2026-02-20T03:02:53.415 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-20T03:02:53.435 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T03:02:53.531 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462 branch: wip-jcollin-testing-20260218.004834-squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} email: jcollin@redhat.com first_in_suite: false flavor: default job_id: '55462' kernel: client: branch: testing sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial mgrmodules: sequential: - print: Enabling mgr modules name: jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-jcollin-testing-20260218.004834-squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - MGR_MODULE_ERROR - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - pg .* is stuck peering - slow metadata IO - SLOW_OPS - slow request sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-jcollin-testing-20260218.004834-squid sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 owner: scheduled_jcollin@soko04.front.sepia.ceph.com priority: 200 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5467 sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 sleep_before_teardown: 0 subset: 663/2048 suite: fs suite_branch: wip-jcollin-testing-20260218.004834-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHQ7qrYYlZz9fmcQ7C/0bjg5HI1kc/DTT6QpVg59dv3WCj0ZlnWxrPTi52uV2fKN22e7Uw5xdkNUJpjXsVgtFpI= trial126.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGXpqRXNaiHz3jLa0uahn8UqTe6zuVDYxHbgYFmN+u4nM8Q92mZweUYjQERrNaygTzHyGGLwBoBQqMZJluvVrM0= trial177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKMT4PDNXlQItXkYuwWYwrTqmNn3gvQ54gIUTvXCZbawjOoGmHdhXenCMJt8sVmAFkzI3kUxM3+qiy78dqufOUE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local branch = yaml.kernel.branch\nif branch and not yaml.kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\", yaml.kernel)\n\ \ py_attrgetter(yaml.kernel).pop('branch', nil)\n py_attrgetter(yaml.kernel).pop('deb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('flavor', nil)\n py_attrgetter(yaml.kernel).pop('kdb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('koji', nil)\n py_attrgetter(yaml.kernel).pop('koji_task',\ \ nil)\n py_attrgetter(yaml.kernel).pop('rpm', nil)\n py_attrgetter(yaml.kernel).pop('sha1',\ \ nil)\n py_attrgetter(yaml.kernel).pop('tag', nil)\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-18_03:11:55 tube: trial user: jcollin verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T03:02:53.531 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa; will attempt to use it 2026-02-20T03:02:53.532 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa/tasks 2026-02-20T03:02:53.532 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T03:02:53.533 INFO:teuthology.task.internal:Checking packages... 2026-02-20T03:02:53.533 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03' 2026-02-20T03:02:53.533 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T03:02:53.534 INFO:teuthology.packaging:ref: None 2026-02-20T03:02:53.534 INFO:teuthology.packaging:tag: None 2026-02-20T03:02:53.534 INFO:teuthology.packaging:branch: wip-jcollin-testing-20260218.004834-squid 2026-02-20T03:02:53.534 INFO:teuthology.packaging:sha1: f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:02:53.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-jcollin-testing-20260218.004834-squid 2026-02-20T03:02:53.650 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-700.gf4ef35d9 2026-02-20T03:02:53.652 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T03:02:53.663 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T03:02:53.663 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T03:02:53.677 INFO:teuthology.task.internal:Saving configuration 2026-02-20T03:02:53.694 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T03:02:53.706 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T03:02:53.780 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial028.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 02:52:47.545802', 'locked_by': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHQ7qrYYlZz9fmcQ7C/0bjg5HI1kc/DTT6QpVg59dv3WCj0ZlnWxrPTi52uV2fKN22e7Uw5xdkNUJpjXsVgtFpI='} 2026-02-20T03:02:53.837 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial126.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 02:52:47.545185', 'locked_by': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGXpqRXNaiHz3jLa0uahn8UqTe6zuVDYxHbgYFmN+u4nM8Q92mZweUYjQERrNaygTzHyGGLwBoBQqMZJluvVrM0='} 2026-02-20T03:02:53.892 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial177.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 02:52:47.546242', 'locked_by': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKMT4PDNXlQItXkYuwWYwrTqmNn3gvQ54gIUTvXCZbawjOoGmHdhXenCMJt8sVmAFkzI3kUxM3+qiy78dqufOUE='} 2026-02-20T03:02:53.892 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T03:02:53.903 INFO:teuthology.task.internal:roles: ubuntu@trial028.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-20T03:02:53.903 INFO:teuthology.task.internal:roles: ubuntu@trial126.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-20T03:02:53.903 INFO:teuthology.task.internal:roles: ubuntu@trial177.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-20T03:02:53.903 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T03:02:54.087 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x76b6245c7060>, signals=[15]) 2026-02-20T03:02:54.087 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T03:02:54.098 INFO:teuthology.task.internal:Opening connections... 2026-02-20T03:02:54.098 DEBUG:teuthology.task.internal:connecting to ubuntu@trial028.front.sepia.ceph.com 2026-02-20T03:02:54.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T03:02:54.163 DEBUG:teuthology.task.internal:connecting to ubuntu@trial126.front.sepia.ceph.com 2026-02-20T03:02:54.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T03:02:54.224 DEBUG:teuthology.task.internal:connecting to ubuntu@trial177.front.sepia.ceph.com 2026-02-20T03:02:54.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T03:02:54.284 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T03:02:54.297 DEBUG:teuthology.orchestra.run.trial028:> uname -m 2026-02-20T03:02:54.315 INFO:teuthology.orchestra.run.trial028.stdout:x86_64 2026-02-20T03:02:54.315 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-20T03:02:54.369 INFO:teuthology.orchestra.run.trial028.stdout:NAME="CentOS Stream" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="9" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:ID="centos" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel fedora" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="9" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el9" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;31" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://centos.org/" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T03:02:54.370 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T03:02:54.370 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-20T03:02:54.436 DEBUG:teuthology.orchestra.run.trial126:> uname -m 2026-02-20T03:02:54.453 INFO:teuthology.orchestra.run.trial126.stdout:x86_64 2026-02-20T03:02:54.453 DEBUG:teuthology.orchestra.run.trial126:> cat /etc/os-release 2026-02-20T03:02:54.510 INFO:teuthology.orchestra.run.trial126.stdout:NAME="CentOS Stream" 2026-02-20T03:02:54.511 INFO:teuthology.orchestra.run.trial126.stdout:VERSION="9" 2026-02-20T03:02:54.511 INFO:teuthology.orchestra.run.trial126.stdout:ID="centos" 2026-02-20T03:02:54.511 INFO:teuthology.orchestra.run.trial126.stdout:ID_LIKE="rhel fedora" 2026-02-20T03:02:54.511 INFO:teuthology.orchestra.run.trial126.stdout:VERSION_ID="9" 2026-02-20T03:02:54.511 INFO:teuthology.orchestra.run.trial126.stdout:PLATFORM_ID="platform:el9" 2026-02-20T03:02:54.511 INFO:teuthology.orchestra.run.trial126.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T03:02:54.511 INFO:teuthology.orchestra.run.trial126.stdout:ANSI_COLOR="0;31" 2026-02-20T03:02:54.511 INFO:teuthology.orchestra.run.trial126.stdout:LOGO="fedora-logo-icon" 2026-02-20T03:02:54.512 INFO:teuthology.orchestra.run.trial126.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T03:02:54.512 INFO:teuthology.orchestra.run.trial126.stdout:HOME_URL="https://centos.org/" 2026-02-20T03:02:54.512 INFO:teuthology.orchestra.run.trial126.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T03:02:54.512 INFO:teuthology.orchestra.run.trial126.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T03:02:54.512 INFO:teuthology.orchestra.run.trial126.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T03:02:54.512 INFO:teuthology.lock.ops:Updating trial126.front.sepia.ceph.com on lock server 2026-02-20T03:02:54.589 DEBUG:teuthology.orchestra.run.trial177:> uname -m 2026-02-20T03:02:54.606 INFO:teuthology.orchestra.run.trial177.stdout:x86_64 2026-02-20T03:02:54.607 DEBUG:teuthology.orchestra.run.trial177:> cat /etc/os-release 2026-02-20T03:02:54.663 INFO:teuthology.orchestra.run.trial177.stdout:NAME="CentOS Stream" 2026-02-20T03:02:54.663 INFO:teuthology.orchestra.run.trial177.stdout:VERSION="9" 2026-02-20T03:02:54.663 INFO:teuthology.orchestra.run.trial177.stdout:ID="centos" 2026-02-20T03:02:54.663 INFO:teuthology.orchestra.run.trial177.stdout:ID_LIKE="rhel fedora" 2026-02-20T03:02:54.663 INFO:teuthology.orchestra.run.trial177.stdout:VERSION_ID="9" 2026-02-20T03:02:54.663 INFO:teuthology.orchestra.run.trial177.stdout:PLATFORM_ID="platform:el9" 2026-02-20T03:02:54.663 INFO:teuthology.orchestra.run.trial177.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T03:02:54.663 INFO:teuthology.orchestra.run.trial177.stdout:ANSI_COLOR="0;31" 2026-02-20T03:02:54.664 INFO:teuthology.orchestra.run.trial177.stdout:LOGO="fedora-logo-icon" 2026-02-20T03:02:54.664 INFO:teuthology.orchestra.run.trial177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T03:02:54.664 INFO:teuthology.orchestra.run.trial177.stdout:HOME_URL="https://centos.org/" 2026-02-20T03:02:54.664 INFO:teuthology.orchestra.run.trial177.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T03:02:54.664 INFO:teuthology.orchestra.run.trial177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T03:02:54.664 INFO:teuthology.orchestra.run.trial177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T03:02:54.664 INFO:teuthology.lock.ops:Updating trial177.front.sepia.ceph.com on lock server 2026-02-20T03:02:54.743 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T03:02:54.756 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T03:02:54.766 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T03:02:54.766 DEBUG:teuthology.orchestra.run.trial028:> test '!' -e /home/ubuntu/cephtest 2026-02-20T03:02:54.768 DEBUG:teuthology.orchestra.run.trial126:> test '!' -e /home/ubuntu/cephtest 2026-02-20T03:02:54.770 DEBUG:teuthology.orchestra.run.trial177:> test '!' -e /home/ubuntu/cephtest 2026-02-20T03:02:54.786 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T03:02:54.797 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T03:02:54.797 DEBUG:teuthology.orchestra.run.trial028:> test -z $(ls -A /var/lib/ceph) 2026-02-20T03:02:54.825 DEBUG:teuthology.orchestra.run.trial126:> test -z $(ls -A /var/lib/ceph) 2026-02-20T03:02:54.827 DEBUG:teuthology.orchestra.run.trial177:> test -z $(ls -A /var/lib/ceph) 2026-02-20T03:02:54.842 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T03:02:55.058 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T03:02:55.076 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'sha1': 'distro'} 2026-02-20T03:02:55.076 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2026-02-20T03:02:55.076 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2026-02-20T03:02:55.076 DEBUG:teuthology.orchestra.run.trial028:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T03:02:55.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:02:55.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2026-02-20T03:02:55.229 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-20T03:02:55.229 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-20T03:02:55.229 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-20T03:02:55.245 INFO:teuthology.orchestra.run.trial028.stdout:5.14.0-681.el9.x86_64 2026-02-20T03:02:55.245 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-20T03:02:55.245 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-20T03:02:55.246 DEBUG:teuthology.orchestra.run.trial028:> sudo yum upgrade -y linux-firmware 2026-02-20T03:02:57.096 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.9 MB 00:01 2026-02-20T03:03:00.142 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-20T03:03:02.730 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 36 MB/s | 7.8 MB 00:00 2026-02-20T03:03:03.908 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 20 kB 00:00 2026-02-20T03:03:04.591 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 33 MB/s | 20 MB 00:00 2026-02-20T03:03:07.750 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-20T03:03:08.792 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T03:03:08.793 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T03:03:08.793 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T03:03:08.817 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-20T03:03:08.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-20T03:03:08.984 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-20T03:03:08.984 DEBUG:teuthology.orchestra.run.trial028:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-20T03:03:08.987 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial028.front.sepia.ceph.com to complete... 2026-02-20T03:03:15.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20 03:03:15 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-20T03:03:15.518 INFO:teuthology.orchestra.run.trial028.stderr:FINISHED --2026-02-20 03:03:15-- 2026-02-20T03:03:15.518 INFO:teuthology.orchestra.run.trial028.stderr:Total wall clock time: 6.5s 2026-02-20T03:03:15.518 INFO:teuthology.orchestra.run.trial028.stderr:Downloaded: 1 files, 370M in 6.4s (57.9 MB/s) 2026-02-20T03:03:15.524 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-20T03:03:15.525 DEBUG:teuthology.orchestra.run.trial028:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-20T03:03:16.654 INFO:teuthology.orchestra.run.trial028.stdout:Verifying... ######################################## 2026-02-20T03:03:16.704 INFO:teuthology.orchestra.run.trial028.stdout:Preparing... ######################################## 2026-02-20T03:03:16.721 INFO:teuthology.orchestra.run.trial028.stdout:Updating / installing... 2026-02-20T03:03:19.899 INFO:teuthology.orchestra.run.trial028.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-20T03:03:36.916 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial028.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-20T03:03:36.917 DEBUG:teuthology.orchestra.run.trial028:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-20T03:03:36.963 INFO:teuthology.orchestra.run.trial028.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-20T03:03:36.963 INFO:teuthology.orchestra.run.trial028.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-20T03:03:36.963 INFO:teuthology.orchestra.run.trial028.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-20T03:03:36.963 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-20T03:03:36.963 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-20T03:03:36.963 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-20T03:03:36.963 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-20T03:03:36.963 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-20T03:03:36.964 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-20T03:03:36.965 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-20T03:03:36.966 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-20T03:03:36.967 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-20T03:03:36.968 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-20T03:03:36.969 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-20T03:03:36.970 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-20T03:03:36.971 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-20T03:03:36.972 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-20T03:03:36.973 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-20T03:03:36.974 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-20T03:03:36.975 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-20T03:03:36.976 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-20T03:03:36.977 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-20T03:03:36.978 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-20T03:03:36.979 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-20T03:03:36.980 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-20T03:03:36.981 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-20T03:03:36.982 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-20T03:03:36.983 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-20T03:03:36.984 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-20T03:03:36.985 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-20T03:03:36.986 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-20T03:03:36.987 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-20T03:03:36.988 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-20T03:03:36.989 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-20T03:03:36.990 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-20T03:03:36.991 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-20T03:03:36.992 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-20T03:03:36.993 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-20T03:03:36.994 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-20T03:03:36.995 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-20T03:03:36.996 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-20T03:03:36.997 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-20T03:03:36.998 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-20T03:03:36.999 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-20T03:03:37.000 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-20T03:03:37.001 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-20T03:03:37.002 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-20T03:03:37.003 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-20T03:03:37.004 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-20T03:03:37.005 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-20T03:03:37.006 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-20T03:03:37.007 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-20T03:03:37.008 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-20T03:03:37.009 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-20T03:03:37.010 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-20T03:03:37.011 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-20T03:03:37.012 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-20T03:03:37.013 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-20T03:03:37.014 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-20T03:03:37.015 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-20T03:03:37.016 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-20T03:03:37.017 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-20T03:03:37.018 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-20T03:03:37.019 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-20T03:03:37.020 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-20T03:03:37.021 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-20T03:03:37.022 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-20T03:03:37.023 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-20T03:03:37.024 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-20T03:03:37.025 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-20T03:03:37.026 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-20T03:03:37.027 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-20T03:03:37.028 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-20T03:03:37.029 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-20T03:03:37.030 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-20T03:03:37.031 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-20T03:03:37.032 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-20T03:03:37.033 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-20T03:03:37.034 INFO:teuthology.orchestra.run.trial028.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-20T03:03:37.036 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-20T03:03:37.036 DEBUG:teuthology.orchestra.run.trial028:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-20T03:03:37.056 INFO:teuthology.orchestra.run.trial028.stdout:postinstall scriptlet (using /bin/sh): 2026-02-20T03:03:37.056 INFO:teuthology.orchestra.run.trial028.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-20T03:03:37.056 INFO:teuthology.orchestra.run.trial028.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-20T03:03:37.056 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-20T03:03:37.056 INFO:teuthology.orchestra.run.trial028.stdout:for file in vmlinuz System.map config; do 2026-02-20T03:03:37.056 INFO:teuthology.orchestra.run.trial028.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout: fi 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout:done 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-20T03:03:37.057 INFO:teuthology.orchestra.run.trial028.stdout:fi 2026-02-20T03:03:37.057 DEBUG:teuthology.orchestra.run.trial028:> sudo rpm -qi grub2-tools 2026-02-20T03:03:37.126 INFO:teuthology.orchestra.run.trial028.stdout:Name : grub2-tools 2026-02-20T03:03:37.126 INFO:teuthology.orchestra.run.trial028.stdout:Epoch : 1 2026-02-20T03:03:37.126 INFO:teuthology.orchestra.run.trial028.stdout:Version : 2.06 2026-02-20T03:03:37.126 INFO:teuthology.orchestra.run.trial028.stdout:Release : 120.el9 2026-02-20T03:03:37.126 INFO:teuthology.orchestra.run.trial028.stdout:Architecture: x86_64 2026-02-20T03:03:37.126 INFO:teuthology.orchestra.run.trial028.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-20T03:03:37.126 INFO:teuthology.orchestra.run.trial028.stdout:Group : Unspecified 2026-02-20T03:03:37.126 INFO:teuthology.orchestra.run.trial028.stdout:Size : 9108611 2026-02-20T03:03:37.126 INFO:teuthology.orchestra.run.trial028.stdout:License : GPLv3+ 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:Packager : builder@centos.org 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:Vendor : CentOS 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:Summary : Support tools for GRUB. 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:Description : 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:hardware devices. 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:03:37.127 INFO:teuthology.orchestra.run.trial028.stdout:This subpackage provides tools for support of all platforms. 2026-02-20T03:03:37.128 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-20T03:03:37.128 INFO:teuthology.task.kernel:Updating grub on trial028 to boot 6.19.0-g8dec4b357aab 2026-02-20T03:03:37.128 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-20T03:03:37.191 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-20T03:03:37.192 DEBUG:teuthology.orchestra.run.trial028:> sudo command -v grubby && echo yes || echo no 2026-02-20T03:03:37.256 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/grubby 2026-02-20T03:03:37.257 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-20T03:03:37.258 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-20T03:03:37.321 INFO:teuthology.orchestra.run.trial028.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-20T03:03:37.323 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-20T03:03:37.395 DEBUG:teuthology.orchestra.run.trial028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-20T03:03:37.602 INFO:teuthology.orchestra.run.trial028.stderr:Generating grub configuration file ... 2026-02-20T03:03:37.668 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-20T03:03:37.675 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-20T03:03:37.923 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-20T03:03:37.930 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-20T03:03:37.964 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-20T03:03:37.971 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-20T03:03:38.002 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-20T03:03:38.008 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-20T03:03:38.031 INFO:teuthology.orchestra.run.trial028.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-20T03:03:38.038 INFO:teuthology.orchestra.run.trial028.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-20T03:03:38.121 INFO:teuthology.orchestra.run.trial028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-20T03:03:38.129 INFO:teuthology.orchestra.run.trial028.stderr:done 2026-02-20T03:03:38.132 DEBUG:teuthology.orchestra.run.trial028:> test -d /sys/firmware/efi 2026-02-20T03:03:38.148 DEBUG:teuthology.orchestra.run.trial028:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-20T03:03:38.212 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/BOOT 2026-02-20T03:03:38.213 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi/EFI/centos 2026-02-20T03:03:38.214 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-20T03:03:38.278 INFO:teuthology.orchestra.run.trial028.stdout:no 2026-02-20T03:03:38.279 DEBUG:teuthology.orchestra.run.trial028:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-20T03:03:38.343 INFO:teuthology.orchestra.run.trial028.stdout:yes 2026-02-20T03:03:38.344 DEBUG:teuthology.orchestra.run.trial028:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-20T03:03:38.408 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial028 2026-02-20T03:03:38.408 DEBUG:teuthology.orchestra.run.trial028:> sudo bash -c ' 2026-02-20T03:03:38.408 DEBUG:teuthology.orchestra.run.trial028:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-20T03:03:38.408 DEBUG:teuthology.orchestra.run.trial028:> ' 2026-02-20T03:04:08.451 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-20T03:04:08.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T03:04:08.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T03:05:08.456 DEBUG:teuthology.orchestra.remote:timed out 2026-02-20T03:05:17.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T03:05:17.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T03:05:17.595 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-20T03:05:17.842 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T03:05:17.843 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.19.0-g8dec4b357aab"... 2026-02-20T03:05:17.843 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-20T03:05:17.919 INFO:teuthology.orchestra.run.trial028.stdout:6.19.0-g8dec4b357aab 2026-02-20T03:05:17.919 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-20T03:05:17.919 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-20T03:05:17.919 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-20T03:05:18.925 DEBUG:teuthology.parallel:result is None 2026-02-20T03:05:18.925 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T03:05:18.936 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T03:05:18.937 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T03:05:18.941 DEBUG:teuthology.orchestra.run.trial126:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T03:05:18.943 DEBUG:teuthology.orchestra.run.trial177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T03:05:18.975 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T03:05:18.987 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T03:05:19.002 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T03:05:19.002 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T03:05:19.018 DEBUG:teuthology.orchestra.run.trial126:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T03:05:19.020 DEBUG:teuthology.orchestra.run.trial177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T03:05:19.065 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T03:05:19.077 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T03:05:19.077 DEBUG:teuthology.orchestra.run.trial126:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T03:05:19.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:05:19.093 DEBUG:teuthology.orchestra.run.trial177:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T03:05:19.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:05:19.109 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T03:05:19.112 DEBUG:teuthology.orchestra.run.trial126:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T03:05:19.135 DEBUG:teuthology.orchestra.run.trial177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T03:05:19.160 INFO:teuthology.orchestra.run.trial126.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T03:05:19.168 INFO:teuthology.orchestra.run.trial126.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T03:05:19.171 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T03:05:19.173 INFO:teuthology.orchestra.run.trial177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T03:05:19.182 INFO:teuthology.orchestra.run.trial177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T03:05:19.192 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T03:05:19.195 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T03:05:19.209 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T03:05:19.209 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T03:05:19.213 DEBUG:teuthology.orchestra.run.trial126:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T03:05:19.216 DEBUG:teuthology.orchestra.run.trial177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T03:05:19.265 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T03:05:19.281 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T03:05:19.282 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T03:05:19.285 DEBUG:teuthology.orchestra.run.trial126:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T03:05:19.288 DEBUG:teuthology.orchestra.run.trial177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T03:05:19.320 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:05:19.461 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:05:19.517 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:05:19.616 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:05:19.672 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:05:19.672 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T03:05:19.724 DEBUG:teuthology.orchestra.run.trial126:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:05:19.843 DEBUG:teuthology.orchestra.run.trial126:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:05:19.868 DEBUG:teuthology.orchestra.run.trial126:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:05:19.989 DEBUG:teuthology.orchestra.run.trial126:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:05:20.014 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:05:20.014 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T03:05:20.077 DEBUG:teuthology.orchestra.run.trial177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:05:20.153 DEBUG:teuthology.orchestra.run.trial177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:05:20.176 DEBUG:teuthology.orchestra.run.trial177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:05:20.310 DEBUG:teuthology.orchestra.run.trial177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:05:20.335 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:05:20.335 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T03:05:20.399 DEBUG:teuthology.orchestra.run.trial028:> sudo service rsyslog restart 2026-02-20T03:05:20.401 DEBUG:teuthology.orchestra.run.trial126:> sudo service rsyslog restart 2026-02-20T03:05:20.403 DEBUG:teuthology.orchestra.run.trial177:> sudo service rsyslog restart 2026-02-20T03:05:20.431 INFO:teuthology.orchestra.run.trial126.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T03:05:20.462 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T03:05:20.467 INFO:teuthology.orchestra.run.trial177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T03:05:20.890 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T03:05:20.905 INFO:teuthology.task.internal:Starting timer... 2026-02-20T03:05:20.905 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T03:05:20.921 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T03:05:20.934 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-20T03:05:20.934 DEBUG:teuthology.orchestra.run.trial028:> sudo service auditd rotate 2026-02-20T03:05:20.998 INFO:teuthology.orchestra.run.trial028.stdout:Rotating logs: 2026-02-20T03:05:21.001 DEBUG:teuthology.orchestra.run.trial126:> sudo service auditd rotate 2026-02-20T03:05:21.030 INFO:teuthology.orchestra.run.trial126.stdout:Rotating logs: 2026-02-20T03:05:21.031 DEBUG:teuthology.orchestra.run.trial177:> sudo service auditd rotate 2026-02-20T03:05:21.060 INFO:teuthology.orchestra.run.trial177.stdout:Rotating logs: 2026-02-20T03:05:21.061 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T03:05:21.061 DEBUG:teuthology.orchestra.run.trial028:> /usr/sbin/getenforce 2026-02-20T03:05:21.097 INFO:teuthology.orchestra.run.trial028.stdout:Permissive 2026-02-20T03:05:21.097 DEBUG:teuthology.orchestra.run.trial126:> /usr/sbin/getenforce 2026-02-20T03:05:21.113 INFO:teuthology.orchestra.run.trial126.stdout:Permissive 2026-02-20T03:05:21.113 DEBUG:teuthology.orchestra.run.trial177:> /usr/sbin/getenforce 2026-02-20T03:05:21.128 INFO:teuthology.orchestra.run.trial177.stdout:Permissive 2026-02-20T03:05:21.128 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial028.front.sepia.ceph.com': 'permissive', 'ubuntu@trial126.front.sepia.ceph.com': 'permissive', 'ubuntu@trial177.front.sepia.ceph.com': 'permissive'} 2026-02-20T03:05:21.128 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T03:05:21.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:05:21.194 DEBUG:teuthology.orchestra.run.trial126:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T03:05:21.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:05:21.219 DEBUG:teuthology.orchestra.run.trial177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T03:05:21.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:05:21.243 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T03:05:21.243 DEBUG:teuthology.orchestra.run.trial028:> sudo /usr/sbin/setenforce permissive 2026-02-20T03:05:21.297 DEBUG:teuthology.orchestra.run.trial126:> sudo /usr/sbin/setenforce permissive 2026-02-20T03:05:21.322 DEBUG:teuthology.orchestra.run.trial177:> sudo /usr/sbin/setenforce permissive 2026-02-20T03:05:21.346 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T03:05:21.360 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-20T03:05:21.363 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-20T03:05:21.478 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T03:05:21.485 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T03:05:21.486 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial028.front.sepia.ceph.com,trial126.front.sepia.ceph.com,trial177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T03:09:16.858 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial028.front.sepia.ceph.com'), Remote(name='ubuntu@trial126.front.sepia.ceph.com'), Remote(name='ubuntu@trial177.front.sepia.ceph.com')] 2026-02-20T03:09:16.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T03:09:16.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T03:09:16.986 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-20T03:09:17.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T03:09:17.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-20T03:09:17.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial126.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T03:09:17.178 DEBUG:teuthology.orchestra.run.trial126:> true 2026-02-20T03:09:17.259 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial126.front.sepia.ceph.com' 2026-02-20T03:09:17.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-20T03:09:17.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T03:09:17.340 DEBUG:teuthology.orchestra.run.trial177:> true 2026-02-20T03:09:17.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial177.front.sepia.ceph.com' 2026-02-20T03:09:17.419 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T03:09:17.431 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T03:09:17.432 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T03:09:17.432 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T03:09:17.435 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T03:09:17.435 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T03:09:17.438 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T03:09:17.439 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T03:09:17.463 INFO:teuthology.orchestra.run.trial126.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T03:09:17.475 INFO:teuthology.orchestra.run.trial126.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T03:09:17.487 INFO:teuthology.orchestra.run.trial177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T03:09:17.492 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T03:09:17.496 INFO:teuthology.orchestra.run.trial126.stderr:sudo: ntpd: command not found 2026-02-20T03:09:17.498 INFO:teuthology.orchestra.run.trial177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T03:09:17.505 INFO:teuthology.orchestra.run.trial126.stdout:506 Cannot talk to daemon 2026-02-20T03:09:17.517 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T03:09:17.518 INFO:teuthology.orchestra.run.trial126.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T03:09:17.518 INFO:teuthology.orchestra.run.trial177.stderr:sudo: ntpd: command not found 2026-02-20T03:09:17.527 INFO:teuthology.orchestra.run.trial177.stdout:506 Cannot talk to daemon 2026-02-20T03:09:17.529 INFO:teuthology.orchestra.run.trial126.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T03:09:17.538 INFO:teuthology.orchestra.run.trial177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T03:09:17.550 INFO:teuthology.orchestra.run.trial177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T03:09:17.561 INFO:teuthology.orchestra.run.trial028.stderr:sudo: ntpd: command not found 2026-02-20T03:09:17.582 INFO:teuthology.orchestra.run.trial126.stderr:bash: line 1: ntpq: command not found 2026-02-20T03:09:17.583 INFO:teuthology.orchestra.run.trial028.stdout:506 Cannot talk to daemon 2026-02-20T03:09:17.584 INFO:teuthology.orchestra.run.trial126.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T03:09:17.584 INFO:teuthology.orchestra.run.trial126.stdout:=============================================================================== 2026-02-20T03:09:17.593 INFO:teuthology.orchestra.run.trial177.stderr:bash: line 1: ntpq: command not found 2026-02-20T03:09:17.596 INFO:teuthology.orchestra.run.trial177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T03:09:17.596 INFO:teuthology.orchestra.run.trial177.stdout:=============================================================================== 2026-02-20T03:09:17.608 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T03:09:17.633 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T03:09:17.711 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-20T03:09:17.725 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T03:09:17.726 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-20T03:09:17.726 INFO:teuthology.orchestra.run.trial028.stdout:^? 172-233-157-223.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T03:09:17.726 INFO:teuthology.orchestra.run.trial028.stdout:^? connected.by.freedominte> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T03:09:17.726 INFO:teuthology.orchestra.run.trial028.stdout:^? ntp.swyn.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T03:09:17.728 INFO:teuthology.run_tasks:Running task install... 2026-02-20T03:09:17.742 DEBUG:teuthology.task.install:project ceph 2026-02-20T03:09:17.742 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03'}} 2026-02-20T03:09:17.743 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03'} 2026-02-20T03:09:17.743 INFO:teuthology.task.install:Using flavor: default 2026-02-20T03:09:17.752 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T03:09:17.752 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-20T03:09:17.753 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', 'tag': None, 'wait_for_package': False} 2026-02-20T03:09:17.754 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:09:17.757 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', 'tag': None, 'wait_for_package': False} 2026-02-20T03:09:17.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:09:17.759 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', 'tag': None, 'wait_for_package': False} 2026-02-20T03:09:17.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:09:17.977 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/ 2026-02-20T03:09:17.977 INFO:teuthology.task.install.rpm:Package version is 19.2.3-700.gf4ef35d9 2026-02-20T03:09:17.988 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/ 2026-02-20T03:09:17.988 INFO:teuthology.task.install.rpm:Package version is 19.2.3-700.gf4ef35d9 2026-02-20T03:09:17.989 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/ 2026-02-20T03:09:17.989 INFO:teuthology.task.install.rpm:Package version is 19.2.3-700.gf4ef35d9 2026-02-20T03:09:18.172 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T03:09:18.172 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:09:18.172 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T03:09:18.174 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T03:09:18.174 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:09:18.174 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T03:09:18.182 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T03:09:18.182 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:09:18.182 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T03:09:18.199 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-20T03:09:18.199 DEBUG:teuthology.orchestra.run.trial126:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T03:09:18.207 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-20T03:09:18.207 DEBUG:teuthology.orchestra.run.trial177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T03:09:18.231 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-20T03:09:18.231 DEBUG:teuthology.orchestra.run.trial028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T03:09:18.265 DEBUG:teuthology.orchestra.run.trial126:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T03:09:18.272 DEBUG:teuthology.orchestra.run.trial177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T03:09:18.329 DEBUG:teuthology.orchestra.run.trial028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T03:09:18.340 DEBUG:teuthology.orchestra.run.trial126:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T03:09:18.345 DEBUG:teuthology.orchestra.run.trial177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T03:09:18.405 DEBUG:teuthology.orchestra.run.trial028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T03:09:18.406 INFO:teuthology.orchestra.run.trial126.stdout:check_obsoletes = 1 2026-02-20T03:09:18.407 DEBUG:teuthology.orchestra.run.trial126:> sudo yum clean all 2026-02-20T03:09:18.408 INFO:teuthology.orchestra.run.trial177.stdout:check_obsoletes = 1 2026-02-20T03:09:18.410 DEBUG:teuthology.orchestra.run.trial177:> sudo yum clean all 2026-02-20T03:09:18.462 INFO:teuthology.orchestra.run.trial028.stdout:check_obsoletes = 1 2026-02-20T03:09:18.464 DEBUG:teuthology.orchestra.run.trial028:> sudo yum clean all 2026-02-20T03:09:18.568 INFO:teuthology.orchestra.run.trial126.stdout:41 files removed 2026-02-20T03:09:18.569 INFO:teuthology.orchestra.run.trial177.stdout:41 files removed 2026-02-20T03:09:18.583 DEBUG:teuthology.orchestra.run.trial126:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-20T03:09:18.584 DEBUG:teuthology.orchestra.run.trial177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-20T03:09:18.634 INFO:teuthology.orchestra.run.trial028.stdout:41 files removed 2026-02-20T03:09:18.652 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-20T03:09:18.865 INFO:teuthology.orchestra.run.trial177.stdout:ceph packages for x86_64 648 kB/s | 86 kB 00:00 2026-02-20T03:09:18.866 INFO:teuthology.orchestra.run.trial126.stdout:ceph packages for x86_64 623 kB/s | 86 kB 00:00 2026-02-20T03:09:18.996 INFO:teuthology.orchestra.run.trial177.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-20T03:09:18.999 INFO:teuthology.orchestra.run.trial126.stdout:ceph noarch packages 111 kB/s | 12 kB 00:00 2026-02-20T03:09:19.023 INFO:teuthology.orchestra.run.trial028.stdout:ceph packages for x86_64 677 kB/s | 86 kB 00:00 2026-02-20T03:09:19.123 INFO:teuthology.orchestra.run.trial177.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-20T03:09:19.126 INFO:teuthology.orchestra.run.trial126.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-20T03:09:19.157 INFO:teuthology.orchestra.run.trial028.stdout:ceph noarch packages 113 kB/s | 12 kB 00:00 2026-02-20T03:09:19.286 INFO:teuthology.orchestra.run.trial028.stdout:ceph source packages 17 kB/s | 1.9 kB 00:00 2026-02-20T03:09:19.436 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - BaseOS 31 MB/s | 8.9 MB 00:00 2026-02-20T03:09:19.852 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-20T03:09:20.664 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.9 MB 00:01 2026-02-20T03:09:22.609 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T03:09:23.241 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 27 MB 00:02 2026-02-20T03:09:23.730 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-20T03:09:27.280 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 7.8 MB 00:01 2026-02-20T03:09:27.287 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 7.8 MB 00:00 2026-02-20T03:09:28.354 INFO:teuthology.orchestra.run.trial177.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 20 kB 00:00 2026-02-20T03:09:29.208 INFO:teuthology.orchestra.run.trial177.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-20T03:09:29.386 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-20T03:09:30.105 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 31 MB/s | 20 MB 00:00 2026-02-20T03:09:32.425 INFO:teuthology.orchestra.run.trial177.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-20T03:09:33.622 INFO:teuthology.orchestra.run.trial177.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T03:09:33.622 INFO:teuthology.orchestra.run.trial177.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T03:09:33.628 INFO:teuthology.orchestra.run.trial177.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-20T03:09:33.628 INFO:teuthology.orchestra.run.trial177.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-20T03:09:33.629 INFO:teuthology.orchestra.run.trial177.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-20T03:09:33.629 INFO:teuthology.orchestra.run.trial177.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-20T03:09:33.630 INFO:teuthology.orchestra.run.trial177.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-20T03:09:33.631 INFO:teuthology.orchestra.run.trial177.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-20T03:09:33.632 INFO:teuthology.orchestra.run.trial177.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-20T03:09:33.658 INFO:teuthology.orchestra.run.trial177.stdout:Dependencies resolved. 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout:====================================================================================== 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: Package Arch Version Repository Size 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout:====================================================================================== 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout:Installing: 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 6.5 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-base x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.5 M 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.2 M 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 145 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.1 M 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 150 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-dashboard noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 3.8 M 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 7.4 M 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-rook noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 49 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-radosgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 11 M 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-test x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 50 M 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: ceph-volume noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 299 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 769 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-mirror x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 233 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-shell x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 27 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-top noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 18 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 34 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 999 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: librados-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 126 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-20T03:09:33.663 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: python3-cephfs x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 165 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: python3-rados x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 322 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: python3-rbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 303 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: python3-rgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 100 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: rbd-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 85 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: rbd-mirror x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.1 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: rbd-nbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 170 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout:Upgrading: 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: librados2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.4 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: librbd1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.2 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout:Installing dependencies: 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 22 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: ceph-grafana-dashboards noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 31 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mds x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 2.4 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-modules-core noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 253 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mon x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 4.7 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 17 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: ceph-prometheus-alerts noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 17 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: ceph-selinux x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 25 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: libcephsqlite x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 163 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T03:09:33.664 INFO:teuthology.orchestra.run.trial177.stdout: libradosstriper1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 504 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: librgw2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.4 M 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-argparse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 45 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 142 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T03:09:33.665 INFO:teuthology.orchestra.run.trial177.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-20T03:09:33.666 INFO:teuthology.orchestra.run.trial177.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout:Installing weak dependencies: 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 22 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout:Transaction Summary 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout:====================================================================================== 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout:Install 170 Packages 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout:Upgrade 2 Packages 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout:Total download size: 230 M 2026-02-20T03:09:33.667 INFO:teuthology.orchestra.run.trial177.stdout:Downloading Packages: 2026-02-20T03:09:33.792 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - CRB 902 kB/s | 7.8 MB 00:08 2026-02-20T03:09:34.050 INFO:teuthology.orchestra.run.trial177.stdout:(1/172): ceph-19.2.3-700.gf4ef35d9.el9.x86_64.r 102 kB/s | 6.5 kB 00:00 2026-02-20T03:09:34.180 INFO:teuthology.orchestra.run.trial177.stdout:(2/172): ceph-fuse-19.2.3-700.gf4ef35d9.el9.x86 8.9 MB/s | 1.2 MB 00:00 2026-02-20T03:09:34.224 INFO:teuthology.orchestra.run.trial177.stdout:(3/172): ceph-immutable-object-cache-19.2.3-700 3.2 MB/s | 145 kB 00:00 2026-02-20T03:09:34.246 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-20T03:09:34.270 INFO:teuthology.orchestra.run.trial177.stdout:(4/172): ceph-base-19.2.3-700.gf4ef35d9.el9.x86 19 MB/s | 5.5 MB 00:00 2026-02-20T03:09:34.329 INFO:teuthology.orchestra.run.trial177.stdout:(5/172): ceph-mgr-19.2.3-700.gf4ef35d9.el9.x86_ 18 MB/s | 1.1 MB 00:00 2026-02-20T03:09:34.384 INFO:teuthology.orchestra.run.trial177.stdout:(6/172): ceph-mds-19.2.3-700.gf4ef35d9.el9.x86_ 15 MB/s | 2.4 MB 00:00 2026-02-20T03:09:34.607 INFO:teuthology.orchestra.run.trial177.stdout:(7/172): ceph-mon-19.2.3-700.gf4ef35d9.el9.x86_ 17 MB/s | 4.7 MB 00:00 2026-02-20T03:09:34.719 INFO:teuthology.orchestra.run.trial126.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 20 kB 00:00 2026-02-20T03:09:35.088 INFO:teuthology.orchestra.run.trial177.stdout:(8/172): ceph-common-19.2.3-700.gf4ef35d9.el9.x 20 MB/s | 22 MB 00:01 2026-02-20T03:09:35.104 INFO:teuthology.orchestra.run.trial177.stdout:(9/172): ceph-radosgw-19.2.3-700.gf4ef35d9.el9. 22 MB/s | 11 MB 00:00 2026-02-20T03:09:35.104 INFO:teuthology.orchestra.run.trial177.stdout:(10/172): ceph-selinux-19.2.3-700.gf4ef35d9.el9 1.5 MB/s | 25 kB 00:00 2026-02-20T03:09:35.146 INFO:teuthology.orchestra.run.trial177.stdout:(11/172): cephfs-mirror-19.2.3-700.gf4ef35d9.el 5.4 MB/s | 233 kB 00:00 2026-02-20T03:09:35.183 INFO:teuthology.orchestra.run.trial177.stdout:(12/172): cephfs-shell-19.2.3-700.gf4ef35d9.el9 731 kB/s | 27 kB 00:00 2026-02-20T03:09:35.221 INFO:teuthology.orchestra.run.trial177.stdout:(13/172): libcephfs-devel-19.2.3-700.gf4ef35d9. 897 kB/s | 34 kB 00:00 2026-02-20T03:09:35.277 INFO:teuthology.orchestra.run.trial177.stdout:(14/172): libcephfs2-19.2.3-700.gf4ef35d9.el9.x 17 MB/s | 999 kB 00:00 2026-02-20T03:09:35.317 INFO:teuthology.orchestra.run.trial177.stdout:(15/172): libcephsqlite-19.2.3-700.gf4ef35d9.el 4.0 MB/s | 163 kB 00:00 2026-02-20T03:09:35.348 INFO:teuthology.orchestra.run.trial177.stdout:(16/172): ceph-osd-19.2.3-700.gf4ef35d9.el9.x86 18 MB/s | 17 MB 00:00 2026-02-20T03:09:35.349 INFO:teuthology.orchestra.run.trial177.stdout:(17/172): librados-devel-19.2.3-700.gf4ef35d9.e 3.9 MB/s | 126 kB 00:00 2026-02-20T03:09:35.378 INFO:teuthology.orchestra.run.trial177.stdout:(18/172): libradosstriper1-19.2.3-700.gf4ef35d9 17 MB/s | 504 kB 00:00 2026-02-20T03:09:35.420 INFO:teuthology.orchestra.run.trial177.stdout:(19/172): python3-ceph-argparse-19.2.3-700.gf4e 1.1 MB/s | 45 kB 00:00 2026-02-20T03:09:35.464 INFO:teuthology.orchestra.run.trial177.stdout:(20/172): python3-ceph-common-19.2.3-700.gf4ef3 3.2 MB/s | 142 kB 00:00 2026-02-20T03:09:35.509 INFO:teuthology.orchestra.run.trial177.stdout:(21/172): python3-cephfs-19.2.3-700.gf4ef35d9.e 3.5 MB/s | 165 kB 00:00 2026-02-20T03:09:35.510 INFO:teuthology.orchestra.run.trial028.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T03:09:35.510 INFO:teuthology.orchestra.run.trial028.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T03:09:35.516 INFO:teuthology.orchestra.run.trial028.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-20T03:09:35.517 INFO:teuthology.orchestra.run.trial028.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-20T03:09:35.517 INFO:teuthology.orchestra.run.trial028.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-20T03:09:35.518 INFO:teuthology.orchestra.run.trial028.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-20T03:09:35.519 INFO:teuthology.orchestra.run.trial028.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-20T03:09:35.520 INFO:teuthology.orchestra.run.trial028.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-20T03:09:35.520 INFO:teuthology.orchestra.run.trial028.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-20T03:09:35.549 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T03:09:35.554 INFO:teuthology.orchestra.run.trial028.stdout:====================================================================================== 2026-02-20T03:09:35.554 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-20T03:09:35.554 INFO:teuthology.orchestra.run.trial028.stdout:====================================================================================== 2026-02-20T03:09:35.554 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T03:09:35.554 INFO:teuthology.orchestra.run.trial028.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-20T03:09:35.554 INFO:teuthology.orchestra.run.trial028.stdout: ceph x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 6.5 k 2026-02-20T03:09:35.554 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.5 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.2 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 145 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.1 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 150 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 3.8 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 7.4 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 49 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 11 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 50 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 299 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 769 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-mirror x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 233 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-shell x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 27 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-top noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 18 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 34 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 999 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 126 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 165 k 2026-02-20T03:09:35.555 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 322 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 303 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 100 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 85 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.1 M 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 170 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout:Upgrading: 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: librados2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.4 M 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: librbd1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.2 M 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 22 M 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 31 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 2.4 M 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 253 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 4.7 M 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 17 M 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 17 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 25 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T03:09:35.556 INFO:teuthology.orchestra.run.trial028.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 163 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 504 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: librgw2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.4 M 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-20T03:09:35.557 INFO:teuthology.orchestra.run.trial028.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 45 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 142 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T03:09:35.558 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T03:09:35.559 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout:Installing weak dependencies: 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 22 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T03:09:35.560 INFO:teuthology.orchestra.run.trial028.stdout:====================================================================================== 2026-02-20T03:09:35.561 INFO:teuthology.orchestra.run.trial028.stdout:Install 170 Packages 2026-02-20T03:09:35.561 INFO:teuthology.orchestra.run.trial028.stdout:Upgrade 2 Packages 2026-02-20T03:09:35.561 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:09:35.561 INFO:teuthology.orchestra.run.trial177.stdout:(22/172): python3-rados-19.2.3-700.gf4ef35d9.el 6.4 MB/s | 322 kB 00:00 2026-02-20T03:09:35.561 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 230 M 2026-02-20T03:09:35.561 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T03:09:35.580 INFO:teuthology.orchestra.run.trial177.stdout:(23/172): librgw2-19.2.3-700.gf4ef35d9.el9.x86_ 23 MB/s | 5.4 MB 00:00 2026-02-20T03:09:35.603 INFO:teuthology.orchestra.run.trial177.stdout:(24/172): python3-rbd-19.2.3-700.gf4ef35d9.el9. 6.7 MB/s | 303 kB 00:00 2026-02-20T03:09:35.610 INFO:teuthology.orchestra.run.trial177.stdout:(25/172): python3-rgw-19.2.3-700.gf4ef35d9.el9. 3.3 MB/s | 100 kB 00:00 2026-02-20T03:09:35.630 INFO:teuthology.orchestra.run.trial177.stdout:(26/172): rbd-fuse-19.2.3-700.gf4ef35d9.el9.x86 3.1 MB/s | 85 kB 00:00 2026-02-20T03:09:35.675 INFO:teuthology.orchestra.run.trial177.stdout:(27/172): rbd-nbd-19.2.3-700.gf4ef35d9.el9.x86_ 3.7 MB/s | 170 kB 00:00 2026-02-20T03:09:35.718 INFO:teuthology.orchestra.run.trial177.stdout:(28/172): ceph-grafana-dashboards-19.2.3-700.gf 722 kB/s | 31 kB 00:00 2026-02-20T03:09:35.743 INFO:teuthology.orchestra.run.trial177.stdout:(29/172): rbd-mirror-19.2.3-700.gf4ef35d9.el9.x 24 MB/s | 3.1 MB 00:00 2026-02-20T03:09:35.759 INFO:teuthology.orchestra.run.trial177.stdout:(30/172): ceph-mgr-cephadm-19.2.3-700.gf4ef35d9 3.6 MB/s | 150 kB 00:00 2026-02-20T03:09:35.954 INFO:teuthology.orchestra.run.trial177.stdout:(31/172): ceph-mgr-dashboard-19.2.3-700.gf4ef35 18 MB/s | 3.8 MB 00:00 2026-02-20T03:09:35.994 INFO:teuthology.orchestra.run.trial177.stdout:(32/172): ceph-mgr-k8sevents-19.2.3-700.gf4ef35 553 kB/s | 22 kB 00:00 2026-02-20T03:09:36.038 INFO:teuthology.orchestra.run.trial177.stdout:(33/172): ceph-mgr-modules-core-19.2.3-700.gf4e 5.6 MB/s | 253 kB 00:00 2026-02-20T03:09:36.073 INFO:teuthology.orchestra.run.trial028.stdout:(1/172): ceph-19.2.3-700.gf4ef35d9.el9.x86_64.r 31 kB/s | 6.5 kB 00:00 2026-02-20T03:09:36.079 INFO:teuthology.orchestra.run.trial177.stdout:(34/172): ceph-mgr-rook-19.2.3-700.gf4ef35d9.el 1.2 MB/s | 49 kB 00:00 2026-02-20T03:09:36.121 INFO:teuthology.orchestra.run.trial177.stdout:(35/172): ceph-prometheus-alerts-19.2.3-700.gf4 404 kB/s | 17 kB 00:00 2026-02-20T03:09:36.169 INFO:teuthology.orchestra.run.trial177.stdout:(36/172): ceph-volume-19.2.3-700.gf4ef35d9.el9. 6.1 MB/s | 299 kB 00:00 2026-02-20T03:09:36.187 INFO:teuthology.orchestra.run.trial177.stdout:(37/172): ceph-mgr-diskprediction-local-19.2.3- 17 MB/s | 7.4 MB 00:00 2026-02-20T03:09:36.216 INFO:teuthology.orchestra.run.trial177.stdout:(38/172): cephadm-19.2.3-700.gf4ef35d9.el9.noar 16 MB/s | 769 kB 00:00 2026-02-20T03:09:36.234 INFO:teuthology.orchestra.run.trial177.stdout:(39/172): cephfs-top-19.2.3-700.gf4ef35d9.el9.n 394 kB/s | 18 kB 00:00 2026-02-20T03:09:36.590 INFO:teuthology.orchestra.run.trial028.stdout:(2/172): ceph-fuse-19.2.3-700.gf4ef35d9.el9.x86 2.2 MB/s | 1.2 MB 00:00 2026-02-20T03:09:36.662 INFO:teuthology.orchestra.run.trial028.stdout:(3/172): ceph-immutable-object-cache-19.2.3-700 2.0 MB/s | 145 kB 00:00 2026-02-20T03:09:36.780 INFO:teuthology.orchestra.run.trial177.stdout:(40/172): ledmon-libs-1.1.0-3.el9.x86_64.rpm 74 kB/s | 40 kB 00:00 2026-02-20T03:09:36.944 INFO:teuthology.orchestra.run.trial177.stdout:(41/172): ceph-test-19.2.3-700.gf4ef35d9.el9.x8 27 MB/s | 50 MB 00:01 2026-02-20T03:09:36.997 INFO:teuthology.orchestra.run.trial177.stdout:(42/172): libconfig-1.7.2-9.el9.x86_64.rpm 332 kB/s | 72 kB 00:00 2026-02-20T03:09:37.015 INFO:teuthology.orchestra.run.trial028.stdout:(4/172): ceph-common-19.2.3-700.gf4ef35d9.el9.x 19 MB/s | 22 MB 00:01 2026-02-20T03:09:37.026 INFO:teuthology.orchestra.run.trial028.stdout:(5/172): ceph-base-19.2.3-700.gf4ef35d9.el9.x86 4.7 MB/s | 5.5 MB 00:01 2026-02-20T03:09:37.077 INFO:teuthology.orchestra.run.trial028.stdout:(6/172): ceph-mgr-19.2.3-700.gf4ef35d9.el9.x86_ 17 MB/s | 1.1 MB 00:00 2026-02-20T03:09:37.110 INFO:teuthology.orchestra.run.trial028.stdout:(7/172): ceph-mds-19.2.3-700.gf4ef35d9.el9.x86_ 5.4 MB/s | 2.4 MB 00:00 2026-02-20T03:09:37.139 INFO:teuthology.orchestra.run.trial177.stdout:(43/172): cryptsetup-2.8.1-3.el9.x86_64.rpm 380 kB/s | 351 kB 00:00 2026-02-20T03:09:37.150 INFO:teuthology.orchestra.run.trial028.stdout:(8/172): ceph-mon-19.2.3-700.gf4ef35d9.el9.x86_ 38 MB/s | 4.7 MB 00:00 2026-02-20T03:09:37.167 INFO:teuthology.orchestra.run.trial028.stdout:(9/172): ceph-selinux-19.2.3-700.gf4ef35d9.el9. 1.5 MB/s | 25 kB 00:00 2026-02-20T03:09:37.200 INFO:teuthology.orchestra.run.trial126.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 20 MB 00:02 2026-02-20T03:09:37.239 INFO:teuthology.orchestra.run.trial177.stdout:(44/172): mailcap-2.1.49-5.el9.noarch.rpm 334 kB/s | 33 kB 00:00 2026-02-20T03:09:37.250 INFO:teuthology.orchestra.run.trial177.stdout:(45/172): libquadmath-11.5.0-14.el9.x86_64.rpm 728 kB/s | 184 kB 00:00 2026-02-20T03:09:37.427 INFO:teuthology.orchestra.run.trial177.stdout:(46/172): pciutils-3.7.0-7.el9.x86_64.rpm 530 kB/s | 93 kB 00:00 2026-02-20T03:09:37.759 INFO:teuthology.orchestra.run.trial177.stdout:(47/172): python3-cffi-1.14.5-5.el9.x86_64.rpm 762 kB/s | 253 kB 00:00 2026-02-20T03:09:38.076 INFO:teuthology.orchestra.run.trial028.stdout:(10/172): ceph-osd-19.2.3-700.gf4ef35d9.el9.x86 17 MB/s | 17 MB 00:00 2026-02-20T03:09:38.107 INFO:teuthology.orchestra.run.trial028.stdout:(11/172): cephfs-mirror-19.2.3-700.gf4ef35d9.el 7.6 MB/s | 233 kB 00:00 2026-02-20T03:09:38.152 INFO:teuthology.orchestra.run.trial028.stdout:(12/172): cephfs-shell-19.2.3-700.gf4ef35d9.el9 606 kB/s | 27 kB 00:00 2026-02-20T03:09:38.185 INFO:teuthology.orchestra.run.trial028.stdout:(13/172): ceph-radosgw-19.2.3-700.gf4ef35d9.el9 10 MB/s | 11 MB 00:01 2026-02-20T03:09:38.186 INFO:teuthology.orchestra.run.trial028.stdout:(14/172): libcephfs-devel-19.2.3-700.gf4ef35d9. 972 kB/s | 34 kB 00:00 2026-02-20T03:09:38.236 INFO:teuthology.orchestra.run.trial028.stdout:(15/172): libcephsqlite-19.2.3-700.gf4ef35d9.el 3.2 MB/s | 163 kB 00:00 2026-02-20T03:09:38.256 INFO:teuthology.orchestra.run.trial028.stdout:(16/172): libcephfs2-19.2.3-700.gf4ef35d9.el9.x 14 MB/s | 999 kB 00:00 2026-02-20T03:09:38.272 INFO:teuthology.orchestra.run.trial028.stdout:(17/172): librados-devel-19.2.3-700.gf4ef35d9.e 3.4 MB/s | 126 kB 00:00 2026-02-20T03:09:38.300 INFO:teuthology.orchestra.run.trial028.stdout:(18/172): libradosstriper1-19.2.3-700.gf4ef35d9 11 MB/s | 504 kB 00:00 2026-02-20T03:09:38.309 INFO:teuthology.orchestra.run.trial177.stdout:(48/172): libgfortran-11.5.0-14.el9.x86_64.rpm 582 kB/s | 794 kB 00:01 2026-02-20T03:09:38.357 INFO:teuthology.orchestra.run.trial028.stdout:(19/172): python3-ceph-argparse-19.2.3-700.gf4e 801 kB/s | 45 kB 00:00 2026-02-20T03:09:38.418 INFO:teuthology.orchestra.run.trial028.stdout:(20/172): python3-ceph-common-19.2.3-700.gf4ef3 2.3 MB/s | 142 kB 00:00 2026-02-20T03:09:38.480 INFO:teuthology.orchestra.run.trial028.stdout:(21/172): python3-cephfs-19.2.3-700.gf4ef35d9.e 2.6 MB/s | 165 kB 00:00 2026-02-20T03:09:38.488 INFO:teuthology.orchestra.run.trial177.stdout:(49/172): python3-ply-3.11-14.el9.noarch.rpm 596 kB/s | 106 kB 00:00 2026-02-20T03:09:38.517 INFO:teuthology.orchestra.run.trial028.stdout:(22/172): librgw2-19.2.3-700.gf4ef35d9.el9.x86_ 22 MB/s | 5.4 MB 00:00 2026-02-20T03:09:38.536 INFO:teuthology.orchestra.run.trial028.stdout:(23/172): python3-rados-19.2.3-700.gf4ef35d9.el 5.6 MB/s | 322 kB 00:00 2026-02-20T03:09:38.562 INFO:teuthology.orchestra.run.trial028.stdout:(24/172): python3-rbd-19.2.3-700.gf4ef35d9.el9. 6.7 MB/s | 303 kB 00:00 2026-02-20T03:09:38.576 INFO:teuthology.orchestra.run.trial028.stdout:(25/172): python3-rgw-19.2.3-700.gf4ef35d9.el9. 2.5 MB/s | 100 kB 00:00 2026-02-20T03:09:38.596 INFO:teuthology.orchestra.run.trial177.stdout:(50/172): nvme-cli-2.16-1.el9.x86_64.rpm 868 kB/s | 1.2 MB 00:01 2026-02-20T03:09:38.598 INFO:teuthology.orchestra.run.trial028.stdout:(26/172): rbd-fuse-19.2.3-700.gf4ef35d9.el9.x86 2.3 MB/s | 85 kB 00:00 2026-02-20T03:09:38.668 INFO:teuthology.orchestra.run.trial177.stdout:(51/172): python3-pycparser-2.20-6.el9.noarch.r 755 kB/s | 135 kB 00:00 2026-02-20T03:09:38.701 INFO:teuthology.orchestra.run.trial028.stdout:(27/172): ceph-test-19.2.3-700.gf4ef35d9.el9.x8 32 MB/s | 50 MB 00:01 2026-02-20T03:09:38.703 INFO:teuthology.orchestra.run.trial028.stdout:(28/172): rbd-nbd-19.2.3-700.gf4ef35d9.el9.x86_ 1.6 MB/s | 170 kB 00:00 2026-02-20T03:09:38.713 INFO:teuthology.orchestra.run.trial028.stdout:(29/172): ceph-grafana-dashboards-19.2.3-700.gf 2.4 MB/s | 31 kB 00:00 2026-02-20T03:09:38.722 INFO:teuthology.orchestra.run.trial028.stdout:(30/172): ceph-mgr-cephadm-19.2.3-700.gf4ef35d9 7.4 MB/s | 150 kB 00:00 2026-02-20T03:09:38.734 INFO:teuthology.orchestra.run.trial028.stdout:(31/172): rbd-mirror-19.2.3-700.gf4ef35d9.el9.x 20 MB/s | 3.1 MB 00:00 2026-02-20T03:09:38.795 INFO:teuthology.orchestra.run.trial028.stdout:(32/172): ceph-mgr-k8sevents-19.2.3-700.gf4ef35 367 kB/s | 22 kB 00:00 2026-02-20T03:09:38.846 INFO:teuthology.orchestra.run.trial177.stdout:(52/172): python3-requests-2.25.1-10.el9.noarch 708 kB/s | 126 kB 00:00 2026-02-20T03:09:38.853 INFO:teuthology.orchestra.run.trial177.stdout:(53/172): python3-pyparsing-2.4.7-9.el9.noarch. 586 kB/s | 150 kB 00:00 2026-02-20T03:09:38.860 INFO:teuthology.orchestra.run.trial028.stdout:(33/172): ceph-mgr-dashboard-19.2.3-700.gf4ef35 26 MB/s | 3.8 MB 00:00 2026-02-20T03:09:38.862 INFO:teuthology.orchestra.run.trial028.stdout:(34/172): ceph-mgr-modules-core-19.2.3-700.gf4e 3.7 MB/s | 253 kB 00:00 2026-02-20T03:09:38.894 INFO:teuthology.orchestra.run.trial028.stdout:(35/172): ceph-mgr-rook-19.2.3-700.gf4ef35d9.el 1.4 MB/s | 49 kB 00:00 2026-02-20T03:09:38.896 INFO:teuthology.orchestra.run.trial028.stdout:(36/172): ceph-prometheus-alerts-19.2.3-700.gf4 494 kB/s | 17 kB 00:00 2026-02-20T03:09:38.940 INFO:teuthology.orchestra.run.trial028.stdout:(37/172): ceph-mgr-diskprediction-local-19.2.3- 34 MB/s | 7.4 MB 00:00 2026-02-20T03:09:38.943 INFO:teuthology.orchestra.run.trial028.stdout:(38/172): ceph-volume-19.2.3-700.gf4ef35d9.el9. 5.9 MB/s | 299 kB 00:00 2026-02-20T03:09:38.947 INFO:teuthology.orchestra.run.trial028.stdout:(39/172): cephadm-19.2.3-700.gf4ef35d9.el9.noar 15 MB/s | 769 kB 00:00 2026-02-20T03:09:38.952 INFO:teuthology.orchestra.run.trial028.stdout:(40/172): cephfs-top-19.2.3-700.gf4ef35d9.el9.n 1.5 MB/s | 18 kB 00:00 2026-02-20T03:09:39.000 INFO:teuthology.orchestra.run.trial028.stdout:(41/172): ledmon-libs-1.1.0-3.el9.x86_64.rpm 770 kB/s | 40 kB 00:00 2026-02-20T03:09:39.014 INFO:teuthology.orchestra.run.trial028.stdout:(42/172): libconfig-1.7.2-9.el9.x86_64.rpm 1.3 MB/s | 72 kB 00:00 2026-02-20T03:09:39.016 INFO:teuthology.orchestra.run.trial028.stdout:(43/172): cryptsetup-2.8.1-3.el9.x86_64.rpm 4.7 MB/s | 351 kB 00:00 2026-02-20T03:09:39.041 INFO:teuthology.orchestra.run.trial028.stdout:(44/172): libgfortran-11.5.0-14.el9.x86_64.rpm 19 MB/s | 794 kB 00:00 2026-02-20T03:09:39.042 INFO:teuthology.orchestra.run.trial028.stdout:(45/172): libquadmath-11.5.0-14.el9.x86_64.rpm 6.5 MB/s | 184 kB 00:00 2026-02-20T03:09:39.047 INFO:teuthology.orchestra.run.trial028.stdout:(46/172): mailcap-2.1.49-5.el9.noarch.rpm 1.1 MB/s | 33 kB 00:00 2026-02-20T03:09:39.069 INFO:teuthology.orchestra.run.trial028.stdout:(47/172): nvme-cli-2.16-1.el9.x86_64.rpm 42 MB/s | 1.2 MB 00:00 2026-02-20T03:09:39.070 INFO:teuthology.orchestra.run.trial028.stdout:(48/172): pciutils-3.7.0-7.el9.x86_64.rpm 3.3 MB/s | 93 kB 00:00 2026-02-20T03:09:39.102 INFO:teuthology.orchestra.run.trial028.stdout:(49/172): python3-cryptography-36.0.1-5.el9.x86 38 MB/s | 1.2 MB 00:00 2026-02-20T03:09:39.103 INFO:teuthology.orchestra.run.trial028.stdout:(50/172): python3-ply-3.11-14.el9.noarch.rpm 3.2 MB/s | 106 kB 00:00 2026-02-20T03:09:39.110 INFO:teuthology.orchestra.run.trial177.stdout:(54/172): unzip-6.0-59.el9.x86_64.rpm 708 kB/s | 182 kB 00:00 2026-02-20T03:09:39.127 INFO:teuthology.orchestra.run.trial028.stdout:(51/172): python3-pycparser-2.20-6.el9.noarch.r 5.5 MB/s | 135 kB 00:00 2026-02-20T03:09:39.128 INFO:teuthology.orchestra.run.trial028.stdout:(52/172): python3-pyparsing-2.4.7-9.el9.noarch. 6.0 MB/s | 150 kB 00:00 2026-02-20T03:09:39.153 INFO:teuthology.orchestra.run.trial028.stdout:(53/172): python3-urllib3-1.26.5-7.el9.noarch.r 8.6 MB/s | 218 kB 00:00 2026-02-20T03:09:39.176 INFO:teuthology.orchestra.run.trial028.stdout:(54/172): python3-requests-2.25.1-10.el9.noarch 2.6 MB/s | 126 kB 00:00 2026-02-20T03:09:39.181 INFO:teuthology.orchestra.run.trial028.stdout:(55/172): unzip-6.0-59.el9.x86_64.rpm 6.3 MB/s | 182 kB 00:00 2026-02-20T03:09:39.182 INFO:teuthology.orchestra.run.trial177.stdout:(55/172): python3-urllib3-1.26.5-7.el9.noarch.r 649 kB/s | 218 kB 00:00 2026-02-20T03:09:39.186 INFO:teuthology.orchestra.run.trial028.stdout:(56/172): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2026-02-20T03:09:39.202 INFO:teuthology.orchestra.run.trial028.stdout:(57/172): zip-3.0-35.el9.x86_64.rpm 9.7 MB/s | 266 kB 00:00 2026-02-20T03:09:39.248 INFO:teuthology.orchestra.run.trial177.stdout:(56/172): automake-1.16.2-8.el9.noarch.rpm 10 MB/s | 689 kB 00:00 2026-02-20T03:09:39.256 INFO:teuthology.orchestra.run.trial177.stdout:(57/172): python3-cryptography-36.0.1-5.el9.x86 852 kB/s | 1.2 MB 00:01 2026-02-20T03:09:39.267 INFO:teuthology.orchestra.run.trial177.stdout:(58/172): bison-3.7.4-5.el9.x86_64.rpm 49 MB/s | 943 kB 00:00 2026-02-20T03:09:39.276 INFO:teuthology.orchestra.run.trial177.stdout:(59/172): elfutils-libelf-devel-0.194-1.el9.x86 8.8 MB/s | 79 kB 00:00 2026-02-20T03:09:39.285 INFO:teuthology.orchestra.run.trial177.stdout:(60/172): flex-2.6.4-9.el9.x86_64.rpm 33 MB/s | 313 kB 00:00 2026-02-20T03:09:39.292 INFO:teuthology.orchestra.run.trial177.stdout:(61/172): boost-program-options-1.75.0-13.el9.x 2.8 MB/s | 104 kB 00:00 2026-02-20T03:09:39.293 INFO:teuthology.orchestra.run.trial177.stdout:(62/172): flexiblas-3.0.4-9.el9.x86_64.rpm 3.6 MB/s | 30 kB 00:00 2026-02-20T03:09:39.301 INFO:teuthology.orchestra.run.trial177.stdout:(63/172): flexiblas-openblas-openmp-3.0.4-9.el9 1.9 MB/s | 15 kB 00:00 2026-02-20T03:09:39.309 INFO:teuthology.orchestra.run.trial177.stdout:(64/172): libaio-devel-0.3.111-13.el9.x86_64.rp 1.4 MB/s | 11 kB 00:00 2026-02-20T03:09:39.318 INFO:teuthology.orchestra.run.trial177.stdout:(65/172): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-20T03:09:39.328 INFO:teuthology.orchestra.run.trial177.stdout:(66/172): libpmemobj-1.12.1-1.el9.x86_64.rpm 15 MB/s | 160 kB 00:00 2026-02-20T03:09:39.336 INFO:teuthology.orchestra.run.trial177.stdout:(67/172): librabbitmq-0.11.0-7.el9.x86_64.rpm 5.3 MB/s | 45 kB 00:00 2026-02-20T03:09:39.343 INFO:teuthology.orchestra.run.trial177.stdout:(68/172): flexiblas-netlib-3.0.4-9.el9.x86_64.r 60 MB/s | 3.0 MB 00:00 2026-02-20T03:09:39.348 INFO:teuthology.orchestra.run.trial177.stdout:(69/172): librdkafka-1.6.1-102.el9.x86_64.rpm 58 MB/s | 662 kB 00:00 2026-02-20T03:09:39.353 INFO:teuthology.orchestra.run.trial177.stdout:(70/172): libstoragemgmt-1.10.1-1.el9.x86_64.rp 24 MB/s | 246 kB 00:00 2026-02-20T03:09:39.359 INFO:teuthology.orchestra.run.trial177.stdout:(71/172): libtool-2.4.6-46.el9.x86_64.rpm 52 MB/s | 581 kB 00:00 2026-02-20T03:09:39.361 INFO:teuthology.orchestra.run.trial177.stdout:(72/172): libuuid-devel-2.37.4-21.el9.x86_64.rp 3.0 MB/s | 25 kB 00:00 2026-02-20T03:09:39.369 INFO:teuthology.orchestra.run.trial177.stdout:(73/172): libxslt-1.1.34-12.el9.x86_64.rpm 23 MB/s | 233 kB 00:00 2026-02-20T03:09:39.369 INFO:teuthology.orchestra.run.trial177.stdout:(74/172): libzstd-devel-1.5.5-1.el9.x86_64.rpm 6.0 MB/s | 51 kB 00:00 2026-02-20T03:09:39.378 INFO:teuthology.orchestra.run.trial177.stdout:(75/172): lua-5.4.4-4.el9.x86_64.rpm 21 MB/s | 188 kB 00:00 2026-02-20T03:09:39.379 INFO:teuthology.orchestra.run.trial177.stdout:(76/172): lttng-ust-2.12.0-6.el9.x86_64.rpm 27 MB/s | 292 kB 00:00 2026-02-20T03:09:39.387 INFO:teuthology.orchestra.run.trial177.stdout:(77/172): openblas-0.3.29-1.el9.x86_64.rpm 5.0 MB/s | 42 kB 00:00 2026-02-20T03:09:39.411 INFO:teuthology.orchestra.run.trial177.stdout:(78/172): openssl-devel-3.5.5-1.el9.x86_64.rpm 199 MB/s | 4.8 MB 00:00 2026-02-20T03:09:39.419 INFO:teuthology.orchestra.run.trial177.stdout:(79/172): perl-Thread-Queue-3.14-460.el9.noarch 2.7 MB/s | 22 kB 00:00 2026-02-20T03:09:39.428 INFO:teuthology.orchestra.run.trial177.stdout:(80/172): perl-threads-2.25-460.el9.x86_64.rpm 6.7 MB/s | 58 kB 00:00 2026-02-20T03:09:39.436 INFO:teuthology.orchestra.run.trial177.stdout:(81/172): perl-threads-shared-1.61-460.el9.x86_ 5.3 MB/s | 45 kB 00:00 2026-02-20T03:09:39.447 INFO:teuthology.orchestra.run.trial177.stdout:(82/172): zip-3.0-35.el9.x86_64.rpm 787 kB/s | 266 kB 00:00 2026-02-20T03:09:39.449 INFO:teuthology.orchestra.run.trial177.stdout:(83/172): postgresql-13.23-1.el9.x86_64.rpm 124 MB/s | 1.6 MB 00:00 2026-02-20T03:09:39.462 INFO:teuthology.orchestra.run.trial177.stdout:(84/172): postgresql-contrib-13.23-1.el9.x86_64 71 MB/s | 903 kB 00:00 2026-02-20T03:09:39.493 INFO:teuthology.orchestra.run.trial177.stdout:(85/172): postgresql-server-13.23-1.el9.x86_64. 186 MB/s | 5.8 MB 00:00 2026-02-20T03:09:39.494 INFO:teuthology.orchestra.run.trial177.stdout:(86/172): postgresql-private-libs-13.23-1.el9.x 3.0 MB/s | 138 kB 00:00 2026-02-20T03:09:39.500 INFO:teuthology.orchestra.run.trial177.stdout:(87/172): openblas-openmp-0.3.29-1.el9.x86_64.r 44 MB/s | 5.3 MB 00:00 2026-02-20T03:09:39.506 INFO:teuthology.orchestra.run.trial177.stdout:(88/172): protobuf-3.14.0-17.el9.x86_64.rpm 81 MB/s | 1.0 MB 00:00 2026-02-20T03:09:39.509 INFO:teuthology.orchestra.run.trial177.stdout:(89/172): python3-colorama-0.4.6-3.el9.noarch.r 6.4 MB/s | 61 kB 00:00 2026-02-20T03:09:39.517 INFO:teuthology.orchestra.run.trial177.stdout:(90/172): python3-devel-3.9.25-3.el9.x86_64.rpm 22 MB/s | 244 kB 00:00 2026-02-20T03:09:39.520 INFO:teuthology.orchestra.run.trial177.stdout:(91/172): python3-jinja2-2.11.3-8.el9.noarch.rp 23 MB/s | 249 kB 00:00 2026-02-20T03:09:39.527 INFO:teuthology.orchestra.run.trial177.stdout:(92/172): python3-libstoragemgmt-1.10.1-1.el9.x 17 MB/s | 177 kB 00:00 2026-02-20T03:09:39.538 INFO:teuthology.orchestra.run.trial177.stdout:(93/172): python3-mako-1.1.4-6.el9.noarch.rpm 16 MB/s | 172 kB 00:00 2026-02-20T03:09:39.547 INFO:teuthology.orchestra.run.trial177.stdout:(94/172): python3-markupsafe-1.1.1-12.el9.x86_6 3.9 MB/s | 35 kB 00:00 2026-02-20T03:09:39.554 INFO:teuthology.orchestra.run.trial177.stdout:(95/172): python3-babel-2.9.1-2.el9.noarch.rpm 99 MB/s | 6.0 MB 00:00 2026-02-20T03:09:39.556 INFO:teuthology.orchestra.run.trial177.stdout:(96/172): python3-lxml-4.6.5-3.el9.x86_64.rpm 34 MB/s | 1.2 MB 00:00 2026-02-20T03:09:39.566 INFO:teuthology.orchestra.run.trial177.stdout:(97/172): python3-numpy-f2py-1.23.5-2.el9.x86_6 37 MB/s | 442 kB 00:00 2026-02-20T03:09:39.567 INFO:teuthology.orchestra.run.trial177.stdout:(98/172): python3-packaging-20.9-5.el9.noarch.r 7.4 MB/s | 77 kB 00:00 2026-02-20T03:09:39.578 INFO:teuthology.orchestra.run.trial177.stdout:(99/172): python3-numpy-1.23.5-2.el9.x86_64.rpm 201 MB/s | 6.1 MB 00:00 2026-02-20T03:09:39.578 INFO:teuthology.orchestra.run.trial177.stdout:(100/172): python3-pyasn1-0.4.8-6.el9.noarch.rp 13 MB/s | 159 kB 00:00 2026-02-20T03:09:39.579 INFO:teuthology.orchestra.run.trial177.stdout:(101/172): python3-protobuf-3.14.0-17.el9.noarc 20 MB/s | 267 kB 00:00 2026-02-20T03:09:39.587 INFO:teuthology.orchestra.run.trial177.stdout:(102/172): python3-requests-oauthlib-1.3.0-12.e 5.8 MB/s | 54 kB 00:00 2026-02-20T03:09:39.589 INFO:teuthology.orchestra.run.trial177.stdout:(103/172): python3-pyasn1-modules-0.4.8-6.el9.n 24 MB/s | 279 kB 00:00 2026-02-20T03:09:39.596 INFO:teuthology.orchestra.run.trial177.stdout:(104/172): python3-toml-0.10.2-6.el9.noarch.rpm 4.6 MB/s | 42 kB 00:00 2026-02-20T03:09:39.598 INFO:teuthology.orchestra.run.trial177.stdout:(105/172): python3-wcwidth-0.2.5-8.el9.noarch.r 4.8 MB/s | 44 kB 00:00 2026-02-20T03:09:39.606 INFO:teuthology.orchestra.run.trial177.stdout:(106/172): qatlib-25.08.0-2.el9.x86_64.rpm 26 MB/s | 240 kB 00:00 2026-02-20T03:09:39.606 INFO:teuthology.orchestra.run.trial177.stdout:(107/172): qatlib-service-25.08.0-2.el9.x86_64. 4.4 MB/s | 37 kB 00:00 2026-02-20T03:09:39.614 INFO:teuthology.orchestra.run.trial177.stdout:(108/172): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.5 MB/s | 66 kB 00:00 2026-02-20T03:09:39.616 INFO:teuthology.orchestra.run.trial177.stdout:(109/172): socat-1.7.4.1-8.el9.x86_64.rpm 32 MB/s | 303 kB 00:00 2026-02-20T03:09:39.623 INFO:teuthology.orchestra.run.trial177.stdout:(110/172): uuid-1.6.2-55.el9.x86_64.rpm 6.6 MB/s | 58 kB 00:00 2026-02-20T03:09:39.625 INFO:teuthology.orchestra.run.trial177.stdout:(111/172): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 10 MB/s | 96 kB 00:00 2026-02-20T03:09:39.632 INFO:teuthology.orchestra.run.trial177.stdout:(112/172): xmlsec1-1.2.29-13.el9.x86_64.rpm 22 MB/s | 189 kB 00:00 2026-02-20T03:09:39.633 INFO:teuthology.orchestra.run.trial177.stdout:(113/172): xmlsec1-openssl-1.2.29-13.el9.x86_64 10 MB/s | 90 kB 00:00 2026-02-20T03:09:39.641 INFO:teuthology.orchestra.run.trial177.stdout:(114/172): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.1 MB/s | 64 kB 00:00 2026-02-20T03:09:39.642 INFO:teuthology.orchestra.run.trial177.stdout:(115/172): zlib-devel-1.2.11-41.el9.x86_64.rpm 5.2 MB/s | 45 kB 00:00 2026-02-20T03:09:39.795 INFO:teuthology.orchestra.run.trial028.stdout:(58/172): boost-program-options-1.75.0-13.el9.x 176 kB/s | 104 kB 00:00 2026-02-20T03:09:39.920 INFO:teuthology.orchestra.run.trial177.stdout:(116/172): lua-devel-5.4.4-4.el9.x86_64.rpm 80 kB/s | 22 kB 00:00 2026-02-20T03:09:39.972 INFO:teuthology.orchestra.run.trial028.stdout:(59/172): elfutils-libelf-devel-0.194-1.el9.x86 446 kB/s | 79 kB 00:00 2026-02-20T03:09:39.981 INFO:teuthology.orchestra.run.trial177.stdout:(117/172): python3-scipy-1.9.3-2.el9.x86_64.rpm 48 MB/s | 19 MB 00:00 2026-02-20T03:09:40.038 INFO:teuthology.orchestra.run.trial177.stdout:(118/172): gperftools-libs-2.9.1-3.el9.x86_64.r 5.3 MB/s | 308 kB 00:00 2026-02-20T03:09:40.048 INFO:teuthology.orchestra.run.trial177.stdout:(119/172): grpc-data-1.46.7-10.el9.noarch.rpm 2.1 MB/s | 19 kB 00:00 2026-02-20T03:09:40.053 INFO:teuthology.orchestra.run.trial177.stdout:(120/172): abseil-cpp-20211102.0-4.el9.x86_64.r 4.1 MB/s | 551 kB 00:00 2026-02-20T03:09:40.063 INFO:teuthology.orchestra.run.trial177.stdout:(121/172): libarrow-doc-9.0.0-15.el9.noarch.rpm 2.4 MB/s | 25 kB 00:00 2026-02-20T03:09:40.074 INFO:teuthology.orchestra.run.trial177.stdout:(122/172): liboath-2.6.12-1.el9.x86_64.rpm 4.6 MB/s | 49 kB 00:00 2026-02-20T03:09:40.084 INFO:teuthology.orchestra.run.trial177.stdout:(123/172): libunwind-1.6.2-1.el9.x86_64.rpm 6.1 MB/s | 67 kB 00:00 2026-02-20T03:09:40.096 INFO:teuthology.orchestra.run.trial177.stdout:(124/172): libarrow-9.0.0-15.el9.x86_64.rpm 91 MB/s | 4.4 MB 00:00 2026-02-20T03:09:40.097 INFO:teuthology.orchestra.run.trial177.stdout:(125/172): luarocks-3.9.2-5.el9.noarch.rpm 12 MB/s | 151 kB 00:00 2026-02-20T03:09:40.122 INFO:teuthology.orchestra.run.trial177.stdout:(126/172): parquet-libs-9.0.0-15.el9.x86_64.rpm 33 MB/s | 838 kB 00:00 2026-02-20T03:09:40.179 INFO:teuthology.orchestra.run.trial177.stdout:(127/172): python3-asyncssh-2.13.2-5.el9.noarch 6.6 MB/s | 548 kB 00:00 2026-02-20T03:09:40.197 INFO:teuthology.orchestra.run.trial177.stdout:(128/172): python3-backports-tarfile-1.2.0-1.el 3.2 MB/s | 60 kB 00:00 2026-02-20T03:09:40.208 INFO:teuthology.orchestra.run.trial177.stdout:(129/172): python3-bcrypt-3.2.2-1.el9.x86_64.rp 3.9 MB/s | 43 kB 00:00 2026-02-20T03:09:40.219 INFO:teuthology.orchestra.run.trial177.stdout:(130/172): python3-cachetools-4.2.4-1.el9.noarc 2.9 MB/s | 32 kB 00:00 2026-02-20T03:09:40.229 INFO:teuthology.orchestra.run.trial177.stdout:(131/172): python3-certifi-2023.05.07-4.el9.noa 1.3 MB/s | 14 kB 00:00 2026-02-20T03:09:40.242 INFO:teuthology.orchestra.run.trial177.stdout:(132/172): python3-cheroot-10.0.1-4.el9.noarch. 13 MB/s | 173 kB 00:00 2026-02-20T03:09:40.248 INFO:teuthology.orchestra.run.trial177.stdout:(133/172): python3-autocommand-2.2.2-8.el9.noar 233 kB/s | 29 kB 00:00 2026-02-20T03:09:40.259 INFO:teuthology.orchestra.run.trial177.stdout:(134/172): python3-cherrypy-18.6.1-2.el9.noarch 20 MB/s | 358 kB 00:00 2026-02-20T03:09:40.268 INFO:teuthology.orchestra.run.trial177.stdout:(135/172): python3-cmd2-2.4.2-2.el9.noarch.rpm 15 MB/s | 303 kB 00:00 2026-02-20T03:09:40.273 INFO:teuthology.orchestra.run.trial177.stdout:(136/172): python3-google-auth-2.45.0-1.el9.noa 19 MB/s | 254 kB 00:00 2026-02-20T03:09:40.285 INFO:teuthology.orchestra.run.trial177.stdout:(137/172): python3-grpcio-1.46.7-10.el9.x86_64. 120 MB/s | 2.0 MB 00:00 2026-02-20T03:09:40.286 INFO:teuthology.orchestra.run.trial177.stdout:(138/172): python3-grpcio-tools-1.46.7-10.el9.x 11 MB/s | 144 kB 00:00 2026-02-20T03:09:40.297 INFO:teuthology.orchestra.run.trial177.stdout:(139/172): python3-isodate-0.6.1-3.el9.noarch.r 4.9 MB/s | 56 kB 00:00 2026-02-20T03:09:40.298 INFO:teuthology.orchestra.run.trial177.stdout:(140/172): python3-influxdb-5.3.1-1.el9.noarch. 11 MB/s | 139 kB 00:00 2026-02-20T03:09:40.307 INFO:teuthology.orchestra.run.trial177.stdout:(141/172): python3-jaraco-classes-3.2.1-5.el9.n 1.8 MB/s | 18 kB 00:00 2026-02-20T03:09:40.317 INFO:teuthology.orchestra.run.trial177.stdout:(142/172): python3-jaraco-collections-3.0.0-8.e 2.4 MB/s | 23 kB 00:00 2026-02-20T03:09:40.327 INFO:teuthology.orchestra.run.trial177.stdout:(143/172): python3-jaraco-context-6.0.1-3.el9.n 2.0 MB/s | 20 kB 00:00 2026-02-20T03:09:40.336 INFO:teuthology.orchestra.run.trial177.stdout:(144/172): python3-jaraco-functools-3.5.0-2.el9 2.0 MB/s | 19 kB 00:00 2026-02-20T03:09:40.341 INFO:teuthology.orchestra.run.trial177.stdout:(145/172): python3-jaraco-8.2.1-3.el9.noarch.rp 243 kB/s | 11 kB 00:00 2026-02-20T03:09:40.346 INFO:teuthology.orchestra.run.trial177.stdout:(146/172): python3-jaraco-text-4.0.0-2.el9.noar 2.7 MB/s | 26 kB 00:00 2026-02-20T03:09:40.356 INFO:teuthology.orchestra.run.trial177.stdout:(147/172): python3-logutils-0.3.5-21.el9.noarch 4.5 MB/s | 46 kB 00:00 2026-02-20T03:09:40.367 INFO:teuthology.orchestra.run.trial177.stdout:(148/172): python3-more-itertools-8.12.0-2.el9. 7.4 MB/s | 79 kB 00:00 2026-02-20T03:09:40.378 INFO:teuthology.orchestra.run.trial177.stdout:(149/172): python3-msgpack-1.0.3-2.el9.x86_64.r 7.9 MB/s | 86 kB 00:00 2026-02-20T03:09:40.383 INFO:teuthology.orchestra.run.trial177.stdout:(150/172): python3-kubernetes-26.1.0-3.el9.noar 25 MB/s | 1.0 MB 00:00 2026-02-20T03:09:40.383 INFO:teuthology.orchestra.run.trial028.stdout:(60/172): flex-2.6.4-9.el9.x86_64.rpm 764 kB/s | 313 kB 00:00 2026-02-20T03:09:40.388 INFO:teuthology.orchestra.run.trial177.stdout:(151/172): python3-natsort-7.1.1-5.el9.noarch.r 5.5 MB/s | 58 kB 00:00 2026-02-20T03:09:40.396 INFO:teuthology.orchestra.run.trial177.stdout:(152/172): python3-pecan-1.4.2-3.el9.noarch.rpm 20 MB/s | 272 kB 00:00 2026-02-20T03:09:40.396 INFO:teuthology.orchestra.run.trial126.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T03:09:40.398 INFO:teuthology.orchestra.run.trial177.stdout:(153/172): python3-portend-3.1.0-2.el9.noarch.r 1.7 MB/s | 16 kB 00:00 2026-02-20T03:09:40.407 INFO:teuthology.orchestra.run.trial177.stdout:(154/172): python3-pyOpenSSL-21.0.0-1.el9.noarc 7.6 MB/s | 90 kB 00:00 2026-02-20T03:09:40.418 INFO:teuthology.orchestra.run.trial177.stdout:(155/172): python3-repoze-lru-0.7-16.el9.noarch 2.8 MB/s | 31 kB 00:00 2026-02-20T03:09:40.421 INFO:teuthology.orchestra.run.trial177.stdout:(156/172): python3-pyperclip-1.8.2-2.el9.noarch 1.2 MB/s | 28 kB 00:00 2026-02-20T03:09:40.429 INFO:teuthology.orchestra.run.trial177.stdout:(157/172): python3-routes-2.5.1-5.el9.noarch.rp 17 MB/s | 188 kB 00:00 2026-02-20T03:09:40.432 INFO:teuthology.orchestra.run.trial177.stdout:(158/172): python3-rsa-4.9-2.el9.noarch.rpm 5.7 MB/s | 59 kB 00:00 2026-02-20T03:09:40.441 INFO:teuthology.orchestra.run.trial177.stdout:(159/172): python3-saml-1.16.0-1.el9.noarch.rpm 10 MB/s | 125 kB 00:00 2026-02-20T03:09:40.442 INFO:teuthology.orchestra.run.trial177.stdout:(160/172): python3-tempora-5.0.0-2.el9.noarch.r 3.5 MB/s | 36 kB 00:00 2026-02-20T03:09:40.452 INFO:teuthology.orchestra.run.trial177.stdout:(161/172): python3-typing-extensions-4.15.0-1.e 7.7 MB/s | 86 kB 00:00 2026-02-20T03:09:40.454 INFO:teuthology.orchestra.run.trial177.stdout:(162/172): python3-webob-1.8.8-2.el9.noarch.rpm 19 MB/s | 230 kB 00:00 2026-02-20T03:09:40.465 INFO:teuthology.orchestra.run.trial177.stdout:(163/172): python3-websocket-client-1.2.3-2.el9 7.3 MB/s | 90 kB 00:00 2026-02-20T03:09:40.471 INFO:teuthology.orchestra.run.trial177.stdout:(164/172): python3-werkzeug-2.0.3-3.el9.1.noarc 24 MB/s | 427 kB 00:00 2026-02-20T03:09:40.477 INFO:teuthology.orchestra.run.trial177.stdout:(165/172): python3-xmlsec-1.3.13-1.el9.x86_64.r 4.0 MB/s | 48 kB 00:00 2026-02-20T03:09:40.477 INFO:teuthology.orchestra.run.trial028.stdout:(61/172): automake-1.16.2-8.el9.noarch.rpm 532 kB/s | 689 kB 00:01 2026-02-20T03:09:40.481 INFO:teuthology.orchestra.run.trial177.stdout:(166/172): python3-xmltodict-0.12.0-15.el9.noar 2.2 MB/s | 22 kB 00:00 2026-02-20T03:09:40.482 INFO:teuthology.orchestra.run.trial028.stdout:(62/172): flexiblas-3.0.4-9.el9.x86_64.rpm 300 kB/s | 30 kB 00:00 2026-02-20T03:09:40.487 INFO:teuthology.orchestra.run.trial177.stdout:(167/172): python3-zc-lockfile-2.0-10.el9.noarc 1.9 MB/s | 20 kB 00:00 2026-02-20T03:09:40.492 INFO:teuthology.orchestra.run.trial177.stdout:(168/172): re2-20211101-20.el9.x86_64.rpm 17 MB/s | 191 kB 00:00 2026-02-20T03:09:40.529 INFO:teuthology.orchestra.run.trial177.stdout:(169/172): thrift-0.15.0-4.el9.x86_64.rpm 38 MB/s | 1.6 MB 00:00 2026-02-20T03:09:40.581 INFO:teuthology.orchestra.run.trial028.stdout:(63/172): flexiblas-openblas-openmp-3.0.4-9.el9 151 kB/s | 15 kB 00:00 2026-02-20T03:09:40.654 INFO:teuthology.orchestra.run.trial177.stdout:(170/172): librados2-19.2.3-700.gf4ef35d9.el9.x 21 MB/s | 3.4 MB 00:00 2026-02-20T03:09:40.680 INFO:teuthology.orchestra.run.trial028.stdout:(64/172): libaio-devel-0.3.111-13.el9.x86_64.rp 112 kB/s | 11 kB 00:00 2026-02-20T03:09:40.727 INFO:teuthology.orchestra.run.trial177.stdout:(171/172): librbd1-19.2.3-700.gf4ef35d9.el9.x86 16 MB/s | 3.2 MB 00:00 2026-02-20T03:09:40.818 INFO:teuthology.orchestra.run.trial028.stdout:(65/172): bison-3.7.4-5.el9.x86_64.rpm 578 kB/s | 943 kB 00:01 2026-02-20T03:09:40.849 INFO:teuthology.orchestra.run.trial177.stdout:(172/172): protobuf-compiler-3.14.0-17.el9.x86_ 714 kB/s | 862 kB 00:01 2026-02-20T03:09:40.853 INFO:teuthology.orchestra.run.trial177.stdout:-------------------------------------------------------------------------------- 2026-02-20T03:09:40.853 INFO:teuthology.orchestra.run.trial177.stdout:Total 32 MB/s | 230 MB 00:07 2026-02-20T03:09:40.935 INFO:teuthology.orchestra.run.trial028.stdout:(66/172): libnbd-1.20.3-4.el9.x86_64.rpm 643 kB/s | 164 kB 00:00 2026-02-20T03:09:41.034 INFO:teuthology.orchestra.run.trial028.stdout:(67/172): librabbitmq-0.11.0-7.el9.x86_64.rpm 457 kB/s | 45 kB 00:00 2026-02-20T03:09:41.074 INFO:teuthology.orchestra.run.trial028.stdout:(68/172): libpmemobj-1.12.1-1.el9.x86_64.rpm 628 kB/s | 160 kB 00:00 2026-02-20T03:09:41.407 INFO:teuthology.orchestra.run.trial028.stdout:(69/172): libstoragemgmt-1.10.1-1.el9.x86_64.rp 739 kB/s | 246 kB 00:00 2026-02-20T03:09:41.588 INFO:teuthology.orchestra.run.trial126.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T03:09:41.588 INFO:teuthology.orchestra.run.trial126.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-20T03:09:41.595 INFO:teuthology.orchestra.run.trial126.stdout:Package NetworkManager-1:1.54.3-2.el9.x86_64 is already installed. 2026-02-20T03:09:41.595 INFO:teuthology.orchestra.run.trial126.stdout:Package iproute-6.17.0-2.el9.x86_64 is already installed. 2026-02-20T03:09:41.596 INFO:teuthology.orchestra.run.trial126.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-20T03:09:41.596 INFO:teuthology.orchestra.run.trial126.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-20T03:09:41.597 INFO:teuthology.orchestra.run.trial126.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-20T03:09:41.598 INFO:teuthology.orchestra.run.trial126.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-20T03:09:41.598 INFO:teuthology.orchestra.run.trial126.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-20T03:09:41.609 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction check 2026-02-20T03:09:41.624 INFO:teuthology.orchestra.run.trial126.stdout:Dependencies resolved. 2026-02-20T03:09:41.629 INFO:teuthology.orchestra.run.trial126.stdout:====================================================================================== 2026-02-20T03:09:41.629 INFO:teuthology.orchestra.run.trial126.stdout: Package Arch Version Repository Size 2026-02-20T03:09:41.629 INFO:teuthology.orchestra.run.trial126.stdout:====================================================================================== 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout:Installing: 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 6.5 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-base x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.5 M 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.2 M 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 145 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 1.1 M 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 150 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-dashboard noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 3.8 M 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 7.4 M 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-rook noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 49 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-radosgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 11 M 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-test x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 50 M 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: ceph-volume noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 299 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: cephadm noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 769 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-mirror x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 233 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-shell x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 27 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-top noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 18 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 34 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 999 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: librados-devel x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 126 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-20T03:09:41.630 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: python3-cephfs x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 165 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: python3-rados x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 322 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: python3-rbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 303 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: python3-rgw x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 100 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: rbd-fuse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 85 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: rbd-mirror x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.1 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: rbd-nbd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 170 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout:Upgrading: 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: librados2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.4 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: librbd1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 3.2 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout:Installing dependencies: 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 22 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: ceph-grafana-dashboards noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 31 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mds x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 2.4 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-modules-core noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 253 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mon x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 4.7 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: ceph-osd x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 17 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: ceph-prometheus-alerts noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 17 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: ceph-selinux x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 25 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: libcephsqlite x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 163 k 2026-02-20T03:09:41.631 INFO:teuthology.orchestra.run.trial126.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: libradosstriper1 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 504 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: librgw2 x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 5.4 M 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T03:09:41.632 INFO:teuthology.orchestra.run.trial126.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-ceph-argparse x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 45 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-ceph-common x86_64 2:19.2.3-700.gf4ef35d9.el9 ceph 142 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T03:09:41.633 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T03:09:41.634 INFO:teuthology.orchestra.run.trial126.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout:Installing weak dependencies: 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-700.gf4ef35d9.el9 ceph-noarch 22 k 2026-02-20T03:09:41.635 INFO:teuthology.orchestra.run.trial126.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout:Transaction Summary 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout:====================================================================================== 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout:Install 170 Packages 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout:Upgrade 2 Packages 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout:Total download size: 230 M 2026-02-20T03:09:41.636 INFO:teuthology.orchestra.run.trial126.stdout:Downloading Packages: 2026-02-20T03:09:41.668 INFO:teuthology.orchestra.run.trial177.stdout:Transaction check succeeded. 2026-02-20T03:09:41.668 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction test 2026-02-20T03:09:41.835 INFO:teuthology.orchestra.run.trial028.stdout:(70/172): librdkafka-1.6.1-102.el9.x86_64.rpm 828 kB/s | 662 kB 00:00 2026-02-20T03:09:41.934 INFO:teuthology.orchestra.run.trial028.stdout:(71/172): libuuid-devel-2.37.4-21.el9.x86_64.rp 248 kB/s | 25 kB 00:00 2026-02-20T03:09:42.142 INFO:teuthology.orchestra.run.trial028.stdout:(72/172): libtool-2.4.6-46.el9.x86_64.rpm 790 kB/s | 581 kB 00:00 2026-02-20T03:09:42.242 INFO:teuthology.orchestra.run.trial028.stdout:(73/172): libzstd-devel-1.5.5-1.el9.x86_64.rpm 513 kB/s | 51 kB 00:00 2026-02-20T03:09:42.266 INFO:teuthology.orchestra.run.trial028.stdout:(74/172): libxslt-1.1.34-12.el9.x86_64.rpm 700 kB/s | 233 kB 00:00 2026-02-20T03:09:42.310 INFO:teuthology.orchestra.run.trial126.stdout:(1/172): ceph-19.2.3-700.gf4ef35d9.el9.x86_64.r 126 kB/s | 6.5 kB 00:00 2026-02-20T03:09:42.416 INFO:teuthology.orchestra.run.trial126.stdout:(2/172): ceph-fuse-19.2.3-700.gf4ef35d9.el9.x86 11 MB/s | 1.2 MB 00:00 2026-02-20T03:09:42.456 INFO:teuthology.orchestra.run.trial126.stdout:(3/172): ceph-immutable-object-cache-19.2.3-700 3.6 MB/s | 145 kB 00:00 2026-02-20T03:09:42.522 INFO:teuthology.orchestra.run.trial028.stdout:(75/172): lua-5.4.4-4.el9.x86_64.rpm 738 kB/s | 188 kB 00:00 2026-02-20T03:09:42.558 INFO:teuthology.orchestra.run.trial126.stdout:(4/172): ceph-base-19.2.3-700.gf4ef35d9.el9.x86 18 MB/s | 5.5 MB 00:00 2026-02-20T03:09:42.566 INFO:teuthology.orchestra.run.trial177.stdout:Transaction test succeeded. 2026-02-20T03:09:42.567 INFO:teuthology.orchestra.run.trial177.stdout:Running transaction 2026-02-20T03:09:42.597 INFO:teuthology.orchestra.run.trial126.stdout:(5/172): ceph-mds-19.2.3-700.gf4ef35d9.el9.x86_ 17 MB/s | 2.4 MB 00:00 2026-02-20T03:09:42.614 INFO:teuthology.orchestra.run.trial126.stdout:(6/172): ceph-mgr-19.2.3-700.gf4ef35d9.el9.x86_ 19 MB/s | 1.1 MB 00:00 2026-02-20T03:09:42.621 INFO:teuthology.orchestra.run.trial028.stdout:(76/172): openblas-0.3.29-1.el9.x86_64.rpm 426 kB/s | 42 kB 00:00 2026-02-20T03:09:42.653 INFO:teuthology.orchestra.run.trial028.stdout:(77/172): lttng-ust-2.12.0-6.el9.x86_64.rpm 710 kB/s | 292 kB 00:00 2026-02-20T03:09:42.901 INFO:teuthology.orchestra.run.trial126.stdout:(7/172): ceph-mon-19.2.3-700.gf4ef35d9.el9.x86_ 16 MB/s | 4.7 MB 00:00 2026-02-20T03:09:43.275 INFO:teuthology.orchestra.run.trial126.stdout:(8/172): ceph-osd-19.2.3-700.gf4ef35d9.el9.x86_ 26 MB/s | 17 MB 00:00 2026-02-20T03:09:43.296 INFO:teuthology.orchestra.run.trial126.stdout:(9/172): ceph-selinux-19.2.3-700.gf4ef35d9.el9. 1.2 MB/s | 25 kB 00:00 2026-02-20T03:09:43.530 INFO:teuthology.orchestra.run.trial177.stdout: Preparing : 1/1 2026-02-20T03:09:43.536 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/174 2026-02-20T03:09:43.549 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/174 2026-02-20T03:09:43.561 INFO:teuthology.orchestra.run.trial177.stdout: Installing : thrift-0.15.0-4.el9.x86_64 3/174 2026-02-20T03:09:43.641 INFO:teuthology.orchestra.run.trial126.stdout:(10/172): ceph-common-19.2.3-700.gf4ef35d9.el9. 16 MB/s | 22 MB 00:01 2026-02-20T03:09:43.654 INFO:teuthology.orchestra.run.trial126.stdout:(11/172): ceph-radosgw-19.2.3-700.gf4ef35d9.el9 14 MB/s | 11 MB 00:00 2026-02-20T03:09:43.661 INFO:teuthology.orchestra.run.trial126.stdout:(12/172): cephfs-mirror-19.2.3-700.gf4ef35d9.el 11 MB/s | 233 kB 00:00 2026-02-20T03:09:43.680 INFO:teuthology.orchestra.run.trial126.stdout:(13/172): cephfs-shell-19.2.3-700.gf4ef35d9.el9 1.0 MB/s | 27 kB 00:00 2026-02-20T03:09:43.691 INFO:teuthology.orchestra.run.trial126.stdout:(14/172): libcephfs-devel-19.2.3-700.gf4ef35d9. 1.1 MB/s | 34 kB 00:00 2026-02-20T03:09:43.711 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/174 2026-02-20T03:09:43.717 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/174 2026-02-20T03:09:43.735 INFO:teuthology.orchestra.run.trial126.stdout:(15/172): libcephsqlite-19.2.3-700.gf4ef35d9.el 3.6 MB/s | 163 kB 00:00 2026-02-20T03:09:43.758 INFO:teuthology.orchestra.run.trial126.stdout:(16/172): libcephfs2-19.2.3-700.gf4ef35d9.el9.x 12 MB/s | 999 kB 00:00 2026-02-20T03:09:43.771 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/174 2026-02-20T03:09:43.771 INFO:teuthology.orchestra.run.trial126.stdout:(17/172): librados-devel-19.2.3-700.gf4ef35d9.e 3.4 MB/s | 126 kB 00:00 2026-02-20T03:09:43.772 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/174 2026-02-20T03:09:43.798 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/174 2026-02-20T03:09:43.800 INFO:teuthology.orchestra.run.trial126.stdout:(18/172): libradosstriper1-19.2.3-700.gf4ef35d9 12 MB/s | 504 kB 00:00 2026-02-20T03:09:43.806 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/174 2026-02-20T03:09:43.808 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/174 2026-02-20T03:09:43.810 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/174 2026-02-20T03:09:43.812 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/174 2026-02-20T03:09:43.817 INFO:teuthology.orchestra.run.trial177.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 11/174 2026-02-20T03:09:43.843 INFO:teuthology.orchestra.run.trial126.stdout:(19/172): python3-ceph-argparse-19.2.3-700.gf4e 1.0 MB/s | 45 kB 00:00 2026-02-20T03:09:43.881 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 12/174 2026-02-20T03:09:43.887 INFO:teuthology.orchestra.run.trial126.stdout:(20/172): python3-ceph-common-19.2.3-700.gf4ef3 3.1 MB/s | 142 kB 00:00 2026-02-20T03:09:43.891 INFO:teuthology.orchestra.run.trial177.stdout: Installing : postgresql-13.23-1.el9.x86_64 13/174 2026-02-20T03:09:43.891 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 14/174 2026-02-20T03:09:43.923 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 14/174 2026-02-20T03:09:43.923 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_ 15/174 2026-02-20T03:09:43.933 INFO:teuthology.orchestra.run.trial126.stdout:(21/172): python3-cephfs-19.2.3-700.gf4ef35d9.e 3.5 MB/s | 165 kB 00:00 2026-02-20T03:09:43.942 INFO:teuthology.orchestra.run.trial028.stdout:(78/172): flexiblas-netlib-3.0.4-9.el9.x86_64.r 883 kB/s | 3.0 MB 00:03 2026-02-20T03:09:43.969 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_ 15/174 2026-02-20T03:09:43.977 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 16/174 2026-02-20T03:09:43.980 INFO:teuthology.orchestra.run.trial177.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 17/174 2026-02-20T03:09:43.981 INFO:teuthology.orchestra.run.trial126.stdout:(22/172): python3-rados-19.2.3-700.gf4ef35d9.el 6.5 MB/s | 322 kB 00:00 2026-02-20T03:09:44.010 INFO:teuthology.orchestra.run.trial177.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/174 2026-02-20T03:09:44.029 INFO:teuthology.orchestra.run.trial126.stdout:(23/172): python3-rbd-19.2.3-700.gf4ef35d9.el9. 6.2 MB/s | 303 kB 00:00 2026-02-20T03:09:44.041 INFO:teuthology.orchestra.run.trial028.stdout:(79/172): perl-Thread-Queue-3.14-460.el9.noarch 225 kB/s | 22 kB 00:00 2026-02-20T03:09:44.041 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 19/174 2026-02-20T03:09:44.044 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/174 2026-02-20T03:09:44.066 INFO:teuthology.orchestra.run.trial177.stdout: Installing : liboath-2.6.12-1.el9.x86_64 21/174 2026-02-20T03:09:44.072 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/174 2026-02-20T03:09:44.075 INFO:teuthology.orchestra.run.trial126.stdout:(24/172): python3-rgw-19.2.3-700.gf4ef35d9.el9. 2.2 MB/s | 100 kB 00:00 2026-02-20T03:09:44.080 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/174 2026-02-20T03:09:44.084 INFO:teuthology.orchestra.run.trial177.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 24/174 2026-02-20T03:09:44.089 INFO:teuthology.orchestra.run.trial177.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 25/174 2026-02-20T03:09:44.091 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/174 2026-02-20T03:09:44.096 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 27/174 2026-02-20T03:09:44.119 INFO:teuthology.orchestra.run.trial126.stdout:(25/172): rbd-fuse-19.2.3-700.gf4ef35d9.el9.x86 1.9 MB/s | 85 kB 00:00 2026-02-20T03:09:44.120 INFO:teuthology.orchestra.run.trial177.stdout: Installing : unzip-6.0-59.el9.x86_64 28/174 2026-02-20T03:09:44.133 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 29/174 2026-02-20T03:09:44.136 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 30/174 2026-02-20T03:09:44.139 INFO:teuthology.orchestra.run.trial126.stdout:(26/172): librgw2-19.2.3-700.gf4ef35d9.el9.x86_ 15 MB/s | 5.4 MB 00:00 2026-02-20T03:09:44.140 INFO:teuthology.orchestra.run.trial028.stdout:(80/172): perl-threads-2.25-460.el9.x86_64.rpm 587 kB/s | 58 kB 00:00 2026-02-20T03:09:44.142 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 31/174 2026-02-20T03:09:44.143 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 32/174 2026-02-20T03:09:44.169 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 33/174 2026-02-20T03:09:44.173 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x 34/174 2026-02-20T03:09:44.182 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9 35/174 2026-02-20T03:09:44.186 INFO:teuthology.orchestra.run.trial126.stdout:(27/172): rbd-nbd-19.2.3-700.gf4ef35d9.el9.x86_ 3.5 MB/s | 170 kB 00:00 2026-02-20T03:09:44.193 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 36/174 2026-02-20T03:09:44.200 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 37/174 2026-02-20T03:09:44.224 INFO:teuthology.orchestra.run.trial177.stdout: Installing : zip-3.0-35.el9.x86_64 38/174 2026-02-20T03:09:44.227 INFO:teuthology.orchestra.run.trial177.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/174 2026-02-20T03:09:44.230 INFO:teuthology.orchestra.run.trial177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 40/174 2026-02-20T03:09:44.231 INFO:teuthology.orchestra.run.trial126.stdout:(28/172): ceph-grafana-dashboards-19.2.3-700.gf 706 kB/s | 31 kB 00:00 2026-02-20T03:09:44.233 INFO:teuthology.orchestra.run.trial177.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 41/174 2026-02-20T03:09:44.239 INFO:teuthology.orchestra.run.trial028.stdout:(81/172): perl-threads-shared-1.61-460.el9.x86_ 451 kB/s | 45 kB 00:00 2026-02-20T03:09:44.261 INFO:teuthology.orchestra.run.trial177.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 42/174 2026-02-20T03:09:44.269 INFO:teuthology.orchestra.run.trial177.stdout: Installing : automake-1.16.2-8.el9.noarch 43/174 2026-02-20T03:09:44.277 INFO:teuthology.orchestra.run.trial126.stdout:(29/172): ceph-mgr-cephadm-19.2.3-700.gf4ef35d9 3.1 MB/s | 150 kB 00:00 2026-02-20T03:09:44.294 INFO:teuthology.orchestra.run.trial177.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/174 2026-02-20T03:09:44.346 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/174 2026-02-20T03:09:44.357 INFO:teuthology.orchestra.run.trial126.stdout:(30/172): rbd-mirror-19.2.3-700.gf4ef35d9.el9.x 13 MB/s | 3.1 MB 00:00 2026-02-20T03:09:44.359 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/174 2026-02-20T03:09:44.361 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/174 2026-02-20T03:09:44.366 INFO:teuthology.orchestra.run.trial177.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 48/174 2026-02-20T03:09:44.371 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 49/174 2026-02-20T03:09:44.379 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/174 2026-02-20T03:09:44.382 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 51/174 2026-02-20T03:09:44.387 INFO:teuthology.orchestra.run.trial177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 52/174 2026-02-20T03:09:44.390 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/174 2026-02-20T03:09:44.405 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 54/174 2026-02-20T03:09:44.426 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 55/174 2026-02-20T03:09:44.430 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 56/174 2026-02-20T03:09:44.435 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 57/174 2026-02-20T03:09:44.447 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 58/174 2026-02-20T03:09:44.451 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 59/174 2026-02-20T03:09:44.460 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 60/174 2026-02-20T03:09:44.467 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 61/174 2026-02-20T03:09:44.486 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 62/174 2026-02-20T03:09:44.496 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 63/174 2026-02-20T03:09:44.550 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 64/174 2026-02-20T03:09:44.562 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 65/174 2026-02-20T03:09:44.578 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 66/174 2026-02-20T03:09:44.583 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 67/174 2026-02-20T03:09:44.590 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 68/174 2026-02-20T03:09:44.603 INFO:teuthology.orchestra.run.trial126.stdout:(31/172): ceph-mgr-dashboard-19.2.3-700.gf4ef35 12 MB/s | 3.8 MB 00:00 2026-02-20T03:09:44.630 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 69/174 2026-02-20T03:09:44.702 INFO:teuthology.orchestra.run.trial126.stdout:(32/172): ceph-test-19.2.3-700.gf4ef35d9.el9.x8 35 MB/s | 50 MB 00:01 2026-02-20T03:09:44.702 INFO:teuthology.orchestra.run.trial126.stdout:(33/172): ceph-mgr-k8sevents-19.2.3-700.gf4ef35 223 kB/s | 22 kB 00:00 2026-02-20T03:09:44.714 INFO:teuthology.orchestra.run.trial126.stdout:(34/172): ceph-mgr-modules-core-19.2.3-700.gf4e 20 MB/s | 253 kB 00:00 2026-02-20T03:09:44.722 INFO:teuthology.orchestra.run.trial126.stdout:(35/172): ceph-mgr-rook-19.2.3-700.gf4ef35d9.el 2.4 MB/s | 49 kB 00:00 2026-02-20T03:09:44.729 INFO:teuthology.orchestra.run.trial126.stdout:(36/172): ceph-prometheus-alerts-19.2.3-700.gf4 1.1 MB/s | 17 kB 00:00 2026-02-20T03:09:44.741 INFO:teuthology.orchestra.run.trial126.stdout:(37/172): ceph-volume-19.2.3-700.gf4ef35d9.el9. 15 MB/s | 299 kB 00:00 2026-02-20T03:09:44.762 INFO:teuthology.orchestra.run.trial126.stdout:(38/172): cephadm-19.2.3-700.gf4ef35d9.el9.noar 23 MB/s | 769 kB 00:00 2026-02-20T03:09:44.771 INFO:teuthology.orchestra.run.trial126.stdout:(39/172): ceph-mgr-diskprediction-local-19.2.3- 18 MB/s | 7.4 MB 00:00 2026-02-20T03:09:44.771 INFO:teuthology.orchestra.run.trial126.stdout:(40/172): cephfs-top-19.2.3-700.gf4ef35d9.el9.n 607 kB/s | 18 kB 00:00 2026-02-20T03:09:44.786 INFO:teuthology.orchestra.run.trial126.stdout:(41/172): libconfig-1.7.2-9.el9.x86_64.rpm 5.0 MB/s | 72 kB 00:00 2026-02-20T03:09:44.790 INFO:teuthology.orchestra.run.trial126.stdout:(42/172): ledmon-libs-1.1.0-3.el9.x86_64.rpm 2.0 MB/s | 40 kB 00:00 2026-02-20T03:09:44.802 INFO:teuthology.orchestra.run.trial126.stdout:(43/172): cryptsetup-2.8.1-3.el9.x86_64.rpm 8.6 MB/s | 351 kB 00:00 2026-02-20T03:09:44.803 INFO:teuthology.orchestra.run.trial126.stdout:(44/172): libgfortran-11.5.0-14.el9.x86_64.rpm 45 MB/s | 794 kB 00:00 2026-02-20T03:09:44.808 INFO:teuthology.orchestra.run.trial126.stdout:(45/172): libquadmath-11.5.0-14.el9.x86_64.rpm 10 MB/s | 184 kB 00:00 2026-02-20T03:09:44.809 INFO:teuthology.orchestra.run.trial126.stdout:(46/172): mailcap-2.1.49-5.el9.noarch.rpm 5.0 MB/s | 33 kB 00:00 2026-02-20T03:09:44.815 INFO:teuthology.orchestra.run.trial126.stdout:(47/172): nvme-cli-2.16-1.el9.x86_64.rpm 98 MB/s | 1.2 MB 00:00 2026-02-20T03:09:44.816 INFO:teuthology.orchestra.run.trial126.stdout:(48/172): pciutils-3.7.0-7.el9.x86_64.rpm 12 MB/s | 93 kB 00:00 2026-02-20T03:09:44.818 INFO:teuthology.orchestra.run.trial126.stdout:(49/172): python3-cffi-1.14.5-5.el9.x86_64.rpm 26 MB/s | 253 kB 00:00 2026-02-20T03:09:44.827 INFO:teuthology.orchestra.run.trial126.stdout:(50/172): python3-cryptography-36.0.1-5.el9.x86 107 MB/s | 1.2 MB 00:00 2026-02-20T03:09:44.827 INFO:teuthology.orchestra.run.trial126.stdout:(51/172): python3-ply-3.11-14.el9.noarch.rpm 9.0 MB/s | 106 kB 00:00 2026-02-20T03:09:44.828 INFO:teuthology.orchestra.run.trial126.stdout:(52/172): python3-pycparser-2.20-6.el9.noarch.r 14 MB/s | 135 kB 00:00 2026-02-20T03:09:44.833 INFO:teuthology.orchestra.run.trial126.stdout:(53/172): python3-pyparsing-2.4.7-9.el9.noarch. 22 MB/s | 150 kB 00:00 2026-02-20T03:09:44.836 INFO:teuthology.orchestra.run.trial126.stdout:(54/172): python3-urllib3-1.26.5-7.el9.noarch.r 26 MB/s | 218 kB 00:00 2026-02-20T03:09:44.837 INFO:teuthology.orchestra.run.trial126.stdout:(55/172): python3-requests-2.25.1-10.el9.noarch 13 MB/s | 126 kB 00:00 2026-02-20T03:09:44.840 INFO:teuthology.orchestra.run.trial126.stdout:(56/172): unzip-6.0-59.el9.x86_64.rpm 29 MB/s | 182 kB 00:00 2026-02-20T03:09:44.846 INFO:teuthology.orchestra.run.trial126.stdout:(57/172): zip-3.0-35.el9.x86_64.rpm 26 MB/s | 266 kB 00:00 2026-02-20T03:09:44.945 INFO:teuthology.orchestra.run.trial126.stdout:(58/172): boost-program-options-1.75.0-13.el9.x 1.0 MB/s | 104 kB 00:00 2026-02-20T03:09:44.957 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 70/174 2026-02-20T03:09:44.967 INFO:teuthology.orchestra.run.trial126.stdout:(59/172): elfutils-libelf-devel-0.194-1.el9.x86 3.5 MB/s | 79 kB 00:00 2026-02-20T03:09:44.967 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 71/174 2026-02-20T03:09:44.971 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 72/174 2026-02-20T03:09:44.977 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 73/174 2026-02-20T03:09:44.980 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 74/174 2026-02-20T03:09:44.986 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/174 2026-02-20T03:09:44.989 INFO:teuthology.orchestra.run.trial177.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 76/174 2026-02-20T03:09:44.990 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 77/174 2026-02-20T03:09:45.000 INFO:teuthology.orchestra.run.trial126.stdout:(60/172): automake-1.16.2-8.el9.noarch.rpm 4.1 MB/s | 689 kB 00:00 2026-02-20T03:09:45.009 INFO:teuthology.orchestra.run.trial126.stdout:(61/172): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 313 kB 00:00 2026-02-20T03:09:45.012 INFO:teuthology.orchestra.run.trial126.stdout:(62/172): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2026-02-20T03:09:45.020 INFO:teuthology.orchestra.run.trial177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/174 2026-02-20T03:09:45.028 INFO:teuthology.orchestra.run.trial126.stdout:(63/172): flexiblas-3.0.4-9.el9.x86_64.rpm 1.1 MB/s | 30 kB 00:00 2026-02-20T03:09:45.034 INFO:teuthology.orchestra.run.trial126.stdout:(64/172): flexiblas-openblas-openmp-3.0.4-9.el9 676 kB/s | 15 kB 00:00 2026-02-20T03:09:45.052 INFO:teuthology.orchestra.run.trial126.stdout:(65/172): libaio-devel-0.3.111-13.el9.x86_64.rp 455 kB/s | 11 kB 00:00 2026-02-20T03:09:45.058 INFO:teuthology.orchestra.run.trial126.stdout:(66/172): libnbd-1.20.3-4.el9.x86_64.rpm 6.8 MB/s | 164 kB 00:00 2026-02-20T03:09:45.063 INFO:teuthology.orchestra.run.trial177.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 79/174 2026-02-20T03:09:45.067 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/174 2026-02-20T03:09:45.071 INFO:teuthology.orchestra.run.trial177.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 81/174 2026-02-20T03:09:45.077 INFO:teuthology.orchestra.run.trial126.stdout:(67/172): flexiblas-netlib-3.0.4-9.el9.x86_64.r 44 MB/s | 3.0 MB 00:00 2026-02-20T03:09:45.079 INFO:teuthology.orchestra.run.trial126.stdout:(68/172): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.9 MB/s | 160 kB 00:00 2026-02-20T03:09:45.079 INFO:teuthology.orchestra.run.trial177.stdout: Installing : uuid-1.6.2-55.el9.x86_64 82/174 2026-02-20T03:09:45.080 INFO:teuthology.orchestra.run.trial126.stdout:(69/172): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-20T03:09:45.086 INFO:teuthology.orchestra.run.trial177.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 83/174 2026-02-20T03:09:45.105 INFO:teuthology.orchestra.run.trial126.stdout:(70/172): libtool-2.4.6-46.el9.x86_64.rpm 23 MB/s | 581 kB 00:00 2026-02-20T03:09:45.106 INFO:teuthology.orchestra.run.trial126.stdout:(71/172): libstoragemgmt-1.10.1-1.el9.x86_64.rp 8.9 MB/s | 246 kB 00:00 2026-02-20T03:09:45.111 INFO:teuthology.orchestra.run.trial126.stdout:(72/172): librdkafka-1.6.1-102.el9.x86_64.rpm 19 MB/s | 662 kB 00:00 2026-02-20T03:09:45.114 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/174 2026-02-20T03:09:45.120 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 85/174 2026-02-20T03:09:45.123 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 86/174 2026-02-20T03:09:45.129 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 87/174 2026-02-20T03:09:45.129 INFO:teuthology.orchestra.run.trial126.stdout:(73/172): libuuid-devel-2.37.4-21.el9.x86_64.rp 1.0 MB/s | 25 kB 00:00 2026-02-20T03:09:45.133 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 88/174 2026-02-20T03:09:45.133 INFO:teuthology.orchestra.run.trial126.stdout:(74/172): libzstd-devel-1.5.5-1.el9.x86_64.rpm 2.3 MB/s | 51 kB 00:00 2026-02-20T03:09:45.134 INFO:teuthology.orchestra.run.trial126.stdout:(75/172): libxslt-1.1.34-12.el9.x86_64.rpm 8.0 MB/s | 233 kB 00:00 2026-02-20T03:09:45.140 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 89/174 2026-02-20T03:09:45.143 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 90/174 2026-02-20T03:09:45.154 INFO:teuthology.orchestra.run.trial126.stdout:(76/172): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-20T03:09:45.156 INFO:teuthology.orchestra.run.trial126.stdout:(77/172): lua-5.4.4-4.el9.x86_64.rpm 8.2 MB/s | 188 kB 00:00 2026-02-20T03:09:45.161 INFO:teuthology.orchestra.run.trial126.stdout:(78/172): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-20T03:09:45.171 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 91/174 2026-02-20T03:09:45.181 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 92/174 2026-02-20T03:09:45.186 INFO:teuthology.orchestra.run.trial126.stdout:(79/172): perl-Thread-Queue-3.14-460.el9.noarch 907 kB/s | 22 kB 00:00 2026-02-20T03:09:45.211 INFO:teuthology.orchestra.run.trial126.stdout:(80/172): perl-threads-2.25-460.el9.x86_64.rpm 2.3 MB/s | 58 kB 00:00 2026-02-20T03:09:45.216 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 93/174 2026-02-20T03:09:45.227 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 94/174 2026-02-20T03:09:45.231 INFO:teuthology.orchestra.run.trial126.stdout:(81/172): openblas-openmp-0.3.29-1.el9.x86_64.r 69 MB/s | 5.3 MB 00:00 2026-02-20T03:09:45.237 INFO:teuthology.orchestra.run.trial126.stdout:(82/172): perl-threads-shared-1.61-460.el9.x86_ 1.7 MB/s | 45 kB 00:00 2026-02-20T03:09:45.261 INFO:teuthology.orchestra.run.trial126.stdout:(83/172): postgresql-13.23-1.el9.x86_64.rpm 55 MB/s | 1.6 MB 00:00 2026-02-20T03:09:45.285 INFO:teuthology.orchestra.run.trial126.stdout:(84/172): postgresql-private-libs-13.23-1.el9.x 5.6 MB/s | 138 kB 00:00 2026-02-20T03:09:45.294 INFO:teuthology.orchestra.run.trial126.stdout:(85/172): openssl-devel-3.5.5-1.el9.x86_64.rpm 35 MB/s | 4.8 MB 00:00 2026-02-20T03:09:45.296 INFO:teuthology.orchestra.run.trial126.stdout:(86/172): postgresql-contrib-13.23-1.el9.x86_64 15 MB/s | 903 kB 00:00 2026-02-20T03:09:45.320 INFO:teuthology.orchestra.run.trial126.stdout:(87/172): protobuf-3.14.0-17.el9.x86_64.rpm 40 MB/s | 1.0 MB 00:00 2026-02-20T03:09:45.343 INFO:teuthology.orchestra.run.trial126.stdout:(88/172): postgresql-server-13.23-1.el9.x86_64. 98 MB/s | 5.8 MB 00:00 2026-02-20T03:09:45.356 INFO:teuthology.orchestra.run.trial126.stdout:(89/172): python3-colorama-0.4.6-3.el9.noarch.r 1.6 MB/s | 61 kB 00:00 2026-02-20T03:09:45.368 INFO:teuthology.orchestra.run.trial126.stdout:(90/172): python3-devel-3.9.25-3.el9.x86_64.rpm 9.5 MB/s | 244 kB 00:00 2026-02-20T03:09:45.380 INFO:teuthology.orchestra.run.trial126.stdout:(91/172): python3-jinja2-2.11.3-8.el9.noarch.rp 10 MB/s | 249 kB 00:00 2026-02-20T03:09:45.394 INFO:teuthology.orchestra.run.trial126.stdout:(92/172): python3-libstoragemgmt-1.10.1-1.el9.x 7.0 MB/s | 177 kB 00:00 2026-02-20T03:09:45.436 INFO:teuthology.orchestra.run.trial126.stdout:(93/172): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2026-02-20T03:09:45.437 INFO:teuthology.orchestra.run.trial126.stdout:(94/172): python3-lxml-4.6.5-3.el9.x86_64.rpm 21 MB/s | 1.2 MB 00:00 2026-02-20T03:09:45.452 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 95/174 2026-02-20T03:09:45.460 INFO:teuthology.orchestra.run.trial126.stdout:(95/172): python3-markupsafe-1.1.1-12.el9.x86_6 1.4 MB/s | 35 kB 00:00 2026-02-20T03:09:45.476 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 96/174 2026-02-20T03:09:45.480 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 97/174 2026-02-20T03:09:45.496 INFO:teuthology.orchestra.run.trial126.stdout:(96/172): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2026-02-20T03:09:45.497 INFO:teuthology.orchestra.run.trial126.stdout:(97/172): python3-numpy-f2py-1.23.5-2.el9.x86_6 12 MB/s | 442 kB 00:00 2026-02-20T03:09:45.523 INFO:teuthology.orchestra.run.trial126.stdout:(98/172): python3-protobuf-3.14.0-17.el9.noarch 10 MB/s | 267 kB 00:00 2026-02-20T03:09:45.524 INFO:teuthology.orchestra.run.trial126.stdout:(99/172): python3-packaging-20.9-5.el9.noarch.r 2.6 MB/s | 77 kB 00:00 2026-02-20T03:09:45.537 INFO:teuthology.orchestra.run.trial126.stdout:(100/172): python3-numpy-1.23.5-2.el9.x86_64.rp 62 MB/s | 6.1 MB 00:00 2026-02-20T03:09:45.538 INFO:teuthology.orchestra.run.trial177.stdout: Installing : openblas-0.3.29-1.el9.x86_64 98/174 2026-02-20T03:09:45.540 INFO:teuthology.orchestra.run.trial177.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 99/174 2026-02-20T03:09:45.548 INFO:teuthology.orchestra.run.trial126.stdout:(101/172): python3-pyasn1-0.4.8-6.el9.noarch.rp 6.3 MB/s | 159 kB 00:00 2026-02-20T03:09:45.551 INFO:teuthology.orchestra.run.trial126.stdout:(102/172): python3-pyasn1-modules-0.4.8-6.el9.n 10 MB/s | 279 kB 00:00 2026-02-20T03:09:45.559 INFO:teuthology.orchestra.run.trial126.stdout:(103/172): python3-requests-oauthlib-1.3.0-12.e 2.4 MB/s | 54 kB 00:00 2026-02-20T03:09:45.562 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 100/174 2026-02-20T03:09:45.575 INFO:teuthology.orchestra.run.trial126.stdout:(104/172): python3-toml-0.10.2-6.el9.noarch.rpm 1.7 MB/s | 42 kB 00:00 2026-02-20T03:09:45.580 INFO:teuthology.orchestra.run.trial126.stdout:(105/172): python3-wcwidth-0.2.5-8.el9.noarch.r 2.0 MB/s | 44 kB 00:00 2026-02-20T03:09:45.601 INFO:teuthology.orchestra.run.trial126.stdout:(106/172): qatlib-25.08.0-2.el9.x86_64.rpm 9.1 MB/s | 240 kB 00:00 2026-02-20T03:09:45.602 INFO:teuthology.orchestra.run.trial126.stdout:(107/172): qatlib-service-25.08.0-2.el9.x86_64. 1.7 MB/s | 37 kB 00:00 2026-02-20T03:09:45.623 INFO:teuthology.orchestra.run.trial126.stdout:(108/172): socat-1.7.4.1-8.el9.x86_64.rpm 14 MB/s | 303 kB 00:00 2026-02-20T03:09:45.627 INFO:teuthology.orchestra.run.trial126.stdout:(109/172): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-20T03:09:45.645 INFO:teuthology.orchestra.run.trial126.stdout:(110/172): uuid-1.6.2-55.el9.x86_64.rpm 2.6 MB/s | 58 kB 00:00 2026-02-20T03:09:45.651 INFO:teuthology.orchestra.run.trial126.stdout:(111/172): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 3.8 MB/s | 96 kB 00:00 2026-02-20T03:09:45.667 INFO:teuthology.orchestra.run.trial126.stdout:(112/172): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.1 MB/s | 189 kB 00:00 2026-02-20T03:09:45.677 INFO:teuthology.orchestra.run.trial126.stdout:(113/172): xmlsec1-openssl-1.2.29-13.el9.x86_64 3.5 MB/s | 90 kB 00:00 2026-02-20T03:09:45.689 INFO:teuthology.orchestra.run.trial126.stdout:(114/172): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.9 MB/s | 64 kB 00:00 2026-02-20T03:09:45.703 INFO:teuthology.orchestra.run.trial126.stdout:(115/172): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.7 MB/s | 45 kB 00:00 2026-02-20T03:09:45.735 INFO:teuthology.orchestra.run.trial126.stdout:(116/172): python3-scipy-1.9.3-2.el9.x86_64.rpm 103 MB/s | 19 MB 00:00 2026-02-20T03:09:45.891 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 101/174 2026-02-20T03:09:45.965 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 102/174 2026-02-20T03:09:46.034 INFO:teuthology.orchestra.run.trial126.stdout:(117/172): abseil-cpp-20211102.0-4.el9.x86_64.r 1.8 MB/s | 551 kB 00:00 2026-02-20T03:09:46.082 INFO:teuthology.orchestra.run.trial126.stdout:(118/172): gperftools-libs-2.9.1-3.el9.x86_64.r 6.2 MB/s | 308 kB 00:00 2026-02-20T03:09:46.117 INFO:teuthology.orchestra.run.trial126.stdout:(119/172): grpc-data-1.46.7-10.el9.noarch.rpm 548 kB/s | 19 kB 00:00 2026-02-20T03:09:46.163 INFO:teuthology.orchestra.run.trial028.stdout:(82/172): postgresql-13.23-1.el9.x86_64.rpm 865 kB/s | 1.6 MB 00:01 2026-02-20T03:09:46.249 INFO:teuthology.orchestra.run.trial126.stdout:(120/172): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2026-02-20T03:09:46.270 INFO:teuthology.orchestra.run.trial126.stdout:(121/172): libarrow-9.0.0-15.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2026-02-20T03:09:46.306 INFO:teuthology.orchestra.run.trial126.stdout:(122/172): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-20T03:09:46.341 INFO:teuthology.orchestra.run.trial126.stdout:(123/172): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2026-02-20T03:09:46.365 INFO:teuthology.orchestra.run.trial126.stdout:(124/172): libarrow-doc-9.0.0-15.el9.noarch.rpm 212 kB/s | 25 kB 00:00 2026-02-20T03:09:46.376 INFO:teuthology.orchestra.run.trial126.stdout:(125/172): luarocks-3.9.2-5.el9.noarch.rpm 4.1 MB/s | 151 kB 00:00 2026-02-20T03:09:46.414 INFO:teuthology.orchestra.run.trial126.stdout:(126/172): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2026-02-20T03:09:46.449 INFO:teuthology.orchestra.run.trial126.stdout:(127/172): python3-autocommand-2.2.2-8.el9.noar 845 kB/s | 29 kB 00:00 2026-02-20T03:09:46.484 INFO:teuthology.orchestra.run.trial126.stdout:(128/172): python3-backports-tarfile-1.2.0-1.el 1.7 MB/s | 60 kB 00:00 2026-02-20T03:09:46.519 INFO:teuthology.orchestra.run.trial126.stdout:(129/172): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.2 MB/s | 43 kB 00:00 2026-02-20T03:09:46.555 INFO:teuthology.orchestra.run.trial126.stdout:(130/172): python3-cachetools-4.2.4-1.el9.noarc 922 kB/s | 32 kB 00:00 2026-02-20T03:09:46.589 INFO:teuthology.orchestra.run.trial126.stdout:(131/172): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.7 MB/s | 838 kB 00:00 2026-02-20T03:09:46.590 INFO:teuthology.orchestra.run.trial126.stdout:(132/172): python3-certifi-2023.05.07-4.el9.noa 401 kB/s | 14 kB 00:00 2026-02-20T03:09:46.625 INFO:teuthology.orchestra.run.trial126.stdout:(133/172): python3-cheroot-10.0.1-4.el9.noarch. 4.8 MB/s | 173 kB 00:00 2026-02-20T03:09:46.640 INFO:teuthology.orchestra.run.trial126.stdout:(134/172): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2026-02-20T03:09:46.641 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 103/174 2026-02-20T03:09:46.655 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 104/174 2026-02-20T03:09:46.660 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 105/174 2026-02-20T03:09:46.661 INFO:teuthology.orchestra.run.trial126.stdout:(135/172): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.1 MB/s | 303 kB 00:00 2026-02-20T03:09:46.663 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 106/174 2026-02-20T03:09:46.685 INFO:teuthology.orchestra.run.trial126.stdout:(136/172): python3-google-auth-2.45.0-1.el9.noa 5.4 MB/s | 254 kB 00:00 2026-02-20T03:09:46.709 INFO:teuthology.orchestra.run.trial126.stdout:(137/172): python3-grpcio-1.46.7-10.el9.x86_64. 43 MB/s | 2.0 MB 00:00 2026-02-20T03:09:46.727 INFO:teuthology.orchestra.run.trial126.stdout:(138/172): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2026-02-20T03:09:46.745 INFO:teuthology.orchestra.run.trial126.stdout:(139/172): python3-influxdb-5.3.1-1.el9.noarch. 3.8 MB/s | 139 kB 00:00 2026-02-20T03:09:46.768 INFO:teuthology.orchestra.run.trial126.stdout:(140/172): python3-isodate-0.6.1-3.el9.noarch.r 1.4 MB/s | 56 kB 00:00 2026-02-20T03:09:46.780 INFO:teuthology.orchestra.run.trial126.stdout:(141/172): python3-jaraco-8.2.1-3.el9.noarch.rp 306 kB/s | 11 kB 00:00 2026-02-20T03:09:46.802 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 107/174 2026-02-20T03:09:46.803 INFO:teuthology.orchestra.run.trial177.stdout: Upgrading : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 108/174 2026-02-20T03:09:46.807 INFO:teuthology.orchestra.run.trial126.stdout:(142/172): python3-jaraco-classes-3.2.1-5.el9.n 452 kB/s | 18 kB 00:00 2026-02-20T03:09:46.815 INFO:teuthology.orchestra.run.trial126.stdout:(143/172): python3-jaraco-collections-3.0.0-8.e 664 kB/s | 23 kB 00:00 2026-02-20T03:09:46.832 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 108/174 2026-02-20T03:09:46.834 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 109/174 2026-02-20T03:09:46.840 INFO:teuthology.orchestra.run.trial177.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/174 2026-02-20T03:09:46.846 INFO:teuthology.orchestra.run.trial126.stdout:(144/172): python3-jaraco-context-6.0.1-3.el9.n 506 kB/s | 20 kB 00:00 2026-02-20T03:09:46.850 INFO:teuthology.orchestra.run.trial126.stdout:(145/172): python3-jaraco-functools-3.5.0-2.el9 558 kB/s | 19 kB 00:00 2026-02-20T03:09:46.886 INFO:teuthology.orchestra.run.trial126.stdout:(146/172): python3-jaraco-text-4.0.0-2.el9.noar 665 kB/s | 26 kB 00:00 2026-02-20T03:09:46.891 INFO:teuthology.orchestra.run.trial126.stdout:(147/172): python3-kubernetes-26.1.0-3.el9.noar 25 MB/s | 1.0 MB 00:00 2026-02-20T03:09:46.922 INFO:teuthology.orchestra.run.trial126.stdout:(148/172): python3-logutils-0.3.5-21.el9.noarch 1.2 MB/s | 46 kB 00:00 2026-02-20T03:09:46.926 INFO:teuthology.orchestra.run.trial126.stdout:(149/172): python3-more-itertools-8.12.0-2.el9. 2.2 MB/s | 79 kB 00:00 2026-02-20T03:09:46.960 INFO:teuthology.orchestra.run.trial126.stdout:(150/172): python3-msgpack-1.0.3-2.el9.x86_64.r 2.2 MB/s | 86 kB 00:00 2026-02-20T03:09:46.962 INFO:teuthology.orchestra.run.trial126.stdout:(151/172): python3-natsort-7.1.1-5.el9.noarch.r 1.6 MB/s | 58 kB 00:00 2026-02-20T03:09:46.997 INFO:teuthology.orchestra.run.trial126.stdout:(152/172): python3-portend-3.1.0-2.el9.noarch.r 471 kB/s | 16 kB 00:00 2026-02-20T03:09:47.005 INFO:teuthology.orchestra.run.trial126.stdout:(153/172): python3-pecan-1.4.2-3.el9.noarch.rpm 6.0 MB/s | 272 kB 00:00 2026-02-20T03:09:47.032 INFO:teuthology.orchestra.run.trial126.stdout:(154/172): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.5 MB/s | 90 kB 00:00 2026-02-20T03:09:47.042 INFO:teuthology.orchestra.run.trial126.stdout:(155/172): python3-pyperclip-1.8.2-2.el9.noarch 765 kB/s | 28 kB 00:00 2026-02-20T03:09:47.066 INFO:teuthology.orchestra.run.trial177.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/174 2026-02-20T03:09:47.067 INFO:teuthology.orchestra.run.trial177.stdout: Installing : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 112/174 2026-02-20T03:09:47.067 INFO:teuthology.orchestra.run.trial126.stdout:(156/172): python3-repoze-lru-0.7-16.el9.noarch 881 kB/s | 31 kB 00:00 2026-02-20T03:09:47.083 INFO:teuthology.orchestra.run.trial126.stdout:(157/172): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2026-02-20T03:09:47.084 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 112/174 2026-02-20T03:09:47.085 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 113/174 2026-02-20T03:09:47.102 INFO:teuthology.orchestra.run.trial126.stdout:(158/172): python3-rsa-4.9-2.el9.noarch.rpm 1.6 MB/s | 59 kB 00:00 2026-02-20T03:09:47.123 INFO:teuthology.orchestra.run.trial126.stdout:(159/172): python3-saml-1.16.0-1.el9.noarch.rpm 3.1 MB/s | 125 kB 00:00 2026-02-20T03:09:47.137 INFO:teuthology.orchestra.run.trial126.stdout:(160/172): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2026-02-20T03:09:47.161 INFO:teuthology.orchestra.run.trial126.stdout:(161/172): python3-typing-extensions-4.15.0-1.e 2.2 MB/s | 86 kB 00:00 2026-02-20T03:09:47.174 INFO:teuthology.orchestra.run.trial126.stdout:(162/172): python3-webob-1.8.8-2.el9.noarch.rpm 6.3 MB/s | 230 kB 00:00 2026-02-20T03:09:47.200 INFO:teuthology.orchestra.run.trial126.stdout:(163/172): python3-websocket-client-1.2.3-2.el9 2.3 MB/s | 90 kB 00:00 2026-02-20T03:09:47.206 INFO:teuthology.orchestra.run.trial028.stdout:(83/172): postgresql-contrib-13.23-1.el9.x86_64 866 kB/s | 903 kB 00:01 2026-02-20T03:09:47.211 INFO:teuthology.orchestra.run.trial126.stdout:(164/172): python3-werkzeug-2.0.3-3.el9.1.noarc 11 MB/s | 427 kB 00:00 2026-02-20T03:09:47.237 INFO:teuthology.orchestra.run.trial126.stdout:(165/172): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.3 MB/s | 48 kB 00:00 2026-02-20T03:09:47.246 INFO:teuthology.orchestra.run.trial126.stdout:(166/172): python3-xmltodict-0.12.0-15.el9.noar 634 kB/s | 22 kB 00:00 2026-02-20T03:09:47.274 INFO:teuthology.orchestra.run.trial126.stdout:(167/172): python3-zc-lockfile-2.0-10.el9.noarc 544 kB/s | 20 kB 00:00 2026-02-20T03:09:47.282 INFO:teuthology.orchestra.run.trial126.stdout:(168/172): re2-20211101-20.el9.x86_64.rpm 5.2 MB/s | 191 kB 00:00 2026-02-20T03:09:47.309 INFO:teuthology.orchestra.run.trial126.stdout:(169/172): protobuf-compiler-3.14.0-17.el9.x86_ 537 kB/s | 862 kB 00:01 2026-02-20T03:09:47.364 INFO:teuthology.orchestra.run.trial126.stdout:(170/172): thrift-0.15.0-4.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2026-02-20T03:09:47.383 INFO:teuthology.orchestra.run.trial028.stdout:(84/172): postgresql-private-libs-13.23-1.el9.x 780 kB/s | 138 kB 00:00 2026-02-20T03:09:47.451 INFO:teuthology.orchestra.run.trial126.stdout:(171/172): librados2-19.2.3-700.gf4ef35d9.el9.x 20 MB/s | 3.4 MB 00:00 2026-02-20T03:09:47.490 INFO:teuthology.orchestra.run.trial126.stdout:(172/172): librbd1-19.2.3-700.gf4ef35d9.el9.x86 17 MB/s | 3.2 MB 00:00 2026-02-20T03:09:47.492 INFO:teuthology.orchestra.run.trial126.stdout:-------------------------------------------------------------------------------- 2026-02-20T03:09:47.492 INFO:teuthology.orchestra.run.trial126.stdout:Total 39 MB/s | 230 MB 00:05 2026-02-20T03:09:48.066 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 114/174 2026-02-20T03:09:48.068 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 114/174 2026-02-20T03:09:48.086 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 114/174 2026-02-20T03:09:48.096 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 115/174 2026-02-20T03:09:48.103 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 116/174 2026-02-20T03:09:48.117 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/174 2026-02-20T03:09:48.133 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/174 2026-02-20T03:09:48.209 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/174 2026-02-20T03:09:48.216 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction check 2026-02-20T03:09:48.218 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 120/174 2026-02-20T03:09:48.223 INFO:teuthology.orchestra.run.trial028.stdout:(85/172): openssl-devel-3.5.5-1.el9.x86_64.rpm 882 kB/s | 4.8 MB 00:05 2026-02-20T03:09:48.243 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/174 2026-02-20T03:09:48.273 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 122/174 2026-02-20T03:09:48.276 INFO:teuthology.orchestra.run.trial126.stdout:Transaction check succeeded. 2026-02-20T03:09:48.276 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction test 2026-02-20T03:09:48.324 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/174 2026-02-20T03:09:48.331 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/174 2026-02-20T03:09:48.334 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/174 2026-02-20T03:09:48.340 INFO:teuthology.orchestra.run.trial177.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 126/174 2026-02-20T03:09:48.342 INFO:teuthology.orchestra.run.trial177.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 127/174 2026-02-20T03:09:48.343 INFO:teuthology.orchestra.run.trial177.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 128/174 2026-02-20T03:09:48.360 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 128/174 2026-02-20T03:09:48.478 INFO:teuthology.orchestra.run.trial177.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 129/174 2026-02-20T03:09:48.480 INFO:teuthology.orchestra.run.trial177.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 130/174 2026-02-20T03:09:48.645 INFO:teuthology.orchestra.run.trial028.stdout:(86/172): openblas-openmp-0.3.29-1.el9.x86_64.r 898 kB/s | 5.3 MB 00:06 2026-02-20T03:09:48.754 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 130/174 2026-02-20T03:09:48.754 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T03:09:48.754 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:49.032 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 131/174 2026-02-20T03:09:49.078 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 131/174 2026-02-20T03:09:49.079 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T03:09:49.079 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T03:09:49.079 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:49.082 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 132/174 2026-02-20T03:09:49.173 INFO:teuthology.orchestra.run.trial126.stdout:Transaction test succeeded. 2026-02-20T03:09:49.173 INFO:teuthology.orchestra.run.trial126.stdout:Running transaction 2026-02-20T03:09:49.420 INFO:teuthology.orchestra.run.trial028.stdout:(87/172): protobuf-3.14.0-17.el9.x86_64.rpm 860 kB/s | 1.0 MB 00:01 2026-02-20T03:09:49.520 INFO:teuthology.orchestra.run.trial028.stdout:(88/172): python3-colorama-0.4.6-3.el9.noarch.r 612 kB/s | 61 kB 00:00 2026-02-20T03:09:49.854 INFO:teuthology.orchestra.run.trial028.stdout:(89/172): python3-devel-3.9.25-3.el9.x86_64.rpm 732 kB/s | 244 kB 00:00 2026-02-20T03:09:50.132 INFO:teuthology.orchestra.run.trial126.stdout: Preparing : 1/1 2026-02-20T03:09:50.138 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/174 2026-02-20T03:09:50.151 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/174 2026-02-20T03:09:50.163 INFO:teuthology.orchestra.run.trial126.stdout: Installing : thrift-0.15.0-4.el9.x86_64 3/174 2026-02-20T03:09:50.190 INFO:teuthology.orchestra.run.trial028.stdout:(90/172): python3-jinja2-2.11.3-8.el9.noarch.rp 741 kB/s | 249 kB 00:00 2026-02-20T03:09:50.319 INFO:teuthology.orchestra.run.trial126.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/174 2026-02-20T03:09:50.324 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/174 2026-02-20T03:09:50.378 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/174 2026-02-20T03:09:50.379 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/174 2026-02-20T03:09:50.408 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/174 2026-02-20T03:09:50.417 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/174 2026-02-20T03:09:50.419 INFO:teuthology.orchestra.run.trial126.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/174 2026-02-20T03:09:50.421 INFO:teuthology.orchestra.run.trial126.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/174 2026-02-20T03:09:50.423 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/174 2026-02-20T03:09:50.428 INFO:teuthology.orchestra.run.trial126.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 11/174 2026-02-20T03:09:50.449 INFO:teuthology.orchestra.run.trial028.stdout:(91/172): python3-libstoragemgmt-1.10.1-1.el9.x 684 kB/s | 177 kB 00:00 2026-02-20T03:09:50.493 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 12/174 2026-02-20T03:09:50.503 INFO:teuthology.orchestra.run.trial126.stdout: Installing : postgresql-13.23-1.el9.x86_64 13/174 2026-02-20T03:09:50.503 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 14/174 2026-02-20T03:09:50.536 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 14/174 2026-02-20T03:09:50.537 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_ 15/174 2026-02-20T03:09:50.580 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_ 15/174 2026-02-20T03:09:50.586 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 16/174 2026-02-20T03:09:50.590 INFO:teuthology.orchestra.run.trial126.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 17/174 2026-02-20T03:09:50.622 INFO:teuthology.orchestra.run.trial126.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/174 2026-02-20T03:09:50.653 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 19/174 2026-02-20T03:09:50.657 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/174 2026-02-20T03:09:50.678 INFO:teuthology.orchestra.run.trial126.stdout: Installing : liboath-2.6.12-1.el9.x86_64 21/174 2026-02-20T03:09:50.684 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/174 2026-02-20T03:09:50.692 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/174 2026-02-20T03:09:50.696 INFO:teuthology.orchestra.run.trial126.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 24/174 2026-02-20T03:09:50.701 INFO:teuthology.orchestra.run.trial126.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 25/174 2026-02-20T03:09:50.703 INFO:teuthology.orchestra.run.trial126.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/174 2026-02-20T03:09:50.708 INFO:teuthology.orchestra.run.trial126.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 27/174 2026-02-20T03:09:50.731 INFO:teuthology.orchestra.run.trial126.stdout: Installing : unzip-6.0-59.el9.x86_64 28/174 2026-02-20T03:09:50.744 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 29/174 2026-02-20T03:09:50.748 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 30/174 2026-02-20T03:09:50.753 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 31/174 2026-02-20T03:09:50.757 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 32/174 2026-02-20T03:09:50.783 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 33/174 2026-02-20T03:09:50.787 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x 34/174 2026-02-20T03:09:50.797 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9 35/174 2026-02-20T03:09:50.808 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 36/174 2026-02-20T03:09:50.814 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 37/174 2026-02-20T03:09:50.838 INFO:teuthology.orchestra.run.trial126.stdout: Installing : zip-3.0-35.el9.x86_64 38/174 2026-02-20T03:09:50.841 INFO:teuthology.orchestra.run.trial126.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/174 2026-02-20T03:09:50.844 INFO:teuthology.orchestra.run.trial126.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 40/174 2026-02-20T03:09:50.847 INFO:teuthology.orchestra.run.trial126.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 41/174 2026-02-20T03:09:50.874 INFO:teuthology.orchestra.run.trial126.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 42/174 2026-02-20T03:09:50.883 INFO:teuthology.orchestra.run.trial126.stdout: Installing : automake-1.16.2-8.el9.noarch 43/174 2026-02-20T03:09:50.907 INFO:teuthology.orchestra.run.trial126.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/174 2026-02-20T03:09:50.959 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/174 2026-02-20T03:09:50.971 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/174 2026-02-20T03:09:50.974 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/174 2026-02-20T03:09:50.978 INFO:teuthology.orchestra.run.trial126.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 48/174 2026-02-20T03:09:50.984 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 49/174 2026-02-20T03:09:50.992 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/174 2026-02-20T03:09:50.995 INFO:teuthology.orchestra.run.trial126.stdout: Installing : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 51/174 2026-02-20T03:09:51.000 INFO:teuthology.orchestra.run.trial126.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 52/174 2026-02-20T03:09:51.003 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/174 2026-02-20T03:09:51.017 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 54/174 2026-02-20T03:09:51.038 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 55/174 2026-02-20T03:09:51.043 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 56/174 2026-02-20T03:09:51.048 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 57/174 2026-02-20T03:09:51.059 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 58/174 2026-02-20T03:09:51.064 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 59/174 2026-02-20T03:09:51.073 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 60/174 2026-02-20T03:09:51.079 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 61/174 2026-02-20T03:09:51.099 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 62/174 2026-02-20T03:09:51.108 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 63/174 2026-02-20T03:09:51.162 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 64/174 2026-02-20T03:09:51.174 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 65/174 2026-02-20T03:09:51.190 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 66/174 2026-02-20T03:09:51.194 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 67/174 2026-02-20T03:09:51.202 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 68/174 2026-02-20T03:09:51.242 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 69/174 2026-02-20T03:09:51.568 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 70/174 2026-02-20T03:09:51.578 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 71/174 2026-02-20T03:09:51.583 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 72/174 2026-02-20T03:09:51.588 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 73/174 2026-02-20T03:09:51.594 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 74/174 2026-02-20T03:09:51.600 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/174 2026-02-20T03:09:51.602 INFO:teuthology.orchestra.run.trial126.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 76/174 2026-02-20T03:09:51.603 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 77/174 2026-02-20T03:09:51.633 INFO:teuthology.orchestra.run.trial126.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/174 2026-02-20T03:09:51.678 INFO:teuthology.orchestra.run.trial126.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 79/174 2026-02-20T03:09:51.682 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/174 2026-02-20T03:09:51.686 INFO:teuthology.orchestra.run.trial126.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 81/174 2026-02-20T03:09:51.694 INFO:teuthology.orchestra.run.trial126.stdout: Installing : uuid-1.6.2-55.el9.x86_64 82/174 2026-02-20T03:09:51.701 INFO:teuthology.orchestra.run.trial126.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 83/174 2026-02-20T03:09:51.728 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/174 2026-02-20T03:09:51.734 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 85/174 2026-02-20T03:09:51.738 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 86/174 2026-02-20T03:09:51.743 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 87/174 2026-02-20T03:09:51.747 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 88/174 2026-02-20T03:09:51.754 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 89/174 2026-02-20T03:09:51.757 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 90/174 2026-02-20T03:09:51.785 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 91/174 2026-02-20T03:09:51.795 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 92/174 2026-02-20T03:09:51.829 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 93/174 2026-02-20T03:09:51.839 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 94/174 2026-02-20T03:09:51.878 INFO:teuthology.orchestra.run.trial028.stdout:(92/172): python3-lxml-4.6.5-3.el9.x86_64.rpm 876 kB/s | 1.2 MB 00:01 2026-02-20T03:09:52.060 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 95/174 2026-02-20T03:09:52.083 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 96/174 2026-02-20T03:09:52.087 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 97/174 2026-02-20T03:09:52.134 INFO:teuthology.orchestra.run.trial028.stdout:(93/172): python3-mako-1.1.4-6.el9.noarch.rpm 672 kB/s | 172 kB 00:00 2026-02-20T03:09:52.145 INFO:teuthology.orchestra.run.trial126.stdout: Installing : openblas-0.3.29-1.el9.x86_64 98/174 2026-02-20T03:09:52.147 INFO:teuthology.orchestra.run.trial126.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 99/174 2026-02-20T03:09:52.168 INFO:teuthology.orchestra.run.trial126.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 100/174 2026-02-20T03:09:52.234 INFO:teuthology.orchestra.run.trial028.stdout:(94/172): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 35 kB 00:00 2026-02-20T03:09:52.491 INFO:teuthology.orchestra.run.trial126.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 101/174 2026-02-20T03:09:52.563 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 102/174 2026-02-20T03:09:53.226 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 103/174 2026-02-20T03:09:53.240 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 104/174 2026-02-20T03:09:53.244 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 105/174 2026-02-20T03:09:53.247 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 106/174 2026-02-20T03:09:53.390 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 107/174 2026-02-20T03:09:53.391 INFO:teuthology.orchestra.run.trial126.stdout: Upgrading : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 108/174 2026-02-20T03:09:53.419 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 108/174 2026-02-20T03:09:53.422 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 109/174 2026-02-20T03:09:53.428 INFO:teuthology.orchestra.run.trial126.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/174 2026-02-20T03:09:53.659 INFO:teuthology.orchestra.run.trial126.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/174 2026-02-20T03:09:53.660 INFO:teuthology.orchestra.run.trial126.stdout: Installing : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 112/174 2026-02-20T03:09:53.676 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 112/174 2026-02-20T03:09:53.677 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 113/174 2026-02-20T03:09:53.812 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 132/174 2026-02-20T03:09:53.813 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /sys 2026-02-20T03:09:53.813 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /proc 2026-02-20T03:09:53.813 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /mnt 2026-02-20T03:09:53.813 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /var/tmp 2026-02-20T03:09:53.813 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /home 2026-02-20T03:09:53.813 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /root 2026-02-20T03:09:53.813 INFO:teuthology.orchestra.run.trial177.stdout:skipping the directory /tmp 2026-02-20T03:09:53.813 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:53.920 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 133/174 2026-02-20T03:09:53.943 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 133/174 2026-02-20T03:09:53.943 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:09:53.943 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T03:09:53.943 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T03:09:53.943 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T03:09:53.944 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:54.033 INFO:teuthology.orchestra.run.trial028.stdout:(95/172): postgresql-server-13.23-1.el9.x86_64. 889 kB/s | 5.8 MB 00:06 2026-02-20T03:09:54.154 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 134/174 2026-02-20T03:09:54.176 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 134/174 2026-02-20T03:09:54.176 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:09:54.176 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T03:09:54.176 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T03:09:54.176 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T03:09:54.176 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:54.182 INFO:teuthology.orchestra.run.trial177.stdout: Installing : mailcap-2.1.49-5.el9.noarch 135/174 2026-02-20T03:09:54.184 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 136/174 2026-02-20T03:09:54.203 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 137/174 2026-02-20T03:09:54.203 INFO:teuthology.orchestra.run.trial177.stdout:Creating group 'qat' with GID 992. 2026-02-20T03:09:54.203 INFO:teuthology.orchestra.run.trial177.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T03:09:54.203 INFO:teuthology.orchestra.run.trial177.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T03:09:54.203 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:54.212 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 137/174 2026-02-20T03:09:54.237 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 137/174 2026-02-20T03:09:54.237 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T03:09:54.237 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:54.272 INFO:teuthology.orchestra.run.trial177.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 138/174 2026-02-20T03:09:54.335 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 139/174 2026-02-20T03:09:54.338 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 140/174 2026-02-20T03:09:54.351 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 140/174 2026-02-20T03:09:54.351 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:09:54.352 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T03:09:54.352 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:54.600 INFO:teuthology.orchestra.run.trial028.stdout:(96/172): python3-numpy-f2py-1.23.5-2.el9.x86_6 780 kB/s | 442 kB 00:00 2026-02-20T03:09:54.676 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 114/174 2026-02-20T03:09:54.679 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 114/174 2026-02-20T03:09:54.697 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 114/174 2026-02-20T03:09:54.707 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 115/174 2026-02-20T03:09:54.715 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-packaging-20.9-5.el9.noarch 116/174 2026-02-20T03:09:54.729 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/174 2026-02-20T03:09:54.745 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/174 2026-02-20T03:09:54.777 INFO:teuthology.orchestra.run.trial028.stdout:(97/172): python3-packaging-20.9-5.el9.noarch.r 435 kB/s | 77 kB 00:00 2026-02-20T03:09:54.821 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/174 2026-02-20T03:09:54.830 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 120/174 2026-02-20T03:09:54.854 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/174 2026-02-20T03:09:54.884 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 122/174 2026-02-20T03:09:54.935 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/174 2026-02-20T03:09:54.941 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/174 2026-02-20T03:09:54.945 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/174 2026-02-20T03:09:54.949 INFO:teuthology.orchestra.run.trial126.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 126/174 2026-02-20T03:09:54.952 INFO:teuthology.orchestra.run.trial126.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 127/174 2026-02-20T03:09:54.953 INFO:teuthology.orchestra.run.trial126.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 128/174 2026-02-20T03:09:54.970 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 128/174 2026-02-20T03:09:55.046 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 141/174 2026-02-20T03:09:55.070 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 141/174 2026-02-20T03:09:55.071 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:09:55.071 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T03:09:55.071 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T03:09:55.071 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T03:09:55.071 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:55.086 INFO:teuthology.orchestra.run.trial126.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 129/174 2026-02-20T03:09:55.088 INFO:teuthology.orchestra.run.trial126.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 130/174 2026-02-20T03:09:55.111 INFO:teuthology.orchestra.run.trial028.stdout:(98/172): python3-protobuf-3.14.0-17.el9.noarch 801 kB/s | 267 kB 00:00 2026-02-20T03:09:55.126 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 142/174 2026-02-20T03:09:55.128 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 142/174 2026-02-20T03:09:55.133 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el 143/174 2026-02-20T03:09:55.153 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.e 144/174 2026-02-20T03:09:55.154 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noar 145/174 2026-02-20T03:09:55.368 INFO:teuthology.orchestra.run.trial028.stdout:(99/172): python3-pyasn1-0.4.8-6.el9.noarch.rpm 620 kB/s | 159 kB 00:00 2026-02-20T03:09:55.387 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 130/174 2026-02-20T03:09:55.387 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T03:09:55.387 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:09:55.458 INFO:teuthology.orchestra.run.trial028.stdout:(100/172): python3-babel-2.9.1-2.el9.noarch.rpm 896 kB/s | 6.0 MB 00:06 2026-02-20T03:09:55.558 INFO:teuthology.orchestra.run.trial028.stdout:(101/172): python3-requests-oauthlib-1.3.0-12.e 537 kB/s | 54 kB 00:00 2026-02-20T03:09:55.647 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noar 145/174 2026-02-20T03:09:55.650 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.no 146/174 2026-02-20T03:09:55.671 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 131/174 2026-02-20T03:09:55.701 INFO:teuthology.orchestra.run.trial028.stdout:(102/172): python3-pyasn1-modules-0.4.8-6.el9.n 836 kB/s | 279 kB 00:00 2026-02-20T03:09:55.711 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 131/174 2026-02-20T03:09:55.711 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T03:09:55.711 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T03:09:55.711 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:09:55.715 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 132/174 2026-02-20T03:09:55.802 INFO:teuthology.orchestra.run.trial028.stdout:(103/172): python3-toml-0.10.2-6.el9.noarch.rpm 413 kB/s | 42 kB 00:00 2026-02-20T03:09:55.903 INFO:teuthology.orchestra.run.trial028.stdout:(104/172): python3-wcwidth-0.2.5-8.el9.noarch.r 441 kB/s | 44 kB 00:00 2026-02-20T03:09:56.102 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.no 146/174 2026-02-20T03:09:56.103 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef 147/174 2026-02-20T03:09:56.115 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef 147/174 2026-02-20T03:09:56.116 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.no 148/174 2026-02-20T03:09:56.172 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.no 148/174 2026-02-20T03:09:56.220 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9 149/174 2026-02-20T03:09:56.221 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 150/174 2026-02-20T03:09:56.235 INFO:teuthology.orchestra.run.trial028.stdout:(105/172): qatlib-25.08.0-2.el9.x86_64.rpm 720 kB/s | 240 kB 00:00 2026-02-20T03:09:56.242 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 150/174 2026-02-20T03:09:56.242 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:09:56.242 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T03:09:56.242 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T03:09:56.242 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T03:09:56.243 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:56.253 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 151/174 2026-02-20T03:09:56.263 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 151/174 2026-02-20T03:09:56.334 INFO:teuthology.orchestra.run.trial028.stdout:(106/172): qatlib-service-25.08.0-2.el9.x86_64. 375 kB/s | 37 kB 00:00 2026-02-20T03:09:56.433 INFO:teuthology.orchestra.run.trial028.stdout:(107/172): qatzip-libs-1.3.1-1.el9.x86_64.rpm 669 kB/s | 66 kB 00:00 2026-02-20T03:09:56.710 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 152/174 2026-02-20T03:09:56.711 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 153/174 2026-02-20T03:09:56.733 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 153/174 2026-02-20T03:09:56.733 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:09:56.734 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T03:09:56.734 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T03:09:56.734 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T03:09:56.734 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:56.743 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35 154/174 2026-02-20T03:09:56.763 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35 154/174 2026-02-20T03:09:56.764 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:09:56.764 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T03:09:56.764 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:56.777 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 155/174 2026-02-20T03:09:56.798 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 155/174 2026-02-20T03:09:56.798 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:09:56.798 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-20T03:09:56.798 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T03:09:56.798 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T03:09:56.799 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:56.843 INFO:teuthology.orchestra.run.trial028.stdout:(108/172): socat-1.7.4.1-8.el9.x86_64.rpm 739 kB/s | 303 kB 00:00 2026-02-20T03:09:56.937 INFO:teuthology.orchestra.run.trial177.stdout: Installing : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 156/174 2026-02-20T03:09:56.942 INFO:teuthology.orchestra.run.trial028.stdout:(109/172): uuid-1.6.2-55.el9.x86_64.rpm 584 kB/s | 58 kB 00:00 2026-02-20T03:09:56.958 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 156/174 2026-02-20T03:09:56.958 INFO:teuthology.orchestra.run.trial177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:09:56.958 INFO:teuthology.orchestra.run.trial177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T03:09:56.958 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T03:09:56.958 INFO:teuthology.orchestra.run.trial177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T03:09:56.958 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:09:57.119 INFO:teuthology.orchestra.run.trial028.stdout:(110/172): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 542 kB/s | 96 kB 00:00 2026-02-20T03:09:57.375 INFO:teuthology.orchestra.run.trial028.stdout:(111/172): xmlsec1-1.2.29-13.el9.x86_64.rpm 740 kB/s | 189 kB 00:00 2026-02-20T03:09:57.552 INFO:teuthology.orchestra.run.trial028.stdout:(112/172): xmlsec1-openssl-1.2.29-13.el9.x86_64 510 kB/s | 90 kB 00:00 2026-02-20T03:09:57.651 INFO:teuthology.orchestra.run.trial028.stdout:(113/172): xmlstarlet-1.6.1-20.el9.x86_64.rpm 644 kB/s | 64 kB 00:00 2026-02-20T03:09:57.750 INFO:teuthology.orchestra.run.trial028.stdout:(114/172): zlib-devel-1.2.11-41.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2026-02-20T03:09:57.779 INFO:teuthology.orchestra.run.trial028.stdout:(115/172): lua-devel-5.4.4-4.el9.x86_64.rpm 765 kB/s | 22 kB 00:00 2026-02-20T03:09:57.827 INFO:teuthology.orchestra.run.trial028.stdout:(116/172): protobuf-compiler-3.14.0-17.el9.x86_ 18 MB/s | 862 kB 00:00 2026-02-20T03:09:58.042 INFO:teuthology.orchestra.run.trial028.stdout:(117/172): abseil-cpp-20211102.0-4.el9.x86_64.r 2.5 MB/s | 551 kB 00:00 2026-02-20T03:09:58.075 INFO:teuthology.orchestra.run.trial028.stdout:(118/172): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2026-02-20T03:09:58.100 INFO:teuthology.orchestra.run.trial028.stdout:(119/172): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2026-02-20T03:09:58.209 INFO:teuthology.orchestra.run.trial028.stdout:(120/172): libarrow-9.0.0-15.el9.x86_64.rpm 40 MB/s | 4.4 MB 00:00 2026-02-20T03:09:58.234 INFO:teuthology.orchestra.run.trial028.stdout:(121/172): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.0 MB/s | 25 kB 00:00 2026-02-20T03:09:58.259 INFO:teuthology.orchestra.run.trial028.stdout:(122/172): liboath-2.6.12-1.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2026-02-20T03:09:58.284 INFO:teuthology.orchestra.run.trial028.stdout:(123/172): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2026-02-20T03:09:58.310 INFO:teuthology.orchestra.run.trial028.stdout:(124/172): luarocks-3.9.2-5.el9.noarch.rpm 5.8 MB/s | 151 kB 00:00 2026-02-20T03:09:58.340 INFO:teuthology.orchestra.run.trial028.stdout:(125/172): parquet-libs-9.0.0-15.el9.x86_64.rpm 27 MB/s | 838 kB 00:00 2026-02-20T03:09:58.369 INFO:teuthology.orchestra.run.trial028.stdout:(126/172): python3-asyncssh-2.13.2-5.el9.noarch 19 MB/s | 548 kB 00:00 2026-02-20T03:09:58.393 INFO:teuthology.orchestra.run.trial028.stdout:(127/172): python3-autocommand-2.2.2-8.el9.noar 1.2 MB/s | 29 kB 00:00 2026-02-20T03:09:58.419 INFO:teuthology.orchestra.run.trial028.stdout:(128/172): python3-backports-tarfile-1.2.0-1.el 2.4 MB/s | 60 kB 00:00 2026-02-20T03:09:58.444 INFO:teuthology.orchestra.run.trial028.stdout:(129/172): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2026-02-20T03:09:58.469 INFO:teuthology.orchestra.run.trial028.stdout:(130/172): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2026-02-20T03:09:58.493 INFO:teuthology.orchestra.run.trial028.stdout:(131/172): python3-certifi-2023.05.07-4.el9.noa 572 kB/s | 14 kB 00:00 2026-02-20T03:09:58.519 INFO:teuthology.orchestra.run.trial028.stdout:(132/172): python3-cheroot-10.0.1-4.el9.noarch. 6.5 MB/s | 173 kB 00:00 2026-02-20T03:09:58.547 INFO:teuthology.orchestra.run.trial028.stdout:(133/172): python3-cherrypy-18.6.1-2.el9.noarch 13 MB/s | 358 kB 00:00 2026-02-20T03:09:58.573 INFO:teuthology.orchestra.run.trial028.stdout:(134/172): python3-cmd2-2.4.2-2.el9.noarch.rpm 11 MB/s | 303 kB 00:00 2026-02-20T03:09:58.600 INFO:teuthology.orchestra.run.trial028.stdout:(135/172): python3-google-auth-2.45.0-1.el9.noa 9.4 MB/s | 254 kB 00:00 2026-02-20T03:09:58.637 INFO:teuthology.orchestra.run.trial028.stdout:(136/172): python3-grpcio-1.46.7-10.el9.x86_64. 56 MB/s | 2.0 MB 00:00 2026-02-20T03:09:58.662 INFO:teuthology.orchestra.run.trial028.stdout:(137/172): python3-grpcio-tools-1.46.7-10.el9.x 5.5 MB/s | 144 kB 00:00 2026-02-20T03:09:58.688 INFO:teuthology.orchestra.run.trial028.stdout:(138/172): python3-influxdb-5.3.1-1.el9.noarch. 5.3 MB/s | 139 kB 00:00 2026-02-20T03:09:58.713 INFO:teuthology.orchestra.run.trial028.stdout:(139/172): python3-isodate-0.6.1-3.el9.noarch.r 2.2 MB/s | 56 kB 00:00 2026-02-20T03:09:58.738 INFO:teuthology.orchestra.run.trial028.stdout:(140/172): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2026-02-20T03:09:58.763 INFO:teuthology.orchestra.run.trial028.stdout:(141/172): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2026-02-20T03:09:58.788 INFO:teuthology.orchestra.run.trial028.stdout:(142/172): python3-jaraco-collections-3.0.0-8.e 938 kB/s | 23 kB 00:00 2026-02-20T03:09:58.812 INFO:teuthology.orchestra.run.trial028.stdout:(143/172): python3-jaraco-context-6.0.1-3.el9.n 797 kB/s | 20 kB 00:00 2026-02-20T03:09:58.837 INFO:teuthology.orchestra.run.trial028.stdout:(144/172): python3-jaraco-functools-3.5.0-2.el9 787 kB/s | 19 kB 00:00 2026-02-20T03:09:58.863 INFO:teuthology.orchestra.run.trial028.stdout:(145/172): python3-jaraco-text-4.0.0-2.el9.noar 1.0 MB/s | 26 kB 00:00 2026-02-20T03:09:58.893 INFO:teuthology.orchestra.run.trial028.stdout:(146/172): python3-kubernetes-26.1.0-3.el9.noar 33 MB/s | 1.0 MB 00:00 2026-02-20T03:09:58.919 INFO:teuthology.orchestra.run.trial028.stdout:(147/172): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2026-02-20T03:09:58.944 INFO:teuthology.orchestra.run.trial028.stdout:(148/172): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2026-02-20T03:09:58.969 INFO:teuthology.orchestra.run.trial028.stdout:(149/172): python3-msgpack-1.0.3-2.el9.x86_64.r 3.3 MB/s | 86 kB 00:00 2026-02-20T03:09:58.994 INFO:teuthology.orchestra.run.trial028.stdout:(150/172): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2026-02-20T03:09:59.021 INFO:teuthology.orchestra.run.trial028.stdout:(151/172): python3-pecan-1.4.2-3.el9.noarch.rpm 10 MB/s | 272 kB 00:00 2026-02-20T03:09:59.046 INFO:teuthology.orchestra.run.trial028.stdout:(152/172): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2026-02-20T03:09:59.072 INFO:teuthology.orchestra.run.trial028.stdout:(153/172): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2026-02-20T03:09:59.097 INFO:teuthology.orchestra.run.trial028.stdout:(154/172): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2026-02-20T03:09:59.122 INFO:teuthology.orchestra.run.trial028.stdout:(155/172): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2026-02-20T03:09:59.148 INFO:teuthology.orchestra.run.trial028.stdout:(156/172): python3-routes-2.5.1-5.el9.noarch.rp 7.1 MB/s | 188 kB 00:00 2026-02-20T03:09:59.174 INFO:teuthology.orchestra.run.trial028.stdout:(157/172): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2026-02-20T03:09:59.200 INFO:teuthology.orchestra.run.trial028.stdout:(158/172): python3-saml-1.16.0-1.el9.noarch.rpm 4.8 MB/s | 125 kB 00:00 2026-02-20T03:09:59.200 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 157/174 2026-02-20T03:09:59.209 INFO:teuthology.orchestra.run.trial177.stdout: Installing : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 158/174 2026-02-20T03:09:59.218 INFO:teuthology.orchestra.run.trial177.stdout: Installing : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 159/174 2026-02-20T03:09:59.225 INFO:teuthology.orchestra.run.trial028.stdout:(159/172): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2026-02-20T03:09:59.232 INFO:teuthology.orchestra.run.trial177.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 160/174 2026-02-20T03:09:59.235 INFO:teuthology.orchestra.run.trial177.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 161/174 2026-02-20T03:09:59.250 INFO:teuthology.orchestra.run.trial028.stdout:(160/172): python3-typing-extensions-4.15.0-1.e 3.4 MB/s | 86 kB 00:00 2026-02-20T03:09:59.277 INFO:teuthology.orchestra.run.trial028.stdout:(161/172): python3-webob-1.8.8-2.el9.noarch.rpm 8.7 MB/s | 230 kB 00:00 2026-02-20T03:09:59.294 INFO:teuthology.orchestra.run.trial028.stdout:(162/172): python3-numpy-1.23.5-2.el9.x86_64.rp 889 kB/s | 6.1 MB 00:07 2026-02-20T03:09:59.302 INFO:teuthology.orchestra.run.trial028.stdout:(163/172): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2026-02-20T03:09:59.311 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cephfs-shell-2:19.2.3-700.gf4ef35d9.el9.x86_64 162/174 2026-02-20T03:09:59.317 INFO:teuthology.orchestra.run.trial177.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 163/174 2026-02-20T03:09:59.321 INFO:teuthology.orchestra.run.trial028.stdout:(164/172): python3-werkzeug-2.0.3-3.el9.1.noarc 15 MB/s | 427 kB 00:00 2026-02-20T03:09:59.326 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_6 164/174 2026-02-20T03:09:59.327 INFO:teuthology.orchestra.run.trial028.stdout:(165/172): python3-xmlsec-1.3.13-1.el9.x86_64.r 1.9 MB/s | 48 kB 00:00 2026-02-20T03:09:59.328 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libtool-2.4.6-46.el9.x86_64 165/174 2026-02-20T03:09:59.346 INFO:teuthology.orchestra.run.trial028.stdout:(166/172): python3-xmltodict-0.12.0-15.el9.noar 896 kB/s | 22 kB 00:00 2026-02-20T03:09:59.352 INFO:teuthology.orchestra.run.trial028.stdout:(167/172): python3-zc-lockfile-2.0-10.el9.noarc 810 kB/s | 20 kB 00:00 2026-02-20T03:09:59.372 INFO:teuthology.orchestra.run.trial028.stdout:(168/172): re2-20211101-20.el9.x86_64.rpm 7.3 MB/s | 191 kB 00:00 2026-02-20T03:09:59.386 INFO:teuthology.orchestra.run.trial028.stdout:(169/172): thrift-0.15.0-4.el9.x86_64.rpm 47 MB/s | 1.6 MB 00:00 2026-02-20T03:09:59.456 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 166/174 2026-02-20T03:09:59.459 INFO:teuthology.orchestra.run.trial177.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 166/174 2026-02-20T03:09:59.478 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 166/174 2026-02-20T03:09:59.532 INFO:teuthology.orchestra.run.trial177.stdout: Installing : cephfs-top-2:19.2.3-700.gf4ef35d9.el9.noarch 167/174 2026-02-20T03:09:59.537 INFO:teuthology.orchestra.run.trial028.stdout:(170/172): librbd1-19.2.3-700.gf4ef35d9.el9.x86 21 MB/s | 3.2 MB 00:00 2026-02-20T03:09:59.545 INFO:teuthology.orchestra.run.trial028.stdout:(171/172): librados2-19.2.3-700.gf4ef35d9.el9.x 20 MB/s | 3.4 MB 00:00 2026-02-20T03:09:59.984 INFO:teuthology.orchestra.run.trial177.stdout: Installing : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 168/174 2026-02-20T03:10:00.000 INFO:teuthology.orchestra.run.trial177.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 169/174 2026-02-20T03:10:00.010 INFO:teuthology.orchestra.run.trial177.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 170/174 2026-02-20T03:10:00.038 INFO:teuthology.orchestra.run.trial177.stdout: Installing : flex-2.6.4-9.el9.x86_64 171/174 2026-02-20T03:10:00.042 INFO:teuthology.orchestra.run.trial177.stdout: Installing : bison-3.7.4-5.el9.x86_64 172/174 2026-02-20T03:10:00.042 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 173/174 2026-02-20T03:10:00.055 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 173/174 2026-02-20T03:10:00.056 INFO:teuthology.orchestra.run.trial177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 174/174 2026-02-20T03:10:00.477 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 132/174 2026-02-20T03:10:00.477 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /sys 2026-02-20T03:10:00.477 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /proc 2026-02-20T03:10:00.477 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /mnt 2026-02-20T03:10:00.477 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /var/tmp 2026-02-20T03:10:00.478 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /home 2026-02-20T03:10:00.478 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /root 2026-02-20T03:10:00.478 INFO:teuthology.orchestra.run.trial126.stdout:skipping the directory /tmp 2026-02-20T03:10:00.478 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:00.587 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 133/174 2026-02-20T03:10:00.610 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 133/174 2026-02-20T03:10:00.611 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:00.611 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T03:10:00.611 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T03:10:00.611 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T03:10:00.611 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:00.821 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 134/174 2026-02-20T03:10:00.843 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 134/174 2026-02-20T03:10:00.843 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:00.844 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T03:10:00.844 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T03:10:00.844 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T03:10:00.844 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:00.851 INFO:teuthology.orchestra.run.trial126.stdout: Installing : mailcap-2.1.49-5.el9.noarch 135/174 2026-02-20T03:10:00.852 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 136/174 2026-02-20T03:10:00.869 INFO:teuthology.orchestra.run.trial177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 174/174 2026-02-20T03:10:00.869 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/174 2026-02-20T03:10:00.869 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 2/174 2026-02-20T03:10:00.869 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 3/174 2026-02-20T03:10:00.869 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/174 2026-02-20T03:10:00.869 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35 5/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 8/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 9/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 10/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 11/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 12/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 13/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cephfs-shell-2:19.2.3-700.gf4ef35d9.el9.x86_64 14/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_6 15/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 16/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 17/174 2026-02-20T03:10:00.870 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 18/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_ 19/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 20/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9 21/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x 22/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 23/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 24/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 25/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 26/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 27/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 28/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 29/174 2026-02-20T03:10:00.871 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.e 30/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noar 31/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.no 32/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef 33/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.no 34/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9 35/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 36/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el 37/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 38/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 39/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cephfs-top-2:19.2.3-700.gf4ef35d9.el9.noarch 40/174 2026-02-20T03:10:00.872 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 41/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 42/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 43/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 44/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 45/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 46/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 47/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 48/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 49/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 50/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 51/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 52/174 2026-02-20T03:10:00.873 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 53/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 54/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 55/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : unzip-6.0-59.el9.x86_64 56/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : zip-3.0-35.el9.x86_64 57/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : automake-1.16.2-8.el9.noarch 58/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : bison-3.7.4-5.el9.x86_64 59/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 60/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 61/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flex-2.6.4-9.el9.x86_64 62/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 63/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 64/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/174 2026-02-20T03:10:00.874 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 66/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 67/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 68/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 69/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 70/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 71/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 72/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 73/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 74/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 75/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 76/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 77/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 78/174 2026-02-20T03:10:00.875 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 79/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 80/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 81/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 82/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 83/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : postgresql-13.23-1.el9.x86_64 84/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 85/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 86/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 87/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 88/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 89/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 90/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 91/174 2026-02-20T03:10:00.876 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 92/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 93/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 94/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 95/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 96/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 97/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 98/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 99/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 100/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 101/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 102/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 103/174 2026-02-20T03:10:00.877 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 104/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 105/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 106/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 107/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 108/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 109/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 110/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 111/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 112/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 113/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 114/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/174 2026-02-20T03:10:00.878 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/174 2026-02-20T03:10:00.879 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 140/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 141/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 142/174 2026-02-20T03:10:00.880 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 143/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 144/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 145/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 146/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 147/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 148/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 149/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 150/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 151/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 152/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 153/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 154/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 155/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 156/174 2026-02-20T03:10:00.881 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 157/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 158/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 159/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 160/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 161/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 162/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 163/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 164/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 165/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 166/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 167/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : re2-1:20211101-20.el9.x86_64 169/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 170/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 171/174 2026-02-20T03:10:00.882 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/174 2026-02-20T03:10:00.883 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 173/174 2026-02-20T03:10:00.883 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 137/174 2026-02-20T03:10:00.883 INFO:teuthology.orchestra.run.trial126.stdout:Creating group 'qat' with GID 992. 2026-02-20T03:10:00.883 INFO:teuthology.orchestra.run.trial126.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T03:10:00.884 INFO:teuthology.orchestra.run.trial126.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T03:10:00.884 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:00.884 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 137/174 2026-02-20T03:10:00.903 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 137/174 2026-02-20T03:10:00.903 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T03:10:00.903 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:00.937 INFO:teuthology.orchestra.run.trial126.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 138/174 2026-02-20T03:10:00.940 INFO:teuthology.orchestra.run.trial177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/174 2026-02-20T03:10:00.940 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout:Upgraded: 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout:Installed: 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: automake-1.16.2-8.el9.noarch 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: bison-3.7.4-5.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.941 INFO:teuthology.orchestra.run.trial177.stdout: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-shell-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: cephfs-top-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: flex-2.6.4-9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.942 INFO:teuthology.orchestra.run.trial177.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-13.23-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T03:10:00.943 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T03:10:00.944 INFO:teuthology.orchestra.run.trial177.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T03:10:00.945 INFO:teuthology.orchestra.run.trial177.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: zip-3.0-35.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:10:00.946 INFO:teuthology.orchestra.run.trial177.stdout:Complete! 2026-02-20T03:10:01.000 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 139/174 2026-02-20T03:10:01.002 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 140/174 2026-02-20T03:10:01.017 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 140/174 2026-02-20T03:10:01.017 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:01.017 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T03:10:01.017 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:01.031 DEBUG:teuthology.parallel:result is None 2026-02-20T03:10:01.725 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 141/174 2026-02-20T03:10:01.750 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 141/174 2026-02-20T03:10:01.750 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:01.750 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T03:10:01.751 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T03:10:01.751 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T03:10:01.751 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:01.808 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 142/174 2026-02-20T03:10:01.810 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 142/174 2026-02-20T03:10:01.815 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el 143/174 2026-02-20T03:10:01.834 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.e 144/174 2026-02-20T03:10:01.835 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noar 145/174 2026-02-20T03:10:02.327 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noar 145/174 2026-02-20T03:10:02.330 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.no 146/174 2026-02-20T03:10:02.784 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.no 146/174 2026-02-20T03:10:02.785 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef 147/174 2026-02-20T03:10:02.797 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef 147/174 2026-02-20T03:10:02.798 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.no 148/174 2026-02-20T03:10:02.854 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.no 148/174 2026-02-20T03:10:02.903 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9 149/174 2026-02-20T03:10:02.904 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 150/174 2026-02-20T03:10:02.926 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 150/174 2026-02-20T03:10:02.926 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:02.926 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T03:10:02.926 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T03:10:02.926 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T03:10:02.926 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:02.938 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 151/174 2026-02-20T03:10:02.949 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 151/174 2026-02-20T03:10:03.406 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 152/174 2026-02-20T03:10:03.408 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 153/174 2026-02-20T03:10:03.429 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 153/174 2026-02-20T03:10:03.429 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:03.429 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T03:10:03.429 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T03:10:03.429 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T03:10:03.429 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:03.437 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35 154/174 2026-02-20T03:10:03.457 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35 154/174 2026-02-20T03:10:03.458 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:03.458 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T03:10:03.458 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:03.471 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 155/174 2026-02-20T03:10:03.491 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 155/174 2026-02-20T03:10:03.492 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:03.492 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-20T03:10:03.492 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T03:10:03.492 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T03:10:03.492 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:03.632 INFO:teuthology.orchestra.run.trial126.stdout: Installing : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 156/174 2026-02-20T03:10:03.653 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 156/174 2026-02-20T03:10:03.653 INFO:teuthology.orchestra.run.trial126.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:03.653 INFO:teuthology.orchestra.run.trial126.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T03:10:03.653 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T03:10:03.653 INFO:teuthology.orchestra.run.trial126.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T03:10:03.653 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:05.932 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 157/174 2026-02-20T03:10:05.941 INFO:teuthology.orchestra.run.trial126.stdout: Installing : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 158/174 2026-02-20T03:10:05.950 INFO:teuthology.orchestra.run.trial126.stdout: Installing : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 159/174 2026-02-20T03:10:05.964 INFO:teuthology.orchestra.run.trial126.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 160/174 2026-02-20T03:10:05.967 INFO:teuthology.orchestra.run.trial126.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 161/174 2026-02-20T03:10:06.042 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cephfs-shell-2:19.2.3-700.gf4ef35d9.el9.x86_64 162/174 2026-02-20T03:10:06.048 INFO:teuthology.orchestra.run.trial126.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 163/174 2026-02-20T03:10:06.058 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_6 164/174 2026-02-20T03:10:06.059 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libtool-2.4.6-46.el9.x86_64 165/174 2026-02-20T03:10:06.181 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 166/174 2026-02-20T03:10:06.185 INFO:teuthology.orchestra.run.trial126.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 166/174 2026-02-20T03:10:06.202 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 166/174 2026-02-20T03:10:06.253 INFO:teuthology.orchestra.run.trial126.stdout: Installing : cephfs-top-2:19.2.3-700.gf4ef35d9.el9.noarch 167/174 2026-02-20T03:10:06.706 INFO:teuthology.orchestra.run.trial126.stdout: Installing : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 168/174 2026-02-20T03:10:06.722 INFO:teuthology.orchestra.run.trial126.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 169/174 2026-02-20T03:10:06.732 INFO:teuthology.orchestra.run.trial126.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 170/174 2026-02-20T03:10:06.760 INFO:teuthology.orchestra.run.trial126.stdout: Installing : flex-2.6.4-9.el9.x86_64 171/174 2026-02-20T03:10:06.764 INFO:teuthology.orchestra.run.trial126.stdout: Installing : bison-3.7.4-5.el9.x86_64 172/174 2026-02-20T03:10:06.764 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 173/174 2026-02-20T03:10:06.778 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 173/174 2026-02-20T03:10:06.778 INFO:teuthology.orchestra.run.trial126.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 174/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 174/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 2/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 3/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35 5/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 8/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 9/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 10/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 11/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 12/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 13/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cephfs-shell-2:19.2.3-700.gf4ef35d9.el9.x86_64 14/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_6 15/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 16/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 17/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 18/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_ 19/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 20/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9 21/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x 22/174 2026-02-20T03:10:07.625 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 23/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 24/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 25/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 26/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 27/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 28/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 29/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.e 30/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noar 31/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.no 32/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef 33/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.no 34/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9 35/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 36/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el 37/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 38/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 39/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cephfs-top-2:19.2.3-700.gf4ef35d9.el9.noarch 40/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 41/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 42/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 43/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 44/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 45/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 46/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 47/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 48/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 49/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 50/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-ply-3.11-14.el9.noarch 51/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 52/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 53/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 54/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 55/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : unzip-6.0-59.el9.x86_64 56/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : zip-3.0-35.el9.x86_64 57/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : automake-1.16.2-8.el9.noarch 58/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : bison-3.7.4-5.el9.x86_64 59/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 60/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 61/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : flex-2.6.4-9.el9.x86_64 62/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 63/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 64/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/174 2026-02-20T03:10:07.626 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 66/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 67/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 68/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 69/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 70/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 71/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 72/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 73/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 74/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 75/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 76/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : lua-5.4.4-4.el9.x86_64 77/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 78/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 79/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 80/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 81/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 82/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 83/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : postgresql-13.23-1.el9.x86_64 84/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 85/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 86/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 87/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 88/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 89/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 90/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 91/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 92/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 93/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 94/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 95/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 96/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 97/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 98/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 99/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 100/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 101/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 102/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 103/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 104/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 105/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 106/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 107/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 108/174 2026-02-20T03:10:07.627 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 109/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 110/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 111/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 112/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 113/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 114/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 140/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 141/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 142/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 143/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 144/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 145/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 146/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 147/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 148/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 149/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 150/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 151/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 152/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 153/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 154/174 2026-02-20T03:10:07.628 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 155/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 156/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 157/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 158/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 159/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 160/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 161/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 162/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 163/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 164/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 165/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 166/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 167/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : re2-1:20211101-20.el9.x86_64 169/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 170/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 171/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/174 2026-02-20T03:10:07.629 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 173/174 2026-02-20T03:10:07.705 INFO:teuthology.orchestra.run.trial126.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/174 2026-02-20T03:10:07.705 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:07.705 INFO:teuthology.orchestra.run.trial126.stdout:Upgraded: 2026-02-20T03:10:07.705 INFO:teuthology.orchestra.run.trial126.stdout: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.705 INFO:teuthology.orchestra.run.trial126.stdout: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.706 INFO:teuthology.orchestra.run.trial126.stdout:Installed: 2026-02-20T03:10:07.706 INFO:teuthology.orchestra.run.trial126.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T03:10:07.706 INFO:teuthology.orchestra.run.trial126.stdout: automake-1.16.2-8.el9.noarch 2026-02-20T03:10:07.706 INFO:teuthology.orchestra.run.trial126.stdout: bison-3.7.4-5.el9.x86_64 2026-02-20T03:10:07.706 INFO:teuthology.orchestra.run.trial126.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T03:10:07.706 INFO:teuthology.orchestra.run.trial126.stdout: ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.707 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.708 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-shell-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: cephfs-top-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: flex-2.6.4-9.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-20T03:10:07.709 INFO:teuthology.orchestra.run.trial126.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T03:10:07.710 INFO:teuthology.orchestra.run.trial126.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-20T03:10:07.711 INFO:teuthology.orchestra.run.trial126.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-13.23-1.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T03:10:07.712 INFO:teuthology.orchestra.run.trial126.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T03:10:07.713 INFO:teuthology.orchestra.run.trial126.stdout: python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: zip-3.0-35.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:10:07.714 INFO:teuthology.orchestra.run.trial126.stdout:Complete! 2026-02-20T03:10:07.795 DEBUG:teuthology.parallel:result is None 2026-02-20T03:10:17.476 INFO:teuthology.orchestra.run.trial028.stdout:(172/172): python3-scipy-1.9.3-2.el9.x86_64.rpm 900 kB/s | 19 MB 00:21 2026-02-20T03:10:17.481 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T03:10:17.481 INFO:teuthology.orchestra.run.trial028.stdout:Total 5.5 MB/s | 230 MB 00:41 2026-02-20T03:10:18.852 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T03:10:18.933 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T03:10:18.933 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T03:10:20.006 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T03:10:20.006 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T03:10:21.138 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T03:10:21.148 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/174 2026-02-20T03:10:21.168 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/174 2026-02-20T03:10:21.187 INFO:teuthology.orchestra.run.trial028.stdout: Installing : thrift-0.15.0-4.el9.x86_64 3/174 2026-02-20T03:10:21.362 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/174 2026-02-20T03:10:21.366 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/174 2026-02-20T03:10:21.435 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 5/174 2026-02-20T03:10:21.438 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/174 2026-02-20T03:10:21.477 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/174 2026-02-20T03:10:21.490 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/174 2026-02-20T03:10:21.495 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/174 2026-02-20T03:10:21.498 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/174 2026-02-20T03:10:21.501 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 10/174 2026-02-20T03:10:21.509 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 11/174 2026-02-20T03:10:21.604 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 12/174 2026-02-20T03:10:21.619 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-13.23-1.el9.x86_64 13/174 2026-02-20T03:10:21.620 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 14/174 2026-02-20T03:10:21.666 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 14/174 2026-02-20T03:10:21.668 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_ 15/174 2026-02-20T03:10:21.739 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_ 15/174 2026-02-20T03:10:21.750 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 16/174 2026-02-20T03:10:21.756 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 17/174 2026-02-20T03:10:21.797 INFO:teuthology.orchestra.run.trial028.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/174 2026-02-20T03:10:21.843 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 19/174 2026-02-20T03:10:21.851 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/174 2026-02-20T03:10:21.884 INFO:teuthology.orchestra.run.trial028.stdout: Installing : liboath-2.6.12-1.el9.x86_64 21/174 2026-02-20T03:10:21.895 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/174 2026-02-20T03:10:21.907 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/174 2026-02-20T03:10:21.913 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 24/174 2026-02-20T03:10:21.922 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 25/174 2026-02-20T03:10:21.926 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/174 2026-02-20T03:10:21.934 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 27/174 2026-02-20T03:10:21.970 INFO:teuthology.orchestra.run.trial028.stdout: Installing : unzip-6.0-59.el9.x86_64 28/174 2026-02-20T03:10:21.990 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 29/174 2026-02-20T03:10:21.996 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 30/174 2026-02-20T03:10:22.004 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 31/174 2026-02-20T03:10:22.008 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 32/174 2026-02-20T03:10:22.045 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 33/174 2026-02-20T03:10:22.051 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x 34/174 2026-02-20T03:10:22.063 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9 35/174 2026-02-20T03:10:22.080 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 36/174 2026-02-20T03:10:22.091 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 37/174 2026-02-20T03:10:22.129 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zip-3.0-35.el9.x86_64 38/174 2026-02-20T03:10:22.135 INFO:teuthology.orchestra.run.trial028.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/174 2026-02-20T03:10:22.141 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 40/174 2026-02-20T03:10:22.146 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 41/174 2026-02-20T03:10:22.186 INFO:teuthology.orchestra.run.trial028.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 42/174 2026-02-20T03:10:22.200 INFO:teuthology.orchestra.run.trial028.stdout: Installing : automake-1.16.2-8.el9.noarch 43/174 2026-02-20T03:10:22.239 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/174 2026-02-20T03:10:22.313 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/174 2026-02-20T03:10:22.333 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/174 2026-02-20T03:10:22.337 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/174 2026-02-20T03:10:22.345 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 48/174 2026-02-20T03:10:22.354 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 49/174 2026-02-20T03:10:22.365 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/174 2026-02-20T03:10:22.371 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 51/174 2026-02-20T03:10:22.379 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 52/174 2026-02-20T03:10:22.384 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/174 2026-02-20T03:10:22.406 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 54/174 2026-02-20T03:10:22.439 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 55/174 2026-02-20T03:10:22.448 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 56/174 2026-02-20T03:10:22.456 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 57/174 2026-02-20T03:10:22.474 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 58/174 2026-02-20T03:10:22.482 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 59/174 2026-02-20T03:10:22.497 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 60/174 2026-02-20T03:10:22.508 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 61/174 2026-02-20T03:10:22.538 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 62/174 2026-02-20T03:10:22.553 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 63/174 2026-02-20T03:10:22.640 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 64/174 2026-02-20T03:10:22.661 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 65/174 2026-02-20T03:10:22.685 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 66/174 2026-02-20T03:10:22.693 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 67/174 2026-02-20T03:10:22.706 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 68/174 2026-02-20T03:10:22.765 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 69/174 2026-02-20T03:10:23.227 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 70/174 2026-02-20T03:10:23.245 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 71/174 2026-02-20T03:10:23.253 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 72/174 2026-02-20T03:10:23.263 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 73/174 2026-02-20T03:10:23.269 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 74/174 2026-02-20T03:10:23.279 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/174 2026-02-20T03:10:23.284 INFO:teuthology.orchestra.run.trial028.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 76/174 2026-02-20T03:10:23.287 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 77/174 2026-02-20T03:10:23.334 INFO:teuthology.orchestra.run.trial028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/174 2026-02-20T03:10:23.401 INFO:teuthology.orchestra.run.trial028.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 79/174 2026-02-20T03:10:23.410 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/174 2026-02-20T03:10:23.416 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 81/174 2026-02-20T03:10:23.429 INFO:teuthology.orchestra.run.trial028.stdout: Installing : uuid-1.6.2-55.el9.x86_64 82/174 2026-02-20T03:10:23.439 INFO:teuthology.orchestra.run.trial028.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 83/174 2026-02-20T03:10:23.481 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/174 2026-02-20T03:10:23.492 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 85/174 2026-02-20T03:10:23.499 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 86/174 2026-02-20T03:10:23.509 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 87/174 2026-02-20T03:10:23.516 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 88/174 2026-02-20T03:10:23.527 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 89/174 2026-02-20T03:10:23.534 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 90/174 2026-02-20T03:10:23.575 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 91/174 2026-02-20T03:10:23.592 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 92/174 2026-02-20T03:10:23.644 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 93/174 2026-02-20T03:10:23.663 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 94/174 2026-02-20T03:10:23.965 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 95/174 2026-02-20T03:10:24.004 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 96/174 2026-02-20T03:10:24.011 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 97/174 2026-02-20T03:10:24.085 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-0.3.29-1.el9.x86_64 98/174 2026-02-20T03:10:24.089 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 99/174 2026-02-20T03:10:24.116 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 100/174 2026-02-20T03:10:24.580 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 101/174 2026-02-20T03:10:24.694 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 102/174 2026-02-20T03:10:25.654 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 103/174 2026-02-20T03:10:25.687 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 104/174 2026-02-20T03:10:25.694 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 105/174 2026-02-20T03:10:25.699 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 106/174 2026-02-20T03:10:25.851 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 107/174 2026-02-20T03:10:25.854 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 108/174 2026-02-20T03:10:25.900 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 108/174 2026-02-20T03:10:25.904 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 109/174 2026-02-20T03:10:25.913 INFO:teuthology.orchestra.run.trial028.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/174 2026-02-20T03:10:26.156 INFO:teuthology.orchestra.run.trial028.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/174 2026-02-20T03:10:26.159 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 112/174 2026-02-20T03:10:26.192 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 112/174 2026-02-20T03:10:26.195 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 113/174 2026-02-20T03:10:27.271 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 114/174 2026-02-20T03:10:27.278 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 114/174 2026-02-20T03:10:27.314 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 114/174 2026-02-20T03:10:27.330 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 115/174 2026-02-20T03:10:27.341 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 116/174 2026-02-20T03:10:27.362 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ply-3.11-14.el9.noarch 117/174 2026-02-20T03:10:27.386 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 118/174 2026-02-20T03:10:27.502 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 119/174 2026-02-20T03:10:27.520 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 120/174 2026-02-20T03:10:27.556 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/174 2026-02-20T03:10:27.601 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 122/174 2026-02-20T03:10:27.675 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 123/174 2026-02-20T03:10:27.686 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 124/174 2026-02-20T03:10:27.693 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 125/174 2026-02-20T03:10:27.700 INFO:teuthology.orchestra.run.trial028.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 126/174 2026-02-20T03:10:27.705 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 127/174 2026-02-20T03:10:27.707 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 128/174 2026-02-20T03:10:27.744 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 128/174 2026-02-20T03:10:27.908 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 129/174 2026-02-20T03:10:27.913 INFO:teuthology.orchestra.run.trial028.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 130/174 2026-02-20T03:10:28.477 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 130/174 2026-02-20T03:10:28.477 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T03:10:28.477 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:28.799 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 131/174 2026-02-20T03:10:28.877 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 131/174 2026-02-20T03:10:28.877 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T03:10:28.877 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T03:10:28.877 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:28.884 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 132/174 2026-02-20T03:10:34.951 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 132/174 2026-02-20T03:10:34.951 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /sys 2026-02-20T03:10:34.951 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /proc 2026-02-20T03:10:34.951 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /mnt 2026-02-20T03:10:34.951 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /var/tmp 2026-02-20T03:10:34.952 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /home 2026-02-20T03:10:34.952 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /root 2026-02-20T03:10:34.952 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /tmp 2026-02-20T03:10:34.952 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:35.070 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 133/174 2026-02-20T03:10:35.119 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 133/174 2026-02-20T03:10:35.119 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:35.119 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T03:10:35.119 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T03:10:35.119 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T03:10:35.120 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:35.344 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 134/174 2026-02-20T03:10:35.390 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 134/174 2026-02-20T03:10:35.390 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:35.390 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T03:10:35.390 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T03:10:35.391 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T03:10:35.391 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:35.403 INFO:teuthology.orchestra.run.trial028.stdout: Installing : mailcap-2.1.49-5.el9.noarch 135/174 2026-02-20T03:10:35.406 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 136/174 2026-02-20T03:10:35.444 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 137/174 2026-02-20T03:10:35.444 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'qat' with GID 992. 2026-02-20T03:10:35.444 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T03:10:35.444 INFO:teuthology.orchestra.run.trial028.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T03:10:35.445 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:35.459 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 137/174 2026-02-20T03:10:35.510 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 137/174 2026-02-20T03:10:35.511 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T03:10:35.511 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:35.562 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 138/174 2026-02-20T03:10:35.651 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 139/174 2026-02-20T03:10:35.657 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 140/174 2026-02-20T03:10:35.688 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 140/174 2026-02-20T03:10:35.688 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:35.689 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T03:10:35.689 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:36.420 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 141/174 2026-02-20T03:10:36.473 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 141/174 2026-02-20T03:10:36.473 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:36.473 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T03:10:36.474 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T03:10:36.474 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T03:10:36.474 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:36.588 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 142/174 2026-02-20T03:10:36.591 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 142/174 2026-02-20T03:10:36.598 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el 143/174 2026-02-20T03:10:36.626 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.e 144/174 2026-02-20T03:10:36.629 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noar 145/174 2026-02-20T03:10:37.205 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noar 145/174 2026-02-20T03:10:37.213 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.no 146/174 2026-02-20T03:10:37.714 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.no 146/174 2026-02-20T03:10:37.716 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef 147/174 2026-02-20T03:10:37.741 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef 147/174 2026-02-20T03:10:37.742 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.no 148/174 2026-02-20T03:10:37.828 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.no 148/174 2026-02-20T03:10:37.883 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9 149/174 2026-02-20T03:10:37.886 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 150/174 2026-02-20T03:10:37.934 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 150/174 2026-02-20T03:10:37.934 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:37.934 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T03:10:37.934 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T03:10:37.935 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T03:10:37.935 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:37.952 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 151/174 2026-02-20T03:10:37.973 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 151/174 2026-02-20T03:10:38.447 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 152/174 2026-02-20T03:10:38.451 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 153/174 2026-02-20T03:10:38.500 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 153/174 2026-02-20T03:10:38.500 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:38.500 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T03:10:38.500 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T03:10:38.500 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T03:10:38.501 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:38.513 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35 154/174 2026-02-20T03:10:38.558 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35 154/174 2026-02-20T03:10:38.558 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:38.558 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T03:10:38.558 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:38.574 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 155/174 2026-02-20T03:10:38.622 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 155/174 2026-02-20T03:10:38.623 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:38.623 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-20T03:10:38.623 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T03:10:38.623 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-20T03:10:38.623 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:38.775 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 156/174 2026-02-20T03:10:38.822 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 156/174 2026-02-20T03:10:38.822 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T03:10:38.823 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T03:10:38.823 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T03:10:38.823 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T03:10:38.823 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:41.178 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 157/174 2026-02-20T03:10:41.189 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 158/174 2026-02-20T03:10:41.203 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 159/174 2026-02-20T03:10:41.224 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 160/174 2026-02-20T03:10:41.230 INFO:teuthology.orchestra.run.trial028.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 161/174 2026-02-20T03:10:41.339 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-shell-2:19.2.3-700.gf4ef35d9.el9.x86_64 162/174 2026-02-20T03:10:41.352 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 163/174 2026-02-20T03:10:41.367 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_6 164/174 2026-02-20T03:10:41.370 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libtool-2.4.6-46.el9.x86_64 165/174 2026-02-20T03:10:41.580 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 166/174 2026-02-20T03:10:41.590 INFO:teuthology.orchestra.run.trial028.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 166/174 2026-02-20T03:10:41.627 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 166/174 2026-02-20T03:10:41.682 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephfs-top-2:19.2.3-700.gf4ef35d9.el9.noarch 167/174 2026-02-20T03:10:42.553 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 168/174 2026-02-20T03:10:42.590 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 169/174 2026-02-20T03:10:42.606 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 170/174 2026-02-20T03:10:42.649 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flex-2.6.4-9.el9.x86_64 171/174 2026-02-20T03:10:42.657 INFO:teuthology.orchestra.run.trial028.stdout: Installing : bison-3.7.4-5.el9.x86_64 172/174 2026-02-20T03:10:42.657 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 173/174 2026-02-20T03:10:42.687 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 173/174 2026-02-20T03:10:42.687 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 174/174 2026-02-20T03:10:42.891 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 174/174 2026-02-20T03:10:42.892 INFO:teuthology.orchestra.run.trial028.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-20T03:10:42.892 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:43.745 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 1/174 2026-02-20T03:10:43.745 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 2/174 2026-02-20T03:10:43.745 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 3/174 2026-02-20T03:10:43.745 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 4/174 2026-02-20T03:10:43.745 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-700.gf4ef35 5/174 2026-02-20T03:10:43.745 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 6/174 2026-02-20T03:10:43.745 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 7/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 8/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 9/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 10/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 11/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 12/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 13/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-shell-2:19.2.3-700.gf4ef35d9.el9.x86_64 14/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_6 15/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 16/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 17/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 18/174 2026-02-20T03:10:43.746 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_ 19/174 2026-02-20T03:10:43.747 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 20/174 2026-02-20T03:10:43.747 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9 21/174 2026-02-20T03:10:43.747 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x 22/174 2026-02-20T03:10:43.747 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 23/174 2026-02-20T03:10:43.747 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 24/174 2026-02-20T03:10:43.747 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 25/174 2026-02-20T03:10:43.747 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 26/174 2026-02-20T03:10:43.747 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 27/174 2026-02-20T03:10:43.758 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 28/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 29/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.e 30/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noar 31/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.no 32/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef 33/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.no 34/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9 35/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 36/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el 37/174 2026-02-20T03:10:43.759 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 38/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 39/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephfs-top-2:19.2.3-700.gf4ef35d9.el9.noarch 40/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 41/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 42/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 43/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 44/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 45/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 46/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 47/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 48/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 49/174 2026-02-20T03:10:43.760 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 50/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 51/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 52/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 53/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 54/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 55/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : unzip-6.0-59.el9.x86_64 56/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zip-3.0-35.el9.x86_64 57/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : automake-1.16.2-8.el9.noarch 58/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : bison-3.7.4-5.el9.x86_64 59/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 60/174 2026-02-20T03:10:43.761 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 61/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flex-2.6.4-9.el9.x86_64 62/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 63/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 64/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 66/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 67/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 68/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 69/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 70/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 71/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 72/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 73/174 2026-02-20T03:10:43.762 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 74/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 75/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 76/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 77/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 78/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 79/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 80/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 81/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 82/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 83/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-13.23-1.el9.x86_64 84/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 85/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 86/174 2026-02-20T03:10:43.763 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 87/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 88/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 89/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 90/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 91/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 92/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 93/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 94/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 95/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 96/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 97/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 98/174 2026-02-20T03:10:43.764 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 99/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 100/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 101/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 102/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 103/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 104/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 105/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 106/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 107/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 108/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 109/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 110/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 111/174 2026-02-20T03:10:43.765 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 112/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 113/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 114/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/174 2026-02-20T03:10:43.766 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/174 2026-02-20T03:10:43.767 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 140/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 141/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 142/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 143/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 144/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 145/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 146/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 147/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 148/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 149/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 150/174 2026-02-20T03:10:43.768 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 151/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 152/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 153/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 154/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 155/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 156/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 157/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 158/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 159/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 160/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 161/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 162/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 163/174 2026-02-20T03:10:43.769 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 164/174 2026-02-20T03:10:43.770 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 165/174 2026-02-20T03:10:43.770 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 166/174 2026-02-20T03:10:43.770 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 167/174 2026-02-20T03:10:43.770 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/174 2026-02-20T03:10:43.770 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : re2-1:20211101-20.el9.x86_64 169/174 2026-02-20T03:10:43.770 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 170/174 2026-02-20T03:10:43.770 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 171/174 2026-02-20T03:10:43.770 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/174 2026-02-20T03:10:43.770 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 173/174 2026-02-20T03:10:43.859 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/174 2026-02-20T03:10:43.859 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:43.859 INFO:teuthology.orchestra.run.trial028.stdout:Upgraded: 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: librados2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: librbd1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: automake-1.16.2-8.el9.noarch 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: bison-3.7.4-5.el9.x86_64 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: ceph-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.860 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-k8sevents-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.861 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: cephadm-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-shell-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: cephfs-top-2:19.2.3-700.gf4ef35d9.el9.noarch 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-20T03:10:43.862 INFO:teuthology.orchestra.run.trial028.stdout: flex-2.6.4-9.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.863 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: librgw2-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.864 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T03:10:43.865 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-13.23-1.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T03:10:43.866 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T03:10:43.867 INFO:teuthology.orchestra.run.trial028.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T03:10:43.868 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T03:10:43.869 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T03:10:43.870 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T03:10:43.871 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T03:10:43.872 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd-2:19.2.3-700.gf4ef35d9.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: zip-3.0-35.el9.x86_64 2026-02-20T03:10:43.873 INFO:teuthology.orchestra.run.trial028.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-20T03:10:43.874 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:10:43.874 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T03:10:44.092 DEBUG:teuthology.parallel:result is None 2026-02-20T03:10:44.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:10:44.256 DEBUG:teuthology.orchestra.run.trial028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T03:10:44.301 INFO:teuthology.orchestra.run.trial028.stdout:19.2.3-700.gf4ef35d9.el9 2026-02-20T03:10:44.302 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-700.gf4ef35d9.el9 2026-02-20T03:10:44.302 INFO:teuthology.task.install:The correct ceph version 19.2.3-700.gf4ef35d9 is installed. 2026-02-20T03:10:44.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:10:44.424 DEBUG:teuthology.orchestra.run.trial126:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T03:10:44.448 INFO:teuthology.orchestra.run.trial126.stdout:19.2.3-700.gf4ef35d9.el9 2026-02-20T03:10:44.448 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-700.gf4ef35d9.el9 2026-02-20T03:10:44.448 INFO:teuthology.task.install:The correct ceph version 19.2.3-700.gf4ef35d9 is installed. 2026-02-20T03:10:44.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:10:44.599 DEBUG:teuthology.orchestra.run.trial177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T03:10:44.622 INFO:teuthology.orchestra.run.trial177.stdout:19.2.3-700.gf4ef35d9.el9 2026-02-20T03:10:44.622 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-700.gf4ef35d9.el9 2026-02-20T03:10:44.622 INFO:teuthology.task.install:The correct ceph version 19.2.3-700.gf4ef35d9 is installed. 2026-02-20T03:10:44.624 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T03:10:44.624 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:10:44.624 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T03:10:44.683 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:10:44.684 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T03:10:44.713 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:10:44.713 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T03:10:44.741 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T03:10:44.741 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:10:44.742 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T03:10:44.796 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T03:10:44.892 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:10:44.892 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T03:10:44.917 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T03:10:44.980 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:10:44.980 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T03:10:45.005 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T03:10:45.068 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T03:10:45.069 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:10:45.069 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T03:10:45.124 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T03:10:45.219 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:10:45.219 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T03:10:45.245 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T03:10:45.310 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:10:45.310 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T03:10:45.335 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T03:10:45.400 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T03:10:45.401 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:10:45.401 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T03:10:45.457 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T03:10:45.553 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:10:45.553 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T03:10:45.578 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T03:10:45.644 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:10:45.645 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T03:10:45.670 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T03:10:45.734 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-20T03:10:45.866 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-20T03:10:45.867 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:10:45.869 INFO:tasks.cephadm:Cluster fsid is bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:10:45.869 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-20T03:10:45.869 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.28', 'mon.b': '10.20.193.126', 'mon.c': '10.20.193.177'} 2026-02-20T03:10:45.869 INFO:tasks.cephadm:First mon is mon.a on trial028 2026-02-20T03:10:45.869 INFO:tasks.cephadm:First mgr is x 2026-02-20T03:10:45.869 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-20T03:10:45.869 DEBUG:teuthology.orchestra.run.trial028:> sudo hostname $(hostname -s) 2026-02-20T03:10:45.930 DEBUG:teuthology.orchestra.run.trial126:> sudo hostname $(hostname -s) 2026-02-20T03:10:45.955 DEBUG:teuthology.orchestra.run.trial177:> sudo hostname $(hostname -s) 2026-02-20T03:10:45.979 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-20T03:10:45.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:10:46.111 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/flavors/default/', 'ref': 'wip-jcollin-testing-20260218.004834-squid', 'sha1': 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-18 01:49:27.821377', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '19.2.3-700-gf4ef35d9', 'package_manager_version': '19.2.3-700.gf4ef35d9', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3045/', 'root_build_cause': '', 'node_name': '10.20.192.25+soko15', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-20T03:10:46.253 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-jcollin-testing-20260218.004834-squid, sha1 f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:10:46.257 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/x86_64/flavors/default/cephadm 2026-02-20T03:10:46.257 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/x86_64/flavors/default/cephadm 2026-02-20T03:10:46.257 DEBUG:teuthology.orchestra.run.trial028:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-20T03:10:46.549 INFO:teuthology.orchestra.run.trial028.stdout:-rw-r--r--. 1 ubuntu ubuntu 788264 Feb 20 03:10 /home/ubuntu/cephtest/cephadm 2026-02-20T03:10:46.550 DEBUG:teuthology.orchestra.run.trial126:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-20T03:10:46.800 INFO:teuthology.orchestra.run.trial126.stdout:-rw-r--r--. 1 ubuntu ubuntu 788264 Feb 20 03:10 /home/ubuntu/cephtest/cephadm 2026-02-20T03:10:46.801 DEBUG:teuthology.orchestra.run.trial177:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260218.004834-squid/f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-20T03:10:47.056 INFO:teuthology.orchestra.run.trial177.stdout:-rw-r--r--. 1 ubuntu ubuntu 788264 Feb 20 03:10 /home/ubuntu/cephtest/cephadm 2026-02-20T03:10:47.056 DEBUG:teuthology.orchestra.run.trial028:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-20T03:10:47.096 DEBUG:teuthology.orchestra.run.trial126:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-20T03:10:47.114 DEBUG:teuthology.orchestra.run.trial177:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-20T03:10:47.159 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 on all hosts... 2026-02-20T03:10:47.159 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 pull 2026-02-20T03:10:47.163 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 pull 2026-02-20T03:10:47.166 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 pull 2026-02-20T03:10:47.395 INFO:teuthology.orchestra.run.trial177.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03... 2026-02-20T03:10:47.409 INFO:teuthology.orchestra.run.trial126.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03... 2026-02-20T03:10:47.650 INFO:teuthology.orchestra.run.trial028.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03... 2026-02-20T03:10:56.554 INFO:teuthology.orchestra.run.trial126.stdout:{ 2026-02-20T03:10:56.555 INFO:teuthology.orchestra.run.trial126.stdout: "ceph_version": "ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable)", 2026-02-20T03:10:56.555 INFO:teuthology.orchestra.run.trial126.stdout: "image_id": "de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7", 2026-02-20T03:10:56.555 INFO:teuthology.orchestra.run.trial126.stdout: "repo_digests": [ 2026-02-20T03:10:56.555 INFO:teuthology.orchestra.run.trial126.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285" 2026-02-20T03:10:56.555 INFO:teuthology.orchestra.run.trial126.stdout: ] 2026-02-20T03:10:56.555 INFO:teuthology.orchestra.run.trial126.stdout:} 2026-02-20T03:10:56.631 INFO:teuthology.orchestra.run.trial177.stdout:{ 2026-02-20T03:10:56.632 INFO:teuthology.orchestra.run.trial177.stdout: "ceph_version": "ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable)", 2026-02-20T03:10:56.632 INFO:teuthology.orchestra.run.trial177.stdout: "image_id": "de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7", 2026-02-20T03:10:56.632 INFO:teuthology.orchestra.run.trial177.stdout: "repo_digests": [ 2026-02-20T03:10:56.632 INFO:teuthology.orchestra.run.trial177.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285" 2026-02-20T03:10:56.632 INFO:teuthology.orchestra.run.trial177.stdout: ] 2026-02-20T03:10:56.632 INFO:teuthology.orchestra.run.trial177.stdout:} 2026-02-20T03:10:58.715 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:10:58.716 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable)", 2026-02-20T03:10:58.716 INFO:teuthology.orchestra.run.trial028.stdout: "image_id": "de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7", 2026-02-20T03:10:58.716 INFO:teuthology.orchestra.run.trial028.stdout: "repo_digests": [ 2026-02-20T03:10:58.716 INFO:teuthology.orchestra.run.trial028.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285" 2026-02-20T03:10:58.716 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:10:58.716 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:10:58.742 DEBUG:teuthology.orchestra.run.trial028:> sudo mkdir -p /etc/ceph 2026-02-20T03:10:58.801 DEBUG:teuthology.orchestra.run.trial126:> sudo mkdir -p /etc/ceph 2026-02-20T03:10:58.829 DEBUG:teuthology.orchestra.run.trial177:> sudo mkdir -p /etc/ceph 2026-02-20T03:10:58.857 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 777 /etc/ceph 2026-02-20T03:10:58.912 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod 777 /etc/ceph 2026-02-20T03:10:58.937 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod 777 /etc/ceph 2026-02-20T03:10:58.963 INFO:tasks.cephadm:Writing seed config... 2026-02-20T03:10:58.964 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2026-02-20T03:10:58.964 INFO:tasks.cephadm: override: [client] debug client = 20 2026-02-20T03:10:58.964 INFO:tasks.cephadm: override: [client] debug ms = 1 2026-02-20T03:10:58.964 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2026-02-20T03:10:58.964 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2026-02-20T03:10:58.964 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] debug mds = 20 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] debug ms = 1 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-20T03:10:58.965 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-20T03:10:58.966 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-20T03:10:58.967 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2026-02-20T03:10:58.967 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-20T03:10:58.967 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2026-02-20T03:10:58.968 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:10:58.968 DEBUG:teuthology.orchestra.run.trial028:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-20T03:10:59.007 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bfaff8d7-0e09-11f1-8045-d404e6e7d460 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2026-02-20T03:10:59.007 DEBUG:teuthology.orchestra.run.trial028:mon.a> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.a.service 2026-02-20T03:10:59.049 DEBUG:teuthology.orchestra.run.trial028:mgr.x> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.x.service 2026-02-20T03:10:59.095 INFO:tasks.cephadm:Bootstrapping... 2026-02-20T03:10:59.095 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 -v bootstrap --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.28 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-20T03:10:59.283 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T03:10:59.283 INFO:teuthology.orchestra.run.trial028.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03', '-v', 'bootstrap', '--fsid', 'bfaff8d7-0e09-11f1-8045-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.28', '--skip-admin-label'] 2026-02-20T03:10:59.283 INFO:teuthology.orchestra.run.trial028.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-20T03:10:59.284 INFO:teuthology.orchestra.run.trial028.stdout:Verifying podman|docker is present... 2026-02-20T03:10:59.316 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.6.0 2026-02-20T03:10:59.317 INFO:teuthology.orchestra.run.trial028.stdout:Verifying lvm2 is present... 2026-02-20T03:10:59.317 INFO:teuthology.orchestra.run.trial028.stdout:Verifying time synchronization is in place... 2026-02-20T03:10:59.328 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-20T03:10:59.329 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-20T03:10:59.338 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-20T03:10:59.338 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T03:10:59.349 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-20T03:10:59.359 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-20T03:10:59.359 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-20T03:10:59.360 INFO:teuthology.orchestra.run.trial028.stdout:Repeating the final host check... 2026-02-20T03:10:59.392 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout 5.6.0 2026-02-20T03:10:59.393 INFO:teuthology.orchestra.run.trial028.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-20T03:10:59.393 INFO:teuthology.orchestra.run.trial028.stdout:systemctl is present 2026-02-20T03:10:59.393 INFO:teuthology.orchestra.run.trial028.stdout:lvcreate is present 2026-02-20T03:10:59.403 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-20T03:10:59.403 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-20T03:10:59.413 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-20T03:10:59.413 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T03:10:59.426 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout enabled 2026-02-20T03:10:59.435 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout active 2026-02-20T03:10:59.436 INFO:teuthology.orchestra.run.trial028.stdout:Unit chronyd.service is enabled and running 2026-02-20T03:10:59.436 INFO:teuthology.orchestra.run.trial028.stdout:Host looks OK 2026-02-20T03:10:59.436 INFO:teuthology.orchestra.run.trial028.stdout:Cluster fsid: bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:10:59.436 INFO:teuthology.orchestra.run.trial028.stdout:Acquiring lock 140645017964848 on /run/cephadm/bfaff8d7-0e09-11f1-8045-d404e6e7d460.lock 2026-02-20T03:10:59.436 INFO:teuthology.orchestra.run.trial028.stdout:Lock 140645017964848 acquired on /run/cephadm/bfaff8d7-0e09-11f1-8045-d404e6e7d460.lock 2026-02-20T03:10:59.436 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 3300 ... 2026-02-20T03:10:59.436 INFO:teuthology.orchestra.run.trial028.stdout:Verifying IP 10.20.193.28 port 6789 ... 2026-02-20T03:10:59.436 INFO:teuthology.orchestra.run.trial028.stdout:Base mon IP(s) is [10.20.193.28:3300, 10.20.193.28:6789], mon addrv is [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-20T03:10:59.442 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.28 metric 100 2026-02-20T03:10:59.442 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.28 metric 100 2026-02-20T03:10:59.448 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-20T03:10:59.448 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0np0 proto kernel metric 256 pref medium 2026-02-20T03:10:59.453 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-20T03:10:59.453 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-20T03:10:59.453 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-20T03:10:59.453 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout 2: enp1s0f0np0: mtu 1500 state UP qlen 1000 2026-02-20T03:10:59.453 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:630c/64 scope link proto kernel_ll 2026-02-20T03:10:59.454 INFO:teuthology.orchestra.run.trial028.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-20T03:10:59.454 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-20T03:10:59.454 INFO:teuthology.orchestra.run.trial028.stdout:Mon IP `10.20.193.28` is in CIDR network `10.20.192.0/20` 2026-02-20T03:10:59.454 INFO:teuthology.orchestra.run.trial028.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-20T03:10:59.454 INFO:teuthology.orchestra.run.trial028.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-20T03:10:59.455 INFO:teuthology.orchestra.run.trial028.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03... 2026-02-20T03:10:59.741 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stdout de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 2026-02-20T03:10:59.741 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03... 2026-02-20T03:10:59.742 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Getting image source signatures 2026-02-20T03:10:59.742 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:6d3e06557248500de3ee1d1978b6f44f0216e6134918a5dff185eb84966415de 2026-02-20T03:10:59.742 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying blob sha256:5dd85e1a50663785d86adae5ef92579a03e6f64059ca9c005010518acdd62048 2026-02-20T03:10:59.742 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Copying config sha256:de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 2026-02-20T03:10:59.742 INFO:teuthology.orchestra.run.trial028.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-20T03:10:59.972 INFO:teuthology.orchestra.run.trial028.stdout:ceph: stdout ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable) 2026-02-20T03:10:59.972 INFO:teuthology.orchestra.run.trial028.stdout:Ceph version: ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable) 2026-02-20T03:10:59.972 INFO:teuthology.orchestra.run.trial028.stdout:Extracting ceph user uid/gid from container image... 2026-02-20T03:11:00.201 INFO:teuthology.orchestra.run.trial028.stdout:stat: stdout 167 167 2026-02-20T03:11:00.201 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial keys... 2026-02-20T03:11:00.428 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQDE0JdpMmZoExAAJzxIbJmJhN0Lb2MRbS9iMg== 2026-02-20T03:11:00.686 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQDE0Jdp1bEDIxAAIeNAOah7sahzu1iptNcgeg== 2026-02-20T03:11:00.925 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph-authtool: stdout AQDE0JdpP1UnMRAAR4KZyOeYg2GRZ3Be1Dmm6Q== 2026-02-20T03:11:00.925 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial monmap... 2026-02-20T03:11:01.159 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-20T03:11:01.159 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-20T03:11:01.159 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:01.159 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-20T03:11:01.159 INFO:teuthology.orchestra.run.trial028.stdout:monmaptool for a [v2:10.20.193.28:3300,v1:10.20.193.28:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-20T03:11:01.160 INFO:teuthology.orchestra.run.trial028.stdout:setting min_mon_release = quincy 2026-02-20T03:11:01.160 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: set fsid to bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:01.160 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-20T03:11:01.160 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:01.160 INFO:teuthology.orchestra.run.trial028.stdout:Creating mon... 2026-02-20T03:11:01.394 INFO:teuthology.orchestra.run.trial028.stdout:create mon.a on 2026-02-20T03:11:01.671 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-20T03:11:01.851 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-20T03:11:02.047 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460.target → /etc/systemd/system/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460.target. 2026-02-20T03:11:02.047 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460.target → /etc/systemd/system/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460.target. 2026-02-20T03:11:02.266 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.a 2026-02-20T03:11:02.266 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.a.service: Unit ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.a.service not loaded. 2026-02-20T03:11:02.491 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460.target.wants/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@.service. 2026-02-20T03:11:02.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:02 trial028 podman[38175]: 2026-02-20 03:11:02.687821811 +0000 UTC m=+0.019453474 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:11:02.781 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T03:11:02.781 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-20T03:11:02.792 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T03:11:02.792 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T03:11:02.792 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-20T03:11:02.792 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-20T03:11:02.793 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon to start... 2026-02-20T03:11:02.793 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mon... 2026-02-20T03:11:03.013 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:02 trial028 systemd[1]: Started Ceph mon.a for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:11:03.014 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:02 trial028 ceph-mon[38195]: mkfs bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:03.014 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:02 trial028 ceph-mon[38195]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-20T03:11:03.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout cluster: 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout id: bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout services: 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.211958s) 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout data: 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-20T03:11:03.127 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout pgs: 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.971+0000 7f29ddc39640 1 Processor -- start 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.971+0000 7f29ddc39640 1 -- start start 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.971+0000 7f29ddc39640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d8111480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.971+0000 7f29ddc39640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f29d80826d0 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.972+0000 7f29dcc37640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d8111480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.972+0000 7f29dcc37640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d8111480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37664/0 (socket says 10.20.193.28:37664) 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.972+0000 7f29dcc37640 1 -- 10.20.193.28:0/2201203450 learned_addr learned my addr 10.20.193.28:0/2201203450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.972+0000 7f29dcc37640 1 -- 10.20.193.28:0/2201203450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d81119c0 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.974+0000 7f29dcc37640 1 --2- 10.20.193.28:0/2201203450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d8111480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009920 tx=0x7f29c802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a5188edb4e1785 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.974+0000 7f29cf7fe640 1 -- 10.20.193.28:0/2201203450 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29c803c070 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.974+0000 7f29cf7fe640 1 -- 10.20.193.28:0/2201203450 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c802fae0 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.974+0000 7f29cf7fe640 1 -- 10.20.193.28:0/2201203450 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29c802fde0 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.974+0000 7f29ddc39640 1 -- 10.20.193.28:0/2201203450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 msgr2=0x7f29d8111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.974+0000 7f29ddc39640 1 --2- 10.20.193.28:0/2201203450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d8111480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009920 tx=0x7f29c802ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.975+0000 7f29ddc39640 1 -- 10.20.193.28:0/2201203450 shutdown_connections 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.975+0000 7f29ddc39640 1 --2- 10.20.193.28:0/2201203450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d8111480 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.975+0000 7f29ddc39640 1 -- 10.20.193.28:0/2201203450 >> 10.20.193.28:0/2201203450 conn(0x7f29d807d600 msgr2=0x7f29d807fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.975+0000 7f29ddc39640 1 -- 10.20.193.28:0/2201203450 shutdown_connections 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.975+0000 7f29ddc39640 1 -- 10.20.193.28:0/2201203450 wait complete. 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.975+0000 7f29ddc39640 1 Processor -- start 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.975+0000 7f29ddc39640 1 -- start start 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.976+0000 7f29ddc39640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d81a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.976+0000 7f29ddc39640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f29d8111e90 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.976+0000 7f29dcc37640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d81a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.976+0000 7f29dcc37640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d81a3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37666/0 (socket says 10.20.193.28:37666) 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.976+0000 7f29dcc37640 1 -- 10.20.193.28:0/3838096060 learned_addr learned my addr 10.20.193.28:0/3838096060 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.976+0000 7f29dcc37640 1 -- 10.20.193.28:0/3838096060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d81a41e0 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.977+0000 7f29dcc37640 1 --2- 10.20.193.28:0/3838096060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d81a3ca0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009a50 tx=0x7f29c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.977+0000 7f29cdffb640 1 -- 10.20.193.28:0/3838096060 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29c803c050 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.977+0000 7f29cdffb640 1 -- 10.20.193.28:0/3838096060 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c8048070 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.977+0000 7f29cdffb640 1 -- 10.20.193.28:0/3838096060 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29c8043710 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.977+0000 7f29ddc39640 1 -- 10.20.193.28:0/3838096060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d81a4470 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.977+0000 7f29ddc39640 1 -- 10.20.193.28:0/3838096060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d81a7160 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.977+0000 7f29cdffb640 1 -- 10.20.193.28:0/3838096060 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f29c802fa90 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.977+0000 7f29cdffb640 1 -- 10.20.193.28:0/3838096060 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f29c804c760 con 0x7f29d810f090 2026-02-20T03:11:03.128 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.977+0000 7f29ddc39640 1 -- 10.20.193.28:0/3838096060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d810f4f0 con 0x7f29d810f090 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:02.980+0000 7f29cdffb640 1 -- 10.20.193.28:0/3838096060 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f29c8051020 con 0x7f29d810f090 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.011+0000 7f29ddc39640 1 -- 10.20.193.28:0/3838096060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f29d819d690 con 0x7f29d810f090 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.011+0000 7f29cdffb640 1 -- 10.20.193.28:0/3838096060 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f29c804c9b0 con 0x7f29d810f090 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.012+0000 7f29ddc39640 1 -- 10.20.193.28:0/3838096060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 msgr2=0x7f29d81a3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.012+0000 7f29ddc39640 1 --2- 10.20.193.28:0/3838096060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d81a3ca0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009a50 tx=0x7f29c80047c0 comp rx=0 tx=0).stop 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.012+0000 7f29ddc39640 1 -- 10.20.193.28:0/3838096060 shutdown_connections 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.012+0000 7f29ddc39640 1 --2- 10.20.193.28:0/3838096060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29d810f090 0x7f29d81a3ca0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.012+0000 7f29ddc39640 1 -- 10.20.193.28:0/3838096060 >> 10.20.193.28:0/3838096060 conn(0x7f29d807d600 msgr2=0x7f29d807e690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.012+0000 7f29ddc39640 1 -- 10.20.193.28:0/3838096060 shutdown_connections 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.012+0000 7f29ddc39640 1 -- 10.20.193.28:0/3838096060 wait complete. 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:mon is available 2026-02-20T03:11:03.129 INFO:teuthology.orchestra.run.trial028.stdout:Assimilating anything we can from ceph.conf... 2026-02-20T03:11:03.426 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:03.426 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-20T03:11:03.427 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-20T03:11:03.428 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.309+0000 7ff77e1e6640 1 Processor -- start 2026-02-20T03:11:03.428 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.309+0000 7ff77e1e6640 1 -- start start 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.310+0000 7ff77e1e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff778111480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.310+0000 7ff77e1e6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff7780826d0 con 0x7ff77810f090 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.310+0000 7ff77d1e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff778111480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.310+0000 7ff77d1e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff778111480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37682/0 (socket says 10.20.193.28:37682) 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.310+0000 7ff77d1e4640 1 -- 10.20.193.28:0/1212941404 learned_addr learned my addr 10.20.193.28:0/1212941404 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.310+0000 7ff77d1e4640 1 -- 10.20.193.28:0/1212941404 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7781119c0 con 0x7ff77810f090 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.311+0000 7ff77d1e4640 1 --2- 10.20.193.28:0/1212941404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff778111480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff768009920 tx=0x7ff76802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd8fbd17d98d7a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff767fff640 1 -- 10.20.193.28:0/1212941404 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff76803c070 con 0x7ff77810f090 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff767fff640 1 -- 10.20.193.28:0/1212941404 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76802fae0 con 0x7ff77810f090 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff767fff640 1 -- 10.20.193.28:0/1212941404 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff76802fde0 con 0x7ff77810f090 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff77e1e6640 1 -- 10.20.193.28:0/1212941404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 msgr2=0x7ff778111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff77e1e6640 1 --2- 10.20.193.28:0/1212941404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff778111480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff768009920 tx=0x7ff76802ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff77e1e6640 1 -- 10.20.193.28:0/1212941404 shutdown_connections 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff77e1e6640 1 --2- 10.20.193.28:0/1212941404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff778111480 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff77e1e6640 1 -- 10.20.193.28:0/1212941404 >> 10.20.193.28:0/1212941404 conn(0x7ff77807d600 msgr2=0x7ff77807fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff77e1e6640 1 -- 10.20.193.28:0/1212941404 shutdown_connections 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.312+0000 7ff77e1e6640 1 -- 10.20.193.28:0/1212941404 wait complete. 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.313+0000 7ff77e1e6640 1 Processor -- start 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.313+0000 7ff77e1e6640 1 -- start start 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.313+0000 7ff77e1e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff7781a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.313+0000 7ff77e1e6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff778111e90 con 0x7ff77810f090 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff77d1e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff7781a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff77d1e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff7781a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37696/0 (socket says 10.20.193.28:37696) 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff77d1e4640 1 -- 10.20.193.28:0/3329129604 learned_addr learned my addr 10.20.193.28:0/3329129604 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff77d1e4640 1 -- 10.20.193.28:0/3329129604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7781a4210 con 0x7ff77810f090 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff77d1e4640 1 --2- 10.20.193.28:0/3329129604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff7781a3cd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff76802fab0 tx=0x7ff7680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff7667fc640 1 -- 10.20.193.28:0/3329129604 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff768046070 con 0x7ff77810f090 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff7667fc640 1 -- 10.20.193.28:0/3329129604 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff768041590 con 0x7ff77810f090 2026-02-20T03:11:03.429 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff7667fc640 1 -- 10.20.193.28:0/3329129604 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff76803c040 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff77e1e6640 1 -- 10.20.193.28:0/3329129604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7781a4500 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.314+0000 7ff77e1e6640 1 -- 10.20.193.28:0/3329129604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7781a7180 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.315+0000 7ff7667fc640 1 -- 10.20.193.28:0/3329129604 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7ff768041890 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.315+0000 7ff7667fc640 1 -- 10.20.193.28:0/3329129604 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff7680423f0 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.315+0000 7ff77e1e6640 1 -- 10.20.193.28:0/3329129604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77810f4f0 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.317+0000 7ff7667fc640 1 -- 10.20.193.28:0/3329129604 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7ff768041d40 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.346+0000 7ff77e1e6640 1 -- 10.20.193.28:0/3329129604 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ff77819d7c0 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.350+0000 7ff7667fc640 1 -- 10.20.193.28:0/3329129604 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7ff76804b450 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.350+0000 7ff7667fc640 1 -- 10.20.193.28:0/3329129604 <== mon.0 v2:10.20.193.28:3300/0 8 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7ff76802fae0 con 0x7ff77810f090 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.350+0000 7ff77e1e6640 1 -- 10.20.193.28:0/3329129604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 msgr2=0x7ff7781a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.350+0000 7ff77e1e6640 1 --2- 10.20.193.28:0/3329129604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff7781a3cd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff76802fab0 tx=0x7ff7680047c0 comp rx=0 tx=0).stop 2026-02-20T03:11:03.430 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.350+0000 7ff77e1e6640 1 -- 10.20.193.28:0/3329129604 shutdown_connections 2026-02-20T03:11:03.431 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.350+0000 7ff77e1e6640 1 --2- 10.20.193.28:0/3329129604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff77810f090 0x7ff7781a3cd0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:03.431 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.350+0000 7ff77e1e6640 1 -- 10.20.193.28:0/3329129604 >> 10.20.193.28:0/3329129604 conn(0x7ff77807d600 msgr2=0x7ff77807e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:03.431 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.350+0000 7ff77e1e6640 1 -- 10.20.193.28:0/3329129604 shutdown_connections 2026-02-20T03:11:03.431 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.351+0000 7ff77e1e6640 1 -- 10.20.193.28:0/3329129604 wait complete. 2026-02-20T03:11:03.431 INFO:teuthology.orchestra.run.trial028.stdout:Generating new minimal ceph.conf... 2026-02-20T03:11:03.765 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.613+0000 7f69bbfff640 1 Processor -- start 2026-02-20T03:11:03.765 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.613+0000 7f69bbfff640 1 -- start start 2026-02-20T03:11:03.765 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.613+0000 7f69bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc073980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:03.765 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.613+0000 7f69bbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc074f80 con 0x7f69bc073580 2026-02-20T03:11:03.765 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.614+0000 7f69baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc073980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:03.765 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.614+0000 7f69baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc073980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37708/0 (socket says 10.20.193.28:37708) 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.614+0000 7f69baffd640 1 -- 10.20.193.28:0/1865979554 learned_addr learned my addr 10.20.193.28:0/1865979554 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.614+0000 7f69baffd640 1 -- 10.20.193.28:0/1865979554 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc073ec0 con 0x7f69bc073580 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69baffd640 1 --2- 10.20.193.28:0/1865979554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc073980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009920 tx=0x7f69b002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb3aa38660d8152 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69b9ffb640 1 -- 10.20.193.28:0/1865979554 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b003c070 con 0x7f69bc073580 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69b9ffb640 1 -- 10.20.193.28:0/1865979554 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f69b0037440 con 0x7f69bc073580 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69b9ffb640 1 -- 10.20.193.28:0/1865979554 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b00354b0 con 0x7f69bc073580 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69bbfff640 1 -- 10.20.193.28:0/1865979554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 msgr2=0x7f69bc073980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69bbfff640 1 --2- 10.20.193.28:0/1865979554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc073980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009920 tx=0x7f69b002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69bbfff640 1 -- 10.20.193.28:0/1865979554 shutdown_connections 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69bbfff640 1 --2- 10.20.193.28:0/1865979554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc073980 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69bbfff640 1 -- 10.20.193.28:0/1865979554 >> 10.20.193.28:0/1865979554 conn(0x7f69bc06f500 msgr2=0x7f69bc071940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69bbfff640 1 -- 10.20.193.28:0/1865979554 shutdown_connections 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.615+0000 7f69bbfff640 1 -- 10.20.193.28:0/1865979554 wait complete. 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.616+0000 7f69bbfff640 1 Processor -- start 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.616+0000 7f69bbfff640 1 -- start start 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.616+0000 7f69bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc1acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.616+0000 7f69bbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc112860 con 0x7f69bc073580 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.616+0000 7f69baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc1acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.616+0000 7f69baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc1acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37714/0 (socket says 10.20.193.28:37714) 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.616+0000 7f69baffd640 1 -- 10.20.193.28:0/1665233059 learned_addr learned my addr 10.20.193.28:0/1665233059 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.617+0000 7f69baffd640 1 -- 10.20.193.28:0/1665233059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc1ad4a0 con 0x7f69bc073580 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.617+0000 7f69baffd640 1 --2- 10.20.193.28:0/1665233059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc1acf60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009a50 tx=0x7f69b0037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.617+0000 7f69c081e640 1 -- 10.20.193.28:0/1665233059 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b0045070 con 0x7f69bc073580 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.617+0000 7f69c081e640 1 -- 10.20.193.28:0/1665233059 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f69b0040450 con 0x7f69bc073580 2026-02-20T03:11:03.766 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.617+0000 7f69c081e640 1 -- 10.20.193.28:0/1665233059 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b003c070 con 0x7f69bc073580 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.617+0000 7f69bbfff640 1 -- 10.20.193.28:0/1665233059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc1ad730 con 0x7f69bc073580 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.617+0000 7f69bbfff640 1 -- 10.20.193.28:0/1665233059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc1b0420 con 0x7f69bc073580 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.617+0000 7f69c081e640 1 -- 10.20.193.28:0/1665233059 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f69b003e5b0 con 0x7f69bc073580 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.617+0000 7f69c081e640 1 -- 10.20.193.28:0/1665233059 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f69b004aaf0 con 0x7f69bc073580 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.618+0000 7f69bbfff640 1 -- 10.20.193.28:0/1665233059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69bc073a00 con 0x7f69bc073580 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.619+0000 7f69c081e640 1 -- 10.20.193.28:0/1665233059 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f69b004f030 con 0x7f69bc073580 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.649+0000 7f69bbfff640 1 -- 10.20.193.28:0/1665233059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f69bc1b05f0 con 0x7f69bc073580 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.650+0000 7f69c081e640 1 -- 10.20.193.28:0/1665233059 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f69b004ad40 con 0x7f69bc073580 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.650+0000 7f69bbfff640 1 -- 10.20.193.28:0/1665233059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 msgr2=0x7f69bc1acf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.650+0000 7f69bbfff640 1 --2- 10.20.193.28:0/1665233059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc1acf60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009a50 tx=0x7f69b0037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.650+0000 7f69bbfff640 1 -- 10.20.193.28:0/1665233059 shutdown_connections 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.650+0000 7f69bbfff640 1 --2- 10.20.193.28:0/1665233059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f69bc073580 0x7f69bc1acf60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.650+0000 7f69bbfff640 1 -- 10.20.193.28:0/1665233059 >> 10.20.193.28:0/1665233059 conn(0x7f69bc06f500 msgr2=0x7f69bc071170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.650+0000 7f69bbfff640 1 -- 10.20.193.28:0/1665233059 shutdown_connections 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:03.651+0000 7f69bbfff640 1 -- 10.20.193.28:0/1665233059 wait complete. 2026-02-20T03:11:03.767 INFO:teuthology.orchestra.run.trial028.stdout:Restarting the monitor... 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 systemd[1]: Stopping Ceph mon.a for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: monmap epoch 1 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: last_changed 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: min_mon_release 19 (squid) 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: election_strategy: 1 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: fsmap 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: osdmap e1: 0 total, 0 up, 0 in 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: mgrmap e1: no daemons active 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: from='client.? 10.20.193.28:0/3838096060' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: from='client.? 10.20.193.28:0/3329129604' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: from='client.? 10.20.193.28:0/3329129604' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-20T03:11:03.905 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-mon[38195]: from='client.? 10.20.193.28:0/1665233059' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:04.272 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a[38191]: 2026-02-20T03:11:03.902+0000 7fe0249be640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:11:04.272 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a[38191]: 2026-02-20T03:11:03.902+0000 7fe0249be640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-20T03:11:04.272 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 podman[38438]: 2026-02-20 03:11:03.93430681 +0000 UTC m=+0.056535240 container died 4b46b29c786083cf3b3aeb5e83738198b65d5b644535af6f81ae497426b2233f (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2026-02-20T03:11:04.272 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 podman[38438]: 2026-02-20 03:11:03.990870581 +0000 UTC m=+0.113099011 container remove 4b46b29c786083cf3b3aeb5e83738198b65d5b644535af6f81ae497426b2233f (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2) 2026-02-20T03:11:04.273 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:03 trial028 bash[38438]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a 2026-02-20T03:11:04.273 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 systemd[1]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-20T03:11:04.273 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 systemd[1]: Stopped Ceph mon.a for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:11:04.273 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 systemd[1]: Starting Ceph mon.a for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:11:04.329 INFO:teuthology.orchestra.run.trial028.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 podman[38532]: 2026-02-20 03:11:04.269989015 +0000 UTC m=+0.030262194 container create 656b013ac329f06d5a566e4f5a7fb75df7d4ff61bba65d70c48e1ea011a8a447 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 podman[38532]: 2026-02-20 03:11:04.314676964 +0000 UTC m=+0.074950143 container init 656b013ac329f06d5a566e4f5a7fb75df7d4ff61bba65d70c48e1ea011a8a447 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, ceph=True) 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 podman[38532]: 2026-02-20 03:11:04.319681437 +0000 UTC m=+0.079954616 container start 656b013ac329f06d5a566e4f5a7fb75df7d4ff61bba65d70c48e1ea011a8a447 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a, org.label-schema.license=GPLv2, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 bash[38532]: 656b013ac329f06d5a566e4f5a7fb75df7d4ff61bba65d70c48e1ea011a8a447 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 podman[38532]: 2026-02-20 03:11:04.259157492 +0000 UTC m=+0.019430671 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 systemd[1]: Started Ceph mon.a for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: set uid:gid to 167:167 (ceph:ceph) 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable), process ceph-mon, pid 2 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: pidfile_write: ignore empty --pid-file 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: load: jerasure load: lrc 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: RocksDB version: 7.9.2 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Git sha 0 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Compile date 2026-02-18 01:04:15 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: DB SUMMARY 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: DB Session ID: O5C6MB50KFTEW8W9VRQV 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: CURRENT file: CURRENT 2026-02-20T03:11:04.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: IDENTITY file: IDENTITY 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 102508 ; 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.error_if_exists: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.create_if_missing: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.paranoid_checks: 1 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.env: 0x558130cdddc0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.fs: PosixFileSystem 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.info_log: 0x55815496b840 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_file_opening_threads: 16 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.statistics: (nil) 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.use_fsync: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_log_file_size: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.keep_log_file_num: 1000 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.recycle_log_file_num: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.allow_fallocate: 1 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.allow_mmap_reads: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.allow_mmap_writes: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.use_direct_reads: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.create_missing_column_families: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.db_log_dir: 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.wal_dir: 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-20T03:11:04.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.advise_random_on_open: 1 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.db_write_buffer_size: 0 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.write_buffer_manager: 0x55815496f900 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.rate_limiter: (nil) 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.wal_recovery_mode: 2 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.enable_thread_tracking: 0 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.enable_pipelined_write: 0 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.unordered_write: 0 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.row_cache: None 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.wal_filter: None 2026-02-20T03:11:04.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.allow_ingest_behind: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.two_write_queues: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.manual_wal_flush: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.wal_compression: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.atomic_flush: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.log_readahead_size: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.best_efforts_recovery: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.allow_data_in_errors: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.db_host_id: __hostname__ 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_background_jobs: 2 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_background_compactions: -1 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_subcompactions: 1 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_total_wal_size: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_open_files: -1 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bytes_per_sync: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-20T03:11:04.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_readahead_size: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_background_flushes: -1 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Compression algorithms supported: 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: kZSTD supported: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: kXpressCompression supported: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: kBZip2Compression supported: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: kLZ4Compression supported: 1 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: kZlibCompression supported: 1 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: kLZ4HCCompression supported: 1 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: kSnappyCompression supported: 1 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.merge_operator: 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_filter: None 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_filter_factory: None 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.sst_partitioner_factory: None 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55815496b4a0) 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks: 1 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: pin_top_level_index_and_filter: 1 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: index_type: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_index_type: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: index_shortening: 1 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: checksum: 4 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: no_block_cache: 0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache: 0x5581549909b0 2026-02-20T03:11:04.546 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_name: BinnedLRUCache 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_options: 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: capacity : 536870912 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: num_shard_bits : 4 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: strict_capacity_limit : 0 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: high_pri_pool_ratio: 0.000 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: block_cache_compressed: (nil) 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: persistent_cache: (nil) 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size: 4096 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: block_size_deviation: 10 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: block_restart_interval: 16 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: index_block_restart_interval: 1 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: metadata_block_size: 4096 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: partition_filters: 0 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: use_delta_encoding: 1 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: filter_policy: bloomfilter 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: whole_key_filtering: 1 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: verify_compression: 0 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: read_amp_bytes_per_bit: 0 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: format_version: 5 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_index_compression: 1 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: block_align: 0 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: max_auto_readahead_size: 262144 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: prepopulate_block_cache: 0 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: initial_auto_readahead_size: 8192 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout: num_file_reads_for_auto_readahead: 2 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.write_buffer_size: 33554432 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_write_buffer_number: 2 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression: NoCompression 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression: Disabled 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.prefix_extractor: nullptr 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.num_levels: 7 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-20T03:11:04.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression_opts.level: 32767 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression_opts.strategy: 0 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression_opts.enabled: false 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.target_file_size_base: 67108864 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-20T03:11:04.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.arena_block_size: 1048576 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.disable_auto_compactions: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.inplace_update_support: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.bloom_locality: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.max_successive_merges: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.paranoid_file_checks: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.force_consistency_checks: 1 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.report_bg_io_stats: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.ttl: 2592000 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.enable_blob_files: false 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.min_blob_size: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.blob_file_size: 268435456 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-20T03:11:04.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.blob_file_starting_level: 0 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b0f9e705-8040-4dfe-8db0-9ae2adf025c2 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771557064353204, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771557064354747, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 98093, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 308, "table_properties": {"data_size": 96049, "index_size": 301, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13758, "raw_average_key_size": 50, "raw_value_size": 88513, "raw_average_value_size": 321, "num_data_blocks": 12, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771557064, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b0f9e705-8040-4dfe-8db0-9ae2adf025c2", "db_session_id": "O5C6MB50KFTEW8W9VRQV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771557064354862, "job": 1, "event": "recovery_finished"} 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558154992e00 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: DB pointer 0x5581549a4000 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: ** DB Stats ** 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: L0 2/0 97.65 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Sum 2/0 97.65 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 85.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: ** Compaction Stats [default] ** 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 85.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-20T03:11:04.550 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: Cumulative compaction: 0.00 GB write, 19.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: Interval compaction: 0.00 GB write, 19.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache BinnedLRUCache@0x5581549909b0#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 7e-06 secs_since: 0 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: starting mon.a rank 0 at public addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] at bind addrs [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mon.a@-1(???) e1 preinit fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mon.a@-1(???).mds e1 new map 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mon.a@-1(???).mds e1 print_map 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: e1 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: btime 2026-02-20T03:11:02:801427+0000 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: legacy client fscid: -1 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout: No filesystems configured 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: monmap epoch 1 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: last_changed 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:04.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:04.552 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: min_mon_release 19 (squid) 2026-02-20T03:11:04.552 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: election_strategy: 1 2026-02-20T03:11:04.552 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:04.552 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: fsmap 2026-02-20T03:11:04.552 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: osdmap e1: 0 total, 0 up, 0 in 2026-02-20T03:11:04.552 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:04 trial028 ceph-mon[38552]: mgrmap e1: no daemons active 2026-02-20T03:11:04.620 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.499+0000 7f9b51cc9640 1 Processor -- start 2026-02-20T03:11:04.624 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.500+0000 7f9b51cc9640 1 -- start start 2026-02-20T03:11:04.624 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.500+0000 7f9b51cc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c10cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:04.624 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.500+0000 7f9b51cc9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c07bf70 con 0x7f9b4c07bae0 2026-02-20T03:11:04.624 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.500+0000 7f9b50cc7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c10cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:04.624 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.500+0000 7f9b50cc7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c10cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37728/0 (socket says 10.20.193.28:37728) 2026-02-20T03:11:04.624 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.500+0000 7f9b50cc7640 1 -- 10.20.193.28:0/2495776736 learned_addr learned my addr 10.20.193.28:0/2495776736 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:04.624 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.501+0000 7f9b50cc7640 1 -- 10.20.193.28:0/2495776736 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c10d490 con 0x7f9b4c07bae0 2026-02-20T03:11:04.624 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b50cc7640 1 --2- 10.20.193.28:0/2495776736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c10cf50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009920 tx=0x7f9b3c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89f45bd1ebd8ff8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b437fe640 1 -- 10.20.193.28:0/2495776736 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c03c070 con 0x7f9b4c07bae0 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b437fe640 1 -- 10.20.193.28:0/2495776736 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f9b3c037440 con 0x7f9b4c07bae0 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b437fe640 1 -- 10.20.193.28:0/2495776736 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c0354b0 con 0x7f9b4c07bae0 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b51cc9640 1 -- 10.20.193.28:0/2495776736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 msgr2=0x7f9b4c10cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b51cc9640 1 --2- 10.20.193.28:0/2495776736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c10cf50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009920 tx=0x7f9b3c02ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b51cc9640 1 -- 10.20.193.28:0/2495776736 shutdown_connections 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b51cc9640 1 --2- 10.20.193.28:0/2495776736 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c10cf50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b51cc9640 1 -- 10.20.193.28:0/2495776736 >> 10.20.193.28:0/2495776736 conn(0x7f9b4c1025a0 msgr2=0x7f9b4c1049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b51cc9640 1 -- 10.20.193.28:0/2495776736 shutdown_connections 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.503+0000 7f9b51cc9640 1 -- 10.20.193.28:0/2495776736 wait complete. 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.504+0000 7f9b51cc9640 1 Processor -- start 2026-02-20T03:11:04.625 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.504+0000 7f9b51cc9640 1 -- start start 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.504+0000 7f9b51cc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c19fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.504+0000 7f9b51cc9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b4c10e480 con 0x7f9b4c07bae0 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b50cc7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c19fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b50cc7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c19fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37730/0 (socket says 10.20.193.28:37730) 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b50cc7640 1 -- 10.20.193.28:0/902995060 learned_addr learned my addr 10.20.193.28:0/902995060 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b50cc7640 1 -- 10.20.193.28:0/902995060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4c1a0530 con 0x7f9b4c07bae0 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b50cc7640 1 --2- 10.20.193.28:0/902995060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c19fff0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009a50 tx=0x7f9b3c037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b41ffb640 1 -- 10.20.193.28:0/902995060 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c045070 con 0x7f9b4c07bae0 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b41ffb640 1 -- 10.20.193.28:0/902995060 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f9b3c040450 con 0x7f9b4c07bae0 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b41ffb640 1 -- 10.20.193.28:0/902995060 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b3c03c070 con 0x7f9b4c07bae0 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b51cc9640 1 -- 10.20.193.28:0/902995060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4c1a07c0 con 0x7f9b4c07bae0 2026-02-20T03:11:04.626 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.505+0000 7f9b51cc9640 1 -- 10.20.193.28:0/902995060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4c1a34b0 con 0x7f9b4c07bae0 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.506+0000 7f9b41ffb640 1 -- 10.20.193.28:0/902995060 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f9b3c03e5c0 con 0x7f9b4c07bae0 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.506+0000 7f9b41ffb640 1 -- 10.20.193.28:0/902995060 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9b3c04a800 con 0x7f9b4c07bae0 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.506+0000 7f9b51cc9640 1 -- 10.20.193.28:0/902995060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b4c10cfd0 con 0x7f9b4c07bae0 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.508+0000 7f9b41ffb640 1 -- 10.20.193.28:0/902995060 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f9b3c04f030 con 0x7f9b4c07bae0 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.539+0000 7f9b51cc9640 1 -- 10.20.193.28:0/902995060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f9b4c1a3a90 con 0x7f9b4c07bae0 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.541+0000 7f9b41ffb640 1 -- 10.20.193.28:0/902995060 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 125+0+0 (secure 0 0 0) 0x7f9b3c035de0 con 0x7f9b4c07bae0 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.542+0000 7f9b51cc9640 1 -- 10.20.193.28:0/902995060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 msgr2=0x7f9b4c19fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.542+0000 7f9b51cc9640 1 --2- 10.20.193.28:0/902995060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c19fff0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009a50 tx=0x7f9b3c037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.542+0000 7f9b51cc9640 1 -- 10.20.193.28:0/902995060 shutdown_connections 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.542+0000 7f9b51cc9640 1 --2- 10.20.193.28:0/902995060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b4c07bae0 0x7f9b4c19fff0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.542+0000 7f9b51cc9640 1 -- 10.20.193.28:0/902995060 >> 10.20.193.28:0/902995060 conn(0x7f9b4c1025a0 msgr2=0x7f9b4c103150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:04.627 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.543+0000 7f9b51cc9640 1 -- 10.20.193.28:0/902995060 shutdown_connections 2026-02-20T03:11:04.628 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:04.543+0000 7f9b51cc9640 1 -- 10.20.193.28:0/902995060 wait complete. 2026-02-20T03:11:04.628 INFO:teuthology.orchestra.run.trial028.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-20T03:11:04.628 INFO:teuthology.orchestra.run.trial028.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:04.628 INFO:teuthology.orchestra.run.trial028.stdout:Creating mgr... 2026-02-20T03:11:04.628 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-20T03:11:04.628 INFO:teuthology.orchestra.run.trial028.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-20T03:11:04.848 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.x 2026-02-20T03:11:04.848 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.x.service: Unit ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.x.service not loaded. 2026-02-20T03:11:05.039 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460.target.wants/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@.service. 2026-02-20T03:11:05.238 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:05 trial028 systemd[1]: Starting Ceph mgr.x for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:11:05.315 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T03:11:05.315 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-20T03:11:05.326 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T03:11:05.326 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T03:11:05.326 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-20T03:11:05.326 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to enable service . firewalld.service is not available 2026-02-20T03:11:05.340 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T03:11:05.340 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-20T03:11:05.352 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T03:11:05.352 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T03:11:05.352 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-20T03:11:05.352 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-20T03:11:05.352 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr to start... 2026-02-20T03:11:05.352 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr... 2026-02-20T03:11:05.542 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:05 trial028 podman[38772]: 2026-02-20 03:11:05.236799477 +0000 UTC m=+0.029053469 container create 58c5d3975ef7b8724aaa27958bb2e21983a18d45a0c2d6e7e5e9ef6e390f5220 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T03:11:05.543 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:05 trial028 podman[38772]: 2026-02-20 03:11:05.281774119 +0000 UTC m=+0.074028111 container init 58c5d3975ef7b8724aaa27958bb2e21983a18d45a0c2d6e7e5e9ef6e390f5220 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, ceph=True, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, io.buildah.version=1.33.7) 2026-02-20T03:11:05.543 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:05 trial028 podman[38772]: 2026-02-20 03:11:05.28675656 +0000 UTC m=+0.079010552 container start 58c5d3975ef7b8724aaa27958bb2e21983a18d45a0c2d6e7e5e9ef6e390f5220 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, ceph=True, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T03:11:05.543 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:05 trial028 bash[38772]: 58c5d3975ef7b8724aaa27958bb2e21983a18d45a0c2d6e7e5e9ef6e390f5220 2026-02-20T03:11:05.543 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:05 trial028 podman[38772]: 2026-02-20 03:11:05.226278381 +0000 UTC m=+0.018532373 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:11:05.543 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:05 trial028 systemd[1]: Started Ceph mgr.x for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:11:05.667 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:05.667 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T03:11:05.667 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:11:05.667 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-20T03:11:05.667 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-20T03:11:05.667 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-20T03:11:05.667 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-20T03:11:05.667 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:05.668 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:05.669 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-20T03:11:02:801427+0000", 2026-02-20T03:11:05.670 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "restful" 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:05.671 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-20T03:11:02.801921+0000", 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.539+0000 7fb1099a1640 1 Processor -- start 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.539+0000 7fb1099a1640 1 -- start start 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.540+0000 7fb1099a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb10410a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.540+0000 7fb1099a1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb10410ab10 con 0x7fb10410a140 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.540+0000 7fb10899f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb10410a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:05.672 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.540+0000 7fb10899f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb10410a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37740/0 (socket says 10.20.193.28:37740) 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.540+0000 7fb10899f640 1 -- 10.20.193.28:0/1500394403 learned_addr learned my addr 10.20.193.28:0/1500394403 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.541+0000 7fb10899f640 1 -- 10.20.193.28:0/1500394403 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10410b340 con 0x7fb10410a140 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.541+0000 7fb10899f640 1 --2- 10.20.193.28:0/1500394403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb10410a540 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009920 tx=0x7fb0f402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7d3f80a9b4d325 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.542+0000 7fb0fb7fe640 1 -- 10.20.193.28:0/1500394403 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f403c070 con 0x7fb10410a140 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.542+0000 7fb0fb7fe640 1 -- 10.20.193.28:0/1500394403 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fb0f4037440 con 0x7fb10410a140 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.542+0000 7fb0fb7fe640 1 -- 10.20.193.28:0/1500394403 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f40354b0 con 0x7fb10410a140 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.543+0000 7fb1099a1640 1 -- 10.20.193.28:0/1500394403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 msgr2=0x7fb10410a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.543+0000 7fb1099a1640 1 --2- 10.20.193.28:0/1500394403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb10410a540 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009920 tx=0x7fb0f402ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.543+0000 7fb1099a1640 1 -- 10.20.193.28:0/1500394403 shutdown_connections 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.543+0000 7fb1099a1640 1 --2- 10.20.193.28:0/1500394403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb10410a540 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:05.673 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.543+0000 7fb1099a1640 1 -- 10.20.193.28:0/1500394403 >> 10.20.193.28:0/1500394403 conn(0x7fb10407d710 msgr2=0x7fb10407db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.543+0000 7fb1099a1640 1 -- 10.20.193.28:0/1500394403 shutdown_connections 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.543+0000 7fb1099a1640 1 -- 10.20.193.28:0/1500394403 wait complete. 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.544+0000 7fb1099a1640 1 Processor -- start 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.544+0000 7fb1099a1640 1 -- start start 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.544+0000 7fb1099a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb1041a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.544+0000 7fb1099a1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb10410e570 con 0x7fb10410a140 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.544+0000 7fb10899f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb1041a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.544+0000 7fb10899f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb1041a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37754/0 (socket says 10.20.193.28:37754) 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.544+0000 7fb10899f640 1 -- 10.20.193.28:0/1069428885 learned_addr learned my addr 10.20.193.28:0/1069428885 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.545+0000 7fb10899f640 1 -- 10.20.193.28:0/1069428885 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1041a0560 con 0x7fb10410a140 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.545+0000 7fb10899f640 1 --2- 10.20.193.28:0/1069428885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb1041a0020 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4037cd0 tx=0x7fb0f4037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:05.674 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.545+0000 7fb0f9ffb640 1 -- 10.20.193.28:0/1069428885 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f4045070 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.545+0000 7fb0f9ffb640 1 -- 10.20.193.28:0/1069428885 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fb0f4040450 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.545+0000 7fb1099a1640 1 -- 10.20.193.28:0/1069428885 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1041a07f0 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.545+0000 7fb0f9ffb640 1 -- 10.20.193.28:0/1069428885 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f403c070 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.545+0000 7fb1099a1640 1 -- 10.20.193.28:0/1069428885 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1041a34e0 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.545+0000 7fb0f9ffb640 1 -- 10.20.193.28:0/1069428885 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb0f403e4e0 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.545+0000 7fb0f9ffb640 1 -- 10.20.193.28:0/1069428885 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb0f404aa30 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.546+0000 7fb1099a1640 1 -- 10.20.193.28:0/1069428885 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10410a5c0 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.547+0000 7fb0f9ffb640 1 -- 10.20.193.28:0/1069428885 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fb0f4040600 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.578+0000 7fb1099a1640 1 -- 10.20.193.28:0/1069428885 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb1041a3ad0 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.578+0000 7fb0f9ffb640 1 -- 10.20.193.28:0/1069428885 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb0f4040920 con 0x7fb10410a140 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.579+0000 7fb1099a1640 1 -- 10.20.193.28:0/1069428885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 msgr2=0x7fb1041a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.579+0000 7fb1099a1640 1 --2- 10.20.193.28:0/1069428885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb1041a0020 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4037cd0 tx=0x7fb0f4037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:05.675 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.579+0000 7fb1099a1640 1 -- 10.20.193.28:0/1069428885 shutdown_connections 2026-02-20T03:11:05.676 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.579+0000 7fb1099a1640 1 --2- 10.20.193.28:0/1069428885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb10410a140 0x7fb1041a0020 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:05.676 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.579+0000 7fb1099a1640 1 -- 10.20.193.28:0/1069428885 >> 10.20.193.28:0/1069428885 conn(0x7fb10407d710 msgr2=0x7fb104107700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:05.676 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.579+0000 7fb1099a1640 1 -- 10.20.193.28:0/1069428885 shutdown_connections 2026-02-20T03:11:05.676 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:05.579+0000 7fb1099a1640 1 -- 10.20.193.28:0/1069428885 wait complete. 2026-02-20T03:11:05.676 INFO:teuthology.orchestra.run.trial028.stdout:mgr not available, waiting (1/15)... 2026-02-20T03:11:05.848 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:05 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/902995060' entity='client.admin' 2026-02-20T03:11:06.100 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:05 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:05.845+0000 7f84231ac140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-20T03:11:06.100 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.044+0000 7f84231ac140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-20T03:11:06.101 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.089+0000 7f84231ac140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-20T03:11:06.431 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.143+0000 7f84231ac140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-20T03:11:06.431 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.185+0000 7f84231ac140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-20T03:11:06.432 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.232+0000 7f84231ac140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-20T03:11:06.432 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.322+0000 7f84231ac140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-20T03:11:06.432 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T03:11:06.432 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T03:11:06.432 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: from numpy import show_config as show_numpy_config 2026-02-20T03:11:06.690 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1069428885' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-20T03:11:06.690 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.434+0000 7f84231ac140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-20T03:11:06.690 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.480+0000 7f84231ac140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-20T03:11:06.690 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.606+0000 7f84231ac140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-20T03:11:06.690 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.687+0000 7f84231ac140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-20T03:11:07.100 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.733+0000 7f84231ac140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-20T03:11:07.101 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.779+0000 7f84231ac140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-20T03:11:07.101 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.828+0000 7f84231ac140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-20T03:11:07.101 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:06.868+0000 7f84231ac140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-20T03:11:07.578 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:07.242+0000 7f84231ac140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-20T03:11:07.578 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:07.369+0000 7f84231ac140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-20T03:11:07.578 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:07.411+0000 7f84231ac140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-20T03:11:07.578 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:07.453+0000 7f84231ac140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-20T03:11:07.579 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:07.575+0000 7f84231ac140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:07.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:07.614+0000 7f84231ac140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-20T03:11:07.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:07.736+0000 7f84231ac140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:07.979 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:07.979 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T03:11:07.979 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:11:07.979 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-20T03:11:07.979 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-20T03:11:07.979 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:07.980 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-20T03:11:07.981 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-20T03:11:02:801427+0000", 2026-02-20T03:11:07.982 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "restful" 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:07.983 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-20T03:11:02.801921+0000", 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.853+0000 7fb273091640 1 Processor -- start 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.853+0000 7fb273091640 1 -- start start 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.853+0000 7fb273091640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.853+0000 7fb273091640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c1087a0 con 0x7fb26c107e60 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.853+0000 7fb27208f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:07.984 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.853+0000 7fb27208f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48054/0 (socket says 10.20.193.28:48054) 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.853+0000 7fb27208f640 1 -- 10.20.193.28:0/1538717857 learned_addr learned my addr 10.20.193.28:0/1538717857 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.854+0000 7fb27208f640 1 -- 10.20.193.28:0/1538717857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c109050 con 0x7fb26c107e60 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.854+0000 7fb27208f640 1 --2- 10.20.193.28:0/1538717857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c108260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009920 tx=0x7fb25c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec125ccba2ceb99c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb27108d640 1 -- 10.20.193.28:0/1538717857 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c03c070 con 0x7fb26c107e60 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb27108d640 1 -- 10.20.193.28:0/1538717857 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fb25c037440 con 0x7fb26c107e60 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb27108d640 1 -- 10.20.193.28:0/1538717857 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c0354b0 con 0x7fb26c107e60 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb273091640 1 -- 10.20.193.28:0/1538717857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 msgr2=0x7fb26c108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb273091640 1 --2- 10.20.193.28:0/1538717857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c108260 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009920 tx=0x7fb25c02ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb273091640 1 -- 10.20.193.28:0/1538717857 shutdown_connections 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb273091640 1 --2- 10.20.193.28:0/1538717857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c108260 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb273091640 1 -- 10.20.193.28:0/1538717857 >> 10.20.193.28:0/1538717857 conn(0x7fb26c103660 msgr2=0x7fb26c105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb273091640 1 -- 10.20.193.28:0/1538717857 shutdown_connections 2026-02-20T03:11:07.985 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.855+0000 7fb273091640 1 -- 10.20.193.28:0/1538717857 wait complete. 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.856+0000 7fb273091640 1 Processor -- start 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.856+0000 7fb273091640 1 -- start start 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.856+0000 7fb273091640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c19ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.856+0000 7fb273091640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c108920 con 0x7fb26c107e60 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb27208f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c19ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb27208f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c19ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48068/0 (socket says 10.20.193.28:48068) 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb27208f640 1 -- 10.20.193.28:0/3852752149 learned_addr learned my addr 10.20.193.28:0/3852752149 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb27208f640 1 -- 10.20.193.28:0/3852752149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c1a0510 con 0x7fb26c107e60 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb27208f640 1 --2- 10.20.193.28:0/3852752149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c19ffd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb25c037cd0 tx=0x7fb25c037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb2537fe640 1 -- 10.20.193.28:0/3852752149 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c045070 con 0x7fb26c107e60 2026-02-20T03:11:07.986 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb2537fe640 1 -- 10.20.193.28:0/3852752149 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fb25c040450 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb2537fe640 1 -- 10.20.193.28:0/3852752149 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb25c03c070 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb273091640 1 -- 10.20.193.28:0/3852752149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26c1a07a0 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.857+0000 7fb273091640 1 -- 10.20.193.28:0/3852752149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb26c1a3490 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.858+0000 7fb2537fe640 1 -- 10.20.193.28:0/3852752149 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fb25c040920 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.858+0000 7fb2537fe640 1 -- 10.20.193.28:0/3852752149 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb25c03ea10 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.858+0000 7fb2517fa640 1 -- 10.20.193.28:0/3852752149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26c1082e0 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.859+0000 7fb2537fe640 1 -- 10.20.193.28:0/3852752149 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fb25c040600 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.890+0000 7fb2517fa640 1 -- 10.20.193.28:0/3852752149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb26c063880 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.890+0000 7fb2537fe640 1 -- 10.20.193.28:0/3852752149 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb25c035aa0 con 0x7fb26c107e60 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.890+0000 7fb2517fa640 1 -- 10.20.193.28:0/3852752149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 msgr2=0x7fb26c19ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.890+0000 7fb2517fa640 1 --2- 10.20.193.28:0/3852752149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c19ffd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb25c037cd0 tx=0x7fb25c037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.891+0000 7fb2517fa640 1 -- 10.20.193.28:0/3852752149 shutdown_connections 2026-02-20T03:11:07.987 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.891+0000 7fb2517fa640 1 --2- 10.20.193.28:0/3852752149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb26c107e60 0x7fb26c19ffd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:07.988 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.891+0000 7fb2517fa640 1 -- 10.20.193.28:0/3852752149 >> 10.20.193.28:0/3852752149 conn(0x7fb26c103660 msgr2=0x7fb26c1041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:07.988 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.891+0000 7fb2517fa640 1 -- 10.20.193.28:0/3852752149 shutdown_connections 2026-02-20T03:11:07.988 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:07.891+0000 7fb2517fa640 1 -- 10.20.193.28:0/3852752149 wait complete. 2026-02-20T03:11:07.988 INFO:teuthology.orchestra.run.trial028.stdout:mgr not available, waiting (2/15)... 2026-02-20T03:11:08.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:07 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3852752149' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-20T03:11:08.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:08 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:08.380+0000 7f84231ac140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-20T03:11:08.851 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:08 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:08.421+0000 7f84231ac140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-20T03:11:09.351 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:09 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:09.005+0000 7f84231ac140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-20T03:11:09.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: Activating manager daemon x 2026-02-20T03:11:09.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: mgrmap e2: x(active, starting, since 0.00355168s) 2026-02-20T03:11:09.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T03:11:09.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T03:11:09.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T03:11:09.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:09.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-02-20T03:11:09.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: Manager daemon x is now available 2026-02-20T03:11:09.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2026-02-20T03:11:09.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2026-02-20T03:11:09.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' 2026-02-20T03:11:09.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' 2026-02-20T03:11:09.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:09 trial028 ceph-mon[38552]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' 2026-02-20T03:11:10.361 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "health": { 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 0 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "a" 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:10.362 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-20T03:11:10.363 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "btime": "2026-02-20T03:11:02:801427+0000", 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "restful" 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ], 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "modified": "2026-02-20T03:11:02.801921+0000", 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout }, 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-20T03:11:10.364 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.149+0000 7fb4fb0a5640 1 Processor -- start 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.150+0000 7fb4fb0a5640 1 -- start start 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.150+0000 7fb4fb0a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f410a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.150+0000 7fb4fb0a5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f410ace0 con 0x7fb4f410a310 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.150+0000 7fb4f8e1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f410a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.150+0000 7fb4f8e1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f410a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48150/0 (socket says 10.20.193.28:48150) 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.150+0000 7fb4f8e1a640 1 -- 10.20.193.28:0/144187645 learned_addr learned my addr 10.20.193.28:0/144187645 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.150+0000 7fb4f8e1a640 1 -- 10.20.193.28:0/144187645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f410b510 con 0x7fb4f410a310 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4f8e1a640 1 --2- 10.20.193.28:0/144187645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f410a710 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009920 tx=0x7fb4e402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad67cff83f84421 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4eb7fe640 1 -- 10.20.193.28:0/144187645 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4e403c070 con 0x7fb4f410a310 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4eb7fe640 1 -- 10.20.193.28:0/144187645 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fb4e4037440 con 0x7fb4f410a310 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4eb7fe640 1 -- 10.20.193.28:0/144187645 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4e40354b0 con 0x7fb4f410a310 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/144187645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 msgr2=0x7fb4f410a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4fb0a5640 1 --2- 10.20.193.28:0/144187645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f410a710 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009920 tx=0x7fb4e402ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/144187645 shutdown_connections 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4fb0a5640 1 --2- 10.20.193.28:0/144187645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f410a710 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/144187645 >> 10.20.193.28:0/144187645 conn(0x7fb4f407d840 msgr2=0x7fb4f407dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/144187645 shutdown_connections 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.151+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/144187645 wait complete. 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.152+0000 7fb4fb0a5640 1 Processor -- start 2026-02-20T03:11:10.365 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.152+0000 7fb4fb0a5640 1 -- start start 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.152+0000 7fb4fb0a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f41a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.152+0000 7fb4fb0a5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f410e740 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.153+0000 7fb4f8e1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f41a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.153+0000 7fb4f8e1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f41a01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48156/0 (socket says 10.20.193.28:48156) 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.153+0000 7fb4f8e1a640 1 -- 10.20.193.28:0/383844365 learned_addr learned my addr 10.20.193.28:0/383844365 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.153+0000 7fb4f8e1a640 1 -- 10.20.193.28:0/383844365 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f41a0700 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.153+0000 7fb4f8e1a640 1 --2- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f41a01c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4037cd0 tx=0x7fb4e4037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.153+0000 7fb4e9ffb640 1 -- 10.20.193.28:0/383844365 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4e4045070 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.153+0000 7fb4e9ffb640 1 -- 10.20.193.28:0/383844365 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fb4e4040450 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.153+0000 7fb4e9ffb640 1 -- 10.20.193.28:0/383844365 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4e403c070 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.154+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f41a0990 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.154+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f41a3680 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.154+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f410a790 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.154+0000 7fb4e9ffb640 1 -- 10.20.193.28:0/383844365 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 3) ==== 50130+0+0 (secure 0 0 0) 0x7fb4e4040920 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.156+0000 7fb4e9ffb640 1 --2- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fb4d003da80 0x7fb4d003ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.156+0000 7fb4e9ffb640 1 -- 10.20.193.28:0/383844365 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb4e4076390 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.156+0000 7fb4ebfff640 1 --2- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fb4d003da80 0x7fb4d003ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.157+0000 7fb4ebfff640 1 --2- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fb4d003da80 0x7fb4d003ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0099c0 tx=0x7fb4dc006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.159+0000 7fb4e9ffb640 1 -- 10.20.193.28:0/383844365 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb4e4033200 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.280+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb4f41a3850 con 0x7fb4f410a310 2026-02-20T03:11:10.366 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.280+0000 7fb4e9ffb640 1 -- 10.20.193.28:0/383844365 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fb4e4035e20 con 0x7fb4f410a310 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.281+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fb4d003da80 msgr2=0x7fb4d003ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.281+0000 7fb4fb0a5640 1 --2- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fb4d003da80 0x7fb4d003ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc0099c0 tx=0x7fb4dc006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.281+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 msgr2=0x7fb4f41a01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.281+0000 7fb4fb0a5640 1 --2- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f41a01c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4037cd0 tx=0x7fb4e4037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.281+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 shutdown_connections 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.281+0000 7fb4fb0a5640 1 --2- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fb4d003da80 0x7fb4d003ff40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.281+0000 7fb4fb0a5640 1 --2- 10.20.193.28:0/383844365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb4f410a310 0x7fb4f41a01c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.281+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 >> 10.20.193.28:0/383844365 conn(0x7fb4f407d840 msgr2=0x7fb4f410c730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.282+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 shutdown_connections 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.282+0000 7fb4fb0a5640 1 -- 10.20.193.28:0/383844365 wait complete. 2026-02-20T03:11:10.367 INFO:teuthology.orchestra.run.trial028.stdout:mgr is available 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [global] 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout fsid = bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.28:3300,v1:10.20.193.28:6789] 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout [osd] 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.537+0000 7efe1aecc640 1 Processor -- start 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.537+0000 7efe1aecc640 1 -- start start 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.538+0000 7efe1aecc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe1410a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.538+0000 7efe1aecc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe1410ab10 con 0x7efe1410a140 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.538+0000 7efe19eca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe1410a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.538+0000 7efe19eca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe1410a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48172/0 (socket says 10.20.193.28:48172) 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.538+0000 7efe19eca640 1 -- 10.20.193.28:0/800768204 learned_addr learned my addr 10.20.193.28:0/800768204 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.538+0000 7efe19eca640 1 -- 10.20.193.28:0/800768204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1410b340 con 0x7efe1410a140 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.539+0000 7efe19eca640 1 --2- 10.20.193.28:0/800768204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe1410a540 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efe04009920 tx=0x7efe0402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af750355989f3df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.539+0000 7efe18ec8640 1 -- 10.20.193.28:0/800768204 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe0403c070 con 0x7efe1410a140 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.539+0000 7efe18ec8640 1 -- 10.20.193.28:0/800768204 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7efe04037440 con 0x7efe1410a140 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.539+0000 7efe18ec8640 1 -- 10.20.193.28:0/800768204 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe040354b0 con 0x7efe1410a140 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.539+0000 7efe1aecc640 1 -- 10.20.193.28:0/800768204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 msgr2=0x7efe1410a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.539+0000 7efe1aecc640 1 --2- 10.20.193.28:0/800768204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe1410a540 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efe04009920 tx=0x7efe0402ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.539+0000 7efe1aecc640 1 -- 10.20.193.28:0/800768204 shutdown_connections 2026-02-20T03:11:10.714 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.539+0000 7efe1aecc640 1 --2- 10.20.193.28:0/800768204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe1410a540 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.539+0000 7efe1aecc640 1 -- 10.20.193.28:0/800768204 >> 10.20.193.28:0/800768204 conn(0x7efe1407d710 msgr2=0x7efe1407db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.540+0000 7efe1aecc640 1 -- 10.20.193.28:0/800768204 shutdown_connections 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.540+0000 7efe1aecc640 1 -- 10.20.193.28:0/800768204 wait complete. 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.540+0000 7efe1aecc640 1 Processor -- start 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.540+0000 7efe1aecc640 1 -- start start 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.541+0000 7efe1aecc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe141a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.541+0000 7efe1aecc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe1410e570 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.541+0000 7efe19eca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe141a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.541+0000 7efe19eca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe141a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48174/0 (socket says 10.20.193.28:48174) 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.541+0000 7efe19eca640 1 -- 10.20.193.28:0/405333609 learned_addr learned my addr 10.20.193.28:0/405333609 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.541+0000 7efe19eca640 1 -- 10.20.193.28:0/405333609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe141a0560 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.541+0000 7efe19eca640 1 --2- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe141a0020 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efe04037cd0 tx=0x7efe04037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.541+0000 7efe02ffd640 1 -- 10.20.193.28:0/405333609 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe04045070 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.542+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe141a07f0 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.542+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe141a34e0 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.542+0000 7efe02ffd640 1 -- 10.20.193.28:0/405333609 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7efe04040450 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.542+0000 7efe02ffd640 1 -- 10.20.193.28:0/405333609 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe0403c070 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.542+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1410a5c0 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.543+0000 7efe02ffd640 1 -- 10.20.193.28:0/405333609 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 3) ==== 50130+0+0 (secure 0 0 0) 0x7efe04040920 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.543+0000 7efe02ffd640 1 --2- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7efdf003da80 0x7efdf003ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.543+0000 7efe02ffd640 1 -- 10.20.193.28:0/405333609 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efe040762a0 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.544+0000 7efe196c9640 1 --2- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7efdf003da80 0x7efdf003ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.544+0000 7efe196c9640 1 --2- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7efdf003da80 0x7efdf003ff40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe080099c0 tx=0x7efe08006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.546+0000 7efe02ffd640 1 -- 10.20.193.28:0/405333609 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7efe04033200 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.637+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7efe141a4ce0 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.638+0000 7efe02ffd640 1 -- 10.20.193.28:0/405333609 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+465 (secure 0 0 0) 0x7efe04035e20 con 0x7efe1410a140 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7efdf003da80 msgr2=0x7efdf003ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 --2- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7efdf003da80 0x7efdf003ff40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efe080099c0 tx=0x7efe08006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 msgr2=0x7efe141a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 --2- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe141a0020 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efe04037cd0 tx=0x7efe04037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 shutdown_connections 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 --2- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7efdf003da80 0x7efdf003ff40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 --2- 10.20.193.28:0/405333609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe1410a140 0x7efe141a0020 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 >> 10.20.193.28:0/405333609 conn(0x7efe1407d710 msgr2=0x7efe14107700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 shutdown_connections 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.639+0000 7efe1aecc640 1 -- 10.20.193.28:0/405333609 wait complete. 2026-02-20T03:11:10.715 INFO:teuthology.orchestra.run.trial028.stdout:Enabling cephadm module... 2026-02-20T03:11:11.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:11 trial028 ceph-mon[38552]: mgrmap e3: x(active, since 1.00669s) 2026-02-20T03:11:11.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:11 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/383844365' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-20T03:11:11.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:11 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/405333609' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-20T03:11:11.056 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:11 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1193932212' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-20T03:11:11.094 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.880+0000 7ff04b577640 1 Processor -- start 2026-02-20T03:11:11.094 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.880+0000 7ff04b577640 1 -- start start 2026-02-20T03:11:11.094 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.881+0000 7ff04b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c07c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:11.094 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.881+0000 7ff04b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c07c8c0 con 0x7ff04c07df20 2026-02-20T03:11:11.094 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.881+0000 7ff04a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c07c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:11.094 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.881+0000 7ff04a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c07c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48182/0 (socket says 10.20.193.28:48182) 2026-02-20T03:11:11.094 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.881+0000 7ff04a575640 1 -- 10.20.193.28:0/2956883528 learned_addr learned my addr 10.20.193.28:0/2956883528 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.881+0000 7ff04a575640 1 -- 10.20.193.28:0/2956883528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c07ca40 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.882+0000 7ff04a575640 1 --2- 10.20.193.28:0/2956883528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c07c380 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff040009920 tx=0x7ff04002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda287e87c8b1902 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.882+0000 7ff049573640 1 -- 10.20.193.28:0/2956883528 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04003c070 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.882+0000 7ff049573640 1 -- 10.20.193.28:0/2956883528 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7ff040037440 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.882+0000 7ff049573640 1 -- 10.20.193.28:0/2956883528 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0400354b0 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.882+0000 7ff04b577640 1 -- 10.20.193.28:0/2956883528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 msgr2=0x7ff04c07c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.882+0000 7ff04b577640 1 --2- 10.20.193.28:0/2956883528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c07c380 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff040009920 tx=0x7ff04002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.883+0000 7ff04b577640 1 -- 10.20.193.28:0/2956883528 shutdown_connections 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.883+0000 7ff04b577640 1 --2- 10.20.193.28:0/2956883528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c07c380 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.883+0000 7ff04b577640 1 -- 10.20.193.28:0/2956883528 >> 10.20.193.28:0/2956883528 conn(0x7ff04c103660 msgr2=0x7ff04c105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.883+0000 7ff04b577640 1 -- 10.20.193.28:0/2956883528 shutdown_connections 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.883+0000 7ff04b577640 1 -- 10.20.193.28:0/2956883528 wait complete. 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.883+0000 7ff04b577640 1 Processor -- start 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.884+0000 7ff04b577640 1 -- start start 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.884+0000 7ff04b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c1a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.884+0000 7ff04b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c109ed0 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.884+0000 7ff04a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c1a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.884+0000 7ff04a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c1a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48198/0 (socket says 10.20.193.28:48198) 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.884+0000 7ff04a575640 1 -- 10.20.193.28:0/1193932212 learned_addr learned my addr 10.20.193.28:0/1193932212 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.884+0000 7ff04a575640 1 -- 10.20.193.28:0/1193932212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c1a4a10 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.884+0000 7ff04a575640 1 --2- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c1a44d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff040009a50 tx=0x7ff040037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.885+0000 7ff0337fe640 1 -- 10.20.193.28:0/1193932212 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff040045070 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.885+0000 7ff0337fe640 1 -- 10.20.193.28:0/1193932212 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7ff040040450 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.885+0000 7ff0337fe640 1 -- 10.20.193.28:0/1193932212 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff04003c070 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.885+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04c1a4ca0 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.885+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04c1a7990 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.885+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff04c07c400 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.886+0000 7ff0337fe640 1 -- 10.20.193.28:0/1193932212 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 3) ==== 50130+0+0 (secure 0 0 0) 0x7ff040040900 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.886+0000 7ff0337fe640 1 --2- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7ff02403da80 0x7ff02403ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.886+0000 7ff0337fe640 1 -- 10.20.193.28:0/1193932212 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff040076410 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.887+0000 7ff049d74640 1 --2- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7ff02403da80 0x7ff02403ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.887+0000 7ff049d74640 1 --2- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7ff02403da80 0x7ff02403ff40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0340099c0 tx=0x7ff034006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:10.889+0000 7ff0337fe640 1 -- 10.20.193.28:0/1193932212 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff040035aa0 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.001+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7ff04c19d9d0 con 0x7ff04c07df20 2026-02-20T03:11:11.095 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.015+0000 7ff0337fe640 1 -- 10.20.193.28:0/1193932212 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v4) ==== 86+0+0 (secure 0 0 0) 0x7ff040045210 con 0x7ff04c07df20 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.016+0000 7ff0337fe640 1 -- 10.20.193.28:0/1193932212 <== mon.0 v2:10.20.193.28:3300/0 8 ==== mgrmap(e 4) ==== 50247+0+0 (secure 0 0 0) 0x7ff04004ab80 con 0x7ff04c07df20 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7ff02403da80 msgr2=0x7ff02403ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 --2- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7ff02403da80 0x7ff02403ff40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0340099c0 tx=0x7ff034006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 msgr2=0x7ff04c1a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 --2- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c1a44d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff040009a50 tx=0x7ff040037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 shutdown_connections 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 --2- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7ff02403da80 0x7ff02403ff40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 --2- 10.20.193.28:0/1193932212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff04c07df20 0x7ff04c1a44d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 >> 10.20.193.28:0/1193932212 conn(0x7ff04c103660 msgr2=0x7ff04c109170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 shutdown_connections 2026-02-20T03:11:11.096 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.017+0000 7ff04b577640 1 -- 10.20.193.28:0/1193932212 wait complete. 2026-02-20T03:11:11.350 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: ignoring --setuser ceph since I am not root 2026-02-20T03:11:11.350 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: ignoring --setgroup ceph since I am not root 2026-02-20T03:11:11.509 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T03:11:11.509 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 4, 2026-02-20T03:11:11.509 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-20T03:11:11.509 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.267+0000 7fe087fff640 1 Processor -- start 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.267+0000 7fe087fff640 1 -- start start 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.268+0000 7fe087fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08810a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.268+0000 7fe087fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe08810ab10 con 0x7fe08810a140 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.268+0000 7fe086ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08810a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.268+0000 7fe086ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08810a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48228/0 (socket says 10.20.193.28:48228) 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.268+0000 7fe086ffd640 1 -- 10.20.193.28:0/3296191616 learned_addr learned my addr 10.20.193.28:0/3296191616 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.268+0000 7fe086ffd640 1 -- 10.20.193.28:0/3296191616 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08810b340 con 0x7fe08810a140 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.269+0000 7fe086ffd640 1 --2- 10.20.193.28:0/3296191616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08810a540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009920 tx=0x7fe07c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3806efaabea68533 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.269+0000 7fe085ffb640 1 -- 10.20.193.28:0/3296191616 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe07c03c070 con 0x7fe08810a140 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.269+0000 7fe085ffb640 1 -- 10.20.193.28:0/3296191616 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fe07c037440 con 0x7fe08810a140 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.269+0000 7fe087fff640 1 -- 10.20.193.28:0/3296191616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 msgr2=0x7fe08810a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.269+0000 7fe087fff640 1 --2- 10.20.193.28:0/3296191616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08810a540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009920 tx=0x7fe07c02ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:11.510 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.270+0000 7fe087fff640 1 -- 10.20.193.28:0/3296191616 shutdown_connections 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.270+0000 7fe087fff640 1 --2- 10.20.193.28:0/3296191616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08810a540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.270+0000 7fe087fff640 1 -- 10.20.193.28:0/3296191616 >> 10.20.193.28:0/3296191616 conn(0x7fe08807d710 msgr2=0x7fe08807db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.270+0000 7fe087fff640 1 -- 10.20.193.28:0/3296191616 shutdown_connections 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.270+0000 7fe087fff640 1 -- 10.20.193.28:0/3296191616 wait complete. 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.270+0000 7fe087fff640 1 Processor -- start 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.270+0000 7fe087fff640 1 -- start start 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.270+0000 7fe087fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08819ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe087fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe08810e570 con 0x7fe08810a140 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe086ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08819ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe086ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08819ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48238/0 (socket says 10.20.193.28:48238) 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe086ffd640 1 -- 10.20.193.28:0/3677756234 learned_addr learned my addr 10.20.193.28:0/3677756234 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe086ffd640 1 -- 10.20.193.28:0/3677756234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0881a0480 con 0x7fe08810a140 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe086ffd640 1 --2- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08819ff40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe07c006fd0 tx=0x7fe07c035760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe08ca20640 1 -- 10.20.193.28:0/3677756234 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe07c03c070 con 0x7fe08810a140 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe08ca20640 1 -- 10.20.193.28:0/3677756234 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fe07c044070 con 0x7fe08810a140 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe08ca20640 1 -- 10.20.193.28:0/3677756234 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe07c0363a0 con 0x7fe08810a140 2026-02-20T03:11:11.511 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe087fff640 1 -- 10.20.193.28:0/3677756234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0881a0710 con 0x7fe08810a140 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.271+0000 7fe087fff640 1 -- 10.20.193.28:0/3677756234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0881a3400 con 0x7fe08810a140 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.272+0000 7fe0667fc640 1 -- 10.20.193.28:0/3677756234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08810a540 con 0x7fe08810a140 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.273+0000 7fe08ca20640 1 -- 10.20.193.28:0/3677756234 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 4) ==== 50247+0+0 (secure 0 0 0) 0x7fe07c051080 con 0x7fe08810a140 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.273+0000 7fe08ca20640 1 --2- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fe05c03dbf0 0x7fe05c0400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.273+0000 7fe08ca20640 1 -- 10.20.193.28:0/3677756234 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe07c076520 con 0x7fe08810a140 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.273+0000 7fe0867fc640 1 -- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fe05c03dbf0 msgr2=0x7fe05c0400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/1032320093 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.273+0000 7fe0867fc640 1 --2- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fe05c03dbf0 0x7fe05c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.276+0000 7fe08ca20640 1 -- 10.20.193.28:0/3677756234 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe07c03f820 con 0x7fe08810a140 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.388+0000 7fe0667fc640 1 -- 10.20.193.28:0/3677756234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe088063880 con 0x7fe08810a140 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.389+0000 7fe08ca20640 1 -- 10.20.193.28:0/3677756234 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v4) ==== 56+0+88 (secure 0 0 0) 0x7fe07c075320 con 0x7fe08810a140 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 -- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fe05c03dbf0 msgr2=0x7fe05c0400b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 --2- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fe05c03dbf0 0x7fe05c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 -- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 msgr2=0x7fe08819ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 --2- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08819ff40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe07c006fd0 tx=0x7fe07c035760 comp rx=0 tx=0).stop 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 -- 10.20.193.28:0/3677756234 shutdown_connections 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 --2- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7fe05c03dbf0 0x7fe05c0400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 --2- 10.20.193.28:0/3677756234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810a140 0x7fe08819ff40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:11.512 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 -- 10.20.193.28:0/3677756234 >> 10.20.193.28:0/3677756234 conn(0x7fe08807d710 msgr2=0x7fe088107660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:11.513 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 -- 10.20.193.28:0/3677756234 shutdown_connections 2026-02-20T03:11:11.513 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.390+0000 7fe0667fc640 1 -- 10.20.193.28:0/3677756234 wait complete. 2026-02-20T03:11:11.513 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for the mgr to restart... 2026-02-20T03:11:11.513 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr epoch 4... 2026-02-20T03:11:11.674 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:11.621+0000 7f3ad4765140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-20T03:11:11.924 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:11.824+0000 7f3ad4765140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-20T03:11:11.924 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:11.868+0000 7f3ad4765140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-20T03:11:11.924 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:11.922+0000 7f3ad4765140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-20T03:11:12.207 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:12 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1193932212' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-20T03:11:12.207 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:12 trial028 ceph-mon[38552]: mgrmap e4: x(active, since 2s) 2026-02-20T03:11:12.208 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:12 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3677756234' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-20T03:11:12.208 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:11.964+0000 7f3ad4765140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-20T03:11:12.208 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.011+0000 7f3ad4765140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-20T03:11:12.208 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.101+0000 7f3ad4765140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-20T03:11:12.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T03:11:12.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T03:11:12.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: from numpy import show_config as show_numpy_config 2026-02-20T03:11:12.469 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.211+0000 7f3ad4765140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-20T03:11:12.469 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.258+0000 7f3ad4765140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-20T03:11:12.469 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.385+0000 7f3ad4765140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-20T03:11:12.469 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.466+0000 7f3ad4765140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-20T03:11:12.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.513+0000 7f3ad4765140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-20T03:11:12.851 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.558+0000 7f3ad4765140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-20T03:11:12.851 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.607+0000 7f3ad4765140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-20T03:11:12.851 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.649+0000 7f3ad4765140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-20T03:11:13.335 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:12.999+0000 7f3ad4765140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-20T03:11:13.335 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:13.127+0000 7f3ad4765140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-20T03:11:13.335 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:13.169+0000 7f3ad4765140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-20T03:11:13.335 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:13.211+0000 7f3ad4765140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-20T03:11:13.336 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:13.334+0000 7f3ad4765140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:13.600 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:13.374+0000 7f3ad4765140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-20T03:11:13.601 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:13.496+0000 7f3ad4765140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:14.600 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:14.128+0000 7f3ad4765140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-20T03:11:14.601 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:14.167+0000 7f3ad4765140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-20T03:11:15.101 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:14.747+0000 7f3ad4765140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-20T03:11:15.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: Active manager daemon x restarted 2026-02-20T03:11:15.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: Activating manager daemon x 2026-02-20T03:11:15.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: osdmap e2: 0 total, 0 up, 0 in 2026-02-20T03:11:15.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: mgrmap e5: x(active, starting, since 0.00298016s) 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: Manager daemon x is now available 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2026-02-20T03:11:15.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:14 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 6, 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.672+0000 7f8a46af6640 1 Processor -- start 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.672+0000 7f8a46af6640 1 -- start start 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.672+0000 7f8a46af6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a40106100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.672+0000 7f8a46af6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401066d0 con 0x7f8a40105d00 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.672+0000 7f8a45af4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a40106100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.672+0000 7f8a45af4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a40106100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48248/0 (socket says 10.20.193.28:48248) 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.672+0000 7f8a45af4640 1 -- 10.20.193.28:0/2152279374 learned_addr learned my addr 10.20.193.28:0/2152279374 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.673+0000 7f8a45af4640 1 -- 10.20.193.28:0/2152279374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a40106e90 con 0x7f8a40105d00 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a45af4640 1 --2- 10.20.193.28:0/2152279374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a40106100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009920 tx=0x7f8a3002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa664bceba60a9d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a44af2640 1 -- 10.20.193.28:0/2152279374 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3003c070 con 0x7f8a40105d00 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a44af2640 1 -- 10.20.193.28:0/2152279374 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f8a30037440 con 0x7f8a40105d00 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a44af2640 1 -- 10.20.193.28:0/2152279374 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a300354b0 con 0x7f8a40105d00 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a46af6640 1 -- 10.20.193.28:0/2152279374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 msgr2=0x7f8a40106100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a46af6640 1 --2- 10.20.193.28:0/2152279374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a40106100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009920 tx=0x7f8a3002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a46af6640 1 -- 10.20.193.28:0/2152279374 shutdown_connections 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a46af6640 1 --2- 10.20.193.28:0/2152279374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a40106100 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a46af6640 1 -- 10.20.193.28:0/2152279374 >> 10.20.193.28:0/2152279374 conn(0x7f8a401018e0 msgr2=0x7f8a40103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.674+0000 7f8a46af6640 1 -- 10.20.193.28:0/2152279374 shutdown_connections 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.675+0000 7f8a46af6640 1 -- 10.20.193.28:0/2152279374 wait complete. 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.675+0000 7f8a46af6640 1 Processor -- start 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.675+0000 7f8a46af6640 1 -- start start 2026-02-20T03:11:15.837 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.676+0000 7f8a46af6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a401a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.676+0000 7f8a46af6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a401080d0 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.676+0000 7f8a45af4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a401a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.676+0000 7f8a45af4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a401a0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48262/0 (socket says 10.20.193.28:48262) 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.676+0000 7f8a45af4640 1 -- 10.20.193.28:0/1097180735 learned_addr learned my addr 10.20.193.28:0/1097180735 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.676+0000 7f8a45af4640 1 -- 10.20.193.28:0/1097180735 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a401a0580 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.676+0000 7f8a45af4640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a401a0040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8a30037cd0 tx=0x7f8a30037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.677+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a30045070 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.677+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f8a30040450 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.677+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a3003c070 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.677+0000 7f8a46af6640 1 -- 10.20.193.28:0/1097180735 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a401a0810 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.677+0000 7f8a46af6640 1 -- 10.20.193.28:0/1097180735 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a401a3500 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.678+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 4) ==== 50247+0+0 (secure 0 0 0) 0x7f8a30040920 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.678+0000 7f8a2effd640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 0x7f8a1c0400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.678+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 --> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a1c0407c0 con 0x7f8a1c03dbf0 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.678+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a300765a0 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.678+0000 7f8a452f3640 1 -- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 msgr2=0x7f8a1c0400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/1032320093 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.678+0000 7f8a452f3640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 0x7f8a1c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.880+0000 7f8a452f3640 1 -- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 msgr2=0x7f8a1c0400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/1032320093 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:11.880+0000 7f8a452f3640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 0x7f8a1c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:12.281+0000 7f8a452f3640 1 -- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 msgr2=0x7f8a1c0400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/1032320093 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:12.281+0000 7f8a452f3640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 0x7f8a1c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:13.082+0000 7f8a452f3640 1 -- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 msgr2=0x7f8a1c0400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/1032320093 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:13.082+0000 7f8a452f3640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 0x7f8a1c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:14.682+0000 7f8a452f3640 1 -- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 msgr2=0x7f8a1c0400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/1032320093 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:14.682+0000 7f8a452f3640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 0x7f8a1c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:14.751+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mgrmap(e 5) ==== 50014+0+0 (secure 0 0 0) 0x7f8a3003e5f0 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:14.751+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 msgr2=0x7f8a1c0400b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:14.751+0000 7f8a2effd640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 0x7f8a1c0400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.752+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 6) ==== 50141+0+0 (secure 0 0 0) 0x7f8a30078240 con 0x7f8a40105d00 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.752+0000 7f8a2effd640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8a1c041540 0x7f8a1c043930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.752+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a30031e50 con 0x7f8a1c041540 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.753+0000 7f8a452f3640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8a1c041540 0x7f8a1c043930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.754+0000 7f8a452f3640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8a1c041540 0x7f8a1c043930 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8a34003a80 tx=0x7f8a340092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.754+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 <== mgr.14118 v2:10.20.193.28:6800/732750991 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f8a30031e50 con 0x7f8a1c041540 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 -- 10.20.193.28:0/1097180735 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f8a40106100 con 0x7f8a1c041540 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a2effd640 1 -- 10.20.193.28:0/1097180735 <== mgr.14118 v2:10.20.193.28:6800/732750991 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f8a40106100 con 0x7f8a1c041540 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 -- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8a1c041540 msgr2=0x7f8a1c043930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8a1c041540 0x7f8a1c043930 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f8a34003a80 tx=0x7f8a340092b0 comp rx=0 tx=0).stop 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 -- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 msgr2=0x7f8a401a0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a401a0040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8a30037cd0 tx=0x7f8a30037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 -- 10.20.193.28:0/1097180735 shutdown_connections 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8a1c041540 0x7f8a1c043930 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:15.838 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:6800/1032320093,v1:10.20.193.28:6801/1032320093] conn(0x7f8a1c03dbf0 0x7f8a1c0400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:15.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 --2- 10.20.193.28:0/1097180735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a40105d00 0x7f8a401a0040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:15.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 -- 10.20.193.28:0/1097180735 >> 10.20.193.28:0/1097180735 conn(0x7f8a401018e0 msgr2=0x7f8a40196770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:15.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 -- 10.20.193.28:0/1097180735 shutdown_connections 2026-02-20T03:11:15.839 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:15.758+0000 7f8a46af6640 1 -- 10.20.193.28:0/1097180735 wait complete. 2026-02-20T03:11:15.839 INFO:teuthology.orchestra.run.trial028.stdout:mgr epoch 4 is available 2026-02-20T03:11:15.839 INFO:teuthology.orchestra.run.trial028.stdout:Setting orchestrator backend to cephadm... 2026-02-20T03:11:16.006 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:15 trial028 ceph-mon[38552]: Found migration_current of "None". Setting to last migration. 2026-02-20T03:11:16.006 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:15 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:16.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:15 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:16.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:15 trial028 ceph-mon[38552]: mgrmap e6: x(active, since 1.00418s) 2026-02-20T03:11:16.194 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.004+0000 7f4704a7d640 1 Processor -- start 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.004+0000 7f4704a7d640 1 -- start start 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.004+0000 7f4704a7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f47001082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.004+0000 7f4704a7d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4700108820 con 0x7f4700107ee0 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.004+0000 7f46fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f47001082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.004+0000 7f46fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f47001082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34632/0 (socket says 10.20.193.28:34632) 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.004+0000 7f46fed76640 1 -- 10.20.193.28:0/135706595 learned_addr learned my addr 10.20.193.28:0/135706595 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.005+0000 7f46fed76640 1 -- 10.20.193.28:0/135706595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4700109080 con 0x7f4700107ee0 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.005+0000 7f46fed76640 1 --2- 10.20.193.28:0/135706595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f47001082e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009920 tx=0x7f46f402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf5df7d90712851 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f46fdd74640 1 -- 10.20.193.28:0/135706595 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46f403c070 con 0x7f4700107ee0 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f46fdd74640 1 -- 10.20.193.28:0/135706595 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f46f4037440 con 0x7f4700107ee0 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f46fdd74640 1 -- 10.20.193.28:0/135706595 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46f40354b0 con 0x7f4700107ee0 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f4704a7d640 1 -- 10.20.193.28:0/135706595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 msgr2=0x7f47001082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f4704a7d640 1 --2- 10.20.193.28:0/135706595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f47001082e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009920 tx=0x7f46f402ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f4704a7d640 1 -- 10.20.193.28:0/135706595 shutdown_connections 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f4704a7d640 1 --2- 10.20.193.28:0/135706595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f47001082e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f4704a7d640 1 -- 10.20.193.28:0/135706595 >> 10.20.193.28:0/135706595 conn(0x7f4700103700 msgr2=0x7f4700105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f4704a7d640 1 -- 10.20.193.28:0/135706595 shutdown_connections 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.006+0000 7f4704a7d640 1 -- 10.20.193.28:0/135706595 wait complete. 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.007+0000 7f4704a7d640 1 Processor -- start 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.007+0000 7f4704a7d640 1 -- start start 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.007+0000 7f4704a7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f4700196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.007+0000 7f4704a7d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47001089a0 con 0x7f4700107ee0 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.007+0000 7f46fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f4700196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.007+0000 7f46fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f4700196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34642/0 (socket says 10.20.193.28:34642) 2026-02-20T03:11:16.195 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.007+0000 7f46fed76640 1 -- 10.20.193.28:0/1979672749 learned_addr learned my addr 10.20.193.28:0/1979672749 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.008+0000 7f46fed76640 1 -- 10.20.193.28:0/1979672749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4700197250 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.008+0000 7f46fed76640 1 --2- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f4700196d10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46f4037cd0 tx=0x7f46f4037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.008+0000 7f46dffff640 1 -- 10.20.193.28:0/1979672749 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46f4045070 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.008+0000 7f46dffff640 1 -- 10.20.193.28:0/1979672749 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f46f4040450 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.008+0000 7f46dffff640 1 -- 10.20.193.28:0/1979672749 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46f403c070 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.008+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47001974e0 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.008+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4700193850 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.009+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4700108360 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.009+0000 7f46dffff640 1 -- 10.20.193.28:0/1979672749 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 6) ==== 50141+0+0 (secure 0 0 0) 0x7f46f4040920 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.009+0000 7f46dffff640 1 --2- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f46d403dad0 0x7f46d403ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.009+0000 7f46dffff640 1 -- 10.20.193.28:0/1979672749 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f46f4076460 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.010+0000 7f46fe575640 1 --2- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f46d403dad0 0x7f46d403ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.010+0000 7f46fe575640 1 --2- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f46d403dad0 0x7f46d403ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46e80099c0 tx=0x7f46e8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.012+0000 7f46dffff640 1 -- 10.20.193.28:0/1979672749 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f46f4033200 con 0x7f4700107ee0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.110+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f47001942a0 con 0x7f46d403dad0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.115+0000 7f46dffff640 1 -- 10.20.193.28:0/1979672749 <== mgr.14118 v2:10.20.193.28:6800/732750991 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f47001942a0 con 0x7f46d403dad0 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f46d403dad0 msgr2=0x7f46d403ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 --2- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f46d403dad0 0x7f46d403ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46e80099c0 tx=0x7f46e8006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 msgr2=0x7f4700196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 --2- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f4700196d10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46f4037cd0 tx=0x7f46f4037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 shutdown_connections 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 --2- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f46d403dad0 0x7f46d403ff90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 --2- 10.20.193.28:0/1979672749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4700107ee0 0x7f4700196d10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 >> 10.20.193.28:0/1979672749 conn(0x7f4700103700 msgr2=0x7f4700104290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 shutdown_connections 2026-02-20T03:11:16.196 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.116+0000 7f4704a7d640 1 -- 10.20.193.28:0/1979672749 wait complete. 2026-02-20T03:11:16.535 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-20T03:11:16.535 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.353+0000 7fb0696a5640 1 Processor -- start 2026-02-20T03:11:16.535 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.353+0000 7fb0696a5640 1 -- start start 2026-02-20T03:11:16.535 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.354+0000 7fb0696a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb064111480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:16.535 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.354+0000 7fb0696a5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb0640826d0 con 0x7fb06410f090 2026-02-20T03:11:16.535 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.354+0000 7fb063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb064111480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:16.535 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.354+0000 7fb063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb064111480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34650/0 (socket says 10.20.193.28:34650) 2026-02-20T03:11:16.535 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.354+0000 7fb063fff640 1 -- 10.20.193.28:0/2435111883 learned_addr learned my addr 10.20.193.28:0/2435111883 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.355+0000 7fb063fff640 1 -- 10.20.193.28:0/2435111883 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0641119c0 con 0x7fb06410f090 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.355+0000 7fb063fff640 1 --2- 10.20.193.28:0/2435111883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb064111480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb050009920 tx=0x7fb05002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6dec36b5a889eb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb062ffd640 1 -- 10.20.193.28:0/2435111883 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05003c070 con 0x7fb06410f090 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb062ffd640 1 -- 10.20.193.28:0/2435111883 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fb050037440 con 0x7fb06410f090 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb062ffd640 1 -- 10.20.193.28:0/2435111883 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0500354b0 con 0x7fb06410f090 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb0696a5640 1 -- 10.20.193.28:0/2435111883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 msgr2=0x7fb064111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb0696a5640 1 --2- 10.20.193.28:0/2435111883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb064111480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb050009920 tx=0x7fb05002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb0696a5640 1 -- 10.20.193.28:0/2435111883 shutdown_connections 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb0696a5640 1 --2- 10.20.193.28:0/2435111883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb064111480 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb0696a5640 1 -- 10.20.193.28:0/2435111883 >> 10.20.193.28:0/2435111883 conn(0x7fb06407d600 msgr2=0x7fb06407fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb0696a5640 1 -- 10.20.193.28:0/2435111883 shutdown_connections 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.356+0000 7fb0696a5640 1 -- 10.20.193.28:0/2435111883 wait complete. 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.357+0000 7fb0696a5640 1 Processor -- start 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.357+0000 7fb0696a5640 1 -- start start 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.357+0000 7fb0696a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb0641a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.357+0000 7fb0696a5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb0641128a0 con 0x7fb06410f090 2026-02-20T03:11:16.536 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.357+0000 7fb063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb0641a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.357+0000 7fb063fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb0641a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34656/0 (socket says 10.20.193.28:34656) 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.357+0000 7fb063fff640 1 -- 10.20.193.28:0/3534611632 learned_addr learned my addr 10.20.193.28:0/3534611632 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.357+0000 7fb063fff640 1 -- 10.20.193.28:0/3534611632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0641a4a10 con 0x7fb06410f090 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.358+0000 7fb063fff640 1 --2- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb0641a44d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb050009a50 tx=0x7fb050037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.358+0000 7fb0617fa640 1 -- 10.20.193.28:0/3534611632 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb050045070 con 0x7fb06410f090 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.358+0000 7fb0617fa640 1 -- 10.20.193.28:0/3534611632 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fb050040450 con 0x7fb06410f090 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.358+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0641a4d00 con 0x7fb06410f090 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.358+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0641a7990 con 0x7fb06410f090 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.358+0000 7fb0617fa640 1 -- 10.20.193.28:0/3534611632 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb05003c070 con 0x7fb06410f090 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.358+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb06410f4f0 con 0x7fb06410f090 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.359+0000 7fb0617fa640 1 -- 10.20.193.28:0/3534611632 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 6) ==== 50141+0+0 (secure 0 0 0) 0x7fb050040900 con 0x7fb06410f090 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.359+0000 7fb0617fa640 1 --2- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7fb03803dad0 0x7fb03803ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.359+0000 7fb0617fa640 1 -- 10.20.193.28:0/3534611632 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb050076560 con 0x7fb06410f090 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.359+0000 7fb0637fe640 1 --2- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7fb03803dad0 0x7fb03803ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.360+0000 7fb0637fe640 1 --2- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7fb03803dad0 0x7fb03803ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0540099c0 tx=0x7fb054006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:16.537 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.362+0000 7fb0617fa640 1 -- 10.20.193.28:0/3534611632 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb050045210 con 0x7fb06410f090 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.454+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fb0641a7b60 con 0x7fb03803dad0 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.455+0000 7fb0617fa640 1 -- 10.20.193.28:0/3534611632 <== mgr.14118 v2:10.20.193.28:6800/732750991 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fb0641a7b60 con 0x7fb03803dad0 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7fb03803dad0 msgr2=0x7fb03803ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 --2- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7fb03803dad0 0x7fb03803ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb0540099c0 tx=0x7fb054006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 msgr2=0x7fb0641a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 --2- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb0641a44d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb050009a50 tx=0x7fb050037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 shutdown_connections 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 --2- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7fb03803dad0 0x7fb03803ff90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 --2- 10.20.193.28:0/3534611632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb06410f090 0x7fb0641a44d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 >> 10.20.193.28:0/3534611632 conn(0x7fb06407d600 msgr2=0x7fb06407e220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 shutdown_connections 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.456+0000 7fb0696a5640 1 -- 10.20.193.28:0/3534611632 wait complete. 2026-02-20T03:11:16.538 INFO:teuthology.orchestra.run.trial028.stdout:Generating ssh key... 2026-02-20T03:11:16.917 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.704+0000 7f389b577640 1 Processor -- start 2026-02-20T03:11:16.917 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.704+0000 7f389b577640 1 -- start start 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.704+0000 7f389b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c10a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.704+0000 7f389b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f389c10ab10 con 0x7f389c10a140 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.705+0000 7f389a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c10a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.705+0000 7f389a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c10a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34666/0 (socket says 10.20.193.28:34666) 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.705+0000 7f389a575640 1 -- 10.20.193.28:0/3217056709 learned_addr learned my addr 10.20.193.28:0/3217056709 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.705+0000 7f389a575640 1 -- 10.20.193.28:0/3217056709 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c10b340 con 0x7f389c10a140 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f389a575640 1 --2- 10.20.193.28:0/3217056709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c10a540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3890009920 tx=0x7f389002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29aa5ca2b8a69c82 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f3899573640 1 -- 10.20.193.28:0/3217056709 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f389003c070 con 0x7f389c10a140 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f3899573640 1 -- 10.20.193.28:0/3217056709 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f3890037440 con 0x7f389c10a140 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f3899573640 1 -- 10.20.193.28:0/3217056709 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38900354b0 con 0x7f389c10a140 2026-02-20T03:11:16.918 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f389b577640 1 -- 10.20.193.28:0/3217056709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 msgr2=0x7f389c10a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f389b577640 1 --2- 10.20.193.28:0/3217056709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c10a540 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3890009920 tx=0x7f389002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f389b577640 1 -- 10.20.193.28:0/3217056709 shutdown_connections 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f389b577640 1 --2- 10.20.193.28:0/3217056709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c10a540 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f389b577640 1 -- 10.20.193.28:0/3217056709 >> 10.20.193.28:0/3217056709 conn(0x7f389c07d710 msgr2=0x7f389c07db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f389b577640 1 -- 10.20.193.28:0/3217056709 shutdown_connections 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.706+0000 7f389b577640 1 -- 10.20.193.28:0/3217056709 wait complete. 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.707+0000 7f389b577640 1 Processor -- start 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.707+0000 7f389b577640 1 -- start start 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.707+0000 7f389b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c1a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.707+0000 7f389b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f389c10e570 con 0x7f389c10a140 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.707+0000 7f389a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c1a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.708+0000 7f389a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c1a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34680/0 (socket says 10.20.193.28:34680) 2026-02-20T03:11:16.919 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.708+0000 7f389a575640 1 -- 10.20.193.28:0/3843047451 learned_addr learned my addr 10.20.193.28:0/3843047451 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.708+0000 7f389a575640 1 -- 10.20.193.28:0/3843047451 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c1a0560 con 0x7f389c10a140 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.708+0000 7f389a575640 1 --2- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c1a0020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3890037cd0 tx=0x7f3890037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.708+0000 7f38837fe640 1 -- 10.20.193.28:0/3843047451 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3890045070 con 0x7f389c10a140 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.708+0000 7f38837fe640 1 -- 10.20.193.28:0/3843047451 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f3890040450 con 0x7f389c10a140 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.708+0000 7f38837fe640 1 -- 10.20.193.28:0/3843047451 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f389003c070 con 0x7f389c10a140 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.708+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c1a07f0 con 0x7f389c10a140 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.708+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c1a34e0 con 0x7f389c10a140 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.709+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3860005390 con 0x7f389c10a140 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.709+0000 7f38837fe640 1 -- 10.20.193.28:0/3843047451 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 6) ==== 50141+0+0 (secure 0 0 0) 0x7f3890040920 con 0x7f389c10a140 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.709+0000 7f38837fe640 1 --2- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f387403dad0 0x7f387403ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.709+0000 7f38837fe640 1 -- 10.20.193.28:0/3843047451 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f38900763e0 con 0x7f389c10a140 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.710+0000 7f3899d74640 1 --2- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f387403dad0 0x7f387403ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.710+0000 7f3899d74640 1 --2- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f387403dad0 0x7f387403ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38840099c0 tx=0x7f3884006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:16.920 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.712+0000 7f38837fe640 1 -- 10.20.193.28:0/3843047451 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f3890033200 con 0x7f389c10a140 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.802+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f3860002bf0 con 0x7f387403dad0 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.837+0000 7f38837fe640 1 -- 10.20.193.28:0/3843047451 <== mgr.14118 v2:10.20.193.28:6800/732750991 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3860002bf0 con 0x7f387403dad0 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.838+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f387403dad0 msgr2=0x7f387403ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.838+0000 7f389b577640 1 --2- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f387403dad0 0x7f387403ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38840099c0 tx=0x7f3884006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.838+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 msgr2=0x7f389c1a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.838+0000 7f389b577640 1 --2- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c1a0020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3890037cd0 tx=0x7f3890037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.839+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 shutdown_connections 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.839+0000 7f389b577640 1 --2- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f387403dad0 0x7f387403ff90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.839+0000 7f389b577640 1 --2- 10.20.193.28:0/3843047451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f389c10a140 0x7f389c1a0020 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.839+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 >> 10.20.193.28:0/3843047451 conn(0x7f389c07d710 msgr2=0x7f389c107700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.839+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 shutdown_connections 2026-02-20T03:11:16.921 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:16.839+0000 7f389b577640 1 -- 10.20.193.28:0/3843047451 wait complete. 2026-02-20T03:11:17.079 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: Generating public/private ed25519 key pair. 2026-02-20T03:11:17.079 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: Your identification has been saved in /tmp/tmpf03_jhw8/key 2026-02-20T03:11:17.079 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: Your public key has been saved in /tmp/tmpf03_jhw8/key.pub 2026-02-20T03:11:17.079 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: The key fingerprint is: 2026-02-20T03:11:17.079 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: SHA256:Kv9wf4C3y7zyvw/fx6M2n1hDPzgmDPVw44qG0sqb5f8 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: The key's randomart image is: 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: +--[ED25519 256]--+ 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: | | 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: | | 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: | o o | 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: | . = . | 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: | So o . | 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: | ..o * . o .| 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: | ..o+.+ *.+ =.| 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: | .o*oo+. +=+o*| 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: | =ooo+OE+=*o+| 2026-02-20T03:11:17.080 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: +----[SHA256]-----+ 2026-02-20T03:11:17.295 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBOSUs5ziEQEAhPUVsovPJrUIq1eP2n640EVw9oSoEga ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:17.296 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.076+0000 7f6ae1fd6640 1 Processor -- start 2026-02-20T03:11:17.296 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.076+0000 7f6ae1fd6640 1 -- start start 2026-02-20T03:11:17.296 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.076+0000 7f6ae1fd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc111480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:17.296 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.076+0000 7f6ae1fd6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc0826d0 con 0x7f6adc10f090 2026-02-20T03:11:17.296 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.077+0000 7f6ae0fd4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc111480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:17.297 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.077+0000 7f6ae0fd4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc111480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34682/0 (socket says 10.20.193.28:34682) 2026-02-20T03:11:17.297 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.077+0000 7f6ae0fd4640 1 -- 10.20.193.28:0/4134016462 learned_addr learned my addr 10.20.193.28:0/4134016462 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:17.297 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.077+0000 7f6ae0fd4640 1 -- 10.20.193.28:0/4134016462 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc1119c0 con 0x7f6adc10f090 2026-02-20T03:11:17.297 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.078+0000 7f6ae0fd4640 1 --2- 10.20.193.28:0/4134016462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc111480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009920 tx=0x7f6acc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7359ae893c3e8ed0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:17.297 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.078+0000 7f6ad37fe640 1 -- 10.20.193.28:0/4134016462 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6acc03c070 con 0x7f6adc10f090 2026-02-20T03:11:17.297 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.078+0000 7f6ad37fe640 1 -- 10.20.193.28:0/4134016462 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f6acc037440 con 0x7f6adc10f090 2026-02-20T03:11:17.297 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.078+0000 7f6ad37fe640 1 -- 10.20.193.28:0/4134016462 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6acc0354b0 con 0x7f6adc10f090 2026-02-20T03:11:17.297 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.078+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/4134016462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 msgr2=0x7f6adc111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:17.298 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.078+0000 7f6ae1fd6640 1 --2- 10.20.193.28:0/4134016462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc111480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009920 tx=0x7f6acc02ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:17.298 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.079+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/4134016462 shutdown_connections 2026-02-20T03:11:17.298 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.079+0000 7f6ae1fd6640 1 --2- 10.20.193.28:0/4134016462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc111480 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:17.298 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.079+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/4134016462 >> 10.20.193.28:0/4134016462 conn(0x7f6adc07d600 msgr2=0x7f6adc07fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:17.298 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.079+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/4134016462 shutdown_connections 2026-02-20T03:11:17.298 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.079+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/4134016462 wait complete. 2026-02-20T03:11:17.298 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.079+0000 7f6ae1fd6640 1 Processor -- start 2026-02-20T03:11:17.298 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.079+0000 7f6ae1fd6640 1 -- start start 2026-02-20T03:11:17.299 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.079+0000 7f6ae1fd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc1a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:17.299 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ae1fd6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc1128a0 con 0x7f6adc10f090 2026-02-20T03:11:17.299 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ae0fd4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc1a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:17.299 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ae0fd4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc1a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34688/0 (socket says 10.20.193.28:34688) 2026-02-20T03:11:17.299 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ae0fd4640 1 -- 10.20.193.28:0/848259273 learned_addr learned my addr 10.20.193.28:0/848259273 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:17.299 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ae0fd4640 1 -- 10.20.193.28:0/848259273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc1a4a10 con 0x7f6adc10f090 2026-02-20T03:11:17.299 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ae0fd4640 1 --2- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc1a44d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009a50 tx=0x7f6acc037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:17.299 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ad1ffb640 1 -- 10.20.193.28:0/848259273 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6acc045070 con 0x7f6adc10f090 2026-02-20T03:11:17.300 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ad1ffb640 1 -- 10.20.193.28:0/848259273 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f6acc040450 con 0x7f6adc10f090 2026-02-20T03:11:17.300 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6adc1a4d00 con 0x7f6adc10f090 2026-02-20T03:11:17.300 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.080+0000 7f6ad1ffb640 1 -- 10.20.193.28:0/848259273 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6acc03c070 con 0x7f6adc10f090 2026-02-20T03:11:17.300 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.081+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6adc1a7990 con 0x7f6adc10f090 2026-02-20T03:11:17.300 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.081+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6adc10f4f0 con 0x7f6adc10f090 2026-02-20T03:11:17.300 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.081+0000 7f6ad1ffb640 1 -- 10.20.193.28:0/848259273 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 6) ==== 50141+0+0 (secure 0 0 0) 0x7f6acc040900 con 0x7f6adc10f090 2026-02-20T03:11:17.300 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.082+0000 7f6ad1ffb640 1 --2- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f6ab803db20 0x7f6ab803ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:17.300 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.082+0000 7f6ad1ffb640 1 -- 10.20.193.28:0/848259273 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6acc076550 con 0x7f6adc10f090 2026-02-20T03:11:17.301 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.082+0000 7f6ad3fff640 1 --2- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f6ab803db20 0x7f6ab803ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:17.301 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.083+0000 7f6ad3fff640 1 --2- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f6ab803db20 0x7f6ab803ffe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40099c0 tx=0x7f6ac4006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:17.301 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.085+0000 7f6ad1ffb640 1 -- 10.20.193.28:0/848259273 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6acc0406b0 con 0x7f6adc10f090 2026-02-20T03:11:17.301 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.118+0000 7f6ad1ffb640 1 -- 10.20.193.28:0/848259273 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 7) ==== 50247+0+0 (secure 0 0 0) 0x7f6acc035aa0 con 0x7f6adc10f090 2026-02-20T03:11:17.301 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.177+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f6adc07e930 con 0x7f6ab803db20 2026-02-20T03:11:17.301 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.178+0000 7f6ad1ffb640 1 -- 10.20.193.28:0/848259273 <== mgr.14118 v2:10.20.193.28:6800/732750991 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+123 (secure 0 0 0) 0x7f6adc07e930 con 0x7f6ab803db20 2026-02-20T03:11:17.301 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f6ab803db20 msgr2=0x7f6ab803ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:17.302 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 --2- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f6ab803db20 0x7f6ab803ffe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40099c0 tx=0x7f6ac4006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:17.302 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 msgr2=0x7f6adc1a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:17.302 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 --2- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc1a44d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009a50 tx=0x7f6acc037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:17.302 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 shutdown_connections 2026-02-20T03:11:17.302 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 --2- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f6ab803db20 0x7f6ab803ffe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:17.302 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 --2- 10.20.193.28:0/848259273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6adc10f090 0x7f6adc1a44d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:17.302 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 >> 10.20.193.28:0/848259273 conn(0x7f6adc07d600 msgr2=0x7f6adc07e220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:17.302 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 shutdown_connections 2026-02-20T03:11:17.303 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.179+0000 7f6ae1fd6640 1 -- 10.20.193.28:0/848259273 wait complete. 2026-02-20T03:11:17.303 INFO:teuthology.orchestra.run.trial028.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-20T03:11:17.303 INFO:teuthology.orchestra.run.trial028.stdout:Adding key to root@localhost authorized_keys... 2026-02-20T03:11:17.303 INFO:teuthology.orchestra.run.trial028.stdout:Adding host trial028... 2026-02-20T03:11:17.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:17 trial028 ceph-mon[38552]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-20T03:11:17.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:17 trial028 ceph-mon[38552]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-20T03:11:17.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:17 trial028 ceph-mon[38552]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:17.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:17 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:17.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:17 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:17.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:17 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:17.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:17 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:17.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:17 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:18.181 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:18 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:16] ENGINE Bus STARTING 2026-02-20T03:11:18.181 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:18 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:16] ENGINE Serving on https://10.20.193.28:7150 2026-02-20T03:11:18.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:18 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:16] ENGINE Client ('10.20.193.28', 39522) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-20T03:11:18.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:18 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:16] ENGINE Serving on http://10.20.193.28:8765 2026-02-20T03:11:18.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:18 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:16] ENGINE Bus STARTED 2026-02-20T03:11:18.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:18 trial028 ceph-mon[38552]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:18.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:18 trial028 ceph-mon[38552]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:18.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:18 trial028 ceph-mon[38552]: Generating ssh key... 2026-02-20T03:11:18.182 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:18 trial028 ceph-mon[38552]: mgrmap e7: x(active, since 2s) 2026-02-20T03:11:19.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:19 trial028 ceph-mon[38552]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:19.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:19 trial028 ceph-mon[38552]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial028", "addr": "10.20.193.28", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:19.613 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Added host 'trial028' with addr '10.20.193.28' 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.464+0000 7f0c55327640 1 Processor -- start 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.464+0000 7f0c55327640 1 -- start start 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.465+0000 7f0c55327640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c5010a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.465+0000 7f0c55327640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5010ab10 con 0x7f0c5010a140 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.465+0000 7f0c4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c5010a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.465+0000 7f0c4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c5010a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34696/0 (socket says 10.20.193.28:34696) 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.465+0000 7f0c4ffff640 1 -- 10.20.193.28:0/4202473782 learned_addr learned my addr 10.20.193.28:0/4202473782 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.465+0000 7f0c4ffff640 1 -- 10.20.193.28:0/4202473782 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5010b340 con 0x7f0c5010a140 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.466+0000 7f0c4ffff640 1 --2- 10.20.193.28:0/4202473782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c5010a540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009920 tx=0x7f0c3c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0131648a9ee4c41 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:19.614 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.466+0000 7f0c4effd640 1 -- 10.20.193.28:0/4202473782 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c03c070 con 0x7f0c5010a140 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.466+0000 7f0c4effd640 1 -- 10.20.193.28:0/4202473782 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f0c3c037440 con 0x7f0c5010a140 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.466+0000 7f0c4effd640 1 -- 10.20.193.28:0/4202473782 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c0354b0 con 0x7f0c5010a140 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.467+0000 7f0c55327640 1 -- 10.20.193.28:0/4202473782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 msgr2=0x7f0c5010a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.467+0000 7f0c55327640 1 --2- 10.20.193.28:0/4202473782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c5010a540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009920 tx=0x7f0c3c02ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.467+0000 7f0c55327640 1 -- 10.20.193.28:0/4202473782 shutdown_connections 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.467+0000 7f0c55327640 1 --2- 10.20.193.28:0/4202473782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c5010a540 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.467+0000 7f0c55327640 1 -- 10.20.193.28:0/4202473782 >> 10.20.193.28:0/4202473782 conn(0x7f0c5007d710 msgr2=0x7f0c5007db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.467+0000 7f0c55327640 1 -- 10.20.193.28:0/4202473782 shutdown_connections 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.467+0000 7f0c55327640 1 -- 10.20.193.28:0/4202473782 wait complete. 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.467+0000 7f0c55327640 1 Processor -- start 2026-02-20T03:11:19.615 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.468+0000 7f0c55327640 1 -- start start 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.468+0000 7f0c55327640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c501a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.468+0000 7f0c55327640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0c5010e570 con 0x7f0c5010a140 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.468+0000 7f0c4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c501a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.468+0000 7f0c4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c501a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34708/0 (socket says 10.20.193.28:34708) 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.468+0000 7f0c4ffff640 1 -- 10.20.193.28:0/304302987 learned_addr learned my addr 10.20.193.28:0/304302987 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.468+0000 7f0c4ffff640 1 -- 10.20.193.28:0/304302987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c501a0560 con 0x7f0c5010a140 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.468+0000 7f0c4ffff640 1 --2- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c501a0020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c037cd0 tx=0x7f0c3c037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.469+0000 7f0c4d7fa640 1 -- 10.20.193.28:0/304302987 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c045070 con 0x7f0c5010a140 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.469+0000 7f0c4d7fa640 1 -- 10.20.193.28:0/304302987 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f0c3c040450 con 0x7f0c5010a140 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.469+0000 7f0c4d7fa640 1 -- 10.20.193.28:0/304302987 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c3c03c070 con 0x7f0c5010a140 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.469+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c501a07f0 con 0x7f0c5010a140 2026-02-20T03:11:19.616 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.469+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c501a34e0 con 0x7f0c5010a140 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.469+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c5010a5c0 con 0x7f0c5010a140 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.470+0000 7f0c4d7fa640 1 -- 10.20.193.28:0/304302987 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 7) ==== 50247+0+0 (secure 0 0 0) 0x7f0c3c040920 con 0x7f0c5010a140 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.470+0000 7f0c4d7fa640 1 --2- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f0c2403dbf0 0x7f0c240400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.470+0000 7f0c4d7fa640 1 -- 10.20.193.28:0/304302987 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0c3c076670 con 0x7f0c5010a140 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.470+0000 7f0c4f7fe640 1 --2- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f0c2403dbf0 0x7f0c240400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.471+0000 7f0c4f7fe640 1 --2- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f0c2403dbf0 0x7f0c240400b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0c400099c0 tx=0x7f0c40006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.473+0000 7f0c4d7fa640 1 -- 10.20.193.28:0/304302987 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0c3c033200 con 0x7f0c5010a140 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:17.566+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial028", "addr": "10.20.193.28", "target": ["mon-mgr", ""]}) -- 0x7f0c50107e10 con 0x7f0c2403dbf0 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.482+0000 7f0c4d7fa640 1 -- 10.20.193.28:0/304302987 <== mgr.14118 v2:10.20.193.28:6800/732750991 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f0c50107e10 con 0x7f0c2403dbf0 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f0c2403dbf0 msgr2=0x7f0c240400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 --2- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f0c2403dbf0 0x7f0c240400b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0c400099c0 tx=0x7f0c40006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:19.617 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 msgr2=0x7f0c501a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:19.618 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 --2- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c501a0020 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c037cd0 tx=0x7f0c3c037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:19.618 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 shutdown_connections 2026-02-20T03:11:19.618 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 --2- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f0c2403dbf0 0x7f0c240400b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:19.618 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 --2- 10.20.193.28:0/304302987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c5010a140 0x7f0c501a0020 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:19.618 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 >> 10.20.193.28:0/304302987 conn(0x7f0c5007d710 msgr2=0x7f0c50107700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:19.618 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 shutdown_connections 2026-02-20T03:11:19.618 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.485+0000 7f0c55327640 1 -- 10.20.193.28:0/304302987 wait complete. 2026-02-20T03:11:19.618 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mon service... 2026-02-20T03:11:20.026 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-20T03:11:20.026 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.795+0000 7f224974d640 1 Processor -- start 2026-02-20T03:11:20.026 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.796+0000 7f224974d640 1 -- start start 2026-02-20T03:11:20.026 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.796+0000 7f224974d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f224410a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.796+0000 7f224974d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f224410ab10 con 0x7f224410a140 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.796+0000 7f2243fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f224410a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.796+0000 7f2243fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f224410a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34720/0 (socket says 10.20.193.28:34720) 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.796+0000 7f2243fff640 1 -- 10.20.193.28:0/1034389724 learned_addr learned my addr 10.20.193.28:0/1034389724 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.796+0000 7f2243fff640 1 -- 10.20.193.28:0/1034389724 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224410b340 con 0x7f224410a140 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.797+0000 7f2243fff640 1 --2- 10.20.193.28:0/1034389724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f224410a540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2230009920 tx=0x7f223002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cee81d7c9652ae5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.797+0000 7f2242ffd640 1 -- 10.20.193.28:0/1034389724 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223003c070 con 0x7f224410a140 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.797+0000 7f2242ffd640 1 -- 10.20.193.28:0/1034389724 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f2230037440 con 0x7f224410a140 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.797+0000 7f2242ffd640 1 -- 10.20.193.28:0/1034389724 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22300354b0 con 0x7f224410a140 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.798+0000 7f224974d640 1 -- 10.20.193.28:0/1034389724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 msgr2=0x7f224410a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:20.027 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.798+0000 7f224974d640 1 --2- 10.20.193.28:0/1034389724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f224410a540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2230009920 tx=0x7f223002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.798+0000 7f224974d640 1 -- 10.20.193.28:0/1034389724 shutdown_connections 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.798+0000 7f224974d640 1 --2- 10.20.193.28:0/1034389724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f224410a540 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.798+0000 7f224974d640 1 -- 10.20.193.28:0/1034389724 >> 10.20.193.28:0/1034389724 conn(0x7f224407d710 msgr2=0x7f224407db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.798+0000 7f224974d640 1 -- 10.20.193.28:0/1034389724 shutdown_connections 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.798+0000 7f224974d640 1 -- 10.20.193.28:0/1034389724 wait complete. 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.799+0000 7f224974d640 1 Processor -- start 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.799+0000 7f224974d640 1 -- start start 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.799+0000 7f224974d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f22441a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.799+0000 7f224974d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f224410e570 con 0x7f224410a140 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.799+0000 7f2243fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f22441a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:20.028 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.799+0000 7f2243fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f22441a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34728/0 (socket says 10.20.193.28:34728) 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.799+0000 7f2243fff640 1 -- 10.20.193.28:0/2891726644 learned_addr learned my addr 10.20.193.28:0/2891726644 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.800+0000 7f2243fff640 1 -- 10.20.193.28:0/2891726644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22441a0560 con 0x7f224410a140 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.800+0000 7f2243fff640 1 --2- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f22441a0020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2230037cd0 tx=0x7f2230037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.800+0000 7f22417fa640 1 -- 10.20.193.28:0/2891726644 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2230045070 con 0x7f224410a140 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.800+0000 7f22417fa640 1 -- 10.20.193.28:0/2891726644 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f2230040450 con 0x7f224410a140 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.800+0000 7f22417fa640 1 -- 10.20.193.28:0/2891726644 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f223003c070 con 0x7f224410a140 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.800+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22441a07f0 con 0x7f224410a140 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.801+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22441a34e0 con 0x7f224410a140 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.801+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224410a5c0 con 0x7f224410a140 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.802+0000 7f22417fa640 1 -- 10.20.193.28:0/2891726644 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 7) ==== 50247+0+0 (secure 0 0 0) 0x7f2230040920 con 0x7f224410a140 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.802+0000 7f22417fa640 1 --2- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f221803dc40 0x7f2218040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:20.029 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.802+0000 7f22417fa640 1 -- 10.20.193.28:0/2891726644 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2230076670 con 0x7f224410a140 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.802+0000 7f22437fe640 1 --2- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f221803dc40 0x7f2218040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.803+0000 7f22437fe640 1 --2- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f221803dc40 0x7f2218040100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22340099c0 tx=0x7f2234006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.805+0000 7f22417fa640 1 -- 10.20.193.28:0/2891726644 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f223003c210 con 0x7f224410a140 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.902+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2244107e10 con 0x7f221803dc40 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.906+0000 7f22417fa640 1 -- 10.20.193.28:0/2891726644 <== mgr.14118 v2:10.20.193.28:6800/732750991 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2244107e10 con 0x7f221803dc40 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f221803dc40 msgr2=0x7f2218040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 --2- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f221803dc40 0x7f2218040100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22340099c0 tx=0x7f2234006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 msgr2=0x7f22441a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 --2- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f22441a0020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2230037cd0 tx=0x7f2230037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 shutdown_connections 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 --2- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f221803dc40 0x7f2218040100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.030 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 --2- 10.20.193.28:0/2891726644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f224410a140 0x7f22441a0020 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.031 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 >> 10.20.193.28:0/2891726644 conn(0x7f224407d710 msgr2=0x7f2244107700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:20.031 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 shutdown_connections 2026-02-20T03:11:20.031 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:19.907+0000 7f224974d640 1 -- 10.20.193.28:0/2891726644 wait complete. 2026-02-20T03:11:20.031 INFO:teuthology.orchestra.run.trial028.stdout:Deploying unmanaged mgr service... 2026-02-20T03:11:20.268 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:20 trial028 ceph-mon[38552]: Deploying cephadm binary to trial028 2026-02-20T03:11:20.269 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:20 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:20.269 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:20 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:20.269 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:20 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:20.380 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-20T03:11:20.381 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.180+0000 7f2805a82640 1 Processor -- start 2026-02-20T03:11:20.381 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.180+0000 7f2805a82640 1 -- start start 2026-02-20T03:11:20.381 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.180+0000 7f2805a82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:20.381 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.180+0000 7f2805a82640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2800108820 con 0x7f2800107ee0 2026-02-20T03:11:20.381 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.180+0000 7f2804a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:20.382 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.180+0000 7f2804a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34730/0 (socket says 10.20.193.28:34730) 2026-02-20T03:11:20.382 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.180+0000 7f2804a80640 1 -- 10.20.193.28:0/2101169056 learned_addr learned my addr 10.20.193.28:0/2101169056 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:20.382 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.181+0000 7f2804a80640 1 -- 10.20.193.28:0/2101169056 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2800109080 con 0x7f2800107ee0 2026-02-20T03:11:20.382 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.181+0000 7f2804a80640 1 --2- 10.20.193.28:0/2101169056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001082e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009920 tx=0x7f27f002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b509ee1269baf5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:20.382 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f27f77fe640 1 -- 10.20.193.28:0/2101169056 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f003c070 con 0x7f2800107ee0 2026-02-20T03:11:20.382 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f27f77fe640 1 -- 10.20.193.28:0/2101169056 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f27f0037440 con 0x7f2800107ee0 2026-02-20T03:11:20.383 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f27f77fe640 1 -- 10.20.193.28:0/2101169056 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f00354b0 con 0x7f2800107ee0 2026-02-20T03:11:20.383 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f2805a82640 1 -- 10.20.193.28:0/2101169056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 msgr2=0x7f28001082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:20.383 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f2805a82640 1 --2- 10.20.193.28:0/2101169056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001082e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009920 tx=0x7f27f002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:20.383 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f2805a82640 1 -- 10.20.193.28:0/2101169056 shutdown_connections 2026-02-20T03:11:20.383 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f2805a82640 1 --2- 10.20.193.28:0/2101169056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001082e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.383 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f2805a82640 1 -- 10.20.193.28:0/2101169056 >> 10.20.193.28:0/2101169056 conn(0x7f2800103700 msgr2=0x7f2800105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:20.383 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f2805a82640 1 -- 10.20.193.28:0/2101169056 shutdown_connections 2026-02-20T03:11:20.384 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.182+0000 7f2805a82640 1 -- 10.20.193.28:0/2101169056 wait complete. 2026-02-20T03:11:20.384 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.183+0000 7f2805a82640 1 Processor -- start 2026-02-20T03:11:20.384 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.183+0000 7f2805a82640 1 -- start start 2026-02-20T03:11:20.384 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.183+0000 7f2805a82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:20.384 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.183+0000 7f2805a82640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f28001089a0 con 0x7f2800107ee0 2026-02-20T03:11:20.384 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.184+0000 7f2804a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:20.384 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.184+0000 7f2804a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001a0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34732/0 (socket says 10.20.193.28:34732) 2026-02-20T03:11:20.385 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.184+0000 7f2804a80640 1 -- 10.20.193.28:0/2172140804 learned_addr learned my addr 10.20.193.28:0/2172140804 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:20.385 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.184+0000 7f2804a80640 1 -- 10.20.193.28:0/2172140804 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28001a0580 con 0x7f2800107ee0 2026-02-20T03:11:20.385 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.184+0000 7f2804a80640 1 --2- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001a0040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f27f0037cd0 tx=0x7f27f0037b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:20.385 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.185+0000 7f27f5ffb640 1 -- 10.20.193.28:0/2172140804 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f0045070 con 0x7f2800107ee0 2026-02-20T03:11:20.385 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.185+0000 7f27f5ffb640 1 -- 10.20.193.28:0/2172140804 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f27f0040450 con 0x7f2800107ee0 2026-02-20T03:11:20.385 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.185+0000 7f27f5ffb640 1 -- 10.20.193.28:0/2172140804 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27f003c070 con 0x7f2800107ee0 2026-02-20T03:11:20.385 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.185+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28001a0810 con 0x7f2800107ee0 2026-02-20T03:11:20.386 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.185+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28001a3500 con 0x7f2800107ee0 2026-02-20T03:11:20.386 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.186+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2800108360 con 0x7f2800107ee0 2026-02-20T03:11:20.386 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.186+0000 7f27f5ffb640 1 -- 10.20.193.28:0/2172140804 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 7) ==== 50247+0+0 (secure 0 0 0) 0x7f27f0040920 con 0x7f2800107ee0 2026-02-20T03:11:20.386 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.186+0000 7f27f5ffb640 1 --2- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f27dc03dc40 0x7f27dc040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:20.386 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.186+0000 7f27f5ffb640 1 -- 10.20.193.28:0/2172140804 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f27f00807a0 con 0x7f2800107ee0 2026-02-20T03:11:20.386 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.186+0000 7f27f7fff640 1 --2- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f27dc03dc40 0x7f27dc040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:20.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.187+0000 7f27f7fff640 1 --2- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f27dc03dc40 0x7f27dc040100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f27e80099c0 tx=0x7f27e8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:20.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.189+0000 7f27f5ffb640 1 -- 10.20.193.28:0/2172140804 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f27f007d060 con 0x7f2800107ee0 2026-02-20T03:11:20.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.266+0000 7f27f5ffb640 1 -- 10.20.193.28:0/2172140804 <== mon.0 v2:10.20.193.28:3300/0 7 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f27f003c210 con 0x7f2800107ee0 2026-02-20T03:11:20.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.286+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f28001049a0 con 0x7f27dc03dc40 2026-02-20T03:11:20.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.289+0000 7f27f5ffb640 1 -- 10.20.193.28:0/2172140804 <== mgr.14118 v2:10.20.193.28:6800/732750991 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f28001049a0 con 0x7f27dc03dc40 2026-02-20T03:11:20.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.291+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f27dc03dc40 msgr2=0x7f27dc040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:20.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.291+0000 7f2805a82640 1 --2- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f27dc03dc40 0x7f27dc040100 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f27e80099c0 tx=0x7f27e8006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.291+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 msgr2=0x7f28001a0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:20.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.291+0000 7f2805a82640 1 --2- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001a0040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f27f0037cd0 tx=0x7f27f0037b90 comp rx=0 tx=0).stop 2026-02-20T03:11:20.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.291+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 shutdown_connections 2026-02-20T03:11:20.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.291+0000 7f2805a82640 1 --2- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f27dc03dc40 0x7f27dc040100 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.291+0000 7f2805a82640 1 --2- 10.20.193.28:0/2172140804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2800107ee0 0x7f28001a0040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.291+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 >> 10.20.193.28:0/2172140804 conn(0x7f2800103700 msgr2=0x7f2800104290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:20.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.291+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 shutdown_connections 2026-02-20T03:11:20.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.292+0000 7f2805a82640 1 -- 10.20.193.28:0/2172140804 wait complete. 2026-02-20T03:11:20.726 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.540+0000 7f3436c18640 1 Processor -- start 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.540+0000 7f3436c18640 1 -- start start 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.541+0000 7f3436c18640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f343010a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.541+0000 7f3436c18640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f343010ab10 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.541+0000 7f3435c16640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f343010a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.541+0000 7f3435c16640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f343010a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34740/0 (socket says 10.20.193.28:34740) 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.541+0000 7f3435c16640 1 -- 10.20.193.28:0/3962592555 learned_addr learned my addr 10.20.193.28:0/3962592555 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.541+0000 7f3435c16640 1 -- 10.20.193.28:0/3962592555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343010b340 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.542+0000 7f3435c16640 1 --2- 10.20.193.28:0/3962592555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f343010a540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3420009920 tx=0x7f342002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05bda655b528877 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.542+0000 7f3434c14640 1 -- 10.20.193.28:0/3962592555 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f342003c070 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.542+0000 7f3434c14640 1 -- 10.20.193.28:0/3962592555 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3420037440 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.542+0000 7f3434c14640 1 -- 10.20.193.28:0/3962592555 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34200354d0 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.543+0000 7f3436c18640 1 -- 10.20.193.28:0/3962592555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 msgr2=0x7f343010a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.543+0000 7f3436c18640 1 --2- 10.20.193.28:0/3962592555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f343010a540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3420009920 tx=0x7f342002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.543+0000 7f3436c18640 1 -- 10.20.193.28:0/3962592555 shutdown_connections 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.543+0000 7f3436c18640 1 --2- 10.20.193.28:0/3962592555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f343010a540 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.543+0000 7f3436c18640 1 -- 10.20.193.28:0/3962592555 >> 10.20.193.28:0/3962592555 conn(0x7f343007d710 msgr2=0x7f343007db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.544+0000 7f3436c18640 1 -- 10.20.193.28:0/3962592555 shutdown_connections 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.544+0000 7f3436c18640 1 -- 10.20.193.28:0/3962592555 wait complete. 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.544+0000 7f3436c18640 1 Processor -- start 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.545+0000 7f3436c18640 1 -- start start 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.545+0000 7f3436c18640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f3430081c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.545+0000 7f3436c18640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f343010e6f0 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.545+0000 7f3435c16640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f3430081c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.545+0000 7f3435c16640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f3430081c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34746/0 (socket says 10.20.193.28:34746) 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.545+0000 7f3435c16640 1 -- 10.20.193.28:0/3107117271 learned_addr learned my addr 10.20.193.28:0/3107117271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.545+0000 7f3435c16640 1 -- 10.20.193.28:0/3107117271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3430082180 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.545+0000 7f3435c16640 1 --2- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f3430081c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3420009a50 tx=0x7f3420037820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.546+0000 7f341effd640 1 -- 10.20.193.28:0/3107117271 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3420047070 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.546+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3430082410 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.546+0000 7f341effd640 1 -- 10.20.193.28:0/3107117271 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3420035da0 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.546+0000 7f341effd640 1 -- 10.20.193.28:0/3107117271 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f342003c070 con 0x7f343010a140 2026-02-20T03:11:20.727 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.546+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343007e780 con 0x7f343010a140 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.547+0000 7f341effd640 1 -- 10.20.193.28:0/3107117271 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 7) ==== 50247+0+0 (secure 0 0 0) 0x7f34200426a0 con 0x7f343010a140 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.547+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343010a5c0 con 0x7f343010a140 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.547+0000 7f341effd640 1 --2- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f340c03dbf0 0x7f340c0400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.547+0000 7f341effd640 1 -- 10.20.193.28:0/3107117271 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3420076c70 con 0x7f343010a140 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.547+0000 7f3435415640 1 --2- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f340c03dbf0 0x7f340c0400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.548+0000 7f3435415640 1 --2- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f340c03dbf0 0x7f340c0400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f34240099c0 tx=0x7f3424006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.549+0000 7f341effd640 1 -- 10.20.193.28:0/3107117271 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f342003c210 con 0x7f343010a140 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.642+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f343007e9b0 con 0x7f343010a140 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.644+0000 7f341effd640 1 -- 10.20.193.28:0/3107117271 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f34200765c0 con 0x7f343010a140 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f340c03dbf0 msgr2=0x7f340c0400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 --2- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f340c03dbf0 0x7f340c0400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f34240099c0 tx=0x7f3424006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 msgr2=0x7f3430081c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 --2- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f3430081c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3420009a50 tx=0x7f3420037820 comp rx=0 tx=0).stop 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 shutdown_connections 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 --2- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f340c03dbf0 0x7f340c0400b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 --2- 10.20.193.28:0/3107117271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f343010a140 0x7f3430081c40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 >> 10.20.193.28:0/3107117271 conn(0x7f343007d710 msgr2=0x7f3430107670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 shutdown_connections 2026-02-20T03:11:20.728 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.646+0000 7f3436c18640 1 -- 10.20.193.28:0/3107117271 wait complete. 2026-02-20T03:11:21.121 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.896+0000 7f69889ee640 1 Processor -- start 2026-02-20T03:11:21.121 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.896+0000 7f69889ee640 1 -- start start 2026-02-20T03:11:21.121 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.896+0000 7f69889ee640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698410a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:21.121 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.896+0000 7f69889ee640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f698410ab10 con 0x7f698410a140 2026-02-20T03:11:21.121 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.896+0000 7f6982d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698410a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:21.121 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.896+0000 7f6982d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698410a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34756/0 (socket says 10.20.193.28:34756) 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.896+0000 7f6982d76640 1 -- 10.20.193.28:0/3614128026 learned_addr learned my addr 10.20.193.28:0/3614128026 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.896+0000 7f6982d76640 1 -- 10.20.193.28:0/3614128026 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698410b340 con 0x7f698410a140 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.897+0000 7f6982d76640 1 --2- 10.20.193.28:0/3614128026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698410a540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6978009920 tx=0x7f697802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310119dfba8f8eab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.897+0000 7f6981d74640 1 -- 10.20.193.28:0/3614128026 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697803c070 con 0x7f698410a140 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.897+0000 7f6981d74640 1 -- 10.20.193.28:0/3614128026 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6978037440 con 0x7f698410a140 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.897+0000 7f6981d74640 1 -- 10.20.193.28:0/3614128026 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69780354d0 con 0x7f698410a140 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.898+0000 7f69889ee640 1 -- 10.20.193.28:0/3614128026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 msgr2=0x7f698410a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.898+0000 7f69889ee640 1 --2- 10.20.193.28:0/3614128026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698410a540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6978009920 tx=0x7f697802ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.898+0000 7f69889ee640 1 -- 10.20.193.28:0/3614128026 shutdown_connections 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.898+0000 7f69889ee640 1 --2- 10.20.193.28:0/3614128026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698410a540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.898+0000 7f69889ee640 1 -- 10.20.193.28:0/3614128026 >> 10.20.193.28:0/3614128026 conn(0x7f698407d710 msgr2=0x7f698407db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:21.122 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.898+0000 7f69889ee640 1 -- 10.20.193.28:0/3614128026 shutdown_connections 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.898+0000 7f69889ee640 1 -- 10.20.193.28:0/3614128026 wait complete. 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.898+0000 7f69889ee640 1 Processor -- start 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.898+0000 7f69889ee640 1 -- start start 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f69889ee640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698419fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f69889ee640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f698410e6f0 con 0x7f698410a140 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f6982d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698419fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f6982d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698419fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34764/0 (socket says 10.20.193.28:34764) 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f6982d76640 1 -- 10.20.193.28:0/1014826822 learned_addr learned my addr 10.20.193.28:0/1014826822 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f6982d76640 1 -- 10.20.193.28:0/1014826822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69841a0530 con 0x7f698410a140 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f6982d76640 1 --2- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698419fff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6978009a50 tx=0x7f6978037820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f6963fff640 1 -- 10.20.193.28:0/1014826822 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6978047070 con 0x7f698410a140 2026-02-20T03:11:21.123 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f6963fff640 1 -- 10.20.193.28:0/1014826822 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6978035da0 con 0x7f698410a140 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f6963fff640 1 -- 10.20.193.28:0/1014826822 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f697803c070 con 0x7f698410a140 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69841a07c0 con 0x7f698410a140 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.899+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69841a34b0 con 0x7f698410a140 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.900+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6948005390 con 0x7f698410a140 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.900+0000 7f6963fff640 1 -- 10.20.193.28:0/1014826822 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 7) ==== 50247+0+0 (secure 0 0 0) 0x7f69780426a0 con 0x7f698410a140 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.901+0000 7f6963fff640 1 --2- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f695803dbf0 0x7f69580400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.901+0000 7f6963fff640 1 -- 10.20.193.28:0/1014826822 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6978076c70 con 0x7f698410a140 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.901+0000 7f6982575640 1 --2- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f695803dbf0 0x7f69580400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.901+0000 7f6982575640 1 --2- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f695803dbf0 0x7f69580400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f696c0099c0 tx=0x7f696c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.903+0000 7f6963fff640 1 -- 10.20.193.28:0/1014826822 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f697803c210 con 0x7f698410a140 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.994+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f6948005680 con 0x7f698410a140 2026-02-20T03:11:21.124 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.996+0000 7f6963fff640 1 -- 10.20.193.28:0/1014826822 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f69780765c0 con 0x7f698410a140 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f695803dbf0 msgr2=0x7f69580400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 --2- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f695803dbf0 0x7f69580400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f696c0099c0 tx=0x7f696c006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 msgr2=0x7f698419fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 --2- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698419fff0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6978009a50 tx=0x7f6978037820 comp rx=0 tx=0).stop 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 shutdown_connections 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 --2- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f695803dbf0 0x7f69580400b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 --2- 10.20.193.28:0/1014826822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f698410a140 0x7f698419fff0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 >> 10.20.193.28:0/1014826822 conn(0x7f698407d710 msgr2=0x7f6984107690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 shutdown_connections 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:20.999+0000 7f69889ee640 1 -- 10.20.193.28:0/1014826822 wait complete. 2026-02-20T03:11:21.125 INFO:teuthology.orchestra.run.trial028.stdout:Enabling the dashboard module... 2026-02-20T03:11:21.308 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:21 trial028 ceph-mon[38552]: Added host trial028 2026-02-20T03:11:21.308 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:21 trial028 ceph-mon[38552]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:21.308 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:21 trial028 ceph-mon[38552]: Saving service mon spec with placement count:5 2026-02-20T03:11:21.308 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:21 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:21.308 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:21 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:21.308 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:21 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:21.308 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:21 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3107117271' entity='client.admin' 2026-02-20T03:11:21.308 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:21 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1014826822' entity='client.admin' 2026-02-20T03:11:22.321 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.303+0000 7f48d6322640 1 Processor -- start 2026-02-20T03:11:22.324 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.304+0000 7f48d6322640 1 -- start start 2026-02-20T03:11:22.324 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.304+0000 7f48d6322640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d010a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:22.324 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.304+0000 7f48d6322640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f48d010ab10 con 0x7f48d010a140 2026-02-20T03:11:22.324 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.304+0000 7f48d5320640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d010a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:22.324 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.304+0000 7f48d5320640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d010a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34766/0 (socket says 10.20.193.28:34766) 2026-02-20T03:11:22.324 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.304+0000 7f48d5320640 1 -- 10.20.193.28:0/28768324 learned_addr learned my addr 10.20.193.28:0/28768324 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:22.324 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.304+0000 7f48d5320640 1 -- 10.20.193.28:0/28768324 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d010b340 con 0x7f48d010a140 2026-02-20T03:11:22.324 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.305+0000 7f48d5320640 1 --2- 10.20.193.28:0/28768324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d010a540 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009920 tx=0x7f48c002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0eb09fc8a106edd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.305+0000 7f48bffff640 1 -- 10.20.193.28:0/28768324 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c003c070 con 0x7f48d010a140 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.305+0000 7f48bffff640 1 -- 10.20.193.28:0/28768324 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f48c0037440 con 0x7f48d010a140 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.305+0000 7f48bffff640 1 -- 10.20.193.28:0/28768324 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c00354d0 con 0x7f48d010a140 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.306+0000 7f48d6322640 1 -- 10.20.193.28:0/28768324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 msgr2=0x7f48d010a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.306+0000 7f48d6322640 1 --2- 10.20.193.28:0/28768324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d010a540 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009920 tx=0x7f48c002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.306+0000 7f48d6322640 1 -- 10.20.193.28:0/28768324 shutdown_connections 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.306+0000 7f48d6322640 1 --2- 10.20.193.28:0/28768324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d010a540 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.306+0000 7f48d6322640 1 -- 10.20.193.28:0/28768324 >> 10.20.193.28:0/28768324 conn(0x7f48d007d710 msgr2=0x7f48d007db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.306+0000 7f48d6322640 1 -- 10.20.193.28:0/28768324 shutdown_connections 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.306+0000 7f48d6322640 1 -- 10.20.193.28:0/28768324 wait complete. 2026-02-20T03:11:22.325 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.307+0000 7f48d6322640 1 Processor -- start 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.307+0000 7f48d6322640 1 -- start start 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.307+0000 7f48d6322640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d019fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.307+0000 7f48d6322640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f48d010e6f0 con 0x7f48d010a140 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.307+0000 7f48d5320640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d019fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.307+0000 7f48d5320640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d019fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34770/0 (socket says 10.20.193.28:34770) 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.307+0000 7f48d5320640 1 -- 10.20.193.28:0/2804301792 learned_addr learned my addr 10.20.193.28:0/2804301792 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.307+0000 7f48d5320640 1 -- 10.20.193.28:0/2804301792 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d01a0530 con 0x7f48d010a140 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.308+0000 7f48d5320640 1 --2- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d019fff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009a50 tx=0x7f48c0037820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.308+0000 7f48be7fc640 1 -- 10.20.193.28:0/2804301792 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c0047070 con 0x7f48d010a140 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.308+0000 7f48be7fc640 1 -- 10.20.193.28:0/2804301792 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f48c0035da0 con 0x7f48d010a140 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.308+0000 7f48be7fc640 1 -- 10.20.193.28:0/2804301792 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c003c070 con 0x7f48d010a140 2026-02-20T03:11:22.326 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.308+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d01a07c0 con 0x7f48d010a140 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.308+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d01a34b0 con 0x7f48d010a140 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.309+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d010e870 con 0x7f48d010a140 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.309+0000 7f48be7fc640 1 -- 10.20.193.28:0/2804301792 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 7) ==== 50247+0+0 (secure 0 0 0) 0x7f48c00426a0 con 0x7f48d010a140 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.310+0000 7f48be7fc640 1 --2- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f48ac03dbf0 0x7f48ac0400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.310+0000 7f48be7fc640 1 -- 10.20.193.28:0/2804301792 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f48c00775a0 con 0x7f48d010a140 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.310+0000 7f48d4b1f640 1 --2- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f48ac03dbf0 0x7f48ac0400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.311+0000 7f48d4b1f640 1 --2- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f48ac03dbf0 0x7f48ac0400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f48c40099c0 tx=0x7f48c4006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.312+0000 7f48be7fc640 1 -- 10.20.193.28:0/2804301792 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f48c0051030 con 0x7f48d010a140 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:21.427+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f48d01a3680 con 0x7f48d010a140 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.198+0000 7f48be7fc640 1 -- 10.20.193.28:0/2804301792 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v8) ==== 88+0+0 (secure 0 0 0) 0x7f48d01a3680 con 0x7f48d010a140 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.199+0000 7f48be7fc640 1 -- 10.20.193.28:0/2804301792 <== mon.0 v2:10.20.193.28:3300/0 8 ==== mgrmap(e 8) ==== 50260+0+0 (secure 0 0 0) 0x7f48c0076050 con 0x7f48d010a140 2026-02-20T03:11:22.327 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f48ac03dbf0 msgr2=0x7f48ac0400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:22.328 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 --2- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f48ac03dbf0 0x7f48ac0400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f48c40099c0 tx=0x7f48c4006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:22.328 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 msgr2=0x7f48d019fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:22.328 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 --2- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d019fff0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009a50 tx=0x7f48c0037820 comp rx=0 tx=0).stop 2026-02-20T03:11:22.328 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 shutdown_connections 2026-02-20T03:11:22.328 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 --2- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f48ac03dbf0 0x7f48ac0400b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:22.328 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 --2- 10.20.193.28:0/2804301792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d010a140 0x7f48d019fff0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:22.328 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 >> 10.20.193.28:0/2804301792 conn(0x7f48d007d710 msgr2=0x7f48d0107690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:22.328 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 shutdown_connections 2026-02-20T03:11:22.328 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.201+0000 7f48d6322640 1 -- 10.20.193.28:0/2804301792 wait complete. 2026-02-20T03:11:22.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:22 trial028 ceph-mon[38552]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:22.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:22 trial028 ceph-mon[38552]: Saving service mgr spec with placement count:2 2026-02-20T03:11:22.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:22 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:22.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:22 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2804301792' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-20T03:11:22.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:22 trial028 ceph-mon[38552]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:22.393 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:22 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: ignoring --setuser ceph since I am not root 2026-02-20T03:11:22.393 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:22 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: ignoring --setgroup ceph since I am not root 2026-02-20T03:11:22.717 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T03:11:22.717 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "epoch": 8, 2026-02-20T03:11:22.717 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-20T03:11:22.717 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-20T03:11:22.717 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.507+0000 7f8bd13ae640 1 Processor -- start 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.507+0000 7f8bd13ae640 1 -- start start 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.507+0000 7f8bd13ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc108290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.507+0000 7f8bd13ae640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc1087d0 con 0x7f8bcc107e90 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.508+0000 7f8bcbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.508+0000 7f8bcbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc108290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34802/0 (socket says 10.20.193.28:34802) 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.508+0000 7f8bcbfff640 1 -- 10.20.193.28:0/4028095001 learned_addr learned my addr 10.20.193.28:0/4028095001 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.508+0000 7f8bcbfff640 1 -- 10.20.193.28:0/4028095001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc109080 con 0x7f8bcc107e90 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.509+0000 7f8bcbfff640 1 --2- 10.20.193.28:0/4028095001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc108290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009920 tx=0x7f8bb802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a88c46088087f0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:22.718 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.509+0000 7f8bcaffd640 1 -- 10.20.193.28:0/4028095001 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb803c070 con 0x7f8bcc107e90 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.509+0000 7f8bcaffd640 1 -- 10.20.193.28:0/4028095001 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8bb8037440 con 0x7f8bcc107e90 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.509+0000 7f8bcaffd640 1 -- 10.20.193.28:0/4028095001 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb80354d0 con 0x7f8bcc107e90 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.509+0000 7f8bd13ae640 1 -- 10.20.193.28:0/4028095001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 msgr2=0x7f8bcc108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.509+0000 7f8bd13ae640 1 --2- 10.20.193.28:0/4028095001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc108290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009920 tx=0x7f8bb802ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.509+0000 7f8bd13ae640 1 -- 10.20.193.28:0/4028095001 shutdown_connections 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.509+0000 7f8bd13ae640 1 --2- 10.20.193.28:0/4028095001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc108290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.509+0000 7f8bd13ae640 1 -- 10.20.193.28:0/4028095001 >> 10.20.193.28:0/4028095001 conn(0x7f8bcc103670 msgr2=0x7f8bcc105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.510+0000 7f8bd13ae640 1 -- 10.20.193.28:0/4028095001 shutdown_connections 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.510+0000 7f8bd13ae640 1 -- 10.20.193.28:0/4028095001 wait complete. 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.510+0000 7f8bd13ae640 1 Processor -- start 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.510+0000 7f8bd13ae640 1 -- start start 2026-02-20T03:11:22.719 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.511+0000 7f8bd13ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc1a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.511+0000 7f8bd13ae640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc108950 con 0x7f8bcc107e90 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.511+0000 7f8bcbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc1a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.511+0000 7f8bcbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc1a0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34810/0 (socket says 10.20.193.28:34810) 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.511+0000 7f8bcbfff640 1 -- 10.20.193.28:0/1889880812 learned_addr learned my addr 10.20.193.28:0/1889880812 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.511+0000 7f8bcbfff640 1 -- 10.20.193.28:0/1889880812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc1a0570 con 0x7f8bcc107e90 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.512+0000 7f8bcbfff640 1 --2- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc1a0030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009a50 tx=0x7f8bb8037820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.512+0000 7f8bc97fa640 1 -- 10.20.193.28:0/1889880812 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb8047070 con 0x7f8bcc107e90 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.512+0000 7f8bc97fa640 1 -- 10.20.193.28:0/1889880812 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8bb8035da0 con 0x7f8bcc107e90 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.512+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc1a0800 con 0x7f8bcc107e90 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.512+0000 7f8bc97fa640 1 -- 10.20.193.28:0/1889880812 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb803c070 con 0x7f8bcc107e90 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.512+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc1a34f0 con 0x7f8bcc107e90 2026-02-20T03:11:22.720 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.513+0000 7f8bc97fa640 1 -- 10.20.193.28:0/1889880812 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 50260+0+0 (secure 0 0 0) 0x7f8bb80426a0 con 0x7f8bcc107e90 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.513+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc108310 con 0x7f8bcc107e90 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.513+0000 7f8bc97fa640 1 --2- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8ba003dc90 0x7f8ba0040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.514+0000 7f8bc97fa640 1 -- 10.20.193.28:0/1889880812 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8bb8076c80 con 0x7f8bcc107e90 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.514+0000 7f8bcb7fe640 1 -- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8ba003dc90 msgr2=0x7f8ba0040150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/732750991 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.514+0000 7f8bcb7fe640 1 --2- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8ba003dc90 0x7f8ba0040150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.516+0000 7f8bc97fa640 1 -- 10.20.193.28:0/1889880812 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8bb803c210 con 0x7f8bcc107e90 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.631+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f8bcc1a3b70 con 0x7f8bcc107e90 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.631+0000 7f8bc97fa640 1 -- 10.20.193.28:0/1889880812 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v8) ==== 56+0+88 (secure 0 0 0) 0x7f8bb8035900 con 0x7f8bcc107e90 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.633+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8ba003dc90 msgr2=0x7f8ba0040150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.633+0000 7f8bd13ae640 1 --2- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8ba003dc90 0x7f8ba0040150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:22.721 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.633+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 msgr2=0x7f8bcc1a0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:22.722 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.633+0000 7f8bd13ae640 1 --2- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc1a0030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8009a50 tx=0x7f8bb8037820 comp rx=0 tx=0).stop 2026-02-20T03:11:22.722 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.633+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 shutdown_connections 2026-02-20T03:11:22.722 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.634+0000 7f8bd13ae640 1 --2- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f8ba003dc90 0x7f8ba0040150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:22.722 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.634+0000 7f8bd13ae640 1 --2- 10.20.193.28:0/1889880812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bcc107e90 0x7f8bcc1a0030 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:22.722 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.634+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 >> 10.20.193.28:0/1889880812 conn(0x7f8bcc103670 msgr2=0x7f8bcc104220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:22.722 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.634+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 shutdown_connections 2026-02-20T03:11:22.722 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.634+0000 7f8bd13ae640 1 -- 10.20.193.28:0/1889880812 wait complete. 2026-02-20T03:11:22.722 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for the mgr to restart... 2026-02-20T03:11:22.722 INFO:teuthology.orchestra.run.trial028.stdout:Waiting for mgr epoch 8... 2026-02-20T03:11:22.900 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:22 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:22.824+0000 7ff861f15140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-20T03:11:23.173 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.028+0000 7ff861f15140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-20T03:11:23.174 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.074+0000 7ff861f15140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-20T03:11:23.174 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.128+0000 7ff861f15140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-20T03:11:23.174 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.171+0000 7ff861f15140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-20T03:11:23.467 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:23 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2804301792' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-20T03:11:23.467 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:23 trial028 ceph-mon[38552]: mgrmap e8: x(active, since 7s) 2026-02-20T03:11:23.467 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:23 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1889880812' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-20T03:11:23.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.218+0000 7ff861f15140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-20T03:11:23.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.308+0000 7ff861f15140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-20T03:11:23.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T03:11:23.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T03:11:23.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: from numpy import show_config as show_numpy_config 2026-02-20T03:11:23.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.417+0000 7ff861f15140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-20T03:11:23.468 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.464+0000 7ff861f15140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-20T03:11:23.720 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.591+0000 7ff861f15140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-20T03:11:23.720 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.671+0000 7ff861f15140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-20T03:11:23.720 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.718+0000 7ff861f15140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-20T03:11:24.100 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.763+0000 7ff861f15140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-20T03:11:24.101 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.812+0000 7ff861f15140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-20T03:11:24.101 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:23 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:23.853+0000 7ff861f15140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-20T03:11:24.548 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:24 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:24.208+0000 7ff861f15140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-20T03:11:24.549 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:24 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:24.337+0000 7ff861f15140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-20T03:11:24.549 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:24 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:24.380+0000 7ff861f15140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-20T03:11:24.549 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:24 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:24.423+0000 7ff861f15140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-20T03:11:24.549 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:24 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:24.546+0000 7ff861f15140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:24.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:24 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:24.586+0000 7ff861f15140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-20T03:11:24.850 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:24 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:24.709+0000 7ff861f15140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:25.851 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:25 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:25.348+0000 7ff861f15140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-20T03:11:25.851 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:25 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:25.389+0000 7ff861f15140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-20T03:11:26.350 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:25 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:25.968+0000 7ff861f15140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-20T03:11:26.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: Active manager daemon x restarted 2026-02-20T03:11:26.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: Activating manager daemon x 2026-02-20T03:11:26.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: osdmap e3: 0 total, 0 up, 0 in 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: mgrmap e9: x(active, starting, since 0.00298714s) 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: Manager daemon x is now available 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2026-02-20T03:11:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2026-02-20T03:11:27.104 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout { 2026-02-20T03:11:27.104 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 10, 2026-02-20T03:11:27.104 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-20T03:11:27.104 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout } 2026-02-20T03:11:27.104 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.897+0000 7f5e33577640 1 Processor -- start 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.897+0000 7f5e33577640 1 -- start start 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.898+0000 7f5e33577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3410a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.898+0000 7f5e33577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3410ab10 con 0x7f5e3410a140 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.898+0000 7f5e32575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3410a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.898+0000 7f5e32575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3410a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34820/0 (socket says 10.20.193.28:34820) 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.898+0000 7f5e32575640 1 -- 10.20.193.28:0/439420905 learned_addr learned my addr 10.20.193.28:0/439420905 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.898+0000 7f5e32575640 1 -- 10.20.193.28:0/439420905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3410b340 con 0x7f5e3410a140 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.899+0000 7f5e32575640 1 --2- 10.20.193.28:0/439420905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3410a540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009920 tx=0x7f5e2802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42d9a212b10daab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.899+0000 7f5e31573640 1 -- 10.20.193.28:0/439420905 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2803c070 con 0x7f5e3410a140 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.899+0000 7f5e31573640 1 -- 10.20.193.28:0/439420905 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e28037440 con 0x7f5e3410a140 2026-02-20T03:11:27.105 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.899+0000 7f5e31573640 1 -- 10.20.193.28:0/439420905 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e280354d0 con 0x7f5e3410a140 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.900+0000 7f5e33577640 1 -- 10.20.193.28:0/439420905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 msgr2=0x7f5e3410a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.900+0000 7f5e33577640 1 --2- 10.20.193.28:0/439420905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3410a540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009920 tx=0x7f5e2802ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.900+0000 7f5e33577640 1 -- 10.20.193.28:0/439420905 shutdown_connections 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.900+0000 7f5e33577640 1 --2- 10.20.193.28:0/439420905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3410a540 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.900+0000 7f5e33577640 1 -- 10.20.193.28:0/439420905 >> 10.20.193.28:0/439420905 conn(0x7f5e3407d710 msgr2=0x7f5e3407db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.900+0000 7f5e33577640 1 -- 10.20.193.28:0/439420905 shutdown_connections 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.900+0000 7f5e33577640 1 -- 10.20.193.28:0/439420905 wait complete. 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.900+0000 7f5e33577640 1 Processor -- start 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.900+0000 7f5e33577640 1 -- start start 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.901+0000 7f5e33577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3419fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.901+0000 7f5e33577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3410e6f0 con 0x7f5e3410a140 2026-02-20T03:11:27.106 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.901+0000 7f5e32575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3419fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.901+0000 7f5e32575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3419fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34828/0 (socket says 10.20.193.28:34828) 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.901+0000 7f5e32575640 1 -- 10.20.193.28:0/3701685163 learned_addr learned my addr 10.20.193.28:0/3701685163 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.901+0000 7f5e32575640 1 -- 10.20.193.28:0/3701685163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e341a0530 con 0x7f5e3410a140 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.902+0000 7f5e32575640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3419fff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e28039000 tx=0x7f5e28037820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.902+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e28047070 con 0x7f5e3410a140 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.902+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e28035df0 con 0x7f5e3410a140 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.902+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e2803c070 con 0x7f5e3410a140 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.902+0000 7f5e33577640 1 -- 10.20.193.28:0/3701685163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e341a07c0 con 0x7f5e3410a140 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.902+0000 7f5e33577640 1 -- 10.20.193.28:0/3701685163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e341a34b0 con 0x7f5e3410a140 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.903+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 8) ==== 50260+0+0 (secure 0 0 0) 0x7f5e28042640 con 0x7f5e3410a140 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.903+0000 7f5e1b7fe640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 0x7f5e0c040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:27.107 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.903+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 --> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5e0c040810 con 0x7f5e0c03dc40 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.903+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5e28076950 con 0x7f5e3410a140 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.903+0000 7f5e31d74640 1 -- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 msgr2=0x7f5e0c040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/732750991 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:22.903+0000 7f5e31d74640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 0x7f5e0c040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:23.104+0000 7f5e31d74640 1 -- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 msgr2=0x7f5e0c040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/732750991 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:23.104+0000 7f5e31d74640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 0x7f5e0c040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:23.505+0000 7f5e31d74640 1 -- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 msgr2=0x7f5e0c040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/732750991 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:23.505+0000 7f5e31d74640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 0x7f5e0c040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:24.306+0000 7f5e31d74640 1 -- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 msgr2=0x7f5e0c040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/732750991 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:24.306+0000 7f5e31d74640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 0x7f5e0c040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:25.907+0000 7f5e31d74640 1 -- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 msgr2=0x7f5e0c040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.28:6800/732750991 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:25.908+0000 7f5e31d74640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 0x7f5e0c040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-20T03:11:27.108 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:25.972+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mgrmap(e 9) ==== 50027+0+0 (secure 0 0 0) 0x7f5e28035950 con 0x7f5e3410a140 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:25.972+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 msgr2=0x7f5e0c040100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:25.972+0000 7f5e1b7fe640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 0x7f5e0c040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.974+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 10) ==== 50154+0+0 (secure 0 0 0) 0x7f5e280783b0 con 0x7f5e3410a140 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.974+0000 7f5e1b7fe640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c041720 0x7f5e0c043b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.974+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5e0c040810 con 0x7f5e0c041720 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.975+0000 7f5e31d74640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c041720 0x7f5e0c043b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.977+0000 7f5e31d74640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c041720 0x7f5e0c043b10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c003a80 tx=0x7f5e1c0092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.977+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f5e0c040810 con 0x7f5e0c041720 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.980+0000 7f5e33577640 1 -- 10.20.193.28:0/3701685163 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f5e3410e870 con 0x7f5e0c041720 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e1b7fe640 1 -- 10.20.193.28:0/3701685163 <== mgr.14150 v2:10.20.193.28:6800/3562582510 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f5e3410e870 con 0x7f5e0c041720 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 -- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c041720 msgr2=0x7f5e0c043b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:27.109 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c041720 0x7f5e0c043b10 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c003a80 tx=0x7f5e1c0092b0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 -- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 msgr2=0x7f5e3419fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3419fff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5e28039000 tx=0x7f5e28037820 comp rx=0 tx=0).stop 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 -- 10.20.193.28:0/3701685163 shutdown_connections 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c041720 0x7f5e0c043b10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:6800/732750991,v1:10.20.193.28:6801/732750991] conn(0x7f5e0c03dc40 0x7f5e0c040100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 --2- 10.20.193.28:0/3701685163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3410a140 0x7f5e3419fff0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 -- 10.20.193.28:0/3701685163 >> 10.20.193.28:0/3701685163 conn(0x7f5e3407d710 msgr2=0x7f5e34107690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 -- 10.20.193.28:0/3701685163 shutdown_connections 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:26.981+0000 7f5e33577640 1 -- 10.20.193.28:0/3701685163 wait complete. 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:mgr epoch 8 is available 2026-02-20T03:11:27.110 INFO:teuthology.orchestra.run.trial028.stdout:Generating a dashboard self-signed certificate... 2026-02-20T03:11:27.493 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.261+0000 7f89a183b640 1 Processor -- start 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.262+0000 7f89a183b640 1 -- start start 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.262+0000 7f89a183b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c111480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.262+0000 7f89a183b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f899c0826d0 con 0x7f899c10f090 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.262+0000 7f89a0839640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c111480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.262+0000 7f89a0839640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c111480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44062/0 (socket says 10.20.193.28:44062) 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.262+0000 7f89a0839640 1 -- 10.20.193.28:0/3248583940 learned_addr learned my addr 10.20.193.28:0/3248583940 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.263+0000 7f89a0839640 1 -- 10.20.193.28:0/3248583940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c1119c0 con 0x7f899c10f090 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.263+0000 7f89a0839640 1 --2- 10.20.193.28:0/3248583940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c111480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f898c009920 tx=0x7f898c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2578d41da9b65cc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:27.494 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89937fe640 1 -- 10.20.193.28:0/3248583940 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f898c03c070 con 0x7f899c10f090 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89937fe640 1 -- 10.20.193.28:0/3248583940 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f898c037440 con 0x7f899c10f090 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89937fe640 1 -- 10.20.193.28:0/3248583940 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f898c0354d0 con 0x7f899c10f090 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89a183b640 1 -- 10.20.193.28:0/3248583940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 msgr2=0x7f899c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89a183b640 1 --2- 10.20.193.28:0/3248583940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c111480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f898c009920 tx=0x7f898c02ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89a183b640 1 -- 10.20.193.28:0/3248583940 shutdown_connections 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89a183b640 1 --2- 10.20.193.28:0/3248583940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c111480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89a183b640 1 -- 10.20.193.28:0/3248583940 >> 10.20.193.28:0/3248583940 conn(0x7f899c07d600 msgr2=0x7f899c07fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89a183b640 1 -- 10.20.193.28:0/3248583940 shutdown_connections 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.264+0000 7f89a183b640 1 -- 10.20.193.28:0/3248583940 wait complete. 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.265+0000 7f89a183b640 1 Processor -- start 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.265+0000 7f89a183b640 1 -- start start 2026-02-20T03:11:27.495 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.265+0000 7f89a183b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c1a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.265+0000 7f89a183b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f899c112920 con 0x7f899c10f090 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f89a0839640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c1a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f89a0839640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c1a44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44076/0 (socket says 10.20.193.28:44076) 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f89a0839640 1 -- 10.20.193.28:0/750871848 learned_addr learned my addr 10.20.193.28:0/750871848 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f89a0839640 1 -- 10.20.193.28:0/750871848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c1a4a20 con 0x7f899c10f090 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f89a0839640 1 --2- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c1a44e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f898c002410 tx=0x7f898c037820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f8991ffb640 1 -- 10.20.193.28:0/750871848 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f898c047070 con 0x7f899c10f090 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f8991ffb640 1 -- 10.20.193.28:0/750871848 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f898c035da0 con 0x7f899c10f090 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f8991ffb640 1 -- 10.20.193.28:0/750871848 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f898c03c070 con 0x7f899c10f090 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f89a183b640 1 -- 10.20.193.28:0/750871848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c1a4d10 con 0x7f899c10f090 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.266+0000 7f89a183b640 1 -- 10.20.193.28:0/750871848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c1a79a0 con 0x7f899c10f090 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.267+0000 7f896b7fe640 1 -- 10.20.193.28:0/750871848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c10f4f0 con 0x7f899c10f090 2026-02-20T03:11:27.496 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.268+0000 7f8991ffb640 1 -- 10.20.193.28:0/750871848 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 50154+0+0 (secure 0 0 0) 0x7f898c042660 con 0x7f899c10f090 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.268+0000 7f8991ffb640 1 --2- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f897803db20 0x7f897803ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.268+0000 7f8991ffb640 1 -- 10.20.193.28:0/750871848 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f898c0775d0 con 0x7f899c10f090 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.268+0000 7f8993fff640 1 --2- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f897803db20 0x7f897803ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.269+0000 7f8993fff640 1 --2- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f897803db20 0x7f897803ffe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f89840099c0 tx=0x7f8984006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.270+0000 7f8991ffb640 1 -- 10.20.193.28:0/750871848 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f898c051030 con 0x7f899c10f090 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.363+0000 7f896b7fe640 1 -- 10.20.193.28:0/750871848 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f899c0630c0 con 0x7f897803db20 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.408+0000 7f8991ffb640 1 -- 10.20.193.28:0/750871848 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f899c0630c0 con 0x7f897803db20 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 -- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f897803db20 msgr2=0x7f897803ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 --2- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f897803db20 0x7f897803ffe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f89840099c0 tx=0x7f8984006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 -- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 msgr2=0x7f899c1a44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:27.497 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 --2- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c1a44e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f898c002410 tx=0x7f898c037820 comp rx=0 tx=0).stop 2026-02-20T03:11:27.498 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 -- 10.20.193.28:0/750871848 shutdown_connections 2026-02-20T03:11:27.498 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 --2- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f897803db20 0x7f897803ffe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.498 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 --2- 10.20.193.28:0/750871848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f899c10f090 0x7f899c1a44e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:27.498 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 -- 10.20.193.28:0/750871848 >> 10.20.193.28:0/750871848 conn(0x7f899c07d600 msgr2=0x7f899c07e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:27.498 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 -- 10.20.193.28:0/750871848 shutdown_connections 2026-02-20T03:11:27.498 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.410+0000 7f896b7fe640 1 -- 10.20.193.28:0/750871848 wait complete. 2026-02-20T03:11:27.498 INFO:teuthology.orchestra.run.trial028.stdout:Creating initial admin user... 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:26] ENGINE Bus STARTING 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:26] ENGINE Serving on http://10.20.193.28:8765 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:26] ENGINE Serving on https://10.20.193.28:7150 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:26] ENGINE Bus STARTED 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: [20/Feb/2026:03:11:26] ENGINE Client ('10.20.193.28', 34946) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: mgrmap e10: x(active, since 1.0059s) 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:27.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$w3uulM2SUdkATm3gRGnAnuiWtWRbcHC1sWSnZYsn4PGB5GNUmtHZ6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771557087, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.659+0000 7f5c208d5640 1 Processor -- start 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.659+0000 7f5c208d5640 1 -- start start 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.659+0000 7f5c208d5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c073be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.660+0000 7f5c208d5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c074f80 con 0x7f5c1c0737e0 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.660+0000 7f5c1ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.660+0000 7f5c1ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c073be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44080/0 (socket says 10.20.193.28:44080) 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.660+0000 7f5c1ad76640 1 -- 10.20.193.28:0/2529330144 learned_addr learned my addr 10.20.193.28:0/2529330144 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.660+0000 7f5c1ad76640 1 -- 10.20.193.28:0/2529330144 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c074120 con 0x7f5c1c0737e0 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.661+0000 7f5c1ad76640 1 --2- 10.20.193.28:0/2529330144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c073be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009920 tx=0x7f5c1002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb3640da210e5d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.662+0000 7f5c19d74640 1 -- 10.20.193.28:0/2529330144 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1003c070 con 0x7f5c1c0737e0 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.662+0000 7f5c19d74640 1 -- 10.20.193.28:0/2529330144 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c10037440 con 0x7f5c1c0737e0 2026-02-20T03:11:28.034 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.662+0000 7f5c19d74640 1 -- 10.20.193.28:0/2529330144 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c100354d0 con 0x7f5c1c0737e0 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.662+0000 7f5c208d5640 1 -- 10.20.193.28:0/2529330144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 msgr2=0x7f5c1c073be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.662+0000 7f5c208d5640 1 --2- 10.20.193.28:0/2529330144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c073be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009920 tx=0x7f5c1002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.662+0000 7f5c208d5640 1 -- 10.20.193.28:0/2529330144 shutdown_connections 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.662+0000 7f5c208d5640 1 --2- 10.20.193.28:0/2529330144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c073be0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.662+0000 7f5c208d5640 1 -- 10.20.193.28:0/2529330144 >> 10.20.193.28:0/2529330144 conn(0x7f5c1c06f500 msgr2=0x7f5c1c071940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.663+0000 7f5c208d5640 1 -- 10.20.193.28:0/2529330144 shutdown_connections 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.663+0000 7f5c208d5640 1 -- 10.20.193.28:0/2529330144 wait complete. 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.663+0000 7f5c208d5640 1 Processor -- start 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.664+0000 7f5c208d5640 1 -- start start 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.664+0000 7f5c208d5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c1a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.664+0000 7f5c208d5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c114bc0 con 0x7f5c1c0737e0 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.664+0000 7f5c1ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c1a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.664+0000 7f5c1ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c1a8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44090/0 (socket says 10.20.193.28:44090) 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.664+0000 7f5c1ad76640 1 -- 10.20.193.28:0/2325877801 learned_addr learned my addr 10.20.193.28:0/2325877801 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.664+0000 7f5c1ad76640 1 -- 10.20.193.28:0/2325877801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c1a8fb0 con 0x7f5c1c0737e0 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.664+0000 7f5c1ad76640 1 --2- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c1a8a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c10039000 tx=0x7f5c10037820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.664+0000 7f5bfbfff640 1 -- 10.20.193.28:0/2325877801 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c10047070 con 0x7f5c1c0737e0 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.665+0000 7f5bfbfff640 1 -- 10.20.193.28:0/2325877801 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c10035da0 con 0x7f5c1c0737e0 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.665+0000 7f5bfbfff640 1 -- 10.20.193.28:0/2325877801 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c1003c070 con 0x7f5c1c0737e0 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.665+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c1a9240 con 0x7f5c1c0737e0 2026-02-20T03:11:28.035 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.665+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c1abf30 con 0x7f5c1c0737e0 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.665+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c1a9720 con 0x7f5c1c0737e0 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.666+0000 7f5bfbfff640 1 -- 10.20.193.28:0/2325877801 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 50154+0+0 (secure 0 0 0) 0x7f5c100425d0 con 0x7f5c1c0737e0 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.666+0000 7f5bfbfff640 1 --2- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bf003db20 0x7f5bf003ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.666+0000 7f5bfbfff640 1 -- 10.20.193.28:0/2325877801 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5c10076c40 con 0x7f5c1c0737e0 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.666+0000 7f5c1a575640 1 --2- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bf003db20 0x7f5bf003ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.667+0000 7f5c1a575640 1 --2- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bf003db20 0x7f5bf003ffe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c040099c0 tx=0x7f5c04006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.669+0000 7f5bfbfff640 1 -- 10.20.193.28:0/2325877801 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5c1c1a9720 con 0x7f5c1c0737e0 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.766+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f5c1c073c60 con 0x7f5bf003db20 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.910+0000 7f5bfbfff640 1 -- 10.20.193.28:0/2325877801 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f5c1c073c60 con 0x7f5bf003db20 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bf003db20 msgr2=0x7f5bf003ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 --2- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bf003db20 0x7f5bf003ffe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c040099c0 tx=0x7f5c04006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 msgr2=0x7f5c1c1a8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 --2- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c1a8a70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c10039000 tx=0x7f5c10037820 comp rx=0 tx=0).stop 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 shutdown_connections 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 --2- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bf003db20 0x7f5bf003ffe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 --2- 10.20.193.28:0/2325877801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c1c0737e0 0x7f5c1c1a8a70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 >> 10.20.193.28:0/2325877801 conn(0x7f5c1c06f500 msgr2=0x7f5c1c0710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 shutdown_connections 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:27.912+0000 7f5c208d5640 1 -- 10.20.193.28:0/2325877801 wait complete. 2026-02-20T03:11:28.036 INFO:teuthology.orchestra.run.trial028.stdout:Fetching dashboard port number... 2026-02-20T03:11:28.386 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stdout 8443 2026-02-20T03:11:28.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.205+0000 7f29e693f640 1 Processor -- start 2026-02-20T03:11:28.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.205+0000 7f29e693f640 1 -- start start 2026-02-20T03:11:28.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.205+0000 7f29e693f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e0106900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:28.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.205+0000 7f29e693f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f29e0106ed0 con 0x7f29e0106500 2026-02-20T03:11:28.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.206+0000 7f29e593d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e0106900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:28.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.206+0000 7f29e593d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e0106900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44106/0 (socket says 10.20.193.28:44106) 2026-02-20T03:11:28.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.206+0000 7f29e593d640 1 -- 10.20.193.28:0/2612516830 learned_addr learned my addr 10.20.193.28:0/2612516830 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:28.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.206+0000 7f29e593d640 1 -- 10.20.193.28:0/2612516830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e0107700 con 0x7f29e0106500 2026-02-20T03:11:28.387 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.207+0000 7f29e593d640 1 --2- 10.20.193.28:0/2612516830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e0106900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009920 tx=0x7f29d002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4f41739368bc34 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.207+0000 7f29e493b640 1 -- 10.20.193.28:0/2612516830 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d003c070 con 0x7f29e0106500 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.207+0000 7f29e493b640 1 -- 10.20.193.28:0/2612516830 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f29d0037440 con 0x7f29e0106500 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.207+0000 7f29e493b640 1 -- 10.20.193.28:0/2612516830 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d00354d0 con 0x7f29e0106500 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.207+0000 7f29e693f640 1 -- 10.20.193.28:0/2612516830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 msgr2=0x7f29e0106900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.207+0000 7f29e693f640 1 --2- 10.20.193.28:0/2612516830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e0106900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009920 tx=0x7f29d002ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.207+0000 7f29e693f640 1 -- 10.20.193.28:0/2612516830 shutdown_connections 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.207+0000 7f29e693f640 1 --2- 10.20.193.28:0/2612516830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e0106900 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.207+0000 7f29e693f640 1 -- 10.20.193.28:0/2612516830 >> 10.20.193.28:0/2612516830 conn(0x7f29e0101d50 msgr2=0x7f29e0104170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.208+0000 7f29e693f640 1 -- 10.20.193.28:0/2612516830 shutdown_connections 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.208+0000 7f29e693f640 1 -- 10.20.193.28:0/2612516830 wait complete. 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.208+0000 7f29e693f640 1 Processor -- start 2026-02-20T03:11:28.388 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.208+0000 7f29e693f640 1 -- start start 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.209+0000 7f29e693f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e019ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.209+0000 7f29e693f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f29e010aab0 con 0x7f29e0106500 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.209+0000 7f29e593d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e019ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.209+0000 7f29e593d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e019ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44122/0 (socket says 10.20.193.28:44122) 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.209+0000 7f29e593d640 1 -- 10.20.193.28:0/1060045905 learned_addr learned my addr 10.20.193.28:0/1060045905 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.209+0000 7f29e593d640 1 -- 10.20.193.28:0/1060045905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e01a0520 con 0x7f29e0106500 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.209+0000 7f29e593d640 1 --2- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e019ffe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009a50 tx=0x7f29d0037820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.210+0000 7f29ceffd640 1 -- 10.20.193.28:0/1060045905 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d0047070 con 0x7f29e0106500 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.210+0000 7f29ceffd640 1 -- 10.20.193.28:0/1060045905 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f29d0035da0 con 0x7f29e0106500 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.210+0000 7f29ceffd640 1 -- 10.20.193.28:0/1060045905 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29d003c070 con 0x7f29e0106500 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.210+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e01a07b0 con 0x7f29e0106500 2026-02-20T03:11:28.389 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.210+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e01a34a0 con 0x7f29e0106500 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.210+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e010ac30 con 0x7f29e0106500 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.210+0000 7f29ceffd640 1 -- 10.20.193.28:0/1060045905 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 50154+0+0 (secure 0 0 0) 0x7f29d00426a0 con 0x7f29e0106500 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.211+0000 7f29ceffd640 1 --2- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29bc03db70 0x7f29bc040030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.211+0000 7f29ceffd640 1 -- 10.20.193.28:0/1060045905 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f29d0076ba0 con 0x7f29e0106500 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.211+0000 7f29e513c640 1 --2- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29bc03db70 0x7f29bc040030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.212+0000 7f29e513c640 1 --2- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29bc03db70 0x7f29bc040030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f29d40099c0 tx=0x7f29d4006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.214+0000 7f29ceffd640 1 -- 10.20.193.28:0/1060045905 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f29d003c210 con 0x7f29e0106500 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.305+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f29e0106980 con 0x7f29e0106500 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.305+0000 7f29ceffd640 1 -- 10.20.193.28:0/1060045905 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f29e0106980 con 0x7f29e0106500 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29bc03db70 msgr2=0x7f29bc040030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 --2- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29bc03db70 0x7f29bc040030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f29d40099c0 tx=0x7f29d4006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.390 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 msgr2=0x7f29e019ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:28.391 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 --2- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e019ffe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009a50 tx=0x7f29d0037820 comp rx=0 tx=0).stop 2026-02-20T03:11:28.391 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 shutdown_connections 2026-02-20T03:11:28.391 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 --2- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29bc03db70 0x7f29bc040030 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.391 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 --2- 10.20.193.28:0/1060045905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f29e0106500 0x7f29e019ffe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.391 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 >> 10.20.193.28:0/1060045905 conn(0x7f29e0101d50 msgr2=0x7f29e0102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:28.391 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 shutdown_connections 2026-02-20T03:11:28.391 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.306+0000 7f29e693f640 1 -- 10.20.193.28:0/1060045905 wait complete. 2026-02-20T03:11:28.399 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-20T03:11:28.399 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout disabled 2026-02-20T03:11:28.410 INFO:teuthology.orchestra.run.trial028.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-20T03:11:28.410 INFO:teuthology.orchestra.run.trial028.stdout:systemctl: stdout inactive 2026-02-20T03:11:28.410 INFO:teuthology.orchestra.run.trial028.stdout:firewalld.service is not enabled 2026-02-20T03:11:28.410 INFO:teuthology.orchestra.run.trial028.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-20T03:11:28.412 INFO:teuthology.orchestra.run.trial028.stdout:Ceph Dashboard is now available at: 2026-02-20T03:11:28.412 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.412 INFO:teuthology.orchestra.run.trial028.stdout: URL: https://trial028:8443/ 2026-02-20T03:11:28.412 INFO:teuthology.orchestra.run.trial028.stdout: User: admin 2026-02-20T03:11:28.412 INFO:teuthology.orchestra.run.trial028.stdout: Password: 9f7iefekq6 2026-02-20T03:11:28.412 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.413 INFO:teuthology.orchestra.run.trial028.stdout:Saving cluster configuration to /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config directory 2026-02-20T03:11:28.790 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.567+0000 7ff7cf577640 1 Processor -- start 2026-02-20T03:11:28.790 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.567+0000 7ff7cf577640 1 -- start start 2026-02-20T03:11:28.790 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.567+0000 7ff7cf577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d010a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:28.790 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.567+0000 7ff7cf577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d010ab10 con 0x7ff7d010a140 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.568+0000 7ff7ce575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d010a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.568+0000 7ff7ce575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d010a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44124/0 (socket says 10.20.193.28:44124) 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.568+0000 7ff7ce575640 1 -- 10.20.193.28:0/3795268644 learned_addr learned my addr 10.20.193.28:0/3795268644 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.568+0000 7ff7ce575640 1 -- 10.20.193.28:0/3795268644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d010b340 con 0x7ff7d010a140 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7ce575640 1 --2- 10.20.193.28:0/3795268644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d010a540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009920 tx=0x7ff7c402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca24b3d6b6a61f57 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cd573640 1 -- 10.20.193.28:0/3795268644 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c403c070 con 0x7ff7d010a140 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cd573640 1 -- 10.20.193.28:0/3795268644 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff7c4037440 con 0x7ff7d010a140 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cd573640 1 -- 10.20.193.28:0/3795268644 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c40354d0 con 0x7ff7d010a140 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cf577640 1 -- 10.20.193.28:0/3795268644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 msgr2=0x7ff7d010a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cf577640 1 --2- 10.20.193.28:0/3795268644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d010a540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009920 tx=0x7ff7c402ef20 comp rx=0 tx=0).stop 2026-02-20T03:11:28.791 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cf577640 1 -- 10.20.193.28:0/3795268644 shutdown_connections 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cf577640 1 --2- 10.20.193.28:0/3795268644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d010a540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cf577640 1 -- 10.20.193.28:0/3795268644 >> 10.20.193.28:0/3795268644 conn(0x7ff7d007d710 msgr2=0x7ff7d007db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cf577640 1 -- 10.20.193.28:0/3795268644 shutdown_connections 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.569+0000 7ff7cf577640 1 -- 10.20.193.28:0/3795268644 wait complete. 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.570+0000 7ff7cf577640 1 Processor -- start 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.570+0000 7ff7cf577640 1 -- start start 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.570+0000 7ff7cf577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d019fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.570+0000 7ff7cf577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d010e6f0 con 0x7ff7d010a140 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.571+0000 7ff7ce575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d019fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.571+0000 7ff7ce575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d019fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44138/0 (socket says 10.20.193.28:44138) 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.571+0000 7ff7ce575640 1 -- 10.20.193.28:0/2742529048 learned_addr learned my addr 10.20.193.28:0/2742529048 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:28.792 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.571+0000 7ff7ce575640 1 -- 10.20.193.28:0/2742529048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d01a0530 con 0x7ff7d010a140 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.571+0000 7ff7ce575640 1 --2- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d019fff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009a50 tx=0x7ff7c4037820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.572+0000 7ff7b77fe640 1 -- 10.20.193.28:0/2742529048 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c4047070 con 0x7ff7d010a140 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.572+0000 7ff7b77fe640 1 -- 10.20.193.28:0/2742529048 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff7c4035da0 con 0x7ff7d010a140 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.572+0000 7ff7b77fe640 1 -- 10.20.193.28:0/2742529048 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7c403c070 con 0x7ff7d010a140 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.572+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d01a07c0 con 0x7ff7d010a140 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.572+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d01a34b0 con 0x7ff7d010a140 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.572+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d010e870 con 0x7ff7d010a140 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.573+0000 7ff7b77fe640 1 -- 10.20.193.28:0/2742529048 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 10) ==== 50154+0+0 (secure 0 0 0) 0x7ff7c40426a0 con 0x7ff7d010a140 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.573+0000 7ff7b77fe640 1 --2- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a803db70 0x7ff7a8040030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.573+0000 7ff7b77fe640 1 -- 10.20.193.28:0/2742529048 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff7c4076b50 con 0x7ff7d010a140 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.573+0000 7ff7cdd74640 1 --2- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a803db70 0x7ff7a8040030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:28.793 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.574+0000 7ff7cdd74640 1 --2- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a803db70 0x7ff7a8040030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80099c0 tx=0x7ff7b8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.576+0000 7ff7b77fe640 1 -- 10.20.193.28:0/2742529048 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff7c403c210 con 0x7ff7d010a140 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.706+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7ff7d010a5c0 con 0x7ff7d010a140 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.708+0000 7ff7b77fe640 1 -- 10.20.193.28:0/2742529048 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7ff7c4035900 con 0x7ff7d010a140 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a803db70 msgr2=0x7ff7a8040030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 --2- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a803db70 0x7ff7a8040030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff7b80099c0 tx=0x7ff7b8006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 msgr2=0x7ff7d019fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 --2- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d019fff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009a50 tx=0x7ff7c4037820 comp rx=0 tx=0).stop 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 shutdown_connections 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 --2- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a803db70 0x7ff7a8040030 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.794 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 --2- 10.20.193.28:0/2742529048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7d010a140 0x7ff7d019fff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 >> 10.20.193.28:0/2742529048 conn(0x7ff7d007d710 msgr2=0x7ff7d0107690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 shutdown_connections 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout:/usr/bin/ceph: stderr 2026-02-20T03:11:28.709+0000 7ff7cf577640 1 -- 10.20.193.28:0/2742529048 wait complete. 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout:Or, if you are only running a single cluster on this host: 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.795 INFO:teuthology.orchestra.run.trial028.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-20T03:11:28.796 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.796 INFO:teuthology.orchestra.run.trial028.stdout: ceph telemetry on 2026-02-20T03:11:28.796 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.796 INFO:teuthology.orchestra.run.trial028.stdout:For more information see: 2026-02-20T03:11:28.796 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.796 INFO:teuthology.orchestra.run.trial028.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-20T03:11:28.796 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:28.796 INFO:teuthology.orchestra.run.trial028.stdout:Bootstrap complete. 2026-02-20T03:11:28.831 INFO:tasks.cephadm:Fetching config... 2026-02-20T03:11:28.832 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:11:28.832 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-20T03:11:28.870 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-20T03:11:28.870 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:11:28.870 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-20T03:11:28.949 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-20T03:11:28.949 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:11:28.949 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-20T03:11:29.046 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-20T03:11:29.046 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:11:29.047 DEBUG:teuthology.orchestra.run.trial028:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-20T03:11:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:28 trial028 ceph-mon[38552]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:28 trial028 ceph-mon[38552]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:28 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:28 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1060045905' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-20T03:11:29.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:28 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2742529048' entity='client.admin' 2026-02-20T03:11:29.126 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-20T03:11:29.127 DEBUG:teuthology.orchestra.run.trial028:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBOSUs5ziEQEAhPUVsovPJrUIq1eP2n640EVw9oSoEga ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-20T03:11:29.245 INFO:teuthology.orchestra.run.trial028.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBOSUs5ziEQEAhPUVsovPJrUIq1eP2n640EVw9oSoEga ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:29.267 DEBUG:teuthology.orchestra.run.trial126:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBOSUs5ziEQEAhPUVsovPJrUIq1eP2n640EVw9oSoEga ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-20T03:11:29.301 INFO:teuthology.orchestra.run.trial126.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBOSUs5ziEQEAhPUVsovPJrUIq1eP2n640EVw9oSoEga ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:29.311 DEBUG:teuthology.orchestra.run.trial177:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBOSUs5ziEQEAhPUVsovPJrUIq1eP2n640EVw9oSoEga ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-20T03:11:29.344 INFO:teuthology.orchestra.run.trial177.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBOSUs5ziEQEAhPUVsovPJrUIq1eP2n640EVw9oSoEga ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:29.354 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-20T03:11:29.653 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:29.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.833+0000 7fa611041640 1 -- 10.20.193.28:0/3122299122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 msgr2=0x7fa60c108d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:29.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.833+0000 7fa611041640 1 --2- 10.20.193.28:0/3122299122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 0x7fa60c108d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80099b0 tx=0x7fa5f802f2b0 comp rx=0 tx=0).stop 2026-02-20T03:11:29.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.833+0000 7fa611041640 1 -- 10.20.193.28:0/3122299122 shutdown_connections 2026-02-20T03:11:29.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.833+0000 7fa611041640 1 --2- 10.20.193.28:0/3122299122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 0x7fa60c108d10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:29.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.833+0000 7fa611041640 1 -- 10.20.193.28:0/3122299122 >> 10.20.193.28:0/3122299122 conn(0x7fa60c0778e0 msgr2=0x7fa60c079d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:29.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.833+0000 7fa611041640 1 -- 10.20.193.28:0/3122299122 shutdown_connections 2026-02-20T03:11:29.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.834+0000 7fa611041640 1 -- 10.20.193.28:0/3122299122 wait complete. 2026-02-20T03:11:29.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.834+0000 7fa611041640 1 Processor -- start 2026-02-20T03:11:29.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.834+0000 7fa611041640 1 -- start start 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.834+0000 7fa611041640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 0x7fa60c1a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa611041640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c10e8a0 con 0x7fa60c108910 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa60bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 0x7fa60c1a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa60bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 0x7fa60c1a8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44160/0 (socket says 10.20.193.28:44160) 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa60bfff640 1 -- 10.20.193.28:0/3868183684 learned_addr learned my addr 10.20.193.28:0/3868183684 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa60bfff640 1 -- 10.20.193.28:0/3868183684 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c1a8d70 con 0x7fa60c108910 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa60bfff640 1 --2- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 0x7fa60c1a8830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802f860 tx=0x7fa5f8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa6097fa640 1 -- 10.20.193.28:0/3868183684 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f8004590 con 0x7fa60c108910 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa6097fa640 1 -- 10.20.193.28:0/3868183684 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa5f8046070 con 0x7fa60c108910 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa6097fa640 1 -- 10.20.193.28:0/3868183684 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5f8041890 con 0x7fa60c108910 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.835+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c1a9000 con 0x7fa60c108910 2026-02-20T03:11:29.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.836+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c197eb0 con 0x7fa60c108910 2026-02-20T03:11:29.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.836+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c1a94e0 con 0x7fa60c108910 2026-02-20T03:11:29.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.836+0000 7fa6097fa640 1 -- 10.20.193.28:0/3868183684 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 50260+0+0 (secure 0 0 0) 0x7fa5f8038770 con 0x7fa60c108910 2026-02-20T03:11:29.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.837+0000 7fa6097fa640 1 --2- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5e003dde0 0x7fa5e00402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:29.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.837+0000 7fa6097fa640 1 -- 10.20.193.28:0/3868183684 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa5f8076eb0 con 0x7fa60c108910 2026-02-20T03:11:29.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.837+0000 7fa60b7fe640 1 --2- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5e003dde0 0x7fa5e00402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:29.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.838+0000 7fa60b7fe640 1 --2- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5e003dde0 0x7fa5e00402a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0099c0 tx=0x7fa5fc006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:29.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.841+0000 7fa6097fa640 1 -- 10.20.193.28:0/3868183684 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa5f8038a90 con 0x7fa60c108910 2026-02-20T03:11:29.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.935+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fa60c10f040 con 0x7fa60c108910 2026-02-20T03:11:29.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.938+0000 7fa6097fa640 1 -- 10.20.193.28:0/3868183684 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fa60c10f040 con 0x7fa60c108910 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5e003dde0 msgr2=0x7fa5e00402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 --2- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5e003dde0 0x7fa5e00402a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0099c0 tx=0x7fa5fc006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 msgr2=0x7fa60c1a8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 --2- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 0x7fa60c1a8830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5f802f860 tx=0x7fa5f8004290 comp rx=0 tx=0).stop 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 shutdown_connections 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 --2- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5e003dde0 0x7fa5e00402a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 --2- 10.20.193.28:0/3868183684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa60c108910 0x7fa60c1a8830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 >> 10.20.193.28:0/3868183684 conn(0x7fa60c0778e0 msgr2=0x7fa60c078280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 shutdown_connections 2026-02-20T03:11:29.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:29.940+0000 7fa611041640 1 -- 10.20.193.28:0/3868183684 wait complete. 2026-02-20T03:11:30.006 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:29 trial028 ceph-mon[38552]: mgrmap e11: x(active, since 2s) 2026-02-20T03:11:30.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:30.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:30.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:11:30.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:30.008 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:30.008 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:30.054 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-20T03:11:30.054 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-20T03:11:30.327 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:30.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.759+0000 7f22fe2c7640 1 -- 10.20.193.28:0/176670143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 msgr2=0x7f22f8104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.759+0000 7f22fe2c7640 1 --2- 10.20.193.28:0/176670143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 0x7f22f8104820 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22e80099b0 tx=0x7f22e802f2b0 comp rx=0 tx=0).stop 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.759+0000 7f22fe2c7640 1 -- 10.20.193.28:0/176670143 shutdown_connections 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.759+0000 7f22fe2c7640 1 --2- 10.20.193.28:0/176670143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 0x7f22f8104820 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.759+0000 7f22fe2c7640 1 -- 10.20.193.28:0/176670143 >> 10.20.193.28:0/176670143 conn(0x7f22f80ffd70 msgr2=0x7f22f8102160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.759+0000 7f22fe2c7640 1 -- 10.20.193.28:0/176670143 shutdown_connections 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.759+0000 7f22fe2c7640 1 -- 10.20.193.28:0/176670143 wait complete. 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.760+0000 7f22fe2c7640 1 Processor -- start 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.760+0000 7f22fe2c7640 1 -- start start 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.760+0000 7f22fe2c7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 0x7f22f819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:30.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.760+0000 7f22fe2c7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22f810a3b0 con 0x7f22f8104420 2026-02-20T03:11:30.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.760+0000 7f22fd2c5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 0x7f22f819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:30.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.760+0000 7f22fd2c5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 0x7f22f819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44184/0 (socket says 10.20.193.28:44184) 2026-02-20T03:11:30.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.760+0000 7f22fd2c5640 1 -- 10.20.193.28:0/3367581362 learned_addr learned my addr 10.20.193.28:0/3367581362 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:30.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.761+0000 7f22fd2c5640 1 -- 10.20.193.28:0/3367581362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f819bf00 con 0x7f22f8104420 2026-02-20T03:11:30.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.761+0000 7f22fd2c5640 1 --2- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 0x7f22f819b9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22e802f860 tx=0x7f22e8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:30.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.761+0000 7f22e67fc640 1 -- 10.20.193.28:0/3367581362 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e8004590 con 0x7f22f8104420 2026-02-20T03:11:30.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.761+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f819c190 con 0x7f22f8104420 2026-02-20T03:11:30.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.761+0000 7f22e67fc640 1 -- 10.20.193.28:0/3367581362 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22e8004590 con 0x7f22f8104420 2026-02-20T03:11:30.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.761+0000 7f22e67fc640 1 -- 10.20.193.28:0/3367581362 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22e80417a0 con 0x7f22f8104420 2026-02-20T03:11:30.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.761+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f819ee80 con 0x7f22f8104420 2026-02-20T03:11:30.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.762+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f810ab50 con 0x7f22f8104420 2026-02-20T03:11:30.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.762+0000 7f22e67fc640 1 -- 10.20.193.28:0/3367581362 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 50260+0+0 (secure 0 0 0) 0x7f22e8038770 con 0x7f22f8104420 2026-02-20T03:11:30.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.763+0000 7f22e67fc640 1 --2- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d403ddd0 0x7f22d4040290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:30.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.763+0000 7f22e67fc640 1 -- 10.20.193.28:0/3367581362 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f22e8076c10 con 0x7f22f8104420 2026-02-20T03:11:30.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.763+0000 7f22fcac4640 1 --2- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d403ddd0 0x7f22d4040290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:30.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.763+0000 7f22fcac4640 1 --2- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d403ddd0 0x7f22d4040290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0099c0 tx=0x7f22ec006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:30.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.765+0000 7f22e67fc640 1 -- 10.20.193.28:0/3367581362 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f22e8038a90 con 0x7f22f8104420 2026-02-20T03:11:30.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.862+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f22f8195080 con 0x7f22d403ddd0 2026-02-20T03:11:30.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.865+0000 7f22e67fc640 1 -- 10.20.193.28:0/3367581362 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f22f8195080 con 0x7f22d403ddd0 2026-02-20T03:11:30.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.867+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d403ddd0 msgr2=0x7f22d4040290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:30.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.867+0000 7f22fe2c7640 1 --2- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d403ddd0 0x7f22d4040290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0099c0 tx=0x7f22ec006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:30.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.867+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 msgr2=0x7f22f819b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:30.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.867+0000 7f22fe2c7640 1 --2- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 0x7f22f819b9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22e802f860 tx=0x7f22e8004290 comp rx=0 tx=0).stop 2026-02-20T03:11:30.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.867+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 shutdown_connections 2026-02-20T03:11:30.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.867+0000 7f22fe2c7640 1 --2- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d403ddd0 0x7f22d4040290 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:30.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.867+0000 7f22fe2c7640 1 --2- 10.20.193.28:0/3367581362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f8104420 0x7f22f819b9c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:30.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.867+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 >> 10.20.193.28:0/3367581362 conn(0x7f22f80ffd70 msgr2=0x7f22f8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:30.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.867+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 shutdown_connections 2026-02-20T03:11:30.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:30.868+0000 7f22fe2c7640 1 -- 10.20.193.28:0/3367581362 wait complete. 2026-02-20T03:11:30.968 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial126 2026-02-20T03:11:30.968 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:11:30.969 DEBUG:teuthology.orchestra.run.trial126:> dd of=/etc/ceph/ceph.conf 2026-02-20T03:11:30.987 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:11:30.987 DEBUG:teuthology.orchestra.run.trial126:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:31.043 INFO:tasks.cephadm:Adding host trial126 to orchestrator... 2026-02-20T03:11:31.044 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch host add trial126 2026-02-20T03:11:31.310 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:31.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:30 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3868183684' entity='client.admin' 2026-02-20T03:11:31.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:31.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:31.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:31.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:31.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:31.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:31.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.495+0000 7f6aad281640 1 -- 10.20.193.28:0/4044961809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 msgr2=0x7f6aa8104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:31.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.495+0000 7f6aad281640 1 --2- 10.20.193.28:0/4044961809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 0x7f6aa8104820 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6a940099b0 tx=0x7f6a9402f2b0 comp rx=0 tx=0).stop 2026-02-20T03:11:31.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.495+0000 7f6aad281640 1 -- 10.20.193.28:0/4044961809 shutdown_connections 2026-02-20T03:11:31.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.495+0000 7f6aad281640 1 --2- 10.20.193.28:0/4044961809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 0x7f6aa8104820 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:31.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.495+0000 7f6aad281640 1 -- 10.20.193.28:0/4044961809 >> 10.20.193.28:0/4044961809 conn(0x7f6aa80ffd70 msgr2=0x7f6aa8102160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:31.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.496+0000 7f6aad281640 1 -- 10.20.193.28:0/4044961809 shutdown_connections 2026-02-20T03:11:31.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.496+0000 7f6aad281640 1 -- 10.20.193.28:0/4044961809 wait complete. 2026-02-20T03:11:31.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.496+0000 7f6aad281640 1 Processor -- start 2026-02-20T03:11:31.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.496+0000 7f6aad281640 1 -- start start 2026-02-20T03:11:31.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.497+0000 7f6aad281640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 0x7f6aa819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:31.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.497+0000 7f6aad281640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa810a3b0 con 0x7f6aa8104420 2026-02-20T03:11:31.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.497+0000 7f6aa7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 0x7f6aa819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:31.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.497+0000 7f6aa7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 0x7f6aa819b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44194/0 (socket says 10.20.193.28:44194) 2026-02-20T03:11:31.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.497+0000 7f6aa7fff640 1 -- 10.20.193.28:0/2202144926 learned_addr learned my addr 10.20.193.28:0/2202144926 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:31.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.497+0000 7f6aa7fff640 1 -- 10.20.193.28:0/2202144926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa819bef0 con 0x7f6aa8104420 2026-02-20T03:11:31.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.498+0000 7f6aa7fff640 1 --2- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 0x7f6aa819b9b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a9402f860 tx=0x7f6a94004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:31.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.498+0000 7f6aa57fa640 1 -- 10.20.193.28:0/2202144926 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a94004590 con 0x7f6aa8104420 2026-02-20T03:11:31.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.498+0000 7f6aa57fa640 1 -- 10.20.193.28:0/2202144926 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6a94046070 con 0x7f6aa8104420 2026-02-20T03:11:31.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.498+0000 7f6aa57fa640 1 -- 10.20.193.28:0/2202144926 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a94041890 con 0x7f6aa8104420 2026-02-20T03:11:31.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.498+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa819c180 con 0x7f6aa8104420 2026-02-20T03:11:31.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.498+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa819ee70 con 0x7f6aa8104420 2026-02-20T03:11:31.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.499+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa810ab50 con 0x7f6aa8104420 2026-02-20T03:11:31.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.499+0000 7f6aa57fa640 1 -- 10.20.193.28:0/2202144926 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 11) ==== 50260+0+0 (secure 0 0 0) 0x7f6a94038770 con 0x7f6aa8104420 2026-02-20T03:11:31.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.499+0000 7f6aa57fa640 1 --2- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a7c03dde0 0x7f6a7c0402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:31.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.499+0000 7f6aa57fa640 1 -- 10.20.193.28:0/2202144926 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6a94076c60 con 0x7f6aa8104420 2026-02-20T03:11:31.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.500+0000 7f6aa77fe640 1 --2- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a7c03dde0 0x7f6a7c0402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:31.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.500+0000 7f6aa77fe640 1 --2- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a7c03dde0 0x7f6a7c0402a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a980099c0 tx=0x7f6a98006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:31.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.502+0000 7f6aa57fa640 1 -- 10.20.193.28:0/2202144926 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6a94038a90 con 0x7f6aa8104420 2026-02-20T03:11:31.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:31.595+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial126", "target": ["mon-mgr", ""]}) -- 0x7f6aa8194de0 con 0x7f6a7c03dde0 2026-02-20T03:11:32.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:31 trial028 ceph-mon[38552]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:32.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:31 trial028 ceph-mon[38552]: Updating trial028:/etc/ceph/ceph.conf 2026-02-20T03:11:32.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:31 trial028 ceph-mon[38552]: Updating trial028:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:32.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:32.941+0000 7f6aa57fa640 1 -- 10.20.193.28:0/2202144926 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7f6a94048310 con 0x7f6aa8104420 2026-02-20T03:11:33.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.041+0000 7f6aa57fa640 1 -- 10.20.193.28:0/2202144926 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f6aa8194de0 con 0x7f6a7c03dde0 2026-02-20T03:11:33.044 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial126' with addr '10.20.193.126' 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a7c03dde0 msgr2=0x7f6a7c0402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 --2- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a7c03dde0 0x7f6a7c0402a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a980099c0 tx=0x7f6a98006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 msgr2=0x7f6aa819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 --2- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 0x7f6aa819b9b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a9402f860 tx=0x7f6a94004290 comp rx=0 tx=0).stop 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 shutdown_connections 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 --2- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a7c03dde0 0x7f6a7c0402a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 --2- 10.20.193.28:0/2202144926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6aa8104420 0x7f6aa819b9b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 >> 10.20.193.28:0/2202144926 conn(0x7f6aa80ffd70 msgr2=0x7f6aa8101640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 shutdown_connections 2026-02-20T03:11:33.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.044+0000 7f6aad281640 1 -- 10.20.193.28:0/2202144926 wait complete. 2026-02-20T03:11:33.147 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-20T03:11:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:33 trial028 ceph-mon[38552]: Updating trial028:/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:33 trial028 ceph-mon[38552]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial126", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:33.197 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:33 trial028 ceph-mon[38552]: Updating trial028:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T03:11:33.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:33 trial028 ceph-mon[38552]: Deploying cephadm binary to trial126 2026-02-20T03:11:33.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:33.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:33.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:33.198 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:33 trial028 ceph-mon[38552]: mgrmap e12: x(active, since 6s) 2026-02-20T03:11:33.406 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:33.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.588+0000 7f901bfff640 1 -- 10.20.193.28:0/375674201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 msgr2=0x7f901c109860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:33.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.588+0000 7f901bfff640 1 --2- 10.20.193.28:0/375674201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 0x7f901c109860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f90100099b0 tx=0x7f901002f2b0 comp rx=0 tx=0).stop 2026-02-20T03:11:33.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.588+0000 7f901bfff640 1 -- 10.20.193.28:0/375674201 shutdown_connections 2026-02-20T03:11:33.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.588+0000 7f901bfff640 1 --2- 10.20.193.28:0/375674201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 0x7f901c109860 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:33.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.588+0000 7f901bfff640 1 -- 10.20.193.28:0/375674201 >> 10.20.193.28:0/375674201 conn(0x7f901c0758a0 msgr2=0x7f901c077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:33.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.588+0000 7f901bfff640 1 -- 10.20.193.28:0/375674201 shutdown_connections 2026-02-20T03:11:33.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.588+0000 7f901bfff640 1 -- 10.20.193.28:0/375674201 wait complete. 2026-02-20T03:11:33.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.589+0000 7f901bfff640 1 Processor -- start 2026-02-20T03:11:33.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.589+0000 7f901bfff640 1 -- start start 2026-02-20T03:11:33.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.589+0000 7f901bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 0x7f901c1a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:33.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.589+0000 7f901bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f901c112db0 con 0x7f901c109480 2026-02-20T03:11:33.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.589+0000 7f901affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 0x7f901c1a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.589+0000 7f901affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 0x7f901c1a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44218/0 (socket says 10.20.193.28:44218) 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.589+0000 7f901affd640 1 -- 10.20.193.28:0/1951933932 learned_addr learned my addr 10.20.193.28:0/1951933932 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.589+0000 7f901affd640 1 -- 10.20.193.28:0/1951933932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c1a0800 con 0x7f901c109480 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.590+0000 7f901affd640 1 --2- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 0x7f901c1a02c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9010002980 tx=0x7f90100029b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.590+0000 7f8ffbfff640 1 -- 10.20.193.28:0/1951933932 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9010047070 con 0x7f901c109480 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.590+0000 7f8ffbfff640 1 -- 10.20.193.28:0/1951933932 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f901003e070 con 0x7f901c109480 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.590+0000 7f8ffbfff640 1 -- 10.20.193.28:0/1951933932 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9010042710 con 0x7f901c109480 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.590+0000 7f901bfff640 1 -- 10.20.193.28:0/1951933932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c1a0af0 con 0x7f901c109480 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.590+0000 7f901bfff640 1 -- 10.20.193.28:0/1951933932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c1a4b90 con 0x7f901c109480 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.590+0000 7f8ff9ffb640 1 -- 10.20.193.28:0/1951933932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f901c079100 con 0x7f901c109480 2026-02-20T03:11:33.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.591+0000 7f8ffbfff640 1 -- 10.20.193.28:0/1951933932 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7f9010038770 con 0x7f901c109480 2026-02-20T03:11:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.591+0000 7f8ffbfff640 1 --2- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ff003dce0 0x7f8ff00401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.591+0000 7f8ffbfff640 1 -- 10.20.193.28:0/1951933932 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9010076b90 con 0x7f901c109480 2026-02-20T03:11:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.592+0000 7f901a7fc640 1 --2- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ff003dce0 0x7f8ff00401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:33.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.592+0000 7f901a7fc640 1 --2- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ff003dce0 0x7f8ff00401a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f90040099c0 tx=0x7f9004006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:33.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.594+0000 7f8ffbfff640 1 -- 10.20.193.28:0/1951933932 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f901004a360 con 0x7f901c109480 2026-02-20T03:11:33.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.688+0000 7f8ff9ffb640 1 -- 10.20.193.28:0/1951933932 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f901c1098e0 con 0x7f8ff003dce0 2026-02-20T03:11:33.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.689+0000 7f8ffbfff640 1 -- 10.20.193.28:0/1951933932 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f901c1098e0 con 0x7f8ff003dce0 2026-02-20T03:11:33.692 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:33.692 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.126", "hostname": "trial126", "labels": [], "status": ""}] 2026-02-20T03:11:33.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.690+0000 7f8ff9ffb640 1 -- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ff003dce0 msgr2=0x7f8ff00401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:33.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.690+0000 7f8ff9ffb640 1 --2- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ff003dce0 0x7f8ff00401a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f90040099c0 tx=0x7f9004006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:33.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.690+0000 7f8ff9ffb640 1 -- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 msgr2=0x7f901c1a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:33.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.690+0000 7f8ff9ffb640 1 --2- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 0x7f901c1a02c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9010002980 tx=0x7f90100029b0 comp rx=0 tx=0).stop 2026-02-20T03:11:33.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.690+0000 7f8ff9ffb640 1 -- 10.20.193.28:0/1951933932 shutdown_connections 2026-02-20T03:11:33.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.690+0000 7f8ff9ffb640 1 --2- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ff003dce0 0x7f8ff00401a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:33.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.690+0000 7f8ff9ffb640 1 --2- 10.20.193.28:0/1951933932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f901c109480 0x7f901c1a02c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:33.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.690+0000 7f8ff9ffb640 1 -- 10.20.193.28:0/1951933932 >> 10.20.193.28:0/1951933932 conn(0x7f901c0758a0 msgr2=0x7f901c076630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:33.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.691+0000 7f8ff9ffb640 1 -- 10.20.193.28:0/1951933932 shutdown_connections 2026-02-20T03:11:33.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:33.691+0000 7f8ff9ffb640 1 -- 10.20.193.28:0/1951933932 wait complete. 2026-02-20T03:11:33.793 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial177 2026-02-20T03:11:33.794 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:11:33.794 DEBUG:teuthology.orchestra.run.trial177:> dd of=/etc/ceph/ceph.conf 2026-02-20T03:11:33.812 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:11:33.813 DEBUG:teuthology.orchestra.run.trial177:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:33.869 INFO:tasks.cephadm:Adding host trial177 to orchestrator... 2026-02-20T03:11:33.870 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch host add trial177 2026-02-20T03:11:34.123 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:34.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.301+0000 7f58f5844640 1 -- 10.20.193.28:0/772918828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 msgr2=0x7f58f0102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:34.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.301+0000 7f58f5844640 1 --2- 10.20.193.28:0/772918828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 0x7f58f0102780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f58e00099b0 tx=0x7f58e002f2b0 comp rx=0 tx=0).stop 2026-02-20T03:11:34.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.301+0000 7f58f5844640 1 -- 10.20.193.28:0/772918828 shutdown_connections 2026-02-20T03:11:34.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.301+0000 7f58f5844640 1 --2- 10.20.193.28:0/772918828 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 0x7f58f0102780 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:34.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.301+0000 7f58f5844640 1 -- 10.20.193.28:0/772918828 >> 10.20.193.28:0/772918828 conn(0x7f58f00fde20 msgr2=0x7f58f0100240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:34.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.301+0000 7f58f5844640 1 -- 10.20.193.28:0/772918828 shutdown_connections 2026-02-20T03:11:34.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.301+0000 7f58f5844640 1 -- 10.20.193.28:0/772918828 wait complete. 2026-02-20T03:11:34.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:34.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:34 trial028 ceph-mon[38552]: Added host trial126 2026-02-20T03:11:34.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:34.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:34.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.302+0000 7f58f5844640 1 Processor -- start 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.302+0000 7f58f5844640 1 -- start start 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58f5844640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 0x7f58f019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58f5844640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f58f010c660 con 0x7f58f01023a0 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58f4842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 0x7f58f019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58f4842640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 0x7f58f019bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44240/0 (socket says 10.20.193.28:44240) 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58f4842640 1 -- 10.20.193.28:0/3184874936 learned_addr learned my addr 10.20.193.28:0/3184874936 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58f4842640 1 -- 10.20.193.28:0/3184874936 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f019c2c0 con 0x7f58f01023a0 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58f4842640 1 --2- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 0x7f58f019bd80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58e0002410 tx=0x7f58e00028f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58e5ffb640 1 -- 10.20.193.28:0/3184874936 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e0047070 con 0x7f58f01023a0 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58e5ffb640 1 -- 10.20.193.28:0/3184874936 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58e003e070 con 0x7f58f01023a0 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58e5ffb640 1 -- 10.20.193.28:0/3184874936 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58e0042680 con 0x7f58f01023a0 2026-02-20T03:11:34.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f019c5b0 con 0x7f58f01023a0 2026-02-20T03:11:34.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.303+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f01a0650 con 0x7f58f01023a0 2026-02-20T03:11:34.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.304+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b8005390 con 0x7f58f01023a0 2026-02-20T03:11:34.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.304+0000 7f58e5ffb640 1 -- 10.20.193.28:0/3184874936 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7f58e0004260 con 0x7f58f01023a0 2026-02-20T03:11:34.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.305+0000 7f58e5ffb640 1 --2- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58cc03dd30 0x7f58cc0401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:34.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.305+0000 7f58e5ffb640 1 -- 10.20.193.28:0/3184874936 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f58e0076b80 con 0x7f58f01023a0 2026-02-20T03:11:34.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.305+0000 7f58e7fff640 1 --2- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58cc03dd30 0x7f58cc0401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:34.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.306+0000 7f58e7fff640 1 --2- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58cc03dd30 0x7f58cc0401f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58d80099c0 tx=0x7f58d8006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:34.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.307+0000 7f58e5ffb640 1 -- 10.20.193.28:0/3184874936 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f58e0007c50 con 0x7f58f01023a0 2026-02-20T03:11:34.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:34.399+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial177", "target": ["mon-mgr", ""]}) -- 0x7f58b8002bf0 con 0x7f58cc03dd30 2026-02-20T03:11:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:35 trial028 ceph-mon[38552]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:11:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:trial126", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:11:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:35.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:35.996+0000 7f58e5ffb640 1 -- 10.20.193.28:0/3184874936 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f58b8002bf0 con 0x7f58cc03dd30 2026-02-20T03:11:35.999 INFO:teuthology.orchestra.run.trial028.stdout:Added host 'trial177' with addr '10.20.193.177' 2026-02-20T03:11:36.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58cc03dd30 msgr2=0x7f58cc0401f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:36.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 --2- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58cc03dd30 0x7f58cc0401f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58d80099c0 tx=0x7f58d8006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 msgr2=0x7f58f019bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:36.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 --2- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 0x7f58f019bd80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f58e0002410 tx=0x7f58e00028f0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 shutdown_connections 2026-02-20T03:11:36.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 --2- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58cc03dd30 0x7f58cc0401f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 --2- 10.20.193.28:0/3184874936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f01023a0 0x7f58f019bd80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 >> 10.20.193.28:0/3184874936 conn(0x7f58f00fde20 msgr2=0x7f58f010a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 shutdown_connections 2026-02-20T03:11:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.000+0000 7f58f5844640 1 -- 10.20.193.28:0/3184874936 wait complete. 2026-02-20T03:11:36.104 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-20T03:11:36.355 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.526+0000 7f74f26df640 1 -- 10.20.193.28:0/4123073474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 msgr2=0x7f74ec1049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.526+0000 7f74f26df640 1 --2- 10.20.193.28:0/4123073474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 0x7f74ec1049e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0099b0 tx=0x7f74dc02f2b0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.526+0000 7f74f26df640 1 -- 10.20.193.28:0/4123073474 shutdown_connections 2026-02-20T03:11:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.526+0000 7f74f26df640 1 --2- 10.20.193.28:0/4123073474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 0x7f74ec1049e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.526+0000 7f74f26df640 1 -- 10.20.193.28:0/4123073474 >> 10.20.193.28:0/4123073474 conn(0x7f74ec100080 msgr2=0x7f74ec1024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.526+0000 7f74f26df640 1 -- 10.20.193.28:0/4123073474 shutdown_connections 2026-02-20T03:11:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.526+0000 7f74f26df640 1 -- 10.20.193.28:0/4123073474 wait complete. 2026-02-20T03:11:36.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial177", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:36.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: Deploying cephadm binary to trial177 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: Updating trial126:/etc/ceph/ceph.conf 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: Updating trial126:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: Updating trial126:/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: Updating trial126:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:36.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.527+0000 7f74f26df640 1 Processor -- start 2026-02-20T03:11:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.527+0000 7f74f26df640 1 -- start start 2026-02-20T03:11:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.527+0000 7f74f26df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 0x7f74ec19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.527+0000 7f74f26df640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec10e8c0 con 0x7f74ec104600 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74f16dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 0x7f74ec19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74f16dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 0x7f74ec19bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60194/0 (socket says 10.20.193.28:60194) 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74f16dd640 1 -- 10.20.193.28:0/3673748329 learned_addr learned my addr 10.20.193.28:0/3673748329 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74f16dd640 1 -- 10.20.193.28:0/3673748329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ec19c290 con 0x7f74ec104600 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74f16dd640 1 --2- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 0x7f74ec19bd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f74dc002410 tx=0x7f74dc0028f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74da7fc640 1 -- 10.20.193.28:0/3673748329 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74dc047070 con 0x7f74ec104600 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74da7fc640 1 -- 10.20.193.28:0/3673748329 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74dc03e070 con 0x7f74ec104600 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74ec19c580 con 0x7f74ec104600 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74da7fc640 1 -- 10.20.193.28:0/3673748329 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74dc042680 con 0x7f74ec104600 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.528+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74ec1a0620 con 0x7f74ec104600 2026-02-20T03:11:36.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.529+0000 7f74da7fc640 1 -- 10.20.193.28:0/3673748329 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7f74dc004260 con 0x7f74ec104600 2026-02-20T03:11:36.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.529+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74ec105ae0 con 0x7f74ec104600 2026-02-20T03:11:36.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.530+0000 7f74da7fc640 1 --2- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74c803dce0 0x7f74c80401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:36.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.530+0000 7f74da7fc640 1 -- 10.20.193.28:0/3673748329 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f74dc0769a0 con 0x7f74ec104600 2026-02-20T03:11:36.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.530+0000 7f74f0edc640 1 --2- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74c803dce0 0x7f74c80401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:36.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.531+0000 7f74f0edc640 1 --2- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74c803dce0 0x7f74c80401a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74e00099c0 tx=0x7f74e0006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:36.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.533+0000 7f74da7fc640 1 -- 10.20.193.28:0/3673748329 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f74dc0373d0 con 0x7f74ec104600 2026-02-20T03:11:36.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.626+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74ec19d0b0 con 0x7f74c803dce0 2026-02-20T03:11:36.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.627+0000 7f74da7fc640 1 -- 10.20.193.28:0/3673748329 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+237 (secure 0 0 0) 0x7f74ec19d0b0 con 0x7f74c803dce0 2026-02-20T03:11:36.630 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:36.630 INFO:teuthology.orchestra.run.trial028.stdout:[{"addr": "10.20.193.28", "hostname": "trial028", "labels": [], "status": ""}, {"addr": "10.20.193.126", "hostname": "trial126", "labels": [], "status": ""}, {"addr": "10.20.193.177", "hostname": "trial177", "labels": [], "status": ""}] 2026-02-20T03:11:36.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74c803dce0 msgr2=0x7f74c80401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:36.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 --2- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74c803dce0 0x7f74c80401a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74e00099c0 tx=0x7f74e0006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 msgr2=0x7f74ec19bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:36.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 --2- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 0x7f74ec19bd50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f74dc002410 tx=0x7f74dc0028f0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 shutdown_connections 2026-02-20T03:11:36.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 --2- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74c803dce0 0x7f74c80401a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 --2- 10.20.193.28:0/3673748329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74ec104600 0x7f74ec19bd50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:36.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 >> 10.20.193.28:0/3673748329 conn(0x7f74ec100080 msgr2=0x7f74ec10c030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:36.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 shutdown_connections 2026-02-20T03:11:36.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:36.628+0000 7f74f26df640 1 -- 10.20.193.28:0/3673748329 wait complete. 2026-02-20T03:11:36.765 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-20T03:11:36.765 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd crush tunables default 2026-02-20T03:11:37.017 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:37.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.198+0000 7f8c0b282640 1 -- 10.20.193.28:0/2862525366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 msgr2=0x7f8c0410aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:37.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.198+0000 7f8c0b282640 1 --2- 10.20.193.28:0/2862525366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 0x7f8c0410aa30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40099b0 tx=0x7f8bf402f2b0 comp rx=0 tx=0).stop 2026-02-20T03:11:37.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.198+0000 7f8c0b282640 1 -- 10.20.193.28:0/2862525366 shutdown_connections 2026-02-20T03:11:37.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.198+0000 7f8c0b282640 1 --2- 10.20.193.28:0/2862525366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 0x7f8c0410aa30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:37.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.198+0000 7f8c0b282640 1 -- 10.20.193.28:0/2862525366 >> 10.20.193.28:0/2862525366 conn(0x7f8c04100260 msgr2=0x7f8c04102680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:37.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.199+0000 7f8c0b282640 1 -- 10.20.193.28:0/2862525366 shutdown_connections 2026-02-20T03:11:37.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.199+0000 7f8c0b282640 1 -- 10.20.193.28:0/2862525366 wait complete. 2026-02-20T03:11:37.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.199+0000 7f8c0b282640 1 Processor -- start 2026-02-20T03:11:37.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.199+0000 7f8c0b282640 1 -- start start 2026-02-20T03:11:37.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.200+0000 7f8c0b282640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 0x7f8c040744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:37.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.200+0000 7f8c0b282640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0410eaf0 con 0x7f8c0410a650 2026-02-20T03:11:37.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.200+0000 7f8c08ff7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 0x7f8c040744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:37.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.200+0000 7f8c08ff7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 0x7f8c040744a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60216/0 (socket says 10.20.193.28:60216) 2026-02-20T03:11:37.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.200+0000 7f8c08ff7640 1 -- 10.20.193.28:0/287345299 learned_addr learned my addr 10.20.193.28:0/287345299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:37.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.200+0000 7f8c08ff7640 1 -- 10.20.193.28:0/287345299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c040749e0 con 0x7f8c0410a650 2026-02-20T03:11:37.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.200+0000 7f8c08ff7640 1 --2- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 0x7f8c040744a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4002410 tx=0x7f8bf40028f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:37.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.201+0000 7f8bf9ffb640 1 -- 10.20.193.28:0/287345299 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf4047070 con 0x7f8c0410a650 2026-02-20T03:11:37.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.201+0000 7f8bf9ffb640 1 -- 10.20.193.28:0/287345299 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8bf403e070 con 0x7f8c0410a650 2026-02-20T03:11:37.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.201+0000 7f8bf9ffb640 1 -- 10.20.193.28:0/287345299 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bf4042680 con 0x7f8c0410a650 2026-02-20T03:11:37.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.201+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c04074c70 con 0x7f8c0410a650 2026-02-20T03:11:37.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.201+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c040750d0 con 0x7f8c0410a650 2026-02-20T03:11:37.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.201+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c04105cc0 con 0x7f8c0410a650 2026-02-20T03:11:37.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.201+0000 7f8bf9ffb640 1 -- 10.20.193.28:0/287345299 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7f8bf4004260 con 0x7f8c0410a650 2026-02-20T03:11:37.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.202+0000 7f8bf9ffb640 1 --2- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8be003dce0 0x7f8be00401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:37.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.202+0000 7f8bf9ffb640 1 -- 10.20.193.28:0/287345299 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8bf4076ac0 con 0x7f8c0410a650 2026-02-20T03:11:37.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.202+0000 7f8bfbfff640 1 --2- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8be003dce0 0x7f8be00401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:37.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.203+0000 7f8bfbfff640 1 --2- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8be003dce0 0x7f8be00401a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0099c0 tx=0x7f8bec006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:37.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.206+0000 7f8bf9ffb640 1 -- 10.20.193.28:0/287345299 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8bf404bdd0 con 0x7f8c0410a650 2026-02-20T03:11:37.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:37.299+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8c04072760 con 0x7f8c0410a650 2026-02-20T03:11:37.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:37 trial028 ceph-mon[38552]: Added host trial177 2026-02-20T03:11:37.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:37.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:37.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:37 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/287345299' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-20T03:11:38.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.202+0000 7f8bf9ffb640 1 -- 10.20.193.28:0/287345299 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f8bf404c440 con 0x7f8c0410a650 2026-02-20T03:11:38.205 INFO:teuthology.orchestra.run.trial028.stderr:adjusted tunables profile to default 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8be003dce0 msgr2=0x7f8be00401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 --2- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8be003dce0 0x7f8be00401a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0099c0 tx=0x7f8bec006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 msgr2=0x7f8c040744a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 --2- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 0x7f8c040744a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4002410 tx=0x7f8bf40028f0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 shutdown_connections 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 --2- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8be003dce0 0x7f8be00401a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 --2- 10.20.193.28:0/287345299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c0410a650 0x7f8c040744a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 >> 10.20.193.28:0/287345299 conn(0x7f8c04100260 msgr2=0x7f8c04108150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 shutdown_connections 2026-02-20T03:11:38.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:38.204+0000 7f8c0b282640 1 -- 10.20.193.28:0/287345299 wait complete. 2026-02-20T03:11:38.307 INFO:tasks.cephadm:Adding mon.a on trial028 2026-02-20T03:11:38.307 INFO:tasks.cephadm:Adding mon.b on trial126 2026-02-20T03:11:38.308 INFO:tasks.cephadm:Adding mon.c on trial177 2026-02-20T03:11:38.308 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch apply mon '3;trial028:10.20.193.28=a;trial126:10.20.193.126=b;trial177:10.20.193.177=c' 2026-02-20T03:11:38.452 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:38.566 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.565+0000 7f5493a78640 1 -- 10.20.193.177:0/528237154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 msgr2=0x7f548c10aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:38.566 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.565+0000 7f5493a78640 1 --2- 10.20.193.177:0/528237154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 0x7f548c10aa30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f547c0099b0 tx=0x7f547c02f2b0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.566 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.565+0000 7f5493a78640 1 -- 10.20.193.177:0/528237154 shutdown_connections 2026-02-20T03:11:38.567 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.565+0000 7f5493a78640 1 --2- 10.20.193.177:0/528237154 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 0x7f548c10aa30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.567 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.565+0000 7f5493a78640 1 -- 10.20.193.177:0/528237154 >> 10.20.193.177:0/528237154 conn(0x7f548c100260 msgr2=0x7f548c102680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:38.567 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.565+0000 7f5493a78640 1 -- 10.20.193.177:0/528237154 shutdown_connections 2026-02-20T03:11:38.567 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.565+0000 7f5493a78640 1 -- 10.20.193.177:0/528237154 wait complete. 2026-02-20T03:11:38.567 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.566+0000 7f5493a78640 1 Processor -- start 2026-02-20T03:11:38.567 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.566+0000 7f5493a78640 1 -- start start 2026-02-20T03:11:38.567 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.566+0000 7f5493a78640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 0x7f548c19bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:38.567 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.566+0000 7f5493a78640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f548c10eaf0 con 0x7f548c10a650 2026-02-20T03:11:38.567 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.566+0000 7f54917ed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 0x7f548c19bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.566+0000 7f54917ed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 0x7f548c19bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.177:44260/0 (socket says 10.20.193.177:44260) 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.566+0000 7f54917ed640 1 -- 10.20.193.177:0/2454808933 learned_addr learned my addr 10.20.193.177:0/2454808933 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.566+0000 7f54917ed640 1 -- 10.20.193.177:0/2454808933 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c19c4c0 con 0x7f548c10a650 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.567+0000 7f54917ed640 1 --2- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 0x7f548c19bf80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f547c002410 tx=0x7f547c0028f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.567+0000 7f547a7fc640 1 -- 10.20.193.177:0/2454808933 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c047070 con 0x7f548c10a650 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.567+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548c19c750 con 0x7f548c10a650 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.567+0000 7f547a7fc640 1 -- 10.20.193.177:0/2454808933 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f547c03e070 con 0x7f548c10a650 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.567+0000 7f547a7fc640 1 -- 10.20.193.177:0/2454808933 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c042680 con 0x7f548c10a650 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.567+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548c19cbb0 con 0x7f548c10a650 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.567+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548c105cc0 con 0x7f548c10a650 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.568+0000 7f547a7fc640 1 -- 10.20.193.177:0/2454808933 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7f547c004260 con 0x7f548c10a650 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.568+0000 7f547a7fc640 1 --2- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f546803dc90 0x7f5468040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:38.568 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.568+0000 7f547a7fc640 1 -- 10.20.193.177:0/2454808933 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f547c076d20 con 0x7f548c10a650 2026-02-20T03:11:38.569 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.568+0000 7f5490fec640 1 --2- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f546803dc90 0x7f5468040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:38.570 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.569+0000 7f5490fec640 1 --2- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f546803dc90 0x7f5468040150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54800099c0 tx=0x7f5480006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:38.571 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.571+0000 7f547a7fc640 1 -- 10.20.193.177:0/2454808933 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f547c037e10 con 0x7f548c10a650 2026-02-20T03:11:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:11:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:11:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:38.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/287345299' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-20T03:11:38.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:38 trial028 ceph-mon[38552]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T03:11:38.659 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.658+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;trial028:10.20.193.28=a;trial126:10.20.193.126=b;trial177:10.20.193.177=c", "target": ["mon-mgr", ""]}) -- 0x7f548c100d50 con 0x7f546803dc90 2026-02-20T03:11:38.663 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.663+0000 7f547a7fc640 1 -- 10.20.193.177:0/2454808933 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f548c100d50 con 0x7f546803dc90 2026-02-20T03:11:38.664 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled mon update... 2026-02-20T03:11:38.665 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f546803dc90 msgr2=0x7f5468040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:38.665 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 --2- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f546803dc90 0x7f5468040150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f54800099c0 tx=0x7f5480006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.665 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 msgr2=0x7f548c19bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:38.665 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 --2- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 0x7f548c19bf80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f547c002410 tx=0x7f547c0028f0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.665 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 shutdown_connections 2026-02-20T03:11:38.665 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 --2- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f546803dc90 0x7f5468040150 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.665 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 --2- 10.20.193.177:0/2454808933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f548c10a650 0x7f548c19bf80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:38.665 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 >> 10.20.193.177:0/2454808933 conn(0x7f548c100260 msgr2=0x7f548c100640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:38.666 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 shutdown_connections 2026-02-20T03:11:38.666 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:38.664+0000 7f5493a78640 1 -- 10.20.193.177:0/2454808933 wait complete. 2026-02-20T03:11:38.701 DEBUG:teuthology.orchestra.run.trial126:mon.b> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.b.service 2026-02-20T03:11:38.705 DEBUG:teuthology.orchestra.run.trial177:mon.c> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.c.service 2026-02-20T03:11:38.708 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-20T03:11:38.709 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T03:11:38.915 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:39.041 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.039+0000 7f0e75ad8640 1 -- 10.20.193.177:0/88025955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 msgr2=0x7f0e70101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.039+0000 7f0e75ad8640 1 --2- 10.20.193.177:0/88025955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 0x7f0e70101430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e600099b0 tx=0x7f0e6002f340 comp rx=0 tx=0).stop 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.039+0000 7f0e75ad8640 1 -- 10.20.193.177:0/88025955 shutdown_connections 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.039+0000 7f0e75ad8640 1 --2- 10.20.193.177:0/88025955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 0x7f0e70101430 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.039+0000 7f0e75ad8640 1 -- 10.20.193.177:0/88025955 >> 10.20.193.177:0/88025955 conn(0x7f0e700fcca0 msgr2=0x7f0e700ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.039+0000 7f0e75ad8640 1 -- 10.20.193.177:0/88025955 shutdown_connections 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.039+0000 7f0e75ad8640 1 -- 10.20.193.177:0/88025955 wait complete. 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.039+0000 7f0e75ad8640 1 Processor -- start 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.039+0000 7f0e75ad8640 1 -- start start 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e75ad8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 0x7f0e701a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:39.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e75ad8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70112df0 con 0x7f0e70101050 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e74ad6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 0x7f0e701a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e74ad6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 0x7f0e701a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.177:44286/0 (socket says 10.20.193.177:44286) 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e74ad6640 1 -- 10.20.193.177:0/716604943 learned_addr learned my addr 10.20.193.177:0/716604943 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e74ad6640 1 -- 10.20.193.177:0/716604943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e701a07f0 con 0x7f0e70101050 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e74ad6640 1 --2- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 0x7f0e701a02b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e60002410 tx=0x7f0e60004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e65ffb640 1 -- 10.20.193.177:0/716604943 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e60038470 con 0x7f0e70101050 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e65ffb640 1 -- 10.20.193.177:0/716604943 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0e60046070 con 0x7f0e70101050 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e701a0a80 con 0x7f0e70101050 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.040+0000 7f0e65ffb640 1 -- 10.20.193.177:0/716604943 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e600417f0 con 0x7f0e70101050 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.041+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e701a0ee0 con 0x7f0e70101050 2026-02-20T03:11:39.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.041+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e7006b2a0 con 0x7f0e70101050 2026-02-20T03:11:39.044 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.041+0000 7f0e65ffb640 1 -- 10.20.193.177:0/716604943 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7f0e60038610 con 0x7f0e70101050 2026-02-20T03:11:39.044 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.041+0000 7f0e65ffb640 1 --2- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e4c03dce0 0x7f0e4c0401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:39.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.041+0000 7f0e65ffb640 1 -- 10.20.193.177:0/716604943 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0e60077110 con 0x7f0e70101050 2026-02-20T03:11:39.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.042+0000 7f0e67fff640 1 --2- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e4c03dce0 0x7f0e4c0401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:39.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.042+0000 7f0e67fff640 1 --2- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e4c03dce0 0x7f0e4c0401a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0e580099c0 tx=0x7f0e58006eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:39.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.044+0000 7f0e65ffb640 1 -- 10.20.193.177:0/716604943 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0e60035320 con 0x7f0e70101050 2026-02-20T03:11:39.163 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.161+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0e701a4b80 con 0x7f0e70101050 2026-02-20T03:11:39.163 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:11:39.163 INFO:teuthology.orchestra.run.trial177.stdout:{"epoch":1,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","modified":"2026-02-20T03:11:01.094372Z","created":"2026-02-20T03:11:01.094372Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-20T03:11:39.164 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.162+0000 7f0e65ffb640 1 -- 10.20.193.177:0/716604943 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f0e60036370 con 0x7f0e70101050 2026-02-20T03:11:39.164 INFO:teuthology.orchestra.run.trial177.stderr:dumped monmap epoch 1 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e4c03dce0 msgr2=0x7f0e4c0401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 --2- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e4c03dce0 0x7f0e4c0401a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0e580099c0 tx=0x7f0e58006eb0 comp rx=0 tx=0).stop 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 msgr2=0x7f0e701a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 --2- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 0x7f0e701a02b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0e60002410 tx=0x7f0e60004290 comp rx=0 tx=0).stop 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 shutdown_connections 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 --2- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e4c03dce0 0x7f0e4c0401a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 --2- 10.20.193.177:0/716604943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e70101050 0x7f0e701a02b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 >> 10.20.193.177:0/716604943 conn(0x7f0e700fcca0 msgr2=0x7f0e700fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 shutdown_connections 2026-02-20T03:11:39.165 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:39.164+0000 7f0e75ad8640 1 -- 10.20.193.177:0/716604943 wait complete. 2026-02-20T03:11:39.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: Updating trial177:/etc/ceph/ceph.conf 2026-02-20T03:11:39.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: Updating trial177:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: Updating trial177:/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: Updating trial177:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial028:10.20.193.28=a;trial126:10.20.193.126=b;trial177:10.20.193.177=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: Saving service mon spec with placement trial028:10.20.193.28=a;trial126:10.20.193.126=b;trial177:10.20.193.177=c;count:3 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: Deploying daemon mon.c on trial177 2026-02-20T03:11:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:39 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/716604943' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T03:11:39.780 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 systemd[1]: Starting Ceph mon.c for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 podman[43152]: 2026-02-20 03:11:39.7800735 +0000 UTC m=+0.015147372 container create 6af395529a11a4d0cd40565ce14eaa0718ad2133d4d31f7093f8889f9a87f5b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-c, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, OSD_FLAVOR=default, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 podman[43152]: 2026-02-20 03:11:39.806151495 +0000 UTC m=+0.041225367 container init 6af395529a11a4d0cd40565ce14eaa0718ad2133d4d31f7093f8889f9a87f5b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-c, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, ceph=True) 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 podman[43152]: 2026-02-20 03:11:39.808558924 +0000 UTC m=+0.043632796 container start 6af395529a11a4d0cd40565ce14eaa0718ad2133d4d31f7093f8889f9a87f5b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-c, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 bash[43152]: 6af395529a11a4d0cd40565ce14eaa0718ad2133d4d31f7093f8889f9a87f5b6 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 podman[43152]: 2026-02-20 03:11:39.773796817 +0000 UTC m=+0.008870689 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 systemd[1]: Started Ceph mon.c for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: set uid:gid to 167:167 (ceph:ceph) 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable), process ceph-mon, pid 2 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: pidfile_write: ignore empty --pid-file 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: load: jerasure load: lrc 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: RocksDB version: 7.9.2 2026-02-20T03:11:40.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Git sha 0 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Compile date 2026-02-18 01:04:15 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: DB SUMMARY 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: DB Session ID: 5XG772690BK0OHOEXZB7 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: CURRENT file: CURRENT 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: IDENTITY file: IDENTITY 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.error_if_exists: 0 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.create_if_missing: 0 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.paranoid_checks: 1 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.env: 0x55f44a361dc0 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.fs: PosixFileSystem 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.info_log: 0x55f44bba3880 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_file_opening_threads: 16 2026-02-20T03:11:40.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.statistics: (nil) 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.use_fsync: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_log_file_size: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.keep_log_file_num: 1000 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.recycle_log_file_num: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.allow_fallocate: 1 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.allow_mmap_reads: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.allow_mmap_writes: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.use_direct_reads: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.create_missing_column_families: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.db_log_dir: 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.wal_dir: 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-20T03:11:40.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.advise_random_on_open: 1 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.db_write_buffer_size: 0 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.write_buffer_manager: 0x55f44bba7900 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.rate_limiter: (nil) 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.wal_recovery_mode: 2 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.enable_thread_tracking: 0 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.enable_pipelined_write: 0 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.unordered_write: 0 2026-02-20T03:11:40.222 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.row_cache: None 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.wal_filter: None 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.allow_ingest_behind: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.two_write_queues: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.manual_wal_flush: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.wal_compression: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.atomic_flush: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.log_readahead_size: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.best_efforts_recovery: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.allow_data_in_errors: 0 2026-02-20T03:11:40.223 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.db_host_id: __hostname__ 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_background_jobs: 2 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_background_compactions: -1 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_subcompactions: 1 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_total_wal_size: 0 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_open_files: -1 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bytes_per_sync: 0 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_readahead_size: 0 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_background_flushes: -1 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Compression algorithms supported: 2026-02-20T03:11:40.224 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: kZSTD supported: 0 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: kXpressCompression supported: 0 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: kBZip2Compression supported: 0 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: kLZ4Compression supported: 1 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: kZlibCompression supported: 1 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: kLZ4HCCompression supported: 1 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: kSnappyCompression supported: 1 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.merge_operator: 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_filter: None 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_filter_factory: None 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.sst_partitioner_factory: None 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f44bba2480) 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout: cache_index_and_filter_blocks: 1 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-20T03:11:40.225 INFO:journalctl@ceph.mon.c.trial177.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: pin_top_level_index_and_filter: 1 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: index_type: 0 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: data_block_index_type: 0 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: index_shortening: 1 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: checksum: 4 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: no_block_cache: 0 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: block_cache: 0x55f44bbc7350 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: block_cache_name: BinnedLRUCache 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: block_cache_options: 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: capacity : 536870912 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: num_shard_bits : 4 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: strict_capacity_limit : 0 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: high_pri_pool_ratio: 0.000 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: block_cache_compressed: (nil) 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: persistent_cache: (nil) 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: block_size: 4096 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: block_size_deviation: 10 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: block_restart_interval: 16 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: index_block_restart_interval: 1 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: metadata_block_size: 4096 2026-02-20T03:11:40.226 INFO:journalctl@ceph.mon.c.trial177.stdout: partition_filters: 0 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: use_delta_encoding: 1 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: filter_policy: bloomfilter 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: whole_key_filtering: 1 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: verify_compression: 0 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: read_amp_bytes_per_bit: 0 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: format_version: 5 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: enable_index_compression: 1 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: block_align: 0 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: max_auto_readahead_size: 262144 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: prepopulate_block_cache: 0 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: initial_auto_readahead_size: 8192 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout: num_file_reads_for_auto_readahead: 2 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.write_buffer_size: 33554432 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_write_buffer_number: 2 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression: NoCompression 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression: Disabled 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.prefix_extractor: nullptr 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.num_levels: 7 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-20T03:11:40.227 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression_opts.level: 32767 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression_opts.strategy: 0 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression_opts.enabled: false 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-20T03:11:40.228 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.target_file_size_base: 67108864 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.arena_block_size: 1048576 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.disable_auto_compactions: 0 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-20T03:11:40.229 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.inplace_update_support: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.bloom_locality: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.max_successive_merges: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.paranoid_file_checks: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.force_consistency_checks: 1 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.report_bg_io_stats: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.ttl: 2592000 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.enable_blob_files: false 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.min_blob_size: 0 2026-02-20T03:11:40.230 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.blob_file_size: 268435456 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.blob_file_starting_level: 0 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e02eafcf-17b8-4dba-bc87-a2672ed6286f 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771557099840137, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771557099840552, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1647, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771557099, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e02eafcf-17b8-4dba-bc87-a2672ed6286f", "db_session_id": "5XG772690BK0OHOEXZB7", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771557099840616, "job": 1, "event": "recovery_finished"} 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f44bbc8e00 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: DB pointer 0x55f44bcd4000 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout: ** DB Stats ** 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-20T03:11:40.231 INFO:journalctl@ceph.mon.c.trial177.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: ** Compaction Stats [default] ** 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: ** Compaction Stats [default] ** 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-20T03:11:40.232 INFO:journalctl@ceph.mon.c.trial177.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: Block cache BinnedLRUCache@0x55f44bbc7350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c does not exist in monmap, will attempt to join an existing cluster 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: using public_addr v2:10.20.193.177:0/0 -> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: starting mon.c rank -1 at public addrs [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] at bind addrs [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(???) e0 preinit fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).mds e1 new map 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).mds e1 print_map 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: e1 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: btime 2026-02-20T03:11:02:801427+0000 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: legacy client fscid: -1 2026-02-20T03:11:40.233 INFO:journalctl@ceph.mon.c.trial177.stdout: 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout: No filesystems configured 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mkfs bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: monmap epoch 1 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: last_changed 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: min_mon_release 19 (squid) 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: election_strategy: 1 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: fsmap 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: osdmap e1: 0 total, 0 up, 0 in 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e1: no daemons active 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3838096060' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3329129604' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-20T03:11:40.234 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3329129604' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1665233059' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: monmap epoch 1 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: last_changed 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: min_mon_release 19 (squid) 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: election_strategy: 1 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: fsmap 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: osdmap e1: 0 total, 0 up, 0 in 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e1: no daemons active 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/902995060' entity='client.admin' 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1069428885' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3852752149' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Activating manager daemon x 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e2: x(active, starting, since 0.00355168s) 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Manager daemon x is now available 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2026-02-20T03:11:40.235 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14100 10.20.193.28:0/2061782376' entity='mgr.x' 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e3: x(active, since 1.00669s) 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/383844365' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/405333609' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1193932212' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1193932212' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e4: x(active, since 2s) 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3677756234' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Active manager daemon x restarted 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Activating manager daemon x 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: osdmap e2: 0 total, 0 up, 0 in 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e5: x(active, starting, since 0.00298016s) 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Manager daemon x is now available 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Found migration_current of "None". Setting to last migration. 2026-02-20T03:11:40.236 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e6: x(active, since 1.00418s) 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:16] ENGINE Bus STARTING 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:16] ENGINE Serving on https://10.20.193.28:7150 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:16] ENGINE Client ('10.20.193.28', 39522) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:16] ENGINE Serving on http://10.20.193.28:8765 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:16] ENGINE Bus STARTED 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Generating ssh key... 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e7: x(active, since 2s) 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial028", "addr": "10.20.193.28", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Deploying cephadm binary to trial028 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.237 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Added host trial028 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Saving service mon spec with placement count:5 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3107117271' entity='client.admin' 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1014826822' entity='client.admin' 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Saving service mgr spec with placement count:2 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2804301792' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14118 10.20.193.28:0/3519663889' entity='mgr.x' 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2804301792' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e8: x(active, since 7s) 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1889880812' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Active manager daemon x restarted 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Activating manager daemon x 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: osdmap e3: 0 total, 0 up, 0 in 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e9: x(active, starting, since 0.00298714s) 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Manager daemon x is now available 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.238 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:26] ENGINE Bus STARTING 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:26] ENGINE Serving on http://10.20.193.28:8765 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:26] ENGINE Serving on https://10.20.193.28:7150 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:26] ENGINE Bus STARTED 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: [20/Feb/2026:03:11:26] ENGINE Client ('10.20.193.28', 34946) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e10: x(active, since 1.0059s) 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1060045905' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2742529048' entity='client.admin' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e11: x(active, since 2s) 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:trial028", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.239 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3868183684' entity='client.admin' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial028:/etc/ceph/ceph.conf 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial028:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial028:/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial126", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial028:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Deploying cephadm binary to trial126 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mgrmap e12: x(active, since 6s) 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Added host trial126 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.240 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:trial126", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial177", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Deploying cephadm binary to trial177 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial126:/etc/ceph/ceph.conf 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial126:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial126:/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial126:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Added host trial177 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/287345299' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.241 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:trial177", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/287345299' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial177:/etc/ceph/ceph.conf 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial177:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial177:/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Updating trial177:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial028:10.20.193.28=a;trial126:10.20.193.126=b;trial177:10.20.193.177=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Saving service mon spec with placement trial028:10.20.193.28=a;trial126:10.20.193.126=b;trial177:10.20.193.177=c;count:3 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: Deploying daemon mon.c on trial177 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/716604943' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T03:11:40.242 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:39 trial177 ceph-mon[43181]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-20T03:11:40.259 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-20T03:11:40.260 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T03:11:40.411 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:11:41.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:41 trial126 ceph-mon[38476]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-20T03:11:44.924 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.920+0000 7fa5166b4640 1 -- 10.20.193.177:0/1809500866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa510102600 msgr2=0x7fa4ec005680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:44.924 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.920+0000 7fa5166b4640 1 --2- 10.20.193.177:0/1809500866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa510102600 0x7fa4ec005680 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc002a00 tx=0x7fa4fc030c80 comp rx=0 tx=0).stop 2026-02-20T03:11:44.924 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.920+0000 7fa5166b4640 1 -- 10.20.193.177:0/1809500866 shutdown_connections 2026-02-20T03:11:44.924 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.920+0000 7fa5166b4640 1 --2- 10.20.193.177:0/1809500866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa510102600 0x7fa4ec005680 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:44.924 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.920+0000 7fa5166b4640 1 -- 10.20.193.177:0/1809500866 >> 10.20.193.177:0/1809500866 conn(0x7fa510079240 msgr2=0x7fa510100510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:44.924 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.920+0000 7fa5166b4640 1 -- 10.20.193.177:0/1809500866 shutdown_connections 2026-02-20T03:11:44.924 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.920+0000 7fa5166b4640 1 -- 10.20.193.177:0/1809500866 wait complete. 2026-02-20T03:11:44.924 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa5166b4640 1 Processor -- start 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa5166b4640 1 -- start start 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa5166b4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa510102600 0x7fa510075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa5166b4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 0x7fa510075d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa5166b4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa51010a340 con 0x7fa510102600 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa5166b4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa51010a1c0 con 0x7fa5100758b0 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 0x7fa510075d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 0x7fa510075d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:46102/0 (socket says 10.20.193.177:46102) 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50f7fe640 1 -- 10.20.193.177:0/1238849800 learned_addr learned my addr 10.20.193.177:0/1238849800 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50f7fe640 1 -- 10.20.193.177:0/1238849800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 msgr2=0x7fa510075d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50f7fe640 1 -- 10.20.193.177:0/1238849800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 msgr2=0x7fa510075d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-20T03:11:44.925 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50f7fe640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 0x7fa510075d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50f7fe640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 0x7fa510075d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50ffff640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa510102600 0x7fa510075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50ffff640 1 -- 10.20.193.177:0/1238849800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 msgr2=0x7fa510075d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50ffff640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 0x7fa510075d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.921+0000 7fa50ffff640 1 -- 10.20.193.177:0/1238849800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5101a6050 con 0x7fa510102600 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.922+0000 7fa50ffff640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa510102600 0x7fa510075370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc03a000 tx=0x7fa4fc032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.922+0000 7fa50d7fa640 1 -- 10.20.193.177:0/1238849800 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa4fc032e20 con 0x7fa510102600 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.922+0000 7fa50d7fa640 1 -- 10.20.193.177:0/1238849800 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa4fc005440 con 0x7fa510102600 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.922+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5101a6220 con 0x7fa510102600 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.922+0000 7fa50d7fa640 1 -- 10.20.193.177:0/1238849800 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa4fc03ab70 con 0x7fa510102600 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.922+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5101a6680 con 0x7fa510102600 2026-02-20T03:11:44.926 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.923+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa510103ae0 con 0x7fa510102600 2026-02-20T03:11:44.927 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.923+0000 7fa50d7fa640 1 -- 10.20.193.177:0/1238849800 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7fa4fc053060 con 0x7fa510102600 2026-02-20T03:11:44.927 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.923+0000 7fa50d7fa640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4e403d950 0x7fa4e403fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:44.927 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.923+0000 7fa50d7fa640 1 -- 10.20.193.177:0/1238849800 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa4fc047070 con 0x7fa510102600 2026-02-20T03:11:44.928 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.924+0000 7fa50f7fe640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4e403d950 0x7fa4e403fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:44.928 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.924+0000 7fa50f7fe640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4e403d950 0x7fa4e403fe10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa500006fd0 tx=0x7fa500008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:44.928 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:44.927+0000 7fa50d7fa640 1 -- 10.20.193.177:0/1238849800 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa4fc047270 con 0x7fa510102600 2026-02-20T03:11:45.042 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.042+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa5101933d0 con 0x7fa510102600 2026-02-20T03:11:45.043 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.042+0000 7fa50d7fa640 1 -- 10.20.193.177:0/1238849800 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7fa4fc03add0 con 0x7fa510102600 2026-02-20T03:11:45.043 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:11:45.043 INFO:teuthology.orchestra.run.trial177.stdout:{"epoch":2,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","modified":"2026-02-20T03:11:39.860913Z","created":"2026-02-20T03:11:01.094372Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:3300","nonce":0},{"type":"v1","addr":"10.20.193.177:6789","nonce":0}]},"addr":"10.20.193.177:6789/0","public_addr":"10.20.193.177:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-02-20T03:11:45.044 INFO:teuthology.orchestra.run.trial177.stderr:dumped monmap epoch 2 2026-02-20T03:11:45.044 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4e403d950 msgr2=0x7fa4e403fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:45.044 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4e403d950 0x7fa4e403fe10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa500006fd0 tx=0x7fa500008040 comp rx=0 tx=0).stop 2026-02-20T03:11:45.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa510102600 msgr2=0x7fa510075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:45.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa510102600 0x7fa510075370 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc03a000 tx=0x7fa4fc032c00 comp rx=0 tx=0).stop 2026-02-20T03:11:45.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 shutdown_connections 2026-02-20T03:11:45.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4e403d950 0x7fa4e403fe10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:45.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa5100758b0 0x7fa510075d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:45.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 --2- 10.20.193.177:0/1238849800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa510102600 0x7fa510075370 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:45.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 >> 10.20.193.177:0/1238849800 conn(0x7fa510079240 msgr2=0x7fa5100ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:45.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 shutdown_connections 2026-02-20T03:11:45.045 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:45.043+0000 7fa5166b4640 1 -- 10.20.193.177:0/1238849800 wait complete. 2026-02-20T03:11:45.187 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: Deploying daemon mon.b on trial126 2026-02-20T03:11:45.187 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:45.188 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.188 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: mon.a calling monitor election 2026-02-20T03:11:45.188 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.188 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:45.188 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.188 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: mon.c calling monitor election 2026-02-20T03:11:45.188 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:45.188 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.188 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: monmap epoch 2 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: last_changed 2026-02-20T03:11:39.860913+0000 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: min_mon_release 19 (squid) 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: election_strategy: 1 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:45.189 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-20T03:11:45.190 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: fsmap 2026-02-20T03:11:45.190 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T03:11:45.190 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: mgrmap e12: x(active, since 18s) 2026-02-20T03:11:45.190 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: overall HEALTH_OK 2026-02-20T03:11:45.190 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:45.190 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:45.190 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:45.190 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: Deploying daemon mon.b on trial126 2026-02-20T03:11:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: mon.a calling monitor election 2026-02-20T03:11:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: mon.c calling monitor election 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: monmap epoch 2 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:45.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: last_changed 2026-02-20T03:11:39.860913+0000 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: min_mon_release 19 (squid) 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: election_strategy: 1 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: fsmap 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: mgrmap e12: x(active, since 18s) 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: overall HEALTH_OK 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:45.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:45.354 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:46.081 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-20T03:11:46.081 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph mon dump -f json 2026-02-20T03:11:46.231 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:11:46.350 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:45 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:45.861+0000 7ff7fe285640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-20T03:11:50.354 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: Deploying daemon mon.b on trial126 2026-02-20T03:11:50.354 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:50.354 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:50.354 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: mon.a calling monitor election 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: mon.c calling monitor election 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: monmap epoch 2 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: last_changed 2026-02-20T03:11:39.860913+0000 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: min_mon_release 19 (squid) 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: election_strategy: 1 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: fsmap 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: mgrmap e12: x(active, since 18s) 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: overall HEALTH_OK 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:50.355 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: mon.a calling monitor election 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: mon.c calling monitor election 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: mon.b calling monitor election 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: monmap epoch 3 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: last_changed 2026-02-20T03:11:45.044348+0000 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: min_mon_release 19 (squid) 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: election_strategy: 1 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: 2: [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] mon.b 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: fsmap 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: mgrmap e12: x(active, since 24s) 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: overall HEALTH_OK 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:50.356 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:50.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:50.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:50.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: mon.a calling monitor election 2026-02-20T03:11:50.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: mon.c calling monitor election 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: mon.b calling monitor election 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: monmap epoch 3 2026-02-20T03:11:50.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:50.470 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: last_changed 2026-02-20T03:11:45.044348+0000 2026-02-20T03:11:50.470 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:50.470 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: min_mon_release 19 (squid) 2026-02-20T03:11:50.470 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: election_strategy: 1 2026-02-20T03:11:50.470 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:50.470 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-20T03:11:50.470 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: 2: [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] mon.b 2026-02-20T03:11:50.470 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: fsmap 2026-02-20T03:11:50.470 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T03:11:50.471 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: mgrmap e12: x(active, since 24s) 2026-02-20T03:11:50.471 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: overall HEALTH_OK 2026-02-20T03:11:50.471 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.471 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.471 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.471 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.471 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.471 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:50.471 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:11:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:11:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: mon.a calling monitor election 2026-02-20T03:11:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: mon.c calling monitor election 2026-02-20T03:11:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: mon.b calling monitor election 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: monmap epoch 3 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: last_changed 2026-02-20T03:11:45.044348+0000 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: created 2026-02-20T03:11:01.094372+0000 2026-02-20T03:11:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: min_mon_release 19 (squid) 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: election_strategy: 1 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: 0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: 1: [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] mon.c 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: 2: [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] mon.b 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: fsmap 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: osdmap e4: 0 total, 0 up, 0 in 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: mgrmap e12: x(active, since 24s) 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: overall HEALTH_OK 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:50.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:50.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:50.742 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 -- 10.20.193.177:0/2625413817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b58103230 msgr2=0x7f6b38005680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:50.742 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 --2- 10.20.193.177:0/2625413817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b58103230 0x7f6b38005680 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6b48002a00 tx=0x7f6b48030c80 comp rx=0 tx=0).stop 2026-02-20T03:11:50.742 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 -- 10.20.193.177:0/2625413817 shutdown_connections 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 --2- 10.20.193.177:0/2625413817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b58103230 0x7f6b38005680 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 -- 10.20.193.177:0/2625413817 >> 10.20.193.177:0/2625413817 conn(0x7f6b580fc6a0 msgr2=0x7f6b580feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 -- 10.20.193.177:0/2625413817 shutdown_connections 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 -- 10.20.193.177:0/2625413817 wait complete. 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 Processor -- start 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 -- start start 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b58103230 0x7f6b5819c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b5819c740 0x7f6b581a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 0x7f6b581a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5810c5d0 con 0x7f6b5819c740 2026-02-20T03:11:50.743 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5810c450 con 0x7f6b58103230 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.737+0000 7f6b605e2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5810c750 con 0x7f6b581a0f70 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5eb58640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 0x7f6b581a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5eb58640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 0x7f6b581a1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:46116/0 (socket says 10.20.193.177:46116) 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5eb58640 1 -- 10.20.193.177:0/1242032312 learned_addr learned my addr 10.20.193.177:0/1242032312 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5db56640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b5819c740 0x7f6b581a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5e357640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b58103230 0x7f6b5819c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5eb58640 1 -- 10.20.193.177:0/1242032312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 msgr2=0x7f6b581a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5eb58640 1 -- 10.20.193.177:0/1242032312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 msgr2=0x7f6b581a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5eb58640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 0x7f6b581a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5eb58640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 0x7f6b581a1420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T03:11:50.744 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5e357640 1 -- 10.20.193.177:0/1242032312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b58103230 msgr2=0x7f6b5819c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5e357640 1 -- 10.20.193.177:0/1242032312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b58103230 msgr2=0x7f6b5819c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5e357640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b58103230 0x7f6b5819c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5e357640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b58103230 0x7f6b5819c200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5db56640 1 -- 10.20.193.177:0/1242032312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 msgr2=0x7f6b581a1420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5db56640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 0x7f6b581a1420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5db56640 1 -- 10.20.193.177:0/1242032312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b58103230 msgr2=0x7f6b5819c200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5db56640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b58103230 0x7f6b5819c200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5db56640 1 -- 10.20.193.177:0/1242032312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b581a8ce0 con 0x7f6b5819c740 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b5db56640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b5819c740 0x7f6b581a0a30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00b550 tx=0x7f6b4c00ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b3f7fe640 1 -- 10.20.193.177:0/1242032312 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c004230 con 0x7f6b5819c740 2026-02-20T03:11:50.745 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b3f7fe640 1 -- 10.20.193.177:0/1242032312 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6b4c0043d0 con 0x7f6b5819c740 2026-02-20T03:11:50.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b581a8f70 con 0x7f6b5819c740 2026-02-20T03:11:50.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b3f7fe640 1 -- 10.20.193.177:0/1242032312 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c00fc30 con 0x7f6b5819c740 2026-02-20T03:11:50.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.738+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b581a9420 con 0x7f6b5819c740 2026-02-20T03:11:50.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.739+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5810d680 con 0x7f6b5819c740 2026-02-20T03:11:50.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.739+0000 7f6b3f7fe640 1 -- 10.20.193.177:0/1242032312 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7f6b4c003710 con 0x7f6b5819c740 2026-02-20T03:11:50.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.739+0000 7f6b3f7fe640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6b3403ddf0 0x7f6b340402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:50.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.739+0000 7f6b3f7fe640 1 -- 10.20.193.177:0/1242032312 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6b4c051740 con 0x7f6b5819c740 2026-02-20T03:11:50.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.739+0000 7f6b5e357640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6b3403ddf0 0x7f6b340402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:50.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.740+0000 7f6b5e357640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6b3403ddf0 0x7f6b340402b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6b48005bb0 tx=0x7f6b48005b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:50.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.742+0000 7f6b3f7fe640 1 -- 10.20.193.177:0/1242032312 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6b4c013070 con 0x7f6b5819c740 2026-02-20T03:11:50.860 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.858+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6b581958f0 con 0x7f6b5819c740 2026-02-20T03:11:50.860 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b3f7fe640 1 -- 10.20.193.177:0/1242032312 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7f6b4c01b170 con 0x7f6b5819c740 2026-02-20T03:11:50.860 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:11:50.860 INFO:teuthology.orchestra.run.trial177.stdout:{"epoch":3,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","modified":"2026-02-20T03:11:45.044348Z","created":"2026-02-20T03:11:01.094372Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:3300","nonce":0},{"type":"v1","addr":"10.20.193.28:6789","nonce":0}]},"addr":"10.20.193.28:6789/0","public_addr":"10.20.193.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:3300","nonce":0},{"type":"v1","addr":"10.20.193.177:6789","nonce":0}]},"addr":"10.20.193.177:6789/0","public_addr":"10.20.193.177:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:3300","nonce":0},{"type":"v1","addr":"10.20.193.126:6789","nonce":0}]},"addr":"10.20.193.126:6789/0","public_addr":"10.20.193.126:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2026-02-20T03:11:50.860 INFO:teuthology.orchestra.run.trial177.stderr:dumped monmap epoch 3 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6b3403ddf0 msgr2=0x7f6b340402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b605e2640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6b3403ddf0 0x7f6b340402b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6b48005bb0 tx=0x7f6b48005b00 comp rx=0 tx=0).stop 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b5819c740 msgr2=0x7f6b581a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b605e2640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b5819c740 0x7f6b581a0a30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00b550 tx=0x7f6b4c00ba20 comp rx=0 tx=0).stop 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 shutdown_connections 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b605e2640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6b3403ddf0 0x7f6b340402b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b605e2640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6b581a0f70 0x7f6b581a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b605e2640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6b5819c740 0x7f6b581a0a30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.859+0000 7f6b605e2640 1 --2- 10.20.193.177:0/1242032312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6b58103230 0x7f6b5819c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.860+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 >> 10.20.193.177:0/1242032312 conn(0x7f6b580fc6a0 msgr2=0x7f6b580fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.860+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 shutdown_connections 2026-02-20T03:11:50.861 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:50.860+0000 7f6b605e2640 1 -- 10.20.193.177:0/1242032312 wait complete. 2026-02-20T03:11:50.897 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-20T03:11:50.897 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-20T03:11:51.179 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.384+0000 7fd16b282640 1 -- 10.20.193.28:0/2939496904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164109ed0 msgr2=0x7fd164111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:51.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.384+0000 7fd16b282640 1 --2- 10.20.193.28:0/2939496904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164109ed0 0x7fd164111a50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd16000b0a0 tx=0x7fd16002f410 comp rx=0 tx=0).stop 2026-02-20T03:11:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.384+0000 7fd16b282640 1 -- 10.20.193.28:0/2939496904 shutdown_connections 2026-02-20T03:11:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.384+0000 7fd16b282640 1 --2- 10.20.193.28:0/2939496904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164109ed0 0x7fd164111a50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.384+0000 7fd16b282640 1 --2- 10.20.193.28:0/2939496904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd164105750 0x7fd1641097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.384+0000 7fd16b282640 1 --2- 10.20.193.28:0/2939496904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd164104da0 0x7fd164105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.384+0000 7fd16b282640 1 -- 10.20.193.28:0/2939496904 >> 10.20.193.28:0/2939496904 conn(0x7fd164100840 msgr2=0x7fd164102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.384+0000 7fd16b282640 1 -- 10.20.193.28:0/2939496904 shutdown_connections 2026-02-20T03:11:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.384+0000 7fd16b282640 1 -- 10.20.193.28:0/2939496904 wait complete. 2026-02-20T03:11:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd16b282640 1 Processor -- start 2026-02-20T03:11:51.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd16b282640 1 -- start start 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd16b282640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164104da0 0x7fd16419d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd16b282640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd164105750 0x7fd16419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd16b282640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd164109ed0 0x7fd1641a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd16b282640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd164114da0 con 0x7fd164104da0 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd16b282640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd164114c20 con 0x7fd164109ed0 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd16b282640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd164114f20 con 0x7fd164105750 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd168ff7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164104da0 0x7fd16419d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd168ff7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164104da0 0x7fd16419d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54166/0 (socket says 10.20.193.28:54166) 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.385+0000 7fd168ff7640 1 -- 10.20.193.28:0/1989781292 learned_addr learned my addr 10.20.193.28:0/1989781292 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd1697f8640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd164109ed0 0x7fd1641a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd15bfff640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd164105750 0x7fd16419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:51.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd168ff7640 1 -- 10.20.193.28:0/1989781292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd164105750 msgr2=0x7fd16419d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:51.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd168ff7640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd164105750 0x7fd16419d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:51.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd168ff7640 1 -- 10.20.193.28:0/1989781292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd164109ed0 msgr2=0x7fd1641a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:51.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd168ff7640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd164109ed0 0x7fd1641a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:51.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd168ff7640 1 -- 10.20.193.28:0/1989781292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1641a2250 con 0x7fd164104da0 2026-02-20T03:11:51.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd1697f8640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd164109ed0 0x7fd1641a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:11:51.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd15bfff640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd164105750 0x7fd16419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:11:51.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd168ff7640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164104da0 0x7fd16419d200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd15400ea30 tx=0x7fd15400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:51.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd159ffb640 1 -- 10.20.193.28:0/1989781292 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15400ce50 con 0x7fd164104da0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd159ffb640 1 -- 10.20.193.28:0/1989781292 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd154004570 con 0x7fd164104da0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1641a2540 con 0x7fd164104da0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd159ffb640 1 -- 10.20.193.28:0/1989781292 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154010760 con 0x7fd164104da0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.386+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1641a9d80 con 0x7fd164104da0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.387+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd164105180 con 0x7fd164104da0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.387+0000 7fd159ffb640 1 -- 10.20.193.28:0/1989781292 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7fd1540040d0 con 0x7fd164104da0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.387+0000 7fd159ffb640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd14003ddf0 0x7fd1400402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.387+0000 7fd159ffb640 1 -- 10.20.193.28:0/1989781292 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd154052580 con 0x7fd164104da0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.388+0000 7fd15bfff640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd14003ddf0 0x7fd1400402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.388+0000 7fd15bfff640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd14003ddf0 0x7fd1400402b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd16410b790 tx=0x7fd14c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:51.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.390+0000 7fd159ffb640 1 -- 10.20.193.28:0/1989781292 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd15400fde0 con 0x7fd164104da0 2026-02-20T03:11:51.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.481+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd16410cbb0 con 0x7fd164104da0 2026-02-20T03:11:51.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.481+0000 7fd159ffb640 1 -- 10.20.193.28:0/1989781292 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7fd154017e10 con 0x7fd164104da0 2026-02-20T03:11:51.483 INFO:teuthology.orchestra.run.trial028.stdout:# minimal ceph.conf for bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:51.483 INFO:teuthology.orchestra.run.trial028.stdout:[global] 2026-02-20T03:11:51.484 INFO:teuthology.orchestra.run.trial028.stdout: fsid = bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:11:51.484 INFO:teuthology.orchestra.run.trial028.stdout: mon_host = [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: Updating trial028:/etc/ceph/ceph.conf 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: Updating trial126:/etc/ceph/ceph.conf 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: Updating trial177:/etc/ceph/ceph.conf 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: Updating trial177:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: Updating trial126:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/1242032312' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T03:11:51.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd14003ddf0 msgr2=0x7fd1400402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd14003ddf0 0x7fd1400402b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd16410b790 tx=0x7fd14c009290 comp rx=0 tx=0).stop 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164104da0 msgr2=0x7fd16419d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164104da0 0x7fd16419d200 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd15400ea30 tx=0x7fd15400ef00 comp rx=0 tx=0).stop 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 shutdown_connections 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd14003ddf0 0x7fd1400402b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd164109ed0 0x7fd1641a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd164105750 0x7fd16419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 --2- 10.20.193.28:0/1989781292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd164104da0 0x7fd16419d200 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 >> 10.20.193.28:0/1989781292 conn(0x7fd164100840 msgr2=0x7fd164101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.482+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 shutdown_connections 2026-02-20T03:11:51.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:51.483+0000 7fd16b282640 1 -- 10.20.193.28:0/1989781292 wait complete. 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: Updating trial028:/etc/ceph/ceph.conf 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: Updating trial126:/etc/ceph/ceph.conf 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: Updating trial177:/etc/ceph/ceph.conf 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: Updating trial177:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: Updating trial126:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:51.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='client.? 10.20.193.177:0/1242032312' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T03:11:51.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:51.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:51.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T03:11:51.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: Updating trial028:/etc/ceph/ceph.conf 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: Updating trial126:/etc/ceph/ceph.conf 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: Updating trial177:/etc/ceph/ceph.conf 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: Updating trial177:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: Updating trial126:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:51.606 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/1242032312' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-20T03:11:51.607 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:11:51.607 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.607 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:51.607 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:51.607 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T03:11:51.607 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:51.625 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-20T03:11:51.625 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:11:51.625 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.conf 2026-02-20T03:11:51.683 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:11:51.683 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:51.778 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:11:51.778 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/etc/ceph/ceph.conf 2026-02-20T03:11:51.805 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:11:51.806 DEBUG:teuthology.orchestra.run.trial126:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:51.869 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:11:51.870 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/ceph/ceph.conf 2026-02-20T03:11:51.897 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:11:51.897 DEBUG:teuthology.orchestra.run.trial177:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-20T03:11:51.962 INFO:tasks.cephadm:Adding mgr.x on trial028 2026-02-20T03:11:51.962 INFO:tasks.cephadm:Adding mgr.y on trial126 2026-02-20T03:11:51.962 INFO:tasks.cephadm:Adding mgr.z on trial177 2026-02-20T03:11:51.962 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch apply mgr '3;trial028=x;trial126=y;trial177=z' 2026-02-20T03:11:52.149 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:11:52.265 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 -- 10.20.193.177:0/3479824206 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 msgr2=0x7f592c106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:52.265 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 --2- 10.20.193.177:0/3479824206 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 0x7f592c106250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f591c009a30 tx=0x7f591c02f260 comp rx=0 tx=0).stop 2026-02-20T03:11:52.266 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 -- 10.20.193.177:0/3479824206 shutdown_connections 2026-02-20T03:11:52.266 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 --2- 10.20.193.177:0/3479824206 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592c106790 0x7f592c10d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.266 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 --2- 10.20.193.177:0/3479824206 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 0x7f592c106250 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.266 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 --2- 10.20.193.177:0/3479824206 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f592c104bd0 0x7f592c104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.266 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 -- 10.20.193.177:0/3479824206 >> 10.20.193.177:0/3479824206 conn(0x7f592c100360 msgr2=0x7f592c1027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 -- 10.20.193.177:0/3479824206 shutdown_connections 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 -- 10.20.193.177:0/3479824206 wait complete. 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 Processor -- start 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 -- start start 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f592c104bd0 0x7f592c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 0x7f592c19d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592c106790 0x7f592c1a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f592c110720 con 0x7f592c106790 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f592c1105a0 con 0x7f592c104bd0 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f593213f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f592c1108a0 con 0x7f592c105dd0 2026-02-20T03:11:52.267 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 0x7f592c19d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 0x7f592c19d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:56050/0 (socket says 10.20.193.177:56050) 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592affd640 1 -- 10.20.193.177:0/573422218 learned_addr learned my addr 10.20.193.177:0/573422218 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592b7fe640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f592c104bd0 0x7f592c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592affd640 1 -- 10.20.193.177:0/573422218 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f592c104bd0 msgr2=0x7f592c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592affd640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f592c104bd0 0x7f592c19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592affd640 1 -- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592c106790 msgr2=0x7f592c1a42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592bfff640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592c106790 0x7f592c1a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592affd640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592c106790 0x7f592c1a42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592affd640 1 -- 10.20.193.177:0/573422218 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592c1a49d0 con 0x7f592c105dd0 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.259+0000 7f592bfff640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592c106790 0x7f592c1a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:11:52.268 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f592affd640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 0x7f592c19d260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f591c009b60 tx=0x7f591c02fcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f5928ff9640 1 -- 10.20.193.177:0/573422218 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c004240 con 0x7f592c105dd0 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f5928ff9640 1 -- 10.20.193.177:0/573422218 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f591c0043e0 con 0x7f592c105dd0 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f592c1a4c60 con 0x7f592c105dd0 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f5928ff9640 1 -- 10.20.193.177:0/573422218 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c042930 con 0x7f592c105dd0 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592c1a5190 con 0x7f592c105dd0 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f592c10b9e0 con 0x7f592c105dd0 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f5928ff9640 1 -- 10.20.193.177:0/573422218 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 12) ==== 50303+0+0 (secure 0 0 0) 0x7f591c04a390 con 0x7f592c105dd0 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f5928ff9640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f590003ddf0 0x7f59000402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f5928ff9640 1 -- 10.20.193.177:0/573422218 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f591c076a30 con 0x7f592c105dd0 2026-02-20T03:11:52.269 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f592b7fe640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f590003ddf0 0x7f59000402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:52.270 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.261+0000 7f592b7fe640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f590003ddf0 0x7f59000402b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f592c19e200 tx=0x7f5918005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:52.270 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.263+0000 7f5928ff9640 1 -- 10.20.193.177:0/573422218 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f591c038b30 con 0x7f592c105dd0 2026-02-20T03:11:52.311 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:11:52 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:11:52.044+0000 7ff7fe285640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-20T03:11:52.357 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.356+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial126=y;trial177=z", "target": ["mon-mgr", ""]}) -- 0x7f592c0630c0 con 0x7f590003ddf0 2026-02-20T03:11:52.360 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.360+0000 7f5928ff9640 1 -- 10.20.193.177:0/573422218 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f592c0630c0 con 0x7f590003ddf0 2026-02-20T03:11:52.361 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled mgr update... 2026-02-20T03:11:52.362 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f590003ddf0 msgr2=0x7f59000402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:52.362 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f590003ddf0 0x7f59000402b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f592c19e200 tx=0x7f5918005f50 comp rx=0 tx=0).stop 2026-02-20T03:11:52.363 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 msgr2=0x7f592c19d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:52.363 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 0x7f592c19d260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f591c009b60 tx=0x7f591c02fcb0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.363 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 shutdown_connections 2026-02-20T03:11:52.363 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f590003ddf0 0x7f59000402b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.363 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f592c106790 0x7f592c1a42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.363 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f592c105dd0 0x7f592c19d260 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.363 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 --2- 10.20.193.177:0/573422218 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f592c104bd0 0x7f592c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:52.363 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 >> 10.20.193.177:0/573422218 conn(0x7f592c100360 msgr2=0x7f592c109140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:52.364 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 shutdown_connections 2026-02-20T03:11:52.364 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:11:52.361+0000 7f593213f640 1 -- 10.20.193.177:0/573422218 wait complete. 2026-02-20T03:11:52.403 DEBUG:teuthology.orchestra.run.trial126:mgr.y> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.y.service 2026-02-20T03:11:52.406 DEBUG:teuthology.orchestra.run.trial177:mgr.z> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.z.service 2026-02-20T03:11:52.410 INFO:tasks.cephadm:Deploying OSDs... 2026-02-20T03:11:52.411 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:11:52.411 DEBUG:teuthology.orchestra.run.trial028:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: Updating trial028:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: Reconfiguring mon.a (unknown last config time)... 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: Reconfiguring daemon mon.a on trial028 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: Reconfiguring mon.b (monmap changed)... 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: Reconfiguring daemon mon.b on trial126 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1989781292' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:52.430 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.454 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T03:11:52.454 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_1 2026-02-20T03:11:52.532 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T03:11:52.532 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:52.532 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1087 Links: 1 2026-02-20T03:11:52.532 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:52.532 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:52.532 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 03:11:30.163641850 +0000 2026-02-20T03:11:52.532 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 03:10:28.579284253 +0000 2026-02-20T03:11:52.533 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 03:10:28.579284253 +0000 2026-02-20T03:11:52.533 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 03:10:28.579284253 +0000 2026-02-20T03:11:52.533 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T03:11:52.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: Updating trial028:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:52.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: Reconfiguring mon.a (unknown last config time)... 2026-02-20T03:11:52.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: Reconfiguring daemon mon.a on trial028 2026-02-20T03:11:52.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: Reconfiguring mon.b (monmap changed)... 2026-02-20T03:11:52.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: Reconfiguring daemon mon.b on trial126 2026-02-20T03:11:52.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:52.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T03:11:52.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:52.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1989781292' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:52.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:52.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:52.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:52.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: Updating trial028:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/config/ceph.conf 2026-02-20T03:11:52.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: Reconfiguring mon.a (unknown last config time)... 2026-02-20T03:11:52.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: Reconfiguring daemon mon.a on trial028 2026-02-20T03:11:52.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: Reconfiguring mon.b (monmap changed)... 2026-02-20T03:11:52.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: Reconfiguring daemon mon.b on trial126 2026-02-20T03:11:52.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-20T03:11:52.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-20T03:11:52.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:52.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1989781292' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:52.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.605 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.606 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:52.606 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:52.606 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:52.606 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:52.626 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T03:11:52.626 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T03:11:52.626 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000316748 s, 1.6 MB/s 2026-02-20T03:11:52.628 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T03:11:52.710 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_2 2026-02-20T03:11:52.789 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T03:11:52.790 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:52.790 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1074 Links: 1 2026-02-20T03:11:52.790 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:52.790 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:52.790 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 03:11:30.163641850 +0000 2026-02-20T03:11:52.790 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 03:10:28.578020018 +0000 2026-02-20T03:11:52.790 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 03:10:28.578020018 +0000 2026-02-20T03:11:52.790 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 03:10:28.578020018 +0000 2026-02-20T03:11:52.791 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T03:11:52.884 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T03:11:52.884 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T03:11:52.884 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000275842 s, 1.9 MB/s 2026-02-20T03:11:52.887 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T03:11:52.927 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_3 2026-02-20T03:11:53.002 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:52 trial177 podman[44691]: 2026-02-20 03:11:52.938557241 +0000 UTC m=+0.009585417 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:11:53.003 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mgr[44720]: -- 10.20.193.177:0/2530271110 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5634b75bb4a0 con 0x5634b7599400 2026-02-20T03:11:53.006 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T03:11:53.006 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:53.006 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1099 Links: 1 2026-02-20T03:11:53.006 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:53.006 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:53.006 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 03:11:30.164641828 +0000 2026-02-20T03:11:53.007 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 03:10:28.581019950 +0000 2026-02-20T03:11:53.007 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 03:10:28.581019950 +0000 2026-02-20T03:11:53.007 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 03:10:28.581019950 +0000 2026-02-20T03:11:53.007 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T03:11:53.101 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T03:11:53.101 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T03:11:53.101 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000272125 s, 1.9 MB/s 2026-02-20T03:11:53.104 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T03:11:53.145 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_4 2026-02-20T03:11:53.224 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T03:11:53.225 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:53.225 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1082 Links: 1 2026-02-20T03:11:53.225 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:53.225 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:53.225 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 03:11:30.164641828 +0000 2026-02-20T03:11:53.225 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 03:10:28.578020018 +0000 2026-02-20T03:11:53.225 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 03:10:28.578020018 +0000 2026-02-20T03:11:53.225 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 03:10:28.578020018 +0000 2026-02-20T03:11:53.226 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T03:11:53.312 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 systemd[1]: Started Ceph mgr.z for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:11:53.312 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: Reconfiguring mon.c (monmap changed)... 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: Reconfiguring daemon mon.c on trial177 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T03:11:53.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T03:11:53.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:53.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T03:11:53.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T03:11:53.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T03:11:53.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:53.319 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T03:11:53.319 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T03:11:53.319 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000216051 s, 2.4 MB/s 2026-02-20T03:11:53.321 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T03:11:53.362 DEBUG:teuthology.orchestra.run.trial126:> set -ex 2026-02-20T03:11:53.362 DEBUG:teuthology.orchestra.run.trial126:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T03:11:53.380 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T03:11:53.381 DEBUG:teuthology.orchestra.run.trial126:> stat /dev/vg_nvme/lv_1 2026-02-20T03:11:53.437 INFO:teuthology.orchestra.run.trial126.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T03:11:53.437 INFO:teuthology.orchestra.run.trial126.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:53.438 INFO:teuthology.orchestra.run.trial126.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-20T03:11:53.438 INFO:teuthology.orchestra.run.trial126.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:53.438 INFO:teuthology.orchestra.run.trial126.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:53.438 INFO:teuthology.orchestra.run.trial126.stdout:Access: 2026-02-20 03:11:53.395821090 +0000 2026-02-20T03:11:53.438 INFO:teuthology.orchestra.run.trial126.stdout:Modify: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:53.438 INFO:teuthology.orchestra.run.trial126.stdout:Change: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:53.439 INFO:teuthology.orchestra.run.trial126.stdout: Birth: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:53.439 DEBUG:teuthology.orchestra.run.trial126:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T03:11:53.498 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: Reconfiguring mon.c (monmap changed)... 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: Reconfiguring daemon mon.c on trial177 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T03:11:53.499 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:53.560 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records in 2026-02-20T03:11:53.561 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records out 2026-02-20T03:11:53.561 INFO:teuthology.orchestra.run.trial126.stderr:512 bytes copied, 0.000159204 s, 3.2 MB/s 2026-02-20T03:11:53.562 DEBUG:teuthology.orchestra.run.trial126:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T03:11:53.595 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.373+0000 7fdc0b7be140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-20T03:11:53.595 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.518+0000 7fdc0b7be140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-20T03:11:53.595 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.553+0000 7fdc0b7be140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-20T03:11:53.596 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.594+0000 7fdc0b7be140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-20T03:11:53.596 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: Reconfiguring mon.c (monmap changed)... 2026-02-20T03:11:53.596 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: Reconfiguring daemon mon.c on trial177 2026-02-20T03:11:53.596 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:53.596 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.596 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:53.596 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:53.596 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-20T03:11:53.597 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T03:11:53.598 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:53.620 DEBUG:teuthology.orchestra.run.trial126:> stat /dev/vg_nvme/lv_2 2026-02-20T03:11:53.677 INFO:teuthology.orchestra.run.trial126.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T03:11:53.678 INFO:teuthology.orchestra.run.trial126.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:53.678 INFO:teuthology.orchestra.run.trial126.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-20T03:11:53.678 INFO:teuthology.orchestra.run.trial126.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:53.678 INFO:teuthology.orchestra.run.trial126.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:53.678 INFO:teuthology.orchestra.run.trial126.stdout:Access: 2026-02-20 03:11:53.529825227 +0000 2026-02-20T03:11:53.678 INFO:teuthology.orchestra.run.trial126.stdout:Modify: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:53.678 INFO:teuthology.orchestra.run.trial126.stdout:Change: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:53.678 INFO:teuthology.orchestra.run.trial126.stdout: Birth: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:53.679 DEBUG:teuthology.orchestra.run.trial126:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T03:11:53.743 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records in 2026-02-20T03:11:53.743 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records out 2026-02-20T03:11:53.743 INFO:teuthology.orchestra.run.trial126.stderr:512 bytes copied, 0.000169714 s, 3.0 MB/s 2026-02-20T03:11:53.745 DEBUG:teuthology.orchestra.run.trial126:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T03:11:53.803 DEBUG:teuthology.orchestra.run.trial126:> stat /dev/vg_nvme/lv_3 2026-02-20T03:11:53.860 INFO:teuthology.orchestra.run.trial126.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T03:11:53.860 INFO:teuthology.orchestra.run.trial126.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:53.860 INFO:teuthology.orchestra.run.trial126.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-20T03:11:53.860 INFO:teuthology.orchestra.run.trial126.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:53.861 INFO:teuthology.orchestra.run.trial126.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:53.861 INFO:teuthology.orchestra.run.trial126.stdout:Access: 2026-02-20 03:11:53.529825227 +0000 2026-02-20T03:11:53.861 INFO:teuthology.orchestra.run.trial126.stdout:Modify: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:53.861 INFO:teuthology.orchestra.run.trial126.stdout:Change: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:53.861 INFO:teuthology.orchestra.run.trial126.stdout: Birth: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:53.861 DEBUG:teuthology.orchestra.run.trial126:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T03:11:53.922 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records in 2026-02-20T03:11:53.922 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records out 2026-02-20T03:11:53.923 INFO:teuthology.orchestra.run.trial126.stderr:512 bytes copied, 0.000153162 s, 3.3 MB/s 2026-02-20T03:11:53.924 DEBUG:teuthology.orchestra.run.trial126:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T03:11:53.934 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.626+0000 7fdc0b7be140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-20T03:11:53.934 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.661+0000 7fdc0b7be140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-20T03:11:53.934 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.727+0000 7fdc0b7be140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-20T03:11:53.934 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T03:11:53.934 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T03:11:53.934 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: from numpy import show_config as show_numpy_config 2026-02-20T03:11:53.934 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.801+0000 7fdc0b7be140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-20T03:11:53.934 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.836+0000 7fdc0b7be140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-20T03:11:53.934 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.933+0000 7fdc0b7be140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-20T03:11:53.980 DEBUG:teuthology.orchestra.run.trial126:> stat /dev/vg_nvme/lv_4 2026-02-20T03:11:54.037 INFO:teuthology.orchestra.run.trial126.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T03:11:54.037 INFO:teuthology.orchestra.run.trial126.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:54.037 INFO:teuthology.orchestra.run.trial126.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-20T03:11:54.037 INFO:teuthology.orchestra.run.trial126.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:54.037 INFO:teuthology.orchestra.run.trial126.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:54.038 INFO:teuthology.orchestra.run.trial126.stdout:Access: 2026-02-20 03:11:53.529825227 +0000 2026-02-20T03:11:54.038 INFO:teuthology.orchestra.run.trial126.stdout:Modify: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:54.038 INFO:teuthology.orchestra.run.trial126.stdout:Change: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:54.038 INFO:teuthology.orchestra.run.trial126.stdout: Birth: 2026-02-20 03:09:55.412586151 +0000 2026-02-20T03:11:54.038 DEBUG:teuthology.orchestra.run.trial126:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T03:11:54.099 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records in 2026-02-20T03:11:54.100 INFO:teuthology.orchestra.run.trial126.stderr:1+0 records out 2026-02-20T03:11:54.100 INFO:teuthology.orchestra.run.trial126.stderr:512 bytes copied, 0.000148253 s, 3.5 MB/s 2026-02-20T03:11:54.101 DEBUG:teuthology.orchestra.run.trial126:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T03:11:54.158 DEBUG:teuthology.orchestra.run.trial177:> set -ex 2026-02-20T03:11:54.158 DEBUG:teuthology.orchestra.run.trial177:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T03:11:54.175 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T03:11:54.175 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_1 2026-02-20T03:11:54.218 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:53.995+0000 7fdc0b7be140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-20T03:11:54.218 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.031+0000 7fdc0b7be140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-20T03:11:54.219 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.066+0000 7fdc0b7be140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-20T03:11:54.219 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.103+0000 7fdc0b7be140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-20T03:11:54.219 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.136+0000 7fdc0b7be140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-20T03:11:54.232 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T03:11:54.232 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:54.232 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-20T03:11:54.232 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:54.233 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:54.233 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-20 03:11:52.812918039 +0000 2026-02-20T03:11:54.233 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.233 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.233 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.233 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T03:11:54.298 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-20T03:11:54.298 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-20T03:11:54.298 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000164576 s, 3.1 MB/s 2026-02-20T03:11:54.299 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T03:11:54.355 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_2 2026-02-20T03:11:54.412 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T03:11:54.412 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:54.412 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-20T03:11:54.412 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:54.413 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:54.413 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-20 03:11:52.812918039 +0000 2026-02-20T03:11:54.413 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.413 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.413 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.413 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T03:11:54.474 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-20T03:11:54.474 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-20T03:11:54.474 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000148235 s, 3.5 MB/s 2026-02-20T03:11:54.475 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T03:11:54.520 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial126=y;trial177=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:54.521 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: Saving service mgr spec with placement trial028=x;trial126=y;trial177=z;count:3 2026-02-20T03:11:54.521 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: Deploying daemon mgr.z on trial177 2026-02-20T03:11:54.521 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: Deploying daemon mgr.y on trial126 2026-02-20T03:11:54.521 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.521 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.521 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.521 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.521 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:54.521 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.522 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.522 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.522 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.522 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:54.522 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:54.522 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.522 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T03:11:54.522 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T03:11:54.522 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:54.523 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:54.448+0000 7f1c1b35e140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-20T03:11:54.523 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: /lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T03:11:54.523 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T03:11:54.523 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: from numpy import show_config as show_numpy_config 2026-02-20T03:11:54.533 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_3 2026-02-20T03:11:54.545 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.381+0000 7fdc0b7be140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-20T03:11:54.545 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.481+0000 7fdc0b7be140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-20T03:11:54.546 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.513+0000 7fdc0b7be140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-20T03:11:54.546 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.544+0000 7fdc0b7be140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-20T03:11:54.546 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial126=y;trial177=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:54.546 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: Saving service mgr spec with placement trial028=x;trial126=y;trial177=z;count:3 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: Deploying daemon mgr.z on trial177 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: Deploying daemon mgr.y on trial126 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.547 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.548 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.548 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:54.548 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:54.548 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.548 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T03:11:54.548 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T03:11:54.548 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:54.564 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T03:11:54.564 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:54.565 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-20T03:11:54.565 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:54.565 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:54.565 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-20 03:11:52.813918005 +0000 2026-02-20T03:11:54.565 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.565 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.565 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.565 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T03:11:54.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial028=x;trial126=y;trial177=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:54.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: Saving service mgr spec with placement trial028=x;trial126=y;trial177=z;count:3 2026-02-20T03:11:54.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: Deploying daemon mgr.z on trial177 2026-02-20T03:11:54.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: Deploying daemon mgr.y on trial126 2026-02-20T03:11:54.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-20T03:11:54.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:54.627 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-20T03:11:54.627 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-20T03:11:54.627 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000180145 s, 2.8 MB/s 2026-02-20T03:11:54.629 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T03:11:54.686 DEBUG:teuthology.orchestra.run.trial177:> stat /dev/vg_nvme/lv_4 2026-02-20T03:11:54.742 INFO:teuthology.orchestra.run.trial177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T03:11:54.742 INFO:teuthology.orchestra.run.trial177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T03:11:54.742 INFO:teuthology.orchestra.run.trial177.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-20T03:11:54.742 INFO:teuthology.orchestra.run.trial177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:11:54.743 INFO:teuthology.orchestra.run.trial177.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T03:11:54.743 INFO:teuthology.orchestra.run.trial177.stdout:Access: 2026-02-20 03:11:52.813918005 +0000 2026-02-20T03:11:54.743 INFO:teuthology.orchestra.run.trial177.stdout:Modify: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.743 INFO:teuthology.orchestra.run.trial177.stdout:Change: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.743 INFO:teuthology.orchestra.run.trial177.stdout: Birth: 2026-02-20 03:09:48.781240886 +0000 2026-02-20T03:11:54.743 DEBUG:teuthology.orchestra.run.trial177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T03:11:54.780 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:54.523+0000 7f1c1b35e140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-20T03:11:54.781 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:54.557+0000 7f1c1b35e140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-20T03:11:54.781 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:54.653+0000 7f1c1b35e140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-20T03:11:54.781 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:54.712+0000 7f1c1b35e140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-20T03:11:54.781 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:54.746+0000 7f1c1b35e140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-20T03:11:54.781 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:54.779+0000 7f1c1b35e140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-20T03:11:54.802 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.639+0000 7fdc0b7be140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:54.802 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.668+0000 7fdc0b7be140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-20T03:11:54.802 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:54.762+0000 7fdc0b7be140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:54.804 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records in 2026-02-20T03:11:54.804 INFO:teuthology.orchestra.run.trial177.stderr:1+0 records out 2026-02-20T03:11:54.804 INFO:teuthology.orchestra.run.trial177.stderr:512 bytes copied, 0.000150519 s, 3.4 MB/s 2026-02-20T03:11:54.806 DEBUG:teuthology.orchestra.run.trial177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T03:11:54.863 INFO:tasks.cephadm:Deploying osd.0 on trial028 with /dev/vg_nvme/lv_4... 2026-02-20T03:11:54.863 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-20T03:11:55.090 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:54.814+0000 7f1c1b35e140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-20T03:11:55.090 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:54.845+0000 7f1c1b35e140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-20T03:11:55.113 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:55.347 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:55.089+0000 7f1c1b35e140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-20T03:11:55.347 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:55.189+0000 7f1c1b35e140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-20T03:11:55.347 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:55.220+0000 7f1c1b35e140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-20T03:11:55.347 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:55.252+0000 7f1c1b35e140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-20T03:11:55.347 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:55.346+0000 7f1c1b35e140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: Reconfiguring mgr.x (unknown last config time)... 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: Reconfiguring daemon mgr.x on trial028 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.458 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:55.459 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: Reconfiguring mgr.x (unknown last config time)... 2026-02-20T03:11:55.459 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: Reconfiguring daemon mgr.x on trial028 2026-02-20T03:11:55.459 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.459 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.459 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:55.459 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:55.459 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:55.459 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.460 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.603 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:55.376+0000 7f1c1b35e140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-20T03:11:55.604 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:55.468+0000 7f1c1b35e140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-20T03:11:55.654 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:55 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:55.225+0000 7fdc0b7be140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-20T03:11:55.654 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:55 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:55.255+0000 7fdc0b7be140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-20T03:11:55.654 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:55.654 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: Reconfiguring mgr.x (unknown last config time)... 2026-02-20T03:11:55.655 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: Reconfiguring daemon mgr.x on trial028 2026-02-20T03:11:55.655 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.655 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.655 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:11:55.655 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:55.655 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:11:55.655 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.655 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:11:55.967 INFO:journalctl@ceph.mgr.z.trial177.stdout:Feb 20 03:11:55 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-z[44713]: 2026-02-20T03:11:55.653+0000 7fdc0b7be140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-20T03:11:56.315 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:55.925+0000 7f1c1b35e140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-20T03:11:56.315 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:55.955+0000 7f1c1b35e140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-20T03:11:56.337 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:11:56.362 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_4 2026-02-20T03:11:56.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:56 trial028 ceph-mon[38552]: Standby manager daemon z started 2026-02-20T03:11:56.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:56 trial028 ceph-mon[38552]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2026-02-20T03:11:56.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:56 trial028 ceph-mon[38552]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-20T03:11:56.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:56 trial028 ceph-mon[38552]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2026-02-20T03:11:56.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:56 trial028 ceph-mon[38552]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-20T03:11:56.603 INFO:journalctl@ceph.mgr.y.trial126.stdout:Feb 20 03:11:56 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-y[39712]: 2026-02-20T03:11:56.354+0000 7f1c1b35e140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-20T03:11:56.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:56 trial126 ceph-mon[38476]: Standby manager daemon z started 2026-02-20T03:11:56.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:56 trial126 ceph-mon[38476]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2026-02-20T03:11:56.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:56 trial126 ceph-mon[38476]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-20T03:11:56.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:56 trial126 ceph-mon[38476]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2026-02-20T03:11:56.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:56 trial126 ceph-mon[38476]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-20T03:11:56.623 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:11:56.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:56 trial177 ceph-mon[43181]: Standby manager daemon z started 2026-02-20T03:11:56.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:56 trial177 ceph-mon[43181]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2026-02-20T03:11:56.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:56 trial177 ceph-mon[43181]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-20T03:11:56.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:56 trial177 ceph-mon[43181]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2026-02-20T03:11:56.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:56 trial177 ceph-mon[43181]: from='mgr.? 10.20.193.177:0/1575952036' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-20T03:11:56.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 -- 10.20.193.28:0/1967533100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 msgr2=0x7fd614075e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 --2- 10.20.193.28:0/1967533100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 0x7fd614075e20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd608009a30 tx=0x7fd60802f220 comp rx=0 tx=0).stop 2026-02-20T03:11:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 -- 10.20.193.28:0/1967533100 shutdown_connections 2026-02-20T03:11:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 --2- 10.20.193.28:0/1967533100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd61410a8c0 0x7fd61410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 --2- 10.20.193.28:0/1967533100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 0x7fd614075e20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 --2- 10.20.193.28:0/1967533100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd614077020 0x7fd614075480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 -- 10.20.193.28:0/1967533100 >> 10.20.193.28:0/1967533100 conn(0x7fd6140fe0e0 msgr2=0x7fd614100520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:11:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 -- 10.20.193.28:0/1967533100 shutdown_connections 2026-02-20T03:11:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 -- 10.20.193.28:0/1967533100 wait complete. 2026-02-20T03:11:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 Processor -- start 2026-02-20T03:11:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.804+0000 7fd61b332640 1 -- start start 2026-02-20T03:11:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd61b332640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 0x7fd61419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd61b332640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd614077020 0x7fd61419d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd61b332640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd61410a8c0 0x7fd6141a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd61b332640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141106d0 con 0x7fd6140759c0 2026-02-20T03:11:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd61b332640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd614110550 con 0x7fd614077020 2026-02-20T03:11:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd61b332640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd614110850 con 0x7fd61410a8c0 2026-02-20T03:11:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6188a6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd614077020 0x7fd61419d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6190a7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 0x7fd61419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6190a7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 0x7fd61419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49702/0 (socket says 10.20.193.28:49702) 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6190a7640 1 -- 10.20.193.28:0/427966031 learned_addr learned my addr 10.20.193.28:0/427966031 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6188a6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd614077020 0x7fd61419d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:46606/0 (socket says 10.20.193.28:46606) 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6198a8640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd61410a8c0 0x7fd6141a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6190a7640 1 -- 10.20.193.28:0/427966031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd61410a8c0 msgr2=0x7fd6141a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6190a7640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd61410a8c0 0x7fd6141a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6190a7640 1 -- 10.20.193.28:0/427966031 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd614077020 msgr2=0x7fd61419d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6190a7640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd614077020 0x7fd61419d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6190a7640 1 -- 10.20.193.28:0/427966031 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6141a49b0 con 0x7fd6140759c0 2026-02-20T03:11:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.805+0000 7fd6190a7640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 0x7fd61419cd00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd60400d950 tx=0x7fd60400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:56.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.806+0000 7fd6027fc640 1 -- 10.20.193.28:0/427966031 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604014070 con 0x7fd6140759c0 2026-02-20T03:11:56.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.806+0000 7fd6027fc640 1 -- 10.20.193.28:0/427966031 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd6040044e0 con 0x7fd6140759c0 2026-02-20T03:11:56.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.806+0000 7fd6027fc640 1 -- 10.20.193.28:0/427966031 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604010460 con 0x7fd6140759c0 2026-02-20T03:11:56.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.806+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6141a4ca0 con 0x7fd6140759c0 2026-02-20T03:11:56.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.806+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6141a5190 con 0x7fd6140759c0 2026-02-20T03:11:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.806+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd614109140 con 0x7fd6140759c0 2026-02-20T03:11:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.808+0000 7fd6027fc640 1 -- 10.20.193.28:0/427966031 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 13) ==== 99976+0+0 (secure 0 0 0) 0x7fd6040026e0 con 0x7fd6140759c0 2026-02-20T03:11:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.809+0000 7fd6027fc640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5f0077580 0x7fd5f0079a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:11:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.809+0000 7fd6027fc640 1 -- 10.20.193.28:0/427966031 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd604098680 con 0x7fd6140759c0 2026-02-20T03:11:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.809+0000 7fd6188a6640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5f0077580 0x7fd5f0079a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:11:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.809+0000 7fd6188a6640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5f0077580 0x7fd5f0079a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd608002c30 tx=0x7fd6080057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:11:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.810+0000 7fd6027fc640 1 -- 10.20.193.28:0/427966031 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd604066960 con 0x7fd6140759c0 2026-02-20T03:11:56.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:56.907+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd6140630c0 con 0x7fd5f0077580 2026-02-20T03:11:57.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:11:57.328+0000 7fd6027fc640 1 -- 10.20.193.28:0/427966031 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 14) ==== 149649+0+0 (secure 0 0 0) 0x7fd60405e6a0 con 0x7fd6140759c0 2026-02-20T03:11:57.503 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:57.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: mgrmap e13: x(active, since 30s), standbys: z 2026-02-20T03:11:57.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2026-02-20T03:11:57.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: Standby manager daemon y started 2026-02-20T03:11:57.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2026-02-20T03:11:57.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-20T03:11:57.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2026-02-20T03:11:57.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-20T03:11:57.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:11:57.505 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:11:57.505 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:57 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:57.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: mgrmap e13: x(active, since 30s), standbys: z 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: Standby manager daemon y started 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:11:57.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:57 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: mgrmap e13: x(active, since 30s), standbys: z 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: Standby manager daemon y started 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: from='mgr.? 10.20.193.126:0/1239331328' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:11:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:57 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:11:58.503 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:58 trial028 ceph-mon[38552]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:58.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:58 trial028 ceph-mon[38552]: mgrmap e14: x(active, since 31s), standbys: z, y 2026-02-20T03:11:58.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-02-20T03:11:58.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:58 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3212957982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5757792c-caf3-4397-a245-e9ff471749a5"}]: dispatch 2026-02-20T03:11:58.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:58 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3212957982' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5757792c-caf3-4397-a245-e9ff471749a5"}]': finished 2026-02-20T03:11:58.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:58 trial028 ceph-mon[38552]: osdmap e5: 1 total, 0 up, 1 in 2026-02-20T03:11:58.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:11:58.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:58 trial126 ceph-mon[38476]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:58.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:58 trial126 ceph-mon[38476]: mgrmap e14: x(active, since 31s), standbys: z, y 2026-02-20T03:11:58.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-02-20T03:11:58.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:58 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3212957982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5757792c-caf3-4397-a245-e9ff471749a5"}]: dispatch 2026-02-20T03:11:58.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:58 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3212957982' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5757792c-caf3-4397-a245-e9ff471749a5"}]': finished 2026-02-20T03:11:58.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:58 trial126 ceph-mon[38476]: osdmap e5: 1 total, 0 up, 1 in 2026-02-20T03:11:58.604 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:11:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:58 trial177 ceph-mon[43181]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:11:58.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:58 trial177 ceph-mon[43181]: mgrmap e14: x(active, since 31s), standbys: z, y 2026-02-20T03:11:58.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2026-02-20T03:11:58.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:58 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3212957982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5757792c-caf3-4397-a245-e9ff471749a5"}]: dispatch 2026-02-20T03:11:58.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:58 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3212957982' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5757792c-caf3-4397-a245-e9ff471749a5"}]': finished 2026-02-20T03:11:58.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:58 trial177 ceph-mon[43181]: osdmap e5: 1 total, 0 up, 1 in 2026-02-20T03:11:58.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:11:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:59 trial028 ceph-mon[38552]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:11:59 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3109132638' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:11:59.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:59 trial126 ceph-mon[38476]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:59.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:11:59 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3109132638' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:11:59.619 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:59 trial177 ceph-mon[43181]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:11:59.619 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:11:59 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3109132638' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:00.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:00 trial028 ceph-mon[38552]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:00.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:00 trial126 ceph-mon[38476]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:00.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:00 trial177 ceph-mon[43181]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:03.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:03 trial028 ceph-mon[38552]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:03.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:03 trial126 ceph-mon[38476]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:03.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:03 trial177 ceph-mon[43181]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:05.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:05 trial028 ceph-mon[38552]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:05.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:05 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-20T03:12:05.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:05 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:05.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:05 trial028 ceph-mon[38552]: Deploying daemon osd.0 on trial028 2026-02-20T03:12:05.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:05 trial126 ceph-mon[38476]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:05.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:05 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-20T03:12:05.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:05 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:05.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:05 trial126 ceph-mon[38476]: Deploying daemon osd.0 on trial028 2026-02-20T03:12:05.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:05 trial177 ceph-mon[43181]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:05.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:05 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-20T03:12:05.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:05 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:05.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:05 trial177 ceph-mon[43181]: Deploying daemon osd.0 on trial028 2026-02-20T03:12:07.301 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:07 trial028 ceph-mon[38552]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:07.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:07 trial126 ceph-mon[38476]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:07.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:07 trial177 ceph-mon[43181]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:08.186 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:08 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:08.186 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:08 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:08.186 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:08 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:08.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:08 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:08.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:08 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:08.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:08 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:08.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:08 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:08.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:08 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:08.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:08 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.264 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 0 on host 'trial028' 2026-02-20T03:12:09.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.261+0000 7fd6027fc640 1 -- 10.20.193.28:0/427966031 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fd6140630c0 con 0x7fd5f0077580 2026-02-20T03:12:09.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.263+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5f0077580 msgr2=0x7fd5f0079a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:09.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.263+0000 7fd61b332640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5f0077580 0x7fd5f0079a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd608002c30 tx=0x7fd6080057d0 comp rx=0 tx=0).stop 2026-02-20T03:12:09.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.263+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 msgr2=0x7fd61419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:09.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.263+0000 7fd61b332640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 0x7fd61419cd00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd60400d950 tx=0x7fd60400de20 comp rx=0 tx=0).stop 2026-02-20T03:12:09.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.264+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 shutdown_connections 2026-02-20T03:12:09.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.264+0000 7fd61b332640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5f0077580 0x7fd5f0079a40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:09.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.264+0000 7fd61b332640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd61410a8c0 0x7fd6141a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:09.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.264+0000 7fd61b332640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd614077020 0x7fd61419d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:09.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.264+0000 7fd61b332640 1 --2- 10.20.193.28:0/427966031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6140759c0 0x7fd61419cd00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:09.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.264+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 >> 10.20.193.28:0/427966031 conn(0x7fd6140fe0e0 msgr2=0x7fd6141068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:09.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.264+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 shutdown_connections 2026-02-20T03:12:09.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:09.264+0000 7fd61b332640 1 -- 10.20.193.28:0/427966031 wait complete. 2026-02-20T03:12:09.366 DEBUG:teuthology.orchestra.run.trial028:osd.0> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.0.service 2026-02-20T03:12:09.370 INFO:tasks.cephadm:Deploying osd.1 on trial126 with /dev/vg_nvme/lv_4... 2026-02-20T03:12:09.370 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-20T03:12:09.520 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.b/config 2026-02-20T03:12:09.558 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:09 trial126 ceph-mon[38476]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:09.558 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.558 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.558 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:09.559 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:09.559 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.559 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:09.559 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.559 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:09 trial028 ceph-mon[38552]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:09.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:09.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:09.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:09.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:09 trial177 ceph-mon[43181]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:10.272 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:12:10.290 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial126:vg_nvme/lv_4 2026-02-20T03:12:10.437 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.b/config 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.538+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1495963027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4102940 msgr2=0x7f48d4102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.538+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1495963027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4102940 0x7f48d4102d40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009a30 tx=0x7f48c402f260 comp rx=0 tx=0).stop 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1495963027 shutdown_connections 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1495963027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d4104500 0x7f48d410ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1495963027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f48d4103b40 0x7f48d4103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1495963027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4102940 0x7f48d4102d40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1495963027 >> 10.20.193.126:0/1495963027 conn(0x7f48d40fe0f0 msgr2=0x7f48d4100510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1495963027 shutdown_connections 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1495963027 wait complete. 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 Processor -- start 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 -- start start 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d4102940 0x7f48d419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f48d4103b40 0x7f48d419d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4104500 0x7f48d41a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f48d410e3e0 con 0x7f48d4102940 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f48d410e260 con 0x7f48d4104500 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48dbfbd640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f48d410e560 con 0x7f48d4103b40 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48da533640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4104500 0x7f48d41a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48da533640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4104500 0x7f48d41a4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.126:47082/0 (socket says 10.20.193.126:47082) 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48da533640 1 -- 10.20.193.126:0/1067259759 learned_addr learned my addr 10.20.193.126:0/1067259759 (peer_addr_for_me v2:10.20.193.126:0/0) 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48d9531640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f48d4103b40 0x7f48d419d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48d9d32640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d4102940 0x7f48d419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48da533640 1 -- 10.20.193.126:0/1067259759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f48d4103b40 msgr2=0x7f48d419d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48da533640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f48d4103b40 0x7f48d419d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:10.539 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48da533640 1 -- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d4102940 msgr2=0x7f48d419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48da533640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d4102940 0x7f48d419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48da533640 1 -- 10.20.193.126:0/1067259759 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d41a4990 con 0x7f48d4104500 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48d9d32640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d4102940 0x7f48d419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.539+0000 7f48da533640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4104500 0x7f48d41a4260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f48d000ada0 tx=0x7f48d000c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.540+0000 7f48c2ffd640 1 -- 10.20.193.126:0/1067259759 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0017020 con 0x7f48d4104500 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.540+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d41a4c80 con 0x7f48d4104500 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.540+0000 7f48c2ffd640 1 -- 10.20.193.126:0/1067259759 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f48d00133f0 con 0x7f48d4104500 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.540+0000 7f48c2ffd640 1 -- 10.20.193.126:0/1067259759 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0007e60 con 0x7f48d4104500 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.540+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d41a51c0 con 0x7f48d4104500 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.540+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d4196ba0 con 0x7f48d4104500 2026-02-20T03:12:10.540 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.541+0000 7f48c2ffd640 1 -- 10.20.193.126:0/1067259759 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 14) ==== 149649+0+0 (secure 0 0 0) 0x7f48d0012070 con 0x7f48d4104500 2026-02-20T03:12:10.541 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.542+0000 7f48c2ffd640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48b00b0d10 0x7f48b00b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:10.541 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.542+0000 7f48c2ffd640 1 -- 10.20.193.126:0/1067259759 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1270+0+0 (secure 0 0 0) 0x7f48d00def50 con 0x7f48d4104500 2026-02-20T03:12:10.541 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.542+0000 7f48d9d32640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48b00b0d10 0x7f48b00b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:10.542 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.543+0000 7f48d9d32640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48b00b0d10 0x7f48b00b31d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f48c4002c30 tx=0x7f48c4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:10.542 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.543+0000 7f48c2ffd640 1 -- 10.20.193.126:0/1067259759 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f48d0021020 con 0x7f48d4104500 2026-02-20T03:12:10.629 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:10.630+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f48d40630c0 con 0x7f48b00b0d10 2026-02-20T03:12:11.393 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:11.393 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.394 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.394 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:11.394 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.394 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:11.394 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:11.394 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.394 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:11.394 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:11.394 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:12.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: Detected new or changed devices on trial028 2026-02-20T03:12:12.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial028 to 84053M 2026-02-20T03:12:12.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:12.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "452bcc43-d4da-471e-8823-6ba9c2de8105"}]: dispatch 2026-02-20T03:12:12.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: from='client.? 10.20.193.126:0/1836821900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "452bcc43-d4da-471e-8823-6ba9c2de8105"}]: dispatch 2026-02-20T03:12:12.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "452bcc43-d4da-471e-8823-6ba9c2de8105"}]': finished 2026-02-20T03:12:12.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: osdmap e6: 2 total, 0 up, 2 in 2026-02-20T03:12:12.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:12.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:12.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:12 trial028 ceph-mon[38552]: from='client.? 10.20.193.126:0/702587929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:12.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: Detected new or changed devices on trial028 2026-02-20T03:12:12.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial028 to 84053M 2026-02-20T03:12:12.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:12.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "452bcc43-d4da-471e-8823-6ba9c2de8105"}]: dispatch 2026-02-20T03:12:12.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: from='client.? 10.20.193.126:0/1836821900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "452bcc43-d4da-471e-8823-6ba9c2de8105"}]: dispatch 2026-02-20T03:12:12.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "452bcc43-d4da-471e-8823-6ba9c2de8105"}]': finished 2026-02-20T03:12:12.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: osdmap e6: 2 total, 0 up, 2 in 2026-02-20T03:12:12.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:12.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:12.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:12 trial126 ceph-mon[38476]: from='client.? 10.20.193.126:0/702587929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:12.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: Detected new or changed devices on trial028 2026-02-20T03:12:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial028 to 84053M 2026-02-20T03:12:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "452bcc43-d4da-471e-8823-6ba9c2de8105"}]: dispatch 2026-02-20T03:12:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: from='client.? 10.20.193.126:0/1836821900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "452bcc43-d4da-471e-8823-6ba9c2de8105"}]: dispatch 2026-02-20T03:12:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "452bcc43-d4da-471e-8823-6ba9c2de8105"}]': finished 2026-02-20T03:12:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: osdmap e6: 2 total, 0 up, 2 in 2026-02-20T03:12:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:12 trial177 ceph-mon[43181]: from='client.? 10.20.193.126:0/702587929' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:13 trial028 ceph-mon[38552]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:13 trial028 ceph-mon[38552]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-20T03:12:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:13 trial028 ceph-mon[38552]: from='osd.0 [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-20T03:12:13.601 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0[49934]: 2026-02-20T03:12:13.165+0000 7f8ee534b740 -1 osd.0 0 log_to_monitors true 2026-02-20T03:12:13.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:13 trial126 ceph-mon[38476]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:13.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:13 trial126 ceph-mon[38476]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-20T03:12:13.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:13 trial126 ceph-mon[38476]: from='osd.0 [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-20T03:12:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:13 trial177 ceph-mon[43181]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:13 trial177 ceph-mon[43181]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-20T03:12:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:13 trial177 ceph-mon[43181]: from='osd.0 [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-20T03:12:14.601 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0[49934]: 2026-02-20T03:12:14.330+0000 7f8ee12cc640 -1 osd.0 0 waiting for initial osdmap 2026-02-20T03:12:14.601 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0[49934]: 2026-02-20T03:12:14.333+0000 7f8edd0f6640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:12:14.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:14 trial028 ceph-mon[38552]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T03:12:14.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:14 trial028 ceph-mon[38552]: osdmap e7: 2 total, 0 up, 2 in 2026-02-20T03:12:14.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:14 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:14.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:14 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:14.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:14 trial028 ceph-mon[38552]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:12:14.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:14 trial028 ceph-mon[38552]: from='osd.0 [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:12:14.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:14 trial126 ceph-mon[38476]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T03:12:14.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:14 trial126 ceph-mon[38476]: osdmap e7: 2 total, 0 up, 2 in 2026-02-20T03:12:14.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:14 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:14.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:14 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:14.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:14 trial126 ceph-mon[38476]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:12:14.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:14 trial126 ceph-mon[38476]: from='osd.0 [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:12:14.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:14 trial177 ceph-mon[43181]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-20T03:12:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:14 trial177 ceph-mon[43181]: osdmap e7: 2 total, 0 up, 2 in 2026-02-20T03:12:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:14 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:14 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:14 trial177 ceph-mon[43181]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:12:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:14 trial177 ceph-mon[43181]: from='osd.0 [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:12:15.384 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:15 trial126 ceph-mon[38476]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:15.384 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:15 trial126 ceph-mon[38476]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:12:15.384 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:15 trial126 ceph-mon[38476]: osdmap e8: 2 total, 0 up, 2 in 2026-02-20T03:12:15.384 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:15 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:15.384 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:15 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:15.384 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:15 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:15 trial028 ceph-mon[38552]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:15 trial028 ceph-mon[38552]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:12:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:15 trial028 ceph-mon[38552]: osdmap e8: 2 total, 0 up, 2 in 2026-02-20T03:12:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:15 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:15.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:15 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:15.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:15 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:15 trial177 ceph-mon[43181]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:15.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:15 trial177 ceph-mon[43181]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:12:15.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:15 trial177 ceph-mon[43181]: osdmap e8: 2 total, 0 up, 2 in 2026-02-20T03:12:15.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:15 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:15.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:15 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:15.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:15 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:16.468 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:16 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:12:16.468 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:16 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:12:16.469 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:16 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:16.469 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:16 trial126 ceph-mon[38476]: osd.0 [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] boot 2026-02-20T03:12:16.469 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:16 trial126 ceph-mon[38476]: osdmap e9: 2 total, 1 up, 2 in 2026-02-20T03:12:16.469 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:16 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:16.469 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:16 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:16.469 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:16 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-20T03:12:16.469 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:16 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:16.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:16 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:12:16.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:16 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:12:16.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:16 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:16.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:16 trial028 ceph-mon[38552]: osd.0 [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] boot 2026-02-20T03:12:16.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:16 trial028 ceph-mon[38552]: osdmap e9: 2 total, 1 up, 2 in 2026-02-20T03:12:16.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:16 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:16.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:16 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:16.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:16 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-20T03:12:16.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:16 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:16.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:16 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:12:16.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:16 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:12:16.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:16 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:16.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:16 trial177 ceph-mon[43181]: osd.0 [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] boot 2026-02-20T03:12:16.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:16 trial177 ceph-mon[43181]: osdmap e9: 2 total, 1 up, 2 in 2026-02-20T03:12:16.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:16 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-20T03:12:16.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:16 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:16.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:16 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-20T03:12:16.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:16 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:17.550 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:17 trial126 ceph-mon[38476]: Deploying daemon osd.1 on trial126 2026-02-20T03:12:17.550 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:17 trial126 ceph-mon[38476]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:17.550 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:17 trial126 ceph-mon[38476]: osdmap e10: 2 total, 1 up, 2 in 2026-02-20T03:12:17.551 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:17.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:17 trial028 ceph-mon[38552]: Deploying daemon osd.1 on trial126 2026-02-20T03:12:17.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:17 trial028 ceph-mon[38552]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:17.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:17 trial028 ceph-mon[38552]: osdmap e10: 2 total, 1 up, 2 in 2026-02-20T03:12:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:17 trial177 ceph-mon[43181]: Deploying daemon osd.1 on trial126 2026-02-20T03:12:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:17 trial177 ceph-mon[43181]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-20T03:12:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:17 trial177 ceph-mon[43181]: osdmap e10: 2 total, 1 up, 2 in 2026-02-20T03:12:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:18.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:18.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:18.603 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.693 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.694+0000 7f48c2ffd640 1 -- 10.20.193.126:0/1067259759 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f48d40630c0 con 0x7f48b00b0d10 2026-02-20T03:12:18.693 INFO:teuthology.orchestra.run.trial126.stdout:Created osd(s) 1 on host 'trial126' 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48b00b0d10 msgr2=0x7f48b00b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48b00b0d10 0x7f48b00b31d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f48c4002c30 tx=0x7f48c4005c50 comp rx=0 tx=0).stop 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4104500 msgr2=0x7f48d41a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4104500 0x7f48d41a4260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f48d000ada0 tx=0x7f48d000c420 comp rx=0 tx=0).stop 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 shutdown_connections 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48b00b0d10 0x7f48b00b31d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f48d4104500 0x7f48d41a4260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f48d4103b40 0x7f48d419d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 --2- 10.20.193.126:0/1067259759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f48d4102940 0x7f48d419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 >> 10.20.193.126:0/1067259759 conn(0x7f48d40fe0f0 msgr2=0x7f48d4109400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 shutdown_connections 2026-02-20T03:12:18.695 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:18.696+0000 7f48dbfbd640 1 -- 10.20.193.126:0/1067259759 wait complete. 2026-02-20T03:12:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:18.733 DEBUG:teuthology.orchestra.run.trial126:osd.1> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.1.service 2026-02-20T03:12:18.734 INFO:tasks.cephadm:Deploying osd.2 on trial177 with /dev/vg_nvme/lv_4... 2026-02-20T03:12:18.734 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-20T03:12:18.882 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:12:19.586 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:19 trial177 ceph-mon[43181]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:19.587 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:19 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:19.587 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:19 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:19.587 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:19 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:19.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:19 trial028 ceph-mon[38552]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:19.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:19 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:19.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:19 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:19.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:19 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:19.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:19 trial126 ceph-mon[38476]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:19.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:19 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:19.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:19 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:19.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:19 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:19.603 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1[43143]: 2026-02-20T03:12:19.426+0000 7f60ae72c740 -1 Falling back to public interface 2026-02-20T03:12:19.626 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:12:19.641 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial177:vg_nvme/lv_4 2026-02-20T03:12:19.793 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/3859917792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0078cf0 msgr2=0x7fc6b0079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/3859917792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0078cf0 0x7fc6b0079150 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009a30 tx=0x7fc6a002f260 comp rx=0 tx=0).stop 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/3859917792 shutdown_connections 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/3859917792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc6b0079690 0x7fc6b0079f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/3859917792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0078cf0 0x7fc6b0079150 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/3859917792 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc6b0077aa0 0x7fc6b0077ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/3859917792 >> 10.20.193.177:0/3859917792 conn(0x7fc6b0100360 msgr2=0x7fc6b01027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/3859917792 shutdown_connections 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/3859917792 wait complete. 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 Processor -- start 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 -- start start 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0077aa0 0x7fc6b01a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc6b0078cf0 0x7fc6b01a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc6b0079690 0x7fc6b01a8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0114be0 con 0x7fc6b0078cf0 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0114a60 con 0x7fc6b0079690 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6b5ab7640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0114d60 con 0x7fc6b0077aa0 2026-02-20T03:12:19.897 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6af7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0077aa0 0x7fc6b01a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6af7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0077aa0 0x7fc6b01a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:44124/0 (socket says 10.20.193.177:44124) 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6af7fe640 1 -- 10.20.193.177:0/1676789801 learned_addr learned my addr 10.20.193.177:0/1676789801 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6affff640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc6b0079690 0x7fc6b01a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6af7fe640 1 -- 10.20.193.177:0/1676789801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc6b0079690 msgr2=0x7fc6b01a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6af7fe640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc6b0079690 0x7fc6b01a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6af7fe640 1 -- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc6b0078cf0 msgr2=0x7fc6b01a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6aeffd640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc6b0078cf0 0x7fc6b01a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6af7fe640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc6b0078cf0 0x7fc6b01a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6af7fe640 1 -- 10.20.193.177:0/1676789801 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b01a8e40 con 0x7fc6b0077aa0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.895+0000 7fc6aeffd640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc6b0078cf0 0x7fc6b01a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.896+0000 7fc6af7fe640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0077aa0 0x7fc6b01a1180 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00d950 tx=0x7fc69c00de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.896+0000 7fc6acff9640 1 -- 10.20.193.177:0/1676789801 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c014070 con 0x7fc6b0077aa0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.896+0000 7fc6acff9640 1 -- 10.20.193.177:0/1676789801 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc69c0044e0 con 0x7fc6b0077aa0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.896+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b01a9130 con 0x7fc6b0077aa0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.896+0000 7fc6acff9640 1 -- 10.20.193.177:0/1676789801 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69c010460 con 0x7fc6b0077aa0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.896+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b01a96c0 con 0x7fc6b0077aa0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.896+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b01111c0 con 0x7fc6b0077aa0 2026-02-20T03:12:19.898 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.897+0000 7fc6acff9640 1 -- 10.20.193.177:0/1676789801 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 14) ==== 149649+0+0 (secure 0 0 0) 0x7fc69c0026e0 con 0x7fc6b0077aa0 2026-02-20T03:12:19.899 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.898+0000 7fc6acff9640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6840b0dc0 0x7fc6840b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:19.899 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.898+0000 7fc6acff9640 1 -- 10.20.193.177:0/1676789801 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1880+0+0 (secure 0 0 0) 0x7fc69c0dee20 con 0x7fc6b0077aa0 2026-02-20T03:12:19.899 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.898+0000 7fc6aeffd640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6840b0dc0 0x7fc6840b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:19.900 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.899+0000 7fc6aeffd640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6840b0dc0 0x7fc6840b3280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0002c30 tx=0x7fc6a0005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:19.901 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.899+0000 7fc6acff9640 1 -- 10.20.193.177:0/1676789801 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc69c0a9090 con 0x7fc6b0077aa0 2026-02-20T03:12:19.987 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:19.985+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc6b00630c0 con 0x7fc6840b0dc0 2026-02-20T03:12:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: Detected new or changed devices on trial126 2026-02-20T03:12:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial126 to 84047M 2026-02-20T03:12:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:20.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:20.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:20.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:20.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:20.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:20.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: Detected new or changed devices on trial126 2026-02-20T03:12:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial126 to 84047M 2026-02-20T03:12:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:20.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: Detected new or changed devices on trial126 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial126 to 84047M 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:20.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:20.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:20.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:20.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:21 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "636c4c98-006a-4471-98ba-d570c4b7963a"}]: dispatch 2026-02-20T03:12:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:21 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "636c4c98-006a-4471-98ba-d570c4b7963a"}]': finished 2026-02-20T03:12:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:21 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/4285177742' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "636c4c98-006a-4471-98ba-d570c4b7963a"}]: dispatch 2026-02-20T03:12:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:21 trial177 ceph-mon[43181]: osdmap e11: 3 total, 1 up, 3 in 2026-02-20T03:12:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:21 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/2522023729' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:21.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:21 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "636c4c98-006a-4471-98ba-d570c4b7963a"}]: dispatch 2026-02-20T03:12:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:21 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "636c4c98-006a-4471-98ba-d570c4b7963a"}]': finished 2026-02-20T03:12:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:21 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/4285177742' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "636c4c98-006a-4471-98ba-d570c4b7963a"}]: dispatch 2026-02-20T03:12:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:21 trial028 ceph-mon[38552]: osdmap e11: 3 total, 1 up, 3 in 2026-02-20T03:12:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:21 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/2522023729' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:21.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:21 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "636c4c98-006a-4471-98ba-d570c4b7963a"}]: dispatch 2026-02-20T03:12:21.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:21 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "636c4c98-006a-4471-98ba-d570c4b7963a"}]': finished 2026-02-20T03:12:21.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:21 trial126 ceph-mon[38476]: from='client.? 10.20.193.177:0/4285177742' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "636c4c98-006a-4471-98ba-d570c4b7963a"}]: dispatch 2026-02-20T03:12:21.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:21 trial126 ceph-mon[38476]: osdmap e11: 3 total, 1 up, 3 in 2026-02-20T03:12:21.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:21.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:21.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:21 trial126 ceph-mon[38476]: from='client.? 10.20.193.177:0/2522023729' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:22.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:22 trial177 ceph-mon[43181]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:22.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:22 trial028 ceph-mon[38552]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:22.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:22 trial126 ceph-mon[38476]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:23.352 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1[43143]: 2026-02-20T03:12:22.963+0000 7f60ae72c740 -1 osd.1 0 log_to_monitors true 2026-02-20T03:12:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:23 trial177 ceph-mon[43181]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-20T03:12:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:23 trial177 ceph-mon[43181]: from='osd.1 [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-20T03:12:23.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:23 trial028 ceph-mon[38552]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-20T03:12:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:23 trial028 ceph-mon[38552]: from='osd.1 [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-20T03:12:23.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:23 trial126 ceph-mon[38476]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-20T03:12:23.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:23 trial126 ceph-mon[38476]: from='osd.1 [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-20T03:12:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:24 trial177 ceph-mon[43181]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-20T03:12:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:24 trial177 ceph-mon[43181]: osdmap e12: 3 total, 1 up, 3 in 2026-02-20T03:12:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:24 trial177 ceph-mon[43181]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:24 trial177 ceph-mon[43181]: from='osd.1 [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:24.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:24 trial177 ceph-mon[43181]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:24.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:24 trial028 ceph-mon[38552]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-20T03:12:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:24 trial028 ceph-mon[38552]: osdmap e12: 3 total, 1 up, 3 in 2026-02-20T03:12:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:24 trial028 ceph-mon[38552]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:24 trial028 ceph-mon[38552]: from='osd.1 [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:24.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:24 trial028 ceph-mon[38552]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:24.852 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1[43143]: 2026-02-20T03:12:24.446+0000 7f60aa6ad640 -1 osd.1 0 waiting for initial osdmap 2026-02-20T03:12:24.852 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1[43143]: 2026-02-20T03:12:24.449+0000 7f60a64d7640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:12:24.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:24 trial126 ceph-mon[38476]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-20T03:12:24.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:24 trial126 ceph-mon[38476]: osdmap e12: 3 total, 1 up, 3 in 2026-02-20T03:12:24.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:24.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:24.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:24 trial126 ceph-mon[38476]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:24.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:24 trial126 ceph-mon[38476]: from='osd.1 [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:24.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:24 trial126 ceph-mon[38476]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:25.526 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:25 trial177 ceph-mon[43181]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:12:25.527 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:25 trial177 ceph-mon[43181]: osdmap e13: 3 total, 1 up, 3 in 2026-02-20T03:12:25.527 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:25.527 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:25.527 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:25.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:25 trial028 ceph-mon[38552]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:12:25.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:25 trial028 ceph-mon[38552]: osdmap e13: 3 total, 1 up, 3 in 2026-02-20T03:12:25.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:25.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:25.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:25.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:25 trial126 ceph-mon[38476]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:12:25.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:25 trial126 ceph-mon[38476]: osdmap e13: 3 total, 1 up, 3 in 2026-02-20T03:12:25.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:25.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:25.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:12:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:12:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: osd.1 [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] boot 2026-02-20T03:12:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: osdmap e14: 3 total, 2 up, 3 in 2026-02-20T03:12:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:26.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-20T03:12:26.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:26.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: Deploying daemon osd.2 on trial177 2026-02-20T03:12:26.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:26 trial177 ceph-mon[43181]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:26.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: osd.1 [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] boot 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: osdmap e14: 3 total, 2 up, 3 in 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: Deploying daemon osd.2 on trial177 2026-02-20T03:12:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:26 trial028 ceph-mon[38552]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:26.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:12:26.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:12:26.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:26.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: osd.1 [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] boot 2026-02-20T03:12:26.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: osdmap e14: 3 total, 2 up, 3 in 2026-02-20T03:12:26.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-20T03:12:26.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:26.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-20T03:12:26.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:26.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: Deploying daemon osd.2 on trial177 2026-02-20T03:12:26.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:26 trial126 ceph-mon[38476]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-20T03:12:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:27 trial177 ceph-mon[43181]: osdmap e15: 3 total, 2 up, 3 in 2026-02-20T03:12:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:27.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:27 trial028 ceph-mon[38552]: osdmap e15: 3 total, 2 up, 3 in 2026-02-20T03:12:27.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:27.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:27 trial126 ceph-mon[38476]: osdmap e15: 3 total, 2 up, 3 in 2026-02-20T03:12:27.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:28.590 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.589+0000 7fc6acff9640 1 -- 10.20.193.177:0/1676789801 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc6b00630c0 con 0x7fc6840b0dc0 2026-02-20T03:12:28.590 INFO:teuthology.orchestra.run.trial177.stdout:Created osd(s) 2 on host 'trial177' 2026-02-20T03:12:28.592 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6840b0dc0 msgr2=0x7fc6840b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:28.592 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6840b0dc0 0x7fc6840b3280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0002c30 tx=0x7fc6a0005c90 comp rx=0 tx=0).stop 2026-02-20T03:12:28.592 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0077aa0 msgr2=0x7fc6b01a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:28.592 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0077aa0 0x7fc6b01a1180 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc69c00d950 tx=0x7fc69c00de20 comp rx=0 tx=0).stop 2026-02-20T03:12:28.592 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 shutdown_connections 2026-02-20T03:12:28.592 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6840b0dc0 0x7fc6840b3280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:28.593 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc6b0079690 0x7fc6b01a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:28.593 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc6b0078cf0 0x7fc6b01a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:28.593 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 --2- 10.20.193.177:0/1676789801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc6b0077aa0 0x7fc6b01a1180 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:28.593 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 >> 10.20.193.177:0/1676789801 conn(0x7fc6b0100360 msgr2=0x7fc6b0101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:28.593 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 shutdown_connections 2026-02-20T03:12:28.593 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:28.591+0000 7fc6b5ab7640 1 -- 10.20.193.177:0/1676789801 wait complete. 2026-02-20T03:12:28.625 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:28 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:28.626 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:28 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.626 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:28 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.626 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:28 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.626 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:28 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.626 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:28 trial177 ceph-mon[43181]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:28.626 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:28 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:28.626 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:28 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:28.626 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:28 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.628 DEBUG:teuthology.orchestra.run.trial177:osd.2> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.2.service 2026-02-20T03:12:28.630 INFO:tasks.cephadm:Deploying osd.3 on trial028 with /dev/vg_nvme/lv_3... 2026-02-20T03:12:28.630 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-20T03:12:28.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:28 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:28 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:28 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:28 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:28 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:28 trial028 ceph-mon[38552]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:28 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:28 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:28 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:28 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:28.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:28 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:28 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:28 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:28 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:28 trial126 ceph-mon[38476]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:28.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:28 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:28.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:28 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:28.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:28 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:28.896 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:12:29.562 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:29.562 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.562 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.563 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: Detected new or changed devices on trial177 2026-02-20T03:12:29.563 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.563 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.563 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:29.563 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.563 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:29.563 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:29.563 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.563 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:29 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2[48328]: 2026-02-20T03:12:29.239+0000 7f7e77930740 -1 Falling back to public interface 2026-02-20T03:12:29.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: Detected new or changed devices on trial177 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.753 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:29.753 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.753 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.753 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: Detected new or changed devices on trial177 2026-02-20T03:12:29.753 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.753 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.753 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:29.753 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:29.754 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:29.754 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:29.754 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:30.145 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:12:30.170 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_3 2026-02-20T03:12:30.427 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:12:30.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.606+0000 7f9f93c05640 1 -- 10.20.193.28:0/293995919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 msgr2=0x7f9f8c106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:30.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.606+0000 7f9f93c05640 1 --2- 10.20.193.28:0/293995919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 0x7f9f8c106230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009a30 tx=0x7f9f8002f220 comp rx=0 tx=0).stop 2026-02-20T03:12:30.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.607+0000 7f9f93c05640 1 -- 10.20.193.28:0/293995919 shutdown_connections 2026-02-20T03:12:30.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.607+0000 7f9f93c05640 1 --2- 10.20.193.28:0/293995919 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f8c106770 0x7f9f8c10d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:30.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.607+0000 7f9f93c05640 1 --2- 10.20.193.28:0/293995919 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 0x7f9f8c106230 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:30.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.607+0000 7f9f93c05640 1 --2- 10.20.193.28:0/293995919 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f8c104bb0 0x7f9f8c104fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:30.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.607+0000 7f9f93c05640 1 -- 10.20.193.28:0/293995919 >> 10.20.193.28:0/293995919 conn(0x7f9f8c100360 msgr2=0x7f9f8c102780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:30.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.607+0000 7f9f93c05640 1 -- 10.20.193.28:0/293995919 shutdown_connections 2026-02-20T03:12:30.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.607+0000 7f9f93c05640 1 -- 10.20.193.28:0/293995919 wait complete. 2026-02-20T03:12:30.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.607+0000 7f9f93c05640 1 Processor -- start 2026-02-20T03:12:30.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.607+0000 7f9f93c05640 1 -- start start 2026-02-20T03:12:30.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f93c05640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f8c104bb0 0x7f9f8c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:30.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f93c05640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 0x7f9f8c19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f93c05640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f8c106770 0x7f9f8c1a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f93c05640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c110650 con 0x7f9f8c105db0 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f93c05640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c1104d0 con 0x7f9f8c106770 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f93c05640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c1107d0 con 0x7f9f8c104bb0 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f91179640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 0x7f9f8c19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f91179640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 0x7f9f8c19d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39198/0 (socket says 10.20.193.28:39198) 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f91179640 1 -- 10.20.193.28:0/643325962 learned_addr learned my addr 10.20.193.28:0/643325962 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f9197a640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f8c104bb0 0x7f9f8c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f9217b640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f8c106770 0x7f9f8c1a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f91179640 1 -- 10.20.193.28:0/643325962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f8c104bb0 msgr2=0x7f9f8c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:30.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f91179640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f8c104bb0 0x7f9f8c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f91179640 1 -- 10.20.193.28:0/643325962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f8c106770 msgr2=0x7f9f8c1a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f91179640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f8c106770 0x7f9f8c1a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f91179640 1 -- 10.20.193.28:0/643325962 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8c1a4940 con 0x7f9f8c105db0 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f9217b640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f8c106770 0x7f9f8c1a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f91179640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 0x7f9f8c19d1d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f8002f730 tx=0x7f9f80002f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.608+0000 7f9f7affd640 1 -- 10.20.193.28:0/643325962 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f8002fe10 con 0x7f9f8c105db0 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.609+0000 7f9f7affd640 1 -- 10.20.193.28:0/643325962 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9f800044f0 con 0x7f9f8c105db0 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.609+0000 7f9f7affd640 1 -- 10.20.193.28:0/643325962 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80041600 con 0x7f9f8c105db0 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.609+0000 7f9f93c05640 1 -- 10.20.193.28:0/643325962 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f8c1a4bd0 con 0x7f9f8c105db0 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.609+0000 7f9f93c05640 1 -- 10.20.193.28:0/643325962 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f8c1a5060 con 0x7f9f8c105db0 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.609+0000 7f9f78ff9640 1 -- 10.20.193.28:0/643325962 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f8c063880 con 0x7f9f8c105db0 2026-02-20T03:12:30.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.611+0000 7f9f7affd640 1 -- 10.20.193.28:0/643325962 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 14) ==== 149649+0+0 (secure 0 0 0) 0x7f9f80038920 con 0x7f9f8c105db0 2026-02-20T03:12:30.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.613+0000 7f9f7affd640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f680b0d90 0x7f9f680b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:30.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.613+0000 7f9f7affd640 1 -- 10.20.193.28:0/643325962 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2420+0+0 (secure 0 0 0) 0x7f9f80103930 con 0x7f9f8c105db0 2026-02-20T03:12:30.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.613+0000 7f9f9197a640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f680b0d90 0x7f9f680b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:30.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.613+0000 7f9f7affd640 1 -- 10.20.193.28:0/643325962 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9f800cd8e0 con 0x7f9f8c105db0 2026-02-20T03:12:30.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.614+0000 7f9f9197a640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f680b0d90 0x7f9f680b3250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c19db70 tx=0x7f9f7c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:30.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:30.708+0000 7f9f78ff9640 1 -- 10.20.193.28:0/643325962 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9f8c063aa0 con 0x7f9f680b0d90 2026-02-20T03:12:30.711 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:30 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial177 to 84047M 2026-02-20T03:12:30.711 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:30 trial028 ceph-mon[38552]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:30.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:30 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial177 to 84047M 2026-02-20T03:12:30.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:30 trial177 ceph-mon[43181]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:30.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:30 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial177 to 84047M 2026-02-20T03:12:30.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:30 trial126 ceph-mon[38476]: pgmap v37: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:31 trial028 ceph-mon[38552]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:31 trial177 ceph-mon[43181]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:31.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:31 trial126 ceph-mon[38476]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:31.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:31.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:31.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:32 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1368858738' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1cd8b22-5eaf-41e1-80be-dd3d856859b8"}]: dispatch 2026-02-20T03:12:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:32 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1368858738' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1cd8b22-5eaf-41e1-80be-dd3d856859b8"}]': finished 2026-02-20T03:12:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:32 trial028 ceph-mon[38552]: osdmap e16: 4 total, 2 up, 4 in 2026-02-20T03:12:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:32 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:32 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:32 trial028 ceph-mon[38552]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:32 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2956239886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:32.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:32 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1368858738' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1cd8b22-5eaf-41e1-80be-dd3d856859b8"}]: dispatch 2026-02-20T03:12:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:32 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1368858738' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1cd8b22-5eaf-41e1-80be-dd3d856859b8"}]': finished 2026-02-20T03:12:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:32 trial177 ceph-mon[43181]: osdmap e16: 4 total, 2 up, 4 in 2026-02-20T03:12:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:32 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:32 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:32 trial177 ceph-mon[43181]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:32 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2956239886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:32.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:32 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1368858738' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1cd8b22-5eaf-41e1-80be-dd3d856859b8"}]: dispatch 2026-02-20T03:12:32.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:32 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1368858738' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1cd8b22-5eaf-41e1-80be-dd3d856859b8"}]': finished 2026-02-20T03:12:32.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:32 trial126 ceph-mon[38476]: osdmap e16: 4 total, 2 up, 4 in 2026-02-20T03:12:32.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:32 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:32.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:32 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:32.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:32 trial126 ceph-mon[38476]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:32.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:32 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2956239886' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:33.217 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:32 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2[48328]: 2026-02-20T03:12:32.761+0000 7f7e77930740 -1 osd.2 0 log_to_monitors true 2026-02-20T03:12:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:33 trial177 ceph-mon[43181]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-20T03:12:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:33 trial177 ceph-mon[43181]: from='osd.2 [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-20T03:12:33.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:33 trial028 ceph-mon[38552]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-20T03:12:33.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:33 trial028 ceph-mon[38552]: from='osd.2 [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-20T03:12:33.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:33 trial126 ceph-mon[38476]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-20T03:12:33.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:33 trial126 ceph-mon[38476]: from='osd.2 [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-20T03:12:34.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:34 trial028 ceph-mon[38552]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-20T03:12:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:34 trial028 ceph-mon[38552]: osdmap e17: 4 total, 2 up, 4 in 2026-02-20T03:12:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:34 trial028 ceph-mon[38552]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:12:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:34 trial028 ceph-mon[38552]: from='osd.2 [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:12:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:34 trial028 ceph-mon[38552]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:34.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:34 trial126 ceph-mon[38476]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-20T03:12:34.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:34 trial126 ceph-mon[38476]: osdmap e17: 4 total, 2 up, 4 in 2026-02-20T03:12:34.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:34.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:34.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:34 trial126 ceph-mon[38476]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:12:34.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:34 trial126 ceph-mon[38476]: from='osd.2 [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:12:34.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:34 trial126 ceph-mon[38476]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:34.967 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:34 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2[48328]: 2026-02-20T03:12:34.472+0000 7f7e738b1640 -1 osd.2 0 waiting for initial osdmap 2026-02-20T03:12:34.968 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:34 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2[48328]: 2026-02-20T03:12:34.475+0000 7f7e6f6db640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:12:34.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:34 trial177 ceph-mon[43181]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-20T03:12:34.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:34 trial177 ceph-mon[43181]: osdmap e17: 4 total, 2 up, 4 in 2026-02-20T03:12:34.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:34.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:34.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:34 trial177 ceph-mon[43181]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:12:34.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:34 trial177 ceph-mon[43181]: from='osd.2 [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:12:34.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:34 trial177 ceph-mon[43181]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:35.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:35 trial028 ceph-mon[38552]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:12:35.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:35 trial028 ceph-mon[38552]: osdmap e18: 4 total, 2 up, 4 in 2026-02-20T03:12:35.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:35.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:35.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:35.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:35 trial126 ceph-mon[38476]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:12:35.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:35 trial126 ceph-mon[38476]: osdmap e18: 4 total, 2 up, 4 in 2026-02-20T03:12:35.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:35.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:35.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:35.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:35 trial177 ceph-mon[43181]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:12:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:35 trial177 ceph-mon[43181]: osdmap e18: 4 total, 2 up, 4 in 2026-02-20T03:12:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:36.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:36 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:12:36.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:36 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:12:36.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:36.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:36 trial028 ceph-mon[38552]: osd.2 [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] boot 2026-02-20T03:12:36.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:36 trial028 ceph-mon[38552]: osdmap e19: 4 total, 3 up, 4 in 2026-02-20T03:12:36.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:36.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:36.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:36 trial028 ceph-mon[38552]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:36.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:12:36.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:36 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:12:36.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:36 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:12:36.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:36.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:36 trial126 ceph-mon[38476]: osd.2 [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] boot 2026-02-20T03:12:36.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:36 trial126 ceph-mon[38476]: osdmap e19: 4 total, 3 up, 4 in 2026-02-20T03:12:36.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:36.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:36.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:36 trial126 ceph-mon[38476]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:36.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:12:36.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:36 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:12:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:36 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:12:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:36 trial177 ceph-mon[43181]: osd.2 [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] boot 2026-02-20T03:12:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:36 trial177 ceph-mon[43181]: osdmap e19: 4 total, 3 up, 4 in 2026-02-20T03:12:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-20T03:12:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:36 trial177 ceph-mon[43181]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-20T03:12:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:12:37.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-20T03:12:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:37 trial028 ceph-mon[38552]: osdmap e20: 4 total, 3 up, 4 in 2026-02-20T03:12:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:12:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-20T03:12:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:37.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-20T03:12:37.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:37 trial126 ceph-mon[38476]: osdmap e20: 4 total, 3 up, 4 in 2026-02-20T03:12:37.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:37.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:12:37.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-20T03:12:37.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:37.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-20T03:12:37.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:37 trial177 ceph-mon[43181]: osdmap e20: 4 total, 3 up, 4 in 2026-02-20T03:12:37.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:37.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:12:37.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-20T03:12:37.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:38.547 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55391]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-20T03:12:38.547 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55391]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.547 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.547 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55391]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.547 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55397]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-20T03:12:38.547 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55397]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.547 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.547 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55397]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55417]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-20T03:12:38.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55417]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55417]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55457]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-20T03:12:38.647 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46236]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-20T03:12:38.647 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46236]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.647 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.647 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46236]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.647 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46240]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-20T03:12:38.647 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46240]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.647 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.647 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46240]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: Deploying daemon osd.3 on trial028 2026-02-20T03:12:38.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-20T03:12:38.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: osdmap e21: 4 total, 3 up, 4 in 2026-02-20T03:12:38.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:38.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:38.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:38.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:38.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:38.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T03:12:38.649 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 ceph-mon[38476]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T03:12:38.649 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46244]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-20T03:12:38.649 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46244]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.649 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.649 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46244]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.649 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46248]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-20T03:12:38.718 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51354]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-20T03:12:38.718 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51354]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.718 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.718 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51354]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.718 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51358]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-20T03:12:38.719 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51358]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.719 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.719 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51358]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: Deploying daemon osd.3 on trial028 2026-02-20T03:12:38.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-20T03:12:38.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: osdmap e21: 4 total, 3 up, 4 in 2026-02-20T03:12:38.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:38.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 ceph-mon[43181]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51362]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51362]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51362]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51366]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51366]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:38 trial177 sudo[51366]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55457]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 sudo[55457]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: Deploying daemon osd.3 on trial028 2026-02-20T03:12:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-20T03:12:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: osdmap e21: 4 total, 3 up, 4 in 2026-02-20T03:12:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:38.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: pgmap v47: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:38.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:38.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:38.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:38.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T03:12:38.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:38 trial028 ceph-mon[38552]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T03:12:39.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46248]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-20T03:12:39.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-20T03:12:39.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:38 trial126 sudo[46248]: pam_unix(sudo:session): session closed for user root 2026-02-20T03:12:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:12:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:12:39.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: osdmap e22: 4 total, 3 up, 4 in 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:12:39.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:12:39.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T03:12:39.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T03:12:39.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:39.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:12:39.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:12:39.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:12:39.853 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: osdmap e22: 4 total, 3 up, 4 in 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:12:39.854 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T03:12:39.855 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T03:12:39.855 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:39.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: osdmap e22: 4 total, 3 up, 4 in 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T03:12:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T03:12:39.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:39.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2026-02-20T03:12:39.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2026-02-20T03:12:39.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2026-02-20T03:12:39.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-20T03:12:39.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-20T03:12:39.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:40.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:40.570+0000 7f9f7affd640 1 -- 10.20.193.28:0/643325962 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f9f800c9220 con 0x7f9f8c105db0 2026-02-20T03:12:40.705 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:40 trial028 ceph-mon[38552]: pgmap v49: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:40.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:40 trial126 ceph-mon[38476]: pgmap v49: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:40.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:40 trial177 ceph-mon[43181]: pgmap v49: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:41.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:41 trial028 ceph-mon[38552]: mgrmap e15: x(active, since 74s), standbys: z, y 2026-02-20T03:12:41.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:41.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:41.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:41.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:41 trial126 ceph-mon[38476]: mgrmap e15: x(active, since 74s), standbys: z, y 2026-02-20T03:12:41.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:41.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:41.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:41.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:41 trial177 ceph-mon[43181]: mgrmap e15: x(active, since 74s), standbys: z, y 2026-02-20T03:12:41.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:41.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:41.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.443+0000 7f9f7affd640 1 -- 10.20.193.28:0/643325962 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f9f8c063aa0 con 0x7f9f680b0d90 2026-02-20T03:12:42.446 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 3 on host 'trial028' 2026-02-20T03:12:42.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 -- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f680b0d90 msgr2=0x7f9f680b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:42.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f680b0d90 0x7f9f680b3250 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c19db70 tx=0x7f9f7c009290 comp rx=0 tx=0).stop 2026-02-20T03:12:42.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 -- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 msgr2=0x7f9f8c19d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:42.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 0x7f9f8c19d1d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9f8002f730 tx=0x7f9f80002f70 comp rx=0 tx=0).stop 2026-02-20T03:12:42.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 -- 10.20.193.28:0/643325962 shutdown_connections 2026-02-20T03:12:42.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f680b0d90 0x7f9f680b3250 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:42.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f8c106770 0x7f9f8c1a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:42.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f8c105db0 0x7f9f8c19d1d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:42.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 --2- 10.20.193.28:0/643325962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f8c104bb0 0x7f9f8c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:42.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 -- 10.20.193.28:0/643325962 >> 10.20.193.28:0/643325962 conn(0x7f9f8c100360 msgr2=0x7f9f8c109240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:42.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 -- 10.20.193.28:0/643325962 shutdown_connections 2026-02-20T03:12:42.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:12:42.445+0000 7f9f78ff9640 1 -- 10.20.193.28:0/643325962 wait complete. 2026-02-20T03:12:42.550 DEBUG:teuthology.orchestra.run.trial028:osd.3> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.3.service 2026-02-20T03:12:42.554 INFO:tasks.cephadm:Deploying osd.4 on trial126 with /dev/vg_nvme/lv_3... 2026-02-20T03:12:42.554 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-20T03:12:42.708 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.b/config 2026-02-20T03:12:42.830 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.830 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.831 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:42.831 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:42.831 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.831 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:42 trial028 ceph-mon[38552]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:42.831 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:42.831 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.831 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.831 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:12:42 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3[55857]: 2026-02-20T03:12:42.666+0000 7f02b4bbf740 -1 Falling back to public interface 2026-02-20T03:12:42.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:42.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:42.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:42 trial126 ceph-mon[38476]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:42.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:42.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.852 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:42 trial177 ceph-mon[43181]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:43.517 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:12:43.534 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial126:vg_nvme/lv_3 2026-02-20T03:12:43.688 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.b/config 2026-02-20T03:12:43.800 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.800+0000 7f9e440dc640 1 -- 10.20.193.126:0/519872699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 msgr2=0x7f9e3c10d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:43.800 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.800+0000 7f9e440dc640 1 --2- 10.20.193.126:0/519872699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 0x7f9e3c10d020 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800b0a0 tx=0x7f9e3802f410 comp rx=0 tx=0).stop 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.800+0000 7f9e440dc640 1 -- 10.20.193.126:0/519872699 shutdown_connections 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.800+0000 7f9e440dc640 1 --2- 10.20.193.126:0/519872699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 0x7f9e3c10d020 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.800+0000 7f9e440dc640 1 --2- 10.20.193.126:0/519872699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9e3c105dd0 0x7f9e3c106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.800+0000 7f9e440dc640 1 --2- 10.20.193.126:0/519872699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9e3c104bd0 0x7f9e3c104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.800+0000 7f9e440dc640 1 -- 10.20.193.126:0/519872699 >> 10.20.193.126:0/519872699 conn(0x7f9e3c100360 msgr2=0x7f9e3c1027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.800+0000 7f9e440dc640 1 -- 10.20.193.126:0/519872699 shutdown_connections 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.800+0000 7f9e440dc640 1 -- 10.20.193.126:0/519872699 wait complete. 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 Processor -- start 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 -- start start 2026-02-20T03:12:43.801 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9e3c104bd0 0x7f9e3c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9e3c105dd0 0x7f9e3c19d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 0x7f9e3c1a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c1106f0 con 0x7f9e3c105dd0 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c110570 con 0x7f9e3c106790 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3c110870 con 0x7f9e3c104bd0 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e42652640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 0x7f9e3c1a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e42652640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 0x7f9e3c1a4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.126:52356/0 (socket says 10.20.193.126:52356) 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e42652640 1 -- 10.20.193.126:0/3591115158 learned_addr learned my addr 10.20.193.126:0/3591115158 (peer_addr_for_me v2:10.20.193.126:0/0) 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e41e51640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9e3c104bd0 0x7f9e3c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e41650640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9e3c105dd0 0x7f9e3c19d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:43.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e42652640 1 -- 10.20.193.126:0/3591115158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9e3c104bd0 msgr2=0x7f9e3c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e42652640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9e3c104bd0 0x7f9e3c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e42652640 1 -- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9e3c105dd0 msgr2=0x7f9e3c19d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e42652640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9e3c105dd0 0x7f9e3c19d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e42652640 1 -- 10.20.193.126:0/3591115158 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3c1a48c0 con 0x7f9e3c106790 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e42652640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 0x7f9e3c1a4190 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800b070 tx=0x7f9e38004310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e2affd640 1 -- 10.20.193.126:0/3591115158 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38046070 con 0x7f9e3c106790 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e2affd640 1 -- 10.20.193.126:0/3591115158 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9e380076a0 con 0x7f9e3c106790 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3c1a4b50 con 0x7f9e3c106790 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e2affd640 1 -- 10.20.193.126:0/3591115158 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e380416e0 con 0x7f9e3c106790 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.801+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3c1a5030 con 0x7f9e3c106790 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.802+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3c10b970 con 0x7f9e3c106790 2026-02-20T03:12:43.803 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.803+0000 7f9e2affd640 1 -- 10.20.193.126:0/3591115158 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f9e38007b80 con 0x7f9e3c106790 2026-02-20T03:12:43.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.803+0000 7f9e2affd640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9e180b0e20 0x7f9e180b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:43.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.804+0000 7f9e2affd640 1 -- 10.20.193.126:0/3591115158 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3346+0+0 (secure 0 0 0) 0x7f9e381043b0 con 0x7f9e3c106790 2026-02-20T03:12:43.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.804+0000 7f9e41e51640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9e180b0e20 0x7f9e180b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:43.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.804+0000 7f9e41e51640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9e180b0e20 0x7f9e180b32e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c19e0f0 tx=0x7f9e2c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:43.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.805+0000 7f9e2affd640 1 -- 10.20.193.126:0/3591115158 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9e38050080 con 0x7f9e3c106790 2026-02-20T03:12:43.890 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:43.893+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9e3c0630c0 con 0x7f9e180b0e20 2026-02-20T03:12:45.007 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: Detected new or changed devices on trial028 2026-02-20T03:12:45.008 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.008 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.008 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:45.008 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:45.008 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial028 to 42026M 2026-02-20T03:12:45.008 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.008 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e6bd944-356d-40ba-8586-50792c78360e"}]: dispatch 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e6bd944-356d-40ba-8586-50792c78360e"}]': finished 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='client.? 10.20.193.126:0/150300679' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e6bd944-356d-40ba-8586-50792c78360e"}]: dispatch 2026-02-20T03:12:45.009 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: osdmap e23: 5 total, 3 up, 5 in 2026-02-20T03:12:45.010 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:45.010 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:45.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: Detected new or changed devices on trial028 2026-02-20T03:12:45.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial028 to 42026M 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:45.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:45.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:45.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:45.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e6bd944-356d-40ba-8586-50792c78360e"}]: dispatch 2026-02-20T03:12:45.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e6bd944-356d-40ba-8586-50792c78360e"}]': finished 2026-02-20T03:12:45.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='client.? 10.20.193.126:0/150300679' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e6bd944-356d-40ba-8586-50792c78360e"}]: dispatch 2026-02-20T03:12:45.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: osdmap e23: 5 total, 3 up, 5 in 2026-02-20T03:12:45.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:45.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:45.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: Detected new or changed devices on trial028 2026-02-20T03:12:45.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:45.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:45.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial028 to 42026M 2026-02-20T03:12:45.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e6bd944-356d-40ba-8586-50792c78360e"}]: dispatch 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4e6bd944-356d-40ba-8586-50792c78360e"}]': finished 2026-02-20T03:12:45.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='client.? 10.20.193.126:0/150300679' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4e6bd944-356d-40ba-8586-50792c78360e"}]: dispatch 2026-02-20T03:12:45.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: osdmap e23: 5 total, 3 up, 5 in 2026-02-20T03:12:45.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:45.220 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:46.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:45 trial028 ceph-mon[38552]: from='client.? 10.20.193.126:0/3300487157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:46.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:45 trial126 ceph-mon[38476]: from='client.? 10.20.193.126:0/3300487157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:46.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:45 trial177 ceph-mon[43181]: from='client.? 10.20.193.126:0/3300487157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:47.069 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:46 trial028 ceph-mon[38552]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:47.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:46 trial126 ceph-mon[38476]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:47.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:46 trial177 ceph-mon[43181]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:47.351 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:12:47 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3[55857]: 2026-02-20T03:12:47.066+0000 7f02b4bbf740 -1 osd.3 0 log_to_monitors true 2026-02-20T03:12:48.061 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:47 trial126 ceph-mon[38476]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-20T03:12:48.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:47 trial028 ceph-mon[38552]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-20T03:12:48.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:47 trial177 ceph-mon[43181]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-20T03:12:48.933 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:48 trial126 ceph-mon[38476]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T03:12:48.933 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:48 trial126 ceph-mon[38476]: osdmap e24: 5 total, 3 up, 5 in 2026-02-20T03:12:48.933 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:48 trial126 ceph-mon[38476]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:12:48.934 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:48.934 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:48.934 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:48 trial126 ceph-mon[38476]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:49.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:48 trial028 ceph-mon[38552]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T03:12:49.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:48 trial028 ceph-mon[38552]: osdmap e24: 5 total, 3 up, 5 in 2026-02-20T03:12:49.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:48 trial028 ceph-mon[38552]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:12:49.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:49.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:49.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:48 trial028 ceph-mon[38552]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:49.102 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:12:48 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3[55857]: 2026-02-20T03:12:48.773+0000 7f02b0b40640 -1 osd.3 0 waiting for initial osdmap 2026-02-20T03:12:49.102 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:12:48 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3[55857]: 2026-02-20T03:12:48.777+0000 7f02ac96a640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:12:49.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:48 trial177 ceph-mon[43181]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-20T03:12:49.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:48 trial177 ceph-mon[43181]: osdmap e24: 5 total, 3 up, 5 in 2026-02-20T03:12:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:48 trial177 ceph-mon[43181]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:12:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:48 trial177 ceph-mon[43181]: pgmap v55: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-20T03:12:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:12:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: osdmap e25: 5 total, 3 up, 5 in 2026-02-20T03:12:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-20T03:12:50.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:50.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: Deploying daemon osd.4 on trial126 2026-02-20T03:12:50.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] boot 2026-02-20T03:12:50.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: osdmap e26: 5 total, 4 up, 5 in 2026-02-20T03:12:50.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:50.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:50.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:12:50.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: osdmap e25: 5 total, 3 up, 5 in 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: Deploying daemon osd.4 on trial126 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] boot 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: osdmap e26: 5 total, 4 up, 5 in 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:50.103 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:50.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: from='osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: osdmap e25: 5 total, 3 up, 5 in 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: Deploying daemon osd.4 on trial126 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: osd.3 [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] boot 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: osdmap e26: 5 total, 4 up, 5 in 2026-02-20T03:12:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-20T03:12:50.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:51.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:50 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:12:51.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:50 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:12:51.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:50 trial028 ceph-mon[38552]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T03:12:51.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:50 trial028 ceph-mon[38552]: osdmap e27: 5 total, 4 up, 5 in 2026-02-20T03:12:51.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:51.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:50 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:12:51.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:50 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:12:51.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:50 trial126 ceph-mon[38476]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T03:12:51.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:50 trial126 ceph-mon[38476]: osdmap e27: 5 total, 4 up, 5 in 2026-02-20T03:12:51.102 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:51.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:50 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:12:51.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:50 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:12:51.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:50 trial177 ceph-mon[43181]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T03:12:51.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:50 trial177 ceph-mon[43181]: osdmap e27: 5 total, 4 up, 5 in 2026-02-20T03:12:51.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:51.950 INFO:teuthology.orchestra.run.trial126.stdout:Created osd(s) 4 on host 'trial126' 2026-02-20T03:12:51.951 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.952+0000 7f9e2affd640 1 -- 10.20.193.126:0/3591115158 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f9e3c0630c0 con 0x7f9e180b0e20 2026-02-20T03:12:51.952 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.954+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9e180b0e20 msgr2=0x7f9e180b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9e180b0e20 0x7f9e180b32e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c19e0f0 tx=0x7f9e2c008040 comp rx=0 tx=0).stop 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 msgr2=0x7f9e3c1a4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 0x7f9e3c1a4190 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800b070 tx=0x7f9e38004310 comp rx=0 tx=0).stop 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 shutdown_connections 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9e180b0e20 0x7f9e180b32e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9e3c106790 0x7f9e3c1a4190 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9e3c105dd0 0x7f9e3c19d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 --2- 10.20.193.126:0/3591115158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9e3c104bd0 0x7f9e3c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 >> 10.20.193.126:0/3591115158 conn(0x7f9e3c100360 msgr2=0x7f9e3c1090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:51.953 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 shutdown_connections 2026-02-20T03:12:51.954 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:12:51.955+0000 7f9e440dc640 1 -- 10.20.193.126:0/3591115158 wait complete. 2026-02-20T03:12:51.989 DEBUG:teuthology.orchestra.run.trial126:osd.4> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.4.service 2026-02-20T03:12:52.000 INFO:tasks.cephadm:Deploying osd.5 on trial177 with /dev/vg_nvme/lv_3... 2026-02-20T03:12:52.002 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-20T03:12:52.017 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:52.017 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.017 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: osdmap e28: 5 total, 4 up, 5 in 2026-02-20T03:12:52.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:52.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:52.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:52.018 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.029 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:52.029 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.029 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.029 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: osdmap e28: 5 total, 4 up, 5 in 2026-02-20T03:12:52.029 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:52.029 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.029 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.029 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:52.030 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:52.030 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:52.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: osdmap e28: 5 total, 4 up, 5 in 2026-02-20T03:12:52.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:52.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:52.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:52.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.157 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:12:52.845 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:52.845 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.845 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.845 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: pgmap v61: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T03:12:52.845 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: osdmap e29: 5 total, 4 up, 5 in 2026-02-20T03:12:52.845 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:52.845 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.846 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.846 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:52.846 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:52.846 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.846 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:52.846 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:52.846 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.911 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:12:52.923 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:52.923 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.923 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: pgmap v61: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: osdmap e29: 5 total, 4 up, 5 in 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:52.924 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:52.925 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:12:52 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4[49259]: 2026-02-20T03:12:52.683+0000 7f8a5b214740 -1 Falling back to public interface 2026-02-20T03:12:52.929 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial177:vg_nvme/lv_3 2026-02-20T03:12:53.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: pgmap v61: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: osdmap e29: 5 total, 4 up, 5 in 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:12:53.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:12:53.120 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.233+0000 7fc71b04c640 1 -- 10.20.193.177:0/2703451331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714104500 msgr2=0x7fc71410ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.233+0000 7fc71b04c640 1 --2- 10.20.193.177:0/2703451331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714104500 0x7fc71410ad90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc71000b0a0 tx=0x7fc71002f410 comp rx=0 tx=0).stop 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.233+0000 7fc71b04c640 1 -- 10.20.193.177:0/2703451331 shutdown_connections 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.233+0000 7fc71b04c640 1 --2- 10.20.193.177:0/2703451331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714104500 0x7fc71410ad90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.233+0000 7fc71b04c640 1 --2- 10.20.193.177:0/2703451331 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc714103b40 0x7fc714103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.233+0000 7fc71b04c640 1 --2- 10.20.193.177:0/2703451331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc714102940 0x7fc714102d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.233+0000 7fc71b04c640 1 -- 10.20.193.177:0/2703451331 >> 10.20.193.177:0/2703451331 conn(0x7fc7140fe0f0 msgr2=0x7fc714100510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.233+0000 7fc71b04c640 1 -- 10.20.193.177:0/2703451331 shutdown_connections 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.233+0000 7fc71b04c640 1 -- 10.20.193.177:0/2703451331 wait complete. 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 Processor -- start 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 -- start start 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714102940 0x7fc714076e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc714103b40 0x7fc714075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc714104500 0x7fc7140759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc71410e410 con 0x7fc714104500 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc71410e290 con 0x7fc714103b40 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc71410e590 con 0x7fc714102940 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc718dc1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714102940 0x7fc714076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc718dc1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714102940 0x7fc714076e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:55778/0 (socket says 10.20.193.177:55778) 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc718dc1640 1 -- 10.20.193.177:0/3194673503 learned_addr learned my addr 10.20.193.177:0/3194673503 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc70bfff640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc714103b40 0x7fc714075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc718dc1640 1 -- 10.20.193.177:0/3194673503 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc714103b40 msgr2=0x7fc714075460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc718dc1640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc714103b40 0x7fc714075460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc7195c2640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc714104500 0x7fc7140759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc718dc1640 1 -- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc714104500 msgr2=0x7fc7140759a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc718dc1640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc714104500 0x7fc7140759a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc718dc1640 1 -- 10.20.193.177:0/3194673503 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc714076230 con 0x7fc714102940 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc718dc1640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714102940 0x7fc714076e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c990 tx=0x7fc70400ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc709ffb640 1 -- 10.20.193.177:0/3194673503 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704007c70 con 0x7fc714102940 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc709ffb640 1 -- 10.20.193.177:0/3194673503 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc704007e10 con 0x7fc714102940 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7141a4b90 con 0x7fc714102940 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc709ffb640 1 -- 10.20.193.177:0/3194673503 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70400f470 con 0x7fc714102940 2026-02-20T03:12:53.235 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.234+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7141a50d0 con 0x7fc714102940 2026-02-20T03:12:53.236 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.235+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7141097b0 con 0x7fc714102940 2026-02-20T03:12:53.236 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.236+0000 7fc709ffb640 1 -- 10.20.193.177:0/3194673503 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fc70401f030 con 0x7fc714102940 2026-02-20T03:12:53.237 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.237+0000 7fc709ffb640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6f00b0da0 0x7fc6f00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:12:53.237 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.237+0000 7fc709ffb640 1 -- 10.20.193.177:0/3194673503 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3778+0+0 (secure 0 0 0) 0x7fc7040df760 con 0x7fc714102940 2026-02-20T03:12:53.237 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.237+0000 7fc70bfff640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6f00b0da0 0x7fc6f00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:12:53.238 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.238+0000 7fc70bfff640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6f00b0da0 0x7fc6f00b3260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc714076b90 tx=0x7fc6fc005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:12:53.238 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.238+0000 7fc709ffb640 1 -- 10.20.193.177:0/3194673503 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc704015330 con 0x7fc714102940 2026-02-20T03:12:53.327 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:12:53.327+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc7140630c0 con 0x7fc6f00b0da0 2026-02-20T03:12:54.131 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:53 trial177 ceph-mon[43181]: Detected new or changed devices on trial126 2026-02-20T03:12:54.131 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:53 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial126 to 42023M 2026-02-20T03:12:54.131 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:54.132 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:54.132 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:54.132 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:53 trial177 ceph-mon[43181]: osdmap e30: 5 total, 4 up, 5 in 2026-02-20T03:12:54.132 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:53 trial028 ceph-mon[38552]: Detected new or changed devices on trial126 2026-02-20T03:12:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:53 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial126 to 42023M 2026-02-20T03:12:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:53 trial028 ceph-mon[38552]: osdmap e30: 5 total, 4 up, 5 in 2026-02-20T03:12:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:54.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:53 trial126 ceph-mon[38476]: Detected new or changed devices on trial126 2026-02-20T03:12:54.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:53 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial126 to 42023M 2026-02-20T03:12:54.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:12:54.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:12:54.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:54.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:53 trial126 ceph-mon[38476]: osdmap e30: 5 total, 4 up, 5 in 2026-02-20T03:12:54.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:54 trial177 ceph-mon[43181]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:54 trial177 ceph-mon[43181]: pgmap v64: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T03:12:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:54 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0"}]: dispatch 2026-02-20T03:12:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:54 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0"}]': finished 2026-02-20T03:12:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:54 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/1675074678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0"}]: dispatch 2026-02-20T03:12:55.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:54 trial177 ceph-mon[43181]: osdmap e31: 6 total, 4 up, 6 in 2026-02-20T03:12:55.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:55.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:12:55.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:54 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/3197642194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:54 trial028 ceph-mon[38552]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:54 trial028 ceph-mon[38552]: pgmap v64: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T03:12:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:54 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0"}]: dispatch 2026-02-20T03:12:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:54 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0"}]': finished 2026-02-20T03:12:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:54 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/1675074678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0"}]: dispatch 2026-02-20T03:12:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:54 trial028 ceph-mon[38552]: osdmap e31: 6 total, 4 up, 6 in 2026-02-20T03:12:55.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:55.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:12:55.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:54 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/3197642194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:55.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:54 trial126 ceph-mon[38476]: from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:12:55.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:54 trial126 ceph-mon[38476]: pgmap v64: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T03:12:55.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:54 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0"}]: dispatch 2026-02-20T03:12:55.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:54 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0"}]': finished 2026-02-20T03:12:55.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:54 trial126 ceph-mon[38476]: from='client.? 10.20.193.177:0/1675074678' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0"}]: dispatch 2026-02-20T03:12:55.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:54 trial126 ceph-mon[38476]: osdmap e31: 6 total, 4 up, 6 in 2026-02-20T03:12:55.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:55.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:12:55.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:54 trial126 ceph-mon[38476]: from='client.? 10.20.193.177:0/3197642194' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:12:57.044 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:12:56 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4[49259]: 2026-02-20T03:12:56.690+0000 7f8a5b214740 -1 osd.4 0 log_to_monitors true 2026-02-20T03:12:57.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:57 trial126 ceph-mon[38476]: pgmap v66: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 125 KiB/s, 0 objects/s recovering 2026-02-20T03:12:57.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:57 trial126 ceph-mon[38476]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T03:12:57.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:57 trial126 ceph-mon[38476]: from='osd.4 [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T03:12:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:57 trial028 ceph-mon[38552]: pgmap v66: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 125 KiB/s, 0 objects/s recovering 2026-02-20T03:12:57.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:57 trial028 ceph-mon[38552]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T03:12:57.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:57 trial028 ceph-mon[38552]: from='osd.4 [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T03:12:57.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:57 trial177 ceph-mon[43181]: pgmap v66: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail; 125 KiB/s, 0 objects/s recovering 2026-02-20T03:12:57.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:57 trial177 ceph-mon[43181]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T03:12:57.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:57 trial177 ceph-mon[43181]: from='osd.4 [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-20T03:12:58.069 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:58 trial177 ceph-mon[43181]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-20T03:12:58.069 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:58 trial177 ceph-mon[43181]: osdmap e32: 6 total, 4 up, 6 in 2026-02-20T03:12:58.069 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:58.070 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:12:58.070 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:58 trial177 ceph-mon[43181]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:58.070 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:58 trial177 ceph-mon[43181]: from='osd.4 [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:58.305 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:58 trial126 ceph-mon[38476]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-20T03:12:58.305 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:58 trial126 ceph-mon[38476]: osdmap e32: 6 total, 4 up, 6 in 2026-02-20T03:12:58.305 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:58.305 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:12:58.306 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:58 trial126 ceph-mon[38476]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:58.306 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:58 trial126 ceph-mon[38476]: from='osd.4 [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:58.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:58 trial028 ceph-mon[38552]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-20T03:12:58.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:58 trial028 ceph-mon[38552]: osdmap e32: 6 total, 4 up, 6 in 2026-02-20T03:12:58.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:58.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:12:58.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:58 trial028 ceph-mon[38552]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:58.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:58 trial028 ceph-mon[38552]: from='osd.4 [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:12:58.601 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:12:58 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4[49259]: 2026-02-20T03:12:58.307+0000 7f8a57195640 -1 osd.4 0 waiting for initial osdmap 2026-02-20T03:12:58.601 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:12:58 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4[49259]: 2026-02-20T03:12:58.310+0000 7f8a4efb7640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:12:59.135 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:59 trial177 ceph-mon[43181]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T03:12:59.135 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:59 trial177 ceph-mon[43181]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:12:59.135 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:59 trial177 ceph-mon[43181]: osdmap e33: 6 total, 4 up, 6 in 2026-02-20T03:12:59.135 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:59 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:59.135 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:59 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:12:59.135 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:59 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:59.135 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:59 trial177 ceph-mon[43181]: from='osd.4 ' entity='osd.4' 2026-02-20T03:12:59.135 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:59 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-20T03:12:59.136 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:12:59 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:59.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:59 trial028 ceph-mon[38552]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T03:12:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:59 trial028 ceph-mon[38552]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:12:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:59 trial028 ceph-mon[38552]: osdmap e33: 6 total, 4 up, 6 in 2026-02-20T03:12:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:59 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:59 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:12:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:59 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:59 trial028 ceph-mon[38552]: from='osd.4 ' entity='osd.4' 2026-02-20T03:12:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:59 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-20T03:12:59.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:12:59 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:12:59.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:59 trial126 ceph-mon[38476]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T03:12:59.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:59 trial126 ceph-mon[38476]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:12:59.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:59 trial126 ceph-mon[38476]: osdmap e33: 6 total, 4 up, 6 in 2026-02-20T03:12:59.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:59 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:59.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:59 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:12:59.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:59 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:12:59.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:59 trial126 ceph-mon[38476]: from='osd.4 ' entity='osd.4' 2026-02-20T03:12:59.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:59 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-20T03:12:59.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:12:59 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:00.168 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:00 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:13:00.168 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:00 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:13:00.168 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:00 trial177 ceph-mon[43181]: Deploying daemon osd.5 on trial177 2026-02-20T03:13:00.168 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:00 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:13:00.168 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:00 trial177 ceph-mon[43181]: osd.4 [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] boot 2026-02-20T03:13:00.168 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:00 trial177 ceph-mon[43181]: osdmap e34: 6 total, 5 up, 6 in 2026-02-20T03:13:00.168 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:00 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:13:00.168 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:00 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:00.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:00 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:13:00.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:00 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:13:00.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:00 trial028 ceph-mon[38552]: Deploying daemon osd.5 on trial177 2026-02-20T03:13:00.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:00 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:13:00.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:00 trial028 ceph-mon[38552]: osd.4 [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] boot 2026-02-20T03:13:00.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:00 trial028 ceph-mon[38552]: osdmap e34: 6 total, 5 up, 6 in 2026-02-20T03:13:00.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:00 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:13:00.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:00 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:00.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:00 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:13:00.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:00 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:13:00.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:00 trial126 ceph-mon[38476]: Deploying daemon osd.5 on trial177 2026-02-20T03:13:00.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:00 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:13:00.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:00 trial126 ceph-mon[38476]: osd.4 [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] boot 2026-02-20T03:13:00.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:00 trial126 ceph-mon[38476]: osdmap e34: 6 total, 5 up, 6 in 2026-02-20T03:13:00.352 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:00 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-20T03:13:00.353 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:00 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:01.286 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.286+0000 7fc709ffb640 1 -- 10.20.193.177:0/3194673503 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc7140630c0 con 0x7fc6f00b0da0 2026-02-20T03:13:01.286 INFO:teuthology.orchestra.run.trial177.stdout:Created osd(s) 5 on host 'trial177' 2026-02-20T03:13:01.288 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6f00b0da0 msgr2=0x7fc6f00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:01.288 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6f00b0da0 0x7fc6f00b3260 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc714076b90 tx=0x7fc6fc005f50 comp rx=0 tx=0).stop 2026-02-20T03:13:01.288 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714102940 msgr2=0x7fc714076e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:01.289 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714102940 0x7fc714076e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc70400c990 tx=0x7fc70400ce60 comp rx=0 tx=0).stop 2026-02-20T03:13:01.289 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 shutdown_connections 2026-02-20T03:13:01.289 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc6f00b0da0 0x7fc6f00b3260 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:01.289 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc714104500 0x7fc7140759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:01.289 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc714103b40 0x7fc714075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:01.289 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 --2- 10.20.193.177:0/3194673503 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc714102940 0x7fc714076e10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:01.289 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 >> 10.20.193.177:0/3194673503 conn(0x7fc7140fe0f0 msgr2=0x7fc714106f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:01.289 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 shutdown_connections 2026-02-20T03:13:01.289 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:01.288+0000 7fc71b04c640 1 -- 10.20.193.177:0/3194673503 wait complete. 2026-02-20T03:13:01.328 DEBUG:teuthology.orchestra.run.trial177:osd.5> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.5.service 2026-02-20T03:13:01.330 INFO:tasks.cephadm:Deploying osd.6 on trial028 with /dev/vg_nvme/lv_2... 2026-02-20T03:13:01.331 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-20T03:13:01.492 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T03:13:01.492 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: osdmap e35: 6 total, 5 up, 6 in 2026-02-20T03:13:01.492 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:01.492 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.493 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:01 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.601 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:13:01.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T03:13:01.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: osdmap e35: 6 total, 5 up, 6 in 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:01 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: osdmap e35: 6 total, 5 up, 6 in 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:01.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:01.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:01.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:01 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:02.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:13:01 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:13:01.783+0000 7f2bed875740 -1 Falling back to public interface 2026-02-20T03:13:02.810 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:13:02.834 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_2 2026-02-20T03:13:03.011 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: Detected new or changed devices on trial177 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial177 to 42023M 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:03.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.091 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:13:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.287+0000 7f2348b40640 1 -- 10.20.193.28:0/2978260225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23441049f0 msgr2=0x7f2344104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.287+0000 7f2348b40640 1 --2- 10.20.193.28:0/2978260225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23441049f0 0x7f2344104df0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2330009a30 tx=0x7f233002f220 comp rx=0 tx=0).stop 2026-02-20T03:13:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.287+0000 7f2348b40640 1 -- 10.20.193.28:0/2978260225 shutdown_connections 2026-02-20T03:13:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.287+0000 7f2348b40640 1 --2- 10.20.193.28:0/2978260225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23441065b0 0x7f234410ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.287+0000 7f2348b40640 1 --2- 10.20.193.28:0/2978260225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2344105bf0 0x7f2344106070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.287+0000 7f2348b40640 1 --2- 10.20.193.28:0/2978260225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23441049f0 0x7f2344104df0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.287+0000 7f2348b40640 1 -- 10.20.193.28:0/2978260225 >> 10.20.193.28:0/2978260225 conn(0x7f2344100180 msgr2=0x7f23441025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.287+0000 7f2348b40640 1 -- 10.20.193.28:0/2978260225 shutdown_connections 2026-02-20T03:13:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.287+0000 7f2348b40640 1 -- 10.20.193.28:0/2978260225 wait complete. 2026-02-20T03:13:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.288+0000 7f2348b40640 1 Processor -- start 2026-02-20T03:13:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.288+0000 7f2348b40640 1 -- start start 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.288+0000 7f2348b40640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23441049f0 0x7f234419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.288+0000 7f2348b40640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2344105bf0 0x7f234419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2348b40640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23441065b0 0x7f23441a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2348b40640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f23441104e0 con 0x7f2344105bf0 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2348b40640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2344110360 con 0x7f23441065b0 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2348b40640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2344110660 con 0x7f23441049f0 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2342ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2344105bf0 0x7f234419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2343fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23441065b0 0x7f23441a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2343fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23441065b0 0x7f23441a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60956/0 (socket says 10.20.193.28:60956) 2026-02-20T03:13:03.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2343fff640 1 -- 10.20.193.28:0/3441428230 learned_addr learned my addr 10.20.193.28:0/3441428230 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:13:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2342ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2344105bf0 0x7f234419d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38870/0 (socket says 10.20.193.28:38870) 2026-02-20T03:13:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f23437fe640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23441049f0 0x7f234419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2343fff640 1 -- 10.20.193.28:0/3441428230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23441049f0 msgr2=0x7f234419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2343fff640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23441049f0 0x7f234419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2343fff640 1 -- 10.20.193.28:0/3441428230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2344105bf0 msgr2=0x7f234419d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2343fff640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2344105bf0 0x7f234419d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:03.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2343fff640 1 -- 10.20.193.28:0/3441428230 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23441a4790 con 0x7f23441065b0 2026-02-20T03:13:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.289+0000 7f2343fff640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23441065b0 0x7f23441a4090 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f233800ef30 tx=0x7f233800c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.290+0000 7f2340ff9640 1 -- 10.20.193.28:0/3441428230 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338019070 con 0x7f23441065b0 2026-02-20T03:13:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.290+0000 7f2340ff9640 1 -- 10.20.193.28:0/3441428230 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23380092d0 con 0x7f23441065b0 2026-02-20T03:13:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.290+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23441a4a20 con 0x7f23441065b0 2026-02-20T03:13:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.290+0000 7f2340ff9640 1 -- 10.20.193.28:0/3441428230 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338007500 con 0x7f23441065b0 2026-02-20T03:13:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.290+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23441a4f60 con 0x7f23441065b0 2026-02-20T03:13:03.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.290+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234410b850 con 0x7f23441065b0 2026-02-20T03:13:03.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.292+0000 7f2340ff9640 1 -- 10.20.193.28:0/3441428230 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f2338004b40 con 0x7f23441065b0 2026-02-20T03:13:03.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.294+0000 7f2340ff9640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23180b0dd0 0x7f23180b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.294+0000 7f2340ff9640 1 -- 10.20.193.28:0/3441428230 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4210+0+0 (secure 0 0 0) 0x7f23380df4e0 con 0x7f23441065b0 2026-02-20T03:13:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.294+0000 7f2340ff9640 1 -- 10.20.193.28:0/3441428230 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f2338010040 con 0x7f23441065b0 2026-02-20T03:13:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.294+0000 7f23437fe640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23180b0dd0 0x7f23180b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:03.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.295+0000 7f23437fe640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23180b0dd0 0x7f23180b3290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2330002410 tx=0x7f23300057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:03.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:03.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: Detected new or changed devices on trial177 2026-02-20T03:13:03.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:03.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:03.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial177 to 42023M 2026-02-20T03:13:03.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:03.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:03.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:03.389+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f23440630c0 con 0x7f23180b0dd0 2026-02-20T03:13:03.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:03.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: Detected new or changed devices on trial177 2026-02-20T03:13:03.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:03.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:03.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial177 to 42023M 2026-02-20T03:13:03.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:03.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:03.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:03.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:04.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:04 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:04.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:04 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:04.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:04 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:04.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:04 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:04.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:04 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:04.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:04 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:04.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:04 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:04.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:04 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:04.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:04 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:05.310 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:05 trial177 ceph-mon[43181]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:05.310 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:05 trial177 ceph-mon[43181]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:05.310 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:05 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2995439799' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f08a6b86-b475-42cd-9e1b-9a0af277f218"}]: dispatch 2026-02-20T03:13:05.310 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:05 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2995439799' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f08a6b86-b475-42cd-9e1b-9a0af277f218"}]': finished 2026-02-20T03:13:05.310 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:05 trial177 ceph-mon[43181]: osdmap e36: 7 total, 5 up, 7 in 2026-02-20T03:13:05.310 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:05 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:05.311 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:05 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:05.311 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:05 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1103100871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:05.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:05 trial126 ceph-mon[38476]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:05.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:05 trial126 ceph-mon[38476]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:05.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:05 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2995439799' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f08a6b86-b475-42cd-9e1b-9a0af277f218"}]: dispatch 2026-02-20T03:13:05.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:05 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2995439799' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f08a6b86-b475-42cd-9e1b-9a0af277f218"}]': finished 2026-02-20T03:13:05.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:05 trial126 ceph-mon[38476]: osdmap e36: 7 total, 5 up, 7 in 2026-02-20T03:13:05.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:05 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:05.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:05 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:05.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:05 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1103100871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:05.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:05 trial028 ceph-mon[38552]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:05.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:05 trial028 ceph-mon[38552]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:05.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:05 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2995439799' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f08a6b86-b475-42cd-9e1b-9a0af277f218"}]: dispatch 2026-02-20T03:13:05.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:05 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2995439799' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f08a6b86-b475-42cd-9e1b-9a0af277f218"}]': finished 2026-02-20T03:13:05.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:05 trial028 ceph-mon[38552]: osdmap e36: 7 total, 5 up, 7 in 2026-02-20T03:13:05.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:05 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:05.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:05 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:05.353 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:05 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1103100871' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:05.717 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:13:05 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:13:05.309+0000 7f2bed875740 -1 osd.5 0 log_to_monitors true 2026-02-20T03:13:06.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:06 trial126 ceph-mon[38476]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T03:13:06.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:06 trial126 ceph-mon[38476]: from='osd.5 [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T03:13:06.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:06 trial028 ceph-mon[38552]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T03:13:06.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:06 trial028 ceph-mon[38552]: from='osd.5 [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T03:13:06.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:06 trial177 ceph-mon[43181]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T03:13:06.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:06 trial177 ceph-mon[43181]: from='osd.5 [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-20T03:13:07.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:07 trial126 ceph-mon[38476]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:07.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:07 trial126 ceph-mon[38476]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-20T03:13:07.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:07 trial126 ceph-mon[38476]: osdmap e37: 7 total, 5 up, 7 in 2026-02-20T03:13:07.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:07.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:07.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:07 trial126 ceph-mon[38476]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:07.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:07 trial126 ceph-mon[38476]: from='osd.5 [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:07.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:07 trial028 ceph-mon[38552]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:07.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:07 trial028 ceph-mon[38552]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-20T03:13:07.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:07 trial028 ceph-mon[38552]: osdmap e37: 7 total, 5 up, 7 in 2026-02-20T03:13:07.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:07.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:07.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:07 trial028 ceph-mon[38552]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:07.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:07 trial028 ceph-mon[38552]: from='osd.5 [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:07.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:07 trial177 ceph-mon[43181]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:07.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:07 trial177 ceph-mon[43181]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-20T03:13:07.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:07 trial177 ceph-mon[43181]: osdmap e37: 7 total, 5 up, 7 in 2026-02-20T03:13:07.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:07.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:07.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:07 trial177 ceph-mon[43181]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:07.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:07 trial177 ceph-mon[43181]: from='osd.5 [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:07.469 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:13:07 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:13:07.027+0000 7f2be97f6640 -1 osd.5 0 waiting for initial osdmap 2026-02-20T03:13:07.469 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:13:07 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:13:07.031+0000 7f2be5620640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:13:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:08 trial126 ceph-mon[38476]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:13:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:08 trial126 ceph-mon[38476]: osdmap e38: 7 total, 5 up, 7 in 2026-02-20T03:13:08.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:08 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:08.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:08 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:08.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:08 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:08.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:08 trial028 ceph-mon[38552]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:13:08.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:08 trial028 ceph-mon[38552]: osdmap e38: 7 total, 5 up, 7 in 2026-02-20T03:13:08.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:08 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:08.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:08 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:08.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:08 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:08.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:08 trial177 ceph-mon[43181]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:13:08.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:08 trial177 ceph-mon[43181]: osdmap e38: 7 total, 5 up, 7 in 2026-02-20T03:13:08.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:08 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:08.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:08 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:08.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:08 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:09.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:09 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:13:09.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:09 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:13:09.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:09 trial028 ceph-mon[38552]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:09.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:09.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:09 trial028 ceph-mon[38552]: osd.5 [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] boot 2026-02-20T03:13:09.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:09 trial028 ceph-mon[38552]: osdmap e39: 7 total, 6 up, 7 in 2026-02-20T03:13:09.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:09.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:09.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:09 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:13:09.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:09 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:13:09.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:09 trial126 ceph-mon[38476]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:09.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:09.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:09 trial126 ceph-mon[38476]: osd.5 [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] boot 2026-02-20T03:13:09.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:09 trial126 ceph-mon[38476]: osdmap e39: 7 total, 6 up, 7 in 2026-02-20T03:13:09.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:09.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:09 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:13:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:09 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:13:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:09 trial177 ceph-mon[43181]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-20T03:13:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:09 trial177 ceph-mon[43181]: osd.5 [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] boot 2026-02-20T03:13:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:09 trial177 ceph-mon[43181]: osdmap e39: 7 total, 6 up, 7 in 2026-02-20T03:13:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-20T03:13:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:10.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:10 trial028 ceph-mon[38552]: osdmap e40: 7 total, 6 up, 7 in 2026-02-20T03:13:10.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:10 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:10.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:10 trial126 ceph-mon[38476]: osdmap e40: 7 total, 6 up, 7 in 2026-02-20T03:13:10.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:10 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:10.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:10 trial177 ceph-mon[43181]: osdmap e40: 7 total, 6 up, 7 in 2026-02-20T03:13:10.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:10 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:11.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:11 trial028 ceph-mon[38552]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T03:13:11.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:11 trial028 ceph-mon[38552]: osdmap e41: 7 total, 6 up, 7 in 2026-02-20T03:13:11.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:11.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-20T03:13:11.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:11 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:11.234 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:11 trial028 ceph-mon[38552]: Deploying daemon osd.6 on trial028 2026-02-20T03:13:11.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:11 trial126 ceph-mon[38476]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T03:13:11.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:11 trial126 ceph-mon[38476]: osdmap e41: 7 total, 6 up, 7 in 2026-02-20T03:13:11.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:11.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-20T03:13:11.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:11 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:11.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:11 trial126 ceph-mon[38476]: Deploying daemon osd.6 on trial028 2026-02-20T03:13:11.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:11 trial177 ceph-mon[43181]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T03:13:11.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:11 trial177 ceph-mon[43181]: osdmap e41: 7 total, 6 up, 7 in 2026-02-20T03:13:11.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:11.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-20T03:13:11.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:11 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:11.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:11 trial177 ceph-mon[43181]: Deploying daemon osd.6 on trial028 2026-02-20T03:13:12.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:12 trial126 ceph-mon[38476]: osdmap e42: 7 total, 6 up, 7 in 2026-02-20T03:13:12.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:12 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:12.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:12 trial028 ceph-mon[38552]: osdmap e42: 7 total, 6 up, 7 in 2026-02-20T03:13:12.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:12 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:12.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:12 trial177 ceph-mon[43181]: osdmap e42: 7 total, 6 up, 7 in 2026-02-20T03:13:12.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:12 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:13.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:13 trial126 ceph-mon[38476]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T03:13:13.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:13 trial126 ceph-mon[38476]: osdmap e43: 7 total, 6 up, 7 in 2026-02-20T03:13:13.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:13 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:13.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:13 trial028 ceph-mon[38552]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T03:13:13.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:13 trial028 ceph-mon[38552]: osdmap e43: 7 total, 6 up, 7 in 2026-02-20T03:13:13.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:13 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:13.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:13 trial177 ceph-mon[43181]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 144 KiB/s, 0 objects/s recovering 2026-02-20T03:13:13.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:13 trial177 ceph-mon[43181]: osdmap e43: 7 total, 6 up, 7 in 2026-02-20T03:13:13.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:13 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:14.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:14 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:14.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:14 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:14.042 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:14 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:14.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:14 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:14.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:14 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:14.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:14 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:14.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:14 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:14.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:14 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:14.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:14 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.286 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 6 on host 'trial028' 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.282+0000 7f2340ff9640 1 -- 10.20.193.28:0/3441428230 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f23440630c0 con 0x7f23180b0dd0 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23180b0dd0 msgr2=0x7f23180b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23180b0dd0 0x7f23180b3290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2330002410 tx=0x7f23300057d0 comp rx=0 tx=0).stop 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23441065b0 msgr2=0x7f23441a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23441065b0 0x7f23441a4090 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f233800ef30 tx=0x7f233800c560 comp rx=0 tx=0).stop 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 shutdown_connections 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23180b0dd0 0x7f23180b3290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23441065b0 0x7f23441a4090 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2344105bf0 0x7f234419d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 --2- 10.20.193.28:0/3441428230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23441049f0 0x7f234419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:15.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.284+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 >> 10.20.193.28:0/3441428230 conn(0x7f2344100180 msgr2=0x7f2344108fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:15.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.285+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 shutdown_connections 2026-02-20T03:13:15.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:15.285+0000 7f2348b40640 1 -- 10.20.193.28:0/3441428230 wait complete. 2026-02-20T03:13:15.298 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:15 trial028 ceph-mon[38552]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 116 KiB/s, 0 objects/s recovering 2026-02-20T03:13:15.298 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:15 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.299 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:15 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.299 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:15 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:15.299 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:15 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:15.299 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:15 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:15 trial126 ceph-mon[38476]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 116 KiB/s, 0 objects/s recovering 2026-02-20T03:13:15.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:15 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:15 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:15 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:15.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:15 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:15.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:15 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.388 DEBUG:teuthology.orchestra.run.trial028:osd.6> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.6.service 2026-02-20T03:13:15.391 INFO:tasks.cephadm:Deploying osd.7 on trial126 with /dev/vg_nvme/lv_2... 2026-02-20T03:13:15.391 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-20T03:13:15.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:15 trial177 ceph-mon[43181]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 116 KiB/s, 0 objects/s recovering 2026-02-20T03:13:15.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:15 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:15 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:15 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:15.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:15 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:15.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:15 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:15.547 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.b/config 2026-02-20T03:13:16.220 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:16 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:16.220 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:16 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:16.220 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:16 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:16.270 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:13:16.288 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial126:vg_nvme/lv_2 2026-02-20T03:13:16.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:16 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:16.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:16 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:16.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:16 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:16.440 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.b/config 2026-02-20T03:13:16.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:16 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:16.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:16 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:16.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:16 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:16.542 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.545+0000 7f6d6d499640 1 -- 10.20.193.126:0/1070093977 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68105dd0 msgr2=0x7f6d68106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:16.542 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.545+0000 7f6d6d499640 1 --2- 10.20.193.126:0/1070093977 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68105dd0 0x7f6d68106250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009a30 tx=0x7f6d5002f260 comp rx=0 tx=0).stop 2026-02-20T03:13:16.542 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.545+0000 7f6d6d499640 1 -- 10.20.193.126:0/1070093977 shutdown_connections 2026-02-20T03:13:16.542 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.545+0000 7f6d6d499640 1 --2- 10.20.193.126:0/1070093977 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d68106790 0x7f6d6810d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:16.543 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.545+0000 7f6d6d499640 1 --2- 10.20.193.126:0/1070093977 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68105dd0 0x7f6d68106250 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:16.543 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.545+0000 7f6d6d499640 1 --2- 10.20.193.126:0/1070093977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d68104bd0 0x7f6d68104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:16.543 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.545+0000 7f6d6d499640 1 -- 10.20.193.126:0/1070093977 >> 10.20.193.126:0/1070093977 conn(0x7f6d68100360 msgr2=0x7f6d681027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:16.543 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.545+0000 7f6d6d499640 1 -- 10.20.193.126:0/1070093977 shutdown_connections 2026-02-20T03:13:16.543 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.545+0000 7f6d6d499640 1 -- 10.20.193.126:0/1070093977 wait complete. 2026-02-20T03:13:16.543 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d6d499640 1 Processor -- start 2026-02-20T03:13:16.543 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d6d499640 1 -- start start 2026-02-20T03:13:16.544 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d6d499640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d68104bd0 0x7f6d6819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:16.544 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d6d499640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d68105dd0 0x7f6d6819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:16.544 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d6d499640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68106790 0x7f6d681a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:16.544 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d6d499640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d681106a0 con 0x7f6d68104bd0 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d6d499640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d68110520 con 0x7f6d68106790 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d6d499640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d68110820 con 0x7f6d68105dd0 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68106790 0x7f6d681a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68106790 0x7f6d681a4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.126:34428/0 (socket says 10.20.193.126:34428) 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d677fe640 1 -- 10.20.193.126:0/3107796011 learned_addr learned my addr 10.20.193.126:0/3107796011 (peer_addr_for_me v2:10.20.193.126:0/0) 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d66ffd640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d68104bd0 0x7f6d6819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d667fc640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d68105dd0 0x7f6d6819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d677fe640 1 -- 10.20.193.126:0/3107796011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d68105dd0 msgr2=0x7f6d6819d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d677fe640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d68105dd0 0x7f6d6819d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:16.545 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d677fe640 1 -- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d68104bd0 msgr2=0x7f6d6819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:16.546 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d677fe640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d68104bd0 0x7f6d6819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:16.546 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d677fe640 1 -- 10.20.193.126:0/3107796011 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d681a4960 con 0x7f6d68106790 2026-02-20T03:13:16.546 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.546+0000 7f6d677fe640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68106790 0x7f6d681a4260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800ef30 tx=0x7f6d5800c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:16.547 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.548+0000 7f6d47fff640 1 -- 10.20.193.126:0/3107796011 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58019070 con 0x7f6d68106790 2026-02-20T03:13:16.547 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.548+0000 7f6d47fff640 1 -- 10.20.193.126:0/3107796011 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d580092d0 con 0x7f6d68106790 2026-02-20T03:13:16.547 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.548+0000 7f6d47fff640 1 -- 10.20.193.126:0/3107796011 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58007500 con 0x7f6d68106790 2026-02-20T03:13:16.548 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.548+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d681a4bf0 con 0x7f6d68106790 2026-02-20T03:13:16.548 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.548+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d681a5180 con 0x7f6d68106790 2026-02-20T03:13:16.548 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.548+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d6810ba90 con 0x7f6d68106790 2026-02-20T03:13:16.548 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.549+0000 7f6d47fff640 1 -- 10.20.193.126:0/3107796011 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f6d58002a60 con 0x7f6d68106790 2026-02-20T03:13:16.548 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.549+0000 7f6d47fff640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d3c0b0e20 0x7f6d3c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:16.548 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.550+0000 7f6d47fff640 1 -- 10.20.193.126:0/3107796011 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4642+0+0 (secure 0 0 0) 0x7f6d580df700 con 0x7f6d68106790 2026-02-20T03:13:16.548 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.550+0000 7f6d66ffd640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d3c0b0e20 0x7f6d3c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:16.548 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.550+0000 7f6d66ffd640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d3c0b0e20 0x7f6d3c0b32e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6d6819db90 tx=0x7f6d5c0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:16.549 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.552+0000 7f6d47fff640 1 -- 10.20.193.126:0/3107796011 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6d58052b20 con 0x7f6d68106790 2026-02-20T03:13:16.637 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:16.640+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6d680630c0 con 0x7f6d3c0b0e20 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:17.421 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T03:13:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:17.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:17.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:17.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:17.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:17.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:18.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: Detected new or changed devices on trial028 2026-02-20T03:13:18.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial028 to 28017M 2026-02-20T03:13:18.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:18.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a8b78d5-ef89-4bd1-94e7-74316c304a1d"}]: dispatch 2026-02-20T03:13:18.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a8b78d5-ef89-4bd1-94e7-74316c304a1d"}]': finished 2026-02-20T03:13:18.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: osdmap e44: 8 total, 6 up, 8 in 2026-02-20T03:13:18.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:18.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:18.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: from='client.? 10.20.193.126:0/1098217814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a8b78d5-ef89-4bd1-94e7-74316c304a1d"}]: dispatch 2026-02-20T03:13:18.602 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:18 trial126 ceph-mon[38476]: from='client.? 10.20.193.126:0/2862375285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:18.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: Detected new or changed devices on trial028 2026-02-20T03:13:18.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial028 to 28017M 2026-02-20T03:13:18.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:18.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a8b78d5-ef89-4bd1-94e7-74316c304a1d"}]: dispatch 2026-02-20T03:13:18.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a8b78d5-ef89-4bd1-94e7-74316c304a1d"}]': finished 2026-02-20T03:13:18.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: osdmap e44: 8 total, 6 up, 8 in 2026-02-20T03:13:18.604 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:18.605 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:18.605 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: from='client.? 10.20.193.126:0/1098217814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a8b78d5-ef89-4bd1-94e7-74316c304a1d"}]: dispatch 2026-02-20T03:13:18.605 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:18 trial028 ceph-mon[38552]: from='client.? 10.20.193.126:0/2862375285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: Detected new or changed devices on trial028 2026-02-20T03:13:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial028 to 28017M 2026-02-20T03:13:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: from='client.24311 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a8b78d5-ef89-4bd1-94e7-74316c304a1d"}]: dispatch 2026-02-20T03:13:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a8b78d5-ef89-4bd1-94e7-74316c304a1d"}]': finished 2026-02-20T03:13:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: osdmap e44: 8 total, 6 up, 8 in 2026-02-20T03:13:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: from='client.? 10.20.193.126:0/1098217814' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a8b78d5-ef89-4bd1-94e7-74316c304a1d"}]: dispatch 2026-02-20T03:13:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:18 trial177 ceph-mon[43181]: from='client.? 10.20.193.126:0/2862375285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:19.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:19 trial028 ceph-mon[38552]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 83 KiB/s, 0 objects/s recovering 2026-02-20T03:13:19.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:19 trial126 ceph-mon[38476]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 83 KiB/s, 0 objects/s recovering 2026-02-20T03:13:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:19 trial177 ceph-mon[43181]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail; 83 KiB/s, 0 objects/s recovering 2026-02-20T03:13:19.851 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:13:19 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:13:19.543+0000 7ff979069740 -1 osd.6 0 log_to_monitors true 2026-02-20T03:13:20.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:20 trial126 ceph-mon[38476]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-20T03:13:20.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:20 trial028 ceph-mon[38552]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-20T03:13:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:20 trial177 ceph-mon[43181]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-20T03:13:21.411 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:21 trial126 ceph-mon[38476]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T03:13:21.411 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:21 trial126 ceph-mon[38476]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T03:13:21.411 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:21 trial126 ceph-mon[38476]: osdmap e45: 8 total, 6 up, 8 in 2026-02-20T03:13:21.411 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:21 trial126 ceph-mon[38476]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:13:21.411 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:21.412 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:21.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:21 trial028 ceph-mon[38552]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T03:13:21.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:21 trial028 ceph-mon[38552]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T03:13:21.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:21 trial028 ceph-mon[38552]: osdmap e45: 8 total, 6 up, 8 in 2026-02-20T03:13:21.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:21 trial028 ceph-mon[38552]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:13:21.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:21.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:21.602 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:13:21 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:13:21.305+0000 7ff974fea640 -1 osd.6 0 waiting for initial osdmap 2026-02-20T03:13:21.602 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:13:21 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:13:21.312+0000 7ff970e14640 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:13:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:21 trial177 ceph-mon[43181]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T03:13:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:21 trial177 ceph-mon[43181]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-20T03:13:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:21 trial177 ceph-mon[43181]: osdmap e45: 8 total, 6 up, 8 in 2026-02-20T03:13:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:21 trial177 ceph-mon[43181]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:13:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:22.486 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:22 trial126 ceph-mon[38476]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:13:22.486 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:22 trial126 ceph-mon[38476]: osdmap e46: 8 total, 6 up, 8 in 2026-02-20T03:13:22.486 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:22.486 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:22.487 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:22.487 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-20T03:13:22.487 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:22.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:22 trial028 ceph-mon[38552]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:13:22.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:22 trial028 ceph-mon[38552]: osdmap e46: 8 total, 6 up, 8 in 2026-02-20T03:13:22.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:22.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:22.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:22.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-20T03:13:22.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:22.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:22 trial177 ceph-mon[43181]: from='osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:13:22.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:22 trial177 ceph-mon[43181]: osdmap e46: 8 total, 6 up, 8 in 2026-02-20T03:13:22.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:22.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:22.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:22.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-20T03:13:22.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:23.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:23 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:13:23.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:23 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:13:23.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:23 trial126 ceph-mon[38476]: Deploying daemon osd.7 on trial126 2026-02-20T03:13:23.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:23 trial126 ceph-mon[38476]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T03:13:23.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:23.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:23 trial126 ceph-mon[38476]: osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] boot 2026-02-20T03:13:23.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:23 trial126 ceph-mon[38476]: osdmap e47: 8 total, 7 up, 8 in 2026-02-20T03:13:23.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:23.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:23.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:23 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:13:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:23 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:13:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:23 trial028 ceph-mon[38552]: Deploying daemon osd.7 on trial126 2026-02-20T03:13:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:23 trial028 ceph-mon[38552]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T03:13:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:23 trial028 ceph-mon[38552]: osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] boot 2026-02-20T03:13:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:23 trial028 ceph-mon[38552]: osdmap e47: 8 total, 7 up, 8 in 2026-02-20T03:13:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:23 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:13:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:23 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:13:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:23 trial177 ceph-mon[43181]: Deploying daemon osd.7 on trial126 2026-02-20T03:13:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:23 trial177 ceph-mon[43181]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-20T03:13:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:23 trial177 ceph-mon[43181]: osd.6 [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] boot 2026-02-20T03:13:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:23 trial177 ceph-mon[43181]: osdmap e47: 8 total, 7 up, 8 in 2026-02-20T03:13:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-20T03:13:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:24.510 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.513+0000 7f6d47fff640 1 -- 10.20.193.126:0/3107796011 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f6d680630c0 con 0x7f6d3c0b0e20 2026-02-20T03:13:24.511 INFO:teuthology.orchestra.run.trial126.stdout:Created osd(s) 7 on host 'trial126' 2026-02-20T03:13:24.512 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d3c0b0e20 msgr2=0x7f6d3c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:24.512 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d3c0b0e20 0x7f6d3c0b32e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6d6819db90 tx=0x7f6d5c0073d0 comp rx=0 tx=0).stop 2026-02-20T03:13:24.512 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68106790 msgr2=0x7f6d681a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:24.513 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68106790 0x7f6d681a4260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800ef30 tx=0x7f6d5800c560 comp rx=0 tx=0).stop 2026-02-20T03:13:24.513 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 shutdown_connections 2026-02-20T03:13:24.513 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d3c0b0e20 0x7f6d3c0b32e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:24.513 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d68106790 0x7f6d681a4260 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:24.513 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d68105dd0 0x7f6d6819d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:24.513 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 --2- 10.20.193.126:0/3107796011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d68104bd0 0x7f6d6819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:24.513 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 >> 10.20.193.126:0/3107796011 conn(0x7f6d68100360 msgr2=0x7f6d681091f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:24.513 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 shutdown_connections 2026-02-20T03:13:24.513 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:24.515+0000 7f6d6d499640 1 -- 10.20.193.126:0/3107796011 wait complete. 2026-02-20T03:13:24.548 DEBUG:teuthology.orchestra.run.trial126:osd.7> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.7.service 2026-02-20T03:13:24.551 INFO:tasks.cephadm:Deploying osd.8 on trial177 with /dev/vg_nvme/lv_2... 2026-02-20T03:13:24.551 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-20T03:13:24.570 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: osdmap e48: 8 total, 7 up, 8 in 2026-02-20T03:13:24.571 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:24.571 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:24.571 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.571 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.571 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.571 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.571 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:24.571 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:24.571 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.575 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: osdmap e48: 8 total, 7 up, 8 in 2026-02-20T03:13:24.575 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:24.575 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:24.575 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.575 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.575 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.576 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.576 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:24.576 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:24.576 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: osdmap e48: 8 total, 7 up, 8 in 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:24.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:24.705 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:13:25.454 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:13:25.471 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial177:vg_nvme/lv_2 2026-02-20T03:13:25.484 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:25.484 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:25.484 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.484 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.484 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.484 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.484 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:25.484 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:25.484 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:25.485 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.485 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:25.485 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:25.485 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.485 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:13:25 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:13:25.277+0000 7f6083703740 -1 Falling back to public interface 2026-02-20T03:13:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.663 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.685 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:25.686 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:25.686 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:25.769 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 -- 10.20.193.177:0/2402531048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4106780 msgr2=0x7f4ac410d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:25.770 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2402531048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4106780 0x7f4ac410d010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400b0a0 tx=0x7f4ab402f410 comp rx=0 tx=0).stop 2026-02-20T03:13:25.770 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 -- 10.20.193.177:0/2402531048 shutdown_connections 2026-02-20T03:13:25.770 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2402531048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4106780 0x7f4ac410d010 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:25.770 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2402531048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ac4105dc0 0x7f4ac4106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:25.770 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2402531048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ac4104bc0 0x7f4ac4104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:25.770 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 -- 10.20.193.177:0/2402531048 >> 10.20.193.177:0/2402531048 conn(0x7f4ac4100370 msgr2=0x7f4ac4102790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:25.770 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 -- 10.20.193.177:0/2402531048 shutdown_connections 2026-02-20T03:13:25.770 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 -- 10.20.193.177:0/2402531048 wait complete. 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.766+0000 7f4ac979d640 1 Processor -- start 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac979d640 1 -- start start 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac979d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ac4104bc0 0x7f4ac419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac979d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4105dc0 0x7f4ac419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac979d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ac4106780 0x7f4ac41a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac979d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac4110760 con 0x7f4ac4104bc0 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac979d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac41105e0 con 0x7f4ac4106780 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac979d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac41108e0 con 0x7f4ac4105dc0 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac27fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4105dc0 0x7f4ac419d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac27fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4105dc0 0x7f4ac419d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:43672/0 (socket says 10.20.193.177:43672) 2026-02-20T03:13:25.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac27fc640 1 -- 10.20.193.177:0/2210053452 learned_addr learned my addr 10.20.193.177:0/2210053452 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac37fe640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ac4106780 0x7f4ac41a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac2ffd640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ac4104bc0 0x7f4ac419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac27fc640 1 -- 10.20.193.177:0/2210053452 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ac4106780 msgr2=0x7f4ac41a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac27fc640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ac4106780 0x7f4ac41a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac27fc640 1 -- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ac4104bc0 msgr2=0x7f4ac419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac27fc640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ac4104bc0 0x7f4ac419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac27fc640 1 -- 10.20.193.177:0/2210053452 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac41a4930 con 0x7f4ac4105dc0 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac2ffd640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ac4104bc0 0x7f4ac419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac37fe640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ac4106780 0x7f4ac41a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac27fc640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4105dc0 0x7f4ac419d1c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00b780 tx=0x7f4aac00bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:25.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4aa3fff640 1 -- 10.20.193.177:0/2210053452 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac004480 con 0x7f4ac4105dc0 2026-02-20T03:13:25.773 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac41a4c20 con 0x7f4ac4105dc0 2026-02-20T03:13:25.773 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4aa3fff640 1 -- 10.20.193.177:0/2210053452 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4aac010070 con 0x7f4ac4105dc0 2026-02-20T03:13:25.773 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4aa3fff640 1 -- 10.20.193.177:0/2210053452 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00cae0 con 0x7f4ac4105dc0 2026-02-20T03:13:25.773 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.767+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac41a51b0 con 0x7f4ac4105dc0 2026-02-20T03:13:25.773 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.768+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac410b9d0 con 0x7f4ac4105dc0 2026-02-20T03:13:25.773 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.769+0000 7f4aa3fff640 1 -- 10.20.193.177:0/2210053452 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f4aac01d030 con 0x7f4ac4105dc0 2026-02-20T03:13:25.774 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.770+0000 7f4aa3fff640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a980b0da0 0x7f4a980b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:25.774 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.770+0000 7f4aa3fff640 1 -- 10.20.193.177:0/2210053452 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5074+0+0 (secure 0 0 0) 0x7f4aac0dec60 con 0x7f4ac4105dc0 2026-02-20T03:13:25.774 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.770+0000 7f4ac2ffd640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a980b0da0 0x7f4a980b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:25.774 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.771+0000 7f4ac2ffd640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a980b0da0 0x7f4a980b3260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8006fd0 tx=0x7f4ab8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:25.775 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.771+0000 7f4aa3fff640 1 -- 10.20.193.177:0/2210053452 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4aac0a8170 con 0x7f4ac4105dc0 2026-02-20T03:13:25.859 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:25.858+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4ac40630c0 con 0x7f4a980b0da0 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:26 trial126 ceph-mon[38476]: Detected new or changed devices on trial126 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:26 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial126 to 28015M 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:26 trial028 ceph-mon[38552]: Detected new or changed devices on trial126 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:26 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial126 to 28015M 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:26.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:26.653 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:26 trial177 ceph-mon[43181]: Detected new or changed devices on trial126 2026-02-20T03:13:26.653 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:26 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial126 to 28015M 2026-02-20T03:13:26.653 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:26.653 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:26.653 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:27 trial126 ceph-mon[38476]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:27 trial126 ceph-mon[38476]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:27 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfc544c3-19d5-4f29-b18f-e846213b9f10"}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:27 trial126 ceph-mon[38476]: from='client.? 10.20.193.177:0/3417963074' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfc544c3-19d5-4f29-b18f-e846213b9f10"}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:27 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfc544c3-19d5-4f29-b18f-e846213b9f10"}]': finished 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:27 trial126 ceph-mon[38476]: osdmap e49: 9 total, 7 up, 9 in 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:27 trial126 ceph-mon[38476]: from='client.? 10.20.193.177:0/3242824968' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:27 trial028 ceph-mon[38552]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:27 trial028 ceph-mon[38552]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:27 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfc544c3-19d5-4f29-b18f-e846213b9f10"}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:27 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/3417963074' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfc544c3-19d5-4f29-b18f-e846213b9f10"}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:27 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfc544c3-19d5-4f29-b18f-e846213b9f10"}]': finished 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:27 trial028 ceph-mon[38552]: osdmap e49: 9 total, 7 up, 9 in 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:27 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/3242824968' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:27 trial177 ceph-mon[43181]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:27 trial177 ceph-mon[43181]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:27 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfc544c3-19d5-4f29-b18f-e846213b9f10"}]: dispatch 2026-02-20T03:13:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:27 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/3417963074' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cfc544c3-19d5-4f29-b18f-e846213b9f10"}]: dispatch 2026-02-20T03:13:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:27 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cfc544c3-19d5-4f29-b18f-e846213b9f10"}]': finished 2026-02-20T03:13:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:27 trial177 ceph-mon[43181]: osdmap e49: 9 total, 7 up, 9 in 2026-02-20T03:13:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:27.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:27 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/3242824968' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:29.318 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:13:29 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:13:29.039+0000 7f6083703740 -1 osd.7 0 log_to_monitors true 2026-02-20T03:13:29.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:29 trial126 ceph-mon[38476]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:29.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:29 trial126 ceph-mon[38476]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T03:13:29.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:29 trial126 ceph-mon[38476]: from='osd.7 [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T03:13:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:29 trial028 ceph-mon[38552]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:29 trial028 ceph-mon[38552]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T03:13:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:29 trial028 ceph-mon[38552]: from='osd.7 [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T03:13:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:29 trial177 ceph-mon[43181]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:29 trial177 ceph-mon[43181]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T03:13:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:29 trial177 ceph-mon[43181]: from='osd.7 [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-20T03:13:30.582 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:30 trial126 ceph-mon[38476]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-20T03:13:30.582 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:30 trial126 ceph-mon[38476]: osdmap e50: 9 total, 7 up, 9 in 2026-02-20T03:13:30.582 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:30.582 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:30.582 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:30 trial126 ceph-mon[38476]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:13:30.583 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:30 trial126 ceph-mon[38476]: from='osd.7 [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:13:30.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:30 trial028 ceph-mon[38552]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-20T03:13:30.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:30 trial028 ceph-mon[38552]: osdmap e50: 9 total, 7 up, 9 in 2026-02-20T03:13:30.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:30.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:30 trial028 ceph-mon[38552]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:13:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:30 trial028 ceph-mon[38552]: from='osd.7 [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:13:30.620 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:30 trial177 ceph-mon[43181]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-20T03:13:30.620 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:30 trial177 ceph-mon[43181]: osdmap e50: 9 total, 7 up, 9 in 2026-02-20T03:13:30.621 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:30.621 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:30.621 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:30 trial177 ceph-mon[43181]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:13:30.621 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:30 trial177 ceph-mon[43181]: from='osd.7 [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:13:30.849 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:13:30 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:13:30.585+0000 7f607f684640 -1 osd.7 0 waiting for initial osdmap 2026-02-20T03:13:30.850 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:13:30 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:13:30.590+0000 7f60774a6640 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:13:31.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:31 trial177 ceph-mon[43181]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:31.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:31 trial177 ceph-mon[43181]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:13:31.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:31 trial177 ceph-mon[43181]: osdmap e51: 9 total, 7 up, 9 in 2026-02-20T03:13:31.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:31.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:31.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:31.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:31 trial177 ceph-mon[43181]: from='osd.7 ' entity='osd.7' 2026-02-20T03:13:31.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2026-02-20T03:13:31.396 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:31 trial126 ceph-mon[38476]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:31 trial126 ceph-mon[38476]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:31 trial126 ceph-mon[38476]: osdmap e51: 9 total, 7 up, 9 in 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:31 trial126 ceph-mon[38476]: from='osd.7 ' entity='osd.7' 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:31 trial028 ceph-mon[38552]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:31 trial028 ceph-mon[38552]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:31 trial028 ceph-mon[38552]: osdmap e51: 9 total, 7 up, 9 in 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:31 trial028 ceph-mon[38552]: from='osd.7 ' entity='osd.7' 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2026-02-20T03:13:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:32 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:13:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:32 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:13:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:32 trial126 ceph-mon[38476]: Deploying daemon osd.8 on trial177 2026-02-20T03:13:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:32 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:32 trial126 ceph-mon[38476]: osd.7 [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] boot 2026-02-20T03:13:32.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:32 trial126 ceph-mon[38476]: osdmap e52: 9 total, 8 up, 9 in 2026-02-20T03:13:32.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:32 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:32.601 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:32 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:32 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:13:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:32 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:13:32.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:32 trial028 ceph-mon[38552]: Deploying daemon osd.8 on trial177 2026-02-20T03:13:32.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:32 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:32.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:32 trial028 ceph-mon[38552]: osd.7 [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] boot 2026-02-20T03:13:32.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:32 trial028 ceph-mon[38552]: osdmap e52: 9 total, 8 up, 9 in 2026-02-20T03:13:32.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:32 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:32.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:32 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:32.688 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:32 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:13:32.688 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:32 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:13:32.688 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:32 trial177 ceph-mon[43181]: Deploying daemon osd.8 on trial177 2026-02-20T03:13:32.688 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:32 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:32.688 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:32 trial177 ceph-mon[43181]: osd.7 [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] boot 2026-02-20T03:13:32.688 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:32 trial177 ceph-mon[43181]: osdmap e52: 9 total, 8 up, 9 in 2026-02-20T03:13:32.688 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:32 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-20T03:13:32.688 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:32 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:33 trial126 ceph-mon[38476]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:33 trial126 ceph-mon[38476]: osdmap e53: 9 total, 8 up, 9 in 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:33 trial028 ceph-mon[38552]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:33 trial028 ceph-mon[38552]: osdmap e53: 9 total, 8 up, 9 in 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:33.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:33 trial177 ceph-mon[43181]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-20T03:13:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:33 trial177 ceph-mon[43181]: osdmap e53: 9 total, 8 up, 9 in 2026-02-20T03:13:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:33.769 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.768+0000 7f4aa3fff640 1 -- 10.20.193.177:0/2210053452 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f4ac40630c0 con 0x7f4a980b0da0 2026-02-20T03:13:33.769 INFO:teuthology.orchestra.run.trial177.stdout:Created osd(s) 8 on host 'trial177' 2026-02-20T03:13:33.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a980b0da0 msgr2=0x7f4a980b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:33.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a980b0da0 0x7f4a980b3260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8006fd0 tx=0x7f4ab8008040 comp rx=0 tx=0).stop 2026-02-20T03:13:33.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4105dc0 msgr2=0x7f4ac419d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:33.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4105dc0 0x7f4ac419d1c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00b780 tx=0x7f4aac00bc50 comp rx=0 tx=0).stop 2026-02-20T03:13:33.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 shutdown_connections 2026-02-20T03:13:33.771 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a980b0da0 0x7f4a980b3260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:33.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4ac4106780 0x7f4ac41a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:33.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4ac4105dc0 0x7f4ac419d1c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:33.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 --2- 10.20.193.177:0/2210053452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4ac4104bc0 0x7f4ac419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:33.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 >> 10.20.193.177:0/2210053452 conn(0x7f4ac4100370 msgr2=0x7f4ac4109130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:33.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 shutdown_connections 2026-02-20T03:13:33.772 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:33.770+0000 7f4ac979d640 1 -- 10.20.193.177:0/2210053452 wait complete. 2026-02-20T03:13:33.809 DEBUG:teuthology.orchestra.run.trial177:osd.8> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.8.service 2026-02-20T03:13:33.811 INFO:tasks.cephadm:Deploying osd.9 on trial028 with /dev/vg_nvme/lv_1... 2026-02-20T03:13:33.812 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-20T03:13:34.073 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:13:34.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:34 trial028 ceph-mon[38552]: osdmap e54: 9 total, 8 up, 9 in 2026-02-20T03:13:34.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:34.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:34.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:34.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:34.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:34.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:34.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:34.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:34 trial028 ceph-mon[38552]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:34.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:34 trial126 ceph-mon[38476]: osdmap e54: 9 total, 8 up, 9 in 2026-02-20T03:13:34.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:34.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:34.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:34.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:34.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:34.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:34.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:34.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:34 trial126 ceph-mon[38476]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:34 trial177 ceph-mon[43181]: osdmap e54: 9 total, 8 up, 9 in 2026-02-20T03:13:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:34 trial177 ceph-mon[43181]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 224 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:35.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:13:34 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:13:34.752+0000 7f652f8b4740 -1 Falling back to public interface 2026-02-20T03:13:35.348 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:13:35.372 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial028:vg_nvme/lv_1 2026-02-20T03:13:35.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: osdmap e55: 9 total, 8 up, 9 in 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: Detected new or changed devices on trial177 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial177 to 28015M 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:35.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: osdmap e55: 9 total, 8 up, 9 in 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: Detected new or changed devices on trial177 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial177 to 28015M 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:35.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:35.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.632 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:13:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: osdmap e55: 9 total, 8 up, 9 in 2026-02-20T03:13:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: Detected new or changed devices on trial177 2026-02-20T03:13:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:35.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial177 to 28015M 2026-02-20T03:13:35.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:35.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:35.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.807+0000 7fb0b3577640 1 -- 10.20.193.28:0/3484911647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b4105bf0 msgr2=0x7fb0b4106070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.807+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3484911647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b4105bf0 0x7fb0b4106070 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009960 tx=0x7fb09c02f140 comp rx=0 tx=0).stop 2026-02-20T03:13:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.807+0000 7fb0b3577640 1 -- 10.20.193.28:0/3484911647 shutdown_connections 2026-02-20T03:13:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.807+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3484911647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0b41065b0 0x7fb0b410ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.807+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3484911647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b4105bf0 0x7fb0b4106070 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.807+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3484911647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0b41049f0 0x7fb0b4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.807+0000 7fb0b3577640 1 -- 10.20.193.28:0/3484911647 >> 10.20.193.28:0/3484911647 conn(0x7fb0b4100180 msgr2=0x7fb0b41025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.807+0000 7fb0b3577640 1 -- 10.20.193.28:0/3484911647 shutdown_connections 2026-02-20T03:13:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.807+0000 7fb0b3577640 1 -- 10.20.193.28:0/3484911647 wait complete. 2026-02-20T03:13:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.808+0000 7fb0b3577640 1 Processor -- start 2026-02-20T03:13:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.808+0000 7fb0b3577640 1 -- start start 2026-02-20T03:13:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.808+0000 7fb0b3577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0b41049f0 0x7fb0b419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.808+0000 7fb0b3577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0b4105bf0 0x7fb0b419cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.808+0000 7fb0b3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b41065b0 0x7fb0b41a4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.808+0000 7fb0b3577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b41104e0 con 0x7fb0b41065b0 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.808+0000 7fb0b3577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b4110360 con 0x7fb0b4105bf0 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.808+0000 7fb0b3577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b4110660 con 0x7fb0b41049f0 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0b41049f0 0x7fb0b419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b41065b0 0x7fb0b41a4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0b41049f0 0x7fb0b419ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60442/0 (socket says 10.20.193.28:60442) 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2575640 1 -- 10.20.193.28:0/3930405349 learned_addr learned my addr 10.20.193.28:0/3930405349 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b1d74640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0b4105bf0 0x7fb0b419cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2d76640 1 -- 10.20.193.28:0/3930405349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0b41049f0 msgr2=0x7fb0b419ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2d76640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0b41049f0 0x7fb0b419ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2d76640 1 -- 10.20.193.28:0/3930405349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0b4105bf0 msgr2=0x7fb0b419cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2d76640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0b4105bf0 0x7fb0b419cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2d76640 1 -- 10.20.193.28:0/3930405349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b41a4740 con 0x7fb0b41065b0 2026-02-20T03:13:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b2d76640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b41065b0 0x7fb0b41a4040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400efc0 tx=0x7fb0a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb09b7fe640 1 -- 10.20.193.28:0/3930405349 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4019070 con 0x7fb0b41065b0 2026-02-20T03:13:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb09b7fe640 1 -- 10.20.193.28:0/3930405349 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb0a40092d0 con 0x7fb0b41065b0 2026-02-20T03:13:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb09b7fe640 1 -- 10.20.193.28:0/3930405349 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4007500 con 0x7fb0b41065b0 2026-02-20T03:13:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b41a49d0 con 0x7fb0b41065b0 2026-02-20T03:13:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.809+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b41a4ec0 con 0x7fb0b41065b0 2026-02-20T03:13:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.810+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b410b800 con 0x7fb0b41065b0 2026-02-20T03:13:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.812+0000 7fb09b7fe640 1 -- 10.20.193.28:0/3930405349 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fb0a4002a60 con 0x7fb0b41065b0 2026-02-20T03:13:35.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.814+0000 7fb09b7fe640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb08c0b0e50 0x7fb08c0b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.814+0000 7fb09b7fe640 1 -- 10.20.193.28:0/3930405349 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5506+0+0 (secure 0 0 0) 0x7fb0a40dfc00 con 0x7fb0b41065b0 2026-02-20T03:13:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.814+0000 7fb09b7fe640 1 -- 10.20.193.28:0/3930405349 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb0a4010040 con 0x7fb0b41065b0 2026-02-20T03:13:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.814+0000 7fb0b2575640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb08c0b0e50 0x7fb08c0b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.814+0000 7fb0b2575640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb08c0b0e50 0x7fb08c0b3310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80059c0 tx=0x7fb0a8009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:35.912+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb0b40630c0 con 0x7fb08c0b0e50 2026-02-20T03:13:36.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:36 trial028 ceph-mon[38552]: osdmap e56: 9 total, 8 up, 9 in 2026-02-20T03:13:36.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:36.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:36 trial028 ceph-mon[38552]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:36.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:36.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:36.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:36.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:36 trial028 ceph-mon[38552]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 224 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:36.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:36 trial126 ceph-mon[38476]: osdmap e56: 9 total, 8 up, 9 in 2026-02-20T03:13:36.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:36.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:36 trial126 ceph-mon[38476]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:36.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:36.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:36.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:36.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:36 trial126 ceph-mon[38476]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 224 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:36.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:36 trial177 ceph-mon[43181]: osdmap e56: 9 total, 8 up, 9 in 2026-02-20T03:13:36.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:36.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:36 trial177 ceph-mon[43181]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial028:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:36.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:36.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:36.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:36.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:36 trial177 ceph-mon[43181]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 224 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:37.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:37 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3249046322' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0bb903a-f9c1-445d-a9b2-5b9eed0489d2"}]: dispatch 2026-02-20T03:13:37.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:37 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3249046322' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0bb903a-f9c1-445d-a9b2-5b9eed0489d2"}]': finished 2026-02-20T03:13:37.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:37 trial028 ceph-mon[38552]: osdmap e57: 10 total, 8 up, 10 in 2026-02-20T03:13:37.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:37.485 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:37.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:37 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3249046322' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0bb903a-f9c1-445d-a9b2-5b9eed0489d2"}]: dispatch 2026-02-20T03:13:37.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:37 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3249046322' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0bb903a-f9c1-445d-a9b2-5b9eed0489d2"}]': finished 2026-02-20T03:13:37.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:37 trial126 ceph-mon[38476]: osdmap e57: 10 total, 8 up, 10 in 2026-02-20T03:13:37.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:37.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:37 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3249046322' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f0bb903a-f9c1-445d-a9b2-5b9eed0489d2"}]: dispatch 2026-02-20T03:13:37.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:37 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3249046322' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f0bb903a-f9c1-445d-a9b2-5b9eed0489d2"}]': finished 2026-02-20T03:13:37.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:37 trial177 ceph-mon[43181]: osdmap e57: 10 total, 8 up, 10 in 2026-02-20T03:13:37.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:37.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:38 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1555047371' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:38 trial177 ceph-mon[43181]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:38.718 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:13:38 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:13:38.512+0000 7f652f8b4740 -1 osd.8 0 log_to_monitors true 2026-02-20T03:13:38.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:38 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1555047371' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:38.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:38 trial126 ceph-mon[38476]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:38 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1555047371' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:38.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:38 trial028 ceph-mon[38552]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:39 trial177 ceph-mon[43181]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2026-02-20T03:13:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:39 trial177 ceph-mon[43181]: from='osd.8 [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2026-02-20T03:13:39.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:39 trial126 ceph-mon[38476]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2026-02-20T03:13:39.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:39 trial126 ceph-mon[38476]: from='osd.8 [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2026-02-20T03:13:39.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:39 trial028 ceph-mon[38552]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2026-02-20T03:13:39.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:39 trial028 ceph-mon[38552]: from='osd.8 [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2026-02-20T03:13:40.632 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:40 trial177 ceph-mon[43181]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-20T03:13:40.632 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:40 trial177 ceph-mon[43181]: osdmap e58: 10 total, 8 up, 10 in 2026-02-20T03:13:40.632 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:40.632 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:40.632 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:40 trial177 ceph-mon[43181]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:40.632 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:40 trial177 ceph-mon[43181]: from='osd.8 [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:40.632 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:40 trial177 ceph-mon[43181]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:40.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:40 trial126 ceph-mon[38476]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-20T03:13:40.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:40 trial126 ceph-mon[38476]: osdmap e58: 10 total, 8 up, 10 in 2026-02-20T03:13:40.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:40.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:40.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:40 trial126 ceph-mon[38476]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:40.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:40 trial126 ceph-mon[38476]: from='osd.8 [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:40.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:40 trial126 ceph-mon[38476]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:40 trial028 ceph-mon[38552]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-20T03:13:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:40 trial028 ceph-mon[38552]: osdmap e58: 10 total, 8 up, 10 in 2026-02-20T03:13:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:40 trial028 ceph-mon[38552]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:40 trial028 ceph-mon[38552]: from='osd.8 [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:13:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:40 trial028 ceph-mon[38552]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:40.967 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:13:40 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:13:40.631+0000 7f652b835640 -1 osd.8 0 waiting for initial osdmap 2026-02-20T03:13:40.968 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:13:40 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:13:40.637+0000 7f6523657640 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:13:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:41 trial028 ceph-mon[38552]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:13:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:41 trial028 ceph-mon[38552]: osdmap e59: 10 total, 8 up, 10 in 2026-02-20T03:13:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:41.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:41.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:41.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:41 trial028 ceph-mon[38552]: from='osd.8 ' entity='osd.8' 2026-02-20T03:13:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:41 trial177 ceph-mon[43181]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:13:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:41 trial177 ceph-mon[43181]: osdmap e59: 10 total, 8 up, 10 in 2026-02-20T03:13:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:41 trial177 ceph-mon[43181]: from='osd.8 ' entity='osd.8' 2026-02-20T03:13:41.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:41 trial126 ceph-mon[38476]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:13:41.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:41 trial126 ceph-mon[38476]: osdmap e59: 10 total, 8 up, 10 in 2026-02-20T03:13:41.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:41.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:41.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:41.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:41 trial126 ceph-mon[38476]: from='osd.8 ' entity='osd.8' 2026-02-20T03:13:42.366 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:42 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:13:42.366 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:42 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:13:42.367 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:42.367 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:42 trial028 ceph-mon[38552]: osd.8 [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] boot 2026-02-20T03:13:42.367 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:42 trial028 ceph-mon[38552]: osdmap e60: 10 total, 9 up, 10 in 2026-02-20T03:13:42.367 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:42.367 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:42.367 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:42 trial028 ceph-mon[38552]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:42.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:42 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:13:42.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:42 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:13:42.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:42.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:42 trial177 ceph-mon[43181]: osd.8 [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] boot 2026-02-20T03:13:42.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:42 trial177 ceph-mon[43181]: osdmap e60: 10 total, 9 up, 10 in 2026-02-20T03:13:42.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:42.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:42.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:42 trial177 ceph-mon[43181]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:42.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:42 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:13:42.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:42 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:13:42.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:42.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:42 trial126 ceph-mon[38476]: osd.8 [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] boot 2026-02-20T03:13:42.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:42 trial126 ceph-mon[38476]: osdmap e60: 10 total, 9 up, 10 in 2026-02-20T03:13:42.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2026-02-20T03:13:42.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:42.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:42 trial126 ceph-mon[38476]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-20T03:13:43.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:43 trial028 ceph-mon[38552]: osdmap e61: 10 total, 9 up, 10 in 2026-02-20T03:13:43.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:43 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:43.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:43 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2026-02-20T03:13:43.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:43 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:43.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:43 trial028 ceph-mon[38552]: Deploying daemon osd.9 on trial028 2026-02-20T03:13:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:43 trial177 ceph-mon[43181]: osdmap e61: 10 total, 9 up, 10 in 2026-02-20T03:13:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:43 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:43 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2026-02-20T03:13:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:43 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:43 trial177 ceph-mon[43181]: Deploying daemon osd.9 on trial028 2026-02-20T03:13:43.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:43 trial126 ceph-mon[38476]: osdmap e61: 10 total, 9 up, 10 in 2026-02-20T03:13:43.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:43 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:43.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:43 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2026-02-20T03:13:43.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:43 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:43.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:43 trial126 ceph-mon[38476]: Deploying daemon osd.9 on trial028 2026-02-20T03:13:44.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:44 trial177 ceph-mon[43181]: osdmap e62: 10 total, 9 up, 10 in 2026-02-20T03:13:44.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:44.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:44 trial177 ceph-mon[43181]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T03:13:44.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:44 trial126 ceph-mon[38476]: osdmap e62: 10 total, 9 up, 10 in 2026-02-20T03:13:44.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:44.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:44 trial126 ceph-mon[38476]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T03:13:44.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:44 trial028 ceph-mon[38552]: osdmap e62: 10 total, 9 up, 10 in 2026-02-20T03:13:44.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:44.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:44 trial028 ceph-mon[38552]: pgmap v121: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T03:13:45.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:45 trial028 ceph-mon[38552]: osdmap e63: 10 total, 9 up, 10 in 2026-02-20T03:13:45.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:45 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:45 trial177 ceph-mon[43181]: osdmap e63: 10 total, 9 up, 10 in 2026-02-20T03:13:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:45 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:45.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:45 trial126 ceph-mon[38476]: osdmap e63: 10 total, 9 up, 10 in 2026-02-20T03:13:45.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:45 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:46.613 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:46 trial028 ceph-mon[38552]: osdmap e64: 10 total, 9 up, 10 in 2026-02-20T03:13:46.613 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:46.613 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:46 trial028 ceph-mon[38552]: pgmap v124: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T03:13:46.613 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:46.613 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:46.613 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:46.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:46 trial177 ceph-mon[43181]: osdmap e64: 10 total, 9 up, 10 in 2026-02-20T03:13:46.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:46.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:46 trial177 ceph-mon[43181]: pgmap v124: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T03:13:46.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:46.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:46 trial126 ceph-mon[38476]: osdmap e64: 10 total, 9 up, 10 in 2026-02-20T03:13:46.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:46.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:46 trial126 ceph-mon[38476]: pgmap v124: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T03:13:46.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:46.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:46.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.482+0000 7fb09b7fe640 1 -- 10.20.193.28:0/3930405349 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb0b40630c0 con 0x7fb08c0b0e50 2026-02-20T03:13:47.486 INFO:teuthology.orchestra.run.trial028.stdout:Created osd(s) 9 on host 'trial028' 2026-02-20T03:13:47.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb08c0b0e50 msgr2=0x7fb08c0b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:47.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb08c0b0e50 0x7fb08c0b3310 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80059c0 tx=0x7fb0a8009340 comp rx=0 tx=0).stop 2026-02-20T03:13:47.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b41065b0 msgr2=0x7fb0b41a4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:47.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b41065b0 0x7fb0b41a4040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400efc0 tx=0x7fb0a400c490 comp rx=0 tx=0).stop 2026-02-20T03:13:47.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 shutdown_connections 2026-02-20T03:13:47.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb08c0b0e50 0x7fb08c0b3310 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:47.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0b41065b0 0x7fb0b41a4040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:47.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0b4105bf0 0x7fb0b419cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:47.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 --2- 10.20.193.28:0/3930405349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0b41049f0 0x7fb0b419ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:47.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 >> 10.20.193.28:0/3930405349 conn(0x7fb0b4100180 msgr2=0x7fb0b4108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:47.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 shutdown_connections 2026-02-20T03:13:47.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:13:47.485+0000 7fb0b3577640 1 -- 10.20.193.28:0/3930405349 wait complete. 2026-02-20T03:13:47.632 DEBUG:teuthology.orchestra.run.trial028:osd.9> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.9.service 2026-02-20T03:13:47.636 INFO:tasks.cephadm:Deploying osd.10 on trial126 with /dev/vg_nvme/lv_1... 2026-02-20T03:13:47.636 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-20T03:13:47.790 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.b/config 2026-02-20T03:13:48.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.148 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.148 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:48.148 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:48.148 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.148 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:48.148 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.148 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.164 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.164 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.165 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:48.165 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:48.165 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.165 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:48.165 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.165 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:48.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:48.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:48.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:48.542 INFO:teuthology.orchestra.run.trial126.stdout: 2026-02-20T03:13:48.561 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial126:vg_nvme/lv_1 2026-02-20T03:13:48.713 INFO:teuthology.orchestra.run.trial126.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.b/config 2026-02-20T03:13:48.825 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 -- 10.20.193.126:0/3388153567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 msgr2=0x7f0d64106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:48.825 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 --2- 10.20.193.126:0/3388153567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 0x7f0d64106940 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000b0a0 tx=0x7f0d6002f410 comp rx=0 tx=0).stop 2026-02-20T03:13:48.825 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 -- 10.20.193.126:0/3388153567 shutdown_connections 2026-02-20T03:13:48.825 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 --2- 10.20.193.126:0/3388153567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 0x7f0d64106940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:48.825 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 --2- 10.20.193.126:0/3388153567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d64103ae0 0x7f0d64105f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:48.825 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 --2- 10.20.193.126:0/3388153567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d64101190 0x7f0d641035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:48.825 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 -- 10.20.193.126:0/3388153567 >> 10.20.193.126:0/3388153567 conn(0x7f0d640fcfa0 msgr2=0x7f0d640ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:48.825 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 -- 10.20.193.126:0/3388153567 shutdown_connections 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 -- 10.20.193.126:0/3388153567 wait complete. 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 Processor -- start 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 -- start start 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d64101190 0x7f0d641a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d64103ae0 0x7f0d641a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 0x7f0d641a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64114ca0 con 0x7f0d64101190 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64114b20 con 0x7f0d64106490 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6c302640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d64114e20 con 0x7f0d64103ae0 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6a878640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 0x7f0d641a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:48.826 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6a878640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 0x7f0d641a87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.126:60248/0 (socket says 10.20.193.126:60248) 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6a878640 1 -- 10.20.193.126:0/2374374254 learned_addr learned my addr 10.20.193.126:0/2374374254 (peer_addr_for_me v2:10.20.193.126:0/0) 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6a077640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d64101190 0x7f0d641a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6a878640 1 -- 10.20.193.126:0/2374374254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d64103ae0 msgr2=0x7f0d641a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6a878640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d64103ae0 0x7f0d641a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6a878640 1 -- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d64101190 msgr2=0x7f0d641a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6a878640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d64101190 0x7f0d641a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.826+0000 7f0d6a878640 1 -- 10.20.193.126:0/2374374254 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d641a8ef0 con 0x7f0d64106490 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.827+0000 7f0d6a878640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 0x7f0d641a87f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000c090 tx=0x7f0d60004990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.827+0000 7f0d4b7fe640 1 -- 10.20.193.126:0/2374374254 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60002c60 con 0x7f0d64106490 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.827+0000 7f0d4b7fe640 1 -- 10.20.193.126:0/2374374254 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d60002e00 con 0x7f0d64106490 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.827+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d641a9180 con 0x7f0d64106490 2026-02-20T03:13:48.827 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.827+0000 7f0d4b7fe640 1 -- 10.20.193.126:0/2374374254 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60038a50 con 0x7f0d64106490 2026-02-20T03:13:48.828 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.827+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d641a9680 con 0x7f0d64106490 2026-02-20T03:13:48.828 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.827+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d640fe500 con 0x7f0d64106490 2026-02-20T03:13:48.828 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.828+0000 7f0d4b7fe640 1 -- 10.20.193.126:0/2374374254 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f0d60038bf0 con 0x7f0d64106490 2026-02-20T03:13:48.829 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.829+0000 7f0d4b7fe640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d400b0e50 0x7f0d400b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:48.829 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.829+0000 7f0d4b7fe640 1 -- 10.20.193.126:0/2374374254 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5938+0+0 (secure 0 0 0) 0x7f0d601046b0 con 0x7f0d64106490 2026-02-20T03:13:48.829 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.829+0000 7f0d6a077640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d400b0e50 0x7f0d400b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:48.829 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.830+0000 7f0d6a077640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d400b0e50 0x7f0d400b3310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009990 tx=0x7f0d54008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:48.829 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.830+0000 7f0d4b7fe640 1 -- 10.20.193.126:0/2374374254 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0d600cd840 con 0x7f0d64106490 2026-02-20T03:13:48.913 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:48.917+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0d640630c0 con 0x7f0d400b0e50 2026-02-20T03:13:49.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail; 102 KiB/s, 0 objects/s recovering 2026-02-20T03:13:49.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.098 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:49.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:49.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail; 102 KiB/s, 0 objects/s recovering 2026-02-20T03:13:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:49.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail; 102 KiB/s, 0 objects/s recovering 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:49.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:50.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: Detected new or changed devices on trial028 2026-02-20T03:13:50.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial028 to 21013M 2026-02-20T03:13:50.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:50.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:50.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:50.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:50.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b911c8a-899c-45c2-8851-56fe9de089e8"}]: dispatch 2026-02-20T03:13:50.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b911c8a-899c-45c2-8851-56fe9de089e8"}]': finished 2026-02-20T03:13:50.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: osdmap e65: 11 total, 9 up, 11 in 2026-02-20T03:13:50.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:50.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:50.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='client.? 10.20.193.126:0/816647163' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b911c8a-899c-45c2-8851-56fe9de089e8"}]: dispatch 2026-02-20T03:13:50.101 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:49 trial126 ceph-mon[38476]: from='client.? 10.20.193.126:0/2064094282' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:50.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: Detected new or changed devices on trial028 2026-02-20T03:13:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial028 to 21013M 2026-02-20T03:13:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b911c8a-899c-45c2-8851-56fe9de089e8"}]: dispatch 2026-02-20T03:13:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b911c8a-899c-45c2-8851-56fe9de089e8"}]': finished 2026-02-20T03:13:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: osdmap e65: 11 total, 9 up, 11 in 2026-02-20T03:13:50.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:50.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:50.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='client.? 10.20.193.126:0/816647163' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b911c8a-899c-45c2-8851-56fe9de089e8"}]: dispatch 2026-02-20T03:13:50.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:49 trial177 ceph-mon[43181]: from='client.? 10.20.193.126:0/2064094282' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:50.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: Detected new or changed devices on trial028 2026-02-20T03:13:50.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial028 to 21013M 2026-02-20T03:13:50.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='client.24386 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial126:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:50.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:50.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:50.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:50.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b911c8a-899c-45c2-8851-56fe9de089e8"}]: dispatch 2026-02-20T03:13:50.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b911c8a-899c-45c2-8851-56fe9de089e8"}]': finished 2026-02-20T03:13:50.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: osdmap e65: 11 total, 9 up, 11 in 2026-02-20T03:13:50.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:50.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:50.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='client.? 10.20.193.126:0/816647163' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b911c8a-899c-45c2-8851-56fe9de089e8"}]: dispatch 2026-02-20T03:13:50.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:49 trial028 ceph-mon[38552]: from='client.? 10.20.193.126:0/2064094282' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:51.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:50 trial177 ceph-mon[43181]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T03:13:51.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:50 trial126 ceph-mon[38476]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T03:13:51.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:50 trial028 ceph-mon[38552]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T03:13:51.851 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:13:51 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:13:51.554+0000 7f6b807cf740 -1 osd.9 0 log_to_monitors true 2026-02-20T03:13:52.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:51 trial177 ceph-mon[43181]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2026-02-20T03:13:52.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:51 trial177 ceph-mon[43181]: from='osd.9 [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2026-02-20T03:13:52.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:51 trial126 ceph-mon[38476]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2026-02-20T03:13:52.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:51 trial126 ceph-mon[38476]: from='osd.9 [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2026-02-20T03:13:52.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:51 trial028 ceph-mon[38552]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2026-02-20T03:13:52.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:51 trial028 ceph-mon[38552]: from='osd.9 [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2026-02-20T03:13:53.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:52 trial177 ceph-mon[43181]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-20T03:13:53.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:52 trial177 ceph-mon[43181]: osdmap e66: 11 total, 9 up, 11 in 2026-02-20T03:13:53.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:53.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:53.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:52 trial177 ceph-mon[43181]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:13:53.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:52 trial177 ceph-mon[43181]: from='osd.9 [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:13:53.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:52 trial177 ceph-mon[43181]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail; 87 KiB/s, 0 objects/s recovering 2026-02-20T03:13:53.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:52 trial126 ceph-mon[38476]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-20T03:13:53.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:52 trial126 ceph-mon[38476]: osdmap e66: 11 total, 9 up, 11 in 2026-02-20T03:13:53.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:53.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:53.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:52 trial126 ceph-mon[38476]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:13:53.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:52 trial126 ceph-mon[38476]: from='osd.9 [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:13:53.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:52 trial126 ceph-mon[38476]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail; 87 KiB/s, 0 objects/s recovering 2026-02-20T03:13:53.351 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:13:52 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:13:52.942+0000 7f6b7c750640 -1 osd.9 0 waiting for initial osdmap 2026-02-20T03:13:53.351 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:13:52 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:13:52.951+0000 7f6b7857a640 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:13:53.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:52 trial028 ceph-mon[38552]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-20T03:13:53.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:52 trial028 ceph-mon[38552]: osdmap e66: 11 total, 9 up, 11 in 2026-02-20T03:13:53.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:53.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:53.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:52 trial028 ceph-mon[38552]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:13:53.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:52 trial028 ceph-mon[38552]: from='osd.9 [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]: dispatch 2026-02-20T03:13:53.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:52 trial028 ceph-mon[38552]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail; 87 KiB/s, 0 objects/s recovering 2026-02-20T03:13:54.180 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:53 trial126 ceph-mon[38476]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:13:54.180 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:53 trial126 ceph-mon[38476]: osdmap e67: 11 total, 9 up, 11 in 2026-02-20T03:13:54.180 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:54.180 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:54.180 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:54.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:53 trial177 ceph-mon[43181]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:13:54.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:53 trial177 ceph-mon[43181]: osdmap e67: 11 total, 9 up, 11 in 2026-02-20T03:13:54.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:54.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:54.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:53 trial028 ceph-mon[38552]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial028", "root=default"]}]': finished 2026-02-20T03:13:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:53 trial028 ceph-mon[38552]: osdmap e67: 11 total, 9 up, 11 in 2026-02-20T03:13:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:54.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: osd.9 [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] boot 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: osdmap e68: 11 total, 10 up, 11 in 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: Deploying daemon osd.10 on trial126 2026-02-20T03:13:55.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:54 trial126 ceph-mon[38476]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T03:13:55.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:13:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:13:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: osd.9 [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] boot 2026-02-20T03:13:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: osdmap e68: 11 total, 10 up, 11 in 2026-02-20T03:13:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2026-02-20T03:13:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:55.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: Deploying daemon osd.10 on trial126 2026-02-20T03:13:55.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:54 trial177 ceph-mon[43181]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T03:13:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:13:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:13:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: osd.9 [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] boot 2026-02-20T03:13:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: osdmap e68: 11 total, 10 up, 11 in 2026-02-20T03:13:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2026-02-20T03:13:55.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:55.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2026-02-20T03:13:55.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:55.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: Deploying daemon osd.10 on trial126 2026-02-20T03:13:55.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:54 trial028 ceph-mon[38552]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-20T03:13:56.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:55 trial126 ceph-mon[38476]: osdmap e69: 11 total, 10 up, 11 in 2026-02-20T03:13:56.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:56.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:56.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:56.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:55 trial177 ceph-mon[43181]: osdmap e69: 11 total, 10 up, 11 in 2026-02-20T03:13:56.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:56.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:56.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:56.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:55 trial028 ceph-mon[38552]: osdmap e69: 11 total, 10 up, 11 in 2026-02-20T03:13:56.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:56.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:56.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:56.802 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.805+0000 7f0d4b7fe640 1 -- 10.20.193.126:0/2374374254 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0d640630c0 con 0x7f0d400b0e50 2026-02-20T03:13:56.802 INFO:teuthology.orchestra.run.trial126.stdout:Created osd(s) 10 on host 'trial126' 2026-02-20T03:13:56.804 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d400b0e50 msgr2=0x7f0d400b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:56.804 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d400b0e50 0x7f0d400b3310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d54009990 tx=0x7f0d54008040 comp rx=0 tx=0).stop 2026-02-20T03:13:56.804 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 msgr2=0x7f0d641a87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:56.804 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 0x7f0d641a87f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000c090 tx=0x7f0d60004990 comp rx=0 tx=0).stop 2026-02-20T03:13:56.804 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 shutdown_connections 2026-02-20T03:13:56.804 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d400b0e50 0x7f0d400b3310 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:56.804 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d64106490 0x7f0d641a87f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:56.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d64103ae0 0x7f0d641a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:56.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 --2- 10.20.193.126:0/2374374254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d64101190 0x7f0d641a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:56.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.807+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 >> 10.20.193.126:0/2374374254 conn(0x7f0d640fcfa0 msgr2=0x7f0d64101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:56.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.808+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 shutdown_connections 2026-02-20T03:13:56.805 INFO:teuthology.orchestra.run.trial126.stderr:2026-02-20T03:13:56.808+0000 7f0d6c302640 1 -- 10.20.193.126:0/2374374254 wait complete. 2026-02-20T03:13:56.843 DEBUG:teuthology.orchestra.run.trial126:osd.10> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.10.service 2026-02-20T03:13:56.845 INFO:tasks.cephadm:Deploying osd.11 on trial177 with /dev/vg_nvme/lv_1... 2026-02-20T03:13:56.845 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-20T03:13:56.998 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:13:57.008 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.008 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:13:57.008 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.008 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.008 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:57.008 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:57.008 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.009 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:57.009 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.009 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.122 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.122 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:13:57.123 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.123 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.123 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:57.123 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:57.123 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.124 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:57.124 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.124 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:13:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:13:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:57.752 INFO:teuthology.orchestra.run.trial177.stdout: 2026-02-20T03:13:57.767 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch daemon add osd trial177:vg_nvme/lv_1 2026-02-20T03:13:57.922 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:13:58.031 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 -- 10.20.193.177:0/2594658856 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188106780 msgr2=0x7f518810d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:58.032 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 --2- 10.20.193.177:0/2594658856 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188106780 0x7f518810d010 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f518400b0a0 tx=0x7f518402f410 comp rx=0 tx=0).stop 2026-02-20T03:13:58.032 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 -- 10.20.193.177:0/2594658856 shutdown_connections 2026-02-20T03:13:58.032 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 --2- 10.20.193.177:0/2594658856 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188106780 0x7f518810d010 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:58.032 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 --2- 10.20.193.177:0/2594658856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5188105dc0 0x7f5188106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:58.032 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 --2- 10.20.193.177:0/2594658856 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5188104bc0 0x7f5188104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:58.032 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 -- 10.20.193.177:0/2594658856 >> 10.20.193.177:0/2594658856 conn(0x7f5188100370 msgr2=0x7f5188102790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:13:58.032 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 -- 10.20.193.177:0/2594658856 shutdown_connections 2026-02-20T03:13:58.032 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 -- 10.20.193.177:0/2594658856 wait complete. 2026-02-20T03:13:58.032 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 Processor -- start 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.028+0000 7f518fa4c640 1 -- start start 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518fa4c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188104bc0 0x7f518819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518fa4c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5188105dc0 0x7f518819d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518fa4c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5188106780 0x7f51881a4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518fa4c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5188110640 con 0x7f5188106780 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518fa4c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f51881104c0 con 0x7f5188105dc0 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518fa4c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f51881107c0 con 0x7f5188104bc0 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518d7c1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188104bc0 0x7f518819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518d7c1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188104bc0 0x7f518819cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:55186/0 (socket says 10.20.193.177:55186) 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518d7c1640 1 -- 10.20.193.177:0/779248114 learned_addr learned my addr 10.20.193.177:0/779248114 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:13:58.033 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518cfc0640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5188105dc0 0x7f518819d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518dfc2640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5188106780 0x7f51881a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518d7c1640 1 -- 10.20.193.177:0/779248114 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5188105dc0 msgr2=0x7f518819d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518d7c1640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5188105dc0 0x7f518819d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518d7c1640 1 -- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5188106780 msgr2=0x7f51881a4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518d7c1640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5188106780 0x7f51881a4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518d7c1640 1 -- 10.20.193.177:0/779248114 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51881a4830 con 0x7f5188104bc0 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518dfc2640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5188106780 0x7f51881a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518d7c1640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188104bc0 0x7f518819cb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f517800c990 tx=0x7f517800ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f51767fc640 1 -- 10.20.193.177:0/779248114 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178007c70 con 0x7f5188104bc0 2026-02-20T03:13:58.034 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f51767fc640 1 -- 10.20.193.177:0/779248114 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5178007e10 con 0x7f5188104bc0 2026-02-20T03:13:58.035 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51881a4b20 con 0x7f5188104bc0 2026-02-20T03:13:58.035 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f51767fc640 1 -- 10.20.193.177:0/779248114 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517800f470 con 0x7f5188104bc0 2026-02-20T03:13:58.035 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51881a50b0 con 0x7f5188104bc0 2026-02-20T03:13:58.035 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.029+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f518810ba30 con 0x7f5188104bc0 2026-02-20T03:13:58.035 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.031+0000 7f51767fc640 1 -- 10.20.193.177:0/779248114 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f517801f030 con 0x7f5188104bc0 2026-02-20T03:13:58.036 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.031+0000 7f51767fc640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51640b0e50 0x7f51640b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:13:58.036 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.032+0000 7f51767fc640 1 -- 10.20.193.177:0/779248114 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6370+0+0 (secure 0 0 0) 0x7f51780e00c0 con 0x7f5188104bc0 2026-02-20T03:13:58.036 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.032+0000 7f518cfc0640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51640b0e50 0x7f51640b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:13:58.036 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.032+0000 7f518cfc0640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51640b0e50 0x7f51640b3310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f518819e090 tx=0x7f517c005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:13:58.037 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.032+0000 7f51767fc640 1 -- 10.20.193.177:0/779248114 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f51780a90b0 con 0x7f5188104bc0 2026-02-20T03:13:58.099 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:13:57 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:13:57.807+0000 7fb0cfaef740 -1 Falling back to public interface 2026-02-20T03:13:58.120 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:13:58.119+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f51880630c0 con 0x7f51640b0e50 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: Detected new or changed devices on trial126 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial126 to 21011M 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:58.646 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:58 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:58.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: Detected new or changed devices on trial126 2026-02-20T03:13:58.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial126 to 21011M 2026-02-20T03:13:58.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:58.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:58.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:13:58.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:58.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:58.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:58.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:58 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: Detected new or changed devices on trial126 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial126 to 21011M 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:58.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:13:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:13:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:13:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial177:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:13:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-20T03:13:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-20T03:13:58.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:58 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:13:59.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:59 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10be6c12-30e6-42bf-bf2c-b4b219cb18bb"}]: dispatch 2026-02-20T03:13:59.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:59 trial126 ceph-mon[38476]: from='client.? 10.20.193.177:0/3472755203' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10be6c12-30e6-42bf-bf2c-b4b219cb18bb"}]: dispatch 2026-02-20T03:13:59.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:59 trial126 ceph-mon[38476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10be6c12-30e6-42bf-bf2c-b4b219cb18bb"}]': finished 2026-02-20T03:13:59.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:59 trial126 ceph-mon[38476]: osdmap e70: 12 total, 10 up, 12 in 2026-02-20T03:13:59.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:59 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:59.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:59 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:13:59.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:13:59 trial126 ceph-mon[38476]: from='client.? 10.20.193.177:0/675160525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:59 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10be6c12-30e6-42bf-bf2c-b4b219cb18bb"}]: dispatch 2026-02-20T03:13:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:59 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/3472755203' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10be6c12-30e6-42bf-bf2c-b4b219cb18bb"}]: dispatch 2026-02-20T03:13:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:59 trial028 ceph-mon[38552]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10be6c12-30e6-42bf-bf2c-b4b219cb18bb"}]': finished 2026-02-20T03:13:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:59 trial028 ceph-mon[38552]: osdmap e70: 12 total, 10 up, 12 in 2026-02-20T03:13:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:59 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:59 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:13:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:13:59 trial028 ceph-mon[38552]: from='client.? 10.20.193.177:0/675160525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:13:59.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:59 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10be6c12-30e6-42bf-bf2c-b4b219cb18bb"}]: dispatch 2026-02-20T03:13:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:59 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/3472755203' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "10be6c12-30e6-42bf-bf2c-b4b219cb18bb"}]: dispatch 2026-02-20T03:13:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:59 trial177 ceph-mon[43181]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "10be6c12-30e6-42bf-bf2c-b4b219cb18bb"}]': finished 2026-02-20T03:13:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:59 trial177 ceph-mon[43181]: osdmap e70: 12 total, 10 up, 12 in 2026-02-20T03:13:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:59 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:13:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:59 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:13:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:13:59 trial177 ceph-mon[43181]: from='client.? 10.20.193.177:0/675160525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-20T03:14:00.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:00 trial126 ceph-mon[38476]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:14:00.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:00 trial028 ceph-mon[38552]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:14:00.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:00 trial177 ceph-mon[43181]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:14:01.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:01 trial126 ceph-mon[38476]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2026-02-20T03:14:01.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:01 trial126 ceph-mon[38476]: from='osd.10 [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2026-02-20T03:14:01.850 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:14:01 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:14:01.372+0000 7fb0cfaef740 -1 osd.10 0 log_to_monitors true 2026-02-20T03:14:01.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:01 trial028 ceph-mon[38552]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2026-02-20T03:14:01.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:01 trial028 ceph-mon[38552]: from='osd.10 [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2026-02-20T03:14:01.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:01 trial177 ceph-mon[43181]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2026-02-20T03:14:01.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:01 trial177 ceph-mon[43181]: from='osd.10 [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2026-02-20T03:14:02.849 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:14:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:14:02.787+0000 7fb0cba70640 -1 osd.10 0 waiting for initial osdmap 2026-02-20T03:14:02.850 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:14:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:14:02.794+0000 7fb0c3892640 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:14:02.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:02 trial126 ceph-mon[38476]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-20T03:14:02.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:02 trial126 ceph-mon[38476]: osdmap e71: 12 total, 10 up, 12 in 2026-02-20T03:14:02.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:02 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:02.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:02 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:02.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:02 trial126 ceph-mon[38476]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:14:02.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:02 trial126 ceph-mon[38476]: from='osd.10 [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:14:02.851 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:02 trial126 ceph-mon[38476]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:14:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:02 trial028 ceph-mon[38552]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-20T03:14:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:02 trial028 ceph-mon[38552]: osdmap e71: 12 total, 10 up, 12 in 2026-02-20T03:14:02.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:02 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:02.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:02 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:02.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:02 trial028 ceph-mon[38552]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:14:02.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:02 trial028 ceph-mon[38552]: from='osd.10 [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:14:02.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:02 trial028 ceph-mon[38552]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:14:02.886 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:02 trial177 ceph-mon[43181]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-20T03:14:02.886 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:02 trial177 ceph-mon[43181]: osdmap e71: 12 total, 10 up, 12 in 2026-02-20T03:14:02.887 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:02 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:02.887 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:02 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:02.887 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:02 trial177 ceph-mon[43181]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:14:02.887 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:02 trial177 ceph-mon[43181]: from='osd.10 [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]: dispatch 2026-02-20T03:14:02.887 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:02 trial177 ceph-mon[43181]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:14:03.671 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:03 trial177 ceph-mon[43181]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:14:03.672 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:03 trial177 ceph-mon[43181]: osdmap e72: 12 total, 10 up, 12 in 2026-02-20T03:14:03.672 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:03.672 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:03.672 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:03.672 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:03 trial177 ceph-mon[43181]: from='osd.10 ' entity='osd.10' 2026-02-20T03:14:03.672 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2026-02-20T03:14:03.672 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:03 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:03 trial126 ceph-mon[38476]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:14:03.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:03 trial126 ceph-mon[38476]: osdmap e72: 12 total, 10 up, 12 in 2026-02-20T03:14:03.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:03.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:03.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:03.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:03 trial126 ceph-mon[38476]: from='osd.10 ' entity='osd.10' 2026-02-20T03:14:03.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2026-02-20T03:14:03.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:03 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:03 trial028 ceph-mon[38552]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial126", "root=default"]}]': finished 2026-02-20T03:14:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:03 trial028 ceph-mon[38552]: osdmap e72: 12 total, 10 up, 12 in 2026-02-20T03:14:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:03 trial028 ceph-mon[38552]: from='osd.10 ' entity='osd.10' 2026-02-20T03:14:03.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2026-02-20T03:14:03.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:03 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:04.833 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:14:04.833 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:14:04.833 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: Deploying daemon osd.11 on trial177 2026-02-20T03:14:04.833 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:04.833 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: osd.10 [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] boot 2026-02-20T03:14:04.833 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: osdmap e73: 12 total, 11 up, 12 in 2026-02-20T03:14:04.834 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:04.834 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:04.834 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:14:04.834 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: osdmap e74: 12 total, 11 up, 12 in 2026-02-20T03:14:04.834 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:04 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:14:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:14:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: Deploying daemon osd.11 on trial177 2026-02-20T03:14:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: osd.10 [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] boot 2026-02-20T03:14:04.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: osdmap e73: 12 total, 11 up, 12 in 2026-02-20T03:14:04.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:04.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:04.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:14:04.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: osdmap e74: 12 total, 11 up, 12 in 2026-02-20T03:14:04.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:04 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:14:04.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:14:04.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: Deploying daemon osd.11 on trial177 2026-02-20T03:14:04.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:04.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: osd.10 [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] boot 2026-02-20T03:14:04.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: osdmap e73: 12 total, 11 up, 12 in 2026-02-20T03:14:04.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2026-02-20T03:14:04.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:04.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-20T03:14:04.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: osdmap e74: 12 total, 11 up, 12 in 2026-02-20T03:14:04.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:04 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:05.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:05 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:05.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:05 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:05.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:05 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:05.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:05 trial126 ceph-mon[38476]: osdmap e75: 12 total, 11 up, 12 in 2026-02-20T03:14:05.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:05 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:05.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:05 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:05.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:05 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:05.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:05 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:05.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:05 trial028 ceph-mon[38552]: osdmap e75: 12 total, 11 up, 12 in 2026-02-20T03:14:05.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:05 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:05.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:05 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:05.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:05 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:05.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:05 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:05.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:05 trial177 ceph-mon[43181]: osdmap e75: 12 total, 11 up, 12 in 2026-02-20T03:14:05.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:05 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:06.227 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.226+0000 7f51767fc640 1 -- 10.20.193.177:0/779248114 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f51880630c0 con 0x7f51640b0e50 2026-02-20T03:14:06.227 INFO:teuthology.orchestra.run.trial177.stdout:Created osd(s) 11 on host 'trial177' 2026-02-20T03:14:06.229 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51640b0e50 msgr2=0x7f51640b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:06.229 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51640b0e50 0x7f51640b3310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f518819e090 tx=0x7f517c005f50 comp rx=0 tx=0).stop 2026-02-20T03:14:06.229 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188104bc0 msgr2=0x7f518819cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:06.229 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188104bc0 0x7f518819cb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f517800c990 tx=0x7f517800ce60 comp rx=0 tx=0).stop 2026-02-20T03:14:06.229 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 shutdown_connections 2026-02-20T03:14:06.230 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51640b0e50 0x7f51640b3310 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.230 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5188106780 0x7f51881a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.230 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5188105dc0 0x7f518819d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.230 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 --2- 10.20.193.177:0/779248114 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5188104bc0 0x7f518819cb70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.230 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 >> 10.20.193.177:0/779248114 conn(0x7f5188100370 msgr2=0x7f5188109190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:06.230 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 shutdown_connections 2026-02-20T03:14:06.230 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:06.228+0000 7f518fa4c640 1 -- 10.20.193.177:0/779248114 wait complete. 2026-02-20T03:14:06.267 DEBUG:teuthology.orchestra.run.trial177:osd.11> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.11.service 2026-02-20T03:14:06.269 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-20T03:14:06.270 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T03:14:06.536 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:06.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.715+0000 7fc8e7577640 1 -- 10.20.193.28:0/2217743231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8103990 msgr2=0x7fc8e8103e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:06.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.715+0000 7fc8e7577640 1 --2- 10.20.193.28:0/2217743231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8103990 0x7fc8e8103e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009a30 tx=0x7fc8d002f220 comp rx=0 tx=0).stop 2026-02-20T03:14:06.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.715+0000 7fc8e7577640 1 -- 10.20.193.28:0/2217743231 shutdown_connections 2026-02-20T03:14:06.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.715+0000 7fc8e7577640 1 --2- 10.20.193.28:0/2217743231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc8e8104350 0x7fc8e810abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.715+0000 7fc8e7577640 1 --2- 10.20.193.28:0/2217743231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8103990 0x7fc8e8103e10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.715+0000 7fc8e7577640 1 --2- 10.20.193.28:0/2217743231 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8e8102790 0x7fc8e8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.715+0000 7fc8e7577640 1 -- 10.20.193.28:0/2217743231 >> 10.20.193.28:0/2217743231 conn(0x7fc8e80fdf40 msgr2=0x7fc8e8100360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:06.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.715+0000 7fc8e7577640 1 -- 10.20.193.28:0/2217743231 shutdown_connections 2026-02-20T03:14:06.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.715+0000 7fc8e7577640 1 -- 10.20.193.28:0/2217743231 wait complete. 2026-02-20T03:14:06.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.716+0000 7fc8e7577640 1 Processor -- start 2026-02-20T03:14:06.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.716+0000 7fc8e7577640 1 -- start start 2026-02-20T03:14:06.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.716+0000 7fc8e7577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8102790 0x7fc8e8076e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e7577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc8e8103990 0x7fc8e8075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e7577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8e8104350 0x7fc8e80759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e7577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e810e260 con 0x7fc8e8102790 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e7577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e810e0e0 con 0x7fc8e8104350 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e7577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e810e3e0 con 0x7fc8e8103990 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8102790 0x7fc8e8076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8102790 0x7fc8e8076e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51306/0 (socket says 10.20.193.28:51306) 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6575640 1 -- 10.20.193.28:0/1870687038 learned_addr learned my addr 10.20.193.28:0/1870687038 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e5d74640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc8e8103990 0x7fc8e8075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6d76640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8e8104350 0x7fc8e80759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6575640 1 -- 10.20.193.28:0/1870687038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc8e8103990 msgr2=0x7fc8e8075460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:06.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6575640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc8e8103990 0x7fc8e8075460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6575640 1 -- 10.20.193.28:0/1870687038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8e8104350 msgr2=0x7fc8e80759a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6575640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8e8104350 0x7fc8e80759a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6575640 1 -- 10.20.193.28:0/1870687038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e8075ee0 con 0x7fc8e8102790 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6d76640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8e8104350 0x7fc8e80759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e6575640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8102790 0x7fc8e8076e10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00e9e0 tx=0x7fc8dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8cf7fe640 1 -- 10.20.193.28:0/1870687038 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc00cde0 con 0x7fc8e8102790 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e7577640 1 -- 10.20.193.28:0/1870687038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e80761d0 con 0x7fc8e8102790 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8cf7fe640 1 -- 10.20.193.28:0/1870687038 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc8dc004570 con 0x7fc8e8102790 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8cf7fe640 1 -- 10.20.193.28:0/1870687038 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc010690 con 0x7fc8e8102790 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.717+0000 7fc8e7577640 1 -- 10.20.193.28:0/1870687038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e81a9530 con 0x7fc8e8102790 2026-02-20T03:14:06.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.718+0000 7fc8cd7fa640 1 -- 10.20.193.28:0/1870687038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8e8063880 con 0x7fc8e8102790 2026-02-20T03:14:06.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.720+0000 7fc8cf7fe640 1 -- 10.20.193.28:0/1870687038 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fc8dc0040d0 con 0x7fc8e8102790 2026-02-20T03:14:06.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.722+0000 7fc8cf7fe640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc8c00b0e20 0x7fc8c00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:06.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.722+0000 7fc8cf7fe640 1 -- 10.20.193.28:0/1870687038 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6832+0+0 (secure 0 0 0) 0x7fc8dc0e06b0 con 0x7fc8e8102790 2026-02-20T03:14:06.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.722+0000 7fc8e5d74640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc8c00b0e20 0x7fc8c00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:06.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.722+0000 7fc8cf7fe640 1 -- 10.20.193.28:0/1870687038 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc8dc0a9470 con 0x7fc8e8102790 2026-02-20T03:14:06.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.723+0000 7fc8e5d74640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc8c00b0e20 0x7fc8c00b32e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8076b90 tx=0x7fc8d003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:06.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.813+0000 7fc8cd7fa640 1 -- 10.20.193.28:0/1870687038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc8e8063a90 con 0x7fc8e8102790 2026-02-20T03:14:06.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.813+0000 7fc8cf7fe640 1 -- 10.20.193.28:0/1870687038 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7fc8dc0ad120 con 0x7fc8e8102790 2026-02-20T03:14:06.816 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 -- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc8c00b0e20 msgr2=0x7fc8c00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc8c00b0e20 0x7fc8c00b32e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8076b90 tx=0x7fc8d003a040 comp rx=0 tx=0).stop 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 -- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8102790 msgr2=0x7fc8e8076e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8102790 0x7fc8e8076e10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00e9e0 tx=0x7fc8dc00eeb0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 -- 10.20.193.28:0/1870687038 shutdown_connections 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc8c00b0e20 0x7fc8c00b32e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc8e8104350 0x7fc8e80759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc8e8103990 0x7fc8e8075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 --2- 10.20.193.28:0/1870687038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc8e8102790 0x7fc8e8076e10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 -- 10.20.193.28:0/1870687038 >> 10.20.193.28:0/1870687038 conn(0x7fc8e80fdf40 msgr2=0x7fc8e8106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 -- 10.20.193.28:0/1870687038 shutdown_connections 2026-02-20T03:14:06.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:06.815+0000 7fc8cd7fa640 1 -- 10.20.193.28:0/1870687038 wait complete. 2026-02-20T03:14:06.915 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1771557243,"num_in_osds":12,"osd_in_since":1771557238,"num_remapped_pgs":1} 2026-02-20T03:14:07.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:07.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:07.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-20T03:14:07.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:07.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.102 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1870687038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:07.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:07.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:07.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-20T03:14:07.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:07.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:06 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1870687038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:07.220 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:14:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:14:06.773+0000 7f4cab597740 -1 Falling back to public interface 2026-02-20T03:14:07.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:07.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:07.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-20T03:14:07.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:07.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:07.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:06 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1870687038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:07.916 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T03:14:08.178 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:08.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: Detected new or changed devices on trial177 2026-02-20T03:14:08.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial177 to 21011M 2026-02-20T03:14:08.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:08.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:08.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: osdmap e76: 12 total, 11 up, 12 in 2026-02-20T03:14:08.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:07 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:08.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: Detected new or changed devices on trial177 2026-02-20T03:14:08.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial177 to 21011M 2026-02-20T03:14:08.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:08.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:08.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: osdmap e76: 12 total, 11 up, 12 in 2026-02-20T03:14:08.224 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:07 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:08.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: Detected new or changed devices on trial177 2026-02-20T03:14:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:14:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial177 to 21011M 2026-02-20T03:14:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:08.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:08.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:08.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: osdmap e76: 12 total, 11 up, 12 in 2026-02-20T03:14:08.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:07 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:08.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.362+0000 7fc234d64640 1 -- 10.20.193.28:0/658572020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2301065e0 msgr2=0x7fc23010ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:08.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.362+0000 7fc234d64640 1 --2- 10.20.193.28:0/658572020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2301065e0 0x7fc23010ce70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc22400b0a0 tx=0x7fc22402f410 comp rx=0 tx=0).stop 2026-02-20T03:14:08.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.363+0000 7fc234d64640 1 -- 10.20.193.28:0/658572020 shutdown_connections 2026-02-20T03:14:08.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.363+0000 7fc234d64640 1 --2- 10.20.193.28:0/658572020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2301065e0 0x7fc23010ce70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.363+0000 7fc234d64640 1 --2- 10.20.193.28:0/658572020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc230105c20 0x7fc2301060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.363+0000 7fc234d64640 1 --2- 10.20.193.28:0/658572020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc230104a20 0x7fc230104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.363+0000 7fc234d64640 1 -- 10.20.193.28:0/658572020 >> 10.20.193.28:0/658572020 conn(0x7fc2301001b0 msgr2=0x7fc2301025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.363+0000 7fc234d64640 1 -- 10.20.193.28:0/658572020 shutdown_connections 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.363+0000 7fc234d64640 1 -- 10.20.193.28:0/658572020 wait complete. 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.363+0000 7fc234d64640 1 Processor -- start 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.363+0000 7fc234d64640 1 -- start start 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc234d64640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc230104a20 0x7fc23019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc234d64640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc230105c20 0x7fc23019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc234d64640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2301065e0 0x7fc2301a3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc234d64640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc2301104f0 con 0x7fc230104a20 2026-02-20T03:14:08.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc234d64640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc230110370 con 0x7fc2301065e0 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc234d64640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc230110670 con 0x7fc230105c20 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc230104a20 0x7fc23019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc230104a20 0x7fc23019c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51332/0 (socket says 10.20.193.28:51332) 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22f7fe640 1 -- 10.20.193.28:0/4044687250 learned_addr learned my addr 10.20.193.28:0/4044687250 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22effd640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc230105c20 0x7fc23019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22ffff640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2301065e0 0x7fc2301a3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22f7fe640 1 -- 10.20.193.28:0/4044687250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc230105c20 msgr2=0x7fc23019cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22f7fe640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc230105c20 0x7fc23019cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22f7fe640 1 -- 10.20.193.28:0/4044687250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2301065e0 msgr2=0x7fc2301a3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22f7fe640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2301065e0 0x7fc2301a3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22f7fe640 1 -- 10.20.193.28:0/4044687250 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2301a46b0 con 0x7fc230104a20 2026-02-20T03:14:08.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22ffff640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2301065e0 0x7fc2301a3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:14:08.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.364+0000 7fc22f7fe640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc230104a20 0x7fc23019c9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0029e0 tx=0x7fc21c002eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:08.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.365+0000 7fc22cff9640 1 -- 10.20.193.28:0/4044687250 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00ed40 con 0x7fc230104a20 2026-02-20T03:14:08.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.365+0000 7fc22cff9640 1 -- 10.20.193.28:0/4044687250 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc21c004d60 con 0x7fc230104a20 2026-02-20T03:14:08.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.365+0000 7fc22cff9640 1 -- 10.20.193.28:0/4044687250 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c005790 con 0x7fc230104a20 2026-02-20T03:14:08.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.365+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2301a49a0 con 0x7fc230104a20 2026-02-20T03:14:08.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.365+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2301a4e90 con 0x7fc230104a20 2026-02-20T03:14:08.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.365+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23010b7c0 con 0x7fc230104a20 2026-02-20T03:14:08.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.367+0000 7fc22cff9640 1 -- 10.20.193.28:0/4044687250 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fc21c020030 con 0x7fc230104a20 2026-02-20T03:14:08.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.369+0000 7fc22cff9640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2040b0e50 0x7fc2040b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:08.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.369+0000 7fc22cff9640 1 -- 10.20.193.28:0/4044687250 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6803+0+0 (secure 0 0 0) 0x7fc21c0e0830 con 0x7fc230104a20 2026-02-20T03:14:08.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.369+0000 7fc22effd640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2040b0e50 0x7fc2040b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:08.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.369+0000 7fc22cff9640 1 -- 10.20.193.28:0/4044687250 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc21c014070 con 0x7fc230104a20 2026-02-20T03:14:08.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.370+0000 7fc22effd640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2040b0e50 0x7fc2040b3310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc23019df10 tx=0x7fc220009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:08.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.461+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc23010b9e0 con 0x7fc230104a20 2026-02-20T03:14:08.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.461+0000 7fc22cff9640 1 -- 10.20.193.28:0/4044687250 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7fc21c0a95e0 con 0x7fc230104a20 2026-02-20T03:14:08.465 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:08.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2040b0e50 msgr2=0x7fc2040b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2040b0e50 0x7fc2040b3310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc23019df10 tx=0x7fc220009290 comp rx=0 tx=0).stop 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc230104a20 msgr2=0x7fc23019c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc230104a20 0x7fc23019c9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0029e0 tx=0x7fc21c002eb0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 shutdown_connections 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2040b0e50 0x7fc2040b3310 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2301065e0 0x7fc2301a3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc230105c20 0x7fc23019cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 --2- 10.20.193.28:0/4044687250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc230104a20 0x7fc23019c9f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 >> 10.20.193.28:0/4044687250 conn(0x7fc2301001b0 msgr2=0x7fc230108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 shutdown_connections 2026-02-20T03:14:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:08.462+0000 7fc234d64640 1 -- 10.20.193.28:0/4044687250 wait complete. 2026-02-20T03:14:08.562 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1771557243,"num_in_osds":12,"osd_in_since":1771557238,"num_remapped_pgs":0} 2026-02-20T03:14:09.564 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T03:14:09.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:09 trial126 ceph-mon[38476]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 316 MiB used, 7.5 TiB / 7.5 TiB avail; 130 KiB/s, 0 objects/s recovering 2026-02-20T03:14:09.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:09 trial126 ceph-mon[38476]: osdmap e77: 12 total, 11 up, 12 in 2026-02-20T03:14:09.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:09 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:09.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:09 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4044687250' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:09.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:09 trial028 ceph-mon[38552]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 316 MiB used, 7.5 TiB / 7.5 TiB avail; 130 KiB/s, 0 objects/s recovering 2026-02-20T03:14:09.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:09 trial028 ceph-mon[38552]: osdmap e77: 12 total, 11 up, 12 in 2026-02-20T03:14:09.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:09 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:09.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:09 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4044687250' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:09 trial177 ceph-mon[43181]: pgmap v147: 1 pgs: 1 peering; 577 KiB data, 316 MiB used, 7.5 TiB / 7.5 TiB avail; 130 KiB/s, 0 objects/s recovering 2026-02-20T03:14:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:09 trial177 ceph-mon[43181]: osdmap e77: 12 total, 11 up, 12 in 2026-02-20T03:14:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:09 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:09 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4044687250' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:09.828 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:09.999+0000 7f3891ee4640 1 -- 10.20.193.28:0/3200424478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c10a970 msgr2=0x7f388c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:09.999+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3200424478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c10a970 0x7f388c111480 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f388800b0a0 tx=0x7f388802f3f0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:09.999+0000 7f3891ee4640 1 -- 10.20.193.28:0/3200424478 shutdown_connections 2026-02-20T03:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:09.999+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3200424478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c10a970 0x7f388c111480 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:09.999+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3200424478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f388c109e50 0x7f388c10a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:09.999+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3200424478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f388c109480 0x7f388c109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:09.999+0000 7f3891ee4640 1 -- 10.20.193.28:0/3200424478 >> 10.20.193.28:0/3200424478 conn(0x7f388c078050 msgr2=0x7f388c07a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:09.999+0000 7f3891ee4640 1 -- 10.20.193.28:0/3200424478 shutdown_connections 2026-02-20T03:14:10.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:09.999+0000 7f3891ee4640 1 -- 10.20.193.28:0/3200424478 wait complete. 2026-02-20T03:14:10.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3891ee4640 1 Processor -- start 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3891ee4640 1 -- start start 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3891ee4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c109480 0x7f388c1a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3891ee4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f388c109e50 0x7f388c1a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3891ee4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f388c10a970 0x7f388c1a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3891ee4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f388c114a00 con 0x7f388c109480 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3891ee4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f388c114880 con 0x7f388c109e50 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3891ee4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f388c114b80 con 0x7f388c10a970 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3890ee2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c109480 0x7f388c1a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3890ee2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c109480 0x7f388c1a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51358/0 (socket says 10.20.193.28:51358) 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3890ee2640 1 -- 10.20.193.28:0/3421467726 learned_addr learned my addr 10.20.193.28:0/3421467726 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3883fff640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f388c109e50 0x7f388c1a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f38916e3640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f388c10a970 0x7f388c1a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3890ee2640 1 -- 10.20.193.28:0/3421467726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f388c10a970 msgr2=0x7f388c1a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3890ee2640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f388c10a970 0x7f388c1a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3890ee2640 1 -- 10.20.193.28:0/3421467726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f388c109e50 msgr2=0x7f388c1a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:10.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3890ee2640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f388c109e50 0x7f388c1a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.000+0000 7f3890ee2640 1 -- 10.20.193.28:0/3421467726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c1a8bc0 con 0x7f388c109480 2026-02-20T03:14:10.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.001+0000 7f3890ee2640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c109480 0x7f388c1a0f00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f387c00d980 tx=0x7f387c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:10.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.001+0000 7f3881ffb640 1 -- 10.20.193.28:0/3421467726 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c014070 con 0x7f388c109480 2026-02-20T03:14:10.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.001+0000 7f3881ffb640 1 -- 10.20.193.28:0/3421467726 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f387c0044e0 con 0x7f388c109480 2026-02-20T03:14:10.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.001+0000 7f3881ffb640 1 -- 10.20.193.28:0/3421467726 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c010460 con 0x7f388c109480 2026-02-20T03:14:10.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.001+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c1a8eb0 con 0x7f388c109480 2026-02-20T03:14:10.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.001+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c1a92b0 con 0x7f388c109480 2026-02-20T03:14:10.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.002+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388c10fdd0 con 0x7f388c109480 2026-02-20T03:14:10.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.004+0000 7f3881ffb640 1 -- 10.20.193.28:0/3421467726 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f387c009820 con 0x7f388c109480 2026-02-20T03:14:10.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.005+0000 7f3881ffb640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f38680b0e50 0x7f38680b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:10.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.005+0000 7f3881ffb640 1 -- 10.20.193.28:0/3421467726 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6803+0+0 (secure 0 0 0) 0x7f387c0e06a0 con 0x7f388c109480 2026-02-20T03:14:10.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.006+0000 7f3881ffb640 1 -- 10.20.193.28:0/3421467726 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f387c0a9450 con 0x7f388c109480 2026-02-20T03:14:10.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.006+0000 7f3883fff640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f38680b0e50 0x7f38680b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:10.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.006+0000 7f3883fff640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f38680b0e50 0x7f38680b3310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f388c1a2420 tx=0x7f3874005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:10.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.096+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f388c1102a0 con 0x7f388c109480 2026-02-20T03:14:10.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.097+0000 7f3881ffb640 1 -- 10.20.193.28:0/3421467726 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7f387c0ad100 con 0x7f388c109480 2026-02-20T03:14:10.100 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f38680b0e50 msgr2=0x7f38680b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f38680b0e50 0x7f38680b3310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f388c1a2420 tx=0x7f3874005f50 comp rx=0 tx=0).stop 2026-02-20T03:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c109480 msgr2=0x7f388c1a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c109480 0x7f388c1a0f00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f387c00d980 tx=0x7f387c00de50 comp rx=0 tx=0).stop 2026-02-20T03:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 shutdown_connections 2026-02-20T03:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f38680b0e50 0x7f38680b3310 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f388c10a970 0x7f388c1a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f388c109e50 0x7f388c1a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 --2- 10.20.193.28:0/3421467726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f388c109480 0x7f388c1a0f00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 >> 10.20.193.28:0/3421467726 conn(0x7f388c078050 msgr2=0x7f388c10d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 shutdown_connections 2026-02-20T03:14:10.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:10.098+0000 7f3891ee4640 1 -- 10.20.193.28:0/3421467726 wait complete. 2026-02-20T03:14:10.237 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1771557243,"num_in_osds":12,"osd_in_since":1771557238,"num_remapped_pgs":0} 2026-02-20T03:14:10.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:10 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3421467726' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:10.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:10 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3421467726' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:10.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:10 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3421467726' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:11.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:14:10 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:14:10.802+0000 7f4cab597740 -1 osd.11 0 log_to_monitors true 2026-02-20T03:14:11.238 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T03:14:11.499 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:11.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:11 trial028 ceph-mon[38552]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 7.5 TiB / 7.5 TiB avail; 103 KiB/s, 0 objects/s recovering 2026-02-20T03:14:11.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:11 trial028 ceph-mon[38552]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2026-02-20T03:14:11.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:11 trial028 ceph-mon[38552]: from='osd.11 [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2026-02-20T03:14:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:11 trial126 ceph-mon[38476]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 7.5 TiB / 7.5 TiB avail; 103 KiB/s, 0 objects/s recovering 2026-02-20T03:14:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:11 trial126 ceph-mon[38476]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2026-02-20T03:14:11.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:11 trial126 ceph-mon[38476]: from='osd.11 [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.680+0000 7f7f92603640 1 -- 10.20.193.28:0/3427618988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109e50 msgr2=0x7f7f8c10a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.680+0000 7f7f92603640 1 --2- 10.20.193.28:0/3427618988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109e50 0x7f7f8c10a2d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009a30 tx=0x7f7f8002f1c0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.681+0000 7f7f92603640 1 -- 10.20.193.28:0/3427618988 shutdown_connections 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.681+0000 7f7f92603640 1 --2- 10.20.193.28:0/3427618988 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f8c10a970 0x7f7f8c111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.681+0000 7f7f92603640 1 --2- 10.20.193.28:0/3427618988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109e50 0x7f7f8c10a2d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.681+0000 7f7f92603640 1 --2- 10.20.193.28:0/3427618988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f8c109480 0x7f7f8c109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.681+0000 7f7f92603640 1 -- 10.20.193.28:0/3427618988 >> 10.20.193.28:0/3427618988 conn(0x7f7f8c078050 msgr2=0x7f7f8c07a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.681+0000 7f7f92603640 1 -- 10.20.193.28:0/3427618988 shutdown_connections 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.681+0000 7f7f92603640 1 -- 10.20.193.28:0/3427618988 wait complete. 2026-02-20T03:14:11.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.681+0000 7f7f92603640 1 Processor -- start 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f92603640 1 -- start start 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f92603640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109480 0x7f7f8c1a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f92603640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f8c109e50 0x7f7f8c1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f92603640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f8c10a970 0x7f7f8c1a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f92603640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c114a00 con 0x7f7f8c109480 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f92603640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c114880 con 0x7f7f8c10a970 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f92603640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8c114b80 con 0x7f7f8c109e50 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f91601640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109480 0x7f7f8c1a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f91601640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109480 0x7f7f8c1a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51374/0 (socket says 10.20.193.28:51374) 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f91601640 1 -- 10.20.193.28:0/3650439979 learned_addr learned my addr 10.20.193.28:0/3650439979 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f90e00640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f8c109e50 0x7f7f8c1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:11.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f91e02640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f8c10a970 0x7f7f8c1a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:11.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f91601640 1 -- 10.20.193.28:0/3650439979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f8c109e50 msgr2=0x7f7f8c1a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:11.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f91601640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f8c109e50 0x7f7f8c1a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f91601640 1 -- 10.20.193.28:0/3650439979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f8c10a970 msgr2=0x7f7f8c1a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:11.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f91601640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f8c10a970 0x7f7f8c1a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.682+0000 7f7f91601640 1 -- 10.20.193.28:0/3650439979 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8c1a8ca0 con 0x7f7f8c109480 2026-02-20T03:14:11.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.683+0000 7f7f91601640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109480 0x7f7f8c1a0fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00e9c0 tx=0x7f7f7c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:11.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.683+0000 7f7f7a7fc640 1 -- 10.20.193.28:0/3650439979 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00cdb0 con 0x7f7f8c109480 2026-02-20T03:14:11.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.683+0000 7f7f7a7fc640 1 -- 10.20.193.28:0/3650439979 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7f7c0044c0 con 0x7f7f8c109480 2026-02-20T03:14:11.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.683+0000 7f7f7a7fc640 1 -- 10.20.193.28:0/3650439979 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c010690 con 0x7f7f8c109480 2026-02-20T03:14:11.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.683+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8c1a8f90 con 0x7f7f8c109480 2026-02-20T03:14:11.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.683+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8c1a9390 con 0x7f7f8c109480 2026-02-20T03:14:11.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.683+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8c10fef0 con 0x7f7f8c109480 2026-02-20T03:14:11.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.685+0000 7f7f7a7fc640 1 -- 10.20.193.28:0/3650439979 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f7f7c003f00 con 0x7f7f8c109480 2026-02-20T03:14:11.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.687+0000 7f7f7a7fc640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f680b0e50 0x7f7f680b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:11.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.687+0000 7f7f7a7fc640 1 -- 10.20.193.28:0/3650439979 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6825+0+0 (secure 0 0 0) 0x7f7f7c0e06b0 con 0x7f7f8c109480 2026-02-20T03:14:11.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.687+0000 7f7f90e00640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f680b0e50 0x7f7f680b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:11.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.687+0000 7f7f7a7fc640 1 -- 10.20.193.28:0/3650439979 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f7f7c0a9450 con 0x7f7f8c109480 2026-02-20T03:14:11.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.687+0000 7f7f90e00640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f680b0e50 0x7f7f680b3310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7f80002bd0 tx=0x7f7f800057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:11 trial177 ceph-mon[43181]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 7.5 TiB / 7.5 TiB avail; 103 KiB/s, 0 objects/s recovering 2026-02-20T03:14:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:11 trial177 ceph-mon[43181]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2026-02-20T03:14:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:11 trial177 ceph-mon[43181]: from='osd.11 [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2026-02-20T03:14:11.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.780+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7f8c110110 con 0x7f7f8c109480 2026-02-20T03:14:11.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f7a7fc640 1 -- 10.20.193.28:0/3650439979 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) ==== 74+0+133 (secure 0 0 0) 0x7f7f7c0ad100 con 0x7f7f8c109480 2026-02-20T03:14:11.784 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:11.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f680b0e50 msgr2=0x7f7f680b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:11.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f680b0e50 0x7f7f680b3310 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7f80002bd0 tx=0x7f7f800057d0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109480 msgr2=0x7f7f8c1a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:11.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109480 0x7f7f8c1a0fe0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c00e9c0 tx=0x7f7f7c00ee90 comp rx=0 tx=0).stop 2026-02-20T03:14:11.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 shutdown_connections 2026-02-20T03:14:11.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f680b0e50 0x7f7f680b3310 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f8c10a970 0x7f7f8c1a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f8c109e50 0x7f7f8c1a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 --2- 10.20.193.28:0/3650439979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f8c109480 0x7f7f8c1a0fe0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:11.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.781+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 >> 10.20.193.28:0/3650439979 conn(0x7f7f8c078050 msgr2=0x7f7f8c10d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:11.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.782+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 shutdown_connections 2026-02-20T03:14:11.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:11.782+0000 7f7f92603640 1 -- 10.20.193.28:0/3650439979 wait complete. 2026-02-20T03:14:11.881 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":78,"num_osds":12,"num_up_osds":11,"osd_up_since":1771557243,"num_in_osds":12,"osd_in_since":1771557238,"num_remapped_pgs":0} 2026-02-20T03:14:12.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:12 trial126 ceph-mon[38476]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-20T03:14:12.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:12 trial126 ceph-mon[38476]: osdmap e78: 12 total, 11 up, 12 in 2026-02-20T03:14:12.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:12 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:12.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:12 trial126 ceph-mon[38476]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:14:12.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:12 trial126 ceph-mon[38476]: from='osd.11 [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:14:12.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:12 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3650439979' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:12.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:12 trial126 ceph-mon[38476]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:14:12.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:12 trial126 ceph-mon[38476]: osdmap e79: 12 total, 11 up, 12 in 2026-02-20T03:14:12.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:12 trial028 ceph-mon[38552]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-20T03:14:12.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:12 trial028 ceph-mon[38552]: osdmap e78: 12 total, 11 up, 12 in 2026-02-20T03:14:12.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:12 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:12.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:12 trial028 ceph-mon[38552]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:14:12.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:12 trial028 ceph-mon[38552]: from='osd.11 [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:14:12.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:12 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3650439979' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:12.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:12 trial028 ceph-mon[38552]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:14:12.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:12 trial028 ceph-mon[38552]: osdmap e79: 12 total, 11 up, 12 in 2026-02-20T03:14:12.717 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:14:12 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:14:12.483+0000 7f4ca7518640 -1 osd.11 0 waiting for initial osdmap 2026-02-20T03:14:12.718 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:14:12 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:14:12.490+0000 7f4c9f33a640 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-20T03:14:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:12 trial177 ceph-mon[43181]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-20T03:14:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:12 trial177 ceph-mon[43181]: osdmap e78: 12 total, 11 up, 12 in 2026-02-20T03:14:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:12 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:12 trial177 ceph-mon[43181]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:14:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:12 trial177 ceph-mon[43181]: from='osd.11 [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]: dispatch 2026-02-20T03:14:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:12 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3650439979' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:12 trial177 ceph-mon[43181]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial177", "root=default"]}]': finished 2026-02-20T03:14:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:12 trial177 ceph-mon[43181]: osdmap e79: 12 total, 11 up, 12 in 2026-02-20T03:14:12.882 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T03:14:13.142 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.330+0000 7f9c92d54640 1 -- 10.20.193.28:0/1575663597 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c10a970 msgr2=0x7f9c8c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.330+0000 7f9c92d54640 1 --2- 10.20.193.28:0/1575663597 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c10a970 0x7f9c8c111480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800b0a0 tx=0x7f9c8802f3b0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.330+0000 7f9c92d54640 1 -- 10.20.193.28:0/1575663597 shutdown_connections 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.330+0000 7f9c92d54640 1 --2- 10.20.193.28:0/1575663597 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c10a970 0x7f9c8c111480 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.330+0000 7f9c92d54640 1 --2- 10.20.193.28:0/1575663597 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9c8c109e50 0x7f9c8c10a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.330+0000 7f9c92d54640 1 --2- 10.20.193.28:0/1575663597 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9c8c109480 0x7f9c8c109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.330+0000 7f9c92d54640 1 -- 10.20.193.28:0/1575663597 >> 10.20.193.28:0/1575663597 conn(0x7f9c8c078050 msgr2=0x7f9c8c07a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.330+0000 7f9c92d54640 1 -- 10.20.193.28:0/1575663597 shutdown_connections 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.330+0000 7f9c92d54640 1 -- 10.20.193.28:0/1575663597 wait complete. 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.331+0000 7f9c92d54640 1 Processor -- start 2026-02-20T03:14:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.331+0000 7f9c92d54640 1 -- start start 2026-02-20T03:14:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c92d54640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c109480 0x7f9c8c1a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c92d54640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9c8c109e50 0x7f9c8c1a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c92d54640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9c8c10a970 0x7f9c8c1a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c92d54640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8c1149e0 con 0x7f9c8c109480 2026-02-20T03:14:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c92d54640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8c114860 con 0x7f9c8c10a970 2026-02-20T03:14:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c92d54640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8c114b60 con 0x7f9c8c109e50 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c109480 0x7f9c8c1a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c109480 0x7f9c8c1a0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51382/0 (socket says 10.20.193.28:51382) 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91d52640 1 -- 10.20.193.28:0/700330433 learned_addr learned my addr 10.20.193.28:0/700330433 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91551640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9c8c109e50 0x7f9c8c1a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c92553640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9c8c10a970 0x7f9c8c1a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91d52640 1 -- 10.20.193.28:0/700330433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9c8c109e50 msgr2=0x7f9c8c1a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91d52640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9c8c109e50 0x7f9c8c1a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91d52640 1 -- 10.20.193.28:0/700330433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9c8c10a970 msgr2=0x7f9c8c1a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91d52640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9c8c10a970 0x7f9c8c1a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91d52640 1 -- 10.20.193.28:0/700330433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8c1a8ba0 con 0x7f9c8c109480 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c91d52640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c109480 0x7f9c8c1a0ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00d950 tx=0x7f9c7c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:13.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c7affd640 1 -- 10.20.193.28:0/700330433 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0044e0 con 0x7f9c8c109480 2026-02-20T03:14:13.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c7affd640 1 -- 10.20.193.28:0/700330433 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9c7c004d40 con 0x7f9c8c109480 2026-02-20T03:14:13.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.332+0000 7f9c7affd640 1 -- 10.20.193.28:0/700330433 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c005320 con 0x7f9c8c109480 2026-02-20T03:14:13.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.333+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8c1a8e90 con 0x7f9c8c109480 2026-02-20T03:14:13.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.333+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8c1a9290 con 0x7f9c8c109480 2026-02-20T03:14:13.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.333+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c54005390 con 0x7f9c8c109480 2026-02-20T03:14:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.335+0000 7f9c7affd640 1 -- 10.20.193.28:0/700330433 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f9c7c00b9f0 con 0x7f9c8c109480 2026-02-20T03:14:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.337+0000 7f9c7affd640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9c680b0e50 0x7f9c680b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.337+0000 7f9c7affd640 1 -- 10.20.193.28:0/700330433 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6841+0+0 (secure 0 0 0) 0x7f9c7c0e0470 con 0x7f9c8c109480 2026-02-20T03:14:13.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.337+0000 7f9c7affd640 1 -- 10.20.193.28:0/700330433 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9c7c014020 con 0x7f9c8c109480 2026-02-20T03:14:13.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.337+0000 7f9c91551640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9c680b0e50 0x7f9c680b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:13.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.338+0000 7f9c91551640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9c680b0e50 0x7f9c680b3310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c1a2400 tx=0x7f9c800073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.428+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9c54005950 con 0x7f9c8c109480 2026-02-20T03:14:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.428+0000 7f9c7affd640 1 -- 10.20.193.28:0/700330433 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f9c7c0aceb0 con 0x7f9c8c109480 2026-02-20T03:14:13.431 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:13.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9c680b0e50 msgr2=0x7f9c680b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:13.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9c680b0e50 0x7f9c680b3310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c1a2400 tx=0x7f9c800073d0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c109480 msgr2=0x7f9c8c1a0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c109480 0x7f9c8c1a0ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00d950 tx=0x7f9c7c00de20 comp rx=0 tx=0).stop 2026-02-20T03:14:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 shutdown_connections 2026-02-20T03:14:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9c680b0e50 0x7f9c680b3310 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9c8c10a970 0x7f9c8c1a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9c8c109e50 0x7f9c8c1a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 --2- 10.20.193.28:0/700330433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9c8c109480 0x7f9c8c1a0ee0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 >> 10.20.193.28:0/700330433 conn(0x7f9c8c078050 msgr2=0x7f9c8c10d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.429+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 shutdown_connections 2026-02-20T03:14:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:13.430+0000 7f9c92d54640 1 -- 10.20.193.28:0/700330433 wait complete. 2026-02-20T03:14:13.444 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:13 trial028 ceph-mon[38552]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 7.5 TiB / 7.5 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T03:14:13.444 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:13 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:13.444 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:13 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:13.444 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:13 trial028 ceph-mon[38552]: from='osd.11 ' entity='osd.11' 2026-02-20T03:14:13.534 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1771557243,"num_in_osds":12,"osd_in_since":1771557238,"num_remapped_pgs":0} 2026-02-20T03:14:13.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:13 trial126 ceph-mon[38476]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 7.5 TiB / 7.5 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T03:14:13.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:13 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:13.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:13 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:13.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:13 trial126 ceph-mon[38476]: from='osd.11 ' entity='osd.11' 2026-02-20T03:14:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:13 trial177 ceph-mon[43181]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 317 MiB used, 7.5 TiB / 7.5 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-20T03:14:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:13 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:13 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:13 trial177 ceph-mon[43181]: from='osd.11 ' entity='osd.11' 2026-02-20T03:14:14.536 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd stat -f json 2026-02-20T03:14:14.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:14 trial028 ceph-mon[38552]: purged_snaps scrub starts 2026-02-20T03:14:14.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:14 trial028 ceph-mon[38552]: purged_snaps scrub ok 2026-02-20T03:14:14.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:14 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:14.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:14 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/700330433' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:14.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:14 trial028 ceph-mon[38552]: osd.11 [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] boot 2026-02-20T03:14:14.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:14 trial028 ceph-mon[38552]: osdmap e80: 12 total, 12 up, 12 in 2026-02-20T03:14:14.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:14 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:14.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:14 trial126 ceph-mon[38476]: purged_snaps scrub starts 2026-02-20T03:14:14.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:14 trial126 ceph-mon[38476]: purged_snaps scrub ok 2026-02-20T03:14:14.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:14 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:14.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:14 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/700330433' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:14.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:14 trial126 ceph-mon[38476]: osd.11 [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] boot 2026-02-20T03:14:14.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:14 trial126 ceph-mon[38476]: osdmap e80: 12 total, 12 up, 12 in 2026-02-20T03:14:14.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:14 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:14.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:14 trial177 ceph-mon[43181]: purged_snaps scrub starts 2026-02-20T03:14:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:14 trial177 ceph-mon[43181]: purged_snaps scrub ok 2026-02-20T03:14:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:14 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:14 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/700330433' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:14 trial177 ceph-mon[43181]: osd.11 [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] boot 2026-02-20T03:14:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:14 trial177 ceph-mon[43181]: osdmap e80: 12 total, 12 up, 12 in 2026-02-20T03:14:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:14 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2026-02-20T03:14:14.794 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:14.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.969+0000 7f499f135640 1 -- 10.20.193.28:0/680887780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109e50 msgr2=0x7f499810a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:14.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.969+0000 7f499f135640 1 --2- 10.20.193.28:0/680887780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109e50 0x7f499810a2d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f498c009a30 tx=0x7f498c02f1c0 comp rx=0 tx=0).stop 2026-02-20T03:14:14.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.969+0000 7f499f135640 1 -- 10.20.193.28:0/680887780 shutdown_connections 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.969+0000 7f499f135640 1 --2- 10.20.193.28:0/680887780 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f499810a970 0x7f4998111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.969+0000 7f499f135640 1 --2- 10.20.193.28:0/680887780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109e50 0x7f499810a2d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.969+0000 7f499f135640 1 --2- 10.20.193.28:0/680887780 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4998109480 0x7f4998109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.969+0000 7f499f135640 1 -- 10.20.193.28:0/680887780 >> 10.20.193.28:0/680887780 conn(0x7f4998078050 msgr2=0x7f499807a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.969+0000 7f499f135640 1 -- 10.20.193.28:0/680887780 shutdown_connections 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.969+0000 7f499f135640 1 -- 10.20.193.28:0/680887780 wait complete. 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499f135640 1 Processor -- start 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499f135640 1 -- start start 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499f135640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109480 0x7f49981a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499f135640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4998109e50 0x7f49981a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499f135640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f499810a970 0x7f49981a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:14.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499f135640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4998114a00 con 0x7f4998109480 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499f135640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4998114880 con 0x7f4998109e50 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499f135640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4998114b80 con 0x7f499810a970 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499e133640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109480 0x7f49981a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499e133640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109480 0x7f49981a0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51410/0 (socket says 10.20.193.28:51410) 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499e133640 1 -- 10.20.193.28:0/1304669964 learned_addr learned my addr 10.20.193.28:0/1304669964 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499d932640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4998109e50 0x7f49981a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.970+0000 7f499e934640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f499810a970 0x7f49981a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f499e133640 1 -- 10.20.193.28:0/1304669964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f499810a970 msgr2=0x7f49981a8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f499e133640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f499810a970 0x7f49981a8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f499e133640 1 -- 10.20.193.28:0/1304669964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4998109e50 msgr2=0x7f49981a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f499e133640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4998109e50 0x7f49981a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:14.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f499e133640 1 -- 10.20.193.28:0/1304669964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49981a8c60 con 0x7f4998109480 2026-02-20T03:14:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f499e133640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109480 0x7f49981a0fa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f498800d980 tx=0x7f498800de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f497f7fe640 1 -- 10.20.193.28:0/1304669964 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988014070 con 0x7f4998109480 2026-02-20T03:14:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f497f7fe640 1 -- 10.20.193.28:0/1304669964 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f49880044e0 con 0x7f4998109480 2026-02-20T03:14:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f497f7fe640 1 -- 10.20.193.28:0/1304669964 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988002e50 con 0x7f4998109480 2026-02-20T03:14:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49981a8f50 con 0x7f4998109480 2026-02-20T03:14:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.971+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49981a9350 con 0x7f4998109480 2026-02-20T03:14:14.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.972+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499810fe40 con 0x7f4998109480 2026-02-20T03:14:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.974+0000 7f497f7fe640 1 -- 10.20.193.28:0/1304669964 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f4988021060 con 0x7f4998109480 2026-02-20T03:14:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.975+0000 7f497f7fe640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49740b0ff0 0x7f49740b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.975+0000 7f497f7fe640 1 -- 10.20.193.28:0/1304669964 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7f49880e04a0 con 0x7f4998109480 2026-02-20T03:14:14.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.976+0000 7f499d932640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49740b0ff0 0x7f49740b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:14.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.976+0000 7f497f7fe640 1 -- 10.20.193.28:0/1304669964 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f49880a9110 con 0x7f4998109480 2026-02-20T03:14:14.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:14.976+0000 7f499d932640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49740b0ff0 0x7f49740b34b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49981a24c0 tx=0x7f498c03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:15.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.066+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4998110030 con 0x7f4998109480 2026-02-20T03:14:15.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.067+0000 7f497f7fe640 1 -- 10.20.193.28:0/1304669964 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f49880acdc0 con 0x7f4998109480 2026-02-20T03:14:15.069 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.067+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49740b0ff0 msgr2=0x7f49740b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.067+0000 7f499f135640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49740b0ff0 0x7f49740b34b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f49981a24c0 tx=0x7f498c03a040 comp rx=0 tx=0).stop 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.067+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109480 msgr2=0x7f49981a0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.067+0000 7f499f135640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109480 0x7f49981a0fa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f498800d980 tx=0x7f498800de50 comp rx=0 tx=0).stop 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.068+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 shutdown_connections 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.068+0000 7f499f135640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49740b0ff0 0x7f49740b34b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.068+0000 7f499f135640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f499810a970 0x7f49981a8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.068+0000 7f499f135640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4998109e50 0x7f49981a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.068+0000 7f499f135640 1 --2- 10.20.193.28:0/1304669964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4998109480 0x7f49981a0fa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.068+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 >> 10.20.193.28:0/1304669964 conn(0x7f4998078050 msgr2=0x7f499810d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.068+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 shutdown_connections 2026-02-20T03:14:15.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.068+0000 7f499f135640 1 -- 10.20.193.28:0/1304669964 wait complete. 2026-02-20T03:14:15.169 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1771557253,"num_in_osds":12,"osd_in_since":1771557238,"num_remapped_pgs":0} 2026-02-20T03:14:15.169 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:14:15.427 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:15.472 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:15 trial028 ceph-mon[38552]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-20T03:14:15.472 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:15 trial028 ceph-mon[38552]: osdmap e81: 12 total, 12 up, 12 in 2026-02-20T03:14:15.472 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:15 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1304669964' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:15.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:15 trial126 ceph-mon[38476]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-20T03:14:15.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:15 trial126 ceph-mon[38476]: osdmap e81: 12 total, 12 up, 12 in 2026-02-20T03:14:15.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:15 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1304669964' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.606+0000 7f2044ff5640 1 -- 10.20.193.28:0/2821156326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2040109220 msgr2=0x7f2040109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.606+0000 7f2044ff5640 1 --2- 10.20.193.28:0/2821156326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2040109220 0x7f2040109660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2030009a30 tx=0x7f203002f220 comp rx=0 tx=0).stop 2026-02-20T03:14:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.606+0000 7f2044ff5640 1 -- 10.20.193.28:0/2821156326 shutdown_connections 2026-02-20T03:14:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.606+0000 7f2044ff5640 1 --2- 10.20.193.28:0/2821156326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2040109ba0 0x7f2040115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.606+0000 7f2044ff5640 1 --2- 10.20.193.28:0/2821156326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2040109220 0x7f2040109660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.606+0000 7f2044ff5640 1 --2- 10.20.193.28:0/2821156326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f204010eef0 0x7f204010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.606+0000 7f2044ff5640 1 -- 10.20.193.28:0/2821156326 >> 10.20.193.28:0/2821156326 conn(0x7f2040078600 msgr2=0x7f204007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.606+0000 7f2044ff5640 1 -- 10.20.193.28:0/2821156326 shutdown_connections 2026-02-20T03:14:15.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.606+0000 7f2044ff5640 1 -- 10.20.193.28:0/2821156326 wait complete. 2026-02-20T03:14:15.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.607+0000 7f2044ff5640 1 Processor -- start 2026-02-20T03:14:15.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.607+0000 7f2044ff5640 1 -- start start 2026-02-20T03:14:15.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.607+0000 7f2044ff5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2040109220 0x7f20401a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.607+0000 7f2044ff5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2040109ba0 0x7f20401a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.607+0000 7f2044ff5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f204010eef0 0x7f20401a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.607+0000 7f2044ff5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2040119070 con 0x7f2040109220 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.607+0000 7f2044ff5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2040118ef0 con 0x7f2040109ba0 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.607+0000 7f2044ff5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f20401191f0 con 0x7f204010eef0 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.607+0000 7f203ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f204010eef0 0x7f20401a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2040109220 0x7f20401a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203effd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2040109ba0 0x7f20401a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f204010eef0 0x7f20401a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33826/0 (socket says 10.20.193.28:33826) 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203ffff640 1 -- 10.20.193.28:0/256359101 learned_addr learned my addr 10.20.193.28:0/256359101 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:15.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203f7fe640 1 -- 10.20.193.28:0/256359101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f204010eef0 msgr2=0x7f20401a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203f7fe640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f204010eef0 0x7f20401a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203f7fe640 1 -- 10.20.193.28:0/256359101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2040109ba0 msgr2=0x7f20401a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203f7fe640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2040109ba0 0x7f20401a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203f7fe640 1 -- 10.20.193.28:0/256359101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20401a6580 con 0x7f2040109220 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203f7fe640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2040109220 0x7f20401a1530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f202c00d730 tx=0x7f202c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203cff9640 1 -- 10.20.193.28:0/256359101 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c014070 con 0x7f2040109220 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f2044ff5640 1 -- 10.20.193.28:0/256359101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20401a6870 con 0x7f2040109220 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203cff9640 1 -- 10.20.193.28:0/256359101 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f202c0044e0 con 0x7f2040109220 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f2044ff5640 1 -- 10.20.193.28:0/256359101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20401ae0b0 con 0x7f2040109220 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.608+0000 7f203cff9640 1 -- 10.20.193.28:0/256359101 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c014070 con 0x7f2040109220 2026-02-20T03:14:15.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.609+0000 7f201a7fc640 1 -- 10.20.193.28:0/256359101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2040109660 con 0x7f2040109220 2026-02-20T03:14:15.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.611+0000 7f203cff9640 1 -- 10.20.193.28:0/256359101 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f202c0047c0 con 0x7f2040109220 2026-02-20T03:14:15.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.612+0000 7f203cff9640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f20140b0fa0 0x7f20140b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:15.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.613+0000 7f203cff9640 1 -- 10.20.193.28:0/256359101 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7f202c0a47c0 con 0x7f2040109220 2026-02-20T03:14:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.613+0000 7f203effd640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f20140b0fa0 0x7f20140b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.613+0000 7f203cff9640 1 -- 10.20.193.28:0/256359101 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f202c0ac720 con 0x7f2040109220 2026-02-20T03:14:15.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.613+0000 7f203effd640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f20140b0fa0 0x7f20140b3460 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2040108d60 tx=0x7f2030005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:15.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.703+0000 7f201a7fc640 1 -- 10.20.193.28:0/256359101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20401a2890 con 0x7f2040109220 2026-02-20T03:14:15.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.704+0000 7f203cff9640 1 -- 10.20.193.28:0/256359101 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18467 (secure 0 0 0) 0x7f202c0b15d0 con 0x7f2040109220 2026-02-20T03:14:15.706 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:15.707 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":81,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:14.485959+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:14:15.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 -- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f20140b0fa0 msgr2=0x7f20140b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:15.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f20140b0fa0 0x7f20140b3460 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2040108d60 tx=0x7f2030005950 comp rx=0 tx=0).stop 2026-02-20T03:14:15.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 -- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2040109220 msgr2=0x7f20401a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:15.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2040109220 0x7f20401a1530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f202c00d730 tx=0x7f202c00dc00 comp rx=0 tx=0).stop 2026-02-20T03:14:15.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 -- 10.20.193.28:0/256359101 shutdown_connections 2026-02-20T03:14:15.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f20140b0fa0 0x7f20140b3460 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f204010eef0 0x7f20401a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2040109ba0 0x7f20401a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 --2- 10.20.193.28:0/256359101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2040109220 0x7f20401a1530 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:15.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 -- 10.20.193.28:0/256359101 >> 10.20.193.28:0/256359101 conn(0x7f2040078600 msgr2=0x7f2040079f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:15.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 -- 10.20.193.28:0/256359101 shutdown_connections 2026-02-20T03:14:15.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:15.705+0000 7f201a7fc640 1 -- 10.20.193.28:0/256359101 wait complete. 2026-02-20T03:14:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:15 trial177 ceph-mon[43181]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 316 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-20T03:14:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:15 trial177 ceph-mon[43181]: osdmap e81: 12 total, 12 up, 12 in 2026-02-20T03:14:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:15 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1304669964' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-20T03:14:15.842 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-20T03:12:36.019995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-20T03:14:15.842 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-20T03:14:16.099 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:16.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.279+0000 7fd5d3fff640 1 -- 10.20.193.28:0/210091179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d4109220 msgr2=0x7fd5d4109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.279+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/210091179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d4109220 0x7fd5d4109660 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009a30 tx=0x7fd5bc02f220 comp rx=0 tx=0).stop 2026-02-20T03:14:16.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.279+0000 7fd5d3fff640 1 -- 10.20.193.28:0/210091179 shutdown_connections 2026-02-20T03:14:16.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.279+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/210091179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5d4109ba0 0x7fd5d4115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.279+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/210091179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d4109220 0x7fd5d4109660 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.279+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/210091179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5d410eef0 0x7fd5d410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.279+0000 7fd5d3fff640 1 -- 10.20.193.28:0/210091179 >> 10.20.193.28:0/210091179 conn(0x7fd5d4078600 msgr2=0x7fd5d407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:16.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.279+0000 7fd5d3fff640 1 -- 10.20.193.28:0/210091179 shutdown_connections 2026-02-20T03:14:16.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.279+0000 7fd5d3fff640 1 -- 10.20.193.28:0/210091179 wait complete. 2026-02-20T03:14:16.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.280+0000 7fd5d3fff640 1 Processor -- start 2026-02-20T03:14:16.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.280+0000 7fd5d3fff640 1 -- start start 2026-02-20T03:14:16.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5d4109220 0x7fd5d41a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:16.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5d4109ba0 0x7fd5d41a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:16.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d410eef0 0x7fd5d41a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:16.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d3fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4119070 con 0x7fd5d410eef0 2026-02-20T03:14:16.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d3fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d4118ef0 con 0x7fd5d4109ba0 2026-02-20T03:14:16.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d3fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d41191f0 con 0x7fd5d4109220 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5d4109220 0x7fd5d41a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d410eef0 0x7fd5d41a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d410eef0 0x7fd5d41a5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34870/0 (socket says 10.20.193.28:34870) 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d37fe640 1 -- 10.20.193.28:0/2621224541 learned_addr learned my addr 10.20.193.28:0/2621224541 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5d4109220 0x7fd5d41a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36232/0 (socket says 10.20.193.28:36232) 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d27fc640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5d4109ba0 0x7fd5d41a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d37fe640 1 -- 10.20.193.28:0/2621224541 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5d4109220 msgr2=0x7fd5d41a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d37fe640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5d4109220 0x7fd5d41a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d37fe640 1 -- 10.20.193.28:0/2621224541 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5d4109ba0 msgr2=0x7fd5d41a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d37fe640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5d4109ba0 0x7fd5d41a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d37fe640 1 -- 10.20.193.28:0/2621224541 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d41a6550 con 0x7fd5d410eef0 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d37fe640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d410eef0 0x7fd5d41a5dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4004820 tx=0x7fd5c400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d8906640 1 -- 10.20.193.28:0/2621224541 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c40090d0 con 0x7fd5d410eef0 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d8906640 1 -- 10.20.193.28:0/2621224541 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd5c4009270 con 0x7fd5d410eef0 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d8906640 1 -- 10.20.193.28:0/2621224541 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4013810 con 0x7fd5d410eef0 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.281+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d41a67e0 con 0x7fd5d410eef0 2026-02-20T03:14:16.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.282+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d41ae080 con 0x7fd5d410eef0 2026-02-20T03:14:16.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.282+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d4109660 con 0x7fd5d410eef0 2026-02-20T03:14:16.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.284+0000 7fd5d8906640 1 -- 10.20.193.28:0/2621224541 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fd5c4012070 con 0x7fd5d410eef0 2026-02-20T03:14:16.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.286+0000 7fd5d8906640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5a80b0e20 0x7fd5a80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:16.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.286+0000 7fd5d8906640 1 -- 10.20.193.28:0/2621224541 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7fd5c40dfed0 con 0x7fd5d410eef0 2026-02-20T03:14:16.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.286+0000 7fd5d8906640 1 -- 10.20.193.28:0/2621224541 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd5c4010070 con 0x7fd5d410eef0 2026-02-20T03:14:16.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.286+0000 7fd5d2ffd640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5a80b0e20 0x7fd5a80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:16.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.287+0000 7fd5d2ffd640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5a80b0e20 0x7fd5a80b32e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8004480 tx=0x7fd5c8009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:16.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.377+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5d4110ea0 con 0x7fd5d410eef0 2026-02-20T03:14:16.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.377+0000 7fd5d8906640 1 -- 10.20.193.28:0/2621224541 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fd5c40ac7f0 con 0x7fd5d410eef0 2026-02-20T03:14:16.380 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-20T03:14:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5a80b0e20 msgr2=0x7fd5a80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5a80b0e20 0x7fd5a80b32e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8004480 tx=0x7fd5c8009290 comp rx=0 tx=0).stop 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d410eef0 msgr2=0x7fd5d41a5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d410eef0 0x7fd5d41a5dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4004820 tx=0x7fd5c400d4a0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 shutdown_connections 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5a80b0e20 0x7fd5a80b32e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5d410eef0 0x7fd5d41a5dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5d4109ba0 0x7fd5d41a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 --2- 10.20.193.28:0/2621224541 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5d4109220 0x7fd5d41a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 >> 10.20.193.28:0/2621224541 conn(0x7fd5d4078600 msgr2=0x7fd5d4079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 shutdown_connections 2026-02-20T03:14:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:16.378+0000 7fd5d3fff640 1 -- 10.20.193.28:0/2621224541 wait complete. 2026-02-20T03:14:16.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:16 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/256359101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.a on trial028 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.d on trial028 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.g on trial028 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.j on trial028 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.b on trial126 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.e on trial126 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.h on trial126 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.k on trial126 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.c on trial177 2026-02-20T03:14:16.479 INFO:tasks.cephadm:Adding mds.f on trial177 2026-02-20T03:14:16.480 INFO:tasks.cephadm:Adding mds.i on trial177 2026-02-20T03:14:16.480 INFO:tasks.cephadm:Adding mds.l on trial177 2026-02-20T03:14:16.480 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph orch apply mds all '12;trial028=a;trial028=d;trial028=g;trial028=j;trial126=b;trial126=e;trial126=h;trial126=k;trial177=c;trial177=f;trial177=i;trial177=l' 2026-02-20T03:14:16.506 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:16 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/256359101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:16.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:16 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/256359101' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:16.638 INFO:teuthology.orchestra.run.trial177.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.c/config 2026-02-20T03:14:16.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.741+0000 7fdb74cf4640 1 -- 10.20.193.177:0/3586758162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 msgr2=0x7fdb70103e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.741+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/3586758162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 0x7fdb70103e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009a30 tx=0x7fdb6002f260 comp rx=0 tx=0).stop 2026-02-20T03:14:16.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.741+0000 7fdb74cf4640 1 -- 10.20.193.177:0/3586758162 shutdown_connections 2026-02-20T03:14:16.746 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.741+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/3586758162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb70104350 0x7fdb7010abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.741+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/3586758162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 0x7fdb70103e10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.741+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/3586758162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb70102790 0x7fdb70102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.741+0000 7fdb74cf4640 1 -- 10.20.193.177:0/3586758162 >> 10.20.193.177:0/3586758162 conn(0x7fdb700fdf40 msgr2=0x7fdb70100360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.741+0000 7fdb74cf4640 1 -- 10.20.193.177:0/3586758162 shutdown_connections 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.741+0000 7fdb74cf4640 1 -- 10.20.193.177:0/3586758162 wait complete. 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 Processor -- start 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 -- start start 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb70102790 0x7fdb70076e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 0x7fdb70075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb70104350 0x7fdb700759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010e290 con 0x7fdb70104350 2026-02-20T03:14:16.747 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010e110 con 0x7fdb70102790 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7010e410 con 0x7fdb70103990 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 0x7fdb70075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 0x7fdb70075460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.177:49250/0 (socket says 10.20.193.177:49250) 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6effd640 1 -- 10.20.193.177:0/2935307818 learned_addr learned my addr 10.20.193.177:0/2935307818 (peer_addr_for_me v2:10.20.193.177:0/0) 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6f7fe640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb70102790 0x7fdb70076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6effd640 1 -- 10.20.193.177:0/2935307818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb70102790 msgr2=0x7fdb70076e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6effd640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb70102790 0x7fdb70076e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6effd640 1 -- 10.20.193.177:0/2935307818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb70104350 msgr2=0x7fdb700759a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6effd640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb70104350 0x7fdb700759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6effd640 1 -- 10.20.193.177:0/2935307818 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb70076230 con 0x7fdb70103990 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6f7fe640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb70102790 0x7fdb70076e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:14:16.748 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6effd640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 0x7fdb70075460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009b60 tx=0x7fdb6002fcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6cff9640 1 -- 10.20.193.177:0/2935307818 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60004260 con 0x7fdb70103990 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6cff9640 1 -- 10.20.193.177:0/2935307818 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdb60004400 con 0x7fdb70103990 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701a49e0 con 0x7fdb70103990 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb6cff9640 1 -- 10.20.193.177:0/2935307818 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60041880 con 0x7fdb70103990 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.742+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701a4ff0 con 0x7fdb70103990 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.743+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb70109620 con 0x7fdb70103990 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.744+0000 7fdb6cff9640 1 -- 10.20.193.177:0/2935307818 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fdb60041a20 con 0x7fdb70103990 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.744+0000 7fdb6cff9640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb440b0e20 0x7fdb440b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.745+0000 7fdb6cff9640 1 -- 10.20.193.177:0/2935307818 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7fdb60104e80 con 0x7fdb70103990 2026-02-20T03:14:16.749 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.745+0000 7fdb6f7fe640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb440b0e20 0x7fdb440b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:16.750 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.745+0000 7fdb6f7fe640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb440b0e20 0x7fdb440b32e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb701037f0 tx=0x7fdb5c005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:16.750 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.746+0000 7fdb6cff9640 1 -- 10.20.193.177:0/2935307818 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fdb600cdb80 con 0x7fdb70103990 2026-02-20T03:14:16.835 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.833+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial126=b;trial126=e;trial126=h;trial126=k;trial177=c;trial177=f;trial177=i;trial177=l", "target": ["mon-mgr", ""]}) -- 0x7fdb700631b0 con 0x7fdb440b0e20 2026-02-20T03:14:16.842 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.840+0000 7fdb6cff9640 1 -- 10.20.193.177:0/2935307818 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fdb700631b0 con 0x7fdb440b0e20 2026-02-20T03:14:16.842 INFO:teuthology.orchestra.run.trial177.stdout:Scheduled mds.all update... 2026-02-20T03:14:16.843 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb440b0e20 msgr2=0x7fdb440b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.844 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb440b0e20 0x7fdb440b32e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb701037f0 tx=0x7fdb5c005f70 comp rx=0 tx=0).stop 2026-02-20T03:14:16.844 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 msgr2=0x7fdb70075460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:16.844 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 0x7fdb70075460 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009b60 tx=0x7fdb6002fcb0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.844 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 shutdown_connections 2026-02-20T03:14:16.844 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb440b0e20 0x7fdb440b32e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.844 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb70104350 0x7fdb700759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.844 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb70103990 0x7fdb70075460 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.844 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 --2- 10.20.193.177:0/2935307818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb70102790 0x7fdb70076e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:16.845 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 >> 10.20.193.177:0/2935307818 conn(0x7fdb700fdf40 msgr2=0x7fdb70106d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:16.845 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 shutdown_connections 2026-02-20T03:14:16.845 INFO:teuthology.orchestra.run.trial177.stderr:2026-02-20T03:14:16.841+0000 7fdb74cf4640 1 -- 10.20.193.177:0/2935307818 wait complete. 2026-02-20T03:14:16.881 DEBUG:teuthology.orchestra.run.trial028:mds.a> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.a.service 2026-02-20T03:14:16.885 DEBUG:teuthology.orchestra.run.trial028:mds.d> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.d.service 2026-02-20T03:14:16.929 DEBUG:teuthology.orchestra.run.trial028:mds.g> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.g.service 2026-02-20T03:14:16.974 DEBUG:teuthology.orchestra.run.trial028:mds.j> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.j.service 2026-02-20T03:14:17.019 DEBUG:teuthology.orchestra.run.trial126:mds.b> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.b.service 2026-02-20T03:14:17.022 DEBUG:teuthology.orchestra.run.trial126:mds.e> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.e.service 2026-02-20T03:14:17.065 DEBUG:teuthology.orchestra.run.trial126:mds.h> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.h.service 2026-02-20T03:14:17.108 DEBUG:teuthology.orchestra.run.trial126:mds.k> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.k.service 2026-02-20T03:14:17.151 DEBUG:teuthology.orchestra.run.trial177:mds.c> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.c.service 2026-02-20T03:14:17.154 DEBUG:teuthology.orchestra.run.trial177:mds.f> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.f.service 2026-02-20T03:14:17.197 DEBUG:teuthology.orchestra.run.trial177:mds.i> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.i.service 2026-02-20T03:14:17.241 DEBUG:teuthology.orchestra.run.trial177:mds.l> sudo journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.l.service 2026-02-20T03:14:17.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:17.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2621224541' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T03:14:17.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:17.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:17.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:17.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:17.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:17.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:17.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:17.252 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:17 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:17.284 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-20T03:14:17.285 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2621224541' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:17.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:17 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:17.350 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:17.350 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2621224541' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T03:14:17.350 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:17.350 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:17.351 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:17.351 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:17.351 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:17.351 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:17.351 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:17.351 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:17 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:17.546 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:17.718 INFO:journalctl@ceph.mds.l.trial177.stdout:Feb 20 03:14:17 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-l[70499]: starting mds.l at 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.736+0000 7fdb90291640 1 -- 10.20.193.28:0/2377552874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88105750 msgr2=0x7fdb881097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.736+0000 7fdb90291640 1 --2- 10.20.193.28:0/2377552874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88105750 0x7fdb881097a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009a30 tx=0x7fdb7c02f220 comp rx=0 tx=0).stop 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.736+0000 7fdb90291640 1 -- 10.20.193.28:0/2377552874 shutdown_connections 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.736+0000 7fdb90291640 1 --2- 10.20.193.28:0/2377552874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb88109ed0 0x7fdb88111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.736+0000 7fdb90291640 1 --2- 10.20.193.28:0/2377552874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88105750 0x7fdb881097a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.736+0000 7fdb90291640 1 --2- 10.20.193.28:0/2377552874 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb88104da0 0x7fdb88105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.736+0000 7fdb90291640 1 -- 10.20.193.28:0/2377552874 >> 10.20.193.28:0/2377552874 conn(0x7fdb88100840 msgr2=0x7fdb88102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.736+0000 7fdb90291640 1 -- 10.20.193.28:0/2377552874 shutdown_connections 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.736+0000 7fdb90291640 1 -- 10.20.193.28:0/2377552874 wait complete. 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.737+0000 7fdb90291640 1 Processor -- start 2026-02-20T03:14:17.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.737+0000 7fdb90291640 1 -- start start 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.737+0000 7fdb90291640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb88104da0 0x7fdb8819d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb90291640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88105750 0x7fdb8819d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb90291640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb88109ed0 0x7fdb881a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb90291640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88114da0 con 0x7fdb88109ed0 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb90291640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88114c20 con 0x7fdb88104da0 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb90291640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb88114f20 con 0x7fdb88105750 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e807640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb88109ed0 0x7fdb881a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8d805640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88105750 0x7fdb8819d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e807640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb88109ed0 0x7fdb881a1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34892/0 (socket says 10.20.193.28:34892) 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e807640 1 -- 10.20.193.28:0/2421677100 learned_addr learned my addr 10.20.193.28:0/2421677100 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e006640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb88104da0 0x7fdb8819d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e807640 1 -- 10.20.193.28:0/2421677100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88105750 msgr2=0x7fdb8819d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e807640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88105750 0x7fdb8819d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e807640 1 -- 10.20.193.28:0/2421677100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb88104da0 msgr2=0x7fdb8819d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e807640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb88104da0 0x7fdb8819d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e807640 1 -- 10.20.193.28:0/2421677100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb881a22d0 con 0x7fdb88109ed0 2026-02-20T03:14:17.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb8e807640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb88109ed0 0x7fdb881a1b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400e1c0 tx=0x7fdb8400e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:17.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb6f7fe640 1 -- 10.20.193.28:0/2421677100 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84019070 con 0x7fdb88109ed0 2026-02-20T03:14:17.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb6f7fe640 1 -- 10.20.193.28:0/2421677100 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdb8400ee50 con 0x7fdb88109ed0 2026-02-20T03:14:17.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb6f7fe640 1 -- 10.20.193.28:0/2421677100 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb840149a0 con 0x7fdb88109ed0 2026-02-20T03:14:17.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb90291640 1 -- 10.20.193.28:0/2421677100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb881a25c0 con 0x7fdb88109ed0 2026-02-20T03:14:17.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.738+0000 7fdb90291640 1 -- 10.20.193.28:0/2421677100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb881a9e00 con 0x7fdb88109ed0 2026-02-20T03:14:17.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.739+0000 7fdb6d7fa640 1 -- 10.20.193.28:0/2421677100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb88106280 con 0x7fdb88109ed0 2026-02-20T03:14:17.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.742+0000 7fdb6f7fe640 1 -- 10.20.193.28:0/2421677100 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fdb84004720 con 0x7fdb88109ed0 2026-02-20T03:14:17.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.744+0000 7fdb6f7fe640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb640b0da0 0x7fdb640b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:17.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.744+0000 7fdb6f7fe640 1 -- 10.20.193.28:0/2421677100 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7fdb840e00a0 con 0x7fdb88109ed0 2026-02-20T03:14:17.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.744+0000 7fdb6f7fe640 1 -- 10.20.193.28:0/2421677100 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fdb84010040 con 0x7fdb88109ed0 2026-02-20T03:14:17.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.744+0000 7fdb8e006640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb640b0da0 0x7fdb640b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:17.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.744+0000 7fdb8e006640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb640b0da0 0x7fdb640b3260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb780046c0 tx=0x7fdb78009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:17.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.854+0000 7fdb6d7fa640 1 -- 10.20.193.28:0/2421677100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb8819e5e0 con 0x7fdb88109ed0 2026-02-20T03:14:17.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.855+0000 7fdb6f7fe640 1 -- 10.20.193.28:0/2421677100 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fdb840a8d10 con 0x7fdb88109ed0 2026-02-20T03:14:17.857 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:17.857 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":2,"btime":"2026-02-20T03:14:17:509415+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2026-02-20T03:14:17.857 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 2 2026-02-20T03:14:17.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 -- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb640b0da0 msgr2=0x7fdb640b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:17.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb640b0da0 0x7fdb640b3260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb780046c0 tx=0x7fdb78009290 comp rx=0 tx=0).stop 2026-02-20T03:14:17.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 -- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb88109ed0 msgr2=0x7fdb881a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:17.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb88109ed0 0x7fdb881a1b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400e1c0 tx=0x7fdb8400e690 comp rx=0 tx=0).stop 2026-02-20T03:14:17.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 -- 10.20.193.28:0/2421677100 shutdown_connections 2026-02-20T03:14:17.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb640b0da0 0x7fdb640b3260 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:17.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb88109ed0 0x7fdb881a1b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:17.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb88105750 0x7fdb8819d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:17.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 --2- 10.20.193.28:0/2421677100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb88104da0 0x7fdb8819d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:17.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 -- 10.20.193.28:0/2421677100 >> 10.20.193.28:0/2421677100 conn(0x7fdb88100840 msgr2=0x7fdb88101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:17.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 -- 10.20.193.28:0/2421677100 shutdown_connections 2026-02-20T03:14:17.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:17.856+0000 7fdb6d7fa640 1 -- 10.20.193.28:0/2421677100 wait complete. 2026-02-20T03:14:18.054 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:14:18 trial126 systemd[1]: Starting Ceph mds.k for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:14:18.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='client.24472 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial126=b;trial126=e;trial126=h;trial126=k;trial177=c;trial177=f;trial177=i;trial177=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:18.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: Saving service mds.all spec with placement trial028=a;trial028=d;trial028=g;trial028=j;trial126=b;trial126=e;trial126=h;trial126=k;trial177=c;trial177=f;trial177=i;trial177=l;count:12 2026-02-20T03:14:18.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: Deploying daemon mds.l on trial177 2026-02-20T03:14:18.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6832/3775040244,v1:10.20.193.177:6833/3775040244] up:boot 2026-02-20T03:14:18.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: fsmap 1 up:standby 2026-02-20T03:14:18.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2026-02-20T03:14:18.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:18.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:18.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:18.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2421677100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:18.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:18.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:18.351 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:18.352 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:14:18 trial126 podman[65199]: 2026-02-20 03:14:18.143434041 +0000 UTC m=+0.016153230 container create b0a7a0c2c751a38a1c0ee10ada7728006f6b01a2ccb4abb9effa4fed5da16b39 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-k, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T03:14:18.352 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:14:18 trial126 podman[65199]: 2026-02-20 03:14:18.172679502 +0000 UTC m=+0.045398701 container init b0a7a0c2c751a38a1c0ee10ada7728006f6b01a2ccb4abb9effa4fed5da16b39 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-k, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216) 2026-02-20T03:14:18.352 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:14:18 trial126 podman[65199]: 2026-02-20 03:14:18.174801923 +0000 UTC m=+0.047521112 container start b0a7a0c2c751a38a1c0ee10ada7728006f6b01a2ccb4abb9effa4fed5da16b39 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-k, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7) 2026-02-20T03:14:18.352 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:14:18 trial126 bash[65199]: b0a7a0c2c751a38a1c0ee10ada7728006f6b01a2ccb4abb9effa4fed5da16b39 2026-02-20T03:14:18.352 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:14:18 trial126 podman[65199]: 2026-02-20 03:14:18.136771847 +0000 UTC m=+0.009491056 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:14:18.352 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:14:18 trial126 systemd[1]: Started Ceph mds.k for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:14:18.352 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:14:18 trial126 ceph-mds[65225]: -- 10.20.193.126:0/1412447471 <== mon.2 v2:10.20.193.126:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5644f3b06b40 con 0x5644f39b1000 2026-02-20T03:14:18.352 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:14:18 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-k[65221]: starting mds.k at 2026-02-20T03:14:18.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='client.24472 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial126=b;trial126=e;trial126=h;trial126=k;trial177=c;trial177=f;trial177=i;trial177=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:18.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: Saving service mds.all spec with placement trial028=a;trial028=d;trial028=g;trial028=j;trial126=b;trial126=e;trial126=h;trial126=k;trial177=c;trial177=f;trial177=i;trial177=l;count:12 2026-02-20T03:14:18.562 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: Deploying daemon mds.l on trial177 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6832/3775040244,v1:10.20.193.177:6833/3775040244] up:boot 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: fsmap 1 up:standby 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:18.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2421677100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:18.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:18.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:18.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:18 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='client.24472 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial028=a;trial028=d;trial028=g;trial028=j;trial126=b;trial126=e;trial126=h;trial126=k;trial177=c;trial177=f;trial177=i;trial177=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: Saving service mds.all spec with placement trial028=a;trial028=d;trial028=g;trial028=j;trial126=b;trial126=e;trial126=h;trial126=k;trial177=c;trial177=f;trial177=i;trial177=l;count:12 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: Deploying daemon mds.l on trial177 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6832/3775040244,v1:10.20.193.177:6833/3775040244] up:boot 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: fsmap 1 up:standby 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2421677100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:18.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:18 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:19.253 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:14:19 trial028 systemd[1]: Starting Ceph mds.j for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:14:19.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:19 trial126 ceph-mon[38476]: Deploying daemon mds.k on trial126 2026-02-20T03:14:19.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:19 trial126 ceph-mon[38476]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:19.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:19 trial126 ceph-mon[38476]: Deploying daemon mds.j on trial028 2026-02-20T03:14:19.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:19 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.126:6832/304296049,v1:10.20.193.126:6833/304296049] up:boot 2026-02-20T03:14:19.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:19 trial126 ceph-mon[38476]: fsmap 2 up:standby 2026-02-20T03:14:19.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:19 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2026-02-20T03:14:19.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:19 trial028 ceph-mon[38552]: Deploying daemon mds.k on trial126 2026-02-20T03:14:19.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:19 trial028 ceph-mon[38552]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:19.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:19 trial028 ceph-mon[38552]: Deploying daemon mds.j on trial028 2026-02-20T03:14:19.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:19 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.126:6832/304296049,v1:10.20.193.126:6833/304296049] up:boot 2026-02-20T03:14:19.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:19 trial028 ceph-mon[38552]: fsmap 2 up:standby 2026-02-20T03:14:19.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:19 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2026-02-20T03:14:19.601 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:14:19 trial028 podman[71805]: 2026-02-20 03:14:19.356505794 +0000 UTC m=+0.028536042 container create b74fb00f503d33dec0e4222c08b494fb7e7ba16845c39e51557491827ed1d01a (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-j, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, ceph=True, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7) 2026-02-20T03:14:19.602 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:14:19 trial028 podman[71805]: 2026-02-20 03:14:19.39533731 +0000 UTC m=+0.067367568 container init b74fb00f503d33dec0e4222c08b494fb7e7ba16845c39e51557491827ed1d01a (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-j, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, ceph=True, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:14:19.602 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:14:19 trial028 podman[71805]: 2026-02-20 03:14:19.400433401 +0000 UTC m=+0.072463650 container start b74fb00f503d33dec0e4222c08b494fb7e7ba16845c39e51557491827ed1d01a (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-j, OSD_FLAVOR=default, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0) 2026-02-20T03:14:19.602 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:14:19 trial028 bash[71805]: b74fb00f503d33dec0e4222c08b494fb7e7ba16845c39e51557491827ed1d01a 2026-02-20T03:14:19.602 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:14:19 trial028 podman[71805]: 2026-02-20 03:14:19.346704247 +0000 UTC m=+0.018734505 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:14:19.602 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:14:19 trial028 systemd[1]: Started Ceph mds.j for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:14:19.602 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:14:19 trial028 ceph-mds[71823]: -- 10.20.193.28:0/2344729952 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f2ac1c6b40 con 0x55f2ac071400 2026-02-20T03:14:19.602 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:14:19 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-j[71819]: starting mds.j at 2026-02-20T03:14:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:19 trial177 ceph-mon[43181]: Deploying daemon mds.k on trial126 2026-02-20T03:14:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:19 trial177 ceph-mon[43181]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:19 trial177 ceph-mon[43181]: Deploying daemon mds.j on trial028 2026-02-20T03:14:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:19 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.126:6832/304296049,v1:10.20.193.126:6833/304296049] up:boot 2026-02-20T03:14:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:19 trial177 ceph-mon[43181]: fsmap 2 up:standby 2026-02-20T03:14:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:19 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2026-02-20T03:14:19.962 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:14:20.383 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.555+0000 7fef1b577640 1 -- 10.20.193.28:0/3145948166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c10eef0 msgr2=0x7fef1c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.555+0000 7fef1b577640 1 --2- 10.20.193.28:0/3145948166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c10eef0 0x7fef1c10f2d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fef10009a30 tx=0x7fef1002f240 comp rx=0 tx=0).stop 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.556+0000 7fef1b577640 1 -- 10.20.193.28:0/3145948166 shutdown_connections 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.556+0000 7fef1b577640 1 --2- 10.20.193.28:0/3145948166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef1c109ba0 0x7fef1c115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.556+0000 7fef1b577640 1 --2- 10.20.193.28:0/3145948166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef1c109220 0x7fef1c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.556+0000 7fef1b577640 1 --2- 10.20.193.28:0/3145948166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c10eef0 0x7fef1c10f2d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.556+0000 7fef1b577640 1 -- 10.20.193.28:0/3145948166 >> 10.20.193.28:0/3145948166 conn(0x7fef1c078600 msgr2=0x7fef1c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.557+0000 7fef1b577640 1 -- 10.20.193.28:0/3145948166 shutdown_connections 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.557+0000 7fef1b577640 1 -- 10.20.193.28:0/3145948166 wait complete. 2026-02-20T03:14:20.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.557+0000 7fef1b577640 1 Processor -- start 2026-02-20T03:14:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1b577640 1 -- start start 2026-02-20T03:14:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1b577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c109220 0x7fef1c1a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef1c109ba0 0x7fef1c1a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1b577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef1c10eef0 0x7fef1c1a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c1190a0 con 0x7fef1c109ba0 2026-02-20T03:14:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1b577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c118f20 con 0x7fef1c10eef0 2026-02-20T03:14:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1b577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef1c119220 con 0x7fef1c109220 2026-02-20T03:14:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c109220 0x7fef1c1a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:20.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef19d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef1c109ba0 0x7fef1c1a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c109220 0x7fef1c1a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36292/0 (socket says 10.20.193.28:36292) 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1a575640 1 -- 10.20.193.28:0/671062683 learned_addr learned my addr 10.20.193.28:0/671062683 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.558+0000 7fef1ad76640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef1c10eef0 0x7fef1c1a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef1a575640 1 -- 10.20.193.28:0/671062683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef1c10eef0 msgr2=0x7fef1c1a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef1a575640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef1c10eef0 0x7fef1c1a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef1a575640 1 -- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef1c109ba0 msgr2=0x7fef1c1a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef1a575640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef1c109ba0 0x7fef1c1a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef1a575640 1 -- 10.20.193.28:0/671062683 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef1c1a6590 con 0x7fef1c109220 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef19d74640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef1c109ba0 0x7fef1c1a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef1a575640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c109220 0x7fef1c1a1540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef1002f750 tx=0x7fef1002fcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef037fe640 1 -- 10.20.193.28:0/671062683 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10046070 con 0x7fef1c109220 2026-02-20T03:14:20.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef037fe640 1 -- 10.20.193.28:0/671062683 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef10038770 con 0x7fef1c109220 2026-02-20T03:14:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1c1a6820 con 0x7fef1c109220 2026-02-20T03:14:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef037fe640 1 -- 10.20.193.28:0/671062683 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef10041670 con 0x7fef1c109220 2026-02-20T03:14:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.559+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1c1ae0c0 con 0x7fef1c109220 2026-02-20T03:14:20.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.560+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef1c10a580 con 0x7fef1c109220 2026-02-20T03:14:20.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.561+0000 7fef037fe640 1 -- 10.20.193.28:0/671062683 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fef10038920 con 0x7fef1c109220 2026-02-20T03:14:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.563+0000 7fef037fe640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feef40b0e20 0x7feef40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:20.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.563+0000 7fef037fe640 1 -- 10.20.193.28:0/671062683 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7fef10104910 con 0x7fef1c109220 2026-02-20T03:14:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.563+0000 7fef19d74640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feef40b0e20 0x7feef40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:20.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.564+0000 7fef037fe640 1 -- 10.20.193.28:0/671062683 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fef10134bc0 con 0x7fef1c109220 2026-02-20T03:14:20.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.565+0000 7fef19d74640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feef40b0e20 0x7feef40b32e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef1c108df0 tx=0x7fef04009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:20.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.675+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef1c109660 con 0x7fef1c109220 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: Deploying daemon mds.d on trial028 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.28:6834/612573094,v1:10.20.193.28:6835/612573094] up:boot 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: fsmap 3 up:standby 2026-02-20T03:14:20.680 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2026-02-20T03:14:20.680 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:20.680 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":4,"btime":"2026-02-20T03:14:20:251504+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2026-02-20T03:14:20.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.676+0000 7fef037fe640 1 -- 10.20.193.28:0/671062683 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7fef1c109660 con 0x7fef1c109220 2026-02-20T03:14:20.680 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 4 2026-02-20T03:14:20.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feef40b0e20 msgr2=0x7feef40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:20.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feef40b0e20 0x7feef40b32e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef1c108df0 tx=0x7fef04009210 comp rx=0 tx=0).stop 2026-02-20T03:14:20.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c109220 msgr2=0x7fef1c1a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:20.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c109220 0x7fef1c1a1540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef1002f750 tx=0x7fef1002fcd0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 shutdown_connections 2026-02-20T03:14:20.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feef40b0e20 0x7feef40b32e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef1c10eef0 0x7fef1c1a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef1c109ba0 0x7fef1c1a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 --2- 10.20.193.28:0/671062683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef1c109220 0x7fef1c1a1540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:20.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 >> 10.20.193.28:0/671062683 conn(0x7fef1c078600 msgr2=0x7fef1c07a040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:20.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.678+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 shutdown_connections 2026-02-20T03:14:20.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:20.679+0000 7fef1b577640 1 -- 10.20.193.28:0/671062683 wait complete. 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: Deploying daemon mds.d on trial028 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.28:6834/612573094,v1:10.20.193.28:6835/612573094] up:boot 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: fsmap 3 up:standby 2026-02-20T03:14:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2026-02-20T03:14:20.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:20.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:20.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:20.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:20.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:20.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:20.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: Deploying daemon mds.d on trial028 2026-02-20T03:14:20.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:20.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.28:6834/612573094,v1:10.20.193.28:6835/612573094] up:boot 2026-02-20T03:14:20.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: fsmap 3 up:standby 2026-02-20T03:14:20.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/671062683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: Deploying daemon mds.e on trial126 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:21.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:21 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:21.826 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/671062683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:21.826 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.826 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.826 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.826 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:21.826 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:21.826 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:21.826 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: Deploying daemon mds.e on trial126 2026-02-20T03:14:21.827 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.827 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.827 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.827 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:21.827 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:21.827 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:21 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/671062683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: Deploying daemon mds.e on trial126 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:21.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:21.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:21.853 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:21 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:22.077 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:14:22 trial177 podman[70810]: 2026-02-20 03:14:22.054157747 +0000 UTC m=+0.018231583 container create 11d1d0799ecb3ec7d49f4dba34e75dd47104e94013ecb3a2962e693836bb90d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-f, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:14:22.339 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:14:22 trial177 podman[70810]: 2026-02-20 03:14:22.079401482 +0000 UTC m=+0.043475318 container init 11d1d0799ecb3ec7d49f4dba34e75dd47104e94013ecb3a2962e693836bb90d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-f, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.label-schema.license=GPLv2) 2026-02-20T03:14:22.341 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:14:22 trial177 podman[70810]: 2026-02-20 03:14:22.081433396 +0000 UTC m=+0.045507232 container start 11d1d0799ecb3ec7d49f4dba34e75dd47104e94013ecb3a2962e693836bb90d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:14:22.341 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:14:22 trial177 bash[70810]: 11d1d0799ecb3ec7d49f4dba34e75dd47104e94013ecb3a2962e693836bb90d8 2026-02-20T03:14:22.341 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:14:22 trial177 podman[70810]: 2026-02-20 03:14:22.046441385 +0000 UTC m=+0.010515221 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:14:22.341 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:14:22 trial177 systemd[1]: Started Ceph mds.f for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:14:22.341 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mds[70837]: -- 10.20.193.177:0/2646973889 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556736b6cb40 con 0x556735d92800 2026-02-20T03:14:22.341 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:14:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-f[70833]: starting mds.f at 2026-02-20T03:14:22.658 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: Deploying daemon mds.f on trial177 2026-02-20T03:14:22.658 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.28:6836/3766105703,v1:10.20.193.28:6837/3766105703] up:boot 2026-02-20T03:14:22.658 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.126:6834/2797409986,v1:10.20.193.126:6835/2797409986] up:boot 2026-02-20T03:14:22.658 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: fsmap 5 up:standby 2026-02-20T03:14:22.658 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2026-02-20T03:14:22.659 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2026-02-20T03:14:22.659 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:22.659 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:22.659 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:22.659 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:22.659 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:22.659 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:22.659 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:22.659 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-mon[43181]: Deploying daemon mds.c on trial177 2026-02-20T03:14:22.784 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:14:22.839 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: Deploying daemon mds.f on trial177 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.28:6836/3766105703,v1:10.20.193.28:6837/3766105703] up:boot 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.126:6834/2797409986,v1:10.20.193.126:6835/2797409986] up:boot 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: fsmap 5 up:standby 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:22.840 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:22.841 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:22.841 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:22.841 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:22 trial028 ceph-mon[38552]: Deploying daemon mds.c on trial177 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: Deploying daemon mds.f on trial177 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.28:6836/3766105703,v1:10.20.193.28:6837/3766105703] up:boot 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.126:6834/2797409986,v1:10.20.193.126:6835/2797409986] up:boot 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: fsmap 5 up:standby 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:22.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:22 trial126 ceph-mon[38476]: Deploying daemon mds.c on trial177 2026-02-20T03:14:22.967 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:14:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: starting mds.c at 2026-02-20T03:14:23.055 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:23.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 -- 10.20.193.28:0/2970995635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 msgr2=0x7f008010ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:23.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 --2- 10.20.193.28:0/2970995635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 0x7f008010ed50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0074009a30 tx=0x7f007402f2b0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 -- 10.20.193.28:0/2970995635 shutdown_connections 2026-02-20T03:14:23.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 --2- 10.20.193.28:0/2970995635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f008010f290 0x7f0080111680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 --2- 10.20.193.28:0/2970995635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 0x7f008010ed50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 --2- 10.20.193.28:0/2970995635 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0080075390 0x7f0080075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 -- 10.20.193.28:0/2970995635 >> 10.20.193.28:0/2970995635 conn(0x7f00800fe5d0 msgr2=0x7f00801009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:23.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 -- 10.20.193.28:0/2970995635 shutdown_connections 2026-02-20T03:14:23.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 -- 10.20.193.28:0/2970995635 wait complete. 2026-02-20T03:14:23.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.236+0000 7f00879d6640 1 Processor -- start 2026-02-20T03:14:23.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f00879d6640 1 -- start start 2026-02-20T03:14:23.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f00879d6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0080075390 0x7f008019d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:23.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f00879d6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 0x7f008019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:23.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f00879d6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f008010f290 0x7f00801a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:23.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f00879d6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0080114d30 con 0x7f0080075cb0 2026-02-20T03:14:23.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f00879d6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0080114bb0 con 0x7f0080075390 2026-02-20T03:14:23.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f00879d6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0080114eb0 con 0x7f008010f290 2026-02-20T03:14:23.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f0084f4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 0x7f008019d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:23.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f0084f4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 0x7f008019d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34954/0 (socket says 10.20.193.28:34954) 2026-02-20T03:14:23.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f0084f4a640 1 -- 10.20.193.28:0/3210254143 learned_addr learned my addr 10.20.193.28:0/3210254143 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:23.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.237+0000 7f0085f4c640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f008010f290 0x7f00801a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:23.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f008574b640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0080075390 0x7f008019d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:23.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f0084f4a640 1 -- 10.20.193.28:0/3210254143 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f008010f290 msgr2=0x7f00801a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:23.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f0084f4a640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f008010f290 0x7f00801a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f0084f4a640 1 -- 10.20.193.28:0/3210254143 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0080075390 msgr2=0x7f008019d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:23.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f0084f4a640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0080075390 0x7f008019d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f0084f4a640 1 -- 10.20.193.28:0/3210254143 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00801069a0 con 0x7f0080075cb0 2026-02-20T03:14:23.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f0084f4a640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 0x7f008019d780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f007402f7c0 tx=0x7f0074002980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:23.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f006e7fc640 1 -- 10.20.193.28:0/3210254143 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074004260 con 0x7f0080075cb0 2026-02-20T03:14:23.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f006e7fc640 1 -- 10.20.193.28:0/3210254143 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0074004400 con 0x7f0080075cb0 2026-02-20T03:14:23.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00801a2050 con 0x7f0080075cb0 2026-02-20T03:14:23.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f006e7fc640 1 -- 10.20.193.28:0/3210254143 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074041620 con 0x7f0080075cb0 2026-02-20T03:14:23.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.238+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00801a2580 con 0x7f0080075cb0 2026-02-20T03:14:23.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.239+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0080076ad0 con 0x7f0080075cb0 2026-02-20T03:14:23.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.241+0000 7f006e7fc640 1 -- 10.20.193.28:0/3210254143 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f0074041820 con 0x7f0080075cb0 2026-02-20T03:14:23.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.243+0000 7f006e7fc640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f005c0b0e20 0x7f005c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:23.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.243+0000 7f006e7fc640 1 -- 10.20.193.28:0/3210254143 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7f0074104d30 con 0x7f0080075cb0 2026-02-20T03:14:23.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.243+0000 7f008574b640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f005c0b0e20 0x7f005c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:23.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.243+0000 7f006e7fc640 1 -- 10.20.193.28:0/3210254143 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0074105290 con 0x7f0080075cb0 2026-02-20T03:14:23.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.243+0000 7f008574b640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f005c0b0e20 0x7f005c0b32e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0070005f10 tx=0x7f0070005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:23.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.351+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0080075770 con 0x7f0080075cb0 2026-02-20T03:14:23.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.351+0000 7f006e7fc640 1 -- 10.20.193.28:0/3210254143 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5566 (secure 0 0 0) 0x7f00740cda40 con 0x7f0080075cb0 2026-02-20T03:14:23.355 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:23.355 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":6,"btime":"2026-02-20T03:14:22:473696+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2026-02-20T03:14:23.356 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 6 2026-02-20T03:14:23.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.352+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f005c0b0e20 msgr2=0x7f005c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:23.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.352+0000 7f00879d6640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f005c0b0e20 0x7f005c0b32e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0070005f10 tx=0x7f0070005ea0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.352+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 msgr2=0x7f008019d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:23.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.352+0000 7f00879d6640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 0x7f008019d780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f007402f7c0 tx=0x7f0074002980 comp rx=0 tx=0).stop 2026-02-20T03:14:23.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.352+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 shutdown_connections 2026-02-20T03:14:23.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.352+0000 7f00879d6640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f005c0b0e20 0x7f005c0b32e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.352+0000 7f00879d6640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f008010f290 0x7f00801a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.352+0000 7f00879d6640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0080075cb0 0x7f008019d780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.352+0000 7f00879d6640 1 --2- 10.20.193.28:0/3210254143 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0080075390 0x7f008019d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:23.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.353+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 >> 10.20.193.28:0/3210254143 conn(0x7f00800fe5d0 msgr2=0x7f00800ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:23.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.353+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 shutdown_connections 2026-02-20T03:14:23.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:23.353+0000 7f00879d6640 1 -- 10.20.193.28:0/3210254143 wait complete. 2026-02-20T03:14:23.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6834/2041071245,v1:10.20.193.177:6835/2041071245] up:boot 2026-02-20T03:14:23.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: fsmap 6 up:standby 2026-02-20T03:14:23.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2026-02-20T03:14:23.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:23.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:23.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:23.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:23.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:23.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:23.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: Deploying daemon mds.h on trial126 2026-02-20T03:14:23.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:23 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3210254143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:23.740 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6834/2041071245,v1:10.20.193.177:6835/2041071245] up:boot 2026-02-20T03:14:23.741 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: fsmap 6 up:standby 2026-02-20T03:14:23.741 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2026-02-20T03:14:23.741 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:23.741 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:23.741 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:23.741 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:23.741 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:23.741 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:23.741 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: Deploying daemon mds.h on trial126 2026-02-20T03:14:23.742 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:23 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3210254143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6834/2041071245,v1:10.20.193.177:6835/2041071245] up:boot 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: fsmap 6 up:standby 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: Deploying daemon mds.h on trial126 2026-02-20T03:14:23.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:23 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3210254143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:24.467 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 20 03:14:24 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-i[71504]: starting mds.i at 2026-02-20T03:14:24.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6836/3933107687,v1:10.20.193.177:6837/3933107687] up:boot 2026-02-20T03:14:24.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] up:boot 2026-02-20T03:14:24.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: fsmap 8 up:standby 2026-02-20T03:14:24.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:14:24.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2026-02-20T03:14:24.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: Deploying daemon mds.i on trial177 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:24.763 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:24 trial028 ceph-mon[38552]: Deploying daemon mds.g on trial028 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6836/3933107687,v1:10.20.193.177:6837/3933107687] up:boot 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] up:boot 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: fsmap 8 up:standby 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: Deploying daemon mds.i on trial177 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:24.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:24.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:24.850 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:24 trial126 ceph-mon[38476]: Deploying daemon mds.g on trial028 2026-02-20T03:14:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6836/3933107687,v1:10.20.193.177:6837/3933107687] up:boot 2026-02-20T03:14:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] up:boot 2026-02-20T03:14:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: fsmap 8 up:standby 2026-02-20T03:14:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:14:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2026-02-20T03:14:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: Deploying daemon mds.i on trial177 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:24.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:24 trial177 ceph-mon[43181]: Deploying daemon mds.g on trial028 2026-02-20T03:14:25.336 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:14:25 trial028 systemd[1]: Starting Ceph mds.g for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:14:25.456 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:14:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:25 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] up:boot 2026-02-20T03:14:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:25 trial028 ceph-mon[38552]: fsmap 9 up:standby 2026-02-20T03:14:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2026-02-20T03:14:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:25.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:25 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:25.602 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:14:25 trial028 podman[72624]: 2026-02-20 03:14:25.33409218 +0000 UTC m=+0.029072819 container create 03cd8aed26d5af5ccb8eb8c7ffed53a37346a30b60a7a173a4c238b903e1bfe9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-g, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T03:14:25.602 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:14:25 trial028 podman[72624]: 2026-02-20 03:14:25.377599677 +0000 UTC m=+0.072580316 container init 03cd8aed26d5af5ccb8eb8c7ffed53a37346a30b60a7a173a4c238b903e1bfe9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-g, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T03:14:25.602 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:14:25 trial028 podman[72624]: 2026-02-20 03:14:25.382752594 +0000 UTC m=+0.077733243 container start 03cd8aed26d5af5ccb8eb8c7ffed53a37346a30b60a7a173a4c238b903e1bfe9 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-g, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7) 2026-02-20T03:14:25.602 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:14:25 trial028 bash[72624]: 03cd8aed26d5af5ccb8eb8c7ffed53a37346a30b60a7a173a4c238b903e1bfe9 2026-02-20T03:14:25.602 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:14:25 trial028 podman[72624]: 2026-02-20 03:14:25.323820078 +0000 UTC m=+0.018800717 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:14:25.603 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:14:25 trial028 systemd[1]: Started Ceph mds.g for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:14:25.603 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:14:25 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-g[72638]: starting mds.g at 2026-02-20T03:14:25.726 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:25.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:25 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] up:boot 2026-02-20T03:14:25.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:25 trial126 ceph-mon[38476]: fsmap 9 up:standby 2026-02-20T03:14:25.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2026-02-20T03:14:25.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:25.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:25.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:25.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:25.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:25.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:25 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:25.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.908+0000 7f280cac6640 1 -- 10.20.193.28:0/1499236397 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28040048b0 con 0x7f28081030b0 2026-02-20T03:14:25.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.909+0000 7f280eaca640 1 -- 10.20.193.28:0/1499236397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28081030b0 msgr2=0x7f280810f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:25.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.909+0000 7f280eaca640 1 --2- 10.20.193.28:0/1499236397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28081030b0 0x7f280810f5e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f280400b0d0 tx=0x7f280402f450 comp rx=0 tx=0).stop 2026-02-20T03:14:25.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.909+0000 7f280eaca640 1 -- 10.20.193.28:0/1499236397 shutdown_connections 2026-02-20T03:14:25.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.909+0000 7f280eaca640 1 --2- 10.20.193.28:0/1499236397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f28081030b0 0x7f280810f5e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:25.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.909+0000 7f280eaca640 1 --2- 10.20.193.28:0/1499236397 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2808102710 0x7f2808102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:25.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.909+0000 7f280eaca640 1 --2- 10.20.193.28:0/1499236397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2808108710 0x7f2808108af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:25.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.909+0000 7f280eaca640 1 -- 10.20.193.28:0/1499236397 >> 10.20.193.28:0/1499236397 conn(0x7f28080fe410 msgr2=0x7f2808100830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:25.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.909+0000 7f280eaca640 1 -- 10.20.193.28:0/1499236397 shutdown_connections 2026-02-20T03:14:25.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.909+0000 7f280eaca640 1 -- 10.20.193.28:0/1499236397 wait complete. 2026-02-20T03:14:25.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280eaca640 1 Processor -- start 2026-02-20T03:14:25.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280eaca640 1 -- start start 2026-02-20T03:14:25.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280eaca640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2808102710 0x7f280819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:25.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280eaca640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28081030b0 0x7f280819d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:25.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280eaca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2808108710 0x7f28081a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:25.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280eaca640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2808112930 con 0x7f2808108710 2026-02-20T03:14:25.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280eaca640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f28081127b0 con 0x7f2808102710 2026-02-20T03:14:25.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280eaca640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2808112ab0 con 0x7f28081030b0 2026-02-20T03:14:25.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280e2c9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2808108710 0x7f28081a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280d2c7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28081030b0 0x7f280819d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280d2c7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28081030b0 0x7f280819d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36380/0 (socket says 10.20.193.28:36380) 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280d2c7640 1 -- 10.20.193.28:0/4249519161 learned_addr learned my addr 10.20.193.28:0/4249519161 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280dac8640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2808102710 0x7f280819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280e2c9640 1 -- 10.20.193.28:0/4249519161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28081030b0 msgr2=0x7f280819d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280e2c9640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28081030b0 0x7f280819d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280e2c9640 1 -- 10.20.193.28:0/4249519161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2808102710 msgr2=0x7f280819cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280e2c9640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2808102710 0x7f280819cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.910+0000 7f280e2c9640 1 -- 10.20.193.28:0/4249519161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28081a1fe0 con 0x7f2808108710 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.911+0000 7f280e2c9640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2808108710 0x7f28081a1860 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f28040062a0 tx=0x7f2804009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.911+0000 7f27f6ffd640 1 -- 10.20.193.28:0/4249519161 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28040044b0 con 0x7f2808108710 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.911+0000 7f27f6ffd640 1 -- 10.20.193.28:0/4249519161 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2804004650 con 0x7f2808108710 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.911+0000 7f27f6ffd640 1 -- 10.20.193.28:0/4249519161 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2804038680 con 0x7f2808108710 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.912+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28081a2270 con 0x7f2808108710 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.912+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2808109500 con 0x7f2808108710 2026-02-20T03:14:25.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.912+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2808103e50 con 0x7f2808108710 2026-02-20T03:14:25.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.914+0000 7f27f6ffd640 1 -- 10.20.193.28:0/4249519161 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f2804048070 con 0x7f2808108710 2026-02-20T03:14:25.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.916+0000 7f27f6ffd640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27e40b0e20 0x7f27e40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:25.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.916+0000 7f27f6ffd640 1 -- 10.20.193.28:0/4249519161 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7f28041049c0 con 0x7f2808108710 2026-02-20T03:14:25.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.916+0000 7f280dac8640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27e40b0e20 0x7f27e40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:25.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.916+0000 7f280dac8640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27e40b0e20 0x7f27e40b32e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27f8004680 tx=0x7f27f8009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:25.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:25.918+0000 7f27f6ffd640 1 -- 10.20.193.28:0/4249519161 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f28040cd750 con 0x7f2808108710 2026-02-20T03:14:25.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:25 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] up:boot 2026-02-20T03:14:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:25 trial177 ceph-mon[43181]: fsmap 9 up:standby 2026-02-20T03:14:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2026-02-20T03:14:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:25 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:26.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.027+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28081097c0 con 0x7f2808108710 2026-02-20T03:14:26.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.027+0000 7f27f6ffd640 1 -- 10.20.193.28:0/4249519161 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+8875 (secure 0 0 0) 0x7f28040d1400 con 0x7f2808108710 2026-02-20T03:14:26.031 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 9 2026-02-20T03:14:26.031 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:26.031 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":9,"btime":"2026-02-20T03:14:25:495155+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-20T03:14:26.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27e40b0e20 msgr2=0x7f27e40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:26.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27e40b0e20 0x7f27e40b32e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27f8004680 tx=0x7f27f8009290 comp rx=0 tx=0).stop 2026-02-20T03:14:26.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2808108710 msgr2=0x7f28081a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:26.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2808108710 0x7f28081a1860 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f28040062a0 tx=0x7f2804009380 comp rx=0 tx=0).stop 2026-02-20T03:14:26.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 shutdown_connections 2026-02-20T03:14:26.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27e40b0e20 0x7f27e40b32e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:26.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2808108710 0x7f28081a1860 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:26.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28081030b0 0x7f280819d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:26.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 --2- 10.20.193.28:0/4249519161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2808102710 0x7f280819cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:26.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.029+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 >> 10.20.193.28:0/4249519161 conn(0x7f28080fe410 msgr2=0x7f28080feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:26.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.031+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 shutdown_connections 2026-02-20T03:14:26.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:26.031+0000 7f280eaca640 1 -- 10.20.193.28:0/4249519161 wait complete. 2026-02-20T03:14:26.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:26 trial028 ceph-mon[38552]: Deploying daemon mds.a on trial028 2026-02-20T03:14:26.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:26 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.28:6838/4204022790,v1:10.20.193.28:6839/4204022790] up:boot 2026-02-20T03:14:26.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:26 trial028 ceph-mon[38552]: fsmap 10 up:standby 2026-02-20T03:14:26.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2026-02-20T03:14:26.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:26 trial028 ceph-mon[38552]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:26.637 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:26 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4249519161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:26.637 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 03:14:26 trial028 podman[73029]: 2026-02-20 03:14:26.634348784 +0000 UTC m=+0.077492586 container start 713fa995906af868a827796e313ec71ea5c90e0028828945ff4b3b0921e7aab6 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T03:14:26.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:26 trial126 ceph-mon[38476]: Deploying daemon mds.a on trial028 2026-02-20T03:14:26.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:26 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.28:6838/4204022790,v1:10.20.193.28:6839/4204022790] up:boot 2026-02-20T03:14:26.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:26 trial126 ceph-mon[38476]: fsmap 10 up:standby 2026-02-20T03:14:26.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2026-02-20T03:14:26.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:26 trial126 ceph-mon[38476]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:26.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:26 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4249519161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:26.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:26 trial177 ceph-mon[43181]: Deploying daemon mds.a on trial028 2026-02-20T03:14:26.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:26 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.28:6838/4204022790,v1:10.20.193.28:6839/4204022790] up:boot 2026-02-20T03:14:26.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:26 trial177 ceph-mon[43181]: fsmap 10 up:standby 2026-02-20T03:14:26.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2026-02-20T03:14:26.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:26 trial177 ceph-mon[43181]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:26.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:26 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4249519161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:27.101 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 03:14:26 trial028 bash[73029]: 713fa995906af868a827796e313ec71ea5c90e0028828945ff4b3b0921e7aab6 2026-02-20T03:14:27.101 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 03:14:26 trial028 podman[73029]: 2026-02-20 03:14:26.576545474 +0000 UTC m=+0.019689276 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:14:27.101 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 03:14:26 trial028 systemd[1]: Started Ceph mds.a for bfaff8d7-0e09-11f1-8045-d404e6e7d460. 2026-02-20T03:14:27.101 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 03:14:26 trial028 ceph-mds[73049]: -- 10.20.193.28:0/2715129931 <== mon.0 v2:10.20.193.28:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5596d8816b40 con 0x5596d86c1000 2026-02-20T03:14:27.101 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 03:14:26 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-a[73045]: starting mds.a at 2026-02-20T03:14:27.599 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: starting mds.b at 2026-02-20T03:14:27.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: Deploying daemon mds.b on trial126 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.28:6840/3872820740,v1:10.20.193.28:6841/3872820740] up:boot 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] up:boot 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: fsmap 12 up:standby 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2026-02-20T03:14:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2026-02-20T03:14:27.995 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: Deploying daemon mds.b on trial126 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.28:6840/3872820740,v1:10.20.193.28:6841/3872820740] up:boot 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] up:boot 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: fsmap 12 up:standby 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2026-02-20T03:14:27.996 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2026-02-20T03:14:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-20T03:14:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-20T03:14:28.099 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: Deploying daemon mds.b on trial126 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.28:6840/3872820740,v1:10.20.193.28:6841/3872820740] up:boot 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] up:boot 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: fsmap 12 up:standby 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2026-02-20T03:14:28.100 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2026-02-20T03:14:28.230 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:14:28.502 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:28.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.690+0000 7f5db2371640 1 -- 10.20.193.28:0/2839867177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac109ed0 msgr2=0x7f5dac111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:28.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.690+0000 7f5db2371640 1 --2- 10.20.193.28:0/2839867177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac109ed0 0x7f5dac111a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5da000b0a0 tx=0x7f5da002f430 comp rx=0 tx=0).stop 2026-02-20T03:14:28.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.690+0000 7f5db2371640 1 -- 10.20.193.28:0/2839867177 shutdown_connections 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.690+0000 7f5db2371640 1 --2- 10.20.193.28:0/2839867177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac109ed0 0x7f5dac111a50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.690+0000 7f5db2371640 1 --2- 10.20.193.28:0/2839867177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5dac105750 0x7f5dac1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.690+0000 7f5db2371640 1 --2- 10.20.193.28:0/2839867177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5dac104da0 0x7f5dac105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.690+0000 7f5db2371640 1 -- 10.20.193.28:0/2839867177 >> 10.20.193.28:0/2839867177 conn(0x7f5dac100840 msgr2=0x7f5dac102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.690+0000 7f5db2371640 1 -- 10.20.193.28:0/2839867177 shutdown_connections 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.690+0000 7f5db2371640 1 -- 10.20.193.28:0/2839867177 wait complete. 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.691+0000 7f5db2371640 1 Processor -- start 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.691+0000 7f5db2371640 1 -- start start 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.691+0000 7f5db2371640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5dac104da0 0x7f5dac111800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.691+0000 7f5db2371640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac105750 0x7f5dac10e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.691+0000 7f5db2371640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5dac109ed0 0x7f5dac10edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.691+0000 7f5db2371640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac114da0 con 0x7f5dac105750 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.691+0000 7f5db2371640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac114c20 con 0x7f5dac109ed0 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.691+0000 7f5db2371640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac114f20 con 0x7f5dac104da0 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac105750 0x7f5dac10e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dabfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5dac104da0 0x7f5dac111800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac105750 0x7f5dac10e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58272/0 (socket says 10.20.193.28:58272) 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dab7fe640 1 -- 10.20.193.28:0/4249756759 learned_addr learned my addr 10.20.193.28:0/4249756759 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dab7fe640 1 -- 10.20.193.28:0/4249756759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5dac104da0 msgr2=0x7f5dac111800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dab7fe640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5dac104da0 0x7f5dac111800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dab7fe640 1 -- 10.20.193.28:0/4249756759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5dac109ed0 msgr2=0x7f5dac10edf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dab7fe640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5dac109ed0 0x7f5dac10edf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dab7fe640 1 -- 10.20.193.28:0/4249756759 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dac10f660 con 0x7f5dac105750 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5dab7fe640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac105750 0x7f5dac10e8b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00ea10 tx=0x7f5d9c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:28.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5da97fa640 1 -- 10.20.193.28:0/4249756759 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00ce50 con 0x7f5dac105750 2026-02-20T03:14:28.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dac1adca0 con 0x7f5dac105750 2026-02-20T03:14:28.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac1ae200 con 0x7f5dac105750 2026-02-20T03:14:28.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5da97fa640 1 -- 10.20.193.28:0/4249756759 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5d9c00ce50 con 0x7f5dac105750 2026-02-20T03:14:28.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.692+0000 7f5da97fa640 1 -- 10.20.193.28:0/4249756759 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c002de0 con 0x7f5dac105750 2026-02-20T03:14:28.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.693+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dac106280 con 0x7f5dac105750 2026-02-20T03:14:28.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.695+0000 7f5da97fa640 1 -- 10.20.193.28:0/4249756759 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f5d9c0026e0 con 0x7f5dac105750 2026-02-20T03:14:28.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.696+0000 7f5da97fa640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d800b1020 0x7f5d800b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:28.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.697+0000 7f5da97fa640 1 -- 10.20.193.28:0/4249756759 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7f5d9c0e0320 con 0x7f5dac105750 2026-02-20T03:14:28.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.697+0000 7f5dabfff640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d800b1020 0x7f5d800b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:28.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.697+0000 7f5da97fa640 1 -- 10.20.193.28:0/4249756759 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5d9c0e07a0 con 0x7f5dac105750 2026-02-20T03:14:28.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.697+0000 7f5dabfff640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d800b1020 0x7f5d800b34e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5d98004500 tx=0x7f5d98009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:28.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.807+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dac105180 con 0x7f5dac105750 2026-02-20T03:14:28.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.808+0000 7f5da97fa640 1 -- 10.20.193.28:0/4249756759 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+10531 (secure 0 0 0) 0x7f5d9c0a8f90 con 0x7f5dac105750 2026-02-20T03:14:28.812 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:28.812 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":10,"btime":"2026-02-20T03:14:27:502853+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2026-02-20T03:14:28.813 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 10 2026-02-20T03:14:28.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d800b1020 msgr2=0x7f5d800b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:28.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d800b1020 0x7f5d800b34e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5d98004500 tx=0x7f5d98009290 comp rx=0 tx=0).stop 2026-02-20T03:14:28.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac105750 msgr2=0x7f5dac10e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:28.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac105750 0x7f5dac10e8b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00ea10 tx=0x7f5d9c00eee0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 shutdown_connections 2026-02-20T03:14:28.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d800b1020 0x7f5d800b34e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5dac109ed0 0x7f5dac10edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5dac105750 0x7f5dac10e8b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 --2- 10.20.193.28:0/4249756759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5dac104da0 0x7f5dac111800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:28.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.809+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 >> 10.20.193.28:0/4249756759 conn(0x7f5dac100840 msgr2=0x7f5dac101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:28.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.810+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 shutdown_connections 2026-02-20T03:14:28.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:28.810+0000 7f5db2371640 1 -- 10.20.193.28:0/4249756759 wait complete. 2026-02-20T03:14:28.917 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-20T03:14:29.215 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:29.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:29.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:29.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:29.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:29.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:29 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4249756759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:29.319 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:29.319 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:29.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:29 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4249756759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:29.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:29.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:14:29.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:29 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4249756759' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:29.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.396+0000 7f32ecd58640 1 -- 10.20.193.28:0/469127385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32e8101f90 msgr2=0x7f32e8106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:29.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.396+0000 7f32ecd58640 1 --2- 10.20.193.28:0/469127385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32e8101f90 0x7f32e8106460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009a30 tx=0x7f32d802f2b0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.397+0000 7f32ecd58640 1 -- 10.20.193.28:0/469127385 shutdown_connections 2026-02-20T03:14:29.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.397+0000 7f32ecd58640 1 --2- 10.20.193.28:0/469127385 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e8106a80 0x7f32e8106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.397+0000 7f32ecd58640 1 --2- 10.20.193.28:0/469127385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32e8101f90 0x7f32e8106460 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.397+0000 7f32ecd58640 1 --2- 10.20.193.28:0/469127385 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f32e8101670 0x7f32e8101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.397+0000 7f32ecd58640 1 -- 10.20.193.28:0/469127385 >> 10.20.193.28:0/469127385 conn(0x7f32e80fd2e0 msgr2=0x7f32e80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:29.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.397+0000 7f32ecd58640 1 -- 10.20.193.28:0/469127385 shutdown_connections 2026-02-20T03:14:29.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.397+0000 7f32ecd58640 1 -- 10.20.193.28:0/469127385 wait complete. 2026-02-20T03:14:29.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32ecd58640 1 Processor -- start 2026-02-20T03:14:29.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32ecd58640 1 -- start start 2026-02-20T03:14:29.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32ecd58640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f32e8101670 0x7f32e81159a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:29.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32ecd58640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e8101f90 0x7f32e8115ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:29.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32ecd58640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32e8106a80 0x7f32e810ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:29.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32ecd58640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f32e8119090 con 0x7f32e8106a80 2026-02-20T03:14:29.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32ecd58640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f32e8118f10 con 0x7f32e8101f90 2026-02-20T03:14:29.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32ecd58640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f32e8119210 con 0x7f32e8101670 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32e6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e8101f90 0x7f32e8115ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32e6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e8101f90 0x7f32e8115ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37610/0 (socket says 10.20.193.28:37610) 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32e6ffd640 1 -- 10.20.193.28:0/295994278 learned_addr learned my addr 10.20.193.28:0/295994278 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32e7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32e8106a80 0x7f32e810ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.398+0000 7f32e77fe640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f32e8101670 0x7f32e81159a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32e7fff640 1 -- 10.20.193.28:0/295994278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f32e8101670 msgr2=0x7f32e81159a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32e7fff640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f32e8101670 0x7f32e81159a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32e7fff640 1 -- 10.20.193.28:0/295994278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e8101f90 msgr2=0x7f32e8115ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32e7fff640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e8101f90 0x7f32e8115ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32e7fff640 1 -- 10.20.193.28:0/295994278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e810f390 con 0x7f32e8106a80 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32e7fff640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32e8106a80 0x7f32e810ead0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f32dc004830 tx=0x7f32dc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32e4ff9640 1 -- 10.20.193.28:0/295994278 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00db60 con 0x7f32e8106a80 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32e4ff9640 1 -- 10.20.193.28:0/295994278 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f32dc00dd00 con 0x7f32e8106a80 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e810f620 con 0x7f32e8106a80 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e81136a0 con 0x7f32e8106a80 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.399+0000 7f32e4ff9640 1 -- 10.20.193.28:0/295994278 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc013770 con 0x7f32e8106a80 2026-02-20T03:14:29.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.400+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e806bb60 con 0x7f32e8106a80 2026-02-20T03:14:29.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.402+0000 7f32e4ff9640 1 -- 10.20.193.28:0/295994278 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f32dc012070 con 0x7f32e8106a80 2026-02-20T03:14:29.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.404+0000 7f32e4ff9640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32bc0b0e70 0x7f32bc0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:29.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.404+0000 7f32e77fe640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32bc0b0e70 0x7f32bc0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:29.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.404+0000 7f32e4ff9640 1 -- 10.20.193.28:0/295994278 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7f32dc0dfd90 con 0x7f32e8106a80 2026-02-20T03:14:29.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.404+0000 7f32e4ff9640 1 -- 10.20.193.28:0/295994278 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f32dc010070 con 0x7f32e8106a80 2026-02-20T03:14:29.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.405+0000 7f32e77fe640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32bc0b0e70 0x7f32bc0b3330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f32d4002930 tx=0x7f32d4005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:29.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.497+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f32e81139f0 con 0x7f32e8106a80 2026-02-20T03:14:29.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.498+0000 7f32e4ff9640 1 -- 10.20.193.28:0/295994278 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f32dc0a8aa0 con 0x7f32e8106a80 2026-02-20T03:14:29.501 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:29.501 INFO:teuthology.orchestra.run.trial028.stdout:[ 2026-02-20T03:14:29.501 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:14:29.501 INFO:teuthology.orchestra.run.trial028.stdout: "poolnum": 1, 2026-02-20T03:14:29.501 INFO:teuthology.orchestra.run.trial028.stdout: "poolname": ".mgr" 2026-02-20T03:14:29.501 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:14:29.501 INFO:teuthology.orchestra.run.trial028.stdout:] 2026-02-20T03:14:29.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32bc0b0e70 msgr2=0x7f32bc0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:29.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32bc0b0e70 0x7f32bc0b3330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f32d4002930 tx=0x7f32d4005f50 comp rx=0 tx=0).stop 2026-02-20T03:14:29.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32e8106a80 msgr2=0x7f32e810ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:29.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32e8106a80 0x7f32e810ead0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f32dc004830 tx=0x7f32dc00d4a0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 shutdown_connections 2026-02-20T03:14:29.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32bc0b0e70 0x7f32bc0b3330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f32e8106a80 0x7f32e810ead0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f32e8101f90 0x7f32e8115ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 --2- 10.20.193.28:0/295994278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f32e8101670 0x7f32e81159a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:29.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.499+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 >> 10.20.193.28:0/295994278 conn(0x7f32e80fd2e0 msgr2=0x7f32e8104380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:29.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.500+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 shutdown_connections 2026-02-20T03:14:29.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:29.500+0000 7f32ecd58640 1 -- 10.20.193.28:0/295994278 wait complete. 2026-02-20T03:14:29.639 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-20T03:14:29.639 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-20T03:14:29.909 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:30.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.099+0000 7f1e7d484640 1 -- 10.20.193.28:0/1532966439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e78109ba0 msgr2=0x7f1e78115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:30.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.099+0000 7f1e7d484640 1 --2- 10.20.193.28:0/1532966439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e78109ba0 0x7f1e78115d10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00b0a0 tx=0x7f1e6c02f450 comp rx=0 tx=0).stop 2026-02-20T03:14:30.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.099+0000 7f1e7d484640 1 -- 10.20.193.28:0/1532966439 shutdown_connections 2026-02-20T03:14:30.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.099+0000 7f1e7d484640 1 --2- 10.20.193.28:0/1532966439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e78109ba0 0x7f1e78115d10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:30.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.099+0000 7f1e7d484640 1 --2- 10.20.193.28:0/1532966439 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e78109220 0x7f1e78109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.099+0000 7f1e7d484640 1 --2- 10.20.193.28:0/1532966439 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e7810eef0 0x7f1e7810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.099+0000 7f1e7d484640 1 -- 10.20.193.28:0/1532966439 >> 10.20.193.28:0/1532966439 conn(0x7f1e78078600 msgr2=0x7f1e7807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.099+0000 7f1e7d484640 1 -- 10.20.193.28:0/1532966439 shutdown_connections 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.099+0000 7f1e7d484640 1 -- 10.20.193.28:0/1532966439 wait complete. 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e7d484640 1 Processor -- start 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e7d484640 1 -- start start 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e7d484640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e78109220 0x7f1e781a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e7d484640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e78109ba0 0x7f1e781a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e7d484640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e7810eef0 0x7f1e781a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e7d484640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78119050 con 0x7f1e78109220 2026-02-20T03:14:30.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e7d484640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78118ed0 con 0x7f1e7810eef0 2026-02-20T03:14:30.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e7d484640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1e781191d0 con 0x7f1e78109ba0 2026-02-20T03:14:30.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e777fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e78109ba0 0x7f1e781a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:30.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e77fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e78109220 0x7f1e781a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:30.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e777fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e78109ba0 0x7f1e781a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51924/0 (socket says 10.20.193.28:51924) 2026-02-20T03:14:30.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e777fe640 1 -- 10.20.193.28:0/3314763645 learned_addr learned my addr 10.20.193.28:0/3314763645 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:30.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.100+0000 7f1e7cc83640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e7810eef0 0x7f1e781a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:30.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e77fff640 1 -- 10.20.193.28:0/3314763645 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e78109ba0 msgr2=0x7f1e781a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:30.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e77fff640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e78109ba0 0x7f1e781a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:30.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e77fff640 1 -- 10.20.193.28:0/3314763645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e7810eef0 msgr2=0x7f1e781a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:30.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e77fff640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e7810eef0 0x7f1e781a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:30.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e77fff640 1 -- 10.20.193.28:0/3314763645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e781a6460 con 0x7f1e78109220 2026-02-20T03:14:30.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e77fff640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e78109220 0x7f1e781a1410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400e9f0 tx=0x7f1e6400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:30.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e757fa640 1 -- 10.20.193.28:0/3314763645 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400cd80 con 0x7f1e78109220 2026-02-20T03:14:30.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e757fa640 1 -- 10.20.193.28:0/3314763645 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1e64004570 con 0x7f1e78109220 2026-02-20T03:14:30.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e757fa640 1 -- 10.20.193.28:0/3314763645 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64010690 con 0x7f1e78109220 2026-02-20T03:14:30.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e781a6750 con 0x7f1e78109220 2026-02-20T03:14:30.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.101+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e781adf90 con 0x7f1e78109220 2026-02-20T03:14:30.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.102+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e7810a580 con 0x7f1e78109220 2026-02-20T03:14:30.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.104+0000 7f1e757fa640 1 -- 10.20.193.28:0/3314763645 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f1e64002890 con 0x7f1e78109220 2026-02-20T03:14:30.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.105+0000 7f1e757fa640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1e4c0b0e20 0x7f1e4c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:30.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.106+0000 7f1e757fa640 1 -- 10.20.193.28:0/3314763645 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7121+0+0 (secure 0 0 0) 0x7f1e640e0690 con 0x7f1e78109220 2026-02-20T03:14:30.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.106+0000 7f1e757fa640 1 -- 10.20.193.28:0/3314763645 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1e640e0b10 con 0x7f1e78109220 2026-02-20T03:14:30.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.106+0000 7f1e777fe640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1e4c0b0e20 0x7f1e4c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:30.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.106+0000 7f1e777fe640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1e4c0b0e20 0x7f1e4c0b32e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1e7810e5b0 tx=0x7f1e68009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:30.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:30.198+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1e78109660 con 0x7f1e78109220 2026-02-20T03:14:30.275 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.276 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.276 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.276 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.276 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/295994278' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2026-02-20T03:14:30.276 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/295994278' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2026-02-20T03:14:30.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:30.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:30.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.600 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:30 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3314763645' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2026-02-20T03:14:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:30 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3314763645' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2026-02-20T03:14:30.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/295994278' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2026-02-20T03:14:30.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:14:30.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:14:30.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:14:30.720 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:30 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3314763645' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2026-02-20T03:14:31.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.064+0000 7f1e757fa640 1 -- 10.20.193.28:0/3314763645 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f1e78109660 con 0x7f1e78109220 2026-02-20T03:14:31.067 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_metadata' created 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.067+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1e4c0b0e20 msgr2=0x7f1e4c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.067+0000 7f1e7d484640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1e4c0b0e20 0x7f1e4c0b32e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1e7810e5b0 tx=0x7f1e68009290 comp rx=0 tx=0).stop 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.067+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e78109220 msgr2=0x7f1e781a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.067+0000 7f1e7d484640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e78109220 0x7f1e781a1410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400e9f0 tx=0x7f1e6400eec0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.068+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 shutdown_connections 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.068+0000 7f1e7d484640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1e4c0b0e20 0x7f1e4c0b32e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.068+0000 7f1e7d484640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e7810eef0 0x7f1e781a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.068+0000 7f1e7d484640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e78109ba0 0x7f1e781a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.068+0000 7f1e7d484640 1 --2- 10.20.193.28:0/3314763645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e78109220 0x7f1e781a1410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.068+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 >> 10.20.193.28:0/3314763645 conn(0x7f1e78078600 msgr2=0x7f1e78079e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:31.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.068+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 shutdown_connections 2026-02-20T03:14:31.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.069+0000 7f1e7d484640 1 -- 10.20.193.28:0/3314763645 wait complete. 2026-02-20T03:14:31.173 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2026-02-20T03:14:31.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:31 trial028 ceph-mon[38552]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:31.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:31 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3314763645' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-20T03:14:31.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:31 trial028 ceph-mon[38552]: osdmap e82: 12 total, 12 up, 12 in 2026-02-20T03:14:31.440 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:31 trial126 ceph-mon[38476]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:31 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3314763645' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-20T03:14:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:31 trial126 ceph-mon[38476]: osdmap e82: 12 total, 12 up, 12 in 2026-02-20T03:14:31.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 -- 10.20.193.28:0/2781931066 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c105320 msgr2=0x7fe07c111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:31.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 --2- 10.20.193.28:0/2781931066 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c105320 0x7fe07c111850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00b0a0 tx=0x7fe06c02f410 comp rx=0 tx=0).stop 2026-02-20T03:14:31.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 -- 10.20.193.28:0/2781931066 shutdown_connections 2026-02-20T03:14:31.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 --2- 10.20.193.28:0/2781931066 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c105320 0x7fe07c111850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 --2- 10.20.193.28:0/2781931066 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c104980 0x7fe07c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 --2- 10.20.193.28:0/2781931066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c10a980 0x7fe07c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 -- 10.20.193.28:0/2781931066 >> 10.20.193.28:0/2781931066 conn(0x7fe07c100680 msgr2=0x7fe07c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:31.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 -- 10.20.193.28:0/2781931066 shutdown_connections 2026-02-20T03:14:31.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 -- 10.20.193.28:0/2781931066 wait complete. 2026-02-20T03:14:31.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 Processor -- start 2026-02-20T03:14:31.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.619+0000 7fe07b577640 1 -- start start 2026-02-20T03:14:31.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07b577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c104980 0x7fe07c19cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:31.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07b577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c105320 0x7fe07c19d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:31.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c10a980 0x7fe07c1a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:31.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c114bf0 con 0x7fe07c10a980 2026-02-20T03:14:31.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07b577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c114a70 con 0x7fe07c105320 2026-02-20T03:14:31.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07b577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c114d70 con 0x7fe07c104980 2026-02-20T03:14:31.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c104980 0x7fe07c19cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c104980 0x7fe07c19cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51930/0 (socket says 10.20.193.28:51930) 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07a575640 1 -- 10.20.193.28:0/2014536380 learned_addr learned my addr 10.20.193.28:0/2014536380 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe079d74640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c105320 0x7fe07c19d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07ad76640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c10a980 0x7fe07c1a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07a575640 1 -- 10.20.193.28:0/2014536380 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c105320 msgr2=0x7fe07c19d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07a575640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c105320 0x7fe07c19d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07a575640 1 -- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c10a980 msgr2=0x7fe07c1a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07a575640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c10a980 0x7fe07c1a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07a575640 1 -- 10.20.193.28:0/2014536380 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c1a2020 con 0x7fe07c104980 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.620+0000 7fe07ad76640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c10a980 0x7fe07c1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.621+0000 7fe07a575640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c104980 0x7fe07c19cfd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0700027e0 tx=0x7fe070002cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.621+0000 7fe0637fe640 1 -- 10.20.193.28:0/2014536380 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07000ed40 con 0x7fe07c104980 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.621+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c1a2310 con 0x7fe07c104980 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.621+0000 7fe0637fe640 1 -- 10.20.193.28:0/2014536380 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0700108d0 con 0x7fe07c104980 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.621+0000 7fe0637fe640 1 -- 10.20.193.28:0/2014536380 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07000f7c0 con 0x7fe07c104980 2026-02-20T03:14:31.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.621+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c1a9b50 con 0x7fe07c104980 2026-02-20T03:14:31.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.621+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c104de0 con 0x7fe07c104980 2026-02-20T03:14:31.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.624+0000 7fe0637fe640 1 -- 10.20.193.28:0/2014536380 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fe070010a80 con 0x7fe07c104980 2026-02-20T03:14:31.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.625+0000 7fe0637fe640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0540b0e20 0x7fe0540b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:31.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.626+0000 7fe0637fe640 1 -- 10.20.193.28:0/2014536380 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7491+0+0 (secure 0 0 0) 0x7fe0700e0a70 con 0x7fe07c104980 2026-02-20T03:14:31.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.626+0000 7fe0637fe640 1 -- 10.20.193.28:0/2014536380 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe070014030 con 0x7fe07c104980 2026-02-20T03:14:31.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.626+0000 7fe079d74640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0540b0e20 0x7fe0540b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:31.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.626+0000 7fe079d74640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0540b0e20 0x7fe0540b32e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe07c102ba0 tx=0x7fe064009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:31 trial177 ceph-mon[43181]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:31 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3314763645' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-20T03:14:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:31 trial177 ceph-mon[43181]: osdmap e82: 12 total, 12 up, 12 in 2026-02-20T03:14:31.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:31.716+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fe07c19e330 con 0x7fe07c104980 2026-02-20T03:14:32.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.067+0000 7fe0637fe640 1 -- 10.20.193.28:0/2014536380 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) ==== 171+0+0 (secure 0 0 0) 0x7fe0700a9570 con 0x7fe07c104980 2026-02-20T03:14:32.070 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_data' created 2026-02-20T03:14:32.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0540b0e20 msgr2=0x7fe0540b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:32.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0540b0e20 0x7fe0540b32e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe07c102ba0 tx=0x7fe064009290 comp rx=0 tx=0).stop 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c104980 msgr2=0x7fe07c19cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c104980 0x7fe07c19cfd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0700027e0 tx=0x7fe070002cb0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 shutdown_connections 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0540b0e20 0x7fe0540b32e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c10a980 0x7fe07c1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c105320 0x7fe07c19d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 --2- 10.20.193.28:0/2014536380 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c104980 0x7fe07c19cfd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.071+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 >> 10.20.193.28:0/2014536380 conn(0x7fe07c100680 msgr2=0x7fe07c100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.072+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 shutdown_connections 2026-02-20T03:14:32.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.072+0000 7fe07b577640 1 -- 10.20.193.28:0/2014536380 wait complete. 2026-02-20T03:14:32.177 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-20T03:14:32.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:32 trial028 ceph-mon[38552]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2026-02-20T03:14:32.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:32 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2014536380' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2026-02-20T03:14:32.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:32 trial028 ceph-mon[38552]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2026-02-20T03:14:32.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:32 trial028 ceph-mon[38552]: osdmap e83: 12 total, 12 up, 12 in 2026-02-20T03:14:32.445 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:32 trial126 ceph-mon[38476]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2026-02-20T03:14:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:32 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2014536380' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2026-02-20T03:14:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:32 trial126 ceph-mon[38476]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2026-02-20T03:14:32.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:32 trial126 ceph-mon[38476]: osdmap e83: 12 total, 12 up, 12 in 2026-02-20T03:14:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.623+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/4186072002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d3810eef0 msgr2=0x7f9d3810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.623+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/4186072002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d3810eef0 0x7f9d3810f2d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009a30 tx=0x7f9d2402f220 comp rx=0 tx=0).stop 2026-02-20T03:14:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.623+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/4186072002 shutdown_connections 2026-02-20T03:14:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.623+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/4186072002 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d38109ba0 0x7f9d38115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.623+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/4186072002 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d38109220 0x7f9d38109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.623+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/4186072002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d3810eef0 0x7f9d3810f2d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.623+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/4186072002 >> 10.20.193.28:0/4186072002 conn(0x7f9d38078600 msgr2=0x7f9d3807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.623+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/4186072002 shutdown_connections 2026-02-20T03:14:32.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.623+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/4186072002 wait complete. 2026-02-20T03:14:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d3d6ce640 1 Processor -- start 2026-02-20T03:14:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d3d6ce640 1 -- start start 2026-02-20T03:14:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d3d6ce640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d38109220 0x7f9d381a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:32.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d3d6ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d38109ba0 0x7f9d381a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:32.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d3d6ce640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d3810eef0 0x7f9d381a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:32.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d3d6ce640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38119080 con 0x7f9d38109ba0 2026-02-20T03:14:32.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d3d6ce640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38118f00 con 0x7f9d38109220 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d3d6ce640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38119200 con 0x7f9d3810eef0 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d377fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d38109ba0 0x7f9d381a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d377fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d38109ba0 0x7f9d381a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58338/0 (socket says 10.20.193.28:58338) 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.624+0000 7f9d377fe640 1 -- 10.20.193.28:0/3154090717 learned_addr learned my addr 10.20.193.28:0/3154090717 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d37fff640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d38109220 0x7f9d381a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d3cecd640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d3810eef0 0x7f9d381a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d377fe640 1 -- 10.20.193.28:0/3154090717 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d3810eef0 msgr2=0x7f9d381a5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d377fe640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d3810eef0 0x7f9d381a5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d377fe640 1 -- 10.20.193.28:0/3154090717 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d38109220 msgr2=0x7f9d381a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d377fe640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d38109220 0x7f9d381a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d377fe640 1 -- 10.20.193.28:0/3154090717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d381a6490 con 0x7f9d38109ba0 2026-02-20T03:14:32.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d377fe640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d38109ba0 0x7f9d381a1a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800cab0 tx=0x7f9d2800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d357fa640 1 -- 10.20.193.28:0/3154090717 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28013070 con 0x7f9d38109ba0 2026-02-20T03:14:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d357fa640 1 -- 10.20.193.28:0/3154090717 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9d28007dd0 con 0x7f9d38109ba0 2026-02-20T03:14:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d381a6780 con 0x7f9d38109ba0 2026-02-20T03:14:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d357fa640 1 -- 10.20.193.28:0/3154090717 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800f450 con 0x7f9d38109ba0 2026-02-20T03:14:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.625+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d381ae060 con 0x7f9d38109ba0 2026-02-20T03:14:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.626+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d3810a580 con 0x7f9d38109ba0 2026-02-20T03:14:32.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.628+0000 7f9d357fa640 1 -- 10.20.193.28:0/3154090717 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f9d28007930 con 0x7f9d38109ba0 2026-02-20T03:14:32.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.630+0000 7f9d357fa640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d0c0b0da0 0x7f9d0c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:32.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.630+0000 7f9d357fa640 1 -- 10.20.193.28:0/3154090717 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7873+0+0 (secure 0 0 0) 0x7f9d280e0ad0 con 0x7f9d38109ba0 2026-02-20T03:14:32.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.630+0000 7f9d357fa640 1 -- 10.20.193.28:0/3154090717 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9d28110bc0 con 0x7f9d38109ba0 2026-02-20T03:14:32.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.630+0000 7f9d37fff640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d0c0b0da0 0x7f9d0c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:32.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.631+0000 7f9d37fff640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d0c0b0da0 0x7f9d0c0b3260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d24002410 tx=0x7f9d24009660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:32.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:32 trial177 ceph-mon[43181]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2026-02-20T03:14:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:32 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2014536380' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2026-02-20T03:14:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:32 trial177 ceph-mon[43181]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2026-02-20T03:14:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:32 trial177 ceph-mon[43181]: osdmap e83: 12 total, 12 up, 12 in 2026-02-20T03:14:32.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:32.739+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9d38109660 con 0x7f9d38109ba0 2026-02-20T03:14:33.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.285+0000 7f9d357fa640 1 -- 10.20.193.28:0/3154090717 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v11) ==== 172+0+0 (secure 0 0 0) 0x7f9d38109660 con 0x7f9d38109ba0 2026-02-20T03:14:33.288 INFO:teuthology.orchestra.run.trial028.stderr:new fs with metadata pool 2 and data pool 3 2026-02-20T03:14:33.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d0c0b0da0 msgr2=0x7f9d0c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:33.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d0c0b0da0 0x7f9d0c0b3260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d24002410 tx=0x7f9d24009660 comp rx=0 tx=0).stop 2026-02-20T03:14:33.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d38109ba0 msgr2=0x7f9d381a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:33.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d38109ba0 0x7f9d381a1a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800cab0 tx=0x7f9d2800cf80 comp rx=0 tx=0).stop 2026-02-20T03:14:33.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 shutdown_connections 2026-02-20T03:14:33.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d0c0b0da0 0x7f9d0c0b3260 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:33.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d3810eef0 0x7f9d381a5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:33.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d38109ba0 0x7f9d381a1a20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:33.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 --2- 10.20.193.28:0/3154090717 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d38109220 0x7f9d381a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:33.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 >> 10.20.193.28:0/3154090717 conn(0x7f9d38078600 msgr2=0x7f9d38079f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:33.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 shutdown_connections 2026-02-20T03:14:33.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.287+0000 7f9d3d6ce640 1 -- 10.20.193.28:0/3154090717 wait complete. 2026-02-20T03:14:33.427 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2026-02-20T03:14:33.428 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2026-02-20T03:14:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:33 trial126 ceph-mon[38476]: pgmap v165: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:33 trial126 ceph-mon[38476]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-20T03:14:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:33 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3154090717' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2026-02-20T03:14:33.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:33 trial126 ceph-mon[38476]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-20T03:14:33.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:33 trial028 ceph-mon[38552]: pgmap v165: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:33 trial028 ceph-mon[38552]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-20T03:14:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:33 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3154090717' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2026-02-20T03:14:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:33 trial028 ceph-mon[38552]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-20T03:14:33.692 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:33 trial177 ceph-mon[43181]: pgmap v165: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:33 trial177 ceph-mon[43181]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-20T03:14:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:33 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3154090717' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2026-02-20T03:14:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:33 trial177 ceph-mon[43181]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-20T03:14:33.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.886+0000 7fd2c5529640 1 -- 10.20.193.28:0/1754606979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2c0105320 msgr2=0x7fd2c0111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:33.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.886+0000 7fd2c5529640 1 --2- 10.20.193.28:0/1754606979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2c0105320 0x7fd2c0111850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400b0d0 tx=0x7fd2b402f450 comp rx=0 tx=0).stop 2026-02-20T03:14:33.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.886+0000 7fd2c5529640 1 -- 10.20.193.28:0/1754606979 shutdown_connections 2026-02-20T03:14:33.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.886+0000 7fd2c5529640 1 --2- 10.20.193.28:0/1754606979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2c0105320 0x7fd2c0111850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:33.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.886+0000 7fd2c5529640 1 --2- 10.20.193.28:0/1754606979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2c0104980 0x7fd2c0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:33.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.886+0000 7fd2c5529640 1 --2- 10.20.193.28:0/1754606979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2c010a980 0x7fd2c010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:33.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.886+0000 7fd2c5529640 1 -- 10.20.193.28:0/1754606979 >> 10.20.193.28:0/1754606979 conn(0x7fd2c0100680 msgr2=0x7fd2c0102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:33.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.886+0000 7fd2c5529640 1 -- 10.20.193.28:0/1754606979 shutdown_connections 2026-02-20T03:14:33.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.886+0000 7fd2c5529640 1 -- 10.20.193.28:0/1754606979 wait complete. 2026-02-20T03:14:33.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.887+0000 7fd2c5529640 1 Processor -- start 2026-02-20T03:14:33.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.887+0000 7fd2c5529640 1 -- start start 2026-02-20T03:14:33.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.887+0000 7fd2c5529640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2c0104980 0x7fd2c019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:33.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.887+0000 7fd2c5529640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2c0105320 0x7fd2c019d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:33.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2c5529640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2c010a980 0x7fd2c01a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:33.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2c5529640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0114ba0 con 0x7fd2c010a980 2026-02-20T03:14:33.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2c5529640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0114a20 con 0x7fd2c0104980 2026-02-20T03:14:33.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2c5529640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0114d20 con 0x7fd2c0105320 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2c0104980 0x7fd2c019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2c0104980 0x7fd2c019cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37680/0 (socket says 10.20.193.28:37680) 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bffff640 1 -- 10.20.193.28:0/915113510 learned_addr learned my addr 10.20.193.28:0/915113510 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bf7fe640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2c0105320 0x7fd2c019d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2c4d28640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2c010a980 0x7fd2c01a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bffff640 1 -- 10.20.193.28:0/915113510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2c0105320 msgr2=0x7fd2c019d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bffff640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2c0105320 0x7fd2c019d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bffff640 1 -- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2c010a980 msgr2=0x7fd2c01a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bffff640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2c010a980 0x7fd2c01a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bffff640 1 -- 10.20.193.28:0/915113510 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c01a1fd0 con 0x7fd2c0104980 2026-02-20T03:14:33.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2c4d28640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2c010a980 0x7fd2c01a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:14:33.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bf7fe640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2c0105320 0x7fd2c019d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:14:33.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bffff640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2c0104980 0x7fd2c019cf80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00ea30 tx=0x7fd2ac00ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:33.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2bd7fa640 1 -- 10.20.193.28:0/915113510 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00ce50 con 0x7fd2c0104980 2026-02-20T03:14:33.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.888+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c01a22c0 con 0x7fd2c0104980 2026-02-20T03:14:33.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.889+0000 7fd2bd7fa640 1 -- 10.20.193.28:0/915113510 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd2ac004570 con 0x7fd2c0104980 2026-02-20T03:14:33.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.889+0000 7fd2bd7fa640 1 -- 10.20.193.28:0/915113510 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac010690 con 0x7fd2c0104980 2026-02-20T03:14:33.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.889+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c01a9b00 con 0x7fd2c0104980 2026-02-20T03:14:33.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.889+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c0104de0 con 0x7fd2c0104980 2026-02-20T03:14:33.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.892+0000 7fd2bd7fa640 1 -- 10.20.193.28:0/915113510 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fd2ac0040d0 con 0x7fd2c0104980 2026-02-20T03:14:33.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.894+0000 7fd2bd7fa640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2940b0e20 0x7fd2940b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:33.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.894+0000 7fd2bd7fa640 1 -- 10.20.193.28:0/915113510 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7973+0+0 (secure 0 0 0) 0x7fd2ac0e0990 con 0x7fd2c0104980 2026-02-20T03:14:33.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.894+0000 7fd2bf7fe640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2940b0e20 0x7fd2940b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:33.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.894+0000 7fd2bd7fa640 1 -- 10.20.193.28:0/915113510 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd2ac110bc0 con 0x7fd2c0104980 2026-02-20T03:14:33.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.895+0000 7fd2bf7fe640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2940b0e20 0x7fd2940b32e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0004750 tx=0x7fd2b0009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:33.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:33.989+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fd2c010c970 con 0x7fd2c0104980 2026-02-20T03:14:34.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.287+0000 7fd2bd7fa640 1 -- 10.20.193.28:0/915113510 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7fd2ac0a9340 con 0x7fd2c0104980 2026-02-20T03:14:34.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.288+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2940b0e20 msgr2=0x7fd2940b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:34.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.288+0000 7fd2c5529640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2940b0e20 0x7fd2940b32e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0004750 tx=0x7fd2b0009290 comp rx=0 tx=0).stop 2026-02-20T03:14:34.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.288+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2c0104980 msgr2=0x7fd2c019cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:34.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.288+0000 7fd2c5529640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2c0104980 0x7fd2c019cf80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00ea30 tx=0x7fd2ac00ef00 comp rx=0 tx=0).stop 2026-02-20T03:14:34.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.289+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 shutdown_connections 2026-02-20T03:14:34.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.289+0000 7fd2c5529640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2940b0e20 0x7fd2940b32e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:34.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.289+0000 7fd2c5529640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd2c010a980 0x7fd2c01a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:34.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.289+0000 7fd2c5529640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd2c0105320 0x7fd2c019d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:34.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.289+0000 7fd2c5529640 1 --2- 10.20.193.28:0/915113510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd2c0104980 0x7fd2c019cf80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:34.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.289+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 >> 10.20.193.28:0/915113510 conn(0x7fd2c0100680 msgr2=0x7fd2c0100f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:34.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.289+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 shutdown_connections 2026-02-20T03:14:34.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.289+0000 7fd2c5529640 1 -- 10.20.193.28:0/915113510 wait complete. 2026-02-20T03:14:34.388 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2026-02-20T03:14:34.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:34 trial126 ceph-mon[38476]: osdmap e84: 12 total, 12 up, 12 in 2026-02-20T03:14:34.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:34 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3154090717' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-20T03:14:34.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:34 trial126 ceph-mon[38476]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-20T03:14:34.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:34 trial126 ceph-mon[38476]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-20T03:14:34.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:34 trial126 ceph-mon[38476]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2026-02-20T03:14:34.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:34 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/915113510' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2026-02-20T03:14:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:34 trial028 ceph-mon[38552]: osdmap e84: 12 total, 12 up, 12 in 2026-02-20T03:14:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:34 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3154090717' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-20T03:14:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:34 trial028 ceph-mon[38552]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-20T03:14:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:34 trial028 ceph-mon[38552]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-20T03:14:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:34 trial028 ceph-mon[38552]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2026-02-20T03:14:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:34 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/915113510' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2026-02-20T03:14:34.651 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:34 trial177 ceph-mon[43181]: osdmap e84: 12 total, 12 up, 12 in 2026-02-20T03:14:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:34 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3154090717' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-20T03:14:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:34 trial177 ceph-mon[43181]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-20T03:14:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:34 trial177 ceph-mon[43181]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-20T03:14:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:34 trial177 ceph-mon[43181]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2026-02-20T03:14:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:34 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/915113510' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2026-02-20T03:14:34.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.833+0000 7f0acbfff640 1 -- 10.20.193.28:0/4150117305 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0acc104980 msgr2=0x7f0acc104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.833+0000 7f0acbfff640 1 --2- 10.20.193.28:0/4150117305 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0acc104980 0x7f0acc104de0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009a60 tx=0x7f0ab402f250 comp rx=0 tx=0).stop 2026-02-20T03:14:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.833+0000 7f0acbfff640 1 -- 10.20.193.28:0/4150117305 shutdown_connections 2026-02-20T03:14:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.833+0000 7f0acbfff640 1 --2- 10.20.193.28:0/4150117305 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0acc105320 0x7f0acc111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.833+0000 7f0acbfff640 1 --2- 10.20.193.28:0/4150117305 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0acc104980 0x7f0acc104de0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.833+0000 7f0acbfff640 1 --2- 10.20.193.28:0/4150117305 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0acc10a980 0x7f0acc10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.833+0000 7f0acbfff640 1 -- 10.20.193.28:0/4150117305 >> 10.20.193.28:0/4150117305 conn(0x7f0acc100680 msgr2=0x7f0acc102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.833+0000 7f0acbfff640 1 -- 10.20.193.28:0/4150117305 shutdown_connections 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.833+0000 7f0acbfff640 1 -- 10.20.193.28:0/4150117305 wait complete. 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acbfff640 1 Processor -- start 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acbfff640 1 -- start start 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0acc104980 0x7f0acc19d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acbfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0acc105320 0x7f0acc19d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acbfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0acc10a980 0x7f0acc1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc114b60 con 0x7f0acc104980 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acbfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc1149e0 con 0x7f0acc10a980 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acbfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc114ce0 con 0x7f0acc105320 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acb7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0acc10a980 0x7f0acc1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0acc104980 0x7f0acc19d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acb7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0acc10a980 0x7f0acc1a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37698/0 (socket says 10.20.193.28:37698) 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0acb7fe640 1 -- 10.20.193.28:0/2940520783 learned_addr learned my addr 10.20.193.28:0/2940520783 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.834+0000 7f0aca7fc640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0acc105320 0x7f0acc19d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0acaffd640 1 -- 10.20.193.28:0/2940520783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0acc105320 msgr2=0x7f0acc19d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0acaffd640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0acc105320 0x7f0acc19d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0acaffd640 1 -- 10.20.193.28:0/2940520783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0acc10a980 msgr2=0x7f0acc1a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0acaffd640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0acc10a980 0x7f0acc1a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0acaffd640 1 -- 10.20.193.28:0/2940520783 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0acc1a20b0 con 0x7f0acc104980 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0acaffd640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0acc104980 0x7f0acc19d060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000d730 tx=0x7f0ac000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0ad0847640 1 -- 10.20.193.28:0/2940520783 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0014070 con 0x7f0acc104980 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0ad0847640 1 -- 10.20.193.28:0/2940520783 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0ac00044e0 con 0x7f0acc104980 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0ad0847640 1 -- 10.20.193.28:0/2940520783 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0005020 con 0x7f0acc104980 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0acc1a23a0 con 0x7f0acc104980 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.835+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0acc1a9be0 con 0x7f0acc104980 2026-02-20T03:14:34.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.836+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0acc104de0 con 0x7f0acc104980 2026-02-20T03:14:34.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.838+0000 7f0ad0847640 1 -- 10.20.193.28:0/2940520783 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f0ac00047c0 con 0x7f0acc104980 2026-02-20T03:14:34.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.839+0000 7f0ad0847640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0aa00b0e20 0x7f0aa00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:34.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.839+0000 7f0ad0847640 1 -- 10.20.193.28:0/2940520783 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8271+0+0 (secure 0 0 0) 0x7f0ac00e05d0 con 0x7f0acc104980 2026-02-20T03:14:34.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.840+0000 7f0aca7fc640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0aa00b0e20 0x7f0aa00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:34.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.840+0000 7f0ad0847640 1 -- 10.20.193.28:0/2940520783 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0ac00aca70 con 0x7f0acc104980 2026-02-20T03:14:34.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.840+0000 7f0aca7fc640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0aa00b0e20 0x7f0aa00b32e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40097c0 tx=0x7f0ab40057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:34.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:34.931+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0acc10caa0 con 0x7f0acc104980 2026-02-20T03:14:35.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:35 trial126 ceph-mon[38476]: pgmap v168: 97 pgs: 19 active+clean, 16 creating+peering, 62 unknown; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail; 0 B/s wr, 0 op/s 2026-02-20T03:14:35.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:35 trial126 ceph-mon[38476]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-20T03:14:35.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:35 trial126 ceph-mon[38476]: Cluster is now healthy 2026-02-20T03:14:35.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:35 trial126 ceph-mon[38476]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2026-02-20T03:14:35.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:35 trial126 ceph-mon[38476]: osdmap e85: 12 total, 12 up, 12 in 2026-02-20T03:14:35.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:35 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] up:active 2026-02-20T03:14:35.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:35 trial126 ceph-mon[38476]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:35.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:35 trial126 ceph-mon[38476]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:35.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:35 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2940520783' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2026-02-20T03:14:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:35 trial028 ceph-mon[38552]: pgmap v168: 97 pgs: 19 active+clean, 16 creating+peering, 62 unknown; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail; 0 B/s wr, 0 op/s 2026-02-20T03:14:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:35 trial028 ceph-mon[38552]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-20T03:14:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:35 trial028 ceph-mon[38552]: Cluster is now healthy 2026-02-20T03:14:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:35 trial028 ceph-mon[38552]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2026-02-20T03:14:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:35 trial028 ceph-mon[38552]: osdmap e85: 12 total, 12 up, 12 in 2026-02-20T03:14:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:35 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] up:active 2026-02-20T03:14:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:35 trial028 ceph-mon[38552]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:35 trial028 ceph-mon[38552]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:35 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2940520783' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2026-02-20T03:14:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:35 trial177 ceph-mon[43181]: pgmap v168: 97 pgs: 19 active+clean, 16 creating+peering, 62 unknown; 577 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail; 0 B/s wr, 0 op/s 2026-02-20T03:14:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:35 trial177 ceph-mon[43181]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-20T03:14:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:35 trial177 ceph-mon[43181]: Cluster is now healthy 2026-02-20T03:14:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:35 trial177 ceph-mon[43181]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2026-02-20T03:14:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:35 trial177 ceph-mon[43181]: osdmap e85: 12 total, 12 up, 12 in 2026-02-20T03:14:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:35 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] up:active 2026-02-20T03:14:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:35 trial177 ceph-mon[43181]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:35 trial177 ceph-mon[43181]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:35 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2940520783' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2026-02-20T03:14:36.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.297+0000 7f0ad0847640 1 -- 10.20.193.28:0/2940520783 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7f0ac00b1920 con 0x7f0acc104980 2026-02-20T03:14:36.300 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_data_ec' created 2026-02-20T03:14:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.299+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0aa00b0e20 msgr2=0x7f0aa00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:36.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.299+0000 7f0acbfff640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0aa00b0e20 0x7f0aa00b32e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40097c0 tx=0x7f0ab40057d0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.299+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0acc104980 msgr2=0x7f0acc19d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:36.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.299+0000 7f0acbfff640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0acc104980 0x7f0acc19d060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000d730 tx=0x7f0ac000dc00 comp rx=0 tx=0).stop 2026-02-20T03:14:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.299+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 shutdown_connections 2026-02-20T03:14:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.299+0000 7f0acbfff640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0aa00b0e20 0x7f0aa00b32e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.300+0000 7f0acbfff640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0acc10a980 0x7f0acc1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.300+0000 7f0acbfff640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0acc105320 0x7f0acc19d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.300+0000 7f0acbfff640 1 --2- 10.20.193.28:0/2940520783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0acc104980 0x7f0acc19d060 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.300+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 >> 10.20.193.28:0/2940520783 conn(0x7f0acc100680 msgr2=0x7f0acc100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.300+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 shutdown_connections 2026-02-20T03:14:36.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.300+0000 7f0acbfff640 1 -- 10.20.193.28:0/2940520783 wait complete. 2026-02-20T03:14:36.404 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2026-02-20T03:14:36.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:36 trial126 ceph-mon[38476]: osdmap e86: 12 total, 12 up, 12 in 2026-02-20T03:14:36.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:36 trial028 ceph-mon[38552]: osdmap e86: 12 total, 12 up, 12 in 2026-02-20T03:14:36.669 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:36.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:36 trial177 ceph-mon[43181]: osdmap e86: 12 total, 12 up, 12 in 2026-02-20T03:14:36.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.849+0000 7f2a49a48640 1 -- 10.20.193.28:0/300073349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44105320 msgr2=0x7f2a44111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:36.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.849+0000 7f2a49a48640 1 --2- 10.20.193.28:0/300073349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44105320 0x7f2a44111850 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000b0d0 tx=0x7f2a4002f450 comp rx=0 tx=0).stop 2026-02-20T03:14:36.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.849+0000 7f2a49a48640 1 -- 10.20.193.28:0/300073349 shutdown_connections 2026-02-20T03:14:36.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.849+0000 7f2a49a48640 1 --2- 10.20.193.28:0/300073349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44105320 0x7f2a44111850 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.849+0000 7f2a49a48640 1 --2- 10.20.193.28:0/300073349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2a44104980 0x7f2a44104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.849+0000 7f2a49a48640 1 --2- 10.20.193.28:0/300073349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2a4410a980 0x7f2a4410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.849+0000 7f2a49a48640 1 -- 10.20.193.28:0/300073349 >> 10.20.193.28:0/300073349 conn(0x7f2a44100680 msgr2=0x7f2a44102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:36.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.849+0000 7f2a49a48640 1 -- 10.20.193.28:0/300073349 shutdown_connections 2026-02-20T03:14:36.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.849+0000 7f2a49a48640 1 -- 10.20.193.28:0/300073349 wait complete. 2026-02-20T03:14:36.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.850+0000 7f2a49a48640 1 Processor -- start 2026-02-20T03:14:36.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.850+0000 7f2a49a48640 1 -- start start 2026-02-20T03:14:36.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.850+0000 7f2a49a48640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44104980 0x7f2a4419cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:36.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.850+0000 7f2a49a48640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2a44105320 0x7f2a4419d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:36.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.850+0000 7f2a49a48640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2a4410a980 0x7f2a441a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:36.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.850+0000 7f2a49a48640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44114ba0 con 0x7f2a44104980 2026-02-20T03:14:36.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.850+0000 7f2a49a48640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44114a20 con 0x7f2a4410a980 2026-02-20T03:14:36.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.850+0000 7f2a49a48640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44114d20 con 0x7f2a44105320 2026-02-20T03:14:36.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a48a46640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44104980 0x7f2a4419cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:36.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a48a46640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44104980 0x7f2a4419cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44458/0 (socket says 10.20.193.28:44458) 2026-02-20T03:14:36.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a48a46640 1 -- 10.20.193.28:0/2237843342 learned_addr learned my addr 10.20.193.28:0/2237843342 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a3bfff640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2a44105320 0x7f2a4419d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a49247640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2a4410a980 0x7f2a441a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a48a46640 1 -- 10.20.193.28:0/2237843342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2a44105320 msgr2=0x7f2a4419d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a48a46640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2a44105320 0x7f2a4419d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a48a46640 1 -- 10.20.193.28:0/2237843342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2a4410a980 msgr2=0x7f2a441a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a48a46640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2a4410a980 0x7f2a441a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a48a46640 1 -- 10.20.193.28:0/2237843342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a441a2030 con 0x7f2a44104980 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a49247640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2a4410a980 0x7f2a441a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a48a46640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44104980 0x7f2a4419cfe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400ea10 tx=0x7f2a3400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a39ffb640 1 -- 10.20.193.28:0/2237843342 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400ce50 con 0x7f2a44104980 2026-02-20T03:14:36.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a39ffb640 1 -- 10.20.193.28:0/2237843342 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2a34004570 con 0x7f2a44104980 2026-02-20T03:14:36.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a39ffb640 1 -- 10.20.193.28:0/2237843342 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34010690 con 0x7f2a44104980 2026-02-20T03:14:36.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a441a2320 con 0x7f2a44104980 2026-02-20T03:14:36.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.851+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a441a9b60 con 0x7f2a44104980 2026-02-20T03:14:36.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.852+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a44104de0 con 0x7f2a44104980 2026-02-20T03:14:36.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.854+0000 7f2a39ffb640 1 -- 10.20.193.28:0/2237843342 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f2a34020030 con 0x7f2a44104980 2026-02-20T03:14:36.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.856+0000 7f2a39ffb640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2a200b0fc0 0x7f2a200b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:36.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.856+0000 7f2a39ffb640 1 -- 10.20.193.28:0/2237843342 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8764+0+0 (secure 0 0 0) 0x7f2a340e0bf0 con 0x7f2a44104980 2026-02-20T03:14:36.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.856+0000 7f2a3bfff640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2a200b0fc0 0x7f2a200b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:36.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.856+0000 7f2a39ffb640 1 -- 10.20.193.28:0/2237843342 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f2a34055b20 con 0x7f2a44104980 2026-02-20T03:14:36.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.857+0000 7f2a3bfff640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2a200b0fc0 0x7f2a200b3480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a44102d10 tx=0x7f2a2c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:36.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:36.947+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f2a4410cae0 con 0x7f2a44104980 2026-02-20T03:14:37.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.299+0000 7f2a39ffb640 1 -- 10.20.193.28:0/2237843342 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) ==== 169+0+0 (secure 0 0 0) 0x7f2a340a91f0 con 0x7f2a44104980 2026-02-20T03:14:37.302 INFO:teuthology.orchestra.run.trial028.stderr:set pool 4 allow_ec_overwrites to true 2026-02-20T03:14:37.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2a200b0fc0 msgr2=0x7f2a200b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:37.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2a200b0fc0 0x7f2a200b3480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a44102d10 tx=0x7f2a2c009290 comp rx=0 tx=0).stop 2026-02-20T03:14:37.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44104980 msgr2=0x7f2a4419cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:37.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44104980 0x7f2a4419cfe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400ea10 tx=0x7f2a3400eee0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 shutdown_connections 2026-02-20T03:14:37.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2a200b0fc0 0x7f2a200b3480 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2a4410a980 0x7f2a441a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2a44105320 0x7f2a4419d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 --2- 10.20.193.28:0/2237843342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2a44104980 0x7f2a4419cfe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 >> 10.20.193.28:0/2237843342 conn(0x7f2a44100680 msgr2=0x7f2a44100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:37.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.301+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 shutdown_connections 2026-02-20T03:14:37.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.302+0000 7f2a49a48640 1 -- 10.20.193.28:0/2237843342 wait complete. 2026-02-20T03:14:37.412 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs add_data_pool cephfs cephfs_data_ec 2026-02-20T03:14:37.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:37 trial126 ceph-mon[38476]: pgmap v171: 97 pgs: 63 active+clean, 16 creating+peering, 18 unknown; 579 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 KiB/s wr, 5 op/s 2026-02-20T03:14:37.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:37 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2940520783' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-20T03:14:37.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:37 trial126 ceph-mon[38476]: osdmap e87: 12 total, 12 up, 12 in 2026-02-20T03:14:37.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:37 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2237843342' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2026-02-20T03:14:37.600 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:14:37 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:14:37.514+0000 7ff73e2ef640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-20T03:14:37.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:37 trial028 ceph-mon[38552]: pgmap v171: 97 pgs: 63 active+clean, 16 creating+peering, 18 unknown; 579 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 KiB/s wr, 5 op/s 2026-02-20T03:14:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:37 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2940520783' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-20T03:14:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:37 trial028 ceph-mon[38552]: osdmap e87: 12 total, 12 up, 12 in 2026-02-20T03:14:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:37 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2237843342' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2026-02-20T03:14:37.676 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:37 trial177 ceph-mon[43181]: pgmap v171: 97 pgs: 63 active+clean, 16 creating+peering, 18 unknown; 579 KiB data, 348 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 KiB/s wr, 5 op/s 2026-02-20T03:14:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:37 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2940520783' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-20T03:14:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:37 trial177 ceph-mon[43181]: osdmap e87: 12 total, 12 up, 12 in 2026-02-20T03:14:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:37 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2237843342' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2026-02-20T03:14:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.852+0000 7fc2289b6640 1 -- 10.20.193.28:0/3161634140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc22410eef0 msgr2=0x7fc22410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.852+0000 7fc2289b6640 1 --2- 10.20.193.28:0/3161634140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc22410eef0 0x7fc22410f2d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc210009960 tx=0x7fc21002f140 comp rx=0 tx=0).stop 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.852+0000 7fc2289b6640 1 -- 10.20.193.28:0/3161634140 shutdown_connections 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.852+0000 7fc2289b6640 1 --2- 10.20.193.28:0/3161634140 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc224109ba0 0x7fc224115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.852+0000 7fc2289b6640 1 --2- 10.20.193.28:0/3161634140 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc224109220 0x7fc224109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.852+0000 7fc2289b6640 1 --2- 10.20.193.28:0/3161634140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc22410eef0 0x7fc22410f2d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.852+0000 7fc2289b6640 1 -- 10.20.193.28:0/3161634140 >> 10.20.193.28:0/3161634140 conn(0x7fc224078600 msgr2=0x7fc22407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.852+0000 7fc2289b6640 1 -- 10.20.193.28:0/3161634140 shutdown_connections 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.852+0000 7fc2289b6640 1 -- 10.20.193.28:0/3161634140 wait complete. 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2289b6640 1 Processor -- start 2026-02-20T03:14:37.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2289b6640 1 -- start start 2026-02-20T03:14:37.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2289b6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc224109220 0x7fc2241a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:37.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2289b6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc224109ba0 0x7fc2241a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:37.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2289b6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc22410eef0 0x7fc2241a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:37.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2289b6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc224119080 con 0x7fc224109220 2026-02-20T03:14:37.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2289b6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc224118f00 con 0x7fc22410eef0 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2289b6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc224119200 con 0x7fc224109ba0 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc224109220 0x7fc2241a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc224109220 0x7fc2241a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44476/0 (socket says 10.20.193.28:44476) 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc2237fe640 1 -- 10.20.193.28:0/1467669689 learned_addr learned my addr 10.20.193.28:0/1467669689 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.853+0000 7fc222ffd640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc224109ba0 0x7fc2241a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc2237fe640 1 -- 10.20.193.28:0/1467669689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc224109ba0 msgr2=0x7fc2241a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc2237fe640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc224109ba0 0x7fc2241a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc2237fe640 1 -- 10.20.193.28:0/1467669689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc22410eef0 msgr2=0x7fc2241a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc2237fe640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc22410eef0 0x7fc2241a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc2237fe640 1 -- 10.20.193.28:0/1467669689 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2241a6590 con 0x7fc224109220 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc222ffd640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc224109ba0 0x7fc2241a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:14:37.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc2237fe640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc224109220 0x7fc2241a1540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc210009a90 tx=0x7fc210004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:37.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc220ff9640 1 -- 10.20.193.28:0/1467669689 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210046070 con 0x7fc224109220 2026-02-20T03:14:37.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc220ff9640 1 -- 10.20.193.28:0/1467669689 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc210038c10 con 0x7fc224109220 2026-02-20T03:14:37.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2241a6820 con 0x7fc224109220 2026-02-20T03:14:37.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc220ff9640 1 -- 10.20.193.28:0/1467669689 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210041410 con 0x7fc224109220 2026-02-20T03:14:37.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.854+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2241ae0c0 con 0x7fc224109220 2026-02-20T03:14:37.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.855+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc22410a580 con 0x7fc224109220 2026-02-20T03:14:37.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.857+0000 7fc220ff9640 1 -- 10.20.193.28:0/1467669689 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fc2100026e0 con 0x7fc224109220 2026-02-20T03:14:37.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.858+0000 7fc220ff9640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1f80b0e20 0x7fc1f80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:37.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.859+0000 7fc220ff9640 1 -- 10.20.193.28:0/1467669689 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8764+0+0 (secure 0 0 0) 0x7fc210104cb0 con 0x7fc224109220 2026-02-20T03:14:37.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.859+0000 7fc222ffd640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1f80b0e20 0x7fc1f80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:37.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.859+0000 7fc220ff9640 1 -- 10.20.193.28:0/1467669689 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc210105130 con 0x7fc224109220 2026-02-20T03:14:37.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.859+0000 7fc222ffd640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1f80b0e20 0x7fc1f80b32e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc224108d60 tx=0x7fc214009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:37.969+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc224110ee0 con 0x7fc224109220 2026-02-20T03:14:38.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.311+0000 7fc220ff9640 1 -- 10.20.193.28:0/1467669689 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v14) ==== 137+0+0 (secure 0 0 0) 0x7fc2100cd2b0 con 0x7fc224109220 2026-02-20T03:14:38.314 INFO:teuthology.orchestra.run.trial028.stderr:added data pool 4 to fsmap 2026-02-20T03:14:38.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1f80b0e20 msgr2=0x7fc1f80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:38.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1f80b0e20 0x7fc1f80b32e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc224108d60 tx=0x7fc214009340 comp rx=0 tx=0).stop 2026-02-20T03:14:38.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc224109220 msgr2=0x7fc2241a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:38.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc224109220 0x7fc2241a1540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc210009a90 tx=0x7fc210004290 comp rx=0 tx=0).stop 2026-02-20T03:14:38.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 shutdown_connections 2026-02-20T03:14:38.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1f80b0e20 0x7fc1f80b32e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc22410eef0 0x7fc2241a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc224109ba0 0x7fc2241a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 --2- 10.20.193.28:0/1467669689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc224109220 0x7fc2241a1540 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 >> 10.20.193.28:0/1467669689 conn(0x7fc224078600 msgr2=0x7fc224079f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:38.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 shutdown_connections 2026-02-20T03:14:38.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.313+0000 7fc2289b6640 1 -- 10.20.193.28:0/1467669689 wait complete. 2026-02-20T03:14:38.419 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:14:38.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:38 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2237843342' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2026-02-20T03:14:38.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:38 trial126 ceph-mon[38476]: osdmap e88: 12 total, 12 up, 12 in 2026-02-20T03:14:38.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:38 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1467669689' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2026-02-20T03:14:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:38 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2237843342' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2026-02-20T03:14:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:38 trial028 ceph-mon[38552]: osdmap e88: 12 total, 12 up, 12 in 2026-02-20T03:14:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:38 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1467669689' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2026-02-20T03:14:38.687 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:38 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2237843342' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2026-02-20T03:14:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:38 trial177 ceph-mon[43181]: osdmap e88: 12 total, 12 up, 12 in 2026-02-20T03:14:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:38 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1467669689' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.868+0000 7f6c1ffff640 1 -- 10.20.193.28:0/523624662 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c20104980 msgr2=0x7f6c20104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.868+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/523624662 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c20104980 0x7f6c20104de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009a60 tx=0x7f6c0802f250 comp rx=0 tx=0).stop 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.868+0000 7f6c1ffff640 1 -- 10.20.193.28:0/523624662 shutdown_connections 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.868+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/523624662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c20105320 0x7f6c20111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.868+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/523624662 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c20104980 0x7f6c20104de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.868+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/523624662 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c2010a980 0x7f6c2010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.868+0000 7f6c1ffff640 1 -- 10.20.193.28:0/523624662 >> 10.20.193.28:0/523624662 conn(0x7f6c20100680 msgr2=0x7f6c20102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.868+0000 7f6c1ffff640 1 -- 10.20.193.28:0/523624662 shutdown_connections 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.868+0000 7f6c1ffff640 1 -- 10.20.193.28:0/523624662 wait complete. 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.869+0000 7f6c1ffff640 1 Processor -- start 2026-02-20T03:14:38.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.869+0000 7f6c1ffff640 1 -- start start 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.869+0000 7f6c1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c20104980 0x7f6c2019d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.869+0000 7f6c1ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c20105320 0x7f6c2019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.869+0000 7f6c1ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c2010a980 0x7f6c201a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.869+0000 7f6c1ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20114bf0 con 0x7f6c20104980 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.869+0000 7f6c1ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20114a70 con 0x7f6c2010a980 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.869+0000 7f6c1ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20114d70 con 0x7f6c20105320 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c20104980 0x7f6c2019d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c20104980 0x7f6c2019d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44484/0 (socket says 10.20.193.28:44484) 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1effd640 1 -- 10.20.193.28:0/4045262520 learned_addr learned my addr 10.20.193.28:0/4045262520 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1e7fc640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c20105320 0x7f6c2019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1f7fe640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c2010a980 0x7f6c201a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1effd640 1 -- 10.20.193.28:0/4045262520 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c20105320 msgr2=0x7f6c2019d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1effd640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c20105320 0x7f6c2019d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1effd640 1 -- 10.20.193.28:0/4045262520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c2010a980 msgr2=0x7f6c201a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1effd640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c2010a980 0x7f6c201a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1effd640 1 -- 10.20.193.28:0/4045262520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c201a2120 con 0x7f6c20104980 2026-02-20T03:14:38.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1effd640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c20104980 0x7f6c2019d0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400d980 tx=0x7f6c1400de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:38.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6bfffff640 1 -- 10.20.193.28:0/4045262520 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14014070 con 0x7f6c20104980 2026-02-20T03:14:38.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6bfffff640 1 -- 10.20.193.28:0/4045262520 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6c140044e0 con 0x7f6c20104980 2026-02-20T03:14:38.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c201a2410 con 0x7f6c20104980 2026-02-20T03:14:38.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6bfffff640 1 -- 10.20.193.28:0/4045262520 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14005040 con 0x7f6c20104980 2026-02-20T03:14:38.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.870+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c201a9c50 con 0x7f6c20104980 2026-02-20T03:14:38.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.871+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c20104de0 con 0x7f6c20104980 2026-02-20T03:14:38.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.873+0000 7f6bfffff640 1 -- 10.20.193.28:0/4045262520 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f6c140047c0 con 0x7f6c20104980 2026-02-20T03:14:38.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.874+0000 7f6bfffff640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6bf40b0e20 0x7f6bf40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:38.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.874+0000 7f6bfffff640 1 -- 10.20.193.28:0/4045262520 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f6c140e0a80 con 0x7f6c20104980 2026-02-20T03:14:38.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.875+0000 7f6c1e7fc640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6bf40b0e20 0x7f6bf40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:38.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.875+0000 7f6bfffff640 1 -- 10.20.193.28:0/4045262520 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6c140a90c0 con 0x7f6c20104980 2026-02-20T03:14:38.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.875+0000 7f6c1e7fc640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6bf40b0e20 0x7f6bf40b32e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c20102d10 tx=0x7f6c0803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:38.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.983+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c2019e430 con 0x7f6c20104980 2026-02-20T03:14:38.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.983+0000 7f6bfffff640 1 -- 10.20.193.28:0/4045262520 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+11849 (secure 0 0 0) 0x7f6c2019e430 con 0x7f6c20104980 2026-02-20T03:14:38.987 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:38.987 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":14,"btime":"2026-02-20T03:14:38:309089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:14:37.971182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24560,"qdb_cluster":[24560]},"id":1}]} 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 14 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.984+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6bf40b0e20 msgr2=0x7f6bf40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.984+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6bf40b0e20 0x7f6bf40b32e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6c20102d10 tx=0x7f6c0803a040 comp rx=0 tx=0).stop 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.984+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c20104980 msgr2=0x7f6c2019d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.984+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c20104980 0x7f6c2019d0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400d980 tx=0x7f6c1400de50 comp rx=0 tx=0).stop 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.985+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 shutdown_connections 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.985+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6bf40b0e20 0x7f6bf40b32e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.985+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c2010a980 0x7f6c201a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.985+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c20105320 0x7f6c2019d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.985+0000 7f6c1ffff640 1 --2- 10.20.193.28:0/4045262520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c20104980 0x7f6c2019d0d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.985+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 >> 10.20.193.28:0/4045262520 conn(0x7f6c20100680 msgr2=0x7f6c20100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.985+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 shutdown_connections 2026-02-20T03:14:38.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:38.985+0000 7f6c1ffff640 1 -- 10.20.193.28:0/4045262520 wait complete. 2026-02-20T03:14:39.087 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:14:39.316 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:39 trial028 ceph-mon[38552]: pgmap v174: 129 pgs: 98 active+clean, 1 creating+activating, 7 creating+peering, 23 unknown; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s wr, 10 op/s 2026-02-20T03:14:39.316 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:39 trial028 ceph-mon[38552]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-20T03:14:39.317 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:39 trial028 ceph-mon[38552]: osdmap e89: 12 total, 12 up, 12 in 2026-02-20T03:14:39.317 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:39 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1467669689' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2026-02-20T03:14:39.317 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:39 trial028 ceph-mon[38552]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:39.317 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:39 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4045262520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:39.349 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:39.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.534+0000 7f121a881640 1 -- 10.20.193.28:0/3469235468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109220 msgr2=0x7f1214109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:39.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.534+0000 7f121a881640 1 --2- 10.20.193.28:0/3469235468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109220 0x7f1214109680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1204009a30 tx=0x7f120402f220 comp rx=0 tx=0).stop 2026-02-20T03:14:39.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.534+0000 7f121a881640 1 -- 10.20.193.28:0/3469235468 shutdown_connections 2026-02-20T03:14:39.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.534+0000 7f121a881640 1 --2- 10.20.193.28:0/3469235468 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1214109bc0 0x7f1214115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.534+0000 7f121a881640 1 --2- 10.20.193.28:0/3469235468 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109220 0x7f1214109680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.534+0000 7f121a881640 1 --2- 10.20.193.28:0/3469235468 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f121410f1e0 0x7f121410f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.534+0000 7f121a881640 1 -- 10.20.193.28:0/3469235468 >> 10.20.193.28:0/3469235468 conn(0x7f1214078860 msgr2=0x7f121407ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.534+0000 7f121a881640 1 -- 10.20.193.28:0/3469235468 shutdown_connections 2026-02-20T03:14:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.534+0000 7f121a881640 1 -- 10.20.193.28:0/3469235468 wait complete. 2026-02-20T03:14:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f121a881640 1 Processor -- start 2026-02-20T03:14:39.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f121a881640 1 -- start start 2026-02-20T03:14:39.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f121a881640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1214109220 0x7f1214074680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:39.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f121a881640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109bc0 0x7f1214074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:39.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f121a881640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121410f1e0 0x7f121406d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:39.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f121a881640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12141192f0 con 0x7f1214109bc0 2026-02-20T03:14:39.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f121a881640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1214119170 con 0x7f1214109220 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f121a881640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1214119470 con 0x7f121410f1e0 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f1213fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1214109220 0x7f1214074680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f12137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109bc0 0x7f1214074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f12137fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109bc0 0x7f1214074bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44492/0 (socket says 10.20.193.28:44492) 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f12137fe640 1 -- 10.20.193.28:0/1172860222 learned_addr learned my addr 10.20.193.28:0/1172860222 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f1218df7640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121410f1e0 0x7f121406d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f12137fe640 1 -- 10.20.193.28:0/1172860222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121410f1e0 msgr2=0x7f121406d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f12137fe640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121410f1e0 0x7f121406d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f12137fe640 1 -- 10.20.193.28:0/1172860222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1214109220 msgr2=0x7f1214074680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f12137fe640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1214109220 0x7f1214074680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:39.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.535+0000 7f12137fe640 1 -- 10.20.193.28:0/1172860222 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121406e0a0 con 0x7f1214109bc0 2026-02-20T03:14:39.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.536+0000 7f12137fe640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109bc0 0x7f1214074bc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f120402f730 tx=0x7f1204004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:39.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.536+0000 7f12117fa640 1 -- 10.20.193.28:0/1172860222 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204004550 con 0x7f1214109bc0 2026-02-20T03:14:39.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.536+0000 7f12117fa640 1 -- 10.20.193.28:0/1172860222 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1204038e20 con 0x7f1214109bc0 2026-02-20T03:14:39.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.536+0000 7f12117fa640 1 -- 10.20.193.28:0/1172860222 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204004b40 con 0x7f1214109bc0 2026-02-20T03:14:39.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.536+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121406e330 con 0x7f1214109bc0 2026-02-20T03:14:39.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.536+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1214072380 con 0x7f1214109bc0 2026-02-20T03:14:39.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.536+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121406e530 con 0x7f1214109bc0 2026-02-20T03:14:39.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.539+0000 7f12117fa640 1 -- 10.20.193.28:0/1172860222 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f12040052e0 con 0x7f1214109bc0 2026-02-20T03:14:39.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.541+0000 7f12117fa640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11e80b0e20 0x7f11e80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:39.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.541+0000 7f12117fa640 1 -- 10.20.193.28:0/1172860222 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f1204105140 con 0x7f1214109bc0 2026-02-20T03:14:39.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.541+0000 7f1213fff640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11e80b0e20 0x7f11e80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:39.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.541+0000 7f12117fa640 1 -- 10.20.193.28:0/1172860222 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f12041055c0 con 0x7f1214109bc0 2026-02-20T03:14:39.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.541+0000 7f1213fff640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11e80b0e20 0x7f11e80b32e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1200004680 tx=0x7f1200009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:39 trial126 ceph-mon[38476]: pgmap v174: 129 pgs: 98 active+clean, 1 creating+activating, 7 creating+peering, 23 unknown; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s wr, 10 op/s 2026-02-20T03:14:39.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:39 trial126 ceph-mon[38476]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-20T03:14:39.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:39 trial126 ceph-mon[38476]: osdmap e89: 12 total, 12 up, 12 in 2026-02-20T03:14:39.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:39 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1467669689' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2026-02-20T03:14:39.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:39 trial126 ceph-mon[38476]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:39.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:39 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4045262520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:39.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.633+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f121406ec40 con 0x7f1214109bc0 2026-02-20T03:14:39.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.634+0000 7f12117fa640 1 -- 10.20.193.28:0/1172860222 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7f12040cd720 con 0x7f1214109bc0 2026-02-20T03:14:39.638 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:39.638 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:14:39.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11e80b0e20 msgr2=0x7f11e80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:39.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11e80b0e20 0x7f11e80b32e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1200004680 tx=0x7f1200009290 comp rx=0 tx=0).stop 2026-02-20T03:14:39.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109bc0 msgr2=0x7f1214074bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:39.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109bc0 0x7f1214074bc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f120402f730 tx=0x7f1204004360 comp rx=0 tx=0).stop 2026-02-20T03:14:39.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 shutdown_connections 2026-02-20T03:14:39.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11e80b0e20 0x7f11e80b32e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:39.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121410f1e0 0x7f121406d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:39.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1214109bc0 0x7f1214074bc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:39.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 --2- 10.20.193.28:0/1172860222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1214109220 0x7f1214074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:39.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 >> 10.20.193.28:0/1172860222 conn(0x7f1214078860 msgr2=0x7f121407a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:39.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 shutdown_connections 2026-02-20T03:14:39.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:39.635+0000 7f121a881640 1 -- 10.20.193.28:0/1172860222 wait complete. 2026-02-20T03:14:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:39 trial177 ceph-mon[43181]: pgmap v174: 129 pgs: 98 active+clean, 1 creating+activating, 7 creating+peering, 23 unknown; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s wr, 10 op/s 2026-02-20T03:14:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:39 trial177 ceph-mon[43181]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2026-02-20T03:14:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:39 trial177 ceph-mon[43181]: osdmap e89: 12 total, 12 up, 12 in 2026-02-20T03:14:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1467669689' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2026-02-20T03:14:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:39 trial177 ceph-mon[43181]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:39.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4045262520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:39.740 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:14:40.002 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:40.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 -- 10.20.193.28:0/3362389033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f199810eef0 msgr2=0x7f199810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 --2- 10.20.193.28:0/3362389033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f199810eef0 0x7f199810f2d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1984009a30 tx=0x7f198402f220 comp rx=0 tx=0).stop 2026-02-20T03:14:40.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 -- 10.20.193.28:0/3362389033 shutdown_connections 2026-02-20T03:14:40.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 --2- 10.20.193.28:0/3362389033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1998109ba0 0x7f1998115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 --2- 10.20.193.28:0/3362389033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1998109220 0x7f1998109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 --2- 10.20.193.28:0/3362389033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f199810eef0 0x7f199810f2d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 -- 10.20.193.28:0/3362389033 >> 10.20.193.28:0/3362389033 conn(0x7f1998078600 msgr2=0x7f199807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:40.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 -- 10.20.193.28:0/3362389033 shutdown_connections 2026-02-20T03:14:40.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 -- 10.20.193.28:0/3362389033 wait complete. 2026-02-20T03:14:40.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 Processor -- start 2026-02-20T03:14:40.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.182+0000 7f199cb42640 1 -- start start 2026-02-20T03:14:40.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f199cb42640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1998109220 0x7f19981a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f199cb42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1998109ba0 0x7f19981a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f199cb42640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f199810eef0 0x7f19981a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f199cb42640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1998119080 con 0x7f1998109ba0 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f199cb42640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1998118f00 con 0x7f1998109220 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f199cb42640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1998119200 con 0x7f199810eef0 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f19977fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1998109220 0x7f19981a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f1996ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1998109ba0 0x7f19981a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f1996ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1998109ba0 0x7f19981a1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44518/0 (socket says 10.20.193.28:44518) 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f1996ffd640 1 -- 10.20.193.28:0/3345236959 learned_addr learned my addr 10.20.193.28:0/3345236959 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f1997fff640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f199810eef0 0x7f19981a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:40.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f1996ffd640 1 -- 10.20.193.28:0/3345236959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f199810eef0 msgr2=0x7f19981a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f1996ffd640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f199810eef0 0x7f19981a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f1996ffd640 1 -- 10.20.193.28:0/3345236959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1998109220 msgr2=0x7f19981a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f1996ffd640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1998109220 0x7f19981a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.183+0000 7f1996ffd640 1 -- 10.20.193.28:0/3345236959 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19981a6590 con 0x7f1998109ba0 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.184+0000 7f1996ffd640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1998109ba0 0x7f19981a1a80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f198800d950 tx=0x7f198800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.184+0000 7f1994ff9640 1 -- 10.20.193.28:0/3345236959 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988014070 con 0x7f1998109ba0 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.184+0000 7f1994ff9640 1 -- 10.20.193.28:0/3345236959 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f19880044e0 con 0x7f1998109ba0 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.184+0000 7f1994ff9640 1 -- 10.20.193.28:0/3345236959 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988010460 con 0x7f1998109ba0 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.184+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19981a6880 con 0x7f1998109ba0 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.184+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19981ae0c0 con 0x7f1998109ba0 2026-02-20T03:14:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.184+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f199810a580 con 0x7f1998109ba0 2026-02-20T03:14:40.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.187+0000 7f1994ff9640 1 -- 10.20.193.28:0/3345236959 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f19880026e0 con 0x7f1998109ba0 2026-02-20T03:14:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.188+0000 7f1994ff9640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f196c0b0da0 0x7f196c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.188+0000 7f1994ff9640 1 -- 10.20.193.28:0/3345236959 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f19880e0a40 con 0x7f1998109ba0 2026-02-20T03:14:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.189+0000 7f19977fe640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f196c0b0da0 0x7f196c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.189+0000 7f1994ff9640 1 -- 10.20.193.28:0/3345236959 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f19880e0e20 con 0x7f1998109ba0 2026-02-20T03:14:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.189+0000 7f19977fe640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f196c0b0da0 0x7f196c0b3260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f19840059c0 tx=0x7f1984005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:40.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.279+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1998109660 con 0x7f1998109ba0 2026-02-20T03:14:40.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.280+0000 7f1994ff9640 1 -- 10.20.193.28:0/3345236959 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7f1998109660 con 0x7f1998109ba0 2026-02-20T03:14:40.283 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:40.283 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:14:40.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f196c0b0da0 msgr2=0x7f196c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f196c0b0da0 0x7f196c0b3260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f19840059c0 tx=0x7f1984005950 comp rx=0 tx=0).stop 2026-02-20T03:14:40.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1998109ba0 msgr2=0x7f19981a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1998109ba0 0x7f19981a1a80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f198800d950 tx=0x7f198800de20 comp rx=0 tx=0).stop 2026-02-20T03:14:40.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 shutdown_connections 2026-02-20T03:14:40.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f196c0b0da0 0x7f196c0b3260 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f199810eef0 0x7f19981a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1998109ba0 0x7f19981a1a80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 --2- 10.20.193.28:0/3345236959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1998109220 0x7f19981a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 >> 10.20.193.28:0/3345236959 conn(0x7f1998078600 msgr2=0x7f1998079f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:40.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 shutdown_connections 2026-02-20T03:14:40.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.281+0000 7f199cb42640 1 -- 10.20.193.28:0/3345236959 wait complete. 2026-02-20T03:14:40.413 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:14:40.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:40 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1172860222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:40.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:40 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3345236959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:40.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:40 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1172860222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:40.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:40 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3345236959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:40.680 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:40.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:40 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1172860222' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:40.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:40 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3345236959' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:40.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.867+0000 7ff32f577640 1 -- 10.20.193.28:0/67211832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 msgr2=0x7ff330111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.867+0000 7ff32f577640 1 --2- 10.20.193.28:0/67211832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 0x7ff330111850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff32000b0d0 tx=0x7ff32002f450 comp rx=0 tx=0).stop 2026-02-20T03:14:40.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.867+0000 7ff32f577640 1 -- 10.20.193.28:0/67211832 shutdown_connections 2026-02-20T03:14:40.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.867+0000 7ff32f577640 1 --2- 10.20.193.28:0/67211832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 0x7ff330111850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.867+0000 7ff32f577640 1 --2- 10.20.193.28:0/67211832 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff330104980 0x7ff330104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.867+0000 7ff32f577640 1 --2- 10.20.193.28:0/67211832 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff33010a980 0x7ff33010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.867+0000 7ff32f577640 1 -- 10.20.193.28:0/67211832 >> 10.20.193.28:0/67211832 conn(0x7ff330100680 msgr2=0x7ff330102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:40.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.868+0000 7ff32f577640 1 -- 10.20.193.28:0/67211832 shutdown_connections 2026-02-20T03:14:40.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.868+0000 7ff32f577640 1 -- 10.20.193.28:0/67211832 wait complete. 2026-02-20T03:14:40.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.868+0000 7ff32f577640 1 Processor -- start 2026-02-20T03:14:40.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32f577640 1 -- start start 2026-02-20T03:14:40.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32f577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff330104980 0x7ff33019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:40.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 0x7ff33019d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:40.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff33010a980 0x7ff3301a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:40.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff330114bf0 con 0x7ff330105320 2026-02-20T03:14:40.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32f577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff330114a70 con 0x7ff330104980 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32f577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff330114d70 con 0x7ff33010a980 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 0x7ff33019d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 0x7ff33019d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44532/0 (socket says 10.20.193.28:44532) 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32dd74640 1 -- 10.20.193.28:0/1845649265 learned_addr learned my addr 10.20.193.28:0/1845649265 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32e575640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff330104980 0x7ff33019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32ed76640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff33010a980 0x7ff3301a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32dd74640 1 -- 10.20.193.28:0/1845649265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff33010a980 msgr2=0x7ff3301a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32dd74640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff33010a980 0x7ff3301a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32dd74640 1 -- 10.20.193.28:0/1845649265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff330104980 msgr2=0x7ff33019cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32dd74640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff330104980 0x7ff33019cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.869+0000 7ff32dd74640 1 -- 10.20.193.28:0/1845649265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3301a2040 con 0x7ff330105320 2026-02-20T03:14:40.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.870+0000 7ff32dd74640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 0x7ff33019d530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff31800d950 tx=0x7ff31800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:40.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.870+0000 7ff3177fe640 1 -- 10.20.193.28:0/1845649265 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318014070 con 0x7ff330105320 2026-02-20T03:14:40.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.870+0000 7ff3177fe640 1 -- 10.20.193.28:0/1845649265 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff3180044e0 con 0x7ff330105320 2026-02-20T03:14:40.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.870+0000 7ff3177fe640 1 -- 10.20.193.28:0/1845649265 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff318010460 con 0x7ff330105320 2026-02-20T03:14:40.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.870+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3301a2330 con 0x7ff330105320 2026-02-20T03:14:40.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.870+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3301a9b70 con 0x7ff330105320 2026-02-20T03:14:40.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.871+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff330104de0 con 0x7ff330105320 2026-02-20T03:14:40.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.872+0000 7ff3177fe640 1 -- 10.20.193.28:0/1845649265 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7ff3180026e0 con 0x7ff330105320 2026-02-20T03:14:40.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.874+0000 7ff3177fe640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3080b0e20 0x7ff3080b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:40.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.874+0000 7ff3177fe640 1 -- 10.20.193.28:0/1845649265 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ff3180e0b20 con 0x7ff330105320 2026-02-20T03:14:40.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.874+0000 7ff32e575640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3080b0e20 0x7ff3080b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:40.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.874+0000 7ff3177fe640 1 -- 10.20.193.28:0/1845649265 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff318110bc0 con 0x7ff330105320 2026-02-20T03:14:40.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.875+0000 7ff32e575640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3080b0e20 0x7ff3080b32e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff324005fd0 tx=0x7ff324002d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:40.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.981+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff33019e350 con 0x7ff330105320 2026-02-20T03:14:40.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.982+0000 7ff3177fe640 1 -- 10.20.193.28:0/1845649265 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+11849 (secure 0 0 0) 0x7ff33019e350 con 0x7ff330105320 2026-02-20T03:14:40.985 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:40.985 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 14 2026-02-20T03:14:40.986 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":14,"btime":"2026-02-20T03:14:38:309089+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24515,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24517,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24523,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24538,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:14:37.971182+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24560},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24560,"qdb_cluster":[24560]},"id":1}]} 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3080b0e20 msgr2=0x7ff3080b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3080b0e20 0x7ff3080b32e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff324005fd0 tx=0x7ff324002d90 comp rx=0 tx=0).stop 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 msgr2=0x7ff33019d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 0x7ff33019d530 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff31800d950 tx=0x7ff31800de20 comp rx=0 tx=0).stop 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 shutdown_connections 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3080b0e20 0x7ff3080b32e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff33010a980 0x7ff3301a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff330105320 0x7ff33019d530 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 --2- 10.20.193.28:0/1845649265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff330104980 0x7ff33019cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:40.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 >> 10.20.193.28:0/1845649265 conn(0x7ff330100680 msgr2=0x7ff330101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:40.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 shutdown_connections 2026-02-20T03:14:40.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:40.983+0000 7ff32f577640 1 -- 10.20.193.28:0/1845649265 wait complete. 2026-02-20T03:14:41.085 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:14:41.354 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:41.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.527+0000 7f1b4dc16640 1 -- 10.20.193.28:0/3929508721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b481030a0 msgr2=0x7f1b4810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:41.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.527+0000 7f1b4dc16640 1 --2- 10.20.193.28:0/3929508721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b481030a0 0x7f1b4810f5d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400b0d0 tx=0x7f1b4402f450 comp rx=0 tx=0).stop 2026-02-20T03:14:41.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.527+0000 7f1b4dc16640 1 -- 10.20.193.28:0/3929508721 shutdown_connections 2026-02-20T03:14:41.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.527+0000 7f1b4dc16640 1 --2- 10.20.193.28:0/3929508721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b481030a0 0x7f1b4810f5d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:41.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.527+0000 7f1b4dc16640 1 --2- 10.20.193.28:0/3929508721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b48102700 0x7f1b48102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:41.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.527+0000 7f1b4dc16640 1 --2- 10.20.193.28:0/3929508721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b48108700 0x7f1b48108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:41.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.527+0000 7f1b4dc16640 1 -- 10.20.193.28:0/3929508721 >> 10.20.193.28:0/3929508721 conn(0x7f1b480fe440 msgr2=0x7f1b48100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:41.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.527+0000 7f1b4dc16640 1 -- 10.20.193.28:0/3929508721 shutdown_connections 2026-02-20T03:14:41.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.527+0000 7f1b4dc16640 1 -- 10.20.193.28:0/3929508721 wait complete. 2026-02-20T03:14:41.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.528+0000 7f1b4dc16640 1 Processor -- start 2026-02-20T03:14:41.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.528+0000 7f1b4dc16640 1 -- start start 2026-02-20T03:14:41.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4dc16640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b48102700 0x7f1b4819cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:41.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4dc16640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b481030a0 0x7f1b4819d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:41.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4dc16640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b48108700 0x7f1b481a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:41.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4dc16640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b48112970 con 0x7f1b48102700 2026-02-20T03:14:41.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4dc16640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b481127f0 con 0x7f1b481030a0 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4dc16640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b48112af0 con 0x7f1b48108700 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4cc14640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b48102700 0x7f1b4819cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4cc14640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b48102700 0x7f1b4819cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44562/0 (socket says 10.20.193.28:44562) 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4cc14640 1 -- 10.20.193.28:0/1906405827 learned_addr learned my addr 10.20.193.28:0/1906405827 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b3ffff640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b481030a0 0x7f1b4819d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4d415640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b48108700 0x7f1b481a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4cc14640 1 -- 10.20.193.28:0/1906405827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b48108700 msgr2=0x7f1b481a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4cc14640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b48108700 0x7f1b481a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4cc14640 1 -- 10.20.193.28:0/1906405827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b481030a0 msgr2=0x7f1b4819d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4cc14640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b481030a0 0x7f1b4819d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4cc14640 1 -- 10.20.193.28:0/1906405827 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b481a2010 con 0x7f1b48102700 2026-02-20T03:14:41.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b3ffff640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b481030a0 0x7f1b4819d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:14:41.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4cc14640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b48102700 0x7f1b4819cfc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d950 tx=0x7f1b3800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:41.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b3dffb640 1 -- 10.20.193.28:0/1906405827 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38014070 con 0x7f1b48102700 2026-02-20T03:14:41.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b3dffb640 1 -- 10.20.193.28:0/1906405827 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b380044e0 con 0x7f1b48102700 2026-02-20T03:14:41.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b3dffb640 1 -- 10.20.193.28:0/1906405827 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b38010460 con 0x7f1b48102700 2026-02-20T03:14:41.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.529+0000 7f1b4dc16640 1 -- 10.20.193.28:0/1906405827 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b481a2300 con 0x7f1b48102700 2026-02-20T03:14:41.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.530+0000 7f1b4dc16640 1 -- 10.20.193.28:0/1906405827 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b481a9b40 con 0x7f1b48102700 2026-02-20T03:14:41.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.531+0000 7f1b177fe640 1 -- 10.20.193.28:0/1906405827 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b48102b60 con 0x7f1b48102700 2026-02-20T03:14:41.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.532+0000 7f1b3dffb640 1 -- 10.20.193.28:0/1906405827 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f1b380026e0 con 0x7f1b48102700 2026-02-20T03:14:41.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.534+0000 7f1b3dffb640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b240b0e20 0x7f1b240b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:41.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.534+0000 7f1b3dffb640 1 -- 10.20.193.28:0/1906405827 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f1b380e0ab0 con 0x7f1b48102700 2026-02-20T03:14:41.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.534+0000 7f1b3ffff640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b240b0e20 0x7f1b240b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:41.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.534+0000 7f1b3dffb640 1 -- 10.20.193.28:0/1906405827 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1b380a9090 con 0x7f1b48102700 2026-02-20T03:14:41.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.535+0000 7f1b3ffff640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b240b0e20 0x7f1b240b32e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b4810ee10 tx=0x7f1b30005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:41.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:41 trial126 ceph-mon[38476]: pgmap v176: 129 pgs: 114 active+clean, 1 creating+activating, 7 creating+peering, 7 unknown; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s wr, 4 op/s 2026-02-20T03:14:41.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:41 trial126 ceph-mon[38476]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-20T03:14:41.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:41 trial126 ceph-mon[38476]: Cluster is now healthy 2026-02-20T03:14:41.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:41 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1845649265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:41 trial028 ceph-mon[38552]: pgmap v176: 129 pgs: 114 active+clean, 1 creating+activating, 7 creating+peering, 7 unknown; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s wr, 4 op/s 2026-02-20T03:14:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:41 trial028 ceph-mon[38552]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-20T03:14:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:41 trial028 ceph-mon[38552]: Cluster is now healthy 2026-02-20T03:14:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:41 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1845649265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:41.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.625+0000 7f1b177fe640 1 -- 10.20.193.28:0/1906405827 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b48063880 con 0x7f1b48102700 2026-02-20T03:14:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.626+0000 7f1b3dffb640 1 -- 10.20.193.28:0/1906405827 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7f1b380acd40 con 0x7f1b48102700 2026-02-20T03:14:41.629 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:41.629 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:14:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 -- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b240b0e20 msgr2=0x7f1b240b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b240b0e20 0x7f1b240b32e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1b4810ee10 tx=0x7f1b30005f50 comp rx=0 tx=0).stop 2026-02-20T03:14:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 -- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b48102700 msgr2=0x7f1b4819cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b48102700 0x7f1b4819cfc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800d950 tx=0x7f1b3800de20 comp rx=0 tx=0).stop 2026-02-20T03:14:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 -- 10.20.193.28:0/1906405827 shutdown_connections 2026-02-20T03:14:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b240b0e20 0x7f1b240b32e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b48108700 0x7f1b481a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b481030a0 0x7f1b4819d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 --2- 10.20.193.28:0/1906405827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b48102700 0x7f1b4819cfc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 -- 10.20.193.28:0/1906405827 >> 10.20.193.28:0/1906405827 conn(0x7f1b480fe440 msgr2=0x7f1b4810daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 -- 10.20.193.28:0/1906405827 shutdown_connections 2026-02-20T03:14:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:41.627+0000 7f1b177fe640 1 -- 10.20.193.28:0/1906405827 wait complete. 2026-02-20T03:14:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:41 trial177 ceph-mon[43181]: pgmap v176: 129 pgs: 114 active+clean, 1 creating+activating, 7 creating+peering, 7 unknown; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s wr, 4 op/s 2026-02-20T03:14:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:41 trial177 ceph-mon[43181]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2026-02-20T03:14:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:41 trial177 ceph-mon[43181]: Cluster is now healthy 2026-02-20T03:14:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:41 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1845649265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:41.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-20T03:14:32.740764+0000', 'modified': '2026-02-20T03:14:37.971182+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24560}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.126:6839/2074063114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6838', 'nonce': 2074063114}, {'type': 'v1', 'addr': '10.20.193.126:6839', 'nonce': 2074063114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24560, 'qdb_cluster': [24560]} 2026-02-20T03:14:41.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-20T03:14:41.732 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.b status 2026-02-20T03:14:41.997 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:42.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.172+0000 7f438ea34640 1 -- 10.20.193.28:0/1111026471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388104da0 msgr2=0x7f4388105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.172+0000 7f438ea34640 1 --2- 10.20.193.28:0/1111026471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388104da0 0x7f4388105180 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4374009a30 tx=0x7f437402f220 comp rx=0 tx=0).stop 2026-02-20T03:14:42.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.172+0000 7f438ea34640 1 -- 10.20.193.28:0/1111026471 shutdown_connections 2026-02-20T03:14:42.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.172+0000 7f438ea34640 1 --2- 10.20.193.28:0/1111026471 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4388109ed0 0x7f4388111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.172+0000 7f438ea34640 1 --2- 10.20.193.28:0/1111026471 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4388105750 0x7f43881097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.172+0000 7f438ea34640 1 --2- 10.20.193.28:0/1111026471 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388104da0 0x7f4388105180 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.172+0000 7f438ea34640 1 -- 10.20.193.28:0/1111026471 >> 10.20.193.28:0/1111026471 conn(0x7f4388100840 msgr2=0x7f4388102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.172+0000 7f438ea34640 1 -- 10.20.193.28:0/1111026471 shutdown_connections 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.172+0000 7f438ea34640 1 -- 10.20.193.28:0/1111026471 wait complete. 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.173+0000 7f438ea34640 1 Processor -- start 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.173+0000 7f438ea34640 1 -- start start 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.173+0000 7f438ea34640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4388104da0 0x7f438819d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.173+0000 7f438ea34640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4388105750 0x7f438819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.173+0000 7f438ea34640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388109ed0 0x7f43881a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438ea34640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4388114d20 con 0x7f4388109ed0 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438ea34640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4388114ba0 con 0x7f4388105750 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438ea34640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4388114ea0 con 0x7f4388104da0 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438cfaa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388109ed0 0x7f43881a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438cfaa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388109ed0 0x7f43881a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44574/0 (socket says 10.20.193.28:44574) 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438cfaa640 1 -- 10.20.193.28:0/2262446636 learned_addr learned my addr 10.20.193.28:0/2262446636 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f4387fff640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4388104da0 0x7f438819d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f43877fe640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4388105750 0x7f438819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438cfaa640 1 -- 10.20.193.28:0/2262446636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4388104da0 msgr2=0x7f438819d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438cfaa640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4388104da0 0x7f438819d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438cfaa640 1 -- 10.20.193.28:0/2262446636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4388105750 msgr2=0x7f438819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438cfaa640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4388105750 0x7f438819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438cfaa640 1 -- 10.20.193.28:0/2262446636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43881a2270 con 0x7f4388109ed0 2026-02-20T03:14:42.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438cfaa640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388109ed0 0x7f43881a1af0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f437c004820 tx=0x7f437c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:42.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f43857fa640 1 -- 10.20.193.28:0/2262446636 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c0090d0 con 0x7f4388109ed0 2026-02-20T03:14:42.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f43857fa640 1 -- 10.20.193.28:0/2262446636 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f437c009270 con 0x7f4388109ed0 2026-02-20T03:14:42.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438ea34640 1 -- 10.20.193.28:0/2262446636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43881a2500 con 0x7f4388109ed0 2026-02-20T03:14:42.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.174+0000 7f438ea34640 1 -- 10.20.193.28:0/2262446636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43881a9da0 con 0x7f4388109ed0 2026-02-20T03:14:42.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.175+0000 7f43857fa640 1 -- 10.20.193.28:0/2262446636 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c013810 con 0x7f4388109ed0 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.177+0000 7f43857fa640 1 -- 10.20.193.28:0/2262446636 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f437c012070 con 0x7f4388109ed0 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.178+0000 7f4390f39e00 1 Processor -- start 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.178+0000 7f4390f39e00 1 -- start start 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.178+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f39b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.178+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f395530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.178+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f395fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.178+0000 7f4390f39e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56109f2d7770 con 0x56109f39aec0 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.178+0000 7f4390f39e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56109f284f80 con 0x56109f39b870 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.178+0000 7f4390f39e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56109f2d36a0 con 0x56109f395b50 2026-02-20T03:14:42.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f39b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f39b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44582/0 (socket says 10.20.193.28:44582) 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 -- 10.20.193.28:0/68018251 learned_addr learned my addr 10.20.193.28:0/68018251 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f4387fff640 1 --2- 10.20.193.28:0/68018251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f395530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 --2- 10.20.193.28:0/68018251 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f395fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43857fa640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f435c0b0da0 0x7f435c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 -- 10.20.193.28:0/68018251 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 msgr2=0x56109f395fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 --2- 10.20.193.28:0/68018251 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f395fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 -- 10.20.193.28:0/68018251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 msgr2=0x56109f395530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 --2- 10.20.193.28:0/68018251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f395530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 -- 10.20.193.28:0/68018251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109f277180 con 0x56109f39aec0 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43857fa640 1 -- 10.20.193.28:0/2262446636 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f437c0e0200 con 0x7f4388109ed0 2026-02-20T03:14:42.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f438cfaa640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f435c0b0da0 0x7f435c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f43877fe640 1 --2- 10.20.193.28:0/68018251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f39b2a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4378005fd0 tx=0x7f437802fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb447f6e0f1fc9c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f4358ce3640 1 -- 10.20.193.28:0/68018251 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437802eae0 con 0x56109f39aec0 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f4358ce3640 1 -- 10.20.193.28:0/68018251 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4378033070 con 0x56109f39aec0 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.179+0000 7f4358ce3640 1 -- 10.20.193.28:0/68018251 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437802f4f0 con 0x56109f39aec0 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f4390f39e00 1 -- 10.20.193.28:0/68018251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 msgr2=0x56109f39b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f4390f39e00 1 --2- 10.20.193.28:0/68018251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f39b2a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4378005fd0 tx=0x7f437802fe80 comp rx=0 tx=0).stop 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f438cfaa640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f435c0b0da0 0x7f435c0b3260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f437c0090a0 tx=0x7f437c0097e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f4390f39e00 1 -- 10.20.193.28:0/68018251 shutdown_connections 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f4390f39e00 1 --2- 10.20.193.28:0/68018251 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f395fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f4390f39e00 1 --2- 10.20.193.28:0/68018251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f395530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f4390f39e00 1 --2- 10.20.193.28:0/68018251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f39b2a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f4390f39e00 1 -- 10.20.193.28:0/68018251 >> 10.20.193.28:0/68018251 conn(0x56109f37cdb0 msgr2=0x56109f382640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:42.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f4390f39e00 1 -- 10.20.193.28:0/68018251 shutdown_connections 2026-02-20T03:14:42.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.180+0000 7f4390f39e00 1 -- 10.20.193.28:0/68018251 wait complete. 2026-02-20T03:14:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.181+0000 7f4390f39e00 1 -- start start 2026-02-20T03:14:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.181+0000 7f4390f39e00 1 Processor -- start 2026-02-20T03:14:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f395b50 0x56109f390bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39aec0 0x56109f391130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f39b870 0x56109f391670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f4390f39e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56109f27ed60 con 0x56109f395b50 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f4390f39e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56109f3842e0 con 0x56109f39aec0 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f4390f39e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56109f3a92a0 con 0x56109f39b870 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f4387fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39aec0 0x56109f391130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f43877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f395b50 0x56109f390bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f43877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f395b50 0x56109f390bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44598/0 (socket says 10.20.193.28:44598) 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f4387fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39aec0 0x56109f391130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:46200/0 (socket says 10.20.193.28:46200) 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.182+0000 7f4387fff640 1 -- 10.20.193.28:0/1468816612 learned_addr learned my addr 10.20.193.28:0/1468816612 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f43877fe640 1 -- 10.20.193.28:0/1468816612 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f39b870 msgr2=0x56109f391670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:14:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f43877fe640 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f39b870 0x56109f391670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f43877fe640 1 -- 10.20.193.28:0/1468816612 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39aec0 msgr2=0x56109f391130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f43877fe640 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39aec0 0x56109f391130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f43877fe640 1 -- 10.20.193.28:0/1468816612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109f38a010 con 0x56109f395b50 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f43877fe640 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f395b50 0x56109f390bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f437802f110 tx=0x7f4378007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69a87cf9c2ddd19 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f4349ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f4349ffb640 1 -- 10.20.193.28:0/1468816612 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437804b070 con 0x56109f395b50 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f4349ffb640 1 -- 10.20.193.28:0/1468816612 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f43780042a0 con 0x56109f395b50 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f4349ffb640 1 -- 10.20.193.28:0/1468816612 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378046410 con 0x56109f395b50 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.183+0000 7f4390f39e00 1 -- 10.20.193.28:0/1468816612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109f0a8a50 con 0x56109f395b50 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 10 client.14607 _ll_register_callbacks cb 0x56109f28c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 1 -- 10.20.193.28:0/1468816612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56109f2e5110 con 0x56109f395b50 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4349ffb640 1 -- 10.20.193.28:0/1468816612 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f4378007a30 con 0x56109f395b50 2026-02-20T03:14:42.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4349ffb640 1 -- 10.20.193.28:0/1468816612 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f437802f250 con 0x56109f395b50 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 10 client.14607 fetch_fsmap learned FSMap version 14 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 1 -- 10.20.193.28:0/1468816612 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=14}) -- 0x56109f27d720 con 0x56109f395b50 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4349ffb640 1 -- 10.20.193.28:0/1468816612 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 14) ==== 8350+0+0 (secure 0 0 0) 0x7f437802f3f0 con 0x56109f395b50 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 10 client.14607 fetch_fsmap finished waiting for FSMap version 14 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 10 client.14607 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 20 client.14607 populate_metadata read hostname 'trial028' 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56109f3ae0e0 0x56109f3af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 4 client.14607 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.184+0000 7f4390f39e00 1 -- 10.20.193.28:0/1468816612 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56109f2df360 con 0x56109f3ae0e0 2026-02-20T03:14:42.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.185+0000 7f4387fff640 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56109f3ae0e0 0x56109f3af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.186+0000 7f4387fff640 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56109f3ae0e0 0x56109f3af550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f415925898236396 server_cookie=6166356774e0d0ec in_seq=0 out_seq=0 2026-02-20T03:14:42.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.186+0000 7f4349ffb640 10 client.14607 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:14:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.186+0000 7f4349ffb640 1 -- 10.20.193.28:0/1468816612 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56109f2df360 con 0x56109f3ae0e0 2026-02-20T03:14:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.186+0000 7f4349ffb640 10 client.14607 handle_command_reply: tid=0 2026-02-20T03:14:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.186+0000 7f4390f39e00 1 client.14607 shutdown 2026-02-20T03:14:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 -- 10.20.193.28:0/1468816612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f395b50 msgr2=0x56109f390bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f395b50 0x56109f390bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f437802f110 tx=0x7f4378007eb0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 -- 10.20.193.28:0/1468816612 shutdown_connections 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56109f3ae0e0 0x56109f3af550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f39b870 0x56109f391670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39aec0 0x56109f391130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 --2- 10.20.193.28:0/1468816612 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f395b50 0x56109f390bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 -- 10.20.193.28:0/1468816612 >> 10.20.193.28:0/1468816612 conn(0x56109f37cdb0 msgr2=0x56109f382d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4349ffb640 0 client.14607 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 -- 10.20.193.28:0/1468816612 shutdown_connections 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 1 -- 10.20.193.28:0/1468816612 wait complete. 2026-02-20T03:14:42.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.187+0000 7f4390f39e00 20 client.14607 trim_cache size 0 max 16384 2026-02-20T03:14:42.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4390f39e00 1 Processor -- start 2026-02-20T03:14:42.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4390f39e00 1 -- start start 2026-02-20T03:14:42.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f38e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f382e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4390f39e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56109f3ad890 con 0x56109f39aec0 2026-02-20T03:14:42.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4390f39e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56109f3adf60 con 0x56109f39b870 2026-02-20T03:14:42.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4390f39e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56109f3ae630 con 0x56109f395b50 2026-02-20T03:14:42.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4387fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f38e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4387fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f38e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44610/0 (socket says 10.20.193.28:44610) 2026-02-20T03:14:42.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4387fff640 1 -- 10.20.193.28:0/3864662869 learned_addr learned my addr 10.20.193.28:0/3864662869 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:42.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f43877fe640 1 --2- 10.20.193.28:0/3864662869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4387fff640 1 -- 10.20.193.28:0/3864662869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 msgr2=0x56109f3aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:14:42.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4387fff640 1 --2- 10.20.193.28:0/3864662869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4387fff640 1 -- 10.20.193.28:0/3864662869 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 msgr2=0x56109f382e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:14:42.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4387fff640 1 --2- 10.20.193.28:0/3864662869 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f382e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4387fff640 1 -- 10.20.193.28:0/3864662869 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109f389e40 con 0x56109f39aec0 2026-02-20T03:14:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f43877fe640 1 --2- 10.20.193.28:0/3864662869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:14:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.197+0000 7f4387fff640 1 --2- 10.20.193.28:0/3864662869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f38e4b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4374009950 tx=0x7f437402fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb242fa41cd9c034 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:42.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f434bfff640 1 -- 10.20.193.28:0/3864662869 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374004250 con 0x56109f39aec0 2026-02-20T03:14:42.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f434bfff640 1 -- 10.20.193.28:0/3864662869 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4374033040 con 0x56109f39aec0 2026-02-20T03:14:42.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f434bfff640 1 -- 10.20.193.28:0/3864662869 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43740389d0 con 0x56109f39aec0 2026-02-20T03:14:42.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f4390f39e00 1 -- 10.20.193.28:0/3864662869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 msgr2=0x56109f38e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f4390f39e00 1 --2- 10.20.193.28:0/3864662869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f38e4b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4374009950 tx=0x7f437402fe10 comp rx=0 tx=0).stop 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f4390f39e00 1 -- 10.20.193.28:0/3864662869 shutdown_connections 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f4390f39e00 1 --2- 10.20.193.28:0/3864662869 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f382e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f4390f39e00 1 --2- 10.20.193.28:0/3864662869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f38e4b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f4390f39e00 1 --2- 10.20.193.28:0/3864662869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f4390f39e00 1 -- 10.20.193.28:0/3864662869 >> 10.20.193.28:0/3864662869 conn(0x56109f37cdb0 msgr2=0x56109f399f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f4390f39e00 1 -- 10.20.193.28:0/3864662869 shutdown_connections 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.198+0000 7f4390f39e00 1 -- 10.20.193.28:0/3864662869 wait complete. 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4390f39e00 1 -- start start 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4390f39e00 1 Processor -- start 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f3a8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4390f39e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f3a4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4390f39e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56109f3af3d0 con 0x56109f39aec0 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4390f39e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56109f3aed00 con 0x56109f39b870 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4390f39e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56109f3afaa0 con 0x56109f395b50 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4387fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f3a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4387fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f3a8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44626/0 (socket says 10.20.193.28:44626) 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.199+0000 7f4387fff640 1 -- 10.20.193.28:0/2231472862 learned_addr learned my addr 10.20.193.28:0/2231472862 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f43877fe640 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4387fff640 1 -- 10.20.193.28:0/2231472862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 msgr2=0x56109f3a81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4387fff640 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3a81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4387fff640 1 -- 10.20.193.28:0/2231472862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 msgr2=0x56109f3a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4387fff640 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f3a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4387fff640 1 -- 10.20.193.28:0/2231472862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109efb6780 con 0x56109f39aec0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f43877fe640 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4387fff640 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f3a8700 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f437402f730 tx=0x7f4374009320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c7a899df015cdd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4349ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4349ffb640 1 -- 10.20.193.28:0/2231472862 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43740049d0 con 0x56109f39aec0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4349ffb640 1 -- 10.20.193.28:0/2231472862 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f43740044f0 con 0x56109f39aec0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4390f39e00 1 -- 10.20.193.28:0/2231472862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109f29d5f0 con 0x56109f39aec0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4390f39e00 10 client.14613 _ll_register_callbacks cb 0x7f43780045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4390f39e00 1 -- 10.20.193.28:0/2231472862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56109f34cca0 con 0x56109f39aec0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4349ffb640 1 -- 10.20.193.28:0/2231472862 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4374005000 con 0x56109f39aec0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4349ffb640 1 -- 10.20.193.28:0/2231472862 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f4374005220 con 0x56109f39aec0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4349ffb640 1 -- 10.20.193.28:0/2231472862 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f4374005540 con 0x56109f39aec0 2026-02-20T03:14:42.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4390f39e00 10 client.14613 fetch_fsmap learned FSMap version 14 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.200+0000 7f4390f39e00 1 -- 10.20.193.28:0/2231472862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=14}) -- 0x56109f38ab30 con 0x56109f39aec0 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.201+0000 7f4349ffb640 1 -- 10.20.193.28:0/2231472862 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 14) ==== 8350+0+0 (secure 0 0 0) 0x7f4374004050 con 0x56109f39aec0 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.201+0000 7f4390f39e00 10 client.14613 fetch_fsmap finished waiting for FSMap version 14 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.201+0000 7f4390f39e00 10 client.14613 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.201+0000 7f4390f39e00 20 client.14613 populate_metadata read hostname 'trial028' 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.201+0000 7f4390f39e00 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56109f41e270 0x56109f41c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.201+0000 7f4390f39e00 4 client.14613 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.201+0000 7f4390f39e00 1 -- 10.20.193.28:0/2231472862 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "status"}) -- 0x7f4374033040 con 0x56109f41e270 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.201+0000 7f43877fe640 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56109f41e270 0x56109f41c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f43877fe640 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56109f41e270 0x56109f41c970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1593d464e26b6bfb server_cookie=8389141faaee4212 in_seq=0 out_seq=0 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4349ffb640 10 client.14613 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:14:42.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4349ffb640 1 -- 10.20.193.28:0/2231472862 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x7f4374033040 con 0x56109f41e270 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4349ffb640 10 client.14613 handle_command_reply: tid=0 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 client.14613 shutdown 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 -- 10.20.193.28:0/2231472862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 msgr2=0x56109f3a8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f3a8700 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f437402f730 tx=0x7f4374009320 comp rx=0 tx=0).stop 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 -- 10.20.193.28:0/2231472862 shutdown_connections 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56109f41e270 0x56109f41c970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56109f39b870 0x56109f3a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56109f39aec0 0x56109f3a8700 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 --2- 10.20.193.28:0/2231472862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56109f395b50 0x56109f3a81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4349ffb640 0 client.14613 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 -- 10.20.193.28:0/2231472862 >> 10.20.193.28:0/2231472862 conn(0x56109f37cdb0 msgr2=0x56109f392070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 -- 10.20.193.28:0/2231472862 shutdown_connections 2026-02-20T03:14:42.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 1 -- 10.20.193.28:0/2231472862 wait complete. 2026-02-20T03:14:42.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.202+0000 7f4390f39e00 20 client.14613 trim_cache size 0 max 16384 2026-02-20T03:14:42.211 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:14:42.211 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:14:42.211 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 0, 2026-02-20T03:14:42.211 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24560, 2026-02-20T03:14:42.211 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:14:42.211 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:14:42.212 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:14:42.212 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 8.9158038289999997, 2026-02-20T03:14:42.212 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 14, 2026-02-20T03:14:42.212 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 89, 2026-02-20T03:14:42.212 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 89, 2026-02-20T03:14:42.212 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 14.829125269 2026-02-20T03:14:42.212 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:14:42.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 -- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f435c0b0da0 msgr2=0x7f435c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f435c0b0da0 0x7f435c0b3260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f437c0090a0 tx=0x7f437c0097e0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 -- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388109ed0 msgr2=0x7f43881a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388109ed0 0x7f43881a1af0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f437c004820 tx=0x7f437c00d4a0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 -- 10.20.193.28:0/2262446636 shutdown_connections 2026-02-20T03:14:42.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f435c0b0da0 0x7f435c0b3260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4388109ed0 0x7f43881a1af0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4388105750 0x7f438819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 --2- 10.20.193.28:0/2262446636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4388104da0 0x7f438819d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 -- 10.20.193.28:0/2262446636 >> 10.20.193.28:0/2262446636 conn(0x7f4388100840 msgr2=0x7f4388101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:42.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 -- 10.20.193.28:0/2262446636 shutdown_connections 2026-02-20T03:14:42.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.203+0000 7f438ea34640 1 -- 10.20.193.28:0/2262446636 wait complete. 2026-02-20T03:14:42.342 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-20T03:14:42.342 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2026-02-20T03:14:42.343 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs ls 2026-02-20T03:14:42.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:42 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1906405827' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:42.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:42 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1906405827' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:42.603 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:42.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:42 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1906405827' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.778+0000 7fb659b46640 1 -- 10.20.193.28:0/1809600827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410d5a0 msgr2=0x7fb65410da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.778+0000 7fb659b46640 1 --2- 10.20.193.28:0/1809600827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410d5a0 0x7fb65410da20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb644009a30 tx=0x7fb64402f220 comp rx=0 tx=0).stop 2026-02-20T03:14:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.778+0000 7fb659b46640 1 -- 10.20.193.28:0/1809600827 shutdown_connections 2026-02-20T03:14:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.778+0000 7fb659b46640 1 --2- 10.20.193.28:0/1809600827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb65410df60 0x7fb65411a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.778+0000 7fb659b46640 1 --2- 10.20.193.28:0/1809600827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410d5a0 0x7fb65410da20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.778+0000 7fb659b46640 1 --2- 10.20.193.28:0/1809600827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb654113600 0x7fb6541139e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.778+0000 7fb659b46640 1 -- 10.20.193.28:0/1809600827 >> 10.20.193.28:0/1809600827 conn(0x7fb65406d5c0 msgr2=0x7fb65406d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.778+0000 7fb659b46640 1 -- 10.20.193.28:0/1809600827 shutdown_connections 2026-02-20T03:14:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.778+0000 7fb659b46640 1 -- 10.20.193.28:0/1809600827 wait complete. 2026-02-20T03:14:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb659b46640 1 Processor -- start 2026-02-20T03:14:42.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb659b46640 1 -- start start 2026-02-20T03:14:42.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb659b46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb65410d5a0 0x7fb6541ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb659b46640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410df60 0x7fb6541abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb659b46640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb654113600 0x7fb6541a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb659b46640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb65411d760 con 0x7fb65410df60 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb659b46640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb65411d5e0 con 0x7fb654113600 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb659b46640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb65411d8e0 con 0x7fb65410d5a0 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb652ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410df60 0x7fb6541abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb652ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410df60 0x7fb6541abcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44640/0 (socket says 10.20.193.28:44640) 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb652ffd640 1 -- 10.20.193.28:0/2949956124 learned_addr learned my addr 10.20.193.28:0/2949956124 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb653fff640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb654113600 0x7fb6541a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.779+0000 7fb6537fe640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb65410d5a0 0x7fb6541ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb652ffd640 1 -- 10.20.193.28:0/2949956124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb65410d5a0 msgr2=0x7fb6541ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb652ffd640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb65410d5a0 0x7fb6541ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb652ffd640 1 -- 10.20.193.28:0/2949956124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb654113600 msgr2=0x7fb6541a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb652ffd640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb654113600 0x7fb6541a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb652ffd640 1 -- 10.20.193.28:0/2949956124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6541a6120 con 0x7fb65410df60 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb652ffd640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410df60 0x7fb6541abcd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb64402f730 tx=0x7fb64402fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb650ff9640 1 -- 10.20.193.28:0/2949956124 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644004240 con 0x7fb65410df60 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb650ff9640 1 -- 10.20.193.28:0/2949956124 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb6440043e0 con 0x7fb65410df60 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb650ff9640 1 -- 10.20.193.28:0/2949956124 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644042820 con 0x7fb65410df60 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6541a63b0 con 0x7fb65410df60 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.780+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6541b2660 con 0x7fb65410df60 2026-02-20T03:14:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.781+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65410da20 con 0x7fb65410df60 2026-02-20T03:14:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.783+0000 7fb650ff9640 1 -- 10.20.193.28:0/2949956124 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fb6440429c0 con 0x7fb65410df60 2026-02-20T03:14:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.785+0000 7fb650ff9640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6280b0e20 0x7fb6280b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.785+0000 7fb650ff9640 1 -- 10.20.193.28:0/2949956124 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fb6441051f0 con 0x7fb65410df60 2026-02-20T03:14:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.785+0000 7fb6537fe640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6280b0e20 0x7fb6280b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.785+0000 7fb650ff9640 1 -- 10.20.193.28:0/2949956124 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb644105710 con 0x7fb65410df60 2026-02-20T03:14:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.786+0000 7fb6537fe640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6280b0e20 0x7fb6280b32e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb6541a6a90 tx=0x7fb640005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:42.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.894+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb6541155d0 con 0x7fb65410df60 2026-02-20T03:14:42.897 INFO:teuthology.orchestra.run.trial028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2026-02-20T03:14:42.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.894+0000 7fb650ff9640 1 -- 10.20.193.28:0/2949956124 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+88 (secure 0 0 0) 0x7fb6440cd830 con 0x7fb65410df60 2026-02-20T03:14:42.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6280b0e20 msgr2=0x7fb6280b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6280b0e20 0x7fb6280b32e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb6541a6a90 tx=0x7fb640005f50 comp rx=0 tx=0).stop 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410df60 msgr2=0x7fb6541abcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410df60 0x7fb6541abcd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb64402f730 tx=0x7fb64402fcb0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 shutdown_connections 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6280b0e20 0x7fb6280b32e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb654113600 0x7fb6541a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb65410df60 0x7fb6541abcd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 --2- 10.20.193.28:0/2949956124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb65410d5a0 0x7fb6541ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 >> 10.20.193.28:0/2949956124 conn(0x7fb65406d5c0 msgr2=0x7fb65410c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 shutdown_connections 2026-02-20T03:14:42.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:42.895+0000 7fb659b46640 1 -- 10.20.193.28:0/2949956124 wait complete. 2026-02-20T03:14:42.995 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2026-02-20T03:14:42.995 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-20T03:14:42.995 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial028.front.sepia.ceph.com 2026-02-20T03:14:42.995 INFO:tasks.cephfs.mount:self.client.name = client.admin 2026-02-20T03:14:42.995 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2026-02-20T03:14:42.995 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2026-02-20T03:14:42.996 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-20T03:14:42.996 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-20T03:14:42.996 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2026-02-20T03:14:42.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:42.996 DEBUG:teuthology.orchestra.run.trial028:> ip addr 2026-02-20T03:14:43.034 INFO:teuthology.orchestra.run.trial028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-20T03:14:43.034 INFO:teuthology.orchestra.run.trial028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-20T03:14:43.034 INFO:teuthology.orchestra.run.trial028.stdout: inet 127.0.0.1/8 scope host lo 2026-02-20T03:14:43.034 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-20T03:14:43.034 INFO:teuthology.orchestra.run.trial028.stdout: inet6 ::1/128 scope host 2026-02-20T03:14:43.034 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-20T03:14:43.034 INFO:teuthology.orchestra.run.trial028.stdout:2: enp1s0f0np0: mtu 1500 qdisc fq_codel state UP group default qlen 1000 2026-02-20T03:14:43.035 INFO:teuthology.orchestra.run.trial028.stdout: link/ether 90:5a:08:77:63:0c brd ff:ff:ff:ff:ff:ff 2026-02-20T03:14:43.035 INFO:teuthology.orchestra.run.trial028.stdout: inet 10.20.193.28/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0np0 2026-02-20T03:14:43.035 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft 760sec preferred_lft 760sec 2026-02-20T03:14:43.035 INFO:teuthology.orchestra.run.trial028.stdout: inet6 fe80::925a:8ff:fe77:630c/64 scope link proto kernel_ll 2026-02-20T03:14:43.035 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-20T03:14:43.035 INFO:teuthology.orchestra.run.trial028.stdout:3: enp1s0f1np1: mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 2026-02-20T03:14:43.035 INFO:teuthology.orchestra.run.trial028.stdout: link/ether 90:5a:08:77:63:0d brd ff:ff:ff:ff:ff:ff 2026-02-20T03:14:43.036 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-20T03:14:43.036 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:14:43.036 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:14:43.036 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link add name ceph-brx type bridge 2026-02-20T03:14:43.036 DEBUG:teuthology.orchestra.run.trial028:> sudo ip addr flush dev ceph-brx 2026-02-20T03:14:43.036 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set ceph-brx up 2026-02-20T03:14:43.036 DEBUG:teuthology.orchestra.run.trial028:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-20T03:14:43.036 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:14:43.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:14:43.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:14:43.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:43.297 DEBUG:teuthology.orchestra.run.trial028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-20T03:14:43.353 INFO:teuthology.orchestra.run.trial028.stdout:1 2026-02-20T03:14:43.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:43.357 DEBUG:teuthology.orchestra.run.trial028:> ip r 2026-02-20T03:14:43.395 INFO:teuthology.orchestra.run.trial028.stdout:default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.28 metric 100 2026-02-20T03:14:43.396 INFO:teuthology.orchestra.run.trial028.stdout:10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.28 metric 100 2026-02-20T03:14:43.396 INFO:teuthology.orchestra.run.trial028.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-20T03:14:43.397 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:14:43.397 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:14:43.397 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -A FORWARD -o enp1s0f0np0 -i ceph-brx -j ACCEPT 2026-02-20T03:14:43.397 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -A FORWARD -i enp1s0f0np0 -o ceph-brx -j ACCEPT 2026-02-20T03:14:43.397 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0np0 -j MASQUERADE 2026-02-20T03:14:43.397 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:14:43.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:14:43.516 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:43 trial028 ceph-mon[38552]: pgmap v177: 129 pgs: 128 active+clean, 1 creating+activating; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s wr, 3 op/s 2026-02-20T03:14:43.516 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:43 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2949956124' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T03:14:43.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:43 trial126 ceph-mon[38476]: pgmap v177: 129 pgs: 128 active+clean, 1 creating+activating; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s wr, 3 op/s 2026-02-20T03:14:43.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:43 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2949956124' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T03:14:43.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:14:43.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:43.691 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-20T03:14:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:43 trial177 ceph-mon[43181]: pgmap v177: 129 pgs: 128 active+clean, 1 creating+activating; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 KiB/s wr, 3 op/s 2026-02-20T03:14:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:43 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2949956124' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T03:14:43.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:43.731 DEBUG:teuthology.orchestra.run.trial028:> ip netns list-id 2026-02-20T03:14:43.819 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:14:43.819 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:14:43.819 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-20T03:14:43.819 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2026-02-20T03:14:43.819 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:14:43.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:14:43.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:14:43.976 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.144.1/20 2026-02-20T03:14:43.977 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:14:43.977 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:14:43.977 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2026-02-20T03:14:43.977 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-20T03:14:43.977 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2026-02-20T03:14:43.977 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2026-02-20T03:14:43.977 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.159.254 2026-02-20T03:14:43.977 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:14:44.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:14:44.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:14:44.174 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:14:44.174 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:14:44.174 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set brx.0 up 2026-02-20T03:14:44.174 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set dev brx.0 master ceph-brx 2026-02-20T03:14:44.174 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:14:44.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:14:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:14:44.325 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2026-02-20T03:14:44.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T03:14:44.325 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2026-02-20T03:14:44.365 INFO:teuthology.orchestra.run.trial028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2026-02-20T03:14:44.365 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T03:14:44.366 DEBUG:teuthology.orchestra.run.trial028:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2026-02-20T03:14:44.443 DEBUG:teuthology.orchestra.run.trial028:> sudo modprobe fuse 2026-02-20T03:14:44.540 DEBUG:teuthology.orchestra.run.trial028:> cat /proc/self/mounts | awk '{print $2}' 2026-02-20T03:14:44.578 INFO:teuthology.orchestra.run.trial028.stdout:/proc 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/sys 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/dev 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/security 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/dev/shm 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/dev/pts 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/run 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/cgroup 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/pstore 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/sys/firmware/efi/efivars 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/bpf 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/config 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/ 2026-02-20T03:14:44.579 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/selinux 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/dev/hugepages 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/dev/mqueue 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/debug 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/tracing 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/fuse/connections 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-sysctl.service 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-20T03:14:44.580 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/nfs/rpc_pipefs 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/run/user/1000 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/ceph 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/4faec576b1b01c6cf62144769ab600e012561d914788fe8ae5ec18f4209d4b0e/merged 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/0339323f652315e561ee280d9023689e6844882abdebe9fb0bd53862450c2e32/merged 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/run/user/0 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/03b45f7d81395a93268fd1487f41f903f0266b70021d2803740d395d94ee8a1a/merged 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/3c2456bfc84eaca098ff1708354414b11baadf261421ed1d2608f58bda09ec0b/merged 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/c471d97931fdfe7e30628c1a66d14ba1520740ccf5ecafeaa89d097abb523cb5/merged 2026-02-20T03:14:44.581 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/54200644b06edd5027864ae6471599d8265278fec638f5de33871eab5c69b25f/merged 2026-02-20T03:14:44.582 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/dbbd8fe4415bc52da1a114c4983b28ba52b9c89824f14a6f906f75674d094a31/merged 2026-02-20T03:14:44.582 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/20f8691a6d1a23cbe006d26e3d7f2e8aef27f13a6caa105c429ca855d52732ff/merged 2026-02-20T03:14:44.582 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/b1da5466f201aa08b06cde1b89e88ca5a6a822d151705c322320e27affb97ee6/merged 2026-02-20T03:14:44.582 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/a34cdc453ac3749eae04a1cabfaa08a321bface1e2eb723570191cde8ebea90c/merged 2026-02-20T03:14:44.582 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns 2026-02-20T03:14:44.582 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-20T03:14:44.582 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-20T03:14:44.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:44.583 DEBUG:teuthology.orchestra.run.trial028:> ls /sys/fs/fuse/connections 2026-02-20T03:14:44.661 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2026-02-20T03:14:44.661 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2026-02-20T03:14:44.705 DEBUG:teuthology.orchestra.run.trial028:> sudo modprobe fuse 2026-02-20T03:14:44.761 DEBUG:teuthology.orchestra.run.trial028:> cat /proc/self/mounts | awk '{print $2}' 2026-02-20T03:14:44.801 INFO:teuthology.orchestra.run.trial028.stdout:/proc 2026-02-20T03:14:44.801 INFO:teuthology.orchestra.run.trial028.stdout:/sys 2026-02-20T03:14:44.801 INFO:teuthology.orchestra.run.trial028.stdout:/dev 2026-02-20T03:14:44.801 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/security 2026-02-20T03:14:44.801 INFO:teuthology.orchestra.run.trial028.stdout:/dev/shm 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/dev/pts 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/run 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/cgroup 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/pstore 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/sys/firmware/efi/efivars 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/bpf 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/config 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/ 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/selinux 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/dev/hugepages 2026-02-20T03:14:44.802 INFO:teuthology.orchestra.run.trial028.stdout:/dev/mqueue 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/debug 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/sys/kernel/tracing 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/sys/fs/fuse/connections 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-sysctl.service 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/boot/efi 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/nfs/rpc_pipefs 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/run/user/1000 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/ceph 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay 2026-02-20T03:14:44.803 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/4faec576b1b01c6cf62144769ab600e012561d914788fe8ae5ec18f4209d4b0e/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/0339323f652315e561ee280d9023689e6844882abdebe9fb0bd53862450c2e32/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/run/user/0 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/proc/sys/fs/binfmt_misc 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/03b45f7d81395a93268fd1487f41f903f0266b70021d2803740d395d94ee8a1a/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/3c2456bfc84eaca098ff1708354414b11baadf261421ed1d2608f58bda09ec0b/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/c471d97931fdfe7e30628c1a66d14ba1520740ccf5ecafeaa89d097abb523cb5/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/54200644b06edd5027864ae6471599d8265278fec638f5de33871eab5c69b25f/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/dbbd8fe4415bc52da1a114c4983b28ba52b9c89824f14a6f906f75674d094a31/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/20f8691a6d1a23cbe006d26e3d7f2e8aef27f13a6caa105c429ca855d52732ff/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/b1da5466f201aa08b06cde1b89e88ca5a6a822d151705c322320e27affb97ee6/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/var/lib/containers/storage/overlay/a34cdc453ac3749eae04a1cabfaa08a321bface1e2eb723570191cde8ebea90c/merged 2026-02-20T03:14:44.804 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns 2026-02-20T03:14:44.805 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-20T03:14:44.805 INFO:teuthology.orchestra.run.trial028.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-20T03:14:44.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:44.806 DEBUG:teuthology.orchestra.run.trial028:> ls /sys/fs/fuse/connections 2026-02-20T03:14:44.848 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial028.stderr:2026-02-20T03:14:44.846+0000 7fd5ef420580 -1 init, newargv = 0x55753106c080 newargc=15 2026-02-20T03:14:44.848 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial028.stderr:ceph-fuse[76167]: starting ceph client 2026-02-20T03:14:44.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial028.stderr:ceph-fuse[76167]: starting fuse 2026-02-20T03:14:44.885 INFO:teuthology.orchestra.run.trial028.stdout:43 2026-02-20T03:14:44.886 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2026-02-20T03:14:44.887 DEBUG:teuthology.orchestra.run.trial028:> sudo stdin-killer -- python3 -c ' 2026-02-20T03:14:44.887 DEBUG:teuthology.orchestra.run.trial028:> import glob 2026-02-20T03:14:44.887 DEBUG:teuthology.orchestra.run.trial028:> import re 2026-02-20T03:14:44.887 DEBUG:teuthology.orchestra.run.trial028:> import os 2026-02-20T03:14:44.887 DEBUG:teuthology.orchestra.run.trial028:> import subprocess 2026-02-20T03:14:44.887 DEBUG:teuthology.orchestra.run.trial028:> 2026-02-20T03:14:44.888 DEBUG:teuthology.orchestra.run.trial028:> def _find_admin_socket(client_name): 2026-02-20T03:14:44.888 DEBUG:teuthology.orchestra.run.trial028:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2026-02-20T03:14:44.888 DEBUG:teuthology.orchestra.run.trial028:> files = glob.glob(asok_path) 2026-02-20T03:14:44.888 DEBUG:teuthology.orchestra.run.trial028:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2026-02-20T03:14:44.888 DEBUG:teuthology.orchestra.run.trial028:> 2026-02-20T03:14:44.888 DEBUG:teuthology.orchestra.run.trial028:> # Given a non-glob path, it better be there 2026-02-20T03:14:44.889 DEBUG:teuthology.orchestra.run.trial028:> if "*" not in asok_path: 2026-02-20T03:14:44.889 DEBUG:teuthology.orchestra.run.trial028:> assert(len(files) == 1) 2026-02-20T03:14:44.889 DEBUG:teuthology.orchestra.run.trial028:> return files[0] 2026-02-20T03:14:44.889 DEBUG:teuthology.orchestra.run.trial028:> 2026-02-20T03:14:44.889 DEBUG:teuthology.orchestra.run.trial028:> for f in files: 2026-02-20T03:14:44.889 DEBUG:teuthology.orchestra.run.trial028:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2026-02-20T03:14:44.889 DEBUG:teuthology.orchestra.run.trial028:> if os.path.exists("/proc/{0}".format(pid)): 2026-02-20T03:14:44.890 DEBUG:teuthology.orchestra.run.trial028:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2026-02-20T03:14:44.890 DEBUG:teuthology.orchestra.run.trial028:> contents = proc_f.read() 2026-02-20T03:14:44.890 DEBUG:teuthology.orchestra.run.trial028:> if mountpoint in contents: 2026-02-20T03:14:44.890 DEBUG:teuthology.orchestra.run.trial028:> return f 2026-02-20T03:14:44.890 DEBUG:teuthology.orchestra.run.trial028:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2026-02-20T03:14:44.890 DEBUG:teuthology.orchestra.run.trial028:> 2026-02-20T03:14:44.891 DEBUG:teuthology.orchestra.run.trial028:> print(_find_admin_socket("client.admin")) 2026-02-20T03:14:44.891 DEBUG:teuthology.orchestra.run.trial028:> ' 2026-02-20T03:14:45.024 INFO:teuthology.orchestra.run.trial028.stdout:/var/run/ceph/ceph-client.admin.76167.asok 2026-02-20T03:14:45.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:14:45.033 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.76167.asok 2026-02-20T03:14:45.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:45.034 DEBUG:teuthology.orchestra.run.trial028:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.76167.asok status 2026-02-20T03:14:45.186 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:14:45.186 INFO:teuthology.orchestra.run.trial028.stdout: "metadata": { 2026-02-20T03:14:45.186 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_sha1": "f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03", 2026-02-20T03:14:45.186 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_version": "ceph version 19.2.3-700-gf4ef35d9 (f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) squid (stable)", 2026-02-20T03:14:45.186 INFO:teuthology.orchestra.run.trial028.stdout: "entity_id": "admin", 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": "trial028", 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "pid": "76167", 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "root": "/" 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "dentry_count": 0, 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "dentry_pinned_count": 0, 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "id": 14625, 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "inst": { 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "name": { 2026-02-20T03:14:45.187 INFO:teuthology.orchestra.run.trial028.stdout: "type": "client", 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: "num": 14625 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: "addr": { 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v1", 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "192.168.144.1:0", 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 3693018522 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: "addr": { 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v1", 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "192.168.144.1:0", 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 3693018522 2026-02-20T03:14:45.188 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:14:45.189 INFO:teuthology.orchestra.run.trial028.stdout: "inst_str": "client.14625 192.168.144.1:0/3693018522", 2026-02-20T03:14:45.189 INFO:teuthology.orchestra.run.trial028.stdout: "addr_str": "192.168.144.1:0/3693018522", 2026-02-20T03:14:45.189 INFO:teuthology.orchestra.run.trial028.stdout: "inode_count": 1, 2026-02-20T03:14:45.189 INFO:teuthology.orchestra.run.trial028.stdout: "mds_epoch": 14, 2026-02-20T03:14:45.189 INFO:teuthology.orchestra.run.trial028.stdout: "osd_epoch": 89, 2026-02-20T03:14:45.189 INFO:teuthology.orchestra.run.trial028.stdout: "osd_epoch_barrier": 0, 2026-02-20T03:14:45.189 INFO:teuthology.orchestra.run.trial028.stdout: "blocklisted": false, 2026-02-20T03:14:45.189 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs" 2026-02-20T03:14:45.189 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:14:45.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:45.195 DEBUG:teuthology.orchestra.run.trial028:> stat --file-system '--printf=%T 2026-02-20T03:14:45.195 DEBUG:teuthology.orchestra.run.trial028:> ' -- /home/ubuntu/cephtest/mnt.admin 2026-02-20T03:14:45.235 INFO:teuthology.orchestra.run.trial028.stdout:fuseblk 2026-02-20T03:14:45.235 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2026-02-20T03:14:45.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:45.236 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2026-02-20T03:14:45.333 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2026-02-20T03:14:45.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-20T03:14:45.410 INFO:teuthology.orchestra.run.trial028.stdout:# file: . 2026-02-20T03:14:45.411 INFO:teuthology.orchestra.run.trial028.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2026-02-20T03:14:45.411 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:45.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:14:45.416 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:14:45.417 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T03:14:45.457 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd blocklist ls 2026-02-20T03:14:45.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:45 trial126 ceph-mon[38476]: pgmap v178: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s wr, 2 op/s 2026-02-20T03:14:45.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:45 trial028 ceph-mon[38552]: pgmap v178: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s wr, 2 op/s 2026-02-20T03:14:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:45 trial177 ceph-mon[43181]: pgmap v178: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 KiB/s wr, 2 op/s 2026-02-20T03:14:45.768 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.951+0000 7f23ef070640 1 -- 10.20.193.28:0/70825626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e8108700 msgr2=0x7f23e8108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.951+0000 7f23ef070640 1 --2- 10.20.193.28:0/70825626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e8108700 0x7f23e8108ae0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009a60 tx=0x7f23d802f260 comp rx=0 tx=0).stop 2026-02-20T03:14:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.951+0000 7f23ef070640 1 -- 10.20.193.28:0/70825626 shutdown_connections 2026-02-20T03:14:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.951+0000 7f23ef070640 1 --2- 10.20.193.28:0/70825626 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e81030a0 0x7f23e810f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.951+0000 7f23ef070640 1 --2- 10.20.193.28:0/70825626 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e8102700 0x7f23e8102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.951+0000 7f23ef070640 1 --2- 10.20.193.28:0/70825626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e8108700 0x7f23e8108ae0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.951+0000 7f23ef070640 1 -- 10.20.193.28:0/70825626 >> 10.20.193.28:0/70825626 conn(0x7f23e80fe440 msgr2=0x7f23e8100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:45.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.951+0000 7f23ef070640 1 -- 10.20.193.28:0/70825626 shutdown_connections 2026-02-20T03:14:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.951+0000 7f23ef070640 1 -- 10.20.193.28:0/70825626 wait complete. 2026-02-20T03:14:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.952+0000 7f23ef070640 1 Processor -- start 2026-02-20T03:14:45.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.952+0000 7f23ef070640 1 -- start start 2026-02-20T03:14:45.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.952+0000 7f23ef070640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e8102700 0x7f23e819d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:45.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.952+0000 7f23ef070640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e81030a0 0x7f23e819d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:45.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.952+0000 7f23ef070640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e8108700 0x7f23e81a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.952+0000 7f23ef070640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8112970 con 0x7f23e8108700 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.952+0000 7f23ef070640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f23e81127f0 con 0x7f23e8102700 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.952+0000 7f23ef070640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8112af0 con 0x7f23e81030a0 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee06e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e8102700 0x7f23e819d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ed86d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e81030a0 0x7f23e819d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee86f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e8108700 0x7f23e81a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee06e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e8102700 0x7f23e819d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:46258/0 (socket says 10.20.193.28:46258) 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee06e640 1 -- 10.20.193.28:0/280301893 learned_addr learned my addr 10.20.193.28:0/280301893 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee86f640 1 -- 10.20.193.28:0/280301893 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e81030a0 msgr2=0x7f23e819d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee86f640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e81030a0 0x7f23e819d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee86f640 1 -- 10.20.193.28:0/280301893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e8102700 msgr2=0x7f23e819d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:45.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee86f640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e8102700 0x7f23e819d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:45.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee86f640 1 -- 10.20.193.28:0/280301893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e81a20a0 con 0x7f23e8108700 2026-02-20T03:14:45.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ee86f640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e8108700 0x7f23e81a1920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f23e400efc0 tx=0x7f23e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:45.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23cf7fe640 1 -- 10.20.193.28:0/280301893 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4019070 con 0x7f23e8108700 2026-02-20T03:14:45.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23cf7fe640 1 -- 10.20.193.28:0/280301893 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23e40092d0 con 0x7f23e8108700 2026-02-20T03:14:45.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23cf7fe640 1 -- 10.20.193.28:0/280301893 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4007500 con 0x7f23e8108700 2026-02-20T03:14:45.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e81a2330 con 0x7f23e8108700 2026-02-20T03:14:45.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.953+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e81a9bd0 con 0x7f23e8108700 2026-02-20T03:14:45.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.954+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e8102b60 con 0x7f23e8108700 2026-02-20T03:14:45.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.956+0000 7f23cf7fe640 1 -- 10.20.193.28:0/280301893 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f23e4002a60 con 0x7f23e8108700 2026-02-20T03:14:45.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.958+0000 7f23cf7fe640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23c40b0e20 0x7f23c40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:45.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.958+0000 7f23cf7fe640 1 -- 10.20.193.28:0/280301893 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f23e40e0800 con 0x7f23e8108700 2026-02-20T03:14:45.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.958+0000 7f23cf7fe640 1 -- 10.20.193.28:0/280301893 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f23e4023080 con 0x7f23e8108700 2026-02-20T03:14:45.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.958+0000 7f23ee06e640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23c40b0e20 0x7f23c40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:45.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:45.959+0000 7f23ee06e640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23c40b0e20 0x7f23c40b32e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23d80097c0 tx=0x7f23d8005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:46.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.054+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f23e81a9e60 con 0x7f23e8108700 2026-02-20T03:14:46.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.055+0000 7f23cf7fe640 1 -- 10.20.193.28:0/280301893 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+589 (secure 0 0 0) 0x7f23e4010040 con 0x7f23e8108700 2026-02-20T03:14:46.057 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/732750991 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.057 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/732750991 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.057 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2248669804 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.057 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/3377311556 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.058 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1349207449 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.058 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/613688684 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.058 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/1032320093 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.058 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/1032320093 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.058 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1867592854 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.058 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2481417757 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.059 INFO:teuthology.orchestra.run.trial028.stderr:listed 10 entries 2026-02-20T03:14:46.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23c40b0e20 msgr2=0x7f23c40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:46.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23c40b0e20 0x7f23c40b32e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f23d80097c0 tx=0x7f23d8005950 comp rx=0 tx=0).stop 2026-02-20T03:14:46.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e8108700 msgr2=0x7f23e81a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:46.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e8108700 0x7f23e81a1920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f23e400efc0 tx=0x7f23e400c490 comp rx=0 tx=0).stop 2026-02-20T03:14:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 shutdown_connections 2026-02-20T03:14:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23c40b0e20 0x7f23c40b32e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e8108700 0x7f23e81a1920 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e81030a0 0x7f23e819d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 --2- 10.20.193.28:0/280301893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e8102700 0x7f23e819d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 >> 10.20.193.28:0/280301893 conn(0x7f23e80fe440 msgr2=0x7f23e810de70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 shutdown_connections 2026-02-20T03:14:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.056+0000 7f23ef070640 1 -- 10.20.193.28:0/280301893 wait complete. 2026-02-20T03:14:46.196 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:14:46.196 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T03:14:46.238 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd blocklist ls 2026-02-20T03:14:46.544 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:46.589 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:46 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/280301893' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T03:14:46.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:46 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/280301893' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T03:14:46.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:46 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/280301893' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T03:14:46.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.725+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/2567829927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 msgr2=0x7fa6c8111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:46.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.725+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/2567829927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 0x7fa6c8111a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800b0a0 tx=0x7fa6b802f410 comp rx=0 tx=0).stop 2026-02-20T03:14:46.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.725+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/2567829927 shutdown_connections 2026-02-20T03:14:46.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.725+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/2567829927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 0x7fa6c8111a50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.725+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/2567829927 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6c8105750 0x7fa6c81097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.725+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/2567829927 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6c8104da0 0x7fa6c8105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.725+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/2567829927 >> 10.20.193.28:0/2567829927 conn(0x7fa6c8100840 msgr2=0x7fa6c8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:46.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.725+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/2567829927 shutdown_connections 2026-02-20T03:14:46.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.725+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/2567829927 wait complete. 2026-02-20T03:14:46.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6ccbf4640 1 Processor -- start 2026-02-20T03:14:46.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6ccbf4640 1 -- start start 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6ccbf4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6c8104da0 0x7fa6c819d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6ccbf4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6c8105750 0x7fa6c819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6ccbf4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 0x7fa6c81a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6ccbf4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c8114da0 con 0x7fa6c8109ed0 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6ccbf4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c8114c20 con 0x7fa6c8105750 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6ccbf4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c8114f20 con 0x7fa6c8104da0 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6c6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 0x7fa6c81a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6c6575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6c8104da0 0x7fa6c819d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6c6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 0x7fa6c81a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59866/0 (socket says 10.20.193.28:59866) 2026-02-20T03:14:46.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6c5d74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6c8105750 0x7fa6c819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.726+0000 7fa6c6d76640 1 -- 10.20.193.28:0/1620081299 learned_addr learned my addr 10.20.193.28:0/1620081299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6c6d76640 1 -- 10.20.193.28:0/1620081299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6c8104da0 msgr2=0x7fa6c819d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6c6d76640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6c8104da0 0x7fa6c819d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6c6d76640 1 -- 10.20.193.28:0/1620081299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6c8105750 msgr2=0x7fa6c819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6c6d76640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6c8105750 0x7fa6c819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6c6d76640 1 -- 10.20.193.28:0/1620081299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c81a2270 con 0x7fa6c8109ed0 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6c6d76640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 0x7fa6c81a1af0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8006030 tx=0x7fa6b8009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6af7fe640 1 -- 10.20.193.28:0/1620081299 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8046070 con 0x7fa6c8109ed0 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6af7fe640 1 -- 10.20.193.28:0/1620081299 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa6b80076a0 con 0x7fa6c8109ed0 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6af7fe640 1 -- 10.20.193.28:0/1620081299 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80416c0 con 0x7fa6c8109ed0 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c81a2500 con 0x7fa6c8109ed0 2026-02-20T03:14:46.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.727+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c81a9da0 con 0x7fa6c8109ed0 2026-02-20T03:14:46.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.728+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c8105180 con 0x7fa6c8109ed0 2026-02-20T03:14:46.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.730+0000 7fa6af7fe640 1 -- 10.20.193.28:0/1620081299 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fa6b8007850 con 0x7fa6c8109ed0 2026-02-20T03:14:46.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.731+0000 7fa6af7fe640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a00b0da0 0x7fa6a00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:46.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.732+0000 7fa6af7fe640 1 -- 10.20.193.28:0/1620081299 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fa6b81057d0 con 0x7fa6c8109ed0 2026-02-20T03:14:46.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.732+0000 7fa6c6575640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a00b0da0 0x7fa6a00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:46.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.732+0000 7fa6af7fe640 1 -- 10.20.193.28:0/1620081299 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa6b80cddb0 con 0x7fa6c8109ed0 2026-02-20T03:14:46.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.732+0000 7fa6c6575640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a00b0da0 0x7fa6a00b3260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc007c40 tx=0x7fa6bc0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:46.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.828+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa6c810cb80 con 0x7fa6c8109ed0 2026-02-20T03:14:46.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.828+0000 7fa6af7fe640 1 -- 10.20.193.28:0/1620081299 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+589 (secure 0 0 0) 0x7fa6b80d1a60 con 0x7fa6c8109ed0 2026-02-20T03:14:46.830 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/732750991 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.831 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/732750991 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.831 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2248669804 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.831 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/3377311556 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.831 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1349207449 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.831 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/613688684 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.831 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/1032320093 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.831 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/1032320093 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.831 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1867592854 2026-02-21T03:11:25.971161+0000 2026-02-20T03:14:46.831 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2481417757 2026-02-21T03:11:14.750053+0000 2026-02-20T03:14:46.832 INFO:teuthology.orchestra.run.trial028.stderr:listed 10 entries 2026-02-20T03:14:46.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a00b0da0 msgr2=0x7fa6a00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:46.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a00b0da0 0x7fa6a00b3260 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc007c40 tx=0x7fa6bc0073d0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 msgr2=0x7fa6c81a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:46.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 0x7fa6c81a1af0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8006030 tx=0x7fa6b8009300 comp rx=0 tx=0).stop 2026-02-20T03:14:46.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 shutdown_connections 2026-02-20T03:14:46.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a00b0da0 0x7fa6a00b3260 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6c8109ed0 0x7fa6c81a1af0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6c8105750 0x7fa6c819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 --2- 10.20.193.28:0/1620081299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6c8104da0 0x7fa6c819d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:46.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 >> 10.20.193.28:0/1620081299 conn(0x7fa6c8100840 msgr2=0x7fa6c8101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:46.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 shutdown_connections 2026-02-20T03:14:46.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:46.829+0000 7fa6ccbf4640 1 -- 10.20.193.28:0/1620081299 wait complete. 2026-02-20T03:14:46.931 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@trial028.front.sepia.ceph.com... 2026-02-20T03:14:46.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:46.931 DEBUG:teuthology.orchestra.run.trial028:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2026-02-20T03:14:46.987 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.trial028.stderr:ceph-fuse[76167]: fuse finished with error 0 and tester_r 0 2026-02-20T03:14:46.991 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T03:14:47.016 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial028.front.sepia.ceph.com 2026-02-20T03:14:47.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:14:47.017 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2026-02-20T03:14:47.098 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:14:47.409 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:47.452 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:47 trial028 ceph-mon[38552]: pgmap v179: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 117 B/s wr, 2 op/s 2026-02-20T03:14:47.453 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:47 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1620081299' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T03:14:47.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.589+0000 7f69a1795640 1 -- 10.20.193.28:0/3794837087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c104da0 msgr2=0x7f699c105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:47.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.589+0000 7f69a1795640 1 --2- 10.20.193.28:0/3794837087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c104da0 0x7f699c105180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6990009a30 tx=0x7f699002f260 comp rx=0 tx=0).stop 2026-02-20T03:14:47.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.589+0000 7f69a1795640 1 -- 10.20.193.28:0/3794837087 shutdown_connections 2026-02-20T03:14:47.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.589+0000 7f69a1795640 1 --2- 10.20.193.28:0/3794837087 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f699c109ed0 0x7f699c111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.589+0000 7f69a1795640 1 --2- 10.20.193.28:0/3794837087 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c105750 0x7f699c1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.589+0000 7f69a1795640 1 --2- 10.20.193.28:0/3794837087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c104da0 0x7f699c105180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.589+0000 7f69a1795640 1 -- 10.20.193.28:0/3794837087 >> 10.20.193.28:0/3794837087 conn(0x7f699c100840 msgr2=0x7f699c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:47.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.589+0000 7f69a1795640 1 -- 10.20.193.28:0/3794837087 shutdown_connections 2026-02-20T03:14:47.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.590+0000 7f69a1795640 1 -- 10.20.193.28:0/3794837087 wait complete. 2026-02-20T03:14:47.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.590+0000 7f69a1795640 1 Processor -- start 2026-02-20T03:14:47.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.590+0000 7f69a1795640 1 -- start start 2026-02-20T03:14:47.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f69a1795640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f699c104da0 0x7f699c19d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:47.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f69a1795640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c105750 0x7f699c19d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:47.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f69a1795640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c109ed0 0x7f699c1a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:47.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f69a1795640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f699c114da0 con 0x7f699c109ed0 2026-02-20T03:14:47.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f69a1795640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f699c114c20 con 0x7f699c104da0 2026-02-20T03:14:47.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f69a1795640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f699c114f20 con 0x7f699c105750 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c109ed0 0x7f699c1a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c109ed0 0x7f699c1a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59890/0 (socket says 10.20.193.28:59890) 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699a7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c105750 0x7f699c19d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699b7fe640 1 -- 10.20.193.28:0/620806809 learned_addr learned my addr 10.20.193.28:0/620806809 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699affd640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f699c104da0 0x7f699c19d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699b7fe640 1 -- 10.20.193.28:0/620806809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c105750 msgr2=0x7f699c19d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699b7fe640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c105750 0x7f699c19d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699b7fe640 1 -- 10.20.193.28:0/620806809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f699c104da0 msgr2=0x7f699c19d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699b7fe640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f699c104da0 0x7f699c19d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699b7fe640 1 -- 10.20.193.28:0/620806809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699c1a2270 con 0x7f699c109ed0 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699affd640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f699c104da0 0x7f699c19d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:14:47.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.591+0000 7f699b7fe640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c109ed0 0x7f699c1a1af0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f698c004820 tx=0x7f698c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:47.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.592+0000 7f6973fff640 1 -- 10.20.193.28:0/620806809 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c0090d0 con 0x7f699c109ed0 2026-02-20T03:14:47.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.592+0000 7f6973fff640 1 -- 10.20.193.28:0/620806809 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f698c009270 con 0x7f699c109ed0 2026-02-20T03:14:47.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.592+0000 7f6973fff640 1 -- 10.20.193.28:0/620806809 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c013810 con 0x7f699c109ed0 2026-02-20T03:14:47.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.592+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f699c1a2500 con 0x7f699c109ed0 2026-02-20T03:14:47.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.592+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699c1a9da0 con 0x7f699c109ed0 2026-02-20T03:14:47.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.592+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f699c105180 con 0x7f699c109ed0 2026-02-20T03:14:47.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.594+0000 7f6973fff640 1 -- 10.20.193.28:0/620806809 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f698c012070 con 0x7f699c109ed0 2026-02-20T03:14:47.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.596+0000 7f6973fff640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f696c0b0e20 0x7f696c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:47.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.596+0000 7f6973fff640 1 -- 10.20.193.28:0/620806809 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f698c0e05a0 con 0x7f699c109ed0 2026-02-20T03:14:47.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.596+0000 7f6973fff640 1 -- 10.20.193.28:0/620806809 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f698c010070 con 0x7f699c109ed0 2026-02-20T03:14:47.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.596+0000 7f699affd640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f696c0b0e20 0x7f696c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:47.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:47 trial126 ceph-mon[38476]: pgmap v179: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 117 B/s wr, 2 op/s 2026-02-20T03:14:47.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:47 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1620081299' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T03:14:47.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.598+0000 7f699affd640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f696c0b0e20 0x7f696c0b32e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f69900097c0 tx=0x7f699003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:47.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.687+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f699c10cb20 con 0x7f699c109ed0 2026-02-20T03:14:47.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.688+0000 7f6973fff640 1 -- 10.20.193.28:0/620806809 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7f698c0a8b80 con 0x7f699c109ed0 2026-02-20T03:14:47.691 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:47.691 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:14:47.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f696c0b0e20 msgr2=0x7f696c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:47.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f696c0b0e20 0x7f696c0b32e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f69900097c0 tx=0x7f699003a040 comp rx=0 tx=0).stop 2026-02-20T03:14:47.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c109ed0 msgr2=0x7f699c1a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:47.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c109ed0 0x7f699c1a1af0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f698c004820 tx=0x7f698c00d4a0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 shutdown_connections 2026-02-20T03:14:47.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f696c0b0e20 0x7f696c0b32e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f699c109ed0 0x7f699c1a1af0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f699c105750 0x7f699c19d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 --2- 10.20.193.28:0/620806809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f699c104da0 0x7f699c19d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:47.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 >> 10.20.193.28:0/620806809 conn(0x7f699c100840 msgr2=0x7f699c101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:47.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 shutdown_connections 2026-02-20T03:14:47.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:47.689+0000 7f69a1795640 1 -- 10.20.193.28:0/620806809 wait complete. 2026-02-20T03:14:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:47 trial177 ceph-mon[43181]: pgmap v179: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 117 B/s wr, 2 op/s 2026-02-20T03:14:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:47 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1620081299' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T03:14:47.791 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:14:48.065 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.248+0000 7f6cb1034640 1 -- 10.20.193.28:0/3118398712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cac109220 msgr2=0x7f6cac109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.248+0000 7f6cb1034640 1 --2- 10.20.193.28:0/3118398712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cac109220 0x7f6cac109660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009a30 tx=0x7f6c9c02f220 comp rx=0 tx=0).stop 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.248+0000 7f6cb1034640 1 -- 10.20.193.28:0/3118398712 shutdown_connections 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.248+0000 7f6cb1034640 1 --2- 10.20.193.28:0/3118398712 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cac109ba0 0x7f6cac115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.248+0000 7f6cb1034640 1 --2- 10.20.193.28:0/3118398712 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cac109220 0x7f6cac109660 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.248+0000 7f6cb1034640 1 --2- 10.20.193.28:0/3118398712 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cac10eef0 0x7f6cac10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.248+0000 7f6cb1034640 1 -- 10.20.193.28:0/3118398712 >> 10.20.193.28:0/3118398712 conn(0x7f6cac078600 msgr2=0x7f6cac07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.248+0000 7f6cb1034640 1 -- 10.20.193.28:0/3118398712 shutdown_connections 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.248+0000 7f6cb1034640 1 -- 10.20.193.28:0/3118398712 wait complete. 2026-02-20T03:14:48.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cb1034640 1 Processor -- start 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cb1034640 1 -- start start 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cb1034640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cac109220 0x7f6cac1a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cb1034640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cac109ba0 0x7f6cac1a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cb1034640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cac10eef0 0x7f6cac1a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cb1034640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac119090 con 0x7f6cac10eef0 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cb1034640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac118f10 con 0x7f6cac109ba0 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cb1034640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac119210 con 0x7f6cac109220 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cabfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cac109220 0x7f6cac1a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cb0833640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cac10eef0 0x7f6cac1a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cab7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cac109ba0 0x7f6cac1a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cabfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cac109220 0x7f6cac1a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48488/0 (socket says 10.20.193.28:48488) 2026-02-20T03:14:48.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.249+0000 7f6cabfff640 1 -- 10.20.193.28:0/1006083315 learned_addr learned my addr 10.20.193.28:0/1006083315 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6cb0833640 1 -- 10.20.193.28:0/1006083315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cac109220 msgr2=0x7f6cac1a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6cb0833640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cac109220 0x7f6cac1a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6cb0833640 1 -- 10.20.193.28:0/1006083315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cac109ba0 msgr2=0x7f6cac1a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6cb0833640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cac109ba0 0x7f6cac1a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6cb0833640 1 -- 10.20.193.28:0/1006083315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac1a65a0 con 0x7f6cac10eef0 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6cab7fe640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cac109ba0 0x7f6cac1a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6cb0833640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cac10eef0 0x7f6cac1a5e20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0007f00 tx=0x7f6ca000e510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6ca97fa640 1 -- 10.20.193.28:0/1006083315 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0002a60 con 0x7f6cac10eef0 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6ca97fa640 1 -- 10.20.193.28:0/1006083315 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6ca0002c00 con 0x7f6cac10eef0 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6ca97fa640 1 -- 10.20.193.28:0/1006083315 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0013680 con 0x7f6cac10eef0 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac1a6830 con 0x7f6cac10eef0 2026-02-20T03:14:48.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.250+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac1ae0d0 con 0x7f6cac10eef0 2026-02-20T03:14:48.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.251+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac109660 con 0x7f6cac10eef0 2026-02-20T03:14:48.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.253+0000 7f6ca97fa640 1 -- 10.20.193.28:0/1006083315 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f6ca00040d0 con 0x7f6cac10eef0 2026-02-20T03:14:48.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.255+0000 7f6ca97fa640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c800b0e20 0x7f6c800b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:48.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.255+0000 7f6ca97fa640 1 -- 10.20.193.28:0/1006083315 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f6ca00e0650 con 0x7f6cac10eef0 2026-02-20T03:14:48.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.255+0000 7f6cabfff640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c800b0e20 0x7f6c800b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:48.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.255+0000 7f6cabfff640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c800b0e20 0x7f6c800b32e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d50 tx=0x7f6c98009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:48.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.256+0000 7f6ca97fa640 1 -- 10.20.193.28:0/1006083315 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6ca0010040 con 0x7f6cac10eef0 2026-02-20T03:14:48.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.347+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cac110ea0 con 0x7f6cac10eef0 2026-02-20T03:14:48.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.348+0000 7f6ca97fa640 1 -- 10.20.193.28:0/1006083315 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7f6ca00a8c30 con 0x7f6cac10eef0 2026-02-20T03:14:48.351 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:48.351 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:14:48.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c800b0e20 msgr2=0x7f6c800b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:48.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c800b0e20 0x7f6c800b32e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009d50 tx=0x7f6c98009290 comp rx=0 tx=0).stop 2026-02-20T03:14:48.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cac10eef0 msgr2=0x7f6cac1a5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:48.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cac10eef0 0x7f6cac1a5e20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0007f00 tx=0x7f6ca000e510 comp rx=0 tx=0).stop 2026-02-20T03:14:48.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 shutdown_connections 2026-02-20T03:14:48.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c800b0e20 0x7f6c800b32e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cac10eef0 0x7f6cac1a5e20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cac109ba0 0x7f6cac1a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 --2- 10.20.193.28:0/1006083315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cac109220 0x7f6cac1a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.349+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 >> 10.20.193.28:0/1006083315 conn(0x7f6cac078600 msgr2=0x7f6cac079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:48.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.350+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 shutdown_connections 2026-02-20T03:14:48.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.350+0000 7f6cb1034640 1 -- 10.20.193.28:0/1006083315 wait complete. 2026-02-20T03:14:48.361 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:48 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/620806809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:48.454 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-20T03:14:48.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:48 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/620806809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:48.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:48 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/620806809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:48.724 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:48.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.896+0000 7ff35d5fe640 1 -- 10.20.193.28:0/1042416617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358108700 msgr2=0x7ff358108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:48.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.896+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/1042416617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358108700 0x7ff358108ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff344009a60 tx=0x7ff34402f250 comp rx=0 tx=0).stop 2026-02-20T03:14:48.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.897+0000 7ff35d5fe640 1 -- 10.20.193.28:0/1042416617 shutdown_connections 2026-02-20T03:14:48.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.897+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/1042416617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff3581030a0 0x7ff35810f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.897+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/1042416617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358102700 0x7ff358102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.897+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/1042416617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358108700 0x7ff358108ae0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.897+0000 7ff35d5fe640 1 -- 10.20.193.28:0/1042416617 >> 10.20.193.28:0/1042416617 conn(0x7ff3580fe440 msgr2=0x7ff358100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:48.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.897+0000 7ff35d5fe640 1 -- 10.20.193.28:0/1042416617 shutdown_connections 2026-02-20T03:14:48.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.897+0000 7ff35d5fe640 1 -- 10.20.193.28:0/1042416617 wait complete. 2026-02-20T03:14:48.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.897+0000 7ff35d5fe640 1 Processor -- start 2026-02-20T03:14:48.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.897+0000 7ff35d5fe640 1 -- start start 2026-02-20T03:14:48.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff35d5fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358102700 0x7ff358076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:48.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff35d5fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3581030a0 0x7ff358075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:48.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff35d5fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358108700 0x7ff3580758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:48.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff35d5fe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff358112970 con 0x7ff3581030a0 2026-02-20T03:14:48.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff35d5fe640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581127f0 con 0x7ff358102700 2026-02-20T03:14:48.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff35d5fe640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff358112af0 con 0x7ff358108700 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff3577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3581030a0 0x7ff358075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff3577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3581030a0 0x7ff358075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59932/0 (socket says 10.20.193.28:59932) 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff3577fe640 1 -- 10.20.193.28:0/4234225606 learned_addr learned my addr 10.20.193.28:0/4234225606 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff357fff640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358102700 0x7ff358076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff35cdfd640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358108700 0x7ff3580758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff3577fe640 1 -- 10.20.193.28:0/4234225606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358108700 msgr2=0x7ff3580758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff3577fe640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358108700 0x7ff3580758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff3577fe640 1 -- 10.20.193.28:0/4234225606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358102700 msgr2=0x7ff358076de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff3577fe640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358102700 0x7ff358076de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff3577fe640 1 -- 10.20.193.28:0/4234225606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3580761b0 con 0x7ff3581030a0 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff357fff640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358102700 0x7ff358076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:14:48.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.898+0000 7ff3577fe640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3581030a0 0x7ff358075370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff34800ea10 tx=0x7ff34800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:48.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.899+0000 7ff3557fa640 1 -- 10.20.193.28:0/4234225606 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34800ce50 con 0x7ff3581030a0 2026-02-20T03:14:48.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.899+0000 7ff3557fa640 1 -- 10.20.193.28:0/4234225606 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff348004570 con 0x7ff3581030a0 2026-02-20T03:14:48.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.899+0000 7ff3557fa640 1 -- 10.20.193.28:0/4234225606 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348010690 con 0x7ff3581030a0 2026-02-20T03:14:48.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.899+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3581adb60 con 0x7ff3581030a0 2026-02-20T03:14:48.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.899+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3581ae050 con 0x7ff3581030a0 2026-02-20T03:14:48.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.899+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff358103e40 con 0x7ff3581030a0 2026-02-20T03:14:48.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.901+0000 7ff3557fa640 1 -- 10.20.193.28:0/4234225606 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7ff348020030 con 0x7ff3581030a0 2026-02-20T03:14:48.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.903+0000 7ff3557fa640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff32c0b0fc0 0x7ff32c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:48.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.903+0000 7ff3557fa640 1 -- 10.20.193.28:0/4234225606 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ff3480e0c70 con 0x7ff3581030a0 2026-02-20T03:14:48.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.903+0000 7ff357fff640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff32c0b0fc0 0x7ff32c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:48.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.903+0000 7ff3557fa640 1 -- 10.20.193.28:0/4234225606 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff3480e10f0 con 0x7ff3581030a0 2026-02-20T03:14:48.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:48.904+0000 7ff357fff640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff32c0b0fc0 0x7ff32c0b3480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff344002410 tx=0x7ff34403a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:49.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.011+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff358102b60 con 0x7ff3581030a0 2026-02-20T03:14:49.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.335+0000 7ff3557fa640 1 -- 10.20.193.28:0/4234225606 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7ff3480a9250 con 0x7ff3581030a0 2026-02-20T03:14:49.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff32c0b0fc0 msgr2=0x7ff32c0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:49.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff32c0b0fc0 0x7ff32c0b3480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff344002410 tx=0x7ff34403a040 comp rx=0 tx=0).stop 2026-02-20T03:14:49.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3581030a0 msgr2=0x7ff358075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:49.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3581030a0 0x7ff358075370 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff34800ea10 tx=0x7ff34800eee0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 shutdown_connections 2026-02-20T03:14:49.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff32c0b0fc0 0x7ff32c0b3480 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358108700 0x7ff3580758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff3581030a0 0x7ff358075370 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 --2- 10.20.193.28:0/4234225606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358102700 0x7ff358076de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.336+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 >> 10.20.193.28:0/4234225606 conn(0x7ff3580fe440 msgr2=0x7ff3580ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:49.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.337+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 shutdown_connections 2026-02-20T03:14:49.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.337+0000 7ff35d5fe640 1 -- 10.20.193.28:0/4234225606 wait complete. 2026-02-20T03:14:49.441 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2026-02-20T03:14:49.441 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs set cephfs max_mds 3 --yes-i-really-mean-it 2026-02-20T03:14:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:49 trial126 ceph-mon[38476]: pgmap v180: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:49 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1006083315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:49.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:49 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4234225606' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2026-02-20T03:14:49.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:49 trial028 ceph-mon[38552]: pgmap v180: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:49 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1006083315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:49 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4234225606' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2026-02-20T03:14:49.705 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:49 trial177 ceph-mon[43181]: pgmap v180: 129 pgs: 129 active+clean; 579 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-20T03:14:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:49 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1006083315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:49 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4234225606' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2026-02-20T03:14:49.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.894+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1010396116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b5010eef0 msgr2=0x7f4b5010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:49.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.894+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1010396116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b5010eef0 0x7f4b5010f2d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b44009960 tx=0x7f4b4402f140 comp rx=0 tx=0).stop 2026-02-20T03:14:49.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.894+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1010396116 shutdown_connections 2026-02-20T03:14:49.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.894+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1010396116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b50109ba0 0x7f4b50115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.894+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1010396116 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b50109220 0x7f4b50109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.894+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1010396116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b5010eef0 0x7f4b5010f2d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.894+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1010396116 >> 10.20.193.28:0/1010396116 conn(0x7f4b50078600 msgr2=0x7f4b5007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:49.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.894+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1010396116 shutdown_connections 2026-02-20T03:14:49.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.894+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1010396116 wait complete. 2026-02-20T03:14:49.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.895+0000 7f4b4ffff640 1 Processor -- start 2026-02-20T03:14:49.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.895+0000 7f4b4ffff640 1 -- start start 2026-02-20T03:14:49.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.895+0000 7f4b4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b50109220 0x7f4b501a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:49.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.895+0000 7f4b4ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b50109ba0 0x7f4b501a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:49.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.895+0000 7f4b4ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b5010eef0 0x7f4b501a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:49.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.895+0000 7f4b4ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4b501190b0 con 0x7f4b50109220 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.895+0000 7f4b4ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4b50118f30 con 0x7f4b50109ba0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.895+0000 7f4b4ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4b50119230 con 0x7f4b5010eef0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.895+0000 7f4b4effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b50109220 0x7f4b501a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4e7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b50109ba0 0x7f4b501a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4e7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b50109ba0 0x7f4b501a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:33746/0 (socket says 10.20.193.28:33746) 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4e7fc640 1 -- 10.20.193.28:0/1890941901 learned_addr learned my addr 10.20.193.28:0/1890941901 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4f7fe640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b5010eef0 0x7f4b501a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4e7fc640 1 -- 10.20.193.28:0/1890941901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b5010eef0 msgr2=0x7f4b501a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4e7fc640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b5010eef0 0x7f4b501a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4e7fc640 1 -- 10.20.193.28:0/1890941901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b50109220 msgr2=0x7f4b501a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4e7fc640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b50109220 0x7f4b501a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4e7fc640 1 -- 10.20.193.28:0/1890941901 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b501a6580 con 0x7f4b50109ba0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4e7fc640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b50109ba0 0x7f4b501a1a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b380027e0 tx=0x7f4b38002cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b2ffff640 1 -- 10.20.193.28:0/1890941901 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800ed40 con 0x7f4b50109ba0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b2ffff640 1 -- 10.20.193.28:0/1890941901 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4b380108d0 con 0x7f4b50109ba0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b2ffff640 1 -- 10.20.193.28:0/1890941901 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3800f820 con 0x7f4b50109ba0 2026-02-20T03:14:49.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b501a6870 con 0x7f4b50109ba0 2026-02-20T03:14:49.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.896+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b501ae0b0 con 0x7f4b50109ba0 2026-02-20T03:14:49.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.897+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5010a580 con 0x7f4b50109ba0 2026-02-20T03:14:49.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.899+0000 7f4b2ffff640 1 -- 10.20.193.28:0/1890941901 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f4b38010a80 con 0x7f4b50109ba0 2026-02-20T03:14:49.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.901+0000 7f4b2ffff640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b200b0e20 0x7f4b200b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:49.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.901+0000 7f4b2ffff640 1 -- 10.20.193.28:0/1890941901 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f4b380e0ec0 con 0x7f4b50109ba0 2026-02-20T03:14:49.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.901+0000 7f4b2ffff640 1 -- 10.20.193.28:0/1890941901 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4b38014070 con 0x7f4b50109ba0 2026-02-20T03:14:49.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.901+0000 7f4b4effd640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b200b0e20 0x7f4b200b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:49.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:49.901+0000 7f4b4effd640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b200b0e20 0x7f4b200b32e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b440096f0 tx=0x7f4b44005e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:50.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.010+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} v 0) -- 0x7f4b501a2890 con 0x7f4b50109ba0 2026-02-20T03:14:50.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.342+0000 7f4b2ffff640 1 -- 10.20.193.28:0/1890941901 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]=0 v16) ==== 135+0+0 (secure 0 0 0) 0x7f4b501a2890 con 0x7f4b50109ba0 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b200b0e20 msgr2=0x7f4b200b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b200b0e20 0x7f4b200b32e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b440096f0 tx=0x7f4b44005e10 comp rx=0 tx=0).stop 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b50109ba0 msgr2=0x7f4b501a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b50109ba0 0x7f4b501a1a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b380027e0 tx=0x7f4b38002cb0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 shutdown_connections 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b200b0e20 0x7f4b200b32e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b5010eef0 0x7f4b501a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b50109ba0 0x7f4b501a1a70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 --2- 10.20.193.28:0/1890941901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b50109220 0x7f4b501a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.343+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 >> 10.20.193.28:0/1890941901 conn(0x7f4b50078600 msgr2=0x7f4b50079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.344+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 shutdown_connections 2026-02-20T03:14:50.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.344+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1890941901 wait complete. 2026-02-20T03:14:50.484 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-20T03:14:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:50 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4234225606' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-20T03:14:50.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:50 trial126 ceph-mon[38476]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:50.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:50 trial126 ceph-mon[38476]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:14:50.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:50 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1890941901' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:14:50.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:50 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4234225606' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-20T03:14:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:50 trial028 ceph-mon[38552]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:50 trial028 ceph-mon[38552]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:14:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:50 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1890941901' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:14:50.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:50 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4234225606' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-20T03:14:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:50 trial177 ceph-mon[43181]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:50 trial177 ceph-mon[43181]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:14:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:50 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1890941901' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:14:50.743 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:50.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 -- 10.20.193.28:0/3645107362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f724c113820 msgr2=0x7f724c115c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:50.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 --2- 10.20.193.28:0/3645107362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f724c113820 0x7f724c115c10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f724800b0a0 tx=0x7f724802f410 comp rx=0 tx=0).stop 2026-02-20T03:14:50.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 -- 10.20.193.28:0/3645107362 shutdown_connections 2026-02-20T03:14:50.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 --2- 10.20.193.28:0/3645107362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f724c113820 0x7f724c115c10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 --2- 10.20.193.28:0/3645107362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f724c077f40 0x7f724c1132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 --2- 10.20.193.28:0/3645107362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f724c077620 0x7f724c077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 -- 10.20.193.28:0/3645107362 >> 10.20.193.28:0/3645107362 conn(0x7f724c100680 msgr2=0x7f724c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:50.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 -- 10.20.193.28:0/3645107362 shutdown_connections 2026-02-20T03:14:50.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 -- 10.20.193.28:0/3645107362 wait complete. 2026-02-20T03:14:50.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.927+0000 7f7252b44640 1 Processor -- start 2026-02-20T03:14:50.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7252b44640 1 -- start start 2026-02-20T03:14:50.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7252b44640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f724c077620 0x7f724c1a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:50.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7252b44640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f724c077f40 0x7f724c1a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:50.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7252b44640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f724c113820 0x7f724c1a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:50.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7252b44640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f724c1190b0 con 0x7f724c077f40 2026-02-20T03:14:50.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7252b44640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f724c118f30 con 0x7f724c113820 2026-02-20T03:14:50.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7252b44640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f724c119230 con 0x7f724c077620 2026-02-20T03:14:50.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7251b42640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f724c077620 0x7f724c1a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:50.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7251341640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f724c077f40 0x7f724c1a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7252343640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f724c113820 0x7f724c1a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7251b42640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f724c077620 0x7f724c1a14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48532/0 (socket says 10.20.193.28:48532) 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7251b42640 1 -- 10.20.193.28:0/3863804240 learned_addr learned my addr 10.20.193.28:0/3863804240 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7251341640 1 -- 10.20.193.28:0/3863804240 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f724c077620 msgr2=0x7f724c1a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7251341640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f724c077620 0x7f724c1a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7251341640 1 -- 10.20.193.28:0/3863804240 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f724c113820 msgr2=0x7f724c1a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7251341640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f724c113820 0x7f724c1a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.928+0000 7f7251341640 1 -- 10.20.193.28:0/3863804240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c1a6520 con 0x7f724c077f40 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.929+0000 7f7251341640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f724c077f40 0x7f724c1a1a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f724000e9f0 tx=0x7f724000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.929+0000 7f723affd640 1 -- 10.20.193.28:0/3863804240 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724000cd80 con 0x7f724c077f40 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.929+0000 7f723affd640 1 -- 10.20.193.28:0/3863804240 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7240004570 con 0x7f724c077f40 2026-02-20T03:14:50.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.929+0000 7f723affd640 1 -- 10.20.193.28:0/3863804240 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240010690 con 0x7f724c077f40 2026-02-20T03:14:50.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.929+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724c1a6810 con 0x7f724c077f40 2026-02-20T03:14:50.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.929+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724c1ae050 con 0x7f724c077f40 2026-02-20T03:14:50.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.929+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724c077a00 con 0x7f724c077f40 2026-02-20T03:14:50.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.931+0000 7f723affd640 1 -- 10.20.193.28:0/3863804240 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f7240020030 con 0x7f724c077f40 2026-02-20T03:14:50.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.933+0000 7f723affd640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72280b0e20 0x7f72280b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:50.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.933+0000 7f723affd640 1 -- 10.20.193.28:0/3863804240 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f72400e0970 con 0x7f724c077f40 2026-02-20T03:14:50.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.933+0000 7f7251b42640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72280b0e20 0x7f72280b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:50.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.933+0000 7f723affd640 1 -- 10.20.193.28:0/3863804240 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f72400a48f0 con 0x7f724c077f40 2026-02-20T03:14:50.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:50.934+0000 7f7251b42640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72280b0e20 0x7f72280b32e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f723c009df0 tx=0x7f723c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:51.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.040+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f724c1a2830 con 0x7f724c077f40 2026-02-20T03:14:51.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.347+0000 7f723affd640 1 -- 10.20.193.28:0/3863804240 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f72400a8fb0 con 0x7f724c077f40 2026-02-20T03:14:51.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72280b0e20 msgr2=0x7f72280b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:51.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72280b0e20 0x7f72280b32e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f723c009df0 tx=0x7f723c009290 comp rx=0 tx=0).stop 2026-02-20T03:14:51.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f724c077f40 msgr2=0x7f724c1a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:51.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f724c077f40 0x7f724c1a1a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f724000e9f0 tx=0x7f724000eec0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 shutdown_connections 2026-02-20T03:14:51.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72280b0e20 0x7f72280b32e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f724c113820 0x7f724c1a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f724c077f40 0x7f724c1a1a10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 --2- 10.20.193.28:0/3863804240 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f724c077620 0x7f724c1a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 >> 10.20.193.28:0/3863804240 conn(0x7f724c100680 msgr2=0x7f724c102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:51.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.348+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 shutdown_connections 2026-02-20T03:14:51.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.349+0000 7f7252b44640 1 -- 10.20.193.28:0/3863804240 wait complete. 2026-02-20T03:14:51.453 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-20T03:14:51.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:51 trial126 ceph-mon[38476]: pgmap v181: 129 pgs: 129 active+clean; 581 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 350 B/s wr, 0 op/s 2026-02-20T03:14:51.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:51 trial126 ceph-mon[38476]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-20T03:14:51.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:51 trial126 ceph-mon[38476]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-20T03:14:51.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:51 trial126 ceph-mon[38476]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-20T03:14:51.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:51 trial126 ceph-mon[38476]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:51.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:51 trial126 ceph-mon[38476]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2026-02-20T03:14:51.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:51 trial126 ceph-mon[38476]: daemon mds.i is now active in filesystem cephfs as rank 1 2026-02-20T03:14:51.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:51 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3863804240' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2026-02-20T03:14:51.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:51 trial028 ceph-mon[38552]: pgmap v181: 129 pgs: 129 active+clean; 581 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 350 B/s wr, 0 op/s 2026-02-20T03:14:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:51 trial028 ceph-mon[38552]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-20T03:14:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:51 trial028 ceph-mon[38552]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-20T03:14:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:51 trial028 ceph-mon[38552]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-20T03:14:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:51 trial028 ceph-mon[38552]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:51 trial028 ceph-mon[38552]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2026-02-20T03:14:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:51 trial028 ceph-mon[38552]: daemon mds.i is now active in filesystem cephfs as rank 1 2026-02-20T03:14:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:51 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3863804240' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2026-02-20T03:14:51.715 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:51 trial177 ceph-mon[43181]: pgmap v181: 129 pgs: 129 active+clean; 581 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 350 B/s wr, 0 op/s 2026-02-20T03:14:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:51 trial177 ceph-mon[43181]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-20T03:14:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:51 trial177 ceph-mon[43181]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-20T03:14:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:51 trial177 ceph-mon[43181]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-20T03:14:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:51 trial177 ceph-mon[43181]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-20T03:14:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:51 trial177 ceph-mon[43181]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2026-02-20T03:14:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:51 trial177 ceph-mon[43181]: daemon mds.i is now active in filesystem cephfs as rank 1 2026-02-20T03:14:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:51 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3863804240' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2026-02-20T03:14:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.910+0000 7f49e6a12640 1 -- 10.20.193.28:0/3802894343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e01030a0 msgr2=0x7f49e010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 --2- 10.20.193.28:0/3802894343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e01030a0 0x7f49e010f5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009fc0 tx=0x7f49dc02f3b0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 -- 10.20.193.28:0/3802894343 shutdown_connections 2026-02-20T03:14:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 --2- 10.20.193.28:0/3802894343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e01030a0 0x7f49e010f5d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 --2- 10.20.193.28:0/3802894343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49e0102700 0x7f49e0102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 --2- 10.20.193.28:0/3802894343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49e0108700 0x7f49e0108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 -- 10.20.193.28:0/3802894343 >> 10.20.193.28:0/3802894343 conn(0x7f49e00fe440 msgr2=0x7f49e0100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 -- 10.20.193.28:0/3802894343 shutdown_connections 2026-02-20T03:14:51.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 -- 10.20.193.28:0/3802894343 wait complete. 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 Processor -- start 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.911+0000 7f49e6a12640 1 -- start start 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e6a12640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e0102700 0x7f49e019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e6a12640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49e01030a0 0x7f49e019d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e6a12640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49e0108700 0x7f49e01a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e6a12640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0112970 con 0x7f49e0102700 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e6a12640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f49e01127f0 con 0x7f49e01030a0 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e6a12640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0112af0 con 0x7f49e0108700 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e5a10640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e0102700 0x7f49e019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e5a10640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e0102700 0x7f49e019cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59994/0 (socket says 10.20.193.28:59994) 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e5a10640 1 -- 10.20.193.28:0/534552357 learned_addr learned my addr 10.20.193.28:0/534552357 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e520f640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49e01030a0 0x7f49e019d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:51.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e6211640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49e0108700 0x7f49e01a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e5a10640 1 -- 10.20.193.28:0/534552357 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49e0108700 msgr2=0x7f49e01a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e5a10640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49e0108700 0x7f49e01a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e5a10640 1 -- 10.20.193.28:0/534552357 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49e01030a0 msgr2=0x7f49e019d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e5a10640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49e01030a0 0x7f49e019d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e5a10640 1 -- 10.20.193.28:0/534552357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e01a2000 con 0x7f49e0102700 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.912+0000 7f49e5a10640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e0102700 0x7f49e019cfb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f49d000ea10 tx=0x7f49d000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.913+0000 7f49ceffd640 1 -- 10.20.193.28:0/534552357 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d000ce50 con 0x7f49e0102700 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.913+0000 7f49ceffd640 1 -- 10.20.193.28:0/534552357 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f49d0004570 con 0x7f49e0102700 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.913+0000 7f49ceffd640 1 -- 10.20.193.28:0/534552357 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0010670 con 0x7f49e0102700 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.913+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e01a22f0 con 0x7f49e0102700 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.913+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e01a9b30 con 0x7f49e0102700 2026-02-20T03:14:51.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.913+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e0102b60 con 0x7f49e0102700 2026-02-20T03:14:51.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.915+0000 7f49ceffd640 1 -- 10.20.193.28:0/534552357 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f49d00040d0 con 0x7f49e0102700 2026-02-20T03:14:51.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.917+0000 7f49ceffd640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49bc0b0fc0 0x7f49bc0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:51.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.917+0000 7f49ceffd640 1 -- 10.20.193.28:0/534552357 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f49d00e0e50 con 0x7f49e0102700 2026-02-20T03:14:51.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.917+0000 7f49e520f640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49bc0b0fc0 0x7f49bc0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:51.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.917+0000 7f49ceffd640 1 -- 10.20.193.28:0/534552357 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f49d00e1370 con 0x7f49e0102700 2026-02-20T03:14:51.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:51.918+0000 7f49e520f640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49bc0b0fc0 0x7f49bc0b3480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f49e0077300 tx=0x7f49d4005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:52.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.024+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f49e01a9e60 con 0x7f49e0102700 2026-02-20T03:14:52.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.353+0000 7f49ceffd640 1 -- 10.20.193.28:0/534552357 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f49d00a9490 con 0x7f49e0102700 2026-02-20T03:14:52.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49bc0b0fc0 msgr2=0x7f49bc0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:52.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49bc0b0fc0 0x7f49bc0b3480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f49e0077300 tx=0x7f49d4005f50 comp rx=0 tx=0).stop 2026-02-20T03:14:52.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e0102700 msgr2=0x7f49e019cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:52.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e0102700 0x7f49e019cfb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f49d000ea10 tx=0x7f49d000eee0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 shutdown_connections 2026-02-20T03:14:52.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f49bc0b0fc0 0x7f49bc0b3480 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f49e0108700 0x7f49e01a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f49e01030a0 0x7f49e019d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 --2- 10.20.193.28:0/534552357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f49e0102700 0x7f49e019cfb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 >> 10.20.193.28:0/534552357 conn(0x7f49e00fe440 msgr2=0x7f49e00ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:52.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.354+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 shutdown_connections 2026-02-20T03:14:52.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.355+0000 7f49e6a12640 1 -- 10.20.193.28:0/534552357 wait complete. 2026-02-20T03:14:52.457 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2026-02-20T03:14:52.458 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-20T03:14:52.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3863804240' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-20T03:14:52.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] up:active 2026-02-20T03:14:52.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-20T03:14:52.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-20T03:14:52.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: Cluster is now healthy 2026-02-20T03:14:52.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2026-02-20T03:14:52.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2026-02-20T03:14:52.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-20T03:14:52.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: pgmap v182: 129 pgs: 129 active+clean; 582 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 426 B/s wr, 1 op/s 2026-02-20T03:14:52.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:52 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/534552357' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2026-02-20T03:14:52.727 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:52.772 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3863804240' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-20T03:14:52.772 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] up:active 2026-02-20T03:14:52.772 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-20T03:14:52.772 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-20T03:14:52.772 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: Cluster is now healthy 2026-02-20T03:14:52.772 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2026-02-20T03:14:52.772 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2026-02-20T03:14:52.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-20T03:14:52.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: pgmap v182: 129 pgs: 129 active+clean; 582 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 426 B/s wr, 1 op/s 2026-02-20T03:14:52.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:52 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/534552357' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2026-02-20T03:14:52.848 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:14:52.514+0000 7ff73e2ef640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2026-02-20T03:14:52.848 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:14:52.514+0000 7ff73e2ef640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2026-02-20T03:14:52.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3863804240' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-20T03:14:52.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] up:active 2026-02-20T03:14:52.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-20T03:14:52.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-20T03:14:52.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: Cluster is now healthy 2026-02-20T03:14:52.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2026-02-20T03:14:52.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2026-02-20T03:14:52.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-20T03:14:52.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: pgmap v182: 129 pgs: 129 active+clean; 582 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 426 B/s wr, 1 op/s 2026-02-20T03:14:52.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:52 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/534552357' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2026-02-20T03:14:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.919+0000 7fa44b224640 1 -- 10.20.193.28:0/2961737369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa444109480 msgr2=0x7fa444109860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.919+0000 7fa44b224640 1 --2- 10.20.193.28:0/2961737369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa444109480 0x7fa444109860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa434009a30 tx=0x7fa43402f220 comp rx=0 tx=0).stop 2026-02-20T03:14:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.919+0000 7fa44b224640 1 -- 10.20.193.28:0/2961737369 shutdown_connections 2026-02-20T03:14:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.919+0000 7fa44b224640 1 --2- 10.20.193.28:0/2961737369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa44410e420 0x7fa444115fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.919+0000 7fa44b224640 1 --2- 10.20.193.28:0/2961737369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa444109e30 0x7fa44410dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.919+0000 7fa44b224640 1 --2- 10.20.193.28:0/2961737369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa444109480 0x7fa444109860 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.919+0000 7fa44b224640 1 -- 10.20.193.28:0/2961737369 >> 10.20.193.28:0/2961737369 conn(0x7fa444078890 msgr2=0x7fa44407acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.919+0000 7fa44b224640 1 -- 10.20.193.28:0/2961737369 shutdown_connections 2026-02-20T03:14:52.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.919+0000 7fa44b224640 1 -- 10.20.193.28:0/2961737369 wait complete. 2026-02-20T03:14:52.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44b224640 1 Processor -- start 2026-02-20T03:14:52.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44b224640 1 -- start start 2026-02-20T03:14:52.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44b224640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa444109480 0x7fa4441a7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:52.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44b224640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa444109e30 0x7fa4441a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:52.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44b224640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa44410e420 0x7fa4441a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44b224640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441192d0 con 0x7fa44410e420 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44b224640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa444119150 con 0x7fa444109e30 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44b224640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa444119450 con 0x7fa444109480 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44979a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa44410e420 0x7fa4441a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44979a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa44410e420 0x7fa4441a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60010/0 (socket says 10.20.193.28:60010) 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa44979a640 1 -- 10.20.193.28:0/1869663394 learned_addr learned my addr 10.20.193.28:0/1869663394 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.920+0000 7fa43bfff640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa444109e30 0x7fa4441a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa448f99640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa444109480 0x7fa4441a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa44979a640 1 -- 10.20.193.28:0/1869663394 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa444109480 msgr2=0x7fa4441a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa44979a640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa444109480 0x7fa4441a7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa44979a640 1 -- 10.20.193.28:0/1869663394 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa444109e30 msgr2=0x7fa4441a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:52.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa44979a640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa444109e30 0x7fa4441a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:52.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa44979a640 1 -- 10.20.193.28:0/1869663394 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4441a1f40 con 0x7fa44410e420 2026-02-20T03:14:52.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa44979a640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa44410e420 0x7fa4441a1680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa4400060b0 tx=0x7fa44000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:52.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa439ffb640 1 -- 10.20.193.28:0/1869663394 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4400090d0 con 0x7fa44410e420 2026-02-20T03:14:52.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa439ffb640 1 -- 10.20.193.28:0/1869663394 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa440009270 con 0x7fa44410e420 2026-02-20T03:14:52.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa439ffb640 1 -- 10.20.193.28:0/1869663394 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4400136e0 con 0x7fa44410e420 2026-02-20T03:14:52.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4441a21d0 con 0x7fa44410e420 2026-02-20T03:14:52.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.921+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4441ae510 con 0x7fa44410e420 2026-02-20T03:14:52.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.922+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa40c005390 con 0x7fa44410e420 2026-02-20T03:14:52.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.924+0000 7fa439ffb640 1 -- 10.20.193.28:0/1869663394 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fa440012070 con 0x7fa44410e420 2026-02-20T03:14:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.925+0000 7fa439ffb640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4200b0da0 0x7fa4200b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.925+0000 7fa439ffb640 1 -- 10.20.193.28:0/1869663394 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fa4400e0500 con 0x7fa44410e420 2026-02-20T03:14:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.925+0000 7fa439ffb640 1 -- 10.20.193.28:0/1869663394 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa440010070 con 0x7fa44410e420 2026-02-20T03:14:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.925+0000 7fa448f99640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4200b0da0 0x7fa4200b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:52.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:52.926+0000 7fa448f99640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4200b0da0 0x7fa4200b3260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa4340059c0 tx=0x7fa434005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:53.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.028+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa40c002bf0 con 0x7fa4200b0da0 2026-02-20T03:14:53.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.045+0000 7fa439ffb640 1 -- 10.20.193.28:0/1869663394 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa40c002bf0 con 0x7fa4200b0da0 2026-02-20T03:14:53.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4200b0da0 msgr2=0x7fa4200b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:53.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4200b0da0 0x7fa4200b3260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa4340059c0 tx=0x7fa434005950 comp rx=0 tx=0).stop 2026-02-20T03:14:53.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa44410e420 msgr2=0x7fa4441a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:53.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa44410e420 0x7fa4441a1680 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa4400060b0 tx=0x7fa44000d4a0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 shutdown_connections 2026-02-20T03:14:53.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa4200b0da0 0x7fa4200b3260 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa44410e420 0x7fa4441a1680 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa444109e30 0x7fa4441a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 --2- 10.20.193.28:0/1869663394 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa444109480 0x7fa4441a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 >> 10.20.193.28:0/1869663394 conn(0x7fa444078890 msgr2=0x7fa444079d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:53.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 shutdown_connections 2026-02-20T03:14:53.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.046+0000 7fa44b224640 1 -- 10.20.193.28:0/1869663394 wait complete. 2026-02-20T03:14:53.151 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-20T03:14:53.351 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:14:53 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:14:53.035+0000 7ff7cb10b640 -1 client.14685 error registering admin socket command: (17) File exists 2026-02-20T03:14:53.418 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:53.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.601+0000 7f90f36f5640 1 -- 10.20.193.28:0/4280925658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ec10a990 msgr2=0x7f90ec10ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:53.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.601+0000 7f90f36f5640 1 --2- 10.20.193.28:0/4280925658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ec10a990 0x7f90ec10ad70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009a60 tx=0x7f90e402f270 comp rx=0 tx=0).stop 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.602+0000 7f90f36f5640 1 -- 10.20.193.28:0/4280925658 shutdown_connections 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.602+0000 7f90f36f5640 1 --2- 10.20.193.28:0/4280925658 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ec105330 0x7f90ec111860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.602+0000 7f90f36f5640 1 --2- 10.20.193.28:0/4280925658 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ec104990 0x7f90ec104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.602+0000 7f90f36f5640 1 --2- 10.20.193.28:0/4280925658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ec10a990 0x7f90ec10ad70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.602+0000 7f90f36f5640 1 -- 10.20.193.28:0/4280925658 >> 10.20.193.28:0/4280925658 conn(0x7f90ec100690 msgr2=0x7f90ec102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.602+0000 7f90f36f5640 1 -- 10.20.193.28:0/4280925658 shutdown_connections 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.602+0000 7f90f36f5640 1 -- 10.20.193.28:0/4280925658 wait complete. 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.602+0000 7f90f36f5640 1 Processor -- start 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.602+0000 7f90f36f5640 1 -- start start 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f36f5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ec104990 0x7f90ec19d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:53.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f36f5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ec105330 0x7f90ec19d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f36f5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ec10a990 0x7f90ec1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f36f5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec114bc0 con 0x7f90ec104990 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f36f5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec114a40 con 0x7f90ec10a990 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f36f5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec114d40 con 0x7f90ec105330 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f26f3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ec104990 0x7f90ec19d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f1ef2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ec105330 0x7f90ec19d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f2ef4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ec10a990 0x7f90ec1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f1ef2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ec105330 0x7f90ec19d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48620/0 (socket says 10.20.193.28:48620) 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f1ef2640 1 -- 10.20.193.28:0/2182679762 learned_addr learned my addr 10.20.193.28:0/2182679762 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f1ef2640 1 -- 10.20.193.28:0/2182679762 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ec10a990 msgr2=0x7f90ec1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f1ef2640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ec10a990 0x7f90ec1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f1ef2640 1 -- 10.20.193.28:0/2182679762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ec104990 msgr2=0x7f90ec19d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:53.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f1ef2640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ec104990 0x7f90ec19d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.603+0000 7f90f1ef2640 1 -- 10.20.193.28:0/2182679762 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec1a20c0 con 0x7f90ec105330 2026-02-20T03:14:53.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.604+0000 7f90f1ef2640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ec105330 0x7f90ec19d5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90d800ea10 tx=0x7f90d800eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:53.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.604+0000 7f90d77fe640 1 -- 10.20.193.28:0/2182679762 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d800ce50 con 0x7f90ec105330 2026-02-20T03:14:53.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.604+0000 7f90d77fe640 1 -- 10.20.193.28:0/2182679762 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f90d8004570 con 0x7f90ec105330 2026-02-20T03:14:53.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.604+0000 7f90d77fe640 1 -- 10.20.193.28:0/2182679762 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8010690 con 0x7f90ec105330 2026-02-20T03:14:53.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.604+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ec1a23b0 con 0x7f90ec105330 2026-02-20T03:14:53.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.604+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ec1a9bf0 con 0x7f90ec105330 2026-02-20T03:14:53.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.604+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ec1060d0 con 0x7f90ec105330 2026-02-20T03:14:53.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:53 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/534552357' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-20T03:14:53.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:53 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] up:active 2026-02-20T03:14:53.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:53 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2026-02-20T03:14:53.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:53 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:14:53.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:53 trial028 ceph-mon[38552]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:53.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.606+0000 7f90d77fe640 1 -- 10.20.193.28:0/2182679762 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7f90d8020030 con 0x7f90ec105330 2026-02-20T03:14:53.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.608+0000 7f90d77fe640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90c80b1040 0x7f90c80b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:53.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.608+0000 7f90f26f3640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90c80b1040 0x7f90c80b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:53.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.608+0000 7f90d77fe640 1 -- 10.20.193.28:0/2182679762 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f90d80e0a40 con 0x7f90ec105330 2026-02-20T03:14:53.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.609+0000 7f90d77fe640 1 -- 10.20.193.28:0/2182679762 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f90d80a4960 con 0x7f90ec105330 2026-02-20T03:14:53.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.609+0000 7f90f26f3640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90c80b1040 0x7f90c80b3500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90e402f780 tx=0x7f90e40023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:53.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.711+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f90ec10ca00 con 0x7f90c80b1040 2026-02-20T03:14:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:53 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/534552357' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-20T03:14:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:53 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] up:active 2026-02-20T03:14:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:53 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2026-02-20T03:14:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:53 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:14:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:53 trial177 ceph-mon[43181]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:53.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.724+0000 7f90d77fe640 1 -- 10.20.193.28:0/2182679762 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f90ec10ca00 con 0x7f90c80b1040 2026-02-20T03:14:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90c80b1040 msgr2=0x7f90c80b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90c80b1040 0x7f90c80b3500 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90e402f780 tx=0x7f90e40023d0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ec105330 msgr2=0x7f90ec19d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ec105330 0x7f90ec19d5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f90d800ea10 tx=0x7f90d800eee0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 shutdown_connections 2026-02-20T03:14:53.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90c80b1040 0x7f90c80b3500 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ec10a990 0x7f90ec1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ec105330 0x7f90ec19d5b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 --2- 10.20.193.28:0/2182679762 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ec104990 0x7f90ec19d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 >> 10.20.193.28:0/2182679762 conn(0x7f90ec100690 msgr2=0x7f90ec101040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 shutdown_connections 2026-02-20T03:14:53.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:53.725+0000 7f90f36f5640 1 -- 10.20.193.28:0/2182679762 wait complete. 2026-02-20T03:14:53.829 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-20T03:14:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:53 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/534552357' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-20T03:14:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:53 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] up:active 2026-02-20T03:14:53.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:53 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2026-02-20T03:14:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:53 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:14:53.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:53 trial126 ceph-mon[38476]: from='client.14679 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:54.096 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.277+0000 7fd872c9f640 1 -- 10.20.193.28:0/783716054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd86c102700 msgr2=0x7fd86c102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.277+0000 7fd872c9f640 1 --2- 10.20.193.28:0/783716054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd86c102700 0x7fd86c102b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd860009a30 tx=0x7fd86002f220 comp rx=0 tx=0).stop 2026-02-20T03:14:54.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.277+0000 7fd872c9f640 1 -- 10.20.193.28:0/783716054 shutdown_connections 2026-02-20T03:14:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.277+0000 7fd872c9f640 1 --2- 10.20.193.28:0/783716054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd86c1030a0 0x7fd86c10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.277+0000 7fd872c9f640 1 --2- 10.20.193.28:0/783716054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd86c102700 0x7fd86c102b60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.277+0000 7fd872c9f640 1 --2- 10.20.193.28:0/783716054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd86c108700 0x7fd86c108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.277+0000 7fd872c9f640 1 -- 10.20.193.28:0/783716054 >> 10.20.193.28:0/783716054 conn(0x7fd86c0fe440 msgr2=0x7fd86c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.277+0000 7fd872c9f640 1 -- 10.20.193.28:0/783716054 shutdown_connections 2026-02-20T03:14:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.277+0000 7fd872c9f640 1 -- 10.20.193.28:0/783716054 wait complete. 2026-02-20T03:14:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd872c9f640 1 Processor -- start 2026-02-20T03:14:54.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd872c9f640 1 -- start start 2026-02-20T03:14:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd872c9f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd86c102700 0x7fd86c19d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd872c9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd86c1030a0 0x7fd86c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd872c9f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd86c108700 0x7fd86c1a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd872c9f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c112970 con 0x7fd86c1030a0 2026-02-20T03:14:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd872c9f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c1127f0 con 0x7fd86c102700 2026-02-20T03:14:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd872c9f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c112af0 con 0x7fd86c108700 2026-02-20T03:14:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd87149c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd86c1030a0 0x7fd86c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:54.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd87149c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd86c1030a0 0x7fd86c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60064/0 (socket says 10.20.193.28:60064) 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd87149c640 1 -- 10.20.193.28:0/1804804615 learned_addr learned my addr 10.20.193.28:0/1804804615 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd871c9d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd86c102700 0x7fd86c19d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd87249e640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd86c108700 0x7fd86c1a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd87149c640 1 -- 10.20.193.28:0/1804804615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd86c108700 msgr2=0x7fd86c1a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd87149c640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd86c108700 0x7fd86c1a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd87149c640 1 -- 10.20.193.28:0/1804804615 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd86c102700 msgr2=0x7fd86c19d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd87149c640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd86c102700 0x7fd86c19d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.278+0000 7fd87149c640 1 -- 10.20.193.28:0/1804804615 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86c1a2150 con 0x7fd86c1030a0 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.279+0000 7fd87149c640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd86c1030a0 0x7fd86c19d640 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd86002f730 tx=0x7fd86002fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:54.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.279+0000 7fd85affd640 1 -- 10.20.193.28:0/1804804615 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8600384e0 con 0x7fd86c1030a0 2026-02-20T03:14:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.279+0000 7fd85affd640 1 -- 10.20.193.28:0/1804804615 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd860038770 con 0x7fd86c1030a0 2026-02-20T03:14:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.279+0000 7fd85affd640 1 -- 10.20.193.28:0/1804804615 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd860042680 con 0x7fd86c1030a0 2026-02-20T03:14:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.279+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86c1a23e0 con 0x7fd86c1030a0 2026-02-20T03:14:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.279+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd86c1a9c80 con 0x7fd86c1030a0 2026-02-20T03:14:54.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.280+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86c102b60 con 0x7fd86c1030a0 2026-02-20T03:14:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.282+0000 7fd85affd640 1 -- 10.20.193.28:0/1804804615 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 15) ==== 149705+0+0 (secure 0 0 0) 0x7fd860038920 con 0x7fd86c1030a0 2026-02-20T03:14:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.283+0000 7fd85affd640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8480b0e20 0x7fd8480b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.283+0000 7fd85affd640 1 -- 10.20.193.28:0/1804804615 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fd860104f20 con 0x7fd86c1030a0 2026-02-20T03:14:54.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.283+0000 7fd871c9d640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8480b0e20 0x7fd8480b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:54.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.284+0000 7fd871c9d640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8480b0e20 0x7fd8480b32e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd85c004480 tx=0x7fd85c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:54.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.285+0000 7fd85affd640 1 -- 10.20.193.28:0/1804804615 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd860047060 con 0x7fd86c1030a0 2026-02-20T03:14:54.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.368+0000 7fd85affd640 1 -- 10.20.193.28:0/1804804615 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fd8600c8e40 con 0x7fd86c1030a0 2026-02-20T03:14:54.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.388+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fd86c10e1f0 con 0x7fd8480b0e20 2026-02-20T03:14:54.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.391+0000 7fd85affd640 1 -- 10.20.193.28:0/1804804615 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd86c10e1f0 con 0x7fd8480b0e20 2026-02-20T03:14:54.394 INFO:teuthology.orchestra.run.trial028.stdout:/volumes/qa/sv_0/d852f002-9869-4832-a0e1-b729ecbbd140 2026-02-20T03:14:54.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:54 trial028 ceph-mon[38552]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:54.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:54 trial028 ceph-mon[38552]: pgmap v183: 129 pgs: 129 active+clean; 582 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 511 B/s rd, 1.2 KiB/s wr, 4 op/s 2026-02-20T03:14:54.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8480b0e20 msgr2=0x7fd8480b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:54.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8480b0e20 0x7fd8480b32e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd85c004480 tx=0x7fd85c009290 comp rx=0 tx=0).stop 2026-02-20T03:14:54.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd86c1030a0 msgr2=0x7fd86c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:54.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd86c1030a0 0x7fd86c19d640 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd86002f730 tx=0x7fd86002fcb0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 shutdown_connections 2026-02-20T03:14:54.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8480b0e20 0x7fd8480b32e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd86c108700 0x7fd86c1a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd86c1030a0 0x7fd86c19d640 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 --2- 10.20.193.28:0/1804804615 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd86c102700 0x7fd86c19d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 >> 10.20.193.28:0/1804804615 conn(0x7fd86c0fe440 msgr2=0x7fd86c10dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:54.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 shutdown_connections 2026-02-20T03:14:54.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.393+0000 7fd872c9f640 1 -- 10.20.193.28:0/1804804615 wait complete. 2026-02-20T03:14:54.497 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-20T03:14:54.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:54 trial177 ceph-mon[43181]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:54.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:54 trial177 ceph-mon[43181]: pgmap v183: 129 pgs: 129 active+clean; 582 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 511 B/s rd, 1.2 KiB/s wr, 4 op/s 2026-02-20T03:14:54.762 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:54.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:54 trial126 ceph-mon[38476]: from='client.24721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:54.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:54 trial126 ceph-mon[38476]: pgmap v183: 129 pgs: 129 active+clean; 582 KiB data, 349 MiB used, 8.2 TiB / 8.2 TiB avail; 511 B/s rd, 1.2 KiB/s wr, 4 op/s 2026-02-20T03:14:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.948+0000 7f73b99ae640 1 -- 10.20.193.28:0/321969632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 msgr2=0x7f73b4104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.948+0000 7f73b99ae640 1 --2- 10.20.193.28:0/321969632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 0x7f73b4104de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f739c009a60 tx=0x7f739c02f250 comp rx=0 tx=0).stop 2026-02-20T03:14:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.948+0000 7f73b99ae640 1 -- 10.20.193.28:0/321969632 shutdown_connections 2026-02-20T03:14:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.948+0000 7f73b99ae640 1 --2- 10.20.193.28:0/321969632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73b4105320 0x7f73b4111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.948+0000 7f73b99ae640 1 --2- 10.20.193.28:0/321969632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 0x7f73b4104de0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.948+0000 7f73b99ae640 1 --2- 10.20.193.28:0/321969632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f73b410a980 0x7f73b410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.948+0000 7f73b99ae640 1 -- 10.20.193.28:0/321969632 >> 10.20.193.28:0/321969632 conn(0x7f73b4100680 msgr2=0x7f73b4102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.948+0000 7f73b99ae640 1 -- 10.20.193.28:0/321969632 shutdown_connections 2026-02-20T03:14:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.948+0000 7f73b99ae640 1 -- 10.20.193.28:0/321969632 wait complete. 2026-02-20T03:14:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b99ae640 1 Processor -- start 2026-02-20T03:14:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b99ae640 1 -- start start 2026-02-20T03:14:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b99ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 0x7f73b4110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b99ae640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f73b4105320 0x7f73b4110640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b99ae640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73b410a980 0x7f73b41ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b99ae640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f73b40785f0 con 0x7f73b4104980 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b99ae640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f73b4078470 con 0x7f73b4105320 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b99ae640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f73b4078770 con 0x7f73b410a980 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b89ac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 0x7f73b4110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73abfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f73b4105320 0x7f73b4110640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b89ac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 0x7f73b4110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60084/0 (socket says 10.20.193.28:60084) 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b89ac640 1 -- 10.20.193.28:0/2127607299 learned_addr learned my addr 10.20.193.28:0/2127607299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.949+0000 7f73b91ad640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73b410a980 0x7f73b41ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73b89ac640 1 -- 10.20.193.28:0/2127607299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73b410a980 msgr2=0x7f73b41ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:54.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73b89ac640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73b410a980 0x7f73b41ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73b89ac640 1 -- 10.20.193.28:0/2127607299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f73b4105320 msgr2=0x7f73b4110640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73b89ac640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f73b4105320 0x7f73b4110640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73b89ac640 1 -- 10.20.193.28:0/2127607299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b41ad8a0 con 0x7f73b4104980 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73b89ac640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 0x7f73b4110100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f73a400d950 tx=0x7f73a400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73a9ffb640 1 -- 10.20.193.28:0/2127607299 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4014070 con 0x7f73b4104980 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73a9ffb640 1 -- 10.20.193.28:0/2127607299 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f73a40044e0 con 0x7f73b4104980 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73a9ffb640 1 -- 10.20.193.28:0/2127607299 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4010460 con 0x7f73b4104980 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b41adb90 con 0x7f73b4104980 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.950+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b41ae080 con 0x7f73b4104980 2026-02-20T03:14:54.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.951+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73b4104de0 con 0x7f73b4104980 2026-02-20T03:14:54.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.954+0000 7f73a9ffb640 1 -- 10.20.193.28:0/2127607299 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f73a40026e0 con 0x7f73b4104980 2026-02-20T03:14:54.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.955+0000 7f73a9ffb640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73900b0f30 0x7f73900b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:54.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.955+0000 7f73a9ffb640 1 -- 10.20.193.28:0/2127607299 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f73a40e0ad0 con 0x7f73b4104980 2026-02-20T03:14:54.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.955+0000 7f73abfff640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73900b0f30 0x7f73900b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:54.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.955+0000 7f73a9ffb640 1 -- 10.20.193.28:0/2127607299 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f73a40a8f50 con 0x7f73b4104980 2026-02-20T03:14:54.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:54.956+0000 7f73abfff640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73900b0f30 0x7f73900b33f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f739c005bb0 tx=0x7f739c005b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:55.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.057+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f73b41010b0 con 0x7f73900b0f30 2026-02-20T03:14:55.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.069+0000 7f73a9ffb640 1 -- 10.20.193.28:0/2127607299 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f73b41010b0 con 0x7f73900b0f30 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.070+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73900b0f30 msgr2=0x7f73900b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.070+0000 7f73b99ae640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73900b0f30 0x7f73900b33f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f739c005bb0 tx=0x7f739c005b40 comp rx=0 tx=0).stop 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.070+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 msgr2=0x7f73b4110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.070+0000 7f73b99ae640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 0x7f73b4110100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f73a400d950 tx=0x7f73a400de20 comp rx=0 tx=0).stop 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.071+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 shutdown_connections 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.071+0000 7f73b99ae640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73900b0f30 0x7f73900b33f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.071+0000 7f73b99ae640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f73b410a980 0x7f73b41ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.071+0000 7f73b99ae640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f73b4105320 0x7f73b4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.071+0000 7f73b99ae640 1 --2- 10.20.193.28:0/2127607299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f73b4104980 0x7f73b4110100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.071+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 >> 10.20.193.28:0/2127607299 conn(0x7f73b4100680 msgr2=0x7f73b407ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.071+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 shutdown_connections 2026-02-20T03:14:55.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.071+0000 7f73b99ae640 1 -- 10.20.193.28:0/2127607299 wait complete. 2026-02-20T03:14:55.172 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-20T03:14:55.437 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:55.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.620+0000 7ff81bfff640 1 -- 10.20.193.28:0/963166455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff81c06f3f0 msgr2=0x7ff81c1114d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:55.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.620+0000 7ff81bfff640 1 --2- 10.20.193.28:0/963166455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff81c06f3f0 0x7ff81c1114d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff810009a60 tx=0x7ff81002f250 comp rx=0 tx=0).stop 2026-02-20T03:14:55.624 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:55 trial028 ceph-mon[38552]: mgrmap e16: x(active, since 3m), standbys: z, y 2026-02-20T03:14:55.624 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:55 trial028 ceph-mon[38552]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:55.624 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:55 trial028 ceph-mon[38552]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:55.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.620+0000 7ff81bfff640 1 -- 10.20.193.28:0/963166455 shutdown_connections 2026-02-20T03:14:55.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.620+0000 7ff81bfff640 1 --2- 10.20.193.28:0/963166455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff81c10adf0 0x7ff81c11e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.620+0000 7ff81bfff640 1 --2- 10.20.193.28:0/963166455 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff81c10a470 0x7ff81c10a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.620+0000 7ff81bfff640 1 --2- 10.20.193.28:0/963166455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff81c06f3f0 0x7ff81c1114d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.620+0000 7ff81bfff640 1 -- 10.20.193.28:0/963166455 >> 10.20.193.28:0/963166455 conn(0x7ff81c06e070 msgr2=0x7ff81c06e480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.620+0000 7ff81bfff640 1 -- 10.20.193.28:0/963166455 shutdown_connections 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.621+0000 7ff81bfff640 1 -- 10.20.193.28:0/963166455 wait complete. 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.621+0000 7ff81bfff640 1 Processor -- start 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.621+0000 7ff81bfff640 1 -- start start 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff81c06f3f0 0x7ff81c1a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff81c10a470 0x7ff81c1aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff81c10adf0 0x7ff81c1ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c121b50 con 0x7ff81c10adf0 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81bfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c1219d0 con 0x7ff81c10a470 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81bfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c121cd0 con 0x7ff81c06f3f0 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff81c10adf0 0x7ff81c1ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:55.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff81c06f3f0 0x7ff81c1a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff81c06f3f0 0x7ff81c1a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48662/0 (socket says 10.20.193.28:48662) 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81affd640 1 -- 10.20.193.28:0/528419348 learned_addr learned my addr 10.20.193.28:0/528419348 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81a7fc640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff81c10a470 0x7ff81c1aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81b7fe640 1 -- 10.20.193.28:0/528419348 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff81c06f3f0 msgr2=0x7ff81c1a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81b7fe640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff81c06f3f0 0x7ff81c1a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81b7fe640 1 -- 10.20.193.28:0/528419348 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff81c10a470 msgr2=0x7ff81c1aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81b7fe640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff81c10a470 0x7ff81c1aa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81b7fe640 1 -- 10.20.193.28:0/528419348 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c1af040 con 0x7ff81c10adf0 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.622+0000 7ff81b7fe640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff81c10adf0 0x7ff81c1ae8c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00efc0 tx=0x7ff80c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.623+0000 7ff7fbfff640 1 -- 10.20.193.28:0/528419348 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c019070 con 0x7ff81c10adf0 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.623+0000 7ff7fbfff640 1 -- 10.20.193.28:0/528419348 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff80c0092d0 con 0x7ff81c10adf0 2026-02-20T03:14:55.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.623+0000 7ff7fbfff640 1 -- 10.20.193.28:0/528419348 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c007500 con 0x7ff81c10adf0 2026-02-20T03:14:55.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.623+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c1af2d0 con 0x7ff81c10adf0 2026-02-20T03:14:55.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.623+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c1b6b70 con 0x7ff81c10adf0 2026-02-20T03:14:55.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.623+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c10a8b0 con 0x7ff81c10adf0 2026-02-20T03:14:55.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.626+0000 7ff7fbfff640 1 -- 10.20.193.28:0/528419348 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7ff80c002a60 con 0x7ff81c10adf0 2026-02-20T03:14:55.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.627+0000 7ff7fbfff640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7ec0b0eb0 0x7ff7ec0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:55.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.627+0000 7ff7fbfff640 1 -- 10.20.193.28:0/528419348 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ff80c0e0930 con 0x7ff81c10adf0 2026-02-20T03:14:55.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.628+0000 7ff81affd640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7ec0b0eb0 0x7ff7ec0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:55.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.628+0000 7ff7fbfff640 1 -- 10.20.193.28:0/528419348 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff80c023080 con 0x7ff81c10adf0 2026-02-20T03:14:55.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.628+0000 7ff81affd640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7ec0b0eb0 0x7ff7ec0b3370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff8100097c0 tx=0x7ff8100057f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:55 trial177 ceph-mon[43181]: mgrmap e16: x(active, since 3m), standbys: z, y 2026-02-20T03:14:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:55 trial177 ceph-mon[43181]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:55 trial177 ceph-mon[43181]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:55.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.731+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ff81c10c700 con 0x7ff7ec0b0eb0 2026-02-20T03:14:55.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.734+0000 7ff7fbfff640 1 -- 10.20.193.28:0/528419348 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ff81c10c700 con 0x7ff7ec0b0eb0 2026-02-20T03:14:55.736 INFO:teuthology.orchestra.run.trial028.stdout:/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021 2026-02-20T03:14:55.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.734+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7ec0b0eb0 msgr2=0x7ff7ec0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:55.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.734+0000 7ff81bfff640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7ec0b0eb0 0x7ff7ec0b3370 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff8100097c0 tx=0x7ff8100057f0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.734+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff81c10adf0 msgr2=0x7ff81c1ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:55.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.734+0000 7ff81bfff640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff81c10adf0 0x7ff81c1ae8c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00efc0 tx=0x7ff80c00c490 comp rx=0 tx=0).stop 2026-02-20T03:14:55.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.735+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 shutdown_connections 2026-02-20T03:14:55.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.735+0000 7ff81bfff640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7ec0b0eb0 0x7ff7ec0b3370 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.735+0000 7ff81bfff640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff81c10adf0 0x7ff81c1ae8c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.735+0000 7ff81bfff640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff81c10a470 0x7ff81c1aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.735+0000 7ff81bfff640 1 --2- 10.20.193.28:0/528419348 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff81c06f3f0 0x7ff81c1a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:55.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.735+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 >> 10.20.193.28:0/528419348 conn(0x7ff81c06e070 msgr2=0x7ff81c11c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:55.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.735+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 shutdown_connections 2026-02-20T03:14:55.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:55.735+0000 7ff81bfff640 1 -- 10.20.193.28:0/528419348 wait complete. 2026-02-20T03:14:55.836 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:14:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:55 trial126 ceph-mon[38476]: mgrmap e16: x(active, since 3m), standbys: z, y 2026-02-20T03:14:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:55 trial126 ceph-mon[38476]: from='client.14697 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:55.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:55 trial126 ceph-mon[38476]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:56.099 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:56.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.291+0000 7fa75b736640 1 -- 10.20.193.28:0/4039788219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa75410f0b0 msgr2=0x7fa7541114a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.291+0000 7fa75b736640 1 --2- 10.20.193.28:0/4039788219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa75410f0b0 0x7fa7541114a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa74800b0a0 tx=0x7fa74802f4a0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.291+0000 7fa75b736640 1 -- 10.20.193.28:0/4039788219 shutdown_connections 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.291+0000 7fa75b736640 1 --2- 10.20.193.28:0/4039788219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa75410f0b0 0x7fa7541114a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.291+0000 7fa75b736640 1 --2- 10.20.193.28:0/4039788219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa754075cd0 0x7fa75410eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.291+0000 7fa75b736640 1 --2- 10.20.193.28:0/4039788219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7540753b0 0x7fa754075790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.291+0000 7fa75b736640 1 -- 10.20.193.28:0/4039788219 >> 10.20.193.28:0/4039788219 conn(0x7fa7540fe410 msgr2=0x7fa754100830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.291+0000 7fa75b736640 1 -- 10.20.193.28:0/4039788219 shutdown_connections 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.291+0000 7fa75b736640 1 -- 10.20.193.28:0/4039788219 wait complete. 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75b736640 1 Processor -- start 2026-02-20T03:14:56.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75b736640 1 -- start start 2026-02-20T03:14:56.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75b736640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7540753b0 0x7fa75419d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:56.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75b736640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa754075cd0 0x7fa75419d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:56.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75b736640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa75410f0b0 0x7fa7541a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:56.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75b736640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa754114c20 con 0x7fa75410f0b0 2026-02-20T03:14:56.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75b736640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa754114aa0 con 0x7fa7540753b0 2026-02-20T03:14:56.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75b736640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa754114da0 con 0x7fa754075cd0 2026-02-20T03:14:56.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75a734640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7540753b0 0x7fa75419d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75a734640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7540753b0 0x7fa75419d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59210/0 (socket says 10.20.193.28:59210) 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75af35640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa75410f0b0 0x7fa7541a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa75a734640 1 -- 10.20.193.28:0/1037480757 learned_addr learned my addr 10.20.193.28:0/1037480757 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.292+0000 7fa759f33640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa754075cd0 0x7fa75419d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa75af35640 1 -- 10.20.193.28:0/1037480757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa754075cd0 msgr2=0x7fa75419d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa75af35640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa754075cd0 0x7fa75419d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa75af35640 1 -- 10.20.193.28:0/1037480757 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7540753b0 msgr2=0x7fa75419d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa75af35640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7540753b0 0x7fa75419d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa75af35640 1 -- 10.20.193.28:0/1037480757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7541a2070 con 0x7fa75410f0b0 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa75af35640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa75410f0b0 0x7fa7541a18f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa748032040 tx=0x7fa748009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa73f7fe640 1 -- 10.20.193.28:0/1037480757 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748002a60 con 0x7fa75410f0b0 2026-02-20T03:14:56.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa73f7fe640 1 -- 10.20.193.28:0/1037480757 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa748002c00 con 0x7fa75410f0b0 2026-02-20T03:14:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa73f7fe640 1 -- 10.20.193.28:0/1037480757 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa748038680 con 0x7fa75410f0b0 2026-02-20T03:14:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7541a2300 con 0x7fa75410f0b0 2026-02-20T03:14:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.293+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7541a2730 con 0x7fa75410f0b0 2026-02-20T03:14:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.294+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa754075790 con 0x7fa75410f0b0 2026-02-20T03:14:56.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.296+0000 7fa73f7fe640 1 -- 10.20.193.28:0/1037480757 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fa7480074c0 con 0x7fa75410f0b0 2026-02-20T03:14:56.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.297+0000 7fa73f7fe640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7300b0eb0 0x7fa7300b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:56.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.297+0000 7fa73f7fe640 1 -- 10.20.193.28:0/1037480757 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fa748104af0 con 0x7fa75410f0b0 2026-02-20T03:14:56.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.297+0000 7fa73f7fe640 1 -- 10.20.193.28:0/1037480757 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa7480ccff0 con 0x7fa75410f0b0 2026-02-20T03:14:56.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.298+0000 7fa75a734640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7300b0eb0 0x7fa7300b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:56.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.298+0000 7fa75a734640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7300b0eb0 0x7fa7300b3370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009e10 tx=0x7fa74c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:56.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.406+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa75419e380 con 0x7fa75410f0b0 2026-02-20T03:14:56.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:56 trial028 ceph-mon[38552]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:56.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:56 trial028 ceph-mon[38552]: pgmap v184: 129 pgs: 129 active+clean; 605 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2026-02-20T03:14:56.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.406+0000 7fa73f7fe640 1 -- 10.20.193.28:0/1037480757 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11921 (secure 0 0 0) 0x7fa75419e380 con 0x7fa75410f0b0 2026-02-20T03:14:56.410 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:56.410 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":21,"btime":"2026-02-20T03:14:52:355182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:14:52.355103+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:14:56.411 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 21 2026-02-20T03:14:56.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7300b0eb0 msgr2=0x7fa7300b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:56.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7300b0eb0 0x7fa7300b3370 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009e10 tx=0x7fa74c009290 comp rx=0 tx=0).stop 2026-02-20T03:14:56.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa75410f0b0 msgr2=0x7fa7541a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:56.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa75410f0b0 0x7fa7541a18f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa748032040 tx=0x7fa748009300 comp rx=0 tx=0).stop 2026-02-20T03:14:56.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 shutdown_connections 2026-02-20T03:14:56.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7300b0eb0 0x7fa7300b3370 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa75410f0b0 0x7fa7541a18f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa754075cd0 0x7fa75419d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 --2- 10.20.193.28:0/1037480757 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7540753b0 0x7fa75419d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 >> 10.20.193.28:0/1037480757 conn(0x7fa7540fe410 msgr2=0x7fa7540ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:56.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.407+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 shutdown_connections 2026-02-20T03:14:56.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.408+0000 7fa75b736640 1 -- 10.20.193.28:0/1037480757 wait complete. 2026-02-20T03:14:56.513 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:14:56.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:56 trial177 ceph-mon[43181]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:56.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:56 trial177 ceph-mon[43181]: pgmap v184: 129 pgs: 129 active+clean; 605 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2026-02-20T03:14:56.778 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:56.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:56 trial126 ceph-mon[38476]: from='client.14709 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:14:56.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:56 trial126 ceph-mon[38476]: pgmap v184: 129 pgs: 129 active+clean; 605 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 4.7 KiB/s wr, 10 op/s 2026-02-20T03:14:56.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.958+0000 7f94b8896640 1 -- 10.20.193.28:0/745423301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 msgr2=0x7f94b4109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:56.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.958+0000 7f94b8896640 1 --2- 10.20.193.28:0/745423301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b4109660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009a30 tx=0x7f94a402f220 comp rx=0 tx=0).stop 2026-02-20T03:14:56.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.958+0000 7f94b8896640 1 -- 10.20.193.28:0/745423301 shutdown_connections 2026-02-20T03:14:56.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.958+0000 7f94b8896640 1 --2- 10.20.193.28:0/745423301 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b4109ba0 0x7f94b4115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.958+0000 7f94b8896640 1 --2- 10.20.193.28:0/745423301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b4109660 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.958+0000 7f94b8896640 1 --2- 10.20.193.28:0/745423301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b410eef0 0x7f94b410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.958+0000 7f94b8896640 1 -- 10.20.193.28:0/745423301 >> 10.20.193.28:0/745423301 conn(0x7f94b4078600 msgr2=0x7f94b407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:56.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.958+0000 7f94b8896640 1 -- 10.20.193.28:0/745423301 shutdown_connections 2026-02-20T03:14:56.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.958+0000 7f94b8896640 1 -- 10.20.193.28:0/745423301 wait complete. 2026-02-20T03:14:56.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b8896640 1 Processor -- start 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b8896640 1 -- start start 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b8896640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b8896640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4109ba0 0x7f94b41a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b8896640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410eef0 0x7f94b41a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b8896640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f94b41190a0 con 0x7f94b4109220 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b2ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4109ba0 0x7f94b41a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b8896640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4118f20 con 0x7f94b4109ba0 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56314/0 (socket says 10.20.193.28:56314) 2026-02-20T03:14:56.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b37fe640 1 -- 10.20.193.28:0/27014464 learned_addr learned my addr 10.20.193.28:0/27014464 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4119220 con 0x7f94b410eef0 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b3fff640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410eef0 0x7f94b41a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b37fe640 1 -- 10.20.193.28:0/27014464 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410eef0 msgr2=0x7f94b41a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b37fe640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410eef0 0x7f94b41a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b37fe640 1 -- 10.20.193.28:0/27014464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4109ba0 msgr2=0x7f94b41a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b37fe640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4109ba0 0x7f94b41a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.959+0000 7f94b37fe640 1 -- 10.20.193.28:0/27014464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b41a65b0 con 0x7f94b4109220 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.960+0000 7f94b37fe640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f94a000ea10 tx=0x7f94a000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.960+0000 7f94b0ff9640 1 -- 10.20.193.28:0/27014464 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a000ce50 con 0x7f94b4109220 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.960+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b41a68a0 con 0x7f94b4109220 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.960+0000 7f94b0ff9640 1 -- 10.20.193.28:0/27014464 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f94a0004570 con 0x7f94b4109220 2026-02-20T03:14:56.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.960+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b41ae0e0 con 0x7f94b4109220 2026-02-20T03:14:56.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.960+0000 7f94b0ff9640 1 -- 10.20.193.28:0/27014464 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a0010690 con 0x7f94b4109220 2026-02-20T03:14:56.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.960+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b410a580 con 0x7f94b4109220 2026-02-20T03:14:56.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.963+0000 7f94b0ff9640 1 -- 10.20.193.28:0/27014464 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f94a0020030 con 0x7f94b4109220 2026-02-20T03:14:56.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.964+0000 7f94b0ff9640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94880b1050 0x7f94880b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:56.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.964+0000 7f94b0ff9640 1 -- 10.20.193.28:0/27014464 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f94a00e0d40 con 0x7f94b4109220 2026-02-20T03:14:56.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.964+0000 7f94b2ffd640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94880b1050 0x7f94880b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:56.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.965+0000 7f94b0ff9640 1 -- 10.20.193.28:0/27014464 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f94a00a9220 con 0x7f94b4109220 2026-02-20T03:14:56.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:56.965+0000 7f94b2ffd640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94880b1050 0x7f94880b3510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f94b410e670 tx=0x7f94a4005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:57.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.056+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94b4110e30 con 0x7f94b4109220 2026-02-20T03:14:57.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.057+0000 7f94b0ff9640 1 -- 10.20.193.28:0/27014464 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7f94a00aced0 con 0x7f94b4109220 2026-02-20T03:14:57.061 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:57.061 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:14:57.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94880b1050 msgr2=0x7f94880b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:57.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94880b1050 0x7f94880b3510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f94b410e670 tx=0x7f94a4005950 comp rx=0 tx=0).stop 2026-02-20T03:14:57.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 msgr2=0x7f94b41a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:57.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f94a000ea10 tx=0x7f94a000eee0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 shutdown_connections 2026-02-20T03:14:57.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94880b1050 0x7f94880b3510 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410eef0 0x7f94b41a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4109ba0 0x7f94b41a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 --2- 10.20.193.28:0/27014464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1560 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 >> 10.20.193.28:0/27014464 conn(0x7f94b4078600 msgr2=0x7f94b4079ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:57.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 shutdown_connections 2026-02-20T03:14:57.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.058+0000 7f94b8896640 1 -- 10.20.193.28:0/27014464 wait complete. 2026-02-20T03:14:57.160 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-20T03:14:57.160 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T03:14:57.427 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:57.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 -- 10.20.193.28:0/127119477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1848109ba0 msgr2=0x7f1848115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:57.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 --2- 10.20.193.28:0/127119477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1848109ba0 0x7f1848115d10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f183800b0a0 tx=0x7f183802f410 comp rx=0 tx=0).stop 2026-02-20T03:14:57.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 -- 10.20.193.28:0/127119477 shutdown_connections 2026-02-20T03:14:57.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 --2- 10.20.193.28:0/127119477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1848109ba0 0x7f1848115d10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 --2- 10.20.193.28:0/127119477 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1848109220 0x7f1848109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 --2- 10.20.193.28:0/127119477 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f184810eef0 0x7f184810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 -- 10.20.193.28:0/127119477 >> 10.20.193.28:0/127119477 conn(0x7f1848078600 msgr2=0x7f184807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:57.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 -- 10.20.193.28:0/127119477 shutdown_connections 2026-02-20T03:14:57.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 -- 10.20.193.28:0/127119477 wait complete. 2026-02-20T03:14:57.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.611+0000 7f1847577640 1 Processor -- start 2026-02-20T03:14:57.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1847577640 1 -- start start 2026-02-20T03:14:57.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1847577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1848109220 0x7f18481a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:57.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1847577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1848109ba0 0x7f18481a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:57.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1847577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f184810eef0 0x7f18481a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:57.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1847577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1848119050 con 0x7f184810eef0 2026-02-20T03:14:57.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1847577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1848118ed0 con 0x7f1848109ba0 2026-02-20T03:14:57.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1847577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f18481191d0 con 0x7f1848109220 2026-02-20T03:14:57.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1846d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f184810eef0 0x7f18481a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:57.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1846d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f184810eef0 0x7f18481a5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56330/0 (socket says 10.20.193.28:56330) 2026-02-20T03:14:57.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1846d76640 1 -- 10.20.193.28:0/3431297708 learned_addr learned my addr 10.20.193.28:0/3431297708 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:57.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1845d74640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1848109ba0 0x7f18481a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:57.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1846575640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1848109220 0x7f18481a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:57.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1846d76640 1 -- 10.20.193.28:0/3431297708 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1848109220 msgr2=0x7f18481a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:57.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1846d76640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1848109220 0x7f18481a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1846d76640 1 -- 10.20.193.28:0/3431297708 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1848109ba0 msgr2=0x7f18481a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:57.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1846d76640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1848109ba0 0x7f18481a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1846d76640 1 -- 10.20.193.28:0/3431297708 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18481a64a0 con 0x7f184810eef0 2026-02-20T03:14:57.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.612+0000 7f1845d74640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1848109ba0 0x7f18481a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:14:57.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.613+0000 7f1846d76640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f184810eef0 0x7f18481a5d20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1838006030 tx=0x7f1838009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:57.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.613+0000 7f182f7fe640 1 -- 10.20.193.28:0/3431297708 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18380044b0 con 0x7f184810eef0 2026-02-20T03:14:57.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.613+0000 7f1847577640 1 -- 10.20.193.28:0/3431297708 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18481a6730 con 0x7f184810eef0 2026-02-20T03:14:57.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.613+0000 7f182f7fe640 1 -- 10.20.193.28:0/3431297708 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1838004650 con 0x7f184810eef0 2026-02-20T03:14:57.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.613+0000 7f182f7fe640 1 -- 10.20.193.28:0/3431297708 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18380416e0 con 0x7f184810eef0 2026-02-20T03:14:57.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.613+0000 7f1847577640 1 -- 10.20.193.28:0/3431297708 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18481adfd0 con 0x7f184810eef0 2026-02-20T03:14:57.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.614+0000 7f182d7fa640 1 -- 10.20.193.28:0/3431297708 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1848109660 con 0x7f184810eef0 2026-02-20T03:14:57.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.616+0000 7f182f7fe640 1 -- 10.20.193.28:0/3431297708 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f18380076a0 con 0x7f184810eef0 2026-02-20T03:14:57.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.617+0000 7f182f7fe640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18200b0eb0 0x7f18200b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:57.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.617+0000 7f182f7fe640 1 -- 10.20.193.28:0/3431297708 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f1838105570 con 0x7f184810eef0 2026-02-20T03:14:57.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.617+0000 7f1846575640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18200b0eb0 0x7f18200b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:57.623 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:57 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1037480757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:57.623 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:57 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/27014464' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:57.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.618+0000 7f1846575640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18200b0eb0 0x7f18200b3370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f183c005fd0 tx=0x7f183c002d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:57.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.619+0000 7f182f7fe640 1 -- 10.20.193.28:0/3431297708 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f18380cd9f0 con 0x7f184810eef0 2026-02-20T03:14:57.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.708+0000 7f182d7fa640 1 -- 10.20.193.28:0/3431297708 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18480630c0 con 0x7f18200b0eb0 2026-02-20T03:14:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:57 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1037480757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:57 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/27014464' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:57.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.715+0000 7f182f7fe640 1 -- 10.20.193.28:0/3431297708 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340360 (secure 0 0 0) 0x7f18480630c0 con 0x7f18200b0eb0 2026-02-20T03:14:57.723 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:57.726 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:14:57.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 -- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18200b0eb0 msgr2=0x7f18200b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:57.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18200b0eb0 0x7f18200b3370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f183c005fd0 tx=0x7f183c002d90 comp rx=0 tx=0).stop 2026-02-20T03:14:57.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 -- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f184810eef0 msgr2=0x7f18481a5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:57.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f184810eef0 0x7f18481a5d20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1838006030 tx=0x7f1838009300 comp rx=0 tx=0).stop 2026-02-20T03:14:57.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 -- 10.20.193.28:0/3431297708 shutdown_connections 2026-02-20T03:14:57.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18200b0eb0 0x7f18200b3370 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f184810eef0 0x7f18481a5d20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1848109ba0 0x7f18481a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 --2- 10.20.193.28:0/3431297708 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1848109220 0x7f18481a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:57.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 -- 10.20.193.28:0/3431297708 >> 10.20.193.28:0/3431297708 conn(0x7f1848078600 msgr2=0x7f1848079d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:57.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 -- 10.20.193.28:0/3431297708 shutdown_connections 2026-02-20T03:14:57.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:57.718+0000 7f182d7fa640 1 -- 10.20.193.28:0/3431297708 wait complete. 2026-02-20T03:14:57.819 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2026-02-20T03:14:56.002987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":619843,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":142,"num_read_kb":142,"num_write":328,"num_write_kb":3787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":357920,"kb_used_data":13552,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807680480,"statfs":{"total":9019431321600,"available":9019064811520,"internally_reserved":0,"allocated":13877248,"data_stored":7575035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27045,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":36,"num_read_kb":51,"num_write":94,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002491"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.357986+0000","last_change":"2026-02-20T03:14:32.081180+0000","last_active":"2026-02-20T03:14:51.357986+0000","last_peered":"2026-02-20T03:14:51.357986+0000","last_clean":"2026-02-20T03:14:51.357986+0000","last_became_active":"2026-02-20T03:14:32.081083+0000","last_became_peered":"2026-02-20T03:14:32.081083+0000","last_unstale":"2026-02-20T03:14:51.357986+0000","last_undegraded":"2026-02-20T03:14:51.357986+0000","last_fullsized":"2026-02-20T03:14:51.357986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:23:16.897948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743323+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:14:38.743323+0000","last_peered":"2026-02-20T03:14:38.743323+0000","last_clean":"2026-02-20T03:14:38.743323+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:14:38.743323+0000","last_undegraded":"2026-02-20T03:14:38.743323+0000","last_fullsized":"2026-02-20T03:14:38.743323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743964+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:14:38.743964+0000","last_peered":"2026-02-20T03:14:38.743964+0000","last_clean":"2026-02-20T03:14:38.743964+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:14:38.743964+0000","last_undegraded":"2026-02-20T03:14:38.743964+0000","last_fullsized":"2026-02-20T03:14:38.743964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743404+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:14:38.743404+0000","last_peered":"2026-02-20T03:14:38.743404+0000","last_clean":"2026-02-20T03:14:38.743404+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:14:38.743404+0000","last_undegraded":"2026-02-20T03:14:38.743404+0000","last_fullsized":"2026-02-20T03:14:38.743404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311999+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:14:38.311999+0000","last_peered":"2026-02-20T03:14:38.311999+0000","last_clean":"2026-02-20T03:14:38.311999+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:14:38.311999+0000","last_undegraded":"2026-02-20T03:14:38.311999+0000","last_fullsized":"2026-02-20T03:14:38.311999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356040+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:14:51.356040+0000","last_peered":"2026-02-20T03:14:51.356040+0000","last_clean":"2026-02-20T03:14:51.356040+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:14:51.356040+0000","last_undegraded":"2026-02-20T03:14:51.356040+0000","last_fullsized":"2026-02-20T03:14:51.356040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749309+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:14:38.749309+0000","last_peered":"2026-02-20T03:14:38.749309+0000","last_clean":"2026-02-20T03:14:38.749309+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:14:38.749309+0000","last_undegraded":"2026-02-20T03:14:38.749309+0000","last_fullsized":"2026-02-20T03:14:38.749309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744316+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:14:38.744316+0000","last_peered":"2026-02-20T03:14:38.744316+0000","last_clean":"2026-02-20T03:14:38.744316+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:14:38.744316+0000","last_undegraded":"2026-02-20T03:14:38.744316+0000","last_fullsized":"2026-02-20T03:14:38.744316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744230+0000","last_change":"2026-02-20T03:14:33.291255+0000","last_active":"2026-02-20T03:14:38.744230+0000","last_peered":"2026-02-20T03:14:38.744230+0000","last_clean":"2026-02-20T03:14:38.744230+0000","last_became_active":"2026-02-20T03:14:33.291089+0000","last_became_peered":"2026-02-20T03:14:33.291089+0000","last_unstale":"2026-02-20T03:14:38.744230+0000","last_undegraded":"2026-02-20T03:14:38.744230+0000","last_fullsized":"2026-02-20T03:14:38.744230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:42:45.321761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318208+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:14:38.318208+0000","last_peered":"2026-02-20T03:14:38.318208+0000","last_clean":"2026-02-20T03:14:38.318208+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:14:38.318208+0000","last_undegraded":"2026-02-20T03:14:38.318208+0000","last_fullsized":"2026-02-20T03:14:38.318208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351492+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:14:50.351492+0000","last_peered":"2026-02-20T03:14:50.351492+0000","last_clean":"2026-02-20T03:14:50.351492+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:14:50.351492+0000","last_undegraded":"2026-02-20T03:14:50.351492+0000","last_fullsized":"2026-02-20T03:14:50.351492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742908+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:14:38.742908+0000","last_peered":"2026-02-20T03:14:38.742908+0000","last_clean":"2026-02-20T03:14:38.742908+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:14:38.742908+0000","last_undegraded":"2026-02-20T03:14:38.742908+0000","last_fullsized":"2026-02-20T03:14:38.742908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743988+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:14:38.743988+0000","last_peered":"2026-02-20T03:14:38.743988+0000","last_clean":"2026-02-20T03:14:38.743988+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:14:38.743988+0000","last_undegraded":"2026-02-20T03:14:38.743988+0000","last_fullsized":"2026-02-20T03:14:38.743988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749851+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:38.749851+0000","last_peered":"2026-02-20T03:14:38.749851+0000","last_clean":"2026-02-20T03:14:38.749851+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:38.749851+0000","last_undegraded":"2026-02-20T03:14:38.749851+0000","last_fullsized":"2026-02-20T03:14:38.749851+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743910+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:14:38.743910+0000","last_peered":"2026-02-20T03:14:38.743910+0000","last_clean":"2026-02-20T03:14:38.743910+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:14:38.743910+0000","last_undegraded":"2026-02-20T03:14:38.743910+0000","last_fullsized":"2026-02-20T03:14:38.743910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351649+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:14:50.351649+0000","last_peered":"2026-02-20T03:14:50.351649+0000","last_clean":"2026-02-20T03:14:50.351649+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:14:50.351649+0000","last_undegraded":"2026-02-20T03:14:50.351649+0000","last_fullsized":"2026-02-20T03:14:50.351649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742825+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:14:38.742825+0000","last_peered":"2026-02-20T03:14:38.742825+0000","last_clean":"2026-02-20T03:14:38.742825+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:14:38.742825+0000","last_undegraded":"2026-02-20T03:14:38.742825+0000","last_fullsized":"2026-02-20T03:14:38.742825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743900+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:14:38.743900+0000","last_peered":"2026-02-20T03:14:38.743900+0000","last_clean":"2026-02-20T03:14:38.743900+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:14:38.743900+0000","last_undegraded":"2026-02-20T03:14:38.743900+0000","last_fullsized":"2026-02-20T03:14:38.743900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357481+0000","last_change":"2026-02-20T03:14:32.086899+0000","last_active":"2026-02-20T03:14:50.357481+0000","last_peered":"2026-02-20T03:14:50.357481+0000","last_clean":"2026-02-20T03:14:50.357481+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357481+0000","last_undegraded":"2026-02-20T03:14:50.357481+0000","last_fullsized":"2026-02-20T03:14:50.357481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:29:02.472130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311960+0000","last_change":"2026-02-20T03:14:33.298094+0000","last_active":"2026-02-20T03:14:38.311960+0000","last_peered":"2026-02-20T03:14:38.311960+0000","last_clean":"2026-02-20T03:14:38.311960+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311960+0000","last_undegraded":"2026-02-20T03:14:38.311960+0000","last_fullsized":"2026-02-20T03:14:38.311960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:14:52.233571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744071+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:14:38.744071+0000","last_peered":"2026-02-20T03:14:38.744071+0000","last_clean":"2026-02-20T03:14:38.744071+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:14:38.744071+0000","last_undegraded":"2026-02-20T03:14:38.744071+0000","last_fullsized":"2026-02-20T03:14:38.744071+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743028+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:14:38.743028+0000","last_peered":"2026-02-20T03:14:38.743028+0000","last_clean":"2026-02-20T03:14:38.743028+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:14:38.743028+0000","last_undegraded":"2026-02-20T03:14:38.743028+0000","last_fullsized":"2026-02-20T03:14:38.743028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:53.292699+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:14:53.292699+0000","last_peered":"2026-02-20T03:14:53.292699+0000","last_clean":"2026-02-20T03:14:53.292699+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:14:53.292699+0000","last_undegraded":"2026-02-20T03:14:53.292699+0000","last_fullsized":"2026-02-20T03:14:53.292699+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742399+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:14:38.742399+0000","last_peered":"2026-02-20T03:14:38.742399+0000","last_clean":"2026-02-20T03:14:38.742399+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:14:38.742399+0000","last_undegraded":"2026-02-20T03:14:38.742399+0000","last_fullsized":"2026-02-20T03:14:38.742399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311146+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:14:38.311146+0000","last_peered":"2026-02-20T03:14:38.311146+0000","last_clean":"2026-02-20T03:14:38.311146+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:14:38.311146+0000","last_undegraded":"2026-02-20T03:14:38.311146+0000","last_fullsized":"2026-02-20T03:14:38.311146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352941+0000","last_change":"2026-02-20T03:14:32.081021+0000","last_active":"2026-02-20T03:14:50.352941+0000","last_peered":"2026-02-20T03:14:50.352941+0000","last_clean":"2026-02-20T03:14:50.352941+0000","last_became_active":"2026-02-20T03:14:32.080799+0000","last_became_peered":"2026-02-20T03:14:32.080799+0000","last_unstale":"2026-02-20T03:14:50.352941+0000","last_undegraded":"2026-02-20T03:14:50.352941+0000","last_fullsized":"2026-02-20T03:14:50.352941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:15.834880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744093+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:14:38.744093+0000","last_peered":"2026-02-20T03:14:38.744093+0000","last_clean":"2026-02-20T03:14:38.744093+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:14:38.744093+0000","last_undegraded":"2026-02-20T03:14:38.744093+0000","last_fullsized":"2026-02-20T03:14:38.744093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479703+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:14:38.479703+0000","last_peered":"2026-02-20T03:14:38.479703+0000","last_clean":"2026-02-20T03:14:38.479703+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:14:38.479703+0000","last_undegraded":"2026-02-20T03:14:38.479703+0000","last_fullsized":"2026-02-20T03:14:38.479703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742701+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:14:38.742701+0000","last_peered":"2026-02-20T03:14:38.742701+0000","last_clean":"2026-02-20T03:14:38.742701+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:14:38.742701+0000","last_undegraded":"2026-02-20T03:14:38.742701+0000","last_fullsized":"2026-02-20T03:14:38.742701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744036+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:14:38.744036+0000","last_peered":"2026-02-20T03:14:38.744036+0000","last_clean":"2026-02-20T03:14:38.744036+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:14:38.744036+0000","last_undegraded":"2026-02-20T03:14:38.744036+0000","last_fullsized":"2026-02-20T03:14:38.744036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479538+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:14:38.479538+0000","last_peered":"2026-02-20T03:14:38.479538+0000","last_clean":"2026-02-20T03:14:38.479538+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:14:38.479538+0000","last_undegraded":"2026-02-20T03:14:38.479538+0000","last_fullsized":"2026-02-20T03:14:38.479538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318364+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:14:38.318364+0000","last_peered":"2026-02-20T03:14:38.318364+0000","last_clean":"2026-02-20T03:14:38.318364+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:14:38.318364+0000","last_undegraded":"2026-02-20T03:14:38.318364+0000","last_fullsized":"2026-02-20T03:14:38.318364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311210+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:14:38.311210+0000","last_peered":"2026-02-20T03:14:38.311210+0000","last_clean":"2026-02-20T03:14:38.311210+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:14:38.311210+0000","last_undegraded":"2026-02-20T03:14:38.311210+0000","last_fullsized":"2026-02-20T03:14:38.311210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.290483+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.289779+0000","last_became_peered":"2026-02-20T03:14:33.289779+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:45:10.985058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356869+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:14:51.356869+0000","last_peered":"2026-02-20T03:14:51.356869+0000","last_clean":"2026-02-20T03:14:51.356869+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:14:51.356869+0000","last_undegraded":"2026-02-20T03:14:51.356869+0000","last_fullsized":"2026-02-20T03:14:51.356869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311164+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:14:38.311164+0000","last_peered":"2026-02-20T03:14:38.311164+0000","last_clean":"2026-02-20T03:14:38.311164+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:14:38.311164+0000","last_undegraded":"2026-02-20T03:14:38.311164+0000","last_fullsized":"2026-02-20T03:14:38.311164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.310925+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:14:38.310925+0000","last_peered":"2026-02-20T03:14:38.310925+0000","last_clean":"2026-02-20T03:14:38.310925+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:14:38.310925+0000","last_undegraded":"2026-02-20T03:14:38.310925+0000","last_fullsized":"2026-02-20T03:14:38.310925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.360846+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:14:51.360846+0000","last_peered":"2026-02-20T03:14:51.360846+0000","last_clean":"2026-02-20T03:14:51.360846+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:14:51.360846+0000","last_undegraded":"2026-02-20T03:14:51.360846+0000","last_fullsized":"2026-02-20T03:14:51.360846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744423+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:14:38.744423+0000","last_peered":"2026-02-20T03:14:38.744423+0000","last_clean":"2026-02-20T03:14:38.744423+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:14:38.744423+0000","last_undegraded":"2026-02-20T03:14:38.744423+0000","last_fullsized":"2026-02-20T03:14:38.744423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743435+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:14:38.743435+0000","last_peered":"2026-02-20T03:14:38.743435+0000","last_clean":"2026-02-20T03:14:38.743435+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:14:38.743435+0000","last_undegraded":"2026-02-20T03:14:38.743435+0000","last_fullsized":"2026-02-20T03:14:38.743435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318242+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:14:38.318242+0000","last_peered":"2026-02-20T03:14:38.318242+0000","last_clean":"2026-02-20T03:14:38.318242+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:14:38.318242+0000","last_undegraded":"2026-02-20T03:14:38.318242+0000","last_fullsized":"2026-02-20T03:14:38.318242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318389+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:14:38.318389+0000","last_peered":"2026-02-20T03:14:38.318389+0000","last_clean":"2026-02-20T03:14:38.318389+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:14:38.318389+0000","last_undegraded":"2026-02-20T03:14:38.318389+0000","last_fullsized":"2026-02-20T03:14:38.318389+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318536+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:14:38.318536+0000","last_peered":"2026-02-20T03:14:38.318536+0000","last_clean":"2026-02-20T03:14:38.318536+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:14:38.318536+0000","last_undegraded":"2026-02-20T03:14:38.318536+0000","last_fullsized":"2026-02-20T03:14:38.318536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.357786+0000","last_change":"2026-02-20T03:14:32.079575+0000","last_active":"2026-02-20T03:14:51.357786+0000","last_peered":"2026-02-20T03:14:51.357786+0000","last_clean":"2026-02-20T03:14:51.357786+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:51.357786+0000","last_undegraded":"2026-02-20T03:14:51.357786+0000","last_fullsized":"2026-02-20T03:14:51.357786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:32:22.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749026+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:14:38.749026+0000","last_peered":"2026-02-20T03:14:38.749026+0000","last_clean":"2026-02-20T03:14:38.749026+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:14:38.749026+0000","last_undegraded":"2026-02-20T03:14:38.749026+0000","last_fullsized":"2026-02-20T03:14:38.749026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318340+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:14:38.318340+0000","last_peered":"2026-02-20T03:14:38.318340+0000","last_clean":"2026-02-20T03:14:38.318340+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:14:38.318340+0000","last_undegraded":"2026-02-20T03:14:38.318340+0000","last_fullsized":"2026-02-20T03:14:38.318340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744433+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:14:38.744433+0000","last_peered":"2026-02-20T03:14:38.744433+0000","last_clean":"2026-02-20T03:14:38.744433+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:14:38.744433+0000","last_undegraded":"2026-02-20T03:14:38.744433+0000","last_fullsized":"2026-02-20T03:14:38.744433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311766+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:14:38.311766+0000","last_peered":"2026-02-20T03:14:38.311766+0000","last_clean":"2026-02-20T03:14:38.311766+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:14:38.311766+0000","last_undegraded":"2026-02-20T03:14:38.311766+0000","last_fullsized":"2026-02-20T03:14:38.311766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318490+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:14:38.318490+0000","last_peered":"2026-02-20T03:14:38.318490+0000","last_clean":"2026-02-20T03:14:38.318490+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:14:38.318490+0000","last_undegraded":"2026-02-20T03:14:38.318490+0000","last_fullsized":"2026-02-20T03:14:38.318490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311359+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:14:38.311359+0000","last_peered":"2026-02-20T03:14:38.311359+0000","last_clean":"2026-02-20T03:14:38.311359+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:14:38.311359+0000","last_undegraded":"2026-02-20T03:14:38.311359+0000","last_fullsized":"2026-02-20T03:14:38.311359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743916+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:14:38.743916+0000","last_peered":"2026-02-20T03:14:38.743916+0000","last_clean":"2026-02-20T03:14:38.743916+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:14:38.743916+0000","last_undegraded":"2026-02-20T03:14:38.743916+0000","last_fullsized":"2026-02-20T03:14:38.743916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744369+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:14:38.744369+0000","last_peered":"2026-02-20T03:14:38.744369+0000","last_clean":"2026-02-20T03:14:38.744369+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:14:38.744369+0000","last_undegraded":"2026-02-20T03:14:38.744369+0000","last_fullsized":"2026-02-20T03:14:38.744369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:14:38.744403+0000","last_peered":"2026-02-20T03:14:38.744403+0000","last_clean":"2026-02-20T03:14:38.744403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:14:38.744403+0000","last_undegraded":"2026-02-20T03:14:38.744403+0000","last_fullsized":"2026-02-20T03:14:38.744403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744027+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:14:38.744027+0000","last_peered":"2026-02-20T03:14:38.744027+0000","last_clean":"2026-02-20T03:14:38.744027+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:14:38.744027+0000","last_undegraded":"2026-02-20T03:14:38.744027+0000","last_fullsized":"2026-02-20T03:14:38.744027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743990+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:14:38.743990+0000","last_peered":"2026-02-20T03:14:38.743990+0000","last_clean":"2026-02-20T03:14:38.743990+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:14:38.743990+0000","last_undegraded":"2026-02-20T03:14:38.743990+0000","last_fullsized":"2026-02-20T03:14:38.743990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358752+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:14:51.358752+0000","last_peered":"2026-02-20T03:14:51.358752+0000","last_clean":"2026-02-20T03:14:51.358752+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:14:51.358752+0000","last_undegraded":"2026-02-20T03:14:51.358752+0000","last_fullsized":"2026-02-20T03:14:51.358752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311328+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:14:38.311328+0000","last_peered":"2026-02-20T03:14:38.311328+0000","last_clean":"2026-02-20T03:14:38.311328+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:14:38.311328+0000","last_undegraded":"2026-02-20T03:14:38.311328+0000","last_fullsized":"2026-02-20T03:14:38.311328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318042+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:14:38.318042+0000","last_peered":"2026-02-20T03:14:38.318042+0000","last_clean":"2026-02-20T03:14:38.318042+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:14:38.318042+0000","last_undegraded":"2026-02-20T03:14:38.318042+0000","last_fullsized":"2026-02-20T03:14:38.318042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:53.368868+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:14:53.368868+0000","last_peered":"2026-02-20T03:14:53.368868+0000","last_clean":"2026-02-20T03:14:53.368868+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:14:53.368868+0000","last_undegraded":"2026-02-20T03:14:53.368868+0000","last_fullsized":"2026-02-20T03:14:53.368868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743149+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:14:38.743149+0000","last_peered":"2026-02-20T03:14:38.743149+0000","last_clean":"2026-02-20T03:14:38.743149+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:14:38.743149+0000","last_undegraded":"2026-02-20T03:14:38.743149+0000","last_fullsized":"2026-02-20T03:14:38.743149+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318241+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:14:38.318241+0000","last_peered":"2026-02-20T03:14:38.318241+0000","last_clean":"2026-02-20T03:14:38.318241+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:14:38.318241+0000","last_undegraded":"2026-02-20T03:14:38.318241+0000","last_fullsized":"2026-02-20T03:14:38.318241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352270+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:14:50.352270+0000","last_peered":"2026-02-20T03:14:50.352270+0000","last_clean":"2026-02-20T03:14:50.352270+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:14:50.352270+0000","last_undegraded":"2026-02-20T03:14:50.352270+0000","last_fullsized":"2026-02-20T03:14:50.352270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744179+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:14:38.744179+0000","last_peered":"2026-02-20T03:14:38.744179+0000","last_clean":"2026-02-20T03:14:38.744179+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:14:38.744179+0000","last_undegraded":"2026-02-20T03:14:38.744179+0000","last_fullsized":"2026-02-20T03:14:38.744179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311740+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:14:38.311740+0000","last_peered":"2026-02-20T03:14:38.311740+0000","last_clean":"2026-02-20T03:14:38.311740+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:14:38.311740+0000","last_undegraded":"2026-02-20T03:14:38.311740+0000","last_fullsized":"2026-02-20T03:14:38.311740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.355874+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:14:51.355874+0000","last_peered":"2026-02-20T03:14:51.355874+0000","last_clean":"2026-02-20T03:14:51.355874+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:14:51.355874+0000","last_undegraded":"2026-02-20T03:14:51.355874+0000","last_fullsized":"2026-02-20T03:14:51.355874+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744303+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:14:38.744303+0000","last_peered":"2026-02-20T03:14:38.744303+0000","last_clean":"2026-02-20T03:14:38.744303+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:14:38.744303+0000","last_undegraded":"2026-02-20T03:14:38.744303+0000","last_fullsized":"2026-02-20T03:14:38.744303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744191+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:14:38.744191+0000","last_peered":"2026-02-20T03:14:38.744191+0000","last_clean":"2026-02-20T03:14:38.744191+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:14:38.744191+0000","last_undegraded":"2026-02-20T03:14:38.744191+0000","last_fullsized":"2026-02-20T03:14:38.744191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'19","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:54.369888+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:14:54.369888+0000","last_peered":"2026-02-20T03:14:54.369888+0000","last_clean":"2026-02-20T03:14:54.369888+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:14:54.369888+0000","last_undegraded":"2026-02-20T03:14:54.369888+0000","last_fullsized":"2026-02-20T03:14:54.369888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25443,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":30,"num_write":20,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742256+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:14:38.742256+0000","last_peered":"2026-02-20T03:14:38.742256+0000","last_clean":"2026-02-20T03:14:38.742256+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:14:38.742256+0000","last_undegraded":"2026-02-20T03:14:38.742256+0000","last_fullsized":"2026-02-20T03:14:38.742256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749385+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:14:38.749385+0000","last_peered":"2026-02-20T03:14:38.749385+0000","last_clean":"2026-02-20T03:14:38.749385+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:14:38.749385+0000","last_undegraded":"2026-02-20T03:14:38.749385+0000","last_fullsized":"2026-02-20T03:14:38.749385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352990+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:14:50.352990+0000","last_peered":"2026-02-20T03:14:50.352990+0000","last_clean":"2026-02-20T03:14:50.352990+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:14:50.352990+0000","last_undegraded":"2026-02-20T03:14:50.352990+0000","last_fullsized":"2026-02-20T03:14:50.352990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.312040+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:14:38.312040+0000","last_peered":"2026-02-20T03:14:38.312040+0000","last_clean":"2026-02-20T03:14:38.312040+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:14:38.312040+0000","last_undegraded":"2026-02-20T03:14:38.312040+0000","last_fullsized":"2026-02-20T03:14:38.312040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.356807+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:14:50.356807+0000","last_peered":"2026-02-20T03:14:50.356807+0000","last_clean":"2026-02-20T03:14:50.356807+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:14:50.356807+0000","last_undegraded":"2026-02-20T03:14:50.356807+0000","last_fullsized":"2026-02-20T03:14:50.356807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743191+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:14:38.743191+0000","last_peered":"2026-02-20T03:14:38.743191+0000","last_clean":"2026-02-20T03:14:38.743191+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:14:38.743191+0000","last_undegraded":"2026-02-20T03:14:38.743191+0000","last_fullsized":"2026-02-20T03:14:38.743191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749609+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:14:38.749609+0000","last_peered":"2026-02-20T03:14:38.749609+0000","last_clean":"2026-02-20T03:14:38.749609+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:14:38.749609+0000","last_undegraded":"2026-02-20T03:14:38.749609+0000","last_fullsized":"2026-02-20T03:14:38.749609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:53.367299+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:14:53.367299+0000","last_peered":"2026-02-20T03:14:53.367299+0000","last_clean":"2026-02-20T03:14:53.367299+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:14:53.367299+0000","last_undegraded":"2026-02-20T03:14:53.367299+0000","last_fullsized":"2026-02-20T03:14:53.367299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743127+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:14:38.743127+0000","last_peered":"2026-02-20T03:14:38.743127+0000","last_clean":"2026-02-20T03:14:38.743127+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:14:38.743127+0000","last_undegraded":"2026-02-20T03:14:38.743127+0000","last_fullsized":"2026-02-20T03:14:38.743127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311932+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:14:38.311932+0000","last_peered":"2026-02-20T03:14:38.311932+0000","last_clean":"2026-02-20T03:14:38.311932+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:14:38.311932+0000","last_undegraded":"2026-02-20T03:14:38.311932+0000","last_fullsized":"2026-02-20T03:14:38.311932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742536+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:14:38.742536+0000","last_peered":"2026-02-20T03:14:38.742536+0000","last_clean":"2026-02-20T03:14:38.742536+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:14:38.742536+0000","last_undegraded":"2026-02-20T03:14:38.742536+0000","last_fullsized":"2026-02-20T03:14:38.742536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744067+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:14:38.744067+0000","last_peered":"2026-02-20T03:14:38.744067+0000","last_clean":"2026-02-20T03:14:38.744067+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:14:38.744067+0000","last_undegraded":"2026-02-20T03:14:38.744067+0000","last_fullsized":"2026-02-20T03:14:38.744067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744459+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:14:38.744459+0000","last_peered":"2026-02-20T03:14:38.744459+0000","last_clean":"2026-02-20T03:14:38.744459+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:14:38.744459+0000","last_undegraded":"2026-02-20T03:14:38.744459+0000","last_fullsized":"2026-02-20T03:14:38.744459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742665+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:14:38.742665+0000","last_peered":"2026-02-20T03:14:38.742665+0000","last_clean":"2026-02-20T03:14:38.742665+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:14:38.742665+0000","last_undegraded":"2026-02-20T03:14:38.742665+0000","last_fullsized":"2026-02-20T03:14:38.742665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356776+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:14:51.356776+0000","last_peered":"2026-02-20T03:14:51.356776+0000","last_clean":"2026-02-20T03:14:51.356776+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:14:51.356776+0000","last_undegraded":"2026-02-20T03:14:51.356776+0000","last_fullsized":"2026-02-20T03:14:51.356776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.361797+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:14:51.361797+0000","last_peered":"2026-02-20T03:14:51.361797+0000","last_clean":"2026-02-20T03:14:51.361797+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:14:51.361797+0000","last_undegraded":"2026-02-20T03:14:51.361797+0000","last_fullsized":"2026-02-20T03:14:51.361797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744227+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:14:38.744227+0000","last_peered":"2026-02-20T03:14:38.744227+0000","last_clean":"2026-02-20T03:14:38.744227+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:14:38.744227+0000","last_undegraded":"2026-02-20T03:14:38.744227+0000","last_fullsized":"2026-02-20T03:14:38.744227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744309+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:14:38.744309+0000","last_peered":"2026-02-20T03:14:38.744309+0000","last_clean":"2026-02-20T03:14:38.744309+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:14:38.744309+0000","last_undegraded":"2026-02-20T03:14:38.744309+0000","last_fullsized":"2026-02-20T03:14:38.744309+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.361725+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:14:52.361725+0000","last_peered":"2026-02-20T03:14:52.361725+0000","last_clean":"2026-02-20T03:14:52.361725+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:14:52.361725+0000","last_undegraded":"2026-02-20T03:14:52.361725+0000","last_fullsized":"2026-02-20T03:14:52.361725+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744076+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:14:38.744076+0000","last_peered":"2026-02-20T03:14:38.744076+0000","last_clean":"2026-02-20T03:14:38.744076+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:14:38.744076+0000","last_undegraded":"2026-02-20T03:14:38.744076+0000","last_fullsized":"2026-02-20T03:14:38.744076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744370+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:14:38.744370+0000","last_peered":"2026-02-20T03:14:38.744370+0000","last_clean":"2026-02-20T03:14:38.744370+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:14:38.744370+0000","last_undegraded":"2026-02-20T03:14:38.744370+0000","last_fullsized":"2026-02-20T03:14:38.744370+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743873+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:14:38.743873+0000","last_peered":"2026-02-20T03:14:38.743873+0000","last_clean":"2026-02-20T03:14:38.743873+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:14:38.743873+0000","last_undegraded":"2026-02-20T03:14:38.743873+0000","last_fullsized":"2026-02-20T03:14:38.743873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744166+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:14:38.744166+0000","last_peered":"2026-02-20T03:14:38.744166+0000","last_clean":"2026-02-20T03:14:38.744166+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:14:38.744166+0000","last_undegraded":"2026-02-20T03:14:38.744166+0000","last_fullsized":"2026-02-20T03:14:38.744166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311828+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:14:38.311828+0000","last_peered":"2026-02-20T03:14:38.311828+0000","last_clean":"2026-02-20T03:14:38.311828+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:14:38.311828+0000","last_undegraded":"2026-02-20T03:14:38.311828+0000","last_fullsized":"2026-02-20T03:14:38.311828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311110+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:14:38.311110+0000","last_peered":"2026-02-20T03:14:38.311110+0000","last_clean":"2026-02-20T03:14:38.311110+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:14:38.311110+0000","last_undegraded":"2026-02-20T03:14:38.311110+0000","last_fullsized":"2026-02-20T03:14:38.311110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744275+0000","last_change":"2026-02-20T03:14:33.290769+0000","last_active":"2026-02-20T03:14:38.744275+0000","last_peered":"2026-02-20T03:14:38.744275+0000","last_clean":"2026-02-20T03:14:38.744275+0000","last_became_active":"2026-02-20T03:14:33.290406+0000","last_became_peered":"2026-02-20T03:14:33.290406+0000","last_unstale":"2026-02-20T03:14:38.744275+0000","last_undegraded":"2026-02-20T03:14:38.744275+0000","last_fullsized":"2026-02-20T03:14:38.744275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:58.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744400+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:14:38.744400+0000","last_peered":"2026-02-20T03:14:38.744400+0000","last_clean":"2026-02-20T03:14:38.744400+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:14:38.744400+0000","last_undegraded":"2026-02-20T03:14:38.744400+0000","last_fullsized":"2026-02-20T03:14:38.744400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742977+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:14:38.742977+0000","last_peered":"2026-02-20T03:14:38.742977+0000","last_clean":"2026-02-20T03:14:38.742977+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:14:38.742977+0000","last_undegraded":"2026-02-20T03:14:38.742977+0000","last_fullsized":"2026-02-20T03:14:38.742977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743959+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:14:38.743959+0000","last_peered":"2026-02-20T03:14:38.743959+0000","last_clean":"2026-02-20T03:14:38.743959+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:14:38.743959+0000","last_undegraded":"2026-02-20T03:14:38.743959+0000","last_fullsized":"2026-02-20T03:14:38.743959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743157+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:14:38.743157+0000","last_peered":"2026-02-20T03:14:38.743157+0000","last_clean":"2026-02-20T03:14:38.743157+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:14:38.743157+0000","last_undegraded":"2026-02-20T03:14:38.743157+0000","last_fullsized":"2026-02-20T03:14:38.743157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749238+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:14:38.749238+0000","last_peered":"2026-02-20T03:14:38.749238+0000","last_clean":"2026-02-20T03:14:38.749238+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:14:38.749238+0000","last_undegraded":"2026-02-20T03:14:38.749238+0000","last_fullsized":"2026-02-20T03:14:38.749238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311289+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:14:38.311289+0000","last_peered":"2026-02-20T03:14:38.311289+0000","last_clean":"2026-02-20T03:14:38.311289+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:14:38.311289+0000","last_undegraded":"2026-02-20T03:14:38.311289+0000","last_fullsized":"2026-02-20T03:14:38.311289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744096+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:14:38.744096+0000","last_peered":"2026-02-20T03:14:38.744096+0000","last_clean":"2026-02-20T03:14:38.744096+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:14:38.744096+0000","last_undegraded":"2026-02-20T03:14:38.744096+0000","last_fullsized":"2026-02-20T03:14:38.744096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744472+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:14:38.744472+0000","last_peered":"2026-02-20T03:14:38.744472+0000","last_clean":"2026-02-20T03:14:38.744472+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:14:38.744472+0000","last_undegraded":"2026-02-20T03:14:38.744472+0000","last_fullsized":"2026-02-20T03:14:38.744472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742612+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:14:38.742612+0000","last_peered":"2026-02-20T03:14:38.742612+0000","last_clean":"2026-02-20T03:14:38.742612+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:14:38.742612+0000","last_undegraded":"2026-02-20T03:14:38.742612+0000","last_fullsized":"2026-02-20T03:14:38.742612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744492+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:14:38.744492+0000","last_peered":"2026-02-20T03:14:38.744492+0000","last_clean":"2026-02-20T03:14:38.744492+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:14:38.744492+0000","last_undegraded":"2026-02-20T03:14:38.744492+0000","last_fullsized":"2026-02-20T03:14:38.744492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.748833+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:14:38.748833+0000","last_peered":"2026-02-20T03:14:38.748833+0000","last_clean":"2026-02-20T03:14:38.748833+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:14:38.748833+0000","last_undegraded":"2026-02-20T03:14:38.748833+0000","last_fullsized":"2026-02-20T03:14:38.748833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311670+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:14:38.311670+0000","last_peered":"2026-02-20T03:14:38.311670+0000","last_clean":"2026-02-20T03:14:38.311670+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:14:38.311670+0000","last_undegraded":"2026-02-20T03:14:38.311670+0000","last_fullsized":"2026-02-20T03:14:38.311670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311568+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:14:38.311568+0000","last_peered":"2026-02-20T03:14:38.311568+0000","last_clean":"2026-02-20T03:14:38.311568+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:14:38.311568+0000","last_undegraded":"2026-02-20T03:14:38.311568+0000","last_fullsized":"2026-02-20T03:14:38.311568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311264+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:14:38.311264+0000","last_peered":"2026-02-20T03:14:38.311264+0000","last_clean":"2026-02-20T03:14:38.311264+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:14:38.311264+0000","last_undegraded":"2026-02-20T03:14:38.311264+0000","last_fullsized":"2026-02-20T03:14:38.311264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318524+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:14:38.318524+0000","last_peered":"2026-02-20T03:14:38.318524+0000","last_clean":"2026-02-20T03:14:38.318524+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:14:38.318524+0000","last_undegraded":"2026-02-20T03:14:38.318524+0000","last_fullsized":"2026-02-20T03:14:38.318524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479875+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:14:38.479875+0000","last_peered":"2026-02-20T03:14:38.479875+0000","last_clean":"2026-02-20T03:14:38.479875+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:14:38.479875+0000","last_undegraded":"2026-02-20T03:14:38.479875+0000","last_fullsized":"2026-02-20T03:14:38.479875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749648+0000","last_change":"2026-02-20T03:14:33.295988+0000","last_active":"2026-02-20T03:14:38.749648+0000","last_peered":"2026-02-20T03:14:38.749648+0000","last_clean":"2026-02-20T03:14:38.749648+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749648+0000","last_undegraded":"2026-02-20T03:14:38.749648+0000","last_fullsized":"2026-02-20T03:14:38.749648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:12:01.602799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742670+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:14:38.742670+0000","last_peered":"2026-02-20T03:14:38.742670+0000","last_clean":"2026-02-20T03:14:38.742670+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:14:38.742670+0000","last_undegraded":"2026-02-20T03:14:38.742670+0000","last_fullsized":"2026-02-20T03:14:38.742670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318097+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:14:38.318097+0000","last_peered":"2026-02-20T03:14:38.318097+0000","last_clean":"2026-02-20T03:14:38.318097+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:14:38.318097+0000","last_undegraded":"2026-02-20T03:14:38.318097+0000","last_fullsized":"2026-02-20T03:14:38.318097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479297+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:14:38.479297+0000","last_peered":"2026-02-20T03:14:38.479297+0000","last_clean":"2026-02-20T03:14:38.479297+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:14:38.479297+0000","last_undegraded":"2026-02-20T03:14:38.479297+0000","last_fullsized":"2026-02-20T03:14:38.479297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743970+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:14:38.743970+0000","last_peered":"2026-02-20T03:14:38.743970+0000","last_clean":"2026-02-20T03:14:38.743970+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:14:38.743970+0000","last_undegraded":"2026-02-20T03:14:38.743970+0000","last_fullsized":"2026-02-20T03:14:38.743970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311798+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:14:38.311798+0000","last_peered":"2026-02-20T03:14:38.311798+0000","last_clean":"2026-02-20T03:14:38.311798+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:14:38.311798+0000","last_undegraded":"2026-02-20T03:14:38.311798+0000","last_fullsized":"2026-02-20T03:14:38.311798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311904+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:14:38.311904+0000","last_peered":"2026-02-20T03:14:38.311904+0000","last_clean":"2026-02-20T03:14:38.311904+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:14:38.311904+0000","last_undegraded":"2026-02-20T03:14:38.311904+0000","last_fullsized":"2026-02-20T03:14:38.311904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744466+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:14:38.744466+0000","last_peered":"2026-02-20T03:14:38.744466+0000","last_clean":"2026-02-20T03:14:38.744466+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:14:38.744466+0000","last_undegraded":"2026-02-20T03:14:38.744466+0000","last_fullsized":"2026-02-20T03:14:38.744466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":29475,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":36,"num_read_kb":51,"num_write":139,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":44099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383689,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971104,"statfs":{"total":751619276800,"available":751586410496,"internally_reserved":0,"allocated":995328,"data_stored":484050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612619,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32736,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970464,"statfs":{"total":751619276800,"available":751585755136,"internally_reserved":0,"allocated":1650688,"data_stored":1097153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776141,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27952,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975248,"statfs":{"total":751619276800,"available":751590653952,"internally_reserved":0,"allocated":1011712,"data_stored":484286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037775,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32108,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971092,"statfs":{"total":751619276800,"available":751586398208,"internally_reserved":0,"allocated":1007616,"data_stored":480110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299409,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32684,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970516,"statfs":{"total":751619276800,"available":751585808384,"internally_reserved":0,"allocated":1597440,"data_stored":1071532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462931,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":479452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724566,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28536,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974664,"statfs":{"total":751619276800,"available":751590055936,"internally_reserved":0,"allocated":1609728,"data_stored":1071216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888088,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32100,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971100,"statfs":{"total":751619276800,"available":751586406400,"internally_reserved":0,"allocated":999424,"data_stored":480398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149722,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27944,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975256,"statfs":{"total":751619276800,"available":751590662144,"internally_reserved":0,"allocated":1003520,"data_stored":479646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27952,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975248,"statfs":{"total":751619276800,"available":751590653952,"internally_reserved":0,"allocated":1011712,"data_stored":483891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27940,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975260,"statfs":{"total":751619276800,"available":751590666240,"internally_reserved":0,"allocated":999424,"data_stored":483235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27940,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975260,"statfs":{"total":751619276800,"available":751590666240,"internally_reserved":0,"allocated":999424,"data_stored":480066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":27423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:14:57.830 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T03:14:57.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:57 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1037480757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:14:57.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:57 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/27014464' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:14:58.094 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.273+0000 7f8c8bfff640 1 -- 10.20.193.28:0/1864732946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8c10eef0 msgr2=0x7f8c8c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.273+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/1864732946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8c10eef0 0x7f8c8c10f2d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009a30 tx=0x7f8c8002f220 comp rx=0 tx=0).stop 2026-02-20T03:14:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.273+0000 7f8c8bfff640 1 -- 10.20.193.28:0/1864732946 shutdown_connections 2026-02-20T03:14:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.273+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/1864732946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c8c109ba0 0x7f8c8c115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.273+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/1864732946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8c109220 0x7f8c8c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.273+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/1864732946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8c10eef0 0x7f8c8c10f2d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.273+0000 7f8c8bfff640 1 -- 10.20.193.28:0/1864732946 >> 10.20.193.28:0/1864732946 conn(0x7f8c8c078600 msgr2=0x7f8c8c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.273+0000 7f8c8bfff640 1 -- 10.20.193.28:0/1864732946 shutdown_connections 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.273+0000 7f8c8bfff640 1 -- 10.20.193.28:0/1864732946 wait complete. 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8bfff640 1 Processor -- start 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8bfff640 1 -- start start 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8c109220 0x7f8c8c1a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c8c109ba0 0x7f8c8c1a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8c10eef0 0x7f8c8c1a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1190b0 con 0x7f8c8c10eef0 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8bfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c118f30 con 0x7f8c8c109220 2026-02-20T03:14:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8bfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c119230 con 0x7f8c8c109ba0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8c10eef0 0x7f8c8c1a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8c109220 0x7f8c8c1a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8c109220 0x7f8c8c1a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59282/0 (socket says 10.20.193.28:59282) 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8affd640 1 -- 10.20.193.28:0/291936803 learned_addr learned my addr 10.20.193.28:0/291936803 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.274+0000 7f8c8a7fc640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c8c109ba0 0x7f8c8c1a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c8b7fe640 1 -- 10.20.193.28:0/291936803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c8c109ba0 msgr2=0x7f8c8c1a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c8b7fe640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c8c109ba0 0x7f8c8c1a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c8b7fe640 1 -- 10.20.193.28:0/291936803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8c109220 msgr2=0x7f8c8c1a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c8b7fe640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8c109220 0x7f8c8c1a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c8b7fe640 1 -- 10.20.193.28:0/291936803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c1a65c0 con 0x7f8c8c10eef0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c8b7fe640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8c10eef0 0x7f8c8c1a5e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c004830 tx=0x7f8c7c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c6bfff640 1 -- 10.20.193.28:0/291936803 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00db60 con 0x7f8c8c10eef0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c6bfff640 1 -- 10.20.193.28:0/291936803 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8c7c00dd00 con 0x7f8c8c10eef0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c6bfff640 1 -- 10.20.193.28:0/291936803 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c013770 con 0x7f8c8c10eef0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8c1a6850 con 0x7f8c8c10eef0 2026-02-20T03:14:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.275+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8c1ae0f0 con 0x7f8c8c10eef0 2026-02-20T03:14:58.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.276+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8c109660 con 0x7f8c8c10eef0 2026-02-20T03:14:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.278+0000 7f8c6bfff640 1 -- 10.20.193.28:0/291936803 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f8c7c012070 con 0x7f8c8c10eef0 2026-02-20T03:14:58.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.279+0000 7f8c6bfff640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c600b0eb0 0x7f8c600b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:58.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.280+0000 7f8c6bfff640 1 -- 10.20.193.28:0/291936803 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f8c7c0e0610 con 0x7f8c8c10eef0 2026-02-20T03:14:58.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.280+0000 7f8c8affd640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c600b0eb0 0x7f8c600b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:58.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.280+0000 7f8c6bfff640 1 -- 10.20.193.28:0/291936803 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8c7c010070 con 0x7f8c8c10eef0 2026-02-20T03:14:58.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.281+0000 7f8c8affd640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c600b0eb0 0x7f8c600b3370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c800097c0 tx=0x7f8c80005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:58.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.370+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8c8c110ea0 con 0x7f8c600b0eb0 2026-02-20T03:14:58.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.375+0000 7f8c6bfff640 1 -- 10.20.193.28:0/291936803 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340386 (secure 0 0 0) 0x7f8c8c110ea0 con 0x7f8c600b0eb0 2026-02-20T03:14:58.383 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:58.385 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:14:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c600b0eb0 msgr2=0x7f8c600b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c600b0eb0 0x7f8c600b3370 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8c800097c0 tx=0x7f8c80005e50 comp rx=0 tx=0).stop 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8c10eef0 msgr2=0x7f8c8c1a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8c10eef0 0x7f8c8c1a5e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c004830 tx=0x7f8c7c00d4a0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 shutdown_connections 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c600b0eb0 0x7f8c600b3370 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8c10eef0 0x7f8c8c1a5e40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c8c109ba0 0x7f8c8c1a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 --2- 10.20.193.28:0/291936803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8c109220 0x7f8c8c1a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.378+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 >> 10.20.193.28:0/291936803 conn(0x7f8c8c078600 msgr2=0x7f8c8c079f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.379+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 shutdown_connections 2026-02-20T03:14:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.379+0000 7f8c8bfff640 1 -- 10.20.193.28:0/291936803 wait complete. 2026-02-20T03:14:58.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:58 trial028 ceph-mon[38552]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:14:58.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:58 trial028 ceph-mon[38552]: pgmap v185: 129 pgs: 129 active+clean; 605 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2026-02-20T03:14:58.477 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2026-02-20T03:14:58.003472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":619960,"num_objects":63,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":144,"num_read_kb":144,"num_write":331,"num_write_kb":3788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358048,"kb_used_data":13680,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807680352,"statfs":{"total":9019431321600,"available":9019064680448,"internally_reserved":0,"allocated":14008320,"data_stored":7674443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27162,"num_objects":39,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":38,"num_read_kb":53,"num_write":97,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002550"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.357986+0000","last_change":"2026-02-20T03:14:32.081180+0000","last_active":"2026-02-20T03:14:51.357986+0000","last_peered":"2026-02-20T03:14:51.357986+0000","last_clean":"2026-02-20T03:14:51.357986+0000","last_became_active":"2026-02-20T03:14:32.081083+0000","last_became_peered":"2026-02-20T03:14:32.081083+0000","last_unstale":"2026-02-20T03:14:51.357986+0000","last_undegraded":"2026-02-20T03:14:51.357986+0000","last_fullsized":"2026-02-20T03:14:51.357986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:23:16.897948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743323+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:14:38.743323+0000","last_peered":"2026-02-20T03:14:38.743323+0000","last_clean":"2026-02-20T03:14:38.743323+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:14:38.743323+0000","last_undegraded":"2026-02-20T03:14:38.743323+0000","last_fullsized":"2026-02-20T03:14:38.743323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743964+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:14:38.743964+0000","last_peered":"2026-02-20T03:14:38.743964+0000","last_clean":"2026-02-20T03:14:38.743964+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:14:38.743964+0000","last_undegraded":"2026-02-20T03:14:38.743964+0000","last_fullsized":"2026-02-20T03:14:38.743964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743404+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:14:38.743404+0000","last_peered":"2026-02-20T03:14:38.743404+0000","last_clean":"2026-02-20T03:14:38.743404+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:14:38.743404+0000","last_undegraded":"2026-02-20T03:14:38.743404+0000","last_fullsized":"2026-02-20T03:14:38.743404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311999+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:14:38.311999+0000","last_peered":"2026-02-20T03:14:38.311999+0000","last_clean":"2026-02-20T03:14:38.311999+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:14:38.311999+0000","last_undegraded":"2026-02-20T03:14:38.311999+0000","last_fullsized":"2026-02-20T03:14:38.311999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356040+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:14:51.356040+0000","last_peered":"2026-02-20T03:14:51.356040+0000","last_clean":"2026-02-20T03:14:51.356040+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:14:51.356040+0000","last_undegraded":"2026-02-20T03:14:51.356040+0000","last_fullsized":"2026-02-20T03:14:51.356040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749309+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:14:38.749309+0000","last_peered":"2026-02-20T03:14:38.749309+0000","last_clean":"2026-02-20T03:14:38.749309+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:14:38.749309+0000","last_undegraded":"2026-02-20T03:14:38.749309+0000","last_fullsized":"2026-02-20T03:14:38.749309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744316+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:14:38.744316+0000","last_peered":"2026-02-20T03:14:38.744316+0000","last_clean":"2026-02-20T03:14:38.744316+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:14:38.744316+0000","last_undegraded":"2026-02-20T03:14:38.744316+0000","last_fullsized":"2026-02-20T03:14:38.744316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744230+0000","last_change":"2026-02-20T03:14:33.291255+0000","last_active":"2026-02-20T03:14:38.744230+0000","last_peered":"2026-02-20T03:14:38.744230+0000","last_clean":"2026-02-20T03:14:38.744230+0000","last_became_active":"2026-02-20T03:14:33.291089+0000","last_became_peered":"2026-02-20T03:14:33.291089+0000","last_unstale":"2026-02-20T03:14:38.744230+0000","last_undegraded":"2026-02-20T03:14:38.744230+0000","last_fullsized":"2026-02-20T03:14:38.744230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:42:45.321761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318208+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:14:38.318208+0000","last_peered":"2026-02-20T03:14:38.318208+0000","last_clean":"2026-02-20T03:14:38.318208+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:14:38.318208+0000","last_undegraded":"2026-02-20T03:14:38.318208+0000","last_fullsized":"2026-02-20T03:14:38.318208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351492+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:14:50.351492+0000","last_peered":"2026-02-20T03:14:50.351492+0000","last_clean":"2026-02-20T03:14:50.351492+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:14:50.351492+0000","last_undegraded":"2026-02-20T03:14:50.351492+0000","last_fullsized":"2026-02-20T03:14:50.351492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742908+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:14:38.742908+0000","last_peered":"2026-02-20T03:14:38.742908+0000","last_clean":"2026-02-20T03:14:38.742908+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:14:38.742908+0000","last_undegraded":"2026-02-20T03:14:38.742908+0000","last_fullsized":"2026-02-20T03:14:38.742908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744042+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:14:38.744042+0000","last_peered":"2026-02-20T03:14:38.744042+0000","last_clean":"2026-02-20T03:14:38.744042+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:14:38.744042+0000","last_undegraded":"2026-02-20T03:14:38.744042+0000","last_fullsized":"2026-02-20T03:14:38.744042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749851+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:38.749851+0000","last_peered":"2026-02-20T03:14:38.749851+0000","last_clean":"2026-02-20T03:14:38.749851+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:38.749851+0000","last_undegraded":"2026-02-20T03:14:38.749851+0000","last_fullsized":"2026-02-20T03:14:38.749851+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743910+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:14:38.743910+0000","last_peered":"2026-02-20T03:14:38.743910+0000","last_clean":"2026-02-20T03:14:38.743910+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:14:38.743910+0000","last_undegraded":"2026-02-20T03:14:38.743910+0000","last_fullsized":"2026-02-20T03:14:38.743910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351649+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:14:50.351649+0000","last_peered":"2026-02-20T03:14:50.351649+0000","last_clean":"2026-02-20T03:14:50.351649+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:14:50.351649+0000","last_undegraded":"2026-02-20T03:14:50.351649+0000","last_fullsized":"2026-02-20T03:14:50.351649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742825+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:14:38.742825+0000","last_peered":"2026-02-20T03:14:38.742825+0000","last_clean":"2026-02-20T03:14:38.742825+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:14:38.742825+0000","last_undegraded":"2026-02-20T03:14:38.742825+0000","last_fullsized":"2026-02-20T03:14:38.742825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743900+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:14:38.743900+0000","last_peered":"2026-02-20T03:14:38.743900+0000","last_clean":"2026-02-20T03:14:38.743900+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:14:38.743900+0000","last_undegraded":"2026-02-20T03:14:38.743900+0000","last_fullsized":"2026-02-20T03:14:38.743900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357481+0000","last_change":"2026-02-20T03:14:32.086899+0000","last_active":"2026-02-20T03:14:50.357481+0000","last_peered":"2026-02-20T03:14:50.357481+0000","last_clean":"2026-02-20T03:14:50.357481+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357481+0000","last_undegraded":"2026-02-20T03:14:50.357481+0000","last_fullsized":"2026-02-20T03:14:50.357481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:29:02.472130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311960+0000","last_change":"2026-02-20T03:14:33.298094+0000","last_active":"2026-02-20T03:14:38.311960+0000","last_peered":"2026-02-20T03:14:38.311960+0000","last_clean":"2026-02-20T03:14:38.311960+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311960+0000","last_undegraded":"2026-02-20T03:14:38.311960+0000","last_fullsized":"2026-02-20T03:14:38.311960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:14:52.233571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744071+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:14:38.744071+0000","last_peered":"2026-02-20T03:14:38.744071+0000","last_clean":"2026-02-20T03:14:38.744071+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:14:38.744071+0000","last_undegraded":"2026-02-20T03:14:38.744071+0000","last_fullsized":"2026-02-20T03:14:38.744071+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743028+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:14:38.743028+0000","last_peered":"2026-02-20T03:14:38.743028+0000","last_clean":"2026-02-20T03:14:38.743028+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:14:38.743028+0000","last_undegraded":"2026-02-20T03:14:38.743028+0000","last_fullsized":"2026-02-20T03:14:38.743028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:53.292699+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:14:53.292699+0000","last_peered":"2026-02-20T03:14:53.292699+0000","last_clean":"2026-02-20T03:14:53.292699+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:14:53.292699+0000","last_undegraded":"2026-02-20T03:14:53.292699+0000","last_fullsized":"2026-02-20T03:14:53.292699+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742399+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:14:38.742399+0000","last_peered":"2026-02-20T03:14:38.742399+0000","last_clean":"2026-02-20T03:14:38.742399+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:14:38.742399+0000","last_undegraded":"2026-02-20T03:14:38.742399+0000","last_fullsized":"2026-02-20T03:14:38.742399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311146+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:14:38.311146+0000","last_peered":"2026-02-20T03:14:38.311146+0000","last_clean":"2026-02-20T03:14:38.311146+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:14:38.311146+0000","last_undegraded":"2026-02-20T03:14:38.311146+0000","last_fullsized":"2026-02-20T03:14:38.311146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352941+0000","last_change":"2026-02-20T03:14:32.081021+0000","last_active":"2026-02-20T03:14:50.352941+0000","last_peered":"2026-02-20T03:14:50.352941+0000","last_clean":"2026-02-20T03:14:50.352941+0000","last_became_active":"2026-02-20T03:14:32.080799+0000","last_became_peered":"2026-02-20T03:14:32.080799+0000","last_unstale":"2026-02-20T03:14:50.352941+0000","last_undegraded":"2026-02-20T03:14:50.352941+0000","last_fullsized":"2026-02-20T03:14:50.352941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:15.834880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744093+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:14:38.744093+0000","last_peered":"2026-02-20T03:14:38.744093+0000","last_clean":"2026-02-20T03:14:38.744093+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:14:38.744093+0000","last_undegraded":"2026-02-20T03:14:38.744093+0000","last_fullsized":"2026-02-20T03:14:38.744093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479703+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:14:38.479703+0000","last_peered":"2026-02-20T03:14:38.479703+0000","last_clean":"2026-02-20T03:14:38.479703+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:14:38.479703+0000","last_undegraded":"2026-02-20T03:14:38.479703+0000","last_fullsized":"2026-02-20T03:14:38.479703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742701+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:14:38.742701+0000","last_peered":"2026-02-20T03:14:38.742701+0000","last_clean":"2026-02-20T03:14:38.742701+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:14:38.742701+0000","last_undegraded":"2026-02-20T03:14:38.742701+0000","last_fullsized":"2026-02-20T03:14:38.742701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744036+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:14:38.744036+0000","last_peered":"2026-02-20T03:14:38.744036+0000","last_clean":"2026-02-20T03:14:38.744036+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:14:38.744036+0000","last_undegraded":"2026-02-20T03:14:38.744036+0000","last_fullsized":"2026-02-20T03:14:38.744036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479538+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:14:38.479538+0000","last_peered":"2026-02-20T03:14:38.479538+0000","last_clean":"2026-02-20T03:14:38.479538+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:14:38.479538+0000","last_undegraded":"2026-02-20T03:14:38.479538+0000","last_fullsized":"2026-02-20T03:14:38.479538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318364+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:14:38.318364+0000","last_peered":"2026-02-20T03:14:38.318364+0000","last_clean":"2026-02-20T03:14:38.318364+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:14:38.318364+0000","last_undegraded":"2026-02-20T03:14:38.318364+0000","last_fullsized":"2026-02-20T03:14:38.318364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311210+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:14:38.311210+0000","last_peered":"2026-02-20T03:14:38.311210+0000","last_clean":"2026-02-20T03:14:38.311210+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:14:38.311210+0000","last_undegraded":"2026-02-20T03:14:38.311210+0000","last_fullsized":"2026-02-20T03:14:38.311210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.290483+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.289779+0000","last_became_peered":"2026-02-20T03:14:33.289779+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:45:10.985058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356869+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:14:51.356869+0000","last_peered":"2026-02-20T03:14:51.356869+0000","last_clean":"2026-02-20T03:14:51.356869+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:14:51.356869+0000","last_undegraded":"2026-02-20T03:14:51.356869+0000","last_fullsized":"2026-02-20T03:14:51.356869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311164+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:14:38.311164+0000","last_peered":"2026-02-20T03:14:38.311164+0000","last_clean":"2026-02-20T03:14:38.311164+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:14:38.311164+0000","last_undegraded":"2026-02-20T03:14:38.311164+0000","last_fullsized":"2026-02-20T03:14:38.311164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.310925+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:14:38.310925+0000","last_peered":"2026-02-20T03:14:38.310925+0000","last_clean":"2026-02-20T03:14:38.310925+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:14:38.310925+0000","last_undegraded":"2026-02-20T03:14:38.310925+0000","last_fullsized":"2026-02-20T03:14:38.310925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.360846+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:14:51.360846+0000","last_peered":"2026-02-20T03:14:51.360846+0000","last_clean":"2026-02-20T03:14:51.360846+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:14:51.360846+0000","last_undegraded":"2026-02-20T03:14:51.360846+0000","last_fullsized":"2026-02-20T03:14:51.360846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744423+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:14:38.744423+0000","last_peered":"2026-02-20T03:14:38.744423+0000","last_clean":"2026-02-20T03:14:38.744423+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:14:38.744423+0000","last_undegraded":"2026-02-20T03:14:38.744423+0000","last_fullsized":"2026-02-20T03:14:38.744423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743435+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:14:38.743435+0000","last_peered":"2026-02-20T03:14:38.743435+0000","last_clean":"2026-02-20T03:14:38.743435+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:14:38.743435+0000","last_undegraded":"2026-02-20T03:14:38.743435+0000","last_fullsized":"2026-02-20T03:14:38.743435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318242+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:14:38.318242+0000","last_peered":"2026-02-20T03:14:38.318242+0000","last_clean":"2026-02-20T03:14:38.318242+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:14:38.318242+0000","last_undegraded":"2026-02-20T03:14:38.318242+0000","last_fullsized":"2026-02-20T03:14:38.318242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318423+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:14:38.318423+0000","last_peered":"2026-02-20T03:14:38.318423+0000","last_clean":"2026-02-20T03:14:38.318423+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:14:38.318423+0000","last_undegraded":"2026-02-20T03:14:38.318423+0000","last_fullsized":"2026-02-20T03:14:38.318423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318536+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:14:38.318536+0000","last_peered":"2026-02-20T03:14:38.318536+0000","last_clean":"2026-02-20T03:14:38.318536+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:14:38.318536+0000","last_undegraded":"2026-02-20T03:14:38.318536+0000","last_fullsized":"2026-02-20T03:14:38.318536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358847+0000","last_change":"2026-02-20T03:14:32.079575+0000","last_active":"2026-02-20T03:14:51.358847+0000","last_peered":"2026-02-20T03:14:51.358847+0000","last_clean":"2026-02-20T03:14:51.358847+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:51.358847+0000","last_undegraded":"2026-02-20T03:14:51.358847+0000","last_fullsized":"2026-02-20T03:14:51.358847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:32:22.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749026+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:14:38.749026+0000","last_peered":"2026-02-20T03:14:38.749026+0000","last_clean":"2026-02-20T03:14:38.749026+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:14:38.749026+0000","last_undegraded":"2026-02-20T03:14:38.749026+0000","last_fullsized":"2026-02-20T03:14:38.749026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318340+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:14:38.318340+0000","last_peered":"2026-02-20T03:14:38.318340+0000","last_clean":"2026-02-20T03:14:38.318340+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:14:38.318340+0000","last_undegraded":"2026-02-20T03:14:38.318340+0000","last_fullsized":"2026-02-20T03:14:38.318340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744433+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:14:38.744433+0000","last_peered":"2026-02-20T03:14:38.744433+0000","last_clean":"2026-02-20T03:14:38.744433+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:14:38.744433+0000","last_undegraded":"2026-02-20T03:14:38.744433+0000","last_fullsized":"2026-02-20T03:14:38.744433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311766+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:14:38.311766+0000","last_peered":"2026-02-20T03:14:38.311766+0000","last_clean":"2026-02-20T03:14:38.311766+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:14:38.311766+0000","last_undegraded":"2026-02-20T03:14:38.311766+0000","last_fullsized":"2026-02-20T03:14:38.311766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318490+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:14:38.318490+0000","last_peered":"2026-02-20T03:14:38.318490+0000","last_clean":"2026-02-20T03:14:38.318490+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:14:38.318490+0000","last_undegraded":"2026-02-20T03:14:38.318490+0000","last_fullsized":"2026-02-20T03:14:38.318490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311359+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:14:38.311359+0000","last_peered":"2026-02-20T03:14:38.311359+0000","last_clean":"2026-02-20T03:14:38.311359+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:14:38.311359+0000","last_undegraded":"2026-02-20T03:14:38.311359+0000","last_fullsized":"2026-02-20T03:14:38.311359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743916+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:14:38.743916+0000","last_peered":"2026-02-20T03:14:38.743916+0000","last_clean":"2026-02-20T03:14:38.743916+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:14:38.743916+0000","last_undegraded":"2026-02-20T03:14:38.743916+0000","last_fullsized":"2026-02-20T03:14:38.743916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744369+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:14:38.744369+0000","last_peered":"2026-02-20T03:14:38.744369+0000","last_clean":"2026-02-20T03:14:38.744369+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:14:38.744369+0000","last_undegraded":"2026-02-20T03:14:38.744369+0000","last_fullsized":"2026-02-20T03:14:38.744369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.359869+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:14:52.359869+0000","last_peered":"2026-02-20T03:14:52.359869+0000","last_clean":"2026-02-20T03:14:52.359869+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:14:52.359869+0000","last_undegraded":"2026-02-20T03:14:52.359869+0000","last_fullsized":"2026-02-20T03:14:52.359869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744027+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:14:38.744027+0000","last_peered":"2026-02-20T03:14:38.744027+0000","last_clean":"2026-02-20T03:14:38.744027+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:14:38.744027+0000","last_undegraded":"2026-02-20T03:14:38.744027+0000","last_fullsized":"2026-02-20T03:14:38.744027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743990+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:14:38.743990+0000","last_peered":"2026-02-20T03:14:38.743990+0000","last_clean":"2026-02-20T03:14:38.743990+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:14:38.743990+0000","last_undegraded":"2026-02-20T03:14:38.743990+0000","last_fullsized":"2026-02-20T03:14:38.743990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358752+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:14:51.358752+0000","last_peered":"2026-02-20T03:14:51.358752+0000","last_clean":"2026-02-20T03:14:51.358752+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:14:51.358752+0000","last_undegraded":"2026-02-20T03:14:51.358752+0000","last_fullsized":"2026-02-20T03:14:51.358752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311328+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:14:38.311328+0000","last_peered":"2026-02-20T03:14:38.311328+0000","last_clean":"2026-02-20T03:14:38.311328+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:14:38.311328+0000","last_undegraded":"2026-02-20T03:14:38.311328+0000","last_fullsized":"2026-02-20T03:14:38.311328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318042+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:14:38.318042+0000","last_peered":"2026-02-20T03:14:38.318042+0000","last_clean":"2026-02-20T03:14:38.318042+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:14:38.318042+0000","last_undegraded":"2026-02-20T03:14:38.318042+0000","last_fullsized":"2026-02-20T03:14:38.318042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:53.368868+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:14:53.368868+0000","last_peered":"2026-02-20T03:14:53.368868+0000","last_clean":"2026-02-20T03:14:53.368868+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:14:53.368868+0000","last_undegraded":"2026-02-20T03:14:53.368868+0000","last_fullsized":"2026-02-20T03:14:53.368868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743149+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:14:38.743149+0000","last_peered":"2026-02-20T03:14:38.743149+0000","last_clean":"2026-02-20T03:14:38.743149+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:14:38.743149+0000","last_undegraded":"2026-02-20T03:14:38.743149+0000","last_fullsized":"2026-02-20T03:14:38.743149+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318241+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:14:38.318241+0000","last_peered":"2026-02-20T03:14:38.318241+0000","last_clean":"2026-02-20T03:14:38.318241+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:14:38.318241+0000","last_undegraded":"2026-02-20T03:14:38.318241+0000","last_fullsized":"2026-02-20T03:14:38.318241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352270+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:14:50.352270+0000","last_peered":"2026-02-20T03:14:50.352270+0000","last_clean":"2026-02-20T03:14:50.352270+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:14:50.352270+0000","last_undegraded":"2026-02-20T03:14:50.352270+0000","last_fullsized":"2026-02-20T03:14:50.352270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744179+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:14:38.744179+0000","last_peered":"2026-02-20T03:14:38.744179+0000","last_clean":"2026-02-20T03:14:38.744179+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:14:38.744179+0000","last_undegraded":"2026-02-20T03:14:38.744179+0000","last_fullsized":"2026-02-20T03:14:38.744179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311740+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:14:38.311740+0000","last_peered":"2026-02-20T03:14:38.311740+0000","last_clean":"2026-02-20T03:14:38.311740+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:14:38.311740+0000","last_undegraded":"2026-02-20T03:14:38.311740+0000","last_fullsized":"2026-02-20T03:14:38.311740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356034+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:14:51.356034+0000","last_peered":"2026-02-20T03:14:51.356034+0000","last_clean":"2026-02-20T03:14:51.356034+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:14:51.356034+0000","last_undegraded":"2026-02-20T03:14:51.356034+0000","last_fullsized":"2026-02-20T03:14:51.356034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744303+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:14:38.744303+0000","last_peered":"2026-02-20T03:14:38.744303+0000","last_clean":"2026-02-20T03:14:38.744303+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:14:38.744303+0000","last_undegraded":"2026-02-20T03:14:38.744303+0000","last_fullsized":"2026-02-20T03:14:38.744303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744191+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:14:38.744191+0000","last_peered":"2026-02-20T03:14:38.744191+0000","last_clean":"2026-02-20T03:14:38.744191+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:14:38.744191+0000","last_undegraded":"2026-02-20T03:14:38.744191+0000","last_fullsized":"2026-02-20T03:14:38.744191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'19","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:54.369888+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:14:54.369888+0000","last_peered":"2026-02-20T03:14:54.369888+0000","last_clean":"2026-02-20T03:14:54.369888+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:14:54.369888+0000","last_undegraded":"2026-02-20T03:14:54.369888+0000","last_fullsized":"2026-02-20T03:14:54.369888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25443,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":30,"num_write":20,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742256+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:14:38.742256+0000","last_peered":"2026-02-20T03:14:38.742256+0000","last_clean":"2026-02-20T03:14:38.742256+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:14:38.742256+0000","last_undegraded":"2026-02-20T03:14:38.742256+0000","last_fullsized":"2026-02-20T03:14:38.742256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749385+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:14:38.749385+0000","last_peered":"2026-02-20T03:14:38.749385+0000","last_clean":"2026-02-20T03:14:38.749385+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:14:38.749385+0000","last_undegraded":"2026-02-20T03:14:38.749385+0000","last_fullsized":"2026-02-20T03:14:38.749385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352990+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:14:50.352990+0000","last_peered":"2026-02-20T03:14:50.352990+0000","last_clean":"2026-02-20T03:14:50.352990+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:14:50.352990+0000","last_undegraded":"2026-02-20T03:14:50.352990+0000","last_fullsized":"2026-02-20T03:14:50.352990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.312040+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:14:38.312040+0000","last_peered":"2026-02-20T03:14:38.312040+0000","last_clean":"2026-02-20T03:14:38.312040+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:14:38.312040+0000","last_undegraded":"2026-02-20T03:14:38.312040+0000","last_fullsized":"2026-02-20T03:14:38.312040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.356807+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:14:50.356807+0000","last_peered":"2026-02-20T03:14:50.356807+0000","last_clean":"2026-02-20T03:14:50.356807+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:14:50.356807+0000","last_undegraded":"2026-02-20T03:14:50.356807+0000","last_fullsized":"2026-02-20T03:14:50.356807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743191+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:14:38.743191+0000","last_peered":"2026-02-20T03:14:38.743191+0000","last_clean":"2026-02-20T03:14:38.743191+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:14:38.743191+0000","last_undegraded":"2026-02-20T03:14:38.743191+0000","last_fullsized":"2026-02-20T03:14:38.743191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749609+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:14:38.749609+0000","last_peered":"2026-02-20T03:14:38.749609+0000","last_clean":"2026-02-20T03:14:38.749609+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:14:38.749609+0000","last_undegraded":"2026-02-20T03:14:38.749609+0000","last_fullsized":"2026-02-20T03:14:38.749609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:53.367299+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:14:53.367299+0000","last_peered":"2026-02-20T03:14:53.367299+0000","last_clean":"2026-02-20T03:14:53.367299+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:14:53.367299+0000","last_undegraded":"2026-02-20T03:14:53.367299+0000","last_fullsized":"2026-02-20T03:14:53.367299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743127+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:14:38.743127+0000","last_peered":"2026-02-20T03:14:38.743127+0000","last_clean":"2026-02-20T03:14:38.743127+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:14:38.743127+0000","last_undegraded":"2026-02-20T03:14:38.743127+0000","last_fullsized":"2026-02-20T03:14:38.743127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311932+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:14:38.311932+0000","last_peered":"2026-02-20T03:14:38.311932+0000","last_clean":"2026-02-20T03:14:38.311932+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:14:38.311932+0000","last_undegraded":"2026-02-20T03:14:38.311932+0000","last_fullsized":"2026-02-20T03:14:38.311932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742536+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:14:38.742536+0000","last_peered":"2026-02-20T03:14:38.742536+0000","last_clean":"2026-02-20T03:14:38.742536+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:14:38.742536+0000","last_undegraded":"2026-02-20T03:14:38.742536+0000","last_fullsized":"2026-02-20T03:14:38.742536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744067+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:14:38.744067+0000","last_peered":"2026-02-20T03:14:38.744067+0000","last_clean":"2026-02-20T03:14:38.744067+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:14:38.744067+0000","last_undegraded":"2026-02-20T03:14:38.744067+0000","last_fullsized":"2026-02-20T03:14:38.744067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744459+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:14:38.744459+0000","last_peered":"2026-02-20T03:14:38.744459+0000","last_clean":"2026-02-20T03:14:38.744459+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:14:38.744459+0000","last_undegraded":"2026-02-20T03:14:38.744459+0000","last_fullsized":"2026-02-20T03:14:38.744459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742665+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:14:38.742665+0000","last_peered":"2026-02-20T03:14:38.742665+0000","last_clean":"2026-02-20T03:14:38.742665+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:14:38.742665+0000","last_undegraded":"2026-02-20T03:14:38.742665+0000","last_fullsized":"2026-02-20T03:14:38.742665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356776+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:14:51.356776+0000","last_peered":"2026-02-20T03:14:51.356776+0000","last_clean":"2026-02-20T03:14:51.356776+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:14:51.356776+0000","last_undegraded":"2026-02-20T03:14:51.356776+0000","last_fullsized":"2026-02-20T03:14:51.356776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.361797+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:14:51.361797+0000","last_peered":"2026-02-20T03:14:51.361797+0000","last_clean":"2026-02-20T03:14:51.361797+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:14:51.361797+0000","last_undegraded":"2026-02-20T03:14:51.361797+0000","last_fullsized":"2026-02-20T03:14:51.361797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744227+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:14:38.744227+0000","last_peered":"2026-02-20T03:14:38.744227+0000","last_clean":"2026-02-20T03:14:38.744227+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:14:38.744227+0000","last_undegraded":"2026-02-20T03:14:38.744227+0000","last_fullsized":"2026-02-20T03:14:38.744227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744309+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:14:38.744309+0000","last_peered":"2026-02-20T03:14:38.744309+0000","last_clean":"2026-02-20T03:14:38.744309+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:14:38.744309+0000","last_undegraded":"2026-02-20T03:14:38.744309+0000","last_fullsized":"2026-02-20T03:14:38.744309+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.361725+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:14:52.361725+0000","last_peered":"2026-02-20T03:14:52.361725+0000","last_clean":"2026-02-20T03:14:52.361725+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:14:52.361725+0000","last_undegraded":"2026-02-20T03:14:52.361725+0000","last_fullsized":"2026-02-20T03:14:52.361725+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744076+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:14:38.744076+0000","last_peered":"2026-02-20T03:14:38.744076+0000","last_clean":"2026-02-20T03:14:38.744076+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:14:38.744076+0000","last_undegraded":"2026-02-20T03:14:38.744076+0000","last_fullsized":"2026-02-20T03:14:38.744076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744370+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:14:38.744370+0000","last_peered":"2026-02-20T03:14:38.744370+0000","last_clean":"2026-02-20T03:14:38.744370+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:14:38.744370+0000","last_undegraded":"2026-02-20T03:14:38.744370+0000","last_fullsized":"2026-02-20T03:14:38.744370+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743873+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:14:38.743873+0000","last_peered":"2026-02-20T03:14:38.743873+0000","last_clean":"2026-02-20T03:14:38.743873+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:14:38.743873+0000","last_undegraded":"2026-02-20T03:14:38.743873+0000","last_fullsized":"2026-02-20T03:14:38.743873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744166+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:14:38.744166+0000","last_peered":"2026-02-20T03:14:38.744166+0000","last_clean":"2026-02-20T03:14:38.744166+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:14:38.744166+0000","last_undegraded":"2026-02-20T03:14:38.744166+0000","last_fullsized":"2026-02-20T03:14:38.744166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311828+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:14:38.311828+0000","last_peered":"2026-02-20T03:14:38.311828+0000","last_clean":"2026-02-20T03:14:38.311828+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:14:38.311828+0000","last_undegraded":"2026-02-20T03:14:38.311828+0000","last_fullsized":"2026-02-20T03:14:38.311828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311110+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:14:38.311110+0000","last_peered":"2026-02-20T03:14:38.311110+0000","last_clean":"2026-02-20T03:14:38.311110+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:14:38.311110+0000","last_undegraded":"2026-02-20T03:14:38.311110+0000","last_fullsized":"2026-02-20T03:14:38.311110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744275+0000","last_change":"2026-02-20T03:14:33.290769+0000","last_active":"2026-02-20T03:14:38.744275+0000","last_peered":"2026-02-20T03:14:38.744275+0000","last_clean":"2026-02-20T03:14:38.744275+0000","last_became_active":"2026-02-20T03:14:33.290406+0000","last_became_peered":"2026-02-20T03:14:33.290406+0000","last_unstale":"2026-02-20T03:14:38.744275+0000","last_undegraded":"2026-02-20T03:14:38.744275+0000","last_fullsized":"2026-02-20T03:14:38.744275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:58.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744400+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:14:38.744400+0000","last_peered":"2026-02-20T03:14:38.744400+0000","last_clean":"2026-02-20T03:14:38.744400+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:14:38.744400+0000","last_undegraded":"2026-02-20T03:14:38.744400+0000","last_fullsized":"2026-02-20T03:14:38.744400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742977+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:14:38.742977+0000","last_peered":"2026-02-20T03:14:38.742977+0000","last_clean":"2026-02-20T03:14:38.742977+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:14:38.742977+0000","last_undegraded":"2026-02-20T03:14:38.742977+0000","last_fullsized":"2026-02-20T03:14:38.742977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743959+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:14:38.743959+0000","last_peered":"2026-02-20T03:14:38.743959+0000","last_clean":"2026-02-20T03:14:38.743959+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:14:38.743959+0000","last_undegraded":"2026-02-20T03:14:38.743959+0000","last_fullsized":"2026-02-20T03:14:38.743959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743157+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:14:38.743157+0000","last_peered":"2026-02-20T03:14:38.743157+0000","last_clean":"2026-02-20T03:14:38.743157+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:14:38.743157+0000","last_undegraded":"2026-02-20T03:14:38.743157+0000","last_fullsized":"2026-02-20T03:14:38.743157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749238+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:14:38.749238+0000","last_peered":"2026-02-20T03:14:38.749238+0000","last_clean":"2026-02-20T03:14:38.749238+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:14:38.749238+0000","last_undegraded":"2026-02-20T03:14:38.749238+0000","last_fullsized":"2026-02-20T03:14:38.749238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311289+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:14:38.311289+0000","last_peered":"2026-02-20T03:14:38.311289+0000","last_clean":"2026-02-20T03:14:38.311289+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:14:38.311289+0000","last_undegraded":"2026-02-20T03:14:38.311289+0000","last_fullsized":"2026-02-20T03:14:38.311289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744096+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:14:38.744096+0000","last_peered":"2026-02-20T03:14:38.744096+0000","last_clean":"2026-02-20T03:14:38.744096+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:14:38.744096+0000","last_undegraded":"2026-02-20T03:14:38.744096+0000","last_fullsized":"2026-02-20T03:14:38.744096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744472+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:14:38.744472+0000","last_peered":"2026-02-20T03:14:38.744472+0000","last_clean":"2026-02-20T03:14:38.744472+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:14:38.744472+0000","last_undegraded":"2026-02-20T03:14:38.744472+0000","last_fullsized":"2026-02-20T03:14:38.744472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742612+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:14:38.742612+0000","last_peered":"2026-02-20T03:14:38.742612+0000","last_clean":"2026-02-20T03:14:38.742612+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:14:38.742612+0000","last_undegraded":"2026-02-20T03:14:38.742612+0000","last_fullsized":"2026-02-20T03:14:38.742612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744492+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:14:38.744492+0000","last_peered":"2026-02-20T03:14:38.744492+0000","last_clean":"2026-02-20T03:14:38.744492+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:14:38.744492+0000","last_undegraded":"2026-02-20T03:14:38.744492+0000","last_fullsized":"2026-02-20T03:14:38.744492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.748833+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:14:38.748833+0000","last_peered":"2026-02-20T03:14:38.748833+0000","last_clean":"2026-02-20T03:14:38.748833+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:14:38.748833+0000","last_undegraded":"2026-02-20T03:14:38.748833+0000","last_fullsized":"2026-02-20T03:14:38.748833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311670+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:14:38.311670+0000","last_peered":"2026-02-20T03:14:38.311670+0000","last_clean":"2026-02-20T03:14:38.311670+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:14:38.311670+0000","last_undegraded":"2026-02-20T03:14:38.311670+0000","last_fullsized":"2026-02-20T03:14:38.311670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311568+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:14:38.311568+0000","last_peered":"2026-02-20T03:14:38.311568+0000","last_clean":"2026-02-20T03:14:38.311568+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:14:38.311568+0000","last_undegraded":"2026-02-20T03:14:38.311568+0000","last_fullsized":"2026-02-20T03:14:38.311568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311264+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:14:38.311264+0000","last_peered":"2026-02-20T03:14:38.311264+0000","last_clean":"2026-02-20T03:14:38.311264+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:14:38.311264+0000","last_undegraded":"2026-02-20T03:14:38.311264+0000","last_fullsized":"2026-02-20T03:14:38.311264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318524+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:14:38.318524+0000","last_peered":"2026-02-20T03:14:38.318524+0000","last_clean":"2026-02-20T03:14:38.318524+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:14:38.318524+0000","last_undegraded":"2026-02-20T03:14:38.318524+0000","last_fullsized":"2026-02-20T03:14:38.318524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479875+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:14:38.479875+0000","last_peered":"2026-02-20T03:14:38.479875+0000","last_clean":"2026-02-20T03:14:38.479875+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:14:38.479875+0000","last_undegraded":"2026-02-20T03:14:38.479875+0000","last_fullsized":"2026-02-20T03:14:38.479875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749648+0000","last_change":"2026-02-20T03:14:33.295988+0000","last_active":"2026-02-20T03:14:38.749648+0000","last_peered":"2026-02-20T03:14:38.749648+0000","last_clean":"2026-02-20T03:14:38.749648+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749648+0000","last_undegraded":"2026-02-20T03:14:38.749648+0000","last_fullsized":"2026-02-20T03:14:38.749648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:12:01.602799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742670+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:14:38.742670+0000","last_peered":"2026-02-20T03:14:38.742670+0000","last_clean":"2026-02-20T03:14:38.742670+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:14:38.742670+0000","last_undegraded":"2026-02-20T03:14:38.742670+0000","last_fullsized":"2026-02-20T03:14:38.742670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318097+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:14:38.318097+0000","last_peered":"2026-02-20T03:14:38.318097+0000","last_clean":"2026-02-20T03:14:38.318097+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:14:38.318097+0000","last_undegraded":"2026-02-20T03:14:38.318097+0000","last_fullsized":"2026-02-20T03:14:38.318097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479297+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:14:38.479297+0000","last_peered":"2026-02-20T03:14:38.479297+0000","last_clean":"2026-02-20T03:14:38.479297+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:14:38.479297+0000","last_undegraded":"2026-02-20T03:14:38.479297+0000","last_fullsized":"2026-02-20T03:14:38.479297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743970+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:14:38.743970+0000","last_peered":"2026-02-20T03:14:38.743970+0000","last_clean":"2026-02-20T03:14:38.743970+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:14:38.743970+0000","last_undegraded":"2026-02-20T03:14:38.743970+0000","last_fullsized":"2026-02-20T03:14:38.743970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311798+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:14:38.311798+0000","last_peered":"2026-02-20T03:14:38.311798+0000","last_clean":"2026-02-20T03:14:38.311798+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:14:38.311798+0000","last_undegraded":"2026-02-20T03:14:38.311798+0000","last_fullsized":"2026-02-20T03:14:38.311798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311904+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:14:38.311904+0000","last_peered":"2026-02-20T03:14:38.311904+0000","last_clean":"2026-02-20T03:14:38.311904+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:14:38.311904+0000","last_undegraded":"2026-02-20T03:14:38.311904+0000","last_fullsized":"2026-02-20T03:14:38.311904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744466+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:14:38.744466+0000","last_peered":"2026-02-20T03:14:38.744466+0000","last_clean":"2026-02-20T03:14:38.744466+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:14:38.744466+0000","last_undegraded":"2026-02-20T03:14:38.744466+0000","last_fullsized":"2026-02-20T03:14:38.744466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":24576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":29475,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":38,"num_read_kb":53,"num_write":141,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":130515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383689,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971104,"statfs":{"total":751619276800,"available":751586410496,"internally_reserved":0,"allocated":995328,"data_stored":484050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612619,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32736,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970464,"statfs":{"total":751619276800,"available":751585755136,"internally_reserved":0,"allocated":1650688,"data_stored":1097153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776141,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27952,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975248,"statfs":{"total":751619276800,"available":751590653952,"internally_reserved":0,"allocated":1011712,"data_stored":484286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037776,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32112,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971088,"statfs":{"total":751619276800,"available":751586394112,"internally_reserved":0,"allocated":1011712,"data_stored":484206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299410,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32692,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970508,"statfs":{"total":751619276800,"available":751585800192,"internally_reserved":0,"allocated":1605632,"data_stored":1080116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462931,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":479452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724566,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28536,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974664,"statfs":{"total":751619276800,"available":751590055936,"internally_reserved":0,"allocated":1609728,"data_stored":1071216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888088,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32100,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971100,"statfs":{"total":751619276800,"available":751586406400,"internally_reserved":0,"allocated":999424,"data_stored":480398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149722,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27944,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975256,"statfs":{"total":751619276800,"available":751590662144,"internally_reserved":0,"allocated":1003520,"data_stored":479646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28008,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975192,"statfs":{"total":751619276800,"available":751590596608,"internally_reserved":0,"allocated":1069056,"data_stored":527210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27984,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975216,"statfs":{"total":751619276800,"available":751590621184,"internally_reserved":0,"allocated":1044480,"data_stored":525850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":480860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":47848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":27423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:14:58.487 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-20T03:14:58.488 INFO:tasks.cephadm:Setting up client nodes... 2026-02-20T03:14:58.489 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-20T03:14:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:58 trial177 ceph-mon[43181]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:14:58.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:58 trial177 ceph-mon[43181]: pgmap v185: 129 pgs: 129 active+clean; 605 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2026-02-20T03:14:58.784 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:58.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:58 trial126 ceph-mon[38476]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:14:58.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:58 trial126 ceph-mon[38476]: pgmap v185: 129 pgs: 129 active+clean; 605 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2026-02-20T03:14:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.964+0000 7f7f0324a640 1 -- 10.20.193.28:0/4083643532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 msgr2=0x7f7efc10a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.964+0000 7f7f0324a640 1 --2- 10.20.193.28:0/4083643532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 0x7f7efc10a2d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009a30 tx=0x7f7ef002f1c0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.964+0000 7f7f0324a640 1 -- 10.20.193.28:0/4083643532 shutdown_connections 2026-02-20T03:14:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.964+0000 7f7f0324a640 1 --2- 10.20.193.28:0/4083643532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7efc10a970 0x7f7efc111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.964+0000 7f7f0324a640 1 --2- 10.20.193.28:0/4083643532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 0x7f7efc10a2d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.964+0000 7f7f0324a640 1 --2- 10.20.193.28:0/4083643532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7efc109480 0x7f7efc109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.964+0000 7f7f0324a640 1 -- 10.20.193.28:0/4083643532 >> 10.20.193.28:0/4083643532 conn(0x7f7efc078050 msgr2=0x7f7efc07a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:58.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.964+0000 7f7f0324a640 1 -- 10.20.193.28:0/4083643532 shutdown_connections 2026-02-20T03:14:58.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.964+0000 7f7f0324a640 1 -- 10.20.193.28:0/4083643532 wait complete. 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f0324a640 1 Processor -- start 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f0324a640 1 -- start start 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f0324a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7efc109480 0x7f7efc1a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f0324a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 0x7f7efc1a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f0324a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7efc10a970 0x7f7efc1a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f0324a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc114a00 con 0x7f7efc109e50 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f0324a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc114880 con 0x7f7efc10a970 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f0324a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc114b80 con 0x7f7efc109480 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f01a47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 0x7f7efc1a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f01a47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 0x7f7efc1a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56360/0 (socket says 10.20.193.28:56360) 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f01a47640 1 -- 10.20.193.28:0/3563232903 learned_addr learned my addr 10.20.193.28:0/3563232903 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.965+0000 7f7f02248640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7efc109480 0x7f7efc1a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7f02a49640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7efc10a970 0x7f7efc1a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7f01a47640 1 -- 10.20.193.28:0/3563232903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7efc109480 msgr2=0x7f7efc1a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7f01a47640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7efc109480 0x7f7efc1a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7f01a47640 1 -- 10.20.193.28:0/3563232903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7efc10a970 msgr2=0x7f7efc1a85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7f01a47640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7efc10a970 0x7f7efc1a85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7f01a47640 1 -- 10.20.193.28:0/3563232903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc1a8cb0 con 0x7f7efc109e50 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7f01a47640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 0x7f7efc1a1530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009b60 tx=0x7f7ef0002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7ee37fe640 1 -- 10.20.193.28:0/3563232903 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0002e30 con 0x7f7efc109e50 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc1a8f40 con 0x7f7efc109e50 2026-02-20T03:14:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7ee37fe640 1 -- 10.20.193.28:0/3563232903 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7ef0038770 con 0x7f7efc109e50 2026-02-20T03:14:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7ee37fe640 1 -- 10.20.193.28:0/3563232903 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0041840 con 0x7f7efc109e50 2026-02-20T03:14:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.966+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc1a93a0 con 0x7f7efc109e50 2026-02-20T03:14:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.967+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc10fef0 con 0x7f7efc109e50 2026-02-20T03:14:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.969+0000 7f7ee37fe640 1 -- 10.20.193.28:0/3563232903 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f7ef0038920 con 0x7f7efc109e50 2026-02-20T03:14:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.970+0000 7f7ee37fe640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ed80b0ee0 0x7f7ed80b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.970+0000 7f7ee37fe640 1 -- 10.20.193.28:0/3563232903 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f7ef0105540 con 0x7f7efc109e50 2026-02-20T03:14:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.970+0000 7f7f02248640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ed80b0ee0 0x7f7ed80b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.971+0000 7f7ee37fe640 1 -- 10.20.193.28:0/3563232903 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f7ef00cda20 con 0x7f7efc109e50 2026-02-20T03:14:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:58.971+0000 7f7f02248640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ed80b0ee0 0x7f7ed80b33a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7efc07b770 tx=0x7f7eec00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:59.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.093+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f7efc1100c0 con 0x7f7efc109e50 2026-02-20T03:14:59.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.095+0000 7f7ee37fe640 1 -- 10.20.193.28:0/3563232903 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f7ef00d16d0 con 0x7f7efc109e50 2026-02-20T03:14:59.098 INFO:teuthology.orchestra.run.trial028.stdout:[client.0] 2026-02-20T03:14:59.098 INFO:teuthology.orchestra.run.trial028.stdout: key = AQCz0ZdpUtSpBRAATU41TwncdilwZl941VGJsg== 2026-02-20T03:14:59.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ed80b0ee0 msgr2=0x7f7ed80b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:59.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ed80b0ee0 0x7f7ed80b33a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7efc07b770 tx=0x7f7eec00b410 comp rx=0 tx=0).stop 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 msgr2=0x7f7efc1a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 0x7f7efc1a1530 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009b60 tx=0x7f7ef0002910 comp rx=0 tx=0).stop 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 shutdown_connections 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ed80b0ee0 0x7f7ed80b33a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7efc10a970 0x7f7efc1a85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7efc109e50 0x7f7efc1a1530 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 --2- 10.20.193.28:0/3563232903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7efc109480 0x7f7efc1a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 >> 10.20.193.28:0/3563232903 conn(0x7f7efc078050 msgr2=0x7f7efc10d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 shutdown_connections 2026-02-20T03:14:59.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.096+0000 7f7f0324a640 1 -- 10.20.193.28:0/3563232903 wait complete. 2026-02-20T03:14:59.198 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:14:59.199 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-20T03:14:59.199 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T03:14:59.278 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T03:14:59.278 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-20T03:14:59.279 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-20T03:14:59.583 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:14:59.628 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:59 trial028 ceph-mon[38552]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:14:59.628 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:59 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3563232903' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-20T03:14:59.628 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:14:59 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3563232903' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T03:14:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:59 trial177 ceph-mon[43181]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:14:59.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:59 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3563232903' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-20T03:14:59.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:14:59 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3563232903' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T03:14:59.749 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:59 trial126 ceph-mon[38476]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:14:59.749 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:59 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3563232903' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-20T03:14:59.750 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:14:59 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3563232903' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-20T03:14:59.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 -- 10.20.193.28:0/945804495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f736810a980 msgr2=0x7f736810ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:59.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 --2- 10.20.193.28:0/945804495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f736810a980 0x7f736810ad60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7354009a60 tx=0x7f735402f250 comp rx=0 tx=0).stop 2026-02-20T03:14:59.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 -- 10.20.193.28:0/945804495 shutdown_connections 2026-02-20T03:14:59.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 --2- 10.20.193.28:0/945804495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7368105320 0x7f7368111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 --2- 10.20.193.28:0/945804495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7368104980 0x7f7368104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 --2- 10.20.193.28:0/945804495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f736810a980 0x7f736810ad60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 -- 10.20.193.28:0/945804495 >> 10.20.193.28:0/945804495 conn(0x7f7368100680 msgr2=0x7f7368102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:59.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 -- 10.20.193.28:0/945804495 shutdown_connections 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 -- 10.20.193.28:0/945804495 wait complete. 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 Processor -- start 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.756+0000 7f736d115640 1 -- start start 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f736d115640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7368104980 0x7f736819d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f736d115640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7368105320 0x7f736819d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f736d115640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f736810a980 0x7f73681a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f736d115640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7368114bf0 con 0x7f7368104980 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f736d115640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7368114a70 con 0x7f736810a980 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f736d115640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7368114d70 con 0x7f7368105320 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f7367fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7368104980 0x7f736819d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:59.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f73677fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7368105320 0x7f736819d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f7367fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7368104980 0x7f736819d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56378/0 (socket says 10.20.193.28:56378) 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f7367fff640 1 -- 10.20.193.28:0/3054538593 learned_addr learned my addr 10.20.193.28:0/3054538593 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f736c914640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f736810a980 0x7f73681a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f7367fff640 1 -- 10.20.193.28:0/3054538593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7368105320 msgr2=0x7f736819d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f7367fff640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7368105320 0x7f736819d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f7367fff640 1 -- 10.20.193.28:0/3054538593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f736810a980 msgr2=0x7f73681a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f7367fff640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f736810a980 0x7f73681a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f7367fff640 1 -- 10.20.193.28:0/3054538593 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73681a2100 con 0x7f7368104980 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.757+0000 7f7367fff640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7368104980 0x7f736819d0b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7354002410 tx=0x7f735402fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.758+0000 7f73657fa640 1 -- 10.20.193.28:0/3054538593 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354002a30 con 0x7f7368104980 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.758+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73681a2390 con 0x7f7368104980 2026-02-20T03:14:59.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.758+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73681a9c30 con 0x7f7368104980 2026-02-20T03:14:59.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.758+0000 7f73657fa640 1 -- 10.20.193.28:0/3054538593 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f735402fe40 con 0x7f7368104980 2026-02-20T03:14:59.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.758+0000 7f73657fa640 1 -- 10.20.193.28:0/3054538593 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354042680 con 0x7f7368104980 2026-02-20T03:14:59.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.758+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7368104de0 con 0x7f7368104980 2026-02-20T03:14:59.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.761+0000 7f73657fa640 1 -- 10.20.193.28:0/3054538593 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f7354038890 con 0x7f7368104980 2026-02-20T03:14:59.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.762+0000 7f73657fa640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f733c0b0eb0 0x7f733c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:14:59.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.762+0000 7f73657fa640 1 -- 10.20.193.28:0/3054538593 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f7354104ff0 con 0x7f7368104980 2026-02-20T03:14:59.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.762+0000 7f73657fa640 1 -- 10.20.193.28:0/3054538593 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f73540cd490 con 0x7f7368104980 2026-02-20T03:14:59.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.762+0000 7f73677fe640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f733c0b0eb0 0x7f733c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:14:59.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.763+0000 7f73677fe640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f733c0b0eb0 0x7f733c0b3370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7368102df0 tx=0x7f7358009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:14:59.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.874+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f736810c9c0 con 0x7f7368104980 2026-02-20T03:14:59.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.878+0000 7f73657fa640 1 -- 10.20.193.28:0/3054538593 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v16) ==== 74+0+287343 (secure 0 0 0) 0x7f73540d1140 con 0x7f7368104980 2026-02-20T03:14:59.885 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:14:59.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f733c0b0eb0 msgr2=0x7f733c0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:59.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f733c0b0eb0 0x7f733c0b3370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7368102df0 tx=0x7f7358009290 comp rx=0 tx=0).stop 2026-02-20T03:14:59.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7368104980 msgr2=0x7f736819d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:14:59.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7368104980 0x7f736819d0b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7354002410 tx=0x7f735402fca0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 shutdown_connections 2026-02-20T03:14:59.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f733c0b0eb0 0x7f733c0b3370 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f736810a980 0x7f73681a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7368105320 0x7f736819d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 --2- 10.20.193.28:0/3054538593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7368104980 0x7f736819d0b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:14:59.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 >> 10.20.193.28:0/3054538593 conn(0x7f7368100680 msgr2=0x7f7368101100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:14:59.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 shutdown_connections 2026-02-20T03:14:59.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:14:59.881+0000 7f736d115640 1 -- 10.20.193.28:0/3054538593 wait complete. 2026-02-20T03:14:59.980 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":16,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6800","nonce":3562582510},{"type":"v1","addr":"10.20.193.28:6801","nonce":3562582510}]},"active_addr":"10.20.193.28:6801/3562582510","active_change":"2026-02-20T03:11:25.971250+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.28:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":3634579217}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":4207797157}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":4249222346}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":3288790577}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.28:0","nonce":3755810501}]}]} 2026-02-20T03:14:59.990 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-20T03:14:59.990 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-20T03:14:59.991 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:15:00.251 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:00.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.423+0000 7ff35f2a5640 1 -- 10.20.193.28:0/3791425246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358113850 msgr2=0x7ff358115c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:00.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.423+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/3791425246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358113850 0x7ff358115c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff35400b0a0 tx=0x7ff35402f410 comp rx=0 tx=0).stop 2026-02-20T03:15:00.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.424+0000 7ff35f2a5640 1 -- 10.20.193.28:0/3791425246 shutdown_connections 2026-02-20T03:15:00.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.424+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/3791425246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358113850 0x7ff358115c40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.424+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/3791425246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358077f40 0x7ff358113310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.424+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/3791425246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358077620 0x7ff358077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.424+0000 7ff35f2a5640 1 -- 10.20.193.28:0/3791425246 >> 10.20.193.28:0/3791425246 conn(0x7ff358100690 msgr2=0x7ff358102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.424+0000 7ff35f2a5640 1 -- 10.20.193.28:0/3791425246 shutdown_connections 2026-02-20T03:15:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.424+0000 7ff35f2a5640 1 -- 10.20.193.28:0/3791425246 wait complete. 2026-02-20T03:15:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.424+0000 7ff35f2a5640 1 Processor -- start 2026-02-20T03:15:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.424+0000 7ff35f2a5640 1 -- start start 2026-02-20T03:15:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35f2a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358077620 0x7ff3581a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35f2a5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358077f40 0x7ff3581a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35f2a5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358113850 0x7ff3581a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35f2a5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff358119210 con 0x7ff358077620 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35f2a5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff358119090 con 0x7ff358077f40 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35f2a5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff358119390 con 0x7ff358113850 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35e2a3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358077620 0x7ff3581a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35e2a3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358077620 0x7ff3581a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56400/0 (socket says 10.20.193.28:56400) 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35e2a3640 1 -- 10.20.193.28:0/2363605587 learned_addr learned my addr 10.20.193.28:0/2363605587 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35daa2640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358077f40 0x7ff3581a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35eaa4640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358113850 0x7ff3581a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35e2a3640 1 -- 10.20.193.28:0/2363605587 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358113850 msgr2=0x7ff3581a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35e2a3640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358113850 0x7ff3581a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35e2a3640 1 -- 10.20.193.28:0/2363605587 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358077f40 msgr2=0x7ff3581a1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35e2a3640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358077f40 0x7ff3581a1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35e2a3640 1 -- 10.20.193.28:0/2363605587 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3581a6610 con 0x7ff358077620 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35daa2640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358077f40 0x7ff3581a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35eaa4640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358113850 0x7ff3581a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff35e2a3640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358077620 0x7ff3581a15c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d980 tx=0x7ff34800de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.425+0000 7ff33f7fe640 1 -- 10.20.193.28:0/2363605587 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348014070 con 0x7ff358077620 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.426+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3581a6900 con 0x7ff358077620 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.426+0000 7ff33f7fe640 1 -- 10.20.193.28:0/2363605587 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff3480044e0 con 0x7ff358077620 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.426+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3581ae140 con 0x7ff358077620 2026-02-20T03:15:00.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.426+0000 7ff33f7fe640 1 -- 10.20.193.28:0/2363605587 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348014070 con 0x7ff358077620 2026-02-20T03:15:00.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.426+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff358078d60 con 0x7ff358077620 2026-02-20T03:15:00.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.428+0000 7ff33f7fe640 1 -- 10.20.193.28:0/2363605587 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7ff3480047c0 con 0x7ff358077620 2026-02-20T03:15:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.430+0000 7ff33f7fe640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3340b1030 0x7ff3340b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.430+0000 7ff33f7fe640 1 -- 10.20.193.28:0/2363605587 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ff3480e05a0 con 0x7ff358077620 2026-02-20T03:15:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.430+0000 7ff33f7fe640 1 -- 10.20.193.28:0/2363605587 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff3480a8a80 con 0x7ff358077620 2026-02-20T03:15:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.430+0000 7ff35daa2640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3340b1030 0x7ff3340b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.431+0000 7ff35daa2640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3340b1030 0x7ff3340b34f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff34c005e80 tx=0x7ff34c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:00.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.520+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff35810e450 con 0x7ff358077620 2026-02-20T03:15:00.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.521+0000 7ff33f7fe640 1 -- 10.20.193.28:0/2363605587 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7ff3480ac730 con 0x7ff358077620 2026-02-20T03:15:00.525 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:00.525 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:15:00.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3340b1030 msgr2=0x7ff3340b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:00.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3340b1030 0x7ff3340b34f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff34c005e80 tx=0x7ff34c005d90 comp rx=0 tx=0).stop 2026-02-20T03:15:00.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358077620 msgr2=0x7ff3581a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:00.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358077620 0x7ff3581a15c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff34800d980 tx=0x7ff34800de50 comp rx=0 tx=0).stop 2026-02-20T03:15:00.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 shutdown_connections 2026-02-20T03:15:00.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3340b1030 0x7ff3340b34f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:00.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff358113850 0x7ff3581a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:00.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff358077f40 0x7ff3581a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:00.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 --2- 10.20.193.28:0/2363605587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff358077620 0x7ff3581a15c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:00.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 >> 10.20.193.28:0/2363605587 conn(0x7ff358100690 msgr2=0x7ff358102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:00.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 shutdown_connections 2026-02-20T03:15:00.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:00.522+0000 7ff35f2a5640 1 -- 10.20.193.28:0/2363605587 wait complete. 2026-02-20T03:15:00.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:00 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3054538593' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-20T03:15:00.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:00 trial028 ceph-mon[38552]: pgmap v186: 129 pgs: 129 active+clean; 631 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 7.3 KiB/s wr, 14 op/s 2026-02-20T03:15:00.622 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-20T03:15:00.623 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:15:00.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:00 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3054538593' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-20T03:15:00.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:00 trial177 ceph-mon[43181]: pgmap v186: 129 pgs: 129 active+clean; 631 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 7.3 KiB/s wr, 14 op/s 2026-02-20T03:15:00.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:00 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3054538593' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-20T03:15:00.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:00 trial126 ceph-mon[38476]: pgmap v186: 129 pgs: 129 active+clean; 631 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 7.3 KiB/s wr, 14 op/s 2026-02-20T03:15:00.884 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.060+0000 7f243f294640 1 -- 10.20.193.28:0/2233031369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24381049b0 msgr2=0x7f2438104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.060+0000 7f243f294640 1 --2- 10.20.193.28:0/2233031369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24381049b0 0x7f2438104e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f242c009a60 tx=0x7f242c02f250 comp rx=0 tx=0).stop 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.060+0000 7f243f294640 1 -- 10.20.193.28:0/2233031369 shutdown_connections 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.060+0000 7f243f294640 1 --2- 10.20.193.28:0/2233031369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2438105350 0x7f2438111990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.060+0000 7f243f294640 1 --2- 10.20.193.28:0/2233031369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f24381049b0 0x7f2438104e10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.060+0000 7f243f294640 1 --2- 10.20.193.28:0/2233031369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f243810aac0 0x7f243810aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.060+0000 7f243f294640 1 -- 10.20.193.28:0/2233031369 >> 10.20.193.28:0/2233031369 conn(0x7f2438100690 msgr2=0x7f2438102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.060+0000 7f243f294640 1 -- 10.20.193.28:0/2233031369 shutdown_connections 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.060+0000 7f243f294640 1 -- 10.20.193.28:0/2233031369 wait complete. 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243f294640 1 Processor -- start 2026-02-20T03:15:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243f294640 1 -- start start 2026-02-20T03:15:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243f294640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f24381049b0 0x7f243819d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243f294640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2438105350 0x7f243819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243f294640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f243810aac0 0x7f24381a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243f294640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2438114d30 con 0x7f2438105350 2026-02-20T03:15:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243f294640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2438114bb0 con 0x7f243810aac0 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243f294640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2438114eb0 con 0x7f24381049b0 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243da91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2438105350 0x7f243819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243da91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2438105350 0x7f243819d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56404/0 (socket says 10.20.193.28:56404) 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243da91640 1 -- 10.20.193.28:0/1128149812 learned_addr learned my addr 10.20.193.28:0/1128149812 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243e292640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f24381049b0 0x7f243819d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243ea93640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f243810aac0 0x7f24381a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243da91640 1 -- 10.20.193.28:0/1128149812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f24381049b0 msgr2=0x7f243819d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243da91640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f24381049b0 0x7f243819d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243da91640 1 -- 10.20.193.28:0/1128149812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f243810aac0 msgr2=0x7f24381a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243da91640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f243810aac0 0x7f24381a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243da91640 1 -- 10.20.193.28:0/1128149812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24381a2220 con 0x7f2438105350 2026-02-20T03:15:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.061+0000 7f243e292640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f24381049b0 0x7f243819d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.062+0000 7f243da91640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2438105350 0x7f243819d710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f242c02fca0 tx=0x7f242c02fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.062+0000 7f241f7fe640 1 -- 10.20.193.28:0/1128149812 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c004240 con 0x7f2438105350 2026-02-20T03:15:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.062+0000 7f241f7fe640 1 -- 10.20.193.28:0/1128149812 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f242c0043e0 con 0x7f2438105350 2026-02-20T03:15:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.062+0000 7f241f7fe640 1 -- 10.20.193.28:0/1128149812 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c042680 con 0x7f2438105350 2026-02-20T03:15:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.062+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24381a24b0 con 0x7f2438105350 2026-02-20T03:15:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.062+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24381a9d50 con 0x7f2438105350 2026-02-20T03:15:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.063+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2438104e10 con 0x7f2438105350 2026-02-20T03:15:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.065+0000 7f241f7fe640 1 -- 10.20.193.28:0/1128149812 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f242c04a060 con 0x7f2438105350 2026-02-20T03:15:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.066+0000 7f241f7fe640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24140b0eb0 0x7f24140b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.066+0000 7f241f7fe640 1 -- 10.20.193.28:0/1128149812 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f242c1052b0 con 0x7f2438105350 2026-02-20T03:15:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.067+0000 7f243e292640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24140b0eb0 0x7f24140b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.067+0000 7f241f7fe640 1 -- 10.20.193.28:0/1128149812 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f242c105730 con 0x7f2438105350 2026-02-20T03:15:01.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.067+0000 7f243e292640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24140b0eb0 0x7f24140b3370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2428004700 tx=0x7f2428009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.159+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f243810ca30 con 0x7f2438105350 2026-02-20T03:15:01.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.160+0000 7f241f7fe640 1 -- 10.20.193.28:0/1128149812 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7f242c035320 con 0x7f2438105350 2026-02-20T03:15:01.163 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:01.163 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:15:01.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.160+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24140b0eb0 msgr2=0x7f24140b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.160+0000 7f243f294640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24140b0eb0 0x7f24140b3370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2428004700 tx=0x7f2428009290 comp rx=0 tx=0).stop 2026-02-20T03:15:01.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.160+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2438105350 msgr2=0x7f243819d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.160+0000 7f243f294640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2438105350 0x7f243819d710 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f242c02fca0 tx=0x7f242c02fcd0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.161+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 shutdown_connections 2026-02-20T03:15:01.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.161+0000 7f243f294640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24140b0eb0 0x7f24140b3370 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.161+0000 7f243f294640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f243810aac0 0x7f24381a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.161+0000 7f243f294640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2438105350 0x7f243819d710 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.161+0000 7f243f294640 1 --2- 10.20.193.28:0/1128149812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f24381049b0 0x7f243819d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.161+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 >> 10.20.193.28:0/1128149812 conn(0x7f2438100690 msgr2=0x7f2438101070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:01.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.161+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 shutdown_connections 2026-02-20T03:15:01.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.161+0000 7f243f294640 1 -- 10.20.193.28:0/1128149812 wait complete. 2026-02-20T03:15:01.262 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-20T03:15:01.262 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-20T03:15:01.263 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-20T03:15:01.263 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-20T03:15:01.263 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-20T03:15:01.263 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-20T03:15:01.263 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-20T03:15:01.263 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-20T03:15:01.263 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-20T03:15:01.264 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-20T03:15:01.264 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-20T03:15:01.264 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-20T03:15:01.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:01 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2363605587' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:01.603 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:01 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1128149812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:01.646 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:01.656 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:01 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2363605587' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:01 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1128149812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:01.728 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:01.750 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:01.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:01 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2363605587' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:01.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:01 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1128149812' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:01.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.872+0000 7fc0b32bc640 1 -- 10.20.193.28:0/3204203096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc0ac10eef0 msgr2=0x7fc0ac10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.872+0000 7fc0b32bc640 1 --2- 10.20.193.28:0/3204203096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc0ac10eef0 0x7fc0ac10f2d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009a30 tx=0x7fc09c02f240 comp rx=0 tx=0).stop 2026-02-20T03:15:01.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.872+0000 7fc0b32bc640 1 -- 10.20.193.28:0/3204203096 shutdown_connections 2026-02-20T03:15:01.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.872+0000 7fc0b32bc640 1 --2- 10.20.193.28:0/3204203096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0ac109ba0 0x7fc0ac115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.872+0000 7fc0b32bc640 1 --2- 10.20.193.28:0/3204203096 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0ac109220 0x7fc0ac109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.872+0000 7fc0b32bc640 1 --2- 10.20.193.28:0/3204203096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc0ac10eef0 0x7fc0ac10f2d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.872+0000 7fc0b32bc640 1 -- 10.20.193.28:0/3204203096 >> 10.20.193.28:0/3204203096 conn(0x7fc0ac078600 msgr2=0x7fc0ac07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:01.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.872+0000 7fc0b32bc640 1 -- 10.20.193.28:0/3204203096 shutdown_connections 2026-02-20T03:15:01.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.872+0000 7fc0b32bc640 1 -- 10.20.193.28:0/3204203096 wait complete. 2026-02-20T03:15:01.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.873+0000 7fc0b32bc640 1 Processor -- start 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.873+0000 7fc0b32bc640 1 -- start start 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.873+0000 7fc0b32bc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc0ac109220 0x7fc0ac1a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.873+0000 7fc0b32bc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0ac109ba0 0x7fc0ac1a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b32bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0ac10eef0 0x7fc0ac1a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b32bc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac1190b0 con 0x7fc0ac10eef0 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b32bc640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac118f30 con 0x7fc0ac109220 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b32bc640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac119230 con 0x7fc0ac109ba0 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b22ba640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc0ac109220 0x7fc0ac1a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b1ab9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0ac109ba0 0x7fc0ac1a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b2abb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0ac10eef0 0x7fc0ac1a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b2abb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0ac10eef0 0x7fc0ac1a5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56434/0 (socket says 10.20.193.28:56434) 2026-02-20T03:15:01.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b2abb640 1 -- 10.20.193.28:0/1378078546 learned_addr learned my addr 10.20.193.28:0/1378078546 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:01.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b22ba640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc0ac109220 0x7fc0ac1a14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59396/0 (socket says 10.20.193.28:59396) 2026-02-20T03:15:01.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b2abb640 1 -- 10.20.193.28:0/1378078546 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0ac109ba0 msgr2=0x7fc0ac1a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b2abb640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0ac109ba0 0x7fc0ac1a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b2abb640 1 -- 10.20.193.28:0/1378078546 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc0ac109220 msgr2=0x7fc0ac1a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b2abb640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc0ac109220 0x7fc0ac1a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.874+0000 7fc0b2abb640 1 -- 10.20.193.28:0/1378078546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ac1a6540 con 0x7fc0ac10eef0 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.875+0000 7fc0b2abb640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0ac10eef0 0x7fc0ac1a5dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8004820 tx=0x7fc0a800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.875+0000 7fc0937fe640 1 -- 10.20.193.28:0/1378078546 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a80090d0 con 0x7fc0ac10eef0 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.875+0000 7fc0937fe640 1 -- 10.20.193.28:0/1378078546 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc0a8023070 con 0x7fc0ac10eef0 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.875+0000 7fc0b32bc640 1 -- 10.20.193.28:0/1378078546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ac1a6830 con 0x7fc0ac10eef0 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.875+0000 7fc0937fe640 1 -- 10.20.193.28:0/1378078546 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8007760 con 0x7fc0ac10eef0 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.875+0000 7fc0b32bc640 1 -- 10.20.193.28:0/1378078546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ac07ba40 con 0x7fc0ac10eef0 2026-02-20T03:15:01.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.875+0000 7fc0b32bc640 1 -- 10.20.193.28:0/1378078546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc074001030 con 0x7fc0ac10eef0 2026-02-20T03:15:01.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.877+0000 7f9864a0a640 1 -- 10.20.193.28:0/765257208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9860109220 msgr2=0x7f9860109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.877+0000 7f9864a0a640 1 --2- 10.20.193.28:0/765257208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9860109220 0x7f9860109660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9850009a30 tx=0x7f985002f220 comp rx=0 tx=0).stop 2026-02-20T03:15:01.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.877+0000 7f9864a0a640 1 -- 10.20.193.28:0/765257208 shutdown_connections 2026-02-20T03:15:01.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.878+0000 7f9864a0a640 1 --2- 10.20.193.28:0/765257208 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9860109ba0 0x7f9860115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.878+0000 7f9864a0a640 1 --2- 10.20.193.28:0/765257208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9860109220 0x7f9860109660 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.878+0000 7fc0937fe640 1 -- 10.20.193.28:0/1378078546 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fc0a802f030 con 0x7fc0ac10eef0 2026-02-20T03:15:01.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.878+0000 7f9864a0a640 1 --2- 10.20.193.28:0/765257208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f986010eef0 0x7f986010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.878+0000 7f9864a0a640 1 -- 10.20.193.28:0/765257208 >> 10.20.193.28:0/765257208 conn(0x7f9860078600 msgr2=0x7f986007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:01.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.878+0000 7f9864a0a640 1 -- 10.20.193.28:0/765257208 shutdown_connections 2026-02-20T03:15:01.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.878+0000 7f9864a0a640 1 -- 10.20.193.28:0/765257208 wait complete. 2026-02-20T03:15:01.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.879+0000 7f9864a0a640 1 Processor -- start 2026-02-20T03:15:01.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.879+0000 7fc0937fe640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0880b0eb0 0x7fc0880b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.879+0000 7f9864a0a640 1 -- start start 2026-02-20T03:15:01.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.879+0000 7fc0937fe640 1 -- 10.20.193.28:0/1378078546 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fc0a80f17c0 con 0x7fc0ac10eef0 2026-02-20T03:15:01.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7f9864a0a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9860109220 0x7f98601a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7f9864a0a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9860109ba0 0x7f98601a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7f9864a0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f986010eef0 0x7f98601a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.879+0000 7fc0937fe640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] conn(0x7fc0880bbad0 0x7fc0880bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7fc0937fe640 1 -- 10.20.193.28:0/1378078546 --> [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0a8032e50 con 0x7fc0880bbad0 2026-02-20T03:15:01.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7fc0937fe640 1 -- 10.20.193.28:0/1378078546 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fc0a80f1b70 con 0x7fc0ac10eef0 2026-02-20T03:15:01.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7fc0b22ba640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0880b0eb0 0x7fc0880b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7fc0b1ab9640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] conn(0x7fc0880bbad0 0x7fc0880bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7fc0b1ab9640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] conn(0x7fc0880bbad0 0x7fc0880bdf10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7fc0b22ba640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0880b0eb0 0x7fc0880b3370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009a00 tx=0x7fc09c0057f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7f985effd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9860109ba0 0x7f98601a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7f985effd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9860109ba0 0x7f98601a1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59400/0 (socket says 10.20.193.28:59400) 2026-02-20T03:15:01.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f98601190c0 con 0x7f986010eef0 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7f985effd640 1 -- 10.20.193.28:0/3654374897 learned_addr learned my addr 10.20.193.28:0/3654374897 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9860118f40 con 0x7f9860109ba0 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.880+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9860119240 con 0x7f9860109220 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985effd640 1 -- 10.20.193.28:0/3654374897 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9860109220 msgr2=0x7f98601a14c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985effd640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9860109220 0x7f98601a14c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985effd640 1 -- 10.20.193.28:0/3654374897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f986010eef0 msgr2=0x7f98601a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985ffff640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f986010eef0 0x7f98601a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985effd640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f986010eef0 0x7f98601a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985effd640 1 -- 10.20.193.28:0/3654374897 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98601a6470 con 0x7f9860109ba0 2026-02-20T03:15:01.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985ffff640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f986010eef0 0x7f98601a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:01.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985effd640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9860109ba0 0x7f98601a1a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9850009b60 tx=0x7f9850004600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7fc0937fe640 1 -- 10.20.193.28:0/1378078546 <== osd.0 v2:10.20.193.28:6802/1632554659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fc0a8032e50 con 0x7fc0880bbad0 2026-02-20T03:15:01.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985cff9640 1 -- 10.20.193.28:0/3654374897 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850005240 con 0x7f9860109ba0 2026-02-20T03:15:01.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985cff9640 1 -- 10.20.193.28:0/3654374897 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9850004c60 con 0x7f9860109ba0 2026-02-20T03:15:01.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98601a6700 con 0x7f9860109ba0 2026-02-20T03:15:01.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f985cff9640 1 -- 10.20.193.28:0/3654374897 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850038ba0 con 0x7f9860109ba0 2026-02-20T03:15:01.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.881+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98601a6b90 con 0x7f9860109ba0 2026-02-20T03:15:01.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.882+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9824001030 con 0x7f9860109ba0 2026-02-20T03:15:01.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.884+0000 7f985cff9640 1 -- 10.20.193.28:0/3654374897 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f98500053e0 con 0x7f9860109ba0 2026-02-20T03:15:01.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.885+0000 7f985cff9640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f98340b0f00 0x7f98340b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.885+0000 7f985cff9640 1 -- 10.20.193.28:0/3654374897 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f98501056a0 con 0x7f9860109ba0 2026-02-20T03:15:01.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.886+0000 7f985f7fe640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f98340b0f00 0x7f98340b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.886+0000 7f985cff9640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] conn(0x7f98340bbb20 0x7f98340bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.886+0000 7f985cff9640 1 -- 10.20.193.28:0/3654374897 --> [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9850034ec0 con 0x7f98340bbb20 2026-02-20T03:15:01.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.886+0000 7f985cff9640 1 -- 10.20.193.28:0/3654374897 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f9850105a50 con 0x7f9860109ba0 2026-02-20T03:15:01.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.886+0000 7f985ffff640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] conn(0x7f98340bbb20 0x7f98340bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.887+0000 7f985f7fe640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f98340b0f00 0x7f98340b33c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f984c005a40 tx=0x7f984c005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.887+0000 7f985ffff640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] conn(0x7f98340bbb20 0x7f98340bdf60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.888+0000 7f985cff9640 1 -- 10.20.193.28:0/3654374897 <== osd.5 v2:10.20.193.177:6808/2872553788 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f9850034ec0 con 0x7f98340bbb20 2026-02-20T03:15:01.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.890+0000 7fc0b32bc640 1 -- 10.20.193.28:0/1378078546 --> [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc074002ed0 con 0x7fc0880bbad0 2026-02-20T03:15:01.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.890+0000 7fc0937fe640 1 -- 10.20.193.28:0/1378078546 <== osd.0 v2:10.20.193.28:6802/1632554659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc074002ed0 con 0x7fc0880bbad0 2026-02-20T03:15:01.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.890+0000 7fc0917fa640 1 -- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] conn(0x7fc0880bbad0 msgr2=0x7fc0880bdf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.890+0000 7fc0917fa640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] conn(0x7fc0880bbad0 0x7fc0880bdf10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.890+0000 7fc0917fa640 1 -- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0880b0eb0 msgr2=0x7fc0880b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.890+0000 7fc0917fa640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0880b0eb0 0x7fc0880b3370 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009a00 tx=0x7fc09c0057f0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.890+0000 7fc0917fa640 1 -- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0ac10eef0 msgr2=0x7fc0ac1a5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.890+0000 7fc0917fa640 1 --2- 10.20.193.28:0/1378078546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc0ac10eef0 0x7fc0ac1a5dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8004820 tx=0x7fc0a800d4a0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.891+0000 7fc0b2abb640 1 -- 10.20.193.28:0/1378078546 reap_dead start 2026-02-20T03:15:01.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.891+0000 7fc0917fa640 1 -- 10.20.193.28:0/1378078546 shutdown_connections 2026-02-20T03:15:01.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.891+0000 7fc0917fa640 1 -- 10.20.193.28:0/1378078546 >> 10.20.193.28:0/1378078546 conn(0x7fc0ac078600 msgr2=0x7fc0ac079e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:01.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.891+0000 7fc0917fa640 1 -- 10.20.193.28:0/1378078546 shutdown_connections 2026-02-20T03:15:01.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.891+0000 7fc0917fa640 1 -- 10.20.193.28:0/1378078546 wait complete. 2026-02-20T03:15:01.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.899+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 --> [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9824002e50 con 0x7f98340bbb20 2026-02-20T03:15:01.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.899+0000 7f985cff9640 1 -- 10.20.193.28:0/3654374897 <== osd.5 v2:10.20.193.177:6808/2872553788 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9824002e50 con 0x7f98340bbb20 2026-02-20T03:15:01.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.900+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 >> [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] conn(0x7f98340bbb20 msgr2=0x7f98340bdf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.900+0000 7f9864a0a640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] conn(0x7f98340bbb20 0x7f98340bdf60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.900+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f98340b0f00 msgr2=0x7f98340b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.900+0000 7f9864a0a640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f98340b0f00 0x7f98340b33c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f984c005a40 tx=0x7f984c005c90 comp rx=0 tx=0).stop 2026-02-20T03:15:01.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.900+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9860109ba0 msgr2=0x7f98601a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.900+0000 7f9864a0a640 1 --2- 10.20.193.28:0/3654374897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9860109ba0 0x7f98601a1a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9850009b60 tx=0x7f9850004600 comp rx=0 tx=0).stop 2026-02-20T03:15:01.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.900+0000 7f985ffff640 1 -- 10.20.193.28:0/3654374897 reap_dead start 2026-02-20T03:15:01.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.901+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 shutdown_connections 2026-02-20T03:15:01.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.901+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 >> 10.20.193.28:0/3654374897 conn(0x7f9860078600 msgr2=0x7f9860079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:01.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.902+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 shutdown_connections 2026-02-20T03:15:01.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.902+0000 7f9864a0a640 1 -- 10.20.193.28:0/3654374897 wait complete. 2026-02-20T03:15:01.909 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:01.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.977+0000 7f0c132e2640 1 -- 10.20.193.28:0/3134526588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c0c1065d0 msgr2=0x7f0c0c075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.977+0000 7f0c132e2640 1 --2- 10.20.193.28:0/3134526588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c0c1065d0 0x7f0c0c075410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009a30 tx=0x7f0bfc02f2b0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.977+0000 7f0c132e2640 1 -- 10.20.193.28:0/3134526588 shutdown_connections 2026-02-20T03:15:01.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.977+0000 7f0c132e2640 1 --2- 10.20.193.28:0/3134526588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c0c1134d0 0x7f0c0c115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.977+0000 7f0c132e2640 1 --2- 10.20.193.28:0/3134526588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0c075950 0x7f0c0c075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.977+0000 7f0c132e2640 1 --2- 10.20.193.28:0/3134526588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c0c1065d0 0x7f0c0c075410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.977+0000 7f0c132e2640 1 -- 10.20.193.28:0/3134526588 >> 10.20.193.28:0/3134526588 conn(0x7f0c0c0fe440 msgr2=0x7f0c0c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:01.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.977+0000 7f0c132e2640 1 -- 10.20.193.28:0/3134526588 shutdown_connections 2026-02-20T03:15:01.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.977+0000 7f0c132e2640 1 -- 10.20.193.28:0/3134526588 wait complete. 2026-02-20T03:15:01.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.978+0000 7f0c132e2640 1 Processor -- start 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.978+0000 7f0c132e2640 1 -- start start 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c132e2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0c075950 0x7f0c0c1a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c132e2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c0c1065d0 0x7f0c0c1a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c132e2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c0c1134d0 0x7f0c0c1a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c132e2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c1190b0 con 0x7f0c0c075950 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c132e2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c118f30 con 0x7f0c0c1065d0 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c132e2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c119230 con 0x7f0c0c1134d0 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c12ae1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c0c1134d0 0x7f0c0c1a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c12ae1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c0c1134d0 0x7f0c0c1a5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37644/0 (socket says 10.20.193.28:37644) 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c12ae1640 1 -- 10.20.193.28:0/2025995190 learned_addr learned my addr 10.20.193.28:0/2025995190 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:01.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c11adf640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c0c1065d0 0x7f0c0c1a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c12ae1640 1 -- 10.20.193.28:0/2025995190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c0c1065d0 msgr2=0x7f0c0c1a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c12ae1640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c0c1065d0 0x7f0c0c1a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c12ae1640 1 -- 10.20.193.28:0/2025995190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0c075950 msgr2=0x7f0c0c1a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c12ae1640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0c075950 0x7f0c0c1a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.979+0000 7f0c12ae1640 1 -- 10.20.193.28:0/2025995190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0c1a65a0 con 0x7f0c0c1134d0 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.980+0000 7f0c12ae1640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c0c1134d0 0x7f0c0c1a5e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c08004820 tx=0x7f0c0800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.980+0000 7f0bf37fe640 1 -- 10.20.193.28:0/2025995190 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c080090d0 con 0x7f0c0c1134d0 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.980+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0c1a6830 con 0x7f0c0c1134d0 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.980+0000 7f0bf37fe640 1 -- 10.20.193.28:0/2025995190 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0c08009270 con 0x7f0c0c1134d0 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.980+0000 7f0bf37fe640 1 -- 10.20.193.28:0/2025995190 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c08013810 con 0x7f0c0c1134d0 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.980+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c0c1ae0d0 con 0x7f0c0c1134d0 2026-02-20T03:15:01.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.980+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0c0c111fc0 con 0x7f0c0c1134d0 2026-02-20T03:15:01.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.982+0000 7f0bf37fe640 1 -- 10.20.193.28:0/2025995190 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f0c08024050 con 0x7f0c0c1134d0 2026-02-20T03:15:01.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.985+0000 7f0bf37fe640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0be80b0eb0 0x7f0be80b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.985+0000 7f0bf37fe640 1 -- 10.20.193.28:0/2025995190 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f0c080e0b40 con 0x7f0c0c1134d0 2026-02-20T03:15:01.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.985+0000 7f0bf37fe640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] conn(0x7f0be80bbad0 0x7f0be80bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:01.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.986+0000 7f0bf37fe640 1 -- 10.20.193.28:0/2025995190 --> [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c08019e50 con 0x7f0be80bbad0 2026-02-20T03:15:01.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.986+0000 7f0bf37fe640 1 -- 10.20.193.28:0/2025995190 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f0c080e0ef0 con 0x7f0c0c1134d0 2026-02-20T03:15:01.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.986+0000 7f0c122e0640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0be80b0eb0 0x7f0be80b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.986+0000 7f0c11adf640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] conn(0x7f0be80bbad0 0x7f0be80bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:01.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.986+0000 7f0c11adf640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] conn(0x7f0be80bbad0 0x7f0be80bdf10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.986+0000 7f0c122e0640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0be80b0eb0 0x7f0be80b3370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009950 tx=0x7f0bfc002c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:01.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.987+0000 7f0bf37fe640 1 -- 10.20.193.28:0/2025995190 <== osd.1 v2:10.20.193.126:6800/2836649908 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f0c08019e50 con 0x7f0be80bbad0 2026-02-20T03:15:01.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 --> [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0c0c076b50 con 0x7f0be80bbad0 2026-02-20T03:15:01.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0bf37fe640 1 -- 10.20.193.28:0/2025995190 <== osd.1 v2:10.20.193.126:6800/2836649908 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0c0c076b50 con 0x7f0be80bbad0 2026-02-20T03:15:01.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 >> [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] conn(0x7f0be80bbad0 msgr2=0x7f0be80bdf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c132e2640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] conn(0x7f0be80bbad0 0x7f0be80bdf10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0be80b0eb0 msgr2=0x7f0be80b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c132e2640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0be80b0eb0 0x7f0be80b3370 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc009950 tx=0x7f0bfc002c90 comp rx=0 tx=0).stop 2026-02-20T03:15:01.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c0c1134d0 msgr2=0x7f0c0c1a5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:01.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c132e2640 1 --2- 10.20.193.28:0/2025995190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c0c1134d0 0x7f0c0c1a5e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c08004820 tx=0x7f0c0800d4a0 comp rx=0 tx=0).stop 2026-02-20T03:15:01.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c12ae1640 1 -- 10.20.193.28:0/2025995190 reap_dead start 2026-02-20T03:15:01.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 shutdown_connections 2026-02-20T03:15:01.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.995+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 >> 10.20.193.28:0/2025995190 conn(0x7f0c0c0fe440 msgr2=0x7f0c0c111560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:01.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.996+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 shutdown_connections 2026-02-20T03:15:01.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:01.996+0000 7f0c132e2640 1 -- 10.20.193.28:0/2025995190 wait complete. 2026-02-20T03:15:02.061 INFO:teuthology.orchestra.run.trial028.stdout:38654705699 2026-02-20T03:15:02.062 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-20T03:15:02.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 -- 10.20.193.28:0/3754019662 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7388109ba0 msgr2=0x7f7388115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 --2- 10.20.193.28:0/3754019662 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7388109ba0 0x7f7388115d10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f738400b0a0 tx=0x7f738402f450 comp rx=0 tx=0).stop 2026-02-20T03:15:02.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 -- 10.20.193.28:0/3754019662 shutdown_connections 2026-02-20T03:15:02.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 --2- 10.20.193.28:0/3754019662 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7388109ba0 0x7f7388115d10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 --2- 10.20.193.28:0/3754019662 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7388109220 0x7f7388109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 --2- 10.20.193.28:0/3754019662 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f738810eef0 0x7f738810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 -- 10.20.193.28:0/3754019662 >> 10.20.193.28:0/3754019662 conn(0x7f7388078600 msgr2=0x7f738807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 -- 10.20.193.28:0/3754019662 shutdown_connections 2026-02-20T03:15:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 -- 10.20.193.28:0/3754019662 wait complete. 2026-02-20T03:15:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 Processor -- start 2026-02-20T03:15:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 -- start start 2026-02-20T03:15:02.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7388109220 0x7f73881a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7388109ba0 0x7f73881a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f738810eef0 0x7f73881a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f73881190a0 con 0x7f738810eef0 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7388118f20 con 0x7f7388109220 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738f0d0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7388119220 con 0x7f7388109ba0 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738e8cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f738810eef0 0x7f73881a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738e8cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f738810eef0 0x7f73881a5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56480/0 (socket says 10.20.193.28:56480) 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738e8cf640 1 -- 10.20.193.28:0/4147032766 learned_addr learned my addr 10.20.193.28:0/4147032766 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.096+0000 7f738d8cd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7388109ba0 0x7f73881a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738e0ce640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7388109220 0x7f73881a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738d8cd640 1 -- 10.20.193.28:0/4147032766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7388109220 msgr2=0x7f73881a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738d8cd640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7388109220 0x7f73881a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738d8cd640 1 -- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f738810eef0 msgr2=0x7f73881a5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738d8cd640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f738810eef0 0x7f73881a5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738d8cd640 1 -- 10.20.193.28:0/4147032766 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73881a64d0 con 0x7f7388109ba0 2026-02-20T03:15:02.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738e8cf640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f738810eef0 0x7f73881a5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:02.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738e0ce640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7388109220 0x7f73881a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:02.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738d8cd640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7388109ba0 0x7f73881a19c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f737c00d950 tx=0x7f737c00de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f736f7fe640 1 -- 10.20.193.28:0/4147032766 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c014070 con 0x7f7388109ba0 2026-02-20T03:15:02.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f736f7fe640 1 -- 10.20.193.28:0/4147032766 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f737c0044e0 con 0x7f7388109ba0 2026-02-20T03:15:02.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73881a67c0 con 0x7f7388109ba0 2026-02-20T03:15:02.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73881ae000 con 0x7f7388109ba0 2026-02-20T03:15:02.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f736f7fe640 1 -- 10.20.193.28:0/4147032766 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c005020 con 0x7f7388109ba0 2026-02-20T03:15:02.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.102+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7388063410 con 0x7f7388109ba0 2026-02-20T03:15:02.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f736f7fe640 1 -- 10.20.193.28:0/4147032766 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f737c0047c0 con 0x7f7388109ba0 2026-02-20T03:15:02.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f736f7fe640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73640b0e30 0x7f73640b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f736f7fe640 1 -- 10.20.193.28:0/4147032766 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f737c0e0cc0 con 0x7f7388109ba0 2026-02-20T03:15:02.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f736f7fe640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] conn(0x7f73640bba50 0x7f73640bde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f736f7fe640 1 -- 10.20.193.28:0/4147032766 --> [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73640be560 con 0x7f73640bba50 2026-02-20T03:15:02.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f736f7fe640 1 -- 10.20.193.28:0/4147032766 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f737c0e1070 con 0x7f7388109ba0 2026-02-20T03:15:02.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f738e0ce640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73640b0e30 0x7f73640b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f738e8cf640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] conn(0x7f73640bba50 0x7f73640bde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f738e0ce640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73640b0e30 0x7f73640b32f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73780046e0 tx=0x7f7378009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.104+0000 7f738e8cf640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] conn(0x7f73640bba50 0x7f73640bde90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.111 INFO:teuthology.orchestra.run.trial028.stdout:167503724568 2026-02-20T03:15:02.112 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-20T03:15:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.112+0000 7f736f7fe640 1 -- 10.20.193.28:0/4147032766 <== osd.6 v2:10.20.193.28:6818/1649444587 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f73640be560 con 0x7f73640bba50 2026-02-20T03:15:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.120+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 --> [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7388063810 con 0x7f73640bba50 2026-02-20T03:15:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f736f7fe640 1 -- 10.20.193.28:0/4147032766 <== osd.6 v2:10.20.193.28:6818/1649444587 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7388063810 con 0x7f73640bba50 2026-02-20T03:15:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] conn(0x7f73640bba50 msgr2=0x7f73640bde90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] conn(0x7f73640bba50 0x7f73640bde90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73640b0e30 msgr2=0x7f73640b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f73640b0e30 0x7f73640b32f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73780046e0 tx=0x7f7378009290 comp rx=0 tx=0).stop 2026-02-20T03:15:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7388109ba0 msgr2=0x7f73881a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 --2- 10.20.193.28:0/4147032766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7388109ba0 0x7f73881a19c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f737c00d950 tx=0x7f737c00de20 comp rx=0 tx=0).stop 2026-02-20T03:15:02.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738e8cf640 1 -- 10.20.193.28:0/4147032766 reap_dead start 2026-02-20T03:15:02.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 shutdown_connections 2026-02-20T03:15:02.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 >> 10.20.193.28:0/4147032766 conn(0x7f7388078600 msgr2=0x7f7388079d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 shutdown_connections 2026-02-20T03:15:02.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.121+0000 7f738f0d0640 1 -- 10.20.193.28:0/4147032766 wait complete. 2026-02-20T03:15:02.147 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:02.148 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:02.174 INFO:teuthology.orchestra.run.trial028.stdout:60129542178 2026-02-20T03:15:02.174 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-20T03:15:02.271 INFO:teuthology.orchestra.run.trial028.stdout:201863462933 2026-02-20T03:15:02.272 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-20T03:15:02.279 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:02.280 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:02.288 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:02.327 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:02.330 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:02.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.375+0000 7f7ae977f640 1 -- 10.20.193.28:0/1926046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7adc0a6840 msgr2=0x7f7adc0a8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.375+0000 7f7ae977f640 1 --2- 10.20.193.28:0/1926046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7adc0a6840 0x7f7adc0a8c30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009a30 tx=0x7f7ad002f260 comp rx=0 tx=0).stop 2026-02-20T03:15:02.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.375+0000 7f7ae977f640 1 -- 10.20.193.28:0/1926046 shutdown_connections 2026-02-20T03:15:02.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.375+0000 7f7ae977f640 1 --2- 10.20.193.28:0/1926046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7adc0a6840 0x7f7adc0a8c30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.375+0000 7f7ae977f640 1 --2- 10.20.193.28:0/1926046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7adc0096f0 0x7f7adc0a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.375+0000 7f7ae977f640 1 --2- 10.20.193.28:0/1926046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7adc008dd0 0x7f7adc0091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.375+0000 7f7ae977f640 1 -- 10.20.193.28:0/1926046 >> 10.20.193.28:0/1926046 conn(0x7f7adc093620 msgr2=0x7f7adc095a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.375+0000 7f7ae977f640 1 -- 10.20.193.28:0/1926046 shutdown_connections 2026-02-20T03:15:02.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.375+0000 7f7ae977f640 1 -- 10.20.193.28:0/1926046 wait complete. 2026-02-20T03:15:02.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.377+0000 7f7ae977f640 1 Processor -- start 2026-02-20T03:15:02.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.377+0000 7f7ae977f640 1 -- start start 2026-02-20T03:15:02.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.377+0000 7f7ae977f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7adc008dd0 0x7f7adc134500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.378+0000 7f7ae977f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7adc0096f0 0x7f7adc134a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.378+0000 7f7ae977f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7adc0a6840 0x7f7adc138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.378+0000 7f7ae977f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc0ac0e0 con 0x7f7adc0096f0 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.378+0000 7f7ae977f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc0abf60 con 0x7f7adc0a6840 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.378+0000 7f7ae977f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc0ac260 con 0x7f7adc008dd0 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.379+0000 7f7ae3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7adc008dd0 0x7f7adc134500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.379+0000 7f7ae8f7e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7adc0a6840 0x7f7adc138dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.379+0000 7f7ae8f7e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7adc0a6840 0x7f7adc138dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59464/0 (socket says 10.20.193.28:59464) 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.379+0000 7f7ae8f7e640 1 -- 10.20.193.28:0/3834382032 learned_addr learned my addr 10.20.193.28:0/3834382032 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.379+0000 7f7ae37fe640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7adc0096f0 0x7f7adc134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.380+0000 7f7ae8f7e640 1 -- 10.20.193.28:0/3834382032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7adc008dd0 msgr2=0x7f7adc134500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.380+0000 7f7ae8f7e640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7adc008dd0 0x7f7adc134500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.380+0000 7f7ae8f7e640 1 -- 10.20.193.28:0/3834382032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7adc0096f0 msgr2=0x7f7adc134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.380+0000 7f7ae8f7e640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7adc0096f0 0x7f7adc134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.380+0000 7f7ae8f7e640 1 -- 10.20.193.28:0/3834382032 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc139550 con 0x7f7adc0a6840 2026-02-20T03:15:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.381+0000 7f7ae3fff640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7adc008dd0 0x7f7adc134500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.381+0000 7f7ae37fe640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7adc0096f0 0x7f7adc134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.381+0000 7f7ae8f7e640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7adc0a6840 0x7f7adc138dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0005ec0 tx=0x7f7ad0004290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.382+0000 7f7ae17fa640 1 -- 10.20.193.28:0/3834382032 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0005020 con 0x7f7adc0a6840 2026-02-20T03:15:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.382+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7adc1397e0 con 0x7f7adc0a6840 2026-02-20T03:15:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.382+0000 7f7ae17fa640 1 -- 10.20.193.28:0/3834382032 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7ad0005660 con 0x7f7adc0a6840 2026-02-20T03:15:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.382+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7adc141080 con 0x7f7adc0a6840 2026-02-20T03:15:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.382+0000 7f7ae17fa640 1 -- 10.20.193.28:0/3834382032 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0038aa0 con 0x7f7adc0a6840 2026-02-20T03:15:02.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.383+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7adc0a0590 con 0x7f7adc0a6840 2026-02-20T03:15:02.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.385+0000 7f7ae17fa640 1 -- 10.20.193.28:0/3834382032 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f7ad0004a00 con 0x7f7adc0a6840 2026-02-20T03:15:02.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.387+0000 7f7ae17fa640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ab80b0eb0 0x7f7ab80b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.387+0000 7f7ae17fa640 1 -- 10.20.193.28:0/3834382032 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f7ad0105220 con 0x7f7adc0a6840 2026-02-20T03:15:02.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.387+0000 7f7ae3fff640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ab80b0eb0 0x7f7ab80b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.387+0000 7f7ae17fa640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] conn(0x7f7ab80bbad0 0x7f7ab80bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.387+0000 7f7ae17fa640 1 -- 10.20.193.28:0/3834382032 --> [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ad0071e50 con 0x7f7ab80bbad0 2026-02-20T03:15:02.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.387+0000 7f7ae17fa640 1 -- 10.20.193.28:0/3834382032 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f7ad0105670 con 0x7f7adc0a6840 2026-02-20T03:15:02.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.389+0000 7f7ae37fe640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] conn(0x7f7ab80bbad0 0x7f7ab80bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.389+0000 7f7ae3fff640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ab80b0eb0 0x7f7ab80b3370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009da0 tx=0x7f7ad8009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.390+0000 7f7ae37fe640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] conn(0x7f7ab80bbad0 0x7f7ab80bdf10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.394+0000 7f7ae17fa640 1 -- 10.20.193.28:0/3834382032 <== osd.2 v2:10.20.193.177:6800/674314820 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f7ad0071e50 con 0x7f7ab80bbad0 2026-02-20T03:15:02.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.426+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 --> [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7adc0a09c0 con 0x7f7ab80bbad0 2026-02-20T03:15:02.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.427+0000 7f7ae17fa640 1 -- 10.20.193.28:0/3834382032 <== osd.2 v2:10.20.193.177:6800/674314820 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7adc0a09c0 con 0x7f7ab80bbad0 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.428+0000 7f82adb07640 1 -- 10.20.193.28:0/3338504738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82a00b3450 msgr2=0x7f82a00b5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.428+0000 7f82adb07640 1 --2- 10.20.193.28:0/3338504738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82a00b3450 0x7f82a00b5880 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8298009a30 tx=0x7f829802f260 comp rx=0 tx=0).stop 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.429+0000 7f82adb07640 1 -- 10.20.193.28:0/3338504738 shutdown_connections 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.429+0000 7f82adb07640 1 --2- 10.20.193.28:0/3338504738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82a00b3450 0x7f82a00b5880 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.429+0000 7f82adb07640 1 --2- 10.20.193.28:0/3338504738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82a00a58a0 0x7f82a00b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.429+0000 7f82adb07640 1 --2- 10.20.193.28:0/3338504738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82a00a4f80 0x7f82a00a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.429+0000 7f82adb07640 1 -- 10.20.193.28:0/3338504738 >> 10.20.193.28:0/3338504738 conn(0x7f82a001a5e0 msgr2=0x7f82a001a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.429+0000 7f82adb07640 1 -- 10.20.193.28:0/3338504738 shutdown_connections 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.429+0000 7f82adb07640 1 -- 10.20.193.28:0/3338504738 wait complete. 2026-02-20T03:15:02.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.430+0000 7f82adb07640 1 Processor -- start 2026-02-20T03:15:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.430+0000 7f82adb07640 1 -- start start 2026-02-20T03:15:02.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.431+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 >> [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] conn(0x7f7ab80bbad0 msgr2=0x7f7ab80bdf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.432+0000 7f7ae977f640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] conn(0x7f7ab80bbad0 0x7f7ab80bdf10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.432+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ab80b0eb0 msgr2=0x7f7ab80b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.432+0000 7f7ae977f640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ab80b0eb0 0x7f7ab80b3370 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009da0 tx=0x7f7ad8009920 comp rx=0 tx=0).stop 2026-02-20T03:15:02.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.432+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7adc0a6840 msgr2=0x7f7adc138dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.432+0000 7f7ae977f640 1 --2- 10.20.193.28:0/3834382032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7adc0a6840 0x7f7adc138dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0005ec0 tx=0x7f7ad0004290 comp rx=0 tx=0).stop 2026-02-20T03:15:02.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.432+0000 7f7ae8f7e640 1 -- 10.20.193.28:0/3834382032 reap_dead start 2026-02-20T03:15:02.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.432+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 shutdown_connections 2026-02-20T03:15:02.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.432+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 >> 10.20.193.28:0/3834382032 conn(0x7f7adc093620 msgr2=0x7f7adc095a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.432+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 shutdown_connections 2026-02-20T03:15:02.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.433+0000 7f7ae977f640 1 -- 10.20.193.28:0/3834382032 wait complete. 2026-02-20T03:15:02.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.433+0000 7f82adb07640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82a00a4f80 0x7f82a00b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.433+0000 7f82adb07640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82a00a58a0 0x7f82a00b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.433+0000 7f82adb07640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82a00b3450 0x7f82a00b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.439+0000 7f82acb05640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82a00a4f80 0x7f82a00b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.439+0000 7f82acb05640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82a00a4f80 0x7f82a00b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59476/0 (socket says 10.20.193.28:59476) 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.439+0000 7f82acb05640 1 -- 10.20.193.28:0/2397557765 learned_addr learned my addr 10.20.193.28:0/2397557765 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.439+0000 7f82a7fff640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82a00a58a0 0x7f82a00b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.439+0000 7f82ad306640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82a00b3450 0x7f82a00b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.439+0000 7f82adb07640 1 -- 10.20.193.28:0/2397557765 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82a00ad4b0 con 0x7f82a00b3450 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.439+0000 7f82adb07640 1 -- 10.20.193.28:0/2397557765 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f82a00ad330 con 0x7f82a00a4f80 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.439+0000 7f82adb07640 1 -- 10.20.193.28:0/2397557765 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f82a00ad630 con 0x7f82a00a58a0 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.440+0000 7f82a7fff640 1 -- 10.20.193.28:0/2397557765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82a00a4f80 msgr2=0x7f82a00b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.440+0000 7f82a7fff640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82a00a4f80 0x7f82a00b2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.440+0000 7f82a7fff640 1 -- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82a00b3450 msgr2=0x7f82a00b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.440+0000 7f82a7fff640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82a00b3450 0x7f82a00b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.440+0000 7f82a7fff640 1 -- 10.20.193.28:0/2397557765 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82a0151d90 con 0x7f82a00a58a0 2026-02-20T03:15:02.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.440+0000 7f82a7fff640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82a00a58a0 0x7f82a00b1020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f829400b550 tx=0x7f829400ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.444+0000 7f82a5ffb640 1 -- 10.20.193.28:0/2397557765 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294016070 con 0x7f82a00a58a0 2026-02-20T03:15:02.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.444+0000 7f82a5ffb640 1 -- 10.20.193.28:0/2397557765 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f82940044e0 con 0x7f82a00a58a0 2026-02-20T03:15:02.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.444+0000 7f82a5ffb640 1 -- 10.20.193.28:0/2397557765 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829400fc10 con 0x7f82a00a58a0 2026-02-20T03:15:02.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.444+0000 7f82adb07640 1 -- 10.20.193.28:0/2397557765 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82a0152080 con 0x7f82a00a58a0 2026-02-20T03:15:02.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.444+0000 7f82adb07640 1 -- 10.20.193.28:0/2397557765 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82a0152570 con 0x7f82a00a58a0 2026-02-20T03:15:02.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.445+0000 7f827b7fe640 1 -- 10.20.193.28:0/2397557765 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8270001030 con 0x7f82a00a58a0 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.447+0000 7f82a5ffb640 1 -- 10.20.193.28:0/2397557765 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f8294043ac0 con 0x7f82a00a58a0 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.448+0000 7f82a5ffb640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82880b1000 0x7f82880b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.449+0000 7f82a5ffb640 1 -- 10.20.193.28:0/2397557765 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f82940dfba0 con 0x7f82a00a58a0 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.449+0000 7f82acb05640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82880b1000 0x7f82880b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.449+0000 7f82a5ffb640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] conn(0x7f82880bbc20 0x7f82880be060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.449+0000 7f82a5ffb640 1 -- 10.20.193.28:0/2397557765 --> [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8294044e50 con 0x7f82880bbc20 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.449+0000 7f82acb05640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82880b1000 0x7f82880b34c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f829c007540 tx=0x7f829c009770 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.449+0000 7f82a5ffb640 1 -- 10.20.193.28:0/2397557765 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f82940dff90 con 0x7f82a00a58a0 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.449+0000 7f82ad306640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] conn(0x7f82880bbc20 0x7f82880be060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.450+0000 7f82ad306640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] conn(0x7f82880bbc20 0x7f82880be060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.451+0000 7f82a5ffb640 1 -- 10.20.193.28:0/2397557765 <== osd.3 v2:10.20.193.28:6810/770811326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f8294044e50 con 0x7f82880bbc20 2026-02-20T03:15:02.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.473+0000 7f827b7fe640 1 -- 10.20.193.28:0/2397557765 --> [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8270002ed0 con 0x7f82880bbc20 2026-02-20T03:15:02.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.474+0000 7f82a5ffb640 1 -- 10.20.193.28:0/2397557765 <== osd.3 v2:10.20.193.28:6810/770811326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8270002ed0 con 0x7f82880bbc20 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.475+0000 7f827b7fe640 1 -- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] conn(0x7f82880bbc20 msgr2=0x7f82880be060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.475+0000 7f827b7fe640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] conn(0x7f82880bbc20 0x7f82880be060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.476+0000 7f827b7fe640 1 -- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82880b1000 msgr2=0x7f82880b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.476+0000 7f827b7fe640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82880b1000 0x7f82880b34c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f829c007540 tx=0x7f829c009770 comp rx=0 tx=0).stop 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.476+0000 7f827b7fe640 1 -- 10.20.193.28:0/2397557765 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82a00a58a0 msgr2=0x7f82a00b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.476+0000 7f827b7fe640 1 --2- 10.20.193.28:0/2397557765 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82a00a58a0 0x7f82a00b1020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f829400b550 tx=0x7f829400ba20 comp rx=0 tx=0).stop 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.476+0000 7f82ad306640 1 -- 10.20.193.28:0/2397557765 reap_dead start 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.477+0000 7f827b7fe640 1 -- 10.20.193.28:0/2397557765 shutdown_connections 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.477+0000 7f827b7fe640 1 -- 10.20.193.28:0/2397557765 >> 10.20.193.28:0/2397557765 conn(0x7f82a001a5e0 msgr2=0x7f82a00b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.477+0000 7f827b7fe640 1 -- 10.20.193.28:0/2397557765 shutdown_connections 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.477+0000 7f827b7fe640 1 -- 10.20.193.28:0/2397557765 wait complete. 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.476+0000 7fbcd2e71640 1 -- 10.20.193.28:0/802094486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc4097970 msgr2=0x7fbcc4097dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.476+0000 7fbcd2e71640 1 --2- 10.20.193.28:0/802094486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc4097970 0x7fbcc4097dd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40099e0 tx=0x7fbcb402f200 comp rx=0 tx=0).stop 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.478+0000 7fbcd2e71640 1 -- 10.20.193.28:0/802094486 shutdown_connections 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.478+0000 7fbcd2e71640 1 --2- 10.20.193.28:0/802094486 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc4098310 0x7fbcc40a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.478+0000 7fbcd2e71640 1 --2- 10.20.193.28:0/802094486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc4097970 0x7fbcc4097dd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.478+0000 7fbcd2e71640 1 --2- 10.20.193.28:0/802094486 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc409d970 0x7fbcc409dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.478+0000 7fbcd2e71640 1 -- 10.20.193.28:0/802094486 >> 10.20.193.28:0/802094486 conn(0x7fbcc4093650 msgr2=0x7fbcc4095a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.478+0000 7fbcd2e71640 1 -- 10.20.193.28:0/802094486 shutdown_connections 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.478+0000 7fbcd2e71640 1 -- 10.20.193.28:0/802094486 wait complete. 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.480+0000 7fbcd2e71640 1 Processor -- start 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.480+0000 7fbcd2e71640 1 -- start start 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.480+0000 7fbcd2e71640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc4097970 0x7fbcc40a3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.481+0000 7fbcd2e71640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc4098310 0x7fbcc40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.481+0000 7fbcd2e71640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc409d970 0x7fbcc4140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.481+0000 7fbcd2e71640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4009db0 con 0x7fbcc409d970 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.481+0000 7fbcd2e71640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4009c30 con 0x7fbcc4098310 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.481+0000 7fbcd2e71640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc4009f30 con 0x7fbcc4097970 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.482+0000 7fbcd1e6f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc4097970 0x7fbcc40a3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.482+0000 7fbcd166e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc4098310 0x7fbcc40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.483+0000 7fbcd2670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc409d970 0x7fbcc4140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.483+0000 7fbcd2670640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc409d970 0x7fbcc4140270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56544/0 (socket says 10.20.193.28:56544) 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.482+0000 7fbcd166e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc4098310 0x7fbcc40a3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59488/0 (socket says 10.20.193.28:59488) 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.483+0000 7fbcd166e640 1 -- 10.20.193.28:0/2409651608 learned_addr learned my addr 10.20.193.28:0/2409651608 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.483+0000 7fbcd1e6f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc4097970 0x7fbcc40a3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37686/0 (socket says 10.20.193.28:37686) 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.484+0000 7fbcd166e640 1 -- 10.20.193.28:0/2409651608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc4097970 msgr2=0x7fbcc40a3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.484+0000 7fbcd166e640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc4097970 0x7fbcc40a3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.484+0000 7fbcd166e640 1 -- 10.20.193.28:0/2409651608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc409d970 msgr2=0x7fbcc4140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.484+0000 7fbcd166e640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc409d970 0x7fbcc4140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.484+0000 7fbcd166e640 1 -- 10.20.193.28:0/2409651608 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc4140910 con 0x7fbcc4098310 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.485+0000 7fbcd2670640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc409d970 0x7fbcc4140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:02.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.485+0000 7fbcd166e640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc4098310 0x7fbcc40a3680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbcb402f710 tx=0x7fbcb4005eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.488 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:02 trial028 ceph-mon[38552]: pgmap v187: 129 pgs: 129 active+clean; 631 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 7.1 KiB/s wr, 14 op/s 2026-02-20T03:15:02.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.488+0000 7fbcc2ffd640 1 -- 10.20.193.28:0/2409651608 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4004300 con 0x7fbcc4098310 2026-02-20T03:15:02.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.488+0000 7fbcd2e71640 1 -- 10.20.193.28:0/2409651608 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc4140ba0 con 0x7fbcc4098310 2026-02-20T03:15:02.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.488+0000 7fbcd2e71640 1 -- 10.20.193.28:0/2409651608 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc4141030 con 0x7fbcc4098310 2026-02-20T03:15:02.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.489+0000 7fbcd2e71640 1 -- 10.20.193.28:0/2409651608 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbcc4002c80 con 0x7fbcc4098310 2026-02-20T03:15:02.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.490+0000 7fbcc2ffd640 1 -- 10.20.193.28:0/2409651608 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbcb40044a0 con 0x7fbcc4098310 2026-02-20T03:15:02.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.491+0000 7fbcc2ffd640 1 -- 10.20.193.28:0/2409651608 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4004300 con 0x7fbcc4098310 2026-02-20T03:15:02.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.522+0000 7fbcc2ffd640 1 -- 10.20.193.28:0/2409651608 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fbcb4038470 con 0x7fbcc4098310 2026-02-20T03:15:02.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.526+0000 7fbcc2ffd640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca80b1030 0x7fbca80b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.527+0000 7fbcc2ffd640 1 -- 10.20.193.28:0/2409651608 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fbcb4105470 con 0x7fbcc4098310 2026-02-20T03:15:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.527+0000 7fbcc2ffd640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] conn(0x7fbca80bbc50 0x7fbca80be090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.527+0000 7fbcd1e6f640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca80b1030 0x7fbca80b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.528+0000 7fbcc2ffd640 1 -- 10.20.193.28:0/2409651608 --> [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcb4009030 con 0x7fbca80bbc50 2026-02-20T03:15:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.528+0000 7fbcc2ffd640 1 -- 10.20.193.28:0/2409651608 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fbcb41058c0 con 0x7fbcc4098310 2026-02-20T03:15:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.528+0000 7fbcd2670640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] conn(0x7fbca80bbc50 0x7fbca80be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.529+0000 7fbcd1e6f640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca80b1030 0x7fbca80b34f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0046e0 tx=0x7fbcbc0091c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.530+0000 7fbcd2670640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] conn(0x7fbca80bbc50 0x7fbca80be090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.530+0000 7fbcc2ffd640 1 -- 10.20.193.28:0/2409651608 <== osd.8 v2:10.20.193.177:6816/830253287 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fbcb4009030 con 0x7fbca80bbc50 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.541+0000 7f1e1af83640 1 -- 10.20.193.28:0/797221582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e1410a470 msgr2=0x7f1e141114d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.541+0000 7f1e0b7fe640 1 -- 10.20.193.28:0/797221582 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0402fc80 con 0x7f1e1410a470 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.541+0000 7f1e1af83640 1 --2- 10.20.193.28:0/797221582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e1410a470 0x7f1e141114d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009a60 tx=0x7f1e0402f260 comp rx=0 tx=0).stop 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.542+0000 7f1e1af83640 1 -- 10.20.193.28:0/797221582 shutdown_connections 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.542+0000 7f1e1af83640 1 --2- 10.20.193.28:0/797221582 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e1411c780 0x7f1e1411eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.542+0000 7f1e1af83640 1 --2- 10.20.193.28:0/797221582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e1410a850 0x7f1e1410acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.542+0000 7f1e1af83640 1 --2- 10.20.193.28:0/797221582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e1410a470 0x7f1e141114d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.542+0000 7f1e1af83640 1 -- 10.20.193.28:0/797221582 >> 10.20.193.28:0/797221582 conn(0x7f1e1406ec00 msgr2=0x7f1e1406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.542+0000 7f1e1af83640 1 -- 10.20.193.28:0/797221582 shutdown_connections 2026-02-20T03:15:02.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.542+0000 7f1e1af83640 1 -- 10.20.193.28:0/797221582 wait complete. 2026-02-20T03:15:02.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.543+0000 7f1e1af83640 1 Processor -- start 2026-02-20T03:15:02.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.543+0000 7f1e1af83640 1 -- start start 2026-02-20T03:15:02.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7f1e1af83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e1410a470 0x7f1e141a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7f1e1af83640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e1410a850 0x7f1e141aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7f1e1af83640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e1411c780 0x7f1e141ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7f1e1af83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14121d80 con 0x7f1e1410a470 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7f1e1af83640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14121c00 con 0x7f1e1410a850 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7f1e1af83640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14121f00 con 0x7f1e1411c780 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7f1e0bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e1410a850 0x7f1e141aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7f1e0bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e1410a850 0x7f1e141aa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59506/0 (socket says 10.20.193.28:59506) 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7f1e0bfff640 1 -- 10.20.193.28:0/2982334686 learned_addr learned my addr 10.20.193.28:0/2982334686 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7f1e0bfff640 1 -- 10.20.193.28:0/2982334686 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e1411c780 msgr2=0x7f1e141ae8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7f1e0bfff640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1e1411c780 0x7f1e141ae8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7f1e0bfff640 1 -- 10.20.193.28:0/2982334686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e1410a470 msgr2=0x7f1e141a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7f1e0bfff640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1e1410a470 0x7f1e141a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7f1e0bfff640 1 -- 10.20.193.28:0/2982334686 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e141af030 con 0x7f1e1410a850 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.544+0000 7fbcd2e71640 1 -- 10.20.193.28:0/2409651608 --> [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbcc4003100 con 0x7fbca80bbc50 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7fbcc2ffd640 1 -- 10.20.193.28:0/2409651608 <== osd.8 v2:10.20.193.177:6816/830253287 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbcc4003100 con 0x7fbca80bbc50 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7fbcc0ff9640 1 -- 10.20.193.28:0/2409651608 >> [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] conn(0x7fbca80bbc50 msgr2=0x7fbca80be090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.545+0000 7fbcc0ff9640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] conn(0x7fbca80bbc50 0x7fbca80be090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7fbcc0ff9640 1 -- 10.20.193.28:0/2409651608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca80b1030 msgr2=0x7fbca80b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7fbcc0ff9640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca80b1030 0x7fbca80b34f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0046e0 tx=0x7fbcbc0091c0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7fbcc0ff9640 1 -- 10.20.193.28:0/2409651608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc4098310 msgr2=0x7fbcc40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7fbcc0ff9640 1 --2- 10.20.193.28:0/2409651608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc4098310 0x7fbcc40a3680 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbcb402f710 tx=0x7fbcb4005eb0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7fbcd2670640 1 -- 10.20.193.28:0/2409651608 reap_dead start 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7fbcc0ff9640 1 -- 10.20.193.28:0/2409651608 shutdown_connections 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7fbcc0ff9640 1 -- 10.20.193.28:0/2409651608 >> 10.20.193.28:0/2409651608 conn(0x7fbcc4093650 msgr2=0x7fbcc4095710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.547+0000 7f1e0bfff640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e1410a850 0x7f1e141aa520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00b780 tx=0x7f1dfc00bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.546+0000 7fbcc0ff9640 1 -- 10.20.193.28:0/2409651608 shutdown_connections 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.547+0000 7fbcc0ff9640 1 -- 10.20.193.28:0/2409651608 wait complete. 2026-02-20T03:15:02.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.547+0000 7f1e09ffb640 1 -- 10.20.193.28:0/2982334686 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc004480 con 0x7f1e1410a850 2026-02-20T03:15:02.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.547+0000 7f1e1af83640 1 -- 10.20.193.28:0/2982334686 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e141af320 con 0x7f1e1410a850 2026-02-20T03:15:02.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.547+0000 7f1e1af83640 1 -- 10.20.193.28:0/2982334686 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e141b6b60 con 0x7f1e1410a850 2026-02-20T03:15:02.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.547+0000 7f1e09ffb640 1 -- 10.20.193.28:0/2982334686 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1dfc010070 con 0x7f1e1410a850 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.547+0000 7f1e09ffb640 1 -- 10.20.193.28:0/2982334686 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc004480 con 0x7f1e1410a850 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.549+0000 7f1e09ffb640 1 -- 10.20.193.28:0/2982334686 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f1dfc01d030 con 0x7f1e1410a850 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.551+0000 7f1e09ffb640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dec0b10b0 0x7f1dec0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.551+0000 7f1e09ffb640 1 -- 10.20.193.28:0/2982334686 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f1dfc0df440 con 0x7f1e1410a850 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.551+0000 7f1e18cf8640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dec0b10b0 0x7f1dec0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.552+0000 7f1de77fe640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] conn(0x7f1ddc001650 0x7f1ddc003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.552+0000 7f1de77fe640 1 -- 10.20.193.28:0/2982334686 --> [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ddc006cb0 con 0x7f1ddc001650 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.552+0000 7f1e18cf8640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dec0b10b0 0x7f1dec0b3570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e04005ec0 tx=0x7f1e04005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.552+0000 7f1e194f9640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] conn(0x7f1ddc001650 0x7f1ddc003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.553+0000 7f1e194f9640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] conn(0x7f1ddc001650 0x7f1ddc003b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.556+0000 7f1e09ffb640 1 -- 10.20.193.28:0/2982334686 <== osd.10 v2:10.20.193.126:6824/4061106799 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f1ddc006cb0 con 0x7f1ddc001650 2026-02-20T03:15:02.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.566+0000 7f1de77fe640 1 -- 10.20.193.28:0/2982334686 --> [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ddc005d90 con 0x7f1ddc001650 2026-02-20T03:15:02.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.567+0000 7f1e09ffb640 1 -- 10.20.193.28:0/2982334686 <== osd.10 v2:10.20.193.126:6824/4061106799 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1ddc005d90 con 0x7f1ddc001650 2026-02-20T03:15:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.568+0000 7f1de77fe640 1 -- 10.20.193.28:0/2982334686 >> [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] conn(0x7f1ddc001650 msgr2=0x7f1ddc003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.568+0000 7f1de77fe640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] conn(0x7f1ddc001650 0x7f1ddc003b10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.568+0000 7f1de77fe640 1 -- 10.20.193.28:0/2982334686 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dec0b10b0 msgr2=0x7f1dec0b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.568+0000 7f1de77fe640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dec0b10b0 0x7f1dec0b3570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e04005ec0 tx=0x7f1e04005e50 comp rx=0 tx=0).stop 2026-02-20T03:15:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.568+0000 7f1de77fe640 1 -- 10.20.193.28:0/2982334686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e1410a850 msgr2=0x7f1e141aa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.568+0000 7f1de77fe640 1 --2- 10.20.193.28:0/2982334686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1e1410a850 0x7f1e141aa520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00b780 tx=0x7f1dfc00bc50 comp rx=0 tx=0).stop 2026-02-20T03:15:02.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.568+0000 7f1e194f9640 1 -- 10.20.193.28:0/2982334686 reap_dead start 2026-02-20T03:15:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.568+0000 7f1de77fe640 1 -- 10.20.193.28:0/2982334686 shutdown_connections 2026-02-20T03:15:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.568+0000 7f1de77fe640 1 -- 10.20.193.28:0/2982334686 >> 10.20.193.28:0/2982334686 conn(0x7f1e1406ec00 msgr2=0x7f1e1411cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.569+0000 7f1de77fe640 1 -- 10.20.193.28:0/2982334686 shutdown_connections 2026-02-20T03:15:02.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.569+0000 7f1de77fe640 1 -- 10.20.193.28:0/2982334686 wait complete. 2026-02-20T03:15:02.582 INFO:teuthology.orchestra.run.trial028.stdout:81604378655 2026-02-20T03:15:02.583 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-20T03:15:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.596+0000 7ff62b577640 1 -- 10.20.193.28:0/1575318274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff62c10a980 msgr2=0x7ff62c10ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.596+0000 7ff62b577640 1 --2- 10.20.193.28:0/1575318274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff62c10a980 0x7ff62c10ad60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff620009a60 tx=0x7ff62002f280 comp rx=0 tx=0).stop 2026-02-20T03:15:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.597+0000 7ff62b577640 1 -- 10.20.193.28:0/1575318274 shutdown_connections 2026-02-20T03:15:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.597+0000 7ff62b577640 1 --2- 10.20.193.28:0/1575318274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff62c105320 0x7ff62c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.597+0000 7ff62b577640 1 --2- 10.20.193.28:0/1575318274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff62c104980 0x7ff62c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.597+0000 7ff62b577640 1 --2- 10.20.193.28:0/1575318274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff62c10a980 0x7ff62c10ad60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.597+0000 7ff62b577640 1 -- 10.20.193.28:0/1575318274 >> 10.20.193.28:0/1575318274 conn(0x7ff62c100680 msgr2=0x7ff62c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.597+0000 7ff62b577640 1 -- 10.20.193.28:0/1575318274 shutdown_connections 2026-02-20T03:15:02.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.597+0000 7ff62b577640 1 -- 10.20.193.28:0/1575318274 wait complete. 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.597+0000 7ff62b577640 1 Processor -- start 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.597+0000 7ff62b577640 1 -- start start 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62b577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff62c104980 0x7ff62c077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff62c105320 0x7ff62c077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62b577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff62c10a980 0x7ff62c078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c114bf0 con 0x7ff62c105320 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62b577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c114a70 con 0x7ff62c104980 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62b577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff62c114d70 con 0x7ff62c10a980 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62a575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff62c104980 0x7ff62c077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff629d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff62c105320 0x7ff62c077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62a575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff62c104980 0x7ff62c077600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59510/0 (socket says 10.20.193.28:59510) 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62a575640 1 -- 10.20.193.28:0/874066927 learned_addr learned my addr 10.20.193.28:0/874066927 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:02.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62ad76640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff62c10a980 0x7ff62c078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62a575640 1 -- 10.20.193.28:0/874066927 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff62c10a980 msgr2=0x7ff62c078080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.598+0000 7ff62a575640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff62c10a980 0x7ff62c078080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff62a575640 1 -- 10.20.193.28:0/874066927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff62c105320 msgr2=0x7ff62c077b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff62a575640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff62c105320 0x7ff62c077b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff62a575640 1 -- 10.20.193.28:0/874066927 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62c1ad910 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff629d74640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff62c105320 0x7ff62c077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff62a575640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff62c104980 0x7ff62c077600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff620002fd0 tx=0x7ff6200029c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff6137fe640 1 -- 10.20.193.28:0/874066927 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620004030 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff6137fe640 1 -- 10.20.193.28:0/874066927 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff620050030 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff6137fe640 1 -- 10.20.193.28:0/874066927 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62004c730 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff62b577640 1 -- 10.20.193.28:0/874066927 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62c06c890 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.599+0000 7ff62b577640 1 -- 10.20.193.28:0/874066927 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff62c06cd20 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.600+0000 7ff6117fa640 1 -- 10.20.193.28:0/874066927 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff62c063410 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.601+0000 7ff6137fe640 1 -- 10.20.193.28:0/874066927 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7ff620038890 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.603+0000 7ff6137fe640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6040b0eb0 0x7ff6040b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.603+0000 7ff6137fe640 1 -- 10.20.193.28:0/874066927 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ff620115fc0 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.603+0000 7ff6137fe640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] conn(0x7ff6040bbad0 0x7ff6040bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.604+0000 7ff629d74640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6040b0eb0 0x7ff6040b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.604+0000 7ff6137fe640 1 -- 10.20.193.28:0/874066927 --> [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff620039e50 con 0x7ff6040bbad0 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.604+0000 7ff62ad76640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] conn(0x7ff6040bbad0 0x7ff6040bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.604+0000 7ff6137fe640 1 -- 10.20.193.28:0/874066927 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ff620116410 con 0x7ff62c104980 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.605+0000 7ff62ad76640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] conn(0x7ff6040bbad0 0x7ff6040bdf10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.605+0000 7ff629d74640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6040b0eb0 0x7ff6040b3370 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff62c078dc0 tx=0x7ff614009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.606+0000 7ff6137fe640 1 -- 10.20.193.28:0/874066927 <== osd.7 v2:10.20.193.126:6816/2141691482 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7ff620039e50 con 0x7ff6040bbad0 2026-02-20T03:15:02.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.619+0000 7ff6117fa640 1 -- 10.20.193.28:0/874066927 --> [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff62c0638e0 con 0x7ff6040bbad0 2026-02-20T03:15:02.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.620+0000 7ff6137fe640 1 -- 10.20.193.28:0/874066927 <== osd.7 v2:10.20.193.126:6816/2141691482 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff62c0638e0 con 0x7ff6040bbad0 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.620+0000 7ff6117fa640 1 -- 10.20.193.28:0/874066927 >> [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] conn(0x7ff6040bbad0 msgr2=0x7ff6040bdf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.620+0000 7ff6117fa640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] conn(0x7ff6040bbad0 0x7ff6040bdf10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.620+0000 7ff6117fa640 1 -- 10.20.193.28:0/874066927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6040b0eb0 msgr2=0x7ff6040b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.620+0000 7ff6117fa640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6040b0eb0 0x7ff6040b3370 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff62c078dc0 tx=0x7ff614009290 comp rx=0 tx=0).stop 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.620+0000 7ff6117fa640 1 -- 10.20.193.28:0/874066927 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff62c104980 msgr2=0x7ff62c077600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.620+0000 7ff6117fa640 1 --2- 10.20.193.28:0/874066927 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff62c104980 0x7ff62c077600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff620002fd0 tx=0x7ff6200029c0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.620+0000 7ff62ad76640 1 -- 10.20.193.28:0/874066927 reap_dead start 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.620+0000 7ff6117fa640 1 -- 10.20.193.28:0/874066927 shutdown_connections 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.621+0000 7ff6117fa640 1 -- 10.20.193.28:0/874066927 >> 10.20.193.28:0/874066927 conn(0x7ff62c100680 msgr2=0x7ff62c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.621+0000 7ff6117fa640 1 -- 10.20.193.28:0/874066927 shutdown_connections 2026-02-20T03:15:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.621+0000 7ff6117fa640 1 -- 10.20.193.28:0/874066927 wait complete. 2026-02-20T03:15:02.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.631+0000 7fd76d57b640 1 -- 10.20.193.28:0/1077151748 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7681030a0 msgr2=0x7fd76810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.631+0000 7fd76d57b640 1 --2- 10.20.193.28:0/1077151748 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7681030a0 0x7fd76810f5d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009f90 tx=0x7fd75c02f3d0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.631+0000 7fd76d57b640 1 -- 10.20.193.28:0/1077151748 shutdown_connections 2026-02-20T03:15:02.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.631+0000 7fd76d57b640 1 --2- 10.20.193.28:0/1077151748 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7681030a0 0x7fd76810f5d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.631+0000 7fd76d57b640 1 --2- 10.20.193.28:0/1077151748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd768102700 0x7fd768102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.631+0000 7fd76d57b640 1 --2- 10.20.193.28:0/1077151748 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd768108700 0x7fd768108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.631+0000 7fd76d57b640 1 -- 10.20.193.28:0/1077151748 >> 10.20.193.28:0/1077151748 conn(0x7fd7680fe440 msgr2=0x7fd768100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.632+0000 7fd76d57b640 1 -- 10.20.193.28:0/1077151748 shutdown_connections 2026-02-20T03:15:02.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.632+0000 7fd76d57b640 1 -- 10.20.193.28:0/1077151748 wait complete. 2026-02-20T03:15:02.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.633+0000 7fd76d57b640 1 Processor -- start 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.634+0000 7fd76d57b640 1 -- start start 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.634+0000 7fd76d57b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd768102700 0x7fd76819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.634+0000 7fd76d57b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7681030a0 0x7fd76819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.634+0000 7fd76d57b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd768108700 0x7fd76819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd7677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7681030a0 0x7fd76819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd7677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7681030a0 0x7fd76819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59536/0 (socket says 10.20.193.28:59536) 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd7677fe640 1 -- 10.20.193.28:0/2242896386 learned_addr learned my addr 10.20.193.28:0/2242896386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd768112920 con 0x7fd768108700 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd7681127a0 con 0x7fd7681030a0 2026-02-20T03:15:02.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd768112aa0 con 0x7fd768102700 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd767fff640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd768102700 0x7fd76819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd76cd7a640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd768108700 0x7fd76819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd767fff640 1 -- 10.20.193.28:0/2242896386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7681030a0 msgr2=0x7fd76819b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd767fff640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7681030a0 0x7fd76819b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd767fff640 1 -- 10.20.193.28:0/2242896386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd768108700 msgr2=0x7fd76819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd767fff640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd768108700 0x7fd76819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd767fff640 1 -- 10.20.193.28:0/2242896386 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76819fd90 con 0x7fd768102700 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.635+0000 7fd7677fe640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7681030a0 0x7fd76819b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.636+0000 7fd767fff640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd768102700 0x7fd76819ad40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7540027e0 tx=0x7fd754002cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.636+0000 7fd7657fa640 1 -- 10.20.193.28:0/2242896386 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75400ed40 con 0x7fd768102700 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.636+0000 7fd7657fa640 1 -- 10.20.193.28:0/2242896386 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd7540108d0 con 0x7fd768102700 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.636+0000 7fd7657fa640 1 -- 10.20.193.28:0/2242896386 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75400f7c0 con 0x7fd768102700 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.636+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7681a0080 con 0x7fd768102700 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.636+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7681a78c0 con 0x7fd768102700 2026-02-20T03:15:02.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.637+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd72c001030 con 0x7fd768102700 2026-02-20T03:15:02.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.637+0000 7fd7657fa640 1 -- 10.20.193.28:0/2242896386 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fd754010430 con 0x7fd768102700 2026-02-20T03:15:02.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.642+0000 7fd7657fa640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7340b0f30 0x7fd7340b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.642+0000 7fd7657fa640 1 -- 10.20.193.28:0/2242896386 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fd7540e1280 con 0x7fd768102700 2026-02-20T03:15:02.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.642+0000 7fd7677fe640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7340b0f30 0x7fd7340b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.642+0000 7fd7657fa640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] conn(0x7fd7340bbb50 0x7fd7340bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.642+0000 7fd7657fa640 1 -- 10.20.193.28:0/2242896386 --> [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd754013ec0 con 0x7fd7340bbb50 2026-02-20T03:15:02.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.642+0000 7fd7657fa640 1 -- 10.20.193.28:0/2242896386 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fd7540e1670 con 0x7fd768102700 2026-02-20T03:15:02.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.642+0000 7fd7677fe640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7340b0f30 0x7fd7340b33f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd7580059c0 tx=0x7fd75800a2b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.642+0000 7fd76cd7a640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] conn(0x7fd7340bbb50 0x7fd7340bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7fd76cd7a640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] conn(0x7fd7340bbb50 0x7fd7340bdf90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7fd7657fa640 1 -- 10.20.193.28:0/2242896386 <== osd.11 v2:10.20.193.177:6824/3589825667 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fd754013ec0 con 0x7fd7340bbb50 2026-02-20T03:15:02.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7f7f7e82f640 1 -- 10.20.193.28:0/788505771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f78074d10 msgr2=0x7f7f7810a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7f7f7e82f640 1 --2- 10.20.193.28:0/788505771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f78074d10 0x7f7f7810a470 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009a30 tx=0x7f7f6402f2d0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7f7f7e82f640 1 -- 10.20.193.28:0/788505771 shutdown_connections 2026-02-20T03:15:02.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7f7f7e82f640 1 --2- 10.20.193.28:0/788505771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f7810aef0 0x7f7f7811e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7f7f7e82f640 1 --2- 10.20.193.28:0/788505771 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f7810d7d0 0x7f7f7810a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7f7f7e82f640 1 --2- 10.20.193.28:0/788505771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f78074d10 0x7f7f7810a470 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7f7f7e82f640 1 -- 10.20.193.28:0/788505771 >> 10.20.193.28:0/788505771 conn(0x7f7f7806ec00 msgr2=0x7f7f7806f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7f7f7e82f640 1 -- 10.20.193.28:0/788505771 shutdown_connections 2026-02-20T03:15:02.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.645+0000 7f7f7e82f640 1 -- 10.20.193.28:0/788505771 wait complete. 2026-02-20T03:15:02.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.650+0000 7f7f7e82f640 1 Processor -- start 2026-02-20T03:15:02.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.650+0000 7f7f7e82f640 1 -- start start 2026-02-20T03:15:02.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.650+0000 7f7f7e82f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f78074d10 0x7f7f781a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7e82f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f7810aef0 0x7f7f781aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7e82f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f7810d7d0 0x7f7f781ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7e82f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7f78121cf0 con 0x7f7f78074d10 2026-02-20T03:15:02.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7e82f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7f78121b70 con 0x7f7f7810aef0 2026-02-20T03:15:02.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7e82f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7f78121e70 con 0x7f7f7810d7d0 2026-02-20T03:15:02.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f777fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f7810aef0 0x7f7f781aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f777fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f7810aef0 0x7f7f781aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59556/0 (socket says 10.20.193.28:59556) 2026-02-20T03:15:02.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f777fe640 1 -- 10.20.193.28:0/4099881993 learned_addr learned my addr 10.20.193.28:0/4099881993 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:02.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f77fff640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f78074d10 0x7f7f781a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7cda5640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f7810d7d0 0x7f7f781ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f777fe640 1 -- 10.20.193.28:0/4099881993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f7810d7d0 msgr2=0x7f7f781ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f777fe640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f7810d7d0 0x7f7f781ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f777fe640 1 -- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f78074d10 msgr2=0x7f7f781a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f777fe640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f78074d10 0x7f7f781a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f777fe640 1 -- 10.20.193.28:0/4099881993 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f781aef80 con 0x7f7f7810aef0 2026-02-20T03:15:02.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f77fff640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7f78074d10 0x7f7f781a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:02.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 --> [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd72c002e50 con 0x7fd7340bbb50 2026-02-20T03:15:02.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7cda5640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7f7810d7d0 0x7f7f781ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:02.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f777fe640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f7810aef0 0x7f7f781aa470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000d950 tx=0x7f7f6000de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f757fa640 1 -- 10.20.193.28:0/4099881993 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60014070 con 0x7f7f7810aef0 2026-02-20T03:15:02.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f757fa640 1 -- 10.20.193.28:0/4099881993 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7f600044e0 con 0x7f7f7810aef0 2026-02-20T03:15:02.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f757fa640 1 -- 10.20.193.28:0/4099881993 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60010460 con 0x7f7f7810aef0 2026-02-20T03:15:02.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f781af270 con 0x7f7f7810aef0 2026-02-20T03:15:02.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f781b6ab0 con 0x7f7f7810aef0 2026-02-20T03:15:02.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f44001030 con 0x7f7f7810aef0 2026-02-20T03:15:02.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd7657fa640 1 -- 10.20.193.28:0/2242896386 <== osd.11 v2:10.20.193.177:6824/3589825667 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd72c002e50 con 0x7fd7340bbb50 2026-02-20T03:15:02.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 >> [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] conn(0x7fd7340bbb50 msgr2=0x7fd7340bdf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7f7f757fa640 1 -- 10.20.193.28:0/4099881993 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f7f600026e0 con 0x7f7f7810aef0 2026-02-20T03:15:02.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] conn(0x7fd7340bbb50 0x7fd7340bdf90 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7340b0f30 msgr2=0x7fd7340b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7340b0f30 0x7fd7340b33f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd7580059c0 tx=0x7fd75800a2b0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd768102700 msgr2=0x7fd76819ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 --2- 10.20.193.28:0/2242896386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd768102700 0x7fd76819ad40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd7540027e0 tx=0x7fd754002cb0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76cd7a640 1 -- 10.20.193.28:0/2242896386 reap_dead start 2026-02-20T03:15:02.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 shutdown_connections 2026-02-20T03:15:02.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 >> 10.20.193.28:0/2242896386 conn(0x7fd7680fe440 msgr2=0x7fd7680fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 shutdown_connections 2026-02-20T03:15:02.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.653+0000 7fd76d57b640 1 -- 10.20.193.28:0/2242896386 wait complete. 2026-02-20T03:15:02.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.658+0000 7f7f757fa640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f480b0eb0 0x7f7f480b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.658+0000 7f7f757fa640 1 -- 10.20.193.28:0/4099881993 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f7f600e0ff0 con 0x7f7f7810aef0 2026-02-20T03:15:02.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.658+0000 7f7f757fa640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] conn(0x7f7f480bbad0 0x7f7f480bdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.658+0000 7f7f757fa640 1 -- 10.20.193.28:0/4099881993 --> [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f60012e80 con 0x7f7f480bbad0 2026-02-20T03:15:02.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.658+0000 7f7f757fa640 1 -- 10.20.193.28:0/4099881993 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f7f600e1440 con 0x7f7f7810aef0 2026-02-20T03:15:02.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.658+0000 7f7f77fff640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f480b0eb0 0x7f7f480b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.660+0000 7f7f7cda5640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] conn(0x7f7f480bbad0 0x7f7f480bdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.660+0000 7f7f7cda5640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] conn(0x7f7f480bbad0 0x7f7f480bdf10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.660+0000 7f7f77fff640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f480b0eb0 0x7f7f480b3370 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f64005ec0 tx=0x7f7f64005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.660+0000 7f7f757fa640 1 -- 10.20.193.28:0/4099881993 <== osd.9 v2:10.20.193.28:6826/698517696 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f7f60012e80 con 0x7f7f480bbad0 2026-02-20T03:15:02.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 --> [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f44002ed0 con 0x7f7f480bbad0 2026-02-20T03:15:02.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f757fa640 1 -- 10.20.193.28:0/4099881993 <== osd.9 v2:10.20.193.28:6826/698517696 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7f44002ed0 con 0x7f7f480bbad0 2026-02-20T03:15:02.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] conn(0x7f7f480bbad0 msgr2=0x7f7f480bdf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] conn(0x7f7f480bbad0 0x7f7f480bdf10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f480b0eb0 msgr2=0x7f7f480b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f480b0eb0 0x7f7f480b3370 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7f64005ec0 tx=0x7f7f64005e50 comp rx=0 tx=0).stop 2026-02-20T03:15:02.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f7810aef0 msgr2=0x7f7f781aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 --2- 10.20.193.28:0/4099881993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7f7810aef0 0x7f7f781aa470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000d950 tx=0x7f7f6000de20 comp rx=0 tx=0).stop 2026-02-20T03:15:02.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7cda5640 1 -- 10.20.193.28:0/4099881993 reap_dead start 2026-02-20T03:15:02.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 shutdown_connections 2026-02-20T03:15:02.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 >> 10.20.193.28:0/4099881993 conn(0x7f7f7806ec00 msgr2=0x7f7f78111d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 shutdown_connections 2026-02-20T03:15:02.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.668+0000 7f7f7e82f640 1 -- 10.20.193.28:0/4099881993 wait complete. 2026-02-20T03:15:02.711 INFO:teuthology.orchestra.run.trial028.stdout:111669149724 2026-02-20T03:15:02.712 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-20T03:15:02.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:02 trial177 ceph-mon[43181]: pgmap v187: 129 pgs: 129 active+clean; 631 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 7.1 KiB/s wr, 14 op/s 2026-02-20T03:15:02.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.721+0000 7f47038a9640 1 -- 10.20.193.28:0/2777100244 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46fc104db0 msgr2=0x7f46fc105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.721+0000 7f47038a9640 1 --2- 10.20.193.28:0/2777100244 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46fc104db0 0x7f46fc105190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00b0a0 tx=0x7f46ec02f410 comp rx=0 tx=0).stop 2026-02-20T03:15:02.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.721+0000 7f47038a9640 1 -- 10.20.193.28:0/2777100244 shutdown_connections 2026-02-20T03:15:02.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.721+0000 7f47038a9640 1 --2- 10.20.193.28:0/2777100244 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46fc109ee0 0x7f46fc111a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.721+0000 7f47038a9640 1 --2- 10.20.193.28:0/2777100244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46fc105760 0x7f46fc1097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.721+0000 7f47038a9640 1 --2- 10.20.193.28:0/2777100244 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46fc104db0 0x7f46fc105190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.721+0000 7f47038a9640 1 -- 10.20.193.28:0/2777100244 >> 10.20.193.28:0/2777100244 conn(0x7f46fc100870 msgr2=0x7f46fc102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.722+0000 7f47038a9640 1 -- 10.20.193.28:0/2777100244 shutdown_connections 2026-02-20T03:15:02.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.722+0000 7f47038a9640 1 -- 10.20.193.28:0/2777100244 wait complete. 2026-02-20T03:15:02.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.722+0000 7f47038a9640 1 Processor -- start 2026-02-20T03:15:02.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.722+0000 7f47038a9640 1 -- start start 2026-02-20T03:15:02.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.723+0000 7f47038a9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46fc104db0 0x7f46fc19d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f47038a9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46fc105760 0x7f46fc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f47038a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46fc109ee0 0x7f46fc1a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f4700e1d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46fc105760 0x7f46fc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f470161e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46fc104db0 0x7f46fc19d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f4700e1d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46fc105760 0x7f46fc19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59562/0 (socket says 10.20.193.28:59562) 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f470161e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46fc104db0 0x7f46fc19d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37778/0 (socket says 10.20.193.28:37778) 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f4700e1d640 1 -- 10.20.193.28:0/1172182983 learned_addr learned my addr 10.20.193.28:0/1172182983 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc114d70 con 0x7f46fc109ee0 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc114bf0 con 0x7f46fc105760 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc114ef0 con 0x7f46fc104db0 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f4701e1f640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46fc109ee0 0x7f46fc1a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f4700e1d640 1 -- 10.20.193.28:0/1172182983 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46fc104db0 msgr2=0x7f46fc19d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f4700e1d640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46fc104db0 0x7f46fc19d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f4700e1d640 1 -- 10.20.193.28:0/1172182983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46fc109ee0 msgr2=0x7f46fc1a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f4700e1d640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46fc109ee0 0x7f46fc1a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.724+0000 7f4700e1d640 1 -- 10.20.193.28:0/1172182983 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46fc1a21e0 con 0x7f46fc105760 2026-02-20T03:15:02.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.725+0000 7f4700e1d640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46fc105760 0x7f46fc19d6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46e400ea10 tx=0x7f46e400eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.725+0000 7f4701e1f640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46fc109ee0 0x7f46fc1a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:02.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.726+0000 7f46f27fc640 1 -- 10.20.193.28:0/1172182983 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e400ce50 con 0x7f46fc105760 2026-02-20T03:15:02.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.726+0000 7f46f27fc640 1 -- 10.20.193.28:0/1172182983 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f46e4004570 con 0x7f46fc105760 2026-02-20T03:15:02.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.726+0000 7f46f27fc640 1 -- 10.20.193.28:0/1172182983 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4010690 con 0x7f46fc105760 2026-02-20T03:15:02.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.726+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46fc1a24d0 con 0x7f46fc105760 2026-02-20T03:15:02.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.726+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46fc1a9d10 con 0x7f46fc105760 2026-02-20T03:15:02.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.726+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46c4001030 con 0x7f46fc105760 2026-02-20T03:15:02.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.728+0000 7f46f27fc640 1 -- 10.20.193.28:0/1172182983 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f46e4020030 con 0x7f46fc105760 2026-02-20T03:15:02.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.730+0000 7f46f27fc640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46d80b1120 0x7f46d80b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.730+0000 7f46f27fc640 1 -- 10.20.193.28:0/1172182983 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f46e40e0d10 con 0x7f46fc105760 2026-02-20T03:15:02.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.730+0000 7f46f27fc640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] conn(0x7f46d80bbd40 0x7f46d80be180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:02.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.730+0000 7f470161e640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46d80b1120 0x7f46d80b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.731+0000 7f46f27fc640 1 -- 10.20.193.28:0/1172182983 --> [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46e4048e50 con 0x7f46d80bbd40 2026-02-20T03:15:02.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.731+0000 7f46f27fc640 1 -- 10.20.193.28:0/1172182983 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f46e40e10c0 con 0x7f46fc105760 2026-02-20T03:15:02.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.731+0000 7f4701e1f640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] conn(0x7f46d80bbd40 0x7f46d80be180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:02.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.731+0000 7f470161e640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46d80b1120 0x7f46d80b35e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f46ec02f920 tx=0x7f46ec03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.732+0000 7f4701e1f640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] conn(0x7f46d80bbd40 0x7f46d80be180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:02.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.733+0000 7f46f27fc640 1 -- 10.20.193.28:0/1172182983 <== osd.4 v2:10.20.193.126:6808/1455790264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f46e4048e50 con 0x7f46d80bbd40 2026-02-20T03:15:02.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.741+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 --> [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46c4002ed0 con 0x7f46d80bbd40 2026-02-20T03:15:02.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.741+0000 7f46f27fc640 1 -- 10.20.193.28:0/1172182983 <== osd.4 v2:10.20.193.126:6808/1455790264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f46c4002ed0 con 0x7f46d80bbd40 2026-02-20T03:15:02.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.742+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 >> [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] conn(0x7f46d80bbd40 msgr2=0x7f46d80be180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.742+0000 7f47038a9640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] conn(0x7f46d80bbd40 0x7f46d80be180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.742+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46d80b1120 msgr2=0x7f46d80b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.742+0000 7f47038a9640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46d80b1120 0x7f46d80b35e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f46ec02f920 tx=0x7f46ec03a040 comp rx=0 tx=0).stop 2026-02-20T03:15:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.742+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46fc105760 msgr2=0x7f46fc19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.742+0000 7f47038a9640 1 --2- 10.20.193.28:0/1172182983 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46fc105760 0x7f46fc19d6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46e400ea10 tx=0x7f46e400eee0 comp rx=0 tx=0).stop 2026-02-20T03:15:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.742+0000 7f4701e1f640 1 -- 10.20.193.28:0/1172182983 reap_dead start 2026-02-20T03:15:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.743+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 shutdown_connections 2026-02-20T03:15:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.743+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 >> 10.20.193.28:0/1172182983 conn(0x7f46fc100870 msgr2=0x7f46fc101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.743+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 shutdown_connections 2026-02-20T03:15:02.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:02.744+0000 7f47038a9640 1 -- 10.20.193.28:0/1172182983 wait complete. 2026-02-20T03:15:02.811 INFO:teuthology.orchestra.run.trial028.stdout:313532612621 2026-02-20T03:15:02.812 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-20T03:15:02.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:02 trial126 ceph-mon[38476]: pgmap v187: 129 pgs: 129 active+clean; 631 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 7.1 KiB/s wr, 14 op/s 2026-02-20T03:15:02.904 INFO:teuthology.orchestra.run.trial028.stdout:223338299412 2026-02-20T03:15:02.905 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-20T03:15:02.916 INFO:teuthology.orchestra.run.trial028.stdout:257698037778 2026-02-20T03:15:02.917 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-20T03:15:02.964 INFO:teuthology.orchestra.run.trial028.stdout:343597383691 2026-02-20T03:15:02.965 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-20T03:15:02.966 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:02.982 INFO:teuthology.orchestra.run.trial028.stdout:292057776143 2026-02-20T03:15:02.982 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-20T03:15:02.986 INFO:teuthology.orchestra.run.trial028.stdout:146028888090 2026-02-20T03:15:02.987 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-20T03:15:03.033 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.052 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.077 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.185 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.188 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.248+0000 7fc589d13640 1 -- 10.20.193.28:0/3861493033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc584074d10 msgr2=0x7fc58410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.249+0000 7fc589d13640 1 --2- 10.20.193.28:0/3861493033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc584074d10 0x7fc58410a470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc574009a30 tx=0x7fc57402f260 comp rx=0 tx=0).stop 2026-02-20T03:15:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.249+0000 7fc589d13640 1 -- 10.20.193.28:0/3861493033 shutdown_connections 2026-02-20T03:15:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.250+0000 7fc589d13640 1 --2- 10.20.193.28:0/3861493033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc584117da0 0x7fc58411a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.250+0000 7fc589d13640 1 --2- 10.20.193.28:0/3861493033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc58410a9b0 0x7fc58410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.250+0000 7fc589d13640 1 --2- 10.20.193.28:0/3861493033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc584074d10 0x7fc58410a470 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.250+0000 7fc589d13640 1 -- 10.20.193.28:0/3861493033 >> 10.20.193.28:0/3861493033 conn(0x7fc58406ec00 msgr2=0x7fc58406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.250+0000 7fc589d13640 1 -- 10.20.193.28:0/3861493033 shutdown_connections 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.250+0000 7fc589d13640 1 -- 10.20.193.28:0/3861493033 wait complete. 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.252+0000 7fc589d13640 1 Processor -- start 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.252+0000 7fc589d13640 1 -- start start 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.252+0000 7fc589d13640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc584074d10 0x7fc5841161f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.252+0000 7fc589d13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc58410a9b0 0x7fc584116730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc5837fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc584074d10 0x7fc5841161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc5837fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc584074d10 0x7fc5841161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59580/0 (socket says 10.20.193.28:59580) 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc5837fe640 1 -- 10.20.193.28:0/2286219294 learned_addr learned my addr 10.20.193.28:0/2286219294 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc589d13640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc584117da0 0x7fc5841b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc58410e970 con 0x7fc58410a9b0 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc58410e7f0 con 0x7fc584074d10 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc58410eaf0 con 0x7fc584117da0 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc5837fe640 1 -- 10.20.193.28:0/2286219294 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc584117da0 msgr2=0x7fc5841b5d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc5837fe640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc584117da0 0x7fc5841b5d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc5837fe640 1 -- 10.20.193.28:0/2286219294 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc58410a9b0 msgr2=0x7fc584116730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc5837fe640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc58410a9b0 0x7fc584116730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.253+0000 7fc5837fe640 1 -- 10.20.193.28:0/2286219294 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5841b64b0 con 0x7fc584074d10 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.254+0000 7fc5837fe640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc584074d10 0x7fc5841161f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc57402f770 tx=0x7fc57402fcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.254+0000 7fc580ff9640 1 -- 10.20.193.28:0/2286219294 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5740384e0 con 0x7fc584074d10 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.254+0000 7fc580ff9640 1 -- 10.20.193.28:0/2286219294 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc574038770 con 0x7fc584074d10 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.255+0000 7fc580ff9640 1 -- 10.20.193.28:0/2286219294 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574041690 con 0x7fc584074d10 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.255+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5841b6740 con 0x7fc584074d10 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.255+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5841b6bd0 con 0x7fc584074d10 2026-02-20T03:15:03.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.256+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc58410a470 con 0x7fc584074d10 2026-02-20T03:15:03.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.257+0000 7fc580ff9640 1 -- 10.20.193.28:0/2286219294 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fc574004240 con 0x7fc584074d10 2026-02-20T03:15:03.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.258+0000 7fc580ff9640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc5680b0e30 0x7fc5680b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.258+0000 7fc580ff9640 1 -- 10.20.193.28:0/2286219294 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fc5741051d0 con 0x7fc584074d10 2026-02-20T03:15:03.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.260+0000 7fc582ffd640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc5680b0e30 0x7fc5680b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.260+0000 7fc582ffd640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc5680b0e30 0x7fc5680b32f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5700059c0 tx=0x7fc570005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.267+0000 7fc580ff9640 1 -- 10.20.193.28:0/2286219294 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc574004560 con 0x7fc584074d10 2026-02-20T03:15:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.310+0000 7f9a9b966640 1 -- 10.20.193.28:0/3608739046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a94077620 msgr2=0x7f9a94077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.310+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3608739046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a94077620 0x7f9a94077a00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009960 tx=0x7f9a8802f140 comp rx=0 tx=0).stop 2026-02-20T03:15:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.310+0000 7f9a9b966640 1 -- 10.20.193.28:0/3608739046 shutdown_connections 2026-02-20T03:15:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.311+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3608739046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a941139e0 0x7f9a94115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.311+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3608739046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a94077f40 0x7f9a941134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.311+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3608739046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a94077620 0x7f9a94077a00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.311+0000 7f9a9b966640 1 -- 10.20.193.28:0/3608739046 >> 10.20.193.28:0/3608739046 conn(0x7f9a94100840 msgr2=0x7f9a94102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.311+0000 7f9a9b966640 1 -- 10.20.193.28:0/3608739046 shutdown_connections 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.311+0000 7f9a9b966640 1 -- 10.20.193.28:0/3608739046 wait complete. 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.312+0000 7f9a9b966640 1 Processor -- start 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.312+0000 7f9a9b966640 1 -- start start 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.312+0000 7f9a9b966640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a94077620 0x7f9a94073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a9b966640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a94077f40 0x7f9a940741d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a996db640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a94077620 0x7f9a94073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a996db640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a94077620 0x7f9a94073c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37816/0 (socket says 10.20.193.28:37816) 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a9b966640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a941139e0 0x7f9a94113000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a9b966640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a94107250 con 0x7f9a94077f40 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a9b966640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9a941070d0 con 0x7f9a941139e0 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a9b966640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9a941073d0 con 0x7f9a94077620 2026-02-20T03:15:03.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a99edc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a941139e0 0x7f9a94113000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a99edc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a941139e0 0x7f9a94113000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59602/0 (socket says 10.20.193.28:59602) 2026-02-20T03:15:03.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.313+0000 7f9a99edc640 1 -- 10.20.193.28:0/3180298050 learned_addr learned my addr 10.20.193.28:0/3180298050 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:03.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.314+0000 7f9a98eda640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a94077f40 0x7f9a940741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.314+0000 7f9a98eda640 1 -- 10.20.193.28:0/3180298050 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a94077620 msgr2=0x7f9a94073c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.314+0000 7f9a98eda640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a94077620 0x7f9a94073c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.314+0000 7f9a98eda640 1 -- 10.20.193.28:0/3180298050 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a941139e0 msgr2=0x7f9a94113000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.314+0000 7f9a98eda640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a941139e0 0x7f9a94113000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.314+0000 7f9a98eda640 1 -- 10.20.193.28:0/3180298050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a941136e0 con 0x7f9a94077f40 2026-02-20T03:15:03.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.315+0000 7f9a98eda640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a94077f40 0x7f9a940741d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a8401aad0 tx=0x7f9a8401e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.315+0000 7f9a827fc640 1 -- 10.20.193.28:0/3180298050 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84029070 con 0x7f9a94077f40 2026-02-20T03:15:03.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.315+0000 7f9a827fc640 1 -- 10.20.193.28:0/3180298050 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9a8401ed50 con 0x7f9a94077f40 2026-02-20T03:15:03.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.315+0000 7f9a827fc640 1 -- 10.20.193.28:0/3180298050 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840243f0 con 0x7f9a94077f40 2026-02-20T03:15:03.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.315+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9410ad10 con 0x7f9a94077f40 2026-02-20T03:15:03.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.317+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9410b1d0 con 0x7f9a94077f40 2026-02-20T03:15:03.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.316+0000 7f9a996db640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a94077620 0x7f9a94073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2026-02-20T03:15:03.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.318+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a94078d60 con 0x7f9a94077f40 2026-02-20T03:15:03.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.320+0000 7f9a827fc640 1 -- 10.20.193.28:0/3180298050 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f9a84023070 con 0x7f9a94077f40 2026-02-20T03:15:03.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.324+0000 7f9a827fc640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a640b0e70 0x7f9a640b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.325+0000 7f9a827fc640 1 -- 10.20.193.28:0/3180298050 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f9a840f4020 con 0x7f9a94077f40 2026-02-20T03:15:03.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.325+0000 7f9a827fc640 1 -- 10.20.193.28:0/3180298050 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9a84021070 con 0x7f9a94077f40 2026-02-20T03:15:03.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.326+0000 7f9a996db640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a640b0e70 0x7f9a640b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.327+0000 7f9a996db640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a640b0e70 0x7f9a640b3330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009960 tx=0x7f9a88009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.343+0000 7f752e3ab640 1 -- 10.20.193.28:0/136586195 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528102710 msgr2=0x7f7528102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.343+0000 7f752e3ab640 1 --2- 10.20.193.28:0/136586195 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528102710 0x7f7528102b70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f751c009a30 tx=0x7f751c02f260 comp rx=0 tx=0).stop 2026-02-20T03:15:03.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.344+0000 7f752e3ab640 1 -- 10.20.193.28:0/136586195 shutdown_connections 2026-02-20T03:15:03.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.344+0000 7f752e3ab640 1 --2- 10.20.193.28:0/136586195 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75281030b0 0x7f752810f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.344+0000 7f752e3ab640 1 --2- 10.20.193.28:0/136586195 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528102710 0x7f7528102b70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.344+0000 7f752e3ab640 1 --2- 10.20.193.28:0/136586195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7528108820 0x7f7528108c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.344+0000 7f752e3ab640 1 -- 10.20.193.28:0/136586195 >> 10.20.193.28:0/136586195 conn(0x7f75280fe450 msgr2=0x7f7528100870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.344+0000 7f752e3ab640 1 -- 10.20.193.28:0/136586195 shutdown_connections 2026-02-20T03:15:03.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.344+0000 7f752e3ab640 1 -- 10.20.193.28:0/136586195 wait complete. 2026-02-20T03:15:03.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.345+0000 7f752e3ab640 1 Processor -- start 2026-02-20T03:15:03.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.345+0000 7f752e3ab640 1 -- start start 2026-02-20T03:15:03.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.345+0000 7f752e3ab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7528102710 0x7f752819d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.346+0000 7f752d3a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7528102710 0x7f752819d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.346+0000 7f752e3ab640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75281030b0 0x7f752819de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.346+0000 7f752e3ab640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528108820 0x7f752810d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.346+0000 7f752d3a9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7528102710 0x7f752819d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56658/0 (socket says 10.20.193.28:56658) 2026-02-20T03:15:03.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.346+0000 7f752e3ab640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7528112a90 con 0x7f7528102710 2026-02-20T03:15:03.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.346+0000 7f752e3ab640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7528112910 con 0x7f7528108820 2026-02-20T03:15:03.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.346+0000 7f752e3ab640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7528112c10 con 0x7f75281030b0 2026-02-20T03:15:03.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.347+0000 7f752dbaa640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528108820 0x7f752810d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.347+0000 7f752dbaa640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528108820 0x7f752810d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59622/0 (socket says 10.20.193.28:59622) 2026-02-20T03:15:03.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.347+0000 7f752dbaa640 1 -- 10.20.193.28:0/744611402 learned_addr learned my addr 10.20.193.28:0/744611402 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:03.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.347+0000 7f752dbaa640 1 -- 10.20.193.28:0/744611402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75281030b0 msgr2=0x7f752819de80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:15:03.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.347+0000 7f752cba8640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75281030b0 0x7f752819de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.347+0000 7f752dbaa640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75281030b0 0x7f752819de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.347+0000 7f752dbaa640 1 -- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7528102710 msgr2=0x7f752819d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.347+0000 7f752dbaa640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7528102710 0x7f752819d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.347+0000 7f752dbaa640 1 -- 10.20.193.28:0/744611402 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752810e110 con 0x7f7528108820 2026-02-20T03:15:03.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.348+0000 7f752d3a9640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7528102710 0x7f752819d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:03.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.348+0000 7f752dbaa640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528108820 0x7f752810d850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f752400ef30 tx=0x7f752400c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.349+0000 7f75167fc640 1 -- 10.20.193.28:0/744611402 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524019070 con 0x7f7528108820 2026-02-20T03:15:03.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.349+0000 7f75167fc640 1 -- 10.20.193.28:0/744611402 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f75240092d0 con 0x7f7528108820 2026-02-20T03:15:03.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.349+0000 7f75167fc640 1 -- 10.20.193.28:0/744611402 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524007500 con 0x7f7528108820 2026-02-20T03:15:03.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.349+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752810e3a0 con 0x7f7528108820 2026-02-20T03:15:03.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.349+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75281a1820 con 0x7f7528108820 2026-02-20T03:15:03.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.350+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f752810e600 con 0x7f7528108820 2026-02-20T03:15:03.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.352+0000 7f75167fc640 1 -- 10.20.193.28:0/744611402 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f7524004b40 con 0x7f7528108820 2026-02-20T03:15:03.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.354+0000 7f75167fc640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75040b0eb0 0x7f75040b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.354+0000 7f75167fc640 1 -- 10.20.193.28:0/744611402 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f75240e05a0 con 0x7f7528108820 2026-02-20T03:15:03.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.354+0000 7f75167fc640 1 -- 10.20.193.28:0/744611402 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f752810e600 con 0x7f7528108820 2026-02-20T03:15:03.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.354+0000 7f752d3a9640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75040b0eb0 0x7f75040b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.358+0000 7f752d3a9640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75040b0eb0 0x7f75040b3370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7518004700 tx=0x7f7518009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.392+0000 7fdcb184f640 1 -- 10.20.193.28:0/1314827311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdcac074380 msgr2=0x7fdcac074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.393+0000 7fdcb184f640 1 --2- 10.20.193.28:0/1314827311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdcac074380 0x7fdcac074760 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdca400b0a0 tx=0x7fdca402f450 comp rx=0 tx=0).stop 2026-02-20T03:15:03.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.393+0000 7fdcb184f640 1 -- 10.20.193.28:0/1314827311 shutdown_connections 2026-02-20T03:15:03.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.393+0000 7fdcb184f640 1 --2- 10.20.193.28:0/1314827311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdcac10e1e0 0x7fdcac07b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.393+0000 7fdcb184f640 1 --2- 10.20.193.28:0/1314827311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdcac074d30 0x7fdcac10dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.393+0000 7fdcb184f640 1 --2- 10.20.193.28:0/1314827311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdcac074380 0x7fdcac074760 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.393+0000 7fdcb184f640 1 -- 10.20.193.28:0/1314827311 >> 10.20.193.28:0/1314827311 conn(0x7fdcac06ead0 msgr2=0x7fdcac06eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.394+0000 7fdcb184f640 1 -- 10.20.193.28:0/1314827311 shutdown_connections 2026-02-20T03:15:03.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.394+0000 7fdcb184f640 1 -- 10.20.193.28:0/1314827311 wait complete. 2026-02-20T03:15:03.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.395+0000 7fdcb184f640 1 Processor -- start 2026-02-20T03:15:03.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.395+0000 7fdcb184f640 1 -- start start 2026-02-20T03:15:03.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.395+0000 7fdcb184f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdcac074380 0x7fdcac085bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.396+0000 7fdcb184f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdcac074d30 0x7fdcac0860f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.396+0000 7fdcb184f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdcac10e1e0 0x7fdcac07fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.396+0000 7fdcb184f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac07e630 con 0x7fdcac074d30 2026-02-20T03:15:03.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.396+0000 7fdcb184f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac07e4b0 con 0x7fdcac074380 2026-02-20T03:15:03.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.396+0000 7fdcb184f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdcac07e7b0 con 0x7fdcac10e1e0 2026-02-20T03:15:03.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.396+0000 7fdcb104e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdcac10e1e0 0x7fdcac07fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.396+0000 7fdcb104e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdcac10e1e0 0x7fdcac07fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37846/0 (socket says 10.20.193.28:37846) 2026-02-20T03:15:03.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.396+0000 7fdcb104e640 1 -- 10.20.193.28:0/817138254 learned_addr learned my addr 10.20.193.28:0/817138254 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:03.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.396+0000 7fdcb084d640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdcac074380 0x7fdcac085bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.397+0000 7fdcb104e640 1 -- 10.20.193.28:0/817138254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdcac074380 msgr2=0x7fdcac085bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.397+0000 7fdcb104e640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdcac074380 0x7fdcac085bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.397+0000 7fdcb104e640 1 -- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdcac074d30 msgr2=0x7fdcac0860f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:15:03.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.397+0000 7fdcabfff640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdcac074d30 0x7fdcac0860f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.397+0000 7fdcb104e640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdcac074d30 0x7fdcac0860f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.397+0000 7fdcb104e640 1 -- 10.20.193.28:0/817138254 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcac0807b0 con 0x7fdcac10e1e0 2026-02-20T03:15:03.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.398+0000 7fdcabfff640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdcac074d30 0x7fdcac0860f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:03.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.398+0000 7fdcb104e640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdcac10e1e0 0x7fdcac07fef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdca000e900 tx=0x7fdca000edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.398+0000 7fdca9ffb640 1 -- 10.20.193.28:0/817138254 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca00042d0 con 0x7fdcac10e1e0 2026-02-20T03:15:03.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.398+0000 7fdca9ffb640 1 -- 10.20.193.28:0/817138254 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdca000ce10 con 0x7fdcac10e1e0 2026-02-20T03:15:03.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.399+0000 7fdca9ffb640 1 -- 10.20.193.28:0/817138254 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0010690 con 0x7fdcac10e1e0 2026-02-20T03:15:03.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.399+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcac1bf1a0 con 0x7fdcac10e1e0 2026-02-20T03:15:03.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.399+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcac1bf690 con 0x7fdcac10e1e0 2026-02-20T03:15:03.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.400+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcac080a40 con 0x7fdcac10e1e0 2026-02-20T03:15:03.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.402+0000 7fdca9ffb640 1 -- 10.20.193.28:0/817138254 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fdca0020030 con 0x7fdcac10e1e0 2026-02-20T03:15:03.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.404+0000 7fdca9ffb640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc880b0e30 0x7fdc880b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.404+0000 7fdca9ffb640 1 -- 10.20.193.28:0/817138254 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fdca00e0eb0 con 0x7fdcac10e1e0 2026-02-20T03:15:03.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.404+0000 7fdcb084d640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc880b0e30 0x7fdc880b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.405+0000 7fdcb084d640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc880b0e30 0x7fdc880b32f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdca4002790 tx=0x7fdca400c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.409+0000 7fdca9ffb640 1 -- 10.20.193.28:0/817138254 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fdca00a9390 con 0x7fdcac10e1e0 2026-02-20T03:15:03.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.411+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc548005240 con 0x7fc584074d10 2026-02-20T03:15:03.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.411+0000 7fc580ff9640 1 -- 10.20.193.28:0/2286219294 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc5740cd6b0 con 0x7fc584074d10 2026-02-20T03:15:03.415 INFO:teuthology.orchestra.run.trial028.stdout:38654705699 2026-02-20T03:15:03.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.413+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc5680b0e30 msgr2=0x7fc5680b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.413+0000 7fc589d13640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc5680b0e30 0x7fc5680b32f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc5700059c0 tx=0x7fc570005950 comp rx=0 tx=0).stop 2026-02-20T03:15:03.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.413+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc584074d10 msgr2=0x7fc5841161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.413+0000 7fc589d13640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc584074d10 0x7fc5841161f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc57402f770 tx=0x7fc57402fcf0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.414+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 shutdown_connections 2026-02-20T03:15:03.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.414+0000 7fc589d13640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc5680b0e30 0x7fc5680b32f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.414+0000 7fc589d13640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc584117da0 0x7fc5841b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.414+0000 7fc589d13640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc58410a9b0 0x7fc584116730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.414+0000 7fc589d13640 1 --2- 10.20.193.28:0/2286219294 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc584074d10 0x7fc5841161f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.414+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 >> 10.20.193.28:0/2286219294 conn(0x7fc58406ec00 msgr2=0x7fc584118180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.414+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 shutdown_connections 2026-02-20T03:15:03.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.414+0000 7fc589d13640 1 -- 10.20.193.28:0/2286219294 wait complete. 2026-02-20T03:15:03.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.440+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9a9410b430 con 0x7f9a94077f40 2026-02-20T03:15:03.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.440+0000 7f9a827fc640 1 -- 10.20.193.28:0/3180298050 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9a840b8870 con 0x7f9a94077f40 2026-02-20T03:15:03.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.437+0000 7f56d63b2640 1 -- 10.20.193.28:0/4198835363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 msgr2=0x7f56d010aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.437+0000 7f56d63b2640 1 --2- 10.20.193.28:0/4198835363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 0x7f56d010aab0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009a30 tx=0x7f56c002f220 comp rx=0 tx=0).stop 2026-02-20T03:15:03.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.441+0000 7f56d63b2640 1 -- 10.20.193.28:0/4198835363 shutdown_connections 2026-02-20T03:15:03.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.442+0000 7f56d63b2640 1 --2- 10.20.193.28:0/4198835363 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56d0113b50 0x7f56d0115fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.442+0000 7f56d63b2640 1 --2- 10.20.193.28:0/4198835363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d010aff0 0x7f56d01134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.442+0000 7f56d63b2640 1 --2- 10.20.193.28:0/4198835363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 0x7f56d010aab0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.442+0000 7f56d63b2640 1 -- 10.20.193.28:0/4198835363 >> 10.20.193.28:0/4198835363 conn(0x7f56d006ec00 msgr2=0x7f56d006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.442+0000 7f56d63b2640 1 -- 10.20.193.28:0/4198835363 shutdown_connections 2026-02-20T03:15:03.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.442+0000 7f56d63b2640 1 -- 10.20.193.28:0/4198835363 wait complete. 2026-02-20T03:15:03.446 INFO:teuthology.orchestra.run.trial028.stdout:167503724568 2026-02-20T03:15:03.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.444+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a640b0e70 msgr2=0x7f9a640b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.444+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a640b0e70 0x7f9a640b3330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009960 tx=0x7f9a88009210 comp rx=0 tx=0).stop 2026-02-20T03:15:03.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.444+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a94077f40 msgr2=0x7f9a940741d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.444+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a94077f40 0x7f9a940741d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a8401aad0 tx=0x7f9a8401e0d0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.445+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 shutdown_connections 2026-02-20T03:15:03.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.445+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a640b0e70 0x7f9a640b3330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.445+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a941139e0 0x7f9a94113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.445+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a94077f40 0x7f9a940741d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.445+0000 7f9a9b966640 1 --2- 10.20.193.28:0/3180298050 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a94077620 0x7f9a94073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.445+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 >> 10.20.193.28:0/3180298050 conn(0x7f9a94100840 msgr2=0x7f9a94102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.445+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 shutdown_connections 2026-02-20T03:15:03.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.445+0000 7f9a9b966640 1 -- 10.20.193.28:0/3180298050 wait complete. 2026-02-20T03:15:03.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.446+0000 7f56d63b2640 1 Processor -- start 2026-02-20T03:15:03.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.446+0000 7f56d63b2640 1 -- start start 2026-02-20T03:15:03.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.446+0000 7f56d63b2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 0x7f56d0113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.447+0000 7f56d63b2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56d010aff0 0x7f56d0110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.447+0000 7f56cffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 0x7f56d0113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.447+0000 7f56cffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 0x7f56d0113290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59638/0 (socket says 10.20.193.28:59638) 2026-02-20T03:15:03.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.447+0000 7f56cffff640 1 -- 10.20.193.28:0/4277477660 learned_addr learned my addr 10.20.193.28:0/4277477660 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:03.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.447+0000 7f56d63b2640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d0113b50 0x7f56d0110880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.447+0000 7f56d63b2640 1 -- 10.20.193.28:0/4277477660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56d0119020 con 0x7f56d0113b50 2026-02-20T03:15:03.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.448+0000 7f56d63b2640 1 -- 10.20.193.28:0/4277477660 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f56d0118ea0 con 0x7f56d010a6d0 2026-02-20T03:15:03.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.448+0000 7f56d63b2640 1 -- 10.20.193.28:0/4277477660 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f56d01191a0 con 0x7f56d010aff0 2026-02-20T03:15:03.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.448+0000 7f56cf7fe640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56d010aff0 0x7f56d0110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.448+0000 7f56d4928640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d0113b50 0x7f56d0110880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.448+0000 7f56cffff640 1 -- 10.20.193.28:0/4277477660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56d010aff0 msgr2=0x7f56d0110340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.448+0000 7f56cffff640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56d010aff0 0x7f56d0110340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.448+0000 7f56cffff640 1 -- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d0113b50 msgr2=0x7f56d0110880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.448+0000 7f56cffff640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d0113b50 0x7f56d0110880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.448+0000 7f56cffff640 1 -- 10.20.193.28:0/4277477660 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d0111120 con 0x7f56d010a6d0 2026-02-20T03:15:03.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.449+0000 7f56d4928640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d0113b50 0x7f56d0110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:03.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.449+0000 7f56cffff640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 0x7f56d0113290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009b60 tx=0x7f56c002fdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.449+0000 7f56cd7fa640 1 -- 10.20.193.28:0/4277477660 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0004480 con 0x7f56d010a6d0 2026-02-20T03:15:03.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.449+0000 7f56d63b2640 1 -- 10.20.193.28:0/4277477660 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d01b6670 con 0x7f56d010a6d0 2026-02-20T03:15:03.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.449+0000 7f56d63b2640 1 -- 10.20.193.28:0/4277477660 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d01b6ba0 con 0x7f56d010a6d0 2026-02-20T03:15:03.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.451+0000 7f56cd7fa640 1 -- 10.20.193.28:0/4277477660 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56c003e070 con 0x7f56d010a6d0 2026-02-20T03:15:03.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.451+0000 7f56cd7fa640 1 -- 10.20.193.28:0/4277477660 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0038470 con 0x7f56d010a6d0 2026-02-20T03:15:03.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.457+0000 7f56aeffd640 1 -- 10.20.193.28:0/4277477660 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d0074a00 con 0x7f56d010a6d0 2026-02-20T03:15:03.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.467+0000 7f56cd7fa640 1 -- 10.20.193.28:0/4277477660 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f56c0005030 con 0x7f56d010a6d0 2026-02-20T03:15:03.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.469+0000 7f56cd7fa640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56a80b0f30 0x7f56a80b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.469+0000 7f56cd7fa640 1 -- 10.20.193.28:0/4277477660 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f56c0104920 con 0x7f56d010a6d0 2026-02-20T03:15:03.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.469+0000 7f56cf7fe640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56a80b0f30 0x7f56a80b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.469+0000 7f56cd7fa640 1 -- 10.20.193.28:0/4277477660 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f56c0048060 con 0x7f56d010a6d0 2026-02-20T03:15:03.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.470+0000 7f56cf7fe640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56a80b0f30 0x7f56a80b33f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56d0111b00 tx=0x7f56b800a430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.474 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.475 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.480+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7528199f90 con 0x7f7528108820 2026-02-20T03:15:03.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.480+0000 7f75167fc640 1 -- 10.20.193.28:0/744611402 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7524010040 con 0x7f7528108820 2026-02-20T03:15:03.487 INFO:teuthology.orchestra.run.trial028.stdout:60129542178 2026-02-20T03:15:03.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75040b0eb0 msgr2=0x7f75040b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75040b0eb0 0x7f75040b3370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7518004700 tx=0x7f7518009290 comp rx=0 tx=0).stop 2026-02-20T03:15:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528108820 msgr2=0x7f752810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528108820 0x7f752810d850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f752400ef30 tx=0x7f752400c560 comp rx=0 tx=0).stop 2026-02-20T03:15:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 shutdown_connections 2026-02-20T03:15:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75040b0eb0 0x7f75040b3370 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7528108820 0x7f752810d850 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75281030b0 0x7f752819de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 --2- 10.20.193.28:0/744611402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7528102710 0x7f752819d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.485+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 >> 10.20.193.28:0/744611402 conn(0x7f75280fe450 msgr2=0x7f7528075780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.486+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 shutdown_connections 2026-02-20T03:15:03.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.486+0000 7f752e3ab640 1 -- 10.20.193.28:0/744611402 wait complete. 2026-02-20T03:15:03.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.521+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3238010353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd5c0a5120 msgr2=0x7efd5c0a5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.521+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3238010353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd5c0a5120 0x7efd5c0a5500 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd5800dec0 tx=0x7efd58033300 comp rx=0 tx=0).stop 2026-02-20T03:15:03.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.521+0000 7efd6bb70640 1 -- 10.20.193.28:0/3238010353 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5800d0d0 con 0x7efd5c0a5120 2026-02-20T03:15:03.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.521+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3238010353 shutdown_connections 2026-02-20T03:15:03.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.521+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3238010353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd5c0aa080 0x7efd5c0b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.521+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3238010353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd5c0a5ad0 0x7efd5c0a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.521+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3238010353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd5c0a5120 0x7efd5c0a5500 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.521+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3238010353 >> 10.20.193.28:0/3238010353 conn(0x7efd5c01a770 msgr2=0x7efd5c01ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.521+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3238010353 shutdown_connections 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.522+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3238010353 wait complete. 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.522+0000 7efd6a8e7640 1 Processor -- start 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.522+0000 7efd6a8e7640 1 -- start start 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd6a8e7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd5c0a5120 0x7efd5c1456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd6a8e7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd5c0a5ad0 0x7efd5c145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd690e4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd5c0a5120 0x7efd5c1456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd690e4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd5c0a5120 0x7efd5c1456d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37882/0 (socket says 10.20.193.28:37882) 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd690e4640 1 -- 10.20.193.28:0/3683661265 learned_addr learned my addr 10.20.193.28:0/3683661265 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:03.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd5c0aa080 0x7efd5c149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd688e3640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd5c0a5ad0 0x7efd5c145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c0b4b00 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c0b4980 con 0x7efd5c0aa080 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.523+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c0b4c80 con 0x7efd5c0a5120 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.524+0000 7efd698e5640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd5c0aa080 0x7efd5c149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.524+0000 7efd688e3640 1 -- 10.20.193.28:0/3683661265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd5c0a5120 msgr2=0x7efd5c1456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.524+0000 7efd688e3640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd5c0a5120 0x7efd5c1456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.524+0000 7efd688e3640 1 -- 10.20.193.28:0/3683661265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd5c0aa080 msgr2=0x7efd5c149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.524+0000 7efd688e3640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd5c0aa080 0x7efd5c149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.524+0000 7efd688e3640 1 -- 10.20.193.28:0/3683661265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c14a680 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.524+0000 7efd698e5640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd5c0aa080 0x7efd5c149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:03.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.524+0000 7efd690e4640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd5c0a5120 0x7efd5c1456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.524+0000 7efd688e3640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd5c0a5ad0 0x7efd5c145c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd5c01be50 tx=0x7efd4c002b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.525+0000 7efd52ffd640 1 -- 10.20.193.28:0/3683661265 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c00eb00 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.525+0000 7efd52ffd640 1 -- 10.20.193.28:0/3683661265 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efd4c00eca0 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.525+0000 7efd52ffd640 1 -- 10.20.193.28:0/3683661265 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c00f620 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.525+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c14a970 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.527+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c13ea30 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.529+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5c0a6420 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.535+0000 7efd52ffd640 1 -- 10.20.193.28:0/3683661265 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7efd4c010430 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.537+0000 7efd52ffd640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efd380b1000 0x7efd380b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.537+0000 7efd52ffd640 1 -- 10.20.193.28:0/3683661265 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7efd4c0e1160 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.537+0000 7efd52ffd640 1 -- 10.20.193.28:0/3683661265 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7efd4c014070 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.541+0000 7efd690e4640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efd380b1000 0x7efd380b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.541+0000 7efd690e4640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efd380b1000 0x7efd380b34c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efd58032ee0 tx=0x7efd5800f010 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.550+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fdcac081160 con 0x7fdcac10e1e0 2026-02-20T03:15:03.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.550+0000 7fdca9ffb640 1 -- 10.20.193.28:0/817138254 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdca00ad040 con 0x7fdcac10e1e0 2026-02-20T03:15:03.553 INFO:teuthology.orchestra.run.trial028.stdout:201863462932 2026-02-20T03:15:03.555 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:03 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2286219294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-20T03:15:03.555 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:03 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3180298050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-20T03:15:03.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc880b0e30 msgr2=0x7fdc880b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc880b0e30 0x7fdc880b32f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdca4002790 tx=0x7fdca400c000 comp rx=0 tx=0).stop 2026-02-20T03:15:03.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdcac10e1e0 msgr2=0x7fdcac07fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdcac10e1e0 0x7fdcac07fef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdca000e900 tx=0x7fdca000edd0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 shutdown_connections 2026-02-20T03:15:03.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc880b0e30 0x7fdc880b32f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdcac10e1e0 0x7fdcac07fef0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdcac074d30 0x7fdcac0860f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 --2- 10.20.193.28:0/817138254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdcac074380 0x7fdcac085bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.553+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 >> 10.20.193.28:0/817138254 conn(0x7fdcac06ead0 msgr2=0x7fdcac072250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.554+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 shutdown_connections 2026-02-20T03:15:03.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.554+0000 7fdcb184f640 1 -- 10.20.193.28:0/817138254 wait complete. 2026-02-20T03:15:03.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.596+0000 7f56aeffd640 1 -- 10.20.193.28:0/4277477660 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f56d0111870 con 0x7f56d010a6d0 2026-02-20T03:15:03.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.596+0000 7f56cd7fa640 1 -- 10.20.193.28:0/4277477660 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f56c00ccda0 con 0x7f56d010a6d0 2026-02-20T03:15:03.599 INFO:teuthology.orchestra.run.trial028.stdout:111669149723 2026-02-20T03:15:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 -- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56a80b0f30 msgr2=0x7f56a80b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56a80b0f30 0x7f56a80b33f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56d0111b00 tx=0x7f56b800a430 comp rx=0 tx=0).stop 2026-02-20T03:15:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 -- 10.20.193.28:0/4277477660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 msgr2=0x7f56d0113290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 0x7f56d0113290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009b60 tx=0x7f56c002fdf0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 -- 10.20.193.28:0/4277477660 shutdown_connections 2026-02-20T03:15:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56a80b0f30 0x7f56a80b33f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56d0113b50 0x7f56d0110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56d010aff0 0x7f56d0110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 --2- 10.20.193.28:0/4277477660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56d010a6d0 0x7f56d0113290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 -- 10.20.193.28:0/4277477660 >> 10.20.193.28:0/4277477660 conn(0x7f56d006ec00 msgr2=0x7f56d0071260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.598+0000 7f56aeffd640 1 -- 10.20.193.28:0/4277477660 shutdown_connections 2026-02-20T03:15:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.599+0000 7f56aeffd640 1 -- 10.20.193.28:0/4277477660 wait complete. 2026-02-20T03:15:03.640 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705699 for osd.0 2026-02-20T03:15:03.640 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:03.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.639+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efd5c13ed20 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.639+0000 7efd52ffd640 1 -- 10.20.193.28:0/3683661265 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd4c0a9660 con 0x7efd5c0a5ad0 2026-02-20T03:15:03.643 INFO:teuthology.orchestra.run.trial028.stdout:81604378654 2026-02-20T03:15:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efd380b1000 msgr2=0x7efd380b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efd380b1000 0x7efd380b34c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efd58032ee0 tx=0x7efd5800f010 comp rx=0 tx=0).stop 2026-02-20T03:15:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd5c0a5ad0 msgr2=0x7efd5c145c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd5c0a5ad0 0x7efd5c145c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efd5c01be50 tx=0x7efd4c002b80 comp rx=0 tx=0).stop 2026-02-20T03:15:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 shutdown_connections 2026-02-20T03:15:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efd380b1000 0x7efd380b34c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd5c0aa080 0x7efd5c149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd5c0a5ad0 0x7efd5c145c10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 --2- 10.20.193.28:0/3683661265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd5c0a5120 0x7efd5c1456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 >> 10.20.193.28:0/3683661265 conn(0x7efd5c01a770 msgr2=0x7efd5c0a2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 shutdown_connections 2026-02-20T03:15:03.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.642+0000 7efd6a8e7640 1 -- 10.20.193.28:0/3683661265 wait complete. 2026-02-20T03:15:03.691 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.1 2026-02-20T03:15:03.691 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:03 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2286219294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-20T03:15:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:03 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3180298050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-20T03:15:03.794 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724568 got 167503724568 for osd.5 2026-02-20T03:15:03.795 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:03.831 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462933 got 201863462932 for osd.6 2026-02-20T03:15:03.831 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149724 got 111669149723 for osd.3 2026-02-20T03:15:03.832 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.837 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.837 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.839 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:03.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:03 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2286219294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-20T03:15:03.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:03 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3180298050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-20T03:15:03.856 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378655 got 81604378654 for osd.2 2026-02-20T03:15:03.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.890+0000 7f2bf5d45640 1 -- 10.20.193.28:0/820180565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf0109220 msgr2=0x7f2bf0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.890+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/820180565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf0109220 0x7f2bf0109660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80099b0 tx=0x7f2bd802f1b0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.892+0000 7f2bf5d45640 1 -- 10.20.193.28:0/820180565 shutdown_connections 2026-02-20T03:15:03.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.892+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/820180565 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bf0109ba0 0x7f2bf0115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.892+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/820180565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf0109220 0x7f2bf0109660 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.892+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/820180565 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bf010eef0 0x7f2bf010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.892+0000 7f2bf5d45640 1 -- 10.20.193.28:0/820180565 >> 10.20.193.28:0/820180565 conn(0x7f2bf0078600 msgr2=0x7f2bf007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.892+0000 7f2bf5d45640 1 -- 10.20.193.28:0/820180565 shutdown_connections 2026-02-20T03:15:03.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.892+0000 7f2bf5d45640 1 -- 10.20.193.28:0/820180565 wait complete. 2026-02-20T03:15:03.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2bf5d45640 1 Processor -- start 2026-02-20T03:15:03.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2bf5d45640 1 -- start start 2026-02-20T03:15:03.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2bf5d45640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bf0109220 0x7f2bf01a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2bf5d45640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bf0109ba0 0x7f2bf01a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2bf5d45640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf010eef0 0x7f2bf01a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2be7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bf0109ba0 0x7f2bf01a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2bf5d45640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf01190f0 con 0x7f2bf010eef0 2026-02-20T03:15:03.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2bf5d45640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf0118f70 con 0x7f2bf0109ba0 2026-02-20T03:15:03.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2be7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bf0109ba0 0x7f2bf01a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59672/0 (socket says 10.20.193.28:59672) 2026-02-20T03:15:03.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2be7fff640 1 -- 10.20.193.28:0/1210576799 learned_addr learned my addr 10.20.193.28:0/1210576799 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:03.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf0119270 con 0x7f2bf0109220 2026-02-20T03:15:03.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.893+0000 7f2bf5544640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf010eef0 0x7f2bf01a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2bf4d43640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bf0109220 0x7f2bf01a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2bf5544640 1 -- 10.20.193.28:0/1210576799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bf0109220 msgr2=0x7f2bf01a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2bf5544640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bf0109220 0x7f2bf01a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2bf5544640 1 -- 10.20.193.28:0/1210576799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bf0109ba0 msgr2=0x7f2bf01a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2bf5544640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bf0109ba0 0x7f2bf01a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2bf5544640 1 -- 10.20.193.28:0/1210576799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf01a65e0 con 0x7f2bf010eef0 2026-02-20T03:15:03.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2bf5544640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf010eef0 0x7f2bf01a5e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2bec004a60 tx=0x7f2bec004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2bf4d43640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bf0109220 0x7f2bf01a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:03.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2be5ffb640 1 -- 10.20.193.28:0/1210576799 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0090d0 con 0x7f2bf010eef0 2026-02-20T03:15:03.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2be5ffb640 1 -- 10.20.193.28:0/1210576799 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bec009270 con 0x7f2bf010eef0 2026-02-20T03:15:03.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.894+0000 7f2be5ffb640 1 -- 10.20.193.28:0/1210576799 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec013890 con 0x7f2bf010eef0 2026-02-20T03:15:03.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.896+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf01a6870 con 0x7f2bf010eef0 2026-02-20T03:15:03.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.896+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf01ae110 con 0x7f2bf010eef0 2026-02-20T03:15:03.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.896+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf010a580 con 0x7f2bf010eef0 2026-02-20T03:15:03.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.899+0000 7f2be5ffb640 1 -- 10.20.193.28:0/1210576799 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f2bec012070 con 0x7f2bf010eef0 2026-02-20T03:15:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.901+0000 7f2be5ffb640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bcc0b0f80 0x7f2bcc0b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.901+0000 7f2be5ffb640 1 -- 10.20.193.28:0/1210576799 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f2bec0e0640 con 0x7f2bf010eef0 2026-02-20T03:15:03.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.901+0000 7f2be5ffb640 1 -- 10.20.193.28:0/1210576799 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f2bec010070 con 0x7f2bf010eef0 2026-02-20T03:15:03.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.902+0000 7f2bf4d43640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bcc0b0f80 0x7f2bcc0b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.902+0000 7f2bf4d43640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bcc0b0f80 0x7f2bcc0b3440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006fd0 tx=0x7f2be0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.955+0000 7f9ee2feb640 1 -- 10.20.193.28:0/707940963 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9edc1030a0 msgr2=0x7f9edc10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.955+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/707940963 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9edc1030a0 0x7f9edc10f5d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800b0a0 tx=0x7f9ed802f450 comp rx=0 tx=0).stop 2026-02-20T03:15:03.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.955+0000 7f9ee2feb640 1 -- 10.20.193.28:0/707940963 shutdown_connections 2026-02-20T03:15:03.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.955+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/707940963 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9edc1030a0 0x7f9edc10f5d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.955+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/707940963 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9edc102700 0x7f9edc102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.955+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/707940963 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9edc108700 0x7f9edc108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.955+0000 7f9ee2feb640 1 -- 10.20.193.28:0/707940963 >> 10.20.193.28:0/707940963 conn(0x7f9edc0fe440 msgr2=0x7f9edc100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:03.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.956+0000 7f9ee2feb640 1 -- 10.20.193.28:0/707940963 shutdown_connections 2026-02-20T03:15:03.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.956+0000 7f9ee2feb640 1 -- 10.20.193.28:0/707940963 wait complete. 2026-02-20T03:15:03.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.957+0000 7f9ee2feb640 1 Processor -- start 2026-02-20T03:15:03.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.957+0000 7f9ee2feb640 1 -- start start 2026-02-20T03:15:03.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.957+0000 7f9ee2feb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9edc102700 0x7f9edc10c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.957+0000 7f9ee2feb640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9edc1030a0 0x7f9edc10cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.957+0000 7f9ee2feb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9edc108700 0x7f9edc10d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.957+0000 7f9ee2feb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc077190 con 0x7f9edc108700 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.957+0000 7f9ee2feb640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc077010 con 0x7f9edc1030a0 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.957+0000 7f9ee2feb640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc077310 con 0x7f9edc102700 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee1fe9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9edc102700 0x7f9edc10c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee1fe9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9edc102700 0x7f9edc10c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37918/0 (socket says 10.20.193.28:37918) 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee1fe9640 1 -- 10.20.193.28:0/377658914 learned_addr learned my addr 10.20.193.28:0/377658914 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee17e8640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9edc1030a0 0x7f9edc10cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee1fe9640 1 -- 10.20.193.28:0/377658914 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9edc1030a0 msgr2=0x7f9edc10cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee1fe9640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9edc1030a0 0x7f9edc10cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee1fe9640 1 -- 10.20.193.28:0/377658914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9edc108700 msgr2=0x7f9edc10d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:03.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee1fe9640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9edc108700 0x7f9edc10d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:03.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee1fe9640 1 -- 10.20.193.28:0/377658914 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc1ad750 con 0x7f9edc102700 2026-02-20T03:15:03.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.958+0000 7f9ee1fe9640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9edc102700 0x7f9edc10c7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00b780 tx=0x7f9ecc00bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:03.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.959+0000 7f9ecaffd640 1 -- 10.20.193.28:0/377658914 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc004480 con 0x7f9edc102700 2026-02-20T03:15:03.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.959+0000 7f9ecaffd640 1 -- 10.20.193.28:0/377658914 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9ecc010070 con 0x7f9edc102700 2026-02-20T03:15:03.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.959+0000 7f9ecaffd640 1 -- 10.20.193.28:0/377658914 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00caa0 con 0x7f9edc102700 2026-02-20T03:15:03.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.959+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc1ada40 con 0x7f9edc102700 2026-02-20T03:15:03.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.959+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc1adf30 con 0x7f9edc102700 2026-02-20T03:15:03.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.960+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc103e40 con 0x7f9edc102700 2026-02-20T03:15:03.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.963+0000 7f9ecaffd640 1 -- 10.20.193.28:0/377658914 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f9ecc01d070 con 0x7f9edc102700 2026-02-20T03:15:03.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.964+0000 7f9ecaffd640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9eb80b0f30 0x7f9eb80b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:03.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.964+0000 7f9ecaffd640 1 -- 10.20.193.28:0/377658914 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f9ecc0e0160 con 0x7f9edc102700 2026-02-20T03:15:03.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.965+0000 7f9ecaffd640 1 -- 10.20.193.28:0/377658914 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9ecc01a060 con 0x7f9edc102700 2026-02-20T03:15:03.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.965+0000 7f9ee17e8640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9eb80b0f30 0x7f9eb80b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:03.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.966+0000 7f9ee17e8640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9eb80b0f30 0x7f9eb80b33f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0005f10 tx=0x7f9ed0005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:04.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.998+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f2bf0110e00 con 0x7f2bf010eef0 2026-02-20T03:15:04.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:03.999+0000 7f2be5ffb640 1 -- 10.20.193.28:0/1210576799 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2bec0a8b40 con 0x7f2bf010eef0 2026-02-20T03:15:04.004 INFO:teuthology.orchestra.run.trial028.stdout:313532612620 2026-02-20T03:15:04.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.002+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bcc0b0f80 msgr2=0x7f2bcc0b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.002+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bcc0b0f80 0x7f2bcc0b3440 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006fd0 tx=0x7f2be0008040 comp rx=0 tx=0).stop 2026-02-20T03:15:04.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.002+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf010eef0 msgr2=0x7f2bf01a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.002+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf010eef0 0x7f2bf01a5e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2bec004a60 tx=0x7f2bec004a90 comp rx=0 tx=0).stop 2026-02-20T03:15:04.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.003+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 shutdown_connections 2026-02-20T03:15:04.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.003+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bcc0b0f80 0x7f2bcc0b3440 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.003+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bf010eef0 0x7f2bf01a5e60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.003+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bf0109ba0 0x7f2bf01a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.003+0000 7f2bf5d45640 1 --2- 10.20.193.28:0/1210576799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bf0109220 0x7f2bf01a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.003+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 >> 10.20.193.28:0/1210576799 conn(0x7f2bf0078600 msgr2=0x7f2bf0079f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.003+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 shutdown_connections 2026-02-20T03:15:04.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.003+0000 7f2bf5d45640 1 -- 10.20.193.28:0/1210576799 wait complete. 2026-02-20T03:15:04.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.038+0000 7f4d649a5640 1 -- 10.20.193.28:0/351431084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4d5c10aff0 msgr2=0x7f4d5c1134e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.038+0000 7f4d649a5640 1 --2- 10.20.193.28:0/351431084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4d5c10aff0 0x7f4d5c1134e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d54009a30 tx=0x7f4d5402f220 comp rx=0 tx=0).stop 2026-02-20T03:15:04.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.038+0000 7f4d649a5640 1 -- 10.20.193.28:0/351431084 shutdown_connections 2026-02-20T03:15:04.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.038+0000 7f4d649a5640 1 --2- 10.20.193.28:0/351431084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d5c113b50 0x7f4d5c115fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.038+0000 7f4d649a5640 1 --2- 10.20.193.28:0/351431084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4d5c10aff0 0x7f4d5c1134e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.038+0000 7f4d649a5640 1 --2- 10.20.193.28:0/351431084 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d5c10a6d0 0x7f4d5c10aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.038+0000 7f4d649a5640 1 -- 10.20.193.28:0/351431084 >> 10.20.193.28:0/351431084 conn(0x7f4d5c06ec00 msgr2=0x7f4d5c06f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.038+0000 7f4d649a5640 1 -- 10.20.193.28:0/351431084 shutdown_connections 2026-02-20T03:15:04.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.038+0000 7f4d649a5640 1 -- 10.20.193.28:0/351431084 wait complete. 2026-02-20T03:15:04.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/4072361945 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bb010a6d0 msgr2=0x7f3bb010aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/4072361945 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bb010a6d0 0x7f3bb010aab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4007570 tx=0x7f3ba402ff30 comp rx=0 tx=0).stop 2026-02-20T03:15:04.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f4d649a5640 1 Processor -- start 2026-02-20T03:15:04.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/4072361945 shutdown_connections 2026-02-20T03:15:04.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/4072361945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bb0113ab0 0x7f3bb0115f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/4072361945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3bb010aff0 0x7f3bb01134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/4072361945 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bb010a6d0 0x7f3bb010aab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/4072361945 >> 10.20.193.28:0/4072361945 conn(0x7f3bb006ed80 msgr2=0x7f3bb006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f4d649a5640 1 -- start start 2026-02-20T03:15:04.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.039+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/4072361945 shutdown_connections 2026-02-20T03:15:04.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.040+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/4072361945 wait complete. 2026-02-20T03:15:04.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.040+0000 7f3bb4a2f640 1 Processor -- start 2026-02-20T03:15:04.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.040+0000 7f3bb4a2f640 1 -- start start 2026-02-20T03:15:04.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d649a5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4d5c10a6d0 0x7f4d5c1aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d649a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d5c10aff0 0x7f4d5c1af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d649a5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d5c113b50 0x7f4d5c112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d649a5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c11b580 con 0x7f4d5c10aff0 2026-02-20T03:15:04.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d649a5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c11b400 con 0x7f4d5c10a6d0 2026-02-20T03:15:04.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d649a5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5c11b700 con 0x7f4d5c113b50 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d6271a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4d5c10a6d0 0x7f4d5c1aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d61f19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d5c10aff0 0x7f4d5c1af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d62f1b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d5c113b50 0x7f4d5c112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d61f19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d5c10aff0 0x7f4d5c1af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56774/0 (socket says 10.20.193.28:56774) 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.041+0000 7f4d61f19640 1 -- 10.20.193.28:0/4126471121 learned_addr learned my addr 10.20.193.28:0/4126471121 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d61f19640 1 -- 10.20.193.28:0/4126471121 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d5c113b50 msgr2=0x7f4d5c112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d61f19640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d5c113b50 0x7f4d5c112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d61f19640 1 -- 10.20.193.28:0/4126471121 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4d5c10a6d0 msgr2=0x7f4d5c1aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d61f19640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4d5c10a6d0 0x7f4d5c1aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d61f19640 1 -- 10.20.193.28:0/4126471121 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5c112ed0 con 0x7f4d5c10aff0 2026-02-20T03:15:04.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d61f19640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d5c10aff0 0x7f4d5c1af2c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d5402f730 tx=0x7f4d54004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:04.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f3bb4a2f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bb010a6d0 0x7f3bb01ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d477fe640 1 -- 10.20.193.28:0/4126471121 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54046070 con 0x7f4d5c10aff0 2026-02-20T03:15:04.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d477fe640 1 -- 10.20.193.28:0/4126471121 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4d54038c10 con 0x7f4d5c10aff0 2026-02-20T03:15:04.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d477fe640 1 -- 10.20.193.28:0/4126471121 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d54041d70 con 0x7f4d5c10aff0 2026-02-20T03:15:04.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f3bb4a2f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bb010aff0 0x7f3bb01abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f3bb4a2f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3bb0113ab0 0x7f3bb01a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f3bb4a2f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb0119220 con 0x7f3bb010a6d0 2026-02-20T03:15:04.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f3bb4a2f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb01190a0 con 0x7f3bb010aff0 2026-02-20T03:15:04.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f3bb4a2f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb01193a0 con 0x7f3bb0113ab0 2026-02-20T03:15:04.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.042+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5c113160 con 0x7f4d5c10aff0 2026-02-20T03:15:04.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.043+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5c1b6cb0 con 0x7f4d5c10aff0 2026-02-20T03:15:04.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.043+0000 7f3baed76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3bb0113ab0 0x7f3bb01a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.043+0000 7f3baed76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3bb0113ab0 0x7f3bb01a5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37966/0 (socket says 10.20.193.28:37966) 2026-02-20T03:15:04.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.043+0000 7f3baed76640 1 -- 10.20.193.28:0/3224821671 learned_addr learned my addr 10.20.193.28:0/3224821671 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:04.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.043+0000 7f3badd74640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bb010aff0 0x7f3bb01abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.043+0000 7f3bae575640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bb010a6d0 0x7f3bb01ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.044+0000 7f3baed76640 1 -- 10.20.193.28:0/3224821671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bb010aff0 msgr2=0x7f3bb01abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.044+0000 7f3baed76640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bb010aff0 0x7f3bb01abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.044+0000 7f3baed76640 1 -- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bb010a6d0 msgr2=0x7f3bb01ab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.044+0000 7f3baed76640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bb010a6d0 0x7f3bb01ab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.044+0000 7f3baed76640 1 -- 10.20.193.28:0/3224821671 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb01a6050 con 0x7f3bb0113ab0 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.044+0000 7f3badd74640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bb010aff0 0x7f3bb01abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.044+0000 7f3bae575640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bb010a6d0 0x7f3bb01ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.044+0000 7f3baed76640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3bb0113ab0 0x7f3bb01a5920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0007d70 tx=0x7f3ba000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.045+0000 7f3b977fe640 1 -- 10.20.193.28:0/3224821671 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0017070 con 0x7f3bb0113ab0 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.045+0000 7f3b977fe640 1 -- 10.20.193.28:0/3224821671 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3ba0004070 con 0x7f3bb0113ab0 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.045+0000 7f3b977fe640 1 -- 10.20.193.28:0/3224821671 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0012660 con 0x7f3bb0113ab0 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.045+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb01a6340 con 0x7f3bb0113ab0 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.045+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb01b2630 con 0x7f3bb0113ab0 2026-02-20T03:15:04.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.046+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bb010aab0 con 0x7f3bb0113ab0 2026-02-20T03:15:04.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.044+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d24005390 con 0x7f4d5c10aff0 2026-02-20T03:15:04.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.047+0000 7f4d477fe640 1 -- 10.20.193.28:0/4126471121 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f4d540414a0 con 0x7f4d5c10aff0 2026-02-20T03:15:04.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.047+0000 7fefbb305640 1 -- 10.20.193.28:0/153133546 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 msgr2=0x7fefb407bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.047+0000 7fefbb305640 1 --2- 10.20.193.28:0/153133546 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 0x7fefb407bd90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fefac009f90 tx=0x7fefac02f810 comp rx=0 tx=0).stop 2026-02-20T03:15:04.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.048+0000 7fefbb305640 1 -- 10.20.193.28:0/153133546 shutdown_connections 2026-02-20T03:15:04.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.048+0000 7fefbb305640 1 --2- 10.20.193.28:0/153133546 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 0x7fefb407bd90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.048+0000 7fefbb305640 1 --2- 10.20.193.28:0/153133546 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fefb410b080 0x7fefb4074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.048+0000 7fefbb305640 1 --2- 10.20.193.28:0/153133546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefb410a6d0 0x7fefb410aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.048+0000 7fefbb305640 1 -- 10.20.193.28:0/153133546 >> 10.20.193.28:0/153133546 conn(0x7fefb406ec00 msgr2=0x7fefb406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.048+0000 7fefbb305640 1 -- 10.20.193.28:0/153133546 shutdown_connections 2026-02-20T03:15:04.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.048+0000 7fefbb305640 1 -- 10.20.193.28:0/153133546 wait complete. 2026-02-20T03:15:04.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.048+0000 7f3b977fe640 1 -- 10.20.193.28:0/3224821671 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f3ba0002a60 con 0x7f3bb0113ab0 2026-02-20T03:15:04.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.049+0000 7f3b977fe640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b880b0f30 0x7f3b880b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.049+0000 7fefbb305640 1 Processor -- start 2026-02-20T03:15:04.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.049+0000 7f4d477fe640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d380b0f30 0x7f4d380b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.049+0000 7f3b977fe640 1 -- 10.20.193.28:0/3224821671 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f3ba00e0200 con 0x7f3bb0113ab0 2026-02-20T03:15:04.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.049+0000 7fefbb305640 1 -- start start 2026-02-20T03:15:04.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.050+0000 7fefbb305640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 0x7fefb4080630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.050+0000 7fefb907a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 0x7fefb4080630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.050+0000 7fefb907a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 0x7fefb4080630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37980/0 (socket says 10.20.193.28:37980) 2026-02-20T03:15:04.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.050+0000 7f3bae575640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b880b0f30 0x7f3b880b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.050+0000 7f4d477fe640 1 -- 10.20.193.28:0/4126471121 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f4d54104cd0 con 0x7f4d5c10aff0 2026-02-20T03:15:04.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.050+0000 7f4d6271a640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d380b0f30 0x7f4d380b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.050+0000 7f3b977fe640 1 -- 10.20.193.28:0/3224821671 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f3ba0050b20 con 0x7f3bb0113ab0 2026-02-20T03:15:04.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.051+0000 7f4d477fe640 1 -- 10.20.193.28:0/4126471121 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4d541050e0 con 0x7f4d5c10aff0 2026-02-20T03:15:04.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7fefbb305640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fefb410a6d0 0x7fefb4080b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7fefbb305640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefb410b080 0x7fefb41c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7fefb907a640 1 -- 10.20.193.28:0/3882961228 learned_addr learned my addr 10.20.193.28:0/3882961228 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:04.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fefb407f080 con 0x7fefb410b080 2026-02-20T03:15:04.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fefb407ef00 con 0x7fefb410a6d0 2026-02-20T03:15:04.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7f4d6271a640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d380b0f30 0x7f4d380b33f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d48007c20 tx=0x7f4d4800c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:04.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fefb407f200 con 0x7fefb40753e0 2026-02-20T03:15:04.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7fefb8879640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fefb410a6d0 0x7fefb4080b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7fefb987b640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefb410b080 0x7fefb41c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.053+0000 7fefb907a640 1 -- 10.20.193.28:0/3882961228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fefb410a6d0 msgr2=0x7fefb4080b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.053+0000 7fefb907a640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fefb410a6d0 0x7fefb4080b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.053+0000 7fefb907a640 1 -- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefb410b080 msgr2=0x7fefb41c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.053+0000 7fefb907a640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefb410b080 0x7fefb41c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.053+0000 7fefb907a640 1 -- 10.20.193.28:0/3882961228 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb41c78a0 con 0x7fefb40753e0 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.053+0000 7fefb987b640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefb410b080 0x7fefb41c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.053+0000 7fefb8879640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fefb410a6d0 0x7fefb4080b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.053+0000 7fefb907a640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 0x7fefb4080630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fefb00027e0 tx=0x7fefb0002cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.054+0000 7fefaa7fc640 1 -- 10.20.193.28:0/3882961228 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb000ed40 con 0x7fefb40753e0 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.054+0000 7fefaa7fc640 1 -- 10.20.193.28:0/3882961228 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fefb00108d0 con 0x7fefb40753e0 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.054+0000 7fefaa7fc640 1 -- 10.20.193.28:0/3882961228 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb000f7c0 con 0x7fefb40753e0 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.054+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb41c7b30 con 0x7fefb40753e0 2026-02-20T03:15:04.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.054+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb41c7ff0 con 0x7fefb40753e0 2026-02-20T03:15:04.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.052+0000 7f3bae575640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b880b0f30 0x7f3b880b33f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40040c0 tx=0x7f3ba403b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:04.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.054+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb40745c0 con 0x7fefb40753e0 2026-02-20T03:15:04.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.056+0000 7fefaa7fc640 1 -- 10.20.193.28:0/3882961228 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fefb0010a80 con 0x7fefb40753e0 2026-02-20T03:15:04.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.058+0000 7fefaa7fc640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef8c0b0e30 0x7fef8c0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.058+0000 7fefaa7fc640 1 -- 10.20.193.28:0/3882961228 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fefb00e14f0 con 0x7fefb40753e0 2026-02-20T03:15:04.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.059+0000 7fefb8879640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef8c0b0e30 0x7fef8c0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.059+0000 7fefb8879640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef8c0b0e30 0x7fef8c0b32f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fefb4081df0 tx=0x7fefa4009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:04.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.059+0000 7fefaa7fc640 1 -- 10.20.193.28:0/3882961228 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fefb0014030 con 0x7fefb40753e0 2026-02-20T03:15:04.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.065+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9edc10dd20 con 0x7f9edc102700 2026-02-20T03:15:04.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.065+0000 7f9ecaffd640 1 -- 10.20.193.28:0/377658914 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9ecc0a85e0 con 0x7f9edc102700 2026-02-20T03:15:04.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.066+0000 7f1291c13640 1 -- 10.20.193.28:0/1306559813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f128c101810 msgr2=0x7f128c101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.066+0000 7f1291c13640 1 --2- 10.20.193.28:0/1306559813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f128c101810 0x7f128c101bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1278009a30 tx=0x7f127802f2b0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.069 INFO:teuthology.orchestra.run.trial028.stdout:223338299410 2026-02-20T03:15:04.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.066+0000 7f1291c13640 1 -- 10.20.193.28:0/1306559813 shutdown_connections 2026-02-20T03:15:04.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.066+0000 7f1291c13640 1 --2- 10.20.193.28:0/1306559813 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f128c106c20 0x7f128c1070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.066+0000 7f1291c13640 1 --2- 10.20.193.28:0/1306559813 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f128c102130 0x7f128c106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.066+0000 7f1291c13640 1 --2- 10.20.193.28:0/1306559813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f128c101810 0x7f128c101bf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.066+0000 7f1291c13640 1 -- 10.20.193.28:0/1306559813 >> 10.20.193.28:0/1306559813 conn(0x7f128c0fd4c0 msgr2=0x7f128c0ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.066+0000 7f1291c13640 1 -- 10.20.193.28:0/1306559813 shutdown_connections 2026-02-20T03:15:04.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.067+0000 7f1291c13640 1 -- 10.20.193.28:0/1306559813 wait complete. 2026-02-20T03:15:04.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.068+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9eb80b0f30 msgr2=0x7f9eb80b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.068+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9eb80b0f30 0x7f9eb80b33f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0005f10 tx=0x7f9ed0005ea0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.068+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9edc102700 msgr2=0x7f9edc10c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.068+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9edc102700 0x7f9edc10c7f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00b780 tx=0x7f9ecc00bc50 comp rx=0 tx=0).stop 2026-02-20T03:15:04.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 shutdown_connections 2026-02-20T03:15:04.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9eb80b0f30 0x7f9eb80b33f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9edc108700 0x7f9edc10d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9edc1030a0 0x7f9edc10cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f9ee2feb640 1 --2- 10.20.193.28:0/377658914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9edc102700 0x7f9edc10c7f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 >> 10.20.193.28:0/377658914 conn(0x7f9edc0fe440 msgr2=0x7f9edc0fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f1291c13640 1 Processor -- start 2026-02-20T03:15:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 shutdown_connections 2026-02-20T03:15:04.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f1291c13640 1 -- start start 2026-02-20T03:15:04.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.069+0000 7f9ee2feb640 1 -- 10.20.193.28:0/377658914 wait complete. 2026-02-20T03:15:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.070+0000 7f1291c13640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f128c101810 0x7f128c1a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.070+0000 7f1291c13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f128c102130 0x7f128c1a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.071+0000 7f1291c13640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f128c106c20 0x7f128c1a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.071+0000 7f1291c13640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f128c119260 con 0x7f128c102130 2026-02-20T03:15:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.071+0000 7f1291c13640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f128c1190e0 con 0x7f128c106c20 2026-02-20T03:15:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.071+0000 7f1291c13640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f128c1193e0 con 0x7f128c101810 2026-02-20T03:15:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.070+0000 7f128b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f128c101810 0x7f128c1a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.071+0000 7f128b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f128c101810 0x7f128c1a73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38012/0 (socket says 10.20.193.28:38012) 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.071+0000 7f128b7fe640 1 -- 10.20.193.28:0/43456376 learned_addr learned my addr 10.20.193.28:0/43456376 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.071+0000 7f128bfff640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f128c106c20 0x7f128c1a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.071+0000 7f128affd640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f128c102130 0x7f128c1a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.072+0000 7f128bfff640 1 -- 10.20.193.28:0/43456376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f128c101810 msgr2=0x7f128c1a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.072+0000 7f128bfff640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f128c101810 0x7f128c1a73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.072+0000 7f128bfff640 1 -- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f128c102130 msgr2=0x7f128c1a7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.072+0000 7f128bfff640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f128c102130 0x7f128c1a7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.072+0000 7f128bfff640 1 -- 10.20.193.28:0/43456376 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c1a1d60 con 0x7f128c106c20 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.072+0000 7f128affd640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f128c102130 0x7f128c1a7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.072+0000 7f128bfff640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f128c106c20 0x7f128c1a1590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f128000ab40 tx=0x7f128000c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.072+0000 7f1288ff9640 1 -- 10.20.193.28:0/43456376 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280017020 con 0x7f128c106c20 2026-02-20T03:15:04.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.072+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128c1a2050 con 0x7f128c106c20 2026-02-20T03:15:04.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.073+0000 7f1288ff9640 1 -- 10.20.193.28:0/43456376 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f128000a0d0 con 0x7f128c106c20 2026-02-20T03:15:04.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.073+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128c1ae2a0 con 0x7f128c106c20 2026-02-20T03:15:04.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.073+0000 7f1288ff9640 1 -- 10.20.193.28:0/43456376 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280017020 con 0x7f128c106c20 2026-02-20T03:15:04.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.074+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128c106600 con 0x7f128c106c20 2026-02-20T03:15:04.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.075+0000 7f1288ff9640 1 -- 10.20.193.28:0/43456376 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f1280012070 con 0x7f128c106c20 2026-02-20T03:15:04.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.077+0000 7f1288ff9640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f125c0b1130 0x7f125c0b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:04.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.077+0000 7f1288ff9640 1 -- 10.20.193.28:0/43456376 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f12800df950 con 0x7f128c106c20 2026-02-20T03:15:04.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.078+0000 7f128b7fe640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f125c0b1130 0x7f125c0b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:04.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.079+0000 7f1288ff9640 1 -- 10.20.193.28:0/43456376 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f12800aba80 con 0x7f128c106c20 2026-02-20T03:15:04.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.079+0000 7f128b7fe640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f125c0b1130 0x7f125c0b35f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f12780097c0 tx=0x7f1278005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:04.115 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612621 got 313532612620 for osd.10 2026-02-20T03:15:04.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.160+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fefb41c8310 con 0x7fefb40753e0 2026-02-20T03:15:04.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.160+0000 7fefaa7fc640 1 -- 10.20.193.28:0/3882961228 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fefb00a9970 con 0x7fefb40753e0 2026-02-20T03:15:04.163 INFO:teuthology.orchestra.run.trial028.stdout:292057776142 2026-02-20T03:15:04.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.165+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f4d24005950 con 0x7f4d5c10aff0 2026-02-20T03:15:04.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.166+0000 7f4d477fe640 1 -- 10.20.193.28:0/4126471121 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4d540d0e90 con 0x7f4d5c10aff0 2026-02-20T03:15:04.168 INFO:teuthology.orchestra.run.trial028.stdout:257698037776 2026-02-20T03:15:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.167+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef8c0b0e30 msgr2=0x7fef8c0b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.167+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f3bb01b2800 con 0x7f3bb0113ab0 2026-02-20T03:15:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.167+0000 7fefbb305640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef8c0b0e30 0x7fef8c0b32f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fefb4081df0 tx=0x7fefa4009340 comp rx=0 tx=0).stop 2026-02-20T03:15:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.167+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 msgr2=0x7fefb4080630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.167+0000 7fefbb305640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 0x7fefb4080630 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fefb00027e0 tx=0x7fefb0002cb0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.167+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d380b0f30 msgr2=0x7f4d380b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f3b977fe640 1 -- 10.20.193.28:0/3224821671 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3ba00a8680 con 0x7f3bb0113ab0 2026-02-20T03:15:04.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f4d649a5640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d380b0f30 0x7f4d380b33f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d48007c20 tx=0x7f4d4800c040 comp rx=0 tx=0).stop 2026-02-20T03:15:04.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d5c10aff0 msgr2=0x7f4d5c1af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 shutdown_connections 2026-02-20T03:15:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7fefbb305640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef8c0b0e30 0x7fef8c0b32f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7fefbb305640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fefb410b080 0x7fefb41c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7fefbb305640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fefb410a6d0 0x7fefb4080b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7fefbb305640 1 --2- 10.20.193.28:0/3882961228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fefb40753e0 0x7fefb4080630 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 >> 10.20.193.28:0/3882961228 conn(0x7fefb406ec00 msgr2=0x7fefb4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f4d649a5640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d5c10aff0 0x7f4d5c1af2c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d5402f730 tx=0x7f4d54004570 comp rx=0 tx=0).stop 2026-02-20T03:15:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 shutdown_connections 2026-02-20T03:15:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7fefbb305640 1 -- 10.20.193.28:0/3882961228 wait complete. 2026-02-20T03:15:04.174 INFO:teuthology.orchestra.run.trial028.stdout:343597383690 2026-02-20T03:15:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 shutdown_connections 2026-02-20T03:15:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f4d649a5640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d380b0f30 0x7f4d380b33f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f4d649a5640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4d5c113b50 0x7f4d5c112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f4d649a5640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4d5c10aff0 0x7f4d5c1af2c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f4d649a5640 1 --2- 10.20.193.28:0/4126471121 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4d5c10a6d0 0x7f4d5c1aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.168+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 >> 10.20.193.28:0/4126471121 conn(0x7f4d5c06ec00 msgr2=0x7f4d5c0727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.169+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 shutdown_connections 2026-02-20T03:15:04.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.169+0000 7f4d649a5640 1 -- 10.20.193.28:0/4126471121 wait complete. 2026-02-20T03:15:04.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b880b0f30 msgr2=0x7f3b880b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b880b0f30 0x7f3b880b33f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40040c0 tx=0x7f3ba403b040 comp rx=0 tx=0).stop 2026-02-20T03:15:04.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3bb0113ab0 msgr2=0x7f3bb01a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3bb0113ab0 0x7f3bb01a5920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0007d70 tx=0x7f3ba000a430 comp rx=0 tx=0).stop 2026-02-20T03:15:04.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 shutdown_connections 2026-02-20T03:15:04.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b880b0f30 0x7f3b880b33f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3bb0113ab0 0x7f3bb01a5920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3bb010aff0 0x7f3bb01abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 --2- 10.20.193.28:0/3224821671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3bb010a6d0 0x7f3bb01ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 >> 10.20.193.28:0/3224821671 conn(0x7f3bb006ed80 msgr2=0x7f3bb00713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 shutdown_connections 2026-02-20T03:15:04.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.170+0000 7f3bb4a2f640 1 -- 10.20.193.28:0/3224821671 wait complete. 2026-02-20T03:15:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.177+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f128c1ae550 con 0x7f128c106c20 2026-02-20T03:15:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.178+0000 7f1288ff9640 1 -- 10.20.193.28:0/43456376 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f12800b0930 con 0x7f128c106c20 2026-02-20T03:15:04.181 INFO:teuthology.orchestra.run.trial028.stdout:146028888089 2026-02-20T03:15:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f125c0b1130 msgr2=0x7f125c0b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f125c0b1130 0x7f125c0b35f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f12780097c0 tx=0x7f1278005c50 comp rx=0 tx=0).stop 2026-02-20T03:15:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f128c106c20 msgr2=0x7f128c1a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f128c106c20 0x7f128c1a1590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f128000ab40 tx=0x7f128000c420 comp rx=0 tx=0).stop 2026-02-20T03:15:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 shutdown_connections 2026-02-20T03:15:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f125c0b1130 0x7f125c0b35f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f128c106c20 0x7f128c1a1590 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f128c102130 0x7f128c1a7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 --2- 10.20.193.28:0/43456376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f128c101810 0x7f128c1a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 >> 10.20.193.28:0/43456376 conn(0x7f128c0fd4c0 msgr2=0x7f128c0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 shutdown_connections 2026-02-20T03:15:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:04.180+0000 7f1291c13640 1 -- 10.20.193.28:0/43456376 wait complete. 2026-02-20T03:15:04.362 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299412 got 223338299410 for osd.7 2026-02-20T03:15:04.412 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888090 got 146028888089 for osd.4 2026-02-20T03:15:04.413 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383691 got 343597383690 for osd.11 2026-02-20T03:15:04.413 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037778 got 257698037776 for osd.8 2026-02-20T03:15:04.424 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776143 got 292057776142 for osd.9 2026-02-20T03:15:04.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/744611402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-20T03:15:04.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/817138254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T03:15:04.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4277477660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T03:15:04.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3683661265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T03:15:04.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1210576799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2026-02-20T03:15:04.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: pgmap v188: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2026-02-20T03:15:04.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/377658914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T03:15:04.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3882961228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2026-02-20T03:15:04.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4126471121' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2026-02-20T03:15:04.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3224821671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2026-02-20T03:15:04.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/43456376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T03:15:04.831 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-20T03:15:04.832 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/744611402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/817138254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4277477660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3683661265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1210576799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: pgmap v188: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/377658914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3882961228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4126471121' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3224821671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2026-02-20T03:15:04.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/43456376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T03:15:04.857 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-20T03:15:04.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/744611402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/817138254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4277477660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3683661265' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1210576799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: pgmap v188: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 8.2 KiB/s wr, 15 op/s 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/377658914' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3882961228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4126471121' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3224821671' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2026-02-20T03:15:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/43456376' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T03:15:05.116 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-20T03:15:05.134 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:05.135 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:05.179 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:05.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.323+0000 7f46890ef640 1 -- 10.20.193.28:0/3453536818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841065d0 msgr2=0x7f4684075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.323+0000 7f46890ef640 1 --2- 10.20.193.28:0/3453536818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841065d0 0x7f4684075410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4670009a30 tx=0x7f467002f2b0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.323+0000 7f46890ef640 1 -- 10.20.193.28:0/3453536818 shutdown_connections 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.323+0000 7f46890ef640 1 --2- 10.20.193.28:0/3453536818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46841134d0 0x7f4684115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.323+0000 7f46890ef640 1 --2- 10.20.193.28:0/3453536818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4684075950 0x7f4684075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.323+0000 7f46890ef640 1 --2- 10.20.193.28:0/3453536818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841065d0 0x7f4684075410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.323+0000 7f46890ef640 1 -- 10.20.193.28:0/3453536818 >> 10.20.193.28:0/3453536818 conn(0x7f46840fe440 msgr2=0x7f4684100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.323+0000 7f46890ef640 1 -- 10.20.193.28:0/3453536818 shutdown_connections 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.323+0000 7f46890ef640 1 -- 10.20.193.28:0/3453536818 wait complete. 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.324+0000 7f46890ef640 1 Processor -- start 2026-02-20T03:15:05.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.324+0000 7f46890ef640 1 -- start start 2026-02-20T03:15:05.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.324+0000 7f46890ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4684075950 0x7f4684074670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.324+0000 7f46890ef640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46841065d0 0x7f4684074bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.324+0000 7f46890ef640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841134d0 0x7f468406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.324+0000 7f46890ef640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4684119100 con 0x7f4684075950 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.324+0000 7f46890ef640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4684118f80 con 0x7f46841134d0 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.324+0000 7f46890ef640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4684119280 con 0x7f46841065d0 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46837fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46841065d0 0x7f4684074bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f4683fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4684075950 0x7f4684074670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46888ee640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841134d0 0x7f468406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46888ee640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841134d0 0x7f468406d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59784/0 (socket says 10.20.193.28:59784) 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46888ee640 1 -- 10.20.193.28:0/3315001564 learned_addr learned my addr 10.20.193.28:0/3315001564 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46888ee640 1 -- 10.20.193.28:0/3315001564 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46841065d0 msgr2=0x7f4684074bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46888ee640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46841065d0 0x7f4684074bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46888ee640 1 -- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4684075950 msgr2=0x7f4684074670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46888ee640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4684075950 0x7f4684074670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46888ee640 1 -- 10.20.193.28:0/3315001564 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468406e0e0 con 0x7f46841134d0 2026-02-20T03:15:05.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f4683fff640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4684075950 0x7f4684074670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:05.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f46888ee640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841134d0 0x7f468406d7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f467800e1c0 tx=0x7f467800e690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f118f577640 1 -- 10.20.193.28:0/1438459487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1190104980 msgr2=0x7f1190104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f118f577640 1 --2- 10.20.193.28:0/1438459487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1190104980 0x7f1190104de0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1178009a60 tx=0x7f117802f270 comp rx=0 tx=0).stop 2026-02-20T03:15:05.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f118f577640 1 -- 10.20.193.28:0/1438459487 shutdown_connections 2026-02-20T03:15:05.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f118f577640 1 --2- 10.20.193.28:0/1438459487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1190105320 0x7f1190111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f118f577640 1 --2- 10.20.193.28:0/1438459487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1190104980 0x7f1190104de0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f118f577640 1 --2- 10.20.193.28:0/1438459487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f119010a980 0x7f119010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f118f577640 1 -- 10.20.193.28:0/1438459487 >> 10.20.193.28:0/1438459487 conn(0x7f1190100680 msgr2=0x7f1190102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f118f577640 1 -- 10.20.193.28:0/1438459487 shutdown_connections 2026-02-20T03:15:05.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.325+0000 7f118f577640 1 -- 10.20.193.28:0/1438459487 wait complete. 2026-02-20T03:15:05.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118f577640 1 Processor -- start 2026-02-20T03:15:05.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118f577640 1 -- start start 2026-02-20T03:15:05.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f46817fa640 1 -- 10.20.193.28:0/3315001564 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678019070 con 0x7f46841134d0 2026-02-20T03:15:05.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f46817fa640 1 -- 10.20.193.28:0/3315001564 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f467800ee50 con 0x7f46841134d0 2026-02-20T03:15:05.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f46817fa640 1 -- 10.20.193.28:0/3315001564 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46780149a0 con 0x7f46841134d0 2026-02-20T03:15:05.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468406e370 con 0x7f46841134d0 2026-02-20T03:15:05.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4684072370 con 0x7f46841134d0 2026-02-20T03:15:05.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4648005390 con 0x7f46841134d0 2026-02-20T03:15:05.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118f577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1190104980 0x7f119019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1190105320 0x7f119019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f119010a980 0x7f11901a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1190114c40 con 0x7f119010a980 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118f577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1190114ac0 con 0x7f1190104980 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118f577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1190114dc0 con 0x7f1190105320 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f119010a980 0x7f11901a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f119010a980 0x7f11901a19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56830/0 (socket says 10.20.193.28:56830) 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118ed76640 1 -- 10.20.193.28:0/581492440 learned_addr learned my addr 10.20.193.28:0/581492440 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118dd74640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1190105320 0x7f119019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.326+0000 7f118e575640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1190104980 0x7f119019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f118dd74640 1 -- 10.20.193.28:0/581492440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1190104980 msgr2=0x7f119019d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f118dd74640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1190104980 0x7f119019d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f118dd74640 1 -- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f119010a980 msgr2=0x7f11901a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f118dd74640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f119010a980 0x7f11901a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f118dd74640 1 -- 10.20.193.28:0/581492440 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11901a2130 con 0x7f1190105320 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f118ed76640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f119010a980 0x7f11901a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f118dd74640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1190105320 0x7f119019d620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1178009950 tx=0x7f117802fcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f116f7fe640 1 -- 10.20.193.28:0/581492440 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117802fe30 con 0x7f1190105320 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f116f7fe640 1 -- 10.20.193.28:0/581492440 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1178005030 con 0x7f1190105320 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11901a23c0 con 0x7f1190105320 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.327+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119006c890 con 0x7f1190105320 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.328+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11901060c0 con 0x7f1190105320 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.328+0000 7f116f7fe640 1 -- 10.20.193.28:0/581492440 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1178004480 con 0x7f1190105320 2026-02-20T03:15:05.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.329+0000 7f46817fa640 1 -- 10.20.193.28:0/3315001564 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f4678004720 con 0x7f46841134d0 2026-02-20T03:15:05.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.330+0000 7f116f7fe640 1 -- 10.20.193.28:0/581492440 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f11780048c0 con 0x7f1190105320 2026-02-20T03:15:05.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.331+0000 7f46817fa640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46640b0eb0 0x7f46640b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.331+0000 7f46817fa640 1 -- 10.20.193.28:0/3315001564 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f46780e0820 con 0x7f46841134d0 2026-02-20T03:15:05.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.331+0000 7f4683fff640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46640b0eb0 0x7f46640b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.331+0000 7f46817fa640 1 -- 10.20.193.28:0/3315001564 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4678010040 con 0x7f46841134d0 2026-02-20T03:15:05.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.332+0000 7f116f7fe640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11600b0e30 0x7f11600b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.332+0000 7f4683fff640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46640b0eb0 0x7f46640b3370 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f46700097c0 tx=0x7f4670005810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.332+0000 7f116f7fe640 1 -- 10.20.193.28:0/581492440 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f1178104d00 con 0x7f1190105320 2026-02-20T03:15:05.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.332+0000 7f116f7fe640 1 -- 10.20.193.28:0/581492440 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1178048070 con 0x7f1190105320 2026-02-20T03:15:05.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.332+0000 7f118e575640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11600b0e30 0x7f11600b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.333+0000 7f118e575640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11600b0e30 0x7f11600b32f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1184005fd0 tx=0x7f1184005e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.357+0000 7ffae2361640 1 -- 10.20.193.28:0/2877708593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 msgr2=0x7ffadc102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.357+0000 7ffae2361640 1 --2- 10.20.193.28:0/2877708593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 0x7ffadc102b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009a30 tx=0x7ffad002f220 comp rx=0 tx=0).stop 2026-02-20T03:15:05.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.357+0000 7ffae2361640 1 -- 10.20.193.28:0/2877708593 shutdown_connections 2026-02-20T03:15:05.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.357+0000 7ffae2361640 1 --2- 10.20.193.28:0/2877708593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffadc1030a0 0x7ffadc10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.357+0000 7ffae2361640 1 --2- 10.20.193.28:0/2877708593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 0x7ffadc102b60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.357+0000 7ffae2361640 1 --2- 10.20.193.28:0/2877708593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffadc108700 0x7ffadc108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.357+0000 7ffae2361640 1 -- 10.20.193.28:0/2877708593 >> 10.20.193.28:0/2877708593 conn(0x7ffadc0fe440 msgr2=0x7ffadc100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.357+0000 7ffae2361640 1 -- 10.20.193.28:0/2877708593 shutdown_connections 2026-02-20T03:15:05.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.357+0000 7ffae2361640 1 -- 10.20.193.28:0/2877708593 wait complete. 2026-02-20T03:15:05.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.358+0000 7ffae2361640 1 Processor -- start 2026-02-20T03:15:05.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.358+0000 7ffae2361640 1 -- start start 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.358+0000 7ffae2361640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 0x7ffadc10e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.358+0000 7ffae2361640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffadc1030a0 0x7ffadc10ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.358+0000 7ffae2361640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffadc108700 0x7ffadc1a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.358+0000 7ffae2361640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc112930 con 0x7ffadc1030a0 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.358+0000 7ffae2361640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc1127b0 con 0x7ffadc102700 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.358+0000 7ffae2361640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc112ab0 con 0x7ffadc108700 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae135f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 0x7ffadc10e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae135f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 0x7ffadc10e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59810/0 (socket says 10.20.193.28:59810) 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae135f640 1 -- 10.20.193.28:0/3093449750 learned_addr learned my addr 10.20.193.28:0/3093449750 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:05.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae0b5e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffadc1030a0 0x7ffadc10ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae1b60640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffadc108700 0x7ffadc1a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae135f640 1 -- 10.20.193.28:0/3093449750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffadc108700 msgr2=0x7ffadc1a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae135f640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffadc108700 0x7ffadc1a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae135f640 1 -- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffadc1030a0 msgr2=0x7ffadc10ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae135f640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffadc1030a0 0x7ffadc10ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae135f640 1 -- 10.20.193.28:0/3093449750 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffadc1a65a0 con 0x7ffadc102700 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae0b5e640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffadc1030a0 0x7ffadc10ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.359+0000 7ffae135f640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 0x7ffadc10e910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0027e0 tx=0x7ffacc002cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.360+0000 7ffaca7fc640 1 -- 10.20.193.28:0/3093449750 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00ed40 con 0x7ffadc102700 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.360+0000 7ffaca7fc640 1 -- 10.20.193.28:0/3093449750 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffacc0108d0 con 0x7ffadc102700 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.360+0000 7ffaca7fc640 1 -- 10.20.193.28:0/3093449750 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00f7c0 con 0x7ffadc102700 2026-02-20T03:15:05.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.360+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffadc1a6890 con 0x7ffadc102700 2026-02-20T03:15:05.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.360+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffadc1ae0d0 con 0x7ffadc102700 2026-02-20T03:15:05.365 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-20T03:15:05.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.360+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffadc103e40 con 0x7ffadc102700 2026-02-20T03:15:05.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.362+0000 7ffaca7fc640 1 -- 10.20.193.28:0/3093449750 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7ffacc010a80 con 0x7ffadc102700 2026-02-20T03:15:05.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.364+0000 7ffaca7fc640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffab80b0eb0 0x7ffab80b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.364+0000 7ffaca7fc640 1 -- 10.20.193.28:0/3093449750 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ffacc0e1340 con 0x7ffadc102700 2026-02-20T03:15:05.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.364+0000 7ffaca7fc640 1 -- 10.20.193.28:0/3093449750 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ffacc014030 con 0x7ffadc102700 2026-02-20T03:15:05.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.364+0000 7ffae0b5e640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffab80b0eb0 0x7ffab80b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.365+0000 7ffae0b5e640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffab80b0eb0 0x7ffab80b3370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffad00040c0 tx=0x7ffad00057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.397 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:05.413 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-20T03:15:05.414 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-20T03:15:05.414 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-20T03:15:05.425 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-20T03:15:05.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.426+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4648005950 con 0x7f46841134d0 2026-02-20T03:15:05.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.427+0000 7f46817fa640 1 -- 10.20.193.28:0/3315001564 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f46780a8ca0 con 0x7f46841134d0 2026-02-20T03:15:05.431 INFO:teuthology.orchestra.run.trial028.stdout:201863462934 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.430+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46640b0eb0 msgr2=0x7f46640b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.430+0000 7f46890ef640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46640b0eb0 0x7f46640b3370 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f46700097c0 tx=0x7f4670005810 comp rx=0 tx=0).stop 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.430+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841134d0 msgr2=0x7f468406d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.430+0000 7f46890ef640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841134d0 0x7f468406d7d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f467800e1c0 tx=0x7f467800e690 comp rx=0 tx=0).stop 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.431+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 shutdown_connections 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.431+0000 7f46890ef640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46640b0eb0 0x7f46640b3370 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.431+0000 7f46890ef640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46841134d0 0x7f468406d7d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.431+0000 7f46890ef640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f46841065d0 0x7f4684074bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.431+0000 7f46890ef640 1 --2- 10.20.193.28:0/3315001564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4684075950 0x7f4684074670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.431+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 >> 10.20.193.28:0/3315001564 conn(0x7f46840fe440 msgr2=0x7f4684114c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.431+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 shutdown_connections 2026-02-20T03:15:05.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.431+0000 7f46890ef640 1 -- 10.20.193.28:0/3315001564 wait complete. 2026-02-20T03:15:05.444 INFO:teuthology.orchestra.run.trial028.stdout:111669149724 2026-02-20T03:15:05.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.439+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f119010c8f0 con 0x7f1190105320 2026-02-20T03:15:05.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.439+0000 7f116f7fe640 1 -- 10.20.193.28:0/581492440 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f11780cd1e0 con 0x7f1190105320 2026-02-20T03:15:05.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11600b0e30 msgr2=0x7f11600b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11600b0e30 0x7f11600b32f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1184005fd0 tx=0x7f1184005e10 comp rx=0 tx=0).stop 2026-02-20T03:15:05.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1190105320 msgr2=0x7f119019d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1190105320 0x7f119019d620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1178009950 tx=0x7f117802fcc0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 shutdown_connections 2026-02-20T03:15:05.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11600b0e30 0x7f11600b32f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f119010a980 0x7f11901a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1190105320 0x7f119019d620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 --2- 10.20.193.28:0/581492440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1190104980 0x7f119019d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 >> 10.20.193.28:0/581492440 conn(0x7f1190100680 msgr2=0x7f1190101040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.442+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 shutdown_connections 2026-02-20T03:15:05.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.443+0000 7f118f577640 1 -- 10.20.193.28:0/581492440 wait complete. 2026-02-20T03:15:05.464 INFO:teuthology.orchestra.run.trial028.stdout:81604378655 2026-02-20T03:15:05.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.460+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ffadc102b60 con 0x7ffadc102700 2026-02-20T03:15:05.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.461+0000 7ffaca7fc640 1 -- 10.20.193.28:0/3093449750 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffadc102b60 con 0x7ffadc102700 2026-02-20T03:15:05.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.464+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffab80b0eb0 msgr2=0x7ffab80b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.464+0000 7ffae2361640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffab80b0eb0 0x7ffab80b3370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffad00040c0 tx=0x7ffad00057d0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.464+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 msgr2=0x7ffadc10e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.464+0000 7ffae2361640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 0x7ffadc10e910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0027e0 tx=0x7ffacc002cb0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.464+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 shutdown_connections 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.465+0000 7ffae2361640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffab80b0eb0 0x7ffab80b3370 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.465+0000 7ffae2361640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffadc108700 0x7ffadc1a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.465+0000 7ffae2361640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffadc1030a0 0x7ffadc10ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.465+0000 7ffae2361640 1 --2- 10.20.193.28:0/3093449750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffadc102700 0x7ffadc10e910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.465+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 >> 10.20.193.28:0/3093449750 conn(0x7ffadc0fe440 msgr2=0x7ffadc0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.465+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 shutdown_connections 2026-02-20T03:15:05.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.465+0000 7ffae2361640 1 -- 10.20.193.28:0/3093449750 wait complete. 2026-02-20T03:15:05.571 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462933 got 201863462934 for osd.6 2026-02-20T03:15:05.571 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:05.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:05 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3315001564' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T03:15:05.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:05 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/581492440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T03:15:05.672 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:05 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3093449750' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T03:15:05.696 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378655 got 81604378655 for osd.2 2026-02-20T03:15:05.696 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:05.742 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149724 got 111669149724 for osd.3 2026-02-20T03:15:05.742 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:05.765 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.771+0000 7fca005fe640 1 -- 10.20.193.28:0/3843405895 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9f8104e10 msgr2=0x7fc9f81051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.771+0000 7fca005fe640 1 --2- 10.20.193.28:0/3843405895 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9f8104e10 0x7fc9f81051f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009a30 tx=0x7fc9e802f220 comp rx=0 tx=0).stop 2026-02-20T03:15:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.772+0000 7fca005fe640 1 -- 10.20.193.28:0/3843405895 shutdown_connections 2026-02-20T03:15:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.772+0000 7fca005fe640 1 --2- 10.20.193.28:0/3843405895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9f8109ef0 0x7fc9f8111a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.772+0000 7fca005fe640 1 --2- 10.20.193.28:0/3843405895 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9f81057c0 0x7fc9f81097c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.772+0000 7fca005fe640 1 --2- 10.20.193.28:0/3843405895 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9f8104e10 0x7fc9f81051f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.772+0000 7fca005fe640 1 -- 10.20.193.28:0/3843405895 >> 10.20.193.28:0/3843405895 conn(0x7fc9f80787c0 msgr2=0x7fc9f807abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.773+0000 7fca005fe640 1 -- 10.20.193.28:0/3843405895 shutdown_connections 2026-02-20T03:15:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.773+0000 7fca005fe640 1 -- 10.20.193.28:0/3843405895 wait complete. 2026-02-20T03:15:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.773+0000 7fca005fe640 1 Processor -- start 2026-02-20T03:15:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.774+0000 7fca005fe640 1 -- start start 2026-02-20T03:15:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.774+0000 7fca005fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9f8104e10 0x7fc9f819d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.774+0000 7fca005fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9f81057c0 0x7fc9f819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.774+0000 7fca005fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9f8109ef0 0x7fc9f81a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.774+0000 7fca005fe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f8114dc0 con 0x7fc9f81057c0 2026-02-20T03:15:05.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.774+0000 7fca005fe640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f8114c40 con 0x7fc9f8109ef0 2026-02-20T03:15:05.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.774+0000 7fca005fe640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f8114f40 con 0x7fc9f8104e10 2026-02-20T03:15:05.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fe373640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9f8104e10 0x7fc9f819d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fe373640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9f8104e10 0x7fc9f819d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38094/0 (socket says 10.20.193.28:38094) 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fe373640 1 -- 10.20.193.28:0/609209363 learned_addr learned my addr 10.20.193.28:0/609209363 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9feb74640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9f8109ef0 0x7fc9f81a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fdb72640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9f81057c0 0x7fc9f819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fe373640 1 -- 10.20.193.28:0/609209363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9f8109ef0 msgr2=0x7fc9f81a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fe373640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9f8109ef0 0x7fc9f81a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fe373640 1 -- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9f81057c0 msgr2=0x7fc9f819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fe373640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9f81057c0 0x7fc9f819d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fe373640 1 -- 10.20.193.28:0/609209363 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f81a2230 con 0x7fc9f8104e10 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9feb74640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9f8109ef0 0x7fc9f81a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:05.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.775+0000 7fc9fe373640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9f8104e10 0x7fc9f819d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9e802f730 tx=0x7fc9e8004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.776+0000 7fc9df7fe640 1 -- 10.20.193.28:0/609209363 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004550 con 0x7fc9f8104e10 2026-02-20T03:15:05.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.776+0000 7fc9df7fe640 1 -- 10.20.193.28:0/609209363 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc9e8038e20 con 0x7fc9f8104e10 2026-02-20T03:15:05.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.776+0000 7fc9df7fe640 1 -- 10.20.193.28:0/609209363 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004c20 con 0x7fc9f8104e10 2026-02-20T03:15:05.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.776+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f81a24c0 con 0x7fc9f8104e10 2026-02-20T03:15:05.781 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:05.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.776+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f81a9d60 con 0x7fc9f8104e10 2026-02-20T03:15:05.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.777+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f81051f0 con 0x7fc9f8104e10 2026-02-20T03:15:05.781 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:05.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.778+0000 7fc9df7fe640 1 -- 10.20.193.28:0/609209363 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fc9e8005340 con 0x7fc9f8104e10 2026-02-20T03:15:05.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.780+0000 7fc9df7fe640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9d40b0eb0 0x7fc9d40b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.780+0000 7fc9df7fe640 1 -- 10.20.193.28:0/609209363 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fc9e8105210 con 0x7fc9f8104e10 2026-02-20T03:15:05.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.780+0000 7fc9fdb72640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9d40b0eb0 0x7fc9d40b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.781+0000 7fc9fdb72640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9d40b0eb0 0x7fc9d40b3370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc9f807ad10 tx=0x7fc9ec0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.782+0000 7fc9df7fe640 1 -- 10.20.193.28:0/609209363 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc9e8047060 con 0x7fc9f8104e10 2026-02-20T03:15:05.808 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:05.821 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:05 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3315001564' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T03:15:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:05 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/581492440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T03:15:05.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:05 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3093449750' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T03:15:05.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.879+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fc9f810caf0 con 0x7fc9f8104e10 2026-02-20T03:15:05.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.879+0000 7fc9df7fe640 1 -- 10.20.193.28:0/609209363 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc9e80cd690 con 0x7fc9f8104e10 2026-02-20T03:15:05.882 INFO:teuthology.orchestra.run.trial028.stdout:313532612621 2026-02-20T03:15:05.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.882+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9d40b0eb0 msgr2=0x7fc9d40b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.882+0000 7fca005fe640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9d40b0eb0 0x7fc9d40b3370 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc9f807ad10 tx=0x7fc9ec0073d0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.882+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9f8104e10 msgr2=0x7fc9f819d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.882+0000 7fca005fe640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9f8104e10 0x7fc9f819d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc9e802f730 tx=0x7fc9e8004360 comp rx=0 tx=0).stop 2026-02-20T03:15:05.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.882+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 shutdown_connections 2026-02-20T03:15:05.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.882+0000 7fca005fe640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9d40b0eb0 0x7fc9d40b3370 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.882+0000 7fca005fe640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9f8109ef0 0x7fc9f81a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.882+0000 7fca005fe640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9f81057c0 0x7fc9f819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.882+0000 7fca005fe640 1 --2- 10.20.193.28:0/609209363 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9f8104e10 0x7fc9f819d1e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.883+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 >> 10.20.193.28:0/609209363 conn(0x7fc9f80787c0 msgr2=0x7fc9f8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.883+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 shutdown_connections 2026-02-20T03:15:05.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.883+0000 7fca005fe640 1 -- 10.20.193.28:0/609209363 wait complete. 2026-02-20T03:15:05.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:05 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3315001564' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-20T03:15:05.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:05 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/581492440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-20T03:15:05.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:05 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3093449750' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.978+0000 7f307f42e640 1 -- 10.20.193.28:0/3652114844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f30700096f0 msgr2=0x7f30700a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.978+0000 7f307f42e640 1 --2- 10.20.193.28:0/3652114844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f30700096f0 0x7f30700a6300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f306c009a30 tx=0x7f306c02f220 comp rx=0 tx=0).stop 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.977+0000 7f6344a06640 1 -- 10.20.193.28:0/2094673608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6340103270 msgr2=0x7f634010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.977+0000 7f6344a06640 1 --2- 10.20.193.28:0/2094673608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6340103270 0x7f634010f7a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6330009fc0 tx=0x7f633002f390 comp rx=0 tx=0).stop 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.977+0000 7f6344a06640 1 -- 10.20.193.28:0/2094673608 shutdown_connections 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.977+0000 7f6344a06640 1 --2- 10.20.193.28:0/2094673608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6340103270 0x7f634010f7a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.977+0000 7f6344a06640 1 --2- 10.20.193.28:0/2094673608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f63401028d0 0x7f6340102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.977+0000 7f6344a06640 1 --2- 10.20.193.28:0/2094673608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63401088d0 0x7f6340108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.977+0000 7f6344a06640 1 -- 10.20.193.28:0/2094673608 >> 10.20.193.28:0/2094673608 conn(0x7f63400fe5d0 msgr2=0x7f63401009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.978+0000 7f6344a06640 1 -- 10.20.193.28:0/2094673608 shutdown_connections 2026-02-20T03:15:05.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.979+0000 7f6344a06640 1 -- 10.20.193.28:0/2094673608 wait complete. 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.979+0000 7f307f42e640 1 -- 10.20.193.28:0/3652114844 shutdown_connections 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.979+0000 7f307f42e640 1 --2- 10.20.193.28:0/3652114844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30700a6840 0x7f30700a8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.979+0000 7f307f42e640 1 --2- 10.20.193.28:0/3652114844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f30700096f0 0x7f30700a6300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.979+0000 7f307f42e640 1 --2- 10.20.193.28:0/3652114844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3070008dd0 0x7f30700091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.979+0000 7f307f42e640 1 -- 10.20.193.28:0/3652114844 >> 10.20.193.28:0/3652114844 conn(0x7f3070093620 msgr2=0x7f3070095a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.979+0000 7f307f42e640 1 -- 10.20.193.28:0/3652114844 shutdown_connections 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.980+0000 7f6344a06640 1 Processor -- start 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.980+0000 7f6344a06640 1 -- start start 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.979+0000 7f307f42e640 1 -- 10.20.193.28:0/3652114844 wait complete. 2026-02-20T03:15:05.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.980+0000 7f307f42e640 1 Processor -- start 2026-02-20T03:15:05.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.980+0000 7f307f42e640 1 -- start start 2026-02-20T03:15:05.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f6344a06640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f63401028d0 0x7f634019fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f6344a06640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6340103270 0x7f634019ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f6344a06640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63401088d0 0x7f6340198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f6344a06640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63401108b0 con 0x7f6340103270 2026-02-20T03:15:05.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f6344a06640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6340110730 con 0x7f63401088d0 2026-02-20T03:15:05.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f6344a06640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6340110a30 con 0x7f63401028d0 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6340103270 0x7f634019ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6340103270 0x7f634019ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56884/0 (socket says 10.20.193.28:56884) 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633dd74640 1 -- 10.20.193.28:0/2050980220 learned_addr learned my addr 10.20.193.28:0/2050980220 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633ed76640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63401088d0 0x7f6340198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633e575640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f63401028d0 0x7f634019fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633dd74640 1 -- 10.20.193.28:0/2050980220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f63401028d0 msgr2=0x7f634019fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633dd74640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f63401028d0 0x7f634019fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633dd74640 1 -- 10.20.193.28:0/2050980220 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63401088d0 msgr2=0x7f6340198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633dd74640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63401088d0 0x7f6340198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.981+0000 7f633dd74640 1 -- 10.20.193.28:0/2050980220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63401993b0 con 0x7f6340103270 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.982+0000 7f633dd74640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6340103270 0x7f634019ff40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f632800ea10 tx=0x7f632800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.982+0000 7f633e575640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f63401028d0 0x7f634019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.982+0000 7f63277fe640 1 -- 10.20.193.28:0/2050980220 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632800ce50 con 0x7f6340103270 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.982+0000 7f63277fe640 1 -- 10.20.193.28:0/2050980220 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6328004570 con 0x7f6340103270 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.982+0000 7f63277fe640 1 -- 10.20.193.28:0/2050980220 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6328010690 con 0x7f6340103270 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.982+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63401996a0 con 0x7f6340103270 2026-02-20T03:15:05.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.982+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634019d700 con 0x7f6340103270 2026-02-20T03:15:05.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.982+0000 7f307f42e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3070008dd0 0x7f30700a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f307f42e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30700096f0 0x7f30700a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f307f42e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f30700a6840 0x7f307009eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6304005390 con 0x7f6340103270 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f307f42e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f30700ac140 con 0x7f30700096f0 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f307f42e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f30700abfc0 con 0x7f3070008dd0 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f307f42e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f30700ac2c0 con 0x7f30700a6840 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f307e42c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3070008dd0 0x7f30700a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f307ec2d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f30700a6840 0x7f307009eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f307ec2d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f30700a6840 0x7f307009eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38114/0 (socket says 10.20.193.28:38114) 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.983+0000 7f307ec2d640 1 -- 10.20.193.28:0/797709056 learned_addr learned my addr 10.20.193.28:0/797709056 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.984+0000 7f307e42c640 1 -- 10.20.193.28:0/797709056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f30700a6840 msgr2=0x7f307009eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.984+0000 7f307e42c640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f30700a6840 0x7f307009eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.984+0000 7f307e42c640 1 -- 10.20.193.28:0/797709056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30700096f0 msgr2=0x7f30700a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.984+0000 7f307e42c640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30700096f0 0x7f30700a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.984+0000 7f307e42c640 1 -- 10.20.193.28:0/797709056 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307009f7a0 con 0x7f3070008dd0 2026-02-20T03:15:05.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.984+0000 7f307e42c640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3070008dd0 0x7f30700a5d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f306800c970 tx=0x7f306800ce40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.984+0000 7f305f7fe640 1 -- 10.20.193.28:0/797709056 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068007bf0 con 0x7f3070008dd0 2026-02-20T03:15:05.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.984+0000 7f305f7fe640 1 -- 10.20.193.28:0/797709056 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3068007d90 con 0x7f3070008dd0 2026-02-20T03:15:05.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.984+0000 7f305f7fe640 1 -- 10.20.193.28:0/797709056 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068007bf0 con 0x7f3070008dd0 2026-02-20T03:15:05.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.985+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307009fa90 con 0x7f3070008dd0 2026-02-20T03:15:05.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.985+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30700a3a10 con 0x7f3070008dd0 2026-02-20T03:15:05.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.986+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307000a510 con 0x7f3070008dd0 2026-02-20T03:15:05.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.987+0000 7f305f7fe640 1 -- 10.20.193.28:0/797709056 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f3068005000 con 0x7f3070008dd0 2026-02-20T03:15:05.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.989+0000 7f305f7fe640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30540b1130 0x7f30540b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.989+0000 7f305f7fe640 1 -- 10.20.193.28:0/797709056 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f30680dfb00 con 0x7f3070008dd0 2026-02-20T03:15:05.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.989+0000 7f63277fe640 1 -- 10.20.193.28:0/2050980220 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f6328002950 con 0x7f6340103270 2026-02-20T03:15:05.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.989+0000 7f307dc2b640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30540b1130 0x7f30540b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.990+0000 7f307dc2b640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30540b1130 0x7f30540b35f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f306c0097c0 tx=0x7f306c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.990+0000 7f305f7fe640 1 -- 10.20.193.28:0/797709056 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f3068014030 con 0x7f3070008dd0 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7f63277fe640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63180b1050 0x7f63180b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7fe2414d1640 1 -- 10.20.193.28:0/1634807410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 msgr2=0x7fe23c111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7fe2414d1640 1 --2- 10.20.193.28:0/1634807410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 0x7fe23c111a50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00b0a0 tx=0x7fe22c02f450 comp rx=0 tx=0).stop 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7fe2414d1640 1 -- 10.20.193.28:0/1634807410 shutdown_connections 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7fe2414d1640 1 --2- 10.20.193.28:0/1634807410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 0x7fe23c111a50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7fe2414d1640 1 --2- 10.20.193.28:0/1634807410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe23c105750 0x7fe23c1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7fe2414d1640 1 --2- 10.20.193.28:0/1634807410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe23c104da0 0x7fe23c105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7fe2414d1640 1 -- 10.20.193.28:0/1634807410 >> 10.20.193.28:0/1634807410 conn(0x7fe23c100840 msgr2=0x7fe23c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7f63277fe640 1 -- 10.20.193.28:0/2050980220 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f63280e0fb0 con 0x7f6340103270 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.991+0000 7f63277fe640 1 -- 10.20.193.28:0/2050980220 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f63280e1430 con 0x7f6340103270 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.992+0000 7f633e575640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63180b1050 0x7f63180b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.992+0000 7fe2414d1640 1 -- 10.20.193.28:0/1634807410 shutdown_connections 2026-02-20T03:15:05.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.992+0000 7fe2414d1640 1 -- 10.20.193.28:0/1634807410 wait complete. 2026-02-20T03:15:05.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.992+0000 7f633e575640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63180b1050 0x7f63180b3510 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f633400dcd0 tx=0x7f633400d850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.993+0000 7fe2414d1640 1 Processor -- start 2026-02-20T03:15:05.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.993+0000 7fe2414d1640 1 -- start start 2026-02-20T03:15:05.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe2414d1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe23c104da0 0x7fe23c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe2414d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe23c105750 0x7fe23c074b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe2414d1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 0x7fe23c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:05.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe23b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 0x7fe23c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe23a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe23c105750 0x7fe23c074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe23b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 0x7fe23c06d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59868/0 (socket says 10.20.193.28:59868) 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe23b7fe640 1 -- 10.20.193.28:0/437709930 learned_addr learned my addr 10.20.193.28:0/437709930 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c114dc0 con 0x7fe23c105750 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe23affd640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe23c104da0 0x7fe23c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.994+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c114c40 con 0x7fe23c109ed0 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.995+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe23c114f40 con 0x7fe23c104da0 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.995+0000 7fe23b7fe640 1 -- 10.20.193.28:0/437709930 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe23c104da0 msgr2=0x7fe23c0745c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.995+0000 7fe23b7fe640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe23c104da0 0x7fe23c0745c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.995+0000 7fe23b7fe640 1 -- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe23c105750 msgr2=0x7fe23c074b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.995+0000 7fe23b7fe640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe23c105750 0x7fe23c074b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.995+0000 7fe23b7fe640 1 -- 10.20.193.28:0/437709930 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23c06df30 con 0x7fe23c109ed0 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.995+0000 7fe23a7fc640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe23c105750 0x7fe23c074b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.995+0000 7fe23affd640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe23c104da0 0x7fe23c0745c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.996+0000 7fe23b7fe640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 0x7fe23c06d670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00b1d0 tx=0x7fe22c009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.996+0000 7fe21bfff640 1 -- 10.20.193.28:0/437709930 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c002a60 con 0x7fe23c109ed0 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.996+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23c06e1c0 con 0x7fe23c109ed0 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.996+0000 7fe21bfff640 1 -- 10.20.193.28:0/437709930 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe22c007d60 con 0x7fe23c109ed0 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.996+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23c0722c0 con 0x7fe23c109ed0 2026-02-20T03:15:05.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.996+0000 7fe21bfff640 1 -- 10.20.193.28:0/437709930 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c002a60 con 0x7fe23c109ed0 2026-02-20T03:15:05.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.997+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23c106280 con 0x7fe23c109ed0 2026-02-20T03:15:06.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:05.998+0000 7fe21bfff640 1 -- 10.20.193.28:0/437709930 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fe22c03f070 con 0x7fe23c109ed0 2026-02-20T03:15:06.002 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612621 got 313532612621 for osd.10 2026-02-20T03:15:06.002 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:06.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.000+0000 7fe21bfff640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2080b10b0 0x7fe2080b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.001+0000 7fe21bfff640 1 -- 10.20.193.28:0/437709930 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fe22c104c80 con 0x7fe23c109ed0 2026-02-20T03:15:06.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.001+0000 7fe23affd640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2080b10b0 0x7fe2080b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.002+0000 7fe23affd640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2080b10b0 0x7fe2080b3570 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe2300046b0 tx=0x7fe230009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:06.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.002+0000 7fe21bfff640 1 -- 10.20.193.28:0/437709930 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe22c0cd100 con 0x7fe23c109ed0 2026-02-20T03:15:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.036+0000 7f0c8e126640 1 -- 10.20.193.28:0/833159841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c881049a0 msgr2=0x7f0c88104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.036+0000 7f0c8e126640 1 --2- 10.20.193.28:0/833159841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c881049a0 0x7f0c88104e00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009a30 tx=0x7f0c7c02f240 comp rx=0 tx=0).stop 2026-02-20T03:15:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.036+0000 7f0c8e126640 1 -- 10.20.193.28:0/833159841 shutdown_connections 2026-02-20T03:15:06.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.036+0000 7f0c8e126640 1 --2- 10.20.193.28:0/833159841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c88105340 0x7f0c88111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.036+0000 7f0c8e126640 1 --2- 10.20.193.28:0/833159841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c881049a0 0x7f0c88104e00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.036+0000 7f0c8e126640 1 --2- 10.20.193.28:0/833159841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c8810a9a0 0x7f0c8810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.036+0000 7f0c8e126640 1 -- 10.20.193.28:0/833159841 >> 10.20.193.28:0/833159841 conn(0x7f0c881006c0 msgr2=0x7f0c88102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.037+0000 7f0c8e126640 1 -- 10.20.193.28:0/833159841 shutdown_connections 2026-02-20T03:15:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.037+0000 7f0c8e126640 1 -- 10.20.193.28:0/833159841 wait complete. 2026-02-20T03:15:06.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.038+0000 7f0c8e126640 1 Processor -- start 2026-02-20T03:15:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.038+0000 7f0c8e126640 1 -- start start 2026-02-20T03:15:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8e126640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c881049a0 0x7f0c88111680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8e126640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c88105340 0x7f0c8810e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8e126640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c8810a9a0 0x7f0c8810ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8e126640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0c88114bd0 con 0x7f0c881049a0 2026-02-20T03:15:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8e126640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0c88114a50 con 0x7f0c88105340 2026-02-20T03:15:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8e126640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c88114d50 con 0x7f0c8810a9a0 2026-02-20T03:15:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8c923640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c88105340 0x7f0c8810e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8d124640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c881049a0 0x7f0c88111680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8c923640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c88105340 0x7f0c8810e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:33358/0 (socket says 10.20.193.28:33358) 2026-02-20T03:15:06.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8c923640 1 -- 10.20.193.28:0/688786152 learned_addr learned my addr 10.20.193.28:0/688786152 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:06.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8d925640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c8810a9a0 0x7f0c8810ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8d925640 1 -- 10.20.193.28:0/688786152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c88105340 msgr2=0x7f0c8810e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8d925640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c88105340 0x7f0c8810e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.039+0000 7f0c8d925640 1 -- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c881049a0 msgr2=0x7f0c88111680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.041+0000 7f0c8d925640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c881049a0 0x7f0c88111680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.041+0000 7f0c8d925640 1 -- 10.20.193.28:0/688786152 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8810f530 con 0x7f0c8810a9a0 2026-02-20T03:15:06.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.041+0000 7f0c8d124640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c881049a0 0x7f0c88111680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:06.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.041+0000 7f0c8d925640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c8810a9a0 0x7f0c8810ec70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0c84004830 tx=0x7f0c8400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:06.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.041+0000 7f0c767fc640 1 -- 10.20.193.28:0/688786152 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400db60 con 0x7f0c8810a9a0 2026-02-20T03:15:06.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.041+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c881a30f0 con 0x7f0c8810a9a0 2026-02-20T03:15:06.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.041+0000 7f0c767fc640 1 -- 10.20.193.28:0/688786152 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0c8400dd00 con 0x7f0c8810a9a0 2026-02-20T03:15:06.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.041+0000 7f0c767fc640 1 -- 10.20.193.28:0/688786152 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8400db60 con 0x7f0c8810a9a0 2026-02-20T03:15:06.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.041+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c881a3630 con 0x7f0c8810a9a0 2026-02-20T03:15:06.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.044+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c881060e0 con 0x7f0c8810a9a0 2026-02-20T03:15:06.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.044+0000 7f0c767fc640 1 -- 10.20.193.28:0/688786152 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f0c84012070 con 0x7f0c8810a9a0 2026-02-20T03:15:06.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.045+0000 7f0c767fc640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0c640b10b0 0x7f0c640b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.045+0000 7f0c767fc640 1 -- 10.20.193.28:0/688786152 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f0c840dff20 con 0x7f0c8810a9a0 2026-02-20T03:15:06.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.046+0000 7f0c8d124640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0c640b10b0 0x7f0c640b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.046+0000 7f0c8d124640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0c640b10b0 0x7f0c640b3570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c78005fd0 tx=0x7f0c78007450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:06.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.047+0000 7f0c767fc640 1 -- 10.20.193.28:0/688786152 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0c84010070 con 0x7f0c8810a9a0 2026-02-20T03:15:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.048+0000 7f0c0945d640 1 -- 10.20.193.28:0/2333385320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c04109220 msgr2=0x7f0c04109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.048+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2333385320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c04109220 0x7f0c04109680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009a30 tx=0x7f0bec02f260 comp rx=0 tx=0).stop 2026-02-20T03:15:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.049+0000 7f0c0945d640 1 -- 10.20.193.28:0/2333385320 shutdown_connections 2026-02-20T03:15:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.049+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2333385320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c04109bc0 0x7f0c04115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.049+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2333385320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c04109220 0x7f0c04109680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.049+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2333385320 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c0410f1e0 0x7f0c0410f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.049+0000 7f0c0945d640 1 -- 10.20.193.28:0/2333385320 >> 10.20.193.28:0/2333385320 conn(0x7f0c04078860 msgr2=0x7f0c0407ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:06.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.049+0000 7f0c0945d640 1 -- 10.20.193.28:0/2333385320 shutdown_connections 2026-02-20T03:15:06.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.049+0000 7f0c0945d640 1 -- 10.20.193.28:0/2333385320 wait complete. 2026-02-20T03:15:06.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.050+0000 7f0c0945d640 1 Processor -- start 2026-02-20T03:15:06.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.050+0000 7f0c0945d640 1 -- start start 2026-02-20T03:15:06.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.051+0000 7f0c0945d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c04109220 0x7f0c041a7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.051+0000 7f0c0945d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c04109bc0 0x7f0c041a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.051+0000 7f0c0945d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0410f1e0 0x7f0c041a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c0945d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0c04119310 con 0x7f0c0410f1e0 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c0945d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0c04119190 con 0x7f0c04109bc0 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c0945d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c04119490 con 0x7f0c04109220 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c027fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c04109bc0 0x7f0c041a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0410f1e0 0x7f0c041a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c02ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c04109220 0x7f0c041a7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c02ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c04109220 0x7f0c041a7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49284/0 (socket says 10.20.193.28:49284) 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c02ffd640 1 -- 10.20.193.28:0/2029986655 learned_addr learned my addr 10.20.193.28:0/2029986655 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c02ffd640 1 -- 10.20.193.28:0/2029986655 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c04109bc0 msgr2=0x7f0c041a7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c02ffd640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c04109bc0 0x7f0c041a7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c02ffd640 1 -- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0410f1e0 msgr2=0x7f0c041a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c02ffd640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0410f1e0 0x7f0c041a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c02ffd640 1 -- 10.20.193.28:0/2029986655 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c041a1ed0 con 0x7f0c04109220 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c027fc640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c04109bc0 0x7f0c041a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.052+0000 7f0c037fe640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0410f1e0 0x7f0c041a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.053+0000 7f0c02ffd640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c04109220 0x7f0c041a7570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800ea30 tx=0x7f0bf800ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.053+0000 7f0be3fff640 1 -- 10.20.193.28:0/2029986655 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800ce50 con 0x7f0c04109220 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.053+0000 7f0be3fff640 1 -- 10.20.193.28:0/2029986655 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0bf8004570 con 0x7f0c04109220 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.053+0000 7f0be3fff640 1 -- 10.20.193.28:0/2029986655 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8010690 con 0x7f0c04109220 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.053+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c041a21c0 con 0x7f0c04109220 2026-02-20T03:15:06.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.053+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c041ae4f0 con 0x7f0c04109220 2026-02-20T03:15:06.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.054+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c0410a7d0 con 0x7f0c04109220 2026-02-20T03:15:06.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.056+0000 7f0be3fff640 1 -- 10.20.193.28:0/2029986655 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f0bf80040d0 con 0x7f0c04109220 2026-02-20T03:15:06.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.057+0000 7f0be3fff640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0bd80b0eb0 0x7f0bd80b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.058+0000 7f0be3fff640 1 -- 10.20.193.28:0/2029986655 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f0bf80e0df0 con 0x7f0c04109220 2026-02-20T03:15:06.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.058+0000 7f0be3fff640 1 -- 10.20.193.28:0/2029986655 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0bf80e1310 con 0x7f0c04109220 2026-02-20T03:15:06.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.059+0000 7f0c027fc640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0bd80b0eb0 0x7f0bd80b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.059+0000 7f0c027fc640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0bd80b0eb0 0x7f0bd80b3370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c041a2e90 tx=0x7f0bec005830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:06.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.087+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f30700a02d0 con 0x7f3070008dd0 2026-02-20T03:15:06.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.087+0000 7f305f7fe640 1 -- 10.20.193.28:0/797709056 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f30680a7f80 con 0x7f3070008dd0 2026-02-20T03:15:06.090 INFO:teuthology.orchestra.run.trial028.stdout:223338299412 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30540b1130 msgr2=0x7f30540b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.089+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6304005950 con 0x7f6340103270 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f63277fe640 1 -- 10.20.193.28:0/2050980220 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f632801f330 con 0x7f6340103270 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30540b1130 0x7f30540b35f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f306c0097c0 tx=0x7f306c005850 comp rx=0 tx=0).stop 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3070008dd0 msgr2=0x7f30700a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3070008dd0 0x7f30700a5d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f306800c970 tx=0x7f306800ce40 comp rx=0 tx=0).stop 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 shutdown_connections 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30540b1130 0x7f30540b35f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f30700a6840 0x7f307009eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f30700096f0 0x7f30700a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 --2- 10.20.193.28:0/797709056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3070008dd0 0x7f30700a5d10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.090+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 >> 10.20.193.28:0/797709056 conn(0x7f3070093620 msgr2=0x7f3070095a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:06.093 INFO:teuthology.orchestra.run.trial028.stdout:146028888090 2026-02-20T03:15:06.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.092+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 shutdown_connections 2026-02-20T03:15:06.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.092+0000 7f307f42e640 1 -- 10.20.193.28:0/797709056 wait complete. 2026-02-20T03:15:06.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.092+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63180b1050 msgr2=0x7f63180b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.092+0000 7f6344a06640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63180b1050 0x7f63180b3510 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f633400dcd0 tx=0x7f633400d850 comp rx=0 tx=0).stop 2026-02-20T03:15:06.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.092+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6340103270 msgr2=0x7f634019ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.092+0000 7f6344a06640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6340103270 0x7f634019ff40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f632800ea10 tx=0x7f632800eee0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.093+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 shutdown_connections 2026-02-20T03:15:06.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.093+0000 7f6344a06640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63180b1050 0x7f63180b3510 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.093+0000 7f6344a06640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f63401088d0 0x7f6340198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.093+0000 7f6344a06640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6340103270 0x7f634019ff40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.093+0000 7f6344a06640 1 --2- 10.20.193.28:0/2050980220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f63401028d0 0x7f634019fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.093+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 >> 10.20.193.28:0/2050980220 conn(0x7f63400fe5d0 msgr2=0x7f63400ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:06.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.093+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 shutdown_connections 2026-02-20T03:15:06.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.093+0000 7f6344a06640 1 -- 10.20.193.28:0/2050980220 wait complete. 2026-02-20T03:15:06.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.099+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe23c072d30 con 0x7fe23c109ed0 2026-02-20T03:15:06.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.099+0000 7fe21bfff640 1 -- 10.20.193.28:0/437709930 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe22c0d0db0 con 0x7fe23c109ed0 2026-02-20T03:15:06.103 INFO:teuthology.orchestra.run.trial028.stdout:343597383691 2026-02-20T03:15:06.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.102+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2080b10b0 msgr2=0x7fe2080b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.102+0000 7fe2414d1640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2080b10b0 0x7fe2080b3570 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe2300046b0 tx=0x7fe230009210 comp rx=0 tx=0).stop 2026-02-20T03:15:06.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.102+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 msgr2=0x7fe23c06d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.102+0000 7fe2414d1640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 0x7fe23c06d670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00b1d0 tx=0x7fe22c009300 comp rx=0 tx=0).stop 2026-02-20T03:15:06.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.103+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 shutdown_connections 2026-02-20T03:15:06.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.103+0000 7fe2414d1640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2080b10b0 0x7fe2080b3570 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.103+0000 7fe2414d1640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe23c109ed0 0x7fe23c06d670 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.103+0000 7fe2414d1640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe23c105750 0x7fe23c074b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.103+0000 7fe2414d1640 1 --2- 10.20.193.28:0/437709930 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe23c104da0 0x7fe23c0745c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.103+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 >> 10.20.193.28:0/437709930 conn(0x7fe23c100840 msgr2=0x7fe23c101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:06.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.103+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 shutdown_connections 2026-02-20T03:15:06.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.103+0000 7fe2414d1640 1 -- 10.20.193.28:0/437709930 wait complete. 2026-02-20T03:15:06.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.143+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f0c88078740 con 0x7f0c8810a9a0 2026-02-20T03:15:06.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.144+0000 7f0c767fc640 1 -- 10.20.193.28:0/688786152 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0c840a83a0 con 0x7f0c8810a9a0 2026-02-20T03:15:06.146 INFO:teuthology.orchestra.run.trial028.stdout:257698037778 2026-02-20T03:15:06.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0c640b10b0 msgr2=0x7f0c640b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0c640b10b0 0x7f0c640b3570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0c78005fd0 tx=0x7f0c78007450 comp rx=0 tx=0).stop 2026-02-20T03:15:06.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c8810a9a0 msgr2=0x7f0c8810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c8810a9a0 0x7f0c8810ec70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0c84004830 tx=0x7f0c8400d4a0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 shutdown_connections 2026-02-20T03:15:06.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0c640b10b0 0x7f0c640b3570 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c8810a9a0 0x7f0c8810ec70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c88105340 0x7f0c8810e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 --2- 10.20.193.28:0/688786152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c881049a0 0x7f0c88111680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 >> 10.20.193.28:0/688786152 conn(0x7f0c881006c0 msgr2=0x7f0c88100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:06.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 shutdown_connections 2026-02-20T03:15:06.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.152+0000 7f0c8e126640 1 -- 10.20.193.28:0/688786152 wait complete. 2026-02-20T03:15:06.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.155+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f0c041a2ba0 con 0x7f0c04109220 2026-02-20T03:15:06.159 INFO:teuthology.orchestra.run.trial028.stdout:292057776143 2026-02-20T03:15:06.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.155+0000 7f0be3fff640 1 -- 10.20.193.28:0/2029986655 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0c041a2ba0 con 0x7f0c04109220 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.157+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0bd80b0eb0 msgr2=0x7f0bd80b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.157+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0bd80b0eb0 0x7f0bd80b3370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0c041a2e90 tx=0x7f0bec005830 comp rx=0 tx=0).stop 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.157+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c04109220 msgr2=0x7f0c041a7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.157+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c04109220 0x7f0c041a7570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800ea30 tx=0x7f0bf800ef00 comp rx=0 tx=0).stop 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.158+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 shutdown_connections 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.158+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0bd80b0eb0 0x7f0bd80b3370 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.158+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0c0410f1e0 0x7f0c041a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.158+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0c04109bc0 0x7f0c041a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.158+0000 7f0c0945d640 1 --2- 10.20.193.28:0/2029986655 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0c04109220 0x7f0c041a7570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.158+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 >> 10.20.193.28:0/2029986655 conn(0x7f0c04078860 msgr2=0x7f0c0407a320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:06.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.158+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 shutdown_connections 2026-02-20T03:15:06.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.158+0000 7f0c0945d640 1 -- 10.20.193.28:0/2029986655 wait complete. 2026-02-20T03:15:06.282 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888090 got 146028888090 for osd.4 2026-02-20T03:15:06.282 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:06.295 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299412 got 223338299412 for osd.7 2026-02-20T03:15:06.295 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:06.368 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383691 got 343597383691 for osd.11 2026-02-20T03:15:06.369 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:06.378 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776143 got 292057776143 for osd.9 2026-02-20T03:15:06.379 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:06.382 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037778 got 257698037778 for osd.8 2026-02-20T03:15:06.382 DEBUG:teuthology.parallel:result is None 2026-02-20T03:15:06.382 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-20T03:15:06.382 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T03:15:06.688 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:06.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/609209363' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2026-02-20T03:15:06.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:06 trial028 ceph-mon[38552]: pgmap v189: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.4 KiB/s wr, 14 op/s 2026-02-20T03:15:06.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2050980220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T03:15:06.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/797709056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T03:15:06.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/437709930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2026-02-20T03:15:06.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/688786152' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2026-02-20T03:15:06.732 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2029986655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2026-02-20T03:15:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:06 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/609209363' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2026-02-20T03:15:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:06 trial126 ceph-mon[38476]: pgmap v189: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.4 KiB/s wr, 14 op/s 2026-02-20T03:15:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:06 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2050980220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T03:15:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:06 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/797709056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T03:15:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:06 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/437709930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2026-02-20T03:15:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:06 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/688786152' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2026-02-20T03:15:06.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:06 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2029986655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.863+0000 7fa7c2416640 1 -- 10.20.193.28:0/1317475427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc10eef0 msgr2=0x7fa7bc10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.863+0000 7fa7c2416640 1 --2- 10.20.193.28:0/1317475427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc10eef0 0x7fa7bc10f2d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac009a30 tx=0x7fa7ac02f260 comp rx=0 tx=0).stop 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.863+0000 7fa7c2416640 1 -- 10.20.193.28:0/1317475427 shutdown_connections 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.863+0000 7fa7c2416640 1 --2- 10.20.193.28:0/1317475427 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc109ba0 0x7fa7bc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.863+0000 7fa7c2416640 1 --2- 10.20.193.28:0/1317475427 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc109220 0x7fa7bc109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.863+0000 7fa7c2416640 1 --2- 10.20.193.28:0/1317475427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc10eef0 0x7fa7bc10f2d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.863+0000 7fa7c2416640 1 -- 10.20.193.28:0/1317475427 >> 10.20.193.28:0/1317475427 conn(0x7fa7bc078600 msgr2=0x7fa7bc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.863+0000 7fa7c2416640 1 -- 10.20.193.28:0/1317475427 shutdown_connections 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.863+0000 7fa7c2416640 1 -- 10.20.193.28:0/1317475427 wait complete. 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.864+0000 7fa7c2416640 1 Processor -- start 2026-02-20T03:15:06.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.864+0000 7fa7c2416640 1 -- start start 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.864+0000 7fa7c2416640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc109220 0x7fa7bc1a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.864+0000 7fa7c2416640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc109ba0 0x7fa7bc1a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.864+0000 7fa7c2416640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10eef0 0x7fa7bc1a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.864+0000 7fa7c2416640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc1190a0 con 0x7fa7bc109ba0 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.864+0000 7fa7c2416640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc118f20 con 0x7fa7bc109220 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.864+0000 7fa7c2416640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc119220 con 0x7fa7bc10eef0 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c0c13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc109ba0 0x7fa7bc1a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c0c13640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc109ba0 0x7fa7bc1a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40234/0 (socket says 10.20.193.28:40234) 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c0c13640 1 -- 10.20.193.28:0/2032208356 learned_addr learned my addr 10.20.193.28:0/2032208356 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c1414640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc109220 0x7fa7bc1a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c1c15640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10eef0 0x7fa7bc1a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c0c13640 1 -- 10.20.193.28:0/2032208356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10eef0 msgr2=0x7fa7bc1a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c0c13640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10eef0 0x7fa7bc1a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c0c13640 1 -- 10.20.193.28:0/2032208356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc109220 msgr2=0x7fa7bc1a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c0c13640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc109220 0x7fa7bc1a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c0c13640 1 -- 10.20.193.28:0/2032208356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc1a65a0 con 0x7fa7bc109ba0 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c0c13640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc109ba0 0x7fa7bc1a1a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000d980 tx=0x7fa7b000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7aa7fc640 1 -- 10.20.193.28:0/2032208356 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0014070 con 0x7fa7bc109ba0 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7aa7fc640 1 -- 10.20.193.28:0/2032208356 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7b00044e0 con 0x7fa7bc109ba0 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7aa7fc640 1 -- 10.20.193.28:0/2032208356 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0005040 con 0x7fa7bc109ba0 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc1a6890 con 0x7fa7bc109ba0 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.865+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc1ae0d0 con 0x7fa7bc109ba0 2026-02-20T03:15:06.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.866+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7bc10a580 con 0x7fa7bc109ba0 2026-02-20T03:15:06.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.868+0000 7fa7aa7fc640 1 -- 10.20.193.28:0/2032208356 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fa7b00047c0 con 0x7fa7bc109ba0 2026-02-20T03:15:06.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.870+0000 7fa7aa7fc640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7980b0eb0 0x7fa7980b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:06.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.870+0000 7fa7aa7fc640 1 -- 10.20.193.28:0/2032208356 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fa7b00e0d20 con 0x7fa7bc109ba0 2026-02-20T03:15:06.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.870+0000 7fa7c1414640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7980b0eb0 0x7fa7980b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:06.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.870+0000 7fa7aa7fc640 1 -- 10.20.193.28:0/2032208356 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa7b00e11a0 con 0x7fa7bc109ba0 2026-02-20T03:15:06.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.871+0000 7fa7c1414640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7980b0eb0 0x7fa7980b3370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac002410 tx=0x7fa7ac03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:06.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.960+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7bc110ee0 con 0x7fa7980b0eb0 2026-02-20T03:15:06.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:06 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/609209363' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2026-02-20T03:15:06.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:06 trial177 ceph-mon[43181]: pgmap v189: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 9.7 KiB/s rd, 7.4 KiB/s wr, 14 op/s 2026-02-20T03:15:06.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:06 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2050980220' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-20T03:15:06.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:06 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/797709056' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-20T03:15:06.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:06 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/437709930' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2026-02-20T03:15:06.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:06 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/688786152' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2026-02-20T03:15:06.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:06 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2029986655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2026-02-20T03:15:06.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.965+0000 7fa7aa7fc640 1 -- 10.20.193.28:0/2032208356 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340386 (secure 0 0 0) 0x7fa7ac09b1c0 con 0x7fa7980b0eb0 2026-02-20T03:15:06.970 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:06.971 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:06.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7980b0eb0 msgr2=0x7fa7980b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7980b0eb0 0x7fa7980b3370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac002410 tx=0x7fa7ac03a040 comp rx=0 tx=0).stop 2026-02-20T03:15:06.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc109ba0 msgr2=0x7fa7bc1a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:06.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc109ba0 0x7fa7bc1a1a90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000d980 tx=0x7fa7b000de50 comp rx=0 tx=0).stop 2026-02-20T03:15:06.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 shutdown_connections 2026-02-20T03:15:06.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7980b0eb0 0x7fa7980b3370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10eef0 0x7fa7bc1a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc109ba0 0x7fa7bc1a1a90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 --2- 10.20.193.28:0/2032208356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc109220 0x7fa7bc1a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:06.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.968+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 >> 10.20.193.28:0/2032208356 conn(0x7fa7bc078600 msgr2=0x7fa7bc079f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:06.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.969+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 shutdown_connections 2026-02-20T03:15:06.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:06.969+0000 7fa7c2416640 1 -- 10.20.193.28:0/2032208356 wait complete. 2026-02-20T03:15:07.109 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2026-02-20T03:15:06.005192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658386,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":207,"num_read_kb":213,"num_write":351,"num_write_kb":3834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":291,"ondisk_log_size":291,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358104,"kb_used_data":13736,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807680296,"statfs":{"total":9019431321600,"available":9019064623104,"internally_reserved":0,"allocated":14065664,"data_stored":7734370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":62521,"num_objects":23,"num_object_clones":0,"num_object_copies":71,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":95,"num_read_kb":116,"num_write":74,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002560"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.357986+0000","last_change":"2026-02-20T03:14:32.081180+0000","last_active":"2026-02-20T03:14:51.357986+0000","last_peered":"2026-02-20T03:14:51.357986+0000","last_clean":"2026-02-20T03:14:51.357986+0000","last_became_active":"2026-02-20T03:14:32.081083+0000","last_became_peered":"2026-02-20T03:14:32.081083+0000","last_unstale":"2026-02-20T03:14:51.357986+0000","last_undegraded":"2026-02-20T03:14:51.357986+0000","last_fullsized":"2026-02-20T03:14:51.357986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:23:16.897948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743323+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:14:38.743323+0000","last_peered":"2026-02-20T03:14:38.743323+0000","last_clean":"2026-02-20T03:14:38.743323+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:14:38.743323+0000","last_undegraded":"2026-02-20T03:14:38.743323+0000","last_fullsized":"2026-02-20T03:14:38.743323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743964+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:14:38.743964+0000","last_peered":"2026-02-20T03:14:38.743964+0000","last_clean":"2026-02-20T03:14:38.743964+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:14:38.743964+0000","last_undegraded":"2026-02-20T03:14:38.743964+0000","last_fullsized":"2026-02-20T03:14:38.743964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743404+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:14:38.743404+0000","last_peered":"2026-02-20T03:14:38.743404+0000","last_clean":"2026-02-20T03:14:38.743404+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:14:38.743404+0000","last_undegraded":"2026-02-20T03:14:38.743404+0000","last_fullsized":"2026-02-20T03:14:38.743404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311999+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:14:38.311999+0000","last_peered":"2026-02-20T03:14:38.311999+0000","last_clean":"2026-02-20T03:14:38.311999+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:14:38.311999+0000","last_undegraded":"2026-02-20T03:14:38.311999+0000","last_fullsized":"2026-02-20T03:14:38.311999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356040+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:14:51.356040+0000","last_peered":"2026-02-20T03:14:51.356040+0000","last_clean":"2026-02-20T03:14:51.356040+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:14:51.356040+0000","last_undegraded":"2026-02-20T03:14:51.356040+0000","last_fullsized":"2026-02-20T03:14:51.356040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749309+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:14:38.749309+0000","last_peered":"2026-02-20T03:14:38.749309+0000","last_clean":"2026-02-20T03:14:38.749309+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:14:38.749309+0000","last_undegraded":"2026-02-20T03:14:38.749309+0000","last_fullsized":"2026-02-20T03:14:38.749309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744316+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:14:38.744316+0000","last_peered":"2026-02-20T03:14:38.744316+0000","last_clean":"2026-02-20T03:14:38.744316+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:14:38.744316+0000","last_undegraded":"2026-02-20T03:14:38.744316+0000","last_fullsized":"2026-02-20T03:14:38.744316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744230+0000","last_change":"2026-02-20T03:14:33.291255+0000","last_active":"2026-02-20T03:14:38.744230+0000","last_peered":"2026-02-20T03:14:38.744230+0000","last_clean":"2026-02-20T03:14:38.744230+0000","last_became_active":"2026-02-20T03:14:33.291089+0000","last_became_peered":"2026-02-20T03:14:33.291089+0000","last_unstale":"2026-02-20T03:14:38.744230+0000","last_undegraded":"2026-02-20T03:14:38.744230+0000","last_fullsized":"2026-02-20T03:14:38.744230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:42:45.321761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318208+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:14:38.318208+0000","last_peered":"2026-02-20T03:14:38.318208+0000","last_clean":"2026-02-20T03:14:38.318208+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:14:38.318208+0000","last_undegraded":"2026-02-20T03:14:38.318208+0000","last_fullsized":"2026-02-20T03:14:38.318208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351492+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:14:50.351492+0000","last_peered":"2026-02-20T03:14:50.351492+0000","last_clean":"2026-02-20T03:14:50.351492+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:14:50.351492+0000","last_undegraded":"2026-02-20T03:14:50.351492+0000","last_fullsized":"2026-02-20T03:14:50.351492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742908+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:14:38.742908+0000","last_peered":"2026-02-20T03:14:38.742908+0000","last_clean":"2026-02-20T03:14:38.742908+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:14:38.742908+0000","last_undegraded":"2026-02-20T03:14:38.742908+0000","last_fullsized":"2026-02-20T03:14:38.742908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744042+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:14:38.744042+0000","last_peered":"2026-02-20T03:14:38.744042+0000","last_clean":"2026-02-20T03:14:38.744042+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:14:38.744042+0000","last_undegraded":"2026-02-20T03:14:38.744042+0000","last_fullsized":"2026-02-20T03:14:38.744042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:40.062667+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:40.062667+0000","last_peered":"2026-02-20T03:14:40.062667+0000","last_clean":"2026-02-20T03:14:40.062667+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:40.062667+0000","last_undegraded":"2026-02-20T03:14:40.062667+0000","last_fullsized":"2026-02-20T03:14:40.062667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743910+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:14:38.743910+0000","last_peered":"2026-02-20T03:14:38.743910+0000","last_clean":"2026-02-20T03:14:38.743910+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:14:38.743910+0000","last_undegraded":"2026-02-20T03:14:38.743910+0000","last_fullsized":"2026-02-20T03:14:38.743910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351649+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:14:50.351649+0000","last_peered":"2026-02-20T03:14:50.351649+0000","last_clean":"2026-02-20T03:14:50.351649+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:14:50.351649+0000","last_undegraded":"2026-02-20T03:14:50.351649+0000","last_fullsized":"2026-02-20T03:14:50.351649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742825+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:14:38.742825+0000","last_peered":"2026-02-20T03:14:38.742825+0000","last_clean":"2026-02-20T03:14:38.742825+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:14:38.742825+0000","last_undegraded":"2026-02-20T03:14:38.742825+0000","last_fullsized":"2026-02-20T03:14:38.742825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743900+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:14:38.743900+0000","last_peered":"2026-02-20T03:14:38.743900+0000","last_clean":"2026-02-20T03:14:38.743900+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:14:38.743900+0000","last_undegraded":"2026-02-20T03:14:38.743900+0000","last_fullsized":"2026-02-20T03:14:38.743900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357481+0000","last_change":"2026-02-20T03:14:32.086899+0000","last_active":"2026-02-20T03:14:50.357481+0000","last_peered":"2026-02-20T03:14:50.357481+0000","last_clean":"2026-02-20T03:14:50.357481+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357481+0000","last_undegraded":"2026-02-20T03:14:50.357481+0000","last_fullsized":"2026-02-20T03:14:50.357481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:29:02.472130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311960+0000","last_change":"2026-02-20T03:14:33.298094+0000","last_active":"2026-02-20T03:14:38.311960+0000","last_peered":"2026-02-20T03:14:38.311960+0000","last_clean":"2026-02-20T03:14:38.311960+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311960+0000","last_undegraded":"2026-02-20T03:14:38.311960+0000","last_fullsized":"2026-02-20T03:14:38.311960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:14:52.233571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744071+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:14:38.744071+0000","last_peered":"2026-02-20T03:14:38.744071+0000","last_clean":"2026-02-20T03:14:38.744071+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:14:38.744071+0000","last_undegraded":"2026-02-20T03:14:38.744071+0000","last_fullsized":"2026-02-20T03:14:38.744071+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743028+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:14:38.743028+0000","last_peered":"2026-02-20T03:14:38.743028+0000","last_clean":"2026-02-20T03:14:38.743028+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:14:38.743028+0000","last_undegraded":"2026-02-20T03:14:38.743028+0000","last_fullsized":"2026-02-20T03:14:38.743028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:00.293338+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:00.293338+0000","last_peered":"2026-02-20T03:15:00.293338+0000","last_clean":"2026-02-20T03:15:00.293338+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:00.293338+0000","last_undegraded":"2026-02-20T03:15:00.293338+0000","last_fullsized":"2026-02-20T03:15:00.293338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742399+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:14:38.742399+0000","last_peered":"2026-02-20T03:14:38.742399+0000","last_clean":"2026-02-20T03:14:38.742399+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:14:38.742399+0000","last_undegraded":"2026-02-20T03:14:38.742399+0000","last_fullsized":"2026-02-20T03:14:38.742399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311146+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:14:38.311146+0000","last_peered":"2026-02-20T03:14:38.311146+0000","last_clean":"2026-02-20T03:14:38.311146+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:14:38.311146+0000","last_undegraded":"2026-02-20T03:14:38.311146+0000","last_fullsized":"2026-02-20T03:14:38.311146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352941+0000","last_change":"2026-02-20T03:14:32.081021+0000","last_active":"2026-02-20T03:14:50.352941+0000","last_peered":"2026-02-20T03:14:50.352941+0000","last_clean":"2026-02-20T03:14:50.352941+0000","last_became_active":"2026-02-20T03:14:32.080799+0000","last_became_peered":"2026-02-20T03:14:32.080799+0000","last_unstale":"2026-02-20T03:14:50.352941+0000","last_undegraded":"2026-02-20T03:14:50.352941+0000","last_fullsized":"2026-02-20T03:14:50.352941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:15.834880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744093+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:14:38.744093+0000","last_peered":"2026-02-20T03:14:38.744093+0000","last_clean":"2026-02-20T03:14:38.744093+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:14:38.744093+0000","last_undegraded":"2026-02-20T03:14:38.744093+0000","last_fullsized":"2026-02-20T03:14:38.744093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479703+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:14:38.479703+0000","last_peered":"2026-02-20T03:14:38.479703+0000","last_clean":"2026-02-20T03:14:38.479703+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:14:38.479703+0000","last_undegraded":"2026-02-20T03:14:38.479703+0000","last_fullsized":"2026-02-20T03:14:38.479703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742701+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:14:38.742701+0000","last_peered":"2026-02-20T03:14:38.742701+0000","last_clean":"2026-02-20T03:14:38.742701+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:14:38.742701+0000","last_undegraded":"2026-02-20T03:14:38.742701+0000","last_fullsized":"2026-02-20T03:14:38.742701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744036+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:14:38.744036+0000","last_peered":"2026-02-20T03:14:38.744036+0000","last_clean":"2026-02-20T03:14:38.744036+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:14:38.744036+0000","last_undegraded":"2026-02-20T03:14:38.744036+0000","last_fullsized":"2026-02-20T03:14:38.744036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479538+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:14:38.479538+0000","last_peered":"2026-02-20T03:14:38.479538+0000","last_clean":"2026-02-20T03:14:38.479538+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:14:38.479538+0000","last_undegraded":"2026-02-20T03:14:38.479538+0000","last_fullsized":"2026-02-20T03:14:38.479538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318364+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:14:38.318364+0000","last_peered":"2026-02-20T03:14:38.318364+0000","last_clean":"2026-02-20T03:14:38.318364+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:14:38.318364+0000","last_undegraded":"2026-02-20T03:14:38.318364+0000","last_fullsized":"2026-02-20T03:14:38.318364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311210+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:14:38.311210+0000","last_peered":"2026-02-20T03:14:38.311210+0000","last_clean":"2026-02-20T03:14:38.311210+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:14:38.311210+0000","last_undegraded":"2026-02-20T03:14:38.311210+0000","last_fullsized":"2026-02-20T03:14:38.311210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.290483+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.289779+0000","last_became_peered":"2026-02-20T03:14:33.289779+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:45:10.985058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:01.366561+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:01.366561+0000","last_peered":"2026-02-20T03:15:01.366561+0000","last_clean":"2026-02-20T03:15:01.366561+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:01.366561+0000","last_undegraded":"2026-02-20T03:15:01.366561+0000","last_fullsized":"2026-02-20T03:15:01.366561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311164+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:14:38.311164+0000","last_peered":"2026-02-20T03:14:38.311164+0000","last_clean":"2026-02-20T03:14:38.311164+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:14:38.311164+0000","last_undegraded":"2026-02-20T03:14:38.311164+0000","last_fullsized":"2026-02-20T03:14:38.311164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.310925+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:14:38.310925+0000","last_peered":"2026-02-20T03:14:38.310925+0000","last_clean":"2026-02-20T03:14:38.310925+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:14:38.310925+0000","last_undegraded":"2026-02-20T03:14:38.310925+0000","last_fullsized":"2026-02-20T03:14:38.310925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.360846+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:14:51.360846+0000","last_peered":"2026-02-20T03:14:51.360846+0000","last_clean":"2026-02-20T03:14:51.360846+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:14:51.360846+0000","last_undegraded":"2026-02-20T03:14:51.360846+0000","last_fullsized":"2026-02-20T03:14:51.360846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744423+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:14:38.744423+0000","last_peered":"2026-02-20T03:14:38.744423+0000","last_clean":"2026-02-20T03:14:38.744423+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:14:38.744423+0000","last_undegraded":"2026-02-20T03:14:38.744423+0000","last_fullsized":"2026-02-20T03:14:38.744423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743435+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:14:38.743435+0000","last_peered":"2026-02-20T03:14:38.743435+0000","last_clean":"2026-02-20T03:14:38.743435+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:14:38.743435+0000","last_undegraded":"2026-02-20T03:14:38.743435+0000","last_fullsized":"2026-02-20T03:14:38.743435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318242+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:14:38.318242+0000","last_peered":"2026-02-20T03:14:38.318242+0000","last_clean":"2026-02-20T03:14:38.318242+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:14:38.318242+0000","last_undegraded":"2026-02-20T03:14:38.318242+0000","last_fullsized":"2026-02-20T03:14:38.318242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318423+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:14:38.318423+0000","last_peered":"2026-02-20T03:14:38.318423+0000","last_clean":"2026-02-20T03:14:38.318423+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:14:38.318423+0000","last_undegraded":"2026-02-20T03:14:38.318423+0000","last_fullsized":"2026-02-20T03:14:38.318423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318536+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:14:38.318536+0000","last_peered":"2026-02-20T03:14:38.318536+0000","last_clean":"2026-02-20T03:14:38.318536+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:14:38.318536+0000","last_undegraded":"2026-02-20T03:14:38.318536+0000","last_fullsized":"2026-02-20T03:14:38.318536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358847+0000","last_change":"2026-02-20T03:14:32.079575+0000","last_active":"2026-02-20T03:14:51.358847+0000","last_peered":"2026-02-20T03:14:51.358847+0000","last_clean":"2026-02-20T03:14:51.358847+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:51.358847+0000","last_undegraded":"2026-02-20T03:14:51.358847+0000","last_fullsized":"2026-02-20T03:14:51.358847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:32:22.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749026+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:14:38.749026+0000","last_peered":"2026-02-20T03:14:38.749026+0000","last_clean":"2026-02-20T03:14:38.749026+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:14:38.749026+0000","last_undegraded":"2026-02-20T03:14:38.749026+0000","last_fullsized":"2026-02-20T03:14:38.749026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318340+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:14:38.318340+0000","last_peered":"2026-02-20T03:14:38.318340+0000","last_clean":"2026-02-20T03:14:38.318340+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:14:38.318340+0000","last_undegraded":"2026-02-20T03:14:38.318340+0000","last_fullsized":"2026-02-20T03:14:38.318340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744433+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:14:38.744433+0000","last_peered":"2026-02-20T03:14:38.744433+0000","last_clean":"2026-02-20T03:14:38.744433+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:14:38.744433+0000","last_undegraded":"2026-02-20T03:14:38.744433+0000","last_fullsized":"2026-02-20T03:14:38.744433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311766+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:14:38.311766+0000","last_peered":"2026-02-20T03:14:38.311766+0000","last_clean":"2026-02-20T03:14:38.311766+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:14:38.311766+0000","last_undegraded":"2026-02-20T03:14:38.311766+0000","last_fullsized":"2026-02-20T03:14:38.311766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318490+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:14:38.318490+0000","last_peered":"2026-02-20T03:14:38.318490+0000","last_clean":"2026-02-20T03:14:38.318490+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:14:38.318490+0000","last_undegraded":"2026-02-20T03:14:38.318490+0000","last_fullsized":"2026-02-20T03:14:38.318490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311359+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:14:38.311359+0000","last_peered":"2026-02-20T03:14:38.311359+0000","last_clean":"2026-02-20T03:14:38.311359+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:14:38.311359+0000","last_undegraded":"2026-02-20T03:14:38.311359+0000","last_fullsized":"2026-02-20T03:14:38.311359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743916+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:14:38.743916+0000","last_peered":"2026-02-20T03:14:38.743916+0000","last_clean":"2026-02-20T03:14:38.743916+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:14:38.743916+0000","last_undegraded":"2026-02-20T03:14:38.743916+0000","last_fullsized":"2026-02-20T03:14:38.743916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744369+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:14:38.744369+0000","last_peered":"2026-02-20T03:14:38.744369+0000","last_clean":"2026-02-20T03:14:38.744369+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:14:38.744369+0000","last_undegraded":"2026-02-20T03:14:38.744369+0000","last_fullsized":"2026-02-20T03:14:38.744369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.359869+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:14:52.359869+0000","last_peered":"2026-02-20T03:14:52.359869+0000","last_clean":"2026-02-20T03:14:52.359869+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:14:52.359869+0000","last_undegraded":"2026-02-20T03:14:52.359869+0000","last_fullsized":"2026-02-20T03:14:52.359869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744027+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:14:38.744027+0000","last_peered":"2026-02-20T03:14:38.744027+0000","last_clean":"2026-02-20T03:14:38.744027+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:14:38.744027+0000","last_undegraded":"2026-02-20T03:14:38.744027+0000","last_fullsized":"2026-02-20T03:14:38.744027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743990+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:14:38.743990+0000","last_peered":"2026-02-20T03:14:38.743990+0000","last_clean":"2026-02-20T03:14:38.743990+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:14:38.743990+0000","last_undegraded":"2026-02-20T03:14:38.743990+0000","last_fullsized":"2026-02-20T03:14:38.743990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358752+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:14:51.358752+0000","last_peered":"2026-02-20T03:14:51.358752+0000","last_clean":"2026-02-20T03:14:51.358752+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:14:51.358752+0000","last_undegraded":"2026-02-20T03:14:51.358752+0000","last_fullsized":"2026-02-20T03:14:51.358752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311328+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:14:38.311328+0000","last_peered":"2026-02-20T03:14:38.311328+0000","last_clean":"2026-02-20T03:14:38.311328+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:14:38.311328+0000","last_undegraded":"2026-02-20T03:14:38.311328+0000","last_fullsized":"2026-02-20T03:14:38.311328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318042+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:14:38.318042+0000","last_peered":"2026-02-20T03:14:38.318042+0000","last_clean":"2026-02-20T03:14:38.318042+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:14:38.318042+0000","last_undegraded":"2026-02-20T03:14:38.318042+0000","last_fullsized":"2026-02-20T03:14:38.318042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:03.375410+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:03.375410+0000","last_peered":"2026-02-20T03:15:03.375410+0000","last_clean":"2026-02-20T03:15:03.375410+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:03.375410+0000","last_undegraded":"2026-02-20T03:15:03.375410+0000","last_fullsized":"2026-02-20T03:15:03.375410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743149+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:14:38.743149+0000","last_peered":"2026-02-20T03:14:38.743149+0000","last_clean":"2026-02-20T03:14:38.743149+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:14:38.743149+0000","last_undegraded":"2026-02-20T03:14:38.743149+0000","last_fullsized":"2026-02-20T03:14:38.743149+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318241+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:14:38.318241+0000","last_peered":"2026-02-20T03:14:38.318241+0000","last_clean":"2026-02-20T03:14:38.318241+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:14:38.318241+0000","last_undegraded":"2026-02-20T03:14:38.318241+0000","last_fullsized":"2026-02-20T03:14:38.318241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352270+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:14:50.352270+0000","last_peered":"2026-02-20T03:14:50.352270+0000","last_clean":"2026-02-20T03:14:50.352270+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:14:50.352270+0000","last_undegraded":"2026-02-20T03:14:50.352270+0000","last_fullsized":"2026-02-20T03:14:50.352270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744179+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:14:38.744179+0000","last_peered":"2026-02-20T03:14:38.744179+0000","last_clean":"2026-02-20T03:14:38.744179+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:14:38.744179+0000","last_undegraded":"2026-02-20T03:14:38.744179+0000","last_fullsized":"2026-02-20T03:14:38.744179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311740+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:14:38.311740+0000","last_peered":"2026-02-20T03:14:38.311740+0000","last_clean":"2026-02-20T03:14:38.311740+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:14:38.311740+0000","last_undegraded":"2026-02-20T03:14:38.311740+0000","last_fullsized":"2026-02-20T03:14:38.311740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356034+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:14:51.356034+0000","last_peered":"2026-02-20T03:14:51.356034+0000","last_clean":"2026-02-20T03:14:51.356034+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:14:51.356034+0000","last_undegraded":"2026-02-20T03:14:51.356034+0000","last_fullsized":"2026-02-20T03:14:51.356034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744303+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:14:38.744303+0000","last_peered":"2026-02-20T03:14:38.744303+0000","last_clean":"2026-02-20T03:14:38.744303+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:14:38.744303+0000","last_undegraded":"2026-02-20T03:14:38.744303+0000","last_fullsized":"2026-02-20T03:14:38.744303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744191+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:14:38.744191+0000","last_peered":"2026-02-20T03:14:38.744191+0000","last_clean":"2026-02-20T03:14:38.744191+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:14:38.744191+0000","last_undegraded":"2026-02-20T03:14:38.744191+0000","last_fullsized":"2026-02-20T03:14:38.744191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'28","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:04.378317+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:04.378317+0000","last_peered":"2026-02-20T03:15:04.378317+0000","last_clean":"2026-02-20T03:15:04.378317+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:04.378317+0000","last_undegraded":"2026-02-20T03:15:04.378317+0000","last_fullsized":"2026-02-20T03:15:04.378317+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63752,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":79,"num_write":29,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742256+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:14:38.742256+0000","last_peered":"2026-02-20T03:14:38.742256+0000","last_clean":"2026-02-20T03:14:38.742256+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:14:38.742256+0000","last_undegraded":"2026-02-20T03:14:38.742256+0000","last_fullsized":"2026-02-20T03:14:38.742256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749385+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:14:38.749385+0000","last_peered":"2026-02-20T03:14:38.749385+0000","last_clean":"2026-02-20T03:14:38.749385+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:14:38.749385+0000","last_undegraded":"2026-02-20T03:14:38.749385+0000","last_fullsized":"2026-02-20T03:14:38.749385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352990+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:14:50.352990+0000","last_peered":"2026-02-20T03:14:50.352990+0000","last_clean":"2026-02-20T03:14:50.352990+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:14:50.352990+0000","last_undegraded":"2026-02-20T03:14:50.352990+0000","last_fullsized":"2026-02-20T03:14:50.352990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.312040+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:14:38.312040+0000","last_peered":"2026-02-20T03:14:38.312040+0000","last_clean":"2026-02-20T03:14:38.312040+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:14:38.312040+0000","last_undegraded":"2026-02-20T03:14:38.312040+0000","last_fullsized":"2026-02-20T03:14:38.312040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.356807+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:14:50.356807+0000","last_peered":"2026-02-20T03:14:50.356807+0000","last_clean":"2026-02-20T03:14:50.356807+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:14:50.356807+0000","last_undegraded":"2026-02-20T03:14:50.356807+0000","last_fullsized":"2026-02-20T03:14:50.356807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743191+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:14:38.743191+0000","last_peered":"2026-02-20T03:14:38.743191+0000","last_clean":"2026-02-20T03:14:38.743191+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:14:38.743191+0000","last_undegraded":"2026-02-20T03:14:38.743191+0000","last_fullsized":"2026-02-20T03:14:38.743191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749609+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:14:38.749609+0000","last_peered":"2026-02-20T03:14:38.749609+0000","last_clean":"2026-02-20T03:14:38.749609+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:14:38.749609+0000","last_undegraded":"2026-02-20T03:14:38.749609+0000","last_fullsized":"2026-02-20T03:14:38.749609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:03.373264+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:03.373264+0000","last_peered":"2026-02-20T03:15:03.373264+0000","last_clean":"2026-02-20T03:15:03.373264+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:03.373264+0000","last_undegraded":"2026-02-20T03:15:03.373264+0000","last_fullsized":"2026-02-20T03:15:03.373264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743127+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:14:38.743127+0000","last_peered":"2026-02-20T03:14:38.743127+0000","last_clean":"2026-02-20T03:14:38.743127+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:14:38.743127+0000","last_undegraded":"2026-02-20T03:14:38.743127+0000","last_fullsized":"2026-02-20T03:14:38.743127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311932+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:14:38.311932+0000","last_peered":"2026-02-20T03:14:38.311932+0000","last_clean":"2026-02-20T03:14:38.311932+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:14:38.311932+0000","last_undegraded":"2026-02-20T03:14:38.311932+0000","last_fullsized":"2026-02-20T03:14:38.311932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742536+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:14:38.742536+0000","last_peered":"2026-02-20T03:14:38.742536+0000","last_clean":"2026-02-20T03:14:38.742536+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:14:38.742536+0000","last_undegraded":"2026-02-20T03:14:38.742536+0000","last_fullsized":"2026-02-20T03:14:38.742536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744067+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:14:38.744067+0000","last_peered":"2026-02-20T03:14:38.744067+0000","last_clean":"2026-02-20T03:14:38.744067+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:14:38.744067+0000","last_undegraded":"2026-02-20T03:14:38.744067+0000","last_fullsized":"2026-02-20T03:14:38.744067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744459+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:14:38.744459+0000","last_peered":"2026-02-20T03:14:38.744459+0000","last_clean":"2026-02-20T03:14:38.744459+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:14:38.744459+0000","last_undegraded":"2026-02-20T03:14:38.744459+0000","last_fullsized":"2026-02-20T03:14:38.744459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742665+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:14:38.742665+0000","last_peered":"2026-02-20T03:14:38.742665+0000","last_clean":"2026-02-20T03:14:38.742665+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:14:38.742665+0000","last_undegraded":"2026-02-20T03:14:38.742665+0000","last_fullsized":"2026-02-20T03:14:38.742665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356776+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:14:51.356776+0000","last_peered":"2026-02-20T03:14:51.356776+0000","last_clean":"2026-02-20T03:14:51.356776+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:14:51.356776+0000","last_undegraded":"2026-02-20T03:14:51.356776+0000","last_fullsized":"2026-02-20T03:14:51.356776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.361797+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:14:51.361797+0000","last_peered":"2026-02-20T03:14:51.361797+0000","last_clean":"2026-02-20T03:14:51.361797+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:14:51.361797+0000","last_undegraded":"2026-02-20T03:14:51.361797+0000","last_fullsized":"2026-02-20T03:14:51.361797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744227+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:14:38.744227+0000","last_peered":"2026-02-20T03:14:38.744227+0000","last_clean":"2026-02-20T03:14:38.744227+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:14:38.744227+0000","last_undegraded":"2026-02-20T03:14:38.744227+0000","last_fullsized":"2026-02-20T03:14:38.744227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744309+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:14:38.744309+0000","last_peered":"2026-02-20T03:14:38.744309+0000","last_clean":"2026-02-20T03:14:38.744309+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:14:38.744309+0000","last_undegraded":"2026-02-20T03:14:38.744309+0000","last_fullsized":"2026-02-20T03:14:38.744309+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:02.367589+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:02.367589+0000","last_peered":"2026-02-20T03:15:02.367589+0000","last_clean":"2026-02-20T03:15:02.367589+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:02.367589+0000","last_undegraded":"2026-02-20T03:15:02.367589+0000","last_fullsized":"2026-02-20T03:15:02.367589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744076+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:14:38.744076+0000","last_peered":"2026-02-20T03:14:38.744076+0000","last_clean":"2026-02-20T03:14:38.744076+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:14:38.744076+0000","last_undegraded":"2026-02-20T03:14:38.744076+0000","last_fullsized":"2026-02-20T03:14:38.744076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744370+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:14:38.744370+0000","last_peered":"2026-02-20T03:14:38.744370+0000","last_clean":"2026-02-20T03:14:38.744370+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:14:38.744370+0000","last_undegraded":"2026-02-20T03:14:38.744370+0000","last_fullsized":"2026-02-20T03:14:38.744370+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743873+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:14:38.743873+0000","last_peered":"2026-02-20T03:14:38.743873+0000","last_clean":"2026-02-20T03:14:38.743873+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:14:38.743873+0000","last_undegraded":"2026-02-20T03:14:38.743873+0000","last_fullsized":"2026-02-20T03:14:38.743873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744166+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:14:38.744166+0000","last_peered":"2026-02-20T03:14:38.744166+0000","last_clean":"2026-02-20T03:14:38.744166+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:14:38.744166+0000","last_undegraded":"2026-02-20T03:14:38.744166+0000","last_fullsized":"2026-02-20T03:14:38.744166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311828+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:14:38.311828+0000","last_peered":"2026-02-20T03:14:38.311828+0000","last_clean":"2026-02-20T03:14:38.311828+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:14:38.311828+0000","last_undegraded":"2026-02-20T03:14:38.311828+0000","last_fullsized":"2026-02-20T03:14:38.311828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311110+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:14:38.311110+0000","last_peered":"2026-02-20T03:14:38.311110+0000","last_clean":"2026-02-20T03:14:38.311110+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:14:38.311110+0000","last_undegraded":"2026-02-20T03:14:38.311110+0000","last_fullsized":"2026-02-20T03:14:38.311110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744275+0000","last_change":"2026-02-20T03:14:33.290769+0000","last_active":"2026-02-20T03:14:38.744275+0000","last_peered":"2026-02-20T03:14:38.744275+0000","last_clean":"2026-02-20T03:14:38.744275+0000","last_became_active":"2026-02-20T03:14:33.290406+0000","last_became_peered":"2026-02-20T03:14:33.290406+0000","last_unstale":"2026-02-20T03:14:38.744275+0000","last_undegraded":"2026-02-20T03:14:38.744275+0000","last_fullsized":"2026-02-20T03:14:38.744275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:58.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744400+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:14:38.744400+0000","last_peered":"2026-02-20T03:14:38.744400+0000","last_clean":"2026-02-20T03:14:38.744400+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:14:38.744400+0000","last_undegraded":"2026-02-20T03:14:38.744400+0000","last_fullsized":"2026-02-20T03:14:38.744400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742977+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:14:38.742977+0000","last_peered":"2026-02-20T03:14:38.742977+0000","last_clean":"2026-02-20T03:14:38.742977+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:14:38.742977+0000","last_undegraded":"2026-02-20T03:14:38.742977+0000","last_fullsized":"2026-02-20T03:14:38.742977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743959+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:14:38.743959+0000","last_peered":"2026-02-20T03:14:38.743959+0000","last_clean":"2026-02-20T03:14:38.743959+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:14:38.743959+0000","last_undegraded":"2026-02-20T03:14:38.743959+0000","last_fullsized":"2026-02-20T03:14:38.743959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743157+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:14:38.743157+0000","last_peered":"2026-02-20T03:14:38.743157+0000","last_clean":"2026-02-20T03:14:38.743157+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:14:38.743157+0000","last_undegraded":"2026-02-20T03:14:38.743157+0000","last_fullsized":"2026-02-20T03:14:38.743157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749238+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:14:38.749238+0000","last_peered":"2026-02-20T03:14:38.749238+0000","last_clean":"2026-02-20T03:14:38.749238+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:14:38.749238+0000","last_undegraded":"2026-02-20T03:14:38.749238+0000","last_fullsized":"2026-02-20T03:14:38.749238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311289+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:14:38.311289+0000","last_peered":"2026-02-20T03:14:38.311289+0000","last_clean":"2026-02-20T03:14:38.311289+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:14:38.311289+0000","last_undegraded":"2026-02-20T03:14:38.311289+0000","last_fullsized":"2026-02-20T03:14:38.311289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744096+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:14:38.744096+0000","last_peered":"2026-02-20T03:14:38.744096+0000","last_clean":"2026-02-20T03:14:38.744096+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:14:38.744096+0000","last_undegraded":"2026-02-20T03:14:38.744096+0000","last_fullsized":"2026-02-20T03:14:38.744096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744472+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:14:38.744472+0000","last_peered":"2026-02-20T03:14:38.744472+0000","last_clean":"2026-02-20T03:14:38.744472+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:14:38.744472+0000","last_undegraded":"2026-02-20T03:14:38.744472+0000","last_fullsized":"2026-02-20T03:14:38.744472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742612+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:14:38.742612+0000","last_peered":"2026-02-20T03:14:38.742612+0000","last_clean":"2026-02-20T03:14:38.742612+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:14:38.742612+0000","last_undegraded":"2026-02-20T03:14:38.742612+0000","last_fullsized":"2026-02-20T03:14:38.742612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744492+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:14:38.744492+0000","last_peered":"2026-02-20T03:14:38.744492+0000","last_clean":"2026-02-20T03:14:38.744492+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:14:38.744492+0000","last_undegraded":"2026-02-20T03:14:38.744492+0000","last_fullsized":"2026-02-20T03:14:38.744492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.748833+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:14:38.748833+0000","last_peered":"2026-02-20T03:14:38.748833+0000","last_clean":"2026-02-20T03:14:38.748833+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:14:38.748833+0000","last_undegraded":"2026-02-20T03:14:38.748833+0000","last_fullsized":"2026-02-20T03:14:38.748833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311670+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:14:38.311670+0000","last_peered":"2026-02-20T03:14:38.311670+0000","last_clean":"2026-02-20T03:14:38.311670+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:14:38.311670+0000","last_undegraded":"2026-02-20T03:14:38.311670+0000","last_fullsized":"2026-02-20T03:14:38.311670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311568+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:14:38.311568+0000","last_peered":"2026-02-20T03:14:38.311568+0000","last_clean":"2026-02-20T03:14:38.311568+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:14:38.311568+0000","last_undegraded":"2026-02-20T03:14:38.311568+0000","last_fullsized":"2026-02-20T03:14:38.311568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311264+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:14:38.311264+0000","last_peered":"2026-02-20T03:14:38.311264+0000","last_clean":"2026-02-20T03:14:38.311264+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:14:38.311264+0000","last_undegraded":"2026-02-20T03:14:38.311264+0000","last_fullsized":"2026-02-20T03:14:38.311264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318524+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:14:38.318524+0000","last_peered":"2026-02-20T03:14:38.318524+0000","last_clean":"2026-02-20T03:14:38.318524+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:14:38.318524+0000","last_undegraded":"2026-02-20T03:14:38.318524+0000","last_fullsized":"2026-02-20T03:14:38.318524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479875+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:14:38.479875+0000","last_peered":"2026-02-20T03:14:38.479875+0000","last_clean":"2026-02-20T03:14:38.479875+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:14:38.479875+0000","last_undegraded":"2026-02-20T03:14:38.479875+0000","last_fullsized":"2026-02-20T03:14:38.479875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749648+0000","last_change":"2026-02-20T03:14:33.295988+0000","last_active":"2026-02-20T03:14:38.749648+0000","last_peered":"2026-02-20T03:14:38.749648+0000","last_clean":"2026-02-20T03:14:38.749648+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749648+0000","last_undegraded":"2026-02-20T03:14:38.749648+0000","last_fullsized":"2026-02-20T03:14:38.749648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:12:01.602799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742670+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:14:38.742670+0000","last_peered":"2026-02-20T03:14:38.742670+0000","last_clean":"2026-02-20T03:14:38.742670+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:14:38.742670+0000","last_undegraded":"2026-02-20T03:14:38.742670+0000","last_fullsized":"2026-02-20T03:14:38.742670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318097+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:14:38.318097+0000","last_peered":"2026-02-20T03:14:38.318097+0000","last_clean":"2026-02-20T03:14:38.318097+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:14:38.318097+0000","last_undegraded":"2026-02-20T03:14:38.318097+0000","last_fullsized":"2026-02-20T03:14:38.318097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479297+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:14:38.479297+0000","last_peered":"2026-02-20T03:14:38.479297+0000","last_clean":"2026-02-20T03:14:38.479297+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:14:38.479297+0000","last_undegraded":"2026-02-20T03:14:38.479297+0000","last_fullsized":"2026-02-20T03:14:38.479297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743970+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:14:38.743970+0000","last_peered":"2026-02-20T03:14:38.743970+0000","last_clean":"2026-02-20T03:14:38.743970+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:14:38.743970+0000","last_undegraded":"2026-02-20T03:14:38.743970+0000","last_fullsized":"2026-02-20T03:14:38.743970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311798+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:14:38.311798+0000","last_peered":"2026-02-20T03:14:38.311798+0000","last_clean":"2026-02-20T03:14:38.311798+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:14:38.311798+0000","last_undegraded":"2026-02-20T03:14:38.311798+0000","last_fullsized":"2026-02-20T03:14:38.311798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311904+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:14:38.311904+0000","last_peered":"2026-02-20T03:14:38.311904+0000","last_clean":"2026-02-20T03:14:38.311904+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:14:38.311904+0000","last_undegraded":"2026-02-20T03:14:38.311904+0000","last_fullsized":"2026-02-20T03:14:38.311904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744466+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:14:38.744466+0000","last_peered":"2026-02-20T03:14:38.744466+0000","last_clean":"2026-02-20T03:14:38.744466+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:14:38.744466+0000","last_undegraded":"2026-02-20T03:14:38.744466+0000","last_fullsized":"2026-02-20T03:14:38.744466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67784,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":101,"num_read_kb":122,"num_write":160,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383692,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971104,"statfs":{"total":751619276800,"available":751586410496,"internally_reserved":0,"allocated":995328,"data_stored":484050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612622,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32772,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970428,"statfs":{"total":751619276800,"available":751585718272,"internally_reserved":0,"allocated":1687552,"data_stored":1135462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776144,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":488382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037778,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32112,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971088,"statfs":{"total":751619276800,"available":751586394112,"internally_reserved":0,"allocated":1011712,"data_stored":484206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299412,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32692,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970508,"statfs":{"total":751619276800,"available":751585800192,"internally_reserved":0,"allocated":1605632,"data_stored":1080116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462934,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":479452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724569,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28540,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974660,"statfs":{"total":751619276800,"available":751590051840,"internally_reserved":0,"allocated":1613824,"data_stored":1075312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888091,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971096,"statfs":{"total":751619276800,"available":751586402304,"internally_reserved":0,"allocated":1003520,"data_stored":484494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149725,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27944,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975256,"statfs":{"total":751619276800,"available":751590662144,"internally_reserved":0,"allocated":1003520,"data_stored":479646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378655,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28012,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975188,"statfs":{"total":751619276800,"available":751590592512,"internally_reserved":0,"allocated":1073152,"data_stored":531875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27988,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975212,"statfs":{"total":751619276800,"available":751590617088,"internally_reserved":0,"allocated":1048576,"data_stored":530515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":480860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":51153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:07.112 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T03:15:07.374 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:07.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.559+0000 7f8b3ffff640 1 -- 10.20.193.28:0/843686485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 msgr2=0x7f8b40104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:07.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.559+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/843686485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 0x7f8b40104de0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009a60 tx=0x7f8b2802f250 comp rx=0 tx=0).stop 2026-02-20T03:15:07.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.559+0000 7f8b3ffff640 1 -- 10.20.193.28:0/843686485 shutdown_connections 2026-02-20T03:15:07.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.559+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/843686485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b40105320 0x7f8b40111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:07.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.559+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/843686485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 0x7f8b40104de0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:07.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.559+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/843686485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b4010a980 0x7f8b4010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:07.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.559+0000 7f8b3ffff640 1 -- 10.20.193.28:0/843686485 >> 10.20.193.28:0/843686485 conn(0x7f8b40100680 msgr2=0x7f8b40102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:07.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.559+0000 7f8b3ffff640 1 -- 10.20.193.28:0/843686485 shutdown_connections 2026-02-20T03:15:07.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.559+0000 7f8b3ffff640 1 -- 10.20.193.28:0/843686485 wait complete. 2026-02-20T03:15:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.560+0000 7f8b3ffff640 1 Processor -- start 2026-02-20T03:15:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.560+0000 7f8b3ffff640 1 -- start start 2026-02-20T03:15:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 0x7f8b4019d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b40105320 0x7f8b4019d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b4010a980 0x7f8b401a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40114bb0 con 0x7f8b40104980 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40114a30 con 0x7f8b4010a980 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8b40114d30 con 0x7f8b40105320 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 0x7f8b4019d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 0x7f8b4019d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40256/0 (socket says 10.20.193.28:40256) 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3effd640 1 -- 10.20.193.28:0/1133358500 learned_addr learned my addr 10.20.193.28:0/1133358500 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3e7fc640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b40105320 0x7f8b4019d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3f7fe640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b4010a980 0x7f8b401a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3effd640 1 -- 10.20.193.28:0/1133358500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b40105320 msgr2=0x7f8b4019d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3effd640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b40105320 0x7f8b4019d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3effd640 1 -- 10.20.193.28:0/1133358500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b4010a980 msgr2=0x7f8b401a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3effd640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b4010a980 0x7f8b401a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.561+0000 7f8b3effd640 1 -- 10.20.193.28:0/1133358500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b401a2100 con 0x7f8b40104980 2026-02-20T03:15:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.562+0000 7f8b3effd640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 0x7f8b4019d0b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400d950 tx=0x7f8b3400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.562+0000 7f8b1ffff640 1 -- 10.20.193.28:0/1133358500 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34014070 con 0x7f8b40104980 2026-02-20T03:15:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.562+0000 7f8b1ffff640 1 -- 10.20.193.28:0/1133358500 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8b340044e0 con 0x7f8b40104980 2026-02-20T03:15:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.562+0000 7f8b1ffff640 1 -- 10.20.193.28:0/1133358500 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b34010460 con 0x7f8b40104980 2026-02-20T03:15:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.562+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b401a23f0 con 0x7f8b40104980 2026-02-20T03:15:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.562+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b401a9c30 con 0x7f8b40104980 2026-02-20T03:15:07.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.563+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b40104de0 con 0x7f8b40104980 2026-02-20T03:15:07.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.564+0000 7f8b1ffff640 1 -- 10.20.193.28:0/1133358500 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f8b340026e0 con 0x7f8b40104980 2026-02-20T03:15:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.566+0000 7f8b1ffff640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b140b0eb0 0x7f8b140b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.566+0000 7f8b1ffff640 1 -- 10.20.193.28:0/1133358500 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f8b340e0460 con 0x7f8b40104980 2026-02-20T03:15:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.566+0000 7f8b3e7fc640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b140b0eb0 0x7f8b140b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.567+0000 7f8b3e7fc640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b140b0eb0 0x7f8b140b3370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b28005bb0 tx=0x7f8b28005b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:07.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.567+0000 7f8b1ffff640 1 -- 10.20.193.28:0/1133358500 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8b340ac590 con 0x7f8b40104980 2026-02-20T03:15:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.657+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b4010cb60 con 0x7f8b140b0eb0 2026-02-20T03:15:07.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.662+0000 7f8b1ffff640 1 -- 10.20.193.28:0/1133358500 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340386 (secure 0 0 0) 0x7f8b4010cb60 con 0x7f8b140b0eb0 2026-02-20T03:15:07.668 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:07.669 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b140b0eb0 msgr2=0x7f8b140b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b140b0eb0 0x7f8b140b3370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b28005bb0 tx=0x7f8b28005b40 comp rx=0 tx=0).stop 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 msgr2=0x7f8b4019d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 0x7f8b4019d0b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400d950 tx=0x7f8b3400de20 comp rx=0 tx=0).stop 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 shutdown_connections 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b140b0eb0 0x7f8b140b3370 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b4010a980 0x7f8b401a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b40105320 0x7f8b4019d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 --2- 10.20.193.28:0/1133358500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b40104980 0x7f8b4019d0b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 >> 10.20.193.28:0/1133358500 conn(0x7f8b40100680 msgr2=0x7f8b40100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 shutdown_connections 2026-02-20T03:15:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:07.665+0000 7f8b3ffff640 1 -- 10.20.193.28:0/1133358500 wait complete. 2026-02-20T03:15:07.678 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:07 trial028 ceph-mon[38552]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:07.804 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2026-02-20T03:15:06.005192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658386,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":207,"num_read_kb":213,"num_write":351,"num_write_kb":3834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":291,"ondisk_log_size":291,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358104,"kb_used_data":13736,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807680296,"statfs":{"total":9019431321600,"available":9019064623104,"internally_reserved":0,"allocated":14065664,"data_stored":7734370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":62521,"num_objects":23,"num_object_clones":0,"num_object_copies":71,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":95,"num_read_kb":116,"num_write":74,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002560"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.357986+0000","last_change":"2026-02-20T03:14:32.081180+0000","last_active":"2026-02-20T03:14:51.357986+0000","last_peered":"2026-02-20T03:14:51.357986+0000","last_clean":"2026-02-20T03:14:51.357986+0000","last_became_active":"2026-02-20T03:14:32.081083+0000","last_became_peered":"2026-02-20T03:14:32.081083+0000","last_unstale":"2026-02-20T03:14:51.357986+0000","last_undegraded":"2026-02-20T03:14:51.357986+0000","last_fullsized":"2026-02-20T03:14:51.357986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:23:16.897948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743323+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:14:38.743323+0000","last_peered":"2026-02-20T03:14:38.743323+0000","last_clean":"2026-02-20T03:14:38.743323+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:14:38.743323+0000","last_undegraded":"2026-02-20T03:14:38.743323+0000","last_fullsized":"2026-02-20T03:14:38.743323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743964+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:14:38.743964+0000","last_peered":"2026-02-20T03:14:38.743964+0000","last_clean":"2026-02-20T03:14:38.743964+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:14:38.743964+0000","last_undegraded":"2026-02-20T03:14:38.743964+0000","last_fullsized":"2026-02-20T03:14:38.743964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743404+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:14:38.743404+0000","last_peered":"2026-02-20T03:14:38.743404+0000","last_clean":"2026-02-20T03:14:38.743404+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:14:38.743404+0000","last_undegraded":"2026-02-20T03:14:38.743404+0000","last_fullsized":"2026-02-20T03:14:38.743404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311999+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:14:38.311999+0000","last_peered":"2026-02-20T03:14:38.311999+0000","last_clean":"2026-02-20T03:14:38.311999+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:14:38.311999+0000","last_undegraded":"2026-02-20T03:14:38.311999+0000","last_fullsized":"2026-02-20T03:14:38.311999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356040+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:14:51.356040+0000","last_peered":"2026-02-20T03:14:51.356040+0000","last_clean":"2026-02-20T03:14:51.356040+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:14:51.356040+0000","last_undegraded":"2026-02-20T03:14:51.356040+0000","last_fullsized":"2026-02-20T03:14:51.356040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749309+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:14:38.749309+0000","last_peered":"2026-02-20T03:14:38.749309+0000","last_clean":"2026-02-20T03:14:38.749309+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:14:38.749309+0000","last_undegraded":"2026-02-20T03:14:38.749309+0000","last_fullsized":"2026-02-20T03:14:38.749309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744316+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:14:38.744316+0000","last_peered":"2026-02-20T03:14:38.744316+0000","last_clean":"2026-02-20T03:14:38.744316+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:14:38.744316+0000","last_undegraded":"2026-02-20T03:14:38.744316+0000","last_fullsized":"2026-02-20T03:14:38.744316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744230+0000","last_change":"2026-02-20T03:14:33.291255+0000","last_active":"2026-02-20T03:14:38.744230+0000","last_peered":"2026-02-20T03:14:38.744230+0000","last_clean":"2026-02-20T03:14:38.744230+0000","last_became_active":"2026-02-20T03:14:33.291089+0000","last_became_peered":"2026-02-20T03:14:33.291089+0000","last_unstale":"2026-02-20T03:14:38.744230+0000","last_undegraded":"2026-02-20T03:14:38.744230+0000","last_fullsized":"2026-02-20T03:14:38.744230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:42:45.321761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318208+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:14:38.318208+0000","last_peered":"2026-02-20T03:14:38.318208+0000","last_clean":"2026-02-20T03:14:38.318208+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:14:38.318208+0000","last_undegraded":"2026-02-20T03:14:38.318208+0000","last_fullsized":"2026-02-20T03:14:38.318208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351492+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:14:50.351492+0000","last_peered":"2026-02-20T03:14:50.351492+0000","last_clean":"2026-02-20T03:14:50.351492+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:14:50.351492+0000","last_undegraded":"2026-02-20T03:14:50.351492+0000","last_fullsized":"2026-02-20T03:14:50.351492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742908+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:14:38.742908+0000","last_peered":"2026-02-20T03:14:38.742908+0000","last_clean":"2026-02-20T03:14:38.742908+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:14:38.742908+0000","last_undegraded":"2026-02-20T03:14:38.742908+0000","last_fullsized":"2026-02-20T03:14:38.742908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744042+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:14:38.744042+0000","last_peered":"2026-02-20T03:14:38.744042+0000","last_clean":"2026-02-20T03:14:38.744042+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:14:38.744042+0000","last_undegraded":"2026-02-20T03:14:38.744042+0000","last_fullsized":"2026-02-20T03:14:38.744042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:40.062667+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:40.062667+0000","last_peered":"2026-02-20T03:14:40.062667+0000","last_clean":"2026-02-20T03:14:40.062667+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:40.062667+0000","last_undegraded":"2026-02-20T03:14:40.062667+0000","last_fullsized":"2026-02-20T03:14:40.062667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743910+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:14:38.743910+0000","last_peered":"2026-02-20T03:14:38.743910+0000","last_clean":"2026-02-20T03:14:38.743910+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:14:38.743910+0000","last_undegraded":"2026-02-20T03:14:38.743910+0000","last_fullsized":"2026-02-20T03:14:38.743910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351649+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:14:50.351649+0000","last_peered":"2026-02-20T03:14:50.351649+0000","last_clean":"2026-02-20T03:14:50.351649+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:14:50.351649+0000","last_undegraded":"2026-02-20T03:14:50.351649+0000","last_fullsized":"2026-02-20T03:14:50.351649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742825+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:14:38.742825+0000","last_peered":"2026-02-20T03:14:38.742825+0000","last_clean":"2026-02-20T03:14:38.742825+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:14:38.742825+0000","last_undegraded":"2026-02-20T03:14:38.742825+0000","last_fullsized":"2026-02-20T03:14:38.742825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743900+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:14:38.743900+0000","last_peered":"2026-02-20T03:14:38.743900+0000","last_clean":"2026-02-20T03:14:38.743900+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:14:38.743900+0000","last_undegraded":"2026-02-20T03:14:38.743900+0000","last_fullsized":"2026-02-20T03:14:38.743900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357481+0000","last_change":"2026-02-20T03:14:32.086899+0000","last_active":"2026-02-20T03:14:50.357481+0000","last_peered":"2026-02-20T03:14:50.357481+0000","last_clean":"2026-02-20T03:14:50.357481+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357481+0000","last_undegraded":"2026-02-20T03:14:50.357481+0000","last_fullsized":"2026-02-20T03:14:50.357481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:29:02.472130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311960+0000","last_change":"2026-02-20T03:14:33.298094+0000","last_active":"2026-02-20T03:14:38.311960+0000","last_peered":"2026-02-20T03:14:38.311960+0000","last_clean":"2026-02-20T03:14:38.311960+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311960+0000","last_undegraded":"2026-02-20T03:14:38.311960+0000","last_fullsized":"2026-02-20T03:14:38.311960+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:14:52.233571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744071+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:14:38.744071+0000","last_peered":"2026-02-20T03:14:38.744071+0000","last_clean":"2026-02-20T03:14:38.744071+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:14:38.744071+0000","last_undegraded":"2026-02-20T03:14:38.744071+0000","last_fullsized":"2026-02-20T03:14:38.744071+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743028+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:14:38.743028+0000","last_peered":"2026-02-20T03:14:38.743028+0000","last_clean":"2026-02-20T03:14:38.743028+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:14:38.743028+0000","last_undegraded":"2026-02-20T03:14:38.743028+0000","last_fullsized":"2026-02-20T03:14:38.743028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:00.293338+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:00.293338+0000","last_peered":"2026-02-20T03:15:00.293338+0000","last_clean":"2026-02-20T03:15:00.293338+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:00.293338+0000","last_undegraded":"2026-02-20T03:15:00.293338+0000","last_fullsized":"2026-02-20T03:15:00.293338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742399+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:14:38.742399+0000","last_peered":"2026-02-20T03:14:38.742399+0000","last_clean":"2026-02-20T03:14:38.742399+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:14:38.742399+0000","last_undegraded":"2026-02-20T03:14:38.742399+0000","last_fullsized":"2026-02-20T03:14:38.742399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311146+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:14:38.311146+0000","last_peered":"2026-02-20T03:14:38.311146+0000","last_clean":"2026-02-20T03:14:38.311146+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:14:38.311146+0000","last_undegraded":"2026-02-20T03:14:38.311146+0000","last_fullsized":"2026-02-20T03:14:38.311146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352941+0000","last_change":"2026-02-20T03:14:32.081021+0000","last_active":"2026-02-20T03:14:50.352941+0000","last_peered":"2026-02-20T03:14:50.352941+0000","last_clean":"2026-02-20T03:14:50.352941+0000","last_became_active":"2026-02-20T03:14:32.080799+0000","last_became_peered":"2026-02-20T03:14:32.080799+0000","last_unstale":"2026-02-20T03:14:50.352941+0000","last_undegraded":"2026-02-20T03:14:50.352941+0000","last_fullsized":"2026-02-20T03:14:50.352941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:15.834880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744093+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:14:38.744093+0000","last_peered":"2026-02-20T03:14:38.744093+0000","last_clean":"2026-02-20T03:14:38.744093+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:14:38.744093+0000","last_undegraded":"2026-02-20T03:14:38.744093+0000","last_fullsized":"2026-02-20T03:14:38.744093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479703+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:14:38.479703+0000","last_peered":"2026-02-20T03:14:38.479703+0000","last_clean":"2026-02-20T03:14:38.479703+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:14:38.479703+0000","last_undegraded":"2026-02-20T03:14:38.479703+0000","last_fullsized":"2026-02-20T03:14:38.479703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742701+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:14:38.742701+0000","last_peered":"2026-02-20T03:14:38.742701+0000","last_clean":"2026-02-20T03:14:38.742701+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:14:38.742701+0000","last_undegraded":"2026-02-20T03:14:38.742701+0000","last_fullsized":"2026-02-20T03:14:38.742701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744036+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:14:38.744036+0000","last_peered":"2026-02-20T03:14:38.744036+0000","last_clean":"2026-02-20T03:14:38.744036+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:14:38.744036+0000","last_undegraded":"2026-02-20T03:14:38.744036+0000","last_fullsized":"2026-02-20T03:14:38.744036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479538+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:14:38.479538+0000","last_peered":"2026-02-20T03:14:38.479538+0000","last_clean":"2026-02-20T03:14:38.479538+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:14:38.479538+0000","last_undegraded":"2026-02-20T03:14:38.479538+0000","last_fullsized":"2026-02-20T03:14:38.479538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318364+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:14:38.318364+0000","last_peered":"2026-02-20T03:14:38.318364+0000","last_clean":"2026-02-20T03:14:38.318364+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:14:38.318364+0000","last_undegraded":"2026-02-20T03:14:38.318364+0000","last_fullsized":"2026-02-20T03:14:38.318364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311210+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:14:38.311210+0000","last_peered":"2026-02-20T03:14:38.311210+0000","last_clean":"2026-02-20T03:14:38.311210+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:14:38.311210+0000","last_undegraded":"2026-02-20T03:14:38.311210+0000","last_fullsized":"2026-02-20T03:14:38.311210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.290483+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.289779+0000","last_became_peered":"2026-02-20T03:14:33.289779+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:45:10.985058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:01.366561+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:01.366561+0000","last_peered":"2026-02-20T03:15:01.366561+0000","last_clean":"2026-02-20T03:15:01.366561+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:01.366561+0000","last_undegraded":"2026-02-20T03:15:01.366561+0000","last_fullsized":"2026-02-20T03:15:01.366561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311164+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:14:38.311164+0000","last_peered":"2026-02-20T03:14:38.311164+0000","last_clean":"2026-02-20T03:14:38.311164+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:14:38.311164+0000","last_undegraded":"2026-02-20T03:14:38.311164+0000","last_fullsized":"2026-02-20T03:14:38.311164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.310925+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:14:38.310925+0000","last_peered":"2026-02-20T03:14:38.310925+0000","last_clean":"2026-02-20T03:14:38.310925+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:14:38.310925+0000","last_undegraded":"2026-02-20T03:14:38.310925+0000","last_fullsized":"2026-02-20T03:14:38.310925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.360846+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:14:51.360846+0000","last_peered":"2026-02-20T03:14:51.360846+0000","last_clean":"2026-02-20T03:14:51.360846+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:14:51.360846+0000","last_undegraded":"2026-02-20T03:14:51.360846+0000","last_fullsized":"2026-02-20T03:14:51.360846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744423+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:14:38.744423+0000","last_peered":"2026-02-20T03:14:38.744423+0000","last_clean":"2026-02-20T03:14:38.744423+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:14:38.744423+0000","last_undegraded":"2026-02-20T03:14:38.744423+0000","last_fullsized":"2026-02-20T03:14:38.744423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743435+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:14:38.743435+0000","last_peered":"2026-02-20T03:14:38.743435+0000","last_clean":"2026-02-20T03:14:38.743435+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:14:38.743435+0000","last_undegraded":"2026-02-20T03:14:38.743435+0000","last_fullsized":"2026-02-20T03:14:38.743435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318242+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:14:38.318242+0000","last_peered":"2026-02-20T03:14:38.318242+0000","last_clean":"2026-02-20T03:14:38.318242+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:14:38.318242+0000","last_undegraded":"2026-02-20T03:14:38.318242+0000","last_fullsized":"2026-02-20T03:14:38.318242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318423+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:14:38.318423+0000","last_peered":"2026-02-20T03:14:38.318423+0000","last_clean":"2026-02-20T03:14:38.318423+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:14:38.318423+0000","last_undegraded":"2026-02-20T03:14:38.318423+0000","last_fullsized":"2026-02-20T03:14:38.318423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318536+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:14:38.318536+0000","last_peered":"2026-02-20T03:14:38.318536+0000","last_clean":"2026-02-20T03:14:38.318536+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:14:38.318536+0000","last_undegraded":"2026-02-20T03:14:38.318536+0000","last_fullsized":"2026-02-20T03:14:38.318536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358847+0000","last_change":"2026-02-20T03:14:32.079575+0000","last_active":"2026-02-20T03:14:51.358847+0000","last_peered":"2026-02-20T03:14:51.358847+0000","last_clean":"2026-02-20T03:14:51.358847+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:51.358847+0000","last_undegraded":"2026-02-20T03:14:51.358847+0000","last_fullsized":"2026-02-20T03:14:51.358847+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:32:22.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749026+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:14:38.749026+0000","last_peered":"2026-02-20T03:14:38.749026+0000","last_clean":"2026-02-20T03:14:38.749026+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:14:38.749026+0000","last_undegraded":"2026-02-20T03:14:38.749026+0000","last_fullsized":"2026-02-20T03:14:38.749026+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318340+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:14:38.318340+0000","last_peered":"2026-02-20T03:14:38.318340+0000","last_clean":"2026-02-20T03:14:38.318340+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:14:38.318340+0000","last_undegraded":"2026-02-20T03:14:38.318340+0000","last_fullsized":"2026-02-20T03:14:38.318340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744433+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:14:38.744433+0000","last_peered":"2026-02-20T03:14:38.744433+0000","last_clean":"2026-02-20T03:14:38.744433+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:14:38.744433+0000","last_undegraded":"2026-02-20T03:14:38.744433+0000","last_fullsized":"2026-02-20T03:14:38.744433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311766+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:14:38.311766+0000","last_peered":"2026-02-20T03:14:38.311766+0000","last_clean":"2026-02-20T03:14:38.311766+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:14:38.311766+0000","last_undegraded":"2026-02-20T03:14:38.311766+0000","last_fullsized":"2026-02-20T03:14:38.311766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318490+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:14:38.318490+0000","last_peered":"2026-02-20T03:14:38.318490+0000","last_clean":"2026-02-20T03:14:38.318490+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:14:38.318490+0000","last_undegraded":"2026-02-20T03:14:38.318490+0000","last_fullsized":"2026-02-20T03:14:38.318490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311359+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:14:38.311359+0000","last_peered":"2026-02-20T03:14:38.311359+0000","last_clean":"2026-02-20T03:14:38.311359+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:14:38.311359+0000","last_undegraded":"2026-02-20T03:14:38.311359+0000","last_fullsized":"2026-02-20T03:14:38.311359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743916+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:14:38.743916+0000","last_peered":"2026-02-20T03:14:38.743916+0000","last_clean":"2026-02-20T03:14:38.743916+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:14:38.743916+0000","last_undegraded":"2026-02-20T03:14:38.743916+0000","last_fullsized":"2026-02-20T03:14:38.743916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744369+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:14:38.744369+0000","last_peered":"2026-02-20T03:14:38.744369+0000","last_clean":"2026-02-20T03:14:38.744369+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:14:38.744369+0000","last_undegraded":"2026-02-20T03:14:38.744369+0000","last_fullsized":"2026-02-20T03:14:38.744369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.359869+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:14:52.359869+0000","last_peered":"2026-02-20T03:14:52.359869+0000","last_clean":"2026-02-20T03:14:52.359869+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:14:52.359869+0000","last_undegraded":"2026-02-20T03:14:52.359869+0000","last_fullsized":"2026-02-20T03:14:52.359869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744027+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:14:38.744027+0000","last_peered":"2026-02-20T03:14:38.744027+0000","last_clean":"2026-02-20T03:14:38.744027+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:14:38.744027+0000","last_undegraded":"2026-02-20T03:14:38.744027+0000","last_fullsized":"2026-02-20T03:14:38.744027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743990+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:14:38.743990+0000","last_peered":"2026-02-20T03:14:38.743990+0000","last_clean":"2026-02-20T03:14:38.743990+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:14:38.743990+0000","last_undegraded":"2026-02-20T03:14:38.743990+0000","last_fullsized":"2026-02-20T03:14:38.743990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358752+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:14:51.358752+0000","last_peered":"2026-02-20T03:14:51.358752+0000","last_clean":"2026-02-20T03:14:51.358752+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:14:51.358752+0000","last_undegraded":"2026-02-20T03:14:51.358752+0000","last_fullsized":"2026-02-20T03:14:51.358752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311328+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:14:38.311328+0000","last_peered":"2026-02-20T03:14:38.311328+0000","last_clean":"2026-02-20T03:14:38.311328+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:14:38.311328+0000","last_undegraded":"2026-02-20T03:14:38.311328+0000","last_fullsized":"2026-02-20T03:14:38.311328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318042+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:14:38.318042+0000","last_peered":"2026-02-20T03:14:38.318042+0000","last_clean":"2026-02-20T03:14:38.318042+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:14:38.318042+0000","last_undegraded":"2026-02-20T03:14:38.318042+0000","last_fullsized":"2026-02-20T03:14:38.318042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:03.375410+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:03.375410+0000","last_peered":"2026-02-20T03:15:03.375410+0000","last_clean":"2026-02-20T03:15:03.375410+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:03.375410+0000","last_undegraded":"2026-02-20T03:15:03.375410+0000","last_fullsized":"2026-02-20T03:15:03.375410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743149+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:14:38.743149+0000","last_peered":"2026-02-20T03:14:38.743149+0000","last_clean":"2026-02-20T03:14:38.743149+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:14:38.743149+0000","last_undegraded":"2026-02-20T03:14:38.743149+0000","last_fullsized":"2026-02-20T03:14:38.743149+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318241+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:14:38.318241+0000","last_peered":"2026-02-20T03:14:38.318241+0000","last_clean":"2026-02-20T03:14:38.318241+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:14:38.318241+0000","last_undegraded":"2026-02-20T03:14:38.318241+0000","last_fullsized":"2026-02-20T03:14:38.318241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352270+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:14:50.352270+0000","last_peered":"2026-02-20T03:14:50.352270+0000","last_clean":"2026-02-20T03:14:50.352270+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:14:50.352270+0000","last_undegraded":"2026-02-20T03:14:50.352270+0000","last_fullsized":"2026-02-20T03:14:50.352270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744179+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:14:38.744179+0000","last_peered":"2026-02-20T03:14:38.744179+0000","last_clean":"2026-02-20T03:14:38.744179+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:14:38.744179+0000","last_undegraded":"2026-02-20T03:14:38.744179+0000","last_fullsized":"2026-02-20T03:14:38.744179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311740+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:14:38.311740+0000","last_peered":"2026-02-20T03:14:38.311740+0000","last_clean":"2026-02-20T03:14:38.311740+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:14:38.311740+0000","last_undegraded":"2026-02-20T03:14:38.311740+0000","last_fullsized":"2026-02-20T03:14:38.311740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356034+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:14:51.356034+0000","last_peered":"2026-02-20T03:14:51.356034+0000","last_clean":"2026-02-20T03:14:51.356034+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:14:51.356034+0000","last_undegraded":"2026-02-20T03:14:51.356034+0000","last_fullsized":"2026-02-20T03:14:51.356034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744303+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:14:38.744303+0000","last_peered":"2026-02-20T03:14:38.744303+0000","last_clean":"2026-02-20T03:14:38.744303+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:14:38.744303+0000","last_undegraded":"2026-02-20T03:14:38.744303+0000","last_fullsized":"2026-02-20T03:14:38.744303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744191+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:14:38.744191+0000","last_peered":"2026-02-20T03:14:38.744191+0000","last_clean":"2026-02-20T03:14:38.744191+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:14:38.744191+0000","last_undegraded":"2026-02-20T03:14:38.744191+0000","last_fullsized":"2026-02-20T03:14:38.744191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'28","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:04.378317+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:04.378317+0000","last_peered":"2026-02-20T03:15:04.378317+0000","last_clean":"2026-02-20T03:15:04.378317+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:04.378317+0000","last_undegraded":"2026-02-20T03:15:04.378317+0000","last_fullsized":"2026-02-20T03:15:04.378317+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63752,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":79,"num_write":29,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742256+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:14:38.742256+0000","last_peered":"2026-02-20T03:14:38.742256+0000","last_clean":"2026-02-20T03:14:38.742256+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:14:38.742256+0000","last_undegraded":"2026-02-20T03:14:38.742256+0000","last_fullsized":"2026-02-20T03:14:38.742256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749385+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:14:38.749385+0000","last_peered":"2026-02-20T03:14:38.749385+0000","last_clean":"2026-02-20T03:14:38.749385+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:14:38.749385+0000","last_undegraded":"2026-02-20T03:14:38.749385+0000","last_fullsized":"2026-02-20T03:14:38.749385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352990+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:14:50.352990+0000","last_peered":"2026-02-20T03:14:50.352990+0000","last_clean":"2026-02-20T03:14:50.352990+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:14:50.352990+0000","last_undegraded":"2026-02-20T03:14:50.352990+0000","last_fullsized":"2026-02-20T03:14:50.352990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.312040+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:14:38.312040+0000","last_peered":"2026-02-20T03:14:38.312040+0000","last_clean":"2026-02-20T03:14:38.312040+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:14:38.312040+0000","last_undegraded":"2026-02-20T03:14:38.312040+0000","last_fullsized":"2026-02-20T03:14:38.312040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.356807+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:14:50.356807+0000","last_peered":"2026-02-20T03:14:50.356807+0000","last_clean":"2026-02-20T03:14:50.356807+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:14:50.356807+0000","last_undegraded":"2026-02-20T03:14:50.356807+0000","last_fullsized":"2026-02-20T03:14:50.356807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743191+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:14:38.743191+0000","last_peered":"2026-02-20T03:14:38.743191+0000","last_clean":"2026-02-20T03:14:38.743191+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:14:38.743191+0000","last_undegraded":"2026-02-20T03:14:38.743191+0000","last_fullsized":"2026-02-20T03:14:38.743191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749609+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:14:38.749609+0000","last_peered":"2026-02-20T03:14:38.749609+0000","last_clean":"2026-02-20T03:14:38.749609+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:14:38.749609+0000","last_undegraded":"2026-02-20T03:14:38.749609+0000","last_fullsized":"2026-02-20T03:14:38.749609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'3","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:03.373264+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:03.373264+0000","last_peered":"2026-02-20T03:15:03.373264+0000","last_clean":"2026-02-20T03:15:03.373264+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:03.373264+0000","last_undegraded":"2026-02-20T03:15:03.373264+0000","last_fullsized":"2026-02-20T03:15:03.373264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743127+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:14:38.743127+0000","last_peered":"2026-02-20T03:14:38.743127+0000","last_clean":"2026-02-20T03:14:38.743127+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:14:38.743127+0000","last_undegraded":"2026-02-20T03:14:38.743127+0000","last_fullsized":"2026-02-20T03:14:38.743127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311932+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:14:38.311932+0000","last_peered":"2026-02-20T03:14:38.311932+0000","last_clean":"2026-02-20T03:14:38.311932+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:14:38.311932+0000","last_undegraded":"2026-02-20T03:14:38.311932+0000","last_fullsized":"2026-02-20T03:14:38.311932+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742536+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:14:38.742536+0000","last_peered":"2026-02-20T03:14:38.742536+0000","last_clean":"2026-02-20T03:14:38.742536+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:14:38.742536+0000","last_undegraded":"2026-02-20T03:14:38.742536+0000","last_fullsized":"2026-02-20T03:14:38.742536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744067+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:14:38.744067+0000","last_peered":"2026-02-20T03:14:38.744067+0000","last_clean":"2026-02-20T03:14:38.744067+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:14:38.744067+0000","last_undegraded":"2026-02-20T03:14:38.744067+0000","last_fullsized":"2026-02-20T03:14:38.744067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744459+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:14:38.744459+0000","last_peered":"2026-02-20T03:14:38.744459+0000","last_clean":"2026-02-20T03:14:38.744459+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:14:38.744459+0000","last_undegraded":"2026-02-20T03:14:38.744459+0000","last_fullsized":"2026-02-20T03:14:38.744459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742665+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:14:38.742665+0000","last_peered":"2026-02-20T03:14:38.742665+0000","last_clean":"2026-02-20T03:14:38.742665+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:14:38.742665+0000","last_undegraded":"2026-02-20T03:14:38.742665+0000","last_fullsized":"2026-02-20T03:14:38.742665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356776+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:14:51.356776+0000","last_peered":"2026-02-20T03:14:51.356776+0000","last_clean":"2026-02-20T03:14:51.356776+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:14:51.356776+0000","last_undegraded":"2026-02-20T03:14:51.356776+0000","last_fullsized":"2026-02-20T03:14:51.356776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.361797+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:14:51.361797+0000","last_peered":"2026-02-20T03:14:51.361797+0000","last_clean":"2026-02-20T03:14:51.361797+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:14:51.361797+0000","last_undegraded":"2026-02-20T03:14:51.361797+0000","last_fullsized":"2026-02-20T03:14:51.361797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744227+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:14:38.744227+0000","last_peered":"2026-02-20T03:14:38.744227+0000","last_clean":"2026-02-20T03:14:38.744227+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:14:38.744227+0000","last_undegraded":"2026-02-20T03:14:38.744227+0000","last_fullsized":"2026-02-20T03:14:38.744227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744309+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:14:38.744309+0000","last_peered":"2026-02-20T03:14:38.744309+0000","last_clean":"2026-02-20T03:14:38.744309+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:14:38.744309+0000","last_undegraded":"2026-02-20T03:14:38.744309+0000","last_fullsized":"2026-02-20T03:14:38.744309+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:02.367589+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:02.367589+0000","last_peered":"2026-02-20T03:15:02.367589+0000","last_clean":"2026-02-20T03:15:02.367589+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:02.367589+0000","last_undegraded":"2026-02-20T03:15:02.367589+0000","last_fullsized":"2026-02-20T03:15:02.367589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744076+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:14:38.744076+0000","last_peered":"2026-02-20T03:14:38.744076+0000","last_clean":"2026-02-20T03:14:38.744076+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:14:38.744076+0000","last_undegraded":"2026-02-20T03:14:38.744076+0000","last_fullsized":"2026-02-20T03:14:38.744076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744370+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:14:38.744370+0000","last_peered":"2026-02-20T03:14:38.744370+0000","last_clean":"2026-02-20T03:14:38.744370+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:14:38.744370+0000","last_undegraded":"2026-02-20T03:14:38.744370+0000","last_fullsized":"2026-02-20T03:14:38.744370+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743873+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:14:38.743873+0000","last_peered":"2026-02-20T03:14:38.743873+0000","last_clean":"2026-02-20T03:14:38.743873+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:14:38.743873+0000","last_undegraded":"2026-02-20T03:14:38.743873+0000","last_fullsized":"2026-02-20T03:14:38.743873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744166+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:14:38.744166+0000","last_peered":"2026-02-20T03:14:38.744166+0000","last_clean":"2026-02-20T03:14:38.744166+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:14:38.744166+0000","last_undegraded":"2026-02-20T03:14:38.744166+0000","last_fullsized":"2026-02-20T03:14:38.744166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311828+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:14:38.311828+0000","last_peered":"2026-02-20T03:14:38.311828+0000","last_clean":"2026-02-20T03:14:38.311828+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:14:38.311828+0000","last_undegraded":"2026-02-20T03:14:38.311828+0000","last_fullsized":"2026-02-20T03:14:38.311828+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311110+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:14:38.311110+0000","last_peered":"2026-02-20T03:14:38.311110+0000","last_clean":"2026-02-20T03:14:38.311110+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:14:38.311110+0000","last_undegraded":"2026-02-20T03:14:38.311110+0000","last_fullsized":"2026-02-20T03:14:38.311110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744275+0000","last_change":"2026-02-20T03:14:33.290769+0000","last_active":"2026-02-20T03:14:38.744275+0000","last_peered":"2026-02-20T03:14:38.744275+0000","last_clean":"2026-02-20T03:14:38.744275+0000","last_became_active":"2026-02-20T03:14:33.290406+0000","last_became_peered":"2026-02-20T03:14:33.290406+0000","last_unstale":"2026-02-20T03:14:38.744275+0000","last_undegraded":"2026-02-20T03:14:38.744275+0000","last_fullsized":"2026-02-20T03:14:38.744275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:58.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744400+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:14:38.744400+0000","last_peered":"2026-02-20T03:14:38.744400+0000","last_clean":"2026-02-20T03:14:38.744400+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:14:38.744400+0000","last_undegraded":"2026-02-20T03:14:38.744400+0000","last_fullsized":"2026-02-20T03:14:38.744400+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742977+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:14:38.742977+0000","last_peered":"2026-02-20T03:14:38.742977+0000","last_clean":"2026-02-20T03:14:38.742977+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:14:38.742977+0000","last_undegraded":"2026-02-20T03:14:38.742977+0000","last_fullsized":"2026-02-20T03:14:38.742977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743959+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:14:38.743959+0000","last_peered":"2026-02-20T03:14:38.743959+0000","last_clean":"2026-02-20T03:14:38.743959+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:14:38.743959+0000","last_undegraded":"2026-02-20T03:14:38.743959+0000","last_fullsized":"2026-02-20T03:14:38.743959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743157+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:14:38.743157+0000","last_peered":"2026-02-20T03:14:38.743157+0000","last_clean":"2026-02-20T03:14:38.743157+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:14:38.743157+0000","last_undegraded":"2026-02-20T03:14:38.743157+0000","last_fullsized":"2026-02-20T03:14:38.743157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749238+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:14:38.749238+0000","last_peered":"2026-02-20T03:14:38.749238+0000","last_clean":"2026-02-20T03:14:38.749238+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:14:38.749238+0000","last_undegraded":"2026-02-20T03:14:38.749238+0000","last_fullsized":"2026-02-20T03:14:38.749238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311289+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:14:38.311289+0000","last_peered":"2026-02-20T03:14:38.311289+0000","last_clean":"2026-02-20T03:14:38.311289+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:14:38.311289+0000","last_undegraded":"2026-02-20T03:14:38.311289+0000","last_fullsized":"2026-02-20T03:14:38.311289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744096+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:14:38.744096+0000","last_peered":"2026-02-20T03:14:38.744096+0000","last_clean":"2026-02-20T03:14:38.744096+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:14:38.744096+0000","last_undegraded":"2026-02-20T03:14:38.744096+0000","last_fullsized":"2026-02-20T03:14:38.744096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744472+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:14:38.744472+0000","last_peered":"2026-02-20T03:14:38.744472+0000","last_clean":"2026-02-20T03:14:38.744472+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:14:38.744472+0000","last_undegraded":"2026-02-20T03:14:38.744472+0000","last_fullsized":"2026-02-20T03:14:38.744472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742612+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:14:38.742612+0000","last_peered":"2026-02-20T03:14:38.742612+0000","last_clean":"2026-02-20T03:14:38.742612+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:14:38.742612+0000","last_undegraded":"2026-02-20T03:14:38.742612+0000","last_fullsized":"2026-02-20T03:14:38.742612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744492+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:14:38.744492+0000","last_peered":"2026-02-20T03:14:38.744492+0000","last_clean":"2026-02-20T03:14:38.744492+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:14:38.744492+0000","last_undegraded":"2026-02-20T03:14:38.744492+0000","last_fullsized":"2026-02-20T03:14:38.744492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.748833+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:14:38.748833+0000","last_peered":"2026-02-20T03:14:38.748833+0000","last_clean":"2026-02-20T03:14:38.748833+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:14:38.748833+0000","last_undegraded":"2026-02-20T03:14:38.748833+0000","last_fullsized":"2026-02-20T03:14:38.748833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311670+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:14:38.311670+0000","last_peered":"2026-02-20T03:14:38.311670+0000","last_clean":"2026-02-20T03:14:38.311670+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:14:38.311670+0000","last_undegraded":"2026-02-20T03:14:38.311670+0000","last_fullsized":"2026-02-20T03:14:38.311670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311568+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:14:38.311568+0000","last_peered":"2026-02-20T03:14:38.311568+0000","last_clean":"2026-02-20T03:14:38.311568+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:14:38.311568+0000","last_undegraded":"2026-02-20T03:14:38.311568+0000","last_fullsized":"2026-02-20T03:14:38.311568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311264+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:14:38.311264+0000","last_peered":"2026-02-20T03:14:38.311264+0000","last_clean":"2026-02-20T03:14:38.311264+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:14:38.311264+0000","last_undegraded":"2026-02-20T03:14:38.311264+0000","last_fullsized":"2026-02-20T03:14:38.311264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318524+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:14:38.318524+0000","last_peered":"2026-02-20T03:14:38.318524+0000","last_clean":"2026-02-20T03:14:38.318524+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:14:38.318524+0000","last_undegraded":"2026-02-20T03:14:38.318524+0000","last_fullsized":"2026-02-20T03:14:38.318524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479875+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:14:38.479875+0000","last_peered":"2026-02-20T03:14:38.479875+0000","last_clean":"2026-02-20T03:14:38.479875+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:14:38.479875+0000","last_undegraded":"2026-02-20T03:14:38.479875+0000","last_fullsized":"2026-02-20T03:14:38.479875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749648+0000","last_change":"2026-02-20T03:14:33.295988+0000","last_active":"2026-02-20T03:14:38.749648+0000","last_peered":"2026-02-20T03:14:38.749648+0000","last_clean":"2026-02-20T03:14:38.749648+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749648+0000","last_undegraded":"2026-02-20T03:14:38.749648+0000","last_fullsized":"2026-02-20T03:14:38.749648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:12:01.602799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742670+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:14:38.742670+0000","last_peered":"2026-02-20T03:14:38.742670+0000","last_clean":"2026-02-20T03:14:38.742670+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:14:38.742670+0000","last_undegraded":"2026-02-20T03:14:38.742670+0000","last_fullsized":"2026-02-20T03:14:38.742670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318097+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:14:38.318097+0000","last_peered":"2026-02-20T03:14:38.318097+0000","last_clean":"2026-02-20T03:14:38.318097+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:14:38.318097+0000","last_undegraded":"2026-02-20T03:14:38.318097+0000","last_fullsized":"2026-02-20T03:14:38.318097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479297+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:14:38.479297+0000","last_peered":"2026-02-20T03:14:38.479297+0000","last_clean":"2026-02-20T03:14:38.479297+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:14:38.479297+0000","last_undegraded":"2026-02-20T03:14:38.479297+0000","last_fullsized":"2026-02-20T03:14:38.479297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743970+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:14:38.743970+0000","last_peered":"2026-02-20T03:14:38.743970+0000","last_clean":"2026-02-20T03:14:38.743970+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:14:38.743970+0000","last_undegraded":"2026-02-20T03:14:38.743970+0000","last_fullsized":"2026-02-20T03:14:38.743970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311798+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:14:38.311798+0000","last_peered":"2026-02-20T03:14:38.311798+0000","last_clean":"2026-02-20T03:14:38.311798+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:14:38.311798+0000","last_undegraded":"2026-02-20T03:14:38.311798+0000","last_fullsized":"2026-02-20T03:14:38.311798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311904+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:14:38.311904+0000","last_peered":"2026-02-20T03:14:38.311904+0000","last_clean":"2026-02-20T03:14:38.311904+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:14:38.311904+0000","last_undegraded":"2026-02-20T03:14:38.311904+0000","last_fullsized":"2026-02-20T03:14:38.311904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744466+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:14:38.744466+0000","last_peered":"2026-02-20T03:14:38.744466+0000","last_clean":"2026-02-20T03:14:38.744466+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:14:38.744466+0000","last_undegraded":"2026-02-20T03:14:38.744466+0000","last_fullsized":"2026-02-20T03:14:38.744466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67784,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":101,"num_read_kb":122,"num_write":160,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383692,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971104,"statfs":{"total":751619276800,"available":751586410496,"internally_reserved":0,"allocated":995328,"data_stored":484050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612622,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32772,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970428,"statfs":{"total":751619276800,"available":751585718272,"internally_reserved":0,"allocated":1687552,"data_stored":1135462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776144,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":488382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037778,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32112,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971088,"statfs":{"total":751619276800,"available":751586394112,"internally_reserved":0,"allocated":1011712,"data_stored":484206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299412,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32692,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970508,"statfs":{"total":751619276800,"available":751585800192,"internally_reserved":0,"allocated":1605632,"data_stored":1080116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462934,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":479452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724569,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28540,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974660,"statfs":{"total":751619276800,"available":751590051840,"internally_reserved":0,"allocated":1613824,"data_stored":1075312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888091,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971096,"statfs":{"total":751619276800,"available":751586402304,"internally_reserved":0,"allocated":1003520,"data_stored":484494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149725,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27944,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975256,"statfs":{"total":751619276800,"available":751590662144,"internally_reserved":0,"allocated":1003520,"data_stored":479646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378655,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28012,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975188,"statfs":{"total":751619276800,"available":751590592512,"internally_reserved":0,"allocated":1073152,"data_stored":531875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27988,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975212,"statfs":{"total":751619276800,"available":751590617088,"internally_reserved":0,"allocated":1048576,"data_stored":530515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":480860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":51153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:07.814 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-20T03:15:07.814 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T03:15:07.814 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-20T03:15:07.814 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph health --format=json 2026-02-20T03:15:07.849 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:07 trial126 ceph-mon[38476]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:07.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:07 trial177 ceph-mon[43181]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:08.108 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:08.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.280+0000 7f9f7f831640 1 -- 10.20.193.28:0/1299836052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 msgr2=0x7f9f78108cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:08.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.280+0000 7f9f7f831640 1 --2- 10.20.193.28:0/1299836052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 0x7f9f78108cb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9f68009a60 tx=0x7f9f6802f250 comp rx=0 tx=0).stop 2026-02-20T03:15:08.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.280+0000 7f9f7f831640 1 -- 10.20.193.28:0/1299836052 shutdown_connections 2026-02-20T03:15:08.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.280+0000 7f9f7f831640 1 --2- 10.20.193.28:0/1299836052 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f78103270 0x7f9f7810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.280+0000 7f9f7f831640 1 --2- 10.20.193.28:0/1299836052 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f781028d0 0x7f9f78102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.280+0000 7f9f7f831640 1 --2- 10.20.193.28:0/1299836052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 0x7f9f78108cb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.280+0000 7f9f7f831640 1 -- 10.20.193.28:0/1299836052 >> 10.20.193.28:0/1299836052 conn(0x7f9f780fe5d0 msgr2=0x7f9f781009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.280+0000 7f9f7f831640 1 -- 10.20.193.28:0/1299836052 shutdown_connections 2026-02-20T03:15:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.280+0000 7f9f7f831640 1 -- 10.20.193.28:0/1299836052 wait complete. 2026-02-20T03:15:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.281+0000 7f9f7f831640 1 Processor -- start 2026-02-20T03:15:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.281+0000 7f9f7f831640 1 -- start start 2026-02-20T03:15:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.281+0000 7f9f7f831640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f781028d0 0x7f9f7819d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7f831640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f78103270 0x7f9f7819d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7f831640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 0x7f9f781a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7f831640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9f78112b40 con 0x7f9f781088d0 2026-02-20T03:15:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7f831640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9f781129c0 con 0x7f9f78103270 2026-02-20T03:15:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7f831640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9f78112cc0 con 0x7f9f781028d0 2026-02-20T03:15:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7dda7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 0x7f9f781a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7dda7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 0x7f9f781a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40272/0 (socket says 10.20.193.28:40272) 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7dda7640 1 -- 10.20.193.28:0/960454046 learned_addr learned my addr 10.20.193.28:0/960454046 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7cda5640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f78103270 0x7f9f7819d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7d5a6640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f781028d0 0x7f9f7819d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7dda7640 1 -- 10.20.193.28:0/960454046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f781028d0 msgr2=0x7f9f7819d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7dda7640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f781028d0 0x7f9f7819d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7dda7640 1 -- 10.20.193.28:0/960454046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f78103270 msgr2=0x7f9f7819d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7dda7640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f78103270 0x7f9f7819d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7dda7640 1 -- 10.20.193.28:0/960454046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f781a2270 con 0x7f9f781088d0 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.282+0000 7f9f7dda7640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 0x7f9f781a1af0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9f74004820 tx=0x7f9f7400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.283+0000 7f9f667fc640 1 -- 10.20.193.28:0/960454046 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f740090d0 con 0x7f9f781088d0 2026-02-20T03:15:08.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.283+0000 7f9f667fc640 1 -- 10.20.193.28:0/960454046 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9f74009270 con 0x7f9f781088d0 2026-02-20T03:15:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.283+0000 7f9f667fc640 1 -- 10.20.193.28:0/960454046 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74013810 con 0x7f9f781088d0 2026-02-20T03:15:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.283+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f781a2500 con 0x7f9f781088d0 2026-02-20T03:15:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.283+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f781a9da0 con 0x7f9f781088d0 2026-02-20T03:15:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.283+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f78102d30 con 0x7f9f781088d0 2026-02-20T03:15:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.286+0000 7f9f667fc640 1 -- 10.20.193.28:0/960454046 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f9f74012070 con 0x7f9f781088d0 2026-02-20T03:15:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.287+0000 7f9f667fc640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f540b0eb0 0x7f9f540b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.287+0000 7f9f667fc640 1 -- 10.20.193.28:0/960454046 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f9f740e07d0 con 0x7f9f781088d0 2026-02-20T03:15:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.287+0000 7f9f667fc640 1 -- 10.20.193.28:0/960454046 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f9f74010070 con 0x7f9f781088d0 2026-02-20T03:15:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.287+0000 7f9f7d5a6640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f540b0eb0 0x7f9f540b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.288+0000 7f9f7d5a6640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f540b0eb0 0x7f9f540b3370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f68002410 tx=0x7f9f6803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:08.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.396+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9f7819e580 con 0x7f9f781088d0 2026-02-20T03:15:08.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.396+0000 7f9f667fc640 1 -- 10.20.193.28:0/960454046 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9f7819e580 con 0x7f9f781088d0 2026-02-20T03:15:08.399 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:08.399 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T03:15:08.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.397+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f540b0eb0 msgr2=0x7f9f540b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:08.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.397+0000 7f9f7f831640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f540b0eb0 0x7f9f540b3370 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f68002410 tx=0x7f9f6803a040 comp rx=0 tx=0).stop 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.397+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 msgr2=0x7f9f781a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.397+0000 7f9f7f831640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 0x7f9f781a1af0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9f74004820 tx=0x7f9f7400d4a0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.398+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 shutdown_connections 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.398+0000 7f9f7f831640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9f540b0eb0 0x7f9f540b3370 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.398+0000 7f9f7f831640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9f781088d0 0x7f9f781a1af0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.398+0000 7f9f7f831640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9f78103270 0x7f9f7819d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.398+0000 7f9f7f831640 1 --2- 10.20.193.28:0/960454046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9f781028d0 0x7f9f7819d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.398+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 >> 10.20.193.28:0/960454046 conn(0x7f9f780fe5d0 msgr2=0x7f9f780ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.398+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 shutdown_connections 2026-02-20T03:15:08.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.398+0000 7f9f7f831640 1 -- 10.20.193.28:0/960454046 wait complete. 2026-02-20T03:15:08.503 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-20T03:15:08.503 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:08.770 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:08.814 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:08 trial028 ceph-mon[38552]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:08.814 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:08 trial028 ceph-mon[38552]: pgmap v190: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2026-02-20T03:15:08.814 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:08 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/960454046' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-20T03:15:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:08 trial126 ceph-mon[38476]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:08 trial126 ceph-mon[38476]: pgmap v190: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2026-02-20T03:15:08.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:08 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/960454046' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-20T03:15:08.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.948+0000 7fdc40af6640 1 -- 10.20.193.28:0/2425510108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c115df0 msgr2=0x7fdc3c1181e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:08.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.948+0000 7fdc40af6640 1 --2- 10.20.193.28:0/2425510108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c115df0 0x7fdc3c1181e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c00b0a0 tx=0x7fdc2c02f4a0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.948+0000 7fdc40af6640 1 -- 10.20.193.28:0/2425510108 shutdown_connections 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.948+0000 7fdc40af6640 1 --2- 10.20.193.28:0/2425510108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c115df0 0x7fdc3c1181e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.948+0000 7fdc40af6640 1 --2- 10.20.193.28:0/2425510108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdc3c10ad90 0x7fdc3c1158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.948+0000 7fdc40af6640 1 --2- 10.20.193.28:0/2425510108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdc3c10a470 0x7fdc3c10a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.948+0000 7fdc40af6640 1 -- 10.20.193.28:0/2425510108 >> 10.20.193.28:0/2425510108 conn(0x7fdc3c06ed80 msgr2=0x7fdc3c06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.948+0000 7fdc40af6640 1 -- 10.20.193.28:0/2425510108 shutdown_connections 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.948+0000 7fdc40af6640 1 -- 10.20.193.28:0/2425510108 wait complete. 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc40af6640 1 Processor -- start 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc40af6640 1 -- start start 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc40af6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdc3c10a470 0x7fdc3c10d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc40af6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c10ad90 0x7fdc3c10b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc40af6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdc3c115df0 0x7fdc3c10bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc40af6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c11b490 con 0x7fdc3c10ad90 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc40af6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c11b310 con 0x7fdc3c115df0 2026-02-20T03:15:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc40af6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c11b610 con 0x7fdc3c10a470 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc39d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c10ad90 0x7fdc3c10b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc3a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdc3c10a470 0x7fdc3c10d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc3ad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdc3c115df0 0x7fdc3c10bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc39d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c10ad90 0x7fdc3c10b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40284/0 (socket says 10.20.193.28:40284) 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc3a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdc3c10a470 0x7fdc3c10d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49334/0 (socket says 10.20.193.28:49334) 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.949+0000 7fdc39d74640 1 -- 10.20.193.28:0/282263525 learned_addr learned my addr 10.20.193.28:0/282263525 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc39d74640 1 -- 10.20.193.28:0/282263525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdc3c10a470 msgr2=0x7fdc3c10d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc39d74640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdc3c10a470 0x7fdc3c10d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc39d74640 1 -- 10.20.193.28:0/282263525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdc3c115df0 msgr2=0x7fdc3c10bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc39d74640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdc3c115df0 0x7fdc3c10bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc39d74640 1 -- 10.20.193.28:0/282263525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3c10c4d0 con 0x7fdc3c10ad90 2026-02-20T03:15:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc39d74640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c10ad90 0x7fdc3c10b690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400d950 tx=0x7fdc2400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc237fe640 1 -- 10.20.193.28:0/282263525 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc24014070 con 0x7fdc3c10ad90 2026-02-20T03:15:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc237fe640 1 -- 10.20.193.28:0/282263525 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdc240044e0 con 0x7fdc3c10ad90 2026-02-20T03:15:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc237fe640 1 -- 10.20.193.28:0/282263525 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc24010460 con 0x7fdc3c10ad90 2026-02-20T03:15:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc3c1b6630 con 0x7fdc3c10ad90 2026-02-20T03:15:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.950+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc3c1b6b20 con 0x7fdc3c10ad90 2026-02-20T03:15:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.951+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc3c074500 con 0x7fdc3c10ad90 2026-02-20T03:15:08.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.953+0000 7fdc237fe640 1 -- 10.20.193.28:0/282263525 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fdc240026e0 con 0x7fdc3c10ad90 2026-02-20T03:15:08.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.954+0000 7fdc237fe640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc140b0eb0 0x7fdc140b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:08.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.954+0000 7fdc237fe640 1 -- 10.20.193.28:0/282263525 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fdc240e0a80 con 0x7fdc3c10ad90 2026-02-20T03:15:08.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.955+0000 7fdc237fe640 1 -- 10.20.193.28:0/282263525 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fdc240acc10 con 0x7fdc3c10ad90 2026-02-20T03:15:08.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.955+0000 7fdc3a575640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc140b0eb0 0x7fdc140b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:08.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:08.955+0000 7fdc3a575640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc140b0eb0 0x7fdc140b3370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdc30007c40 tx=0x7fdc300073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:08.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:08 trial177 ceph-mon[43181]: from='client.14913 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:08.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:08 trial177 ceph-mon[43181]: pgmap v190: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2026-02-20T03:15:08.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:08 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/960454046' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-20T03:15:09.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.061+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc3c10cbc0 con 0x7fdc3c10ad90 2026-02-20T03:15:09.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.062+0000 7fdc237fe640 1 -- 10.20.193.28:0/282263525 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11921 (secure 0 0 0) 0x7fdc240b1ac0 con 0x7fdc3c10ad90 2026-02-20T03:15:09.065 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:09.065 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":21,"btime":"2026-02-20T03:14:52:355182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:14:52.355103+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:15:09.066 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 21 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc140b0eb0 msgr2=0x7fdc140b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc140b0eb0 0x7fdc140b3370 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdc30007c40 tx=0x7fdc300073d0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c10ad90 msgr2=0x7fdc3c10b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c10ad90 0x7fdc3c10b690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400d950 tx=0x7fdc2400de20 comp rx=0 tx=0).stop 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 shutdown_connections 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdc140b0eb0 0x7fdc140b3370 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdc3c115df0 0x7fdc3c10bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdc3c10ad90 0x7fdc3c10b690 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 --2- 10.20.193.28:0/282263525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdc3c10a470 0x7fdc3c10d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 >> 10.20.193.28:0/282263525 conn(0x7fdc3c06ed80 msgr2=0x7fdc3c0713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:09.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 shutdown_connections 2026-02-20T03:15:09.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.063+0000 7fdc40af6640 1 -- 10.20.193.28:0/282263525 wait complete. 2026-02-20T03:15:09.162 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:09.431 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.611+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2456472499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81065d0 msgr2=0x7ff6e8075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.611+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2456472499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81065d0 0x7ff6e8075410 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009a30 tx=0x7ff6d802f2b0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.611+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2456472499 shutdown_connections 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.611+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2456472499 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6e81134d0 0x7ff6e8115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.611+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2456472499 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6e8075950 0x7ff6e8075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.611+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2456472499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81065d0 0x7ff6e8075410 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.611+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2456472499 >> 10.20.193.28:0/2456472499 conn(0x7ff6e80fe440 msgr2=0x7ff6e8100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.611+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2456472499 shutdown_connections 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.611+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2456472499 wait complete. 2026-02-20T03:15:09.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6eeb5f640 1 Processor -- start 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6eeb5f640 1 -- start start 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6eeb5f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6e8075950 0x7ff6e81a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6eeb5f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6e81065d0 0x7ff6e81a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6eeb5f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81134d0 0x7ff6e81a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6eeb5f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8119080 con 0x7ff6e81134d0 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6eeb5f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8118f00 con 0x7ff6e81065d0 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6eeb5f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8119200 con 0x7ff6e8075950 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6ee35e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81134d0 0x7ff6e81a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6ee35e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81134d0 0x7ff6e81a5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40296/0 (socket says 10.20.193.28:40296) 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6edb5d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6e8075950 0x7ff6e81a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6ee35e640 1 -- 10.20.193.28:0/2318614608 learned_addr learned my addr 10.20.193.28:0/2318614608 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.612+0000 7ff6ed35c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6e81065d0 0x7ff6e81a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6ee35e640 1 -- 10.20.193.28:0/2318614608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6e8075950 msgr2=0x7ff6e81a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6ee35e640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6e8075950 0x7ff6e81a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6ee35e640 1 -- 10.20.193.28:0/2318614608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6e81065d0 msgr2=0x7ff6e81a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:09.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6ee35e640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6e81065d0 0x7ff6e81a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6ee35e640 1 -- 10.20.193.28:0/2318614608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e81a6530 con 0x7ff6e81134d0 2026-02-20T03:15:09.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6ee35e640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81134d0 0x7ff6e81a5db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4004820 tx=0x7ff6e400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:09.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6d6ffd640 1 -- 10.20.193.28:0/2318614608 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40090d0 con 0x7ff6e81134d0 2026-02-20T03:15:09.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6d6ffd640 1 -- 10.20.193.28:0/2318614608 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff6e4009270 con 0x7ff6e81134d0 2026-02-20T03:15:09.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6d6ffd640 1 -- 10.20.193.28:0/2318614608 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4013810 con 0x7ff6e81134d0 2026-02-20T03:15:09.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e81a67c0 con 0x7ff6e81134d0 2026-02-20T03:15:09.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.613+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e81ae060 con 0x7ff6e81134d0 2026-02-20T03:15:09.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.614+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e8075d90 con 0x7ff6e81134d0 2026-02-20T03:15:09.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.616+0000 7ff6d6ffd640 1 -- 10.20.193.28:0/2318614608 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7ff6e4012070 con 0x7ff6e81134d0 2026-02-20T03:15:09.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.617+0000 7ff6d6ffd640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c40b0e30 0x7ff6c40b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:09.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.618+0000 7ff6d6ffd640 1 -- 10.20.193.28:0/2318614608 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ff6e40e06d0 con 0x7ff6e81134d0 2026-02-20T03:15:09.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.618+0000 7ff6edb5d640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c40b0e30 0x7ff6c40b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:09.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.618+0000 7ff6d6ffd640 1 -- 10.20.193.28:0/2318614608 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff6e4010070 con 0x7ff6e81134d0 2026-02-20T03:15:09.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.618+0000 7ff6edb5d640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c40b0e30 0x7ff6c40b32f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009a00 tx=0x7ff6d8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:09.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.725+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6e81ae390 con 0x7ff6e81134d0 2026-02-20T03:15:09.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:09 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/282263525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:09.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.726+0000 7ff6d6ffd640 1 -- 10.20.193.28:0/2318614608 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11921 (secure 0 0 0) 0x7ff6e40ac800 con 0x7ff6e81134d0 2026-02-20T03:15:09.729 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:09.730 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":21,"btime":"2026-02-20T03:14:52:355182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:14:52.355103+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:15:09.730 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 21 2026-02-20T03:15:09.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c40b0e30 msgr2=0x7ff6c40b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c40b0e30 0x7ff6c40b32f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009a00 tx=0x7ff6d8005e50 comp rx=0 tx=0).stop 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81134d0 msgr2=0x7ff6e81a5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81134d0 0x7ff6e81a5db0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4004820 tx=0x7ff6e400d4a0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 shutdown_connections 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c40b0e30 0x7ff6c40b32f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6e81134d0 0x7ff6e81a5db0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6e81065d0 0x7ff6e81a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 --2- 10.20.193.28:0/2318614608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6e8075950 0x7ff6e81a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 >> 10.20.193.28:0/2318614608 conn(0x7ff6e80fe440 msgr2=0x7ff6e8111560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 shutdown_connections 2026-02-20T03:15:09.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:09.727+0000 7ff6eeb5f640 1 -- 10.20.193.28:0/2318614608 wait complete. 2026-02-20T03:15:09.833 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:15:09.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:09 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/282263525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:09.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:09 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/282263525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:10.100 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:10.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.277+0000 7fb055547640 1 -- 10.20.193.28:0/1007472703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 msgr2=0x7fb050102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.277+0000 7fb055547640 1 --2- 10.20.193.28:0/1007472703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 0x7fb050102b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb040009a60 tx=0x7fb04002f260 comp rx=0 tx=0).stop 2026-02-20T03:15:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.277+0000 7fb055547640 1 -- 10.20.193.28:0/1007472703 shutdown_connections 2026-02-20T03:15:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.277+0000 7fb055547640 1 --2- 10.20.193.28:0/1007472703 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0501030a0 0x7fb05010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.277+0000 7fb055547640 1 --2- 10.20.193.28:0/1007472703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 0x7fb050102b60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.277+0000 7fb055547640 1 --2- 10.20.193.28:0/1007472703 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb050108700 0x7fb050108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.277+0000 7fb055547640 1 -- 10.20.193.28:0/1007472703 >> 10.20.193.28:0/1007472703 conn(0x7fb0500fe440 msgr2=0x7fb050100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.277+0000 7fb055547640 1 -- 10.20.193.28:0/1007472703 shutdown_connections 2026-02-20T03:15:10.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.277+0000 7fb055547640 1 -- 10.20.193.28:0/1007472703 wait complete. 2026-02-20T03:15:10.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.278+0000 7fb055547640 1 Processor -- start 2026-02-20T03:15:10.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.278+0000 7fb055547640 1 -- start start 2026-02-20T03:15:10.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.278+0000 7fb055547640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb050102700 0x7fb05019d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.278+0000 7fb055547640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0501030a0 0x7fb05019d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.278+0000 7fb055547640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050108700 0x7fb0501a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.278+0000 7fb055547640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb050112970 con 0x7fb050108700 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.278+0000 7fb055547640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501127f0 con 0x7fb0501030a0 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.278+0000 7fb055547640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb050112af0 con 0x7fb050102700 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb050102700 0x7fb05019d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb054d46640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050108700 0x7fb0501a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0501030a0 0x7fb05019d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb054d46640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050108700 0x7fb0501a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40312/0 (socket says 10.20.193.28:40312) 2026-02-20T03:15:10.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb050102700 0x7fb05019d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49392/0 (socket says 10.20.193.28:49392) 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04ffff640 1 -- 10.20.193.28:0/88814513 learned_addr learned my addr 10.20.193.28:0/88814513 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04ffff640 1 -- 10.20.193.28:0/88814513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0501030a0 msgr2=0x7fb05019d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04ffff640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0501030a0 0x7fb05019d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04ffff640 1 -- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050108700 msgr2=0x7fb0501a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04ffff640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050108700 0x7fb0501a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04ffff640 1 -- 10.20.193.28:0/88814513 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0501a20d0 con 0x7fb050102700 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb054d46640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050108700 0x7fb0501a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.279+0000 7fb04ffff640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb050102700 0x7fb05019d080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00ea30 tx=0x7fb03c00ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.280+0000 7fb04d7fa640 1 -- 10.20.193.28:0/88814513 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00ce50 con 0x7fb050102700 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.280+0000 7fb04d7fa640 1 -- 10.20.193.28:0/88814513 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb03c004570 con 0x7fb050102700 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.280+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0501a23c0 con 0x7fb050102700 2026-02-20T03:15:10.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.280+0000 7fb04d7fa640 1 -- 10.20.193.28:0/88814513 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c010690 con 0x7fb050102700 2026-02-20T03:15:10.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.280+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0501a9c00 con 0x7fb050102700 2026-02-20T03:15:10.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.280+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb050102b60 con 0x7fb050102700 2026-02-20T03:15:10.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.282+0000 7fb04d7fa640 1 -- 10.20.193.28:0/88814513 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fb03c0040c0 con 0x7fb050102700 2026-02-20T03:15:10.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.284+0000 7fb04d7fa640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0eb0 0x7fb0240b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:10.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.284+0000 7fb04d7fa640 1 -- 10.20.193.28:0/88814513 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fb03c0e1120 con 0x7fb050102700 2026-02-20T03:15:10.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.284+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0eb0 0x7fb0240b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:10.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.284+0000 7fb04d7fa640 1 -- 10.20.193.28:0/88814513 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb03c0e15a0 con 0x7fb050102700 2026-02-20T03:15:10.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.285+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0eb0 0x7fb0240b3370 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb040005bb0 tx=0x7fb040005b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:10.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.377+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0501a9e30 con 0x7fb050102700 2026-02-20T03:15:10.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.378+0000 7fb04d7fa640 1 -- 10.20.193.28:0/88814513 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7fb03c0a9630 con 0x7fb050102700 2026-02-20T03:15:10.381 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:10.382 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:15:10.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0eb0 msgr2=0x7fb0240b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:10.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0eb0 0x7fb0240b3370 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb040005bb0 tx=0x7fb040005b40 comp rx=0 tx=0).stop 2026-02-20T03:15:10.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb050102700 msgr2=0x7fb05019d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:10.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb050102700 0x7fb05019d080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00ea30 tx=0x7fb03c00ef00 comp rx=0 tx=0).stop 2026-02-20T03:15:10.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 shutdown_connections 2026-02-20T03:15:10.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0eb0 0x7fb0240b3370 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050108700 0x7fb0501a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb0501030a0 0x7fb05019d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 --2- 10.20.193.28:0/88814513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb050102700 0x7fb05019d080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 >> 10.20.193.28:0/88814513 conn(0x7fb0500fe440 msgr2=0x7fb0500feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:10.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 shutdown_connections 2026-02-20T03:15:10.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.379+0000 7fb055547640 1 -- 10.20.193.28:0/88814513 wait complete. 2026-02-20T03:15:10.482 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:10.753 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:10.799 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:10 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2318614608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:10.799 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:10 trial028 ceph-mon[38552]: pgmap v191: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2026-02-20T03:15:10.799 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:10 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/88814513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:10.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:10 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2318614608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:10.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:10 trial126 ceph-mon[38476]: pgmap v191: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2026-02-20T03:15:10.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:10 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/88814513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/4072235071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 msgr2=0x7fdb58109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/4072235071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 0x7fdb58109660 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009a30 tx=0x7fdb4c02f220 comp rx=0 tx=0).stop 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/4072235071 shutdown_connections 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/4072235071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb58109ba0 0x7fdb58115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/4072235071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 0x7fdb58109660 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/4072235071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb5810eef0 0x7fdb5810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/4072235071 >> 10.20.193.28:0/4072235071 conn(0x7fdb58078600 msgr2=0x7fdb5807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/4072235071 shutdown_connections 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/4072235071 wait complete. 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 Processor -- start 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.935+0000 7fdb5e4fe640 1 -- start start 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5e4fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 0x7fdb581a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:10.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5e4fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb58109ba0 0x7fdb581a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5e4fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5810eef0 0x7fdb581a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5e4fe640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58119070 con 0x7fdb58109220 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5e4fe640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58118ef0 con 0x7fdb5810eef0 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5e4fe640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb581191f0 con 0x7fdb58109ba0 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5d4fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 0x7fdb581a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5d4fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 0x7fdb581a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40334/0 (socket says 10.20.193.28:40334) 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5d4fc640 1 -- 10.20.193.28:0/1213780234 learned_addr learned my addr 10.20.193.28:0/1213780234 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5dcfd640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5810eef0 0x7fdb581a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5ccfb640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb58109ba0 0x7fdb581a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5d4fc640 1 -- 10.20.193.28:0/1213780234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb58109ba0 msgr2=0x7fdb581a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5d4fc640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb58109ba0 0x7fdb581a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5d4fc640 1 -- 10.20.193.28:0/1213780234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5810eef0 msgr2=0x7fdb581a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5d4fc640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5810eef0 0x7fdb581a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5d4fc640 1 -- 10.20.193.28:0/1213780234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb581a6550 con 0x7fdb58109220 2026-02-20T03:15:10.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.936+0000 7fdb5ccfb640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb58109ba0 0x7fdb581a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:10.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.937+0000 7fdb5d4fc640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 0x7fdb581a1500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800ea10 tx=0x7fdb4800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:10.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.937+0000 7fdb467fc640 1 -- 10.20.193.28:0/1213780234 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800ce50 con 0x7fdb58109220 2026-02-20T03:15:10.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.937+0000 7fdb467fc640 1 -- 10.20.193.28:0/1213780234 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdb48004570 con 0x7fdb58109220 2026-02-20T03:15:10.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.937+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb581a6840 con 0x7fdb58109220 2026-02-20T03:15:10.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.937+0000 7fdb467fc640 1 -- 10.20.193.28:0/1213780234 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48010690 con 0x7fdb58109220 2026-02-20T03:15:10.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.937+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb581ae080 con 0x7fdb58109220 2026-02-20T03:15:10.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.937+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb58109660 con 0x7fdb58109220 2026-02-20T03:15:10.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.939+0000 7fdb467fc640 1 -- 10.20.193.28:0/1213780234 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fdb48020030 con 0x7fdb58109220 2026-02-20T03:15:10.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.941+0000 7fdb467fc640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb340b1050 0x7fdb340b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:10.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.941+0000 7fdb467fc640 1 -- 10.20.193.28:0/1213780234 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fdb480e0d40 con 0x7fdb58109220 2026-02-20T03:15:10.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.941+0000 7fdb467fc640 1 -- 10.20.193.28:0/1213780234 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fdb480a4b60 con 0x7fdb58109220 2026-02-20T03:15:10.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.941+0000 7fdb5ccfb640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb340b1050 0x7fdb340b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:10.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:10.942+0000 7fdb5ccfb640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb340b1050 0x7fdb340b3510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0097c0 tx=0x7fdb4c0057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:10.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:10 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2318614608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:10.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:10 trial177 ceph-mon[43181]: pgmap v191: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 3.8 KiB/s wr, 8 op/s 2026-02-20T03:15:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:10 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/88814513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:11.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.054+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb581a2860 con 0x7fdb58109220 2026-02-20T03:15:11.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.055+0000 7fdb467fc640 1 -- 10.20.193.28:0/1213780234 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11921 (secure 0 0 0) 0x7fdb480a9220 con 0x7fdb58109220 2026-02-20T03:15:11.058 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:11.059 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":21,"btime":"2026-02-20T03:14:52:355182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:14:52.355103+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:15:11.059 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 21 2026-02-20T03:15:11.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb340b1050 msgr2=0x7fdb340b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb340b1050 0x7fdb340b3510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c0097c0 tx=0x7fdb4c0057d0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 msgr2=0x7fdb581a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 0x7fdb581a1500 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800ea10 tx=0x7fdb4800eee0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 shutdown_connections 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb340b1050 0x7fdb340b3510 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5810eef0 0x7fdb581a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb58109ba0 0x7fdb581a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 --2- 10.20.193.28:0/1213780234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb58109220 0x7fdb581a1500 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 >> 10.20.193.28:0/1213780234 conn(0x7fdb58078600 msgr2=0x7fdb58079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 shutdown_connections 2026-02-20T03:15:11.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.056+0000 7fdb5e4fe640 1 -- 10.20.193.28:0/1213780234 wait complete. 2026-02-20T03:15:11.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-20T03:14:32.740764+0000', 'modified': '2026-02-20T03:14:52.355103+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24538, 'mds_2': 24533}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24515': {'gid': 24515, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.126:6835/2797409986', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6834', 'nonce': 2797409986}, {'type': 'v1', 'addr': '10.20.193.126:6835', 'nonce': 2797409986}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.177:6835/2041071245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.177:6834', 'nonce': 2041071245}, {'type': 'v1', 'addr': '10.20.193.177:6835', 'nonce': 2041071245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.177:6837/3933107687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.177:6836', 'nonce': 3933107687}, {'type': 'v1', 'addr': '10.20.193.177:6837', 'nonce': 3933107687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '10.20.193.126:6837/1802675915', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6836', 'nonce': 1802675915}, {'type': 'v1', 'addr': '10.20.193.126:6837', 'nonce': 1802675915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'i', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 8, 'addr': '10.20.193.177:6839/1288808268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.177:6838', 'nonce': 1288808268}, {'type': 'v1', 'addr': '10.20.193.177:6839', 'nonce': 1288808268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.126:6839/2074063114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6838', 'nonce': 2074063114}, {'type': 'v1', 'addr': '10.20.193.126:6839', 'nonce': 2074063114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24560, 24538, 24533]} 2026-02-20T03:15:11.159 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2026-02-20T03:15:11.159 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.h status 2026-02-20T03:15:11.421 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:11.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 -- 10.20.193.28:0/1419349761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d4101f90 msgr2=0x7f23d410e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 --2- 10.20.193.28:0/1419349761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d4101f90 0x7f23d410e4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f23d000b0d0 tx=0x7f23d002f450 comp rx=0 tx=0).stop 2026-02-20T03:15:11.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 -- 10.20.193.28:0/1419349761 shutdown_connections 2026-02-20T03:15:11.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 --2- 10.20.193.28:0/1419349761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d4101f90 0x7f23d410e4a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 --2- 10.20.193.28:0/1419349761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23d41015d0 0x7f23d4101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 --2- 10.20.193.28:0/1419349761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23d4107660 0x7f23d4107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 -- 10.20.193.28:0/1419349761 >> 10.20.193.28:0/1419349761 conn(0x7f23d40fd330 msgr2=0x7f23d40ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:11.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 -- 10.20.193.28:0/1419349761 shutdown_connections 2026-02-20T03:15:11.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 -- 10.20.193.28:0/1419349761 wait complete. 2026-02-20T03:15:11.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.606+0000 7f23d99c0640 1 Processor -- start 2026-02-20T03:15:11.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d99c0640 1 -- start start 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d99c0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d41015d0 0x7f23d419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d99c0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23d4101f90 0x7f23d419d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d99c0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23d4107660 0x7f23d41a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d99c0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f23d406c1f0 con 0x7f23d41015d0 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d99c0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f23d406c070 con 0x7f23d4107660 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d99c0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4112b50 con 0x7f23d4101f90 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d89be640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d41015d0 0x7f23d419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d89be640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d41015d0 0x7f23d419cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40350/0 (socket says 10.20.193.28:40350) 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d89be640 1 -- 10.20.193.28:0/2054363964 learned_addr learned my addr 10.20.193.28:0/2054363964 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:11.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23cbfff640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23d4101f90 0x7f23d419d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d91bf640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23d4107660 0x7f23d41a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d89be640 1 -- 10.20.193.28:0/2054363964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23d4101f90 msgr2=0x7f23d419d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d89be640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23d4101f90 0x7f23d419d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d89be640 1 -- 10.20.193.28:0/2054363964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23d4107660 msgr2=0x7f23d41a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d89be640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23d4107660 0x7f23d41a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.607+0000 7f23d89be640 1 -- 10.20.193.28:0/2054363964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d41a1ff0 con 0x7f23d41015d0 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.608+0000 7f23d89be640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d41015d0 0x7f23d419cfa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f23c400ea30 tx=0x7f23c400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.608+0000 7f23c9ffb640 1 -- 10.20.193.28:0/2054363964 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c400ce50 con 0x7f23d41015d0 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.608+0000 7f23c9ffb640 1 -- 10.20.193.28:0/2054363964 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23c4004570 con 0x7f23d41015d0 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.608+0000 7f23c9ffb640 1 -- 10.20.193.28:0/2054363964 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4010690 con 0x7f23d41015d0 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.608+0000 7f23d99c0640 1 -- 10.20.193.28:0/2054363964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d41a22e0 con 0x7f23d41015d0 2026-02-20T03:15:11.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.608+0000 7f23d99c0640 1 -- 10.20.193.28:0/2054363964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41a9b20 con 0x7f23d41015d0 2026-02-20T03:15:11.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.611+0000 7f23c9ffb640 1 -- 10.20.193.28:0/2054363964 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f23c40040d0 con 0x7f23d41015d0 2026-02-20T03:15:11.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.611+0000 7f23dd14ee00 1 Processor -- start 2026-02-20T03:15:11.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.611+0000 7f23dd14ee00 1 -- start start 2026-02-20T03:15:11.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.611+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f69678e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967eb0 0x55e7f696b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f696c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e7f68ba770 con 0x55e7f696bf00 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6867f80 con 0x55e7f6967500 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e7f68b66a0 con 0x55e7f6967eb0 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f696c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f696c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40354/0 (socket says 10.20.193.28:40354) 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23cbfff640 1 -- 10.20.193.28:0/2460345898 learned_addr learned my addr 10.20.193.28:0/2460345898 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23d91bf640 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f69678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23d89be640 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967eb0 0x55e7f696b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23cbfff640 1 -- 10.20.193.28:0/2460345898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967eb0 msgr2=0x55e7f696b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:11.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23cbfff640 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967eb0 0x55e7f696b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23cbfff640 1 -- 10.20.193.28:0/2460345898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 msgr2=0x55e7f69678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23cbfff640 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f69678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23cbfff640 1 -- 10.20.193.28:0/2460345898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f685a180 con 0x55e7f696bf00 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23d91bf640 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f69678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.612+0000 7f23cbfff640 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f696c370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f23bc002760 tx=0x7f23bc002c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52a3f423c98fd9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23c9ffb640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b00b0eb0 0x7f23b00b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23a14e4640 1 -- 10.20.193.28:0/2460345898 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc009e10 con 0x55e7f696bf00 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23a14e4640 1 -- 10.20.193.28:0/2460345898 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23bc015030 con 0x55e7f696bf00 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23a14e4640 1 -- 10.20.193.28:0/2460345898 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0109a0 con 0x55e7f696bf00 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23c9ffb640 1 -- 10.20.193.28:0/2054363964 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f23c40e0930 con 0x7f23d41015d0 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2460345898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 msgr2=0x55e7f696c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f696c370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f23bc002760 tx=0x7f23bc002c30 comp rx=0 tx=0).stop 2026-02-20T03:15:11.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2460345898 shutdown_connections 2026-02-20T03:15:11.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f696c370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967eb0 0x55e7f696b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/2460345898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f69678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2460345898 >> 10.20.193.28:0/2460345898 conn(0x55e7f6963630 msgr2=0x55e7f6965a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:11.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23d91bf640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b00b0eb0 0x7f23b00b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2460345898 shutdown_connections 2026-02-20T03:15:11.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.613+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2460345898 wait complete. 2026-02-20T03:15:11.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.614+0000 7f23d91bf640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b00b0eb0 0x7f23b00b3370 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f23d0007590 tx=0x7f23d00074c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:11.619 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:11 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1213780234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.616+0000 7f23dd14ee00 1 -- start start 2026-02-20T03:15:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.616+0000 7f23dd14ee00 1 Processor -- start 2026-02-20T03:15:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967500 0x55e7f6980320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6980860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f69816e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6861d60 con 0x55e7f696bf00 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6974110 con 0x55e7f6967eb0 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6981d50 con 0x55e7f6967500 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23d91bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f69816e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23cbfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6980860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23d91bf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f69816e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40366/0 (socket says 10.20.193.28:40366) 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23cbfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6980860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:33506/0 (socket says 10.20.193.28:33506) 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23d91bf640 1 -- 10.20.193.28:0/1460892553 learned_addr learned my addr 10.20.193.28:0/1460892553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.617+0000 7f23d89be640 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967500 0x55e7f6980320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23d91bf640 1 -- 10.20.193.28:0/1460892553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967500 msgr2=0x55e7f6980320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:11.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23d91bf640 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967500 0x55e7f6980320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23d91bf640 1 -- 10.20.193.28:0/1460892553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 msgr2=0x55e7f6980860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23d91bf640 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6980860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23d91bf640 1 -- 10.20.193.28:0/1460892553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f6979890 con 0x55e7f696bf00 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23cbfff640 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6980860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23d91bf640 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f69816e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009d80 tx=0x7f23d002f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac58f45b5722d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23927fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23927fc640 1 -- 10.20.193.28:0/1460892553 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0052070 con 0x55e7f696bf00 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23927fc640 1 -- 10.20.193.28:0/1460892553 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23d0033040 con 0x55e7f696bf00 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23927fc640 1 -- 10.20.193.28:0/1460892553 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0007aa0 con 0x55e7f696bf00 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23dd14ee00 1 -- 10.20.193.28:0/1460892553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f668ba50 con 0x55e7f696bf00 2026-02-20T03:15:11.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23927fc640 1 -- 10.20.193.28:0/1460892553 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f23d0007c40 con 0x55e7f696bf00 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23dd14ee00 10 client.14955 _ll_register_callbacks cb 0x55e7f686f630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23dd14ee00 1 -- 10.20.193.28:0/1460892553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7f68c8110 con 0x55e7f696bf00 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23927fc640 1 -- 10.20.193.28:0/1460892553 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f23d0009270 con 0x55e7f696bf00 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23dd14ee00 10 client.14955 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.618+0000 7f23dd14ee00 1 -- 10.20.193.28:0/1460892553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55e7f6860720 con 0x55e7f696bf00 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.619+0000 7f23927fc640 1 -- 10.20.193.28:0/1460892553 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7f23d00044b0 con 0x55e7f696bf00 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.619+0000 7f23dd14ee00 10 client.14955 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.619+0000 7f23dd14ee00 10 client.14955 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.619+0000 7f23dd14ee00 20 client.14955 populate_metadata read hostname 'trial028' 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.619+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e7f6991290 0x55e7f6992700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.619+0000 7f23dd14ee00 4 client.14955 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.619+0000 7f23dd14ee00 1 -- 10.20.193.28:0/1460892553 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7f68c2360 con 0x55e7f6991290 2026-02-20T03:15:11.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.619+0000 7f23d89be640 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e7f6991290 0x55e7f6992700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.620+0000 7f23d89be640 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e7f6991290 0x55e7f6992700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7202d383e70f6d59 server_cookie=bb97298f13f93f98 in_seq=0 out_seq=0 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.620+0000 7f23927fc640 10 client.14955 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23927fc640 1 -- 10.20.193.28:0/1460892553 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e7f68c2360 con 0x55e7f6991290 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23927fc640 10 client.14955 handle_command_reply: tid=0 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 client.14955 shutdown 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 -- 10.20.193.28:0/1460892553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 msgr2=0x55e7f69816e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f69816e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009d80 tx=0x7f23d002f450 comp rx=0 tx=0).stop 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 -- 10.20.193.28:0/1460892553 shutdown_connections 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e7f6991290 0x55e7f6992700 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f696bf00 0x55e7f69816e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6980860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/1460892553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f6967500 0x55e7f6980320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23927fc640 0 client.14955 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:11.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 -- 10.20.193.28:0/1460892553 >> 10.20.193.28:0/1460892553 conn(0x55e7f6963630 msgr2=0x55e7f696d210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:11.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 -- 10.20.193.28:0/1460892553 shutdown_connections 2026-02-20T03:15:11.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 1 -- 10.20.193.28:0/1460892553 wait complete. 2026-02-20T03:15:11.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.621+0000 7f23dd14ee00 20 client.14955 trim_cache size 0 max 16384 2026-02-20T03:15:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23dd14ee00 1 Processor -- start 2026-02-20T03:15:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23dd14ee00 1 -- start start 2026-02-20T03:15:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967500 0x55e7f6965ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6964a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 0x55e7f6990000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6990a40 con 0x55e7f6967500 2026-02-20T03:15:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6991110 con 0x55e7f6967eb0 2026-02-20T03:15:11.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e7f69917e0 con 0x55e7f696bf00 2026-02-20T03:15:11.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23d89be640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967500 0x55e7f6965ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23d89be640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967500 0x55e7f6965ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40368/0 (socket says 10.20.193.28:40368) 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.630+0000 7f23d89be640 1 -- 10.20.193.28:0/2961423904 learned_addr learned my addr 10.20.193.28:0/2961423904 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23d91bf640 1 --2- 10.20.193.28:0/2961423904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 0x55e7f6990000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23cbfff640 1 --2- 10.20.193.28:0/2961423904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6964a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23d89be640 1 -- 10.20.193.28:0/2961423904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 msgr2=0x55e7f6990000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23d89be640 1 --2- 10.20.193.28:0/2961423904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 0x55e7f6990000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23d89be640 1 -- 10.20.193.28:0/2961423904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 msgr2=0x55e7f6964a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23d89be640 1 --2- 10.20.193.28:0/2961423904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6964a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23d89be640 1 -- 10.20.193.28:0/2961423904 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f6967c50 con 0x55e7f6967500 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23d89be640 1 --2- 10.20.193.28:0/2961423904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967500 0x55e7f6965ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f23c400c770 tx=0x7f23c4002c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be738354a99b461e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:11.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23a0ce3640 1 -- 10.20.193.28:0/2961423904 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c40a8db0 con 0x55e7f6967500 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23a0ce3640 1 -- 10.20.193.28:0/2961423904 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23c40aca60 con 0x55e7f6967500 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23a0ce3640 1 -- 10.20.193.28:0/2961423904 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c40a76c0 con 0x55e7f6967500 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2961423904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967500 msgr2=0x55e7f6965ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/2961423904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967500 0x55e7f6965ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f23c400c770 tx=0x7f23c4002c60 comp rx=0 tx=0).stop 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2961423904 shutdown_connections 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/2961423904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 0x55e7f6990000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/2961423904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967eb0 0x55e7f6964a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/2961423904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967500 0x55e7f6965ea0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2961423904 >> 10.20.193.28:0/2961423904 conn(0x55e7f6963630 msgr2=0x55e7f6981670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.631+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2961423904 shutdown_connections 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.632+0000 7f23dd14ee00 1 -- 10.20.193.28:0/2961423904 wait complete. 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.632+0000 7f23dd14ee00 1 -- start start 2026-02-20T03:15:11.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.632+0000 7f23dd14ee00 1 Processor -- start 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.632+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f6995950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.632+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967eb0 0x55e7f6995e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.632+0000 7f23dd14ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 0x55e7f69963d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.632+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6992580 con 0x55e7f6967eb0 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.632+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6991eb0 con 0x55e7f6967500 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.632+0000 7f23dd14ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e7f6992c50 con 0x55e7f696bf00 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967eb0 0x55e7f6995e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967eb0 0x55e7f6995e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40370/0 (socket says 10.20.193.28:40370) 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23cbfff640 1 -- 10.20.193.28:0/4018322414 learned_addr learned my addr 10.20.193.28:0/4018322414 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23d91bf640 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 0x55e7f69963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23d89be640 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f6995950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23cbfff640 1 -- 10.20.193.28:0/4018322414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 msgr2=0x55e7f69963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23cbfff640 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 0x55e7f69963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23cbfff640 1 -- 10.20.193.28:0/4018322414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 msgr2=0x55e7f6995950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23cbfff640 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f6995950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23cbfff640 1 -- 10.20.193.28:0/4018322414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f69796c0 con 0x55e7f6967eb0 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23d89be640 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f6995950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23cbfff640 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967eb0 0x55e7f6995e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23bc011db0 tx=0x7f23bc0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230982047e488a0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23927fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23927fc640 1 -- 10.20.193.28:0/4018322414 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc011850 con 0x55e7f6967eb0 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23dd14ee00 1 -- 10.20.193.28:0/4018322414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f6599780 con 0x55e7f6967eb0 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23dd14ee00 10 client.14961 _ll_register_callbacks cb 0x7f23bc005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:11.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23dd14ee00 1 -- 10.20.193.28:0/4018322414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7f688b5c0 con 0x55e7f6967eb0 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23927fc640 1 -- 10.20.193.28:0/4018322414 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23bc015040 con 0x55e7f6967eb0 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23927fc640 1 -- 10.20.193.28:0/4018322414 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc004d70 con 0x55e7f6967eb0 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23927fc640 1 -- 10.20.193.28:0/4018322414 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f23bc010570 con 0x55e7f6967eb0 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23927fc640 1 -- 10.20.193.28:0/4018322414 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f23bc0107d0 con 0x55e7f6967eb0 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23dd14ee00 10 client.14961 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.633+0000 7f23dd14ee00 1 -- 10.20.193.28:0/4018322414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55e7f68805f0 con 0x55e7f6967eb0 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.634+0000 7f23927fc640 1 -- 10.20.193.28:0/4018322414 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7f23bc010970 con 0x55e7f6967eb0 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.634+0000 7f23dd14ee00 10 client.14961 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.634+0000 7f23dd14ee00 10 client.14961 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.634+0000 7f23dd14ee00 20 client.14961 populate_metadata read hostname 'trial028' 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.634+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e7f6a09e10 0x55e7f6a08b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.634+0000 7f23dd14ee00 4 client.14961 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:15:11.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.634+0000 7f23dd14ee00 1 -- 10.20.193.28:0/4018322414 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "status"}) -- 0x55e7f692fca0 con 0x55e7f6a09e10 2026-02-20T03:15:11.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.634+0000 7f23d89be640 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e7f6a09e10 0x55e7f6a08b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23d89be640 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e7f6a09e10 0x55e7f6a08b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e0b10f418e00a60c server_cookie=e940669e612486b6 in_seq=0 out_seq=0 2026-02-20T03:15:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23927fc640 10 client.14961 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23927fc640 1 -- 10.20.193.28:0/4018322414 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55e7f692fca0 con 0x55e7f6a09e10 2026-02-20T03:15:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23927fc640 10 client.14961 handle_command_reply: tid=0 2026-02-20T03:15:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 client.14961 shutdown 2026-02-20T03:15:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 -- 10.20.193.28:0/4018322414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967eb0 msgr2=0x55e7f6995e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967eb0 0x55e7f6995e90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f23bc011db0 tx=0x7f23bc0055f0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 -- 10.20.193.28:0/4018322414 shutdown_connections 2026-02-20T03:15:11.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7f696bf00 0x55e7f69963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e7f6a09e10 0x55e7f6a08b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7f6967eb0 0x55e7f6995e90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 --2- 10.20.193.28:0/4018322414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7f6967500 0x55e7f6995950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23927fc640 0 client.14961 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 -- 10.20.193.28:0/4018322414 >> 10.20.193.28:0/4018322414 conn(0x55e7f6963630 msgr2=0x55e7f6980320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 -- 10.20.193.28:0/4018322414 shutdown_connections 2026-02-20T03:15:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 1 -- 10.20.193.28:0/4018322414 wait complete. 2026-02-20T03:15:11.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.635+0000 7f23dd14ee00 20 client.14961 trim_cache size 0 max 16384 2026-02-20T03:15:11.644 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 2, 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24533, 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 20.285516416, 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 21, 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 89, 2026-02-20T03:15:11.645 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 89, 2026-02-20T03:15:11.646 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 48.174209593 2026-02-20T03:15:11.646 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:11.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 -- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b00b0eb0 msgr2=0x7f23b00b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b00b0eb0 0x7f23b00b3370 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f23d0007590 tx=0x7f23d00074c0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 -- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d41015d0 msgr2=0x7f23d419cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:11.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d41015d0 0x7f23d419cfa0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f23c400ea30 tx=0x7f23c400ef00 comp rx=0 tx=0).stop 2026-02-20T03:15:11.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 -- 10.20.193.28:0/2054363964 shutdown_connections 2026-02-20T03:15:11.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b00b0eb0 0x7f23b00b3370 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23d4107660 0x7f23d41a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23d4101f90 0x7f23d419d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 --2- 10.20.193.28:0/2054363964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23d41015d0 0x7f23d419cfa0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:11.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 -- 10.20.193.28:0/2054363964 >> 10.20.193.28:0/2054363964 conn(0x7f23d40fd330 msgr2=0x7f23d410d100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:11.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 -- 10.20.193.28:0/2054363964 shutdown_connections 2026-02-20T03:15:11.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:11.636+0000 7f23d99c0640 1 -- 10.20.193.28:0/2054363964 wait complete. 2026-02-20T03:15:11.774 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.i status 2026-02-20T03:15:11.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:11 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1213780234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:11.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:11 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1213780234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:12.043 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.228+0000 7ff062fd2640 1 -- 10.20.193.28:0/917408955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c109ba0 msgr2=0x7ff05c115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.228+0000 7ff062fd2640 1 --2- 10.20.193.28:0/917408955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c109ba0 0x7ff05c115d10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff05800b0a0 tx=0x7ff05802f450 comp rx=0 tx=0).stop 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.228+0000 7ff062fd2640 1 -- 10.20.193.28:0/917408955 shutdown_connections 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.228+0000 7ff062fd2640 1 --2- 10.20.193.28:0/917408955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c109ba0 0x7ff05c115d10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.228+0000 7ff062fd2640 1 --2- 10.20.193.28:0/917408955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff05c109220 0x7ff05c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.228+0000 7ff062fd2640 1 --2- 10.20.193.28:0/917408955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff05c10eef0 0x7ff05c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.228+0000 7ff062fd2640 1 -- 10.20.193.28:0/917408955 >> 10.20.193.28:0/917408955 conn(0x7ff05c078600 msgr2=0x7ff05c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.228+0000 7ff062fd2640 1 -- 10.20.193.28:0/917408955 shutdown_connections 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.228+0000 7ff062fd2640 1 -- 10.20.193.28:0/917408955 wait complete. 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff062fd2640 1 Processor -- start 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff062fd2640 1 -- start start 2026-02-20T03:15:12.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff062fd2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff05c109220 0x7ff05c1a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff062fd2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff05c109ba0 0x7ff05c1a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff062fd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c10eef0 0x7ff05c1a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff062fd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c119090 con 0x7ff05c10eef0 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff062fd2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c118f10 con 0x7ff05c109220 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff062fd2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c119210 con 0x7ff05c109ba0 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff0627d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c10eef0 0x7ff05c1a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff0627d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c10eef0 0x7ff05c1a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40392/0 (socket says 10.20.193.28:40392) 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff061fd0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff05c109220 0x7ff05c1a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff0627d1640 1 -- 10.20.193.28:0/1060323930 learned_addr learned my addr 10.20.193.28:0/1060323930 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.229+0000 7ff0617cf640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff05c109ba0 0x7ff05c1a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff0627d1640 1 -- 10.20.193.28:0/1060323930 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff05c109ba0 msgr2=0x7ff05c1a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff0627d1640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff05c109ba0 0x7ff05c1a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff0627d1640 1 -- 10.20.193.28:0/1060323930 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff05c109220 msgr2=0x7ff05c1a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff0627d1640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff05c109220 0x7ff05c1a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff0627d1640 1 -- 10.20.193.28:0/1060323930 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c1a6480 con 0x7ff05c10eef0 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff0627d1640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c10eef0 0x7ff05c1a5d00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff058006030 tx=0x7ff058009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff04affd640 1 -- 10.20.193.28:0/1060323930 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058046070 con 0x7ff05c10eef0 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff04affd640 1 -- 10.20.193.28:0/1060323930 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0580076a0 con 0x7ff05c10eef0 2026-02-20T03:15:12.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff04affd640 1 -- 10.20.193.28:0/1060323930 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0580416e0 con 0x7ff05c10eef0 2026-02-20T03:15:12.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff062fd2640 1 -- 10.20.193.28:0/1060323930 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c1a6710 con 0x7ff05c10eef0 2026-02-20T03:15:12.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.230+0000 7ff062fd2640 1 -- 10.20.193.28:0/1060323930 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c1adfb0 con 0x7ff05c10eef0 2026-02-20T03:15:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.233+0000 7ff04affd640 1 -- 10.20.193.28:0/1060323930 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7ff058007850 con 0x7ff05c10eef0 2026-02-20T03:15:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff066760e00 1 Processor -- start 2026-02-20T03:15:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff066760e00 1 -- start start 2026-02-20T03:15:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff066760e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85bc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff066760e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 0x5604c85c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff066760e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 0x5604c85c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff066760e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604c850f770 con 0x5604c85bc500 2026-02-20T03:15:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff066760e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5604c84bcf80 con 0x5604c85bceb0 2026-02-20T03:15:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff066760e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5604c850b6a0 con 0x5604c85c0f00 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff0617cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85bc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff0617cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85bc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40402/0 (socket says 10.20.193.28:40402) 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff0617cf640 1 -- 10.20.193.28:0/971487307 learned_addr learned my addr 10.20.193.28:0/971487307 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff061fd0640 1 --2- 10.20.193.28:0/971487307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 0x5604c85c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.234+0000 7ff0617cf640 1 --2- 10.20.193.28:0/971487307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 0x5604c85c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff0617cf640 1 -- 10.20.193.28:0/971487307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 msgr2=0x5604c85c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff0617cf640 1 --2- 10.20.193.28:0/971487307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 0x5604c85c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff0617cf640 1 -- 10.20.193.28:0/971487307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 msgr2=0x5604c85c08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff0617cf640 1 --2- 10.20.193.28:0/971487307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 0x5604c85c08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff0617cf640 1 -- 10.20.193.28:0/971487307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c84af180 con 0x5604c85bc500 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff04affd640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0380b0eb0 0x7ff0380b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff04affd640 1 -- 10.20.193.28:0/1060323930 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ff058105400 con 0x7ff05c10eef0 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff0617cf640 1 --2- 10.20.193.28:0/971487307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85bc8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff050004670 tx=0x7ff050004140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866a21e82a09da7b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff061fd0640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0380b0eb0 0x7ff0380b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff02a4e6640 1 -- 10.20.193.28:0/971487307 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050012650 con 0x5604c85bc500 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff02a4e6640 1 -- 10.20.193.28:0/971487307 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff050009e30 con 0x5604c85bc500 2026-02-20T03:15:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff02a4e6640 1 -- 10.20.193.28:0/971487307 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050010b90 con 0x5604c85bc500 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff066760e00 1 -- 10.20.193.28:0/971487307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 msgr2=0x5604c85bc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff066760e00 1 --2- 10.20.193.28:0/971487307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85bc8e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff050004670 tx=0x7ff050004140 comp rx=0 tx=0).stop 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.235+0000 7ff061fd0640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0380b0eb0 0x7ff0380b3370 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5604c85bd430 tx=0x7ff04c0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.236+0000 7ff066760e00 1 -- 10.20.193.28:0/971487307 shutdown_connections 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.236+0000 7ff066760e00 1 --2- 10.20.193.28:0/971487307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 0x5604c85c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.236+0000 7ff066760e00 1 --2- 10.20.193.28:0/971487307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 0x5604c85c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.236+0000 7ff066760e00 1 --2- 10.20.193.28:0/971487307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85bc8e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.236+0000 7ff066760e00 1 -- 10.20.193.28:0/971487307 >> 10.20.193.28:0/971487307 conn(0x5604c85b8630 msgr2=0x5604c85baa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.236+0000 7ff066760e00 1 -- 10.20.193.28:0/971487307 shutdown_connections 2026-02-20T03:15:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.236+0000 7ff066760e00 1 -- 10.20.193.28:0/971487307 wait complete. 2026-02-20T03:15:12.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.237+0000 7ff066760e00 1 -- start start 2026-02-20T03:15:12.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.237+0000 7ff066760e00 1 Processor -- start 2026-02-20T03:15:12.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.237+0000 7ff066760e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bc500 0x5604c85d6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.237+0000 7ff066760e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bceb0 0x5604c85d6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.237+0000 7ff066760e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 0x5604c85d5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.237+0000 7ff066760e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604c84b6d60 con 0x5604c85bceb0 2026-02-20T03:15:12.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.237+0000 7ff066760e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5604c85c9110 con 0x5604c85c0f00 2026-02-20T03:15:12.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.237+0000 7ff066760e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5604c85d5750 con 0x5604c85bc500 2026-02-20T03:15:12.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.237+0000 7ff061fd0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bc500 0x5604c85d6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff0617cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bceb0 0x5604c85d6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff061fd0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bc500 0x5604c85d6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49474/0 (socket says 10.20.193.28:49474) 2026-02-20T03:15:12.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff061fd0640 1 -- 10.20.193.28:0/585482657 learned_addr learned my addr 10.20.193.28:0/585482657 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff0627d1640 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 0x5604c85d5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff061fd0640 1 -- 10.20.193.28:0/585482657 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 msgr2=0x5604c85d5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff061fd0640 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 0x5604c85d5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff061fd0640 1 -- 10.20.193.28:0/585482657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bceb0 msgr2=0x5604c85d6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff061fd0640 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bceb0 0x5604c85d6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff061fd0640 1 -- 10.20.193.28:0/585482657 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c85ce8e0 con 0x5604c85bc500 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff061fd0640 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bc500 0x5604c85d6960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff04c002ea0 tx=0x7ff04c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4b4c7a33e6e2ce8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff0177fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.238+0000 7ff0177fe640 1 -- 10.20.193.28:0/585482657 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c010460 con 0x5604c85bc500 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff0177fe640 1 -- 10.20.193.28:0/585482657 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff04c024020 con 0x5604c85bc500 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff0177fe640 1 -- 10.20.193.28:0/585482657 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c01f990 con 0x5604c85bc500 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff066760e00 1 -- 10.20.193.28:0/585482657 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c82e0a50 con 0x5604c85bc500 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff0177fe640 1 -- 10.20.193.28:0/585482657 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ff04c01fb30 con 0x5604c85bc500 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff066760e00 10 client.25009 _ll_register_callbacks cb 0x5604c84c4630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff066760e00 1 -- 10.20.193.28:0/585482657 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604c851d110 con 0x5604c85bc500 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff0177fe640 1 -- 10.20.193.28:0/585482657 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff04c023020 con 0x5604c85bc500 2026-02-20T03:15:12.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff066760e00 10 client.25009 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:12.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff066760e00 1 -- 10.20.193.28:0/585482657 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=21}) -- 0x5604c84b5720 con 0x5604c85bc500 2026-02-20T03:15:12.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.239+0000 7ff0177fe640 1 -- 10.20.193.28:0/585482657 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7ff04c010600 con 0x5604c85bc500 2026-02-20T03:15:12.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.240+0000 7ff066760e00 10 client.25009 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:12.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.240+0000 7ff066760e00 10 client.25009 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T03:15:12.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.240+0000 7ff066760e00 20 client.25009 populate_metadata read hostname 'trial028' 2026-02-20T03:15:12.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.240+0000 7ff066760e00 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5604c85e6ae0 0x5604c85e7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.240+0000 7ff066760e00 4 client.25009 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:12.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.240+0000 7ff066760e00 1 -- 10.20.193.28:0/585482657 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604c8517360 con 0x5604c85e6ae0 2026-02-20T03:15:12.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.240+0000 7ff0617cf640 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5604c85e6ae0 0x5604c85e7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.241+0000 7ff0617cf640 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5604c85e6ae0 0x5604c85e7830 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4774c9dc6b0f7f22 server_cookie=ace97e00f6fbadd8 in_seq=0 out_seq=0 2026-02-20T03:15:12.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.241+0000 7ff0177fe640 10 client.25009 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.241+0000 7ff0177fe640 1 -- 10.20.193.28:0/585482657 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5604c8517360 con 0x5604c85e6ae0 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.241+0000 7ff0177fe640 10 client.25009 handle_command_reply: tid=0 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.241+0000 7ff066760e00 1 client.25009 shutdown 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.241+0000 7ff066760e00 1 -- 10.20.193.28:0/585482657 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bc500 msgr2=0x5604c85d6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bc500 0x5604c85d6960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff04c002ea0 tx=0x7ff04c0047c0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 1 -- 10.20.193.28:0/585482657 shutdown_connections 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5604c85e6ae0 0x5604c85e7830 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 0x5604c85d5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bceb0 0x5604c85d6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 1 --2- 10.20.193.28:0/585482657 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bc500 0x5604c85d6960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff0177fe640 0 client.25009 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 1 -- 10.20.193.28:0/585482657 >> 10.20.193.28:0/585482657 conn(0x5604c85b8630 msgr2=0x5604c85c2210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 1 -- 10.20.193.28:0/585482657 shutdown_connections 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 1 -- 10.20.193.28:0/585482657 wait complete. 2026-02-20T03:15:12.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.242+0000 7ff066760e00 20 client.25009 trim_cache size 0 max 16384 2026-02-20T03:15:12.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff066760e00 1 Processor -- start 2026-02-20T03:15:12.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff066760e00 1 -- start start 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff066760e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff066760e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bceb0 0x5604c85b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff066760e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 0x5604c85e5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff066760e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604c85e5bc0 con 0x5604c85bc500 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff066760e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5604c85e6290 con 0x5604c85c0f00 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff066760e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5604c85e6960 con 0x5604c85bceb0 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff061fd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff0617cf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bceb0 0x5604c85b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff061fd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85d2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40422/0 (socket says 10.20.193.28:40422) 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff061fd0640 1 -- 10.20.193.28:0/2369994346 learned_addr learned my addr 10.20.193.28:0/2369994346 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.251+0000 7ff0627d1640 1 --2- 10.20.193.28:0/2369994346 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 0x5604c85e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff061fd0640 1 -- 10.20.193.28:0/2369994346 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bceb0 msgr2=0x5604c85b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff061fd0640 1 --2- 10.20.193.28:0/2369994346 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bceb0 0x5604c85b9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff061fd0640 1 -- 10.20.193.28:0/2369994346 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 msgr2=0x5604c85e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff061fd0640 1 --2- 10.20.193.28:0/2369994346 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 0x5604c85e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff061fd0640 1 -- 10.20.193.28:0/2369994346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c85ce710 con 0x5604c85bc500 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff061fd0640 1 --2- 10.20.193.28:0/2369994346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85d2ba0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff04c012cc0 tx=0x7ff04c02b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becc8c6b52fe6a7a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff029ce5640 1 -- 10.20.193.28:0/2369994346 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c002a50 con 0x5604c85bc500 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff029ce5640 1 -- 10.20.193.28:0/2369994346 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5604c851d110 con 0x5604c85bc500 2026-02-20T03:15:12.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff029ce5640 1 -- 10.20.193.28:0/2369994346 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c01fcd0 con 0x5604c85bc500 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff066760e00 1 -- 10.20.193.28:0/2369994346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 msgr2=0x5604c85d2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff066760e00 1 --2- 10.20.193.28:0/2369994346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85d2ba0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff04c012cc0 tx=0x7ff04c02b000 comp rx=0 tx=0).stop 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff066760e00 1 -- 10.20.193.28:0/2369994346 shutdown_connections 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff066760e00 1 --2- 10.20.193.28:0/2369994346 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85c0f00 0x5604c85e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff066760e00 1 --2- 10.20.193.28:0/2369994346 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85bceb0 0x5604c85b9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff066760e00 1 --2- 10.20.193.28:0/2369994346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85d2ba0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff066760e00 1 -- 10.20.193.28:0/2369994346 >> 10.20.193.28:0/2369994346 conn(0x5604c85b8630 msgr2=0x5604c85d6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff066760e00 1 -- 10.20.193.28:0/2369994346 shutdown_connections 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.252+0000 7ff066760e00 1 -- 10.20.193.28:0/2369994346 wait complete. 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.253+0000 7ff066760e00 1 -- start start 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.253+0000 7ff066760e00 1 Processor -- start 2026-02-20T03:15:12.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.253+0000 7ff066760e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85f0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.253+0000 7ff066760e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 0x5604c85eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.253+0000 7ff066760e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 0x5604c85eb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.253+0000 7ff066760e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5604c85e76b0 con 0x5604c85bc500 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.253+0000 7ff066760e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5604c85e6fe0 con 0x5604c85bceb0 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.253+0000 7ff066760e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5604c85e7d80 con 0x5604c85c0f00 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff061fd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff061fd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40436/0 (socket says 10.20.193.28:40436) 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff061fd0640 1 -- 10.20.193.28:0/3589540533 learned_addr learned my addr 10.20.193.28:0/3589540533 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff0617cf640 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 0x5604c85eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff0627d1640 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 0x5604c85eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff061fd0640 1 -- 10.20.193.28:0/3589540533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 msgr2=0x5604c85eb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff061fd0640 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 0x5604c85eb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff061fd0640 1 -- 10.20.193.28:0/3589540533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 msgr2=0x5604c85eb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff061fd0640 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 0x5604c85eb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff061fd0640 1 -- 10.20.193.28:0/3589540533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c81ee780 con 0x5604c85bc500 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff061fd0640 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85f0100 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff04c002410 tx=0x7ff04c005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c8a0889624eb03 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff0177fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff0177fe640 1 -- 10.20.193.28:0/3589540533 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c04c070 con 0x5604c85bc500 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff0177fe640 1 -- 10.20.193.28:0/3589540533 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff04c010460 con 0x5604c85bc500 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff0177fe640 1 -- 10.20.193.28:0/3589540533 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c033690 con 0x5604c85bc500 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.254+0000 7ff066760e00 1 -- 10.20.193.28:0/3589540533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c84d55f0 con 0x5604c85bc500 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff0177fe640 1 -- 10.20.193.28:0/3589540533 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ff04c033830 con 0x5604c85bc500 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 10 client.14979 _ll_register_callbacks cb 0x7ff04c0042f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 1 -- 10.20.193.28:0/3589540533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604c84e05c0 con 0x5604c85bc500 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff0177fe640 1 -- 10.20.193.28:0/3589540533 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff04c010610 con 0x5604c85bc500 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 10 client.14979 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 1 -- 10.20.193.28:0/3589540533 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x5604c85cf400 con 0x5604c85bc500 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff0177fe640 1 -- 10.20.193.28:0/3589540533 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7ff04c01fa50 con 0x5604c85bc500 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 10 client.14979 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 10 client.14979 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T03:15:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 20 client.14979 populate_metadata read hostname 'trial028' 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5604c8656c20 0x5604c8655930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 4 client.14979 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff066760e00 1 -- 10.20.193.28:0/3589540533 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "status"}) -- 0x5604c8584ca0 con 0x5604c8656c20 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.255+0000 7ff0617cf640 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5604c8656c20 0x5604c8655930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff0617cf640 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5604c8656c20 0x5604c8655930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8018e91dc6b6aac server_cookie=ead16c0b8ad6e0d3 in_seq=0 out_seq=0 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff0177fe640 10 client.14979 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff0177fe640 1 -- 10.20.193.28:0/3589540533 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5604c8584ca0 con 0x5604c8656c20 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff0177fe640 10 client.14979 handle_command_reply: tid=0 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 client.14979 shutdown 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 -- 10.20.193.28:0/3589540533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 msgr2=0x5604c85f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85f0100 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff04c002410 tx=0x7ff04c005750 comp rx=0 tx=0).stop 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 -- 10.20.193.28:0/3589540533 shutdown_connections 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5604c8656c20 0x5604c8655930 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5604c85c0f00 0x5604c85eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5604c85bceb0 0x5604c85eb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 --2- 10.20.193.28:0/3589540533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5604c85bc500 0x5604c85f0100 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 -- 10.20.193.28:0/3589540533 >> 10.20.193.28:0/3589540533 conn(0x5604c85b8630 msgr2=0x5604c85e5130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff0177fe640 0 client.14979 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.256+0000 7ff066760e00 1 -- 10.20.193.28:0/3589540533 shutdown_connections 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff066760e00 1 -- 10.20.193.28:0/3589540533 wait complete. 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff066760e00 20 client.14979 trim_cache size 0 max 16384 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 1, 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24538, 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 21.911682961, 2026-02-20T03:15:12.259 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 21, 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 89, 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 89, 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 48.098440535999998 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 -- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0380b0eb0 msgr2=0x7ff0380b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0380b0eb0 0x7ff0380b3370 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5604c85bd430 tx=0x7ff04c0073d0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 -- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c10eef0 msgr2=0x7ff05c1a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c10eef0 0x7ff05c1a5d00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff058006030 tx=0x7ff058009300 comp rx=0 tx=0).stop 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 -- 10.20.193.28:0/1060323930 shutdown_connections 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0380b0eb0 0x7ff0380b3370 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff05c10eef0 0x7ff05c1a5d00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff05c109ba0 0x7ff05c1a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 --2- 10.20.193.28:0/1060323930 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff05c109220 0x7ff05c1a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 -- 10.20.193.28:0/1060323930 >> 10.20.193.28:0/1060323930 conn(0x7ff05c078600 msgr2=0x7ff05c079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.257+0000 7ff062fd2640 1 -- 10.20.193.28:0/1060323930 shutdown_connections 2026-02-20T03:15:12.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.258+0000 7ff062fd2640 1 -- 10.20.193.28:0/1060323930 wait complete. 2026-02-20T03:15:12.360 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.b status 2026-02-20T03:15:12.626 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:12.674 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:12 trial028 ceph-mon[38552]: pgmap v192: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2026-02-20T03:15:12.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.805+0000 7f5c83fff640 1 -- 10.20.193.28:0/1249663974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c8410a980 msgr2=0x7f5c8410ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.805+0000 7f5c83fff640 1 --2- 10.20.193.28:0/1249663974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c8410a980 0x7f5c8410ad60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009a60 tx=0x7f5c7802f250 comp rx=0 tx=0).stop 2026-02-20T03:15:12.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.805+0000 7f5c83fff640 1 -- 10.20.193.28:0/1249663974 shutdown_connections 2026-02-20T03:15:12.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.805+0000 7f5c83fff640 1 --2- 10.20.193.28:0/1249663974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c84105320 0x7f5c84111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.805+0000 7f5c83fff640 1 --2- 10.20.193.28:0/1249663974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c84104980 0x7f5c84104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.805+0000 7f5c83fff640 1 --2- 10.20.193.28:0/1249663974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c8410a980 0x7f5c8410ad60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.805+0000 7f5c83fff640 1 -- 10.20.193.28:0/1249663974 >> 10.20.193.28:0/1249663974 conn(0x7f5c84100680 msgr2=0x7f5c84102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.805+0000 7f5c83fff640 1 -- 10.20.193.28:0/1249663974 shutdown_connections 2026-02-20T03:15:12.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.806+0000 7f5c83fff640 1 -- 10.20.193.28:0/1249663974 wait complete. 2026-02-20T03:15:12.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.806+0000 7f5c83fff640 1 Processor -- start 2026-02-20T03:15:12.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.806+0000 7f5c83fff640 1 -- start start 2026-02-20T03:15:12.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.806+0000 7f5c83fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c84104980 0x7f5c8419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.806+0000 7f5c83fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c84105320 0x7f5c8419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c83fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c8410a980 0x7f5c841a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c83fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84114bf0 con 0x7f5c84104980 2026-02-20T03:15:12.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c83fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84114a70 con 0x7f5c84105320 2026-02-20T03:15:12.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c83fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c84114d70 con 0x7f5c8410a980 2026-02-20T03:15:12.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c82ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c84104980 0x7f5c8419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c827fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c84105320 0x7f5c8419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c827fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c84105320 0x7f5c8419d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:33586/0 (socket says 10.20.193.28:33586) 2026-02-20T03:15:12.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c827fc640 1 -- 10.20.193.28:0/378308651 learned_addr learned my addr 10.20.193.28:0/378308651 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c837fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c8410a980 0x7f5c841a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c827fc640 1 -- 10.20.193.28:0/378308651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c8410a980 msgr2=0x7f5c841a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c827fc640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c8410a980 0x7f5c841a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c827fc640 1 -- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c84104980 msgr2=0x7f5c8419d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c827fc640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c84104980 0x7f5c8419d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c827fc640 1 -- 10.20.193.28:0/378308651 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c841a2120 con 0x7f5c84105320 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c837fe640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c8410a980 0x7f5c841a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c82ffd640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c84104980 0x7f5c8419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.807+0000 7f5c827fc640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c84105320 0x7f5c8419d610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0027e0 tx=0x7f5c6c002cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.808+0000 7f5c63fff640 1 -- 10.20.193.28:0/378308651 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00ed40 con 0x7f5c84105320 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.808+0000 7f5c63fff640 1 -- 10.20.193.28:0/378308651 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c6c0108d0 con 0x7f5c84105320 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.808+0000 7f5c63fff640 1 -- 10.20.193.28:0/378308651 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00f7c0 con 0x7f5c84105320 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.808+0000 7f5c83fff640 1 -- 10.20.193.28:0/378308651 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c841a2410 con 0x7f5c84105320 2026-02-20T03:15:12.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.808+0000 7f5c83fff640 1 -- 10.20.193.28:0/378308651 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c841a9c50 con 0x7f5c84105320 2026-02-20T03:15:12.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c8b97ce00 1 Processor -- start 2026-02-20T03:15:12.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c63fff640 1 -- 10.20.193.28:0/378308651 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f5c6c00f960 con 0x7f5c84105320 2026-02-20T03:15:12.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c8b97ce00 1 -- start start 2026-02-20T03:15:12.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550e98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e9f00 0x55fc550ea370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fc55038770 con 0x55fc550e5eb0 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fc54fe5f80 con 0x55fc550e9f00 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fc550346a0 con 0x55fc550e5500 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c837fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c82ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550e98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c837fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550e58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49520/0 (socket says 10.20.193.28:49520) 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c837fe640 1 -- 10.20.193.28:0/471608136 learned_addr learned my addr 10.20.193.28:0/471608136 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c827fc640 1 --2- 10.20.193.28:0/471608136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e9f00 0x55fc550ea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c82ffd640 1 -- 10.20.193.28:0/471608136 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 msgr2=0x55fc550e58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c82ffd640 1 --2- 10.20.193.28:0/471608136 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550e58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c82ffd640 1 -- 10.20.193.28:0/471608136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e9f00 msgr2=0x55fc550ea370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.811+0000 7f5c82ffd640 1 --2- 10.20.193.28:0/471608136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e9f00 0x55fc550ea370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c82ffd640 1 -- 10.20.193.28:0/471608136 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc54fd8180 con 0x55fc550e5eb0 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c827fc640 1 --2- 10.20.193.28:0/471608136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e9f00 0x55fc550ea370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c82ffd640 1 --2- 10.20.193.28:0/471608136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550e98e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c78002410 tx=0x7f5c78005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f99f0e8c8c93d32 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c4b7fe640 1 -- 10.20.193.28:0/471608136 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78046070 con 0x55fc550e5eb0 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c4b7fe640 1 -- 10.20.193.28:0/471608136 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c78033040 con 0x55fc550e5eb0 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c4b7fe640 1 -- 10.20.193.28:0/471608136 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78038770 con 0x55fc550e5eb0 2026-02-20T03:15:12.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c63fff640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c540b0eb0 0x7f5c540b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c63fff640 1 -- 10.20.193.28:0/378308651 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f5c6c0e0ef0 con 0x7f5c84105320 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/471608136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 msgr2=0x55fc550e98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.812+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/471608136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550e98e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5c78002410 tx=0x7f5c78005cb0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.813+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/471608136 shutdown_connections 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.813+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/471608136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e9f00 0x55fc550ea370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.813+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/471608136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550e98e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.813+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/471608136 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550e58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.813+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/471608136 >> 10.20.193.28:0/471608136 conn(0x55fc550e1630 msgr2=0x55fc550e3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.813+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/471608136 shutdown_connections 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.813+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/471608136 wait complete. 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.813+0000 7f5c837fe640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c540b0eb0 0x7f5c540b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.813+0000 7f5c837fe640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c540b0eb0 0x7f5c540b3370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009fd0 tx=0x7f5c7400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.814+0000 7f5c8b97ce00 1 -- start start 2026-02-20T03:15:12.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.814+0000 7f5c8b97ce00 1 Processor -- start 2026-02-20T03:15:12.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.814+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550ff970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.814+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 0x55fc550ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.814+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc550fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.814+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fc54fdfd60 con 0x55fc550e9f00 2026-02-20T03:15:12.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.814+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fc550f20b0 con 0x55fc550e5eb0 2026-02-20T03:15:12.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.814+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fc550fe830 con 0x55fc550e5500 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c82ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c82ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550ff970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49536/0 (socket says 10.20.193.28:49536) 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c82ffd640 1 -- 10.20.193.28:0/1710414312 learned_addr learned my addr 10.20.193.28:0/1710414312 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c827fc640 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 0x55fc550ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c837fe640 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc550fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c837fe640 1 -- 10.20.193.28:0/1710414312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 msgr2=0x55fc550ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c837fe640 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c837fe640 1 -- 10.20.193.28:0/1710414312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 msgr2=0x55fc550ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c837fe640 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 0x55fc550ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c837fe640 1 -- 10.20.193.28:0/1710414312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc550f78a0 con 0x55fc550e9f00 2026-02-20T03:15:12.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c837fe640 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc550fe0b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c74008ad0 tx=0x7f5c74004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc2916c9ea9e746 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c48ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c48ff9640 1 -- 10.20.193.28:0/1710414312 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74023430 con 0x55fc550e9f00 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/1710414312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc54e09a50 con 0x55fc550e9f00 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c48ff9640 1 -- 10.20.193.28:0/1710414312 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c74023a70 con 0x55fc550e9f00 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c48ff9640 1 -- 10.20.193.28:0/1710414312 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74016b20 con 0x55fc550e9f00 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c8b97ce00 10 client.14991 _ll_register_callbacks cb 0x55fc54fed630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.815+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/1710414312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fc55046110 con 0x55fc550e9f00 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c48ff9640 1 -- 10.20.193.28:0/1710414312 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f5c74016400 con 0x55fc550e9f00 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c48ff9640 1 -- 10.20.193.28:0/1710414312 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5c74030060 con 0x55fc550e9f00 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c8b97ce00 10 client.14991 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/1710414312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55fc54fde720 con 0x55fc550e9f00 2026-02-20T03:15:12.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c48ff9640 1 -- 10.20.193.28:0/1710414312 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7f5c74016cc0 con 0x55fc550e9f00 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c8b97ce00 10 client.14991 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c8b97ce00 10 client.14991 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c8b97ce00 20 client.14991 populate_metadata read hostname 'trial028' 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fc55117e10 0x55fc55119280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c8b97ce00 4 client.14991 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.816+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/1710414312 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc55040360 con 0x55fc55117e10 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.817+0000 7f5c82ffd640 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fc55117e10 0x55fc55119280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.817+0000 7f5c82ffd640 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fc55117e10 0x55fc55119280 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea69fb1a7e24e7bf server_cookie=9dcc6ed739d2be33 in_seq=0 out_seq=0 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.817+0000 7f5c48ff9640 10 client.14991 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c48ff9640 1 -- 10.20.193.28:0/1710414312 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fc55040360 con 0x55fc55117e10 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c48ff9640 10 client.14991 handle_command_reply: tid=0 2026-02-20T03:15:12.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 client.14991 shutdown 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/1710414312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 msgr2=0x55fc550fe0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc550fe0b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5c74008ad0 tx=0x7f5c74004bb0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/1710414312 shutdown_connections 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fc55117e10 0x55fc55119280 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc550fe0b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 0x55fc550ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/1710414312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc550ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c48ff9640 0 client.14991 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/1710414312 >> 10.20.193.28:0/1710414312 conn(0x55fc550e1630 msgr2=0x55fc550eb210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/1710414312 shutdown_connections 2026-02-20T03:15:12.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/1710414312 wait complete. 2026-02-20T03:15:12.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.818+0000 7f5c8b97ce00 20 client.14991 trim_cache size 0 max 16384 2026-02-20T03:15:12.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c8b97ce00 1 Processor -- start 2026-02-20T03:15:12.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c8b97ce00 1 -- start start 2026-02-20T03:15:12.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5500 0x55fc55118bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e9f00 0x55fc55116b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fc551175c0 con 0x55fc550e5eb0 2026-02-20T03:15:12.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fc55117c90 con 0x55fc550e5500 2026-02-20T03:15:12.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fc55118360 con 0x55fc550e9f00 2026-02-20T03:15:12.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c827fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c827fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550fbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40480/0 (socket says 10.20.193.28:40480) 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c827fc640 1 -- 10.20.193.28:0/3232624719 learned_addr learned my addr 10.20.193.28:0/3232624719 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c82ffd640 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5500 0x55fc55118bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c837fe640 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e9f00 0x55fc55116b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c827fc640 1 -- 10.20.193.28:0/3232624719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e9f00 msgr2=0x55fc55116b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c827fc640 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e9f00 0x55fc55116b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c827fc640 1 -- 10.20.193.28:0/3232624719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5500 msgr2=0x55fc55118bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c827fc640 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5500 0x55fc55118bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c827fc640 1 -- 10.20.193.28:0/3232624719 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc550f76d0 con 0x55fc550e5eb0 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.828+0000 7f5c837fe640 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e9f00 0x55fc55116b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c827fc640 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550fbb60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0a5a10 tx=0x7f5c6c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0944a9ded103495 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c4affd640 1 -- 10.20.193.28:0/3232624719 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0b1ed0 con 0x55fc550e5eb0 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c4affd640 1 -- 10.20.193.28:0/3232624719 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c6c0de860 con 0x55fc550e5eb0 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c4affd640 1 -- 10.20.193.28:0/3232624719 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c0e4280 con 0x55fc550e5eb0 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/3232624719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 msgr2=0x55fc550fbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550fbb60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0a5a10 tx=0x7f5c6c00eee0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/3232624719 shutdown_connections 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e9f00 0x55fc55116b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e5eb0 0x55fc550fbb60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/3232624719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5500 0x55fc55118bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/3232624719 >> 10.20.193.28:0/3232624719 conn(0x55fc550e1630 msgr2=0x55fc550ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/3232624719 shutdown_connections 2026-02-20T03:15:12.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.829+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/3232624719 wait complete. 2026-02-20T03:15:12.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c8b97ce00 1 -- start start 2026-02-20T03:15:12.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c8b97ce00 1 Processor -- start 2026-02-20T03:15:12.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc5511c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 0x55fc5511cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c8b97ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc55182720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fc55119100 con 0x55fc550e9f00 2026-02-20T03:15:12.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fc55118a30 con 0x55fc550e5eb0 2026-02-20T03:15:12.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c8b97ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fc551197d0 con 0x55fc550e5500 2026-02-20T03:15:12.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c82ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc5511c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c82ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc5511c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49554/0 (socket says 10.20.193.28:49554) 2026-02-20T03:15:12.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c82ffd640 1 -- 10.20.193.28:0/147763589 learned_addr learned my addr 10.20.193.28:0/147763589 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c827fc640 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 0x55fc5511cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.830+0000 7f5c837fe640 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc55182720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c837fe640 1 -- 10.20.193.28:0/147763589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 msgr2=0x55fc5511c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c837fe640 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc5511c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c837fe640 1 -- 10.20.193.28:0/147763589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 msgr2=0x55fc5511cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c837fe640 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 0x55fc5511cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c837fe640 1 -- 10.20.193.28:0/147763589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc54d17780 con 0x55fc550e9f00 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c837fe640 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc55182720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5c74003ef0 tx=0x7f5c740236e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe78c9095dff904 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c48ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c48ff9640 1 -- 10.20.193.28:0/147763589 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74039050 con 0x55fc550e9f00 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c48ff9640 1 -- 10.20.193.28:0/147763589 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c74043070 con 0x55fc550e9f00 2026-02-20T03:15:12.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c48ff9640 1 -- 10.20.193.28:0/147763589 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7403e780 con 0x55fc550e9f00 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/147763589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc54ffe5f0 con 0x55fc550e9f00 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c48ff9640 1 -- 10.20.193.28:0/147763589 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f5c7403e920 con 0x55fc550e9f00 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c8b97ce00 10 client.14997 _ll_register_callbacks cb 0x7f5c7401a050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.831+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/147763589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c78033040 con 0x55fc550e9f00 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c48ff9640 1 -- 10.20.193.28:0/147763589 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5c7403eb20 con 0x55fc550e9f00 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c8b97ce00 10 client.14997 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/147763589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55fc550f83c0 con 0x55fc550e9f00 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c48ff9640 1 -- 10.20.193.28:0/147763589 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7f5c7403ecc0 con 0x55fc550e9f00 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c8b97ce00 10 client.14997 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c8b97ce00 10 client.14997 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c8b97ce00 20 client.14997 populate_metadata read hostname 'trial028' 2026-02-20T03:15:12.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fc551885a0 0x55fc551872b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c8b97ce00 4 client.14997 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/147763589 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "status"}) -- 0x55fc550095c0 con 0x55fc551885a0 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.832+0000 7f5c82ffd640 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fc551885a0 0x55fc551872b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c82ffd640 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fc551885a0 0x55fc551872b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11bdf261d3f08a2e server_cookie=728dde21b5af17ee in_seq=0 out_seq=0 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c48ff9640 10 client.14997 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c48ff9640 1 -- 10.20.193.28:0/147763589 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fc550095c0 con 0x55fc551885a0 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c48ff9640 10 client.14997 handle_command_reply: tid=0 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 client.14997 shutdown 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/147763589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 msgr2=0x55fc55182720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc55182720 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5c74003ef0 tx=0x7f5c740236e0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/147763589 shutdown_connections 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fc551885a0 0x55fc551872b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fc550e9f00 0x55fc55182720 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fc550e5eb0 0x55fc5511cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 --2- 10.20.193.28:0/147763589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fc550e5500 0x55fc5511c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c48ff9640 0 client.14997 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/147763589 >> 10.20.193.28:0/147763589 conn(0x55fc550e1630 msgr2=0x55fc55116b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/147763589 shutdown_connections 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.833+0000 7f5c8b97ce00 1 -- 10.20.193.28:0/147763589 wait complete. 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c8b97ce00 20 client.14997 trim_cache size 0 max 16384 2026-02-20T03:15:12.844 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 0, 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24560, 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 39.547307082000003, 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 21, 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 89, 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 89, 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 45.460621097999997 2026-02-20T03:15:12.845 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:12.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 -- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c540b0eb0 msgr2=0x7f5c540b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c540b0eb0 0x7f5c540b3370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009fd0 tx=0x7f5c7400b040 comp rx=0 tx=0).stop 2026-02-20T03:15:12.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 -- 10.20.193.28:0/378308651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c84105320 msgr2=0x7f5c8419d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:12.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c84105320 0x7f5c8419d610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0027e0 tx=0x7f5c6c002cb0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 -- 10.20.193.28:0/378308651 shutdown_connections 2026-02-20T03:15:12.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c540b0eb0 0x7f5c540b3370 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c8410a980 0x7f5c841a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c84105320 0x7f5c8419d610 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 --2- 10.20.193.28:0/378308651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c84104980 0x7f5c8419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:12.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 -- 10.20.193.28:0/378308651 >> 10.20.193.28:0/378308651 conn(0x7f5c84100680 msgr2=0x7f5c84101080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:12.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 -- 10.20.193.28:0/378308651 shutdown_connections 2026-02-20T03:15:12.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:12.834+0000 7f5c83fff640 1 -- 10.20.193.28:0/378308651 wait complete. 2026-02-20T03:15:12.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:12 trial126 ceph-mon[38476]: pgmap v192: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2026-02-20T03:15:12.934 INFO:tasks.cephadm:Setup complete, yielding 2026-02-20T03:15:12.935 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-20T03:15:12.952 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-20T03:15:12.952 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-20T03:15:12.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:12 trial177 ceph-mon[43181]: pgmap v192: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2026-02-20T03:15:13.223 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:13.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.395+0000 7f2e648f0640 1 -- 10.20.193.28:0/309843314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e60074950 msgr2=0x7f2e6010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.395+0000 7f2e648f0640 1 --2- 10.20.193.28:0/309843314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e60074950 0x7f2e6010a470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009a30 tx=0x7f2e4802f2b0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.395+0000 7f2e648f0640 1 -- 10.20.193.28:0/309843314 shutdown_connections 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.395+0000 7f2e648f0640 1 --2- 10.20.193.28:0/309843314 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e6010aa00 0x7f2e6010aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.395+0000 7f2e648f0640 1 --2- 10.20.193.28:0/309843314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e60074950 0x7f2e6010a470 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.395+0000 7f2e648f0640 1 --2- 10.20.193.28:0/309843314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e60074010 0x7f2e60074410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.395+0000 7f2e648f0640 1 -- 10.20.193.28:0/309843314 >> 10.20.193.28:0/309843314 conn(0x7f2e6006f8f0 msgr2=0x7f2e60071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.395+0000 7f2e648f0640 1 -- 10.20.193.28:0/309843314 shutdown_connections 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.395+0000 7f2e648f0640 1 -- 10.20.193.28:0/309843314 wait complete. 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e648f0640 1 Processor -- start 2026-02-20T03:15:13.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e648f0640 1 -- start start 2026-02-20T03:15:13.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e648f0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e60074010 0x7f2e601a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:13.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e648f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e60074950 0x7f2e601a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:13.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e648f0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e6010aa00 0x7f2e601aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e648f0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2e60116c40 con 0x7f2e60074950 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e648f0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2e60116ac0 con 0x7f2e60074010 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e648f0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e60116dc0 con 0x7f2e6010aa00 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e5e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e60074950 0x7f2e601a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e5f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e6010aa00 0x7f2e601aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e5e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e60074950 0x7f2e601a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40496/0 (socket says 10.20.193.28:40496) 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e5e575640 1 -- 10.20.193.28:0/2801390177 learned_addr learned my addr 10.20.193.28:0/2801390177 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.396+0000 7f2e5ed76640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e60074010 0x7f2e601a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e5e575640 1 -- 10.20.193.28:0/2801390177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e6010aa00 msgr2=0x7f2e601aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e5e575640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e6010aa00 0x7f2e601aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e5e575640 1 -- 10.20.193.28:0/2801390177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e60074010 msgr2=0x7f2e601a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:13.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e5e575640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e60074010 0x7f2e601a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e5e575640 1 -- 10.20.193.28:0/2801390177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e601ad170 con 0x7f2e60074950 2026-02-20T03:15:13.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e5e575640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e60074950 0x7f2e601a59f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009950 tx=0x7f2e4802fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:13.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e3ffff640 1 -- 10.20.193.28:0/2801390177 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48004260 con 0x7f2e60074950 2026-02-20T03:15:13.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e601ad400 con 0x7f2e60074950 2026-02-20T03:15:13.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e3ffff640 1 -- 10.20.193.28:0/2801390177 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2e48004400 con 0x7f2e60074950 2026-02-20T03:15:13.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e3ffff640 1 -- 10.20.193.28:0/2801390177 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48041710 con 0x7f2e60074950 2026-02-20T03:15:13.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.397+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e601ad930 con 0x7f2e60074950 2026-02-20T03:15:13.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.398+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e601adc50 con 0x7f2e60074950 2026-02-20T03:15:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.400+0000 7f2e3ffff640 1 -- 10.20.193.28:0/2801390177 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f2e48038a30 con 0x7f2e60074950 2026-02-20T03:15:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.402+0000 7f2e3ffff640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e340b0ee0 0x7f2e340b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.402+0000 7f2e3ffff640 1 -- 10.20.193.28:0/2801390177 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f2e48105420 con 0x7f2e60074950 2026-02-20T03:15:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.402+0000 7f2e5ed76640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e340b0ee0 0x7f2e340b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.402+0000 7f2e3ffff640 1 -- 10.20.193.28:0/2801390177 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f2e481058a0 con 0x7f2e60074950 2026-02-20T03:15:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.403+0000 7f2e5ed76640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e340b0ee0 0x7f2e340b33a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004560 tx=0x7f2e54009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:13.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.500+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2e60112fc0 con 0x7f2e340b0ee0 2026-02-20T03:15:13.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.501+0000 7f2e3ffff640 1 -- 10.20.193.28:0/2801390177 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2e60112fc0 con 0x7f2e340b0ee0 2026-02-20T03:15:13.504 INFO:teuthology.orchestra.run.trial028.stdout:Backend: cephadm 2026-02-20T03:15:13.504 INFO:teuthology.orchestra.run.trial028.stdout:Available: Yes 2026-02-20T03:15:13.504 INFO:teuthology.orchestra.run.trial028.stdout:Paused: No 2026-02-20T03:15:13.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e340b0ee0 msgr2=0x7f2e340b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:13.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e340b0ee0 0x7f2e340b33a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2e54004560 tx=0x7f2e54009290 comp rx=0 tx=0).stop 2026-02-20T03:15:13.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e60074950 msgr2=0x7f2e601a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:13.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e60074950 0x7f2e601a59f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009950 tx=0x7f2e4802fdb0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 shutdown_connections 2026-02-20T03:15:13.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e340b0ee0 0x7f2e340b33a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e6010aa00 0x7f2e601aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e60074950 0x7f2e601a59f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 --2- 10.20.193.28:0/2801390177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e60074010 0x7f2e601a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:13.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 >> 10.20.193.28:0/2801390177 conn(0x7f2e6006f8f0 msgr2=0x7f2e600710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:13.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 shutdown_connections 2026-02-20T03:15:13.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:13.502+0000 7f2e648f0640 1 -- 10.20.193.28:0/2801390177 wait complete. 2026-02-20T03:15:13.640 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-20T03:15:13.905 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:14.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.086+0000 7f0cfae1f640 1 -- 10.20.193.28:0/800229495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf4109e50 msgr2=0x7f0cf410a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.086+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/800229495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf4109e50 0x7f0cf410a2d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009a30 tx=0x7f0ce802f1c0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.086+0000 7f0cfae1f640 1 -- 10.20.193.28:0/800229495 shutdown_connections 2026-02-20T03:15:14.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.086+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/800229495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf410a970 0x7f0cf4111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.086+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/800229495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf4109e50 0x7f0cf410a2d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.086+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/800229495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf4109480 0x7f0cf4109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.086+0000 7f0cfae1f640 1 -- 10.20.193.28:0/800229495 >> 10.20.193.28:0/800229495 conn(0x7f0cf4078050 msgr2=0x7f0cf407a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:14.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.086+0000 7f0cfae1f640 1 -- 10.20.193.28:0/800229495 shutdown_connections 2026-02-20T03:15:14.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.086+0000 7f0cfae1f640 1 -- 10.20.193.28:0/800229495 wait complete. 2026-02-20T03:15:14.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfae1f640 1 Processor -- start 2026-02-20T03:15:14.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfae1f640 1 -- start start 2026-02-20T03:15:14.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfae1f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf4109480 0x7f0cf40809d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:14.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfae1f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf4109e50 0x7f0cf4080f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:14.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfae1f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf410a970 0x7f0cf41b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfae1f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf41149e0 con 0x7f0cf4109480 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfae1f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf4114860 con 0x7f0cf4109e50 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfae1f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf4114b60 con 0x7f0cf410a970 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfa61e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf410a970 0x7f0cf41b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfa61e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf410a970 0x7f0cf41b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49590/0 (socket says 10.20.193.28:49590) 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cfa61e640 1 -- 10.20.193.28:0/4054949679 learned_addr learned my addr 10.20.193.28:0/4054949679 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cf961c640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf4109e50 0x7f0cf4080f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.087+0000 7f0cf9e1d640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf4109480 0x7f0cf40809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0cfa61e640 1 -- 10.20.193.28:0/4054949679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf4109e50 msgr2=0x7f0cf4080f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0cfa61e640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf4109e50 0x7f0cf4080f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0cfa61e640 1 -- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf4109480 msgr2=0x7f0cf40809d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0cfa61e640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf4109480 0x7f0cf40809d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0cfa61e640 1 -- 10.20.193.28:0/4054949679 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf4084160 con 0x7f0cf410a970 2026-02-20T03:15:14.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0cfa61e640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf410a970 0x7f0cf41b1450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0004820 tx=0x7f0cf000d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:14.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0ce2ffd640 1 -- 10.20.193.28:0/4054949679 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf00090d0 con 0x7f0cf410a970 2026-02-20T03:15:14.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0ce2ffd640 1 -- 10.20.193.28:0/4054949679 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0cf0009270 con 0x7f0cf410a970 2026-02-20T03:15:14.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf41b1990 con 0x7f0cf410a970 2026-02-20T03:15:14.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf41b1e40 con 0x7f0cf410a970 2026-02-20T03:15:14.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.088+0000 7f0ce2ffd640 1 -- 10.20.193.28:0/4054949679 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0013810 con 0x7f0cf410a970 2026-02-20T03:15:14.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.089+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf4109880 con 0x7f0cf410a970 2026-02-20T03:15:14.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.091+0000 7f0ce2ffd640 1 -- 10.20.193.28:0/4054949679 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f0cf0012070 con 0x7f0cf410a970 2026-02-20T03:15:14.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.093+0000 7f0ce2ffd640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cd00b0e30 0x7f0cd00b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:14.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.093+0000 7f0ce2ffd640 1 -- 10.20.193.28:0/4054949679 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f0cf00e0790 con 0x7f0cf410a970 2026-02-20T03:15:14.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.093+0000 7f0cf9e1d640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cd00b0e30 0x7f0cd00b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:14.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.093+0000 7f0ce2ffd640 1 -- 10.20.193.28:0/4054949679 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0cf0010070 con 0x7f0cf410a970 2026-02-20T03:15:14.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.094+0000 7f0cf9e1d640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cd00b0e30 0x7f0cd00b32f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0cf407b770 tx=0x7f0ce4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:14.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.187+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0cf40630c0 con 0x7f0cd00b0e30 2026-02-20T03:15:14.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.193+0000 7f0ce2ffd640 1 -- 10.20.193.28:0/4054949679 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f0cf40630c0 con 0x7f0cd00b0e30 2026-02-20T03:15:14.196 INFO:teuthology.orchestra.run.trial028.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-20T03:15:14.196 INFO:teuthology.orchestra.run.trial028.stdout:mds.a trial028 running (47s) 44s ago 47s 13.7M - 19.2.3-700-gf4ef35d9 de93007c0a72 713fa995906a 2026-02-20T03:15:14.196 INFO:teuthology.orchestra.run.trial028.stdout:mds.b trial126 running (46s) 44s ago 46s 15.0M - 19.2.3-700-gf4ef35d9 de93007c0a72 d9a14fd46dca 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.c trial177 running (51s) 44s ago 51s 15.1M - 19.2.3-700-gf4ef35d9 de93007c0a72 d32fc97afd6f 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.d trial028 running (53s) 44s ago 53s 13.7M - 19.2.3-700-gf4ef35d9 de93007c0a72 973e99a6fe84 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.e trial126 running (52s) 44s ago 52s 15.0M - 19.2.3-700-gf4ef35d9 de93007c0a72 39a5bee4020e 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.f trial177 running (52s) 44s ago 52s 15.1M - 19.2.3-700-gf4ef35d9 de93007c0a72 11d1d0799ecb 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.g trial028 running (48s) 44s ago 48s 13.5M - 19.2.3-700-gf4ef35d9 de93007c0a72 03cd8aed26d5 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.h trial126 running (50s) 44s ago 50s 16.6M - 19.2.3-700-gf4ef35d9 de93007c0a72 4403d524e197 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.i trial177 running (50s) 44s ago 50s 17.5M - 19.2.3-700-gf4ef35d9 de93007c0a72 81465b241018 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.j trial028 running (54s) 44s ago 54s 13.6M - 19.2.3-700-gf4ef35d9 de93007c0a72 b74fb00f503d 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.k trial126 running (56s) 44s ago 56s 17.3M - 19.2.3-700-gf4ef35d9 de93007c0a72 b0a7a0c2c751 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mds.l trial177 running (56s) 44s ago 56s 14.3M - 19.2.3-700-gf4ef35d9 de93007c0a72 fbb6c767244d 2026-02-20T03:15:14.197 INFO:teuthology.orchestra.run.trial028.stdout:mgr.x trial028 *:9283,8765 running (4m) 44s ago 4m 563M - 19.2.3-700-gf4ef35d9 de93007c0a72 58c5d3975ef7 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:mgr.y trial126 *:8443,8765 running (3m) 44s ago 3m 488M - 19.2.3-700-gf4ef35d9 de93007c0a72 9913e34b3d37 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:mgr.z trial177 *:8443,8765 running (3m) 44s ago 3m 488M - 19.2.3-700-gf4ef35d9 de93007c0a72 45956e2ef5b0 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:mon.a trial028 running (4m) 44s ago 4m 53.6M 2048M 19.2.3-700-gf4ef35d9 de93007c0a72 656b013ac329 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:mon.b trial126 running (3m) 44s ago 3m 50.0M 2048M 19.2.3-700-gf4ef35d9 de93007c0a72 50a518dae843 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:mon.c trial177 running (3m) 44s ago 3m 50.7M 2048M 19.2.3-700-gf4ef35d9 de93007c0a72 6af395529a11 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:osd.0 trial028 running (3m) 44s ago 3m 44.5M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 c0a662372942 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:osd.1 trial126 running (2m) 44s ago 2m 45.9M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 36c286a5e682 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:osd.2 trial177 running (2m) 44s ago 2m 44.6M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 13492f6c7e7f 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:osd.3 trial028 running (2m) 44s ago 2m 43.0M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 7921a6bdf300 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:osd.4 trial126 running (2m) 44s ago 2m 53.5M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 36233f3afce9 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:osd.5 trial177 running (2m) 44s ago 2m 44.0M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 25a2493cd137 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:osd.6 trial028 running (2m) 44s ago 2m 40.3M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 fd2350b223eb 2026-02-20T03:15:14.198 INFO:teuthology.orchestra.run.trial028.stdout:osd.7 trial126 running (110s) 44s ago 110s 53.8M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 2954902dceab 2026-02-20T03:15:14.199 INFO:teuthology.orchestra.run.trial028.stdout:osd.8 trial177 running (101s) 44s ago 101s 52.9M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 16c1d09876b0 2026-02-20T03:15:14.199 INFO:teuthology.orchestra.run.trial028.stdout:osd.9 trial028 running (88s) 44s ago 88s 40.4M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 d7fdd1c73bc1 2026-02-20T03:15:14.199 INFO:teuthology.orchestra.run.trial028.stdout:osd.10 trial126 running (78s) 44s ago 78s 55.2M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 8462e598297e 2026-02-20T03:15:14.199 INFO:teuthology.orchestra.run.trial028.stdout:osd.11 trial177 running (68s) 44s ago 68s 49.9M 20.5G 19.2.3-700-gf4ef35d9 de93007c0a72 9d958a352ae4 2026-02-20T03:15:14.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cd00b0e30 msgr2=0x7f0cd00b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cd00b0e30 0x7f0cd00b32f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0cf407b770 tx=0x7f0ce4009260 comp rx=0 tx=0).stop 2026-02-20T03:15:14.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf410a970 msgr2=0x7f0cf41b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf410a970 0x7f0cf41b1450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0004820 tx=0x7f0cf000d4a0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 shutdown_connections 2026-02-20T03:15:14.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cd00b0e30 0x7f0cd00b32f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf410a970 0x7f0cf41b1450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf4109e50 0x7f0cf4080f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 --2- 10.20.193.28:0/4054949679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf4109480 0x7f0cf40809d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 >> 10.20.193.28:0/4054949679 conn(0x7f0cf4078050 msgr2=0x7f0cf410d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:14.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 shutdown_connections 2026-02-20T03:15:14.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.195+0000 7f0cfae1f640 1 -- 10.20.193.28:0/4054949679 wait complete. 2026-02-20T03:15:14.337 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-20T03:15:14.601 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.779+0000 7f587bfff640 1 -- 10.20.193.28:0/297769252 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 msgr2=0x7f587c10a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.779+0000 7f587bfff640 1 --2- 10.20.193.28:0/297769252 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 0x7f587c10a2d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5864009a30 tx=0x7f586402f1c0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.779+0000 7f587bfff640 1 -- 10.20.193.28:0/297769252 shutdown_connections 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.779+0000 7f587bfff640 1 --2- 10.20.193.28:0/297769252 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f587c10a970 0x7f587c111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.779+0000 7f587bfff640 1 --2- 10.20.193.28:0/297769252 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 0x7f587c10a2d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.779+0000 7f587bfff640 1 --2- 10.20.193.28:0/297769252 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f587c109480 0x7f587c109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.779+0000 7f587bfff640 1 -- 10.20.193.28:0/297769252 >> 10.20.193.28:0/297769252 conn(0x7f587c078050 msgr2=0x7f587c07a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.779+0000 7f587bfff640 1 -- 10.20.193.28:0/297769252 shutdown_connections 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.779+0000 7f587bfff640 1 -- 10.20.193.28:0/297769252 wait complete. 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.780+0000 7f587bfff640 1 Processor -- start 2026-02-20T03:15:14.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.780+0000 7f587bfff640 1 -- start start 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.780+0000 7f587bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f587c109480 0x7f587c1a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.780+0000 7f587bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 0x7f587c1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.780+0000 7f587bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f587c10a970 0x7f587c1a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.780+0000 7f587bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f587c114a00 con 0x7f587c109e50 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.780+0000 7f587bfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f587c114880 con 0x7f587c10a970 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.780+0000 7f587bfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f587c114b80 con 0x7f587c109480 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 0x7f587c1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f587c109480 0x7f587c1a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 0x7f587c1a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40518/0 (socket says 10.20.193.28:40518) 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587a7fc640 1 -- 10.20.193.28:0/2187769448 learned_addr learned my addr 10.20.193.28:0/2187769448 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587a7fc640 1 -- 10.20.193.28:0/2187769448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f587c109480 msgr2=0x7f587c1a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587a7fc640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f587c109480 0x7f587c1a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587a7fc640 1 -- 10.20.193.28:0/2187769448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f587c10a970 msgr2=0x7f587c1a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587a7fc640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f587c10a970 0x7f587c1a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587a7fc640 1 -- 10.20.193.28:0/2187769448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f587c1a8ca0 con 0x7f587c109e50 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587a7fc640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 0x7f587c1a1520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5864009b60 tx=0x7f5864002980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f585bfff640 1 -- 10.20.193.28:0/2187769448 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864004260 con 0x7f587c109e50 2026-02-20T03:15:14.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f587c1a8f30 con 0x7f587c109e50 2026-02-20T03:15:14.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f587c1a93e0 con 0x7f587c109e50 2026-02-20T03:15:14.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f585bfff640 1 -- 10.20.193.28:0/2187769448 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5864004400 con 0x7f587c109e50 2026-02-20T03:15:14.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.781+0000 7f585bfff640 1 -- 10.20.193.28:0/2187769448 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864041740 con 0x7f587c109e50 2026-02-20T03:15:14.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.782+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587c10fef0 con 0x7f587c109e50 2026-02-20T03:15:14.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.784+0000 7f585bfff640 1 -- 10.20.193.28:0/2187769448 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f586404a070 con 0x7f587c109e50 2026-02-20T03:15:14.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.786+0000 7f585bfff640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58500b0f60 0x7f58500b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:14.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.786+0000 7f585bfff640 1 -- 10.20.193.28:0/2187769448 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f5864105880 con 0x7f587c109e50 2026-02-20T03:15:14.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.786+0000 7f585bfff640 1 -- 10.20.193.28:0/2187769448 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5864047060 con 0x7f587c109e50 2026-02-20T03:15:14.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.786+0000 7f587affd640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58500b0f60 0x7f58500b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:14.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.787+0000 7f587affd640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58500b0f60 0x7f58500b3420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5870004730 tx=0x7f5870004050 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:14.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.881+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f587c0630c0 con 0x7f58500b0f60 2026-02-20T03:15:14.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.884+0000 7f585bfff640 1 -- 10.20.193.28:0/2187769448 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+920 (secure 0 0 0) 0x7f587c0630c0 con 0x7f58500b0f60 2026-02-20T03:15:14.887 INFO:teuthology.orchestra.run.trial028.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-20T03:15:14.887 INFO:teuthology.orchestra.run.trial028.stdout:mds.all 12/12 45s ago 58s trial028=a;trial028=d;trial028=g;trial028=j;trial126=b;trial126=e;trial126=h;trial126=k;trial177=c;trial177=f;trial177=i;trial177=l;count:12 2026-02-20T03:15:14.887 INFO:teuthology.orchestra.run.trial028.stdout:mgr 3/3 45s ago 3m trial028=x;trial126=y;trial177=z;count:3 2026-02-20T03:15:14.887 INFO:teuthology.orchestra.run.trial028.stdout:mon 3/3 45s ago 3m trial028:10.20.193.28=a;trial126:10.20.193.126=b;trial177:10.20.193.177=c;count:3 2026-02-20T03:15:14.888 INFO:teuthology.orchestra.run.trial028.stdout:osd 12 45s ago - 2026-02-20T03:15:14.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58500b0f60 msgr2=0x7f58500b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58500b0f60 0x7f58500b3420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5870004730 tx=0x7f5870004050 comp rx=0 tx=0).stop 2026-02-20T03:15:14.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 msgr2=0x7f587c1a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:14.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 0x7f587c1a1520 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5864009b60 tx=0x7f5864002980 comp rx=0 tx=0).stop 2026-02-20T03:15:14.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 shutdown_connections 2026-02-20T03:15:14.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58500b0f60 0x7f58500b3420 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f587c10a970 0x7f587c1a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f587c109e50 0x7f587c1a1520 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 --2- 10.20.193.28:0/2187769448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f587c109480 0x7f587c1a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:14.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 >> 10.20.193.28:0/2187769448 conn(0x7f587c078050 msgr2=0x7f587c10d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:14.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.885+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 shutdown_connections 2026-02-20T03:15:14.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:14.886+0000 7f587bfff640 1 -- 10.20.193.28:0/2187769448 wait complete. 2026-02-20T03:15:14.987 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-20T03:15:15.260 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:15.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:15 trial028 ceph-mon[38552]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:15.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:15 trial028 ceph-mon[38552]: pgmap v193: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2026-02-20T03:15:15.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:15 trial028 ceph-mon[38552]: from='client.25042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:15.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:15 trial126 ceph-mon[38476]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:15.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:15 trial126 ceph-mon[38476]: pgmap v193: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2026-02-20T03:15:15.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:15 trial126 ceph-mon[38476]: from='client.25042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:15.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.446+0000 7f45fa234640 1 -- 10.20.193.28:0/2793960384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4105dc0 msgr2=0x7f45f4106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:15.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.446+0000 7f45fa234640 1 --2- 10.20.193.28:0/2793960384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4105dc0 0x7f45f4106240 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009a30 tx=0x7f45e402f220 comp rx=0 tx=0).stop 2026-02-20T03:15:15.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.446+0000 7f45fa234640 1 -- 10.20.193.28:0/2793960384 shutdown_connections 2026-02-20T03:15:15.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.446+0000 7f45fa234640 1 --2- 10.20.193.28:0/2793960384 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45f4106780 0x7f45f410d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:15.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.446+0000 7f45fa234640 1 --2- 10.20.193.28:0/2793960384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4105dc0 0x7f45f4106240 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:15.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.446+0000 7f45fa234640 1 --2- 10.20.193.28:0/2793960384 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45f4104bc0 0x7f45f4104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:15.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.446+0000 7f45fa234640 1 -- 10.20.193.28:0/2793960384 >> 10.20.193.28:0/2793960384 conn(0x7f45f4100370 msgr2=0x7f45f4102790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:15.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.446+0000 7f45fa234640 1 -- 10.20.193.28:0/2793960384 shutdown_connections 2026-02-20T03:15:15.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.447+0000 7f45fa234640 1 -- 10.20.193.28:0/2793960384 wait complete. 2026-02-20T03:15:15.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.447+0000 7f45fa234640 1 Processor -- start 2026-02-20T03:15:15.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45fa234640 1 -- start start 2026-02-20T03:15:15.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45fa234640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45f4104bc0 0x7f45f419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:15.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45fa234640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45f4105dc0 0x7f45f419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:15.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45fa234640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4106780 0x7f45f41a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45fa234640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4110760 con 0x7f45f4106780 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45fa234640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41105e0 con 0x7f45f4105dc0 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45fa234640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41108e0 con 0x7f45f4104bc0 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4106780 0x7f45f41a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4106780 0x7f45f41a43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40524/0 (socket says 10.20.193.28:40524) 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f3fff640 1 -- 10.20.193.28:0/56092406 learned_addr learned my addr 10.20.193.28:0/56092406 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f37fe640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45f4104bc0 0x7f45f419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f2ffd640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45f4105dc0 0x7f45f419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f3fff640 1 -- 10.20.193.28:0/56092406 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45f4104bc0 msgr2=0x7f45f419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f3fff640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45f4104bc0 0x7f45f419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f3fff640 1 -- 10.20.193.28:0/56092406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45f4105dc0 msgr2=0x7f45f419d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:15.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f3fff640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45f4105dc0 0x7f45f419d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:15.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.448+0000 7f45f3fff640 1 -- 10.20.193.28:0/56092406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f41a4aa0 con 0x7f45f4106780 2026-02-20T03:15:15.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.449+0000 7f45f3fff640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4106780 0x7f45f41a43a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f45e800b970 tx=0x7f45e800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:15.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.449+0000 7f45f0ff9640 1 -- 10.20.193.28:0/56092406 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e800c790 con 0x7f45f4106780 2026-02-20T03:15:15.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.449+0000 7f45f0ff9640 1 -- 10.20.193.28:0/56092406 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45e8010070 con 0x7f45f4106780 2026-02-20T03:15:15.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.449+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f41a4d90 con 0x7f45f4106780 2026-02-20T03:15:15.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.449+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f41a5320 con 0x7f45f4106780 2026-02-20T03:15:15.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.449+0000 7f45f0ff9640 1 -- 10.20.193.28:0/56092406 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8015470 con 0x7f45f4106780 2026-02-20T03:15:15.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.450+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f410bb70 con 0x7f45f4106780 2026-02-20T03:15:15.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.452+0000 7f45f0ff9640 1 -- 10.20.193.28:0/56092406 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f45e801d030 con 0x7f45f4106780 2026-02-20T03:15:15.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.453+0000 7f45f0ff9640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45c80b0ee0 0x7f45c80b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:15.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.453+0000 7f45f0ff9640 1 -- 10.20.193.28:0/56092406 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f45e80e00a0 con 0x7f45f4106780 2026-02-20T03:15:15.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.453+0000 7f45f0ff9640 1 -- 10.20.193.28:0/56092406 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f45e80e0520 con 0x7f45f4106780 2026-02-20T03:15:15.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.454+0000 7f45f37fe640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45c80b0ee0 0x7f45c80b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:15.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.454+0000 7f45f37fe640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45c80b0ee0 0x7f45c80b33a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45f4105c20 tx=0x7f45e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:15.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:15 trial177 ceph-mon[43181]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:15.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:15 trial177 ceph-mon[43181]: pgmap v193: 129 pgs: 129 active+clean; 643 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2026-02-20T03:15:15.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:15 trial177 ceph-mon[43181]: from='client.25042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:15.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.547+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f45f40630c0 con 0x7f45c80b0ee0 2026-02-20T03:15:15.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.548+0000 7f45f0ff9640 1 -- 10.20.193.28:0/56092406 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f45f40630c0 con 0x7f45c80b0ee0 2026-02-20T03:15:15.550 INFO:teuthology.orchestra.run.trial028.stdout:HOST ADDR LABELS STATUS 2026-02-20T03:15:15.551 INFO:teuthology.orchestra.run.trial028.stdout:trial028 10.20.193.28 2026-02-20T03:15:15.551 INFO:teuthology.orchestra.run.trial028.stdout:trial126 10.20.193.126 2026-02-20T03:15:15.551 INFO:teuthology.orchestra.run.trial028.stdout:trial177 10.20.193.177 2026-02-20T03:15:15.551 INFO:teuthology.orchestra.run.trial028.stdout:3 hosts in cluster 2026-02-20T03:15:15.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45c80b0ee0 msgr2=0x7f45c80b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:15.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45c80b0ee0 0x7f45c80b33a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45f4105c20 tx=0x7f45e0008040 comp rx=0 tx=0).stop 2026-02-20T03:15:15.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4106780 msgr2=0x7f45f41a43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:15.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4106780 0x7f45f41a43a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f45e800b970 tx=0x7f45e800be40 comp rx=0 tx=0).stop 2026-02-20T03:15:15.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 shutdown_connections 2026-02-20T03:15:15.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45c80b0ee0 0x7f45c80b33a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:15.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45f4106780 0x7f45f41a43a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:15.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45f4105dc0 0x7f45f419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:15.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 --2- 10.20.193.28:0/56092406 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45f4104bc0 0x7f45f419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:15.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 >> 10.20.193.28:0/56092406 conn(0x7f45f4100370 msgr2=0x7f45f41092d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:15.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 shutdown_connections 2026-02-20T03:15:15.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:15.549+0000 7f45fa234640 1 -- 10.20.193.28:0/56092406 wait complete. 2026-02-20T03:15:15.688 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-20T03:15:15.958 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.141+0000 7f4003577640 1 -- 10.20.193.28:0/1006332658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f400410a970 msgr2=0x7f4004111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.141+0000 7f4003577640 1 --2- 10.20.193.28:0/1006332658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f400410a970 0x7f4004111480 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400b0a0 tx=0x7f3ff402f3b0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.141+0000 7f4003577640 1 -- 10.20.193.28:0/1006332658 shutdown_connections 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.141+0000 7f4003577640 1 --2- 10.20.193.28:0/1006332658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f400410a970 0x7f4004111480 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.141+0000 7f4003577640 1 --2- 10.20.193.28:0/1006332658 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4004109e50 0x7f400410a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.141+0000 7f4003577640 1 --2- 10.20.193.28:0/1006332658 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4004109480 0x7f4004109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.141+0000 7f4003577640 1 -- 10.20.193.28:0/1006332658 >> 10.20.193.28:0/1006332658 conn(0x7f4004078050 msgr2=0x7f400407a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.141+0000 7f4003577640 1 -- 10.20.193.28:0/1006332658 shutdown_connections 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.141+0000 7f4003577640 1 -- 10.20.193.28:0/1006332658 wait complete. 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4003577640 1 Processor -- start 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4003577640 1 -- start start 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4003577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4004109480 0x7f40041a0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4003577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4004109e50 0x7f40041a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4003577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f400410a970 0x7f40041a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4003577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4004114a00 con 0x7f4004109e50 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4003577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4004114880 con 0x7f4004109480 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4003577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4004114b80 con 0x7f400410a970 2026-02-20T03:15:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4001d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4004109e50 0x7f40041a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4001d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4004109e50 0x7f40041a1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45312/0 (socket says 10.20.193.28:45312) 2026-02-20T03:15:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4001d74640 1 -- 10.20.193.28:0/3709608270 learned_addr learned my addr 10.20.193.28:0/3709608270 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4002d76640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f400410a970 0x7f40041a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.142+0000 7f4002575640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4004109480 0x7f40041a0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f4001d74640 1 -- 10.20.193.28:0/3709608270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f400410a970 msgr2=0x7f40041a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f4001d74640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f400410a970 0x7f40041a8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f4001d74640 1 -- 10.20.193.28:0/3709608270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4004109480 msgr2=0x7f40041a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f4001d74640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4004109480 0x7f40041a0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f4001d74640 1 -- 10.20.193.28:0/3709608270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40041a8c10 con 0x7f4004109e50 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f4002d76640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f400410a970 0x7f40041a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f4001d74640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4004109e50 0x7f40041a1490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00ea10 tx=0x7f3fec00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f3feb7fe640 1 -- 10.20.193.28:0/3709608270 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00ce50 con 0x7f4004109e50 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f3feb7fe640 1 -- 10.20.193.28:0/3709608270 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3fec004570 con 0x7f4004109e50 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f3feb7fe640 1 -- 10.20.193.28:0/3709608270 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fec010690 con 0x7f4004109e50 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40041a8f00 con 0x7f4004109e50 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.143+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40041a9360 con 0x7f4004109e50 2026-02-20T03:15:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.144+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f400410fdd0 con 0x7f4004109e50 2026-02-20T03:15:16.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.146+0000 7f3feb7fe640 1 -- 10.20.193.28:0/3709608270 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f3fec020030 con 0x7f4004109e50 2026-02-20T03:15:16.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.148+0000 7f3feb7fe640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3fdc0b1080 0x7f3fdc0b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:16.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.148+0000 7f3feb7fe640 1 -- 10.20.193.28:0/3709608270 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f3fec0e0ae0 con 0x7f4004109e50 2026-02-20T03:15:16.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.148+0000 7f4002575640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3fdc0b1080 0x7f3fdc0b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:16.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.148+0000 7f4002575640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3fdc0b1080 0x7f3fdc0b3540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f400407b770 tx=0x7f3ff8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:16.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.149+0000 7f3feb7fe640 1 -- 10.20.193.28:0/3709608270 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f3fec0a8f60 con 0x7f4004109e50 2026-02-20T03:15:16.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.245+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f40040630c0 con 0x7f3fdc0b1080 2026-02-20T03:15:16.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.246+0000 7f3feb7fe640 1 -- 10.20.193.28:0/3709608270 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+910 (secure 0 0 0) 0x7f40040630c0 con 0x7f3fdc0b1080 2026-02-20T03:15:16.249 INFO:teuthology.orchestra.run.trial028.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-20T03:15:16.249 INFO:teuthology.orchestra.run.trial028.stdout:trial028 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB50DD 1788G No 87s ago Has a FileSystem, LVM detected 2026-02-20T03:15:16.249 INFO:teuthology.orchestra.run.trial028.stdout:trial028 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_112510AB50F4 1788G No 87s ago Has a FileSystem, LVM detected 2026-02-20T03:15:16.249 INFO:teuthology.orchestra.run.trial028.stdout:trial126 /dev/nvme1n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6BEF 1788G No 78s ago Has a FileSystem, LVM detected 2026-02-20T03:15:16.249 INFO:teuthology.orchestra.run.trial028.stdout:trial126 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6BD9 1788G No 78s ago Has a FileSystem, LVM detected 2026-02-20T03:15:16.250 INFO:teuthology.orchestra.run.trial028.stdout:trial177 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B0040C 1788G No 69s ago Has a FileSystem, LVM detected 2026-02-20T03:15:16.250 INFO:teuthology.orchestra.run.trial028.stdout:trial177 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B003F2 1788G No 69s ago Has a FileSystem, LVM detected 2026-02-20T03:15:16.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3fdc0b1080 msgr2=0x7f3fdc0b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3fdc0b1080 0x7f3fdc0b3540 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f400407b770 tx=0x7f3ff8009260 comp rx=0 tx=0).stop 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4004109e50 msgr2=0x7f40041a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4004109e50 0x7f40041a1490 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00ea10 tx=0x7f3fec00eee0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 shutdown_connections 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3fdc0b1080 0x7f3fdc0b3540 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f400410a970 0x7f40041a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4004109e50 0x7f40041a1490 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 --2- 10.20.193.28:0/3709608270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4004109480 0x7f40041a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 >> 10.20.193.28:0/3709608270 conn(0x7f4004078050 msgr2=0x7f400410d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 shutdown_connections 2026-02-20T03:15:16.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.247+0000 7f4003577640 1 -- 10.20.193.28:0/3709608270 wait complete. 2026-02-20T03:15:16.260 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:16 trial028 ceph-mon[38552]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:16.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:16 trial126 ceph-mon[38476]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:16.383 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-20T03:15:16.395 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-20T03:15:16.396 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- bash -c 'ceph fs dump' 2026-02-20T03:15:16.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:16 trial177 ceph-mon[43181]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:16.658 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:16.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.837+0000 7f5aff577640 1 -- 10.20.193.28:0/921778330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b0010a970 msgr2=0x7f5b00111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.837+0000 7f5aff577640 1 --2- 10.20.193.28:0/921778330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b0010a970 0x7f5b00111480 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009f90 tx=0x7f5af002f330 comp rx=0 tx=0).stop 2026-02-20T03:15:16.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.837+0000 7f5aff577640 1 -- 10.20.193.28:0/921778330 shutdown_connections 2026-02-20T03:15:16.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.837+0000 7f5aff577640 1 --2- 10.20.193.28:0/921778330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b0010a970 0x7f5b00111480 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.837+0000 7f5aff577640 1 --2- 10.20.193.28:0/921778330 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b00109e50 0x7f5b0010a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.837+0000 7f5aff577640 1 --2- 10.20.193.28:0/921778330 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b00109480 0x7f5b00109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.837+0000 7f5aff577640 1 -- 10.20.193.28:0/921778330 >> 10.20.193.28:0/921778330 conn(0x7f5b00078050 msgr2=0x7f5b0007a490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:16.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.837+0000 7f5aff577640 1 -- 10.20.193.28:0/921778330 shutdown_connections 2026-02-20T03:15:16.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.837+0000 7f5aff577640 1 -- 10.20.193.28:0/921778330 wait complete. 2026-02-20T03:15:16.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5aff577640 1 Processor -- start 2026-02-20T03:15:16.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5aff577640 1 -- start start 2026-02-20T03:15:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5aff577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b00109480 0x7f5b001a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5aff577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b00109e50 0x7f5b001a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5aff577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b0010a970 0x7f5b001a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5aff577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5b001149e0 con 0x7f5b0010a970 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5aff577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00114860 con 0x7f5b00109480 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5aff577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00114b60 con 0x7f5b00109e50 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5afdd74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b00109e50 0x7f5b001a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5afe575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b00109480 0x7f5b001a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5afed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b0010a970 0x7f5b001a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5afe575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b00109480 0x7f5b001a0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35168/0 (socket says 10.20.193.28:35168) 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5afe575640 1 -- 10.20.193.28:0/1547028155 learned_addr learned my addr 10.20.193.28:0/1547028155 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5afdd74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b00109e50 0x7f5b001a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34570/0 (socket says 10.20.193.28:34570) 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5afed76640 1 -- 10.20.193.28:0/1547028155 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b00109e50 msgr2=0x7f5b001a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.838+0000 7f5afed76640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b00109e50 0x7f5b001a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5afed76640 1 -- 10.20.193.28:0/1547028155 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b00109480 msgr2=0x7f5b001a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5afed76640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b00109480 0x7f5b001a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5afed76640 1 -- 10.20.193.28:0/1547028155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b001a8bd0 con 0x7f5b0010a970 2026-02-20T03:15:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5afed76640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b0010a970 0x7f5b001a84d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5af002f840 tx=0x7f5af0009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5ae77fe640 1 -- 10.20.193.28:0/1547028155 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0046070 con 0x7f5b0010a970 2026-02-20T03:15:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5ae77fe640 1 -- 10.20.193.28:0/1547028155 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5af0004780 con 0x7f5b0010a970 2026-02-20T03:15:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5ae77fe640 1 -- 10.20.193.28:0/1547028155 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0041480 con 0x7f5b0010a970 2026-02-20T03:15:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b001a8e60 con 0x7f5b0010a970 2026-02-20T03:15:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b001a9260 con 0x7f5b0010a970 2026-02-20T03:15:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.839+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0010fdd0 con 0x7f5b0010a970 2026-02-20T03:15:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.842+0000 7f5ae77fe640 1 -- 10.20.193.28:0/1547028155 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f5af00075a0 con 0x7f5b0010a970 2026-02-20T03:15:16.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.843+0000 7f5ae77fe640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ad80b0ee0 0x7f5ad80b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:16.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.844+0000 7f5ae77fe640 1 -- 10.20.193.28:0/1547028155 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f5af0105120 con 0x7f5b0010a970 2026-02-20T03:15:16.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.844+0000 7f5afe575640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ad80b0ee0 0x7f5ad80b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:16.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.844+0000 7f5ae77fe640 1 -- 10.20.193.28:0/1547028155 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5af004f080 con 0x7f5b0010a970 2026-02-20T03:15:16.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.844+0000 7f5afe575640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ad80b0ee0 0x7f5ad80b33a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5af40045d0 tx=0x7f5af4009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:16.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.950+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5b0010ffa0 con 0x7f5b0010a970 2026-02-20T03:15:16.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.951+0000 7f5ae77fe640 1 -- 10.20.193.28:0/1547028155 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3094 (secure 0 0 0) 0x7f5af00d12b0 con 0x7f5b0010a970 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:e21 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:btime 2026-02-20T03:14:52:355182+0000 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:legacy client fscid: 1 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:Filesystem 'cephfs' (1) 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:fs_name cephfs 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:epoch 21 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:created 2026-02-20T03:14:32.740764+0000 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:modified 2026-02-20T03:14:52.355103+0000 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:tableserver 0 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:root 0 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:session_timeout 300 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:session_autoclose 300 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:max_file_size 1099511627776 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:max_xattr_size 65536 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:required_client_features {} 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:last_failure 0 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:last_failure_osd_epoch 0 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:max_mds 3 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:in 0,1,2 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:up {0=24560,1=24538,2=24533} 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:failed 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:damaged 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:stopped 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:data_pools [3,4] 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:metadata_pool 2 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:inline_data disabled 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:balancer 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:bal_rank_mask -1 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:standby_count_wanted 0 2026-02-20T03:15:16.954 INFO:teuthology.orchestra.run.trial028.stdout:qdb_cluster leader: 24560 members: 24560,24538,24533 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.b{0:24560} state up:active seq 3 addr [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.c{0:24523} state up:standby-replay seq 1 addr [v2:10.20.193.177:6836/3933107687,v1:10.20.193.177:6837/3933107687] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.i{1:24538} state up:active seq 8 addr [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.f{1:24517} state up:standby-replay seq 1 addr [v2:10.20.193.177:6834/2041071245,v1:10.20.193.177:6835/2041071245] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.h{2:24533} state up:active seq 8 addr [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.e{2:24515} state up:standby-replay seq 1 addr [v2:10.20.193.126:6834/2797409986,v1:10.20.193.126:6835/2797409986] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:Standby daemons: 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.d{-1:14472} state up:standby seq 1 addr [v2:10.20.193.28:6836/3766105703,v1:10.20.193.28:6837/3766105703] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.g{-1:14499} state up:standby seq 1 addr [v2:10.20.193.28:6838/4204022790,v1:10.20.193.28:6839/4204022790] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.a{-1:14511} state up:standby seq 1 addr [v2:10.20.193.28:6840/3872820740,v1:10.20.193.28:6841/3872820740] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.l{-1:24478} state up:standby seq 1 addr [v2:10.20.193.177:6832/3775040244,v1:10.20.193.177:6833/3775040244] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.k{-1:24494} state up:standby seq 1 addr [v2:10.20.193.126:6832/304296049,v1:10.20.193.126:6833/304296049] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stdout:[mds.j{-1:24496} state up:standby seq 1 addr [v2:10.20.193.28:6834/612573094,v1:10.20.193.28:6835/612573094] compat {c=[1],r=[1],i=[1fff]}] 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 21 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ad80b0ee0 msgr2=0x7f5ad80b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ad80b0ee0 0x7f5ad80b33a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5af40045d0 tx=0x7f5af4009310 comp rx=0 tx=0).stop 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b0010a970 msgr2=0x7f5b001a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b0010a970 0x7f5b001a84d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5af002f840 tx=0x7f5af0009740 comp rx=0 tx=0).stop 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 shutdown_connections 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ad80b0ee0 0x7f5ad80b33a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b0010a970 0x7f5b001a84d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b00109e50 0x7f5b001a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 --2- 10.20.193.28:0/1547028155 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b00109480 0x7f5b001a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:16.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 >> 10.20.193.28:0/1547028155 conn(0x7f5b00078050 msgr2=0x7f5b0010d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:16.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 shutdown_connections 2026-02-20T03:15:16.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:16.952+0000 7f5aff577640 1 -- 10.20.193.28:0/1547028155 wait complete. 2026-02-20T03:15:17.053 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- bash -c 'ceph osd dump' 2026-02-20T03:15:17.317 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:17.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:17 trial126 ceph-mon[38476]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:17.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:17 trial126 ceph-mon[38476]: pgmap v194: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-20T03:15:17.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:17 trial126 ceph-mon[38476]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:17.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:17 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1547028155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2026-02-20T03:15:17.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:17 trial028 ceph-mon[38552]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:17.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:17 trial028 ceph-mon[38552]: pgmap v194: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-20T03:15:17.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:17 trial028 ceph-mon[38552]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:17.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:17 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1547028155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2026-02-20T03:15:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:17 trial177 ceph-mon[43181]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:17 trial177 ceph-mon[43181]: pgmap v194: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-20T03:15:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:17 trial177 ceph-mon[43181]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-20T03:15:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:17 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1547028155' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2026-02-20T03:15:17.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.513+0000 7ffa354b2640 1 -- 10.20.193.28:0/4198769337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa30103990 msgr2=0x7ffa30103e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:17.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.513+0000 7ffa354b2640 1 --2- 10.20.193.28:0/4198769337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa30103990 0x7ffa30103e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009a30 tx=0x7ffa2002f220 comp rx=0 tx=0).stop 2026-02-20T03:15:17.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.513+0000 7ffa354b2640 1 -- 10.20.193.28:0/4198769337 shutdown_connections 2026-02-20T03:15:17.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.513+0000 7ffa354b2640 1 --2- 10.20.193.28:0/4198769337 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa30104350 0x7ffa3010abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:17.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.513+0000 7ffa354b2640 1 --2- 10.20.193.28:0/4198769337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa30103990 0x7ffa30103e10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:17.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.513+0000 7ffa354b2640 1 --2- 10.20.193.28:0/4198769337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa30102790 0x7ffa30102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:17.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.513+0000 7ffa354b2640 1 -- 10.20.193.28:0/4198769337 >> 10.20.193.28:0/4198769337 conn(0x7ffa300fdf40 msgr2=0x7ffa30100360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:17.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.513+0000 7ffa354b2640 1 -- 10.20.193.28:0/4198769337 shutdown_connections 2026-02-20T03:15:17.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.513+0000 7ffa354b2640 1 -- 10.20.193.28:0/4198769337 wait complete. 2026-02-20T03:15:17.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa354b2640 1 Processor -- start 2026-02-20T03:15:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa354b2640 1 -- start start 2026-02-20T03:15:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa354b2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa30102790 0x7ffa3019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa354b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa30103990 0x7ffa3019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa354b2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa30104350 0x7ffa301a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa354b2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3010e280 con 0x7ffa30103990 2026-02-20T03:15:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa354b2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3010e100 con 0x7ffa30102790 2026-02-20T03:15:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa354b2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3010e400 con 0x7ffa30104350 2026-02-20T03:15:17.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa2f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa30103990 0x7ffa3019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa2f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa30103990 0x7ffa3019d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45342/0 (socket says 10.20.193.28:45342) 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa2f7fe640 1 -- 10.20.193.28:0/1420922230 learned_addr learned my addr 10.20.193.28:0/1420922230 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa34cb1640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa30104350 0x7ffa301a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa2ffff640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa30102790 0x7ffa3019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa34cb1640 1 -- 10.20.193.28:0/1420922230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa30102790 msgr2=0x7ffa3019cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.514+0000 7ffa34cb1640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa30102790 0x7ffa3019cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa34cb1640 1 -- 10.20.193.28:0/1420922230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa30103990 msgr2=0x7ffa3019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa34cb1640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa30103990 0x7ffa3019d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa34cb1640 1 -- 10.20.193.28:0/1420922230 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa301a4790 con 0x7ffa30104350 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa34cb1640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa30104350 0x7ffa301a4090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400efc0 tx=0x7ffa2400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:17.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa2d7fa640 1 -- 10.20.193.28:0/1420922230 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24019070 con 0x7ffa30104350 2026-02-20T03:15:17.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa2d7fa640 1 -- 10.20.193.28:0/1420922230 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffa240092d0 con 0x7ffa30104350 2026-02-20T03:15:17.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa2d7fa640 1 -- 10.20.193.28:0/1420922230 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa24007500 con 0x7ffa30104350 2026-02-20T03:15:17.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa301a4a20 con 0x7ffa30104350 2026-02-20T03:15:17.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa301a4f10 con 0x7ffa30104350 2026-02-20T03:15:17.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.515+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa301a5140 con 0x7ffa30104350 2026-02-20T03:15:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.517+0000 7ffa2d7fa640 1 -- 10.20.193.28:0/1420922230 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7ffa240076a0 con 0x7ffa30104350 2026-02-20T03:15:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.519+0000 7ffa2d7fa640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffa040b0ee0 0x7ffa040b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.519+0000 7ffa2d7fa640 1 -- 10.20.193.28:0/1420922230 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7ffa240e08f0 con 0x7ffa30104350 2026-02-20T03:15:17.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.519+0000 7ffa2ffff640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffa040b0ee0 0x7ffa040b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.520+0000 7ffa2ffff640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffa040b0ee0 0x7ffa040b33a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffa301037f0 tx=0x7ffa1c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:17.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.520+0000 7ffa2d7fa640 1 -- 10.20.193.28:0/1420922230 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ffa24052b20 con 0x7ffa30104350 2026-02-20T03:15:17.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.610+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7ffa301a5430 con 0x7ffa30104350 2026-02-20T03:15:17.614 INFO:teuthology.orchestra.run.trial028.stdout:epoch 89 2026-02-20T03:15:17.614 INFO:teuthology.orchestra.run.trial028.stdout:fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:15:17.614 INFO:teuthology.orchestra.run.trial028.stdout:created 2026-02-20T03:11:02.801601+0000 2026-02-20T03:15:17.614 INFO:teuthology.orchestra.run.trial028.stdout:modified 2026-02-20T03:14:37.971017+0000 2026-02-20T03:15:17.614 INFO:teuthology.orchestra.run.trial028.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:crush_version 27 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:full_ratio 0.95 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:backfillfull_ratio 0.9 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:nearfull_ratio 0.85 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:require_min_compat_client luminous 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:min_compat_client jewel 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:require_osd_release squid 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:stretch_mode_enabled false 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2026-02-20T03:15:17.615 INFO:teuthology.orchestra.run.trial028.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:max_osd 12 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.0 up in weight 1 up_from 9 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6802/1632554659,v1:10.20.193.28:6803/1632554659] [v2:10.20.193.28:6804/1632554659,v1:10.20.193.28:6805/1632554659] exists,up 5757792c-caf3-4397-a245-e9ff471749a5 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.1 up in weight 1 up_from 14 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.126:6800/2836649908,v1:10.20.193.126:6801/2836649908] [v2:10.20.193.126:6802/2836649908,v1:10.20.193.126:6803/2836649908] exists,up 452bcc43-d4da-471e-8823-6ba9c2de8105 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.2 up in weight 1 up_from 19 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.177:6800/674314820,v1:10.20.193.177:6801/674314820] [v2:10.20.193.177:6802/674314820,v1:10.20.193.177:6803/674314820] exists,up 636c4c98-006a-4471-98ba-d570c4b7963a 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.3 up in weight 1 up_from 26 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6810/770811326,v1:10.20.193.28:6811/770811326] [v2:10.20.193.28:6812/770811326,v1:10.20.193.28:6813/770811326] exists,up c1cd8b22-5eaf-41e1-80be-dd3d856859b8 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.4 up in weight 1 up_from 34 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.126:6808/1455790264,v1:10.20.193.126:6809/1455790264] [v2:10.20.193.126:6810/1455790264,v1:10.20.193.126:6811/1455790264] exists,up 4e6bd944-356d-40ba-8586-50792c78360e 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.5 up in weight 1 up_from 39 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.177:6808/2872553788,v1:10.20.193.177:6809/2872553788] [v2:10.20.193.177:6810/2872553788,v1:10.20.193.177:6811/2872553788] exists,up c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.6 up in weight 1 up_from 47 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6818/1649444587,v1:10.20.193.28:6819/1649444587] [v2:10.20.193.28:6820/1649444587,v1:10.20.193.28:6821/1649444587] exists,up f08a6b86-b475-42cd-9e1b-9a0af277f218 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.7 up in weight 1 up_from 52 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.126:6816/2141691482,v1:10.20.193.126:6817/2141691482] [v2:10.20.193.126:6818/2141691482,v1:10.20.193.126:6819/2141691482] exists,up 4a8b78d5-ef89-4bd1-94e7-74316c304a1d 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.8 up in weight 1 up_from 60 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.177:6816/830253287,v1:10.20.193.177:6817/830253287] [v2:10.20.193.177:6818/830253287,v1:10.20.193.177:6819/830253287] exists,up cfc544c3-19d5-4f29-b18f-e846213b9f10 2026-02-20T03:15:17.616 INFO:teuthology.orchestra.run.trial028.stdout:osd.9 up in weight 1 up_from 68 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.28:6826/698517696,v1:10.20.193.28:6827/698517696] [v2:10.20.193.28:6828/698517696,v1:10.20.193.28:6829/698517696] exists,up f0bb903a-f9c1-445d-a9b2-5b9eed0489d2 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:osd.10 up in weight 1 up_from 73 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:10.20.193.126:6824/4061106799,v1:10.20.193.126:6825/4061106799] [v2:10.20.193.126:6826/4061106799,v1:10.20.193.126:6827/4061106799] exists,up 2b911c8a-899c-45c2-8851-56fe9de089e8 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:osd.11 up in weight 1 up_from 80 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:10.20.193.177:6824/3589825667,v1:10.20.193.177:6825/3589825667] [v2:10.20.193.177:6826/3589825667,v1:10.20.193.177:6827/3589825667] exists,up 10be6c12-30e6-42bf-bf2c-b4b219cb18bb 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6801/732750991 expires 2026-02-21T03:11:25.971161+0000 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6800/732750991 expires 2026-02-21T03:11:25.971161+0000 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/2248669804 expires 2026-02-21T03:11:25.971161+0000 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/3377311556 expires 2026-02-21T03:11:25.971161+0000 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/1349207449 expires 2026-02-21T03:11:14.750053+0000 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/613688684 expires 2026-02-21T03:11:14.750053+0000 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6801/1032320093 expires 2026-02-21T03:11:14.750053+0000 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:6800/1032320093 expires 2026-02-21T03:11:14.750053+0000 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/1867592854 expires 2026-02-21T03:11:25.971161+0000 2026-02-20T03:15:17.617 INFO:teuthology.orchestra.run.trial028.stdout:blocklist 10.20.193.28:0/2481417757 expires 2026-02-21T03:11:14.750053+0000 2026-02-20T03:15:17.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.611+0000 7ffa2d7fa640 1 -- 10.20.193.28:0/1420922230 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) ==== 56+0+5335 (secure 0 0 0) 0x7ffa24010040 con 0x7ffa30104350 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.612+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffa040b0ee0 msgr2=0x7ffa040b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.612+0000 7ffa354b2640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffa040b0ee0 0x7ffa040b33a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffa301037f0 tx=0x7ffa1c009290 comp rx=0 tx=0).stop 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.612+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa30104350 msgr2=0x7ffa301a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.612+0000 7ffa354b2640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa30104350 0x7ffa301a4090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa2400efc0 tx=0x7ffa2400c490 comp rx=0 tx=0).stop 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.612+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 shutdown_connections 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.612+0000 7ffa354b2640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffa040b0ee0 0x7ffa040b33a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.613+0000 7ffa354b2640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa30104350 0x7ffa301a4090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.613+0000 7ffa354b2640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa30103990 0x7ffa3019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.613+0000 7ffa354b2640 1 --2- 10.20.193.28:0/1420922230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa30102790 0x7ffa3019cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:17.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.613+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 >> 10.20.193.28:0/1420922230 conn(0x7ffa300fdf40 msgr2=0x7ffa301091c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:17.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.614+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 shutdown_connections 2026-02-20T03:15:17.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:17.614+0000 7ffa354b2640 1 -- 10.20.193.28:0/1420922230 wait complete. 2026-02-20T03:15:17.715 INFO:teuthology.run_tasks:Running task fs.ready... 2026-02-20T03:15:17.730 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:17.998 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.174+0000 7f8602186640 1 -- 10.20.193.28:0/1517960877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc104980 msgr2=0x7f85fc104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.174+0000 7f8602186640 1 --2- 10.20.193.28:0/1517960877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc104980 0x7f85fc104de0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009a60 tx=0x7f85f002f260 comp rx=0 tx=0).stop 2026-02-20T03:15:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.174+0000 7f8602186640 1 -- 10.20.193.28:0/1517960877 shutdown_connections 2026-02-20T03:15:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.174+0000 7f8602186640 1 --2- 10.20.193.28:0/1517960877 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f85fc105320 0x7f85fc111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.174+0000 7f8602186640 1 --2- 10.20.193.28:0/1517960877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc104980 0x7f85fc104de0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.174+0000 7f8602186640 1 --2- 10.20.193.28:0/1517960877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f85fc10a980 0x7f85fc10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.174+0000 7f8602186640 1 -- 10.20.193.28:0/1517960877 >> 10.20.193.28:0/1517960877 conn(0x7f85fc100680 msgr2=0x7f85fc102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.174+0000 7f8602186640 1 -- 10.20.193.28:0/1517960877 shutdown_connections 2026-02-20T03:15:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.174+0000 7f8602186640 1 -- 10.20.193.28:0/1517960877 wait complete. 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8602186640 1 Processor -- start 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8602186640 1 -- start start 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8602186640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f85fc104980 0x7f85fc19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8602186640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc105320 0x7f85fc19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8602186640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f85fc10a980 0x7f85fc1a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8602186640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc114bf0 con 0x7f85fc105320 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8602186640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc114a70 con 0x7f85fc10a980 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8602186640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc114d70 con 0x7f85fc104980 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8600983640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc105320 0x7f85fc19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8600983640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc105320 0x7f85fc19d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45360/0 (socket says 10.20.193.28:45360) 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8600983640 1 -- 10.20.193.28:0/3842782158 learned_addr learned my addr 10.20.193.28:0/3842782158 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8601184640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f85fc104980 0x7f85fc19d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.175+0000 7f8601985640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f85fc10a980 0x7f85fc1a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f8600983640 1 -- 10.20.193.28:0/3842782158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f85fc104980 msgr2=0x7f85fc19d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f8600983640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f85fc104980 0x7f85fc19d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f8600983640 1 -- 10.20.193.28:0/3842782158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f85fc10a980 msgr2=0x7f85fc1a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f8600983640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f85fc10a980 0x7f85fc1a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f8600983640 1 -- 10.20.193.28:0/3842782158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85fc1a2120 con 0x7f85fc105320 2026-02-20T03:15:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f8600983640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc105320 0x7f85fc19d610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f85f00386a0 tx=0x7f85f0004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:18.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f85ea7fc640 1 -- 10.20.193.28:0/3842782158 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0038770 con 0x7f85fc105320 2026-02-20T03:15:18.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f85ea7fc640 1 -- 10.20.193.28:0/3842782158 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f85f0038db0 con 0x7f85fc105320 2026-02-20T03:15:18.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f85ea7fc640 1 -- 10.20.193.28:0/3842782158 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0041620 con 0x7f85fc105320 2026-02-20T03:15:18.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85fc1a23b0 con 0x7f85fc105320 2026-02-20T03:15:18.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.176+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85fc1a9c50 con 0x7f85fc105320 2026-02-20T03:15:18.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.177+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c4005390 con 0x7f85fc105320 2026-02-20T03:15:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.179+0000 7f85ea7fc640 1 -- 10.20.193.28:0/3842782158 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f85f0002890 con 0x7f85fc105320 2026-02-20T03:15:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.180+0000 7f85ea7fc640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85d80b0eb0 0x7f85d80b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.180+0000 7f85ea7fc640 1 -- 10.20.193.28:0/3842782158 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f85f0105500 con 0x7f85fc105320 2026-02-20T03:15:18.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.181+0000 7f8601184640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85d80b0eb0 0x7f85d80b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:18.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.181+0000 7f85ea7fc640 1 -- 10.20.193.28:0/3842782158 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f85f0105980 con 0x7f85fc105320 2026-02-20T03:15:18.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.181+0000 7f8601184640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85d80b0eb0 0x7f85d80b3370 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85ec004680 tx=0x7f85ec009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:18.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.288+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85c4005680 con 0x7f85fc105320 2026-02-20T03:15:18.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.288+0000 7f85ea7fc640 1 -- 10.20.193.28:0/3842782158 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11921 (secure 0 0 0) 0x7f85f00cd980 con 0x7f85fc105320 2026-02-20T03:15:18.292 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:18.292 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":21,"btime":"2026-02-20T03:14:52:355182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:14:52.355103+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:15:18.292 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 21 2026-02-20T03:15:18.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85d80b0eb0 msgr2=0x7f85d80b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85d80b0eb0 0x7f85d80b3370 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f85ec004680 tx=0x7f85ec009290 comp rx=0 tx=0).stop 2026-02-20T03:15:18.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc105320 msgr2=0x7f85fc19d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc105320 0x7f85fc19d610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f85f00386a0 tx=0x7f85f0004300 comp rx=0 tx=0).stop 2026-02-20T03:15:18.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:18 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1420922230' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2026-02-20T03:15:18.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 shutdown_connections 2026-02-20T03:15:18.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85d80b0eb0 0x7f85d80b3370 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f85fc10a980 0x7f85fc1a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85fc105320 0x7f85fc19d610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 --2- 10.20.193.28:0/3842782158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f85fc104980 0x7f85fc19d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 >> 10.20.193.28:0/3842782158 conn(0x7f85fc100680 msgr2=0x7f85fc100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:18.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.289+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 shutdown_connections 2026-02-20T03:15:18.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.290+0000 7f8602186640 1 -- 10.20.193.28:0/3842782158 wait complete. 2026-02-20T03:15:18.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:18 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1420922230' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2026-02-20T03:15:18.428 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:18.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:18 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1420922230' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2026-02-20T03:15:18.698 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.869+0000 7f019be61640 1 -- 10.20.193.28:0/1299426665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0194105750 msgr2=0x7f01941097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.869+0000 7f019be61640 1 --2- 10.20.193.28:0/1299426665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0194105750 0x7f01941097a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0188009a30 tx=0x7f018802f220 comp rx=0 tx=0).stop 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.869+0000 7f019be61640 1 -- 10.20.193.28:0/1299426665 shutdown_connections 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.869+0000 7f019be61640 1 --2- 10.20.193.28:0/1299426665 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0194109ed0 0x7f0194111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.869+0000 7f019be61640 1 --2- 10.20.193.28:0/1299426665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0194105750 0x7f01941097a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.869+0000 7f019be61640 1 --2- 10.20.193.28:0/1299426665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0194104da0 0x7f0194105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.869+0000 7f019be61640 1 -- 10.20.193.28:0/1299426665 >> 10.20.193.28:0/1299426665 conn(0x7f0194100840 msgr2=0x7f0194102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.869+0000 7f019be61640 1 -- 10.20.193.28:0/1299426665 shutdown_connections 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.869+0000 7f019be61640 1 -- 10.20.193.28:0/1299426665 wait complete. 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.870+0000 7f019be61640 1 Processor -- start 2026-02-20T03:15:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.870+0000 7f019be61640 1 -- start start 2026-02-20T03:15:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.870+0000 7f019be61640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0194104da0 0x7f019419d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.870+0000 7f019be61640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0194105750 0x7f019419d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.870+0000 7f019be61640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0194109ed0 0x7f01941a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.870+0000 7f019be61640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0194114da0 con 0x7f0194109ed0 2026-02-20T03:15:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.870+0000 7f019be61640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0194114c20 con 0x7f0194105750 2026-02-20T03:15:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.870+0000 7f019be61640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0194114f20 con 0x7f0194104da0 2026-02-20T03:15:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.870+0000 7f0199bd6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0194104da0 0x7f019419d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f019a3d7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0194109ed0 0x7f01941a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f0199bd6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0194104da0 0x7f019419d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34606/0 (socket says 10.20.193.28:34606) 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f01993d5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0194105750 0x7f019419d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f0199bd6640 1 -- 10.20.193.28:0/2834870153 learned_addr learned my addr 10.20.193.28:0/2834870153 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f0199bd6640 1 -- 10.20.193.28:0/2834870153 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0194105750 msgr2=0x7f019419d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f0199bd6640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0194105750 0x7f019419d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f0199bd6640 1 -- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0194109ed0 msgr2=0x7f01941a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f0199bd6640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0194109ed0 0x7f01941a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f0199bd6640 1 -- 10.20.193.28:0/2834870153 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01941a2290 con 0x7f0194104da0 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f019a3d7640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0194109ed0 0x7f01941a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.871+0000 7f0199bd6640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0194104da0 0x7f019419d240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f018400ea30 tx=0x7f018400ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.872+0000 7f0182ffd640 1 -- 10.20.193.28:0/2834870153 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018400ce50 con 0x7f0194104da0 2026-02-20T03:15:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.872+0000 7f0182ffd640 1 -- 10.20.193.28:0/2834870153 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0184004570 con 0x7f0194104da0 2026-02-20T03:15:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.872+0000 7f0182ffd640 1 -- 10.20.193.28:0/2834870153 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184010690 con 0x7f0194104da0 2026-02-20T03:15:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.872+0000 7f019be61640 1 -- 10.20.193.28:0/2834870153 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01941a2580 con 0x7f0194104da0 2026-02-20T03:15:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.872+0000 7f019be61640 1 -- 10.20.193.28:0/2834870153 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0194077530 con 0x7f0194104da0 2026-02-20T03:15:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.872+0000 7f0180ff9640 1 -- 10.20.193.28:0/2834870153 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0194105180 con 0x7f0194104da0 2026-02-20T03:15:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.874+0000 7f0182ffd640 1 -- 10.20.193.28:0/2834870153 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f01840040c0 con 0x7f0194104da0 2026-02-20T03:15:18.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.876+0000 7f0182ffd640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01700b0eb0 0x7f01700b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:18.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.876+0000 7f0182ffd640 1 -- 10.20.193.28:0/2834870153 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f01840e0ef0 con 0x7f0194104da0 2026-02-20T03:15:18.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.876+0000 7f0182ffd640 1 -- 10.20.193.28:0/2834870153 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f01840e1370 con 0x7f0194104da0 2026-02-20T03:15:18.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.876+0000 7f01993d5640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01700b0eb0 0x7f01700b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:18.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.877+0000 7f01993d5640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01700b0eb0 0x7f01700b3370 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0194100c60 tx=0x7f0188005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:18.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.985+0000 7f0180ff9640 1 -- 10.20.193.28:0/2834870153 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01940638b0 con 0x7f0194104da0 2026-02-20T03:15:18.989 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:18.989 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":21,"btime":"2026-02-20T03:14:52:355182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:14:52.355103+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:15:18.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.985+0000 7f0182ffd640 1 -- 10.20.193.28:0/2834870153 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11921 (secure 0 0 0) 0x7f01840a9400 con 0x7f0194104da0 2026-02-20T03:15:18.991 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 21 2026-02-20T03:15:18.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 -- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01700b0eb0 msgr2=0x7f01700b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01700b0eb0 0x7f01700b3370 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0194100c60 tx=0x7f0188005950 comp rx=0 tx=0).stop 2026-02-20T03:15:18.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 -- 10.20.193.28:0/2834870153 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0194104da0 msgr2=0x7f019419d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:18.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0194104da0 0x7f019419d240 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f018400ea30 tx=0x7f018400ef00 comp rx=0 tx=0).stop 2026-02-20T03:15:18.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 -- 10.20.193.28:0/2834870153 shutdown_connections 2026-02-20T03:15:18.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01700b0eb0 0x7f01700b3370 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0194109ed0 0x7f01941a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0194105750 0x7f019419d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 --2- 10.20.193.28:0/2834870153 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0194104da0 0x7f019419d240 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:18.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 -- 10.20.193.28:0/2834870153 >> 10.20.193.28:0/2834870153 conn(0x7f0194100840 msgr2=0x7f0194101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:18.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 -- 10.20.193.28:0/2834870153 shutdown_connections 2026-02-20T03:15:18.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:18.987+0000 7f0180ff9640 1 -- 10.20.193.28:0/2834870153 wait complete. 2026-02-20T03:15:19.097 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:15:19.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:19 trial126 ceph-mon[38476]: pgmap v195: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-20T03:15:19.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:19 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3842782158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:19.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:19 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2834870153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:19.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:19 trial028 ceph-mon[38552]: pgmap v195: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-20T03:15:19.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:19 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3842782158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:19.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:19 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2834870153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:19.366 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:19.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:19 trial177 ceph-mon[43181]: pgmap v195: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-20T03:15:19.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:19 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3842782158' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:19.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:19 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2834870153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:19.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.545+0000 7f0df8ad4640 1 -- 10.20.193.28:0/946209099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0df4109ba0 msgr2=0x7f0df4115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:19.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.545+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/946209099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0df4109ba0 0x7f0df4115d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009f90 tx=0x7f0de802f390 comp rx=0 tx=0).stop 2026-02-20T03:15:19.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.546+0000 7f0df8ad4640 1 -- 10.20.193.28:0/946209099 shutdown_connections 2026-02-20T03:15:19.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.546+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/946209099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0df4109ba0 0x7f0df4115d10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:19.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.546+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/946209099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0df4109220 0x7f0df4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:19.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.546+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/946209099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0df410eef0 0x7f0df410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:19.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.546+0000 7f0df8ad4640 1 -- 10.20.193.28:0/946209099 >> 10.20.193.28:0/946209099 conn(0x7f0df4078600 msgr2=0x7f0df407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:19.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.546+0000 7f0df8ad4640 1 -- 10.20.193.28:0/946209099 shutdown_connections 2026-02-20T03:15:19.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.546+0000 7f0df8ad4640 1 -- 10.20.193.28:0/946209099 wait complete. 2026-02-20T03:15:19.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df8ad4640 1 Processor -- start 2026-02-20T03:15:19.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df8ad4640 1 -- start start 2026-02-20T03:15:19.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df8ad4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0df4109220 0x7f0df41a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:19.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df8ad4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0df4109ba0 0x7f0df41a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df8ad4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0df410eef0 0x7f0df41a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df8ad4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41190a0 con 0x7f0df410eef0 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df8ad4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4118f20 con 0x7f0df4109220 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df8ad4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4119220 con 0x7f0df4109ba0 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df37fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0df4109220 0x7f0df41a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df37fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0df4109220 0x7f0df41a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35262/0 (socket says 10.20.193.28:35262) 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df37fe640 1 -- 10.20.193.28:0/3441463772 learned_addr learned my addr 10.20.193.28:0/3441463772 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0df4109ba0 0x7f0df41a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.547+0000 7f0df3fff640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0df410eef0 0x7f0df41a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df3fff640 1 -- 10.20.193.28:0/3441463772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0df4109ba0 msgr2=0x7f0df41a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:19.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df3fff640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0df4109ba0 0x7f0df41a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df3fff640 1 -- 10.20.193.28:0/3441463772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0df4109220 msgr2=0x7f0df41a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df3fff640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0df4109220 0x7f0df41a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df3fff640 1 -- 10.20.193.28:0/3441463772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df41a6490 con 0x7f0df410eef0 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df37fe640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0df4109220 0x7f0df41a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df3fff640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0df410eef0 0x7f0df41a5d10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009f90 tx=0x7f0de8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df0ff9640 1 -- 10.20.193.28:0/3441463772 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8045070 con 0x7f0df410eef0 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df0ff9640 1 -- 10.20.193.28:0/3441463772 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0de8002a60 con 0x7f0df410eef0 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df0ff9640 1 -- 10.20.193.28:0/3441463772 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8007b30 con 0x7f0df410eef0 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df41a6720 con 0x7f0df410eef0 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.548+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df41adfc0 con 0x7f0df410eef0 2026-02-20T03:15:19.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.549+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df4109660 con 0x7f0df410eef0 2026-02-20T03:15:19.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.551+0000 7f0df0ff9640 1 -- 10.20.193.28:0/3441463772 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f0de803f030 con 0x7f0df410eef0 2026-02-20T03:15:19.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.553+0000 7f0df0ff9640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0dc80b0e30 0x7f0dc80b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:19.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.553+0000 7f0df0ff9640 1 -- 10.20.193.28:0/3441463772 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f0de8104830 con 0x7f0df410eef0 2026-02-20T03:15:19.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.553+0000 7f0df37fe640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0dc80b0e30 0x7f0dc80b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:19.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.553+0000 7f0df0ff9640 1 -- 10.20.193.28:0/3441463772 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0de803d070 con 0x7f0df410eef0 2026-02-20T03:15:19.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.554+0000 7f0df37fe640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0dc80b0e30 0x7f0dc80b32f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0de00026e0 tx=0x7f0de0009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:19.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.644+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0df4110e30 con 0x7f0df410eef0 2026-02-20T03:15:19.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.645+0000 7f0df0ff9640 1 -- 10.20.193.28:0/3441463772 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7f0de80ccd10 con 0x7f0df410eef0 2026-02-20T03:15:19.648 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:19.649 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:15:19.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0dc80b0e30 msgr2=0x7f0dc80b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:19.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0dc80b0e30 0x7f0dc80b32f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0de00026e0 tx=0x7f0de0009290 comp rx=0 tx=0).stop 2026-02-20T03:15:19.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0df410eef0 msgr2=0x7f0df41a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:19.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0df410eef0 0x7f0df41a5d10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009f90 tx=0x7f0de8004290 comp rx=0 tx=0).stop 2026-02-20T03:15:19.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 shutdown_connections 2026-02-20T03:15:19.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0dc80b0e30 0x7f0dc80b32f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:19.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0df410eef0 0x7f0df41a5d10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:19.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0df4109ba0 0x7f0df41a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:19.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 --2- 10.20.193.28:0/3441463772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0df4109220 0x7f0df41a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:19.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 >> 10.20.193.28:0/3441463772 conn(0x7f0df4078600 msgr2=0x7f0df4079d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:19.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 shutdown_connections 2026-02-20T03:15:19.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:19.646+0000 7f0df8ad4640 1 -- 10.20.193.28:0/3441463772 wait complete. 2026-02-20T03:15:19.748 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-20T03:14:32.740764+0000', 'modified': '2026-02-20T03:14:52.355103+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24538, 'mds_2': 24533}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24515': {'gid': 24515, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.126:6835/2797409986', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6834', 'nonce': 2797409986}, {'type': 'v1', 'addr': '10.20.193.126:6835', 'nonce': 2797409986}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.177:6835/2041071245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.177:6834', 'nonce': 2041071245}, {'type': 'v1', 'addr': '10.20.193.177:6835', 'nonce': 2041071245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.177:6837/3933107687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.177:6836', 'nonce': 3933107687}, {'type': 'v1', 'addr': '10.20.193.177:6837', 'nonce': 3933107687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '10.20.193.126:6837/1802675915', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6836', 'nonce': 1802675915}, {'type': 'v1', 'addr': '10.20.193.126:6837', 'nonce': 1802675915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'i', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 8, 'addr': '10.20.193.177:6839/1288808268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.177:6838', 'nonce': 1288808268}, {'type': 'v1', 'addr': '10.20.193.177:6839', 'nonce': 1288808268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.126:6839/2074063114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6838', 'nonce': 2074063114}, {'type': 'v1', 'addr': '10.20.193.126:6839', 'nonce': 2074063114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24560, 24538, 24533]} 2026-02-20T03:15:19.749 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2026-02-20T03:15:19.749 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.h status 2026-02-20T03:15:20.010 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:20.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 -- 10.20.193.28:0/522198802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2498105750 msgr2=0x7f24981097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 --2- 10.20.193.28:0/522198802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2498105750 0x7f24981097a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f248c009a30 tx=0x7f248c02f220 comp rx=0 tx=0).stop 2026-02-20T03:15:20.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 -- 10.20.193.28:0/522198802 shutdown_connections 2026-02-20T03:15:20.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 --2- 10.20.193.28:0/522198802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2498109ed0 0x7f2498111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 --2- 10.20.193.28:0/522198802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2498105750 0x7f24981097a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 --2- 10.20.193.28:0/522198802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2498104da0 0x7f2498105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 -- 10.20.193.28:0/522198802 >> 10.20.193.28:0/522198802 conn(0x7f2498100840 msgr2=0x7f2498102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 -- 10.20.193.28:0/522198802 shutdown_connections 2026-02-20T03:15:20.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 -- 10.20.193.28:0/522198802 wait complete. 2026-02-20T03:15:20.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.187+0000 7f249fb21640 1 Processor -- start 2026-02-20T03:15:20.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249fb21640 1 -- start start 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249fb21640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2498104da0 0x7f249819d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249fb21640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2498105750 0x7f249819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249fb21640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2498109ed0 0x7f24981a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249fb21640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2498114da0 con 0x7f2498105750 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249fb21640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2498114c20 con 0x7f2498104da0 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249fb21640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2498114f20 con 0x7f2498109ed0 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249d896640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2498104da0 0x7f249819d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249d896640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2498104da0 0x7f249819d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35286/0 (socket says 10.20.193.28:35286) 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249d896640 1 -- 10.20.193.28:0/503847914 learned_addr learned my addr 10.20.193.28:0/503847914 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249d095640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2498105750 0x7f249819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249e097640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2498109ed0 0x7f24981a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249d896640 1 -- 10.20.193.28:0/503847914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2498109ed0 msgr2=0x7f24981a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249d896640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2498109ed0 0x7f24981a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249d896640 1 -- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2498105750 msgr2=0x7f249819d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249d896640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2498105750 0x7f249819d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249d896640 1 -- 10.20.193.28:0/503847914 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24981a2290 con 0x7f2498104da0 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.188+0000 7f249e097640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2498109ed0 0x7f24981a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.189+0000 7f249d896640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2498104da0 0x7f249819d240 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f248800d980 tx=0x7f248800de50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.189+0000 7f2486ffd640 1 -- 10.20.193.28:0/503847914 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488014070 con 0x7f2498104da0 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.189+0000 7f2486ffd640 1 -- 10.20.193.28:0/503847914 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f24880044e0 con 0x7f2498104da0 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.189+0000 7f2486ffd640 1 -- 10.20.193.28:0/503847914 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488005040 con 0x7f2498104da0 2026-02-20T03:15:20.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.189+0000 7f249fb21640 1 -- 10.20.193.28:0/503847914 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24981a2580 con 0x7f2498104da0 2026-02-20T03:15:20.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.189+0000 7f249fb21640 1 -- 10.20.193.28:0/503847914 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24981a9dc0 con 0x7f2498104da0 2026-02-20T03:15:20.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.191+0000 7f2486ffd640 1 -- 10.20.193.28:0/503847914 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f24880047c0 con 0x7f2498104da0 2026-02-20T03:15:20.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f24a2026e00 1 Processor -- start 2026-02-20T03:15:20.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f24a2026e00 1 -- start start 2026-02-20T03:15:20.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bc4c0 0x55e91c0bc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 0x55e91c0b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f24a2026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e91c001770 con 0x55e91c0bc4c0 2026-02-20T03:15:20.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f24a2026e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e91bfaef80 con 0x55e91c0b7150 2026-02-20T03:15:20.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f24a2026e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e91bffd6a0 con 0x55e91c0bce70 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f249d896640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 0x55e91c0b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f249d095640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f249d095640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35294/0 (socket says 10.20.193.28:35294) 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f249d095640 1 -- 10.20.193.28:0/2121730872 learned_addr learned my addr 10.20.193.28:0/2121730872 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f249e097640 1 --2- 10.20.193.28:0/2121730872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bc4c0 0x55e91c0bc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f2486ffd640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24740b0e30 0x7f24740b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.193+0000 7f2486ffd640 1 -- 10.20.193.28:0/503847914 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f24880e08e0 con 0x7f2498104da0 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f249d095640 1 -- 10.20.193.28:0/2121730872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 msgr2=0x55e91c0b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f249d095640 1 --2- 10.20.193.28:0/2121730872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 0x55e91c0b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f249d095640 1 -- 10.20.193.28:0/2121730872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bc4c0 msgr2=0x55e91c0bc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f249d095640 1 --2- 10.20.193.28:0/2121730872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bc4c0 0x55e91c0bc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f249d095640 1 -- 10.20.193.28:0/2121730872 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91bfa1180 con 0x55e91c0b7150 2026-02-20T03:15:20.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f249d095640 1 --2- 10.20.193.28:0/2121730872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0b75b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f248c0059c0 tx=0x7f248c038520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f474d680738d8f88 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f249e097640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24740b0e30 0x7f24740b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f24664e6640 1 -- 10.20.193.28:0/2121730872 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c02fd40 con 0x55e91c0b7150 2026-02-20T03:15:20.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f24664e6640 1 -- 10.20.193.28:0/2121730872 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f248c033040 con 0x55e91c0b7150 2026-02-20T03:15:20.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.194+0000 7f24664e6640 1 -- 10.20.193.28:0/2121730872 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0389d0 con 0x55e91c0b7150 2026-02-20T03:15:20.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f24a2026e00 1 -- 10.20.193.28:0/2121730872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 msgr2=0x55e91c0b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f24a2026e00 1 --2- 10.20.193.28:0/2121730872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0b75b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f248c0059c0 tx=0x7f248c038520 comp rx=0 tx=0).stop 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f249e097640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24740b0e30 0x7f24740b32f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2494009de0 tx=0x7f24940094b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f24a2026e00 1 -- 10.20.193.28:0/2121730872 shutdown_connections 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f24a2026e00 1 --2- 10.20.193.28:0/2121730872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0b75b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f24a2026e00 1 --2- 10.20.193.28:0/2121730872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 0x55e91c0b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f24a2026e00 1 --2- 10.20.193.28:0/2121730872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bc4c0 0x55e91c0bc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f24a2026e00 1 -- 10.20.193.28:0/2121730872 >> 10.20.193.28:0/2121730872 conn(0x55e91c0a6db0 msgr2=0x55e91c0ac640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f24a2026e00 1 -- 10.20.193.28:0/2121730872 shutdown_connections 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.195+0000 7f24a2026e00 1 -- 10.20.193.28:0/2121730872 wait complete. 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.196+0000 7f24a2026e00 1 -- start start 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.197+0000 7f24a2026e00 1 Processor -- start 2026-02-20T03:15:20.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bc4c0 0x55e91c0d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 0x55e91c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f24a2026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e91bfa8d60 con 0x55e91c0b7150 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f249d095640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bc4c0 0x55e91c0d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f24a2026e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e91c0c38d0 con 0x55e91c0bc4c0 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f24a2026e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e91c0d0050 con 0x55e91c0bce70 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f249d896640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f249d095640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bc4c0 0x55e91c0d16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35304/0 (socket says 10.20.193.28:35304) 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f249d896640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45416/0 (socket says 10.20.193.28:45416) 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f249d896640 1 -- 10.20.193.28:0/3896886042 learned_addr learned my addr 10.20.193.28:0/3896886042 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.198+0000 7f249e097640 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 0x55e91c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f249d896640 1 -- 10.20.193.28:0/3896886042 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 msgr2=0x55e91c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f249d896640 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 0x55e91c0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f249d896640 1 -- 10.20.193.28:0/3896886042 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bc4c0 msgr2=0x55e91c0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f249d896640 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bc4c0 0x55e91c0d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f249d896640 1 -- 10.20.193.28:0/3896886042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91c0c90f0 con 0x55e91c0b7150 2026-02-20T03:15:20.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f249d896640 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0d1190 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f24880a4490 tx=0x7f24880a43a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae80e55ce6a3a412 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f24537fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f24537fe640 1 -- 10.20.193.28:0/3896886042 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248801d050 con 0x55e91c0b7150 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f24537fe640 1 -- 10.20.193.28:0/3896886042 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f24880a8d60 con 0x55e91c0b7150 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f24537fe640 1 -- 10.20.193.28:0/3896886042 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24880ade00 con 0x55e91c0b7150 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.199+0000 7f24a2026e00 1 -- 10.20.193.28:0/3896886042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91bdd2a50 con 0x55e91c0b7150 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24537fe640 1 -- 10.20.193.28:0/3896886042 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f24880a3d80 con 0x55e91c0b7150 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24537fe640 10 client.15069 inactive, discarding osd_map(89..89 src has 1..89) 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 10 client.15069 _ll_register_callbacks cb 0x55e91bfb6630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 1 -- 10.20.193.28:0/3896886042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e91c00f110 con 0x55e91c0b7150 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24537fe640 1 -- 10.20.193.28:0/3896886042 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f24880aca10 con 0x55e91c0b7150 2026-02-20T03:15:20.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 10 client.15069 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 1 -- 10.20.193.28:0/3896886042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55e91bfa7720 con 0x55e91c0b7150 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24537fe640 1 -- 10.20.193.28:0/3896886042 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7f24880a3f80 con 0x55e91c0b7150 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 10 client.15069 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 10 client.15069 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 20 client.15069 populate_metadata read hostname 'trial028' 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e91c0e0ad0 0x55e91c0e1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 4 client.15069 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.200+0000 7f24a2026e00 1 -- 10.20.193.28:0/3896886042 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e91c009360 con 0x55e91c0e0ad0 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.201+0000 7f249d095640 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e91c0e0ad0 0x55e91c0e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.201+0000 7f249d095640 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e91c0e0ad0 0x55e91c0e1f40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ea05ae9e8e16d4d server_cookie=4c08330aac7e751f in_seq=0 out_seq=0 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.201+0000 7f24537fe640 10 client.15069 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:20.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24537fe640 1 -- 10.20.193.28:0/3896886042 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e91c009360 con 0x55e91c0e0ad0 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24537fe640 10 client.15069 handle_command_reply: tid=0 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 client.15069 shutdown 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 -- 10.20.193.28:0/3896886042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 msgr2=0x55e91c0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0d1190 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f24880a4490 tx=0x7f24880a43a0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 -- 10.20.193.28:0/3896886042 shutdown_connections 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bce70 0x55e91c0cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bc4c0 0x55e91c0d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e91c0e0ad0 0x55e91c0e1f40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 --2- 10.20.193.28:0/3896886042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0d1190 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 -- 10.20.193.28:0/3896886042 >> 10.20.193.28:0/3896886042 conn(0x55e91c0a6db0 msgr2=0x55e91c0acd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24537fe640 0 client.15069 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:20.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 -- 10.20.193.28:0/3896886042 shutdown_connections 2026-02-20T03:15:20.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 1 -- 10.20.193.28:0/3896886042 wait complete. 2026-02-20T03:15:20.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.202+0000 7f24a2026e00 20 client.15069 trim_cache size 0 max 16384 2026-02-20T03:15:20.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.212+0000 7f24a2026e00 1 Processor -- start 2026-02-20T03:15:20.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.212+0000 7f24a2026e00 1 -- start start 2026-02-20T03:15:20.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.212+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0e11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.212+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.212+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bce70 0x55e91c0b7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.212+0000 7f24a2026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e91c0e0280 con 0x55e91c0b7150 2026-02-20T03:15:20.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.212+0000 7f24a2026e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e91c0e0950 con 0x55e91c0bce70 2026-02-20T03:15:20.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.212+0000 7f24a2026e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e91c0e1020 con 0x55e91c0bc4c0 2026-02-20T03:15:20.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d095640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d896640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0e11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d896640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0e11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45428/0 (socket says 10.20.193.28:45428) 2026-02-20T03:15:20.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d896640 1 -- 10.20.193.28:0/2267574847 learned_addr learned my addr 10.20.193.28:0/2267574847 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249e097640 1 --2- 10.20.193.28:0/2267574847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bce70 0x55e91c0b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d896640 1 -- 10.20.193.28:0/2267574847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 msgr2=0x55e91c0e0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d896640 1 --2- 10.20.193.28:0/2267574847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d896640 1 -- 10.20.193.28:0/2267574847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bce70 msgr2=0x55e91c0b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d896640 1 --2- 10.20.193.28:0/2267574847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bce70 0x55e91c0b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d896640 1 -- 10.20.193.28:0/2267574847 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91c0c8f20 con 0x55e91c0b7150 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d095640 1 --2- 10.20.193.28:0/2267574847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f249d896640 1 --2- 10.20.193.28:0/2267574847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0e11a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f24880a5680 tx=0x7f24880df000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a835842a0228bb0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f2465ce5640 1 -- 10.20.193.28:0/2267574847 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248801d040 con 0x55e91c0b7150 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f2465ce5640 1 -- 10.20.193.28:0/2267574847 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e91c00f110 con 0x55e91c0b7150 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.213+0000 7f2465ce5640 1 -- 10.20.193.28:0/2267574847 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24880b1430 con 0x55e91c0b7150 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 -- 10.20.193.28:0/2267574847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 msgr2=0x55e91c0e11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 --2- 10.20.193.28:0/2267574847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0e11a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f24880a5680 tx=0x7f24880df000 comp rx=0 tx=0).stop 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 -- 10.20.193.28:0/2267574847 shutdown_connections 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 --2- 10.20.193.28:0/2267574847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0bce70 0x55e91c0b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 --2- 10.20.193.28:0/2267574847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 --2- 10.20.193.28:0/2267574847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0b7150 0x55e91c0e11a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 -- 10.20.193.28:0/2267574847 >> 10.20.193.28:0/2267574847 conn(0x55e91c0a6db0 msgr2=0x55e91c0bafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 -- 10.20.193.28:0/2267574847 shutdown_connections 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 -- 10.20.193.28:0/2267574847 wait complete. 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 -- start start 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.214+0000 7f24a2026e00 1 Processor -- start 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0e7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f24a2026e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bce70 0x55e91c0e7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f24a2026e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e91c0e1dc0 con 0x55e91c0bce70 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f24a2026e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e91c0e16f0 con 0x55e91c0b7150 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f24a2026e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e91c0e2490 con 0x55e91c0bc4c0 2026-02-20T03:15:20.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d095640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d095640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34670/0 (socket says 10.20.193.28:34670) 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d095640 1 -- 10.20.193.28:0/671593210 learned_addr learned my addr 10.20.193.28:0/671593210 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249e097640 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bce70 0x55e91c0e7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d896640 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d095640 1 -- 10.20.193.28:0/671593210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 msgr2=0x55e91c0e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d095640 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d095640 1 -- 10.20.193.28:0/671593210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bce70 msgr2=0x55e91c0e7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d095640 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bce70 0x55e91c0e7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d095640 1 -- 10.20.193.28:0/671593210 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e91bce0780 con 0x55e91c0bc4c0 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f249d095640 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e7780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f248c02f730 tx=0x7f248c031040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5473ea913a8b9fc9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.215+0000 7f24537fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:15:20.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24537fe640 1 -- 10.20.193.28:0/671593210 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c02fdb0 con 0x55e91c0bc4c0 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24537fe640 1 -- 10.20.193.28:0/671593210 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f248c033040 con 0x55e91c0bc4c0 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 1 -- 10.20.193.28:0/671593210 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e91bfc75f0 con 0x55e91c0bc4c0 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24537fe640 1 -- 10.20.193.28:0/671593210 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c038c70 con 0x55e91c0bc4c0 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 10 client.25105 _ll_register_callbacks cb 0x7f2488004ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 1 -- 10.20.193.28:0/671593210 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e91c076ca0 con 0x55e91c0bc4c0 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24537fe640 1 -- 10.20.193.28:0/671593210 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f248c0040b0 con 0x55e91c0bc4c0 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24537fe640 1 -- 10.20.193.28:0/671593210 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f248c004370 con 0x55e91c0bc4c0 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 10 client.25105 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 1 -- 10.20.193.28:0/671593210 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55e91c0c9c10 con 0x55e91c0bc4c0 2026-02-20T03:15:20.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24537fe640 1 -- 10.20.193.28:0/671593210 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7f248c05c030 con 0x55e91c0bc4c0 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 10 client.25105 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 10 client.25105 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 20 client.25105 populate_metadata read hostname 'trial028' 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e91c150b50 0x55e91c14f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 4 client.25105 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.216+0000 7f24a2026e00 1 -- 10.20.193.28:0/671593210 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "status"}) -- 0x55e91c00f110 con 0x55e91c150b50 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.217+0000 7f249d896640 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e91c150b50 0x55e91c14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.217+0000 7f249d896640 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e91c150b50 0x55e91c14f860 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd75fa9c635bfa64 server_cookie=dca26c40645bbef3 in_seq=0 out_seq=0 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.217+0000 7f24537fe640 10 client.25105 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24537fe640 1 -- 10.20.193.28:0/671593210 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e91c00f110 con 0x55e91c150b50 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24537fe640 10 client.25105 handle_command_reply: tid=0 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 client.25105 shutdown 2026-02-20T03:15:20.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 -- 10.20.193.28:0/671593210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 msgr2=0x55e91c0e7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e7780 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f248c02f730 tx=0x7f248c031040 comp rx=0 tx=0).stop 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 -- 10.20.193.28:0/671593210 shutdown_connections 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55e91c150b50 0x55e91c14f860 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e91c0bce70 0x55e91c0e7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e91c0bc4c0 0x55e91c0e7780 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 --2- 10.20.193.28:0/671593210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e91c0b7150 0x55e91c0e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 -- 10.20.193.28:0/671593210 >> 10.20.193.28:0/671593210 conn(0x55e91c0a6db0 msgr2=0x55e91c0d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24537fe640 0 client.25105 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 -- 10.20.193.28:0/671593210 shutdown_connections 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 1 -- 10.20.193.28:0/671593210 wait complete. 2026-02-20T03:15:20.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f24a2026e00 20 client.25105 trim_cache size 0 max 16384 2026-02-20T03:15:20.227 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:20.227 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:15:20.227 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 2, 2026-02-20T03:15:20.227 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24533, 2026-02-20T03:15:20.227 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:15:20.227 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:15:20.227 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:15:20.228 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 28.868292832000002, 2026-02-20T03:15:20.228 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 21, 2026-02-20T03:15:20.228 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 89, 2026-02-20T03:15:20.228 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 89, 2026-02-20T03:15:20.228 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 56.756986851000001 2026-02-20T03:15:20.228 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:20.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f249fb21640 1 -- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24740b0e30 msgr2=0x7f24740b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f249fb21640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24740b0e30 0x7f24740b32f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2494009de0 tx=0x7f24940094b0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f249fb21640 1 -- 10.20.193.28:0/503847914 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2498104da0 msgr2=0x7f249819d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.218+0000 7f249fb21640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2498104da0 0x7f249819d240 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f248800d980 tx=0x7f248800de50 comp rx=0 tx=0).stop 2026-02-20T03:15:20.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.219+0000 7f249fb21640 1 -- 10.20.193.28:0/503847914 shutdown_connections 2026-02-20T03:15:20.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.219+0000 7f249fb21640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24740b0e30 0x7f24740b32f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.219+0000 7f249fb21640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2498109ed0 0x7f24981a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.219+0000 7f249fb21640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2498105750 0x7f249819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.219+0000 7f249fb21640 1 --2- 10.20.193.28:0/503847914 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2498104da0 0x7f249819d240 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.219+0000 7f249fb21640 1 -- 10.20.193.28:0/503847914 >> 10.20.193.28:0/503847914 conn(0x7f2498100840 msgr2=0x7f2498101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.219+0000 7f249fb21640 1 -- 10.20.193.28:0/503847914 shutdown_connections 2026-02-20T03:15:20.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.219+0000 7f249fb21640 1 -- 10.20.193.28:0/503847914 wait complete. 2026-02-20T03:15:20.321 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:20 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3441463772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:20.324 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.i status 2026-02-20T03:15:20.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:20 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3441463772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:20.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:20 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3441463772' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:20.590 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:20.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.771+0000 7efe052c5640 1 -- 10.20.193.28:0/328599904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109220 msgr2=0x7efe00109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.771+0000 7efe052c5640 1 --2- 10.20.193.28:0/328599904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109220 0x7efe00109660 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efdf0009a30 tx=0x7efdf002f220 comp rx=0 tx=0).stop 2026-02-20T03:15:20.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.771+0000 7efe052c5640 1 -- 10.20.193.28:0/328599904 shutdown_connections 2026-02-20T03:15:20.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.771+0000 7efe052c5640 1 --2- 10.20.193.28:0/328599904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe00109ba0 0x7efe00115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.771+0000 7efe052c5640 1 --2- 10.20.193.28:0/328599904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109220 0x7efe00109660 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.771+0000 7efe052c5640 1 --2- 10.20.193.28:0/328599904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe0010eef0 0x7efe0010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.771+0000 7efe052c5640 1 -- 10.20.193.28:0/328599904 >> 10.20.193.28:0/328599904 conn(0x7efe00078600 msgr2=0x7efe0007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.772+0000 7efe052c5640 1 -- 10.20.193.28:0/328599904 shutdown_connections 2026-02-20T03:15:20.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.772+0000 7efe052c5640 1 -- 10.20.193.28:0/328599904 wait complete. 2026-02-20T03:15:20.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.772+0000 7efe052c5640 1 Processor -- start 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efe052c5640 1 -- start start 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efe052c5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe00109220 0x7efe001a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efe052c5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109ba0 0x7efe001a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efe052c5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe0010eef0 0x7efe001a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efe052c5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe00119070 con 0x7efe00109ba0 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efe052c5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efe00118ef0 con 0x7efe0010eef0 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efe052c5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe001191f0 con 0x7efe00109220 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efdff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109ba0 0x7efe001a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efdff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109ba0 0x7efe001a1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45452/0 (socket says 10.20.193.28:45452) 2026-02-20T03:15:20.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efdff7fe640 1 -- 10.20.193.28:0/1673155553 learned_addr learned my addr 10.20.193.28:0/1673155553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efe04ac4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe0010eef0 0x7efe001a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efdfffff640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe00109220 0x7efe001a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efdff7fe640 1 -- 10.20.193.28:0/1673155553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe00109220 msgr2=0x7efe001a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efdff7fe640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe00109220 0x7efe001a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efdff7fe640 1 -- 10.20.193.28:0/1673155553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe0010eef0 msgr2=0x7efe001a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efdff7fe640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe0010eef0 0x7efe001a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.773+0000 7efdff7fe640 1 -- 10.20.193.28:0/1673155553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe001a6580 con 0x7efe00109ba0 2026-02-20T03:15:20.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.774+0000 7efdff7fe640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109ba0 0x7efe001a1a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efdf002f730 tx=0x7efdf0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.774+0000 7efdfd7fa640 1 -- 10.20.193.28:0/1673155553 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0004550 con 0x7efe00109ba0 2026-02-20T03:15:20.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.774+0000 7efdfd7fa640 1 -- 10.20.193.28:0/1673155553 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efdf0038e20 con 0x7efe00109ba0 2026-02-20T03:15:20.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.774+0000 7efdfd7fa640 1 -- 10.20.193.28:0/1673155553 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0004c20 con 0x7efe00109ba0 2026-02-20T03:15:20.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.774+0000 7efe052c5640 1 -- 10.20.193.28:0/1673155553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe001a6810 con 0x7efe00109ba0 2026-02-20T03:15:20.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.774+0000 7efe052c5640 1 -- 10.20.193.28:0/1673155553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe001ae0b0 con 0x7efe00109ba0 2026-02-20T03:15:20.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.777+0000 7efdfd7fa640 1 -- 10.20.193.28:0/1673155553 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7efdf0005340 con 0x7efe00109ba0 2026-02-20T03:15:20.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.777+0000 7efe08a53e00 1 Processor -- start 2026-02-20T03:15:20.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efe08a53e00 1 -- start start 2026-02-20T03:15:20.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 0x562cd7ac38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7ac78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7ac8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efe08a53e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562cd7a16770 con 0x562cd7ac7f00 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efe08a53e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562cd79c3f80 con 0x562cd7ac3eb0 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efe08a53e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562cd7a126a0 con 0x562cd7ac3500 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efdfffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7ac78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efe04ac4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 0x562cd7ac38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efdfffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7ac78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35348/0 (socket says 10.20.193.28:35348) 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efdfffff640 1 -- 10.20.193.28:0/1953161243 learned_addr learned my addr 10.20.193.28:0/1953161243 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efdff7fe640 1 --2- 10.20.193.28:0/1953161243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7ac8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efdff7fe640 1 -- 10.20.193.28:0/1953161243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 msgr2=0x562cd7ac38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efdff7fe640 1 --2- 10.20.193.28:0/1953161243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 0x562cd7ac38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efdff7fe640 1 -- 10.20.193.28:0/1953161243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 msgr2=0x562cd7ac78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efdff7fe640 1 --2- 10.20.193.28:0/1953161243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7ac78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.778+0000 7efdff7fe640 1 -- 10.20.193.28:0/1953161243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd79b6180 con 0x562cd7ac7f00 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efdfd7fa640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efdd40b0eb0 0x7efdd40b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efdfd7fa640 1 -- 10.20.193.28:0/1673155553 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7efdf0104ab0 con 0x7efe00109ba0 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efdff7fe640 1 --2- 10.20.193.28:0/1953161243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7ac8370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efdf01021a0 tx=0x7efdf0108f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6964f9ad22f5675c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe04ac4640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efdd40b0eb0 0x7efdd40b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efdd0ce3640 1 -- 10.20.193.28:0/1953161243 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf00c84a0 con 0x562cd7ac7f00 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efdd0ce3640 1 -- 10.20.193.28:0/1953161243 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efdf010b070 con 0x562cd7ac7f00 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efdd0ce3640 1 -- 10.20.193.28:0/1953161243 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf00cbd50 con 0x562cd7ac7f00 2026-02-20T03:15:20.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe08a53e00 1 -- 10.20.193.28:0/1953161243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 msgr2=0x562cd7ac8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1953161243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7ac8370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efdf01021a0 tx=0x7efdf0108f30 comp rx=0 tx=0).stop 2026-02-20T03:15:20.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe04ac4640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efdd40b0eb0 0x7efdd40b3370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efdf4007610 tx=0x7efdf400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe08a53e00 1 -- 10.20.193.28:0/1953161243 shutdown_connections 2026-02-20T03:15:20.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1953161243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7ac8370 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1953161243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7ac78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1953161243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 0x562cd7ac38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe08a53e00 1 -- 10.20.193.28:0/1953161243 >> 10.20.193.28:0/1953161243 conn(0x562cd7abf630 msgr2=0x562cd7ac1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe08a53e00 1 -- 10.20.193.28:0/1953161243 shutdown_connections 2026-02-20T03:15:20.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.779+0000 7efe08a53e00 1 -- 10.20.193.28:0/1953161243 wait complete. 2026-02-20T03:15:20.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe08a53e00 1 -- start start 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe08a53e00 1 Processor -- start 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 0x562cd7add6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7adbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe08a53e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562cd79bdd60 con 0x562cd7ac7f00 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe08a53e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562cd7acff50 con 0x562cd7ac3500 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe08a53e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562cd7adc490 con 0x562cd7ac3eb0 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe04ac4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7adbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe04ac4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7adbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45460/0 (socket says 10.20.193.28:45460) 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe04ac4640 1 -- 10.20.193.28:0/1727985482 learned_addr learned my addr 10.20.193.28:0/1727985482 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efdfffff640 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 0x562cd7add6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efdff7fe640 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe04ac4640 1 -- 10.20.193.28:0/1727985482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3eb0 msgr2=0x562cd7addbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe04ac4640 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe04ac4640 1 -- 10.20.193.28:0/1727985482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 msgr2=0x562cd7add6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe04ac4640 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 0x562cd7add6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.781+0000 7efe04ac4640 1 -- 10.20.193.28:0/1727985482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd7ad5620 con 0x562cd7ac7f00 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efe04ac4640 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7adbe50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efdf40045e0 tx=0x7efdf4004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a86985f8b06b7b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efdc1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efdc1ffb640 1 -- 10.20.193.28:0/1727985482 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4029070 con 0x562cd7ac7f00 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efdc1ffb640 1 -- 10.20.193.28:0/1727985482 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efdf4014df0 con 0x562cd7ac7f00 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efdc1ffb640 1 -- 10.20.193.28:0/1727985482 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4016730 con 0x562cd7ac7f00 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efe08a53e00 1 -- 10.20.193.28:0/1727985482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd77e7a50 con 0x562cd7ac7f00 2026-02-20T03:15:20.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efdc1ffb640 1 -- 10.20.193.28:0/1727985482 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7efdf40168d0 con 0x562cd7ac7f00 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efe08a53e00 10 client.15087 _ll_register_callbacks cb 0x562cd79cb630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efe08a53e00 1 -- 10.20.193.28:0/1727985482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562cd7a24110 con 0x562cd7ac7f00 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efdc1ffb640 1 -- 10.20.193.28:0/1727985482 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efdf4033050 con 0x562cd7ac7f00 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efe08a53e00 10 client.15087 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.782+0000 7efe08a53e00 1 -- 10.20.193.28:0/1727985482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x562cd79bc720 con 0x562cd7ac7f00 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.783+0000 7efdc1ffb640 1 -- 10.20.193.28:0/1727985482 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7efdf4016ad0 con 0x562cd7ac7f00 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.783+0000 7efe08a53e00 10 client.15087 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.783+0000 7efe08a53e00 10 client.15087 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.783+0000 7efe08a53e00 20 client.15087 populate_metadata read hostname 'trial028' 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.783+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562cd7aed080 0x562cd7aee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.783+0000 7efe08a53e00 4 client.15087 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:20.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.783+0000 7efe08a53e00 1 -- 10.20.193.28:0/1727985482 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cd7a1e360 con 0x562cd7aed080 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.783+0000 7efdfffff640 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562cd7aed080 0x562cd7aee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.784+0000 7efdfffff640 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562cd7aed080 0x562cd7aee4f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b565579b4b22acb5 server_cookie=11b50bf64374ec92 in_seq=0 out_seq=0 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.784+0000 7efdc1ffb640 10 client.15087 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.784+0000 7efdc1ffb640 1 -- 10.20.193.28:0/1727985482 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562cd7a1e360 con 0x562cd7aed080 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.784+0000 7efdc1ffb640 10 client.15087 handle_command_reply: tid=0 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 client.15087 shutdown 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 -- 10.20.193.28:0/1727985482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 msgr2=0x562cd7adbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7adbe50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efdf40045e0 tx=0x7efdf4004bb0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 -- 10.20.193.28:0/1727985482 shutdown_connections 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562cd7aed080 0x562cd7aee4f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7adbe50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 --2- 10.20.193.28:0/1727985482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 0x562cd7add6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 -- 10.20.193.28:0/1727985482 >> 10.20.193.28:0/1727985482 conn(0x562cd7abf630 msgr2=0x562cd7ac9210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efdc1ffb640 0 client.15087 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:20.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 -- 10.20.193.28:0/1727985482 shutdown_connections 2026-02-20T03:15:20.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 1 -- 10.20.193.28:0/1727985482 wait complete. 2026-02-20T03:15:20.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.785+0000 7efe08a53e00 20 client.15087 trim_cache size 0 max 16384 2026-02-20T03:15:20.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe08a53e00 1 Processor -- start 2026-02-20T03:15:20.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe08a53e00 1 -- start start 2026-02-20T03:15:20.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 0x562cd7add6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac7f00 0x562cd7ada6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe08a53e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562cd7aec830 con 0x562cd7ac3eb0 2026-02-20T03:15:20.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe08a53e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562cd7aecf00 con 0x562cd7ac3500 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe08a53e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562cd7aed5d0 con 0x562cd7ac7f00 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efdff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efdff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45472/0 (socket says 10.20.193.28:45472) 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efdff7fe640 1 -- 10.20.193.28:0/2355624601 learned_addr learned my addr 10.20.193.28:0/2355624601 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efdfffff640 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 0x562cd7add6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe04ac4640 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac7f00 0x562cd7ada6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efdff7fe640 1 -- 10.20.193.28:0/2355624601 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac7f00 msgr2=0x562cd7ada6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efdff7fe640 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac7f00 0x562cd7ada6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efdff7fe640 1 -- 10.20.193.28:0/2355624601 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 msgr2=0x562cd7add6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efdff7fe640 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 0x562cd7add6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efdff7fe640 1 -- 10.20.193.28:0/2355624601 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd7ad5450 con 0x562cd7ac3eb0 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.795+0000 7efe04ac4640 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac7f00 0x562cd7ada6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efdfffff640 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 0x562cd7add6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efdff7fe640 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efdf0005ec0 tx=0x7efdf0009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b33f97895caa4b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efdc3fff640 1 -- 10.20.193.28:0/2355624601 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf00cbf30 con 0x562cd7ac3eb0 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efdc3fff640 1 -- 10.20.193.28:0/2355624601 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efdf0033030 con 0x562cd7ac3eb0 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efdc3fff640 1 -- 10.20.193.28:0/2355624601 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf00cc600 con 0x562cd7ac3eb0 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efe08a53e00 1 -- 10.20.193.28:0/2355624601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac3eb0 msgr2=0x562cd7addbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efe08a53e00 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efdf0005ec0 tx=0x7efdf0009340 comp rx=0 tx=0).stop 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efe08a53e00 1 -- 10.20.193.28:0/2355624601 shutdown_connections 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efe08a53e00 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac7f00 0x562cd7ada6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efe08a53e00 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac3eb0 0x562cd7addbe0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efe08a53e00 1 --2- 10.20.193.28:0/2355624601 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3500 0x562cd7add6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efe08a53e00 1 -- 10.20.193.28:0/2355624601 >> 10.20.193.28:0/2355624601 conn(0x562cd7abf630 msgr2=0x562cd7aebdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efe08a53e00 1 -- 10.20.193.28:0/2355624601 shutdown_connections 2026-02-20T03:15:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.796+0000 7efe08a53e00 1 -- 10.20.193.28:0/2355624601 wait complete. 2026-02-20T03:15:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.797+0000 7efe08a53e00 1 -- start start 2026-02-20T03:15:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.797+0000 7efe08a53e00 1 Processor -- start 2026-02-20T03:15:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.797+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 0x562cd7af1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.797+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7af2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.797+0000 7efe08a53e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7b51960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.797+0000 7efe08a53e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562cd7aee370 con 0x562cd7ac7f00 2026-02-20T03:15:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.797+0000 7efe08a53e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562cd7aedca0 con 0x562cd7ac3eb0 2026-02-20T03:15:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.797+0000 7efe08a53e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562cd7aeea40 con 0x562cd7ac3500 2026-02-20T03:15:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.797+0000 7efdfffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 0x562cd7af1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efdfffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 0x562cd7af1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34726/0 (socket says 10.20.193.28:34726) 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efdfffff640 1 -- 10.20.193.28:0/65878531 learned_addr learned my addr 10.20.193.28:0/65878531 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe04ac4640 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7b51960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efdff7fe640 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7af2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe04ac4640 1 -- 10.20.193.28:0/65878531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 msgr2=0x562cd7af1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe04ac4640 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 0x562cd7af1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe04ac4640 1 -- 10.20.193.28:0/65878531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 msgr2=0x562cd7af2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe04ac4640 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7af2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe04ac4640 1 -- 10.20.193.28:0/65878531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cd76f5780 con 0x562cd7ac7f00 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efdff7fe640 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7af2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe04ac4640 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7b51960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efdf40093e0 tx=0x7efdf4014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cec0ae645e5d95 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:20.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efdc1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efdc1ffb640 1 -- 10.20.193.28:0/65878531 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4029040 con 0x562cd7ac7f00 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efdc1ffb640 1 -- 10.20.193.28:0/65878531 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x562cd7a24110 con 0x562cd7ac7f00 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efdc1ffb640 1 -- 10.20.193.28:0/65878531 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4024b90 con 0x562cd7ac7f00 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe08a53e00 1 -- 10.20.193.28:0/65878531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cd79dc5f0 con 0x562cd7ac7f00 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe08a53e00 10 client.15093 _ll_register_callbacks cb 0x7efdf401a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.798+0000 7efe08a53e00 1 -- 10.20.193.28:0/65878531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562cd7a8bca0 con 0x562cd7ac7f00 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efdc1ffb640 1 -- 10.20.193.28:0/65878531 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7efdf4024d30 con 0x562cd7ac7f00 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efdc1ffb640 1 -- 10.20.193.28:0/65878531 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efdf4003e10 con 0x562cd7ac7f00 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efe08a53e00 10 client.15093 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efe08a53e00 1 -- 10.20.193.28:0/65878531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x562cd7ad6140 con 0x562cd7ac7f00 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efdc1ffb640 1 -- 10.20.193.28:0/65878531 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7efdf4004b80 con 0x562cd7ac7f00 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efe08a53e00 10 client.15093 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:20.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efe08a53e00 10 client.15093 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efe08a53e00 20 client.15093 populate_metadata read hostname 'trial028' 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efe08a53e00 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562cd7b5d9c0 0x562cd7b5c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efe08a53e00 4 client.15093 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.799+0000 7efe08a53e00 1 -- 10.20.193.28:0/65878531 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "status"}) -- 0x7efdf0033030 con 0x562cd7b5d9c0 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.800+0000 7efdfffff640 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562cd7b5d9c0 0x562cd7b5c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.800+0000 7efdfffff640 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562cd7b5d9c0 0x562cd7b5c6d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6b3f2990528869e0 server_cookie=a1734a13aa3e16ef in_seq=0 out_seq=0 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.800+0000 7efdc1ffb640 10 client.15093 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efdc1ffb640 1 -- 10.20.193.28:0/65878531 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x7efdf0033030 con 0x562cd7b5d9c0 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efdc1ffb640 10 client.15093 handle_command_reply: tid=0 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 client.15093 shutdown 2026-02-20T03:15:20.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 -- 10.20.193.28:0/65878531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 msgr2=0x562cd7b51960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7b51960 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efdf40093e0 tx=0x7efdf4014ea0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 -- 10.20.193.28:0/65878531 shutdown_connections 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562cd7b5d9c0 0x562cd7b5c6d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562cd7ac7f00 0x562cd7b51960 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562cd7ac3eb0 0x562cd7af2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 --2- 10.20.193.28:0/65878531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562cd7ac3500 0x562cd7af1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 -- 10.20.193.28:0/65878531 >> 10.20.193.28:0/65878531 conn(0x562cd7abf630 msgr2=0x562cd7ada8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efdc1ffb640 0 client.15093 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 -- 10.20.193.28:0/65878531 shutdown_connections 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 1 -- 10.20.193.28:0/65878531 wait complete. 2026-02-20T03:15:20.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.801+0000 7efe08a53e00 20 client.15093 trim_cache size 0 max 16384 2026-02-20T03:15:20.810 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:20.810 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:15:20.810 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 1, 2026-02-20T03:15:20.810 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24538, 2026-02-20T03:15:20.810 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:15:20.810 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:15:20.810 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:15:20.811 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 30.456182807000001, 2026-02-20T03:15:20.811 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 21, 2026-02-20T03:15:20.811 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 89, 2026-02-20T03:15:20.811 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 89, 2026-02-20T03:15:20.811 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 56.642939019000003 2026-02-20T03:15:20.811 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 -- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efdd40b0eb0 msgr2=0x7efdd40b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efdd40b0eb0 0x7efdd40b3370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efdf4007610 tx=0x7efdf400b040 comp rx=0 tx=0).stop 2026-02-20T03:15:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 -- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109ba0 msgr2=0x7efe001a1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109ba0 0x7efe001a1a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efdf002f730 tx=0x7efdf0004360 comp rx=0 tx=0).stop 2026-02-20T03:15:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 -- 10.20.193.28:0/1673155553 shutdown_connections 2026-02-20T03:15:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efdd40b0eb0 0x7efdd40b3370 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe0010eef0 0x7efe001a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe00109ba0 0x7efe001a1a70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 --2- 10.20.193.28:0/1673155553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe00109220 0x7efe001a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 -- 10.20.193.28:0/1673155553 >> 10.20.193.28:0/1673155553 conn(0x7efe00078600 msgr2=0x7efe00079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 -- 10.20.193.28:0/1673155553 shutdown_connections 2026-02-20T03:15:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:20.802+0000 7efe052c5640 1 -- 10.20.193.28:0/1673155553 wait complete. 2026-02-20T03:15:20.942 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.b status 2026-02-20T03:15:21.206 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:21.250 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:21 trial028 ceph-mon[38552]: pgmap v196: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-20T03:15:21.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:21 trial126 ceph-mon[38476]: pgmap v196: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-20T03:15:21.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 -- 10.20.193.28:0/2474053509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 msgr2=0x7f84d8111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:21.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 --2- 10.20.193.28:0/2474053509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 0x7f84d8111850 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f84c800b0d0 tx=0x7f84c802f450 comp rx=0 tx=0).stop 2026-02-20T03:15:21.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 -- 10.20.193.28:0/2474053509 shutdown_connections 2026-02-20T03:15:21.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 --2- 10.20.193.28:0/2474053509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 0x7f84d8111850 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 --2- 10.20.193.28:0/2474053509 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84d8104980 0x7f84d8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 --2- 10.20.193.28:0/2474053509 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84d810a980 0x7f84d810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 -- 10.20.193.28:0/2474053509 >> 10.20.193.28:0/2474053509 conn(0x7f84d8100680 msgr2=0x7f84d8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:21.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 -- 10.20.193.28:0/2474053509 shutdown_connections 2026-02-20T03:15:21.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 -- 10.20.193.28:0/2474053509 wait complete. 2026-02-20T03:15:21.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.394+0000 7f84d7fff640 1 Processor -- start 2026-02-20T03:15:21.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d7fff640 1 -- start start 2026-02-20T03:15:21.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84d8104980 0x7f84d819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 0x7f84d819d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84d810a980 0x7f84d81a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f84d8114bf0 con 0x7f84d8105320 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d7fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f84d8114a70 con 0x7f84d8104980 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d7fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84d8114d70 con 0x7f84d810a980 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 0x7f84d819d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84d8104980 0x7f84d819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 0x7f84d819d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45492/0 (socket says 10.20.193.28:45492) 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d67fc640 1 -- 10.20.193.28:0/3879657899 learned_addr learned my addr 10.20.193.28:0/3879657899 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d77fe640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84d810a980 0x7f84d81a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d67fc640 1 -- 10.20.193.28:0/3879657899 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84d810a980 msgr2=0x7f84d81a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d67fc640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84d810a980 0x7f84d81a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d67fc640 1 -- 10.20.193.28:0/3879657899 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84d8104980 msgr2=0x7f84d819cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:21.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d67fc640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84d8104980 0x7f84d819cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.395+0000 7f84d67fc640 1 -- 10.20.193.28:0/3879657899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d81a2040 con 0x7f84d8105320 2026-02-20T03:15:21.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.396+0000 7f84d67fc640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 0x7f84d819d530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84c000d980 tx=0x7f84c000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:21.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.396+0000 7f84b7fff640 1 -- 10.20.193.28:0/3879657899 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0014070 con 0x7f84d8105320 2026-02-20T03:15:21.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.396+0000 7f84d7fff640 1 -- 10.20.193.28:0/3879657899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d81a2330 con 0x7f84d8105320 2026-02-20T03:15:21.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.396+0000 7f84b7fff640 1 -- 10.20.193.28:0/3879657899 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84c00044e0 con 0x7f84d8105320 2026-02-20T03:15:21.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.396+0000 7f84d7fff640 1 -- 10.20.193.28:0/3879657899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d81a9b70 con 0x7f84d8105320 2026-02-20T03:15:21.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.396+0000 7f84b7fff640 1 -- 10.20.193.28:0/3879657899 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0014070 con 0x7f84d8105320 2026-02-20T03:15:21.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.399+0000 7f84b7fff640 1 -- 10.20.193.28:0/3879657899 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f84c00047c0 con 0x7f84d8105320 2026-02-20T03:15:21.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.399+0000 7f84dfc9ee00 1 Processor -- start 2026-02-20T03:15:21.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.399+0000 7f84dfc9ee00 1 -- start start 2026-02-20T03:15:21.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.399+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3500 0x55f95c7c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.399+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3eb0 0x55f95c7c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.399+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c7f00 0x55f95c7c8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.399+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f95c716770 con 0x55f95c7c3500 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.399+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f95c6c3f80 con 0x55f95c7c3eb0 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.399+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f95c7126a0 con 0x55f95c7c7f00 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3500 0x55f95c7c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3eb0 0x55f95c7c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3eb0 0x55f95c7c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35386/0 (socket says 10.20.193.28:35386) 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3500 0x55f95c7c38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45504/0 (socket says 10.20.193.28:45504) 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d77fe640 1 -- 10.20.193.28:0/645881644 learned_addr learned my addr 10.20.193.28:0/645881644 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d67fc640 1 --2- 10.20.193.28:0/645881644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c7f00 0x55f95c7c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d77fe640 1 -- 10.20.193.28:0/645881644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c7f00 msgr2=0x55f95c7c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d77fe640 1 --2- 10.20.193.28:0/645881644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c7f00 0x55f95c7c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d77fe640 1 -- 10.20.193.28:0/645881644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3eb0 msgr2=0x55f95c7c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d77fe640 1 --2- 10.20.193.28:0/645881644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3eb0 0x55f95c7c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d77fe640 1 -- 10.20.193.28:0/645881644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95c6b6180 con 0x55f95c7c3500 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/645881644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3eb0 0x55f95c7c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84b7fff640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84ac0b1030 0x7f84ac0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84d77fe640 1 --2- 10.20.193.28:0/645881644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3500 0x55f95c7c38e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009790 tx=0x7f84c800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4dd423220ff90c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84b7fff640 1 -- 10.20.193.28:0/3879657899 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f84c00e03d0 con 0x7f84d8105320 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84a37fe640 1 -- 10.20.193.28:0/645881644 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80042c0 con 0x55f95c7c3500 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84a37fe640 1 -- 10.20.193.28:0/645881644 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84c8033050 con 0x55f95c7c3500 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.400+0000 7f84a37fe640 1 -- 10.20.193.28:0/645881644 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80076a0 con 0x55f95c7c3500 2026-02-20T03:15:21.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/645881644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3500 msgr2=0x55f95c7c38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/645881644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3500 0x55f95c7c38e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009790 tx=0x7f84c800c000 comp rx=0 tx=0).stop 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84ac0b1030 0x7f84ac0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/645881644 shutdown_connections 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/645881644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c7f00 0x55f95c7c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/645881644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3eb0 0x55f95c7c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/645881644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3500 0x55f95c7c38e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/645881644 >> 10.20.193.28:0/645881644 conn(0x55f95c7bf630 msgr2=0x55f95c7c1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/645881644 shutdown_connections 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.401+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84ac0b1030 0x7f84ac0b34f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55f95c7c4430 tx=0x7f84cc0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:21.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.402+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/645881644 wait complete. 2026-02-20T03:15:21.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.403+0000 7f84dfc9ee00 1 -- start start 2026-02-20T03:15:21.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.403+0000 7f84dfc9ee00 1 Processor -- start 2026-02-20T03:15:21.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.403+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3500 0x55f95c7dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.403+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3eb0 0x55f95c7ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.403+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c7f00 0x55f95c7dc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.403+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f95c6bdd60 con 0x55f95c7c3eb0 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.403+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f95c7d00b0 con 0x55f95c7c7f00 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.403+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f95c7dc830 con 0x55f95c7c3500 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3500 0x55f95c7dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3eb0 0x55f95c7ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3500 0x55f95c7dd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34754/0 (socket says 10.20.193.28:34754) 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d6ffd640 1 -- 10.20.193.28:0/2059162863 learned_addr learned my addr 10.20.193.28:0/2059162863 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d77fe640 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c7f00 0x55f95c7dc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d67fc640 1 -- 10.20.193.28:0/2059162863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3500 msgr2=0x55f95c7dd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d67fc640 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3500 0x55f95c7dd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d67fc640 1 -- 10.20.193.28:0/2059162863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c7f00 msgr2=0x55f95c7dc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:21.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d67fc640 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c7f00 0x55f95c7dc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d67fc640 1 -- 10.20.193.28:0/2059162863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95c7d5880 con 0x55f95c7c3eb0 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3500 0x55f95c7dd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84d67fc640 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3eb0 0x55f95c7ddeb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f84c00ddb50 tx=0x7f84c00a4520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86240f2b3a327d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84a0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84a0ff9640 1 -- 10.20.193.28:0/2059162863 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c001d070 con 0x55f95c7c3eb0 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2059162863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f95c4e7a50 con 0x55f95c7c3eb0 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84a0ff9640 1 -- 10.20.193.28:0/2059162863 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84c00ac560 con 0x55f95c7c3eb0 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84a0ff9640 1 -- 10.20.193.28:0/2059162863 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c00a3980 con 0x55f95c7c3eb0 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84a0ff9640 1 -- 10.20.193.28:0/2059162863 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f84c00a3b20 con 0x55f95c7c3eb0 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84a0ff9640 10 client.15105 inactive, discarding osd_map(89..89 src has 1..89) 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84dfc9ee00 10 client.15105 _ll_register_callbacks cb 0x55f95c6cb630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:21.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.404+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2059162863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f95c724110 con 0x55f95c7c3eb0 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84a0ff9640 1 -- 10.20.193.28:0/2059162863 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f84c000be60 con 0x55f95c7c3eb0 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84dfc9ee00 10 client.15105 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2059162863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55f95c6bc720 con 0x55f95c7c3eb0 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84a0ff9640 1 -- 10.20.193.28:0/2059162863 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7f84c00ac120 con 0x55f95c7c3eb0 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84dfc9ee00 10 client.15105 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84dfc9ee00 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84dfc9ee00 20 client.15105 populate_metadata read hostname 'trial028' 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f95c7ee060 0x55f95c7ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84dfc9ee00 4 client.15105 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2059162863 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f95c71e360 con 0x55f95c7ee060 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.405+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f95c7ee060 0x55f95c7ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.406+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f95c7ee060 0x55f95c7ee6e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9089191c6f7d378a server_cookie=a7c266d078d1230a in_seq=0 out_seq=0 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.406+0000 7f84a0ff9640 10 client.15105 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.406+0000 7f84a0ff9640 1 -- 10.20.193.28:0/2059162863 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f95c71e360 con 0x55f95c7ee060 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.406+0000 7f84a0ff9640 10 client.15105 handle_command_reply: tid=0 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.406+0000 7f84dfc9ee00 1 client.15105 shutdown 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2059162863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3eb0 msgr2=0x55f95c7ddeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3eb0 0x55f95c7ddeb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f84c00ddb50 tx=0x7f84c00a4520 comp rx=0 tx=0).stop 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2059162863 shutdown_connections 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f95c7ee060 0x55f95c7ee6e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c7f00 0x55f95c7dc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c3eb0 0x55f95c7ddeb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2059162863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3500 0x55f95c7dd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2059162863 >> 10.20.193.28:0/2059162863 conn(0x55f95c7bf630 msgr2=0x55f95c7c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:21.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84a0ff9640 0 client.15105 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:21.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2059162863 shutdown_connections 2026-02-20T03:15:21.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2059162863 wait complete. 2026-02-20T03:15:21.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.407+0000 7f84dfc9ee00 20 client.15105 trim_cache size 0 max 16384 2026-02-20T03:15:21.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84dfc9ee00 1 Processor -- start 2026-02-20T03:15:21.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84dfc9ee00 1 -- start start 2026-02-20T03:15:21.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 0x55f95c7ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 0x55f95c7d9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c7dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f95c7eca70 con 0x55f95c7c7f00 2026-02-20T03:15:21.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f95c7ed140 con 0x55f95c7c3500 2026-02-20T03:15:21.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f95c7ed810 con 0x55f95c7c3eb0 2026-02-20T03:15:21.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c7dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c7dd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45524/0 (socket says 10.20.193.28:45524) 2026-02-20T03:15:21.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84d77fe640 1 -- 10.20.193.28:0/2180834361 learned_addr learned my addr 10.20.193.28:0/2180834361 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:21.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 0x55f95c7ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.416+0000 7f84d67fc640 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 0x55f95c7d9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84d77fe640 1 -- 10.20.193.28:0/2180834361 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 msgr2=0x55f95c7d9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:21.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84d77fe640 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 0x55f95c7d9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84d77fe640 1 -- 10.20.193.28:0/2180834361 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 msgr2=0x55f95c7ee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:21.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84d77fe640 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 0x55f95c7ee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84d77fe640 1 -- 10.20.193.28:0/2180834361 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95c7c3c50 con 0x55f95c7c7f00 2026-02-20T03:15:21.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 0x55f95c7ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84d77fe640 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c7dd970 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f84c8004660 tx=0x7f84c80045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad380833be93d57 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84a2ffd640 1 -- 10.20.193.28:0/2180834361 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80048d0 con 0x55f95c7c7f00 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84a2ffd640 1 -- 10.20.193.28:0/2180834361 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84c8002a60 con 0x55f95c7c7f00 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84a2ffd640 1 -- 10.20.193.28:0/2180834361 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8007b90 con 0x55f95c7c7f00 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2180834361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 msgr2=0x55f95c7dd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c7dd970 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f84c8004660 tx=0x7f84c80045f0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2180834361 shutdown_connections 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c7dd970 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 0x55f95c7d9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/2180834361 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 0x55f95c7ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.417+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2180834361 >> 10.20.193.28:0/2180834361 conn(0x55f95c7bf630 msgr2=0x55f95c7ec080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:21.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.418+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2180834361 shutdown_connections 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.418+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/2180834361 wait complete. 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.418+0000 7f84dfc9ee00 1 -- start start 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.418+0000 7f84dfc9ee00 1 Processor -- start 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.418+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 0x55f95c7f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.418+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 0x55f95c7f6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84dfc9ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c857b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f95c7ee560 con 0x55f95c7c7f00 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f95c7edee0 con 0x55f95c7c3500 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84dfc9ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f95c7eec30 con 0x55f95c7c3eb0 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 0x55f95c7f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c857b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c857b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45530/0 (socket says 10.20.193.28:45530) 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d77fe640 1 -- 10.20.193.28:0/1939314638 learned_addr learned my addr 10.20.193.28:0/1939314638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d67fc640 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 0x55f95c7f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d77fe640 1 -- 10.20.193.28:0/1939314638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 msgr2=0x55f95c7f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d77fe640 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 0x55f95c7f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d77fe640 1 -- 10.20.193.28:0/1939314638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 msgr2=0x55f95c7f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d77fe640 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 0x55f95c7f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d77fe640 1 -- 10.20.193.28:0/1939314638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f95c7d56b0 con 0x55f95c7c7f00 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84d77fe640 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c857b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f84c800c060 tx=0x7f84c80074c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec512379d49fb58 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84a0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:21.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84a0ff9640 1 -- 10.20.193.28:0/1939314638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c8058020 con 0x55f95c7c7f00 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84a0ff9640 1 -- 10.20.193.28:0/1939314638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84c80092d0 con 0x55f95c7c7f00 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84a0ff9640 1 -- 10.20.193.28:0/1939314638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80427c0 con 0x55f95c7c7f00 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.419+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/1939314638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f95c3f5780 con 0x55f95c7c7f00 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84a0ff9640 1 -- 10.20.193.28:0/1939314638 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7f84c8042960 con 0x55f95c7c7f00 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84a0ff9640 10 client.15111 inactive, discarding osd_map(89..89 src has 1..89) 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 10 client.15111 _ll_register_callbacks cb 0x7f84c00a8030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/1939314638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f95c6e75c0 con 0x55f95c7c7f00 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84a0ff9640 1 -- 10.20.193.28:0/1939314638 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f84c8042b60 con 0x55f95c7c7f00 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 10 client.15111 fetch_fsmap learned FSMap version 21 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/1939314638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55f95c6dc5f0 con 0x55f95c7c7f00 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84a0ff9640 1 -- 10.20.193.28:0/1939314638 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 21) ==== 8354+0+0 (secure 0 0 0) 0x7f84c80076a0 con 0x55f95c7c7f00 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 10 client.15111 fetch_fsmap finished waiting for FSMap version 21 2026-02-20T03:15:21.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 20 client.15111 populate_metadata read hostname 'trial028' 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f95c85d310 0x55f95c85c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 4 client.15111 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.420+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/1939314638 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "status"}) -- 0x55f95c78bca0 con 0x55f95c85d310 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.421+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f95c85d310 0x55f95c85c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.421+0000 7f84d6ffd640 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f95c85d310 0x55f95c85c020 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15a7cb311f7b2707 server_cookie=4189f7b70ba589b9 in_seq=0 out_seq=0 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.421+0000 7f84a0ff9640 10 client.15111 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84a0ff9640 1 -- 10.20.193.28:0/1939314638 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f95c78bca0 con 0x55f95c85d310 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84a0ff9640 10 client.15111 handle_command_reply: tid=0 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 client.15111 shutdown 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/1939314638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 msgr2=0x55f95c857b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:21.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c857b80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f84c800c060 tx=0x7f84c80074c0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/1939314638 shutdown_connections 2026-02-20T03:15:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f95c85d310 0x55f95c85c020 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f95c7c7f00 0x55f95c857b80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f95c7c3eb0 0x55f95c7f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 --2- 10.20.193.28:0/1939314638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f95c7c3500 0x55f95c7f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/1939314638 >> 10.20.193.28:0/1939314638 conn(0x55f95c7bf630 msgr2=0x55f95c7ec080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:21.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84a0ff9640 0 client.15111 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:21.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/1939314638 shutdown_connections 2026-02-20T03:15:21.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 1 -- 10.20.193.28:0/1939314638 wait complete. 2026-02-20T03:15:21.431 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:21.431 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 0, 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24560, 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 48.135834017000001, 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 21, 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 89, 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 89, 2026-02-20T03:15:21.432 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 54.049148225000003 2026-02-20T03:15:21.433 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.422+0000 7f84dfc9ee00 20 client.15111 trim_cache size 0 max 16384 2026-02-20T03:15:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 -- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84ac0b1030 msgr2=0x7f84ac0b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84ac0b1030 0x7f84ac0b34f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55f95c7c4430 tx=0x7f84cc0073d0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 -- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 msgr2=0x7f84d819d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 0x7f84d819d530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84c000d980 tx=0x7f84c000de50 comp rx=0 tx=0).stop 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 -- 10.20.193.28:0/3879657899 shutdown_connections 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84ac0b1030 0x7f84ac0b34f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84d810a980 0x7f84d81a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84d8105320 0x7f84d819d530 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 --2- 10.20.193.28:0/3879657899 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84d8104980 0x7f84d819cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 -- 10.20.193.28:0/3879657899 >> 10.20.193.28:0/3879657899 conn(0x7f84d8100680 msgr2=0x7f84d8100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 -- 10.20.193.28:0/3879657899 shutdown_connections 2026-02-20T03:15:21.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:21.423+0000 7f84d7fff640 1 -- 10.20.193.28:0/3879657899 wait complete. 2026-02-20T03:15:21.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:21 trial177 ceph-mon[43181]: pgmap v196: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-20T03:15:21.560 INFO:teuthology.run_tasks:Running task sequential... 2026-02-20T03:15:21.574 INFO:teuthology.task.sequential:In sequential, running task sequential... 2026-02-20T03:15:21.574 INFO:teuthology.task.sequential:In sequential, running task print... 2026-02-20T03:15:21.575 INFO:teuthology.task.print:Enabling mgr modules 2026-02-20T03:15:21.575 INFO:teuthology.run_tasks:Running task kclient... 2026-02-20T03:15:21.604 INFO:tasks.kclient:Mounting kernel clients... 2026-02-20T03:15:21.604 INFO:tasks.kclient:config is {'client.0': {}} 2026-02-20T03:15:21.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:21.605 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-20T03:15:21.643 INFO:teuthology.orchestra.run.trial028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2026-02-20T03:15:21.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:21.645 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2026-02-20T03:15:21.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:21.741 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link delete ceph-brx 2026-02-20T03:15:21.842 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2026-02-20T03:15:21.842 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-20T03:15:21.842 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-20T03:15:21.842 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs ls 2026-02-20T03:15:22.117 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 -- 10.20.193.28:0/841295119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 msgr2=0x7fe678109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/841295119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 0x7fe678109660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe668009a30 tx=0x7fe66802f220 comp rx=0 tx=0).stop 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 -- 10.20.193.28:0/841295119 shutdown_connections 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/841295119 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe678109ba0 0x7fe678115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/841295119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 0x7fe678109660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/841295119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe67810eef0 0x7fe67810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 -- 10.20.193.28:0/841295119 >> 10.20.193.28:0/841295119 conn(0x7fe678078600 msgr2=0x7fe67807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 -- 10.20.193.28:0/841295119 shutdown_connections 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 -- 10.20.193.28:0/841295119 wait complete. 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 Processor -- start 2026-02-20T03:15:22.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.297+0000 7fe67cdc7640 1 -- start start 2026-02-20T03:15:22.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe67cdc7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 0x7fe6781a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:22.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe67cdc7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe678109ba0 0x7fe6781a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:22.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe67cdc7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe67810eef0 0x7fe6781a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe67cdc7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe678119050 con 0x7fe678109220 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe67cdc7640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe678118ed0 con 0x7fe678109ba0 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe67cdc7640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe6781191d0 con 0x7fe67810eef0 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe6777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 0x7fe6781a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe6777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 0x7fe6781a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45540/0 (socket says 10.20.193.28:45540) 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe6777fe640 1 -- 10.20.193.28:0/1974550844 learned_addr learned my addr 10.20.193.28:0/1974550844 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe676ffd640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe678109ba0 0x7fe6781a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe677fff640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe67810eef0 0x7fe6781a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe6777fe640 1 -- 10.20.193.28:0/1974550844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe67810eef0 msgr2=0x7fe6781a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe6777fe640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe67810eef0 0x7fe6781a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe6777fe640 1 -- 10.20.193.28:0/1974550844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe678109ba0 msgr2=0x7fe6781a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe6777fe640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe678109ba0 0x7fe6781a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe6777fe640 1 -- 10.20.193.28:0/1974550844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6781a6560 con 0x7fe678109220 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.298+0000 7fe6777fe640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 0x7fe6781a1510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe66400d950 tx=0x7fe66400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.299+0000 7fe674ff9640 1 -- 10.20.193.28:0/1974550844 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664014070 con 0x7fe678109220 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.299+0000 7fe674ff9640 1 -- 10.20.193.28:0/1974550844 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe6640044e0 con 0x7fe678109220 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.299+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6781a6850 con 0x7fe678109220 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.299+0000 7fe674ff9640 1 -- 10.20.193.28:0/1974550844 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe664010460 con 0x7fe678109220 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.299+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6781ae090 con 0x7fe678109220 2026-02-20T03:15:22.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.299+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe678109660 con 0x7fe678109220 2026-02-20T03:15:22.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.301+0000 7fe674ff9640 1 -- 10.20.193.28:0/1974550844 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fe6640026e0 con 0x7fe678109220 2026-02-20T03:15:22.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.303+0000 7fe674ff9640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe64c0b0eb0 0x7fe64c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:22.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.303+0000 7fe674ff9640 1 -- 10.20.193.28:0/1974550844 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fe6640e0c00 con 0x7fe678109220 2026-02-20T03:15:22.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.303+0000 7fe676ffd640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe64c0b0eb0 0x7fe64c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:22.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.304+0000 7fe674ff9640 1 -- 10.20.193.28:0/1974550844 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe664110ba0 con 0x7fe678109220 2026-02-20T03:15:22.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.304+0000 7fe676ffd640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe64c0b0eb0 0x7fe64c0b3370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe678108cc0 tx=0x7fe66803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:22.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.411+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe678110ea0 con 0x7fe678109220 2026-02-20T03:15:22.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.412+0000 7fe674ff9640 1 -- 10.20.193.28:0/1974550844 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7fe6640a9080 con 0x7fe678109220 2026-02-20T03:15:22.415 INFO:teuthology.orchestra.run.trial028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe64c0b0eb0 msgr2=0x7fe64c0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe64c0b0eb0 0x7fe64c0b3370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe678108cc0 tx=0x7fe66803a040 comp rx=0 tx=0).stop 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 msgr2=0x7fe6781a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 0x7fe6781a1510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe66400d950 tx=0x7fe66400de20 comp rx=0 tx=0).stop 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 shutdown_connections 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe64c0b0eb0 0x7fe64c0b3370 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe67810eef0 0x7fe6781a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe678109ba0 0x7fe6781a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 --2- 10.20.193.28:0/1974550844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe678109220 0x7fe6781a1510 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:22.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 >> 10.20.193.28:0/1974550844 conn(0x7fe678078600 msgr2=0x7fe678079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:22.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 shutdown_connections 2026-02-20T03:15:22.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22.413+0000 7fe67cdc7640 1 -- 10.20.193.28:0/1974550844 wait complete. 2026-02-20T03:15:22.553 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2026-02-20T03:15:22.553 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-20T03:15:22.553 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial028.front.sepia.ceph.com 2026-02-20T03:15:22.553 INFO:tasks.cephfs.mount:self.client.name = client.0 2026-02-20T03:15:22.554 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-20T03:15:22.554 INFO:tasks.cephfs.mount:self.cephfs_name = None 2026-02-20T03:15:22.554 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-20T03:15:22.554 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-20T03:15:22.554 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2026-02-20T03:15:22.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:22.554 DEBUG:teuthology.orchestra.run.trial028:> ip addr 2026-02-20T03:15:22.594 INFO:teuthology.orchestra.run.trial028.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-20T03:15:22.594 INFO:teuthology.orchestra.run.trial028.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout: inet 127.0.0.1/8 scope host lo 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout: inet6 ::1/128 scope host 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout:2: enp1s0f0np0: mtu 1500 qdisc fq_codel state UP group default qlen 1000 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout: link/ether 90:5a:08:77:63:0c brd ff:ff:ff:ff:ff:ff 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout: inet 10.20.193.28/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0np0 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft 720sec preferred_lft 720sec 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout: inet6 fe80::925a:8ff:fe77:630c/64 scope link proto kernel_ll 2026-02-20T03:15:22.595 INFO:teuthology.orchestra.run.trial028.stdout: valid_lft forever preferred_lft forever 2026-02-20T03:15:22.596 INFO:teuthology.orchestra.run.trial028.stdout:3: enp1s0f1np1: mtu 1500 qdisc fq_codel state DOWN group default qlen 1000 2026-02-20T03:15:22.596 INFO:teuthology.orchestra.run.trial028.stdout: link/ether 90:5a:08:77:63:0d brd ff:ff:ff:ff:ff:ff 2026-02-20T03:15:22.596 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-20T03:15:22.596 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:15:22.597 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:15:22.597 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link add name ceph-brx type bridge 2026-02-20T03:15:22.597 DEBUG:teuthology.orchestra.run.trial028:> sudo ip addr flush dev ceph-brx 2026-02-20T03:15:22.597 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set ceph-brx up 2026-02-20T03:15:22.597 DEBUG:teuthology.orchestra.run.trial028:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-20T03:15:22.597 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:15:22.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:15:22.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:15:22.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:22.794 DEBUG:teuthology.orchestra.run.trial028:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-20T03:15:22.850 INFO:teuthology.orchestra.run.trial028.stdout:1 2026-02-20T03:15:22.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:22.853 DEBUG:teuthology.orchestra.run.trial028:> ip r 2026-02-20T03:15:22.892 INFO:teuthology.orchestra.run.trial028.stdout:default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.28 metric 100 2026-02-20T03:15:22.892 INFO:teuthology.orchestra.run.trial028.stdout:10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.28 metric 100 2026-02-20T03:15:22.892 INFO:teuthology.orchestra.run.trial028.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-20T03:15:22.893 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:15:22.893 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:15:22.893 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -A FORWARD -o enp1s0f0np0 -i ceph-brx -j ACCEPT 2026-02-20T03:15:22.893 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -A FORWARD -i enp1s0f0np0 -o ceph-brx -j ACCEPT 2026-02-20T03:15:22.893 DEBUG:teuthology.orchestra.run.trial028:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0np0 -j MASQUERADE 2026-02-20T03:15:22.893 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:15:23.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:15:23.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:15:23.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:23.069 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-20T03:15:23.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:23.108 DEBUG:teuthology.orchestra.run.trial028:> ip netns list-id 2026-02-20T03:15:23.186 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:15:23.187 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:15:23.187 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T03:15:23.187 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2026-02-20T03:15:23.187 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:15:23.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:15:23.307 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:23 trial028 ceph-mon[38552]: pgmap v197: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-20T03:15:23.307 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:23 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1974550844' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T03:15:23.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:15:23.344 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.144.1/20 2026-02-20T03:15:23.344 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:15:23.344 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:15:23.345 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2026-02-20T03:15:23.345 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-20T03:15:23.345 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2026-02-20T03:15:23.345 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2026-02-20T03:15:23.345 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.159.254 2026-02-20T03:15:23.345 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:15:23.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:23 trial126 ceph-mon[38476]: pgmap v197: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-20T03:15:23.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:23 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1974550844' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T03:15:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:15:23.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:23 trial177 ceph-mon[43181]: pgmap v197: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-20T03:15:23.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:23 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1974550844' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-20T03:15:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:15:23.533 DEBUG:teuthology.orchestra.run.trial028:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-20T03:15:23.533 DEBUG:teuthology.orchestra.run.trial028:> set -e 2026-02-20T03:15:23.533 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set brx.0 up 2026-02-20T03:15:23.534 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link set dev brx.0 master ceph-brx 2026-02-20T03:15:23.534 DEBUG:teuthology.orchestra.run.trial028:> ') 2026-02-20T03:15:23.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:15:23.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:15:23.684 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T03:15:23.684 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2026-02-20T03:15:23.724 INFO:teuthology.orchestra.run.trial028.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2026-02-20T03:15:23.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-20T03:15:23.725 DEBUG:teuthology.orchestra.run.trial028:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2026-02-20T03:15:23.803 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2026-02-20T03:15:23.803 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2026-02-20T03:15:23.803 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021 2026-02-20T03:15:23.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:23.804 DEBUG:teuthology.orchestra.run.trial028:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2026-02-20T03:15:23.926 INFO:teuthology.orchestra.run.trial028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2026-02-20T03:15:23.926 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2026-02-20T03:15:23.926 INFO:teuthology.orchestra.run.trial028.stdout:invalid new device string format 2026-02-20T03:15:24.080 INFO:teuthology.orchestra.run.trial028.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2026-02-20T03:15:24.080 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2026-02-20T03:15:24.080 INFO:teuthology.orchestra.run.trial028.stdout:invalid new device string format 2026-02-20T03:15:24.080 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: resolved to: "10.20.193.28:3300,10.20.193.126:3300,10.20.193.177:3300" 2026-02-20T03:15:24.080 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: trying mount with old device syntax: 10.20.193.28:3300,10.20.193.126:3300,10.20.193.177:3300:/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021 2026-02-20T03:15:24.080 INFO:teuthology.orchestra.run.trial028.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=bfaff8d7-0e09-11f1-8045-d404e6e7d460" will pass to kernel 2026-02-20T03:15:24.081 INFO:teuthology.orchestra.run.trial028.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2026-02-20T03:15:24.081 INFO:teuthology.orchestra.run.trial028.stdout: You just mounted a file system that supports labels which does not 2026-02-20T03:15:24.081 INFO:teuthology.orchestra.run.trial028.stdout: contain labels, onto an SELinux box. It is likely that confined 2026-02-20T03:15:24.081 INFO:teuthology.orchestra.run.trial028.stdout: applications will generate AVC messages and not be allowed access to 2026-02-20T03:15:24.081 INFO:teuthology.orchestra.run.trial028.stdout: this file system. For more details see restorecon(8) and mount(8). 2026-02-20T03:15:24.083 INFO:tasks.cephfs.kernel_mount:mount command passed 2026-02-20T03:15:24.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:15:24.083 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2026-02-20T03:15:24.143 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-20T03:15:24.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-20T03:15:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:15:24.223 INFO:teuthology.orchestra.run.trial028.stdout:client25141 2026-02-20T03:15:24.224 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:15:24.224 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T03:15:24.264 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-20T03:15:24.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-20T03:15:24.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:15:24.384 INFO:teuthology.orchestra.run.trial028.stdout:client25141 2026-02-20T03:15:24.385 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2026-02-20T03:15:24.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2026-02-20T03:15:24.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:15:24.464 INFO:teuthology.orchestra.run.trial028.stdout:client25141 2026-02-20T03:15:24.465 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460.client25141/status') 2026-02-20T03:15:24.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-20T03:15:24.553 INFO:teuthology.orchestra.run.trial028.stdout:instance: client.25141 (3)10.20.193.28:0/1519628739 2026-02-20T03:15:24.553 INFO:teuthology.orchestra.run.trial028.stdout:blocklisted: false 2026-02-20T03:15:24.553 INFO:teuthology.orchestra.run.trial028.stderr:0+1 records in 2026-02-20T03:15:24.553 INFO:teuthology.orchestra.run.trial028.stderr:0+1 records out 2026-02-20T03:15:24.553 INFO:teuthology.orchestra.run.trial028.stderr:71 bytes copied, 5.0253e-05 s, 1.4 MB/s 2026-02-20T03:15:24.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-20T03:15:24.562 INFO:teuthology.run_tasks:Running task exec... 2026-02-20T03:15:24.587 INFO:teuthology.task.exec:Executing custom commands... 2026-02-20T03:15:24.587 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-20T03:15:24.587 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2026-02-20T03:15:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.704+0000 7fbdf27f3640 1 -- 10.20.193.28:0/4127824035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec10a5d0 msgr2=0x7fbdec10ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.704+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/4127824035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec10a5d0 0x7fbdec10ca70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbde800b0a0 tx=0x7fbde802f410 comp rx=0 tx=0).stop 2026-02-20T03:15:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.704+0000 7fbdf27f3640 1 -- 10.20.193.28:0/4127824035 shutdown_connections 2026-02-20T03:15:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.704+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/4127824035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec10a5d0 0x7fbdec10ca70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.704+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/4127824035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdec075a00 0x7fbdec075e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.704+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/4127824035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdec077070 0x7fbdec0754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.704+0000 7fbdf27f3640 1 -- 10.20.193.28:0/4127824035 >> 10.20.193.28:0/4127824035 conn(0x7fbdec0fde10 msgr2=0x7fbdec100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.704+0000 7fbdf27f3640 1 -- 10.20.193.28:0/4127824035 shutdown_connections 2026-02-20T03:15:24.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.704+0000 7fbdf27f3640 1 -- 10.20.193.28:0/4127824035 wait complete. 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf27f3640 1 Processor -- start 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf27f3640 1 -- start start 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf27f3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec075a00 0x7fbdec19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf27f3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdec077070 0x7fbdec19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf27f3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdec10a5d0 0x7fbdec1a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf27f3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec110420 con 0x7fbdec075a00 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf27f3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec1102a0 con 0x7fbdec077070 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf27f3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec1105a0 con 0x7fbdec10a5d0 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf17f1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec075a00 0x7fbdec19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf17f1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec075a00 0x7fbdec19c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45562/0 (socket says 10.20.193.28:45562) 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.705+0000 7fbdf17f1640 1 -- 10.20.193.28:0/2981492027 learned_addr learned my addr 10.20.193.28:0/2981492027 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf0ff0640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdec077070 0x7fbdec19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:24.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf1ff2640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdec10a5d0 0x7fbdec1a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf17f1640 1 -- 10.20.193.28:0/2981492027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdec10a5d0 msgr2=0x7fbdec1a3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf17f1640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdec10a5d0 0x7fbdec1a3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf17f1640 1 -- 10.20.193.28:0/2981492027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdec077070 msgr2=0x7fbdec19cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf17f1640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdec077070 0x7fbdec19cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf17f1640 1 -- 10.20.193.28:0/2981492027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec1a4650 con 0x7fbdec075a00 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf17f1640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec075a00 0x7fbdec19c9a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00d950 tx=0x7fbddc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdda7fc640 1 -- 10.20.193.28:0/2981492027 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc014070 con 0x7fbdec075a00 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdda7fc640 1 -- 10.20.193.28:0/2981492027 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbddc0044e0 con 0x7fbdec075a00 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdec1a4940 con 0x7fbdec075a00 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdda7fc640 1 -- 10.20.193.28:0/2981492027 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc010460 con 0x7fbdec075a00 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.706+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdec1a4e90 con 0x7fbdec075a00 2026-02-20T03:15:24.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.707+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdec108e50 con 0x7fbdec075a00 2026-02-20T03:15:24.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.709+0000 7fbdda7fc640 1 -- 10.20.193.28:0/2981492027 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fbddc0026e0 con 0x7fbdec075a00 2026-02-20T03:15:24.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.710+0000 7fbdda7fc640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdc80b0e30 0x7fbdc80b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:24.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.710+0000 7fbdda7fc640 1 -- 10.20.193.28:0/2981492027 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fbddc0e0d30 con 0x7fbdec075a00 2026-02-20T03:15:24.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.710+0000 7fbdf0ff0640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdc80b0e30 0x7fbdc80b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:24.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.710+0000 7fbdda7fc640 1 -- 10.20.193.28:0/2981492027 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fbddc0a91b0 con 0x7fbdec075a00 2026-02-20T03:15:24.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.711+0000 7fbdf0ff0640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdc80b0e30 0x7fbdc80b32f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbdec19deb0 tx=0x7fbde0005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:24.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:24.820+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fbdec109060 con 0x7fbdec075a00 2026-02-20T03:15:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.078+0000 7fbdda7fc640 1 -- 10.20.193.28:0/2981492027 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v22) ==== 117+0+0 (secure 0 0 0) 0x7fbddc0ace60 con 0x7fbdec075a00 2026-02-20T03:15:25.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdc80b0e30 msgr2=0x7fbdc80b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdc80b0e30 0x7fbdc80b32f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbdec19deb0 tx=0x7fbde0005f50 comp rx=0 tx=0).stop 2026-02-20T03:15:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec075a00 msgr2=0x7fbdec19c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec075a00 0x7fbdec19c9a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00d950 tx=0x7fbddc00de20 comp rx=0 tx=0).stop 2026-02-20T03:15:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 shutdown_connections 2026-02-20T03:15:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdc80b0e30 0x7fbdc80b32f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdec10a5d0 0x7fbdec1a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdec077070 0x7fbdec19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 --2- 10.20.193.28:0/2981492027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdec075a00 0x7fbdec19c9a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 >> 10.20.193.28:0/2981492027 conn(0x7fbdec0fde10 msgr2=0x7fbdec1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:25.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 shutdown_connections 2026-02-20T03:15:25.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.079+0000 7fbdf27f3640 1 -- 10.20.193.28:0/2981492027 wait complete. 2026-02-20T03:15:25.094 INFO:teuthology.run_tasks:Running task check-counter... 2026-02-20T03:15:25.115 INFO:teuthology.run_tasks:Running task fwd_scrub... 2026-02-20T03:15:25.135 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T03:15:25.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.257+0000 7fd66ec7a640 1 -- 10.20.193.28:0/2083902658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 msgr2=0x7fd668111250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.257+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/2083902658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 0x7fd668111250 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd66400b0a0 tx=0x7fd66402f3b0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.257+0000 7fd66ec7a640 1 -- 10.20.193.28:0/2083902658 shutdown_connections 2026-02-20T03:15:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.257+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/2083902658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 0x7fd668111250 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.257+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/2083902658 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd668109f70 0x7fd66810a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.257+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/2083902658 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd668108e20 0x7fd668109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.257+0000 7fd66ec7a640 1 -- 10.20.193.28:0/2083902658 >> 10.20.193.28:0/2083902658 conn(0x7fd668077e70 msgr2=0x7fd66807a290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.257+0000 7fd66ec7a640 1 -- 10.20.193.28:0/2083902658 shutdown_connections 2026-02-20T03:15:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.257+0000 7fd66ec7a640 1 -- 10.20.193.28:0/2083902658 wait complete. 2026-02-20T03:15:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66ec7a640 1 Processor -- start 2026-02-20T03:15:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66ec7a640 1 -- start start 2026-02-20T03:15:25.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66ec7a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd668108e20 0x7fd6681a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66ec7a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd668109f70 0x7fd6681a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66ec7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 0x7fd6681a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66ec7a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd6681148e0 con 0x7fd66810a930 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66ec7a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd668114760 con 0x7fd668108e20 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66ec7a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd668114a60 con 0x7fd668109f70 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66e479640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 0x7fd6681a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66dc78640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd668108e20 0x7fd6681a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66e479640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 0x7fd6681a83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45586/0 (socket says 10.20.193.28:45586) 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66e479640 1 -- 10.20.193.28:0/1594939607 learned_addr learned my addr 10.20.193.28:0/1594939607 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.258+0000 7fd66d477640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd668109f70 0x7fd6681a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd66e479640 1 -- 10.20.193.28:0/1594939607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd668109f70 msgr2=0x7fd6681a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd66e479640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd668109f70 0x7fd6681a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd66e479640 1 -- 10.20.193.28:0/1594939607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd668108e20 msgr2=0x7fd6681a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd66e479640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd668108e20 0x7fd6681a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd66e479640 1 -- 10.20.193.28:0/1594939607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6681a8ae0 con 0x7fd66810a930 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd66e479640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 0x7fd6681a83e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd66400b020 tx=0x7fd6640045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd656ffd640 1 -- 10.20.193.28:0/1594939607 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664047070 con 0x7fd66810a930 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6681a8d70 con 0x7fd66810a930 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd656ffd640 1 -- 10.20.193.28:0/1594939607 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd664007660 con 0x7fd66810a930 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd656ffd640 1 -- 10.20.193.28:0/1594939607 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664042680 con 0x7fd66810a930 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.259+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6681a9260 con 0x7fd66810a930 2026-02-20T03:15:25.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.260+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd66810fba0 con 0x7fd66810a930 2026-02-20T03:15:25.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.262+0000 7fd656ffd640 1 -- 10.20.193.28:0/1594939607 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fd664007810 con 0x7fd66810a930 2026-02-20T03:15:25.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.264+0000 7fd656ffd640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6440b0e30 0x7fd6440b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.264+0000 7fd656ffd640 1 -- 10.20.193.28:0/1594939607 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fd664105410 con 0x7fd66810a930 2026-02-20T03:15:25.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.264+0000 7fd66dc78640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6440b0e30 0x7fd6440b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.264+0000 7fd656ffd640 1 -- 10.20.193.28:0/1594939607 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd66403d070 con 0x7fd66810a930 2026-02-20T03:15:25.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.264+0000 7fd66dc78640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6440b0e30 0x7fd6440b32f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd658004500 tx=0x7fd658009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:25.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:25 trial126 ceph-mon[38476]: pgmap v198: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-20T03:15:25.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:25 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2981492027' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2026-02-20T03:15:25.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:25 trial028 ceph-mon[38552]: pgmap v198: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-20T03:15:25.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:25 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2981492027' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2026-02-20T03:15:25.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.355+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd668063920 con 0x7fd66810a930 2026-02-20T03:15:25.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.356+0000 7fd656ffd640 1 -- 10.20.193.28:0/1594939607 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24211 (secure 0 0 0) 0x7fd6640d15a0 con 0x7fd66810a930 2026-02-20T03:15:25.359 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:25.359 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":89,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:14:37.971017+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:15:25.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6440b0e30 msgr2=0x7fd6440b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6440b0e30 0x7fd6440b32f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd658004500 tx=0x7fd658009290 comp rx=0 tx=0).stop 2026-02-20T03:15:25.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 msgr2=0x7fd6681a83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 0x7fd6681a83e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd66400b020 tx=0x7fd6640045c0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 shutdown_connections 2026-02-20T03:15:25.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6440b0e30 0x7fd6440b32f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd66810a930 0x7fd6681a83e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd668109f70 0x7fd6681a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 --2- 10.20.193.28:0/1594939607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd668108e20 0x7fd6681a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 >> 10.20.193.28:0/1594939607 conn(0x7fd668077e70 msgr2=0x7fd66810d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:25.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 shutdown_connections 2026-02-20T03:15:25.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.357+0000 7fd66ec7a640 1 -- 10.20.193.28:0/1594939607 wait complete. 2026-02-20T03:15:25.373 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-20T03:12:36.019995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2026-02-20T03:14:30.208166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2026-02-20T03:14:31.725985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2026-02-20T03:14:35.302631+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2026-02-20T03:15:25.374 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-20T03:15:25.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:25 trial177 ceph-mon[43181]: pgmap v198: 129 pgs: 129 active+clean; 646 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-20T03:15:25.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:25 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2981492027' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2026-02-20T03:15:25.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.497+0000 7fcb31141640 1 -- 10.20.193.28:0/760149498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 msgr2=0x7fcb2c1096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.497+0000 7fcb31141640 1 --2- 10.20.193.28:0/760149498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 0x7fcb2c1096a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c009a30 tx=0x7fcb1c02f220 comp rx=0 tx=0).stop 2026-02-20T03:15:25.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.497+0000 7fcb31141640 1 -- 10.20.193.28:0/760149498 shutdown_connections 2026-02-20T03:15:25.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.497+0000 7fcb31141640 1 --2- 10.20.193.28:0/760149498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb2c109be0 0x7fcb2c111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.497+0000 7fcb31141640 1 --2- 10.20.193.28:0/760149498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 0x7fcb2c1096a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.497+0000 7fcb31141640 1 --2- 10.20.193.28:0/760149498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb2c10a540 0x7fcb2c10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.497+0000 7fcb31141640 1 -- 10.20.193.28:0/760149498 >> 10.20.193.28:0/760149498 conn(0x7fcb2c078080 msgr2=0x7fcb2c07a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:25.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.497+0000 7fcb31141640 1 -- 10.20.193.28:0/760149498 shutdown_connections 2026-02-20T03:15:25.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.497+0000 7fcb31141640 1 -- 10.20.193.28:0/760149498 wait complete. 2026-02-20T03:15:25.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.498+0000 7fcb31141640 1 Processor -- start 2026-02-20T03:15:25.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.498+0000 7fcb31141640 1 -- start start 2026-02-20T03:15:25.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.498+0000 7fcb31141640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 0x7fcb2c1a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.498+0000 7fcb31141640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb2c109be0 0x7fcb2c1a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.498+0000 7fcb31141640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb2c10a540 0x7fcb2c1a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.498+0000 7fcb31141640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c1149c0 con 0x7fcb2c109220 2026-02-20T03:15:25.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.498+0000 7fcb31141640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c114840 con 0x7fcb2c109be0 2026-02-20T03:15:25.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.498+0000 7fcb31141640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2c114b40 con 0x7fcb2c10a540 2026-02-20T03:15:25.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.498+0000 7fcb2bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 0x7fcb2c1a1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb2b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb2c109be0 0x7fcb2c1a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb2bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 0x7fcb2c1a1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45612/0 (socket says 10.20.193.28:45612) 2026-02-20T03:15:25.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb2bfff640 1 -- 10.20.193.28:0/3381548344 learned_addr learned my addr 10.20.193.28:0/3381548344 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:25.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb30940640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb2c10a540 0x7fcb2c1a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb2bfff640 1 -- 10.20.193.28:0/3381548344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb2c10a540 msgr2=0x7fcb2c1a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb2bfff640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb2c10a540 0x7fcb2c1a85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb2bfff640 1 -- 10.20.193.28:0/3381548344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb2c109be0 msgr2=0x7fcb2c1a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb2bfff640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb2c109be0 0x7fcb2c1a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb2bfff640 1 -- 10.20.193.28:0/3381548344 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2c1a8cc0 con 0x7fcb2c109220 2026-02-20T03:15:25.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb2bfff640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 0x7fcb2c1a1010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800e9c0 tx=0x7fcb1800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:25.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb297fa640 1 -- 10.20.193.28:0/3381548344 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800cdb0 con 0x7fcb2c109220 2026-02-20T03:15:25.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb297fa640 1 -- 10.20.193.28:0/3381548344 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcb18004570 con 0x7fcb2c109220 2026-02-20T03:15:25.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb297fa640 1 -- 10.20.193.28:0/3381548344 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18010690 con 0x7fcb2c109220 2026-02-20T03:15:25.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb2c1a8fb0 con 0x7fcb2c109220 2026-02-20T03:15:25.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.499+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb2c1a93c0 con 0x7fcb2c109220 2026-02-20T03:15:25.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.500+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2c10fec0 con 0x7fcb2c109220 2026-02-20T03:15:25.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.502+0000 7fcb297fa640 1 -- 10.20.193.28:0/3381548344 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fcb180040d0 con 0x7fcb2c109220 2026-02-20T03:15:25.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.503+0000 7fcb297fa640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcb000b0eb0 0x7fcb000b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.503+0000 7fcb297fa640 1 -- 10.20.193.28:0/3381548344 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fcb180e0f30 con 0x7fcb2c109220 2026-02-20T03:15:25.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.504+0000 7fcb297fa640 1 -- 10.20.193.28:0/3381548344 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fcb180e1450 con 0x7fcb2c109220 2026-02-20T03:15:25.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.504+0000 7fcb2b7fe640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcb000b0eb0 0x7fcb000b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.504+0000 7fcb2b7fe640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcb000b0eb0 0x7fcb000b3370 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c002c30 tx=0x7fcb1c0057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:25.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.594+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb2c110390 con 0x7fcb2c109220 2026-02-20T03:15:25.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.594+0000 7fcb297fa640 1 -- 10.20.193.28:0/3381548344 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7fcb180a94a0 con 0x7fcb2c109220 2026-02-20T03:15:25.597 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-20T03:15:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcb000b0eb0 msgr2=0x7fcb000b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcb000b0eb0 0x7fcb000b3370 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c002c30 tx=0x7fcb1c0057d0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 msgr2=0x7fcb2c1a1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 0x7fcb2c1a1010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800e9c0 tx=0x7fcb1800ee90 comp rx=0 tx=0).stop 2026-02-20T03:15:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 shutdown_connections 2026-02-20T03:15:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcb000b0eb0 0x7fcb000b3370 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcb2c10a540 0x7fcb2c1a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcb2c109be0 0x7fcb2c1a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 --2- 10.20.193.28:0/3381548344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcb2c109220 0x7fcb2c1a1010 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 >> 10.20.193.28:0/3381548344 conn(0x7fcb2c078080 msgr2=0x7fcb2c10d620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 shutdown_connections 2026-02-20T03:15:25.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.595+0000 7fcb31141640 1 -- 10.20.193.28:0/3381548344 wait complete. 2026-02-20T03:15:25.610 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2026-02-20T03:15:25.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.732+0000 7fa897577640 1 -- 10.20.193.28:0/363012747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 msgr2=0x7fa8981096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.732+0000 7fa897577640 1 --2- 10.20.193.28:0/363012747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 0x7fa8981096a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa880009a30 tx=0x7fa88002f220 comp rx=0 tx=0).stop 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.732+0000 7fa897577640 1 -- 10.20.193.28:0/363012747 shutdown_connections 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.732+0000 7fa897577640 1 --2- 10.20.193.28:0/363012747 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa898109be0 0x7fa898111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.732+0000 7fa897577640 1 --2- 10.20.193.28:0/363012747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 0x7fa8981096a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.732+0000 7fa897577640 1 --2- 10.20.193.28:0/363012747 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa89810a540 0x7fa89810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.732+0000 7fa897577640 1 -- 10.20.193.28:0/363012747 >> 10.20.193.28:0/363012747 conn(0x7fa898078080 msgr2=0x7fa89807a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.732+0000 7fa897577640 1 -- 10.20.193.28:0/363012747 shutdown_connections 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.732+0000 7fa897577640 1 -- 10.20.193.28:0/363012747 wait complete. 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa897577640 1 Processor -- start 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa897577640 1 -- start start 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa897577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 0x7fa8981a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa897577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa898109be0 0x7fa8981a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa897577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa89810a540 0x7fa8981a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa897577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981149c0 con 0x7fa898109220 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa897577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa898114840 con 0x7fa89810a540 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa897577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa898114b40 con 0x7fa898109be0 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa895d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa898109be0 0x7fa8981a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa896575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 0x7fa8981a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa896575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 0x7fa8981a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45636/0 (socket says 10.20.193.28:45636) 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa896575640 1 -- 10.20.193.28:0/1223394784 learned_addr learned my addr 10.20.193.28:0/1223394784 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa896d76640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa89810a540 0x7fa8981a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa896575640 1 -- 10.20.193.28:0/1223394784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa898109be0 msgr2=0x7fa8981a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa896575640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa898109be0 0x7fa8981a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa896575640 1 -- 10.20.193.28:0/1223394784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa89810a540 msgr2=0x7fa8981a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa896575640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa89810a540 0x7fa8981a8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.733+0000 7fa896575640 1 -- 10.20.193.28:0/1223394784 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8981a8c80 con 0x7fa898109220 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.734+0000 7fa896575640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 0x7fa8981a0fd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0059c0 tx=0x7fa88c00ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.734+0000 7fa87f7fe640 1 -- 10.20.193.28:0/1223394784 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c014070 con 0x7fa898109220 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.734+0000 7fa87f7fe640 1 -- 10.20.193.28:0/1223394784 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa88c0044e0 con 0x7fa898109220 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.734+0000 7fa87f7fe640 1 -- 10.20.193.28:0/1223394784 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c010460 con 0x7fa898109220 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.734+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8981a8f70 con 0x7fa898109220 2026-02-20T03:15:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.734+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8981a9380 con 0x7fa898109220 2026-02-20T03:15:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.734+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa89810fef0 con 0x7fa898109220 2026-02-20T03:15:25.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.736+0000 7fa87f7fe640 1 -- 10.20.193.28:0/1223394784 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fa88c00b840 con 0x7fa898109220 2026-02-20T03:15:25.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.738+0000 7fa87f7fe640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa8700b0eb0 0x7fa8700b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.738+0000 7fa87f7fe640 1 -- 10.20.193.28:0/1223394784 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fa88c0e1210 con 0x7fa898109220 2026-02-20T03:15:25.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.738+0000 7fa895d74640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa8700b0eb0 0x7fa8700b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.738+0000 7fa87f7fe640 1 -- 10.20.193.28:0/1223394784 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa88c01e030 con 0x7fa898109220 2026-02-20T03:15:25.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.739+0000 7fa895d74640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa8700b0eb0 0x7fa8700b3370 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa880002c30 tx=0x7fa8800057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:25.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.830+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa898110400 con 0x7fa898109220 2026-02-20T03:15:25.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.830+0000 7fa87f7fe640 1 -- 10.20.193.28:0/1223394784 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fa88c0a9790 con 0x7fa898109220 2026-02-20T03:15:25.833 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 32 2026-02-20T03:15:25.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa8700b0eb0 msgr2=0x7fa8700b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa8700b0eb0 0x7fa8700b3370 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa880002c30 tx=0x7fa8800057d0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 msgr2=0x7fa8981a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 0x7fa8981a0fd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0059c0 tx=0x7fa88c00ddf0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 shutdown_connections 2026-02-20T03:15:25.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa8700b0eb0 0x7fa8700b3370 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa89810a540 0x7fa8981a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa898109be0 0x7fa8981a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 --2- 10.20.193.28:0/1223394784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa898109220 0x7fa8981a0fd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 >> 10.20.193.28:0/1223394784 conn(0x7fa898078080 msgr2=0x7fa89810d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:25.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 shutdown_connections 2026-02-20T03:15:25.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.831+0000 7fa897577640 1 -- 10.20.193.28:0/1223394784 wait complete. 2026-02-20T03:15:25.846 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2026-02-20T03:15:25.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.969+0000 7fc4c7382640 1 -- 10.20.193.28:0/1295454833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc4c0105bb0 msgr2=0x7fc4c0106030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.969+0000 7fc4c7382640 1 --2- 10.20.193.28:0/1295454833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc4c0105bb0 0x7fc4c0106030 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009a30 tx=0x7fc4b402f220 comp rx=0 tx=0).stop 2026-02-20T03:15:25.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.969+0000 7fc4c7382640 1 -- 10.20.193.28:0/1295454833 shutdown_connections 2026-02-20T03:15:25.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.969+0000 7fc4c7382640 1 --2- 10.20.193.28:0/1295454833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4c0106570 0x7fc4c010ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.969+0000 7fc4c7382640 1 --2- 10.20.193.28:0/1295454833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc4c0105bb0 0x7fc4c0106030 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.969+0000 7fc4c7382640 1 --2- 10.20.193.28:0/1295454833 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc4c01049c0 0x7fc4c0104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.969+0000 7fc4c7382640 1 -- 10.20.193.28:0/1295454833 >> 10.20.193.28:0/1295454833 conn(0x7fc4c0100120 msgr2=0x7fc4c0102560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:25.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.969+0000 7fc4c7382640 1 -- 10.20.193.28:0/1295454833 shutdown_connections 2026-02-20T03:15:25.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.969+0000 7fc4c7382640 1 -- 10.20.193.28:0/1295454833 wait complete. 2026-02-20T03:15:25.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.970+0000 7fc4c7382640 1 Processor -- start 2026-02-20T03:15:25.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.970+0000 7fc4c7382640 1 -- start start 2026-02-20T03:15:25.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.970+0000 7fc4c7382640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4c01049c0 0x7fc4c019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.970+0000 7fc4c7382640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc4c0105bb0 0x7fc4c019d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.970+0000 7fc4c7382640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc4c0106570 0x7fc4c01a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.970+0000 7fc4c7382640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c01104b0 con 0x7fc4c01049c0 2026-02-20T03:15:25.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.970+0000 7fc4c7382640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c0110330 con 0x7fc4c0106570 2026-02-20T03:15:25.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.970+0000 7fc4c7382640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c0110630 con 0x7fc4c0105bb0 2026-02-20T03:15:25.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c6380640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4c01049c0 0x7fc4c019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c5b7f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc4c0105bb0 0x7fc4c019d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c6380640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4c01049c0 0x7fc4c019caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45650/0 (socket says 10.20.193.28:45650) 2026-02-20T03:15:25.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c6380640 1 -- 10.20.193.28:0/453681696 learned_addr learned my addr 10.20.193.28:0/453681696 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:25.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c6b81640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc4c0106570 0x7fc4c01a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c5b7f640 1 -- 10.20.193.28:0/453681696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc4c0106570 msgr2=0x7fc4c01a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c5b7f640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc4c0106570 0x7fc4c01a40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c5b7f640 1 -- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4c01049c0 msgr2=0x7fc4c019caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:25.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c5b7f640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4c01049c0 0x7fc4c019caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:25.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c5b7f640 1 -- 10.20.193.28:0/453681696 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c01a47a0 con 0x7fc4c0105bb0 2026-02-20T03:15:25.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c6380640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4c01049c0 0x7fc4c019caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:25.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c5b7f640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc4c0105bb0 0x7fc4c019d030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009950 tx=0x7fc4b402fcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:25.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4a77fe640 1 -- 10.20.193.28:0/453681696 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4002e10 con 0x7fc4c0105bb0 2026-02-20T03:15:25.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4a77fe640 1 -- 10.20.193.28:0/453681696 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc4b4038770 con 0x7fc4c0105bb0 2026-02-20T03:15:25.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4a77fe640 1 -- 10.20.193.28:0/453681696 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4042810 con 0x7fc4c0105bb0 2026-02-20T03:15:25.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c01a4a30 con 0x7fc4c0105bb0 2026-02-20T03:15:25.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.971+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c01a4ed0 con 0x7fc4c0105bb0 2026-02-20T03:15:25.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.972+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c010b870 con 0x7fc4c0105bb0 2026-02-20T03:15:25.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.974+0000 7fc4a77fe640 1 -- 10.20.193.28:0/453681696 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fc4b4004240 con 0x7fc4c0105bb0 2026-02-20T03:15:25.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.975+0000 7fc4a77fe640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc49c0b0eb0 0x7fc49c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:25.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.975+0000 7fc4a77fe640 1 -- 10.20.193.28:0/453681696 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8796+0+0 (secure 0 0 0) 0x7fc4b41054a0 con 0x7fc4c0105bb0 2026-02-20T03:15:25.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.976+0000 7fc4c6380640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc49c0b0eb0 0x7fc49c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:25.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.976+0000 7fc4a77fe640 1 -- 10.20.193.28:0/453681696 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fc4b4105920 con 0x7fc4c0105bb0 2026-02-20T03:15:25.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:25.976+0000 7fc4c6380640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc49c0b0eb0 0x7fc49c0b3370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009fd0 tx=0x7fc4b0009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:26.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.066+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc4c010bc90 con 0x7fc4c0105bb0 2026-02-20T03:15:26.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.066+0000 7fc4a77fe640 1 -- 10.20.193.28:0/453681696 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7fc4b4004560 con 0x7fc4c0105bb0 2026-02-20T03:15:26.069 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 64 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc49c0b0eb0 msgr2=0x7fc49c0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc49c0b0eb0 0x7fc49c0b3370 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009fd0 tx=0x7fc4b0009290 comp rx=0 tx=0).stop 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc4c0105bb0 msgr2=0x7fc4c019d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc4c0105bb0 0x7fc4c019d030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009950 tx=0x7fc4b402fcb0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 shutdown_connections 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc49c0b0eb0 0x7fc49c0b3370 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc4c0106570 0x7fc4c01a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc4c0105bb0 0x7fc4c019d030 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 --2- 10.20.193.28:0/453681696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc4c01049c0 0x7fc4c019caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 >> 10.20.193.28:0/453681696 conn(0x7fc4c0100120 msgr2=0x7fc4c0108fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 shutdown_connections 2026-02-20T03:15:26.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.067+0000 7fc4c7382640 1 -- 10.20.193.28:0/453681696 wait complete. 2026-02-20T03:15:26.082 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2026-02-20T03:15:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.207+0000 7f0e22941640 1 -- 10.20.193.28:0/268918820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e1c077090 msgr2=0x7f0e1c0754e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.207+0000 7f0e22941640 1 --2- 10.20.193.28:0/268918820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e1c077090 0x7f0e1c0754e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009a30 tx=0x7f0e0c02f2b0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.207+0000 7f0e22941640 1 -- 10.20.193.28:0/268918820 shutdown_connections 2026-02-20T03:15:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.207+0000 7f0e22941640 1 --2- 10.20.193.28:0/268918820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e1c10a630 0x7f0e1c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.207+0000 7f0e22941640 1 --2- 10.20.193.28:0/268918820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e1c075a20 0x7f0e1c075e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.207+0000 7f0e22941640 1 --2- 10.20.193.28:0/268918820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e1c077090 0x7f0e1c0754e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.207+0000 7f0e22941640 1 -- 10.20.193.28:0/268918820 >> 10.20.193.28:0/268918820 conn(0x7f0e1c0fde90 msgr2=0x7f0e1c1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.207+0000 7f0e22941640 1 -- 10.20.193.28:0/268918820 shutdown_connections 2026-02-20T03:15:26.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.207+0000 7f0e22941640 1 -- 10.20.193.28:0/268918820 wait complete. 2026-02-20T03:15:26.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e22941640 1 Processor -- start 2026-02-20T03:15:26.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e22941640 1 -- start start 2026-02-20T03:15:26.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e22941640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e1c075a20 0x7f0e1c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:26.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e22941640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e1c077090 0x7f0e1c19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:26.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e22941640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e1c10a630 0x7f0e1c1a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:26.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e22941640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c1104a0 con 0x7f0e1c075a20 2026-02-20T03:15:26.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e22941640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c110320 con 0x7f0e1c077090 2026-02-20T03:15:26.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e22941640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c110620 con 0x7f0e1c10a630 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e2193f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e1c075a20 0x7f0e1c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e2193f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e1c075a20 0x7f0e1c19cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33634/0 (socket says 10.20.193.28:33634) 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e2193f640 1 -- 10.20.193.28:0/2192855368 learned_addr learned my addr 10.20.193.28:0/2192855368 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e2113e640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e1c077090 0x7f0e1c19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.208+0000 7f0e22140640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e1c10a630 0x7f0e1c1a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e2193f640 1 -- 10.20.193.28:0/2192855368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e1c10a630 msgr2=0x7f0e1c1a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e2193f640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e1c10a630 0x7f0e1c1a40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e2193f640 1 -- 10.20.193.28:0/2192855368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e1c077090 msgr2=0x7f0e1c19d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e2193f640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e1c077090 0x7f0e1c19d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e2193f640 1 -- 10.20.193.28:0/2192855368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c1a47c0 con 0x7f0e1c075a20 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e2193f640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e1c075a20 0x7f0e1c19cb10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009950 tx=0x7f0e0c02fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:26.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e0affd640 1 -- 10.20.193.28:0/2192855368 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c004300 con 0x7f0e1c075a20 2026-02-20T03:15:26.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c1a4a50 con 0x7f0e1c075a20 2026-02-20T03:15:26.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e0affd640 1 -- 10.20.193.28:0/2192855368 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0e0c0044a0 con 0x7f0e1c075a20 2026-02-20T03:15:26.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e0affd640 1 -- 10.20.193.28:0/2192855368 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c042810 con 0x7f0e1c075a20 2026-02-20T03:15:26.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.209+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c1a4f90 con 0x7f0e1c075a20 2026-02-20T03:15:26.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.210+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c108eb0 con 0x7f0e1c075a20 2026-02-20T03:15:26.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.212+0000 7f0e0affd640 1 -- 10.20.193.28:0/2192855368 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f0e0c038b50 con 0x7f0e1c075a20 2026-02-20T03:15:26.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.213+0000 7f0e0affd640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0f30 0x7f0df80b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:26.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.213+0000 7f0e0affd640 1 -- 10.20.193.28:0/2192855368 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9065+0+0 (secure 0 0 0) 0x7f0e0c1052a0 con 0x7f0e1c075a20 2026-02-20T03:15:26.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.213+0000 7f0e0affd640 1 -- 10.20.193.28:0/2192855368 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0e0c1056c0 con 0x7f0e1c075a20 2026-02-20T03:15:26.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.213+0000 7f0e2113e640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0f30 0x7f0df80b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:26.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.214+0000 7f0e2113e640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0f30 0x7f0df80b33f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c19e020 tx=0x7f0e10009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:26.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.302+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0e1c109080 con 0x7f0e1c075a20 2026-02-20T03:15:26.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.302+0000 7f0e0affd640 1 -- 10.20.193.28:0/2192855368 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f0e0c0cd6a0 con 0x7f0e1c075a20 2026-02-20T03:15:26.305 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 32 2026-02-20T03:15:26.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0f30 msgr2=0x7f0df80b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0f30 0x7f0df80b33f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c19e020 tx=0x7f0e10009290 comp rx=0 tx=0).stop 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e1c075a20 msgr2=0x7f0e1c19cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e1c075a20 0x7f0e1c19cb10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009950 tx=0x7f0e0c02fe10 comp rx=0 tx=0).stop 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 shutdown_connections 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0f30 0x7f0df80b33f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e1c10a630 0x7f0e1c1a40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e1c077090 0x7f0e1c19d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 --2- 10.20.193.28:0/2192855368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e1c075a20 0x7f0e1c19cb10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 >> 10.20.193.28:0/2192855368 conn(0x7f0e1c0fde90 msgr2=0x7f0e1c106610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 shutdown_connections 2026-02-20T03:15:26.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.303+0000 7f0e22941640 1 -- 10.20.193.28:0/2192855368 wait complete. 2026-02-20T03:15:26.318 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2026-02-20T03:15:26.318 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:26.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2981492027' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2026-02-20T03:15:26.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:15:26.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1594939607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:26.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3381548344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T03:15:26.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1223394784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2026-02-20T03:15:26.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2026-02-20T03:15:26.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2026-02-20T03:15:26.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2026-02-20T03:15:26.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2026-02-20T03:15:26.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2026-02-20T03:15:26.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7, 3, 6]}]: dispatch 2026-02-20T03:15:26.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2026-02-20T03:15:26.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2026-02-20T03:15:26.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2026-02-20T03:15:26.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:26 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/453681696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2026-02-20T03:15:26.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2981492027' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1594939607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3381548344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1223394784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7, 3, 6]}]: dispatch 2026-02-20T03:15:26.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2026-02-20T03:15:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2026-02-20T03:15:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2026-02-20T03:15:26.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:26 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/453681696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2026-02-20T03:15:26.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2981492027' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2026-02-20T03:15:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:15:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1594939607' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3381548344' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T03:15:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1223394784' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2026-02-20T03:15:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2026-02-20T03:15:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2026-02-20T03:15:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]: dispatch 2026-02-20T03:15:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2026-02-20T03:15:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2026-02-20T03:15:26.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7, 3, 6]}]: dispatch 2026-02-20T03:15:26.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2026-02-20T03:15:26.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2026-02-20T03:15:26.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]: dispatch 2026-02-20T03:15:26.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:26 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/453681696' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2026-02-20T03:15:26.584 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:26.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.770+0000 7feff54fa640 1 -- 10.20.193.28:0/3984035365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff0104970 msgr2=0x7feff0104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.770+0000 7feff54fa640 1 --2- 10.20.193.28:0/3984035365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff0104970 0x7feff0104dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009a60 tx=0x7fefe002f260 comp rx=0 tx=0).stop 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.770+0000 7feff54fa640 1 -- 10.20.193.28:0/3984035365 shutdown_connections 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.770+0000 7feff54fa640 1 --2- 10.20.193.28:0/3984035365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feff0105310 0x7feff0111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.770+0000 7feff54fa640 1 --2- 10.20.193.28:0/3984035365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff0104970 0x7feff0104dd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.770+0000 7feff54fa640 1 --2- 10.20.193.28:0/3984035365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7feff010a970 0x7feff010ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.770+0000 7feff54fa640 1 -- 10.20.193.28:0/3984035365 >> 10.20.193.28:0/3984035365 conn(0x7feff0100650 msgr2=0x7feff0102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.770+0000 7feff54fa640 1 -- 10.20.193.28:0/3984035365 shutdown_connections 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.770+0000 7feff54fa640 1 -- 10.20.193.28:0/3984035365 wait complete. 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7feff54fa640 1 Processor -- start 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7feff54fa640 1 -- start start 2026-02-20T03:15:26.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7feff54fa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff0104970 0x7feff019d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7feff54fa640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7feff0105310 0x7feff019d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7feff54fa640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feff010a970 0x7feff01a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7feff54fa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feff0114be0 con 0x7feff0104970 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7feff54fa640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7feff0114a60 con 0x7feff010a970 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7feff54fa640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7feff0114d60 con 0x7feff0105310 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7fefef7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7feff0105310 0x7feff019d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7fefef7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7feff0105310 0x7feff019d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33114/0 (socket says 10.20.193.28:33114) 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.771+0000 7fefef7fe640 1 -- 10.20.193.28:0/2734073051 learned_addr learned my addr 10.20.193.28:0/2734073051 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefeffff640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff0104970 0x7feff019d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7feff4cf9640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feff010a970 0x7feff01a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:26.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefeffff640 1 -- 10.20.193.28:0/2734073051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7feff0105310 msgr2=0x7feff019d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefeffff640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7feff0105310 0x7feff019d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefeffff640 1 -- 10.20.193.28:0/2734073051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feff010a970 msgr2=0x7feff01a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefeffff640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feff010a970 0x7feff01a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefeffff640 1 -- 10.20.193.28:0/2734073051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff01a20f0 con 0x7feff0104970 2026-02-20T03:15:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefef7fe640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7feff0105310 0x7feff019d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefeffff640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff0104970 0x7feff019d0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00d750 tx=0x7fefdc00dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefed7fa640 1 -- 10.20.193.28:0/2734073051 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc014070 con 0x7feff0104970 2026-02-20T03:15:26.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefed7fa640 1 -- 10.20.193.28:0/2734073051 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fefdc0044e0 con 0x7feff0104970 2026-02-20T03:15:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7fefed7fa640 1 -- 10.20.193.28:0/2734073051 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefdc005020 con 0x7feff0104970 2026-02-20T03:15:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff01a23e0 con 0x7feff0104970 2026-02-20T03:15:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.772+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff01a9c20 con 0x7feff0104970 2026-02-20T03:15:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.773+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff0104dd0 con 0x7feff0104970 2026-02-20T03:15:26.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.776+0000 7fefed7fa640 1 -- 10.20.193.28:0/2734073051 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fefdc0047c0 con 0x7feff0104970 2026-02-20T03:15:26.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.777+0000 7fefed7fa640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fefc40b0eb0 0x7fefc40b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:26.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.777+0000 7fefed7fa640 1 -- 10.20.193.28:0/2734073051 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9065+0+0 (secure 0 0 0) 0x7fefdc0e0c90 con 0x7feff0104970 2026-02-20T03:15:26.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.777+0000 7fefef7fe640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fefc40b0eb0 0x7fefc40b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:26.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.778+0000 7fefed7fa640 1 -- 10.20.193.28:0/2734073051 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fefdc0e1110 con 0x7feff0104970 2026-02-20T03:15:26.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.778+0000 7fefef7fe640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fefc40b0eb0 0x7fefc40b3370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fefe00097c0 tx=0x7fefe0005830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:26.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.887+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feff010c970 con 0x7feff0104970 2026-02-20T03:15:26.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.887+0000 7fefed7fa640 1 -- 10.20.193.28:0/2734073051 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11921 (secure 0 0 0) 0x7fefdc0a9000 con 0x7feff0104970 2026-02-20T03:15:26.890 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:26.890 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":22,"btime":"2026-02-20T03:15:25:077948+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:24.821493+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:15:26.891 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 22 2026-02-20T03:15:26.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fefc40b0eb0 msgr2=0x7fefc40b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fefc40b0eb0 0x7fefc40b3370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fefe00097c0 tx=0x7fefe0005830 comp rx=0 tx=0).stop 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff0104970 msgr2=0x7feff019d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff0104970 0x7feff019d0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fefdc00d750 tx=0x7fefdc00dc20 comp rx=0 tx=0).stop 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 shutdown_connections 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fefc40b0eb0 0x7fefc40b3370 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7feff010a970 0x7feff01a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7feff0105310 0x7feff019d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 --2- 10.20.193.28:0/2734073051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7feff0104970 0x7feff019d0a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 >> 10.20.193.28:0/2734073051 conn(0x7feff0100650 msgr2=0x7feff0100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 shutdown_connections 2026-02-20T03:15:26.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:26.888+0000 7feff54fa640 1 -- 10.20.193.28:0/2734073051 wait complete. 2026-02-20T03:15:26.999 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2026-02-20T03:15:26.999 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2026-02-20T03:15:26.999 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T03:15:27.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.164+0000 7f00265ba640 1 -- 10.20.193.28:0/1730444613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00201026a0 msgr2=0x7f0020102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.164+0000 7f00265ba640 1 --2- 10.20.193.28:0/1730444613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00201026a0 0x7f0020102aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0010009960 tx=0x7f001002f140 comp rx=0 tx=0).stop 2026-02-20T03:15:27.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.165+0000 7f00265ba640 1 -- 10.20.193.28:0/1730444613 shutdown_connections 2026-02-20T03:15:27.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.165+0000 7f00265ba640 1 --2- 10.20.193.28:0/1730444613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0020104250 0x7f002010aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.165+0000 7f00265ba640 1 --2- 10.20.193.28:0/1730444613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0020103890 0x7f0020103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.165+0000 7f00265ba640 1 --2- 10.20.193.28:0/1730444613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00201026a0 0x7f0020102aa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.165+0000 7f00265ba640 1 -- 10.20.193.28:0/1730444613 >> 10.20.193.28:0/1730444613 conn(0x7f00200fde20 msgr2=0x7f0020100240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:27.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.165+0000 7f00265ba640 1 -- 10.20.193.28:0/1730444613 shutdown_connections 2026-02-20T03:15:27.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.165+0000 7f00265ba640 1 -- 10.20.193.28:0/1730444613 wait complete. 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.165+0000 7f00265ba640 1 Processor -- start 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.165+0000 7f00265ba640 1 -- start start 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00265ba640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00201026a0 0x7f002019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00265ba640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0020103890 0x7f002019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00265ba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0020104250 0x7f00201a3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00265ba640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f002010e190 con 0x7f0020104250 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00265ba640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f002010e010 con 0x7f0020103890 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00265ba640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f002010e310 con 0x7f00201026a0 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00255b8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00201026a0 0x7f002019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f0025db9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0020104250 0x7f00201a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00255b8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00201026a0 0x7f002019ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33134/0 (socket says 10.20.193.28:33134) 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00255b8640 1 -- 10.20.193.28:0/2222357902 learned_addr learned my addr 10.20.193.28:0/2222357902 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f0024db7640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0020103890 0x7f002019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f0025db9640 1 -- 10.20.193.28:0/2222357902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00201026a0 msgr2=0x7f002019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f0025db9640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00201026a0 0x7f002019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f0025db9640 1 -- 10.20.193.28:0/2222357902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0020103890 msgr2=0x7f002019cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f0025db9640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0020103890 0x7f002019cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f0025db9640 1 -- 10.20.193.28:0/2222357902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00201a46f0 con 0x7f0020104250 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f0025db9640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0020104250 0x7f00201a3ff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f001c00efc0 tx=0x7f001c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f000e7fc640 1 -- 10.20.193.28:0/2222357902 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c019070 con 0x7f0020104250 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f000e7fc640 1 -- 10.20.193.28:0/2222357902 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f001c0092d0 con 0x7f0020104250 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00201a4980 con 0x7f0020104250 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.166+0000 7f000e7fc640 1 -- 10.20.193.28:0/2222357902 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c0075c0 con 0x7f0020104250 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.167+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00201a4ed0 con 0x7f0020104250 2026-02-20T03:15:27.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.167+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0020196950 con 0x7f0020104250 2026-02-20T03:15:27.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.169+0000 7f000e7fc640 1 -- 10.20.193.28:0/2222357902 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f001c004b40 con 0x7f0020104250 2026-02-20T03:15:27.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.171+0000 7f000e7fc640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efffc0b0eb0 0x7efffc0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.171+0000 7f000e7fc640 1 -- 10.20.193.28:0/2222357902 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f001c0e0ad0 con 0x7f0020104250 2026-02-20T03:15:27.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.171+0000 7f000e7fc640 1 -- 10.20.193.28:0/2222357902 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f001c023080 con 0x7f0020104250 2026-02-20T03:15:27.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.171+0000 7f00255b8640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efffc0b0eb0 0x7efffc0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.172+0000 7f00255b8640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efffc0b0eb0 0x7efffc0b3370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f00100096f0 tx=0x7f00100057f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:27.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.261+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00200630c0 con 0x7efffc0b0eb0 2026-02-20T03:15:27.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.267+0000 7f000e7fc640 1 -- 10.20.193.28:0/2222357902 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340232 (secure 0 0 0) 0x7f00200630c0 con 0x7efffc0b0eb0 2026-02-20T03:15:27.272 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:27.274 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efffc0b0eb0 msgr2=0x7efffc0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efffc0b0eb0 0x7efffc0b3370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f00100096f0 tx=0x7f00100057f0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0020104250 msgr2=0x7f00201a3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0020104250 0x7f00201a3ff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f001c00efc0 tx=0x7f001c00c490 comp rx=0 tx=0).stop 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 shutdown_connections 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efffc0b0eb0 0x7efffc0b3370 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0020104250 0x7f00201a3ff0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0020103890 0x7f002019cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 --2- 10.20.193.28:0/2222357902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00201026a0 0x7f002019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 >> 10.20.193.28:0/2222357902 conn(0x7f00200fde20 msgr2=0x7f0020109160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 shutdown_connections 2026-02-20T03:15:27.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.270+0000 7f00265ba640 1 -- 10.20.193.28:0/2222357902 wait complete. 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: pgmap v199: 129 pgs: 129 active+clean; 648 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7, 3, 6]}]': finished 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: osdmap e90: 12 total, 12 up, 12 in 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2192855368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2026-02-20T03:15:27.284 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:27 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2734073051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:27.285 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2026-02-20T03:15:27.088550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663968,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":329,"num_read_kb":279,"num_write":357,"num_write_kb":3843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":297,"ondisk_log_size":297,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358160,"kb_used_data":13788,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807680240,"statfs":{"total":9019431321600,"available":9019064565760,"internally_reserved":0,"allocated":14118912,"data_stored":7785848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1978,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.080863"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.357986+0000","last_change":"2026-02-20T03:14:32.081180+0000","last_active":"2026-02-20T03:14:51.357986+0000","last_peered":"2026-02-20T03:14:51.357986+0000","last_clean":"2026-02-20T03:14:51.357986+0000","last_became_active":"2026-02-20T03:14:32.081083+0000","last_became_peered":"2026-02-20T03:14:32.081083+0000","last_unstale":"2026-02-20T03:14:51.357986+0000","last_undegraded":"2026-02-20T03:14:51.357986+0000","last_fullsized":"2026-02-20T03:14:51.357986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:23:16.897948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743323+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:14:38.743323+0000","last_peered":"2026-02-20T03:14:38.743323+0000","last_clean":"2026-02-20T03:14:38.743323+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:14:38.743323+0000","last_undegraded":"2026-02-20T03:14:38.743323+0000","last_fullsized":"2026-02-20T03:14:38.743323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092834+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:26.092834+0000","last_peered":"2026-02-20T03:15:26.092834+0000","last_clean":"2026-02-20T03:15:26.092834+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:26.092834+0000","last_undegraded":"2026-02-20T03:15:26.092834+0000","last_fullsized":"2026-02-20T03:15:26.092834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743404+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:14:38.743404+0000","last_peered":"2026-02-20T03:14:38.743404+0000","last_clean":"2026-02-20T03:14:38.743404+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:14:38.743404+0000","last_undegraded":"2026-02-20T03:14:38.743404+0000","last_fullsized":"2026-02-20T03:14:38.743404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089055+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:26.089055+0000","last_peered":"2026-02-20T03:15:26.089055+0000","last_clean":"2026-02-20T03:15:26.089055+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:26.089055+0000","last_undegraded":"2026-02-20T03:15:26.089055+0000","last_fullsized":"2026-02-20T03:15:26.089055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356040+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:14:51.356040+0000","last_peered":"2026-02-20T03:14:51.356040+0000","last_clean":"2026-02-20T03:14:51.356040+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:14:51.356040+0000","last_undegraded":"2026-02-20T03:14:51.356040+0000","last_fullsized":"2026-02-20T03:14:51.356040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098104+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:26.098104+0000","last_peered":"2026-02-20T03:15:26.098104+0000","last_clean":"2026-02-20T03:15:26.098104+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:26.098104+0000","last_undegraded":"2026-02-20T03:15:26.098104+0000","last_fullsized":"2026-02-20T03:15:26.098104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744316+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:14:38.744316+0000","last_peered":"2026-02-20T03:14:38.744316+0000","last_clean":"2026-02-20T03:14:38.744316+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:14:38.744316+0000","last_undegraded":"2026-02-20T03:14:38.744316+0000","last_fullsized":"2026-02-20T03:14:38.744316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744230+0000","last_change":"2026-02-20T03:14:33.291255+0000","last_active":"2026-02-20T03:14:38.744230+0000","last_peered":"2026-02-20T03:14:38.744230+0000","last_clean":"2026-02-20T03:14:38.744230+0000","last_became_active":"2026-02-20T03:14:33.291089+0000","last_became_peered":"2026-02-20T03:14:33.291089+0000","last_unstale":"2026-02-20T03:14:38.744230+0000","last_undegraded":"2026-02-20T03:14:38.744230+0000","last_fullsized":"2026-02-20T03:14:38.744230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:42:45.321761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318208+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:14:38.318208+0000","last_peered":"2026-02-20T03:14:38.318208+0000","last_clean":"2026-02-20T03:14:38.318208+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:14:38.318208+0000","last_undegraded":"2026-02-20T03:14:38.318208+0000","last_fullsized":"2026-02-20T03:14:38.318208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351492+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:14:50.351492+0000","last_peered":"2026-02-20T03:14:50.351492+0000","last_clean":"2026-02-20T03:14:50.351492+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:14:50.351492+0000","last_undegraded":"2026-02-20T03:14:50.351492+0000","last_fullsized":"2026-02-20T03:14:50.351492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742908+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:14:38.742908+0000","last_peered":"2026-02-20T03:14:38.742908+0000","last_clean":"2026-02-20T03:14:38.742908+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:14:38.742908+0000","last_undegraded":"2026-02-20T03:14:38.742908+0000","last_fullsized":"2026-02-20T03:14:38.742908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093043+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:26.093043+0000","last_peered":"2026-02-20T03:15:26.093043+0000","last_clean":"2026-02-20T03:15:26.093043+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:26.093043+0000","last_undegraded":"2026-02-20T03:15:26.093043+0000","last_fullsized":"2026-02-20T03:15:26.093043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:40.062667+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:40.062667+0000","last_peered":"2026-02-20T03:14:40.062667+0000","last_clean":"2026-02-20T03:14:40.062667+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:40.062667+0000","last_undegraded":"2026-02-20T03:14:40.062667+0000","last_fullsized":"2026-02-20T03:14:40.062667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743910+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:14:38.743910+0000","last_peered":"2026-02-20T03:14:38.743910+0000","last_clean":"2026-02-20T03:14:38.743910+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:14:38.743910+0000","last_undegraded":"2026-02-20T03:14:38.743910+0000","last_fullsized":"2026-02-20T03:14:38.743910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351649+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:14:50.351649+0000","last_peered":"2026-02-20T03:14:50.351649+0000","last_clean":"2026-02-20T03:14:50.351649+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:14:50.351649+0000","last_undegraded":"2026-02-20T03:14:50.351649+0000","last_fullsized":"2026-02-20T03:14:50.351649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742825+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:14:38.742825+0000","last_peered":"2026-02-20T03:14:38.742825+0000","last_clean":"2026-02-20T03:14:38.742825+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:14:38.742825+0000","last_undegraded":"2026-02-20T03:14:38.742825+0000","last_fullsized":"2026-02-20T03:14:38.742825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743900+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:14:38.743900+0000","last_peered":"2026-02-20T03:14:38.743900+0000","last_clean":"2026-02-20T03:14:38.743900+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:14:38.743900+0000","last_undegraded":"2026-02-20T03:14:38.743900+0000","last_fullsized":"2026-02-20T03:14:38.743900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:50.357549+0000","last_change":"2026-02-20T03:15:26.097400+0000","last_active":"2026-02-20T03:15:26.097400+0000","last_peered":"2026-02-20T03:14:50.357549+0000","last_clean":"2026-02-20T03:14:50.357549+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357549+0000","last_undegraded":"2026-02-20T03:14:50.357549+0000","last_fullsized":"2026-02-20T03:14:50.357549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.311982+0000","last_change":"2026-02-20T03:15:26.089098+0000","last_active":"2026-02-20T03:15:26.089098+0000","last_peered":"2026-02-20T03:14:38.311982+0000","last_clean":"2026-02-20T03:14:38.311982+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311982+0000","last_undegraded":"2026-02-20T03:14:38.311982+0000","last_fullsized":"2026-02-20T03:14:38.311982+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,6,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092967+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:26.092967+0000","last_peered":"2026-02-20T03:15:26.092967+0000","last_clean":"2026-02-20T03:15:26.092967+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:26.092967+0000","last_undegraded":"2026-02-20T03:15:26.092967+0000","last_fullsized":"2026-02-20T03:15:26.092967+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743028+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:14:38.743028+0000","last_peered":"2026-02-20T03:14:38.743028+0000","last_clean":"2026-02-20T03:14:38.743028+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:14:38.743028+0000","last_undegraded":"2026-02-20T03:14:38.743028+0000","last_fullsized":"2026-02-20T03:14:38.743028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:00.293338+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:00.293338+0000","last_peered":"2026-02-20T03:15:00.293338+0000","last_clean":"2026-02-20T03:15:00.293338+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:00.293338+0000","last_undegraded":"2026-02-20T03:15:00.293338+0000","last_fullsized":"2026-02-20T03:15:00.293338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742399+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:14:38.742399+0000","last_peered":"2026-02-20T03:14:38.742399+0000","last_clean":"2026-02-20T03:14:38.742399+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:14:38.742399+0000","last_undegraded":"2026-02-20T03:14:38.742399+0000","last_fullsized":"2026-02-20T03:14:38.742399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311146+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:14:38.311146+0000","last_peered":"2026-02-20T03:14:38.311146+0000","last_clean":"2026-02-20T03:14:38.311146+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:14:38.311146+0000","last_undegraded":"2026-02-20T03:14:38.311146+0000","last_fullsized":"2026-02-20T03:14:38.311146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352941+0000","last_change":"2026-02-20T03:14:32.081021+0000","last_active":"2026-02-20T03:14:50.352941+0000","last_peered":"2026-02-20T03:14:50.352941+0000","last_clean":"2026-02-20T03:14:50.352941+0000","last_became_active":"2026-02-20T03:14:32.080799+0000","last_became_peered":"2026-02-20T03:14:32.080799+0000","last_unstale":"2026-02-20T03:14:50.352941+0000","last_undegraded":"2026-02-20T03:14:50.352941+0000","last_fullsized":"2026-02-20T03:14:50.352941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:15.834880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744093+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:14:38.744093+0000","last_peered":"2026-02-20T03:14:38.744093+0000","last_clean":"2026-02-20T03:14:38.744093+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:14:38.744093+0000","last_undegraded":"2026-02-20T03:14:38.744093+0000","last_fullsized":"2026-02-20T03:14:38.744093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479703+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:14:38.479703+0000","last_peered":"2026-02-20T03:14:38.479703+0000","last_clean":"2026-02-20T03:14:38.479703+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:14:38.479703+0000","last_undegraded":"2026-02-20T03:14:38.479703+0000","last_fullsized":"2026-02-20T03:14:38.479703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742701+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:14:38.742701+0000","last_peered":"2026-02-20T03:14:38.742701+0000","last_clean":"2026-02-20T03:14:38.742701+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:14:38.742701+0000","last_undegraded":"2026-02-20T03:14:38.742701+0000","last_fullsized":"2026-02-20T03:14:38.742701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744036+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:14:38.744036+0000","last_peered":"2026-02-20T03:14:38.744036+0000","last_clean":"2026-02-20T03:14:38.744036+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:14:38.744036+0000","last_undegraded":"2026-02-20T03:14:38.744036+0000","last_fullsized":"2026-02-20T03:14:38.744036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479538+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:14:38.479538+0000","last_peered":"2026-02-20T03:14:38.479538+0000","last_clean":"2026-02-20T03:14:38.479538+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:14:38.479538+0000","last_undegraded":"2026-02-20T03:14:38.479538+0000","last_fullsized":"2026-02-20T03:14:38.479538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318364+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:14:38.318364+0000","last_peered":"2026-02-20T03:14:38.318364+0000","last_clean":"2026-02-20T03:14:38.318364+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:14:38.318364+0000","last_undegraded":"2026-02-20T03:14:38.318364+0000","last_fullsized":"2026-02-20T03:14:38.318364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311210+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:14:38.311210+0000","last_peered":"2026-02-20T03:14:38.311210+0000","last_clean":"2026-02-20T03:14:38.311210+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:14:38.311210+0000","last_undegraded":"2026-02-20T03:14:38.311210+0000","last_fullsized":"2026-02-20T03:14:38.311210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.290483+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.289779+0000","last_became_peered":"2026-02-20T03:14:33.289779+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:45:10.985058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:21.379484+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:21.379484+0000","last_peered":"2026-02-20T03:15:21.379484+0000","last_clean":"2026-02-20T03:15:21.379484+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:21.379484+0000","last_undegraded":"2026-02-20T03:15:21.379484+0000","last_fullsized":"2026-02-20T03:15:21.379484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311164+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:14:38.311164+0000","last_peered":"2026-02-20T03:14:38.311164+0000","last_clean":"2026-02-20T03:14:38.311164+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:14:38.311164+0000","last_undegraded":"2026-02-20T03:14:38.311164+0000","last_fullsized":"2026-02-20T03:14:38.311164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.310925+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:14:38.310925+0000","last_peered":"2026-02-20T03:14:38.310925+0000","last_clean":"2026-02-20T03:14:38.310925+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:14:38.310925+0000","last_undegraded":"2026-02-20T03:14:38.310925+0000","last_fullsized":"2026-02-20T03:14:38.310925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.360846+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:14:51.360846+0000","last_peered":"2026-02-20T03:14:51.360846+0000","last_clean":"2026-02-20T03:14:51.360846+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:14:51.360846+0000","last_undegraded":"2026-02-20T03:14:51.360846+0000","last_fullsized":"2026-02-20T03:14:51.360846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744423+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:14:38.744423+0000","last_peered":"2026-02-20T03:14:38.744423+0000","last_clean":"2026-02-20T03:14:38.744423+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:14:38.744423+0000","last_undegraded":"2026-02-20T03:14:38.744423+0000","last_fullsized":"2026-02-20T03:14:38.744423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743435+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:14:38.743435+0000","last_peered":"2026-02-20T03:14:38.743435+0000","last_clean":"2026-02-20T03:14:38.743435+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:14:38.743435+0000","last_undegraded":"2026-02-20T03:14:38.743435+0000","last_fullsized":"2026-02-20T03:14:38.743435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318242+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:14:38.318242+0000","last_peered":"2026-02-20T03:14:38.318242+0000","last_clean":"2026-02-20T03:14:38.318242+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:14:38.318242+0000","last_undegraded":"2026-02-20T03:14:38.318242+0000","last_fullsized":"2026-02-20T03:14:38.318242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318423+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:14:38.318423+0000","last_peered":"2026-02-20T03:14:38.318423+0000","last_clean":"2026-02-20T03:14:38.318423+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:14:38.318423+0000","last_undegraded":"2026-02-20T03:14:38.318423+0000","last_fullsized":"2026-02-20T03:14:38.318423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318536+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:14:38.318536+0000","last_peered":"2026-02-20T03:14:38.318536+0000","last_clean":"2026-02-20T03:14:38.318536+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:14:38.318536+0000","last_undegraded":"2026-02-20T03:14:38.318536+0000","last_fullsized":"2026-02-20T03:14:38.318536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2026-02-20T03:14:38.744446+0000","last_change":"2026-02-20T03:15:26.460325+0000","last_active":"2026-02-20T03:15:26.460325+0000","last_peered":"2026-02-20T03:14:38.744446+0000","last_clean":"2026-02-20T03:14:38.744446+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:38.744446+0000","last_undegraded":"2026-02-20T03:14:38.744446+0000","last_fullsized":"2026-02-20T03:14:38.744446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097649+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:26.097649+0000","last_peered":"2026-02-20T03:15:26.097649+0000","last_clean":"2026-02-20T03:15:26.097649+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:26.097649+0000","last_undegraded":"2026-02-20T03:15:26.097649+0000","last_fullsized":"2026-02-20T03:15:26.097649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318340+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:14:38.318340+0000","last_peered":"2026-02-20T03:14:38.318340+0000","last_clean":"2026-02-20T03:14:38.318340+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:14:38.318340+0000","last_undegraded":"2026-02-20T03:14:38.318340+0000","last_fullsized":"2026-02-20T03:14:38.318340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744433+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:14:38.744433+0000","last_peered":"2026-02-20T03:14:38.744433+0000","last_clean":"2026-02-20T03:14:38.744433+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:14:38.744433+0000","last_undegraded":"2026-02-20T03:14:38.744433+0000","last_fullsized":"2026-02-20T03:14:38.744433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088541+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:26.088541+0000","last_peered":"2026-02-20T03:15:26.088541+0000","last_clean":"2026-02-20T03:15:26.088541+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:26.088541+0000","last_undegraded":"2026-02-20T03:15:26.088541+0000","last_fullsized":"2026-02-20T03:15:26.088541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318490+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:14:38.318490+0000","last_peered":"2026-02-20T03:14:38.318490+0000","last_clean":"2026-02-20T03:14:38.318490+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:14:38.318490+0000","last_undegraded":"2026-02-20T03:14:38.318490+0000","last_fullsized":"2026-02-20T03:14:38.318490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311359+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:14:38.311359+0000","last_peered":"2026-02-20T03:14:38.311359+0000","last_clean":"2026-02-20T03:14:38.311359+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:14:38.311359+0000","last_undegraded":"2026-02-20T03:14:38.311359+0000","last_fullsized":"2026-02-20T03:14:38.311359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743916+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:14:38.743916+0000","last_peered":"2026-02-20T03:14:38.743916+0000","last_clean":"2026-02-20T03:14:38.743916+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:14:38.743916+0000","last_undegraded":"2026-02-20T03:14:38.743916+0000","last_fullsized":"2026-02-20T03:14:38.743916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744369+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:14:38.744369+0000","last_peered":"2026-02-20T03:14:38.744369+0000","last_clean":"2026-02-20T03:14:38.744369+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:14:38.744369+0000","last_undegraded":"2026-02-20T03:14:38.744369+0000","last_fullsized":"2026-02-20T03:14:38.744369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.359869+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:14:52.359869+0000","last_peered":"2026-02-20T03:14:52.359869+0000","last_clean":"2026-02-20T03:14:52.359869+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:14:52.359869+0000","last_undegraded":"2026-02-20T03:14:52.359869+0000","last_fullsized":"2026-02-20T03:14:52.359869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744027+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:14:38.744027+0000","last_peered":"2026-02-20T03:14:38.744027+0000","last_clean":"2026-02-20T03:14:38.744027+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:14:38.744027+0000","last_undegraded":"2026-02-20T03:14:38.744027+0000","last_fullsized":"2026-02-20T03:14:38.744027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743990+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:14:38.743990+0000","last_peered":"2026-02-20T03:14:38.743990+0000","last_clean":"2026-02-20T03:14:38.743990+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:14:38.743990+0000","last_undegraded":"2026-02-20T03:14:38.743990+0000","last_fullsized":"2026-02-20T03:14:38.743990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358752+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:14:51.358752+0000","last_peered":"2026-02-20T03:14:51.358752+0000","last_clean":"2026-02-20T03:14:51.358752+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:14:51.358752+0000","last_undegraded":"2026-02-20T03:14:51.358752+0000","last_fullsized":"2026-02-20T03:14:51.358752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311328+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:14:38.311328+0000","last_peered":"2026-02-20T03:14:38.311328+0000","last_clean":"2026-02-20T03:14:38.311328+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:14:38.311328+0000","last_undegraded":"2026-02-20T03:14:38.311328+0000","last_fullsized":"2026-02-20T03:14:38.311328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318042+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:14:38.318042+0000","last_peered":"2026-02-20T03:14:38.318042+0000","last_clean":"2026-02-20T03:14:38.318042+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:14:38.318042+0000","last_undegraded":"2026-02-20T03:14:38.318042+0000","last_fullsized":"2026-02-20T03:14:38.318042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:23.388416+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:23.388416+0000","last_peered":"2026-02-20T03:15:23.388416+0000","last_clean":"2026-02-20T03:15:23.388416+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:23.388416+0000","last_undegraded":"2026-02-20T03:15:23.388416+0000","last_fullsized":"2026-02-20T03:15:23.388416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743149+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:14:38.743149+0000","last_peered":"2026-02-20T03:14:38.743149+0000","last_clean":"2026-02-20T03:14:38.743149+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:14:38.743149+0000","last_undegraded":"2026-02-20T03:14:38.743149+0000","last_fullsized":"2026-02-20T03:14:38.743149+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318241+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:14:38.318241+0000","last_peered":"2026-02-20T03:14:38.318241+0000","last_clean":"2026-02-20T03:14:38.318241+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:14:38.318241+0000","last_undegraded":"2026-02-20T03:14:38.318241+0000","last_fullsized":"2026-02-20T03:14:38.318241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352270+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:14:50.352270+0000","last_peered":"2026-02-20T03:14:50.352270+0000","last_clean":"2026-02-20T03:14:50.352270+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:14:50.352270+0000","last_undegraded":"2026-02-20T03:14:50.352270+0000","last_fullsized":"2026-02-20T03:14:50.352270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744179+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:14:38.744179+0000","last_peered":"2026-02-20T03:14:38.744179+0000","last_clean":"2026-02-20T03:14:38.744179+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:14:38.744179+0000","last_undegraded":"2026-02-20T03:14:38.744179+0000","last_fullsized":"2026-02-20T03:14:38.744179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311740+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:14:38.311740+0000","last_peered":"2026-02-20T03:14:38.311740+0000","last_clean":"2026-02-20T03:14:38.311740+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:14:38.311740+0000","last_undegraded":"2026-02-20T03:14:38.311740+0000","last_fullsized":"2026-02-20T03:14:38.311740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093258+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:26.093258+0000","last_peered":"2026-02-20T03:15:26.093258+0000","last_clean":"2026-02-20T03:15:26.093258+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:26.093258+0000","last_undegraded":"2026-02-20T03:15:26.093258+0000","last_fullsized":"2026-02-20T03:15:26.093258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744303+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:14:38.744303+0000","last_peered":"2026-02-20T03:14:38.744303+0000","last_clean":"2026-02-20T03:14:38.744303+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:14:38.744303+0000","last_undegraded":"2026-02-20T03:14:38.744303+0000","last_fullsized":"2026-02-20T03:14:38.744303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744191+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:14:38.744191+0000","last_peered":"2026-02-20T03:14:38.744191+0000","last_clean":"2026-02-20T03:14:38.744191+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:14:38.744191+0000","last_undegraded":"2026-02-20T03:14:38.744191+0000","last_fullsized":"2026-02-20T03:14:38.744191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:24.392752+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:24.392752+0000","last_peered":"2026-02-20T03:15:24.392752+0000","last_clean":"2026-02-20T03:15:24.392752+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:24.392752+0000","last_undegraded":"2026-02-20T03:15:24.392752+0000","last_fullsized":"2026-02-20T03:15:24.392752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69334,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":76,"num_read_kb":106,"num_write":34,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742256+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:14:38.742256+0000","last_peered":"2026-02-20T03:14:38.742256+0000","last_clean":"2026-02-20T03:14:38.742256+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:14:38.742256+0000","last_undegraded":"2026-02-20T03:14:38.742256+0000","last_fullsized":"2026-02-20T03:14:38.742256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098166+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:26.098166+0000","last_peered":"2026-02-20T03:15:26.098166+0000","last_clean":"2026-02-20T03:15:26.098166+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:26.098166+0000","last_undegraded":"2026-02-20T03:15:26.098166+0000","last_fullsized":"2026-02-20T03:15:26.098166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352990+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:14:50.352990+0000","last_peered":"2026-02-20T03:14:50.352990+0000","last_clean":"2026-02-20T03:14:50.352990+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:14:50.352990+0000","last_undegraded":"2026-02-20T03:14:50.352990+0000","last_fullsized":"2026-02-20T03:14:50.352990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089065+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:26.089065+0000","last_peered":"2026-02-20T03:15:26.089065+0000","last_clean":"2026-02-20T03:15:26.089065+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:26.089065+0000","last_undegraded":"2026-02-20T03:15:26.089065+0000","last_fullsized":"2026-02-20T03:15:26.089065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.356807+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:14:50.356807+0000","last_peered":"2026-02-20T03:14:50.356807+0000","last_clean":"2026-02-20T03:14:50.356807+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:14:50.356807+0000","last_undegraded":"2026-02-20T03:14:50.356807+0000","last_fullsized":"2026-02-20T03:14:50.356807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743191+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:14:38.743191+0000","last_peered":"2026-02-20T03:14:38.743191+0000","last_clean":"2026-02-20T03:14:38.743191+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:14:38.743191+0000","last_undegraded":"2026-02-20T03:14:38.743191+0000","last_fullsized":"2026-02-20T03:14:38.743191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098167+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:26.098167+0000","last_peered":"2026-02-20T03:15:26.098167+0000","last_clean":"2026-02-20T03:15:26.098167+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:26.098167+0000","last_undegraded":"2026-02-20T03:15:26.098167+0000","last_fullsized":"2026-02-20T03:15:26.098167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:24.079702+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:24.079702+0000","last_peered":"2026-02-20T03:15:24.079702+0000","last_clean":"2026-02-20T03:15:24.079702+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:24.079702+0000","last_undegraded":"2026-02-20T03:15:24.079702+0000","last_fullsized":"2026-02-20T03:15:24.079702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743127+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:14:38.743127+0000","last_peered":"2026-02-20T03:14:38.743127+0000","last_clean":"2026-02-20T03:14:38.743127+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:14:38.743127+0000","last_undegraded":"2026-02-20T03:14:38.743127+0000","last_fullsized":"2026-02-20T03:14:38.743127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088557+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:26.088557+0000","last_peered":"2026-02-20T03:15:26.088557+0000","last_clean":"2026-02-20T03:15:26.088557+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:26.088557+0000","last_undegraded":"2026-02-20T03:15:26.088557+0000","last_fullsized":"2026-02-20T03:15:26.088557+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742536+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:14:38.742536+0000","last_peered":"2026-02-20T03:14:38.742536+0000","last_clean":"2026-02-20T03:14:38.742536+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:14:38.742536+0000","last_undegraded":"2026-02-20T03:14:38.742536+0000","last_fullsized":"2026-02-20T03:14:38.742536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744067+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:14:38.744067+0000","last_peered":"2026-02-20T03:14:38.744067+0000","last_clean":"2026-02-20T03:14:38.744067+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:14:38.744067+0000","last_undegraded":"2026-02-20T03:14:38.744067+0000","last_fullsized":"2026-02-20T03:14:38.744067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744459+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:14:38.744459+0000","last_peered":"2026-02-20T03:14:38.744459+0000","last_clean":"2026-02-20T03:14:38.744459+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:14:38.744459+0000","last_undegraded":"2026-02-20T03:14:38.744459+0000","last_fullsized":"2026-02-20T03:14:38.744459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742665+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:14:38.742665+0000","last_peered":"2026-02-20T03:14:38.742665+0000","last_clean":"2026-02-20T03:14:38.742665+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:14:38.742665+0000","last_undegraded":"2026-02-20T03:14:38.742665+0000","last_fullsized":"2026-02-20T03:14:38.742665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356776+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:14:51.356776+0000","last_peered":"2026-02-20T03:14:51.356776+0000","last_clean":"2026-02-20T03:14:51.356776+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:14:51.356776+0000","last_undegraded":"2026-02-20T03:14:51.356776+0000","last_fullsized":"2026-02-20T03:14:51.356776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.361797+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:14:51.361797+0000","last_peered":"2026-02-20T03:14:51.361797+0000","last_clean":"2026-02-20T03:14:51.361797+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:14:51.361797+0000","last_undegraded":"2026-02-20T03:14:51.361797+0000","last_fullsized":"2026-02-20T03:14:51.361797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744227+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:14:38.744227+0000","last_peered":"2026-02-20T03:14:38.744227+0000","last_clean":"2026-02-20T03:14:38.744227+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:14:38.744227+0000","last_undegraded":"2026-02-20T03:14:38.744227+0000","last_fullsized":"2026-02-20T03:14:38.744227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093296+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:26.093296+0000","last_peered":"2026-02-20T03:15:26.093296+0000","last_clean":"2026-02-20T03:15:26.093296+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:26.093296+0000","last_undegraded":"2026-02-20T03:15:26.093296+0000","last_fullsized":"2026-02-20T03:15:26.093296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":62,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:22.379029+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:22.379029+0000","last_peered":"2026-02-20T03:15:22.379029+0000","last_clean":"2026-02-20T03:15:22.379029+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:22.379029+0000","last_undegraded":"2026-02-20T03:15:22.379029+0000","last_fullsized":"2026-02-20T03:15:22.379029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744076+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:14:38.744076+0000","last_peered":"2026-02-20T03:14:38.744076+0000","last_clean":"2026-02-20T03:14:38.744076+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:14:38.744076+0000","last_undegraded":"2026-02-20T03:14:38.744076+0000","last_fullsized":"2026-02-20T03:14:38.744076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093320+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:26.093320+0000","last_peered":"2026-02-20T03:15:26.093320+0000","last_clean":"2026-02-20T03:15:26.093320+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:26.093320+0000","last_undegraded":"2026-02-20T03:15:26.093320+0000","last_fullsized":"2026-02-20T03:15:26.093320+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743873+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:14:38.743873+0000","last_peered":"2026-02-20T03:14:38.743873+0000","last_clean":"2026-02-20T03:14:38.743873+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:14:38.743873+0000","last_undegraded":"2026-02-20T03:14:38.743873+0000","last_fullsized":"2026-02-20T03:14:38.743873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093050+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:26.093050+0000","last_peered":"2026-02-20T03:15:26.093050+0000","last_clean":"2026-02-20T03:15:26.093050+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:26.093050+0000","last_undegraded":"2026-02-20T03:15:26.093050+0000","last_fullsized":"2026-02-20T03:15:26.093050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093067+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:26.093067+0000","last_peered":"2026-02-20T03:15:26.093067+0000","last_clean":"2026-02-20T03:15:26.093067+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:26.093067+0000","last_undegraded":"2026-02-20T03:15:26.093067+0000","last_fullsized":"2026-02-20T03:15:26.093067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088712+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:26.088712+0000","last_peered":"2026-02-20T03:15:26.088712+0000","last_clean":"2026-02-20T03:15:26.088712+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:26.088712+0000","last_undegraded":"2026-02-20T03:15:26.088712+0000","last_fullsized":"2026-02-20T03:15:26.088712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311110+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:14:38.311110+0000","last_peered":"2026-02-20T03:14:38.311110+0000","last_clean":"2026-02-20T03:14:38.311110+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:14:38.311110+0000","last_undegraded":"2026-02-20T03:14:38.311110+0000","last_fullsized":"2026-02-20T03:14:38.311110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744275+0000","last_change":"2026-02-20T03:14:33.290769+0000","last_active":"2026-02-20T03:14:38.744275+0000","last_peered":"2026-02-20T03:14:38.744275+0000","last_clean":"2026-02-20T03:14:38.744275+0000","last_became_active":"2026-02-20T03:14:33.290406+0000","last_became_peered":"2026-02-20T03:14:33.290406+0000","last_unstale":"2026-02-20T03:14:38.744275+0000","last_undegraded":"2026-02-20T03:14:38.744275+0000","last_fullsized":"2026-02-20T03:14:38.744275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:58.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093494+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:26.093494+0000","last_peered":"2026-02-20T03:15:26.093494+0000","last_clean":"2026-02-20T03:15:26.093494+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:26.093494+0000","last_undegraded":"2026-02-20T03:15:26.093494+0000","last_fullsized":"2026-02-20T03:15:26.093494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742977+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:14:38.742977+0000","last_peered":"2026-02-20T03:14:38.742977+0000","last_clean":"2026-02-20T03:14:38.742977+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:14:38.742977+0000","last_undegraded":"2026-02-20T03:14:38.742977+0000","last_fullsized":"2026-02-20T03:14:38.742977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743959+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:14:38.743959+0000","last_peered":"2026-02-20T03:14:38.743959+0000","last_clean":"2026-02-20T03:14:38.743959+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:14:38.743959+0000","last_undegraded":"2026-02-20T03:14:38.743959+0000","last_fullsized":"2026-02-20T03:14:38.743959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743157+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:14:38.743157+0000","last_peered":"2026-02-20T03:14:38.743157+0000","last_clean":"2026-02-20T03:14:38.743157+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:14:38.743157+0000","last_undegraded":"2026-02-20T03:14:38.743157+0000","last_fullsized":"2026-02-20T03:14:38.743157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097832+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:26.097832+0000","last_peered":"2026-02-20T03:15:26.097832+0000","last_clean":"2026-02-20T03:15:26.097832+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:26.097832+0000","last_undegraded":"2026-02-20T03:15:26.097832+0000","last_fullsized":"2026-02-20T03:15:26.097832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311289+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:14:38.311289+0000","last_peered":"2026-02-20T03:14:38.311289+0000","last_clean":"2026-02-20T03:14:38.311289+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:14:38.311289+0000","last_undegraded":"2026-02-20T03:14:38.311289+0000","last_fullsized":"2026-02-20T03:14:38.311289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744096+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:14:38.744096+0000","last_peered":"2026-02-20T03:14:38.744096+0000","last_clean":"2026-02-20T03:14:38.744096+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:14:38.744096+0000","last_undegraded":"2026-02-20T03:14:38.744096+0000","last_fullsized":"2026-02-20T03:14:38.744096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093417+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:26.093417+0000","last_peered":"2026-02-20T03:15:26.093417+0000","last_clean":"2026-02-20T03:15:26.093417+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:26.093417+0000","last_undegraded":"2026-02-20T03:15:26.093417+0000","last_fullsized":"2026-02-20T03:15:26.093417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742612+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:14:38.742612+0000","last_peered":"2026-02-20T03:14:38.742612+0000","last_clean":"2026-02-20T03:14:38.742612+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:14:38.742612+0000","last_undegraded":"2026-02-20T03:14:38.742612+0000","last_fullsized":"2026-02-20T03:14:38.742612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744492+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:14:38.744492+0000","last_peered":"2026-02-20T03:14:38.744492+0000","last_clean":"2026-02-20T03:14:38.744492+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:14:38.744492+0000","last_undegraded":"2026-02-20T03:14:38.744492+0000","last_fullsized":"2026-02-20T03:14:38.744492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097561+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:26.097561+0000","last_peered":"2026-02-20T03:15:26.097561+0000","last_clean":"2026-02-20T03:15:26.097561+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:26.097561+0000","last_undegraded":"2026-02-20T03:15:26.097561+0000","last_fullsized":"2026-02-20T03:15:26.097561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088395+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:26.088395+0000","last_peered":"2026-02-20T03:15:26.088395+0000","last_clean":"2026-02-20T03:15:26.088395+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:26.088395+0000","last_undegraded":"2026-02-20T03:15:26.088395+0000","last_fullsized":"2026-02-20T03:15:26.088395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088313+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:26.088313+0000","last_peered":"2026-02-20T03:15:26.088313+0000","last_clean":"2026-02-20T03:15:26.088313+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:26.088313+0000","last_undegraded":"2026-02-20T03:15:26.088313+0000","last_fullsized":"2026-02-20T03:15:26.088313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311264+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:14:38.311264+0000","last_peered":"2026-02-20T03:14:38.311264+0000","last_clean":"2026-02-20T03:14:38.311264+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:14:38.311264+0000","last_undegraded":"2026-02-20T03:14:38.311264+0000","last_fullsized":"2026-02-20T03:14:38.311264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318524+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:14:38.318524+0000","last_peered":"2026-02-20T03:14:38.318524+0000","last_clean":"2026-02-20T03:14:38.318524+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:14:38.318524+0000","last_undegraded":"2026-02-20T03:14:38.318524+0000","last_fullsized":"2026-02-20T03:14:38.318524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479875+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:14:38.479875+0000","last_peered":"2026-02-20T03:14:38.479875+0000","last_clean":"2026-02-20T03:14:38.479875+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:14:38.479875+0000","last_undegraded":"2026-02-20T03:14:38.479875+0000","last_fullsized":"2026-02-20T03:14:38.479875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.749677+0000","last_change":"2026-02-20T03:15:26.098509+0000","last_active":"2026-02-20T03:15:26.098509+0000","last_peered":"2026-02-20T03:14:38.749677+0000","last_clean":"2026-02-20T03:14:38.749677+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749677+0000","last_undegraded":"2026-02-20T03:14:38.749677+0000","last_fullsized":"2026-02-20T03:14:38.749677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742670+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:14:38.742670+0000","last_peered":"2026-02-20T03:14:38.742670+0000","last_clean":"2026-02-20T03:14:38.742670+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:14:38.742670+0000","last_undegraded":"2026-02-20T03:14:38.742670+0000","last_fullsized":"2026-02-20T03:14:38.742670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318097+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:14:38.318097+0000","last_peered":"2026-02-20T03:14:38.318097+0000","last_clean":"2026-02-20T03:14:38.318097+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:14:38.318097+0000","last_undegraded":"2026-02-20T03:14:38.318097+0000","last_fullsized":"2026-02-20T03:14:38.318097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479297+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:14:38.479297+0000","last_peered":"2026-02-20T03:14:38.479297+0000","last_clean":"2026-02-20T03:14:38.479297+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:14:38.479297+0000","last_undegraded":"2026-02-20T03:14:38.479297+0000","last_fullsized":"2026-02-20T03:14:38.479297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743970+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:14:38.743970+0000","last_peered":"2026-02-20T03:14:38.743970+0000","last_clean":"2026-02-20T03:14:38.743970+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:14:38.743970+0000","last_undegraded":"2026-02-20T03:14:38.743970+0000","last_fullsized":"2026-02-20T03:14:38.743970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088720+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:26.088720+0000","last_peered":"2026-02-20T03:15:26.088720+0000","last_clean":"2026-02-20T03:15:26.088720+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:26.088720+0000","last_undegraded":"2026-02-20T03:15:26.088720+0000","last_fullsized":"2026-02-20T03:15:26.088720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088833+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:26.088833+0000","last_peered":"2026-02-20T03:15:26.088833+0000","last_clean":"2026-02-20T03:15:26.088833+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:26.088833+0000","last_undegraded":"2026-02-20T03:15:26.088833+0000","last_fullsized":"2026-02-20T03:15:26.088833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744466+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:14:38.744466+0000","last_peered":"2026-02-20T03:14:38.744466+0000","last_clean":"2026-02-20T03:14:38.744466+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:14:38.744466+0000","last_undegraded":"2026-02-20T03:14:38.744466+0000","last_fullsized":"2026-02-20T03:14:38.744466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73366,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":223,"num_read_kb":188,"num_write":166,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":220404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383696,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971104,"statfs":{"total":751619276800,"available":751586410496,"internally_reserved":0,"allocated":995328,"data_stored":484050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612626,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32776,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970424,"statfs":{"total":751619276800,"available":751585714176,"internally_reserved":0,"allocated":1691648,"data_stored":1140738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776148,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":488382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037782,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32112,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971088,"statfs":{"total":751619276800,"available":751586394112,"internally_reserved":0,"allocated":1011712,"data_stored":484206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299416,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32692,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970508,"statfs":{"total":751619276800,"available":751585800192,"internally_reserved":0,"allocated":1605632,"data_stored":1080116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462938,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":479452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724573,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28540,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974660,"statfs":{"total":751619276800,"available":751590051840,"internally_reserved":0,"allocated":1613824,"data_stored":1075312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888095,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971096,"statfs":{"total":751619276800,"available":751586402304,"internally_reserved":0,"allocated":1003520,"data_stored":484494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149729,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27944,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975256,"statfs":{"total":751619276800,"available":751590662144,"internally_reserved":0,"allocated":1003520,"data_stored":479646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378660,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28048,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975152,"statfs":{"total":751619276800,"available":751590555648,"internally_reserved":0,"allocated":1105920,"data_stored":559896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28004,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975196,"statfs":{"total":751619276800,"available":751590600704,"internally_reserved":0,"allocated":1064960,"data_stored":548696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":480860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:27.290 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T03:15:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: pgmap v199: 129 pgs: 129 active+clean; 648 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-20T03:15:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-20T03:15:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-20T03:15:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2026-02-20T03:15:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2026-02-20T03:15:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2026-02-20T03:15:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7, 3, 6]}]': finished 2026-02-20T03:15:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2026-02-20T03:15:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2026-02-20T03:15:27.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2026-02-20T03:15:27.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: osdmap e90: 12 total, 12 up, 12 in 2026-02-20T03:15:27.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2192855368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2026-02-20T03:15:27.350 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:27 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2734073051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:27.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.448+0000 7fe6a091a640 1 -- 10.20.193.28:0/3209787742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c10a930 msgr2=0x7fe69c111250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.448+0000 7fe6a091a640 1 --2- 10.20.193.28:0/3209787742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c10a930 0x7fe69c111250 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe68c00b0a0 tx=0x7fe68c02f3f0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.448+0000 7fe6a091a640 1 -- 10.20.193.28:0/3209787742 shutdown_connections 2026-02-20T03:15:27.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.448+0000 7fe6a091a640 1 --2- 10.20.193.28:0/3209787742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c10a930 0x7fe69c111250 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.448+0000 7fe6a091a640 1 --2- 10.20.193.28:0/3209787742 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe69c109f70 0x7fe69c10a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.448+0000 7fe6a091a640 1 --2- 10.20.193.28:0/3209787742 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe69c108e20 0x7fe69c109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.448+0000 7fe6a091a640 1 -- 10.20.193.28:0/3209787742 >> 10.20.193.28:0/3209787742 conn(0x7fe69c077e70 msgr2=0x7fe69c07a290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:27.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.448+0000 7fe6a091a640 1 -- 10.20.193.28:0/3209787742 shutdown_connections 2026-02-20T03:15:27.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.448+0000 7fe6a091a640 1 -- 10.20.193.28:0/3209787742 wait complete. 2026-02-20T03:15:27.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe6a091a640 1 Processor -- start 2026-02-20T03:15:27.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe6a091a640 1 -- start start 2026-02-20T03:15:27.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe6a091a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c108e20 0x7fe69c1a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe6a091a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe69c109f70 0x7fe69c1a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe6a091a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe69c10a930 0x7fe69c1a8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe6a091a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c114930 con 0x7fe69c108e20 2026-02-20T03:15:27.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe6a091a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c1147b0 con 0x7fe69c109f70 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe6a091a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe69c114ab0 con 0x7fe69c10a930 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe69ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c108e20 0x7fe69c1a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe69ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c108e20 0x7fe69c1a0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33670/0 (socket says 10.20.193.28:33670) 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe69ad76640 1 -- 10.20.193.28:0/2038298921 learned_addr learned my addr 10.20.193.28:0/2038298921 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe69a575640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe69c109f70 0x7fe69c1a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.449+0000 7fe69b577640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe69c10a930 0x7fe69c1a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe69ad76640 1 -- 10.20.193.28:0/2038298921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe69c10a930 msgr2=0x7fe69c1a8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe69ad76640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe69c10a930 0x7fe69c1a8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe69ad76640 1 -- 10.20.193.28:0/2038298921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe69c109f70 msgr2=0x7fe69c1a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe69ad76640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe69c109f70 0x7fe69c1a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe69ad76640 1 -- 10.20.193.28:0/2038298921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69c1a8b10 con 0x7fe69c108e20 2026-02-20T03:15:27.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe69ad76640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c108e20 0x7fe69c1a0e60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe69000d950 tx=0x7fe69000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:27.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe67bfff640 1 -- 10.20.193.28:0/2038298921 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690014070 con 0x7fe69c108e20 2026-02-20T03:15:27.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe67bfff640 1 -- 10.20.193.28:0/2038298921 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe6900044e0 con 0x7fe69c108e20 2026-02-20T03:15:27.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe67bfff640 1 -- 10.20.193.28:0/2038298921 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690010460 con 0x7fe69c108e20 2026-02-20T03:15:27.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69c1a8e00 con 0x7fe69c108e20 2026-02-20T03:15:27.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.450+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69c1a9260 con 0x7fe69c108e20 2026-02-20T03:15:27.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.451+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe69c10fba0 con 0x7fe69c108e20 2026-02-20T03:15:27.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.453+0000 7fe67bfff640 1 -- 10.20.193.28:0/2038298921 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fe6900026e0 con 0x7fe69c108e20 2026-02-20T03:15:27.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.454+0000 7fe67bfff640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe6700b0e30 0x7fe6700b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.454+0000 7fe67bfff640 1 -- 10.20.193.28:0/2038298921 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fe6900e0de0 con 0x7fe69c108e20 2026-02-20T03:15:27.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.454+0000 7fe69a575640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe6700b0e30 0x7fe6700b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.454+0000 7fe67bfff640 1 -- 10.20.193.28:0/2038298921 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe6900e1300 con 0x7fe69c108e20 2026-02-20T03:15:27.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.455+0000 7fe69a575640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe6700b0e30 0x7fe6700b32f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe684005fd0 tx=0x7fe684004380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: pgmap v199: 129 pgs: 129 active+clean; 648 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-20T03:15:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-20T03:15:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2026-02-20T03:15:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2026-02-20T03:15:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2026-02-20T03:15:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2026-02-20T03:15:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 7, 3, 6]}]': finished 2026-02-20T03:15:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2026-02-20T03:15:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2026-02-20T03:15:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 6]}]': finished 2026-02-20T03:15:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: osdmap e90: 12 total, 12 up, 12 in 2026-02-20T03:15:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2192855368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2026-02-20T03:15:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:27 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2734073051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:27.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.545+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe69c0630c0 con 0x7fe6700b0e30 2026-02-20T03:15:27.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.550+0000 7fe67bfff640 1 -- 10.20.193.28:0/2038298921 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340232 (secure 0 0 0) 0x7fe69c0630c0 con 0x7fe6700b0e30 2026-02-20T03:15:27.556 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:27.558 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:27.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe6700b0e30 msgr2=0x7fe6700b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe6700b0e30 0x7fe6700b32f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe684005fd0 tx=0x7fe684004380 comp rx=0 tx=0).stop 2026-02-20T03:15:27.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c108e20 msgr2=0x7fe69c1a0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c108e20 0x7fe69c1a0e60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe69000d950 tx=0x7fe69000de20 comp rx=0 tx=0).stop 2026-02-20T03:15:27.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 shutdown_connections 2026-02-20T03:15:27.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe6700b0e30 0x7fe6700b32f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe69c10a930 0x7fe69c1a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe69c109f70 0x7fe69c1a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 --2- 10.20.193.28:0/2038298921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe69c108e20 0x7fe69c1a0e60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 >> 10.20.193.28:0/2038298921 conn(0x7fe69c077e70 msgr2=0x7fe69c10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:27.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.552+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 shutdown_connections 2026-02-20T03:15:27.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.553+0000 7fe6a091a640 1 -- 10.20.193.28:0/2038298921 wait complete. 2026-02-20T03:15:27.567 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2026-02-20T03:15:27.088550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663968,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":329,"num_read_kb":279,"num_write":357,"num_write_kb":3843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":297,"ondisk_log_size":297,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358160,"kb_used_data":13788,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807680240,"statfs":{"total":9019431321600,"available":9019064565760,"internally_reserved":0,"allocated":14118912,"data_stored":7785848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1978,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.080863"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.357986+0000","last_change":"2026-02-20T03:14:32.081180+0000","last_active":"2026-02-20T03:14:51.357986+0000","last_peered":"2026-02-20T03:14:51.357986+0000","last_clean":"2026-02-20T03:14:51.357986+0000","last_became_active":"2026-02-20T03:14:32.081083+0000","last_became_peered":"2026-02-20T03:14:32.081083+0000","last_unstale":"2026-02-20T03:14:51.357986+0000","last_undegraded":"2026-02-20T03:14:51.357986+0000","last_fullsized":"2026-02-20T03:14:51.357986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:23:16.897948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743323+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:14:38.743323+0000","last_peered":"2026-02-20T03:14:38.743323+0000","last_clean":"2026-02-20T03:14:38.743323+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:14:38.743323+0000","last_undegraded":"2026-02-20T03:14:38.743323+0000","last_fullsized":"2026-02-20T03:14:38.743323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092834+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:26.092834+0000","last_peered":"2026-02-20T03:15:26.092834+0000","last_clean":"2026-02-20T03:15:26.092834+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:26.092834+0000","last_undegraded":"2026-02-20T03:15:26.092834+0000","last_fullsized":"2026-02-20T03:15:26.092834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743404+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:14:38.743404+0000","last_peered":"2026-02-20T03:14:38.743404+0000","last_clean":"2026-02-20T03:14:38.743404+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:14:38.743404+0000","last_undegraded":"2026-02-20T03:14:38.743404+0000","last_fullsized":"2026-02-20T03:14:38.743404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089055+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:26.089055+0000","last_peered":"2026-02-20T03:15:26.089055+0000","last_clean":"2026-02-20T03:15:26.089055+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:26.089055+0000","last_undegraded":"2026-02-20T03:15:26.089055+0000","last_fullsized":"2026-02-20T03:15:26.089055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356040+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:14:51.356040+0000","last_peered":"2026-02-20T03:14:51.356040+0000","last_clean":"2026-02-20T03:14:51.356040+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:14:51.356040+0000","last_undegraded":"2026-02-20T03:14:51.356040+0000","last_fullsized":"2026-02-20T03:14:51.356040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098104+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:26.098104+0000","last_peered":"2026-02-20T03:15:26.098104+0000","last_clean":"2026-02-20T03:15:26.098104+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:26.098104+0000","last_undegraded":"2026-02-20T03:15:26.098104+0000","last_fullsized":"2026-02-20T03:15:26.098104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744316+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:14:38.744316+0000","last_peered":"2026-02-20T03:14:38.744316+0000","last_clean":"2026-02-20T03:14:38.744316+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:14:38.744316+0000","last_undegraded":"2026-02-20T03:14:38.744316+0000","last_fullsized":"2026-02-20T03:14:38.744316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744230+0000","last_change":"2026-02-20T03:14:33.291255+0000","last_active":"2026-02-20T03:14:38.744230+0000","last_peered":"2026-02-20T03:14:38.744230+0000","last_clean":"2026-02-20T03:14:38.744230+0000","last_became_active":"2026-02-20T03:14:33.291089+0000","last_became_peered":"2026-02-20T03:14:33.291089+0000","last_unstale":"2026-02-20T03:14:38.744230+0000","last_undegraded":"2026-02-20T03:14:38.744230+0000","last_fullsized":"2026-02-20T03:14:38.744230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:42:45.321761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318208+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:14:38.318208+0000","last_peered":"2026-02-20T03:14:38.318208+0000","last_clean":"2026-02-20T03:14:38.318208+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:14:38.318208+0000","last_undegraded":"2026-02-20T03:14:38.318208+0000","last_fullsized":"2026-02-20T03:14:38.318208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351492+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:14:50.351492+0000","last_peered":"2026-02-20T03:14:50.351492+0000","last_clean":"2026-02-20T03:14:50.351492+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:14:50.351492+0000","last_undegraded":"2026-02-20T03:14:50.351492+0000","last_fullsized":"2026-02-20T03:14:50.351492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742908+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:14:38.742908+0000","last_peered":"2026-02-20T03:14:38.742908+0000","last_clean":"2026-02-20T03:14:38.742908+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:14:38.742908+0000","last_undegraded":"2026-02-20T03:14:38.742908+0000","last_fullsized":"2026-02-20T03:14:38.742908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093043+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:26.093043+0000","last_peered":"2026-02-20T03:15:26.093043+0000","last_clean":"2026-02-20T03:15:26.093043+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:26.093043+0000","last_undegraded":"2026-02-20T03:15:26.093043+0000","last_fullsized":"2026-02-20T03:15:26.093043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:40.062667+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:40.062667+0000","last_peered":"2026-02-20T03:14:40.062667+0000","last_clean":"2026-02-20T03:14:40.062667+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:40.062667+0000","last_undegraded":"2026-02-20T03:14:40.062667+0000","last_fullsized":"2026-02-20T03:14:40.062667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743910+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:14:38.743910+0000","last_peered":"2026-02-20T03:14:38.743910+0000","last_clean":"2026-02-20T03:14:38.743910+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:14:38.743910+0000","last_undegraded":"2026-02-20T03:14:38.743910+0000","last_fullsized":"2026-02-20T03:14:38.743910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351649+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:14:50.351649+0000","last_peered":"2026-02-20T03:14:50.351649+0000","last_clean":"2026-02-20T03:14:50.351649+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:14:50.351649+0000","last_undegraded":"2026-02-20T03:14:50.351649+0000","last_fullsized":"2026-02-20T03:14:50.351649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742825+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:14:38.742825+0000","last_peered":"2026-02-20T03:14:38.742825+0000","last_clean":"2026-02-20T03:14:38.742825+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:14:38.742825+0000","last_undegraded":"2026-02-20T03:14:38.742825+0000","last_fullsized":"2026-02-20T03:14:38.742825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743900+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:14:38.743900+0000","last_peered":"2026-02-20T03:14:38.743900+0000","last_clean":"2026-02-20T03:14:38.743900+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:14:38.743900+0000","last_undegraded":"2026-02-20T03:14:38.743900+0000","last_fullsized":"2026-02-20T03:14:38.743900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:50.357549+0000","last_change":"2026-02-20T03:15:26.097400+0000","last_active":"2026-02-20T03:15:26.097400+0000","last_peered":"2026-02-20T03:14:50.357549+0000","last_clean":"2026-02-20T03:14:50.357549+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357549+0000","last_undegraded":"2026-02-20T03:14:50.357549+0000","last_fullsized":"2026-02-20T03:14:50.357549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.311982+0000","last_change":"2026-02-20T03:15:26.089098+0000","last_active":"2026-02-20T03:15:26.089098+0000","last_peered":"2026-02-20T03:14:38.311982+0000","last_clean":"2026-02-20T03:14:38.311982+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311982+0000","last_undegraded":"2026-02-20T03:14:38.311982+0000","last_fullsized":"2026-02-20T03:14:38.311982+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,6,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092967+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:26.092967+0000","last_peered":"2026-02-20T03:15:26.092967+0000","last_clean":"2026-02-20T03:15:26.092967+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:26.092967+0000","last_undegraded":"2026-02-20T03:15:26.092967+0000","last_fullsized":"2026-02-20T03:15:26.092967+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743028+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:14:38.743028+0000","last_peered":"2026-02-20T03:14:38.743028+0000","last_clean":"2026-02-20T03:14:38.743028+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:14:38.743028+0000","last_undegraded":"2026-02-20T03:14:38.743028+0000","last_fullsized":"2026-02-20T03:14:38.743028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:00.293338+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:00.293338+0000","last_peered":"2026-02-20T03:15:00.293338+0000","last_clean":"2026-02-20T03:15:00.293338+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:00.293338+0000","last_undegraded":"2026-02-20T03:15:00.293338+0000","last_fullsized":"2026-02-20T03:15:00.293338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742399+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:14:38.742399+0000","last_peered":"2026-02-20T03:14:38.742399+0000","last_clean":"2026-02-20T03:14:38.742399+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:14:38.742399+0000","last_undegraded":"2026-02-20T03:14:38.742399+0000","last_fullsized":"2026-02-20T03:14:38.742399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311146+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:14:38.311146+0000","last_peered":"2026-02-20T03:14:38.311146+0000","last_clean":"2026-02-20T03:14:38.311146+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:14:38.311146+0000","last_undegraded":"2026-02-20T03:14:38.311146+0000","last_fullsized":"2026-02-20T03:14:38.311146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352941+0000","last_change":"2026-02-20T03:14:32.081021+0000","last_active":"2026-02-20T03:14:50.352941+0000","last_peered":"2026-02-20T03:14:50.352941+0000","last_clean":"2026-02-20T03:14:50.352941+0000","last_became_active":"2026-02-20T03:14:32.080799+0000","last_became_peered":"2026-02-20T03:14:32.080799+0000","last_unstale":"2026-02-20T03:14:50.352941+0000","last_undegraded":"2026-02-20T03:14:50.352941+0000","last_fullsized":"2026-02-20T03:14:50.352941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:15.834880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744093+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:14:38.744093+0000","last_peered":"2026-02-20T03:14:38.744093+0000","last_clean":"2026-02-20T03:14:38.744093+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:14:38.744093+0000","last_undegraded":"2026-02-20T03:14:38.744093+0000","last_fullsized":"2026-02-20T03:14:38.744093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479703+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:14:38.479703+0000","last_peered":"2026-02-20T03:14:38.479703+0000","last_clean":"2026-02-20T03:14:38.479703+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:14:38.479703+0000","last_undegraded":"2026-02-20T03:14:38.479703+0000","last_fullsized":"2026-02-20T03:14:38.479703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742701+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:14:38.742701+0000","last_peered":"2026-02-20T03:14:38.742701+0000","last_clean":"2026-02-20T03:14:38.742701+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:14:38.742701+0000","last_undegraded":"2026-02-20T03:14:38.742701+0000","last_fullsized":"2026-02-20T03:14:38.742701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744036+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:14:38.744036+0000","last_peered":"2026-02-20T03:14:38.744036+0000","last_clean":"2026-02-20T03:14:38.744036+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:14:38.744036+0000","last_undegraded":"2026-02-20T03:14:38.744036+0000","last_fullsized":"2026-02-20T03:14:38.744036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479538+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:14:38.479538+0000","last_peered":"2026-02-20T03:14:38.479538+0000","last_clean":"2026-02-20T03:14:38.479538+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:14:38.479538+0000","last_undegraded":"2026-02-20T03:14:38.479538+0000","last_fullsized":"2026-02-20T03:14:38.479538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318364+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:14:38.318364+0000","last_peered":"2026-02-20T03:14:38.318364+0000","last_clean":"2026-02-20T03:14:38.318364+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:14:38.318364+0000","last_undegraded":"2026-02-20T03:14:38.318364+0000","last_fullsized":"2026-02-20T03:14:38.318364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311210+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:14:38.311210+0000","last_peered":"2026-02-20T03:14:38.311210+0000","last_clean":"2026-02-20T03:14:38.311210+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:14:38.311210+0000","last_undegraded":"2026-02-20T03:14:38.311210+0000","last_fullsized":"2026-02-20T03:14:38.311210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.290483+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.289779+0000","last_became_peered":"2026-02-20T03:14:33.289779+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:45:10.985058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:21.379484+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:21.379484+0000","last_peered":"2026-02-20T03:15:21.379484+0000","last_clean":"2026-02-20T03:15:21.379484+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:21.379484+0000","last_undegraded":"2026-02-20T03:15:21.379484+0000","last_fullsized":"2026-02-20T03:15:21.379484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311164+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:14:38.311164+0000","last_peered":"2026-02-20T03:14:38.311164+0000","last_clean":"2026-02-20T03:14:38.311164+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:14:38.311164+0000","last_undegraded":"2026-02-20T03:14:38.311164+0000","last_fullsized":"2026-02-20T03:14:38.311164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.310925+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:14:38.310925+0000","last_peered":"2026-02-20T03:14:38.310925+0000","last_clean":"2026-02-20T03:14:38.310925+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:14:38.310925+0000","last_undegraded":"2026-02-20T03:14:38.310925+0000","last_fullsized":"2026-02-20T03:14:38.310925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.360846+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:14:51.360846+0000","last_peered":"2026-02-20T03:14:51.360846+0000","last_clean":"2026-02-20T03:14:51.360846+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:14:51.360846+0000","last_undegraded":"2026-02-20T03:14:51.360846+0000","last_fullsized":"2026-02-20T03:14:51.360846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744423+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:14:38.744423+0000","last_peered":"2026-02-20T03:14:38.744423+0000","last_clean":"2026-02-20T03:14:38.744423+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:14:38.744423+0000","last_undegraded":"2026-02-20T03:14:38.744423+0000","last_fullsized":"2026-02-20T03:14:38.744423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743435+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:14:38.743435+0000","last_peered":"2026-02-20T03:14:38.743435+0000","last_clean":"2026-02-20T03:14:38.743435+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:14:38.743435+0000","last_undegraded":"2026-02-20T03:14:38.743435+0000","last_fullsized":"2026-02-20T03:14:38.743435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318242+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:14:38.318242+0000","last_peered":"2026-02-20T03:14:38.318242+0000","last_clean":"2026-02-20T03:14:38.318242+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:14:38.318242+0000","last_undegraded":"2026-02-20T03:14:38.318242+0000","last_fullsized":"2026-02-20T03:14:38.318242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318423+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:14:38.318423+0000","last_peered":"2026-02-20T03:14:38.318423+0000","last_clean":"2026-02-20T03:14:38.318423+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:14:38.318423+0000","last_undegraded":"2026-02-20T03:14:38.318423+0000","last_fullsized":"2026-02-20T03:14:38.318423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318536+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:14:38.318536+0000","last_peered":"2026-02-20T03:14:38.318536+0000","last_clean":"2026-02-20T03:14:38.318536+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:14:38.318536+0000","last_undegraded":"2026-02-20T03:14:38.318536+0000","last_fullsized":"2026-02-20T03:14:38.318536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2026-02-20T03:14:38.744446+0000","last_change":"2026-02-20T03:15:26.460325+0000","last_active":"2026-02-20T03:15:26.460325+0000","last_peered":"2026-02-20T03:14:38.744446+0000","last_clean":"2026-02-20T03:14:38.744446+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:38.744446+0000","last_undegraded":"2026-02-20T03:14:38.744446+0000","last_fullsized":"2026-02-20T03:14:38.744446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097649+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:26.097649+0000","last_peered":"2026-02-20T03:15:26.097649+0000","last_clean":"2026-02-20T03:15:26.097649+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:26.097649+0000","last_undegraded":"2026-02-20T03:15:26.097649+0000","last_fullsized":"2026-02-20T03:15:26.097649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318340+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:14:38.318340+0000","last_peered":"2026-02-20T03:14:38.318340+0000","last_clean":"2026-02-20T03:14:38.318340+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:14:38.318340+0000","last_undegraded":"2026-02-20T03:14:38.318340+0000","last_fullsized":"2026-02-20T03:14:38.318340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744433+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:14:38.744433+0000","last_peered":"2026-02-20T03:14:38.744433+0000","last_clean":"2026-02-20T03:14:38.744433+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:14:38.744433+0000","last_undegraded":"2026-02-20T03:14:38.744433+0000","last_fullsized":"2026-02-20T03:14:38.744433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088541+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:26.088541+0000","last_peered":"2026-02-20T03:15:26.088541+0000","last_clean":"2026-02-20T03:15:26.088541+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:26.088541+0000","last_undegraded":"2026-02-20T03:15:26.088541+0000","last_fullsized":"2026-02-20T03:15:26.088541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318490+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:14:38.318490+0000","last_peered":"2026-02-20T03:14:38.318490+0000","last_clean":"2026-02-20T03:14:38.318490+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:14:38.318490+0000","last_undegraded":"2026-02-20T03:14:38.318490+0000","last_fullsized":"2026-02-20T03:14:38.318490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311359+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:14:38.311359+0000","last_peered":"2026-02-20T03:14:38.311359+0000","last_clean":"2026-02-20T03:14:38.311359+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:14:38.311359+0000","last_undegraded":"2026-02-20T03:14:38.311359+0000","last_fullsized":"2026-02-20T03:14:38.311359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743916+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:14:38.743916+0000","last_peered":"2026-02-20T03:14:38.743916+0000","last_clean":"2026-02-20T03:14:38.743916+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:14:38.743916+0000","last_undegraded":"2026-02-20T03:14:38.743916+0000","last_fullsized":"2026-02-20T03:14:38.743916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744369+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:14:38.744369+0000","last_peered":"2026-02-20T03:14:38.744369+0000","last_clean":"2026-02-20T03:14:38.744369+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:14:38.744369+0000","last_undegraded":"2026-02-20T03:14:38.744369+0000","last_fullsized":"2026-02-20T03:14:38.744369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.359869+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:14:52.359869+0000","last_peered":"2026-02-20T03:14:52.359869+0000","last_clean":"2026-02-20T03:14:52.359869+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:14:52.359869+0000","last_undegraded":"2026-02-20T03:14:52.359869+0000","last_fullsized":"2026-02-20T03:14:52.359869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744027+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:14:38.744027+0000","last_peered":"2026-02-20T03:14:38.744027+0000","last_clean":"2026-02-20T03:14:38.744027+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:14:38.744027+0000","last_undegraded":"2026-02-20T03:14:38.744027+0000","last_fullsized":"2026-02-20T03:14:38.744027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743990+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:14:38.743990+0000","last_peered":"2026-02-20T03:14:38.743990+0000","last_clean":"2026-02-20T03:14:38.743990+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:14:38.743990+0000","last_undegraded":"2026-02-20T03:14:38.743990+0000","last_fullsized":"2026-02-20T03:14:38.743990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358752+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:14:51.358752+0000","last_peered":"2026-02-20T03:14:51.358752+0000","last_clean":"2026-02-20T03:14:51.358752+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:14:51.358752+0000","last_undegraded":"2026-02-20T03:14:51.358752+0000","last_fullsized":"2026-02-20T03:14:51.358752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311328+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:14:38.311328+0000","last_peered":"2026-02-20T03:14:38.311328+0000","last_clean":"2026-02-20T03:14:38.311328+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:14:38.311328+0000","last_undegraded":"2026-02-20T03:14:38.311328+0000","last_fullsized":"2026-02-20T03:14:38.311328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318042+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:14:38.318042+0000","last_peered":"2026-02-20T03:14:38.318042+0000","last_clean":"2026-02-20T03:14:38.318042+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:14:38.318042+0000","last_undegraded":"2026-02-20T03:14:38.318042+0000","last_fullsized":"2026-02-20T03:14:38.318042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:23.388416+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:23.388416+0000","last_peered":"2026-02-20T03:15:23.388416+0000","last_clean":"2026-02-20T03:15:23.388416+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:23.388416+0000","last_undegraded":"2026-02-20T03:15:23.388416+0000","last_fullsized":"2026-02-20T03:15:23.388416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743149+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:14:38.743149+0000","last_peered":"2026-02-20T03:14:38.743149+0000","last_clean":"2026-02-20T03:14:38.743149+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:14:38.743149+0000","last_undegraded":"2026-02-20T03:14:38.743149+0000","last_fullsized":"2026-02-20T03:14:38.743149+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318241+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:14:38.318241+0000","last_peered":"2026-02-20T03:14:38.318241+0000","last_clean":"2026-02-20T03:14:38.318241+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:14:38.318241+0000","last_undegraded":"2026-02-20T03:14:38.318241+0000","last_fullsized":"2026-02-20T03:14:38.318241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352270+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:14:50.352270+0000","last_peered":"2026-02-20T03:14:50.352270+0000","last_clean":"2026-02-20T03:14:50.352270+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:14:50.352270+0000","last_undegraded":"2026-02-20T03:14:50.352270+0000","last_fullsized":"2026-02-20T03:14:50.352270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744179+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:14:38.744179+0000","last_peered":"2026-02-20T03:14:38.744179+0000","last_clean":"2026-02-20T03:14:38.744179+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:14:38.744179+0000","last_undegraded":"2026-02-20T03:14:38.744179+0000","last_fullsized":"2026-02-20T03:14:38.744179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311740+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:14:38.311740+0000","last_peered":"2026-02-20T03:14:38.311740+0000","last_clean":"2026-02-20T03:14:38.311740+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:14:38.311740+0000","last_undegraded":"2026-02-20T03:14:38.311740+0000","last_fullsized":"2026-02-20T03:14:38.311740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093258+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:26.093258+0000","last_peered":"2026-02-20T03:15:26.093258+0000","last_clean":"2026-02-20T03:15:26.093258+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:26.093258+0000","last_undegraded":"2026-02-20T03:15:26.093258+0000","last_fullsized":"2026-02-20T03:15:26.093258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744303+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:14:38.744303+0000","last_peered":"2026-02-20T03:14:38.744303+0000","last_clean":"2026-02-20T03:14:38.744303+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:14:38.744303+0000","last_undegraded":"2026-02-20T03:14:38.744303+0000","last_fullsized":"2026-02-20T03:14:38.744303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744191+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:14:38.744191+0000","last_peered":"2026-02-20T03:14:38.744191+0000","last_clean":"2026-02-20T03:14:38.744191+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:14:38.744191+0000","last_undegraded":"2026-02-20T03:14:38.744191+0000","last_fullsized":"2026-02-20T03:14:38.744191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:24.392752+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:24.392752+0000","last_peered":"2026-02-20T03:15:24.392752+0000","last_clean":"2026-02-20T03:15:24.392752+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:24.392752+0000","last_undegraded":"2026-02-20T03:15:24.392752+0000","last_fullsized":"2026-02-20T03:15:24.392752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69334,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":76,"num_read_kb":106,"num_write":34,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742256+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:14:38.742256+0000","last_peered":"2026-02-20T03:14:38.742256+0000","last_clean":"2026-02-20T03:14:38.742256+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:14:38.742256+0000","last_undegraded":"2026-02-20T03:14:38.742256+0000","last_fullsized":"2026-02-20T03:14:38.742256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098166+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:26.098166+0000","last_peered":"2026-02-20T03:15:26.098166+0000","last_clean":"2026-02-20T03:15:26.098166+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:26.098166+0000","last_undegraded":"2026-02-20T03:15:26.098166+0000","last_fullsized":"2026-02-20T03:15:26.098166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352990+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:14:50.352990+0000","last_peered":"2026-02-20T03:14:50.352990+0000","last_clean":"2026-02-20T03:14:50.352990+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:14:50.352990+0000","last_undegraded":"2026-02-20T03:14:50.352990+0000","last_fullsized":"2026-02-20T03:14:50.352990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089065+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:26.089065+0000","last_peered":"2026-02-20T03:15:26.089065+0000","last_clean":"2026-02-20T03:15:26.089065+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:26.089065+0000","last_undegraded":"2026-02-20T03:15:26.089065+0000","last_fullsized":"2026-02-20T03:15:26.089065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.356807+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:14:50.356807+0000","last_peered":"2026-02-20T03:14:50.356807+0000","last_clean":"2026-02-20T03:14:50.356807+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:14:50.356807+0000","last_undegraded":"2026-02-20T03:14:50.356807+0000","last_fullsized":"2026-02-20T03:14:50.356807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743191+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:14:38.743191+0000","last_peered":"2026-02-20T03:14:38.743191+0000","last_clean":"2026-02-20T03:14:38.743191+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:14:38.743191+0000","last_undegraded":"2026-02-20T03:14:38.743191+0000","last_fullsized":"2026-02-20T03:14:38.743191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098167+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:26.098167+0000","last_peered":"2026-02-20T03:15:26.098167+0000","last_clean":"2026-02-20T03:15:26.098167+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:26.098167+0000","last_undegraded":"2026-02-20T03:15:26.098167+0000","last_fullsized":"2026-02-20T03:15:26.098167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:24.079702+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:24.079702+0000","last_peered":"2026-02-20T03:15:24.079702+0000","last_clean":"2026-02-20T03:15:24.079702+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:24.079702+0000","last_undegraded":"2026-02-20T03:15:24.079702+0000","last_fullsized":"2026-02-20T03:15:24.079702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743127+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:14:38.743127+0000","last_peered":"2026-02-20T03:14:38.743127+0000","last_clean":"2026-02-20T03:14:38.743127+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:14:38.743127+0000","last_undegraded":"2026-02-20T03:14:38.743127+0000","last_fullsized":"2026-02-20T03:14:38.743127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088557+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:26.088557+0000","last_peered":"2026-02-20T03:15:26.088557+0000","last_clean":"2026-02-20T03:15:26.088557+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:26.088557+0000","last_undegraded":"2026-02-20T03:15:26.088557+0000","last_fullsized":"2026-02-20T03:15:26.088557+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742536+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:14:38.742536+0000","last_peered":"2026-02-20T03:14:38.742536+0000","last_clean":"2026-02-20T03:14:38.742536+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:14:38.742536+0000","last_undegraded":"2026-02-20T03:14:38.742536+0000","last_fullsized":"2026-02-20T03:14:38.742536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744067+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:14:38.744067+0000","last_peered":"2026-02-20T03:14:38.744067+0000","last_clean":"2026-02-20T03:14:38.744067+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:14:38.744067+0000","last_undegraded":"2026-02-20T03:14:38.744067+0000","last_fullsized":"2026-02-20T03:14:38.744067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744459+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:14:38.744459+0000","last_peered":"2026-02-20T03:14:38.744459+0000","last_clean":"2026-02-20T03:14:38.744459+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:14:38.744459+0000","last_undegraded":"2026-02-20T03:14:38.744459+0000","last_fullsized":"2026-02-20T03:14:38.744459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742665+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:14:38.742665+0000","last_peered":"2026-02-20T03:14:38.742665+0000","last_clean":"2026-02-20T03:14:38.742665+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:14:38.742665+0000","last_undegraded":"2026-02-20T03:14:38.742665+0000","last_fullsized":"2026-02-20T03:14:38.742665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356776+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:14:51.356776+0000","last_peered":"2026-02-20T03:14:51.356776+0000","last_clean":"2026-02-20T03:14:51.356776+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:14:51.356776+0000","last_undegraded":"2026-02-20T03:14:51.356776+0000","last_fullsized":"2026-02-20T03:14:51.356776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.361797+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:14:51.361797+0000","last_peered":"2026-02-20T03:14:51.361797+0000","last_clean":"2026-02-20T03:14:51.361797+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:14:51.361797+0000","last_undegraded":"2026-02-20T03:14:51.361797+0000","last_fullsized":"2026-02-20T03:14:51.361797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744227+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:14:38.744227+0000","last_peered":"2026-02-20T03:14:38.744227+0000","last_clean":"2026-02-20T03:14:38.744227+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:14:38.744227+0000","last_undegraded":"2026-02-20T03:14:38.744227+0000","last_fullsized":"2026-02-20T03:14:38.744227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093296+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:26.093296+0000","last_peered":"2026-02-20T03:15:26.093296+0000","last_clean":"2026-02-20T03:15:26.093296+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:26.093296+0000","last_undegraded":"2026-02-20T03:15:26.093296+0000","last_fullsized":"2026-02-20T03:15:26.093296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":62,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:22.379029+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:22.379029+0000","last_peered":"2026-02-20T03:15:22.379029+0000","last_clean":"2026-02-20T03:15:22.379029+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:22.379029+0000","last_undegraded":"2026-02-20T03:15:22.379029+0000","last_fullsized":"2026-02-20T03:15:22.379029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744076+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:14:38.744076+0000","last_peered":"2026-02-20T03:14:38.744076+0000","last_clean":"2026-02-20T03:14:38.744076+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:14:38.744076+0000","last_undegraded":"2026-02-20T03:14:38.744076+0000","last_fullsized":"2026-02-20T03:14:38.744076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093320+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:26.093320+0000","last_peered":"2026-02-20T03:15:26.093320+0000","last_clean":"2026-02-20T03:15:26.093320+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:26.093320+0000","last_undegraded":"2026-02-20T03:15:26.093320+0000","last_fullsized":"2026-02-20T03:15:26.093320+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743873+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:14:38.743873+0000","last_peered":"2026-02-20T03:14:38.743873+0000","last_clean":"2026-02-20T03:14:38.743873+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:14:38.743873+0000","last_undegraded":"2026-02-20T03:14:38.743873+0000","last_fullsized":"2026-02-20T03:14:38.743873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093050+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:26.093050+0000","last_peered":"2026-02-20T03:15:26.093050+0000","last_clean":"2026-02-20T03:15:26.093050+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:26.093050+0000","last_undegraded":"2026-02-20T03:15:26.093050+0000","last_fullsized":"2026-02-20T03:15:26.093050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093067+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:26.093067+0000","last_peered":"2026-02-20T03:15:26.093067+0000","last_clean":"2026-02-20T03:15:26.093067+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:26.093067+0000","last_undegraded":"2026-02-20T03:15:26.093067+0000","last_fullsized":"2026-02-20T03:15:26.093067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088712+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:26.088712+0000","last_peered":"2026-02-20T03:15:26.088712+0000","last_clean":"2026-02-20T03:15:26.088712+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:26.088712+0000","last_undegraded":"2026-02-20T03:15:26.088712+0000","last_fullsized":"2026-02-20T03:15:26.088712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311110+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:14:38.311110+0000","last_peered":"2026-02-20T03:14:38.311110+0000","last_clean":"2026-02-20T03:14:38.311110+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:14:38.311110+0000","last_undegraded":"2026-02-20T03:14:38.311110+0000","last_fullsized":"2026-02-20T03:14:38.311110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744275+0000","last_change":"2026-02-20T03:14:33.290769+0000","last_active":"2026-02-20T03:14:38.744275+0000","last_peered":"2026-02-20T03:14:38.744275+0000","last_clean":"2026-02-20T03:14:38.744275+0000","last_became_active":"2026-02-20T03:14:33.290406+0000","last_became_peered":"2026-02-20T03:14:33.290406+0000","last_unstale":"2026-02-20T03:14:38.744275+0000","last_undegraded":"2026-02-20T03:14:38.744275+0000","last_fullsized":"2026-02-20T03:14:38.744275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:58.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093494+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:26.093494+0000","last_peered":"2026-02-20T03:15:26.093494+0000","last_clean":"2026-02-20T03:15:26.093494+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:26.093494+0000","last_undegraded":"2026-02-20T03:15:26.093494+0000","last_fullsized":"2026-02-20T03:15:26.093494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742977+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:14:38.742977+0000","last_peered":"2026-02-20T03:14:38.742977+0000","last_clean":"2026-02-20T03:14:38.742977+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:14:38.742977+0000","last_undegraded":"2026-02-20T03:14:38.742977+0000","last_fullsized":"2026-02-20T03:14:38.742977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743959+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:14:38.743959+0000","last_peered":"2026-02-20T03:14:38.743959+0000","last_clean":"2026-02-20T03:14:38.743959+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:14:38.743959+0000","last_undegraded":"2026-02-20T03:14:38.743959+0000","last_fullsized":"2026-02-20T03:14:38.743959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743157+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:14:38.743157+0000","last_peered":"2026-02-20T03:14:38.743157+0000","last_clean":"2026-02-20T03:14:38.743157+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:14:38.743157+0000","last_undegraded":"2026-02-20T03:14:38.743157+0000","last_fullsized":"2026-02-20T03:14:38.743157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097832+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:26.097832+0000","last_peered":"2026-02-20T03:15:26.097832+0000","last_clean":"2026-02-20T03:15:26.097832+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:26.097832+0000","last_undegraded":"2026-02-20T03:15:26.097832+0000","last_fullsized":"2026-02-20T03:15:26.097832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311289+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:14:38.311289+0000","last_peered":"2026-02-20T03:14:38.311289+0000","last_clean":"2026-02-20T03:14:38.311289+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:14:38.311289+0000","last_undegraded":"2026-02-20T03:14:38.311289+0000","last_fullsized":"2026-02-20T03:14:38.311289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744096+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:14:38.744096+0000","last_peered":"2026-02-20T03:14:38.744096+0000","last_clean":"2026-02-20T03:14:38.744096+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:14:38.744096+0000","last_undegraded":"2026-02-20T03:14:38.744096+0000","last_fullsized":"2026-02-20T03:14:38.744096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093417+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:26.093417+0000","last_peered":"2026-02-20T03:15:26.093417+0000","last_clean":"2026-02-20T03:15:26.093417+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:26.093417+0000","last_undegraded":"2026-02-20T03:15:26.093417+0000","last_fullsized":"2026-02-20T03:15:26.093417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742612+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:14:38.742612+0000","last_peered":"2026-02-20T03:14:38.742612+0000","last_clean":"2026-02-20T03:14:38.742612+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:14:38.742612+0000","last_undegraded":"2026-02-20T03:14:38.742612+0000","last_fullsized":"2026-02-20T03:14:38.742612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744492+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:14:38.744492+0000","last_peered":"2026-02-20T03:14:38.744492+0000","last_clean":"2026-02-20T03:14:38.744492+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:14:38.744492+0000","last_undegraded":"2026-02-20T03:14:38.744492+0000","last_fullsized":"2026-02-20T03:14:38.744492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097561+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:26.097561+0000","last_peered":"2026-02-20T03:15:26.097561+0000","last_clean":"2026-02-20T03:15:26.097561+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:26.097561+0000","last_undegraded":"2026-02-20T03:15:26.097561+0000","last_fullsized":"2026-02-20T03:15:26.097561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088395+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:26.088395+0000","last_peered":"2026-02-20T03:15:26.088395+0000","last_clean":"2026-02-20T03:15:26.088395+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:26.088395+0000","last_undegraded":"2026-02-20T03:15:26.088395+0000","last_fullsized":"2026-02-20T03:15:26.088395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088313+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:26.088313+0000","last_peered":"2026-02-20T03:15:26.088313+0000","last_clean":"2026-02-20T03:15:26.088313+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:26.088313+0000","last_undegraded":"2026-02-20T03:15:26.088313+0000","last_fullsized":"2026-02-20T03:15:26.088313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311264+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:14:38.311264+0000","last_peered":"2026-02-20T03:14:38.311264+0000","last_clean":"2026-02-20T03:14:38.311264+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:14:38.311264+0000","last_undegraded":"2026-02-20T03:14:38.311264+0000","last_fullsized":"2026-02-20T03:14:38.311264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318524+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:14:38.318524+0000","last_peered":"2026-02-20T03:14:38.318524+0000","last_clean":"2026-02-20T03:14:38.318524+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:14:38.318524+0000","last_undegraded":"2026-02-20T03:14:38.318524+0000","last_fullsized":"2026-02-20T03:14:38.318524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479875+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:14:38.479875+0000","last_peered":"2026-02-20T03:14:38.479875+0000","last_clean":"2026-02-20T03:14:38.479875+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:14:38.479875+0000","last_undegraded":"2026-02-20T03:14:38.479875+0000","last_fullsized":"2026-02-20T03:14:38.479875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.749677+0000","last_change":"2026-02-20T03:15:26.098509+0000","last_active":"2026-02-20T03:15:26.098509+0000","last_peered":"2026-02-20T03:14:38.749677+0000","last_clean":"2026-02-20T03:14:38.749677+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749677+0000","last_undegraded":"2026-02-20T03:14:38.749677+0000","last_fullsized":"2026-02-20T03:14:38.749677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742670+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:14:38.742670+0000","last_peered":"2026-02-20T03:14:38.742670+0000","last_clean":"2026-02-20T03:14:38.742670+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:14:38.742670+0000","last_undegraded":"2026-02-20T03:14:38.742670+0000","last_fullsized":"2026-02-20T03:14:38.742670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318097+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:14:38.318097+0000","last_peered":"2026-02-20T03:14:38.318097+0000","last_clean":"2026-02-20T03:14:38.318097+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:14:38.318097+0000","last_undegraded":"2026-02-20T03:14:38.318097+0000","last_fullsized":"2026-02-20T03:14:38.318097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479297+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:14:38.479297+0000","last_peered":"2026-02-20T03:14:38.479297+0000","last_clean":"2026-02-20T03:14:38.479297+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:14:38.479297+0000","last_undegraded":"2026-02-20T03:14:38.479297+0000","last_fullsized":"2026-02-20T03:14:38.479297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743970+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:14:38.743970+0000","last_peered":"2026-02-20T03:14:38.743970+0000","last_clean":"2026-02-20T03:14:38.743970+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:14:38.743970+0000","last_undegraded":"2026-02-20T03:14:38.743970+0000","last_fullsized":"2026-02-20T03:14:38.743970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088720+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:26.088720+0000","last_peered":"2026-02-20T03:15:26.088720+0000","last_clean":"2026-02-20T03:15:26.088720+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:26.088720+0000","last_undegraded":"2026-02-20T03:15:26.088720+0000","last_fullsized":"2026-02-20T03:15:26.088720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088833+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:26.088833+0000","last_peered":"2026-02-20T03:15:26.088833+0000","last_clean":"2026-02-20T03:15:26.088833+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:26.088833+0000","last_undegraded":"2026-02-20T03:15:26.088833+0000","last_fullsized":"2026-02-20T03:15:26.088833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744466+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:14:38.744466+0000","last_peered":"2026-02-20T03:14:38.744466+0000","last_clean":"2026-02-20T03:14:38.744466+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:14:38.744466+0000","last_undegraded":"2026-02-20T03:14:38.744466+0000","last_fullsized":"2026-02-20T03:14:38.744466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73366,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":223,"num_read_kb":188,"num_write":166,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":220404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383696,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971104,"statfs":{"total":751619276800,"available":751586410496,"internally_reserved":0,"allocated":995328,"data_stored":484050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612626,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32776,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970424,"statfs":{"total":751619276800,"available":751585714176,"internally_reserved":0,"allocated":1691648,"data_stored":1140738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776148,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":488382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037782,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32112,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971088,"statfs":{"total":751619276800,"available":751586394112,"internally_reserved":0,"allocated":1011712,"data_stored":484206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299416,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32692,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970508,"statfs":{"total":751619276800,"available":751585800192,"internally_reserved":0,"allocated":1605632,"data_stored":1080116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462938,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":479452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724573,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28540,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974660,"statfs":{"total":751619276800,"available":751590051840,"internally_reserved":0,"allocated":1613824,"data_stored":1075312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888095,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971096,"statfs":{"total":751619276800,"available":751586402304,"internally_reserved":0,"allocated":1003520,"data_stored":484494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149729,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27944,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975256,"statfs":{"total":751619276800,"available":751590662144,"internally_reserved":0,"allocated":1003520,"data_stored":479646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378660,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28048,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975152,"statfs":{"total":751619276800,"available":751590555648,"internally_reserved":0,"allocated":1105920,"data_stored":559896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28004,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975196,"statfs":{"total":751619276800,"available":751590600704,"internally_reserved":0,"allocated":1064960,"data_stored":548696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":480860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:27.576 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T03:15:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 -- 10.20.193.28:0/3168631953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410e540 msgr2=0x7f510410e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 --2- 10.20.193.28:0/3168631953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410e540 0x7f510410e9c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009a30 tx=0x7f50ec02f220 comp rx=0 tx=0).stop 2026-02-20T03:15:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 -- 10.20.193.28:0/3168631953 shutdown_connections 2026-02-20T03:15:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 --2- 10.20.193.28:0/3168631953 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f510410ef00 0x7f5104115790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 --2- 10.20.193.28:0/3168631953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410e540 0x7f510410e9c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 --2- 10.20.193.28:0/3168631953 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f510410d8e0 0x7f510410dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 -- 10.20.193.28:0/3168631953 >> 10.20.193.28:0/3168631953 conn(0x7f510406c640 msgr2=0x7f510406ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 -- 10.20.193.28:0/3168631953 shutdown_connections 2026-02-20T03:15:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 -- 10.20.193.28:0/3168631953 wait complete. 2026-02-20T03:15:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.728+0000 7f51094f5640 1 Processor -- start 2026-02-20T03:15:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51094f5640 1 -- start start 2026-02-20T03:15:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51094f5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f510410d8e0 0x7f51041a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51094f5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f510410e540 0x7f51041a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51094f5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410ef00 0x7f51041aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51094f5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5104118ea0 con 0x7f510410ef00 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51094f5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5104118d20 con 0x7f510410e540 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51094f5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5104119020 con 0x7f510410d8e0 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410ef00 0x7f51041aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410ef00 0x7f51041aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33682/0 (socket says 10.20.193.28:33682) 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51037fe640 1 -- 10.20.193.28:0/3740102823 learned_addr learned my addr 10.20.193.28:0/3740102823 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f5102ffd640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f510410d8e0 0x7f51041a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51027fc640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f510410e540 0x7f51041a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51037fe640 1 -- 10.20.193.28:0/3740102823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f510410d8e0 msgr2=0x7f51041a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51037fe640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f510410d8e0 0x7f51041a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51037fe640 1 -- 10.20.193.28:0/3740102823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f510410e540 msgr2=0x7f51041a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51037fe640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f510410e540 0x7f51041a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.729+0000 7f51037fe640 1 -- 10.20.193.28:0/3740102823 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51041ad0d0 con 0x7f510410ef00 2026-02-20T03:15:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.730+0000 7f51037fe640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410ef00 0x7f51041aca60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50f400b970 tx=0x7f50f400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.730+0000 7f50e3fff640 1 -- 10.20.193.28:0/3740102823 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f400c790 con 0x7f510410ef00 2026-02-20T03:15:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.730+0000 7f50e3fff640 1 -- 10.20.193.28:0/3740102823 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f50f4010070 con 0x7f510410ef00 2026-02-20T03:15:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.730+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51041ad3c0 con 0x7f510410ef00 2026-02-20T03:15:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.730+0000 7f50e3fff640 1 -- 10.20.193.28:0/3740102823 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f4015470 con 0x7f510410ef00 2026-02-20T03:15:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.730+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51041ad9b0 con 0x7f510410ef00 2026-02-20T03:15:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.730+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51041141b0 con 0x7f510410ef00 2026-02-20T03:15:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.733+0000 7f50e3fff640 1 -- 10.20.193.28:0/3740102823 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f50f401d030 con 0x7f510410ef00 2026-02-20T03:15:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.734+0000 7f50e3fff640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f50d80b0eb0 0x7f50d80b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.735+0000 7f50e3fff640 1 -- 10.20.193.28:0/3740102823 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f50f40e0250 con 0x7f510410ef00 2026-02-20T03:15:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.735+0000 7f5102ffd640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f50d80b0eb0 0x7f50d80b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.735+0000 7f50e3fff640 1 -- 10.20.193.28:0/3740102823 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f50f40e0770 con 0x7f510410ef00 2026-02-20T03:15:27.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.735+0000 7f5102ffd640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f50d80b0eb0 0x7f50d80b3370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50f80059c0 tx=0x7f50f8005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:27.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.824+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51040630c0 con 0x7f50d80b0eb0 2026-02-20T03:15:27.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.830+0000 7f50e3fff640 1 -- 10.20.193.28:0/3740102823 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340232 (secure 0 0 0) 0x7f51040630c0 con 0x7f50d80b0eb0 2026-02-20T03:15:27.836 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:27.839 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f50d80b0eb0 msgr2=0x7f50d80b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f50d80b0eb0 0x7f50d80b3370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50f80059c0 tx=0x7f50f8005950 comp rx=0 tx=0).stop 2026-02-20T03:15:27.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410ef00 msgr2=0x7f51041aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:27.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410ef00 0x7f51041aca60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f50f400b970 tx=0x7f50f400be40 comp rx=0 tx=0).stop 2026-02-20T03:15:27.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 shutdown_connections 2026-02-20T03:15:27.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f50d80b0eb0 0x7f50d80b3370 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f510410ef00 0x7f51041aca60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f510410e540 0x7f51041a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 --2- 10.20.193.28:0/3740102823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f510410d8e0 0x7f51041a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:27.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 >> 10.20.193.28:0/3740102823 conn(0x7f510406c640 msgr2=0x7f5104111910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:27.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 shutdown_connections 2026-02-20T03:15:27.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:27.832+0000 7f51094f5640 1 -- 10.20.193.28:0/3740102823 wait complete. 2026-02-20T03:15:27.848 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2026-02-20T03:15:27.088550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663968,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":329,"num_read_kb":279,"num_write":357,"num_write_kb":3843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":297,"ondisk_log_size":297,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358160,"kb_used_data":13788,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807680240,"statfs":{"total":9019431321600,"available":9019064565760,"internally_reserved":0,"allocated":14118912,"data_stored":7785848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1978,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":32,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.080863"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.357986+0000","last_change":"2026-02-20T03:14:32.081180+0000","last_active":"2026-02-20T03:14:51.357986+0000","last_peered":"2026-02-20T03:14:51.357986+0000","last_clean":"2026-02-20T03:14:51.357986+0000","last_became_active":"2026-02-20T03:14:32.081083+0000","last_became_peered":"2026-02-20T03:14:32.081083+0000","last_unstale":"2026-02-20T03:14:51.357986+0000","last_undegraded":"2026-02-20T03:14:51.357986+0000","last_fullsized":"2026-02-20T03:14:51.357986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:23:16.897948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743323+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:14:38.743323+0000","last_peered":"2026-02-20T03:14:38.743323+0000","last_clean":"2026-02-20T03:14:38.743323+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:14:38.743323+0000","last_undegraded":"2026-02-20T03:14:38.743323+0000","last_fullsized":"2026-02-20T03:14:38.743323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092834+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:26.092834+0000","last_peered":"2026-02-20T03:15:26.092834+0000","last_clean":"2026-02-20T03:15:26.092834+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:26.092834+0000","last_undegraded":"2026-02-20T03:15:26.092834+0000","last_fullsized":"2026-02-20T03:15:26.092834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743404+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:14:38.743404+0000","last_peered":"2026-02-20T03:14:38.743404+0000","last_clean":"2026-02-20T03:14:38.743404+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:14:38.743404+0000","last_undegraded":"2026-02-20T03:14:38.743404+0000","last_fullsized":"2026-02-20T03:14:38.743404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089055+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:26.089055+0000","last_peered":"2026-02-20T03:15:26.089055+0000","last_clean":"2026-02-20T03:15:26.089055+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:26.089055+0000","last_undegraded":"2026-02-20T03:15:26.089055+0000","last_fullsized":"2026-02-20T03:15:26.089055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356040+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:14:51.356040+0000","last_peered":"2026-02-20T03:14:51.356040+0000","last_clean":"2026-02-20T03:14:51.356040+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:14:51.356040+0000","last_undegraded":"2026-02-20T03:14:51.356040+0000","last_fullsized":"2026-02-20T03:14:51.356040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098104+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:26.098104+0000","last_peered":"2026-02-20T03:15:26.098104+0000","last_clean":"2026-02-20T03:15:26.098104+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:26.098104+0000","last_undegraded":"2026-02-20T03:15:26.098104+0000","last_fullsized":"2026-02-20T03:15:26.098104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744316+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:14:38.744316+0000","last_peered":"2026-02-20T03:14:38.744316+0000","last_clean":"2026-02-20T03:14:38.744316+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:14:38.744316+0000","last_undegraded":"2026-02-20T03:14:38.744316+0000","last_fullsized":"2026-02-20T03:14:38.744316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744230+0000","last_change":"2026-02-20T03:14:33.291255+0000","last_active":"2026-02-20T03:14:38.744230+0000","last_peered":"2026-02-20T03:14:38.744230+0000","last_clean":"2026-02-20T03:14:38.744230+0000","last_became_active":"2026-02-20T03:14:33.291089+0000","last_became_peered":"2026-02-20T03:14:33.291089+0000","last_unstale":"2026-02-20T03:14:38.744230+0000","last_undegraded":"2026-02-20T03:14:38.744230+0000","last_fullsized":"2026-02-20T03:14:38.744230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:42:45.321761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318208+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:14:38.318208+0000","last_peered":"2026-02-20T03:14:38.318208+0000","last_clean":"2026-02-20T03:14:38.318208+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:14:38.318208+0000","last_undegraded":"2026-02-20T03:14:38.318208+0000","last_fullsized":"2026-02-20T03:14:38.318208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351492+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:14:50.351492+0000","last_peered":"2026-02-20T03:14:50.351492+0000","last_clean":"2026-02-20T03:14:50.351492+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:14:50.351492+0000","last_undegraded":"2026-02-20T03:14:50.351492+0000","last_fullsized":"2026-02-20T03:14:50.351492+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742908+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:14:38.742908+0000","last_peered":"2026-02-20T03:14:38.742908+0000","last_clean":"2026-02-20T03:14:38.742908+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:14:38.742908+0000","last_undegraded":"2026-02-20T03:14:38.742908+0000","last_fullsized":"2026-02-20T03:14:38.742908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093043+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:26.093043+0000","last_peered":"2026-02-20T03:15:26.093043+0000","last_clean":"2026-02-20T03:15:26.093043+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:26.093043+0000","last_undegraded":"2026-02-20T03:15:26.093043+0000","last_fullsized":"2026-02-20T03:15:26.093043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:40.062667+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:40.062667+0000","last_peered":"2026-02-20T03:14:40.062667+0000","last_clean":"2026-02-20T03:14:40.062667+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:40.062667+0000","last_undegraded":"2026-02-20T03:14:40.062667+0000","last_fullsized":"2026-02-20T03:14:40.062667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743910+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:14:38.743910+0000","last_peered":"2026-02-20T03:14:38.743910+0000","last_clean":"2026-02-20T03:14:38.743910+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:14:38.743910+0000","last_undegraded":"2026-02-20T03:14:38.743910+0000","last_fullsized":"2026-02-20T03:14:38.743910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351649+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:14:50.351649+0000","last_peered":"2026-02-20T03:14:50.351649+0000","last_clean":"2026-02-20T03:14:50.351649+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:14:50.351649+0000","last_undegraded":"2026-02-20T03:14:50.351649+0000","last_fullsized":"2026-02-20T03:14:50.351649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742825+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:14:38.742825+0000","last_peered":"2026-02-20T03:14:38.742825+0000","last_clean":"2026-02-20T03:14:38.742825+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:14:38.742825+0000","last_undegraded":"2026-02-20T03:14:38.742825+0000","last_fullsized":"2026-02-20T03:14:38.742825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743900+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:14:38.743900+0000","last_peered":"2026-02-20T03:14:38.743900+0000","last_clean":"2026-02-20T03:14:38.743900+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:14:38.743900+0000","last_undegraded":"2026-02-20T03:14:38.743900+0000","last_fullsized":"2026-02-20T03:14:38.743900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:50.357549+0000","last_change":"2026-02-20T03:15:26.097400+0000","last_active":"2026-02-20T03:15:26.097400+0000","last_peered":"2026-02-20T03:14:50.357549+0000","last_clean":"2026-02-20T03:14:50.357549+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357549+0000","last_undegraded":"2026-02-20T03:14:50.357549+0000","last_fullsized":"2026-02-20T03:14:50.357549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.311982+0000","last_change":"2026-02-20T03:15:26.089098+0000","last_active":"2026-02-20T03:15:26.089098+0000","last_peered":"2026-02-20T03:14:38.311982+0000","last_clean":"2026-02-20T03:14:38.311982+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311982+0000","last_undegraded":"2026-02-20T03:14:38.311982+0000","last_fullsized":"2026-02-20T03:14:38.311982+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,6,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092967+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:26.092967+0000","last_peered":"2026-02-20T03:15:26.092967+0000","last_clean":"2026-02-20T03:15:26.092967+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:26.092967+0000","last_undegraded":"2026-02-20T03:15:26.092967+0000","last_fullsized":"2026-02-20T03:15:26.092967+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743028+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:14:38.743028+0000","last_peered":"2026-02-20T03:14:38.743028+0000","last_clean":"2026-02-20T03:14:38.743028+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:14:38.743028+0000","last_undegraded":"2026-02-20T03:14:38.743028+0000","last_fullsized":"2026-02-20T03:14:38.743028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:00.293338+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:00.293338+0000","last_peered":"2026-02-20T03:15:00.293338+0000","last_clean":"2026-02-20T03:15:00.293338+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:00.293338+0000","last_undegraded":"2026-02-20T03:15:00.293338+0000","last_fullsized":"2026-02-20T03:15:00.293338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742399+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:14:38.742399+0000","last_peered":"2026-02-20T03:14:38.742399+0000","last_clean":"2026-02-20T03:14:38.742399+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:14:38.742399+0000","last_undegraded":"2026-02-20T03:14:38.742399+0000","last_fullsized":"2026-02-20T03:14:38.742399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311146+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:14:38.311146+0000","last_peered":"2026-02-20T03:14:38.311146+0000","last_clean":"2026-02-20T03:14:38.311146+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:14:38.311146+0000","last_undegraded":"2026-02-20T03:14:38.311146+0000","last_fullsized":"2026-02-20T03:14:38.311146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352941+0000","last_change":"2026-02-20T03:14:32.081021+0000","last_active":"2026-02-20T03:14:50.352941+0000","last_peered":"2026-02-20T03:14:50.352941+0000","last_clean":"2026-02-20T03:14:50.352941+0000","last_became_active":"2026-02-20T03:14:32.080799+0000","last_became_peered":"2026-02-20T03:14:32.080799+0000","last_unstale":"2026-02-20T03:14:50.352941+0000","last_undegraded":"2026-02-20T03:14:50.352941+0000","last_fullsized":"2026-02-20T03:14:50.352941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:15.834880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744093+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:14:38.744093+0000","last_peered":"2026-02-20T03:14:38.744093+0000","last_clean":"2026-02-20T03:14:38.744093+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:14:38.744093+0000","last_undegraded":"2026-02-20T03:14:38.744093+0000","last_fullsized":"2026-02-20T03:14:38.744093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479703+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:14:38.479703+0000","last_peered":"2026-02-20T03:14:38.479703+0000","last_clean":"2026-02-20T03:14:38.479703+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:14:38.479703+0000","last_undegraded":"2026-02-20T03:14:38.479703+0000","last_fullsized":"2026-02-20T03:14:38.479703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742701+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:14:38.742701+0000","last_peered":"2026-02-20T03:14:38.742701+0000","last_clean":"2026-02-20T03:14:38.742701+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:14:38.742701+0000","last_undegraded":"2026-02-20T03:14:38.742701+0000","last_fullsized":"2026-02-20T03:14:38.742701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744036+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:14:38.744036+0000","last_peered":"2026-02-20T03:14:38.744036+0000","last_clean":"2026-02-20T03:14:38.744036+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:14:38.744036+0000","last_undegraded":"2026-02-20T03:14:38.744036+0000","last_fullsized":"2026-02-20T03:14:38.744036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479538+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:14:38.479538+0000","last_peered":"2026-02-20T03:14:38.479538+0000","last_clean":"2026-02-20T03:14:38.479538+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:14:38.479538+0000","last_undegraded":"2026-02-20T03:14:38.479538+0000","last_fullsized":"2026-02-20T03:14:38.479538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318364+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:14:38.318364+0000","last_peered":"2026-02-20T03:14:38.318364+0000","last_clean":"2026-02-20T03:14:38.318364+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:14:38.318364+0000","last_undegraded":"2026-02-20T03:14:38.318364+0000","last_fullsized":"2026-02-20T03:14:38.318364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311210+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:14:38.311210+0000","last_peered":"2026-02-20T03:14:38.311210+0000","last_clean":"2026-02-20T03:14:38.311210+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:14:38.311210+0000","last_undegraded":"2026-02-20T03:14:38.311210+0000","last_fullsized":"2026-02-20T03:14:38.311210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.290483+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.289779+0000","last_became_peered":"2026-02-20T03:14:33.289779+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:45:10.985058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:21.379484+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:21.379484+0000","last_peered":"2026-02-20T03:15:21.379484+0000","last_clean":"2026-02-20T03:15:21.379484+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:21.379484+0000","last_undegraded":"2026-02-20T03:15:21.379484+0000","last_fullsized":"2026-02-20T03:15:21.379484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311164+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:14:38.311164+0000","last_peered":"2026-02-20T03:14:38.311164+0000","last_clean":"2026-02-20T03:14:38.311164+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:14:38.311164+0000","last_undegraded":"2026-02-20T03:14:38.311164+0000","last_fullsized":"2026-02-20T03:14:38.311164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.310925+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:14:38.310925+0000","last_peered":"2026-02-20T03:14:38.310925+0000","last_clean":"2026-02-20T03:14:38.310925+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:14:38.310925+0000","last_undegraded":"2026-02-20T03:14:38.310925+0000","last_fullsized":"2026-02-20T03:14:38.310925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.360846+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:14:51.360846+0000","last_peered":"2026-02-20T03:14:51.360846+0000","last_clean":"2026-02-20T03:14:51.360846+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:14:51.360846+0000","last_undegraded":"2026-02-20T03:14:51.360846+0000","last_fullsized":"2026-02-20T03:14:51.360846+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744423+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:14:38.744423+0000","last_peered":"2026-02-20T03:14:38.744423+0000","last_clean":"2026-02-20T03:14:38.744423+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:14:38.744423+0000","last_undegraded":"2026-02-20T03:14:38.744423+0000","last_fullsized":"2026-02-20T03:14:38.744423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743435+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:14:38.743435+0000","last_peered":"2026-02-20T03:14:38.743435+0000","last_clean":"2026-02-20T03:14:38.743435+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:14:38.743435+0000","last_undegraded":"2026-02-20T03:14:38.743435+0000","last_fullsized":"2026-02-20T03:14:38.743435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":350,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318242+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:14:38.318242+0000","last_peered":"2026-02-20T03:14:38.318242+0000","last_clean":"2026-02-20T03:14:38.318242+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:14:38.318242+0000","last_undegraded":"2026-02-20T03:14:38.318242+0000","last_fullsized":"2026-02-20T03:14:38.318242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318423+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:14:38.318423+0000","last_peered":"2026-02-20T03:14:38.318423+0000","last_clean":"2026-02-20T03:14:38.318423+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:14:38.318423+0000","last_undegraded":"2026-02-20T03:14:38.318423+0000","last_fullsized":"2026-02-20T03:14:38.318423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318536+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:14:38.318536+0000","last_peered":"2026-02-20T03:14:38.318536+0000","last_clean":"2026-02-20T03:14:38.318536+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:14:38.318536+0000","last_undegraded":"2026-02-20T03:14:38.318536+0000","last_fullsized":"2026-02-20T03:14:38.318536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2026-02-20T03:14:38.744446+0000","last_change":"2026-02-20T03:15:26.460325+0000","last_active":"2026-02-20T03:15:26.460325+0000","last_peered":"2026-02-20T03:14:38.744446+0000","last_clean":"2026-02-20T03:14:38.744446+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:38.744446+0000","last_undegraded":"2026-02-20T03:14:38.744446+0000","last_fullsized":"2026-02-20T03:14:38.744446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097649+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:26.097649+0000","last_peered":"2026-02-20T03:15:26.097649+0000","last_clean":"2026-02-20T03:15:26.097649+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:26.097649+0000","last_undegraded":"2026-02-20T03:15:26.097649+0000","last_fullsized":"2026-02-20T03:15:26.097649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318340+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:14:38.318340+0000","last_peered":"2026-02-20T03:14:38.318340+0000","last_clean":"2026-02-20T03:14:38.318340+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:14:38.318340+0000","last_undegraded":"2026-02-20T03:14:38.318340+0000","last_fullsized":"2026-02-20T03:14:38.318340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744433+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:14:38.744433+0000","last_peered":"2026-02-20T03:14:38.744433+0000","last_clean":"2026-02-20T03:14:38.744433+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:14:38.744433+0000","last_undegraded":"2026-02-20T03:14:38.744433+0000","last_fullsized":"2026-02-20T03:14:38.744433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088541+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:26.088541+0000","last_peered":"2026-02-20T03:15:26.088541+0000","last_clean":"2026-02-20T03:15:26.088541+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:26.088541+0000","last_undegraded":"2026-02-20T03:15:26.088541+0000","last_fullsized":"2026-02-20T03:15:26.088541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318490+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:14:38.318490+0000","last_peered":"2026-02-20T03:14:38.318490+0000","last_clean":"2026-02-20T03:14:38.318490+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:14:38.318490+0000","last_undegraded":"2026-02-20T03:14:38.318490+0000","last_fullsized":"2026-02-20T03:14:38.318490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311359+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:14:38.311359+0000","last_peered":"2026-02-20T03:14:38.311359+0000","last_clean":"2026-02-20T03:14:38.311359+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:14:38.311359+0000","last_undegraded":"2026-02-20T03:14:38.311359+0000","last_fullsized":"2026-02-20T03:14:38.311359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743916+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:14:38.743916+0000","last_peered":"2026-02-20T03:14:38.743916+0000","last_clean":"2026-02-20T03:14:38.743916+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:14:38.743916+0000","last_undegraded":"2026-02-20T03:14:38.743916+0000","last_fullsized":"2026-02-20T03:14:38.743916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744369+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:14:38.744369+0000","last_peered":"2026-02-20T03:14:38.744369+0000","last_clean":"2026-02-20T03:14:38.744369+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:14:38.744369+0000","last_undegraded":"2026-02-20T03:14:38.744369+0000","last_fullsized":"2026-02-20T03:14:38.744369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.359869+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:14:52.359869+0000","last_peered":"2026-02-20T03:14:52.359869+0000","last_clean":"2026-02-20T03:14:52.359869+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:14:52.359869+0000","last_undegraded":"2026-02-20T03:14:52.359869+0000","last_fullsized":"2026-02-20T03:14:52.359869+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744027+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:14:38.744027+0000","last_peered":"2026-02-20T03:14:38.744027+0000","last_clean":"2026-02-20T03:14:38.744027+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:14:38.744027+0000","last_undegraded":"2026-02-20T03:14:38.744027+0000","last_fullsized":"2026-02-20T03:14:38.744027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743990+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:14:38.743990+0000","last_peered":"2026-02-20T03:14:38.743990+0000","last_clean":"2026-02-20T03:14:38.743990+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:14:38.743990+0000","last_undegraded":"2026-02-20T03:14:38.743990+0000","last_fullsized":"2026-02-20T03:14:38.743990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.358752+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:14:51.358752+0000","last_peered":"2026-02-20T03:14:51.358752+0000","last_clean":"2026-02-20T03:14:51.358752+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:14:51.358752+0000","last_undegraded":"2026-02-20T03:14:51.358752+0000","last_fullsized":"2026-02-20T03:14:51.358752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311328+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:14:38.311328+0000","last_peered":"2026-02-20T03:14:38.311328+0000","last_clean":"2026-02-20T03:14:38.311328+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:14:38.311328+0000","last_undegraded":"2026-02-20T03:14:38.311328+0000","last_fullsized":"2026-02-20T03:14:38.311328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318042+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:14:38.318042+0000","last_peered":"2026-02-20T03:14:38.318042+0000","last_clean":"2026-02-20T03:14:38.318042+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:14:38.318042+0000","last_undegraded":"2026-02-20T03:14:38.318042+0000","last_fullsized":"2026-02-20T03:14:38.318042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:23.388416+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:23.388416+0000","last_peered":"2026-02-20T03:15:23.388416+0000","last_clean":"2026-02-20T03:15:23.388416+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:23.388416+0000","last_undegraded":"2026-02-20T03:15:23.388416+0000","last_fullsized":"2026-02-20T03:15:23.388416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743149+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:14:38.743149+0000","last_peered":"2026-02-20T03:14:38.743149+0000","last_clean":"2026-02-20T03:14:38.743149+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:14:38.743149+0000","last_undegraded":"2026-02-20T03:14:38.743149+0000","last_fullsized":"2026-02-20T03:14:38.743149+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318241+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:14:38.318241+0000","last_peered":"2026-02-20T03:14:38.318241+0000","last_clean":"2026-02-20T03:14:38.318241+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:14:38.318241+0000","last_undegraded":"2026-02-20T03:14:38.318241+0000","last_fullsized":"2026-02-20T03:14:38.318241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352270+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:14:50.352270+0000","last_peered":"2026-02-20T03:14:50.352270+0000","last_clean":"2026-02-20T03:14:50.352270+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:14:50.352270+0000","last_undegraded":"2026-02-20T03:14:50.352270+0000","last_fullsized":"2026-02-20T03:14:50.352270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744179+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:14:38.744179+0000","last_peered":"2026-02-20T03:14:38.744179+0000","last_clean":"2026-02-20T03:14:38.744179+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:14:38.744179+0000","last_undegraded":"2026-02-20T03:14:38.744179+0000","last_fullsized":"2026-02-20T03:14:38.744179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311740+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:14:38.311740+0000","last_peered":"2026-02-20T03:14:38.311740+0000","last_clean":"2026-02-20T03:14:38.311740+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:14:38.311740+0000","last_undegraded":"2026-02-20T03:14:38.311740+0000","last_fullsized":"2026-02-20T03:14:38.311740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093258+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:26.093258+0000","last_peered":"2026-02-20T03:15:26.093258+0000","last_clean":"2026-02-20T03:15:26.093258+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:26.093258+0000","last_undegraded":"2026-02-20T03:15:26.093258+0000","last_fullsized":"2026-02-20T03:15:26.093258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744303+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:14:38.744303+0000","last_peered":"2026-02-20T03:14:38.744303+0000","last_clean":"2026-02-20T03:14:38.744303+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:14:38.744303+0000","last_undegraded":"2026-02-20T03:14:38.744303+0000","last_fullsized":"2026-02-20T03:14:38.744303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744191+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:14:38.744191+0000","last_peered":"2026-02-20T03:14:38.744191+0000","last_clean":"2026-02-20T03:14:38.744191+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:14:38.744191+0000","last_undegraded":"2026-02-20T03:14:38.744191+0000","last_fullsized":"2026-02-20T03:14:38.744191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:24.392752+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:24.392752+0000","last_peered":"2026-02-20T03:15:24.392752+0000","last_clean":"2026-02-20T03:15:24.392752+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:24.392752+0000","last_undegraded":"2026-02-20T03:15:24.392752+0000","last_fullsized":"2026-02-20T03:15:24.392752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69334,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":76,"num_read_kb":106,"num_write":34,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742256+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:14:38.742256+0000","last_peered":"2026-02-20T03:14:38.742256+0000","last_clean":"2026-02-20T03:14:38.742256+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:14:38.742256+0000","last_undegraded":"2026-02-20T03:14:38.742256+0000","last_fullsized":"2026-02-20T03:14:38.742256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098166+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:26.098166+0000","last_peered":"2026-02-20T03:15:26.098166+0000","last_clean":"2026-02-20T03:15:26.098166+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:26.098166+0000","last_undegraded":"2026-02-20T03:15:26.098166+0000","last_fullsized":"2026-02-20T03:15:26.098166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352990+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:14:50.352990+0000","last_peered":"2026-02-20T03:14:50.352990+0000","last_clean":"2026-02-20T03:14:50.352990+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:14:50.352990+0000","last_undegraded":"2026-02-20T03:14:50.352990+0000","last_fullsized":"2026-02-20T03:14:50.352990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089065+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:26.089065+0000","last_peered":"2026-02-20T03:15:26.089065+0000","last_clean":"2026-02-20T03:15:26.089065+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:26.089065+0000","last_undegraded":"2026-02-20T03:15:26.089065+0000","last_fullsized":"2026-02-20T03:15:26.089065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.356807+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:14:50.356807+0000","last_peered":"2026-02-20T03:14:50.356807+0000","last_clean":"2026-02-20T03:14:50.356807+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:14:50.356807+0000","last_undegraded":"2026-02-20T03:14:50.356807+0000","last_fullsized":"2026-02-20T03:14:50.356807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743191+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:14:38.743191+0000","last_peered":"2026-02-20T03:14:38.743191+0000","last_clean":"2026-02-20T03:14:38.743191+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:14:38.743191+0000","last_undegraded":"2026-02-20T03:14:38.743191+0000","last_fullsized":"2026-02-20T03:14:38.743191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098167+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:26.098167+0000","last_peered":"2026-02-20T03:15:26.098167+0000","last_clean":"2026-02-20T03:15:26.098167+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:26.098167+0000","last_undegraded":"2026-02-20T03:15:26.098167+0000","last_fullsized":"2026-02-20T03:15:26.098167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:24.079702+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:24.079702+0000","last_peered":"2026-02-20T03:15:24.079702+0000","last_clean":"2026-02-20T03:15:24.079702+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:24.079702+0000","last_undegraded":"2026-02-20T03:15:24.079702+0000","last_fullsized":"2026-02-20T03:15:24.079702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743127+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:14:38.743127+0000","last_peered":"2026-02-20T03:14:38.743127+0000","last_clean":"2026-02-20T03:14:38.743127+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:14:38.743127+0000","last_undegraded":"2026-02-20T03:14:38.743127+0000","last_fullsized":"2026-02-20T03:14:38.743127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088557+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:26.088557+0000","last_peered":"2026-02-20T03:15:26.088557+0000","last_clean":"2026-02-20T03:15:26.088557+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:26.088557+0000","last_undegraded":"2026-02-20T03:15:26.088557+0000","last_fullsized":"2026-02-20T03:15:26.088557+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742536+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:14:38.742536+0000","last_peered":"2026-02-20T03:14:38.742536+0000","last_clean":"2026-02-20T03:14:38.742536+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:14:38.742536+0000","last_undegraded":"2026-02-20T03:14:38.742536+0000","last_fullsized":"2026-02-20T03:14:38.742536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744067+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:14:38.744067+0000","last_peered":"2026-02-20T03:14:38.744067+0000","last_clean":"2026-02-20T03:14:38.744067+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:14:38.744067+0000","last_undegraded":"2026-02-20T03:14:38.744067+0000","last_fullsized":"2026-02-20T03:14:38.744067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744459+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:14:38.744459+0000","last_peered":"2026-02-20T03:14:38.744459+0000","last_clean":"2026-02-20T03:14:38.744459+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:14:38.744459+0000","last_undegraded":"2026-02-20T03:14:38.744459+0000","last_fullsized":"2026-02-20T03:14:38.744459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742665+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:14:38.742665+0000","last_peered":"2026-02-20T03:14:38.742665+0000","last_clean":"2026-02-20T03:14:38.742665+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:14:38.742665+0000","last_undegraded":"2026-02-20T03:14:38.742665+0000","last_fullsized":"2026-02-20T03:14:38.742665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356776+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:14:51.356776+0000","last_peered":"2026-02-20T03:14:51.356776+0000","last_clean":"2026-02-20T03:14:51.356776+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:14:51.356776+0000","last_undegraded":"2026-02-20T03:14:51.356776+0000","last_fullsized":"2026-02-20T03:14:51.356776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.361797+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:14:51.361797+0000","last_peered":"2026-02-20T03:14:51.361797+0000","last_clean":"2026-02-20T03:14:51.361797+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:14:51.361797+0000","last_undegraded":"2026-02-20T03:14:51.361797+0000","last_fullsized":"2026-02-20T03:14:51.361797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744227+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:14:38.744227+0000","last_peered":"2026-02-20T03:14:38.744227+0000","last_clean":"2026-02-20T03:14:38.744227+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:14:38.744227+0000","last_undegraded":"2026-02-20T03:14:38.744227+0000","last_fullsized":"2026-02-20T03:14:38.744227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093296+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:26.093296+0000","last_peered":"2026-02-20T03:15:26.093296+0000","last_clean":"2026-02-20T03:15:26.093296+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:26.093296+0000","last_undegraded":"2026-02-20T03:15:26.093296+0000","last_fullsized":"2026-02-20T03:15:26.093296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":62,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:22.379029+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:22.379029+0000","last_peered":"2026-02-20T03:15:22.379029+0000","last_clean":"2026-02-20T03:15:22.379029+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:22.379029+0000","last_undegraded":"2026-02-20T03:15:22.379029+0000","last_fullsized":"2026-02-20T03:15:22.379029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744076+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:14:38.744076+0000","last_peered":"2026-02-20T03:14:38.744076+0000","last_clean":"2026-02-20T03:14:38.744076+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:14:38.744076+0000","last_undegraded":"2026-02-20T03:14:38.744076+0000","last_fullsized":"2026-02-20T03:14:38.744076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093320+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:26.093320+0000","last_peered":"2026-02-20T03:15:26.093320+0000","last_clean":"2026-02-20T03:15:26.093320+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:26.093320+0000","last_undegraded":"2026-02-20T03:15:26.093320+0000","last_fullsized":"2026-02-20T03:15:26.093320+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743873+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:14:38.743873+0000","last_peered":"2026-02-20T03:14:38.743873+0000","last_clean":"2026-02-20T03:14:38.743873+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:14:38.743873+0000","last_undegraded":"2026-02-20T03:14:38.743873+0000","last_fullsized":"2026-02-20T03:14:38.743873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093050+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:26.093050+0000","last_peered":"2026-02-20T03:15:26.093050+0000","last_clean":"2026-02-20T03:15:26.093050+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:26.093050+0000","last_undegraded":"2026-02-20T03:15:26.093050+0000","last_fullsized":"2026-02-20T03:15:26.093050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093067+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:26.093067+0000","last_peered":"2026-02-20T03:15:26.093067+0000","last_clean":"2026-02-20T03:15:26.093067+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:26.093067+0000","last_undegraded":"2026-02-20T03:15:26.093067+0000","last_fullsized":"2026-02-20T03:15:26.093067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088712+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:26.088712+0000","last_peered":"2026-02-20T03:15:26.088712+0000","last_clean":"2026-02-20T03:15:26.088712+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:26.088712+0000","last_undegraded":"2026-02-20T03:15:26.088712+0000","last_fullsized":"2026-02-20T03:15:26.088712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311110+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:14:38.311110+0000","last_peered":"2026-02-20T03:14:38.311110+0000","last_clean":"2026-02-20T03:14:38.311110+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:14:38.311110+0000","last_undegraded":"2026-02-20T03:14:38.311110+0000","last_fullsized":"2026-02-20T03:14:38.311110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744275+0000","last_change":"2026-02-20T03:14:33.290769+0000","last_active":"2026-02-20T03:14:38.744275+0000","last_peered":"2026-02-20T03:14:38.744275+0000","last_clean":"2026-02-20T03:14:38.744275+0000","last_became_active":"2026-02-20T03:14:33.290406+0000","last_became_peered":"2026-02-20T03:14:33.290406+0000","last_unstale":"2026-02-20T03:14:38.744275+0000","last_undegraded":"2026-02-20T03:14:38.744275+0000","last_fullsized":"2026-02-20T03:14:38.744275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:58.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093494+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:26.093494+0000","last_peered":"2026-02-20T03:15:26.093494+0000","last_clean":"2026-02-20T03:15:26.093494+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:26.093494+0000","last_undegraded":"2026-02-20T03:15:26.093494+0000","last_fullsized":"2026-02-20T03:15:26.093494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742977+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:14:38.742977+0000","last_peered":"2026-02-20T03:14:38.742977+0000","last_clean":"2026-02-20T03:14:38.742977+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:14:38.742977+0000","last_undegraded":"2026-02-20T03:14:38.742977+0000","last_fullsized":"2026-02-20T03:14:38.742977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743959+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:14:38.743959+0000","last_peered":"2026-02-20T03:14:38.743959+0000","last_clean":"2026-02-20T03:14:38.743959+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:14:38.743959+0000","last_undegraded":"2026-02-20T03:14:38.743959+0000","last_fullsized":"2026-02-20T03:14:38.743959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743157+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:14:38.743157+0000","last_peered":"2026-02-20T03:14:38.743157+0000","last_clean":"2026-02-20T03:14:38.743157+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:14:38.743157+0000","last_undegraded":"2026-02-20T03:14:38.743157+0000","last_fullsized":"2026-02-20T03:14:38.743157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097832+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:26.097832+0000","last_peered":"2026-02-20T03:15:26.097832+0000","last_clean":"2026-02-20T03:15:26.097832+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:26.097832+0000","last_undegraded":"2026-02-20T03:15:26.097832+0000","last_fullsized":"2026-02-20T03:15:26.097832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311289+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:14:38.311289+0000","last_peered":"2026-02-20T03:14:38.311289+0000","last_clean":"2026-02-20T03:14:38.311289+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:14:38.311289+0000","last_undegraded":"2026-02-20T03:14:38.311289+0000","last_fullsized":"2026-02-20T03:14:38.311289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744096+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:14:38.744096+0000","last_peered":"2026-02-20T03:14:38.744096+0000","last_clean":"2026-02-20T03:14:38.744096+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:14:38.744096+0000","last_undegraded":"2026-02-20T03:14:38.744096+0000","last_fullsized":"2026-02-20T03:14:38.744096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093417+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:26.093417+0000","last_peered":"2026-02-20T03:15:26.093417+0000","last_clean":"2026-02-20T03:15:26.093417+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:26.093417+0000","last_undegraded":"2026-02-20T03:15:26.093417+0000","last_fullsized":"2026-02-20T03:15:26.093417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742612+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:14:38.742612+0000","last_peered":"2026-02-20T03:14:38.742612+0000","last_clean":"2026-02-20T03:14:38.742612+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:14:38.742612+0000","last_undegraded":"2026-02-20T03:14:38.742612+0000","last_fullsized":"2026-02-20T03:14:38.742612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744492+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:14:38.744492+0000","last_peered":"2026-02-20T03:14:38.744492+0000","last_clean":"2026-02-20T03:14:38.744492+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:14:38.744492+0000","last_undegraded":"2026-02-20T03:14:38.744492+0000","last_fullsized":"2026-02-20T03:14:38.744492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097561+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:26.097561+0000","last_peered":"2026-02-20T03:15:26.097561+0000","last_clean":"2026-02-20T03:15:26.097561+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:26.097561+0000","last_undegraded":"2026-02-20T03:15:26.097561+0000","last_fullsized":"2026-02-20T03:15:26.097561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088395+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:26.088395+0000","last_peered":"2026-02-20T03:15:26.088395+0000","last_clean":"2026-02-20T03:15:26.088395+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:26.088395+0000","last_undegraded":"2026-02-20T03:15:26.088395+0000","last_fullsized":"2026-02-20T03:15:26.088395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088313+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:26.088313+0000","last_peered":"2026-02-20T03:15:26.088313+0000","last_clean":"2026-02-20T03:15:26.088313+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:26.088313+0000","last_undegraded":"2026-02-20T03:15:26.088313+0000","last_fullsized":"2026-02-20T03:15:26.088313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311264+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:14:38.311264+0000","last_peered":"2026-02-20T03:14:38.311264+0000","last_clean":"2026-02-20T03:14:38.311264+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:14:38.311264+0000","last_undegraded":"2026-02-20T03:14:38.311264+0000","last_fullsized":"2026-02-20T03:14:38.311264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318524+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:14:38.318524+0000","last_peered":"2026-02-20T03:14:38.318524+0000","last_clean":"2026-02-20T03:14:38.318524+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:14:38.318524+0000","last_undegraded":"2026-02-20T03:14:38.318524+0000","last_fullsized":"2026-02-20T03:14:38.318524+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479875+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:14:38.479875+0000","last_peered":"2026-02-20T03:14:38.479875+0000","last_clean":"2026-02-20T03:14:38.479875+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:14:38.479875+0000","last_undegraded":"2026-02-20T03:14:38.479875+0000","last_fullsized":"2026-02-20T03:14:38.479875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.749677+0000","last_change":"2026-02-20T03:15:26.098509+0000","last_active":"2026-02-20T03:15:26.098509+0000","last_peered":"2026-02-20T03:14:38.749677+0000","last_clean":"2026-02-20T03:14:38.749677+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749677+0000","last_undegraded":"2026-02-20T03:14:38.749677+0000","last_fullsized":"2026-02-20T03:14:38.749677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742670+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:14:38.742670+0000","last_peered":"2026-02-20T03:14:38.742670+0000","last_clean":"2026-02-20T03:14:38.742670+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:14:38.742670+0000","last_undegraded":"2026-02-20T03:14:38.742670+0000","last_fullsized":"2026-02-20T03:14:38.742670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.318097+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:14:38.318097+0000","last_peered":"2026-02-20T03:14:38.318097+0000","last_clean":"2026-02-20T03:14:38.318097+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:14:38.318097+0000","last_undegraded":"2026-02-20T03:14:38.318097+0000","last_fullsized":"2026-02-20T03:14:38.318097+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479297+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:14:38.479297+0000","last_peered":"2026-02-20T03:14:38.479297+0000","last_clean":"2026-02-20T03:14:38.479297+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:14:38.479297+0000","last_undegraded":"2026-02-20T03:14:38.479297+0000","last_fullsized":"2026-02-20T03:14:38.479297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743970+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:14:38.743970+0000","last_peered":"2026-02-20T03:14:38.743970+0000","last_clean":"2026-02-20T03:14:38.743970+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:14:38.743970+0000","last_undegraded":"2026-02-20T03:14:38.743970+0000","last_fullsized":"2026-02-20T03:14:38.743970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088720+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:26.088720+0000","last_peered":"2026-02-20T03:15:26.088720+0000","last_clean":"2026-02-20T03:15:26.088720+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:26.088720+0000","last_undegraded":"2026-02-20T03:15:26.088720+0000","last_fullsized":"2026-02-20T03:15:26.088720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088833+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:26.088833+0000","last_peered":"2026-02-20T03:15:26.088833+0000","last_clean":"2026-02-20T03:15:26.088833+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:26.088833+0000","last_undegraded":"2026-02-20T03:15:26.088833+0000","last_fullsized":"2026-02-20T03:15:26.088833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744466+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:14:38.744466+0000","last_peered":"2026-02-20T03:14:38.744466+0000","last_clean":"2026-02-20T03:14:38.744466+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:14:38.744466+0000","last_undegraded":"2026-02-20T03:14:38.744466+0000","last_fullsized":"2026-02-20T03:14:38.744466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73366,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":223,"num_read_kb":188,"num_write":166,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":220404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383696,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971104,"statfs":{"total":751619276800,"available":751586410496,"internally_reserved":0,"allocated":995328,"data_stored":484050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612626,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32776,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970424,"statfs":{"total":751619276800,"available":751585714176,"internally_reserved":0,"allocated":1691648,"data_stored":1140738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776148,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":488382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037782,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32112,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971088,"statfs":{"total":751619276800,"available":751586394112,"internally_reserved":0,"allocated":1011712,"data_stored":484206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299416,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32692,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970508,"statfs":{"total":751619276800,"available":751585800192,"internally_reserved":0,"allocated":1605632,"data_stored":1080116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462938,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":479452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724573,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28540,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974660,"statfs":{"total":751619276800,"available":751590051840,"internally_reserved":0,"allocated":1613824,"data_stored":1075312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888095,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971096,"statfs":{"total":751619276800,"available":751586402304,"internally_reserved":0,"allocated":1003520,"data_stored":484494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149729,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27944,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975256,"statfs":{"total":751619276800,"available":751590662144,"internally_reserved":0,"allocated":1003520,"data_stored":479646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378660,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28048,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975152,"statfs":{"total":751619276800,"available":751590555648,"internally_reserved":0,"allocated":1105920,"data_stored":559896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28004,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975196,"statfs":{"total":751619276800,"available":751590600704,"internally_reserved":0,"allocated":1064960,"data_stored":548696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":480860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:27.851 INFO:tasks.fwd_scrub.ceph_manager:PG 2.8 is not active+clean 2026-02-20T03:15:27.851 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '2.8', 'version': "89'2", 'reported_seq': 26, 'reported_epoch': 89, 'state': 'peering', 'last_fresh': '2026-02-20T03:14:50.357549+0000', 'last_change': '2026-02-20T03:15:26.097400+0000', 'last_active': '2026-02-20T03:15:26.097400+0000', 'last_peered': '2026-02-20T03:14:50.357549+0000', 'last_clean': '2026-02-20T03:14:50.357549+0000', 'last_became_active': '2026-02-20T03:14:32.086778+0000', 'last_became_peered': '2026-02-20T03:14:32.086778+0000', 'last_unstale': '2026-02-20T03:14:50.357549+0000', 'last_undegraded': '2026-02-20T03:14:50.357549+0000', 'last_fullsized': '2026-02-20T03:14:50.357549+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 83, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'last_clean_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 3, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 11, 0], 'acting': [1, 11, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 2, 11], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2026-02-20T03:15:27.851 INFO:tasks.fwd_scrub.ceph_manager:PG 3.6 is not active+clean 2026-02-20T03:15:27.851 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 22, 'reported_epoch': 89, 'state': 'peering', 'last_fresh': '2026-02-20T03:14:38.311982+0000', 'last_change': '2026-02-20T03:15:26.089098+0000', 'last_active': '2026-02-20T03:15:26.089098+0000', 'last_peered': '2026-02-20T03:14:38.311982+0000', 'last_clean': '2026-02-20T03:14:38.311982+0000', 'last_became_active': '2026-02-20T03:14:33.297919+0000', 'last_became_peered': '2026-02-20T03:14:33.297919+0000', 'last_unstale': '2026-02-20T03:14:38.311982+0000', 'last_undegraded': '2026-02-20T03:14:38.311982+0000', 'last_fullsized': '2026-02-20T03:14:38.311982+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'last_clean_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6, 7], 'acting': [0, 6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3, 4, 6, 7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2026-02-20T03:15:27.851 INFO:tasks.fwd_scrub.ceph_manager:PG 2.c is not active+clean 2026-02-20T03:15:27.851 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '2.c', 'version': "89'3", 'reported_seq': 2, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2026-02-20T03:14:38.744446+0000', 'last_change': '2026-02-20T03:15:26.460325+0000', 'last_active': '2026-02-20T03:15:26.460325+0000', 'last_peered': '2026-02-20T03:14:38.744446+0000', 'last_clean': '2026-02-20T03:14:38.744446+0000', 'last_became_active': '2026-02-20T03:14:32.079385+0000', 'last_became_peered': '2026-02-20T03:14:32.079385+0000', 'last_unstale': '2026-02-20T03:14:38.744446+0000', 'last_undegraded': '2026-02-20T03:14:38.744446+0000', 'last_fullsized': '2026-02-20T03:14:38.744446+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 83, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'last_clean_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 0, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 592, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 2, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 4, 'num_write_kb': 1, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 11, 0], 'acting': [1, 11, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2026-02-20T03:15:27.852 INFO:tasks.fwd_scrub.ceph_manager:PG 3.37 is not active+clean 2026-02-20T03:15:27.852 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 22, 'reported_epoch': 89, 'state': 'peering', 'last_fresh': '2026-02-20T03:14:38.749677+0000', 'last_change': '2026-02-20T03:15:26.098509+0000', 'last_active': '2026-02-20T03:15:26.098509+0000', 'last_peered': '2026-02-20T03:14:38.749677+0000', 'last_clean': '2026-02-20T03:14:38.749677+0000', 'last_became_active': '2026-02-20T03:14:33.295836+0000', 'last_became_peered': '2026-02-20T03:14:33.295836+0000', 'last_unstale': '2026-02-20T03:14:38.749677+0000', 'last_undegraded': '2026-02-20T03:14:38.749677+0000', 'last_fullsized': '2026-02-20T03:14:38.749677+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'last_clean_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6, 11], 'acting': [1, 6, 11], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5, 6, 11], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2026-02-20T03:15:27.852 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-20T03:15:28.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.010+0000 7fa148d91640 1 -- 10.20.193.28:0/671968744 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa144108e20 msgr2=0x7fa144109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.010+0000 7fa148d91640 1 --2- 10.20.193.28:0/671968744 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa144108e20 0x7fa144109220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa130009a30 tx=0x7fa13002f1c0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.010+0000 7fa148d91640 1 -- 10.20.193.28:0/671968744 shutdown_connections 2026-02-20T03:15:28.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.010+0000 7fa148d91640 1 --2- 10.20.193.28:0/671968744 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa14410a930 0x7fa144111250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.010+0000 7fa148d91640 1 --2- 10.20.193.28:0/671968744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa144109f70 0x7fa14410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.010+0000 7fa148d91640 1 --2- 10.20.193.28:0/671968744 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa144108e20 0x7fa144109220 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.010+0000 7fa148d91640 1 -- 10.20.193.28:0/671968744 >> 10.20.193.28:0/671968744 conn(0x7fa144077e70 msgr2=0x7fa14407a290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:28.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.010+0000 7fa148d91640 1 -- 10.20.193.28:0/671968744 shutdown_connections 2026-02-20T03:15:28.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.010+0000 7fa148d91640 1 -- 10.20.193.28:0/671968744 wait complete. 2026-02-20T03:15:28.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa148d91640 1 Processor -- start 2026-02-20T03:15:28.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa148d91640 1 -- start start 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa148d91640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa144108e20 0x7fa1441a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa148d91640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa144109f70 0x7fa1441a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa148d91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa14410a930 0x7fa1441a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa148d91640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa144114900 con 0x7fa14410a930 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa148d91640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa144114780 con 0x7fa144109f70 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa148d91640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa144114a80 con 0x7fa144108e20 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa143fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa14410a930 0x7fa1441a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa143fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa14410a930 0x7fa1441a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33694/0 (socket says 10.20.193.28:33694) 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa143fff640 1 -- 10.20.193.28:0/1201531020 learned_addr learned my addr 10.20.193.28:0/1201531020 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa1437fe640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa144108e20 0x7fa1441a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:28.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa142ffd640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa144109f70 0x7fa1441a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa143fff640 1 -- 10.20.193.28:0/1201531020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa144108e20 msgr2=0x7fa1441a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa143fff640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa144108e20 0x7fa1441a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa143fff640 1 -- 10.20.193.28:0/1201531020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa144109f70 msgr2=0x7fa1441a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa143fff640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa144109f70 0x7fa1441a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.011+0000 7fa143fff640 1 -- 10.20.193.28:0/1201531020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1441a8ba0 con 0x7fa14410a930 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.012+0000 7fa143fff640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa14410a930 0x7fa1441a84a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa13800ef30 tx=0x7fa13800c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.012+0000 7fa140ff9640 1 -- 10.20.193.28:0/1201531020 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa138019070 con 0x7fa14410a930 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.012+0000 7fa140ff9640 1 -- 10.20.193.28:0/1201531020 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa1380092d0 con 0x7fa14410a930 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.012+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1441a8e30 con 0x7fa14410a930 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.012+0000 7fa140ff9640 1 -- 10.20.193.28:0/1201531020 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa138007500 con 0x7fa14410a930 2026-02-20T03:15:28.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.012+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1441a92f0 con 0x7fa14410a930 2026-02-20T03:15:28.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.012+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14410fc60 con 0x7fa14410a930 2026-02-20T03:15:28.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.014+0000 7fa140ff9640 1 -- 10.20.193.28:0/1201531020 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fa1380076a0 con 0x7fa14410a930 2026-02-20T03:15:28.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.016+0000 7fa140ff9640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa1180b0eb0 0x7fa1180b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:28.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.016+0000 7fa140ff9640 1 -- 10.20.193.28:0/1201531020 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fa1380e0ad0 con 0x7fa14410a930 2026-02-20T03:15:28.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.016+0000 7fa1437fe640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa1180b0eb0 0x7fa1180b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:28.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.017+0000 7fa1437fe640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa1180b0eb0 0x7fa1180b3370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa130002410 tx=0x7fa13003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:28.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.018+0000 7fa140ff9640 1 -- 10.20.193.28:0/1201531020 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa138052b20 con 0x7fa14410a930 2026-02-20T03:15:28.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:28 trial028 ceph-mon[38552]: osdmap e91: 12 total, 12 up, 12 in 2026-02-20T03:15:28.100 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:28 trial028 ceph-mon[38552]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:28.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.140+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa144110080 con 0x7fa14410a930 2026-02-20T03:15:28.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.141+0000 7fa140ff9640 1 -- 10.20.193.28:0/1201531020 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2420 (secure 0 0 0) 0x7fa138010040 con 0x7fa14410a930 2026-02-20T03:15:28.143 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:28.143 INFO:teuthology.orchestra.run.trial028.stdout:{"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":218,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":91,"num_osds":12,"num_up_osds":12,"osd_up_since":1771557253,"num_in_osds":12,"osd_in_since":1771557238,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":125},{"state_name":"peering","count":4}],"num_pgs":129,"num_pools":4,"num_objects":64,"data_bytes":663968,"bytes_used":366796800,"bytes_avail":9019064524800,"bytes_total":9019431321600,"inactive_pgs_ratio":0.031007751822471619,"read_bytes_sec":2175,"write_bytes_sec":511,"read_op_per_sec":4,"write_op_per_sec":0},"fsmap":{"epoch":22,"btime":"2026-02-20T03:15:25:077948+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"e","status":"up:standby-replay","gid":24515},{"filesystem_id":1,"rank":1,"name":"f","status":"up:standby-replay","gid":24517},{"filesystem_id":1,"rank":0,"name":"c","status":"up:standby-replay","gid":24523},{"filesystem_id":1,"rank":2,"name":"h","status":"up:active","gid":24533},{"filesystem_id":1,"rank":1,"name":"i","status":"up:active","gid":24538},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24560}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://10.20.193.28:8443/"}},"servicemap":{"epoch":22,"modified":"2026-02-20T03:15:28.009899+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa1180b0eb0 msgr2=0x7fa1180b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa1180b0eb0 0x7fa1180b3370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa130002410 tx=0x7fa13003a040 comp rx=0 tx=0).stop 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa14410a930 msgr2=0x7fa1441a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa14410a930 0x7fa1441a84a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa13800ef30 tx=0x7fa13800c560 comp rx=0 tx=0).stop 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 shutdown_connections 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa1180b0eb0 0x7fa1180b3370 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa14410a930 0x7fa1441a84a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa144109f70 0x7fa1441a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 --2- 10.20.193.28:0/1201531020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa144108e20 0x7fa1441a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 >> 10.20.193.28:0/1201531020 conn(0x7fa144077e70 msgr2=0x7fa14410d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 shutdown_connections 2026-02-20T03:15:28.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.142+0000 7fa148d91640 1 -- 10.20.193.28:0/1201531020 wait complete. 2026-02-20T03:15:28.159 INFO:tasks.fwd_scrub.ceph_manager:no progress seen, keeping timeout for now 2026-02-20T03:15:28.159 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T03:15:28.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.279+0000 7f41722b2640 1 -- 10.20.193.28:0/1066660223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 msgr2=0x7f416c10a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.279+0000 7f41722b2640 1 --2- 10.20.193.28:0/1066660223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 0x7f416c10a3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4160009a30 tx=0x7f416002f1c0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.279+0000 7f41722b2640 1 -- 10.20.193.28:0/1066660223 shutdown_connections 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.279+0000 7f41722b2640 1 --2- 10.20.193.28:0/1066660223 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f416c10a930 0x7f416c111250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.279+0000 7f41722b2640 1 --2- 10.20.193.28:0/1066660223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 0x7f416c10a3f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.279+0000 7f41722b2640 1 --2- 10.20.193.28:0/1066660223 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f416c108e20 0x7f416c109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.279+0000 7f41722b2640 1 -- 10.20.193.28:0/1066660223 >> 10.20.193.28:0/1066660223 conn(0x7f416c077e70 msgr2=0x7f416c07a290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.279+0000 7f41722b2640 1 -- 10.20.193.28:0/1066660223 shutdown_connections 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.279+0000 7f41722b2640 1 -- 10.20.193.28:0/1066660223 wait complete. 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.280+0000 7f41722b2640 1 Processor -- start 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.280+0000 7f41722b2640 1 -- start start 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.280+0000 7f41722b2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f416c108e20 0x7f416c1a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.280+0000 7f41722b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 0x7f416c1a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:28.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.280+0000 7f41722b2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f416c10a930 0x7f416c1a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.280+0000 7f41722b2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f416c114900 con 0x7f416c109f70 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.280+0000 7f41722b2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f416c114780 con 0x7f416c108e20 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.280+0000 7f41722b2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f416c114a80 con 0x7f416c10a930 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4170aaf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 0x7f416c1a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4170aaf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 0x7f416c1a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33714/0 (socket says 10.20.193.28:33714) 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4170aaf640 1 -- 10.20.193.28:0/2492976086 learned_addr learned my addr 10.20.193.28:0/2492976086 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f41712b0640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f416c108e20 0x7f416c1a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4171ab1640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f416c10a930 0x7f416c1a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4170aaf640 1 -- 10.20.193.28:0/2492976086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f416c10a930 msgr2=0x7f416c1a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4170aaf640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f416c10a930 0x7f416c1a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4170aaf640 1 -- 10.20.193.28:0/2492976086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f416c108e20 msgr2=0x7f416c1a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4170aaf640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f416c108e20 0x7f416c1a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4170aaf640 1 -- 10.20.193.28:0/2492976086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c1a8bc0 con 0x7f416c109f70 2026-02-20T03:15:28.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f4170aaf640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 0x7f416c1a1450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4160002410 tx=0x7f4160002980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:28.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f415a7fc640 1 -- 10.20.193.28:0/2492976086 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160004050 con 0x7f416c109f70 2026-02-20T03:15:28.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f415a7fc640 1 -- 10.20.193.28:0/2492976086 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4160038770 con 0x7f416c109f70 2026-02-20T03:15:28.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f415a7fc640 1 -- 10.20.193.28:0/2492976086 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41600417e0 con 0x7f416c109f70 2026-02-20T03:15:28.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c1a8e50 con 0x7f416c109f70 2026-02-20T03:15:28.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.281+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c1a9200 con 0x7f416c109f70 2026-02-20T03:15:28.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.282+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c10fcc0 con 0x7f416c109f70 2026-02-20T03:15:28.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.284+0000 7f415a7fc640 1 -- 10.20.193.28:0/2492976086 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f4160038920 con 0x7f416c109f70 2026-02-20T03:15:28.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.286+0000 7f415a7fc640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f41480b0eb0 0x7f41480b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:28.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.286+0000 7f415a7fc640 1 -- 10.20.193.28:0/2492976086 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f4160105870 con 0x7f416c109f70 2026-02-20T03:15:28.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.286+0000 7f41712b0640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f41480b0eb0 0x7f41480b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:28.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.286+0000 7f415a7fc640 1 -- 10.20.193.28:0/2492976086 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4160135be0 con 0x7f416c109f70 2026-02-20T03:15:28.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.286+0000 7f41712b0640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f41480b0eb0 0x7f41480b3370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f415c007c40 tx=0x7f415c0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:28.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:28 trial126 ceph-mon[38476]: osdmap e91: 12 total, 12 up, 12 in 2026-02-20T03:15:28.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:28 trial126 ceph-mon[38476]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:28.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.375+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f416c0630c0 con 0x7f41480b0eb0 2026-02-20T03:15:28.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.380+0000 7f415a7fc640 1 -- 10.20.193.28:0/2492976086 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340233 (secure 0 0 0) 0x7f416c0630c0 con 0x7f41480b0eb0 2026-02-20T03:15:28.386 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:28.389 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:28.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f41480b0eb0 msgr2=0x7f41480b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f41480b0eb0 0x7f41480b3370 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f415c007c40 tx=0x7f415c0073d0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 msgr2=0x7f416c1a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 0x7f416c1a1450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4160002410 tx=0x7f4160002980 comp rx=0 tx=0).stop 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 shutdown_connections 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f41480b0eb0 0x7f41480b3370 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f416c10a930 0x7f416c1a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f416c109f70 0x7f416c1a1450 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 --2- 10.20.193.28:0/2492976086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f416c108e20 0x7f416c1a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 >> 10.20.193.28:0/2492976086 conn(0x7f416c077e70 msgr2=0x7f416c10d420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 shutdown_connections 2026-02-20T03:15:28.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:28.384+0000 7f41722b2640 1 -- 10.20.193.28:0/2492976086 wait complete. 2026-02-20T03:15:28.399 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2026-02-20T03:15:28.009794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663968,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":329,"num_read_kb":279,"num_write":357,"num_write_kb":3843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":297,"ondisk_log_size":297,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358200,"kb_used_data":13820,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807680200,"statfs":{"total":9019431321600,"available":9019064524800,"internally_reserved":0,"allocated":14151680,"data_stored":7805222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1978,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":17,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001674"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.357986+0000","last_change":"2026-02-20T03:14:32.081180+0000","last_active":"2026-02-20T03:14:51.357986+0000","last_peered":"2026-02-20T03:14:51.357986+0000","last_clean":"2026-02-20T03:14:51.357986+0000","last_became_active":"2026-02-20T03:14:32.081083+0000","last_became_peered":"2026-02-20T03:14:32.081083+0000","last_unstale":"2026-02-20T03:14:51.357986+0000","last_undegraded":"2026-02-20T03:14:51.357986+0000","last_fullsized":"2026-02-20T03:14:51.357986+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:23:16.897948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743323+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:14:38.743323+0000","last_peered":"2026-02-20T03:14:38.743323+0000","last_clean":"2026-02-20T03:14:38.743323+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:14:38.743323+0000","last_undegraded":"2026-02-20T03:14:38.743323+0000","last_fullsized":"2026-02-20T03:14:38.743323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092834+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:26.092834+0000","last_peered":"2026-02-20T03:15:26.092834+0000","last_clean":"2026-02-20T03:15:26.092834+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:26.092834+0000","last_undegraded":"2026-02-20T03:15:26.092834+0000","last_fullsized":"2026-02-20T03:15:26.092834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743404+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:14:38.743404+0000","last_peered":"2026-02-20T03:14:38.743404+0000","last_clean":"2026-02-20T03:14:38.743404+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:14:38.743404+0000","last_undegraded":"2026-02-20T03:14:38.743404+0000","last_fullsized":"2026-02-20T03:14:38.743404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089055+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:26.089055+0000","last_peered":"2026-02-20T03:15:26.089055+0000","last_clean":"2026-02-20T03:15:26.089055+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:26.089055+0000","last_undegraded":"2026-02-20T03:15:26.089055+0000","last_fullsized":"2026-02-20T03:15:26.089055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096362+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:15:27.096362+0000","last_peered":"2026-02-20T03:15:27.096362+0000","last_clean":"2026-02-20T03:15:27.096362+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:15:27.096362+0000","last_undegraded":"2026-02-20T03:15:27.096362+0000","last_fullsized":"2026-02-20T03:15:27.096362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098104+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:26.098104+0000","last_peered":"2026-02-20T03:15:26.098104+0000","last_clean":"2026-02-20T03:15:26.098104+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:26.098104+0000","last_undegraded":"2026-02-20T03:15:26.098104+0000","last_fullsized":"2026-02-20T03:15:26.098104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096305+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:15:27.096305+0000","last_peered":"2026-02-20T03:15:27.096305+0000","last_clean":"2026-02-20T03:15:27.096305+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:15:27.096305+0000","last_undegraded":"2026-02-20T03:15:27.096305+0000","last_fullsized":"2026-02-20T03:15:27.096305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744230+0000","last_change":"2026-02-20T03:14:33.291255+0000","last_active":"2026-02-20T03:14:38.744230+0000","last_peered":"2026-02-20T03:14:38.744230+0000","last_clean":"2026-02-20T03:14:38.744230+0000","last_became_active":"2026-02-20T03:14:33.291089+0000","last_became_peered":"2026-02-20T03:14:33.291089+0000","last_unstale":"2026-02-20T03:14:38.744230+0000","last_undegraded":"2026-02-20T03:14:38.744230+0000","last_fullsized":"2026-02-20T03:14:38.744230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:42:45.321761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097517+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:15:27.097517+0000","last_peered":"2026-02-20T03:15:27.097517+0000","last_clean":"2026-02-20T03:15:27.097517+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:15:27.097517+0000","last_undegraded":"2026-02-20T03:15:27.097517+0000","last_fullsized":"2026-02-20T03:15:27.097517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742908+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:14:38.742908+0000","last_peered":"2026-02-20T03:14:38.742908+0000","last_clean":"2026-02-20T03:14:38.742908+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:14:38.742908+0000","last_undegraded":"2026-02-20T03:14:38.742908+0000","last_fullsized":"2026-02-20T03:14:38.742908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093043+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:26.093043+0000","last_peered":"2026-02-20T03:15:26.093043+0000","last_clean":"2026-02-20T03:15:26.093043+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:26.093043+0000","last_undegraded":"2026-02-20T03:15:26.093043+0000","last_fullsized":"2026-02-20T03:15:26.093043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:40.062667+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:40.062667+0000","last_peered":"2026-02-20T03:14:40.062667+0000","last_clean":"2026-02-20T03:14:40.062667+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:40.062667+0000","last_undegraded":"2026-02-20T03:14:40.062667+0000","last_fullsized":"2026-02-20T03:14:40.062667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743910+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:14:38.743910+0000","last_peered":"2026-02-20T03:14:38.743910+0000","last_clean":"2026-02-20T03:14:38.743910+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:14:38.743910+0000","last_undegraded":"2026-02-20T03:14:38.743910+0000","last_fullsized":"2026-02-20T03:14:38.743910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.351649+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:14:50.351649+0000","last_peered":"2026-02-20T03:14:50.351649+0000","last_clean":"2026-02-20T03:14:50.351649+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:14:50.351649+0000","last_undegraded":"2026-02-20T03:14:50.351649+0000","last_fullsized":"2026-02-20T03:14:50.351649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742825+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:14:38.742825+0000","last_peered":"2026-02-20T03:14:38.742825+0000","last_clean":"2026-02-20T03:14:38.742825+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:14:38.742825+0000","last_undegraded":"2026-02-20T03:14:38.742825+0000","last_fullsized":"2026-02-20T03:14:38.742825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095913+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:15:27.095913+0000","last_peered":"2026-02-20T03:15:27.095913+0000","last_clean":"2026-02-20T03:15:27.095913+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:15:27.095913+0000","last_undegraded":"2026-02-20T03:15:27.095913+0000","last_fullsized":"2026-02-20T03:15:27.095913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:50.357549+0000","last_change":"2026-02-20T03:15:26.097400+0000","last_active":"2026-02-20T03:15:26.097400+0000","last_peered":"2026-02-20T03:14:50.357549+0000","last_clean":"2026-02-20T03:14:50.357549+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357549+0000","last_undegraded":"2026-02-20T03:14:50.357549+0000","last_fullsized":"2026-02-20T03:14:50.357549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.311982+0000","last_change":"2026-02-20T03:15:26.089098+0000","last_active":"2026-02-20T03:15:26.089098+0000","last_peered":"2026-02-20T03:14:38.311982+0000","last_clean":"2026-02-20T03:14:38.311982+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311982+0000","last_undegraded":"2026-02-20T03:14:38.311982+0000","last_fullsized":"2026-02-20T03:14:38.311982+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,6,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092967+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:26.092967+0000","last_peered":"2026-02-20T03:15:26.092967+0000","last_clean":"2026-02-20T03:15:26.092967+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:26.092967+0000","last_undegraded":"2026-02-20T03:15:26.092967+0000","last_fullsized":"2026-02-20T03:15:26.092967+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743028+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:14:38.743028+0000","last_peered":"2026-02-20T03:14:38.743028+0000","last_clean":"2026-02-20T03:14:38.743028+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:14:38.743028+0000","last_undegraded":"2026-02-20T03:14:38.743028+0000","last_fullsized":"2026-02-20T03:14:38.743028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:00.293338+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:00.293338+0000","last_peered":"2026-02-20T03:15:00.293338+0000","last_clean":"2026-02-20T03:15:00.293338+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:00.293338+0000","last_undegraded":"2026-02-20T03:15:00.293338+0000","last_fullsized":"2026-02-20T03:15:00.293338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742399+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:14:38.742399+0000","last_peered":"2026-02-20T03:14:38.742399+0000","last_clean":"2026-02-20T03:14:38.742399+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:14:38.742399+0000","last_undegraded":"2026-02-20T03:14:38.742399+0000","last_fullsized":"2026-02-20T03:14:38.742399+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311146+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:14:38.311146+0000","last_peered":"2026-02-20T03:14:38.311146+0000","last_clean":"2026-02-20T03:14:38.311146+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:14:38.311146+0000","last_undegraded":"2026-02-20T03:14:38.311146+0000","last_fullsized":"2026-02-20T03:14:38.311146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352941+0000","last_change":"2026-02-20T03:14:32.081021+0000","last_active":"2026-02-20T03:14:50.352941+0000","last_peered":"2026-02-20T03:14:50.352941+0000","last_clean":"2026-02-20T03:14:50.352941+0000","last_became_active":"2026-02-20T03:14:32.080799+0000","last_became_peered":"2026-02-20T03:14:32.080799+0000","last_unstale":"2026-02-20T03:14:50.352941+0000","last_undegraded":"2026-02-20T03:14:50.352941+0000","last_fullsized":"2026-02-20T03:14:50.352941+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:15.834880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744093+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:14:38.744093+0000","last_peered":"2026-02-20T03:14:38.744093+0000","last_clean":"2026-02-20T03:14:38.744093+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:14:38.744093+0000","last_undegraded":"2026-02-20T03:14:38.744093+0000","last_fullsized":"2026-02-20T03:14:38.744093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479703+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:14:38.479703+0000","last_peered":"2026-02-20T03:14:38.479703+0000","last_clean":"2026-02-20T03:14:38.479703+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:14:38.479703+0000","last_undegraded":"2026-02-20T03:14:38.479703+0000","last_fullsized":"2026-02-20T03:14:38.479703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742701+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:14:38.742701+0000","last_peered":"2026-02-20T03:14:38.742701+0000","last_clean":"2026-02-20T03:14:38.742701+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:14:38.742701+0000","last_undegraded":"2026-02-20T03:14:38.742701+0000","last_fullsized":"2026-02-20T03:14:38.742701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095909+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:15:27.095909+0000","last_peered":"2026-02-20T03:15:27.095909+0000","last_clean":"2026-02-20T03:15:27.095909+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:15:27.095909+0000","last_undegraded":"2026-02-20T03:15:27.095909+0000","last_fullsized":"2026-02-20T03:15:27.095909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479538+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:14:38.479538+0000","last_peered":"2026-02-20T03:14:38.479538+0000","last_clean":"2026-02-20T03:14:38.479538+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:14:38.479538+0000","last_undegraded":"2026-02-20T03:14:38.479538+0000","last_fullsized":"2026-02-20T03:14:38.479538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097629+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:15:27.097629+0000","last_peered":"2026-02-20T03:15:27.097629+0000","last_clean":"2026-02-20T03:15:27.097629+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:15:27.097629+0000","last_undegraded":"2026-02-20T03:15:27.097629+0000","last_fullsized":"2026-02-20T03:15:27.097629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311210+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:14:38.311210+0000","last_peered":"2026-02-20T03:14:38.311210+0000","last_clean":"2026-02-20T03:14:38.311210+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:14:38.311210+0000","last_undegraded":"2026-02-20T03:14:38.311210+0000","last_fullsized":"2026-02-20T03:14:38.311210+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743981+0000","last_change":"2026-02-20T03:14:33.290483+0000","last_active":"2026-02-20T03:14:38.743981+0000","last_peered":"2026-02-20T03:14:38.743981+0000","last_clean":"2026-02-20T03:14:38.743981+0000","last_became_active":"2026-02-20T03:14:33.289779+0000","last_became_peered":"2026-02-20T03:14:33.289779+0000","last_unstale":"2026-02-20T03:14:38.743981+0000","last_undegraded":"2026-02-20T03:14:38.743981+0000","last_fullsized":"2026-02-20T03:14:38.743981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:45:10.985058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:21.379484+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:21.379484+0000","last_peered":"2026-02-20T03:15:21.379484+0000","last_clean":"2026-02-20T03:15:21.379484+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:21.379484+0000","last_undegraded":"2026-02-20T03:15:21.379484+0000","last_fullsized":"2026-02-20T03:15:21.379484+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311164+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:14:38.311164+0000","last_peered":"2026-02-20T03:14:38.311164+0000","last_clean":"2026-02-20T03:14:38.311164+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:14:38.311164+0000","last_undegraded":"2026-02-20T03:14:38.311164+0000","last_fullsized":"2026-02-20T03:14:38.311164+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.310925+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:14:38.310925+0000","last_peered":"2026-02-20T03:14:38.310925+0000","last_clean":"2026-02-20T03:14:38.310925+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:14:38.310925+0000","last_undegraded":"2026-02-20T03:14:38.310925+0000","last_fullsized":"2026-02-20T03:14:38.310925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097578+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:15:27.097578+0000","last_peered":"2026-02-20T03:15:27.097578+0000","last_clean":"2026-02-20T03:15:27.097578+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:15:27.097578+0000","last_undegraded":"2026-02-20T03:15:27.097578+0000","last_fullsized":"2026-02-20T03:15:27.097578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744423+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:14:38.744423+0000","last_peered":"2026-02-20T03:14:38.744423+0000","last_clean":"2026-02-20T03:14:38.744423+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:14:38.744423+0000","last_undegraded":"2026-02-20T03:14:38.744423+0000","last_fullsized":"2026-02-20T03:14:38.744423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743435+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:14:38.743435+0000","last_peered":"2026-02-20T03:14:38.743435+0000","last_clean":"2026-02-20T03:14:38.743435+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:14:38.743435+0000","last_undegraded":"2026-02-20T03:14:38.743435+0000","last_fullsized":"2026-02-20T03:14:38.743435+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":354,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097799+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:15:27.097799+0000","last_peered":"2026-02-20T03:15:27.097799+0000","last_clean":"2026-02-20T03:15:27.097799+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:15:27.097799+0000","last_undegraded":"2026-02-20T03:15:27.097799+0000","last_fullsized":"2026-02-20T03:15:27.097799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097882+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:15:27.097882+0000","last_peered":"2026-02-20T03:15:27.097882+0000","last_clean":"2026-02-20T03:15:27.097882+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:15:27.097882+0000","last_undegraded":"2026-02-20T03:15:27.097882+0000","last_fullsized":"2026-02-20T03:15:27.097882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098144+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:15:27.098144+0000","last_peered":"2026-02-20T03:15:27.098144+0000","last_clean":"2026-02-20T03:15:27.098144+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:15:27.098144+0000","last_undegraded":"2026-02-20T03:15:27.098144+0000","last_fullsized":"2026-02-20T03:15:27.098144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2026-02-20T03:14:38.744446+0000","last_change":"2026-02-20T03:15:26.460325+0000","last_active":"2026-02-20T03:15:26.460325+0000","last_peered":"2026-02-20T03:14:38.744446+0000","last_clean":"2026-02-20T03:14:38.744446+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:38.744446+0000","last_undegraded":"2026-02-20T03:14:38.744446+0000","last_fullsized":"2026-02-20T03:14:38.744446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097649+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:26.097649+0000","last_peered":"2026-02-20T03:15:26.097649+0000","last_clean":"2026-02-20T03:15:26.097649+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:26.097649+0000","last_undegraded":"2026-02-20T03:15:26.097649+0000","last_fullsized":"2026-02-20T03:15:26.097649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097824+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:15:27.097824+0000","last_peered":"2026-02-20T03:15:27.097824+0000","last_clean":"2026-02-20T03:15:27.097824+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:15:27.097824+0000","last_undegraded":"2026-02-20T03:15:27.097824+0000","last_fullsized":"2026-02-20T03:15:27.097824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744433+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:14:38.744433+0000","last_peered":"2026-02-20T03:14:38.744433+0000","last_clean":"2026-02-20T03:14:38.744433+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:14:38.744433+0000","last_undegraded":"2026-02-20T03:14:38.744433+0000","last_fullsized":"2026-02-20T03:14:38.744433+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088541+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:26.088541+0000","last_peered":"2026-02-20T03:15:26.088541+0000","last_clean":"2026-02-20T03:15:26.088541+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:26.088541+0000","last_undegraded":"2026-02-20T03:15:26.088541+0000","last_fullsized":"2026-02-20T03:15:26.088541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098225+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:15:27.098225+0000","last_peered":"2026-02-20T03:15:27.098225+0000","last_clean":"2026-02-20T03:15:27.098225+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:15:27.098225+0000","last_undegraded":"2026-02-20T03:15:27.098225+0000","last_fullsized":"2026-02-20T03:15:27.098225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311359+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:14:38.311359+0000","last_peered":"2026-02-20T03:14:38.311359+0000","last_clean":"2026-02-20T03:14:38.311359+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:14:38.311359+0000","last_undegraded":"2026-02-20T03:14:38.311359+0000","last_fullsized":"2026-02-20T03:14:38.311359+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743916+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:14:38.743916+0000","last_peered":"2026-02-20T03:14:38.743916+0000","last_clean":"2026-02-20T03:14:38.743916+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:14:38.743916+0000","last_undegraded":"2026-02-20T03:14:38.743916+0000","last_fullsized":"2026-02-20T03:14:38.743916+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744369+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:14:38.744369+0000","last_peered":"2026-02-20T03:14:38.744369+0000","last_clean":"2026-02-20T03:14:38.744369+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:14:38.744369+0000","last_undegraded":"2026-02-20T03:14:38.744369+0000","last_fullsized":"2026-02-20T03:14:38.744369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:15:27.096403+0000","last_peered":"2026-02-20T03:15:27.096403+0000","last_clean":"2026-02-20T03:15:27.096403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:15:27.096403+0000","last_undegraded":"2026-02-20T03:15:27.096403+0000","last_fullsized":"2026-02-20T03:15:27.096403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744027+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:14:38.744027+0000","last_peered":"2026-02-20T03:14:38.744027+0000","last_clean":"2026-02-20T03:14:38.744027+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:14:38.744027+0000","last_undegraded":"2026-02-20T03:14:38.744027+0000","last_fullsized":"2026-02-20T03:14:38.744027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743990+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:14:38.743990+0000","last_peered":"2026-02-20T03:14:38.743990+0000","last_clean":"2026-02-20T03:14:38.743990+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:14:38.743990+0000","last_undegraded":"2026-02-20T03:14:38.743990+0000","last_fullsized":"2026-02-20T03:14:38.743990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095895+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:15:27.095895+0000","last_peered":"2026-02-20T03:15:27.095895+0000","last_clean":"2026-02-20T03:15:27.095895+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:15:27.095895+0000","last_undegraded":"2026-02-20T03:15:27.095895+0000","last_fullsized":"2026-02-20T03:15:27.095895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311328+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:14:38.311328+0000","last_peered":"2026-02-20T03:14:38.311328+0000","last_clean":"2026-02-20T03:14:38.311328+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:14:38.311328+0000","last_undegraded":"2026-02-20T03:14:38.311328+0000","last_fullsized":"2026-02-20T03:14:38.311328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097367+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:15:27.097367+0000","last_peered":"2026-02-20T03:15:27.097367+0000","last_clean":"2026-02-20T03:15:27.097367+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:15:27.097367+0000","last_undegraded":"2026-02-20T03:15:27.097367+0000","last_fullsized":"2026-02-20T03:15:27.097367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:23.388416+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:23.388416+0000","last_peered":"2026-02-20T03:15:23.388416+0000","last_clean":"2026-02-20T03:15:23.388416+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:23.388416+0000","last_undegraded":"2026-02-20T03:15:23.388416+0000","last_fullsized":"2026-02-20T03:15:23.388416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743149+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:14:38.743149+0000","last_peered":"2026-02-20T03:14:38.743149+0000","last_clean":"2026-02-20T03:14:38.743149+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:14:38.743149+0000","last_undegraded":"2026-02-20T03:14:38.743149+0000","last_fullsized":"2026-02-20T03:14:38.743149+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097787+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:15:27.097787+0000","last_peered":"2026-02-20T03:15:27.097787+0000","last_clean":"2026-02-20T03:15:27.097787+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:15:27.097787+0000","last_undegraded":"2026-02-20T03:15:27.097787+0000","last_fullsized":"2026-02-20T03:15:27.097787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352270+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:14:50.352270+0000","last_peered":"2026-02-20T03:14:50.352270+0000","last_clean":"2026-02-20T03:14:50.352270+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:14:50.352270+0000","last_undegraded":"2026-02-20T03:14:50.352270+0000","last_fullsized":"2026-02-20T03:14:50.352270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744179+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:14:38.744179+0000","last_peered":"2026-02-20T03:14:38.744179+0000","last_clean":"2026-02-20T03:14:38.744179+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:14:38.744179+0000","last_undegraded":"2026-02-20T03:14:38.744179+0000","last_fullsized":"2026-02-20T03:14:38.744179+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311740+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:14:38.311740+0000","last_peered":"2026-02-20T03:14:38.311740+0000","last_clean":"2026-02-20T03:14:38.311740+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:14:38.311740+0000","last_undegraded":"2026-02-20T03:14:38.311740+0000","last_fullsized":"2026-02-20T03:14:38.311740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093258+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:26.093258+0000","last_peered":"2026-02-20T03:15:26.093258+0000","last_clean":"2026-02-20T03:15:26.093258+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:26.093258+0000","last_undegraded":"2026-02-20T03:15:26.093258+0000","last_fullsized":"2026-02-20T03:15:26.093258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744303+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:14:38.744303+0000","last_peered":"2026-02-20T03:14:38.744303+0000","last_clean":"2026-02-20T03:14:38.744303+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:14:38.744303+0000","last_undegraded":"2026-02-20T03:14:38.744303+0000","last_fullsized":"2026-02-20T03:14:38.744303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096216+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:15:27.096216+0000","last_peered":"2026-02-20T03:15:27.096216+0000","last_clean":"2026-02-20T03:15:27.096216+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:15:27.096216+0000","last_undegraded":"2026-02-20T03:15:27.096216+0000","last_fullsized":"2026-02-20T03:15:27.096216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":132,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:24.392752+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:24.392752+0000","last_peered":"2026-02-20T03:15:24.392752+0000","last_clean":"2026-02-20T03:15:24.392752+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:24.392752+0000","last_undegraded":"2026-02-20T03:15:24.392752+0000","last_fullsized":"2026-02-20T03:15:24.392752+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69334,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":76,"num_read_kb":106,"num_write":34,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742256+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:14:38.742256+0000","last_peered":"2026-02-20T03:14:38.742256+0000","last_clean":"2026-02-20T03:14:38.742256+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:14:38.742256+0000","last_undegraded":"2026-02-20T03:14:38.742256+0000","last_fullsized":"2026-02-20T03:14:38.742256+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098166+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:26.098166+0000","last_peered":"2026-02-20T03:15:26.098166+0000","last_clean":"2026-02-20T03:15:26.098166+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:26.098166+0000","last_undegraded":"2026-02-20T03:15:26.098166+0000","last_fullsized":"2026-02-20T03:15:26.098166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.352990+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:14:50.352990+0000","last_peered":"2026-02-20T03:14:50.352990+0000","last_clean":"2026-02-20T03:14:50.352990+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:14:50.352990+0000","last_undegraded":"2026-02-20T03:14:50.352990+0000","last_fullsized":"2026-02-20T03:14:50.352990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089065+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:26.089065+0000","last_peered":"2026-02-20T03:15:26.089065+0000","last_clean":"2026-02-20T03:15:26.089065+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:26.089065+0000","last_undegraded":"2026-02-20T03:15:26.089065+0000","last_fullsized":"2026-02-20T03:15:26.089065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098009+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:15:27.098009+0000","last_peered":"2026-02-20T03:15:27.098009+0000","last_clean":"2026-02-20T03:15:27.098009+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:15:27.098009+0000","last_undegraded":"2026-02-20T03:15:27.098009+0000","last_fullsized":"2026-02-20T03:15:27.098009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743191+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:14:38.743191+0000","last_peered":"2026-02-20T03:14:38.743191+0000","last_clean":"2026-02-20T03:14:38.743191+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:14:38.743191+0000","last_undegraded":"2026-02-20T03:14:38.743191+0000","last_fullsized":"2026-02-20T03:14:38.743191+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098167+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:26.098167+0000","last_peered":"2026-02-20T03:15:26.098167+0000","last_clean":"2026-02-20T03:15:26.098167+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:26.098167+0000","last_undegraded":"2026-02-20T03:15:26.098167+0000","last_fullsized":"2026-02-20T03:15:26.098167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:24.079702+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:24.079702+0000","last_peered":"2026-02-20T03:15:24.079702+0000","last_clean":"2026-02-20T03:15:24.079702+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:24.079702+0000","last_undegraded":"2026-02-20T03:15:24.079702+0000","last_fullsized":"2026-02-20T03:15:24.079702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743127+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:14:38.743127+0000","last_peered":"2026-02-20T03:14:38.743127+0000","last_clean":"2026-02-20T03:14:38.743127+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:14:38.743127+0000","last_undegraded":"2026-02-20T03:14:38.743127+0000","last_fullsized":"2026-02-20T03:14:38.743127+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088557+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:26.088557+0000","last_peered":"2026-02-20T03:15:26.088557+0000","last_clean":"2026-02-20T03:15:26.088557+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:26.088557+0000","last_undegraded":"2026-02-20T03:15:26.088557+0000","last_fullsized":"2026-02-20T03:15:26.088557+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742536+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:14:38.742536+0000","last_peered":"2026-02-20T03:14:38.742536+0000","last_clean":"2026-02-20T03:14:38.742536+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:14:38.742536+0000","last_undegraded":"2026-02-20T03:14:38.742536+0000","last_fullsized":"2026-02-20T03:14:38.742536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744067+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:14:38.744067+0000","last_peered":"2026-02-20T03:14:38.744067+0000","last_clean":"2026-02-20T03:14:38.744067+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:14:38.744067+0000","last_undegraded":"2026-02-20T03:14:38.744067+0000","last_fullsized":"2026-02-20T03:14:38.744067+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744459+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:14:38.744459+0000","last_peered":"2026-02-20T03:14:38.744459+0000","last_clean":"2026-02-20T03:14:38.744459+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:14:38.744459+0000","last_undegraded":"2026-02-20T03:14:38.744459+0000","last_fullsized":"2026-02-20T03:14:38.744459+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742665+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:14:38.742665+0000","last_peered":"2026-02-20T03:14:38.742665+0000","last_clean":"2026-02-20T03:14:38.742665+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:14:38.742665+0000","last_undegraded":"2026-02-20T03:14:38.742665+0000","last_fullsized":"2026-02-20T03:14:38.742665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.356776+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:14:51.356776+0000","last_peered":"2026-02-20T03:14:51.356776+0000","last_clean":"2026-02-20T03:14:51.356776+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:14:51.356776+0000","last_undegraded":"2026-02-20T03:14:51.356776+0000","last_fullsized":"2026-02-20T03:14:51.356776+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:51.361797+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:14:51.361797+0000","last_peered":"2026-02-20T03:14:51.361797+0000","last_clean":"2026-02-20T03:14:51.361797+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:14:51.361797+0000","last_undegraded":"2026-02-20T03:14:51.361797+0000","last_fullsized":"2026-02-20T03:14:51.361797+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744227+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:14:38.744227+0000","last_peered":"2026-02-20T03:14:38.744227+0000","last_clean":"2026-02-20T03:14:38.744227+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:14:38.744227+0000","last_undegraded":"2026-02-20T03:14:38.744227+0000","last_fullsized":"2026-02-20T03:14:38.744227+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093296+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:26.093296+0000","last_peered":"2026-02-20T03:15:26.093296+0000","last_clean":"2026-02-20T03:15:26.093296+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:26.093296+0000","last_undegraded":"2026-02-20T03:15:26.093296+0000","last_fullsized":"2026-02-20T03:15:26.093296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'5","reported_seq":62,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:22.379029+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:22.379029+0000","last_peered":"2026-02-20T03:15:22.379029+0000","last_clean":"2026-02-20T03:15:22.379029+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:22.379029+0000","last_undegraded":"2026-02-20T03:15:22.379029+0000","last_fullsized":"2026-02-20T03:15:22.379029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096098+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:15:27.096098+0000","last_peered":"2026-02-20T03:15:27.096098+0000","last_clean":"2026-02-20T03:15:27.096098+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:15:27.096098+0000","last_undegraded":"2026-02-20T03:15:27.096098+0000","last_fullsized":"2026-02-20T03:15:27.096098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093320+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:26.093320+0000","last_peered":"2026-02-20T03:15:26.093320+0000","last_clean":"2026-02-20T03:15:26.093320+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:26.093320+0000","last_undegraded":"2026-02-20T03:15:26.093320+0000","last_fullsized":"2026-02-20T03:15:26.093320+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743873+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:14:38.743873+0000","last_peered":"2026-02-20T03:14:38.743873+0000","last_clean":"2026-02-20T03:14:38.743873+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:14:38.743873+0000","last_undegraded":"2026-02-20T03:14:38.743873+0000","last_fullsized":"2026-02-20T03:14:38.743873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093050+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:26.093050+0000","last_peered":"2026-02-20T03:15:26.093050+0000","last_clean":"2026-02-20T03:15:26.093050+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:26.093050+0000","last_undegraded":"2026-02-20T03:15:26.093050+0000","last_fullsized":"2026-02-20T03:15:26.093050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093067+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:26.093067+0000","last_peered":"2026-02-20T03:15:26.093067+0000","last_clean":"2026-02-20T03:15:26.093067+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:26.093067+0000","last_undegraded":"2026-02-20T03:15:26.093067+0000","last_fullsized":"2026-02-20T03:15:26.093067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088712+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:26.088712+0000","last_peered":"2026-02-20T03:15:26.088712+0000","last_clean":"2026-02-20T03:15:26.088712+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:26.088712+0000","last_undegraded":"2026-02-20T03:15:26.088712+0000","last_fullsized":"2026-02-20T03:15:26.088712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311110+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:14:38.311110+0000","last_peered":"2026-02-20T03:14:38.311110+0000","last_clean":"2026-02-20T03:14:38.311110+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:14:38.311110+0000","last_undegraded":"2026-02-20T03:14:38.311110+0000","last_fullsized":"2026-02-20T03:14:38.311110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744275+0000","last_change":"2026-02-20T03:14:33.290769+0000","last_active":"2026-02-20T03:14:38.744275+0000","last_peered":"2026-02-20T03:14:38.744275+0000","last_clean":"2026-02-20T03:14:38.744275+0000","last_became_active":"2026-02-20T03:14:33.290406+0000","last_became_peered":"2026-02-20T03:14:33.290406+0000","last_unstale":"2026-02-20T03:14:38.744275+0000","last_undegraded":"2026-02-20T03:14:38.744275+0000","last_fullsized":"2026-02-20T03:14:38.744275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:58.991965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093494+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:26.093494+0000","last_peered":"2026-02-20T03:15:26.093494+0000","last_clean":"2026-02-20T03:15:26.093494+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:26.093494+0000","last_undegraded":"2026-02-20T03:15:26.093494+0000","last_fullsized":"2026-02-20T03:15:26.093494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742977+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:14:38.742977+0000","last_peered":"2026-02-20T03:14:38.742977+0000","last_clean":"2026-02-20T03:14:38.742977+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:14:38.742977+0000","last_undegraded":"2026-02-20T03:14:38.742977+0000","last_fullsized":"2026-02-20T03:14:38.742977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743959+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:14:38.743959+0000","last_peered":"2026-02-20T03:14:38.743959+0000","last_clean":"2026-02-20T03:14:38.743959+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:14:38.743959+0000","last_undegraded":"2026-02-20T03:14:38.743959+0000","last_fullsized":"2026-02-20T03:14:38.743959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.743157+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:14:38.743157+0000","last_peered":"2026-02-20T03:14:38.743157+0000","last_clean":"2026-02-20T03:14:38.743157+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:14:38.743157+0000","last_undegraded":"2026-02-20T03:14:38.743157+0000","last_fullsized":"2026-02-20T03:14:38.743157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097832+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:26.097832+0000","last_peered":"2026-02-20T03:15:26.097832+0000","last_clean":"2026-02-20T03:15:26.097832+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:26.097832+0000","last_undegraded":"2026-02-20T03:15:26.097832+0000","last_fullsized":"2026-02-20T03:15:26.097832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311289+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:14:38.311289+0000","last_peered":"2026-02-20T03:14:38.311289+0000","last_clean":"2026-02-20T03:14:38.311289+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:14:38.311289+0000","last_undegraded":"2026-02-20T03:14:38.311289+0000","last_fullsized":"2026-02-20T03:14:38.311289+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744096+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:14:38.744096+0000","last_peered":"2026-02-20T03:14:38.744096+0000","last_clean":"2026-02-20T03:14:38.744096+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:14:38.744096+0000","last_undegraded":"2026-02-20T03:14:38.744096+0000","last_fullsized":"2026-02-20T03:14:38.744096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093417+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:26.093417+0000","last_peered":"2026-02-20T03:15:26.093417+0000","last_clean":"2026-02-20T03:15:26.093417+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:26.093417+0000","last_undegraded":"2026-02-20T03:15:26.093417+0000","last_fullsized":"2026-02-20T03:15:26.093417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742612+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:14:38.742612+0000","last_peered":"2026-02-20T03:14:38.742612+0000","last_clean":"2026-02-20T03:14:38.742612+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:14:38.742612+0000","last_undegraded":"2026-02-20T03:14:38.742612+0000","last_fullsized":"2026-02-20T03:14:38.742612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744492+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:14:38.744492+0000","last_peered":"2026-02-20T03:14:38.744492+0000","last_clean":"2026-02-20T03:14:38.744492+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:14:38.744492+0000","last_undegraded":"2026-02-20T03:14:38.744492+0000","last_fullsized":"2026-02-20T03:14:38.744492+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097561+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:26.097561+0000","last_peered":"2026-02-20T03:15:26.097561+0000","last_clean":"2026-02-20T03:15:26.097561+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:26.097561+0000","last_undegraded":"2026-02-20T03:15:26.097561+0000","last_fullsized":"2026-02-20T03:15:26.097561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088395+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:26.088395+0000","last_peered":"2026-02-20T03:15:26.088395+0000","last_clean":"2026-02-20T03:15:26.088395+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:26.088395+0000","last_undegraded":"2026-02-20T03:15:26.088395+0000","last_fullsized":"2026-02-20T03:15:26.088395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088313+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:26.088313+0000","last_peered":"2026-02-20T03:15:26.088313+0000","last_clean":"2026-02-20T03:15:26.088313+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:26.088313+0000","last_undegraded":"2026-02-20T03:15:26.088313+0000","last_fullsized":"2026-02-20T03:15:26.088313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.311264+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:14:38.311264+0000","last_peered":"2026-02-20T03:14:38.311264+0000","last_clean":"2026-02-20T03:14:38.311264+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:14:38.311264+0000","last_undegraded":"2026-02-20T03:14:38.311264+0000","last_fullsized":"2026-02-20T03:14:38.311264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098066+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:15:27.098066+0000","last_peered":"2026-02-20T03:15:27.098066+0000","last_clean":"2026-02-20T03:15:27.098066+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:15:27.098066+0000","last_undegraded":"2026-02-20T03:15:27.098066+0000","last_fullsized":"2026-02-20T03:15:27.098066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479875+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:14:38.479875+0000","last_peered":"2026-02-20T03:14:38.479875+0000","last_clean":"2026-02-20T03:14:38.479875+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:14:38.479875+0000","last_undegraded":"2026-02-20T03:14:38.479875+0000","last_fullsized":"2026-02-20T03:14:38.479875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.749677+0000","last_change":"2026-02-20T03:15:26.098509+0000","last_active":"2026-02-20T03:15:26.098509+0000","last_peered":"2026-02-20T03:14:38.749677+0000","last_clean":"2026-02-20T03:14:38.749677+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749677+0000","last_undegraded":"2026-02-20T03:14:38.749677+0000","last_fullsized":"2026-02-20T03:14:38.749677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.742670+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:14:38.742670+0000","last_peered":"2026-02-20T03:14:38.742670+0000","last_clean":"2026-02-20T03:14:38.742670+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:14:38.742670+0000","last_undegraded":"2026-02-20T03:14:38.742670+0000","last_fullsized":"2026-02-20T03:14:38.742670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097349+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:15:27.097349+0000","last_peered":"2026-02-20T03:15:27.097349+0000","last_clean":"2026-02-20T03:15:27.097349+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:15:27.097349+0000","last_undegraded":"2026-02-20T03:15:27.097349+0000","last_fullsized":"2026-02-20T03:15:27.097349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.479297+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:14:38.479297+0000","last_peered":"2026-02-20T03:14:38.479297+0000","last_clean":"2026-02-20T03:14:38.479297+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:14:38.479297+0000","last_undegraded":"2026-02-20T03:14:38.479297+0000","last_fullsized":"2026-02-20T03:14:38.479297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088720+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:26.088720+0000","last_peered":"2026-02-20T03:15:26.088720+0000","last_clean":"2026-02-20T03:15:26.088720+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:26.088720+0000","last_undegraded":"2026-02-20T03:15:26.088720+0000","last_fullsized":"2026-02-20T03:15:26.088720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088833+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:26.088833+0000","last_peered":"2026-02-20T03:15:26.088833+0000","last_clean":"2026-02-20T03:15:26.088833+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:26.088833+0000","last_undegraded":"2026-02-20T03:15:26.088833+0000","last_fullsized":"2026-02-20T03:15:26.088833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.744466+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:14:38.744466+0000","last_peered":"2026-02-20T03:14:38.744466+0000","last_clean":"2026-02-20T03:14:38.744466+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:14:38.744466+0000","last_undegraded":"2026-02-20T03:14:38.744466+0000","last_fullsized":"2026-02-20T03:14:38.744466+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73366,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":223,"num_read_kb":188,"num_write":166,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":438272,"data_stored":220688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383696,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971104,"statfs":{"total":751619276800,"available":751586410496,"internally_reserved":0,"allocated":995328,"data_stored":484050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612626,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32776,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970424,"statfs":{"total":751619276800,"available":751585714176,"internally_reserved":0,"allocated":1691648,"data_stored":1140738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776148,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":488382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037783,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32132,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971068,"statfs":{"total":751619276800,"available":751586373632,"internally_reserved":0,"allocated":1028096,"data_stored":493740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299417,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32712,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970488,"statfs":{"total":751619276800,"available":751585779712,"internally_reserved":0,"allocated":1622016,"data_stored":1089956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462938,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":479452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724573,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28540,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974660,"statfs":{"total":751619276800,"available":751590051840,"internally_reserved":0,"allocated":1613824,"data_stored":1075312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888095,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971096,"statfs":{"total":751619276800,"available":751586402304,"internally_reserved":0,"allocated":1003520,"data_stored":484494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149729,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27944,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975256,"statfs":{"total":751619276800,"available":751590662144,"internally_reserved":0,"allocated":1003520,"data_stored":479646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378660,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28048,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975152,"statfs":{"total":751619276800,"available":751590555648,"internally_reserved":0,"allocated":1105920,"data_stored":559896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28004,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975196,"statfs":{"total":751619276800,"available":751590600704,"internally_reserved":0,"allocated":1064960,"data_stored":548696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":480860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:28.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:28 trial177 ceph-mon[43181]: osdmap e91: 12 total, 12 up, 12 in 2026-02-20T03:15:28.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:28 trial177 ceph-mon[43181]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:29.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:29 trial028 ceph-mon[38552]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:29.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:29 trial028 ceph-mon[38552]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:29.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:29 trial028 ceph-mon[38552]: pgmap v202: 129 pgs: 4 peering, 125 active+clean; 648 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 511 B/s wr, 4 op/s 2026-02-20T03:15:29.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:29 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1201531020' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-20T03:15:29.368 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:29 trial177 ceph-mon[43181]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:29.368 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:29 trial177 ceph-mon[43181]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:29.368 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:29 trial177 ceph-mon[43181]: pgmap v202: 129 pgs: 4 peering, 125 active+clean; 648 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 511 B/s wr, 4 op/s 2026-02-20T03:15:29.368 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:29 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1201531020' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-20T03:15:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:29 trial126 ceph-mon[38476]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:29 trial126 ceph-mon[38476]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:29 trial126 ceph-mon[38476]: pgmap v202: 129 pgs: 4 peering, 125 active+clean; 648 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.1 KiB/s rd, 511 B/s wr, 4 op/s 2026-02-20T03:15:29.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:29 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1201531020' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-20T03:15:30.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:30 trial028 ceph-mon[38552]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:30.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:30 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:15:30.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:30 trial177 ceph-mon[43181]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:30.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:30 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:15:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:30 trial126 ceph-mon[38476]: from='client.15189 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:30.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:30 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:15:31.409 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T03:15:31.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:31 trial028 ceph-mon[38552]: pgmap v203: 129 pgs: 4 peering, 125 active+clean; 653 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 76 B/s, 0 objects/s recovering 2026-02-20T03:15:31.463 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.463 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.463 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.463 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.463 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.463 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:31 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:31 trial177 ceph-mon[43181]: pgmap v203: 129 pgs: 4 peering, 125 active+clean; 653 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 76 B/s, 0 objects/s recovering 2026-02-20T03:15:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:31 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.536+0000 7f1b65dbc640 1 -- 10.20.193.28:0/96934346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b601064d0 msgr2=0x7f1b6010cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.536+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/96934346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b601064d0 0x7f1b6010cd60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009f90 tx=0x7f1b5c02f390 comp rx=0 tx=0).stop 2026-02-20T03:15:31.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.536+0000 7f1b65dbc640 1 -- 10.20.193.28:0/96934346 shutdown_connections 2026-02-20T03:15:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.536+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/96934346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b601064d0 0x7f1b6010cd60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.536+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/96934346 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b60105b10 0x7f1b60105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.536+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/96934346 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b60104920 0x7f1b60104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.536+0000 7f1b65dbc640 1 -- 10.20.193.28:0/96934346 >> 10.20.193.28:0/96934346 conn(0x7f1b60100080 msgr2=0x7f1b601024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.536+0000 7f1b65dbc640 1 -- 10.20.193.28:0/96934346 shutdown_connections 2026-02-20T03:15:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.536+0000 7f1b65dbc640 1 -- 10.20.193.28:0/96934346 wait complete. 2026-02-20T03:15:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b65dbc640 1 Processor -- start 2026-02-20T03:15:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b65dbc640 1 -- start start 2026-02-20T03:15:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b65dbc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b60104920 0x7f1b6019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b65dbc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b60105b10 0x7f1b6019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b65dbc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b601064d0 0x7f1b601a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b65dbc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b601103f0 con 0x7f1b60105b10 2026-02-20T03:15:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b65dbc640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b60110270 con 0x7f1b60104920 2026-02-20T03:15:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b65dbc640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b60110570 con 0x7f1b601064d0 2026-02-20T03:15:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b64dba640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b60104920 0x7f1b6019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b57fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b60105b10 0x7f1b6019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b64dba640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b60104920 0x7f1b6019c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:33596/0 (socket says 10.20.193.28:33596) 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b64dba640 1 -- 10.20.193.28:0/4152954678 learned_addr learned my addr 10.20.193.28:0/4152954678 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b655bb640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b601064d0 0x7f1b601a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b57fff640 1 -- 10.20.193.28:0/4152954678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b601064d0 msgr2=0x7f1b601a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.537+0000 7f1b57fff640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b601064d0 0x7f1b601a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.538+0000 7f1b57fff640 1 -- 10.20.193.28:0/4152954678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b60104920 msgr2=0x7f1b6019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.538+0000 7f1b57fff640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b60104920 0x7f1b6019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.538+0000 7f1b57fff640 1 -- 10.20.193.28:0/4152954678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b601a45f0 con 0x7f1b60105b10 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.538+0000 7f1b57fff640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b60105b10 0x7f1b6019ce80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800e9f0 tx=0x7f1b4800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.538+0000 7f1b55ffb640 1 -- 10.20.193.28:0/4152954678 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800cd80 con 0x7f1b60105b10 2026-02-20T03:15:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.538+0000 7f1b55ffb640 1 -- 10.20.193.28:0/4152954678 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b48004570 con 0x7f1b60105b10 2026-02-20T03:15:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.538+0000 7f1b55ffb640 1 -- 10.20.193.28:0/4152954678 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48010690 con 0x7f1b60105b10 2026-02-20T03:15:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.538+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b601a48e0 con 0x7f1b60105b10 2026-02-20T03:15:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.538+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b601a4de0 con 0x7f1b60105b10 2026-02-20T03:15:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.539+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6010b6d0 con 0x7f1b60105b10 2026-02-20T03:15:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.541+0000 7f1b55ffb640 1 -- 10.20.193.28:0/4152954678 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f1b48020030 con 0x7f1b60105b10 2026-02-20T03:15:31.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.543+0000 7f1b55ffb640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b3c0b0eb0 0x7f1b3c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:31.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.543+0000 7f1b55ffb640 1 -- 10.20.193.28:0/4152954678 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f1b480e0c50 con 0x7f1b60105b10 2026-02-20T03:15:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.543+0000 7f1b64dba640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b3c0b0eb0 0x7f1b3c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.543+0000 7f1b55ffb640 1 -- 10.20.193.28:0/4152954678 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1b480e10d0 con 0x7f1b60105b10 2026-02-20T03:15:31.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.543+0000 7f1b64dba640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b3c0b0eb0 0x7f1b3c0b3370 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1b500097c0 tx=0x7f1b50009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:31 trial126 ceph-mon[38476]: pgmap v203: 129 pgs: 4 peering, 125 active+clean; 653 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 76 B/s, 0 objects/s recovering 2026-02-20T03:15:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.599 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:31 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:31.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.633+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b600630c0 con 0x7f1b3c0b0eb0 2026-02-20T03:15:31.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.639+0000 7f1b55ffb640 1 -- 10.20.193.28:0/4152954678 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340251 (secure 0 0 0) 0x7f1b600630c0 con 0x7f1b3c0b0eb0 2026-02-20T03:15:31.644 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:31.647 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:31.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.641+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b3c0b0eb0 msgr2=0x7f1b3c0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.641+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b3c0b0eb0 0x7f1b3c0b3370 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1b500097c0 tx=0x7f1b50009340 comp rx=0 tx=0).stop 2026-02-20T03:15:31.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.641+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b60105b10 msgr2=0x7f1b6019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.641+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b60105b10 0x7f1b6019ce80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800e9f0 tx=0x7f1b4800eec0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.642+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 shutdown_connections 2026-02-20T03:15:31.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.642+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b3c0b0eb0 0x7f1b3c0b3370 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.642+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b601064d0 0x7f1b601a3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.642+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b60105b10 0x7f1b6019ce80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.642+0000 7f1b65dbc640 1 --2- 10.20.193.28:0/4152954678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b60104920 0x7f1b6019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.642+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 >> 10.20.193.28:0/4152954678 conn(0x7f1b60100080 msgr2=0x7f1b60108e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:31.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.642+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 shutdown_connections 2026-02-20T03:15:31.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.642+0000 7f1b65dbc640 1 -- 10.20.193.28:0/4152954678 wait complete. 2026-02-20T03:15:31.657 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2026-02-20T03:15:30.010150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668673,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":355,"num_read_kb":299,"num_write":359,"num_write_kb":3849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181350,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358440,"kb_used_data":14020,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807679960,"statfs":{"total":9019431321600,"available":9019064279040,"internally_reserved":0,"allocated":14356480,"data_stored":7923289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6683,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":37,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":614,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001574"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.389259+0000","last_change":"2026-02-20T03:15:27.389259+0000","last_active":"2026-02-20T03:15:27.389259+0000","last_peered":"2026-02-20T03:15:27.389259+0000","last_clean":"2026-02-20T03:15:27.389259+0000","last_became_active":"2026-02-20T03:15:27.385887+0000","last_became_peered":"2026-02-20T03:15:27.385887+0000","last_unstale":"2026-02-20T03:15:27.389259+0000","last_undegraded":"2026-02-20T03:15:27.389259+0000","last_fullsized":"2026-02-20T03:15:27.389259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:20:01.907763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677322+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:15:27.677322+0000","last_peered":"2026-02-20T03:15:27.677322+0000","last_clean":"2026-02-20T03:15:27.677322+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:15:27.677322+0000","last_undegraded":"2026-02-20T03:15:27.677322+0000","last_fullsized":"2026-02-20T03:15:27.677322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092834+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:26.092834+0000","last_peered":"2026-02-20T03:15:26.092834+0000","last_clean":"2026-02-20T03:15:26.092834+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:26.092834+0000","last_undegraded":"2026-02-20T03:15:26.092834+0000","last_fullsized":"2026-02-20T03:15:26.092834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677381+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:15:27.677381+0000","last_peered":"2026-02-20T03:15:27.677381+0000","last_clean":"2026-02-20T03:15:27.677381+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:15:27.677381+0000","last_undegraded":"2026-02-20T03:15:27.677381+0000","last_fullsized":"2026-02-20T03:15:27.677381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089055+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:26.089055+0000","last_peered":"2026-02-20T03:15:26.089055+0000","last_clean":"2026-02-20T03:15:26.089055+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:26.089055+0000","last_undegraded":"2026-02-20T03:15:26.089055+0000","last_fullsized":"2026-02-20T03:15:26.089055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096362+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:15:27.096362+0000","last_peered":"2026-02-20T03:15:27.096362+0000","last_clean":"2026-02-20T03:15:27.096362+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:15:27.096362+0000","last_undegraded":"2026-02-20T03:15:27.096362+0000","last_fullsized":"2026-02-20T03:15:27.096362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098104+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:26.098104+0000","last_peered":"2026-02-20T03:15:26.098104+0000","last_clean":"2026-02-20T03:15:26.098104+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:26.098104+0000","last_undegraded":"2026-02-20T03:15:26.098104+0000","last_fullsized":"2026-02-20T03:15:26.098104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096305+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:15:27.096305+0000","last_peered":"2026-02-20T03:15:27.096305+0000","last_clean":"2026-02-20T03:15:27.096305+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:15:27.096305+0000","last_undegraded":"2026-02-20T03:15:27.096305+0000","last_fullsized":"2026-02-20T03:15:27.096305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096792+0000","last_change":"2026-02-20T03:15:27.096792+0000","last_active":"2026-02-20T03:15:27.096792+0000","last_peered":"2026-02-20T03:15:27.096792+0000","last_clean":"2026-02-20T03:15:27.096792+0000","last_became_active":"2026-02-20T03:15:27.096659+0000","last_became_peered":"2026-02-20T03:15:27.096659+0000","last_unstale":"2026-02-20T03:15:27.096792+0000","last_undegraded":"2026-02-20T03:15:27.096792+0000","last_fullsized":"2026-02-20T03:15:27.096792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:57.312267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097517+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:15:27.097517+0000","last_peered":"2026-02-20T03:15:27.097517+0000","last_clean":"2026-02-20T03:15:27.097517+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:15:27.097517+0000","last_undegraded":"2026-02-20T03:15:27.097517+0000","last_fullsized":"2026-02-20T03:15:27.097517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677473+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:15:27.677473+0000","last_peered":"2026-02-20T03:15:27.677473+0000","last_clean":"2026-02-20T03:15:27.677473+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:15:27.677473+0000","last_undegraded":"2026-02-20T03:15:27.677473+0000","last_fullsized":"2026-02-20T03:15:27.677473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093043+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:26.093043+0000","last_peered":"2026-02-20T03:15:26.093043+0000","last_clean":"2026-02-20T03:15:26.093043+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:26.093043+0000","last_undegraded":"2026-02-20T03:15:26.093043+0000","last_fullsized":"2026-02-20T03:15:26.093043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:40.062667+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:40.062667+0000","last_peered":"2026-02-20T03:14:40.062667+0000","last_clean":"2026-02-20T03:14:40.062667+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:40.062667+0000","last_undegraded":"2026-02-20T03:14:40.062667+0000","last_fullsized":"2026-02-20T03:14:40.062667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677054+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:15:27.677054+0000","last_peered":"2026-02-20T03:15:27.677054+0000","last_clean":"2026-02-20T03:15:27.677054+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:15:27.677054+0000","last_undegraded":"2026-02-20T03:15:27.677054+0000","last_fullsized":"2026-02-20T03:15:27.677054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092084+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:15:27.092084+0000","last_peered":"2026-02-20T03:15:27.092084+0000","last_clean":"2026-02-20T03:15:27.092084+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:15:27.092084+0000","last_undegraded":"2026-02-20T03:15:27.092084+0000","last_fullsized":"2026-02-20T03:15:27.092084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095913+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:15:27.095913+0000","last_peered":"2026-02-20T03:15:27.095913+0000","last_clean":"2026-02-20T03:15:27.095913+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:15:27.095913+0000","last_undegraded":"2026-02-20T03:15:27.095913+0000","last_fullsized":"2026-02-20T03:15:27.095913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:50.357549+0000","last_change":"2026-02-20T03:15:26.097400+0000","last_active":"2026-02-20T03:15:26.097400+0000","last_peered":"2026-02-20T03:14:50.357549+0000","last_clean":"2026-02-20T03:14:50.357549+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357549+0000","last_undegraded":"2026-02-20T03:14:50.357549+0000","last_fullsized":"2026-02-20T03:14:50.357549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.311982+0000","last_change":"2026-02-20T03:15:26.089098+0000","last_active":"2026-02-20T03:15:26.089098+0000","last_peered":"2026-02-20T03:14:38.311982+0000","last_clean":"2026-02-20T03:14:38.311982+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311982+0000","last_undegraded":"2026-02-20T03:14:38.311982+0000","last_fullsized":"2026-02-20T03:14:38.311982+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,6,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092967+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:26.092967+0000","last_peered":"2026-02-20T03:15:26.092967+0000","last_clean":"2026-02-20T03:15:26.092967+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:26.092967+0000","last_undegraded":"2026-02-20T03:15:26.092967+0000","last_fullsized":"2026-02-20T03:15:26.092967+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677369+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:15:27.677369+0000","last_peered":"2026-02-20T03:15:27.677369+0000","last_clean":"2026-02-20T03:15:27.677369+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:15:27.677369+0000","last_undegraded":"2026-02-20T03:15:27.677369+0000","last_fullsized":"2026-02-20T03:15:27.677369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092065+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:27.092065+0000","last_peered":"2026-02-20T03:15:27.092065+0000","last_clean":"2026-02-20T03:15:27.092065+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:27.092065+0000","last_undegraded":"2026-02-20T03:15:27.092065+0000","last_fullsized":"2026-02-20T03:15:27.092065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676826+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:15:27.676826+0000","last_peered":"2026-02-20T03:15:27.676826+0000","last_clean":"2026-02-20T03:15:27.676826+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:15:27.676826+0000","last_undegraded":"2026-02-20T03:15:27.676826+0000","last_fullsized":"2026-02-20T03:15:27.676826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090039+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:15:27.090039+0000","last_peered":"2026-02-20T03:15:27.090039+0000","last_clean":"2026-02-20T03:15:27.090039+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:15:27.090039+0000","last_undegraded":"2026-02-20T03:15:27.090039+0000","last_fullsized":"2026-02-20T03:15:27.090039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099935+0000","last_change":"2026-02-20T03:15:27.099749+0000","last_active":"2026-02-20T03:15:27.099935+0000","last_peered":"2026-02-20T03:15:27.099935+0000","last_clean":"2026-02-20T03:15:27.099935+0000","last_became_active":"2026-02-20T03:15:27.096338+0000","last_became_peered":"2026-02-20T03:15:27.096338+0000","last_unstale":"2026-02-20T03:15:27.099935+0000","last_undegraded":"2026-02-20T03:15:27.099935+0000","last_fullsized":"2026-02-20T03:15:27.099935+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:59:55.738735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093553+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:15:27.093553+0000","last_peered":"2026-02-20T03:15:27.093553+0000","last_clean":"2026-02-20T03:15:27.093553+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:15:27.093553+0000","last_undegraded":"2026-02-20T03:15:27.093553+0000","last_fullsized":"2026-02-20T03:15:27.093553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384089+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:15:27.384089+0000","last_peered":"2026-02-20T03:15:27.384089+0000","last_clean":"2026-02-20T03:15:27.384089+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:15:27.384089+0000","last_undegraded":"2026-02-20T03:15:27.384089+0000","last_fullsized":"2026-02-20T03:15:27.384089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091877+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:15:27.091877+0000","last_peered":"2026-02-20T03:15:27.091877+0000","last_clean":"2026-02-20T03:15:27.091877+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:15:27.091877+0000","last_undegraded":"2026-02-20T03:15:27.091877+0000","last_fullsized":"2026-02-20T03:15:27.091877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095909+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:15:27.095909+0000","last_peered":"2026-02-20T03:15:27.095909+0000","last_clean":"2026-02-20T03:15:27.095909+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:15:27.095909+0000","last_undegraded":"2026-02-20T03:15:27.095909+0000","last_fullsized":"2026-02-20T03:15:27.095909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384056+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:15:27.384056+0000","last_peered":"2026-02-20T03:15:27.384056+0000","last_clean":"2026-02-20T03:15:27.384056+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:15:27.384056+0000","last_undegraded":"2026-02-20T03:15:27.384056+0000","last_fullsized":"2026-02-20T03:15:27.384056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097629+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:15:27.097629+0000","last_peered":"2026-02-20T03:15:27.097629+0000","last_clean":"2026-02-20T03:15:27.097629+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:15:27.097629+0000","last_undegraded":"2026-02-20T03:15:27.097629+0000","last_fullsized":"2026-02-20T03:15:27.097629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090084+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:15:27.090084+0000","last_peered":"2026-02-20T03:15:27.090084+0000","last_clean":"2026-02-20T03:15:27.090084+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:15:27.090084+0000","last_undegraded":"2026-02-20T03:15:27.090084+0000","last_fullsized":"2026-02-20T03:15:27.090084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096476+0000","last_change":"2026-02-20T03:15:27.096476+0000","last_active":"2026-02-20T03:15:27.096476+0000","last_peered":"2026-02-20T03:15:27.096476+0000","last_clean":"2026-02-20T03:15:27.096476+0000","last_became_active":"2026-02-20T03:15:27.096369+0000","last_became_peered":"2026-02-20T03:15:27.096369+0000","last_unstale":"2026-02-20T03:15:27.096476+0000","last_undegraded":"2026-02-20T03:15:27.096476+0000","last_fullsized":"2026-02-20T03:15:27.096476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:18:04.418088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089586+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:27.089586+0000","last_peered":"2026-02-20T03:15:27.089586+0000","last_clean":"2026-02-20T03:15:27.089586+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:27.089586+0000","last_undegraded":"2026-02-20T03:15:27.089586+0000","last_fullsized":"2026-02-20T03:15:27.089586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089978+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:15:27.089978+0000","last_peered":"2026-02-20T03:15:27.089978+0000","last_clean":"2026-02-20T03:15:27.089978+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:15:27.089978+0000","last_undegraded":"2026-02-20T03:15:27.089978+0000","last_fullsized":"2026-02-20T03:15:27.089978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089476+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:15:27.089476+0000","last_peered":"2026-02-20T03:15:27.089476+0000","last_clean":"2026-02-20T03:15:27.089476+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:15:27.089476+0000","last_undegraded":"2026-02-20T03:15:27.089476+0000","last_fullsized":"2026-02-20T03:15:27.089476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097578+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:15:27.097578+0000","last_peered":"2026-02-20T03:15:27.097578+0000","last_clean":"2026-02-20T03:15:27.097578+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:15:27.097578+0000","last_undegraded":"2026-02-20T03:15:27.097578+0000","last_fullsized":"2026-02-20T03:15:27.097578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093923+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:15:27.093923+0000","last_peered":"2026-02-20T03:15:27.093923+0000","last_clean":"2026-02-20T03:15:27.093923+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:15:27.093923+0000","last_undegraded":"2026-02-20T03:15:27.093923+0000","last_fullsized":"2026-02-20T03:15:27.093923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677506+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:15:27.677506+0000","last_peered":"2026-02-20T03:15:27.677506+0000","last_clean":"2026-02-20T03:15:27.677506+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:15:27.677506+0000","last_undegraded":"2026-02-20T03:15:27.677506+0000","last_fullsized":"2026-02-20T03:15:27.677506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":354,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097799+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:15:27.097799+0000","last_peered":"2026-02-20T03:15:27.097799+0000","last_clean":"2026-02-20T03:15:27.097799+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:15:27.097799+0000","last_undegraded":"2026-02-20T03:15:27.097799+0000","last_fullsized":"2026-02-20T03:15:27.097799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097882+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:15:27.097882+0000","last_peered":"2026-02-20T03:15:27.097882+0000","last_clean":"2026-02-20T03:15:27.097882+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:15:27.097882+0000","last_undegraded":"2026-02-20T03:15:27.097882+0000","last_fullsized":"2026-02-20T03:15:27.097882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098144+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:15:27.098144+0000","last_peered":"2026-02-20T03:15:27.098144+0000","last_clean":"2026-02-20T03:15:27.098144+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:15:27.098144+0000","last_undegraded":"2026-02-20T03:15:27.098144+0000","last_fullsized":"2026-02-20T03:15:27.098144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2026-02-20T03:14:38.744446+0000","last_change":"2026-02-20T03:15:26.460325+0000","last_active":"2026-02-20T03:15:26.460325+0000","last_peered":"2026-02-20T03:14:38.744446+0000","last_clean":"2026-02-20T03:14:38.744446+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:38.744446+0000","last_undegraded":"2026-02-20T03:14:38.744446+0000","last_fullsized":"2026-02-20T03:14:38.744446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097649+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:26.097649+0000","last_peered":"2026-02-20T03:15:26.097649+0000","last_clean":"2026-02-20T03:15:26.097649+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:26.097649+0000","last_undegraded":"2026-02-20T03:15:26.097649+0000","last_fullsized":"2026-02-20T03:15:26.097649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097824+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:15:27.097824+0000","last_peered":"2026-02-20T03:15:27.097824+0000","last_clean":"2026-02-20T03:15:27.097824+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:15:27.097824+0000","last_undegraded":"2026-02-20T03:15:27.097824+0000","last_fullsized":"2026-02-20T03:15:27.097824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094597+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:15:27.094597+0000","last_peered":"2026-02-20T03:15:27.094597+0000","last_clean":"2026-02-20T03:15:27.094597+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:15:27.094597+0000","last_undegraded":"2026-02-20T03:15:27.094597+0000","last_fullsized":"2026-02-20T03:15:27.094597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088541+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:26.088541+0000","last_peered":"2026-02-20T03:15:26.088541+0000","last_clean":"2026-02-20T03:15:26.088541+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:26.088541+0000","last_undegraded":"2026-02-20T03:15:26.088541+0000","last_fullsized":"2026-02-20T03:15:26.088541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098225+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:15:27.098225+0000","last_peered":"2026-02-20T03:15:27.098225+0000","last_clean":"2026-02-20T03:15:27.098225+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:15:27.098225+0000","last_undegraded":"2026-02-20T03:15:27.098225+0000","last_fullsized":"2026-02-20T03:15:27.098225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089901+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:15:27.089901+0000","last_peered":"2026-02-20T03:15:27.089901+0000","last_clean":"2026-02-20T03:15:27.089901+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:15:27.089901+0000","last_undegraded":"2026-02-20T03:15:27.089901+0000","last_fullsized":"2026-02-20T03:15:27.089901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093235+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:15:27.093235+0000","last_peered":"2026-02-20T03:15:27.093235+0000","last_clean":"2026-02-20T03:15:27.093235+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:15:27.093235+0000","last_undegraded":"2026-02-20T03:15:27.093235+0000","last_fullsized":"2026-02-20T03:15:27.093235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093959+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:15:27.093959+0000","last_peered":"2026-02-20T03:15:27.093959+0000","last_clean":"2026-02-20T03:15:27.093959+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:15:27.093959+0000","last_undegraded":"2026-02-20T03:15:27.093959+0000","last_fullsized":"2026-02-20T03:15:27.093959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:15:27.096403+0000","last_peered":"2026-02-20T03:15:27.096403+0000","last_clean":"2026-02-20T03:15:27.096403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:15:27.096403+0000","last_undegraded":"2026-02-20T03:15:27.096403+0000","last_fullsized":"2026-02-20T03:15:27.096403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093292+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:15:27.093292+0000","last_peered":"2026-02-20T03:15:27.093292+0000","last_clean":"2026-02-20T03:15:27.093292+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:15:27.093292+0000","last_undegraded":"2026-02-20T03:15:27.093292+0000","last_fullsized":"2026-02-20T03:15:27.093292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093347+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:15:27.093347+0000","last_peered":"2026-02-20T03:15:27.093347+0000","last_clean":"2026-02-20T03:15:27.093347+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:15:27.093347+0000","last_undegraded":"2026-02-20T03:15:27.093347+0000","last_fullsized":"2026-02-20T03:15:27.093347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095895+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:15:27.095895+0000","last_peered":"2026-02-20T03:15:27.095895+0000","last_clean":"2026-02-20T03:15:27.095895+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:15:27.095895+0000","last_undegraded":"2026-02-20T03:15:27.095895+0000","last_fullsized":"2026-02-20T03:15:27.095895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089892+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:15:27.089892+0000","last_peered":"2026-02-20T03:15:27.089892+0000","last_clean":"2026-02-20T03:15:27.089892+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:15:27.089892+0000","last_undegraded":"2026-02-20T03:15:27.089892+0000","last_fullsized":"2026-02-20T03:15:27.089892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097367+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:15:27.097367+0000","last_peered":"2026-02-20T03:15:27.097367+0000","last_clean":"2026-02-20T03:15:27.097367+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:15:27.097367+0000","last_undegraded":"2026-02-20T03:15:27.097367+0000","last_fullsized":"2026-02-20T03:15:27.097367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:23.388416+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:23.388416+0000","last_peered":"2026-02-20T03:15:23.388416+0000","last_clean":"2026-02-20T03:15:23.388416+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:23.388416+0000","last_undegraded":"2026-02-20T03:15:23.388416+0000","last_fullsized":"2026-02-20T03:15:23.388416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092155+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:15:27.092155+0000","last_peered":"2026-02-20T03:15:27.092155+0000","last_clean":"2026-02-20T03:15:27.092155+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:15:27.092155+0000","last_undegraded":"2026-02-20T03:15:27.092155+0000","last_fullsized":"2026-02-20T03:15:27.092155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097787+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:15:27.097787+0000","last_peered":"2026-02-20T03:15:27.097787+0000","last_clean":"2026-02-20T03:15:27.097787+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:15:27.097787+0000","last_undegraded":"2026-02-20T03:15:27.097787+0000","last_fullsized":"2026-02-20T03:15:27.097787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093616+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:15:27.093616+0000","last_peered":"2026-02-20T03:15:27.093616+0000","last_clean":"2026-02-20T03:15:27.093616+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:15:27.093616+0000","last_undegraded":"2026-02-20T03:15:27.093616+0000","last_fullsized":"2026-02-20T03:15:27.093616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093604+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:15:27.093604+0000","last_peered":"2026-02-20T03:15:27.093604+0000","last_clean":"2026-02-20T03:15:27.093604+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:15:27.093604+0000","last_undegraded":"2026-02-20T03:15:27.093604+0000","last_fullsized":"2026-02-20T03:15:27.093604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089674+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:15:27.089674+0000","last_peered":"2026-02-20T03:15:27.089674+0000","last_clean":"2026-02-20T03:15:27.089674+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:15:27.089674+0000","last_undegraded":"2026-02-20T03:15:27.089674+0000","last_fullsized":"2026-02-20T03:15:27.089674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093258+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:26.093258+0000","last_peered":"2026-02-20T03:15:26.093258+0000","last_clean":"2026-02-20T03:15:26.093258+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:26.093258+0000","last_undegraded":"2026-02-20T03:15:26.093258+0000","last_fullsized":"2026-02-20T03:15:26.093258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093756+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:15:27.093756+0000","last_peered":"2026-02-20T03:15:27.093756+0000","last_clean":"2026-02-20T03:15:27.093756+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:15:27.093756+0000","last_undegraded":"2026-02-20T03:15:27.093756+0000","last_fullsized":"2026-02-20T03:15:27.093756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096216+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:15:27.096216+0000","last_peered":"2026-02-20T03:15:27.096216+0000","last_clean":"2026-02-20T03:15:27.096216+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:15:27.096216+0000","last_undegraded":"2026-02-20T03:15:27.096216+0000","last_fullsized":"2026-02-20T03:15:27.096216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:29.396148+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:29.396148+0000","last_peered":"2026-02-20T03:15:29.396148+0000","last_clean":"2026-02-20T03:15:29.396148+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:29.396148+0000","last_undegraded":"2026-02-20T03:15:29.396148+0000","last_fullsized":"2026-02-20T03:15:29.396148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73733,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":87,"num_read_kb":116,"num_write":35,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091741+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:15:27.091741+0000","last_peered":"2026-02-20T03:15:27.091741+0000","last_clean":"2026-02-20T03:15:27.091741+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:15:27.091741+0000","last_undegraded":"2026-02-20T03:15:27.091741+0000","last_fullsized":"2026-02-20T03:15:27.091741+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098166+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:26.098166+0000","last_peered":"2026-02-20T03:15:26.098166+0000","last_clean":"2026-02-20T03:15:26.098166+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:26.098166+0000","last_undegraded":"2026-02-20T03:15:26.098166+0000","last_fullsized":"2026-02-20T03:15:26.098166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094441+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:15:27.094441+0000","last_peered":"2026-02-20T03:15:27.094441+0000","last_clean":"2026-02-20T03:15:27.094441+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:15:27.094441+0000","last_undegraded":"2026-02-20T03:15:27.094441+0000","last_fullsized":"2026-02-20T03:15:27.094441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089065+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:26.089065+0000","last_peered":"2026-02-20T03:15:26.089065+0000","last_clean":"2026-02-20T03:15:26.089065+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:26.089065+0000","last_undegraded":"2026-02-20T03:15:26.089065+0000","last_fullsized":"2026-02-20T03:15:26.089065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098009+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:15:27.098009+0000","last_peered":"2026-02-20T03:15:27.098009+0000","last_clean":"2026-02-20T03:15:27.098009+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:15:27.098009+0000","last_undegraded":"2026-02-20T03:15:27.098009+0000","last_fullsized":"2026-02-20T03:15:27.098009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091618+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:15:27.091618+0000","last_peered":"2026-02-20T03:15:27.091618+0000","last_clean":"2026-02-20T03:15:27.091618+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:15:27.091618+0000","last_undegraded":"2026-02-20T03:15:27.091618+0000","last_fullsized":"2026-02-20T03:15:27.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098167+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:26.098167+0000","last_peered":"2026-02-20T03:15:26.098167+0000","last_clean":"2026-02-20T03:15:26.098167+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:26.098167+0000","last_undegraded":"2026-02-20T03:15:26.098167+0000","last_fullsized":"2026-02-20T03:15:26.098167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:28.388164+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:28.388164+0000","last_peered":"2026-02-20T03:15:28.388164+0000","last_clean":"2026-02-20T03:15:28.388164+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:28.388164+0000","last_undegraded":"2026-02-20T03:15:28.388164+0000","last_fullsized":"2026-02-20T03:15:28.388164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676945+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:15:27.676945+0000","last_peered":"2026-02-20T03:15:27.676945+0000","last_clean":"2026-02-20T03:15:27.676945+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:15:27.676945+0000","last_undegraded":"2026-02-20T03:15:27.676945+0000","last_fullsized":"2026-02-20T03:15:27.676945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088557+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:26.088557+0000","last_peered":"2026-02-20T03:15:26.088557+0000","last_clean":"2026-02-20T03:15:26.088557+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:26.088557+0000","last_undegraded":"2026-02-20T03:15:26.088557+0000","last_fullsized":"2026-02-20T03:15:26.088557+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091995+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:15:27.091995+0000","last_peered":"2026-02-20T03:15:27.091995+0000","last_clean":"2026-02-20T03:15:27.091995+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:15:27.091995+0000","last_undegraded":"2026-02-20T03:15:27.091995+0000","last_fullsized":"2026-02-20T03:15:27.091995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094048+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:15:27.094048+0000","last_peered":"2026-02-20T03:15:27.094048+0000","last_clean":"2026-02-20T03:15:27.094048+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:15:27.094048+0000","last_undegraded":"2026-02-20T03:15:27.094048+0000","last_fullsized":"2026-02-20T03:15:27.094048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093983+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:15:27.093983+0000","last_peered":"2026-02-20T03:15:27.093983+0000","last_clean":"2026-02-20T03:15:27.093983+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:15:27.093983+0000","last_undegraded":"2026-02-20T03:15:27.093983+0000","last_fullsized":"2026-02-20T03:15:27.093983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676892+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:15:27.676892+0000","last_peered":"2026-02-20T03:15:27.676892+0000","last_clean":"2026-02-20T03:15:27.676892+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:15:27.676892+0000","last_undegraded":"2026-02-20T03:15:27.676892+0000","last_fullsized":"2026-02-20T03:15:27.676892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089481+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:15:27.089481+0000","last_peered":"2026-02-20T03:15:27.089481+0000","last_clean":"2026-02-20T03:15:27.089481+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:15:27.089481+0000","last_undegraded":"2026-02-20T03:15:27.089481+0000","last_fullsized":"2026-02-20T03:15:27.089481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383994+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:15:27.383994+0000","last_peered":"2026-02-20T03:15:27.383994+0000","last_clean":"2026-02-20T03:15:27.383994+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:15:27.383994+0000","last_undegraded":"2026-02-20T03:15:27.383994+0000","last_fullsized":"2026-02-20T03:15:27.383994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093591+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:15:27.093591+0000","last_peered":"2026-02-20T03:15:27.093591+0000","last_clean":"2026-02-20T03:15:27.093591+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:15:27.093591+0000","last_undegraded":"2026-02-20T03:15:27.093591+0000","last_fullsized":"2026-02-20T03:15:27.093591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093296+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:26.093296+0000","last_peered":"2026-02-20T03:15:26.093296+0000","last_clean":"2026-02-20T03:15:26.093296+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:26.093296+0000","last_undegraded":"2026-02-20T03:15:26.093296+0000","last_fullsized":"2026-02-20T03:15:26.093296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.382264+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:27.382264+0000","last_peered":"2026-02-20T03:15:27.382264+0000","last_clean":"2026-02-20T03:15:27.382264+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:27.382264+0000","last_undegraded":"2026-02-20T03:15:27.382264+0000","last_fullsized":"2026-02-20T03:15:27.382264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096098+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:15:27.096098+0000","last_peered":"2026-02-20T03:15:27.096098+0000","last_clean":"2026-02-20T03:15:27.096098+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:15:27.096098+0000","last_undegraded":"2026-02-20T03:15:27.096098+0000","last_fullsized":"2026-02-20T03:15:27.096098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093320+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:26.093320+0000","last_peered":"2026-02-20T03:15:26.093320+0000","last_clean":"2026-02-20T03:15:26.093320+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:26.093320+0000","last_undegraded":"2026-02-20T03:15:26.093320+0000","last_fullsized":"2026-02-20T03:15:26.093320+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093050+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:26.093050+0000","last_peered":"2026-02-20T03:15:26.093050+0000","last_clean":"2026-02-20T03:15:26.093050+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:26.093050+0000","last_undegraded":"2026-02-20T03:15:26.093050+0000","last_fullsized":"2026-02-20T03:15:26.093050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093067+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:26.093067+0000","last_peered":"2026-02-20T03:15:26.093067+0000","last_clean":"2026-02-20T03:15:26.093067+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:26.093067+0000","last_undegraded":"2026-02-20T03:15:26.093067+0000","last_fullsized":"2026-02-20T03:15:26.093067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088712+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:26.088712+0000","last_peered":"2026-02-20T03:15:26.088712+0000","last_clean":"2026-02-20T03:15:26.088712+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:26.088712+0000","last_undegraded":"2026-02-20T03:15:26.088712+0000","last_fullsized":"2026-02-20T03:15:26.088712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090007+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:15:27.090007+0000","last_peered":"2026-02-20T03:15:27.090007+0000","last_clean":"2026-02-20T03:15:27.090007+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:15:27.090007+0000","last_undegraded":"2026-02-20T03:15:27.090007+0000","last_fullsized":"2026-02-20T03:15:27.090007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096323+0000","last_change":"2026-02-20T03:15:27.096323+0000","last_active":"2026-02-20T03:15:27.096323+0000","last_peered":"2026-02-20T03:15:27.096323+0000","last_clean":"2026-02-20T03:15:27.096323+0000","last_became_active":"2026-02-20T03:15:27.096171+0000","last_became_peered":"2026-02-20T03:15:27.096171+0000","last_unstale":"2026-02-20T03:15:27.096323+0000","last_undegraded":"2026-02-20T03:15:27.096323+0000","last_fullsized":"2026-02-20T03:15:27.096323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:00:54.803500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093494+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:26.093494+0000","last_peered":"2026-02-20T03:15:26.093494+0000","last_clean":"2026-02-20T03:15:26.093494+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:26.093494+0000","last_undegraded":"2026-02-20T03:15:26.093494+0000","last_fullsized":"2026-02-20T03:15:26.093494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677330+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:15:27.677330+0000","last_peered":"2026-02-20T03:15:27.677330+0000","last_clean":"2026-02-20T03:15:27.677330+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:15:27.677330+0000","last_undegraded":"2026-02-20T03:15:27.677330+0000","last_fullsized":"2026-02-20T03:15:27.677330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093789+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:15:27.093789+0000","last_peered":"2026-02-20T03:15:27.093789+0000","last_clean":"2026-02-20T03:15:27.093789+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:15:27.093789+0000","last_undegraded":"2026-02-20T03:15:27.093789+0000","last_fullsized":"2026-02-20T03:15:27.093789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677022+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:15:27.677022+0000","last_peered":"2026-02-20T03:15:27.677022+0000","last_clean":"2026-02-20T03:15:27.677022+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:15:27.677022+0000","last_undegraded":"2026-02-20T03:15:27.677022+0000","last_fullsized":"2026-02-20T03:15:27.677022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097832+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:26.097832+0000","last_peered":"2026-02-20T03:15:26.097832+0000","last_clean":"2026-02-20T03:15:26.097832+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:26.097832+0000","last_undegraded":"2026-02-20T03:15:26.097832+0000","last_fullsized":"2026-02-20T03:15:26.097832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089899+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:15:27.089899+0000","last_peered":"2026-02-20T03:15:27.089899+0000","last_clean":"2026-02-20T03:15:27.089899+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:15:27.089899+0000","last_undegraded":"2026-02-20T03:15:27.089899+0000","last_fullsized":"2026-02-20T03:15:27.089899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093603+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:15:27.093603+0000","last_peered":"2026-02-20T03:15:27.093603+0000","last_clean":"2026-02-20T03:15:27.093603+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:15:27.093603+0000","last_undegraded":"2026-02-20T03:15:27.093603+0000","last_fullsized":"2026-02-20T03:15:27.093603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093417+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:26.093417+0000","last_peered":"2026-02-20T03:15:26.093417+0000","last_clean":"2026-02-20T03:15:26.093417+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:26.093417+0000","last_undegraded":"2026-02-20T03:15:26.093417+0000","last_fullsized":"2026-02-20T03:15:26.093417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092017+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:15:27.092017+0000","last_peered":"2026-02-20T03:15:27.092017+0000","last_clean":"2026-02-20T03:15:27.092017+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:15:27.092017+0000","last_undegraded":"2026-02-20T03:15:27.092017+0000","last_fullsized":"2026-02-20T03:15:27.092017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094334+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:15:27.094334+0000","last_peered":"2026-02-20T03:15:27.094334+0000","last_clean":"2026-02-20T03:15:27.094334+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:15:27.094334+0000","last_undegraded":"2026-02-20T03:15:27.094334+0000","last_fullsized":"2026-02-20T03:15:27.094334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097561+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:26.097561+0000","last_peered":"2026-02-20T03:15:26.097561+0000","last_clean":"2026-02-20T03:15:26.097561+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:26.097561+0000","last_undegraded":"2026-02-20T03:15:26.097561+0000","last_fullsized":"2026-02-20T03:15:26.097561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088395+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:26.088395+0000","last_peered":"2026-02-20T03:15:26.088395+0000","last_clean":"2026-02-20T03:15:26.088395+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:26.088395+0000","last_undegraded":"2026-02-20T03:15:26.088395+0000","last_fullsized":"2026-02-20T03:15:26.088395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088313+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:26.088313+0000","last_peered":"2026-02-20T03:15:26.088313+0000","last_clean":"2026-02-20T03:15:26.088313+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:26.088313+0000","last_undegraded":"2026-02-20T03:15:26.088313+0000","last_fullsized":"2026-02-20T03:15:26.088313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089821+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:15:27.089821+0000","last_peered":"2026-02-20T03:15:27.089821+0000","last_clean":"2026-02-20T03:15:27.089821+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:15:27.089821+0000","last_undegraded":"2026-02-20T03:15:27.089821+0000","last_fullsized":"2026-02-20T03:15:27.089821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098066+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:15:27.098066+0000","last_peered":"2026-02-20T03:15:27.098066+0000","last_clean":"2026-02-20T03:15:27.098066+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:15:27.098066+0000","last_undegraded":"2026-02-20T03:15:27.098066+0000","last_fullsized":"2026-02-20T03:15:27.098066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384200+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:15:27.384200+0000","last_peered":"2026-02-20T03:15:27.384200+0000","last_clean":"2026-02-20T03:15:27.384200+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:15:27.384200+0000","last_undegraded":"2026-02-20T03:15:27.384200+0000","last_fullsized":"2026-02-20T03:15:27.384200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.749677+0000","last_change":"2026-02-20T03:15:26.098509+0000","last_active":"2026-02-20T03:15:26.098509+0000","last_peered":"2026-02-20T03:14:38.749677+0000","last_clean":"2026-02-20T03:14:38.749677+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749677+0000","last_undegraded":"2026-02-20T03:14:38.749677+0000","last_fullsized":"2026-02-20T03:14:38.749677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676902+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:15:27.676902+0000","last_peered":"2026-02-20T03:15:27.676902+0000","last_clean":"2026-02-20T03:15:27.676902+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:15:27.676902+0000","last_undegraded":"2026-02-20T03:15:27.676902+0000","last_fullsized":"2026-02-20T03:15:27.676902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097349+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:15:27.097349+0000","last_peered":"2026-02-20T03:15:27.097349+0000","last_clean":"2026-02-20T03:15:27.097349+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:15:27.097349+0000","last_undegraded":"2026-02-20T03:15:27.097349+0000","last_fullsized":"2026-02-20T03:15:27.097349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383987+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:15:27.383987+0000","last_peered":"2026-02-20T03:15:27.383987+0000","last_clean":"2026-02-20T03:15:27.383987+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:15:27.383987+0000","last_undegraded":"2026-02-20T03:15:27.383987+0000","last_fullsized":"2026-02-20T03:15:27.383987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088720+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:26.088720+0000","last_peered":"2026-02-20T03:15:26.088720+0000","last_clean":"2026-02-20T03:15:26.088720+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:26.088720+0000","last_undegraded":"2026-02-20T03:15:26.088720+0000","last_fullsized":"2026-02-20T03:15:26.088720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088833+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:26.088833+0000","last_peered":"2026-02-20T03:15:26.088833+0000","last_clean":"2026-02-20T03:15:26.088833+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:26.088833+0000","last_undegraded":"2026-02-20T03:15:26.088833+0000","last_fullsized":"2026-02-20T03:15:26.088833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094313+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:15:27.094313+0000","last_peered":"2026-02-20T03:15:27.094313+0000","last_clean":"2026-02-20T03:15:27.094313+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:15:27.094313+0000","last_undegraded":"2026-02-20T03:15:27.094313+0000","last_fullsized":"2026-02-20T03:15:27.094313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78071,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":249,"num_read_kb":208,"num_write":168,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":614,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":225415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32140,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971060,"statfs":{"total":751619276800,"available":751586365440,"internally_reserved":0,"allocated":1032192,"data_stored":502911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32820,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970380,"statfs":{"total":751619276800,"available":751585669120,"internally_reserved":0,"allocated":1728512,"data_stored":1164282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776149,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":507221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037783,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32132,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971068,"statfs":{"total":751619276800,"available":751586373632,"internally_reserved":0,"allocated":1028096,"data_stored":493740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299417,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32712,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970488,"statfs":{"total":751619276800,"available":751585779712,"internally_reserved":0,"allocated":1622016,"data_stored":1089956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462939,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1024000,"data_stored":498291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28576,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974624,"statfs":{"total":751619276800,"available":751590014976,"internally_reserved":0,"allocated":1646592,"data_stored":1094457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888095,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971096,"statfs":{"total":751619276800,"available":751586402304,"internally_reserved":0,"allocated":1003520,"data_stored":484494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149730,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1036288,"data_stored":498485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378660,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28048,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975152,"statfs":{"total":751619276800,"available":751590555648,"internally_reserved":0,"allocated":1105920,"data_stored":559896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28004,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975196,"statfs":{"total":751619276800,"available":751590600704,"internally_reserved":0,"allocated":1064960,"data_stored":548696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":480860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":75713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:31.666 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.820+0000 7f1ad75e4640 1 -- 10.20.193.28:0/52034402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 msgr2=0x7f1ad0104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.820+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/52034402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 0x7f1ad0104d20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009a30 tx=0x7f1ac802f220 comp rx=0 tx=0).stop 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.820+0000 7f1ad75e4640 1 -- 10.20.193.28:0/52034402 shutdown_connections 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.820+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/52034402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ad01064d0 0x7f1ad010cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.820+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/52034402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ad0105b10 0x7f1ad0105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.820+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/52034402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 0x7f1ad0104d20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.820+0000 7f1ad75e4640 1 -- 10.20.193.28:0/52034402 >> 10.20.193.28:0/52034402 conn(0x7f1ad01000e0 msgr2=0x7f1ad0102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 -- 10.20.193.28:0/52034402 shutdown_connections 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 -- 10.20.193.28:0/52034402 wait complete. 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 Processor -- start 2026-02-20T03:15:31.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 -- start start 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 0x7f1ad019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ad0105b10 0x7f1ad019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ad01064d0 0x7f1ad01a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad0110410 con 0x7f1ad0104920 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad0110290 con 0x7f1ad01064d0 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.821+0000 7f1ad75e4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad0110590 con 0x7f1ad0105b10 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad65e2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 0x7f1ad019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad5de1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ad0105b10 0x7f1ad019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad65e2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 0x7f1ad019ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33742/0 (socket says 10.20.193.28:33742) 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad65e2640 1 -- 10.20.193.28:0/3884860447 learned_addr learned my addr 10.20.193.28:0/3884860447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad6de3640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ad01064d0 0x7f1ad01a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad65e2640 1 -- 10.20.193.28:0/3884860447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ad0105b10 msgr2=0x7f1ad019cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad65e2640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ad0105b10 0x7f1ad019cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad65e2640 1 -- 10.20.193.28:0/3884860447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ad01064d0 msgr2=0x7f1ad01a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad65e2640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ad01064d0 0x7f1ad01a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad65e2640 1 -- 10.20.193.28:0/3884860447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad01a4700 con 0x7f1ad0104920 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad6de3640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ad01064d0 0x7f1ad01a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:31.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad65e2640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 0x7f1ad019ca50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8002fd0 tx=0x7f1ac802fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:31.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1abb7fe640 1 -- 10.20.193.28:0/3884860447 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac802fe30 con 0x7f1ad0104920 2026-02-20T03:15:31.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1abb7fe640 1 -- 10.20.193.28:0/3884860447 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1ac8038770 con 0x7f1ad0104920 2026-02-20T03:15:31.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1abb7fe640 1 -- 10.20.193.28:0/3884860447 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8042950 con 0x7f1ad0104920 2026-02-20T03:15:31.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad01a4990 con 0x7f1ad0104920 2026-02-20T03:15:31.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.822+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad01a4e30 con 0x7f1ad0104920 2026-02-20T03:15:31.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.823+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad010b820 con 0x7f1ad0104920 2026-02-20T03:15:31.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.825+0000 7f1abb7fe640 1 -- 10.20.193.28:0/3884860447 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f1ac804a030 con 0x7f1ad0104920 2026-02-20T03:15:31.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.826+0000 7f1abb7fe640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1aac0b0eb0 0x7f1aac0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:31.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.827+0000 7f1abb7fe640 1 -- 10.20.193.28:0/3884860447 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f1ac8105310 con 0x7f1ad0104920 2026-02-20T03:15:31.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.827+0000 7f1ad5de1640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1aac0b0eb0 0x7f1aac0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:31.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.827+0000 7f1abb7fe640 1 -- 10.20.193.28:0/3884860447 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1ac8105790 con 0x7f1ad0104920 2026-02-20T03:15:31.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.827+0000 7f1ad5de1640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1aac0b0eb0 0x7f1aac0b3370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1ad019df60 tx=0x7f1abc009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:31.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.917+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ad00630c0 con 0x7f1aac0b0eb0 2026-02-20T03:15:31.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.922+0000 7f1abb7fe640 1 -- 10.20.193.28:0/3884860447 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340251 (secure 0 0 0) 0x7f1ad00630c0 con 0x7f1aac0b0eb0 2026-02-20T03:15:31.926 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1aac0b0eb0 msgr2=0x7f1aac0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1aac0b0eb0 0x7f1aac0b3370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1ad019df60 tx=0x7f1abc009290 comp rx=0 tx=0).stop 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 msgr2=0x7f1ad019ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 0x7f1ad019ca50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8002fd0 tx=0x7f1ac802fc90 comp rx=0 tx=0).stop 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 shutdown_connections 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1aac0b0eb0 0x7f1aac0b3370 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ad01064d0 0x7f1ad01a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ad0105b10 0x7f1ad019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 --2- 10.20.193.28:0/3884860447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ad0104920 0x7f1ad019ca50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 >> 10.20.193.28:0/3884860447 conn(0x7f1ad01000e0 msgr2=0x7f1ad0108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 shutdown_connections 2026-02-20T03:15:31.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:31.925+0000 7f1ad75e4640 1 -- 10.20.193.28:0/3884860447 wait complete. 2026-02-20T03:15:31.939 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2026-02-20T03:15:30.010150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668673,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":355,"num_read_kb":299,"num_write":359,"num_write_kb":3849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":1181350,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358440,"kb_used_data":14020,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807679960,"statfs":{"total":9019431321600,"available":9019064279040,"internally_reserved":0,"allocated":14356480,"data_stored":7923289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6683,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":37,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":614,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001574"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.389259+0000","last_change":"2026-02-20T03:15:27.389259+0000","last_active":"2026-02-20T03:15:27.389259+0000","last_peered":"2026-02-20T03:15:27.389259+0000","last_clean":"2026-02-20T03:15:27.389259+0000","last_became_active":"2026-02-20T03:15:27.385887+0000","last_became_peered":"2026-02-20T03:15:27.385887+0000","last_unstale":"2026-02-20T03:15:27.389259+0000","last_undegraded":"2026-02-20T03:15:27.389259+0000","last_fullsized":"2026-02-20T03:15:27.389259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:20:01.907763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677322+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:15:27.677322+0000","last_peered":"2026-02-20T03:15:27.677322+0000","last_clean":"2026-02-20T03:15:27.677322+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:15:27.677322+0000","last_undegraded":"2026-02-20T03:15:27.677322+0000","last_fullsized":"2026-02-20T03:15:27.677322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092834+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:26.092834+0000","last_peered":"2026-02-20T03:15:26.092834+0000","last_clean":"2026-02-20T03:15:26.092834+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:26.092834+0000","last_undegraded":"2026-02-20T03:15:26.092834+0000","last_fullsized":"2026-02-20T03:15:26.092834+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677381+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:15:27.677381+0000","last_peered":"2026-02-20T03:15:27.677381+0000","last_clean":"2026-02-20T03:15:27.677381+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:15:27.677381+0000","last_undegraded":"2026-02-20T03:15:27.677381+0000","last_fullsized":"2026-02-20T03:15:27.677381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089055+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:26.089055+0000","last_peered":"2026-02-20T03:15:26.089055+0000","last_clean":"2026-02-20T03:15:26.089055+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:26.089055+0000","last_undegraded":"2026-02-20T03:15:26.089055+0000","last_fullsized":"2026-02-20T03:15:26.089055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749090+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:14:38.749090+0000","last_peered":"2026-02-20T03:14:38.749090+0000","last_clean":"2026-02-20T03:14:38.749090+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:14:38.749090+0000","last_undegraded":"2026-02-20T03:14:38.749090+0000","last_fullsized":"2026-02-20T03:14:38.749090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096362+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:15:27.096362+0000","last_peered":"2026-02-20T03:15:27.096362+0000","last_clean":"2026-02-20T03:15:27.096362+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:15:27.096362+0000","last_undegraded":"2026-02-20T03:15:27.096362+0000","last_fullsized":"2026-02-20T03:15:27.096362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098104+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:26.098104+0000","last_peered":"2026-02-20T03:15:26.098104+0000","last_clean":"2026-02-20T03:15:26.098104+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:26.098104+0000","last_undegraded":"2026-02-20T03:15:26.098104+0000","last_fullsized":"2026-02-20T03:15:26.098104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749566+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:14:38.749566+0000","last_peered":"2026-02-20T03:14:38.749566+0000","last_clean":"2026-02-20T03:14:38.749566+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:14:38.749566+0000","last_undegraded":"2026-02-20T03:14:38.749566+0000","last_fullsized":"2026-02-20T03:14:38.749566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096305+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:15:27.096305+0000","last_peered":"2026-02-20T03:15:27.096305+0000","last_clean":"2026-02-20T03:15:27.096305+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:15:27.096305+0000","last_undegraded":"2026-02-20T03:15:27.096305+0000","last_fullsized":"2026-02-20T03:15:27.096305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096792+0000","last_change":"2026-02-20T03:15:27.096792+0000","last_active":"2026-02-20T03:15:27.096792+0000","last_peered":"2026-02-20T03:15:27.096792+0000","last_clean":"2026-02-20T03:15:27.096792+0000","last_became_active":"2026-02-20T03:15:27.096659+0000","last_became_peered":"2026-02-20T03:15:27.096659+0000","last_unstale":"2026-02-20T03:15:27.096792+0000","last_undegraded":"2026-02-20T03:15:27.096792+0000","last_fullsized":"2026-02-20T03:15:27.096792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:57.312267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749331+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:14:38.749331+0000","last_peered":"2026-02-20T03:14:38.749331+0000","last_clean":"2026-02-20T03:14:38.749331+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:14:38.749331+0000","last_undegraded":"2026-02-20T03:14:38.749331+0000","last_fullsized":"2026-02-20T03:14:38.749331+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097517+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:15:27.097517+0000","last_peered":"2026-02-20T03:15:27.097517+0000","last_clean":"2026-02-20T03:15:27.097517+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:15:27.097517+0000","last_undegraded":"2026-02-20T03:15:27.097517+0000","last_fullsized":"2026-02-20T03:15:27.097517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749774+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:14:38.749774+0000","last_peered":"2026-02-20T03:14:38.749774+0000","last_clean":"2026-02-20T03:14:38.749774+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:14:38.749774+0000","last_undegraded":"2026-02-20T03:14:38.749774+0000","last_fullsized":"2026-02-20T03:14:38.749774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677473+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:15:27.677473+0000","last_peered":"2026-02-20T03:15:27.677473+0000","last_clean":"2026-02-20T03:15:27.677473+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:15:27.677473+0000","last_undegraded":"2026-02-20T03:15:27.677473+0000","last_fullsized":"2026-02-20T03:15:27.677473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093043+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:26.093043+0000","last_peered":"2026-02-20T03:15:26.093043+0000","last_clean":"2026-02-20T03:15:26.093043+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:26.093043+0000","last_undegraded":"2026-02-20T03:15:26.093043+0000","last_fullsized":"2026-02-20T03:15:26.093043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:40.062667+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:14:40.062667+0000","last_peered":"2026-02-20T03:14:40.062667+0000","last_clean":"2026-02-20T03:14:40.062667+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:14:40.062667+0000","last_undegraded":"2026-02-20T03:14:40.062667+0000","last_fullsized":"2026-02-20T03:14:40.062667+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677054+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:15:27.677054+0000","last_peered":"2026-02-20T03:15:27.677054+0000","last_clean":"2026-02-20T03:15:27.677054+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:15:27.677054+0000","last_undegraded":"2026-02-20T03:15:27.677054+0000","last_fullsized":"2026-02-20T03:15:27.677054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092084+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:15:27.092084+0000","last_peered":"2026-02-20T03:15:27.092084+0000","last_clean":"2026-02-20T03:15:27.092084+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:15:27.092084+0000","last_undegraded":"2026-02-20T03:15:27.092084+0000","last_fullsized":"2026-02-20T03:15:27.092084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095913+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:15:27.095913+0000","last_peered":"2026-02-20T03:15:27.095913+0000","last_clean":"2026-02-20T03:15:27.095913+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:15:27.095913+0000","last_undegraded":"2026-02-20T03:15:27.095913+0000","last_fullsized":"2026-02-20T03:15:27.095913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":26,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:50.357549+0000","last_change":"2026-02-20T03:15:26.097400+0000","last_active":"2026-02-20T03:15:26.097400+0000","last_peered":"2026-02-20T03:14:50.357549+0000","last_clean":"2026-02-20T03:14:50.357549+0000","last_became_active":"2026-02-20T03:14:32.086778+0000","last_became_peered":"2026-02-20T03:14:32.086778+0000","last_unstale":"2026-02-20T03:14:50.357549+0000","last_undegraded":"2026-02-20T03:14:50.357549+0000","last_fullsized":"2026-02-20T03:14:50.357549+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749946+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:14:38.749946+0000","last_peered":"2026-02-20T03:14:38.749946+0000","last_clean":"2026-02-20T03:14:38.749946+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:14:38.749946+0000","last_undegraded":"2026-02-20T03:14:38.749946+0000","last_fullsized":"2026-02-20T03:14:38.749946+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.311982+0000","last_change":"2026-02-20T03:15:26.089098+0000","last_active":"2026-02-20T03:15:26.089098+0000","last_peered":"2026-02-20T03:14:38.311982+0000","last_clean":"2026-02-20T03:14:38.311982+0000","last_became_active":"2026-02-20T03:14:33.297919+0000","last_became_peered":"2026-02-20T03:14:33.297919+0000","last_unstale":"2026-02-20T03:14:38.311982+0000","last_undegraded":"2026-02-20T03:14:38.311982+0000","last_fullsized":"2026-02-20T03:14:38.311982+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,4,6,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:50.357703+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:14:50.357703+0000","last_peered":"2026-02-20T03:14:50.357703+0000","last_clean":"2026-02-20T03:14:50.357703+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:14:50.357703+0000","last_undegraded":"2026-02-20T03:14:50.357703+0000","last_fullsized":"2026-02-20T03:14:50.357703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.092967+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:26.092967+0000","last_peered":"2026-02-20T03:15:26.092967+0000","last_clean":"2026-02-20T03:15:26.092967+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:26.092967+0000","last_undegraded":"2026-02-20T03:15:26.092967+0000","last_fullsized":"2026-02-20T03:15:26.092967+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677369+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:15:27.677369+0000","last_peered":"2026-02-20T03:15:27.677369+0000","last_clean":"2026-02-20T03:15:27.677369+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:15:27.677369+0000","last_undegraded":"2026-02-20T03:15:27.677369+0000","last_fullsized":"2026-02-20T03:15:27.677369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092065+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:27.092065+0000","last_peered":"2026-02-20T03:15:27.092065+0000","last_clean":"2026-02-20T03:15:27.092065+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:27.092065+0000","last_undegraded":"2026-02-20T03:15:27.092065+0000","last_fullsized":"2026-02-20T03:15:27.092065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676826+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:15:27.676826+0000","last_peered":"2026-02-20T03:15:27.676826+0000","last_clean":"2026-02-20T03:15:27.676826+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:15:27.676826+0000","last_undegraded":"2026-02-20T03:15:27.676826+0000","last_fullsized":"2026-02-20T03:15:27.676826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090039+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:15:27.090039+0000","last_peered":"2026-02-20T03:15:27.090039+0000","last_clean":"2026-02-20T03:15:27.090039+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:15:27.090039+0000","last_undegraded":"2026-02-20T03:15:27.090039+0000","last_fullsized":"2026-02-20T03:15:27.090039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099935+0000","last_change":"2026-02-20T03:15:27.099749+0000","last_active":"2026-02-20T03:15:27.099935+0000","last_peered":"2026-02-20T03:15:27.099935+0000","last_clean":"2026-02-20T03:15:27.099935+0000","last_became_active":"2026-02-20T03:15:27.096338+0000","last_became_peered":"2026-02-20T03:15:27.096338+0000","last_unstale":"2026-02-20T03:15:27.099935+0000","last_undegraded":"2026-02-20T03:15:27.099935+0000","last_fullsized":"2026-02-20T03:15:27.099935+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:59:55.738735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093553+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:15:27.093553+0000","last_peered":"2026-02-20T03:15:27.093553+0000","last_clean":"2026-02-20T03:15:27.093553+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:15:27.093553+0000","last_undegraded":"2026-02-20T03:15:27.093553+0000","last_fullsized":"2026-02-20T03:15:27.093553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384089+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:15:27.384089+0000","last_peered":"2026-02-20T03:15:27.384089+0000","last_clean":"2026-02-20T03:15:27.384089+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:15:27.384089+0000","last_undegraded":"2026-02-20T03:15:27.384089+0000","last_fullsized":"2026-02-20T03:15:27.384089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091877+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:15:27.091877+0000","last_peered":"2026-02-20T03:15:27.091877+0000","last_clean":"2026-02-20T03:15:27.091877+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:15:27.091877+0000","last_undegraded":"2026-02-20T03:15:27.091877+0000","last_fullsized":"2026-02-20T03:15:27.091877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095909+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:15:27.095909+0000","last_peered":"2026-02-20T03:15:27.095909+0000","last_clean":"2026-02-20T03:15:27.095909+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:15:27.095909+0000","last_undegraded":"2026-02-20T03:15:27.095909+0000","last_fullsized":"2026-02-20T03:15:27.095909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384056+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:15:27.384056+0000","last_peered":"2026-02-20T03:15:27.384056+0000","last_clean":"2026-02-20T03:15:27.384056+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:15:27.384056+0000","last_undegraded":"2026-02-20T03:15:27.384056+0000","last_fullsized":"2026-02-20T03:15:27.384056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097629+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:15:27.097629+0000","last_peered":"2026-02-20T03:15:27.097629+0000","last_clean":"2026-02-20T03:15:27.097629+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:15:27.097629+0000","last_undegraded":"2026-02-20T03:15:27.097629+0000","last_fullsized":"2026-02-20T03:15:27.097629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090084+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:15:27.090084+0000","last_peered":"2026-02-20T03:15:27.090084+0000","last_clean":"2026-02-20T03:15:27.090084+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:15:27.090084+0000","last_undegraded":"2026-02-20T03:15:27.090084+0000","last_fullsized":"2026-02-20T03:15:27.090084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096476+0000","last_change":"2026-02-20T03:15:27.096476+0000","last_active":"2026-02-20T03:15:27.096476+0000","last_peered":"2026-02-20T03:15:27.096476+0000","last_clean":"2026-02-20T03:15:27.096476+0000","last_became_active":"2026-02-20T03:15:27.096369+0000","last_became_peered":"2026-02-20T03:15:27.096369+0000","last_unstale":"2026-02-20T03:15:27.096476+0000","last_undegraded":"2026-02-20T03:15:27.096476+0000","last_fullsized":"2026-02-20T03:15:27.096476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:18:04.418088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089586+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:27.089586+0000","last_peered":"2026-02-20T03:15:27.089586+0000","last_clean":"2026-02-20T03:15:27.089586+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:27.089586+0000","last_undegraded":"2026-02-20T03:15:27.089586+0000","last_fullsized":"2026-02-20T03:15:27.089586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089978+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:15:27.089978+0000","last_peered":"2026-02-20T03:15:27.089978+0000","last_clean":"2026-02-20T03:15:27.089978+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:15:27.089978+0000","last_undegraded":"2026-02-20T03:15:27.089978+0000","last_fullsized":"2026-02-20T03:15:27.089978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089476+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:15:27.089476+0000","last_peered":"2026-02-20T03:15:27.089476+0000","last_clean":"2026-02-20T03:15:27.089476+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:15:27.089476+0000","last_undegraded":"2026-02-20T03:15:27.089476+0000","last_fullsized":"2026-02-20T03:15:27.089476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097578+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:15:27.097578+0000","last_peered":"2026-02-20T03:15:27.097578+0000","last_clean":"2026-02-20T03:15:27.097578+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:15:27.097578+0000","last_undegraded":"2026-02-20T03:15:27.097578+0000","last_fullsized":"2026-02-20T03:15:27.097578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093923+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:15:27.093923+0000","last_peered":"2026-02-20T03:15:27.093923+0000","last_clean":"2026-02-20T03:15:27.093923+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:15:27.093923+0000","last_undegraded":"2026-02-20T03:15:27.093923+0000","last_fullsized":"2026-02-20T03:15:27.093923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677506+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:15:27.677506+0000","last_peered":"2026-02-20T03:15:27.677506+0000","last_clean":"2026-02-20T03:15:27.677506+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:15:27.677506+0000","last_undegraded":"2026-02-20T03:15:27.677506+0000","last_fullsized":"2026-02-20T03:15:27.677506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:52.364868+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:14:52.364868+0000","last_peered":"2026-02-20T03:14:52.364868+0000","last_clean":"2026-02-20T03:14:52.364868+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:14:52.364868+0000","last_undegraded":"2026-02-20T03:14:52.364868+0000","last_fullsized":"2026-02-20T03:14:52.364868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":354,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097799+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:15:27.097799+0000","last_peered":"2026-02-20T03:15:27.097799+0000","last_clean":"2026-02-20T03:15:27.097799+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:15:27.097799+0000","last_undegraded":"2026-02-20T03:15:27.097799+0000","last_fullsized":"2026-02-20T03:15:27.097799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097882+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:15:27.097882+0000","last_peered":"2026-02-20T03:15:27.097882+0000","last_clean":"2026-02-20T03:15:27.097882+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:15:27.097882+0000","last_undegraded":"2026-02-20T03:15:27.097882+0000","last_fullsized":"2026-02-20T03:15:27.097882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098144+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:15:27.098144+0000","last_peered":"2026-02-20T03:15:27.098144+0000","last_clean":"2026-02-20T03:15:27.098144+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:15:27.098144+0000","last_undegraded":"2026-02-20T03:15:27.098144+0000","last_fullsized":"2026-02-20T03:15:27.098144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":2,"reported_epoch":90,"state":"peering","last_fresh":"2026-02-20T03:14:38.744446+0000","last_change":"2026-02-20T03:15:26.460325+0000","last_active":"2026-02-20T03:15:26.460325+0000","last_peered":"2026-02-20T03:14:38.744446+0000","last_clean":"2026-02-20T03:14:38.744446+0000","last_became_active":"2026-02-20T03:14:32.079385+0000","last_became_peered":"2026-02-20T03:14:32.079385+0000","last_unstale":"2026-02-20T03:14:38.744446+0000","last_undegraded":"2026-02-20T03:14:38.744446+0000","last_fullsized":"2026-02-20T03:14:38.744446+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097649+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:26.097649+0000","last_peered":"2026-02-20T03:15:26.097649+0000","last_clean":"2026-02-20T03:15:26.097649+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:26.097649+0000","last_undegraded":"2026-02-20T03:15:26.097649+0000","last_fullsized":"2026-02-20T03:15:26.097649+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097824+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:15:27.097824+0000","last_peered":"2026-02-20T03:15:27.097824+0000","last_clean":"2026-02-20T03:15:27.097824+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:15:27.097824+0000","last_undegraded":"2026-02-20T03:15:27.097824+0000","last_fullsized":"2026-02-20T03:15:27.097824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094597+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:15:27.094597+0000","last_peered":"2026-02-20T03:15:27.094597+0000","last_clean":"2026-02-20T03:15:27.094597+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:15:27.094597+0000","last_undegraded":"2026-02-20T03:15:27.094597+0000","last_fullsized":"2026-02-20T03:15:27.094597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088541+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:26.088541+0000","last_peered":"2026-02-20T03:15:26.088541+0000","last_clean":"2026-02-20T03:15:26.088541+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:26.088541+0000","last_undegraded":"2026-02-20T03:15:26.088541+0000","last_fullsized":"2026-02-20T03:15:26.088541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098225+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:15:27.098225+0000","last_peered":"2026-02-20T03:15:27.098225+0000","last_clean":"2026-02-20T03:15:27.098225+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:15:27.098225+0000","last_undegraded":"2026-02-20T03:15:27.098225+0000","last_fullsized":"2026-02-20T03:15:27.098225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089901+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:15:27.089901+0000","last_peered":"2026-02-20T03:15:27.089901+0000","last_clean":"2026-02-20T03:15:27.089901+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:15:27.089901+0000","last_undegraded":"2026-02-20T03:15:27.089901+0000","last_fullsized":"2026-02-20T03:15:27.089901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093235+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:15:27.093235+0000","last_peered":"2026-02-20T03:15:27.093235+0000","last_clean":"2026-02-20T03:15:27.093235+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:15:27.093235+0000","last_undegraded":"2026-02-20T03:15:27.093235+0000","last_fullsized":"2026-02-20T03:15:27.093235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093959+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:15:27.093959+0000","last_peered":"2026-02-20T03:15:27.093959+0000","last_clean":"2026-02-20T03:15:27.093959+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:15:27.093959+0000","last_undegraded":"2026-02-20T03:15:27.093959+0000","last_fullsized":"2026-02-20T03:15:27.093959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:15:27.096403+0000","last_peered":"2026-02-20T03:15:27.096403+0000","last_clean":"2026-02-20T03:15:27.096403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:15:27.096403+0000","last_undegraded":"2026-02-20T03:15:27.096403+0000","last_fullsized":"2026-02-20T03:15:27.096403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093292+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:15:27.093292+0000","last_peered":"2026-02-20T03:15:27.093292+0000","last_clean":"2026-02-20T03:15:27.093292+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:15:27.093292+0000","last_undegraded":"2026-02-20T03:15:27.093292+0000","last_fullsized":"2026-02-20T03:15:27.093292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093347+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:15:27.093347+0000","last_peered":"2026-02-20T03:15:27.093347+0000","last_clean":"2026-02-20T03:15:27.093347+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:15:27.093347+0000","last_undegraded":"2026-02-20T03:15:27.093347+0000","last_fullsized":"2026-02-20T03:15:27.093347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095895+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:15:27.095895+0000","last_peered":"2026-02-20T03:15:27.095895+0000","last_clean":"2026-02-20T03:15:27.095895+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:15:27.095895+0000","last_undegraded":"2026-02-20T03:15:27.095895+0000","last_fullsized":"2026-02-20T03:15:27.095895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089892+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:15:27.089892+0000","last_peered":"2026-02-20T03:15:27.089892+0000","last_clean":"2026-02-20T03:15:27.089892+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:15:27.089892+0000","last_undegraded":"2026-02-20T03:15:27.089892+0000","last_fullsized":"2026-02-20T03:15:27.089892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097367+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:15:27.097367+0000","last_peered":"2026-02-20T03:15:27.097367+0000","last_clean":"2026-02-20T03:15:27.097367+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:15:27.097367+0000","last_undegraded":"2026-02-20T03:15:27.097367+0000","last_fullsized":"2026-02-20T03:15:27.097367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:15:23.388416+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:23.388416+0000","last_peered":"2026-02-20T03:15:23.388416+0000","last_clean":"2026-02-20T03:15:23.388416+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:23.388416+0000","last_undegraded":"2026-02-20T03:15:23.388416+0000","last_fullsized":"2026-02-20T03:15:23.388416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092155+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:15:27.092155+0000","last_peered":"2026-02-20T03:15:27.092155+0000","last_clean":"2026-02-20T03:15:27.092155+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:15:27.092155+0000","last_undegraded":"2026-02-20T03:15:27.092155+0000","last_fullsized":"2026-02-20T03:15:27.092155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097787+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:15:27.097787+0000","last_peered":"2026-02-20T03:15:27.097787+0000","last_clean":"2026-02-20T03:15:27.097787+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:15:27.097787+0000","last_undegraded":"2026-02-20T03:15:27.097787+0000","last_fullsized":"2026-02-20T03:15:27.097787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093616+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:15:27.093616+0000","last_peered":"2026-02-20T03:15:27.093616+0000","last_clean":"2026-02-20T03:15:27.093616+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:15:27.093616+0000","last_undegraded":"2026-02-20T03:15:27.093616+0000","last_fullsized":"2026-02-20T03:15:27.093616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093604+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:15:27.093604+0000","last_peered":"2026-02-20T03:15:27.093604+0000","last_clean":"2026-02-20T03:15:27.093604+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:15:27.093604+0000","last_undegraded":"2026-02-20T03:15:27.093604+0000","last_fullsized":"2026-02-20T03:15:27.093604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089674+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:15:27.089674+0000","last_peered":"2026-02-20T03:15:27.089674+0000","last_clean":"2026-02-20T03:15:27.089674+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:15:27.089674+0000","last_undegraded":"2026-02-20T03:15:27.089674+0000","last_fullsized":"2026-02-20T03:15:27.089674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093258+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:26.093258+0000","last_peered":"2026-02-20T03:15:26.093258+0000","last_clean":"2026-02-20T03:15:26.093258+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:26.093258+0000","last_undegraded":"2026-02-20T03:15:26.093258+0000","last_fullsized":"2026-02-20T03:15:26.093258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093756+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:15:27.093756+0000","last_peered":"2026-02-20T03:15:27.093756+0000","last_clean":"2026-02-20T03:15:27.093756+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:15:27.093756+0000","last_undegraded":"2026-02-20T03:15:27.093756+0000","last_fullsized":"2026-02-20T03:15:27.093756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096216+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:15:27.096216+0000","last_peered":"2026-02-20T03:15:27.096216+0000","last_clean":"2026-02-20T03:15:27.096216+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:15:27.096216+0000","last_undegraded":"2026-02-20T03:15:27.096216+0000","last_fullsized":"2026-02-20T03:15:27.096216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:29.396148+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:29.396148+0000","last_peered":"2026-02-20T03:15:29.396148+0000","last_clean":"2026-02-20T03:15:29.396148+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:29.396148+0000","last_undegraded":"2026-02-20T03:15:29.396148+0000","last_fullsized":"2026-02-20T03:15:29.396148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73733,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":87,"num_read_kb":116,"num_write":35,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091741+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:15:27.091741+0000","last_peered":"2026-02-20T03:15:27.091741+0000","last_clean":"2026-02-20T03:15:27.091741+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:15:27.091741+0000","last_undegraded":"2026-02-20T03:15:27.091741+0000","last_fullsized":"2026-02-20T03:15:27.091741+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098166+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:26.098166+0000","last_peered":"2026-02-20T03:15:26.098166+0000","last_clean":"2026-02-20T03:15:26.098166+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:26.098166+0000","last_undegraded":"2026-02-20T03:15:26.098166+0000","last_fullsized":"2026-02-20T03:15:26.098166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094441+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:15:27.094441+0000","last_peered":"2026-02-20T03:15:27.094441+0000","last_clean":"2026-02-20T03:15:27.094441+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:15:27.094441+0000","last_undegraded":"2026-02-20T03:15:27.094441+0000","last_fullsized":"2026-02-20T03:15:27.094441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749701+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:14:38.749701+0000","last_peered":"2026-02-20T03:14:38.749701+0000","last_clean":"2026-02-20T03:14:38.749701+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:14:38.749701+0000","last_undegraded":"2026-02-20T03:14:38.749701+0000","last_fullsized":"2026-02-20T03:14:38.749701+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.089065+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:26.089065+0000","last_peered":"2026-02-20T03:15:26.089065+0000","last_clean":"2026-02-20T03:15:26.089065+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:26.089065+0000","last_undegraded":"2026-02-20T03:15:26.089065+0000","last_fullsized":"2026-02-20T03:15:26.089065+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098009+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:15:27.098009+0000","last_peered":"2026-02-20T03:15:27.098009+0000","last_clean":"2026-02-20T03:15:27.098009+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:15:27.098009+0000","last_undegraded":"2026-02-20T03:15:27.098009+0000","last_fullsized":"2026-02-20T03:15:27.098009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091618+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:15:27.091618+0000","last_peered":"2026-02-20T03:15:27.091618+0000","last_clean":"2026-02-20T03:15:27.091618+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:15:27.091618+0000","last_undegraded":"2026-02-20T03:15:27.091618+0000","last_fullsized":"2026-02-20T03:15:27.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.098167+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:26.098167+0000","last_peered":"2026-02-20T03:15:26.098167+0000","last_clean":"2026-02-20T03:15:26.098167+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:26.098167+0000","last_undegraded":"2026-02-20T03:15:26.098167+0000","last_fullsized":"2026-02-20T03:15:26.098167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:28.388164+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:28.388164+0000","last_peered":"2026-02-20T03:15:28.388164+0000","last_clean":"2026-02-20T03:15:28.388164+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:28.388164+0000","last_undegraded":"2026-02-20T03:15:28.388164+0000","last_fullsized":"2026-02-20T03:15:28.388164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676945+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:15:27.676945+0000","last_peered":"2026-02-20T03:15:27.676945+0000","last_clean":"2026-02-20T03:15:27.676945+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:15:27.676945+0000","last_undegraded":"2026-02-20T03:15:27.676945+0000","last_fullsized":"2026-02-20T03:15:27.676945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088557+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:26.088557+0000","last_peered":"2026-02-20T03:15:26.088557+0000","last_clean":"2026-02-20T03:15:26.088557+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:26.088557+0000","last_undegraded":"2026-02-20T03:15:26.088557+0000","last_fullsized":"2026-02-20T03:15:26.088557+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091995+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:15:27.091995+0000","last_peered":"2026-02-20T03:15:27.091995+0000","last_clean":"2026-02-20T03:15:27.091995+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:15:27.091995+0000","last_undegraded":"2026-02-20T03:15:27.091995+0000","last_fullsized":"2026-02-20T03:15:27.091995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094048+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:15:27.094048+0000","last_peered":"2026-02-20T03:15:27.094048+0000","last_clean":"2026-02-20T03:15:27.094048+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:15:27.094048+0000","last_undegraded":"2026-02-20T03:15:27.094048+0000","last_fullsized":"2026-02-20T03:15:27.094048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093983+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:15:27.093983+0000","last_peered":"2026-02-20T03:15:27.093983+0000","last_clean":"2026-02-20T03:15:27.093983+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:15:27.093983+0000","last_undegraded":"2026-02-20T03:15:27.093983+0000","last_fullsized":"2026-02-20T03:15:27.093983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676892+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:15:27.676892+0000","last_peered":"2026-02-20T03:15:27.676892+0000","last_clean":"2026-02-20T03:15:27.676892+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:15:27.676892+0000","last_undegraded":"2026-02-20T03:15:27.676892+0000","last_fullsized":"2026-02-20T03:15:27.676892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089481+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:15:27.089481+0000","last_peered":"2026-02-20T03:15:27.089481+0000","last_clean":"2026-02-20T03:15:27.089481+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:15:27.089481+0000","last_undegraded":"2026-02-20T03:15:27.089481+0000","last_fullsized":"2026-02-20T03:15:27.089481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383994+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:15:27.383994+0000","last_peered":"2026-02-20T03:15:27.383994+0000","last_clean":"2026-02-20T03:15:27.383994+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:15:27.383994+0000","last_undegraded":"2026-02-20T03:15:27.383994+0000","last_fullsized":"2026-02-20T03:15:27.383994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093591+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:15:27.093591+0000","last_peered":"2026-02-20T03:15:27.093591+0000","last_clean":"2026-02-20T03:15:27.093591+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:15:27.093591+0000","last_undegraded":"2026-02-20T03:15:27.093591+0000","last_fullsized":"2026-02-20T03:15:27.093591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093296+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:26.093296+0000","last_peered":"2026-02-20T03:15:26.093296+0000","last_clean":"2026-02-20T03:15:26.093296+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:26.093296+0000","last_undegraded":"2026-02-20T03:15:26.093296+0000","last_fullsized":"2026-02-20T03:15:26.093296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.382264+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:27.382264+0000","last_peered":"2026-02-20T03:15:27.382264+0000","last_clean":"2026-02-20T03:15:27.382264+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:27.382264+0000","last_undegraded":"2026-02-20T03:15:27.382264+0000","last_fullsized":"2026-02-20T03:15:27.382264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096098+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:15:27.096098+0000","last_peered":"2026-02-20T03:15:27.096098+0000","last_clean":"2026-02-20T03:15:27.096098+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:15:27.096098+0000","last_undegraded":"2026-02-20T03:15:27.096098+0000","last_fullsized":"2026-02-20T03:15:27.096098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093320+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:26.093320+0000","last_peered":"2026-02-20T03:15:26.093320+0000","last_clean":"2026-02-20T03:15:26.093320+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:26.093320+0000","last_undegraded":"2026-02-20T03:15:26.093320+0000","last_fullsized":"2026-02-20T03:15:26.093320+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093050+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:26.093050+0000","last_peered":"2026-02-20T03:15:26.093050+0000","last_clean":"2026-02-20T03:15:26.093050+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:26.093050+0000","last_undegraded":"2026-02-20T03:15:26.093050+0000","last_fullsized":"2026-02-20T03:15:26.093050+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093067+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:26.093067+0000","last_peered":"2026-02-20T03:15:26.093067+0000","last_clean":"2026-02-20T03:15:26.093067+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:26.093067+0000","last_undegraded":"2026-02-20T03:15:26.093067+0000","last_fullsized":"2026-02-20T03:15:26.093067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088712+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:26.088712+0000","last_peered":"2026-02-20T03:15:26.088712+0000","last_clean":"2026-02-20T03:15:26.088712+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:26.088712+0000","last_undegraded":"2026-02-20T03:15:26.088712+0000","last_fullsized":"2026-02-20T03:15:26.088712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090007+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:15:27.090007+0000","last_peered":"2026-02-20T03:15:27.090007+0000","last_clean":"2026-02-20T03:15:27.090007+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:15:27.090007+0000","last_undegraded":"2026-02-20T03:15:27.090007+0000","last_fullsized":"2026-02-20T03:15:27.090007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096323+0000","last_change":"2026-02-20T03:15:27.096323+0000","last_active":"2026-02-20T03:15:27.096323+0000","last_peered":"2026-02-20T03:15:27.096323+0000","last_clean":"2026-02-20T03:15:27.096323+0000","last_became_active":"2026-02-20T03:15:27.096171+0000","last_became_peered":"2026-02-20T03:15:27.096171+0000","last_unstale":"2026-02-20T03:15:27.096323+0000","last_undegraded":"2026-02-20T03:15:27.096323+0000","last_fullsized":"2026-02-20T03:15:27.096323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:00:54.803500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093494+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:26.093494+0000","last_peered":"2026-02-20T03:15:26.093494+0000","last_clean":"2026-02-20T03:15:26.093494+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:26.093494+0000","last_undegraded":"2026-02-20T03:15:26.093494+0000","last_fullsized":"2026-02-20T03:15:26.093494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677330+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:15:27.677330+0000","last_peered":"2026-02-20T03:15:27.677330+0000","last_clean":"2026-02-20T03:15:27.677330+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:15:27.677330+0000","last_undegraded":"2026-02-20T03:15:27.677330+0000","last_fullsized":"2026-02-20T03:15:27.677330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093789+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:15:27.093789+0000","last_peered":"2026-02-20T03:15:27.093789+0000","last_clean":"2026-02-20T03:15:27.093789+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:15:27.093789+0000","last_undegraded":"2026-02-20T03:15:27.093789+0000","last_fullsized":"2026-02-20T03:15:27.093789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677022+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:15:27.677022+0000","last_peered":"2026-02-20T03:15:27.677022+0000","last_clean":"2026-02-20T03:15:27.677022+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:15:27.677022+0000","last_undegraded":"2026-02-20T03:15:27.677022+0000","last_fullsized":"2026-02-20T03:15:27.677022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097832+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:26.097832+0000","last_peered":"2026-02-20T03:15:26.097832+0000","last_clean":"2026-02-20T03:15:26.097832+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:26.097832+0000","last_undegraded":"2026-02-20T03:15:26.097832+0000","last_fullsized":"2026-02-20T03:15:26.097832+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089899+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:15:27.089899+0000","last_peered":"2026-02-20T03:15:27.089899+0000","last_clean":"2026-02-20T03:15:27.089899+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:15:27.089899+0000","last_undegraded":"2026-02-20T03:15:27.089899+0000","last_fullsized":"2026-02-20T03:15:27.089899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093603+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:15:27.093603+0000","last_peered":"2026-02-20T03:15:27.093603+0000","last_clean":"2026-02-20T03:15:27.093603+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:15:27.093603+0000","last_undegraded":"2026-02-20T03:15:27.093603+0000","last_fullsized":"2026-02-20T03:15:27.093603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.093417+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:26.093417+0000","last_peered":"2026-02-20T03:15:26.093417+0000","last_clean":"2026-02-20T03:15:26.093417+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:26.093417+0000","last_undegraded":"2026-02-20T03:15:26.093417+0000","last_fullsized":"2026-02-20T03:15:26.093417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092017+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:15:27.092017+0000","last_peered":"2026-02-20T03:15:27.092017+0000","last_clean":"2026-02-20T03:15:27.092017+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:15:27.092017+0000","last_undegraded":"2026-02-20T03:15:27.092017+0000","last_fullsized":"2026-02-20T03:15:27.092017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094334+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:15:27.094334+0000","last_peered":"2026-02-20T03:15:27.094334+0000","last_clean":"2026-02-20T03:15:27.094334+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:15:27.094334+0000","last_undegraded":"2026-02-20T03:15:27.094334+0000","last_fullsized":"2026-02-20T03:15:27.094334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.097561+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:26.097561+0000","last_peered":"2026-02-20T03:15:26.097561+0000","last_clean":"2026-02-20T03:15:26.097561+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:26.097561+0000","last_undegraded":"2026-02-20T03:15:26.097561+0000","last_fullsized":"2026-02-20T03:15:26.097561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088395+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:26.088395+0000","last_peered":"2026-02-20T03:15:26.088395+0000","last_clean":"2026-02-20T03:15:26.088395+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:26.088395+0000","last_undegraded":"2026-02-20T03:15:26.088395+0000","last_fullsized":"2026-02-20T03:15:26.088395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088313+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:26.088313+0000","last_peered":"2026-02-20T03:15:26.088313+0000","last_clean":"2026-02-20T03:15:26.088313+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:26.088313+0000","last_undegraded":"2026-02-20T03:15:26.088313+0000","last_fullsized":"2026-02-20T03:15:26.088313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089821+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:15:27.089821+0000","last_peered":"2026-02-20T03:15:27.089821+0000","last_clean":"2026-02-20T03:15:27.089821+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:15:27.089821+0000","last_undegraded":"2026-02-20T03:15:27.089821+0000","last_fullsized":"2026-02-20T03:15:27.089821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749938+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:14:38.749938+0000","last_peered":"2026-02-20T03:14:38.749938+0000","last_clean":"2026-02-20T03:14:38.749938+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:14:38.749938+0000","last_undegraded":"2026-02-20T03:14:38.749938+0000","last_fullsized":"2026-02-20T03:14:38.749938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098066+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:15:27.098066+0000","last_peered":"2026-02-20T03:15:27.098066+0000","last_clean":"2026-02-20T03:15:27.098066+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:15:27.098066+0000","last_undegraded":"2026-02-20T03:15:27.098066+0000","last_fullsized":"2026-02-20T03:15:27.098066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384200+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:15:27.384200+0000","last_peered":"2026-02-20T03:15:27.384200+0000","last_clean":"2026-02-20T03:15:27.384200+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:15:27.384200+0000","last_undegraded":"2026-02-20T03:15:27.384200+0000","last_fullsized":"2026-02-20T03:15:27.384200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":89,"state":"peering","last_fresh":"2026-02-20T03:14:38.749677+0000","last_change":"2026-02-20T03:15:26.098509+0000","last_active":"2026-02-20T03:15:26.098509+0000","last_peered":"2026-02-20T03:14:38.749677+0000","last_clean":"2026-02-20T03:14:38.749677+0000","last_became_active":"2026-02-20T03:14:33.295836+0000","last_became_peered":"2026-02-20T03:14:33.295836+0000","last_unstale":"2026-02-20T03:14:38.749677+0000","last_undegraded":"2026-02-20T03:14:38.749677+0000","last_fullsized":"2026-02-20T03:14:38.749677+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,6,11],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676902+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:15:27.676902+0000","last_peered":"2026-02-20T03:15:27.676902+0000","last_clean":"2026-02-20T03:15:27.676902+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:15:27.676902+0000","last_undegraded":"2026-02-20T03:15:27.676902+0000","last_fullsized":"2026-02-20T03:15:27.676902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097349+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:15:27.097349+0000","last_peered":"2026-02-20T03:15:27.097349+0000","last_clean":"2026-02-20T03:15:27.097349+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:15:27.097349+0000","last_undegraded":"2026-02-20T03:15:27.097349+0000","last_fullsized":"2026-02-20T03:15:27.097349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383987+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:15:27.383987+0000","last_peered":"2026-02-20T03:15:27.383987+0000","last_clean":"2026-02-20T03:15:27.383987+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:15:27.383987+0000","last_undegraded":"2026-02-20T03:15:27.383987+0000","last_fullsized":"2026-02-20T03:15:27.383987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2026-02-20T03:14:38.749792+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:14:38.749792+0000","last_peered":"2026-02-20T03:14:38.749792+0000","last_clean":"2026-02-20T03:14:38.749792+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:14:38.749792+0000","last_undegraded":"2026-02-20T03:14:38.749792+0000","last_fullsized":"2026-02-20T03:14:38.749792+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088720+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:26.088720+0000","last_peered":"2026-02-20T03:15:26.088720+0000","last_clean":"2026-02-20T03:15:26.088720+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:26.088720+0000","last_undegraded":"2026-02-20T03:15:26.088720+0000","last_fullsized":"2026-02-20T03:15:26.088720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2026-02-20T03:15:26.088833+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:26.088833+0000","last_peered":"2026-02-20T03:15:26.088833+0000","last_clean":"2026-02-20T03:15:26.088833+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:26.088833+0000","last_undegraded":"2026-02-20T03:15:26.088833+0000","last_fullsized":"2026-02-20T03:15:26.088833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094313+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:15:27.094313+0000","last_peered":"2026-02-20T03:15:27.094313+0000","last_clean":"2026-02-20T03:15:27.094313+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:15:27.094313+0000","last_undegraded":"2026-02-20T03:15:27.094313+0000","last_fullsized":"2026-02-20T03:15:27.094313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78071,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":249,"num_read_kb":208,"num_write":168,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":614,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":225415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32140,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971060,"statfs":{"total":751619276800,"available":751586365440,"internally_reserved":0,"allocated":1032192,"data_stored":502911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32820,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970380,"statfs":{"total":751619276800,"available":751585669120,"internally_reserved":0,"allocated":1728512,"data_stored":1164282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776149,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":507221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037783,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32132,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971068,"statfs":{"total":751619276800,"available":751586373632,"internally_reserved":0,"allocated":1028096,"data_stored":493740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299417,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32712,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970488,"statfs":{"total":751619276800,"available":751585779712,"internally_reserved":0,"allocated":1622016,"data_stored":1089956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462939,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1024000,"data_stored":498291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28576,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974624,"statfs":{"total":751619276800,"available":751590014976,"internally_reserved":0,"allocated":1646592,"data_stored":1094457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888095,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32104,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971096,"statfs":{"total":751619276800,"available":751586402304,"internally_reserved":0,"allocated":1003520,"data_stored":484494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149730,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1036288,"data_stored":498485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378660,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28048,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975152,"statfs":{"total":751619276800,"available":751590555648,"internally_reserved":0,"allocated":1105920,"data_stored":559896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28004,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975196,"statfs":{"total":751619276800,"available":751590600704,"internally_reserved":0,"allocated":1064960,"data_stored":548696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27956,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975244,"statfs":{"total":751619276800,"available":751590649856,"internally_reserved":0,"allocated":1015808,"data_stored":480860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":75713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:31.942 INFO:tasks.fwd_scrub.ceph_manager:PG 2.8 is not active+clean 2026-02-20T03:15:31.942 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '2.8', 'version': "89'2", 'reported_seq': 26, 'reported_epoch': 89, 'state': 'peering', 'last_fresh': '2026-02-20T03:14:50.357549+0000', 'last_change': '2026-02-20T03:15:26.097400+0000', 'last_active': '2026-02-20T03:15:26.097400+0000', 'last_peered': '2026-02-20T03:14:50.357549+0000', 'last_clean': '2026-02-20T03:14:50.357549+0000', 'last_became_active': '2026-02-20T03:14:32.086778+0000', 'last_became_peered': '2026-02-20T03:14:32.086778+0000', 'last_unstale': '2026-02-20T03:14:50.357549+0000', 'last_undegraded': '2026-02-20T03:14:50.357549+0000', 'last_fullsized': '2026-02-20T03:14:50.357549+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 83, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'last_clean_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'objects_scrubbed': 0, 'log_size': 2, 'log_dups_size': 0, 'ondisk_log_size': 2, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 3, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 11, 0], 'acting': [1, 11, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 2, 11], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2026-02-20T03:15:31.942 INFO:tasks.fwd_scrub.ceph_manager:PG 3.6 is not active+clean 2026-02-20T03:15:31.942 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 22, 'reported_epoch': 89, 'state': 'peering', 'last_fresh': '2026-02-20T03:14:38.311982+0000', 'last_change': '2026-02-20T03:15:26.089098+0000', 'last_active': '2026-02-20T03:15:26.089098+0000', 'last_peered': '2026-02-20T03:14:38.311982+0000', 'last_clean': '2026-02-20T03:14:38.311982+0000', 'last_became_active': '2026-02-20T03:14:33.297919+0000', 'last_became_peered': '2026-02-20T03:14:33.297919+0000', 'last_unstale': '2026-02-20T03:14:38.311982+0000', 'last_undegraded': '2026-02-20T03:14:38.311982+0000', 'last_fullsized': '2026-02-20T03:14:38.311982+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'last_clean_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6, 7], 'acting': [0, 6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3, 4, 6, 7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2026-02-20T03:15:31.942 INFO:tasks.fwd_scrub.ceph_manager:PG 2.c is not active+clean 2026-02-20T03:15:31.942 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '2.c', 'version': "89'3", 'reported_seq': 2, 'reported_epoch': 90, 'state': 'peering', 'last_fresh': '2026-02-20T03:14:38.744446+0000', 'last_change': '2026-02-20T03:15:26.460325+0000', 'last_active': '2026-02-20T03:15:26.460325+0000', 'last_peered': '2026-02-20T03:14:38.744446+0000', 'last_clean': '2026-02-20T03:14:38.744446+0000', 'last_became_active': '2026-02-20T03:14:32.079385+0000', 'last_became_peered': '2026-02-20T03:14:32.079385+0000', 'last_unstale': '2026-02-20T03:14:38.744446+0000', 'last_undegraded': '2026-02-20T03:14:38.744446+0000', 'last_fullsized': '2026-02-20T03:14:38.744446+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 83, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'last_clean_scrub_stamp': '2026-02-20T03:14:31.063769+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 0, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 592, 'num_objects': 2, 'num_object_clones': 0, 'num_object_copies': 6, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 2, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 2, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 4, 'num_write_kb': 1, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 11, 0], 'acting': [1, 11, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2026-02-20T03:15:31.942 INFO:tasks.fwd_scrub.ceph_manager:PG 3.37 is not active+clean 2026-02-20T03:15:31.942 INFO:tasks.fwd_scrub.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 22, 'reported_epoch': 89, 'state': 'peering', 'last_fresh': '2026-02-20T03:14:38.749677+0000', 'last_change': '2026-02-20T03:15:26.098509+0000', 'last_active': '2026-02-20T03:15:26.098509+0000', 'last_peered': '2026-02-20T03:14:38.749677+0000', 'last_clean': '2026-02-20T03:14:38.749677+0000', 'last_became_active': '2026-02-20T03:14:33.295836+0000', 'last_became_peered': '2026-02-20T03:14:33.295836+0000', 'last_unstale': '2026-02-20T03:14:38.749677+0000', 'last_undegraded': '2026-02-20T03:14:38.749677+0000', 'last_fullsized': '2026-02-20T03:14:38.749677+0000', 'mapping_epoch': 90, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 84, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'last_clean_scrub_stamp': '2026-02-20T03:14:32.065320+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6, 11], 'acting': [1, 6, 11], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5, 6, 11], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2026-02-20T03:15:31.942 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-20T03:15:32.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.101+0000 7f3955ba2640 1 -- 10.20.193.28:0/3906988806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39501026a0 msgr2=0x7f3950102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.101+0000 7f3955ba2640 1 --2- 10.20.193.28:0/3906988806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39501026a0 0x7f3950102aa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3940009a30 tx=0x7f394002f220 comp rx=0 tx=0).stop 2026-02-20T03:15:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.102+0000 7f3955ba2640 1 -- 10.20.193.28:0/3906988806 shutdown_connections 2026-02-20T03:15:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.102+0000 7f3955ba2640 1 --2- 10.20.193.28:0/3906988806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3950104250 0x7f395010aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.102+0000 7f3955ba2640 1 --2- 10.20.193.28:0/3906988806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3950103890 0x7f3950103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.102+0000 7f3955ba2640 1 --2- 10.20.193.28:0/3906988806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39501026a0 0x7f3950102aa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.102+0000 7f3955ba2640 1 -- 10.20.193.28:0/3906988806 >> 10.20.193.28:0/3906988806 conn(0x7f39500fde20 msgr2=0x7f3950100240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.102+0000 7f3955ba2640 1 -- 10.20.193.28:0/3906988806 shutdown_connections 2026-02-20T03:15:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.102+0000 7f3955ba2640 1 -- 10.20.193.28:0/3906988806 wait complete. 2026-02-20T03:15:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.102+0000 7f3955ba2640 1 Processor -- start 2026-02-20T03:15:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3955ba2640 1 -- start start 2026-02-20T03:15:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3955ba2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39501026a0 0x7f395019ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3955ba2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3950103890 0x7f395019cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3955ba2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3950104250 0x7f39501a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3955ba2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f395010e170 con 0x7f39501026a0 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3955ba2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f395010dff0 con 0x7f3950104250 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3955ba2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f395010e2f0 con 0x7f3950103890 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3947fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3950103890 0x7f395019cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3947fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3950103890 0x7f395019cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33252/0 (socket says 10.20.193.28:33252) 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3947fff640 1 -- 10.20.193.28:0/4276807447 learned_addr learned my addr 10.20.193.28:0/4276807447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f39553a1640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3950104250 0x7f39501a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3947fff640 1 -- 10.20.193.28:0/4276807447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3950104250 msgr2=0x7f39501a3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3947fff640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3950104250 0x7f39501a3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3947fff640 1 -- 10.20.193.28:0/4276807447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39501026a0 msgr2=0x7f395019ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3947fff640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39501026a0 0x7f395019ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.103+0000 7f3947fff640 1 -- 10.20.193.28:0/4276807447 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39501a46e0 con 0x7f3950103890 2026-02-20T03:15:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.104+0000 7f3947fff640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3950103890 0x7f395019cf70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f393800ea10 tx=0x7f393800eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.104+0000 7f3945ffb640 1 -- 10.20.193.28:0/4276807447 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393800ce50 con 0x7f3950103890 2026-02-20T03:15:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.104+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39501a49d0 con 0x7f3950103890 2026-02-20T03:15:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.104+0000 7f3945ffb640 1 -- 10.20.193.28:0/4276807447 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3938004570 con 0x7f3950103890 2026-02-20T03:15:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.104+0000 7f3945ffb640 1 -- 10.20.193.28:0/4276807447 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938010690 con 0x7f3950103890 2026-02-20T03:15:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.104+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501a4f70 con 0x7f3950103890 2026-02-20T03:15:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.105+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3950102aa0 con 0x7f3950103890 2026-02-20T03:15:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.107+0000 7f3945ffb640 1 -- 10.20.193.28:0/4276807447 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f3938044ce0 con 0x7f3950103890 2026-02-20T03:15:32.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.109+0000 7f3945ffb640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f392c0b1050 0x7f392c0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:32.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.109+0000 7f3945ffb640 1 -- 10.20.193.28:0/4276807447 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f39380e0f40 con 0x7f3950103890 2026-02-20T03:15:32.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.109+0000 7f3954ba0640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f392c0b1050 0x7f392c0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.109+0000 7f3945ffb640 1 -- 10.20.193.28:0/4276807447 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f39380e13c0 con 0x7f3950103890 2026-02-20T03:15:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.109+0000 7f3954ba0640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f392c0b1050 0x7f392c0b3510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3940005d20 tx=0x7f3940005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:32.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.231+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f39501a5420 con 0x7f3950103890 2026-02-20T03:15:32.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.231+0000 7f3945ffb640 1 -- 10.20.193.28:0/4276807447 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2585 (secure 0 0 0) 0x7f39380a92b0 con 0x7f3950103890 2026-02-20T03:15:32.233 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:32.233 INFO:teuthology.orchestra.run.trial028.stdout:{"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":222,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":91,"num_osds":12,"num_up_osds":12,"osd_up_since":1771557253,"num_in_osds":12,"osd_in_since":1771557238,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":125},{"state_name":"peering","count":4}],"num_pgs":129,"num_pools":4,"num_objects":64,"data_bytes":668673,"bytes_used":367042560,"bytes_avail":9019064279040,"bytes_total":9019431321600,"inactive_pgs_ratio":0.031007751822471619,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":76,"recovering_keys_per_sec":0,"num_objects_recovered":5,"num_bytes_recovered":614,"num_keys_recovered":0,"read_bytes_sec":4735,"write_bytes_sec":1279,"read_op_per_sec":7,"write_op_per_sec":0},"fsmap":{"epoch":22,"btime":"2026-02-20T03:15:25:077948+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"e","status":"up:standby-replay","gid":24515},{"filesystem_id":1,"rank":1,"name":"f","status":"up:standby-replay","gid":24517},{"filesystem_id":1,"rank":0,"name":"c","status":"up:standby-replay","gid":24523},{"filesystem_id":1,"rank":2,"name":"h","status":"up:active","gid":24533},{"filesystem_id":1,"rank":1,"name":"i","status":"up:active","gid":24538},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24560}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://10.20.193.28:8443/"}},"servicemap":{"epoch":22,"modified":"2026-02-20T03:15:28.009899+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2026-02-20T03:15:32.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f392c0b1050 msgr2=0x7f392c0b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f392c0b1050 0x7f392c0b3510 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3940005d20 tx=0x7f3940005c50 comp rx=0 tx=0).stop 2026-02-20T03:15:32.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3950103890 msgr2=0x7f395019cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3950103890 0x7f395019cf70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f393800ea10 tx=0x7f393800eee0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 shutdown_connections 2026-02-20T03:15:32.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f392c0b1050 0x7f392c0b3510 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3950104250 0x7f39501a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3950103890 0x7f395019cf70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 --2- 10.20.193.28:0/4276807447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39501026a0 0x7f395019ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 >> 10.20.193.28:0/4276807447 conn(0x7f39500fde20 msgr2=0x7f3950109110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:32.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 shutdown_connections 2026-02-20T03:15:32.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.232+0000 7f3955ba2640 1 -- 10.20.193.28:0/4276807447 wait complete. 2026-02-20T03:15:32.246 INFO:tasks.fwd_scrub.ceph_manager:making progress, resetting timeout 2026-02-20T03:15:32.247 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T03:15:32.296 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:32 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:15:32.296 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:32 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:15:32.296 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:32 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:32.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 -- 10.20.193.28:0/71368951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690104920 msgr2=0x7f4690104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 --2- 10.20.193.28:0/71368951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690104920 0x7f4690104d20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4680009a30 tx=0x7f468002f220 comp rx=0 tx=0).stop 2026-02-20T03:15:32.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 -- 10.20.193.28:0/71368951 shutdown_connections 2026-02-20T03:15:32.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 --2- 10.20.193.28:0/71368951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46901064d0 0x7f469010cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 --2- 10.20.193.28:0/71368951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4690105b10 0x7f4690105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 --2- 10.20.193.28:0/71368951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690104920 0x7f4690104d20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 -- 10.20.193.28:0/71368951 >> 10.20.193.28:0/71368951 conn(0x7f4690100080 msgr2=0x7f46901024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:32.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 -- 10.20.193.28:0/71368951 shutdown_connections 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 -- 10.20.193.28:0/71368951 wait complete. 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.368+0000 7f469740d640 1 Processor -- start 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f469740d640 1 -- start start 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f469740d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4690104920 0x7f469019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f469740d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690105b10 0x7f469019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f469740d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46901064d0 0x7f46901a4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f469740d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4690110410 con 0x7f4690105b10 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f469740d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4690110290 con 0x7f46901064d0 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f469740d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4690110590 con 0x7f4690104920 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4695c0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690105b10 0x7f469019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4695c0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690105b10 0x7f469019cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33778/0 (socket says 10.20.193.28:33778) 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4695c0a640 1 -- 10.20.193.28:0/3610874809 learned_addr learned my addr 10.20.193.28:0/3610874809 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f469640b640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4690104920 0x7f469019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4696c0c640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46901064d0 0x7f46901a4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4695c0a640 1 -- 10.20.193.28:0/3610874809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4690104920 msgr2=0x7f469019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4695c0a640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4690104920 0x7f469019ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4695c0a640 1 -- 10.20.193.28:0/3610874809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46901064d0 msgr2=0x7f46901a4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4695c0a640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46901064d0 0x7f46901a4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4695c0a640 1 -- 10.20.193.28:0/3610874809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46901a46b0 con 0x7f4690105b10 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.369+0000 7f4695c0a640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690105b10 0x7f469019cfd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f468400d980 tx=0x7f468400de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.370+0000 7f46777fe640 1 -- 10.20.193.28:0/3610874809 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684014070 con 0x7f4690105b10 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.370+0000 7f46777fe640 1 -- 10.20.193.28:0/3610874809 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f46840044e0 con 0x7f4690105b10 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.370+0000 7f46777fe640 1 -- 10.20.193.28:0/3610874809 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684005040 con 0x7f4690105b10 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.370+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46901a49a0 con 0x7f4690105b10 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.370+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46901a4ea0 con 0x7f4690105b10 2026-02-20T03:15:32.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.370+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469010b890 con 0x7f4690105b10 2026-02-20T03:15:32.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.372+0000 7f46777fe640 1 -- 10.20.193.28:0/3610874809 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f46840047c0 con 0x7f4690105b10 2026-02-20T03:15:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.374+0000 7f46777fe640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f466c0b0eb0 0x7f466c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.374+0000 7f46777fe640 1 -- 10.20.193.28:0/3610874809 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f46840e0a20 con 0x7f4690105b10 2026-02-20T03:15:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.374+0000 7f469640b640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f466c0b0eb0 0x7f466c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.374+0000 7f469640b640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f466c0b0eb0 0x7f466c0b3370 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4680002410 tx=0x7f468003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.375+0000 7f46777fe640 1 -- 10.20.193.28:0/3610874809 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f46840a8d90 con 0x7f4690105b10 2026-02-20T03:15:32.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.463+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46900630c0 con 0x7f466c0b0eb0 2026-02-20T03:15:32.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:32 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:15:32.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:32 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:15:32.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:32 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:32.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.468+0000 7f46777fe640 1 -- 10.20.193.28:0/3610874809 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340406 (secure 0 0 0) 0x7f468009b1d0 con 0x7f466c0b0eb0 2026-02-20T03:15:32.471 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:32.473 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f466c0b0eb0 msgr2=0x7f466c0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f466c0b0eb0 0x7f466c0b3370 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4680002410 tx=0x7f468003a040 comp rx=0 tx=0).stop 2026-02-20T03:15:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690105b10 msgr2=0x7f469019cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690105b10 0x7f469019cfd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f468400d980 tx=0x7f468400de50 comp rx=0 tx=0).stop 2026-02-20T03:15:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 shutdown_connections 2026-02-20T03:15:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f466c0b0eb0 0x7f466c0b3370 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46901064d0 0x7f46901a4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4690105b10 0x7f469019cfd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 --2- 10.20.193.28:0/3610874809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4690104920 0x7f469019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 >> 10.20.193.28:0/3610874809 conn(0x7f4690100080 msgr2=0x7f4690108ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 shutdown_connections 2026-02-20T03:15:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:32.471+0000 7f469740d640 1 -- 10.20.193.28:0/3610874809 wait complete. 2026-02-20T03:15:32.484 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2026-02-20T03:15:32.010524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668673,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":360,"num_read_kb":299,"num_write":359,"num_write_kb":3849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181942,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358580,"kb_used_data":14144,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807679820,"statfs":{"total":9019431321600,"available":9019064135680,"internally_reserved":0,"allocated":14483456,"data_stored":7998501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6683,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":32,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001541"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.389259+0000","last_change":"2026-02-20T03:15:27.389259+0000","last_active":"2026-02-20T03:15:27.389259+0000","last_peered":"2026-02-20T03:15:27.389259+0000","last_clean":"2026-02-20T03:15:27.389259+0000","last_became_active":"2026-02-20T03:15:27.385887+0000","last_became_peered":"2026-02-20T03:15:27.385887+0000","last_unstale":"2026-02-20T03:15:27.389259+0000","last_undegraded":"2026-02-20T03:15:27.389259+0000","last_fullsized":"2026-02-20T03:15:27.389259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:20:01.907763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677322+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:15:27.677322+0000","last_peered":"2026-02-20T03:15:27.677322+0000","last_clean":"2026-02-20T03:15:27.677322+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:15:27.677322+0000","last_undegraded":"2026-02-20T03:15:27.677322+0000","last_fullsized":"2026-02-20T03:15:27.677322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091764+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:27.091764+0000","last_peered":"2026-02-20T03:15:27.091764+0000","last_clean":"2026-02-20T03:15:27.091764+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:27.091764+0000","last_undegraded":"2026-02-20T03:15:27.091764+0000","last_fullsized":"2026-02-20T03:15:27.091764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677381+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:15:27.677381+0000","last_peered":"2026-02-20T03:15:27.677381+0000","last_clean":"2026-02-20T03:15:27.677381+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:15:27.677381+0000","last_undegraded":"2026-02-20T03:15:27.677381+0000","last_fullsized":"2026-02-20T03:15:27.677381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092401+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:27.092401+0000","last_peered":"2026-02-20T03:15:27.092401+0000","last_clean":"2026-02-20T03:15:27.092401+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:27.092401+0000","last_undegraded":"2026-02-20T03:15:27.092401+0000","last_fullsized":"2026-02-20T03:15:27.092401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392166+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:15:27.392166+0000","last_peered":"2026-02-20T03:15:27.392166+0000","last_clean":"2026-02-20T03:15:27.392166+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:15:27.392166+0000","last_undegraded":"2026-02-20T03:15:27.392166+0000","last_fullsized":"2026-02-20T03:15:27.392166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096362+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:15:27.096362+0000","last_peered":"2026-02-20T03:15:27.096362+0000","last_clean":"2026-02-20T03:15:27.096362+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:15:27.096362+0000","last_undegraded":"2026-02-20T03:15:27.096362+0000","last_fullsized":"2026-02-20T03:15:27.096362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100051+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:27.100051+0000","last_peered":"2026-02-20T03:15:27.100051+0000","last_clean":"2026-02-20T03:15:27.100051+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:27.100051+0000","last_undegraded":"2026-02-20T03:15:27.100051+0000","last_fullsized":"2026-02-20T03:15:27.100051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392411+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:15:27.392411+0000","last_peered":"2026-02-20T03:15:27.392411+0000","last_clean":"2026-02-20T03:15:27.392411+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:15:27.392411+0000","last_undegraded":"2026-02-20T03:15:27.392411+0000","last_fullsized":"2026-02-20T03:15:27.392411+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096305+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:15:27.096305+0000","last_peered":"2026-02-20T03:15:27.096305+0000","last_clean":"2026-02-20T03:15:27.096305+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:15:27.096305+0000","last_undegraded":"2026-02-20T03:15:27.096305+0000","last_fullsized":"2026-02-20T03:15:27.096305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096792+0000","last_change":"2026-02-20T03:15:27.096792+0000","last_active":"2026-02-20T03:15:27.096792+0000","last_peered":"2026-02-20T03:15:27.096792+0000","last_clean":"2026-02-20T03:15:27.096792+0000","last_became_active":"2026-02-20T03:15:27.096659+0000","last_became_peered":"2026-02-20T03:15:27.096659+0000","last_unstale":"2026-02-20T03:15:27.096792+0000","last_undegraded":"2026-02-20T03:15:27.096792+0000","last_fullsized":"2026-02-20T03:15:27.096792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:57.312267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392339+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:15:27.392339+0000","last_peered":"2026-02-20T03:15:27.392339+0000","last_clean":"2026-02-20T03:15:27.392339+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:15:27.392339+0000","last_undegraded":"2026-02-20T03:15:27.392339+0000","last_fullsized":"2026-02-20T03:15:27.392339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097517+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:15:27.097517+0000","last_peered":"2026-02-20T03:15:27.097517+0000","last_clean":"2026-02-20T03:15:27.097517+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:15:27.097517+0000","last_undegraded":"2026-02-20T03:15:27.097517+0000","last_fullsized":"2026-02-20T03:15:27.097517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392602+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:15:27.392602+0000","last_peered":"2026-02-20T03:15:27.392602+0000","last_clean":"2026-02-20T03:15:27.392602+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:15:27.392602+0000","last_undegraded":"2026-02-20T03:15:27.392602+0000","last_fullsized":"2026-02-20T03:15:27.392602+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677473+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:15:27.677473+0000","last_peered":"2026-02-20T03:15:27.677473+0000","last_clean":"2026-02-20T03:15:27.677473+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:15:27.677473+0000","last_undegraded":"2026-02-20T03:15:27.677473+0000","last_fullsized":"2026-02-20T03:15:27.677473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091890+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:27.091890+0000","last_peered":"2026-02-20T03:15:27.091890+0000","last_clean":"2026-02-20T03:15:27.091890+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:27.091890+0000","last_undegraded":"2026-02-20T03:15:27.091890+0000","last_fullsized":"2026-02-20T03:15:27.091890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392578+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:15:27.392578+0000","last_peered":"2026-02-20T03:15:27.392578+0000","last_clean":"2026-02-20T03:15:27.392578+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:15:27.392578+0000","last_undegraded":"2026-02-20T03:15:27.392578+0000","last_fullsized":"2026-02-20T03:15:27.392578+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677054+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:15:27.677054+0000","last_peered":"2026-02-20T03:15:27.677054+0000","last_clean":"2026-02-20T03:15:27.677054+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:15:27.677054+0000","last_undegraded":"2026-02-20T03:15:27.677054+0000","last_fullsized":"2026-02-20T03:15:27.677054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092084+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:15:27.092084+0000","last_peered":"2026-02-20T03:15:27.092084+0000","last_clean":"2026-02-20T03:15:27.092084+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:15:27.092084+0000","last_undegraded":"2026-02-20T03:15:27.092084+0000","last_fullsized":"2026-02-20T03:15:27.092084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095913+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:15:27.095913+0000","last_peered":"2026-02-20T03:15:27.095913+0000","last_clean":"2026-02-20T03:15:27.095913+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:15:27.095913+0000","last_undegraded":"2026-02-20T03:15:27.095913+0000","last_fullsized":"2026-02-20T03:15:27.095913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.106320+0000","last_change":"2026-02-20T03:15:27.106320+0000","last_active":"2026-02-20T03:15:27.106320+0000","last_peered":"2026-02-20T03:15:27.106320+0000","last_clean":"2026-02-20T03:15:27.106320+0000","last_became_active":"2026-02-20T03:15:27.101151+0000","last_became_peered":"2026-02-20T03:15:27.101151+0000","last_unstale":"2026-02-20T03:15:27.106320+0000","last_undegraded":"2026-02-20T03:15:27.106320+0000","last_fullsized":"2026-02-20T03:15:27.106320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:56.197115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392629+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:15:27.392629+0000","last_peered":"2026-02-20T03:15:27.392629+0000","last_clean":"2026-02-20T03:15:27.392629+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:15:27.392629+0000","last_undegraded":"2026-02-20T03:15:27.392629+0000","last_fullsized":"2026-02-20T03:15:27.392629+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093728+0000","last_change":"2026-02-20T03:15:27.093728+0000","last_active":"2026-02-20T03:15:27.093728+0000","last_peered":"2026-02-20T03:15:27.093728+0000","last_clean":"2026-02-20T03:15:27.093728+0000","last_became_active":"2026-02-20T03:15:27.093455+0000","last_became_peered":"2026-02-20T03:15:27.093455+0000","last_unstale":"2026-02-20T03:15:27.093728+0000","last_undegraded":"2026-02-20T03:15:27.093728+0000","last_fullsized":"2026-02-20T03:15:27.093728+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:38:26.593708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392844+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:15:27.392844+0000","last_peered":"2026-02-20T03:15:27.392844+0000","last_clean":"2026-02-20T03:15:27.392844+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:15:27.392844+0000","last_undegraded":"2026-02-20T03:15:27.392844+0000","last_fullsized":"2026-02-20T03:15:27.392844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091895+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:27.091895+0000","last_peered":"2026-02-20T03:15:27.091895+0000","last_clean":"2026-02-20T03:15:27.091895+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:27.091895+0000","last_undegraded":"2026-02-20T03:15:27.091895+0000","last_fullsized":"2026-02-20T03:15:27.091895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677369+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:15:27.677369+0000","last_peered":"2026-02-20T03:15:27.677369+0000","last_clean":"2026-02-20T03:15:27.677369+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:15:27.677369+0000","last_undegraded":"2026-02-20T03:15:27.677369+0000","last_fullsized":"2026-02-20T03:15:27.677369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092065+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:27.092065+0000","last_peered":"2026-02-20T03:15:27.092065+0000","last_clean":"2026-02-20T03:15:27.092065+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:27.092065+0000","last_undegraded":"2026-02-20T03:15:27.092065+0000","last_fullsized":"2026-02-20T03:15:27.092065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676826+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:15:27.676826+0000","last_peered":"2026-02-20T03:15:27.676826+0000","last_clean":"2026-02-20T03:15:27.676826+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:15:27.676826+0000","last_undegraded":"2026-02-20T03:15:27.676826+0000","last_fullsized":"2026-02-20T03:15:27.676826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090039+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:15:27.090039+0000","last_peered":"2026-02-20T03:15:27.090039+0000","last_clean":"2026-02-20T03:15:27.090039+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:15:27.090039+0000","last_undegraded":"2026-02-20T03:15:27.090039+0000","last_fullsized":"2026-02-20T03:15:27.090039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099935+0000","last_change":"2026-02-20T03:15:27.099749+0000","last_active":"2026-02-20T03:15:27.099935+0000","last_peered":"2026-02-20T03:15:27.099935+0000","last_clean":"2026-02-20T03:15:27.099935+0000","last_became_active":"2026-02-20T03:15:27.096338+0000","last_became_peered":"2026-02-20T03:15:27.096338+0000","last_unstale":"2026-02-20T03:15:27.099935+0000","last_undegraded":"2026-02-20T03:15:27.099935+0000","last_fullsized":"2026-02-20T03:15:27.099935+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:59:55.738735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093553+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:15:27.093553+0000","last_peered":"2026-02-20T03:15:27.093553+0000","last_clean":"2026-02-20T03:15:27.093553+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:15:27.093553+0000","last_undegraded":"2026-02-20T03:15:27.093553+0000","last_fullsized":"2026-02-20T03:15:27.093553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384089+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:15:27.384089+0000","last_peered":"2026-02-20T03:15:27.384089+0000","last_clean":"2026-02-20T03:15:27.384089+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:15:27.384089+0000","last_undegraded":"2026-02-20T03:15:27.384089+0000","last_fullsized":"2026-02-20T03:15:27.384089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091877+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:15:27.091877+0000","last_peered":"2026-02-20T03:15:27.091877+0000","last_clean":"2026-02-20T03:15:27.091877+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:15:27.091877+0000","last_undegraded":"2026-02-20T03:15:27.091877+0000","last_fullsized":"2026-02-20T03:15:27.091877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095909+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:15:27.095909+0000","last_peered":"2026-02-20T03:15:27.095909+0000","last_clean":"2026-02-20T03:15:27.095909+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:15:27.095909+0000","last_undegraded":"2026-02-20T03:15:27.095909+0000","last_fullsized":"2026-02-20T03:15:27.095909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384056+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:15:27.384056+0000","last_peered":"2026-02-20T03:15:27.384056+0000","last_clean":"2026-02-20T03:15:27.384056+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:15:27.384056+0000","last_undegraded":"2026-02-20T03:15:27.384056+0000","last_fullsized":"2026-02-20T03:15:27.384056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097629+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:15:27.097629+0000","last_peered":"2026-02-20T03:15:27.097629+0000","last_clean":"2026-02-20T03:15:27.097629+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:15:27.097629+0000","last_undegraded":"2026-02-20T03:15:27.097629+0000","last_fullsized":"2026-02-20T03:15:27.097629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090084+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:15:27.090084+0000","last_peered":"2026-02-20T03:15:27.090084+0000","last_clean":"2026-02-20T03:15:27.090084+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:15:27.090084+0000","last_undegraded":"2026-02-20T03:15:27.090084+0000","last_fullsized":"2026-02-20T03:15:27.090084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096476+0000","last_change":"2026-02-20T03:15:27.096476+0000","last_active":"2026-02-20T03:15:27.096476+0000","last_peered":"2026-02-20T03:15:27.096476+0000","last_clean":"2026-02-20T03:15:27.096476+0000","last_became_active":"2026-02-20T03:15:27.096369+0000","last_became_peered":"2026-02-20T03:15:27.096369+0000","last_unstale":"2026-02-20T03:15:27.096476+0000","last_undegraded":"2026-02-20T03:15:27.096476+0000","last_fullsized":"2026-02-20T03:15:27.096476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:18:04.418088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":67,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089586+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:27.089586+0000","last_peered":"2026-02-20T03:15:27.089586+0000","last_clean":"2026-02-20T03:15:27.089586+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:27.089586+0000","last_undegraded":"2026-02-20T03:15:27.089586+0000","last_fullsized":"2026-02-20T03:15:27.089586+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089978+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:15:27.089978+0000","last_peered":"2026-02-20T03:15:27.089978+0000","last_clean":"2026-02-20T03:15:27.089978+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:15:27.089978+0000","last_undegraded":"2026-02-20T03:15:27.089978+0000","last_fullsized":"2026-02-20T03:15:27.089978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089476+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:15:27.089476+0000","last_peered":"2026-02-20T03:15:27.089476+0000","last_clean":"2026-02-20T03:15:27.089476+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:15:27.089476+0000","last_undegraded":"2026-02-20T03:15:27.089476+0000","last_fullsized":"2026-02-20T03:15:27.089476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097578+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:15:27.097578+0000","last_peered":"2026-02-20T03:15:27.097578+0000","last_clean":"2026-02-20T03:15:27.097578+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:15:27.097578+0000","last_undegraded":"2026-02-20T03:15:27.097578+0000","last_fullsized":"2026-02-20T03:15:27.097578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093923+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:15:27.093923+0000","last_peered":"2026-02-20T03:15:27.093923+0000","last_clean":"2026-02-20T03:15:27.093923+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:15:27.093923+0000","last_undegraded":"2026-02-20T03:15:27.093923+0000","last_fullsized":"2026-02-20T03:15:27.093923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677506+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:15:27.677506+0000","last_peered":"2026-02-20T03:15:27.677506+0000","last_clean":"2026-02-20T03:15:27.677506+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:15:27.677506+0000","last_undegraded":"2026-02-20T03:15:27.677506+0000","last_fullsized":"2026-02-20T03:15:27.677506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392678+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:15:27.392678+0000","last_peered":"2026-02-20T03:15:27.392678+0000","last_clean":"2026-02-20T03:15:27.392678+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:15:27.392678+0000","last_undegraded":"2026-02-20T03:15:27.392678+0000","last_fullsized":"2026-02-20T03:15:27.392678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":354,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097799+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:15:27.097799+0000","last_peered":"2026-02-20T03:15:27.097799+0000","last_clean":"2026-02-20T03:15:27.097799+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:15:27.097799+0000","last_undegraded":"2026-02-20T03:15:27.097799+0000","last_fullsized":"2026-02-20T03:15:27.097799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097882+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:15:27.097882+0000","last_peered":"2026-02-20T03:15:27.097882+0000","last_clean":"2026-02-20T03:15:27.097882+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:15:27.097882+0000","last_undegraded":"2026-02-20T03:15:27.097882+0000","last_fullsized":"2026-02-20T03:15:27.097882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098144+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:15:27.098144+0000","last_peered":"2026-02-20T03:15:27.098144+0000","last_clean":"2026-02-20T03:15:27.098144+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:15:27.098144+0000","last_undegraded":"2026-02-20T03:15:27.098144+0000","last_fullsized":"2026-02-20T03:15:27.098144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.104030+0000","last_change":"2026-02-20T03:15:27.104030+0000","last_active":"2026-02-20T03:15:27.104030+0000","last_peered":"2026-02-20T03:15:27.104030+0000","last_clean":"2026-02-20T03:15:27.104030+0000","last_became_active":"2026-02-20T03:15:27.101137+0000","last_became_peered":"2026-02-20T03:15:27.101137+0000","last_unstale":"2026-02-20T03:15:27.104030+0000","last_undegraded":"2026-02-20T03:15:27.104030+0000","last_fullsized":"2026-02-20T03:15:27.104030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:16.927063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099157+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:27.099157+0000","last_peered":"2026-02-20T03:15:27.099157+0000","last_clean":"2026-02-20T03:15:27.099157+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:27.099157+0000","last_undegraded":"2026-02-20T03:15:27.099157+0000","last_fullsized":"2026-02-20T03:15:27.099157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097824+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:15:27.097824+0000","last_peered":"2026-02-20T03:15:27.097824+0000","last_clean":"2026-02-20T03:15:27.097824+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:15:27.097824+0000","last_undegraded":"2026-02-20T03:15:27.097824+0000","last_fullsized":"2026-02-20T03:15:27.097824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094597+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:15:27.094597+0000","last_peered":"2026-02-20T03:15:27.094597+0000","last_clean":"2026-02-20T03:15:27.094597+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:15:27.094597+0000","last_undegraded":"2026-02-20T03:15:27.094597+0000","last_fullsized":"2026-02-20T03:15:27.094597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091583+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:27.091583+0000","last_peered":"2026-02-20T03:15:27.091583+0000","last_clean":"2026-02-20T03:15:27.091583+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:27.091583+0000","last_undegraded":"2026-02-20T03:15:27.091583+0000","last_fullsized":"2026-02-20T03:15:27.091583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098225+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:15:27.098225+0000","last_peered":"2026-02-20T03:15:27.098225+0000","last_clean":"2026-02-20T03:15:27.098225+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:15:27.098225+0000","last_undegraded":"2026-02-20T03:15:27.098225+0000","last_fullsized":"2026-02-20T03:15:27.098225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089901+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:15:27.089901+0000","last_peered":"2026-02-20T03:15:27.089901+0000","last_clean":"2026-02-20T03:15:27.089901+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:15:27.089901+0000","last_undegraded":"2026-02-20T03:15:27.089901+0000","last_fullsized":"2026-02-20T03:15:27.089901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093235+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:15:27.093235+0000","last_peered":"2026-02-20T03:15:27.093235+0000","last_clean":"2026-02-20T03:15:27.093235+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:15:27.093235+0000","last_undegraded":"2026-02-20T03:15:27.093235+0000","last_fullsized":"2026-02-20T03:15:27.093235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093959+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:15:27.093959+0000","last_peered":"2026-02-20T03:15:27.093959+0000","last_clean":"2026-02-20T03:15:27.093959+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:15:27.093959+0000","last_undegraded":"2026-02-20T03:15:27.093959+0000","last_fullsized":"2026-02-20T03:15:27.093959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:15:27.096403+0000","last_peered":"2026-02-20T03:15:27.096403+0000","last_clean":"2026-02-20T03:15:27.096403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:15:27.096403+0000","last_undegraded":"2026-02-20T03:15:27.096403+0000","last_fullsized":"2026-02-20T03:15:27.096403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093292+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:15:27.093292+0000","last_peered":"2026-02-20T03:15:27.093292+0000","last_clean":"2026-02-20T03:15:27.093292+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:15:27.093292+0000","last_undegraded":"2026-02-20T03:15:27.093292+0000","last_fullsized":"2026-02-20T03:15:27.093292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093347+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:15:27.093347+0000","last_peered":"2026-02-20T03:15:27.093347+0000","last_clean":"2026-02-20T03:15:27.093347+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:15:27.093347+0000","last_undegraded":"2026-02-20T03:15:27.093347+0000","last_fullsized":"2026-02-20T03:15:27.093347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095895+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:15:27.095895+0000","last_peered":"2026-02-20T03:15:27.095895+0000","last_clean":"2026-02-20T03:15:27.095895+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:15:27.095895+0000","last_undegraded":"2026-02-20T03:15:27.095895+0000","last_fullsized":"2026-02-20T03:15:27.095895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089892+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:15:27.089892+0000","last_peered":"2026-02-20T03:15:27.089892+0000","last_clean":"2026-02-20T03:15:27.089892+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:15:27.089892+0000","last_undegraded":"2026-02-20T03:15:27.089892+0000","last_fullsized":"2026-02-20T03:15:27.089892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097367+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:15:27.097367+0000","last_peered":"2026-02-20T03:15:27.097367+0000","last_clean":"2026-02-20T03:15:27.097367+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:15:27.097367+0000","last_undegraded":"2026-02-20T03:15:27.097367+0000","last_fullsized":"2026-02-20T03:15:27.097367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:28.393348+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:28.393348+0000","last_peered":"2026-02-20T03:15:28.393348+0000","last_clean":"2026-02-20T03:15:28.393348+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:28.393348+0000","last_undegraded":"2026-02-20T03:15:28.393348+0000","last_fullsized":"2026-02-20T03:15:28.393348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092155+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:15:27.092155+0000","last_peered":"2026-02-20T03:15:27.092155+0000","last_clean":"2026-02-20T03:15:27.092155+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:15:27.092155+0000","last_undegraded":"2026-02-20T03:15:27.092155+0000","last_fullsized":"2026-02-20T03:15:27.092155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097787+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:15:27.097787+0000","last_peered":"2026-02-20T03:15:27.097787+0000","last_clean":"2026-02-20T03:15:27.097787+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:15:27.097787+0000","last_undegraded":"2026-02-20T03:15:27.097787+0000","last_fullsized":"2026-02-20T03:15:27.097787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093616+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:15:27.093616+0000","last_peered":"2026-02-20T03:15:27.093616+0000","last_clean":"2026-02-20T03:15:27.093616+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:15:27.093616+0000","last_undegraded":"2026-02-20T03:15:27.093616+0000","last_fullsized":"2026-02-20T03:15:27.093616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093604+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:15:27.093604+0000","last_peered":"2026-02-20T03:15:27.093604+0000","last_clean":"2026-02-20T03:15:27.093604+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:15:27.093604+0000","last_undegraded":"2026-02-20T03:15:27.093604+0000","last_fullsized":"2026-02-20T03:15:27.093604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089674+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:15:27.089674+0000","last_peered":"2026-02-20T03:15:27.089674+0000","last_clean":"2026-02-20T03:15:27.089674+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:15:27.089674+0000","last_undegraded":"2026-02-20T03:15:27.089674+0000","last_fullsized":"2026-02-20T03:15:27.089674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092119+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:27.092119+0000","last_peered":"2026-02-20T03:15:27.092119+0000","last_clean":"2026-02-20T03:15:27.092119+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:27.092119+0000","last_undegraded":"2026-02-20T03:15:27.092119+0000","last_fullsized":"2026-02-20T03:15:27.092119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093756+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:15:27.093756+0000","last_peered":"2026-02-20T03:15:27.093756+0000","last_clean":"2026-02-20T03:15:27.093756+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:15:27.093756+0000","last_undegraded":"2026-02-20T03:15:27.093756+0000","last_fullsized":"2026-02-20T03:15:27.093756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096216+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:15:27.096216+0000","last_peered":"2026-02-20T03:15:27.096216+0000","last_clean":"2026-02-20T03:15:27.096216+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:15:27.096216+0000","last_undegraded":"2026-02-20T03:15:27.096216+0000","last_fullsized":"2026-02-20T03:15:27.096216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:29.396148+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:29.396148+0000","last_peered":"2026-02-20T03:15:29.396148+0000","last_clean":"2026-02-20T03:15:29.396148+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:29.396148+0000","last_undegraded":"2026-02-20T03:15:29.396148+0000","last_fullsized":"2026-02-20T03:15:29.396148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73733,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":87,"num_read_kb":116,"num_write":35,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091741+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:15:27.091741+0000","last_peered":"2026-02-20T03:15:27.091741+0000","last_clean":"2026-02-20T03:15:27.091741+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:15:27.091741+0000","last_undegraded":"2026-02-20T03:15:27.091741+0000","last_fullsized":"2026-02-20T03:15:27.091741+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100059+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:27.100059+0000","last_peered":"2026-02-20T03:15:27.100059+0000","last_clean":"2026-02-20T03:15:27.100059+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:27.100059+0000","last_undegraded":"2026-02-20T03:15:27.100059+0000","last_fullsized":"2026-02-20T03:15:27.100059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094441+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:15:27.094441+0000","last_peered":"2026-02-20T03:15:27.094441+0000","last_clean":"2026-02-20T03:15:27.094441+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:15:27.094441+0000","last_undegraded":"2026-02-20T03:15:27.094441+0000","last_fullsized":"2026-02-20T03:15:27.094441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392567+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:15:27.392567+0000","last_peered":"2026-02-20T03:15:27.392567+0000","last_clean":"2026-02-20T03:15:27.392567+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:15:27.392567+0000","last_undegraded":"2026-02-20T03:15:27.392567+0000","last_fullsized":"2026-02-20T03:15:27.392567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092453+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:27.092453+0000","last_peered":"2026-02-20T03:15:27.092453+0000","last_clean":"2026-02-20T03:15:27.092453+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:27.092453+0000","last_undegraded":"2026-02-20T03:15:27.092453+0000","last_fullsized":"2026-02-20T03:15:27.092453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098009+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:15:27.098009+0000","last_peered":"2026-02-20T03:15:27.098009+0000","last_clean":"2026-02-20T03:15:27.098009+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:15:27.098009+0000","last_undegraded":"2026-02-20T03:15:27.098009+0000","last_fullsized":"2026-02-20T03:15:27.098009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091618+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:15:27.091618+0000","last_peered":"2026-02-20T03:15:27.091618+0000","last_clean":"2026-02-20T03:15:27.091618+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:15:27.091618+0000","last_undegraded":"2026-02-20T03:15:27.091618+0000","last_fullsized":"2026-02-20T03:15:27.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099742+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:27.099742+0000","last_peered":"2026-02-20T03:15:27.099742+0000","last_clean":"2026-02-20T03:15:27.099742+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:27.099742+0000","last_undegraded":"2026-02-20T03:15:27.099742+0000","last_fullsized":"2026-02-20T03:15:27.099742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:28.388164+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:28.388164+0000","last_peered":"2026-02-20T03:15:28.388164+0000","last_clean":"2026-02-20T03:15:28.388164+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:28.388164+0000","last_undegraded":"2026-02-20T03:15:28.388164+0000","last_fullsized":"2026-02-20T03:15:28.388164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676945+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:15:27.676945+0000","last_peered":"2026-02-20T03:15:27.676945+0000","last_clean":"2026-02-20T03:15:27.676945+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:15:27.676945+0000","last_undegraded":"2026-02-20T03:15:27.676945+0000","last_fullsized":"2026-02-20T03:15:27.676945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091966+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:27.091966+0000","last_peered":"2026-02-20T03:15:27.091966+0000","last_clean":"2026-02-20T03:15:27.091966+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:27.091966+0000","last_undegraded":"2026-02-20T03:15:27.091966+0000","last_fullsized":"2026-02-20T03:15:27.091966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091995+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:15:27.091995+0000","last_peered":"2026-02-20T03:15:27.091995+0000","last_clean":"2026-02-20T03:15:27.091995+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:15:27.091995+0000","last_undegraded":"2026-02-20T03:15:27.091995+0000","last_fullsized":"2026-02-20T03:15:27.091995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094048+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:15:27.094048+0000","last_peered":"2026-02-20T03:15:27.094048+0000","last_clean":"2026-02-20T03:15:27.094048+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:15:27.094048+0000","last_undegraded":"2026-02-20T03:15:27.094048+0000","last_fullsized":"2026-02-20T03:15:27.094048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093983+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:15:27.093983+0000","last_peered":"2026-02-20T03:15:27.093983+0000","last_clean":"2026-02-20T03:15:27.093983+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:15:27.093983+0000","last_undegraded":"2026-02-20T03:15:27.093983+0000","last_fullsized":"2026-02-20T03:15:27.093983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676892+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:15:27.676892+0000","last_peered":"2026-02-20T03:15:27.676892+0000","last_clean":"2026-02-20T03:15:27.676892+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:15:27.676892+0000","last_undegraded":"2026-02-20T03:15:27.676892+0000","last_fullsized":"2026-02-20T03:15:27.676892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089481+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:15:27.089481+0000","last_peered":"2026-02-20T03:15:27.089481+0000","last_clean":"2026-02-20T03:15:27.089481+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:15:27.089481+0000","last_undegraded":"2026-02-20T03:15:27.089481+0000","last_fullsized":"2026-02-20T03:15:27.089481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383994+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:15:27.383994+0000","last_peered":"2026-02-20T03:15:27.383994+0000","last_clean":"2026-02-20T03:15:27.383994+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:15:27.383994+0000","last_undegraded":"2026-02-20T03:15:27.383994+0000","last_fullsized":"2026-02-20T03:15:27.383994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093591+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:15:27.093591+0000","last_peered":"2026-02-20T03:15:27.093591+0000","last_clean":"2026-02-20T03:15:27.093591+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:15:27.093591+0000","last_undegraded":"2026-02-20T03:15:27.093591+0000","last_fullsized":"2026-02-20T03:15:27.093591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092112+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:27.092112+0000","last_peered":"2026-02-20T03:15:27.092112+0000","last_clean":"2026-02-20T03:15:27.092112+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:27.092112+0000","last_undegraded":"2026-02-20T03:15:27.092112+0000","last_fullsized":"2026-02-20T03:15:27.092112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.382264+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:27.382264+0000","last_peered":"2026-02-20T03:15:27.382264+0000","last_clean":"2026-02-20T03:15:27.382264+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:27.382264+0000","last_undegraded":"2026-02-20T03:15:27.382264+0000","last_fullsized":"2026-02-20T03:15:27.382264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096098+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:15:27.096098+0000","last_peered":"2026-02-20T03:15:27.096098+0000","last_clean":"2026-02-20T03:15:27.096098+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:15:27.096098+0000","last_undegraded":"2026-02-20T03:15:27.096098+0000","last_fullsized":"2026-02-20T03:15:27.096098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092190+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:27.092190+0000","last_peered":"2026-02-20T03:15:27.092190+0000","last_clean":"2026-02-20T03:15:27.092190+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:27.092190+0000","last_undegraded":"2026-02-20T03:15:27.092190+0000","last_fullsized":"2026-02-20T03:15:27.092190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092030+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:27.092030+0000","last_peered":"2026-02-20T03:15:27.092030+0000","last_clean":"2026-02-20T03:15:27.092030+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:27.092030+0000","last_undegraded":"2026-02-20T03:15:27.092030+0000","last_fullsized":"2026-02-20T03:15:27.092030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091880+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:27.091880+0000","last_peered":"2026-02-20T03:15:27.091880+0000","last_clean":"2026-02-20T03:15:27.091880+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:27.091880+0000","last_undegraded":"2026-02-20T03:15:27.091880+0000","last_fullsized":"2026-02-20T03:15:27.091880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092039+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:27.092039+0000","last_peered":"2026-02-20T03:15:27.092039+0000","last_clean":"2026-02-20T03:15:27.092039+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:27.092039+0000","last_undegraded":"2026-02-20T03:15:27.092039+0000","last_fullsized":"2026-02-20T03:15:27.092039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090007+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:15:27.090007+0000","last_peered":"2026-02-20T03:15:27.090007+0000","last_clean":"2026-02-20T03:15:27.090007+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:15:27.090007+0000","last_undegraded":"2026-02-20T03:15:27.090007+0000","last_fullsized":"2026-02-20T03:15:27.090007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096323+0000","last_change":"2026-02-20T03:15:27.096323+0000","last_active":"2026-02-20T03:15:27.096323+0000","last_peered":"2026-02-20T03:15:27.096323+0000","last_clean":"2026-02-20T03:15:27.096323+0000","last_became_active":"2026-02-20T03:15:27.096171+0000","last_became_peered":"2026-02-20T03:15:27.096171+0000","last_unstale":"2026-02-20T03:15:27.096323+0000","last_undegraded":"2026-02-20T03:15:27.096323+0000","last_fullsized":"2026-02-20T03:15:27.096323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:00:54.803500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092769+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:27.092769+0000","last_peered":"2026-02-20T03:15:27.092769+0000","last_clean":"2026-02-20T03:15:27.092769+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:27.092769+0000","last_undegraded":"2026-02-20T03:15:27.092769+0000","last_fullsized":"2026-02-20T03:15:27.092769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677330+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:15:27.677330+0000","last_peered":"2026-02-20T03:15:27.677330+0000","last_clean":"2026-02-20T03:15:27.677330+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:15:27.677330+0000","last_undegraded":"2026-02-20T03:15:27.677330+0000","last_fullsized":"2026-02-20T03:15:27.677330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093789+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:15:27.093789+0000","last_peered":"2026-02-20T03:15:27.093789+0000","last_clean":"2026-02-20T03:15:27.093789+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:15:27.093789+0000","last_undegraded":"2026-02-20T03:15:27.093789+0000","last_fullsized":"2026-02-20T03:15:27.093789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677022+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:15:27.677022+0000","last_peered":"2026-02-20T03:15:27.677022+0000","last_clean":"2026-02-20T03:15:27.677022+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:15:27.677022+0000","last_undegraded":"2026-02-20T03:15:27.677022+0000","last_fullsized":"2026-02-20T03:15:27.677022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099411+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:27.099411+0000","last_peered":"2026-02-20T03:15:27.099411+0000","last_clean":"2026-02-20T03:15:27.099411+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:27.099411+0000","last_undegraded":"2026-02-20T03:15:27.099411+0000","last_fullsized":"2026-02-20T03:15:27.099411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089899+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:15:27.089899+0000","last_peered":"2026-02-20T03:15:27.089899+0000","last_clean":"2026-02-20T03:15:27.089899+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:15:27.089899+0000","last_undegraded":"2026-02-20T03:15:27.089899+0000","last_fullsized":"2026-02-20T03:15:27.089899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093603+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:15:27.093603+0000","last_peered":"2026-02-20T03:15:27.093603+0000","last_clean":"2026-02-20T03:15:27.093603+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:15:27.093603+0000","last_undegraded":"2026-02-20T03:15:27.093603+0000","last_fullsized":"2026-02-20T03:15:27.093603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092566+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:27.092566+0000","last_peered":"2026-02-20T03:15:27.092566+0000","last_clean":"2026-02-20T03:15:27.092566+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:27.092566+0000","last_undegraded":"2026-02-20T03:15:27.092566+0000","last_fullsized":"2026-02-20T03:15:27.092566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092017+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:15:27.092017+0000","last_peered":"2026-02-20T03:15:27.092017+0000","last_clean":"2026-02-20T03:15:27.092017+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:15:27.092017+0000","last_undegraded":"2026-02-20T03:15:27.092017+0000","last_fullsized":"2026-02-20T03:15:27.092017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094334+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:15:27.094334+0000","last_peered":"2026-02-20T03:15:27.094334+0000","last_clean":"2026-02-20T03:15:27.094334+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:15:27.094334+0000","last_undegraded":"2026-02-20T03:15:27.094334+0000","last_fullsized":"2026-02-20T03:15:27.094334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098981+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:27.098981+0000","last_peered":"2026-02-20T03:15:27.098981+0000","last_clean":"2026-02-20T03:15:27.098981+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:27.098981+0000","last_undegraded":"2026-02-20T03:15:27.098981+0000","last_fullsized":"2026-02-20T03:15:27.098981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091896+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:27.091896+0000","last_peered":"2026-02-20T03:15:27.091896+0000","last_clean":"2026-02-20T03:15:27.091896+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:27.091896+0000","last_undegraded":"2026-02-20T03:15:27.091896+0000","last_fullsized":"2026-02-20T03:15:27.091896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091504+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:27.091504+0000","last_peered":"2026-02-20T03:15:27.091504+0000","last_clean":"2026-02-20T03:15:27.091504+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:27.091504+0000","last_undegraded":"2026-02-20T03:15:27.091504+0000","last_fullsized":"2026-02-20T03:15:27.091504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089821+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:15:27.089821+0000","last_peered":"2026-02-20T03:15:27.089821+0000","last_clean":"2026-02-20T03:15:27.089821+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:15:27.089821+0000","last_undegraded":"2026-02-20T03:15:27.089821+0000","last_fullsized":"2026-02-20T03:15:27.089821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392752+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:15:27.392752+0000","last_peered":"2026-02-20T03:15:27.392752+0000","last_clean":"2026-02-20T03:15:27.392752+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:15:27.392752+0000","last_undegraded":"2026-02-20T03:15:27.392752+0000","last_fullsized":"2026-02-20T03:15:27.392752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098066+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:15:27.098066+0000","last_peered":"2026-02-20T03:15:27.098066+0000","last_clean":"2026-02-20T03:15:27.098066+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:15:27.098066+0000","last_undegraded":"2026-02-20T03:15:27.098066+0000","last_fullsized":"2026-02-20T03:15:27.098066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384200+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:15:27.384200+0000","last_peered":"2026-02-20T03:15:27.384200+0000","last_clean":"2026-02-20T03:15:27.384200+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:15:27.384200+0000","last_undegraded":"2026-02-20T03:15:27.384200+0000","last_fullsized":"2026-02-20T03:15:27.384200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.101465+0000","last_change":"2026-02-20T03:15:27.101465+0000","last_active":"2026-02-20T03:15:27.101465+0000","last_peered":"2026-02-20T03:15:27.101465+0000","last_clean":"2026-02-20T03:15:27.101465+0000","last_became_active":"2026-02-20T03:15:27.101042+0000","last_became_peered":"2026-02-20T03:15:27.101042+0000","last_unstale":"2026-02-20T03:15:27.101465+0000","last_undegraded":"2026-02-20T03:15:27.101465+0000","last_fullsized":"2026-02-20T03:15:27.101465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:16:15.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676902+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:15:27.676902+0000","last_peered":"2026-02-20T03:15:27.676902+0000","last_clean":"2026-02-20T03:15:27.676902+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:15:27.676902+0000","last_undegraded":"2026-02-20T03:15:27.676902+0000","last_fullsized":"2026-02-20T03:15:27.676902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097349+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:15:27.097349+0000","last_peered":"2026-02-20T03:15:27.097349+0000","last_clean":"2026-02-20T03:15:27.097349+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:15:27.097349+0000","last_undegraded":"2026-02-20T03:15:27.097349+0000","last_fullsized":"2026-02-20T03:15:27.097349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383987+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:15:27.383987+0000","last_peered":"2026-02-20T03:15:27.383987+0000","last_clean":"2026-02-20T03:15:27.383987+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:15:27.383987+0000","last_undegraded":"2026-02-20T03:15:27.383987+0000","last_fullsized":"2026-02-20T03:15:27.383987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392687+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:15:27.392687+0000","last_peered":"2026-02-20T03:15:27.392687+0000","last_clean":"2026-02-20T03:15:27.392687+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:15:27.392687+0000","last_undegraded":"2026-02-20T03:15:27.392687+0000","last_fullsized":"2026-02-20T03:15:27.392687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091837+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:27.091837+0000","last_peered":"2026-02-20T03:15:27.091837+0000","last_clean":"2026-02-20T03:15:27.091837+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:27.091837+0000","last_undegraded":"2026-02-20T03:15:27.091837+0000","last_fullsized":"2026-02-20T03:15:27.091837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091994+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:27.091994+0000","last_peered":"2026-02-20T03:15:27.091994+0000","last_clean":"2026-02-20T03:15:27.091994+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:27.091994+0000","last_undegraded":"2026-02-20T03:15:27.091994+0000","last_fullsized":"2026-02-20T03:15:27.091994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094313+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:15:27.094313+0000","last_peered":"2026-02-20T03:15:27.094313+0000","last_clean":"2026-02-20T03:15:27.094313+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:15:27.094313+0000","last_undegraded":"2026-02-20T03:15:27.094313+0000","last_fullsized":"2026-02-20T03:15:27.094313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78071,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":254,"num_read_kb":208,"num_write":168,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":234805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32140,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971060,"statfs":{"total":751619276800,"available":751586365440,"internally_reserved":0,"allocated":1032192,"data_stored":502911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32820,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970380,"statfs":{"total":751619276800,"available":751585669120,"internally_reserved":0,"allocated":1728512,"data_stored":1164282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776149,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":507221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037783,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32132,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971068,"statfs":{"total":751619276800,"available":751586373632,"internally_reserved":0,"allocated":1028096,"data_stored":493740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299417,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32712,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970488,"statfs":{"total":751619276800,"available":751585779712,"internally_reserved":0,"allocated":1622016,"data_stored":1089956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462939,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1024000,"data_stored":498291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28576,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974624,"statfs":{"total":751619276800,"available":751590014976,"internally_reserved":0,"allocated":1646592,"data_stored":1094457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888096,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32148,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971052,"statfs":{"total":751619276800,"available":751586357248,"internally_reserved":0,"allocated":1040384,"data_stored":503925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149730,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1036288,"data_stored":498485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378661,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":1122304,"data_stored":573008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28044,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975156,"statfs":{"total":751619276800,"available":751590559744,"internally_reserved":0,"allocated":1105920,"data_stored":572526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":499699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":74807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":75713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:32 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:15:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:32 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:15:32.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:32 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:15:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:33 trial177 ceph-mon[43181]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:33 trial177 ceph-mon[43181]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:33 trial177 ceph-mon[43181]: pgmap v204: 129 pgs: 129 active+clean; 653 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 150 B/s, 0 objects/s recovering 2026-02-20T03:15:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:33 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4276807447' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-20T03:15:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:33 trial126 ceph-mon[38476]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:33 trial126 ceph-mon[38476]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:33 trial126 ceph-mon[38476]: pgmap v204: 129 pgs: 129 active+clean; 653 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 150 B/s, 0 objects/s recovering 2026-02-20T03:15:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:33 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4276807447' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-20T03:15:33.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:33 trial028 ceph-mon[38552]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:33 trial028 ceph-mon[38552]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:33 trial028 ceph-mon[38552]: pgmap v204: 129 pgs: 129 active+clean; 653 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s; 150 B/s, 0 objects/s recovering 2026-02-20T03:15:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:33 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4276807447' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2026-02-20T03:15:34.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:34 trial177 ceph-mon[43181]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:34.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:34 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:15:34.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:34 trial126 ceph-mon[38476]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:34.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:34 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:15:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:34 trial028 ceph-mon[38552]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:34 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:15:35.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:35 trial177 ceph-mon[43181]: pgmap v205: 129 pgs: 129 active+clean; 653 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 4 op/s; 150 B/s, 0 objects/s recovering 2026-02-20T03:15:35.489 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T03:15:35.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:35 trial028 ceph-mon[38552]: pgmap v205: 129 pgs: 129 active+clean; 653 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 4 op/s; 150 B/s, 0 objects/s recovering 2026-02-20T03:15:35.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:35 trial126 ceph-mon[38476]: pgmap v205: 129 pgs: 129 active+clean; 653 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 4 op/s; 150 B/s, 0 objects/s recovering 2026-02-20T03:15:35.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.612+0000 7f88e926c640 1 -- 10.20.193.28:0/2336651651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e410a5b0 msgr2=0x7f88e410ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:35.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.612+0000 7f88e926c640 1 --2- 10.20.193.28:0/2336651651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e410a5b0 0x7f88e410ca70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009f90 tx=0x7f88d802f390 comp rx=0 tx=0).stop 2026-02-20T03:15:35.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.612+0000 7f88e926c640 1 -- 10.20.193.28:0/2336651651 shutdown_connections 2026-02-20T03:15:35.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.612+0000 7f88e926c640 1 --2- 10.20.193.28:0/2336651651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e410a5b0 0x7f88e410ca70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.612+0000 7f88e926c640 1 --2- 10.20.193.28:0/2336651651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88e4107c30 0x7f88e410a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.612+0000 7f88e926c640 1 --2- 10.20.193.28:0/2336651651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88e406b670 0x7f88e41076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.612+0000 7f88e926c640 1 -- 10.20.193.28:0/2336651651 >> 10.20.193.28:0/2336651651 conn(0x7f88e40fccc0 msgr2=0x7f88e40ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.612+0000 7f88e926c640 1 -- 10.20.193.28:0/2336651651 shutdown_connections 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.612+0000 7f88e926c640 1 -- 10.20.193.28:0/2336651651 wait complete. 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e926c640 1 Processor -- start 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e926c640 1 -- start start 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e926c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88e406b670 0x7f88e419c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e926c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e4107c30 0x7f88e419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e926c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88e410a5b0 0x7f88e41a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e926c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f88e4110400 con 0x7f88e4107c30 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e926c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f88e4110280 con 0x7f88e406b670 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e926c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f88e4110580 con 0x7f88e410a5b0 2026-02-20T03:15:35.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88e406b670 0x7f88e419c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e4107c30 0x7f88e419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e8a6b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88e410a5b0 0x7f88e41a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e4107c30 0x7f88e419ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33796/0 (socket says 10.20.193.28:33796) 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e37fe640 1 -- 10.20.193.28:0/2266364291 learned_addr learned my addr 10.20.193.28:0/2266364291 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e37fe640 1 -- 10.20.193.28:0/2266364291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88e410a5b0 msgr2=0x7f88e41a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e37fe640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88e410a5b0 0x7f88e41a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e37fe640 1 -- 10.20.193.28:0/2266364291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88e406b670 msgr2=0x7f88e419c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e37fe640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88e406b670 0x7f88e419c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.613+0000 7f88e37fe640 1 -- 10.20.193.28:0/2266364291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e41a4620 con 0x7f88e4107c30 2026-02-20T03:15:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.614+0000 7f88e37fe640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e4107c30 0x7f88e419ceb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f88d40027e0 tx=0x7f88d4002cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:35.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.614+0000 7f88e17fa640 1 -- 10.20.193.28:0/2266364291 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d400ed40 con 0x7f88e4107c30 2026-02-20T03:15:35.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.614+0000 7f88e17fa640 1 -- 10.20.193.28:0/2266364291 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f88d40108d0 con 0x7f88e4107c30 2026-02-20T03:15:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.614+0000 7f88e17fa640 1 -- 10.20.193.28:0/2266364291 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d400f7c0 con 0x7f88e4107c30 2026-02-20T03:15:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.614+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88e41a4910 con 0x7f88e4107c30 2026-02-20T03:15:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.614+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88e41a4e10 con 0x7f88e4107c30 2026-02-20T03:15:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.614+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88e40fe220 con 0x7f88e4107c30 2026-02-20T03:15:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.616+0000 7f88e17fa640 1 -- 10.20.193.28:0/2266364291 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f88d4010a80 con 0x7f88e4107c30 2026-02-20T03:15:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.618+0000 7f88e17fa640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f88b80b0eb0 0x7f88b80b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.618+0000 7f88e17fa640 1 -- 10.20.193.28:0/2266364291 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f88d40e0ff0 con 0x7f88e4107c30 2026-02-20T03:15:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.618+0000 7f88e3fff640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f88b80b0eb0 0x7f88b80b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.618+0000 7f88e3fff640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f88b80b0eb0 0x7f88b80b3370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f88d00097c0 tx=0x7f88d0009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:35.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.619+0000 7f88e17fa640 1 -- 10.20.193.28:0/2266364291 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f88d4014030 con 0x7f88e4107c30 2026-02-20T03:15:35.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.709+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88e40630c0 con 0x7f88b80b0eb0 2026-02-20T03:15:35.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.713+0000 7f88e17fa640 1 -- 10.20.193.28:0/2266364291 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340405 (secure 0 0 0) 0x7f88e40630c0 con 0x7f88b80b0eb0 2026-02-20T03:15:35.720 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:35.722 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:35.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f88b80b0eb0 msgr2=0x7f88b80b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:35.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f88b80b0eb0 0x7f88b80b3370 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f88d00097c0 tx=0x7f88d0009340 comp rx=0 tx=0).stop 2026-02-20T03:15:35.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e4107c30 msgr2=0x7f88e419ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:35.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e4107c30 0x7f88e419ceb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f88d40027e0 tx=0x7f88d4002cb0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 shutdown_connections 2026-02-20T03:15:35.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f88b80b0eb0 0x7f88b80b3370 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88e410a5b0 0x7f88e41a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88e4107c30 0x7f88e419ceb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 --2- 10.20.193.28:0/2266364291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88e406b670 0x7f88e419c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 >> 10.20.193.28:0/2266364291 conn(0x7f88e40fccc0 msgr2=0x7f88e4108630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:35.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 shutdown_connections 2026-02-20T03:15:35.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.716+0000 7f88e926c640 1 -- 10.20.193.28:0/2266364291 wait complete. 2026-02-20T03:15:35.731 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2026-02-20T03:15:34.010914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668673,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":365,"num_read_kb":304,"num_write":359,"num_write_kb":3849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181942,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":423,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358612,"kb_used_data":14168,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807679788,"statfs":{"total":9019431321600,"available":9019064102912,"internally_reserved":0,"allocated":14508032,"data_stored":8016497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4705,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":2,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001531"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.389259+0000","last_change":"2026-02-20T03:15:27.389259+0000","last_active":"2026-02-20T03:15:27.389259+0000","last_peered":"2026-02-20T03:15:27.389259+0000","last_clean":"2026-02-20T03:15:27.389259+0000","last_became_active":"2026-02-20T03:15:27.385887+0000","last_became_peered":"2026-02-20T03:15:27.385887+0000","last_unstale":"2026-02-20T03:15:27.389259+0000","last_undegraded":"2026-02-20T03:15:27.389259+0000","last_fullsized":"2026-02-20T03:15:27.389259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:20:01.907763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677322+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:15:27.677322+0000","last_peered":"2026-02-20T03:15:27.677322+0000","last_clean":"2026-02-20T03:15:27.677322+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:15:27.677322+0000","last_undegraded":"2026-02-20T03:15:27.677322+0000","last_fullsized":"2026-02-20T03:15:27.677322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091764+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:27.091764+0000","last_peered":"2026-02-20T03:15:27.091764+0000","last_clean":"2026-02-20T03:15:27.091764+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:27.091764+0000","last_undegraded":"2026-02-20T03:15:27.091764+0000","last_fullsized":"2026-02-20T03:15:27.091764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677381+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:15:27.677381+0000","last_peered":"2026-02-20T03:15:27.677381+0000","last_clean":"2026-02-20T03:15:27.677381+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:15:27.677381+0000","last_undegraded":"2026-02-20T03:15:27.677381+0000","last_fullsized":"2026-02-20T03:15:27.677381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092401+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:27.092401+0000","last_peered":"2026-02-20T03:15:27.092401+0000","last_clean":"2026-02-20T03:15:27.092401+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:27.092401+0000","last_undegraded":"2026-02-20T03:15:27.092401+0000","last_fullsized":"2026-02-20T03:15:27.092401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392166+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:15:27.392166+0000","last_peered":"2026-02-20T03:15:27.392166+0000","last_clean":"2026-02-20T03:15:27.392166+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:15:27.392166+0000","last_undegraded":"2026-02-20T03:15:27.392166+0000","last_fullsized":"2026-02-20T03:15:27.392166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096362+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:15:27.096362+0000","last_peered":"2026-02-20T03:15:27.096362+0000","last_clean":"2026-02-20T03:15:27.096362+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:15:27.096362+0000","last_undegraded":"2026-02-20T03:15:27.096362+0000","last_fullsized":"2026-02-20T03:15:27.096362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100051+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:27.100051+0000","last_peered":"2026-02-20T03:15:27.100051+0000","last_clean":"2026-02-20T03:15:27.100051+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:27.100051+0000","last_undegraded":"2026-02-20T03:15:27.100051+0000","last_fullsized":"2026-02-20T03:15:27.100051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392411+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:15:27.392411+0000","last_peered":"2026-02-20T03:15:27.392411+0000","last_clean":"2026-02-20T03:15:27.392411+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:15:27.392411+0000","last_undegraded":"2026-02-20T03:15:27.392411+0000","last_fullsized":"2026-02-20T03:15:27.392411+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096305+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:15:27.096305+0000","last_peered":"2026-02-20T03:15:27.096305+0000","last_clean":"2026-02-20T03:15:27.096305+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:15:27.096305+0000","last_undegraded":"2026-02-20T03:15:27.096305+0000","last_fullsized":"2026-02-20T03:15:27.096305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096792+0000","last_change":"2026-02-20T03:15:27.096792+0000","last_active":"2026-02-20T03:15:27.096792+0000","last_peered":"2026-02-20T03:15:27.096792+0000","last_clean":"2026-02-20T03:15:27.096792+0000","last_became_active":"2026-02-20T03:15:27.096659+0000","last_became_peered":"2026-02-20T03:15:27.096659+0000","last_unstale":"2026-02-20T03:15:27.096792+0000","last_undegraded":"2026-02-20T03:15:27.096792+0000","last_fullsized":"2026-02-20T03:15:27.096792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:57.312267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392339+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:15:27.392339+0000","last_peered":"2026-02-20T03:15:27.392339+0000","last_clean":"2026-02-20T03:15:27.392339+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:15:27.392339+0000","last_undegraded":"2026-02-20T03:15:27.392339+0000","last_fullsized":"2026-02-20T03:15:27.392339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097517+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:15:27.097517+0000","last_peered":"2026-02-20T03:15:27.097517+0000","last_clean":"2026-02-20T03:15:27.097517+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:15:27.097517+0000","last_undegraded":"2026-02-20T03:15:27.097517+0000","last_fullsized":"2026-02-20T03:15:27.097517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392602+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:15:27.392602+0000","last_peered":"2026-02-20T03:15:27.392602+0000","last_clean":"2026-02-20T03:15:27.392602+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:15:27.392602+0000","last_undegraded":"2026-02-20T03:15:27.392602+0000","last_fullsized":"2026-02-20T03:15:27.392602+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677473+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:15:27.677473+0000","last_peered":"2026-02-20T03:15:27.677473+0000","last_clean":"2026-02-20T03:15:27.677473+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:15:27.677473+0000","last_undegraded":"2026-02-20T03:15:27.677473+0000","last_fullsized":"2026-02-20T03:15:27.677473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091890+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:27.091890+0000","last_peered":"2026-02-20T03:15:27.091890+0000","last_clean":"2026-02-20T03:15:27.091890+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:27.091890+0000","last_undegraded":"2026-02-20T03:15:27.091890+0000","last_fullsized":"2026-02-20T03:15:27.091890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392578+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:15:27.392578+0000","last_peered":"2026-02-20T03:15:27.392578+0000","last_clean":"2026-02-20T03:15:27.392578+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:15:27.392578+0000","last_undegraded":"2026-02-20T03:15:27.392578+0000","last_fullsized":"2026-02-20T03:15:27.392578+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677054+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:15:27.677054+0000","last_peered":"2026-02-20T03:15:27.677054+0000","last_clean":"2026-02-20T03:15:27.677054+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:15:27.677054+0000","last_undegraded":"2026-02-20T03:15:27.677054+0000","last_fullsized":"2026-02-20T03:15:27.677054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092084+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:15:27.092084+0000","last_peered":"2026-02-20T03:15:27.092084+0000","last_clean":"2026-02-20T03:15:27.092084+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:15:27.092084+0000","last_undegraded":"2026-02-20T03:15:27.092084+0000","last_fullsized":"2026-02-20T03:15:27.092084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095913+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:15:27.095913+0000","last_peered":"2026-02-20T03:15:27.095913+0000","last_clean":"2026-02-20T03:15:27.095913+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:15:27.095913+0000","last_undegraded":"2026-02-20T03:15:27.095913+0000","last_fullsized":"2026-02-20T03:15:27.095913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.106320+0000","last_change":"2026-02-20T03:15:27.106320+0000","last_active":"2026-02-20T03:15:27.106320+0000","last_peered":"2026-02-20T03:15:27.106320+0000","last_clean":"2026-02-20T03:15:27.106320+0000","last_became_active":"2026-02-20T03:15:27.101151+0000","last_became_peered":"2026-02-20T03:15:27.101151+0000","last_unstale":"2026-02-20T03:15:27.106320+0000","last_undegraded":"2026-02-20T03:15:27.106320+0000","last_fullsized":"2026-02-20T03:15:27.106320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:56.197115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392629+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:15:27.392629+0000","last_peered":"2026-02-20T03:15:27.392629+0000","last_clean":"2026-02-20T03:15:27.392629+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:15:27.392629+0000","last_undegraded":"2026-02-20T03:15:27.392629+0000","last_fullsized":"2026-02-20T03:15:27.392629+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093728+0000","last_change":"2026-02-20T03:15:27.093728+0000","last_active":"2026-02-20T03:15:27.093728+0000","last_peered":"2026-02-20T03:15:27.093728+0000","last_clean":"2026-02-20T03:15:27.093728+0000","last_became_active":"2026-02-20T03:15:27.093455+0000","last_became_peered":"2026-02-20T03:15:27.093455+0000","last_unstale":"2026-02-20T03:15:27.093728+0000","last_undegraded":"2026-02-20T03:15:27.093728+0000","last_fullsized":"2026-02-20T03:15:27.093728+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:38:26.593708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392844+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:15:27.392844+0000","last_peered":"2026-02-20T03:15:27.392844+0000","last_clean":"2026-02-20T03:15:27.392844+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:15:27.392844+0000","last_undegraded":"2026-02-20T03:15:27.392844+0000","last_fullsized":"2026-02-20T03:15:27.392844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091895+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:27.091895+0000","last_peered":"2026-02-20T03:15:27.091895+0000","last_clean":"2026-02-20T03:15:27.091895+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:27.091895+0000","last_undegraded":"2026-02-20T03:15:27.091895+0000","last_fullsized":"2026-02-20T03:15:27.091895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677369+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:15:27.677369+0000","last_peered":"2026-02-20T03:15:27.677369+0000","last_clean":"2026-02-20T03:15:27.677369+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:15:27.677369+0000","last_undegraded":"2026-02-20T03:15:27.677369+0000","last_fullsized":"2026-02-20T03:15:27.677369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092065+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:27.092065+0000","last_peered":"2026-02-20T03:15:27.092065+0000","last_clean":"2026-02-20T03:15:27.092065+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:27.092065+0000","last_undegraded":"2026-02-20T03:15:27.092065+0000","last_fullsized":"2026-02-20T03:15:27.092065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676826+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:15:27.676826+0000","last_peered":"2026-02-20T03:15:27.676826+0000","last_clean":"2026-02-20T03:15:27.676826+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:15:27.676826+0000","last_undegraded":"2026-02-20T03:15:27.676826+0000","last_fullsized":"2026-02-20T03:15:27.676826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090039+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:15:27.090039+0000","last_peered":"2026-02-20T03:15:27.090039+0000","last_clean":"2026-02-20T03:15:27.090039+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:15:27.090039+0000","last_undegraded":"2026-02-20T03:15:27.090039+0000","last_fullsized":"2026-02-20T03:15:27.090039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099935+0000","last_change":"2026-02-20T03:15:27.099749+0000","last_active":"2026-02-20T03:15:27.099935+0000","last_peered":"2026-02-20T03:15:27.099935+0000","last_clean":"2026-02-20T03:15:27.099935+0000","last_became_active":"2026-02-20T03:15:27.096338+0000","last_became_peered":"2026-02-20T03:15:27.096338+0000","last_unstale":"2026-02-20T03:15:27.099935+0000","last_undegraded":"2026-02-20T03:15:27.099935+0000","last_fullsized":"2026-02-20T03:15:27.099935+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:59:55.738735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093553+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:15:27.093553+0000","last_peered":"2026-02-20T03:15:27.093553+0000","last_clean":"2026-02-20T03:15:27.093553+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:15:27.093553+0000","last_undegraded":"2026-02-20T03:15:27.093553+0000","last_fullsized":"2026-02-20T03:15:27.093553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384089+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:15:27.384089+0000","last_peered":"2026-02-20T03:15:27.384089+0000","last_clean":"2026-02-20T03:15:27.384089+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:15:27.384089+0000","last_undegraded":"2026-02-20T03:15:27.384089+0000","last_fullsized":"2026-02-20T03:15:27.384089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091877+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:15:27.091877+0000","last_peered":"2026-02-20T03:15:27.091877+0000","last_clean":"2026-02-20T03:15:27.091877+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:15:27.091877+0000","last_undegraded":"2026-02-20T03:15:27.091877+0000","last_fullsized":"2026-02-20T03:15:27.091877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095909+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:15:27.095909+0000","last_peered":"2026-02-20T03:15:27.095909+0000","last_clean":"2026-02-20T03:15:27.095909+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:15:27.095909+0000","last_undegraded":"2026-02-20T03:15:27.095909+0000","last_fullsized":"2026-02-20T03:15:27.095909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384056+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:15:27.384056+0000","last_peered":"2026-02-20T03:15:27.384056+0000","last_clean":"2026-02-20T03:15:27.384056+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:15:27.384056+0000","last_undegraded":"2026-02-20T03:15:27.384056+0000","last_fullsized":"2026-02-20T03:15:27.384056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097629+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:15:27.097629+0000","last_peered":"2026-02-20T03:15:27.097629+0000","last_clean":"2026-02-20T03:15:27.097629+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:15:27.097629+0000","last_undegraded":"2026-02-20T03:15:27.097629+0000","last_fullsized":"2026-02-20T03:15:27.097629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090084+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:15:27.090084+0000","last_peered":"2026-02-20T03:15:27.090084+0000","last_clean":"2026-02-20T03:15:27.090084+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:15:27.090084+0000","last_undegraded":"2026-02-20T03:15:27.090084+0000","last_fullsized":"2026-02-20T03:15:27.090084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096476+0000","last_change":"2026-02-20T03:15:27.096476+0000","last_active":"2026-02-20T03:15:27.096476+0000","last_peered":"2026-02-20T03:15:27.096476+0000","last_clean":"2026-02-20T03:15:27.096476+0000","last_became_active":"2026-02-20T03:15:27.096369+0000","last_became_peered":"2026-02-20T03:15:27.096369+0000","last_unstale":"2026-02-20T03:15:27.096476+0000","last_undegraded":"2026-02-20T03:15:27.096476+0000","last_fullsized":"2026-02-20T03:15:27.096476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:18:04.418088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:31.387805+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:31.387805+0000","last_peered":"2026-02-20T03:15:31.387805+0000","last_clean":"2026-02-20T03:15:31.387805+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:31.387805+0000","last_undegraded":"2026-02-20T03:15:31.387805+0000","last_fullsized":"2026-02-20T03:15:31.387805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089978+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:15:27.089978+0000","last_peered":"2026-02-20T03:15:27.089978+0000","last_clean":"2026-02-20T03:15:27.089978+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:15:27.089978+0000","last_undegraded":"2026-02-20T03:15:27.089978+0000","last_fullsized":"2026-02-20T03:15:27.089978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089476+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:15:27.089476+0000","last_peered":"2026-02-20T03:15:27.089476+0000","last_clean":"2026-02-20T03:15:27.089476+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:15:27.089476+0000","last_undegraded":"2026-02-20T03:15:27.089476+0000","last_fullsized":"2026-02-20T03:15:27.089476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097578+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:15:27.097578+0000","last_peered":"2026-02-20T03:15:27.097578+0000","last_clean":"2026-02-20T03:15:27.097578+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:15:27.097578+0000","last_undegraded":"2026-02-20T03:15:27.097578+0000","last_fullsized":"2026-02-20T03:15:27.097578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093923+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:15:27.093923+0000","last_peered":"2026-02-20T03:15:27.093923+0000","last_clean":"2026-02-20T03:15:27.093923+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:15:27.093923+0000","last_undegraded":"2026-02-20T03:15:27.093923+0000","last_fullsized":"2026-02-20T03:15:27.093923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677506+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:15:27.677506+0000","last_peered":"2026-02-20T03:15:27.677506+0000","last_clean":"2026-02-20T03:15:27.677506+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:15:27.677506+0000","last_undegraded":"2026-02-20T03:15:27.677506+0000","last_fullsized":"2026-02-20T03:15:27.677506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392678+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:15:27.392678+0000","last_peered":"2026-02-20T03:15:27.392678+0000","last_clean":"2026-02-20T03:15:27.392678+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:15:27.392678+0000","last_undegraded":"2026-02-20T03:15:27.392678+0000","last_fullsized":"2026-02-20T03:15:27.392678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":354,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097799+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:15:27.097799+0000","last_peered":"2026-02-20T03:15:27.097799+0000","last_clean":"2026-02-20T03:15:27.097799+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:15:27.097799+0000","last_undegraded":"2026-02-20T03:15:27.097799+0000","last_fullsized":"2026-02-20T03:15:27.097799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097882+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:15:27.097882+0000","last_peered":"2026-02-20T03:15:27.097882+0000","last_clean":"2026-02-20T03:15:27.097882+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:15:27.097882+0000","last_undegraded":"2026-02-20T03:15:27.097882+0000","last_fullsized":"2026-02-20T03:15:27.097882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098144+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:15:27.098144+0000","last_peered":"2026-02-20T03:15:27.098144+0000","last_clean":"2026-02-20T03:15:27.098144+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:15:27.098144+0000","last_undegraded":"2026-02-20T03:15:27.098144+0000","last_fullsized":"2026-02-20T03:15:27.098144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.104030+0000","last_change":"2026-02-20T03:15:27.104030+0000","last_active":"2026-02-20T03:15:27.104030+0000","last_peered":"2026-02-20T03:15:27.104030+0000","last_clean":"2026-02-20T03:15:27.104030+0000","last_became_active":"2026-02-20T03:15:27.101137+0000","last_became_peered":"2026-02-20T03:15:27.101137+0000","last_unstale":"2026-02-20T03:15:27.104030+0000","last_undegraded":"2026-02-20T03:15:27.104030+0000","last_fullsized":"2026-02-20T03:15:27.104030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:16.927063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099157+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:27.099157+0000","last_peered":"2026-02-20T03:15:27.099157+0000","last_clean":"2026-02-20T03:15:27.099157+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:27.099157+0000","last_undegraded":"2026-02-20T03:15:27.099157+0000","last_fullsized":"2026-02-20T03:15:27.099157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097824+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:15:27.097824+0000","last_peered":"2026-02-20T03:15:27.097824+0000","last_clean":"2026-02-20T03:15:27.097824+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:15:27.097824+0000","last_undegraded":"2026-02-20T03:15:27.097824+0000","last_fullsized":"2026-02-20T03:15:27.097824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094597+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:15:27.094597+0000","last_peered":"2026-02-20T03:15:27.094597+0000","last_clean":"2026-02-20T03:15:27.094597+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:15:27.094597+0000","last_undegraded":"2026-02-20T03:15:27.094597+0000","last_fullsized":"2026-02-20T03:15:27.094597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091583+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:27.091583+0000","last_peered":"2026-02-20T03:15:27.091583+0000","last_clean":"2026-02-20T03:15:27.091583+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:27.091583+0000","last_undegraded":"2026-02-20T03:15:27.091583+0000","last_fullsized":"2026-02-20T03:15:27.091583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098225+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:15:27.098225+0000","last_peered":"2026-02-20T03:15:27.098225+0000","last_clean":"2026-02-20T03:15:27.098225+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:15:27.098225+0000","last_undegraded":"2026-02-20T03:15:27.098225+0000","last_fullsized":"2026-02-20T03:15:27.098225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089901+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:15:27.089901+0000","last_peered":"2026-02-20T03:15:27.089901+0000","last_clean":"2026-02-20T03:15:27.089901+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:15:27.089901+0000","last_undegraded":"2026-02-20T03:15:27.089901+0000","last_fullsized":"2026-02-20T03:15:27.089901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093235+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:15:27.093235+0000","last_peered":"2026-02-20T03:15:27.093235+0000","last_clean":"2026-02-20T03:15:27.093235+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:15:27.093235+0000","last_undegraded":"2026-02-20T03:15:27.093235+0000","last_fullsized":"2026-02-20T03:15:27.093235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093959+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:15:27.093959+0000","last_peered":"2026-02-20T03:15:27.093959+0000","last_clean":"2026-02-20T03:15:27.093959+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:15:27.093959+0000","last_undegraded":"2026-02-20T03:15:27.093959+0000","last_fullsized":"2026-02-20T03:15:27.093959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:15:27.096403+0000","last_peered":"2026-02-20T03:15:27.096403+0000","last_clean":"2026-02-20T03:15:27.096403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:15:27.096403+0000","last_undegraded":"2026-02-20T03:15:27.096403+0000","last_fullsized":"2026-02-20T03:15:27.096403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093292+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:15:27.093292+0000","last_peered":"2026-02-20T03:15:27.093292+0000","last_clean":"2026-02-20T03:15:27.093292+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:15:27.093292+0000","last_undegraded":"2026-02-20T03:15:27.093292+0000","last_fullsized":"2026-02-20T03:15:27.093292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093347+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:15:27.093347+0000","last_peered":"2026-02-20T03:15:27.093347+0000","last_clean":"2026-02-20T03:15:27.093347+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:15:27.093347+0000","last_undegraded":"2026-02-20T03:15:27.093347+0000","last_fullsized":"2026-02-20T03:15:27.093347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095895+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:15:27.095895+0000","last_peered":"2026-02-20T03:15:27.095895+0000","last_clean":"2026-02-20T03:15:27.095895+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:15:27.095895+0000","last_undegraded":"2026-02-20T03:15:27.095895+0000","last_fullsized":"2026-02-20T03:15:27.095895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089892+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:15:27.089892+0000","last_peered":"2026-02-20T03:15:27.089892+0000","last_clean":"2026-02-20T03:15:27.089892+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:15:27.089892+0000","last_undegraded":"2026-02-20T03:15:27.089892+0000","last_fullsized":"2026-02-20T03:15:27.089892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097367+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:15:27.097367+0000","last_peered":"2026-02-20T03:15:27.097367+0000","last_clean":"2026-02-20T03:15:27.097367+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:15:27.097367+0000","last_undegraded":"2026-02-20T03:15:27.097367+0000","last_fullsized":"2026-02-20T03:15:27.097367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:28.393348+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:28.393348+0000","last_peered":"2026-02-20T03:15:28.393348+0000","last_clean":"2026-02-20T03:15:28.393348+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:28.393348+0000","last_undegraded":"2026-02-20T03:15:28.393348+0000","last_fullsized":"2026-02-20T03:15:28.393348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092155+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:15:27.092155+0000","last_peered":"2026-02-20T03:15:27.092155+0000","last_clean":"2026-02-20T03:15:27.092155+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:15:27.092155+0000","last_undegraded":"2026-02-20T03:15:27.092155+0000","last_fullsized":"2026-02-20T03:15:27.092155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097787+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:15:27.097787+0000","last_peered":"2026-02-20T03:15:27.097787+0000","last_clean":"2026-02-20T03:15:27.097787+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:15:27.097787+0000","last_undegraded":"2026-02-20T03:15:27.097787+0000","last_fullsized":"2026-02-20T03:15:27.097787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093616+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:15:27.093616+0000","last_peered":"2026-02-20T03:15:27.093616+0000","last_clean":"2026-02-20T03:15:27.093616+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:15:27.093616+0000","last_undegraded":"2026-02-20T03:15:27.093616+0000","last_fullsized":"2026-02-20T03:15:27.093616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093604+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:15:27.093604+0000","last_peered":"2026-02-20T03:15:27.093604+0000","last_clean":"2026-02-20T03:15:27.093604+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:15:27.093604+0000","last_undegraded":"2026-02-20T03:15:27.093604+0000","last_fullsized":"2026-02-20T03:15:27.093604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089674+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:15:27.089674+0000","last_peered":"2026-02-20T03:15:27.089674+0000","last_clean":"2026-02-20T03:15:27.089674+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:15:27.089674+0000","last_undegraded":"2026-02-20T03:15:27.089674+0000","last_fullsized":"2026-02-20T03:15:27.089674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092119+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:27.092119+0000","last_peered":"2026-02-20T03:15:27.092119+0000","last_clean":"2026-02-20T03:15:27.092119+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:27.092119+0000","last_undegraded":"2026-02-20T03:15:27.092119+0000","last_fullsized":"2026-02-20T03:15:27.092119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093756+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:15:27.093756+0000","last_peered":"2026-02-20T03:15:27.093756+0000","last_clean":"2026-02-20T03:15:27.093756+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:15:27.093756+0000","last_undegraded":"2026-02-20T03:15:27.093756+0000","last_fullsized":"2026-02-20T03:15:27.093756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096216+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:15:27.096216+0000","last_peered":"2026-02-20T03:15:27.096216+0000","last_clean":"2026-02-20T03:15:27.096216+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:15:27.096216+0000","last_undegraded":"2026-02-20T03:15:27.096216+0000","last_fullsized":"2026-02-20T03:15:27.096216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:29.396148+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:29.396148+0000","last_peered":"2026-02-20T03:15:29.396148+0000","last_clean":"2026-02-20T03:15:29.396148+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:29.396148+0000","last_undegraded":"2026-02-20T03:15:29.396148+0000","last_fullsized":"2026-02-20T03:15:29.396148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73733,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":87,"num_read_kb":116,"num_write":35,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091741+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:15:27.091741+0000","last_peered":"2026-02-20T03:15:27.091741+0000","last_clean":"2026-02-20T03:15:27.091741+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:15:27.091741+0000","last_undegraded":"2026-02-20T03:15:27.091741+0000","last_fullsized":"2026-02-20T03:15:27.091741+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100059+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:27.100059+0000","last_peered":"2026-02-20T03:15:27.100059+0000","last_clean":"2026-02-20T03:15:27.100059+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:27.100059+0000","last_undegraded":"2026-02-20T03:15:27.100059+0000","last_fullsized":"2026-02-20T03:15:27.100059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094441+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:15:27.094441+0000","last_peered":"2026-02-20T03:15:27.094441+0000","last_clean":"2026-02-20T03:15:27.094441+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:15:27.094441+0000","last_undegraded":"2026-02-20T03:15:27.094441+0000","last_fullsized":"2026-02-20T03:15:27.094441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392567+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:15:27.392567+0000","last_peered":"2026-02-20T03:15:27.392567+0000","last_clean":"2026-02-20T03:15:27.392567+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:15:27.392567+0000","last_undegraded":"2026-02-20T03:15:27.392567+0000","last_fullsized":"2026-02-20T03:15:27.392567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092453+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:27.092453+0000","last_peered":"2026-02-20T03:15:27.092453+0000","last_clean":"2026-02-20T03:15:27.092453+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:27.092453+0000","last_undegraded":"2026-02-20T03:15:27.092453+0000","last_fullsized":"2026-02-20T03:15:27.092453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098009+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:15:27.098009+0000","last_peered":"2026-02-20T03:15:27.098009+0000","last_clean":"2026-02-20T03:15:27.098009+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:15:27.098009+0000","last_undegraded":"2026-02-20T03:15:27.098009+0000","last_fullsized":"2026-02-20T03:15:27.098009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091618+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:15:27.091618+0000","last_peered":"2026-02-20T03:15:27.091618+0000","last_clean":"2026-02-20T03:15:27.091618+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:15:27.091618+0000","last_undegraded":"2026-02-20T03:15:27.091618+0000","last_fullsized":"2026-02-20T03:15:27.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099742+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:27.099742+0000","last_peered":"2026-02-20T03:15:27.099742+0000","last_clean":"2026-02-20T03:15:27.099742+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:27.099742+0000","last_undegraded":"2026-02-20T03:15:27.099742+0000","last_fullsized":"2026-02-20T03:15:27.099742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:28.388164+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:28.388164+0000","last_peered":"2026-02-20T03:15:28.388164+0000","last_clean":"2026-02-20T03:15:28.388164+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:28.388164+0000","last_undegraded":"2026-02-20T03:15:28.388164+0000","last_fullsized":"2026-02-20T03:15:28.388164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676945+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:15:27.676945+0000","last_peered":"2026-02-20T03:15:27.676945+0000","last_clean":"2026-02-20T03:15:27.676945+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:15:27.676945+0000","last_undegraded":"2026-02-20T03:15:27.676945+0000","last_fullsized":"2026-02-20T03:15:27.676945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091966+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:27.091966+0000","last_peered":"2026-02-20T03:15:27.091966+0000","last_clean":"2026-02-20T03:15:27.091966+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:27.091966+0000","last_undegraded":"2026-02-20T03:15:27.091966+0000","last_fullsized":"2026-02-20T03:15:27.091966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091995+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:15:27.091995+0000","last_peered":"2026-02-20T03:15:27.091995+0000","last_clean":"2026-02-20T03:15:27.091995+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:15:27.091995+0000","last_undegraded":"2026-02-20T03:15:27.091995+0000","last_fullsized":"2026-02-20T03:15:27.091995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094048+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:15:27.094048+0000","last_peered":"2026-02-20T03:15:27.094048+0000","last_clean":"2026-02-20T03:15:27.094048+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:15:27.094048+0000","last_undegraded":"2026-02-20T03:15:27.094048+0000","last_fullsized":"2026-02-20T03:15:27.094048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093983+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:15:27.093983+0000","last_peered":"2026-02-20T03:15:27.093983+0000","last_clean":"2026-02-20T03:15:27.093983+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:15:27.093983+0000","last_undegraded":"2026-02-20T03:15:27.093983+0000","last_fullsized":"2026-02-20T03:15:27.093983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676892+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:15:27.676892+0000","last_peered":"2026-02-20T03:15:27.676892+0000","last_clean":"2026-02-20T03:15:27.676892+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:15:27.676892+0000","last_undegraded":"2026-02-20T03:15:27.676892+0000","last_fullsized":"2026-02-20T03:15:27.676892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089481+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:15:27.089481+0000","last_peered":"2026-02-20T03:15:27.089481+0000","last_clean":"2026-02-20T03:15:27.089481+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:15:27.089481+0000","last_undegraded":"2026-02-20T03:15:27.089481+0000","last_fullsized":"2026-02-20T03:15:27.089481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383994+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:15:27.383994+0000","last_peered":"2026-02-20T03:15:27.383994+0000","last_clean":"2026-02-20T03:15:27.383994+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:15:27.383994+0000","last_undegraded":"2026-02-20T03:15:27.383994+0000","last_fullsized":"2026-02-20T03:15:27.383994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093591+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:15:27.093591+0000","last_peered":"2026-02-20T03:15:27.093591+0000","last_clean":"2026-02-20T03:15:27.093591+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:15:27.093591+0000","last_undegraded":"2026-02-20T03:15:27.093591+0000","last_fullsized":"2026-02-20T03:15:27.093591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092112+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:27.092112+0000","last_peered":"2026-02-20T03:15:27.092112+0000","last_clean":"2026-02-20T03:15:27.092112+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:27.092112+0000","last_undegraded":"2026-02-20T03:15:27.092112+0000","last_fullsized":"2026-02-20T03:15:27.092112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.382264+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:27.382264+0000","last_peered":"2026-02-20T03:15:27.382264+0000","last_clean":"2026-02-20T03:15:27.382264+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:27.382264+0000","last_undegraded":"2026-02-20T03:15:27.382264+0000","last_fullsized":"2026-02-20T03:15:27.382264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096098+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:15:27.096098+0000","last_peered":"2026-02-20T03:15:27.096098+0000","last_clean":"2026-02-20T03:15:27.096098+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:15:27.096098+0000","last_undegraded":"2026-02-20T03:15:27.096098+0000","last_fullsized":"2026-02-20T03:15:27.096098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092190+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:27.092190+0000","last_peered":"2026-02-20T03:15:27.092190+0000","last_clean":"2026-02-20T03:15:27.092190+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:27.092190+0000","last_undegraded":"2026-02-20T03:15:27.092190+0000","last_fullsized":"2026-02-20T03:15:27.092190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092030+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:27.092030+0000","last_peered":"2026-02-20T03:15:27.092030+0000","last_clean":"2026-02-20T03:15:27.092030+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:27.092030+0000","last_undegraded":"2026-02-20T03:15:27.092030+0000","last_fullsized":"2026-02-20T03:15:27.092030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091880+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:27.091880+0000","last_peered":"2026-02-20T03:15:27.091880+0000","last_clean":"2026-02-20T03:15:27.091880+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:27.091880+0000","last_undegraded":"2026-02-20T03:15:27.091880+0000","last_fullsized":"2026-02-20T03:15:27.091880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092039+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:27.092039+0000","last_peered":"2026-02-20T03:15:27.092039+0000","last_clean":"2026-02-20T03:15:27.092039+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:27.092039+0000","last_undegraded":"2026-02-20T03:15:27.092039+0000","last_fullsized":"2026-02-20T03:15:27.092039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090007+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:15:27.090007+0000","last_peered":"2026-02-20T03:15:27.090007+0000","last_clean":"2026-02-20T03:15:27.090007+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:15:27.090007+0000","last_undegraded":"2026-02-20T03:15:27.090007+0000","last_fullsized":"2026-02-20T03:15:27.090007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096323+0000","last_change":"2026-02-20T03:15:27.096323+0000","last_active":"2026-02-20T03:15:27.096323+0000","last_peered":"2026-02-20T03:15:27.096323+0000","last_clean":"2026-02-20T03:15:27.096323+0000","last_became_active":"2026-02-20T03:15:27.096171+0000","last_became_peered":"2026-02-20T03:15:27.096171+0000","last_unstale":"2026-02-20T03:15:27.096323+0000","last_undegraded":"2026-02-20T03:15:27.096323+0000","last_fullsized":"2026-02-20T03:15:27.096323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:00:54.803500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092769+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:27.092769+0000","last_peered":"2026-02-20T03:15:27.092769+0000","last_clean":"2026-02-20T03:15:27.092769+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:27.092769+0000","last_undegraded":"2026-02-20T03:15:27.092769+0000","last_fullsized":"2026-02-20T03:15:27.092769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677330+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:15:27.677330+0000","last_peered":"2026-02-20T03:15:27.677330+0000","last_clean":"2026-02-20T03:15:27.677330+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:15:27.677330+0000","last_undegraded":"2026-02-20T03:15:27.677330+0000","last_fullsized":"2026-02-20T03:15:27.677330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093789+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:15:27.093789+0000","last_peered":"2026-02-20T03:15:27.093789+0000","last_clean":"2026-02-20T03:15:27.093789+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:15:27.093789+0000","last_undegraded":"2026-02-20T03:15:27.093789+0000","last_fullsized":"2026-02-20T03:15:27.093789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677022+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:15:27.677022+0000","last_peered":"2026-02-20T03:15:27.677022+0000","last_clean":"2026-02-20T03:15:27.677022+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:15:27.677022+0000","last_undegraded":"2026-02-20T03:15:27.677022+0000","last_fullsized":"2026-02-20T03:15:27.677022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099411+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:27.099411+0000","last_peered":"2026-02-20T03:15:27.099411+0000","last_clean":"2026-02-20T03:15:27.099411+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:27.099411+0000","last_undegraded":"2026-02-20T03:15:27.099411+0000","last_fullsized":"2026-02-20T03:15:27.099411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089899+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:15:27.089899+0000","last_peered":"2026-02-20T03:15:27.089899+0000","last_clean":"2026-02-20T03:15:27.089899+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:15:27.089899+0000","last_undegraded":"2026-02-20T03:15:27.089899+0000","last_fullsized":"2026-02-20T03:15:27.089899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093603+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:15:27.093603+0000","last_peered":"2026-02-20T03:15:27.093603+0000","last_clean":"2026-02-20T03:15:27.093603+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:15:27.093603+0000","last_undegraded":"2026-02-20T03:15:27.093603+0000","last_fullsized":"2026-02-20T03:15:27.093603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092566+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:27.092566+0000","last_peered":"2026-02-20T03:15:27.092566+0000","last_clean":"2026-02-20T03:15:27.092566+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:27.092566+0000","last_undegraded":"2026-02-20T03:15:27.092566+0000","last_fullsized":"2026-02-20T03:15:27.092566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092017+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:15:27.092017+0000","last_peered":"2026-02-20T03:15:27.092017+0000","last_clean":"2026-02-20T03:15:27.092017+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:15:27.092017+0000","last_undegraded":"2026-02-20T03:15:27.092017+0000","last_fullsized":"2026-02-20T03:15:27.092017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094334+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:15:27.094334+0000","last_peered":"2026-02-20T03:15:27.094334+0000","last_clean":"2026-02-20T03:15:27.094334+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:15:27.094334+0000","last_undegraded":"2026-02-20T03:15:27.094334+0000","last_fullsized":"2026-02-20T03:15:27.094334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098981+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:27.098981+0000","last_peered":"2026-02-20T03:15:27.098981+0000","last_clean":"2026-02-20T03:15:27.098981+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:27.098981+0000","last_undegraded":"2026-02-20T03:15:27.098981+0000","last_fullsized":"2026-02-20T03:15:27.098981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091896+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:27.091896+0000","last_peered":"2026-02-20T03:15:27.091896+0000","last_clean":"2026-02-20T03:15:27.091896+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:27.091896+0000","last_undegraded":"2026-02-20T03:15:27.091896+0000","last_fullsized":"2026-02-20T03:15:27.091896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091504+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:27.091504+0000","last_peered":"2026-02-20T03:15:27.091504+0000","last_clean":"2026-02-20T03:15:27.091504+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:27.091504+0000","last_undegraded":"2026-02-20T03:15:27.091504+0000","last_fullsized":"2026-02-20T03:15:27.091504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089821+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:15:27.089821+0000","last_peered":"2026-02-20T03:15:27.089821+0000","last_clean":"2026-02-20T03:15:27.089821+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:15:27.089821+0000","last_undegraded":"2026-02-20T03:15:27.089821+0000","last_fullsized":"2026-02-20T03:15:27.089821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392752+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:15:27.392752+0000","last_peered":"2026-02-20T03:15:27.392752+0000","last_clean":"2026-02-20T03:15:27.392752+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:15:27.392752+0000","last_undegraded":"2026-02-20T03:15:27.392752+0000","last_fullsized":"2026-02-20T03:15:27.392752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098066+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:15:27.098066+0000","last_peered":"2026-02-20T03:15:27.098066+0000","last_clean":"2026-02-20T03:15:27.098066+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:15:27.098066+0000","last_undegraded":"2026-02-20T03:15:27.098066+0000","last_fullsized":"2026-02-20T03:15:27.098066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384200+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:15:27.384200+0000","last_peered":"2026-02-20T03:15:27.384200+0000","last_clean":"2026-02-20T03:15:27.384200+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:15:27.384200+0000","last_undegraded":"2026-02-20T03:15:27.384200+0000","last_fullsized":"2026-02-20T03:15:27.384200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.101465+0000","last_change":"2026-02-20T03:15:27.101465+0000","last_active":"2026-02-20T03:15:27.101465+0000","last_peered":"2026-02-20T03:15:27.101465+0000","last_clean":"2026-02-20T03:15:27.101465+0000","last_became_active":"2026-02-20T03:15:27.101042+0000","last_became_peered":"2026-02-20T03:15:27.101042+0000","last_unstale":"2026-02-20T03:15:27.101465+0000","last_undegraded":"2026-02-20T03:15:27.101465+0000","last_fullsized":"2026-02-20T03:15:27.101465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:16:15.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676902+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:15:27.676902+0000","last_peered":"2026-02-20T03:15:27.676902+0000","last_clean":"2026-02-20T03:15:27.676902+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:15:27.676902+0000","last_undegraded":"2026-02-20T03:15:27.676902+0000","last_fullsized":"2026-02-20T03:15:27.676902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097349+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:15:27.097349+0000","last_peered":"2026-02-20T03:15:27.097349+0000","last_clean":"2026-02-20T03:15:27.097349+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:15:27.097349+0000","last_undegraded":"2026-02-20T03:15:27.097349+0000","last_fullsized":"2026-02-20T03:15:27.097349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383987+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:15:27.383987+0000","last_peered":"2026-02-20T03:15:27.383987+0000","last_clean":"2026-02-20T03:15:27.383987+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:15:27.383987+0000","last_undegraded":"2026-02-20T03:15:27.383987+0000","last_fullsized":"2026-02-20T03:15:27.383987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392687+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:15:27.392687+0000","last_peered":"2026-02-20T03:15:27.392687+0000","last_clean":"2026-02-20T03:15:27.392687+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:15:27.392687+0000","last_undegraded":"2026-02-20T03:15:27.392687+0000","last_fullsized":"2026-02-20T03:15:27.392687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091837+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:27.091837+0000","last_peered":"2026-02-20T03:15:27.091837+0000","last_clean":"2026-02-20T03:15:27.091837+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:27.091837+0000","last_undegraded":"2026-02-20T03:15:27.091837+0000","last_fullsized":"2026-02-20T03:15:27.091837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091994+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:27.091994+0000","last_peered":"2026-02-20T03:15:27.091994+0000","last_clean":"2026-02-20T03:15:27.091994+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:27.091994+0000","last_undegraded":"2026-02-20T03:15:27.091994+0000","last_fullsized":"2026-02-20T03:15:27.091994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094313+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:15:27.094313+0000","last_peered":"2026-02-20T03:15:27.094313+0000","last_clean":"2026-02-20T03:15:27.094313+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:15:27.094313+0000","last_undegraded":"2026-02-20T03:15:27.094313+0000","last_fullsized":"2026-02-20T03:15:27.094313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78071,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":259,"num_read_kb":213,"num_write":168,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":234213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32140,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971060,"statfs":{"total":751619276800,"available":751586365440,"internally_reserved":0,"allocated":1032192,"data_stored":502911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32820,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970380,"statfs":{"total":751619276800,"available":751585669120,"internally_reserved":0,"allocated":1728512,"data_stored":1164282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776149,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":507221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037784,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32144,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971056,"statfs":{"total":751619276800,"available":751586361344,"internally_reserved":0,"allocated":1036288,"data_stored":502431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299418,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32732,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970468,"statfs":{"total":751619276800,"available":751585759232,"internally_reserved":0,"allocated":1638400,"data_stored":1099261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1024000,"data_stored":498291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28576,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974624,"statfs":{"total":751619276800,"available":751590014976,"internally_reserved":0,"allocated":1646592,"data_stored":1094457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888096,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32148,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971052,"statfs":{"total":751619276800,"available":751586357248,"internally_reserved":0,"allocated":1040384,"data_stored":503925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149730,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1036288,"data_stored":498485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378661,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":1122304,"data_stored":573008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28044,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975156,"statfs":{"total":751619276800,"available":751590559744,"internally_reserved":0,"allocated":1105920,"data_stored":572526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":499699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":74807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":75713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:35.740 INFO:tasks.fwd_scrub.ceph_manager:clean! 2026-02-20T03:15:35.740 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T03:15:35.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 -- 10.20.193.28:0/1919967609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86001064d0 msgr2=0x7f860010cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 --2- 10.20.193.28:0/1919967609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86001064d0 0x7f860010cd60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009f90 tx=0x7f85fc02f390 comp rx=0 tx=0).stop 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 -- 10.20.193.28:0/1919967609 shutdown_connections 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 --2- 10.20.193.28:0/1919967609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86001064d0 0x7f860010cd60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 --2- 10.20.193.28:0/1919967609 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8600105b10 0x7f8600105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 --2- 10.20.193.28:0/1919967609 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8600104920 0x7f8600104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 -- 10.20.193.28:0/1919967609 >> 10.20.193.28:0/1919967609 conn(0x7f8600100080 msgr2=0x7f86001024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 -- 10.20.193.28:0/1919967609 shutdown_connections 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 -- 10.20.193.28:0/1919967609 wait complete. 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 Processor -- start 2026-02-20T03:15:35.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.892+0000 7f8605c20640 1 -- start start 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8605c20640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8600104920 0x7f860019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8605c20640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8600105b10 0x7f860019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8605c20640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86001064d0 0x7f86001a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8605c20640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8600110410 con 0x7f8600104920 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8605c20640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8600110290 con 0x7f86001064d0 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8605c20640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8600110590 con 0x7f8600105b10 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8604c1e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8600104920 0x7f860019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f85f7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8600105b10 0x7f860019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8604c1e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8600104920 0x7f860019c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33808/0 (socket says 10.20.193.28:33808) 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8604c1e640 1 -- 10.20.193.28:0/3297797469 learned_addr learned my addr 10.20.193.28:0/3297797469 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f860541f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86001064d0 0x7f86001a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8604c1e640 1 -- 10.20.193.28:0/3297797469 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8600105b10 msgr2=0x7f860019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:35.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8604c1e640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8600105b10 0x7f860019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8604c1e640 1 -- 10.20.193.28:0/3297797469 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86001064d0 msgr2=0x7f86001a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:35.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8604c1e640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86001064d0 0x7f86001a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:35.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8604c1e640 1 -- 10.20.193.28:0/3297797469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86001a4620 con 0x7f8600104920 2026-02-20T03:15:35.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8604c1e640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8600104920 0x7f860019c970 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f85f000e9c0 tx=0x7f85f000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:35.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f85f5ffb640 1 -- 10.20.193.28:0/3297797469 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f000cdb0 con 0x7f8600104920 2026-02-20T03:15:35.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f85f5ffb640 1 -- 10.20.193.28:0/3297797469 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f85f0004570 con 0x7f8600104920 2026-02-20T03:15:35.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f85f5ffb640 1 -- 10.20.193.28:0/3297797469 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0010690 con 0x7f8600104920 2026-02-20T03:15:35.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.893+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86001a4910 con 0x7f8600104920 2026-02-20T03:15:35.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.894+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86001a4e10 con 0x7f8600104920 2026-02-20T03:15:35.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.894+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f860010b6b0 con 0x7f8600104920 2026-02-20T03:15:35.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.896+0000 7f85f5ffb640 1 -- 10.20.193.28:0/3297797469 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f85f0020030 con 0x7f8600104920 2026-02-20T03:15:35.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.897+0000 7f85f5ffb640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85dc0b0eb0 0x7f85dc0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:35.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.897+0000 7f85f5ffb640 1 -- 10.20.193.28:0/3297797469 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f85f00e0cf0 con 0x7f8600104920 2026-02-20T03:15:35.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.897+0000 7f85f7fff640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85dc0b0eb0 0x7f85dc0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:35.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.898+0000 7f85f7fff640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85dc0b0eb0 0x7f85dc0b3370 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f860019de80 tx=0x7f85e8009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:35.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.899+0000 7f85f5ffb640 1 -- 10.20.193.28:0/3297797469 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f85f00a9060 con 0x7f8600104920 2026-02-20T03:15:35.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.988+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86000630c0 con 0x7f85dc0b0eb0 2026-02-20T03:15:35.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.993+0000 7f85f5ffb640 1 -- 10.20.193.28:0/3297797469 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340405 (secure 0 0 0) 0x7f86000630c0 con 0x7f85dc0b0eb0 2026-02-20T03:15:35.999 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:36.002 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:36.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85dc0b0eb0 msgr2=0x7f85dc0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:36.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85dc0b0eb0 0x7f85dc0b3370 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f860019de80 tx=0x7f85e8009290 comp rx=0 tx=0).stop 2026-02-20T03:15:36.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8600104920 msgr2=0x7f860019c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8600104920 0x7f860019c970 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f85f000e9c0 tx=0x7f85f000ee90 comp rx=0 tx=0).stop 2026-02-20T03:15:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 shutdown_connections 2026-02-20T03:15:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85dc0b0eb0 0x7f85dc0b3370 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86001064d0 0x7f86001a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8600105b10 0x7f860019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 --2- 10.20.193.28:0/3297797469 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8600104920 0x7f860019c970 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 >> 10.20.193.28:0/3297797469 conn(0x7f8600100080 msgr2=0x7f8600108e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 shutdown_connections 2026-02-20T03:15:36.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:35.996+0000 7f8605c20640 1 -- 10.20.193.28:0/3297797469 wait complete. 2026-02-20T03:15:36.011 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2026-02-20T03:15:34.010914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668673,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":365,"num_read_kb":304,"num_write":359,"num_write_kb":3849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181942,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":299,"ondisk_log_size":299,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":423,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358612,"kb_used_data":14168,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807679788,"statfs":{"total":9019431321600,"available":9019064102912,"internally_reserved":0,"allocated":14508032,"data_stored":8016497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4705,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":24,"num_write":2,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001531"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.389259+0000","last_change":"2026-02-20T03:15:27.389259+0000","last_active":"2026-02-20T03:15:27.389259+0000","last_peered":"2026-02-20T03:15:27.389259+0000","last_clean":"2026-02-20T03:15:27.389259+0000","last_became_active":"2026-02-20T03:15:27.385887+0000","last_became_peered":"2026-02-20T03:15:27.385887+0000","last_unstale":"2026-02-20T03:15:27.389259+0000","last_undegraded":"2026-02-20T03:15:27.389259+0000","last_fullsized":"2026-02-20T03:15:27.389259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:20:01.907763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677322+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:15:27.677322+0000","last_peered":"2026-02-20T03:15:27.677322+0000","last_clean":"2026-02-20T03:15:27.677322+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:15:27.677322+0000","last_undegraded":"2026-02-20T03:15:27.677322+0000","last_fullsized":"2026-02-20T03:15:27.677322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091764+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:27.091764+0000","last_peered":"2026-02-20T03:15:27.091764+0000","last_clean":"2026-02-20T03:15:27.091764+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:27.091764+0000","last_undegraded":"2026-02-20T03:15:27.091764+0000","last_fullsized":"2026-02-20T03:15:27.091764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677381+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:15:27.677381+0000","last_peered":"2026-02-20T03:15:27.677381+0000","last_clean":"2026-02-20T03:15:27.677381+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:15:27.677381+0000","last_undegraded":"2026-02-20T03:15:27.677381+0000","last_fullsized":"2026-02-20T03:15:27.677381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092401+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:27.092401+0000","last_peered":"2026-02-20T03:15:27.092401+0000","last_clean":"2026-02-20T03:15:27.092401+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:27.092401+0000","last_undegraded":"2026-02-20T03:15:27.092401+0000","last_fullsized":"2026-02-20T03:15:27.092401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392166+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:15:27.392166+0000","last_peered":"2026-02-20T03:15:27.392166+0000","last_clean":"2026-02-20T03:15:27.392166+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:15:27.392166+0000","last_undegraded":"2026-02-20T03:15:27.392166+0000","last_fullsized":"2026-02-20T03:15:27.392166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096362+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:15:27.096362+0000","last_peered":"2026-02-20T03:15:27.096362+0000","last_clean":"2026-02-20T03:15:27.096362+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:15:27.096362+0000","last_undegraded":"2026-02-20T03:15:27.096362+0000","last_fullsized":"2026-02-20T03:15:27.096362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100051+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:27.100051+0000","last_peered":"2026-02-20T03:15:27.100051+0000","last_clean":"2026-02-20T03:15:27.100051+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:27.100051+0000","last_undegraded":"2026-02-20T03:15:27.100051+0000","last_fullsized":"2026-02-20T03:15:27.100051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392411+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:15:27.392411+0000","last_peered":"2026-02-20T03:15:27.392411+0000","last_clean":"2026-02-20T03:15:27.392411+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:15:27.392411+0000","last_undegraded":"2026-02-20T03:15:27.392411+0000","last_fullsized":"2026-02-20T03:15:27.392411+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096305+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:15:27.096305+0000","last_peered":"2026-02-20T03:15:27.096305+0000","last_clean":"2026-02-20T03:15:27.096305+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:15:27.096305+0000","last_undegraded":"2026-02-20T03:15:27.096305+0000","last_fullsized":"2026-02-20T03:15:27.096305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096792+0000","last_change":"2026-02-20T03:15:27.096792+0000","last_active":"2026-02-20T03:15:27.096792+0000","last_peered":"2026-02-20T03:15:27.096792+0000","last_clean":"2026-02-20T03:15:27.096792+0000","last_became_active":"2026-02-20T03:15:27.096659+0000","last_became_peered":"2026-02-20T03:15:27.096659+0000","last_unstale":"2026-02-20T03:15:27.096792+0000","last_undegraded":"2026-02-20T03:15:27.096792+0000","last_fullsized":"2026-02-20T03:15:27.096792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:57.312267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392339+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:15:27.392339+0000","last_peered":"2026-02-20T03:15:27.392339+0000","last_clean":"2026-02-20T03:15:27.392339+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:15:27.392339+0000","last_undegraded":"2026-02-20T03:15:27.392339+0000","last_fullsized":"2026-02-20T03:15:27.392339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097517+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:15:27.097517+0000","last_peered":"2026-02-20T03:15:27.097517+0000","last_clean":"2026-02-20T03:15:27.097517+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:15:27.097517+0000","last_undegraded":"2026-02-20T03:15:27.097517+0000","last_fullsized":"2026-02-20T03:15:27.097517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392602+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:15:27.392602+0000","last_peered":"2026-02-20T03:15:27.392602+0000","last_clean":"2026-02-20T03:15:27.392602+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:15:27.392602+0000","last_undegraded":"2026-02-20T03:15:27.392602+0000","last_fullsized":"2026-02-20T03:15:27.392602+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677473+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:15:27.677473+0000","last_peered":"2026-02-20T03:15:27.677473+0000","last_clean":"2026-02-20T03:15:27.677473+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:15:27.677473+0000","last_undegraded":"2026-02-20T03:15:27.677473+0000","last_fullsized":"2026-02-20T03:15:27.677473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091890+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:27.091890+0000","last_peered":"2026-02-20T03:15:27.091890+0000","last_clean":"2026-02-20T03:15:27.091890+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:27.091890+0000","last_undegraded":"2026-02-20T03:15:27.091890+0000","last_fullsized":"2026-02-20T03:15:27.091890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392578+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:15:27.392578+0000","last_peered":"2026-02-20T03:15:27.392578+0000","last_clean":"2026-02-20T03:15:27.392578+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:15:27.392578+0000","last_undegraded":"2026-02-20T03:15:27.392578+0000","last_fullsized":"2026-02-20T03:15:27.392578+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677054+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:15:27.677054+0000","last_peered":"2026-02-20T03:15:27.677054+0000","last_clean":"2026-02-20T03:15:27.677054+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:15:27.677054+0000","last_undegraded":"2026-02-20T03:15:27.677054+0000","last_fullsized":"2026-02-20T03:15:27.677054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092084+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:15:27.092084+0000","last_peered":"2026-02-20T03:15:27.092084+0000","last_clean":"2026-02-20T03:15:27.092084+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:15:27.092084+0000","last_undegraded":"2026-02-20T03:15:27.092084+0000","last_fullsized":"2026-02-20T03:15:27.092084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095913+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:15:27.095913+0000","last_peered":"2026-02-20T03:15:27.095913+0000","last_clean":"2026-02-20T03:15:27.095913+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:15:27.095913+0000","last_undegraded":"2026-02-20T03:15:27.095913+0000","last_fullsized":"2026-02-20T03:15:27.095913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.106320+0000","last_change":"2026-02-20T03:15:27.106320+0000","last_active":"2026-02-20T03:15:27.106320+0000","last_peered":"2026-02-20T03:15:27.106320+0000","last_clean":"2026-02-20T03:15:27.106320+0000","last_became_active":"2026-02-20T03:15:27.101151+0000","last_became_peered":"2026-02-20T03:15:27.101151+0000","last_unstale":"2026-02-20T03:15:27.106320+0000","last_undegraded":"2026-02-20T03:15:27.106320+0000","last_fullsized":"2026-02-20T03:15:27.106320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:56.197115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392629+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:15:27.392629+0000","last_peered":"2026-02-20T03:15:27.392629+0000","last_clean":"2026-02-20T03:15:27.392629+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:15:27.392629+0000","last_undegraded":"2026-02-20T03:15:27.392629+0000","last_fullsized":"2026-02-20T03:15:27.392629+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093728+0000","last_change":"2026-02-20T03:15:27.093728+0000","last_active":"2026-02-20T03:15:27.093728+0000","last_peered":"2026-02-20T03:15:27.093728+0000","last_clean":"2026-02-20T03:15:27.093728+0000","last_became_active":"2026-02-20T03:15:27.093455+0000","last_became_peered":"2026-02-20T03:15:27.093455+0000","last_unstale":"2026-02-20T03:15:27.093728+0000","last_undegraded":"2026-02-20T03:15:27.093728+0000","last_fullsized":"2026-02-20T03:15:27.093728+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:38:26.593708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392844+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:15:27.392844+0000","last_peered":"2026-02-20T03:15:27.392844+0000","last_clean":"2026-02-20T03:15:27.392844+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:15:27.392844+0000","last_undegraded":"2026-02-20T03:15:27.392844+0000","last_fullsized":"2026-02-20T03:15:27.392844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091895+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:27.091895+0000","last_peered":"2026-02-20T03:15:27.091895+0000","last_clean":"2026-02-20T03:15:27.091895+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:27.091895+0000","last_undegraded":"2026-02-20T03:15:27.091895+0000","last_fullsized":"2026-02-20T03:15:27.091895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677369+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:15:27.677369+0000","last_peered":"2026-02-20T03:15:27.677369+0000","last_clean":"2026-02-20T03:15:27.677369+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:15:27.677369+0000","last_undegraded":"2026-02-20T03:15:27.677369+0000","last_fullsized":"2026-02-20T03:15:27.677369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'10","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092065+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:27.092065+0000","last_peered":"2026-02-20T03:15:27.092065+0000","last_clean":"2026-02-20T03:15:27.092065+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:27.092065+0000","last_undegraded":"2026-02-20T03:15:27.092065+0000","last_fullsized":"2026-02-20T03:15:27.092065+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676826+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:15:27.676826+0000","last_peered":"2026-02-20T03:15:27.676826+0000","last_clean":"2026-02-20T03:15:27.676826+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:15:27.676826+0000","last_undegraded":"2026-02-20T03:15:27.676826+0000","last_fullsized":"2026-02-20T03:15:27.676826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090039+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:15:27.090039+0000","last_peered":"2026-02-20T03:15:27.090039+0000","last_clean":"2026-02-20T03:15:27.090039+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:15:27.090039+0000","last_undegraded":"2026-02-20T03:15:27.090039+0000","last_fullsized":"2026-02-20T03:15:27.090039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099935+0000","last_change":"2026-02-20T03:15:27.099749+0000","last_active":"2026-02-20T03:15:27.099935+0000","last_peered":"2026-02-20T03:15:27.099935+0000","last_clean":"2026-02-20T03:15:27.099935+0000","last_became_active":"2026-02-20T03:15:27.096338+0000","last_became_peered":"2026-02-20T03:15:27.096338+0000","last_unstale":"2026-02-20T03:15:27.099935+0000","last_undegraded":"2026-02-20T03:15:27.099935+0000","last_fullsized":"2026-02-20T03:15:27.099935+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:59:55.738735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093553+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:15:27.093553+0000","last_peered":"2026-02-20T03:15:27.093553+0000","last_clean":"2026-02-20T03:15:27.093553+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:15:27.093553+0000","last_undegraded":"2026-02-20T03:15:27.093553+0000","last_fullsized":"2026-02-20T03:15:27.093553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384089+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:15:27.384089+0000","last_peered":"2026-02-20T03:15:27.384089+0000","last_clean":"2026-02-20T03:15:27.384089+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:15:27.384089+0000","last_undegraded":"2026-02-20T03:15:27.384089+0000","last_fullsized":"2026-02-20T03:15:27.384089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091877+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:15:27.091877+0000","last_peered":"2026-02-20T03:15:27.091877+0000","last_clean":"2026-02-20T03:15:27.091877+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:15:27.091877+0000","last_undegraded":"2026-02-20T03:15:27.091877+0000","last_fullsized":"2026-02-20T03:15:27.091877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095909+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:15:27.095909+0000","last_peered":"2026-02-20T03:15:27.095909+0000","last_clean":"2026-02-20T03:15:27.095909+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:15:27.095909+0000","last_undegraded":"2026-02-20T03:15:27.095909+0000","last_fullsized":"2026-02-20T03:15:27.095909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384056+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:15:27.384056+0000","last_peered":"2026-02-20T03:15:27.384056+0000","last_clean":"2026-02-20T03:15:27.384056+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:15:27.384056+0000","last_undegraded":"2026-02-20T03:15:27.384056+0000","last_fullsized":"2026-02-20T03:15:27.384056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097629+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:15:27.097629+0000","last_peered":"2026-02-20T03:15:27.097629+0000","last_clean":"2026-02-20T03:15:27.097629+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:15:27.097629+0000","last_undegraded":"2026-02-20T03:15:27.097629+0000","last_fullsized":"2026-02-20T03:15:27.097629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090084+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:15:27.090084+0000","last_peered":"2026-02-20T03:15:27.090084+0000","last_clean":"2026-02-20T03:15:27.090084+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:15:27.090084+0000","last_undegraded":"2026-02-20T03:15:27.090084+0000","last_fullsized":"2026-02-20T03:15:27.090084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096476+0000","last_change":"2026-02-20T03:15:27.096476+0000","last_active":"2026-02-20T03:15:27.096476+0000","last_peered":"2026-02-20T03:15:27.096476+0000","last_clean":"2026-02-20T03:15:27.096476+0000","last_became_active":"2026-02-20T03:15:27.096369+0000","last_became_peered":"2026-02-20T03:15:27.096369+0000","last_unstale":"2026-02-20T03:15:27.096476+0000","last_undegraded":"2026-02-20T03:15:27.096476+0000","last_fullsized":"2026-02-20T03:15:27.096476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:18:04.418088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:31.387805+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:31.387805+0000","last_peered":"2026-02-20T03:15:31.387805+0000","last_clean":"2026-02-20T03:15:31.387805+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:31.387805+0000","last_undegraded":"2026-02-20T03:15:31.387805+0000","last_fullsized":"2026-02-20T03:15:31.387805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089978+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:15:27.089978+0000","last_peered":"2026-02-20T03:15:27.089978+0000","last_clean":"2026-02-20T03:15:27.089978+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:15:27.089978+0000","last_undegraded":"2026-02-20T03:15:27.089978+0000","last_fullsized":"2026-02-20T03:15:27.089978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089476+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:15:27.089476+0000","last_peered":"2026-02-20T03:15:27.089476+0000","last_clean":"2026-02-20T03:15:27.089476+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:15:27.089476+0000","last_undegraded":"2026-02-20T03:15:27.089476+0000","last_fullsized":"2026-02-20T03:15:27.089476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097578+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:15:27.097578+0000","last_peered":"2026-02-20T03:15:27.097578+0000","last_clean":"2026-02-20T03:15:27.097578+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:15:27.097578+0000","last_undegraded":"2026-02-20T03:15:27.097578+0000","last_fullsized":"2026-02-20T03:15:27.097578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093923+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:15:27.093923+0000","last_peered":"2026-02-20T03:15:27.093923+0000","last_clean":"2026-02-20T03:15:27.093923+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:15:27.093923+0000","last_undegraded":"2026-02-20T03:15:27.093923+0000","last_fullsized":"2026-02-20T03:15:27.093923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677506+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:15:27.677506+0000","last_peered":"2026-02-20T03:15:27.677506+0000","last_clean":"2026-02-20T03:15:27.677506+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:15:27.677506+0000","last_undegraded":"2026-02-20T03:15:27.677506+0000","last_fullsized":"2026-02-20T03:15:27.677506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392678+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:15:27.392678+0000","last_peered":"2026-02-20T03:15:27.392678+0000","last_clean":"2026-02-20T03:15:27.392678+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:15:27.392678+0000","last_undegraded":"2026-02-20T03:15:27.392678+0000","last_fullsized":"2026-02-20T03:15:27.392678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":354,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097799+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:15:27.097799+0000","last_peered":"2026-02-20T03:15:27.097799+0000","last_clean":"2026-02-20T03:15:27.097799+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:15:27.097799+0000","last_undegraded":"2026-02-20T03:15:27.097799+0000","last_fullsized":"2026-02-20T03:15:27.097799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097882+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:15:27.097882+0000","last_peered":"2026-02-20T03:15:27.097882+0000","last_clean":"2026-02-20T03:15:27.097882+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:15:27.097882+0000","last_undegraded":"2026-02-20T03:15:27.097882+0000","last_fullsized":"2026-02-20T03:15:27.097882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098144+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:15:27.098144+0000","last_peered":"2026-02-20T03:15:27.098144+0000","last_clean":"2026-02-20T03:15:27.098144+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:15:27.098144+0000","last_undegraded":"2026-02-20T03:15:27.098144+0000","last_fullsized":"2026-02-20T03:15:27.098144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.104030+0000","last_change":"2026-02-20T03:15:27.104030+0000","last_active":"2026-02-20T03:15:27.104030+0000","last_peered":"2026-02-20T03:15:27.104030+0000","last_clean":"2026-02-20T03:15:27.104030+0000","last_became_active":"2026-02-20T03:15:27.101137+0000","last_became_peered":"2026-02-20T03:15:27.101137+0000","last_unstale":"2026-02-20T03:15:27.104030+0000","last_undegraded":"2026-02-20T03:15:27.104030+0000","last_fullsized":"2026-02-20T03:15:27.104030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:16.927063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099157+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:27.099157+0000","last_peered":"2026-02-20T03:15:27.099157+0000","last_clean":"2026-02-20T03:15:27.099157+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:27.099157+0000","last_undegraded":"2026-02-20T03:15:27.099157+0000","last_fullsized":"2026-02-20T03:15:27.099157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097824+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:15:27.097824+0000","last_peered":"2026-02-20T03:15:27.097824+0000","last_clean":"2026-02-20T03:15:27.097824+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:15:27.097824+0000","last_undegraded":"2026-02-20T03:15:27.097824+0000","last_fullsized":"2026-02-20T03:15:27.097824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094597+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:15:27.094597+0000","last_peered":"2026-02-20T03:15:27.094597+0000","last_clean":"2026-02-20T03:15:27.094597+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:15:27.094597+0000","last_undegraded":"2026-02-20T03:15:27.094597+0000","last_fullsized":"2026-02-20T03:15:27.094597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091583+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:27.091583+0000","last_peered":"2026-02-20T03:15:27.091583+0000","last_clean":"2026-02-20T03:15:27.091583+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:27.091583+0000","last_undegraded":"2026-02-20T03:15:27.091583+0000","last_fullsized":"2026-02-20T03:15:27.091583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098225+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:15:27.098225+0000","last_peered":"2026-02-20T03:15:27.098225+0000","last_clean":"2026-02-20T03:15:27.098225+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:15:27.098225+0000","last_undegraded":"2026-02-20T03:15:27.098225+0000","last_fullsized":"2026-02-20T03:15:27.098225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089901+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:15:27.089901+0000","last_peered":"2026-02-20T03:15:27.089901+0000","last_clean":"2026-02-20T03:15:27.089901+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:15:27.089901+0000","last_undegraded":"2026-02-20T03:15:27.089901+0000","last_fullsized":"2026-02-20T03:15:27.089901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093235+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:15:27.093235+0000","last_peered":"2026-02-20T03:15:27.093235+0000","last_clean":"2026-02-20T03:15:27.093235+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:15:27.093235+0000","last_undegraded":"2026-02-20T03:15:27.093235+0000","last_fullsized":"2026-02-20T03:15:27.093235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093959+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:15:27.093959+0000","last_peered":"2026-02-20T03:15:27.093959+0000","last_clean":"2026-02-20T03:15:27.093959+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:15:27.093959+0000","last_undegraded":"2026-02-20T03:15:27.093959+0000","last_fullsized":"2026-02-20T03:15:27.093959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:15:27.096403+0000","last_peered":"2026-02-20T03:15:27.096403+0000","last_clean":"2026-02-20T03:15:27.096403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:15:27.096403+0000","last_undegraded":"2026-02-20T03:15:27.096403+0000","last_fullsized":"2026-02-20T03:15:27.096403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093292+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:15:27.093292+0000","last_peered":"2026-02-20T03:15:27.093292+0000","last_clean":"2026-02-20T03:15:27.093292+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:15:27.093292+0000","last_undegraded":"2026-02-20T03:15:27.093292+0000","last_fullsized":"2026-02-20T03:15:27.093292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093347+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:15:27.093347+0000","last_peered":"2026-02-20T03:15:27.093347+0000","last_clean":"2026-02-20T03:15:27.093347+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:15:27.093347+0000","last_undegraded":"2026-02-20T03:15:27.093347+0000","last_fullsized":"2026-02-20T03:15:27.093347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095895+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:15:27.095895+0000","last_peered":"2026-02-20T03:15:27.095895+0000","last_clean":"2026-02-20T03:15:27.095895+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:15:27.095895+0000","last_undegraded":"2026-02-20T03:15:27.095895+0000","last_fullsized":"2026-02-20T03:15:27.095895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089892+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:15:27.089892+0000","last_peered":"2026-02-20T03:15:27.089892+0000","last_clean":"2026-02-20T03:15:27.089892+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:15:27.089892+0000","last_undegraded":"2026-02-20T03:15:27.089892+0000","last_fullsized":"2026-02-20T03:15:27.089892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097367+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:15:27.097367+0000","last_peered":"2026-02-20T03:15:27.097367+0000","last_clean":"2026-02-20T03:15:27.097367+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:15:27.097367+0000","last_undegraded":"2026-02-20T03:15:27.097367+0000","last_fullsized":"2026-02-20T03:15:27.097367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:28.393348+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:28.393348+0000","last_peered":"2026-02-20T03:15:28.393348+0000","last_clean":"2026-02-20T03:15:28.393348+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:28.393348+0000","last_undegraded":"2026-02-20T03:15:28.393348+0000","last_fullsized":"2026-02-20T03:15:28.393348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092155+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:15:27.092155+0000","last_peered":"2026-02-20T03:15:27.092155+0000","last_clean":"2026-02-20T03:15:27.092155+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:15:27.092155+0000","last_undegraded":"2026-02-20T03:15:27.092155+0000","last_fullsized":"2026-02-20T03:15:27.092155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097787+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:15:27.097787+0000","last_peered":"2026-02-20T03:15:27.097787+0000","last_clean":"2026-02-20T03:15:27.097787+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:15:27.097787+0000","last_undegraded":"2026-02-20T03:15:27.097787+0000","last_fullsized":"2026-02-20T03:15:27.097787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093616+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:15:27.093616+0000","last_peered":"2026-02-20T03:15:27.093616+0000","last_clean":"2026-02-20T03:15:27.093616+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:15:27.093616+0000","last_undegraded":"2026-02-20T03:15:27.093616+0000","last_fullsized":"2026-02-20T03:15:27.093616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093604+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:15:27.093604+0000","last_peered":"2026-02-20T03:15:27.093604+0000","last_clean":"2026-02-20T03:15:27.093604+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:15:27.093604+0000","last_undegraded":"2026-02-20T03:15:27.093604+0000","last_fullsized":"2026-02-20T03:15:27.093604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089674+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:15:27.089674+0000","last_peered":"2026-02-20T03:15:27.089674+0000","last_clean":"2026-02-20T03:15:27.089674+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:15:27.089674+0000","last_undegraded":"2026-02-20T03:15:27.089674+0000","last_fullsized":"2026-02-20T03:15:27.089674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092119+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:27.092119+0000","last_peered":"2026-02-20T03:15:27.092119+0000","last_clean":"2026-02-20T03:15:27.092119+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:27.092119+0000","last_undegraded":"2026-02-20T03:15:27.092119+0000","last_fullsized":"2026-02-20T03:15:27.092119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093756+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:15:27.093756+0000","last_peered":"2026-02-20T03:15:27.093756+0000","last_clean":"2026-02-20T03:15:27.093756+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:15:27.093756+0000","last_undegraded":"2026-02-20T03:15:27.093756+0000","last_fullsized":"2026-02-20T03:15:27.093756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096216+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:15:27.096216+0000","last_peered":"2026-02-20T03:15:27.096216+0000","last_clean":"2026-02-20T03:15:27.096216+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:15:27.096216+0000","last_undegraded":"2026-02-20T03:15:27.096216+0000","last_fullsized":"2026-02-20T03:15:27.096216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:29.396148+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:29.396148+0000","last_peered":"2026-02-20T03:15:29.396148+0000","last_clean":"2026-02-20T03:15:29.396148+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:29.396148+0000","last_undegraded":"2026-02-20T03:15:29.396148+0000","last_fullsized":"2026-02-20T03:15:29.396148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73733,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":87,"num_read_kb":116,"num_write":35,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091741+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:15:27.091741+0000","last_peered":"2026-02-20T03:15:27.091741+0000","last_clean":"2026-02-20T03:15:27.091741+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:15:27.091741+0000","last_undegraded":"2026-02-20T03:15:27.091741+0000","last_fullsized":"2026-02-20T03:15:27.091741+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100059+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:27.100059+0000","last_peered":"2026-02-20T03:15:27.100059+0000","last_clean":"2026-02-20T03:15:27.100059+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:27.100059+0000","last_undegraded":"2026-02-20T03:15:27.100059+0000","last_fullsized":"2026-02-20T03:15:27.100059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094441+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:15:27.094441+0000","last_peered":"2026-02-20T03:15:27.094441+0000","last_clean":"2026-02-20T03:15:27.094441+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:15:27.094441+0000","last_undegraded":"2026-02-20T03:15:27.094441+0000","last_fullsized":"2026-02-20T03:15:27.094441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392567+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:15:27.392567+0000","last_peered":"2026-02-20T03:15:27.392567+0000","last_clean":"2026-02-20T03:15:27.392567+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:15:27.392567+0000","last_undegraded":"2026-02-20T03:15:27.392567+0000","last_fullsized":"2026-02-20T03:15:27.392567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092453+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:27.092453+0000","last_peered":"2026-02-20T03:15:27.092453+0000","last_clean":"2026-02-20T03:15:27.092453+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:27.092453+0000","last_undegraded":"2026-02-20T03:15:27.092453+0000","last_fullsized":"2026-02-20T03:15:27.092453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098009+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:15:27.098009+0000","last_peered":"2026-02-20T03:15:27.098009+0000","last_clean":"2026-02-20T03:15:27.098009+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:15:27.098009+0000","last_undegraded":"2026-02-20T03:15:27.098009+0000","last_fullsized":"2026-02-20T03:15:27.098009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091618+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:15:27.091618+0000","last_peered":"2026-02-20T03:15:27.091618+0000","last_clean":"2026-02-20T03:15:27.091618+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:15:27.091618+0000","last_undegraded":"2026-02-20T03:15:27.091618+0000","last_fullsized":"2026-02-20T03:15:27.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099742+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:27.099742+0000","last_peered":"2026-02-20T03:15:27.099742+0000","last_clean":"2026-02-20T03:15:27.099742+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:27.099742+0000","last_undegraded":"2026-02-20T03:15:27.099742+0000","last_fullsized":"2026-02-20T03:15:27.099742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":69,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:28.388164+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:28.388164+0000","last_peered":"2026-02-20T03:15:28.388164+0000","last_clean":"2026-02-20T03:15:28.388164+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:28.388164+0000","last_undegraded":"2026-02-20T03:15:28.388164+0000","last_fullsized":"2026-02-20T03:15:28.388164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676945+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:15:27.676945+0000","last_peered":"2026-02-20T03:15:27.676945+0000","last_clean":"2026-02-20T03:15:27.676945+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:15:27.676945+0000","last_undegraded":"2026-02-20T03:15:27.676945+0000","last_fullsized":"2026-02-20T03:15:27.676945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091966+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:27.091966+0000","last_peered":"2026-02-20T03:15:27.091966+0000","last_clean":"2026-02-20T03:15:27.091966+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:27.091966+0000","last_undegraded":"2026-02-20T03:15:27.091966+0000","last_fullsized":"2026-02-20T03:15:27.091966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091995+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:15:27.091995+0000","last_peered":"2026-02-20T03:15:27.091995+0000","last_clean":"2026-02-20T03:15:27.091995+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:15:27.091995+0000","last_undegraded":"2026-02-20T03:15:27.091995+0000","last_fullsized":"2026-02-20T03:15:27.091995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094048+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:15:27.094048+0000","last_peered":"2026-02-20T03:15:27.094048+0000","last_clean":"2026-02-20T03:15:27.094048+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:15:27.094048+0000","last_undegraded":"2026-02-20T03:15:27.094048+0000","last_fullsized":"2026-02-20T03:15:27.094048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093983+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:15:27.093983+0000","last_peered":"2026-02-20T03:15:27.093983+0000","last_clean":"2026-02-20T03:15:27.093983+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:15:27.093983+0000","last_undegraded":"2026-02-20T03:15:27.093983+0000","last_fullsized":"2026-02-20T03:15:27.093983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676892+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:15:27.676892+0000","last_peered":"2026-02-20T03:15:27.676892+0000","last_clean":"2026-02-20T03:15:27.676892+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:15:27.676892+0000","last_undegraded":"2026-02-20T03:15:27.676892+0000","last_fullsized":"2026-02-20T03:15:27.676892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089481+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:15:27.089481+0000","last_peered":"2026-02-20T03:15:27.089481+0000","last_clean":"2026-02-20T03:15:27.089481+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:15:27.089481+0000","last_undegraded":"2026-02-20T03:15:27.089481+0000","last_fullsized":"2026-02-20T03:15:27.089481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383994+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:15:27.383994+0000","last_peered":"2026-02-20T03:15:27.383994+0000","last_clean":"2026-02-20T03:15:27.383994+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:15:27.383994+0000","last_undegraded":"2026-02-20T03:15:27.383994+0000","last_fullsized":"2026-02-20T03:15:27.383994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093591+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:15:27.093591+0000","last_peered":"2026-02-20T03:15:27.093591+0000","last_clean":"2026-02-20T03:15:27.093591+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:15:27.093591+0000","last_undegraded":"2026-02-20T03:15:27.093591+0000","last_fullsized":"2026-02-20T03:15:27.093591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092112+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:27.092112+0000","last_peered":"2026-02-20T03:15:27.092112+0000","last_clean":"2026-02-20T03:15:27.092112+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:27.092112+0000","last_undegraded":"2026-02-20T03:15:27.092112+0000","last_fullsized":"2026-02-20T03:15:27.092112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.382264+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:27.382264+0000","last_peered":"2026-02-20T03:15:27.382264+0000","last_clean":"2026-02-20T03:15:27.382264+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:27.382264+0000","last_undegraded":"2026-02-20T03:15:27.382264+0000","last_fullsized":"2026-02-20T03:15:27.382264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":928,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096098+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:15:27.096098+0000","last_peered":"2026-02-20T03:15:27.096098+0000","last_clean":"2026-02-20T03:15:27.096098+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:15:27.096098+0000","last_undegraded":"2026-02-20T03:15:27.096098+0000","last_fullsized":"2026-02-20T03:15:27.096098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092190+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:27.092190+0000","last_peered":"2026-02-20T03:15:27.092190+0000","last_clean":"2026-02-20T03:15:27.092190+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:27.092190+0000","last_undegraded":"2026-02-20T03:15:27.092190+0000","last_fullsized":"2026-02-20T03:15:27.092190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092030+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:27.092030+0000","last_peered":"2026-02-20T03:15:27.092030+0000","last_clean":"2026-02-20T03:15:27.092030+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:27.092030+0000","last_undegraded":"2026-02-20T03:15:27.092030+0000","last_fullsized":"2026-02-20T03:15:27.092030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091880+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:27.091880+0000","last_peered":"2026-02-20T03:15:27.091880+0000","last_clean":"2026-02-20T03:15:27.091880+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:27.091880+0000","last_undegraded":"2026-02-20T03:15:27.091880+0000","last_fullsized":"2026-02-20T03:15:27.091880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092039+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:27.092039+0000","last_peered":"2026-02-20T03:15:27.092039+0000","last_clean":"2026-02-20T03:15:27.092039+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:27.092039+0000","last_undegraded":"2026-02-20T03:15:27.092039+0000","last_fullsized":"2026-02-20T03:15:27.092039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090007+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:15:27.090007+0000","last_peered":"2026-02-20T03:15:27.090007+0000","last_clean":"2026-02-20T03:15:27.090007+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:15:27.090007+0000","last_undegraded":"2026-02-20T03:15:27.090007+0000","last_fullsized":"2026-02-20T03:15:27.090007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096323+0000","last_change":"2026-02-20T03:15:27.096323+0000","last_active":"2026-02-20T03:15:27.096323+0000","last_peered":"2026-02-20T03:15:27.096323+0000","last_clean":"2026-02-20T03:15:27.096323+0000","last_became_active":"2026-02-20T03:15:27.096171+0000","last_became_peered":"2026-02-20T03:15:27.096171+0000","last_unstale":"2026-02-20T03:15:27.096323+0000","last_undegraded":"2026-02-20T03:15:27.096323+0000","last_fullsized":"2026-02-20T03:15:27.096323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:00:54.803500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092769+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:27.092769+0000","last_peered":"2026-02-20T03:15:27.092769+0000","last_clean":"2026-02-20T03:15:27.092769+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:27.092769+0000","last_undegraded":"2026-02-20T03:15:27.092769+0000","last_fullsized":"2026-02-20T03:15:27.092769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677330+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:15:27.677330+0000","last_peered":"2026-02-20T03:15:27.677330+0000","last_clean":"2026-02-20T03:15:27.677330+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:15:27.677330+0000","last_undegraded":"2026-02-20T03:15:27.677330+0000","last_fullsized":"2026-02-20T03:15:27.677330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093789+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:15:27.093789+0000","last_peered":"2026-02-20T03:15:27.093789+0000","last_clean":"2026-02-20T03:15:27.093789+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:15:27.093789+0000","last_undegraded":"2026-02-20T03:15:27.093789+0000","last_fullsized":"2026-02-20T03:15:27.093789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677022+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:15:27.677022+0000","last_peered":"2026-02-20T03:15:27.677022+0000","last_clean":"2026-02-20T03:15:27.677022+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:15:27.677022+0000","last_undegraded":"2026-02-20T03:15:27.677022+0000","last_fullsized":"2026-02-20T03:15:27.677022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099411+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:27.099411+0000","last_peered":"2026-02-20T03:15:27.099411+0000","last_clean":"2026-02-20T03:15:27.099411+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:27.099411+0000","last_undegraded":"2026-02-20T03:15:27.099411+0000","last_fullsized":"2026-02-20T03:15:27.099411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089899+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:15:27.089899+0000","last_peered":"2026-02-20T03:15:27.089899+0000","last_clean":"2026-02-20T03:15:27.089899+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:15:27.089899+0000","last_undegraded":"2026-02-20T03:15:27.089899+0000","last_fullsized":"2026-02-20T03:15:27.089899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093603+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:15:27.093603+0000","last_peered":"2026-02-20T03:15:27.093603+0000","last_clean":"2026-02-20T03:15:27.093603+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:15:27.093603+0000","last_undegraded":"2026-02-20T03:15:27.093603+0000","last_fullsized":"2026-02-20T03:15:27.093603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092566+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:27.092566+0000","last_peered":"2026-02-20T03:15:27.092566+0000","last_clean":"2026-02-20T03:15:27.092566+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:27.092566+0000","last_undegraded":"2026-02-20T03:15:27.092566+0000","last_fullsized":"2026-02-20T03:15:27.092566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092017+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:15:27.092017+0000","last_peered":"2026-02-20T03:15:27.092017+0000","last_clean":"2026-02-20T03:15:27.092017+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:15:27.092017+0000","last_undegraded":"2026-02-20T03:15:27.092017+0000","last_fullsized":"2026-02-20T03:15:27.092017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094334+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:15:27.094334+0000","last_peered":"2026-02-20T03:15:27.094334+0000","last_clean":"2026-02-20T03:15:27.094334+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:15:27.094334+0000","last_undegraded":"2026-02-20T03:15:27.094334+0000","last_fullsized":"2026-02-20T03:15:27.094334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098981+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:27.098981+0000","last_peered":"2026-02-20T03:15:27.098981+0000","last_clean":"2026-02-20T03:15:27.098981+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:27.098981+0000","last_undegraded":"2026-02-20T03:15:27.098981+0000","last_fullsized":"2026-02-20T03:15:27.098981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091896+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:27.091896+0000","last_peered":"2026-02-20T03:15:27.091896+0000","last_clean":"2026-02-20T03:15:27.091896+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:27.091896+0000","last_undegraded":"2026-02-20T03:15:27.091896+0000","last_fullsized":"2026-02-20T03:15:27.091896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091504+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:27.091504+0000","last_peered":"2026-02-20T03:15:27.091504+0000","last_clean":"2026-02-20T03:15:27.091504+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:27.091504+0000","last_undegraded":"2026-02-20T03:15:27.091504+0000","last_fullsized":"2026-02-20T03:15:27.091504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089821+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:15:27.089821+0000","last_peered":"2026-02-20T03:15:27.089821+0000","last_clean":"2026-02-20T03:15:27.089821+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:15:27.089821+0000","last_undegraded":"2026-02-20T03:15:27.089821+0000","last_fullsized":"2026-02-20T03:15:27.089821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392752+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:15:27.392752+0000","last_peered":"2026-02-20T03:15:27.392752+0000","last_clean":"2026-02-20T03:15:27.392752+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:15:27.392752+0000","last_undegraded":"2026-02-20T03:15:27.392752+0000","last_fullsized":"2026-02-20T03:15:27.392752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098066+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:15:27.098066+0000","last_peered":"2026-02-20T03:15:27.098066+0000","last_clean":"2026-02-20T03:15:27.098066+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:15:27.098066+0000","last_undegraded":"2026-02-20T03:15:27.098066+0000","last_fullsized":"2026-02-20T03:15:27.098066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384200+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:15:27.384200+0000","last_peered":"2026-02-20T03:15:27.384200+0000","last_clean":"2026-02-20T03:15:27.384200+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:15:27.384200+0000","last_undegraded":"2026-02-20T03:15:27.384200+0000","last_fullsized":"2026-02-20T03:15:27.384200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.101465+0000","last_change":"2026-02-20T03:15:27.101465+0000","last_active":"2026-02-20T03:15:27.101465+0000","last_peered":"2026-02-20T03:15:27.101465+0000","last_clean":"2026-02-20T03:15:27.101465+0000","last_became_active":"2026-02-20T03:15:27.101042+0000","last_became_peered":"2026-02-20T03:15:27.101042+0000","last_unstale":"2026-02-20T03:15:27.101465+0000","last_undegraded":"2026-02-20T03:15:27.101465+0000","last_fullsized":"2026-02-20T03:15:27.101465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:16:15.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676902+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:15:27.676902+0000","last_peered":"2026-02-20T03:15:27.676902+0000","last_clean":"2026-02-20T03:15:27.676902+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:15:27.676902+0000","last_undegraded":"2026-02-20T03:15:27.676902+0000","last_fullsized":"2026-02-20T03:15:27.676902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097349+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:15:27.097349+0000","last_peered":"2026-02-20T03:15:27.097349+0000","last_clean":"2026-02-20T03:15:27.097349+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:15:27.097349+0000","last_undegraded":"2026-02-20T03:15:27.097349+0000","last_fullsized":"2026-02-20T03:15:27.097349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383987+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:15:27.383987+0000","last_peered":"2026-02-20T03:15:27.383987+0000","last_clean":"2026-02-20T03:15:27.383987+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:15:27.383987+0000","last_undegraded":"2026-02-20T03:15:27.383987+0000","last_fullsized":"2026-02-20T03:15:27.383987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392687+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:15:27.392687+0000","last_peered":"2026-02-20T03:15:27.392687+0000","last_clean":"2026-02-20T03:15:27.392687+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:15:27.392687+0000","last_undegraded":"2026-02-20T03:15:27.392687+0000","last_fullsized":"2026-02-20T03:15:27.392687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091837+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:27.091837+0000","last_peered":"2026-02-20T03:15:27.091837+0000","last_clean":"2026-02-20T03:15:27.091837+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:27.091837+0000","last_undegraded":"2026-02-20T03:15:27.091837+0000","last_fullsized":"2026-02-20T03:15:27.091837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091994+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:27.091994+0000","last_peered":"2026-02-20T03:15:27.091994+0000","last_clean":"2026-02-20T03:15:27.091994+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:27.091994+0000","last_undegraded":"2026-02-20T03:15:27.091994+0000","last_fullsized":"2026-02-20T03:15:27.091994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094313+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:15:27.094313+0000","last_peered":"2026-02-20T03:15:27.094313+0000","last_clean":"2026-02-20T03:15:27.094313+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:15:27.094313+0000","last_undegraded":"2026-02-20T03:15:27.094313+0000","last_fullsized":"2026-02-20T03:15:27.094313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78071,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":259,"num_read_kb":213,"num_write":168,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":234213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383697,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32140,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971060,"statfs":{"total":751619276800,"available":751586365440,"internally_reserved":0,"allocated":1032192,"data_stored":502911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32820,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970380,"statfs":{"total":751619276800,"available":751585669120,"internally_reserved":0,"allocated":1728512,"data_stored":1164282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776149,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":507221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037784,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32144,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971056,"statfs":{"total":751619276800,"available":751586361344,"internally_reserved":0,"allocated":1036288,"data_stored":502431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299418,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32732,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970468,"statfs":{"total":751619276800,"available":751585759232,"internally_reserved":0,"allocated":1638400,"data_stored":1099261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1024000,"data_stored":498291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28576,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974624,"statfs":{"total":751619276800,"available":751590014976,"internally_reserved":0,"allocated":1646592,"data_stored":1094457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888096,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32148,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971052,"statfs":{"total":751619276800,"available":751586357248,"internally_reserved":0,"allocated":1040384,"data_stored":503925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149730,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27980,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975220,"statfs":{"total":751619276800,"available":751590625280,"internally_reserved":0,"allocated":1036288,"data_stored":498485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378661,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":1122304,"data_stored":573008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28044,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975156,"statfs":{"total":751619276800,"available":751590559744,"internally_reserved":0,"allocated":1105920,"data_stored":572526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":499699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":74807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":75713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:36.021 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:36.319 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 -- 10.20.193.28:0/3865455961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb89010eef0 msgr2=0x7fb89010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 --2- 10.20.193.28:0/3865455961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb89010eef0 0x7fb89010f2d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb880009a30 tx=0x7fb88002f220 comp rx=0 tx=0).stop 2026-02-20T03:15:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 -- 10.20.193.28:0/3865455961 shutdown_connections 2026-02-20T03:15:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 --2- 10.20.193.28:0/3865455961 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb890109ba0 0x7fb890115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 --2- 10.20.193.28:0/3865455961 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb890109220 0x7fb890109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 --2- 10.20.193.28:0/3865455961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb89010eef0 0x7fb89010f2d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 -- 10.20.193.28:0/3865455961 >> 10.20.193.28:0/3865455961 conn(0x7fb890078600 msgr2=0x7fb89007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 -- 10.20.193.28:0/3865455961 shutdown_connections 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 -- 10.20.193.28:0/3865455961 wait complete. 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.498+0000 7fb895d6f640 1 Processor -- start 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb895d6f640 1 -- start start 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb895d6f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb890109220 0x7fb8901a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb895d6f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb890109ba0 0x7fb8901a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb895d6f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb89010eef0 0x7fb8901a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb895d6f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb8901190b0 con 0x7fb890109ba0 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb895d6f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb890118f30 con 0x7fb89010eef0 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb895d6f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb890119230 con 0x7fb890109220 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb887fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb890109ba0 0x7fb8901a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb887fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb890109ba0 0x7fb8901a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56184/0 (socket says 10.20.193.28:56184) 2026-02-20T03:15:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb887fff640 1 -- 10.20.193.28:0/3907766349 learned_addr learned my addr 10.20.193.28:0/3907766349 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb894d6d640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb890109220 0x7fb8901a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb89556e640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb89010eef0 0x7fb8901a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb887fff640 1 -- 10.20.193.28:0/3907766349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb890109220 msgr2=0x7fb8901a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb887fff640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb890109220 0x7fb8901a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb887fff640 1 -- 10.20.193.28:0/3907766349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb89010eef0 msgr2=0x7fb8901a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb887fff640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb89010eef0 0x7fb8901a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.499+0000 7fb887fff640 1 -- 10.20.193.28:0/3907766349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8901a65c0 con 0x7fb890109ba0 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.500+0000 7fb887fff640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb890109ba0 0x7fb8901a1ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb87800ea10 tx=0x7fb87800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.500+0000 7fb885ffb640 1 -- 10.20.193.28:0/3907766349 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87800ce50 con 0x7fb890109ba0 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.500+0000 7fb885ffb640 1 -- 10.20.193.28:0/3907766349 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb878004570 con 0x7fb890109ba0 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.500+0000 7fb895d6f640 1 -- 10.20.193.28:0/3907766349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8901a68b0 con 0x7fb890109ba0 2026-02-20T03:15:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.500+0000 7fb885ffb640 1 -- 10.20.193.28:0/3907766349 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb878010690 con 0x7fb890109ba0 2026-02-20T03:15:36.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.500+0000 7fb895d6f640 1 -- 10.20.193.28:0/3907766349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8901ae0f0 con 0x7fb890109ba0 2026-02-20T03:15:36.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.501+0000 7fb85f7fe640 1 -- 10.20.193.28:0/3907766349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb89010a580 con 0x7fb890109ba0 2026-02-20T03:15:36.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.503+0000 7fb885ffb640 1 -- 10.20.193.28:0/3907766349 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fb878020030 con 0x7fb890109ba0 2026-02-20T03:15:36.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.504+0000 7fb885ffb640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb86c0b1050 0x7fb86c0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:36.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.505+0000 7fb885ffb640 1 -- 10.20.193.28:0/3907766349 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fb8780e0fc0 con 0x7fb890109ba0 2026-02-20T03:15:36.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.505+0000 7fb894d6d640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb86c0b1050 0x7fb86c0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:36.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.505+0000 7fb885ffb640 1 -- 10.20.193.28:0/3907766349 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb8780e1440 con 0x7fb890109ba0 2026-02-20T03:15:36.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.505+0000 7fb894d6d640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb86c0b1050 0x7fb86c0b3510 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb880002410 tx=0x7fb88003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:36.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.612+0000 7fb85f7fe640 1 -- 10.20.193.28:0/3907766349 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb890109660 con 0x7fb890109ba0 2026-02-20T03:15:36.616 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:36.616 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":23,"btime":"2026-02-20T03:15:33:102690+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":23,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:32.375773+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:15:36.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.612+0000 7fb885ffb640 1 -- 10.20.193.28:0/3907766349 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11922 (secure 0 0 0) 0x7fb8780a9330 con 0x7fb890109ba0 2026-02-20T03:15:36.617 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 23 2026-02-20T03:15:36.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 -- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb86c0b1050 msgr2=0x7fb86c0b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:36.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb86c0b1050 0x7fb86c0b3510 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb880002410 tx=0x7fb88003a040 comp rx=0 tx=0).stop 2026-02-20T03:15:36.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 -- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb890109ba0 msgr2=0x7fb8901a1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:36.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb890109ba0 0x7fb8901a1ab0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb87800ea10 tx=0x7fb87800eee0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 -- 10.20.193.28:0/3907766349 shutdown_connections 2026-02-20T03:15:36.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb86c0b1050 0x7fb86c0b3510 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb89010eef0 0x7fb8901a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb890109ba0 0x7fb8901a1ab0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 --2- 10.20.193.28:0/3907766349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb890109220 0x7fb8901a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:36.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 -- 10.20.193.28:0/3907766349 >> 10.20.193.28:0/3907766349 conn(0x7fb890078600 msgr2=0x7fb890079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:36.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 -- 10.20.193.28:0/3907766349 shutdown_connections 2026-02-20T03:15:36.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:36.614+0000 7fb85f7fe640 1 -- 10.20.193.28:0/3907766349 wait complete. 2026-02-20T03:15:36.716 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:15:36.987 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:37.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.176+0000 7f2219758640 1 -- 10.20.193.28:0/1536887542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 msgr2=0x7f2214109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.176+0000 7f2219758640 1 --2- 10.20.193.28:0/1536887542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 0x7f2214109660 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2204009960 tx=0x7f220402f140 comp rx=0 tx=0).stop 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.176+0000 7f2219758640 1 -- 10.20.193.28:0/1536887542 shutdown_connections 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.176+0000 7f2219758640 1 --2- 10.20.193.28:0/1536887542 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2214109ba0 0x7f2214115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.176+0000 7f2219758640 1 --2- 10.20.193.28:0/1536887542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 0x7f2214109660 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.176+0000 7f2219758640 1 --2- 10.20.193.28:0/1536887542 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f221410eef0 0x7f221410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.176+0000 7f2219758640 1 -- 10.20.193.28:0/1536887542 >> 10.20.193.28:0/1536887542 conn(0x7f2214078600 msgr2=0x7f221407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.176+0000 7f2219758640 1 -- 10.20.193.28:0/1536887542 shutdown_connections 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.176+0000 7f2219758640 1 -- 10.20.193.28:0/1536887542 wait complete. 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.177+0000 7f2219758640 1 Processor -- start 2026-02-20T03:15:37.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.177+0000 7f2219758640 1 -- start start 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.177+0000 7f2219758640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 0x7f22141a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.177+0000 7f2219758640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2214109ba0 0x7f22141a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.177+0000 7f2219758640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f221410eef0 0x7f22141a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.177+0000 7f2219758640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2214119070 con 0x7f2214109220 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.177+0000 7f2219758640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2214118ef0 con 0x7f2214109ba0 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.177+0000 7f2219758640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22141191f0 con 0x7f221410eef0 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2213fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 0x7f22141a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2213fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 0x7f22141a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56204/0 (socket says 10.20.193.28:56204) 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2213fff640 1 -- 10.20.193.28:0/1802237038 learned_addr learned my addr 10.20.193.28:0/1802237038 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2218f57640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f221410eef0 0x7f22141a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f22137fe640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2214109ba0 0x7f22141a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2213fff640 1 -- 10.20.193.28:0/1802237038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f221410eef0 msgr2=0x7f22141a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2213fff640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f221410eef0 0x7f22141a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2213fff640 1 -- 10.20.193.28:0/1802237038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2214109ba0 msgr2=0x7f22141a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2213fff640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2214109ba0 0x7f22141a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2213fff640 1 -- 10.20.193.28:0/1802237038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22141a6550 con 0x7f2214109220 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2218f57640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f221410eef0 0x7f22141a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f2213fff640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 0x7f22141a1500 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f220000ea10 tx=0x7f220000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f22117fa640 1 -- 10.20.193.28:0/1802237038 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220000ce50 con 0x7f2214109220 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f22117fa640 1 -- 10.20.193.28:0/1802237038 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2200004570 con 0x7f2214109220 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.178+0000 7f22117fa640 1 -- 10.20.193.28:0/1802237038 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200010690 con 0x7f2214109220 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.179+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22141a6840 con 0x7f2214109220 2026-02-20T03:15:37.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.179+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22141ae080 con 0x7f2214109220 2026-02-20T03:15:37.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.179+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221410a580 con 0x7f2214109220 2026-02-20T03:15:37.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.181+0000 7f22117fa640 1 -- 10.20.193.28:0/1802237038 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f2200020030 con 0x7f2214109220 2026-02-20T03:15:37.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.183+0000 7f22117fa640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21e80b1050 0x7f21e80b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.183+0000 7f22117fa640 1 -- 10.20.193.28:0/1802237038 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f22000e0f40 con 0x7f2214109220 2026-02-20T03:15:37.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.183+0000 7f22137fe640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21e80b1050 0x7f21e80b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.183+0000 7f22117fa640 1 -- 10.20.193.28:0/1802237038 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f2200055b20 con 0x7f2214109220 2026-02-20T03:15:37.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.184+0000 7f22137fe640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21e80b1050 0x7f21e80b3510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f22040096f0 tx=0x7f220403a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.276+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2214109660 con 0x7f2214109220 2026-02-20T03:15:37.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.277+0000 7f22117fa640 1 -- 10.20.193.28:0/1802237038 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24707 (secure 0 0 0) 0x7f22000a92b0 con 0x7f2214109220 2026-02-20T03:15:37.280 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:37.281 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":91,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:15:27.086854+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7},{"from":3,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21e80b1050 msgr2=0x7f21e80b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21e80b1050 0x7f21e80b3510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f22040096f0 tx=0x7f220403a040 comp rx=0 tx=0).stop 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 msgr2=0x7f22141a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 0x7f22141a1500 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f220000ea10 tx=0x7f220000eee0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 shutdown_connections 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21e80b1050 0x7f21e80b3510 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f221410eef0 0x7f22141a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2214109ba0 0x7f22141a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 --2- 10.20.193.28:0/1802237038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2214109220 0x7f22141a1500 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 >> 10.20.193.28:0/1802237038 conn(0x7f2214078600 msgr2=0x7f2214079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 shutdown_connections 2026-02-20T03:15:37.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.278+0000 7f2219758640 1 -- 10.20.193.28:0/1802237038 wait complete. 2026-02-20T03:15:37.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:37 trial028 ceph-mon[38552]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:37.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:37 trial028 ceph-mon[38552]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:37.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:37 trial028 ceph-mon[38552]: pgmap v206: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 121 B/s, 0 objects/s recovering 2026-02-20T03:15:37.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:37 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3907766349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:37.383 DEBUG:tasks.fwd_scrub:Yielding 2026-02-20T03:15:37.384 INFO:teuthology.run_tasks:Running task background_exec... 2026-02-20T03:15:37.407 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@trial028.front.sepia.ceph.com 2026-02-20T03:15:37.407 DEBUG:teuthology.orchestra.run.trial028:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2026-02-20T03:15:37.408 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2026-02-20T03:15:37.408 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:15:37.408 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:15:37.412 INFO:teuthology.run_tasks:Running task quiescer... 2026-02-20T03:15:37.439 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-20T03:15:37.439 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T03:15:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:37 trial177 ceph-mon[43181]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:37 trial177 ceph-mon[43181]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:37 trial177 ceph-mon[43181]: pgmap v206: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 121 B/s, 0 objects/s recovering 2026-02-20T03:15:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:37 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3907766349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:37.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:37 trial126 ceph-mon[38476]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:37.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:37 trial126 ceph-mon[38476]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:37.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:37 trial126 ceph-mon[38476]: pgmap v206: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 121 B/s, 0 objects/s recovering 2026-02-20T03:15:37.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:37 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3907766349' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:37.683 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:37.707 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:37.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.868+0000 7f9753577640 1 -- 10.20.193.28:0/1651665672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f975410f040 msgr2=0x7f9754111430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.868+0000 7f9753577640 1 --2- 10.20.193.28:0/1651665672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f975410f040 0x7f9754111430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f974400b0a0 tx=0x7f9744037eb0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.869+0000 7f9753577640 1 -- 10.20.193.28:0/1651665672 shutdown_connections 2026-02-20T03:15:37.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.869+0000 7f9753577640 1 --2- 10.20.193.28:0/1651665672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f975410f040 0x7f9754111430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.869+0000 7f9753577640 1 --2- 10.20.193.28:0/1651665672 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9754075d30 0x7f975410eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.869+0000 7f9753577640 1 --2- 10.20.193.28:0/1651665672 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9754075410 0x7f97540757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.869+0000 7f9753577640 1 -- 10.20.193.28:0/1651665672 >> 10.20.193.28:0/1651665672 conn(0x7f97540fe440 msgr2=0x7f9754100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.869+0000 7f9753577640 1 -- 10.20.193.28:0/1651665672 shutdown_connections 2026-02-20T03:15:37.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.869+0000 7f9753577640 1 -- 10.20.193.28:0/1651665672 wait complete. 2026-02-20T03:15:37.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.869+0000 7f9753577640 1 Processor -- start 2026-02-20T03:15:37.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9753577640 1 -- start start 2026-02-20T03:15:37.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9753577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9754075410 0x7f9754199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9753577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9754075d30 0x7f9754199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9753577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f975410f040 0x7f975419d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9753577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9754104d90 con 0x7f975410f040 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9753577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9754104c10 con 0x7f9754075410 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9753577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9754104f10 con 0x7f9754075d30 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9752575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9754075410 0x7f9754199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9752d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f975410f040 0x7f975419d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9752575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9754075410 0x7f9754199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59800/0 (socket says 10.20.193.28:59800) 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9752575640 1 -- 10.20.193.28:0/1967001056 learned_addr learned my addr 10.20.193.28:0/1967001056 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.870+0000 7f9751d74640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9754075d30 0x7f9754199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.871+0000 7f9752d76640 1 -- 10.20.193.28:0/1967001056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9754075d30 msgr2=0x7f9754199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.871+0000 7f9752d76640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9754075d30 0x7f9754199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.871+0000 7f9752d76640 1 -- 10.20.193.28:0/1967001056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9754075410 msgr2=0x7f9754199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.871+0000 7f9752d76640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9754075410 0x7f9754199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.871+0000 7f9752d76640 1 -- 10.20.193.28:0/1967001056 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975419db20 con 0x7f975410f040 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.871+0000 7f9752d76640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f975410f040 0x7f975419d3a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f974400b0a0 tx=0x7f9744009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.871+0000 7f973b7fe640 1 -- 10.20.193.28:0/1967001056 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744038be0 con 0x7f975410f040 2026-02-20T03:15:37.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.871+0000 7f9753577640 1 -- 10.20.193.28:0/1967001056 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975419ddb0 con 0x7f975410f040 2026-02-20T03:15:37.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.871+0000 7f9753577640 1 -- 10.20.193.28:0/1967001056 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97541a5650 con 0x7f975410f040 2026-02-20T03:15:37.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.872+0000 7f973b7fe640 1 -- 10.20.193.28:0/1967001056 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9744004510 con 0x7f975410f040 2026-02-20T03:15:37.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.872+0000 7f973b7fe640 1 -- 10.20.193.28:0/1967001056 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744007920 con 0x7f975410f040 2026-02-20T03:15:37.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.873+0000 7fd24ffff640 1 -- 10.20.193.28:0/2793174615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd25010eef0 msgr2=0x7fd25010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.873+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2793174615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd25010eef0 0x7fd25010f2d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd244009a30 tx=0x7fd24402f220 comp rx=0 tx=0).stop 2026-02-20T03:15:37.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.873+0000 7fd24ffff640 1 -- 10.20.193.28:0/2793174615 shutdown_connections 2026-02-20T03:15:37.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.873+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2793174615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd250109ba0 0x7fd250115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.873+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2793174615 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd250109220 0x7fd250109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.873+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2793174615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd25010eef0 0x7fd25010f2d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.873+0000 7fd24ffff640 1 -- 10.20.193.28:0/2793174615 >> 10.20.193.28:0/2793174615 conn(0x7fd250078600 msgr2=0x7fd25007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.874+0000 7fd24ffff640 1 -- 10.20.193.28:0/2793174615 shutdown_connections 2026-02-20T03:15:37.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.874+0000 7fd24ffff640 1 -- 10.20.193.28:0/2793174615 wait complete. 2026-02-20T03:15:37.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.874+0000 7fd24ffff640 1 Processor -- start 2026-02-20T03:15:37.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.875+0000 7fd24ffff640 1 -- start start 2026-02-20T03:15:37.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.875+0000 7fd24ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd250109220 0x7fd250083840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.875+0000 7fd24ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd250109ba0 0x7fd250083d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.875+0000 7fd24ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd25010eef0 0x7fd25007c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7fd24ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2501190f0 con 0x7fd250109ba0 2026-02-20T03:15:37.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7fd24e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd250109ba0 0x7fd250083d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7fd24e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd250109ba0 0x7fd250083d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56216/0 (socket says 10.20.193.28:56216) 2026-02-20T03:15:37.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7fd24e7fc640 1 -- 10.20.193.28:0/2964452907 learned_addr learned my addr 10.20.193.28:0/2964452907 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:37.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd250118f70 con 0x7fd25010eef0 2026-02-20T03:15:37.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd250119270 con 0x7fd250109220 2026-02-20T03:15:37.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7fd24effd640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd250109220 0x7fd250083840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.875+0000 7f973b7fe640 1 -- 10.20.193.28:0/1967001056 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f9744050030 con 0x7f975410f040 2026-02-20T03:15:37.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7f975afe2e00 1 Processor -- start 2026-02-20T03:15:37.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7f975afe2e00 1 -- start start 2026-02-20T03:15:37.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdcb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcba70 0x55950bdcf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcfb60 0x55950bdcffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7f975afe2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55950bd1dc00 con 0x55950bdcb0c0 2026-02-20T03:15:37.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7f975afe2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55950bccb3c0 con 0x55950bdcba70 2026-02-20T03:15:37.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7f975afe2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55950bd19b30 con 0x55950bdcfb60 2026-02-20T03:15:37.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7fd24f7fe640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd25010eef0 0x7fd25007c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.876+0000 7fd24e7fc640 1 -- 10.20.193.28:0/2964452907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd250109220 msgr2=0x7fd250083840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7fd24e7fc640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd250109220 0x7fd250083840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcfb60 0x55950bdcffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdcb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdcb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56222/0 (socket says 10.20.193.28:56222) 2026-02-20T03:15:37.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 -- 10.20.193.28:0/1575724656 learned_addr learned my addr 10.20.193.28:0/1575724656 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:37.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9752575640 1 --2- 10.20.193.28:0/1575724656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcba70 0x55950bdcf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 -- 10.20.193.28:0/1575724656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcfb60 msgr2=0x55950bdcffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:37.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 --2- 10.20.193.28:0/1575724656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcfb60 0x55950bdcffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 -- 10.20.193.28:0/1575724656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcba70 msgr2=0x55950bdcf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:37.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 --2- 10.20.193.28:0/1575724656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcba70 0x55950bdcf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 -- 10.20.193.28:0/1575724656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950bcc4840 con 0x55950bdcb0c0 2026-02-20T03:15:37.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f973b7fe640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f972c0b0eb0 0x7f972c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7fd24e7fc640 1 -- 10.20.193.28:0/2964452907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd25010eef0 msgr2=0x7fd25007c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7fd24e7fc640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd25010eef0 0x7fd25007c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f9751d74640 1 --2- 10.20.193.28:0/1575724656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdcb4a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f973c0046f0 tx=0x7f973c009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20094d0c054bb31 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7fd24e7fc640 1 -- 10.20.193.28:0/2964452907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25007d2b0 con 0x7fd250109ba0 2026-02-20T03:15:37.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7f973b7fe640 1 -- 10.20.193.28:0/1967001056 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f974410d300 con 0x7f975410f040 2026-02-20T03:15:37.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f9752575640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f972c0b0eb0 0x7f972c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f9738cf3640 1 -- 10.20.193.28:0/1575724656 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c010660 con 0x55950bdcb0c0 2026-02-20T03:15:37.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f9738cf3640 1 -- 10.20.193.28:0/1575724656 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f973c010ca0 con 0x55950bdcb0c0 2026-02-20T03:15:37.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f9738cf3640 1 -- 10.20.193.28:0/1575724656 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c012de0 con 0x55950bdcb0c0 2026-02-20T03:15:37.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.877+0000 7fd24effd640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd250109220 0x7fd250083840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:37.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f975afe2e00 1 -- 10.20.193.28:0/1575724656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 msgr2=0x55950bdcb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1575724656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdcb4a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f973c0046f0 tx=0x7f973c009290 comp rx=0 tx=0).stop 2026-02-20T03:15:37.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7fd24e7fc640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd250109ba0 0x7fd250083d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd23800b780 tx=0x7fd23800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7fd22ffff640 1 -- 10.20.193.28:0/2964452907 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238004480 con 0x7fd250109ba0 2026-02-20T03:15:37.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25007d5a0 con 0x7fd250109ba0 2026-02-20T03:15:37.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f975afe2e00 1 -- 10.20.193.28:0/1575724656 shutdown_connections 2026-02-20T03:15:37.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1575724656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcfb60 0x55950bdcffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1575724656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcba70 0x55950bdcf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1575724656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdcb4a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f975afe2e00 1 -- 10.20.193.28:0/1575724656 >> 10.20.193.28:0/1575724656 conn(0x55950bdc3b60 msgr2=0x55950bdc95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7f975afe2e00 1 -- 10.20.193.28:0/1575724656 shutdown_connections 2026-02-20T03:15:37.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.879+0000 7f9752575640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f972c0b0eb0 0x7f972c0b3370 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55950bdcc090 tx=0x7f9748009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.879+0000 7f975afe2e00 1 -- 10.20.193.28:0/1575724656 wait complete. 2026-02-20T03:15:37.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2500815f0 con 0x7fd250109ba0 2026-02-20T03:15:37.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7fd22ffff640 1 -- 10.20.193.28:0/2964452907 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd238010070 con 0x7fd250109ba0 2026-02-20T03:15:37.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.878+0000 7fd22ffff640 1 -- 10.20.193.28:0/2964452907 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23800cae0 con 0x7fd250109ba0 2026-02-20T03:15:37.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f975afe2e00 1 -- start start 2026-02-20T03:15:37.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd25010a580 con 0x7fd250109ba0 2026-02-20T03:15:37.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f975afe2e00 1 Processor -- start 2026-02-20T03:15:37.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdf6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 0x55950bdf6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950bdf4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f975afe2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55950bcc51a0 con 0x55950bdcb0c0 2026-02-20T03:15:37.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f975afe2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55950bde9180 con 0x55950bdcfb60 2026-02-20T03:15:37.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f975afe2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55950bdf56c0 con 0x55950bdcba70 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f9752575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdf6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f9752575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdf6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56224/0 (socket says 10.20.193.28:56224) 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.880+0000 7f9752575640 1 -- 10.20.193.28:0/3933083400 learned_addr learned my addr 10.20.193.28:0/3933083400 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9752d76640 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950bdf4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9751d74640 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 0x55950bdf6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9752575640 1 -- 10.20.193.28:0/3933083400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 msgr2=0x55950bdf6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9752575640 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 0x55950bdf6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9752575640 1 -- 10.20.193.28:0/3933083400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 msgr2=0x55950bdf4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9752575640 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950bdf4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9752575640 1 -- 10.20.193.28:0/3933083400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950bdee960 con 0x55950bdcb0c0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9752d76640 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950bdf4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9752575640 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdf6800 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9748005e80 tx=0x7f9748004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5aff7d150b142bd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9703fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9703fff640 1 -- 10.20.193.28:0/3933083400 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748011e10 con 0x55950bdcb0c0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9703fff640 1 -- 10.20.193.28:0/3933083400 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f974801edb0 con 0x55950bdcb0c0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f9703fff640 1 -- 10.20.193.28:0/3933083400 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974801cbe0 con 0x55950bdcb0c0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.881+0000 7f975afe2e00 1 -- 10.20.193.28:0/3933083400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950baecb60 con 0x55950bdcb0c0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.882+0000 7f9703fff640 1 -- 10.20.193.28:0/3933083400 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f974801cd80 con 0x55950bdcb0c0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.882+0000 7f975afe2e00 10 client.15252 _ll_register_callbacks cb 0x55950bcc90d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.882+0000 7f975afe2e00 1 -- 10.20.193.28:0/3933083400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55950bd257f0 con 0x55950bdcb0c0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.882+0000 7f9703fff640 1 -- 10.20.193.28:0/3933083400 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f974801e910 con 0x55950bdcb0c0 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.882+0000 7f975afe2e00 10 client.15252 fetch_fsmap learned FSMap version 23 2026-02-20T03:15:37.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.882+0000 7f975afe2e00 1 -- 10.20.193.28:0/3933083400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55950bcea430 con 0x55950bdcb0c0 2026-02-20T03:15:37.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.882+0000 7fd22ffff640 1 -- 10.20.193.28:0/2964452907 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fd23801d030 con 0x7fd250109ba0 2026-02-20T03:15:37.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.883+0000 7fd22ffff640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2240b0eb0 0x7fd2240b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.884+0000 7fd22ffff640 1 -- 10.20.193.28:0/2964452907 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fd2380df8d0 con 0x7fd250109ba0 2026-02-20T03:15:37.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.884+0000 7fd24effd640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2240b0eb0 0x7fd2240b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.884+0000 7fd24effd640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2240b0eb0 0x7fd2240b3370 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd2440097c0 tx=0x7fd244005830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.884+0000 7fd22ffff640 1 -- 10.20.193.28:0/2964452907 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd2380a7c40 con 0x7fd250109ba0 2026-02-20T03:15:37.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.884+0000 7f9703fff640 1 -- 10.20.193.28:0/3933083400 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 23) ==== 8358+0+0 (secure 0 0 0) 0x7f974801c3f0 con 0x55950bdcb0c0 2026-02-20T03:15:37.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.885+0000 7f975afe2e00 10 client.15252 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.885+0000 7f975afe2e00 10 client.15252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.885+0000 7f975afe2e00 20 client.15252 populate_metadata read hostname 'trial028' 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.885+0000 7f975afe2e00 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55950be05080 0x55950be07540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.885+0000 7f975afe2e00 4 client.15252 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.885+0000 7f975afe2e00 1 -- 10.20.193.28:0/3933083400 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55950bc9fc00 con 0x55950be05080 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.885+0000 7f9751d74640 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55950be05080 0x55950be07540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.886+0000 7f9751d74640 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55950be05080 0x55950be07540 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=114021604d9e5abe server_cookie=9f439c9a22b0c312 in_seq=0 out_seq=0 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.886+0000 7f9703fff640 10 client.15252 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.886+0000 7f9703fff640 1 -- 10.20.193.28:0/3933083400 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55950bc9fc00 con 0x55950be05080 2026-02-20T03:15:37.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.886+0000 7f9703fff640 10 client.15252 handle_command_reply: tid=0 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.886+0000 7f975afe2e00 1 client.15252 shutdown 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 -- 10.20.193.28:0/3933083400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 msgr2=0x55950bdf6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdf6800 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9748005e80 tx=0x7f9748004830 comp rx=0 tx=0).stop 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 -- 10.20.193.28:0/3933083400 shutdown_connections 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55950be05080 0x55950be07540 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950bdf4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 0x55950bdf6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 --2- 10.20.193.28:0/3933083400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcb0c0 0x55950bdf6800 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 -- 10.20.193.28:0/3933083400 >> 10.20.193.28:0/3933083400 conn(0x55950bdc3b60 msgr2=0x55950bdce520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f9703fff640 0 client.15252 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 -- 10.20.193.28:0/3933083400 shutdown_connections 2026-02-20T03:15:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 1 -- 10.20.193.28:0/3933083400 wait complete. 2026-02-20T03:15:37.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.887+0000 7f975afe2e00 20 client.15252 trim_cache size 0 max 16384 2026-02-20T03:15:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.896+0000 7f975afe2e00 1 Processor -- start 2026-02-20T03:15:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f975afe2e00 1 -- start start 2026-02-20T03:15:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcb0c0 0x55950be0ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 0x55950be0d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcfb60 0x55950bdfc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f975afe2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f96f80122e0 con 0x55950bdcfb60 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f975afe2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f96f800fbb0 con 0x55950bdcb0c0 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f975afe2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96f800da00 con 0x55950bdcba70 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f9751d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 0x55950be0d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f9752575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcb0c0 0x55950be0ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f9752575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcb0c0 0x55950be0ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59858/0 (socket says 10.20.193.28:59858) 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.897+0000 7f9752575640 1 -- 10.20.193.28:0/2931912632 learned_addr learned my addr 10.20.193.28:0/2931912632 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f9751d74640 1 -- 10.20.193.28:0/2931912632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcb0c0 msgr2=0x55950be0ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f9751d74640 1 --2- 10.20.193.28:0/2931912632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcb0c0 0x55950be0ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f9751d74640 1 -- 10.20.193.28:0/2931912632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcfb60 msgr2=0x55950bdfc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f9751d74640 1 --2- 10.20.193.28:0/2931912632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcfb60 0x55950bdfc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f9751d74640 1 -- 10.20.193.28:0/2931912632 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950bdee790 con 0x55950bdcba70 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f9752575640 1 --2- 10.20.193.28:0/2931912632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcb0c0 0x55950be0ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f9751d74640 1 --2- 10.20.193.28:0/2931912632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 0x55950be0d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55950bdf63c0 tx=0x7f973c009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c487bbcc446e0e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f971e4e6640 1 -- 10.20.193.28:0/2931912632 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c0094e0 con 0x55950bdcba70 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f971e4e6640 1 -- 10.20.193.28:0/2931912632 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f973c010e50 con 0x55950bdcba70 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f971e4e6640 1 -- 10.20.193.28:0/2931912632 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c010770 con 0x55950bdcba70 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f975afe2e00 1 -- 10.20.193.28:0/2931912632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 msgr2=0x55950be0d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f975afe2e00 1 --2- 10.20.193.28:0/2931912632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 0x55950be0d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55950bdf63c0 tx=0x7f973c009290 comp rx=0 tx=0).stop 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f975afe2e00 1 -- 10.20.193.28:0/2931912632 shutdown_connections 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f975afe2e00 1 --2- 10.20.193.28:0/2931912632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcfb60 0x55950bdfc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f975afe2e00 1 --2- 10.20.193.28:0/2931912632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcba70 0x55950be0d390 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f975afe2e00 1 --2- 10.20.193.28:0/2931912632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcb0c0 0x55950be0ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f975afe2e00 1 -- 10.20.193.28:0/2931912632 >> 10.20.193.28:0/2931912632 conn(0x55950bdc3b60 msgr2=0x55950bdcff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.898+0000 7f975afe2e00 1 -- 10.20.193.28:0/2931912632 shutdown_connections 2026-02-20T03:15:37.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.899+0000 7f975afe2e00 1 -- 10.20.193.28:0/2931912632 wait complete. 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.899+0000 7f975afe2e00 1 -- start start 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.899+0000 7f975afe2e00 1 Processor -- start 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcb0c0 0x55950bdfc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcba70 0x55950bdfc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f975afe2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950be694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f975afe2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f96f800e070 con 0x55950bdcba70 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f975afe2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f96f800f4e0 con 0x55950bdcfb60 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f975afe2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96f800e740 con 0x55950bdcb0c0 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950be694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcb0c0 0x55950bdfc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9751d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcba70 0x55950bdfc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950be694b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59870/0 (socket says 10.20.193.28:59870) 2026-02-20T03:15:37.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752d76640 1 -- 10.20.193.28:0/1322781325 learned_addr learned my addr 10.20.193.28:0/1322781325 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752d76640 1 -- 10.20.193.28:0/1322781325 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcb0c0 msgr2=0x55950bdfc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752d76640 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcb0c0 0x55950bdfc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752d76640 1 -- 10.20.193.28:0/1322781325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcba70 msgr2=0x55950bdfc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752d76640 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcba70 0x55950bdfc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752d76640 1 -- 10.20.193.28:0/1322781325 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950b9fc900 con 0x55950bdcfb60 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9752d76640 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950be694b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f974410a940 tx=0x7f974410ad90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4ca0abe85ea5362 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.900+0000 7f9703fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f9703fff640 1 -- 10.20.193.28:0/1322781325 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97440d9320 con 0x55950bdcfb60 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f975afe2e00 1 -- 10.20.193.28:0/1322781325 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950bcd84d0 con 0x55950bdcfb60 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f975afe2e00 10 client.25301 _ll_register_callbacks cb 0x7f97480115a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f975afe2e00 1 -- 10.20.193.28:0/1322781325 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f973c010ca0 con 0x55950bdcfb60 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f9703fff640 1 -- 10.20.193.28:0/1322781325 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f974403c030 con 0x55950bdcfb60 2026-02-20T03:15:37.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f9703fff640 1 -- 10.20.193.28:0/1322781325 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97440d0a10 con 0x55950bdcfb60 2026-02-20T03:15:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f9703fff640 1 -- 10.20.193.28:0/1322781325 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f97440ef470 con 0x55950bdcfb60 2026-02-20T03:15:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f9703fff640 1 -- 10.20.193.28:0/1322781325 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9744007ac0 con 0x55950bdcfb60 2026-02-20T03:15:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f975afe2e00 10 client.25301 fetch_fsmap learned FSMap version 23 2026-02-20T03:15:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f975afe2e00 1 -- 10.20.193.28:0/1322781325 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=23}) -- 0x55950bdef480 con 0x55950bdcfb60 2026-02-20T03:15:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f9703fff640 1 -- 10.20.193.28:0/1322781325 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 23) ==== 8358+0+0 (secure 0 0 0) 0x7f9744048030 con 0x55950bdcfb60 2026-02-20T03:15:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f975afe2e00 10 client.25301 fetch_fsmap finished waiting for FSMap version 23 2026-02-20T03:15:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f975afe2e00 10 client.25301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:15:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f975afe2e00 20 client.25301 populate_metadata read hostname 'trial028' 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.901+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55950be722f0 0x55950be747b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.902+0000 7f975afe2e00 4 client.25301 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.902+0000 7f975afe2e00 1 -- 10.20.193.28:0/1322781325 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55950ba8da20 con 0x55950be722f0 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.902+0000 7f9752575640 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55950be722f0 0x55950be747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.902+0000 7f9752575640 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55950be722f0 0x55950be747b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8849939d0bd0182 server_cookie=9ad3291b4f155ece in_seq=0 out_seq=0 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.902+0000 7f9703fff640 10 client.25301 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.903+0000 7f9703fff640 1 -- 10.20.193.28:0/1322781325 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55950ba8da20 con 0x55950be722f0 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.903+0000 7f9703fff640 10 client.25301 handle_command_reply: tid=0 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.903+0000 7f975afe2e00 1 client.25301 shutdown 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.903+0000 7f975afe2e00 1 -- 10.20.193.28:0/1322781325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 msgr2=0x55950be694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.903+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950be694b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f974410a940 tx=0x7f974410ad90 comp rx=0 tx=0).stop 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f975afe2e00 1 -- 10.20.193.28:0/1322781325 shutdown_connections 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55950be722f0 0x55950be747b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950bdcfb60 0x55950be694b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f9703fff640 0 client.25301 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950bdcba70 0x55950bdfc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f975afe2e00 1 --2- 10.20.193.28:0/1322781325 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950bdcb0c0 0x55950bdfc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f975afe2e00 1 -- 10.20.193.28:0/1322781325 >> 10.20.193.28:0/1322781325 conn(0x55950bdc3b60 msgr2=0x55950bdd0760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f975afe2e00 1 -- 10.20.193.28:0/1322781325 shutdown_connections 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f975afe2e00 1 -- 10.20.193.28:0/1322781325 wait complete. 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f975afe2e00 20 client.25301 trim_cache size 0 max 16384 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "0e03cddc-e767-482b-bf7c-bbb0d71260e0", 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:15:37.911 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f9753577640 1 -- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f972c0b0eb0 msgr2=0x7f972c0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f9753577640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f972c0b0eb0 0x7f972c0b3370 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55950bdcc090 tx=0x7f9748009290 comp rx=0 tx=0).stop 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f9753577640 1 -- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f975410f040 msgr2=0x7f975419d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.904+0000 7f9753577640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f975410f040 0x7f975419d3a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f974400b0a0 tx=0x7f9744009510 comp rx=0 tx=0).stop 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.905+0000 7f9753577640 1 -- 10.20.193.28:0/1967001056 shutdown_connections 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.905+0000 7f9753577640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f972c0b0eb0 0x7f972c0b3370 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.905+0000 7f9753577640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f975410f040 0x7f975419d3a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.905+0000 7f9753577640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9754075d30 0x7f9754199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.905+0000 7f9753577640 1 --2- 10.20.193.28:0/1967001056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9754075410 0x7f9754199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.905+0000 7f9753577640 1 -- 10.20.193.28:0/1967001056 >> 10.20.193.28:0/1967001056 conn(0x7f97540fe440 msgr2=0x7f97540ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.905+0000 7f9753577640 1 -- 10.20.193.28:0/1967001056 shutdown_connections 2026-02-20T03:15:37.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.905+0000 7f9753577640 1 -- 10.20.193.28:0/1967001056 wait complete. 2026-02-20T03:15:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.975+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd2500818d0 con 0x7fd2240b0eb0 2026-02-20T03:15:37.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.981+0000 7fd22ffff640 1 -- 10.20.193.28:0/2964452907 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340408 (secure 0 0 0) 0x7fd2500818d0 con 0x7fd2240b0eb0 2026-02-20T03:15:37.988 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:37.991 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:37.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2240b0eb0 msgr2=0x7fd2240b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2240b0eb0 0x7fd2240b3370 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd2440097c0 tx=0x7fd244005830 comp rx=0 tx=0).stop 2026-02-20T03:15:37.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd250109ba0 msgr2=0x7fd250083d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:37.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd250109ba0 0x7fd250083d80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd23800b780 tx=0x7fd23800bc50 comp rx=0 tx=0).stop 2026-02-20T03:15:37.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 shutdown_connections 2026-02-20T03:15:37.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2240b0eb0 0x7fd2240b3370 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd25010eef0 0x7fd25007c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd250109ba0 0x7fd250083d80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 --2- 10.20.193.28:0/2964452907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd250109220 0x7fd250083840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:37.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 >> 10.20.193.28:0/2964452907 conn(0x7fd250078600 msgr2=0x7fd250079f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:37.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 shutdown_connections 2026-02-20T03:15:37.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:37.984+0000 7fd24ffff640 1 -- 10.20.193.28:0/2964452907 wait complete. 2026-02-20T03:15:38.010 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:15:38.125 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2026-02-20T03:15:36.011451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":676862,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":392,"num_read_kb":323,"num_write":364,"num_write_kb":3859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181942,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":421,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358604,"kb_used_data":14176,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807679796,"statfs":{"total":9019431321600,"available":9019064111104,"internally_reserved":0,"allocated":14516224,"data_stored":8024686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12894,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":7,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.924105"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.389259+0000","last_change":"2026-02-20T03:15:27.389259+0000","last_active":"2026-02-20T03:15:27.389259+0000","last_peered":"2026-02-20T03:15:27.389259+0000","last_clean":"2026-02-20T03:15:27.389259+0000","last_became_active":"2026-02-20T03:15:27.385887+0000","last_became_peered":"2026-02-20T03:15:27.385887+0000","last_unstale":"2026-02-20T03:15:27.389259+0000","last_undegraded":"2026-02-20T03:15:27.389259+0000","last_fullsized":"2026-02-20T03:15:27.389259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:20:01.907763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677322+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:15:27.677322+0000","last_peered":"2026-02-20T03:15:27.677322+0000","last_clean":"2026-02-20T03:15:27.677322+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:15:27.677322+0000","last_undegraded":"2026-02-20T03:15:27.677322+0000","last_fullsized":"2026-02-20T03:15:27.677322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091764+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:27.091764+0000","last_peered":"2026-02-20T03:15:27.091764+0000","last_clean":"2026-02-20T03:15:27.091764+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:27.091764+0000","last_undegraded":"2026-02-20T03:15:27.091764+0000","last_fullsized":"2026-02-20T03:15:27.091764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677381+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:15:27.677381+0000","last_peered":"2026-02-20T03:15:27.677381+0000","last_clean":"2026-02-20T03:15:27.677381+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:15:27.677381+0000","last_undegraded":"2026-02-20T03:15:27.677381+0000","last_fullsized":"2026-02-20T03:15:27.677381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092401+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:27.092401+0000","last_peered":"2026-02-20T03:15:27.092401+0000","last_clean":"2026-02-20T03:15:27.092401+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:27.092401+0000","last_undegraded":"2026-02-20T03:15:27.092401+0000","last_fullsized":"2026-02-20T03:15:27.092401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392166+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:15:27.392166+0000","last_peered":"2026-02-20T03:15:27.392166+0000","last_clean":"2026-02-20T03:15:27.392166+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:15:27.392166+0000","last_undegraded":"2026-02-20T03:15:27.392166+0000","last_fullsized":"2026-02-20T03:15:27.392166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096362+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:15:27.096362+0000","last_peered":"2026-02-20T03:15:27.096362+0000","last_clean":"2026-02-20T03:15:27.096362+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:15:27.096362+0000","last_undegraded":"2026-02-20T03:15:27.096362+0000","last_fullsized":"2026-02-20T03:15:27.096362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100051+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:27.100051+0000","last_peered":"2026-02-20T03:15:27.100051+0000","last_clean":"2026-02-20T03:15:27.100051+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:27.100051+0000","last_undegraded":"2026-02-20T03:15:27.100051+0000","last_fullsized":"2026-02-20T03:15:27.100051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392411+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:15:27.392411+0000","last_peered":"2026-02-20T03:15:27.392411+0000","last_clean":"2026-02-20T03:15:27.392411+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:15:27.392411+0000","last_undegraded":"2026-02-20T03:15:27.392411+0000","last_fullsized":"2026-02-20T03:15:27.392411+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096305+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:15:27.096305+0000","last_peered":"2026-02-20T03:15:27.096305+0000","last_clean":"2026-02-20T03:15:27.096305+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:15:27.096305+0000","last_undegraded":"2026-02-20T03:15:27.096305+0000","last_fullsized":"2026-02-20T03:15:27.096305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096792+0000","last_change":"2026-02-20T03:15:27.096792+0000","last_active":"2026-02-20T03:15:27.096792+0000","last_peered":"2026-02-20T03:15:27.096792+0000","last_clean":"2026-02-20T03:15:27.096792+0000","last_became_active":"2026-02-20T03:15:27.096659+0000","last_became_peered":"2026-02-20T03:15:27.096659+0000","last_unstale":"2026-02-20T03:15:27.096792+0000","last_undegraded":"2026-02-20T03:15:27.096792+0000","last_fullsized":"2026-02-20T03:15:27.096792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:57.312267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392339+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:15:27.392339+0000","last_peered":"2026-02-20T03:15:27.392339+0000","last_clean":"2026-02-20T03:15:27.392339+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:15:27.392339+0000","last_undegraded":"2026-02-20T03:15:27.392339+0000","last_fullsized":"2026-02-20T03:15:27.392339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097517+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:15:27.097517+0000","last_peered":"2026-02-20T03:15:27.097517+0000","last_clean":"2026-02-20T03:15:27.097517+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:15:27.097517+0000","last_undegraded":"2026-02-20T03:15:27.097517+0000","last_fullsized":"2026-02-20T03:15:27.097517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392602+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:15:27.392602+0000","last_peered":"2026-02-20T03:15:27.392602+0000","last_clean":"2026-02-20T03:15:27.392602+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:15:27.392602+0000","last_undegraded":"2026-02-20T03:15:27.392602+0000","last_fullsized":"2026-02-20T03:15:27.392602+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677473+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:15:27.677473+0000","last_peered":"2026-02-20T03:15:27.677473+0000","last_clean":"2026-02-20T03:15:27.677473+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:15:27.677473+0000","last_undegraded":"2026-02-20T03:15:27.677473+0000","last_fullsized":"2026-02-20T03:15:27.677473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091890+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:27.091890+0000","last_peered":"2026-02-20T03:15:27.091890+0000","last_clean":"2026-02-20T03:15:27.091890+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:27.091890+0000","last_undegraded":"2026-02-20T03:15:27.091890+0000","last_fullsized":"2026-02-20T03:15:27.091890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392578+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:15:27.392578+0000","last_peered":"2026-02-20T03:15:27.392578+0000","last_clean":"2026-02-20T03:15:27.392578+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:15:27.392578+0000","last_undegraded":"2026-02-20T03:15:27.392578+0000","last_fullsized":"2026-02-20T03:15:27.392578+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677054+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:15:27.677054+0000","last_peered":"2026-02-20T03:15:27.677054+0000","last_clean":"2026-02-20T03:15:27.677054+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:15:27.677054+0000","last_undegraded":"2026-02-20T03:15:27.677054+0000","last_fullsized":"2026-02-20T03:15:27.677054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092084+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:15:27.092084+0000","last_peered":"2026-02-20T03:15:27.092084+0000","last_clean":"2026-02-20T03:15:27.092084+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:15:27.092084+0000","last_undegraded":"2026-02-20T03:15:27.092084+0000","last_fullsized":"2026-02-20T03:15:27.092084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095913+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:15:27.095913+0000","last_peered":"2026-02-20T03:15:27.095913+0000","last_clean":"2026-02-20T03:15:27.095913+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:15:27.095913+0000","last_undegraded":"2026-02-20T03:15:27.095913+0000","last_fullsized":"2026-02-20T03:15:27.095913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.106320+0000","last_change":"2026-02-20T03:15:27.106320+0000","last_active":"2026-02-20T03:15:27.106320+0000","last_peered":"2026-02-20T03:15:27.106320+0000","last_clean":"2026-02-20T03:15:27.106320+0000","last_became_active":"2026-02-20T03:15:27.101151+0000","last_became_peered":"2026-02-20T03:15:27.101151+0000","last_unstale":"2026-02-20T03:15:27.106320+0000","last_undegraded":"2026-02-20T03:15:27.106320+0000","last_fullsized":"2026-02-20T03:15:27.106320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:56.197115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392629+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:15:27.392629+0000","last_peered":"2026-02-20T03:15:27.392629+0000","last_clean":"2026-02-20T03:15:27.392629+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:15:27.392629+0000","last_undegraded":"2026-02-20T03:15:27.392629+0000","last_fullsized":"2026-02-20T03:15:27.392629+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093728+0000","last_change":"2026-02-20T03:15:27.093728+0000","last_active":"2026-02-20T03:15:27.093728+0000","last_peered":"2026-02-20T03:15:27.093728+0000","last_clean":"2026-02-20T03:15:27.093728+0000","last_became_active":"2026-02-20T03:15:27.093455+0000","last_became_peered":"2026-02-20T03:15:27.093455+0000","last_unstale":"2026-02-20T03:15:27.093728+0000","last_undegraded":"2026-02-20T03:15:27.093728+0000","last_fullsized":"2026-02-20T03:15:27.093728+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:38:26.593708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392844+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:15:27.392844+0000","last_peered":"2026-02-20T03:15:27.392844+0000","last_clean":"2026-02-20T03:15:27.392844+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:15:27.392844+0000","last_undegraded":"2026-02-20T03:15:27.392844+0000","last_fullsized":"2026-02-20T03:15:27.392844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091895+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:27.091895+0000","last_peered":"2026-02-20T03:15:27.091895+0000","last_clean":"2026-02-20T03:15:27.091895+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:27.091895+0000","last_undegraded":"2026-02-20T03:15:27.091895+0000","last_fullsized":"2026-02-20T03:15:27.091895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677369+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:15:27.677369+0000","last_peered":"2026-02-20T03:15:27.677369+0000","last_clean":"2026-02-20T03:15:27.677369+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:15:27.677369+0000","last_undegraded":"2026-02-20T03:15:27.677369+0000","last_fullsized":"2026-02-20T03:15:27.677369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092083+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:27.092083+0000","last_peered":"2026-02-20T03:15:27.092083+0000","last_clean":"2026-02-20T03:15:27.092083+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:27.092083+0000","last_undegraded":"2026-02-20T03:15:27.092083+0000","last_fullsized":"2026-02-20T03:15:27.092083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676826+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:15:27.676826+0000","last_peered":"2026-02-20T03:15:27.676826+0000","last_clean":"2026-02-20T03:15:27.676826+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:15:27.676826+0000","last_undegraded":"2026-02-20T03:15:27.676826+0000","last_fullsized":"2026-02-20T03:15:27.676826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090039+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:15:27.090039+0000","last_peered":"2026-02-20T03:15:27.090039+0000","last_clean":"2026-02-20T03:15:27.090039+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:15:27.090039+0000","last_undegraded":"2026-02-20T03:15:27.090039+0000","last_fullsized":"2026-02-20T03:15:27.090039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099935+0000","last_change":"2026-02-20T03:15:27.099749+0000","last_active":"2026-02-20T03:15:27.099935+0000","last_peered":"2026-02-20T03:15:27.099935+0000","last_clean":"2026-02-20T03:15:27.099935+0000","last_became_active":"2026-02-20T03:15:27.096338+0000","last_became_peered":"2026-02-20T03:15:27.096338+0000","last_unstale":"2026-02-20T03:15:27.099935+0000","last_undegraded":"2026-02-20T03:15:27.099935+0000","last_fullsized":"2026-02-20T03:15:27.099935+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:59:55.738735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093553+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:15:27.093553+0000","last_peered":"2026-02-20T03:15:27.093553+0000","last_clean":"2026-02-20T03:15:27.093553+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:15:27.093553+0000","last_undegraded":"2026-02-20T03:15:27.093553+0000","last_fullsized":"2026-02-20T03:15:27.093553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384089+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:15:27.384089+0000","last_peered":"2026-02-20T03:15:27.384089+0000","last_clean":"2026-02-20T03:15:27.384089+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:15:27.384089+0000","last_undegraded":"2026-02-20T03:15:27.384089+0000","last_fullsized":"2026-02-20T03:15:27.384089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091877+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:15:27.091877+0000","last_peered":"2026-02-20T03:15:27.091877+0000","last_clean":"2026-02-20T03:15:27.091877+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:15:27.091877+0000","last_undegraded":"2026-02-20T03:15:27.091877+0000","last_fullsized":"2026-02-20T03:15:27.091877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095909+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:15:27.095909+0000","last_peered":"2026-02-20T03:15:27.095909+0000","last_clean":"2026-02-20T03:15:27.095909+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:15:27.095909+0000","last_undegraded":"2026-02-20T03:15:27.095909+0000","last_fullsized":"2026-02-20T03:15:27.095909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384056+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:15:27.384056+0000","last_peered":"2026-02-20T03:15:27.384056+0000","last_clean":"2026-02-20T03:15:27.384056+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:15:27.384056+0000","last_undegraded":"2026-02-20T03:15:27.384056+0000","last_fullsized":"2026-02-20T03:15:27.384056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097629+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:15:27.097629+0000","last_peered":"2026-02-20T03:15:27.097629+0000","last_clean":"2026-02-20T03:15:27.097629+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:15:27.097629+0000","last_undegraded":"2026-02-20T03:15:27.097629+0000","last_fullsized":"2026-02-20T03:15:27.097629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090084+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:15:27.090084+0000","last_peered":"2026-02-20T03:15:27.090084+0000","last_clean":"2026-02-20T03:15:27.090084+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:15:27.090084+0000","last_undegraded":"2026-02-20T03:15:27.090084+0000","last_fullsized":"2026-02-20T03:15:27.090084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096476+0000","last_change":"2026-02-20T03:15:27.096476+0000","last_active":"2026-02-20T03:15:27.096476+0000","last_peered":"2026-02-20T03:15:27.096476+0000","last_clean":"2026-02-20T03:15:27.096476+0000","last_became_active":"2026-02-20T03:15:27.096369+0000","last_became_peered":"2026-02-20T03:15:27.096369+0000","last_unstale":"2026-02-20T03:15:27.096476+0000","last_undegraded":"2026-02-20T03:15:27.096476+0000","last_fullsized":"2026-02-20T03:15:27.096476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:18:04.418088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:31.387805+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:31.387805+0000","last_peered":"2026-02-20T03:15:31.387805+0000","last_clean":"2026-02-20T03:15:31.387805+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:31.387805+0000","last_undegraded":"2026-02-20T03:15:31.387805+0000","last_fullsized":"2026-02-20T03:15:31.387805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089978+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:15:27.089978+0000","last_peered":"2026-02-20T03:15:27.089978+0000","last_clean":"2026-02-20T03:15:27.089978+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:15:27.089978+0000","last_undegraded":"2026-02-20T03:15:27.089978+0000","last_fullsized":"2026-02-20T03:15:27.089978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089476+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:15:27.089476+0000","last_peered":"2026-02-20T03:15:27.089476+0000","last_clean":"2026-02-20T03:15:27.089476+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:15:27.089476+0000","last_undegraded":"2026-02-20T03:15:27.089476+0000","last_fullsized":"2026-02-20T03:15:27.089476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097578+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:15:27.097578+0000","last_peered":"2026-02-20T03:15:27.097578+0000","last_clean":"2026-02-20T03:15:27.097578+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:15:27.097578+0000","last_undegraded":"2026-02-20T03:15:27.097578+0000","last_fullsized":"2026-02-20T03:15:27.097578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093923+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:15:27.093923+0000","last_peered":"2026-02-20T03:15:27.093923+0000","last_clean":"2026-02-20T03:15:27.093923+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:15:27.093923+0000","last_undegraded":"2026-02-20T03:15:27.093923+0000","last_fullsized":"2026-02-20T03:15:27.093923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677506+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:15:27.677506+0000","last_peered":"2026-02-20T03:15:27.677506+0000","last_clean":"2026-02-20T03:15:27.677506+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:15:27.677506+0000","last_undegraded":"2026-02-20T03:15:27.677506+0000","last_fullsized":"2026-02-20T03:15:27.677506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392678+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:15:27.392678+0000","last_peered":"2026-02-20T03:15:27.392678+0000","last_clean":"2026-02-20T03:15:27.392678+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:15:27.392678+0000","last_undegraded":"2026-02-20T03:15:27.392678+0000","last_fullsized":"2026-02-20T03:15:27.392678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":354,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097799+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:15:27.097799+0000","last_peered":"2026-02-20T03:15:27.097799+0000","last_clean":"2026-02-20T03:15:27.097799+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:15:27.097799+0000","last_undegraded":"2026-02-20T03:15:27.097799+0000","last_fullsized":"2026-02-20T03:15:27.097799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097882+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:15:27.097882+0000","last_peered":"2026-02-20T03:15:27.097882+0000","last_clean":"2026-02-20T03:15:27.097882+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:15:27.097882+0000","last_undegraded":"2026-02-20T03:15:27.097882+0000","last_fullsized":"2026-02-20T03:15:27.097882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098144+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:15:27.098144+0000","last_peered":"2026-02-20T03:15:27.098144+0000","last_clean":"2026-02-20T03:15:27.098144+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:15:27.098144+0000","last_undegraded":"2026-02-20T03:15:27.098144+0000","last_fullsized":"2026-02-20T03:15:27.098144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.104030+0000","last_change":"2026-02-20T03:15:27.104030+0000","last_active":"2026-02-20T03:15:27.104030+0000","last_peered":"2026-02-20T03:15:27.104030+0000","last_clean":"2026-02-20T03:15:27.104030+0000","last_became_active":"2026-02-20T03:15:27.101137+0000","last_became_peered":"2026-02-20T03:15:27.101137+0000","last_unstale":"2026-02-20T03:15:27.104030+0000","last_undegraded":"2026-02-20T03:15:27.104030+0000","last_fullsized":"2026-02-20T03:15:27.104030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:16.927063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099157+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:27.099157+0000","last_peered":"2026-02-20T03:15:27.099157+0000","last_clean":"2026-02-20T03:15:27.099157+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:27.099157+0000","last_undegraded":"2026-02-20T03:15:27.099157+0000","last_fullsized":"2026-02-20T03:15:27.099157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097824+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:15:27.097824+0000","last_peered":"2026-02-20T03:15:27.097824+0000","last_clean":"2026-02-20T03:15:27.097824+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:15:27.097824+0000","last_undegraded":"2026-02-20T03:15:27.097824+0000","last_fullsized":"2026-02-20T03:15:27.097824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094597+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:15:27.094597+0000","last_peered":"2026-02-20T03:15:27.094597+0000","last_clean":"2026-02-20T03:15:27.094597+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:15:27.094597+0000","last_undegraded":"2026-02-20T03:15:27.094597+0000","last_fullsized":"2026-02-20T03:15:27.094597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091583+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:27.091583+0000","last_peered":"2026-02-20T03:15:27.091583+0000","last_clean":"2026-02-20T03:15:27.091583+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:27.091583+0000","last_undegraded":"2026-02-20T03:15:27.091583+0000","last_fullsized":"2026-02-20T03:15:27.091583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098225+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:15:27.098225+0000","last_peered":"2026-02-20T03:15:27.098225+0000","last_clean":"2026-02-20T03:15:27.098225+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:15:27.098225+0000","last_undegraded":"2026-02-20T03:15:27.098225+0000","last_fullsized":"2026-02-20T03:15:27.098225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089901+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:15:27.089901+0000","last_peered":"2026-02-20T03:15:27.089901+0000","last_clean":"2026-02-20T03:15:27.089901+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:15:27.089901+0000","last_undegraded":"2026-02-20T03:15:27.089901+0000","last_fullsized":"2026-02-20T03:15:27.089901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093235+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:15:27.093235+0000","last_peered":"2026-02-20T03:15:27.093235+0000","last_clean":"2026-02-20T03:15:27.093235+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:15:27.093235+0000","last_undegraded":"2026-02-20T03:15:27.093235+0000","last_fullsized":"2026-02-20T03:15:27.093235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093959+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:15:27.093959+0000","last_peered":"2026-02-20T03:15:27.093959+0000","last_clean":"2026-02-20T03:15:27.093959+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:15:27.093959+0000","last_undegraded":"2026-02-20T03:15:27.093959+0000","last_fullsized":"2026-02-20T03:15:27.093959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:15:27.096403+0000","last_peered":"2026-02-20T03:15:27.096403+0000","last_clean":"2026-02-20T03:15:27.096403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:15:27.096403+0000","last_undegraded":"2026-02-20T03:15:27.096403+0000","last_fullsized":"2026-02-20T03:15:27.096403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093292+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:15:27.093292+0000","last_peered":"2026-02-20T03:15:27.093292+0000","last_clean":"2026-02-20T03:15:27.093292+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:15:27.093292+0000","last_undegraded":"2026-02-20T03:15:27.093292+0000","last_fullsized":"2026-02-20T03:15:27.093292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093347+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:15:27.093347+0000","last_peered":"2026-02-20T03:15:27.093347+0000","last_clean":"2026-02-20T03:15:27.093347+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:15:27.093347+0000","last_undegraded":"2026-02-20T03:15:27.093347+0000","last_fullsized":"2026-02-20T03:15:27.093347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095895+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:15:27.095895+0000","last_peered":"2026-02-20T03:15:27.095895+0000","last_clean":"2026-02-20T03:15:27.095895+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:15:27.095895+0000","last_undegraded":"2026-02-20T03:15:27.095895+0000","last_fullsized":"2026-02-20T03:15:27.095895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089892+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:15:27.089892+0000","last_peered":"2026-02-20T03:15:27.089892+0000","last_clean":"2026-02-20T03:15:27.089892+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:15:27.089892+0000","last_undegraded":"2026-02-20T03:15:27.089892+0000","last_fullsized":"2026-02-20T03:15:27.089892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097367+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:15:27.097367+0000","last_peered":"2026-02-20T03:15:27.097367+0000","last_clean":"2026-02-20T03:15:27.097367+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:15:27.097367+0000","last_undegraded":"2026-02-20T03:15:27.097367+0000","last_fullsized":"2026-02-20T03:15:27.097367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":77,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:33.396951+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:33.396951+0000","last_peered":"2026-02-20T03:15:33.396951+0000","last_clean":"2026-02-20T03:15:33.396951+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:33.396951+0000","last_undegraded":"2026-02-20T03:15:33.396951+0000","last_fullsized":"2026-02-20T03:15:33.396951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092155+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:15:27.092155+0000","last_peered":"2026-02-20T03:15:27.092155+0000","last_clean":"2026-02-20T03:15:27.092155+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:15:27.092155+0000","last_undegraded":"2026-02-20T03:15:27.092155+0000","last_fullsized":"2026-02-20T03:15:27.092155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097787+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:15:27.097787+0000","last_peered":"2026-02-20T03:15:27.097787+0000","last_clean":"2026-02-20T03:15:27.097787+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:15:27.097787+0000","last_undegraded":"2026-02-20T03:15:27.097787+0000","last_fullsized":"2026-02-20T03:15:27.097787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093616+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:15:27.093616+0000","last_peered":"2026-02-20T03:15:27.093616+0000","last_clean":"2026-02-20T03:15:27.093616+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:15:27.093616+0000","last_undegraded":"2026-02-20T03:15:27.093616+0000","last_fullsized":"2026-02-20T03:15:27.093616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093604+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:15:27.093604+0000","last_peered":"2026-02-20T03:15:27.093604+0000","last_clean":"2026-02-20T03:15:27.093604+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:15:27.093604+0000","last_undegraded":"2026-02-20T03:15:27.093604+0000","last_fullsized":"2026-02-20T03:15:27.093604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089674+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:15:27.089674+0000","last_peered":"2026-02-20T03:15:27.089674+0000","last_clean":"2026-02-20T03:15:27.089674+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:15:27.089674+0000","last_undegraded":"2026-02-20T03:15:27.089674+0000","last_fullsized":"2026-02-20T03:15:27.089674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092119+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:27.092119+0000","last_peered":"2026-02-20T03:15:27.092119+0000","last_clean":"2026-02-20T03:15:27.092119+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:27.092119+0000","last_undegraded":"2026-02-20T03:15:27.092119+0000","last_fullsized":"2026-02-20T03:15:27.092119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093756+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:15:27.093756+0000","last_peered":"2026-02-20T03:15:27.093756+0000","last_clean":"2026-02-20T03:15:27.093756+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:15:27.093756+0000","last_undegraded":"2026-02-20T03:15:27.093756+0000","last_fullsized":"2026-02-20T03:15:27.093756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096216+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:15:27.096216+0000","last_peered":"2026-02-20T03:15:27.096216+0000","last_clean":"2026-02-20T03:15:27.096216+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:15:27.096216+0000","last_undegraded":"2026-02-20T03:15:27.096216+0000","last_fullsized":"2026-02-20T03:15:27.096216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'36","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:34.399834+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:34.399834+0000","last_peered":"2026-02-20T03:15:34.399834+0000","last_clean":"2026-02-20T03:15:34.399834+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:34.399834+0000","last_undegraded":"2026-02-20T03:15:34.399834+0000","last_fullsized":"2026-02-20T03:15:34.399834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76903,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":125,"num_write":37,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091741+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:15:27.091741+0000","last_peered":"2026-02-20T03:15:27.091741+0000","last_clean":"2026-02-20T03:15:27.091741+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:15:27.091741+0000","last_undegraded":"2026-02-20T03:15:27.091741+0000","last_fullsized":"2026-02-20T03:15:27.091741+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100059+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:27.100059+0000","last_peered":"2026-02-20T03:15:27.100059+0000","last_clean":"2026-02-20T03:15:27.100059+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:27.100059+0000","last_undegraded":"2026-02-20T03:15:27.100059+0000","last_fullsized":"2026-02-20T03:15:27.100059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094441+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:15:27.094441+0000","last_peered":"2026-02-20T03:15:27.094441+0000","last_clean":"2026-02-20T03:15:27.094441+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:15:27.094441+0000","last_undegraded":"2026-02-20T03:15:27.094441+0000","last_fullsized":"2026-02-20T03:15:27.094441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392567+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:15:27.392567+0000","last_peered":"2026-02-20T03:15:27.392567+0000","last_clean":"2026-02-20T03:15:27.392567+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:15:27.392567+0000","last_undegraded":"2026-02-20T03:15:27.392567+0000","last_fullsized":"2026-02-20T03:15:27.392567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092453+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:27.092453+0000","last_peered":"2026-02-20T03:15:27.092453+0000","last_clean":"2026-02-20T03:15:27.092453+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:27.092453+0000","last_undegraded":"2026-02-20T03:15:27.092453+0000","last_fullsized":"2026-02-20T03:15:27.092453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098009+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:15:27.098009+0000","last_peered":"2026-02-20T03:15:27.098009+0000","last_clean":"2026-02-20T03:15:27.098009+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:15:27.098009+0000","last_undegraded":"2026-02-20T03:15:27.098009+0000","last_fullsized":"2026-02-20T03:15:27.098009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091618+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:15:27.091618+0000","last_peered":"2026-02-20T03:15:27.091618+0000","last_clean":"2026-02-20T03:15:27.091618+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:15:27.091618+0000","last_undegraded":"2026-02-20T03:15:27.091618+0000","last_fullsized":"2026-02-20T03:15:27.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099742+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:27.099742+0000","last_peered":"2026-02-20T03:15:27.099742+0000","last_clean":"2026-02-20T03:15:27.099742+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:27.099742+0000","last_undegraded":"2026-02-20T03:15:27.099742+0000","last_fullsized":"2026-02-20T03:15:27.099742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":74,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:33.391952+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:33.391952+0000","last_peered":"2026-02-20T03:15:33.391952+0000","last_clean":"2026-02-20T03:15:33.391952+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:33.391952+0000","last_undegraded":"2026-02-20T03:15:33.391952+0000","last_fullsized":"2026-02-20T03:15:33.391952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676945+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:15:27.676945+0000","last_peered":"2026-02-20T03:15:27.676945+0000","last_clean":"2026-02-20T03:15:27.676945+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:15:27.676945+0000","last_undegraded":"2026-02-20T03:15:27.676945+0000","last_fullsized":"2026-02-20T03:15:27.676945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091966+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:27.091966+0000","last_peered":"2026-02-20T03:15:27.091966+0000","last_clean":"2026-02-20T03:15:27.091966+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:27.091966+0000","last_undegraded":"2026-02-20T03:15:27.091966+0000","last_fullsized":"2026-02-20T03:15:27.091966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091995+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:15:27.091995+0000","last_peered":"2026-02-20T03:15:27.091995+0000","last_clean":"2026-02-20T03:15:27.091995+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:15:27.091995+0000","last_undegraded":"2026-02-20T03:15:27.091995+0000","last_fullsized":"2026-02-20T03:15:27.091995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094048+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:15:27.094048+0000","last_peered":"2026-02-20T03:15:27.094048+0000","last_clean":"2026-02-20T03:15:27.094048+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:15:27.094048+0000","last_undegraded":"2026-02-20T03:15:27.094048+0000","last_fullsized":"2026-02-20T03:15:27.094048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093983+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:15:27.093983+0000","last_peered":"2026-02-20T03:15:27.093983+0000","last_clean":"2026-02-20T03:15:27.093983+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:15:27.093983+0000","last_undegraded":"2026-02-20T03:15:27.093983+0000","last_fullsized":"2026-02-20T03:15:27.093983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676892+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:15:27.676892+0000","last_peered":"2026-02-20T03:15:27.676892+0000","last_clean":"2026-02-20T03:15:27.676892+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:15:27.676892+0000","last_undegraded":"2026-02-20T03:15:27.676892+0000","last_fullsized":"2026-02-20T03:15:27.676892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089481+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:15:27.089481+0000","last_peered":"2026-02-20T03:15:27.089481+0000","last_clean":"2026-02-20T03:15:27.089481+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:15:27.089481+0000","last_undegraded":"2026-02-20T03:15:27.089481+0000","last_fullsized":"2026-02-20T03:15:27.089481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383994+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:15:27.383994+0000","last_peered":"2026-02-20T03:15:27.383994+0000","last_clean":"2026-02-20T03:15:27.383994+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:15:27.383994+0000","last_undegraded":"2026-02-20T03:15:27.383994+0000","last_fullsized":"2026-02-20T03:15:27.383994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093591+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:15:27.093591+0000","last_peered":"2026-02-20T03:15:27.093591+0000","last_clean":"2026-02-20T03:15:27.093591+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:15:27.093591+0000","last_undegraded":"2026-02-20T03:15:27.093591+0000","last_fullsized":"2026-02-20T03:15:27.093591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092112+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:27.092112+0000","last_peered":"2026-02-20T03:15:27.092112+0000","last_clean":"2026-02-20T03:15:27.092112+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:27.092112+0000","last_undegraded":"2026-02-20T03:15:27.092112+0000","last_fullsized":"2026-02-20T03:15:27.092112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:33.386554+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:33.386554+0000","last_peered":"2026-02-20T03:15:33.386554+0000","last_clean":"2026-02-20T03:15:33.386554+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:33.386554+0000","last_undegraded":"2026-02-20T03:15:33.386554+0000","last_fullsized":"2026-02-20T03:15:33.386554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5947,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":8,"num_write":4,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096098+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:15:27.096098+0000","last_peered":"2026-02-20T03:15:27.096098+0000","last_clean":"2026-02-20T03:15:27.096098+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:15:27.096098+0000","last_undegraded":"2026-02-20T03:15:27.096098+0000","last_fullsized":"2026-02-20T03:15:27.096098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092190+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:27.092190+0000","last_peered":"2026-02-20T03:15:27.092190+0000","last_clean":"2026-02-20T03:15:27.092190+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:27.092190+0000","last_undegraded":"2026-02-20T03:15:27.092190+0000","last_fullsized":"2026-02-20T03:15:27.092190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092030+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:27.092030+0000","last_peered":"2026-02-20T03:15:27.092030+0000","last_clean":"2026-02-20T03:15:27.092030+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:27.092030+0000","last_undegraded":"2026-02-20T03:15:27.092030+0000","last_fullsized":"2026-02-20T03:15:27.092030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091880+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:27.091880+0000","last_peered":"2026-02-20T03:15:27.091880+0000","last_clean":"2026-02-20T03:15:27.091880+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:27.091880+0000","last_undegraded":"2026-02-20T03:15:27.091880+0000","last_fullsized":"2026-02-20T03:15:27.091880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092039+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:27.092039+0000","last_peered":"2026-02-20T03:15:27.092039+0000","last_clean":"2026-02-20T03:15:27.092039+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:27.092039+0000","last_undegraded":"2026-02-20T03:15:27.092039+0000","last_fullsized":"2026-02-20T03:15:27.092039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090007+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:15:27.090007+0000","last_peered":"2026-02-20T03:15:27.090007+0000","last_clean":"2026-02-20T03:15:27.090007+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:15:27.090007+0000","last_undegraded":"2026-02-20T03:15:27.090007+0000","last_fullsized":"2026-02-20T03:15:27.090007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096323+0000","last_change":"2026-02-20T03:15:27.096323+0000","last_active":"2026-02-20T03:15:27.096323+0000","last_peered":"2026-02-20T03:15:27.096323+0000","last_clean":"2026-02-20T03:15:27.096323+0000","last_became_active":"2026-02-20T03:15:27.096171+0000","last_became_peered":"2026-02-20T03:15:27.096171+0000","last_unstale":"2026-02-20T03:15:27.096323+0000","last_undegraded":"2026-02-20T03:15:27.096323+0000","last_fullsized":"2026-02-20T03:15:27.096323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:00:54.803500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092769+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:27.092769+0000","last_peered":"2026-02-20T03:15:27.092769+0000","last_clean":"2026-02-20T03:15:27.092769+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:27.092769+0000","last_undegraded":"2026-02-20T03:15:27.092769+0000","last_fullsized":"2026-02-20T03:15:27.092769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677330+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:15:27.677330+0000","last_peered":"2026-02-20T03:15:27.677330+0000","last_clean":"2026-02-20T03:15:27.677330+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:15:27.677330+0000","last_undegraded":"2026-02-20T03:15:27.677330+0000","last_fullsized":"2026-02-20T03:15:27.677330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093789+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:15:27.093789+0000","last_peered":"2026-02-20T03:15:27.093789+0000","last_clean":"2026-02-20T03:15:27.093789+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:15:27.093789+0000","last_undegraded":"2026-02-20T03:15:27.093789+0000","last_fullsized":"2026-02-20T03:15:27.093789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677022+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:15:27.677022+0000","last_peered":"2026-02-20T03:15:27.677022+0000","last_clean":"2026-02-20T03:15:27.677022+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:15:27.677022+0000","last_undegraded":"2026-02-20T03:15:27.677022+0000","last_fullsized":"2026-02-20T03:15:27.677022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099411+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:27.099411+0000","last_peered":"2026-02-20T03:15:27.099411+0000","last_clean":"2026-02-20T03:15:27.099411+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:27.099411+0000","last_undegraded":"2026-02-20T03:15:27.099411+0000","last_fullsized":"2026-02-20T03:15:27.099411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089899+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:15:27.089899+0000","last_peered":"2026-02-20T03:15:27.089899+0000","last_clean":"2026-02-20T03:15:27.089899+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:15:27.089899+0000","last_undegraded":"2026-02-20T03:15:27.089899+0000","last_fullsized":"2026-02-20T03:15:27.089899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093603+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:15:27.093603+0000","last_peered":"2026-02-20T03:15:27.093603+0000","last_clean":"2026-02-20T03:15:27.093603+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:15:27.093603+0000","last_undegraded":"2026-02-20T03:15:27.093603+0000","last_fullsized":"2026-02-20T03:15:27.093603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092566+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:27.092566+0000","last_peered":"2026-02-20T03:15:27.092566+0000","last_clean":"2026-02-20T03:15:27.092566+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:27.092566+0000","last_undegraded":"2026-02-20T03:15:27.092566+0000","last_fullsized":"2026-02-20T03:15:27.092566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092017+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:15:27.092017+0000","last_peered":"2026-02-20T03:15:27.092017+0000","last_clean":"2026-02-20T03:15:27.092017+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:15:27.092017+0000","last_undegraded":"2026-02-20T03:15:27.092017+0000","last_fullsized":"2026-02-20T03:15:27.092017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094334+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:15:27.094334+0000","last_peered":"2026-02-20T03:15:27.094334+0000","last_clean":"2026-02-20T03:15:27.094334+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:15:27.094334+0000","last_undegraded":"2026-02-20T03:15:27.094334+0000","last_fullsized":"2026-02-20T03:15:27.094334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098981+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:27.098981+0000","last_peered":"2026-02-20T03:15:27.098981+0000","last_clean":"2026-02-20T03:15:27.098981+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:27.098981+0000","last_undegraded":"2026-02-20T03:15:27.098981+0000","last_fullsized":"2026-02-20T03:15:27.098981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091896+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:27.091896+0000","last_peered":"2026-02-20T03:15:27.091896+0000","last_clean":"2026-02-20T03:15:27.091896+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:27.091896+0000","last_undegraded":"2026-02-20T03:15:27.091896+0000","last_fullsized":"2026-02-20T03:15:27.091896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091504+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:27.091504+0000","last_peered":"2026-02-20T03:15:27.091504+0000","last_clean":"2026-02-20T03:15:27.091504+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:27.091504+0000","last_undegraded":"2026-02-20T03:15:27.091504+0000","last_fullsized":"2026-02-20T03:15:27.091504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089821+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:15:27.089821+0000","last_peered":"2026-02-20T03:15:27.089821+0000","last_clean":"2026-02-20T03:15:27.089821+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:15:27.089821+0000","last_undegraded":"2026-02-20T03:15:27.089821+0000","last_fullsized":"2026-02-20T03:15:27.089821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392752+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:15:27.392752+0000","last_peered":"2026-02-20T03:15:27.392752+0000","last_clean":"2026-02-20T03:15:27.392752+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:15:27.392752+0000","last_undegraded":"2026-02-20T03:15:27.392752+0000","last_fullsized":"2026-02-20T03:15:27.392752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098066+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:15:27.098066+0000","last_peered":"2026-02-20T03:15:27.098066+0000","last_clean":"2026-02-20T03:15:27.098066+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:15:27.098066+0000","last_undegraded":"2026-02-20T03:15:27.098066+0000","last_fullsized":"2026-02-20T03:15:27.098066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384200+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:15:27.384200+0000","last_peered":"2026-02-20T03:15:27.384200+0000","last_clean":"2026-02-20T03:15:27.384200+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:15:27.384200+0000","last_undegraded":"2026-02-20T03:15:27.384200+0000","last_fullsized":"2026-02-20T03:15:27.384200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.101465+0000","last_change":"2026-02-20T03:15:27.101465+0000","last_active":"2026-02-20T03:15:27.101465+0000","last_peered":"2026-02-20T03:15:27.101465+0000","last_clean":"2026-02-20T03:15:27.101465+0000","last_became_active":"2026-02-20T03:15:27.101042+0000","last_became_peered":"2026-02-20T03:15:27.101042+0000","last_unstale":"2026-02-20T03:15:27.101465+0000","last_undegraded":"2026-02-20T03:15:27.101465+0000","last_fullsized":"2026-02-20T03:15:27.101465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:16:15.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676902+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:15:27.676902+0000","last_peered":"2026-02-20T03:15:27.676902+0000","last_clean":"2026-02-20T03:15:27.676902+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:15:27.676902+0000","last_undegraded":"2026-02-20T03:15:27.676902+0000","last_fullsized":"2026-02-20T03:15:27.676902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097349+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:15:27.097349+0000","last_peered":"2026-02-20T03:15:27.097349+0000","last_clean":"2026-02-20T03:15:27.097349+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:15:27.097349+0000","last_undegraded":"2026-02-20T03:15:27.097349+0000","last_fullsized":"2026-02-20T03:15:27.097349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383987+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:15:27.383987+0000","last_peered":"2026-02-20T03:15:27.383987+0000","last_clean":"2026-02-20T03:15:27.383987+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:15:27.383987+0000","last_undegraded":"2026-02-20T03:15:27.383987+0000","last_fullsized":"2026-02-20T03:15:27.383987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392687+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:15:27.392687+0000","last_peered":"2026-02-20T03:15:27.392687+0000","last_clean":"2026-02-20T03:15:27.392687+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:15:27.392687+0000","last_undegraded":"2026-02-20T03:15:27.392687+0000","last_fullsized":"2026-02-20T03:15:27.392687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091837+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:27.091837+0000","last_peered":"2026-02-20T03:15:27.091837+0000","last_clean":"2026-02-20T03:15:27.091837+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:27.091837+0000","last_undegraded":"2026-02-20T03:15:27.091837+0000","last_fullsized":"2026-02-20T03:15:27.091837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091994+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:27.091994+0000","last_peered":"2026-02-20T03:15:27.091994+0000","last_clean":"2026-02-20T03:15:27.091994+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:27.091994+0000","last_undegraded":"2026-02-20T03:15:27.091994+0000","last_fullsized":"2026-02-20T03:15:27.091994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094313+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:15:27.094313+0000","last_peered":"2026-02-20T03:15:27.094313+0000","last_clean":"2026-02-20T03:15:27.094313+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:15:27.094313+0000","last_undegraded":"2026-02-20T03:15:27.094313+0000","last_fullsized":"2026-02-20T03:15:27.094313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":86260,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":286,"num_read_kb":232,"num_write":173,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":242402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32140,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971060,"statfs":{"total":751619276800,"available":751586365440,"internally_reserved":0,"allocated":1032192,"data_stored":502911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612628,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32816,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970384,"statfs":{"total":751619276800,"available":751585673216,"internally_reserved":0,"allocated":1732608,"data_stored":1167452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776150,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":507221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037784,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32144,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971056,"statfs":{"total":751619276800,"available":751586361344,"internally_reserved":0,"allocated":1036288,"data_stored":502431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299418,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32732,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970468,"statfs":{"total":751619276800,"available":751585759232,"internally_reserved":0,"allocated":1638400,"data_stored":1099261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1024000,"data_stored":498291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724575,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28576,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974624,"statfs":{"total":751619276800,"available":751590014976,"internally_reserved":0,"allocated":1650688,"data_stored":1099476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888097,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32148,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971052,"statfs":{"total":751619276800,"available":751586357248,"internally_reserved":0,"allocated":1040384,"data_stored":503925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149731,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27976,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975224,"statfs":{"total":751619276800,"available":751590629376,"internally_reserved":0,"allocated":1036288,"data_stored":498485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378661,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28064,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975136,"statfs":{"total":751619276800,"available":751590539264,"internally_reserved":0,"allocated":1122304,"data_stored":573008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28044,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975156,"statfs":{"total":751619276800,"available":751590559744,"internally_reserved":0,"allocated":1105920,"data_stored":572526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705705,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":499699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":74325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":74807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":78883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:38.134 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T03:15:38.331 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:38.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:38 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1802237038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:38.453 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:38.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:38 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1802237038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:38.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.512+0000 7f2783365640 1 -- 10.20.193.28:0/628500964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277c113840 msgr2=0x7f277c115c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.512+0000 7f2783365640 1 --2- 10.20.193.28:0/628500964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277c113840 0x7f277c115c30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f277800b0a0 tx=0x7f277802f410 comp rx=0 tx=0).stop 2026-02-20T03:15:38.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.512+0000 7f2783365640 1 -- 10.20.193.28:0/628500964 shutdown_connections 2026-02-20T03:15:38.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.512+0000 7f2783365640 1 --2- 10.20.193.28:0/628500964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277c113840 0x7f277c115c30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.512+0000 7f2783365640 1 --2- 10.20.193.28:0/628500964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f277c077f40 0x7f277c113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.512+0000 7f2783365640 1 --2- 10.20.193.28:0/628500964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f277c077620 0x7f277c077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.512+0000 7f2783365640 1 -- 10.20.193.28:0/628500964 >> 10.20.193.28:0/628500964 conn(0x7f277c1006c0 msgr2=0x7f277c102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:38.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.512+0000 7f2783365640 1 -- 10.20.193.28:0/628500964 shutdown_connections 2026-02-20T03:15:38.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.512+0000 7f2783365640 1 -- 10.20.193.28:0/628500964 wait complete. 2026-02-20T03:15:38.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.513+0000 7f2783365640 1 Processor -- start 2026-02-20T03:15:38.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.513+0000 7f2783365640 1 -- start start 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.513+0000 7f2783365640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f277c077620 0x7f277c1a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.513+0000 7f2783365640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f277c077f40 0x7f277c1a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.513+0000 7f2783365640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277c113840 0x7f277c1a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.513+0000 7f2783365640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f277c1190e0 con 0x7f277c113840 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.513+0000 7f2783365640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f277c118f60 con 0x7f277c077620 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.513+0000 7f2783365640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f277c119260 con 0x7f277c077f40 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2781b62640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f277c077f40 0x7f277c1a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2781b62640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f277c077f40 0x7f277c1a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50824/0 (socket says 10.20.193.28:50824) 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2781b62640 1 -- 10.20.193.28:0/3489837818 learned_addr learned my addr 10.20.193.28:0/3489837818 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2782363640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f277c077620 0x7f277c1a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2782b64640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277c113840 0x7f277c1a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2781b62640 1 -- 10.20.193.28:0/3489837818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f277c077620 msgr2=0x7f277c1a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2781b62640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f277c077620 0x7f277c1a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2781b62640 1 -- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277c113840 msgr2=0x7f277c1a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2781b62640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277c113840 0x7f277c1a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2781b62640 1 -- 10.20.193.28:0/3489837818 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c1a64f0 con 0x7f277c077f40 2026-02-20T03:15:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2782b64640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277c113840 0x7f277c1a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2781b62640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f277c077f40 0x7f277c1a19e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f277000ea10 tx=0x7f277000eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f27637fe640 1 -- 10.20.193.28:0/3489837818 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277000ce50 con 0x7f277c077f40 2026-02-20T03:15:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f27637fe640 1 -- 10.20.193.28:0/3489837818 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2770004570 con 0x7f277c077f40 2026-02-20T03:15:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2783365640 1 -- 10.20.193.28:0/3489837818 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277c1a67e0 con 0x7f277c077f40 2026-02-20T03:15:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f2783365640 1 -- 10.20.193.28:0/3489837818 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277c1ae020 con 0x7f277c077f40 2026-02-20T03:15:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.514+0000 7f27637fe640 1 -- 10.20.193.28:0/3489837818 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770010690 con 0x7f277c077f40 2026-02-20T03:15:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.517+0000 7f27637fe640 1 -- 10.20.193.28:0/3489837818 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f2770020030 con 0x7f277c077f40 2026-02-20T03:15:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2786af3e00 1 Processor -- start 2026-02-20T03:15:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2786af3e00 1 -- start start 2026-02-20T03:15:38.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef37000 0x557d7ef373e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31630 0x557d7ef31a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef3de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2786af3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557d7eeb1e50 con 0x557d7ef31fb0 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2786af3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557d7ee849c0 con 0x557d7ef37000 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2786af3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557d7ee32240 con 0x557d7ef31630 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2782b64640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef37000 0x557d7ef373e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2782363640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31630 0x557d7ef31a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2782363640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31630 0x557d7ef31a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50840/0 (socket says 10.20.193.28:50840) 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2782b64640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef37000 0x557d7ef373e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59898/0 (socket says 10.20.193.28:59898) 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2782363640 1 -- 10.20.193.28:0/3486027723 learned_addr learned my addr 10.20.193.28:0/3486027723 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f2781b62640 1 --2- 10.20.193.28:0/3486027723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef3de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.518+0000 7f27637fe640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27580b1050 0x7f27580b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2782363640 1 -- 10.20.193.28:0/3486027723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef37000 msgr2=0x557d7ef373e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:38.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2782363640 1 --2- 10.20.193.28:0/3486027723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef37000 0x557d7ef373e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2782363640 1 -- 10.20.193.28:0/3486027723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 msgr2=0x557d7ef3de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:38.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f27637fe640 1 -- 10.20.193.28:0/3489837818 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f27700e0c80 con 0x7f277c077f40 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2782363640 1 --2- 10.20.193.28:0/3486027723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef3de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2782b64640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27580b1050 0x7f27580b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2782363640 1 -- 10.20.193.28:0/3486027723 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7ee45420 con 0x557d7ef31630 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2781b62640 1 --2- 10.20.193.28:0/3486027723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef3de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2782363640 1 --2- 10.20.193.28:0/3486027723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31630 0x557d7ef31a70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f276c007d30 tx=0x7f276c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e70f2fa18fed9fa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2760cf3640 1 -- 10.20.193.28:0/3486027723 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c0042d0 con 0x557d7ef31630 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2760cf3640 1 -- 10.20.193.28:0/3486027723 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f276c015030 con 0x557d7ef31630 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.519+0000 7f2760cf3640 1 -- 10.20.193.28:0/3486027723 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c011730 con 0x557d7ef31630 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2786af3e00 1 -- 10.20.193.28:0/3486027723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31630 msgr2=0x557d7ef31a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2786af3e00 1 --2- 10.20.193.28:0/3486027723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31630 0x557d7ef31a70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f276c007d30 tx=0x7f276c0107a0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2782b64640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27580b1050 0x7f27580b3510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2778009e60 tx=0x7f27780099e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2786af3e00 1 -- 10.20.193.28:0/3486027723 shutdown_connections 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2786af3e00 1 --2- 10.20.193.28:0/3486027723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef3de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2786af3e00 1 --2- 10.20.193.28:0/3486027723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31630 0x557d7ef31a70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2786af3e00 1 --2- 10.20.193.28:0/3486027723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef37000 0x557d7ef373e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2786af3e00 1 -- 10.20.193.28:0/3486027723 >> 10.20.193.28:0/3486027723 conn(0x557d7eef4290 msgr2=0x557d7ef2fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2786af3e00 1 -- 10.20.193.28:0/3486027723 shutdown_connections 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.520+0000 7f2786af3e00 1 -- 10.20.193.28:0/3486027723 wait complete. 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.521+0000 7f2786af3e00 1 -- start start 2026-02-20T03:15:38.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.521+0000 7f2786af3e00 1 Processor -- start 2026-02-20T03:15:38.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef4b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31fb0 0x557d7ef4beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef37000 0x557d7ef4a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2786af3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557d7ee808f0 con 0x557d7ef37000 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2786af3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557d7ec72f50 con 0x557d7ef31630 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2786af3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557d7ef4a830 con 0x557d7ef31fb0 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2781b62640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31fb0 0x557d7ef4beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2781b62640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31fb0 0x557d7ef4beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50842/0 (socket says 10.20.193.28:50842) 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2782363640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef4b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2781b62640 1 -- 10.20.193.28:0/1660843379 learned_addr learned my addr 10.20.193.28:0/1660843379 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2782b64640 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef37000 0x557d7ef4a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2781b62640 1 -- 10.20.193.28:0/1660843379 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 msgr2=0x557d7ef4b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2781b62640 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef4b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2781b62640 1 -- 10.20.193.28:0/1660843379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef37000 msgr2=0x557d7ef4a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2781b62640 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef37000 0x557d7ef4a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2781b62640 1 -- 10.20.193.28:0/1660843379 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7ef43a30 con 0x557d7ef31fb0 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.522+0000 7f2782b64640 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef37000 0x557d7ef4a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f2781b62640 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31fb0 0x557d7ef4beb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f27700a85f0 tx=0x7f27700af330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4baa727197d67d85 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f272ffff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f272ffff640 1 -- 10.20.193.28:0/1660843379 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27700a86c0 con 0x557d7ef31fb0 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f272ffff640 1 -- 10.20.193.28:0/1660843379 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f27700a8ff0 con 0x557d7ef31fb0 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f272ffff640 1 -- 10.20.193.28:0/1660843379 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27700a7e10 con 0x557d7ef31fb0 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f2786af3e00 1 -- 10.20.193.28:0/1660843379 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7ec55b40 con 0x557d7ef31fb0 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f2786af3e00 10 client.25288 _ll_register_callbacks cb 0x557d7eebdf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f272ffff640 1 -- 10.20.193.28:0/1660843379 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f27700e4020 con 0x557d7ef31fb0 2026-02-20T03:15:38.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f2786af3e00 1 -- 10.20.193.28:0/1660843379 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d7ee921a0 con 0x557d7ef31fb0 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f272ffff640 1 -- 10.20.193.28:0/1660843379 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f27700a7ff0 con 0x557d7ef31fb0 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f2786af3e00 10 client.25288 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f2786af3e00 1 -- 10.20.193.28:0/1660843379 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x557d7ee3f230 con 0x557d7ef31fb0 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.523+0000 7f272ffff640 1 -- 10.20.193.28:0/1660843379 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f27700e8040 con 0x557d7ef31fb0 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.524+0000 7f2786af3e00 10 client.25288 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.524+0000 7f2786af3e00 10 client.25288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.524+0000 7f2786af3e00 20 client.25288 populate_metadata read hostname 'trial028' 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.524+0000 7f2786af3e00 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d7ef6b500 0x557d7ef6d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.524+0000 7f2786af3e00 4 client.25288 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.524+0000 7f2786af3e00 1 -- 10.20.193.28:0/1660843379 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d7ee8c5b0 con 0x557d7ef6b500 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.524+0000 7f2782363640 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d7ef6b500 0x557d7ef6d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.524+0000 7f2782363640 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d7ef6b500 0x557d7ef6d9c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13cf53b251c2df12 server_cookie=ff0b5b5c090c95fd in_seq=0 out_seq=0 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.524+0000 7f272ffff640 10 client.25288 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f272ffff640 1 -- 10.20.193.28:0/1660843379 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557d7ee8c5b0 con 0x557d7ef6b500 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f272ffff640 10 client.25288 handle_command_reply: tid=0 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 client.25288 shutdown 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 -- 10.20.193.28:0/1660843379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31fb0 msgr2=0x557d7ef4beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31fb0 0x557d7ef4beb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f27700a85f0 tx=0x7f27700af330 comp rx=0 tx=0).stop 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 -- 10.20.193.28:0/1660843379 shutdown_connections 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d7ef6b500 0x557d7ef6d9c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef37000 0x557d7ef4a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef31fb0 0x557d7ef4beb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 --2- 10.20.193.28:0/1660843379 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef4b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f272ffff640 0 client.25288 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:38.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 -- 10.20.193.28:0/1660843379 >> 10.20.193.28:0/1660843379 conn(0x557d7eef4290 msgr2=0x557d7ef30440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:38.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 -- 10.20.193.28:0/1660843379 shutdown_connections 2026-02-20T03:15:38.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.525+0000 7f2786af3e00 1 -- 10.20.193.28:0/1660843379 wait complete. 2026-02-20T03:15:38.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.526+0000 7f2786af3e00 20 client.25288 trim_cache size 0 max 16384 2026-02-20T03:15:38.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.534+0000 7f2786af3e00 1 Processor -- start 2026-02-20T03:15:38.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.534+0000 7f2786af3e00 1 -- start start 2026-02-20T03:15:38.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.534+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef49060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.534+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef30520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7ef30a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2786af3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f27240122a0 con 0x557d7ef31fb0 2026-02-20T03:15:38.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2786af3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f272400fb70 con 0x557d7ef31630 2026-02-20T03:15:38.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2786af3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f272400d9c0 con 0x557d7ef37000 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782b64640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7ef30a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782b64640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7ef30a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50848/0 (socket says 10.20.193.28:50848) 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782b64640 1 -- 10.20.193.28:0/2133679713 learned_addr learned my addr 10.20.193.28:0/2133679713 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2781b62640 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef30520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782363640 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef49060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782b64640 1 -- 10.20.193.28:0/2133679713 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 msgr2=0x557d7ef49060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782b64640 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef49060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782b64640 1 -- 10.20.193.28:0/2133679713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 msgr2=0x557d7ef30520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782b64640 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef30520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782b64640 1 -- 10.20.193.28:0/2133679713 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7ef43860 con 0x557d7ef37000 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782363640 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef49060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:38.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2781b62640 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef30520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.535+0000 7f2782b64640 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7ef30a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2778004b70 tx=0x7f277803f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2866b6783d45a71 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f274a4e6640 1 -- 10.20.193.28:0/2133679713 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778002c60 con 0x557d7ef37000 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f274a4e6640 1 -- 10.20.193.28:0/2133679713 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2778033040 con 0x557d7ef37000 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f274a4e6640 1 -- 10.20.193.28:0/2133679713 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778007c50 con 0x557d7ef37000 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f2786af3e00 1 -- 10.20.193.28:0/2133679713 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 msgr2=0x557d7ef30a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f2786af3e00 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7ef30a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2778004b70 tx=0x7f277803f000 comp rx=0 tx=0).stop 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f2786af3e00 1 -- 10.20.193.28:0/2133679713 shutdown_connections 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f2786af3e00 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7ef30a60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f2786af3e00 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef30520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f2786af3e00 1 --2- 10.20.193.28:0/2133679713 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef49060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f2786af3e00 1 -- 10.20.193.28:0/2133679713 >> 10.20.193.28:0/2133679713 conn(0x557d7eef4290 msgr2=0x557d7ef48950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:38.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f2786af3e00 1 -- 10.20.193.28:0/2133679713 shutdown_connections 2026-02-20T03:15:38.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.536+0000 7f2786af3e00 1 -- 10.20.193.28:0/2133679713 wait complete. 2026-02-20T03:15:38.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.537+0000 7f2786af3e00 1 -- start start 2026-02-20T03:15:38.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.537+0000 7f2786af3e00 1 Processor -- start 2026-02-20T03:15:38.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.537+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef4ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.537+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef4f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.537+0000 7f2786af3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7efd04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.537+0000 7f2786af3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f272400e030 con 0x557d7ef31fb0 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.537+0000 7f2786af3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f272400f4a0 con 0x557d7ef31630 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.537+0000 7f2786af3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f272400e700 con 0x557d7ef37000 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782b64640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7efd04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782b64640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7efd04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50858/0 (socket says 10.20.193.28:50858) 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782b64640 1 -- 10.20.193.28:0/958460196 learned_addr learned my addr 10.20.193.28:0/958460196 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782363640 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef4ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782b64640 1 -- 10.20.193.28:0/958460196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 msgr2=0x557d7ef4ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782b64640 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef4ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782b64640 1 -- 10.20.193.28:0/958460196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 msgr2=0x557d7ef4f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2781b62640 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef4f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782b64640 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef4f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782b64640 1 -- 10.20.193.28:0/958460196 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7eb63870 con 0x557d7ef37000 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782363640 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef4ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2781b62640 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef4f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f2782b64640 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7efd04f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2778004ec0 tx=0x7f2778004ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fda12406460793ad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.538+0000 7f272ffff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f272ffff640 1 -- 10.20.193.28:0/958460196 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778007be0 con 0x557d7ef37000 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f272ffff640 1 -- 10.20.193.28:0/958460196 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2778004950 con 0x557d7ef37000 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f272ffff640 1 -- 10.20.193.28:0/958460196 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778059cc0 con 0x557d7ef37000 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 1 -- 10.20.193.28:0/958460196 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7ee24440 con 0x557d7ef37000 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f272ffff640 1 -- 10.20.193.28:0/958460196 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f2778038420 con 0x557d7ef37000 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 10 client.25294 _ll_register_callbacks cb 0x7f2770009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 1 -- 10.20.193.28:0/958460196 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d7ee55810 con 0x557d7ef37000 2026-02-20T03:15:38.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f272ffff640 1 -- 10.20.193.28:0/958460196 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2778059e60 con 0x557d7ef37000 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 10 client.25294 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 1 -- 10.20.193.28:0/958460196 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x557d7ef44550 con 0x557d7ef37000 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f272ffff640 1 -- 10.20.193.28:0/958460196 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f2778061070 con 0x557d7ef37000 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 10 client.25294 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 10 client.25294 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 20 client.25294 populate_metadata read hostname 'trial028' 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d7efd80d0 0x557d7efda560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 4 client.25294 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.539+0000 7f2786af3e00 1 -- 10.20.193.28:0/958460196 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557d7ee36b00 con 0x557d7efd80d0 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2782363640 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d7efd80d0 0x557d7efda560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2782363640 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d7efd80d0 0x557d7efda560 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ae722aa8d8da208 server_cookie=65cacd3e33a7be94 in_seq=0 out_seq=0 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f272ffff640 10 client.25294 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f272ffff640 1 -- 10.20.193.28:0/958460196 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557d7ee36b00 con 0x557d7efd80d0 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f272ffff640 10 client.25294 handle_command_reply: tid=0 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2786af3e00 1 client.25294 shutdown 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2786af3e00 1 -- 10.20.193.28:0/958460196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 msgr2=0x557d7efd04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2786af3e00 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7efd04f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2778004ec0 tx=0x7f2778004ef0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2786af3e00 1 -- 10.20.193.28:0/958460196 shutdown_connections 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2786af3e00 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d7efd80d0 0x557d7efda560 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2786af3e00 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d7ef37000 0x557d7efd04f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2786af3e00 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d7ef31fb0 0x557d7ef4f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2786af3e00 1 --2- 10.20.193.28:0/958460196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d7ef31630 0x557d7ef4ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.540+0000 7f2786af3e00 1 -- 10.20.193.28:0/958460196 >> 10.20.193.28:0/958460196 conn(0x557d7eef4290 msgr2=0x557d7ef49170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:38.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f272ffff640 0 client.25294 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:38.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2786af3e00 1 -- 10.20.193.28:0/958460196 shutdown_connections 2026-02-20T03:15:38.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2786af3e00 1 -- 10.20.193.28:0/958460196 wait complete. 2026-02-20T03:15:38.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2786af3e00 20 client.25294 trim_cache size 0 max 16384 2026-02-20T03:15:38.551 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:38.551 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:15:38.551 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:15:38.551 INFO:teuthology.orchestra.run.trial028.stdout: "0e03cddc-e767-482b-bf7c-bbb0d71260e0": { 2026-02-20T03:15:38.552 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:15:38.552 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "0e03cddc-e767-482b-bf7c-bbb0d71260e0", 2026-02-20T03:15:38.552 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:15:38.552 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:15:38.552 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:15:38.552 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:38.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 -- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27580b1050 msgr2=0x7f27580b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27580b1050 0x7f27580b3510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2778009e60 tx=0x7f27780099e0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 -- 10.20.193.28:0/3489837818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f277c077f40 msgr2=0x7f277c1a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f277c077f40 0x7f277c1a19e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f277000ea10 tx=0x7f277000eee0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 -- 10.20.193.28:0/3489837818 shutdown_connections 2026-02-20T03:15:38.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27580b1050 0x7f27580b3510 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f277c113840 0x7f277c1a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f277c077f40 0x7f277c1a19e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 --2- 10.20.193.28:0/3489837818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f277c077620 0x7f277c1a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.541+0000 7f2783365640 1 -- 10.20.193.28:0/3489837818 >> 10.20.193.28:0/3489837818 conn(0x7f277c1006c0 msgr2=0x7f277c102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:38.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.542+0000 7f2783365640 1 -- 10.20.193.28:0/3489837818 shutdown_connections 2026-02-20T03:15:38.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.542+0000 7f2783365640 1 -- 10.20.193.28:0/3489837818 wait complete. 2026-02-20T03:15:38.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:38 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1802237038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:38.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.634+0000 7f074ee81640 1 -- 10.20.193.28:0/453230972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0748104da0 msgr2=0x7f0748105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 --2- 10.20.193.28:0/453230972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0748104da0 0x7f0748105180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0738009a30 tx=0x7f073802f220 comp rx=0 tx=0).stop 2026-02-20T03:15:38.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 -- 10.20.193.28:0/453230972 shutdown_connections 2026-02-20T03:15:38.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 --2- 10.20.193.28:0/453230972 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0748109ed0 0x7f0748111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 --2- 10.20.193.28:0/453230972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0748105750 0x7f07481097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 --2- 10.20.193.28:0/453230972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0748104da0 0x7f0748105180 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 -- 10.20.193.28:0/453230972 >> 10.20.193.28:0/453230972 conn(0x7f0748100840 msgr2=0x7f0748102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:38.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 -- 10.20.193.28:0/453230972 shutdown_connections 2026-02-20T03:15:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 -- 10.20.193.28:0/453230972 wait complete. 2026-02-20T03:15:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 Processor -- start 2026-02-20T03:15:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.635+0000 7f074ee81640 1 -- start start 2026-02-20T03:15:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074ee81640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0748104da0 0x7f074819d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074ee81640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0748105750 0x7f074819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074ee81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0748109ed0 0x7f07481a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074ee81640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0748114d50 con 0x7f0748109ed0 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074ee81640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0748114bd0 con 0x7f0748105750 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074ee81640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0748114ed0 con 0x7f0748104da0 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074cbf6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0748104da0 0x7f074819d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074cbf6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0748104da0 0x7f074819d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50884/0 (socket says 10.20.193.28:50884) 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074cbf6640 1 -- 10.20.193.28:0/1774637933 learned_addr learned my addr 10.20.193.28:0/1774637933 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f073ffff640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0748105750 0x7f074819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074d3f7640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0748109ed0 0x7f07481a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074cbf6640 1 -- 10.20.193.28:0/1774637933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0748105750 msgr2=0x7f074819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074cbf6640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0748105750 0x7f074819d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074cbf6640 1 -- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0748109ed0 msgr2=0x7f07481a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074cbf6640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0748109ed0 0x7f07481a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.636+0000 7f074cbf6640 1 -- 10.20.193.28:0/1774637933 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07481a2220 con 0x7f0748104da0 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.637+0000 7f074cbf6640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0748104da0 0x7f074819d1d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0738005ec0 tx=0x7f0738004300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.637+0000 7f073dffb640 1 -- 10.20.193.28:0/1774637933 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738005020 con 0x7f0748104da0 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.637+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07481a24b0 con 0x7f0748104da0 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.637+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07481a9d50 con 0x7f0748104da0 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.637+0000 7f073dffb640 1 -- 10.20.193.28:0/1774637933 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0738005660 con 0x7f0748104da0 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.637+0000 7f073dffb640 1 -- 10.20.193.28:0/1774637933 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738038b90 con 0x7f0748104da0 2026-02-20T03:15:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.637+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0748105180 con 0x7f0748104da0 2026-02-20T03:15:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.640+0000 7f073dffb640 1 -- 10.20.193.28:0/1774637933 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f0738004a50 con 0x7f0748104da0 2026-02-20T03:15:38.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.642+0000 7f073dffb640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07240b0eb0 0x7f07240b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:38.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.642+0000 7f073dffb640 1 -- 10.20.193.28:0/1774637933 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f0738104ad0 con 0x7f0748104da0 2026-02-20T03:15:38.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.642+0000 7f073dffb640 1 -- 10.20.193.28:0/1774637933 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0738134be0 con 0x7f0748104da0 2026-02-20T03:15:38.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.642+0000 7f073ffff640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07240b0eb0 0x7f07240b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:38.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.642+0000 7f073ffff640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07240b0eb0 0x7f07240b3370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0748100c60 tx=0x7f0730009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:38.685 INFO:tasks.cephfs.filesystem:scrub status for tag:0e03cddc-e767-482b-bf7c-bbb0d71260e0 - {'path': '/', 'tag': '0e03cddc-e767-482b-bf7c-bbb0d71260e0', 'options': 'recursive,force'} 2026-02-20T03:15:38.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.732+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f074810cc00 con 0x7f07240b0eb0 2026-02-20T03:15:38.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.737+0000 7f073dffb640 1 -- 10.20.193.28:0/1774637933 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340410 (secure 0 0 0) 0x7f074810cc00 con 0x7f07240b0eb0 2026-02-20T03:15:38.744 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:38.747 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:38.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07240b0eb0 msgr2=0x7f07240b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07240b0eb0 0x7f07240b3370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0748100c60 tx=0x7f0730009290 comp rx=0 tx=0).stop 2026-02-20T03:15:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0748104da0 msgr2=0x7f074819d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0748104da0 0x7f074819d1d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0738005ec0 tx=0x7f0738004300 comp rx=0 tx=0).stop 2026-02-20T03:15:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 shutdown_connections 2026-02-20T03:15:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07240b0eb0 0x7f07240b3370 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0748109ed0 0x7f07481a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0748105750 0x7f074819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 --2- 10.20.193.28:0/1774637933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0748104da0 0x7f074819d1d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:38.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 >> 10.20.193.28:0/1774637933 conn(0x7f0748100840 msgr2=0x7f0748101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:38.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 shutdown_connections 2026-02-20T03:15:38.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:38.741+0000 7f074ee81640 1 -- 10.20.193.28:0/1774637933 wait complete. 2026-02-20T03:15:38.844 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2026-02-20T03:15:38.011824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":676862,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":392,"num_read_kb":323,"num_write":366,"num_write_kb":3860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181942,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358600,"kb_used_data":14192,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807679800,"statfs":{"total":9019431321600,"available":9019064115200,"internally_reserved":0,"allocated":14532608,"data_stored":8041186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12894,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":44,"num_write":9,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.923274"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.389259+0000","last_change":"2026-02-20T03:15:27.389259+0000","last_active":"2026-02-20T03:15:27.389259+0000","last_peered":"2026-02-20T03:15:27.389259+0000","last_clean":"2026-02-20T03:15:27.389259+0000","last_became_active":"2026-02-20T03:15:27.385887+0000","last_became_peered":"2026-02-20T03:15:27.385887+0000","last_unstale":"2026-02-20T03:15:27.389259+0000","last_undegraded":"2026-02-20T03:15:27.389259+0000","last_fullsized":"2026-02-20T03:15:27.389259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:20:01.907763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677322+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:15:27.677322+0000","last_peered":"2026-02-20T03:15:27.677322+0000","last_clean":"2026-02-20T03:15:27.677322+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:15:27.677322+0000","last_undegraded":"2026-02-20T03:15:27.677322+0000","last_fullsized":"2026-02-20T03:15:27.677322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091764+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:27.091764+0000","last_peered":"2026-02-20T03:15:27.091764+0000","last_clean":"2026-02-20T03:15:27.091764+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:27.091764+0000","last_undegraded":"2026-02-20T03:15:27.091764+0000","last_fullsized":"2026-02-20T03:15:27.091764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677381+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:15:27.677381+0000","last_peered":"2026-02-20T03:15:27.677381+0000","last_clean":"2026-02-20T03:15:27.677381+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:15:27.677381+0000","last_undegraded":"2026-02-20T03:15:27.677381+0000","last_fullsized":"2026-02-20T03:15:27.677381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092401+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:27.092401+0000","last_peered":"2026-02-20T03:15:27.092401+0000","last_clean":"2026-02-20T03:15:27.092401+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:27.092401+0000","last_undegraded":"2026-02-20T03:15:27.092401+0000","last_fullsized":"2026-02-20T03:15:27.092401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392166+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:15:27.392166+0000","last_peered":"2026-02-20T03:15:27.392166+0000","last_clean":"2026-02-20T03:15:27.392166+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:15:27.392166+0000","last_undegraded":"2026-02-20T03:15:27.392166+0000","last_fullsized":"2026-02-20T03:15:27.392166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096362+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:15:27.096362+0000","last_peered":"2026-02-20T03:15:27.096362+0000","last_clean":"2026-02-20T03:15:27.096362+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:15:27.096362+0000","last_undegraded":"2026-02-20T03:15:27.096362+0000","last_fullsized":"2026-02-20T03:15:27.096362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100051+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:27.100051+0000","last_peered":"2026-02-20T03:15:27.100051+0000","last_clean":"2026-02-20T03:15:27.100051+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:27.100051+0000","last_undegraded":"2026-02-20T03:15:27.100051+0000","last_fullsized":"2026-02-20T03:15:27.100051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392411+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:15:27.392411+0000","last_peered":"2026-02-20T03:15:27.392411+0000","last_clean":"2026-02-20T03:15:27.392411+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:15:27.392411+0000","last_undegraded":"2026-02-20T03:15:27.392411+0000","last_fullsized":"2026-02-20T03:15:27.392411+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096305+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:15:27.096305+0000","last_peered":"2026-02-20T03:15:27.096305+0000","last_clean":"2026-02-20T03:15:27.096305+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:15:27.096305+0000","last_undegraded":"2026-02-20T03:15:27.096305+0000","last_fullsized":"2026-02-20T03:15:27.096305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096792+0000","last_change":"2026-02-20T03:15:27.096792+0000","last_active":"2026-02-20T03:15:27.096792+0000","last_peered":"2026-02-20T03:15:27.096792+0000","last_clean":"2026-02-20T03:15:27.096792+0000","last_became_active":"2026-02-20T03:15:27.096659+0000","last_became_peered":"2026-02-20T03:15:27.096659+0000","last_unstale":"2026-02-20T03:15:27.096792+0000","last_undegraded":"2026-02-20T03:15:27.096792+0000","last_fullsized":"2026-02-20T03:15:27.096792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:57.312267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392339+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:15:27.392339+0000","last_peered":"2026-02-20T03:15:27.392339+0000","last_clean":"2026-02-20T03:15:27.392339+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:15:27.392339+0000","last_undegraded":"2026-02-20T03:15:27.392339+0000","last_fullsized":"2026-02-20T03:15:27.392339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097517+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:15:27.097517+0000","last_peered":"2026-02-20T03:15:27.097517+0000","last_clean":"2026-02-20T03:15:27.097517+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:15:27.097517+0000","last_undegraded":"2026-02-20T03:15:27.097517+0000","last_fullsized":"2026-02-20T03:15:27.097517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392602+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:15:27.392602+0000","last_peered":"2026-02-20T03:15:27.392602+0000","last_clean":"2026-02-20T03:15:27.392602+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:15:27.392602+0000","last_undegraded":"2026-02-20T03:15:27.392602+0000","last_fullsized":"2026-02-20T03:15:27.392602+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677473+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:15:27.677473+0000","last_peered":"2026-02-20T03:15:27.677473+0000","last_clean":"2026-02-20T03:15:27.677473+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:15:27.677473+0000","last_undegraded":"2026-02-20T03:15:27.677473+0000","last_fullsized":"2026-02-20T03:15:27.677473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092021+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:27.092021+0000","last_peered":"2026-02-20T03:15:27.092021+0000","last_clean":"2026-02-20T03:15:27.092021+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:27.092021+0000","last_undegraded":"2026-02-20T03:15:27.092021+0000","last_fullsized":"2026-02-20T03:15:27.092021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392578+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:15:27.392578+0000","last_peered":"2026-02-20T03:15:27.392578+0000","last_clean":"2026-02-20T03:15:27.392578+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:15:27.392578+0000","last_undegraded":"2026-02-20T03:15:27.392578+0000","last_fullsized":"2026-02-20T03:15:27.392578+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677054+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:15:27.677054+0000","last_peered":"2026-02-20T03:15:27.677054+0000","last_clean":"2026-02-20T03:15:27.677054+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:15:27.677054+0000","last_undegraded":"2026-02-20T03:15:27.677054+0000","last_fullsized":"2026-02-20T03:15:27.677054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092084+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:15:27.092084+0000","last_peered":"2026-02-20T03:15:27.092084+0000","last_clean":"2026-02-20T03:15:27.092084+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:15:27.092084+0000","last_undegraded":"2026-02-20T03:15:27.092084+0000","last_fullsized":"2026-02-20T03:15:27.092084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095913+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:15:27.095913+0000","last_peered":"2026-02-20T03:15:27.095913+0000","last_clean":"2026-02-20T03:15:27.095913+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:15:27.095913+0000","last_undegraded":"2026-02-20T03:15:27.095913+0000","last_fullsized":"2026-02-20T03:15:27.095913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.106320+0000","last_change":"2026-02-20T03:15:27.106320+0000","last_active":"2026-02-20T03:15:27.106320+0000","last_peered":"2026-02-20T03:15:27.106320+0000","last_clean":"2026-02-20T03:15:27.106320+0000","last_became_active":"2026-02-20T03:15:27.101151+0000","last_became_peered":"2026-02-20T03:15:27.101151+0000","last_unstale":"2026-02-20T03:15:27.106320+0000","last_undegraded":"2026-02-20T03:15:27.106320+0000","last_fullsized":"2026-02-20T03:15:27.106320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:56.197115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392629+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:15:27.392629+0000","last_peered":"2026-02-20T03:15:27.392629+0000","last_clean":"2026-02-20T03:15:27.392629+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:15:27.392629+0000","last_undegraded":"2026-02-20T03:15:27.392629+0000","last_fullsized":"2026-02-20T03:15:27.392629+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093728+0000","last_change":"2026-02-20T03:15:27.093728+0000","last_active":"2026-02-20T03:15:27.093728+0000","last_peered":"2026-02-20T03:15:27.093728+0000","last_clean":"2026-02-20T03:15:27.093728+0000","last_became_active":"2026-02-20T03:15:27.093455+0000","last_became_peered":"2026-02-20T03:15:27.093455+0000","last_unstale":"2026-02-20T03:15:27.093728+0000","last_undegraded":"2026-02-20T03:15:27.093728+0000","last_fullsized":"2026-02-20T03:15:27.093728+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:38:26.593708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392844+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:15:27.392844+0000","last_peered":"2026-02-20T03:15:27.392844+0000","last_clean":"2026-02-20T03:15:27.392844+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:15:27.392844+0000","last_undegraded":"2026-02-20T03:15:27.392844+0000","last_fullsized":"2026-02-20T03:15:27.392844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091895+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:27.091895+0000","last_peered":"2026-02-20T03:15:27.091895+0000","last_clean":"2026-02-20T03:15:27.091895+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:27.091895+0000","last_undegraded":"2026-02-20T03:15:27.091895+0000","last_fullsized":"2026-02-20T03:15:27.091895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677369+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:15:27.677369+0000","last_peered":"2026-02-20T03:15:27.677369+0000","last_clean":"2026-02-20T03:15:27.677369+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:15:27.677369+0000","last_undegraded":"2026-02-20T03:15:27.677369+0000","last_fullsized":"2026-02-20T03:15:27.677369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092083+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:27.092083+0000","last_peered":"2026-02-20T03:15:27.092083+0000","last_clean":"2026-02-20T03:15:27.092083+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:27.092083+0000","last_undegraded":"2026-02-20T03:15:27.092083+0000","last_fullsized":"2026-02-20T03:15:27.092083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676826+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:15:27.676826+0000","last_peered":"2026-02-20T03:15:27.676826+0000","last_clean":"2026-02-20T03:15:27.676826+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:15:27.676826+0000","last_undegraded":"2026-02-20T03:15:27.676826+0000","last_fullsized":"2026-02-20T03:15:27.676826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090039+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:15:27.090039+0000","last_peered":"2026-02-20T03:15:27.090039+0000","last_clean":"2026-02-20T03:15:27.090039+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:15:27.090039+0000","last_undegraded":"2026-02-20T03:15:27.090039+0000","last_fullsized":"2026-02-20T03:15:27.090039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099935+0000","last_change":"2026-02-20T03:15:27.099749+0000","last_active":"2026-02-20T03:15:27.099935+0000","last_peered":"2026-02-20T03:15:27.099935+0000","last_clean":"2026-02-20T03:15:27.099935+0000","last_became_active":"2026-02-20T03:15:27.096338+0000","last_became_peered":"2026-02-20T03:15:27.096338+0000","last_unstale":"2026-02-20T03:15:27.099935+0000","last_undegraded":"2026-02-20T03:15:27.099935+0000","last_fullsized":"2026-02-20T03:15:27.099935+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:59:55.738735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093553+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:15:27.093553+0000","last_peered":"2026-02-20T03:15:27.093553+0000","last_clean":"2026-02-20T03:15:27.093553+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:15:27.093553+0000","last_undegraded":"2026-02-20T03:15:27.093553+0000","last_fullsized":"2026-02-20T03:15:27.093553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384089+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:15:27.384089+0000","last_peered":"2026-02-20T03:15:27.384089+0000","last_clean":"2026-02-20T03:15:27.384089+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:15:27.384089+0000","last_undegraded":"2026-02-20T03:15:27.384089+0000","last_fullsized":"2026-02-20T03:15:27.384089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091877+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:15:27.091877+0000","last_peered":"2026-02-20T03:15:27.091877+0000","last_clean":"2026-02-20T03:15:27.091877+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:15:27.091877+0000","last_undegraded":"2026-02-20T03:15:27.091877+0000","last_fullsized":"2026-02-20T03:15:27.091877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095909+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:15:27.095909+0000","last_peered":"2026-02-20T03:15:27.095909+0000","last_clean":"2026-02-20T03:15:27.095909+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:15:27.095909+0000","last_undegraded":"2026-02-20T03:15:27.095909+0000","last_fullsized":"2026-02-20T03:15:27.095909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384056+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:15:27.384056+0000","last_peered":"2026-02-20T03:15:27.384056+0000","last_clean":"2026-02-20T03:15:27.384056+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:15:27.384056+0000","last_undegraded":"2026-02-20T03:15:27.384056+0000","last_fullsized":"2026-02-20T03:15:27.384056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097629+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:15:27.097629+0000","last_peered":"2026-02-20T03:15:27.097629+0000","last_clean":"2026-02-20T03:15:27.097629+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:15:27.097629+0000","last_undegraded":"2026-02-20T03:15:27.097629+0000","last_fullsized":"2026-02-20T03:15:27.097629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090084+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:15:27.090084+0000","last_peered":"2026-02-20T03:15:27.090084+0000","last_clean":"2026-02-20T03:15:27.090084+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:15:27.090084+0000","last_undegraded":"2026-02-20T03:15:27.090084+0000","last_fullsized":"2026-02-20T03:15:27.090084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096476+0000","last_change":"2026-02-20T03:15:27.096476+0000","last_active":"2026-02-20T03:15:27.096476+0000","last_peered":"2026-02-20T03:15:27.096476+0000","last_clean":"2026-02-20T03:15:27.096476+0000","last_became_active":"2026-02-20T03:15:27.096369+0000","last_became_peered":"2026-02-20T03:15:27.096369+0000","last_unstale":"2026-02-20T03:15:27.096476+0000","last_undegraded":"2026-02-20T03:15:27.096476+0000","last_fullsized":"2026-02-20T03:15:27.096476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:18:04.418088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:31.387805+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:31.387805+0000","last_peered":"2026-02-20T03:15:31.387805+0000","last_clean":"2026-02-20T03:15:31.387805+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:31.387805+0000","last_undegraded":"2026-02-20T03:15:31.387805+0000","last_fullsized":"2026-02-20T03:15:31.387805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089978+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:15:27.089978+0000","last_peered":"2026-02-20T03:15:27.089978+0000","last_clean":"2026-02-20T03:15:27.089978+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:15:27.089978+0000","last_undegraded":"2026-02-20T03:15:27.089978+0000","last_fullsized":"2026-02-20T03:15:27.089978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089476+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:15:27.089476+0000","last_peered":"2026-02-20T03:15:27.089476+0000","last_clean":"2026-02-20T03:15:27.089476+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:15:27.089476+0000","last_undegraded":"2026-02-20T03:15:27.089476+0000","last_fullsized":"2026-02-20T03:15:27.089476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097578+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:15:27.097578+0000","last_peered":"2026-02-20T03:15:27.097578+0000","last_clean":"2026-02-20T03:15:27.097578+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:15:27.097578+0000","last_undegraded":"2026-02-20T03:15:27.097578+0000","last_fullsized":"2026-02-20T03:15:27.097578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093923+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:15:27.093923+0000","last_peered":"2026-02-20T03:15:27.093923+0000","last_clean":"2026-02-20T03:15:27.093923+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:15:27.093923+0000","last_undegraded":"2026-02-20T03:15:27.093923+0000","last_fullsized":"2026-02-20T03:15:27.093923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677506+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:15:27.677506+0000","last_peered":"2026-02-20T03:15:27.677506+0000","last_clean":"2026-02-20T03:15:27.677506+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:15:27.677506+0000","last_undegraded":"2026-02-20T03:15:27.677506+0000","last_fullsized":"2026-02-20T03:15:27.677506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392678+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:15:27.392678+0000","last_peered":"2026-02-20T03:15:27.392678+0000","last_clean":"2026-02-20T03:15:27.392678+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:15:27.392678+0000","last_undegraded":"2026-02-20T03:15:27.392678+0000","last_fullsized":"2026-02-20T03:15:27.392678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":355,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097913+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:15:27.097913+0000","last_peered":"2026-02-20T03:15:27.097913+0000","last_clean":"2026-02-20T03:15:27.097913+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:15:27.097913+0000","last_undegraded":"2026-02-20T03:15:27.097913+0000","last_fullsized":"2026-02-20T03:15:27.097913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097882+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:15:27.097882+0000","last_peered":"2026-02-20T03:15:27.097882+0000","last_clean":"2026-02-20T03:15:27.097882+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:15:27.097882+0000","last_undegraded":"2026-02-20T03:15:27.097882+0000","last_fullsized":"2026-02-20T03:15:27.097882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098144+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:15:27.098144+0000","last_peered":"2026-02-20T03:15:27.098144+0000","last_clean":"2026-02-20T03:15:27.098144+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:15:27.098144+0000","last_undegraded":"2026-02-20T03:15:27.098144+0000","last_fullsized":"2026-02-20T03:15:27.098144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.104030+0000","last_change":"2026-02-20T03:15:27.104030+0000","last_active":"2026-02-20T03:15:27.104030+0000","last_peered":"2026-02-20T03:15:27.104030+0000","last_clean":"2026-02-20T03:15:27.104030+0000","last_became_active":"2026-02-20T03:15:27.101137+0000","last_became_peered":"2026-02-20T03:15:27.101137+0000","last_unstale":"2026-02-20T03:15:27.104030+0000","last_undegraded":"2026-02-20T03:15:27.104030+0000","last_fullsized":"2026-02-20T03:15:27.104030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:16.927063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099157+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:27.099157+0000","last_peered":"2026-02-20T03:15:27.099157+0000","last_clean":"2026-02-20T03:15:27.099157+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:27.099157+0000","last_undegraded":"2026-02-20T03:15:27.099157+0000","last_fullsized":"2026-02-20T03:15:27.099157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097824+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:15:27.097824+0000","last_peered":"2026-02-20T03:15:27.097824+0000","last_clean":"2026-02-20T03:15:27.097824+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:15:27.097824+0000","last_undegraded":"2026-02-20T03:15:27.097824+0000","last_fullsized":"2026-02-20T03:15:27.097824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094597+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:15:27.094597+0000","last_peered":"2026-02-20T03:15:27.094597+0000","last_clean":"2026-02-20T03:15:27.094597+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:15:27.094597+0000","last_undegraded":"2026-02-20T03:15:27.094597+0000","last_fullsized":"2026-02-20T03:15:27.094597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091583+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:27.091583+0000","last_peered":"2026-02-20T03:15:27.091583+0000","last_clean":"2026-02-20T03:15:27.091583+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:27.091583+0000","last_undegraded":"2026-02-20T03:15:27.091583+0000","last_fullsized":"2026-02-20T03:15:27.091583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098225+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:15:27.098225+0000","last_peered":"2026-02-20T03:15:27.098225+0000","last_clean":"2026-02-20T03:15:27.098225+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:15:27.098225+0000","last_undegraded":"2026-02-20T03:15:27.098225+0000","last_fullsized":"2026-02-20T03:15:27.098225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089901+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:15:27.089901+0000","last_peered":"2026-02-20T03:15:27.089901+0000","last_clean":"2026-02-20T03:15:27.089901+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:15:27.089901+0000","last_undegraded":"2026-02-20T03:15:27.089901+0000","last_fullsized":"2026-02-20T03:15:27.089901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093235+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:15:27.093235+0000","last_peered":"2026-02-20T03:15:27.093235+0000","last_clean":"2026-02-20T03:15:27.093235+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:15:27.093235+0000","last_undegraded":"2026-02-20T03:15:27.093235+0000","last_fullsized":"2026-02-20T03:15:27.093235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093959+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:15:27.093959+0000","last_peered":"2026-02-20T03:15:27.093959+0000","last_clean":"2026-02-20T03:15:27.093959+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:15:27.093959+0000","last_undegraded":"2026-02-20T03:15:27.093959+0000","last_fullsized":"2026-02-20T03:15:27.093959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:15:27.096403+0000","last_peered":"2026-02-20T03:15:27.096403+0000","last_clean":"2026-02-20T03:15:27.096403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:15:27.096403+0000","last_undegraded":"2026-02-20T03:15:27.096403+0000","last_fullsized":"2026-02-20T03:15:27.096403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093292+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:15:27.093292+0000","last_peered":"2026-02-20T03:15:27.093292+0000","last_clean":"2026-02-20T03:15:27.093292+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:15:27.093292+0000","last_undegraded":"2026-02-20T03:15:27.093292+0000","last_fullsized":"2026-02-20T03:15:27.093292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093347+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:15:27.093347+0000","last_peered":"2026-02-20T03:15:27.093347+0000","last_clean":"2026-02-20T03:15:27.093347+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:15:27.093347+0000","last_undegraded":"2026-02-20T03:15:27.093347+0000","last_fullsized":"2026-02-20T03:15:27.093347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095895+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:15:27.095895+0000","last_peered":"2026-02-20T03:15:27.095895+0000","last_clean":"2026-02-20T03:15:27.095895+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:15:27.095895+0000","last_undegraded":"2026-02-20T03:15:27.095895+0000","last_fullsized":"2026-02-20T03:15:27.095895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089892+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:15:27.089892+0000","last_peered":"2026-02-20T03:15:27.089892+0000","last_clean":"2026-02-20T03:15:27.089892+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:15:27.089892+0000","last_undegraded":"2026-02-20T03:15:27.089892+0000","last_fullsized":"2026-02-20T03:15:27.089892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097367+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:15:27.097367+0000","last_peered":"2026-02-20T03:15:27.097367+0000","last_clean":"2026-02-20T03:15:27.097367+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:15:27.097367+0000","last_undegraded":"2026-02-20T03:15:27.097367+0000","last_fullsized":"2026-02-20T03:15:27.097367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":77,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:33.396951+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:33.396951+0000","last_peered":"2026-02-20T03:15:33.396951+0000","last_clean":"2026-02-20T03:15:33.396951+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:33.396951+0000","last_undegraded":"2026-02-20T03:15:33.396951+0000","last_fullsized":"2026-02-20T03:15:33.396951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092155+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:15:27.092155+0000","last_peered":"2026-02-20T03:15:27.092155+0000","last_clean":"2026-02-20T03:15:27.092155+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:15:27.092155+0000","last_undegraded":"2026-02-20T03:15:27.092155+0000","last_fullsized":"2026-02-20T03:15:27.092155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097787+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:15:27.097787+0000","last_peered":"2026-02-20T03:15:27.097787+0000","last_clean":"2026-02-20T03:15:27.097787+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:15:27.097787+0000","last_undegraded":"2026-02-20T03:15:27.097787+0000","last_fullsized":"2026-02-20T03:15:27.097787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093616+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:15:27.093616+0000","last_peered":"2026-02-20T03:15:27.093616+0000","last_clean":"2026-02-20T03:15:27.093616+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:15:27.093616+0000","last_undegraded":"2026-02-20T03:15:27.093616+0000","last_fullsized":"2026-02-20T03:15:27.093616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093604+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:15:27.093604+0000","last_peered":"2026-02-20T03:15:27.093604+0000","last_clean":"2026-02-20T03:15:27.093604+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:15:27.093604+0000","last_undegraded":"2026-02-20T03:15:27.093604+0000","last_fullsized":"2026-02-20T03:15:27.093604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089674+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:15:27.089674+0000","last_peered":"2026-02-20T03:15:27.089674+0000","last_clean":"2026-02-20T03:15:27.089674+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:15:27.089674+0000","last_undegraded":"2026-02-20T03:15:27.089674+0000","last_fullsized":"2026-02-20T03:15:27.089674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092119+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:27.092119+0000","last_peered":"2026-02-20T03:15:27.092119+0000","last_clean":"2026-02-20T03:15:27.092119+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:27.092119+0000","last_undegraded":"2026-02-20T03:15:27.092119+0000","last_fullsized":"2026-02-20T03:15:27.092119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093756+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:15:27.093756+0000","last_peered":"2026-02-20T03:15:27.093756+0000","last_clean":"2026-02-20T03:15:27.093756+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:15:27.093756+0000","last_undegraded":"2026-02-20T03:15:27.093756+0000","last_fullsized":"2026-02-20T03:15:27.093756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096216+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:15:27.096216+0000","last_peered":"2026-02-20T03:15:27.096216+0000","last_clean":"2026-02-20T03:15:27.096216+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:15:27.096216+0000","last_undegraded":"2026-02-20T03:15:27.096216+0000","last_fullsized":"2026-02-20T03:15:27.096216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'36","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:34.399834+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:34.399834+0000","last_peered":"2026-02-20T03:15:34.399834+0000","last_clean":"2026-02-20T03:15:34.399834+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:34.399834+0000","last_undegraded":"2026-02-20T03:15:34.399834+0000","last_fullsized":"2026-02-20T03:15:34.399834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76903,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":125,"num_write":37,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091741+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:15:27.091741+0000","last_peered":"2026-02-20T03:15:27.091741+0000","last_clean":"2026-02-20T03:15:27.091741+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:15:27.091741+0000","last_undegraded":"2026-02-20T03:15:27.091741+0000","last_fullsized":"2026-02-20T03:15:27.091741+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100059+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:27.100059+0000","last_peered":"2026-02-20T03:15:27.100059+0000","last_clean":"2026-02-20T03:15:27.100059+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:27.100059+0000","last_undegraded":"2026-02-20T03:15:27.100059+0000","last_fullsized":"2026-02-20T03:15:27.100059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094441+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:15:27.094441+0000","last_peered":"2026-02-20T03:15:27.094441+0000","last_clean":"2026-02-20T03:15:27.094441+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:15:27.094441+0000","last_undegraded":"2026-02-20T03:15:27.094441+0000","last_fullsized":"2026-02-20T03:15:27.094441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392567+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:15:27.392567+0000","last_peered":"2026-02-20T03:15:27.392567+0000","last_clean":"2026-02-20T03:15:27.392567+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:15:27.392567+0000","last_undegraded":"2026-02-20T03:15:27.392567+0000","last_fullsized":"2026-02-20T03:15:27.392567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092453+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:27.092453+0000","last_peered":"2026-02-20T03:15:27.092453+0000","last_clean":"2026-02-20T03:15:27.092453+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:27.092453+0000","last_undegraded":"2026-02-20T03:15:27.092453+0000","last_fullsized":"2026-02-20T03:15:27.092453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098009+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:15:27.098009+0000","last_peered":"2026-02-20T03:15:27.098009+0000","last_clean":"2026-02-20T03:15:27.098009+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:15:27.098009+0000","last_undegraded":"2026-02-20T03:15:27.098009+0000","last_fullsized":"2026-02-20T03:15:27.098009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091618+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:15:27.091618+0000","last_peered":"2026-02-20T03:15:27.091618+0000","last_clean":"2026-02-20T03:15:27.091618+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:15:27.091618+0000","last_undegraded":"2026-02-20T03:15:27.091618+0000","last_fullsized":"2026-02-20T03:15:27.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099742+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:27.099742+0000","last_peered":"2026-02-20T03:15:27.099742+0000","last_clean":"2026-02-20T03:15:27.099742+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:27.099742+0000","last_undegraded":"2026-02-20T03:15:27.099742+0000","last_fullsized":"2026-02-20T03:15:27.099742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":74,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:33.391952+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:33.391952+0000","last_peered":"2026-02-20T03:15:33.391952+0000","last_clean":"2026-02-20T03:15:33.391952+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:33.391952+0000","last_undegraded":"2026-02-20T03:15:33.391952+0000","last_fullsized":"2026-02-20T03:15:33.391952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676945+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:15:27.676945+0000","last_peered":"2026-02-20T03:15:27.676945+0000","last_clean":"2026-02-20T03:15:27.676945+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:15:27.676945+0000","last_undegraded":"2026-02-20T03:15:27.676945+0000","last_fullsized":"2026-02-20T03:15:27.676945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091966+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:27.091966+0000","last_peered":"2026-02-20T03:15:27.091966+0000","last_clean":"2026-02-20T03:15:27.091966+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:27.091966+0000","last_undegraded":"2026-02-20T03:15:27.091966+0000","last_fullsized":"2026-02-20T03:15:27.091966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091995+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:15:27.091995+0000","last_peered":"2026-02-20T03:15:27.091995+0000","last_clean":"2026-02-20T03:15:27.091995+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:15:27.091995+0000","last_undegraded":"2026-02-20T03:15:27.091995+0000","last_fullsized":"2026-02-20T03:15:27.091995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094048+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:15:27.094048+0000","last_peered":"2026-02-20T03:15:27.094048+0000","last_clean":"2026-02-20T03:15:27.094048+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:15:27.094048+0000","last_undegraded":"2026-02-20T03:15:27.094048+0000","last_fullsized":"2026-02-20T03:15:27.094048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093983+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:15:27.093983+0000","last_peered":"2026-02-20T03:15:27.093983+0000","last_clean":"2026-02-20T03:15:27.093983+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:15:27.093983+0000","last_undegraded":"2026-02-20T03:15:27.093983+0000","last_fullsized":"2026-02-20T03:15:27.093983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676892+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:15:27.676892+0000","last_peered":"2026-02-20T03:15:27.676892+0000","last_clean":"2026-02-20T03:15:27.676892+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:15:27.676892+0000","last_undegraded":"2026-02-20T03:15:27.676892+0000","last_fullsized":"2026-02-20T03:15:27.676892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089481+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:15:27.089481+0000","last_peered":"2026-02-20T03:15:27.089481+0000","last_clean":"2026-02-20T03:15:27.089481+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:15:27.089481+0000","last_undegraded":"2026-02-20T03:15:27.089481+0000","last_fullsized":"2026-02-20T03:15:27.089481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383994+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:15:27.383994+0000","last_peered":"2026-02-20T03:15:27.383994+0000","last_clean":"2026-02-20T03:15:27.383994+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:15:27.383994+0000","last_undegraded":"2026-02-20T03:15:27.383994+0000","last_fullsized":"2026-02-20T03:15:27.383994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093591+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:15:27.093591+0000","last_peered":"2026-02-20T03:15:27.093591+0000","last_clean":"2026-02-20T03:15:27.093591+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:15:27.093591+0000","last_undegraded":"2026-02-20T03:15:27.093591+0000","last_fullsized":"2026-02-20T03:15:27.093591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092112+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:27.092112+0000","last_peered":"2026-02-20T03:15:27.092112+0000","last_clean":"2026-02-20T03:15:27.092112+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:27.092112+0000","last_undegraded":"2026-02-20T03:15:27.092112+0000","last_fullsized":"2026-02-20T03:15:27.092112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:33.386554+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:33.386554+0000","last_peered":"2026-02-20T03:15:33.386554+0000","last_clean":"2026-02-20T03:15:33.386554+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:33.386554+0000","last_undegraded":"2026-02-20T03:15:33.386554+0000","last_fullsized":"2026-02-20T03:15:33.386554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5947,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":8,"num_write":4,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096098+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:15:27.096098+0000","last_peered":"2026-02-20T03:15:27.096098+0000","last_clean":"2026-02-20T03:15:27.096098+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:15:27.096098+0000","last_undegraded":"2026-02-20T03:15:27.096098+0000","last_fullsized":"2026-02-20T03:15:27.096098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092190+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:27.092190+0000","last_peered":"2026-02-20T03:15:27.092190+0000","last_clean":"2026-02-20T03:15:27.092190+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:27.092190+0000","last_undegraded":"2026-02-20T03:15:27.092190+0000","last_fullsized":"2026-02-20T03:15:27.092190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092030+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:27.092030+0000","last_peered":"2026-02-20T03:15:27.092030+0000","last_clean":"2026-02-20T03:15:27.092030+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:27.092030+0000","last_undegraded":"2026-02-20T03:15:27.092030+0000","last_fullsized":"2026-02-20T03:15:27.092030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091880+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:27.091880+0000","last_peered":"2026-02-20T03:15:27.091880+0000","last_clean":"2026-02-20T03:15:27.091880+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:27.091880+0000","last_undegraded":"2026-02-20T03:15:27.091880+0000","last_fullsized":"2026-02-20T03:15:27.091880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092039+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:27.092039+0000","last_peered":"2026-02-20T03:15:27.092039+0000","last_clean":"2026-02-20T03:15:27.092039+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:27.092039+0000","last_undegraded":"2026-02-20T03:15:27.092039+0000","last_fullsized":"2026-02-20T03:15:27.092039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090007+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:15:27.090007+0000","last_peered":"2026-02-20T03:15:27.090007+0000","last_clean":"2026-02-20T03:15:27.090007+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:15:27.090007+0000","last_undegraded":"2026-02-20T03:15:27.090007+0000","last_fullsized":"2026-02-20T03:15:27.090007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096323+0000","last_change":"2026-02-20T03:15:27.096323+0000","last_active":"2026-02-20T03:15:27.096323+0000","last_peered":"2026-02-20T03:15:27.096323+0000","last_clean":"2026-02-20T03:15:27.096323+0000","last_became_active":"2026-02-20T03:15:27.096171+0000","last_became_peered":"2026-02-20T03:15:27.096171+0000","last_unstale":"2026-02-20T03:15:27.096323+0000","last_undegraded":"2026-02-20T03:15:27.096323+0000","last_fullsized":"2026-02-20T03:15:27.096323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:00:54.803500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092769+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:27.092769+0000","last_peered":"2026-02-20T03:15:27.092769+0000","last_clean":"2026-02-20T03:15:27.092769+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:27.092769+0000","last_undegraded":"2026-02-20T03:15:27.092769+0000","last_fullsized":"2026-02-20T03:15:27.092769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677330+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:15:27.677330+0000","last_peered":"2026-02-20T03:15:27.677330+0000","last_clean":"2026-02-20T03:15:27.677330+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:15:27.677330+0000","last_undegraded":"2026-02-20T03:15:27.677330+0000","last_fullsized":"2026-02-20T03:15:27.677330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093789+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:15:27.093789+0000","last_peered":"2026-02-20T03:15:27.093789+0000","last_clean":"2026-02-20T03:15:27.093789+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:15:27.093789+0000","last_undegraded":"2026-02-20T03:15:27.093789+0000","last_fullsized":"2026-02-20T03:15:27.093789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677022+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:15:27.677022+0000","last_peered":"2026-02-20T03:15:27.677022+0000","last_clean":"2026-02-20T03:15:27.677022+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:15:27.677022+0000","last_undegraded":"2026-02-20T03:15:27.677022+0000","last_fullsized":"2026-02-20T03:15:27.677022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099411+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:27.099411+0000","last_peered":"2026-02-20T03:15:27.099411+0000","last_clean":"2026-02-20T03:15:27.099411+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:27.099411+0000","last_undegraded":"2026-02-20T03:15:27.099411+0000","last_fullsized":"2026-02-20T03:15:27.099411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089899+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:15:27.089899+0000","last_peered":"2026-02-20T03:15:27.089899+0000","last_clean":"2026-02-20T03:15:27.089899+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:15:27.089899+0000","last_undegraded":"2026-02-20T03:15:27.089899+0000","last_fullsized":"2026-02-20T03:15:27.089899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093603+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:15:27.093603+0000","last_peered":"2026-02-20T03:15:27.093603+0000","last_clean":"2026-02-20T03:15:27.093603+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:15:27.093603+0000","last_undegraded":"2026-02-20T03:15:27.093603+0000","last_fullsized":"2026-02-20T03:15:27.093603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092566+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:27.092566+0000","last_peered":"2026-02-20T03:15:27.092566+0000","last_clean":"2026-02-20T03:15:27.092566+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:27.092566+0000","last_undegraded":"2026-02-20T03:15:27.092566+0000","last_fullsized":"2026-02-20T03:15:27.092566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092017+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:15:27.092017+0000","last_peered":"2026-02-20T03:15:27.092017+0000","last_clean":"2026-02-20T03:15:27.092017+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:15:27.092017+0000","last_undegraded":"2026-02-20T03:15:27.092017+0000","last_fullsized":"2026-02-20T03:15:27.092017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094334+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:15:27.094334+0000","last_peered":"2026-02-20T03:15:27.094334+0000","last_clean":"2026-02-20T03:15:27.094334+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:15:27.094334+0000","last_undegraded":"2026-02-20T03:15:27.094334+0000","last_fullsized":"2026-02-20T03:15:27.094334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098981+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:27.098981+0000","last_peered":"2026-02-20T03:15:27.098981+0000","last_clean":"2026-02-20T03:15:27.098981+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:27.098981+0000","last_undegraded":"2026-02-20T03:15:27.098981+0000","last_fullsized":"2026-02-20T03:15:27.098981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091896+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:27.091896+0000","last_peered":"2026-02-20T03:15:27.091896+0000","last_clean":"2026-02-20T03:15:27.091896+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:27.091896+0000","last_undegraded":"2026-02-20T03:15:27.091896+0000","last_fullsized":"2026-02-20T03:15:27.091896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091504+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:27.091504+0000","last_peered":"2026-02-20T03:15:27.091504+0000","last_clean":"2026-02-20T03:15:27.091504+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:27.091504+0000","last_undegraded":"2026-02-20T03:15:27.091504+0000","last_fullsized":"2026-02-20T03:15:27.091504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089821+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:15:27.089821+0000","last_peered":"2026-02-20T03:15:27.089821+0000","last_clean":"2026-02-20T03:15:27.089821+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:15:27.089821+0000","last_undegraded":"2026-02-20T03:15:27.089821+0000","last_fullsized":"2026-02-20T03:15:27.089821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392752+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:15:27.392752+0000","last_peered":"2026-02-20T03:15:27.392752+0000","last_clean":"2026-02-20T03:15:27.392752+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:15:27.392752+0000","last_undegraded":"2026-02-20T03:15:27.392752+0000","last_fullsized":"2026-02-20T03:15:27.392752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098066+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:15:27.098066+0000","last_peered":"2026-02-20T03:15:27.098066+0000","last_clean":"2026-02-20T03:15:27.098066+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:15:27.098066+0000","last_undegraded":"2026-02-20T03:15:27.098066+0000","last_fullsized":"2026-02-20T03:15:27.098066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384200+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:15:27.384200+0000","last_peered":"2026-02-20T03:15:27.384200+0000","last_clean":"2026-02-20T03:15:27.384200+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:15:27.384200+0000","last_undegraded":"2026-02-20T03:15:27.384200+0000","last_fullsized":"2026-02-20T03:15:27.384200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.101465+0000","last_change":"2026-02-20T03:15:27.101465+0000","last_active":"2026-02-20T03:15:27.101465+0000","last_peered":"2026-02-20T03:15:27.101465+0000","last_clean":"2026-02-20T03:15:27.101465+0000","last_became_active":"2026-02-20T03:15:27.101042+0000","last_became_peered":"2026-02-20T03:15:27.101042+0000","last_unstale":"2026-02-20T03:15:27.101465+0000","last_undegraded":"2026-02-20T03:15:27.101465+0000","last_fullsized":"2026-02-20T03:15:27.101465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:16:15.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676902+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:15:27.676902+0000","last_peered":"2026-02-20T03:15:27.676902+0000","last_clean":"2026-02-20T03:15:27.676902+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:15:27.676902+0000","last_undegraded":"2026-02-20T03:15:27.676902+0000","last_fullsized":"2026-02-20T03:15:27.676902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097349+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:15:27.097349+0000","last_peered":"2026-02-20T03:15:27.097349+0000","last_clean":"2026-02-20T03:15:27.097349+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:15:27.097349+0000","last_undegraded":"2026-02-20T03:15:27.097349+0000","last_fullsized":"2026-02-20T03:15:27.097349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383987+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:15:27.383987+0000","last_peered":"2026-02-20T03:15:27.383987+0000","last_clean":"2026-02-20T03:15:27.383987+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:15:27.383987+0000","last_undegraded":"2026-02-20T03:15:27.383987+0000","last_fullsized":"2026-02-20T03:15:27.383987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392687+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:15:27.392687+0000","last_peered":"2026-02-20T03:15:27.392687+0000","last_clean":"2026-02-20T03:15:27.392687+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:15:27.392687+0000","last_undegraded":"2026-02-20T03:15:27.392687+0000","last_fullsized":"2026-02-20T03:15:27.392687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091837+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:27.091837+0000","last_peered":"2026-02-20T03:15:27.091837+0000","last_clean":"2026-02-20T03:15:27.091837+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:27.091837+0000","last_undegraded":"2026-02-20T03:15:27.091837+0000","last_fullsized":"2026-02-20T03:15:27.091837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091994+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:27.091994+0000","last_peered":"2026-02-20T03:15:27.091994+0000","last_clean":"2026-02-20T03:15:27.091994+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:27.091994+0000","last_undegraded":"2026-02-20T03:15:27.091994+0000","last_fullsized":"2026-02-20T03:15:27.091994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094313+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:15:27.094313+0000","last_peered":"2026-02-20T03:15:27.094313+0000","last_clean":"2026-02-20T03:15:27.094313+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:15:27.094313+0000","last_undegraded":"2026-02-20T03:15:27.094313+0000","last_fullsized":"2026-02-20T03:15:27.094313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":86260,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":286,"num_read_kb":232,"num_write":175,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":258902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32140,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971060,"statfs":{"total":751619276800,"available":751586365440,"internally_reserved":0,"allocated":1032192,"data_stored":502911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612628,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32816,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970384,"statfs":{"total":751619276800,"available":751585673216,"internally_reserved":0,"allocated":1732608,"data_stored":1167452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776150,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":507221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037785,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32136,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971064,"statfs":{"total":751619276800,"available":751586369536,"internally_reserved":0,"allocated":1036288,"data_stored":502431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299419,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32728,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970472,"statfs":{"total":751619276800,"available":751585763328,"internally_reserved":0,"allocated":1642496,"data_stored":1104341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1024000,"data_stored":498291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724575,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28576,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974624,"statfs":{"total":751619276800,"available":751590014976,"internally_reserved":0,"allocated":1650688,"data_stored":1099476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888097,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32148,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971052,"statfs":{"total":751619276800,"available":751586357248,"internally_reserved":0,"allocated":1040384,"data_stored":503925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149731,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27976,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975224,"statfs":{"total":751619276800,"available":751590629376,"internally_reserved":0,"allocated":1036288,"data_stored":498485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378662,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28068,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975132,"statfs":{"total":751619276800,"available":751590535168,"internally_reserved":0,"allocated":1130496,"data_stored":581258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28048,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975152,"statfs":{"total":751619276800,"available":751590555648,"internally_reserved":0,"allocated":1110016,"data_stored":575696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":499699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":77495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":83057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":78883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:38.848 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-20T03:15:38.848 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph pg dump --format=json 2026-02-20T03:15:39.113 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:39.157 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:39 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:15:39.157 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:39 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:15:39.157 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:39 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:15:39.157 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:39 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:15:39.157 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:39 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:15:39.157 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:39 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:15:39.157 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:39 trial028 ceph-mon[38552]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:39.157 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:39 trial028 ceph-mon[38552]: pgmap v207: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 110 B/s, 0 objects/s recovering 2026-02-20T03:15:39.157 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:39 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:15:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.298+0000 7f39a97e1640 1 -- 10.20.193.28:0/28311399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4104da0 msgr2=0x7f39a4105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.298+0000 7f39a97e1640 1 --2- 10.20.193.28:0/28311399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4104da0 0x7f39a4105180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3998009a30 tx=0x7f399802f220 comp rx=0 tx=0).stop 2026-02-20T03:15:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.298+0000 7f39a97e1640 1 -- 10.20.193.28:0/28311399 shutdown_connections 2026-02-20T03:15:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.298+0000 7f39a97e1640 1 --2- 10.20.193.28:0/28311399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f39a4109ed0 0x7f39a4111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.298+0000 7f39a97e1640 1 --2- 10.20.193.28:0/28311399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39a4105750 0x7f39a41097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.298+0000 7f39a97e1640 1 --2- 10.20.193.28:0/28311399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4104da0 0x7f39a4105180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.298+0000 7f39a97e1640 1 -- 10.20.193.28:0/28311399 >> 10.20.193.28:0/28311399 conn(0x7f39a4100840 msgr2=0x7f39a4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.298+0000 7f39a97e1640 1 -- 10.20.193.28:0/28311399 shutdown_connections 2026-02-20T03:15:39.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.298+0000 7f39a97e1640 1 -- 10.20.193.28:0/28311399 wait complete. 2026-02-20T03:15:39.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a97e1640 1 Processor -- start 2026-02-20T03:15:39.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a97e1640 1 -- start start 2026-02-20T03:15:39.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a97e1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f39a4104da0 0x7f39a419d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:39.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a97e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4105750 0x7f39a419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:39.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a97e1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39a4109ed0 0x7f39a41a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a97e1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4114da0 con 0x7f39a4105750 2026-02-20T03:15:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a97e1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4114c20 con 0x7f39a4109ed0 2026-02-20T03:15:39.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a97e1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4114f20 con 0x7f39a4104da0 2026-02-20T03:15:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4105750 0x7f39a419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4105750 0x7f39a419d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56346/0 (socket says 10.20.193.28:56346) 2026-02-20T03:15:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a27fc640 1 -- 10.20.193.28:0/2163765494 learned_addr learned my addr 10.20.193.28:0/2163765494 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a37fe640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39a4109ed0 0x7f39a41a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a2ffd640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f39a4104da0 0x7f39a419d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a27fc640 1 -- 10.20.193.28:0/2163765494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f39a4104da0 msgr2=0x7f39a419d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:39.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a27fc640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f39a4104da0 0x7f39a419d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a27fc640 1 -- 10.20.193.28:0/2163765494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39a4109ed0 msgr2=0x7f39a41a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.299+0000 7f39a27fc640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39a4109ed0 0x7f39a41a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.300+0000 7f39a27fc640 1 -- 10.20.193.28:0/2163765494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a41a2250 con 0x7f39a4105750 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.300+0000 7f39a27fc640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4105750 0x7f39a419d740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f398c00d950 tx=0x7f398c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.300+0000 7f3983fff640 1 -- 10.20.193.28:0/2163765494 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c014070 con 0x7f39a4105750 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.300+0000 7f3983fff640 1 -- 10.20.193.28:0/2163765494 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f398c0044e0 con 0x7f39a4105750 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.300+0000 7f3983fff640 1 -- 10.20.193.28:0/2163765494 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c005020 con 0x7f39a4105750 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.300+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a41a2540 con 0x7f39a4105750 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.300+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a41a9d80 con 0x7f39a4105750 2026-02-20T03:15:39.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.301+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a4105180 con 0x7f39a4105750 2026-02-20T03:15:39.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.303+0000 7f3983fff640 1 -- 10.20.193.28:0/2163765494 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f398c00b900 con 0x7f39a4105750 2026-02-20T03:15:39.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.304+0000 7f3983fff640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f39740b0eb0 0x7f39740b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:39.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.305+0000 7f3983fff640 1 -- 10.20.193.28:0/2163765494 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f398c0e0d60 con 0x7f39a4105750 2026-02-20T03:15:39.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.305+0000 7f39a2ffd640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f39740b0eb0 0x7f39740b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:39.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.305+0000 7f3983fff640 1 -- 10.20.193.28:0/2163765494 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f398c0e11e0 con 0x7f39a4105750 2026-02-20T03:15:39.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.305+0000 7f39a2ffd640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f39740b0eb0 0x7f39740b3370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3998002410 tx=0x7f399803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:39.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.394+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 --> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39a410cd00 con 0x7f39740b0eb0 2026-02-20T03:15:39.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.399+0000 7f3983fff640 1 -- 10.20.193.28:0/2163765494 <== mgr.14150 v2:10.20.193.28:6800/3562582510 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340410 (secure 0 0 0) 0x7f399809b1d0 con 0x7f39740b0eb0 2026-02-20T03:15:39.405 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:39.407 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T03:15:39.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f39740b0eb0 msgr2=0x7f39740b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:39.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f39740b0eb0 0x7f39740b3370 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3998002410 tx=0x7f399803a040 comp rx=0 tx=0).stop 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4105750 msgr2=0x7f39a419d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4105750 0x7f39a419d740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f398c00d950 tx=0x7f398c00de20 comp rx=0 tx=0).stop 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 shutdown_connections 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f39740b0eb0 0x7f39740b3370 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f39a4109ed0 0x7f39a41a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f39a4105750 0x7f39a419d740 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 --2- 10.20.193.28:0/2163765494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f39a4104da0 0x7f39a419d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 >> 10.20.193.28:0/2163765494 conn(0x7f39a4100840 msgr2=0x7f39a4101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 shutdown_connections 2026-02-20T03:15:39.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.402+0000 7f39a97e1640 1 -- 10.20.193.28:0/2163765494 wait complete. 2026-02-20T03:15:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:39 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:15:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:39 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:15:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:39 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:15:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:39 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:15:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:39 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:15:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:39 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:15:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:39 trial177 ceph-mon[43181]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:39 trial177 ceph-mon[43181]: pgmap v207: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 110 B/s, 0 objects/s recovering 2026-02-20T03:15:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:39 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:15:39.504 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":207,"stamp":"2026-02-20T03:15:38.011824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":676862,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":392,"num_read_kb":323,"num_write":366,"num_write_kb":3860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181942,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":358600,"kb_used_data":14192,"kb_used_omap":18,"kb_used_meta":344109,"kb_avail":8807679800,"statfs":{"total":9019431321600,"available":9019064115200,"internally_reserved":0,"allocated":14532608,"data_stored":8041186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":352367946},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12894,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":44,"num_write":9,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.923274"},"pg_stats":[{"pgid":"2.1f","version":"89'9","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.389259+0000","last_change":"2026-02-20T03:15:27.389259+0000","last_active":"2026-02-20T03:15:27.389259+0000","last_peered":"2026-02-20T03:15:27.389259+0000","last_clean":"2026-02-20T03:15:27.389259+0000","last_became_active":"2026-02-20T03:15:27.385887+0000","last_became_peered":"2026-02-20T03:15:27.385887+0000","last_unstale":"2026-02-20T03:15:27.389259+0000","last_undegraded":"2026-02-20T03:15:27.389259+0000","last_fullsized":"2026-02-20T03:15:27.389259+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:20:01.907763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677322+0000","last_change":"2026-02-20T03:14:33.286074+0000","last_active":"2026-02-20T03:15:27.677322+0000","last_peered":"2026-02-20T03:15:27.677322+0000","last_clean":"2026-02-20T03:15:27.677322+0000","last_became_active":"2026-02-20T03:14:33.285965+0000","last_became_peered":"2026-02-20T03:14:33.285965+0000","last_unstale":"2026-02-20T03:15:27.677322+0000","last_undegraded":"2026-02-20T03:15:27.677322+0000","last_fullsized":"2026-02-20T03:15:27.677322+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:17:20.376052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091764+0000","last_change":"2026-02-20T03:14:37.314485+0000","last_active":"2026-02-20T03:15:27.091764+0000","last_peered":"2026-02-20T03:15:27.091764+0000","last_clean":"2026-02-20T03:15:27.091764+0000","last_became_active":"2026-02-20T03:14:37.314327+0000","last_became_peered":"2026-02-20T03:14:37.314327+0000","last_unstale":"2026-02-20T03:15:27.091764+0000","last_undegraded":"2026-02-20T03:15:27.091764+0000","last_fullsized":"2026-02-20T03:15:27.091764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:56:03.760368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677381+0000","last_change":"2026-02-20T03:14:32.076842+0000","last_active":"2026-02-20T03:15:27.677381+0000","last_peered":"2026-02-20T03:15:27.677381+0000","last_clean":"2026-02-20T03:15:27.677381+0000","last_became_active":"2026-02-20T03:14:32.076708+0000","last_became_peered":"2026-02-20T03:14:32.076708+0000","last_unstale":"2026-02-20T03:15:27.677381+0000","last_undegraded":"2026-02-20T03:15:27.677381+0000","last_fullsized":"2026-02-20T03:15:27.677381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:09:39.610025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092401+0000","last_change":"2026-02-20T03:14:33.300305+0000","last_active":"2026-02-20T03:15:27.092401+0000","last_peered":"2026-02-20T03:15:27.092401+0000","last_clean":"2026-02-20T03:15:27.092401+0000","last_became_active":"2026-02-20T03:14:33.300223+0000","last_became_peered":"2026-02-20T03:14:33.300223+0000","last_unstale":"2026-02-20T03:15:27.092401+0000","last_undegraded":"2026-02-20T03:15:27.092401+0000","last_fullsized":"2026-02-20T03:15:27.092401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:49.862967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392166+0000","last_change":"2026-02-20T03:14:37.324424+0000","last_active":"2026-02-20T03:15:27.392166+0000","last_peered":"2026-02-20T03:15:27.392166+0000","last_clean":"2026-02-20T03:15:27.392166+0000","last_became_active":"2026-02-20T03:14:37.324248+0000","last_became_peered":"2026-02-20T03:14:37.324248+0000","last_unstale":"2026-02-20T03:15:27.392166+0000","last_undegraded":"2026-02-20T03:15:27.392166+0000","last_fullsized":"2026-02-20T03:15:27.392166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:45:00.121785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096362+0000","last_change":"2026-02-20T03:14:32.077518+0000","last_active":"2026-02-20T03:15:27.096362+0000","last_peered":"2026-02-20T03:15:27.096362+0000","last_clean":"2026-02-20T03:15:27.096362+0000","last_became_active":"2026-02-20T03:14:32.077389+0000","last_became_peered":"2026-02-20T03:14:32.077389+0000","last_unstale":"2026-02-20T03:15:27.096362+0000","last_undegraded":"2026-02-20T03:15:27.096362+0000","last_fullsized":"2026-02-20T03:15:27.096362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:49:20.580514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100051+0000","last_change":"2026-02-20T03:14:33.303908+0000","last_active":"2026-02-20T03:15:27.100051+0000","last_peered":"2026-02-20T03:15:27.100051+0000","last_clean":"2026-02-20T03:15:27.100051+0000","last_became_active":"2026-02-20T03:14:33.303788+0000","last_became_peered":"2026-02-20T03:14:33.303788+0000","last_unstale":"2026-02-20T03:15:27.100051+0000","last_undegraded":"2026-02-20T03:15:27.100051+0000","last_fullsized":"2026-02-20T03:15:27.100051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:20:00.521715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392411+0000","last_change":"2026-02-20T03:14:37.328896+0000","last_active":"2026-02-20T03:15:27.392411+0000","last_peered":"2026-02-20T03:15:27.392411+0000","last_clean":"2026-02-20T03:15:27.392411+0000","last_became_active":"2026-02-20T03:14:37.328708+0000","last_became_peered":"2026-02-20T03:14:37.328708+0000","last_unstale":"2026-02-20T03:15:27.392411+0000","last_undegraded":"2026-02-20T03:15:27.392411+0000","last_fullsized":"2026-02-20T03:15:27.392411+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:25.374558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096305+0000","last_change":"2026-02-20T03:14:32.076195+0000","last_active":"2026-02-20T03:15:27.096305+0000","last_peered":"2026-02-20T03:15:27.096305+0000","last_clean":"2026-02-20T03:15:27.096305+0000","last_became_active":"2026-02-20T03:14:32.076077+0000","last_became_peered":"2026-02-20T03:14:32.076077+0000","last_unstale":"2026-02-20T03:15:27.096305+0000","last_undegraded":"2026-02-20T03:15:27.096305+0000","last_fullsized":"2026-02-20T03:15:27.096305+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:34:58.860766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096792+0000","last_change":"2026-02-20T03:15:27.096792+0000","last_active":"2026-02-20T03:15:27.096792+0000","last_peered":"2026-02-20T03:15:27.096792+0000","last_clean":"2026-02-20T03:15:27.096792+0000","last_became_active":"2026-02-20T03:15:27.096659+0000","last_became_peered":"2026-02-20T03:15:27.096659+0000","last_unstale":"2026-02-20T03:15:27.096792+0000","last_undegraded":"2026-02-20T03:15:27.096792+0000","last_fullsized":"2026-02-20T03:15:27.096792+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:57.312267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392339+0000","last_change":"2026-02-20T03:14:37.317018+0000","last_active":"2026-02-20T03:15:27.392339+0000","last_peered":"2026-02-20T03:15:27.392339+0000","last_clean":"2026-02-20T03:15:27.392339+0000","last_became_active":"2026-02-20T03:14:37.316830+0000","last_became_peered":"2026-02-20T03:14:37.316830+0000","last_unstale":"2026-02-20T03:15:27.392339+0000","last_undegraded":"2026-02-20T03:15:27.392339+0000","last_fullsized":"2026-02-20T03:15:27.392339+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:22:47.546091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097517+0000","last_change":"2026-02-20T03:14:33.303924+0000","last_active":"2026-02-20T03:15:27.097517+0000","last_peered":"2026-02-20T03:15:27.097517+0000","last_clean":"2026-02-20T03:15:27.097517+0000","last_became_active":"2026-02-20T03:14:33.303714+0000","last_became_peered":"2026-02-20T03:14:33.303714+0000","last_unstale":"2026-02-20T03:15:27.097517+0000","last_undegraded":"2026-02-20T03:15:27.097517+0000","last_fullsized":"2026-02-20T03:15:27.097517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:33:09.351298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:32.078049+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:32.077916+0000","last_became_peered":"2026-02-20T03:14:32.077916+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:08:44.745850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392602+0000","last_change":"2026-02-20T03:14:37.379871+0000","last_active":"2026-02-20T03:15:27.392602+0000","last_peered":"2026-02-20T03:15:27.392602+0000","last_clean":"2026-02-20T03:15:27.392602+0000","last_became_active":"2026-02-20T03:14:37.379647+0000","last_became_peered":"2026-02-20T03:14:37.379647+0000","last_unstale":"2026-02-20T03:15:27.392602+0000","last_undegraded":"2026-02-20T03:15:27.392602+0000","last_fullsized":"2026-02-20T03:15:27.392602+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:41.271965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677473+0000","last_change":"2026-02-20T03:14:33.291179+0000","last_active":"2026-02-20T03:15:27.677473+0000","last_peered":"2026-02-20T03:15:27.677473+0000","last_clean":"2026-02-20T03:15:27.677473+0000","last_became_active":"2026-02-20T03:14:33.290044+0000","last_became_peered":"2026-02-20T03:14:33.290044+0000","last_unstale":"2026-02-20T03:15:27.677473+0000","last_undegraded":"2026-02-20T03:15:27.677473+0000","last_fullsized":"2026-02-20T03:15:27.677473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:22:08.084040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"91'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092021+0000","last_change":"2026-02-20T03:14:32.080331+0000","last_active":"2026-02-20T03:15:27.092021+0000","last_peered":"2026-02-20T03:15:27.092021+0000","last_clean":"2026-02-20T03:15:27.092021+0000","last_became_active":"2026-02-20T03:14:32.080095+0000","last_became_peered":"2026-02-20T03:14:32.080095+0000","last_unstale":"2026-02-20T03:15:27.092021+0000","last_undegraded":"2026-02-20T03:15:27.092021+0000","last_fullsized":"2026-02-20T03:15:27.092021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:37.642069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392578+0000","last_change":"2026-02-20T03:14:37.328898+0000","last_active":"2026-02-20T03:15:27.392578+0000","last_peered":"2026-02-20T03:15:27.392578+0000","last_clean":"2026-02-20T03:15:27.392578+0000","last_became_active":"2026-02-20T03:14:37.328723+0000","last_became_peered":"2026-02-20T03:14:37.328723+0000","last_unstale":"2026-02-20T03:15:27.392578+0000","last_undegraded":"2026-02-20T03:15:27.392578+0000","last_fullsized":"2026-02-20T03:15:27.392578+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:53:23.042899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.295054+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.294829+0000","last_became_peered":"2026-02-20T03:14:33.294829+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:54:36.255637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677054+0000","last_change":"2026-02-20T03:14:32.079079+0000","last_active":"2026-02-20T03:15:27.677054+0000","last_peered":"2026-02-20T03:15:27.677054+0000","last_clean":"2026-02-20T03:15:27.677054+0000","last_became_active":"2026-02-20T03:14:32.078990+0000","last_became_peered":"2026-02-20T03:14:32.078990+0000","last_unstale":"2026-02-20T03:15:27.677054+0000","last_undegraded":"2026-02-20T03:15:27.677054+0000","last_fullsized":"2026-02-20T03:15:27.677054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:03:41.496169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092084+0000","last_change":"2026-02-20T03:14:37.319518+0000","last_active":"2026-02-20T03:15:27.092084+0000","last_peered":"2026-02-20T03:15:27.092084+0000","last_clean":"2026-02-20T03:15:27.092084+0000","last_became_active":"2026-02-20T03:14:37.318696+0000","last_became_peered":"2026-02-20T03:14:37.318696+0000","last_unstale":"2026-02-20T03:15:27.092084+0000","last_undegraded":"2026-02-20T03:15:27.092084+0000","last_fullsized":"2026-02-20T03:15:27.092084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:11:24.223374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095913+0000","last_change":"2026-02-20T03:14:33.290547+0000","last_active":"2026-02-20T03:15:27.095913+0000","last_peered":"2026-02-20T03:15:27.095913+0000","last_clean":"2026-02-20T03:15:27.095913+0000","last_became_active":"2026-02-20T03:14:33.290350+0000","last_became_peered":"2026-02-20T03:14:33.290350+0000","last_unstale":"2026-02-20T03:15:27.095913+0000","last_undegraded":"2026-02-20T03:15:27.095913+0000","last_fullsized":"2026-02-20T03:15:27.095913+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:27:50.762417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.106320+0000","last_change":"2026-02-20T03:15:27.106320+0000","last_active":"2026-02-20T03:15:27.106320+0000","last_peered":"2026-02-20T03:15:27.106320+0000","last_clean":"2026-02-20T03:15:27.106320+0000","last_became_active":"2026-02-20T03:15:27.101151+0000","last_became_peered":"2026-02-20T03:15:27.101151+0000","last_unstale":"2026-02-20T03:15:27.106320+0000","last_undegraded":"2026-02-20T03:15:27.106320+0000","last_fullsized":"2026-02-20T03:15:27.106320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:56.197115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392629+0000","last_change":"2026-02-20T03:14:37.380399+0000","last_active":"2026-02-20T03:15:27.392629+0000","last_peered":"2026-02-20T03:15:27.392629+0000","last_clean":"2026-02-20T03:15:27.392629+0000","last_became_active":"2026-02-20T03:14:37.380187+0000","last_became_peered":"2026-02-20T03:14:37.380187+0000","last_unstale":"2026-02-20T03:15:27.392629+0000","last_undegraded":"2026-02-20T03:15:27.392629+0000","last_fullsized":"2026-02-20T03:15:27.392629+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:24:47.682489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093728+0000","last_change":"2026-02-20T03:15:27.093728+0000","last_active":"2026-02-20T03:15:27.093728+0000","last_peered":"2026-02-20T03:15:27.093728+0000","last_clean":"2026-02-20T03:15:27.093728+0000","last_became_active":"2026-02-20T03:15:27.093455+0000","last_became_peered":"2026-02-20T03:15:27.093455+0000","last_unstale":"2026-02-20T03:15:27.093728+0000","last_undegraded":"2026-02-20T03:15:27.093728+0000","last_fullsized":"2026-02-20T03:15:27.093728+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:38:26.593708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"89'4","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392844+0000","last_change":"2026-02-20T03:14:32.084417+0000","last_active":"2026-02-20T03:15:27.392844+0000","last_peered":"2026-02-20T03:15:27.392844+0000","last_clean":"2026-02-20T03:15:27.392844+0000","last_became_active":"2026-02-20T03:14:32.084289+0000","last_became_peered":"2026-02-20T03:14:32.084289+0000","last_unstale":"2026-02-20T03:15:27.392844+0000","last_undegraded":"2026-02-20T03:15:27.392844+0000","last_fullsized":"2026-02-20T03:15:27.392844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:52.652997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091895+0000","last_change":"2026-02-20T03:14:37.309750+0000","last_active":"2026-02-20T03:15:27.091895+0000","last_peered":"2026-02-20T03:15:27.091895+0000","last_clean":"2026-02-20T03:15:27.091895+0000","last_became_active":"2026-02-20T03:14:37.309459+0000","last_became_peered":"2026-02-20T03:14:37.309459+0000","last_unstale":"2026-02-20T03:15:27.091895+0000","last_undegraded":"2026-02-20T03:15:27.091895+0000","last_fullsized":"2026-02-20T03:15:27.091895+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:49:31.020334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677369+0000","last_change":"2026-02-20T03:14:33.290390+0000","last_active":"2026-02-20T03:15:27.677369+0000","last_peered":"2026-02-20T03:15:27.677369+0000","last_clean":"2026-02-20T03:15:27.677369+0000","last_became_active":"2026-02-20T03:14:33.289133+0000","last_became_peered":"2026-02-20T03:14:33.289133+0000","last_unstale":"2026-02-20T03:15:27.677369+0000","last_undegraded":"2026-02-20T03:15:27.677369+0000","last_fullsized":"2026-02-20T03:15:27.677369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:25:40.507078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'11","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092083+0000","last_change":"2026-02-20T03:14:32.082347+0000","last_active":"2026-02-20T03:15:27.092083+0000","last_peered":"2026-02-20T03:15:27.092083+0000","last_clean":"2026-02-20T03:15:27.092083+0000","last_became_active":"2026-02-20T03:14:32.082251+0000","last_became_peered":"2026-02-20T03:14:32.082251+0000","last_unstale":"2026-02-20T03:15:27.092083+0000","last_undegraded":"2026-02-20T03:15:27.092083+0000","last_fullsized":"2026-02-20T03:15:27.092083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:41:06.789249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676826+0000","last_change":"2026-02-20T03:14:37.373082+0000","last_active":"2026-02-20T03:15:27.676826+0000","last_peered":"2026-02-20T03:15:27.676826+0000","last_clean":"2026-02-20T03:15:27.676826+0000","last_became_active":"2026-02-20T03:14:37.372883+0000","last_became_peered":"2026-02-20T03:14:37.372883+0000","last_unstale":"2026-02-20T03:15:27.676826+0000","last_undegraded":"2026-02-20T03:15:27.676826+0000","last_fullsized":"2026-02-20T03:15:27.676826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:04.442673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090039+0000","last_change":"2026-02-20T03:14:33.287995+0000","last_active":"2026-02-20T03:15:27.090039+0000","last_peered":"2026-02-20T03:15:27.090039+0000","last_clean":"2026-02-20T03:15:27.090039+0000","last_became_active":"2026-02-20T03:14:33.287396+0000","last_became_peered":"2026-02-20T03:14:33.287396+0000","last_unstale":"2026-02-20T03:15:27.090039+0000","last_undegraded":"2026-02-20T03:15:27.090039+0000","last_fullsized":"2026-02-20T03:15:27.090039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:36:53.740594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"89'1","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099935+0000","last_change":"2026-02-20T03:15:27.099749+0000","last_active":"2026-02-20T03:15:27.099935+0000","last_peered":"2026-02-20T03:15:27.099935+0000","last_clean":"2026-02-20T03:15:27.099935+0000","last_became_active":"2026-02-20T03:15:27.096338+0000","last_became_peered":"2026-02-20T03:15:27.096338+0000","last_unstale":"2026-02-20T03:15:27.099935+0000","last_undegraded":"2026-02-20T03:15:27.099935+0000","last_fullsized":"2026-02-20T03:15:27.099935+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:59:55.738735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093553+0000","last_change":"2026-02-20T03:14:37.311745+0000","last_active":"2026-02-20T03:15:27.093553+0000","last_peered":"2026-02-20T03:15:27.093553+0000","last_clean":"2026-02-20T03:15:27.093553+0000","last_became_active":"2026-02-20T03:14:37.311566+0000","last_became_peered":"2026-02-20T03:14:37.311566+0000","last_unstale":"2026-02-20T03:15:27.093553+0000","last_undegraded":"2026-02-20T03:15:27.093553+0000","last_fullsized":"2026-02-20T03:15:27.093553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:04:24.900058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384089+0000","last_change":"2026-02-20T03:14:33.303819+0000","last_active":"2026-02-20T03:15:27.384089+0000","last_peered":"2026-02-20T03:15:27.384089+0000","last_clean":"2026-02-20T03:15:27.384089+0000","last_became_active":"2026-02-20T03:14:33.303658+0000","last_became_peered":"2026-02-20T03:14:33.303658+0000","last_unstale":"2026-02-20T03:15:27.384089+0000","last_undegraded":"2026-02-20T03:15:27.384089+0000","last_fullsized":"2026-02-20T03:15:27.384089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:39:51.709415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091877+0000","last_change":"2026-02-20T03:14:32.081159+0000","last_active":"2026-02-20T03:15:27.091877+0000","last_peered":"2026-02-20T03:15:27.091877+0000","last_clean":"2026-02-20T03:15:27.091877+0000","last_became_active":"2026-02-20T03:14:32.080958+0000","last_became_peered":"2026-02-20T03:14:32.080958+0000","last_unstale":"2026-02-20T03:15:27.091877+0000","last_undegraded":"2026-02-20T03:15:27.091877+0000","last_fullsized":"2026-02-20T03:15:27.091877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:21:58.895052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095909+0000","last_change":"2026-02-20T03:14:37.374955+0000","last_active":"2026-02-20T03:15:27.095909+0000","last_peered":"2026-02-20T03:15:27.095909+0000","last_clean":"2026-02-20T03:15:27.095909+0000","last_became_active":"2026-02-20T03:14:37.374781+0000","last_became_peered":"2026-02-20T03:14:37.374781+0000","last_unstale":"2026-02-20T03:15:27.095909+0000","last_undegraded":"2026-02-20T03:15:27.095909+0000","last_fullsized":"2026-02-20T03:15:27.095909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:33:58.736587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384056+0000","last_change":"2026-02-20T03:14:33.301575+0000","last_active":"2026-02-20T03:15:27.384056+0000","last_peered":"2026-02-20T03:15:27.384056+0000","last_clean":"2026-02-20T03:15:27.384056+0000","last_became_active":"2026-02-20T03:14:33.301449+0000","last_became_peered":"2026-02-20T03:14:33.301449+0000","last_unstale":"2026-02-20T03:15:27.384056+0000","last_undegraded":"2026-02-20T03:15:27.384056+0000","last_fullsized":"2026-02-20T03:15:27.384056+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:25.524016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097629+0000","last_change":"2026-02-20T03:14:32.085186+0000","last_active":"2026-02-20T03:15:27.097629+0000","last_peered":"2026-02-20T03:15:27.097629+0000","last_clean":"2026-02-20T03:15:27.097629+0000","last_became_active":"2026-02-20T03:14:32.085053+0000","last_became_peered":"2026-02-20T03:14:32.085053+0000","last_unstale":"2026-02-20T03:15:27.097629+0000","last_undegraded":"2026-02-20T03:15:27.097629+0000","last_fullsized":"2026-02-20T03:15:27.097629+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:31:34.969387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090084+0000","last_change":"2026-02-20T03:14:37.313608+0000","last_active":"2026-02-20T03:15:27.090084+0000","last_peered":"2026-02-20T03:15:27.090084+0000","last_clean":"2026-02-20T03:15:27.090084+0000","last_became_active":"2026-02-20T03:14:37.312940+0000","last_became_peered":"2026-02-20T03:14:37.312940+0000","last_unstale":"2026-02-20T03:15:27.090084+0000","last_undegraded":"2026-02-20T03:15:27.090084+0000","last_fullsized":"2026-02-20T03:15:27.090084+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:53:39.070879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096476+0000","last_change":"2026-02-20T03:15:27.096476+0000","last_active":"2026-02-20T03:15:27.096476+0000","last_peered":"2026-02-20T03:15:27.096476+0000","last_clean":"2026-02-20T03:15:27.096476+0000","last_became_active":"2026-02-20T03:15:27.096369+0000","last_became_peered":"2026-02-20T03:15:27.096369+0000","last_unstale":"2026-02-20T03:15:27.096476+0000","last_undegraded":"2026-02-20T03:15:27.096476+0000","last_fullsized":"2026-02-20T03:15:27.096476+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:18:04.418088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'4","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:31.387805+0000","last_change":"2026-02-20T03:14:32.078297+0000","last_active":"2026-02-20T03:15:31.387805+0000","last_peered":"2026-02-20T03:15:31.387805+0000","last_clean":"2026-02-20T03:15:31.387805+0000","last_became_active":"2026-02-20T03:14:32.078215+0000","last_became_peered":"2026-02-20T03:14:32.078215+0000","last_unstale":"2026-02-20T03:15:31.387805+0000","last_undegraded":"2026-02-20T03:15:31.387805+0000","last_fullsized":"2026-02-20T03:15:31.387805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:09:48.505472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089978+0000","last_change":"2026-02-20T03:14:37.373516+0000","last_active":"2026-02-20T03:15:27.089978+0000","last_peered":"2026-02-20T03:15:27.089978+0000","last_clean":"2026-02-20T03:15:27.089978+0000","last_became_active":"2026-02-20T03:14:37.372913+0000","last_became_peered":"2026-02-20T03:14:37.372913+0000","last_unstale":"2026-02-20T03:15:27.089978+0000","last_undegraded":"2026-02-20T03:15:27.089978+0000","last_fullsized":"2026-02-20T03:15:27.089978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:46.727225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089476+0000","last_change":"2026-02-20T03:14:33.287932+0000","last_active":"2026-02-20T03:15:27.089476+0000","last_peered":"2026-02-20T03:15:27.089476+0000","last_clean":"2026-02-20T03:15:27.089476+0000","last_became_active":"2026-02-20T03:14:33.287844+0000","last_became_peered":"2026-02-20T03:14:33.287844+0000","last_unstale":"2026-02-20T03:15:27.089476+0000","last_undegraded":"2026-02-20T03:15:27.089476+0000","last_fullsized":"2026-02-20T03:15:27.089476+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:00:42.495373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097578+0000","last_change":"2026-02-20T03:14:32.082749+0000","last_active":"2026-02-20T03:15:27.097578+0000","last_peered":"2026-02-20T03:15:27.097578+0000","last_clean":"2026-02-20T03:15:27.097578+0000","last_became_active":"2026-02-20T03:14:32.082472+0000","last_became_peered":"2026-02-20T03:14:32.082472+0000","last_unstale":"2026-02-20T03:15:27.097578+0000","last_undegraded":"2026-02-20T03:15:27.097578+0000","last_fullsized":"2026-02-20T03:15:27.097578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:24:29.257934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093923+0000","last_change":"2026-02-20T03:14:37.375381+0000","last_active":"2026-02-20T03:15:27.093923+0000","last_peered":"2026-02-20T03:15:27.093923+0000","last_clean":"2026-02-20T03:15:27.093923+0000","last_became_active":"2026-02-20T03:14:37.375246+0000","last_became_peered":"2026-02-20T03:14:37.375246+0000","last_unstale":"2026-02-20T03:15:27.093923+0000","last_undegraded":"2026-02-20T03:15:27.093923+0000","last_fullsized":"2026-02-20T03:15:27.093923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:45:58.268980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677506+0000","last_change":"2026-02-20T03:14:33.292620+0000","last_active":"2026-02-20T03:15:27.677506+0000","last_peered":"2026-02-20T03:15:27.677506+0000","last_clean":"2026-02-20T03:15:27.677506+0000","last_became_active":"2026-02-20T03:14:33.291635+0000","last_became_peered":"2026-02-20T03:14:33.291635+0000","last_unstale":"2026-02-20T03:15:27.677506+0000","last_undegraded":"2026-02-20T03:15:27.677506+0000","last_fullsized":"2026-02-20T03:15:27.677506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:06:50.208932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'3","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392678+0000","last_change":"2026-02-20T03:14:32.086397+0000","last_active":"2026-02-20T03:15:27.392678+0000","last_peered":"2026-02-20T03:15:27.392678+0000","last_clean":"2026-02-20T03:15:27.392678+0000","last_became_active":"2026-02-20T03:14:32.086259+0000","last_became_peered":"2026-02-20T03:14:32.086259+0000","last_unstale":"2026-02-20T03:15:27.392678+0000","last_undegraded":"2026-02-20T03:15:27.392678+0000","last_fullsized":"2026-02-20T03:15:27.392678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:35:20.211408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'152","reported_seq":355,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097913+0000","last_change":"2026-02-20T03:14:08.235907+0000","last_active":"2026-02-20T03:15:27.097913+0000","last_peered":"2026-02-20T03:15:27.097913+0000","last_clean":"2026-02-20T03:15:27.097913+0000","last_became_active":"2026-02-20T03:14:08.235623+0000","last_became_peered":"2026-02-20T03:14:08.235623+0000","last_unstale":"2026-02-20T03:15:27.097913+0000","last_undegraded":"2026-02-20T03:15:27.097913+0000","last_fullsized":"2026-02-20T03:15:27.097913+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:12:36.478567+0000","last_clean_scrub_stamp":"2026-02-20T03:12:36.478567+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:22.616525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097882+0000","last_change":"2026-02-20T03:14:37.323914+0000","last_active":"2026-02-20T03:15:27.097882+0000","last_peered":"2026-02-20T03:15:27.097882+0000","last_clean":"2026-02-20T03:15:27.097882+0000","last_became_active":"2026-02-20T03:14:37.323720+0000","last_became_peered":"2026-02-20T03:14:37.323720+0000","last_unstale":"2026-02-20T03:15:27.097882+0000","last_undegraded":"2026-02-20T03:15:27.097882+0000","last_fullsized":"2026-02-20T03:15:27.097882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:48:52.760942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098144+0000","last_change":"2026-02-20T03:14:33.298023+0000","last_active":"2026-02-20T03:15:27.098144+0000","last_peered":"2026-02-20T03:15:27.098144+0000","last_clean":"2026-02-20T03:15:27.098144+0000","last_became_active":"2026-02-20T03:14:33.297654+0000","last_became_peered":"2026-02-20T03:14:33.297654+0000","last_unstale":"2026-02-20T03:15:27.098144+0000","last_undegraded":"2026-02-20T03:15:27.098144+0000","last_fullsized":"2026-02-20T03:15:27.098144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:07:00.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'3","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.104030+0000","last_change":"2026-02-20T03:15:27.104030+0000","last_active":"2026-02-20T03:15:27.104030+0000","last_peered":"2026-02-20T03:15:27.104030+0000","last_clean":"2026-02-20T03:15:27.104030+0000","last_became_active":"2026-02-20T03:15:27.101137+0000","last_became_peered":"2026-02-20T03:15:27.101137+0000","last_unstale":"2026-02-20T03:15:27.104030+0000","last_undegraded":"2026-02-20T03:15:27.104030+0000","last_fullsized":"2026-02-20T03:15:27.104030+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:16.927063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":592,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":592,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099157+0000","last_change":"2026-02-20T03:14:37.316974+0000","last_active":"2026-02-20T03:15:27.099157+0000","last_peered":"2026-02-20T03:15:27.099157+0000","last_clean":"2026-02-20T03:15:27.099157+0000","last_became_active":"2026-02-20T03:14:37.316781+0000","last_became_peered":"2026-02-20T03:14:37.316781+0000","last_unstale":"2026-02-20T03:15:27.099157+0000","last_undegraded":"2026-02-20T03:15:27.099157+0000","last_fullsized":"2026-02-20T03:15:27.099157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:14:56.399478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097824+0000","last_change":"2026-02-20T03:14:33.298026+0000","last_active":"2026-02-20T03:15:27.097824+0000","last_peered":"2026-02-20T03:15:27.097824+0000","last_clean":"2026-02-20T03:15:27.097824+0000","last_became_active":"2026-02-20T03:14:33.297592+0000","last_became_peered":"2026-02-20T03:14:33.297592+0000","last_unstale":"2026-02-20T03:15:27.097824+0000","last_undegraded":"2026-02-20T03:15:27.097824+0000","last_fullsized":"2026-02-20T03:15:27.097824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:12:54.500693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094597+0000","last_change":"2026-02-20T03:14:32.073368+0000","last_active":"2026-02-20T03:15:27.094597+0000","last_peered":"2026-02-20T03:15:27.094597+0000","last_clean":"2026-02-20T03:15:27.094597+0000","last_became_active":"2026-02-20T03:14:32.073168+0000","last_became_peered":"2026-02-20T03:14:32.073168+0000","last_unstale":"2026-02-20T03:15:27.094597+0000","last_undegraded":"2026-02-20T03:15:27.094597+0000","last_fullsized":"2026-02-20T03:15:27.094597+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:52:03.875514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091583+0000","last_change":"2026-02-20T03:14:37.322084+0000","last_active":"2026-02-20T03:15:27.091583+0000","last_peered":"2026-02-20T03:15:27.091583+0000","last_clean":"2026-02-20T03:15:27.091583+0000","last_became_active":"2026-02-20T03:14:37.321992+0000","last_became_peered":"2026-02-20T03:14:37.321992+0000","last_unstale":"2026-02-20T03:15:27.091583+0000","last_undegraded":"2026-02-20T03:15:27.091583+0000","last_fullsized":"2026-02-20T03:15:27.091583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:31:46.795579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098225+0000","last_change":"2026-02-20T03:14:33.295565+0000","last_active":"2026-02-20T03:15:27.098225+0000","last_peered":"2026-02-20T03:15:27.098225+0000","last_clean":"2026-02-20T03:15:27.098225+0000","last_became_active":"2026-02-20T03:14:33.295257+0000","last_became_peered":"2026-02-20T03:14:33.295257+0000","last_unstale":"2026-02-20T03:15:27.098225+0000","last_undegraded":"2026-02-20T03:15:27.098225+0000","last_fullsized":"2026-02-20T03:15:27.098225+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:11:32.842345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089901+0000","last_change":"2026-02-20T03:14:32.078366+0000","last_active":"2026-02-20T03:15:27.089901+0000","last_peered":"2026-02-20T03:15:27.089901+0000","last_clean":"2026-02-20T03:15:27.089901+0000","last_became_active":"2026-02-20T03:14:32.078046+0000","last_became_peered":"2026-02-20T03:14:32.078046+0000","last_unstale":"2026-02-20T03:15:27.089901+0000","last_undegraded":"2026-02-20T03:15:27.089901+0000","last_fullsized":"2026-02-20T03:15:27.089901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:35:06.214317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093235+0000","last_change":"2026-02-20T03:14:37.309789+0000","last_active":"2026-02-20T03:15:27.093235+0000","last_peered":"2026-02-20T03:15:27.093235+0000","last_clean":"2026-02-20T03:15:27.093235+0000","last_became_active":"2026-02-20T03:14:37.309564+0000","last_became_peered":"2026-02-20T03:14:37.309564+0000","last_unstale":"2026-02-20T03:15:27.093235+0000","last_undegraded":"2026-02-20T03:15:27.093235+0000","last_fullsized":"2026-02-20T03:15:27.093235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:34:38.811970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093959+0000","last_change":"2026-02-20T03:14:33.290833+0000","last_active":"2026-02-20T03:15:27.093959+0000","last_peered":"2026-02-20T03:15:27.093959+0000","last_clean":"2026-02-20T03:15:27.093959+0000","last_became_active":"2026-02-20T03:14:33.290474+0000","last_became_peered":"2026-02-20T03:14:33.290474+0000","last_unstale":"2026-02-20T03:15:27.093959+0000","last_undegraded":"2026-02-20T03:15:27.093959+0000","last_fullsized":"2026-02-20T03:15:27.093959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:13:00.863562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096403+0000","last_change":"2026-02-20T03:14:32.076011+0000","last_active":"2026-02-20T03:15:27.096403+0000","last_peered":"2026-02-20T03:15:27.096403+0000","last_clean":"2026-02-20T03:15:27.096403+0000","last_became_active":"2026-02-20T03:14:32.075845+0000","last_became_peered":"2026-02-20T03:14:32.075845+0000","last_unstale":"2026-02-20T03:15:27.096403+0000","last_undegraded":"2026-02-20T03:15:27.096403+0000","last_fullsized":"2026-02-20T03:15:27.096403+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:03:53.798044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093292+0000","last_change":"2026-02-20T03:14:37.314385+0000","last_active":"2026-02-20T03:15:27.093292+0000","last_peered":"2026-02-20T03:15:27.093292+0000","last_clean":"2026-02-20T03:15:27.093292+0000","last_became_active":"2026-02-20T03:14:37.314227+0000","last_became_peered":"2026-02-20T03:14:37.314227+0000","last_unstale":"2026-02-20T03:15:27.093292+0000","last_undegraded":"2026-02-20T03:15:27.093292+0000","last_fullsized":"2026-02-20T03:15:27.093292+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:37:42.260725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093347+0000","last_change":"2026-02-20T03:14:33.291323+0000","last_active":"2026-02-20T03:15:27.093347+0000","last_peered":"2026-02-20T03:15:27.093347+0000","last_clean":"2026-02-20T03:15:27.093347+0000","last_became_active":"2026-02-20T03:14:33.291129+0000","last_became_peered":"2026-02-20T03:14:33.291129+0000","last_unstale":"2026-02-20T03:15:27.093347+0000","last_undegraded":"2026-02-20T03:15:27.093347+0000","last_fullsized":"2026-02-20T03:15:27.093347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:55.541185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"89'15","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.095895+0000","last_change":"2026-02-20T03:14:32.078360+0000","last_active":"2026-02-20T03:15:27.095895+0000","last_peered":"2026-02-20T03:15:27.095895+0000","last_clean":"2026-02-20T03:15:27.095895+0000","last_became_active":"2026-02-20T03:14:32.078167+0000","last_became_peered":"2026-02-20T03:14:32.078167+0000","last_unstale":"2026-02-20T03:15:27.095895+0000","last_undegraded":"2026-02-20T03:15:27.095895+0000","last_fullsized":"2026-02-20T03:15:27.095895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:47:52.765363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089892+0000","last_change":"2026-02-20T03:14:37.319706+0000","last_active":"2026-02-20T03:15:27.089892+0000","last_peered":"2026-02-20T03:15:27.089892+0000","last_clean":"2026-02-20T03:15:27.089892+0000","last_became_active":"2026-02-20T03:14:37.319033+0000","last_became_peered":"2026-02-20T03:14:37.319033+0000","last_unstale":"2026-02-20T03:15:27.089892+0000","last_undegraded":"2026-02-20T03:15:27.089892+0000","last_fullsized":"2026-02-20T03:15:27.089892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T10:02:23.406722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097367+0000","last_change":"2026-02-20T03:14:33.297981+0000","last_active":"2026-02-20T03:15:27.097367+0000","last_peered":"2026-02-20T03:15:27.097367+0000","last_clean":"2026-02-20T03:15:27.097367+0000","last_became_active":"2026-02-20T03:14:33.297495+0000","last_became_peered":"2026-02-20T03:14:33.297495+0000","last_unstale":"2026-02-20T03:15:27.097367+0000","last_undegraded":"2026-02-20T03:15:27.097367+0000","last_fullsized":"2026-02-20T03:15:27.097367+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:26:19.073589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":77,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:33.396951+0000","last_change":"2026-02-20T03:14:32.081723+0000","last_active":"2026-02-20T03:15:33.396951+0000","last_peered":"2026-02-20T03:15:33.396951+0000","last_clean":"2026-02-20T03:15:33.396951+0000","last_became_active":"2026-02-20T03:14:32.081574+0000","last_became_peered":"2026-02-20T03:14:32.081574+0000","last_unstale":"2026-02-20T03:15:33.396951+0000","last_undegraded":"2026-02-20T03:15:33.396951+0000","last_fullsized":"2026-02-20T03:15:33.396951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:56:18.486502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092155+0000","last_change":"2026-02-20T03:14:37.322024+0000","last_active":"2026-02-20T03:15:27.092155+0000","last_peered":"2026-02-20T03:15:27.092155+0000","last_clean":"2026-02-20T03:15:27.092155+0000","last_became_active":"2026-02-20T03:14:37.321649+0000","last_became_peered":"2026-02-20T03:14:37.321649+0000","last_unstale":"2026-02-20T03:15:27.092155+0000","last_undegraded":"2026-02-20T03:15:27.092155+0000","last_fullsized":"2026-02-20T03:15:27.092155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:16:10.109564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097787+0000","last_change":"2026-02-20T03:14:33.304183+0000","last_active":"2026-02-20T03:15:27.097787+0000","last_peered":"2026-02-20T03:15:27.097787+0000","last_clean":"2026-02-20T03:15:27.097787+0000","last_became_active":"2026-02-20T03:14:33.303973+0000","last_became_peered":"2026-02-20T03:14:33.303973+0000","last_unstale":"2026-02-20T03:15:27.097787+0000","last_undegraded":"2026-02-20T03:15:27.097787+0000","last_fullsized":"2026-02-20T03:15:27.097787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:51:46.704388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093616+0000","last_change":"2026-02-20T03:14:32.076765+0000","last_active":"2026-02-20T03:15:27.093616+0000","last_peered":"2026-02-20T03:15:27.093616+0000","last_clean":"2026-02-20T03:15:27.093616+0000","last_became_active":"2026-02-20T03:14:32.076589+0000","last_became_peered":"2026-02-20T03:14:32.076589+0000","last_unstale":"2026-02-20T03:15:27.093616+0000","last_undegraded":"2026-02-20T03:15:27.093616+0000","last_fullsized":"2026-02-20T03:15:27.093616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T15:04:58.907709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093604+0000","last_change":"2026-02-20T03:14:37.323087+0000","last_active":"2026-02-20T03:15:27.093604+0000","last_peered":"2026-02-20T03:15:27.093604+0000","last_clean":"2026-02-20T03:15:27.093604+0000","last_became_active":"2026-02-20T03:14:37.322911+0000","last_became_peered":"2026-02-20T03:14:37.322911+0000","last_unstale":"2026-02-20T03:15:27.093604+0000","last_undegraded":"2026-02-20T03:15:27.093604+0000","last_fullsized":"2026-02-20T03:15:27.093604+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:46:43.668668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089674+0000","last_change":"2026-02-20T03:14:33.294217+0000","last_active":"2026-02-20T03:15:27.089674+0000","last_peered":"2026-02-20T03:15:27.089674+0000","last_clean":"2026-02-20T03:15:27.089674+0000","last_became_active":"2026-02-20T03:14:33.294137+0000","last_became_peered":"2026-02-20T03:14:33.294137+0000","last_unstale":"2026-02-20T03:15:27.089674+0000","last_undegraded":"2026-02-20T03:15:27.089674+0000","last_fullsized":"2026-02-20T03:15:27.089674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:18:09.309691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"89'6","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092119+0000","last_change":"2026-02-20T03:14:32.080306+0000","last_active":"2026-02-20T03:15:27.092119+0000","last_peered":"2026-02-20T03:15:27.092119+0000","last_clean":"2026-02-20T03:15:27.092119+0000","last_became_active":"2026-02-20T03:14:32.080134+0000","last_became_peered":"2026-02-20T03:14:32.080134+0000","last_unstale":"2026-02-20T03:15:27.092119+0000","last_undegraded":"2026-02-20T03:15:27.092119+0000","last_fullsized":"2026-02-20T03:15:27.092119+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:00.807096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093756+0000","last_change":"2026-02-20T03:14:37.311310+0000","last_active":"2026-02-20T03:15:27.093756+0000","last_peered":"2026-02-20T03:15:27.093756+0000","last_clean":"2026-02-20T03:15:27.093756+0000","last_became_active":"2026-02-20T03:14:37.311142+0000","last_became_peered":"2026-02-20T03:14:37.311142+0000","last_unstale":"2026-02-20T03:15:27.093756+0000","last_undegraded":"2026-02-20T03:15:27.093756+0000","last_fullsized":"2026-02-20T03:15:27.093756+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:07:16.508805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096216+0000","last_change":"2026-02-20T03:14:33.291076+0000","last_active":"2026-02-20T03:15:27.096216+0000","last_peered":"2026-02-20T03:15:27.096216+0000","last_clean":"2026-02-20T03:15:27.096216+0000","last_became_active":"2026-02-20T03:14:33.290755+0000","last_became_peered":"2026-02-20T03:14:33.290755+0000","last_unstale":"2026-02-20T03:15:27.096216+0000","last_undegraded":"2026-02-20T03:15:27.096216+0000","last_fullsized":"2026-02-20T03:15:27.096216+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:44:12.941919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'36","reported_seq":161,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:34.399834+0000","last_change":"2026-02-20T03:14:32.080558+0000","last_active":"2026-02-20T03:15:34.399834+0000","last_peered":"2026-02-20T03:15:34.399834+0000","last_clean":"2026-02-20T03:15:34.399834+0000","last_became_active":"2026-02-20T03:14:32.080347+0000","last_became_peered":"2026-02-20T03:14:32.080347+0000","last_unstale":"2026-02-20T03:15:34.399834+0000","last_undegraded":"2026-02-20T03:15:34.399834+0000","last_fullsized":"2026-02-20T03:15:34.399834+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:39:31.892467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76903,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":98,"num_read_kb":125,"num_write":37,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091741+0000","last_change":"2026-02-20T03:14:37.320089+0000","last_active":"2026-02-20T03:15:27.091741+0000","last_peered":"2026-02-20T03:15:27.091741+0000","last_clean":"2026-02-20T03:15:27.091741+0000","last_became_active":"2026-02-20T03:14:37.319375+0000","last_became_peered":"2026-02-20T03:14:37.319375+0000","last_unstale":"2026-02-20T03:15:27.091741+0000","last_undegraded":"2026-02-20T03:15:27.091741+0000","last_fullsized":"2026-02-20T03:15:27.091741+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:37:12.207550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.100059+0000","last_change":"2026-02-20T03:14:33.295490+0000","last_active":"2026-02-20T03:15:27.100059+0000","last_peered":"2026-02-20T03:15:27.100059+0000","last_clean":"2026-02-20T03:15:27.100059+0000","last_became_active":"2026-02-20T03:14:33.295350+0000","last_became_peered":"2026-02-20T03:14:33.295350+0000","last_unstale":"2026-02-20T03:15:27.100059+0000","last_undegraded":"2026-02-20T03:15:27.100059+0000","last_fullsized":"2026-02-20T03:15:27.100059+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:30:57.078320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"89'4","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094441+0000","last_change":"2026-02-20T03:14:32.077078+0000","last_active":"2026-02-20T03:15:27.094441+0000","last_peered":"2026-02-20T03:15:27.094441+0000","last_clean":"2026-02-20T03:15:27.094441+0000","last_became_active":"2026-02-20T03:14:32.076931+0000","last_became_peered":"2026-02-20T03:14:32.076931+0000","last_unstale":"2026-02-20T03:15:27.094441+0000","last_undegraded":"2026-02-20T03:15:27.094441+0000","last_fullsized":"2026-02-20T03:15:27.094441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:14:28.711827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":682,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392567+0000","last_change":"2026-02-20T03:14:37.329172+0000","last_active":"2026-02-20T03:15:27.392567+0000","last_peered":"2026-02-20T03:15:27.392567+0000","last_clean":"2026-02-20T03:15:27.392567+0000","last_became_active":"2026-02-20T03:14:37.328895+0000","last_became_peered":"2026-02-20T03:14:37.328895+0000","last_unstale":"2026-02-20T03:15:27.392567+0000","last_undegraded":"2026-02-20T03:15:27.392567+0000","last_fullsized":"2026-02-20T03:15:27.392567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:44:29.408716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092453+0000","last_change":"2026-02-20T03:14:33.292038+0000","last_active":"2026-02-20T03:15:27.092453+0000","last_peered":"2026-02-20T03:15:27.092453+0000","last_clean":"2026-02-20T03:15:27.092453+0000","last_became_active":"2026-02-20T03:14:33.291954+0000","last_became_peered":"2026-02-20T03:14:33.291954+0000","last_unstale":"2026-02-20T03:15:27.092453+0000","last_undegraded":"2026-02-20T03:15:27.092453+0000","last_fullsized":"2026-02-20T03:15:27.092453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:59:35.539659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098009+0000","last_change":"2026-02-20T03:14:32.082183+0000","last_active":"2026-02-20T03:15:27.098009+0000","last_peered":"2026-02-20T03:15:27.098009+0000","last_clean":"2026-02-20T03:15:27.098009+0000","last_became_active":"2026-02-20T03:14:32.081723+0000","last_became_peered":"2026-02-20T03:14:32.081723+0000","last_unstale":"2026-02-20T03:15:27.098009+0000","last_undegraded":"2026-02-20T03:15:27.098009+0000","last_fullsized":"2026-02-20T03:15:27.098009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:11:28.173154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091618+0000","last_change":"2026-02-20T03:14:37.322029+0000","last_active":"2026-02-20T03:15:27.091618+0000","last_peered":"2026-02-20T03:15:27.091618+0000","last_clean":"2026-02-20T03:15:27.091618+0000","last_became_active":"2026-02-20T03:14:37.321815+0000","last_became_peered":"2026-02-20T03:14:37.321815+0000","last_unstale":"2026-02-20T03:15:27.091618+0000","last_undegraded":"2026-02-20T03:15:27.091618+0000","last_fullsized":"2026-02-20T03:15:27.091618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:50:31.999690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099742+0000","last_change":"2026-02-20T03:14:33.296618+0000","last_active":"2026-02-20T03:15:27.099742+0000","last_peered":"2026-02-20T03:15:27.099742+0000","last_clean":"2026-02-20T03:15:27.099742+0000","last_became_active":"2026-02-20T03:14:33.296312+0000","last_became_peered":"2026-02-20T03:14:33.296312+0000","last_unstale":"2026-02-20T03:15:27.099742+0000","last_undegraded":"2026-02-20T03:15:27.099742+0000","last_fullsized":"2026-02-20T03:15:27.099742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:34:20.153415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":74,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:33.391952+0000","last_change":"2026-02-20T03:14:32.086329+0000","last_active":"2026-02-20T03:15:33.391952+0000","last_peered":"2026-02-20T03:15:33.391952+0000","last_clean":"2026-02-20T03:15:33.391952+0000","last_became_active":"2026-02-20T03:14:32.086176+0000","last_became_peered":"2026-02-20T03:14:32.086176+0000","last_unstale":"2026-02-20T03:15:33.391952+0000","last_undegraded":"2026-02-20T03:15:33.391952+0000","last_fullsized":"2026-02-20T03:15:33.391952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:40:53.200128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676945+0000","last_change":"2026-02-20T03:14:37.308956+0000","last_active":"2026-02-20T03:15:27.676945+0000","last_peered":"2026-02-20T03:15:27.676945+0000","last_clean":"2026-02-20T03:15:27.676945+0000","last_became_active":"2026-02-20T03:14:37.308826+0000","last_became_peered":"2026-02-20T03:14:37.308826+0000","last_unstale":"2026-02-20T03:15:27.676945+0000","last_undegraded":"2026-02-20T03:15:27.676945+0000","last_fullsized":"2026-02-20T03:15:27.676945+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:43:28.463638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091966+0000","last_change":"2026-02-20T03:14:37.312559+0000","last_active":"2026-02-20T03:15:27.091966+0000","last_peered":"2026-02-20T03:15:27.091966+0000","last_clean":"2026-02-20T03:15:27.091966+0000","last_became_active":"2026-02-20T03:14:37.312199+0000","last_became_peered":"2026-02-20T03:14:37.312199+0000","last_unstale":"2026-02-20T03:15:27.091966+0000","last_undegraded":"2026-02-20T03:15:27.091966+0000","last_fullsized":"2026-02-20T03:15:27.091966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:10:01.924073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091995+0000","last_change":"2026-02-20T03:14:33.299414+0000","last_active":"2026-02-20T03:15:27.091995+0000","last_peered":"2026-02-20T03:15:27.091995+0000","last_clean":"2026-02-20T03:15:27.091995+0000","last_became_active":"2026-02-20T03:14:33.299287+0000","last_became_peered":"2026-02-20T03:14:33.299287+0000","last_unstale":"2026-02-20T03:15:27.091995+0000","last_undegraded":"2026-02-20T03:15:27.091995+0000","last_fullsized":"2026-02-20T03:15:27.091995+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:51:32.893353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"89'1","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094048+0000","last_change":"2026-02-20T03:14:32.076645+0000","last_active":"2026-02-20T03:15:27.094048+0000","last_peered":"2026-02-20T03:15:27.094048+0000","last_clean":"2026-02-20T03:15:27.094048+0000","last_became_active":"2026-02-20T03:14:32.076478+0000","last_became_peered":"2026-02-20T03:14:32.076478+0000","last_unstale":"2026-02-20T03:15:27.094048+0000","last_undegraded":"2026-02-20T03:15:27.094048+0000","last_fullsized":"2026-02-20T03:15:27.094048+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:28.800350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093983+0000","last_change":"2026-02-20T03:14:37.320247+0000","last_active":"2026-02-20T03:15:27.093983+0000","last_peered":"2026-02-20T03:15:27.093983+0000","last_clean":"2026-02-20T03:15:27.093983+0000","last_became_active":"2026-02-20T03:14:37.320114+0000","last_became_peered":"2026-02-20T03:14:37.320114+0000","last_unstale":"2026-02-20T03:15:27.093983+0000","last_undegraded":"2026-02-20T03:15:27.093983+0000","last_fullsized":"2026-02-20T03:15:27.093983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:40:28.313774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676892+0000","last_change":"2026-02-20T03:14:33.294034+0000","last_active":"2026-02-20T03:15:27.676892+0000","last_peered":"2026-02-20T03:15:27.676892+0000","last_clean":"2026-02-20T03:15:27.676892+0000","last_became_active":"2026-02-20T03:14:33.293835+0000","last_became_peered":"2026-02-20T03:14:33.293835+0000","last_unstale":"2026-02-20T03:15:27.676892+0000","last_undegraded":"2026-02-20T03:15:27.676892+0000","last_fullsized":"2026-02-20T03:15:27.676892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:25:20.153789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"89'2","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089481+0000","last_change":"2026-02-20T03:14:32.079717+0000","last_active":"2026-02-20T03:15:27.089481+0000","last_peered":"2026-02-20T03:15:27.089481+0000","last_clean":"2026-02-20T03:15:27.089481+0000","last_became_active":"2026-02-20T03:14:32.079620+0000","last_became_peered":"2026-02-20T03:14:32.079620+0000","last_unstale":"2026-02-20T03:15:27.089481+0000","last_undegraded":"2026-02-20T03:15:27.089481+0000","last_fullsized":"2026-02-20T03:15:27.089481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:47:27.286112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"89'3","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383994+0000","last_change":"2026-02-20T03:14:32.084208+0000","last_active":"2026-02-20T03:15:27.383994+0000","last_peered":"2026-02-20T03:15:27.383994+0000","last_clean":"2026-02-20T03:15:27.383994+0000","last_became_active":"2026-02-20T03:14:32.084061+0000","last_became_peered":"2026-02-20T03:14:32.084061+0000","last_unstale":"2026-02-20T03:15:27.383994+0000","last_undegraded":"2026-02-20T03:15:27.383994+0000","last_fullsized":"2026-02-20T03:15:27.383994+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:06.093660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093591+0000","last_change":"2026-02-20T03:14:33.290194+0000","last_active":"2026-02-20T03:15:27.093591+0000","last_peered":"2026-02-20T03:15:27.093591+0000","last_clean":"2026-02-20T03:15:27.093591+0000","last_became_active":"2026-02-20T03:14:33.289780+0000","last_became_peered":"2026-02-20T03:14:33.289780+0000","last_unstale":"2026-02-20T03:15:27.093591+0000","last_undegraded":"2026-02-20T03:15:27.093591+0000","last_fullsized":"2026-02-20T03:15:27.093591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:26:35.699654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092112+0000","last_change":"2026-02-20T03:14:37.321367+0000","last_active":"2026-02-20T03:15:27.092112+0000","last_peered":"2026-02-20T03:15:27.092112+0000","last_clean":"2026-02-20T03:15:27.092112+0000","last_became_active":"2026-02-20T03:14:37.321242+0000","last_became_peered":"2026-02-20T03:14:37.321242+0000","last_unstale":"2026-02-20T03:15:27.092112+0000","last_undegraded":"2026-02-20T03:15:27.092112+0000","last_fullsized":"2026-02-20T03:15:27.092112+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:20:12.992911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:33.386554+0000","last_change":"2026-02-20T03:14:32.077511+0000","last_active":"2026-02-20T03:15:33.386554+0000","last_peered":"2026-02-20T03:15:33.386554+0000","last_clean":"2026-02-20T03:15:33.386554+0000","last_became_active":"2026-02-20T03:14:32.077372+0000","last_became_peered":"2026-02-20T03:14:32.077372+0000","last_unstale":"2026-02-20T03:15:33.386554+0000","last_undegraded":"2026-02-20T03:15:33.386554+0000","last_fullsized":"2026-02-20T03:15:33.386554+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:31.063769+0000","last_clean_scrub_stamp":"2026-02-20T03:14:31.063769+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:25:50.520799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5947,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":8,"num_write":4,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096098+0000","last_change":"2026-02-20T03:14:33.292088+0000","last_active":"2026-02-20T03:15:27.096098+0000","last_peered":"2026-02-20T03:15:27.096098+0000","last_clean":"2026-02-20T03:15:27.096098+0000","last_became_active":"2026-02-20T03:14:33.291903+0000","last_became_peered":"2026-02-20T03:14:33.291903+0000","last_unstale":"2026-02-20T03:15:27.096098+0000","last_undegraded":"2026-02-20T03:15:27.096098+0000","last_fullsized":"2026-02-20T03:15:27.096098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T12:53:01.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092190+0000","last_change":"2026-02-20T03:14:37.309797+0000","last_active":"2026-02-20T03:15:27.092190+0000","last_peered":"2026-02-20T03:15:27.092190+0000","last_clean":"2026-02-20T03:15:27.092190+0000","last_became_active":"2026-02-20T03:14:37.309592+0000","last_became_peered":"2026-02-20T03:14:37.309592+0000","last_unstale":"2026-02-20T03:15:27.092190+0000","last_undegraded":"2026-02-20T03:15:27.092190+0000","last_fullsized":"2026-02-20T03:15:27.092190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:36.293475+0000","last_clean_scrub_stamp":"2026-02-20T03:14:36.293475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:42.336952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093327+0000","last_change":"2026-02-20T03:14:33.291635+0000","last_active":"2026-02-20T03:15:27.093327+0000","last_peered":"2026-02-20T03:15:27.093327+0000","last_clean":"2026-02-20T03:15:27.093327+0000","last_became_active":"2026-02-20T03:14:33.291447+0000","last_became_peered":"2026-02-20T03:14:33.291447+0000","last_unstale":"2026-02-20T03:15:27.093327+0000","last_undegraded":"2026-02-20T03:15:27.093327+0000","last_fullsized":"2026-02-20T03:15:27.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:08:10.432877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092030+0000","last_change":"2026-02-20T03:14:33.287807+0000","last_active":"2026-02-20T03:15:27.092030+0000","last_peered":"2026-02-20T03:15:27.092030+0000","last_clean":"2026-02-20T03:15:27.092030+0000","last_became_active":"2026-02-20T03:14:33.287536+0000","last_became_peered":"2026-02-20T03:14:33.287536+0000","last_unstale":"2026-02-20T03:15:27.092030+0000","last_undegraded":"2026-02-20T03:15:27.092030+0000","last_fullsized":"2026-02-20T03:15:27.092030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:54:45.475315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091880+0000","last_change":"2026-02-20T03:14:33.295076+0000","last_active":"2026-02-20T03:15:27.091880+0000","last_peered":"2026-02-20T03:15:27.091880+0000","last_clean":"2026-02-20T03:15:27.091880+0000","last_became_active":"2026-02-20T03:14:33.294895+0000","last_became_peered":"2026-02-20T03:14:33.294895+0000","last_unstale":"2026-02-20T03:15:27.091880+0000","last_undegraded":"2026-02-20T03:15:27.091880+0000","last_fullsized":"2026-02-20T03:15:27.091880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:29:08.769603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092039+0000","last_change":"2026-02-20T03:14:33.298566+0000","last_active":"2026-02-20T03:15:27.092039+0000","last_peered":"2026-02-20T03:15:27.092039+0000","last_clean":"2026-02-20T03:15:27.092039+0000","last_became_active":"2026-02-20T03:14:33.298431+0000","last_became_peered":"2026-02-20T03:14:33.298431+0000","last_unstale":"2026-02-20T03:15:27.092039+0000","last_undegraded":"2026-02-20T03:15:27.092039+0000","last_fullsized":"2026-02-20T03:15:27.092039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:04:53.868664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.090007+0000","last_change":"2026-02-20T03:14:33.294457+0000","last_active":"2026-02-20T03:15:27.090007+0000","last_peered":"2026-02-20T03:15:27.090007+0000","last_clean":"2026-02-20T03:15:27.090007+0000","last_became_active":"2026-02-20T03:14:33.294350+0000","last_became_peered":"2026-02-20T03:14:33.294350+0000","last_unstale":"2026-02-20T03:15:27.090007+0000","last_undegraded":"2026-02-20T03:15:27.090007+0000","last_fullsized":"2026-02-20T03:15:27.090007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:14.648991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096323+0000","last_change":"2026-02-20T03:15:27.096323+0000","last_active":"2026-02-20T03:15:27.096323+0000","last_peered":"2026-02-20T03:15:27.096323+0000","last_clean":"2026-02-20T03:15:27.096323+0000","last_became_active":"2026-02-20T03:15:27.096171+0000","last_became_peered":"2026-02-20T03:15:27.096171+0000","last_unstale":"2026-02-20T03:15:27.096323+0000","last_undegraded":"2026-02-20T03:15:27.096323+0000","last_fullsized":"2026-02-20T03:15:27.096323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:00:54.803500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092769+0000","last_change":"2026-02-20T03:14:33.291634+0000","last_active":"2026-02-20T03:15:27.092769+0000","last_peered":"2026-02-20T03:15:27.092769+0000","last_clean":"2026-02-20T03:15:27.092769+0000","last_became_active":"2026-02-20T03:14:33.291482+0000","last_became_peered":"2026-02-20T03:14:33.291482+0000","last_unstale":"2026-02-20T03:15:27.092769+0000","last_undegraded":"2026-02-20T03:15:27.092769+0000","last_fullsized":"2026-02-20T03:15:27.092769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:22.115615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677330+0000","last_change":"2026-02-20T03:14:33.284662+0000","last_active":"2026-02-20T03:15:27.677330+0000","last_peered":"2026-02-20T03:15:27.677330+0000","last_clean":"2026-02-20T03:15:27.677330+0000","last_became_active":"2026-02-20T03:14:33.284535+0000","last_became_peered":"2026-02-20T03:14:33.284535+0000","last_unstale":"2026-02-20T03:15:27.677330+0000","last_undegraded":"2026-02-20T03:15:27.677330+0000","last_fullsized":"2026-02-20T03:15:27.677330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:32:45.033204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093789+0000","last_change":"2026-02-20T03:14:33.292878+0000","last_active":"2026-02-20T03:15:27.093789+0000","last_peered":"2026-02-20T03:15:27.093789+0000","last_clean":"2026-02-20T03:15:27.093789+0000","last_became_active":"2026-02-20T03:14:33.292647+0000","last_became_peered":"2026-02-20T03:14:33.292647+0000","last_unstale":"2026-02-20T03:15:27.093789+0000","last_undegraded":"2026-02-20T03:15:27.093789+0000","last_fullsized":"2026-02-20T03:15:27.093789+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:16:07.438826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.677022+0000","last_change":"2026-02-20T03:14:33.287639+0000","last_active":"2026-02-20T03:15:27.677022+0000","last_peered":"2026-02-20T03:15:27.677022+0000","last_clean":"2026-02-20T03:15:27.677022+0000","last_became_active":"2026-02-20T03:14:33.287537+0000","last_became_peered":"2026-02-20T03:14:33.287537+0000","last_unstale":"2026-02-20T03:15:27.677022+0000","last_undegraded":"2026-02-20T03:15:27.677022+0000","last_fullsized":"2026-02-20T03:15:27.677022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:28:39.894444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.099411+0000","last_change":"2026-02-20T03:14:33.300765+0000","last_active":"2026-02-20T03:15:27.099411+0000","last_peered":"2026-02-20T03:15:27.099411+0000","last_clean":"2026-02-20T03:15:27.099411+0000","last_became_active":"2026-02-20T03:14:33.300621+0000","last_became_peered":"2026-02-20T03:14:33.300621+0000","last_unstale":"2026-02-20T03:15:27.099411+0000","last_undegraded":"2026-02-20T03:15:27.099411+0000","last_fullsized":"2026-02-20T03:15:27.099411+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:42:53.665037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089899+0000","last_change":"2026-02-20T03:14:33.293416+0000","last_active":"2026-02-20T03:15:27.089899+0000","last_peered":"2026-02-20T03:15:27.089899+0000","last_clean":"2026-02-20T03:15:27.089899+0000","last_became_active":"2026-02-20T03:14:33.293336+0000","last_became_peered":"2026-02-20T03:14:33.293336+0000","last_unstale":"2026-02-20T03:15:27.089899+0000","last_undegraded":"2026-02-20T03:15:27.089899+0000","last_fullsized":"2026-02-20T03:15:27.089899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:33:05.579344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.093603+0000","last_change":"2026-02-20T03:14:33.290783+0000","last_active":"2026-02-20T03:15:27.093603+0000","last_peered":"2026-02-20T03:15:27.093603+0000","last_clean":"2026-02-20T03:15:27.093603+0000","last_became_active":"2026-02-20T03:14:33.290497+0000","last_became_peered":"2026-02-20T03:14:33.290497+0000","last_unstale":"2026-02-20T03:15:27.093603+0000","last_undegraded":"2026-02-20T03:15:27.093603+0000","last_fullsized":"2026-02-20T03:15:27.093603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:36:46.985235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092566+0000","last_change":"2026-02-20T03:14:33.296682+0000","last_active":"2026-02-20T03:15:27.092566+0000","last_peered":"2026-02-20T03:15:27.092566+0000","last_clean":"2026-02-20T03:15:27.092566+0000","last_became_active":"2026-02-20T03:14:33.296567+0000","last_became_peered":"2026-02-20T03:14:33.296567+0000","last_unstale":"2026-02-20T03:15:27.092566+0000","last_undegraded":"2026-02-20T03:15:27.092566+0000","last_fullsized":"2026-02-20T03:15:27.092566+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:25:19.617183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.092017+0000","last_change":"2026-02-20T03:14:33.297533+0000","last_active":"2026-02-20T03:15:27.092017+0000","last_peered":"2026-02-20T03:15:27.092017+0000","last_clean":"2026-02-20T03:15:27.092017+0000","last_became_active":"2026-02-20T03:14:33.297400+0000","last_became_peered":"2026-02-20T03:14:33.297400+0000","last_unstale":"2026-02-20T03:15:27.092017+0000","last_undegraded":"2026-02-20T03:15:27.092017+0000","last_fullsized":"2026-02-20T03:15:27.092017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:34.212210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094334+0000","last_change":"2026-02-20T03:14:33.295094+0000","last_active":"2026-02-20T03:15:27.094334+0000","last_peered":"2026-02-20T03:15:27.094334+0000","last_clean":"2026-02-20T03:15:27.094334+0000","last_became_active":"2026-02-20T03:14:33.294859+0000","last_became_peered":"2026-02-20T03:14:33.294859+0000","last_unstale":"2026-02-20T03:15:27.094334+0000","last_undegraded":"2026-02-20T03:15:27.094334+0000","last_fullsized":"2026-02-20T03:15:27.094334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T11:21:13.802134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098981+0000","last_change":"2026-02-20T03:14:33.301585+0000","last_active":"2026-02-20T03:15:27.098981+0000","last_peered":"2026-02-20T03:15:27.098981+0000","last_clean":"2026-02-20T03:15:27.098981+0000","last_became_active":"2026-02-20T03:14:33.301478+0000","last_became_peered":"2026-02-20T03:14:33.301478+0000","last_unstale":"2026-02-20T03:15:27.098981+0000","last_undegraded":"2026-02-20T03:15:27.098981+0000","last_fullsized":"2026-02-20T03:15:27.098981+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:10:19.909661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091896+0000","last_change":"2026-02-20T03:14:33.291285+0000","last_active":"2026-02-20T03:15:27.091896+0000","last_peered":"2026-02-20T03:15:27.091896+0000","last_clean":"2026-02-20T03:15:27.091896+0000","last_became_active":"2026-02-20T03:14:33.291212+0000","last_became_peered":"2026-02-20T03:14:33.291212+0000","last_unstale":"2026-02-20T03:15:27.091896+0000","last_undegraded":"2026-02-20T03:15:27.091896+0000","last_fullsized":"2026-02-20T03:15:27.091896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:21:39.642425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091504+0000","last_change":"2026-02-20T03:14:33.292795+0000","last_active":"2026-02-20T03:15:27.091504+0000","last_peered":"2026-02-20T03:15:27.091504+0000","last_clean":"2026-02-20T03:15:27.091504+0000","last_became_active":"2026-02-20T03:14:33.292687+0000","last_became_peered":"2026-02-20T03:14:33.292687+0000","last_unstale":"2026-02-20T03:15:27.091504+0000","last_undegraded":"2026-02-20T03:15:27.091504+0000","last_fullsized":"2026-02-20T03:15:27.091504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:43:54.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.089821+0000","last_change":"2026-02-20T03:14:33.293234+0000","last_active":"2026-02-20T03:15:27.089821+0000","last_peered":"2026-02-20T03:15:27.089821+0000","last_clean":"2026-02-20T03:15:27.089821+0000","last_became_active":"2026-02-20T03:14:33.293158+0000","last_became_peered":"2026-02-20T03:14:33.293158+0000","last_unstale":"2026-02-20T03:15:27.089821+0000","last_undegraded":"2026-02-20T03:15:27.089821+0000","last_fullsized":"2026-02-20T03:15:27.089821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:52:57.818751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392752+0000","last_change":"2026-02-20T03:14:33.296005+0000","last_active":"2026-02-20T03:15:27.392752+0000","last_peered":"2026-02-20T03:15:27.392752+0000","last_clean":"2026-02-20T03:15:27.392752+0000","last_became_active":"2026-02-20T03:14:33.295699+0000","last_became_peered":"2026-02-20T03:14:33.295699+0000","last_unstale":"2026-02-20T03:15:27.392752+0000","last_undegraded":"2026-02-20T03:15:27.392752+0000","last_fullsized":"2026-02-20T03:15:27.392752+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:41:34.638536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.098066+0000","last_change":"2026-02-20T03:14:33.298535+0000","last_active":"2026-02-20T03:15:27.098066+0000","last_peered":"2026-02-20T03:15:27.098066+0000","last_clean":"2026-02-20T03:15:27.098066+0000","last_became_active":"2026-02-20T03:14:33.297751+0000","last_became_peered":"2026-02-20T03:14:33.297751+0000","last_unstale":"2026-02-20T03:15:27.098066+0000","last_undegraded":"2026-02-20T03:15:27.098066+0000","last_fullsized":"2026-02-20T03:15:27.098066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:44:17.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.384200+0000","last_change":"2026-02-20T03:14:33.297002+0000","last_active":"2026-02-20T03:15:27.384200+0000","last_peered":"2026-02-20T03:15:27.384200+0000","last_clean":"2026-02-20T03:15:27.384200+0000","last_became_active":"2026-02-20T03:14:33.296790+0000","last_became_peered":"2026-02-20T03:14:33.296790+0000","last_unstale":"2026-02-20T03:15:27.384200+0000","last_undegraded":"2026-02-20T03:15:27.384200+0000","last_fullsized":"2026-02-20T03:15:27.384200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T14:28:22.555195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.101465+0000","last_change":"2026-02-20T03:15:27.101465+0000","last_active":"2026-02-20T03:15:27.101465+0000","last_peered":"2026-02-20T03:15:27.101465+0000","last_clean":"2026-02-20T03:15:27.101465+0000","last_became_active":"2026-02-20T03:15:27.101042+0000","last_became_peered":"2026-02-20T03:15:27.101042+0000","last_unstale":"2026-02-20T03:15:27.101465+0000","last_undegraded":"2026-02-20T03:15:27.101465+0000","last_fullsized":"2026-02-20T03:15:27.101465+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T13:16:15.105763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,11],"acting":[1,6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.676902+0000","last_change":"2026-02-20T03:14:33.289152+0000","last_active":"2026-02-20T03:15:27.676902+0000","last_peered":"2026-02-20T03:15:27.676902+0000","last_clean":"2026-02-20T03:15:27.676902+0000","last_became_active":"2026-02-20T03:14:33.288993+0000","last_became_peered":"2026-02-20T03:14:33.288993+0000","last_unstale":"2026-02-20T03:15:27.676902+0000","last_undegraded":"2026-02-20T03:15:27.676902+0000","last_fullsized":"2026-02-20T03:15:27.676902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:48:57.695591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.097349+0000","last_change":"2026-02-20T03:14:33.297850+0000","last_active":"2026-02-20T03:15:27.097349+0000","last_peered":"2026-02-20T03:15:27.097349+0000","last_clean":"2026-02-20T03:15:27.097349+0000","last_became_active":"2026-02-20T03:14:33.297526+0000","last_became_peered":"2026-02-20T03:14:33.297526+0000","last_unstale":"2026-02-20T03:15:27.097349+0000","last_undegraded":"2026-02-20T03:15:27.097349+0000","last_fullsized":"2026-02-20T03:15:27.097349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:46:44.566998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.383987+0000","last_change":"2026-02-20T03:14:33.297113+0000","last_active":"2026-02-20T03:15:27.383987+0000","last_peered":"2026-02-20T03:15:27.383987+0000","last_clean":"2026-02-20T03:15:27.383987+0000","last_became_active":"2026-02-20T03:14:33.296938+0000","last_became_peered":"2026-02-20T03:14:33.296938+0000","last_unstale":"2026-02-20T03:15:27.383987+0000","last_undegraded":"2026-02-20T03:15:27.383987+0000","last_fullsized":"2026-02-20T03:15:27.383987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:29.514208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.096022+0000","last_change":"2026-02-20T03:14:33.289368+0000","last_active":"2026-02-20T03:15:27.096022+0000","last_peered":"2026-02-20T03:15:27.096022+0000","last_clean":"2026-02-20T03:15:27.096022+0000","last_became_active":"2026-02-20T03:14:33.289089+0000","last_became_peered":"2026-02-20T03:14:33.289089+0000","last_unstale":"2026-02-20T03:15:27.096022+0000","last_undegraded":"2026-02-20T03:15:27.096022+0000","last_fullsized":"2026-02-20T03:15:27.096022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:23:18.314010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.392687+0000","last_change":"2026-02-20T03:14:33.294583+0000","last_active":"2026-02-20T03:15:27.392687+0000","last_peered":"2026-02-20T03:15:27.392687+0000","last_clean":"2026-02-20T03:15:27.392687+0000","last_became_active":"2026-02-20T03:14:33.294401+0000","last_became_peered":"2026-02-20T03:14:33.294401+0000","last_unstale":"2026-02-20T03:15:27.392687+0000","last_undegraded":"2026-02-20T03:15:27.392687+0000","last_fullsized":"2026-02-20T03:15:27.392687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T09:23:11.000376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091837+0000","last_change":"2026-02-20T03:14:33.292960+0000","last_active":"2026-02-20T03:15:27.091837+0000","last_peered":"2026-02-20T03:15:27.091837+0000","last_clean":"2026-02-20T03:15:27.091837+0000","last_became_active":"2026-02-20T03:14:33.292878+0000","last_became_peered":"2026-02-20T03:14:33.292878+0000","last_unstale":"2026-02-20T03:15:27.091837+0000","last_undegraded":"2026-02-20T03:15:27.091837+0000","last_fullsized":"2026-02-20T03:15:27.091837+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:56:54.905640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.091994+0000","last_change":"2026-02-20T03:14:33.295130+0000","last_active":"2026-02-20T03:15:27.091994+0000","last_peered":"2026-02-20T03:15:27.091994+0000","last_clean":"2026-02-20T03:15:27.091994+0000","last_became_active":"2026-02-20T03:14:33.294988+0000","last_became_peered":"2026-02-20T03:14:33.294988+0000","last_unstale":"2026-02-20T03:15:27.091994+0000","last_undegraded":"2026-02-20T03:15:27.091994+0000","last_fullsized":"2026-02-20T03:15:27.091994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:18:20.569164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2026-02-20T03:15:27.094313+0000","last_change":"2026-02-20T03:14:33.295221+0000","last_active":"2026-02-20T03:15:27.094313+0000","last_peered":"2026-02-20T03:15:27.094313+0000","last_clean":"2026-02-20T03:15:27.094313+0000","last_became_active":"2026-02-20T03:14:33.294882+0000","last_became_peered":"2026-02-20T03:14:33.294882+0000","last_unstale":"2026-02-20T03:15:27.094313+0000","last_undegraded":"2026-02-20T03:15:27.094313+0000","last_fullsized":"2026-02-20T03:15:27.094313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T03:14:32.065320+0000","last_clean_scrub_stamp":"2026-02-20T03:14:32.065320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:15:47.401955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":86260,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":286,"num_read_kb":232,"num_write":175,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1206,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":258902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32140,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971060,"statfs":{"total":751619276800,"available":751586365440,"internally_reserved":0,"allocated":1032192,"data_stored":502911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31848901},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612628,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32816,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970384,"statfs":{"total":751619276800,"available":751585673216,"internally_reserved":0,"allocated":1732608,"data_stored":1167452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776150,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":507221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037785,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32136,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971064,"statfs":{"total":751619276800,"available":751586369536,"internally_reserved":0,"allocated":1036288,"data_stored":502431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299419,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32728,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733970472,"statfs":{"total":751619276800,"available":751585763328,"internally_reserved":0,"allocated":1642496,"data_stored":1104341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":47,"seq":201863462940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27972,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975228,"statfs":{"total":751619276800,"available":751590633472,"internally_reserved":0,"allocated":1024000,"data_stored":498291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":39,"seq":167503724575,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28576,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733974624,"statfs":{"total":751619276800,"available":751590014976,"internally_reserved":0,"allocated":1650688,"data_stored":1099476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888097,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":32148,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":733971052,"statfs":{"total":751619276800,"available":751586357248,"internally_reserved":0,"allocated":1040384,"data_stored":503925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149731,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27976,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975224,"statfs":{"total":751619276800,"available":751590629376,"internally_reserved":0,"allocated":1036288,"data_stored":498485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378662,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28068,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975132,"statfs":{"total":751619276800,"available":751590535168,"internally_reserved":0,"allocated":1130496,"data_stored":581258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28048,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975152,"statfs":{"total":751619276800,"available":751590555648,"internally_reserved":0,"allocated":1110016,"data_stored":575696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27996,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975204,"statfs":{"total":751619276800,"available":751590608896,"internally_reserved":0,"allocated":1048576,"data_stored":499699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":77495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":83057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":78883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T03:15:39.507 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:39 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:15:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:39 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:15:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:39 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:15:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:39 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:15:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:39 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:15:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:39 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:15:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:39 trial126 ceph-mon[38476]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:39 trial126 ceph-mon[38476]: pgmap v207: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 110 B/s, 0 objects/s recovering 2026-02-20T03:15:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:39 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:15:39.774 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:39.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.961+0000 7f2896e43640 1 -- 10.20.193.28:0/4264618568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f289010f270 msgr2=0x7f2890111660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:39.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.961+0000 7f2896e43640 1 --2- 10.20.193.28:0/4264618568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f289010f270 0x7f2890111660 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f288c00b0a0 tx=0x7f288c02f4a0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.961+0000 7f2896e43640 1 -- 10.20.193.28:0/4264618568 shutdown_connections 2026-02-20T03:15:39.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.961+0000 7f2896e43640 1 --2- 10.20.193.28:0/4264618568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f289010f270 0x7f2890111660 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.961+0000 7f2896e43640 1 --2- 10.20.193.28:0/4264618568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2890075cd0 0x7f289010ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.961+0000 7f2896e43640 1 --2- 10.20.193.28:0/4264618568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f28900753b0 0x7f2890075790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.961+0000 7f2896e43640 1 -- 10.20.193.28:0/4264618568 >> 10.20.193.28:0/4264618568 conn(0x7f28900fe5d0 msgr2=0x7f28901009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:39.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.961+0000 7f2896e43640 1 -- 10.20.193.28:0/4264618568 shutdown_connections 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.961+0000 7f2896e43640 1 -- 10.20.193.28:0/4264618568 wait complete. 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2896e43640 1 Processor -- start 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2896e43640 1 -- start start 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2896e43640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f28900753b0 0x7f289019d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2896e43640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2890075cd0 0x7f289019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2896e43640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f289010f270 0x7f28901a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2896e43640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2890114da0 con 0x7f2890075cd0 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2896e43640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2890114c20 con 0x7f28900753b0 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2896e43640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2890114f20 con 0x7f289010f270 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f28953b9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f289010f270 0x7f28901a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2894bb8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f28900753b0 0x7f289019d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.962+0000 7f2887fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2890075cd0 0x7f289019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2887fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2890075cd0 0x7f289019d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56364/0 (socket says 10.20.193.28:56364) 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2887fff640 1 -- 10.20.193.28:0/2292908334 learned_addr learned my addr 10.20.193.28:0/2292908334 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2887fff640 1 -- 10.20.193.28:0/2292908334 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f289010f270 msgr2=0x7f28901a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2887fff640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f289010f270 0x7f28901a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2887fff640 1 -- 10.20.193.28:0/2292908334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f28900753b0 msgr2=0x7f289019d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2887fff640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f28900753b0 0x7f289019d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2887fff640 1 -- 10.20.193.28:0/2292908334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28901a2230 con 0x7f2890075cd0 2026-02-20T03:15:39.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2887fff640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2890075cd0 0x7f289019d720 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f287800e9f0 tx=0x7f287800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:39.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2885ffb640 1 -- 10.20.193.28:0/2292908334 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287800cd80 con 0x7f2890075cd0 2026-02-20T03:15:39.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2885ffb640 1 -- 10.20.193.28:0/2292908334 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2878004570 con 0x7f2890075cd0 2026-02-20T03:15:39.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2885ffb640 1 -- 10.20.193.28:0/2292908334 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878010690 con 0x7f2890075cd0 2026-02-20T03:15:39.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28901a2520 con 0x7f2890075cd0 2026-02-20T03:15:39.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.963+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28901a9d60 con 0x7f2890075cd0 2026-02-20T03:15:39.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.964+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2890075790 con 0x7f2890075cd0 2026-02-20T03:15:39.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.966+0000 7f2885ffb640 1 -- 10.20.193.28:0/2292908334 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f28780040d0 con 0x7f2890075cd0 2026-02-20T03:15:39.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.968+0000 7f2885ffb640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f286c0b0eb0 0x7f286c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:39.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.968+0000 7f2885ffb640 1 -- 10.20.193.28:0/2292908334 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f28780e0f40 con 0x7f2890075cd0 2026-02-20T03:15:39.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.968+0000 7f2885ffb640 1 -- 10.20.193.28:0/2292908334 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f28780a9310 con 0x7f2890075cd0 2026-02-20T03:15:39.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.968+0000 7f2894bb8640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f286c0b0eb0 0x7f286c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:39.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:39.969+0000 7f2894bb8640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f286c0b0eb0 0x7f286c0b3370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2880004520 tx=0x7f2880009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:40.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.076+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f289019e540 con 0x7f2890075cd0 2026-02-20T03:15:40.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.077+0000 7f2885ffb640 1 -- 10.20.193.28:0/2292908334 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7f289019e540 con 0x7f2890075cd0 2026-02-20T03:15:40.080 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:40.080 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T03:15:38:113153+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:37.375812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:15:40.081 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T03:15:40.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f286c0b0eb0 msgr2=0x7f286c0b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f286c0b0eb0 0x7f286c0b3370 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2880004520 tx=0x7f2880009290 comp rx=0 tx=0).stop 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2890075cd0 msgr2=0x7f289019d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2890075cd0 0x7f289019d720 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f287800e9f0 tx=0x7f287800eec0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 shutdown_connections 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f286c0b0eb0 0x7f286c0b3370 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f289010f270 0x7f28901a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2890075cd0 0x7f289019d720 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 --2- 10.20.193.28:0/2292908334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f28900753b0 0x7f289019d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 >> 10.20.193.28:0/2292908334 conn(0x7f28900fe5d0 msgr2=0x7f28900ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 shutdown_connections 2026-02-20T03:15:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.078+0000 7f2896e43640 1 -- 10.20.193.28:0/2292908334 wait complete. 2026-02-20T03:15:40.182 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:40.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:40 trial028 ceph-mon[38552]: from='client.25300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:40.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:40 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2292908334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:40.447 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:40.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:40 trial177 ceph-mon[43181]: from='client.25300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:40.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:40 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2292908334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:40.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:40 trial126 ceph-mon[38476]: from='client.25300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:40.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:40 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2292908334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:40.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.640+0000 7fe01656f640 1 -- 10.20.193.28:0/3826466248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe010109ba0 msgr2=0x7fe010115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:40.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.640+0000 7fe01656f640 1 --2- 10.20.193.28:0/3826466248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe010109ba0 0x7fe010115d10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00b0a0 tx=0x7fe00c02f410 comp rx=0 tx=0).stop 2026-02-20T03:15:40.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.640+0000 7fe01656f640 1 -- 10.20.193.28:0/3826466248 shutdown_connections 2026-02-20T03:15:40.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.640+0000 7fe01656f640 1 --2- 10.20.193.28:0/3826466248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe010109ba0 0x7fe010115d10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.640+0000 7fe01656f640 1 --2- 10.20.193.28:0/3826466248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe010109220 0x7fe010109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.640+0000 7fe01656f640 1 --2- 10.20.193.28:0/3826466248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe01010eef0 0x7fe01010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.640+0000 7fe01656f640 1 -- 10.20.193.28:0/3826466248 >> 10.20.193.28:0/3826466248 conn(0x7fe010078600 msgr2=0x7fe01007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:40.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.640+0000 7fe01656f640 1 -- 10.20.193.28:0/3826466248 shutdown_connections 2026-02-20T03:15:40.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.640+0000 7fe01656f640 1 -- 10.20.193.28:0/3826466248 wait complete. 2026-02-20T03:15:40.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.641+0000 7fe01656f640 1 Processor -- start 2026-02-20T03:15:40.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.641+0000 7fe01656f640 1 -- start start 2026-02-20T03:15:40.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01656f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe010109220 0x7fe0101a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:40.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01656f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe010109ba0 0x7fe0101a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01656f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe01010eef0 0x7fe0101a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01656f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0101190b0 con 0x7fe010109ba0 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01656f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe010118f30 con 0x7fe01010eef0 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01656f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe010119230 con 0x7fe010109220 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01556d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe010109220 0x7fe0101a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01556d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe010109220 0x7fe0101a1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50938/0 (socket says 10.20.193.28:50938) 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01556d640 1 -- 10.20.193.28:0/212117188 learned_addr learned my addr 10.20.193.28:0/212117188 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe014d6c640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe010109ba0 0x7fe0101a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe015d6e640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe01010eef0 0x7fe0101a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:40.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe014d6c640 1 -- 10.20.193.28:0/212117188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe010109220 msgr2=0x7fe0101a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe014d6c640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe010109220 0x7fe0101a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe014d6c640 1 -- 10.20.193.28:0/212117188 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe01010eef0 msgr2=0x7fe0101a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe014d6c640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe01010eef0 0x7fe0101a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe014d6c640 1 -- 10.20.193.28:0/212117188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0101a6480 con 0x7fe010109ba0 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe01556d640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe010109220 0x7fe0101a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.642+0000 7fe014d6c640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe010109ba0 0x7fe0101a1970 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe00400e9f0 tx=0x7fe00400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.643+0000 7fdffe7fc640 1 -- 10.20.193.28:0/212117188 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00400cd80 con 0x7fe010109ba0 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.643+0000 7fdffe7fc640 1 -- 10.20.193.28:0/212117188 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe004004570 con 0x7fe010109ba0 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.643+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0101a6770 con 0x7fe010109ba0 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.643+0000 7fdffe7fc640 1 -- 10.20.193.28:0/212117188 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004010690 con 0x7fe010109ba0 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.643+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0101adfb0 con 0x7fe010109ba0 2026-02-20T03:15:40.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.643+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01010a580 con 0x7fe010109ba0 2026-02-20T03:15:40.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.646+0000 7fdffe7fc640 1 -- 10.20.193.28:0/212117188 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fe004002890 con 0x7fe010109ba0 2026-02-20T03:15:40.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.647+0000 7fdffe7fc640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfec0b0e30 0x7fdfec0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:40.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.647+0000 7fdffe7fc640 1 -- 10.20.193.28:0/212117188 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fe0040e1060 con 0x7fe010109ba0 2026-02-20T03:15:40.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.647+0000 7fe01556d640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfec0b0e30 0x7fdfec0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:40.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.647+0000 7fdffe7fc640 1 -- 10.20.193.28:0/212117188 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe0040a4da0 con 0x7fe010109ba0 2026-02-20T03:15:40.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.648+0000 7fe01556d640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfec0b0e30 0x7fdfec0b32f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe000005fd0 tx=0x7fe0000074e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:40.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.756+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe010109660 con 0x7fe010109ba0 2026-02-20T03:15:40.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.757+0000 7fdffe7fc640 1 -- 10.20.193.28:0/212117188 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7fe010109660 con 0x7fe010109ba0 2026-02-20T03:15:40.760 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:40.760 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T03:15:38:113153+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:37.375812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:15:40.760 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T03:15:40.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfec0b0e30 msgr2=0x7fdfec0b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:40.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfec0b0e30 0x7fdfec0b32f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe000005fd0 tx=0x7fe0000074e0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe010109ba0 msgr2=0x7fe0101a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:40.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe010109ba0 0x7fe0101a1970 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe00400e9f0 tx=0x7fe00400eec0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 shutdown_connections 2026-02-20T03:15:40.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfec0b0e30 0x7fdfec0b32f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe01010eef0 0x7fe0101a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe010109ba0 0x7fe0101a1970 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 --2- 10.20.193.28:0/212117188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe010109220 0x7fe0101a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:40.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 >> 10.20.193.28:0/212117188 conn(0x7fe010078600 msgr2=0x7fe010079cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:40.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 shutdown_connections 2026-02-20T03:15:40.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:40.758+0000 7fe01656f640 1 -- 10.20.193.28:0/212117188 wait complete. 2026-02-20T03:15:40.858 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:15:41.121 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:41.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 -- 10.20.193.28:0/2872985833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077620 msgr2=0x7f719c077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:41.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/2872985833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077620 0x7f719c077a00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f718c009a30 tx=0x7f718c02f220 comp rx=0 tx=0).stop 2026-02-20T03:15:41.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 -- 10.20.193.28:0/2872985833 shutdown_connections 2026-02-20T03:15:41.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/2872985833 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f719c113820 0x7f719c115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:41.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/2872985833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f719c077f40 0x7f719c1132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:41.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/2872985833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077620 0x7f719c077a00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:41.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 -- 10.20.193.28:0/2872985833 >> 10.20.193.28:0/2872985833 conn(0x7f719c100680 msgr2=0x7f719c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:41.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 -- 10.20.193.28:0/2872985833 shutdown_connections 2026-02-20T03:15:41.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 -- 10.20.193.28:0/2872985833 wait complete. 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.306+0000 7f71a1ddd640 1 Processor -- start 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f71a1ddd640 1 -- start start 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f71a1ddd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f719c077620 0x7f719c1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f71a1ddd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077f40 0x7f719c1a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f71a1ddd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f719c113820 0x7f719c1a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f71a1ddd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f719c1190c0 con 0x7f719c077f40 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f71a1ddd640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f719c118f40 con 0x7f719c113820 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f71a1ddd640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f719c119240 con 0x7f719c077620 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f7193fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077f40 0x7f719c1a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f7193fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077f40 0x7f719c1a1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56414/0 (socket says 10.20.193.28:56414) 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f7193fff640 1 -- 10.20.193.28:0/376037978 learned_addr learned my addr 10.20.193.28:0/376037978 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f71a15dc640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f719c113820 0x7f719c1a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f71a0ddb640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f719c077620 0x7f719c1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f7193fff640 1 -- 10.20.193.28:0/376037978 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f719c077620 msgr2=0x7f719c1a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f7193fff640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f719c077620 0x7f719c1a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f7193fff640 1 -- 10.20.193.28:0/376037978 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f719c113820 msgr2=0x7f719c1a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.307+0000 7f7193fff640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f719c113820 0x7f719c1a5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.308+0000 7f7193fff640 1 -- 10.20.193.28:0/376037978 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c1a65d0 con 0x7f719c077f40 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.308+0000 7f7193fff640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077f40 0x7f719c1a1ac0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f718400ea30 tx=0x7f718400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.308+0000 7f7191ffb640 1 -- 10.20.193.28:0/376037978 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718400ce50 con 0x7f719c077f40 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.308+0000 7f7191ffb640 1 -- 10.20.193.28:0/376037978 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7184004570 con 0x7f719c077f40 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.308+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719c1a68c0 con 0x7f719c077f40 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.308+0000 7f7191ffb640 1 -- 10.20.193.28:0/376037978 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184010690 con 0x7f719c077f40 2026-02-20T03:15:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.308+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719c1ae100 con 0x7f719c077f40 2026-02-20T03:15:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.309+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719c077a00 con 0x7f719c077f40 2026-02-20T03:15:41.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.311+0000 7f7191ffb640 1 -- 10.20.193.28:0/376037978 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f71840040d0 con 0x7f719c077f40 2026-02-20T03:15:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.313+0000 7f7191ffb640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71780b0eb0 0x7f71780b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.313+0000 7f7191ffb640 1 -- 10.20.193.28:0/376037978 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f71840e0fb0 con 0x7f719c077f40 2026-02-20T03:15:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.313+0000 7f7191ffb640 1 -- 10.20.193.28:0/376037978 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f71840e1430 con 0x7f719c077f40 2026-02-20T03:15:41.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.313+0000 7f71a0ddb640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71780b0eb0 0x7f71780b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:41.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.314+0000 7f71a0ddb640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71780b0eb0 0x7f71780b3370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f718c0059c0 tx=0x7f718c005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:41.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.407+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f719c10e450 con 0x7f719c077f40 2026-02-20T03:15:41.410 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:41 trial028 ceph-mon[38552]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:41.410 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:41 trial028 ceph-mon[38552]: pgmap v208: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 8 op/s; 100 B/s, 0 objects/s recovering 2026-02-20T03:15:41.410 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:41 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/212117188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:41.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.408+0000 7f7191ffb640 1 -- 10.20.193.28:0/376037978 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24707 (secure 0 0 0) 0x7f71840a93b0 con 0x7f719c077f40 2026-02-20T03:15:41.411 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:41.411 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":91,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:15:27.086854+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7},{"from":3,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:15:41.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.409+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71780b0eb0 msgr2=0x7f71780b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:41.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.409+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71780b0eb0 0x7f71780b3370 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f718c0059c0 tx=0x7f718c005950 comp rx=0 tx=0).stop 2026-02-20T03:15:41.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.409+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077f40 msgr2=0x7f719c1a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:41.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.409+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077f40 0x7f719c1a1ac0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f718400ea30 tx=0x7f718400ef00 comp rx=0 tx=0).stop 2026-02-20T03:15:41.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.410+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 shutdown_connections 2026-02-20T03:15:41.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.410+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71780b0eb0 0x7f71780b3370 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:41.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.410+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f719c113820 0x7f719c1a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:41.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.410+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f719c077f40 0x7f719c1a1ac0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:41.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.410+0000 7f71a1ddd640 1 --2- 10.20.193.28:0/376037978 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f719c077620 0x7f719c1a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:41.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.410+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 >> 10.20.193.28:0/376037978 conn(0x7f719c100680 msgr2=0x7f719c113ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:41.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.410+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 shutdown_connections 2026-02-20T03:15:41.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:41.410+0000 7f71a1ddd640 1 -- 10.20.193.28:0/376037978 wait complete. 2026-02-20T03:15:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:41 trial177 ceph-mon[43181]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:41 trial177 ceph-mon[43181]: pgmap v208: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 8 op/s; 100 B/s, 0 objects/s recovering 2026-02-20T03:15:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:41 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/212117188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:41.511 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph daemon mon.a --format=json config get run_dir 2026-02-20T03:15:41.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:41 trial126 ceph-mon[38476]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-20T03:15:41.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:41 trial126 ceph-mon[38476]: pgmap v208: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.5 KiB/s wr, 8 op/s; 100 B/s, 0 objects/s recovering 2026-02-20T03:15:41.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:41 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/212117188' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:41.779 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:42.071 INFO:teuthology.orchestra.run.trial028.stdout:{"run_dir":"/var/run/ceph"} 2026-02-20T03:15:42.072 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2026-02-20T03:15:42.072 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 5467 2026-02-20T03:15:42.072 DEBUG:tasks.quiescer:Yielding 2026-02-20T03:15:42.073 INFO:teuthology.run_tasks:Running task workunit... 2026-02-20T03:15:42.097 INFO:tasks.workunit:Pulling workunits from ref f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:15:42.097 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-20T03:15:42.097 INFO:tasks.workunit:timeout=3h 2026-02-20T03:15:42.098 INFO:tasks.workunit:cleanup=True 2026-02-20T03:15:42.098 DEBUG:teuthology.orchestra.run.trial028:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-20T03:15:42.098 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:42.139 INFO:teuthology.orchestra.run.trial028.stdout: File: /home/ubuntu/cephtest/mnt.0 2026-02-20T03:15:42.139 INFO:teuthology.orchestra.run.trial028.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2026-02-20T03:15:42.139 INFO:teuthology.orchestra.run.trial028.stdout:Device: 2bh/43d Inode: 1099511628283 Links: 2 2026-02-20T03:15:42.139 INFO:teuthology.orchestra.run.trial028.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T03:15:42.139 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:unlabeled_t:s0 2026-02-20T03:15:42.139 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 03:14:55.060656861 +0000 2026-02-20T03:15:42.140 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 03:14:55.060656861 +0000 2026-02-20T03:15:42.140 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 03:15:24.137203243 +0000 2026-02-20T03:15:42.140 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 03:14:55.060656861 +0000 2026-02-20T03:15:42.140 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2026-02-20T03:15:42.140 DEBUG:teuthology.orchestra.run.trial028:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2026-02-20T03:15:42.246 DEBUG:teuthology.orchestra.run.trial028:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 2026-02-20T03:15:42.296 INFO:tasks.workunit.client.0.trial028.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-20T03:15:42.370 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:42.415 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:42 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/376037978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:42.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:42 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/376037978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:42.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.557+0000 7efc02736640 1 -- 10.20.193.28:0/2450342796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc105750 msgr2=0x7efbfc1097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:42.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.557+0000 7efc02736640 1 --2- 10.20.193.28:0/2450342796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc105750 0x7efbfc1097a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7efbec009a30 tx=0x7efbec02f240 comp rx=0 tx=0).stop 2026-02-20T03:15:42.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.557+0000 7efc02736640 1 -- 10.20.193.28:0/2450342796 shutdown_connections 2026-02-20T03:15:42.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.557+0000 7efc02736640 1 --2- 10.20.193.28:0/2450342796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efbfc109ed0 0x7efbfc111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.557+0000 7efc02736640 1 --2- 10.20.193.28:0/2450342796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc105750 0x7efbfc1097a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.557+0000 7efc02736640 1 --2- 10.20.193.28:0/2450342796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efbfc104da0 0x7efbfc105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.557+0000 7efc02736640 1 -- 10.20.193.28:0/2450342796 >> 10.20.193.28:0/2450342796 conn(0x7efbfc100840 msgr2=0x7efbfc102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:42.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.557+0000 7efc02736640 1 -- 10.20.193.28:0/2450342796 shutdown_connections 2026-02-20T03:15:42.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.557+0000 7efc02736640 1 -- 10.20.193.28:0/2450342796 wait complete. 2026-02-20T03:15:42.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.558+0000 7efc02736640 1 Processor -- start 2026-02-20T03:15:42.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.558+0000 7efc02736640 1 -- start start 2026-02-20T03:15:42.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc02736640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efbfc104da0 0x7efbfc19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:42.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc02736640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efbfc105750 0x7efbfc19d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:42.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc02736640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc109ed0 0x7efbfc1a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:42.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc02736640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc114d60 con 0x7efbfc109ed0 2026-02-20T03:15:42.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc02736640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc114be0 con 0x7efbfc104da0 2026-02-20T03:15:42.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc02736640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc114ee0 con 0x7efbfc105750 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc00cac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc109ed0 0x7efbfc1a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efbfbfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efbfc104da0 0x7efbfc19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc00cac640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc109ed0 0x7efbfc1a1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56436/0 (socket says 10.20.193.28:56436) 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc00cac640 1 -- 10.20.193.28:0/748715737 learned_addr learned my addr 10.20.193.28:0/748715737 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efbfb7fe640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efbfc105750 0x7efbfc19d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc00cac640 1 -- 10.20.193.28:0/748715737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efbfc105750 msgr2=0x7efbfc19d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc00cac640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efbfc105750 0x7efbfc19d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc00cac640 1 -- 10.20.193.28:0/748715737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efbfc104da0 msgr2=0x7efbfc19d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc00cac640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efbfc104da0 0x7efbfc19d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc00cac640 1 -- 10.20.193.28:0/748715737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc1a2220 con 0x7efbfc109ed0 2026-02-20T03:15:42.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.559+0000 7efc00cac640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc109ed0 0x7efbfc1a1aa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efbf0004820 tx=0x7efbf000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:42.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.560+0000 7efbf97fa640 1 -- 10.20.193.28:0/748715737 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf00090d0 con 0x7efbfc109ed0 2026-02-20T03:15:42.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.560+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbfc1a24b0 con 0x7efbfc109ed0 2026-02-20T03:15:42.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.560+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc1a9d50 con 0x7efbfc109ed0 2026-02-20T03:15:42.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.560+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbfc105180 con 0x7efbfc109ed0 2026-02-20T03:15:42.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.561+0000 7efbf97fa640 1 -- 10.20.193.28:0/748715737 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efbf0009270 con 0x7efbfc109ed0 2026-02-20T03:15:42.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.561+0000 7efbf97fa640 1 -- 10.20.193.28:0/748715737 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0021060 con 0x7efbfc109ed0 2026-02-20T03:15:42.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.562+0000 7efbf97fa640 1 -- 10.20.193.28:0/748715737 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7efbf0012070 con 0x7efbfc109ed0 2026-02-20T03:15:42.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.564+0000 7efbf97fa640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbd00b0eb0 0x7efbd00b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:42.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.564+0000 7efbf97fa640 1 -- 10.20.193.28:0/748715737 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7efbf00e08b0 con 0x7efbfc109ed0 2026-02-20T03:15:42.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.564+0000 7efbf97fa640 1 -- 10.20.193.28:0/748715737 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7efbf0010070 con 0x7efbfc109ed0 2026-02-20T03:15:42.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.564+0000 7efbfbfff640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbd00b0eb0 0x7efbd00b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:42.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.565+0000 7efbfbfff640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbd00b0eb0 0x7efbd00b3370 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efbe8004700 tx=0x7efbe8009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:42.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:42 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/376037978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:15:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.672+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efbfc10cd20 con 0x7efbfc109ed0 2026-02-20T03:15:42.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.672+0000 7efbf97fa640 1 -- 10.20.193.28:0/748715737 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7efbf00a8c80 con 0x7efbfc109ed0 2026-02-20T03:15:42.676 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:15:42.676 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T03:15:38:113153+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:37.375812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:15:42.677 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T03:15:42.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbd00b0eb0 msgr2=0x7efbd00b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:42.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbd00b0eb0 0x7efbd00b3370 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7efbe8004700 tx=0x7efbe8009290 comp rx=0 tx=0).stop 2026-02-20T03:15:42.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc109ed0 msgr2=0x7efbfc1a1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:42.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc109ed0 0x7efbfc1a1aa0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efbf0004820 tx=0x7efbf000d4a0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 shutdown_connections 2026-02-20T03:15:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbd00b0eb0 0x7efbd00b3370 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efbfc109ed0 0x7efbfc1a1aa0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efbfc105750 0x7efbfc19d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 --2- 10.20.193.28:0/748715737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efbfc104da0 0x7efbfc19d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 >> 10.20.193.28:0/748715737 conn(0x7efbfc100840 msgr2=0x7efbfc101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 shutdown_connections 2026-02-20T03:15:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:42.673+0000 7efc02736640 1 -- 10.20.193.28:0/748715737 wait complete. 2026-02-20T03:15:42.774 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2026-02-20T03:14:32.740764+0000', 'modified': '2026-02-20T03:15:37.375812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24560, 'mds_1': 24538, 'mds_2': 24533}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24515': {'gid': 24515, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.126:6835/2797409986', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6834', 'nonce': 2797409986}, {'type': 'v1', 'addr': '10.20.193.126:6835', 'nonce': 2797409986}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.177:6835/2041071245', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.177:6834', 'nonce': 2041071245}, {'type': 'v1', 'addr': '10.20.193.177:6835', 'nonce': 2041071245}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24523': {'gid': 24523, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '10.20.193.177:6837/3933107687', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.177:6836', 'nonce': 3933107687}, {'type': 'v1', 'addr': '10.20.193.177:6837', 'nonce': 3933107687}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '10.20.193.126:6837/1802675915', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6836', 'nonce': 1802675915}, {'type': 'v1', 'addr': '10.20.193.126:6837', 'nonce': 1802675915}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'i', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 8, 'addr': '10.20.193.177:6839/1288808268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.177:6838', 'nonce': 1288808268}, {'type': 'v1', 'addr': '10.20.193.177:6839', 'nonce': 1288808268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '10.20.193.126:6839/2074063114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.126:6838', 'nonce': 2074063114}, {'type': 'v1', 'addr': '10.20.193.126:6839', 'nonce': 2074063114}]}, 'join_fscid': -1, 'export_targets': [1, 2], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24533, 24538, 24560]} 2026-02-20T03:15:42.774 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2026-02-20T03:15:42.774 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.h status 2026-02-20T03:15:43.048 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:43.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.233+0000 7f0258c34640 1 -- 10.20.193.28:0/1604516400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0254109220 msgr2=0x7f0254109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.233+0000 7f0258c34640 1 --2- 10.20.193.28:0/1604516400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0254109220 0x7f0254109660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0244009960 tx=0x7f024402f160 comp rx=0 tx=0).stop 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.233+0000 7f0258c34640 1 -- 10.20.193.28:0/1604516400 shutdown_connections 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.233+0000 7f0258c34640 1 --2- 10.20.193.28:0/1604516400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0254109ba0 0x7f0254115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.233+0000 7f0258c34640 1 --2- 10.20.193.28:0/1604516400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0254109220 0x7f0254109660 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.233+0000 7f0258c34640 1 --2- 10.20.193.28:0/1604516400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f025410eef0 0x7f025410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.233+0000 7f0258c34640 1 -- 10.20.193.28:0/1604516400 >> 10.20.193.28:0/1604516400 conn(0x7f0254078600 msgr2=0x7f025407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.233+0000 7f0258c34640 1 -- 10.20.193.28:0/1604516400 shutdown_connections 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.233+0000 7f0258c34640 1 -- 10.20.193.28:0/1604516400 wait complete. 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0258c34640 1 Processor -- start 2026-02-20T03:15:43.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0258c34640 1 -- start start 2026-02-20T03:15:43.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0258c34640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0254109220 0x7f02541a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0258c34640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0254109ba0 0x7f02541a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0258c34640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f025410eef0 0x7f02541a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0258c34640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0254119070 con 0x7f0254109ba0 2026-02-20T03:15:43.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0258c34640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0254118ef0 con 0x7f025410eef0 2026-02-20T03:15:43.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0258c34640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f02541191f0 con 0x7f0254109220 2026-02-20T03:15:43.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0252ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0254109ba0 0x7f02541a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0252ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0254109ba0 0x7f02541a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56452/0 (socket says 10.20.193.28:56452) 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0252ffd640 1 -- 10.20.193.28:0/2321748545 learned_addr learned my addr 10.20.193.28:0/2321748545 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f0253fff640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f025410eef0 0x7f02541a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.234+0000 7f02537fe640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0254109220 0x7f02541a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0252ffd640 1 -- 10.20.193.28:0/2321748545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0254109220 msgr2=0x7f02541a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0252ffd640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0254109220 0x7f02541a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0252ffd640 1 -- 10.20.193.28:0/2321748545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f025410eef0 msgr2=0x7f02541a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0252ffd640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f025410eef0 0x7f02541a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0252ffd640 1 -- 10.20.193.28:0/2321748545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02541a65c0 con 0x7f0254109ba0 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f02537fe640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0254109220 0x7f02541a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0252ffd640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0254109ba0 0x7f02541a1ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f024402f670 tx=0x7f0244002980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0250ff9640 1 -- 10.20.193.28:0/2321748545 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024402fd50 con 0x7f0254109ba0 2026-02-20T03:15:43.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0258c34640 1 -- 10.20.193.28:0/2321748545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02541a6850 con 0x7f0254109ba0 2026-02-20T03:15:43.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0250ff9640 1 -- 10.20.193.28:0/2321748545 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f02440044d0 con 0x7f0254109ba0 2026-02-20T03:15:43.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0250ff9640 1 -- 10.20.193.28:0/2321748545 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244041620 con 0x7f0254109ba0 2026-02-20T03:15:43.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.235+0000 7f0258c34640 1 -- 10.20.193.28:0/2321748545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02541ae0f0 con 0x7f0254109ba0 2026-02-20T03:15:43.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.238+0000 7f025c3c2e00 1 Processor -- start 2026-02-20T03:15:43.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.238+0000 7f0250ff9640 1 -- 10.20.193.28:0/2321748545 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f02440417c0 con 0x7f0254109ba0 2026-02-20T03:15:43.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.238+0000 7f025c3c2e00 1 -- start start 2026-02-20T03:15:43.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.238+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb468e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.238+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46eb0 0x558c9fb4a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.238+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 0x558c9fb4b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.238+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558c9fa99770 con 0x558c9fb46eb0 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.238+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558c9fa46f80 con 0x558c9fb4af00 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.238+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558c9fa956a0 con 0x558c9fb46500 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0253fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0252ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 0x558c9fb4b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0253fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50980/0 (socket says 10.20.193.28:50980) 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0253fff640 1 -- 10.20.193.28:0/1627816751 learned_addr learned my addr 10.20.193.28:0/1627816751 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f02537fe640 1 --2- 10.20.193.28:0/1627816751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46eb0 0x558c9fb4a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0253fff640 1 -- 10.20.193.28:0/1627816751 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 msgr2=0x558c9fb4b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0253fff640 1 --2- 10.20.193.28:0/1627816751 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 0x558c9fb4b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0253fff640 1 -- 10.20.193.28:0/1627816751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46eb0 msgr2=0x558c9fb4a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0253fff640 1 --2- 10.20.193.28:0/1627816751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46eb0 0x558c9fb4a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0253fff640 1 -- 10.20.193.28:0/1627816751 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c9fa39180 con 0x558c9fb46500 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0253fff640 1 --2- 10.20.193.28:0/1627816751 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb468e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f02480094e0 tx=0x7f02480099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11c5097ff6d192e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0217fff640 1 -- 10.20.193.28:0/1627816751 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024801b070 con 0x558c9fb46500 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0217fff640 1 -- 10.20.193.28:0/1627816751 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0248004570 con 0x558c9fb46500 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.239+0000 7f0217fff640 1 -- 10.20.193.28:0/1627816751 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248013ae0 con 0x558c9fb46500 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f0250ff9640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02280b0eb0 0x7f02280b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1627816751 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 msgr2=0x558c9fb468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1627816751 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb468e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f02480094e0 tx=0x7f02480099e0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f0250ff9640 1 -- 10.20.193.28:0/2321748545 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f0244105310 con 0x7f0254109ba0 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1627816751 shutdown_connections 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1627816751 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 0x558c9fb4b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1627816751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46eb0 0x558c9fb4a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1627816751 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb468e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1627816751 >> 10.20.193.28:0/1627816751 conn(0x558c9fb42630 msgr2=0x558c9fb44a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f02537fe640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02280b0eb0 0x7f02280b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1627816751 shutdown_connections 2026-02-20T03:15:43.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1627816751 wait complete. 2026-02-20T03:15:43.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.240+0000 7f02537fe640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02280b0eb0 0x7f02280b3370 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x558c9fb47430 tx=0x7f0240009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.241+0000 7f025c3c2e00 1 -- start start 2026-02-20T03:15:43.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f025c3c2e00 1 Processor -- start 2026-02-20T03:15:43.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb70710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46eb0 0x558c9fb70c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 0x558c9fb71ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558c9fa40d60 con 0x558c9fb46500 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558c9fb64520 con 0x558c9fb4af00 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558c9fb72140 con 0x558c9fb46eb0 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f02537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb70710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f02537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb70710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56484/0 (socket says 10.20.193.28:56484) 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f02537fe640 1 -- 10.20.193.28:0/2677739301 learned_addr learned my addr 10.20.193.28:0/2677739301 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f0252ffd640 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46eb0 0x558c9fb70c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f0253fff640 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 0x558c9fb71ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f02537fe640 1 -- 10.20.193.28:0/2677739301 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46eb0 msgr2=0x558c9fb70c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f02537fe640 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46eb0 0x558c9fb70c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f02537fe640 1 -- 10.20.193.28:0/2677739301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 msgr2=0x558c9fb71ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f02537fe640 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 0x558c9fb71ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.242+0000 7f02537fe640 1 -- 10.20.193.28:0/2677739301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c9fb69ca0 con 0x558c9fb46500 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f02537fe640 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb70710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0240004290 tx=0x7f0240004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70e7e62d4dffa94 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f02157fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f02157fa640 1 -- 10.20.193.28:0/2677739301 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024001e630 con 0x558c9fb46500 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f02157fa640 1 -- 10.20.193.28:0/2677739301 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0240023030 con 0x558c9fb46500 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f02157fa640 1 -- 10.20.193.28:0/2677739301 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024001fb40 con 0x558c9fb46500 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f025c3c2e00 1 -- 10.20.193.28:0/2677739301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c9f86aa50 con 0x558c9fb46500 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f02157fa640 1 -- 10.20.193.28:0/2677739301 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f024001fd00 con 0x558c9fb46500 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f02157fa640 10 client.15315 inactive, discarding osd_map(91..91 src has 1..91) 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f025c3c2e00 10 client.15315 _ll_register_callbacks cb 0x558c9fa4e630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f025c3c2e00 1 -- 10.20.193.28:0/2677739301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558c9faa7110 con 0x558c9fb46500 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f02157fa640 1 -- 10.20.193.28:0/2677739301 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f024002d060 con 0x558c9fb46500 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f025c3c2e00 10 client.15315 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.243+0000 7f025c3c2e00 1 -- 10.20.193.28:0/2677739301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x558c9fa3f720 con 0x558c9fb46500 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.244+0000 7f02157fa640 1 -- 10.20.193.28:0/2677739301 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f0240030050 con 0x558c9fb46500 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.244+0000 7f025c3c2e00 10 client.15315 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.244+0000 7f025c3c2e00 10 client.15315 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.244+0000 7f025c3c2e00 20 client.15315 populate_metadata read hostname 'trial028' 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.244+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558c9fb81770 0x558c9fb82be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.244+0000 7f025c3c2e00 4 client.15315 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.244+0000 7f025c3c2e00 1 -- 10.20.193.28:0/2677739301 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c9faa1360 con 0x558c9fb81770 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.244+0000 7f0252ffd640 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558c9fb81770 0x558c9fb82be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.245+0000 7f0252ffd640 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558c9fb81770 0x558c9fb82be0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ccd4b0450bb1a58a server_cookie=aba25cddb27a434 in_seq=0 out_seq=0 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.245+0000 7f02157fa640 10 client.15315 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f02157fa640 1 -- 10.20.193.28:0/2677739301 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x558c9faa1360 con 0x558c9fb81770 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f02157fa640 10 client.15315 handle_command_reply: tid=0 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 client.15315 shutdown 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 -- 10.20.193.28:0/2677739301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 msgr2=0x558c9fb70710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb70710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0240004290 tx=0x7f0240004830 comp rx=0 tx=0).stop 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 -- 10.20.193.28:0/2677739301 shutdown_connections 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb4af00 0x558c9fb71ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46eb0 0x558c9fb70c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558c9fb81770 0x558c9fb82be0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/2677739301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb70710 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 -- 10.20.193.28:0/2677739301 >> 10.20.193.28:0/2677739301 conn(0x558c9fb42630 msgr2=0x558c9fb4a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f02157fa640 0 client.15315 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 -- 10.20.193.28:0/2677739301 shutdown_connections 2026-02-20T03:15:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 1 -- 10.20.193.28:0/2677739301 wait complete. 2026-02-20T03:15:43.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.246+0000 7f025c3c2e00 20 client.15315 trim_cache size 0 max 16384 2026-02-20T03:15:43.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.255+0000 7f025c3c2e00 1 Processor -- start 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.255+0000 7f025c3c2e00 1 -- start start 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.255+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb71a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.255+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 0x558c9fb4a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.255+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb4af00 0x558c9fb804e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.255+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558c9fb80f20 con 0x558c9fb4af00 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.255+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558c9fb815f0 con 0x558c9fb46eb0 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.255+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558c9fb81cc0 con 0x558c9fb46500 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f02537fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb71a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f0253fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb4af00 0x558c9fb804e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f02537fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb71a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50998/0 (socket says 10.20.193.28:50998) 2026-02-20T03:15:43.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f02537fe640 1 -- 10.20.193.28:0/1520275725 learned_addr learned my addr 10.20.193.28:0/1520275725 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f0252ffd640 1 --2- 10.20.193.28:0/1520275725 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 0x558c9fb4a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f0253fff640 1 -- 10.20.193.28:0/1520275725 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 msgr2=0x558c9fb71a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f0253fff640 1 --2- 10.20.193.28:0/1520275725 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb71a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f0253fff640 1 -- 10.20.193.28:0/1520275725 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 msgr2=0x558c9fb4a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f0253fff640 1 --2- 10.20.193.28:0/1520275725 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 0x558c9fb4a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f0253fff640 1 -- 10.20.193.28:0/1520275725 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c9fb69ad0 con 0x558c9fb4af00 2026-02-20T03:15:43.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f0253fff640 1 --2- 10.20.193.28:0/1520275725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb4af00 0x558c9fb804e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f024800b010 tx=0x7f0248006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ede70e9e03fe85 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f02177fe640 1 -- 10.20.193.28:0/1520275725 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248025070 con 0x558c9fb4af00 2026-02-20T03:15:43.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f02177fe640 1 -- 10.20.193.28:0/1520275725 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f024801c040 con 0x558c9fb4af00 2026-02-20T03:15:43.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.256+0000 7f02177fe640 1 -- 10.20.193.28:0/1520275725 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024801b030 con 0x558c9fb4af00 2026-02-20T03:15:43.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1520275725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb4af00 msgr2=0x558c9fb804e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1520275725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb4af00 0x558c9fb804e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f024800b010 tx=0x7f0248006000 comp rx=0 tx=0).stop 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1520275725 shutdown_connections 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1520275725 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb4af00 0x558c9fb804e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1520275725 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 0x558c9fb4a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1520275725 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb46500 0x558c9fb71a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1520275725 >> 10.20.193.28:0/1520275725 conn(0x558c9fb42630 msgr2=0x558c9fb44a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1520275725 shutdown_connections 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1520275725 wait complete. 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 -- start start 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.257+0000 7f025c3c2e00 1 Processor -- start 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb8b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 0x558c9fb87be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f025c3c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb4af00 0x558c9fb88160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558c9fb82a60 con 0x558c9fb46500 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558c9fb82390 con 0x558c9fb46eb0 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f025c3c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558c9fb83130 con 0x558c9fb4af00 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f0253fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb4af00 0x558c9fb88160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f02537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb8b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f0252ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 0x558c9fb87be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f02537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb8b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56492/0 (socket says 10.20.193.28:56492) 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f02537fe640 1 -- 10.20.193.28:0/1031395161 learned_addr learned my addr 10.20.193.28:0/1031395161 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f02537fe640 1 -- 10.20.193.28:0/1031395161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb4af00 msgr2=0x558c9fb88160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f02537fe640 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb4af00 0x558c9fb88160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f02537fe640 1 -- 10.20.193.28:0/1031395161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 msgr2=0x558c9fb87be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f02537fe640 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 0x558c9fb87be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.258+0000 7f02537fe640 1 -- 10.20.193.28:0/1031395161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c9f778780 con 0x558c9fb46500 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f02537fe640 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb8b8c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f024000a010 tx=0x7f024002b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241e83fd0e5d467b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f02157fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f02157fa640 1 -- 10.20.193.28:0/1031395161 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024001e630 con 0x558c9fb46500 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f02157fa640 1 -- 10.20.193.28:0/1031395161 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0240023030 con 0x558c9fb46500 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f02157fa640 1 -- 10.20.193.28:0/1031395161 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240032800 con 0x558c9fb46500 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1031395161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c9fa5f5f0 con 0x558c9fb46500 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f02157fa640 1 -- 10.20.193.28:0/1031395161 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f02400329a0 con 0x558c9fb46500 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f02157fa640 10 client.15321 inactive, discarding osd_map(91..91 src has 1..91) 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f025c3c2e00 10 client.15321 _ll_register_callbacks cb 0x7f02400044a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1031395161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558c9fb0eca0 con 0x558c9fb46500 2026-02-20T03:15:43.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f02157fa640 1 -- 10.20.193.28:0/1031395161 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0240032ba0 con 0x558c9fb46500 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f025c3c2e00 10 client.15321 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.259+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1031395161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x558c9fb6a7c0 con 0x558c9fb46500 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f02157fa640 1 -- 10.20.193.28:0/1031395161 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f0240030040 con 0x558c9fb46500 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f025c3c2e00 10 client.15321 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f025c3c2e00 10 client.15321 resolve_mds: resolved name 'h' to daemon mds.h 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f025c3c2e00 20 client.15321 populate_metadata read hostname 'trial028' 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558c9fbf19d0 0x558c9fbf0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f025c3c2e00 4 client.15321 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1031395161 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "status"}) -- 0x7f024801c040 con 0x558c9fbf19d0 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f0252ffd640 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558c9fbf19d0 0x558c9fbf0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f0252ffd640 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558c9fbf19d0 0x558c9fbf0680 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ade3c6e5d2c5d6e server_cookie=27e94b026ad2a276 in_seq=0 out_seq=0 2026-02-20T03:15:43.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.260+0000 7f02157fa640 10 client.15321 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f02157fa640 1 -- 10.20.193.28:0/1031395161 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x7f024801c040 con 0x558c9fbf19d0 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f02157fa640 10 client.15321 handle_command_reply: tid=0 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 client.15321 shutdown 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1031395161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 msgr2=0x558c9fb8b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb8b8c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f024000a010 tx=0x7f024002b000 comp rx=0 tx=0).stop 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1031395161 shutdown_connections 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c9fb4af00 0x558c9fb88160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c9fb46eb0 0x558c9fb87be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558c9fbf19d0 0x558c9fbf0680 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 --2- 10.20.193.28:0/1031395161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c9fb46500 0x558c9fb8b8c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1031395161 >> 10.20.193.28:0/1031395161 conn(0x558c9fb42630 msgr2=0x558c9fb44a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f02157fa640 0 client.15321 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:15:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1031395161 shutdown_connections 2026-02-20T03:15:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 1 -- 10.20.193.28:0/1031395161 wait complete. 2026-02-20T03:15:43.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f025c3c2e00 20 client.15321 trim_cache size 0 max 16384 2026-02-20T03:15:43.270 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:43.270 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:15:43.270 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 2, 2026-02-20T03:15:43.270 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24533, 2026-02-20T03:15:43.271 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:15:43.271 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:15:43.271 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:15:43.271 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 51.911589348, 2026-02-20T03:15:43.271 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 24, 2026-02-20T03:15:43.271 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 91, 2026-02-20T03:15:43.271 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 91, 2026-02-20T03:15:43.271 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 79.800283307000001 2026-02-20T03:15:43.271 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f0258c34640 1 -- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02280b0eb0 msgr2=0x7f02280b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f0258c34640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02280b0eb0 0x7f02280b3370 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x558c9fb47430 tx=0x7f0240009290 comp rx=0 tx=0).stop 2026-02-20T03:15:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f0258c34640 1 -- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0254109ba0 msgr2=0x7f02541a1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.261+0000 7f0258c34640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0254109ba0 0x7f02541a1ab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f024402f670 tx=0x7f0244002980 comp rx=0 tx=0).stop 2026-02-20T03:15:43.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.262+0000 7f0258c34640 1 -- 10.20.193.28:0/2321748545 shutdown_connections 2026-02-20T03:15:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.262+0000 7f0258c34640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02280b0eb0 0x7f02280b3370 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.262+0000 7f0258c34640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f025410eef0 0x7f02541a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.262+0000 7f0258c34640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0254109ba0 0x7f02541a1ab0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.262+0000 7f0258c34640 1 --2- 10.20.193.28:0/2321748545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0254109220 0x7f02541a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.262+0000 7f0258c34640 1 -- 10.20.193.28:0/2321748545 >> 10.20.193.28:0/2321748545 conn(0x7f0254078600 msgr2=0x7f0254079f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.262+0000 7f0258c34640 1 -- 10.20.193.28:0/2321748545 shutdown_connections 2026-02-20T03:15:43.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.262+0000 7f0258c34640 1 -- 10.20.193.28:0/2321748545 wait complete. 2026-02-20T03:15:43.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:43 trial028 ceph-mon[38552]: pgmap v209: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s; 49 B/s, 0 objects/s recovering 2026-02-20T03:15:43.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:43 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/748715737' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:43.362 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.i status 2026-02-20T03:15:43.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:43 trial177 ceph-mon[43181]: pgmap v209: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s; 49 B/s, 0 objects/s recovering 2026-02-20T03:15:43.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:43 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/748715737' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:43.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:43 trial126 ceph-mon[38476]: pgmap v209: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 6 op/s; 49 B/s, 0 objects/s recovering 2026-02-20T03:15:43.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:43 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/748715737' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:15:43.627 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:43.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.817+0000 7fbdfec9d640 1 -- 10.20.193.28:0/1321644792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8104980 msgr2=0x7fbdf8104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.817+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/1321644792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8104980 0x7fbdf8104de0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009a60 tx=0x7fbdec02f250 comp rx=0 tx=0).stop 2026-02-20T03:15:43.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.817+0000 7fbdfec9d640 1 -- 10.20.193.28:0/1321644792 shutdown_connections 2026-02-20T03:15:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.817+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/1321644792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf8105320 0x7fbdf8111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.817+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/1321644792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8104980 0x7fbdf8104de0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.817+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/1321644792 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdf810a980 0x7fbdf810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.817+0000 7fbdfec9d640 1 -- 10.20.193.28:0/1321644792 >> 10.20.193.28:0/1321644792 conn(0x7fbdf8100680 msgr2=0x7fbdf8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.817+0000 7fbdfec9d640 1 -- 10.20.193.28:0/1321644792 shutdown_connections 2026-02-20T03:15:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.817+0000 7fbdfec9d640 1 -- 10.20.193.28:0/1321644792 wait complete. 2026-02-20T03:15:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.818+0000 7fbdfec9d640 1 Processor -- start 2026-02-20T03:15:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.818+0000 7fbdfec9d640 1 -- start start 2026-02-20T03:15:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfec9d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf8104980 0x7fbdf819d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfec9d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8105320 0x7fbdf819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfec9d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdf810a980 0x7fbdf81a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfec9d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf8114bf0 con 0x7fbdf8105320 2026-02-20T03:15:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfec9d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf8114a70 con 0x7fbdf810a980 2026-02-20T03:15:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfec9d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf8114d70 con 0x7fbdf8104980 2026-02-20T03:15:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfdc9b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf8104980 0x7fbdf819d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfd49a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8105320 0x7fbdf819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfd49a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8105320 0x7fbdf819d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56516/0 (socket says 10.20.193.28:56516) 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfd49a640 1 -- 10.20.193.28:0/2953513789 learned_addr learned my addr 10.20.193.28:0/2953513789 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfe49c640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdf810a980 0x7fbdf81a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfd49a640 1 -- 10.20.193.28:0/2953513789 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf8104980 msgr2=0x7fbdf819d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf8104980 0x7fbdf819d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfd49a640 1 -- 10.20.193.28:0/2953513789 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdf810a980 msgr2=0x7fbdf81a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdf810a980 0x7fbdf81a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.819+0000 7fbdfd49a640 1 -- 10.20.193.28:0/2953513789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf81a2080 con 0x7fbdf8105320 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.820+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8105320 0x7fbdf819d610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbdec02fca0 tx=0x7fbdec02fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.820+0000 7fbde6ffd640 1 -- 10.20.193.28:0/2953513789 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec004240 con 0x7fbdf8105320 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.820+0000 7fbdfec9d640 1 -- 10.20.193.28:0/2953513789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf81a2310 con 0x7fbdf8105320 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.820+0000 7fbdfec9d640 1 -- 10.20.193.28:0/2953513789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf81a9c50 con 0x7fbdf8105320 2026-02-20T03:15:43.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.820+0000 7fbde6ffd640 1 -- 10.20.193.28:0/2953513789 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbdec0043e0 con 0x7fbdf8105320 2026-02-20T03:15:43.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.820+0000 7fbde6ffd640 1 -- 10.20.193.28:0/2953513789 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec042620 con 0x7fbdf8105320 2026-02-20T03:15:43.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.823+0000 7fbde6ffd640 1 -- 10.20.193.28:0/2953513789 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fbdec038770 con 0x7fbdf8105320 2026-02-20T03:15:43.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.823+0000 7fbe0242be00 1 Processor -- start 2026-02-20T03:15:43.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.823+0000 7fbe0242be00 1 -- start start 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.823+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea80ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.823+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea80ee8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea80ef370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbe0242be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562ea803d770 con 0x562ea80eaeb0 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbe0242be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562ea7feaf80 con 0x562ea80ea500 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbe0242be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562ea80396a0 con 0x562ea80eef00 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfdc9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea80ee8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfe49c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea80ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfdc9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea80ee8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56522/0 (socket says 10.20.193.28:56522) 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/1875453740 learned_addr learned my addr 10.20.193.28:0/1875453740 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/1875453740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea80ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/1875453740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 msgr2=0x562ea80ef370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/1875453740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea80ef370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/1875453740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 msgr2=0x562ea80ea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/1875453740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea80ea8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/1875453740 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea7fdd180 con 0x562ea80eaeb0 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/1875453740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea80ee8e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbde8007ce0 tx=0x7fbde80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43ba8f160b5d47f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdc64e6640 1 -- 10.20.193.28:0/1875453740 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde80040d0 con 0x562ea80eaeb0 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdc64e6640 1 -- 10.20.193.28:0/1875453740 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbde8015030 con 0x562ea80eaeb0 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.824+0000 7fbdc64e6640 1 -- 10.20.193.28:0/1875453740 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8011680 con 0x562ea80eaeb0 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbe0242be00 1 -- 10.20.193.28:0/1875453740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 msgr2=0x562ea80ee8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbe0242be00 1 --2- 10.20.193.28:0/1875453740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea80ee8e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbde8007ce0 tx=0x7fbde80107a0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbde6ffd640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdd40b0eb0 0x7fbdd40b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbde6ffd640 1 -- 10.20.193.28:0/2953513789 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fbdec105330 con 0x7fbdf8105320 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbe0242be00 1 -- 10.20.193.28:0/1875453740 shutdown_connections 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbe0242be00 1 --2- 10.20.193.28:0/1875453740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea80ef370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbe0242be00 1 --2- 10.20.193.28:0/1875453740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea80ee8e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbe0242be00 1 --2- 10.20.193.28:0/1875453740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea80ea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbe0242be00 1 -- 10.20.193.28:0/1875453740 >> 10.20.193.28:0/1875453740 conn(0x562ea80e6630 msgr2=0x562ea80e8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbe0242be00 1 -- 10.20.193.28:0/1875453740 shutdown_connections 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbdfe49c640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdd40b0eb0 0x7fbdd40b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbe0242be00 1 -- 10.20.193.28:0/1875453740 wait complete. 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.825+0000 7fbdfe49c640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdd40b0eb0 0x7fbdd40b3370 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4003d60 tx=0x7fbdf4007950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.826+0000 7fbe0242be00 1 -- start start 2026-02-20T03:15:43.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.826+0000 7fbe0242be00 1 Processor -- start 2026-02-20T03:15:43.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea810d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eaeb0 0x562ea810d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea810bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbe0242be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562ea7fe4d60 con 0x562ea80ea500 2026-02-20T03:15:43.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbe0242be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562ea80f7110 con 0x562ea80eaeb0 2026-02-20T03:15:43.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbe0242be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562ea810c280 con 0x562ea80eef00 2026-02-20T03:15:43.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfd49a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eaeb0 0x562ea810d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfe49c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea810bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfd49a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eaeb0 0x562ea810d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60104/0 (socket says 10.20.193.28:60104) 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfd49a640 1 -- 10.20.193.28:0/2545504329 learned_addr learned my addr 10.20.193.28:0/2545504329 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea810d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfd49a640 1 -- 10.20.193.28:0/2545504329 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 msgr2=0x562ea810bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea810bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfd49a640 1 -- 10.20.193.28:0/2545504329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 msgr2=0x562ea810d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea810d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.827+0000 7fbdfd49a640 1 -- 10.20.193.28:0/2545504329 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea81052f0 con 0x562ea80eaeb0 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eaeb0 0x562ea810d900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0c8dd0 tx=0x7fbdec002ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90ab12d55c191227 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbdb37fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbdb37fe640 1 -- 10.20.193.28:0/2545504329 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0ccd70 con 0x562ea80eaeb0 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbe0242be00 1 -- 10.20.193.28:0/2545504329 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ea7e0ea50 con 0x562ea80eaeb0 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbdb37fe640 1 -- 10.20.193.28:0/2545504329 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbdec033020 con 0x562ea80eaeb0 2026-02-20T03:15:43.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbdb37fe640 1 -- 10.20.193.28:0/2545504329 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0cc4c0 con 0x562ea80eaeb0 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbe0242be00 10 client.25382 _ll_register_callbacks cb 0x562ea7ff2630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbe0242be00 1 -- 10.20.193.28:0/2545504329 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562ea804b110 con 0x562ea80eaeb0 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbdb37fe640 1 -- 10.20.193.28:0/2545504329 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fbdec0b50f0 con 0x562ea80eaeb0 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbdb37fe640 1 -- 10.20.193.28:0/2545504329 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbdec0cc6a0 con 0x562ea80eaeb0 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbe0242be00 10 client.25382 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.828+0000 7fbe0242be00 1 -- 10.20.193.28:0/2545504329 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x562ea7fe3720 con 0x562ea80eaeb0 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbdb37fe640 1 -- 10.20.193.28:0/2545504329 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fbdec0cbfb0 con 0x562ea80eaeb0 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbe0242be00 10 client.25382 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbe0242be00 10 client.25382 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbe0242be00 20 client.25382 populate_metadata read hostname 'trial028' 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbe0242be00 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562ea811cdd0 0x562ea811e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbe0242be00 4 client.25382 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbe0242be00 1 -- 10.20.193.28:0/2545504329 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ea8045360 con 0x562ea811cdd0 2026-02-20T03:15:43.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562ea811cdd0 0x562ea811e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562ea811cdd0 0x562ea811e240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=54aaa18d49ff78d9 server_cookie=32c4ba9d585d4167 in_seq=0 out_seq=0 2026-02-20T03:15:43.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.829+0000 7fbdb37fe640 10 client.25382 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:43.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.830+0000 7fbdb37fe640 1 -- 10.20.193.28:0/2545504329 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562ea8045360 con 0x562ea811cdd0 2026-02-20T03:15:43.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.830+0000 7fbdb37fe640 10 client.25382 handle_command_reply: tid=0 2026-02-20T03:15:43.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.830+0000 7fbe0242be00 1 client.25382 shutdown 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.830+0000 7fbe0242be00 1 -- 10.20.193.28:0/2545504329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eaeb0 msgr2=0x562ea810d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.830+0000 7fbe0242be00 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eaeb0 0x562ea810d900 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbdec0c8dd0 tx=0x7fbdec002ae0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbe0242be00 1 -- 10.20.193.28:0/2545504329 shutdown_connections 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbe0242be00 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562ea811cdd0 0x562ea811e240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbe0242be00 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbe0242be00 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eaeb0 0x562ea810d900 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbe0242be00 1 --2- 10.20.193.28:0/2545504329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea810d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbe0242be00 1 -- 10.20.193.28:0/2545504329 >> 10.20.193.28:0/2545504329 conn(0x562ea80e6630 msgr2=0x562ea80f0210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbdb37fe640 0 client.25382 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbe0242be00 1 -- 10.20.193.28:0/2545504329 shutdown_connections 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbe0242be00 1 -- 10.20.193.28:0/2545504329 wait complete. 2026-02-20T03:15:43.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.831+0000 7fbe0242be00 20 client.25382 trim_cache size 0 max 16384 2026-02-20T03:15:43.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.840+0000 7fbe0242be00 1 Processor -- start 2026-02-20T03:15:43.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.840+0000 7fbe0242be00 1 -- start start 2026-02-20T03:15:43.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.840+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea811b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.840+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eaeb0 0x562ea811bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.840+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eef00 0x562ea80e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.840+0000 7fbe0242be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562ea811c580 con 0x562ea80ea500 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.840+0000 7fbe0242be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562ea811cc50 con 0x562ea80eef00 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.840+0000 7fbe0242be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562ea811d320 con 0x562ea80eaeb0 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfdc9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea811b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfe49c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eef00 0x562ea80e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfd49a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eaeb0 0x562ea811bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfdc9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea811b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56532/0 (socket says 10.20.193.28:56532) 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/802427901 learned_addr learned my addr 10.20.193.28:0/802427901 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/802427901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eaeb0 msgr2=0x562ea811bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/802427901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eaeb0 0x562ea811bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/802427901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eef00 msgr2=0x562ea80e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/802427901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eef00 0x562ea80e7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/802427901 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea8105120 con 0x562ea80ea500 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/802427901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea811b840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbde8010cb0 tx=0x7fbde80075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c94723b9991100 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdc5ce5640 1 -- 10.20.193.28:0/802427901 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8007de0 con 0x562ea80ea500 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdc5ce5640 1 -- 10.20.193.28:0/802427901 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbde8004570 con 0x562ea80ea500 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbdc5ce5640 1 -- 10.20.193.28:0/802427901 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8027460 con 0x562ea80ea500 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbe0242be00 1 -- 10.20.193.28:0/802427901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 msgr2=0x562ea811b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.841+0000 7fbe0242be00 1 --2- 10.20.193.28:0/802427901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea811b840 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbde8010cb0 tx=0x7fbde80075d0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.842+0000 7fbe0242be00 1 -- 10.20.193.28:0/802427901 shutdown_connections 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.842+0000 7fbe0242be00 1 --2- 10.20.193.28:0/802427901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80eef00 0x562ea80e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.842+0000 7fbe0242be00 1 --2- 10.20.193.28:0/802427901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eaeb0 0x562ea811bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.842+0000 7fbe0242be00 1 --2- 10.20.193.28:0/802427901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80ea500 0x562ea811b840 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.842+0000 7fbe0242be00 1 -- 10.20.193.28:0/802427901 >> 10.20.193.28:0/802427901 conn(0x562ea80e6630 msgr2=0x562ea810d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.842+0000 7fbe0242be00 1 -- 10.20.193.28:0/802427901 shutdown_connections 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.842+0000 7fbe0242be00 1 -- 10.20.193.28:0/802427901 wait complete. 2026-02-20T03:15:43.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.842+0000 7fbe0242be00 1 -- start start 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.842+0000 7fbe0242be00 1 Processor -- start 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea8121d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea81222c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbe0242be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea8126470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbe0242be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562ea811e0c0 con 0x562ea80eaeb0 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbe0242be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562ea811d9f0 con 0x562ea80ea500 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbe0242be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562ea811e790 con 0x562ea80eef00 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfdc9b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea8121d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfd49a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea81222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfdc9b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea8121d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60130/0 (socket says 10.20.193.28:60130) 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/300126512 learned_addr learned my addr 10.20.193.28:0/300126512 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfe49c640 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea8126470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/300126512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 msgr2=0x562ea8126470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea8126470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/300126512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 msgr2=0x562ea81222c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea81222c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfdc9b640 1 -- 10.20.193.28:0/300126512 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ea7d1c780 con 0x562ea80ea500 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfe49c640 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea8126470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.843+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea81222c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbdfdc9b640 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea8121d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbde8029040 tx=0x7fbde8007de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e04fb99e230b39e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbdb37fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbdb37fe640 1 -- 10.20.193.28:0/300126512 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8032070 con 0x562ea80ea500 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbe0242be00 1 -- 10.20.193.28:0/300126512 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ea80035f0 con 0x562ea80ea500 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbe0242be00 10 client.25388 _ll_register_callbacks cb 0x7fbdec004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbe0242be00 1 -- 10.20.193.28:0/300126512 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562ea80b2ca0 con 0x562ea80ea500 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbdb37fe640 1 -- 10.20.193.28:0/300126512 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbde8015070 con 0x562ea80ea500 2026-02-20T03:15:43.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbdb37fe640 1 -- 10.20.193.28:0/300126512 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8004720 con 0x562ea80ea500 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbdb37fe640 1 -- 10.20.193.28:0/300126512 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fbde80048c0 con 0x562ea80ea500 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbdb37fe640 1 -- 10.20.193.28:0/300126512 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbde803c060 con 0x562ea80ea500 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbe0242be00 10 client.25388 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.844+0000 7fbe0242be00 1 -- 10.20.193.28:0/300126512 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x562ea8105e10 con 0x562ea80ea500 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbdb37fe640 1 -- 10.20.193.28:0/300126512 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fbde8004ba0 con 0x562ea80ea500 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbe0242be00 10 client.25388 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbe0242be00 10 client.25388 resolve_mds: resolved name 'i' to daemon mds.i 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbe0242be00 20 client.25388 populate_metadata read hostname 'trial028' 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbe0242be00 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562ea818d870 0x562ea818c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbe0242be00 4 client.25388 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbe0242be00 1 -- 10.20.193.28:0/300126512 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "status"}) -- 0x7fbde8004570 con 0x562ea818d870 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562ea818d870 0x562ea818c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:43.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbdfd49a640 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562ea818d870 0x562ea818c520 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=581bac01a1061f8e server_cookie=33ce9421af84ae9f in_seq=0 out_seq=0 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.845+0000 7fbdb37fe640 10 client.25388 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbdb37fe640 1 -- 10.20.193.28:0/300126512 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x7fbde8004570 con 0x562ea818d870 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbdb37fe640 10 client.25388 handle_command_reply: tid=0 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 client.25388 shutdown 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 -- 10.20.193.28:0/300126512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 msgr2=0x562ea8121d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea8121d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbde8029040 tx=0x7fbde8007de0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 -- 10.20.193.28:0/300126512 shutdown_connections 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562ea818d870 0x562ea818c520 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ea80eef00 0x562ea8126470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ea80eaeb0 0x562ea81222c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 --2- 10.20.193.28:0/300126512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ea80ea500 0x562ea8121d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 -- 10.20.193.28:0/300126512 >> 10.20.193.28:0/300126512 conn(0x562ea80e6630 msgr2=0x562ea811b840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbdb37fe640 0 client.25388 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:15:43.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 -- 10.20.193.28:0/300126512 shutdown_connections 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 1 -- 10.20.193.28:0/300126512 wait complete. 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.846+0000 7fbe0242be00 20 client.25388 trim_cache size 0 max 16384 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 1, 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24538, 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 53.501194994000002, 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 24, 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 91, 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 91, 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 79.687952839000005 2026-02-20T03:15:43.849 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 -- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdd40b0eb0 msgr2=0x7fbdd40b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdd40b0eb0 0x7fbdd40b3370 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4003d60 tx=0x7fbdf4007950 comp rx=0 tx=0).stop 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 -- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8105320 msgr2=0x7fbdf819d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8105320 0x7fbdf819d610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbdec02fca0 tx=0x7fbdec02fcd0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 -- 10.20.193.28:0/2953513789 shutdown_connections 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdd40b0eb0 0x7fbdd40b3370 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbdf810a980 0x7fbdf81a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbdf8105320 0x7fbdf819d610 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 --2- 10.20.193.28:0/2953513789 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbdf8104980 0x7fbdf819d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 -- 10.20.193.28:0/2953513789 >> 10.20.193.28:0/2953513789 conn(0x7fbdf8100680 msgr2=0x7fbdf8101110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 -- 10.20.193.28:0/2953513789 shutdown_connections 2026-02-20T03:15:43.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:43.847+0000 7fbdfec9d640 1 -- 10.20.193.28:0/2953513789 wait complete. 2026-02-20T03:15:43.983 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.b status 2026-02-20T03:15:44.252 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:15:44.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.432+0000 7fb32255f640 1 -- 10.20.193.28:0/3634441664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c104980 msgr2=0x7fb31c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:44.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.432+0000 7fb32255f640 1 --2- 10.20.193.28:0/3634441664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c104980 0x7fb31c104de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb310009a60 tx=0x7fb31002f280 comp rx=0 tx=0).stop 2026-02-20T03:15:44.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.432+0000 7fb32255f640 1 -- 10.20.193.28:0/3634441664 shutdown_connections 2026-02-20T03:15:44.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.432+0000 7fb32255f640 1 --2- 10.20.193.28:0/3634441664 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb31c105320 0x7fb31c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.432+0000 7fb32255f640 1 --2- 10.20.193.28:0/3634441664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c104980 0x7fb31c104de0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.432+0000 7fb32255f640 1 --2- 10.20.193.28:0/3634441664 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb31c10a980 0x7fb31c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.432+0000 7fb32255f640 1 -- 10.20.193.28:0/3634441664 >> 10.20.193.28:0/3634441664 conn(0x7fb31c100680 msgr2=0x7fb31c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:44.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.432+0000 7fb32255f640 1 -- 10.20.193.28:0/3634441664 shutdown_connections 2026-02-20T03:15:44.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.432+0000 7fb32255f640 1 -- 10.20.193.28:0/3634441664 wait complete. 2026-02-20T03:15:44.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32255f640 1 Processor -- start 2026-02-20T03:15:44.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32255f640 1 -- start start 2026-02-20T03:15:44.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32255f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb31c104980 0x7fb31c19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32255f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb31c105320 0x7fb31c19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32255f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c10a980 0x7fb31c1a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32255f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c114bf0 con 0x7fb31c10a980 2026-02-20T03:15:44.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32255f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c114a70 con 0x7fb31c105320 2026-02-20T03:15:44.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32255f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c114d70 con 0x7fb31c104980 2026-02-20T03:15:44.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32155d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb31c104980 0x7fb31c19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb321d5e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c10a980 0x7fb31c1a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32155d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb31c104980 0x7fb31c19d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51066/0 (socket says 10.20.193.28:51066) 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb321d5e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c10a980 0x7fb31c1a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56546/0 (socket says 10.20.193.28:56546) 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb32155d640 1 -- 10.20.193.28:0/1032789564 learned_addr learned my addr 10.20.193.28:0/1032789564 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.433+0000 7fb320d5c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb31c105320 0x7fb31c19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb321d5e640 1 -- 10.20.193.28:0/1032789564 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb31c104980 msgr2=0x7fb31c19d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb321d5e640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb31c104980 0x7fb31c19d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb321d5e640 1 -- 10.20.193.28:0/1032789564 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb31c105320 msgr2=0x7fb31c19d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb321d5e640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb31c105320 0x7fb31c19d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb321d5e640 1 -- 10.20.193.28:0/1032789564 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31c1a2100 con 0x7fb31c10a980 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb320d5c640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb31c105320 0x7fb31c19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb321d5e640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c10a980 0x7fb31c1a1980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb31800efc0 tx=0x7fb31800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:44.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb30a7fc640 1 -- 10.20.193.28:0/1032789564 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318019070 con 0x7fb31c10a980 2026-02-20T03:15:44.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb30a7fc640 1 -- 10.20.193.28:0/1032789564 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb3180092d0 con 0x7fb31c10a980 2026-02-20T03:15:44.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb30a7fc640 1 -- 10.20.193.28:0/1032789564 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318007500 con 0x7fb31c10a980 2026-02-20T03:15:44.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb32255f640 1 -- 10.20.193.28:0/1032789564 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb31c1a2390 con 0x7fb31c10a980 2026-02-20T03:15:44.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.434+0000 7fb32255f640 1 -- 10.20.193.28:0/1032789564 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb31c1a9c30 con 0x7fb31c10a980 2026-02-20T03:15:44.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.437+0000 7fb325cede00 1 Processor -- start 2026-02-20T03:15:44.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.437+0000 7fb30a7fc640 1 -- 10.20.193.28:0/1032789564 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7fb3180076a0 con 0x7fb31c10a980 2026-02-20T03:15:44.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb325cede00 1 -- start start 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb325cede00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a07378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb325cede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 0x5570a073b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb325cede00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 0x5570a073c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb325cede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5570a068a770 con 0x5570a0737eb0 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb325cede00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5570a0637f80 con 0x5570a073bf00 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb325cede00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5570a06866a0 con 0x5570a0737500 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a07378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a07378e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51074/0 (socket says 10.20.193.28:51074) 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 -- 10.20.193.28:0/837065820 learned_addr learned my addr 10.20.193.28:0/837065820 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 --2- 10.20.193.28:0/837065820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 0x5570a073c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 -- 10.20.193.28:0/837065820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 msgr2=0x5570a073c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 --2- 10.20.193.28:0/837065820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 0x5570a073c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 -- 10.20.193.28:0/837065820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 msgr2=0x5570a073b8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 --2- 10.20.193.28:0/837065820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 0x5570a073b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 -- 10.20.193.28:0/837065820 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a062a180 con 0x5570a0737500 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.438+0000 7fb320d5c640 1 --2- 10.20.193.28:0/837065820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a07378e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb310037000 tx=0x7fb310031040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70e1fe97469cda54 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb2e9ce5640 1 -- 10.20.193.28:0/837065820 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3100095e0 con 0x5570a0737500 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb2e9ce5640 1 -- 10.20.193.28:0/837065820 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb310033070 con 0x5570a0737500 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb2e9ce5640 1 -- 10.20.193.28:0/837065820 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3100047c0 con 0x5570a0737500 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb30a7fc640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2f80b0eb0 0x7fb2f80b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb325cede00 1 -- 10.20.193.28:0/837065820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 msgr2=0x5570a07378e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb325cede00 1 --2- 10.20.193.28:0/837065820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a07378e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb310037000 tx=0x7fb310031040 comp rx=0 tx=0).stop 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb30a7fc640 1 -- 10.20.193.28:0/1032789564 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fb3180e0970 con 0x7fb31c10a980 2026-02-20T03:15:44.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb325cede00 1 -- 10.20.193.28:0/837065820 shutdown_connections 2026-02-20T03:15:44.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb325cede00 1 --2- 10.20.193.28:0/837065820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 0x5570a073c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb325cede00 1 --2- 10.20.193.28:0/837065820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 0x5570a073b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb325cede00 1 --2- 10.20.193.28:0/837065820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a07378e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.439+0000 7fb325cede00 1 -- 10.20.193.28:0/837065820 >> 10.20.193.28:0/837065820 conn(0x5570a0733630 msgr2=0x5570a0735a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:44.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.440+0000 7fb32155d640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2f80b0eb0 0x7fb2f80b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.440+0000 7fb325cede00 1 -- 10.20.193.28:0/837065820 shutdown_connections 2026-02-20T03:15:44.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.440+0000 7fb325cede00 1 -- 10.20.193.28:0/837065820 wait complete. 2026-02-20T03:15:44.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.440+0000 7fb32155d640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2f80b0eb0 0x7fb2f80b3370 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5570a0738430 tx=0x7fb30c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.441+0000 7fb325cede00 1 -- start start 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.441+0000 7fb325cede00 1 Processor -- start 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb325cede00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737500 0x5570a0758cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb325cede00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737eb0 0x5570a07591f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb325cede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 0x5570a075a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb325cede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5570a0631d60 con 0x5570a073bf00 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb325cede00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5570a07440b0 con 0x5570a0737500 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb325cede00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5570a075a6e0 con 0x5570a0737eb0 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb32155d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737500 0x5570a0758cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb32155d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737500 0x5570a0758cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60154/0 (socket says 10.20.193.28:60154) 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb32155d640 1 -- 10.20.193.28:0/2380139974 learned_addr learned my addr 10.20.193.28:0/2380139974 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb321d5e640 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 0x5570a075a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb320d5c640 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737eb0 0x5570a07591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb321d5e640 1 -- 10.20.193.28:0/2380139974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737eb0 msgr2=0x5570a07591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb321d5e640 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737eb0 0x5570a07591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb321d5e640 1 -- 10.20.193.28:0/2380139974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737500 msgr2=0x5570a0758cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb321d5e640 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737500 0x5570a0758cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb321d5e640 1 -- 10.20.193.28:0/2380139974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a0752240 con 0x5570a073bf00 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb321d5e640 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 0x5570a075a070 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3180ddf80 tx=0x7fb3180a8250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8203e9df15d1085e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb2d6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.442+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/2380139974 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3180ac990 con 0x5570a073bf00 2026-02-20T03:15:44.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 1 -- 10.20.193.28:0/2380139974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570a045ba50 con 0x5570a073bf00 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 10 client.15348 _ll_register_callbacks cb 0x5570a063f630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 1 -- 10.20.193.28:0/2380139974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570a0698110 con 0x5570a073bf00 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/2380139974 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb3180b1840 con 0x5570a073bf00 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/2380139974 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3180a4010 con 0x5570a073bf00 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/2380139974 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fb3180a7110 con 0x5570a073bf00 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/2380139974 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb3180ce050 con 0x5570a073bf00 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 10 client.15348 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 1 -- 10.20.193.28:0/2380139974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5570a0630720 con 0x5570a073bf00 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/2380139974 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fb3180a76a0 con 0x5570a073bf00 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 10 client.15348 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 10 client.15348 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 20 client.15348 populate_metadata read hostname 'trial028' 2026-02-20T03:15:44.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570a0769c10 0x5570a076b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 4 client.15348 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.443+0000 7fb325cede00 1 -- 10.20.193.28:0/2380139974 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570a0692360 con 0x5570a0769c10 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.444+0000 7fb32155d640 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570a0769c10 0x5570a076b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.444+0000 7fb32155d640 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570a0769c10 0x5570a076b080 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42f34bdeda281516 server_cookie=c0d4fcfdbb0a3010 in_seq=0 out_seq=0 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.444+0000 7fb2d6ffd640 10 client.15348 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/2380139974 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5570a0692360 con 0x5570a0769c10 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb2d6ffd640 10 client.15348 handle_command_reply: tid=0 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 client.15348 shutdown 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 -- 10.20.193.28:0/2380139974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 msgr2=0x5570a075a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 0x5570a075a070 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3180ddf80 tx=0x7fb3180a8250 comp rx=0 tx=0).stop 2026-02-20T03:15:44.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 -- 10.20.193.28:0/2380139974 shutdown_connections 2026-02-20T03:15:44.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570a0769c10 0x5570a076b080 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 0x5570a075a070 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737eb0 0x5570a07591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 --2- 10.20.193.28:0/2380139974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737500 0x5570a0758cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 -- 10.20.193.28:0/2380139974 >> 10.20.193.28:0/2380139974 conn(0x5570a0733630 msgr2=0x5570a073d210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:44.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb2d6ffd640 0 client.15348 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:44.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 -- 10.20.193.28:0/2380139974 shutdown_connections 2026-02-20T03:15:44.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 1 -- 10.20.193.28:0/2380139974 wait complete. 2026-02-20T03:15:44.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.445+0000 7fb325cede00 20 client.15348 trim_cache size 0 max 16384 2026-02-20T03:15:44.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb325cede00 1 Processor -- start 2026-02-20T03:15:44.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb325cede00 1 -- start start 2026-02-20T03:15:44.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb325cede00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a076a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb325cede00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737eb0 0x5570a073b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb325cede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 0x5570a0756520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb325cede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5570a07693c0 con 0x5570a073bf00 2026-02-20T03:15:44.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb325cede00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5570a0769a90 con 0x5570a0737eb0 2026-02-20T03:15:44.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb325cede00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5570a076a160 con 0x5570a0737500 2026-02-20T03:15:44.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb32155d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a076a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb32155d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a076a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51084/0 (socket says 10.20.193.28:51084) 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb32155d640 1 -- 10.20.193.28:0/3032971409 learned_addr learned my addr 10.20.193.28:0/3032971409 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb321d5e640 1 --2- 10.20.193.28:0/3032971409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 0x5570a0756520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.455+0000 7fb320d5c640 1 --2- 10.20.193.28:0/3032971409 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737eb0 0x5570a073b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb32155d640 1 -- 10.20.193.28:0/3032971409 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737eb0 msgr2=0x5570a073b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb32155d640 1 --2- 10.20.193.28:0/3032971409 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737eb0 0x5570a073b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb32155d640 1 -- 10.20.193.28:0/3032971409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 msgr2=0x5570a0756520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb32155d640 1 --2- 10.20.193.28:0/3032971409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 0x5570a0756520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb32155d640 1 -- 10.20.193.28:0/3032971409 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a0752070 con 0x5570a0737500 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb32155d640 1 --2- 10.20.193.28:0/3032971409 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a076a2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009720 tx=0x7fb30c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f355f0b25106b6d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb2e94e4640 1 -- 10.20.193.28:0/3032971409 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c027430 con 0x5570a0737500 2026-02-20T03:15:44.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb2e94e4640 1 -- 10.20.193.28:0/3032971409 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb30c01f030 con 0x5570a0737500 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb2e94e4640 1 -- 10.20.193.28:0/3032971409 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0119c0 con 0x5570a0737500 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb325cede00 1 -- 10.20.193.28:0/3032971409 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 msgr2=0x5570a076a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb325cede00 1 --2- 10.20.193.28:0/3032971409 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a076a2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009720 tx=0x7fb30c014000 comp rx=0 tx=0).stop 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb325cede00 1 -- 10.20.193.28:0/3032971409 shutdown_connections 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb325cede00 1 --2- 10.20.193.28:0/3032971409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a073bf00 0x5570a0756520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb325cede00 1 --2- 10.20.193.28:0/3032971409 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a0737eb0 0x5570a073b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb325cede00 1 --2- 10.20.193.28:0/3032971409 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a076a2e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb325cede00 1 -- 10.20.193.28:0/3032971409 >> 10.20.193.28:0/3032971409 conn(0x5570a0733630 msgr2=0x5570a075a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb325cede00 1 -- 10.20.193.28:0/3032971409 shutdown_connections 2026-02-20T03:15:44.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.456+0000 7fb325cede00 1 -- 10.20.193.28:0/3032971409 wait complete. 2026-02-20T03:15:44.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.457+0000 7fb325cede00 1 -- start start 2026-02-20T03:15:44.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.457+0000 7fb325cede00 1 Processor -- start 2026-02-20T03:15:44.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.457+0000 7fb325cede00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a0773d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.457+0000 7fb325cede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 0x5570a076e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.457+0000 7fb325cede00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 0x5570a076ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.457+0000 7fb325cede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5570a076af00 con 0x5570a0737eb0 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.457+0000 7fb325cede00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5570a076a830 con 0x5570a073bf00 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.457+0000 7fb325cede00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5570a076b5d0 con 0x5570a0737500 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb320d5c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 0x5570a076e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb32155d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a0773d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb321d5e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 0x5570a076ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb32155d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a0773d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51086/0 (socket says 10.20.193.28:51086) 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb32155d640 1 -- 10.20.193.28:0/1323029777 learned_addr learned my addr 10.20.193.28:0/1323029777 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb32155d640 1 -- 10.20.193.28:0/1323029777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 msgr2=0x5570a076ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb32155d640 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 0x5570a076ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb32155d640 1 -- 10.20.193.28:0/1323029777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 msgr2=0x5570a076e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb32155d640 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 0x5570a076e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb32155d640 1 -- 10.20.193.28:0/1323029777 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570a0369780 con 0x5570a0737500 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb320d5c640 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 0x5570a076e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb32155d640 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a0773d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb30c006010 tx=0x7fb30c003db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e84770adb35cd9b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb2d6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/1323029777 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c03c070 con 0x5570a0737500 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/1323029777 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb30c0054f0 con 0x5570a0737500 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb325cede00 1 -- 10.20.193.28:0/1323029777 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570a06505f0 con 0x5570a0737500 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb325cede00 10 client.25378 _ll_register_callbacks cb 0x7fb318007400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.458+0000 7fb325cede00 1 -- 10.20.193.28:0/1323029777 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570a06ffca0 con 0x5570a0737500 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/1323029777 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c011960 con 0x5570a0737500 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/1323029777 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fb30c011bc0 con 0x5570a0737500 2026-02-20T03:15:44.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/1323029777 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb30c011dc0 con 0x5570a0737500 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb325cede00 10 client.25378 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb325cede00 1 -- 10.20.193.28:0/1323029777 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5570a0752d60 con 0x5570a0737500 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/1323029777 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fb30c018040 con 0x5570a0737500 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb325cede00 10 client.25378 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb325cede00 10 client.25378 resolve_mds: resolved name 'b' to daemon mds.b 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb325cede00 20 client.25378 populate_metadata read hostname 'trial028' 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb325cede00 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570a07d9aa0 0x5570a07d8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb325cede00 4 client.25378 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb325cede00 1 -- 10.20.193.28:0/1323029777 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "status"}) -- 0x7fb30c01f030 con 0x5570a07d9aa0 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.459+0000 7fb320d5c640 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570a07d9aa0 0x5570a07d8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb2d6ffd640 10 client.25378 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb320d5c640 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570a07d9aa0 0x5570a07d8750 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13dc20dee273f37c server_cookie=2d0617c721ee6601 in_seq=0 out_seq=0 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb2d6ffd640 1 -- 10.20.193.28:0/1323029777 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x7fb30c01f030 con 0x5570a07d9aa0 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb2d6ffd640 10 client.25378 handle_command_reply: tid=0 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb325cede00 1 client.25378 shutdown 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb325cede00 1 -- 10.20.193.28:0/1323029777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 msgr2=0x5570a0773d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb325cede00 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a0773d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb30c006010 tx=0x7fb30c003db0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb325cede00 1 -- 10.20.193.28:0/1323029777 shutdown_connections 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb325cede00 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570a07d9aa0 0x5570a07d8750 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb325cede00 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570a073bf00 0x5570a076ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb325cede00 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570a0737eb0 0x5570a076e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb325cede00 1 --2- 10.20.193.28:0/1323029777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570a0737500 0x5570a0773d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb325cede00 1 -- 10.20.193.28:0/1323029777 >> 10.20.193.28:0/1323029777 conn(0x5570a0733630 msgr2=0x5570a0758cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.460+0000 7fb2d6ffd640 0 client.25378 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb325cede00 1 -- 10.20.193.28:0/1323029777 shutdown_connections 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb325cede00 1 -- 10.20.193.28:0/1323029777 wait complete. 2026-02-20T03:15:44.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb325cede00 20 client.25378 trim_cache size 0 max 16384 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_fsid": "bfaff8d7-0e09-11f1-8045-d404e6e7d460", 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "whoami": 0, 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "id": 24560, 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "want_state": "up:active", 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "state": "up:active", 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "fs_name": "cephfs", 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "rank_uptime": 71.174749126999998, 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "mdsmap_epoch": 24, 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch": 91, 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_epoch_barrier": 91, 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout: "uptime": 77.088064396999997 2026-02-20T03:15:44.466 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 -- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2f80b0eb0 msgr2=0x7fb2f80b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2f80b0eb0 0x7fb2f80b3370 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x5570a0738430 tx=0x7fb30c009290 comp rx=0 tx=0).stop 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 -- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c10a980 msgr2=0x7fb31c1a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c10a980 0x7fb31c1a1980 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb31800efc0 tx=0x7fb31800c490 comp rx=0 tx=0).stop 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 -- 10.20.193.28:0/1032789564 shutdown_connections 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2f80b0eb0 0x7fb2f80b3370 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb31c10a980 0x7fb31c1a1980 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb31c105320 0x7fb31c19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 --2- 10.20.193.28:0/1032789564 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb31c104980 0x7fb31c19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 -- 10.20.193.28:0/1032789564 >> 10.20.193.28:0/1032789564 conn(0x7fb31c100680 msgr2=0x7fb31c100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 -- 10.20.193.28:0/1032789564 shutdown_connections 2026-02-20T03:15:44.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:15:44.461+0000 7fb32255f640 1 -- 10.20.193.28:0/1032789564 wait complete. 2026-02-20T03:15:44.601 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2026-02-20T03:15:45.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:45 trial177 ceph-mon[43181]: pgmap v210: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 1023 B/s wr, 6 op/s 2026-02-20T03:15:45.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:45 trial126 ceph-mon[38476]: pgmap v210: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 1023 B/s wr, 6 op/s 2026-02-20T03:15:45.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:45 trial028 ceph-mon[38552]: pgmap v210: 129 pgs: 129 active+clean; 661 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 1023 B/s wr, 6 op/s 2026-02-20T03:15:47.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:47 trial177 ceph-mon[43181]: pgmap v211: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2026-02-20T03:15:47.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:47 trial126 ceph-mon[38476]: pgmap v211: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2026-02-20T03:15:47.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:47 trial028 ceph-mon[38552]: pgmap v211: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2026-02-20T03:15:49.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:49 trial177 ceph-mon[43181]: pgmap v212: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2026-02-20T03:15:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:49 trial126 ceph-mon[38476]: pgmap v212: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2026-02-20T03:15:49.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:49 trial028 ceph-mon[38552]: pgmap v212: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2026-02-20T03:15:50.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 -- 10.20.193.28:0/1622778895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e48109e60 msgr2=0x7f5e4810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:50.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/1622778895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e48109e60 0x7f5e4810a2e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009a30 tx=0x7f5e3c02f220 comp rx=0 tx=0).stop 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 -- 10.20.193.28:0/1622778895 shutdown_connections 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/1622778895 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e4810a900 0x7f5e48111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/1622778895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e48109e60 0x7f5e4810a2e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/1622778895 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e48109490 0x7f5e48109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 -- 10.20.193.28:0/1622778895 >> 10.20.193.28:0/1622778895 conn(0x7f5e48077fe0 msgr2=0x7f5e4807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 -- 10.20.193.28:0/1622778895 shutdown_connections 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 -- 10.20.193.28:0/1622778895 wait complete. 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.554+0000 7f5e4f26a640 1 Processor -- start 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4f26a640 1 -- start start 2026-02-20T03:15:50.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4f26a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e48109490 0x7f5e481a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4f26a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e48109e60 0x7f5e481a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4f26a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4810a900 0x7f5e481a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4f26a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48114910 con 0x7f5e48109490 2026-02-20T03:15:50.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4f26a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48114790 con 0x7f5e4810a900 2026-02-20T03:15:50.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4f26a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48114a90 con 0x7f5e48109e60 2026-02-20T03:15:50.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4ea69640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4810a900 0x7f5e481a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4ea69640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4810a900 0x7f5e481a8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37022/0 (socket says 10.20.193.28:37022) 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4ea69640 1 -- 10.20.193.28:0/2688052040 learned_addr learned my addr 10.20.193.28:0/2688052040 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4da67640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e48109e60 0x7f5e481a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.555+0000 7f5e4e268640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e48109490 0x7f5e481a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e4da67640 1 -- 10.20.193.28:0/2688052040 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4810a900 msgr2=0x7f5e481a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e4da67640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4810a900 0x7f5e481a8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e4da67640 1 -- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e48109490 msgr2=0x7f5e481a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e4da67640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e48109490 0x7f5e481a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e4da67640 1 -- 10.20.193.28:0/2688052040 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e481a8ba0 con 0x7f5e48109e60 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e4da67640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e48109e60 0x7f5e481a14c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009950 tx=0x7f5e3c02fcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e2f7fe640 1 -- 10.20.193.28:0/2688052040 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c004240 con 0x7f5e48109e60 2026-02-20T03:15:50.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e4f26a640 1 -- 10.20.193.28:0/2688052040 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e481a8e30 con 0x7f5e48109e60 2026-02-20T03:15:50.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e2f7fe640 1 -- 10.20.193.28:0/2688052040 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e3c0043e0 con 0x7f5e48109e60 2026-02-20T03:15:50.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e4f26a640 1 -- 10.20.193.28:0/2688052040 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e481a92a0 con 0x7f5e48109e60 2026-02-20T03:15:50.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.556+0000 7f5e2f7fe640 1 -- 10.20.193.28:0/2688052040 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c042950 con 0x7f5e48109e60 2026-02-20T03:15:50.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.559+0000 7f5e2f7fe640 1 -- 10.20.193.28:0/2688052040 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 16) ==== 149756+0+0 (secure 0 0 0) 0x7f5e3c04a030 con 0x7f5e48109e60 2026-02-20T03:15:50.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e53434e00 1 Processor -- start 2026-02-20T03:15:50.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e53434e00 1 -- start start 2026-02-20T03:15:50.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901460e80 0x55c901461280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9014617c0 0x55c901465f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c9014689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e53434e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c9013b18f0 con 0x55c901466560 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e53434e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c90135f2e0 con 0x55c901460e80 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e53434e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c9013ad820 con 0x55c9014617c0 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e4da67640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c9014689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e4e268640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9014617c0 0x55c901465f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e4da67640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c9014689f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42156/0 (socket says 10.20.193.28:42156) 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e4da67640 1 -- 10.20.193.28:0/2905357140 learned_addr learned my addr 10.20.193.28:0/2905357140 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e4ea69640 1 --2- 10.20.193.28:0/2905357140 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901460e80 0x55c901461280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.560+0000 7f5e2f7fe640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e240b0e30 0x7f5e240b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e4da67640 1 -- 10.20.193.28:0/2905357140 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9014617c0 msgr2=0x55c901465f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e4da67640 1 --2- 10.20.193.28:0/2905357140 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9014617c0 0x55c901465f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e4da67640 1 -- 10.20.193.28:0/2905357140 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901460e80 msgr2=0x55c901461280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e4da67640 1 --2- 10.20.193.28:0/2905357140 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901460e80 0x55c901461280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e4da67640 1 -- 10.20.193.28:0/2905357140 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9013515a0 con 0x55c901466560 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e4ea69640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e240b0e30 0x7f5e240b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e2f7fe640 1 -- 10.20.193.28:0/2688052040 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f5e3c104e10 con 0x7f5e48109e60 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e4da67640 1 --2- 10.20.193.28:0/2905357140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c9014689f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0c8ff0 tx=0x7f5e3c04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceda7148131ffb7b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e163ff640 1 -- 10.20.193.28:0/2905357140 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0377e0 con 0x55c901466560 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e4ea69640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e240b0e30 0x7f5e240b32f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e44002e80 tx=0x7f5e44004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e163ff640 1 -- 10.20.193.28:0/2905357140 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e3c033070 con 0x55c901466560 2026-02-20T03:15:50.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e163ff640 1 -- 10.20.193.28:0/2905357140 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0d4120 con 0x55c901466560 2026-02-20T03:15:50.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e53434e00 1 -- 10.20.193.28:0/2905357140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 msgr2=0x55c9014689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:50.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.561+0000 7f5e53434e00 1 --2- 10.20.193.28:0/2905357140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c9014689f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0c8ff0 tx=0x7f5e3c04b000 comp rx=0 tx=0).stop 2026-02-20T03:15:50.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.562+0000 7f5e53434e00 1 -- 10.20.193.28:0/2905357140 shutdown_connections 2026-02-20T03:15:50.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.562+0000 7f5e53434e00 1 --2- 10.20.193.28:0/2905357140 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c9014689f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.562+0000 7f5e53434e00 1 --2- 10.20.193.28:0/2905357140 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9014617c0 0x55c901465f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.562+0000 7f5e53434e00 1 --2- 10.20.193.28:0/2905357140 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901460e80 0x55c901461280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.562+0000 7f5e53434e00 1 -- 10.20.193.28:0/2905357140 >> 10.20.193.28:0/2905357140 conn(0x55c9014586f0 msgr2=0x55c90145f570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:50.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.562+0000 7f5e53434e00 1 -- 10.20.193.28:0/2905357140 shutdown_connections 2026-02-20T03:15:50.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.562+0000 7f5e53434e00 1 -- 10.20.193.28:0/2905357140 wait complete. 2026-02-20T03:15:50.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.563+0000 7f5e53434e00 1 -- start start 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.563+0000 7f5e53434e00 1 Processor -- start 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.563+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c901479610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.563+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901479b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.563+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 0x55c9014809d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.563+0000 7f5e53434e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c9013590c0 con 0x55c9014617c0 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.563+0000 7f5e53434e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c901469370 con 0x55c901466560 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.563+0000 7f5e53434e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c901480f60 con 0x55c901460e80 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4da67640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901479b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4ea69640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 0x55c9014809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4e268640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c901479610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4ea69640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 0x55c9014809d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37046/0 (socket says 10.20.193.28:37046) 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4ea69640 1 -- 10.20.193.28:0/751897632 learned_addr learned my addr 10.20.193.28:0/751897632 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4da67640 1 -- 10.20.193.28:0/751897632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 msgr2=0x55c901479610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4da67640 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c901479610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4da67640 1 -- 10.20.193.28:0/751897632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 msgr2=0x55c9014809d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4da67640 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 0x55c9014809d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4da67640 1 -- 10.20.193.28:0/751897632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c901472d50 con 0x55c9014617c0 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e4da67640 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901479b50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0c8ff0 tx=0x7f5e3c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203cf2bc81d5445b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:50.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e037fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e037fe640 1 -- 10.20.193.28:0/751897632 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0377e0 con 0x55c9014617c0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e037fe640 1 -- 10.20.193.28:0/751897632 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e3c0d4120 con 0x55c9014617c0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e037fe640 1 -- 10.20.193.28:0/751897632 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0d3370 con 0x55c9014617c0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.564+0000 7f5e53434e00 1 -- 10.20.193.28:0/751897632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c90136d820 con 0x55c9014617c0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e037fe640 1 -- 10.20.193.28:0/751897632 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f5e3c0cc340 con 0x55c9014617c0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e037fe640 10 client.15366 inactive, discarding osd_map(91..91 src has 1..91) 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 10 client.15366 _ll_register_callbacks cb 0x55c90135cff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 1 -- 10.20.193.28:0/751897632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c9013b94e0 con 0x55c9014617c0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e037fe640 1 -- 10.20.193.28:0/751897632 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5e3c0cd180 con 0x55c9014617c0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 10 client.15366 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 1 -- 10.20.193.28:0/751897632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55c901372380 con 0x55c9014617c0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e037fe640 1 -- 10.20.193.28:0/751897632 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f5e3c0d5850 con 0x55c9014617c0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 10 client.15366 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 10 client.15366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 20 client.15366 populate_metadata read hostname 'trial028' 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c901484e70 0x55c901487330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 4 client.15366 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.565+0000 7f5e53434e00 1 -- 10.20.193.28:0/751897632 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c901333bd0 con 0x55c901484e70 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.566+0000 7f5e4e268640 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c901484e70 0x55c901487330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.566+0000 7f5e4e268640 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c901484e70 0x55c901487330 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=902f69ab70c9ad84 server_cookie=e421b5d9b1d09983 in_seq=0 out_seq=0 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.566+0000 7f5e037fe640 10 client.15366 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:50.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e037fe640 1 -- 10.20.193.28:0/751897632 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c901333bd0 con 0x55c901484e70 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e037fe640 10 client.15366 handle_command_reply: tid=0 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 client.15366 shutdown 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 -- 10.20.193.28:0/751897632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 msgr2=0x55c901479b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901479b50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0c8ff0 tx=0x7f5e3c009340 comp rx=0 tx=0).stop 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 -- 10.20.193.28:0/751897632 shutdown_connections 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c901484e70 0x55c901487330 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 0x55c9014809d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901479b50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 --2- 10.20.193.28:0/751897632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c901479610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 -- 10.20.193.28:0/751897632 >> 10.20.193.28:0/751897632 conn(0x55c9014586f0 msgr2=0x55c9014678b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e037fe640 0 client.15366 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 -- 10.20.193.28:0/751897632 shutdown_connections 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 1 -- 10.20.193.28:0/751897632 wait complete. 2026-02-20T03:15:50.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.567+0000 7f5e53434e00 20 client.15366 trim_cache size 0 max 16384 2026-02-20T03:15:50.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.575+0000 7f5e53434e00 1 Processor -- start 2026-02-20T03:15:50.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.575+0000 7f5e53434e00 1 -- start start 2026-02-20T03:15:50.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.575+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c901467870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.575+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901480990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 0x55c901462ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4e268640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c901467870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e53434e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5df40122f0 con 0x55c9014617c0 2026-02-20T03:15:50.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e53434e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5df400fbc0 con 0x55c901466560 2026-02-20T03:15:50.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e53434e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5df400da10 con 0x55c901460e80 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4e268640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c901467870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54762/0 (socket says 10.20.193.28:54762) 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4e268640 1 -- 10.20.193.28:0/4142472993 learned_addr learned my addr 10.20.193.28:0/4142472993 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4da67640 1 --2- 10.20.193.28:0/4142472993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901480990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4ea69640 1 --2- 10.20.193.28:0/4142472993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 0x55c901462ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4da67640 1 -- 10.20.193.28:0/4142472993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 msgr2=0x55c901467870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4da67640 1 --2- 10.20.193.28:0/4142472993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c901467870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4da67640 1 -- 10.20.193.28:0/4142472993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 msgr2=0x55c901462ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4da67640 1 --2- 10.20.193.28:0/4142472993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 0x55c901462ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4da67640 1 -- 10.20.193.28:0/4142472993 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c901472b80 con 0x55c9014617c0 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e4da67640 1 --2- 10.20.193.28:0/4142472993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901480990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c102360 tx=0x7f5e3c031020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d31218c54714da server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e15bfe640 1 -- 10.20.193.28:0/4142472993 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0377e0 con 0x55c9014617c0 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e15bfe640 1 -- 10.20.193.28:0/4142472993 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55c9013b94e0 con 0x55c9014617c0 2026-02-20T03:15:50.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.576+0000 7f5e15bfe640 1 -- 10.20.193.28:0/4142472993 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0d5ce0 con 0x55c9014617c0 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 -- 10.20.193.28:0/4142472993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 msgr2=0x55c901480990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4142472993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901480990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c102360 tx=0x7f5e3c031020 comp rx=0 tx=0).stop 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 -- 10.20.193.28:0/4142472993 shutdown_connections 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4142472993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c901466560 0x55c901462ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4142472993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9014617c0 0x55c901480990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4142472993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c901467870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 -- 10.20.193.28:0/4142472993 >> 10.20.193.28:0/4142472993 conn(0x55c9014586f0 msgr2=0x55c901467160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 -- 10.20.193.28:0/4142472993 shutdown_connections 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 -- 10.20.193.28:0/4142472993 wait complete. 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.577+0000 7f5e53434e00 1 -- start start 2026-02-20T03:15:50.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e53434e00 1 Processor -- start 2026-02-20T03:15:50.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c90147e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9014617c0 0x55c90147eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e53434e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c90147faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e53434e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5df400e080 con 0x55c901466560 2026-02-20T03:15:50.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e53434e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5df400f4f0 con 0x55c9014617c0 2026-02-20T03:15:50.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e53434e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5df400e750 con 0x55c901460e80 2026-02-20T03:15:50.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e4e268640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c90147e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e4e268640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c90147e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54772/0 (socket says 10.20.193.28:54772) 2026-02-20T03:15:50.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e4e268640 1 -- 10.20.193.28:0/4264391990 learned_addr learned my addr 10.20.193.28:0/4264391990 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:15:50.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e4ea69640 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c90147faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.578+0000 7f5e4da67640 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9014617c0 0x55c90147eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e4e268640 1 -- 10.20.193.28:0/4264391990 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9014617c0 msgr2=0x55c90147eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:50.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e4e268640 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9014617c0 0x55c90147eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e4e268640 1 -- 10.20.193.28:0/4264391990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 msgr2=0x55c90147faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:15:50.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e4e268640 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c90147faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e4e268640 1 -- 10.20.193.28:0/4264391990 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c901111690 con 0x55c901460e80 2026-02-20T03:15:50.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e4ea69640 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c90147faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e4e268640 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c90147e5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5e38007f00 tx=0x7f5e380044e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edde9407a81a66cc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e037fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e037fe640 1 -- 10.20.193.28:0/4264391990 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38028020 con 0x55c901460e80 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e53434e00 1 -- 10.20.193.28:0/4264391990 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c901376b70 con 0x55c901460e80 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e53434e00 10 client.25393 _ll_register_callbacks cb 0x7f5e3c0cc8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e53434e00 1 -- 10.20.193.28:0/4264391990 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c90118a520 con 0x55c901460e80 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e037fe640 1 -- 10.20.193.28:0/4264391990 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e3801fac0 con 0x55c901460e80 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.579+0000 7f5e037fe640 1 -- 10.20.193.28:0/4264391990 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38011b50 con 0x55c901460e80 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e037fe640 1 -- 10.20.193.28:0/4264391990 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f5e38011440 con 0x55c901460e80 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e037fe640 1 -- 10.20.193.28:0/4264391990 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5e38011cf0 con 0x55c901460e80 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e53434e00 10 client.25393 fetch_fsmap learned FSMap version 24 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e53434e00 1 -- 10.20.193.28:0/4264391990 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55c901473870 con 0x55c901460e80 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e037fe640 1 -- 10.20.193.28:0/4264391990 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f5e3801f620 con 0x55c901460e80 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e53434e00 10 client.25393 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e53434e00 10 client.25393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e53434e00 20 client.25393 populate_metadata read hostname 'trial028' 2026-02-20T03:15:50.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9014f0840 0x55c9014f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:15:50.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e53434e00 4 client.25393 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:15:50.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e53434e00 1 -- 10.20.193.28:0/4264391990 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9013bf290 con 0x55c9014f0840 2026-02-20T03:15:50.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.580+0000 7f5e4da67640 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9014f0840 0x55c9014f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:15:50.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.581+0000 7f5e4da67640 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9014f0840 0x55c9014f2d00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ca9ba50e3680ff0 server_cookie=375a48d3335e03b7 in_seq=0 out_seq=0 2026-02-20T03:15:50.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.581+0000 7f5e037fe640 10 client.25393 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:50.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e037fe640 1 -- 10.20.193.28:0/4264391990 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c9013bf290 con 0x55c9014f0840 2026-02-20T03:15:50.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e037fe640 10 client.25393 handle_command_reply: tid=0 2026-02-20T03:15:50.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 client.25393 shutdown 2026-02-20T03:15:50.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 -- 10.20.193.28:0/4264391990 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 msgr2=0x55c90147e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:50.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c90147e5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5e38007f00 tx=0x7f5e380044e0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 -- 10.20.193.28:0/4264391990 shutdown_connections 2026-02-20T03:15:50.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9014f0840 0x55c9014f2d00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c901466560 0x55c90147faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9014617c0 0x55c90147eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 --2- 10.20.193.28:0/4264391990 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c901460e80 0x55c90147e5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 -- 10.20.193.28:0/4264391990 >> 10.20.193.28:0/4264391990 conn(0x55c9014586f0 msgr2=0x55c901467870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:50.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e037fe640 0 client.25393 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:15:50.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 -- 10.20.193.28:0/4264391990 shutdown_connections 2026-02-20T03:15:50.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 1 -- 10.20.193.28:0/4264391990 wait complete. 2026-02-20T03:15:50.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.588+0000 7f5e53434e00 20 client.25393 trim_cache size 0 max 16384 2026-02-20T03:15:50.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:15:50.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:15:50.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:15:50.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:15:50.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 -- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e240b0e30 msgr2=0x7f5e240b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:50.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e240b0e30 0x7f5e240b32f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5e44002e80 tx=0x7f5e44004b40 comp rx=0 tx=0).stop 2026-02-20T03:15:50.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 -- 10.20.193.28:0/2688052040 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e48109e60 msgr2=0x7f5e481a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:15:50.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e48109e60 0x7f5e481a14c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009950 tx=0x7f5e3c02fcb0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 -- 10.20.193.28:0/2688052040 shutdown_connections 2026-02-20T03:15:50.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e240b0e30 0x7f5e240b32f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4810a900 0x7f5e481a8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e48109e60 0x7f5e481a14c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 --2- 10.20.193.28:0/2688052040 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e48109490 0x7f5e481a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:15:50.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 -- 10.20.193.28:0/2688052040 >> 10.20.193.28:0/2688052040 conn(0x7f5e48077fe0 msgr2=0x7f5e4810d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:15:50.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 -- 10.20.193.28:0/2688052040 shutdown_connections 2026-02-20T03:15:50.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:15:50.589+0000 7f5e4f26a640 1 -- 10.20.193.28:0/2688052040 wait complete. 2026-02-20T03:15:51.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:51 trial028 ceph-mon[38552]: pgmap v213: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 682 B/s wr, 7 op/s 2026-02-20T03:15:51.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:51 trial177 ceph-mon[43181]: pgmap v213: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 682 B/s wr, 7 op/s 2026-02-20T03:15:51.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:51 trial126 ceph-mon[38476]: pgmap v213: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 682 B/s wr, 7 op/s 2026-02-20T03:15:53.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:53 trial177 ceph-mon[43181]: pgmap v214: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2026-02-20T03:15:53.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:53 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:15:53.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:53 trial126 ceph-mon[38476]: pgmap v214: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2026-02-20T03:15:53.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:53 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:15:53.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:53 trial028 ceph-mon[38552]: pgmap v214: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 6 op/s 2026-02-20T03:15:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:53 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:15:54.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:54 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:15:54.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:54 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:15:54.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:54 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:15:55.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:55 trial177 ceph-mon[43181]: pgmap v215: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2026-02-20T03:15:55.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:55 trial126 ceph-mon[38476]: pgmap v215: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2026-02-20T03:15:55.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:55 trial028 ceph-mon[38552]: pgmap v215: 129 pgs: 129 active+clean; 667 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2026-02-20T03:15:57.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:57 trial177 ceph-mon[43181]: pgmap v216: 129 pgs: 129 active+clean; 670 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2026-02-20T03:15:57.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:57 trial177 ceph-mon[43181]: mgrmap e17: x(active, since 4m), standbys: z, y 2026-02-20T03:15:57.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:57 trial126 ceph-mon[38476]: pgmap v216: 129 pgs: 129 active+clean; 670 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2026-02-20T03:15:57.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:57 trial126 ceph-mon[38476]: mgrmap e17: x(active, since 4m), standbys: z, y 2026-02-20T03:15:57.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:57 trial028 ceph-mon[38552]: pgmap v216: 129 pgs: 129 active+clean; 670 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2026-02-20T03:15:57.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:57 trial028 ceph-mon[38552]: mgrmap e17: x(active, since 4m), standbys: z, y 2026-02-20T03:15:59.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:15:59 trial177 ceph-mon[43181]: pgmap v217: 129 pgs: 129 active+clean; 670 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2026-02-20T03:15:59.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:15:59 trial126 ceph-mon[38476]: pgmap v217: 129 pgs: 129 active+clean; 670 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2026-02-20T03:15:59.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:15:59 trial028 ceph-mon[38552]: pgmap v217: 129 pgs: 129 active+clean; 670 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2026-02-20T03:15:59.602 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.6 2026-02-20T03:15:59.602 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:15:59.879 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:00.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.071+0000 7fac41fe5640 1 -- 10.20.193.28:0/2707459044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fac3c10a6d0 msgr2=0x7fac3c10aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.071+0000 7fac41fe5640 1 --2- 10.20.193.28:0/2707459044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fac3c10a6d0 0x7fac3c10aab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fac28007570 tx=0x7fac2802ff10 comp rx=0 tx=0).stop 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.071+0000 7fac41fe5640 1 -- 10.20.193.28:0/2707459044 shutdown_connections 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.071+0000 7fac41fe5640 1 --2- 10.20.193.28:0/2707459044 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac3c113ab0 0x7fac3c115f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.071+0000 7fac41fe5640 1 --2- 10.20.193.28:0/2707459044 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac3c10aff0 0x7fac3c1134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.071+0000 7fac41fe5640 1 --2- 10.20.193.28:0/2707459044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fac3c10a6d0 0x7fac3c10aab0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.071+0000 7fac41fe5640 1 -- 10.20.193.28:0/2707459044 >> 10.20.193.28:0/2707459044 conn(0x7fac3c06ed80 msgr2=0x7fac3c06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.071+0000 7fac41fe5640 1 -- 10.20.193.28:0/2707459044 shutdown_connections 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.071+0000 7fac41fe5640 1 -- 10.20.193.28:0/2707459044 wait complete. 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac41fe5640 1 Processor -- start 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac41fe5640 1 -- start start 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac41fe5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac3c10a6d0 0x7fac3c10f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac41fe5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fac3c10aff0 0x7fac3c10fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac41fe5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac3c113ab0 0x7fac3c110230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac3b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac3c10a6d0 0x7fac3c10f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac41fe5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c118d10 con 0x7fac3c10aff0 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac41fe5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c118b90 con 0x7fac3c113ab0 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac41fe5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c118e90 con 0x7fac3c10a6d0 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac3b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac3c10a6d0 0x7fac3c10f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37480/0 (socket says 10.20.193.28:37480) 2026-02-20T03:16:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.072+0000 7fac3b7fe640 1 -- 10.20.193.28:0/1488210755 learned_addr learned my addr 10.20.193.28:0/1488210755 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.073+0000 7fac3affd640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fac3c10aff0 0x7fac3c10fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.073+0000 7fac3bfff640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac3c113ab0 0x7fac3c110230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.073+0000 7fac3b7fe640 1 -- 10.20.193.28:0/1488210755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac3c113ab0 msgr2=0x7fac3c110230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.073+0000 7fac3b7fe640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac3c113ab0 0x7fac3c110230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.073+0000 7fac3b7fe640 1 -- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fac3c10aff0 msgr2=0x7fac3c10fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.073+0000 7fac3b7fe640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fac3c10aff0 0x7fac3c10fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.073+0000 7fac3b7fe640 1 -- 10.20.193.28:0/1488210755 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c1b6480 con 0x7fac3c10a6d0 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.073+0000 7fac3affd640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fac3c10aff0 0x7fac3c10fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.073+0000 7fac3b7fe640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac3c10a6d0 0x7fac3c10f7b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac280076a0 tx=0x7fac28002f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.074+0000 7fac38ff9640 1 -- 10.20.193.28:0/1488210755 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28004460 con 0x7fac3c10a6d0 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.074+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3c1b6710 con 0x7fac3c10a6d0 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.074+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3c1b6ca0 con 0x7fac3c10a6d0 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.074+0000 7fac38ff9640 1 -- 10.20.193.28:0/1488210755 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fac28030bd0 con 0x7fac3c10a6d0 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.074+0000 7fac38ff9640 1 -- 10.20.193.28:0/1488210755 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2800a860 con 0x7fac3c10a6d0 2026-02-20T03:16:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.075+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3c0749d0 con 0x7fac3c10a6d0 2026-02-20T03:16:00.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.077+0000 7fac38ff9640 1 -- 10.20.193.28:0/1488210755 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fac28040070 con 0x7fac3c10a6d0 2026-02-20T03:16:00.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.078+0000 7fac38ff9640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fac100b0e20 0x7fac100b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.079+0000 7fac38ff9640 1 -- 10.20.193.28:0/1488210755 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fac28104b50 con 0x7fac3c10a6d0 2026-02-20T03:16:00.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.079+0000 7fac38ff9640 1 -- 10.20.193.28:0/1488210755 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fac28134bc0 con 0x7fac3c10a6d0 2026-02-20T03:16:00.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.079+0000 7fac3affd640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fac100b0e20 0x7fac100b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.080+0000 7fac3affd640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fac100b0e20 0x7fac100b32e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fac3c110f70 tx=0x7fac2c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:00.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.191+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac3c119e20 con 0x7fac3c10a6d0 2026-02-20T03:16:00.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.194+0000 7fac38ff9640 1 -- 10.20.193.28:0/1488210755 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7fac280cd0b0 con 0x7fac3c10a6d0 2026-02-20T03:16:00.197 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:16:00.197 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T03:15:38:113153+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:37.375812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:16:00.197 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T03:16:00.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.195+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fac100b0e20 msgr2=0x7fac100b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.195+0000 7fac41fe5640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fac100b0e20 0x7fac100b32e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fac3c110f70 tx=0x7fac2c009290 comp rx=0 tx=0).stop 2026-02-20T03:16:00.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.195+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac3c10a6d0 msgr2=0x7fac3c10f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.195+0000 7fac41fe5640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac3c10a6d0 0x7fac3c10f7b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac280076a0 tx=0x7fac28002f40 comp rx=0 tx=0).stop 2026-02-20T03:16:00.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.196+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 shutdown_connections 2026-02-20T03:16:00.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.196+0000 7fac41fe5640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fac100b0e20 0x7fac100b32e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.196+0000 7fac41fe5640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fac3c113ab0 0x7fac3c110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.196+0000 7fac41fe5640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fac3c10aff0 0x7fac3c10fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.196+0000 7fac41fe5640 1 --2- 10.20.193.28:0/1488210755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fac3c10a6d0 0x7fac3c10f7b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.196+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 >> 10.20.193.28:0/1488210755 conn(0x7fac3c06ed80 msgr2=0x7fac3c073ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:00.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.196+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 shutdown_connections 2026-02-20T03:16:00.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.196+0000 7fac41fe5640 1 -- 10.20.193.28:0/1488210755 wait complete. 2026-02-20T03:16:00.341 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 146.6 --await-for 45.0' 2026-02-20T03:16:00.341 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 146.6 --await-for 45.0 2026-02-20T03:16:00.623 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.827+0000 7f7fb7633640 1 -- 10.20.193.28:0/3809187456 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7fb010f040 msgr2=0x7f7fb0111430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.827+0000 7f7fb7633640 1 --2- 10.20.193.28:0/3809187456 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7fb010f040 0x7f7fb0111430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009f90 tx=0x7f7fa402f420 comp rx=0 tx=0).stop 2026-02-20T03:16:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.827+0000 7f7fb7633640 1 -- 10.20.193.28:0/3809187456 shutdown_connections 2026-02-20T03:16:00.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.827+0000 7f7fb7633640 1 --2- 10.20.193.28:0/3809187456 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7fb010f040 0x7f7fb0111430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.827+0000 7f7fb7633640 1 --2- 10.20.193.28:0/3809187456 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7fb0075d30 0x7f7fb010eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.827+0000 7f7fb7633640 1 --2- 10.20.193.28:0/3809187456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7fb0075410 0x7f7fb00757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.827+0000 7f7fb7633640 1 -- 10.20.193.28:0/3809187456 >> 10.20.193.28:0/3809187456 conn(0x7f7fb00fe440 msgr2=0x7f7fb0100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.827+0000 7f7fb7633640 1 -- 10.20.193.28:0/3809187456 shutdown_connections 2026-02-20T03:16:00.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.827+0000 7f7fb7633640 1 -- 10.20.193.28:0/3809187456 wait complete. 2026-02-20T03:16:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.828+0000 7f7fb7633640 1 Processor -- start 2026-02-20T03:16:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.828+0000 7f7fb7633640 1 -- start start 2026-02-20T03:16:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.828+0000 7f7fb7633640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7fb0075410 0x7f7fb019cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.828+0000 7f7fb7633640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7fb0075d30 0x7f7fb019d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.828+0000 7f7fb7633640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7fb010f040 0x7f7fb01a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.828+0000 7f7fb7633640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb0114ba0 con 0x7f7fb0075410 2026-02-20T03:16:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.828+0000 7f7fb7633640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb0114a20 con 0x7f7fb0075d30 2026-02-20T03:16:00.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.828+0000 7f7fb7633640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb0114d20 con 0x7f7fb010f040 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb5e30640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7fb0075d30 0x7f7fb019d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb5e30640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7fb0075d30 0x7f7fb019d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35598/0 (socket says 10.20.193.28:35598) 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb5e30640 1 -- 10.20.193.28:0/697936593 learned_addr learned my addr 10.20.193.28:0/697936593 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb6e32640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7fb010f040 0x7f7fb01a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb5e30640 1 -- 10.20.193.28:0/697936593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7fb010f040 msgr2=0x7f7fb01a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7fb010f040 0x7f7fb01a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb5e30640 1 -- 10.20.193.28:0/697936593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7fb0075410 msgr2=0x7f7fb019cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7fb0075410 0x7f7fb019cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb5e30640 1 -- 10.20.193.28:0/697936593 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb01a2010 con 0x7f7fb0075d30 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb6e32640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7fb010f040 0x7f7fb01a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7fb0075d30 0x7f7fb019d500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00ea10 tx=0x7f7f9c00eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:00.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7f9b7fe640 1 -- 10.20.193.28:0/697936593 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00ce50 con 0x7f7fb0075d30 2026-02-20T03:16:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.829+0000 7f7fb7633640 1 -- 10.20.193.28:0/697936593 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb01a2300 con 0x7f7fb0075d30 2026-02-20T03:16:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.830+0000 7f7f9b7fe640 1 -- 10.20.193.28:0/697936593 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7f9c004570 con 0x7f7fb0075d30 2026-02-20T03:16:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.830+0000 7f7fb7633640 1 -- 10.20.193.28:0/697936593 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb01a9b40 con 0x7f7fb0075d30 2026-02-20T03:16:00.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.830+0000 7f7f9b7fe640 1 -- 10.20.193.28:0/697936593 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c010690 con 0x7f7fb0075d30 2026-02-20T03:16:00.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.834+0000 7f7f9b7fe640 1 -- 10.20.193.28:0/697936593 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7f9c020030 con 0x7f7fb0075d30 2026-02-20T03:16:00.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.835+0000 7f7fbadc1e00 1 Processor -- start 2026-02-20T03:16:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.835+0000 7f7f9b7fe640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f8c0b0fc0 0x7f7f8c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.835+0000 7f7f9b7fe640 1 -- 10.20.193.28:0/697936593 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f7f9c0e0ae0 con 0x7f7fb0075d30 2026-02-20T03:16:00.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fbadc1e00 1 -- start start 2026-02-20T03:16:00.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c7992b80 0x5584c7992f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798d270 0x5584c798d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79999d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5584c78d7410 con 0x5584c798dc30 2026-02-20T03:16:00.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5584c78848b0 con 0x5584c798d270 2026-02-20T03:16:00.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5584c78d3340 con 0x5584c7992b80 2026-02-20T03:16:00.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fb6e32640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f8c0b0fc0 0x7f7f8c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fb5e30640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798d270 0x5584c798d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fb5e30640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798d270 0x5584c798d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35606/0 (socket says 10.20.193.28:35606) 2026-02-20T03:16:00.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fb5e30640 1 -- 10.20.193.28:0/1516389108 learned_addr learned my addr 10.20.193.28:0/1516389108 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.836+0000 7f7fb6631640 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c7992b80 0x5584c7992f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.837+0000 7f7fb5e30640 1 -- 10.20.193.28:0/1516389108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c7992b80 msgr2=0x5584c7992f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.837+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c7992b80 0x5584c7992f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.837+0000 7f7fb5e30640 1 -- 10.20.193.28:0/1516389108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 msgr2=0x5584c79999d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.837+0000 7f7fb6e32640 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.837+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.837+0000 7f7fb5e30640 1 -- 10.20.193.28:0/1516389108 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c78768c0 con 0x5584c798d270 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.837+0000 7f7fb6e32640 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798d270 0x5584c798d6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0a5930 tx=0x7f7f9c0a90e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660a574949a94703 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7f98ff9640 1 -- 10.20.193.28:0/1516389108 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0b1b70 con 0x5584c798d270 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7f98ff9640 1 -- 10.20.193.28:0/1516389108 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7f9c0ade50 con 0x5584c798d270 2026-02-20T03:16:00.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1516389108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798d270 msgr2=0x5584c798d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798d270 0x5584c798d6f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0a5930 tx=0x7f7f9c0a90e0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fb6e32640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f8c0b0fc0 0x7f7f8c0b3480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7fa402f930 tx=0x7f7fa40096f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:00.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1516389108 shutdown_connections 2026-02-20T03:16:00.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798d270 0x5584c798d6f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1516389108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c7992b80 0x5584c7992f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1516389108 >> 10.20.193.28:0/1516389108 conn(0x5584c797d3c0 msgr2=0x5584c7982f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:00.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1516389108 shutdown_connections 2026-02-20T03:16:00.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.838+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1516389108 wait complete. 2026-02-20T03:16:00.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.840+0000 7f7fbadc1e00 1 -- start start 2026-02-20T03:16:00.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.840+0000 7f7fbadc1e00 1 Processor -- start 2026-02-20T03:16:00.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.840+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.840+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.840+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 0x5584c79a6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.840+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5584c787e4a0 con 0x5584c798dc30 2026-02-20T03:16:00.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.840+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5584c799a010 con 0x5584c7992b80 2026-02-20T03:16:00.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.840+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5584c79a6a50 con 0x5584c798d270 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.840+0000 7f7fb6631640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb6e32640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 0x5584c79a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb6631640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79ab2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37518/0 (socket says 10.20.193.28:37518) 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb6631640 1 -- 10.20.193.28:0/1534291362 learned_addr learned my addr 10.20.193.28:0/1534291362 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb6631640 1 -- 10.20.193.28:0/1534291362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 msgr2=0x5584c79a6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb6631640 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 0x5584c79a6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb6631640 1 -- 10.20.193.28:0/1534291362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 msgr2=0x5584c79ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb6631640 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb6631640 1 -- 10.20.193.28:0/1534291362 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c799f8d0 con 0x5584c798d270 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:00.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7fb6631640 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79ab2a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009b20 tx=0x7f7fa80026e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45eb8b2ebe505542 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.841+0000 7f7f63fff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.842+0000 7f7f63fff640 1 -- 10.20.193.28:0/1534291362 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8010840 con 0x5584c798d270 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.842+0000 7f7f63fff640 1 -- 10.20.193.28:0/1534291362 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7fa800e3e0 con 0x5584c798d270 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.842+0000 7f7f63fff640 1 -- 10.20.193.28:0/1534291362 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa801a5f0 con 0x5584c798d270 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.842+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1534291362 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c763b8a0 con 0x5584c798d270 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.842+0000 7f7f63fff640 1 -- 10.20.193.28:0/1534291362 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f7fa801a790 con 0x5584c798d270 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.842+0000 7f7f63fff640 10 client.25411 inactive, discarding osd_map(91..91 src has 1..91) 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.842+0000 7f7fbadc1e00 10 client.25411 _ll_register_callbacks cb 0x5584c78823d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.842+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1534291362 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584c78df000 con 0x5584c798d270 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.842+0000 7f7f63fff640 1 -- 10.20.193.28:0/1534291362 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7fa8020060 con 0x5584c798d270 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7fbadc1e00 10 client.25411 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:00.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1534291362 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5584c76a70e0 con 0x5584c798d270 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7f63fff640 1 -- 10.20.193.28:0/1534291362 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f7fa800e590 con 0x5584c798d270 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7fbadc1e00 10 client.25411 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7fbadc1e00 10 client.25411 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7fbadc1e00 20 client.25411 populate_metadata read hostname 'trial028' 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584c79b6630 0x5584c79b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7fbadc1e00 4 client.25411 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1534291362 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584c7858f60 con 0x5584c79b6630 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.843+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584c79b6630 0x5584c79b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.844+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584c79b6630 0x5584c79b8af0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b57d670721fb2460 server_cookie=188d58f1ed5fe6ca in_seq=0 out_seq=0 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.844+0000 7f7f63fff640 10 client.25411 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.844+0000 7f7f63fff640 1 -- 10.20.193.28:0/1534291362 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5584c7858f60 con 0x5584c79b6630 2026-02-20T03:16:00.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.844+0000 7f7f63fff640 10 client.25411 handle_command_reply: tid=0 2026-02-20T03:16:00.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.845+0000 7f7fbadc1e00 1 client.25411 shutdown 2026-02-20T03:16:00.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.845+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1534291362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 msgr2=0x5584c79ab2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.845+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79ab2a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009b20 tx=0x7f7fa80026e0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1534291362 shutdown_connections 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584c79b6630 0x5584c79b8af0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 0x5584c79a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798dc30 0x5584c79ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1534291362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79ab2a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1534291362 >> 10.20.193.28:0/1534291362 conn(0x5584c797d3c0 msgr2=0x5584c7983670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7f63fff640 0 client.25411 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1534291362 shutdown_connections 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1534291362 wait complete. 2026-02-20T03:16:00.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.846+0000 7f7fbadc1e00 20 client.25411 trim_cache size 0 max 16384 2026-02-20T03:16:00.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.855+0000 7f7fbadc1e00 1 Processor -- start 2026-02-20T03:16:00.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.855+0000 7f7fbadc1e00 1 -- start start 2026-02-20T03:16:00.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798d270 0x5584c7983750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798dc30 0x5584c7983c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 0x5584c79a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58012370 con 0x5584c798d270 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5800fc40 con 0x5584c7992b80 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5800da90 con 0x5584c798dc30 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fb5e30640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798dc30 0x5584c7983c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fb5e30640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798dc30 0x5584c7983c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37534/0 (socket says 10.20.193.28:37534) 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fb5e30640 1 -- 10.20.193.28:0/2156553566 learned_addr learned my addr 10.20.193.28:0/2156553566 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fb6e32640 1 --2- 10.20.193.28:0/2156553566 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 0x5584c79a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fb5e30640 1 -- 10.20.193.28:0/2156553566 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 msgr2=0x5584c79a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.856+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/2156553566 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 0x5584c79a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.857+0000 7f7fb5e30640 1 -- 10.20.193.28:0/2156553566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798d270 msgr2=0x5584c7983750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.857+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/2156553566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798d270 0x5584c7983750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.857+0000 7f7fb5e30640 1 -- 10.20.193.28:0/2156553566 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c799f700 con 0x5584c798dc30 2026-02-20T03:16:00.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.857+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/2156553566 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798dc30 0x5584c7983c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0de610 tx=0x7f7f9c0098c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59b705361693863b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:00.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.857+0000 7f7f7e4e6640 1 -- 10.20.193.28:0/2156553566 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0a4950 con 0x5584c798dc30 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.857+0000 7f7f7e4e6640 1 -- 10.20.193.28:0/2156553566 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7f9c0a2e50 con 0x5584c798dc30 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.857+0000 7f7f7e4e6640 1 -- 10.20.193.28:0/2156553566 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0a4300 con 0x5584c798dc30 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.858+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/2156553566 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798dc30 msgr2=0x5584c7983c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.858+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/2156553566 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798dc30 0x5584c7983c90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0de610 tx=0x7f7f9c0098c0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.858+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/2156553566 shutdown_connections 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.858+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/2156553566 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c7992b80 0x5584c79a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.858+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/2156553566 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798dc30 0x5584c7983c90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.858+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/2156553566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c798d270 0x5584c7983750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.858+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/2156553566 >> 10.20.193.28:0/2156553566 conn(0x5584c797d3c0 msgr2=0x5584c7990520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.858+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/2156553566 shutdown_connections 2026-02-20T03:16:00.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.858+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/2156553566 wait complete. 2026-02-20T03:16:00.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.859+0000 7f7fbadc1e00 1 -- start start 2026-02-20T03:16:00.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.859+0000 7f7fbadc1e00 1 Processor -- start 2026-02-20T03:16:00.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.859+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.859+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798dc30 0x5584c79ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.859+0000 7f7fbadc1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c7992b80 0x5584c79ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.859+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5800e100 con 0x5584c7992b80 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.859+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5800f570 con 0x5584c798dc30 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.859+0000 7f7fbadc1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5800e7d0 con 0x5584c798d270 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb5e30640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798dc30 0x5584c79ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb5e30640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798dc30 0x5584c79ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35634/0 (socket says 10.20.193.28:35634) 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb5e30640 1 -- 10.20.193.28:0/1624827604 learned_addr learned my addr 10.20.193.28:0/1624827604 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb6631640 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb6e32640 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c7992b80 0x5584c79ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb5e30640 1 -- 10.20.193.28:0/1624827604 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 msgr2=0x5584c79b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb5e30640 1 -- 10.20.193.28:0/1624827604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c7992b80 msgr2=0x5584c79ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c7992b80 0x5584c79ad5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb5e30640 1 -- 10.20.193.28:0/1624827604 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584c799f2c0 con 0x5584c798dc30 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb6631640 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb6e32640 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c7992b80 0x5584c79ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fb5e30640 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798dc30 0x5584c79ad090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0a5930 tx=0x7f7f9c00efd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4629aca39b97652 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7f63fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7f63fff640 1 -- 10.20.193.28:0/1624827604 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0a4950 con 0x5584c798dc30 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1624827604 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584c76587f0 con 0x5584c798dc30 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fbadc1e00 10 client.25448 _ll_register_callbacks cb 0x7f7fa80046b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:00.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1624827604 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f9c0ade50 con 0x5584c798dc30 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.860+0000 7f7f63fff640 1 -- 10.20.193.28:0/1624827604 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7f9c002900 con 0x5584c798dc30 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7f63fff640 1 -- 10.20.193.28:0/1624827604 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0a4950 con 0x5584c798dc30 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7f63fff640 1 -- 10.20.193.28:0/1624827604 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f7f9c0c7070 con 0x5584c798dc30 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7f63fff640 1 -- 10.20.193.28:0/1624827604 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7f9c0c6030 con 0x5584c798dc30 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7fbadc1e00 10 client.25448 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1624827604 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5584c79a03f0 con 0x5584c798dc30 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7f63fff640 1 -- 10.20.193.28:0/1624827604 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f7f9c0bdbe0 con 0x5584c798dc30 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7fbadc1e00 10 client.25448 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7fbadc1e00 10 client.25448 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7fbadc1e00 20 client.25448 populate_metadata read hostname 'trial028' 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584c7a221d0 0x5584c7a245c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:00.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7fbadc1e00 4 client.25448 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.6, "await_for": 45.0}] 2026-02-20T03:16:00.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.861+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1624827604 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.6, "await_for": 45.0}) -- 0x5584c7647f60 con 0x5584c7a221d0 2026-02-20T03:16:00.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.862+0000 7f7fb6631640 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584c7a221d0 0x5584c7a245c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:00.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.862+0000 7f7fb6631640 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584c7a221d0 0x5584c7a245c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54fe4fe0b46497d2 server_cookie=df7a117a103e32a2 in_seq=0 out_seq=0 2026-02-20T03:16:00.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.862+0000 7f7f63fff640 10 client.25448 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:00.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.867+0000 7f7f63fff640 1 -- 10.20.193.28:0/1624827604 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5584c7647f60 con 0x5584c7a221d0 2026-02-20T03:16:00.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.867+0000 7f7f63fff640 10 client.25448 handle_command_reply: tid=0 2026-02-20T03:16:00.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 client.25448 shutdown 2026-02-20T03:16:00.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1624827604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798dc30 msgr2=0x5584c79ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798dc30 0x5584c79ad090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0a5930 tx=0x7f7f9c00efd0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1624827604 shutdown_connections 2026-02-20T03:16:00.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584c7a221d0 0x5584c7a245c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584c7992b80 0x5584c79ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584c798dc30 0x5584c79ad090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 --2- 10.20.193.28:0/1624827604 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584c798d270 0x5584c79b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1624827604 >> 10.20.193.28:0/1624827604 conn(0x5584c797d3c0 msgr2=0x5584c79a4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:00.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7f63fff640 0 client.25448 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:00.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1624827604 shutdown_connections 2026-02-20T03:16:00.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.868+0000 7f7fbadc1e00 1 -- 10.20.193.28:0/1624827604 wait complete. 2026-02-20T03:16:00.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fbadc1e00 20 client.25448 trim_cache size 0 max 16384 2026-02-20T03:16:00.872 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 24, 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 2, 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "975a2bd": { 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "version": 2, 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:16:00.873 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 146.6, 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:00.874 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:00.875 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:00.875 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:00.875 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:16:00.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 -- 10.20.193.28:0/697936593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f8c0b0fc0 msgr2=0x7f7f8c0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f8c0b0fc0 0x7f7f8c0b3480 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7fa402f930 tx=0x7f7fa40096f0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 -- 10.20.193.28:0/697936593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7fb0075d30 msgr2=0x7f7fb019d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7fb0075d30 0x7f7fb019d500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00ea10 tx=0x7f7f9c00eee0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 -- 10.20.193.28:0/697936593 shutdown_connections 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7f8c0b0fc0 0x7f7f8c0b3480 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7fb010f040 0x7f7fb01a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7fb0075d30 0x7f7fb019d500 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 --2- 10.20.193.28:0/697936593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7fb0075410 0x7f7fb019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.869+0000 7f7fb7633640 1 -- 10.20.193.28:0/697936593 >> 10.20.193.28:0/697936593 conn(0x7f7fb00fe440 msgr2=0x7f7fb00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:00.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.870+0000 7f7fb7633640 1 -- 10.20.193.28:0/697936593 shutdown_connections 2026-02-20T03:16:00.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:00.870+0000 7f7fb7633640 1 -- 10.20.193.28:0/697936593 wait complete. 2026-02-20T03:16:01.020 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '975a2bd', quiesce took 1.4 seconds. Will release after: 25.200000000000003 2026-02-20T03:16:01.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:01 trial177 ceph-mon[43181]: pgmap v218: 129 pgs: 129 active+clean; 670 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2026-02-20T03:16:01.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:01 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1488210755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:01.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:01 trial126 ceph-mon[38476]: pgmap v218: 129 pgs: 129 active+clean; 670 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2026-02-20T03:16:01.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:01 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1488210755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:01 trial028 ceph-mon[38552]: pgmap v218: 129 pgs: 129 active+clean; 670 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2026-02-20T03:16:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:01 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1488210755' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:03.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:03 trial177 ceph-mon[43181]: pgmap v219: 129 pgs: 129 active+clean; 671 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2026-02-20T03:16:03.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:03 trial126 ceph-mon[38476]: pgmap v219: 129 pgs: 129 active+clean; 671 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2026-02-20T03:16:03.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:03 trial028 ceph-mon[38552]: pgmap v219: 129 pgs: 129 active+clean; 671 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2026-02-20T03:16:03.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.667+0000 7fb5a674c640 1 -- 10.20.193.28:0/4265279095 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a010a900 msgr2=0x7fb5a0111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:03.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.667+0000 7fb5a674c640 1 --2- 10.20.193.28:0/4265279095 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a010a900 0x7fb5a0111480 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009f90 tx=0x7fb59c02f390 comp rx=0 tx=0).stop 2026-02-20T03:16:03.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.667+0000 7fb5a674c640 1 -- 10.20.193.28:0/4265279095 shutdown_connections 2026-02-20T03:16:03.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.667+0000 7fb5a674c640 1 --2- 10.20.193.28:0/4265279095 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a010a900 0x7fb5a0111480 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.667+0000 7fb5a674c640 1 --2- 10.20.193.28:0/4265279095 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5a0109e60 0x7fb5a010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.667+0000 7fb5a674c640 1 --2- 10.20.193.28:0/4265279095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5a0109490 0x7fb5a0109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.667+0000 7fb5a674c640 1 -- 10.20.193.28:0/4265279095 >> 10.20.193.28:0/4265279095 conn(0x7fb5a0077fe0 msgr2=0x7fb5a007a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:03.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.667+0000 7fb5a674c640 1 -- 10.20.193.28:0/4265279095 shutdown_connections 2026-02-20T03:16:03.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.667+0000 7fb5a674c640 1 -- 10.20.193.28:0/4265279095 wait complete. 2026-02-20T03:16:03.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.668+0000 7fb5a674c640 1 Processor -- start 2026-02-20T03:16:03.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.668+0000 7fb5a674c640 1 -- start start 2026-02-20T03:16:03.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.668+0000 7fb5a674c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a0109490 0x7fb5a0074d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.668+0000 7fb5a674c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5a0109e60 0x7fb5a00717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.668+0000 7fb5a674c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5a010a900 0x7fb5a0071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.668+0000 7fb5a674c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0114910 con 0x7fb5a010a900 2026-02-20T03:16:03.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.668+0000 7fb5a674c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0114790 con 0x7fb5a0109e60 2026-02-20T03:16:03.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.668+0000 7fb5a674c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0114a90 con 0x7fb5a0109490 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a574a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a0109490 0x7fb5a0074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a574a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a0109490 0x7fb5a0074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37564/0 (socket says 10.20.193.28:37564) 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a574a640 1 -- 10.20.193.28:0/3355225821 learned_addr learned my addr 10.20.193.28:0/3355225821 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5a0109e60 0x7fb5a00717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5a010a900 0x7fb5a0071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a574a640 1 -- 10.20.193.28:0/3355225821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5a0109e60 msgr2=0x7fb5a00717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a574a640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5a0109e60 0x7fb5a00717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a574a640 1 -- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5a010a900 msgr2=0x7fb5a0071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a574a640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5a010a900 0x7fb5a0071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a574a640 1 -- 10.20.193.28:0/3355225821 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a01b1540 con 0x7fb5a0109490 2026-02-20T03:16:03.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.669+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5a0109e60 0x7fb5a00717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:03.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.670+0000 7fb5a574a640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a0109490 0x7fb5a0074d50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb5900059c0 tx=0x7fb59000ddf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:03.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.670+0000 7fb58e7fc640 1 -- 10.20.193.28:0/3355225821 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590014070 con 0x7fb5a0109490 2026-02-20T03:16:03.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.670+0000 7fb5a674c640 1 -- 10.20.193.28:0/3355225821 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a01b1830 con 0x7fb5a0109490 2026-02-20T03:16:03.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.670+0000 7fb58e7fc640 1 -- 10.20.193.28:0/3355225821 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb5900044e0 con 0x7fb5a0109490 2026-02-20T03:16:03.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.670+0000 7fb58e7fc640 1 -- 10.20.193.28:0/3355225821 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590010460 con 0x7fb5a0109490 2026-02-20T03:16:03.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.670+0000 7fb5a674c640 1 -- 10.20.193.28:0/3355225821 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a01b1dd0 con 0x7fb5a0109490 2026-02-20T03:16:03.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.673+0000 7fb5aa834e00 1 Processor -- start 2026-02-20T03:16:03.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.674+0000 7fb5aa834e00 1 -- start start 2026-02-20T03:16:03.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.674+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.674+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efd2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.674+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.674+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e13ef1e8f0 con 0x55e13efcde80 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.674+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e13eecc2e0 con 0x55e13efce7c0 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.674+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e13ef1a820 con 0x55e13efd3560 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a4f49640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a4f49640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37572/0 (socket says 10.20.193.28:37572) 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a4f49640 1 -- 10.20.193.28:0/240250117 learned_addr learned my addr 10.20.193.28:0/240250117 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/240250117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a4f49640 1 -- 10.20.193.28:0/240250117 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 msgr2=0x55e13efd2f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:16:03.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/240250117 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efd2f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a4f49640 1 -- 10.20.193.28:0/240250117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 msgr2=0x55e13efce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:03.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb58e7fc640 1 -- 10.20.193.28:0/3355225821 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb590021060 con 0x7fb5a0109490 2026-02-20T03:16:03.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/240250117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a4f49640 1 -- 10.20.193.28:0/240250117 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e13eebe5a0 con 0x55e13efd3560 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.675+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/240250117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.676+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/240250117 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd59f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb594009bd0 tx=0x7fb594002ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc35b53803456c25 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.676+0000 7fb56dbfe640 1 -- 10.20.193.28:0/240250117 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59401a640 con 0x55e13efd3560 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.676+0000 7fb56dbfe640 1 -- 10.20.193.28:0/240250117 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb59401ac80 con 0x55e13efd3560 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.676+0000 7fb56dbfe640 1 -- 10.20.193.28:0/240250117 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594010d00 con 0x55e13efd3560 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb58e7fc640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb57c0b0e20 0x7fb57c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb58e7fc640 1 -- 10.20.193.28:0/3355225821 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fb5900e0630 con 0x7fb5a0109490 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5aa834e00 1 -- 10.20.193.28:0/240250117 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 msgr2=0x55e13efd59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/240250117 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd59f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb594009bd0 tx=0x7fb594002ab0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5aa834e00 1 -- 10.20.193.28:0/240250117 shutdown_connections 2026-02-20T03:16:03.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/240250117 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd59f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/240250117 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efd2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/240250117 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5aa834e00 1 -- 10.20.193.28:0/240250117 >> 10.20.193.28:0/240250117 conn(0x55e13efc56f0 msgr2=0x55e13efcc570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:03.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5aa834e00 1 -- 10.20.193.28:0/240250117 shutdown_connections 2026-02-20T03:16:03.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb57c0b0e20 0x7fb57c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.677+0000 7fb5aa834e00 1 -- 10.20.193.28:0/240250117 wait complete. 2026-02-20T03:16:03.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.678+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb57c0b0e20 0x7fb57c0b32e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009da0 tx=0x7fb59c004520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:03.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.679+0000 7fb5aa834e00 1 -- start start 2026-02-20T03:16:03.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.679+0000 7fb5aa834e00 1 Processor -- start 2026-02-20T03:16:03.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.679+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efcde80 0x55e13efe6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.679+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efce7c0 0x55e13efe6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.679+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efedb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.679+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e13eec60c0 con 0x55e13efce7c0 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.679+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e13efd6610 con 0x55e13efcde80 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.679+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e13efee090 con 0x55e13efd3560 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a5f4b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efedb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a574a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efcde80 0x55e13efe6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a5f4b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efedb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37586/0 (socket says 10.20.193.28:37586) 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a5f4b640 1 -- 10.20.193.28:0/1040895896 learned_addr learned my addr 10.20.193.28:0/1040895896 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efce7c0 0x55e13efe6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a574a640 1 -- 10.20.193.28:0/1040895896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 msgr2=0x55e13efedb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a574a640 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efedb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a574a640 1 -- 10.20.193.28:0/1040895896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efce7c0 msgr2=0x55e13efe6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:03.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a574a640 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efce7c0 0x55e13efe6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a574a640 1 -- 10.20.193.28:0/1040895896 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e13efe0090 con 0x55e13efcde80 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efedb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efce7c0 0x55e13efe6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5a574a640 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efcde80 0x55e13efe6740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55e13efceeb0 tx=0x7fb5900a7b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90495b783f0579e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb55affd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb55affd640 1 -- 10.20.193.28:0/1040895896 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59001e070 con 0x55e13efcde80 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5aa834e00 1 -- 10.20.193.28:0/1040895896 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e13eeda820 con 0x55e13efcde80 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5aa834e00 10 client.25457 _ll_register_callbacks cb 0x55e13eec9ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb5aa834e00 1 -- 10.20.193.28:0/1040895896 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e13ef264e0 con 0x55e13efcde80 2026-02-20T03:16:03.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb55affd640 1 -- 10.20.193.28:0/1040895896 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb5900ac7b0 con 0x55e13efcde80 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.680+0000 7fb55affd640 1 -- 10.20.193.28:0/1040895896 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900a70e0 con 0x55e13efcde80 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb55affd640 1 -- 10.20.193.28:0/1040895896 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fb590090ad0 con 0x55e13efcde80 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb55affd640 1 -- 10.20.193.28:0/1040895896 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb590090dd0 con 0x55e13efcde80 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb5aa834e00 10 client.25457 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb5aa834e00 1 -- 10.20.193.28:0/1040895896 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55e13eedf380 con 0x55e13efcde80 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb55affd640 1 -- 10.20.193.28:0/1040895896 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fb5900e0070 con 0x55e13efcde80 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb5aa834e00 10 client.25457 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb5aa834e00 10 client.25457 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb5aa834e00 20 client.25457 populate_metadata read hostname 'trial028' 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e13eff2330 0x55e13eff47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb5aa834e00 4 client.25457 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb5aa834e00 1 -- 10.20.193.28:0/1040895896 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e13eea0bd0 con 0x55e13eff2330 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.681+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e13eff2330 0x55e13eff47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e13eff2330 0x55e13eff47f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7833ed2bd161d643 server_cookie=2cf62da878871da0 in_seq=0 out_seq=0 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb55affd640 10 client.25457 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb55affd640 1 -- 10.20.193.28:0/1040895896 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e13eea0bd0 con 0x55e13eff2330 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb55affd640 10 client.25457 handle_command_reply: tid=0 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5aa834e00 1 client.25457 shutdown 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5aa834e00 1 -- 10.20.193.28:0/1040895896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efcde80 msgr2=0x55e13efe6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efcde80 0x55e13efe6740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55e13efceeb0 tx=0x7fb5900a7b00 comp rx=0 tx=0).stop 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5aa834e00 1 -- 10.20.193.28:0/1040895896 shutdown_connections 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e13eff2330 0x55e13eff47f0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efedb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efce7c0 0x55e13efe6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/1040895896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efcde80 0x55e13efe6740 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb5aa834e00 1 -- 10.20.193.28:0/1040895896 >> 10.20.193.28:0/1040895896 conn(0x55e13efc56f0 msgr2=0x55e13efd4890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:03.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.682+0000 7fb55affd640 0 client.25457 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:03.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.683+0000 7fb5aa834e00 1 -- 10.20.193.28:0/1040895896 shutdown_connections 2026-02-20T03:16:03.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.683+0000 7fb5aa834e00 1 -- 10.20.193.28:0/1040895896 wait complete. 2026-02-20T03:16:03.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.683+0000 7fb5aa834e00 20 client.25457 trim_cache size 0 max 16384 2026-02-20T03:16:03.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5aa834e00 1 Processor -- start 2026-02-20T03:16:03.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5aa834e00 1 -- start start 2026-02-20T03:16:03.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efedac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c012250 con 0x55e13efcde80 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c00fb20 con 0x55e13efce7c0 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c00d970 con 0x55e13efd3560 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5a574a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5a574a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59348/0 (socket says 10.20.193.28:59348) 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5a574a640 1 -- 10.20.193.28:0/3270944277 learned_addr learned my addr 10.20.193.28:0/3270944277 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.690+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efedac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5a574a640 1 -- 10.20.193.28:0/3270944277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 msgr2=0x55e13efd4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5a574a640 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5a574a640 1 -- 10.20.193.28:0/3270944277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 msgr2=0x55e13efedac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:03.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5a574a640 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efedac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5a574a640 1 -- 10.20.193.28:0/3270944277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e13efdfec0 con 0x55e13efcde80 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efedac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5a574a640 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb5900a8390 tx=0x7fb5900aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdf98fa43eddaf6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb56d3fd640 1 -- 10.20.193.28:0/3270944277 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59001e030 con 0x55e13efcde80 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb56d3fd640 1 -- 10.20.193.28:0/3270944277 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e13ef264e0 con 0x55e13efcde80 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb56d3fd640 1 -- 10.20.193.28:0/3270944277 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900a3e60 con 0x55e13efcde80 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5aa834e00 1 -- 10.20.193.28:0/3270944277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 msgr2=0x55e13efce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb5900a8390 tx=0x7fb5900aa000 comp rx=0 tx=0).stop 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5aa834e00 1 -- 10.20.193.28:0/3270944277 shutdown_connections 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efd3560 0x55e13efd4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.696 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.691+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efedac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.692+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/3270944277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efcde80 0x55e13efce260 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.692+0000 7fb5aa834e00 1 -- 10.20.193.28:0/3270944277 >> 10.20.193.28:0/3270944277 conn(0x55e13efc56f0 msgr2=0x55e13efe5520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:03.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.692+0000 7fb5aa834e00 1 -- 10.20.193.28:0/3270944277 shutdown_connections 2026-02-20T03:16:03.697 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.692+0000 7fb5aa834e00 1 -- 10.20.193.28:0/3270944277 wait complete. 2026-02-20T03:16:03.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.692+0000 7fb5aa834e00 1 -- start start 2026-02-20T03:16:03.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.692+0000 7fb5aa834e00 1 Processor -- start 2026-02-20T03:16:03.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efcde80 0x55e13efe9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5aa834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efd3560 0x55e13efed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c00dfe0 con 0x55e13efd3560 2026-02-20T03:16:03.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c00f450 con 0x55e13efce7c0 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5a574a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efcde80 0x55e13efe9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5aa834e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb54c00e6b0 con 0x55e13efcde80 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5a574a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efcde80 0x55e13efe9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37608/0 (socket says 10.20.193.28:37608) 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5a574a640 1 -- 10.20.193.28:0/2132293356 learned_addr learned my addr 10.20.193.28:0/2132293356 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.693+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efd3560 0x55e13efed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5a574a640 1 -- 10.20.193.28:0/2132293356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 msgr2=0x55e13efea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5a574a640 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5a574a640 1 -- 10.20.193.28:0/2132293356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efd3560 msgr2=0x55e13efed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5a574a640 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efd3560 0x55e13efed220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5a574a640 1 -- 10.20.193.28:0/2132293356 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e13ec7e690 con 0x55e13efcde80 2026-02-20T03:16:03.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:03.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5a5f4b640 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efd3560 0x55e13efed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:03.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5a574a640 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efcde80 0x55e13efe9d60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb5900a5420 tx=0x7fb5900a3a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af52d810128565a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:03.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb55affd640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:03.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb55affd640 1 -- 10.20.193.28:0/2132293356 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900a3de0 con 0x55e13efcde80 2026-02-20T03:16:03.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5aa834e00 1 -- 10.20.193.28:0/2132293356 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e13eee3b70 con 0x55e13efcde80 2026-02-20T03:16:03.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5aa834e00 10 client.25435 _ll_register_callbacks cb 0x7fb5900a3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:03.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb5aa834e00 1 -- 10.20.193.28:0/2132293356 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e13ef2c290 con 0x55e13efcde80 2026-02-20T03:16:03.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb55affd640 1 -- 10.20.193.28:0/2132293356 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb5900c2b70 con 0x55e13efcde80 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb55affd640 1 -- 10.20.193.28:0/2132293356 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900b0f70 con 0x55e13efcde80 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.694+0000 7fb55affd640 1 -- 10.20.193.28:0/2132293356 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fb5900c92b0 con 0x55e13efcde80 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb55affd640 1 -- 10.20.193.28:0/2132293356 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb5900a6e80 con 0x55e13efcde80 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb5aa834e00 10 client.25435 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb5aa834e00 1 -- 10.20.193.28:0/2132293356 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55e13efe0bb0 con 0x55e13efcde80 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb55affd640 1 -- 10.20.193.28:0/2132293356 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fb5900e0040 con 0x55e13efcde80 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb5aa834e00 10 client.25435 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb5aa834e00 10 client.25435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb5aa834e00 20 client.25435 populate_metadata read hostname 'trial028' 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e13f05db30 0x55e13f05fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb5aa834e00 4 client.25435 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:16:03.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb5aa834e00 1 -- 10.20.193.28:0/2132293356 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e13ef264e0 con 0x55e13f05db30 2026-02-20T03:16:03.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.695+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e13f05db30 0x55e13f05fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:03.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.696+0000 7fb5a4f49640 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e13f05db30 0x55e13f05fff0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de7038d5b9896484 server_cookie=997e3d947803336a in_seq=0 out_seq=0 2026-02-20T03:16:03.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.696+0000 7fb55affd640 10 client.25435 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:03.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb55affd640 1 -- 10.20.193.28:0/2132293356 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e13ef264e0 con 0x55e13f05db30 2026-02-20T03:16:03.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb55affd640 10 client.25435 handle_command_reply: tid=0 2026-02-20T03:16:03.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 client.25435 shutdown 2026-02-20T03:16:03.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 -- 10.20.193.28:0/2132293356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efcde80 msgr2=0x55e13efe9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:03.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efcde80 0x55e13efe9d60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb5900a5420 tx=0x7fb5900a3a40 comp rx=0 tx=0).stop 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 -- 10.20.193.28:0/2132293356 shutdown_connections 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e13f05db30 0x55e13f05fff0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e13efd3560 0x55e13efed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e13efce7c0 0x55e13efea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 --2- 10.20.193.28:0/2132293356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e13efcde80 0x55e13efe9d60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb55affd640 0 client.25435 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 -- 10.20.193.28:0/2132293356 >> 10.20.193.28:0/2132293356 conn(0x55e13efc56f0 msgr2=0x55e13efd3940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 -- 10.20.193.28:0/2132293356 shutdown_connections 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 1 -- 10.20.193.28:0/2132293356 wait complete. 2026-02-20T03:16:03.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.701+0000 7fb5aa834e00 20 client.25435 trim_cache size 0 max 16384 2026-02-20T03:16:03.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:16:03.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:16:03.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:16:03.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:16:03.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 -- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb57c0b0e20 msgr2=0x7fb57c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:03.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb57c0b0e20 0x7fb57c0b32e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009da0 tx=0x7fb59c004520 comp rx=0 tx=0).stop 2026-02-20T03:16:03.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 -- 10.20.193.28:0/3355225821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a0109490 msgr2=0x7fb5a0074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:03.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a0109490 0x7fb5a0074d50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb5900059c0 tx=0x7fb59000ddf0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 -- 10.20.193.28:0/3355225821 shutdown_connections 2026-02-20T03:16:03.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb57c0b0e20 0x7fb57c0b32e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5a010a900 0x7fb5a0071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb5a0109e60 0x7fb5a00717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 --2- 10.20.193.28:0/3355225821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb5a0109490 0x7fb5a0074d50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:03.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 -- 10.20.193.28:0/3355225821 >> 10.20.193.28:0/3355225821 conn(0x7fb5a0077fe0 msgr2=0x7fb5a010d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:03.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 -- 10.20.193.28:0/3355225821 shutdown_connections 2026-02-20T03:16:03.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:03.703+0000 7fb5a674c640 1 -- 10.20.193.28:0/3355225821 wait complete. 2026-02-20T03:16:05.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:05 trial177 ceph-mon[43181]: pgmap v220: 129 pgs: 129 active+clean; 671 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2026-02-20T03:16:05.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:05 trial126 ceph-mon[38476]: pgmap v220: 129 pgs: 129 active+clean; 671 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2026-02-20T03:16:05.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:05 trial028 ceph-mon[38552]: pgmap v220: 129 pgs: 129 active+clean; 671 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.5 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2026-02-20T03:16:07.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:07 trial177 ceph-mon[43181]: pgmap v221: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2026-02-20T03:16:07.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:07 trial126 ceph-mon[38476]: pgmap v221: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2026-02-20T03:16:07.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:07 trial028 ceph-mon[38552]: pgmap v221: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 3.1 KiB/s wr, 12 op/s 2026-02-20T03:16:08.686 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:16:08.955 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:09.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.144+0000 7fa52dde2640 1 -- 10.20.193.28:0/3834881287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 msgr2=0x7fa528115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.144+0000 7fa52dde2640 1 --2- 10.20.193.28:0/3834881287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 0x7fa528115d10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa52400b0a0 tx=0x7fa52402f450 comp rx=0 tx=0).stop 2026-02-20T03:16:09.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.144+0000 7fa52dde2640 1 -- 10.20.193.28:0/3834881287 shutdown_connections 2026-02-20T03:16:09.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.144+0000 7fa52dde2640 1 --2- 10.20.193.28:0/3834881287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 0x7fa528115d10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.144+0000 7fa52dde2640 1 --2- 10.20.193.28:0/3834881287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa528109220 0x7fa528109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.144+0000 7fa52dde2640 1 --2- 10.20.193.28:0/3834881287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa52810eef0 0x7fa52810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.144+0000 7fa52dde2640 1 -- 10.20.193.28:0/3834881287 >> 10.20.193.28:0/3834881287 conn(0x7fa528078600 msgr2=0x7fa52807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:09.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.144+0000 7fa52dde2640 1 -- 10.20.193.28:0/3834881287 shutdown_connections 2026-02-20T03:16:09.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.144+0000 7fa52dde2640 1 -- 10.20.193.28:0/3834881287 wait complete. 2026-02-20T03:16:09.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa52dde2640 1 Processor -- start 2026-02-20T03:16:09.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa52dde2640 1 -- start start 2026-02-20T03:16:09.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa52dde2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa528109220 0x7fa5281a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa52dde2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 0x7fa5281a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa52dde2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa52810eef0 0x7fa5281a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa52dde2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa528119090 con 0x7fa528109ba0 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa52dde2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa528118f10 con 0x7fa52810eef0 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa52dde2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa528119210 con 0x7fa528109220 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa51ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 0x7fa5281a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa51ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 0x7fa5281a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46308/0 (socket says 10.20.193.28:46308) 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa51ffff640 1 -- 10.20.193.28:0/187057627 learned_addr learned my addr 10.20.193.28:0/187057627 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.145+0000 7fa52cde0640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa528109220 0x7fa5281a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa52d5e1640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa52810eef0 0x7fa5281a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa51ffff640 1 -- 10.20.193.28:0/187057627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa528109220 msgr2=0x7fa5281a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa51ffff640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa528109220 0x7fa5281a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa51ffff640 1 -- 10.20.193.28:0/187057627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa52810eef0 msgr2=0x7fa5281a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa51ffff640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa52810eef0 0x7fa5281a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa51ffff640 1 -- 10.20.193.28:0/187057627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5281a6560 con 0x7fa528109ba0 2026-02-20T03:16:09.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa51ffff640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 0x7fa5281a1a50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa51000d950 tx=0x7fa51000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:09.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa51dffb640 1 -- 10.20.193.28:0/187057627 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510014070 con 0x7fa528109ba0 2026-02-20T03:16:09.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa51dffb640 1 -- 10.20.193.28:0/187057627 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa5100044e0 con 0x7fa528109ba0 2026-02-20T03:16:09.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa51dffb640 1 -- 10.20.193.28:0/187057627 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510010460 con 0x7fa528109ba0 2026-02-20T03:16:09.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa52dde2640 1 -- 10.20.193.28:0/187057627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5281a6850 con 0x7fa528109ba0 2026-02-20T03:16:09.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.146+0000 7fa52dde2640 1 -- 10.20.193.28:0/187057627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5281ae090 con 0x7fa528109ba0 2026-02-20T03:16:09.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.149+0000 7fa531570e00 1 Processor -- start 2026-02-20T03:16:09.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.149+0000 7fa531570e00 1 -- start start 2026-02-20T03:16:09.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.149+0000 7fa51dffb640 1 -- 10.20.193.28:0/187057627 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa5100026e0 con 0x7fa528109ba0 2026-02-20T03:16:09.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.149+0000 7fa531570e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a6d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.149+0000 7fa531570e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a67a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.149+0000 7fa531570e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a73e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.149+0000 7fa531570e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635469e7e50 con 0x563546a6d000 2026-02-20T03:16:09.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.149+0000 7fa531570e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5635469ba9c0 con 0x563546a67630 2026-02-20T03:16:09.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.149+0000 7fa531570e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563546968240 con 0x563546a67fb0 2026-02-20T03:16:09.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52cde0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a67a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52cde0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a67a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48580/0 (socket says 10.20.193.28:48580) 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52cde0640 1 -- 10.20.193.28:0/1907894817 learned_addr learned my addr 10.20.193.28:0/1907894817 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa51ffff640 1 --2- 10.20.193.28:0/1907894817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a73e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52d5e1640 1 --2- 10.20.193.28:0/1907894817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a6d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52cde0640 1 -- 10.20.193.28:0/1907894817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 msgr2=0x563546a73e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52cde0640 1 --2- 10.20.193.28:0/1907894817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a73e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52cde0640 1 -- 10.20.193.28:0/1907894817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 msgr2=0x563546a6d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52cde0640 1 --2- 10.20.193.28:0/1907894817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a6d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52cde0640 1 -- 10.20.193.28:0/1907894817 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354697b420 con 0x563546a67630 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.150+0000 7fa52cde0640 1 --2- 10.20.193.28:0/1907894817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a67a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa518007ce0 tx=0x7fa5180107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=264212965e9ccbe6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa4f54e4640 1 -- 10.20.193.28:0/1907894817 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5180040d0 con 0x563546a67630 2026-02-20T03:16:09.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa4f54e4640 1 -- 10.20.193.28:0/1907894817 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa518015030 con 0x563546a67630 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa4f54e4640 1 -- 10.20.193.28:0/1907894817 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5180040d0 con 0x563546a67630 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa531570e00 1 -- 10.20.193.28:0/1907894817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 msgr2=0x563546a67a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa531570e00 1 --2- 10.20.193.28:0/1907894817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a67a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa518007ce0 tx=0x7fa5180107a0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa531570e00 1 -- 10.20.193.28:0/1907894817 shutdown_connections 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa531570e00 1 --2- 10.20.193.28:0/1907894817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a73e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa531570e00 1 --2- 10.20.193.28:0/1907894817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a67a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa531570e00 1 --2- 10.20.193.28:0/1907894817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a6d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa531570e00 1 -- 10.20.193.28:0/1907894817 >> 10.20.193.28:0/1907894817 conn(0x563546a2a290 msgr2=0x563546a65d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa51dffb640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5040b0ea0 0x7fa5040b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa51dffb640 1 -- 10.20.193.28:0/187057627 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fa5100e0780 con 0x7fa528109ba0 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa531570e00 1 -- 10.20.193.28:0/1907894817 shutdown_connections 2026-02-20T03:16:09.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.151+0000 7fa531570e00 1 -- 10.20.193.28:0/1907894817 wait complete. 2026-02-20T03:16:09.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.152+0000 7fa531570e00 1 -- start start 2026-02-20T03:16:09.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.153+0000 7fa52cde0640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5040b0ea0 0x7fa5040b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.153+0000 7fa531570e00 1 Processor -- start 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.153+0000 7fa52cde0640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5040b0ea0 0x7fa5040b3360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa518007aa0 tx=0x7fa5180023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.153+0000 7fa531570e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a81af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.153+0000 7fa531570e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a82030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.153+0000 7fa531570e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a80230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.153+0000 7fa531570e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635469b68f0 con 0x563546a6d000 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.153+0000 7fa531570e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5635467a8f50 con 0x563546a67630 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.153+0000 7fa531570e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563546a809b0 con 0x563546a67fb0 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52cde0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a81af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52cde0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a81af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48584/0 (socket says 10.20.193.28:48584) 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa51ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a82030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52cde0640 1 -- 10.20.193.28:0/3488118399 learned_addr learned my addr 10.20.193.28:0/3488118399 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52d5e1640 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a80230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52cde0640 1 -- 10.20.193.28:0/3488118399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 msgr2=0x563546a82030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52cde0640 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a82030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52cde0640 1 -- 10.20.193.28:0/3488118399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 msgr2=0x563546a80230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52cde0640 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a80230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52cde0640 1 -- 10.20.193.28:0/3488118399 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563546a79a30 con 0x563546a67630 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa52cde0640 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a81af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa518004460 tx=0x7fa5180078a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d419a7dc706eb26 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa4e67fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.154+0000 7fa4e67fc640 1 -- 10.20.193.28:0/3488118399 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa518004560 con 0x563546a67630 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa4e67fc640 1 -- 10.20.193.28:0/3488118399 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa518004cc0 con 0x563546a67630 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa4e67fc640 1 -- 10.20.193.28:0/3488118399 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa518011660 con 0x563546a67630 2026-02-20T03:16:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 1 -- 10.20.193.28:0/3488118399 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354678bb40 con 0x563546a67630 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa4e67fc640 1 -- 10.20.193.28:0/3488118399 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fa518005000 con 0x563546a67630 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 10 client.25475 _ll_register_callbacks cb 0x5635469f3f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 1 -- 10.20.193.28:0/3488118399 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635469c81a0 con 0x563546a67630 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa4e67fc640 1 -- 10.20.193.28:0/3488118399 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa518005200 con 0x563546a67630 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 10 client.25475 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 1 -- 10.20.193.28:0/3488118399 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x563546975230 con 0x563546a67630 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa4e67fc640 1 -- 10.20.193.28:0/3488118399 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fa5180053a0 con 0x563546a67630 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 10 client.25475 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 10 client.25475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 20 client.25475 populate_metadata read hostname 'trial028' 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563546a901b0 0x563546a925c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 4 client.25475 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.155+0000 7fa531570e00 1 -- 10.20.193.28:0/3488118399 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635469c25b0 con 0x563546a901b0 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.156+0000 7fa51ffff640 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563546a901b0 0x563546a925c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.156+0000 7fa51ffff640 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563546a901b0 0x563546a925c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f10aede544e8fe3a server_cookie=e90745c594d1fcc1 in_seq=0 out_seq=0 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.156+0000 7fa4e67fc640 10 client.25475 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa4e67fc640 1 -- 10.20.193.28:0/3488118399 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5635469c25b0 con 0x563546a901b0 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa4e67fc640 10 client.25475 handle_command_reply: tid=0 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 client.25475 shutdown 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 -- 10.20.193.28:0/3488118399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 msgr2=0x563546a81af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a81af0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa518004460 tx=0x7fa5180078a0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 -- 10.20.193.28:0/3488118399 shutdown_connections 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563546a901b0 0x563546a925c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a80230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a82030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 --2- 10.20.193.28:0/3488118399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67630 0x563546a81af0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 -- 10.20.193.28:0/3488118399 >> 10.20.193.28:0/3488118399 conn(0x563546a2a290 msgr2=0x563546a66440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:09.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa4e67fc640 0 client.25475 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:09.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 -- 10.20.193.28:0/3488118399 shutdown_connections 2026-02-20T03:16:09.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 1 -- 10.20.193.28:0/3488118399 wait complete. 2026-02-20T03:16:09.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.157+0000 7fa531570e00 20 client.25475 trim_cache size 0 max 16384 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.166+0000 7fa531570e00 1 Processor -- start 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.166+0000 7fa531570e00 1 -- start start 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa531570e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67630 0x563546a7f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa531570e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67fb0 0x563546a66520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa531570e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a66a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa531570e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc0122f0 con 0x563546a6d000 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa531570e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc00fbc0 con 0x563546a67fb0 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa531570e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc00da10 con 0x563546a67630 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52d5e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a66a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52d5e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a66a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46350/0 (socket says 10.20.193.28:46350) 2026-02-20T03:16:09.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52d5e1640 1 -- 10.20.193.28:0/423454869 learned_addr learned my addr 10.20.193.28:0/423454869 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52cde0640 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67630 0x563546a7f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa51ffff640 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67fb0 0x563546a66520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52d5e1640 1 -- 10.20.193.28:0/423454869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67630 msgr2=0x563546a7f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52d5e1640 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67630 0x563546a7f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52d5e1640 1 -- 10.20.193.28:0/423454869 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67fb0 msgr2=0x563546a66520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52d5e1640 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67fb0 0x563546a66520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52d5e1640 1 -- 10.20.193.28:0/423454869 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563546a79860 con 0x563546a6d000 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa51ffff640 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67fb0 0x563546a66520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.167+0000 7fa52cde0640 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67630 0x563546a7f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.168+0000 7fa52d5e1640 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a66a60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa524004200 tx=0x7fa52400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db436038dbba6ce0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.168+0000 7fa4f4ce3640 1 -- 10.20.193.28:0/423454869 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524004d40 con 0x563546a6d000 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.168+0000 7fa4f4ce3640 1 -- 10.20.193.28:0/423454869 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa524033040 con 0x563546a6d000 2026-02-20T03:16:09.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.168+0000 7fa4f4ce3640 1 -- 10.20.193.28:0/423454869 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240048b0 con 0x563546a6d000 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 -- 10.20.193.28:0/423454869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 msgr2=0x563546a66a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a66a60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa524004200 tx=0x7fa52400c000 comp rx=0 tx=0).stop 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 -- 10.20.193.28:0/423454869 shutdown_connections 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a6d000 0x563546a66a60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a67fb0 0x563546a66520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 --2- 10.20.193.28:0/423454869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67630 0x563546a7f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 -- 10.20.193.28:0/423454869 >> 10.20.193.28:0/423454869 conn(0x563546a2a290 msgr2=0x563546a7eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 -- 10.20.193.28:0/423454869 shutdown_connections 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 -- 10.20.193.28:0/423454869 wait complete. 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 -- start start 2026-02-20T03:16:09.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.169+0000 7fa531570e00 1 Processor -- start 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa531570e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a67630 0x563546a87d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa531570e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a882b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa531570e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a6d000 0x563546a84a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa531570e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc00e080 con 0x563546a67630 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa531570e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc00f4f0 con 0x563546a6d000 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa531570e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc00e750 con 0x563546a67fb0 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa52d5e1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a6d000 0x563546a84a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa52d5e1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a6d000 0x563546a84a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48600/0 (socket says 10.20.193.28:48600) 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa52d5e1640 1 -- 10.20.193.28:0/316380354 learned_addr learned my addr 10.20.193.28:0/316380354 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa51ffff640 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a882b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa52cde0640 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a67630 0x563546a87d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa52d5e1640 1 -- 10.20.193.28:0/316380354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 msgr2=0x563546a882b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa52d5e1640 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a882b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.170+0000 7fa52d5e1640 1 -- 10.20.193.28:0/316380354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a67630 msgr2=0x563546a87d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa52d5e1640 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a67630 0x563546a87d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa52d5e1640 1 -- 10.20.193.28:0/316380354 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563546699870 con 0x563546a6d000 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa52cde0640 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a67630 0x563546a87d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa52d5e1640 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a6d000 0x563546a84a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa52400c090 tx=0x7fa5240044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a60e7766e74aaea6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa4e67fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa4e67fc640 1 -- 10.20.193.28:0/316380354 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524053020 con 0x563546a6d000 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa4e67fc640 1 -- 10.20.193.28:0/316380354 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa5240076a0 con 0x563546a6d000 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa4e67fc640 1 -- 10.20.193.28:0/316380354 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240446a0 con 0x563546a6d000 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa531570e00 1 -- 10.20.193.28:0/316380354 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354695a440 con 0x563546a6d000 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa4e67fc640 1 -- 10.20.193.28:0/316380354 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fa524044840 con 0x563546a6d000 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa531570e00 10 client.25481 _ll_register_callbacks cb 0x7fa518007b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:09.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.171+0000 7fa531570e00 1 -- 10.20.193.28:0/316380354 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa524033040 con 0x563546a6d000 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa4e67fc640 1 -- 10.20.193.28:0/316380354 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa524050020 con 0x563546a6d000 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa531570e00 10 client.25481 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa531570e00 1 -- 10.20.193.28:0/316380354 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x563546a7a550 con 0x563546a6d000 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa4e67fc640 1 -- 10.20.193.28:0/316380354 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fa524007b10 con 0x563546a6d000 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa531570e00 10 client.25481 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa531570e00 10 client.25481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa531570e00 20 client.25481 populate_metadata read hostname 'trial028' 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa531570e00 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563546afbf80 0x563546afe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa531570e00 4 client.25481 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa531570e00 1 -- 10.20.193.28:0/316380354 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5635469c25b0 con 0x563546afbf80 2026-02-20T03:16:09.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.172+0000 7fa52cde0640 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563546afbf80 0x563546afe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa52cde0640 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563546afbf80 0x563546afe440 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a8084ef4d2f13b2 server_cookie=de3f64782ec028cb in_seq=0 out_seq=0 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa4e67fc640 10 client.25481 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa4e67fc640 1 -- 10.20.193.28:0/316380354 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5635469c25b0 con 0x563546afbf80 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa4e67fc640 10 client.25481 handle_command_reply: tid=0 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 client.25481 shutdown 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 -- 10.20.193.28:0/316380354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a6d000 msgr2=0x563546a84a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a6d000 0x563546a84a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa52400c090 tx=0x7fa5240044b0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 -- 10.20.193.28:0/316380354 shutdown_connections 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563546afbf80 0x563546afe440 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563546a6d000 0x563546a84a70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563546a67fb0 0x563546a882b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 --2- 10.20.193.28:0/316380354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563546a67630 0x563546a87d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa4e67fc640 0 client.25481 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 -- 10.20.193.28:0/316380354 >> 10.20.193.28:0/316380354 conn(0x563546a2a290 msgr2=0x563546a7f310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 -- 10.20.193.28:0/316380354 shutdown_connections 2026-02-20T03:16:09.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 1 -- 10.20.193.28:0/316380354 wait complete. 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.173+0000 7fa531570e00 20 client.25481 trim_cache size 0 max 16384 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 -- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5040b0ea0 msgr2=0x7fa5040b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5040b0ea0 0x7fa5040b3360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa518007aa0 tx=0x7fa5180023d0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 -- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 msgr2=0x7fa5281a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 0x7fa5281a1a50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa51000d950 tx=0x7fa51000de20 comp rx=0 tx=0).stop 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 -- 10.20.193.28:0/187057627 shutdown_connections 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa5040b0ea0 0x7fa5040b3360 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa52810eef0 0x7fa5281a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa528109ba0 0x7fa5281a1a50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 --2- 10.20.193.28:0/187057627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa528109220 0x7fa5281a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 -- 10.20.193.28:0/187057627 >> 10.20.193.28:0/187057627 conn(0x7fa528078600 msgr2=0x7fa528079d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 -- 10.20.193.28:0/187057627 shutdown_connections 2026-02-20T03:16:09.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.174+0000 7fa52dde2640 1 -- 10.20.193.28:0/187057627 wait complete. 2026-02-20T03:16:09.254 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:09 trial028 ceph-mon[38552]: pgmap v222: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2026-02-20T03:16:09.279 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:16:09.279 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:16:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:09 trial177 ceph-mon[43181]: pgmap v222: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2026-02-20T03:16:09.554 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:09.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:09 trial126 ceph-mon[38476]: pgmap v222: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2026-02-20T03:16:09.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.748+0000 7ff713fff640 1 -- 10.20.193.28:0/167711801 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff718038470 con 0x7ff7241049a0 2026-02-20T03:16:09.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.748+0000 7ff72a49c640 1 -- 10.20.193.28:0/167711801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7241049a0 msgr2=0x7ff724104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.748+0000 7ff72a49c640 1 --2- 10.20.193.28:0/167711801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7241049a0 0x7ff724104e00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff718009a60 tx=0x7ff71802f250 comp rx=0 tx=0).stop 2026-02-20T03:16:09.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.748+0000 7ff72a49c640 1 -- 10.20.193.28:0/167711801 shutdown_connections 2026-02-20T03:16:09.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.748+0000 7ff72a49c640 1 --2- 10.20.193.28:0/167711801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff724105340 0x7ff724111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.748+0000 7ff72a49c640 1 --2- 10.20.193.28:0/167711801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7241049a0 0x7ff724104e00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.748+0000 7ff72a49c640 1 --2- 10.20.193.28:0/167711801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff72410a9a0 0x7ff72410ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.748+0000 7ff72a49c640 1 -- 10.20.193.28:0/167711801 >> 10.20.193.28:0/167711801 conn(0x7ff7241006c0 msgr2=0x7ff724102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:09.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.749+0000 7ff72a49c640 1 -- 10.20.193.28:0/167711801 shutdown_connections 2026-02-20T03:16:09.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.749+0000 7ff72a49c640 1 -- 10.20.193.28:0/167711801 wait complete. 2026-02-20T03:16:09.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.749+0000 7ff72a49c640 1 Processor -- start 2026-02-20T03:16:09.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.749+0000 7ff72a49c640 1 -- start start 2026-02-20T03:16:09.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff72a49c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7241049a0 0x7ff7241116c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff72a49c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff724105340 0x7ff72410e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff72a49c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff72410a9a0 0x7ff72410ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff72a49c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff724114bc0 con 0x7ff7241049a0 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff72a49c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff724114a40 con 0x7ff724105340 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff72a49c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff724114d40 con 0x7ff72410a9a0 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff72949a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7241049a0 0x7ff7241116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff72949a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7241049a0 0x7ff7241116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46364/0 (socket says 10.20.193.28:46364) 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff72949a640 1 -- 10.20.193.28:0/1877890867 learned_addr learned my addr 10.20.193.28:0/1877890867 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff729c9b640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff72410a9a0 0x7ff72410ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.750+0000 7ff728c99640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff724105340 0x7ff72410e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff72949a640 1 -- 10.20.193.28:0/1877890867 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff72410a9a0 msgr2=0x7ff72410ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff72949a640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff72410a9a0 0x7ff72410ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff72949a640 1 -- 10.20.193.28:0/1877890867 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff724105340 msgr2=0x7ff72410e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff72949a640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff724105340 0x7ff72410e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff72949a640 1 -- 10.20.193.28:0/1877890867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72410f5b0 con 0x7ff7241049a0 2026-02-20T03:16:09.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff729c9b640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff72410a9a0 0x7ff72410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:09.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff72949a640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7241049a0 0x7ff7241116c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff71400ea30 tx=0x7ff71400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:09.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff7127fc640 1 -- 10.20.193.28:0/1877890867 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71400ce50 con 0x7ff7241049a0 2026-02-20T03:16:09.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7241adb40 con 0x7ff7241049a0 2026-02-20T03:16:09.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7241ae080 con 0x7ff7241049a0 2026-02-20T03:16:09.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff7127fc640 1 -- 10.20.193.28:0/1877890867 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff714004570 con 0x7ff7241049a0 2026-02-20T03:16:09.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.751+0000 7ff7127fc640 1 -- 10.20.193.28:0/1877890867 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714010690 con 0x7ff7241049a0 2026-02-20T03:16:09.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.752+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7241060e0 con 0x7ff7241049a0 2026-02-20T03:16:09.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.754+0000 7ff7127fc640 1 -- 10.20.193.28:0/1877890867 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff7140040d0 con 0x7ff7241049a0 2026-02-20T03:16:09.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.756+0000 7ff7127fc640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7000b0e20 0x7ff7000b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:09.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.756+0000 7ff7127fc640 1 -- 10.20.193.28:0/1877890867 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7ff7140e0f70 con 0x7ff7241049a0 2026-02-20T03:16:09.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.756+0000 7ff728c99640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7000b0e20 0x7ff7000b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:09.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.756+0000 7ff7127fc640 1 -- 10.20.193.28:0/1877890867 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff7140e13f0 con 0x7ff7241049a0 2026-02-20T03:16:09.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.757+0000 7ff728c99640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7000b0e20 0x7ff7000b32e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff72410ff30 tx=0x7ff71803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:09.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.865+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7240786e0 con 0x7ff7241049a0 2026-02-20T03:16:09.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.865+0000 7ff7127fc640 1 -- 10.20.193.28:0/1877890867 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7ff7140a9440 con 0x7ff7241049a0 2026-02-20T03:16:09.868 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:16:09.869 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T03:15:38:113153+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:37.375812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:16:09.869 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T03:16:09.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7000b0e20 msgr2=0x7ff7000b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7000b0e20 0x7ff7000b32e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff72410ff30 tx=0x7ff71803a040 comp rx=0 tx=0).stop 2026-02-20T03:16:09.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7241049a0 msgr2=0x7ff7241116c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:09.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7241049a0 0x7ff7241116c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff71400ea30 tx=0x7ff71400ef00 comp rx=0 tx=0).stop 2026-02-20T03:16:09.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 shutdown_connections 2026-02-20T03:16:09.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7000b0e20 0x7ff7000b32e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff72410a9a0 0x7ff72410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff724105340 0x7ff72410e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 --2- 10.20.193.28:0/1877890867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7241049a0 0x7ff7241116c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:09.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.867+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 >> 10.20.193.28:0/1877890867 conn(0x7ff7241006c0 msgr2=0x7ff724100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:09.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.868+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 shutdown_connections 2026-02-20T03:16:09.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:09.868+0000 7ff72a49c640 1 -- 10.20.193.28:0/1877890867 wait complete. 2026-02-20T03:16:09.977 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:16:10.250 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:10.250 INFO:tasks.workunit.client.0.trial028.stderr:Note: switching to 'f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03'. 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr:state without impacting any branches by switching back to a branch. 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr: git switch -c 2026-02-20T03:16:10.251 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T03:16:10.252 INFO:tasks.workunit.client.0.trial028.stderr:Or undo this operation with: 2026-02-20T03:16:10.252 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T03:16:10.252 INFO:tasks.workunit.client.0.trial028.stderr: git switch - 2026-02-20T03:16:10.252 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T03:16:10.252 INFO:tasks.workunit.client.0.trial028.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-20T03:16:10.252 INFO:tasks.workunit.client.0.trial028.stderr: 2026-02-20T03:16:10.252 INFO:tasks.workunit.client.0.trial028.stderr:HEAD is now at f4ef35d9be5 Merge PR #63023 into wip-jcollin-testing-20260218.004834-squid 2026-02-20T03:16:10.269 DEBUG:teuthology.orchestra.run.trial028:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-20T03:16:10.308 INFO:tasks.workunit.client.0.trial028.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-20T03:16:10.312 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T03:16:10.312 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-20T03:16:10.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.442+0000 7f53a7fff640 1 -- 10.20.193.28:0/3165111753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53a810eef0 msgr2=0x7f53a810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:10.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.442+0000 7f53a7fff640 1 --2- 10.20.193.28:0/3165111753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53a810eef0 0x7f53a810f2d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f539c009a30 tx=0x7f539c02f220 comp rx=0 tx=0).stop 2026-02-20T03:16:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.442+0000 7f53a7fff640 1 -- 10.20.193.28:0/3165111753 shutdown_connections 2026-02-20T03:16:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.442+0000 7f53a7fff640 1 --2- 10.20.193.28:0/3165111753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53a8109ba0 0x7f53a8115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.442+0000 7f53a7fff640 1 --2- 10.20.193.28:0/3165111753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53a8109220 0x7f53a8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.442+0000 7f53a7fff640 1 --2- 10.20.193.28:0/3165111753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53a810eef0 0x7f53a810f2d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.442+0000 7f53a7fff640 1 -- 10.20.193.28:0/3165111753 >> 10.20.193.28:0/3165111753 conn(0x7f53a8078600 msgr2=0x7f53a807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:10.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.443+0000 7f53a7fff640 1 -- 10.20.193.28:0/3165111753 shutdown_connections 2026-02-20T03:16:10.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:10 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1877890867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:10.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.444+0000 7f53a7fff640 1 -- 10.20.193.28:0/3165111753 wait complete. 2026-02-20T03:16:10.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.444+0000 7f53a7fff640 1 Processor -- start 2026-02-20T03:16:10.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.444+0000 7f53a7fff640 1 -- start start 2026-02-20T03:16:10.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53a8109220 0x7f53a81a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53a8109ba0 0x7f53a81a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53a810eef0 0x7f53a81a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53a8119030 con 0x7f53a810eef0 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a7fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f53a8118eb0 con 0x7f53a8109ba0 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a7fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53a81191b0 con 0x7f53a8109220 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53a8109220 0x7f53a81a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53a8109220 0x7f53a81a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56702/0 (socket says 10.20.193.28:56702) 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a6ffd640 1 -- 10.20.193.28:0/2429467618 learned_addr learned my addr 10.20.193.28:0/2429467618 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a67fc640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53a8109ba0 0x7f53a81a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a77fe640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53a810eef0 0x7f53a81a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a6ffd640 1 -- 10.20.193.28:0/2429467618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53a8109ba0 msgr2=0x7f53a81a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53a8109ba0 0x7f53a81a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a6ffd640 1 -- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53a810eef0 msgr2=0x7f53a81a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:10.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53a810eef0 0x7f53a81a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.445+0000 7f53a6ffd640 1 -- 10.20.193.28:0/2429467618 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a81a6560 con 0x7f53a8109220 2026-02-20T03:16:10.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.446+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53a8109220 0x7f53a81a1510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f539c009b60 tx=0x7f539c02fdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:10.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.446+0000 7f53ac8e3640 1 -- 10.20.193.28:0/2429467618 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c004440 con 0x7f53a8109220 2026-02-20T03:16:10.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.446+0000 7f53ac8e3640 1 -- 10.20.193.28:0/2429467618 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f539c03e070 con 0x7f53a8109220 2026-02-20T03:16:10.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.446+0000 7f53a7fff640 1 -- 10.20.193.28:0/2429467618 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a81a67f0 con 0x7f53a8109220 2026-02-20T03:16:10.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.446+0000 7f53ac8e3640 1 -- 10.20.193.28:0/2429467618 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c038830 con 0x7f53a8109220 2026-02-20T03:16:10.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.446+0000 7f53a7fff640 1 -- 10.20.193.28:0/2429467618 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a81ae090 con 0x7f53a8109220 2026-02-20T03:16:10.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.449+0000 7f53ac8e3640 1 -- 10.20.193.28:0/2429467618 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f539c04b030 con 0x7f53a8109220 2026-02-20T03:16:10.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.449+0000 7f53afdeae00 1 Processor -- start 2026-02-20T03:16:10.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.449+0000 7f53afdeae00 1 -- start start 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b388fb0 0x557a3b389390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b383a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b383f60 0x557a3b38fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53afdeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557a3b303e00 con 0x557a3b388fb0 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53afdeae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557a3b2d6970 con 0x557a3b383f60 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53afdeae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557a3b2841f0 con 0x557a3b3835e0 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b383a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b388fb0 0x557a3b389390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a67fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b383f60 0x557a3b38fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b388fb0 0x557a3b389390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46388/0 (socket says 10.20.193.28:46388) 2026-02-20T03:16:10.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a77fe640 1 -- 10.20.193.28:0/838324906 learned_addr learned my addr 10.20.193.28:0/838324906 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:10.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53ac8e3640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f537c0b0ea0 0x7f537c0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53ac8e3640 1 -- 10.20.193.28:0/2429467618 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f539c105da0 con 0x7f53a8109220 2026-02-20T03:16:10.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a67fc640 1 -- 10.20.193.28:0/838324906 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 msgr2=0x557a3b383a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:10.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a67fc640 1 --2- 10.20.193.28:0/838324906 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b383a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a67fc640 1 -- 10.20.193.28:0/838324906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b388fb0 msgr2=0x557a3b389390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a67fc640 1 --2- 10.20.193.28:0/838324906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b388fb0 0x557a3b389390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.450+0000 7f53a67fc640 1 -- 10.20.193.28:0/838324906 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3b2973d0 con 0x557a3b383f60 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53a77fe640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f537c0b0ea0 0x7f537c0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53a67fc640 1 --2- 10.20.193.28:0/838324906 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b383f60 0x557a3b38fde0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5390007c20 tx=0x7f53900107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=367bbc7111361ab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f536bfff640 1 -- 10.20.193.28:0/838324906 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53900040d0 con 0x557a3b383f60 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f536bfff640 1 -- 10.20.193.28:0/838324906 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5390015030 con 0x557a3b383f60 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f536bfff640 1 -- 10.20.193.28:0/838324906 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53900116a0 con 0x557a3b383f60 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53afdeae00 1 -- 10.20.193.28:0/838324906 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b383f60 msgr2=0x557a3b38fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53afdeae00 1 --2- 10.20.193.28:0/838324906 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b383f60 0x557a3b38fde0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5390007c20 tx=0x7f53900107a0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53a77fe640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f537c0b0ea0 0x7f537c0b3360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5398002c60 tx=0x7f5398004bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:10.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53afdeae00 1 -- 10.20.193.28:0/838324906 shutdown_connections 2026-02-20T03:16:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53afdeae00 1 --2- 10.20.193.28:0/838324906 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b383f60 0x557a3b38fde0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53afdeae00 1 --2- 10.20.193.28:0/838324906 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b383a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53afdeae00 1 --2- 10.20.193.28:0/838324906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b388fb0 0x557a3b389390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53afdeae00 1 -- 10.20.193.28:0/838324906 >> 10.20.193.28:0/838324906 conn(0x557a3b346240 msgr2=0x557a3b381ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53afdeae00 1 -- 10.20.193.28:0/838324906 shutdown_connections 2026-02-20T03:16:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.451+0000 7f53afdeae00 1 -- 10.20.193.28:0/838324906 wait complete. 2026-02-20T03:16:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.453+0000 7f53afdeae00 1 -- start start 2026-02-20T03:16:10.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.453+0000 7f53afdeae00 1 Processor -- start 2026-02-20T03:16:10.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.453+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b39db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.453+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b39e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.453+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b388fb0 0x557a3b39c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.453+0000 7f53afdeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557a3b2d28a0 con 0x557a3b383f60 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.453+0000 7f53afdeae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557a3b0c4f50 con 0x557a3b388fb0 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.453+0000 7f53afdeae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557a3b39c9f0 con 0x557a3b3835e0 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b39db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b39db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56732/0 (socket says 10.20.193.28:56732) 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a6ffd640 1 -- 10.20.193.28:0/935089498 learned_addr learned my addr 10.20.193.28:0/935089498 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a77fe640 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b388fb0 0x557a3b39c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a67fc640 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b39e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a6ffd640 1 -- 10.20.193.28:0/935089498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b388fb0 msgr2=0x557a3b39c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b388fb0 0x557a3b39c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a6ffd640 1 -- 10.20.193.28:0/935089498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 msgr2=0x557a3b39e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b39e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a6ffd640 1 -- 10.20.193.28:0/935089498 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3b3959e0 con 0x557a3b3835e0 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a67fc640 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b39e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.454+0000 7f53a77fe640 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b388fb0 0x557a3b39c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b39db30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f539c009a00 tx=0x7f539c03e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f681bffaa6c2be8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53697fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53697fa640 1 -- 10.20.193.28:0/935089498 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c10d040 con 0x557a3b3835e0 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53697fa640 1 -- 10.20.193.28:0/935089498 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f539c033040 con 0x557a3b3835e0 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53697fa640 1 -- 10.20.193.28:0/935089498 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c0f41c0 con 0x557a3b3835e0 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53afdeae00 1 -- 10.20.193.28:0/935089498 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3b0a7b40 con 0x557a3b3835e0 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53697fa640 1 -- 10.20.193.28:0/935089498 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f539c0d4130 con 0x557a3b3835e0 2026-02-20T03:16:10.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53697fa640 10 client.25471 inactive, discarding osd_map(91..91 src has 1..91) 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53afdeae00 10 client.25471 _ll_register_callbacks cb 0x557a3b30feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53afdeae00 1 -- 10.20.193.28:0/935089498 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a3b2e4150 con 0x557a3b3835e0 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53697fa640 1 -- 10.20.193.28:0/935089498 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f539c0ce270 con 0x557a3b3835e0 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53afdeae00 10 client.25471 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.455+0000 7f53afdeae00 1 -- 10.20.193.28:0/935089498 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x557a3b2911e0 con 0x557a3b3835e0 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.456+0000 7f53697fa640 1 -- 10.20.193.28:0/935089498 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f539c0ccb80 con 0x557a3b3835e0 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.456+0000 7f53afdeae00 10 client.25471 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.456+0000 7f53afdeae00 10 client.25471 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.456+0000 7f53afdeae00 20 client.25471 populate_metadata read hostname 'trial028' 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.456+0000 7f53afdeae00 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557a3b3ac160 0x557a3b3ae620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.456+0000 7f53afdeae00 4 client.25471 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.456+0000 7f53afdeae00 1 -- 10.20.193.28:0/935089498 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a3b2de560 con 0x557a3b3ac160 2026-02-20T03:16:10.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.456+0000 7f53a67fc640 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557a3b3ac160 0x557a3b3ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.457+0000 7f53697fa640 10 client.25471 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.457+0000 7f53a67fc640 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557a3b3ac160 0x557a3b3ae620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=785e769aa2015d85 server_cookie=a0cfada3c1e58de7 in_seq=0 out_seq=0 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.457+0000 7f53697fa640 1 -- 10.20.193.28:0/935089498 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557a3b2de560 con 0x557a3b3ac160 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.457+0000 7f53697fa640 10 client.25471 handle_command_reply: tid=0 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.457+0000 7f53afdeae00 1 client.25471 shutdown 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.457+0000 7f53afdeae00 1 -- 10.20.193.28:0/935089498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 msgr2=0x557a3b39db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.457+0000 7f53afdeae00 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b39db30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f539c009a00 tx=0x7f539c03e000 comp rx=0 tx=0).stop 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53afdeae00 1 -- 10.20.193.28:0/935089498 shutdown_connections 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53afdeae00 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b388fb0 0x557a3b39c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53afdeae00 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557a3b3ac160 0x557a3b3ae620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53afdeae00 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b39e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53afdeae00 1 --2- 10.20.193.28:0/935089498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b3835e0 0x557a3b39db30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53afdeae00 1 -- 10.20.193.28:0/935089498 >> 10.20.193.28:0/935089498 conn(0x557a3b346240 msgr2=0x557a3b3823f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:10.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53697fa640 0 client.25471 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:16:10.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53afdeae00 1 -- 10.20.193.28:0/935089498 shutdown_connections 2026-02-20T03:16:10.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53afdeae00 1 -- 10.20.193.28:0/935089498 wait complete. 2026-02-20T03:16:10.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.458+0000 7f53afdeae00 20 client.25471 trim_cache size 0 max 16384 2026-02-20T03:16:10.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:10 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1877890867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:10.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53afdeae00 1 Processor -- start 2026-02-20T03:16:10.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53afdeae00 1 -- start start 2026-02-20T03:16:10.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 0x557a3b37bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3824d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b382a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53afdeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f534c012240 con 0x557a3b383f60 2026-02-20T03:16:10.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53afdeae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f534c00fb10 con 0x557a3b3835e0 2026-02-20T03:16:10.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53afdeae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f534c00d960 con 0x557a3b388fb0 2026-02-20T03:16:10.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53a6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 0x557a3b37bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53a77fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b382a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53a77fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b382a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56742/0 (socket says 10.20.193.28:56742) 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.465+0000 7f53a77fe640 1 -- 10.20.193.28:0/3520703381 learned_addr learned my addr 10.20.193.28:0/3520703381 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f53a67fc640 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3824d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f53a77fe640 1 -- 10.20.193.28:0/3520703381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 msgr2=0x557a3b37bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f53a77fe640 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 0x557a3b37bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f53a77fe640 1 -- 10.20.193.28:0/3520703381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 msgr2=0x557a3b3824d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f53a77fe640 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3824d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f53a77fe640 1 -- 10.20.193.28:0/3520703381 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3b39c5e0 con 0x557a3b388fb0 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 0x557a3b37bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f53a67fc640 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3824d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:10.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f53a77fe640 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b382a10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53980042d0 tx=0x7f5398017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fdad902d250fed9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:10.471 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-20T03:16:10.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f536b7fe640 1 -- 10.20.193.28:0/3520703381 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539801a110 con 0x557a3b388fb0 2026-02-20T03:16:10.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f536b7fe640 1 -- 10.20.193.28:0/3520703381 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f539801a2b0 con 0x557a3b388fb0 2026-02-20T03:16:10.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.466+0000 7f536b7fe640 1 -- 10.20.193.28:0/3520703381 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980263d0 con 0x557a3b388fb0 2026-02-20T03:16:10.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.467+0000 7f53afdeae00 1 -- 10.20.193.28:0/3520703381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 msgr2=0x557a3b382a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:10.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.467+0000 7f53afdeae00 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b382a10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53980042d0 tx=0x7f5398017000 comp rx=0 tx=0).stop 2026-02-20T03:16:10.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.467+0000 7f53afdeae00 1 -- 10.20.193.28:0/3520703381 shutdown_connections 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.467+0000 7f53afdeae00 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b382a10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.467+0000 7f53afdeae00 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3824d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.467+0000 7f53afdeae00 1 --2- 10.20.193.28:0/3520703381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 0x557a3b37bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.467+0000 7f53afdeae00 1 -- 10.20.193.28:0/3520703381 >> 10.20.193.28:0/3520703381 conn(0x557a3b346240 msgr2=0x557a3b39b330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.467+0000 7f53afdeae00 1 -- 10.20.193.28:0/3520703381 shutdown_connections 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.467+0000 7f53afdeae00 1 -- 10.20.193.28:0/3520703381 wait complete. 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53afdeae00 1 -- start start 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53afdeae00 1 Processor -- start 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 0x557a3b3a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53afdeae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b3a5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53afdeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f534c00dfd0 con 0x557a3b383f60 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53afdeae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f534c00f440 con 0x557a3b3835e0 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53afdeae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f534c00e6a0 con 0x557a3b388fb0 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53a67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53a67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3a4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46424/0 (socket says 10.20.193.28:46424) 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53a67fc640 1 -- 10.20.193.28:0/1140800307 learned_addr learned my addr 10.20.193.28:0/1140800307 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 0x557a3b3a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.468+0000 7f53a77fe640 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b3a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53a67fc640 1 -- 10.20.193.28:0/1140800307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 msgr2=0x557a3b3a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53a67fc640 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b3a5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53a67fc640 1 -- 10.20.193.28:0/1140800307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 msgr2=0x557a3b3a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53a67fc640 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 0x557a3b3a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53a67fc640 1 -- 10.20.193.28:0/1140800307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a3b395810 con 0x557a3b383f60 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53a77fe640 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b3a5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53a67fc640 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3a4ef0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f53900074b0 tx=0x7f5390005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac49d2e7945f0b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53697fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53697fa640 1 -- 10.20.193.28:0/1140800307 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390002820 con 0x557a3b383f60 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53afdeae00 1 -- 10.20.193.28:0/1140800307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a3afb5870 con 0x557a3b383f60 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53afdeae00 10 client.15435 _ll_register_callbacks cb 0x7f539c0c9120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53afdeae00 1 -- 10.20.193.28:0/1140800307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f539801a2b0 con 0x557a3b383f60 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53697fa640 1 -- 10.20.193.28:0/1140800307 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f539801a2b0 con 0x557a3b383f60 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53697fa640 1 -- 10.20.193.28:0/1140800307 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390011860 con 0x557a3b383f60 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.469+0000 7f53697fa640 1 -- 10.20.193.28:0/1140800307 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f5390011a00 con 0x557a3b383f60 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53697fa640 1 -- 10.20.193.28:0/1140800307 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5390011d20 con 0x557a3b383f60 2026-02-20T03:16:10.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53afdeae00 10 client.15435 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53afdeae00 1 -- 10.20.193.28:0/1140800307 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x557a3b2763f0 con 0x557a3b383f60 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53697fa640 1 -- 10.20.193.28:0/1140800307 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f5390002ce0 con 0x557a3b383f60 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53afdeae00 10 client.15435 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53afdeae00 10 client.15435 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53afdeae00 20 client.15435 populate_metadata read hostname 'trial028' 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53afdeae00 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557a3b419490 0x557a3b41b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53afdeae00 4 client.15435 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53afdeae00 1 -- 10.20.193.28:0/1140800307 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a3b2de560 con 0x557a3b419490 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.470+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557a3b419490 0x557a3b41b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53a6ffd640 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557a3b419490 0x557a3b41b950 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5e1e7bf5ce401e40 server_cookie=c4f5c145b0f3c91c in_seq=0 out_seq=0 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53697fa640 10 client.15435 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:16:10.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53697fa640 1 -- 10.20.193.28:0/1140800307 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a3b2de560 con 0x557a3b419490 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53697fa640 10 client.15435 handle_command_reply: tid=0 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 client.15435 shutdown 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 -- 10.20.193.28:0/1140800307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 msgr2=0x557a3b3a4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3a4ef0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f53900074b0 tx=0x7f5390005d20 comp rx=0 tx=0).stop 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 -- 10.20.193.28:0/1140800307 shutdown_connections 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557a3b388fb0 0x557a3b3a5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557a3b419490 0x557a3b41b950 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557a3b383f60 0x557a3b3a4ef0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 --2- 10.20.193.28:0/1140800307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557a3b3835e0 0x557a3b3a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 -- 10.20.193.28:0/1140800307 >> 10.20.193.28:0/1140800307 conn(0x557a3b346240 msgr2=0x557a3b3a0990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53697fa640 0 client.15435 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:16:10.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 -- 10.20.193.28:0/1140800307 shutdown_connections 2026-02-20T03:16:10.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 1 -- 10.20.193.28:0/1140800307 wait complete. 2026-02-20T03:16:10.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.471+0000 7f53afdeae00 20 client.15435 trim_cache size 0 max 16384 2026-02-20T03:16:10.480 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 -- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f537c0b0ea0 msgr2=0x7f537c0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f537c0b0ea0 0x7f537c0b3360 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5398002c60 tx=0x7f5398004bb0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 -- 10.20.193.28:0/2429467618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53a8109220 msgr2=0x7f53a81a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53a8109220 0x7f53a81a1510 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f539c009b60 tx=0x7f539c02fdd0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 -- 10.20.193.28:0/2429467618 shutdown_connections 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f537c0b0ea0 0x7f537c0b3360 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53a810eef0 0x7f53a81a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53a8109ba0 0x7f53a81a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 --2- 10.20.193.28:0/2429467618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53a8109220 0x7f53a81a1510 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 -- 10.20.193.28:0/2429467618 >> 10.20.193.28:0/2429467618 conn(0x7f53a8078600 msgr2=0x7f53a807a020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:10.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 -- 10.20.193.28:0/2429467618 shutdown_connections 2026-02-20T03:16:10.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:10.472+0000 7f53a7fff640 1 -- 10.20.193.28:0/2429467618 wait complete. 2026-02-20T03:16:10.541 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-20T03:16:10.595 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-20T03:16:10.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:10 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1877890867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:10.598 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T03:16:10.598 INFO:tasks.workunit.client.0.trial028.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-20T03:16:10.614 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:16:10.653 INFO:tasks.workunit.client.0.trial028.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-20T03:16:10.660 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:16:10.660 DEBUG:teuthology.orchestra.run.trial028:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-20T03:16:10.740 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2026-02-20T03:16:10.742 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2026-02-20T03:16:10.742 DEBUG:teuthology.orchestra.run.trial028:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2026-02-20T03:16:10.921 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.108+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1111579865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc8105750 msgr2=0x7fbcc81097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.108+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1111579865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc8105750 0x7fbcc81097a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbcb0009a30 tx=0x7fbcb002f220 comp rx=0 tx=0).stop 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.108+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1111579865 shutdown_connections 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.108+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1111579865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc8109ed0 0x7fbcc8111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.108+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1111579865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc8105750 0x7fbcc81097a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.108+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1111579865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc8104da0 0x7fbcc8105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.108+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1111579865 >> 10.20.193.28:0/1111579865 conn(0x7fbcc8100840 msgr2=0x7fbcc8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.108+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1111579865 shutdown_connections 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.108+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1111579865 wait complete. 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.109+0000 7fbcccaa0640 1 Processor -- start 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.109+0000 7fbcccaa0640 1 -- start start 2026-02-20T03:16:11.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.109+0000 7fbcccaa0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc8104da0 0x7fbcc819d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.109+0000 7fbcccaa0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc8105750 0x7fbcc819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.109+0000 7fbcccaa0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc8109ed0 0x7fbcc81a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.109+0000 7fbcccaa0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc8114d60 con 0x7fbcc8109ed0 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.109+0000 7fbcccaa0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc8114be0 con 0x7fbcc8105750 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.109+0000 7fbcccaa0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc8114ee0 con 0x7fbcc8104da0 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc8104da0 0x7fbcc819d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc8104da0 0x7fbcc819d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56768/0 (socket says 10.20.193.28:56768) 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc8109ed0 0x7fbcc81a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6575640 1 -- 10.20.193.28:0/1561602858 learned_addr learned my addr 10.20.193.28:0/1561602858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc5d74640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc8105750 0x7fbcc819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6575640 1 -- 10.20.193.28:0/1561602858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc8105750 msgr2=0x7fbcc819d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6575640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc8105750 0x7fbcc819d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6575640 1 -- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc8109ed0 msgr2=0x7fbcc81a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6575640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc8109ed0 0x7fbcc81a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6575640 1 -- 10.20.193.28:0/1561602858 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc81a2290 con 0x7fbcc8104da0 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc8109ed0 0x7fbcc81a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcc6575640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc8104da0 0x7fbcc819d240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00ea10 tx=0x7fbcbc00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcaf7fe640 1 -- 10.20.193.28:0/1561602858 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00ce50 con 0x7fbcc8104da0 2026-02-20T03:16:11.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcaf7fe640 1 -- 10.20.193.28:0/1561602858 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbcbc004570 con 0x7fbcc8104da0 2026-02-20T03:16:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.110+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1561602858 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc81a2580 con 0x7fbcc8104da0 2026-02-20T03:16:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.111+0000 7fbcaf7fe640 1 -- 10.20.193.28:0/1561602858 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc010690 con 0x7fbcc8104da0 2026-02-20T03:16:11.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.111+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1561602858 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc81a9dc0 con 0x7fbcc8104da0 2026-02-20T03:16:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbcaf7fe640 1 -- 10.20.193.28:0/1561602858 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbcbc020030 con 0x7fbcc8104da0 2026-02-20T03:16:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbccefa5e00 1 Processor -- start 2026-02-20T03:16:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbccefa5e00 1 -- start start 2026-02-20T03:16:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d5f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 0x55856d5f9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f9aa0 0x55856d601640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbccefa5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55856d56ce00 con 0x55856d5f59a0 2026-02-20T03:16:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbccefa5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55856d53f970 con 0x55856d5f4ff0 2026-02-20T03:16:11.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbccefa5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55856d4ed1f0 con 0x55856d5f9aa0 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbcc6d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d5f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbcc6d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d5f53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48696/0 (socket says 10.20.193.28:48696) 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbcc6d76640 1 -- 10.20.193.28:0/3383712455 learned_addr learned my addr 10.20.193.28:0/3383712455 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.114+0000 7fbcc5d74640 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f9aa0 0x55856d601640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcc6d76640 1 -- 10.20.193.28:0/3383712455 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f9aa0 msgr2=0x55856d601640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f9aa0 0x55856d601640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcc6d76640 1 -- 10.20.193.28:0/3383712455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 msgr2=0x55856d5f9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcc6575640 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 0x55856d5f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 0x55856d5f9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcc6d76640 1 -- 10.20.193.28:0/3383712455 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d5003d0 con 0x55856d5f4ff0 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcc6575640 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 0x55856d5f9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d5f53d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009420 tx=0x7fbcb8009130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c03b3268dbeb6160 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcaf7fe640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca00b0f40 0x7fbca00b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcaf7fe640 1 -- 10.20.193.28:0/1561602858 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fbcbc0e0c40 con 0x7fbcc8104da0 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcaccf3640 1 -- 10.20.193.28:0/3383712455 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8002c60 con 0x55856d5f4ff0 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcaccf3640 1 -- 10.20.193.28:0/3383712455 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbcb801a070 con 0x55856d5f4ff0 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.115+0000 7fbcaccf3640 1 -- 10.20.193.28:0/3383712455 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8004700 con 0x55856d5f4ff0 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbcc6575640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca00b0f40 0x7fbca00b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3383712455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 msgr2=0x55856d5f53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d5f53d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009420 tx=0x7fbcb8009130 comp rx=0 tx=0).stop 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3383712455 shutdown_connections 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f9aa0 0x55856d601640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 0x55856d5f9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3383712455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d5f53d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3383712455 >> 10.20.193.28:0/3383712455 conn(0x55856d5af240 msgr2=0x55856d5f36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3383712455 shutdown_connections 2026-02-20T03:16:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbcc6575640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca00b0f40 0x7fbca00b3400 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0a8710 tx=0x7fbcbc002c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.116+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3383712455 wait complete. 2026-02-20T03:16:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.117+0000 7fbccefa5e00 1 -- start start 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.117+0000 7fbccefa5e00 1 Processor -- start 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f4ff0 0x55856d60f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 0x55856d60fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f9aa0 0x55856d60ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbccefa5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55856d53b8a0 con 0x55856d5f4ff0 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbccefa5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55856d32df50 con 0x55856d5f9aa0 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbccefa5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55856d60e550 con 0x55856d5f59a0 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f4ff0 0x55856d60f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f4ff0 0x55856d60f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46452/0 (socket says 10.20.193.28:46452) 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc6d76640 1 -- 10.20.193.28:0/3668670892 learned_addr learned my addr 10.20.193.28:0/3668670892 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f9aa0 0x55856d60ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc5d74640 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 0x55856d60fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc6d76640 1 -- 10.20.193.28:0/3668670892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 msgr2=0x55856d60fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 0x55856d60fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc6d76640 1 -- 10.20.193.28:0/3668670892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f9aa0 msgr2=0x55856d60ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f9aa0 0x55856d60ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.118+0000 7fbcc6d76640 1 -- 10.20.193.28:0/3668670892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d607240 con 0x55856d5f4ff0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f4ff0 0x55856d60f690 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009020 tx=0x7fbcb8010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f520ebd2b71114 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbc77fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbc77fff640 1 -- 10.20.193.28:0/3668670892 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8002c60 con 0x55856d5f4ff0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbc77fff640 1 -- 10.20.193.28:0/3668670892 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbcb8002e00 con 0x55856d5f4ff0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbc77fff640 1 -- 10.20.193.28:0/3668670892 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb80035e0 con 0x55856d5f4ff0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3668670892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55856d310b40 con 0x55856d5f4ff0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbc77fff640 1 -- 10.20.193.28:0/3668670892 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fbcb8003780 con 0x55856d5f4ff0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbccefa5e00 10 client.15444 _ll_register_callbacks cb 0x55856d578eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:11.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3668670892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55856d54d150 con 0x55856d5f4ff0 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbc77fff640 1 -- 10.20.193.28:0/3668670892 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbcb8002fb0 con 0x55856d5f4ff0 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbccefa5e00 10 client.15444 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.119+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3668670892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55856d4fa1e0 con 0x55856d5f4ff0 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.120+0000 7fbc77fff640 1 -- 10.20.193.28:0/3668670892 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fbcb8010770 con 0x55856d5f4ff0 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.120+0000 7fbccefa5e00 10 client.15444 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.120+0000 7fbccefa5e00 10 client.15444 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.120+0000 7fbccefa5e00 20 client.15444 populate_metadata read hostname 'trial028' 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.120+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55856d61dcd0 0x55856d6200c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.120+0000 7fbccefa5e00 4 client.15444 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.120+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3668670892 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55856d547560 con 0x55856d61dcd0 2026-02-20T03:16:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.120+0000 7fbcc5d74640 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55856d61dcd0 0x55856d6200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbcc5d74640 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55856d61dcd0 0x55856d6200c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4011e5c3adc205a server_cookie=52c166e7e391d28c in_seq=0 out_seq=0 2026-02-20T03:16:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbc77fff640 10 client.15444 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:16:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbc77fff640 1 -- 10.20.193.28:0/3668670892 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55856d547560 con 0x55856d61dcd0 2026-02-20T03:16:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbc77fff640 10 client.15444 handle_command_reply: tid=0 2026-02-20T03:16:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbccefa5e00 1 client.15444 shutdown 2026-02-20T03:16:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3668670892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f4ff0 msgr2=0x55856d60f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f4ff0 0x55856d60f690 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009020 tx=0x7fbcb8010f70 comp rx=0 tx=0).stop 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3668670892 shutdown_connections 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55856d61dcd0 0x55856d6200c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f9aa0 0x55856d60ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 0x55856d60fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/3668670892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f4ff0 0x55856d60f690 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.121+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3668670892 >> 10.20.193.28:0/3668670892 conn(0x55856d5af240 msgr2=0x55856d5facc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.122+0000 7fbc77fff640 0 client.15444 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.122+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3668670892 shutdown_connections 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.122+0000 7fbccefa5e00 1 -- 10.20.193.28:0/3668670892 wait complete. 2026-02-20T03:16:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.122+0000 7fbccefa5e00 20 client.15444 trim_cache size 0 max 16384 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbccefa5e00 1 Processor -- start 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbccefa5e00 1 -- start start 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f4ff0 0x55856d60cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 0x55856d5f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbcc6d76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f4ff0 0x55856d60cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbcc6d76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f4ff0 0x55856d60cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56802/0 (socket says 10.20.193.28:56802) 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f9aa0 0x55856d5f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbcc6d76640 1 -- 10.20.193.28:0/2764916973 learned_addr learned my addr 10.20.193.28:0/2764916973 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbccefa5e00 1 -- 10.20.193.28:0/2764916973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c012370 con 0x55856d5f59a0 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbccefa5e00 1 -- 10.20.193.28:0/2764916973 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c00fc40 con 0x55856d5f9aa0 2026-02-20T03:16:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbccefa5e00 1 -- 10.20.193.28:0/2764916973 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c00da90 con 0x55856d5f4ff0 2026-02-20T03:16:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.129+0000 7fbcc5d74640 1 --2- 10.20.193.28:0/2764916973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 0x55856d5f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.130+0000 7fbcc6d76640 1 -- 10.20.193.28:0/2764916973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f9aa0 msgr2=0x55856d5f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.130+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/2764916973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f9aa0 0x55856d5f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.130+0000 7fbcc6d76640 1 -- 10.20.193.28:0/2764916973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 msgr2=0x55856d5f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.130+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/2764916973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 0x55856d5f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.130+0000 7fbcc6d76640 1 -- 10.20.193.28:0/2764916973 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d607070 con 0x55856d5f4ff0 2026-02-20T03:16:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.130+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/2764916973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f4ff0 0x55856d60cd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009790 tx=0x7fbcb800b030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b3d86e6dbd297f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.130+0000 7fbc924e6640 1 -- 10.20.193.28:0/2764916973 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb803b070 con 0x55856d5f4ff0 2026-02-20T03:16:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.130+0000 7fbc924e6640 1 -- 10.20.193.28:0/2764916973 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55856d54d150 con 0x55856d5f4ff0 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 -- 10.20.193.28:0/2764916973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f4ff0 msgr2=0x55856d60cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/2764916973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f4ff0 0x55856d60cd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009790 tx=0x7fbcb800b030 comp rx=0 tx=0).stop 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 -- 10.20.193.28:0/2764916973 shutdown_connections 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/2764916973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f9aa0 0x55856d5f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/2764916973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f59a0 0x55856d5f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/2764916973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f4ff0 0x55856d60cd60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 -- 10.20.193.28:0/2764916973 >> 10.20.193.28:0/2764916973 conn(0x55856d5af240 msgr2=0x55856d60c650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 -- 10.20.193.28:0/2764916973 shutdown_connections 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 -- 10.20.193.28:0/2764916973 wait complete. 2026-02-20T03:16:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.131+0000 7fbccefa5e00 1 -- start start 2026-02-20T03:16:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbccefa5e00 1 Processor -- start 2026-02-20T03:16:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d615700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 0x55856d615c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbccefa5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f9aa0 0x55856d6124f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbcc6d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d615700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbcc6d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d615700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48736/0 (socket says 10.20.193.28:48736) 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbccefa5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c00e100 con 0x55856d5f9aa0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbccefa5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c00f570 con 0x55856d5f4ff0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbccefa5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c00e7d0 con 0x55856d5f59a0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbcc6d76640 1 -- 10.20.193.28:0/1963921995 learned_addr learned my addr 10.20.193.28:0/1963921995 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.132+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f9aa0 0x55856d6124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbcc5d74640 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 0x55856d615c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbcc6d76640 1 -- 10.20.193.28:0/1963921995 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 msgr2=0x55856d615c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 0x55856d615c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbcc6d76640 1 -- 10.20.193.28:0/1963921995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f9aa0 msgr2=0x55856d6124f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f9aa0 0x55856d6124f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbcc6d76640 1 -- 10.20.193.28:0/1963921995 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55856d21e870 con 0x55856d5f4ff0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbcc6d76640 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d615700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8003f00 tx=0x7fbcb8010cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4198750f79fa0edd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbc77fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbc77fff640 1 -- 10.20.193.28:0/1963921995 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb803b040 con 0x55856d5f4ff0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbc77fff640 1 -- 10.20.193.28:0/1963921995 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbcb801a070 con 0x55856d5f4ff0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbc77fff640 1 -- 10.20.193.28:0/1963921995 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcb80156e0 con 0x55856d5f4ff0 2026-02-20T03:16:11.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.133+0000 7fbccefa5e00 1 -- 10.20.193.28:0/1963921995 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55856d4df3f0 con 0x55856d5f4ff0 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbc77fff640 1 -- 10.20.193.28:0/1963921995 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fbcb8015880 con 0x55856d5f4ff0 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 10 client.25520 _ll_register_callbacks cb 0x7fbcbc005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 1 -- 10.20.193.28:0/1963921995 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55856d5107c0 con 0x55856d5f4ff0 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbc77fff640 1 -- 10.20.193.28:0/1963921995 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbcb8002ca0 con 0x55856d5f4ff0 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 10 client.25520 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 1 -- 10.20.193.28:0/1963921995 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55856d607d60 con 0x55856d5f4ff0 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbc77fff640 1 -- 10.20.193.28:0/1963921995 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fbcb8015a80 con 0x55856d5f4ff0 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 10 client.25520 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 10 client.25520 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 20 client.25520 populate_metadata read hostname 'trial028' 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55856d689170 0x55856d68b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 4 client.25520 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbccefa5e00 1 -- 10.20.193.28:0/1963921995 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55856d4f1ab0 con 0x55856d689170 2026-02-20T03:16:11.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.134+0000 7fbcc5d74640 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55856d689170 0x55856d68b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbcc5d74640 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55856d689170 0x55856d68b600 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dcad157bdc0a1cb1 server_cookie=e6e341c4085c0da0 in_seq=0 out_seq=0 2026-02-20T03:16:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbc77fff640 10 client.25520 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:16:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbc77fff640 1 -- 10.20.193.28:0/1963921995 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55856d4f1ab0 con 0x55856d689170 2026-02-20T03:16:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbc77fff640 10 client.25520 handle_command_reply: tid=0 2026-02-20T03:16:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 client.25520 shutdown 2026-02-20T03:16:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 -- 10.20.193.28:0/1963921995 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 msgr2=0x55856d615700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d615700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8003f00 tx=0x7fbcb8010cc0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 -- 10.20.193.28:0/1963921995 shutdown_connections 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55856d689170 0x55856d68b600 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55856d5f9aa0 0x55856d6124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55856d5f59a0 0x55856d615c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 --2- 10.20.193.28:0/1963921995 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55856d5f4ff0 0x55856d615700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbc77fff640 0 client.25520 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 -- 10.20.193.28:0/1963921995 >> 10.20.193.28:0/1963921995 conn(0x55856d5af240 msgr2=0x55856d60ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.135+0000 7fbccefa5e00 1 -- 10.20.193.28:0/1963921995 shutdown_connections 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbccefa5e00 1 -- 10.20.193.28:0/1963921995 wait complete. 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbccefa5e00 20 client.25520 trim_cache size 0 max 16384 2026-02-20T03:16:11.138 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca00b0f40 msgr2=0x7fbca00b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca00b0f40 0x7fbca00b3400 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0a8710 tx=0x7fbcbc002c60 comp rx=0 tx=0).stop 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1561602858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc8104da0 msgr2=0x7fbcc819d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc8104da0 0x7fbcc819d240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00ea10 tx=0x7fbcbc00eee0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1561602858 shutdown_connections 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbca00b0f40 0x7fbca00b3400 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcc8109ed0 0x7fbcc81a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcc8105750 0x7fbcc819d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 --2- 10.20.193.28:0/1561602858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcc8104da0 0x7fbcc819d240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1561602858 >> 10.20.193.28:0/1561602858 conn(0x7fbcc8100840 msgr2=0x7fbcc8101c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1561602858 shutdown_connections 2026-02-20T03:16:11.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.136+0000 7fbcccaa0640 1 -- 10.20.193.28:0/1561602858 wait complete. 2026-02-20T03:16:11.239 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:11 trial028 ceph-mon[38552]: pgmap v223: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2026-02-20T03:16:11.241 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:16:11.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:11 trial177 ceph-mon[43181]: pgmap v223: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2026-02-20T03:16:11.507 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:11.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:11 trial126 ceph-mon[38476]: pgmap v223: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2026-02-20T03:16:11.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.704+0000 7f3ab6be9640 1 -- 10.20.193.28:0/1078495841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ab010eef0 msgr2=0x7f3ab010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.704+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/1078495841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ab010eef0 0x7f3ab010f2d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009960 tx=0x7f3aa002f140 comp rx=0 tx=0).stop 2026-02-20T03:16:11.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.704+0000 7f3ab6be9640 1 -- 10.20.193.28:0/1078495841 shutdown_connections 2026-02-20T03:16:11.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.704+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/1078495841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ab0109ba0 0x7f3ab0115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.704+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/1078495841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ab0109220 0x7f3ab0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.704+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/1078495841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ab010eef0 0x7f3ab010f2d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.704+0000 7f3ab6be9640 1 -- 10.20.193.28:0/1078495841 >> 10.20.193.28:0/1078495841 conn(0x7f3ab0078600 msgr2=0x7f3ab007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.704+0000 7f3ab6be9640 1 -- 10.20.193.28:0/1078495841 shutdown_connections 2026-02-20T03:16:11.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.705+0000 7f3ab6be9640 1 -- 10.20.193.28:0/1078495841 wait complete. 2026-02-20T03:16:11.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.705+0000 7f3ab6be9640 1 Processor -- start 2026-02-20T03:16:11.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.705+0000 7f3ab6be9640 1 -- start start 2026-02-20T03:16:11.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab6be9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ab0109220 0x7f3ab01a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab6be9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ab0109ba0 0x7f3ab01a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab6be9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ab010eef0 0x7f3ab01a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab6be9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab0119080 con 0x7f3ab0109220 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab6be9640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab0118f00 con 0x7f3ab0109ba0 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab6be9640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab0119200 con 0x7f3ab010eef0 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab5be7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ab0109220 0x7f3ab01a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab5be7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ab0109220 0x7f3ab01a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46490/0 (socket says 10.20.193.28:46490) 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab5be7640 1 -- 10.20.193.28:0/3584586158 learned_addr learned my addr 10.20.193.28:0/3584586158 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ab0109ba0 0x7f3ab01a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab5be7640 1 -- 10.20.193.28:0/3584586158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ab010eef0 msgr2=0x7f3ab01a5ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ab010eef0 0x7f3ab01a5ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab5be7640 1 -- 10.20.193.28:0/3584586158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ab0109ba0 msgr2=0x7f3ab01a1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ab0109ba0 0x7f3ab01a1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab5be7640 1 -- 10.20.193.28:0/3584586158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab01a6650 con 0x7f3ab0109220 2026-02-20T03:16:11.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.706+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ab0109220 0x7f3ab01a1600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009a90 tx=0x7f3aa0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.707+0000 7f3a9effd640 1 -- 10.20.193.28:0/3584586158 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0046070 con 0x7f3ab0109220 2026-02-20T03:16:11.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.707+0000 7f3ab6be9640 1 -- 10.20.193.28:0/3584586158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab01a68e0 con 0x7f3ab0109220 2026-02-20T03:16:11.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.707+0000 7f3a9effd640 1 -- 10.20.193.28:0/3584586158 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3aa0004540 con 0x7f3ab0109220 2026-02-20T03:16:11.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.707+0000 7f3a9effd640 1 -- 10.20.193.28:0/3584586158 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0041c80 con 0x7f3ab0109220 2026-02-20T03:16:11.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.707+0000 7f3ab6be9640 1 -- 10.20.193.28:0/3584586158 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab01ae180 con 0x7f3ab0109220 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.709+0000 7f3a9effd640 1 -- 10.20.193.28:0/3584586158 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3aa00026e0 con 0x7f3ab0109220 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3aba377e00 1 Processor -- start 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3aba377e00 1 -- start start 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29b5e0 0x56099e29ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3aba377e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56099e21be00 con 0x56099e29bf60 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3aba377e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56099e1ee970 con 0x56099e2a0fb0 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3aba377e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56099e19c1f0 con 0x56099e29b5e0 2026-02-20T03:16:11.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3ab63e8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3ab63e8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48758/0 (socket says 10.20.193.28:48758) 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3ab63e8640 1 -- 10.20.193.28:0/4104228746 learned_addr learned my addr 10.20.193.28:0/4104228746 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/4104228746 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29b5e0 0x56099e29ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4104228746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4104228746 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29b5e0 msgr2=0x56099e29ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4104228746 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29b5e0 0x56099e29ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.710+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4104228746 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 msgr2=0x56099e2a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4104228746 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4104228746 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099e1af3d0 con 0x56099e29bf60 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4104228746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2a7de0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4004480 tx=0x7f3aa4009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c46e060f159a2f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3a7e4e6640 1 -- 10.20.193.28:0/4104228746 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4002cc0 con 0x56099e29bf60 2026-02-20T03:16:11.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3a7e4e6640 1 -- 10.20.193.28:0/4104228746 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3aa40128f0 con 0x56099e29bf60 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3a7e4e6640 1 -- 10.20.193.28:0/4104228746 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400f920 con 0x56099e29bf60 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3a9effd640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3a8c0b0e20 0x7f3a8c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3a9effd640 1 -- 10.20.193.28:0/3584586158 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f3aa0104c00 con 0x7f3ab0109220 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3ab63e8640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3a8c0b0e20 0x7f3a8c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3aba377e00 1 -- 10.20.193.28:0/4104228746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 msgr2=0x56099e2a7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4104228746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2a7de0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4004480 tx=0x7f3aa4009c60 comp rx=0 tx=0).stop 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3aba377e00 1 -- 10.20.193.28:0/4104228746 shutdown_connections 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4104228746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2a7de0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4104228746 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29b5e0 0x56099e29ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4104228746 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.711+0000 7f3aba377e00 1 -- 10.20.193.28:0/4104228746 >> 10.20.193.28:0/4104228746 conn(0x56099e25e240 msgr2=0x56099e299ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.712+0000 7f3aba377e00 1 -- 10.20.193.28:0/4104228746 shutdown_connections 2026-02-20T03:16:11.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.712+0000 7f3aba377e00 1 -- 10.20.193.28:0/4104228746 wait complete. 2026-02-20T03:16:11.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.712+0000 7f3ab63e8640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3a8c0b0e20 0x7f3a8c0b32e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009fd0 tx=0x7f3aac00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.713+0000 7f3aba377e00 1 -- start start 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.713+0000 7f3aba377e00 1 Processor -- start 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.713+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 0x56099e2b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.713+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.713+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e2a0fb0 0x56099e2b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.713+0000 7f3aba377e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56099e1ea8a0 con 0x56099e29bf60 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.713+0000 7f3aba377e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56099dfdcf50 con 0x56099e29b5e0 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.713+0000 7f3aba377e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56099e2b9390 con 0x56099e2a0fb0 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab53e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab53e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46516/0 (socket says 10.20.193.28:46516) 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4043109024 learned_addr learned my addr 10.20.193.28:0/4043109024 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 0x56099e2b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab63e8640 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e2a0fb0 0x56099e2b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4043109024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e2a0fb0 msgr2=0x56099e2b8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e2a0fb0 0x56099e2b8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4043109024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 msgr2=0x56099e2b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 0x56099e2b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4043109024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099e2ada30 con 0x56099e29bf60 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2b4b60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4012880 tx=0x7f3aa40041b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b17c4a41e7f72e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3a6b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4043109024 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4009e20 con 0x56099e29bf60 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4043109024 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3aa4002c60 con 0x56099e29bf60 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4043109024 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400fd40 con 0x56099e29bf60 2026-02-20T03:16:11.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.714+0000 7f3aba377e00 1 -- 10.20.193.28:0/4043109024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099dfbfb40 con 0x56099e29bf60 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4043109024 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f3aa401c430 con 0x56099e29bf60 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 10 client.15462 _ll_register_callbacks cb 0x56099e227eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 1 -- 10.20.193.28:0/4043109024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56099e1fc150 con 0x56099e29bf60 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4043109024 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3aa400f520 con 0x56099e29bf60 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 10 client.15462 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 1 -- 10.20.193.28:0/4043109024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x56099e1a91e0 con 0x56099e29bf60 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4043109024 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f3aa4012aa0 con 0x56099e29bf60 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 10 client.15462 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 20 client.15462 populate_metadata read hostname 'trial028' 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56099e2c4490 0x56099e2c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 4 client.15462 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:11.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3aba377e00 1 -- 10.20.193.28:0/4043109024 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56099e1f6560 con 0x56099e2c4490 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.715+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56099e2c4490 0x56099e2c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.716+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56099e2c4490 0x56099e2c6880 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f988ba9119238b0 server_cookie=8e5767ffdf80bc7 in_seq=0 out_seq=0 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.716+0000 7f3a6b7fe640 10 client.15462 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.716+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4043109024 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56099e1f6560 con 0x56099e2c4490 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.716+0000 7f3a6b7fe640 10 client.15462 handle_command_reply: tid=0 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 client.15462 shutdown 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 -- 10.20.193.28:0/4043109024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 msgr2=0x56099e2b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2b4b60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4012880 tx=0x7f3aa40041b0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 -- 10.20.193.28:0/4043109024 shutdown_connections 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56099e2c4490 0x56099e2c6880 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e2a0fb0 0x56099e2b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29bf60 0x56099e2b4b60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4043109024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 0x56099e2b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 -- 10.20.193.28:0/4043109024 >> 10.20.193.28:0/4043109024 conn(0x56099e25e240 msgr2=0x56099e29a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3a6b7fe640 0 client.15462 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:11.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 -- 10.20.193.28:0/4043109024 shutdown_connections 2026-02-20T03:16:11.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 1 -- 10.20.193.28:0/4043109024 wait complete. 2026-02-20T03:16:11.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.717+0000 7f3aba377e00 20 client.15462 trim_cache size 0 max 16384 2026-02-20T03:16:11.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.723+0000 7f3aba377e00 1 Processor -- start 2026-02-20T03:16:11.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3aba377e00 1 -- start start 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29b5e0 0x56099e29a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e29aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3aba377e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c012240 con 0x56099e29b5e0 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3aba377e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c00fb10 con 0x56099e2a0fb0 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3aba377e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c00d960 con 0x56099e29bf60 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab53e6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e29aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab5be7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29b5e0 0x56099e29a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab5be7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29b5e0 0x56099e29a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46524/0 (socket says 10.20.193.28:46524) 2026-02-20T03:16:11.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab5be7640 1 -- 10.20.193.28:0/3563708698 learned_addr learned my addr 10.20.193.28:0/3563708698 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab63e8640 1 --2- 10.20.193.28:0/3563708698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab5be7640 1 -- 10.20.193.28:0/3563708698 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 msgr2=0x56099e29aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/3563708698 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e29aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab5be7640 1 -- 10.20.193.28:0/3563708698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 msgr2=0x56099e2cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/3563708698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab5be7640 1 -- 10.20.193.28:0/3563708698 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099e2ad860 con 0x56099e29b5e0 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab63e8640 1 --2- 10.20.193.28:0/3563708698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.724+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/3563708698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29b5e0 0x56099e29a4d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0048040 tx=0x7f3aa00ef040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599a12e5be368afe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3a7dce5640 1 -- 10.20.193.28:0/3563708698 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0109040 con 0x56099e29b5e0 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3a7dce5640 1 -- 10.20.193.28:0/3563708698 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3aa0033040 con 0x56099e29b5e0 2026-02-20T03:16:11.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3a7dce5640 1 -- 10.20.193.28:0/3563708698 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00c8d90 con 0x56099e29b5e0 2026-02-20T03:16:11.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3aba377e00 1 -- 10.20.193.28:0/3563708698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29b5e0 msgr2=0x56099e29a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3aba377e00 1 --2- 10.20.193.28:0/3563708698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29b5e0 0x56099e29a4d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0048040 tx=0x7f3aa00ef040 comp rx=0 tx=0).stop 2026-02-20T03:16:11.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3aba377e00 1 -- 10.20.193.28:0/3563708698 shutdown_connections 2026-02-20T03:16:11.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3aba377e00 1 --2- 10.20.193.28:0/3563708698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e2a0fb0 0x56099e2cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3aba377e00 1 --2- 10.20.193.28:0/3563708698 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e29aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3aba377e00 1 --2- 10.20.193.28:0/3563708698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e29b5e0 0x56099e29a4d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3aba377e00 1 -- 10.20.193.28:0/3563708698 >> 10.20.193.28:0/3563708698 conn(0x56099e25e240 msgr2=0x56099e2b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3aba377e00 1 -- 10.20.193.28:0/3563708698 shutdown_connections 2026-02-20T03:16:11.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.725+0000 7f3aba377e00 1 -- 10.20.193.28:0/3563708698 wait complete. 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3aba377e00 1 -- start start 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3aba377e00 1 Processor -- start 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 0x56099e2bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e2bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3aba377e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e2a0fb0 0x56099e2bc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3aba377e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c00dfd0 con 0x56099e2a0fb0 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3aba377e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c00f440 con 0x56099e29b5e0 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3aba377e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c00e6a0 con 0x56099e29bf60 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3ab53e6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e2bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3ab5be7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 0x56099e2bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3ab53e6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e2bbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56872/0 (socket says 10.20.193.28:56872) 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4259898686 learned_addr learned my addr 10.20.193.28:0/4259898686 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.726+0000 7f3ab63e8640 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e2a0fb0 0x56099e2bc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4259898686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 msgr2=0x56099e2bf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 0x56099e2bf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4259898686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e2a0fb0 msgr2=0x56099e2bc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e2a0fb0 0x56099e2bc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3ab53e6640 1 -- 10.20.193.28:0/4259898686 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099decd870 con 0x56099e29bf60 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 0x56099e2bf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3ab53e6640 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e2bbc90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40026b0 tx=0x7f3aa4005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18379955f389af5a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3a6b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4259898686 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400f6c0 con 0x56099e29bf60 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4259898686 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56099e1fc150 con 0x56099e29bf60 2026-02-20T03:16:11.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3aba377e00 1 -- 10.20.193.28:0/4259898686 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099e18e3f0 con 0x56099e29bf60 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4259898686 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4005680 con 0x56099e29bf60 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4259898686 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f3aa40046a0 con 0x56099e29bf60 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.727+0000 7f3a6b7fe640 10 client.25510 inactive, discarding osd_map(91..91 src has 1..91) 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 10 client.25510 _ll_register_callbacks cb 0x7f3aac009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 1 -- 10.20.193.28:0/4259898686 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56099e1bf7c0 con 0x56099e29bf60 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4259898686 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3aa400f860 con 0x56099e29bf60 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 10 client.25510 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 1 -- 10.20.193.28:0/4259898686 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x56099e2ae550 con 0x56099e29bf60 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4259898686 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f3aa400fac0 con 0x56099e29bf60 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 10 client.25510 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 10 client.25510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 20 client.25510 populate_metadata read hostname 'trial028' 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56099e330200 0x56099e3326c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:11.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 4 client.25510 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3aba377e00 1 -- 10.20.193.28:0/4259898686 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56099e1a0ab0 con 0x56099e330200 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.728+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56099e330200 0x56099e3326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3ab5be7640 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56099e330200 0x56099e3326c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5986d5bf605c2a49 server_cookie=a191e448dbffc960 in_seq=0 out_seq=0 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3a6b7fe640 10 client.25510 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3a6b7fe640 1 -- 10.20.193.28:0/4259898686 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56099e1a0ab0 con 0x56099e330200 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3a6b7fe640 10 client.25510 handle_command_reply: tid=0 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 client.25510 shutdown 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 -- 10.20.193.28:0/4259898686 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 msgr2=0x56099e2bbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e2bbc90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40026b0 tx=0x7f3aa4005fd0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 -- 10.20.193.28:0/4259898686 shutdown_connections 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56099e330200 0x56099e3326c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56099e2a0fb0 0x56099e2bc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56099e29bf60 0x56099e2bbc90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 --2- 10.20.193.28:0/4259898686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56099e29b5e0 0x56099e2bf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3a6b7fe640 0 client.25510 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:11.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 -- 10.20.193.28:0/4259898686 >> 10.20.193.28:0/4259898686 conn(0x56099e25e240 msgr2=0x56099e2b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 -- 10.20.193.28:0/4259898686 shutdown_connections 2026-02-20T03:16:11.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 1 -- 10.20.193.28:0/4259898686 wait complete. 2026-02-20T03:16:11.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.729+0000 7f3aba377e00 20 client.25510 trim_cache size 0 max 16384 2026-02-20T03:16:11.738 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 -- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3a8c0b0e20 msgr2=0x7f3a8c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3a8c0b0e20 0x7f3a8c0b32e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009fd0 tx=0x7f3aac00d040 comp rx=0 tx=0).stop 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 -- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ab0109220 msgr2=0x7f3ab01a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ab0109220 0x7f3ab01a1600 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0009a90 tx=0x7f3aa0004290 comp rx=0 tx=0).stop 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 -- 10.20.193.28:0/3584586158 shutdown_connections 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3a8c0b0e20 0x7f3a8c0b32e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ab010eef0 0x7f3ab01a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ab0109ba0 0x7f3ab01a1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 --2- 10.20.193.28:0/3584586158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ab0109220 0x7f3ab01a1600 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 -- 10.20.193.28:0/3584586158 >> 10.20.193.28:0/3584586158 conn(0x7f3ab0078600 msgr2=0x7f3ab007a080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 -- 10.20.193.28:0/3584586158 shutdown_connections 2026-02-20T03:16:11.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:11.730+0000 7f3ab6be9640 1 -- 10.20.193.28:0/3584586158 wait complete. 2026-02-20T03:16:12.869 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:16:12.869 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:16:13.135 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:13.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.329+0000 7f6757fff640 1 -- 10.20.193.28:0/3170170362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f675810a980 msgr2=0x7f675810ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.329+0000 7f6757fff640 1 --2- 10.20.193.28:0/3170170362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f675810a980 0x7f675810ad60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f674c009a60 tx=0x7f674c02f250 comp rx=0 tx=0).stop 2026-02-20T03:16:13.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.329+0000 7f6757fff640 1 -- 10.20.193.28:0/3170170362 shutdown_connections 2026-02-20T03:16:13.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.329+0000 7f6757fff640 1 --2- 10.20.193.28:0/3170170362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6758105320 0x7f6758111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.329+0000 7f6757fff640 1 --2- 10.20.193.28:0/3170170362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6758104980 0x7f6758104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.329+0000 7f6757fff640 1 --2- 10.20.193.28:0/3170170362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f675810a980 0x7f675810ad60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.329+0000 7f6757fff640 1 -- 10.20.193.28:0/3170170362 >> 10.20.193.28:0/3170170362 conn(0x7f6758100680 msgr2=0x7f6758102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.329+0000 7f6757fff640 1 -- 10.20.193.28:0/3170170362 shutdown_connections 2026-02-20T03:16:13.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.329+0000 7f6757fff640 1 -- 10.20.193.28:0/3170170362 wait complete. 2026-02-20T03:16:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6757fff640 1 Processor -- start 2026-02-20T03:16:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6757fff640 1 -- start start 2026-02-20T03:16:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6757fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6758104980 0x7f675819d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6757fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6758105320 0x7f675819d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6757fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f675810a980 0x7f67581a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6757fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6758114b90 con 0x7f6758104980 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6757fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6758114a10 con 0x7f6758105320 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6757fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6758114d10 con 0x7f675810a980 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6756ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6758104980 0x7f675819d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6756ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6758104980 0x7f675819d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46548/0 (socket says 10.20.193.28:46548) 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f6756ffd640 1 -- 10.20.193.28:0/1652990830 learned_addr learned my addr 10.20.193.28:0/1652990830 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f67567fc640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6758105320 0x7f675819d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.330+0000 7f67577fe640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f675810a980 0x7f67581a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f6756ffd640 1 -- 10.20.193.28:0/1652990830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f675810a980 msgr2=0x7f67581a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f6756ffd640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f675810a980 0x7f67581a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f6756ffd640 1 -- 10.20.193.28:0/1652990830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6758105320 msgr2=0x7f675819d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f6756ffd640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6758105320 0x7f675819d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f6756ffd640 1 -- 10.20.193.28:0/1652990830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67581a2060 con 0x7f6758104980 2026-02-20T03:16:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f67567fc640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6758105320 0x7f675819d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f6756ffd640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6758104980 0x7f675819d010 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f674c002410 tx=0x7f674c02fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f675c944640 1 -- 10.20.193.28:0/1652990830 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c004260 con 0x7f6758104980 2026-02-20T03:16:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f675c944640 1 -- 10.20.193.28:0/1652990830 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f674c004400 con 0x7f6758104980 2026-02-20T03:16:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f675c944640 1 -- 10.20.193.28:0/1652990830 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674c041620 con 0x7f6758104980 2026-02-20T03:16:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f6757fff640 1 -- 10.20.193.28:0/1652990830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67581a22f0 con 0x7f6758104980 2026-02-20T03:16:13.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.331+0000 7f6757fff640 1 -- 10.20.193.28:0/1652990830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67581a9b90 con 0x7f6758104980 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.334+0000 7f675c944640 1 -- 10.20.193.28:0/1652990830 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f674c038770 con 0x7f6758104980 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.334+0000 7f675fe4be00 1 Processor -- start 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.334+0000 7f675fe4be00 1 -- start start 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.334+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.334+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566a4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.334+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 0x564b566a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.334+0000 7f675fe4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564b565f2c00 con 0x564b566a4b60 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.334+0000 7f675fe4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564b565a03c0 con 0x564b566a00c0 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.334+0000 7f675fe4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564b565eeb30 con 0x564b566a0a70 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67577fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f6756ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67577fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566a04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48818/0 (socket says 10.20.193.28:48818) 2026-02-20T03:16:13.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67577fe640 1 -- 10.20.193.28:0/3730511836 learned_addr learned my addr 10.20.193.28:0/3730511836 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67567fc640 1 --2- 10.20.193.28:0/3730511836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 0x564b566a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67577fe640 1 -- 10.20.193.28:0/3730511836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 msgr2=0x564b566a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67577fe640 1 --2- 10.20.193.28:0/3730511836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67577fe640 1 -- 10.20.193.28:0/3730511836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 msgr2=0x564b566a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67577fe640 1 --2- 10.20.193.28:0/3730511836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 0x564b566a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67577fe640 1 -- 10.20.193.28:0/3730511836 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b56599840 con 0x564b566a00c0 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67567fc640 1 --2- 10.20.193.28:0/3730511836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 0x564b566a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f67577fe640 1 --2- 10.20.193.28:0/3730511836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566a04a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6748009810 tx=0x7f6748009ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237a8059f1178e0f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f675c944640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f672c0b0da0 0x7f672c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f675c944640 1 -- 10.20.193.28:0/1652990830 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f674c105510 con 0x7f6758104980 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f671bfff640 1 -- 10.20.193.28:0/3730511836 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748004840 con 0x564b566a00c0 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f671bfff640 1 -- 10.20.193.28:0/3730511836 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f67480079a0 con 0x564b566a00c0 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.335+0000 7f671bfff640 1 -- 10.20.193.28:0/3730511836 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748014a90 con 0x564b566a00c0 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f675fe4be00 1 -- 10.20.193.28:0/3730511836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 msgr2=0x564b566a04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3730511836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566a04a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6748009810 tx=0x7f6748009ce0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f6756ffd640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f672c0b0da0 0x7f672c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f675fe4be00 1 -- 10.20.193.28:0/3730511836 shutdown_connections 2026-02-20T03:16:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3730511836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 0x564b566a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3730511836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3730511836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566a04a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f675fe4be00 1 -- 10.20.193.28:0/3730511836 >> 10.20.193.28:0/3730511836 conn(0x564b56698b60 msgr2=0x564b5669e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f675fe4be00 1 -- 10.20.193.28:0/3730511836 shutdown_connections 2026-02-20T03:16:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f675fe4be00 1 -- 10.20.193.28:0/3730511836 wait complete. 2026-02-20T03:16:13.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.336+0000 7f6756ffd640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f672c0b0da0 0x7f672c0b3260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f674c0cd270 tx=0x7f674c038f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.337+0000 7f675fe4be00 1 -- start start 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.337+0000 7f675fe4be00 1 Processor -- start 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.337+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a00c0 0x564b566ba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566ba960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a4b60 0x564b566b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f675fe4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564b5659a1a0 con 0x564b566a0a70 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f675fe4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564b566acd70 con 0x564b566a4b60 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f675fe4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564b566b92e0 con 0x564b566a00c0 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a00c0 0x564b566ba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a00c0 0x564b566ba420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56902/0 (socket says 10.20.193.28:56902) 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 -- 10.20.193.28:0/4152341773 learned_addr learned my addr 10.20.193.28:0/4152341773 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67567fc640 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a4b60 0x564b566b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 -- 10.20.193.28:0/4152341773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a4b60 msgr2=0x564b566b8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a4b60 0x564b566b8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 -- 10.20.193.28:0/4152341773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 msgr2=0x564b566ba960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566ba960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 -- 10.20.193.28:0/4152341773 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b566b2550 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67567fc640 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566ba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67577fe640 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a00c0 0x564b566ba420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6748014670 tx=0x7f67480060c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38e50a28266866de server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.338+0000 7f67197fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f67197fa640 1 -- 10.20.193.28:0/4152341773 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748029070 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f67197fa640 1 -- 10.20.193.28:0/4152341773 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6748014c70 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f67197fa640 1 -- 10.20.193.28:0/4152341773 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6748021690 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f675fe4be00 1 -- 10.20.193.28:0/4152341773 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b563c1b60 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f675fe4be00 10 client.25522 _ll_register_callbacks cb 0x564b5659e0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f675fe4be00 1 -- 10.20.193.28:0/4152341773 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564b565fa7f0 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f67197fa640 1 -- 10.20.193.28:0/4152341773 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f67480147d0 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f67197fa640 1 -- 10.20.193.28:0/4152341773 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6748008fa0 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f675fe4be00 10 client.25522 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f675fe4be00 1 -- 10.20.193.28:0/4152341773 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x564b565bf430 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f67197fa640 1 -- 10.20.193.28:0/4152341773 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f6748021830 con 0x564b566a00c0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f675fe4be00 10 client.25522 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f675fe4be00 10 client.25522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.339+0000 7f675fe4be00 20 client.25522 populate_metadata read hostname 'trial028' 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.340+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564b566c8a60 0x564b566cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.340+0000 7f675fe4be00 4 client.25522 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.340+0000 7f675fe4be00 1 -- 10.20.193.28:0/4152341773 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b56574c00 con 0x564b566c8a60 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.340+0000 7f67567fc640 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564b566c8a60 0x564b566cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.340+0000 7f67567fc640 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564b566c8a60 0x564b566cae50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5081738483898afa server_cookie=96d2aed0685da005 in_seq=0 out_seq=0 2026-02-20T03:16:13.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.340+0000 7f67197fa640 10 client.25522 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:13.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f67197fa640 1 -- 10.20.193.28:0/4152341773 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x564b56574c00 con 0x564b566c8a60 2026-02-20T03:16:13.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f67197fa640 10 client.25522 handle_command_reply: tid=0 2026-02-20T03:16:13.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 client.25522 shutdown 2026-02-20T03:16:13.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 -- 10.20.193.28:0/4152341773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a00c0 msgr2=0x564b566ba420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a00c0 0x564b566ba420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6748014670 tx=0x7f67480060c0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 -- 10.20.193.28:0/4152341773 shutdown_connections 2026-02-20T03:16:13.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564b566c8a60 0x564b566cae50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a4b60 0x564b566b8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566ba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4152341773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a00c0 0x564b566ba420 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 -- 10.20.193.28:0/4152341773 >> 10.20.193.28:0/4152341773 conn(0x564b56698b60 msgr2=0x564b566a3520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f67197fa640 0 client.25522 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:13.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 -- 10.20.193.28:0/4152341773 shutdown_connections 2026-02-20T03:16:13.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 1 -- 10.20.193.28:0/4152341773 wait complete. 2026-02-20T03:16:13.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.341+0000 7f675fe4be00 20 client.25522 trim_cache size 0 max 16384 2026-02-20T03:16:13.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.350+0000 7f675fe4be00 1 Processor -- start 2026-02-20T03:16:13.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.350+0000 7f675fe4be00 1 -- start start 2026-02-20T03:16:13.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.350+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.350+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.350+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 0x564b566d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.350+0000 7f675fe4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc012290 con 0x564b566a4b60 2026-02-20T03:16:13.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.350+0000 7f675fe4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00fb60 con 0x564b566a00c0 2026-02-20T03:16:13.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.350+0000 7f675fe4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00d9b0 con 0x564b566a0a70 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67567fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 0x564b566d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67567fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566d0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56906/0 (socket says 10.20.193.28:56906) 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67567fc640 1 -- 10.20.193.28:0/4214057138 learned_addr learned my addr 10.20.193.28:0/4214057138 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67577fe640 1 --2- 10.20.193.28:0/4214057138 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67567fc640 1 -- 10.20.193.28:0/4214057138 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 msgr2=0x564b566caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67567fc640 1 --2- 10.20.193.28:0/4214057138 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67567fc640 1 -- 10.20.193.28:0/4214057138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 msgr2=0x564b566d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67567fc640 1 --2- 10.20.193.28:0/4214057138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 0x564b566d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67567fc640 1 -- 10.20.193.28:0/4214057138 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b566a0810 con 0x564b566a0a70 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.351+0000 7f67567fc640 1 --2- 10.20.193.28:0/4214057138 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566d0570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x564b566b1110 tx=0x7f6740009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de4a6afe56469d92 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f671b7fe640 1 -- 10.20.193.28:0/4214057138 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740020070 con 0x564b566a0a70 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f671b7fe640 1 -- 10.20.193.28:0/4214057138 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f67400118e0 con 0x564b566a0a70 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f671b7fe640 1 -- 10.20.193.28:0/4214057138 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67400108c0 con 0x564b566a0a70 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f675fe4be00 1 -- 10.20.193.28:0/4214057138 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 msgr2=0x564b566d0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4214057138 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566d0570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x564b566b1110 tx=0x7f6740009290 comp rx=0 tx=0).stop 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f675fe4be00 1 -- 10.20.193.28:0/4214057138 shutdown_connections 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4214057138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a4b60 0x564b566d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4214057138 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a0a70 0x564b566d0570 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f675fe4be00 1 --2- 10.20.193.28:0/4214057138 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f675fe4be00 1 -- 10.20.193.28:0/4214057138 >> 10.20.193.28:0/4214057138 conn(0x564b56698b60 msgr2=0x564b566b7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f675fe4be00 1 -- 10.20.193.28:0/4214057138 shutdown_connections 2026-02-20T03:16:13.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.352+0000 7f675fe4be00 1 -- 10.20.193.28:0/4214057138 wait complete. 2026-02-20T03:16:13.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.353+0000 7f675fe4be00 1 -- start start 2026-02-20T03:16:13.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.353+0000 7f675fe4be00 1 Processor -- start 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.353+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.353+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566be120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.353+0000 7f675fe4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a4b60 0x564b5672c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.353+0000 7f675fe4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00e020 con 0x564b566a0a70 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.353+0000 7f675fe4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00f490 con 0x564b566a00c0 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.353+0000 7f675fe4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc00e6f0 con 0x564b566a4b60 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67567fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67577fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67577fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566bdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48844/0 (socket says 10.20.193.28:48844) 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67577fe640 1 -- 10.20.193.28:0/3091315024 learned_addr learned my addr 10.20.193.28:0/3091315024 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67577fe640 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a4b60 0x564b5672c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67567fc640 1 -- 10.20.193.28:0/3091315024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a4b60 msgr2=0x564b5672c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67567fc640 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a4b60 0x564b5672c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67567fc640 1 -- 10.20.193.28:0/3091315024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 msgr2=0x564b566bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67567fc640 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67567fc640 1 -- 10.20.193.28:0/3091315024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b566b2380 con 0x564b566a0a70 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67567fc640 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566be120 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x564b565f2c20 tx=0x7f6740009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a28f5d385ab5e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67197fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67197fa640 1 -- 10.20.193.28:0/3091315024 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740020040 con 0x564b566a0a70 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67197fa640 1 -- 10.20.193.28:0/3091315024 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6740009e10 con 0x564b566a0a70 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67197fa640 1 -- 10.20.193.28:0/3091315024 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6740010bb0 con 0x564b566a0a70 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f675fe4be00 1 -- 10.20.193.28:0/3091315024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b562d1900 con 0x564b566a0a70 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.354+0000 7f67197fa640 1 -- 10.20.193.28:0/3091315024 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f6740010d50 con 0x564b566a0a70 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f67197fa640 10 client.15486 inactive, discarding osd_map(91..91 src has 1..91) 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 10 client.15486 _ll_register_callbacks cb 0x7f6748004840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 1 -- 10.20.193.28:0/3091315024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67480079a0 con 0x564b566a0a70 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f67197fa640 1 -- 10.20.193.28:0/3091315024 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6740010540 con 0x564b566a0a70 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 10 client.15486 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 1 -- 10.20.193.28:0/3091315024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x564b565ad4d0 con 0x564b566a0a70 2026-02-20T03:16:13.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f67197fa640 1 -- 10.20.193.28:0/3091315024 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f6740037050 con 0x564b566a0a70 2026-02-20T03:16:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 10 client.15486 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 20 client.15486 populate_metadata read hostname 'trial028' 2026-02-20T03:16:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564b56735280 0x564b56737740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 4 client.15486 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:16:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f675fe4be00 1 -- 10.20.193.28:0/3091315024 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564b56362a20 con 0x564b56735280 2026-02-20T03:16:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.355+0000 7f67577fe640 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564b56735280 0x564b56737740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.356+0000 7f67577fe640 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564b56735280 0x564b56737740 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=475304c2196ff5d6 server_cookie=d18f11adc96a8dbe in_seq=0 out_seq=0 2026-02-20T03:16:13.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.356+0000 7f67197fa640 10 client.15486 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.356+0000 7f67197fa640 1 -- 10.20.193.28:0/3091315024 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564b56362a20 con 0x564b56735280 2026-02-20T03:16:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.356+0000 7f67197fa640 10 client.15486 handle_command_reply: tid=0 2026-02-20T03:16:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.356+0000 7f675fe4be00 1 client.15486 shutdown 2026-02-20T03:16:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 -- 10.20.193.28:0/3091315024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 msgr2=0x564b566be120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566be120 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x564b565f2c20 tx=0x7f6740009c60 comp rx=0 tx=0).stop 2026-02-20T03:16:13.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 -- 10.20.193.28:0/3091315024 shutdown_connections 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564b56735280 0x564b56737740 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564b566a4b60 0x564b5672c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564b566a0a70 0x564b566be120 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 --2- 10.20.193.28:0/3091315024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564b566a00c0 0x564b566bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 -- 10.20.193.28:0/3091315024 >> 10.20.193.28:0/3091315024 conn(0x564b56698b60 msgr2=0x564b566a5510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f67197fa640 0 client.15486 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 -- 10.20.193.28:0/3091315024 shutdown_connections 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 1 -- 10.20.193.28:0/3091315024 wait complete. 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.357+0000 7f675fe4be00 20 client.15486 trim_cache size 0 max 16384 2026-02-20T03:16:13.362 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:16:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:16:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "6515be3d-14e9-42ae-8681-32b97bfedc0c", 2026-02-20T03:16:13.363 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:16:13.363 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:16:13.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 -- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f672c0b0da0 msgr2=0x7f672c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f672c0b0da0 0x7f672c0b3260 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f674c0cd270 tx=0x7f674c038f90 comp rx=0 tx=0).stop 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 -- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6758104980 msgr2=0x7f675819d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6758104980 0x7f675819d010 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f674c002410 tx=0x7f674c02fca0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 -- 10.20.193.28:0/1652990830 shutdown_connections 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f672c0b0da0 0x7f672c0b3260 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f675810a980 0x7f67581a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6758105320 0x7f675819d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 --2- 10.20.193.28:0/1652990830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6758104980 0x7f675819d010 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 -- 10.20.193.28:0/1652990830 >> 10.20.193.28:0/1652990830 conn(0x7f6758100680 msgr2=0x7f6758100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 -- 10.20.193.28:0/1652990830 shutdown_connections 2026-02-20T03:16:13.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.358+0000 7f6757fff640 1 -- 10.20.193.28:0/1652990830 wait complete. 2026-02-20T03:16:13.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:13 trial028 ceph-mon[38552]: pgmap v224: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-20T03:16:13.458 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:16:13.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:13 trial177 ceph-mon[43181]: pgmap v224: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-20T03:16:13.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:13 trial126 ceph-mon[38476]: pgmap v224: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-20T03:16:13.721 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:13.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.904+0000 7f4a8085c640 1 -- 10.20.193.28:0/527916538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c104980 msgr2=0x7f4a7c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.904+0000 7f4a8085c640 1 --2- 10.20.193.28:0/527916538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c104980 0x7f4a7c104de0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009a60 tx=0x7f4a6402f250 comp rx=0 tx=0).stop 2026-02-20T03:16:13.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.904+0000 7f4a8085c640 1 -- 10.20.193.28:0/527916538 shutdown_connections 2026-02-20T03:16:13.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.904+0000 7f4a8085c640 1 --2- 10.20.193.28:0/527916538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a7c105320 0x7f4a7c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.904+0000 7f4a8085c640 1 --2- 10.20.193.28:0/527916538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c104980 0x7f4a7c104de0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.904+0000 7f4a8085c640 1 --2- 10.20.193.28:0/527916538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a7c10a980 0x7f4a7c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.904+0000 7f4a8085c640 1 -- 10.20.193.28:0/527916538 >> 10.20.193.28:0/527916538 conn(0x7f4a7c100680 msgr2=0x7f4a7c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.904+0000 7f4a8085c640 1 -- 10.20.193.28:0/527916538 shutdown_connections 2026-02-20T03:16:13.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.904+0000 7f4a8085c640 1 -- 10.20.193.28:0/527916538 wait complete. 2026-02-20T03:16:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.905+0000 7f4a8085c640 1 Processor -- start 2026-02-20T03:16:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.905+0000 7f4a8085c640 1 -- start start 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.905+0000 7f4a8085c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a7c104980 0x7f4a7c19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.905+0000 7f4a8085c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c105320 0x7f4a7c19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.905+0000 7f4a8085c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a7c10a980 0x7f4a7c1a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.905+0000 7f4a8085c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c114bf0 con 0x7f4a7c10a980 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.905+0000 7f4a8085c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c114a70 con 0x7f4a7c104980 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.905+0000 7f4a8085c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4a7c114d70 con 0x7f4a7c105320 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7ad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a7c104980 0x7f4a7c19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a7c10a980 0x7f4a7c1a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c105320 0x7f4a7c19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c105320 0x7f4a7c19d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56936/0 (socket says 10.20.193.28:56936) 2026-02-20T03:16:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7a575640 1 -- 10.20.193.28:0/4267326193 learned_addr learned my addr 10.20.193.28:0/4267326193 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7ad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a7c104980 0x7f4a7c19d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48860/0 (socket says 10.20.193.28:48860) 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7b577640 1 -- 10.20.193.28:0/4267326193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c105320 msgr2=0x7f4a7c19d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7b577640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c105320 0x7f4a7c19d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7b577640 1 -- 10.20.193.28:0/4267326193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a7c104980 msgr2=0x7f4a7c19d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7b577640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a7c104980 0x7f4a7c19d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7b577640 1 -- 10.20.193.28:0/4267326193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a7c1a2100 con 0x7f4a7c10a980 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7a575640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c105320 0x7f4a7c19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a7b577640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a7c10a980 0x7f4a7c1a1980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00efc0 tx=0x7f4a6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a5bfff640 1 -- 10.20.193.28:0/4267326193 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c019070 con 0x7f4a7c10a980 2026-02-20T03:16:13.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a8085c640 1 -- 10.20.193.28:0/4267326193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a7c1a2390 con 0x7f4a7c10a980 2026-02-20T03:16:13.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a5bfff640 1 -- 10.20.193.28:0/4267326193 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4a6c0092d0 con 0x7f4a7c10a980 2026-02-20T03:16:13.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a5bfff640 1 -- 10.20.193.28:0/4267326193 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c007500 con 0x7f4a7c10a980 2026-02-20T03:16:13.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.906+0000 7f4a8085c640 1 -- 10.20.193.28:0/4267326193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a7c1a9c30 con 0x7f4a7c10a980 2026-02-20T03:16:13.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.909+0000 7f4a5bfff640 1 -- 10.20.193.28:0/4267326193 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4a6c0076a0 con 0x7f4a7c10a980 2026-02-20T03:16:13.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a83562e00 1 Processor -- start 2026-02-20T03:16:13.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a83562e00 1 -- start start 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b78a10 0x562f10b78df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b73040 0x562f10b73480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b739c0 0x562f10b7f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a83562e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562f10aeae50 con 0x562f10b73040 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a83562e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562f10abd9c0 con 0x562f10b78a10 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a83562e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562f10a6b240 con 0x562f10b739c0 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a7ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b73040 0x562f10b73480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a7ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b73040 0x562f10b73480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46608/0 (socket says 10.20.193.28:46608) 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a7ad76640 1 -- 10.20.193.28:0/1478261367 learned_addr learned my addr 10.20.193.28:0/1478261367 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a5bfff640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a500b0e20 0x7f4a500b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.910+0000 7f4a7ad76640 1 -- 10.20.193.28:0/1478261367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b739c0 msgr2=0x562f10b7f840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/1478261367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b739c0 0x562f10b7f840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a7ad76640 1 -- 10.20.193.28:0/1478261367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b78a10 msgr2=0x562f10b78df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/1478261367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b78a10 0x562f10b78df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a7ad76640 1 -- 10.20.193.28:0/1478261367 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f10a7e420 con 0x562f10b73040 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a5bfff640 1 -- 10.20.193.28:0/4267326193 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f4a6c0e08b0 con 0x7f4a7c10a980 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/1478261367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b73040 0x562f10b73480 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4a700045d0 tx=0x7f4a70009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2728b7d3a7d7091a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a7b577640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a500b0e20 0x7f4a500b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a477fe640 1 -- 10.20.193.28:0/1478261367 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70010630 con 0x562f10b73040 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a477fe640 1 -- 10.20.193.28:0/1478261367 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4a70010c70 con 0x562f10b73040 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a477fe640 1 -- 10.20.193.28:0/1478261367 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000eca0 con 0x562f10b73040 2026-02-20T03:16:13.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a83562e00 1 -- 10.20.193.28:0/1478261367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b73040 msgr2=0x562f10b73480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a83562e00 1 --2- 10.20.193.28:0/1478261367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b73040 0x562f10b73480 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4a700045d0 tx=0x7f4a70009c70 comp rx=0 tx=0).stop 2026-02-20T03:16:13.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a7b577640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a500b0e20 0x7f4a500b32e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0a8610 tx=0x7f4a6c009e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a83562e00 1 -- 10.20.193.28:0/1478261367 shutdown_connections 2026-02-20T03:16:13.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a83562e00 1 --2- 10.20.193.28:0/1478261367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b739c0 0x562f10b7f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a83562e00 1 --2- 10.20.193.28:0/1478261367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b73040 0x562f10b73480 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a83562e00 1 --2- 10.20.193.28:0/1478261367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b78a10 0x562f10b78df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.911+0000 7f4a83562e00 1 -- 10.20.193.28:0/1478261367 >> 10.20.193.28:0/1478261367 conn(0x562f10b2d290 msgr2=0x562f10b68d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.912+0000 7f4a83562e00 1 -- 10.20.193.28:0/1478261367 shutdown_connections 2026-02-20T03:16:13.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.912+0000 7f4a83562e00 1 -- 10.20.193.28:0/1478261367 wait complete. 2026-02-20T03:16:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.913+0000 7f4a83562e00 1 -- start start 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.913+0000 7f4a83562e00 1 Processor -- start 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.913+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10b962d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.913+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 0x562f10b96810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.913+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 0x562f10b94a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.913+0000 7f4a83562e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562f10ab98f0 con 0x562f10b739c0 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.913+0000 7f4a83562e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562f108abf50 con 0x562f10b73040 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.913+0000 7f4a83562e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562f10b95190 con 0x562f10b78a10 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10b962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10b962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48872/0 (socket says 10.20.193.28:48872) 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 -- 10.20.193.28:0/2124494010 learned_addr learned my addr 10.20.193.28:0/2124494010 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 0x562f10b94a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 0x562f10b96810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 -- 10.20.193.28:0/2124494010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 msgr2=0x562f10b94a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 0x562f10b94a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 -- 10.20.193.28:0/2124494010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 msgr2=0x562f10b96810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 0x562f10b96810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 -- 10.20.193.28:0/2124494010 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f10b6fd20 con 0x562f10b73040 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 0x562f10b96810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a7a575640 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10b962d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4a64038690 tx=0x7f4a6403a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e0a6af503beaa49 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a44ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2124494010 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a640040c0 con 0x562f10b73040 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2124494010 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4a64033070 con 0x562f10b73040 2026-02-20T03:16:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2124494010 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64038e50 con 0x562f10b73040 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.914+0000 7f4a83562e00 1 -- 10.20.193.28:0/2124494010 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1088eb40 con 0x562f10b73040 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2124494010 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f4a64036370 con 0x562f10b73040 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a44ff9640 10 client.25562 inactive, discarding osd_map(91..91 src has 1..91) 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 10 client.25562 _ll_register_callbacks cb 0x562f10af6f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 1 -- 10.20.193.28:0/2124494010 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562f10acb1a0 con 0x562f10b73040 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2124494010 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4a64038770 con 0x562f10b73040 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 10 client.25562 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 1 -- 10.20.193.28:0/2124494010 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x562f10a78230 con 0x562f10b73040 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2124494010 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f4a64004260 con 0x562f10b73040 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 10 client.25562 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 10 client.25562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:13.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 20 client.25562 populate_metadata read hostname 'trial028' 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562f10ba4ac0 0x562f10ba6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 4 client.25562 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.915+0000 7f4a83562e00 1 -- 10.20.193.28:0/2124494010 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f10ac55b0 con 0x562f10ba4ac0 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.916+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562f10ba4ac0 0x562f10ba6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.916+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562f10ba4ac0 0x562f10ba6f10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4384d4157ced9a92 server_cookie=27774787f215f118 in_seq=0 out_seq=0 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.916+0000 7f4a44ff9640 10 client.25562 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2124494010 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562f10ac55b0 con 0x562f10ba4ac0 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a44ff9640 10 client.25562 handle_command_reply: tid=0 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 client.25562 shutdown 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 -- 10.20.193.28:0/2124494010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 msgr2=0x562f10b962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10b962d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4a64038690 tx=0x7f4a6403a040 comp rx=0 tx=0).stop 2026-02-20T03:16:13.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 -- 10.20.193.28:0/2124494010 shutdown_connections 2026-02-20T03:16:13.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562f10ba4ac0 0x562f10ba6f10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 0x562f10b94a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 0x562f10b96810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2124494010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10b962d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 -- 10.20.193.28:0/2124494010 >> 10.20.193.28:0/2124494010 conn(0x562f10b2d290 msgr2=0x562f10b69440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a44ff9640 0 client.25562 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:13.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 -- 10.20.193.28:0/2124494010 shutdown_connections 2026-02-20T03:16:13.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 1 -- 10.20.193.28:0/2124494010 wait complete. 2026-02-20T03:16:13.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.917+0000 7f4a83562e00 20 client.25562 trim_cache size 0 max 16384 2026-02-20T03:16:13.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.926+0000 7f4a83562e00 1 Processor -- start 2026-02-20T03:16:13.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.926+0000 7f4a83562e00 1 -- start start 2026-02-20T03:16:13.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.926+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10ba1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.926+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 0x562f10b77850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.926+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 0x562f10b69520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.926+0000 7f4a83562e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4a200122f0 con 0x562f10b739c0 2026-02-20T03:16:13.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.926+0000 7f4a83562e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2000fbc0 con 0x562f10b73040 2026-02-20T03:16:13.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.926+0000 7f4a83562e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2000da10 con 0x562f10b78a10 2026-02-20T03:16:13.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10ba1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10ba1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48880/0 (socket says 10.20.193.28:48880) 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 0x562f10b77850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 -- 10.20.193.28:0/1418739755 learned_addr learned my addr 10.20.193.28:0/1418739755 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 --2- 10.20.193.28:0/1418739755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 0x562f10b69520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 -- 10.20.193.28:0/1418739755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 msgr2=0x562f10b69520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 --2- 10.20.193.28:0/1418739755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 0x562f10b69520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 -- 10.20.193.28:0/1418739755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 msgr2=0x562f10b77850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 --2- 10.20.193.28:0/1418739755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 0x562f10b77850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 -- 10.20.193.28:0/1418739755 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f10b93950 con 0x562f10b73040 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a7a575640 1 --2- 10.20.193.28:0/1418739755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10ba1800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4a64002410 tx=0x7f4a6404b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dacda3757a19d164 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a46ffd640 1 -- 10.20.193.28:0/1418739755 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64059070 con 0x562f10b73040 2026-02-20T03:16:13.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a46ffd640 1 -- 10.20.193.28:0/1418739755 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4a64033070 con 0x562f10b73040 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.927+0000 7f4a46ffd640 1 -- 10.20.193.28:0/1418739755 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64051940 con 0x562f10b73040 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 -- 10.20.193.28:0/1418739755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 msgr2=0x562f10ba1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 --2- 10.20.193.28:0/1418739755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10ba1800 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4a64002410 tx=0x7f4a6404b000 comp rx=0 tx=0).stop 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 -- 10.20.193.28:0/1418739755 shutdown_connections 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 --2- 10.20.193.28:0/1418739755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b78a10 0x562f10b69520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 --2- 10.20.193.28:0/1418739755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b739c0 0x562f10b77850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 --2- 10.20.193.28:0/1418739755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b73040 0x562f10ba1800 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 -- 10.20.193.28:0/1418739755 >> 10.20.193.28:0/1418739755 conn(0x562f10b2d290 msgr2=0x562f10ba10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 -- 10.20.193.28:0/1418739755 shutdown_connections 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 -- 10.20.193.28:0/1418739755 wait complete. 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 -- start start 2026-02-20T03:16:13.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.928+0000 7f4a83562e00 1 Processor -- start 2026-02-20T03:16:13.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b73040 0x562f10b9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b739c0 0x562f10b9cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a83562e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b78a10 0x562f10b99170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a83562e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2000e080 con 0x562f10b78a10 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a83562e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2000f4f0 con 0x562f10b739c0 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a83562e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2000e750 con 0x562f10b73040 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7ad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b739c0 0x562f10b9cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b73040 0x562f10b9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7ad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b739c0 0x562f10b9cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48892/0 (socket says 10.20.193.28:48892) 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7ad76640 1 -- 10.20.193.28:0/2430144649 learned_addr learned my addr 10.20.193.28:0/2430144649 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7a575640 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b78a10 0x562f10b99170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7ad76640 1 -- 10.20.193.28:0/2430144649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b73040 msgr2=0x562f10b9c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b73040 0x562f10b9c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7ad76640 1 -- 10.20.193.28:0/2430144649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b78a10 msgr2=0x562f10b99170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b78a10 0x562f10b99170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7ad76640 1 -- 10.20.193.28:0/2430144649 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f10b6fb50 con 0x562f10b739c0 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7a575640 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b78a10 0x562f10b99170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a7ad76640 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b739c0 0x562f10b9cac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000e850 tx=0x7f4a7000e880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9444fd4da9924488 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a44ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2430144649 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000eaf0 con 0x562f10b739c0 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2430144649 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4a700108d0 con 0x562f10b739c0 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2430144649 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70029830 con 0x562f10b739c0 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.929+0000 7f4a83562e00 1 -- 10.20.193.28:0/2430144649 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1079c870 con 0x562f10b739c0 2026-02-20T03:16:13.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2430144649 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7f4a700299d0 con 0x562f10b739c0 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 10 client.25568 _ll_register_callbacks cb 0x7f4a70005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 1 -- 10.20.193.28:0/2430144649 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562f10a6fb00 con 0x562f10b739c0 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2430144649 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4a70035060 con 0x562f10b739c0 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 10 client.25568 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 1 -- 10.20.193.28:0/2430144649 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x562f10a5d440 con 0x562f10b739c0 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2430144649 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f4a70029bd0 con 0x562f10b739c0 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 10 client.25568 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 10 client.25568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 20 client.25568 populate_metadata read hostname 'trial028' 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562f10c106c0 0x562f10c12b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 4 client.25568 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a83562e00 1 -- 10.20.193.28:0/2430144649 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f4a70010c70 con 0x562f10c106c0 2026-02-20T03:16:13.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.930+0000 7f4a7a575640 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562f10c106c0 0x562f10c12b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a7a575640 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562f10c106c0 0x562f10c12b80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae5b0dd2fe683b6 server_cookie=78ecc6979e12f439 in_seq=0 out_seq=0 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a44ff9640 10 client.25568 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a44ff9640 1 -- 10.20.193.28:0/2430144649 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f4a70010c70 con 0x562f10c106c0 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a44ff9640 10 client.25568 handle_command_reply: tid=0 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 client.25568 shutdown 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 -- 10.20.193.28:0/2430144649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b739c0 msgr2=0x562f10b9cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b739c0 0x562f10b9cac0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000e850 tx=0x7f4a7000e880 comp rx=0 tx=0).stop 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 -- 10.20.193.28:0/2430144649 shutdown_connections 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562f10c106c0 0x562f10c12b80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562f10b78a10 0x562f10b99170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562f10b739c0 0x562f10b9cac0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 --2- 10.20.193.28:0/2430144649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562f10b73040 0x562f10b9c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 -- 10.20.193.28:0/2430144649 >> 10.20.193.28:0/2430144649 conn(0x562f10b2d290 msgr2=0x562f10ba4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a44ff9640 0 client.25568 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:13.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 -- 10.20.193.28:0/2430144649 shutdown_connections 2026-02-20T03:16:13.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.931+0000 7f4a83562e00 1 -- 10.20.193.28:0/2430144649 wait complete. 2026-02-20T03:16:13.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a83562e00 20 client.25568 trim_cache size 0 max 16384 2026-02-20T03:16:13.940 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:16:13.940 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:16:13.941 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:16:13.941 INFO:teuthology.orchestra.run.trial028.stdout: "6515be3d-14e9-42ae-8681-32b97bfedc0c": { 2026-02-20T03:16:13.941 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:16:13.941 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "6515be3d-14e9-42ae-8681-32b97bfedc0c", 2026-02-20T03:16:13.941 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:16:13.941 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:13.941 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:13.941 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:16:13.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 -- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a500b0e20 msgr2=0x7f4a500b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a500b0e20 0x7f4a500b32e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0a8610 tx=0x7f4a6c009e90 comp rx=0 tx=0).stop 2026-02-20T03:16:13.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 -- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a7c10a980 msgr2=0x7f4a7c1a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:13.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a7c10a980 0x7f4a7c1a1980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c00efc0 tx=0x7f4a6c00c490 comp rx=0 tx=0).stop 2026-02-20T03:16:13.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 -- 10.20.193.28:0/4267326193 shutdown_connections 2026-02-20T03:16:13.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a500b0e20 0x7f4a500b32e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a7c10a980 0x7f4a7c1a1980 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a7c105320 0x7f4a7c19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 --2- 10.20.193.28:0/4267326193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a7c104980 0x7f4a7c19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:13.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 -- 10.20.193.28:0/4267326193 >> 10.20.193.28:0/4267326193 conn(0x7f4a7c100680 msgr2=0x7f4a7c100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:13.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 -- 10.20.193.28:0/4267326193 shutdown_connections 2026-02-20T03:16:13.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:13.932+0000 7f4a8085c640 1 -- 10.20.193.28:0/4267326193 wait complete. 2026-02-20T03:16:14.033 INFO:tasks.cephfs.filesystem:scrub status for tag:6515be3d-14e9-42ae-8681-32b97bfedc0c - {'path': '/', 'tag': '6515be3d-14e9-42ae-8681-32b97bfedc0c', 'options': 'recursive,force'} 2026-02-20T03:16:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:14 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:16:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:14 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:14 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:16:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:14 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:14 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:16:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:14 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:14.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:14 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:16:14.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:14 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:14.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:14 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:16:14.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:14 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:14.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:14 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:16:14.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:14 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:14.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:14 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:16:14.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:14 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:14.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:14 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:16:14.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:14 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:14.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:14 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:16:14.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:14 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:15.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:15 trial177 ceph-mon[43181]: pgmap v225: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-20T03:16:15.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:15 trial126 ceph-mon[38476]: pgmap v225: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-20T03:16:15.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:15 trial028 ceph-mon[38552]: pgmap v225: 129 pgs: 129 active+clean; 679 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-20T03:16:16.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.783+0000 7fae11a7f640 1 -- 10.20.193.28:0/1580613572 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 msgr2=0x7fae0c075e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:16.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.783+0000 7fae11a7f640 1 --2- 10.20.193.28:0/1580613572 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 0x7fae0c075e60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009a30 tx=0x7fadf402f220 comp rx=0 tx=0).stop 2026-02-20T03:16:16.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.783+0000 7fae11a7f640 1 -- 10.20.193.28:0/1580613572 shutdown_connections 2026-02-20T03:16:16.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.783+0000 7fae11a7f640 1 --2- 10.20.193.28:0/1580613572 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae0c10a5d0 0x7fae0c10ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.783+0000 7fae11a7f640 1 --2- 10.20.193.28:0/1580613572 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 0x7fae0c075e60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.783+0000 7fae11a7f640 1 --2- 10.20.193.28:0/1580613572 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae0c077070 0x7fae0c0754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.783+0000 7fae11a7f640 1 -- 10.20.193.28:0/1580613572 >> 10.20.193.28:0/1580613572 conn(0x7fae0c0fde10 msgr2=0x7fae0c100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:16.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.783+0000 7fae11a7f640 1 -- 10.20.193.28:0/1580613572 shutdown_connections 2026-02-20T03:16:16.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.783+0000 7fae11a7f640 1 -- 10.20.193.28:0/1580613572 wait complete. 2026-02-20T03:16:16.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae11a7f640 1 Processor -- start 2026-02-20T03:16:16.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae11a7f640 1 -- start start 2026-02-20T03:16:16.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae11a7f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 0x7fae0c19ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae11a7f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae0c077070 0x7fae0c19cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae11a7f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae0c10a5d0 0x7fae0c1a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae11a7f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c110420 con 0x7fae0c075a00 2026-02-20T03:16:16.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae11a7f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c1102a0 con 0x7fae0c077070 2026-02-20T03:16:16.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae11a7f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c1105a0 con 0x7fae0c10a5d0 2026-02-20T03:16:16.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae10a7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 0x7fae0c19ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae03fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae0c077070 0x7fae0c19cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae10a7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 0x7fae0c19ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44918/0 (socket says 10.20.193.28:44918) 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae10a7d640 1 -- 10.20.193.28:0/666109096 learned_addr learned my addr 10.20.193.28:0/666109096 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae1127e640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae0c10a5d0 0x7fae0c1a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae10a7d640 1 -- 10.20.193.28:0/666109096 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae0c10a5d0 msgr2=0x7fae0c1a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae10a7d640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae0c10a5d0 0x7fae0c1a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae10a7d640 1 -- 10.20.193.28:0/666109096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae0c077070 msgr2=0x7fae0c19cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae10a7d640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae0c077070 0x7fae0c19cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.784+0000 7fae10a7d640 1 -- 10.20.193.28:0/666109096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c1a4730 con 0x7fae0c075a00 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.785+0000 7fae10a7d640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 0x7fae0c19ca80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00ea10 tx=0x7fadfc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.785+0000 7fae01ffb640 1 -- 10.20.193.28:0/666109096 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00ce50 con 0x7fae0c075a00 2026-02-20T03:16:16.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.785+0000 7fae11a7f640 1 -- 10.20.193.28:0/666109096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0c1a4a20 con 0x7fae0c075a00 2026-02-20T03:16:16.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.785+0000 7fae01ffb640 1 -- 10.20.193.28:0/666109096 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fadfc004570 con 0x7fae0c075a00 2026-02-20T03:16:16.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.785+0000 7fae01ffb640 1 -- 10.20.193.28:0/666109096 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc010690 con 0x7fae0c075a00 2026-02-20T03:16:16.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.785+0000 7fae11a7f640 1 -- 10.20.193.28:0/666109096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0c1a4f90 con 0x7fae0c075a00 2026-02-20T03:16:16.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.787+0000 7fae01ffb640 1 -- 10.20.193.28:0/666109096 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fadfc020030 con 0x7fae0c075a00 2026-02-20T03:16:16.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae15c44e00 1 Processor -- start 2026-02-20T03:16:16.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae15c44e00 1 -- start start 2026-02-20T03:16:16.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193732c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x556193737950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x55619373a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae15c44e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55619367a8f0 con 0x556193732890 2026-02-20T03:16:16.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae15c44e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5561936282e0 con 0x556193737f70 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae15c44e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556193676820 con 0x5561937331d0 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae10a7d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x556193737950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae1127e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193732c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae10a7d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x556193737950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33162/0 (socket says 10.20.193.28:33162) 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae10a7d640 1 -- 10.20.193.28:0/4207636645 learned_addr learned my addr 10.20.193.28:0/4207636645 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae03fff640 1 --2- 10.20.193.28:0/4207636645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x55619373a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae10a7d640 1 -- 10.20.193.28:0/4207636645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 msgr2=0x55619373a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae10a7d640 1 --2- 10.20.193.28:0/4207636645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x55619373a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae10a7d640 1 -- 10.20.193.28:0/4207636645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 msgr2=0x556193732c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:16.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae10a7d640 1 --2- 10.20.193.28:0/4207636645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193732c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.788+0000 7fae10a7d640 1 -- 10.20.193.28:0/4207636645 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619361a5a0 con 0x5561937331d0 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae10a7d640 1 --2- 10.20.193.28:0/4207636645 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x556193737950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0e4b90 tx=0x7fadfc0e9520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e414fd96abf2b1f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fadd8ffe640 1 -- 10.20.193.28:0/4207636645 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0f4070 con 0x5561937331d0 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fadd8ffe640 1 -- 10.20.193.28:0/4207636645 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fadfc0e9e40 con 0x5561937331d0 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fadd8ffe640 1 -- 10.20.193.28:0/4207636645 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0ee800 con 0x5561937331d0 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae01ffb640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fade80b0fc0 0x7fade80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae15c44e00 1 -- 10.20.193.28:0/4207636645 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 msgr2=0x556193737950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4207636645 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x556193737950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0e4b90 tx=0x7fadfc0e9520 comp rx=0 tx=0).stop 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae01ffb640 1 -- 10.20.193.28:0/666109096 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fadfc0e0ad0 con 0x7fae0c075a00 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae15c44e00 1 -- 10.20.193.28:0/4207636645 shutdown_connections 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4207636645 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x55619373a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4207636645 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x556193737950 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4207636645 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193732c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae15c44e00 1 -- 10.20.193.28:0/4207636645 >> 10.20.193.28:0/4207636645 conn(0x5561937216f0 msgr2=0x556193730f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae15c44e00 1 -- 10.20.193.28:0/4207636645 shutdown_connections 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae15c44e00 1 -- 10.20.193.28:0/4207636645 wait complete. 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.789+0000 7fae1127e640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fade80b0fc0 0x7fade80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.790+0000 7fae1127e640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fade80b0fc0 0x7fade80b3480 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fae08009e40 tx=0x7fae0800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae15c44e00 1 -- start start 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae15c44e00 1 Processor -- start 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x55619374b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561937331d0 0x55619374bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193737f70 0x556193752aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae15c44e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561936220c0 con 0x556193732890 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae15c44e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55619373b070 con 0x5561937331d0 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae15c44e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556193753030 con 0x556193737f70 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae10a7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x55619374b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae10a7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x55619374b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44948/0 (socket says 10.20.193.28:44948) 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae10a7d640 1 -- 10.20.193.28:0/1053928743 learned_addr learned my addr 10.20.193.28:0/1053928743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae1127e640 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193737f70 0x556193752aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.791+0000 7fae03fff640 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561937331d0 0x55619374bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae10a7d640 1 -- 10.20.193.28:0/1053928743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193737f70 msgr2=0x556193752aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae10a7d640 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193737f70 0x556193752aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae10a7d640 1 -- 10.20.193.28:0/1053928743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561937331d0 msgr2=0x55619374bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae10a7d640 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561937331d0 0x55619374bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae10a7d640 1 -- 10.20.193.28:0/1053928743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556193744cf0 con 0x556193732890 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae10a7d640 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x55619374b5e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0a46d0 tx=0x7fadfc0e4080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d6f554c7aed487 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fadd1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fadd1ffb640 1 -- 10.20.193.28:0/1053928743 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0a4510 con 0x556193732890 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fadd1ffb640 1 -- 10.20.193.28:0/1053928743 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fadfc0a8fa0 con 0x556193732890 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fadd1ffb640 1 -- 10.20.193.28:0/1053928743 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0a7dc0 con 0x556193732890 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae15c44e00 1 -- 10.20.193.28:0/1053928743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556193636820 con 0x556193732890 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fadd1ffb640 1 -- 10.20.193.28:0/1053928743 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fadfc002890 con 0x556193732890 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae15c44e00 10 client.15516 _ll_register_callbacks cb 0x556193625ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae15c44e00 1 -- 10.20.193.28:0/1053928743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561935fcbd0 con 0x556193732890 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fadd1ffb640 1 -- 10.20.193.28:0/1053928743 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fadfc0a7fa0 con 0x556193732890 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae15c44e00 10 client.15516 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:16.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fae15c44e00 1 -- 10.20.193.28:0/1053928743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55619363b380 con 0x556193732890 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.792+0000 7fadd1ffb640 1 -- 10.20.193.28:0/1053928743 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fadfc0a8160 con 0x556193732890 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.793+0000 7fae15c44e00 10 client.15516 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.793+0000 7fae15c44e00 10 client.15516 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.793+0000 7fae15c44e00 20 client.15516 populate_metadata read hostname 'trial028' 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.793+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556193756d60 0x556193759200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.793+0000 7fae15c44e00 4 client.15516 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.793+0000 7fae15c44e00 1 -- 10.20.193.28:0/1053928743 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55619364b6b0 con 0x556193756d60 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.793+0000 7fae03fff640 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556193756d60 0x556193759200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.793+0000 7fae03fff640 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556193756d60 0x556193759200 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db319f6540ec752b server_cookie=78348d752395c803 in_seq=0 out_seq=0 2026-02-20T03:16:16.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.793+0000 7fadd1ffb640 10 client.15516 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:16.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fadd1ffb640 1 -- 10.20.193.28:0/1053928743 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55619364b6b0 con 0x556193756d60 2026-02-20T03:16:16.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fadd1ffb640 10 client.15516 handle_command_reply: tid=0 2026-02-20T03:16:16.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 client.15516 shutdown 2026-02-20T03:16:16.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 -- 10.20.193.28:0/1053928743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 msgr2=0x55619374b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:16.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x55619374b5e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0a46d0 tx=0x7fadfc0e4080 comp rx=0 tx=0).stop 2026-02-20T03:16:16.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 -- 10.20.193.28:0/1053928743 shutdown_connections 2026-02-20T03:16:16.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556193756d60 0x556193759200 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193737f70 0x556193752aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561937331d0 0x55619374bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fadd1ffb640 0 client.15516 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:16.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1053928743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x55619374b5e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 -- 10.20.193.28:0/1053928743 >> 10.20.193.28:0/1053928743 conn(0x5561937216f0 msgr2=0x556193730f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:16.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 -- 10.20.193.28:0/1053928743 shutdown_connections 2026-02-20T03:16:16.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.794+0000 7fae15c44e00 1 -- 10.20.193.28:0/1053928743 wait complete. 2026-02-20T03:16:16.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.795+0000 7fae15c44e00 20 client.15516 trim_cache size 0 max 16384 2026-02-20T03:16:16.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae15c44e00 1 Processor -- start 2026-02-20T03:16:16.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae15c44e00 1 -- start start 2026-02-20T03:16:16.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193748280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x5561937529c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x5561937487c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae15c44e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fadb00122a0 con 0x556193732890 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae15c44e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fadb000fb70 con 0x556193737f70 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae15c44e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fadb000d9c0 con 0x5561937331d0 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae10a7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193748280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae03fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x5561937529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae10a7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193748280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44952/0 (socket says 10.20.193.28:44952) 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae10a7d640 1 -- 10.20.193.28:0/1866309646 learned_addr learned my addr 10.20.193.28:0/1866309646 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae1127e640 1 --2- 10.20.193.28:0/1866309646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x5561937487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae10a7d640 1 -- 10.20.193.28:0/1866309646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 msgr2=0x5561937529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae10a7d640 1 --2- 10.20.193.28:0/1866309646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x5561937529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae10a7d640 1 -- 10.20.193.28:0/1866309646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 msgr2=0x5561937487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:16.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae10a7d640 1 --2- 10.20.193.28:0/1866309646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x5561937487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.802+0000 7fae10a7d640 1 -- 10.20.193.28:0/1866309646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556193744b20 con 0x556193732890 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae10a7d640 1 --2- 10.20.193.28:0/1866309646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193748280 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0a85a0 tx=0x7fadfc0af030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965204ecec3d193e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fadd3fff640 1 -- 10.20.193.28:0/1866309646 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0a8670 con 0x556193732890 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fadd3fff640 1 -- 10.20.193.28:0/1866309646 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5561935fcbd0 con 0x556193732890 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fadd3fff640 1 -- 10.20.193.28:0/1866309646 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0a8160 con 0x556193732890 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae15c44e00 1 -- 10.20.193.28:0/1866309646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 msgr2=0x556193748280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1866309646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193748280 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0a85a0 tx=0x7fadfc0af030 comp rx=0 tx=0).stop 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae15c44e00 1 -- 10.20.193.28:0/1866309646 shutdown_connections 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1866309646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x5561937487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1866309646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561937331d0 0x5561937529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae15c44e00 1 --2- 10.20.193.28:0/1866309646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556193732890 0x556193748280 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae15c44e00 1 -- 10.20.193.28:0/1866309646 >> 10.20.193.28:0/1866309646 conn(0x5561937216f0 msgr2=0x556193738b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae15c44e00 1 -- 10.20.193.28:0/1866309646 shutdown_connections 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.803+0000 7fae15c44e00 1 -- 10.20.193.28:0/1866309646 wait complete. 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae15c44e00 1 -- start start 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae15c44e00 1 Processor -- start 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193732890 0x55619374ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561937331d0 0x55619374f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae15c44e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x5561937520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae15c44e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fadb000e030 con 0x5561937331d0 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae15c44e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fadb000f4a0 con 0x556193737f70 2026-02-20T03:16:16.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae15c44e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fadb000e700 con 0x556193732890 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae10a7d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193732890 0x55619374ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae1127e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x5561937520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561937331d0 0x55619374f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae1127e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x5561937520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:58678/0 (socket says 10.20.193.28:58678) 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae1127e640 1 -- 10.20.193.28:0/4139126818 learned_addr learned my addr 10.20.193.28:0/4139126818 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae03fff640 1 -- 10.20.193.28:0/4139126818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193732890 msgr2=0x55619374ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae03fff640 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193732890 0x55619374ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae03fff640 1 -- 10.20.193.28:0/4139126818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 msgr2=0x5561937520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae03fff640 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x5561937520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae03fff640 1 -- 10.20.193.28:0/4139126818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561933da690 con 0x5561937331d0 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.804+0000 7fae03fff640 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561937331d0 0x55619374f160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fadf402f730 tx=0x7fadf4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83e8e98a51101f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fadd1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:16.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fadd1ffb640 1 -- 10.20.193.28:0/4139126818 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf404f020 con 0x5561937331d0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fadd1ffb640 1 -- 10.20.193.28:0/4139126818 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fadf4033040 con 0x5561937331d0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fadd1ffb640 1 -- 10.20.193.28:0/4139126818 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf40389d0 con 0x5561937331d0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 1 -- 10.20.193.28:0/4139126818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619363fb70 con 0x5561937331d0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fadd1ffb640 1 -- 10.20.193.28:0/4139126818 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(91..91 src has 1..91) ==== 9065+0+0 (secure 0 0 0) 0x7fadf4038b70 con 0x5561937331d0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fadd1ffb640 10 client.15522 inactive, discarding osd_map(91..91 src has 1..91) 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 10 client.15522 _ll_register_callbacks cb 0x7fadfc0e49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 1 -- 10.20.193.28:0/4139126818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556193688290 con 0x5561937331d0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fadd1ffb640 1 -- 10.20.193.28:0/4139126818 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fadf4038d70 con 0x5561937331d0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 10 client.15522 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 1 -- 10.20.193.28:0/4139126818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x556193745810 con 0x5561937331d0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fadd1ffb640 1 -- 10.20.193.28:0/4139126818 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fadf40040c0 con 0x5561937331d0 2026-02-20T03:16:16.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 10 client.15522 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:16.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 10 client.15522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:16.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 20 client.15522 populate_metadata read hostname 'trial028' 2026-02-20T03:16:16.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561937c2b60 0x5561937c5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:16.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 4 client.15522 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:16:16.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.805+0000 7fae15c44e00 1 -- 10.20.193.28:0/4139126818 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556193453520 con 0x5561937c2b60 2026-02-20T03:16:16.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.806+0000 7fae10a7d640 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561937c2b60 0x5561937c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:16.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.806+0000 7fae10a7d640 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561937c2b60 0x5561937c5020 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94d5a6bada164744 server_cookie=af347241fba38dfc in_seq=0 out_seq=0 2026-02-20T03:16:16.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.806+0000 7fadd1ffb640 10 client.15522 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:16.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fadd1ffb640 1 -- 10.20.193.28:0/4139126818 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556193453520 con 0x5561937c2b60 2026-02-20T03:16:16.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fadd1ffb640 10 client.15522 handle_command_reply: tid=0 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 client.15522 shutdown 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 -- 10.20.193.28:0/4139126818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561937331d0 msgr2=0x55619374f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561937331d0 0x55619374f160 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fadf402f730 tx=0x7fadf4005ef0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 -- 10.20.193.28:0/4139126818 shutdown_connections 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561937c2b60 0x5561937c5020 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556193737f70 0x5561937520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561937331d0 0x55619374f160 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 --2- 10.20.193.28:0/4139126818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556193732890 0x55619374ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fadd1ffb640 0 client.15522 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 -- 10.20.193.28:0/4139126818 >> 10.20.193.28:0/4139126818 conn(0x5561937216f0 msgr2=0x55619374ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 -- 10.20.193.28:0/4139126818 shutdown_connections 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 1 -- 10.20.193.28:0/4139126818 wait complete. 2026-02-20T03:16:16.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae15c44e00 20 client.15522 trim_cache size 0 max 16384 2026-02-20T03:16:16.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:16:16.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:16:16.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:16:16.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 -- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fade80b0fc0 msgr2=0x7fade80b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fade80b0fc0 0x7fade80b3480 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fae08009e40 tx=0x7fae0800b040 comp rx=0 tx=0).stop 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 -- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 msgr2=0x7fae0c19ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 0x7fae0c19ca80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00ea10 tx=0x7fadfc00eee0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 -- 10.20.193.28:0/666109096 shutdown_connections 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fade80b0fc0 0x7fade80b3480 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae0c10a5d0 0x7fae0c1a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae0c077070 0x7fae0c19cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 --2- 10.20.193.28:0/666109096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae0c075a00 0x7fae0c19ca80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 -- 10.20.193.28:0/666109096 >> 10.20.193.28:0/666109096 conn(0x7fae0c0fde10 msgr2=0x7fae0c1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.809+0000 7fae11a7f640 1 -- 10.20.193.28:0/666109096 shutdown_connections 2026-02-20T03:16:16.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:16.810+0000 7fae11a7f640 1 -- 10.20.193.28:0/666109096 wait complete. 2026-02-20T03:16:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:17 trial177 ceph-mon[43181]: pgmap v226: 129 pgs: 129 active+clean; 682 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2026-02-20T03:16:17.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:17 trial126 ceph-mon[38476]: pgmap v226: 129 pgs: 129 active+clean; 682 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2026-02-20T03:16:17.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:17 trial028 ceph-mon[38552]: pgmap v226: 129 pgs: 129 active+clean; 682 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2026-02-20T03:16:19.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:19 trial177 ceph-mon[43181]: pgmap v227: 129 pgs: 129 active+clean; 682 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-20T03:16:19.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:19 trial126 ceph-mon[38476]: pgmap v227: 129 pgs: 129 active+clean; 682 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-20T03:16:19.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:19 trial028 ceph-mon[38552]: pgmap v227: 129 pgs: 129 active+clean; 682 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2026-02-20T03:16:21.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:21 trial177 ceph-mon[43181]: pgmap v228: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 8 op/s 2026-02-20T03:16:21.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:21 trial126 ceph-mon[38476]: pgmap v228: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 8 op/s 2026-02-20T03:16:21.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:21 trial028 ceph-mon[38552]: pgmap v228: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 8 op/s 2026-02-20T03:16:23.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:23 trial177 ceph-mon[43181]: pgmap v229: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2026-02-20T03:16:23.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:16:23.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:16:23.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:23 trial126 ceph-mon[38476]: pgmap v229: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2026-02-20T03:16:23.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:16:23.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:16:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:23 trial028 ceph-mon[38552]: pgmap v229: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2026-02-20T03:16:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:16:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:16:25.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:25 trial177 ceph-mon[43181]: pgmap v230: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 7 op/s 2026-02-20T03:16:25.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:25 trial126 ceph-mon[38476]: pgmap v230: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 7 op/s 2026-02-20T03:16:25.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:25 trial028 ceph-mon[38552]: pgmap v230: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 7 op/s 2026-02-20T03:16:26.221 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:16:26.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2026-02-20T03:16:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 8]}]: dispatch 2026-02-20T03:16:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 9]}]: dispatch 2026-02-20T03:16:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2026-02-20T03:16:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2026-02-20T03:16:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2026-02-20T03:16:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2026-02-20T03:16:26.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:26 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2026-02-20T03:16:26.494 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:26.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2026-02-20T03:16:26.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 8]}]: dispatch 2026-02-20T03:16:26.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 9]}]: dispatch 2026-02-20T03:16:26.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2026-02-20T03:16:26.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2026-02-20T03:16:26.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2026-02-20T03:16:26.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2026-02-20T03:16:26.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:26 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2026-02-20T03:16:26.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]: dispatch 2026-02-20T03:16:26.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 8]}]: dispatch 2026-02-20T03:16:26.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 9]}]: dispatch 2026-02-20T03:16:26.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2026-02-20T03:16:26.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]: dispatch 2026-02-20T03:16:26.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2026-02-20T03:16:26.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2026-02-20T03:16:26.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:26 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]: dispatch 2026-02-20T03:16:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.665+0000 7f8365067640 1 -- 10.20.193.28:0/96515232 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8360108700 msgr2=0x7f8360108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.665+0000 7f8365067640 1 --2- 10.20.193.28:0/96515232 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8360108700 0x7f8360108ae0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f834c009a60 tx=0x7f834c02f260 comp rx=0 tx=0).stop 2026-02-20T03:16:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.665+0000 7f8365067640 1 -- 10.20.193.28:0/96515232 shutdown_connections 2026-02-20T03:16:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.665+0000 7f8365067640 1 --2- 10.20.193.28:0/96515232 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83601030a0 0x7f836010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.665+0000 7f8365067640 1 --2- 10.20.193.28:0/96515232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8360102700 0x7f8360102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.665+0000 7f8365067640 1 --2- 10.20.193.28:0/96515232 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8360108700 0x7f8360108ae0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.665+0000 7f8365067640 1 -- 10.20.193.28:0/96515232 >> 10.20.193.28:0/96515232 conn(0x7f83600fe440 msgr2=0x7f8360100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.665+0000 7f8365067640 1 -- 10.20.193.28:0/96515232 shutdown_connections 2026-02-20T03:16:26.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.665+0000 7f8365067640 1 -- 10.20.193.28:0/96515232 wait complete. 2026-02-20T03:16:26.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.666+0000 7f8365067640 1 Processor -- start 2026-02-20T03:16:26.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.666+0000 7f8365067640 1 -- start start 2026-02-20T03:16:26.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.666+0000 7f8365067640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8360102700 0x7f83601095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:26.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f8365067640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83601030a0 0x7f8360109b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:26.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f8365067640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8360108700 0x7f836010a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:26.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f8365067640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8360112970 con 0x7f8360102700 2026-02-20T03:16:26.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f8365067640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f83601127f0 con 0x7f83601030a0 2026-02-20T03:16:26.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f8365067640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8360112af0 con 0x7f8360108700 2026-02-20T03:16:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8360102700 0x7f83601095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8360102700 0x7f83601095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50746/0 (socket says 10.20.193.28:50746) 2026-02-20T03:16:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835ffff640 1 -- 10.20.193.28:0/3388398339 learned_addr learned my addr 10.20.193.28:0/3388398339 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f8364866640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8360108700 0x7f836010a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835f7fe640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83601030a0 0x7f8360109b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835ffff640 1 -- 10.20.193.28:0/3388398339 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8360108700 msgr2=0x7f836010a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835ffff640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8360108700 0x7f836010a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:26.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835ffff640 1 -- 10.20.193.28:0/3388398339 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83601030a0 msgr2=0x7f8360109b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835ffff640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83601030a0 0x7f8360109b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835ffff640 1 -- 10.20.193.28:0/3388398339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83601ad8f0 con 0x7f8360102700 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835ffff640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8360102700 0x7f83601095e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f834c02ffa0 tx=0x7f834c004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835d7fa640 1 -- 10.20.193.28:0/3388398339 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c038770 con 0x7f8360102700 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835d7fa640 1 -- 10.20.193.28:0/3388398339 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f834c038db0 con 0x7f8360102700 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f835d7fa640 1 -- 10.20.193.28:0/3388398339 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c042680 con 0x7f8360102700 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.667+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83601adb80 con 0x7f8360102700 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.668+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83601ae010 con 0x7f8360102700 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.668+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8360103e40 con 0x7f8360102700 2026-02-20T03:16:26.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.670+0000 7f835d7fa640 1 -- 10.20.193.28:0/3388398339 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f834c04a020 con 0x7f8360102700 2026-02-20T03:16:26.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.671+0000 7f835d7fa640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83340b0da0 0x7f83340b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:26.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.672+0000 7f835d7fa640 1 -- 10.20.193.28:0/3388398339 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9297+0+0 (secure 0 0 0) 0x7f834c105190 con 0x7f8360102700 2026-02-20T03:16:26.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.672+0000 7f835f7fe640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83340b0da0 0x7f83340b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:26.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.672+0000 7f835d7fa640 1 -- 10.20.193.28:0/3388398339 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f834c0cd570 con 0x7f8360102700 2026-02-20T03:16:26.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.672+0000 7f835f7fe640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83340b0da0 0x7f83340b3260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83500096f0 tx=0x7f8350009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:26.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.785+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83601ae340 con 0x7f8360102700 2026-02-20T03:16:26.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.786+0000 7f835d7fa640 1 -- 10.20.193.28:0/3388398339 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7f834c0d1220 con 0x7f8360102700 2026-02-20T03:16:26.789 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:16:26.789 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T03:15:38:113153+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:37.375812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:16:26.789 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83340b0da0 msgr2=0x7f83340b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83340b0da0 0x7f83340b3260 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f83500096f0 tx=0x7f8350009290 comp rx=0 tx=0).stop 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8360102700 msgr2=0x7f83601095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8360102700 0x7f83601095e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f834c02ffa0 tx=0x7f834c004300 comp rx=0 tx=0).stop 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 shutdown_connections 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83340b0da0 0x7f83340b3260 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8360108700 0x7f836010a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83601030a0 0x7f8360109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 --2- 10.20.193.28:0/3388398339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8360102700 0x7f83601095e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 >> 10.20.193.28:0/3388398339 conn(0x7f83600fe440 msgr2=0x7f83600feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 shutdown_connections 2026-02-20T03:16:26.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:26.787+0000 7f8365067640 1 -- 10.20.193.28:0/3388398339 wait complete. 2026-02-20T03:16:26.892 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 975a2bd --release --await' 2026-02-20T03:16:26.893 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 975a2bd --release --await 2026-02-20T03:16:27.153 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:27.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.348+0000 7fb715c7c640 1 -- 10.20.193.28:0/1980297460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb71010a980 msgr2=0x7fb71010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:27.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.348+0000 7fb715c7c640 1 --2- 10.20.193.28:0/1980297460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb71010a980 0x7fb71010ad60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb700009a60 tx=0x7fb70002f250 comp rx=0 tx=0).stop 2026-02-20T03:16:27.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.348+0000 7fb715c7c640 1 -- 10.20.193.28:0/1980297460 shutdown_connections 2026-02-20T03:16:27.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.348+0000 7fb715c7c640 1 --2- 10.20.193.28:0/1980297460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb710105320 0x7fb710111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.348+0000 7fb715c7c640 1 --2- 10.20.193.28:0/1980297460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb710104980 0x7fb710104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.348+0000 7fb715c7c640 1 --2- 10.20.193.28:0/1980297460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb71010a980 0x7fb71010ad60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.348+0000 7fb715c7c640 1 -- 10.20.193.28:0/1980297460 >> 10.20.193.28:0/1980297460 conn(0x7fb710100680 msgr2=0x7fb710102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:27.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.348+0000 7fb715c7c640 1 -- 10.20.193.28:0/1980297460 shutdown_connections 2026-02-20T03:16:27.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.348+0000 7fb715c7c640 1 -- 10.20.193.28:0/1980297460 wait complete. 2026-02-20T03:16:27.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.349+0000 7fb715c7c640 1 Processor -- start 2026-02-20T03:16:27.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.349+0000 7fb715c7c640 1 -- start start 2026-02-20T03:16:27.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.349+0000 7fb715c7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb710104980 0x7fb71019d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.349+0000 7fb715c7c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb710105320 0x7fb71019d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.349+0000 7fb715c7c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb71010a980 0x7fb7101a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb715c7c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb710114bf0 con 0x7fb710104980 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb715c7c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb710114a70 con 0x7fb71010a980 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb715c7c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb710114d70 con 0x7fb710105320 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb714c7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb710104980 0x7fb71019d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb707fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb710105320 0x7fb71019d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb707fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb710105320 0x7fb71019d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52604/0 (socket says 10.20.193.28:52604) 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb707fff640 1 -- 10.20.193.28:0/2085692163 learned_addr learned my addr 10.20.193.28:0/2085692163 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb71547b640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb71010a980 0x7fb7101a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb714c7a640 1 -- 10.20.193.28:0/2085692163 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb710105320 msgr2=0x7fb71019d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:27.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb714c7a640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb710105320 0x7fb71019d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb714c7a640 1 -- 10.20.193.28:0/2085692163 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb71010a980 msgr2=0x7fb7101a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:27.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb714c7a640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb71010a980 0x7fb7101a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb714c7a640 1 -- 10.20.193.28:0/2085692163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7101a20c0 con 0x7fb710104980 2026-02-20T03:16:27.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb714c7a640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb710104980 0x7fb71019d070 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb700009a60 tx=0x7fb700002a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:27.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb705ffb640 1 -- 10.20.193.28:0/2085692163 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70002fa70 con 0x7fb710104980 2026-02-20T03:16:27.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb705ffb640 1 -- 10.20.193.28:0/2085692163 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb700047030 con 0x7fb710104980 2026-02-20T03:16:27.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb715c7c640 1 -- 10.20.193.28:0/2085692163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7101a2350 con 0x7fb710104980 2026-02-20T03:16:27.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.350+0000 7fb705ffb640 1 -- 10.20.193.28:0/2085692163 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700038d40 con 0x7fb710104980 2026-02-20T03:16:27.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.351+0000 7fb715c7c640 1 -- 10.20.193.28:0/2085692163 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb710077530 con 0x7fb710104980 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.353+0000 7fb705ffb640 1 -- 10.20.193.28:0/2085692163 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb7000040d0 con 0x7fb710104980 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb71940ae00 1 Processor -- start 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb71940ae00 1 -- start start 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 0x55d8548b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b2f60 0x55d8548b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b38e0 0x55d8548be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb71940ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d854804a20 con 0x55d8548b2f60 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb71940ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d8547b22a0 con 0x55d8548b38e0 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb71940ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d854800950 con 0x55d8548b1dd0 2026-02-20T03:16:27.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb714c7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b2f60 0x55d8548b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb71547b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 0x55d8548b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb714c7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b2f60 0x55d8548b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50762/0 (socket says 10.20.193.28:50762) 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb714c7a640 1 -- 10.20.193.28:0/4103570254 learned_addr learned my addr 10.20.193.28:0/4103570254 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.354+0000 7fb707fff640 1 --2- 10.20.193.28:0/4103570254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b38e0 0x55d8548be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb714c7a640 1 -- 10.20.193.28:0/4103570254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 msgr2=0x55d8548b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb714c7a640 1 --2- 10.20.193.28:0/4103570254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 0x55d8548b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb714c7a640 1 -- 10.20.193.28:0/4103570254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b38e0 msgr2=0x55d8548be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb714c7a640 1 --2- 10.20.193.28:0/4103570254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b38e0 0x55d8548be2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb714c7a640 1 -- 10.20.193.28:0/4103570254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8547950f0 con 0x55d8548b2f60 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb714c7a640 1 --2- 10.20.193.28:0/4103570254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b2f60 0x55d8548b33a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb700110ea0 tx=0x7fb7001157c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985f3f15c8d2e633 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb6dd4e4640 1 -- 10.20.193.28:0/4103570254 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70011c070 con 0x55d8548b2f60 2026-02-20T03:16:27.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb6dd4e4640 1 -- 10.20.193.28:0/4103570254 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb700033030 con 0x55d8548b2f60 2026-02-20T03:16:27.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb6dd4e4640 1 -- 10.20.193.28:0/4103570254 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700112a90 con 0x55d8548b2f60 2026-02-20T03:16:27.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb705ffb640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6ec0b0e20 0x7fb6ec0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb705ffb640 1 -- 10.20.193.28:0/2085692163 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fb70010cd70 con 0x7fb710104980 2026-02-20T03:16:27.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb71940ae00 1 -- 10.20.193.28:0/4103570254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b2f60 msgr2=0x55d8548b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:27.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb71940ae00 1 --2- 10.20.193.28:0/4103570254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b2f60 0x55d8548b33a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb700110ea0 tx=0x7fb7001157c0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.355+0000 7fb71547b640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6ec0b0e20 0x7fb6ec0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.356+0000 7fb71547b640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6ec0b0e20 0x7fb6ec0b32e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb70c007610 tx=0x7fb70c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:27.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.356+0000 7fb71940ae00 1 -- 10.20.193.28:0/4103570254 shutdown_connections 2026-02-20T03:16:27.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.356+0000 7fb71940ae00 1 --2- 10.20.193.28:0/4103570254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b38e0 0x55d8548be2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.356+0000 7fb71940ae00 1 --2- 10.20.193.28:0/4103570254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b2f60 0x55d8548b33a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.356+0000 7fb71940ae00 1 --2- 10.20.193.28:0/4103570254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 0x55d8548b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.356+0000 7fb71940ae00 1 -- 10.20.193.28:0/4103570254 >> 10.20.193.28:0/4103570254 conn(0x55d8548a91b0 msgr2=0x55d8548b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.356+0000 7fb71940ae00 1 -- 10.20.193.28:0/4103570254 shutdown_connections 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.356+0000 7fb71940ae00 1 -- 10.20.193.28:0/4103570254 wait complete. 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.357+0000 7fb71940ae00 1 -- start start 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.357+0000 7fb71940ae00 1 Processor -- start 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b1dd0 0x55d8548cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b2f60 0x55d8548cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71940ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d8547ac080 con 0x55d8548b38e0 2026-02-20T03:16:27.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71940ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d8548be810 con 0x55d8548b1dd0 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71940ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d8548cacb0 con 0x55d8548b2f60 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71547b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb714c7a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b1dd0 0x55d8548cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71547b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50774/0 (socket says 10.20.193.28:50774) 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71547b640 1 -- 10.20.193.28:0/1410485246 learned_addr learned my addr 10.20.193.28:0/1410485246 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb707fff640 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b2f60 0x55d8548cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71547b640 1 -- 10.20.193.28:0/1410485246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b2f60 msgr2=0x55d8548cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71547b640 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b2f60 0x55d8548cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71547b640 1 -- 10.20.193.28:0/1410485246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b1dd0 msgr2=0x55d8548cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71547b640 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b1dd0 0x55d8548cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71547b640 1 -- 10.20.193.28:0/1410485246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8548c3c30 con 0x55d8548b38e0 2026-02-20T03:16:27.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.358+0000 7fb71547b640 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548ca720 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0045e0 tx=0x7fb70c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf79abca9c38b1a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb6ce7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/1410485246 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c029070 con 0x55d8548b38e0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/1410485246 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb70c014df0 con 0x55d8548b38e0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/1410485246 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c016800 con 0x55d8548b38e0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb71940ae00 1 -- 10.20.193.28:0/1410485246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8545d5da0 con 0x55d8548b38e0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/1410485246 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fb70c0169a0 con 0x55d8548b38e0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb6ce7fc640 10 client.15540 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb71940ae00 10 client.15540 _ll_register_callbacks cb 0x55d8547affb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb71940ae00 1 -- 10.20.193.28:0/1410485246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d85480c610 con 0x55d8548b38e0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/1410485246 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb70c016ba0 con 0x55d8548b38e0 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb71940ae00 10 client.15540 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:27.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.359+0000 7fb71940ae00 1 -- 10.20.193.28:0/1410485246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55d8547c2020 con 0x55d8548b38e0 2026-02-20T03:16:27.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.360+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/1410485246 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fb70c036020 con 0x55d8548b38e0 2026-02-20T03:16:27.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.360+0000 7fb71940ae00 10 client.15540 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:27.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.360+0000 7fb71940ae00 10 client.15540 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:16:27.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.360+0000 7fb71940ae00 20 client.15540 populate_metadata read hostname 'trial028' 2026-02-20T03:16:27.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.360+0000 7fb71940ae00 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8548da7b0 0x55d8548dcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.360+0000 7fb71940ae00 4 client.15540 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:27.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.360+0000 7fb71940ae00 1 -- 10.20.193.28:0/1410485246 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d854786b80 con 0x55d8548da7b0 2026-02-20T03:16:27.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.360+0000 7fb714c7a640 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8548da7b0 0x55d8548dcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.361+0000 7fb714c7a640 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8548da7b0 0x55d8548dcc50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c1b019c51a3e7ff server_cookie=74a8a49b04fca5b6 in_seq=0 out_seq=0 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.361+0000 7fb6ce7fc640 10 client.15540 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.361+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/1410485246 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d854786b80 con 0x55d8548da7b0 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.361+0000 7fb6ce7fc640 10 client.15540 handle_command_reply: tid=0 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 client.15540 shutdown 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 -- 10.20.193.28:0/1410485246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 msgr2=0x55d8548ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548ca720 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0045e0 tx=0x7fb70c004bb0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 -- 10.20.193.28:0/1410485246 shutdown_connections 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8548da7b0 0x55d8548dcc50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548ca720 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b2f60 0x55d8548cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 --2- 10.20.193.28:0/1410485246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b1dd0 0x55d8548cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 -- 10.20.193.28:0/1410485246 >> 10.20.193.28:0/1410485246 conn(0x55d8548a91b0 msgr2=0x55d8548ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:27.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb6ce7fc640 0 client.15540 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:27.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 -- 10.20.193.28:0/1410485246 shutdown_connections 2026-02-20T03:16:27.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 1 -- 10.20.193.28:0/1410485246 wait complete. 2026-02-20T03:16:27.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.362+0000 7fb71940ae00 20 client.15540 trim_cache size 0 max 16384 2026-02-20T03:16:27.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.370+0000 7fb71940ae00 1 Processor -- start 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.370+0000 7fb71940ae00 1 -- start start 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.370+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 0x55d8548b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.370+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 0x55d8548b0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.370+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.370+0000 7fb71940ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b40126f0 con 0x55d8548b38e0 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.370+0000 7fb71940ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b400ffc0 con 0x55d8548b2f60 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71940ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b400de10 con 0x55d8548b1dd0 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71547b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71547b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50776/0 (socket says 10.20.193.28:50776) 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71547b640 1 -- 10.20.193.28:0/427601537 learned_addr learned my addr 10.20.193.28:0/427601537 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:27.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb714c7a640 1 --2- 10.20.193.28:0/427601537 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 0x55d8548b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb707fff640 1 --2- 10.20.193.28:0/427601537 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 0x55d8548b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71547b640 1 -- 10.20.193.28:0/427601537 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 msgr2=0x55d8548b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:27.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71547b640 1 --2- 10.20.193.28:0/427601537 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 0x55d8548b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71547b640 1 -- 10.20.193.28:0/427601537 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 msgr2=0x55d8548b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:27.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71547b640 1 --2- 10.20.193.28:0/427601537 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 0x55d8548b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71547b640 1 -- 10.20.193.28:0/427601537 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8548c3a60 con 0x55d8548b38e0 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.371+0000 7fb71547b640 1 --2- 10.20.193.28:0/427601537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548c8f80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0093e0 tx=0x7fb70c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db8178ccb466315 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb6dcce3640 1 -- 10.20.193.28:0/427601537 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c029030 con 0x55d8548b38e0 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb6dcce3640 1 -- 10.20.193.28:0/427601537 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d85480c610 con 0x55d8548b38e0 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb6dcce3640 1 -- 10.20.193.28:0/427601537 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c024c80 con 0x55d8548b38e0 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb71940ae00 1 -- 10.20.193.28:0/427601537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 msgr2=0x55d8548c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb71940ae00 1 --2- 10.20.193.28:0/427601537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548c8f80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb70c0093e0 tx=0x7fb70c02c000 comp rx=0 tx=0).stop 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb71940ae00 1 -- 10.20.193.28:0/427601537 shutdown_connections 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb71940ae00 1 --2- 10.20.193.28:0/427601537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b38e0 0x55d8548c8f80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb71940ae00 1 --2- 10.20.193.28:0/427601537 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 0x55d8548b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb71940ae00 1 --2- 10.20.193.28:0/427601537 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b1dd0 0x55d8548b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb71940ae00 1 -- 10.20.193.28:0/427601537 >> 10.20.193.28:0/427601537 conn(0x55d8548a91b0 msgr2=0x55d8548db3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb71940ae00 1 -- 10.20.193.28:0/427601537 shutdown_connections 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.372+0000 7fb71940ae00 1 -- 10.20.193.28:0/427601537 wait complete. 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb71940ae00 1 -- start start 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb71940ae00 1 Processor -- start 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b1dd0 0x55d8548d6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 0x55d8548d6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb71940ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b38e0 0x55d8548d40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb71940ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b400e480 con 0x55d8548b1dd0 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb71940ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b400f8f0 con 0x55d8548b2f60 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb71940ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b400eb50 con 0x55d8548b38e0 2026-02-20T03:16:27.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb714c7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b1dd0 0x55d8548d6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb707fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 0x55d8548d6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb714c7a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b1dd0 0x55d8548d6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50786/0 (socket says 10.20.193.28:50786) 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb714c7a640 1 -- 10.20.193.28:0/824814193 learned_addr learned my addr 10.20.193.28:0/824814193 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.373+0000 7fb71547b640 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b38e0 0x55d8548d40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb714c7a640 1 -- 10.20.193.28:0/824814193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b38e0 msgr2=0x55d8548d40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb714c7a640 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b38e0 0x55d8548d40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb714c7a640 1 -- 10.20.193.28:0/824814193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 msgr2=0x55d8548d6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb714c7a640 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 0x55d8548d6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb714c7a640 1 -- 10.20.193.28:0/824814193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8544e3ad0 con 0x55d8548b1dd0 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb71547b640 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b38e0 0x55d8548d40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb714c7a640 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b1dd0 0x55d8548d6790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb700009950 tx=0x7fb7001125f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce8ee150d2b389e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb6ce7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:27.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/824814193 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70011c040 con 0x55d8548b1dd0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/824814193 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb7000dd040 con 0x55d8548b1dd0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/824814193 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7000d41e0 con 0x55d8548b1dd0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb71940ae00 1 -- 10.20.193.28:0/824814193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d85478b370 con 0x55d8548b1dd0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/824814193 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fb70002fd30 con 0x55d8548b1dd0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb6ce7fc640 10 client.15546 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb71940ae00 10 client.15546 _ll_register_callbacks cb 0x7fb70c004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb71940ae00 1 -- 10.20.193.28:0/824814193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb700033030 con 0x55d8548b1dd0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/824814193 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb7000043f0 con 0x55d8548b1dd0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb71940ae00 10 client.15546 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.374+0000 7fb71940ae00 1 -- 10.20.193.28:0/824814193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55d8548c4750 con 0x55d8548b1dd0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.375+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/824814193 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fb7000d0b20 con 0x55d8548b1dd0 2026-02-20T03:16:27.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.375+0000 7fb71940ae00 10 client.15546 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:27.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.375+0000 7fb71940ae00 10 client.15546 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:16:27.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.375+0000 7fb71940ae00 20 client.15546 populate_metadata read hostname 'trial028' 2026-02-20T03:16:27.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.375+0000 7fb71940ae00 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d854947000 0x55d8549494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:27.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.375+0000 7fb71940ae00 4 client.15546 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "975a2bd", "release": true, "await": true}] 2026-02-20T03:16:27.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.375+0000 7fb71940ae00 1 -- 10.20.193.28:0/824814193 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "975a2bd", "release": true, "await": true}) -- 0x55d854574bf0 con 0x55d854947000 2026-02-20T03:16:27.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.375+0000 7fb707fff640 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d854947000 0x55d8549494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:27.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.376+0000 7fb707fff640 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d854947000 0x55d8549494c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8d645683377a68f server_cookie=649bd9b8d57a98d in_seq=0 out_seq=0 2026-02-20T03:16:27.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.376+0000 7fb6ce7fc640 10 client.15546 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:27.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb6ce7fc640 1 -- 10.20.193.28:0/824814193 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55d854574bf0 con 0x55d854947000 2026-02-20T03:16:27.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb6ce7fc640 10 client.15546 handle_command_reply: tid=0 2026-02-20T03:16:27.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 client.15546 shutdown 2026-02-20T03:16:27.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 -- 10.20.193.28:0/824814193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b1dd0 msgr2=0x55d8548d6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:27.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b1dd0 0x55d8548d6790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb700009950 tx=0x7fb7001125f0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 -- 10.20.193.28:0/824814193 shutdown_connections 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d854947000 0x55d8549494c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8548b38e0 0x55d8548d40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8548b2f60 0x55d8548d6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 --2- 10.20.193.28:0/824814193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8548b1dd0 0x55d8548d6790 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 -- 10.20.193.28:0/824814193 >> 10.20.193.28:0/824814193 conn(0x55d8548a91b0 msgr2=0x55d8548af810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb6ce7fc640 0 client.15546 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 -- 10.20.193.28:0/824814193 shutdown_connections 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 1 -- 10.20.193.28:0/824814193 wait complete. 2026-02-20T03:16:27.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.378+0000 7fb71940ae00 20 client.15546 trim_cache size 0 max 16384 2026-02-20T03:16:27.385 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:16:27.385 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 24, 2026-02-20T03:16:27.385 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:16:27.385 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 4, 2026-02-20T03:16:27.385 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:16:27.385 INFO:teuthology.orchestra.run.trial028.stdout: "975a2bd": { 2026-02-20T03:16:27.385 INFO:teuthology.orchestra.run.trial028.stdout: "version": 4, 2026-02-20T03:16:27.385 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:16:27.385 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 146.6, 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:16:27.386 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:16:27.387 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:27.387 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:27.387 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:27.387 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:27.387 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:27.387 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:16:27.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 -- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6ec0b0e20 msgr2=0x7fb6ec0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:27.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6ec0b0e20 0x7fb6ec0b32e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb70c007610 tx=0x7fb70c00b040 comp rx=0 tx=0).stop 2026-02-20T03:16:27.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 -- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb710104980 msgr2=0x7fb71019d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:27.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb710104980 0x7fb71019d070 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb700009a60 tx=0x7fb700002a50 comp rx=0 tx=0).stop 2026-02-20T03:16:27.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 -- 10.20.193.28:0/2085692163 shutdown_connections 2026-02-20T03:16:27.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb6ec0b0e20 0x7fb6ec0b32e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb71010a980 0x7fb7101a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb710105320 0x7fb71019d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 --2- 10.20.193.28:0/2085692163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb710104980 0x7fb71019d070 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:27.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 -- 10.20.193.28:0/2085692163 >> 10.20.193.28:0/2085692163 conn(0x7fb710100680 msgr2=0x7fb710100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:27.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 -- 10.20.193.28:0/2085692163 shutdown_connections 2026-02-20T03:16:27.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:27.380+0000 7fb715c7c640 1 -- 10.20.193.28:0/2085692163 wait complete. 2026-02-20T03:16:27.392 INFO:tasks.workunit.client.0.trial028.stderr:+ dbench 1 2026-02-20T03:16:27.394 INFO:tasks.workunit.client.0.trial028.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-20T03:16:27.394 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-20T03:16:27.394 INFO:tasks.workunit.client.0.trial028.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-20T03:16:27.395 INFO:tasks.workunit.client.0.trial028.stdout:0 of 1 processes prepared for launch 0 sec 2026-02-20T03:16:27.453 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: pgmap v231: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 8 op/s 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 8]}]': finished 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 9]}]': finished 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: osdmap e92: 12 total, 12 up, 12 in 2026-02-20T03:16:27.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:27 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3388398339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: pgmap v231: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 8 op/s 2026-02-20T03:16:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2026-02-20T03:16:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 8]}]': finished 2026-02-20T03:16:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 9]}]': finished 2026-02-20T03:16:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2026-02-20T03:16:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2026-02-20T03:16:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2026-02-20T03:16:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2026-02-20T03:16:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2026-02-20T03:16:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: osdmap e92: 12 total, 12 up, 12 in 2026-02-20T03:16:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:27 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3388398339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:27.482 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '975a2bd', total seconds elapsed: 27.9 2026-02-20T03:16:27.495 INFO:tasks.workunit.client.0.trial028.stdout:1 of 1 processes prepared for launch 0 sec 2026-02-20T03:16:27.495 INFO:tasks.workunit.client.0.trial028.stdout:releasing clients 2026-02-20T03:16:27.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: pgmap v231: 129 pgs: 129 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 8 op/s 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.16", "id": [1, 8]}]': finished 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [0, 9]}]': finished 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: osdmap e92: 12 total, 12 up, 12 in 2026-02-20T03:16:27.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:27 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3388398339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:28.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:28 trial177 ceph-mon[43181]: osdmap e93: 12 total, 12 up, 12 in 2026-02-20T03:16:28.495 INFO:tasks.workunit.client.0.trial028.stdout: 1 5440 45.48 MB/sec warmup 1 sec latency 4.819 ms 2026-02-20T03:16:28.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:28 trial126 ceph-mon[38476]: osdmap e93: 12 total, 12 up, 12 in 2026-02-20T03:16:28.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:28 trial028 ceph-mon[38552]: osdmap e93: 12 total, 12 up, 12 in 2026-02-20T03:16:29.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:29 trial177 ceph-mon[43181]: pgmap v234: 129 pgs: 1 peering, 128 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:29.495 INFO:tasks.workunit.client.0.trial028.stdout: 1 10970 39.00 MB/sec warmup 2 sec latency 5.097 ms 2026-02-20T03:16:29.498 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:29 trial126 ceph-mon[38476]: pgmap v234: 129 pgs: 1 peering, 128 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:29.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:29 trial028 ceph-mon[38552]: pgmap v234: 129 pgs: 1 peering, 128 active+clean; 686 KiB data, 350 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 KiB/s rd, 4 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:29.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 -- 10.20.193.28:0/4185743072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c10a900 msgr2=0x7fef8c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:29.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 --2- 10.20.193.28:0/4185743072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c10a900 0x7fef8c111480 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fef8000b0a0 tx=0x7fef8002f410 comp rx=0 tx=0).stop 2026-02-20T03:16:29.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 -- 10.20.193.28:0/4185743072 shutdown_connections 2026-02-20T03:16:29.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 --2- 10.20.193.28:0/4185743072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c10a900 0x7fef8c111480 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 --2- 10.20.193.28:0/4185743072 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef8c109e60 0x7fef8c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 --2- 10.20.193.28:0/4185743072 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef8c109490 0x7fef8c109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 -- 10.20.193.28:0/4185743072 >> 10.20.193.28:0/4185743072 conn(0x7fef8c077fe0 msgr2=0x7fef8c07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:29.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 -- 10.20.193.28:0/4185743072 shutdown_connections 2026-02-20T03:16:29.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 -- 10.20.193.28:0/4185743072 wait complete. 2026-02-20T03:16:29.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 Processor -- start 2026-02-20T03:16:29.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.885+0000 7fef93617640 1 -- start start 2026-02-20T03:16:29.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef93617640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef8c109490 0x7fef8c1a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef93617640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c109e60 0x7fef8c1a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef93617640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef8c10a900 0x7fef8c1a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef93617640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c114930 con 0x7fef8c109e60 2026-02-20T03:16:29.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef93617640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c1147b0 con 0x7fef8c10a900 2026-02-20T03:16:29.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef93617640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef8c114ab0 con 0x7fef8c109490 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef91e14640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c109e60 0x7fef8c1a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef91e14640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c109e60 0x7fef8c1a13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50816/0 (socket says 10.20.193.28:50816) 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef91e14640 1 -- 10.20.193.28:0/499353556 learned_addr learned my addr 10.20.193.28:0/499353556 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef92615640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef8c109490 0x7fef8c1a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef92e16640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef8c10a900 0x7fef8c1a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef91e14640 1 -- 10.20.193.28:0/499353556 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef8c109490 msgr2=0x7fef8c1a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef91e14640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef8c109490 0x7fef8c1a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef91e14640 1 -- 10.20.193.28:0/499353556 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef8c10a900 msgr2=0x7fef8c1a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef91e14640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef8c10a900 0x7fef8c1a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef91e14640 1 -- 10.20.193.28:0/499353556 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8c1a8b60 con 0x7fef8c109e60 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef92e16640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef8c10a900 0x7fef8c1a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef92615640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef8c109490 0x7fef8c1a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef91e14640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c109e60 0x7fef8c1a13f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fef7800ea10 tx=0x7fef7800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.886+0000 7fef777fe640 1 -- 10.20.193.28:0/499353556 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7800ce50 con 0x7fef8c109e60 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.887+0000 7fef777fe640 1 -- 10.20.193.28:0/499353556 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef78004570 con 0x7fef8c109e60 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.887+0000 7fef93617640 1 -- 10.20.193.28:0/499353556 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8c1a8e50 con 0x7fef8c109e60 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.887+0000 7fef777fe640 1 -- 10.20.193.28:0/499353556 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78010690 con 0x7fef8c109e60 2026-02-20T03:16:29.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.887+0000 7fef93617640 1 -- 10.20.193.28:0/499353556 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8c1a9360 con 0x7fef8c109e60 2026-02-20T03:16:29.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.889+0000 7fef977dde00 1 Processor -- start 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef977dde00 1 -- start start 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef977dde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47dc50 0x55ea5b47e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef977dde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47e5b0 0x55ea5b482fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef777fe640 1 -- 10.20.193.28:0/499353556 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fef78020030 con 0x7fef8c109e60 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef977dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b485a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef977dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ea5b3ce8f0 con 0x55ea5b483600 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef977dde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ea5b37c2e0 con 0x55ea5b47dc50 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef977dde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ea5b3ca820 con 0x55ea5b47e5b0 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef92e16640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47dc50 0x55ea5b47e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef92e16640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47dc50 0x55ea5b47e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56098/0 (socket says 10.20.193.28:56098) 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef92e16640 1 -- 10.20.193.28:0/2290159839 learned_addr learned my addr 10.20.193.28:0/2290159839 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef92615640 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47e5b0 0x55ea5b482fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef91e14640 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b485a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef92e16640 1 -- 10.20.193.28:0/2290159839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47e5b0 msgr2=0x55ea5b482fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef92e16640 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47e5b0 0x55ea5b482fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef92e16640 1 -- 10.20.193.28:0/2290159839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 msgr2=0x55ea5b485a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef92e16640 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b485a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef92e16640 1 -- 10.20.193.28:0/2290159839 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea5b36e5a0 con 0x55ea5b47dc50 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.890+0000 7fef91e14640 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b485a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef92e16640 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47dc50 0x55ea5b47e070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef80004510 tx=0x7fef80005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39fb9fad05726dc8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef74bfe640 1 -- 10.20.193.28:0/2290159839 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80045070 con 0x55ea5b47dc50 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef74bfe640 1 -- 10.20.193.28:0/2290159839 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef80033070 con 0x55ea5b47dc50 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef74bfe640 1 -- 10.20.193.28:0/2290159839 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef800076a0 con 0x55ea5b47dc50 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef777fe640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef680b0fc0 0x7fef680b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef777fe640 1 -- 10.20.193.28:0/499353556 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fef780e0cb0 con 0x7fef8c109e60 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef977dde00 1 -- 10.20.193.28:0/2290159839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47dc50 msgr2=0x55ea5b47e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:29.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef977dde00 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47dc50 0x55ea5b47e070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fef80004510 tx=0x7fef80005c00 comp rx=0 tx=0).stop 2026-02-20T03:16:29.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef977dde00 1 -- 10.20.193.28:0/2290159839 shutdown_connections 2026-02-20T03:16:29.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef977dde00 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b485a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef977dde00 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47e5b0 0x55ea5b482fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef977dde00 1 --2- 10.20.193.28:0/2290159839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47dc50 0x55ea5b47e070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef977dde00 1 -- 10.20.193.28:0/2290159839 >> 10.20.193.28:0/2290159839 conn(0x55ea5b4752d0 msgr2=0x55ea5b47c150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:29.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.891+0000 7fef92615640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef680b0fc0 0x7fef680b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.892+0000 7fef977dde00 1 -- 10.20.193.28:0/2290159839 shutdown_connections 2026-02-20T03:16:29.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.892+0000 7fef977dde00 1 -- 10.20.193.28:0/2290159839 wait complete. 2026-02-20T03:16:29.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.892+0000 7fef92615640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef680b0fc0 0x7fef680b3480 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef8c07b6a0 tx=0x7fef84009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:29.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.893+0000 7fef977dde00 1 -- start start 2026-02-20T03:16:29.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.893+0000 7fef977dde00 1 Processor -- start 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.893+0000 7fef977dde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b496970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.893+0000 7fef977dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b496eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.893+0000 7fef977dde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 0x55ea5b49de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.893+0000 7fef977dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ea5b3760c0 con 0x55ea5b47e5b0 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.893+0000 7fef977dde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ea5b486590 con 0x55ea5b483600 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.893+0000 7fef977dde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ea5b4af7d0 con 0x55ea5b47dc50 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef91e14640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b496eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef91e14640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b496eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50846/0 (socket says 10.20.193.28:50846) 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef91e14640 1 -- 10.20.193.28:0/2272094678 learned_addr learned my addr 10.20.193.28:0/2272094678 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef92e16640 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 0x55ea5b49de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef92615640 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b496970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef91e14640 1 -- 10.20.193.28:0/2272094678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 msgr2=0x55ea5b496970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef91e14640 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b496970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef91e14640 1 -- 10.20.193.28:0/2272094678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 msgr2=0x55ea5b49de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef91e14640 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 0x55ea5b49de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef91e14640 1 -- 10.20.193.28:0/2272094678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea5b4900b0 con 0x55ea5b47e5b0 2026-02-20T03:16:29.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef91e14640 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b496eb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef78002410 tx=0x7fef78002ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728ccd4ca9c33b5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef3bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef3bfff640 1 -- 10.20.193.28:0/2272094678 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef780a8090 con 0x55ea5b47e5b0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef3bfff640 1 -- 10.20.193.28:0/2272094678 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef7801f2f0 con 0x55ea5b47e5b0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef3bfff640 1 -- 10.20.193.28:0/2272094678 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef780a7eb0 con 0x55ea5b47e5b0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef977dde00 1 -- 10.20.193.28:0/2272094678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea5b38a820 con 0x55ea5b47e5b0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef977dde00 10 client.15558 _ll_register_callbacks cb 0x55ea5b379ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.894+0000 7fef977dde00 1 -- 10.20.193.28:0/2272094678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ea5b3d64e0 con 0x55ea5b47e5b0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef3bfff640 1 -- 10.20.193.28:0/2272094678 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fef780a7c00 con 0x55ea5b47e5b0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef3bfff640 1 -- 10.20.193.28:0/2272094678 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef780b19d0 con 0x55ea5b47e5b0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef977dde00 10 client.15558 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef977dde00 1 -- 10.20.193.28:0/2272094678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55ea5b38f380 con 0x55ea5b47e5b0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef3bfff640 1 -- 10.20.193.28:0/2272094678 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fef780a40b0 con 0x55ea5b47e5b0 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef977dde00 10 client.15558 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef977dde00 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef977dde00 20 client.15558 populate_metadata read hostname 'trial028' 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef977dde00 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ea5b4b3be0 0x55ea5b4b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef977dde00 4 client.15558 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:29.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef977dde00 1 -- 10.20.193.28:0/2272094678 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea5b350bd0 con 0x55ea5b4b3be0 2026-02-20T03:16:29.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.895+0000 7fef92615640 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ea5b4b3be0 0x55ea5b4b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.896+0000 7fef92615640 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ea5b4b3be0 0x55ea5b4b6050 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbc8962e2cd8a6e0 server_cookie=af2add5691a9ff5f in_seq=0 out_seq=0 2026-02-20T03:16:29.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.896+0000 7fef3bfff640 10 client.15558 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef3bfff640 1 -- 10.20.193.28:0/2272094678 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ea5b350bd0 con 0x55ea5b4b3be0 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef3bfff640 10 client.15558 handle_command_reply: tid=0 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 client.15558 shutdown 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 -- 10.20.193.28:0/2272094678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 msgr2=0x55ea5b496eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b496eb0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fef78002410 tx=0x7fef78002ac0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 -- 10.20.193.28:0/2272094678 shutdown_connections 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ea5b4b3be0 0x55ea5b4b6050 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 0x55ea5b49de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b496eb0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 --2- 10.20.193.28:0/2272094678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b496970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 -- 10.20.193.28:0/2272094678 >> 10.20.193.28:0/2272094678 conn(0x55ea5b4752d0 msgr2=0x55ea5b484950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:29.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef3bfff640 0 client.15558 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:29.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 -- 10.20.193.28:0/2272094678 shutdown_connections 2026-02-20T03:16:29.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 1 -- 10.20.193.28:0/2272094678 wait complete. 2026-02-20T03:16:29.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.897+0000 7fef977dde00 20 client.15558 trim_cache size 0 max 16384 2026-02-20T03:16:29.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef977dde00 1 Processor -- start 2026-02-20T03:16:29.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef977dde00 1 -- start start 2026-02-20T03:16:29.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef977dde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b494f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef977dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b49ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef977dde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 0x55ea5b47ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef977dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef34012720 con 0x55ea5b47e5b0 2026-02-20T03:16:29.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef977dde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fef3400fff0 con 0x55ea5b483600 2026-02-20T03:16:29.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef977dde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef3400de40 con 0x55ea5b47dc50 2026-02-20T03:16:29.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef92615640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b494f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef91e14640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b49ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef92615640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b494f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52698/0 (socket says 10.20.193.28:52698) 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef92615640 1 -- 10.20.193.28:0/597453271 learned_addr learned my addr 10.20.193.28:0/597453271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef92e16640 1 --2- 10.20.193.28:0/597453271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 0x55ea5b47ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef91e14640 1 -- 10.20.193.28:0/597453271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 msgr2=0x55ea5b494f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef91e14640 1 --2- 10.20.193.28:0/597453271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b494f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef91e14640 1 -- 10.20.193.28:0/597453271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 msgr2=0x55ea5b47ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef91e14640 1 --2- 10.20.193.28:0/597453271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 0x55ea5b47ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.905+0000 7fef91e14640 1 -- 10.20.193.28:0/597453271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea5b48fee0 con 0x55ea5b47e5b0 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef91e14640 1 --2- 10.20.193.28:0/597453271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b49ddf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fef780a4ce0 tx=0x7fef780cc000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c49b027e28d32a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef5a3ff640 1 -- 10.20.193.28:0/597453271 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef780a8090 con 0x55ea5b47e5b0 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef5a3ff640 1 -- 10.20.193.28:0/597453271 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55ea5b3d64e0 con 0x55ea5b47e5b0 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef5a3ff640 1 -- 10.20.193.28:0/597453271 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef780b1760 con 0x55ea5b47e5b0 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef977dde00 1 -- 10.20.193.28:0/597453271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 msgr2=0x55ea5b49ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef977dde00 1 --2- 10.20.193.28:0/597453271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b49ddf0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fef780a4ce0 tx=0x7fef780cc000 comp rx=0 tx=0).stop 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef977dde00 1 -- 10.20.193.28:0/597453271 shutdown_connections 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef977dde00 1 --2- 10.20.193.28:0/597453271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b483600 0x55ea5b47ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef977dde00 1 --2- 10.20.193.28:0/597453271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b47e5b0 0x55ea5b49ddf0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef977dde00 1 --2- 10.20.193.28:0/597453271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b494f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef977dde00 1 -- 10.20.193.28:0/597453271 >> 10.20.193.28:0/597453271 conn(0x55ea5b4752d0 msgr2=0x55ea5b493e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:29.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef977dde00 1 -- 10.20.193.28:0/597453271 shutdown_connections 2026-02-20T03:16:29.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.906+0000 7fef977dde00 1 -- 10.20.193.28:0/597453271 wait complete. 2026-02-20T03:16:29.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef977dde00 1 -- start start 2026-02-20T03:16:29.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef977dde00 1 Processor -- start 2026-02-20T03:16:29.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef977dde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b49d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef977dde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47e5b0 0x55ea5b49db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef977dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b49bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef977dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef3400e4b0 con 0x55ea5b483600 2026-02-20T03:16:29.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef977dde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fef3400f920 con 0x55ea5b47e5b0 2026-02-20T03:16:29.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef977dde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef3400eb80 con 0x55ea5b47dc50 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef92e16640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b49bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef92e16640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b49bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50866/0 (socket says 10.20.193.28:50866) 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.907+0000 7fef92e16640 1 -- 10.20.193.28:0/3810448342 learned_addr learned my addr 10.20.193.28:0/3810448342 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef92615640 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b49d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef91e14640 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47e5b0 0x55ea5b49db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef92e16640 1 -- 10.20.193.28:0/3810448342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 msgr2=0x55ea5b49d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef92e16640 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b49d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef92e16640 1 -- 10.20.193.28:0/3810448342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47e5b0 msgr2=0x55ea5b49db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef92e16640 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47e5b0 0x55ea5b49db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef92e16640 1 -- 10.20.193.28:0/3810448342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea5b12e690 con 0x55ea5b483600 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef92e16640 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b49bd10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fef80009850 tx=0x7fef800094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2456da10f565c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef3bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef3bfff640 1 -- 10.20.193.28:0/3810448342 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80051020 con 0x55ea5b483600 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef3bfff640 1 -- 10.20.193.28:0/3810448342 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef80033040 con 0x55ea5b483600 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef3bfff640 1 -- 10.20.193.28:0/3810448342 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80045040 con 0x55ea5b483600 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef977dde00 1 -- 10.20.193.28:0/3810448342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea5b393b70 con 0x55ea5b483600 2026-02-20T03:16:29.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef977dde00 10 client.15564 _ll_register_callbacks cb 0x7fef7800ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef977dde00 1 -- 10.20.193.28:0/3810448342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ea5b1a7520 con 0x55ea5b483600 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef3bfff640 1 -- 10.20.193.28:0/3810448342 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fef80007900 con 0x55ea5b483600 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef3bfff640 1 -- 10.20.193.28:0/3810448342 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fef80007be0 con 0x55ea5b483600 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.908+0000 7fef977dde00 10 client.15564 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.909+0000 7fef977dde00 1 -- 10.20.193.28:0/3810448342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55ea5b490bd0 con 0x55ea5b483600 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.909+0000 7fef3bfff640 1 -- 10.20.193.28:0/3810448342 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fef8003f030 con 0x55ea5b483600 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.909+0000 7fef977dde00 10 client.15564 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.909+0000 7fef977dde00 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.909+0000 7fef977dde00 20 client.15564 populate_metadata read hostname 'trial028' 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.909+0000 7fef977dde00 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ea5b51f3c0 0x55ea5b521830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.909+0000 7fef977dde00 4 client.15564 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.909+0000 7fef977dde00 1 -- 10.20.193.28:0/3810448342 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ea5b3dc290 con 0x55ea5b51f3c0 2026-02-20T03:16:29.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.909+0000 7fef92615640 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ea5b51f3c0 0x55ea5b521830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:29.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.910+0000 7fef3bfff640 10 client.15564 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:29.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.910+0000 7fef92615640 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ea5b51f3c0 0x55ea5b521830 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=749a17828e945312 server_cookie=b81b7188c30ab6a4 in_seq=0 out_seq=0 2026-02-20T03:16:29.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef3bfff640 1 -- 10.20.193.28:0/3810448342 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ea5b3dc290 con 0x55ea5b51f3c0 2026-02-20T03:16:29.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef3bfff640 10 client.15564 handle_command_reply: tid=0 2026-02-20T03:16:29.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 client.15564 shutdown 2026-02-20T03:16:29.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 -- 10.20.193.28:0/3810448342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 msgr2=0x55ea5b49bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:29.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b49bd10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fef80009850 tx=0x7fef800094b0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 -- 10.20.193.28:0/3810448342 shutdown_connections 2026-02-20T03:16:29.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ea5b51f3c0 0x55ea5b521830 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ea5b483600 0x55ea5b49bd10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef3bfff640 0 client.15564 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ea5b47e5b0 0x55ea5b49db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 --2- 10.20.193.28:0/3810448342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ea5b47dc50 0x55ea5b49d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 -- 10.20.193.28:0/3810448342 >> 10.20.193.28:0/3810448342 conn(0x55ea5b4752d0 msgr2=0x55ea5b495ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.972+0000 7fef977dde00 1 -- 10.20.193.28:0/3810448342 shutdown_connections 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef977dde00 1 -- 10.20.193.28:0/3810448342 wait complete. 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef977dde00 20 client.15564 trim_cache size 0 max 16384 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 -- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef680b0fc0 msgr2=0x7fef680b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef680b0fc0 0x7fef680b3480 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fef8c07b6a0 tx=0x7fef84009290 comp rx=0 tx=0).stop 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 -- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c109e60 msgr2=0x7fef8c1a13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:29.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c109e60 0x7fef8c1a13f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fef7800ea10 tx=0x7fef7800eee0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 -- 10.20.193.28:0/499353556 shutdown_connections 2026-02-20T03:16:29.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef680b0fc0 0x7fef680b3480 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef8c10a900 0x7fef8c1a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef8c109e60 0x7fef8c1a13f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 --2- 10.20.193.28:0/499353556 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef8c109490 0x7fef8c1a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:29.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 -- 10.20.193.28:0/499353556 >> 10.20.193.28:0/499353556 conn(0x7fef8c077fe0 msgr2=0x7fef8c10d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:29.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 -- 10.20.193.28:0/499353556 shutdown_connections 2026-02-20T03:16:29.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:29.973+0000 7fef93617640 1 -- 10.20.193.28:0/499353556 wait complete. 2026-02-20T03:16:30.495 INFO:tasks.workunit.client.0.trial028.stdout: 1 15725 34.19 MB/sec warmup 3 sec latency 17.547 ms 2026-02-20T03:16:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:31 trial177 ceph-mon[43181]: pgmap v235: 129 pgs: 1 peering, 128 active+clean; 4.4 MiB data, 359 MiB used, 8.2 TiB / 8.2 TiB avail; 350 KiB/s rd, 569 KiB/s wr, 98 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:31.495 INFO:tasks.workunit.client.0.trial028.stdout: 1 21566 33.85 MB/sec warmup 4 sec latency 4.972 ms 2026-02-20T03:16:31.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:31 trial126 ceph-mon[38476]: pgmap v235: 129 pgs: 1 peering, 128 active+clean; 4.4 MiB data, 359 MiB used, 8.2 TiB / 8.2 TiB avail; 350 KiB/s rd, 569 KiB/s wr, 98 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:31 trial028 ceph-mon[38552]: pgmap v235: 129 pgs: 1 peering, 128 active+clean; 4.4 MiB data, 359 MiB used, 8.2 TiB / 8.2 TiB avail; 350 KiB/s rd, 569 KiB/s wr, 98 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:32.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:32 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:16:32.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:32 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:16:32.495 INFO:tasks.workunit.client.0.trial028.stdout: 1 25915 31.36 MB/sec warmup 5 sec latency 13.156 ms 2026-02-20T03:16:32.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:32 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:16:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:33 trial177 ceph-mon[43181]: pgmap v236: 129 pgs: 129 active+clean; 5.8 MiB data, 383 MiB used, 8.2 TiB / 8.2 TiB avail; 350 KiB/s rd, 789 KiB/s wr, 162 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:33 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 31624 31.22 MB/sec warmup 6 sec latency 4.622 ms 2026-02-20T03:16:33.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:33 trial126 ceph-mon[38476]: pgmap v236: 129 pgs: 129 active+clean; 5.8 MiB data, 383 MiB used, 8.2 TiB / 8.2 TiB avail; 350 KiB/s rd, 789 KiB/s wr, 162 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:33 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:33 trial028 ceph-mon[38552]: pgmap v236: 129 pgs: 129 active+clean; 5.8 MiB data, 383 MiB used, 8.2 TiB / 8.2 TiB avail; 350 KiB/s rd, 789 KiB/s wr, 162 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:33 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:34.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 36313 30.39 MB/sec warmup 7 sec latency 6.057 ms 2026-02-20T03:16:34.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:16:34.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:16:34.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:34.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:16:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:16:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:16:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:16:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:16:35.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 42243 30.58 MB/sec warmup 8 sec latency 5.604 ms 2026-02-20T03:16:35.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:35 trial126 ceph-mon[38476]: pgmap v237: 129 pgs: 129 active+clean; 6.7 MiB data, 396 MiB used, 8.2 TiB / 8.2 TiB avail; 356 KiB/s rd, 978 KiB/s wr, 200 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:35 trial028 ceph-mon[38552]: pgmap v237: 129 pgs: 129 active+clean; 6.7 MiB data, 396 MiB used, 8.2 TiB / 8.2 TiB avail; 356 KiB/s rd, 978 KiB/s wr, 200 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:35 trial177 ceph-mon[43181]: pgmap v237: 129 pgs: 129 active+clean; 6.7 MiB data, 396 MiB used, 8.2 TiB / 8.2 TiB avail; 356 KiB/s rd, 978 KiB/s wr, 200 op/s; 14 B/s, 0 objects/s recovering 2026-02-20T03:16:36.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 46864 29.98 MB/sec warmup 9 sec latency 7.731 ms 2026-02-20T03:16:37.495 INFO:tasks.workunit.client.0.trial028.stdout: 1 52092 29.57 MB/sec warmup 10 sec latency 7.146 ms 2026-02-20T03:16:37.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:37 trial126 ceph-mon[38476]: pgmap v238: 129 pgs: 129 active+clean; 15 MiB data, 431 MiB used, 8.2 TiB / 8.2 TiB avail; 833 KiB/s rd, 1.8 MiB/s wr, 331 op/s; 11 B/s, 0 objects/s recovering 2026-02-20T03:16:37.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:37 trial028 ceph-mon[38552]: pgmap v238: 129 pgs: 129 active+clean; 15 MiB data, 431 MiB used, 8.2 TiB / 8.2 TiB avail; 833 KiB/s rd, 1.8 MiB/s wr, 331 op/s; 11 B/s, 0 objects/s recovering 2026-02-20T03:16:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:37 trial177 ceph-mon[43181]: pgmap v238: 129 pgs: 129 active+clean; 15 MiB data, 431 MiB used, 8.2 TiB / 8.2 TiB avail; 833 KiB/s rd, 1.8 MiB/s wr, 331 op/s; 11 B/s, 0 objects/s recovering 2026-02-20T03:16:38.495 INFO:tasks.workunit.client.0.trial028.stdout: 1 57225 29.72 MB/sec warmup 11 sec latency 5.592 ms 2026-02-20T03:16:39.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 62421 29.31 MB/sec warmup 12 sec latency 6.216 ms 2026-02-20T03:16:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:39 trial126 ceph-mon[38476]: pgmap v239: 129 pgs: 129 active+clean; 20 MiB data, 460 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 386 op/s; 10 B/s, 0 objects/s recovering 2026-02-20T03:16:39.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:39 trial028 ceph-mon[38552]: pgmap v239: 129 pgs: 129 active+clean; 20 MiB data, 460 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 386 op/s; 10 B/s, 0 objects/s recovering 2026-02-20T03:16:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:39 trial177 ceph-mon[43181]: pgmap v239: 129 pgs: 129 active+clean; 20 MiB data, 460 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 386 op/s; 10 B/s, 0 objects/s recovering 2026-02-20T03:16:40.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 67693 29.54 MB/sec warmup 13 sec latency 5.547 ms 2026-02-20T03:16:41.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 72522 29.18 MB/sec warmup 14 sec latency 7.366 ms 2026-02-20T03:16:41.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:41 trial126 ceph-mon[38476]: pgmap v240: 129 pgs: 129 active+clean; 27 MiB data, 483 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 452 op/s 2026-02-20T03:16:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:41 trial028 ceph-mon[38552]: pgmap v240: 129 pgs: 129 active+clean; 27 MiB data, 483 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 452 op/s 2026-02-20T03:16:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:41 trial177 ceph-mon[43181]: pgmap v240: 129 pgs: 129 active+clean; 27 MiB data, 483 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 452 op/s 2026-02-20T03:16:42.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 78172 29.35 MB/sec warmup 15 sec latency 5.381 ms 2026-02-20T03:16:43.054 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.050+0000 7fb040ea3640 1 -- 10.20.193.28:0/4204261152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10e540 msgr2=0x7fb03c10e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:43.054 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.050+0000 7fb040ea3640 1 --2- 10.20.193.28:0/4204261152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10e540 0x7fb03c10e9a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009a30 tx=0x7fb02c02f220 comp rx=0 tx=0).stop 2026-02-20T03:16:43.054 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.050+0000 7fb040ea3640 1 -- 10.20.193.28:0/4204261152 shutdown_connections 2026-02-20T03:16:43.054 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.050+0000 7fb040ea3640 1 --2- 10.20.193.28:0/4204261152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb03c10eee0 0x7fb03c115790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.054 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.050+0000 7fb040ea3640 1 --2- 10.20.193.28:0/4204261152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10e540 0x7fb03c10e9a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.054 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.050+0000 7fb040ea3640 1 --2- 10.20.193.28:0/4204261152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb03c10d830 0x7fb03c10dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.054 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.050+0000 7fb040ea3640 1 -- 10.20.193.28:0/4204261152 >> 10.20.193.28:0/4204261152 conn(0x7fb03c06c680 msgr2=0x7fb03c06cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:43.055 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.051+0000 7fb040ea3640 1 -- 10.20.193.28:0/4204261152 shutdown_connections 2026-02-20T03:16:43.055 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.051+0000 7fb040ea3640 1 -- 10.20.193.28:0/4204261152 wait complete. 2026-02-20T03:16:43.055 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.051+0000 7fb040ea3640 1 Processor -- start 2026-02-20T03:16:43.055 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.051+0000 7fb040ea3640 1 -- start start 2026-02-20T03:16:43.056 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb040ea3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10d830 0x7fb03c1a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb040ea3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb03c10e540 0x7fb03c1a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb040ea3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb03c10eee0 0x7fb03c1aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb040ea3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c118e30 con 0x7fb03c10d830 2026-02-20T03:16:43.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb040ea3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c118cb0 con 0x7fb03c10e540 2026-02-20T03:16:43.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb040ea3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb03c118fb0 con 0x7fb03c10eee0 2026-02-20T03:16:43.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10d830 0x7fb03c1a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10d830 0x7fb03c1a54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47710/0 (socket says 10.20.193.28:47710) 2026-02-20T03:16:43.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03b7fe640 1 -- 10.20.193.28:0/1654737198 learned_addr learned my addr 10.20.193.28:0/1654737198 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:43.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03affd640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb03c10e540 0x7fb03c1a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03bfff640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb03c10eee0 0x7fb03c1aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03b7fe640 1 -- 10.20.193.28:0/1654737198 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb03c10eee0 msgr2=0x7fb03c1aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03b7fe640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb03c10eee0 0x7fb03c1aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03b7fe640 1 -- 10.20.193.28:0/1654737198 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb03c10e540 msgr2=0x7fb03c1a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03b7fe640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb03c10e540 0x7fb03c1a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03b7fe640 1 -- 10.20.193.28:0/1654737198 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03c1ad190 con 0x7fb03c10d830 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb03b7fe640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10d830 0x7fb03c1a54e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb02800ea30 tx=0x7fb02800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb038ff9640 1 -- 10.20.193.28:0/1654737198 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02800ce50 con 0x7fb03c10d830 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb038ff9640 1 -- 10.20.193.28:0/1654737198 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb028004570 con 0x7fb03c10d830 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb038ff9640 1 -- 10.20.193.28:0/1654737198 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028010690 con 0x7fb03c10d830 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb040ea3640 1 -- 10.20.193.28:0/1654737198 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03c1ad480 con 0x7fb03c10d830 2026-02-20T03:16:43.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.052+0000 7fb040ea3640 1 -- 10.20.193.28:0/1654737198 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb03c1ad980 con 0x7fb03c10d830 2026-02-20T03:16:43.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.055+0000 7fb038ff9640 1 -- 10.20.193.28:0/1654737198 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb0280040d0 con 0x7fb03c10d830 2026-02-20T03:16:43.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb04506be00 1 Processor -- start 2026-02-20T03:16:43.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb04506be00 1 -- start start 2026-02-20T03:16:43.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb04506be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7be80 0x55f076e7c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb04506be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7c7c0 0x55f076e80f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb04506be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076e839f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb04506be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f076dcc8f0 con 0x55f076e7be80 2026-02-20T03:16:43.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb04506be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f076d7a2e0 con 0x55f076e81560 2026-02-20T03:16:43.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb04506be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f076dc8820 con 0x55f076e7c7c0 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb03bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7be80 0x55f076e7c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb03bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7be80 0x55f076e7c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47720/0 (socket says 10.20.193.28:47720) 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb03bfff640 1 -- 10.20.193.28:0/1845964336 learned_addr learned my addr 10.20.193.28:0/1845964336 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.056+0000 7fb03b7fe640 1 --2- 10.20.193.28:0/1845964336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7c7c0 0x55f076e80f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb03affd640 1 --2- 10.20.193.28:0/1845964336 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076e839f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb03bfff640 1 -- 10.20.193.28:0/1845964336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7c7c0 msgr2=0x55f076e80f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb03bfff640 1 --2- 10.20.193.28:0/1845964336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7c7c0 0x55f076e80f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb03bfff640 1 -- 10.20.193.28:0/1845964336 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 msgr2=0x55f076e839f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb03bfff640 1 --2- 10.20.193.28:0/1845964336 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076e839f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb03bfff640 1 -- 10.20.193.28:0/1845964336 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f076d6c5a0 con 0x55f076e7be80 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb038ff9640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0100b0e20 0x7fb0100b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb03bfff640 1 --2- 10.20.193.28:0/1845964336 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7be80 0x55f076e7c280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb030002ee0 tx=0x7fb030009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d027fac4a0fa3c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb038ff9640 1 -- 10.20.193.28:0/1654737198 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fb0280e10d0 con 0x7fb03c10d830 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7faffffff640 1 -- 10.20.193.28:0/1845964336 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030004840 con 0x55f076e7be80 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7faffffff640 1 -- 10.20.193.28:0/1845964336 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb0300079a0 con 0x55f076e7be80 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7faffffff640 1 -- 10.20.193.28:0/1845964336 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030014980 con 0x55f076e7be80 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb04506be00 1 -- 10.20.193.28:0/1845964336 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7be80 msgr2=0x55f076e7c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb04506be00 1 --2- 10.20.193.28:0/1845964336 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7be80 0x55f076e7c280 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb030002ee0 tx=0x7fb030009d10 comp rx=0 tx=0).stop 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb03b7fe640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0100b0e20 0x7fb0100b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb04506be00 1 -- 10.20.193.28:0/1845964336 shutdown_connections 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb04506be00 1 --2- 10.20.193.28:0/1845964336 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076e839f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb04506be00 1 --2- 10.20.193.28:0/1845964336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7c7c0 0x55f076e80f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb04506be00 1 --2- 10.20.193.28:0/1845964336 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7be80 0x55f076e7c280 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb04506be00 1 -- 10.20.193.28:0/1845964336 >> 10.20.193.28:0/1845964336 conn(0x55f076e736f0 msgr2=0x55f076e7a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:43.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb04506be00 1 -- 10.20.193.28:0/1845964336 shutdown_connections 2026-02-20T03:16:43.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.057+0000 7fb04506be00 1 -- 10.20.193.28:0/1845964336 wait complete. 2026-02-20T03:16:43.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.058+0000 7fb03b7fe640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0100b0e20 0x7fb0100b32e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb0280a8ab0 tx=0x7fb0280e4b10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:43.067 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb04506be00 1 -- start start 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb04506be00 1 Processor -- start 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb04506be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e9d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb04506be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076e9d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb04506be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076ea45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb04506be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f076d740c0 con 0x55f076e7c7c0 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb04506be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f076e84610 con 0x55f076e81560 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb04506be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f076ea4b30 con 0x55f076e7be80 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb03affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076e9d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb03affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076e9d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47722/0 (socket says 10.20.193.28:47722) 2026-02-20T03:16:43.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb03affd640 1 -- 10.20.193.28:0/232390485 learned_addr learned my addr 10.20.193.28:0/232390485 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb03bfff640 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e9d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb03bfff640 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076ea45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb03affd640 1 -- 10.20.193.28:0/232390485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 msgr2=0x55f076e9d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.059+0000 7fb03affd640 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e9d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7fb03affd640 1 -- 10.20.193.28:0/232390485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 msgr2=0x55f076ea45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7fb03affd640 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076ea45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7fb03affd640 1 -- 10.20.193.28:0/232390485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f076e96c70 con 0x55f076e7c7c0 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7fb03bfff640 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e9d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7fb03affd640 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076e9d700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009950 tx=0x7fb02c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8ae03a0ee4dd8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7faffd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:43.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7faffd7fa640 1 -- 10.20.193.28:0/232390485 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c047070 con 0x55f076e7c7c0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7faffd7fa640 1 -- 10.20.193.28:0/232390485 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb02c033040 con 0x55f076e7c7c0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7faffd7fa640 1 -- 10.20.193.28:0/232390485 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c038cd0 con 0x55f076e7c7c0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7fb04506be00 1 -- 10.20.193.28:0/232390485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f076d88820 con 0x55f076e7c7c0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7faffd7fa640 1 -- 10.20.193.28:0/232390485 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fb02c04b3b0 con 0x55f076e7c7c0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7fb04506be00 10 client.15576 _ll_register_callbacks cb 0x55f076d77ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.060+0000 7fb04506be00 1 -- 10.20.193.28:0/232390485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f076dd44e0 con 0x55f076e7c7c0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7faffd7fa640 1 -- 10.20.193.28:0/232390485 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb02c02fc80 con 0x55f076e7c7c0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7fb04506be00 10 client.15576 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7fb04506be00 1 -- 10.20.193.28:0/232390485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55f076d8d380 con 0x55f076e7c7c0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7faffd7fa640 1 -- 10.20.193.28:0/232390485 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fb02c0040d0 con 0x55f076e7c7c0 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7fb04506be00 10 client.15576 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:43.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7fb04506be00 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7fb04506be00 20 client.15576 populate_metadata read hostname 'trial028' 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7fb04506be00 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f076ea8e10 0x55f076eab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7fb04506be00 4 client.15576 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7fb04506be00 1 -- 10.20.193.28:0/232390485 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f076d4ebd0 con 0x55f076ea8e10 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.061+0000 7fb03bfff640 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f076ea8e10 0x55f076eab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.062+0000 7fb03bfff640 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f076ea8e10 0x55f076eab2a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d03456f8f7ccefa server_cookie=9675c184401323ae in_seq=0 out_seq=0 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.062+0000 7faffd7fa640 10 client.15576 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.063+0000 7faffd7fa640 1 -- 10.20.193.28:0/232390485 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f076d4ebd0 con 0x55f076ea8e10 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.063+0000 7faffd7fa640 10 client.15576 handle_command_reply: tid=0 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.063+0000 7fb04506be00 1 client.15576 shutdown 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 -- 10.20.193.28:0/232390485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 msgr2=0x55f076e9d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:43.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076e9d700 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb02c009950 tx=0x7fb02c005840 comp rx=0 tx=0).stop 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 -- 10.20.193.28:0/232390485 shutdown_connections 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f076ea8e10 0x55f076eab2a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076ea45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076e9d700 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 --2- 10.20.193.28:0/232390485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e9d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 -- 10.20.193.28:0/232390485 >> 10.20.193.28:0/232390485 conn(0x55f076e736f0 msgr2=0x55f076e82910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7faffd7fa640 0 client.15576 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 -- 10.20.193.28:0/232390485 shutdown_connections 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 1 -- 10.20.193.28:0/232390485 wait complete. 2026-02-20T03:16:43.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.064+0000 7fb04506be00 20 client.15576 trim_cache size 0 max 16384 2026-02-20T03:16:43.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.071+0000 7fb04506be00 1 Processor -- start 2026-02-20T03:16:43.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.071+0000 7fb04506be00 1 -- start start 2026-02-20T03:16:43.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.071+0000 7fb04506be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e99d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.071+0000 7fb04506be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e7c7c0 0x55f076ea4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.071+0000 7fb04506be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e81560 0x55f076e9a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.071+0000 7fb04506be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafe00126a0 con 0x55f076e81560 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.071+0000 7fb04506be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fafe000ff70 con 0x55f076e7c7c0 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.071+0000 7fb04506be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafe000ddc0 con 0x55f076e7be80 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.071+0000 7fb03bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e99d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e7c7c0 0x55f076ea4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e99d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:35862/0 (socket says 10.20.193.28:35862) 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03bfff640 1 -- 10.20.193.28:0/1679921474 learned_addr learned my addr 10.20.193.28:0/1679921474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03bfff640 1 --2- 10.20.193.28:0/1679921474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e81560 0x55f076e9a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03bfff640 1 -- 10.20.193.28:0/1679921474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 msgr2=0x55f076e99d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:43.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03bfff640 1 --2- 10.20.193.28:0/1679921474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e99d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03bfff640 1 -- 10.20.193.28:0/1679921474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e7c7c0 msgr2=0x55f076ea4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03bfff640 1 --2- 10.20.193.28:0/1679921474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e7c7c0 0x55f076ea4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03bfff640 1 -- 10.20.193.28:0/1679921474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f076e96aa0 con 0x55f076e81560 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb03bfff640 1 --2- 10.20.193.28:0/1679921474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e81560 0x55f076e9a270 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x55f076e9c810 tx=0x7fb030009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad1c8e75a73490d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fafff7fe640 1 -- 10.20.193.28:0/1679921474 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030004920 con 0x55f076e81560 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fafff7fe640 1 -- 10.20.193.28:0/1679921474 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb030007b50 con 0x55f076e81560 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fafff7fe640 1 -- 10.20.193.28:0/1679921474 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030020af0 con 0x55f076e81560 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb04506be00 1 -- 10.20.193.28:0/1679921474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e81560 msgr2=0x55f076e9a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb04506be00 1 --2- 10.20.193.28:0/1679921474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e81560 0x55f076e9a270 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x55f076e9c810 tx=0x7fb030009d10 comp rx=0 tx=0).stop 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb04506be00 1 -- 10.20.193.28:0/1679921474 shutdown_connections 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb04506be00 1 --2- 10.20.193.28:0/1679921474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e81560 0x55f076e9a270 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb04506be00 1 --2- 10.20.193.28:0/1679921474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e7c7c0 0x55f076ea4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb04506be00 1 --2- 10.20.193.28:0/1679921474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076e99d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.072+0000 7fb04506be00 1 -- 10.20.193.28:0/1679921474 >> 10.20.193.28:0/1679921474 conn(0x55f076e736f0 msgr2=0x55f076e7a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:43.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 -- 10.20.193.28:0/1679921474 shutdown_connections 2026-02-20T03:16:43.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 -- 10.20.193.28:0/1679921474 wait complete. 2026-02-20T03:16:43.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 -- start start 2026-02-20T03:16:43.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 Processor -- start 2026-02-20T03:16:43.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076ea41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076ea2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076ea2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafe000e430 con 0x55f076e7c7c0 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fafe000f8a0 con 0x55f076e81560 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.073+0000 7fb04506be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafe000eb00 con 0x55f076e7be80 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076ea41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076ea41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:35866/0 (socket says 10.20.193.28:35866) 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 -- 10.20.193.28:0/146183332 learned_addr learned my addr 10.20.193.28:0/146183332 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076ea2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076ea2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 -- 10.20.193.28:0/146183332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 msgr2=0x55f076ea2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076ea2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 -- 10.20.193.28:0/146183332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 msgr2=0x55f076ea2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076ea2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 -- 10.20.193.28:0/146183332 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f076e84370 con 0x55f076e7be80 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7fb03bfff640 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076ea41f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb030002e30 tx=0x7fb030009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d3137759f9cd04d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.074+0000 7faffd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7faffd7fa640 1 -- 10.20.193.28:0/146183332 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030028070 con 0x55f076e7be80 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7faffd7fa640 1 -- 10.20.193.28:0/146183332 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb030020650 con 0x55f076e7be80 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7faffd7fa640 1 -- 10.20.193.28:0/146183332 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030033b30 con 0x55f076e7be80 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 1 -- 10.20.193.28:0/146183332 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f076b2c690 con 0x55f076e7be80 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7faffd7fa640 1 -- 10.20.193.28:0/146183332 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fb030033cd0 con 0x55f076e7be80 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 10 client.25618 _ll_register_callbacks cb 0x7fb02c005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 1 -- 10.20.193.28:0/146183332 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0300079a0 con 0x55f076e7be80 2026-02-20T03:16:43.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7faffd7fa640 1 -- 10.20.193.28:0/146183332 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb030007d90 con 0x55f076e7be80 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 10 client.25618 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 1 -- 10.20.193.28:0/146183332 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55f076d91b70 con 0x55f076e7be80 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7faffd7fa640 1 -- 10.20.193.28:0/146183332 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fb030007420 con 0x55f076e7be80 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 10 client.25618 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 10 client.25618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 20 client.25618 populate_metadata read hostname 'trial028' 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f076f14ba0 0x55f076f17060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 4 client.25618 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.075+0000 7fb04506be00 1 -- 10.20.193.28:0/146183332 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f076d9d6b0 con 0x55f076f14ba0 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.076+0000 7fb03affd640 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f076f14ba0 0x55f076f17060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:43.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.077+0000 7fb03affd640 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f076f14ba0 0x55f076f17060 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac20c5498670617f server_cookie=f1c0a4ef761a05d8 in_seq=0 out_seq=0 2026-02-20T03:16:43.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.077+0000 7faffd7fa640 10 client.25618 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:43.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.282+0000 7faffd7fa640 1 -- 10.20.193.28:0/146183332 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f076d9d6b0 con 0x55f076f14ba0 2026-02-20T03:16:43.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.282+0000 7faffd7fa640 10 client.25618 handle_command_reply: tid=0 2026-02-20T03:16:43.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.282+0000 7fb04506be00 1 client.25618 shutdown 2026-02-20T03:16:43.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.282+0000 7fb04506be00 1 -- 10.20.193.28:0/146183332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 msgr2=0x55f076ea41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:43.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.282+0000 7fb04506be00 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076ea41f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb030002e30 tx=0x7fb030009f70 comp rx=0 tx=0).stop 2026-02-20T03:16:43.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.282+0000 7fb04506be00 1 -- 10.20.193.28:0/146183332 shutdown_connections 2026-02-20T03:16:43.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.282+0000 7fb04506be00 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f076f14ba0 0x55f076f17060 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb04506be00 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f076e81560 0x55f076ea2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb04506be00 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f076e7c7c0 0x55f076ea2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb04506be00 1 --2- 10.20.193.28:0/146183332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f076e7be80 0x55f076ea41f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb04506be00 1 -- 10.20.193.28:0/146183332 >> 10.20.193.28:0/146183332 conn(0x55f076e736f0 msgr2=0x55f076e9c840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:43.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7faffd7fa640 0 client.25618 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:43.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb04506be00 1 -- 10.20.193.28:0/146183332 shutdown_connections 2026-02-20T03:16:43.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb04506be00 1 -- 10.20.193.28:0/146183332 wait complete. 2026-02-20T03:16:43.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb04506be00 20 client.25618 trim_cache size 0 max 16384 2026-02-20T03:16:43.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:16:43.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:16:43.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:16:43.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:16:43.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb040ea3640 1 -- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0100b0e20 msgr2=0x7fb0100b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:43.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb040ea3640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0100b0e20 0x7fb0100b32e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb0280a8ab0 tx=0x7fb0280e4b10 comp rx=0 tx=0).stop 2026-02-20T03:16:43.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb040ea3640 1 -- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10d830 msgr2=0x7fb03c1a54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:43.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.283+0000 7fb040ea3640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10d830 0x7fb03c1a54e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb02800ea30 tx=0x7fb02800ef00 comp rx=0 tx=0).stop 2026-02-20T03:16:43.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.284+0000 7fb040ea3640 1 -- 10.20.193.28:0/1654737198 shutdown_connections 2026-02-20T03:16:43.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.284+0000 7fb040ea3640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0100b0e20 0x7fb0100b32e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.284+0000 7fb040ea3640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb03c10eee0 0x7fb03c1aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.284+0000 7fb040ea3640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb03c10e540 0x7fb03c1a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.284+0000 7fb040ea3640 1 --2- 10.20.193.28:0/1654737198 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb03c10d830 0x7fb03c1a54e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:43.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.284+0000 7fb040ea3640 1 -- 10.20.193.28:0/1654737198 >> 10.20.193.28:0/1654737198 conn(0x7fb03c06c680 msgr2=0x7fb03c1119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:43.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.284+0000 7fb040ea3640 1 -- 10.20.193.28:0/1654737198 shutdown_connections 2026-02-20T03:16:43.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:43.284+0000 7fb040ea3640 1 -- 10.20.193.28:0/1654737198 wait complete. 2026-02-20T03:16:43.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 81934 28.78 MB/sec warmup 16 sec latency 81.464 ms 2026-02-20T03:16:43.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:43 trial126 ceph-mon[38476]: pgmap v241: 129 pgs: 129 active+clean; 29 MiB data, 481 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 400 op/s 2026-02-20T03:16:43.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:43 trial028 ceph-mon[38552]: pgmap v241: 129 pgs: 129 active+clean; 29 MiB data, 481 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 400 op/s 2026-02-20T03:16:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:43 trial177 ceph-mon[43181]: pgmap v241: 129 pgs: 129 active+clean; 29 MiB data, 481 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 400 op/s 2026-02-20T03:16:44.034 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:16:44.309 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:44.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 86215 28.35 MB/sec warmup 17 sec latency 11.851 ms 2026-02-20T03:16:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.506+0000 7f3e9d713640 1 -- 10.20.193.28:0/3336013872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e981134d0 msgr2=0x7f3e98115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.506+0000 7f3e9d713640 1 --2- 10.20.193.28:0/3336013872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e981134d0 0x7f3e98115900 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00b0a0 tx=0x7f3e8c02f4c0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.506+0000 7f3e9d713640 1 -- 10.20.193.28:0/3336013872 shutdown_connections 2026-02-20T03:16:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.506+0000 7f3e9d713640 1 --2- 10.20.193.28:0/3336013872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e981134d0 0x7f3e98115900 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.506+0000 7f3e9d713640 1 --2- 10.20.193.28:0/3336013872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e98075950 0x7f3e98075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.506+0000 7f3e9d713640 1 --2- 10.20.193.28:0/3336013872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e981065d0 0x7f3e98075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.506+0000 7f3e9d713640 1 -- 10.20.193.28:0/3336013872 >> 10.20.193.28:0/3336013872 conn(0x7f3e980fe440 msgr2=0x7f3e98100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.507+0000 7f3e9d713640 1 -- 10.20.193.28:0/3336013872 shutdown_connections 2026-02-20T03:16:44.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.507+0000 7f3e9d713640 1 -- 10.20.193.28:0/3336013872 wait complete. 2026-02-20T03:16:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.507+0000 7f3e9d713640 1 Processor -- start 2026-02-20T03:16:44.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.507+0000 7f3e9d713640 1 -- start start 2026-02-20T03:16:44.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9d713640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98075950 0x7f3e981a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9d713640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e981065d0 0x7f3e981a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9d713640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e981134d0 0x7f3e981a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9d713640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e981190c0 con 0x7f3e981134d0 2026-02-20T03:16:44.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9d713640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e98118f40 con 0x7f3e981065d0 2026-02-20T03:16:44.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9d713640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e98119240 con 0x7f3e98075950 2026-02-20T03:16:44.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98075950 0x7f3e981a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98075950 0x7f3e981a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:35888/0 (socket says 10.20.193.28:35888) 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e97fff640 1 -- 10.20.193.28:0/2717813440 learned_addr learned my addr 10.20.193.28:0/2717813440 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9cf12640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e981134d0 0x7f3e981a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e977fe640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e981065d0 0x7f3e981a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9cf12640 1 -- 10.20.193.28:0/2717813440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98075950 msgr2=0x7f3e981a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9cf12640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98075950 0x7f3e981a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9cf12640 1 -- 10.20.193.28:0/2717813440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e981065d0 msgr2=0x7f3e981a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9cf12640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e981065d0 0x7f3e981a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9cf12640 1 -- 10.20.193.28:0/2717813440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e981a6530 con 0x7f3e981134d0 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e977fe640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e981065d0 0x7f3e981a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.508+0000 7f3e9cf12640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e981134d0 0x7f3e981a5db0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00b0a0 tx=0x7f3e8c0049a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.509+0000 7f3e957fa640 1 -- 10.20.193.28:0/2717813440 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c002a60 con 0x7f3e981134d0 2026-02-20T03:16:44.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.509+0000 7f3e957fa640 1 -- 10.20.193.28:0/2717813440 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e8c0092e0 con 0x7f3e981134d0 2026-02-20T03:16:44.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.509+0000 7f3e957fa640 1 -- 10.20.193.28:0/2717813440 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c007e50 con 0x7f3e981134d0 2026-02-20T03:16:44.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.509+0000 7f3e9d713640 1 -- 10.20.193.28:0/2717813440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e981a67c0 con 0x7f3e981134d0 2026-02-20T03:16:44.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.509+0000 7f3e9d713640 1 -- 10.20.193.28:0/2717813440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e981ae060 con 0x7f3e981134d0 2026-02-20T03:16:44.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.511+0000 7f3e957fa640 1 -- 10.20.193.28:0/2717813440 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3e8c0074c0 con 0x7f3e981134d0 2026-02-20T03:16:44.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.512+0000 7f3ea0ea1e00 1 Processor -- start 2026-02-20T03:16:44.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.512+0000 7f3ea0ea1e00 1 -- start start 2026-02-20T03:16:44.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.512+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b66000 0x562b49b663e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.512+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60630 0x562b49b60a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.512+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60fb0 0x562b49b6ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.512+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b49ae0e50 con 0x562b49b60630 2026-02-20T03:16:44.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.512+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562b49ab39c0 con 0x562b49b66000 2026-02-20T03:16:44.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.512+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562b49a61240 con 0x562b49b60fb0 2026-02-20T03:16:44.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e977fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b66000 0x562b49b663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e977fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b66000 0x562b49b663e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38462/0 (socket says 10.20.193.28:38462) 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e977fe640 1 -- 10.20.193.28:0/1667734628 learned_addr learned my addr 10.20.193.28:0/1667734628 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e977fe640 1 --2- 10.20.193.28:0/1667734628 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60fb0 0x562b49b6ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e97fff640 1 --2- 10.20.193.28:0/1667734628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60630 0x562b49b60a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e97fff640 1 -- 10.20.193.28:0/1667734628 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60fb0 msgr2=0x562b49b6ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e97fff640 1 --2- 10.20.193.28:0/1667734628 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60fb0 0x562b49b6ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e97fff640 1 -- 10.20.193.28:0/1667734628 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b66000 msgr2=0x562b49b663e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e97fff640 1 --2- 10.20.193.28:0/1667734628 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b66000 0x562b49b663e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e97fff640 1 -- 10.20.193.28:0/1667734628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b49a74420 con 0x562b49b60630 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e97fff640 1 --2- 10.20.193.28:0/1667734628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60630 0x562b49b60a70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d60 tx=0x7f3e84004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01c3e05dbeac82a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e68ce3640 1 -- 10.20.193.28:0/1667734628 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8401a440 con 0x562b49b60630 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e68ce3640 1 -- 10.20.193.28:0/1667734628 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e840108d0 con 0x562b49b60630 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.513+0000 7f3e68ce3640 1 -- 10.20.193.28:0/1667734628 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400e6f0 con 0x562b49b60630 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1667734628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60630 msgr2=0x562b49b60a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:44.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1667734628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60630 0x562b49b60a70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d60 tx=0x7f3e84004420 comp rx=0 tx=0).stop 2026-02-20T03:16:44.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3e957fa640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0fc0 0x7f3e6c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1667734628 shutdown_connections 2026-02-20T03:16:44.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1667734628 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60fb0 0x562b49b6ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1667734628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60630 0x562b49b60a70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1667734628 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b66000 0x562b49b663e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1667734628 >> 10.20.193.28:0/1667734628 conn(0x562b49b23290 msgr2=0x562b49b5ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:44.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1667734628 shutdown_connections 2026-02-20T03:16:44.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1667734628 wait complete. 2026-02-20T03:16:44.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.514+0000 7f3e957fa640 1 -- 10.20.193.28:0/2717813440 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f3e8c1054a0 con 0x7f3e981134d0 2026-02-20T03:16:44.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.515+0000 7f3ea0ea1e00 1 -- start start 2026-02-20T03:16:44.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.515+0000 7f3e977fe640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0fc0 0x7f3e6c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.516+0000 7f3ea0ea1e00 1 Processor -- start 2026-02-20T03:16:44.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.516+0000 7f3e977fe640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0fc0 0x7f3e6c0b3480 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009530 tx=0x7f3e88018040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:44.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.516+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b7a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.516+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b7ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 0x562b49b78fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b49aaf8f0 con 0x562b49b66000 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b7a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562b498a1f50 con 0x562b49b60fb0 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562b49b79760 con 0x562b49b60630 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e9cf12640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 0x562b49b78fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b7a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:35906/0 (socket says 10.20.193.28:35906) 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e97fff640 1 -- 10.20.193.28:0/1318759710 learned_addr learned my addr 10.20.193.28:0/1318759710 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e9cf12640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 0x562b49b78fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47770/0 (socket says 10.20.193.28:47770) 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e977fe640 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b7ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e97fff640 1 -- 10.20.193.28:0/1318759710 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 msgr2=0x562b49b7ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e97fff640 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b7ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e97fff640 1 -- 10.20.193.28:0/1318759710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 msgr2=0x562b49b78fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:44.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e97fff640 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 0x562b49b78fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.517+0000 7f3e97fff640 1 -- 10.20.193.28:0/1318759710 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b49b72ad0 con 0x562b49b60630 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.518+0000 7f3e97fff640 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b7a8a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e840098c0 tx=0x7f3e84010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dbe4d465a8ec039 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.518+0000 7f3e59ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.518+0000 7f3e59ffb640 1 -- 10.20.193.28:0/1318759710 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8402a070 con 0x562b49b60630 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.518+0000 7f3e59ffb640 1 -- 10.20.193.28:0/1318759710 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e84009980 con 0x562b49b60630 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.518+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1318759710 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b49884b40 con 0x562b49b60630 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.518+0000 7f3e59ffb640 1 -- 10.20.193.28:0/1318759710 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84025410 con 0x562b49b60630 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.518+0000 7f3e59ffb640 1 -- 10.20.193.28:0/1318759710 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f3e8402e3b0 con 0x562b49b60630 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.518+0000 7f3e59ffb640 10 client.25630 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.519+0000 7f3ea0ea1e00 10 client.25630 _ll_register_callbacks cb 0x562b49aecf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.519+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1318759710 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b49ac11a0 con 0x562b49b60630 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.519+0000 7f3e59ffb640 1 -- 10.20.193.28:0/1318759710 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3e84010c90 con 0x562b49b60630 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.519+0000 7f3ea0ea1e00 10 client.25630 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.519+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1318759710 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x562b49a6e230 con 0x562b49b60630 2026-02-20T03:16:44.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.519+0000 7f3e59ffb640 1 -- 10.20.193.28:0/1318759710 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f3e84018020 con 0x562b49b60630 2026-02-20T03:16:44.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.519+0000 7f3ea0ea1e00 10 client.25630 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:44.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.519+0000 7f3ea0ea1e00 10 client.25630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:44.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.519+0000 7f3ea0ea1e00 20 client.25630 populate_metadata read hostname 'trial028' 2026-02-20T03:16:44.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.520+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b49b88f20 0x562b49b8b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.520+0000 7f3ea0ea1e00 4 client.25630 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:44.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.520+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1318759710 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b49abb5b0 con 0x562b49b88f20 2026-02-20T03:16:44.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.520+0000 7f3e977fe640 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b49b88f20 0x562b49b8b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.520+0000 7f3e977fe640 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b49b88f20 0x562b49b8b310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f53780ca49177ac server_cookie=5ceed34393264395 in_seq=0 out_seq=0 2026-02-20T03:16:44.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.520+0000 7f3e59ffb640 10 client.25630 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:44.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3e59ffb640 1 -- 10.20.193.28:0/1318759710 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562b49abb5b0 con 0x562b49b88f20 2026-02-20T03:16:44.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3e59ffb640 10 client.25630 handle_command_reply: tid=0 2026-02-20T03:16:44.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 client.25630 shutdown 2026-02-20T03:16:44.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1318759710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 msgr2=0x562b49b7a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:44.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b7a8a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e840098c0 tx=0x7f3e84010860 comp rx=0 tx=0).stop 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1318759710 shutdown_connections 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b49b88f20 0x562b49b8b310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 0x562b49b78fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b7ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/1318759710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b7a8a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3e59ffb640 0 client.25630 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1318759710 >> 10.20.193.28:0/1318759710 conn(0x562b49b23290 msgr2=0x562b49b5f440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1318759710 shutdown_connections 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.521+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/1318759710 wait complete. 2026-02-20T03:16:44.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.522+0000 7f3ea0ea1e00 20 client.25630 trim_cache size 0 max 16384 2026-02-20T03:16:44.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.530+0000 7f3ea0ea1e00 1 Processor -- start 2026-02-20T03:16:44.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.530+0000 7f3ea0ea1e00 1 -- start start 2026-02-20T03:16:44.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.530+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b85dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.530+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b5f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.530+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 0x562b49b5fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.530+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c012670 con 0x562b49b66000 2026-02-20T03:16:44.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.530+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00ff40 con 0x562b49b60fb0 2026-02-20T03:16:44.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.530+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00dd90 con 0x562b49b60630 2026-02-20T03:16:44.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.530+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b85dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e977fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b5f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e977fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b5f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38480/0 (socket says 10.20.193.28:38480) 2026-02-20T03:16:44.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e977fe640 1 -- 10.20.193.28:0/3757042827 learned_addr learned my addr 10.20.193.28:0/3757042827 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:44.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e9cf12640 1 --2- 10.20.193.28:0/3757042827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 0x562b49b5fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e977fe640 1 -- 10.20.193.28:0/3757042827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 msgr2=0x562b49b85dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:44.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e977fe640 1 --2- 10.20.193.28:0/3757042827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b85dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e977fe640 1 -- 10.20.193.28:0/3757042827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 msgr2=0x562b49b5fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:44.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e977fe640 1 --2- 10.20.193.28:0/3757042827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 0x562b49b5fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e977fe640 1 -- 10.20.193.28:0/3757042827 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b49b66750 con 0x562b49b60fb0 2026-02-20T03:16:44.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e977fe640 1 --2- 10.20.193.28:0/3757042827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b5f520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3e88014440 tx=0x7f3e880047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a329e2fd9959c95 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:44.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e5bfff640 1 -- 10.20.193.28:0/3757042827 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88015250 con 0x562b49b60fb0 2026-02-20T03:16:44.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e5bfff640 1 -- 10.20.193.28:0/3757042827 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e880153f0 con 0x562b49b60fb0 2026-02-20T03:16:44.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.531+0000 7f3e5bfff640 1 -- 10.20.193.28:0/3757042827 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8800f7f0 con 0x562b49b60fb0 2026-02-20T03:16:44.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/3757042827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 msgr2=0x562b49b5f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:44.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/3757042827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b5f520 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3e88014440 tx=0x7f3e880047c0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/3757042827 shutdown_connections 2026-02-20T03:16:44.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/3757042827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b66000 0x562b49b5fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/3757042827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60fb0 0x562b49b5f520 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/3757042827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b60630 0x562b49b85dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/3757042827 >> 10.20.193.28:0/3757042827 conn(0x562b49b23290 msgr2=0x562b49b856c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/3757042827 shutdown_connections 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/3757042827 wait complete. 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 -- start start 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.532+0000 7f3ea0ea1e00 1 Processor -- start 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60630 0x562b49b7de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60fb0 0x562b49b7e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3ea0ea1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b66000 0x562b49bf3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00e400 con 0x562b49b60fb0 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00f870 con 0x562b49b60630 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3ea0ea1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00ead0 con 0x562b49b66000 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60630 0x562b49b7de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60630 0x562b49b7de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38482/0 (socket says 10.20.193.28:38482) 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e97fff640 1 -- 10.20.193.28:0/689890063 learned_addr learned my addr 10.20.193.28:0/689890063 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:44.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e977fe640 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60fb0 0x562b49b7e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e9cf12640 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b66000 0x562b49bf3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e977fe640 1 -- 10.20.193.28:0/689890063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b66000 msgr2=0x562b49bf3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:44.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e977fe640 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b66000 0x562b49bf3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e977fe640 1 -- 10.20.193.28:0/689890063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60630 msgr2=0x562b49b7de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:44.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e977fe640 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60630 0x562b49b7de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e977fe640 1 -- 10.20.193.28:0/689890063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b49b72900 con 0x562b49b60fb0 2026-02-20T03:16:44.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.533+0000 7f3e97fff640 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60630 0x562b49b7de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:44.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3e977fe640 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60fb0 0x562b49b7e3a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3e88017040 tx=0x7f3e880150e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7147f7069263101 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:44.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3e59ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3e59ffb640 1 -- 10.20.193.28:0/689890063 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88039020 con 0x562b49b60fb0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3e59ffb640 1 -- 10.20.193.28:0/689890063 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e880044d0 con 0x562b49b60fb0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3e59ffb640 1 -- 10.20.193.28:0/689890063 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88014520 con 0x562b49b60fb0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/689890063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b49792870 con 0x562b49b60fb0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3ea0ea1e00 10 client.15600 _ll_register_callbacks cb 0x7f3e88014470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/689890063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b49a65b00 con 0x562b49b60fb0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3e59ffb640 1 -- 10.20.193.28:0/689890063 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f3e88005040 con 0x562b49b60fb0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.534+0000 7f3e59ffb640 1 -- 10.20.193.28:0/689890063 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3e880047c0 con 0x562b49b60fb0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3ea0ea1e00 10 client.15600 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/689890063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x562b49a53440 con 0x562b49b60fb0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3e59ffb640 1 -- 10.20.193.28:0/689890063 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f3e8801d040 con 0x562b49b60fb0 2026-02-20T03:16:44.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3ea0ea1e00 10 client.15600 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3ea0ea1e00 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3ea0ea1e00 20 client.15600 populate_metadata read hostname 'trial028' 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b49bf5620 0x562b49bf7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3ea0ea1e00 4 client.15600 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/689890063 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3e880153f0 con 0x562b49bf5620 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.535+0000 7f3e97fff640 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b49bf5620 0x562b49bf7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3e97fff640 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b49bf5620 0x562b49bf7ae0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=896c82013fe66fcb server_cookie=89a697b709ccd8a3 in_seq=0 out_seq=0 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3e59ffb640 10 client.15600 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3e59ffb640 1 -- 10.20.193.28:0/689890063 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f3e880153f0 con 0x562b49bf5620 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3e59ffb640 10 client.15600 handle_command_reply: tid=0 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 client.15600 shutdown 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/689890063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60fb0 msgr2=0x562b49b7e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60fb0 0x562b49b7e3a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3e88017040 tx=0x7f3e880150e0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/689890063 shutdown_connections 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b49bf5620 0x562b49bf7ae0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b49b66000 0x562b49bf3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b49b60fb0 0x562b49b7e3a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 --2- 10.20.193.28:0/689890063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b49b60630 0x562b49b7de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/689890063 >> 10.20.193.28:0/689890063 conn(0x562b49b23290 msgr2=0x562b49b61a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3e59ffb640 0 client.15600 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/689890063 shutdown_connections 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 1 -- 10.20.193.28:0/689890063 wait complete. 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.536+0000 7f3ea0ea1e00 20 client.15600 trim_cache size 0 max 16384 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:16:44.542 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:16:44.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 -- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0fc0 msgr2=0x7f3e6c0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:44.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0fc0 0x7f3e6c0b3480 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009530 tx=0x7f3e88018040 comp rx=0 tx=0).stop 2026-02-20T03:16:44.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 -- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e981134d0 msgr2=0x7f3e981a5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:44.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e981134d0 0x7f3e981a5db0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00b0a0 tx=0x7f3e8c0049a0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 -- 10.20.193.28:0/2717813440 shutdown_connections 2026-02-20T03:16:44.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0fc0 0x7f3e6c0b3480 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e981134d0 0x7f3e981a5db0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e981065d0 0x7f3e981a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 --2- 10.20.193.28:0/2717813440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98075950 0x7f3e981a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:44.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 -- 10.20.193.28:0/2717813440 >> 10.20.193.28:0/2717813440 conn(0x7f3e980fe440 msgr2=0x7f3e981115f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:44.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 -- 10.20.193.28:0/2717813440 shutdown_connections 2026-02-20T03:16:44.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:44.537+0000 7f3e9d713640 1 -- 10.20.193.28:0/2717813440 wait complete. 2026-02-20T03:16:44.643 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:16:44.644 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:16:44.912 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:45.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/1454778487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c410a990 msgr2=0x7ff7c410ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/1454778487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c410a990 0x7ff7c410ad70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009a60 tx=0x7ff7b402f250 comp rx=0 tx=0).stop 2026-02-20T03:16:45.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/1454778487 shutdown_connections 2026-02-20T03:16:45.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/1454778487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7c4105330 0x7ff7c4111860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/1454778487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7c4104990 0x7ff7c4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/1454778487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c410a990 0x7ff7c410ad70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/1454778487 >> 10.20.193.28:0/1454778487 conn(0x7ff7c4100690 msgr2=0x7ff7c4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:45.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/1454778487 shutdown_connections 2026-02-20T03:16:45.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/1454778487 wait complete. 2026-02-20T03:16:45.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.094+0000 7ff7cb0e0640 1 Processor -- start 2026-02-20T03:16:45.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7cb0e0640 1 -- start start 2026-02-20T03:16:45.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7cb0e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c4104990 0x7ff7c419d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7cb0e0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7c4105330 0x7ff7c419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7cb0e0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7c410a990 0x7ff7c41a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7cb0e0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c4114c00 con 0x7ff7c4104990 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7cb0e0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c4114a80 con 0x7ff7c410a990 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7cb0e0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c4114d80 con 0x7ff7c4105330 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7ca0de640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c4104990 0x7ff7c419d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7ca0de640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c4104990 0x7ff7c419d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47808/0 (socket says 10.20.193.28:47808) 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7ca0de640 1 -- 10.20.193.28:0/2416395826 learned_addr learned my addr 10.20.193.28:0/2416395826 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7c98dd640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7c4105330 0x7ff7c419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7ca8df640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7c410a990 0x7ff7c41a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7ca0de640 1 -- 10.20.193.28:0/2416395826 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7c4105330 msgr2=0x7ff7c419d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7ca0de640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7c4105330 0x7ff7c419d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7ca0de640 1 -- 10.20.193.28:0/2416395826 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7c410a990 msgr2=0x7ff7c41a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7ca0de640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7c410a990 0x7ff7c41a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.095+0000 7ff7ca0de640 1 -- 10.20.193.28:0/2416395826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c41a20f0 con 0x7ff7c4104990 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.096+0000 7ff7ca0de640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c4104990 0x7ff7c419d0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff7b402fca0 tx=0x7ff7b402fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.096+0000 7ff7ab7fe640 1 -- 10.20.193.28:0/2416395826 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40384e0 con 0x7ff7c4104990 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.096+0000 7ff7ab7fe640 1 -- 10.20.193.28:0/2416395826 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff7b4038770 con 0x7ff7c4104990 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.096+0000 7ff7ab7fe640 1 -- 10.20.193.28:0/2416395826 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4042680 con 0x7ff7c4104990 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.096+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c41a2380 con 0x7ff7c4104990 2026-02-20T03:16:45.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.096+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c41a9c20 con 0x7ff7c4104990 2026-02-20T03:16:45.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.097+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c41060d0 con 0x7ff7c4104990 2026-02-20T03:16:45.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.099+0000 7ff7ab7fe640 1 -- 10.20.193.28:0/2416395826 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff7b4038920 con 0x7ff7c4104990 2026-02-20T03:16:45.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.101+0000 7ff7ab7fe640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a00b0e20 0x7ff7a00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.101+0000 7ff7ab7fe640 1 -- 10.20.193.28:0/2416395826 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7ff7b4105950 con 0x7ff7c4104990 2026-02-20T03:16:45.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.101+0000 7ff7c98dd640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a00b0e20 0x7ff7a00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.101+0000 7ff7ab7fe640 1 -- 10.20.193.28:0/2416395826 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff7b4047060 con 0x7ff7c4104990 2026-02-20T03:16:45.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.101+0000 7ff7c98dd640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a00b0e20 0x7ff7a00b32e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4102ca0 tx=0x7ff7b8009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:45.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.209+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7c419e400 con 0x7ff7c4104990 2026-02-20T03:16:45.212 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:16:45.213 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T03:15:38:113153+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:37.375812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:16:45.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.209+0000 7ff7ab7fe640 1 -- 10.20.193.28:0/2416395826 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7ff7c419e400 con 0x7ff7c4104990 2026-02-20T03:16:45.214 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T03:16:45.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.210+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a00b0e20 msgr2=0x7ff7a00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.210+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a00b0e20 0x7ff7a00b32e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4102ca0 tx=0x7ff7b8009290 comp rx=0 tx=0).stop 2026-02-20T03:16:45.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.210+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c4104990 msgr2=0x7ff7c419d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.210+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c4104990 0x7ff7c419d0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff7b402fca0 tx=0x7ff7b402fcd0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.211+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 shutdown_connections 2026-02-20T03:16:45.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.211+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7a00b0e20 0x7ff7a00b32e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.211+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7c410a990 0x7ff7c41a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.211+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7c4105330 0x7ff7c419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.211+0000 7ff7cb0e0640 1 --2- 10.20.193.28:0/2416395826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7c4104990 0x7ff7c419d0a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.211+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 >> 10.20.193.28:0/2416395826 conn(0x7ff7c4100690 msgr2=0x7ff7c4100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:45.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.211+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 shutdown_connections 2026-02-20T03:16:45.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.211+0000 7ff7cb0e0640 1 -- 10.20.193.28:0/2416395826 wait complete. 2026-02-20T03:16:45.315 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:16:45.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 91718 28.42 MB/sec warmup 18 sec latency 5.727 ms 2026-02-20T03:16:45.576 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:45.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:45 trial126 ceph-mon[38476]: pgmap v242: 129 pgs: 129 active+clean; 30 MiB data, 508 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 396 op/s 2026-02-20T03:16:45.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:45 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2416395826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:45.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:45 trial028 ceph-mon[38552]: pgmap v242: 129 pgs: 129 active+clean; 30 MiB data, 508 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 396 op/s 2026-02-20T03:16:45.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:45 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2416395826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:45 trial177 ceph-mon[43181]: pgmap v242: 129 pgs: 129 active+clean; 30 MiB data, 508 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 396 op/s 2026-02-20T03:16:45.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:45 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2416395826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:16:45.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.760+0000 7fad576e5640 1 -- 10.20.193.28:0/1697113679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad5010eef0 msgr2=0x7fad5010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.760+0000 7fad576e5640 1 --2- 10.20.193.28:0/1697113679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad5010eef0 0x7fad5010f2d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fad48009a30 tx=0x7fad4802f220 comp rx=0 tx=0).stop 2026-02-20T03:16:45.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.760+0000 7fad576e5640 1 -- 10.20.193.28:0/1697113679 shutdown_connections 2026-02-20T03:16:45.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.760+0000 7fad576e5640 1 --2- 10.20.193.28:0/1697113679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad50109ba0 0x7fad50115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.760+0000 7fad576e5640 1 --2- 10.20.193.28:0/1697113679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad50109220 0x7fad50109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.760+0000 7fad576e5640 1 --2- 10.20.193.28:0/1697113679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad5010eef0 0x7fad5010f2d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.760+0000 7fad576e5640 1 -- 10.20.193.28:0/1697113679 >> 10.20.193.28:0/1697113679 conn(0x7fad50078600 msgr2=0x7fad5007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:45.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.760+0000 7fad576e5640 1 -- 10.20.193.28:0/1697113679 shutdown_connections 2026-02-20T03:16:45.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.760+0000 7fad576e5640 1 -- 10.20.193.28:0/1697113679 wait complete. 2026-02-20T03:16:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.761+0000 7fad576e5640 1 Processor -- start 2026-02-20T03:16:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.761+0000 7fad576e5640 1 -- start start 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.761+0000 7fad576e5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad50109220 0x7fad501a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.761+0000 7fad576e5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad50109ba0 0x7fad501a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.761+0000 7fad576e5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad5010eef0 0x7fad501a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.761+0000 7fad576e5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad50119080 con 0x7fad5010eef0 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.761+0000 7fad576e5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fad50118f00 con 0x7fad50109220 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.761+0000 7fad576e5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad50119200 con 0x7fad50109ba0 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.761+0000 7fad566e3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad50109220 0x7fad501a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad566e3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad50109220 0x7fad501a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38520/0 (socket says 10.20.193.28:38520) 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad566e3640 1 -- 10.20.193.28:0/4151420776 learned_addr learned my addr 10.20.193.28:0/4151420776 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad55ee2640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad50109ba0 0x7fad501a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad56ee4640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad5010eef0 0x7fad501a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad566e3640 1 -- 10.20.193.28:0/4151420776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad50109ba0 msgr2=0x7fad501a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad566e3640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad50109ba0 0x7fad501a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad566e3640 1 -- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad5010eef0 msgr2=0x7fad501a5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad566e3640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad5010eef0 0x7fad501a5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad566e3640 1 -- 10.20.193.28:0/4151420776 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad501a65f0 con 0x7fad50109220 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad56ee4640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad5010eef0 0x7fad501a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.762+0000 7fad566e3640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad50109220 0x7fad501a15a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad4802f730 tx=0x7fad48004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.763+0000 7fad3b7fe640 1 -- 10.20.193.28:0/4151420776 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48004550 con 0x7fad50109220 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.763+0000 7fad3b7fe640 1 -- 10.20.193.28:0/4151420776 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad48038e20 con 0x7fad50109220 2026-02-20T03:16:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.763+0000 7fad576e5640 1 -- 10.20.193.28:0/4151420776 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad501a6880 con 0x7fad50109220 2026-02-20T03:16:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.763+0000 7fad3b7fe640 1 -- 10.20.193.28:0/4151420776 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48004c20 con 0x7fad50109220 2026-02-20T03:16:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.763+0000 7fad576e5640 1 -- 10.20.193.28:0/4151420776 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad501ae120 con 0x7fad50109220 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad5ae73e00 1 Processor -- start 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad5ae73e00 1 -- start start 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad3b7fe640 1 -- 10.20.193.28:0/4151420776 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fad48005340 con 0x7fad50109220 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b62672390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b6266ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266cf60 0x560b62678de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560b625ece00 con 0x560b62671fb0 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560b625bf970 con 0x560b6266cf60 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560b6256d1f0 con 0x560b6266c5e0 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad566e3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b6266ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad55ee2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266cf60 0x560b62678de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad566e3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b6266ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:35982/0 (socket says 10.20.193.28:35982) 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.766+0000 7fad566e3640 1 -- 10.20.193.28:0/4285013213 learned_addr learned my addr 10.20.193.28:0/4285013213 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.767+0000 7fad566e3640 1 -- 10.20.193.28:0/4285013213 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266cf60 msgr2=0x560b62678de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.767+0000 7fad566e3640 1 --2- 10.20.193.28:0/4285013213 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266cf60 0x560b62678de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.767+0000 7fad566e3640 1 -- 10.20.193.28:0/4285013213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 msgr2=0x560b62672390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.767+0000 7fad566e3640 1 --2- 10.20.193.28:0/4285013213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b62672390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.767+0000 7fad566e3640 1 -- 10.20.193.28:0/4285013213 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b625803d0 con 0x560b6266c5e0 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.767+0000 7fad566e3640 1 --2- 10.20.193.28:0/4285013213 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b6266ca20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad4810d110 tx=0x7fad4810d210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8690b1ba70c824fc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.767+0000 7fad38ff9640 1 -- 10.20.193.28:0/4285013213 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4810de60 con 0x560b6266c5e0 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.767+0000 7fad38ff9640 1 -- 10.20.193.28:0/4285013213 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad48112070 con 0x560b6266c5e0 2026-02-20T03:16:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.767+0000 7fad38ff9640 1 -- 10.20.193.28:0/4285013213 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48105750 con 0x560b6266c5e0 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad3b7fe640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad2c0b0e20 0x7fad2c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad5ae73e00 1 -- 10.20.193.28:0/4285013213 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 msgr2=0x560b6266ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/4285013213 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b6266ca20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad4810d110 tx=0x7fad4810d210 comp rx=0 tx=0).stop 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad3b7fe640 1 -- 10.20.193.28:0/4151420776 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fad48104f80 con 0x7fad50109220 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad5ae73e00 1 -- 10.20.193.28:0/4285013213 shutdown_connections 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/4285013213 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266cf60 0x560b62678de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/4285013213 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b6266ca20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/4285013213 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b62672390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad5ae73e00 1 -- 10.20.193.28:0/4285013213 >> 10.20.193.28:0/4285013213 conn(0x560b6262f240 msgr2=0x560b6266ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad5ae73e00 1 -- 10.20.193.28:0/4285013213 shutdown_connections 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad56ee4640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad2c0b0e20 0x7fad2c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.768+0000 7fad5ae73e00 1 -- 10.20.193.28:0/4285013213 wait complete. 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.769+0000 7fad56ee4640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad2c0b0e20 0x7fad2c0b32e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fad440040a0 tx=0x7fad4400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad5ae73e00 1 -- start start 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad5ae73e00 1 Processor -- start 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 0x560b62686870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b62686db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b62684fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560b625bb8a0 con 0x560b62671fb0 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560b623adf50 con 0x560b6266c5e0 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560b62685730 con 0x560b6266cf60 2026-02-20T03:16:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad55ee2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b62686db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad55ee2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b62686db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:35986/0 (socket says 10.20.193.28:35986) 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.770+0000 7fad55ee2640 1 -- 10.20.193.28:0/2473951791 learned_addr learned my addr 10.20.193.28:0/2473951791 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad55ee2640 1 -- 10.20.193.28:0/2473951791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 msgr2=0x560b62686870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad566e3640 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 0x560b62686870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad55ee2640 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 0x560b62686870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad56ee4640 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b62684fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad55ee2640 1 -- 10.20.193.28:0/2473951791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 msgr2=0x560b62684fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad55ee2640 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b62684fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad55ee2640 1 -- 10.20.193.28:0/2473951791 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b6267e700 con 0x560b6266cf60 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad55ee2640 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b62686db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009d50 tx=0x7fad3c002ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1019d97161be417a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad56ee4640 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b62684fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad03fff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad03fff640 1 -- 10.20.193.28:0/2473951791 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0125a0 con 0x560b6266cf60 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad03fff640 1 -- 10.20.193.28:0/2473951791 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad3c012be0 con 0x560b6266cf60 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2473951791 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b62390b40 con 0x560b6266cf60 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad03fff640 1 -- 10.20.193.28:0/2473951791 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c010c90 con 0x560b6266cf60 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad5ae73e00 10 client.25654 _ll_register_callbacks cb 0x560b625f8eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2473951791 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b625cd150 con 0x560b6266cf60 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.771+0000 7fad03fff640 1 -- 10.20.193.28:0/2473951791 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fad3c01c420 con 0x560b6266cf60 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad03fff640 1 -- 10.20.193.28:0/2473951791 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fad3c010e30 con 0x560b6266cf60 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad5ae73e00 10 client.25654 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2473951791 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x560b6257a1e0 con 0x560b6266cf60 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad03fff640 1 -- 10.20.193.28:0/2473951791 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fad3c024030 con 0x560b6266cf60 2026-02-20T03:16:45.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad5ae73e00 10 client.25654 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:45.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad5ae73e00 10 client.25654 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:16:45.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad5ae73e00 20 client.25654 populate_metadata read hostname 'trial028' 2026-02-20T03:16:45.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x560b62695080 0x560b62697540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad5ae73e00 4 client.25654 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:45.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2473951791 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b625cd150 con 0x560b62695080 2026-02-20T03:16:45.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.772+0000 7fad566e3640 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x560b62695080 0x560b62697540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.773+0000 7fad566e3640 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x560b62695080 0x560b62697540 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=49983736aa422b57 server_cookie=1f0b9b3869c92954 in_seq=0 out_seq=0 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.773+0000 7fad03fff640 10 client.25654 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.773+0000 7fad03fff640 1 -- 10.20.193.28:0/2473951791 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560b625cd150 con 0x560b62695080 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.773+0000 7fad03fff640 10 client.25654 handle_command_reply: tid=0 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.773+0000 7fad5ae73e00 1 client.25654 shutdown 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.773+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2473951791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 msgr2=0x560b62686db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.773+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b62686db0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009d50 tx=0x7fad3c002ab0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2473951791 shutdown_connections 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x560b62695080 0x560b62697540 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b62684fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b62686db0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2473951791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 0x560b62686870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2473951791 >> 10.20.193.28:0/2473951791 conn(0x560b6262f240 msgr2=0x560b6266b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:45.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad03fff640 0 client.25654 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:16:45.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2473951791 shutdown_connections 2026-02-20T03:16:45.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2473951791 wait complete. 2026-02-20T03:16:45.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.774+0000 7fad5ae73e00 20 client.25654 trim_cache size 0 max 16384 2026-02-20T03:16:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad5ae73e00 1 Processor -- start 2026-02-20T03:16:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad5ae73e00 1 -- start start 2026-02-20T03:16:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 0x560b62670cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b6266b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b6266ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7facf8012670 con 0x560b62671fb0 2026-02-20T03:16:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7facf800ff40 con 0x560b6266c5e0 2026-02-20T03:16:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7facf800dd90 con 0x560b6266cf60 2026-02-20T03:16:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad55ee2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b6266b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad566e3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 0x560b62670cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad56ee4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b6266ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad55ee2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b6266b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36002/0 (socket says 10.20.193.28:36002) 2026-02-20T03:16:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad55ee2640 1 -- 10.20.193.28:0/3400876526 learned_addr learned my addr 10.20.193.28:0/3400876526 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad55ee2640 1 -- 10.20.193.28:0/3400876526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 msgr2=0x560b62670cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad55ee2640 1 --2- 10.20.193.28:0/3400876526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 0x560b62670cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad55ee2640 1 -- 10.20.193.28:0/3400876526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 msgr2=0x560b6266ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad55ee2640 1 --2- 10.20.193.28:0/3400876526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b6266ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad55ee2640 1 -- 10.20.193.28:0/3400876526 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b6267e530 con 0x560b6266cf60 2026-02-20T03:16:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.781+0000 7fad56ee4640 1 --2- 10.20.193.28:0/3400876526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b6266ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad55ee2640 1 --2- 10.20.193.28:0/3400876526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b6266b4d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fad3c010e00 tx=0x7fad3c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b8f79590293554d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad1e4e6640 1 -- 10.20.193.28:0/3400876526 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c033070 con 0x560b6266cf60 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad1e4e6640 1 -- 10.20.193.28:0/3400876526 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad3c0104d0 con 0x560b6266cf60 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad1e4e6640 1 -- 10.20.193.28:0/3400876526 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c033070 con 0x560b6266cf60 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad5ae73e00 1 -- 10.20.193.28:0/3400876526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 msgr2=0x560b6266b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/3400876526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b6266b4d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fad3c010e00 tx=0x7fad3c020000 comp rx=0 tx=0).stop 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad5ae73e00 1 -- 10.20.193.28:0/3400876526 shutdown_connections 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/3400876526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b62671fb0 0x560b6266ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/3400876526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266cf60 0x560b6266b4d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/3400876526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b6266c5e0 0x560b62670cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad5ae73e00 1 -- 10.20.193.28:0/3400876526 >> 10.20.193.28:0/3400876526 conn(0x560b6262f240 msgr2=0x560b62683f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad5ae73e00 1 -- 10.20.193.28:0/3400876526 shutdown_connections 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.782+0000 7fad5ae73e00 1 -- 10.20.193.28:0/3400876526 wait complete. 2026-02-20T03:16:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad5ae73e00 1 -- start start 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad5ae73e00 1 Processor -- start 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b62689c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b6266cf60 0x560b6268a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad5ae73e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b62671fb0 0x560b62700080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7facf800e400 con 0x560b6266cf60 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7facf800f870 con 0x560b62671fb0 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad5ae73e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7facf800ead0 con 0x560b6266c5e0 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad566e3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b62689c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad55ee2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b6266cf60 0x560b6268a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad566e3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b62689c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36006/0 (socket says 10.20.193.28:36006) 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.783+0000 7fad566e3640 1 -- 10.20.193.28:0/2376172266 learned_addr learned my addr 10.20.193.28:0/2376172266 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad56ee4640 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b62671fb0 0x560b62700080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad566e3640 1 -- 10.20.193.28:0/2376172266 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b62671fb0 msgr2=0x560b62700080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad566e3640 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b62671fb0 0x560b62700080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad566e3640 1 -- 10.20.193.28:0/2376172266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b6266cf60 msgr2=0x560b6268a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad566e3640 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b6266cf60 0x560b6268a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad566e3640 1 -- 10.20.193.28:0/2376172266 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b6229e870 con 0x560b6266c5e0 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad55ee2640 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b6266cf60 0x560b6268a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad566e3640 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b62689c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad480c8310 tx=0x7fad48115ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=febe988dab2c9a7d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad03fff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad03fff640 1 -- 10.20.193.28:0/2376172266 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad480c88d0 con 0x560b6266c5e0 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad03fff640 1 -- 10.20.193.28:0/2376172266 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad48033040 con 0x560b6266c5e0 2026-02-20T03:16:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad03fff640 1 -- 10.20.193.28:0/2376172266 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48108890 con 0x560b6266c5e0 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2376172266 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b6255f3f0 con 0x560b6266c5e0 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad03fff640 1 -- 10.20.193.28:0/2376172266 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fad4810dc60 con 0x560b6266c5e0 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad5ae73e00 10 client.25660 _ll_register_callbacks cb 0x7fad3c004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.784+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2376172266 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b625c7560 con 0x560b6266c5e0 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad03fff640 1 -- 10.20.193.28:0/2376172266 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fad480cc180 con 0x560b6266c5e0 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad5ae73e00 10 client.25660 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2376172266 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x560b6267f220 con 0x560b6266c5e0 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad03fff640 1 -- 10.20.193.28:0/2376172266 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fad480f3120 con 0x560b6266c5e0 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad5ae73e00 10 client.25660 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad5ae73e00 10 client.25660 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad5ae73e00 20 client.25660 populate_metadata read hostname 'trial028' 2026-02-20T03:16:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x560b627012f0 0x560b627037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad5ae73e00 4 client.25660 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2376172266 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b62571ab0 con 0x560b627012f0 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.785+0000 7fad55ee2640 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x560b627012f0 0x560b627037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad55ee2640 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x560b627012f0 0x560b627037b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=987cfce3098baa93 server_cookie=ca5520398c1c1d27 in_seq=0 out_seq=0 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad03fff640 10 client.25660 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad03fff640 1 -- 10.20.193.28:0/2376172266 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b62571ab0 con 0x560b627012f0 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad03fff640 10 client.25660 handle_command_reply: tid=0 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 client.25660 shutdown 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2376172266 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 msgr2=0x560b62689c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b62689c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad480c8310 tx=0x7fad48115ef0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2376172266 shutdown_connections 2026-02-20T03:16:45.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b62671fb0 0x560b62700080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x560b627012f0 0x560b627037b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b6266cf60 0x560b6268a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 --2- 10.20.193.28:0/2376172266 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b6266c5e0 0x560b62689c10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2376172266 >> 10.20.193.28:0/2376172266 conn(0x560b6262f240 msgr2=0x560b6266da10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:45.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad03fff640 0 client.25660 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:16:45.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2376172266 shutdown_connections 2026-02-20T03:16:45.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 1 -- 10.20.193.28:0/2376172266 wait complete. 2026-02-20T03:16:45.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.786+0000 7fad5ae73e00 20 client.25660 trim_cache size 0 max 16384 2026-02-20T03:16:45.795 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:16:45.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 -- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad2c0b0e20 msgr2=0x7fad2c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad2c0b0e20 0x7fad2c0b32e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fad440040a0 tx=0x7fad4400b040 comp rx=0 tx=0).stop 2026-02-20T03:16:45.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 -- 10.20.193.28:0/4151420776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad50109220 msgr2=0x7fad501a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:45.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad50109220 0x7fad501a15a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad4802f730 tx=0x7fad48004360 comp rx=0 tx=0).stop 2026-02-20T03:16:45.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 -- 10.20.193.28:0/4151420776 shutdown_connections 2026-02-20T03:16:45.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad2c0b0e20 0x7fad2c0b32e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad5010eef0 0x7fad501a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad50109ba0 0x7fad501a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 --2- 10.20.193.28:0/4151420776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad50109220 0x7fad501a15a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:45.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 -- 10.20.193.28:0/4151420776 >> 10.20.193.28:0/4151420776 conn(0x7fad50078600 msgr2=0x7fad50079fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:45.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 -- 10.20.193.28:0/4151420776 shutdown_connections 2026-02-20T03:16:45.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:45.787+0000 7fad576e5640 1 -- 10.20.193.28:0/4151420776 wait complete. 2026-02-20T03:16:45.887 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:16:46.156 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:46.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.379+0000 7f93607f7640 1 -- 10.20.193.28:0/1932688747 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f935810a850 msgr2=0x7f935810acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.379+0000 7f93607f7640 1 --2- 10.20.193.28:0/1932688747 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f935810a850 0x7f935810acb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f934c009a60 tx=0x7f934c02f250 comp rx=0 tx=0).stop 2026-02-20T03:16:46.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.379+0000 7f93607f7640 1 -- 10.20.193.28:0/1932688747 shutdown_connections 2026-02-20T03:16:46.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.379+0000 7f93607f7640 1 --2- 10.20.193.28:0/1932688747 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935811c780 0x7f935811eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.379+0000 7f93607f7640 1 --2- 10.20.193.28:0/1932688747 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f935810a850 0x7f935810acb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.379+0000 7f93607f7640 1 --2- 10.20.193.28:0/1932688747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935810a470 0x7f93581114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.379+0000 7f93607f7640 1 -- 10.20.193.28:0/1932688747 >> 10.20.193.28:0/1932688747 conn(0x7f935806ec00 msgr2=0x7f935806f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:46.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.380+0000 7f93607f7640 1 -- 10.20.193.28:0/1932688747 shutdown_connections 2026-02-20T03:16:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.380+0000 7f93607f7640 1 -- 10.20.193.28:0/1932688747 wait complete. 2026-02-20T03:16:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.381+0000 7f93607f7640 1 Processor -- start 2026-02-20T03:16:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.381+0000 7f93607f7640 1 -- start start 2026-02-20T03:16:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.381+0000 7f93607f7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810a470 0x7f93581aa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.381+0000 7f93607f7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935810a850 0x7f93581aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.381+0000 7f93607f7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f935811c780 0x7f93581aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.381+0000 7f93607f7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9358121d10 con 0x7f935810a850 2026-02-20T03:16:46.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.381+0000 7f93607f7640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9358121b90 con 0x7f935811c780 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.381+0000 7f93607f7640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9358121e90 con 0x7f935810a470 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935e56c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810a470 0x7f93581aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935ed6d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f935811c780 0x7f93581aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935e56c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810a470 0x7f93581aa210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:41384/0 (socket says 10.20.193.28:41384) 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935e56c640 1 -- 10.20.193.28:0/1415195670 learned_addr learned my addr 10.20.193.28:0/1415195670 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935dd6b640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935810a850 0x7f93581aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935e56c640 1 -- 10.20.193.28:0/1415195670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f935811c780 msgr2=0x7f93581aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935e56c640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f935811c780 0x7f93581aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935e56c640 1 -- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935810a850 msgr2=0x7f93581aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935e56c640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935810a850 0x7f93581aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935e56c640 1 -- 10.20.193.28:0/1415195670 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93581af260 con 0x7f935810a470 2026-02-20T03:16:46.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935dd6b640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935810a850 0x7f93581aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:46.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.382+0000 7f935e56c640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810a470 0x7f93581aa210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f935400ea10 tx=0x7f935400eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.383+0000 7f933f7fe640 1 -- 10.20.193.28:0/1415195670 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935400ce50 con 0x7f935810a470 2026-02-20T03:16:46.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.384+0000 7f933f7fe640 1 -- 10.20.193.28:0/1415195670 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9354004570 con 0x7f935810a470 2026-02-20T03:16:46.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.384+0000 7f93607f7640 1 -- 10.20.193.28:0/1415195670 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93581af550 con 0x7f935810a470 2026-02-20T03:16:46.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.384+0000 7f933f7fe640 1 -- 10.20.193.28:0/1415195670 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354010690 con 0x7f935810a470 2026-02-20T03:16:46.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.384+0000 7f93607f7640 1 -- 10.20.193.28:0/1415195670 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93581b6d90 con 0x7f935810a470 2026-02-20T03:16:46.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.387+0000 7f933f7fe640 1 -- 10.20.193.28:0/1415195670 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9354020030 con 0x7f935810a470 2026-02-20T03:16:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.388+0000 7f9362cfce00 1 Processor -- start 2026-02-20T03:16:46.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f9362cfce00 1 -- start start 2026-02-20T03:16:46.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad1340f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340ff90 0x55ad134139a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 0x55ad1341bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f9362cfce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad1338fe00 con 0x55ad1340f5e0 2026-02-20T03:16:46.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f9362cfce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ad13362970 con 0x55ad1340ff90 2026-02-20T03:16:46.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f9362cfce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad133101f0 con 0x55ad134140d0 2026-02-20T03:16:46.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f935dd6b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 0x55ad1341bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f935ed6d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad1340f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.389+0000 7f935ed6d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad1340f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47102/0 (socket says 10.20.193.28:47102) 2026-02-20T03:16:46.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.390+0000 7f935e56c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340ff90 0x55ad134139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.390+0000 7f935ed6d640 1 -- 10.20.193.28:0/2247079228 learned_addr learned my addr 10.20.193.28:0/2247079228 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:46.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.390+0000 7f935dd6b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 0x55ad1341bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:41388/0 (socket says 10.20.193.28:41388) 2026-02-20T03:16:46.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f935ed6d640 1 -- 10.20.193.28:0/2247079228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 msgr2=0x55ad1341bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f935ed6d640 1 --2- 10.20.193.28:0/2247079228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 0x55ad1341bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f935ed6d640 1 -- 10.20.193.28:0/2247079228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340ff90 msgr2=0x55ad134139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f933f7fe640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93340b1090 0x7f93340b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f935ed6d640 1 --2- 10.20.193.28:0/2247079228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340ff90 0x55ad134139a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f935ed6d640 1 -- 10.20.193.28:0/2247079228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad133233d0 con 0x55ad1340f5e0 2026-02-20T03:16:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f933f7fe640 1 -- 10.20.193.28:0/1415195670 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f93540040d0 con 0x7f935810a470 2026-02-20T03:16:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f935ed6d640 1 --2- 10.20.193.28:0/2247079228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad1340f9c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9350009480 tx=0x7f9350009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2b3f6cf1f6e211 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f935e56c640 1 --2- 10.20.193.28:0/2247079228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340ff90 0x55ad134139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f935ed6d640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93340b1090 0x7f93340b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.391+0000 7f933ccf3640 1 -- 10.20.193.28:0/2247079228 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350019070 con 0x55ad1340f5e0 2026-02-20T03:16:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f935ed6d640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93340b1090 0x7f93340b3550 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f935001b000 tx=0x7f9350019000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f933ccf3640 1 -- 10.20.193.28:0/2247079228 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f935001ee10 con 0x55ad1340f5e0 2026-02-20T03:16:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f933ccf3640 1 -- 10.20.193.28:0/2247079228 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93500143b0 con 0x55ad1340f5e0 2026-02-20T03:16:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f9362cfce00 1 -- 10.20.193.28:0/2247079228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 msgr2=0x55ad1340f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f9362cfce00 1 --2- 10.20.193.28:0/2247079228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad1340f9c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9350009480 tx=0x7f9350009920 comp rx=0 tx=0).stop 2026-02-20T03:16:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f9362cfce00 1 -- 10.20.193.28:0/2247079228 shutdown_connections 2026-02-20T03:16:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f9362cfce00 1 --2- 10.20.193.28:0/2247079228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 0x55ad1341bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f9362cfce00 1 --2- 10.20.193.28:0/2247079228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340ff90 0x55ad134139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f9362cfce00 1 --2- 10.20.193.28:0/2247079228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad1340f9c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.392+0000 7f9362cfce00 1 -- 10.20.193.28:0/2247079228 >> 10.20.193.28:0/2247079228 conn(0x55ad133d2240 msgr2=0x55ad1340dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.393+0000 7f9362cfce00 1 -- 10.20.193.28:0/2247079228 shutdown_connections 2026-02-20T03:16:46.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.393+0000 7f9362cfce00 1 -- 10.20.193.28:0/2247079228 wait complete. 2026-02-20T03:16:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.394+0000 7f9362cfce00 1 -- start start 2026-02-20T03:16:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.394+0000 7f9362cfce00 1 Processor -- start 2026-02-20T03:16:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.395+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340f5e0 0x55ad134280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.395+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340ff90 0x55ad13428610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.395+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 0x55ad1342db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.395+0000 7f9362cfce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad1335e8a0 con 0x55ad1340ff90 2026-02-20T03:16:46.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.395+0000 7f935e56c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340f5e0 0x55ad134280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.395+0000 7f935e56c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340f5e0 0x55ad134280d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48930/0 (socket says 10.20.193.28:48930) 2026-02-20T03:16:46.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.395+0000 7f9362cfce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ad13150f50 con 0x55ad1340f5e0 2026-02-20T03:16:46.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.395+0000 7f9362cfce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad1342e0b0 con 0x55ad134140d0 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.395+0000 7f935e56c640 1 -- 10.20.193.28:0/1201508278 learned_addr learned my addr 10.20.193.28:0/1201508278 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.396+0000 7f935dd6b640 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340ff90 0x55ad13428610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.396+0000 7f935ed6d640 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 0x55ad1342db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.396+0000 7f935e56c640 1 -- 10.20.193.28:0/1201508278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 msgr2=0x55ad1342db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.396+0000 7f935e56c640 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 0x55ad1342db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.396+0000 7f935e56c640 1 -- 10.20.193.28:0/1201508278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340ff90 msgr2=0x55ad13428610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.396+0000 7f935e56c640 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340ff90 0x55ad13428610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.396+0000 7f935e56c640 1 -- 10.20.193.28:0/1201508278 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad13421840 con 0x55ad1340f5e0 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.396+0000 7f935e56c640 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340f5e0 0x55ad134280d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93540a97d0 tx=0x7f9354014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cedf17f7f5c5c45 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.396+0000 7f930bfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:46.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.397+0000 7f930bfff640 1 -- 10.20.193.28:0/1201508278 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9354095020 con 0x55ad1340f5e0 2026-02-20T03:16:46.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.397+0000 7f9362cfce00 1 -- 10.20.193.28:0/1201508278 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad13133b40 con 0x55ad1340f5e0 2026-02-20T03:16:46.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.397+0000 7f9362cfce00 10 client.25685 _ll_register_callbacks cb 0x55ad1339beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:46.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.397+0000 7f9362cfce00 1 -- 10.20.193.28:0/1201508278 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ad13370150 con 0x55ad1340f5e0 2026-02-20T03:16:46.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.400+0000 7f930bfff640 1 -- 10.20.193.28:0/1201508278 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f93540a9f40 con 0x55ad1340f5e0 2026-02-20T03:16:46.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.400+0000 7f930bfff640 1 -- 10.20.193.28:0/1201508278 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93540a51c0 con 0x55ad1340f5e0 2026-02-20T03:16:46.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.400+0000 7f930bfff640 1 -- 10.20.193.28:0/1201508278 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f93540a82c0 con 0x55ad1340f5e0 2026-02-20T03:16:46.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.400+0000 7f930bfff640 1 -- 10.20.193.28:0/1201508278 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f93540a8580 con 0x55ad1340f5e0 2026-02-20T03:16:46.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.400+0000 7f9362cfce00 10 client.25685 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:46.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.400+0000 7f9362cfce00 1 -- 10.20.193.28:0/1201508278 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55ad1331d1e0 con 0x55ad1340f5e0 2026-02-20T03:16:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.401+0000 7f930bfff640 1 -- 10.20.193.28:0/1201508278 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f93540a8850 con 0x55ad1340f5e0 2026-02-20T03:16:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.401+0000 7f9362cfce00 10 client.25685 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.401+0000 7f9362cfce00 10 client.25685 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:16:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.401+0000 7f9362cfce00 20 client.25685 populate_metadata read hostname 'trial028' 2026-02-20T03:16:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.401+0000 7f9362cfce00 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ad134380f0 0x55ad1343a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.401+0000 7f9362cfce00 4 client.25685 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:46.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.401+0000 7f9362cfce00 1 -- 10.20.193.28:0/1201508278 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad1336a560 con 0x55ad134380f0 2026-02-20T03:16:46.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.401+0000 7f935dd6b640 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ad134380f0 0x55ad1343a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.402+0000 7f935dd6b640 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ad134380f0 0x55ad1343a540 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8d949d5e797f3596 server_cookie=6c5667d3881cf502 in_seq=0 out_seq=0 2026-02-20T03:16:46.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.402+0000 7f930bfff640 10 client.25685 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:16:46.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.402+0000 7f930bfff640 1 -- 10.20.193.28:0/1201508278 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ad1336a560 con 0x55ad134380f0 2026-02-20T03:16:46.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.402+0000 7f930bfff640 10 client.25685 handle_command_reply: tid=0 2026-02-20T03:16:46.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.402+0000 7f9362cfce00 1 client.25685 shutdown 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.402+0000 7f9362cfce00 1 -- 10.20.193.28:0/1201508278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340f5e0 msgr2=0x55ad134280d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.402+0000 7f9362cfce00 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340f5e0 0x55ad134280d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93540a97d0 tx=0x7f9354014000 comp rx=0 tx=0).stop 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.402+0000 7f9362cfce00 1 -- 10.20.193.28:0/1201508278 shutdown_connections 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.402+0000 7f9362cfce00 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ad134380f0 0x55ad1343a540 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.403+0000 7f9362cfce00 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad134140d0 0x55ad1342db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.403+0000 7f9362cfce00 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340ff90 0x55ad13428610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.403+0000 7f9362cfce00 1 --2- 10.20.193.28:0/1201508278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad1340f5e0 0x55ad134280d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.403+0000 7f9362cfce00 1 -- 10.20.193.28:0/1201508278 >> 10.20.193.28:0/1201508278 conn(0x55ad133d2240 msgr2=0x55ad134128f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.403+0000 7f930bfff640 0 client.25685 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.403+0000 7f9362cfce00 1 -- 10.20.193.28:0/1201508278 shutdown_connections 2026-02-20T03:16:46.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.403+0000 7f9362cfce00 1 -- 10.20.193.28:0/1201508278 wait complete. 2026-02-20T03:16:46.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.403+0000 7f9362cfce00 20 client.25685 trim_cache size 0 max 16384 2026-02-20T03:16:46.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.410+0000 7f9362cfce00 1 Processor -- start 2026-02-20T03:16:46.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.410+0000 7f9362cfce00 1 -- start start 2026-02-20T03:16:46.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.410+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad13412e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.410+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 0x55ad134133b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.410+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad13425370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.410+0000 7f9362cfce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc0127a0 con 0x55ad1340f5e0 2026-02-20T03:16:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.410+0000 7f9362cfce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc010070 con 0x55ad134140d0 2026-02-20T03:16:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.410+0000 7f9362cfce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc00de60 con 0x55ad1340ff90 2026-02-20T03:16:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935e56c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad13412e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935ed6d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad13425370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935e56c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad13412e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47114/0 (socket says 10.20.193.28:47114) 2026-02-20T03:16:46.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935e56c640 1 -- 10.20.193.28:0/2018022689 learned_addr learned my addr 10.20.193.28:0/2018022689 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935dd6b640 1 --2- 10.20.193.28:0/2018022689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 0x55ad134133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935ed6d640 1 -- 10.20.193.28:0/2018022689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 msgr2=0x55ad134133b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935ed6d640 1 --2- 10.20.193.28:0/2018022689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 0x55ad134133b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935ed6d640 1 -- 10.20.193.28:0/2018022689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 msgr2=0x55ad13412e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935ed6d640 1 --2- 10.20.193.28:0/2018022689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad13412e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935ed6d640 1 -- 10.20.193.28:0/2018022689 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad13421670 con 0x55ad134140d0 2026-02-20T03:16:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935e56c640 1 --2- 10.20.193.28:0/2018022689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad13412e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:46.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.411+0000 7f935ed6d640 1 --2- 10.20.193.28:0/2018022689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad13425370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9350015bf0 tx=0x7f93500090b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d105a346516270 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f93264e6640 1 -- 10.20.193.28:0/2018022689 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350013cd0 con 0x55ad134140d0 2026-02-20T03:16:46.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f93264e6640 1 -- 10.20.193.28:0/2018022689 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9350013e70 con 0x55ad134140d0 2026-02-20T03:16:46.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f93264e6640 1 -- 10.20.193.28:0/2018022689 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93500346d0 con 0x55ad134140d0 2026-02-20T03:16:46.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f9362cfce00 1 -- 10.20.193.28:0/2018022689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 msgr2=0x55ad13425370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f9362cfce00 1 --2- 10.20.193.28:0/2018022689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad13425370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9350015bf0 tx=0x7f93500090b0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f9362cfce00 1 -- 10.20.193.28:0/2018022689 shutdown_connections 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f9362cfce00 1 --2- 10.20.193.28:0/2018022689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad13425370 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f9362cfce00 1 --2- 10.20.193.28:0/2018022689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 0x55ad134133b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f9362cfce00 1 --2- 10.20.193.28:0/2018022689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad13412e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f9362cfce00 1 -- 10.20.193.28:0/2018022689 >> 10.20.193.28:0/2018022689 conn(0x55ad133d2240 msgr2=0x55ad13415400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f9362cfce00 1 -- 10.20.193.28:0/2018022689 shutdown_connections 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.412+0000 7f9362cfce00 1 -- 10.20.193.28:0/2018022689 wait complete. 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.413+0000 7f9362cfce00 1 -- start start 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.413+0000 7f9362cfce00 1 Processor -- start 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.413+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad134336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.413+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 0x55ad13433be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.413+0000 7f9362cfce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad1349d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.413+0000 7f9362cfce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc00e530 con 0x55ad1340f5e0 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.413+0000 7f9362cfce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc00f9a0 con 0x55ad134140d0 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.413+0000 7f9362cfce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc00ec00 con 0x55ad1340ff90 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935e56c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad134336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935ed6d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad1349d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935ed6d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad1349d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48944/0 (socket says 10.20.193.28:48944) 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935ed6d640 1 -- 10.20.193.28:0/3976960122 learned_addr learned my addr 10.20.193.28:0/3976960122 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935e56c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad134336a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47122/0 (socket says 10.20.193.28:47122) 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935dd6b640 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 0x55ad13433be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935ed6d640 1 -- 10.20.193.28:0/3976960122 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 msgr2=0x55ad13433be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935ed6d640 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 0x55ad13433be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935ed6d640 1 -- 10.20.193.28:0/3976960122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 msgr2=0x55ad134336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935ed6d640 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad134336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935ed6d640 1 -- 10.20.193.28:0/3976960122 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad13041870 con 0x55ad134140d0 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f935ed6d640 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad1349d010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93500158c0 tx=0x7f9350009ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81f8da03e9b907c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.414+0000 7f930bfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.415+0000 7f930bfff640 1 -- 10.20.193.28:0/3976960122 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350013cd0 con 0x55ad134140d0 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.415+0000 7f930bfff640 1 -- 10.20.193.28:0/3976960122 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f93500136a0 con 0x55ad134140d0 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.415+0000 7f930bfff640 1 -- 10.20.193.28:0/3976960122 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350034470 con 0x55ad134140d0 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.415+0000 7f9362cfce00 1 -- 10.20.193.28:0/3976960122 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad133023f0 con 0x55ad134140d0 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.415+0000 7f930bfff640 1 -- 10.20.193.28:0/3976960122 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f9350034610 con 0x55ad134140d0 2026-02-20T03:16:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.415+0000 7f930bfff640 10 client.25691 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:16:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.416+0000 7f9362cfce00 10 client.25691 _ll_register_callbacks cb 0x7f9354009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.416+0000 7f9362cfce00 1 -- 10.20.193.28:0/3976960122 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9350013e70 con 0x55ad134140d0 2026-02-20T03:16:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f930bfff640 1 -- 10.20.193.28:0/3976960122 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f935003f480 con 0x55ad134140d0 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f9362cfce00 10 client.25691 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f9362cfce00 1 -- 10.20.193.28:0/3976960122 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55ad13422360 con 0x55ad134140d0 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f930bfff640 1 -- 10.20.193.28:0/3976960122 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f935003f680 con 0x55ad134140d0 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f9362cfce00 10 client.25691 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f9362cfce00 10 client.25691 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f9362cfce00 20 client.25691 populate_metadata read hostname 'trial028' 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f9362cfce00 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ad134a4860 0x55ad134a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f9362cfce00 4 client.25691 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.417+0000 7f9362cfce00 1 -- 10.20.193.28:0/3976960122 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9350013e70 con 0x55ad134a4860 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.418+0000 7f935e56c640 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ad134a4860 0x55ad134a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.418+0000 7f935e56c640 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ad134a4860 0x55ad134a6cf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=baa0c2bcb621ce42 server_cookie=2ed8101a1ab2a8dd in_seq=0 out_seq=0 2026-02-20T03:16:46.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.418+0000 7f930bfff640 10 client.25691 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.418+0000 7f930bfff640 1 -- 10.20.193.28:0/3976960122 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9350013e70 con 0x55ad134a4860 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.418+0000 7f930bfff640 10 client.25691 handle_command_reply: tid=0 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.418+0000 7f9362cfce00 1 client.25691 shutdown 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.418+0000 7f9362cfce00 1 -- 10.20.193.28:0/3976960122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 msgr2=0x55ad1349d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.418+0000 7f9362cfce00 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad1349d010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f93500158c0 tx=0x7f9350009ce0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f9362cfce00 1 -- 10.20.193.28:0/3976960122 shutdown_connections 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f9362cfce00 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ad134a4860 0x55ad134a6cf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f9362cfce00 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad134140d0 0x55ad1349d010 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f9362cfce00 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad1340ff90 0x55ad13433be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f9362cfce00 1 --2- 10.20.193.28:0/3976960122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad1340f5e0 0x55ad134336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f9362cfce00 1 -- 10.20.193.28:0/3976960122 >> 10.20.193.28:0/3976960122 conn(0x55ad133d2240 msgr2=0x55ad13412e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f930bfff640 0 client.25691 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:16:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f9362cfce00 1 -- 10.20.193.28:0/3976960122 shutdown_connections 2026-02-20T03:16:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f9362cfce00 1 -- 10.20.193.28:0/3976960122 wait complete. 2026-02-20T03:16:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f9362cfce00 20 client.25691 trim_cache size 0 max 16384 2026-02-20T03:16:46.426 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:16:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f93607f7640 1 -- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93340b1090 msgr2=0x7f93340b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f93607f7640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93340b1090 0x7f93340b3550 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f935001b000 tx=0x7f9350019000 comp rx=0 tx=0).stop 2026-02-20T03:16:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f93607f7640 1 -- 10.20.193.28:0/1415195670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810a470 msgr2=0x7f93581aa210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.419+0000 7f93607f7640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810a470 0x7f93581aa210 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f935400ea10 tx=0x7f935400eee0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.420+0000 7f93607f7640 1 -- 10.20.193.28:0/1415195670 shutdown_connections 2026-02-20T03:16:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.420+0000 7f93607f7640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93340b1090 0x7f93340b3550 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.420+0000 7f93607f7640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f935811c780 0x7f93581aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.420+0000 7f93607f7640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f935810a850 0x7f93581aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.420+0000 7f93607f7640 1 --2- 10.20.193.28:0/1415195670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f935810a470 0x7f93581aa210 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.420+0000 7f93607f7640 1 -- 10.20.193.28:0/1415195670 >> 10.20.193.28:0/1415195670 conn(0x7f935806ec00 msgr2=0x7f935811ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.420+0000 7f93607f7640 1 -- 10.20.193.28:0/1415195670 shutdown_connections 2026-02-20T03:16:46.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.420+0000 7f93607f7640 1 -- 10.20.193.28:0/1415195670 wait complete. 2026-02-20T03:16:46.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 96558 28.30 MB/sec warmup 19 sec latency 7.086 ms 2026-02-20T03:16:46.523 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:16:46.788 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:46.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.975+0000 7fa647577640 1 -- 10.20.193.28:0/3189107834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa64810eef0 msgr2=0x7fa64810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.975+0000 7fa647577640 1 --2- 10.20.193.28:0/3189107834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa64810eef0 0x7fa64810f2d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009a30 tx=0x7fa63c02f220 comp rx=0 tx=0).stop 2026-02-20T03:16:46.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.975+0000 7fa647577640 1 -- 10.20.193.28:0/3189107834 shutdown_connections 2026-02-20T03:16:46.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.975+0000 7fa647577640 1 --2- 10.20.193.28:0/3189107834 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa648109ba0 0x7fa648115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.975+0000 7fa647577640 1 --2- 10.20.193.28:0/3189107834 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa648109220 0x7fa648109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.975+0000 7fa647577640 1 --2- 10.20.193.28:0/3189107834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa64810eef0 0x7fa64810f2d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.975+0000 7fa647577640 1 -- 10.20.193.28:0/3189107834 >> 10.20.193.28:0/3189107834 conn(0x7fa648078600 msgr2=0x7fa64807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:46.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.975+0000 7fa647577640 1 -- 10.20.193.28:0/3189107834 shutdown_connections 2026-02-20T03:16:46.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.975+0000 7fa647577640 1 -- 10.20.193.28:0/3189107834 wait complete. 2026-02-20T03:16:46.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.976+0000 7fa647577640 1 Processor -- start 2026-02-20T03:16:46.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.976+0000 7fa647577640 1 -- start start 2026-02-20T03:16:46.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa647577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa648109220 0x7fa6481a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa647577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa648109ba0 0x7fa6481a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa647577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa64810eef0 0x7fa6481a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa647577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa6481190b0 con 0x7fa64810eef0 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa647577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa648118f30 con 0x7fa648109ba0 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa647577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa648119230 con 0x7fa648109220 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa646575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa648109220 0x7fa6481a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa645d74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa648109ba0 0x7fa6481a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa645d74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa648109ba0 0x7fa6481a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48964/0 (socket says 10.20.193.28:48964) 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa645d74640 1 -- 10.20.193.28:0/3003508858 learned_addr learned my addr 10.20.193.28:0/3003508858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa646d76640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa64810eef0 0x7fa6481a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa645d74640 1 -- 10.20.193.28:0/3003508858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa648109220 msgr2=0x7fa6481a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa645d74640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa648109220 0x7fa6481a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa645d74640 1 -- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa64810eef0 msgr2=0x7fa6481a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa645d74640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa64810eef0 0x7fa6481a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa645d74640 1 -- 10.20.193.28:0/3003508858 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6481a65c0 con 0x7fa648109ba0 2026-02-20T03:16:46.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.977+0000 7fa646d76640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa64810eef0 0x7fa6481a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:46.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.978+0000 7fa645d74640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa648109ba0 0x7fa6481a1ab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa63000d950 tx=0x7fa63000de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.978+0000 7fa62f7fe640 1 -- 10.20.193.28:0/3003508858 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630014070 con 0x7fa648109ba0 2026-02-20T03:16:46.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.978+0000 7fa62f7fe640 1 -- 10.20.193.28:0/3003508858 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa6300044e0 con 0x7fa648109ba0 2026-02-20T03:16:46.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.978+0000 7fa62f7fe640 1 -- 10.20.193.28:0/3003508858 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa630010460 con 0x7fa648109ba0 2026-02-20T03:16:46.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.978+0000 7fa647577640 1 -- 10.20.193.28:0/3003508858 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6481a68b0 con 0x7fa648109ba0 2026-02-20T03:16:46.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.978+0000 7fa647577640 1 -- 10.20.193.28:0/3003508858 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6481ae0f0 con 0x7fa648109ba0 2026-02-20T03:16:46.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.981+0000 7fa64ef80e00 1 Processor -- start 2026-02-20T03:16:46.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.981+0000 7fa62f7fe640 1 -- 10.20.193.28:0/3003508858 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa6300026e0 con 0x7fa648109ba0 2026-02-20T03:16:46.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.981+0000 7fa64ef80e00 1 -- start start 2026-02-20T03:16:46.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.981+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad48fb0 0x55d46ad49390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.981+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad43a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.981+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad43f60 0x55d46ad4fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.981+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d46acc3e00 con 0x55d46ad48fb0 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.981+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d46ac96970 con 0x55d46ad43f60 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.981+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d46ac441f0 con 0x55d46ad435e0 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad43a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa645d74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad43f60 0x55d46ad4fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad48fb0 0x55d46ad49390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad48fb0 0x55d46ad49390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47154/0 (socket says 10.20.193.28:47154) 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646d76640 1 -- 10.20.193.28:0/3623104241 learned_addr learned my addr 10.20.193.28:0/3623104241 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646d76640 1 -- 10.20.193.28:0/3623104241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 msgr2=0x55d46ad43a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646d76640 1 --2- 10.20.193.28:0/3623104241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad43a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646d76640 1 -- 10.20.193.28:0/3623104241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad43f60 msgr2=0x55d46ad4fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646d76640 1 --2- 10.20.193.28:0/3623104241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad43f60 0x55d46ad4fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646d76640 1 -- 10.20.193.28:0/3623104241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46ac573d0 con 0x55d46ad48fb0 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa645d74640 1 --2- 10.20.193.28:0/3623104241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad43f60 0x55d46ad4fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646575640 1 --2- 10.20.193.28:0/3623104241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad43a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.982+0000 7fa646d76640 1 --2- 10.20.193.28:0/3623104241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad48fb0 0x55d46ad49390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa638004200 tx=0x7fa638002c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4161f70b07bd53d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa62ccf3640 1 -- 10.20.193.28:0/3623104241 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6380092d0 con 0x55d46ad48fb0 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa62ccf3640 1 -- 10.20.193.28:0/3623104241 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa63801a070 con 0x55d46ad48fb0 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa62ccf3640 1 -- 10.20.193.28:0/3623104241 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa638007b20 con 0x55d46ad48fb0 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3623104241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad48fb0 msgr2=0x55d46ad49390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3623104241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad48fb0 0x55d46ad49390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa638004200 tx=0x7fa638002c60 comp rx=0 tx=0).stop 2026-02-20T03:16:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3623104241 shutdown_connections 2026-02-20T03:16:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3623104241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad43f60 0x55d46ad4fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3623104241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad43a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3623104241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad48fb0 0x55d46ad49390 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3623104241 >> 10.20.193.28:0/3623104241 conn(0x55d46ad06240 msgr2=0x55d46ad41ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3623104241 shutdown_connections 2026-02-20T03:16:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa62f7fe640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6200b0d80 0x7fa6200b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3623104241 wait complete. 2026-02-20T03:16:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.983+0000 7fa62f7fe640 1 -- 10.20.193.28:0/3003508858 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fa6300e0bc0 con 0x7fa648109ba0 2026-02-20T03:16:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.984+0000 7fa646575640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6200b0d80 0x7fa6200b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.985+0000 7fa646575640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6200b0d80 0x7fa6200b3240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009420 tx=0x7fa63c0093b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.985+0000 7fa64ef80e00 1 -- start start 2026-02-20T03:16:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.985+0000 7fa64ef80e00 1 Processor -- start 2026-02-20T03:16:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad5c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d46ac928a0 con 0x55d46ad435e0 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d46aa84f50 con 0x55d46ad48fb0 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d46ad5c9b0 con 0x55d46ad43f60 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47164/0 (socket says 10.20.193.28:47164) 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646575640 1 -- 10.20.193.28:0/3727134949 learned_addr learned my addr 10.20.193.28:0/3727134949 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa645d74640 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646d76640 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad5c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646575640 1 -- 10.20.193.28:0/3727134949 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad43f60 msgr2=0x55d46ad5e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646575640 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646575640 1 -- 10.20.193.28:0/3727134949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 msgr2=0x55d46ad5c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646575640 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad5c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646575640 1 -- 10.20.193.28:0/3727134949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46ad55a30 con 0x55d46ad435e0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa646575640 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009a30 tx=0x7fa63c02f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a20120fb6c06af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa5f7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.986+0000 7fa5f7fff640 1 -- 10.20.193.28:0/3727134949 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c053070 con 0x55d46ad435e0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa5f7fff640 1 -- 10.20.193.28:0/3727134949 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa63c033040 con 0x55d46ad435e0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa5f7fff640 1 -- 10.20.193.28:0/3727134949 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c04ebb0 con 0x55d46ad435e0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3727134949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d46aa67b40 con 0x55d46ad435e0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa64ef80e00 10 client.15648 _ll_register_callbacks cb 0x55d46accfeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3727134949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d46aca4150 con 0x55d46ad435e0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa5f7fff640 1 -- 10.20.193.28:0/3727134949 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fa63c04e400 con 0x55d46ad435e0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa5f7fff640 1 -- 10.20.193.28:0/3727134949 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa63c04e680 con 0x55d46ad435e0 2026-02-20T03:16:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa64ef80e00 10 client.15648 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3727134949 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55d46ac511e0 con 0x55d46ad435e0 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa5f7fff640 1 -- 10.20.193.28:0/3727134949 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fa63c060020 con 0x55d46ad435e0 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa64ef80e00 10 client.15648 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa64ef80e00 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa64ef80e00 20 client.15648 populate_metadata read hostname 'trial028' 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.987+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d46ad6c660 0x55d46ad6eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.988+0000 7fa64ef80e00 4 client.15648 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.988+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3727134949 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d46ac9e560 con 0x55d46ad6c660 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.988+0000 7fa645d74640 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d46ad6c660 0x55d46ad6eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.989+0000 7fa645d74640 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d46ad6c660 0x55d46ad6eb00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26eebbfbeb34f614 server_cookie=aa7be2ec2cf11848 in_seq=0 out_seq=0 2026-02-20T03:16:46.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.989+0000 7fa5f7fff640 10 client.15648 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.989+0000 7fa5f7fff640 1 -- 10.20.193.28:0/3727134949 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d46ac9e560 con 0x55d46ad6c660 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.989+0000 7fa5f7fff640 10 client.15648 handle_command_reply: tid=0 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.989+0000 7fa64ef80e00 1 client.15648 shutdown 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3727134949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad435e0 msgr2=0x55d46ad5dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009a30 tx=0x7fa63c02f220 comp rx=0 tx=0).stop 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3727134949 shutdown_connections 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d46ad6c660 0x55d46ad6eb00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad5c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/3727134949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3727134949 >> 10.20.193.28:0/3727134949 conn(0x55d46ad06240 msgr2=0x55d46ad423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa5f7fff640 0 client.15648 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:46.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3727134949 shutdown_connections 2026-02-20T03:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 1 -- 10.20.193.28:0/3727134949 wait complete. 2026-02-20T03:16:46.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.990+0000 7fa64ef80e00 20 client.15648 trim_cache size 0 max 16384 2026-02-20T03:16:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.996+0000 7fa64ef80e00 1 Processor -- start 2026-02-20T03:16:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.996+0000 7fa64ef80e00 1 -- start start 2026-02-20T03:16:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec0126f0 con 0x55d46ad43f60 2026-02-20T03:16:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec00ffc0 con 0x55d46ad48fb0 2026-02-20T03:16:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec00de10 con 0x55d46ad435e0 2026-02-20T03:16:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa645d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa646575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa645d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47178/0 (socket says 10.20.193.28:47178) 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa645d74640 1 -- 10.20.193.28:0/1533897062 learned_addr learned my addr 10.20.193.28:0/1533897062 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa646d76640 1 --2- 10.20.193.28:0/1533897062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa645d74640 1 -- 10.20.193.28:0/1533897062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 msgr2=0x55d46ad5dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa645d74640 1 --2- 10.20.193.28:0/1533897062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa645d74640 1 -- 10.20.193.28:0/1533897062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 msgr2=0x55d46ad598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa645d74640 1 --2- 10.20.193.28:0/1533897062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa645d74640 1 -- 10.20.193.28:0/1533897062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46ad55860 con 0x55d46ad43f60 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa645d74640 1 --2- 10.20.193.28:0/1533897062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa6300a88e0 tx=0x7fa6300af040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87397a76004a1e5c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.997+0000 7fa6124e6640 1 -- 10.20.193.28:0/1533897062 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63001e040 con 0x55d46ad43f60 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa6124e6640 1 -- 10.20.193.28:0/1533897062 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d46ac9e560 con 0x55d46ad43f60 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa6124e6640 1 -- 10.20.193.28:0/1533897062 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63001e040 con 0x55d46ad43f60 2026-02-20T03:16:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa64ef80e00 1 -- 10.20.193.28:0/1533897062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 msgr2=0x55d46ad5e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/1533897062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa6300a88e0 tx=0x7fa6300af040 comp rx=0 tx=0).stop 2026-02-20T03:16:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa64ef80e00 1 -- 10.20.193.28:0/1533897062 shutdown_connections 2026-02-20T03:16:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/1533897062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/1533897062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad5e520 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/1533897062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad5dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa64ef80e00 1 -- 10.20.193.28:0/1533897062 >> 10.20.193.28:0/1533897062 conn(0x55d46ad06240 msgr2=0x55d46ad5acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa64ef80e00 1 -- 10.20.193.28:0/1533897062 shutdown_connections 2026-02-20T03:16:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.998+0000 7fa64ef80e00 1 -- 10.20.193.28:0/1533897062 wait complete. 2026-02-20T03:16:47.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.999+0000 7fa64ef80e00 1 -- start start 2026-02-20T03:16:47.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.999+0000 7fa64ef80e00 1 Processor -- start 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.999+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.999+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad64720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.999+0000 7fa64ef80e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad60e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.999+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec00e480 con 0x55d46ad43f60 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.999+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec00f8f0 con 0x55d46ad48fb0 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:46.999+0000 7fa64ef80e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ec00eb50 con 0x55d46ad435e0 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa646575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa645d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad64720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa646575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad641e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:41474/0 (socket says 10.20.193.28:41474) 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa646575640 1 -- 10.20.193.28:0/505333435 learned_addr learned my addr 10.20.193.28:0/505333435 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa646d76640 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad60e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa645d74640 1 -- 10.20.193.28:0/505333435 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 msgr2=0x55d46ad641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa645d74640 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa645d74640 1 -- 10.20.193.28:0/505333435 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 msgr2=0x55d46ad60e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa645d74640 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad60e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa645d74640 1 -- 10.20.193.28:0/505333435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d46a975870 con 0x55d46ad43f60 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa646575640 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa645d74640 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad64720 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6300a88e0 tx=0x7fa6300e4270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da7f68905b5beac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa5f7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa5f7fff640 1 -- 10.20.193.28:0/505333435 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6300a4990 con 0x55d46ad43f60 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa5f7fff640 1 -- 10.20.193.28:0/505333435 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa6300a9bd0 con 0x55d46ad43f60 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa5f7fff640 1 -- 10.20.193.28:0/505333435 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6300a7630 con 0x55d46ad43f60 2026-02-20T03:16:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.000+0000 7fa64ef80e00 1 -- 10.20.193.28:0/505333435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d46ac363f0 con 0x55d46ad43f60 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa5f7fff640 1 -- 10.20.193.28:0/505333435 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fa6300b1040 con 0x55d46ad43f60 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa5f7fff640 10 client.15654 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 10 client.15654 _ll_register_callbacks cb 0x7fa63c005e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 1 -- 10.20.193.28:0/505333435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa63801a070 con 0x55d46ad43f60 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa5f7fff640 1 -- 10.20.193.28:0/505333435 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa6300a43e0 con 0x55d46ad43f60 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 10 client.15654 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 1 -- 10.20.193.28:0/505333435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55d46ad56550 con 0x55d46ad43f60 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa5f7fff640 1 -- 10.20.193.28:0/505333435 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fa6300b1260 con 0x55d46ad43f60 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 10 client.15654 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 20 client.15654 populate_metadata read hostname 'trial028' 2026-02-20T03:16:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d46add80e0 0x55d46adda5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 4 client.15654 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.001+0000 7fa64ef80e00 1 -- 10.20.193.28:0/505333435 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d46ac677c0 con 0x55d46add80e0 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.002+0000 7fa646575640 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d46add80e0 0x55d46adda5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.002+0000 7fa646575640 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d46add80e0 0x55d46adda5a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1eab622e90c8cfb3 server_cookie=b9de2af56a36d74f in_seq=0 out_seq=0 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.002+0000 7fa5f7fff640 10 client.15654 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.002+0000 7fa5f7fff640 1 -- 10.20.193.28:0/505333435 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d46ac677c0 con 0x55d46add80e0 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.002+0000 7fa5f7fff640 10 client.15654 handle_command_reply: tid=0 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.002+0000 7fa64ef80e00 1 client.15654 shutdown 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.002+0000 7fa64ef80e00 1 -- 10.20.193.28:0/505333435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 msgr2=0x55d46ad64720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.002+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad64720 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6300a88e0 tx=0x7fa6300e4270 comp rx=0 tx=0).stop 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa64ef80e00 1 -- 10.20.193.28:0/505333435 shutdown_connections 2026-02-20T03:16:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d46add80e0 0x55d46adda5a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d46ad48fb0 0x55d46ad60e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d46ad43f60 0x55d46ad64720 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa64ef80e00 1 --2- 10.20.193.28:0/505333435 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d46ad435e0 0x55d46ad641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa5f7fff640 0 client.15654 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:47.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa64ef80e00 1 -- 10.20.193.28:0/505333435 >> 10.20.193.28:0/505333435 conn(0x55d46ad06240 msgr2=0x55d46ad5dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:47.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa64ef80e00 1 -- 10.20.193.28:0/505333435 shutdown_connections 2026-02-20T03:16:47.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa64ef80e00 1 -- 10.20.193.28:0/505333435 wait complete. 2026-02-20T03:16:47.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa64ef80e00 20 client.15654 trim_cache size 0 max 16384 2026-02-20T03:16:47.011 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:16:47.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 -- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6200b0d80 msgr2=0x7fa6200b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6200b0d80 0x7fa6200b3240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009420 tx=0x7fa63c0093b0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 -- 10.20.193.28:0/3003508858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa648109ba0 msgr2=0x7fa6481a1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa648109ba0 0x7fa6481a1ab0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa63000d950 tx=0x7fa63000de20 comp rx=0 tx=0).stop 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 -- 10.20.193.28:0/3003508858 shutdown_connections 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6200b0d80 0x7fa6200b3240 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa64810eef0 0x7fa6481a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa648109ba0 0x7fa6481a1ab0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 --2- 10.20.193.28:0/3003508858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa648109220 0x7fa6481a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 -- 10.20.193.28:0/3003508858 >> 10.20.193.28:0/3003508858 conn(0x7fa648078600 msgr2=0x7fa648079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.003+0000 7fa647577640 1 -- 10.20.193.28:0/3003508858 shutdown_connections 2026-02-20T03:16:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:47.004+0000 7fa647577640 1 -- 10.20.193.28:0/3003508858 wait complete. 2026-02-20T03:16:47.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 101942 28.22 MB/sec warmup 20 sec latency 7.494 ms 2026-02-20T03:16:47.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:47 trial126 ceph-mon[38476]: pgmap v243: 129 pgs: 129 active+clean; 23 MiB data, 505 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 686 op/s 2026-02-20T03:16:47.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:47 trial028 ceph-mon[38552]: pgmap v243: 129 pgs: 129 active+clean; 23 MiB data, 505 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 686 op/s 2026-02-20T03:16:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:47 trial177 ceph-mon[43181]: pgmap v243: 129 pgs: 129 active+clean; 23 MiB data, 505 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 686 op/s 2026-02-20T03:16:48.142 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:16:48.143 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:16:48.405 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:48.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 106603 28.26 MB/sec warmup 21 sec latency 8.049 ms 2026-02-20T03:16:48.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.588+0000 7f4b92394640 1 -- 10.20.193.28:0/364165570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c105750 msgr2=0x7f4b8c1097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:48.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.588+0000 7f4b92394640 1 --2- 10.20.193.28:0/364165570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c105750 0x7f4b8c1097a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009a30 tx=0x7f4b7c02f260 comp rx=0 tx=0).stop 2026-02-20T03:16:48.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.588+0000 7f4b92394640 1 -- 10.20.193.28:0/364165570 shutdown_connections 2026-02-20T03:16:48.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.588+0000 7f4b92394640 1 --2- 10.20.193.28:0/364165570 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b8c109ed0 0x7f4b8c111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.588+0000 7f4b92394640 1 --2- 10.20.193.28:0/364165570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c105750 0x7f4b8c1097a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.588+0000 7f4b92394640 1 --2- 10.20.193.28:0/364165570 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b8c104da0 0x7f4b8c105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.588+0000 7f4b92394640 1 -- 10.20.193.28:0/364165570 >> 10.20.193.28:0/364165570 conn(0x7f4b8c100840 msgr2=0x7f4b8c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:48.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.588+0000 7f4b92394640 1 -- 10.20.193.28:0/364165570 shutdown_connections 2026-02-20T03:16:48.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.588+0000 7f4b92394640 1 -- 10.20.193.28:0/364165570 wait complete. 2026-02-20T03:16:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.589+0000 7f4b92394640 1 Processor -- start 2026-02-20T03:16:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.589+0000 7f4b92394640 1 -- start start 2026-02-20T03:16:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.589+0000 7f4b92394640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c104da0 0x7f4b8c19d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.589+0000 7f4b92394640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b8c105750 0x7f4b8c19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.589+0000 7f4b92394640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b8c109ed0 0x7f4b8c1a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.589+0000 7f4b92394640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c114d50 con 0x7f4b8c104da0 2026-02-20T03:16:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c104da0 0x7f4b8c19d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b92394640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c114bd0 con 0x7f4b8c105750 2026-02-20T03:16:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b92394640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c114ed0 con 0x7f4b8c109ed0 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c104da0 0x7f4b8c19d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47202/0 (socket says 10.20.193.28:47202) 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8bfff640 1 -- 10.20.193.28:0/1112628663 learned_addr learned my addr 10.20.193.28:0/1112628663 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b8c105750 0x7f4b8c19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8bfff640 1 -- 10.20.193.28:0/1112628663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b8c109ed0 msgr2=0x7f4b8c1a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8bfff640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b8c109ed0 0x7f4b8c1a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8bfff640 1 -- 10.20.193.28:0/1112628663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b8c105750 msgr2=0x7f4b8c19d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8bfff640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b8c105750 0x7f4b8c19d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8bfff640 1 -- 10.20.193.28:0/1112628663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c1a2260 con 0x7f4b8c104da0 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b8bfff640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c104da0 0x7f4b8c19d210 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800ea30 tx=0x7f4b7800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b897fa640 1 -- 10.20.193.28:0/1112628663 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800ce50 con 0x7f4b8c104da0 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b92394640 1 -- 10.20.193.28:0/1112628663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8c1a2550 con 0x7f4b8c104da0 2026-02-20T03:16:48.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.590+0000 7f4b92394640 1 -- 10.20.193.28:0/1112628663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8c1a9d90 con 0x7f4b8c104da0 2026-02-20T03:16:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.591+0000 7f4b897fa640 1 -- 10.20.193.28:0/1112628663 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4b78004570 con 0x7f4b8c104da0 2026-02-20T03:16:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.591+0000 7f4b897fa640 1 -- 10.20.193.28:0/1112628663 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800ce50 con 0x7f4b8c104da0 2026-02-20T03:16:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.593+0000 7f4b897fa640 1 -- 10.20.193.28:0/1112628663 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4b78010430 con 0x7f4b8c104da0 2026-02-20T03:16:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.593+0000 7f4b94899e00 1 Processor -- start 2026-02-20T03:16:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b94899e00 1 -- start start 2026-02-20T03:16:48.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cc2630 0x5608a6cc2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbdee0 0x5608a6cbe360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b94899e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5608a6c10c00 con 0x5608a6cbdee0 2026-02-20T03:16:48.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b94899e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5608a6bbe3c0 con 0x5608a6cc2630 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b94899e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5608a6c0cb30 con 0x5608a6cbe8a0 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b9090a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cc2630 0x5608a6cc2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b9090a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cc2630 0x5608a6cc2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49024/0 (socket says 10.20.193.28:49024) 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b9090a640 1 -- 10.20.193.28:0/235356759 learned_addr learned my addr 10.20.193.28:0/235356759 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b8bfff640 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbdee0 0x5608a6cbe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.594+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b9090a640 1 -- 10.20.193.28:0/235356759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 msgr2=0x5608a6cca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b9090a640 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b9090a640 1 -- 10.20.193.28:0/235356759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbdee0 msgr2=0x5608a6cbe360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b9090a640 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbdee0 0x5608a6cbe360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b9090a640 1 -- 10.20.193.28:0/235356759 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a6bb7840 con 0x5608a6cc2630 2026-02-20T03:16:48.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b8bfff640 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbdee0 0x5608a6cbe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b897fa640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b600b1020 0x7f4b600b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b897fa640 1 -- 10.20.193.28:0/1112628663 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f4b780e0d80 con 0x7f4b8c104da0 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b9090a640 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cc2630 0x5608a6cc2a10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000e3b0 tx=0x7f4b8000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae8dafb0f5df1c67 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b8bfff640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b600b1020 0x7f4b600b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b5cce3640 1 -- 10.20.193.28:0/235356759 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80019070 con 0x5608a6cc2630 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b5cce3640 1 -- 10.20.193.28:0/235356759 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4b800040d0 con 0x5608a6cc2630 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b5cce3640 1 -- 10.20.193.28:0/235356759 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80007760 con 0x5608a6cc2630 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b94899e00 1 -- 10.20.193.28:0/235356759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cc2630 msgr2=0x5608a6cc2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b94899e00 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cc2630 0x5608a6cc2a10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4b8000e3b0 tx=0x7f4b8000b040 comp rx=0 tx=0).stop 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b8bfff640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b600b1020 0x7f4b600b34e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4b780a98b0 tx=0x7f4b78002f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.595+0000 7f4b94899e00 1 -- 10.20.193.28:0/235356759 shutdown_connections 2026-02-20T03:16:48.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.596+0000 7f4b94899e00 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.596+0000 7f4b94899e00 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbdee0 0x5608a6cbe360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.596+0000 7f4b94899e00 1 --2- 10.20.193.28:0/235356759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cc2630 0x5608a6cc2a10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.596+0000 7f4b94899e00 1 -- 10.20.193.28:0/235356759 >> 10.20.193.28:0/235356759 conn(0x5608a6cb6aa0 msgr2=0x5608a6cbc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:48.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.596+0000 7f4b94899e00 1 -- 10.20.193.28:0/235356759 shutdown_connections 2026-02-20T03:16:48.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.596+0000 7f4b94899e00 1 -- 10.20.193.28:0/235356759 wait complete. 2026-02-20T03:16:48.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.597+0000 7f4b94899e00 1 -- start start 2026-02-20T03:16:48.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.597+0000 7f4b94899e00 1 Processor -- start 2026-02-20T03:16:48.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.597+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbdee0 0x5608a6ce8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.597+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.597+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6cf3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.597+0000 7f4b94899e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5608a6bb81a0 con 0x5608a6cc2630 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.597+0000 7f4b94899e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5608a6cdbfb0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.597+0000 7f4b94899e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5608a6cf41c0 con 0x5608a6cbdee0 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b8b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b8b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49036/0 (socket says 10.20.193.28:49036) 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/4063263697 learned_addr learned my addr 10.20.193.28:0/4063263697 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b9090a640 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbdee0 0x5608a6ce8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b9090a640 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6cf3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/4063263697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbdee0 msgr2=0x5608a6ce8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbdee0 0x5608a6ce8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/4063263697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 msgr2=0x5608a6cf3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6cf3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/4063263697 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a6ce1780 con 0x5608a6cbe8a0 2026-02-20T03:16:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b9090a640 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6cf3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce85a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c002410 tx=0x7f4b7c02ff60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec5d1711f5c0087 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.598+0000 7f4b4dffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b4dffb640 1 -- 10.20.193.28:0/4063263697 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c004280 con 0x5608a6cbe8a0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b4dffb640 1 -- 10.20.193.28:0/4063263697 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4b7c033040 con 0x5608a6cbe8a0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b4dffb640 1 -- 10.20.193.28:0/4063263697 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c038b90 con 0x5608a6cbe8a0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 1 -- 10.20.193.28:0/4063263697 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608a69dfb60 con 0x5608a6cbe8a0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b4dffb640 1 -- 10.20.193.28:0/4063263697 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f4b7c038d30 con 0x5608a6cbe8a0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 10 client.25715 _ll_register_callbacks cb 0x5608a6bbc0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 1 -- 10.20.193.28:0/4063263697 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5608a6c187f0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b4dffb640 1 -- 10.20.193.28:0/4063263697 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b7c004420 con 0x5608a6cbe8a0 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 10 client.25715 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 1 -- 10.20.193.28:0/4063263697 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5608a6bdd430 con 0x5608a6cbe8a0 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b4dffb640 1 -- 10.20.193.28:0/4063263697 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f4b7c0047c0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 10 client.25715 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 10 client.25715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 20 client.25715 populate_metadata read hostname 'trial028' 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608a6cf8030 0x5608a6cfa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 4 client.25715 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.599+0000 7f4b94899e00 1 -- 10.20.193.28:0/4063263697 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608a6b92c00 con 0x5608a6cf8030 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.600+0000 7f4b9090a640 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608a6cf8030 0x5608a6cfa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.600+0000 7f4b9090a640 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608a6cf8030 0x5608a6cfa4d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d2a3bbe8ac926ba server_cookie=e6fde651b2440722 in_seq=0 out_seq=0 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.600+0000 7f4b4dffb640 10 client.25715 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b4dffb640 1 -- 10.20.193.28:0/4063263697 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5608a6b92c00 con 0x5608a6cf8030 2026-02-20T03:16:48.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b4dffb640 10 client.25715 handle_command_reply: tid=0 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 client.25715 shutdown 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 -- 10.20.193.28:0/4063263697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbe8a0 msgr2=0x5608a6ce85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce85a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c002410 tx=0x7f4b7c02ff60 comp rx=0 tx=0).stop 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 -- 10.20.193.28:0/4063263697 shutdown_connections 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608a6cf8030 0x5608a6cfa4d0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6cf3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce85a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b4dffb640 0 client.25715 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 --2- 10.20.193.28:0/4063263697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbdee0 0x5608a6ce8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 -- 10.20.193.28:0/4063263697 >> 10.20.193.28:0/4063263697 conn(0x5608a6cb6aa0 msgr2=0x5608a6cb9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 -- 10.20.193.28:0/4063263697 shutdown_connections 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 1 -- 10.20.193.28:0/4063263697 wait complete. 2026-02-20T03:16:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.601+0000 7f4b94899e00 20 client.25715 trim_cache size 0 max 16384 2026-02-20T03:16:48.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b94899e00 1 Processor -- start 2026-02-20T03:16:48.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b94899e00 1 -- start start 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 0x5608a6cc1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cc2630 0x5608a6ce56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b94899e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4b30012670 con 0x5608a6cbe8a0 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b94899e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3000ff40 con 0x5608a6cbdee0 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b94899e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3000dd90 con 0x5608a6cc2630 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b8b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.610+0000 7f4b9090a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 0x5608a6cc1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b8b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47220/0 (socket says 10.20.193.28:47220) 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/1290609835 learned_addr learned my addr 10.20.193.28:0/1290609835 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b9090a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 0x5608a6cc1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49046/0 (socket says 10.20.193.28:49046) 2026-02-20T03:16:48.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b9090a640 1 --2- 10.20.193.28:0/1290609835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cc2630 0x5608a6ce56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/1290609835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cc2630 msgr2=0x5608a6ce56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:48.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/1290609835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cc2630 0x5608a6ce56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/1290609835 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 msgr2=0x5608a6cc1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:48.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/1290609835 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 0x5608a6cc1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/1290609835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a6ce15b0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/1290609835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce51a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c005ec0 tx=0x7f4b7c046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60911e7c2c8def24 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:48.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1290609835 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c004280 con 0x5608a6cbe8a0 2026-02-20T03:16:48.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1290609835 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4b7c033070 con 0x5608a6cbe8a0 2026-02-20T03:16:48.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b4ffff640 1 -- 10.20.193.28:0/1290609835 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0047c0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b94899e00 1 -- 10.20.193.28:0/1290609835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbe8a0 msgr2=0x5608a6ce51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:48.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b94899e00 1 --2- 10.20.193.28:0/1290609835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce51a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c005ec0 tx=0x7f4b7c046000 comp rx=0 tx=0).stop 2026-02-20T03:16:48.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b94899e00 1 -- 10.20.193.28:0/1290609835 shutdown_connections 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b94899e00 1 --2- 10.20.193.28:0/1290609835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cc2630 0x5608a6ce56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b94899e00 1 --2- 10.20.193.28:0/1290609835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cbe8a0 0x5608a6ce51a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b94899e00 1 --2- 10.20.193.28:0/1290609835 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 0x5608a6cc1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.611+0000 7f4b94899e00 1 -- 10.20.193.28:0/1290609835 >> 10.20.193.28:0/1290609835 conn(0x5608a6cb6aa0 msgr2=0x5608a6ce66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.612+0000 7f4b94899e00 1 -- 10.20.193.28:0/1290609835 shutdown_connections 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.612+0000 7f4b94899e00 1 -- 10.20.193.28:0/1290609835 wait complete. 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.612+0000 7f4b94899e00 1 -- start start 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.612+0000 7f4b94899e00 1 Processor -- start 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 0x5608a6cec360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b94899e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6d5cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b94899e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3000e400 con 0x5608a6cc2630 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b94899e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3000f870 con 0x5608a6cbdee0 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b94899e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3000ead0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b9090a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 0x5608a6cec360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b8b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b8b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cec8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:41520/0 (socket says 10.20.193.28:41520) 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/3537336035 learned_addr learned my addr 10.20.193.28:0/3537336035 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b9090a640 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6d5cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/3537336035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 msgr2=0x5608a6cec360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 0x5608a6cec360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/3537336035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 msgr2=0x5608a6d5cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6d5cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b8b7fe640 1 -- 10.20.193.28:0/3537336035 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608a68ef900 con 0x5608a6cbe8a0 2026-02-20T03:16:48.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b9090a640 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6d5cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b8b7fe640 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cec8a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c005e90 tx=0x7f4b7c0049f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71c57fa7736b59dd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.613+0000 7f4b4dffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.614+0000 7f4b4dffb640 1 -- 10.20.193.28:0/3537336035 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c057070 con 0x5608a6cbe8a0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.614+0000 7f4b94899e00 1 -- 10.20.193.28:0/3537336035 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608a6bcb4d0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.614+0000 7f4b94899e00 10 client.25708 _ll_register_callbacks cb 0x7f4b7c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.614+0000 7f4b94899e00 1 -- 10.20.193.28:0/3537336035 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b800040d0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.614+0000 7f4b4dffb640 1 -- 10.20.193.28:0/3537336035 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5608a6c187f0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.614+0000 7f4b4dffb640 1 -- 10.20.193.28:0/3537336035 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c002a90 con 0x5608a6cbe8a0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.614+0000 7f4b4dffb640 1 -- 10.20.193.28:0/3537336035 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f4b7c002c30 con 0x5608a6cbe8a0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b4dffb640 1 -- 10.20.193.28:0/3537336035 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b7c060060 con 0x5608a6cbe8a0 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b94899e00 10 client.25708 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b94899e00 1 -- 10.20.193.28:0/3537336035 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5608a6ce22a0 con 0x5608a6cbe8a0 2026-02-20T03:16:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b4dffb640 1 -- 10.20.193.28:0/3537336035 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f4b7c063050 con 0x5608a6cbe8a0 2026-02-20T03:16:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b94899e00 10 client.25708 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b94899e00 10 client.25708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b94899e00 20 client.25708 populate_metadata read hostname 'trial028' 2026-02-20T03:16:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b94899e00 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608a6cf8030 0x5608a6d66930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b94899e00 4 client.25708 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:16:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b94899e00 1 -- 10.20.193.28:0/3537336035 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5608a6cdfdb0 con 0x5608a6cf8030 2026-02-20T03:16:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.615+0000 7f4b9090a640 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608a6cf8030 0x5608a6d66930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:48.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b9090a640 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608a6cf8030 0x5608a6d66930 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=508db9a7cefd0fa server_cookie=5ab5976aa4fae993 in_seq=0 out_seq=0 2026-02-20T03:16:48.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b4dffb640 10 client.25708 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:48.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b4dffb640 1 -- 10.20.193.28:0/3537336035 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5608a6cdfdb0 con 0x5608a6cf8030 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b4dffb640 10 client.25708 handle_command_reply: tid=0 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 client.25708 shutdown 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 -- 10.20.193.28:0/3537336035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 msgr2=0x5608a6cec8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cec8a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c005e90 tx=0x7f4b7c0049f0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 -- 10.20.193.28:0/3537336035 shutdown_connections 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608a6cf8030 0x5608a6d66930 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608a6cc2630 0x5608a6d5cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608a6cbe8a0 0x5608a6cec8a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 --2- 10.20.193.28:0/3537336035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608a6cbdee0 0x5608a6cec360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 -- 10.20.193.28:0/3537336035 >> 10.20.193.28:0/3537336035 conn(0x5608a6cb6aa0 msgr2=0x5608a6cf8410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b4dffb640 0 client.25708 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:48.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.616+0000 7f4b94899e00 1 -- 10.20.193.28:0/3537336035 shutdown_connections 2026-02-20T03:16:48.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b94899e00 1 -- 10.20.193.28:0/3537336035 wait complete. 2026-02-20T03:16:48.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b94899e00 20 client.25708 trim_cache size 0 max 16384 2026-02-20T03:16:48.625 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:16:48.625 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:16:48.625 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "291620b6-99a3-4804-8443-04a0de66ec53", 2026-02-20T03:16:48.625 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:16:48.626 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:16:48.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 -- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b600b1020 msgr2=0x7f4b600b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:48.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b600b1020 0x7f4b600b34e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4b780a98b0 tx=0x7f4b78002f90 comp rx=0 tx=0).stop 2026-02-20T03:16:48.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 -- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c104da0 msgr2=0x7f4b8c19d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:48.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c104da0 0x7f4b8c19d210 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800ea30 tx=0x7f4b7800ef00 comp rx=0 tx=0).stop 2026-02-20T03:16:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 -- 10.20.193.28:0/1112628663 shutdown_connections 2026-02-20T03:16:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b600b1020 0x7f4b600b34e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b8c109ed0 0x7f4b8c1a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b8c105750 0x7f4b8c19d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 --2- 10.20.193.28:0/1112628663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b8c104da0 0x7f4b8c19d210 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.617+0000 7f4b92394640 1 -- 10.20.193.28:0/1112628663 >> 10.20.193.28:0/1112628663 conn(0x7f4b8c100840 msgr2=0x7f4b8c101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.618+0000 7f4b92394640 1 -- 10.20.193.28:0/1112628663 shutdown_connections 2026-02-20T03:16:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:48.618+0000 7f4b92394640 1 -- 10.20.193.28:0/1112628663 wait complete. 2026-02-20T03:16:48.721 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:16:48.994 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:16:49.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 -- 10.20.193.28:0/2758423641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41b010a980 msgr2=0x7f41b010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:49.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 --2- 10.20.193.28:0/2758423641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41b010a980 0x7f41b010ad60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009a60 tx=0x7f41a002f260 comp rx=0 tx=0).stop 2026-02-20T03:16:49.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 -- 10.20.193.28:0/2758423641 shutdown_connections 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 --2- 10.20.193.28:0/2758423641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f41b0105320 0x7f41b0111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 --2- 10.20.193.28:0/2758423641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f41b0104980 0x7f41b0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 --2- 10.20.193.28:0/2758423641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41b010a980 0x7f41b010ad60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 -- 10.20.193.28:0/2758423641 >> 10.20.193.28:0/2758423641 conn(0x7f41b0100680 msgr2=0x7f41b0102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 -- 10.20.193.28:0/2758423641 shutdown_connections 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 -- 10.20.193.28:0/2758423641 wait complete. 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 Processor -- start 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.171+0000 7f41b7316640 1 -- start start 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b7316640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f41b0104980 0x7f41b019d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b7316640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41b0105320 0x7f41b019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b7316640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f41b010a980 0x7f41b01a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b7316640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0114bf0 con 0x7f41b0105320 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b7316640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0114a70 con 0x7f41b0104980 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b7316640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f41b0114d70 con 0x7f41b010a980 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6314640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f41b0104980 0x7f41b019d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6314640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f41b0104980 0x7f41b019d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49066/0 (socket says 10.20.193.28:49066) 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6314640 1 -- 10.20.193.28:0/1447665629 learned_addr learned my addr 10.20.193.28:0/1447665629 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6b15640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f41b010a980 0x7f41b01a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6314640 1 -- 10.20.193.28:0/1447665629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f41b010a980 msgr2=0x7f41b01a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:49.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6314640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f41b010a980 0x7f41b01a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6314640 1 -- 10.20.193.28:0/1447665629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41b0105320 msgr2=0x7f41b019d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:49.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6314640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41b0105320 0x7f41b019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6314640 1 -- 10.20.193.28:0/1447665629 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b01a2110 con 0x7f41b0104980 2026-02-20T03:16:49.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.172+0000 7f41b6314640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f41b0104980 0x7f41b019d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41a00386a0 tx=0x7f41a0004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:49.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.173+0000 7f41977fe640 1 -- 10.20.193.28:0/1447665629 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0038770 con 0x7f41b0104980 2026-02-20T03:16:49.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.173+0000 7f41b7316640 1 -- 10.20.193.28:0/1447665629 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b01a23a0 con 0x7f41b0104980 2026-02-20T03:16:49.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.173+0000 7f41b7316640 1 -- 10.20.193.28:0/1447665629 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b01a9c40 con 0x7f41b0104980 2026-02-20T03:16:49.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.173+0000 7f41977fe640 1 -- 10.20.193.28:0/1447665629 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f41a0038db0 con 0x7f41b0104980 2026-02-20T03:16:49.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.173+0000 7f41977fe640 1 -- 10.20.193.28:0/1447665629 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0041b70 con 0x7f41b0104980 2026-02-20T03:16:49.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.175+0000 7f41977fe640 1 -- 10.20.193.28:0/1447665629 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f41a0042420 con 0x7f41b0104980 2026-02-20T03:16:49.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.176+0000 7f41baaa4e00 1 Processor -- start 2026-02-20T03:16:49.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41baaa4e00 1 -- start start 2026-02-20T03:16:49.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558758292a10 0x558758292df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55875828d040 0x55875828d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 0x558758299840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558758204e50 con 0x55875828d040 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41b6b15640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558758292a10 0x558758292df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5587581d79c0 con 0x55875828d9c0 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558758185240 con 0x558758292a10 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41b6b15640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558758292a10 0x558758292df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:41536/0 (socket says 10.20.193.28:41536) 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41b6b15640 1 -- 10.20.193.28:0/4193851652 learned_addr learned my addr 10.20.193.28:0/4193851652 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41977fe640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f418c0b0e20 0x7f418c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41b6314640 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55875828d040 0x55875828d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41977fe640 1 -- 10.20.193.28:0/1447665629 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f41a00389b0 con 0x7f41b0104980 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.177+0000 7f41b5b13640 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 0x558758299840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.178+0000 7f41b6b15640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f418c0b0e20 0x7f418c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.178+0000 7f41b6b15640 1 -- 10.20.193.28:0/4193851652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 msgr2=0x558758299840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.178+0000 7f41b6b15640 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 0x558758299840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.178+0000 7f41b6b15640 1 -- 10.20.193.28:0/4193851652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55875828d040 msgr2=0x55875828d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.178+0000 7f41b6b15640 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55875828d040 0x55875828d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.178+0000 7f41b6b15640 1 -- 10.20.193.28:0/4193851652 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558758198420 con 0x558758292a10 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.178+0000 7f41b6314640 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55875828d040 0x55875828d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.178+0000 7f41b6b15640 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558758292a10 0x558758292df0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41ac004520 tx=0x7f41ac0049f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a228bf29b9be4d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.179+0000 7f41b6b15640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f418c0b0e20 0x7f418c0b32e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009000 tx=0x7f41ac01c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.179+0000 7f4194cf3640 1 -- 10.20.193.28:0/4193851652 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac007910 con 0x558758292a10 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.179+0000 7f4194cf3640 1 -- 10.20.193.28:0/4193851652 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f41ac01e070 con 0x558758292a10 2026-02-20T03:16:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.179+0000 7f4194cf3640 1 -- 10.20.193.28:0/4193851652 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac01ace0 con 0x558758292a10 2026-02-20T03:16:49.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.179+0000 7f41baaa4e00 1 -- 10.20.193.28:0/4193851652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558758292a10 msgr2=0x558758292df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:49.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.179+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558758292a10 0x558758292df0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41ac004520 tx=0x7f41ac0049f0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.180+0000 7f41baaa4e00 1 -- 10.20.193.28:0/4193851652 shutdown_connections 2026-02-20T03:16:49.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.180+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 0x558758299840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.180+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55875828d040 0x55875828d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.180+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/4193851652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558758292a10 0x558758292df0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.180+0000 7f41baaa4e00 1 -- 10.20.193.28:0/4193851652 >> 10.20.193.28:0/4193851652 conn(0x558758247290 msgr2=0x558758282d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.180+0000 7f41baaa4e00 1 -- 10.20.193.28:0/4193851652 shutdown_connections 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.180+0000 7f41baaa4e00 1 -- 10.20.193.28:0/4193851652 wait complete. 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.181+0000 7f41baaa4e00 1 -- start start 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41baaa4e00 1 Processor -- start 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d040 0x5587582a79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 0x5587582a7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x5587582a6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5587581d38f0 con 0x558758292a10 2026-02-20T03:16:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558757fc5f50 con 0x55875828d9c0 2026-02-20T03:16:49.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5587582a6880 con 0x55875828d040 2026-02-20T03:16:49.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41b6314640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d040 0x5587582a79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41b6314640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d040 0x5587582a79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:41544/0 (socket says 10.20.193.28:41544) 2026-02-20T03:16:49.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.182+0000 7f41b6314640 1 -- 10.20.193.28:0/1557378932 learned_addr learned my addr 10.20.193.28:0/1557378932 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:49.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41b6314640 1 -- 10.20.193.28:0/1557378932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 msgr2=0x5587582a7f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:16:49.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41b5b13640 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 0x5587582a7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41b6314640 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 0x5587582a7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41b6314640 1 -- 10.20.193.28:0/1557378932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 msgr2=0x5587582a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41b6b15640 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x5587582a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41b6314640 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x5587582a6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41b6314640 1 -- 10.20.193.28:0/1557378932 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55875829f530 con 0x55875828d040 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41b6314640 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d040 0x5587582a79c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41a00cdea0 tx=0x7f41a00fbf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=212538cfa0d9189 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f4163fff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f4163fff640 1 -- 10.20.193.28:0/1557378932 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00ce610 con 0x55875828d040 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f4163fff640 1 -- 10.20.193.28:0/1557378932 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f41a0033070 con 0x55875828d040 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41baaa4e00 1 -- 10.20.193.28:0/1557378932 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558757fa8b40 con 0x55875828d040 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f4163fff640 1 -- 10.20.193.28:0/1557378932 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00b6320 con 0x55875828d040 2026-02-20T03:16:49.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41baaa4e00 10 client.25720 _ll_register_callbacks cb 0x558758210f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f41baaa4e00 1 -- 10.20.193.28:0/1557378932 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5587581e51a0 con 0x55875828d040 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.183+0000 7f4163fff640 1 -- 10.20.193.28:0/1557378932 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f41a00ce170 con 0x55875828d040 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f4163fff640 1 -- 10.20.193.28:0/1557378932 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f41a00d22c0 con 0x55875828d040 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f41baaa4e00 10 client.25720 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f41baaa4e00 1 -- 10.20.193.28:0/1557378932 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x558758192230 con 0x55875828d040 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f4163fff640 1 -- 10.20.193.28:0/1557378932 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f41a00d6ce0 con 0x55875828d040 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f41baaa4e00 10 client.25720 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f41baaa4e00 10 client.25720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f41baaa4e00 20 client.25720 populate_metadata read hostname 'trial028' 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5587582b61b0 0x5587582b8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f41baaa4e00 4 client.25720 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f41baaa4e00 1 -- 10.20.193.28:0/1557378932 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587581df5b0 con 0x5587582b61b0 2026-02-20T03:16:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.184+0000 7f41b5b13640 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5587582b61b0 0x5587582b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.185+0000 7f41b5b13640 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5587582b61b0 0x5587582b8670 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d466fe0919c773f6 server_cookie=7fa684581bdd5644 in_seq=0 out_seq=0 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.185+0000 7f4163fff640 10 client.25720 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.185+0000 7f4163fff640 1 -- 10.20.193.28:0/1557378932 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5587581df5b0 con 0x5587582b61b0 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.185+0000 7f4163fff640 10 client.25720 handle_command_reply: tid=0 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.185+0000 7f41baaa4e00 1 client.25720 shutdown 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.185+0000 7f41baaa4e00 1 -- 10.20.193.28:0/1557378932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d040 msgr2=0x5587582a79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.185+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d040 0x5587582a79c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f41a00cdea0 tx=0x7f41a00fbf20 comp rx=0 tx=0).stop 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.185+0000 7f41baaa4e00 1 -- 10.20.193.28:0/1557378932 shutdown_connections 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.185+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5587582b61b0 0x5587582b8670 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.186+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x5587582a6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.186+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d9c0 0x5587582a7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.186+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/1557378932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d040 0x5587582a79c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.186+0000 7f41baaa4e00 1 -- 10.20.193.28:0/1557378932 >> 10.20.193.28:0/1557378932 conn(0x558758247290 msgr2=0x558758283440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.186+0000 7f4163fff640 0 client.25720 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.186+0000 7f41baaa4e00 1 -- 10.20.193.28:0/1557378932 shutdown_connections 2026-02-20T03:16:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.186+0000 7f41baaa4e00 1 -- 10.20.193.28:0/1557378932 wait complete. 2026-02-20T03:16:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.186+0000 7f41baaa4e00 20 client.25720 trim_cache size 0 max 16384 2026-02-20T03:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.194+0000 7f41baaa4e00 1 Processor -- start 2026-02-20T03:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.194+0000 7f41baaa4e00 1 -- start start 2026-02-20T03:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.194+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.194+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 0x5587582b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.194+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x558758283520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.194+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4158012630 con 0x558758292a10 2026-02-20T03:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.194+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f415800ff00 con 0x55875828d040 2026-02-20T03:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.194+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f415800dd50 con 0x55875828d9c0 2026-02-20T03:16:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6314640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6314640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49090/0 (socket says 10.20.193.28:49090) 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6314640 1 -- 10.20.193.28:0/3064031349 learned_addr learned my addr 10.20.193.28:0/3064031349 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6b15640 1 --2- 10.20.193.28:0/3064031349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x558758283520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b5b13640 1 --2- 10.20.193.28:0/3064031349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 0x5587582b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6314640 1 -- 10.20.193.28:0/3064031349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 msgr2=0x5587582b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6314640 1 --2- 10.20.193.28:0/3064031349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 0x5587582b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6314640 1 -- 10.20.193.28:0/3064031349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 msgr2=0x558758283520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6314640 1 --2- 10.20.193.28:0/3064031349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x558758283520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6314640 1 -- 10.20.193.28:0/3064031349 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55875829f360 con 0x55875828d040 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41b6314640 1 --2- 10.20.193.28:0/3064031349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582b6cd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f41a00097a0 tx=0x5587582a7400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb1a64f5174d9c94 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f417e4e6640 1 -- 10.20.193.28:0/3064031349 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00cdce0 con 0x55875828d040 2026-02-20T03:16:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f417e4e6640 1 -- 10.20.193.28:0/3064031349 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f41a0033070 con 0x55875828d040 2026-02-20T03:16:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f417e4e6640 1 -- 10.20.193.28:0/3064031349 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00d71c0 con 0x55875828d040 2026-02-20T03:16:49.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41baaa4e00 1 -- 10.20.193.28:0/3064031349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 msgr2=0x5587582b6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:49.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.195+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/3064031349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582b6cd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f41a00097a0 tx=0x5587582a7400 comp rx=0 tx=0).stop 2026-02-20T03:16:49.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.196+0000 7f41baaa4e00 1 -- 10.20.193.28:0/3064031349 shutdown_connections 2026-02-20T03:16:49.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.196+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/3064031349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x558758283520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.196+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/3064031349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 0x5587582b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.196+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/3064031349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582b6cd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.196+0000 7f41baaa4e00 1 -- 10.20.193.28:0/3064031349 >> 10.20.193.28:0/3064031349 conn(0x558758247290 msgr2=0x5587582b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.196+0000 7f41baaa4e00 1 -- 10.20.193.28:0/3064031349 shutdown_connections 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.196+0000 7f41baaa4e00 1 -- 10.20.193.28:0/3064031349 wait complete. 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.196+0000 7f41baaa4e00 1 -- start start 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.196+0000 7f41baaa4e00 1 Processor -- start 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 0x5587582acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41baaa4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x5587582ad170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f415800e3c0 con 0x558758292a10 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f415800f830 con 0x55875828d040 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41baaa4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f415800ea90 con 0x55875828d9c0 2026-02-20T03:16:49.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b5b13640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 0x5587582acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6314640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6314640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582ac6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49098/0 (socket says 10.20.193.28:49098) 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6314640 1 -- 10.20.193.28:0/211211020 learned_addr learned my addr 10.20.193.28:0/211211020 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b5b13640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 0x5587582acc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:41566/0 (socket says 10.20.193.28:41566) 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6314640 1 -- 10.20.193.28:0/211211020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 msgr2=0x5587582acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6314640 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 0x5587582acc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6314640 1 -- 10.20.193.28:0/211211020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 msgr2=0x5587582ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6b15640 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x5587582ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6314640 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x5587582ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6314640 1 -- 10.20.193.28:0/211211020 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558757eb6870 con 0x55875828d040 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.197+0000 7f41b6b15640 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x5587582ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:16:49.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f41b6314640 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582ac6f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f41a00d2480 tx=0x7f41a0005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4f0fcb41efbeed2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f4163fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f4163fff640 1 -- 10.20.193.28:0/211211020 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00cdf10 con 0x55875828d040 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f4163fff640 1 -- 10.20.193.28:0/211211020 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5587581e51a0 con 0x55875828d040 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f4163fff640 1 -- 10.20.193.28:0/211211020 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00ce3b0 con 0x55875828d040 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f41baaa4e00 1 -- 10.20.193.28:0/211211020 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558758177440 con 0x55875828d040 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f4163fff640 1 -- 10.20.193.28:0/211211020 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f41a0035bd0 con 0x55875828d040 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f4163fff640 10 client.25736 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f41baaa4e00 10 client.25736 _ll_register_callbacks cb 0x7f41a0005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f41baaa4e00 1 -- 10.20.193.28:0/211211020 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5587581a8810 con 0x55875828d040 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f4163fff640 1 -- 10.20.193.28:0/211211020 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f41a0102ea0 con 0x55875828d040 2026-02-20T03:16:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f41baaa4e00 10 client.25736 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.198+0000 7f41baaa4e00 1 -- 10.20.193.28:0/211211020 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5587582a0050 con 0x55875828d040 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f4163fff640 1 -- 10.20.193.28:0/211211020 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f41a00ccf20 con 0x55875828d040 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f41baaa4e00 10 client.25736 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f41baaa4e00 10 client.25736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f41baaa4e00 20 client.25736 populate_metadata read hostname 'trial028' 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558758321e90 0x558758324350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f41baaa4e00 4 client.25736 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f41baaa4e00 1 -- 10.20.193.28:0/211211020 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558758189b00 con 0x558758321e90 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f41b5b13640 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558758321e90 0x558758324350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f41b5b13640 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558758321e90 0x558758324350 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa44e62199b2006 server_cookie=329464d80e80659e in_seq=0 out_seq=0 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.199+0000 7f4163fff640 10 client.25736 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f4163fff640 1 -- 10.20.193.28:0/211211020 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558758189b00 con 0x558758321e90 2026-02-20T03:16:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f4163fff640 10 client.25736 handle_command_reply: tid=0 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 client.25736 shutdown 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 -- 10.20.193.28:0/211211020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 msgr2=0x5587582ac6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582ac6f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f41a00d2480 tx=0x7f41a0005e50 comp rx=0 tx=0).stop 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 -- 10.20.193.28:0/211211020 shutdown_connections 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558758321e90 0x558758324350 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558758292a10 0x5587582ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55875828d9c0 0x5587582acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 --2- 10.20.193.28:0/211211020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55875828d040 0x5587582ac6f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f4163fff640 0 client.25736 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 -- 10.20.193.28:0/211211020 >> 10.20.193.28:0/211211020 conn(0x558758247290 msgr2=0x5587582b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 -- 10.20.193.28:0/211211020 shutdown_connections 2026-02-20T03:16:49.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 1 -- 10.20.193.28:0/211211020 wait complete. 2026-02-20T03:16:49.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.200+0000 7f41baaa4e00 20 client.25736 trim_cache size 0 max 16384 2026-02-20T03:16:49.209 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:16:49.209 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:16:49.209 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:16:49.209 INFO:teuthology.orchestra.run.trial028.stdout: "291620b6-99a3-4804-8443-04a0de66ec53": { 2026-02-20T03:16:49.209 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:16:49.209 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "291620b6-99a3-4804-8443-04a0de66ec53", 2026-02-20T03:16:49.210 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:16:49.210 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:49.210 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:16:49.210 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 -- 10.20.193.28:0/1447665629 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f418c0b0e20 msgr2=0x7f418c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f418c0b0e20 0x7f418c0b32e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009000 tx=0x7f41ac01c000 comp rx=0 tx=0).stop 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 -- 10.20.193.28:0/1447665629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f41b0104980 msgr2=0x7f41b019d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f41b0104980 0x7f41b019d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f41a00386a0 tx=0x7f41a0004300 comp rx=0 tx=0).stop 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 -- 10.20.193.28:0/1447665629 shutdown_connections 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f418c0b0e20 0x7f418c0b32e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f41b010a980 0x7f41b01a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f41b0105320 0x7f41b019d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 --2- 10.20.193.28:0/1447665629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f41b0104980 0x7f41b019d0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 -- 10.20.193.28:0/1447665629 >> 10.20.193.28:0/1447665629 conn(0x7f41b0100680 msgr2=0x7f41b0100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 -- 10.20.193.28:0/1447665629 shutdown_connections 2026-02-20T03:16:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:16:49.201+0000 7f41b7316640 1 -- 10.20.193.28:0/1447665629 wait complete. 2026-02-20T03:16:49.303 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:49 trial028 ceph-mon[38552]: pgmap v244: 129 pgs: 129 active+clean; 24 MiB data, 544 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 740 op/s 2026-02-20T03:16:49.303 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:49 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:16:49.303 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:49 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:49.306 INFO:tasks.cephfs.filesystem:scrub status for tag:291620b6-99a3-4804-8443-04a0de66ec53 - {'path': '/', 'tag': '291620b6-99a3-4804-8443-04a0de66ec53', 'options': 'recursive,force'} 2026-02-20T03:16:49.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 110424 27.90 MB/sec warmup 22 sec latency 12.500 ms 2026-02-20T03:16:49.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:49 trial126 ceph-mon[38476]: pgmap v244: 129 pgs: 129 active+clean; 24 MiB data, 544 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 740 op/s 2026-02-20T03:16:49.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:49 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:16:49.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:49 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:49 trial177 ceph-mon[43181]: pgmap v244: 129 pgs: 129 active+clean; 24 MiB data, 544 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 740 op/s 2026-02-20T03:16:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:49 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:16:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:49 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:50.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 114480 27.55 MB/sec warmup 23 sec latency 10.907 ms 2026-02-20T03:16:50.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:50 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:16:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:50 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:50 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:16:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:50 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:16:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:50 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:50.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:50 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:50 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:16:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:50 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:50 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:16:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:50 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:16:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:50 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:50 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:50.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:50 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:16:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:50 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:50 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:16:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:50 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:16:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:50 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:50 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:16:51.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 119468 27.46 MB/sec warmup 24 sec latency 6.680 ms 2026-02-20T03:16:51.502 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:51 trial028 ceph-mon[38552]: pgmap v245: 129 pgs: 129 active+clean; 26 MiB data, 544 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 691 op/s 2026-02-20T03:16:51.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:51 trial126 ceph-mon[38476]: pgmap v245: 129 pgs: 129 active+clean; 26 MiB data, 544 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 691 op/s 2026-02-20T03:16:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:51 trial177 ceph-mon[43181]: pgmap v245: 129 pgs: 129 active+clean; 26 MiB data, 544 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 691 op/s 2026-02-20T03:16:52.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 124183 27.55 MB/sec warmup 25 sec latency 8.809 ms 2026-02-20T03:16:53.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 128199 27.28 MB/sec warmup 26 sec latency 8.022 ms 2026-02-20T03:16:53.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:53 trial126 ceph-mon[38476]: pgmap v246: 129 pgs: 129 active+clean; 29 MiB data, 582 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 626 op/s 2026-02-20T03:16:53.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:53 trial028 ceph-mon[38552]: pgmap v246: 129 pgs: 129 active+clean; 29 MiB data, 582 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 626 op/s 2026-02-20T03:16:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:53 trial177 ceph-mon[43181]: pgmap v246: 129 pgs: 129 active+clean; 29 MiB data, 582 MiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 626 op/s 2026-02-20T03:16:54.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 132384 27.06 MB/sec warmup 27 sec latency 8.048 ms 2026-02-20T03:16:55.496 INFO:tasks.workunit.client.0.trial028.stdout: 1 137579 27.10 MB/sec warmup 28 sec latency 7.125 ms 2026-02-20T03:16:55.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:55 trial126 ceph-mon[38476]: pgmap v247: 129 pgs: 129 active+clean; 34 MiB data, 613 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 711 op/s 2026-02-20T03:16:55.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:55 trial028 ceph-mon[38552]: pgmap v247: 129 pgs: 129 active+clean; 34 MiB data, 613 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 711 op/s 2026-02-20T03:16:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:55 trial177 ceph-mon[43181]: pgmap v247: 129 pgs: 129 active+clean; 34 MiB data, 613 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 711 op/s 2026-02-20T03:16:56.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.361+0000 7f824dbe4640 1 -- 10.20.193.28:0/2062451156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248105b30 msgr2=0x7f8248105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:56.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.361+0000 7f824dbe4640 1 --2- 10.20.193.28:0/2062451156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248105b30 0x7f8248105fb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8230009a30 tx=0x7f823002f220 comp rx=0 tx=0).stop 2026-02-20T03:16:56.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.361+0000 7f824dbe4640 1 -- 10.20.193.28:0/2062451156 shutdown_connections 2026-02-20T03:16:56.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.361+0000 7f824dbe4640 1 --2- 10.20.193.28:0/2062451156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82481064f0 0x7f824810cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.361+0000 7f824dbe4640 1 --2- 10.20.193.28:0/2062451156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248105b30 0x7f8248105fb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.361+0000 7f824dbe4640 1 --2- 10.20.193.28:0/2062451156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8248104940 0x7f8248104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.361+0000 7f824dbe4640 1 -- 10.20.193.28:0/2062451156 >> 10.20.193.28:0/2062451156 conn(0x7f82481000c0 msgr2=0x7f82481024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:56.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.361+0000 7f824dbe4640 1 -- 10.20.193.28:0/2062451156 shutdown_connections 2026-02-20T03:16:56.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.361+0000 7f824dbe4640 1 -- 10.20.193.28:0/2062451156 wait complete. 2026-02-20T03:16:56.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.362+0000 7f824dbe4640 1 Processor -- start 2026-02-20T03:16:56.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.362+0000 7f824dbe4640 1 -- start start 2026-02-20T03:16:56.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.362+0000 7f824dbe4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248104940 0x7f824819ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.362+0000 7f824dbe4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8248105b30 0x7f824819cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.362+0000 7f824dbe4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82481064f0 0x7f82481a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.362+0000 7f824dbe4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8248110410 con 0x7f8248104940 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.362+0000 7f824dbe4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8248110290 con 0x7f82481064f0 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.362+0000 7f824dbe4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8248110590 con 0x7f8248105b30 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824cbe2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248104940 0x7f824819ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824cbe2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248104940 0x7f824819ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50964/0 (socket says 10.20.193.28:50964) 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824cbe2640 1 -- 10.20.193.28:0/3666327550 learned_addr learned my addr 10.20.193.28:0/3666327550 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f823ffff640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8248105b30 0x7f824819cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824d3e3640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82481064f0 0x7f82481a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824cbe2640 1 -- 10.20.193.28:0/3666327550 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8248105b30 msgr2=0x7f824819cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824cbe2640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8248105b30 0x7f824819cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.368 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824cbe2640 1 -- 10.20.193.28:0/3666327550 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82481064f0 msgr2=0x7f82481a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:56.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824cbe2640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82481064f0 0x7f82481a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824cbe2640 1 -- 10.20.193.28:0/3666327550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82481a4730 con 0x7f8248104940 2026-02-20T03:16:56.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824cbe2640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248104940 0x7f824819ca80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f82380059c0 tx=0x7f823800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:56.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f823dffb640 1 -- 10.20.193.28:0/3666327550 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238014070 con 0x7f8248104940 2026-02-20T03:16:56.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f823dffb640 1 -- 10.20.193.28:0/3666327550 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f82380044e0 con 0x7f8248104940 2026-02-20T03:16:56.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f823dffb640 1 -- 10.20.193.28:0/3666327550 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238010460 con 0x7f8248104940 2026-02-20T03:16:56.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824dbe4640 1 -- 10.20.193.28:0/3666327550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82481a4a20 con 0x7f8248104940 2026-02-20T03:16:56.369 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.363+0000 7f824dbe4640 1 -- 10.20.193.28:0/3666327550 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82481a4ef0 con 0x7f8248104940 2026-02-20T03:16:56.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f823dffb640 1 -- 10.20.193.28:0/3666327550 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f823800b840 con 0x7f8248104940 2026-02-20T03:16:56.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f8251cd1e00 1 Processor -- start 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f8251cd1e00 1 -- start start 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e4585ce80 0x557e4585d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e45861f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e45862560 0x557e458649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557e457ad8f0 con 0x557e45862560 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557e4575b2e0 con 0x557e4585ce80 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557e457a9820 con 0x557e4585d7c0 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f824d3e3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e4585ce80 0x557e4585d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f824cbe2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e45861f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f823ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e45862560 0x557e458649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f824d3e3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e4585ce80 0x557e4585d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:43740/0 (socket says 10.20.193.28:43740) 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f824d3e3640 1 -- 10.20.193.28:0/1576656969 learned_addr learned my addr 10.20.193.28:0/1576656969 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f824d3e3640 1 -- 10.20.193.28:0/1576656969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 msgr2=0x557e45861f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f824d3e3640 1 --2- 10.20.193.28:0/1576656969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e45861f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f824d3e3640 1 -- 10.20.193.28:0/1576656969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e45862560 msgr2=0x557e458649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f824d3e3640 1 --2- 10.20.193.28:0/1576656969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e45862560 0x557e458649f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.367+0000 7f824d3e3640 1 -- 10.20.193.28:0/1576656969 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4574d5a0 con 0x557e4585ce80 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f824d3e3640 1 --2- 10.20.193.28:0/1576656969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e4585ce80 0x557e4585d280 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8244009dc0 tx=0x7f8244009130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=226d1356446d3f78 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f823dffb640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82240b0e20 0x7f82240b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8214ffe640 1 -- 10.20.193.28:0/1576656969 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82440040d0 con 0x557e4585ce80 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8214ffe640 1 -- 10.20.193.28:0/1576656969 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8244004710 con 0x557e4585ce80 2026-02-20T03:16:56.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8214ffe640 1 -- 10.20.193.28:0/1576656969 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244015bb0 con 0x557e4585ce80 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f823dffb640 1 -- 10.20.193.28:0/3666327550 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f82380e0c50 con 0x7f8248104940 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f824cbe2640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82240b0e20 0x7f82240b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8251cd1e00 1 -- 10.20.193.28:0/1576656969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e4585ce80 msgr2=0x557e4585d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/1576656969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e4585ce80 0x557e4585d280 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8244009dc0 tx=0x7f8244009130 comp rx=0 tx=0).stop 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8251cd1e00 1 -- 10.20.193.28:0/1576656969 shutdown_connections 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/1576656969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e45862560 0x557e458649f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/1576656969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e45861f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/1576656969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e4585ce80 0x557e4585d280 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8251cd1e00 1 -- 10.20.193.28:0/1576656969 >> 10.20.193.28:0/1576656969 conn(0x557e458546f0 msgr2=0x557e4585b570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8251cd1e00 1 -- 10.20.193.28:0/1576656969 shutdown_connections 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f8251cd1e00 1 -- 10.20.193.28:0/1576656969 wait complete. 2026-02-20T03:16:56.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.368+0000 7f824cbe2640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82240b0e20 0x7f82240b32e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f82380a88c0 tx=0x7f82380e4690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:56.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.369+0000 7f8251cd1e00 1 -- start start 2026-02-20T03:16:56.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f8251cd1e00 1 Processor -- start 2026-02-20T03:16:56.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585ce80 0x557e458758d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585d7c0 0x557e45875e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4587cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557e457550c0 con 0x557e4585d7c0 2026-02-20T03:16:56.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557e45865660 con 0x557e45862560 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557e4587d320 con 0x557e4585ce80 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f824d3e3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585ce80 0x557e458758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f823ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585d7c0 0x557e45875e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f824d3e3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585ce80 0x557e458758d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47370/0 (socket says 10.20.193.28:47370) 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f824d3e3640 1 -- 10.20.193.28:0/562711162 learned_addr learned my addr 10.20.193.28:0/562711162 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f824d3e3640 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4587cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f823ffff640 1 -- 10.20.193.28:0/562711162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585ce80 msgr2=0x557e458758d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f823ffff640 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585ce80 0x557e458758d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f823ffff640 1 -- 10.20.193.28:0/562711162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 msgr2=0x557e4587cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f823ffff640 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4587cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.370+0000 7f823ffff640 1 -- 10.20.193.28:0/562711162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4586eff0 con 0x557e4585d7c0 2026-02-20T03:16:56.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f823ffff640 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585d7c0 0x557e45875e10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8230009a00 tx=0x7f8230002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d6e63b25f26e9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f820dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f820dffb640 1 -- 10.20.193.28:0/562711162 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230047070 con 0x557e4585d7c0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f8251cd1e00 1 -- 10.20.193.28:0/562711162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e45769820 con 0x557e4585d7c0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f8251cd1e00 10 client.15687 _ll_register_callbacks cb 0x557e45758ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f8251cd1e00 1 -- 10.20.193.28:0/562711162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557e457b54e0 con 0x557e4585d7c0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f820dffb640 1 -- 10.20.193.28:0/562711162 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x557e457b54e0 con 0x557e4585d7c0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f820dffb640 1 -- 10.20.193.28:0/562711162 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230038e10 con 0x557e4585d7c0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f820dffb640 1 -- 10.20.193.28:0/562711162 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f823004e8b0 con 0x557e4585d7c0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f820dffb640 1 -- 10.20.193.28:0/562711162 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f823004eb70 con 0x557e4585d7c0 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f8251cd1e00 10 client.15687 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:56.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f8251cd1e00 1 -- 10.20.193.28:0/562711162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x557e4576e380 con 0x557e4585d7c0 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f820dffb640 1 -- 10.20.193.28:0/562711162 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f823004ed10 con 0x557e4585d7c0 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f8251cd1e00 10 client.15687 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.371+0000 7f8251cd1e00 10 client.15687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.372+0000 7f8251cd1e00 20 client.15687 populate_metadata read hostname 'trial028' 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.372+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557e45881580 0x557e45883a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.372+0000 7f8251cd1e00 4 client.15687 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.372+0000 7f8251cd1e00 1 -- 10.20.193.28:0/562711162 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e4572fbd0 con 0x557e45881580 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.372+0000 7f824d3e3640 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557e45881580 0x557e45883a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.372+0000 7f824d3e3640 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557e45881580 0x557e45883a10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=620dffb381e67136 server_cookie=b0e22803dbdc5fc9 in_seq=0 out_seq=0 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.372+0000 7f820dffb640 10 client.15687 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f820dffb640 1 -- 10.20.193.28:0/562711162 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557e4572fbd0 con 0x557e45881580 2026-02-20T03:16:56.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f820dffb640 10 client.15687 handle_command_reply: tid=0 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 client.15687 shutdown 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 -- 10.20.193.28:0/562711162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585d7c0 msgr2=0x557e45875e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585d7c0 0x557e45875e10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8230009a00 tx=0x7f8230002910 comp rx=0 tx=0).stop 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 -- 10.20.193.28:0/562711162 shutdown_connections 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557e45881580 0x557e45883a10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4587cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f820dffb640 0 client.15687 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585d7c0 0x557e45875e10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/562711162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585ce80 0x557e458758d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 -- 10.20.193.28:0/562711162 >> 10.20.193.28:0/562711162 conn(0x557e458546f0 msgr2=0x557e45863910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:56.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 -- 10.20.193.28:0/562711162 shutdown_connections 2026-02-20T03:16:56.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 1 -- 10.20.193.28:0/562711162 wait complete. 2026-02-20T03:16:56.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.373+0000 7f8251cd1e00 20 client.15687 trim_cache size 0 max 16384 2026-02-20T03:16:56.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f8251cd1e00 1 Processor -- start 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f8251cd1e00 1 -- start start 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e45873ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e4587cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4585dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec0126f0 con 0x557e4585ce80 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec00ffc0 con 0x557e45862560 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec00de10 con 0x557e4585d7c0 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f823ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e4587cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f824d3e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e45873ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f823ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e4587cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47386/0 (socket says 10.20.193.28:47386) 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f823ffff640 1 -- 10.20.193.28:0/2908854428 learned_addr learned my addr 10.20.193.28:0/2908854428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.381+0000 7f824d3e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e45873ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50986/0 (socket says 10.20.193.28:50986) 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f824d3e3640 1 --2- 10.20.193.28:0/2908854428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4585dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f824d3e3640 1 -- 10.20.193.28:0/2908854428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 msgr2=0x557e4587cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f824d3e3640 1 --2- 10.20.193.28:0/2908854428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e4587cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f824d3e3640 1 -- 10.20.193.28:0/2908854428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 msgr2=0x557e4585dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f824d3e3640 1 --2- 10.20.193.28:0/2908854428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4585dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f824d3e3640 1 -- 10.20.193.28:0/2908854428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4586ee20 con 0x557e4585ce80 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f824d3e3640 1 --2- 10.20.193.28:0/2908854428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e45873ed0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x557e45874f80 tx=0x7f82440156f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d126083eef589 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f820ffff640 1 -- 10.20.193.28:0/2908854428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244004ae0 con 0x557e4585ce80 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f820ffff640 1 -- 10.20.193.28:0/2908854428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8244004c80 con 0x557e4585ce80 2026-02-20T03:16:56.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f820ffff640 1 -- 10.20.193.28:0/2908854428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244005270 con 0x557e4585ce80 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f8251cd1e00 1 -- 10.20.193.28:0/2908854428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 msgr2=0x557e45873ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/2908854428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e45873ed0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x557e45874f80 tx=0x7f82440156f0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f8251cd1e00 1 -- 10.20.193.28:0/2908854428 shutdown_connections 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/2908854428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4585dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/2908854428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e4587cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/2908854428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e45873ed0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f8251cd1e00 1 -- 10.20.193.28:0/2908854428 >> 10.20.193.28:0/2908854428 conn(0x557e458546f0 msgr2=0x557e4585b570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f8251cd1e00 1 -- 10.20.193.28:0/2908854428 shutdown_connections 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.382+0000 7f8251cd1e00 1 -- 10.20.193.28:0/2908854428 wait complete. 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.383+0000 7f8251cd1e00 1 -- start start 2026-02-20T03:16:56.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.383+0000 7f8251cd1e00 1 Processor -- start 2026-02-20T03:16:56.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.383+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e4587c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.383+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e4587cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.383+0000 7f8251cd1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4587ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.383+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec00e480 con 0x557e4585ce80 2026-02-20T03:16:56.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.383+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec00f8f0 con 0x557e45862560 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.383+0000 7f8251cd1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec00eb50 con 0x557e4585d7c0 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.383+0000 7f824d3e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e4587c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f824d3e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e4587c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51002/0 (socket says 10.20.193.28:51002) 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f824d3e3640 1 -- 10.20.193.28:0/3718015459 learned_addr learned my addr 10.20.193.28:0/3718015459 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f823ffff640 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e4587cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f824d3e3640 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4587ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f824d3e3640 1 -- 10.20.193.28:0/3718015459 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 msgr2=0x557e4587cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f824d3e3640 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e4587cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f824d3e3640 1 -- 10.20.193.28:0/3718015459 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 msgr2=0x557e4587ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f824d3e3640 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4587ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f824d3e3640 1 -- 10.20.193.28:0/3718015459 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4585bc80 con 0x557e4585ce80 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f824d3e3640 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e4587c5f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8244009dc0 tx=0x7f8244006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64844e44c27f1c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f820dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f820dffb640 1 -- 10.20.193.28:0/3718015459 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824403f070 con 0x557e4585ce80 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f820dffb640 1 -- 10.20.193.28:0/3718015459 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8244015c00 con 0x557e4585ce80 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f8251cd1e00 1 -- 10.20.193.28:0/3718015459 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4550d690 con 0x557e4585ce80 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f820dffb640 1 -- 10.20.193.28:0/3718015459 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824403ac40 con 0x557e4585ce80 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f8251cd1e00 10 client.15693 _ll_register_callbacks cb 0x7f8230009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f8251cd1e00 1 -- 10.20.193.28:0/3718015459 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8244004710 con 0x557e4585ce80 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f820dffb640 1 -- 10.20.193.28:0/3718015459 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f8244038450 con 0x557e4585ce80 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.384+0000 7f820dffb640 1 -- 10.20.193.28:0/3718015459 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8244038730 con 0x557e4585ce80 2026-02-20T03:16:56.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f8251cd1e00 10 client.15693 fetch_fsmap learned FSMap version 24 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f8251cd1e00 1 -- 10.20.193.28:0/3718015459 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x557e45772b70 con 0x557e4585ce80 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f820dffb640 1 -- 10.20.193.28:0/3718015459 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f82440156f0 con 0x557e4585ce80 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f8251cd1e00 10 client.15693 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f8251cd1e00 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f8251cd1e00 20 client.15693 populate_metadata read hostname 'trial028' 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557e458f5a80 0x557e458f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f8251cd1e00 4 client.15693 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f8251cd1e00 1 -- 10.20.193.28:0/3718015459 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e45586520 con 0x557e458f5a80 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.385+0000 7f823ffff640 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557e458f5a80 0x557e458f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.386+0000 7f823ffff640 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557e458f5a80 0x557e458f7f40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c209f5192f4ffbc0 server_cookie=45f8befd83a43c26 in_seq=0 out_seq=0 2026-02-20T03:16:56.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.386+0000 7f820dffb640 10 client.15693 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:56.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 141990 27.05 MB/sec warmup 29 sec latency 57.191 ms 2026-02-20T03:16:56.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.553+0000 7f820dffb640 1 -- 10.20.193.28:0/3718015459 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e45586520 con 0x557e458f5a80 2026-02-20T03:16:56.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.553+0000 7f820dffb640 10 client.15693 handle_command_reply: tid=0 2026-02-20T03:16:56.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.553+0000 7f8251cd1e00 1 client.15693 shutdown 2026-02-20T03:16:56.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.553+0000 7f8251cd1e00 1 -- 10.20.193.28:0/3718015459 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 msgr2=0x557e4587c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:56.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.553+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e4587c5f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8244009dc0 tx=0x7f8244006040 comp rx=0 tx=0).stop 2026-02-20T03:16:56.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f8251cd1e00 1 -- 10.20.193.28:0/3718015459 shutdown_connections 2026-02-20T03:16:56.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557e458f5a80 0x557e458f7f40 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557e45862560 0x557e4587ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557e4585d7c0 0x557e4587cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f8251cd1e00 1 --2- 10.20.193.28:0/3718015459 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557e4585ce80 0x557e4587c5f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f8251cd1e00 1 -- 10.20.193.28:0/3718015459 >> 10.20.193.28:0/3718015459 conn(0x557e458546f0 msgr2=0x557e45874fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:56.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f820dffb640 0 client.15693 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:16:56.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f8251cd1e00 1 -- 10.20.193.28:0/3718015459 shutdown_connections 2026-02-20T03:16:56.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f8251cd1e00 1 -- 10.20.193.28:0/3718015459 wait complete. 2026-02-20T03:16:56.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.554+0000 7f8251cd1e00 20 client.15693 trim_cache size 0 max 16384 2026-02-20T03:16:56.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:16:56.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:16:56.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:16:56.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 -- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82240b0e20 msgr2=0x7f82240b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82240b0e20 0x7f82240b32e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f82380a88c0 tx=0x7f82380e4690 comp rx=0 tx=0).stop 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 -- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248104940 msgr2=0x7f824819ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248104940 0x7f824819ca80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f82380059c0 tx=0x7f823800ddf0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 -- 10.20.193.28:0/3666327550 shutdown_connections 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82240b0e20 0x7f82240b32e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82481064f0 0x7f82481a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8248105b30 0x7f824819cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 --2- 10.20.193.28:0/3666327550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8248104940 0x7f824819ca80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:16:56.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 -- 10.20.193.28:0/3666327550 >> 10.20.193.28:0/3666327550 conn(0x7f82481000c0 msgr2=0x7f8248108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:16:56.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 -- 10.20.193.28:0/3666327550 shutdown_connections 2026-02-20T03:16:56.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:16:56.555+0000 7f824dbe4640 1 -- 10.20.193.28:0/3666327550 wait complete. 2026-02-20T03:16:57.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 145817 26.83 MB/sec warmup 30 sec latency 18.180 ms 2026-02-20T03:16:57.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:57 trial126 ceph-mon[38476]: pgmap v248: 129 pgs: 129 active+clean; 38 MiB data, 640 MiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 743 op/s 2026-02-20T03:16:57.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:57 trial028 ceph-mon[38552]: pgmap v248: 129 pgs: 129 active+clean; 38 MiB data, 640 MiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 743 op/s 2026-02-20T03:16:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:57 trial177 ceph-mon[43181]: pgmap v248: 129 pgs: 129 active+clean; 38 MiB data, 640 MiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 743 op/s 2026-02-20T03:16:58.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 149755 26.60 MB/sec warmup 31 sec latency 9.749 ms 2026-02-20T03:16:58.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:16:58.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:16:58.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:16:58.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:16:58.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:16:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:16:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:16:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:16:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:16:59.467 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:16:59 trial028 ceph-mon[38552]: pgmap v249: 129 pgs: 129 active+clean; 36 MiB data, 661 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 586 op/s 2026-02-20T03:16:59.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 149790 25.77 MB/sec warmup 32 sec latency 812.078 ms 2026-02-20T03:16:59.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:16:59 trial126 ceph-mon[38476]: pgmap v249: 129 pgs: 129 active+clean; 36 MiB data, 661 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 586 op/s 2026-02-20T03:16:59.618 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:16:59 trial177 ceph-mon[43181]: pgmap v249: 129 pgs: 129 active+clean; 36 MiB data, 661 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 586 op/s 2026-02-20T03:17:00.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 152620 25.51 MB/sec warmup 33 sec latency 1319.096 ms 2026-02-20T03:17:01.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 156442 25.36 MB/sec warmup 34 sec latency 11.691 ms 2026-02-20T03:17:01.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:01 trial126 ceph-mon[38476]: pgmap v250: 129 pgs: 129 active+clean; 40 MiB data, 685 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 565 op/s 2026-02-20T03:17:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:01 trial028 ceph-mon[38552]: pgmap v250: 129 pgs: 129 active+clean; 40 MiB data, 685 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 565 op/s 2026-02-20T03:17:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:01 trial177 ceph-mon[43181]: pgmap v250: 129 pgs: 129 active+clean; 40 MiB data, 685 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 565 op/s 2026-02-20T03:17:02.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 160186 25.19 MB/sec warmup 35 sec latency 9.563 ms 2026-02-20T03:17:03.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 163921 25.03 MB/sec warmup 36 sec latency 8.201 ms 2026-02-20T03:17:03.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:03 trial126 ceph-mon[38476]: pgmap v251: 129 pgs: 129 active+clean; 51 MiB data, 668 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 695 op/s 2026-02-20T03:17:03.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:03 trial028 ceph-mon[38552]: pgmap v251: 129 pgs: 129 active+clean; 51 MiB data, 668 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 695 op/s 2026-02-20T03:17:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:03 trial177 ceph-mon[43181]: pgmap v251: 129 pgs: 129 active+clean; 51 MiB data, 668 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 4.2 MiB/s wr, 695 op/s 2026-02-20T03:17:04.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 166972 24.85 MB/sec warmup 37 sec latency 362.101 ms 2026-02-20T03:17:05.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 166972 24.20 MB/sec warmup 38 sec latency 1362.139 ms 2026-02-20T03:17:05.524 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:05 trial028 ceph-mon[38552]: pgmap v252: 129 pgs: 129 active+clean; 57 MiB data, 676 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 671 op/s 2026-02-20T03:17:05.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:05 trial126 ceph-mon[38476]: pgmap v252: 129 pgs: 129 active+clean; 57 MiB data, 676 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 671 op/s 2026-02-20T03:17:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:05 trial177 ceph-mon[43181]: pgmap v252: 129 pgs: 129 active+clean; 57 MiB data, 676 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 671 op/s 2026-02-20T03:17:06.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 166972 23.57 MB/sec warmup 39 sec latency 2362.170 ms 2026-02-20T03:17:07.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:07 trial028 ceph-mon[38552]: pgmap v253: 129 pgs: 129 active+clean; 68 MiB data, 708 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 5.2 MiB/s wr, 657 op/s 2026-02-20T03:17:07.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 166972 22.99 MB/sec warmup 40 sec latency 3362.203 ms 2026-02-20T03:17:07.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:07 trial126 ceph-mon[38476]: pgmap v253: 129 pgs: 129 active+clean; 68 MiB data, 708 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 5.2 MiB/s wr, 657 op/s 2026-02-20T03:17:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:07 trial177 ceph-mon[43181]: pgmap v253: 129 pgs: 129 active+clean; 68 MiB data, 708 MiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 5.2 MiB/s wr, 657 op/s 2026-02-20T03:17:08.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 166972 22.42 MB/sec warmup 41 sec latency 4362.244 ms 2026-02-20T03:17:09.320 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:09 trial028 ceph-mon[38552]: pgmap v254: 129 pgs: 129 active+clean; 76 MiB data, 728 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 652 op/s 2026-02-20T03:17:09.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 166972 21.89 MB/sec warmup 42 sec latency 5362.291 ms 2026-02-20T03:17:09.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:09 trial126 ceph-mon[38476]: pgmap v254: 129 pgs: 129 active+clean; 76 MiB data, 728 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 652 op/s 2026-02-20T03:17:09.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.631+0000 7f9b32d9b640 1 -- 10.20.193.28:0/3199614613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c109490 msgr2=0x7f9b2c109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:09.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.631+0000 7f9b30d97640 1 -- 10.20.193.28:0/3199614613 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c02fc80 con 0x7f9b2c109490 2026-02-20T03:17:09.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.631+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/3199614613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c109490 0x7f9b2c109890 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009a30 tx=0x7f9b1c02f220 comp rx=0 tx=0).stop 2026-02-20T03:17:09.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.631+0000 7f9b32d9b640 1 -- 10.20.193.28:0/3199614613 shutdown_connections 2026-02-20T03:17:09.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.631+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/3199614613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b2c10a900 0x7f9b2c111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.631+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/3199614613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2c109e60 0x7f9b2c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.631+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/3199614613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c109490 0x7f9b2c109890 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.631+0000 7f9b32d9b640 1 -- 10.20.193.28:0/3199614613 >> 10.20.193.28:0/3199614613 conn(0x7f9b2c077fe0 msgr2=0x7f9b2c07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:09.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.632+0000 7f9b32d9b640 1 -- 10.20.193.28:0/3199614613 shutdown_connections 2026-02-20T03:17:09.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.632+0000 7f9b32d9b640 1 -- 10.20.193.28:0/3199614613 wait complete. 2026-02-20T03:17:09.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.632+0000 7f9b32d9b640 1 Processor -- start 2026-02-20T03:17:09.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.632+0000 7f9b32d9b640 1 -- start start 2026-02-20T03:17:09.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.632+0000 7f9b32d9b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2c109490 0x7f9b2c1a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b32d9b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b2c109e60 0x7f9b2c1a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b32d9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c10a900 0x7f9b2c1a8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b32d9b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c114990 con 0x7f9b2c10a900 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b32d9b640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c114810 con 0x7f9b2c109e60 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b32d9b640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c114b10 con 0x7f9b2c109490 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b3259a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c10a900 0x7f9b2c1a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b3259a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c10a900 0x7f9b2c1a8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55818/0 (socket says 10.20.193.28:55818) 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b3259a640 1 -- 10.20.193.28:0/1000977341 learned_addr learned my addr 10.20.193.28:0/1000977341 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b31d99640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2c109490 0x7f9b2c1a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b31598640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b2c109e60 0x7f9b2c1a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b3259a640 1 -- 10.20.193.28:0/1000977341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2c109490 msgr2=0x7f9b2c1a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b3259a640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2c109490 0x7f9b2c1a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b3259a640 1 -- 10.20.193.28:0/1000977341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b2c109e60 msgr2=0x7f9b2c1a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b3259a640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b2c109e60 0x7f9b2c1a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b3259a640 1 -- 10.20.193.28:0/1000977341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c1a89c0 con 0x7f9b2c10a900 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b3259a640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c10a900 0x7f9b2c1a8290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800ef30 tx=0x7f9b2800c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b1b7fe640 1 -- 10.20.193.28:0/1000977341 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28019070 con 0x7f9b2c10a900 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b1b7fe640 1 -- 10.20.193.28:0/1000977341 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9b280092d0 con 0x7f9b2c10a900 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b32d9b640 1 -- 10.20.193.28:0/1000977341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2c1a8c50 con 0x7f9b2c10a900 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.633+0000 7f9b1b7fe640 1 -- 10.20.193.28:0/1000977341 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28007500 con 0x7f9b2c10a900 2026-02-20T03:17:09.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.634+0000 7f9b32d9b640 1 -- 10.20.193.28:0/1000977341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2c1a9150 con 0x7f9b2c10a900 2026-02-20T03:17:09.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.636+0000 7f9b1b7fe640 1 -- 10.20.193.28:0/1000977341 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9b280076a0 con 0x7f9b2c10a900 2026-02-20T03:17:09.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b36e86e00 1 Processor -- start 2026-02-20T03:17:09.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b36e86e00 1 -- start start 2026-02-20T03:17:09.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 0x5653ac979280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac97df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac9809f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5653ac8c98f0 con 0x5653ac97e560 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5653ac8772e0 con 0x5653ac978e80 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5653ac8c5820 con 0x5653ac9797c0 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31598640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 0x5653ac979280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31598640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac9809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31598640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac9809f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55820/0 (socket says 10.20.193.28:55820) 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31598640 1 -- 10.20.193.28:0/3037577982 learned_addr learned my addr 10.20.193.28:0/3037577982 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31d99640 1 --2- 10.20.193.28:0/3037577982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac97df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b1b7fe640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9afc0b0da0 0x7f9afc0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31598640 1 -- 10.20.193.28:0/3037577982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 msgr2=0x5653ac97df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:09.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31598640 1 --2- 10.20.193.28:0/3037577982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac97df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b1b7fe640 1 -- 10.20.193.28:0/1000977341 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f9b280e0950 con 0x7f9b2c10a900 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31598640 1 -- 10.20.193.28:0/3037577982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 msgr2=0x5653ac979280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31598640 1 --2- 10.20.193.28:0/3037577982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 0x5653ac979280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.637+0000 7f9b31598640 1 -- 10.20.193.28:0/3037577982 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ac8695a0 con 0x5653ac97e560 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b31598640 1 --2- 10.20.193.28:0/3037577982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac9809f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9b20004590 tx=0x7f9b20009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189009f44ebb5906 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b3259a640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9afc0b0da0 0x7f9afc0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b18bfe640 1 -- 10.20.193.28:0/3037577982 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20013110 con 0x5653ac97e560 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b18bfe640 1 -- 10.20.193.28:0/3037577982 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9b200132b0 con 0x5653ac97e560 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b18bfe640 1 -- 10.20.193.28:0/3037577982 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20011940 con 0x5653ac97e560 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3037577982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 msgr2=0x5653ac9809f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3037577982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac9809f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9b20004590 tx=0x7f9b20009290 comp rx=0 tx=0).stop 2026-02-20T03:17:09.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b3259a640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9afc0b0da0 0x7f9afc0b3260 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9b280a83e0 tx=0x7f9b28009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3037577982 shutdown_connections 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3037577982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac9809f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3037577982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac97df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3037577982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 0x5653ac979280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3037577982 >> 10.20.193.28:0/3037577982 conn(0x5653ac9706f0 msgr2=0x5653ac977570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3037577982 shutdown_connections 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.638+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3037577982 wait complete. 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b36e86e00 1 -- start start 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b36e86e00 1 Processor -- start 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac978e80 0x5653ac9919e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac9797c0 0x5653ac991f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac97e560 0x5653ac998ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5653ac8710c0 con 0x5653ac978e80 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5653ac981610 con 0x5653ac9797c0 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5653ac999430 con 0x5653ac97e560 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b31598640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac978e80 0x5653ac9919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b31d99640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac9797c0 0x5653ac991f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b31598640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac978e80 0x5653ac9919e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55824/0 (socket says 10.20.193.28:55824) 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b31598640 1 -- 10.20.193.28:0/3204929481 learned_addr learned my addr 10.20.193.28:0/3204929481 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.640+0000 7f9b31598640 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac97e560 0x5653ac998ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9b31d99640 1 -- 10.20.193.28:0/3204929481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac97e560 msgr2=0x5653ac998ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9b31d99640 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac97e560 0x5653ac998ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9b31d99640 1 -- 10.20.193.28:0/3204929481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac978e80 msgr2=0x5653ac9919e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:09.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9b31d99640 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac978e80 0x5653ac9919e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9b31d99640 1 -- 10.20.193.28:0/3204929481 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ac98b100 con 0x5653ac9797c0 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9b31d99640 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac9797c0 0x5653ac991f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009950 tx=0x7f9b1c030cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfdebe8e71e8d2b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9ae37fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9ae37fe640 1 -- 10.20.193.28:0/3204929481 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c004450 con 0x5653ac9797c0 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9ae37fe640 1 -- 10.20.193.28:0/3204929481 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9b1c033070 con 0x5653ac9797c0 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9ae37fe640 1 -- 10.20.193.28:0/3204929481 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c044460 con 0x5653ac9797c0 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3204929481 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ac885820 con 0x5653ac9797c0 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9b36e86e00 10 client.25766 _ll_register_callbacks cb 0x5653ac874ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.641+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3204929481 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5653ac8d14e0 con 0x5653ac9797c0 2026-02-20T03:17:09.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9ae37fe640 1 -- 10.20.193.28:0/3204929481 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f9b1c038470 con 0x5653ac9797c0 2026-02-20T03:17:09.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9ae37fe640 1 -- 10.20.193.28:0/3204929481 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9b1c038730 con 0x5653ac9797c0 2026-02-20T03:17:09.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9b36e86e00 10 client.25766 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:09.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3204929481 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5653ac88a380 con 0x5653ac9797c0 2026-02-20T03:17:09.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9ae37fe640 1 -- 10.20.193.28:0/3204929481 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f9b1c055060 con 0x5653ac9797c0 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9b36e86e00 10 client.25766 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9b36e86e00 10 client.25766 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9b36e86e00 20 client.25766 populate_metadata read hostname 'trial028' 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5653ac99d700 0x5653ac99fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9b36e86e00 4 client.25766 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3204929481 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653ac84bbd0 con 0x5653ac99d700 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.642+0000 7f9b31598640 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5653ac99d700 0x5653ac99fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.643+0000 7f9b31598640 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5653ac99d700 0x5653ac99fba0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d10905818a7042d7 server_cookie=bdb107ebec3cddfc in_seq=0 out_seq=0 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.643+0000 7f9ae37fe640 10 client.25766 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:09.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.643+0000 7f9ae37fe640 1 -- 10.20.193.28:0/3204929481 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5653ac84bbd0 con 0x5653ac99d700 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.643+0000 7f9ae37fe640 10 client.25766 handle_command_reply: tid=0 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.643+0000 7f9b36e86e00 1 client.25766 shutdown 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3204929481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac9797c0 msgr2=0x5653ac991f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac9797c0 0x5653ac991f20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009950 tx=0x7f9b1c030cc0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3204929481 shutdown_connections 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5653ac99d700 0x5653ac99fba0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac97e560 0x5653ac998ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac9797c0 0x5653ac991f20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3204929481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac978e80 0x5653ac9919e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9ae37fe640 0 client.25766 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3204929481 >> 10.20.193.28:0/3204929481 conn(0x5653ac9706f0 msgr2=0x5653ac97f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:09.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3204929481 shutdown_connections 2026-02-20T03:17:09.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3204929481 wait complete. 2026-02-20T03:17:09.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.644+0000 7f9b36e86e00 20 client.25766 trim_cache size 0 max 16384 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b36e86e00 1 Processor -- start 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b36e86e00 1 -- start start 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 0x5653ac976d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac998e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac977290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad80126f0 con 0x5653ac97e560 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad800ffc0 con 0x5653ac978e80 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad800de10 con 0x5653ac9797c0 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b31598640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 0x5653ac976d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.651+0000 7f9b31d99640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac998e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b31598640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac977290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b31d99640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac998e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49044/0 (socket says 10.20.193.28:49044) 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b31d99640 1 -- 10.20.193.28:0/3895811011 learned_addr learned my addr 10.20.193.28:0/3895811011 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b31d99640 1 -- 10.20.193.28:0/3895811011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 msgr2=0x5653ac976d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b31d99640 1 --2- 10.20.193.28:0/3895811011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 0x5653ac976d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b31d99640 1 -- 10.20.193.28:0/3895811011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 msgr2=0x5653ac977290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b31d99640 1 --2- 10.20.193.28:0/3895811011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac977290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b31d99640 1 -- 10.20.193.28:0/3895811011 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ac98af30 con 0x5653ac9797c0 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b31d99640 1 --2- 10.20.193.28:0/3895811011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac998e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c002a70 tx=0x7f9b1c04b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a601b75cdd560db5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b13fff640 1 -- 10.20.193.28:0/3895811011 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c030d30 con 0x5653ac9797c0 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b13fff640 1 -- 10.20.193.28:0/3895811011 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9b1c033070 con 0x5653ac9797c0 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b13fff640 1 -- 10.20.193.28:0/3895811011 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c044b60 con 0x5653ac9797c0 2026-02-20T03:17:09.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3895811011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 msgr2=0x5653ac998e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.652+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3895811011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac998e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c002a70 tx=0x7f9b1c04b000 comp rx=0 tx=0).stop 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.653+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3895811011 shutdown_connections 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.653+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3895811011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac97e560 0x5653ac977290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.653+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3895811011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac9797c0 0x5653ac998e60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.653+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/3895811011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac978e80 0x5653ac976d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.653+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3895811011 >> 10.20.193.28:0/3895811011 conn(0x5653ac9706f0 msgr2=0x5653ac97e940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.653+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3895811011 shutdown_connections 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.653+0000 7f9b36e86e00 1 -- 10.20.193.28:0/3895811011 wait complete. 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.653+0000 7f9b36e86e00 1 -- start start 2026-02-20T03:17:09.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.653+0000 7f9b36e86e00 1 Processor -- start 2026-02-20T03:17:09.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac978e80 0x5653ac995560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac9797c0 0x5653ac995aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b36e86e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac97e560 0x5653ac998900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad800e480 con 0x5653ac9797c0 2026-02-20T03:17:09.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad800f8f0 con 0x5653ac97e560 2026-02-20T03:17:09.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b36e86e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad800eb50 con 0x5653ac978e80 2026-02-20T03:17:09.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31598640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac97e560 0x5653ac998900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31d99640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac9797c0 0x5653ac995aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31598640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac978e80 0x5653ac995560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31598640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac978e80 0x5653ac995560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49058/0 (socket says 10.20.193.28:49058) 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31598640 1 -- 10.20.193.28:0/4007106980 learned_addr learned my addr 10.20.193.28:0/4007106980 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31598640 1 -- 10.20.193.28:0/4007106980 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac97e560 msgr2=0x5653ac998900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31598640 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac97e560 0x5653ac998900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31598640 1 -- 10.20.193.28:0/4007106980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac9797c0 msgr2=0x5653ac995aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31598640 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac9797c0 0x5653ac995aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31598640 1 -- 10.20.193.28:0/4007106980 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ac629690 con 0x5653ac978e80 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.654+0000 7f9b31d99640 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac9797c0 0x5653ac995aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9b31598640 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac978e80 0x5653ac995560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009fa0 tx=0x7f9b20009d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd743315d9be6998 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9ae37fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9ae37fe640 1 -- 10.20.193.28:0/4007106980 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20003c50 con 0x5653ac978e80 2026-02-20T03:17:09.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9ae37fe640 1 -- 10.20.193.28:0/4007106980 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9b20032040 con 0x5653ac978e80 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9ae37fe640 1 -- 10.20.193.28:0/4007106980 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20004970 con 0x5653ac978e80 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9b36e86e00 1 -- 10.20.193.28:0/4007106980 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ac88eb70 con 0x5653ac978e80 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9b36e86e00 10 client.25762 _ll_register_callbacks cb 0x7f9b1c0057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9b36e86e00 1 -- 10.20.193.28:0/4007106980 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b200132b0 con 0x5653ac978e80 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9ae37fe640 1 -- 10.20.193.28:0/4007106980 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f9b20003df0 con 0x5653ac978e80 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9ae37fe640 1 -- 10.20.193.28:0/4007106980 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9b2003e060 con 0x5653ac978e80 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9b36e86e00 10 client.25762 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.655+0000 7f9b36e86e00 1 -- 10.20.193.28:0/4007106980 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5653ac98bc20 con 0x5653ac978e80 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9ae37fe640 1 -- 10.20.193.28:0/4007106980 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f9b20037040 con 0x5653ac978e80 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9b36e86e00 10 client.25762 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9b36e86e00 10 client.25762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9b36e86e00 20 client.25762 populate_metadata read hostname 'trial028' 2026-02-20T03:17:09.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5653aca094e0 0x5653aca0b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:09.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9b36e86e00 4 client.25762 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:17:09.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9b36e86e00 1 -- 10.20.193.28:0/4007106980 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5653ac6a2520 con 0x5653aca094e0 2026-02-20T03:17:09.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9b31d99640 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5653aca094e0 0x5653aca0b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:09.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9b31d99640 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5653aca094e0 0x5653aca0b950 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a61bb44f31494369 server_cookie=f849f39e9d0e5822 in_seq=0 out_seq=0 2026-02-20T03:17:09.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.656+0000 7f9ae37fe640 10 client.25762 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:09 trial177 ceph-mon[43181]: pgmap v254: 129 pgs: 129 active+clean; 76 MiB data, 728 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 652 op/s 2026-02-20T03:17:09.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.721+0000 7f9ae37fe640 1 -- 10.20.193.28:0/4007106980 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5653ac6a2520 con 0x5653aca094e0 2026-02-20T03:17:09.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.721+0000 7f9ae37fe640 10 client.25762 handle_command_reply: tid=0 2026-02-20T03:17:09.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.721+0000 7f9b36e86e00 1 client.25762 shutdown 2026-02-20T03:17:09.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 -- 10.20.193.28:0/4007106980 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac978e80 msgr2=0x5653ac995560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:09.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac978e80 0x5653ac995560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009fa0 tx=0x7f9b20009d80 comp rx=0 tx=0).stop 2026-02-20T03:17:09.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 -- 10.20.193.28:0/4007106980 shutdown_connections 2026-02-20T03:17:09.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5653aca094e0 0x5653aca0b950 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5653ac97e560 0x5653ac998900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5653ac9797c0 0x5653ac995aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 --2- 10.20.193.28:0/4007106980 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5653ac978e80 0x5653ac995560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9ae37fe640 0 client.25762 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:09.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 -- 10.20.193.28:0/4007106980 >> 10.20.193.28:0/4007106980 conn(0x5653ac9706f0 msgr2=0x5653ac97f160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:09.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 -- 10.20.193.28:0/4007106980 shutdown_connections 2026-02-20T03:17:09.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 1 -- 10.20.193.28:0/4007106980 wait complete. 2026-02-20T03:17:09.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.722+0000 7f9b36e86e00 20 client.25762 trim_cache size 0 max 16384 2026-02-20T03:17:09.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:17:09.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:17:09.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:17:09.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:17:09.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 -- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9afc0b0da0 msgr2=0x7f9afc0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:09.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9afc0b0da0 0x7f9afc0b3260 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9b280a83e0 tx=0x7f9b28009040 comp rx=0 tx=0).stop 2026-02-20T03:17:09.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 -- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c10a900 msgr2=0x7f9b2c1a8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:09.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c10a900 0x7f9b2c1a8290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800ef30 tx=0x7f9b2800c560 comp rx=0 tx=0).stop 2026-02-20T03:17:09.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 -- 10.20.193.28:0/1000977341 shutdown_connections 2026-02-20T03:17:09.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9afc0b0da0 0x7f9afc0b3260 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b2c10a900 0x7f9b2c1a8290 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b2c109e60 0x7f9b2c1a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 --2- 10.20.193.28:0/1000977341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b2c109490 0x7f9b2c1a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:09.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 -- 10.20.193.28:0/1000977341 >> 10.20.193.28:0/1000977341 conn(0x7f9b2c077fe0 msgr2=0x7f9b2c079e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:09.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 -- 10.20.193.28:0/1000977341 shutdown_connections 2026-02-20T03:17:09.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:09.723+0000 7f9b32d9b640 1 -- 10.20.193.28:0/1000977341 wait complete. 2026-02-20T03:17:10.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167194 21.39 MB/sec warmup 43 sec latency 5411.803 ms 2026-02-20T03:17:11.477 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:11 trial028 ceph-mon[38552]: pgmap v255: 129 pgs: 129 active+clean; 75 MiB data, 724 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 5.8 MiB/s wr, 552 op/s 2026-02-20T03:17:11.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 20.90 MB/sec warmup 44 sec latency 821.532 ms 2026-02-20T03:17:11.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:11 trial126 ceph-mon[38476]: pgmap v255: 129 pgs: 129 active+clean; 75 MiB data, 724 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 5.8 MiB/s wr, 552 op/s 2026-02-20T03:17:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:11 trial177 ceph-mon[43181]: pgmap v255: 129 pgs: 129 active+clean; 75 MiB data, 724 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 5.8 MiB/s wr, 552 op/s 2026-02-20T03:17:12.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 20.44 MB/sec warmup 45 sec latency 1821.558 ms 2026-02-20T03:17:13.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:13 trial028 ceph-mon[38552]: pgmap v256: 129 pgs: 129 active+clean; 68 MiB data, 726 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 5.4 MiB/s wr, 447 op/s 2026-02-20T03:17:13.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 19.99 MB/sec warmup 46 sec latency 2821.593 ms 2026-02-20T03:17:13.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:13 trial126 ceph-mon[38476]: pgmap v256: 129 pgs: 129 active+clean; 68 MiB data, 726 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 5.4 MiB/s wr, 447 op/s 2026-02-20T03:17:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:13 trial177 ceph-mon[43181]: pgmap v256: 129 pgs: 129 active+clean; 68 MiB data, 726 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 5.4 MiB/s wr, 447 op/s 2026-02-20T03:17:14.497 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 19.57 MB/sec warmup 47 sec latency 3821.644 ms 2026-02-20T03:17:15.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 19.16 MB/sec warmup 48 sec latency 4821.683 ms 2026-02-20T03:17:15.547 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:15 trial028 ceph-mon[38552]: pgmap v257: 129 pgs: 129 active+clean; 68 MiB data, 748 MiB used, 8.2 TiB / 8.2 TiB avail; 977 KiB/s rd, 4.7 MiB/s wr, 337 op/s 2026-02-20T03:17:15.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:15 trial126 ceph-mon[38476]: pgmap v257: 129 pgs: 129 active+clean; 68 MiB data, 748 MiB used, 8.2 TiB / 8.2 TiB avail; 977 KiB/s rd, 4.7 MiB/s wr, 337 op/s 2026-02-20T03:17:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:15 trial177 ceph-mon[43181]: pgmap v257: 129 pgs: 129 active+clean; 68 MiB data, 748 MiB used, 8.2 TiB / 8.2 TiB avail; 977 KiB/s rd, 4.7 MiB/s wr, 337 op/s 2026-02-20T03:17:16.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 18.77 MB/sec warmup 49 sec latency 5821.729 ms 2026-02-20T03:17:16.883 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.3 2026-02-20T03:17:16.883 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:17:17.172 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:17.467 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:17 trial028 ceph-mon[38552]: pgmap v258: 129 pgs: 129 active+clean; 65 MiB data, 744 MiB used, 8.2 TiB / 8.2 TiB avail; 970 KiB/s rd, 4.8 MiB/s wr, 389 op/s 2026-02-20T03:17:17.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- 10.20.193.28:0/3101164936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce00753b0 msgr2=0x7efce0075790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:17.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 --2- 10.20.193.28:0/3101164936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce00753b0 0x7efce0075790 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009a30 tx=0x7efcd402f2f0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- 10.20.193.28:0/3101164936 shutdown_connections 2026-02-20T03:17:17.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 --2- 10.20.193.28:0/3101164936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efce010f0b0 0x7efce01114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 --2- 10.20.193.28:0/3101164936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce0075cd0 0x7efce010eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 --2- 10.20.193.28:0/3101164936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce00753b0 0x7efce0075790 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- 10.20.193.28:0/3101164936 >> 10.20.193.28:0/3101164936 conn(0x7efce00fe410 msgr2=0x7efce0100830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:17.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- 10.20.193.28:0/3101164936 shutdown_connections 2026-02-20T03:17:17.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- 10.20.193.28:0/3101164936 wait complete. 2026-02-20T03:17:17.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 Processor -- start 2026-02-20T03:17:17.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- start start 2026-02-20T03:17:17.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efce00753b0 0x7efce010e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:17.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce0075cd0 0x7efce010ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:17.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce010f0b0 0x7efce010c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efce0114d00 con 0x7efce0075cd0 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efce0114b80 con 0x7efce010f0b0 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efce0114e80 con 0x7efce00753b0 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcddd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce0075cd0 0x7efce010ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcddd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce0075cd0 0x7efce010ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44740/0 (socket says 10.20.193.28:44740) 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcddd74640 1 -- 10.20.193.28:0/2389263818 learned_addr learned my addr 10.20.193.28:0/2389263818 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcddd74640 1 -- 10.20.193.28:0/2389263818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efce00753b0 msgr2=0x7efce010e9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcddd74640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efce00753b0 0x7efce010e9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcddd74640 1 -- 10.20.193.28:0/2389263818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce010f0b0 msgr2=0x7efce010c180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcddd74640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce010f0b0 0x7efce010c180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcddd74640 1 -- 10.20.193.28:0/2389263818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce01adba0 con 0x7efce0075cd0 2026-02-20T03:17:17.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 18.39 MB/sec warmup 50 sec latency 6821.761 ms 2026-02-20T03:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcddd74640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce0075cd0 0x7efce010ba90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efcc800b570 tx=0x7efcc800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcc77fe640 1 -- 10.20.193.28:0/2389263818 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8013020 con 0x7efce0075cd0 2026-02-20T03:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcc77fe640 1 -- 10.20.193.28:0/2389263818 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efcc8004480 con 0x7efce0075cd0 2026-02-20T03:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcc77fe640 1 -- 10.20.193.28:0/2389263818 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc800fb50 con 0x7efce0075cd0 2026-02-20T03:17:17.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce01add70 con 0x7efce0075cd0 2026-02-20T03:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce01ae1a0 con 0x7efce0075cd0 2026-02-20T03:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce0076af0 con 0x7efce0075cd0 2026-02-20T03:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.493+0000 7efcc77fe640 1 -- 10.20.193.28:0/2389263818 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efcc8020060 con 0x7efce0075cd0 2026-02-20T03:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.499+0000 7efcc77fe640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcb80b0e20 0x7efcb80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.499+0000 7efcc77fe640 1 -- 10.20.193.28:0/2389263818 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7efcc80e0ab0 con 0x7efce0075cd0 2026-02-20T03:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.499+0000 7efcc77fe640 1 -- 10.20.193.28:0/2389263818 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7efcc800e3c0 con 0x7efce0075cd0 2026-02-20T03:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.499+0000 7efcde575640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcb80b0e20 0x7efcb80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:17.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.499+0000 7efcde575640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcb80b0e20 0x7efcb80b32e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009950 tx=0x7efcd40023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:17.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:17 trial126 ceph-mon[38476]: pgmap v258: 129 pgs: 129 active+clean; 65 MiB data, 744 MiB used, 8.2 TiB / 8.2 TiB avail; 970 KiB/s rd, 4.8 MiB/s wr, 389 op/s 2026-02-20T03:17:17.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efce01058b0 con 0x7efce0075cd0 2026-02-20T03:17:17.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcc77fe640 1 -- 10.20.193.28:0/2389263818 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7efcc80a8e90 con 0x7efce0075cd0 2026-02-20T03:17:17.610 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:17:17.613 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T03:15:38:113153+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:37.375812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:17:17.614 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T03:17:17.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcb80b0e20 msgr2=0x7efcb80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcb80b0e20 0x7efcb80b32e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009950 tx=0x7efcd40023d0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce0075cd0 msgr2=0x7efce010ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce0075cd0 0x7efce010ba90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efcc800b570 tx=0x7efcc800ba40 comp rx=0 tx=0).stop 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 shutdown_connections 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcb80b0e20 0x7efcb80b32e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efce010f0b0 0x7efce010c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efce0075cd0 0x7efce010ba90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 --2- 10.20.193.28:0/2389263818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efce00753b0 0x7efce010e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 >> 10.20.193.28:0/2389263818 conn(0x7efce00fe410 msgr2=0x7efce00ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 shutdown_connections 2026-02-20T03:17:17.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:17.607+0000 7efcdf577640 1 -- 10.20.193.28:0/2389263818 wait complete. 2026-02-20T03:17:17.696 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 140.3 --await-for 45.0' 2026-02-20T03:17:17.696 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 140.3 --await-for 45.0 2026-02-20T03:17:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:17 trial177 ceph-mon[43181]: pgmap v258: 129 pgs: 129 active+clean; 65 MiB data, 744 MiB used, 8.2 TiB / 8.2 TiB avail; 970 KiB/s rd, 4.8 MiB/s wr, 389 op/s 2026-02-20T03:17:18.002 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:18.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.325+0000 7fd594a00640 1 -- 10.20.193.28:0/3402654901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd59010eef0 msgr2=0x7fd59010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:18.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.325+0000 7fd594a00640 1 --2- 10.20.193.28:0/3402654901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd59010eef0 0x7fd59010f2d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009a30 tx=0x7fd57c02f260 comp rx=0 tx=0).stop 2026-02-20T03:17:18.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.325+0000 7fd594a00640 1 -- 10.20.193.28:0/3402654901 shutdown_connections 2026-02-20T03:17:18.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.325+0000 7fd594a00640 1 --2- 10.20.193.28:0/3402654901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd590109ba0 0x7fd590115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.325+0000 7fd594a00640 1 --2- 10.20.193.28:0/3402654901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd590109220 0x7fd590109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.325+0000 7fd594a00640 1 --2- 10.20.193.28:0/3402654901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd59010eef0 0x7fd59010f2d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.325+0000 7fd594a00640 1 -- 10.20.193.28:0/3402654901 >> 10.20.193.28:0/3402654901 conn(0x7fd590078600 msgr2=0x7fd59007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:18.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.325+0000 7fd594a00640 1 -- 10.20.193.28:0/3402654901 shutdown_connections 2026-02-20T03:17:18.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.325+0000 7fd594a00640 1 -- 10.20.193.28:0/3402654901 wait complete. 2026-02-20T03:17:18.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 Processor -- start 2026-02-20T03:17:18.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 -- start start 2026-02-20T03:17:18.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd590109220 0x7fd5901a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd590109ba0 0x7fd5901a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd59010eef0 0x7fd5901a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901191b0 con 0x7fd590109220 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd590119030 con 0x7fd590109ba0 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd590119330 con 0x7fd59010eef0 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd590109220 0x7fd5901a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd590109220 0x7fd5901a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44758/0 (socket says 10.20.193.28:44758) 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1024253808 learned_addr learned my addr 10.20.193.28:0/1024253808 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1024253808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd59010eef0 msgr2=0x7fd5901a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd59010eef0 0x7fd5901a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1024253808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd590109ba0 msgr2=0x7fd5901a1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd590109ba0 0x7fd5901a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1024253808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5901a66a0 con 0x7fd590109220 2026-02-20T03:17:18.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd590109220 0x7fd5901a1650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009950 tx=0x7fd57c002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:18.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58cff9640 1 -- 10.20.193.28:0/1024253808 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c002a00 con 0x7fd590109220 2026-02-20T03:17:18.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58cff9640 1 -- 10.20.193.28:0/1024253808 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd57c005030 con 0x7fd590109220 2026-02-20T03:17:18.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 -- 10.20.193.28:0/1024253808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5901a6930 con 0x7fd590109220 2026-02-20T03:17:18.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd58cff9640 1 -- 10.20.193.28:0/1024253808 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c004d80 con 0x7fd590109220 2026-02-20T03:17:18.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.331+0000 7fd594a00640 1 -- 10.20.193.28:0/1024253808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5901ae1d0 con 0x7fd590109220 2026-02-20T03:17:18.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58cff9640 1 -- 10.20.193.28:0/1024253808 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd57c0051e0 con 0x7fd590109220 2026-02-20T03:17:18.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 Processor -- start 2026-02-20T03:17:18.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 -- start start 2026-02-20T03:17:18.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e0af960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0a9c70 0x55739e0aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55739dfeb410 con 0x55739e0aa630 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55739df988b0 con 0x55739e0a9c70 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55739dfe7340 con 0x55739e0af580 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44774/0 (socket says 10.20.193.28:44774) 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58effd640 1 -- 10.20.193.28:0/3482486811 learned_addr learned my addr 10.20.193.28:0/3482486811 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58effd640 1 -- 10.20.193.28:0/3482486811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 msgr2=0x55739e0af960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58effd640 1 --2- 10.20.193.28:0/3482486811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e0af960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58effd640 1 -- 10.20.193.28:0/3482486811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0a9c70 msgr2=0x55739e0aa0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58effd640 1 --2- 10.20.193.28:0/3482486811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0a9c70 0x55739e0aa0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58effd640 1 -- 10.20.193.28:0/3482486811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739df8a8c0 con 0x55739e0aa630 2026-02-20T03:17:18.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58effd640 1 --2- 10.20.193.28:0/3482486811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0b63d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd5800098c0 tx=0x7fd580009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5031236453520168 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:18.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd553fff640 1 -- 10.20.193.28:0/3482486811 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580016070 con 0x55739e0aa630 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd553fff640 1 -- 10.20.193.28:0/3482486811 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd580004540 con 0x55739e0aa630 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd553fff640 1 -- 10.20.193.28:0/3482486811 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58000be40 con 0x55739e0aa630 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58cff9640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd58cff9640 1 -- 10.20.193.28:0/1024253808 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fd57c105200 con 0x7fd590109220 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 -- 10.20.193.28:0/3482486811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 msgr2=0x55739e0b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.336+0000 7fd59818ee00 1 --2- 10.20.193.28:0/3482486811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0b63d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd5800098c0 tx=0x7fd580009d90 comp rx=0 tx=0).stop 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58ffff640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- 10.20.193.28:0/3482486811 shutdown_connections 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 --2- 10.20.193.28:0/3482486811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0b63d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 --2- 10.20.193.28:0/3482486811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0a9c70 0x55739e0aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 --2- 10.20.193.28:0/3482486811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e0af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- 10.20.193.28:0/3482486811 >> 10.20.193.28:0/3482486811 conn(0x55739e0913c0 msgr2=0x55739e096f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- 10.20.193.28:0/3482486811 shutdown_connections 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- 10.20.193.28:0/3482486811 wait complete. 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58ffff640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd58400aab0 tx=0x7fd584009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- start start 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 Processor -- start 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0aa630 0x55739e0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e0c3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55739df924a0 con 0x55739e0a9c70 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55739e0b6ad0 con 0x55739e0aa630 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55739e0c3990 con 0x55739e0af580 2026-02-20T03:17:18.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44784/0 (socket says 10.20.193.28:44784) 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1762582020 learned_addr learned my addr 10.20.193.28:0/1762582020 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1762582020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 msgr2=0x55739e0c3210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e0c3210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1762582020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0aa630 msgr2=0x55739e0c5010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0aa630 0x55739e0c5010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1762582020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739e0bc550 con 0x55739e0a9c70 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0c4ad0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0cd280 tx=0x7fd57c02fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fedf29cfe11796 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd5517fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd5517fa640 1 -- 10.20.193.28:0/1762582020 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c048040 con 0x55739e0a9c70 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd5517fa640 1 -- 10.20.193.28:0/1762582020 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd57c0d16a0 con 0x55739e0a9c70 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd5517fa640 1 -- 10.20.193.28:0/1762582020 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0cbfd0 con 0x55739e0a9c70 2026-02-20T03:17:18.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- 10.20.193.28:0/1762582020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739dd4f8a0 con 0x55739e0a9c70 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd5517fa640 1 -- 10.20.193.28:0/1762582020 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fd57c0c8a10 con 0x55739e0a9c70 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 10 client.15729 _ll_register_callbacks cb 0x55739df963d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- 10.20.193.28:0/1762582020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55739dff3000 con 0x55739e0a9c70 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd5517fa640 1 -- 10.20.193.28:0/1762582020 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd57c004490 con 0x55739e0a9c70 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 10 client.15729 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- 10.20.193.28:0/1762582020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55739ddbb0e0 con 0x55739e0a9c70 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd5517fa640 1 -- 10.20.193.28:0/1762582020 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fd57c0cc300 con 0x55739e0a9c70 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 10 client.15729 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 10 client.15729 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 20 client.15729 populate_metadata read hostname 'trial028' 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55739e0d2ef0 0x55739e0d53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 4 client.15729 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:18.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.339+0000 7fd59818ee00 1 -- 10.20.193.28:0/1762582020 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55739df6cf60 con 0x55739e0d2ef0 2026-02-20T03:17:18.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.345+0000 7fd58effd640 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55739e0d2ef0 0x55739e0d53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:18.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.399+0000 7fd58effd640 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55739e0d2ef0 0x55739e0d53b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f84d4cf2d4bc6813 server_cookie=c3975c26fdedfea in_seq=0 out_seq=0 2026-02-20T03:17:18.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.399+0000 7fd5517fa640 10 client.15729 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:18.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd5517fa640 1 -- 10.20.193.28:0/1762582020 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55739df6cf60 con 0x55739e0d2ef0 2026-02-20T03:17:18.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd5517fa640 10 client.15729 handle_command_reply: tid=0 2026-02-20T03:17:18.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd59818ee00 1 client.15729 shutdown 2026-02-20T03:17:18.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd59818ee00 1 -- 10.20.193.28:0/1762582020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 msgr2=0x55739e0c4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:18.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0c4ad0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0cd280 tx=0x7fd57c02fee0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd59818ee00 1 -- 10.20.193.28:0/1762582020 shutdown_connections 2026-02-20T03:17:18.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55739e0d2ef0 0x55739e0d53b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e0c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0aa630 0x55739e0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1762582020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0c4ad0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd59818ee00 1 -- 10.20.193.28:0/1762582020 >> 10.20.193.28:0/1762582020 conn(0x55739e0913c0 msgr2=0x55739e097670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:18.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.413+0000 7fd5517fa640 0 client.15729 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:18.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.427+0000 7fd59818ee00 1 -- 10.20.193.28:0/1762582020 shutdown_connections 2026-02-20T03:17:18.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.427+0000 7fd59818ee00 1 -- 10.20.193.28:0/1762582020 wait complete. 2026-02-20T03:17:18.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.427+0000 7fd59818ee00 20 client.15729 trim_cache size 0 max 16384 2026-02-20T03:17:18.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 Processor -- start 2026-02-20T03:17:18.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 -- start start 2026-02-20T03:17:18.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0aa630 0x55739e0d3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e097750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd5340126a0 con 0x55739e0a9c70 2026-02-20T03:17:18.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400ff70 con 0x55739e0aa630 2026-02-20T03:17:18.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400ddc0 con 0x55739e0af580 2026-02-20T03:17:18.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd58f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:18.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd58f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0d39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44792/0 (socket says 10.20.193.28:44792) 2026-02-20T03:17:18.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1681893451 learned_addr learned my addr 10.20.193.28:0/1681893451 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:18.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1681893451 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 msgr2=0x55739e097750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:18.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1681893451 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e097750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1681893451 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0aa630 msgr2=0x55739e0d3f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:18.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1681893451 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0aa630 0x55739e0d3f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd58f7fe640 1 -- 10.20.193.28:0/1681893451 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739e0c3580 con 0x55739e0a9c70 2026-02-20T03:17:18.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1681893451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0d39e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0c9120 tx=0x55739e0c4510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96800f7708f3958 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:18.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd5537fe640 1 -- 10.20.193.28:0/1681893451 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c048040 con 0x55739e0a9c70 2026-02-20T03:17:18.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd5537fe640 1 -- 10.20.193.28:0/1681893451 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55739dff3000 con 0x55739e0a9c70 2026-02-20T03:17:18.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd5537fe640 1 -- 10.20.193.28:0/1681893451 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0cc500 con 0x55739e0a9c70 2026-02-20T03:17:18.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 -- 10.20.193.28:0/1681893451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 msgr2=0x55739e0d39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:18.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1681893451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0d39e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0c9120 tx=0x55739e0c4510 comp rx=0 tx=0).stop 2026-02-20T03:17:18.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 -- 10.20.193.28:0/1681893451 shutdown_connections 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1681893451 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e097750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1681893451 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0aa630 0x55739e0d3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1681893451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0a9c70 0x55739e0d39e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.432+0000 7fd59818ee00 1 -- 10.20.193.28:0/1681893451 >> 10.20.193.28:0/1681893451 conn(0x55739e0913c0 msgr2=0x55739e0d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- 10.20.193.28:0/1681893451 shutdown_connections 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- 10.20.193.28:0/1681893451 wait complete. 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- start start 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 Processor -- start 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0a9c70 0x55739e0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e13de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400e430 con 0x55739e0aa630 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400f8a0 con 0x55739e0a9c70 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400eb00 con 0x55739e0af580 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd58effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd58effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44804/0 (socket says 10.20.193.28:44804) 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd58effd640 1 -- 10.20.193.28:0/1398729279 learned_addr learned my addr 10.20.193.28:0/1398729279 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd58effd640 1 -- 10.20.193.28:0/1398729279 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 msgr2=0x55739e13de60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd58effd640 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e13de60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd58effd640 1 -- 10.20.193.28:0/1398729279 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0a9c70 msgr2=0x55739e0c8050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd58effd640 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0a9c70 0x55739e0c8050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd58effd640 1 -- 10.20.193.28:0/1398729279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739e0bc380 con 0x55739e0aa630 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd58effd640 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0c8590 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd580009890 tx=0x7fd580009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8220f3fd7a6390cd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:18.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd5517fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:18.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd5517fa640 1 -- 10.20.193.28:0/1398729279 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580028070 con 0x55739e0aa630 2026-02-20T03:17:18.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd5517fa640 1 -- 10.20.193.28:0/1398729279 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd580017040 con 0x55739e0aa630 2026-02-20T03:17:18.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd5517fa640 1 -- 10.20.193.28:0/1398729279 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580016040 con 0x55739e0aa630 2026-02-20T03:17:18.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- 10.20.193.28:0/1398729279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739e0bbf40 con 0x55739e0aa630 2026-02-20T03:17:18.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd5517fa640 1 -- 10.20.193.28:0/1398729279 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fd58001d430 con 0x55739e0aa630 2026-02-20T03:17:18.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd5517fa640 10 client.15735 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:17:18.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 10 client.15735 _ll_register_callbacks cb 0x7fd57c0cc9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- 10.20.193.28:0/1398729279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd580004540 con 0x55739e0aa630 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd5517fa640 1 -- 10.20.193.28:0/1398729279 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd58000bc90 con 0x55739e0aa630 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 10 client.15735 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- 10.20.193.28:0/1398729279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55739dd6c7f0 con 0x55739e0aa630 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd5517fa640 1 -- 10.20.193.28:0/1398729279 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7fd580022070 con 0x55739e0aa630 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 10 client.15735 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 10 client.15735 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 20 client.15735 populate_metadata read hostname 'trial028' 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55739e13f730 0x55739e141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 4 client.15735 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.3, "await_for": 45.0}] 2026-02-20T03:17:18.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.437+0000 7fd59818ee00 1 -- 10.20.193.28:0/1398729279 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.3, "await_for": 45.0}) -- 0x55739dd5bf60 con 0x55739e13f730 2026-02-20T03:17:18.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.454+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55739e13f730 0x55739e141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:18.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.482+0000 7fd58f7fe640 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55739e13f730 0x55739e141bf0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73fcadbcd3f3aeda server_cookie=cf75793f1503ae80 in_seq=0 out_seq=0 2026-02-20T03:17:18.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:18.482+0000 7fd5517fa640 10 client.15735 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:18.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 18.03 MB/sec warmup 51 sec latency 7821.795 ms 2026-02-20T03:17:18.566 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:18 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2389263818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:18 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2389263818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:18.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:18 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2389263818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:19.307 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:17:19.379 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:19 trial028 ceph-mon[38552]: pgmap v259: 129 pgs: 129 active+clean; 62 MiB data, 739 MiB used, 8.2 TiB / 8.2 TiB avail; 620 KiB/s rd, 4.1 MiB/s wr, 343 op/s 2026-02-20T03:17:19.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 17.69 MB/sec warmup 52 sec latency 8821.832 ms 2026-02-20T03:17:19.613 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:19 trial177 ceph-mon[43181]: pgmap v259: 129 pgs: 129 active+clean; 62 MiB data, 739 MiB used, 8.2 TiB / 8.2 TiB avail; 620 KiB/s rd, 4.1 MiB/s wr, 343 op/s 2026-02-20T03:17:19.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:19 trial126 ceph-mon[38476]: pgmap v259: 129 pgs: 129 active+clean; 62 MiB data, 739 MiB used, 8.2 TiB / 8.2 TiB avail; 620 KiB/s rd, 4.1 MiB/s wr, 343 op/s 2026-02-20T03:17:20.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 -- 10.20.193.28:0/64165608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810d6f0 msgr2=0x7f83f810dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 --2- 10.20.193.28:0/64165608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810d6f0 0x7f83f810dad0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009a30 tx=0x7f83ec02f260 comp rx=0 tx=0).stop 2026-02-20T03:17:20.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 -- 10.20.193.28:0/64165608 shutdown_connections 2026-02-20T03:17:20.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 --2- 10.20.193.28:0/64165608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f83f8112700 0x7f83f811a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 --2- 10.20.193.28:0/64165608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83f810e0a0 0x7f83f8111fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 --2- 10.20.193.28:0/64165608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810d6f0 0x7f83f810dad0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 -- 10.20.193.28:0/64165608 >> 10.20.193.28:0/64165608 conn(0x7f83f806d500 msgr2=0x7f83f806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:20.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 -- 10.20.193.28:0/64165608 shutdown_connections 2026-02-20T03:17:20.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 -- 10.20.193.28:0/64165608 wait complete. 2026-02-20T03:17:20.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 Processor -- start 2026-02-20T03:17:20.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 -- start start 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f83f810d6f0 0x7f83f81ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810e0a0 0x7f83f81abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83f8112700 0x7f83f81a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f83f811d6b0 con 0x7f83f810e0a0 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f83f811d530 con 0x7f83f8112700 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f7fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f83f811d830 con 0x7f83f810d6f0 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:19.995+0000 7f83f67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810e0a0 0x7f83f81abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83f67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810e0a0 0x7f83f81abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44836/0 (socket says 10.20.193.28:44836) 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83f67fc640 1 -- 10.20.193.28:0/2423765137 learned_addr learned my addr 10.20.193.28:0/2423765137 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83f67fc640 1 -- 10.20.193.28:0/2423765137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f83f810d6f0 msgr2=0x7f83f81ab7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:20.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83f67fc640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f83f810d6f0 0x7f83f81ab7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83f67fc640 1 -- 10.20.193.28:0/2423765137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83f8112700 msgr2=0x7f83f81a59a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:20.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83f67fc640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83f8112700 0x7f83f81a59a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83f67fc640 1 -- 10.20.193.28:0/2423765137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f81a6170 con 0x7f83f810e0a0 2026-02-20T03:17:20.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83f67fc640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810e0a0 0x7f83f81abd20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f83e000b570 tx=0x7f83e000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:20.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83cffff640 1 -- 10.20.193.28:0/2423765137 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0013020 con 0x7f83f810e0a0 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83cffff640 1 -- 10.20.193.28:0/2423765137 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f83e0004480 con 0x7f83f810e0a0 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83cffff640 1 -- 10.20.193.28:0/2423765137 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e000fb50 con 0x7f83f810e0a0 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.001+0000 7f83f7fff640 1 -- 10.20.193.28:0/2423765137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f81a6460 con 0x7f83f810e0a0 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.002+0000 7f83f7fff640 1 -- 10.20.193.28:0/2423765137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f81b26b0 con 0x7f83f810e0a0 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.005+0000 7f83ff8bbe00 1 Processor -- start 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.005+0000 7f83ff8bbe00 1 -- start start 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.005+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e834d000 0x5635e834d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.005+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e8347630 0x5635e8347a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.005+0000 7f83cffff640 1 -- 10.20.193.28:0/2423765137 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f83e0002780 con 0x7f83f810e0a0 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.005+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8353e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.005+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635e82c7e50 con 0x5635e8347fb0 2026-02-20T03:17:20.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.005+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5635e829a9c0 con 0x5635e8347630 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.005+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5635e8248240 con 0x5635e834d000 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.006+0000 7f83f67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8353e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.006+0000 7f83f67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8353e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44852/0 (socket says 10.20.193.28:44852) 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.006+0000 7f83f67fc640 1 -- 10.20.193.28:0/3331348214 learned_addr learned my addr 10.20.193.28:0/3331348214 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.006+0000 7f83f67fc640 1 -- 10.20.193.28:0/3331348214 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e834d000 msgr2=0x5635e834d3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.006+0000 7f83f67fc640 1 --2- 10.20.193.28:0/3331348214 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e834d000 0x5635e834d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.006+0000 7f83f67fc640 1 -- 10.20.193.28:0/3331348214 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e8347630 msgr2=0x5635e8347a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.006+0000 7f83f67fc640 1 --2- 10.20.193.28:0/3331348214 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e8347630 0x5635e8347a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.006+0000 7f83f67fc640 1 -- 10.20.193.28:0/3331348214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e825b420 con 0x5635e8347fb0 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.007+0000 7f83f67fc640 1 --2- 10.20.193.28:0/3331348214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8353e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f83e00e85d0 tx=0x7f83e00e8aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6cf2f975d7b059 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.007+0000 7f83cf7fe640 1 -- 10.20.193.28:0/3331348214 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00f4070 con 0x5635e8347fb0 2026-02-20T03:17:20.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.007+0000 7f83cf7fe640 1 -- 10.20.193.28:0/3331348214 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f83e00e24e0 con 0x5635e8347fb0 2026-02-20T03:17:20.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.008+0000 7f83cf7fe640 1 -- 10.20.193.28:0/3331348214 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00e6ad0 con 0x5635e8347fb0 2026-02-20T03:17:20.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.009+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3331348214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 msgr2=0x5635e8353e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.009+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/3331348214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8353e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f83e00e85d0 tx=0x7f83e00e8aa0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.009+0000 7f83cffff640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83c80b0f70 0x7f83c80b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.009+0000 7f83cffff640 1 -- 10.20.193.28:0/2423765137 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f83e00e0450 con 0x7f83f810e0a0 2026-02-20T03:17:20.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.015+0000 7f83f77fe640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83c80b0f70 0x7f83c80b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.015+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3331348214 shutdown_connections 2026-02-20T03:17:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.015+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/3331348214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8353e30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.015+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/3331348214 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e8347630 0x5635e8347a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.015+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/3331348214 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e834d000 0x5635e834d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.015+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3331348214 >> 10.20.193.28:0/3331348214 conn(0x5635e830a290 msgr2=0x5635e8345d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:20.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.016+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3331348214 shutdown_connections 2026-02-20T03:17:20.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.016+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3331348214 wait complete. 2026-02-20T03:17:20.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.017+0000 7f83ff8bbe00 1 -- start start 2026-02-20T03:17:20.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.017+0000 7f83ff8bbe00 1 Processor -- start 2026-02-20T03:17:20.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.017+0000 7f83f77fe640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83c80b0f70 0x7f83c80b3430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83e800a9b0 tx=0x7f83e8009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:20.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e836a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83f6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e836a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83f6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e836a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44868/0 (socket says 10.20.193.28:44868) 2026-02-20T03:17:20.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347fb0 0x5635e836aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e834d000 0x5635e83690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635e82968f0 con 0x5635e8347630 2026-02-20T03:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5635e8088f50 con 0x5635e834d000 2026-02-20T03:17:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5635e8369850 con 0x5635e8347fb0 2026-02-20T03:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83f6ffd640 1 -- 10.20.193.28:0/2083712635 learned_addr learned my addr 10.20.193.28:0/2083712635 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.018+0000 7f83f67fc640 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347fb0 0x5635e836aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.019+0000 7f83f77fe640 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e834d000 0x5635e83690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.019+0000 7f83f67fc640 1 -- 10.20.193.28:0/2083712635 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e834d000 msgr2=0x5635e83690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.019+0000 7f83f67fc640 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e834d000 0x5635e83690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.019+0000 7f83f67fc640 1 -- 10.20.193.28:0/2083712635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 msgr2=0x5635e836a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.019+0000 7f83f67fc640 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e836a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.019+0000 7f83f67fc640 1 -- 10.20.193.28:0/2083712635 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e8362530 con 0x5635e8347fb0 2026-02-20T03:17:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.020+0000 7f83f67fc640 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347fb0 0x5635e836aed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83e00a3f60 tx=0x7f83e000f510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb7283c1c8ab033 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:20.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.020+0000 7f83ccff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:17:20.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.020+0000 7f83ccff9640 1 -- 10.20.193.28:0/2083712635 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00a3da0 con 0x5635e8347fb0 2026-02-20T03:17:20.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.020+0000 7f83ccff9640 1 -- 10.20.193.28:0/2083712635 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f83e00a8830 con 0x5635e8347fb0 2026-02-20T03:17:20.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.020+0000 7f83ccff9640 1 -- 10.20.193.28:0/2083712635 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00a7650 con 0x5635e8347fb0 2026-02-20T03:17:20.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.020+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/2083712635 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635e806bb40 con 0x5635e8347fb0 2026-02-20T03:17:20.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.021+0000 7f83ccff9640 1 -- 10.20.193.28:0/2083712635 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f83e00e0120 con 0x5635e8347fb0 2026-02-20T03:17:20.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.021+0000 7f83ccff9640 10 client.25765 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:17:20.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.021+0000 7f83ff8bbe00 10 client.25765 _ll_register_callbacks cb 0x5635e82d3f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:20.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.021+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/2083712635 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635e82a81a0 con 0x5635e8347fb0 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.021+0000 7f83ccff9640 1 -- 10.20.193.28:0/2083712635 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f83e00a7830 con 0x5635e8347fb0 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.021+0000 7f83ff8bbe00 10 client.25765 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.021+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/2083712635 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5635e8255230 con 0x5635e8347fb0 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.022+0000 7f83ccff9640 1 -- 10.20.193.28:0/2083712635 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f83e00ac0a0 con 0x5635e8347fb0 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.022+0000 7f83ff8bbe00 10 client.25765 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.022+0000 7f83ff8bbe00 10 client.25765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.022+0000 7f83ff8bbe00 20 client.25765 populate_metadata read hostname 'trial028' 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.022+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635e8379220 0x5635e837b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.022+0000 7f83ff8bbe00 4 client.25765 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.022+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/2083712635 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635e82a25b0 con 0x5635e8379220 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.022+0000 7f83f6ffd640 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635e8379220 0x5635e837b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.023+0000 7f83f6ffd640 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635e8379220 0x5635e837b6e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2f2b5e46d3f464c server_cookie=946b47ac4cb26126 in_seq=0 out_seq=0 2026-02-20T03:17:20.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.023+0000 7f83ccff9640 10 client.25765 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:20.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.023+0000 7f83ccff9640 1 -- 10.20.193.28:0/2083712635 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5635e82a25b0 con 0x5635e8379220 2026-02-20T03:17:20.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.023+0000 7f83ccff9640 10 client.25765 handle_command_reply: tid=0 2026-02-20T03:17:20.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.023+0000 7f83ff8bbe00 1 client.25765 shutdown 2026-02-20T03:17:20.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/2083712635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347fb0 msgr2=0x5635e836aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347fb0 0x5635e836aed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83e00a3f60 tx=0x7f83e000f510 comp rx=0 tx=0).stop 2026-02-20T03:17:20.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/2083712635 shutdown_connections 2026-02-20T03:17:20.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635e8379220 0x5635e837b6e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e834d000 0x5635e83690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347fb0 0x5635e836aed0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/2083712635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e836a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/2083712635 >> 10.20.193.28:0/2083712635 conn(0x5635e830a290 msgr2=0x5635e8346440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:20.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ccff9640 0 client.25765 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:20.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/2083712635 shutdown_connections 2026-02-20T03:17:20.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/2083712635 wait complete. 2026-02-20T03:17:20.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.024+0000 7f83ff8bbe00 20 client.25765 trim_cache size 0 max 16384 2026-02-20T03:17:20.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83ff8bbe00 1 Processor -- start 2026-02-20T03:17:20.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83ff8bbe00 1 -- start start 2026-02-20T03:17:20.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347630 0x5635e8366990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8346520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e834d000 0x5635e8346a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f83980126a0 con 0x5635e8347fb0 2026-02-20T03:17:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f839800ff70 con 0x5635e834d000 2026-02-20T03:17:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f839800ddc0 con 0x5635e8347630 2026-02-20T03:17:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83f67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8346520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83f67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8346520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44872/0 (socket says 10.20.193.28:44872) 2026-02-20T03:17:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.029+0000 7f83f67fc640 1 -- 10.20.193.28:0/3477588055 learned_addr learned my addr 10.20.193.28:0/3477588055 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f67fc640 1 -- 10.20.193.28:0/3477588055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347630 msgr2=0x5635e8366990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:20.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f67fc640 1 --2- 10.20.193.28:0/3477588055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347630 0x5635e8366990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f67fc640 1 -- 10.20.193.28:0/3477588055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e834d000 msgr2=0x5635e8346a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f67fc640 1 --2- 10.20.193.28:0/3477588055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e834d000 0x5635e8346a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f67fc640 1 -- 10.20.193.28:0/3477588055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e8362360 con 0x5635e8347fb0 2026-02-20T03:17:20.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f67fc640 1 --2- 10.20.193.28:0/3477588055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8346520 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f83e00e03c0 tx=0x5635e836a3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4caba221fd97a65 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:20.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ceffd640 1 -- 10.20.193.28:0/3477588055 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00a7f00 con 0x5635e8347fb0 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ceffd640 1 -- 10.20.193.28:0/3477588055 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5635e82a81a0 con 0x5635e8347fb0 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ceffd640 1 -- 10.20.193.28:0/3477588055 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00b1390 con 0x5635e8347fb0 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3477588055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 msgr2=0x5635e8346520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/3477588055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8346520 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f83e00e03c0 tx=0x5635e836a3d0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3477588055 shutdown_connections 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/3477588055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e834d000 0x5635e8346a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/3477588055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347fb0 0x5635e8346520 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/3477588055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e8347630 0x5635e8366990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3477588055 >> 10.20.193.28:0/3477588055 conn(0x5635e830a290 msgr2=0x5635e836a990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:20.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3477588055 shutdown_connections 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/3477588055 wait complete. 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 -- start start 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 Processor -- start 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e8371a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e8347fb0 0x5635e8371f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e834d000 0x5635e8372480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f839800e430 con 0x5635e8347630 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f839800f8a0 con 0x5635e8347fb0 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ff8bbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f839800eb00 con 0x5635e834d000 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e8371a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e8371a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44878/0 (socket says 10.20.193.28:44878) 2026-02-20T03:17:20.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f6ffd640 1 -- 10.20.193.28:0/1487368793 learned_addr learned my addr 10.20.193.28:0/1487368793 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f6ffd640 1 -- 10.20.193.28:0/1487368793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e834d000 msgr2=0x5635e8372480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f6ffd640 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e834d000 0x5635e8372480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f6ffd640 1 -- 10.20.193.28:0/1487368793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e8347fb0 msgr2=0x5635e8371f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f6ffd640 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e8347fb0 0x5635e8371f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f6ffd640 1 -- 10.20.193.28:0/1487368793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635e836f800 con 0x5635e8347630 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83f6ffd640 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e8371a00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009a30 tx=0x7f83ec005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5527c7a9f8ad1316 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ccff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.035+0000 7f83ccff9640 1 -- 10.20.193.28:0/1487368793 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec02fd90 con 0x5635e8347630 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ccff9640 1 -- 10.20.193.28:0/1487368793 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f83ec033040 con 0x5635e8347630 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ccff9640 1 -- 10.20.193.28:0/1487368793 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec038b00 con 0x5635e8347630 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/1487368793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635e7f79870 con 0x5635e8347630 2026-02-20T03:17:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ccff9640 1 -- 10.20.193.28:0/1487368793 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f83ec038ca0 con 0x5635e8347630 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ccff9640 10 client.15753 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ff8bbe00 10 client.15753 _ll_register_callbacks cb 0x7f83e00f2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/1487368793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635e824cb00 con 0x5635e8347630 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ccff9640 1 -- 10.20.193.28:0/1487368793 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f83ec050060 con 0x5635e8347630 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ff8bbe00 10 client.15753 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.040+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/1487368793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5635e823a440 con 0x5635e8347630 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.042+0000 7f83ccff9640 1 -- 10.20.193.28:0/1487368793 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f83ec0026e0 con 0x5635e8347630 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.042+0000 7f83ff8bbe00 10 client.15753 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.042+0000 7f83ff8bbe00 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.042+0000 7f83ff8bbe00 20 client.15753 populate_metadata read hostname 'trial028' 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.042+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635e83e4400 0x5635e83e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.042+0000 7f83ff8bbe00 4 client.15753 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:17:20.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.042+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/1487368793 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f83e00e24e0 con 0x5635e83e4400 2026-02-20T03:17:20.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.045+0000 7f83f67fc640 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635e83e4400 0x5635e83e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.050+0000 7f83f67fc640 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635e83e4400 0x5635e83e68c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c72f6120d26911b2 server_cookie=120f73c0a0b34b52 in_seq=0 out_seq=0 2026-02-20T03:17:20.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.050+0000 7f83ccff9640 10 client.15753 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.050+0000 7f83ccff9640 1 -- 10.20.193.28:0/1487368793 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f83e00e24e0 con 0x5635e83e4400 2026-02-20T03:17:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.050+0000 7f83ccff9640 10 client.15753 handle_command_reply: tid=0 2026-02-20T03:17:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.050+0000 7f83ff8bbe00 1 client.15753 shutdown 2026-02-20T03:17:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/1487368793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 msgr2=0x5635e8371a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e8371a00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009a30 tx=0x7f83ec005b00 comp rx=0 tx=0).stop 2026-02-20T03:17:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/1487368793 shutdown_connections 2026-02-20T03:17:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635e83e4400 0x5635e83e68c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635e834d000 0x5635e8372480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635e8347fb0 0x5635e8371f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 --2- 10.20.193.28:0/1487368793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635e8347630 0x5635e8371a00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/1487368793 >> 10.20.193.28:0/1487368793 conn(0x5635e830a290 msgr2=0x5635e83677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:20.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ccff9640 0 client.15753 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/1487368793 shutdown_connections 2026-02-20T03:17:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 1 -- 10.20.193.28:0/1487368793 wait complete. 2026-02-20T03:17:20.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.051+0000 7f83ff8bbe00 20 client.15753 trim_cache size 0 max 16384 2026-02-20T03:17:20.056 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:17:20.056 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:17:20.056 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:17:20.056 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:17:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.052+0000 7f83f7fff640 1 -- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83c80b0f70 msgr2=0x7f83c80b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.052+0000 7f83f7fff640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83c80b0f70 0x7f83c80b3430 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83e800a9b0 tx=0x7f83e8009230 comp rx=0 tx=0).stop 2026-02-20T03:17:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.052+0000 7f83f7fff640 1 -- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810e0a0 msgr2=0x7f83f81abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.052+0000 7f83f7fff640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810e0a0 0x7f83f81abd20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f83e000b570 tx=0x7f83e000ba40 comp rx=0 tx=0).stop 2026-02-20T03:17:20.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.053+0000 7f83f7fff640 1 -- 10.20.193.28:0/2423765137 shutdown_connections 2026-02-20T03:17:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.053+0000 7f83f7fff640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83c80b0f70 0x7f83c80b3430 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.053+0000 7f83f7fff640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f83f8112700 0x7f83f81a59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.053+0000 7f83f7fff640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f83f810e0a0 0x7f83f81abd20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.053+0000 7f83f7fff640 1 --2- 10.20.193.28:0/2423765137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f83f810d6f0 0x7f83f81ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.053+0000 7f83f7fff640 1 -- 10.20.193.28:0/2423765137 >> 10.20.193.28:0/2423765137 conn(0x7f83f806d500 msgr2=0x7f83f810b780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.053+0000 7f83f7fff640 1 -- 10.20.193.28:0/2423765137 shutdown_connections 2026-02-20T03:17:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.053+0000 7f83f7fff640 1 -- 10.20.193.28:0/2423765137 wait complete. 2026-02-20T03:17:20.206 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:17:20.206 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:17:20.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167199 17.35 MB/sec warmup 53 sec latency 9821.865 ms 2026-02-20T03:17:20.552 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:20.671 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:20 trial028 ceph-mon[38552]: pgmap v260: 129 pgs: 129 active+clean; 56 MiB data, 732 MiB used, 8.2 TiB / 8.2 TiB avail; 241 KiB/s rd, 3.9 MiB/s wr, 327 op/s 2026-02-20T03:17:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:20 trial177 ceph-mon[43181]: pgmap v260: 129 pgs: 129 active+clean; 56 MiB data, 732 MiB used, 8.2 TiB / 8.2 TiB avail; 241 KiB/s rd, 3.9 MiB/s wr, 327 op/s 2026-02-20T03:17:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.811+0000 7fba75215640 1 -- 10.20.193.28:0/2032722125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101f90 msgr2=0x7fba70106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.811+0000 7fba75215640 1 --2- 10.20.193.28:0/2032722125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101f90 0x7fba70106460 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fba60009a30 tx=0x7fba6002f2f0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.811+0000 7fba75215640 1 -- 10.20.193.28:0/2032722125 shutdown_connections 2026-02-20T03:17:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.811+0000 7fba75215640 1 --2- 10.20.193.28:0/2032722125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba70106a80 0x7fba70106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.811+0000 7fba75215640 1 --2- 10.20.193.28:0/2032722125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101f90 0x7fba70106460 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.811+0000 7fba75215640 1 --2- 10.20.193.28:0/2032722125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba70101670 0x7fba70101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.811+0000 7fba75215640 1 -- 10.20.193.28:0/2032722125 >> 10.20.193.28:0/2032722125 conn(0x7fba700fd2e0 msgr2=0x7fba700ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.811+0000 7fba75215640 1 -- 10.20.193.28:0/2032722125 shutdown_connections 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.811+0000 7fba75215640 1 -- 10.20.193.28:0/2032722125 wait complete. 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 Processor -- start 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 -- start start 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101670 0x7fba701a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba70101f90 0x7fba701a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba70106a80 0x7fba701a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fba701191d0 con 0x7fba70101670 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fba70119050 con 0x7fba70101f90 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fba70119350 con 0x7fba70106a80 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101670 0x7fba701a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101670 0x7fba701a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44896/0 (socket says 10.20.193.28:44896) 2026-02-20T03:17:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6ffff640 1 -- 10.20.193.28:0/1417265492 learned_addr learned my addr 10.20.193.28:0/1417265492 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6ffff640 1 -- 10.20.193.28:0/1417265492 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba70106a80 msgr2=0x7fba701a5fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6ffff640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba70106a80 0x7fba701a5fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6ffff640 1 -- 10.20.193.28:0/1417265492 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba70101f90 msgr2=0x7fba701a1c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6ffff640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba70101f90 0x7fba701a1c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6ffff640 1 -- 10.20.193.28:0/1417265492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba701a6740 con 0x7fba70101670 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6ffff640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101670 0x7fba701a16f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00b570 tx=0x7fba5c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6d7fa640 1 -- 10.20.193.28:0/1417265492 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c013020 con 0x7fba70101670 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6d7fa640 1 -- 10.20.193.28:0/1417265492 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fba5c004480 con 0x7fba70101670 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba701a6a30 con 0x7fba70101670 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6d7fa640 1 -- 10.20.193.28:0/1417265492 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c00fb50 con 0x7fba70101670 2026-02-20T03:17:20.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba701ae270 con 0x7fba70101670 2026-02-20T03:17:20.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba701064e0 con 0x7fba70101670 2026-02-20T03:17:20.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6d7fa640 1 -- 10.20.193.28:0/1417265492 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fba5c002780 con 0x7fba70101670 2026-02-20T03:17:20.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6d7fa640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba440b0da0 0x7fba440b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:20.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6d7fa640 1 -- 10.20.193.28:0/1417265492 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7fba5c0e0ca0 con 0x7fba70101670 2026-02-20T03:17:20.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6f7fe640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba440b0da0 0x7fba440b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:20.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6d7fa640 1 -- 10.20.193.28:0/1417265492 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fba5c01d020 con 0x7fba70101670 2026-02-20T03:17:20.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.813+0000 7fba6f7fe640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba440b0da0 0x7fba440b3260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fba60009950 tx=0x7fba600023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:20.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:20 trial126 ceph-mon[38476]: pgmap v260: 129 pgs: 129 active+clean; 56 MiB data, 732 MiB used, 8.2 TiB / 8.2 TiB avail; 241 KiB/s rd, 3.9 MiB/s wr, 327 op/s 2026-02-20T03:17:20.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.928+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba701a2a50 con 0x7fba70101670 2026-02-20T03:17:20.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.928+0000 7fba6d7fa640 1 -- 10.20.193.28:0/1417265492 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11924 (secure 0 0 0) 0x7fba5c0a9080 con 0x7fba70101670 2026-02-20T03:17:20.931 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:17:20.933 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":24,"btime":"2026-02-20T03:15:38:113153+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:15:37.375812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24523":{"gid":24523,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3933107687","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3933107687},{"type":"v1","addr":"10.20.193.177:6837","nonce":3933107687}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:17:20.934 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 24 2026-02-20T03:17:20.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba440b0da0 msgr2=0x7fba440b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba440b0da0 0x7fba440b3260 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fba60009950 tx=0x7fba600023d0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101670 msgr2=0x7fba701a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101670 0x7fba701a16f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fba5c00b570 tx=0x7fba5c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 shutdown_connections 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba440b0da0 0x7fba440b3260 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba70106a80 0x7fba701a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba70101f90 0x7fba701a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 --2- 10.20.193.28:0/1417265492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba70101670 0x7fba701a16f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 >> 10.20.193.28:0/1417265492 conn(0x7fba700fd2e0 msgr2=0x7fba70104380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:20.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 shutdown_connections 2026-02-20T03:17:20.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:20.929+0000 7fba75215640 1 -- 10.20.193.28:0/1417265492 wait complete. 2026-02-20T03:17:21.090 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:17:21.404 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:21.442 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:21 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1417265492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:21.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 17.03 MB/sec warmup 54 sec latency 10110.227 ms 2026-02-20T03:17:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.649+0000 7f1b92841640 1 -- 10.20.193.28:0/3999889953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c100780 msgr2=0x7f1b8c100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.649+0000 7f1b92841640 1 --2- 10.20.193.28:0/3999889953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c100780 0x7f1b8c100bc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009960 tx=0x7f1b8002f1d0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.649+0000 7f1b92841640 1 -- 10.20.193.28:0/3999889953 shutdown_connections 2026-02-20T03:17:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.649+0000 7f1b92841640 1 --2- 10.20.193.28:0/3999889953 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b8c101100 0x7f1b8c10f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.649+0000 7f1b92841640 1 --2- 10.20.193.28:0/3999889953 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c100780 0x7f1b8c100bc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.649+0000 7f1b92841640 1 --2- 10.20.193.28:0/3999889953 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b8c107830 0x7f1b8c107c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.649+0000 7f1b92841640 1 -- 10.20.193.28:0/3999889953 >> 10.20.193.28:0/3999889953 conn(0x7f1b8c0fc5f0 msgr2=0x7f1b8c0fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.649+0000 7f1b92841640 1 -- 10.20.193.28:0/3999889953 shutdown_connections 2026-02-20T03:17:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.649+0000 7f1b92841640 1 -- 10.20.193.28:0/3999889953 wait complete. 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b92841640 1 Processor -- start 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b92841640 1 -- start start 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b92841640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b8c100780 0x7f1b8c19cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b92841640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c101100 0x7f1b8c19d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b92841640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b8c107830 0x7f1b8c1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b92841640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c112980 con 0x7f1b8c101100 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b92841640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c112800 con 0x7f1b8c100780 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b92841640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c112b00 con 0x7f1b8c107830 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b9103e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c101100 0x7f1b8c19d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b9103e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c101100 0x7f1b8c19d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44918/0 (socket says 10.20.193.28:44918) 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b9103e640 1 -- 10.20.193.28:0/3431528772 learned_addr learned my addr 10.20.193.28:0/3431528772 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b9103e640 1 -- 10.20.193.28:0/3431528772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b8c107830 msgr2=0x7f1b8c1a18b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b9103e640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b8c107830 0x7f1b8c1a18b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b9103e640 1 -- 10.20.193.28:0/3431528772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b8c100780 msgr2=0x7f1b8c19cfe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b9103e640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b8c100780 0x7f1b8c19cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b9103e640 1 -- 10.20.193.28:0/3431528772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c1a2030 con 0x7f1b8c101100 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b9103e640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c101100 0x7f1b8c19d520 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b8002f6e0 tx=0x7f1b80004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b7affd640 1 -- 10.20.193.28:0/3431528772 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800029f0 con 0x7f1b8c101100 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b92841640 1 -- 10.20.193.28:0/3431528772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c1a22c0 con 0x7f1b8c101100 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.650+0000 7f1b7affd640 1 -- 10.20.193.28:0/3431528772 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b800054c0 con 0x7f1b8c101100 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b7affd640 1 -- 10.20.193.28:0/3431528772 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800386b0 con 0x7f1b8c101100 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b92841640 1 -- 10.20.193.28:0/3431528772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c1a9b60 con 0x7f1b8c101100 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b7affd640 1 -- 10.20.193.28:0/3431528772 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1b80038910 con 0x7f1b8c101100 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 Processor -- start 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 -- start start 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550fefb0 0x55f7550ff390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f95e0 0x55f7550f9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f755105de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f755079e00 con 0x55f7550f9f60 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f75504c970 con 0x55f7550fefb0 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f754ffa1f0 con 0x55f7550f95e0 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b9103e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f755105de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b9103e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f755105de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44928/0 (socket says 10.20.193.28:44928) 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b9103e640 1 -- 10.20.193.28:0/3059002996 learned_addr learned my addr 10.20.193.28:0/3059002996 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b9103e640 1 -- 10.20.193.28:0/3059002996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f95e0 msgr2=0x55f7550f9a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b9103e640 1 --2- 10.20.193.28:0/3059002996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f95e0 0x55f7550f9a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b9103e640 1 -- 10.20.193.28:0/3059002996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550fefb0 msgr2=0x55f7550ff390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:21.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b9103e640 1 --2- 10.20.193.28:0/3059002996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550fefb0 0x55f7550ff390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b9103e640 1 -- 10.20.193.28:0/3059002996 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75500d3d0 con 0x55f7550f9f60 2026-02-20T03:17:21.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b9103e640 1 --2- 10.20.193.28:0/3059002996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f755105de0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1b8010d110 tx=0x7f1b8010d210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3182e093c8c15cde server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:21.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b5a4e6640 1 -- 10.20.193.28:0/3059002996 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8010de60 con 0x55f7550f9f60 2026-02-20T03:17:21.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b5a4e6640 1 -- 10.20.193.28:0/3059002996 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b80112070 con 0x55f7550f9f60 2026-02-20T03:17:21.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b5a4e6640 1 -- 10.20.193.28:0/3059002996 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80115780 con 0x55f7550f9f60 2026-02-20T03:17:21.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/3059002996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 msgr2=0x55f755105de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:21.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/3059002996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f755105de0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1b8010d110 tx=0x7f1b8010d210 comp rx=0 tx=0).stop 2026-02-20T03:17:21.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b7affd640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b680b0da0 0x7f1b680b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b7affd640 1 -- 10.20.193.28:0/3431528772 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f1b80104fe0 con 0x7f1b8c101100 2026-02-20T03:17:21.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/3059002996 shutdown_connections 2026-02-20T03:17:21.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/3059002996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f755105de0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/3059002996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f95e0 0x55f7550f9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/3059002996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550fefb0 0x55f7550ff390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/3059002996 >> 10.20.193.28:0/3059002996 conn(0x55f7550bc240 msgr2=0x55f7550f7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/3059002996 shutdown_connections 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b92040640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b680b0da0 0x7f1b680b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.652+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/3059002996 wait complete. 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b92040640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b680b0da0 0x7f1b680b3260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1b880060b0 tx=0x7f1b88006040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 -- start start 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 Processor -- start 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f95e0 0x55f755113c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f7551141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550fefb0 0x55f7551123d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f7550488a0 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f754e3af50 con 0x55f7550fefb0 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f755112b50 con 0x55f7550f95e0 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b9103e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f7551141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b9103e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f7551141d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44942/0 (socket says 10.20.193.28:44942) 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b9103e640 1 -- 10.20.193.28:0/260567017 learned_addr learned my addr 10.20.193.28:0/260567017 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b9103e640 1 -- 10.20.193.28:0/260567017 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f95e0 msgr2=0x55f755113c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b9103e640 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f95e0 0x55f755113c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b9103e640 1 -- 10.20.193.28:0/260567017 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550fefb0 msgr2=0x55f7551123d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b9103e640 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550fefb0 0x55f7551123d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b9103e640 1 -- 10.20.193.28:0/260567017 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75510b840 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b9103e640 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f7551141d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1b800057e0 tx=0x7f1b80047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd39e45952c6017 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b477fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b477fe640 1 -- 10.20.193.28:0/260567017 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800c9880 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b477fe640 1 -- 10.20.193.28:0/260567017 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b80033070 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b477fe640 1 -- 10.20.193.28:0/260567017 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800cd130 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/260567017 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f754e1db40 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b477fe640 1 -- 10.20.193.28:0/260567017 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f1b8010dc60 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 10 client.15771 _ll_register_callbacks cb 0x55f755085eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/260567017 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f75505a150 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b477fe640 1 -- 10.20.193.28:0/260567017 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b800cd310 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 10 client.15771 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.658+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/260567017 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55f7550071e0 con 0x55f7550f9f60 2026-02-20T03:17:21.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.660+0000 7f1b477fe640 1 -- 10.20.193.28:0/260567017 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f1b801080a0 con 0x55f7550f9f60 2026-02-20T03:17:21.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.660+0000 7f1b95fcfe00 10 client.15771 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:21.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.660+0000 7f1b95fcfe00 10 client.15771 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:17:21.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.660+0000 7f1b95fcfe00 20 client.15771 populate_metadata read hostname 'trial028' 2026-02-20T03:17:21.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.660+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f755121fa0 0x55f755124460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.660+0000 7f1b95fcfe00 4 client.15771 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:21.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.660+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/260567017 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f755054560 con 0x55f755121fa0 2026-02-20T03:17:21.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.661+0000 7f1b9183f640 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f755121fa0 0x55f755124460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:21.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.675+0000 7f1b9183f640 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f755121fa0 0x55f755124460 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=75167606d6e5735f server_cookie=6f30d7f5a2a2c7c3 in_seq=0 out_seq=0 2026-02-20T03:17:21.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.675+0000 7f1b477fe640 10 client.15771 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:17:21.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.689+0000 7f1b477fe640 1 -- 10.20.193.28:0/260567017 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f755054560 con 0x55f755121fa0 2026-02-20T03:17:21.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.689+0000 7f1b477fe640 10 client.15771 handle_command_reply: tid=0 2026-02-20T03:17:21.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.689+0000 7f1b95fcfe00 1 client.15771 shutdown 2026-02-20T03:17:21.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.689+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/260567017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 msgr2=0x55f7551141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:21.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.689+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f7551141d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1b800057e0 tx=0x7f1b80047000 comp rx=0 tx=0).stop 2026-02-20T03:17:21.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/260567017 shutdown_connections 2026-02-20T03:17:21.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550fefb0 0x55f7551123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f755121fa0 0x55f755124460 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f7551141d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/260567017 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f95e0 0x55f755113c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/260567017 >> 10.20.193.28:0/260567017 conn(0x55f7550bc240 msgr2=0x55f7550f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:21.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b477fe640 0 client.15771 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:17:21.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/260567017 shutdown_connections 2026-02-20T03:17:21.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/260567017 wait complete. 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.690+0000 7f1b95fcfe00 20 client.15771 trim_cache size 0 max 16384 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 Processor -- start 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- start start 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550f95e0 0x55f75511ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f9f60 0x55f755110ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550fefb0 0x55f7550f84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b380127c0 con 0x55f7550fefb0 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b38010090 con 0x55f7550f95e0 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3800dee0 con 0x55f7550f9f60 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b92040640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550fefb0 0x55f7550f84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b92040640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550fefb0 0x55f7550f84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44944/0 (socket says 10.20.193.28:44944) 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b92040640 1 -- 10.20.193.28:0/692505620 learned_addr learned my addr 10.20.193.28:0/692505620 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b92040640 1 -- 10.20.193.28:0/692505620 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f9f60 msgr2=0x55f755110ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b92040640 1 --2- 10.20.193.28:0/692505620 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f9f60 0x55f755110ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b92040640 1 -- 10.20.193.28:0/692505620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550f95e0 msgr2=0x55f75511ed40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b92040640 1 --2- 10.20.193.28:0/692505620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550f95e0 0x55f75511ed40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b92040640 1 -- 10.20.193.28:0/692505620 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f75510b670 con 0x55f7550fefb0 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b92040640 1 --2- 10.20.193.28:0/692505620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550fefb0 0x55f7550f84d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1b880091d0 tx=0x7f1b8800b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf657446ddda6a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b59ce5640 1 -- 10.20.193.28:0/692505620 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88007e20 con 0x55f7550fefb0 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b59ce5640 1 -- 10.20.193.28:0/692505620 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b880138d0 con 0x55f7550fefb0 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b59ce5640 1 -- 10.20.193.28:0/692505620 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88015980 con 0x55f7550fefb0 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/692505620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550fefb0 msgr2=0x55f7550f84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/692505620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550fefb0 0x55f7550f84d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1b880091d0 tx=0x7f1b8800b050 comp rx=0 tx=0).stop 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/692505620 shutdown_connections 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/692505620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550fefb0 0x55f7550f84d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/692505620 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550f9f60 0x55f755110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/692505620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550f95e0 0x55f75511ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/692505620 >> 10.20.193.28:0/692505620 conn(0x55f7550bc240 msgr2=0x55f755122bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/692505620 shutdown_connections 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/692505620 wait complete. 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- start start 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 Processor -- start 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550f95e0 0x55f75511d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f75511df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550fefb0 0x55f75518f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3800e550 con 0x55f7550f9f60 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3800f9c0 con 0x55f7550f95e0 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3800ec20 con 0x55f7550fefb0 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b9103e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f75511df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b9103e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f75511df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44946/0 (socket says 10.20.193.28:44946) 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b9103e640 1 -- 10.20.193.28:0/1263449054 learned_addr learned my addr 10.20.193.28:0/1263449054 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b9103e640 1 -- 10.20.193.28:0/1263449054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550fefb0 msgr2=0x55f75518f900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b9103e640 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550fefb0 0x55f75518f900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b9103e640 1 -- 10.20.193.28:0/1263449054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550f95e0 msgr2=0x55f75511d9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b9103e640 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550f95e0 0x55f75511d9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b9103e640 1 -- 10.20.193.28:0/1263449054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f754d2b870 con 0x55f7550f9f60 2026-02-20T03:17:21.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b9103e640 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f75511df30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1b80002410 tx=0x7f1b80105260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a172eda47af7234 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b477fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b477fe640 1 -- 10.20.193.28:0/1263449054 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800cd9e0 con 0x55f7550f9f60 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b477fe640 1 -- 10.20.193.28:0/1263449054 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b80033030 con 0x55f7550f9f60 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/1263449054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f754fec3f0 con 0x55f7550f9f60 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b477fe640 1 -- 10.20.193.28:0/1263449054 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80108c00 con 0x55f7550f9f60 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 10 client.15777 _ll_register_callbacks cb 0x7f1b80108e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/1263449054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f754ffeab0 con 0x55f7550f9f60 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b477fe640 1 -- 10.20.193.28:0/1263449054 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f1b8010dc60 con 0x55f7550f9f60 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b477fe640 1 -- 10.20.193.28:0/1263449054 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b80004970 con 0x55f7550f9f60 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 10 client.15777 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/1263449054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55f75510c360 con 0x55f7550f9f60 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.697+0000 7f1b477fe640 1 -- 10.20.193.28:0/1263449054 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f1b800cd4d0 con 0x55f7550f9f60 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.702+0000 7f1b95fcfe00 10 client.15777 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.702+0000 7f1b95fcfe00 10 client.15777 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.702+0000 7f1b95fcfe00 20 client.15777 populate_metadata read hostname 'trial028' 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.702+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f755196e30 0x55f7551992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.702+0000 7f1b95fcfe00 4 client.15777 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.702+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/1263449054 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f1b880138d0 con 0x55f755196e30 2026-02-20T03:17:21.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.703+0000 7f1b9183f640 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f755196e30 0x55f7551992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:21 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1417265492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:21.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.731+0000 7f1b9183f640 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f755196e30 0x55f7551992c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a09bccc9a6d700ae server_cookie=47cde12b1bbd67ae in_seq=0 out_seq=0 2026-02-20T03:17:21.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.731+0000 7f1b477fe640 10 client.15777 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:17:21.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b477fe640 1 -- 10.20.193.28:0/1263449054 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f1b880138d0 con 0x55f755196e30 2026-02-20T03:17:21.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b477fe640 10 client.15777 handle_command_reply: tid=0 2026-02-20T03:17:21.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 client.15777 shutdown 2026-02-20T03:17:21.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/1263449054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 msgr2=0x55f75511df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:21.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f75511df30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1b80002410 tx=0x7f1b80105260 comp rx=0 tx=0).stop 2026-02-20T03:17:21.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/1263449054 shutdown_connections 2026-02-20T03:17:21.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f7550fefb0 0x55f75518f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f755196e30 0x55f7551992c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f7550f9f60 0x55f75511df30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 --2- 10.20.193.28:0/1263449054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f7550f95e0 0x55f75511d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/1263449054 >> 10.20.193.28:0/1263449054 conn(0x55f7550bc240 msgr2=0x55f7550f74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:21.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b477fe640 0 client.15777 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:17:21.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/1263449054 shutdown_connections 2026-02-20T03:17:21.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.745+0000 7f1b95fcfe00 1 -- 10.20.193.28:0/1263449054 wait complete. 2026-02-20T03:17:21.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b95fcfe00 20 client.15777 trim_cache size 0 max 16384 2026-02-20T03:17:21.749 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:17:21.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 -- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b680b0da0 msgr2=0x7f1b680b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:21.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b680b0da0 0x7f1b680b3260 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1b880060b0 tx=0x7f1b88006040 comp rx=0 tx=0).stop 2026-02-20T03:17:21.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 -- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c101100 msgr2=0x7f1b8c19d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:21.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c101100 0x7f1b8c19d520 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b8002f6e0 tx=0x7f1b80004650 comp rx=0 tx=0).stop 2026-02-20T03:17:21.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 -- 10.20.193.28:0/3431528772 shutdown_connections 2026-02-20T03:17:21.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b680b0da0 0x7f1b680b3260 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b8c107830 0x7f1b8c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b8c101100 0x7f1b8c19d520 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 --2- 10.20.193.28:0/3431528772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b8c100780 0x7f1b8c19cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:21.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 -- 10.20.193.28:0/3431528772 >> 10.20.193.28:0/3431528772 conn(0x7f1b8c0fc5f0 msgr2=0x7f1b8c0fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:21.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 -- 10.20.193.28:0/3431528772 shutdown_connections 2026-02-20T03:17:21.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:21.746+0000 7f1b92841640 1 -- 10.20.193.28:0/3431528772 wait complete. 2026-02-20T03:17:21.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:21 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1417265492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:21.934 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:17:22.228 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:22.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:22 trial028 ceph-mon[38552]: pgmap v261: 129 pgs: 129 active+clean; 52 MiB data, 734 MiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 3.7 MiB/s wr, 299 op/s 2026-02-20T03:17:22.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 16.72 MB/sec warmup 55 sec latency 1711.835 ms 2026-02-20T03:17:22.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.538+0000 7f8f090fd640 1 -- 10.20.193.28:0/786930785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 msgr2=0x7f8f04077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.538+0000 7f8f090fd640 1 --2- 10.20.193.28:0/786930785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 0x7f8f04077a00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009a30 tx=0x7f8ef002f260 comp rx=0 tx=0).stop 2026-02-20T03:17:22.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.539+0000 7f8f090fd640 1 -- 10.20.193.28:0/786930785 shutdown_connections 2026-02-20T03:17:22.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.539+0000 7f8f090fd640 1 --2- 10.20.193.28:0/786930785 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f04113820 0x7f8f04115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.539+0000 7f8f090fd640 1 --2- 10.20.193.28:0/786930785 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f04077f40 0x7f8f041132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.539+0000 7f8f090fd640 1 --2- 10.20.193.28:0/786930785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 0x7f8f04077a00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.539+0000 7f8f090fd640 1 -- 10.20.193.28:0/786930785 >> 10.20.193.28:0/786930785 conn(0x7f8f04100680 msgr2=0x7f8f04102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.539+0000 7f8f090fd640 1 -- 10.20.193.28:0/786930785 shutdown_connections 2026-02-20T03:17:22.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.539+0000 7f8f090fd640 1 -- 10.20.193.28:0/786930785 wait complete. 2026-02-20T03:17:22.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.539+0000 7f8f090fd640 1 Processor -- start 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.539+0000 7f8f090fd640 1 -- start start 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f090fd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 0x7f8f041a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f090fd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f04077f40 0x7f8f041a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f090fd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f04113820 0x7f8f041a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f090fd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f04119170 con 0x7f8f04077620 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f090fd640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f04118ff0 con 0x7f8f04113820 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f090fd640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f041192f0 con 0x7f8f04077f40 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 0x7f8f041a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 0x7f8f041a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44956/0 (socket says 10.20.193.28:44956) 2026-02-20T03:17:22.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f03fff640 1 -- 10.20.193.28:0/67360811 learned_addr learned my addr 10.20.193.28:0/67360811 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f03fff640 1 -- 10.20.193.28:0/67360811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f04077f40 msgr2=0x7f8f041a1b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f03fff640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f04077f40 0x7f8f041a1b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f03fff640 1 -- 10.20.193.28:0/67360811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f04113820 msgr2=0x7f8f041a5f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f03fff640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f04113820 0x7f8f041a5f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f03fff640 1 -- 10.20.193.28:0/67360811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f041a66a0 con 0x7f8f04077620 2026-02-20T03:17:22.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f03fff640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 0x7f8f041a1650 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009a00 tx=0x7f8ef0002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f017fa640 1 -- 10.20.193.28:0/67360811 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0004260 con 0x7f8f04077620 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f017fa640 1 -- 10.20.193.28:0/67360811 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ef0004400 con 0x7f8f04077620 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f017fa640 1 -- 10.20.193.28:0/67360811 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0041950 con 0x7f8f04077620 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f090fd640 1 -- 10.20.193.28:0/67360811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f041a6930 con 0x7f8f04077620 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.540+0000 7f8f090fd640 1 -- 10.20.193.28:0/67360811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f041ae1d0 con 0x7f8f04077620 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.543+0000 7f8f017fa640 1 -- 10.20.193.28:0/67360811 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8ef0038790 con 0x7f8f04077620 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f0c88be00 1 Processor -- start 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f0c88be00 1 -- start start 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 0x560f210d4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 0x560f210cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210dade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f2104ee00 con 0x560f210cef60 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560f21021970 con 0x560f210d3fb0 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560f20fcf1f0 con 0x560f210ce5e0 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210dade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210dade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44962/0 (socket says 10.20.193.28:44962) 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.544+0000 7f8f037fe640 1 -- 10.20.193.28:0/291725859 learned_addr learned my addr 10.20.193.28:0/291725859 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8f037fe640 1 -- 10.20.193.28:0/291725859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 msgr2=0x560f210cea20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8f037fe640 1 --2- 10.20.193.28:0/291725859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 0x560f210cea20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8f037fe640 1 -- 10.20.193.28:0/291725859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 msgr2=0x560f210d4390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8f037fe640 1 --2- 10.20.193.28:0/291725859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 0x560f210d4390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8f037fe640 1 -- 10.20.193.28:0/291725859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f20fe23d0 con 0x560f210cef60 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8f017fa640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ed80b0e20 0x7f8ed80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8f017fa640 1 -- 10.20.193.28:0/67360811 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f8ef0105820 con 0x7f8f04077620 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8f037fe640 1 --2- 10.20.193.28:0/291725859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210dade0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009840 tx=0x7f8ef4009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca86def18f2cbc9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8f088fc640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ed80b0e20 0x7f8ed80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8ed4ce3640 1 -- 10.20.193.28:0/291725859 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4016070 con 0x560f210cef60 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8ed4ce3640 1 -- 10.20.193.28:0/291725859 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ef4004480 con 0x560f210cef60 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.545+0000 7f8ed4ce3640 1 -- 10.20.193.28:0/291725859 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef400bd00 con 0x560f210cef60 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f0c88be00 1 -- 10.20.193.28:0/291725859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 msgr2=0x560f210dade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f088fc640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ed80b0e20 0x7f8ed80b32e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800aab0 tx=0x7f8ef8009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/291725859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210dade0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009840 tx=0x7f8ef4009d10 comp rx=0 tx=0).stop 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f0c88be00 1 -- 10.20.193.28:0/291725859 shutdown_connections 2026-02-20T03:17:22.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/291725859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210dade0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/291725859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 0x560f210cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/291725859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 0x560f210d4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f0c88be00 1 -- 10.20.193.28:0/291725859 >> 10.20.193.28:0/291725859 conn(0x560f21091240 msgr2=0x560f210ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f0c88be00 1 -- 10.20.193.28:0/291725859 shutdown_connections 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.546+0000 7f8f0c88be00 1 -- 10.20.193.28:0/291725859 wait complete. 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.547+0000 7f8f0c88be00 1 -- start start 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.547+0000 7f8f0c88be00 1 Processor -- start 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 0x560f210e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 0x560f210ebf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f2101d8a0 con 0x560f210cef60 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560f20e0ff50 con 0x560f210d3fb0 2026-02-20T03:17:22.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560f210ec460 con 0x560f210ce5e0 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210e7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210e7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44976/0 (socket says 10.20.193.28:44976) 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f037fe640 1 -- 10.20.193.28:0/118429262 learned_addr learned my addr 10.20.193.28:0/118429262 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f037fe640 1 -- 10.20.193.28:0/118429262 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 msgr2=0x560f210e76f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f037fe640 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 0x560f210e76f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f037fe640 1 -- 10.20.193.28:0/118429262 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 msgr2=0x560f210ebf20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f037fe640 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 0x560f210ebf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f037fe640 1 -- 10.20.193.28:0/118429262 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f210e0b70 con 0x560f210cef60 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8f037fe640 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210e7c30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4014040 tx=0x7f8ef400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec5aac44b89c1c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.548+0000 7f8ec5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.549+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/118429262 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4016040 con 0x560f210cef60 2026-02-20T03:17:22.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.549+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/118429262 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ef400b660 con 0x560f210cef60 2026-02-20T03:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.549+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/118429262 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4011ae0 con 0x560f210cef60 2026-02-20T03:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.550+0000 7f8f0c88be00 1 -- 10.20.193.28:0/118429262 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f20df2b40 con 0x560f210cef60 2026-02-20T03:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.550+0000 7f8f0c88be00 10 client.15789 _ll_register_callbacks cb 0x560f2105aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.550+0000 7f8f0c88be00 1 -- 10.20.193.28:0/118429262 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560f2102f150 con 0x560f210cef60 2026-02-20T03:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.550+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/118429262 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f8ef4002780 con 0x560f210cef60 2026-02-20T03:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.550+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/118429262 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8ef402a050 con 0x560f210cef60 2026-02-20T03:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.550+0000 7f8f0c88be00 10 client.15789 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:22.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.550+0000 7f8f0c88be00 1 -- 10.20.193.28:0/118429262 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x560f20fdc1e0 con 0x560f210cef60 2026-02-20T03:17:22.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.551+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/118429262 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f8ef402d020 con 0x560f210cef60 2026-02-20T03:17:22.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.551+0000 7f8f0c88be00 10 client.15789 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:22.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.551+0000 7f8f0c88be00 10 client.15789 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:17:22.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.551+0000 7f8f0c88be00 20 client.15789 populate_metadata read hostname 'trial028' 2026-02-20T03:17:22.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.551+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560f210f7710 0x560f210f9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.551+0000 7f8f0c88be00 4 client.15789 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:22.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.551+0000 7f8f0c88be00 1 -- 10.20.193.28:0/118429262 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f21029560 con 0x560f210f7710 2026-02-20T03:17:22.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.563+0000 7f8f03fff640 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560f210f7710 0x560f210f9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.590+0000 7f8ec5ffb640 10 client.15789 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:17:22.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.590+0000 7f8f03fff640 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560f210f7710 0x560f210f9b00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=45426c5a02a6ada8 server_cookie=d75b751c8d60dd21 in_seq=0 out_seq=0 2026-02-20T03:17:22.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.605+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/118429262 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560f21029560 con 0x560f210f7710 2026-02-20T03:17:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.605+0000 7f8ec5ffb640 10 client.15789 handle_command_reply: tid=0 2026-02-20T03:17:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.605+0000 7f8f0c88be00 1 client.15789 shutdown 2026-02-20T03:17:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.605+0000 7f8f0c88be00 1 -- 10.20.193.28:0/118429262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 msgr2=0x560f210e7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.605+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210e7c30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4014040 tx=0x7f8ef400be00 comp rx=0 tx=0).stop 2026-02-20T03:17:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8f0c88be00 1 -- 10.20.193.28:0/118429262 shutdown_connections 2026-02-20T03:17:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560f210f7710 0x560f210f9b00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 0x560f210ebf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210e7c30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/118429262 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 0x560f210e76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8f0c88be00 1 -- 10.20.193.28:0/118429262 >> 10.20.193.28:0/118429262 conn(0x560f21091240 msgr2=0x560f210cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8ec5ffb640 0 client.15789 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:17:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8f0c88be00 1 -- 10.20.193.28:0/118429262 shutdown_connections 2026-02-20T03:17:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8f0c88be00 1 -- 10.20.193.28:0/118429262 wait complete. 2026-02-20T03:17:22.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.606+0000 7f8f0c88be00 20 client.15789 trim_cache size 0 max 16384 2026-02-20T03:17:22.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f0c88be00 1 Processor -- start 2026-02-20T03:17:22.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f0c88be00 1 -- start start 2026-02-20T03:17:22.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 0x560f210ff290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ff7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 0x560f210e49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8012760 con 0x560f210cef60 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8010030 con 0x560f210d3fb0 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea800de80 con 0x560f210ce5e0 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ff7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ff7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44980/0 (socket says 10.20.193.28:44980) 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.613+0000 7f8f037fe640 1 -- 10.20.193.28:0/3968465641 learned_addr learned my addr 10.20.193.28:0/3968465641 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f037fe640 1 -- 10.20.193.28:0/3968465641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 msgr2=0x560f210ff290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f037fe640 1 --2- 10.20.193.28:0/3968465641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 0x560f210ff290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f037fe640 1 -- 10.20.193.28:0/3968465641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 msgr2=0x560f210e49e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f037fe640 1 --2- 10.20.193.28:0/3968465641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 0x560f210e49e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f037fe640 1 -- 10.20.193.28:0/3968465641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f210e09a0 con 0x560f210cef60 2026-02-20T03:17:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f037fe640 1 --2- 10.20.193.28:0/3968465641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ff7d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4002410 tx=0x7f8ef4023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6253e4395ba560 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8ec7fff640 1 -- 10.20.193.28:0/3968465641 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4016040 con 0x560f210cef60 2026-02-20T03:17:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8ec7fff640 1 -- 10.20.193.28:0/3968465641 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x560f2102f150 con 0x560f210cef60 2026-02-20T03:17:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8ec7fff640 1 -- 10.20.193.28:0/3968465641 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4011a40 con 0x560f210cef60 2026-02-20T03:17:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f0c88be00 1 -- 10.20.193.28:0/3968465641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 msgr2=0x560f210ff7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/3968465641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ff7d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4002410 tx=0x7f8ef4023000 comp rx=0 tx=0).stop 2026-02-20T03:17:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f0c88be00 1 -- 10.20.193.28:0/3968465641 shutdown_connections 2026-02-20T03:17:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/3968465641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210d3fb0 0x560f210e49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/3968465641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ff7d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/3968465641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210ce5e0 0x560f210ff290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.614+0000 7f8f0c88be00 1 -- 10.20.193.28:0/3968465641 >> 10.20.193.28:0/3968465641 conn(0x560f21091240 msgr2=0x560f210e76f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.615+0000 7f8f0c88be00 1 -- 10.20.193.28:0/3968465641 shutdown_connections 2026-02-20T03:17:22.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.615+0000 7f8f0c88be00 1 -- 10.20.193.28:0/3968465641 wait complete. 2026-02-20T03:17:22.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.615+0000 7f8f0c88be00 1 -- start start 2026-02-20T03:17:22.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.615+0000 7f8f0c88be00 1 Processor -- start 2026-02-20T03:17:22.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210ce5e0 0x560f210f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f0c88be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210d3fb0 0x560f210eee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea800e4f0 con 0x560f210cef60 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea800f960 con 0x560f210ce5e0 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f0c88be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea800ebc0 con 0x560f210d3fb0 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f037fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ee900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44982/0 (socket says 10.20.193.28:44982) 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f037fe640 1 -- 10.20.193.28:0/2144234093 learned_addr learned my addr 10.20.193.28:0/2144234093 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f037fe640 1 -- 10.20.193.28:0/2144234093 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210d3fb0 msgr2=0x560f210eee40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f037fe640 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210d3fb0 0x560f210eee40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f037fe640 1 -- 10.20.193.28:0/2144234093 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210ce5e0 msgr2=0x560f210f25e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f037fe640 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210ce5e0 0x560f210f25e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f037fe640 1 -- 10.20.193.28:0/2144234093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f20d00870 con 0x560f210cef60 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8f037fe640 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ee900 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009510 tx=0x7f8ef40092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd640b1030c1614 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.616+0000 7f8ec5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/2144234093 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4016040 con 0x560f210cef60 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/2144234093 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ef4002a50 con 0x560f210cef60 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/2144234093 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef402fa70 con 0x560f210cef60 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8f0c88be00 1 -- 10.20.193.28:0/2144234093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f20fc13f0 con 0x560f210cef60 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/2144234093 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f8ef402fc10 con 0x560f210cef60 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8ec5ffb640 10 client.15795 inactive, discarding osd_map(93..93 src has 1..93) 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8f0c88be00 10 client.15795 _ll_register_callbacks cb 0x7f8ef4014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8f0c88be00 1 -- 10.20.193.28:0/2144234093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560f20ff27c0 con 0x560f210cef60 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/2144234093 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8ef402fe10 con 0x560f210cef60 2026-02-20T03:17:22.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8f0c88be00 10 client.15795 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:22.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.617+0000 7f8f0c88be00 1 -- 10.20.193.28:0/2144234093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x560f210e1690 con 0x560f210cef60 2026-02-20T03:17:22.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.618+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/2144234093 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f8ef4038070 con 0x560f210cef60 2026-02-20T03:17:22.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.618+0000 7f8f0c88be00 10 client.15795 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:22.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.618+0000 7f8f0c88be00 10 client.15795 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:17:22.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.618+0000 7f8f0c88be00 20 client.15795 populate_metadata read hostname 'trial028' 2026-02-20T03:17:22.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.618+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560f21163310 0x560f211657d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.618+0000 7f8f0c88be00 4 client.15795 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:17:22.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.618+0000 7f8f0c88be00 1 -- 10.20.193.28:0/2144234093 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560f20fd3ab0 con 0x560f21163310 2026-02-20T03:17:22.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.619+0000 7f8f03fff640 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560f21163310 0x560f211657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.660+0000 7f8f03fff640 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560f21163310 0x560f211657d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8034ddba9cc0d676 server_cookie=6ce4eace1e55017d in_seq=0 out_seq=0 2026-02-20T03:17:22.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.660+0000 7f8ec5ffb640 10 client.15795 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:17:22.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.660+0000 7f8ec5ffb640 1 -- 10.20.193.28:0/2144234093 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560f20fd3ab0 con 0x560f21163310 2026-02-20T03:17:22.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.660+0000 7f8ec5ffb640 10 client.15795 handle_command_reply: tid=0 2026-02-20T03:17:22.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 client.15795 shutdown 2026-02-20T03:17:22.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 -- 10.20.193.28:0/2144234093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 msgr2=0x560f210ee900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ee900 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009510 tx=0x7f8ef40092e0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 -- 10.20.193.28:0/2144234093 shutdown_connections 2026-02-20T03:17:22.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560f21163310 0x560f211657d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f210d3fb0 0x560f210eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f210cef60 0x560f210ee900 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 --2- 10.20.193.28:0/2144234093 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f210ce5e0 0x560f210f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 -- 10.20.193.28:0/2144234093 >> 10.20.193.28:0/2144234093 conn(0x560f21091240 msgr2=0x560f210e5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8ec5ffb640 0 client.15795 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:17:22.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 -- 10.20.193.28:0/2144234093 shutdown_connections 2026-02-20T03:17:22.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 1 -- 10.20.193.28:0/2144234093 wait complete. 2026-02-20T03:17:22.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.662+0000 7f8f0c88be00 20 client.15795 trim_cache size 0 max 16384 2026-02-20T03:17:22.667 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:17:22.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 -- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ed80b0e20 msgr2=0x7f8ed80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ed80b0e20 0x7f8ed80b32e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800aab0 tx=0x7f8ef8009250 comp rx=0 tx=0).stop 2026-02-20T03:17:22.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 -- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 msgr2=0x7f8f041a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 0x7f8f041a1650 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009a00 tx=0x7f8ef0002910 comp rx=0 tx=0).stop 2026-02-20T03:17:22.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 -- 10.20.193.28:0/67360811 shutdown_connections 2026-02-20T03:17:22.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ed80b0e20 0x7f8ed80b32e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f04113820 0x7f8f041a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f04077f40 0x7f8f041a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 --2- 10.20.193.28:0/67360811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f04077620 0x7f8f041a1650 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 -- 10.20.193.28:0/67360811 >> 10.20.193.28:0/67360811 conn(0x7f8f04100680 msgr2=0x7f8f04113e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 -- 10.20.193.28:0/67360811 shutdown_connections 2026-02-20T03:17:22.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:22.663+0000 7f8f090fd640 1 -- 10.20.193.28:0/67360811 wait complete. 2026-02-20T03:17:22.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.799+0000 7f3d572e1640 1 -- 10.20.193.28:0/3321614110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d501038a0 msgr2=0x7f3d50103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.799+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3321614110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d501038a0 0x7f3d50103d20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009a30 tx=0x7f3d4402f260 comp rx=0 tx=0).stop 2026-02-20T03:17:22.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.799+0000 7f3d572e1640 1 -- 10.20.193.28:0/3321614110 shutdown_connections 2026-02-20T03:17:22.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.799+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3321614110 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d50104260 0x7f3d5010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.799+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3321614110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d501038a0 0x7f3d50103d20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.799+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3321614110 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501026b0 0x7f3d50102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.799+0000 7f3d572e1640 1 -- 10.20.193.28:0/3321614110 >> 10.20.193.28:0/3321614110 conn(0x7f3d500fde10 msgr2=0x7f3d50100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.799+0000 7f3d572e1640 1 -- 10.20.193.28:0/3321614110 shutdown_connections 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.799+0000 7f3d572e1640 1 -- 10.20.193.28:0/3321614110 wait complete. 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d572e1640 1 Processor -- start 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d572e1640 1 -- start start 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d572e1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d501026b0 0x7f3d5019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d572e1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501038a0 0x7f3d5019d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d572e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50104260 0x7f3d501a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d572e1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5010e2c0 con 0x7f3d50104260 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d572e1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5010e140 con 0x7f3d501038a0 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d572e1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5010e440 con 0x7f3d501026b0 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d56ae0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50104260 0x7f3d501a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d56ae0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50104260 0x7f3d501a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45002/0 (socket says 10.20.193.28:45002) 2026-02-20T03:17:22.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.800+0000 7f3d56ae0640 1 -- 10.20.193.28:0/3738284396 learned_addr learned my addr 10.20.193.28:0/3738284396 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d56ae0640 1 -- 10.20.193.28:0/3738284396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d501026b0 msgr2=0x7f3d5019cb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:22.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d56ae0640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d501026b0 0x7f3d5019cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d56ae0640 1 -- 10.20.193.28:0/3738284396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501038a0 msgr2=0x7f3d5019d0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:22.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d56ae0640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501038a0 0x7f3d5019d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d56ae0640 1 -- 10.20.193.28:0/3738284396 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d501a4840 con 0x7f3d50104260 2026-02-20T03:17:22.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d56ae0640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50104260 0x7f3d501a4140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00b990 tx=0x7f3d4c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d377fe640 1 -- 10.20.193.28:0/3738284396 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c006e60 con 0x7f3d50104260 2026-02-20T03:17:22.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d377fe640 1 -- 10.20.193.28:0/3738284396 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d4c010070 con 0x7f3d50104260 2026-02-20T03:17:22.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d377fe640 1 -- 10.20.193.28:0/3738284396 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c004800 con 0x7f3d50104260 2026-02-20T03:17:22.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d572e1640 1 -- 10.20.193.28:0/3738284396 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d501a4b30 con 0x7f3d50104260 2026-02-20T03:17:22.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.801+0000 7f3d572e1640 1 -- 10.20.193.28:0/3738284396 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d501a50b0 con 0x7f3d50104260 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.804+0000 7f3d5b3cce00 1 Processor -- start 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.804+0000 7f3d377fe640 1 -- 10.20.193.28:0/3738284396 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3d4c01d030 con 0x7f3d50104260 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.804+0000 7f3d5b3cce00 1 -- start start 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.804+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb96660 0x56266eb96a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.804+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96fc0 0x56266eb9b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.804+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb9c010 0x56266eb9e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.804+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56266eade8f0 con 0x56266eb9c010 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.804+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56266ea8c2e0 con 0x56266eb96660 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.804+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56266eada820 con 0x56266eb96fc0 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d55ade640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb9c010 0x56266eb9e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d55ade640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb9c010 0x56266eb9e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45018/0 (socket says 10.20.193.28:45018) 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d55ade640 1 -- 10.20.193.28:0/101156855 learned_addr learned my addr 10.20.193.28:0/101156855 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d55ade640 1 -- 10.20.193.28:0/101156855 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96fc0 msgr2=0x56266eb9b9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d55ade640 1 --2- 10.20.193.28:0/101156855 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96fc0 0x56266eb9b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d55ade640 1 -- 10.20.193.28:0/101156855 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb96660 msgr2=0x56266eb96a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d55ade640 1 --2- 10.20.193.28:0/101156855 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb96660 0x56266eb96a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d55ade640 1 -- 10.20.193.28:0/101156855 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266ea7e5a0 con 0x56266eb9c010 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d55ade640 1 --2- 10.20.193.28:0/101156855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb9c010 0x56266eb9e440 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3d44002b60 tx=0x7f3d44005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811c7f52e7665553 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d1e3ff640 1 -- 10.20.193.28:0/101156855 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44038470 con 0x56266eb9c010 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d1e3ff640 1 -- 10.20.193.28:0/101156855 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d44033040 con 0x56266eb9c010 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.805+0000 7f3d1e3ff640 1 -- 10.20.193.28:0/101156855 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44004580 con 0x56266eb9c010 2026-02-20T03:17:22.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/101156855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb9c010 msgr2=0x56266eb9e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/101156855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb9c010 0x56266eb9e440 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3d44002b60 tx=0x7f3d44005ce0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/101156855 shutdown_connections 2026-02-20T03:17:22.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/101156855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb9c010 0x56266eb9e440 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/101156855 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96fc0 0x56266eb9b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/101156855 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb96660 0x56266eb96a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/101156855 >> 10.20.193.28:0/101156855 conn(0x56266eb852d0 msgr2=0x56266eb94b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/101156855 shutdown_connections 2026-02-20T03:17:22.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/101156855 wait complete. 2026-02-20T03:17:22.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d377fe640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d2c0b0e00 0x7f3d2c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d377fe640 1 -- 10.20.193.28:0/3738284396 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f3d4c0dfff0 con 0x7f3d50104260 2026-02-20T03:17:22.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.806+0000 7f3d55ade640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d2c0b0e00 0x7f3d2c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.807+0000 7f3d55ade640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d2c0b0e00 0x7f3d2c0b32c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3d44002fd0 tx=0x7f3d440023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.807+0000 7f3d5b3cce00 1 -- start start 2026-02-20T03:17:22.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.807+0000 7f3d5b3cce00 1 Processor -- start 2026-02-20T03:17:22.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.807+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96660 0x56266ebc0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.807+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.807+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb9c010 0x56266ebc7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56266ea860c0 con 0x56266eb96fc0 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56266ebb0400 con 0x56266eb9c010 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56266ebc8110 con 0x56266eb96660 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d55ade640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d55ade640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45024/0 (socket says 10.20.193.28:45024) 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d55ade640 1 -- 10.20.193.28:0/555996264 learned_addr learned my addr 10.20.193.28:0/555996264 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d55ade640 1 -- 10.20.193.28:0/555996264 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96660 msgr2=0x56266ebc0760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d55ade640 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96660 0x56266ebc0760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d55ade640 1 -- 10.20.193.28:0/555996264 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb9c010 msgr2=0x56266ebc7b80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d55ade640 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb9c010 0x56266ebc7b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d55ade640 1 -- 10.20.193.28:0/555996264 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266ebb9e00 con 0x56266eb96fc0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d55ade640 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc0ca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3d4403f000 tx=0x7f3d4402f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fbdd07feecb747 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d0b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/555996264 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4405c070 con 0x56266eb96fc0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/555996264 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266ea9a820 con 0x56266eb96fc0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d5b3cce00 10 client.15807 _ll_register_callbacks cb 0x56266ea89ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/555996264 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56266eae64e0 con 0x56266eb96fc0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/555996264 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d44002900 con 0x56266eb96fc0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.808+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/555996264 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4404c430 con 0x56266eb96fc0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/555996264 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f3d44047040 con 0x56266eb96fc0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/555996264 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d4404c5d0 con 0x56266eb96fc0 2026-02-20T03:17:22.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d5b3cce00 10 client.15807 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:22.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/555996264 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x56266ea9f380 con 0x56266eb96fc0 2026-02-20T03:17:22.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/555996264 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f3d44069020 con 0x56266eb96fc0 2026-02-20T03:17:22.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d5b3cce00 10 client.15807 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:22.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d5b3cce00 10 client.15807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:22.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d5b3cce00 20 client.15807 populate_metadata read hostname 'trial028' 2026-02-20T03:17:22.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56266ebcc120 0x56266ebce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d5b3cce00 4 client.15807 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:22.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.809+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/555996264 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56266ea60bd0 con 0x56266ebcc120 2026-02-20T03:17:22.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.822+0000 7f3d562df640 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56266ebcc120 0x56266ebce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:22 trial126 ceph-mon[38476]: pgmap v261: 129 pgs: 129 active+clean; 52 MiB data, 734 MiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 3.7 MiB/s wr, 299 op/s 2026-02-20T03:17:22.864 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:17:22.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.889+0000 7f3d562df640 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56266ebcc120 0x56266ebce5e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2536663b9838904 server_cookie=5d7b4be19d79fbd1 in_seq=0 out_seq=0 2026-02-20T03:17:22.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.889+0000 7f3d0b7fe640 10 client.15807 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:22.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/555996264 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56266ea60bd0 con 0x56266ebcc120 2026-02-20T03:17:22.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d0b7fe640 10 client.15807 handle_command_reply: tid=0 2026-02-20T03:17:22.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 client.15807 shutdown 2026-02-20T03:17:22.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/555996264 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 msgr2=0x56266ebc0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc0ca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f3d4403f000 tx=0x7f3d4402f260 comp rx=0 tx=0).stop 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/555996264 shutdown_connections 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56266ebcc120 0x56266ebce5e0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb9c010 0x56266ebc7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc0ca0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/555996264 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96660 0x56266ebc0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/555996264 >> 10.20.193.28:0/555996264 conn(0x56266eb852d0 msgr2=0x56266eb94b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d0b7fe640 0 client.15807 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/555996264 shutdown_connections 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/555996264 wait complete. 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.903+0000 7f3d5b3cce00 20 client.15807 trim_cache size 0 max 16384 2026-02-20T03:17:22.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.911+0000 7f3d5b3cce00 1 Processor -- start 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.911+0000 7f3d5b3cce00 1 -- start start 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.911+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96660 0x56266eb95b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.911+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96fc0 0x56266ebbee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.911+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb9c010 0x56266ebc7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.911+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc0126f0 con 0x56266eb96660 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.911+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc00ffc0 con 0x56266eb9c010 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.911+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc00de10 con 0x56266eb96fc0 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d562df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96660 0x56266eb95b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d562df640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96660 0x56266eb95b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45040/0 (socket says 10.20.193.28:45040) 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d562df640 1 -- 10.20.193.28:0/3099569304 learned_addr learned my addr 10.20.193.28:0/3099569304 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d562df640 1 -- 10.20.193.28:0/3099569304 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96fc0 msgr2=0x56266ebbee70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d562df640 1 --2- 10.20.193.28:0/3099569304 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96fc0 0x56266ebbee70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d562df640 1 -- 10.20.193.28:0/3099569304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb9c010 msgr2=0x56266ebc7b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d562df640 1 --2- 10.20.193.28:0/3099569304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb9c010 0x56266ebc7b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d562df640 1 -- 10.20.193.28:0/3099569304 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266ebb9c30 con 0x56266eb96660 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d562df640 1 --2- 10.20.193.28:0/3099569304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96660 0x56266eb95b70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x56266ebcee10 tx=0x7f3d400047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fd775497560e6b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d1dbfe640 1 -- 10.20.193.28:0/3099569304 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4001e070 con 0x56266eb96660 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.912+0000 7f3d1dbfe640 1 -- 10.20.193.28:0/3099569304 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d40009dc0 con 0x56266eb96660 2026-02-20T03:17:22.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.913+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3099569304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96660 msgr2=0x56266eb95b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:22.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.913+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3099569304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96660 0x56266eb95b70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x56266ebcee10 tx=0x7f3d400047e0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.914+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3099569304 shutdown_connections 2026-02-20T03:17:22.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.914+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3099569304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb9c010 0x56266ebc7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.914+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3099569304 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb96fc0 0x56266ebbee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.914+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3099569304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96660 0x56266eb95b70 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.914+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3099569304 >> 10.20.193.28:0/3099569304 conn(0x56266eb852d0 msgr2=0x56266ebc07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.914+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3099569304 shutdown_connections 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.914+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3099569304 wait complete. 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.914+0000 7f3d5b3cce00 1 -- start start 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.914+0000 7f3d5b3cce00 1 Processor -- start 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb96660 0x56266ebc7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d5b3cce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb9c010 0x56266ebc4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc00e480 con 0x56266eb96fc0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc00f8f0 con 0x56266eb96660 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d5b3cce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc00eb50 con 0x56266eb9c010 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d55ade640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d55ade640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45044/0 (socket says 10.20.193.28:45044) 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d55ade640 1 -- 10.20.193.28:0/3567697053 learned_addr learned my addr 10.20.193.28:0/3567697053 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d55ade640 1 -- 10.20.193.28:0/3567697053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb9c010 msgr2=0x56266ebc4290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d55ade640 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb9c010 0x56266ebc4290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d55ade640 1 -- 10.20.193.28:0/3567697053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb96660 msgr2=0x56266ebc7680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d55ade640 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb96660 0x56266ebc7680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d55ade640 1 -- 10.20.193.28:0/3567697053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56266eb99230 con 0x56266eb96fc0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d55ade640 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc7bc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3d44002c90 tx=0x7f3d440044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d5adb775abe01f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d0b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/3567697053 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4405c070 con 0x56266eb96fc0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/3567697053 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56266eae64e0 con 0x56266eb96fc0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/3567697053 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4404ca60 con 0x56266eb96fc0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.915+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3567697053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56266e83e690 con 0x56266eb96fc0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/3567697053 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(93..93 src has 1..93) ==== 9297+0+0 (secure 0 0 0) 0x7f3d4404cc00 con 0x56266eb96fc0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 10 client.15813 _ll_register_callbacks cb 0x7f3d44002830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3567697053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d44033040 con 0x56266eb96fc0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/3567697053 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d44070060 con 0x56266eb96fc0 2026-02-20T03:17:22.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 10 client.15813 fetch_fsmap learned FSMap version 24 2026-02-20T03:17:22.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3567697053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=24}) -- 0x56266eaa3b70 con 0x56266eb96fc0 2026-02-20T03:17:22.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/3567697053 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 24) ==== 8362+0+0 (secure 0 0 0) 0x7f3d44069070 con 0x56266eb96fc0 2026-02-20T03:17:22.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 10 client.15813 fetch_fsmap finished waiting for FSMap version 24 2026-02-20T03:17:22.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:22.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 20 client.15813 populate_metadata read hostname 'trial028' 2026-02-20T03:17:22.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56266ec37eb0 0x56266ec3a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:22.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 4 client.15813 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:17:22.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.916+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3567697053 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56266e8b7520 con 0x56266ec37eb0 2026-02-20T03:17:22.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.917+0000 7f3d562df640 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56266ec37eb0 0x56266ec3a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:22.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:22 trial177 ceph-mon[43181]: pgmap v261: 129 pgs: 129 active+clean; 52 MiB data, 734 MiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 3.7 MiB/s wr, 299 op/s 2026-02-20T03:17:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.997+0000 7f3d562df640 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56266ec37eb0 0x56266ec3a370 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac60c1cd57316f8 server_cookie=db1f21ab453def54 in_seq=0 out_seq=0 2026-02-20T03:17:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:22.997+0000 7f3d0b7fe640 10 client.15813 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:23.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.066+0000 7f3d0b7fe640 1 -- 10.20.193.28:0/3567697053 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56266e8b7520 con 0x56266ec37eb0 2026-02-20T03:17:23.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.066+0000 7f3d0b7fe640 10 client.15813 handle_command_reply: tid=0 2026-02-20T03:17:23.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.066+0000 7f3d5b3cce00 1 client.15813 shutdown 2026-02-20T03:17:23.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.066+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3567697053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 msgr2=0x56266ebc7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.066+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc7bc0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3d44002c90 tx=0x7f3d440044c0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3567697053 shutdown_connections 2026-02-20T03:17:23.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56266ec37eb0 0x56266ec3a370 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56266eb9c010 0x56266ebc4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56266eb96fc0 0x56266ebc7bc0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d5b3cce00 1 --2- 10.20.193.28:0/3567697053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56266eb96660 0x56266ebc7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3567697053 >> 10.20.193.28:0/3567697053 conn(0x56266eb852d0 msgr2=0x56266ebbee00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:23.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d0b7fe640 0 client.15813 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:23.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3567697053 shutdown_connections 2026-02-20T03:17:23.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d5b3cce00 1 -- 10.20.193.28:0/3567697053 wait complete. 2026-02-20T03:17:23.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d5b3cce00 20 client.15813 trim_cache size 0 max 16384 2026-02-20T03:17:23.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:17:23.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:17:23.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:17:23.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:17:23.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d572e1640 1 -- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d2c0b0e00 msgr2=0x7f3d2c0b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d2c0b0e00 0x7f3d2c0b32c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3d44002fd0 tx=0x7f3d440023d0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d572e1640 1 -- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50104260 msgr2=0x7f3d501a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.067+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50104260 0x7f3d501a4140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00b990 tx=0x7f3d4c00be60 comp rx=0 tx=0).stop 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.068+0000 7f3d572e1640 1 -- 10.20.193.28:0/3738284396 shutdown_connections 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.068+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d2c0b0e00 0x7f3d2c0b32c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.068+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50104260 0x7f3d501a4140 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.068+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501038a0 0x7f3d5019d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.068+0000 7f3d572e1640 1 --2- 10.20.193.28:0/3738284396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d501026b0 0x7f3d5019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.068+0000 7f3d572e1640 1 -- 10.20.193.28:0/3738284396 >> 10.20.193.28:0/3738284396 conn(0x7f3d500fde10 msgr2=0x7f3d50109190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.068+0000 7f3d572e1640 1 -- 10.20.193.28:0/3738284396 shutdown_connections 2026-02-20T03:17:23.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:23.068+0000 7f3d572e1640 1 -- 10.20.193.28:0/3738284396 wait complete. 2026-02-20T03:17:23.176 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:23.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 16.42 MB/sec warmup 56 sec latency 2711.871 ms 2026-02-20T03:17:23.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.579+0000 7f955668e640 1 -- 10.20.193.28:0/2052764923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f955010a980 msgr2=0x7f955010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.579+0000 7f955668e640 1 --2- 10.20.193.28:0/2052764923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f955010a980 0x7f955010ad60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9540009a60 tx=0x7f954002f290 comp rx=0 tx=0).stop 2026-02-20T03:17:23.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.579+0000 7f955668e640 1 -- 10.20.193.28:0/2052764923 shutdown_connections 2026-02-20T03:17:23.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.579+0000 7f955668e640 1 --2- 10.20.193.28:0/2052764923 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9550105320 0x7f9550111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.579+0000 7f955668e640 1 --2- 10.20.193.28:0/2052764923 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9550104980 0x7f9550104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.579+0000 7f955668e640 1 --2- 10.20.193.28:0/2052764923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f955010a980 0x7f955010ad60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.579+0000 7f955668e640 1 -- 10.20.193.28:0/2052764923 >> 10.20.193.28:0/2052764923 conn(0x7f9550100680 msgr2=0x7f9550102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:23.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.579+0000 7f955668e640 1 -- 10.20.193.28:0/2052764923 shutdown_connections 2026-02-20T03:17:23.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.579+0000 7f955668e640 1 -- 10.20.193.28:0/2052764923 wait complete. 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f955668e640 1 Processor -- start 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f955668e640 1 -- start start 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f955668e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9550104980 0x7f9550077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f955668e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9550105320 0x7f9550077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f955668e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f955010a980 0x7f9550078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f955668e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9550114cd0 con 0x7f9550105320 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f955668e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9550114b50 con 0x7f9550104980 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f955668e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9550114e50 con 0x7f955010a980 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f9554e8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9550105320 0x7f9550077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f9554e8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9550105320 0x7f9550077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45062/0 (socket says 10.20.193.28:45062) 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.580+0000 7f9554e8b640 1 -- 10.20.193.28:0/2697348916 learned_addr learned my addr 10.20.193.28:0/2697348916 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f9554e8b640 1 -- 10.20.193.28:0/2697348916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f955010a980 msgr2=0x7f9550078080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f9554e8b640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f955010a980 0x7f9550078080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f9554e8b640 1 -- 10.20.193.28:0/2697348916 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9550104980 msgr2=0x7f9550077600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f9554e8b640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9550104980 0x7f9550077600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f9554e8b640 1 -- 10.20.193.28:0/2697348916 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95501adb30 con 0x7f9550105320 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f9554e8b640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9550105320 0x7f9550077b40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f954400b5a0 tx=0x7f954400ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f953e7fc640 1 -- 10.20.193.28:0/2697348916 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544012070 con 0x7f9550105320 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f953e7fc640 1 -- 10.20.193.28:0/2697348916 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9544004480 con 0x7f9550105320 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f955668e640 1 -- 10.20.193.28:0/2697348916 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95501ade20 con 0x7f9550105320 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f953e7fc640 1 -- 10.20.193.28:0/2697348916 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954400dac0 con 0x7f9550105320 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.581+0000 7f955668e640 1 -- 10.20.193.28:0/2697348916 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95501ae280 con 0x7f9550105320 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.584+0000 7f953e7fc640 1 -- 10.20.193.28:0/2697348916 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f954400dce0 con 0x7f9550105320 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.585+0000 7f9559e1ce00 1 Processor -- start 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.585+0000 7f9559e1ce00 1 -- start start 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.585+0000 7f953e7fc640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f952c0b0ea0 0x7f952c0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.585+0000 7f953e7fc640 1 -- 10.20.193.28:0/2697348916 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f95440e00d0 con 0x7f9550105320 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.585+0000 7f9555e8d640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f952c0b0ea0 0x7f952c0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 0x5613031fd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f75e0 0x5613031f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303203de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561303177e00 con 0x5613031f7f60 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56130314a970 con 0x5613031fcfb0 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5613030f81f0 con 0x5613031f75e0 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303203de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303203de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45074/0 (socket says 10.20.193.28:45074) 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 -- 10.20.193.28:0/3947107983 learned_addr learned my addr 10.20.193.28:0/3947107983 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 -- 10.20.193.28:0/3947107983 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f75e0 msgr2=0x5613031f7a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 --2- 10.20.193.28:0/3947107983 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f75e0 0x5613031f7a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 -- 10.20.193.28:0/3947107983 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 msgr2=0x5613031fd390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 --2- 10.20.193.28:0/3947107983 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 0x5613031fd390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 -- 10.20.193.28:0/3947107983 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56130310b3d0 con 0x5613031f7f60 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f952c0b0ea0 0x7f952c0b3360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f954c010640 tx=0x7f954c010a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.586+0000 7f9555e8d640 1 --2- 10.20.193.28:0/3947107983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303203de0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f954c00aa70 tx=0x7f954c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b56abc9210095a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f951dce5640 1 -- 10.20.193.28:0/3947107983 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c006e60 con 0x5613031f7f60 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f951dce5640 1 -- 10.20.193.28:0/3947107983 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f954c020070 con 0x5613031f7f60 2026-02-20T03:17:23.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f951dce5640 1 -- 10.20.193.28:0/3947107983 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c01a680 con 0x5613031f7f60 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3947107983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 msgr2=0x561303203de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3947107983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303203de0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f954c00aa70 tx=0x7f954c019000 comp rx=0 tx=0).stop 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3947107983 shutdown_connections 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3947107983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303203de0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3947107983 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f75e0 0x5613031f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3947107983 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 0x5613031fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3947107983 >> 10.20.193.28:0/3947107983 conn(0x5613031ba240 msgr2=0x5613031f5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3947107983 shutdown_connections 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.587+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3947107983 wait complete. 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.588+0000 7f9559e1ce00 1 -- start start 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.588+0000 7f9559e1ce00 1 Processor -- start 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f75e0 0x561303210320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f7f60 0x561303210860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 0x561303215dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5613031468a0 con 0x5613031f75e0 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561302f38f50 con 0x5613031fcfb0 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561303216300 con 0x5613031f7f60 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f955568c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f75e0 0x561303210320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f955568c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f75e0 0x561303210320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45090/0 (socket says 10.20.193.28:45090) 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f955568c640 1 -- 10.20.193.28:0/3553716555 learned_addr learned my addr 10.20.193.28:0/3553716555 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f955568c640 1 -- 10.20.193.28:0/3553716555 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f7f60 msgr2=0x561303210860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f955568c640 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f7f60 0x561303210860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f955568c640 1 -- 10.20.193.28:0/3553716555 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 msgr2=0x561303215dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f955568c640 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 0x561303215dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f955568c640 1 -- 10.20.193.28:0/3553716555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561303209ad0 con 0x5613031f75e0 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f955568c640 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f75e0 0x561303210320 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9540005d10 tx=0x7f9540002f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac7bd16b3802d3e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.589+0000 7f950affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f950affd640 1 -- 10.20.193.28:0/3553716555 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95400029b0 con 0x5613031f75e0 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f950affd640 1 -- 10.20.193.28:0/3553716555 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9540033040 con 0x5613031f75e0 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f950affd640 1 -- 10.20.193.28:0/3553716555 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540038a20 con 0x5613031f75e0 2026-02-20T03:17:23.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3553716555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561302f1bb40 con 0x5613031f75e0 2026-02-20T03:17:23.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f9559e1ce00 10 client.15825 _ll_register_callbacks cb 0x561303183eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:23.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3553716555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561303158150 con 0x5613031f75e0 2026-02-20T03:17:23.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f950affd640 1 -- 10.20.193.28:0/3553716555 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f9540038be0 con 0x5613031f75e0 2026-02-20T03:17:23.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f950affd640 1 -- 10.20.193.28:0/3553716555 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9540004030 con 0x5613031f75e0 2026-02-20T03:17:23.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f9559e1ce00 10 client.15825 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:23.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.590+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3553716555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5613031051e0 con 0x5613031f75e0 2026-02-20T03:17:23.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.591+0000 7f950affd640 1 -- 10.20.193.28:0/3553716555 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f954004a030 con 0x5613031f75e0 2026-02-20T03:17:23.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.591+0000 7f9559e1ce00 10 client.15825 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:23.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.591+0000 7f9559e1ce00 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:23.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.591+0000 7f9559e1ce00 20 client.15825 populate_metadata read hostname 'trial028' 2026-02-20T03:17:23.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.591+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561303220460 0x561303222920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.591+0000 7f9559e1ce00 4 client.15825 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:23.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.591+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3553716555 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561303152560 con 0x561303220460 2026-02-20T03:17:23.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.617+0000 7f9554e8b640 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561303220460 0x561303222920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:23.632 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:23 trial028 ceph-mon[38552]: daemon mds.c restarted 2026-02-20T03:17:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.670+0000 7f9554e8b640 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561303220460 0x561303222920 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8e509e5264817b0 server_cookie=92c36c44ece6fd08 in_seq=0 out_seq=0 2026-02-20T03:17:23.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.670+0000 7f950affd640 10 client.15825 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:23.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f950affd640 1 -- 10.20.193.28:0/3553716555 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561303152560 con 0x561303220460 2026-02-20T03:17:23.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f950affd640 10 client.15825 handle_command_reply: tid=0 2026-02-20T03:17:23.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 client.15825 shutdown 2026-02-20T03:17:23.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3553716555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f75e0 msgr2=0x561303210320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f75e0 0x561303210320 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9540005d10 tx=0x7f9540002f80 comp rx=0 tx=0).stop 2026-02-20T03:17:23.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3553716555 shutdown_connections 2026-02-20T03:17:23.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561303220460 0x561303222920 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 0x561303215dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f7f60 0x561303210860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3553716555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f75e0 0x561303210320 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3553716555 >> 10.20.193.28:0/3553716555 conn(0x5613031ba240 msgr2=0x5613031f63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:23.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f950affd640 0 client.15825 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:23.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3553716555 shutdown_connections 2026-02-20T03:17:23.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3553716555 wait complete. 2026-02-20T03:17:23.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.697+0000 7f9559e1ce00 20 client.15825 trim_cache size 0 max 16384 2026-02-20T03:17:23.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.704+0000 7f9559e1ce00 1 Processor -- start 2026-02-20T03:17:23.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.704+0000 7f9559e1ce00 1 -- start start 2026-02-20T03:17:23.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.704+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f75e0 0x5613031faad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.704+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x56130320d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.704+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 0x56130320db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.704+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc0127d0 con 0x5613031f7f60 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.704+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc010040 con 0x5613031fcfb0 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.704+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc00de90 con 0x5613031f75e0 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9554e8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x56130320d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9554e8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x56130320d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45106/0 (socket says 10.20.193.28:45106) 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9554e8b640 1 -- 10.20.193.28:0/2665803027 learned_addr learned my addr 10.20.193.28:0/2665803027 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9554e8b640 1 -- 10.20.193.28:0/2665803027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f75e0 msgr2=0x5613031faad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9554e8b640 1 --2- 10.20.193.28:0/2665803027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f75e0 0x5613031faad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9554e8b640 1 -- 10.20.193.28:0/2665803027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 msgr2=0x56130320db00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9554e8b640 1 --2- 10.20.193.28:0/2665803027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 0x56130320db00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9554e8b640 1 -- 10.20.193.28:0/2665803027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561303209900 con 0x5613031f7f60 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9554e8b640 1 --2- 10.20.193.28:0/2665803027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x56130320d5c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f954400bf80 tx=0x7f95440047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb55965352adf22b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f951d4e4640 1 -- 10.20.193.28:0/2665803027 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954401c040 con 0x5613031f7f60 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f951d4e4640 1 -- 10.20.193.28:0/2665803027 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f95440dd850 con 0x5613031f7f60 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f951d4e4640 1 -- 10.20.193.28:0/2665803027 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95440b0de0 con 0x5613031f7f60 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9559e1ce00 1 -- 10.20.193.28:0/2665803027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 msgr2=0x56130320d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/2665803027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x56130320d5c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f954400bf80 tx=0x7f95440047e0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9559e1ce00 1 -- 10.20.193.28:0/2665803027 shutdown_connections 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/2665803027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031fcfb0 0x56130320db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/2665803027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x56130320d5c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/2665803027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031f75e0 0x5613031faad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9559e1ce00 1 -- 10.20.193.28:0/2665803027 >> 10.20.193.28:0/2665803027 conn(0x5613031ba240 msgr2=0x56130320f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:23.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.705+0000 7f9559e1ce00 1 -- 10.20.193.28:0/2665803027 shutdown_connections 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.706+0000 7f9559e1ce00 1 -- 10.20.193.28:0/2665803027 wait complete. 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.706+0000 7f9559e1ce00 1 -- start start 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.706+0000 7f9559e1ce00 1 Processor -- start 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031f75e0 0x5613032190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303219630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9559e1ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031fcfb0 0x561303219b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc00e500 con 0x5613031f7f60 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc00f970 con 0x5613031f75e0 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9559e1ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94fc00ebd0 con 0x5613031fcfb0 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9554e8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303219630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:23.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9554e8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303219630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45122/0 (socket says 10.20.193.28:45122) 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9554e8b640 1 -- 10.20.193.28:0/3845606417 learned_addr learned my addr 10.20.193.28:0/3845606417 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9554e8b640 1 -- 10.20.193.28:0/3845606417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031fcfb0 msgr2=0x561303219b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9554e8b640 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031fcfb0 0x561303219b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9554e8b640 1 -- 10.20.193.28:0/3845606417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031f75e0 msgr2=0x5613032190f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9554e8b640 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031f75e0 0x5613032190f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9554e8b640 1 -- 10.20.193.28:0/3845606417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561302e29870 con 0x5613031f7f60 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f9554e8b640 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303219630 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f95440a7c70 tx=0x7f95440a4150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728292a8eacc9d8e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f950affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f950affd640 1 -- 10.20.193.28:0/3845606417 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954401c070 con 0x5613031f7f60 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f950affd640 1 -- 10.20.193.28:0/3845606417 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f95440b0d80 con 0x5613031f7f60 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.707+0000 7f950affd640 1 -- 10.20.193.28:0/3845606417 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954408eb10 con 0x5613031f7f60 2026-02-20T03:17:23.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3845606417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613030ea3f0 con 0x5613031f7f60 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 10 client.15831 _ll_register_callbacks cb 0x7f9540009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3845606417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5613030fcab0 con 0x5613031f7f60 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f950affd640 1 -- 10.20.193.28:0/3845606417 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f954408ecb0 con 0x5613031f7f60 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f950affd640 1 -- 10.20.193.28:0/3845606417 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f95440ce1d0 con 0x5613031f7f60 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 10 client.15831 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3845606417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56130320a5f0 con 0x5613031f7f60 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f950affd640 1 -- 10.20.193.28:0/3845606417 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f95440ae040 con 0x5613031f7f60 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 10 client.15831 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 20 client.15831 populate_metadata read hostname 'trial028' 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56130328ca20 0x56130328eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:23.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 4 client.15831 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:17:23.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.708+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3845606417 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f954c020070 con 0x56130328ca20 2026-02-20T03:17:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:23 trial177 ceph-mon[43181]: daemon mds.c restarted 2026-02-20T03:17:23.718 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:17:23 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setuser ceph since I am not root 2026-02-20T03:17:23.718 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:17:23 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setgroup ceph since I am not root 2026-02-20T03:17:23.719 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:17:23 trial177 ceph-mds[71178]: -- 10.20.193.177:0/583377234 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562bb8cc0b40 con 0x562bb7ee7400 2026-02-20T03:17:23.719 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:17:23 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: starting mds.c at 2026-02-20T03:17:23.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.724+0000 7f955568c640 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56130328ca20 0x56130328eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:23.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.777+0000 7f955568c640 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56130328ca20 0x56130328eee0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deed9014016956f0 server_cookie=7b202a3c8ceaf187 in_seq=0 out_seq=0 2026-02-20T03:17:23.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.777+0000 7f950affd640 10 client.15831 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.790+0000 7f950affd640 1 -- 10.20.193.28:0/3845606417 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f954c020070 con 0x56130328ca20 2026-02-20T03:17:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.790+0000 7f950affd640 10 client.15831 handle_command_reply: tid=0 2026-02-20T03:17:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.790+0000 7f9559e1ce00 1 client.15831 shutdown 2026-02-20T03:17:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3845606417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 msgr2=0x561303219630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303219630 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f95440a7c70 tx=0x7f95440a4150 comp rx=0 tx=0).stop 2026-02-20T03:17:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3845606417 shutdown_connections 2026-02-20T03:17:23.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56130328ca20 0x56130328eee0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613031fcfb0 0x561303219b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613031f7f60 0x561303219630 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f950affd640 0 client.15831 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 --2- 10.20.193.28:0/3845606417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613031f75e0 0x5613032190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3845606417 >> 10.20.193.28:0/3845606417 conn(0x5613031ba240 msgr2=0x561303220840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3845606417 shutdown_connections 2026-02-20T03:17:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 1 -- 10.20.193.28:0/3845606417 wait complete. 2026-02-20T03:17:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f9559e1ce00 20 client.15831 trim_cache size 0 max 16384 2026-02-20T03:17:23.806 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:17:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f955668e640 1 -- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f952c0b0ea0 msgr2=0x7f952c0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f955668e640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f952c0b0ea0 0x7f952c0b3360 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f954c010640 tx=0x7f954c010a40 comp rx=0 tx=0).stop 2026-02-20T03:17:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f955668e640 1 -- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9550105320 msgr2=0x7f9550077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f955668e640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9550105320 0x7f9550077b40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f954400b5a0 tx=0x7f954400ba70 comp rx=0 tx=0).stop 2026-02-20T03:17:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.791+0000 7f955668e640 1 -- 10.20.193.28:0/2697348916 shutdown_connections 2026-02-20T03:17:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.792+0000 7f955668e640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f952c0b0ea0 0x7f952c0b3360 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.792+0000 7f955668e640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f955010a980 0x7f9550078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.792+0000 7f955668e640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9550105320 0x7f9550077b40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.792+0000 7f955668e640 1 --2- 10.20.193.28:0/2697348916 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9550104980 0x7f9550077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.792+0000 7f955668e640 1 -- 10.20.193.28:0/2697348916 >> 10.20.193.28:0/2697348916 conn(0x7f9550100680 msgr2=0x7f9550101180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.792+0000 7f955668e640 1 -- 10.20.193.28:0/2697348916 shutdown_connections 2026-02-20T03:17:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:23.792+0000 7f955668e640 1 -- 10.20.193.28:0/2697348916 wait complete. 2026-02-20T03:17:23.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:23 trial126 ceph-mon[38476]: daemon mds.c restarted 2026-02-20T03:17:24.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 16.14 MB/sec warmup 57 sec latency 3711.910 ms 2026-02-20T03:17:24.690 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:24 trial028 ceph-mon[38552]: osdmap e94: 12 total, 12 up, 12 in 2026-02-20T03:17:24.690 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:24 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6836/1716979260,v1:10.20.193.177:6837/1716979260] up:boot 2026-02-20T03:17:24.690 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:24 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:17:24.690 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:24 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:17:24.690 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:24 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:17:24.690 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:24 trial028 ceph-mon[38552]: pgmap v263: 129 pgs: 129 active+clean; 50 MiB data, 742 MiB used, 8.2 TiB / 8.2 TiB avail; 278 KiB/s rd, 3.3 MiB/s wr, 262 op/s 2026-02-20T03:17:24.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:24 trial126 ceph-mon[38476]: osdmap e94: 12 total, 12 up, 12 in 2026-02-20T03:17:24.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:24 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6836/1716979260,v1:10.20.193.177:6837/1716979260] up:boot 2026-02-20T03:17:24.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:24 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:17:24.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:24 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:17:24.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:24 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:17:24.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:24 trial126 ceph-mon[38476]: pgmap v263: 129 pgs: 129 active+clean; 50 MiB data, 742 MiB used, 8.2 TiB / 8.2 TiB avail; 278 KiB/s rd, 3.3 MiB/s wr, 262 op/s 2026-02-20T03:17:24.963 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:17:24.963 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:17:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:24 trial177 ceph-mon[43181]: osdmap e94: 12 total, 12 up, 12 in 2026-02-20T03:17:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:24 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6836/1716979260,v1:10.20.193.177:6837/1716979260] up:boot 2026-02-20T03:17:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:24 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:17:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:24 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:17:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:24 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:17:24.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:24 trial177 ceph-mon[43181]: pgmap v263: 129 pgs: 129 active+clean; 50 MiB data, 742 MiB used, 8.2 TiB / 8.2 TiB avail; 278 KiB/s rd, 3.3 MiB/s wr, 262 op/s 2026-02-20T03:17:25.278 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd5517fa640 1 -- 10.20.193.28:0/1398729279 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55739dd5bf60 con 0x55739e13f730 2026-02-20T03:17:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd5517fa640 10 client.15735 handle_command_reply: tid=0 2026-02-20T03:17:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd59818ee00 1 client.15735 shutdown 2026-02-20T03:17:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd59818ee00 1 -- 10.20.193.28:0/1398729279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 msgr2=0x55739e0c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0c8590 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd580009890 tx=0x7fd580009100 comp rx=0 tx=0).stop 2026-02-20T03:17:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd59818ee00 1 -- 10.20.193.28:0/1398729279 shutdown_connections 2026-02-20T03:17:25.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55739e13f730 0x55739e141bf0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55739e0af580 0x55739e13de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55739e0aa630 0x55739e0c8590 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd59818ee00 1 --2- 10.20.193.28:0/1398729279 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55739e0a9c70 0x55739e0c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.408+0000 7fd59818ee00 1 -- 10.20.193.28:0/1398729279 >> 10.20.193.28:0/1398729279 conn(0x55739e0913c0 msgr2=0x55739e0d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.409+0000 7fd5517fa640 0 client.15735 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.409+0000 7fd59818ee00 1 -- 10.20.193.28:0/1398729279 shutdown_connections 2026-02-20T03:17:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.409+0000 7fd59818ee00 1 -- 10.20.193.28:0/1398729279 wait complete. 2026-02-20T03:17:25.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.409+0000 7fd59818ee00 20 client.15735 trim_cache size 0 max 16384 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 26, 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 6, 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "2514cb31": { 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "version": 6, 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:17:25.414 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 140.3, 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:25.415 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:25.416 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:17:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.410+0000 7fd594a00640 1 -- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 msgr2=0x7fd5640b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.410+0000 7fd594a00640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd58400aab0 tx=0x7fd584009250 comp rx=0 tx=0).stop 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.410+0000 7fd594a00640 1 -- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd590109220 msgr2=0x7fd5901a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.410+0000 7fd594a00640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd590109220 0x7fd5901a1650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009950 tx=0x7fd57c002910 comp rx=0 tx=0).stop 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.411+0000 7fd594a00640 1 -- 10.20.193.28:0/1024253808 shutdown_connections 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.411+0000 7fd594a00640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.411+0000 7fd594a00640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd59010eef0 0x7fd5901a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.411+0000 7fd594a00640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd590109ba0 0x7fd5901a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.411+0000 7fd594a00640 1 --2- 10.20.193.28:0/1024253808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd590109220 0x7fd5901a1650 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.411+0000 7fd594a00640 1 -- 10.20.193.28:0/1024253808 >> 10.20.193.28:0/1024253808 conn(0x7fd590078600 msgr2=0x7fd59007a040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.411+0000 7fd594a00640 1 -- 10.20.193.28:0/1024253808 shutdown_connections 2026-02-20T03:17:25.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.411+0000 7fd594a00640 1 -- 10.20.193.28:0/1024253808 wait complete. 2026-02-20T03:17:25.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 15.86 MB/sec warmup 58 sec latency 4711.945 ms 2026-02-20T03:17:25.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.507+0000 7fe74310d640 1 -- 10.20.193.28:0/3561204950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c104980 msgr2=0x7fe73c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.507+0000 7fe74310d640 1 --2- 10.20.193.28:0/3561204950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c104980 0x7fe73c104de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe730009960 tx=0x7fe73002f140 comp rx=0 tx=0).stop 2026-02-20T03:17:25.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.507+0000 7fe74310d640 1 -- 10.20.193.28:0/3561204950 shutdown_connections 2026-02-20T03:17:25.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.507+0000 7fe74310d640 1 --2- 10.20.193.28:0/3561204950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe73c105320 0x7fe73c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.507+0000 7fe74310d640 1 --2- 10.20.193.28:0/3561204950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c104980 0x7fe73c104de0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.507+0000 7fe74310d640 1 --2- 10.20.193.28:0/3561204950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe73c10a980 0x7fe73c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.507+0000 7fe74310d640 1 -- 10.20.193.28:0/3561204950 >> 10.20.193.28:0/3561204950 conn(0x7fe73c100680 msgr2=0x7fe73c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:25.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.507+0000 7fe74310d640 1 -- 10.20.193.28:0/3561204950 shutdown_connections 2026-02-20T03:17:25.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.507+0000 7fe74310d640 1 -- 10.20.193.28:0/3561204950 wait complete. 2026-02-20T03:17:25.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74310d640 1 Processor -- start 2026-02-20T03:17:25.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74310d640 1 -- start start 2026-02-20T03:17:25.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74310d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe73c104980 0x7fe73c1116c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74310d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c105320 0x7fe73c10e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74310d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe73c10a980 0x7fe73c10ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74310d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c114ba0 con 0x7fe73c104980 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74310d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c114a20 con 0x7fe73c105320 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74310d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c114d20 con 0x7fe73c10a980 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74190a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c105320 0x7fe73c10e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.508+0000 7fe74210b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe73c104980 0x7fe73c1116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74190a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c105320 0x7fe73c10e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44448/0 (socket says 10.20.193.28:44448) 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74190a640 1 -- 10.20.193.28:0/2916411518 learned_addr learned my addr 10.20.193.28:0/2916411518 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74290c640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe73c10a980 0x7fe73c10ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74190a640 1 -- 10.20.193.28:0/2916411518 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe73c10a980 msgr2=0x7fe73c10ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74190a640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe73c10a980 0x7fe73c10ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74190a640 1 -- 10.20.193.28:0/2916411518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe73c104980 msgr2=0x7fe73c1116c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74190a640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe73c104980 0x7fe73c1116c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74190a640 1 -- 10.20.193.28:0/2916411518 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c1ad9e0 con 0x7fe73c105320 2026-02-20T03:17:25.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74190a640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c105320 0x7fe73c10e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe73002f650 tx=0x7fe7300029e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:25.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe7237fe640 1 -- 10.20.193.28:0/2916411518 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe730046070 con 0x7fe73c105320 2026-02-20T03:17:25.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe7237fe640 1 -- 10.20.193.28:0/2916411518 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe7300044f0 con 0x7fe73c105320 2026-02-20T03:17:25.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe7237fe640 1 -- 10.20.193.28:0/2916411518 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe730041410 con 0x7fe73c105320 2026-02-20T03:17:25.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74310d640 1 -- 10.20.193.28:0/2916411518 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c1adbb0 con 0x7fe73c105320 2026-02-20T03:17:25.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.509+0000 7fe74310d640 1 -- 10.20.193.28:0/2916411518 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c1ae010 con 0x7fe73c105320 2026-02-20T03:17:25.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.512+0000 7fe7237fe640 1 -- 10.20.193.28:0/2916411518 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe730038770 con 0x7fe73c105320 2026-02-20T03:17:25.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.513+0000 7fe74689be00 1 Processor -- start 2026-02-20T03:17:25.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74689be00 1 -- start start 2026-02-20T03:17:25.516 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2514cb31', quiesce took 8.6 seconds. Will release after: 11.700000000000001 2026-02-20T03:17:25.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe7237fe640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe7180b0e20 0x7fe7180b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74689be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfed0c0 0x55592bfed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74689be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592bff1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74689be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 0x55592bff1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74689be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55592bf3fc00 con 0x55592bfed0c0 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74689be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55592beed3c0 con 0x55592bff1b60 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74689be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55592bf3bb30 con 0x55592bfeda70 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe7237fe640 1 -- 10.20.193.28:0/2916411518 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe730104ad0 con 0x7fe73c105320 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74210b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfed0c0 0x55592bfed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74210b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfed0c0 0x55592bfed4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45156/0 (socket says 10.20.193.28:45156) 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74210b640 1 -- 10.20.193.28:0/4004818323 learned_addr learned my addr 10.20.193.28:0/4004818323 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74290c640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe7180b0e20 0x7fe7180b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.514+0000 7fe74190a640 1 --2- 10.20.193.28:0/4004818323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592bff1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe74210b640 1 -- 10.20.193.28:0/4004818323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 msgr2=0x55592bff1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe74210b640 1 --2- 10.20.193.28:0/4004818323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592bff1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe74210b640 1 -- 10.20.193.28:0/4004818323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 msgr2=0x55592bff1fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe74210b640 1 --2- 10.20.193.28:0/4004818323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 0x55592bff1fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe74210b640 1 -- 10.20.193.28:0/4004818323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592bee6840 con 0x55592bfed0c0 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe74210b640 1 --2- 10.20.193.28:0/4004818323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfed0c0 0x55592bfed4a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0045a0 tx=0x7fe72c009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fd1651bf983516 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe74290c640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe7180b0e20 0x7fe7180b32e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe738009fd0 tx=0x7fe73800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe720a08640 1 -- 10.20.193.28:0/4004818323 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c010630 con 0x55592bfed0c0 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe720a08640 1 -- 10.20.193.28:0/4004818323 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe72c010c70 con 0x55592bfed0c0 2026-02-20T03:17:25.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe720a08640 1 -- 10.20.193.28:0/4004818323 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c00ec20 con 0x55592bfed0c0 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe74689be00 1 -- 10.20.193.28:0/4004818323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfed0c0 msgr2=0x55592bfed4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.515+0000 7fe74689be00 1 --2- 10.20.193.28:0/4004818323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfed0c0 0x55592bfed4a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0045a0 tx=0x7fe72c009c70 comp rx=0 tx=0).stop 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.516+0000 7fe74689be00 1 -- 10.20.193.28:0/4004818323 shutdown_connections 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.516+0000 7fe74689be00 1 --2- 10.20.193.28:0/4004818323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 0x55592bff1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.516+0000 7fe74689be00 1 --2- 10.20.193.28:0/4004818323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592bff1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.516+0000 7fe74689be00 1 --2- 10.20.193.28:0/4004818323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfed0c0 0x55592bfed4a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.516+0000 7fe74689be00 1 -- 10.20.193.28:0/4004818323 >> 10.20.193.28:0/4004818323 conn(0x55592bfe5b60 msgr2=0x55592bfeb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.516+0000 7fe74689be00 1 -- 10.20.193.28:0/4004818323 shutdown_connections 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.516+0000 7fe74689be00 1 -- 10.20.193.28:0/4004818323 wait complete. 2026-02-20T03:17:25.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.517+0000 7fe74689be00 1 -- start start 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.517+0000 7fe74689be00 1 Processor -- start 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.517+0000 7fe74689be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfed0c0 0x55592c0073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.517+0000 7fe74689be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c007930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.517+0000 7fe74689be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 0x55592c005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.517+0000 7fe74689be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55592bee71a0 con 0x55592bfeda70 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.517+0000 7fe74689be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55592bff9d70 con 0x55592bff1b60 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.517+0000 7fe74689be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55592c0062b0 con 0x55592bfed0c0 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74210b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfed0c0 0x55592c0073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74190a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c007930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74210b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfed0c0 0x55592c0073f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:53994/0 (socket says 10.20.193.28:53994) 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74210b640 1 -- 10.20.193.28:0/2182212071 learned_addr learned my addr 10.20.193.28:0/2182212071 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74290c640 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 0x55592c005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74190a640 1 -- 10.20.193.28:0/2182212071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfed0c0 msgr2=0x55592c0073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74190a640 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfed0c0 0x55592c0073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74190a640 1 -- 10.20.193.28:0/2182212071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 msgr2=0x55592c005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74190a640 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 0x55592c005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74190a640 1 -- 10.20.193.28:0/2182212071 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592bfff520 con 0x55592bfeda70 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74290c640 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 0x55592c005b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74190a640 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c007930 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe7300cc560 tx=0x7fe7300046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ae4b859d08c953 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe6effff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:25.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe6effff640 1 -- 10.20.193.28:0/2182212071 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300d3070 con 0x55592bfeda70 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe6effff640 1 -- 10.20.193.28:0/2182212071 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe7300d3e50 con 0x55592bfeda70 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe6effff640 1 -- 10.20.193.28:0/2182212071 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300c81e0 con 0x55592bfeda70 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.518+0000 7fe74689be00 1 -- 10.20.193.28:0/2182212071 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55592bd0eb60 con 0x55592bfeda70 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe6effff640 1 -- 10.20.193.28:0/2182212071 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe7300cb2e0 con 0x55592bfeda70 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 10 client.15843 _ll_register_callbacks cb 0x55592beeb0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 1 -- 10.20.193.28:0/2182212071 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55592bf477f0 con 0x55592bfeda70 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe6effff640 1 -- 10.20.193.28:0/2182212071 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe730004260 con 0x55592bfeda70 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 10 client.15843 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 1 -- 10.20.193.28:0/2182212071 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55592bf0c430 con 0x55592bfeda70 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe6effff640 1 -- 10.20.193.28:0/2182212071 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fe7300cb4e0 con 0x55592bfeda70 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 10 client.15843 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 20 client.15843 populate_metadata read hostname 'trial028' 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55592c015ac0 0x55592c017f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 4 client.15843 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74689be00 1 -- 10.20.193.28:0/2182212071 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55592bec1c00 con 0x55592c015ac0 2026-02-20T03:17:25.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.519+0000 7fe74210b640 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55592c015ac0 0x55592c017f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.520+0000 7fe74210b640 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55592c015ac0 0x55592c017f60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6801576c40213c25 server_cookie=2ab7f155f9ab73fa in_seq=0 out_seq=0 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.520+0000 7fe6effff640 10 client.15843 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.520+0000 7fe6effff640 1 -- 10.20.193.28:0/2182212071 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55592bec1c00 con 0x55592c015ac0 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.520+0000 7fe6effff640 10 client.15843 handle_command_reply: tid=0 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.520+0000 7fe74689be00 1 client.15843 shutdown 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.520+0000 7fe74689be00 1 -- 10.20.193.28:0/2182212071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 msgr2=0x55592c007930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.520+0000 7fe74689be00 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c007930 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe7300cc560 tx=0x7fe7300046a0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe74689be00 1 -- 10.20.193.28:0/2182212071 shutdown_connections 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe74689be00 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55592c015ac0 0x55592c017f60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe74689be00 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bff1b60 0x55592c005b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe74689be00 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c007930 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe6effff640 0 client.15843 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe74689be00 1 --2- 10.20.193.28:0/2182212071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfed0c0 0x55592c0073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe74689be00 1 -- 10.20.193.28:0/2182212071 >> 10.20.193.28:0/2182212071 conn(0x55592bfe5b60 msgr2=0x55592bff0520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe74689be00 1 -- 10.20.193.28:0/2182212071 shutdown_connections 2026-02-20T03:17:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe74689be00 1 -- 10.20.193.28:0/2182212071 wait complete. 2026-02-20T03:17:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.521+0000 7fe74689be00 20 client.15843 trim_cache size 0 max 16384 2026-02-20T03:17:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.529+0000 7fe74689be00 1 Processor -- start 2026-02-20T03:17:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.529+0000 7fe74689be00 1 -- start start 2026-02-20T03:17:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.529+0000 7fe74689be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 0x55592c01d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.529+0000 7fe74689be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c01dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.529+0000 7fe74689be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bff1b60 0x55592c0114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.529+0000 7fe74689be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e4012750 con 0x55592bfeda70 2026-02-20T03:17:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.529+0000 7fe74689be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e400ffc0 con 0x55592bfed0c0 2026-02-20T03:17:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.529+0000 7fe74689be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e400de10 con 0x55592bff1b60 2026-02-20T03:17:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74190a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c01dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74190a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c01dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45168/0 (socket says 10.20.193.28:45168) 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74190a640 1 -- 10.20.193.28:0/1587054331 learned_addr learned my addr 10.20.193.28:0/1587054331 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74190a640 1 -- 10.20.193.28:0/1587054331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bff1b60 msgr2=0x55592c0114b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74190a640 1 --2- 10.20.193.28:0/1587054331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bff1b60 0x55592c0114b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74190a640 1 -- 10.20.193.28:0/1587054331 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 msgr2=0x55592c01d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74210b640 1 --2- 10.20.193.28:0/1587054331 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 0x55592c01d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74190a640 1 --2- 10.20.193.28:0/1587054331 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 0x55592c01d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74190a640 1 -- 10.20.193.28:0/1587054331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592bfff350 con 0x55592bfeda70 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74210b640 1 --2- 10.20.193.28:0/1587054331 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 0x55592c01d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe74190a640 1 --2- 10.20.193.28:0/1587054331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c01dd70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe730002a50 tx=0x7fe730104030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54fc032b86b7582 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:25.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe70a4e6640 1 -- 10.20.193.28:0/1587054331 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73002fd30 con 0x55592bfeda70 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe70a4e6640 1 -- 10.20.193.28:0/1587054331 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe7300d3e50 con 0x55592bfeda70 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.530+0000 7fe70a4e6640 1 -- 10.20.193.28:0/1587054331 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300c8270 con 0x55592bfeda70 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.531+0000 7fe74689be00 1 -- 10.20.193.28:0/1587054331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 msgr2=0x55592c01dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.531+0000 7fe74689be00 1 --2- 10.20.193.28:0/1587054331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c01dd70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe730002a50 tx=0x7fe730104030 comp rx=0 tx=0).stop 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.531+0000 7fe74689be00 1 -- 10.20.193.28:0/1587054331 shutdown_connections 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.531+0000 7fe74689be00 1 --2- 10.20.193.28:0/1587054331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bff1b60 0x55592c0114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.531+0000 7fe74689be00 1 --2- 10.20.193.28:0/1587054331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bfeda70 0x55592c01dd70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.531+0000 7fe74689be00 1 --2- 10.20.193.28:0/1587054331 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 0x55592c01d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.531+0000 7fe74689be00 1 -- 10.20.193.28:0/1587054331 >> 10.20.193.28:0/1587054331 conn(0x55592bfe5b60 msgr2=0x55592bff1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.531+0000 7fe74689be00 1 -- 10.20.193.28:0/1587054331 shutdown_connections 2026-02-20T03:17:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.531+0000 7fe74689be00 1 -- 10.20.193.28:0/1587054331 wait complete. 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74689be00 1 -- start start 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74689be00 1 Processor -- start 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74689be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 0x55592c0769b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74689be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74689be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bff1b60 0x55592c077430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74689be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e400e480 con 0x55592bff1b60 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74689be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e400f8f0 con 0x55592bfed0c0 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74689be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e400eb50 con 0x55592bfeda70 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74190a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74290c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bff1b60 0x55592c077430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74190a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592c076ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54010/0 (socket says 10.20.193.28:54010) 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.532+0000 7fe74190a640 1 -- 10.20.193.28:0/1727906931 learned_addr learned my addr 10.20.193.28:0/1727906931 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74210b640 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 0x55592c0769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74190a640 1 -- 10.20.193.28:0/1727906931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 msgr2=0x55592c0769b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74190a640 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 0x55592c0769b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74190a640 1 -- 10.20.193.28:0/1727906931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bff1b60 msgr2=0x55592c077430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74190a640 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bff1b60 0x55592c077430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74190a640 1 -- 10.20.193.28:0/1727906931 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55592bc1e900 con 0x55592bfeda70 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74290c640 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bff1b60 0x55592c077430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74190a640 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592c076ef0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe7300cc7f0 tx=0x7fe7300d0b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b507de335afd5c45 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe6effff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe6effff640 1 -- 10.20.193.28:0/1727906931 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300cb870 con 0x55592bfeda70 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74689be00 1 -- 10.20.193.28:0/1727906931 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55592befa4d0 con 0x55592bfeda70 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74689be00 10 client.25789 _ll_register_callbacks cb 0x7fe7300cc720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:25.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe74689be00 1 -- 10.20.193.28:0/1727906931 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe72c010c70 con 0x55592bfeda70 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe6effff640 1 -- 10.20.193.28:0/1727906931 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55592bf477f0 con 0x55592bfeda70 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.533+0000 7fe6effff640 1 -- 10.20.193.28:0/1727906931 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7300e1ce0 con 0x55592bfeda70 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe6effff640 1 -- 10.20.193.28:0/1727906931 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe7300d4f50 con 0x55592bfeda70 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe6effff640 1 -- 10.20.193.28:0/1727906931 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe7300d5230 con 0x55592bfeda70 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe74689be00 10 client.25789 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe74689be00 1 -- 10.20.193.28:0/1727906931 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55592c000040 con 0x55592bfeda70 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe6effff640 1 -- 10.20.193.28:0/1727906931 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fe7300cba10 con 0x55592bfeda70 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe74689be00 10 client.25789 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe74689be00 10 client.25789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe74689be00 20 client.25789 populate_metadata read hostname 'trial028' 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe74689be00 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55592c015ac0 0x55592c0849d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe74689be00 4 client.25789 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe74689be00 1 -- 10.20.193.28:0/1727906931 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55592bcafa20 con 0x55592c015ac0 2026-02-20T03:17:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.534+0000 7fe74210b640 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55592c015ac0 0x55592c0849d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:25.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.536+0000 7fe74210b640 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55592c015ac0 0x55592c0849d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5edd444625e737c9 server_cookie=518a48685507c1f2 in_seq=0 out_seq=0 2026-02-20T03:17:25.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.536+0000 7fe6effff640 10 client.25789 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:25.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.536+0000 7fe6effff640 1 -- 10.20.193.28:0/1727906931 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55592bcafa20 con 0x55592c015ac0 2026-02-20T03:17:25.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.536+0000 7fe6effff640 10 client.25789 handle_command_reply: tid=0 2026-02-20T03:17:25.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 client.25789 shutdown 2026-02-20T03:17:25.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 -- 10.20.193.28:0/1727906931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 msgr2=0x55592c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592c076ef0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe7300cc7f0 tx=0x7fe7300d0b60 comp rx=0 tx=0).stop 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 -- 10.20.193.28:0/1727906931 shutdown_connections 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55592c015ac0 0x55592c0849d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55592bff1b60 0x55592c077430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55592bfeda70 0x55592c076ef0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 --2- 10.20.193.28:0/1727906931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55592bfed0c0 0x55592c0769b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 -- 10.20.193.28:0/1727906931 >> 10.20.193.28:0/1727906931 conn(0x55592bfe5b60 msgr2=0x55592bff2760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe6effff640 0 client.25789 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.537+0000 7fe74689be00 1 -- 10.20.193.28:0/1727906931 shutdown_connections 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.538+0000 7fe74689be00 1 -- 10.20.193.28:0/1727906931 wait complete. 2026-02-20T03:17:25.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.538+0000 7fe74689be00 20 client.25789 trim_cache size 0 max 16384 2026-02-20T03:17:25.541 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:17:25.541 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:17:25.541 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "0b2ca088-47b2-4c22-a658-bfe3ff557b81", 2026-02-20T03:17:25.541 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:17:25.541 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:17:25.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.538+0000 7fe74310d640 1 -- 10.20.193.28:0/2916411518 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe7180b0e20 msgr2=0x7fe7180b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.538+0000 7fe74310d640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe7180b0e20 0x7fe7180b32e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe738009fd0 tx=0x7fe73800b040 comp rx=0 tx=0).stop 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.538+0000 7fe74310d640 1 -- 10.20.193.28:0/2916411518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c105320 msgr2=0x7fe73c10e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.538+0000 7fe74310d640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c105320 0x7fe73c10e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe73002f650 tx=0x7fe7300029e0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.539+0000 7fe74310d640 1 -- 10.20.193.28:0/2916411518 shutdown_connections 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.539+0000 7fe74310d640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe7180b0e20 0x7fe7180b32e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.539+0000 7fe74310d640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe73c10a980 0x7fe73c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.539+0000 7fe74310d640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe73c105320 0x7fe73c10e770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.539+0000 7fe74310d640 1 --2- 10.20.193.28:0/2916411518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe73c104980 0x7fe73c1116c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.539+0000 7fe74310d640 1 -- 10.20.193.28:0/2916411518 >> 10.20.193.28:0/2916411518 conn(0x7fe73c100680 msgr2=0x7fe73c101020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.539+0000 7fe74310d640 1 -- 10.20.193.28:0/2916411518 shutdown_connections 2026-02-20T03:17:25.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:25.539+0000 7fe74310d640 1 -- 10.20.193.28:0/2916411518 wait complete. 2026-02-20T03:17:25.642 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:17:25.974 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:26.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.228+0000 7f5ed7fff640 1 -- 10.20.193.28:0/4241513189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed8104980 msgr2=0x7f5ed8104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:26.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.228+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/4241513189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed8104980 0x7f5ed8104de0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009a60 tx=0x7f5ec002f250 comp rx=0 tx=0).stop 2026-02-20T03:17:26.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.228+0000 7f5ed7fff640 1 -- 10.20.193.28:0/4241513189 shutdown_connections 2026-02-20T03:17:26.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.228+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/4241513189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ed8105320 0x7f5ed8111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.228+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/4241513189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed8104980 0x7f5ed8104de0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.228+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/4241513189 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ed810a980 0x7f5ed810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.228+0000 7f5ed7fff640 1 -- 10.20.193.28:0/4241513189 >> 10.20.193.28:0/4241513189 conn(0x7f5ed8100680 msgr2=0x7f5ed8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:26.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.228+0000 7f5ed7fff640 1 -- 10.20.193.28:0/4241513189 shutdown_connections 2026-02-20T03:17:26.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.228+0000 7f5ed7fff640 1 -- 10.20.193.28:0/4241513189 wait complete. 2026-02-20T03:17:26.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.229+0000 7f5ed7fff640 1 Processor -- start 2026-02-20T03:17:26.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.229+0000 7f5ed7fff640 1 -- start start 2026-02-20T03:17:26.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.229+0000 7f5ed7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ed8104980 0x7f5ed81116d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.229+0000 7f5ed7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ed8105320 0x7f5ed810e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.229+0000 7f5ed7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed810a980 0x7f5ed810ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.229+0000 7f5ed7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed8114bf0 con 0x7f5ed810a980 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.229+0000 7f5ed7fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed8114a70 con 0x7f5ed8105320 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.229+0000 7f5ed7fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed8114d70 con 0x7f5ed8104980 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed810a980 0x7f5ed810ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed810a980 0x7f5ed810ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51254/0 (socket says 10.20.193.28:51254) 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed77fe640 1 -- 10.20.193.28:0/3605931522 learned_addr learned my addr 10.20.193.28:0/3605931522 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ed8105320 0x7f5ed810e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed77fe640 1 -- 10.20.193.28:0/3605931522 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ed8104980 msgr2=0x7f5ed81116d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed77fe640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ed8104980 0x7f5ed81116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed77fe640 1 -- 10.20.193.28:0/3605931522 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ed8105320 msgr2=0x7f5ed810e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed77fe640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ed8105320 0x7f5ed810e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed77fe640 1 -- 10.20.193.28:0/3605931522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed81ada50 con 0x7f5ed810a980 2026-02-20T03:17:26.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed77fe640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed810a980 0x7f5ed810ee70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8004820 tx=0x7f5ec800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:26.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5eb7fff640 1 -- 10.20.193.28:0/3605931522 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80090d0 con 0x7f5ed810a980 2026-02-20T03:17:26.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5eb7fff640 1 -- 10.20.193.28:0/3605931522 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5ec8009270 con 0x7f5ed810a980 2026-02-20T03:17:26.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5eb7fff640 1 -- 10.20.193.28:0/3605931522 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80138b0 con 0x7f5ed810a980 2026-02-20T03:17:26.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.230+0000 7f5ed7fff640 1 -- 10.20.193.28:0/3605931522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed81adc20 con 0x7f5ed810a980 2026-02-20T03:17:26.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ed8105320 0x7f5ed810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:26.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed7fff640 1 -- 10.20.193.28:0/3605931522 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed81ae0b0 con 0x7f5ed810a980 2026-02-20T03:17:26.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5eb7fff640 1 -- 10.20.193.28:0/3605931522 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5ec8012070 con 0x7f5ed810a980 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 Processor -- start 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 -- start start 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d6263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620630 0x558a6d620a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 0x558a6d62ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558a6d5a0e50 con 0x558a6d620fb0 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558a6d5739c0 con 0x558a6d626000 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558a6d521240 con 0x558a6d620630 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed67fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d6263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620630 0x558a6d620a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620630 0x558a6d620a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49766/0 (socket says 10.20.193.28:49766) 2026-02-20T03:17:26.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed6ffd640 1 -- 10.20.193.28:0/662168062 learned_addr learned my addr 10.20.193.28:0/662168062 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/662168062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 0x558a6d62ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5eb7fff640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ea80b0e20 0x7f5ea80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5eb7fff640 1 -- 10.20.193.28:0/3605931522 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5ec80e03a0 con 0x7f5ed810a980 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed67fc640 1 -- 10.20.193.28:0/662168062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620630 msgr2=0x558a6d620a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/662168062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620630 0x558a6d620a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed67fc640 1 -- 10.20.193.28:0/662168062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 msgr2=0x558a6d62ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/662168062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 0x558a6d62ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed67fc640 1 -- 10.20.193.28:0/662168062 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6d534420 con 0x558a6d626000 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/662168062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620630 0x558a6d620a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/662168062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d6263e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ed810ff40 tx=0x7f5ec0009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10b73de899d1c9c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed77fe640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ea80b0e20 0x7f5ea80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5e9f7fe640 1 -- 10.20.193.28:0/662168062 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00026e0 con 0x558a6d626000 2026-02-20T03:17:26.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5e9f7fe640 1 -- 10.20.193.28:0/662168062 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5ec0033070 con 0x558a6d626000 2026-02-20T03:17:26.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5e9f7fe640 1 -- 10.20.193.28:0/662168062 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00044c0 con 0x558a6d626000 2026-02-20T03:17:26.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 -- 10.20.193.28:0/662168062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 msgr2=0x558a6d6263e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:26.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/662168062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d6263e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5ed810ff40 tx=0x7f5ec0009340 comp rx=0 tx=0).stop 2026-02-20T03:17:26.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5ed77fe640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ea80b0e20 0x7f5ea80b32e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80a3f10 tx=0x7f5ec80097e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:26.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 -- 10.20.193.28:0/662168062 shutdown_connections 2026-02-20T03:17:26.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/662168062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 0x558a6d62ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/662168062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620630 0x558a6d620a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/662168062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d6263e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 -- 10.20.193.28:0/662168062 >> 10.20.193.28:0/662168062 conn(0x558a6d5e3290 msgr2=0x558a6d61ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 -- 10.20.193.28:0/662168062 shutdown_connections 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.231+0000 7f5edfa57e00 1 -- 10.20.193.28:0/662168062 wait complete. 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 -- start start 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 Processor -- start 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d63ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 0x558a6d63b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d626000 0x558a6d639390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558a6d56f8f0 con 0x558a6d620fb0 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558a6d361f50 con 0x558a6d620630 2026-02-20T03:17:26.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558a6d639b10 con 0x558a6d626000 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d626000 0x558a6d639390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d63ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d63ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50076/0 (socket says 10.20.193.28:50076) 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 -- 10.20.193.28:0/2794174312 learned_addr learned my addr 10.20.193.28:0/2794174312 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 0x558a6d63b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 -- 10.20.193.28:0/2794174312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d626000 msgr2=0x558a6d639390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d626000 0x558a6d639390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 -- 10.20.193.28:0/2794174312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 msgr2=0x558a6d63b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 0x558a6d63b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 -- 10.20.193.28:0/2794174312 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6d632b40 con 0x558a6d620630 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 0x558a6d63b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d63ac50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009730 tx=0x7f5ec00023d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f8978bfb687ebf9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5e9cff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:17:26.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5e9cff9640 1 -- 10.20.193.28:0/2794174312 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec002fc70 con 0x558a6d620630 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5e9cff9640 1 -- 10.20.193.28:0/2794174312 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5ec0038770 con 0x558a6d620630 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5e9cff9640 1 -- 10.20.193.28:0/2794174312 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00476b0 con 0x558a6d620630 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 -- 10.20.193.28:0/2794174312 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a6d344b40 con 0x558a6d620630 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5e9cff9640 1 -- 10.20.193.28:0/2794174312 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5ec0004160 con 0x558a6d620630 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 10 client.25805 _ll_register_callbacks cb 0x558a6d5acf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 -- 10.20.193.28:0/2794174312 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a6d5811a0 con 0x558a6d620630 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5e9cff9640 1 -- 10.20.193.28:0/2794174312 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5ec0038920 con 0x558a6d620630 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 10 client.25805 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 -- 10.20.193.28:0/2794174312 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=26}) -- 0x558a6d52e230 con 0x558a6d620630 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5e9cff9640 1 -- 10.20.193.28:0/2794174312 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f5ec0038c20 con 0x558a6d620630 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 10 client.25805 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 10 client.25805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 20 client.25805 populate_metadata read hostname 'trial028' 2026-02-20T03:17:26.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558a6d6493b0 0x558a6d64b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 4 client.25805 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:26.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5edfa57e00 1 -- 10.20.193.28:0/2794174312 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a6d57b5b0 con 0x558a6d6493b0 2026-02-20T03:17:26.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.237+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558a6d6493b0 0x558a6d64b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558a6d6493b0 0x558a6d64b7a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6deec138f41949e server_cookie=789d2862c91a1995 in_seq=0 out_seq=0 2026-02-20T03:17:26.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5e9cff9640 10 client.25805 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:26.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5e9cff9640 1 -- 10.20.193.28:0/2794174312 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x558a6d57b5b0 con 0x558a6d6493b0 2026-02-20T03:17:26.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5e9cff9640 10 client.25805 handle_command_reply: tid=0 2026-02-20T03:17:26.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 client.25805 shutdown 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 -- 10.20.193.28:0/2794174312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 msgr2=0x558a6d63ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d63ac50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009730 tx=0x7f5ec00023d0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 -- 10.20.193.28:0/2794174312 shutdown_connections 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558a6d6493b0 0x558a6d64b7a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d626000 0x558a6d639390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620fb0 0x558a6d63b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/2794174312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d63ac50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 -- 10.20.193.28:0/2794174312 >> 10.20.193.28:0/2794174312 conn(0x558a6d5e3290 msgr2=0x558a6d61f440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5e9cff9640 0 client.25805 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 -- 10.20.193.28:0/2794174312 shutdown_connections 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 1 -- 10.20.193.28:0/2794174312 wait complete. 2026-02-20T03:17:26.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.240+0000 7f5edfa57e00 20 client.25805 trim_cache size 0 max 16384 2026-02-20T03:17:26.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5edfa57e00 1 Processor -- start 2026-02-20T03:17:26.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5edfa57e00 1 -- start start 2026-02-20T03:17:26.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d623ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d61f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d626000 0x558a6d61fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c0126d0 con 0x558a6d626000 2026-02-20T03:17:26.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c00ff40 con 0x558a6d620630 2026-02-20T03:17:26.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c00dd90 con 0x558a6d620fb0 2026-02-20T03:17:26.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5ed6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d61f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5ed67fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d623ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5ed67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d626000 0x558a6d61fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5ed6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d61f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49784/0 (socket says 10.20.193.28:49784) 2026-02-20T03:17:26.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.246+0000 7f5ed6ffd640 1 -- 10.20.193.28:0/3767144515 learned_addr learned my addr 10.20.193.28:0/3767144515 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:26.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5ed6ffd640 1 -- 10.20.193.28:0/3767144515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 msgr2=0x558a6d623ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:26.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/3767144515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d623ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5ed6ffd640 1 -- 10.20.193.28:0/3767144515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d626000 msgr2=0x558a6d61fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:26.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/3767144515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d626000 0x558a6d61fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5ed6ffd640 1 -- 10.20.193.28:0/3767144515 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6d632970 con 0x558a6d620fb0 2026-02-20T03:17:26.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/3767144515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d626000 0x558a6d61fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/3767144515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d61f520 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x558a6d63a810 tx=0x7f5ecc009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db673dc24075d344 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5e9effd640 1 -- 10.20.193.28:0/3767144515 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc003dc0 con 0x558a6d620fb0 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5e9effd640 1 -- 10.20.193.28:0/3767144515 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5ecc01b870 con 0x558a6d620fb0 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5e9effd640 1 -- 10.20.193.28:0/3767144515 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc010870 con 0x558a6d620fb0 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 -- 10.20.193.28:0/3767144515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 msgr2=0x558a6d61f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/3767144515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d61f520 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x558a6d63a810 tx=0x7f5ecc009be0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 -- 10.20.193.28:0/3767144515 shutdown_connections 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/3767144515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d626000 0x558a6d61fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/3767144515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d61f520 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/3767144515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d620630 0x558a6d623ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 -- 10.20.193.28:0/3767144515 >> 10.20.193.28:0/3767144515 conn(0x558a6d5e3290 msgr2=0x558a6d6382c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 -- 10.20.193.28:0/3767144515 shutdown_connections 2026-02-20T03:17:26.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 -- 10.20.193.28:0/3767144515 wait complete. 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 -- start start 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 Processor -- start 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620630 0x558a6d64ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d64e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d64eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c00e400 con 0x558a6d620630 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c00f870 con 0x558a6d626000 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.251+0000 7f5edfa57e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7c00ead0 con 0x558a6d620fb0 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d64e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d64e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49790/0 (socket says 10.20.193.28:49790) 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed6ffd640 1 -- 10.20.193.28:0/1075065831 learned_addr learned my addr 10.20.193.28:0/1075065831 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620630 0x558a6d64ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d64eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed6ffd640 1 -- 10.20.193.28:0/1075065831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 msgr2=0x558a6d64eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:26.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d64eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed6ffd640 1 -- 10.20.193.28:0/1075065831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620630 msgr2=0x558a6d64ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:26.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620630 0x558a6d64ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed6ffd640 1 -- 10.20.193.28:0/1075065831 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6d252870 con 0x558a6d620fb0 2026-02-20T03:17:26.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d64eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:26.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed6ffd640 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d64e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc01b3d0 tx=0x7f5ecc01b400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f02c4c6017fed59 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:26.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:17:26.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 1 -- 10.20.193.28:0/1075065831 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc032070 con 0x558a6d620fb0 2026-02-20T03:17:26.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 -- 10.20.193.28:0/1075065831 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a6d513440 con 0x558a6d620fb0 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 1 -- 10.20.193.28:0/1075065831 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5ecc01bc20 con 0x558a6d620fb0 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 1 -- 10.20.193.28:0/1075065831 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc010e30 con 0x558a6d620fb0 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 10 client.25804 _ll_register_callbacks cb 0x7f5ec0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 -- 10.20.193.28:0/1075065831 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a6d525b00 con 0x558a6d620fb0 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 1 -- 10.20.193.28:0/1075065831 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5ecc003bc0 con 0x558a6d620fb0 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 1 -- 10.20.193.28:0/1075065831 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5ecc003dc0 con 0x558a6d620fb0 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 10 client.25804 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 -- 10.20.193.28:0/1075065831 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=26}) -- 0x558a6d633660 con 0x558a6d620fb0 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 1 -- 10.20.193.28:0/1075065831 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f5ecc02c070 con 0x558a6d620fb0 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 10 client.25804 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 10 client.25804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 20 client.25804 populate_metadata read hostname 'trial028' 2026-02-20T03:17:26.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558a6d6b5340 0x558a6d6b7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 4 client.25804 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 -- 10.20.193.28:0/1075065831 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f5ec0033070 con 0x558a6d6b5340 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558a6d6b5340 0x558a6d6b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed67fc640 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558a6d6b5340 0x558a6d6b7800 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=256ba686e755a00f server_cookie=600ce1e2db51ddbd in_seq=0 out_seq=0 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 10 client.25804 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 1 -- 10.20.193.28:0/1075065831 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f5ec0033070 con 0x558a6d6b5340 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 10 client.25804 handle_command_reply: tid=0 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 client.25804 shutdown 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 -- 10.20.193.28:0/1075065831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 msgr2=0x558a6d64e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d64e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc01b3d0 tx=0x7f5ecc01b400 comp rx=0 tx=0).stop 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 -- 10.20.193.28:0/1075065831 shutdown_connections 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558a6d6b5340 0x558a6d6b7800 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558a6d626000 0x558a6d64eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558a6d620fb0 0x558a6d64e320 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5e9cff9640 0 client.25804 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:26.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 --2- 10.20.193.28:0/1075065831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558a6d620630 0x558a6d64ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.264 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:17:26.264 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:17:26.264 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:17:26.264 INFO:teuthology.orchestra.run.trial028.stdout: "0b2ca088-47b2-4c22-a658-bfe3ff557b81": { 2026-02-20T03:17:26.264 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:17:26.264 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "0b2ca088-47b2-4c22-a658-bfe3ff557b81", 2026-02-20T03:17:26.265 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:17:26.265 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:26.265 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:26.265 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 -- 10.20.193.28:0/1075065831 >> 10.20.193.28:0/1075065831 conn(0x558a6d5e3290 msgr2=0x558a6d61e510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 -- 10.20.193.28:0/1075065831 shutdown_connections 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 1 -- 10.20.193.28:0/1075065831 wait complete. 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5edfa57e00 20 client.25804 trim_cache size 0 max 16384 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 -- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ea80b0e20 msgr2=0x7f5ea80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ea80b0e20 0x7f5ea80b32e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80a3f10 tx=0x7f5ec80097e0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 -- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed810a980 msgr2=0x7f5ed810ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed810a980 0x7f5ed810ee70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8004820 tx=0x7f5ec800d4a0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 -- 10.20.193.28:0/3605931522 shutdown_connections 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ea80b0e20 0x7f5ea80b32e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ed810a980 0x7f5ed810ee70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ed8105320 0x7f5ed810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 --2- 10.20.193.28:0/3605931522 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ed8104980 0x7f5ed81116d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:26.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.254+0000 7f5ed7fff640 1 -- 10.20.193.28:0/3605931522 >> 10.20.193.28:0/3605931522 conn(0x7f5ed8100680 msgr2=0x7f5ed8101050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:26.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.259+0000 7f5ed7fff640 1 -- 10.20.193.28:0/3605931522 shutdown_connections 2026-02-20T03:17:26.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:26.259+0000 7f5ed7fff640 1 -- 10.20.193.28:0/3605931522 wait complete. 2026-02-20T03:17:26.346 INFO:tasks.cephfs.filesystem:scrub status for tag:0b2ca088-47b2-4c22-a658-bfe3ff557b81 - {'path': '/', 'tag': '0b2ca088-47b2-4c22-a658-bfe3ff557b81', 'options': 'recursive,force'} 2026-02-20T03:17:26.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 15.59 MB/sec warmup 59 sec latency 5711.980 ms 2026-02-20T03:17:27.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:17:27.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:17:27.146 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:17:27.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:17:27.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:17:27.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:17:27.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.147 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:27 trial028 ceph-mon[38552]: pgmap v264: 129 pgs: 129 active+clean; 47 MiB data, 745 MiB used, 8.2 TiB / 8.2 TiB avail; 280 KiB/s rd, 3.8 MiB/s wr, 261 op/s 2026-02-20T03:17:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:17:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:17:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:17:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:17:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:17:27.348 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:17:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.349 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:27 trial126 ceph-mon[38476]: pgmap v264: 129 pgs: 129 active+clean; 47 MiB data, 745 MiB used, 8.2 TiB / 8.2 TiB avail; 280 KiB/s rd, 3.8 MiB/s wr, 261 op/s 2026-02-20T03:17:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:17:27.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:27 trial177 ceph-mon[43181]: pgmap v264: 129 pgs: 129 active+clean; 47 MiB data, 745 MiB used, 8.2 TiB / 8.2 TiB avail; 280 KiB/s rd, 3.8 MiB/s wr, 261 op/s 2026-02-20T03:17:27.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 15.33 MB/sec warmup 60 sec latency 6712.018 ms 2026-02-20T03:17:28.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 15.08 MB/sec warmup 61 sec latency 7712.062 ms 2026-02-20T03:17:29.194 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:29 trial028 ceph-mon[38552]: pgmap v265: 129 pgs: 129 active+clean; 42 MiB data, 757 MiB used, 8.2 TiB / 8.2 TiB avail; 234 KiB/s rd, 3.6 MiB/s wr, 269 op/s 2026-02-20T03:17:29.347 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:29 trial126 ceph-mon[38476]: pgmap v265: 129 pgs: 129 active+clean; 42 MiB data, 757 MiB used, 8.2 TiB / 8.2 TiB avail; 234 KiB/s rd, 3.6 MiB/s wr, 269 op/s 2026-02-20T03:17:29.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:29 trial177 ceph-mon[43181]: pgmap v265: 129 pgs: 129 active+clean; 42 MiB data, 757 MiB used, 8.2 TiB / 8.2 TiB avail; 234 KiB/s rd, 3.6 MiB/s wr, 269 op/s 2026-02-20T03:17:29.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 14.83 MB/sec warmup 62 sec latency 8712.124 ms 2026-02-20T03:17:30.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 14.60 MB/sec warmup 63 sec latency 9712.166 ms 2026-02-20T03:17:31.306 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:31 trial028 ceph-mon[38552]: pgmap v266: 129 pgs: 129 active+clean; 41 MiB data, 765 MiB used, 8.2 TiB / 8.2 TiB avail; 250 KiB/s rd, 4.3 MiB/s wr, 266 op/s 2026-02-20T03:17:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:31 trial177 ceph-mon[43181]: pgmap v266: 129 pgs: 129 active+clean; 41 MiB data, 765 MiB used, 8.2 TiB / 8.2 TiB avail; 250 KiB/s rd, 4.3 MiB/s wr, 266 op/s 2026-02-20T03:17:31.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 14.37 MB/sec warmup 64 sec latency 10712.219 ms 2026-02-20T03:17:31.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:31 trial126 ceph-mon[38476]: pgmap v266: 129 pgs: 129 active+clean; 41 MiB data, 765 MiB used, 8.2 TiB / 8.2 TiB avail; 250 KiB/s rd, 4.3 MiB/s wr, 266 op/s 2026-02-20T03:17:32.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 14.15 MB/sec warmup 65 sec latency 11712.256 ms 2026-02-20T03:17:33.187 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:33 trial028 ceph-mon[38552]: pgmap v267: 129 pgs: 129 active+clean; 41 MiB data, 762 MiB used, 8.2 TiB / 8.2 TiB avail; 252 KiB/s rd, 4.2 MiB/s wr, 264 op/s 2026-02-20T03:17:33.187 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:17:33.188 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:17:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:33 trial177 ceph-mon[43181]: pgmap v267: 129 pgs: 129 active+clean; 41 MiB data, 762 MiB used, 8.2 TiB / 8.2 TiB avail; 252 KiB/s rd, 4.2 MiB/s wr, 264 op/s 2026-02-20T03:17:33.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:17:33.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:17:33.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 13.94 MB/sec warmup 66 sec latency 12712.306 ms 2026-02-20T03:17:33.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:33 trial126 ceph-mon[38476]: pgmap v267: 129 pgs: 129 active+clean; 41 MiB data, 762 MiB used, 8.2 TiB / 8.2 TiB avail; 252 KiB/s rd, 4.2 MiB/s wr, 264 op/s 2026-02-20T03:17:33.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:17:33.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:17:34.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:34 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:17:34.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:17:34.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 13.73 MB/sec warmup 67 sec latency 13712.345 ms 2026-02-20T03:17:34.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:34 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:17:34.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:17:34.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:34 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:17:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:17:35.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:35 trial177 ceph-mon[43181]: pgmap v268: 129 pgs: 129 active+clean; 41 MiB data, 766 MiB used, 8.2 TiB / 8.2 TiB avail; 156 KiB/s rd, 3.9 MiB/s wr, 228 op/s 2026-02-20T03:17:35.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:17:35.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:17:35.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:17:35.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 13.53 MB/sec warmup 68 sec latency 14712.395 ms 2026-02-20T03:17:35.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:35 trial126 ceph-mon[38476]: pgmap v268: 129 pgs: 129 active+clean; 41 MiB data, 766 MiB used, 8.2 TiB / 8.2 TiB avail; 156 KiB/s rd, 3.9 MiB/s wr, 228 op/s 2026-02-20T03:17:35.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:17:35.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:17:35.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:17:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:35 trial028 ceph-mon[38552]: pgmap v268: 129 pgs: 129 active+clean; 41 MiB data, 766 MiB used, 8.2 TiB / 8.2 TiB avail; 156 KiB/s rd, 3.9 MiB/s wr, 228 op/s 2026-02-20T03:17:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:17:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:17:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:17:36.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- 10.20.193.28:0/1467920685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 msgr2=0x7fee2c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:36.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 --2- 10.20.193.28:0/1467920685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 0x7fee2c111480 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00b0a0 tx=0x7fee1c02f450 comp rx=0 tx=0).stop 2026-02-20T03:17:36.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- 10.20.193.28:0/1467920685 shutdown_connections 2026-02-20T03:17:36.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 --2- 10.20.193.28:0/1467920685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 0x7fee2c111480 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 --2- 10.20.193.28:0/1467920685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee2c109e60 0x7fee2c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 --2- 10.20.193.28:0/1467920685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee2c109490 0x7fee2c109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- 10.20.193.28:0/1467920685 >> 10.20.193.28:0/1467920685 conn(0x7fee2c077fe0 msgr2=0x7fee2c07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:36.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- 10.20.193.28:0/1467920685 shutdown_connections 2026-02-20T03:17:36.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- 10.20.193.28:0/1467920685 wait complete. 2026-02-20T03:17:36.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 Processor -- start 2026-02-20T03:17:36.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- start start 2026-02-20T03:17:36.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee2c109490 0x7fee2c1a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee2c109e60 0x7fee2c1a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 0x7fee2c1a8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c114a00 con 0x7fee2c10a900 2026-02-20T03:17:36.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c114880 con 0x7fee2c109490 2026-02-20T03:17:36.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c114b80 con 0x7fee2c109e60 2026-02-20T03:17:36.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 0x7fee2c1a8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:36.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 0x7fee2c1a8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40098/0 (socket says 10.20.193.28:40098) 2026-02-20T03:17:36.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2b7fe640 1 -- 10.20.193.28:0/4035901135 learned_addr learned my addr 10.20.193.28:0/4035901135 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:36.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2b7fe640 1 -- 10.20.193.28:0/4035901135 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee2c109e60 msgr2=0x7fee2c1a1500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:36.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2b7fe640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee2c109e60 0x7fee2c1a1500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2b7fe640 1 -- 10.20.193.28:0/4035901135 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee2c109490 msgr2=0x7fee2c1a0fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2b7fe640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee2c109490 0x7fee2c1a0fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2b7fe640 1 -- 10.20.193.28:0/4035901135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c1a8c70 con 0x7fee2c10a900 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2b7fe640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 0x7fee2c1a8570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00b1d0 tx=0x7fee1c0043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee0bfff640 1 -- 10.20.193.28:0/4035901135 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c004d40 con 0x7fee2c10a900 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee0bfff640 1 -- 10.20.193.28:0/4035901135 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fee1c0078c0 con 0x7fee2c10a900 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee0bfff640 1 -- 10.20.193.28:0/4035901135 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0387a0 con 0x7fee2c10a900 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- 10.20.193.28:0/4035901135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2c1a8f00 con 0x7fee2c10a900 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.141+0000 7fee2bfff640 1 -- 10.20.193.28:0/4035901135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2c1a9390 con 0x7fee2c10a900 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 Processor -- start 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee0bfff640 1 -- 10.20.193.28:0/4035901135 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fee1c007a70 con 0x7fee2c10a900 2026-02-20T03:17:36.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 -- start start 2026-02-20T03:17:36.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d7780ce80 0x558d7780d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780d7c0 0x558d77811f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d778149f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558d7775d8f0 con 0x558d77812560 2026-02-20T03:17:36.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558d7770b2e0 con 0x558d7780d7c0 2026-02-20T03:17:36.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558d77759820 con 0x558d7780ce80 2026-02-20T03:17:36.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d778149f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:36.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d778149f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40110/0 (socket says 10.20.193.28:40110) 2026-02-20T03:17:36.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2a7fc640 1 -- 10.20.193.28:0/3614742112 learned_addr learned my addr 10.20.193.28:0/3614742112 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:36.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2a7fc640 1 -- 10.20.193.28:0/3614742112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d7780ce80 msgr2=0x558d7780d280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:36.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2a7fc640 1 --2- 10.20.193.28:0/3614742112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d7780ce80 0x558d7780d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2a7fc640 1 -- 10.20.193.28:0/3614742112 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780d7c0 msgr2=0x558d77811f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:36.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2a7fc640 1 --2- 10.20.193.28:0/3614742112 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780d7c0 0x558d77811f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2a7fc640 1 -- 10.20.193.28:0/3614742112 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d776fd5a0 con 0x558d77812560 2026-02-20T03:17:36.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2a7fc640 1 --2- 10.20.193.28:0/3614742112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d778149f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fee140098a0 tx=0x7fee14009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e61b50647e10832 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:36.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee093fe640 1 -- 10.20.193.28:0/3614742112 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14016070 con 0x558d77812560 2026-02-20T03:17:36.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee093fe640 1 -- 10.20.193.28:0/3614742112 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fee14002870 con 0x558d77812560 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee093fe640 1 -- 10.20.193.28:0/3614742112 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee140046e0 con 0x558d77812560 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 -- 10.20.193.28:0/3614742112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 msgr2=0x558d778149f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 --2- 10.20.193.28:0/3614742112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d778149f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fee140098a0 tx=0x7fee14009d70 comp rx=0 tx=0).stop 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 -- 10.20.193.28:0/3614742112 shutdown_connections 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 --2- 10.20.193.28:0/3614742112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d778149f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 --2- 10.20.193.28:0/3614742112 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780d7c0 0x558d77811f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 --2- 10.20.193.28:0/3614742112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d7780ce80 0x558d7780d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 -- 10.20.193.28:0/3614742112 >> 10.20.193.28:0/3614742112 conn(0x558d778046f0 msgr2=0x558d7780b570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 -- 10.20.193.28:0/3614742112 shutdown_connections 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee34205e00 1 -- 10.20.193.28:0/3614742112 wait complete. 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee0bfff640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedfc0b0d80 0x7fedfc0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee0bfff640 1 -- 10.20.193.28:0/4035901135 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fee1c105820 con 0x7fee2c10a900 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2affd640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedfc0b0d80 0x7fedfc0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.146+0000 7fee2affd640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedfc0b0d80 0x7fedfc0b3240 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x558d7780deb0 tx=0x7fee20006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 -- start start 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 Processor -- start 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780ce80 0x558d77825b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d7780d7c0 0x558d77826040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d7782cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558d777050c0 con 0x558d77812560 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558d77815610 con 0x558d7780ce80 2026-02-20T03:17:36.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558d7782d550 con 0x558d7780d7c0 2026-02-20T03:17:36.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d7782cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:36.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d7782cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40126/0 (socket says 10.20.193.28:40126) 2026-02-20T03:17:36.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee2b7fe640 1 -- 10.20.193.28:0/1885611636 learned_addr learned my addr 10.20.193.28:0/1885611636 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:36.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee2b7fe640 1 -- 10.20.193.28:0/1885611636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d7780d7c0 msgr2=0x558d77826040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:36.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee2b7fe640 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d7780d7c0 0x558d77826040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee2b7fe640 1 -- 10.20.193.28:0/1885611636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780ce80 msgr2=0x558d77825b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:36.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee2b7fe640 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780ce80 0x558d77825b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee2b7fe640 1 -- 10.20.193.28:0/1885611636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7781f210 con 0x558d77812560 2026-02-20T03:17:36.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee2b7fe640 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d7782cfc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0cd490 tx=0x7fee1c0cdcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f4d768c102c3ab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:36.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fedf0bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:36.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fedf0bfc640 1 -- 10.20.193.28:0/1885611636 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0d64e0 con 0x558d77812560 2026-02-20T03:17:36.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fedf0bfc640 1 -- 10.20.193.28:0/1885611636 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fee1c033050 con 0x558d77812560 2026-02-20T03:17:36.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fedf0bfc640 1 -- 10.20.193.28:0/1885611636 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0cc1e0 con 0x558d77812560 2026-02-20T03:17:36.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 -- 10.20.193.28:0/1885611636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d77719820 con 0x558d77812560 2026-02-20T03:17:36.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fedf0bfc640 1 -- 10.20.193.28:0/1885611636 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fee1c002a60 con 0x558d77812560 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 10 client.15879 _ll_register_callbacks cb 0x558d77708ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 -- 10.20.193.28:0/1885611636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558d777654e0 con 0x558d77812560 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fedf0bfc640 1 -- 10.20.193.28:0/1885611636 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fee1c0c8c20 con 0x558d77812560 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 10 client.15879 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 -- 10.20.193.28:0/1885611636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x558d7771e380 con 0x558d77812560 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fedf0bfc640 1 -- 10.20.193.28:0/1885611636 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fee1c002c60 con 0x558d77812560 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 10 client.15879 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 20 client.15879 populate_metadata read hostname 'trial028' 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558d77831920 0x558d77833de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 4 client.15879 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:36.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.151+0000 7fee34205e00 1 -- 10.20.193.28:0/1885611636 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d776dfbd0 con 0x558d77831920 2026-02-20T03:17:36.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.179+0000 7fee2affd640 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558d77831920 0x558d77833de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:36.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.193+0000 7fee2affd640 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558d77831920 0x558d77833de0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2452bda756f7efd4 server_cookie=35f7d4a6eb75a7ee in_seq=0 out_seq=0 2026-02-20T03:17:36.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.193+0000 7fedf0bfc640 10 client.15879 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:36.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fedf0bfc640 1 -- 10.20.193.28:0/1885611636 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x558d776dfbd0 con 0x558d77831920 2026-02-20T03:17:36.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fedf0bfc640 10 client.15879 handle_command_reply: tid=0 2026-02-20T03:17:36.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 client.15879 shutdown 2026-02-20T03:17:36.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 -- 10.20.193.28:0/1885611636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 msgr2=0x558d7782cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:36.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d7782cfc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0cd490 tx=0x7fee1c0cdcd0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 -- 10.20.193.28:0/1885611636 shutdown_connections 2026-02-20T03:17:36.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558d77831920 0x558d77833de0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d77812560 0x558d7782cfc0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d7780d7c0 0x558d77826040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 --2- 10.20.193.28:0/1885611636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780ce80 0x558d77825b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 -- 10.20.193.28:0/1885611636 >> 10.20.193.28:0/1885611636 conn(0x558d778046f0 msgr2=0x558d778138b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:36.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fedf0bfc640 0 client.15879 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:36.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 -- 10.20.193.28:0/1885611636 shutdown_connections 2026-02-20T03:17:36.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 1 -- 10.20.193.28:0/1885611636 wait complete. 2026-02-20T03:17:36.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.220+0000 7fee34205e00 20 client.15879 trim_cache size 0 max 16384 2026-02-20T03:17:36.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 Processor -- start 2026-02-20T03:17:36.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- start start 2026-02-20T03:17:36.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780ce80 0x558d7780f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780d7c0 0x558d7782cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d77812560 0x558d77812940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fedd0012750 con 0x558d7780d7c0 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fedd000ffc0 con 0x558d7780ce80 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedd000de10 con 0x558d77812560 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780d7c0 0x558d7782cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780d7c0 0x558d7782cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40130/0 (socket says 10.20.193.28:40130) 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2a7fc640 1 -- 10.20.193.28:0/4181918144 learned_addr learned my addr 10.20.193.28:0/4181918144 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2a7fc640 1 -- 10.20.193.28:0/4181918144 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d77812560 msgr2=0x558d77812940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2a7fc640 1 --2- 10.20.193.28:0/4181918144 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d77812560 0x558d77812940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2a7fc640 1 -- 10.20.193.28:0/4181918144 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780ce80 msgr2=0x558d7780f470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:36.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2a7fc640 1 --2- 10.20.193.28:0/4181918144 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780ce80 0x558d7780f470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2a7fc640 1 -- 10.20.193.28:0/4181918144 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7781f040 con 0x558d7780d7c0 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2a7fc640 1 --2- 10.20.193.28:0/4181918144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780d7c0 0x558d7782cf80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fee140091a0 tx=0x7fee140095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794e63902d9d7df2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee08bfd640 1 -- 10.20.193.28:0/4181918144 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14021070 con 0x558d7780d7c0 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee08bfd640 1 -- 10.20.193.28:0/4181918144 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fee1400bd70 con 0x558d7780d7c0 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee08bfd640 1 -- 10.20.193.28:0/4181918144 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14016040 con 0x558d7780d7c0 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- 10.20.193.28:0/4181918144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780d7c0 msgr2=0x558d7782cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- 10.20.193.28:0/4181918144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780d7c0 0x558d7782cf80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fee140091a0 tx=0x7fee140095d0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- 10.20.193.28:0/4181918144 shutdown_connections 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- 10.20.193.28:0/4181918144 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d77812560 0x558d77812940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- 10.20.193.28:0/4181918144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780d7c0 0x558d7782cf80 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- 10.20.193.28:0/4181918144 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780ce80 0x558d7780f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- 10.20.193.28:0/4181918144 >> 10.20.193.28:0/4181918144 conn(0x558d778046f0 msgr2=0x558d778241f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:36.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- 10.20.193.28:0/4181918144 shutdown_connections 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- 10.20.193.28:0/4181918144 wait complete. 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- start start 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 Processor -- start 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780ce80 0x558d7782c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780d7c0 0x558d7782cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d77812560 0x558d77829450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fedd000e480 con 0x558d7780ce80 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fedd000f8f0 con 0x558d7780d7c0 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee34205e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedd000eb50 con 0x558d77812560 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.225+0000 7fee2affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780ce80 0x558d7782c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:36.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee2affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780ce80 0x558d7782c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40134/0 (socket says 10.20.193.28:40134) 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee2affd640 1 -- 10.20.193.28:0/2842322162 learned_addr learned my addr 10.20.193.28:0/2842322162 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee2affd640 1 -- 10.20.193.28:0/2842322162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d77812560 msgr2=0x558d77829450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee2affd640 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d77812560 0x558d77829450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee2affd640 1 -- 10.20.193.28:0/2842322162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780d7c0 msgr2=0x558d7782cdc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee2affd640 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780d7c0 0x558d7782cdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee2affd640 1 -- 10.20.193.28:0/2842322162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d77815370 con 0x558d7780ce80 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee2affd640 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780ce80 0x558d7782c880 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x558d77834650 tx=0x7fee20004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700946b021dc3a0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fedf0bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fedf0bfc640 1 -- 10.20.193.28:0/2842322162 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20013610 con 0x558d7780ce80 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fedf0bfc640 1 -- 10.20.193.28:0/2842322162 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fee20013c50 con 0x558d7780ce80 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fedf0bfc640 1 -- 10.20.193.28:0/2842322162 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20011df0 con 0x558d7780ce80 2026-02-20T03:17:36.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 1 -- 10.20.193.28:0/2842322162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d774bd690 con 0x558d7780ce80 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fedf0bfc640 1 -- 10.20.193.28:0/2842322162 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fee2001f340 con 0x558d7780ce80 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fedf0bfc640 10 client.15885 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 10 client.15885 _ll_register_callbacks cb 0x7fee1c0ccc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 1 -- 10.20.193.28:0/2842322162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee14002870 con 0x558d7780ce80 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fedf0bfc640 1 -- 10.20.193.28:0/2842322162 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fee2002d060 con 0x558d7780ce80 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 10 client.15885 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 1 -- 10.20.193.28:0/2842322162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x558d77722b70 con 0x558d7780ce80 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fedf0bfc640 1 -- 10.20.193.28:0/2842322162 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fee200137b0 con 0x558d7780ce80 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 10 client.15885 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 10 client.15885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 20 client.15885 populate_metadata read hostname 'trial028' 2026-02-20T03:17:36.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558d7789db30 0x558d7789fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:36.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 4 client.15885 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:17:36.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.230+0000 7fee34205e00 1 -- 10.20.193.28:0/2842322162 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d7772e6b0 con 0x558d7789db30 2026-02-20T03:17:36.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.233+0000 7fee2a7fc640 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558d7789db30 0x558d7789fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:36.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.301+0000 7fee2a7fc640 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558d7789db30 0x558d7789fff0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8170823dfd6869c server_cookie=2ed37317bd04fe9f in_seq=0 out_seq=0 2026-02-20T03:17:36.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.301+0000 7fedf0bfc640 10 client.15885 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:36.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fedf0bfc640 1 -- 10.20.193.28:0/2842322162 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d7772e6b0 con 0x558d7789db30 2026-02-20T03:17:36.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fedf0bfc640 10 client.15885 handle_command_reply: tid=0 2026-02-20T03:17:36.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 client.15885 shutdown 2026-02-20T03:17:36.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 -- 10.20.193.28:0/2842322162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780ce80 msgr2=0x558d7782c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:36.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780ce80 0x558d7782c880 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x558d77834650 tx=0x7fee20004850 comp rx=0 tx=0).stop 2026-02-20T03:17:36.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 -- 10.20.193.28:0/2842322162 shutdown_connections 2026-02-20T03:17:36.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558d7789db30 0x558d7789fff0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558d77812560 0x558d77829450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558d7780d7c0 0x558d7782cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 --2- 10.20.193.28:0/2842322162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558d7780ce80 0x558d7782c880 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fedf0bfc640 0 client.15885 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:36.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 -- 10.20.193.28:0/2842322162 >> 10.20.193.28:0/2842322162 conn(0x558d778046f0 msgr2=0x558d778227a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:36.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 -- 10.20.193.28:0/2842322162 shutdown_connections 2026-02-20T03:17:36.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 1 -- 10.20.193.28:0/2842322162 wait complete. 2026-02-20T03:17:36.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.382+0000 7fee34205e00 20 client.15885 trim_cache size 0 max 16384 2026-02-20T03:17:36.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:17:36.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:17:36.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:17:36.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:17:36.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 -- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedfc0b0d80 msgr2=0x7fedfc0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedfc0b0d80 0x7fedfc0b3240 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x558d7780deb0 tx=0x7fee20006cd0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 -- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 msgr2=0x7fee2c1a8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 0x7fee2c1a8570 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00b1d0 tx=0x7fee1c0043e0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 -- 10.20.193.28:0/4035901135 shutdown_connections 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedfc0b0d80 0x7fedfc0b3240 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee2c10a900 0x7fee2c1a8570 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee2c109e60 0x7fee2c1a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 --2- 10.20.193.28:0/4035901135 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee2c109490 0x7fee2c1a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 -- 10.20.193.28:0/4035901135 >> 10.20.193.28:0/4035901135 conn(0x7fee2c077fe0 msgr2=0x7fee2c10d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 -- 10.20.193.28:0/4035901135 shutdown_connections 2026-02-20T03:17:36.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:36.384+0000 7fee2bfff640 1 -- 10.20.193.28:0/4035901135 wait complete. 2026-02-20T03:17:36.498 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 13.33 MB/sec warmup 69 sec latency 15712.443 ms 2026-02-20T03:17:37.217 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:17:37.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:37 trial028 ceph-mon[38552]: pgmap v269: 129 pgs: 129 active+clean; 43 MiB data, 758 MiB used, 8.2 TiB / 8.2 TiB avail; 148 KiB/s rd, 4.0 MiB/s wr, 224 op/s 2026-02-20T03:17:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:37 trial177 ceph-mon[43181]: pgmap v269: 129 pgs: 129 active+clean; 43 MiB data, 758 MiB used, 8.2 TiB / 8.2 TiB avail; 148 KiB/s rd, 4.0 MiB/s wr, 224 op/s 2026-02-20T03:17:37.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 13.14 MB/sec warmup 70 sec latency 16712.476 ms 2026-02-20T03:17:37.537 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:37.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:37 trial126 ceph-mon[38476]: pgmap v269: 129 pgs: 129 active+clean; 43 MiB data, 758 MiB used, 8.2 TiB / 8.2 TiB avail; 148 KiB/s rd, 4.0 MiB/s wr, 224 op/s 2026-02-20T03:17:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.893+0000 7efeb7577640 1 -- 10.20.193.28:0/149917103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb8105320 msgr2=0x7efeb8111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.893+0000 7efeb7577640 1 --2- 10.20.193.28:0/149917103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb8105320 0x7efeb8111850 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7efea800b0d0 tx=0x7efea802f490 comp rx=0 tx=0).stop 2026-02-20T03:17:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.893+0000 7efeb7577640 1 -- 10.20.193.28:0/149917103 shutdown_connections 2026-02-20T03:17:37.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.893+0000 7efeb7577640 1 --2- 10.20.193.28:0/149917103 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb8105320 0x7efeb8111850 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:37.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.893+0000 7efeb7577640 1 --2- 10.20.193.28:0/149917103 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8104980 0x7efeb8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:37.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.893+0000 7efeb7577640 1 --2- 10.20.193.28:0/149917103 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb810a980 0x7efeb810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:37.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.893+0000 7efeb7577640 1 -- 10.20.193.28:0/149917103 >> 10.20.193.28:0/149917103 conn(0x7efeb8100680 msgr2=0x7efeb8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:37.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.893+0000 7efeb7577640 1 -- 10.20.193.28:0/149917103 shutdown_connections 2026-02-20T03:17:37.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.893+0000 7efeb7577640 1 -- 10.20.193.28:0/149917103 wait complete. 2026-02-20T03:17:37.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 Processor -- start 2026-02-20T03:17:37.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 -- start start 2026-02-20T03:17:37.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8104980 0x7efeb819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:37.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb8105320 0x7efeb819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8114cd0 con 0x7efeb810a980 2026-02-20T03:17:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8114b50 con 0x7efeb8105320 2026-02-20T03:17:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8114e50 con 0x7efeb8104980 2026-02-20T03:17:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40158/0 (socket says 10.20.193.28:40158) 2026-02-20T03:17:37.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb6d76640 1 -- 10.20.193.28:0/341998935 learned_addr learned my addr 10.20.193.28:0/341998935 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb6d76640 1 -- 10.20.193.28:0/341998935 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8104980 msgr2=0x7efeb819d1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:37.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb6d76640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8104980 0x7efeb819d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb6d76640 1 -- 10.20.193.28:0/341998935 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb8105320 msgr2=0x7efeb819d6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb6d76640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb8105320 0x7efeb819d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb6d76640 1 -- 10.20.193.28:0/341998935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb81a2200 con 0x7efeb810a980 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb6d76640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1a80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efea80077f0 tx=0x7efea8009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efe9f7fe640 1 -- 10.20.193.28:0/341998935 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8004590 con 0x7efeb810a980 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efe9f7fe640 1 -- 10.20.193.28:0/341998935 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efea8004730 con 0x7efeb810a980 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efe9f7fe640 1 -- 10.20.193.28:0/341998935 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea80052b0 con 0x7efeb810a980 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb81a2490 con 0x7efeb810a980 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81a9d30 con 0x7efeb810a980 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb8104e60 con 0x7efeb810a980 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.898+0000 7efe9f7fe640 1 -- 10.20.193.28:0/341998935 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efea8002a60 con 0x7efeb810a980 2026-02-20T03:17:37.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.903+0000 7efe9f7fe640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.903+0000 7efe9f7fe640 1 -- 10.20.193.28:0/341998935 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efea8105a70 con 0x7efeb810a980 2026-02-20T03:17:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.903+0000 7efeb6575640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.903+0000 7efe9f7fe640 1 -- 10.20.193.28:0/341998935 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7efea803d070 con 0x7efeb810a980 2026-02-20T03:17:37.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:37.903+0000 7efeb6575640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efeac009770 tx=0x7efeac006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:38.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.012+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efeb810ca80 con 0x7efeb810a980 2026-02-20T03:17:38.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.012+0000 7efe9f7fe640 1 -- 10.20.193.28:0/341998935 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11924 (secure 0 0 0) 0x7efea80048e0 con 0x7efeb810a980 2026-02-20T03:17:38.016 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:17:38.016 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T03:17:23:524010+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:17:23.524005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 msgr2=0x7efe900b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efeac009770 tx=0x7efeac006cd0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 msgr2=0x7efeb81a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1a80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efea80077f0 tx=0x7efea8009300 comp rx=0 tx=0).stop 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 shutdown_connections 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1a80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb8105320 0x7efeb819d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 --2- 10.20.193.28:0/341998935 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8104980 0x7efeb819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 >> 10.20.193.28:0/341998935 conn(0x7efeb8100680 msgr2=0x7efeb8100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:38.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 shutdown_connections 2026-02-20T03:17:38.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.014+0000 7efeb7577640 1 -- 10.20.193.28:0/341998935 wait complete. 2026-02-20T03:17:38.107 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 2514cb31 --release --await' 2026-02-20T03:17:38.107 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 2514cb31 --release --await 2026-02-20T03:17:38.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:38 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/341998935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:38.444 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:38.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:38 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/341998935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:38.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 167202 12.95 MB/sec warmup 71 sec latency 17712.508 ms 2026-02-20T03:17:38.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:38 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/341998935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:38.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.622+0000 7efc1bd04640 1 -- 10.20.193.28:0/3335418674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc14109ed0 msgr2=0x7efc14111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.622+0000 7efc1bd04640 1 --2- 10.20.193.28:0/3335418674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc14109ed0 0x7efc14111a50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efc1000b0a0 tx=0x7efc1002f410 comp rx=0 tx=0).stop 2026-02-20T03:17:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.622+0000 7efc1bd04640 1 -- 10.20.193.28:0/3335418674 shutdown_connections 2026-02-20T03:17:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.622+0000 7efc1bd04640 1 --2- 10.20.193.28:0/3335418674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc14109ed0 0x7efc14111a50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.622+0000 7efc1bd04640 1 --2- 10.20.193.28:0/3335418674 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efc14105750 0x7efc141097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.622+0000 7efc1bd04640 1 --2- 10.20.193.28:0/3335418674 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efc14104da0 0x7efc14105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.622+0000 7efc1bd04640 1 -- 10.20.193.28:0/3335418674 >> 10.20.193.28:0/3335418674 conn(0x7efc14100840 msgr2=0x7efc14102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.622+0000 7efc1bd04640 1 -- 10.20.193.28:0/3335418674 shutdown_connections 2026-02-20T03:17:38.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.623+0000 7efc1bd04640 1 -- 10.20.193.28:0/3335418674 wait complete. 2026-02-20T03:17:38.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.623+0000 7efc1bd04640 1 Processor -- start 2026-02-20T03:17:38.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.623+0000 7efc1bd04640 1 -- start start 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc1bd04640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efc14104da0 0x7efc1419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc1bd04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc14105750 0x7efc1419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc1bd04640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efc14109ed0 0x7efc141a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc1bd04640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc14114da0 con 0x7efc14105750 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc1bd04640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efc14114c20 con 0x7efc14109ed0 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc1bd04640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efc14114f20 con 0x7efc14104da0 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19a79640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efc14104da0 0x7efc1419d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19a79640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efc14104da0 0x7efc1419d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49746/0 (socket says 10.20.193.28:49746) 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19a79640 1 -- 10.20.193.28:0/2065103903 learned_addr learned my addr 10.20.193.28:0/2065103903 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19278640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc14105750 0x7efc1419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc1a27a640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efc14109ed0 0x7efc141a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19278640 1 -- 10.20.193.28:0/2065103903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efc14104da0 msgr2=0x7efc1419d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19278640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efc14104da0 0x7efc1419d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19278640 1 -- 10.20.193.28:0/2065103903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efc14109ed0 msgr2=0x7efc141a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19278640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efc14109ed0 0x7efc141a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19278640 1 -- 10.20.193.28:0/2065103903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc141a21b0 con 0x7efc14105750 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.624+0000 7efc19a79640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efc14104da0 0x7efc1419d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.625+0000 7efc19278640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc14105750 0x7efc1419d6a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e9f0 tx=0x7efc0800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.625+0000 7efc02ffd640 1 -- 10.20.193.28:0/2065103903 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0800cd80 con 0x7efc14105750 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.625+0000 7efc02ffd640 1 -- 10.20.193.28:0/2065103903 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efc08004570 con 0x7efc14105750 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.625+0000 7efc1bd04640 1 -- 10.20.193.28:0/2065103903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc141a24a0 con 0x7efc14105750 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.625+0000 7efc02ffd640 1 -- 10.20.193.28:0/2065103903 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08010690 con 0x7efc14105750 2026-02-20T03:17:38.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.625+0000 7efc1bd04640 1 -- 10.20.193.28:0/2065103903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc141a9ce0 con 0x7efc14105750 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc02ffd640 1 -- 10.20.193.28:0/2065103903 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efc08020030 con 0x7efc14105750 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc1e209e00 1 Processor -- start 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc1e209e00 1 -- start start 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d4b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d45930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d45f50 0x560d68d463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc1e209e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560d68c98a20 con 0x560d68d4b210 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc1e209e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560d68c462a0 con 0x560d68d45f50 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc1e209e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560d68c94950 con 0x560d68d4bb30 2026-02-20T03:17:38.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc19a79640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d45930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc19a79640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d45930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49762/0 (socket says 10.20.193.28:49762) 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc19a79640 1 -- 10.20.193.28:0/2178694979 learned_addr learned my addr 10.20.193.28:0/2178694979 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc19278640 1 --2- 10.20.193.28:0/2178694979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d45f50 0x560d68d463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.628+0000 7efc1a27a640 1 --2- 10.20.193.28:0/2178694979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d4b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc19a79640 1 -- 10.20.193.28:0/2178694979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d45f50 msgr2=0x560d68d463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc19a79640 1 --2- 10.20.193.28:0/2178694979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d45f50 0x560d68d463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc19a79640 1 -- 10.20.193.28:0/2178694979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 msgr2=0x560d68d4b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc19a79640 1 --2- 10.20.193.28:0/2178694979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d4b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc19a79640 1 -- 10.20.193.28:0/2178694979 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d68c290f0 con 0x560d68d4bb30 2026-02-20T03:17:38.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc19a79640 1 --2- 10.20.193.28:0/2178694979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d45930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc04004420 tx=0x7efc04002ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3adaeb5d09b95f8d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efbe24e6640 1 -- 10.20.193.28:0/2178694979 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc04011730 con 0x560d68d4bb30 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efbe24e6640 1 -- 10.20.193.28:0/2178694979 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efc04011d70 con 0x560d68d4bb30 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efbe24e6640 1 -- 10.20.193.28:0/2178694979 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0400ee30 con 0x560d68d4bb30 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc02ffd640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbf00b0da0 0x7efbf00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc02ffd640 1 -- 10.20.193.28:0/2065103903 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efc080e0a50 con 0x7efc14105750 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc1e209e00 1 -- 10.20.193.28:0/2178694979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 msgr2=0x560d68d45930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.629+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2178694979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d45930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc04004420 tx=0x7efc04002ab0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.630+0000 7efc1a27a640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbf00b0da0 0x7efbf00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.630+0000 7efc1e209e00 1 -- 10.20.193.28:0/2178694979 shutdown_connections 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.630+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2178694979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d45f50 0x560d68d463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.630+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2178694979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d45930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.630+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2178694979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d4b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.630+0000 7efc1e209e00 1 -- 10.20.193.28:0/2178694979 >> 10.20.193.28:0/2178694979 conn(0x560d68d3d1b0 msgr2=0x560d68d44030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:38.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.630+0000 7efc1e209e00 1 -- 10.20.193.28:0/2178694979 shutdown_connections 2026-02-20T03:17:38.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.630+0000 7efc1e209e00 1 -- 10.20.193.28:0/2178694979 wait complete. 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.630+0000 7efc1a27a640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbf00b0da0 0x7efbf00b3260 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efc10009e60 tx=0x7efc1003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.631+0000 7efc1e209e00 1 -- start start 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.631+0000 7efc1e209e00 1 Processor -- start 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.631+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d45f50 0x560d68d68a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d68f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4bb30 0x560d68d67180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc1e209e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560d68c40080 con 0x560d68d4b210 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc1e209e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560d68d52650 con 0x560d68d4bb30 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc1e209e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560d68d67900 con 0x560d68d45f50 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19278640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d68f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19a79640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d45f50 0x560d68d68a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc1a27a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4bb30 0x560d68d67180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19278640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d68f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40206/0 (socket says 10.20.193.28:40206) 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19278640 1 -- 10.20.193.28:0/2754703754 learned_addr learned my addr 10.20.193.28:0/2754703754 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19278640 1 -- 10.20.193.28:0/2754703754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d45f50 msgr2=0x560d68d68a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19278640 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d45f50 0x560d68d68a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19278640 1 -- 10.20.193.28:0/2754703754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4bb30 msgr2=0x560d68d67180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19278640 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4bb30 0x560d68d67180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19278640 1 -- 10.20.193.28:0/2754703754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d68d606b0 con 0x560d68d4b210 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc19278640 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d68f80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efc080a86c0 tx=0x7efc080a3d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37c7e4a169f24b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efbcf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efbcf7fe640 1 -- 10.20.193.28:0/2754703754 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc080a8500 con 0x560d68d4b210 2026-02-20T03:17:38.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc1e209e00 1 -- 10.20.193.28:0/2754703754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d68a69da0 con 0x560d68d4b210 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc1e209e00 10 client.15903 _ll_register_callbacks cb 0x560d68c43fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efc1e209e00 1 -- 10.20.193.28:0/2754703754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d68ca0610 con 0x560d68d4b210 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efbcf7fe640 1 -- 10.20.193.28:0/2754703754 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efc080a8e30 con 0x560d68d4b210 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.632+0000 7efbcf7fe640 1 -- 10.20.193.28:0/2754703754 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc080a7c50 con 0x560d68d4b210 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efbcf7fe640 1 -- 10.20.193.28:0/2754703754 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efc080cc070 con 0x560d68d4b210 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efbcf7fe640 1 -- 10.20.193.28:0/2754703754 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efc080a7e30 con 0x560d68d4b210 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efc1e209e00 10 client.15903 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efc1e209e00 1 -- 10.20.193.28:0/2754703754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x560d68c56020 con 0x560d68d4b210 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efbcf7fe640 1 -- 10.20.193.28:0/2754703754 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7efc080a3e50 con 0x560d68d4b210 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efc1e209e00 10 client.15903 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efc1e209e00 10 client.15903 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:17:38.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efc1e209e00 20 client.15903 populate_metadata read hostname 'trial028' 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560d68d77230 0x560d68d796d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efc1e209e00 4 client.15903 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efc1e209e00 1 -- 10.20.193.28:0/2754703754 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d68c1ab80 con 0x560d68d77230 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.633+0000 7efc19a79640 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560d68d77230 0x560d68d796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.634+0000 7efc19a79640 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560d68d77230 0x560d68d796d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cf7c84b8b3a07 server_cookie=1c764da043ebf0be in_seq=0 out_seq=0 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.634+0000 7efbcf7fe640 10 client.15903 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.634+0000 7efbcf7fe640 1 -- 10.20.193.28:0/2754703754 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560d68c1ab80 con 0x560d68d77230 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.634+0000 7efbcf7fe640 10 client.15903 handle_command_reply: tid=0 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.634+0000 7efc1e209e00 1 client.15903 shutdown 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 -- 10.20.193.28:0/2754703754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 msgr2=0x560d68d68f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d68f80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efc080a86c0 tx=0x7efc080a3d50 comp rx=0 tx=0).stop 2026-02-20T03:17:38.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 -- 10.20.193.28:0/2754703754 shutdown_connections 2026-02-20T03:17:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560d68d77230 0x560d68d796d0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4bb30 0x560d68d67180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d4b210 0x560d68d68f80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 --2- 10.20.193.28:0/2754703754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d45f50 0x560d68d68a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 -- 10.20.193.28:0/2754703754 >> 10.20.193.28:0/2754703754 conn(0x560d68d3d1b0 msgr2=0x560d68d44740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efbcf7fe640 0 client.15903 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 -- 10.20.193.28:0/2754703754 shutdown_connections 2026-02-20T03:17:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 1 -- 10.20.193.28:0/2754703754 wait complete. 2026-02-20T03:17:38.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.635+0000 7efc1e209e00 20 client.15903 trim_cache size 0 max 16384 2026-02-20T03:17:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc1e209e00 1 Processor -- start 2026-02-20T03:17:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc1e209e00 1 -- start start 2026-02-20T03:17:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 0x560d68d7efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d7f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d63750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc1e209e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efbc0012750 con 0x560d68d45f50 2026-02-20T03:17:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc1e209e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efbc000ffc0 con 0x560d68d4b210 2026-02-20T03:17:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc1e209e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efbc000de10 con 0x560d68d4bb30 2026-02-20T03:17:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc19278640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d7f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc19278640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d7f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36746/0 (socket says 10.20.193.28:36746) 2026-02-20T03:17:38.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc19278640 1 -- 10.20.193.28:0/700555532 learned_addr learned my addr 10.20.193.28:0/700555532 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:38.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc1a27a640 1 --2- 10.20.193.28:0/700555532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d63750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc19a79640 1 --2- 10.20.193.28:0/700555532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 0x560d68d7efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc19278640 1 -- 10.20.193.28:0/700555532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 msgr2=0x560d68d63750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:38.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc19278640 1 --2- 10.20.193.28:0/700555532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d63750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc19278640 1 -- 10.20.193.28:0/700555532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 msgr2=0x560d68d7efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:38.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc19278640 1 --2- 10.20.193.28:0/700555532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 0x560d68d7efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.644+0000 7efc19278640 1 -- 10.20.193.28:0/700555532 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d68d604e0 con 0x560d68d4b210 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc19278640 1 --2- 10.20.193.28:0/700555532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d7f520 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efc080e4010 tx=0x7efc0800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f94defb4f248fd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efbe1ce5640 1 -- 10.20.193.28:0/700555532 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc080a8e30 con 0x560d68d4b210 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efbe1ce5640 1 -- 10.20.193.28:0/700555532 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efc080e6040 con 0x560d68d4b210 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efbe1ce5640 1 -- 10.20.193.28:0/700555532 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc080a7890 con 0x560d68d4b210 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc1e209e00 1 -- 10.20.193.28:0/700555532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 msgr2=0x560d68d7f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc1e209e00 1 --2- 10.20.193.28:0/700555532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d7f520 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efc080e4010 tx=0x7efc0800cf20 comp rx=0 tx=0).stop 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc1e209e00 1 -- 10.20.193.28:0/700555532 shutdown_connections 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc1e209e00 1 --2- 10.20.193.28:0/700555532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d63750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc1e209e00 1 --2- 10.20.193.28:0/700555532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d7f520 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc1e209e00 1 --2- 10.20.193.28:0/700555532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 0x560d68d7efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc1e209e00 1 -- 10.20.193.28:0/700555532 >> 10.20.193.28:0/700555532 conn(0x560d68d3d1b0 msgr2=0x560d68d43810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc1e209e00 1 -- 10.20.193.28:0/700555532 shutdown_connections 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.645+0000 7efc1e209e00 1 -- 10.20.193.28:0/700555532 wait complete. 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.646+0000 7efc1e209e00 1 -- start start 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.646+0000 7efc1e209e00 1 Processor -- start 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.646+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 0x560d68d730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.646+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.646+0000 7efc1e209e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d70910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.646+0000 7efc1e209e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efbc000e480 con 0x560d68d45f50 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.646+0000 7efc1e209e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efbc000f8f0 con 0x560d68d4b210 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.646+0000 7efc1e209e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efbc000eb50 con 0x560d68d4bb30 2026-02-20T03:17:38.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1a27a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d70910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc19a79640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 0x560d68d730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1a27a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d70910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49782/0 (socket says 10.20.193.28:49782) 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1a27a640 1 -- 10.20.193.28:0/1919632205 learned_addr learned my addr 10.20.193.28:0/1919632205 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc19278640 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1a27a640 1 -- 10.20.193.28:0/1919632205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 msgr2=0x560d68d703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1a27a640 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1a27a640 1 -- 10.20.193.28:0/1919632205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 msgr2=0x560d68d730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1a27a640 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 0x560d68d730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1a27a640 1 -- 10.20.193.28:0/1919632205 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d68977ad0 con 0x560d68d4bb30 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc19a79640 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 0x560d68d730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1a27a640 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d70910 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc1000b0a0 tx=0x7efc1002f410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8888aa5366e9569 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:38.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efbcf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efbcf7fe640 1 -- 10.20.193.28:0/1919632205 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10053020 con 0x560d68d4bb30 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efbcf7fe640 1 -- 10.20.193.28:0/1919632205 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efc1004a040 con 0x560d68d4bb30 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efc1e209e00 1 -- 10.20.193.28:0/1919632205 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d68c1f370 con 0x560d68d4bb30 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.647+0000 7efbcf7fe640 1 -- 10.20.193.28:0/1919632205 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10043860 con 0x560d68d4bb30 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efbcf7fe640 1 -- 10.20.193.28:0/1919632205 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efc10043b40 con 0x560d68d4bb30 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 10 client.25822 _ll_register_callbacks cb 0x7efc080a3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 1 -- 10.20.193.28:0/1919632205 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d68a08bf0 con 0x560d68d4bb30 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efbcf7fe640 1 -- 10.20.193.28:0/1919632205 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efc100076a0 con 0x560d68d4bb30 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 10 client.25822 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 1 -- 10.20.193.28:0/1919632205 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=26}) -- 0x560d68d611d0 con 0x560d68d4bb30 2026-02-20T03:17:38.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efbcf7fe640 1 -- 10.20.193.28:0/1919632205 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7efc10007840 con 0x560d68d4bb30 2026-02-20T03:17:38.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 10 client.25822 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:38.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 10 client.25822 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:17:38.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 20 client.25822 populate_metadata read hostname 'trial028' 2026-02-20T03:17:38.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560d68de4170 0x560d68de6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:38.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 4 client.25822 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2514cb31", "release": true, "await": true}] 2026-02-20T03:17:38.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.648+0000 7efc1e209e00 1 -- 10.20.193.28:0/1919632205 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2514cb31", "release": true, "await": true}) -- 0x560d68ca63c0 con 0x560d68de4170 2026-02-20T03:17:38.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.649+0000 7efc19a79640 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560d68de4170 0x560d68de6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:38.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.649+0000 7efbcf7fe640 10 client.25822 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:38.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.649+0000 7efc19a79640 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560d68de4170 0x560d68de6630 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c24e1821a0ef75fb server_cookie=50088b4181bc1e20 in_seq=0 out_seq=0 2026-02-20T03:17:38.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efbcf7fe640 1 -- 10.20.193.28:0/1919632205 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560d68ca63c0 con 0x560d68de4170 2026-02-20T03:17:38.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efbcf7fe640 10 client.25822 handle_command_reply: tid=0 2026-02-20T03:17:38.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 client.25822 shutdown 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 -- 10.20.193.28:0/1919632205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 msgr2=0x560d68d70910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d70910 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efc1000b0a0 tx=0x7efc1002f410 comp rx=0 tx=0).stop 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 -- 10.20.193.28:0/1919632205 shutdown_connections 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560d68de4170 0x560d68de6630 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d68d4bb30 0x560d68d70910 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d68d4b210 0x560d68d703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 --2- 10.20.193.28:0/1919632205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d68d45f50 0x560d68d730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 -- 10.20.193.28:0/1919632205 >> 10.20.193.28:0/1919632205 conn(0x560d68d3d1b0 msgr2=0x560d68d44030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efbcf7fe640 0 client.25822 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 -- 10.20.193.28:0/1919632205 shutdown_connections 2026-02-20T03:17:38.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 1 -- 10.20.193.28:0/1919632205 wait complete. 2026-02-20T03:17:38.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.652+0000 7efc1e209e00 20 client.25822 trim_cache size 0 max 16384 2026-02-20T03:17:38.659 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:17:38.659 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 26, 2026-02-20T03:17:38.659 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:17:38.659 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 8, 2026-02-20T03:17:38.659 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:17:38.659 INFO:teuthology.orchestra.run.trial028.stdout: "2514cb31": { 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "version": 8, 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 140.3, 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:17:38.660 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:17:38.661 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:17:38.661 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:17:38.661 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:38.661 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:38.661 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:38.661 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:38.661 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:17:38.661 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:17:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 -- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbf00b0da0 msgr2=0x7efbf00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbf00b0da0 0x7efbf00b3260 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efc10009e60 tx=0x7efc1003a040 comp rx=0 tx=0).stop 2026-02-20T03:17:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 -- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc14105750 msgr2=0x7efc1419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc14105750 0x7efc1419d6a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7efc0800e9f0 tx=0x7efc0800eec0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 -- 10.20.193.28:0/2065103903 shutdown_connections 2026-02-20T03:17:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efbf00b0da0 0x7efbf00b3260 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efc14109ed0 0x7efc141a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efc14105750 0x7efc1419d6a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 --2- 10.20.193.28:0/2065103903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efc14104da0 0x7efc1419d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 -- 10.20.193.28:0/2065103903 >> 10.20.193.28:0/2065103903 conn(0x7efc14100840 msgr2=0x7efc14101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 -- 10.20.193.28:0/2065103903 shutdown_connections 2026-02-20T03:17:38.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:38.653+0000 7efc1bd04640 1 -- 10.20.193.28:0/2065103903 wait complete. 2026-02-20T03:17:38.756 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2514cb31', total seconds elapsed: 21.9 2026-02-20T03:17:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:39 trial177 ceph-mon[43181]: pgmap v270: 129 pgs: 129 active+clean; 43 MiB data, 757 MiB used, 8.2 TiB / 8.2 TiB avail; 205 KiB/s rd, 3.2 MiB/s wr, 184 op/s 2026-02-20T03:17:39.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 170537 13.04 MB/sec warmup 72 sec latency 17869.674 ms 2026-02-20T03:17:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:39 trial126 ceph-mon[38476]: pgmap v270: 129 pgs: 129 active+clean; 43 MiB data, 757 MiB used, 8.2 TiB / 8.2 TiB avail; 205 KiB/s rd, 3.2 MiB/s wr, 184 op/s 2026-02-20T03:17:39.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:39 trial028 ceph-mon[38552]: pgmap v270: 129 pgs: 129 active+clean; 43 MiB data, 757 MiB used, 8.2 TiB / 8.2 TiB avail; 205 KiB/s rd, 3.2 MiB/s wr, 184 op/s 2026-02-20T03:17:40.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 174147 13.12 MB/sec warmup 73 sec latency 8.118 ms 2026-02-20T03:17:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:41 trial177 ceph-mon[43181]: pgmap v271: 129 pgs: 129 active+clean; 42 MiB data, 749 MiB used, 8.2 TiB / 8.2 TiB avail; 513 KiB/s rd, 3.1 MiB/s wr, 193 op/s 2026-02-20T03:17:41.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 177774 13.20 MB/sec warmup 74 sec latency 8.494 ms 2026-02-20T03:17:41.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:41 trial126 ceph-mon[38476]: pgmap v271: 129 pgs: 129 active+clean; 42 MiB data, 749 MiB used, 8.2 TiB / 8.2 TiB avail; 513 KiB/s rd, 3.1 MiB/s wr, 193 op/s 2026-02-20T03:17:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:41 trial028 ceph-mon[38552]: pgmap v271: 129 pgs: 129 active+clean; 42 MiB data, 749 MiB used, 8.2 TiB / 8.2 TiB avail; 513 KiB/s rd, 3.1 MiB/s wr, 193 op/s 2026-02-20T03:17:42.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 181360 13.28 MB/sec warmup 75 sec latency 11.394 ms 2026-02-20T03:17:43.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:43 trial177 ceph-mon[43181]: pgmap v272: 129 pgs: 129 active+clean; 36 MiB data, 756 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 173 op/s 2026-02-20T03:17:43.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 185013 13.36 MB/sec warmup 76 sec latency 8.419 ms 2026-02-20T03:17:43.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:43 trial126 ceph-mon[38476]: pgmap v272: 129 pgs: 129 active+clean; 36 MiB data, 756 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 173 op/s 2026-02-20T03:17:43.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:43 trial028 ceph-mon[38552]: pgmap v272: 129 pgs: 129 active+clean; 36 MiB data, 756 MiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 173 op/s 2026-02-20T03:17:44.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 188691 13.44 MB/sec warmup 77 sec latency 7.538 ms 2026-02-20T03:17:45.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:45 trial177 ceph-mon[43181]: pgmap v273: 129 pgs: 129 active+clean; 38 MiB data, 738 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 200 op/s 2026-02-20T03:17:45.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 192421 13.52 MB/sec warmup 78 sec latency 6.945 ms 2026-02-20T03:17:45.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:45 trial126 ceph-mon[38476]: pgmap v273: 129 pgs: 129 active+clean; 38 MiB data, 738 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 200 op/s 2026-02-20T03:17:45.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:45 trial028 ceph-mon[38552]: pgmap v273: 129 pgs: 129 active+clean; 38 MiB data, 738 MiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 200 op/s 2026-02-20T03:17:46.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 196169 13.60 MB/sec warmup 79 sec latency 12.521 ms 2026-02-20T03:17:47.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:47 trial177 ceph-mon[43181]: pgmap v274: 129 pgs: 129 active+clean; 39 MiB data, 822 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 248 op/s 2026-02-20T03:17:47.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 200091 13.71 MB/sec warmup 80 sec latency 6.219 ms 2026-02-20T03:17:47.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:47 trial126 ceph-mon[38476]: pgmap v274: 129 pgs: 129 active+clean; 39 MiB data, 822 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 248 op/s 2026-02-20T03:17:47.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:47 trial028 ceph-mon[38552]: pgmap v274: 129 pgs: 129 active+clean; 39 MiB data, 822 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 2.2 MiB/s wr, 248 op/s 2026-02-20T03:17:48.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 203795 13.78 MB/sec warmup 81 sec latency 6.977 ms 2026-02-20T03:17:49.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.461+0000 7f07e8faf640 1 -- 10.20.193.28:0/1096253879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e4077050 msgr2=0x7f07e40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.461+0000 7f07e8faf640 1 --2- 10.20.193.28:0/1096253879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e4077050 0x7f07e40754a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009a30 tx=0x7f07d002f220 comp rx=0 tx=0).stop 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.461+0000 7f07e8faf640 1 -- 10.20.193.28:0/1096253879 shutdown_connections 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.461+0000 7f07e8faf640 1 --2- 10.20.193.28:0/1096253879 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f07e410a5f0 0x7f07e410ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.461+0000 7f07e8faf640 1 --2- 10.20.193.28:0/1096253879 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f07e40759e0 0x7f07e4075e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.461+0000 7f07e8faf640 1 --2- 10.20.193.28:0/1096253879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e4077050 0x7f07e40754a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.461+0000 7f07e8faf640 1 -- 10.20.193.28:0/1096253879 >> 10.20.193.28:0/1096253879 conn(0x7f07e40fde10 msgr2=0x7f07e4100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.461+0000 7f07e8faf640 1 -- 10.20.193.28:0/1096253879 shutdown_connections 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.461+0000 7f07e8faf640 1 -- 10.20.193.28:0/1096253879 wait complete. 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e8faf640 1 Processor -- start 2026-02-20T03:17:49.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e8faf640 1 -- start start 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e8faf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f07e40759e0 0x7f07e419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e8faf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f07e4077050 0x7f07e419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e8faf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e410a5f0 0x7f07e41a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e8faf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f07e41103c0 con 0x7f07e410a5f0 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e8faf640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f07e4110240 con 0x7f07e40759e0 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e8faf640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f07e4110540 con 0x7f07e4077050 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e410a5f0 0x7f07e41a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f07e4077050 0x7f07e419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e37fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f07e40759e0 0x7f07e419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e410a5f0 0x7f07e41a3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39980/0 (socket says 10.20.193.28:39980) 2026-02-20T03:17:49.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e3fff640 1 -- 10.20.193.28:0/2539472449 learned_addr learned my addr 10.20.193.28:0/2539472449 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e3fff640 1 -- 10.20.193.28:0/2539472449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f07e4077050 msgr2=0x7f07e419cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e3fff640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f07e4077050 0x7f07e419cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e3fff640 1 -- 10.20.193.28:0/2539472449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f07e40759e0 msgr2=0x7f07e419ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e3fff640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f07e40759e0 0x7f07e419ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.462+0000 7f07e3fff640 1 -- 10.20.193.28:0/2539472449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e41a46e0 con 0x7f07e410a5f0 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.463+0000 7f07e3fff640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e410a5f0 0x7f07e41a3fe0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f07d800ef30 tx=0x7f07d800c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.463+0000 7f07e0ff9640 1 -- 10.20.193.28:0/2539472449 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8019070 con 0x7f07e410a5f0 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.463+0000 7f07e0ff9640 1 -- 10.20.193.28:0/2539472449 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f07d80092d0 con 0x7f07e410a5f0 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.463+0000 7f07e0ff9640 1 -- 10.20.193.28:0/2539472449 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8007500 con 0x7f07e410a5f0 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.463+0000 7f07e8faf640 1 -- 10.20.193.28:0/2539472449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e41a4970 con 0x7f07e410a5f0 2026-02-20T03:17:49.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.463+0000 7f07e8faf640 1 -- 10.20.193.28:0/2539472449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e41a4e70 con 0x7f07e410a5f0 2026-02-20T03:17:49.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:49 trial177 ceph-mon[43181]: pgmap v275: 129 pgs: 129 active+clean; 44 MiB data, 868 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 351 op/s 2026-02-20T03:17:49.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.466+0000 7f07e0ff9640 1 -- 10.20.193.28:0/2539472449 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f07d80076a0 con 0x7f07e410a5f0 2026-02-20T03:17:49.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.466+0000 7f07ed097e00 1 Processor -- start 2026-02-20T03:17:49.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.466+0000 7f07ed097e00 1 -- start start 2026-02-20T03:17:49.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf3e80 0x55b264cf4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264cf8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 0x55b264cfb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07ed097e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b264c448f0 con 0x55b264cf3e80 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07ed097e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b264bf22e0 con 0x55b264cf9560 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07ed097e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b264c40820 con 0x55b264cf47c0 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf3e80 0x55b264cf4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf3e80 0x55b264cf4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39996/0 (socket says 10.20.193.28:39996) 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e2ffd640 1 -- 10.20.193.28:0/921491477 learned_addr learned my addr 10.20.193.28:0/921491477 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/921491477 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 0x55b264cfb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e37fe640 1 --2- 10.20.193.28:0/921491477 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264cf8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e0ff9640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07b80b0e20 0x7f07b80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e2ffd640 1 -- 10.20.193.28:0/921491477 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 msgr2=0x55b264cf8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/921491477 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264cf8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e2ffd640 1 -- 10.20.193.28:0/921491477 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 msgr2=0x55b264cfb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/921491477 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 0x55b264cfb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e2ffd640 1 -- 10.20.193.28:0/921491477 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b264be45a0 con 0x55b264cf3e80 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.467+0000 7f07e0ff9640 1 -- 10.20.193.28:0/2539472449 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f07d80e0840 con 0x7f07e410a5f0 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/921491477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf3e80 0x55b264cf4280 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009e10 tx=0x7f07d40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a232885cbe6573cd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07e3fff640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07b80b0e20 0x7f07b80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07a7fff640 1 -- 10.20.193.28:0/921491477 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4010460 con 0x55b264cf3e80 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07a7fff640 1 -- 10.20.193.28:0/921491477 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f07d4010aa0 con 0x55b264cf3e80 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07a7fff640 1 -- 10.20.193.28:0/921491477 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4012af0 con 0x55b264cf3e80 2026-02-20T03:17:49.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07ed097e00 1 -- 10.20.193.28:0/921491477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf3e80 msgr2=0x55b264cf4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:49.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07e3fff640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07b80b0e20 0x7f07b80b32e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07d80a5650 tx=0x7f07d8009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:49.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07ed097e00 1 --2- 10.20.193.28:0/921491477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf3e80 0x55b264cf4280 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009e10 tx=0x7f07d40040c0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07ed097e00 1 -- 10.20.193.28:0/921491477 shutdown_connections 2026-02-20T03:17:49.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07ed097e00 1 --2- 10.20.193.28:0/921491477 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 0x55b264cfb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07ed097e00 1 --2- 10.20.193.28:0/921491477 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264cf8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07ed097e00 1 --2- 10.20.193.28:0/921491477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf3e80 0x55b264cf4280 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07ed097e00 1 -- 10.20.193.28:0/921491477 >> 10.20.193.28:0/921491477 conn(0x55b264ceb6f0 msgr2=0x55b264cf2570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:49.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07ed097e00 1 -- 10.20.193.28:0/921491477 shutdown_connections 2026-02-20T03:17:49.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.468+0000 7f07ed097e00 1 -- 10.20.193.28:0/921491477 wait complete. 2026-02-20T03:17:49.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07ed097e00 1 -- start start 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07ed097e00 1 Processor -- start 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf3e80 0x55b264d1ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d1e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 0x55b264d25280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07ed097e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b264bec0c0 con 0x55b264cf47c0 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07ed097e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b264d0d9c0 con 0x55b264cf9560 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07ed097e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b264d25810 con 0x55b264cf3e80 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d1e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07e2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf3e80 0x55b264d1ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d1e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40002/0 (socket says 10.20.193.28:40002) 2026-02-20T03:17:49.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07e37fe640 1 -- 10.20.193.28:0/1862622971 learned_addr learned my addr 10.20.193.28:0/1862622971 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.470+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 0x55b264d25280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07e37fe640 1 -- 10.20.193.28:0/1862622971 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf3e80 msgr2=0x55b264d1ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07e37fe640 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf3e80 0x55b264d1ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07e37fe640 1 -- 10.20.193.28:0/1862622971 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 msgr2=0x55b264d25280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07e37fe640 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 0x55b264d25280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07e37fe640 1 -- 10.20.193.28:0/1862622971 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b264d174e0 con 0x55b264cf47c0 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07e37fe640 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d1e300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009a30 tx=0x7f07d00059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2578c7c7a35a953 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07a57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07a57fa640 1 -- 10.20.193.28:0/1862622971 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0047070 con 0x55b264cf47c0 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07a57fa640 1 -- 10.20.193.28:0/1862622971 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f07d0033040 con 0x55b264cf47c0 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07a57fa640 1 -- 10.20.193.28:0/1862622971 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0038c90 con 0x55b264cf47c0 2026-02-20T03:17:49.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07ed097e00 1 -- 10.20.193.28:0/1862622971 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b264c00820 con 0x55b264cf47c0 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07a57fa640 1 -- 10.20.193.28:0/1862622971 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f07d00413c0 con 0x55b264cf47c0 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07ed097e00 10 client.15921 _ll_register_callbacks cb 0x55b264befff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07ed097e00 1 -- 10.20.193.28:0/1862622971 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b264c4c4e0 con 0x55b264cf47c0 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07a57fa640 1 -- 10.20.193.28:0/1862622971 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f07d002fc80 con 0x55b264cf47c0 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07ed097e00 10 client.15921 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.471+0000 7f07ed097e00 1 -- 10.20.193.28:0/1862622971 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55b264c05380 con 0x55b264cf47c0 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07a57fa640 1 -- 10.20.193.28:0/1862622971 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f07d0004050 con 0x55b264cf47c0 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07ed097e00 10 client.15921 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07ed097e00 10 client.15921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07ed097e00 20 client.15921 populate_metadata read hostname 'trial028' 2026-02-20T03:17:49.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b264d29b40 0x55b264d2bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07ed097e00 4 client.15921 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:49.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07ed097e00 1 -- 10.20.193.28:0/1862622971 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b264bc6bd0 con 0x55b264d29b40 2026-02-20T03:17:49.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b264d29b40 0x55b264d2bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b264d29b40 0x55b264d2bfe0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=636375d0200b2c51 server_cookie=c07318bf86f27bc0 in_seq=0 out_seq=0 2026-02-20T03:17:49.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.472+0000 7f07a57fa640 10 client.15921 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:49.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07a57fa640 1 -- 10.20.193.28:0/1862622971 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b264bc6bd0 con 0x55b264d29b40 2026-02-20T03:17:49.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07a57fa640 10 client.15921 handle_command_reply: tid=0 2026-02-20T03:17:49.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 client.15921 shutdown 2026-02-20T03:17:49.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 -- 10.20.193.28:0/1862622971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 msgr2=0x55b264d1e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d1e300 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009a30 tx=0x7f07d00059d0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 -- 10.20.193.28:0/1862622971 shutdown_connections 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b264d29b40 0x55b264d2bfe0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf9560 0x55b264d25280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d1e300 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1862622971 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf3e80 0x55b264d1ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 -- 10.20.193.28:0/1862622971 >> 10.20.193.28:0/1862622971 conn(0x55b264ceb6f0 msgr2=0x55b264cfa910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07a57fa640 0 client.15921 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 -- 10.20.193.28:0/1862622971 shutdown_connections 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 1 -- 10.20.193.28:0/1862622971 wait complete. 2026-02-20T03:17:49.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.473+0000 7f07ed097e00 20 client.15921 trim_cache size 0 max 16384 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07ed097e00 1 Processor -- start 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07ed097e00 1 -- start start 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 0x55b264d1ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264d25240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf9560 0x55b264cf2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07ed097e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0788012750 con 0x55b264cf9560 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07ed097e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f078800ffc0 con 0x55b264cf3e80 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07ed097e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f078800de10 con 0x55b264cf47c0 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264d25240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e2ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 0x55b264d1ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264d25240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60696/0 (socket says 10.20.193.28:60696) 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e37fe640 1 -- 10.20.193.28:0/1233239326 learned_addr learned my addr 10.20.193.28:0/1233239326 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/1233239326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf9560 0x55b264cf2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e37fe640 1 -- 10.20.193.28:0/1233239326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 msgr2=0x55b264d1ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e37fe640 1 --2- 10.20.193.28:0/1233239326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 0x55b264d1ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e37fe640 1 -- 10.20.193.28:0/1233239326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf9560 msgr2=0x55b264cf2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e37fe640 1 --2- 10.20.193.28:0/1233239326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf9560 0x55b264cf2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.481+0000 7f07e37fe640 1 -- 10.20.193.28:0/1233239326 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b264d17310 con 0x55b264cf47c0 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07e37fe640 1 --2- 10.20.193.28:0/1233239326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264d25240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07d0005b20 tx=0x7f07d0031070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b94082d38fc10c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07a77fe640 1 -- 10.20.193.28:0/1233239326 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0047020 con 0x55b264cf47c0 2026-02-20T03:17:49.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07a77fe640 1 -- 10.20.193.28:0/1233239326 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f07d0033040 con 0x55b264cf47c0 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07a77fe640 1 -- 10.20.193.28:0/1233239326 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0004b30 con 0x55b264cf47c0 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07ed097e00 1 -- 10.20.193.28:0/1233239326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 msgr2=0x55b264d25240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1233239326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264d25240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f07d0005b20 tx=0x7f07d0031070 comp rx=0 tx=0).stop 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07ed097e00 1 -- 10.20.193.28:0/1233239326 shutdown_connections 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1233239326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf9560 0x55b264cf2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1233239326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf47c0 0x55b264d25240 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07ed097e00 1 --2- 10.20.193.28:0/1233239326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 0x55b264d1ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07ed097e00 1 -- 10.20.193.28:0/1233239326 >> 10.20.193.28:0/1233239326 conn(0x55b264ceb6f0 msgr2=0x55b264cf1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07ed097e00 1 -- 10.20.193.28:0/1233239326 shutdown_connections 2026-02-20T03:17:49.487 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.482+0000 7f07ed097e00 1 -- 10.20.193.28:0/1233239326 wait complete. 2026-02-20T03:17:49.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07ed097e00 1 -- start start 2026-02-20T03:17:49.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07ed097e00 1 Processor -- start 2026-02-20T03:17:49.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 0x55b264d22d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d23290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07ed097e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf9560 0x55b264d242c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07ed097e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f078800e480 con 0x55b264cf47c0 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07ed097e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f078800f8f0 con 0x55b264cf3e80 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07ed097e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f078800eb50 con 0x55b264cf9560 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d23290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e2ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 0x55b264d22d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d23290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40022/0 (socket says 10.20.193.28:40022) 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e37fe640 1 -- 10.20.193.28:0/2097186073 learned_addr learned my addr 10.20.193.28:0/2097186073 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf9560 0x55b264d242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e37fe640 1 -- 10.20.193.28:0/2097186073 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf9560 msgr2=0x55b264d242c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e37fe640 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf9560 0x55b264d242c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e37fe640 1 -- 10.20.193.28:0/2097186073 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 msgr2=0x55b264d22d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e37fe640 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 0x55b264d22d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e37fe640 1 -- 10.20.193.28:0/2097186073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b264cf2c80 con 0x55b264cf47c0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.483+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf9560 0x55b264d242c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07e37fe640 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d23290 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f07d002f730 tx=0x7f07d0009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3376353edd6b594c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07a57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07a57fa640 1 -- 10.20.193.28:0/2097186073 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0047030 con 0x55b264cf47c0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07a57fa640 1 -- 10.20.193.28:0/2097186073 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55b264c4c4e0 con 0x55b264cf47c0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07a57fa640 1 -- 10.20.193.28:0/2097186073 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d00053a0 con 0x55b264cf47c0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07ed097e00 1 -- 10.20.193.28:0/2097186073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2649a4690 con 0x55b264cf47c0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07a57fa640 1 -- 10.20.193.28:0/2097186073 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f07d0005540 con 0x55b264cf47c0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07ed097e00 10 client.15927 _ll_register_callbacks cb 0x7f07d0009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07ed097e00 1 -- 10.20.193.28:0/2097186073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07d4010aa0 con 0x55b264cf47c0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07a57fa640 1 -- 10.20.193.28:0/2097186073 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f07d0038470 con 0x55b264cf47c0 2026-02-20T03:17:49.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07ed097e00 10 client.15927 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07ed097e00 1 -- 10.20.193.28:0/2097186073 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55b264c09b70 con 0x55b264cf47c0 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.484+0000 7f07a57fa640 1 -- 10.20.193.28:0/2097186073 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f07d0004830 con 0x55b264cf47c0 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.485+0000 7f07ed097e00 10 client.15927 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.485+0000 7f07ed097e00 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.485+0000 7f07ed097e00 20 client.15927 populate_metadata read hostname 'trial028' 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.485+0000 7f07ed097e00 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b264d94cd0 0x55b264d97160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.485+0000 7f07ed097e00 4 client.15927 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.485+0000 7f07ed097e00 1 -- 10.20.193.28:0/2097186073 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b264a1d520 con 0x55b264d94cd0 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.485+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b264d94cd0 0x55b264d97160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.485+0000 7f07e2ffd640 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b264d94cd0 0x55b264d97160 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95d6b9a5b114013a server_cookie=6c15ff90002446bd in_seq=0 out_seq=0 2026-02-20T03:17:49.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.485+0000 7f07a57fa640 10 client.15927 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:49.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 207590 13.85 MB/sec warmup 82 sec latency 11.536 ms 2026-02-20T03:17:49.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.562+0000 7f07a57fa640 1 -- 10.20.193.28:0/2097186073 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b264a1d520 con 0x55b264d94cd0 2026-02-20T03:17:49.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.562+0000 7f07a57fa640 10 client.15927 handle_command_reply: tid=0 2026-02-20T03:17:49.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.562+0000 7f07ed097e00 1 client.15927 shutdown 2026-02-20T03:17:49.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.562+0000 7f07ed097e00 1 -- 10.20.193.28:0/2097186073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 msgr2=0x55b264d23290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:49.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.562+0000 7f07ed097e00 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d23290 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f07d002f730 tx=0x7f07d0009730 comp rx=0 tx=0).stop 2026-02-20T03:17:49.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07ed097e00 1 -- 10.20.193.28:0/2097186073 shutdown_connections 2026-02-20T03:17:49.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07ed097e00 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b264d94cd0 0x55b264d97160 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07ed097e00 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b264cf9560 0x55b264d242c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07ed097e00 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b264cf47c0 0x55b264d23290 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07ed097e00 1 --2- 10.20.193.28:0/2097186073 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b264cf3e80 0x55b264d22d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07a57fa640 0 client.15927 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:49.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07ed097e00 1 -- 10.20.193.28:0/2097186073 >> 10.20.193.28:0/2097186073 conn(0x55b264ceb6f0 msgr2=0x55b264cf2570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:49.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07ed097e00 1 -- 10.20.193.28:0/2097186073 shutdown_connections 2026-02-20T03:17:49.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07ed097e00 1 -- 10.20.193.28:0/2097186073 wait complete. 2026-02-20T03:17:49.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.563+0000 7f07ed097e00 20 client.15927 trim_cache size 0 max 16384 2026-02-20T03:17:49.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:17:49.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:17:49.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:17:49.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:17:49.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 -- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07b80b0e20 msgr2=0x7f07b80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:49.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07b80b0e20 0x7f07b80b32e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f07d80a5650 tx=0x7f07d8009040 comp rx=0 tx=0).stop 2026-02-20T03:17:49.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 -- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e410a5f0 msgr2=0x7f07e41a3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:49.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e410a5f0 0x7f07e41a3fe0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f07d800ef30 tx=0x7f07d800c560 comp rx=0 tx=0).stop 2026-02-20T03:17:49.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 -- 10.20.193.28:0/2539472449 shutdown_connections 2026-02-20T03:17:49.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f07b80b0e20 0x7f07b80b32e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f07e410a5f0 0x7f07e41a3fe0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f07e4077050 0x7f07e419cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 --2- 10.20.193.28:0/2539472449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f07e40759e0 0x7f07e419ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:49.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 -- 10.20.193.28:0/2539472449 >> 10.20.193.28:0/2539472449 conn(0x7f07e40fde10 msgr2=0x7f07e41065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:49.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 -- 10.20.193.28:0/2539472449 shutdown_connections 2026-02-20T03:17:49.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:17:49.564+0000 7f07e8faf640 1 -- 10.20.193.28:0/2539472449 wait complete. 2026-02-20T03:17:49.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:49 trial126 ceph-mon[38476]: pgmap v275: 129 pgs: 129 active+clean; 44 MiB data, 868 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 351 op/s 2026-02-20T03:17:49.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:49 trial028 ceph-mon[38552]: pgmap v275: 129 pgs: 129 active+clean; 44 MiB data, 868 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 351 op/s 2026-02-20T03:17:50.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 211258 13.91 MB/sec warmup 83 sec latency 34.326 ms 2026-02-20T03:17:51.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:51 trial177 ceph-mon[43181]: pgmap v276: 129 pgs: 129 active+clean; 47 MiB data, 894 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.3 MiB/s wr, 393 op/s 2026-02-20T03:17:51.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 214765 13.97 MB/sec warmup 84 sec latency 17.767 ms 2026-02-20T03:17:51.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:51 trial126 ceph-mon[38476]: pgmap v276: 129 pgs: 129 active+clean; 47 MiB data, 894 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.3 MiB/s wr, 393 op/s 2026-02-20T03:17:51.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:51 trial028 ceph-mon[38552]: pgmap v276: 129 pgs: 129 active+clean; 47 MiB data, 894 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.3 MiB/s wr, 393 op/s 2026-02-20T03:17:52.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 218901 14.06 MB/sec warmup 85 sec latency 6.080 ms 2026-02-20T03:17:53.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:53 trial177 ceph-mon[43181]: pgmap v277: 129 pgs: 129 active+clean; 45 MiB data, 906 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 MiB/s rd, 2.2 MiB/s wr, 415 op/s 2026-02-20T03:17:53.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 223044 14.18 MB/sec warmup 86 sec latency 6.945 ms 2026-02-20T03:17:53.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:53 trial126 ceph-mon[38476]: pgmap v277: 129 pgs: 129 active+clean; 45 MiB data, 906 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 MiB/s rd, 2.2 MiB/s wr, 415 op/s 2026-02-20T03:17:53.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:53 trial028 ceph-mon[38552]: pgmap v277: 129 pgs: 129 active+clean; 45 MiB data, 906 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 MiB/s rd, 2.2 MiB/s wr, 415 op/s 2026-02-20T03:17:54.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 227026 14.29 MB/sec warmup 87 sec latency 6.709 ms 2026-02-20T03:17:55.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 230817 14.36 MB/sec warmup 88 sec latency 7.346 ms 2026-02-20T03:17:55.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:55 trial126 ceph-mon[38476]: pgmap v278: 129 pgs: 129 active+clean; 43 MiB data, 902 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 MiB/s rd, 2.1 MiB/s wr, 460 op/s 2026-02-20T03:17:55.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:55 trial028 ceph-mon[38552]: pgmap v278: 129 pgs: 129 active+clean; 43 MiB data, 902 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 MiB/s rd, 2.1 MiB/s wr, 460 op/s 2026-02-20T03:17:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:55 trial177 ceph-mon[43181]: pgmap v278: 129 pgs: 129 active+clean; 43 MiB data, 902 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 MiB/s rd, 2.1 MiB/s wr, 460 op/s 2026-02-20T03:17:56.348 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:17:56.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 234455 14.41 MB/sec warmup 89 sec latency 10.552 ms 2026-02-20T03:17:56.621 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:56.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.802+0000 7f68c507a640 1 -- 10.20.193.28:0/48242796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c0109220 msgr2=0x7f68c0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:56.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.802+0000 7f68c507a640 1 --2- 10.20.193.28:0/48242796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c0109220 0x7f68c0109660 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009960 tx=0x7f68b002f140 comp rx=0 tx=0).stop 2026-02-20T03:17:56.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.802+0000 7f68c507a640 1 -- 10.20.193.28:0/48242796 shutdown_connections 2026-02-20T03:17:56.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.802+0000 7f68c507a640 1 --2- 10.20.193.28:0/48242796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f68c0109ba0 0x7f68c0115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.802+0000 7f68c507a640 1 --2- 10.20.193.28:0/48242796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c0109220 0x7f68c0109660 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.802+0000 7f68c507a640 1 --2- 10.20.193.28:0/48242796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68c010eef0 0x7f68c010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.802+0000 7f68c507a640 1 -- 10.20.193.28:0/48242796 >> 10.20.193.28:0/48242796 conn(0x7f68c0078600 msgr2=0x7f68c007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:56.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.802+0000 7f68c507a640 1 -- 10.20.193.28:0/48242796 shutdown_connections 2026-02-20T03:17:56.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.802+0000 7f68c507a640 1 -- 10.20.193.28:0/48242796 wait complete. 2026-02-20T03:17:56.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.803+0000 7f68c507a640 1 Processor -- start 2026-02-20T03:17:56.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.803+0000 7f68c507a640 1 -- start start 2026-02-20T03:17:56.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.803+0000 7f68c507a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68c0109220 0x7f68c01a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.803+0000 7f68c507a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f68c0109ba0 0x7f68c01a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.803+0000 7f68c507a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c010eef0 0x7f68c01a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.803+0000 7f68c507a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0119090 con 0x7f68c010eef0 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.803+0000 7f68c507a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0118f10 con 0x7f68c0109ba0 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.803+0000 7f68c507a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0119210 con 0x7f68c0109220 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68bf7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f68c0109ba0 0x7f68c01a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68bffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68c0109220 0x7f68c01a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68bffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68c0109220 0x7f68c01a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39706/0 (socket says 10.20.193.28:39706) 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68bf7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f68c0109ba0 0x7f68c01a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48856/0 (socket says 10.20.193.28:48856) 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68bffff640 1 -- 10.20.193.28:0/4088719996 learned_addr learned my addr 10.20.193.28:0/4088719996 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:56.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68bf7fe640 1 -- 10.20.193.28:0/4088719996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68c0109220 msgr2=0x7f68c01a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68bf7fe640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68c0109220 0x7f68c01a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68bf7fe640 1 -- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c010eef0 msgr2=0x7f68c01a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68c4879640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c010eef0 0x7f68c01a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.804+0000 7f68bf7fe640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c010eef0 0x7f68c01a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.805+0000 7f68bf7fe640 1 -- 10.20.193.28:0/4088719996 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c01a6570 con 0x7f68c0109ba0 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.805+0000 7f68c4879640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c010eef0 0x7f68c01a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.805+0000 7f68bf7fe640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f68c0109ba0 0x7f68c01a1a60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f68b002f650 tx=0x7f68b0004290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.805+0000 7f68bd7fa640 1 -- 10.20.193.28:0/4088719996 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b0005020 con 0x7f68c0109ba0 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.806+0000 7f68bd7fa640 1 -- 10.20.193.28:0/4088719996 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f68b0005660 con 0x7f68c0109ba0 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.806+0000 7f68bd7fa640 1 -- 10.20.193.28:0/4088719996 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b00389d0 con 0x7f68c0109ba0 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.806+0000 7f68c507a640 1 -- 10.20.193.28:0/4088719996 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c01a6800 con 0x7f68c0109ba0 2026-02-20T03:17:56.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.806+0000 7f68c507a640 1 -- 10.20.193.28:0/4088719996 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c01a6c30 con 0x7f68c0109ba0 2026-02-20T03:17:56.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68c8808e00 1 Processor -- start 2026-02-20T03:17:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68c8808e00 1 -- start start 2026-02-20T03:17:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9f3000 0x55a0ea9f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0ea9eda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 0x55a0ea9f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68c8808e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0ea96de50 con 0x55a0ea9ed630 2026-02-20T03:17:56.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68c8808e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a0ea9409c0 con 0x55a0ea9edfb0 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68c8808e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a0ea8ee240 con 0x55a0ea9f3000 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0ea9eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0ea9eda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57108/0 (socket says 10.20.193.28:57108) 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.809+0000 7f68bffff640 1 -- 10.20.193.28:0/2434395168 learned_addr learned my addr 10.20.193.28:0/2434395168 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.810+0000 7f68bffff640 1 -- 10.20.193.28:0/2434395168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9f3000 msgr2=0x55a0ea9f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.810+0000 7f68bffff640 1 --2- 10.20.193.28:0/2434395168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9f3000 0x55a0ea9f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.810+0000 7f68bffff640 1 -- 10.20.193.28:0/2434395168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 msgr2=0x55a0ea9f9e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.810+0000 7f68bd7fa640 1 -- 10.20.193.28:0/4088719996 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f68b00049c0 con 0x7f68c0109ba0 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.811+0000 7f68bf7fe640 1 --2- 10.20.193.28:0/2434395168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 0x55a0ea9f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.811+0000 7f68bffff640 1 --2- 10.20.193.28:0/2434395168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 0x55a0ea9f9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.811+0000 7f68bffff640 1 -- 10.20.193.28:0/2434395168 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ea901420 con 0x55a0ea9ed630 2026-02-20T03:17:56.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.811+0000 7f68bffff640 1 --2- 10.20.193.28:0/2434395168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0ea9eda70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009e30 tx=0x7f68ac004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cfd7b191780030 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.811+0000 7f6890ce3640 1 -- 10.20.193.28:0/2434395168 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac010630 con 0x55a0ea9ed630 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.811+0000 7f6890ce3640 1 -- 10.20.193.28:0/2434395168 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f68ac010c70 con 0x55a0ea9ed630 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.811+0000 7f6890ce3640 1 -- 10.20.193.28:0/2434395168 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac01abd0 con 0x55a0ea9ed630 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.811+0000 7f68c8808e00 1 -- 10.20.193.28:0/2434395168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 msgr2=0x55a0ea9eda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.811+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2434395168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0ea9eda70 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009e30 tx=0x7f68ac004420 comp rx=0 tx=0).stop 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.812+0000 7f68c8808e00 1 -- 10.20.193.28:0/2434395168 shutdown_connections 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.812+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2434395168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 0x55a0ea9f9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.812+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2434395168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0ea9eda70 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.812+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2434395168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9f3000 0x55a0ea9f33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.812+0000 7f68c8808e00 1 -- 10.20.193.28:0/2434395168 >> 10.20.193.28:0/2434395168 conn(0x55a0ea9b0290 msgr2=0x55a0ea9ebd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.812+0000 7f68c8808e00 1 -- 10.20.193.28:0/2434395168 shutdown_connections 2026-02-20T03:17:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.812+0000 7f68c8808e00 1 -- 10.20.193.28:0/2434395168 wait complete. 2026-02-20T03:17:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.812+0000 7f68bd7fa640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68940b0ee0 0x7f68940b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.812+0000 7f68bd7fa640 1 -- 10.20.193.28:0/4088719996 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f68b0104ab0 con 0x7f68c0109ba0 2026-02-20T03:17:56.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.813+0000 7f68bffff640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68940b0ee0 0x7f68940b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.813+0000 7f68bffff640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68940b0ee0 0x7f68940b33a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0046f0 tx=0x7f68ac01a710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.814+0000 7f68c8808e00 1 -- start start 2026-02-20T03:17:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.814+0000 7f68c8808e00 1 Processor -- start 2026-02-20T03:17:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.814+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9ed630 0x55a0eaa064c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.814+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa06a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.814+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa07880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.814+0000 7f68c8808e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0ea93c8f0 con 0x55a0ea9f3000 2026-02-20T03:17:56.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.814+0000 7f68c8808e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a0ea72ef50 con 0x55a0ea9edfb0 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.814+0000 7f68c8808e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a0eaa07e40 con 0x55a0ea9ed630 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68bf7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa06a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c4879640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa07880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c4879640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa07880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57112/0 (socket says 10.20.193.28:57112) 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c4879640 1 -- 10.20.193.28:0/2002726528 learned_addr learned my addr 10.20.193.28:0/2002726528 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68bffff640 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9ed630 0x55a0eaa064c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c4879640 1 -- 10.20.193.28:0/2002726528 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9ed630 msgr2=0x55a0eaa064c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c4879640 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9ed630 0x55a0eaa064c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c4879640 1 -- 10.20.193.28:0/2002726528 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 msgr2=0x55a0eaa06a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c4879640 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa06a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c4879640 1 -- 10.20.193.28:0/2002726528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ea9ff980 con 0x55a0ea9f3000 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68bffff640 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9ed630 0x55a0eaa064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c4879640 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa07880 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f68b4007b90 tx=0x7f68b400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f86f93b6e8f48c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f6881ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f6881ffb640 1 -- 10.20.193.28:0/2002726528 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b401a070 con 0x55a0ea9f3000 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c8808e00 1 -- 10.20.193.28:0/2002726528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ea711b40 con 0x55a0ea9f3000 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f6881ffb640 1 -- 10.20.193.28:0/2002726528 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f68b400fdc0 con 0x55a0ea9f3000 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f6881ffb640 1 -- 10.20.193.28:0/2002726528 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4015470 con 0x55a0ea9f3000 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c8808e00 10 client.15936 _ll_register_callbacks cb 0x55a0ea979f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.815+0000 7f68c8808e00 1 -- 10.20.193.28:0/2002726528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0ea94e1a0 con 0x55a0ea9f3000 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f6881ffb640 1 -- 10.20.193.28:0/2002726528 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f68b401f440 con 0x55a0ea9f3000 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f6881ffb640 1 -- 10.20.193.28:0/2002726528 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f68b401f740 con 0x55a0ea9f3000 2026-02-20T03:17:56.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f68c8808e00 10 client.15936 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f68c8808e00 1 -- 10.20.193.28:0/2002726528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a0ea8fb230 con 0x55a0ea9f3000 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f6881ffb640 1 -- 10.20.193.28:0/2002726528 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f68b4002a60 con 0x55a0ea9f3000 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f68c8808e00 10 client.15936 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f68c8808e00 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f68c8808e00 20 client.15936 populate_metadata read hostname 'trial028' 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0eaa16260 0x55a0eaa18720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f68c8808e00 4 client.15936 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f68c8808e00 1 -- 10.20.193.28:0/2002726528 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0ea9485b0 con 0x55a0eaa16260 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.816+0000 7f68bffff640 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0eaa16260 0x55a0eaa18720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.817+0000 7f68bffff640 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0eaa16260 0x55a0eaa18720 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b0285f73985948 server_cookie=59c12a424a77a163 in_seq=0 out_seq=0 2026-02-20T03:17:56.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.817+0000 7f6881ffb640 10 client.15936 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.817+0000 7f6881ffb640 1 -- 10.20.193.28:0/2002726528 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a0ea9485b0 con 0x55a0eaa16260 2026-02-20T03:17:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.817+0000 7f6881ffb640 10 client.15936 handle_command_reply: tid=0 2026-02-20T03:17:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.817+0000 7f68c8808e00 1 client.15936 shutdown 2026-02-20T03:17:56.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 -- 10.20.193.28:0/2002726528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 msgr2=0x55a0eaa07880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa07880 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f68b4007b90 tx=0x7f68b400f520 comp rx=0 tx=0).stop 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 -- 10.20.193.28:0/2002726528 shutdown_connections 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0eaa16260 0x55a0eaa18720 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa07880 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa06a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 --2- 10.20.193.28:0/2002726528 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9ed630 0x55a0eaa064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 -- 10.20.193.28:0/2002726528 >> 10.20.193.28:0/2002726528 conn(0x55a0ea9b0290 msgr2=0x55a0ea9ec440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f6881ffb640 0 client.15936 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 -- 10.20.193.28:0/2002726528 shutdown_connections 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 1 -- 10.20.193.28:0/2002726528 wait complete. 2026-02-20T03:17:56.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.818+0000 7f68c8808e00 20 client.15936 trim_cache size 0 max 16384 2026-02-20T03:17:56.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.827+0000 7f68c8808e00 1 Processor -- start 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.827+0000 7f68c8808e00 1 -- start start 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.827+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0eaa1e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa1e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9f3000 0x55a0eaa0d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68c8808e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6864012700 con 0x55a0ea9ed630 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68c8808e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f686400ff70 con 0x55a0ea9f3000 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68c8808e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f686400ddc0 con 0x55a0ea9edfb0 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0eaa1e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bf7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa1e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0eaa1e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57126/0 (socket says 10.20.193.28:57126) 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bffff640 1 -- 10.20.193.28:0/4084357160 learned_addr learned my addr 10.20.193.28:0/4084357160 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68c4879640 1 --2- 10.20.193.28:0/4084357160 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9f3000 0x55a0eaa0d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bffff640 1 -- 10.20.193.28:0/4084357160 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 msgr2=0x55a0eaa1e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bffff640 1 --2- 10.20.193.28:0/4084357160 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa1e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bffff640 1 -- 10.20.193.28:0/4084357160 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9f3000 msgr2=0x55a0eaa0d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bffff640 1 --2- 10.20.193.28:0/4084357160 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9f3000 0x55a0eaa0d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bffff640 1 -- 10.20.193.28:0/4084357160 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ea9ff7b0 con 0x55a0ea9ed630 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.828+0000 7f68bffff640 1 --2- 10.20.193.28:0/4084357160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0eaa1e030 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f68ac002ab0 tx=0x7f68ac022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30674fa45b9ee800 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f6883fff640 1 -- 10.20.193.28:0/4084357160 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac010900 con 0x55a0ea9ed630 2026-02-20T03:17:56.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f6883fff640 1 -- 10.20.193.28:0/4084357160 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f68ac010aa0 con 0x55a0ea9ed630 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f6883fff640 1 -- 10.20.193.28:0/4084357160 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac01a780 con 0x55a0ea9ed630 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f68c8808e00 1 -- 10.20.193.28:0/4084357160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 msgr2=0x55a0eaa1e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f68c8808e00 1 --2- 10.20.193.28:0/4084357160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0eaa1e030 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f68ac002ab0 tx=0x7f68ac022000 comp rx=0 tx=0).stop 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f68c8808e00 1 -- 10.20.193.28:0/4084357160 shutdown_connections 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f68c8808e00 1 --2- 10.20.193.28:0/4084357160 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9f3000 0x55a0eaa0d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f68c8808e00 1 --2- 10.20.193.28:0/4084357160 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa1e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f68c8808e00 1 --2- 10.20.193.28:0/4084357160 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9ed630 0x55a0eaa1e030 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f68c8808e00 1 -- 10.20.193.28:0/4084357160 >> 10.20.193.28:0/4084357160 conn(0x55a0ea9b0290 msgr2=0x55a0eaa04be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f68c8808e00 1 -- 10.20.193.28:0/4084357160 shutdown_connections 2026-02-20T03:17:56.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.829+0000 7f68c8808e00 1 -- 10.20.193.28:0/4084357160 wait complete. 2026-02-20T03:17:56.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.830+0000 7f68c8808e00 1 -- start start 2026-02-20T03:17:56.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.830+0000 7f68c8808e00 1 Processor -- start 2026-02-20T03:17:56.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.830+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9ed630 0x55a0eaa0cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.830+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa0d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.830+0000 7f68c8808e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa81220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.830+0000 7f68c8808e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f686400e430 con 0x55a0ea9f3000 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.830+0000 7f68c8808e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f686400f8a0 con 0x55a0ea9ed630 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.830+0000 7f68c8808e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f686400eb00 con 0x55a0ea9edfb0 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68bffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9ed630 0x55a0eaa0cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c4879640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa81220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68bffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9ed630 0x55a0eaa0cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48898/0 (socket says 10.20.193.28:48898) 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c4879640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa81220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57128/0 (socket says 10.20.193.28:57128) 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68bffff640 1 -- 10.20.193.28:0/1758723815 learned_addr learned my addr 10.20.193.28:0/1758723815 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68bf7fe640 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa0d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c4879640 1 -- 10.20.193.28:0/1758723815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 msgr2=0x55a0eaa0d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c4879640 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa0d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c4879640 1 -- 10.20.193.28:0/1758723815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9ed630 msgr2=0x55a0eaa0cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c4879640 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9ed630 0x55a0eaa0cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c4879640 1 -- 10.20.193.28:0/1758723815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ea61f870 con 0x55a0ea9f3000 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68bf7fe640 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa0d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c4879640 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa81220 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f68b40095b0 tx=0x7f68b401f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89095feb68f5129 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f6881ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f6881ffb640 1 -- 10.20.193.28:0/1758723815 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b401a070 con 0x55a0ea9f3000 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f6881ffb640 1 -- 10.20.193.28:0/1758723815 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55a0ea94e1a0 con 0x55a0ea9f3000 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f6881ffb640 1 -- 10.20.193.28:0/1758723815 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4004320 con 0x55a0ea9f3000 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c8808e00 1 -- 10.20.193.28:0/1758723815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ea8e0440 con 0x55a0ea9f3000 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f6881ffb640 1 -- 10.20.193.28:0/1758723815 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f68b40044c0 con 0x55a0ea9f3000 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f6881ffb640 10 client.15942 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c8808e00 10 client.15942 _ll_register_callbacks cb 0x7f68b40077a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:56.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.831+0000 7f68c8808e00 1 -- 10.20.193.28:0/1758723815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0ea8f2b00 con 0x55a0ea9f3000 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f6881ffb640 1 -- 10.20.193.28:0/1758723815 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f68b40046c0 con 0x55a0ea9f3000 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f68c8808e00 10 client.15942 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f68c8808e00 1 -- 10.20.193.28:0/1758723815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a0eaa004a0 con 0x55a0ea9f3000 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f6881ffb640 1 -- 10.20.193.28:0/1758723815 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f68b4004ae0 con 0x55a0ea9f3000 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f68c8808e00 10 client.15942 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f68c8808e00 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f68c8808e00 20 client.15942 populate_metadata read hostname 'trial028' 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f68c8808e00 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0eaa82af0 0x55a0eaa84fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f68c8808e00 4 client.15942 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f68c8808e00 1 -- 10.20.193.28:0/1758723815 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f68ac010c70 con 0x55a0eaa82af0 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.832+0000 7f68bffff640 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0eaa82af0 0x55a0eaa84fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:56.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.833+0000 7f68bffff640 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0eaa82af0 0x55a0eaa84fb0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61355dd16870bd5e server_cookie=c7ec051c10da2ba7 in_seq=0 out_seq=0 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.833+0000 7f6881ffb640 10 client.15942 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.833+0000 7f6881ffb640 1 -- 10.20.193.28:0/1758723815 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f68ac010c70 con 0x55a0eaa82af0 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.833+0000 7f6881ffb640 10 client.15942 handle_command_reply: tid=0 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.833+0000 7f68c8808e00 1 client.15942 shutdown 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.833+0000 7f68c8808e00 1 -- 10.20.193.28:0/1758723815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 msgr2=0x55a0eaa81220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.833+0000 7f68c8808e00 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa81220 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f68b40095b0 tx=0x7f68b401f670 comp rx=0 tx=0).stop 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f68c8808e00 1 -- 10.20.193.28:0/1758723815 shutdown_connections 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f68c8808e00 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0eaa82af0 0x55a0eaa84fb0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f68c8808e00 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0ea9f3000 0x55a0eaa81220 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f68c8808e00 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0ea9edfb0 0x55a0eaa0d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f68c8808e00 1 --2- 10.20.193.28:0/1758723815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0ea9ed630 0x55a0eaa0cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f68c8808e00 1 -- 10.20.193.28:0/1758723815 >> 10.20.193.28:0/1758723815 conn(0x55a0ea9b0290 msgr2=0x55a0ea9ee990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:56.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f6881ffb640 0 client.15942 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:56.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f68c8808e00 1 -- 10.20.193.28:0/1758723815 shutdown_connections 2026-02-20T03:17:56.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f68c8808e00 1 -- 10.20.193.28:0/1758723815 wait complete. 2026-02-20T03:17:56.842 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:17:56.842 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:17:56.842 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:17:56.842 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:17:56.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.834+0000 7f68c8808e00 20 client.15942 trim_cache size 0 max 16384 2026-02-20T03:17:56.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 -- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68940b0ee0 msgr2=0x7f68940b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:56.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68940b0ee0 0x7f68940b33a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0046f0 tx=0x7f68ac01a710 comp rx=0 tx=0).stop 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 -- 10.20.193.28:0/4088719996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f68c0109ba0 msgr2=0x7f68c01a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f68c0109ba0 0x7f68c01a1a60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f68b002f650 tx=0x7f68b0004290 comp rx=0 tx=0).stop 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 -- 10.20.193.28:0/4088719996 shutdown_connections 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68940b0ee0 0x7f68940b33a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f68c010eef0 0x7f68c01a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f68c0109ba0 0x7f68c01a1a60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 --2- 10.20.193.28:0/4088719996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f68c0109220 0x7f68c01a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 -- 10.20.193.28:0/4088719996 >> 10.20.193.28:0/4088719996 conn(0x7f68c0078600 msgr2=0x7f68c0079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 -- 10.20.193.28:0/4088719996 shutdown_connections 2026-02-20T03:17:56.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:56.835+0000 7f68c507a640 1 -- 10.20.193.28:0/4088719996 wait complete. 2026-02-20T03:17:56.941 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:17:56.941 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:17:57.215 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.399+0000 7f81e6912640 1 -- 10.20.193.28:0/3892637175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81e0101f90 msgr2=0x7f81e0106460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:57.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.399+0000 7f81e6912640 1 --2- 10.20.193.28:0/3892637175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81e0101f90 0x7f81e0106460 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009a30 tx=0x7f81d402f2b0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.399+0000 7f81e6912640 1 -- 10.20.193.28:0/3892637175 shutdown_connections 2026-02-20T03:17:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.399+0000 7f81e6912640 1 --2- 10.20.193.28:0/3892637175 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81e0106a80 0x7f81e0106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.399+0000 7f81e6912640 1 --2- 10.20.193.28:0/3892637175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81e0101f90 0x7f81e0106460 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.399+0000 7f81e6912640 1 --2- 10.20.193.28:0/3892637175 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81e0101670 0x7f81e0101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.399+0000 7f81e6912640 1 -- 10.20.193.28:0/3892637175 >> 10.20.193.28:0/3892637175 conn(0x7f81e00fd2e0 msgr2=0x7f81e00ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.399+0000 7f81e6912640 1 -- 10.20.193.28:0/3892637175 shutdown_connections 2026-02-20T03:17:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.399+0000 7f81e6912640 1 -- 10.20.193.28:0/3892637175 wait complete. 2026-02-20T03:17:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e6912640 1 Processor -- start 2026-02-20T03:17:57.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e6912640 1 -- start start 2026-02-20T03:17:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e6912640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81e0101670 0x7f81e01a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e6912640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81e0101f90 0x7f81e01a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e6912640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81e0106a80 0x7f81e01a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e6912640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f81e01190b0 con 0x7f81e0106a80 2026-02-20T03:17:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e6912640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f81e0118f30 con 0x7f81e0101670 2026-02-20T03:17:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e6912640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81e0119230 con 0x7f81e0101f90 2026-02-20T03:17:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e510f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81e0101f90 0x7f81e01a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:57.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e5910640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81e0101670 0x7f81e01a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e5910640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81e0101670 0x7f81e01a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48916/0 (socket says 10.20.193.28:48916) 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e510f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81e0101f90 0x7f81e01a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39774/0 (socket says 10.20.193.28:39774) 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e5910640 1 -- 10.20.193.28:0/3730125573 learned_addr learned my addr 10.20.193.28:0/3730125573 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.400+0000 7f81e6111640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81e0106a80 0x7f81e01a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81e510f640 1 -- 10.20.193.28:0/3730125573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81e0101670 msgr2=0x7f81e01a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81e510f640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81e0101670 0x7f81e01a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81e510f640 1 -- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81e0106a80 msgr2=0x7f81e01a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81e510f640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81e0106a80 0x7f81e01a5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81e510f640 1 -- 10.20.193.28:0/3730125573 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e01a6600 con 0x7f81e0101f90 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81e510f640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81e0101f90 0x7f81e01a1af0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009950 tx=0x7f81d4002980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:57.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81ceffd640 1 -- 10.20.193.28:0/3730125573 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4004240 con 0x7f81e0101f90 2026-02-20T03:17:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81ceffd640 1 -- 10.20.193.28:0/3730125573 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f81d40043e0 con 0x7f81e0101f90 2026-02-20T03:17:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e01a6890 con 0x7f81e0101f90 2026-02-20T03:17:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81ceffd640 1 -- 10.20.193.28:0/3730125573 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4042660 con 0x7f81e0101f90 2026-02-20T03:17:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.401+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e01ae130 con 0x7f81e0101f90 2026-02-20T03:17:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.402+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e0106460 con 0x7f81e0101f90 2026-02-20T03:17:57.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.404+0000 7f81ceffd640 1 -- 10.20.193.28:0/3730125573 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f81d40389a0 con 0x7f81e0101f90 2026-02-20T03:17:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.405+0000 7f81ceffd640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81bc0b0da0 0x7f81bc0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:57.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.406+0000 7f81ceffd640 1 -- 10.20.193.28:0/3730125573 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f81d4104fe0 con 0x7f81e0101f90 2026-02-20T03:17:57.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.406+0000 7f81e5910640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81bc0b0da0 0x7f81bc0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:57.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.406+0000 7f81ceffd640 1 -- 10.20.193.28:0/3730125573 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f81d41054a0 con 0x7f81e0101f90 2026-02-20T03:17:57.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.407+0000 7f81e5910640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81bc0b0da0 0x7f81bc0b3260 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f81d0005fd0 tx=0x7f81d00074e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:57.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 238005 14.47 MB/sec warmup 90 sec latency 7.472 ms 2026-02-20T03:17:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.515+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81e01ae360 con 0x7f81e0101f90 2026-02-20T03:17:57.518 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:57 trial028 ceph-mon[38552]: pgmap v279: 129 pgs: 129 active+clean; 49 MiB data, 878 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 2.5 MiB/s wr, 538 op/s 2026-02-20T03:17:57.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.516+0000 7f81ceffd640 1 -- 10.20.193.28:0/3730125573 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11924 (secure 0 0 0) 0x7f81d40cd400 con 0x7f81e0101f90 2026-02-20T03:17:57.519 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T03:17:57.519 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:17:57.519 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T03:17:23:524010+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:17:23.524005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81bc0b0da0 msgr2=0x7f81bc0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81bc0b0da0 0x7f81bc0b3260 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f81d0005fd0 tx=0x7f81d00074e0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81e0101f90 msgr2=0x7f81e01a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81e0101f90 0x7f81e01a1af0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009950 tx=0x7f81d4002980 comp rx=0 tx=0).stop 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 shutdown_connections 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81bc0b0da0 0x7f81bc0b3260 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81e0106a80 0x7f81e01a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81e0101f90 0x7f81e01a1af0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 --2- 10.20.193.28:0/3730125573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81e0101670 0x7f81e01a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.517+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 >> 10.20.193.28:0/3730125573 conn(0x7f81e00fd2e0 msgr2=0x7f81e0104380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:57.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.518+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 shutdown_connections 2026-02-20T03:17:57.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:57.518+0000 7f81e6912640 1 -- 10.20.193.28:0/3730125573 wait complete. 2026-02-20T03:17:57.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:57 trial126 ceph-mon[38476]: pgmap v279: 129 pgs: 129 active+clean; 49 MiB data, 878 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 2.5 MiB/s wr, 538 op/s 2026-02-20T03:17:57.657 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:17:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:57 trial177 ceph-mon[43181]: pgmap v279: 129 pgs: 129 active+clean; 49 MiB data, 878 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 2.5 MiB/s wr, 538 op/s 2026-02-20T03:17:57.924 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:58.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.107+0000 7f1126d59640 1 -- 10.20.193.28:0/808891125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1120105320 msgr2=0x7f1120111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.107+0000 7f1126d59640 1 --2- 10.20.193.28:0/808891125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1120105320 0x7f1120111850 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f111c00b0d0 tx=0x7f111c02f450 comp rx=0 tx=0).stop 2026-02-20T03:17:58.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.107+0000 7f1126d59640 1 -- 10.20.193.28:0/808891125 shutdown_connections 2026-02-20T03:17:58.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.107+0000 7f1126d59640 1 --2- 10.20.193.28:0/808891125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1120105320 0x7f1120111850 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.107+0000 7f1126d59640 1 --2- 10.20.193.28:0/808891125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1120104980 0x7f1120104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.107+0000 7f1126d59640 1 --2- 10.20.193.28:0/808891125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f112010a980 0x7f112010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.107+0000 7f1126d59640 1 -- 10.20.193.28:0/808891125 >> 10.20.193.28:0/808891125 conn(0x7f1120100680 msgr2=0x7f1120102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.107+0000 7f1126d59640 1 -- 10.20.193.28:0/808891125 shutdown_connections 2026-02-20T03:17:58.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.107+0000 7f1126d59640 1 -- 10.20.193.28:0/808891125 wait complete. 2026-02-20T03:17:58.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.108+0000 7f1126d59640 1 Processor -- start 2026-02-20T03:17:58.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.108+0000 7f1126d59640 1 -- start start 2026-02-20T03:17:58.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.108+0000 7f1126d59640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1120104980 0x7f1120077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.108+0000 7f1126d59640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1120105320 0x7f1120077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.108+0000 7f1126d59640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f112010a980 0x7f1120078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.108+0000 7f1126d59640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1120114bf0 con 0x7f112010a980 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.108+0000 7f1126d59640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1120114a70 con 0x7f1120105320 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.108+0000 7f1126d59640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1120114d70 con 0x7f1120104980 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126558640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f112010a980 0x7f1120078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126558640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f112010a980 0x7f1120078080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57158/0 (socket says 10.20.193.28:57158) 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126558640 1 -- 10.20.193.28:0/2847305622 learned_addr learned my addr 10.20.193.28:0/2847305622 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1125556640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1120105320 0x7f1120077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1125d57640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1120104980 0x7f1120077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126558640 1 -- 10.20.193.28:0/2847305622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1120104980 msgr2=0x7f1120077600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126558640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1120104980 0x7f1120077600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126558640 1 -- 10.20.193.28:0/2847305622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1120105320 msgr2=0x7f1120077b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126558640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1120105320 0x7f1120077b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126558640 1 -- 10.20.193.28:0/2847305622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11201ad830 con 0x7f112010a980 2026-02-20T03:17:58.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126558640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f112010a980 0x7f1120078080 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f111c006030 tx=0x7f111c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f110effd640 1 -- 10.20.193.28:0/2847305622 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c045070 con 0x7f112010a980 2026-02-20T03:17:58.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f110effd640 1 -- 10.20.193.28:0/2847305622 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f111c0076a0 con 0x7f112010a980 2026-02-20T03:17:58.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f110effd640 1 -- 10.20.193.28:0/2847305622 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c038680 con 0x7f112010a980 2026-02-20T03:17:58.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126d59640 1 -- 10.20.193.28:0/2847305622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11201adac0 con 0x7f112010a980 2026-02-20T03:17:58.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.109+0000 7f1126d59640 1 -- 10.20.193.28:0/2847305622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11201adf50 con 0x7f112010a980 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.112+0000 7f112a4e7e00 1 Processor -- start 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.113+0000 7f110effd640 1 -- 10.20.193.28:0/2847305622 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f111c007b80 con 0x7f112010a980 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.113+0000 7f112a4e7e00 1 -- start start 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.113+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf1723fb0 0x561cf1724390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.113+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf171ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.113+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf172ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.113+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561cf169ee00 con 0x561cf171e5e0 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.113+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561cf1671970 con 0x561cf171ef60 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.113+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561cf161f1f0 con 0x561cf1723fb0 2026-02-20T03:17:58.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf1723fb0 0x561cf1724390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf1723fb0 0x561cf1724390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39798/0 (socket says 10.20.193.28:39798) 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 -- 10.20.193.28:0/145896101 learned_addr learned my addr 10.20.193.28:0/145896101 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125d57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf171ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 --2- 10.20.193.28:0/145896101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf172ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 -- 10.20.193.28:0/145896101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 msgr2=0x561cf172ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 --2- 10.20.193.28:0/145896101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf172ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 -- 10.20.193.28:0/145896101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 msgr2=0x561cf171ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 --2- 10.20.193.28:0/145896101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf171ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 -- 10.20.193.28:0/145896101 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf16323d0 con 0x561cf1723fb0 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125d57640 1 --2- 10.20.193.28:0/145896101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf171ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:17:58.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f110effd640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10fc0b0ef0 0x7f10fc0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f110effd640 1 -- 10.20.193.28:0/2847305622 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f111c104dd0 con 0x7f112010a980 2026-02-20T03:17:58.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.114+0000 7f1125556640 1 --2- 10.20.193.28:0/145896101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf1723fb0 0x561cf1724390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1114004360 tx=0x7f11140098f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d1f096acccbe00c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f10ee4e6640 1 -- 10.20.193.28:0/145896101 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114004aa0 con 0x561cf1723fb0 2026-02-20T03:17:58.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f10ee4e6640 1 -- 10.20.193.28:0/145896101 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1114004c40 con 0x561cf1723fb0 2026-02-20T03:17:58.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f10ee4e6640 1 -- 10.20.193.28:0/145896101 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114012690 con 0x561cf1723fb0 2026-02-20T03:17:58.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f1125d57640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10fc0b0ef0 0x7f10fc0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f112a4e7e00 1 -- 10.20.193.28:0/145896101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf1723fb0 msgr2=0x561cf1724390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/145896101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf1723fb0 0x561cf1724390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1114004360 tx=0x7f11140098f0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f112a4e7e00 1 -- 10.20.193.28:0/145896101 shutdown_connections 2026-02-20T03:17:58.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/145896101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf172ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/145896101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf171ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/145896101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf1723fb0 0x561cf1724390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f112a4e7e00 1 -- 10.20.193.28:0/145896101 >> 10.20.193.28:0/145896101 conn(0x561cf16e1240 msgr2=0x561cf171cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f112a4e7e00 1 -- 10.20.193.28:0/145896101 shutdown_connections 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f1125d57640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10fc0b0ef0 0x7f10fc0b33b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1110002950 tx=0x7f1110009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.115+0000 7f112a4e7e00 1 -- 10.20.193.28:0/145896101 wait complete. 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f112a4e7e00 1 -- start start 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f112a4e7e00 1 Processor -- start 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf1739010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171ef60 0x561cf1739550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf1723fb0 0x561cf1737750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561cf166d8a0 con 0x561cf171e5e0 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561cf145ff50 con 0x561cf1723fb0 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561cf1737ce0 con 0x561cf171ef60 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f1125d57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf1739010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f1125d57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf1739010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57178/0 (socket says 10.20.193.28:57178) 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.117+0000 7f1125d57640 1 -- 10.20.193.28:0/3966511588 learned_addr learned my addr 10.20.193.28:0/3966511588 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f1125556640 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171ef60 0x561cf1739550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f1126558640 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf1723fb0 0x561cf1737750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f1125d57640 1 -- 10.20.193.28:0/3966511588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171ef60 msgr2=0x561cf1739550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f1125d57640 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171ef60 0x561cf1739550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f1125d57640 1 -- 10.20.193.28:0/3966511588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf1723fb0 msgr2=0x561cf1737750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f1125d57640 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf1723fb0 0x561cf1737750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f1125d57640 1 -- 10.20.193.28:0/3966511588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf1730b20 con 0x561cf171e5e0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f1126558640 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf1723fb0 0x561cf1737750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f1125d57640 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf1739010 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1110009f80 tx=0x7f1110004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21a33ace408417b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f10db7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f10db7fe640 1 -- 10.20.193.28:0/3966511588 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11100048a0 con 0x561cf171e5e0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f10db7fe640 1 -- 10.20.193.28:0/3966511588 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1110005020 con 0x561cf171e5e0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f10db7fe640 1 -- 10.20.193.28:0/3966511588 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110010650 con 0x561cf171e5e0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.118+0000 7f112a4e7e00 1 -- 10.20.193.28:0/3966511588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf1442b40 con 0x561cf171e5e0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f10db7fe640 1 -- 10.20.193.28:0/3966511588 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1110010850 con 0x561cf171e5e0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 10 client.15960 _ll_register_callbacks cb 0x561cf16aaeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 1 -- 10.20.193.28:0/3966511588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561cf167f150 con 0x561cf171e5e0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f10db7fe640 1 -- 10.20.193.28:0/3966511588 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1110004a40 con 0x561cf171e5e0 2026-02-20T03:17:58.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 10 client.15960 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 1 -- 10.20.193.28:0/3966511588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x561cf162c1e0 con 0x561cf171e5e0 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f10db7fe640 1 -- 10.20.193.28:0/3966511588 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f1110004be0 con 0x561cf171e5e0 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 10 client.15960 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 10 client.15960 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 20 client.15960 populate_metadata read hostname 'trial028' 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561cf1758b20 0x561cf175afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 4 client.15960 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.119+0000 7f112a4e7e00 1 -- 10.20.193.28:0/3966511588 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cf1679560 con 0x561cf1758b20 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.120+0000 7f1125556640 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561cf1758b20 0x561cf175afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.120+0000 7f1125556640 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561cf1758b20 0x561cf175afe0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ecec208ed0ee5b7f server_cookie=7e3a8d51f33f996d in_seq=0 out_seq=0 2026-02-20T03:17:58.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.120+0000 7f10db7fe640 10 client.15960 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f10db7fe640 1 -- 10.20.193.28:0/3966511588 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561cf1679560 con 0x561cf1758b20 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f10db7fe640 10 client.15960 handle_command_reply: tid=0 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 client.15960 shutdown 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 -- 10.20.193.28:0/3966511588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 msgr2=0x561cf1739010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf1739010 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f1110009f80 tx=0x7f1110004830 comp rx=0 tx=0).stop 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 -- 10.20.193.28:0/3966511588 shutdown_connections 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf1723fb0 0x561cf1737750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171ef60 0x561cf1739550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561cf1758b20 0x561cf175afe0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/3966511588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf171e5e0 0x561cf1739010 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f10db7fe640 0 client.15960 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 -- 10.20.193.28:0/3966511588 >> 10.20.193.28:0/3966511588 conn(0x561cf16e1240 msgr2=0x561cf171d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 -- 10.20.193.28:0/3966511588 shutdown_connections 2026-02-20T03:17:58.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 1 -- 10.20.193.28:0/3966511588 wait complete. 2026-02-20T03:17:58.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.121+0000 7f112a4e7e00 20 client.15960 trim_cache size 0 max 16384 2026-02-20T03:17:58.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.130+0000 7f112a4e7e00 1 Processor -- start 2026-02-20T03:17:58.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.130+0000 7f112a4e7e00 1 -- start start 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 0x561cf1734b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf1735060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf17608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc012750 con 0x561cf1723fb0 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc00ffc0 con 0x561cf171ef60 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc00de10 con 0x561cf171e5e0 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f1125556640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf1735060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f1126558640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf17608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f1126558640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf17608b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57194/0 (socket says 10.20.193.28:57194) 2026-02-20T03:17:58.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f1126558640 1 -- 10.20.193.28:0/2950232419 learned_addr learned my addr 10.20.193.28:0/2950232419 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.131+0000 7f1125d57640 1 --2- 10.20.193.28:0/2950232419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 0x561cf1734b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.132+0000 7f1126558640 1 -- 10.20.193.28:0/2950232419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 msgr2=0x561cf1734b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.132+0000 7f1126558640 1 --2- 10.20.193.28:0/2950232419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 0x561cf1734b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.132+0000 7f1126558640 1 -- 10.20.193.28:0/2950232419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 msgr2=0x561cf1735060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.132+0000 7f1126558640 1 --2- 10.20.193.28:0/2950232419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf1735060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.132+0000 7f1126558640 1 -- 10.20.193.28:0/2950232419 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf1729ea0 con 0x561cf1723fb0 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.132+0000 7f1126558640 1 --2- 10.20.193.28:0/2950232419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf17608b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f111c0062a0 tx=0x7f111c0cc950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366f749b44e40296 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.132+0000 7f10edce5640 1 -- 10.20.193.28:0/2950232419 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c0f3170 con 0x561cf1723fb0 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.132+0000 7f10edce5640 1 -- 10.20.193.28:0/2950232419 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f111c0b6070 con 0x561cf1723fb0 2026-02-20T03:17:58.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.132+0000 7f10edce5640 1 -- 10.20.193.28:0/2950232419 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c0d5880 con 0x561cf1723fb0 2026-02-20T03:17:58.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.133+0000 7f112a4e7e00 1 -- 10.20.193.28:0/2950232419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 msgr2=0x561cf17608b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.133+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/2950232419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf17608b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f111c0062a0 tx=0x7f111c0cc950 comp rx=0 tx=0).stop 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.133+0000 7f112a4e7e00 1 -- 10.20.193.28:0/2950232419 shutdown_connections 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.133+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/2950232419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf17608b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.133+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/2950232419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf1735060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.133+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/2950232419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 0x561cf1734b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.133+0000 7f112a4e7e00 1 -- 10.20.193.28:0/2950232419 >> 10.20.193.28:0/2950232419 conn(0x561cf16e1240 msgr2=0x561cf17367d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.133+0000 7f112a4e7e00 1 -- 10.20.193.28:0/2950232419 shutdown_connections 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.133+0000 7f112a4e7e00 1 -- 10.20.193.28:0/2950232419 wait complete. 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.134+0000 7f112a4e7e00 1 -- start start 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.134+0000 7f112a4e7e00 1 Processor -- start 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 0x561cf17400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf1740610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f112a4e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf1740b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc00e480 con 0x561cf1723fb0 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc00f8f0 con 0x561cf171ef60 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f112a4e7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc00eb50 con 0x561cf171e5e0 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f1125556640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf1740610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f1125d57640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 0x561cf17400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f1125d57640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 0x561cf17400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39820/0 (socket says 10.20.193.28:39820) 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f1126558640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf1740b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f1125d57640 1 -- 10.20.193.28:0/519500568 learned_addr learned my addr 10.20.193.28:0/519500568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f1126558640 1 -- 10.20.193.28:0/519500568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 msgr2=0x561cf17400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f1126558640 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 0x561cf17400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.135+0000 7f1126558640 1 -- 10.20.193.28:0/519500568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 msgr2=0x561cf1740610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f1126558640 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf1740610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f1126558640 1 -- 10.20.193.28:0/519500568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf1730950 con 0x561cf1723fb0 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f1125556640 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf1740610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f1126558640 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf1740b50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f111c0062a0 tx=0x7f111c02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f6ab0812d3e716 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f10db7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f10db7fe640 1 -- 10.20.193.28:0/519500568 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c0f3170 con 0x561cf1723fb0 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f10db7fe640 1 -- 10.20.193.28:0/519500568 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f111c033020 con 0x561cf1723fb0 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f10db7fe640 1 -- 10.20.193.28:0/519500568 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c0cbd20 con 0x561cf1723fb0 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f112a4e7e00 1 -- 10.20.193.28:0/519500568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf1350870 con 0x561cf1723fb0 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f10db7fe640 1 -- 10.20.193.28:0/519500568 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f111c0d3060 con 0x561cf1723fb0 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f112a4e7e00 10 client.15966 _ll_register_callbacks cb 0x7f1110004650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:58.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f112a4e7e00 1 -- 10.20.193.28:0/519500568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561cf1623ab0 con 0x561cf1723fb0 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f10db7fe640 1 -- 10.20.193.28:0/519500568 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f111c0d3260 con 0x561cf1723fb0 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f112a4e7e00 10 client.15966 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.136+0000 7f112a4e7e00 1 -- 10.20.193.28:0/519500568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x561cf16113f0 con 0x561cf1723fb0 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f10db7fe640 1 -- 10.20.193.28:0/519500568 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f111c0044b0 con 0x561cf1723fb0 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f112a4e7e00 10 client.15966 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f112a4e7e00 10 client.15966 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f112a4e7e00 20 client.15966 populate_metadata read hostname 'trial028' 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561cf17c4cf0 0x561cf17c7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f112a4e7e00 4 client.15966 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f112a4e7e00 1 -- 10.20.193.28:0/519500568 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f111c0b6070 con 0x561cf17c4cf0 2026-02-20T03:17:58.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f1125d57640 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561cf17c4cf0 0x561cf17c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f1125d57640 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561cf17c4cf0 0x561cf17c7180 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77fd0f89ae1bdf37 server_cookie=6d5f1ec84a40f63e in_seq=0 out_seq=0 2026-02-20T03:17:58.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.137+0000 7f10db7fe640 10 client.15966 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:17:58.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f10db7fe640 1 -- 10.20.193.28:0/519500568 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f111c0b6070 con 0x561cf17c4cf0 2026-02-20T03:17:58.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f10db7fe640 10 client.15966 handle_command_reply: tid=0 2026-02-20T03:17:58.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 client.15966 shutdown 2026-02-20T03:17:58.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 -- 10.20.193.28:0/519500568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 msgr2=0x561cf1740b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf1740b50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f111c0062a0 tx=0x7f111c02f450 comp rx=0 tx=0).stop 2026-02-20T03:17:58.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 -- 10.20.193.28:0/519500568 shutdown_connections 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561cf17c4cf0 0x561cf17c7180 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561cf1723fb0 0x561cf1740b50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561cf171ef60 0x561cf1740610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 --2- 10.20.193.28:0/519500568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561cf171e5e0 0x561cf17400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f10db7fe640 0 client.15966 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 -- 10.20.193.28:0/519500568 >> 10.20.193.28:0/519500568 conn(0x561cf16e1240 msgr2=0x561cf1758f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 -- 10.20.193.28:0/519500568 shutdown_connections 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 1 -- 10.20.193.28:0/519500568 wait complete. 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.138+0000 7f112a4e7e00 20 client.15966 trim_cache size 0 max 16384 2026-02-20T03:17:58.146 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:17:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 -- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10fc0b0ef0 msgr2=0x7f10fc0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10fc0b0ef0 0x7f10fc0b33b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1110002950 tx=0x7f1110009290 comp rx=0 tx=0).stop 2026-02-20T03:17:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 -- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f112010a980 msgr2=0x7f1120078080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f112010a980 0x7f1120078080 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f111c006030 tx=0x7f111c009300 comp rx=0 tx=0).stop 2026-02-20T03:17:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 -- 10.20.193.28:0/2847305622 shutdown_connections 2026-02-20T03:17:58.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10fc0b0ef0 0x7f10fc0b33b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f112010a980 0x7f1120078080 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1120105320 0x7f1120077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 --2- 10.20.193.28:0/2847305622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1120104980 0x7f1120077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 -- 10.20.193.28:0/2847305622 >> 10.20.193.28:0/2847305622 conn(0x7f1120100680 msgr2=0x7f1120101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 -- 10.20.193.28:0/2847305622 shutdown_connections 2026-02-20T03:17:58.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.139+0000 7f1126d59640 1 -- 10.20.193.28:0/2847305622 wait complete. 2026-02-20T03:17:58.239 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:17:58.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 241604 14.52 MB/sec warmup 91 sec latency 11.434 ms 2026-02-20T03:17:58.524 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:58.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:58 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3730125573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:58.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:58 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3730125573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:58.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.708+0000 7f7e47109640 1 -- 10.20.193.28:0/1286731298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 msgr2=0x7f7e4010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.708+0000 7f7e47109640 1 --2- 10.20.193.28:0/1286731298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 0x7f7e4010f2d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009a30 tx=0x7f7e3002f220 comp rx=0 tx=0).stop 2026-02-20T03:17:58.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.709+0000 7f7e47109640 1 -- 10.20.193.28:0/1286731298 shutdown_connections 2026-02-20T03:17:58.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.709+0000 7f7e47109640 1 --2- 10.20.193.28:0/1286731298 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e40109ba0 0x7f7e40115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.709+0000 7f7e47109640 1 --2- 10.20.193.28:0/1286731298 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e40109220 0x7f7e40109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.709+0000 7f7e47109640 1 --2- 10.20.193.28:0/1286731298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 0x7f7e4010f2d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.709+0000 7f7e47109640 1 -- 10.20.193.28:0/1286731298 >> 10.20.193.28:0/1286731298 conn(0x7f7e40078600 msgr2=0x7f7e4007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.709+0000 7f7e47109640 1 -- 10.20.193.28:0/1286731298 shutdown_connections 2026-02-20T03:17:58.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.709+0000 7f7e47109640 1 -- 10.20.193.28:0/1286731298 wait complete. 2026-02-20T03:17:58.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.709+0000 7f7e47109640 1 Processor -- start 2026-02-20T03:17:58.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e47109640 1 -- start start 2026-02-20T03:17:58.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e47109640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e40109220 0x7f7e401a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e47109640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e40109ba0 0x7f7e401a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e47109640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 0x7f7e401a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e47109640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7e401190f0 con 0x7f7e4010eef0 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e47109640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40118f70 con 0x7f7e40109ba0 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e47109640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7e40119270 con 0x7f7e40109220 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e46908640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 0x7f7e401a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e46908640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 0x7f7e401a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57212/0 (socket says 10.20.193.28:57212) 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e46908640 1 -- 10.20.193.28:0/2535864938 learned_addr learned my addr 10.20.193.28:0/2535864938 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e46107640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e40109220 0x7f7e401a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e45906640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e40109ba0 0x7f7e401a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e46908640 1 -- 10.20.193.28:0/2535864938 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e40109220 msgr2=0x7f7e401a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e46908640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e40109220 0x7f7e401a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e46908640 1 -- 10.20.193.28:0/2535864938 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e40109ba0 msgr2=0x7f7e401a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e46908640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e40109ba0 0x7f7e401a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.710+0000 7f7e46908640 1 -- 10.20.193.28:0/2535864938 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e401a6580 con 0x7f7e4010eef0 2026-02-20T03:17:58.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.711+0000 7f7e46908640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 0x7f7e401a5e00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00ef30 tx=0x7f7e3c00c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.711+0000 7f7e277fe640 1 -- 10.20.193.28:0/2535864938 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c019070 con 0x7f7e4010eef0 2026-02-20T03:17:58.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.711+0000 7f7e277fe640 1 -- 10.20.193.28:0/2535864938 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e3c0092d0 con 0x7f7e4010eef0 2026-02-20T03:17:58.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.711+0000 7f7e277fe640 1 -- 10.20.193.28:0/2535864938 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c007500 con 0x7f7e4010eef0 2026-02-20T03:17:58.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.711+0000 7f7e47109640 1 -- 10.20.193.28:0/2535864938 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e401a6810 con 0x7f7e4010eef0 2026-02-20T03:17:58.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.711+0000 7f7e47109640 1 -- 10.20.193.28:0/2535864938 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e401ae0b0 con 0x7f7e4010eef0 2026-02-20T03:17:58.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.714+0000 7f7e4a897e00 1 Processor -- start 2026-02-20T03:17:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:58 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3730125573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:17:58.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.715+0000 7f7e277fe640 1 -- 10.20.193.28:0/2535864938 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7e3c0076a0 con 0x7f7e4010eef0 2026-02-20T03:17:58.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.715+0000 7f7e4a897e00 1 -- start start 2026-02-20T03:17:58.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.715+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e422390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.715+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41c5e0 0x560d0e41ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.715+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41cf60 0x560d0e428de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.715+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560d0e39ce00 con 0x560d0e41c5e0 2026-02-20T03:17:58.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.715+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560d0e36f970 con 0x560d0e421fb0 2026-02-20T03:17:58.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.715+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560d0e31d1f0 con 0x560d0e41cf60 2026-02-20T03:17:58.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e45906640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e422390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e45906640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e422390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48990/0 (socket says 10.20.193.28:48990) 2026-02-20T03:17:58.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e45906640 1 -- 10.20.193.28:0/533230055 learned_addr learned my addr 10.20.193.28:0/533230055 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e45906640 1 --2- 10.20.193.28:0/533230055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41cf60 0x560d0e428de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e46107640 1 --2- 10.20.193.28:0/533230055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41c5e0 0x560d0e41ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e46107640 1 -- 10.20.193.28:0/533230055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41cf60 msgr2=0x560d0e428de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e46107640 1 --2- 10.20.193.28:0/533230055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41cf60 0x560d0e428de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e46107640 1 -- 10.20.193.28:0/533230055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 msgr2=0x560d0e422390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e46107640 1 --2- 10.20.193.28:0/533230055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e422390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e46107640 1 -- 10.20.193.28:0/533230055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0e3303d0 con 0x560d0e41c5e0 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e46107640 1 --2- 10.20.193.28:0/533230055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41c5e0 0x560d0e41ca20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e30005ec0 tx=0x7f7e30005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6e0fa573d2e83d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e24a08640 1 -- 10.20.193.28:0/533230055 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3002fc80 con 0x560d0e41c5e0 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e24a08640 1 -- 10.20.193.28:0/533230055 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e30046070 con 0x560d0e41c5e0 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.716+0000 7f7e24a08640 1 -- 10.20.193.28:0/533230055 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3002fc80 con 0x560d0e41c5e0 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e277fe640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e1c0b0e20 0x7f7e1c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e4a897e00 1 -- 10.20.193.28:0/533230055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41c5e0 msgr2=0x560d0e41ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/533230055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41c5e0 0x560d0e41ca20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7e30005ec0 tx=0x7f7e30005c50 comp rx=0 tx=0).stop 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e277fe640 1 -- 10.20.193.28:0/2535864938 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f7e3c0e0830 con 0x7f7e4010eef0 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e45906640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e1c0b0e20 0x7f7e1c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e4a897e00 1 -- 10.20.193.28:0/533230055 shutdown_connections 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/533230055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41cf60 0x560d0e428de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/533230055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41c5e0 0x560d0e41ca20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/533230055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e422390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e4a897e00 1 -- 10.20.193.28:0/533230055 >> 10.20.193.28:0/533230055 conn(0x560d0e3df240 msgr2=0x560d0e41ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e4a897e00 1 -- 10.20.193.28:0/533230055 shutdown_connections 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e4a897e00 1 -- 10.20.193.28:0/533230055 wait complete. 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.717+0000 7f7e45906640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e1c0b0e20 0x7f7e1c0b32e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009fa0 tx=0x7f7e340098f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.718+0000 7f7e4a897e00 1 -- start start 2026-02-20T03:17:58.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.718+0000 7f7e4a897e00 1 Processor -- start 2026-02-20T03:17:58.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e436b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e437040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e435240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560d0e36b8a0 con 0x560d0e41cf60 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560d0e15df50 con 0x560d0e421fb0 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560d0e4359c0 con 0x560d0e41c5e0 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46107640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e436b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46107640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e436b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39858/0 (socket says 10.20.193.28:39858) 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46107640 1 -- 10.20.193.28:0/2447369 learned_addr learned my addr 10.20.193.28:0/2447369 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e45906640 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e437040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46908640 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e435240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46107640 1 -- 10.20.193.28:0/2447369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 msgr2=0x560d0e435240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46107640 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e435240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46107640 1 -- 10.20.193.28:0/2447369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 msgr2=0x560d0e437040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46107640 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e437040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46107640 1 -- 10.20.193.28:0/2447369 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0e42e9b0 con 0x560d0e41c5e0 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e46908640 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e435240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.719+0000 7f7e45906640 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e437040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7e46107640 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e436b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e3002f260 tx=0x7f7e3002f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f9d82ad1d73b2c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7df3fff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7df3fff640 1 -- 10.20.193.28:0/2447369 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3004e070 con 0x560d0e41c5e0 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7e4a897e00 1 -- 10.20.193.28:0/2447369 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0e140b40 con 0x560d0e41c5e0 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7df3fff640 1 -- 10.20.193.28:0/2447369 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e30033040 con 0x560d0e41c5e0 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7e4a897e00 10 client.25888 _ll_register_callbacks cb 0x560d0e3a8eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7e4a897e00 1 -- 10.20.193.28:0/2447369 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d0e37d150 con 0x560d0e41c5e0 2026-02-20T03:17:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7df3fff640 1 -- 10.20.193.28:0/2447369 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e30058060 con 0x560d0e41c5e0 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7df3fff640 1 -- 10.20.193.28:0/2447369 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f7e30002bc0 con 0x560d0e41c5e0 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7df3fff640 1 -- 10.20.193.28:0/2447369 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7e3002fc80 con 0x560d0e41c5e0 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7e4a897e00 10 client.25888 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.720+0000 7f7e4a897e00 1 -- 10.20.193.28:0/2447369 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=26}) -- 0x560d0e32a1e0 con 0x560d0e41c5e0 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.721+0000 7f7df3fff640 1 -- 10.20.193.28:0/2447369 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f7e300042d0 con 0x560d0e41c5e0 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.721+0000 7f7e4a897e00 10 client.25888 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.721+0000 7f7e4a897e00 10 client.25888 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.721+0000 7f7e4a897e00 20 client.25888 populate_metadata read hostname 'trial028' 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.721+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560d0e444f60 0x560d0e447350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.721+0000 7f7e4a897e00 4 client.25888 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.721+0000 7f7e4a897e00 1 -- 10.20.193.28:0/2447369 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d0e377560 con 0x560d0e444f60 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.721+0000 7f7e45906640 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560d0e444f60 0x560d0e447350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e45906640 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560d0e444f60 0x560d0e447350 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7945e01f4fe4ac3f server_cookie=3922932bb54ecca0 in_seq=0 out_seq=0 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7df3fff640 10 client.25888 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7df3fff640 1 -- 10.20.193.28:0/2447369 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560d0e377560 con 0x560d0e444f60 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7df3fff640 10 client.25888 handle_command_reply: tid=0 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e4a897e00 1 client.25888 shutdown 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e4a897e00 1 -- 10.20.193.28:0/2447369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 msgr2=0x560d0e436b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e436b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e3002f260 tx=0x7f7e3002f840 comp rx=0 tx=0).stop 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e4a897e00 1 -- 10.20.193.28:0/2447369 shutdown_connections 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560d0e444f60 0x560d0e447350 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e435240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e437040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/2447369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e436b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7e4a897e00 1 -- 10.20.193.28:0/2447369 >> 10.20.193.28:0/2447369 conn(0x560d0e3df240 msgr2=0x560d0e41b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.722+0000 7f7df3fff640 0 client.25888 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:17:58.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.723+0000 7f7e4a897e00 1 -- 10.20.193.28:0/2447369 shutdown_connections 2026-02-20T03:17:58.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.723+0000 7f7e4a897e00 1 -- 10.20.193.28:0/2447369 wait complete. 2026-02-20T03:17:58.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.723+0000 7f7e4a897e00 20 client.25888 trim_cache size 0 max 16384 2026-02-20T03:17:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.730+0000 7f7e4a897e00 1 Processor -- start 2026-02-20T03:17:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.730+0000 7f7e4a897e00 1 -- start start 2026-02-20T03:17:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e41c5e0 0x560d0e41b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e41ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e421fb0 0x560d0e44cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7de8012750 con 0x560d0e41cf60 2026-02-20T03:17:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7de800ffc0 con 0x560d0e41c5e0 2026-02-20T03:17:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7de800de10 con 0x560d0e421fb0 2026-02-20T03:17:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46908640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e421fb0 0x560d0e44cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46908640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e421fb0 0x560d0e44cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39860/0 (socket says 10.20.193.28:39860) 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46908640 1 -- 10.20.193.28:0/3286862225 learned_addr learned my addr 10.20.193.28:0/3286862225 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46107640 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e41c5e0 0x560d0e41b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e45906640 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e41ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46908640 1 -- 10.20.193.28:0/3286862225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e41c5e0 msgr2=0x560d0e41b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46908640 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e41c5e0 0x560d0e41b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46908640 1 -- 10.20.193.28:0/3286862225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 msgr2=0x560d0e41ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46908640 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e41ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46908640 1 -- 10.20.193.28:0/3286862225 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0e42e7e0 con 0x560d0e421fb0 2026-02-20T03:17:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e45906640 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e41ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e46908640 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e421fb0 0x560d0e44cb40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0a82c0 tx=0x7f7e3c0a7be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72ec8314bf736133 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.731+0000 7f7e0a4e6640 1 -- 10.20.193.28:0/3286862225 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0a4600 con 0x560d0e421fb0 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e0a4e6640 1 -- 10.20.193.28:0/3286862225 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e3c0e0470 con 0x560d0e421fb0 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e0a4e6640 1 -- 10.20.193.28:0/3286862225 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0a2d60 con 0x560d0e421fb0 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e4a897e00 1 -- 10.20.193.28:0/3286862225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e421fb0 msgr2=0x560d0e44cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e421fb0 0x560d0e44cb40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0a82c0 tx=0x7f7e3c0a7be0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e4a897e00 1 -- 10.20.193.28:0/3286862225 shutdown_connections 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e421fb0 0x560d0e44cb40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e41ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/3286862225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e41c5e0 0x560d0e41b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e4a897e00 1 -- 10.20.193.28:0/3286862225 >> 10.20.193.28:0/3286862225 conn(0x560d0e3df240 msgr2=0x560d0e4341d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e4a897e00 1 -- 10.20.193.28:0/3286862225 shutdown_connections 2026-02-20T03:17:58.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.732+0000 7f7e4a897e00 1 -- 10.20.193.28:0/3286862225 wait complete. 2026-02-20T03:17:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.733+0000 7f7e4a897e00 1 -- start start 2026-02-20T03:17:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.733+0000 7f7e4a897e00 1 Processor -- start 2026-02-20T03:17:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.733+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e439c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.733+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e43a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.733+0000 7f7e4a897e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e4afd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.733+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7de800e480 con 0x560d0e41cf60 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.733+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7de800f8f0 con 0x560d0e421fb0 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.733+0000 7f7e4a897e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7de800eb50 con 0x560d0e41c5e0 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46107640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e439c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46107640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e439c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39868/0 (socket says 10.20.193.28:39868) 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46107640 1 -- 10.20.193.28:0/1045752004 learned_addr learned my addr 10.20.193.28:0/1045752004 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e45906640 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e43a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46908640 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e4afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46107640 1 -- 10.20.193.28:0/1045752004 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 msgr2=0x560d0e4afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46107640 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e4afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46107640 1 -- 10.20.193.28:0/1045752004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 msgr2=0x560d0e43a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46107640 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e43a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46107640 1 -- 10.20.193.28:0/1045752004 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d0e04e870 con 0x560d0e41c5e0 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e46107640 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e439c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7e30005ec0 tx=0x7f7e30056000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a929a4d83566e925 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7df3fff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7df3fff640 1 -- 10.20.193.28:0/1045752004 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3004e040 con 0x560d0e41c5e0 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7df3fff640 1 -- 10.20.193.28:0/1045752004 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e30033070 con 0x560d0e41c5e0 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7df3fff640 1 -- 10.20.193.28:0/1045752004 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3005d990 con 0x560d0e41c5e0 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.734+0000 7f7e4a897e00 1 -- 10.20.193.28:0/1045752004 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d0e30f3f0 con 0x560d0e41c5e0 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7df3fff640 1 -- 10.20.193.28:0/1045752004 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f7e3005db30 con 0x560d0e41c5e0 2026-02-20T03:17:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 10 client.25894 _ll_register_callbacks cb 0x7f7e34009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 1 -- 10.20.193.28:0/1045752004 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560d0e3407c0 con 0x560d0e41c5e0 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7df3fff640 1 -- 10.20.193.28:0/1045752004 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7e3005d460 con 0x560d0e41c5e0 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 10 client.25894 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 1 -- 10.20.193.28:0/1045752004 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=26}) -- 0x560d0e42f4d0 con 0x560d0e41c5e0 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7df3fff640 1 -- 10.20.193.28:0/1045752004 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f7e30002650 con 0x560d0e41c5e0 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 10 client.25894 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 10 client.25894 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 20 client.25894 populate_metadata read hostname 'trial028' 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560d0e4b1040 0x560d0e4b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 4 client.25894 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.735+0000 7f7e4a897e00 1 -- 10.20.193.28:0/1045752004 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d0e321ab0 con 0x560d0e4b1040 2026-02-20T03:17:58.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.736+0000 7f7e45906640 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560d0e4b1040 0x560d0e4b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.736+0000 7f7e45906640 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560d0e4b1040 0x560d0e4b3500 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f386cd8c6066a2 server_cookie=78d1772c9c89fc89 in_seq=0 out_seq=0 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.736+0000 7f7df3fff640 10 client.25894 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.736+0000 7f7df3fff640 1 -- 10.20.193.28:0/1045752004 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d0e321ab0 con 0x560d0e4b1040 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.736+0000 7f7df3fff640 10 client.25894 handle_command_reply: tid=0 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.736+0000 7f7e4a897e00 1 client.25894 shutdown 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.736+0000 7f7e4a897e00 1 -- 10.20.193.28:0/1045752004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 msgr2=0x560d0e439c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.736+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e439c40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7e30005ec0 tx=0x7f7e30056000 comp rx=0 tx=0).stop 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7e4a897e00 1 -- 10.20.193.28:0/1045752004 shutdown_connections 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x560d0e4b1040 0x560d0e4b3500 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560d0e421fb0 0x560d0e4afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560d0e41cf60 0x560d0e43a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7e4a897e00 1 --2- 10.20.193.28:0/1045752004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560d0e41c5e0 0x560d0e439c40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7e4a897e00 1 -- 10.20.193.28:0/1045752004 >> 10.20.193.28:0/1045752004 conn(0x560d0e3df240 msgr2=0x560d0e41da10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7df3fff640 0 client.25894 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:17:58.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7e4a897e00 1 -- 10.20.193.28:0/1045752004 shutdown_connections 2026-02-20T03:17:58.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7e4a897e00 1 -- 10.20.193.28:0/1045752004 wait complete. 2026-02-20T03:17:58.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.737+0000 7f7e4a897e00 20 client.25894 trim_cache size 0 max 16384 2026-02-20T03:17:58.746 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:17:58.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 -- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e1c0b0e20 msgr2=0x7f7e1c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e1c0b0e20 0x7f7e1c0b32e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7e34009fa0 tx=0x7f7e340098f0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 -- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 msgr2=0x7f7e401a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:58.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 0x7f7e401a5e00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00ef30 tx=0x7f7e3c00c560 comp rx=0 tx=0).stop 2026-02-20T03:17:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 -- 10.20.193.28:0/2535864938 shutdown_connections 2026-02-20T03:17:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e1c0b0e20 0x7f7e1c0b32e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e4010eef0 0x7f7e401a5e00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e40109ba0 0x7f7e401a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 --2- 10.20.193.28:0/2535864938 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e40109220 0x7f7e401a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 -- 10.20.193.28:0/2535864938 >> 10.20.193.28:0/2535864938 conn(0x7f7e40078600 msgr2=0x7f7e40079ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 -- 10.20.193.28:0/2535864938 shutdown_connections 2026-02-20T03:17:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:58.738+0000 7f7e47109640 1 -- 10.20.193.28:0/2535864938 wait complete. 2026-02-20T03:17:58.839 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:17:59.110 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:17:59.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.292+0000 7f8cfb642640 1 -- 10.20.193.28:0/1972817212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cf410a990 msgr2=0x7f8cf410ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.292+0000 7f8cfb642640 1 --2- 10.20.193.28:0/1972817212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cf410a990 0x7f8cf410ad70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009a60 tx=0x7f8cec02f250 comp rx=0 tx=0).stop 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.292+0000 7f8cfb642640 1 -- 10.20.193.28:0/1972817212 shutdown_connections 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.292+0000 7f8cfb642640 1 --2- 10.20.193.28:0/1972817212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cf4105330 0x7f8cf4111860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.292+0000 7f8cfb642640 1 --2- 10.20.193.28:0/1972817212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cf4104990 0x7f8cf4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.292+0000 7f8cfb642640 1 --2- 10.20.193.28:0/1972817212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cf410a990 0x7f8cf410ad70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.292+0000 7f8cfb642640 1 -- 10.20.193.28:0/1972817212 >> 10.20.193.28:0/1972817212 conn(0x7f8cf4100690 msgr2=0x7f8cf4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.292+0000 7f8cfb642640 1 -- 10.20.193.28:0/1972817212 shutdown_connections 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.292+0000 7f8cfb642640 1 -- 10.20.193.28:0/1972817212 wait complete. 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfb642640 1 Processor -- start 2026-02-20T03:17:59.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfb642640 1 -- start start 2026-02-20T03:17:59.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfb642640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cf4104990 0x7f8cf419d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfb642640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cf4105330 0x7f8cf419d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfb642640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cf410a990 0x7f8cf41a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfb642640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4114c00 con 0x7f8cf4105330 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfb642640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4114a80 con 0x7f8cf4104990 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfb642640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf4114d80 con 0x7f8cf410a990 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfae41640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cf410a990 0x7f8cf41a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cf9e3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cf4105330 0x7f8cf419d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfa640640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cf4104990 0x7f8cf419d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfa640640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cf4104990 0x7f8cf419d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49042/0 (socket says 10.20.193.28:49042) 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.293+0000 7f8cfa640640 1 -- 10.20.193.28:0/2353595190 learned_addr learned my addr 10.20.193.28:0/2353595190 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.294+0000 7f8cfae41640 1 -- 10.20.193.28:0/2353595190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cf4104990 msgr2=0x7f8cf419d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.294+0000 7f8cfae41640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cf4104990 0x7f8cf419d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.294+0000 7f8cfae41640 1 -- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cf4105330 msgr2=0x7f8cf419d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.294+0000 7f8cfae41640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cf4105330 0x7f8cf419d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.294+0000 7f8cfae41640 1 -- 10.20.193.28:0/2353595190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf41a2100 con 0x7f8cf410a990 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.294+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cf4105330 0x7f8cf419d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.294+0000 7f8cfae41640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cf410a990 0x7f8cf41a1980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8007f00 tx=0x7f8ce800e510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.295+0000 7f8cdf7fe640 1 -- 10.20.193.28:0/2353595190 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8002a60 con 0x7f8cf410a990 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.295+0000 7f8cdf7fe640 1 -- 10.20.193.28:0/2353595190 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ce8002c00 con 0x7f8cf410a990 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.295+0000 7f8cdf7fe640 1 -- 10.20.193.28:0/2353595190 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8013680 con 0x7f8cf410a990 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.295+0000 7f8cfb642640 1 -- 10.20.193.28:0/2353595190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf41a2390 con 0x7f8cf410a990 2026-02-20T03:17:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.295+0000 7f8cfb642640 1 -- 10.20.193.28:0/2353595190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf41a9c30 con 0x7f8cf410a990 2026-02-20T03:17:59.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.298+0000 7f8cdf7fe640 1 -- 10.20.193.28:0/2353595190 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8ce80040d0 con 0x7f8cf410a990 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.298+0000 7f8cfedd0e00 1 Processor -- start 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.298+0000 7f8cfedd0e00 1 -- start start 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f88929c0 0x55e9f8892da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888cff0 0x55e9f888d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfedd0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9f8804e00 con 0x55e9f888d970 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfedd0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e9f87d7970 con 0x55e9f88929c0 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfedd0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e9f87851f0 con 0x55e9f888cff0 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cf9e3f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f88929c0 0x55e9f8892da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfa640640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888cff0 0x55e9f888d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cf9e3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfa640640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888cff0 0x55e9f888d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39892/0 (socket says 10.20.193.28:39892) 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfa640640 1 -- 10.20.193.28:0/4167864530 learned_addr learned my addr 10.20.193.28:0/4167864530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cdf7fe640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8cd00b0e20 0x7f8cd00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfa640640 1 -- 10.20.193.28:0/4167864530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f88929c0 msgr2=0x55e9f8892da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfa640640 1 --2- 10.20.193.28:0/4167864530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f88929c0 0x55e9f8892da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfa640640 1 -- 10.20.193.28:0/4167864530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 msgr2=0x55e9f88997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cdf7fe640 1 -- 10.20.193.28:0/2353595190 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8ce80e0070 con 0x7f8cf410a990 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfa640640 1 --2- 10.20.193.28:0/4167864530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cfa640640 1 -- 10.20.193.28:0/4167864530 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f87983d0 con 0x55e9f888cff0 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.299+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/4167864530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfae41640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8cd00b0e20 0x7f8cd00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfa640640 1 --2- 10.20.193.28:0/4167864530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888cff0 0x55e9f888d430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0057d0 tx=0x7f8cec005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3feb912c0562813b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:59.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cdcff9640 1 -- 10.20.193.28:0/4167864530 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec046070 con 0x55e9f888cff0 2026-02-20T03:17:59.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cdcff9640 1 -- 10.20.193.28:0/4167864530 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8cec033040 con 0x55e9f888cff0 2026-02-20T03:17:59.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cdcff9640 1 -- 10.20.193.28:0/4167864530 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec004320 con 0x55e9f888cff0 2026-02-20T03:17:59.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/4167864530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888cff0 msgr2=0x55e9f888d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:59.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/4167864530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888cff0 0x55e9f888d430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0057d0 tx=0x7f8cec005800 comp rx=0 tx=0).stop 2026-02-20T03:17:59.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfae41640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8cd00b0e20 0x7f8cd00b32e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8002790 tx=0x7f8ce800eb50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:59.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/4167864530 shutdown_connections 2026-02-20T03:17:59.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/4167864530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/4167864530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888cff0 0x55e9f888d430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/4167864530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f88929c0 0x55e9f8892da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/4167864530 >> 10.20.193.28:0/4167864530 conn(0x55e9f8847240 msgr2=0x55e9f8882ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/4167864530 shutdown_connections 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.300+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/4167864530 wait complete. 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.301+0000 7f8cfedd0e00 1 -- start start 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfedd0e00 1 Processor -- start 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 0x55e9f88a72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 0x55e9f88a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfedd0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9f87d38a0 con 0x55e9f888d970 2026-02-20T03:17:59.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfedd0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e9f85c5f50 con 0x55e9f888cff0 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfedd0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e9f88a6160 con 0x55e9f88929c0 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfa640640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfa640640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88a77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57290/0 (socket says 10.20.193.28:57290) 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfa640640 1 -- 10.20.193.28:0/1646397284 learned_addr learned my addr 10.20.193.28:0/1646397284 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 0x55e9f88a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfa640640 1 -- 10.20.193.28:0/1646397284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 msgr2=0x55e9f88a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfa640640 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 0x55e9f88a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfa640640 1 -- 10.20.193.28:0/1646397284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 msgr2=0x55e9f88a72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfa640640 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 0x55e9f88a72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cfa640640 1 -- 10.20.193.28:0/1646397284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f889f490 con 0x55e9f888d970 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.302+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 0x55e9f88a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:17:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8cfa640640 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88a77e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009380 tx=0x7f8cec0059c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ba1e9423759f1a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8ca7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8ca7fff640 1 -- 10.20.193.28:0/1646397284 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec046040 con 0x55e9f888d970 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1646397284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f85a8b40 con 0x55e9f888d970 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8cfedd0e00 10 client.15993 _ll_register_callbacks cb 0x55e9f8810eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1646397284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9f87e5150 con 0x55e9f888d970 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8ca7fff640 1 -- 10.20.193.28:0/1646397284 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8cec009620 con 0x55e9f888d970 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8ca7fff640 1 -- 10.20.193.28:0/1646397284 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0413f0 con 0x55e9f888d970 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8ca7fff640 1 -- 10.20.193.28:0/1646397284 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8cec041590 con 0x55e9f888d970 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8ca7fff640 1 -- 10.20.193.28:0/1646397284 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8cec041830 con 0x55e9f888d970 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8cfedd0e00 10 client.15993 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.303+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1646397284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e9f87921e0 con 0x55e9f888d970 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.304+0000 7f8ca7fff640 1 -- 10.20.193.28:0/1646397284 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f8cec049070 con 0x55e9f888d970 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.304+0000 7f8cfedd0e00 10 client.15993 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.304+0000 7f8cfedd0e00 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.304+0000 7f8cfedd0e00 20 client.15993 populate_metadata read hostname 'trial028' 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.304+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e9f88b56d0 0x55e9f88b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.304+0000 7f8cfedd0e00 4 client.15993 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.304+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1646397284 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9f87df560 con 0x55e9f88b56d0 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.304+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e9f88b56d0 0x55e9f88b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.305+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e9f88b56d0 0x55e9f88b7ac0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dfb915e661bc139 server_cookie=ac296a34f554901b in_seq=0 out_seq=0 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.305+0000 7f8ca7fff640 10 client.15993 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.305+0000 7f8ca7fff640 1 -- 10.20.193.28:0/1646397284 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e9f87df560 con 0x55e9f88b56d0 2026-02-20T03:17:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.305+0000 7f8ca7fff640 10 client.15993 handle_command_reply: tid=0 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.305+0000 7f8cfedd0e00 1 client.15993 shutdown 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1646397284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 msgr2=0x55e9f88a77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88a77e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009380 tx=0x7f8cec0059c0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1646397284 shutdown_connections 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e9f88b56d0 0x55e9f88b7ac0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 0x55e9f88a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888d970 0x55e9f88a77e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1646397284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 0x55e9f88a72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1646397284 >> 10.20.193.28:0/1646397284 conn(0x55e9f8847240 msgr2=0x55e9f88833f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8ca7fff640 0 client.15993 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1646397284 shutdown_connections 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1646397284 wait complete. 2026-02-20T03:17:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.306+0000 7f8cfedd0e00 20 client.15993 trim_cache size 0 max 16384 2026-02-20T03:17:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cfedd0e00 1 Processor -- start 2026-02-20T03:17:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cfedd0e00 1 -- start start 2026-02-20T03:17:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 0x55e9f88a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888d970 0x55e9f88a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f88929c0 0x55e9f88a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cfedd0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c0127d0 con 0x55e9f88929c0 2026-02-20T03:17:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cfedd0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c010040 con 0x55e9f888cff0 2026-02-20T03:17:59.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cfedd0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c00de90 con 0x55e9f888d970 2026-02-20T03:17:59.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cfa640640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888d970 0x55e9f88a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cf9e3f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 0x55e9f88a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cf9e3f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 0x55e9f88a4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49076/0 (socket says 10.20.193.28:49076) 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.313+0000 7f8cf9e3f640 1 -- 10.20.193.28:0/1464142341 learned_addr learned my addr 10.20.193.28:0/1464142341 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/1464142341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f88929c0 0x55e9f88a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cfa640640 1 -- 10.20.193.28:0/1464142341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 msgr2=0x55e9f88a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cfa640640 1 --2- 10.20.193.28:0/1464142341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 0x55e9f88a4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cfa640640 1 -- 10.20.193.28:0/1464142341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f88929c0 msgr2=0x55e9f88a37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cfa640640 1 --2- 10.20.193.28:0/1464142341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f88929c0 0x55e9f88a37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cfa640640 1 -- 10.20.193.28:0/1464142341 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f889f2c0 con 0x55e9f888d970 2026-02-20T03:17:59.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cfa640640 1 --2- 10.20.193.28:0/1464142341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888d970 0x55e9f88a32b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009a30 tx=0x55e9f88a6ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d7b5f47a76dcfe5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cc24e6640 1 -- 10.20.193.28:0/1464142341 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec046040 con 0x55e9f888d970 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cc24e6640 1 -- 10.20.193.28:0/1464142341 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e9f87e5150 con 0x55e9f888d970 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.314+0000 7f8cc24e6640 1 -- 10.20.193.28:0/1464142341 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0042d0 con 0x55e9f888d970 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1464142341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888d970 msgr2=0x55e9f88a32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1464142341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888d970 0x55e9f88a32b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009a30 tx=0x55e9f88a6ce0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1464142341 shutdown_connections 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1464142341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f88929c0 0x55e9f88a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1464142341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f888d970 0x55e9f88a32b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/1464142341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888cff0 0x55e9f88a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1464142341 >> 10.20.193.28:0/1464142341 conn(0x55e9f8847240 msgr2=0x55e9f888ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1464142341 shutdown_connections 2026-02-20T03:17:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/1464142341 wait complete. 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 -- start start 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.315+0000 7f8cfedd0e00 1 Processor -- start 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888cff0 0x55e9f88ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888d970 0x55e9f88aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cfedd0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 0x55e9f88aa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888cff0 0x55e9f88ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888cff0 0x55e9f88ada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57314/0 (socket says 10.20.193.28:57314) 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 -- 10.20.193.28:0/572910288 learned_addr learned my addr 10.20.193.28:0/572910288 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c00e500 con 0x55e9f888cff0 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c00f970 con 0x55e9f888d970 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c9c00ebd0 con 0x55e9f88929c0 2026-02-20T03:17:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cfa640640 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888d970 0x55e9f88aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 0x55e9f88aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 -- 10.20.193.28:0/572910288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 msgr2=0x55e9f88aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 0x55e9f88aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 -- 10.20.193.28:0/572910288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888d970 msgr2=0x55e9f88aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888d970 0x55e9f88aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 -- 10.20.193.28:0/572910288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f84b6870 con 0x55e9f888cff0 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cfa640640 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888d970 0x55e9f88aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8cf9e3f640 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888cff0 0x55e9f88ada10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0005d20 tx=0x7f8ce00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23059519fb1399d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.316+0000 7f8ca7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.317+0000 7f8ca7fff640 1 -- 10.20.193.28:0/572910288 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0029450 con 0x55e9f888cff0 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.317+0000 7f8ca7fff640 1 -- 10.20.193.28:0/572910288 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ce0029a90 con 0x55e9f888cff0 2026-02-20T03:17:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.317+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f87773f0 con 0x55e9f888cff0 2026-02-20T03:17:59.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.317+0000 7f8ca7fff640 1 -- 10.20.193.28:0/572910288 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0011860 con 0x55e9f888cff0 2026-02-20T03:17:59.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.317+0000 7f8cfedd0e00 10 client.15999 _ll_register_callbacks cb 0x7f8cec044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:17:59.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.317+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9f87a87c0 con 0x55e9f888cff0 2026-02-20T03:17:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.317+0000 7f8ca7fff640 1 -- 10.20.193.28:0/572910288 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8ce0011a00 con 0x55e9f888cff0 2026-02-20T03:17:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.317+0000 7f8ca7fff640 1 -- 10.20.193.28:0/572910288 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8ce0011c60 con 0x55e9f888cff0 2026-02-20T03:17:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8cfedd0e00 10 client.15999 fetch_fsmap learned FSMap version 26 2026-02-20T03:17:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e9f889ffb0 con 0x55e9f888cff0 2026-02-20T03:17:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8ca7fff640 1 -- 10.20.193.28:0/572910288 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f8ce0029c40 con 0x55e9f888cff0 2026-02-20T03:17:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8cfedd0e00 10 client.15999 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:17:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8cfedd0e00 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:17:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8cfedd0e00 20 client.15999 populate_metadata read hostname 'trial028' 2026-02-20T03:17:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e9f8921900 0x55e9f8923dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8cfedd0e00 4 client.15999 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9f8789ab0 con 0x55e9f8921900 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.318+0000 7f8cfa640640 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e9f8921900 0x55e9f8923dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfa640640 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e9f8921900 0x55e9f8923dc0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c791837da65c97f9 server_cookie=d34e71a738d8fa28 in_seq=0 out_seq=0 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8ca7fff640 10 client.15999 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8ca7fff640 1 -- 10.20.193.28:0/572910288 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9f8789ab0 con 0x55e9f8921900 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8ca7fff640 10 client.15999 handle_command_reply: tid=0 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 client.15999 shutdown 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888cff0 msgr2=0x55e9f88ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888cff0 0x55e9f88ada10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0005d20 tx=0x7f8ce00047c0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 shutdown_connections 2026-02-20T03:17:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e9f8921900 0x55e9f8923dc0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9f88929c0 0x55e9f88aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9f888d970 0x55e9f88aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 --2- 10.20.193.28:0/572910288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9f888cff0 0x55e9f88ada10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 >> 10.20.193.28:0/572910288 conn(0x55e9f8847240 msgr2=0x55e9f88a3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8ca7fff640 0 client.15999 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:17:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 shutdown_connections 2026-02-20T03:17:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.319+0000 7f8cfedd0e00 1 -- 10.20.193.28:0/572910288 wait complete. 2026-02-20T03:17:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfedd0e00 20 client.15999 trim_cache size 0 max 16384 2026-02-20T03:17:59.328 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:17:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 -- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8cd00b0e20 msgr2=0x7f8cd00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8cd00b0e20 0x7f8cd00b32e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8002790 tx=0x7f8ce800eb50 comp rx=0 tx=0).stop 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 -- 10.20.193.28:0/2353595190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cf410a990 msgr2=0x7f8cf41a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cf410a990 0x7f8cf41a1980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8007f00 tx=0x7f8ce800e510 comp rx=0 tx=0).stop 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 -- 10.20.193.28:0/2353595190 shutdown_connections 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8cd00b0e20 0x7f8cd00b32e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cf410a990 0x7f8cf41a1980 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cf4105330 0x7f8cf419d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 --2- 10.20.193.28:0/2353595190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cf4104990 0x7f8cf419d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.320+0000 7f8cfb642640 1 -- 10.20.193.28:0/2353595190 >> 10.20.193.28:0/2353595190 conn(0x7f8cf4100690 msgr2=0x7f8cf4100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.321+0000 7f8cfb642640 1 -- 10.20.193.28:0/2353595190 shutdown_connections 2026-02-20T03:17:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:17:59.321+0000 7f8cfb642640 1 -- 10.20.193.28:0/2353595190 wait complete. 2026-02-20T03:17:59.421 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:17:59 trial028 ceph-mon[38552]: pgmap v280: 129 pgs: 129 active+clean; 53 MiB data, 884 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.5 MiB/s wr, 554 op/s 2026-02-20T03:17:59.497 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:17:59 trial126 ceph-mon[38476]: pgmap v280: 129 pgs: 129 active+clean; 53 MiB data, 884 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.5 MiB/s wr, 554 op/s 2026-02-20T03:17:59.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 245193 14.57 MB/sec warmup 92 sec latency 6.631 ms 2026-02-20T03:17:59.618 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:17:59 trial177 ceph-mon[43181]: pgmap v280: 129 pgs: 129 active+clean; 53 MiB data, 884 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.5 MiB/s wr, 554 op/s 2026-02-20T03:18:00.424 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:18:00.424 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:18:00.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 248835 14.62 MB/sec warmup 93 sec latency 6.568 ms 2026-02-20T03:18:00.696 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:00.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.875+0000 7f3b07242640 1 -- 10.20.193.28:0/2221151811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b001014a0 msgr2=0x7f3b00101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:00.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.875+0000 7f3b07242640 1 --2- 10.20.193.28:0/2221151811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b001014a0 0x7f3b00101880 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009a30 tx=0x7f3af002f220 comp rx=0 tx=0).stop 2026-02-20T03:18:00.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.875+0000 7f3b07242640 1 -- 10.20.193.28:0/2221151811 shutdown_connections 2026-02-20T03:18:00.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.875+0000 7f3b07242640 1 --2- 10.20.193.28:0/2221151811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b0010f1d0 0x7f3b001115c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.875+0000 7f3b07242640 1 --2- 10.20.193.28:0/2221151811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b00101dc0 0x7f3b0010ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.875+0000 7f3b07242640 1 --2- 10.20.193.28:0/2221151811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b001014a0 0x7f3b00101880 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.875+0000 7f3b07242640 1 -- 10.20.193.28:0/2221151811 >> 10.20.193.28:0/2221151811 conn(0x7f3b000fd330 msgr2=0x7f3b000ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:00.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.875+0000 7f3b07242640 1 -- 10.20.193.28:0/2221151811 shutdown_connections 2026-02-20T03:18:00.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.875+0000 7f3b07242640 1 -- 10.20.193.28:0/2221151811 wait complete. 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.876+0000 7f3b07242640 1 Processor -- start 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.876+0000 7f3b07242640 1 -- start start 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b07242640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b001014a0 0x7f3b00103800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b07242640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b00101dc0 0x7f3b00103d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b07242640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b0010f1d0 0x7f3b00104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b07242640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00114c00 con 0x7f3b001014a0 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b07242640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00114a80 con 0x7f3b0010f1d0 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b07242640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3b00114d80 con 0x7f3b00101dc0 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b06240640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b001014a0 0x7f3b00103800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b05a3f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b00101dc0 0x7f3b00103d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b05a3f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b00101dc0 0x7f3b00103d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39952/0 (socket says 10.20.193.28:39952) 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b05a3f640 1 -- 10.20.193.28:0/464419202 learned_addr learned my addr 10.20.193.28:0/464419202 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b06240640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b001014a0 0x7f3b00103800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57328/0 (socket says 10.20.193.28:57328) 2026-02-20T03:18:00.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b06a41640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b0010f1d0 0x7f3b00104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b05a3f640 1 -- 10.20.193.28:0/464419202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b0010f1d0 msgr2=0x7f3b00104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b0010f1d0 0x7f3b00104280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b05a3f640 1 -- 10.20.193.28:0/464419202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b001014a0 msgr2=0x7f3b00103800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b001014a0 0x7f3b00103800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.877+0000 7f3b05a3f640 1 -- 10.20.193.28:0/464419202 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b001ad8c0 con 0x7f3b00101dc0 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.878+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b00101dc0 0x7f3b00103d40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3af400ea60 tx=0x7f3af400ef30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.878+0000 7f3ae77fe640 1 -- 10.20.193.28:0/464419202 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af400ce50 con 0x7f3b00101dc0 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.878+0000 7f3b07242640 1 -- 10.20.193.28:0/464419202 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b001adbb0 con 0x7f3b00101dc0 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.878+0000 7f3b07242640 1 -- 10.20.193.28:0/464419202 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b001ae0f0 con 0x7f3b00101dc0 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.878+0000 7f3ae77fe640 1 -- 10.20.193.28:0/464419202 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3af4004570 con 0x7f3b00101dc0 2026-02-20T03:18:00.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.878+0000 7f3ae77fe640 1 -- 10.20.193.28:0/464419202 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4010690 con 0x7f3b00101dc0 2026-02-20T03:18:00.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.881+0000 7f3b0a9d0e00 1 Processor -- start 2026-02-20T03:18:00.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.881+0000 7f3b0a9d0e00 1 -- start start 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.881+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c444a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.881+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c48540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.881+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 0x55aac1c48fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.881+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aac1b96c00 con 0x55aac1c440c0 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.881+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55aac1b443c0 con 0x55aac1c44a70 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.881+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55aac1b92b30 con 0x55aac1c48b60 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06240640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c48540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06a41640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06240640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c48540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49126/0 (socket says 10.20.193.28:49126) 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06240640 1 -- 10.20.193.28:0/3492471231 learned_addr learned my addr 10.20.193.28:0/3492471231 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3ae77fe640 1 -- 10.20.193.28:0/464419202 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3af40040d0 con 0x7f3b00101dc0 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/3492471231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 0x55aac1c48fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06a41640 1 -- 10.20.193.28:0/3492471231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 msgr2=0x55aac1c48fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06a41640 1 --2- 10.20.193.28:0/3492471231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 0x55aac1c48fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06a41640 1 -- 10.20.193.28:0/3492471231 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 msgr2=0x55aac1c48540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:00.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06a41640 1 --2- 10.20.193.28:0/3492471231 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c48540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06a41640 1 -- 10.20.193.28:0/3492471231 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac1b3d840 con 0x55aac1c440c0 2026-02-20T03:18:00.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/3492471231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 0x55aac1c48fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:18:00.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.882+0000 7f3b06a41640 1 --2- 10.20.193.28:0/3492471231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c444a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009790 tx=0x7f3afc009130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e755f637dbdb51f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:00.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3ae4a08640 1 -- 10.20.193.28:0/3492471231 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0040d0 con 0x55aac1c440c0 2026-02-20T03:18:00.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3ae4a08640 1 -- 10.20.193.28:0/3492471231 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3afc004710 con 0x55aac1c440c0 2026-02-20T03:18:00.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3ae4a08640 1 -- 10.20.193.28:0/3492471231 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3afc015bb0 con 0x55aac1c440c0 2026-02-20T03:18:00.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3492471231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 msgr2=0x55aac1c444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:00.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3492471231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c444a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009790 tx=0x7f3afc009130 comp rx=0 tx=0).stop 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3492471231 shutdown_connections 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3492471231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 0x55aac1c48fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3492471231 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c48540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3492471231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c444a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3492471231 >> 10.20.193.28:0/3492471231 conn(0x55aac1c3cb60 msgr2=0x55aac1c425e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3492471231 shutdown_connections 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3492471231 wait complete. 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3ae77fe640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3adc0b0d80 0x7f3adc0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.883+0000 7f3ae77fe640 1 -- 10.20.193.28:0/464419202 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3af40e0f40 con 0x7f3b00101dc0 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.884+0000 7f3b06240640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3adc0b0d80 0x7f3adc0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.884+0000 7f3b06240640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3adc0b0d80 0x7f3adc0b3240 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3af00097c0 tx=0x7f3af002f8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:00.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b0a9d0e00 1 -- start start 2026-02-20T03:18:00.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b0a9d0e00 1 Processor -- start 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c5d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c48b60 0x55aac1c68900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aac1b3e1a0 con 0x55aac1c48b60 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55aac1c50d70 con 0x55aac1c44a70 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55aac1c68e40 con 0x55aac1c440c0 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b06240640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.885+0000 7f3b05a3f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c5d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.886+0000 7f3b05a3f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c5d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49142/0 (socket says 10.20.193.28:49142) 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.886+0000 7f3b05a3f640 1 -- 10.20.193.28:0/3151221946 learned_addr learned my addr 10.20.193.28:0/3151221946 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.886+0000 7f3b06a41640 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c48b60 0x55aac1c68900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.886+0000 7f3b05a3f640 1 -- 10.20.193.28:0/3151221946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 msgr2=0x55aac1c5cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.886+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.886+0000 7f3b05a3f640 1 -- 10.20.193.28:0/3151221946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c48b60 msgr2=0x55aac1c68900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.886+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c48b60 0x55aac1c68900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.886+0000 7f3b05a3f640 1 -- 10.20.193.28:0/3151221946 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac1c56400 con 0x55aac1c44a70 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.886+0000 7f3b06a41640 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c48b60 0x55aac1c68900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c5d1d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3af40a5c40 tx=0x7f3af40a89f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e31b5481a2286d06 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3ab3fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3ab3fff640 1 -- 10.20.193.28:0/3151221946 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40a9320 con 0x55aac1c44a70 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3151221946 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aac1965b60 con 0x55aac1c44a70 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3b0a9d0e00 10 client.25916 _ll_register_callbacks cb 0x55aac1b420d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3151221946 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aac1b9e7f0 con 0x55aac1c44a70 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3ab3fff640 1 -- 10.20.193.28:0/3151221946 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3af40acfd0 con 0x55aac1c44a70 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3ab3fff640 1 -- 10.20.193.28:0/3151221946 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40a7f30 con 0x55aac1c44a70 2026-02-20T03:18:00.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3ab3fff640 1 -- 10.20.193.28:0/3151221946 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3af40b1c00 con 0x55aac1c44a70 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3ab3fff640 1 -- 10.20.193.28:0/3151221946 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3af40cf1b0 con 0x55aac1c44a70 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3b0a9d0e00 10 client.25916 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.887+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3151221946 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55aac1b63430 con 0x55aac1c44a70 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.888+0000 7f3ab3fff640 1 -- 10.20.193.28:0/3151221946 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3af4092030 con 0x55aac1c44a70 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.888+0000 7f3b0a9d0e00 10 client.25916 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.888+0000 7f3b0a9d0e00 10 client.25916 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.888+0000 7f3b0a9d0e00 20 client.25916 populate_metadata read hostname 'trial028' 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.888+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aac1c7e1e0 0x55aac1c80670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.888+0000 7f3b0a9d0e00 4 client.25916 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.888+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3151221946 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aac1b18c00 con 0x55aac1c7e1e0 2026-02-20T03:18:00.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.888+0000 7f3b06240640 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aac1c7e1e0 0x55aac1c80670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.889+0000 7f3b06240640 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aac1c7e1e0 0x55aac1c80670 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ed52e03002d4455 server_cookie=a3d7cdf44ac819c8 in_seq=0 out_seq=0 2026-02-20T03:18:00.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.889+0000 7f3ab3fff640 10 client.25916 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:00.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.889+0000 7f3ab3fff640 1 -- 10.20.193.28:0/3151221946 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55aac1b18c00 con 0x55aac1c7e1e0 2026-02-20T03:18:00.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.889+0000 7f3ab3fff640 10 client.25916 handle_command_reply: tid=0 2026-02-20T03:18:00.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.889+0000 7f3b0a9d0e00 1 client.25916 shutdown 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.889+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3151221946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 msgr2=0x55aac1c5d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.889+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c5d1d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3af40a5c40 tx=0x7f3af40a89f0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3151221946 shutdown_connections 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aac1c7e1e0 0x55aac1c80670 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c48b60 0x55aac1c68900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c5d1d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3151221946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3151221946 >> 10.20.193.28:0/3151221946 conn(0x55aac1c3cb60 msgr2=0x55aac1c47520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3ab3fff640 0 client.25916 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3151221946 shutdown_connections 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3151221946 wait complete. 2026-02-20T03:18:00.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.890+0000 7f3b0a9d0e00 20 client.25916 trim_cache size 0 max 16384 2026-02-20T03:18:00.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.898+0000 7f3b0a9d0e00 1 Processor -- start 2026-02-20T03:18:00.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b0a9d0e00 1 -- start start 2026-02-20T03:18:00.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c44a70 0x55aac1c84f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c48b60 0x55aac1c85470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa8012740 con 0x55aac1c44a70 2026-02-20T03:18:00.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa800ffb0 con 0x55aac1c48b60 2026-02-20T03:18:00.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa800de00 con 0x55aac1c440c0 2026-02-20T03:18:00.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b05a3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c44a70 0x55aac1c84f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b06240640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b06240640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39994/0 (socket says 10.20.193.28:39994) 2026-02-20T03:18:00.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b06240640 1 -- 10.20.193.28:0/3181088511 learned_addr learned my addr 10.20.193.28:0/3181088511 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:00.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b06a41640 1 --2- 10.20.193.28:0/3181088511 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c48b60 0x55aac1c85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b06240640 1 -- 10.20.193.28:0/3181088511 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c48b60 msgr2=0x55aac1c85470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:00.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b06240640 1 --2- 10.20.193.28:0/3181088511 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c48b60 0x55aac1c85470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b06240640 1 -- 10.20.193.28:0/3181088511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c44a70 msgr2=0x55aac1c84f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:00.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b06240640 1 --2- 10.20.193.28:0/3181088511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c44a70 0x55aac1c84f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.899+0000 7f3b06240640 1 -- 10.20.193.28:0/3181088511 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac1c44810 con 0x55aac1c440c0 2026-02-20T03:18:00.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/3181088511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c44a70 0x55aac1c84f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:18:00.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3b06240640 1 --2- 10.20.193.28:0/3181088511 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5baa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55aac1c45090 tx=0x7f3af003f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccaba1987d512203 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:00.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3ace4e6640 1 -- 10.20.193.28:0/3181088511 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af005d070 con 0x55aac1c440c0 2026-02-20T03:18:00.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3ace4e6640 1 -- 10.20.193.28:0/3181088511 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3af0055030 con 0x55aac1c440c0 2026-02-20T03:18:00.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3ace4e6640 1 -- 10.20.193.28:0/3181088511 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0002c80 con 0x55aac1c440c0 2026-02-20T03:18:00.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3181088511 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 msgr2=0x55aac1c5baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:00.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3181088511 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5baa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x55aac1c45090 tx=0x7f3af003f000 comp rx=0 tx=0).stop 2026-02-20T03:18:00.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3181088511 shutdown_connections 2026-02-20T03:18:00.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3181088511 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c48b60 0x55aac1c85470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3181088511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c44a70 0x55aac1c84f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/3181088511 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c440c0 0x55aac1c5baa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.900+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3181088511 >> 10.20.193.28:0/3181088511 conn(0x55aac1c3cb60 msgr2=0x55aac1c5b390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.901+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3181088511 shutdown_connections 2026-02-20T03:18:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.901+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/3181088511 wait complete. 2026-02-20T03:18:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.901+0000 7f3b0a9d0e00 1 -- start start 2026-02-20T03:18:00.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.901+0000 7f3b0a9d0e00 1 Processor -- start 2026-02-20T03:18:00.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c62760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c62ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b0a9d0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 0x55aac1c631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa800e470 con 0x55aac1c440c0 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa800f8e0 con 0x55aac1c44a70 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b0a9d0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa800eb40 con 0x55aac1c48b60 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b06240640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c62760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b06240640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c62760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57352/0 (socket says 10.20.193.28:57352) 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b06240640 1 -- 10.20.193.28:0/2042243360 learned_addr learned my addr 10.20.193.28:0/2042243360 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c62ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b06a41640 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 0x55aac1c631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b06240640 1 -- 10.20.193.28:0/2042243360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 msgr2=0x55aac1c631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b06240640 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 0x55aac1c631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b06240640 1 -- 10.20.193.28:0/2042243360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 msgr2=0x55aac1c62ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b06240640 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c62ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b06240640 1 -- 10.20.193.28:0/2042243360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac1c56230 con 0x55aac1c440c0 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.902+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c62ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3b06240640 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c62760 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009a00 tx=0x7f3af002fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e37e3429574c415 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3ab3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3ab3fff640 1 -- 10.20.193.28:0/2042243360 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0066070 con 0x55aac1c440c0 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3ab3fff640 1 -- 10.20.193.28:0/2042243360 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3af0033040 con 0x55aac1c440c0 2026-02-20T03:18:00.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3ab3fff640 1 -- 10.20.193.28:0/2042243360 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af005d040 con 0x55aac1c440c0 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/2042243360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aac1875900 con 0x55aac1c440c0 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3b0a9d0e00 10 client.16017 _ll_register_callbacks cb 0x7f3af4005860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/2042243360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3afc004710 con 0x55aac1c440c0 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3ab3fff640 1 -- 10.20.193.28:0/2042243360 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3af00026e0 con 0x55aac1c440c0 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3ab3fff640 1 -- 10.20.193.28:0/2042243360 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3af00029c0 con 0x55aac1c440c0 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.903+0000 7f3b0a9d0e00 10 client.16017 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.904+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/2042243360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55aac1b514d0 con 0x55aac1c440c0 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.904+0000 7f3ab3fff640 1 -- 10.20.193.28:0/2042243360 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3af0038ab0 con 0x55aac1c440c0 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.904+0000 7f3b0a9d0e00 10 client.16017 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.904+0000 7f3b0a9d0e00 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.904+0000 7f3b0a9d0e00 20 client.16017 populate_metadata read hostname 'trial028' 2026-02-20T03:18:00.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.904+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aac1cea5f0 0x55aac1cecab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.904+0000 7f3b0a9d0e00 4 client.16017 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.904+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/2042243360 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aac19172b0 con 0x55aac1cea5f0 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.904+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aac1cea5f0 0x55aac1cecab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.905+0000 7f3b05a3f640 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aac1cea5f0 0x55aac1cecab0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20232883c7e5a4c6 server_cookie=98652d7653852f9e in_seq=0 out_seq=0 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.905+0000 7f3ab3fff640 10 client.16017 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.905+0000 7f3ab3fff640 1 -- 10.20.193.28:0/2042243360 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aac19172b0 con 0x55aac1cea5f0 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.905+0000 7f3ab3fff640 10 client.16017 handle_command_reply: tid=0 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.905+0000 7f3b0a9d0e00 1 client.16017 shutdown 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/2042243360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 msgr2=0x55aac1c62760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:00.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c62760 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009a00 tx=0x7f3af002fa80 comp rx=0 tx=0).stop 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/2042243360 shutdown_connections 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aac1cea5f0 0x55aac1cecab0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aac1c48b60 0x55aac1c631e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aac1c44a70 0x55aac1c62ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 --2- 10.20.193.28:0/2042243360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aac1c440c0 0x55aac1c62760 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/2042243360 >> 10.20.193.28:0/2042243360 conn(0x55aac1c3cb60 msgr2=0x55aac1c5bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3ab3fff640 0 client.16017 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/2042243360 shutdown_connections 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 1 -- 10.20.193.28:0/2042243360 wait complete. 2026-02-20T03:18:00.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.906+0000 7f3b0a9d0e00 20 client.16017 trim_cache size 0 max 16384 2026-02-20T03:18:00.915 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:18:00.915 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:18:00.915 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "65007deb-fdba-4ef4-b625-35f08e58fe2a", 2026-02-20T03:18:00.915 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:18:00.915 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:18:00.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 -- 10.20.193.28:0/464419202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3adc0b0d80 msgr2=0x7f3adc0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:00.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3adc0b0d80 0x7f3adc0b3240 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3af00097c0 tx=0x7f3af002f8c0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 -- 10.20.193.28:0/464419202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b00101dc0 msgr2=0x7f3b00103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:00.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b00101dc0 0x7f3b00103d40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3af400ea60 tx=0x7f3af400ef30 comp rx=0 tx=0).stop 2026-02-20T03:18:00.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 -- 10.20.193.28:0/464419202 shutdown_connections 2026-02-20T03:18:00.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3adc0b0d80 0x7f3adc0b3240 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b0010f1d0 0x7f3b00104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b00101dc0 0x7f3b00103d40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 --2- 10.20.193.28:0/464419202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b001014a0 0x7f3b00103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:00.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 -- 10.20.193.28:0/464419202 >> 10.20.193.28:0/464419202 conn(0x7f3b000fd330 msgr2=0x7f3b000ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:00.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 -- 10.20.193.28:0/464419202 shutdown_connections 2026-02-20T03:18:00.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:00.907+0000 7f3b07242640 1 -- 10.20.193.28:0/464419202 wait complete. 2026-02-20T03:18:01.010 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:18:01.281 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:01.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:01 trial028 ceph-mon[38552]: pgmap v281: 129 pgs: 129 active+clean; 55 MiB data, 908 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 472 op/s 2026-02-20T03:18:01.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:01 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:18:01.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:01 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:01.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:01 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:18:01.326 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:01 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:01.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.476+0000 7f74b7fff640 1 -- 10.20.193.28:0/1349232642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74b810a980 msgr2=0x7f74b810ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:01.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.476+0000 7f74b7fff640 1 --2- 10.20.193.28:0/1349232642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74b810a980 0x7f74b810ad60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009a60 tx=0x7f74ac02f250 comp rx=0 tx=0).stop 2026-02-20T03:18:01.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.476+0000 7f74b7fff640 1 -- 10.20.193.28:0/1349232642 shutdown_connections 2026-02-20T03:18:01.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.476+0000 7f74b7fff640 1 --2- 10.20.193.28:0/1349232642 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74b8105320 0x7f74b8111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.476+0000 7f74b7fff640 1 --2- 10.20.193.28:0/1349232642 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74b8104980 0x7f74b8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.476+0000 7f74b7fff640 1 --2- 10.20.193.28:0/1349232642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74b810a980 0x7f74b810ad60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.476+0000 7f74b7fff640 1 -- 10.20.193.28:0/1349232642 >> 10.20.193.28:0/1349232642 conn(0x7f74b8100680 msgr2=0x7f74b8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:01.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.476+0000 7f74b7fff640 1 -- 10.20.193.28:0/1349232642 shutdown_connections 2026-02-20T03:18:01.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.476+0000 7f74b7fff640 1 -- 10.20.193.28:0/1349232642 wait complete. 2026-02-20T03:18:01.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b7fff640 1 Processor -- start 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b7fff640 1 -- start start 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74b8104980 0x7f74b819d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74b8105320 0x7f74b819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74b810a980 0x7f74b81a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8114bf0 con 0x7f74b810a980 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b7fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8114a70 con 0x7f74b8104980 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b7fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8114d70 con 0x7f74b8105320 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74b8104980 0x7f74b819d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74b8104980 0x7f74b819d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49162/0 (socket says 10.20.193.28:49162) 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b6ffd640 1 -- 10.20.193.28:0/672492582 learned_addr learned my addr 10.20.193.28:0/672492582 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:01.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.477+0000 7f74b67fc640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74b8105320 0x7f74b819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f74b77fe640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74b810a980 0x7f74b81a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f74b67fc640 1 -- 10.20.193.28:0/672492582 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74b8104980 msgr2=0x7f74b819d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f74b67fc640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74b8104980 0x7f74b819d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f74b67fc640 1 -- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74b810a980 msgr2=0x7f74b81a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f74b67fc640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74b810a980 0x7f74b81a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f74b67fc640 1 -- 10.20.193.28:0/672492582 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b81a2120 con 0x7f74b8105320 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f74b6ffd640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74b8104980 0x7f74b819d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f74b67fc640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74b8105320 0x7f74b819d610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f74a000e9f0 tx=0x7f74a000eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f7497fff640 1 -- 10.20.193.28:0/672492582 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a000cd80 con 0x7f74b8105320 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f74b7fff640 1 -- 10.20.193.28:0/672492582 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b81a2410 con 0x7f74b8105320 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f7497fff640 1 -- 10.20.193.28:0/672492582 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74a0004570 con 0x7f74b8105320 2026-02-20T03:18:01.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.478+0000 7f7497fff640 1 -- 10.20.193.28:0/672492582 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a0010690 con 0x7f74b8105320 2026-02-20T03:18:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.479+0000 7f74b7fff640 1 -- 10.20.193.28:0/672492582 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81a9c50 con 0x7f74b8105320 2026-02-20T03:18:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.481+0000 7f74bfae3e00 1 Processor -- start 2026-02-20T03:18:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.481+0000 7f7497fff640 1 -- 10.20.193.28:0/672492582 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f74a0010830 con 0x7f74b8105320 2026-02-20T03:18:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74bfae3e00 1 -- start start 2026-02-20T03:18:01.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b194c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 0x565436b1d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b25870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x565436a90e50 con 0x565436b1dcd0 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x565436a639c0 con 0x565436b190e0 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x565436a11240 con 0x565436b19a90 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b77fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b25870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 0x565436b1d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b25870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57380/0 (socket says 10.20.193.28:57380) 2026-02-20T03:18:01.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b67fc640 1 -- 10.20.193.28:0/3678613020 learned_addr learned my addr 10.20.193.28:0/3678613020 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b67fc640 1 -- 10.20.193.28:0/3678613020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 msgr2=0x565436b1d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b67fc640 1 --2- 10.20.193.28:0/3678613020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 0x565436b1d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b67fc640 1 -- 10.20.193.28:0/3678613020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 msgr2=0x565436b194c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b67fc640 1 --2- 10.20.193.28:0/3678613020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b194c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.482+0000 7f74b67fc640 1 -- 10.20.193.28:0/3678613020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565436a24420 con 0x565436b1dcd0 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74b67fc640 1 --2- 10.20.193.28:0/3678613020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b25870 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f74a00e4f60 tx=0x7f74a00e4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc36329a23a9d47 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74837fe640 1 -- 10.20.193.28:0/3678613020 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a00f4070 con 0x565436b1dcd0 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74837fe640 1 -- 10.20.193.28:0/3678613020 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74a00e9d90 con 0x565436b1dcd0 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74837fe640 1 -- 10.20.193.28:0/3678613020 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a00ee780 con 0x565436b1dcd0 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f7497fff640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f748c0b0e20 0x7f748c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74bfae3e00 1 -- 10.20.193.28:0/3678613020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 msgr2=0x565436b25870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:01.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/3678613020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b25870 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f74a00e4f60 tx=0x7f74a00e4f90 comp rx=0 tx=0).stop 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74bfae3e00 1 -- 10.20.193.28:0/3678613020 shutdown_connections 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/3678613020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b25870 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/3678613020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 0x565436b1d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.483+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/3678613020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b194c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.484+0000 7f74bfae3e00 1 -- 10.20.193.28:0/3678613020 >> 10.20.193.28:0/3678613020 conn(0x565436ad3290 msgr2=0x565436b17740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.484+0000 7f74b77fe640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f748c0b0e20 0x7f748c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.484+0000 7f7497fff640 1 -- 10.20.193.28:0/672492582 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f74a00e0ec0 con 0x7f74b8105320 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.484+0000 7f74bfae3e00 1 -- 10.20.193.28:0/3678613020 shutdown_connections 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.484+0000 7f74bfae3e00 1 -- 10.20.193.28:0/3678613020 wait complete. 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.484+0000 7f74b77fe640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f748c0b0e20 0x7f748c0b32e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e30 tx=0x7f74a800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.485+0000 7f74bfae3e00 1 -- start start 2026-02-20T03:18:01.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.485+0000 7f74bfae3e00 1 Processor -- start 2026-02-20T03:18:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b190e0 0x565436b55f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b19a90 0x565436b56460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b54660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x565436a5f8f0 con 0x565436b1dcd0 2026-02-20T03:18:01.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x565436851f50 con 0x565436b19a90 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x565436b54bf0 con 0x565436b190e0 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b54660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b54660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57382/0 (socket says 10.20.193.28:57382) 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b77fe640 1 -- 10.20.193.28:0/1924758811 learned_addr learned my addr 10.20.193.28:0/1924758811 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b67fc640 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b19a90 0x565436b56460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b6ffd640 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b190e0 0x565436b55f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b77fe640 1 -- 10.20.193.28:0/1924758811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b190e0 msgr2=0x565436b55f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b77fe640 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b190e0 0x565436b55f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b77fe640 1 -- 10.20.193.28:0/1924758811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b19a90 msgr2=0x565436b56460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b77fe640 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b19a90 0x565436b56460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b77fe640 1 -- 10.20.193.28:0/1924758811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565436b4dd30 con 0x565436b1dcd0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74b77fe640 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b54660 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f74a8016ea0 tx=0x7f74a8004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798987da024797ed server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f7480ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f7480ff9640 1 -- 10.20.193.28:0/1924758811 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8027030 con 0x565436b1dcd0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f7480ff9640 1 -- 10.20.193.28:0/1924758811 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74a801c030 con 0x565436b1dcd0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f7480ff9640 1 -- 10.20.193.28:0/1924758811 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a80048f0 con 0x565436b1dcd0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1924758811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565436834b40 con 0x565436b1dcd0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.486+0000 7f7480ff9640 1 -- 10.20.193.28:0/1924758811 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f74a8023440 con 0x565436b1dcd0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 10 client.16029 _ll_register_callbacks cb 0x565436a9cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1924758811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565436a711a0 con 0x565436b1dcd0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f7480ff9640 1 -- 10.20.193.28:0/1924758811 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f74a8004000 con 0x565436b1dcd0 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 10 client.16029 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:01.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1924758811 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x565436a1e230 con 0x565436b1dcd0 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f7480ff9640 1 -- 10.20.193.28:0/1924758811 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f74a8003a70 con 0x565436b1dcd0 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 10 client.16029 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 20 client.16029 populate_metadata read hostname 'trial028' 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565436b64690 0x565436b66b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 4 client.16029 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1924758811 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565436a6b5b0 con 0x565436b64690 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.487+0000 7f74b6ffd640 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565436b64690 0x565436b66b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.488+0000 7f74b6ffd640 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565436b64690 0x565436b66b50 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=584d1a867adddf8d server_cookie=9dae14f2a90cd487 in_seq=0 out_seq=0 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.488+0000 7f7480ff9640 10 client.16029 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f7480ff9640 1 -- 10.20.193.28:0/1924758811 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x565436a6b5b0 con 0x565436b64690 2026-02-20T03:18:01.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f7480ff9640 10 client.16029 handle_command_reply: tid=0 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 client.16029 shutdown 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1924758811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 msgr2=0x565436b54660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b54660 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f74a8016ea0 tx=0x7f74a8004bb0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1924758811 shutdown_connections 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565436b64690 0x565436b66b50 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b54660 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b19a90 0x565436b56460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f7480ff9640 0 client.16029 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1924758811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b190e0 0x565436b55f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1924758811 >> 10.20.193.28:0/1924758811 conn(0x565436ad3290 msgr2=0x565436b1ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1924758811 shutdown_connections 2026-02-20T03:18:01.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1924758811 wait complete. 2026-02-20T03:18:01.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.489+0000 7f74bfae3e00 20 client.16029 trim_cache size 0 max 16384 2026-02-20T03:18:01.499 INFO:tasks.workunit.client.0.trial028.stdout: 1 252446 14.67 MB/sec warmup 94 sec latency 9.547 ms 2026-02-20T03:18:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.498+0000 7f74bfae3e00 1 Processor -- start 2026-02-20T03:18:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.498+0000 7f74bfae3e00 1 -- start start 2026-02-20T03:18:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.498+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b16740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.498+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 0x565436b16c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.498+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b6c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.498+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f745c0126d0 con 0x565436b1dcd0 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.498+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f745c00ff40 con 0x565436b190e0 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.498+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f745c00dd90 con 0x565436b19a90 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.498+0000 7f74b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b6c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b6c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57384/0 (socket says 10.20.193.28:57384) 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b77fe640 1 -- 10.20.193.28:0/572450636 learned_addr learned my addr 10.20.193.28:0/572450636 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b67fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 0x565436b16c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b6ffd640 1 --2- 10.20.193.28:0/572450636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b16740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b77fe640 1 -- 10.20.193.28:0/572450636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 msgr2=0x565436b16c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b77fe640 1 --2- 10.20.193.28:0/572450636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 0x565436b16c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b77fe640 1 -- 10.20.193.28:0/572450636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 msgr2=0x565436b16740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:01.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b77fe640 1 --2- 10.20.193.28:0/572450636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b16740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b77fe640 1 -- 10.20.193.28:0/572450636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565436b4db60 con 0x565436b1dcd0 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74b77fe640 1 --2- 10.20.193.28:0/572450636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b6c460 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f74a8003cb0 tx=0x7f74a802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fbee12eda9fa94 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f7482ffd640 1 -- 10.20.193.28:0/572450636 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a803e070 con 0x565436b1dcd0 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f7482ffd640 1 -- 10.20.193.28:0/572450636 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74a801c070 con 0x565436b1dcd0 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f7482ffd640 1 -- 10.20.193.28:0/572450636 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8027040 con 0x565436b1dcd0 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74bfae3e00 1 -- 10.20.193.28:0/572450636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 msgr2=0x565436b6c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.499+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/572450636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b6c460 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f74a8003cb0 tx=0x7f74a802d000 comp rx=0 tx=0).stop 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.500+0000 7f74bfae3e00 1 -- 10.20.193.28:0/572450636 shutdown_connections 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.500+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/572450636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b1dcd0 0x565436b6c460 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.500+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/572450636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b19a90 0x565436b16c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.500+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/572450636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b16740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.500+0000 7f74bfae3e00 1 -- 10.20.193.28:0/572450636 >> 10.20.193.28:0/572450636 conn(0x565436ad3290 msgr2=0x565436b595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:01.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.500+0000 7f74bfae3e00 1 -- 10.20.193.28:0/572450636 shutdown_connections 2026-02-20T03:18:01.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.500+0000 7f74bfae3e00 1 -- 10.20.193.28:0/572450636 wait complete. 2026-02-20T03:18:01.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.500+0000 7f74bfae3e00 1 -- start start 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.500+0000 7f74bfae3e00 1 Processor -- start 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b5bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b19a90 0x565436b5c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74bfae3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b1dcd0 0x565436bcf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f745c00e400 con 0x565436b19a90 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f745c00f870 con 0x565436b190e0 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74bfae3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f745c00ead0 con 0x565436b1dcd0 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b19a90 0x565436b5c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b19a90 0x565436b5c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57398/0 (socket says 10.20.193.28:57398) 2026-02-20T03:18:01.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b67fc640 1 -- 10.20.193.28:0/1025434343 learned_addr learned my addr 10.20.193.28:0/1025434343 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b77fe640 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b1dcd0 0x565436bcf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b6ffd640 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b5bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b67fc640 1 -- 10.20.193.28:0/1025434343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b1dcd0 msgr2=0x565436bcf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b67fc640 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b1dcd0 0x565436bcf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b67fc640 1 -- 10.20.193.28:0/1025434343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 msgr2=0x565436b5bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b67fc640 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b5bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b67fc640 1 -- 10.20.193.28:0/1025434343 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565436742870 con 0x565436b19a90 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b6ffd640 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b5bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f74b67fc640 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b19a90 0x565436b5c480 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f74a00e9fb0 tx=0x7f74a00e9f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47500bdc13365157 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f7480ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f7480ff9640 1 -- 10.20.193.28:0/1025434343 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a00a5000 con 0x565436b19a90 2026-02-20T03:18:01.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f7480ff9640 1 -- 10.20.193.28:0/1025434343 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74a00e4750 con 0x565436b19a90 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.501+0000 7f7480ff9640 1 -- 10.20.193.28:0/1025434343 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a00a80c0 con 0x565436b19a90 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1025434343 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565436a03440 con 0x565436b19a90 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f7480ff9640 1 -- 10.20.193.28:0/1025434343 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f74a00a8460 con 0x565436b19a90 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 10 client.16035 _ll_register_callbacks cb 0x7f74a8009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1025434343 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74a801c070 con 0x565436b19a90 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f7480ff9640 1 -- 10.20.193.28:0/1025434343 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f74a00a82a0 con 0x565436b19a90 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 10 client.16035 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1025434343 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x565436b4e850 con 0x565436b19a90 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f7480ff9640 1 -- 10.20.193.28:0/1025434343 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f74a00b1970 con 0x565436b19a90 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 10 client.16035 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:01.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 20 client.16035 populate_metadata read hostname 'trial028' 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565436bd0b60 0x565436bd2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 4 client.16035 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.502+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1025434343 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x565436a6b5b0 con 0x565436bd0b60 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.503+0000 7f74b6ffd640 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565436bd0b60 0x565436bd2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.503+0000 7f74b6ffd640 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565436bd0b60 0x565436bd2f50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=257b6e97ff4669af server_cookie=81ffb6776e4bf449 in_seq=0 out_seq=0 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.503+0000 7f7480ff9640 10 client.16035 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.503+0000 7f7480ff9640 1 -- 10.20.193.28:0/1025434343 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x565436a6b5b0 con 0x565436bd0b60 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.503+0000 7f7480ff9640 10 client.16035 handle_command_reply: tid=0 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.503+0000 7f74bfae3e00 1 client.16035 shutdown 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.503+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1025434343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b19a90 msgr2=0x565436b5c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:01.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.503+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b19a90 0x565436b5c480 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f74a00e9fb0 tx=0x7f74a00e9f40 comp rx=0 tx=0).stop 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1025434343 shutdown_connections 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565436bd0b60 0x565436bd2f50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f7480ff9640 0 client.16035 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565436b1dcd0 0x565436bcf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565436b19a90 0x565436b5c480 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74bfae3e00 1 --2- 10.20.193.28:0/1025434343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565436b190e0 0x565436b5bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1025434343 >> 10.20.193.28:0/1025434343 conn(0x565436ad3290 msgr2=0x565436b50b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1025434343 shutdown_connections 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74bfae3e00 1 -- 10.20.193.28:0/1025434343 wait complete. 2026-02-20T03:18:01.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74bfae3e00 20 client.16035 trim_cache size 0 max 16384 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout: "65007deb-fdba-4ef4-b625-35f08e58fe2a": { 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "65007deb-fdba-4ef4-b625-35f08e58fe2a", 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:01.513 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:18:01.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 -- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f748c0b0e20 msgr2=0x7f748c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f748c0b0e20 0x7f748c0b32e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e30 tx=0x7f74a800b040 comp rx=0 tx=0).stop 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 -- 10.20.193.28:0/672492582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74b8105320 msgr2=0x7f74b819d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74b8105320 0x7f74b819d610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f74a000e9f0 tx=0x7f74a000eec0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 -- 10.20.193.28:0/672492582 shutdown_connections 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f748c0b0e20 0x7f748c0b32e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74b810a980 0x7f74b81a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74b8105320 0x7f74b819d610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 --2- 10.20.193.28:0/672492582 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74b8104980 0x7f74b819d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.504+0000 7f74b7fff640 1 -- 10.20.193.28:0/672492582 >> 10.20.193.28:0/672492582 conn(0x7f74b8100680 msgr2=0x7f74b8101060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:01.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.505+0000 7f74b7fff640 1 -- 10.20.193.28:0/672492582 shutdown_connections 2026-02-20T03:18:01.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:01.505+0000 7f74b7fff640 1 -- 10.20.193.28:0/672492582 wait complete. 2026-02-20T03:18:01.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:01 trial126 ceph-mon[38476]: pgmap v281: 129 pgs: 129 active+clean; 55 MiB data, 908 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 472 op/s 2026-02-20T03:18:01.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:01 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:18:01.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:01 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:01.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:01 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:18:01.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:01 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:01.611 INFO:tasks.cephfs.filesystem:scrub status for tag:65007deb-fdba-4ef4-b625-35f08e58fe2a - {'path': '/', 'tag': '65007deb-fdba-4ef4-b625-35f08e58fe2a', 'options': 'recursive,force'} 2026-02-20T03:18:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:01 trial177 ceph-mon[43181]: pgmap v281: 129 pgs: 129 active+clean; 55 MiB data, 908 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 MiB/s rd, 2.2 MiB/s wr, 472 op/s 2026-02-20T03:18:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:01 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:18:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:01 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:01 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:18:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:01 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 255981 14.71 MB/sec warmup 95 sec latency 44.614 ms 2026-02-20T03:18:02.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:02 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:18:02.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:02 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:02 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:18:02.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:02 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:18:02.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:02 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:02 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:02 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:18:02.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:02 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:02 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:18:02.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:02 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:18:02.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:02 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:02 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.642+0000 7fd30575b640 1 -- 10.20.193.28:0/661913201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd300109e60 msgr2=0x7fd30010a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:02.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.642+0000 7fd30575b640 1 --2- 10.20.193.28:0/661913201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd300109e60 0x7fd30010a2e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009960 tx=0x7fd2f002f140 comp rx=0 tx=0).stop 2026-02-20T03:18:02.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.642+0000 7fd30575b640 1 -- 10.20.193.28:0/661913201 shutdown_connections 2026-02-20T03:18:02.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.643+0000 7fd30575b640 1 --2- 10.20.193.28:0/661913201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd30010a900 0x7fd300111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.643+0000 7fd30575b640 1 --2- 10.20.193.28:0/661913201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd300109e60 0x7fd30010a2e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.643+0000 7fd30575b640 1 --2- 10.20.193.28:0/661913201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd300109490 0x7fd300109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.643+0000 7fd30575b640 1 -- 10.20.193.28:0/661913201 >> 10.20.193.28:0/661913201 conn(0x7fd300077fe0 msgr2=0x7fd30007a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:02.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.643+0000 7fd30575b640 1 -- 10.20.193.28:0/661913201 shutdown_connections 2026-02-20T03:18:02.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.643+0000 7fd30575b640 1 -- 10.20.193.28:0/661913201 wait complete. 2026-02-20T03:18:02.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.643+0000 7fd30575b640 1 Processor -- start 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.643+0000 7fd30575b640 1 -- start start 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.643+0000 7fd30575b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd300109490 0x7fd3001a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd30575b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd300109e60 0x7fd3001a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd30575b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd30010a900 0x7fd3001a84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd30575b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd300114910 con 0x7fd30010a900 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd30575b640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd300114790 con 0x7fd300109e60 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd30575b640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd300114a90 con 0x7fd300109490 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd304f5a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd30010a900 0x7fd3001a84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd2fffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd300109490 0x7fd3001a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd2ff7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd300109e60 0x7fd3001a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd304f5a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd30010a900 0x7fd3001a84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57418/0 (socket says 10.20.193.28:57418) 2026-02-20T03:18:02.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd304f5a640 1 -- 10.20.193.28:0/2566441068 learned_addr learned my addr 10.20.193.28:0/2566441068 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:02.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd304f5a640 1 -- 10.20.193.28:0/2566441068 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd300109490 msgr2=0x7fd3001a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:02.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd304f5a640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd300109490 0x7fd3001a0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd304f5a640 1 -- 10.20.193.28:0/2566441068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd300109e60 msgr2=0x7fd3001a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:02.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd304f5a640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd300109e60 0x7fd3001a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd304f5a640 1 -- 10.20.193.28:0/2566441068 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3001a8be0 con 0x7fd30010a900 2026-02-20T03:18:02.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.644+0000 7fd304f5a640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd30010a900 0x7fd3001a84e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400e3c0 tx=0x7fd2f400e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:02.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.645+0000 7fd2fd7fa640 1 -- 10.20.193.28:0/2566441068 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40040d0 con 0x7fd30010a900 2026-02-20T03:18:02.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.645+0000 7fd2fd7fa640 1 -- 10.20.193.28:0/2566441068 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd2f4018070 con 0x7fd30010a900 2026-02-20T03:18:02.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.645+0000 7fd30575b640 1 -- 10.20.193.28:0/2566441068 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3001a8e70 con 0x7fd30010a900 2026-02-20T03:18:02.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.645+0000 7fd2fd7fa640 1 -- 10.20.193.28:0/2566441068 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4013a20 con 0x7fd30010a900 2026-02-20T03:18:02.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.645+0000 7fd30575b640 1 -- 10.20.193.28:0/2566441068 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3001a9380 con 0x7fd30010a900 2026-02-20T03:18:02.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.648+0000 7fd2fd7fa640 1 -- 10.20.193.28:0/2566441068 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd2f4013bc0 con 0x7fd30010a900 2026-02-20T03:18:02.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.648+0000 7fd30984ee00 1 Processor -- start 2026-02-20T03:18:02.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd30984ee00 1 -- start start 2026-02-20T03:18:02.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb52f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 0x556fb52f99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd30984ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556fb52428f0 con 0x556fb52f27c0 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd30984ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556fb51f02e0 con 0x556fb52f7560 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd30984ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556fb523e820 con 0x556fb52f1e80 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2ff7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2fffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb52f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2ff7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40072/0 (socket says 10.20.193.28:40072) 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2ff7fe640 1 -- 10.20.193.28:0/1198362239 learned_addr learned my addr 10.20.193.28:0/1198362239 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2ff7fe640 1 --2- 10.20.193.28:0/1198362239 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 0x556fb52f99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2ff7fe640 1 -- 10.20.193.28:0/1198362239 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 msgr2=0x556fb52f99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2ff7fe640 1 --2- 10.20.193.28:0/1198362239 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 0x556fb52f99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2ff7fe640 1 -- 10.20.193.28:0/1198362239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 msgr2=0x556fb52f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2ff7fe640 1 --2- 10.20.193.28:0/1198362239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb52f6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2fd7fa640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2d40b0ea0 0x7fd2d40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.649+0000 7fd2ff7fe640 1 -- 10.20.193.28:0/1198362239 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb51e25a0 con 0x556fb52f1e80 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd2fd7fa640 1 -- 10.20.193.28:0/2566441068 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd2f40e08d0 con 0x7fd30010a900 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd2ff7fe640 1 --2- 10.20.193.28:0/1198362239 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f2280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0005860 tx=0x7fd2f0031040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9169899089e915f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd2fffff640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2d40b0ea0 0x7fd2d40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd2d0bfe640 1 -- 10.20.193.28:0/1198362239 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0002b80 con 0x556fb52f1e80 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd2d0bfe640 1 -- 10.20.193.28:0/1198362239 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd2f0033070 con 0x556fb52f1e80 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd2d0bfe640 1 -- 10.20.193.28:0/1198362239 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0038770 con 0x556fb52f1e80 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd30984ee00 1 -- 10.20.193.28:0/1198362239 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 msgr2=0x556fb52f2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd30984ee00 1 --2- 10.20.193.28:0/1198362239 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f2280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0005860 tx=0x7fd2f0031040 comp rx=0 tx=0).stop 2026-02-20T03:18:02.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd30984ee00 1 -- 10.20.193.28:0/1198362239 shutdown_connections 2026-02-20T03:18:02.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd30984ee00 1 --2- 10.20.193.28:0/1198362239 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 0x556fb52f99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd30984ee00 1 --2- 10.20.193.28:0/1198362239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb52f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd30984ee00 1 --2- 10.20.193.28:0/1198362239 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f2280 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd30984ee00 1 -- 10.20.193.28:0/1198362239 >> 10.20.193.28:0/1198362239 conn(0x556fb52e96f0 msgr2=0x556fb52f0570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:02.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd2fffff640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2d40b0ea0 0x7fd2d40b3360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x556fb52f2eb0 tx=0x7fd2ec009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:02.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd30984ee00 1 -- 10.20.193.28:0/1198362239 shutdown_connections 2026-02-20T03:18:02.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.650+0000 7fd30984ee00 1 -- 10.20.193.28:0/1198362239 wait complete. 2026-02-20T03:18:02.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd30984ee00 1 -- start start 2026-02-20T03:18:02.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd30984ee00 1 Processor -- start 2026-02-20T03:18:02.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f1e80 0x556fb530a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb530aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f7560 0x556fb5311e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd30984ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556fb51ea0c0 con 0x556fb52f27c0 2026-02-20T03:18:02.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd30984ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556fb52fa5b0 con 0x556fb52f1e80 2026-02-20T03:18:02.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd30984ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556fb53123f0 con 0x556fb52f7560 2026-02-20T03:18:02.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd2fffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f1e80 0x556fb530a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd2fffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f1e80 0x556fb530a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49228/0 (socket says 10.20.193.28:49228) 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd2fffff640 1 -- 10.20.193.28:0/724603085 learned_addr learned my addr 10.20.193.28:0/724603085 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd2ff7fe640 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb530aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.652+0000 7fd304f5a640 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f7560 0x556fb5311e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2fffff640 1 -- 10.20.193.28:0/724603085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f7560 msgr2=0x556fb5311e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2fffff640 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f7560 0x556fb5311e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2fffff640 1 -- 10.20.193.28:0/724603085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 msgr2=0x556fb530aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2fffff640 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb530aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2fffff640 1 -- 10.20.193.28:0/724603085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb53040d0 con 0x556fb52f1e80 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2fffff640 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f1e80 0x556fb530a9a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec011860 tx=0x7fd2ec004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3121f9849681a37f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:02.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2c1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/724603085 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec011e00 con 0x556fb52f1e80 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd30984ee00 1 -- 10.20.193.28:0/724603085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fb51fe820 con 0x556fb52f1e80 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd30984ee00 10 client.25952 _ll_register_callbacks cb 0x556fb51edff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd30984ee00 1 -- 10.20.193.28:0/724603085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556fb524a4e0 con 0x556fb52f1e80 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/724603085 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd2ec01ed30 con 0x556fb52f1e80 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/724603085 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec01cb60 con 0x556fb52f1e80 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/724603085 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd2ec01cd00 con 0x556fb52f1e80 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/724603085 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd2ec028420 con 0x556fb52f1e80 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd30984ee00 10 client.25952 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.653+0000 7fd30984ee00 1 -- 10.20.193.28:0/724603085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=26}) -- 0x556fb5203380 con 0x556fb52f1e80 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/724603085 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fd2ec01e890 con 0x556fb52f1e80 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd30984ee00 10 client.25952 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:02.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd30984ee00 10 client.25952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd30984ee00 20 client.25952 populate_metadata read hostname 'trial028' 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd30984ee00 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556fb5316850 0x556fb5318ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd30984ee00 4 client.25952 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd30984ee00 1 -- 10.20.193.28:0/724603085 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fb51c4bd0 con 0x556fb5316850 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd2ff7fe640 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556fb5316850 0x556fb5318ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd2ff7fe640 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556fb5316850 0x556fb5318ce0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8a7cf6b1fa976b6 server_cookie=4427cfd392dc9a25 in_seq=0 out_seq=0 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.654+0000 7fd2c1ffb640 10 client.25952 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/724603085 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556fb51c4bd0 con 0x556fb5316850 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd2c1ffb640 10 client.25952 handle_command_reply: tid=0 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 client.25952 shutdown 2026-02-20T03:18:02.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 -- 10.20.193.28:0/724603085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f1e80 msgr2=0x556fb530a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f1e80 0x556fb530a9a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec011860 tx=0x7fd2ec004830 comp rx=0 tx=0).stop 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 -- 10.20.193.28:0/724603085 shutdown_connections 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556fb5316850 0x556fb5318ce0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f7560 0x556fb5311e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb530aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 --2- 10.20.193.28:0/724603085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f1e80 0x556fb530a9a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 -- 10.20.193.28:0/724603085 >> 10.20.193.28:0/724603085 conn(0x556fb52e96f0 msgr2=0x556fb52f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd2c1ffb640 0 client.25952 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 -- 10.20.193.28:0/724603085 shutdown_connections 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 1 -- 10.20.193.28:0/724603085 wait complete. 2026-02-20T03:18:02.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.655+0000 7fd30984ee00 20 client.25952 trim_cache size 0 max 16384 2026-02-20T03:18:02.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd30984ee00 1 Processor -- start 2026-02-20T03:18:02.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd30984ee00 1 -- start start 2026-02-20T03:18:02.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb5311d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 0x556fb530a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd30984ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4012700 con 0x556fb52f27c0 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd30984ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a400ff70 con 0x556fb52f7560 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd30984ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a400ddc0 con 0x556fb52f1e80 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd2fffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd2fffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40096/0 (socket says 10.20.193.28:40096) 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd2fffff640 1 -- 10.20.193.28:0/2037718956 learned_addr learned my addr 10.20.193.28:0/2037718956 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd304f5a640 1 --2- 10.20.193.28:0/2037718956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 0x556fb530a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd2ff7fe640 1 --2- 10.20.193.28:0/2037718956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb5311d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd2fffff640 1 -- 10.20.193.28:0/2037718956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 msgr2=0x556fb530a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:02.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd2fffff640 1 --2- 10.20.193.28:0/2037718956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 0x556fb530a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd2fffff640 1 -- 10.20.193.28:0/2037718956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 msgr2=0x556fb5311d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:02.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd2fffff640 1 --2- 10.20.193.28:0/2037718956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb5311d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.663+0000 7fd2fffff640 1 -- 10.20.193.28:0/2037718956 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb5309790 con 0x556fb52f1e80 2026-02-20T03:18:02.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd2fffff640 1 --2- 10.20.193.28:0/2037718956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f4240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec004790 tx=0x7fd2ec032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ee9af70e454e135 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:02.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd2c3fff640 1 -- 10.20.193.28:0/2037718956 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec03e070 con 0x556fb52f1e80 2026-02-20T03:18:02.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd2c3fff640 1 -- 10.20.193.28:0/2037718956 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x556fb524a4e0 con 0x556fb52f1e80 2026-02-20T03:18:02.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd2c3fff640 1 -- 10.20.193.28:0/2037718956 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec01ea00 con 0x556fb52f1e80 2026-02-20T03:18:02.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd30984ee00 1 -- 10.20.193.28:0/2037718956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 msgr2=0x556fb52f4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:02.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd30984ee00 1 --2- 10.20.193.28:0/2037718956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f4240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec004790 tx=0x7fd2ec032000 comp rx=0 tx=0).stop 2026-02-20T03:18:02.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd30984ee00 1 -- 10.20.193.28:0/2037718956 shutdown_connections 2026-02-20T03:18:02.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd30984ee00 1 --2- 10.20.193.28:0/2037718956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f7560 0x556fb530a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd30984ee00 1 --2- 10.20.193.28:0/2037718956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f27c0 0x556fb5311d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd30984ee00 1 --2- 10.20.193.28:0/2037718956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb52f4240 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd30984ee00 1 -- 10.20.193.28:0/2037718956 >> 10.20.193.28:0/2037718956 conn(0x556fb52e96f0 msgr2=0x556fb52f0570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd30984ee00 1 -- 10.20.193.28:0/2037718956 shutdown_connections 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.664+0000 7fd30984ee00 1 -- 10.20.193.28:0/2037718956 wait complete. 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd30984ee00 1 -- start start 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd30984ee00 1 Processor -- start 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb530fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f27c0 0x556fb5310160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd30984ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f7560 0x556fb5311190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd30984ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a400e430 con 0x556fb52f7560 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd30984ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a400f8a0 con 0x556fb52f27c0 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd30984ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a400eb00 con 0x556fb52f1e80 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd2fffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb530fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd304f5a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f7560 0x556fb5311190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd2ff7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f27c0 0x556fb5310160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd2fffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb530fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40100/0 (socket says 10.20.193.28:40100) 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.665+0000 7fd2fffff640 1 -- 10.20.193.28:0/3678279205 learned_addr learned my addr 10.20.193.28:0/3678279205 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd304f5a640 1 -- 10.20.193.28:0/3678279205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 msgr2=0x556fb530fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd304f5a640 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb530fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd304f5a640 1 -- 10.20.193.28:0/3678279205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f27c0 msgr2=0x556fb5310160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd304f5a640 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f27c0 0x556fb5310160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd304f5a640 1 -- 10.20.193.28:0/3678279205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fb5303f00 con 0x556fb52f7560 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd2ff7fe640 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f27c0 0x556fb5310160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd304f5a640 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f7560 0x556fb5311190 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40ddf40 tx=0x7fd2f40a8170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dd14583d528ac8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd2c1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:02.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/3678279205 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40a8cb0 con 0x556fb52f7560 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/3678279205 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd2f40ac960 con 0x556fb52f7560 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/3678279205 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f40a7030 con 0x556fb52f7560 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd30984ee00 1 -- 10.20.193.28:0/3678279205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fb4fa2690 con 0x556fb52f7560 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd30984ee00 10 client.16053 _ll_register_callbacks cb 0x7fd2ec011510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd30984ee00 1 -- 10.20.193.28:0/3678279205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2f0033070 con 0x556fb52f7560 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.666+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/3678279205 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd2f40add00 con 0x556fb52f7560 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/3678279205 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd2f40a71f0 con 0x556fb52f7560 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd30984ee00 10 client.16053 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd30984ee00 1 -- 10.20.193.28:0/3678279205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x556fb5207b70 con 0x556fb52f7560 2026-02-20T03:18:02.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/3678279205 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fd2f40a2af0 con 0x556fb52f7560 2026-02-20T03:18:02.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd30984ee00 10 client.16053 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:02.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd30984ee00 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:02.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd30984ee00 20 client.16053 populate_metadata read hostname 'trial028' 2026-02-20T03:18:02.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd30984ee00 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556fb5382250 0x556fb53846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:02.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd30984ee00 4 client.16053 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:18:02.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd30984ee00 1 -- 10.20.193.28:0/3678279205 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556fb501b520 con 0x556fb5382250 2026-02-20T03:18:02.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.667+0000 7fd2fffff640 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556fb5382250 0x556fb53846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:02.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.668+0000 7fd2fffff640 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556fb5382250 0x556fb53846e0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f258078f1d08b9 server_cookie=1a80c6cd8ef4fcbd in_seq=0 out_seq=0 2026-02-20T03:18:02.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.668+0000 7fd2c1ffb640 10 client.16053 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:02.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:02 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:18:02.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:02 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:02 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:18:02.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:02 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:18:02.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:02 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:02 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:02.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd2c1ffb640 1 -- 10.20.193.28:0/3678279205 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556fb501b520 con 0x556fb5382250 2026-02-20T03:18:02.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd2c1ffb640 10 client.16053 handle_command_reply: tid=0 2026-02-20T03:18:02.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 client.16053 shutdown 2026-02-20T03:18:02.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 -- 10.20.193.28:0/3678279205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f7560 msgr2=0x556fb5311190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:02.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f7560 0x556fb5311190 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40ddf40 tx=0x7fd2f40a8170 comp rx=0 tx=0).stop 2026-02-20T03:18:02.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 -- 10.20.193.28:0/3678279205 shutdown_connections 2026-02-20T03:18:02.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556fb5382250 0x556fb53846e0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fb52f7560 0x556fb5311190 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd2c1ffb640 0 client.16053 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:02.759 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fb52f27c0 0x556fb5310160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 --2- 10.20.193.28:0/3678279205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fb52f1e80 0x556fb530fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 -- 10.20.193.28:0/3678279205 >> 10.20.193.28:0/3678279205 conn(0x556fb52e96f0 msgr2=0x556fb5307660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:02.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 -- 10.20.193.28:0/3678279205 shutdown_connections 2026-02-20T03:18:02.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 1 -- 10.20.193.28:0/3678279205 wait complete. 2026-02-20T03:18:02.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.755+0000 7fd30984ee00 20 client.16053 trim_cache size 0 max 16384 2026-02-20T03:18:02.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:18:02.760 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:18:02.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:18:02.761 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:18:02.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 -- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2d40b0ea0 msgr2=0x7fd2d40b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:02.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2d40b0ea0 0x7fd2d40b3360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x556fb52f2eb0 tx=0x7fd2ec009290 comp rx=0 tx=0).stop 2026-02-20T03:18:02.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 -- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd30010a900 msgr2=0x7fd3001a84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:02.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd30010a900 0x7fd3001a84e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400e3c0 tx=0x7fd2f400e890 comp rx=0 tx=0).stop 2026-02-20T03:18:02.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 -- 10.20.193.28:0/2566441068 shutdown_connections 2026-02-20T03:18:02.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2d40b0ea0 0x7fd2d40b3360 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd30010a900 0x7fd3001a84e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.762 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd300109e60 0x7fd3001a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 --2- 10.20.193.28:0/2566441068 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd300109490 0x7fd3001a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:02.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 -- 10.20.193.28:0/2566441068 >> 10.20.193.28:0/2566441068 conn(0x7fd300077fe0 msgr2=0x7fd30010d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:02.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 -- 10.20.193.28:0/2566441068 shutdown_connections 2026-02-20T03:18:02.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:02.756+0000 7fd30575b640 1 -- 10.20.193.28:0/2566441068 wait complete. 2026-02-20T03:18:03.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 259450 14.76 MB/sec warmup 96 sec latency 22.252 ms 2026-02-20T03:18:03.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:03 trial126 ceph-mon[38476]: pgmap v282: 129 pgs: 129 active+clean; 60 MiB data, 973 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 MiB/s rd, 2.3 MiB/s wr, 486 op/s 2026-02-20T03:18:03.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:03 trial028 ceph-mon[38552]: pgmap v282: 129 pgs: 129 active+clean; 60 MiB data, 973 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 MiB/s rd, 2.3 MiB/s wr, 486 op/s 2026-02-20T03:18:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:03 trial177 ceph-mon[43181]: pgmap v282: 129 pgs: 129 active+clean; 60 MiB data, 973 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 MiB/s rd, 2.3 MiB/s wr, 486 op/s 2026-02-20T03:18:04.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 263106 14.80 MB/sec warmup 97 sec latency 6.995 ms 2026-02-20T03:18:05.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 266928 14.85 MB/sec warmup 98 sec latency 6.639 ms 2026-02-20T03:18:05.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:05 trial126 ceph-mon[38476]: pgmap v283: 129 pgs: 129 active+clean; 62 MiB data, 1003 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 471 op/s 2026-02-20T03:18:05.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:05 trial028 ceph-mon[38552]: pgmap v283: 129 pgs: 129 active+clean; 62 MiB data, 1003 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 471 op/s 2026-02-20T03:18:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:05 trial177 ceph-mon[43181]: pgmap v283: 129 pgs: 129 active+clean; 62 MiB data, 1003 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 2.3 MiB/s wr, 471 op/s 2026-02-20T03:18:06.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 270710 14.91 MB/sec warmup 99 sec latency 6.389 ms 2026-02-20T03:18:07.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 274586 14.98 MB/sec warmup 100 sec latency 6.853 ms 2026-02-20T03:18:07.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:07 trial126 ceph-mon[38476]: pgmap v284: 129 pgs: 129 active+clean; 62 MiB data, 1.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 554 op/s 2026-02-20T03:18:07.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:07 trial028 ceph-mon[38552]: pgmap v284: 129 pgs: 129 active+clean; 62 MiB data, 1.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 554 op/s 2026-02-20T03:18:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:07 trial177 ceph-mon[43181]: pgmap v284: 129 pgs: 129 active+clean; 62 MiB data, 1.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 554 op/s 2026-02-20T03:18:08.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 278181 15.03 MB/sec warmup 101 sec latency 13.089 ms 2026-02-20T03:18:08.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:18:08.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:18:08.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:18:08.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:18:08.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:18:08.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:18:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:18:08.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:18:08.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:18:09.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 281880 15.07 MB/sec warmup 102 sec latency 5.745 ms 2026-02-20T03:18:09.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:09 trial126 ceph-mon[38476]: pgmap v285: 129 pgs: 129 active+clean; 60 MiB data, 1.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 494 op/s 2026-02-20T03:18:09.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:09 trial028 ceph-mon[38552]: pgmap v285: 129 pgs: 129 active+clean; 60 MiB data, 1.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 494 op/s 2026-02-20T03:18:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:09 trial177 ceph-mon[43181]: pgmap v285: 129 pgs: 129 active+clean; 60 MiB data, 1.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 494 op/s 2026-02-20T03:18:10.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 285701 15.11 MB/sec warmup 103 sec latency 7.398 ms 2026-02-20T03:18:11.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 289659 15.16 MB/sec warmup 104 sec latency 6.781 ms 2026-02-20T03:18:11.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:11 trial126 ceph-mon[38476]: pgmap v286: 129 pgs: 129 active+clean; 66 MiB data, 1.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 545 op/s 2026-02-20T03:18:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:11 trial028 ceph-mon[38552]: pgmap v286: 129 pgs: 129 active+clean; 66 MiB data, 1.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 545 op/s 2026-02-20T03:18:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:11 trial177 ceph-mon[43181]: pgmap v286: 129 pgs: 129 active+clean; 66 MiB data, 1.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 545 op/s 2026-02-20T03:18:12.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 290884 15.12 MB/sec warmup 105 sec latency 728.020 ms 2026-02-20T03:18:13.368 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:13 trial028 ceph-mon[38552]: pgmap v287: 129 pgs: 129 active+clean; 67 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 511 op/s 2026-02-20T03:18:13.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 290884 14.97 MB/sec warmup 106 sec latency 1728.062 ms 2026-02-20T03:18:13.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:13 trial126 ceph-mon[38476]: pgmap v287: 129 pgs: 129 active+clean; 67 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 511 op/s 2026-02-20T03:18:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:13 trial177 ceph-mon[43181]: pgmap v287: 129 pgs: 129 active+clean; 67 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 511 op/s 2026-02-20T03:18:14.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 292765 14.90 MB/sec warmup 107 sec latency 2073.138 ms 2026-02-20T03:18:15.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 296625 14.94 MB/sec warmup 108 sec latency 7.760 ms 2026-02-20T03:18:15.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:15 trial126 ceph-mon[38476]: pgmap v288: 129 pgs: 129 active+clean; 71 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 499 op/s 2026-02-20T03:18:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:15 trial028 ceph-mon[38552]: pgmap v288: 129 pgs: 129 active+clean; 71 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 499 op/s 2026-02-20T03:18:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:15 trial177 ceph-mon[43181]: pgmap v288: 129 pgs: 129 active+clean; 71 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 499 op/s 2026-02-20T03:18:15.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.833+0000 7f123da27640 1 -- 10.20.193.28:0/32349833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123810a900 msgr2=0x7f1238111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:15.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.833+0000 7f123da27640 1 --2- 10.20.193.28:0/32349833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123810a900 0x7f1238111480 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f123400b0a0 tx=0x7f123402f410 comp rx=0 tx=0).stop 2026-02-20T03:18:15.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.833+0000 7f123da27640 1 -- 10.20.193.28:0/32349833 shutdown_connections 2026-02-20T03:18:15.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.833+0000 7f123da27640 1 --2- 10.20.193.28:0/32349833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123810a900 0x7f1238111480 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.833+0000 7f123da27640 1 --2- 10.20.193.28:0/32349833 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1238109e60 0x7f123810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.833+0000 7f123da27640 1 --2- 10.20.193.28:0/32349833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1238109490 0x7f1238109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.833+0000 7f123da27640 1 -- 10.20.193.28:0/32349833 >> 10.20.193.28:0/32349833 conn(0x7f1238077fe0 msgr2=0x7f123807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:15.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.833+0000 7f123da27640 1 -- 10.20.193.28:0/32349833 shutdown_connections 2026-02-20T03:18:15.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.833+0000 7f123da27640 1 -- 10.20.193.28:0/32349833 wait complete. 2026-02-20T03:18:15.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.834+0000 7f123da27640 1 Processor -- start 2026-02-20T03:18:15.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.834+0000 7f123da27640 1 -- start start 2026-02-20T03:18:15.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123da27640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1238109490 0x7f12381a0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123da27640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1238109e60 0x7f12381a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123da27640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123810a900 0x7f12381a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123da27640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1238114910 con 0x7f1238109e60 2026-02-20T03:18:15.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123da27640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1238114790 con 0x7f1238109490 2026-02-20T03:18:15.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123da27640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1238114a90 con 0x7f123810a900 2026-02-20T03:18:15.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123ca25640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1238109490 0x7f12381a0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123ca25640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1238109490 0x7f12381a0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50230/0 (socket says 10.20.193.28:50230) 2026-02-20T03:18:15.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123ca25640 1 -- 10.20.193.28:0/1021579184 learned_addr learned my addr 10.20.193.28:0/1021579184 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:15.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f122ffff640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1238109e60 0x7f12381a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123d226640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123810a900 0x7f12381a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123ca25640 1 -- 10.20.193.28:0/1021579184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123810a900 msgr2=0x7f12381a8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123ca25640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123810a900 0x7f12381a8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123ca25640 1 -- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1238109e60 msgr2=0x7f12381a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123ca25640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1238109e60 0x7f12381a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123ca25640 1 -- 10.20.193.28:0/1021579184 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12381a8b50 con 0x7f1238109490 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f122ffff640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1238109e60 0x7f12381a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f123ca25640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1238109490 0x7f12381a0ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f122800e9e0 tx=0x7f122800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f122dffb640 1 -- 10.20.193.28:0/1021579184 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122800cde0 con 0x7f1238109490 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.835+0000 7f122dffb640 1 -- 10.20.193.28:0/1021579184 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1228004570 con 0x7f1238109490 2026-02-20T03:18:15.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.836+0000 7f123da27640 1 -- 10.20.193.28:0/1021579184 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12381a8e40 con 0x7f1238109490 2026-02-20T03:18:15.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.836+0000 7f123da27640 1 -- 10.20.193.28:0/1021579184 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12381a92a0 con 0x7f1238109490 2026-02-20T03:18:15.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.836+0000 7f122dffb640 1 -- 10.20.193.28:0/1021579184 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228010690 con 0x7f1238109490 2026-02-20T03:18:15.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.838+0000 7f1241befe00 1 Processor -- start 2026-02-20T03:18:15.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f1241befe00 1 -- start start 2026-02-20T03:18:15.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f122dffb640 1 -- 10.20.193.28:0/1021579184 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f12280040d0 con 0x7f1238109490 2026-02-20T03:18:15.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f1241befe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x56175056a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f1241befe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056a7c0 0x56175056ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f1241befe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x5617505719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f1241befe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5617504ba8f0 con 0x56175056f560 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f1241befe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5617504682e0 con 0x561750569e80 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f1241befe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5617504b6820 con 0x56175056a7c0 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123d226640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x56175056a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f122ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x5617505719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123ca25640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056a7c0 0x56175056ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123d226640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x56175056a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50234/0 (socket says 10.20.193.28:50234) 2026-02-20T03:18:15.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123d226640 1 -- 10.20.193.28:0/3661634743 learned_addr learned my addr 10.20.193.28:0/3661634743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123d226640 1 -- 10.20.193.28:0/3661634743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056a7c0 msgr2=0x56175056ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123d226640 1 --2- 10.20.193.28:0/3661634743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056a7c0 0x56175056ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123d226640 1 -- 10.20.193.28:0/3661634743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 msgr2=0x5617505719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123d226640 1 --2- 10.20.193.28:0/3661634743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x5617505719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123d226640 1 -- 10.20.193.28:0/3661634743 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175045a5a0 con 0x561750569e80 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.839+0000 7f123d226640 1 --2- 10.20.193.28:0/3661634743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x56175056a280 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f12340074f0 tx=0x7f12340044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1396d120d69cac49 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.840+0000 7f122dffb640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12140b0da0 0x7f12140b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.840+0000 7f122dffb640 1 -- 10.20.193.28:0/1021579184 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f12280e0fe0 con 0x7f1238109490 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f123ca25640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12140b0da0 0x7f12140b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1204ffe640 1 -- 10.20.193.28:0/3661634743 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12340045b0 con 0x561750569e80 2026-02-20T03:18:15.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1204ffe640 1 -- 10.20.193.28:0/3661634743 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1234033050 con 0x561750569e80 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1204ffe640 1 -- 10.20.193.28:0/3661634743 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234002e60 con 0x561750569e80 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1241befe00 1 -- 10.20.193.28:0/3661634743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 msgr2=0x56175056a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1241befe00 1 --2- 10.20.193.28:0/3661634743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x56175056a280 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f12340074f0 tx=0x7f12340044b0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1241befe00 1 -- 10.20.193.28:0/3661634743 shutdown_connections 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1241befe00 1 --2- 10.20.193.28:0/3661634743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x5617505719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1241befe00 1 --2- 10.20.193.28:0/3661634743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056a7c0 0x56175056ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1241befe00 1 --2- 10.20.193.28:0/3661634743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x56175056a280 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1241befe00 1 -- 10.20.193.28:0/3661634743 >> 10.20.193.28:0/3661634743 conn(0x5617505616f0 msgr2=0x561750568570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f123ca25640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12140b0da0 0x7f12140b3260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f122800c6a0 tx=0x7f12280e4a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:15.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1241befe00 1 -- 10.20.193.28:0/3661634743 shutdown_connections 2026-02-20T03:18:15.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.841+0000 7f1241befe00 1 -- 10.20.193.28:0/3661634743 wait complete. 2026-02-20T03:18:15.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.842+0000 7f1241befe00 1 -- start start 2026-02-20T03:18:15.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f1241befe00 1 Processor -- start 2026-02-20T03:18:15.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f1241befe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x5617505829d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f1241befe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 0x561750582f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f1241befe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750589e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f1241befe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5617504620c0 con 0x56175056f560 2026-02-20T03:18:15.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f1241befe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5617505725b0 con 0x56175056a7c0 2026-02-20T03:18:15.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f1241befe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56175058a420 con 0x561750569e80 2026-02-20T03:18:15.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f123d226640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x5617505829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f123d226640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x5617505829d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45230/0 (socket says 10.20.193.28:45230) 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f123d226640 1 -- 10.20.193.28:0/930685369 learned_addr learned my addr 10.20.193.28:0/930685369 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f122ffff640 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 0x561750582f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f123d226640 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750589e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f123d226640 1 -- 10.20.193.28:0/930685369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 msgr2=0x561750582f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f123d226640 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 0x561750582f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f123d226640 1 -- 10.20.193.28:0/930685369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 msgr2=0x561750589e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f123d226640 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750589e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.843+0000 7f123d226640 1 -- 10.20.193.28:0/930685369 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175057c120 con 0x561750569e80 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f123d226640 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x5617505829d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1234002ba0 tx=0x7f123400b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=979c4134488b1dbc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f11fdffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:18:15.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f11fdffb640 1 -- 10.20.193.28:0/930685369 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1234009220 con 0x561750569e80 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f11fdffb640 1 -- 10.20.193.28:0/930685369 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f12340093c0 con 0x561750569e80 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f11fdffb640 1 -- 10.20.193.28:0/930685369 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123404fb40 con 0x561750569e80 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f1241befe00 1 -- 10.20.193.28:0/930685369 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561750476820 con 0x561750569e80 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f11fdffb640 1 -- 10.20.193.28:0/930685369 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f123404fce0 con 0x561750569e80 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f1241befe00 10 client.25972 _ll_register_callbacks cb 0x561750465ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f1241befe00 1 -- 10.20.193.28:0/930685369 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5617504c24e0 con 0x561750569e80 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f11fdffb640 1 -- 10.20.193.28:0/930685369 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1234007810 con 0x561750569e80 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f1241befe00 10 client.25972 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f1241befe00 1 -- 10.20.193.28:0/930685369 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56175047b380 con 0x561750569e80 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f11fdffb640 1 -- 10.20.193.28:0/930685369 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f1234007ab0 con 0x561750569e80 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f1241befe00 10 client.25972 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:15.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f1241befe00 10 client.25972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f1241befe00 20 client.25972 populate_metadata read hostname 'trial028' 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.844+0000 7f1241befe00 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56175058e150 0x5617505905f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.845+0000 7f1241befe00 4 client.25972 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.845+0000 7f1241befe00 1 -- 10.20.193.28:0/930685369 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56175043cbd0 con 0x56175058e150 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.845+0000 7f122ffff640 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56175058e150 0x5617505905f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.845+0000 7f122ffff640 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56175058e150 0x5617505905f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5c8abfebc3d11a server_cookie=d70eeb7dccd4f982 in_seq=0 out_seq=0 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.845+0000 7f11fdffb640 10 client.25972 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f11fdffb640 1 -- 10.20.193.28:0/930685369 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56175043cbd0 con 0x56175058e150 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f11fdffb640 10 client.25972 handle_command_reply: tid=0 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 client.25972 shutdown 2026-02-20T03:18:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 -- 10.20.193.28:0/930685369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 msgr2=0x5617505829d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x5617505829d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1234002ba0 tx=0x7f123400b000 comp rx=0 tx=0).stop 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 -- 10.20.193.28:0/930685369 shutdown_connections 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56175058e150 0x5617505905f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750589e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 0x561750582f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 --2- 10.20.193.28:0/930685369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x5617505829d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 -- 10.20.193.28:0/930685369 >> 10.20.193.28:0/930685369 conn(0x5617505616f0 msgr2=0x5617505708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f11fdffb640 0 client.25972 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 -- 10.20.193.28:0/930685369 shutdown_connections 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 1 -- 10.20.193.28:0/930685369 wait complete. 2026-02-20T03:18:15.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.846+0000 7f1241befe00 20 client.25972 trim_cache size 0 max 16384 2026-02-20T03:18:15.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f1241befe00 1 Processor -- start 2026-02-20T03:18:15.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f1241befe00 1 -- start start 2026-02-20T03:18:15.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f1241befe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x561750580240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f1241befe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056a7c0 0x561750589e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f1241befe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056f560 0x56175056f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f1241befe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc0126d0 con 0x56175056a7c0 2026-02-20T03:18:15.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f1241befe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00ff40 con 0x561750569e80 2026-02-20T03:18:15.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f1241befe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00dd90 con 0x56175056f560 2026-02-20T03:18:15.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f123d226640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x561750580240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f122ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056a7c0 0x561750589e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f122ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056a7c0 0x561750589e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36138/0 (socket says 10.20.193.28:36138) 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f122ffff640 1 -- 10.20.193.28:0/1179817142 learned_addr learned my addr 10.20.193.28:0/1179817142 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.854+0000 7f123d226640 1 --2- 10.20.193.28:0/1179817142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056f560 0x56175056f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f122ffff640 1 -- 10.20.193.28:0/1179817142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056f560 msgr2=0x56175056f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f122ffff640 1 --2- 10.20.193.28:0/1179817142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056f560 0x56175056f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f122ffff640 1 -- 10.20.193.28:0/1179817142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 msgr2=0x561750580240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f122ffff640 1 --2- 10.20.193.28:0/1179817142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x561750580240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f122ffff640 1 -- 10.20.193.28:0/1179817142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56175057bf50 con 0x56175056a7c0 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f122ffff640 1 --2- 10.20.193.28:0/1179817142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056a7c0 0x561750589e50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x561750583df0 tx=0x7f12200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfe605a22d949c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f11fffff640 1 -- 10.20.193.28:0/1179817142 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122001e740 con 0x56175056a7c0 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f11fffff640 1 -- 10.20.193.28:0/1179817142 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f122001ed80 con 0x56175056a7c0 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f11fffff640 1 -- 10.20.193.28:0/1179817142 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12200243f0 con 0x56175056a7c0 2026-02-20T03:18:15.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f1241befe00 1 -- 10.20.193.28:0/1179817142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056a7c0 msgr2=0x561750589e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f1241befe00 1 --2- 10.20.193.28:0/1179817142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056a7c0 0x561750589e50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x561750583df0 tx=0x7f12200047c0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f1241befe00 1 -- 10.20.193.28:0/1179817142 shutdown_connections 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f1241befe00 1 --2- 10.20.193.28:0/1179817142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56175056f560 0x56175056f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f1241befe00 1 --2- 10.20.193.28:0/1179817142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056a7c0 0x561750589e50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f1241befe00 1 --2- 10.20.193.28:0/1179817142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561750569e80 0x561750580240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f1241befe00 1 -- 10.20.193.28:0/1179817142 >> 10.20.193.28:0/1179817142 conn(0x5617505616f0 msgr2=0x5617505828d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f1241befe00 1 -- 10.20.193.28:0/1179817142 shutdown_connections 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.855+0000 7f1241befe00 1 -- 10.20.193.28:0/1179817142 wait complete. 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.856+0000 7f1241befe00 1 -- start start 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.856+0000 7f1241befe00 1 Processor -- start 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.856+0000 7f1241befe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x561750589820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.856+0000 7f1241befe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 0x561750589d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.856+0000 7f1241befe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750586480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.856+0000 7f123d226640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x561750589820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.856+0000 7f1241befe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00e400 con 0x56175056f560 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.856+0000 7f1241befe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00f870 con 0x56175056a7c0 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.856+0000 7f1241befe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00ead0 con 0x561750569e80 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f123d226640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750586480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f123d226640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750586480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36144/0 (socket says 10.20.193.28:36144) 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f123d226640 1 -- 10.20.193.28:0/3035336715 learned_addr learned my addr 10.20.193.28:0/3035336715 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f122ffff640 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 0x561750589d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f123d226640 1 -- 10.20.193.28:0/3035336715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 msgr2=0x561750589820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f123d226640 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x561750589820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f123d226640 1 -- 10.20.193.28:0/3035336715 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 msgr2=0x561750589d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f123d226640 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 0x561750589d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f123d226640 1 -- 10.20.193.28:0/3035336715 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561750580d00 con 0x56175056f560 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f123d226640 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750586480 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1234009a20 tx=0x7f1234009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323a55685e91e087 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f11fdffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f11fdffb640 1 -- 10.20.193.28:0/3035336715 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123404f440 con 0x56175056f560 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f11fdffb640 1 -- 10.20.193.28:0/3035336715 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5617504c24e0 con 0x56175056f560 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f11fdffb640 1 -- 10.20.193.28:0/3035336715 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12340427d0 con 0x56175056f560 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f1241befe00 1 -- 10.20.193.28:0/3035336715 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56175021a690 con 0x56175056f560 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f1241befe00 10 client.16071 _ll_register_callbacks cb 0x7f1234007720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f1241befe00 1 -- 10.20.193.28:0/3035336715 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1234033050 con 0x56175056f560 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f11fdffb640 1 -- 10.20.193.28:0/3035336715 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1234042970 con 0x56175056f560 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f11fdffb640 1 -- 10.20.193.28:0/3035336715 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1234042c10 con 0x56175056f560 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f1241befe00 10 client.16071 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:15.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.857+0000 7f1241befe00 1 -- 10.20.193.28:0/3035336715 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x56175047fb70 con 0x56175056f560 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.858+0000 7f11fdffb640 1 -- 10.20.193.28:0/3035336715 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f123404f5e0 con 0x56175056f560 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.858+0000 7f1241befe00 10 client.16071 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.858+0000 7f1241befe00 10 client.16071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.858+0000 7f1241befe00 20 client.16071 populate_metadata read hostname 'trial028' 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.858+0000 7f1241befe00 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617505f9ce0 0x5617505fc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.858+0000 7f1241befe00 4 client.16071 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.858+0000 7f1241befe00 1 -- 10.20.193.28:0/3035336715 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56175048b6b0 con 0x5617505f9ce0 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.858+0000 7f122ffff640 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617505f9ce0 0x5617505fc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.859+0000 7f122ffff640 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617505f9ce0 0x5617505fc1a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=316c05f3904608e1 server_cookie=2f06706a6363b1d2 in_seq=0 out_seq=0 2026-02-20T03:18:15.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.859+0000 7f11fdffb640 10 client.16071 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:15.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f11fdffb640 1 -- 10.20.193.28:0/3035336715 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56175048b6b0 con 0x5617505f9ce0 2026-02-20T03:18:15.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f11fdffb640 10 client.16071 handle_command_reply: tid=0 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f1241befe00 1 client.16071 shutdown 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f1241befe00 1 -- 10.20.193.28:0/3035336715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 msgr2=0x561750586480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f1241befe00 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750586480 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1234009a20 tx=0x7f1234009040 comp rx=0 tx=0).stop 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f1241befe00 1 -- 10.20.193.28:0/3035336715 shutdown_connections 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f1241befe00 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617505f9ce0 0x5617505fc1a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f1241befe00 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56175056f560 0x561750586480 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f1241befe00 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56175056a7c0 0x561750589d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f1241befe00 1 --2- 10.20.193.28:0/3035336715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561750569e80 0x561750589820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f1241befe00 1 -- 10.20.193.28:0/3035336715 >> 10.20.193.28:0/3035336715 conn(0x5617505616f0 msgr2=0x56175057f230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.934+0000 7f11fdffb640 0 client.16071 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:15.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.935+0000 7f1241befe00 1 -- 10.20.193.28:0/3035336715 shutdown_connections 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.935+0000 7f1241befe00 1 -- 10.20.193.28:0/3035336715 wait complete. 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.935+0000 7f1241befe00 20 client.16071 trim_cache size 0 max 16384 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.935+0000 7f123da27640 1 -- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12140b0da0 msgr2=0x7f12140b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.935+0000 7f123da27640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12140b0da0 0x7f12140b3260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f122800c6a0 tx=0x7f12280e4a20 comp rx=0 tx=0).stop 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.935+0000 7f123da27640 1 -- 10.20.193.28:0/1021579184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1238109490 msgr2=0x7f12381a0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.935+0000 7f123da27640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1238109490 0x7f12381a0ea0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f122800e9e0 tx=0x7f122800eeb0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.936+0000 7f123da27640 1 -- 10.20.193.28:0/1021579184 shutdown_connections 2026-02-20T03:18:15.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.936+0000 7f123da27640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12140b0da0 0x7f12140b3260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.936+0000 7f123da27640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123810a900 0x7f12381a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.936+0000 7f123da27640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1238109e60 0x7f12381a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.936+0000 7f123da27640 1 --2- 10.20.193.28:0/1021579184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1238109490 0x7f12381a0ea0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:15.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.936+0000 7f123da27640 1 -- 10.20.193.28:0/1021579184 >> 10.20.193.28:0/1021579184 conn(0x7f1238077fe0 msgr2=0x7f123810d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:15.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.936+0000 7f123da27640 1 -- 10.20.193.28:0/1021579184 shutdown_connections 2026-02-20T03:18:15.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:15.936+0000 7f123da27640 1 -- 10.20.193.28:0/1021579184 wait complete. 2026-02-20T03:18:16.457 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.3 2026-02-20T03:18:16.458 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:18:16.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 299844 14.98 MB/sec warmup 109 sec latency 49.324 ms 2026-02-20T03:18:16.735 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:16.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.919+0000 7f6e94a6f640 1 -- 10.20.193.28:0/1482709949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 msgr2=0x7f6e90111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.919+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/1482709949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 0x7f6e90111850 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6e8000b0d0 tx=0x7f6e8002f490 comp rx=0 tx=0).stop 2026-02-20T03:18:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.920+0000 7f6e94a6f640 1 -- 10.20.193.28:0/1482709949 shutdown_connections 2026-02-20T03:18:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.920+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/1482709949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 0x7f6e90111850 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.920+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/1482709949 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e90104980 0x7f6e90104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.920+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/1482709949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e9010a980 0x7f6e9010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.920+0000 7f6e94a6f640 1 -- 10.20.193.28:0/1482709949 >> 10.20.193.28:0/1482709949 conn(0x7f6e90100680 msgr2=0x7f6e90102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.920+0000 7f6e94a6f640 1 -- 10.20.193.28:0/1482709949 shutdown_connections 2026-02-20T03:18:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.920+0000 7f6e94a6f640 1 -- 10.20.193.28:0/1482709949 wait complete. 2026-02-20T03:18:16.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e94a6f640 1 Processor -- start 2026-02-20T03:18:16.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e94a6f640 1 -- start start 2026-02-20T03:18:16.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e94a6f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e90104980 0x7f6e90111680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:16.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e94a6f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 0x7f6e9010e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e94a6f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e9010a980 0x7f6e9010ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e94a6f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90114cd0 con 0x7f6e90105320 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e94a6f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90114b50 con 0x7f6e90104980 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e94a6f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90114e50 con 0x7f6e9010a980 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e8e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 0x7f6e9010e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e8e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 0x7f6e9010e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35330/0 (socket says 10.20.193.28:35330) 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.921+0000 7f6e8e575640 1 -- 10.20.193.28:0/2533758118 learned_addr learned my addr 10.20.193.28:0/2533758118 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.922+0000 7f6e8f577640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e9010a980 0x7f6e9010ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.922+0000 7f6e8ed76640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e90104980 0x7f6e90111680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.922+0000 7f6e8e575640 1 -- 10.20.193.28:0/2533758118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e9010a980 msgr2=0x7f6e9010ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:16.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.922+0000 7f6e8e575640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e9010a980 0x7f6e9010ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.922+0000 7f6e8e575640 1 -- 10.20.193.28:0/2533758118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e90104980 msgr2=0x7f6e90111680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.922+0000 7f6e8e575640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e90104980 0x7f6e90111680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.922+0000 7f6e8e575640 1 -- 10.20.193.28:0/2533758118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9010f550 con 0x7f6e90105320 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.922+0000 7f6e8ed76640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e90104980 0x7f6e90111680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.923+0000 7f6e8e575640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 0x7f6e9010e730 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800b570 tx=0x7f6e7800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.923+0000 7f6e6ffff640 1 -- 10.20.193.28:0/2533758118 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78013020 con 0x7f6e90105320 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.923+0000 7f6e6ffff640 1 -- 10.20.193.28:0/2533758118 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e78004480 con 0x7f6e90105320 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.923+0000 7f6e6ffff640 1 -- 10.20.193.28:0/2533758118 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800fb50 con 0x7f6e90105320 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.923+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e901a3270 con 0x7f6e90105320 2026-02-20T03:18:16.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.923+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e901a3760 con 0x7f6e90105320 2026-02-20T03:18:16.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.924+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e901060c0 con 0x7f6e90105320 2026-02-20T03:18:16.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.927+0000 7f6e6ffff640 1 -- 10.20.193.28:0/2533758118 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6e78002780 con 0x7f6e90105320 2026-02-20T03:18:16.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.929+0000 7f6e6ffff640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e600b0ea0 0x7f6e600b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:16.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.929+0000 7f6e6ffff640 1 -- 10.20.193.28:0/2533758118 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6e780e0c10 con 0x7f6e90105320 2026-02-20T03:18:16.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.929+0000 7f6e8ed76640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e600b0ea0 0x7f6e600b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:16.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.929+0000 7f6e6ffff640 1 -- 10.20.193.28:0/2533758118 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f6e7801d020 con 0x7f6e90105320 2026-02-20T03:18:16.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:16.929+0000 7f6e8ed76640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e600b0ea0 0x7f6e600b3360 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e84007920 tx=0x7f6e84008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:17.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.041+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e90078750 con 0x7f6e90105320 2026-02-20T03:18:17.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.042+0000 7f6e6ffff640 1 -- 10.20.193.28:0/2533758118 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11924 (secure 0 0 0) 0x7f6e780a8ff0 con 0x7f6e90105320 2026-02-20T03:18:17.045 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:18:17.046 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T03:17:23:524010+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:17:23.524005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:18:17.046 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T03:18:17.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e600b0ea0 msgr2=0x7f6e600b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:17.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e600b0ea0 0x7f6e600b3360 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6e84007920 tx=0x7f6e84008040 comp rx=0 tx=0).stop 2026-02-20T03:18:17.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 msgr2=0x7f6e9010e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:17.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 0x7f6e9010e730 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800b570 tx=0x7f6e7800ba40 comp rx=0 tx=0).stop 2026-02-20T03:18:17.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 shutdown_connections 2026-02-20T03:18:17.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e600b0ea0 0x7f6e600b3360 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e9010a980 0x7f6e9010ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105320 0x7f6e9010e730 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 --2- 10.20.193.28:0/2533758118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e90104980 0x7f6e90111680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.044+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 >> 10.20.193.28:0/2533758118 conn(0x7f6e90100680 msgr2=0x7f6e90100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:17.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.045+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 shutdown_connections 2026-02-20T03:18:17.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.045+0000 7f6e94a6f640 1 -- 10.20.193.28:0/2533758118 wait complete. 2026-02-20T03:18:17.214 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 137.3 --await-for 45.0' 2026-02-20T03:18:17.215 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 137.3 --await-for 45.0 2026-02-20T03:18:17.299 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:17 trial028 ceph-mon[38552]: pgmap v289: 129 pgs: 129 active+clean; 73 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 505 op/s 2026-02-20T03:18:17.299 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:17 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2533758118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:18:17.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301659 14.95 MB/sec warmup 110 sec latency 658.087 ms 2026-02-20T03:18:17.571 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:17.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:17 trial126 ceph-mon[38476]: pgmap v289: 129 pgs: 129 active+clean; 73 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 505 op/s 2026-02-20T03:18:17.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:17 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2533758118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:18:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:17 trial177 ceph-mon[43181]: pgmap v289: 129 pgs: 129 active+clean; 73 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 505 op/s 2026-02-20T03:18:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:17 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2533758118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:18:17.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.816+0000 7f1adf577640 1 -- 10.20.193.28:0/1241466225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0105320 msgr2=0x7f1ae0111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:17.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.816+0000 7f1adf577640 1 --2- 10.20.193.28:0/1241466225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0105320 0x7f1ae0111850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000b0d0 tx=0x7f1ad002f490 comp rx=0 tx=0).stop 2026-02-20T03:18:17.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.816+0000 7f1adf577640 1 -- 10.20.193.28:0/1241466225 shutdown_connections 2026-02-20T03:18:17.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.816+0000 7f1adf577640 1 --2- 10.20.193.28:0/1241466225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0105320 0x7f1ae0111850 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.816+0000 7f1adf577640 1 --2- 10.20.193.28:0/1241466225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ae0104980 0x7f1ae0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.816+0000 7f1adf577640 1 --2- 10.20.193.28:0/1241466225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ae010a980 0x7f1ae010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.816+0000 7f1adf577640 1 -- 10.20.193.28:0/1241466225 >> 10.20.193.28:0/1241466225 conn(0x7f1ae0100680 msgr2=0x7f1ae0102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:17.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.816+0000 7f1adf577640 1 -- 10.20.193.28:0/1241466225 shutdown_connections 2026-02-20T03:18:17.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.816+0000 7f1adf577640 1 -- 10.20.193.28:0/1241466225 wait complete. 2026-02-20T03:18:17.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1adf577640 1 Processor -- start 2026-02-20T03:18:17.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1adf577640 1 -- start start 2026-02-20T03:18:17.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1adf577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0104980 0x7f1ae019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1adf577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ae0105320 0x7f1ae019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1adf577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ae010a980 0x7f1ae01a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1adf577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae0114cd0 con 0x7f1ae0104980 2026-02-20T03:18:17.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1adf577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae0114b50 con 0x7f1ae010a980 2026-02-20T03:18:17.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1adf577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae0114e50 con 0x7f1ae0105320 2026-02-20T03:18:17.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1ade575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0104980 0x7f1ae019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:17.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1ade575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0104980 0x7f1ae019d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35344/0 (socket says 10.20.193.28:35344) 2026-02-20T03:18:17.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1ade575640 1 -- 10.20.193.28:0/3010223796 learned_addr learned my addr 10.20.193.28:0/3010223796 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:17.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1ade575640 1 -- 10.20.193.28:0/3010223796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ae0105320 msgr2=0x7f1ae019d6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:17.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1ade575640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ae0105320 0x7f1ae019d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1ade575640 1 -- 10.20.193.28:0/3010223796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ae010a980 msgr2=0x7f1ae01a1a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:17.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1ade575640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ae010a980 0x7f1ae01a1a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.819+0000 7f1ade575640 1 -- 10.20.193.28:0/3010223796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae01a2200 con 0x7f1ae0104980 2026-02-20T03:18:17.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.821+0000 7f1ade575640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0104980 0x7f1ae019d1b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b570 tx=0x7f1ad400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:17.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.821+0000 7f1ac37fe640 1 -- 10.20.193.28:0/3010223796 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4013020 con 0x7f1ae0104980 2026-02-20T03:18:17.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.821+0000 7f1ac37fe640 1 -- 10.20.193.28:0/3010223796 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1ad4004480 con 0x7f1ae0104980 2026-02-20T03:18:17.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.821+0000 7f1ac37fe640 1 -- 10.20.193.28:0/3010223796 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad400fb50 con 0x7f1ae0104980 2026-02-20T03:18:17.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.821+0000 7f1adf577640 1 -- 10.20.193.28:0/3010223796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae01a24f0 con 0x7f1ae0104980 2026-02-20T03:18:17.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.821+0000 7f1adf577640 1 -- 10.20.193.28:0/3010223796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae01a9d30 con 0x7f1ae0104980 2026-02-20T03:18:17.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ac37fe640 1 -- 10.20.193.28:0/3010223796 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1ad4002780 con 0x7f1ae0104980 2026-02-20T03:18:17.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 Processor -- start 2026-02-20T03:18:17.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- start start 2026-02-20T03:18:17.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea9170 0x55f33fea9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea3860 0x55f33fea3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea4220 0x55f33feaffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f33fdf6410 con 0x55f33fea4220 2026-02-20T03:18:17.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f33fda38b0 con 0x55f33fea9170 2026-02-20T03:18:17.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f33fdf2340 con 0x55f33fea3860 2026-02-20T03:18:17.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1addd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea4220 0x55f33feaffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:17.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1addd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea4220 0x55f33feaffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35348/0 (socket says 10.20.193.28:35348) 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1addd74640 1 -- 10.20.193.28:0/823271998 learned_addr learned my addr 10.20.193.28:0/823271998 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1addd74640 1 -- 10.20.193.28:0/823271998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea3860 msgr2=0x55f33fea3ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1addd74640 1 --2- 10.20.193.28:0/823271998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea3860 0x55f33fea3ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1addd74640 1 -- 10.20.193.28:0/823271998 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea9170 msgr2=0x55f33fea9550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1addd74640 1 --2- 10.20.193.28:0/823271998 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea9170 0x55f33fea9550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1addd74640 1 -- 10.20.193.28:0/823271998 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33fd958c0 con 0x55f33fea4220 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1addd74640 1 --2- 10.20.193.28:0/823271998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea4220 0x55f33feaffc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009840 tx=0x7f1ac8009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7762b4c4050a4f5c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ac0ff9640 1 -- 10.20.193.28:0/823271998 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8016070 con 0x55f33fea4220 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ac0ff9640 1 -- 10.20.193.28:0/823271998 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1ac8004480 con 0x55f33fea4220 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ac0ff9640 1 -- 10.20.193.28:0/823271998 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800bca0 con 0x55f33fea4220 2026-02-20T03:18:17.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ac37fe640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ab80b0e20 0x7f1ab80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- 10.20.193.28:0/823271998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea4220 msgr2=0x55f33feaffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/823271998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea4220 0x55f33feaffc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009840 tx=0x7f1ac8009d10 comp rx=0 tx=0).stop 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ac37fe640 1 -- 10.20.193.28:0/3010223796 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1ad40e0590 con 0x7f1ae0104980 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- 10.20.193.28:0/823271998 shutdown_connections 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/823271998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea4220 0x55f33feaffc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/823271998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea3860 0x55f33fea3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/823271998 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea9170 0x55f33fea9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- 10.20.193.28:0/823271998 >> 10.20.193.28:0/823271998 conn(0x55f33fe9c3c0 msgr2=0x55f33fea1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1aded76640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ab80b0e20 0x7f1ab80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:17.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- 10.20.193.28:0/823271998 shutdown_connections 2026-02-20T03:18:17.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- 10.20.193.28:0/823271998 wait complete. 2026-02-20T03:18:17.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1aded76640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ab80b0e20 0x7f1ab80b32e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000b0d0 tx=0x7f1ad000b020 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:17.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- start start 2026-02-20T03:18:17.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 Processor -- start 2026-02-20T03:18:17.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea3860 0x55f33febe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 0x55f33febebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea9170 0x55f33febcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f33fd9d4a0 con 0x55f33fea9170 2026-02-20T03:18:17.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f33feb06c0 con 0x55f33fea4220 2026-02-20T03:18:17.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f33febd360 con 0x55f33fea3860 2026-02-20T03:18:17.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1aded76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea9170 0x55f33febcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:17.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1aded76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea9170 0x55f33febcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35356/0 (socket says 10.20.193.28:35356) 2026-02-20T03:18:17.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.823+0000 7f1aded76640 1 -- 10.20.193.28:0/1079090892 learned_addr learned my addr 10.20.193.28:0/1079090892 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:17.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1aded76640 1 -- 10.20.193.28:0/1079090892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea3860 msgr2=0x55f33febe690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:17.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1aded76640 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea3860 0x55f33febe690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1aded76640 1 -- 10.20.193.28:0/1079090892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 msgr2=0x55f33febebd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:17.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1aded76640 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 0x55f33febebd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1aded76640 1 -- 10.20.193.28:0/1079090892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33feb6050 con 0x55f33fea9170 2026-02-20T03:18:17.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1aded76640 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea9170 0x55f33febcdd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009320 tx=0x7f1ad00099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4cefdfccfdb7e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:17.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1a8ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:17.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1a8ffff640 1 -- 10.20.193.28:0/1079090892 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0009420 con 0x55f33fea9170 2026-02-20T03:18:17.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 1 -- 10.20.193.28:0/1079090892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f33fb5a8a0 con 0x55f33fea9170 2026-02-20T03:18:17.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 10 client.16089 _ll_register_callbacks cb 0x55f33fda13d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:17.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 1 -- 10.20.193.28:0/1079090892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f33fdfe000 con 0x55f33fea9170 2026-02-20T03:18:17.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1a8ffff640 1 -- 10.20.193.28:0/1079090892 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55f33fdfe000 con 0x55f33fea9170 2026-02-20T03:18:17.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1a8ffff640 1 -- 10.20.193.28:0/1079090892 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad004bb90 con 0x55f33fea9170 2026-02-20T03:18:17.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1a8ffff640 1 -- 10.20.193.28:0/1079090892 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1ad004bd30 con 0x55f33fea9170 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1a8ffff640 1 -- 10.20.193.28:0/1079090892 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1ad0038420 con 0x55f33fea9170 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 10 client.16089 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 1 -- 10.20.193.28:0/1079090892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55f33fbc60e0 con 0x55f33fea9170 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1a8ffff640 1 -- 10.20.193.28:0/1079090892 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f1ad0053030 con 0x55f33fea9170 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 10 client.16089 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 10 client.16089 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 20 client.16089 populate_metadata read hostname 'trial028' 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f33feccc30 0x55f33fecf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 4 client.16089 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:17.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.828+0000 7f1ae7096e00 1 -- 10.20.193.28:0/1079090892 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f33fd77f60 con 0x55f33feccc30 2026-02-20T03:18:17.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.850+0000 7f1ade575640 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f33feccc30 0x55f33fecf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:17.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ade575640 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f33feccc30 0x55f33fecf0f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7884ffb5654d8ed5 server_cookie=c05e541f605383c5 in_seq=0 out_seq=0 2026-02-20T03:18:17.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1a8ffff640 10 client.16089 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:17.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1a8ffff640 1 -- 10.20.193.28:0/1079090892 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f33fd77f60 con 0x55f33feccc30 2026-02-20T03:18:17.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1a8ffff640 10 client.16089 handle_command_reply: tid=0 2026-02-20T03:18:17.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 client.16089 shutdown 2026-02-20T03:18:17.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 -- 10.20.193.28:0/1079090892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea9170 msgr2=0x55f33febcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:17.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea9170 0x55f33febcdd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0009320 tx=0x7f1ad00099e0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 -- 10.20.193.28:0/1079090892 shutdown_connections 2026-02-20T03:18:17.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f33feccc30 0x55f33fecf0f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea9170 0x55f33febcdd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 0x55f33febebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/1079090892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea3860 0x55f33febe690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 -- 10.20.193.28:0/1079090892 >> 10.20.193.28:0/1079090892 conn(0x55f33fe9c3c0 msgr2=0x55f33fea2670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:17.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1a8ffff640 0 client.16089 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:17.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 -- 10.20.193.28:0/1079090892 shutdown_connections 2026-02-20T03:18:17.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.890+0000 7f1ae7096e00 1 -- 10.20.193.28:0/1079090892 wait complete. 2026-02-20T03:18:17.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.891+0000 7f1ae7096e00 20 client.16089 trim_cache size 0 max 16384 2026-02-20T03:18:17.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 Processor -- start 2026-02-20T03:18:17.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- start start 2026-02-20T03:18:17.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33febbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 0x55f33feba100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea9170 0x55f33feba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1a84012740 con 0x55f33fea3860 2026-02-20T03:18:17.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8400ffb0 con 0x55f33fea4220 2026-02-20T03:18:17.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8400de00 con 0x55f33fea9170 2026-02-20T03:18:17.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33febbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:17.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33febbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35362/0 (socket says 10.20.193.28:35362) 2026-02-20T03:18:17.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 -- 10.20.193.28:0/3947393950 learned_addr learned my addr 10.20.193.28:0/3947393950 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:17.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 -- 10.20.193.28:0/3947393950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea9170 msgr2=0x55f33feba640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:17.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 --2- 10.20.193.28:0/3947393950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea9170 0x55f33feba640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 -- 10.20.193.28:0/3947393950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 msgr2=0x55f33feba100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:17.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 --2- 10.20.193.28:0/3947393950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 0x55f33feba100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 -- 10.20.193.28:0/3947393950 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33feb5e80 con 0x55f33fea3860 2026-02-20T03:18:17.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 --2- 10.20.193.28:0/3947393950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33febbd00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40a8200 tx=0x7f1ad40ddad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625e03e80b2e8635 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:17.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1aaa4e6640 1 -- 10.20.193.28:0/3947393950 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4002aa0 con 0x55f33fea3860 2026-02-20T03:18:17.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1aaa4e6640 1 -- 10.20.193.28:0/3947393950 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1ad40ddd10 con 0x55f33fea3860 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1aaa4e6640 1 -- 10.20.193.28:0/3947393950 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40b1040 con 0x55f33fea3860 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- 10.20.193.28:0/3947393950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 msgr2=0x55f33febbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/3947393950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33febbd00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40a8200 tx=0x7f1ad40ddad0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- 10.20.193.28:0/3947393950 shutdown_connections 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/3947393950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea9170 0x55f33feba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/3947393950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 0x55f33feba100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/3947393950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33febbd00 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- 10.20.193.28:0/3947393950 >> 10.20.193.28:0/3947393950 conn(0x55f33fe9c3c0 msgr2=0x55f33febb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- 10.20.193.28:0/3947393950 shutdown_connections 2026-02-20T03:18:17.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- 10.20.193.28:0/3947393950 wait complete. 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- start start 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 Processor -- start 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33fec5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 0x55f33fec6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea9170 0x55f33ff405f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8400e470 con 0x55f33fea3860 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8400f8e0 con 0x55f33fea4220 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ae7096e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8400eb40 con 0x55f33fea9170 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33fec5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:17.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33fec5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35364/0 (socket says 10.20.193.28:35364) 2026-02-20T03:18:17.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 -- 10.20.193.28:0/2406703672 learned_addr learned my addr 10.20.193.28:0/2406703672 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:17.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 -- 10.20.193.28:0/2406703672 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea9170 msgr2=0x55f33ff405f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:17.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea9170 0x55f33ff405f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 -- 10.20.193.28:0/2406703672 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 msgr2=0x55f33fec6250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:17.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 0x55f33fec6250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:17.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.900+0000 7f1ade575640 1 -- 10.20.193.28:0/2406703672 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33feb5a40 con 0x55f33fea3860 2026-02-20T03:18:17.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ade575640 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33fec5d10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40a7900 tx=0x7f1ad40a4610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd195920a22c6a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:17.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1a8ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:17.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1a8ffff640 1 -- 10.20.193.28:0/2406703672 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40c1030 con 0x55f33fea3860 2026-02-20T03:18:17.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1a8ffff640 1 -- 10.20.193.28:0/2406703672 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1ad4002e00 con 0x55f33fea3860 2026-02-20T03:18:17.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 1 -- 10.20.193.28:0/2406703672 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f33fb777f0 con 0x55f33fea3860 2026-02-20T03:18:17.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1a8ffff640 1 -- 10.20.193.28:0/2406703672 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad40ac330 con 0x55f33fea3860 2026-02-20T03:18:17.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1a8ffff640 1 -- 10.20.193.28:0/2406703672 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1ad40a3990 con 0x55f33fea3860 2026-02-20T03:18:17.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 10 client.16095 _ll_register_callbacks cb 0x7f1ad0009230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:17.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 1 -- 10.20.193.28:0/2406703672 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f33feafbe0 con 0x55f33fea3860 2026-02-20T03:18:17.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1a8ffff640 1 -- 10.20.193.28:0/2406703672 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1ad40b1040 con 0x55f33fea3860 2026-02-20T03:18:17.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 10 client.16095 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:17.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 1 -- 10.20.193.28:0/2406703672 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55f33feb6b70 con 0x55f33fea3860 2026-02-20T03:18:17.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1a8ffff640 1 -- 10.20.193.28:0/2406703672 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f1ad40a3b90 con 0x55f33fea3860 2026-02-20T03:18:17.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 10 client.16095 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:17.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 10 client.16095 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:18:17.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 20 client.16095 populate_metadata read hostname 'trial028' 2026-02-20T03:18:17.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f33ff41f10 0x55f33ff443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:17.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 4 client.16095 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.3, "await_for": 45.0}] 2026-02-20T03:18:17.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.904+0000 7f1ae7096e00 1 -- 10.20.193.28:0/2406703672 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.3, "await_for": 45.0}) -- 0x55f33fe03db0 con 0x55f33ff41f10 2026-02-20T03:18:17.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.931+0000 7f1addd74640 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f33ff41f10 0x55f33ff443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:18.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.998+0000 7f1addd74640 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f33ff41f10 0x55f33ff443d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=483b722b4c9c521e server_cookie=e7944c3a53e37671 in_seq=0 out_seq=0 2026-02-20T03:18:18.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:17.998+0000 7f1a8ffff640 10 client.16095 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:18.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 301659 14.82 MB/sec warmup 111 sec latency 1658.126 ms 2026-02-20T03:18:19.452 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:19 trial028 ceph-mon[38552]: pgmap v290: 129 pgs: 129 active+clean; 74 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 440 op/s 2026-02-20T03:18:19.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 14.69 MB/sec warmup 112 sec latency 2099.443 ms 2026-02-20T03:18:19.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:19 trial126 ceph-mon[38476]: pgmap v290: 129 pgs: 129 active+clean; 74 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 440 op/s 2026-02-20T03:18:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:19 trial177 ceph-mon[43181]: pgmap v290: 129 pgs: 129 active+clean; 74 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 440 op/s 2026-02-20T03:18:20.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 14.56 MB/sec warmup 113 sec latency 1558.760 ms 2026-02-20T03:18:21.365 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:21 trial028 ceph-mon[38552]: pgmap v291: 129 pgs: 129 active+clean; 77 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 471 op/s 2026-02-20T03:18:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1a8ffff640 1 -- 10.20.193.28:0/2406703672 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f33fe03db0 con 0x55f33ff41f10 2026-02-20T03:18:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1a8ffff640 10 client.16095 handle_command_reply: tid=0 2026-02-20T03:18:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 client.16095 shutdown 2026-02-20T03:18:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 -- 10.20.193.28:0/2406703672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 msgr2=0x55f33fec5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33fec5d10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1ad40a7900 tx=0x7f1ad40a4610 comp rx=0 tx=0).stop 2026-02-20T03:18:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 -- 10.20.193.28:0/2406703672 shutdown_connections 2026-02-20T03:18:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f33ff41f10 0x55f33ff443d0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f33fea9170 0x55f33ff405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f33fea4220 0x55f33fec6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 --2- 10.20.193.28:0/2406703672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f33fea3860 0x55f33fec5d10 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 -- 10.20.193.28:0/2406703672 >> 10.20.193.28:0/2406703672 conn(0x55f33fe9c3c0 msgr2=0x55f33febbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1a8ffff640 0 client.16095 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.489+0000 7f1ae7096e00 1 -- 10.20.193.28:0/2406703672 shutdown_connections 2026-02-20T03:18:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1ae7096e00 1 -- 10.20.193.28:0/2406703672 wait complete. 2026-02-20T03:18:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1ae7096e00 20 client.16095 trim_cache size 0 max 16384 2026-02-20T03:18:21.494 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:18:21.495 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 26, 2026-02-20T03:18:21.495 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:18:21.495 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 10, 2026-02-20T03:18:21.495 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:18:21.495 INFO:teuthology.orchestra.run.trial028.stdout: "8846346f": { 2026-02-20T03:18:21.495 INFO:teuthology.orchestra.run.trial028.stdout: "version": 10, 2026-02-20T03:18:21.495 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:18:21.495 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:18:21.495 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 137.3, 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:21.496 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:21.497 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:21.497 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:21.497 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:21.497 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:18:21.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 -- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ab80b0e20 msgr2=0x7f1ab80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:21.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ab80b0e20 0x7f1ab80b32e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1ad000b0d0 tx=0x7f1ad000b020 comp rx=0 tx=0).stop 2026-02-20T03:18:21.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 -- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0104980 msgr2=0x7f1ae019d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:21.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0104980 0x7f1ae019d1b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b570 tx=0x7f1ad400ba40 comp rx=0 tx=0).stop 2026-02-20T03:18:21.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 -- 10.20.193.28:0/3010223796 shutdown_connections 2026-02-20T03:18:21.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ab80b0e20 0x7f1ab80b32e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:21.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1ae010a980 0x7f1ae01a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:21.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1ae0105320 0x7f1ae019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:21.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 --2- 10.20.193.28:0/3010223796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1ae0104980 0x7f1ae019d1b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:21.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.490+0000 7f1adf577640 1 -- 10.20.193.28:0/3010223796 >> 10.20.193.28:0/3010223796 conn(0x7f1ae0100680 msgr2=0x7f1ae0100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:21.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.491+0000 7f1adf577640 1 -- 10.20.193.28:0/3010223796 shutdown_connections 2026-02-20T03:18:21.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:21.491+0000 7f1adf577640 1 -- 10.20.193.28:0/3010223796 wait complete. 2026-02-20T03:18:21.500 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 14.43 MB/sec warmup 114 sec latency 2558.795 ms 2026-02-20T03:18:21.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:21 trial126 ceph-mon[38476]: pgmap v291: 129 pgs: 129 active+clean; 77 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 471 op/s 2026-02-20T03:18:21.630 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8846346f', quiesce took 5.2 seconds. Will release after: 12.100000000000001 2026-02-20T03:18:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:21 trial177 ceph-mon[43181]: pgmap v291: 129 pgs: 129 active+clean; 77 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 471 op/s 2026-02-20T03:18:22.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 14.30 MB/sec warmup 115 sec latency 3558.836 ms 2026-02-20T03:18:23.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:23 trial028 ceph-mon[38552]: pgmap v292: 129 pgs: 129 active+clean; 83 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 379 op/s 2026-02-20T03:18:23.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 14.18 MB/sec warmup 116 sec latency 4558.877 ms 2026-02-20T03:18:23.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:23 trial126 ceph-mon[38476]: pgmap v292: 129 pgs: 129 active+clean; 83 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 379 op/s 2026-02-20T03:18:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:23 trial177 ceph-mon[43181]: pgmap v292: 129 pgs: 129 active+clean; 83 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 379 op/s 2026-02-20T03:18:24.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 14.06 MB/sec warmup 117 sec latency 5558.919 ms 2026-02-20T03:18:25.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 13.94 MB/sec warmup 118 sec latency 6558.961 ms 2026-02-20T03:18:25.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:25 trial028 ceph-mon[38552]: pgmap v293: 129 pgs: 129 active+clean; 81 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 385 op/s 2026-02-20T03:18:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:25 trial126 ceph-mon[38476]: pgmap v293: 129 pgs: 129 active+clean; 81 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 385 op/s 2026-02-20T03:18:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:25 trial177 ceph-mon[43181]: pgmap v293: 129 pgs: 129 active+clean; 81 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 385 op/s 2026-02-20T03:18:26.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 13.82 MB/sec warmup 119 sec latency 7558.996 ms 2026-02-20T03:18:27.481 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:27 trial028 ceph-mon[38552]: pgmap v294: 129 pgs: 129 active+clean; 74 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 944 KiB/s rd, 3.8 MiB/s wr, 365 op/s 2026-02-20T03:18:27.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:27 trial126 ceph-mon[38476]: pgmap v294: 129 pgs: 129 active+clean; 74 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 944 KiB/s rd, 3.8 MiB/s wr, 365 op/s 2026-02-20T03:18:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:27 trial177 ceph-mon[43181]: pgmap v294: 129 pgs: 129 active+clean; 74 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 944 KiB/s rd, 3.8 MiB/s wr, 365 op/s 2026-02-20T03:18:28.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 0.00 MB/sec execute 1 sec latency 9559.066 ms 2026-02-20T03:18:29.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- 10.20.193.28:0/1194583663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc06b710 msgr2=0x7f2ebc1076f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:29.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 --2- 10.20.193.28:0/1194583663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc06b710 0x7f2ebc1076f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009a30 tx=0x7f2ea802f260 comp rx=0 tx=0).stop 2026-02-20T03:18:29.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- 10.20.193.28:0/1194583663 shutdown_connections 2026-02-20T03:18:29.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 --2- 10.20.193.28:0/1194583663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ebc10a5b0 0x7f2ebc10ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 --2- 10.20.193.28:0/1194583663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ebc107c30 0x7f2ebc10a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 --2- 10.20.193.28:0/1194583663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc06b710 0x7f2ebc1076f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- 10.20.193.28:0/1194583663 >> 10.20.193.28:0/1194583663 conn(0x7f2ebc0fccc0 msgr2=0x7f2ebc0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- 10.20.193.28:0/1194583663 shutdown_connections 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- 10.20.193.28:0/1194583663 wait complete. 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 Processor -- start 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- start start 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ebc06b710 0x7f2ebc19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ebc107c30 0x7f2ebc19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc10a5b0 0x7f2ebc1a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc110540 con 0x7f2ebc10a5b0 2026-02-20T03:18:29.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc1103c0 con 0x7f2ebc06b710 2026-02-20T03:18:29.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ebc1106c0 con 0x7f2ebc107c30 2026-02-20T03:18:29.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ebbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc10a5b0 0x7f2ebc1a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:29.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ebbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc10a5b0 0x7f2ebc1a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38750/0 (socket says 10.20.193.28:38750) 2026-02-20T03:18:29.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ebbfff640 1 -- 10.20.193.28:0/2798827046 learned_addr learned my addr 10.20.193.28:0/2798827046 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:29.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ebbfff640 1 -- 10.20.193.28:0/2798827046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ebc107c30 msgr2=0x7f2ebc19d0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:29.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ebbfff640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ebc107c30 0x7f2ebc19d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ebbfff640 1 -- 10.20.193.28:0/2798827046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ebc06b710 msgr2=0x7f2ebc19cb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:29.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ebbfff640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ebc06b710 0x7f2ebc19cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ebbfff640 1 -- 10.20.193.28:0/2798827046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ebc1a4840 con 0x7f2ebc10a5b0 2026-02-20T03:18:29.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ebbfff640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc10a5b0 0x7f2ebc1a4140 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000b990 tx=0x7f2eb000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:29.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2eb8ff9640 1 -- 10.20.193.28:0/2798827046 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0006e60 con 0x7f2ebc10a5b0 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2eb8ff9640 1 -- 10.20.193.28:0/2798827046 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2eb0010070 con 0x7f2ebc10a5b0 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- 10.20.193.28:0/2798827046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ebc1a4b30 con 0x7f2ebc10a5b0 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2eb8ff9640 1 -- 10.20.193.28:0/2798827046 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0004800 con 0x7f2ebc10a5b0 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.012+0000 7f2ec0806640 1 -- 10.20.193.28:0/2798827046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ebc1a50d0 con 0x7f2ebc10a5b0 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.018+0000 7f2ec49cae00 1 Processor -- start 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2eb8ff9640 1 -- 10.20.193.28:0/2798827046 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2eb001d030 con 0x7f2ebc10a5b0 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- start start 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f34e80 0x564dd1f35280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f357c0 0x564dd1f39f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f3a560 0x564dd1f3c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564dd1e858f0 con 0x564dd1f3a560 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564dd1e332e0 con 0x564dd1f357c0 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564dd1e81820 con 0x564dd1f34e80 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f3a560 0x564dd1f3c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f3a560 0x564dd1f3c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38758/0 (socket says 10.20.193.28:38758) 2026-02-20T03:18:29.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebaffd640 1 -- 10.20.193.28:0/3406904428 learned_addr learned my addr 10.20.193.28:0/3406904428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebaffd640 1 -- 10.20.193.28:0/3406904428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f34e80 msgr2=0x564dd1f35280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebaffd640 1 --2- 10.20.193.28:0/3406904428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f34e80 0x564dd1f35280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebaffd640 1 -- 10.20.193.28:0/3406904428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f357c0 msgr2=0x564dd1f39f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebaffd640 1 --2- 10.20.193.28:0/3406904428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f357c0 0x564dd1f39f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebaffd640 1 -- 10.20.193.28:0/3406904428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd1e255a0 con 0x564dd1f3a560 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebaffd640 1 --2- 10.20.193.28:0/3406904428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f3a560 0x564dd1f3c9f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098a0 tx=0x7f2eac009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5050f8feaa446d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2e877fe640 1 -- 10.20.193.28:0/3406904428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac016070 con 0x564dd1f3a560 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2e877fe640 1 -- 10.20.193.28:0/3406904428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2eac002870 con 0x564dd1f3a560 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2e877fe640 1 -- 10.20.193.28:0/3406904428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac004670 con 0x564dd1f3a560 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2eb8ff9640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e900b0e20 0x7f2e900b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3406904428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f3a560 msgr2=0x564dd1f3c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/3406904428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f3a560 0x564dd1f3c9f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098a0 tx=0x7f2eac009d70 comp rx=0 tx=0).stop 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3406904428 shutdown_connections 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/3406904428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f3a560 0x564dd1f3c9f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/3406904428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f357c0 0x564dd1f39f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/3406904428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f34e80 0x564dd1f35280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3406904428 >> 10.20.193.28:0/3406904428 conn(0x564dd1f2c6f0 msgr2=0x564dd1f33570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2eb8ff9640 1 -- 10.20.193.28:0/2798827046 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2eb00dfff0 con 0x7f2ebc10a5b0 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3406904428 shutdown_connections 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e900b0e20 0x7f2e900b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:29.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3406904428 wait complete. 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e900b0e20 0x7f2e900b32e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009950 tx=0x7f2ea80023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- start start 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 Processor -- start 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f357c0 0x564dd1f4dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f3a560 0x564dd1f54f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564dd1e2d0c0 con 0x564dd1f34e80 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564dd1f3d610 con 0x564dd1f3a560 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564dd1f554d0 con 0x564dd1f357c0 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38766/0 (socket says 10.20.193.28:38766) 2026-02-20T03:18:29.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 -- 10.20.193.28:0/1803112591 learned_addr learned my addr 10.20.193.28:0/1803112591 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 -- 10.20.193.28:0/1803112591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f357c0 msgr2=0x564dd1f4dfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f357c0 0x564dd1f4dfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 -- 10.20.193.28:0/1803112591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f3a560 msgr2=0x564dd1f54f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f3a560 0x564dd1f54f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 -- 10.20.193.28:0/1803112591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd1f471d0 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4da80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8002fd0 tx=0x7f2ea802f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419856726a469cd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.019+0000 7f2e84ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2e84ff9640 1 -- 10.20.193.28:0/1803112591 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80045a0 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2e84ff9640 1 -- 10.20.193.28:0/1803112591 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2ea8033040 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2e84ff9640 1 -- 10.20.193.28:0/1803112591 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80459a0 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 1 -- 10.20.193.28:0/1803112591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd1e41820 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 10 client.16107 _ll_register_callbacks cb 0x564dd1e30ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 1 -- 10.20.193.28:0/1803112591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564dd1e8d4e0 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2e84ff9640 1 -- 10.20.193.28:0/1803112591 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2ea8045b40 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2e84ff9640 1 -- 10.20.193.28:0/1803112591 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2ea8045e00 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 10 client.16107 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 1 -- 10.20.193.28:0/1803112591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x564dd1e46380 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2e84ff9640 1 -- 10.20.193.28:0/1803112591 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f2ea804d070 con 0x564dd1f34e80 2026-02-20T03:18:29.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 10 client.16107 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:29.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:29.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 20 client.16107 populate_metadata read hostname 'trial028' 2026-02-20T03:18:29.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564dd1f599a0 0x564dd1f5be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 4 client.16107 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:29.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.025+0000 7f2ec49cae00 1 -- 10.20.193.28:0/1803112591 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dd1e07bd0 con 0x564dd1f599a0 2026-02-20T03:18:29.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.046+0000 7f2ebaffd640 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564dd1f599a0 0x564dd1f5be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:29.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.112+0000 7f2ebaffd640 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564dd1f599a0 0x564dd1f5be40 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8c84104432a9179 server_cookie=f04f53ba0eca2a66 in_seq=0 out_seq=0 2026-02-20T03:18:29.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.112+0000 7f2e84ff9640 10 client.16107 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.138+0000 7f2e84ff9640 1 -- 10.20.193.28:0/1803112591 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x564dd1e07bd0 con 0x564dd1f599a0 2026-02-20T03:18:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.138+0000 7f2e84ff9640 10 client.16107 handle_command_reply: tid=0 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 client.16107 shutdown 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 -- 10.20.193.28:0/1803112591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 msgr2=0x564dd1f4da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4da80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8002fd0 tx=0x7f2ea802f260 comp rx=0 tx=0).stop 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 -- 10.20.193.28:0/1803112591 shutdown_connections 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564dd1f599a0 0x564dd1f5be40 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f3a560 0x564dd1f54f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f357c0 0x564dd1f4dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/1803112591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4da80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 -- 10.20.193.28:0/1803112591 >> 10.20.193.28:0/1803112591 conn(0x564dd1f2c6f0 msgr2=0x564dd1f3b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2e84ff9640 0 client.16107 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 -- 10.20.193.28:0/1803112591 shutdown_connections 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 1 -- 10.20.193.28:0/1803112591 wait complete. 2026-02-20T03:18:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.139+0000 7f2ec49cae00 20 client.16107 trim_cache size 0 max 16384 2026-02-20T03:18:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ec49cae00 1 Processor -- start 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ec49cae00 1 -- start start 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f357c0 0x564dd1f54f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f3a560 0x564dd1f364a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2e60012750 con 0x564dd1f34e80 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6000ffc0 con 0x564dd1f357c0 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6000de10 con 0x564dd1f3a560 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ebb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ebb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38768/0 (socket says 10.20.193.28:38768) 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.146+0000 7f2ebb7fe640 1 -- 10.20.193.28:0/3790878859 learned_addr learned my addr 10.20.193.28:0/3790878859 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebb7fe640 1 -- 10.20.193.28:0/3790878859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f3a560 msgr2=0x564dd1f364a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/3790878859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f3a560 0x564dd1f364a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebb7fe640 1 -- 10.20.193.28:0/3790878859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f357c0 msgr2=0x564dd1f54f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/3790878859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f357c0 0x564dd1f54f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebb7fe640 1 -- 10.20.193.28:0/3790878859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd1f47000 con 0x564dd1f34e80 2026-02-20T03:18:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/3790878859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4b2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8045dd0 tx=0x7f2ea8053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7b94d684e37861 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e86ffd640 1 -- 10.20.193.28:0/3790878859 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8038790 con 0x564dd1f34e80 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e86ffd640 1 -- 10.20.193.28:0/3790878859 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x564dd1e8d4e0 con 0x564dd1f34e80 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e86ffd640 1 -- 10.20.193.28:0/3790878859 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8045a90 con 0x564dd1f34e80 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3790878859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 msgr2=0x564dd1f4b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/3790878859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4b2f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8045dd0 tx=0x7f2ea8053000 comp rx=0 tx=0).stop 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3790878859 shutdown_connections 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/3790878859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f3a560 0x564dd1f364a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/3790878859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f357c0 0x564dd1f54f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/3790878859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f34e80 0x564dd1f4b2f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3790878859 >> 10.20.193.28:0/3790878859 conn(0x564dd1f2c6f0 msgr2=0x564dd1f35d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3790878859 shutdown_connections 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- 10.20.193.28:0/3790878859 wait complete. 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- start start 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 Processor -- start 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f34e80 0x564dd1f54890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f357c0 0x564dd1f54dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f3a560 0x564dd1f514d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6000e480 con 0x564dd1f357c0 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6000f8f0 con 0x564dd1f3a560 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6000eb50 con 0x564dd1f34e80 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f357c0 0x564dd1f54dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f357c0 0x564dd1f54dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38784/0 (socket says 10.20.193.28:38784) 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebaffd640 1 -- 10.20.193.28:0/2889173814 learned_addr learned my addr 10.20.193.28:0/2889173814 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebaffd640 1 -- 10.20.193.28:0/2889173814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f34e80 msgr2=0x564dd1f54890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:29.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebaffd640 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f34e80 0x564dd1f54890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebaffd640 1 -- 10.20.193.28:0/2889173814 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f3a560 msgr2=0x564dd1f514d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebaffd640 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f3a560 0x564dd1f514d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebaffd640 1 -- 10.20.193.28:0/2889173814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dd1be5690 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ebaffd640 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f357c0 0x564dd1f54dd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2eac002410 tx=0x7f2eac0042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6422221ae9531a1d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e84ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e84ff9640 1 -- 10.20.193.28:0/2889173814 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac016040 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e84ff9640 1 -- 10.20.193.28:0/2889173814 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2eac0047b0 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- 10.20.193.28:0/2889173814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dd1e4ab70 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e84ff9640 1 -- 10.20.193.28:0/2889173814 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac01d6e0 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 10 client.16113 _ll_register_callbacks cb 0x7f2ea8005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- 10.20.193.28:0/2889173814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2eac002870 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e84ff9640 1 -- 10.20.193.28:0/2889173814 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2eac01d880 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e84ff9640 1 -- 10.20.193.28:0/2889173814 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2eac01db60 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 10 client.16113 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- 10.20.193.28:0/2889173814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x564dd1f47cf0 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2e84ff9640 1 -- 10.20.193.28:0/2889173814 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f2eac02b070 con 0x564dd1f357c0 2026-02-20T03:18:29.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 10 client.16113 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:29.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:29.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 20 client.16113 populate_metadata read hostname 'trial028' 2026-02-20T03:18:29.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564dd1fc5980 0x564dd1fc7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:29.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 4 client.16113 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:18:29.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.147+0000 7f2ec49cae00 1 -- 10.20.193.28:0/2889173814 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564dd1e566b0 con 0x564dd1fc5980 2026-02-20T03:18:29.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.165+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564dd1fc5980 0x564dd1fc7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:29.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.232+0000 7f2ebb7fe640 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564dd1fc5980 0x564dd1fc7e40 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e81a534893cdd3 server_cookie=62fb7c0d4d2e3088 in_seq=0 out_seq=0 2026-02-20T03:18:29.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.232+0000 7f2e84ff9640 10 client.16113 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:29.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2e84ff9640 1 -- 10.20.193.28:0/2889173814 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564dd1e566b0 con 0x564dd1fc5980 2026-02-20T03:18:29.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2e84ff9640 10 client.16113 handle_command_reply: tid=0 2026-02-20T03:18:29.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 client.16113 shutdown 2026-02-20T03:18:29.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 -- 10.20.193.28:0/2889173814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f357c0 msgr2=0x564dd1f54dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:29.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f357c0 0x564dd1f54dd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2eac002410 tx=0x7f2eac0042b0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 -- 10.20.193.28:0/2889173814 shutdown_connections 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564dd1fc5980 0x564dd1fc7e40 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564dd1f3a560 0x564dd1f514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564dd1f357c0 0x564dd1f54dd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 --2- 10.20.193.28:0/2889173814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564dd1f34e80 0x564dd1f54890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 -- 10.20.193.28:0/2889173814 >> 10.20.193.28:0/2889173814 conn(0x564dd1f2c6f0 msgr2=0x564dd1f365b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2e84ff9640 0 client.16113 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 -- 10.20.193.28:0/2889173814 shutdown_connections 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 1 -- 10.20.193.28:0/2889173814 wait complete. 2026-02-20T03:18:29.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.290+0000 7f2ec49cae00 20 client.16113 trim_cache size 0 max 16384 2026-02-20T03:18:29.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:18:29.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:18:29.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:18:29.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:18:29.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 -- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e900b0e20 msgr2=0x7f2e900b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:29.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e900b0e20 0x7f2e900b32e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009950 tx=0x7f2ea80023d0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 -- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc10a5b0 msgr2=0x7f2ebc1a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc10a5b0 0x7f2ebc1a4140 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000b990 tx=0x7f2eb000be60 comp rx=0 tx=0).stop 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 -- 10.20.193.28:0/2798827046 shutdown_connections 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e900b0e20 0x7f2e900b32e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ebc10a5b0 0x7f2ebc1a4140 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ebc107c30 0x7f2ebc19d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 --2- 10.20.193.28:0/2798827046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ebc06b710 0x7f2ebc19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 -- 10.20.193.28:0/2798827046 >> 10.20.193.28:0/2798827046 conn(0x7f2ebc0fccc0 msgr2=0x7f2ebc108570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 -- 10.20.193.28:0/2798827046 shutdown_connections 2026-02-20T03:18:29.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:29.291+0000 7f2ec0806640 1 -- 10.20.193.28:0/2798827046 wait complete. 2026-02-20T03:18:29.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 0.00 MB/sec execute 2 sec latency 10559.117 ms 2026-02-20T03:18:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:29 trial028 ceph-mon[38552]: pgmap v295: 129 pgs: 129 active+clean; 71 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 604 KiB/s rd, 3.3 MiB/s wr, 321 op/s 2026-02-20T03:18:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:29 trial177 ceph-mon[43181]: pgmap v295: 129 pgs: 129 active+clean; 71 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 604 KiB/s rd, 3.3 MiB/s wr, 321 op/s 2026-02-20T03:18:29.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:29 trial126 ceph-mon[38476]: pgmap v295: 129 pgs: 129 active+clean; 71 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 604 KiB/s rd, 3.3 MiB/s wr, 321 op/s 2026-02-20T03:18:30.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 0.00 MB/sec execute 3 sec latency 11559.153 ms 2026-02-20T03:18:31.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 0.00 MB/sec execute 4 sec latency 12559.189 ms 2026-02-20T03:18:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:31 trial028 ceph-mon[38552]: pgmap v296: 129 pgs: 129 active+clean; 69 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 465 KiB/s rd, 3.6 MiB/s wr, 273 op/s 2026-02-20T03:18:31.612 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:18:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:31 trial177 ceph-mon[43181]: pgmap v296: 129 pgs: 129 active+clean; 69 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 465 KiB/s rd, 3.6 MiB/s wr, 273 op/s 2026-02-20T03:18:31.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:31 trial126 ceph-mon[38476]: pgmap v296: 129 pgs: 129 active+clean; 69 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 465 KiB/s rd, 3.6 MiB/s wr, 273 op/s 2026-02-20T03:18:31.878 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:32.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 -- 10.20.193.28:0/1131498502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc124106a80 msgr2=0x7fc124106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/1131498502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc124106a80 0x7fc124106f30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc12000b0a0 tx=0x7fc12002f4a0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 -- 10.20.193.28:0/1131498502 shutdown_connections 2026-02-20T03:18:32.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/1131498502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc124106a80 0x7fc124106f30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/1131498502 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc124101f90 0x7fc124106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/1131498502 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc124101670 0x7fc124101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 -- 10.20.193.28:0/1131498502 >> 10.20.193.28:0/1131498502 conn(0x7fc1240fd2e0 msgr2=0x7fc1240ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:32.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 -- 10.20.193.28:0/1131498502 shutdown_connections 2026-02-20T03:18:32.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 -- 10.20.193.28:0/1131498502 wait complete. 2026-02-20T03:18:32.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.072+0000 7fc12b2f1640 1 Processor -- start 2026-02-20T03:18:32.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12b2f1640 1 -- start start 2026-02-20T03:18:32.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12b2f1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc124101670 0x7fc1241a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12b2f1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc124101f90 0x7fc1241a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12b2f1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc124106a80 0x7fc1241a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12b2f1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc1241190d0 con 0x7fc124106a80 2026-02-20T03:18:32.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12b2f1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc124118f50 con 0x7fc124101f90 2026-02-20T03:18:32.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12b2f1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc124119250 con 0x7fc124101670 2026-02-20T03:18:32.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12a2ef640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc124101670 0x7fc1241a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12a2ef640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc124101670 0x7fc1241a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47832/0 (socket says 10.20.193.28:47832) 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12a2ef640 1 -- 10.20.193.28:0/3411133769 learned_addr learned my addr 10.20.193.28:0/3411133769 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc129aee640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc124101f90 0x7fc1241a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12aaf0640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc124106a80 0x7fc1241a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12a2ef640 1 -- 10.20.193.28:0/3411133769 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc124101f90 msgr2=0x7fc1241a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.073+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc124101f90 0x7fc1241a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.074+0000 7fc12a2ef640 1 -- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc124106a80 msgr2=0x7fc1241a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.074+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc124106a80 0x7fc1241a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.074+0000 7fc12a2ef640 1 -- 10.20.193.28:0/3411133769 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1241a64a0 con 0x7fc124101670 2026-02-20T03:18:32.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.074+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc124101670 0x7fc1241a1450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc11400d950 tx=0x7fc11400de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:32.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.074+0000 7fc10b7fe640 1 -- 10.20.193.28:0/3411133769 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc114014070 con 0x7fc124101670 2026-02-20T03:18:32.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.074+0000 7fc10b7fe640 1 -- 10.20.193.28:0/3411133769 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc1140044e0 con 0x7fc124101670 2026-02-20T03:18:32.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.074+0000 7fc10b7fe640 1 -- 10.20.193.28:0/3411133769 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc114005020 con 0x7fc124101670 2026-02-20T03:18:32.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.074+0000 7fc12b2f1640 1 -- 10.20.193.28:0/3411133769 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1241a6790 con 0x7fc124101670 2026-02-20T03:18:32.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.074+0000 7fc12b2f1640 1 -- 10.20.193.28:0/3411133769 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1241adfd0 con 0x7fc124101670 2026-02-20T03:18:32.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.077+0000 7fc10b7fe640 1 -- 10.20.193.28:0/3411133769 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc11400b900 con 0x7fc124101670 2026-02-20T03:18:32.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.077+0000 7fc12ea7fe00 1 Processor -- start 2026-02-20T03:18:32.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.077+0000 7fc12ea7fe00 1 -- start start 2026-02-20T03:18:32.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d619000 0x55e89d6193e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d613a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613fb0 0x55e89d61fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e89d593e50 con 0x55e89d613fb0 2026-02-20T03:18:32.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e89d5669c0 con 0x55e89d619000 2026-02-20T03:18:32.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e89d514240 con 0x55e89d613630 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12a2ef640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d613a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc129aee640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613fb0 0x55e89d61fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12a2ef640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d613a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47844/0 (socket says 10.20.193.28:47844) 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12a2ef640 1 -- 10.20.193.28:0/1068307098 learned_addr learned my addr 10.20.193.28:0/1068307098 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12aaf0640 1 --2- 10.20.193.28:0/1068307098 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d619000 0x55e89d6193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12a2ef640 1 -- 10.20.193.28:0/1068307098 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d619000 msgr2=0x55e89d6193e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/1068307098 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d619000 0x55e89d6193e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12a2ef640 1 -- 10.20.193.28:0/1068307098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613fb0 msgr2=0x55e89d61fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/1068307098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613fb0 0x55e89d61fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc12a2ef640 1 -- 10.20.193.28:0/1068307098 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89d527420 con 0x55e89d613630 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.078+0000 7fc129aee640 1 --2- 10.20.193.28:0/1068307098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613fb0 0x55e89d61fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:18:32.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.079+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/1068307098 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d613a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1140e6c20 tx=0x7fc1140e8670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=741c8492a8170931 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:32.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.079+0000 7fc10b7fe640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1000b0e20 0x7fc1000b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.079+0000 7fc10b7fe640 1 -- 10.20.193.28:0/3411133769 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc1140e0860 con 0x7fc124101670 2026-02-20T03:18:32.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.079+0000 7fc108cf3640 1 -- 10.20.193.28:0/1068307098 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140ef070 con 0x55e89d613630 2026-02-20T03:18:32.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.079+0000 7fc108cf3640 1 -- 10.20.193.28:0/1068307098 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc1140ac8f0 con 0x55e89d613630 2026-02-20T03:18:32.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.079+0000 7fc108cf3640 1 -- 10.20.193.28:0/1068307098 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1140a7b10 con 0x55e89d613630 2026-02-20T03:18:32.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.079+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/1068307098 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 msgr2=0x55e89d613a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.079+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/1068307098 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d613a70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc1140e6c20 tx=0x7fc1140e8670 comp rx=0 tx=0).stop 2026-02-20T03:18:32.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.079+0000 7fc12aaf0640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1000b0e20 0x7fc1000b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.080+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/1068307098 shutdown_connections 2026-02-20T03:18:32.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.080+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/1068307098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613fb0 0x55e89d61fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.080+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/1068307098 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d613a70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.080+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/1068307098 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d619000 0x55e89d6193e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.080+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/1068307098 >> 10.20.193.28:0/1068307098 conn(0x55e89d5d6290 msgr2=0x55e89d611d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.080+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/1068307098 shutdown_connections 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.080+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/1068307098 wait complete. 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.080+0000 7fc12aaf0640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1000b0e20 0x7fc1000b32e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc120009e60 tx=0x7fc120030f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.081+0000 7fc12ea7fe00 1 -- start start 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.081+0000 7fc12ea7fe00 1 Processor -- start 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.081+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d62dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.081+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 0x55e89d62e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.081+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d62c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.081+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e89d5628f0 con 0x55e89d619000 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.081+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e89d354f50 con 0x55e89d613fb0 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.081+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e89d62ca60 con 0x55e89d613630 2026-02-20T03:18:32.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc12a2ef640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d62dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc129aee640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 0x55e89d62e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc12a2ef640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d62dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47854/0 (socket says 10.20.193.28:47854) 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc12a2ef640 1 -- 10.20.193.28:0/2645540118 learned_addr learned my addr 10.20.193.28:0/2645540118 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc12aaf0640 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d62c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc129aee640 1 -- 10.20.193.28:0/2645540118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 msgr2=0x55e89d62dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc129aee640 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d62dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc129aee640 1 -- 10.20.193.28:0/2645540118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 msgr2=0x55e89d62c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc129aee640 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d62c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc129aee640 1 -- 10.20.193.28:0/2645540118 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89d625a30 con 0x55e89d613fb0 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc129aee640 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 0x55e89d62e0e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc118009b00 tx=0x7fc1180026e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a14892b2c20e71b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.082+0000 7fc0d7fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:18:32.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc0d7fff640 1 -- 10.20.193.28:0/2645540118 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118010640 con 0x55e89d613fb0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc0d7fff640 1 -- 10.20.193.28:0/2645540118 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc118010c80 con 0x55e89d613fb0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc0d7fff640 1 -- 10.20.193.28:0/2645540118 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11801bd90 con 0x55e89d613fb0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/2645540118 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89d337b40 con 0x55e89d613fb0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc0d7fff640 1 -- 10.20.193.28:0/2645540118 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc11800f3c0 con 0x55e89d613fb0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc0d7fff640 10 client.25988 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc12ea7fe00 10 client.25988 _ll_register_callbacks cb 0x55e89d59ff00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/2645540118 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e89d5741a0 con 0x55e89d613fb0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc0d7fff640 1 -- 10.20.193.28:0/2645540118 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc118021060 con 0x55e89d613fb0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc12ea7fe00 10 client.25988 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.083+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/2645540118 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e89d521230 con 0x55e89d613fb0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.084+0000 7fc0d7fff640 1 -- 10.20.193.28:0/2645540118 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc1180107e0 con 0x55e89d613fb0 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.084+0000 7fc12ea7fe00 10 client.25988 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:32.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.084+0000 7fc12ea7fe00 10 client.25988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.084+0000 7fc12ea7fe00 20 client.25988 populate_metadata read hostname 'trial028' 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.084+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e89d64d7f0 0x55e89d64fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.084+0000 7fc12ea7fe00 4 client.25988 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.084+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/2645540118 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e89d56e5b0 con 0x55e89d64d7f0 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.084+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e89d64d7f0 0x55e89d64fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.085+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e89d64d7f0 0x55e89d64fcb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab10b5fafff6c837 server_cookie=a865b95fbb462e07 in_seq=0 out_seq=0 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.085+0000 7fc0d7fff640 10 client.25988 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.085+0000 7fc0d7fff640 1 -- 10.20.193.28:0/2645540118 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e89d56e5b0 con 0x55e89d64d7f0 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.085+0000 7fc0d7fff640 10 client.25988 handle_command_reply: tid=0 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.085+0000 7fc12ea7fe00 1 client.25988 shutdown 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/2645540118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 msgr2=0x55e89d62e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 0x55e89d62e0e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc118009b00 tx=0x7fc1180026e0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/2645540118 shutdown_connections 2026-02-20T03:18:32.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e89d64d7f0 0x55e89d64fcb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d62c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 0x55e89d62e0e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/2645540118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613630 0x55e89d62dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/2645540118 >> 10.20.193.28:0/2645540118 conn(0x55e89d5d6290 msgr2=0x55e89d612440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:32.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc0d7fff640 0 client.25988 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:32.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/2645540118 shutdown_connections 2026-02-20T03:18:32.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/2645540118 wait complete. 2026-02-20T03:18:32.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.086+0000 7fc12ea7fe00 20 client.25988 trim_cache size 0 max 16384 2026-02-20T03:18:32.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12ea7fe00 1 Processor -- start 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12ea7fe00 1 -- start start 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613630 0x55e89d62b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 0x55e89d612520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d619000 0x55e89d612a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc012750 con 0x55e89d613630 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc00ffc0 con 0x55e89d613fb0 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc00de10 con 0x55e89d619000 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12a2ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613630 0x55e89d62b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc129aee640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 0x55e89d612520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12a2ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613630 0x55e89d62b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38828/0 (socket says 10.20.193.28:38828) 2026-02-20T03:18:32.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12a2ef640 1 -- 10.20.193.28:0/3667138194 learned_addr learned my addr 10.20.193.28:0/3667138194 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:32.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.095+0000 7fc12aaf0640 1 --2- 10.20.193.28:0/3667138194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d619000 0x55e89d612a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12a2ef640 1 -- 10.20.193.28:0/3667138194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d619000 msgr2=0x55e89d612a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:32.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/3667138194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d619000 0x55e89d612a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12a2ef640 1 -- 10.20.193.28:0/3667138194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 msgr2=0x55e89d612520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:32.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/3667138194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 0x55e89d612520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12a2ef640 1 -- 10.20.193.28:0/3667138194 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89d62c650 con 0x55e89d613630 2026-02-20T03:18:32.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/3667138194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613630 0x55e89d62b160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc1140a5610 tx=0x7fc1140e8fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc36dd82fb39e5b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:32.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc0f24e6640 1 -- 10.20.193.28:0/3667138194 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11401d030 con 0x55e89d613630 2026-02-20T03:18:32.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc0f24e6640 1 -- 10.20.193.28:0/3667138194 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc1140b17a0 con 0x55e89d613630 2026-02-20T03:18:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/3667138194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613630 msgr2=0x55e89d62b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/3667138194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613630 0x55e89d62b160 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc1140a5610 tx=0x7fc1140e8fd0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/3667138194 shutdown_connections 2026-02-20T03:18:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/3667138194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d619000 0x55e89d612a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/3667138194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613fb0 0x55e89d612520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/3667138194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d613630 0x55e89d62b160 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/3667138194 >> 10.20.193.28:0/3667138194 conn(0x55e89d5d6290 msgr2=0x55e89d62aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:32.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/3667138194 shutdown_connections 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.096+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/3667138194 wait complete. 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.097+0000 7fc12ea7fe00 1 -- start start 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.097+0000 7fc12ea7fe00 1 Processor -- start 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.097+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613630 0x55e89d630a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.097+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613fb0 0x55e89d630f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.097+0000 7fc12ea7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d631480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.097+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc00e480 con 0x55e89d619000 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.097+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc00f8f0 con 0x55e89d613630 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.097+0000 7fc12ea7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0cc00eb50 con 0x55e89d613fb0 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc129aee640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613fb0 0x55e89d630f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12aaf0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d631480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12aaf0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d631480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38842/0 (socket says 10.20.193.28:38842) 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12aaf0640 1 -- 10.20.193.28:0/691156895 learned_addr learned my addr 10.20.193.28:0/691156895 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613630 0x55e89d630a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12aaf0640 1 -- 10.20.193.28:0/691156895 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613fb0 msgr2=0x55e89d630f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12aaf0640 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613fb0 0x55e89d630f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12aaf0640 1 -- 10.20.193.28:0/691156895 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613630 msgr2=0x55e89d630a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12aaf0640 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613630 0x55e89d630a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12aaf0640 1 -- 10.20.193.28:0/691156895 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e89d625860 con 0x55e89d619000 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12aaf0640 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d631480 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc12000b0a0 tx=0x7fc12003a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5f46f3e8dbbc1d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc0d7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc0d7fff640 1 -- 10.20.193.28:0/691156895 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120057070 con 0x55e89d619000 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc0d7fff640 1 -- 10.20.193.28:0/691156895 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc120007960 con 0x55e89d619000 2026-02-20T03:18:32.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc0d7fff640 1 -- 10.20.193.28:0/691156895 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120045ac0 con 0x55e89d619000 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.098+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/691156895 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e89d245870 con 0x55e89d619000 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc0d7fff640 1 -- 10.20.193.28:0/691156895 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc120045c60 con 0x55e89d619000 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 10 client.16131 _ll_register_callbacks cb 0x7fc118004050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/691156895 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e89d518b00 con 0x55e89d619000 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc0d7fff640 1 -- 10.20.193.28:0/691156895 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc120045e60 con 0x55e89d619000 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 10 client.16131 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/691156895 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55e89d506440 con 0x55e89d619000 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc0d7fff640 1 -- 10.20.193.28:0/691156895 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7fc1200074c0 con 0x55e89d619000 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 10 client.16131 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 20 client.16131 populate_metadata read hostname 'trial028' 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e89d6b9b60 0x55e89d6bc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 4 client.16131 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/691156895 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fc1140b17a0 con 0x55e89d6b9b60 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.099+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e89d6b9b60 0x55e89d6bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.100+0000 7fc12a2ef640 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e89d6b9b60 0x55e89d6bc020 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82a6f4c6338664cb server_cookie=ac276f32f14ffb85 in_seq=0 out_seq=0 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.100+0000 7fc0d7fff640 10 client.16131 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.100+0000 7fc0d7fff640 1 -- 10.20.193.28:0/691156895 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fc1140b17a0 con 0x55e89d6b9b60 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.100+0000 7fc0d7fff640 10 client.16131 handle_command_reply: tid=0 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.100+0000 7fc12ea7fe00 1 client.16131 shutdown 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.100+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/691156895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 msgr2=0x55e89d631480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.100+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d631480 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc12000b0a0 tx=0x7fc12003a040 comp rx=0 tx=0).stop 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.100+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/691156895 shutdown_connections 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.100+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e89d6b9b60 0x55e89d6bc020 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e89d619000 0x55e89d631480 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e89d613fb0 0x55e89d630f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12ea7fe00 1 --2- 10.20.193.28:0/691156895 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e89d613630 0x55e89d630a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/691156895 >> 10.20.193.28:0/691156895 conn(0x55e89d5d6290 msgr2=0x55e89d62b270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc0d7fff640 0 client.16131 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/691156895 shutdown_connections 2026-02-20T03:18:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12ea7fe00 1 -- 10.20.193.28:0/691156895 wait complete. 2026-02-20T03:18:32.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12ea7fe00 20 client.16131 trim_cache size 0 max 16384 2026-02-20T03:18:32.109 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:18:32.109 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:18:32.110 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:18:32.110 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:18:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12b2f1640 1 -- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1000b0e20 msgr2=0x7fc1000b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1000b0e20 0x7fc1000b32e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc120009e60 tx=0x7fc120030f90 comp rx=0 tx=0).stop 2026-02-20T03:18:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12b2f1640 1 -- 10.20.193.28:0/3411133769 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc124101670 msgr2=0x7fc1241a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc124101670 0x7fc1241a1450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc11400d950 tx=0x7fc11400de20 comp rx=0 tx=0).stop 2026-02-20T03:18:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.101+0000 7fc12b2f1640 1 -- 10.20.193.28:0/3411133769 shutdown_connections 2026-02-20T03:18:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.102+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc1000b0e20 0x7fc1000b32e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.102+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc124106a80 0x7fc1241a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.102+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc124101f90 0x7fc1241a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.102+0000 7fc12b2f1640 1 --2- 10.20.193.28:0/3411133769 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc124101670 0x7fc1241a1450 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.102+0000 7fc12b2f1640 1 -- 10.20.193.28:0/3411133769 >> 10.20.193.28:0/3411133769 conn(0x7fc1240fd2e0 msgr2=0x7fc1241043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:32.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.102+0000 7fc12b2f1640 1 -- 10.20.193.28:0/3411133769 shutdown_connections 2026-02-20T03:18:32.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.102+0000 7fc12b2f1640 1 -- 10.20.193.28:0/3411133769 wait complete. 2026-02-20T03:18:32.314 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:18:32.314 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:18:32.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 0.00 MB/sec execute 5 sec latency 13559.219 ms 2026-02-20T03:18:32.589 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:32.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.829+0000 7f0afc905640 1 -- 10.20.193.28:0/4167079756 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af81069e0 msgr2=0x7f0af8107350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.829+0000 7f0afc905640 1 --2- 10.20.193.28:0/4167079756 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af81069e0 0x7f0af8107350 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00b0a0 tx=0x7f0aec02f450 comp rx=0 tx=0).stop 2026-02-20T03:18:32.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.829+0000 7f0afc905640 1 -- 10.20.193.28:0/4167079756 shutdown_connections 2026-02-20T03:18:32.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.829+0000 7f0afc905640 1 --2- 10.20.193.28:0/4167079756 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af81069e0 0x7f0af8107350 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.829+0000 7f0afc905640 1 --2- 10.20.193.28:0/4167079756 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0af8101700 0x7f0af81062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.829+0000 7f0afc905640 1 --2- 10.20.193.28:0/4167079756 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0af8100d50 0x7f0af8101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.829+0000 7f0afc905640 1 -- 10.20.193.28:0/4167079756 >> 10.20.193.28:0/4167079756 conn(0x7f0af80fca60 msgr2=0x7f0af80fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:32.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.829+0000 7f0afc905640 1 -- 10.20.193.28:0/4167079756 shutdown_connections 2026-02-20T03:18:32.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.829+0000 7f0afc905640 1 -- 10.20.193.28:0/4167079756 wait complete. 2026-02-20T03:18:32.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.830+0000 7f0afc905640 1 Processor -- start 2026-02-20T03:18:32.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.830+0000 7f0afc905640 1 -- start start 2026-02-20T03:18:32.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.830+0000 7f0afc905640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0af8100d50 0x7f0af81a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.830+0000 7f0afc905640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af8101700 0x7f0af81a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.830+0000 7f0afc905640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0af81069e0 0x7f0af81a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.830+0000 7f0afc905640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0af81191c0 con 0x7f0af8101700 2026-02-20T03:18:32.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.830+0000 7f0afc905640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0af8119040 con 0x7f0af8100d50 2026-02-20T03:18:32.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.830+0000 7f0afc905640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0af8119340 con 0x7f0af81069e0 2026-02-20T03:18:32.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af8101700 0x7f0af81a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af8101700 0x7f0af81a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38866/0 (socket says 10.20.193.28:38866) 2026-02-20T03:18:32.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af6ffd640 1 -- 10.20.193.28:0/3387691063 learned_addr learned my addr 10.20.193.28:0/3387691063 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:32.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af6ffd640 1 -- 10.20.193.28:0/3387691063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0af81069e0 msgr2=0x7f0af81a5ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:32.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af6ffd640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0af81069e0 0x7f0af81a5ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af6ffd640 1 -- 10.20.193.28:0/3387691063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0af8100d50 msgr2=0x7f0af81a1620 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af6ffd640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0af8100d50 0x7f0af81a1620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af6ffd640 1 -- 10.20.193.28:0/3387691063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af81a6670 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af6ffd640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af8101700 0x7f0af81a1b60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800b570 tx=0x7f0ae800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af4ff9640 1 -- 10.20.193.28:0/3387691063 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8013020 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af4ff9640 1 -- 10.20.193.28:0/3387691063 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0ae8004480 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0af4ff9640 1 -- 10.20.193.28:0/3387691063 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800fb50 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af81a6960 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.831+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af81ae1a0 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.832+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af8106330 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.834+0000 7f0af4ff9640 1 -- 10.20.193.28:0/3387691063 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0ae8002780 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.836+0000 7f0af4ff9640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0acc0b0e20 0x7f0acc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.836+0000 7f0af4ff9640 1 -- 10.20.193.28:0/3387691063 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f0ae80e0c40 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.836+0000 7f0af4ff9640 1 -- 10.20.193.28:0/3387691063 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0ae801d020 con 0x7f0af8101700 2026-02-20T03:18:32.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.836+0000 7f0af77fe640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0acc0b0e20 0x7f0acc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:32.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.836+0000 7f0af77fe640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0acc0b0e20 0x7f0acc0b32e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009770 tx=0x7f0ae4006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:32.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.945+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0af81a2980 con 0x7f0af8101700 2026-02-20T03:18:32.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.945+0000 7f0af4ff9640 1 -- 10.20.193.28:0/3387691063 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11924 (secure 0 0 0) 0x7f0af81a2980 con 0x7f0af8101700 2026-02-20T03:18:32.948 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:18:32.951 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T03:17:23:524010+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:17:23.524005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0acc0b0e20 msgr2=0x7f0acc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0acc0b0e20 0x7f0acc0b32e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009770 tx=0x7f0ae4006cd0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af8101700 msgr2=0x7f0af81a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af8101700 0x7f0af81a1b60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800b570 tx=0x7f0ae800ba40 comp rx=0 tx=0).stop 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 shutdown_connections 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0acc0b0e20 0x7f0acc0b32e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0af81069e0 0x7f0af81a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0af8101700 0x7f0af81a1b60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 --2- 10.20.193.28:0/3387691063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0af8100d50 0x7f0af81a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:32.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 >> 10.20.193.28:0/3387691063 conn(0x7f0af80fca60 msgr2=0x7f0af8104280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:32.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 shutdown_connections 2026-02-20T03:18:32.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:32.946+0000 7f0afc905640 1 -- 10.20.193.28:0/3387691063 wait complete. 2026-02-20T03:18:33.148 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:18:33.461 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:33.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 0.00 MB/sec execute 6 sec latency 14559.254 ms 2026-02-20T03:18:33.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:33 trial028 ceph-mon[38552]: pgmap v297: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 146 KiB/s rd, 3.2 MiB/s wr, 200 op/s 2026-02-20T03:18:33.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:33 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3387691063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:18:33.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 -- 10.20.193.28:0/3350336396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 msgr2=0x7f1a3410ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:33.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/3350336396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 0x7f1a3410ad60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009a60 tx=0x7f1a2402f290 comp rx=0 tx=0).stop 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 -- 10.20.193.28:0/3350336396 shutdown_connections 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/3350336396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a34105320 0x7f1a34111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/3350336396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a34104980 0x7f1a34104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/3350336396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 0x7f1a3410ad60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 -- 10.20.193.28:0/3350336396 >> 10.20.193.28:0/3350336396 conn(0x7f1a34100680 msgr2=0x7f1a34102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 -- 10.20.193.28:0/3350336396 shutdown_connections 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 -- 10.20.193.28:0/3350336396 wait complete. 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.704+0000 7f1a39e5f640 1 Processor -- start 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a39e5f640 1 -- start start 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a39e5f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a34104980 0x7f1a34077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a39e5f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a34105320 0x7f1a34077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a39e5f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 0x7f1a34078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a39e5f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1a34114cd0 con 0x7f1a3410a980 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a39e5f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1a34114b50 con 0x7f1a34105320 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a39e5f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1a34114e50 con 0x7f1a34104980 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a3965e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 0x7f1a34078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a3965e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 0x7f1a34078080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38886/0 (socket says 10.20.193.28:38886) 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a3965e640 1 -- 10.20.193.28:0/1373577944 learned_addr learned my addr 10.20.193.28:0/1373577944 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a3965e640 1 -- 10.20.193.28:0/1373577944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a34104980 msgr2=0x7f1a34077600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a3965e640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a34104980 0x7f1a34077600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a3965e640 1 -- 10.20.193.28:0/1373577944 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a34105320 msgr2=0x7f1a34077b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:33.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a3965e640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a34105320 0x7f1a34077b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a3965e640 1 -- 10.20.193.28:0/1373577944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a341adb30 con 0x7f1a3410a980 2026-02-20T03:18:33.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.705+0000 7f1a3965e640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 0x7f1a34078080 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000b9c0 tx=0x7f1a3000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:33.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.706+0000 7f1a29ffb640 1 -- 10.20.193.28:0/1373577944 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30006e60 con 0x7f1a3410a980 2026-02-20T03:18:33.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.706+0000 7f1a29ffb640 1 -- 10.20.193.28:0/1373577944 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1a30010070 con 0x7f1a3410a980 2026-02-20T03:18:33.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.706+0000 7f1a29ffb640 1 -- 10.20.193.28:0/1373577944 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300047f0 con 0x7f1a3410a980 2026-02-20T03:18:33.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.706+0000 7f1a39e5f640 1 -- 10.20.193.28:0/1373577944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a341ade20 con 0x7f1a3410a980 2026-02-20T03:18:33.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.706+0000 7f1a39e5f640 1 -- 10.20.193.28:0/1373577944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a341ae280 con 0x7f1a3410a980 2026-02-20T03:18:33.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.709+0000 7f1a29ffb640 1 -- 10.20.193.28:0/1373577944 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1a3000c790 con 0x7f1a3410a980 2026-02-20T03:18:33.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.709+0000 7f1a3d5ede00 1 Processor -- start 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.709+0000 7f1a3d5ede00 1 -- start start 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.709+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dc7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.709+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 0x556fe3dc1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.709+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 0x556fe3dcdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.709+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556fe3d41e00 con 0x556fe3dc6fb0 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.709+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556fe3d14970 con 0x556fe3dc15e0 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.709+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556fe3cc21f0 con 0x556fe3dc1f60 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a2bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dc7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a2bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dc7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38896/0 (socket says 10.20.193.28:38896) 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a2bfff640 1 -- 10.20.193.28:0/1882586270 learned_addr learned my addr 10.20.193.28:0/1882586270 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:33.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a2bfff640 1 -- 10.20.193.28:0/1882586270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 msgr2=0x556fe3dcdde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a2bfff640 1 --2- 10.20.193.28:0/1882586270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 0x556fe3dcdde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a2bfff640 1 -- 10.20.193.28:0/1882586270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 msgr2=0x556fe3dc1a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a2bfff640 1 --2- 10.20.193.28:0/1882586270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 0x556fe3dc1a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a2bfff640 1 -- 10.20.193.28:0/1882586270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fe3cd53d0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a2bfff640 1 --2- 10.20.193.28:0/1882586270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dc7390 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009860 tx=0x7f1a1c009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db99dddd3720561 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a014e4640 1 -- 10.20.193.28:0/1882586270 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c016070 con 0x556fe3dc6fb0 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a29ffb640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a100b0e20 0x7f1a100b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a014e4640 1 -- 10.20.193.28:0/1882586270 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1a1c00b8d0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a014e4640 1 -- 10.20.193.28:0/1882586270 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c002d80 con 0x556fe3dc6fb0 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.710+0000 7f1a29ffb640 1 -- 10.20.193.28:0/1373577944 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1a300e0370 con 0x7f1a3410a980 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1882586270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 msgr2=0x556fe3dc7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1882586270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dc7390 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009860 tx=0x7f1a1c009d30 comp rx=0 tx=0).stop 2026-02-20T03:18:33.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a38e5d640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a100b0e20 0x7f1a100b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:33.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1882586270 shutdown_connections 2026-02-20T03:18:33.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1882586270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 0x556fe3dcdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1882586270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 0x556fe3dc1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1882586270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dc7390 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1882586270 >> 10.20.193.28:0/1882586270 conn(0x556fe3d84240 msgr2=0x556fe3dbfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:33.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1882586270 shutdown_connections 2026-02-20T03:18:33.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1882586270 wait complete. 2026-02-20T03:18:33.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.711+0000 7f1a38e5d640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a100b0e20 0x7f1a100b32e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009950 tx=0x7f1a240023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:33.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.712+0000 7f1a3d5ede00 1 -- start start 2026-02-20T03:18:33.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:33 trial177 ceph-mon[43181]: pgmap v297: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 146 KiB/s rd, 3.2 MiB/s wr, 200 op/s 2026-02-20T03:18:33.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:33 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3387691063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:18:33.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3d5ede00 1 Processor -- start 2026-02-20T03:18:33.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 0x556fe3ddbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 0x556fe3ddc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dda6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556fe3d108a0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556fe3b02f50 con 0x556fe3dc15e0 2026-02-20T03:18:33.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556fe3ddad30 con 0x556fe3dc1f60 2026-02-20T03:18:33.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3965e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dda6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:33.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3965e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dda6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38910/0 (socket says 10.20.193.28:38910) 2026-02-20T03:18:33.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3965e640 1 -- 10.20.193.28:0/1700028101 learned_addr learned my addr 10.20.193.28:0/1700028101 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:33.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3965e640 1 -- 10.20.193.28:0/1700028101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 msgr2=0x556fe3ddc480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:33.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.716+0000 7f1a3965e640 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 0x556fe3ddc480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f1a3965e640 1 -- 10.20.193.28:0/1700028101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 msgr2=0x556fe3ddbf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:33.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f1a3965e640 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 0x556fe3ddbf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f1a3965e640 1 -- 10.20.193.28:0/1700028101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fe3dd3b20 con 0x556fe3dc6fb0 2026-02-20T03:18:33.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f1a3965e640 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dda6f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1a300a3e80 tx=0x7f1a3000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b812cc92d427d06 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:33.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f19f27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:33.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f19f27fc640 1 -- 10.20.193.28:0/1700028101 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300e0160 con 0x556fe3dc6fb0 2026-02-20T03:18:33.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f19f27fc640 1 -- 10.20.193.28:0/1700028101 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1a300ca040 con 0x556fe3dc6fb0 2026-02-20T03:18:33.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f19f27fc640 1 -- 10.20.193.28:0/1700028101 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300a6ad0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1700028101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fe3ae5b40 con 0x556fe3dc6fb0 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f1a3d5ede00 10 client.16149 _ll_register_callbacks cb 0x556fe3d4deb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1700028101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556fe3d22150 con 0x556fe3dc6fb0 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f19f27fc640 1 -- 10.20.193.28:0/1700028101 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1a300a6d30 con 0x556fe3dc6fb0 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f19f27fc640 1 -- 10.20.193.28:0/1700028101 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1a300a8750 con 0x556fe3dc6fb0 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f1a3d5ede00 10 client.16149 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.717+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1700028101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x556fe3ccf1e0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.718+0000 7f19f27fc640 1 -- 10.20.193.28:0/1700028101 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f1a300941c0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.718+0000 7f1a3d5ede00 10 client.16149 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.718+0000 7f1a3d5ede00 10 client.16149 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.718+0000 7f1a3d5ede00 20 client.16149 populate_metadata read hostname 'trial028' 2026-02-20T03:18:33.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.718+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556fe3dea890 0x556fe3decd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.718+0000 7f1a3d5ede00 4 client.16149 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:33.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.718+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1700028101 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fe3d1c560 con 0x556fe3dea890 2026-02-20T03:18:33.731 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:18:33.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.739+0000 7f1a38e5d640 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556fe3dea890 0x556fe3decd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:33.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.779+0000 7f1a38e5d640 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556fe3dea890 0x556fe3decd30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c966dc795a9146b3 server_cookie=e970030bcbf38568 in_seq=0 out_seq=0 2026-02-20T03:18:33.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.779+0000 7f19f27fc640 10 client.16149 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:18:33.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f19f27fc640 1 -- 10.20.193.28:0/1700028101 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556fe3d1c560 con 0x556fe3dea890 2026-02-20T03:18:33.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f19f27fc640 10 client.16149 handle_command_reply: tid=0 2026-02-20T03:18:33.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f1a3d5ede00 1 client.16149 shutdown 2026-02-20T03:18:33.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1700028101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 msgr2=0x556fe3dda6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:33.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dda6f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1a300a3e80 tx=0x7f1a3000cd30 comp rx=0 tx=0).stop 2026-02-20T03:18:33.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1700028101 shutdown_connections 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556fe3dea890 0x556fe3decd30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3dda6f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 0x556fe3ddc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/1700028101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 0x556fe3ddbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1700028101 >> 10.20.193.28:0/1700028101 conn(0x556fe3d84240 msgr2=0x556fe3dc03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.806+0000 7f19f27fc640 0 client.16149 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.807+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1700028101 shutdown_connections 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.807+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/1700028101 wait complete. 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.807+0000 7f1a3d5ede00 20 client.16149 trim_cache size 0 max 16384 2026-02-20T03:18:33.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3d5ede00 1 Processor -- start 2026-02-20T03:18:33.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3d5ede00 1 -- start start 2026-02-20T03:18:33.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 0x556fe3dd7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 0x556fe3dd7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3df2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8012700 con 0x556fe3dc6fb0 2026-02-20T03:18:33.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f19d800ff70 con 0x556fe3dc15e0 2026-02-20T03:18:33.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19d800ddc0 con 0x556fe3dc1f60 2026-02-20T03:18:33.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3965e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3df2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:33.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3965e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3df2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38916/0 (socket says 10.20.193.28:38916) 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3965e640 1 -- 10.20.193.28:0/3141948025 learned_addr learned my addr 10.20.193.28:0/3141948025 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3965e640 1 -- 10.20.193.28:0/3141948025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 msgr2=0x556fe3dd7e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3965e640 1 --2- 10.20.193.28:0/3141948025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 0x556fe3dd7e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3965e640 1 -- 10.20.193.28:0/3141948025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 msgr2=0x556fe3dd7940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3965e640 1 --2- 10.20.193.28:0/3141948025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 0x556fe3dd7940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3965e640 1 -- 10.20.193.28:0/3141948025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fe3dd3950 con 0x556fe3dc6fb0 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.814+0000 7f1a3965e640 1 --2- 10.20.193.28:0/3141948025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3df2640 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1a30002790 tx=0x7f1a300df050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5198054661302d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a00ce3640 1 -- 10.20.193.28:0/3141948025 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300b1300 con 0x556fe3dc6fb0 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a00ce3640 1 -- 10.20.193.28:0/3141948025 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1a300ca070 con 0x556fe3dc6fb0 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a00ce3640 1 -- 10.20.193.28:0/3141948025 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300ac0d0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/3141948025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 msgr2=0x556fe3df2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:33.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/3141948025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3df2640 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1a30002790 tx=0x7f1a300df050 comp rx=0 tx=0).stop 2026-02-20T03:18:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/3141948025 shutdown_connections 2026-02-20T03:18:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/3141948025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3df2640 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/3141948025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc1f60 0x556fe3dd7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/3141948025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc15e0 0x556fe3dd7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/3141948025 >> 10.20.193.28:0/3141948025 conn(0x556fe3d84240 msgr2=0x556fe3dd9750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/3141948025 shutdown_connections 2026-02-20T03:18:33.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.815+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/3141948025 wait complete. 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.816+0000 7f1a3d5ede00 1 -- start start 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.816+0000 7f1a3d5ede00 1 Processor -- start 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.816+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc15e0 0x556fe3ddf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.816+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc1f60 0x556fe3ddfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.816+0000 7f1a3d5ede00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3e51800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.816+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f19d800e430 con 0x556fe3dc6fb0 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.816+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f19d800f8a0 con 0x556fe3dc1f60 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.816+0000 7f1a3d5ede00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f19d800eb00 con 0x556fe3dc15e0 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3965e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3e51800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:33.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3965e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3e51800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38920/0 (socket says 10.20.193.28:38920) 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3965e640 1 -- 10.20.193.28:0/816822543 learned_addr learned my addr 10.20.193.28:0/816822543 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3965e640 1 -- 10.20.193.28:0/816822543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc15e0 msgr2=0x556fe3ddf4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3965e640 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc15e0 0x556fe3ddf4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3965e640 1 -- 10.20.193.28:0/816822543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc1f60 msgr2=0x556fe3ddfa30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3965e640 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc1f60 0x556fe3ddfa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3965e640 1 -- 10.20.193.28:0/816822543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fe39f3870 con 0x556fe3dc6fb0 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3965e640 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3e51800 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1a300a7d50 tx=0x7f1a300a6f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f813616c20787f77 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f19f27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f19f27fc640 1 -- 10.20.193.28:0/816822543 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300e0160 con 0x556fe3dc6fb0 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f19f27fc640 1 -- 10.20.193.28:0/816822543 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x556fe3d22150 con 0x556fe3dc6fb0 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f19f27fc640 1 -- 10.20.193.28:0/816822543 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300a39d0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.817+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/816822543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fe3cb43f0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f19f27fc640 1 -- 10.20.193.28:0/816822543 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1a300b07f0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f19f27fc640 10 client.16155 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 10 client.16155 _ll_register_callbacks cb 0x7f1a300049b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/816822543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556fe3ce57c0 con 0x556fe3dc6fb0 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f19f27fc640 1 -- 10.20.193.28:0/816822543 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1a300a8750 con 0x556fe3dc6fb0 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 10 client.16155 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/816822543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x556fe3dd4640 con 0x556fe3dc6fb0 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f19f27fc640 1 -- 10.20.193.28:0/816822543 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f1a300b8050 con 0x556fe3dc6fb0 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 10 client.16155 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 10 client.16155 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 20 client.16155 populate_metadata read hostname 'trial028' 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556fe3e52c70 0x556fe3e53120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 4 client.16155 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:18:33.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.818+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/816822543 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556fe3cc6ab0 con 0x556fe3e52c70 2026-02-20T03:18:33.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.833+0000 7f1a38e5d640 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556fe3e52c70 0x556fe3e53120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:33.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:33 trial126 ceph-mon[38476]: pgmap v297: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 146 KiB/s rd, 3.2 MiB/s wr, 200 op/s 2026-02-20T03:18:33.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:33 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3387691063' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:18:33.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.899+0000 7f1a38e5d640 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556fe3e52c70 0x556fe3e53120 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=75dc4fe9ce97646 server_cookie=a38c0110eb067537 in_seq=0 out_seq=0 2026-02-20T03:18:33.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.899+0000 7f19f27fc640 10 client.16155 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:18:33.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f19f27fc640 1 -- 10.20.193.28:0/816822543 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556fe3cc6ab0 con 0x556fe3e52c70 2026-02-20T03:18:33.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f19f27fc640 10 client.16155 handle_command_reply: tid=0 2026-02-20T03:18:33.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 client.16155 shutdown 2026-02-20T03:18:33.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/816822543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 msgr2=0x556fe3e51800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:33.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3e51800 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1a300a7d50 tx=0x7f1a300a6f80 comp rx=0 tx=0).stop 2026-02-20T03:18:33.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/816822543 shutdown_connections 2026-02-20T03:18:33.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556fe3e52c70 0x556fe3e53120 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556fe3dc6fb0 0x556fe3e51800 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556fe3dc1f60 0x556fe3ddfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 --2- 10.20.193.28:0/816822543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556fe3dc15e0 0x556fe3ddf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/816822543 >> 10.20.193.28:0/816822543 conn(0x556fe3d84240 msgr2=0x556fe3deac70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:33.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f19f27fc640 0 client.16155 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:18:33.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.913+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/816822543 shutdown_connections 2026-02-20T03:18:33.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a3d5ede00 1 -- 10.20.193.28:0/816822543 wait complete. 2026-02-20T03:18:33.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a3d5ede00 20 client.16155 trim_cache size 0 max 16384 2026-02-20T03:18:33.929 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:18:33.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 -- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a100b0e20 msgr2=0x7f1a100b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:33.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a100b0e20 0x7f1a100b32e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009950 tx=0x7f1a240023d0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 -- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 msgr2=0x7f1a34078080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:33.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 0x7f1a34078080 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000b9c0 tx=0x7f1a3000be90 comp rx=0 tx=0).stop 2026-02-20T03:18:33.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 -- 10.20.193.28:0/1373577944 shutdown_connections 2026-02-20T03:18:33.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a100b0e20 0x7f1a100b32e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a3410a980 0x7f1a34078080 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a34105320 0x7f1a34077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 --2- 10.20.193.28:0/1373577944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a34104980 0x7f1a34077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:33.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.914+0000 7f1a39e5f640 1 -- 10.20.193.28:0/1373577944 >> 10.20.193.28:0/1373577944 conn(0x7f1a34100680 msgr2=0x7f1a34101180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:33.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.915+0000 7f1a39e5f640 1 -- 10.20.193.28:0/1373577944 shutdown_connections 2026-02-20T03:18:33.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:33.915+0000 7f1a39e5f640 1 -- 10.20.193.28:0/1373577944 wait complete. 2026-02-20T03:18:34.155 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:18:34.170 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:34.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.412+0000 7f43e0c10640 1 -- 10.20.193.28:0/3053724579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 msgr2=0x7f43dc10adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:34.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.412+0000 7f43e0c10640 1 --2- 10.20.193.28:0/3053724579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 0x7f43dc10adb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009a60 tx=0x7f43d002f290 comp rx=0 tx=0).stop 2026-02-20T03:18:34.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.412+0000 7f43e0c10640 1 -- 10.20.193.28:0/3053724579 shutdown_connections 2026-02-20T03:18:34.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.412+0000 7f43e0c10640 1 --2- 10.20.193.28:0/3053724579 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f43dc105370 0x7f43dc1118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.412+0000 7f43e0c10640 1 --2- 10.20.193.28:0/3053724579 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f43dc1049d0 0x7f43dc104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.412+0000 7f43e0c10640 1 --2- 10.20.193.28:0/3053724579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 0x7f43dc10adb0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.412+0000 7f43e0c10640 1 -- 10.20.193.28:0/3053724579 >> 10.20.193.28:0/3053724579 conn(0x7f43dc1006b0 msgr2=0x7f43dc102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:34.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.412+0000 7f43e0c10640 1 -- 10.20.193.28:0/3053724579 shutdown_connections 2026-02-20T03:18:34.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.412+0000 7f43e0c10640 1 -- 10.20.193.28:0/3053724579 wait complete. 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.413+0000 7f43e0c10640 1 Processor -- start 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.413+0000 7f43e0c10640 1 -- start start 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.414+0000 7f43e0c10640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f43dc1049d0 0x7f43dc19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.414+0000 7f43e0c10640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f43dc105370 0x7f43dc19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.414+0000 7f43e0c10640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 0x7f43dc1a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.414+0000 7f43e0c10640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc114d20 con 0x7f43dc10a9d0 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.414+0000 7f43e0c10640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc114ba0 con 0x7f43dc105370 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.414+0000 7f43e0c10640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc114ea0 con 0x7f43dc1049d0 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.415+0000 7f43dad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 0x7f43dc1a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.415+0000 7f43dad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 0x7f43dc1a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38936/0 (socket says 10.20.193.28:38936) 2026-02-20T03:18:34.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.415+0000 7f43dad76640 1 -- 10.20.193.28:0/307887376 learned_addr learned my addr 10.20.193.28:0/307887376 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:34.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.415+0000 7f43dad76640 1 -- 10.20.193.28:0/307887376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f43dc1049d0 msgr2=0x7f43dc19d290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:34.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.415+0000 7f43dad76640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f43dc1049d0 0x7f43dc19d290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.415+0000 7f43dad76640 1 -- 10.20.193.28:0/307887376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f43dc105370 msgr2=0x7f43dc19d7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:34.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.415+0000 7f43dad76640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f43dc105370 0x7f43dc19d7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.415+0000 7f43dad76640 1 -- 10.20.193.28:0/307887376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc1a22e0 con 0x7f43dc10a9d0 2026-02-20T03:18:34.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.415+0000 7f43dad76640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 0x7f43dc1a1b60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00b990 tx=0x7f43cc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:34.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.416+0000 7f43c37fe640 1 -- 10.20.193.28:0/307887376 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc006e60 con 0x7f43dc10a9d0 2026-02-20T03:18:34.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.416+0000 7f43c37fe640 1 -- 10.20.193.28:0/307887376 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f43cc010070 con 0x7f43dc10a9d0 2026-02-20T03:18:34.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.416+0000 7f43c37fe640 1 -- 10.20.193.28:0/307887376 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43cc004800 con 0x7f43dc10a9d0 2026-02-20T03:18:34.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.416+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc1a25d0 con 0x7f43dc10a9d0 2026-02-20T03:18:34.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.416+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1a9e10 con 0x7f43dc10a9d0 2026-02-20T03:18:34.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.417+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43dc104eb0 con 0x7f43dc10a9d0 2026-02-20T03:18:34.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.419+0000 7f43c37fe640 1 -- 10.20.193.28:0/307887376 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f43cc01d030 con 0x7f43dc10a9d0 2026-02-20T03:18:34.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.420+0000 7f43c37fe640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f43b40b0ea0 0x7f43b40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.421+0000 7f43c37fe640 1 -- 10.20.193.28:0/307887376 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f43cc0e04c0 con 0x7f43dc10a9d0 2026-02-20T03:18:34.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.421+0000 7f43da575640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f43b40b0ea0 0x7f43b40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.421+0000 7f43c37fe640 1 -- 10.20.193.28:0/307887376 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f43cc023080 con 0x7f43dc10a9d0 2026-02-20T03:18:34.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.422+0000 7f43da575640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f43b40b0ea0 0x7f43b40b3360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009950 tx=0x7f43d00023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:34.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 0.00 MB/sec execute 7 sec latency 15559.287 ms 2026-02-20T03:18:34.505 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:34.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.534+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43dc19e5f0 con 0x7f43dc10a9d0 2026-02-20T03:18:34.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.536+0000 7f43c37fe640 1 -- 10.20.193.28:0/307887376 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11924 (secure 0 0 0) 0x7f43dc19e5f0 con 0x7f43dc10a9d0 2026-02-20T03:18:34.544 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:18:34.544 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":26,"btime":"2026-02-20T03:17:23:524010+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:17:23.524005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:18:34.545 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 26 2026-02-20T03:18:34.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f43b40b0ea0 msgr2=0x7f43b40b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:34.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f43b40b0ea0 0x7f43b40b3360 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009950 tx=0x7f43d00023d0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 msgr2=0x7f43dc1a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:34.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 0x7f43dc1a1b60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00b990 tx=0x7f43cc00be60 comp rx=0 tx=0).stop 2026-02-20T03:18:34.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 shutdown_connections 2026-02-20T03:18:34.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f43b40b0ea0 0x7f43b40b3360 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f43dc10a9d0 0x7f43dc1a1b60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f43dc105370 0x7f43dc19d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 --2- 10.20.193.28:0/307887376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f43dc1049d0 0x7f43dc19d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 >> 10.20.193.28:0/307887376 conn(0x7f43dc1006b0 msgr2=0x7f43dc1010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:34.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.539+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 shutdown_connections 2026-02-20T03:18:34.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.540+0000 7f43e0c10640 1 -- 10.20.193.28:0/307887376 wait complete. 2026-02-20T03:18:34.641 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:34 trial028 ceph-mon[38552]: pgmap v298: 129 pgs: 129 active+clean; 65 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 157 KiB/s rd, 2.7 MiB/s wr, 181 op/s 2026-02-20T03:18:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:34 trial177 ceph-mon[43181]: pgmap v298: 129 pgs: 129 active+clean; 65 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 157 KiB/s rd, 2.7 MiB/s wr, 181 op/s 2026-02-20T03:18:34.735 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 8846346f --release --await' 2026-02-20T03:18:34.735 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 8846346f --release --await 2026-02-20T03:18:34.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.807+0000 7f3da89cb640 1 -- 10.20.193.28:0/2432929533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da4075950 msgr2=0x7f3da4075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:34.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.807+0000 7f3da89cb640 1 --2- 10.20.193.28:0/2432929533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da4075950 0x7f3da4075d90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009a30 tx=0x7f3d8c02f2d0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.808+0000 7f3da89cb640 1 -- 10.20.193.28:0/2432929533 shutdown_connections 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.808+0000 7f3da89cb640 1 --2- 10.20.193.28:0/2432929533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3da41134d0 0x7f3da4115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.808+0000 7f3da89cb640 1 --2- 10.20.193.28:0/2432929533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da4075950 0x7f3da4075d90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.808+0000 7f3da89cb640 1 --2- 10.20.193.28:0/2432929533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3da41065d0 0x7f3da4075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.808+0000 7f3da89cb640 1 -- 10.20.193.28:0/2432929533 >> 10.20.193.28:0/2432929533 conn(0x7f3da40fe440 msgr2=0x7f3da4100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.808+0000 7f3da89cb640 1 -- 10.20.193.28:0/2432929533 shutdown_connections 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.808+0000 7f3da89cb640 1 -- 10.20.193.28:0/2432929533 wait complete. 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.808+0000 7f3da89cb640 1 Processor -- start 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da89cb640 1 -- start start 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da89cb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3da4075950 0x7f3da41a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da89cb640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3da41065d0 0x7f3da41a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da89cb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da41134d0 0x7f3da41a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da89cb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3da4119160 con 0x7f3da41134d0 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da89cb640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3da4118fe0 con 0x7f3da41065d0 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da89cb640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3da41192e0 con 0x7f3da4075950 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da41134d0 0x7f3da41a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da41134d0 0x7f3da41a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38954/0 (socket says 10.20.193.28:38954) 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da3577640 1 -- 10.20.193.28:0/271967628 learned_addr learned my addr 10.20.193.28:0/271967628 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da3577640 1 -- 10.20.193.28:0/271967628 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3da4075950 msgr2=0x7f3da41a15c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da3577640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3da4075950 0x7f3da41a15c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da3577640 1 -- 10.20.193.28:0/271967628 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3da41065d0 msgr2=0x7f3da41a1b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da3577640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3da41065d0 0x7f3da41a1b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.809+0000 7f3da3577640 1 -- 10.20.193.28:0/271967628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da41a6610 con 0x7f3da41134d0 2026-02-20T03:18:34.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.810+0000 7f3da3577640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da41134d0 0x7f3da41a5e90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400b990 tx=0x7f3d9400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:34.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.810+0000 7f3d83fff640 1 -- 10.20.193.28:0/271967628 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94006e60 con 0x7f3da41134d0 2026-02-20T03:18:34.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.810+0000 7f3d83fff640 1 -- 10.20.193.28:0/271967628 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d94010070 con 0x7f3da41134d0 2026-02-20T03:18:34.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.810+0000 7f3d83fff640 1 -- 10.20.193.28:0/271967628 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94004800 con 0x7f3da41134d0 2026-02-20T03:18:34.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.810+0000 7f3da89cb640 1 -- 10.20.193.28:0/271967628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da41a6900 con 0x7f3da41134d0 2026-02-20T03:18:34.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.810+0000 7f3da89cb640 1 -- 10.20.193.28:0/271967628 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da4106aa0 con 0x7f3da41134d0 2026-02-20T03:18:34.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.813+0000 7f3d83fff640 1 -- 10.20.193.28:0/271967628 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3d9401d030 con 0x7f3da41134d0 2026-02-20T03:18:34.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.813+0000 7f3dab6d1e00 1 Processor -- start 2026-02-20T03:18:34.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.813+0000 7f3dab6d1e00 1 -- start start 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.814+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffae2fb0 0x55abffae3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.814+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffadd5e0 0x55abffadda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.814+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffaddf60 0x55abffae9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.814+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55abffa5de00 con 0x55abffaddf60 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.814+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55abffa30970 con 0x55abffadd5e0 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.814+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55abff9de1f0 con 0x55abffae2fb0 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.814+0000 7f3d83fff640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d740b0ea0 0x7f3d740b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.814+0000 7f3d83fff640 1 -- 10.20.193.28:0/271967628 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3d940e0030 con 0x7f3da41134d0 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.815+0000 7f3da3577640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d740b0ea0 0x7f3d740b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.815+0000 7f3da2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffaddf60 0x55abffae9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.815+0000 7f3da2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffaddf60 0x55abffae9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38964/0 (socket says 10.20.193.28:38964) 2026-02-20T03:18:34.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.815+0000 7f3da2575640 1 -- 10.20.193.28:0/1353247020 learned_addr learned my addr 10.20.193.28:0/1353247020 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.815+0000 7f3da3577640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d740b0ea0 0x7f3d740b3360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3d940a7ca0 tx=0x7f3d94002f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.815+0000 7f3da2575640 1 -- 10.20.193.28:0/1353247020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffae2fb0 msgr2=0x55abffae3390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.815+0000 7f3da2575640 1 --2- 10.20.193.28:0/1353247020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffae2fb0 0x55abffae3390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3da2575640 1 -- 10.20.193.28:0/1353247020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffadd5e0 msgr2=0x55abffadda20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3da2575640 1 --2- 10.20.193.28:0/1353247020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffadd5e0 0x55abffadda20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3da2575640 1 -- 10.20.193.28:0/1353247020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abff9f13d0 con 0x55abffaddf60 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3da2575640 1 --2- 10.20.193.28:0/1353247020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffaddf60 0x55abffae9de0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c002cf0 tx=0x7f3d8c0057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2705643b89da1706 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3d7b7fe640 1 -- 10.20.193.28:0/1353247020 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c047070 con 0x55abffaddf60 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3d7b7fe640 1 -- 10.20.193.28:0/1353247020 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d8c03e070 con 0x55abffaddf60 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3d7b7fe640 1 -- 10.20.193.28:0/1353247020 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c047070 con 0x55abffaddf60 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1353247020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffaddf60 msgr2=0x55abffae9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:34.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1353247020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffaddf60 0x55abffae9de0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c002cf0 tx=0x7f3d8c0057d0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1353247020 shutdown_connections 2026-02-20T03:18:34.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1353247020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffaddf60 0x55abffae9de0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1353247020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffadd5e0 0x55abffadda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1353247020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffae2fb0 0x55abffae3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.816+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1353247020 >> 10.20.193.28:0/1353247020 conn(0x55abffaa0240 msgr2=0x55abffadbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:34.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.817+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1353247020 shutdown_connections 2026-02-20T03:18:34.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.817+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1353247020 wait complete. 2026-02-20T03:18:34.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.818+0000 7f3dab6d1e00 1 -- start start 2026-02-20T03:18:34.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.818+0000 7f3dab6d1e00 1 Processor -- start 2026-02-20T03:18:34.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.821+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffadd5e0 0x55abffaf62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.821+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffaddf60 0x55abffaf6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.821+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffae2fb0 0x55abffafbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.821+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55abffa2c8a0 con 0x55abffadd5e0 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.821+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55abff81ef50 con 0x55abffae2fb0 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.821+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55abffafc360 con 0x55abffaddf60 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.822+0000 7f3da2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffadd5e0 0x55abffaf62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.822+0000 7f3da2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffadd5e0 0x55abffaf62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38976/0 (socket says 10.20.193.28:38976) 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.822+0000 7f3da2575640 1 -- 10.20.193.28:0/97405425 learned_addr learned my addr 10.20.193.28:0/97405425 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.822+0000 7f3da2575640 1 -- 10.20.193.28:0/97405425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffaddf60 msgr2=0x55abffaf6830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.822+0000 7f3da2575640 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffaddf60 0x55abffaf6830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.822+0000 7f3da2575640 1 -- 10.20.193.28:0/97405425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffae2fb0 msgr2=0x55abffafbe20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:18:34.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.822+0000 7f3da2575640 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffae2fb0 0x55abffafbe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.822+0000 7f3da2575640 1 -- 10.20.193.28:0/97405425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abffaefa80 con 0x55abffadd5e0 2026-02-20T03:18:34.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3da2575640 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffadd5e0 0x55abffaf62f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c004260 tx=0x7f3d8c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138819234a34c473 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:34.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3d78ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:34.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3d78ff9640 1 -- 10.20.193.28:0/97405425 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c047070 con 0x55abffadd5e0 2026-02-20T03:18:34.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3d78ff9640 1 -- 10.20.193.28:0/97405425 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d8c033040 con 0x55abffadd5e0 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3d78ff9640 1 -- 10.20.193.28:0/97405425 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c02fd30 con 0x55abffadd5e0 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/97405425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abff801b40 con 0x55abffadd5e0 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3d78ff9640 1 -- 10.20.193.28:0/97405425 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3d8c042550 con 0x55abffadd5e0 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3dab6d1e00 10 client.16173 _ll_register_callbacks cb 0x55abffa69eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/97405425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55abffa3e150 con 0x55abffadd5e0 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3d78ff9640 1 -- 10.20.193.28:0/97405425 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3d8c042750 con 0x55abffadd5e0 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3dab6d1e00 10 client.16173 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.823+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/97405425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55abff9eb1e0 con 0x55abffadd5e0 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.824+0000 7f3d78ff9640 1 -- 10.20.193.28:0/97405425 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3d8c0428f0 con 0x55abffadd5e0 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.824+0000 7f3dab6d1e00 10 client.16173 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.824+0000 7f3dab6d1e00 10 client.16173 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:18:34.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.824+0000 7f3dab6d1e00 20 client.16173 populate_metadata read hostname 'trial028' 2026-02-20T03:18:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.824+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55abffb06070 0x55abffb08460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.824+0000 7f3dab6d1e00 4 client.16173 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:34.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.824+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/97405425 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abffa38560 con 0x55abffb06070 2026-02-20T03:18:34.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:34 trial126 ceph-mon[38476]: pgmap v298: 129 pgs: 129 active+clean; 65 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 157 KiB/s rd, 2.7 MiB/s wr, 181 op/s 2026-02-20T03:18:34.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.846+0000 7f3da2d76640 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55abffb06070 0x55abffb08460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.887+0000 7f3da2d76640 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55abffb06070 0x55abffb08460 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ae32b0084ad1378 server_cookie=538512d6bd1cd36b in_seq=0 out_seq=0 2026-02-20T03:18:34.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.887+0000 7f3d78ff9640 10 client.16173 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:18:34.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.901+0000 7f3d78ff9640 1 -- 10.20.193.28:0/97405425 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55abffa38560 con 0x55abffb06070 2026-02-20T03:18:34.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.901+0000 7f3d78ff9640 10 client.16173 handle_command_reply: tid=0 2026-02-20T03:18:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.902+0000 7f3dab6d1e00 1 client.16173 shutdown 2026-02-20T03:18:34.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/97405425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffadd5e0 msgr2=0x55abffaf62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:34.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffadd5e0 0x55abffaf62f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c004260 tx=0x7f3d8c004290 comp rx=0 tx=0).stop 2026-02-20T03:18:34.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/97405425 shutdown_connections 2026-02-20T03:18:34.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55abffb06070 0x55abffb08460 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffae2fb0 0x55abffafbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffaddf60 0x55abffaf6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/97405425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffadd5e0 0x55abffaf62f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/97405425 >> 10.20.193.28:0/97405425 conn(0x55abffaa0240 msgr2=0x55abffadc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:34.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3d78ff9640 0 client.16173 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:18:34.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/97405425 shutdown_connections 2026-02-20T03:18:34.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/97405425 wait complete. 2026-02-20T03:18:34.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.903+0000 7f3dab6d1e00 20 client.16173 trim_cache size 0 max 16384 2026-02-20T03:18:34.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.910+0000 7f3dab6d1e00 1 Processor -- start 2026-02-20T03:18:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.910+0000 7f3dab6d1e00 1 -- start start 2026-02-20T03:18:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.910+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffadd5e0 0x55abffb029f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.910+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffaddf60 0x55abffaf35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.910+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffaf3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.910+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d50012750 con 0x55abffae2fb0 2026-02-20T03:18:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.910+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5000ffc0 con 0x55abffadd5e0 2026-02-20T03:18:34.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.910+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5000de10 con 0x55abffaddf60 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.910+0000 7f3da2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffaf3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3da2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffaf3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38980/0 (socket says 10.20.193.28:38980) 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3da2575640 1 -- 10.20.193.28:0/3709706964 learned_addr learned my addr 10.20.193.28:0/3709706964 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3da2575640 1 -- 10.20.193.28:0/3709706964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffaddf60 msgr2=0x55abffaf35b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3da2575640 1 --2- 10.20.193.28:0/3709706964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffaddf60 0x55abffaf35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3da2575640 1 -- 10.20.193.28:0/3709706964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffadd5e0 msgr2=0x55abffb029f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3da2575640 1 --2- 10.20.193.28:0/3709706964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffadd5e0 0x55abffb029f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3da2575640 1 -- 10.20.193.28:0/3709706964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abffaef8b0 con 0x55abffae2fb0 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3da2575640 1 --2- 10.20.193.28:0/3709706964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffaf3af0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c005840 tx=0x7f3d8c056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c61999d05d31354 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3d7affd640 1 -- 10.20.193.28:0/3709706964 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c047040 con 0x55abffae2fb0 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.911+0000 7f3d7affd640 1 -- 10.20.193.28:0/3709706964 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d8c033030 con 0x55abffae2fb0 2026-02-20T03:18:34.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.912+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/3709706964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 msgr2=0x55abffaf3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.912+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/3709706964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffaf3af0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c005840 tx=0x7f3d8c056000 comp rx=0 tx=0).stop 2026-02-20T03:18:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.912+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/3709706964 shutdown_connections 2026-02-20T03:18:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.912+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/3709706964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffaf3af0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.912+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/3709706964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffaddf60 0x55abffaf35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.912+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/3709706964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffadd5e0 0x55abffb029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.912+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/3709706964 >> 10.20.193.28:0/3709706964 conn(0x55abffaa0240 msgr2=0x55abffaf51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.912+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/3709706964 shutdown_connections 2026-02-20T03:18:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.912+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/3709706964 wait complete. 2026-02-20T03:18:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3dab6d1e00 1 -- start start 2026-02-20T03:18:34.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3dab6d1e00 1 Processor -- start 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffadd5e0 0x55abffb6b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffaddf60 0x55abffb6bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3dab6d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffb6c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5000e480 con 0x55abffae2fb0 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5000f8f0 con 0x55abffaddf60 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3dab6d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5000eb50 con 0x55abffadd5e0 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3da2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffb6c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3da2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffb6c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38982/0 (socket says 10.20.193.28:38982) 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.913+0000 7f3da2575640 1 -- 10.20.193.28:0/1631995761 learned_addr learned my addr 10.20.193.28:0/1631995761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3da2575640 1 -- 10.20.193.28:0/1631995761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffadd5e0 msgr2=0x55abffb6b9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3da2575640 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffadd5e0 0x55abffb6b9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3da2575640 1 -- 10.20.193.28:0/1631995761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffaddf60 msgr2=0x55abffb6bee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3da2575640 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffaddf60 0x55abffb6bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3da2575640 1 -- 10.20.193.28:0/1631995761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abff70f870 con 0x55abffae2fb0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3da2575640 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffb6c420 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c002410 tx=0x7f3d8c02fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9784daeec871fd0d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3d78ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3d78ff9640 1 -- 10.20.193.28:0/1631995761 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c067020 con 0x55abffae2fb0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3d78ff9640 1 -- 10.20.193.28:0/1631995761 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55abffa3e150 con 0x55abffae2fb0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1631995761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abff9d03f0 con 0x55abffae2fb0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3dab6d1e00 10 client.16179 _ll_register_callbacks cb 0x7f3d8c045070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1631995761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d8c03e070 con 0x55abffae2fb0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.914+0000 7f3d78ff9640 1 -- 10.20.193.28:0/1631995761 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c038470 con 0x55abffae2fb0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.915+0000 7f3d78ff9640 1 -- 10.20.193.28:0/1631995761 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3d8c0047c0 con 0x55abffae2fb0 2026-02-20T03:18:34.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.916+0000 7f3d78ff9640 1 -- 10.20.193.28:0/1631995761 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3d8c0428f0 con 0x55abffae2fb0 2026-02-20T03:18:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.916+0000 7f3dab6d1e00 10 client.16179 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:34.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.916+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1631995761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55abffaf05a0 con 0x55abffae2fb0 2026-02-20T03:18:34.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.917+0000 7f3d78ff9640 1 -- 10.20.193.28:0/1631995761 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3d8c042a90 con 0x55abffae2fb0 2026-02-20T03:18:34.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.917+0000 7f3dab6d1e00 10 client.16179 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:34.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.917+0000 7f3dab6d1e00 10 client.16179 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:18:34.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.917+0000 7f3dab6d1e00 20 client.16179 populate_metadata read hostname 'trial028' 2026-02-20T03:18:34.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.917+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55abffb833a0 0x55abffb85840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:34.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.917+0000 7f3dab6d1e00 4 client.16179 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:18:34.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.917+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1631995761 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55abffa017c0 con 0x55abffb833a0 2026-02-20T03:18:34.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.929+0000 7f3da2d76640 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55abffb833a0 0x55abffb85840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:34.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.984+0000 7f3da2d76640 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55abffb833a0 0x55abffb85840 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=deeb6edce9cc9808 server_cookie=8cb16d18f61fb016 in_seq=0 out_seq=0 2026-02-20T03:18:34.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.984+0000 7f3d78ff9640 10 client.16179 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:18:35.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3d78ff9640 1 -- 10.20.193.28:0/1631995761 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55abffa017c0 con 0x55abffb833a0 2026-02-20T03:18:35.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3d78ff9640 10 client.16179 handle_command_reply: tid=0 2026-02-20T03:18:35.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3dab6d1e00 1 client.16179 shutdown 2026-02-20T03:18:35.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1631995761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 msgr2=0x55abffb6c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffb6c420 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c002410 tx=0x7f3d8c02fd40 comp rx=0 tx=0).stop 2026-02-20T03:18:35.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1631995761 shutdown_connections 2026-02-20T03:18:35.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55abffb833a0 0x55abffb85840 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55abffae2fb0 0x55abffb6c420 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55abffaddf60 0x55abffb6bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3d78ff9640 0 client.16179 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:18:35.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.997+0000 7f3dab6d1e00 1 --2- 10.20.193.28:0/1631995761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55abffadd5e0 0x55abffb6b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.998+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1631995761 >> 10.20.193.28:0/1631995761 conn(0x55abffaa0240 msgr2=0x55abffb06450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.998+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1631995761 shutdown_connections 2026-02-20T03:18:35.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.998+0000 7f3dab6d1e00 1 -- 10.20.193.28:0/1631995761 wait complete. 2026-02-20T03:18:35.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.998+0000 7f3dab6d1e00 20 client.16179 trim_cache size 0 max 16384 2026-02-20T03:18:35.013 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:18:35.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.998+0000 7f3da89cb640 1 -- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d740b0ea0 msgr2=0x7f3d740b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.998+0000 7f3da89cb640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d740b0ea0 0x7f3d740b3360 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3d940a7ca0 tx=0x7f3d94002f10 comp rx=0 tx=0).stop 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.998+0000 7f3da89cb640 1 -- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da41134d0 msgr2=0x7f3da41a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.998+0000 7f3da89cb640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da41134d0 0x7f3da41a5e90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400b990 tx=0x7f3d9400be60 comp rx=0 tx=0).stop 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.999+0000 7f3da89cb640 1 -- 10.20.193.28:0/271967628 shutdown_connections 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.999+0000 7f3da89cb640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d740b0ea0 0x7f3d740b3360 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.999+0000 7f3da89cb640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3da41134d0 0x7f3da41a5e90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.999+0000 7f3da89cb640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3da41065d0 0x7f3da41a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.999+0000 7f3da89cb640 1 --2- 10.20.193.28:0/271967628 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3da4075950 0x7f3da41a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.999+0000 7f3da89cb640 1 -- 10.20.193.28:0/271967628 >> 10.20.193.28:0/271967628 conn(0x7f3da40fe440 msgr2=0x7f3da41115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.999+0000 7f3da89cb640 1 -- 10.20.193.28:0/271967628 shutdown_connections 2026-02-20T03:18:35.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:34.999+0000 7f3da89cb640 1 -- 10.20.193.28:0/271967628 wait complete. 2026-02-20T03:18:35.041 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:35.236 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:18:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.404+0000 7f22f9ade640 1 -- 10.20.193.28:0/1148371484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f4109ba0 msgr2=0x7f22f4115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.404+0000 7f22f9ade640 1 --2- 10.20.193.28:0/1148371484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f4109ba0 0x7f22f4115d10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f22f000b0a0 tx=0x7f22f002f450 comp rx=0 tx=0).stop 2026-02-20T03:18:35.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.404+0000 7f22f9ade640 1 -- 10.20.193.28:0/1148371484 shutdown_connections 2026-02-20T03:18:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.404+0000 7f22f9ade640 1 --2- 10.20.193.28:0/1148371484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f4109ba0 0x7f22f4115d10 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.404+0000 7f22f9ade640 1 --2- 10.20.193.28:0/1148371484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f22f4109220 0x7f22f4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.404+0000 7f22f9ade640 1 --2- 10.20.193.28:0/1148371484 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f22f410eef0 0x7f22f410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.404+0000 7f22f9ade640 1 -- 10.20.193.28:0/1148371484 >> 10.20.193.28:0/1148371484 conn(0x7f22f4078600 msgr2=0x7f22f407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.404+0000 7f22f9ade640 1 -- 10.20.193.28:0/1148371484 shutdown_connections 2026-02-20T03:18:35.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.404+0000 7f22f9ade640 1 -- 10.20.193.28:0/1148371484 wait complete. 2026-02-20T03:18:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.405+0000 7f22f9ade640 1 Processor -- start 2026-02-20T03:18:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.405+0000 7f22f9ade640 1 -- start start 2026-02-20T03:18:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.405+0000 7f22f9ade640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f22f4109220 0x7f22f41a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.405+0000 7f22f9ade640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f22f4109ba0 0x7f22f41a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.405+0000 7f22f9ade640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f410eef0 0x7f22f41a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.405+0000 7f22f9ade640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22f41191b0 con 0x7f22f410eef0 2026-02-20T03:18:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.405+0000 7f22f9ade640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f22f4119030 con 0x7f22f4109220 2026-02-20T03:18:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.405+0000 7f22f9ade640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22f4119330 con 0x7f22f4109ba0 2026-02-20T03:18:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22f92dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f410eef0 0x7f22f41a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22f92dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f410eef0 0x7f22f41a5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38998/0 (socket says 10.20.193.28:38998) 2026-02-20T03:18:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22f92dd640 1 -- 10.20.193.28:0/3031824130 learned_addr learned my addr 10.20.193.28:0/3031824130 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22f92dd640 1 -- 10.20.193.28:0/3031824130 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f22f4109ba0 msgr2=0x7f22f41a1b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:35.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22f92dd640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f22f4109ba0 0x7f22f41a1b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22f92dd640 1 -- 10.20.193.28:0/3031824130 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f22f4109220 msgr2=0x7f22f41a15f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22f92dd640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f22f4109220 0x7f22f41a15f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22f92dd640 1 -- 10.20.193.28:0/3031824130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f41a6640 con 0x7f22f410eef0 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22f92dd640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f410eef0 0x7f22f41a5ec0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f22f000b1d0 tx=0x7f22f0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22e9ffb640 1 -- 10.20.193.28:0/3031824130 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0004590 con 0x7f22f410eef0 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22e9ffb640 1 -- 10.20.193.28:0/3031824130 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22f0004730 con 0x7f22f410eef0 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.406+0000 7f22e9ffb640 1 -- 10.20.193.28:0/3031824130 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0038680 con 0x7f22f410eef0 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.407+0000 7f22f9ade640 1 -- 10.20.193.28:0/3031824130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f41a68d0 con 0x7f22f410eef0 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.407+0000 7f22f9ade640 1 -- 10.20.193.28:0/3031824130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f41ae170 con 0x7f22f410eef0 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.409+0000 7f22e9ffb640 1 -- 10.20.193.28:0/3031824130 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f22f0002a60 con 0x7f22f410eef0 2026-02-20T03:18:35.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22fd26ce00 1 Processor -- start 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22fd26ce00 1 -- start start 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 0x5619e1c0d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c0e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0e8e0 0x5619e1c192d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5619e1b5fa20 con 0x5619e1c0df60 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5619e1b0d2a0 con 0x5619e1c0cdd0 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5619e1b5b950 con 0x5619e1c0e8e0 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22f8adc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c0e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22f8adc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c0e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39006/0 (socket says 10.20.193.28:39006) 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.410+0000 7f22f8adc640 1 -- 10.20.193.28:0/1249159197 learned_addr learned my addr 10.20.193.28:0/1249159197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.411+0000 7f22f8adc640 1 -- 10.20.193.28:0/1249159197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0e8e0 msgr2=0x5619e1c192d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:35.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.411+0000 7f22f8adc640 1 --2- 10.20.193.28:0/1249159197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0e8e0 0x5619e1c192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.411+0000 7f22f8adc640 1 -- 10.20.193.28:0/1249159197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 msgr2=0x5619e1c0d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.411+0000 7f22f8adc640 1 --2- 10.20.193.28:0/1249159197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 0x5619e1c0d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.411+0000 7f22f8adc640 1 -- 10.20.193.28:0/1249159197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e1af00f0 con 0x5619e1c0df60 2026-02-20T03:18:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.411+0000 7f22e9ffb640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d00b0e20 0x7f22d00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.411+0000 7f22e9ffb640 1 -- 10.20.193.28:0/3031824130 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f22f0105940 con 0x7f22f410eef0 2026-02-20T03:18:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.411+0000 7f22f8adc640 1 --2- 10.20.193.28:0/1249159197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c0e3a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009870 tx=0x7f22e4009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963c54974cbc5ff1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.411+0000 7f22c14e4640 1 -- 10.20.193.28:0/1249159197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e4016070 con 0x5619e1c0df60 2026-02-20T03:18:35.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22c14e4640 1 -- 10.20.193.28:0/1249159197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22e4004480 con 0x5619e1c0df60 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22c14e4640 1 -- 10.20.193.28:0/1249159197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e400bda0 con 0x5619e1c0df60 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22ebfff640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d00b0e20 0x7f22d00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22fd26ce00 1 -- 10.20.193.28:0/1249159197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 msgr2=0x5619e1c0e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/1249159197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c0e3a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f22e4009870 tx=0x7f22e4009d40 comp rx=0 tx=0).stop 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22fd26ce00 1 -- 10.20.193.28:0/1249159197 shutdown_connections 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/1249159197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0e8e0 0x5619e1c192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22ebfff640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d00b0e20 0x7f22d00b32e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f22f410e5a0 tx=0x7f22dc007bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/1249159197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c0e3a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/1249159197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 0x5619e1c0d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22fd26ce00 1 -- 10.20.193.28:0/1249159197 >> 10.20.193.28:0/1249159197 conn(0x5619e1c041b0 msgr2=0x5619e1c0b030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22fd26ce00 1 -- 10.20.193.28:0/1249159197 shutdown_connections 2026-02-20T03:18:35.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.412+0000 7f22fd26ce00 1 -- 10.20.193.28:0/1249159197 wait complete. 2026-02-20T03:18:35.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.414+0000 7f22fd26ce00 1 -- start start 2026-02-20T03:18:35.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.414+0000 7f22fd26ce00 1 Processor -- start 2026-02-20T03:18:35.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.414+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0cdd0 0x5619e1c27700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.414+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0df60 0x5619e1c27c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.414+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c25e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.414+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5619e1b07080 con 0x5619e1c0e8e0 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.414+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5619e1c199d0 con 0x5619e1c0df60 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.414+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5619e1c263d0 con 0x5619e1c0cdd0 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22f92dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c25e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22f92dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c25e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39022/0 (socket says 10.20.193.28:39022) 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22f92dd640 1 -- 10.20.193.28:0/2074513794 learned_addr learned my addr 10.20.193.28:0/2074513794 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22f92dd640 1 -- 10.20.193.28:0/2074513794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0cdd0 msgr2=0x5619e1c27700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22f92dd640 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0cdd0 0x5619e1c27700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22f92dd640 1 -- 10.20.193.28:0/2074513794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0df60 msgr2=0x5619e1c27c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22f92dd640 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0df60 0x5619e1c27c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22f92dd640 1 -- 10.20.193.28:0/2074513794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e1c1ef80 con 0x5619e1c0e8e0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22f92dd640 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c25e40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f22f00c9450 tx=0x7f22f0007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e276f31cd4cd962b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22b27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22b27fc640 1 -- 10.20.193.28:0/2074513794 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f00048e0 con 0x5619e1c0e8e0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22b27fc640 1 -- 10.20.193.28:0/2074513794 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22f0033020 con 0x5619e1c0e8e0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22b27fc640 1 -- 10.20.193.28:0/2074513794 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f00d63f0 con 0x5619e1c0e8e0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.415+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2074513794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619e1930da0 con 0x5619e1c0e8e0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 10 client.16191 _ll_register_callbacks cb 0x5619e1b0afb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2074513794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5619e1b67610 con 0x5619e1c0e8e0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22b27fc640 1 -- 10.20.193.28:0/2074513794 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f22f0041c30 con 0x5619e1c0e8e0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22b27fc640 1 -- 10.20.193.28:0/2074513794 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f22f00d19d0 con 0x5619e1c0e8e0 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 10 client.16191 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:35.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2074513794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5619e1b1d020 con 0x5619e1c0e8e0 2026-02-20T03:18:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22b27fc640 1 -- 10.20.193.28:0/2074513794 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f22f00d2b60 con 0x5619e1c0e8e0 2026-02-20T03:18:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 10 client.16191 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 10 client.16191 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:18:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 20 client.16191 populate_metadata read hostname 'trial028' 2026-02-20T03:18:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5619e1c35e20 0x5619e1c382e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 4 client.16191 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:35.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.416+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2074513794 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619e1ae1b80 con 0x5619e1c35e20 2026-02-20T03:18:35.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.437+0000 7f22f8adc640 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5619e1c35e20 0x5619e1c382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:18:35.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:35 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/307887376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:18:35.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:18:35.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:18:35.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:35 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:18:35.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 0.00 MB/sec execute 8 sec latency 16559.323 ms 2026-02-20T03:18:35.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.504+0000 7f22f8adc640 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5619e1c35e20 0x5619e1c382e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e4daff5a38136da server_cookie=5f22ab443daaf77c in_seq=0 out_seq=0 2026-02-20T03:18:35.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.504+0000 7f22b27fc640 10 client.16191 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:35.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.518+0000 7f22b27fc640 1 -- 10.20.193.28:0/2074513794 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5619e1ae1b80 con 0x5619e1c35e20 2026-02-20T03:18:35.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.518+0000 7f22b27fc640 10 client.16191 handle_command_reply: tid=0 2026-02-20T03:18:35.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.518+0000 7f22fd26ce00 1 client.16191 shutdown 2026-02-20T03:18:35.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2074513794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 msgr2=0x5619e1c25e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c25e40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f22f00c9450 tx=0x7f22f0007e30 comp rx=0 tx=0).stop 2026-02-20T03:18:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2074513794 shutdown_connections 2026-02-20T03:18:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5619e1c35e20 0x5619e1c382e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22b27fc640 0 client.16191 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c25e40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0df60 0x5619e1c27c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2074513794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0cdd0 0x5619e1c27700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2074513794 >> 10.20.193.28:0/2074513794 conn(0x5619e1c041b0 msgr2=0x5619e1c11080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2074513794 shutdown_connections 2026-02-20T03:18:35.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2074513794 wait complete. 2026-02-20T03:18:35.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.520+0000 7f22fd26ce00 20 client.16191 trim_cache size 0 max 16384 2026-02-20T03:18:35.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.529+0000 7f22fd26ce00 1 Processor -- start 2026-02-20T03:18:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.529+0000 7f22fd26ce00 1 -- start start 2026-02-20T03:18:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.529+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 0x5619e1c11790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.529+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c32800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.529+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0e8e0 0x5619e1c04e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2298012730 con 0x5619e1c0df60 2026-02-20T03:18:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f229800ffa0 con 0x5619e1c0cdd0 2026-02-20T03:18:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f229800ddf0 con 0x5619e1c0e8e0 2026-02-20T03:18:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22ebfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c32800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22ebfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c32800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39028/0 (socket says 10.20.193.28:39028) 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22ebfff640 1 -- 10.20.193.28:0/2533555805 learned_addr learned my addr 10.20.193.28:0/2533555805 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22ebfff640 1 -- 10.20.193.28:0/2533555805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0e8e0 msgr2=0x5619e1c04e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22ebfff640 1 --2- 10.20.193.28:0/2533555805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0e8e0 0x5619e1c04e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22ebfff640 1 -- 10.20.193.28:0/2533555805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 msgr2=0x5619e1c11790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22ebfff640 1 --2- 10.20.193.28:0/2533555805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 0x5619e1c11790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22ebfff640 1 -- 10.20.193.28:0/2533555805 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e1c27de0 con 0x5619e1c0df60 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22ebfff640 1 --2- 10.20.193.28:0/2533555805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c32800 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f22dc002920 tx=0x7f22dc00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c965b23941ad7eb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22c0ce3640 1 -- 10.20.193.28:0/2533555805 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc007050 con 0x5619e1c0df60 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22c0ce3640 1 -- 10.20.193.28:0/2533555805 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22dc00c760 con 0x5619e1c0df60 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.530+0000 7f22c0ce3640 1 -- 10.20.193.28:0/2533555805 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc006940 con 0x5619e1c0df60 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.531+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2533555805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 msgr2=0x5619e1c32800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.531+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2533555805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c32800 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f22dc002920 tx=0x7f22dc00f000 comp rx=0 tx=0).stop 2026-02-20T03:18:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.531+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2533555805 shutdown_connections 2026-02-20T03:18:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.531+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2533555805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0e8e0 0x5619e1c04e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.531+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2533555805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0df60 0x5619e1c32800 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.531+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/2533555805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 0x5619e1c11790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.531+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2533555805 >> 10.20.193.28:0/2533555805 conn(0x5619e1c041b0 msgr2=0x5619e1c11080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.531+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2533555805 shutdown_connections 2026-02-20T03:18:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.531+0000 7f22fd26ce00 1 -- 10.20.193.28:0/2533555805 wait complete. 2026-02-20T03:18:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.532+0000 7f22fd26ce00 1 -- start start 2026-02-20T03:18:35.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.532+0000 7f22fd26ce00 1 Processor -- start 2026-02-20T03:18:35.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.532+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 0x5619e1c32570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.533+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0df60 0x5619e1c308b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.533+0000 7f22fd26ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c30df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.533+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f229800e460 con 0x5619e1c0e8e0 2026-02-20T03:18:35.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.533+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f229800f8d0 con 0x5619e1c0cdd0 2026-02-20T03:18:35.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.533+0000 7f22fd26ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f229800eb30 con 0x5619e1c0df60 2026-02-20T03:18:35.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.534+0000 7f22f92dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c30df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.534+0000 7f22f92dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c30df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39040/0 (socket says 10.20.193.28:39040) 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.534+0000 7f22f92dd640 1 -- 10.20.193.28:0/100683749 learned_addr learned my addr 10.20.193.28:0/100683749 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.534+0000 7f22f92dd640 1 -- 10.20.193.28:0/100683749 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0df60 msgr2=0x5619e1c308b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.535+0000 7f22f92dd640 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0df60 0x5619e1c308b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.535+0000 7f22f92dd640 1 -- 10.20.193.28:0/100683749 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 msgr2=0x5619e1c32570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.535+0000 7f22f92dd640 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 0x5619e1c32570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.535+0000 7f22f92dd640 1 -- 10.20.193.28:0/100683749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619e1c0d520 con 0x5619e1c0e8e0 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.535+0000 7f22f92dd640 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c30df0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f22f003d040 tx=0x7f22f00048e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545b0c64f9aaa152 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.535+0000 7f22b27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.535+0000 7f22b27fc640 1 -- 10.20.193.28:0/100683749 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0041c30 con 0x5619e1c0e8e0 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22b27fc640 1 -- 10.20.193.28:0/100683749 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22f0033070 con 0x5619e1c0e8e0 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22b27fc640 1 -- 10.20.193.28:0/100683749 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f00cc630 con 0x5619e1c0e8e0 2026-02-20T03:18:35.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 1 -- 10.20.193.28:0/100683749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619e1c1edb0 con 0x5619e1c0e8e0 2026-02-20T03:18:35.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22b27fc640 1 -- 10.20.193.28:0/100683749 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f22f00cc7d0 con 0x5619e1c0e8e0 2026-02-20T03:18:35.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22b27fc640 10 client.16197 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:18:35.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 10 client.16197 _ll_register_callbacks cb 0x7f22f00ccd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:35.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 1 -- 10.20.193.28:0/100683749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22e4004480 con 0x5619e1c0e8e0 2026-02-20T03:18:35.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22b27fc640 1 -- 10.20.193.28:0/100683749 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f22f00ccee0 con 0x5619e1c0e8e0 2026-02-20T03:18:35.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 10 client.16197 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:35.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 1 -- 10.20.193.28:0/100683749 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5619e183ead0 con 0x5619e1c0e8e0 2026-02-20T03:18:35.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22b27fc640 1 -- 10.20.193.28:0/100683749 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f22f00ee340 con 0x5619e1c0e8e0 2026-02-20T03:18:35.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 10 client.16197 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:35.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 10 client.16197 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:18:35.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 20 client.16197 populate_metadata read hostname 'trial028' 2026-02-20T03:18:35.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5619e1ca1ac0 0x5619e1ca3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 4 client.16197 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8846346f", "release": true, "await": true}] 2026-02-20T03:18:35.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.536+0000 7f22fd26ce00 1 -- 10.20.193.28:0/100683749 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8846346f", "release": true, "await": true}) -- 0x5619e1c19600 con 0x5619e1ca1ac0 2026-02-20T03:18:35.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.546+0000 7f22f8adc640 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5619e1ca1ac0 0x5619e1ca3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.587+0000 7f22f8adc640 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5619e1ca1ac0 0x5619e1ca3f80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fb55534d50618ae server_cookie=16be9140176a157b in_seq=0 out_seq=0 2026-02-20T03:18:35.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.587+0000 7f22b27fc640 10 client.16197 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.601+0000 7f22b27fc640 1 -- 10.20.193.28:0/100683749 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5619e1c19600 con 0x5619e1ca1ac0 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.601+0000 7f22b27fc640 10 client.16197 handle_command_reply: tid=0 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 client.16197 shutdown 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 -- 10.20.193.28:0/100683749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 msgr2=0x5619e1c30df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c30df0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f22f003d040 tx=0x7f22f00048e0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 -- 10.20.193.28:0/100683749 shutdown_connections 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5619e1ca1ac0 0x5619e1ca3f80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5619e1c0e8e0 0x5619e1c30df0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5619e1c0df60 0x5619e1c308b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 --2- 10.20.193.28:0/100683749 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5619e1c0cdd0 0x5619e1c32570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 -- 10.20.193.28:0/100683749 >> 10.20.193.28:0/100683749 conn(0x5619e1c041b0 msgr2=0x5619e1c24640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22b27fc640 0 client.16197 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:35.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 -- 10.20.193.28:0/100683749 shutdown_connections 2026-02-20T03:18:35.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 1 -- 10.20.193.28:0/100683749 wait complete. 2026-02-20T03:18:35.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.602+0000 7f22fd26ce00 20 client.16197 trim_cache size 0 max 16384 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 26, 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 12, 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout: "8846346f": { 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout: "version": 12, 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:18:35.607 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 137.3, 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:18:35.608 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:35.609 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:35.609 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:35.609 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:35.609 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:35.609 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:18:35.609 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:35.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 -- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d00b0e20 msgr2=0x7f22d00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d00b0e20 0x7f22d00b32e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f22f410e5a0 tx=0x7f22dc007bd0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 -- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f410eef0 msgr2=0x7f22f41a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f410eef0 0x7f22f41a5ec0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f22f000b1d0 tx=0x7f22f0009300 comp rx=0 tx=0).stop 2026-02-20T03:18:35.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 -- 10.20.193.28:0/3031824130 shutdown_connections 2026-02-20T03:18:35.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d00b0e20 0x7f22d00b32e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f22f410eef0 0x7f22f41a5ec0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f22f4109ba0 0x7f22f41a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 --2- 10.20.193.28:0/3031824130 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f22f4109220 0x7f22f41a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 -- 10.20.193.28:0/3031824130 >> 10.20.193.28:0/3031824130 conn(0x7f22f4078600 msgr2=0x7f22f4079e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 -- 10.20.193.28:0/3031824130 shutdown_connections 2026-02-20T03:18:35.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.603+0000 7f22f9ade640 1 -- 10.20.193.28:0/3031824130 wait complete. 2026-02-20T03:18:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:18:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:35 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/307887376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:18:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:18:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:18:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:35 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:18:35.760 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8846346f', total seconds elapsed: 19.3 2026-02-20T03:18:35.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:18:35.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:35 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/307887376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:18:35.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:18:35.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:18:35.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:35 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:18:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.926+0000 7f2e8b423640 1 -- 10.20.193.28:0/3183656002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8410a9a0 msgr2=0x7f2e8410ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.926+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3183656002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8410a9a0 0x7f2e8410ad80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009a60 tx=0x7f2e7402f290 comp rx=0 tx=0).stop 2026-02-20T03:18:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.926+0000 7f2e8b423640 1 -- 10.20.193.28:0/3183656002 shutdown_connections 2026-02-20T03:18:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.926+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3183656002 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e84105340 0x7f2e84111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.926+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3183656002 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e841049a0 0x7f2e84104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.926+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3183656002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e8410a9a0 0x7f2e8410ad80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.926+0000 7f2e8b423640 1 -- 10.20.193.28:0/3183656002 >> 10.20.193.28:0/3183656002 conn(0x7f2e841006c0 msgr2=0x7f2e84102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.927+0000 7f2e8b423640 1 -- 10.20.193.28:0/3183656002 shutdown_connections 2026-02-20T03:18:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.927+0000 7f2e8b423640 1 -- 10.20.193.28:0/3183656002 wait complete. 2026-02-20T03:18:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.927+0000 7f2e8b423640 1 Processor -- start 2026-02-20T03:18:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.927+0000 7f2e8b423640 1 -- start start 2026-02-20T03:18:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e8b423640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e841049a0 0x7f2e8419d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e8b423640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e84105340 0x7f2e8419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e8b423640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e8410a9a0 0x7f2e841a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e8b423640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84114cf0 con 0x7f2e84105340 2026-02-20T03:18:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e8b423640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84114b70 con 0x7f2e8410a9a0 2026-02-20T03:18:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e8b423640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84114e70 con 0x7f2e841049a0 2026-02-20T03:18:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e89c20640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e84105340 0x7f2e8419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e89c20640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e84105340 0x7f2e8419d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39062/0 (socket says 10.20.193.28:39062) 2026-02-20T03:18:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e89c20640 1 -- 10.20.193.28:0/3946436735 learned_addr learned my addr 10.20.193.28:0/3946436735 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e89c20640 1 -- 10.20.193.28:0/3946436735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e841049a0 msgr2=0x7f2e8419d230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e89c20640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e841049a0 0x7f2e8419d230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e89c20640 1 -- 10.20.193.28:0/3946436735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e8410a9a0 msgr2=0x7f2e841a1b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e89c20640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e8410a9a0 0x7f2e841a1b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e89c20640 1 -- 10.20.193.28:0/3946436735 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e841a2280 con 0x7f2e84105340 2026-02-20T03:18:35.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.928+0000 7f2e89c20640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e84105340 0x7f2e8419d770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800b570 tx=0x7f2e7800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.929+0000 7f2e6b7fe640 1 -- 10.20.193.28:0/3946436735 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78013020 con 0x7f2e84105340 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.929+0000 7f2e6b7fe640 1 -- 10.20.193.28:0/3946436735 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2e78004480 con 0x7f2e84105340 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.929+0000 7f2e6b7fe640 1 -- 10.20.193.28:0/3946436735 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800fb50 con 0x7f2e84105340 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.929+0000 7f2e8b423640 1 -- 10.20.193.28:0/3946436735 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e841a2570 con 0x7f2e84105340 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.929+0000 7f2e8b423640 1 -- 10.20.193.28:0/3946436735 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e841a9db0 con 0x7f2e84105340 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8ebb1e00 1 Processor -- start 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e6b7fe640 1 -- 10.20.193.28:0/3946436735 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2e78002780 con 0x7f2e84105340 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8ebb1e00 1 -- start start 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3cf3fb0 0x5561f3cf4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3ceea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3ceef60 0x5561f3cfade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561f3c6ee00 con 0x5561f3cee5e0 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5561f3c41970 con 0x5561f3cf3fb0 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5561f3bef1f0 con 0x5561f3ceef60 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8a421640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3ceea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8a421640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3ceea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39074/0 (socket says 10.20.193.28:39074) 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.932+0000 7f2e8a421640 1 -- 10.20.193.28:0/2093305228 learned_addr learned my addr 10.20.193.28:0/2093305228 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8a421640 1 -- 10.20.193.28:0/2093305228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3ceef60 msgr2=0x5561f3cfade0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8a421640 1 --2- 10.20.193.28:0/2093305228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3ceef60 0x5561f3cfade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8a421640 1 -- 10.20.193.28:0/2093305228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3cf3fb0 msgr2=0x5561f3cf4390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8a421640 1 --2- 10.20.193.28:0/2093305228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3cf3fb0 0x5561f3cf4390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8a421640 1 -- 10.20.193.28:0/2093305228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f3c023d0 con 0x5561f3cee5e0 2026-02-20T03:18:35.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8a421640 1 --2- 10.20.193.28:0/2093305228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3ceea20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2e74005880 tx=0x7f2e74038470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b81c24fda27d68 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e68cf3640 1 -- 10.20.193.28:0/2093305228 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74002c00 con 0x5561f3cee5e0 2026-02-20T03:18:35.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e68cf3640 1 -- 10.20.193.28:0/2093305228 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2e74033040 con 0x5561f3cee5e0 2026-02-20T03:18:35.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e68cf3640 1 -- 10.20.193.28:0/2093305228 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e74004320 con 0x5561f3cee5e0 2026-02-20T03:18:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/2093305228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 msgr2=0x5561f3ceea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/2093305228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3ceea20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2e74005880 tx=0x7f2e74038470 comp rx=0 tx=0).stop 2026-02-20T03:18:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/2093305228 shutdown_connections 2026-02-20T03:18:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/2093305228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3ceef60 0x5561f3cfade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/2093305228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3ceea20 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/2093305228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3cf3fb0 0x5561f3cf4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/2093305228 >> 10.20.193.28:0/2093305228 conn(0x5561f3cb1240 msgr2=0x5561f3cecce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e6b7fe640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e600b0d80 0x7f2e600b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.933+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/2093305228 shutdown_connections 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.934+0000 7f2e6b7fe640 1 -- 10.20.193.28:0/3946436735 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2e780e0560 con 0x7f2e84105340 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.934+0000 7f2e8a421640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e600b0d80 0x7f2e600b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.934+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/2093305228 wait complete. 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.935+0000 7f2e8ebb1e00 1 -- start start 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.935+0000 7f2e8ebb1e00 1 Processor -- start 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d11800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3ceef60 0x5561f3d11d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3cf3fb0 0x5561f3d0ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561f3c3d8a0 con 0x5561f3cee5e0 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5561f3a2ff50 con 0x5561f3cf3fb0 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5561f3d105b0 con 0x5561f3ceef60 2026-02-20T03:18:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8a421640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e600b0d80 0x7f2e600b3240 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009950 tx=0x7f2e7402ff60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8a421640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d11800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8a421640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d11800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39076/0 (socket says 10.20.193.28:39076) 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8a421640 1 -- 10.20.193.28:0/3697656654 learned_addr learned my addr 10.20.193.28:0/3697656654 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8a421640 1 -- 10.20.193.28:0/3697656654 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3ceef60 msgr2=0x5561f3d11d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8a421640 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3ceef60 0x5561f3d11d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8a421640 1 -- 10.20.193.28:0/3697656654 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3cf3fb0 msgr2=0x5561f3d0ff40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8a421640 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3cf3fb0 0x5561f3d0ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.936+0000 7f2e8a421640 1 -- 10.20.193.28:0/3697656654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f3d09530 con 0x5561f3cee5e0 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e8a421640 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d11800 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2e740042b0 tx=0x7f2e7402f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af997ce0cd47fd5a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e37fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e37fff640 1 -- 10.20.193.28:0/3697656654 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7404f420 con 0x5561f3cee5e0 2026-02-20T03:18:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e37fff640 1 -- 10.20.193.28:0/3697656654 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2e7404fa60 con 0x5561f3cee5e0 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e37fff640 1 -- 10.20.193.28:0/3697656654 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e740428e0 con 0x5561f3cee5e0 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3697656654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f3a12b40 con 0x5561f3cee5e0 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e8ebb1e00 10 client.16209 _ll_register_callbacks cb 0x5561f3c7aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3697656654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561f3c4f150 con 0x5561f3cee5e0 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e37fff640 1 -- 10.20.193.28:0/3697656654 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2e7404f5c0 con 0x5561f3cee5e0 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e37fff640 1 -- 10.20.193.28:0/3697656654 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2e7404f880 con 0x5561f3cee5e0 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e8ebb1e00 10 client.16209 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.937+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3697656654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5561f3bfc1e0 con 0x5561f3cee5e0 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.938+0000 7f2e37fff640 1 -- 10.20.193.28:0/3697656654 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f2e7405f030 con 0x5561f3cee5e0 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.938+0000 7f2e8ebb1e00 10 client.16209 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.938+0000 7f2e8ebb1e00 10 client.16209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:35.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.938+0000 7f2e8ebb1e00 20 client.16209 populate_metadata read hostname 'trial028' 2026-02-20T03:18:35.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.938+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561f3d1fcc0 0x5561f3d220b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:35.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.938+0000 7f2e8ebb1e00 4 client.16209 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:35.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.938+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3697656654 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561f3c49560 con 0x5561f3d1fcc0 2026-02-20T03:18:35.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:35.963+0000 7f2e89c20640 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561f3d1fcc0 0x5561f3d220b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:36.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.016+0000 7f2e89c20640 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561f3d1fcc0 0x5561f3d220b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=863882f03758fe98 server_cookie=676b85c3ea89a8fc in_seq=0 out_seq=0 2026-02-20T03:18:36.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.016+0000 7f2e37fff640 10 client.16209 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:36.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e37fff640 1 -- 10.20.193.28:0/3697656654 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5561f3c49560 con 0x5561f3d1fcc0 2026-02-20T03:18:36.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e37fff640 10 client.16209 handle_command_reply: tid=0 2026-02-20T03:18:36.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 client.16209 shutdown 2026-02-20T03:18:36.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3697656654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 msgr2=0x5561f3d11800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:36.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d11800 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2e740042b0 tx=0x7f2e7402f290 comp rx=0 tx=0).stop 2026-02-20T03:18:36.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3697656654 shutdown_connections 2026-02-20T03:18:36.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561f3d1fcc0 0x5561f3d220b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3cf3fb0 0x5561f3d0ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3ceef60 0x5561f3d11d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3697656654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d11800 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3697656654 >> 10.20.193.28:0/3697656654 conn(0x5561f3cb1240 msgr2=0x5561f3ced3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:36.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e37fff640 0 client.16209 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:36.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3697656654 shutdown_connections 2026-02-20T03:18:36.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.030+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3697656654 wait complete. 2026-02-20T03:18:36.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.043+0000 7f2e8ebb1e00 20 client.16209 trim_cache size 0 max 16384 2026-02-20T03:18:36.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ebb1e00 1 Processor -- start 2026-02-20T03:18:36.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ebb1e00 1 -- start start 2026-02-20T03:18:36.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3cee5e0 0x5561f3d0ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:36.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3ceef60 0x5561f3d0d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:36.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cf3fb0 0x5561f3d0da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:36.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c012750 con 0x5561f3cf3fb0 2026-02-20T03:18:36.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00ffc0 con 0x5561f3ceef60 2026-02-20T03:18:36.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00de10 con 0x5561f3cee5e0 2026-02-20T03:18:36.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ac22640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cf3fb0 0x5561f3d0da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:36.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ac22640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cf3fb0 0x5561f3d0da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54966/0 (socket says 10.20.193.28:54966) 2026-02-20T03:18:36.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.050+0000 7f2e8ac22640 1 -- 10.20.193.28:0/312378414 learned_addr learned my addr 10.20.193.28:0/312378414 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:36.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ac22640 1 -- 10.20.193.28:0/312378414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3cee5e0 msgr2=0x5561f3d0ef10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:36.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ac22640 1 --2- 10.20.193.28:0/312378414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3cee5e0 0x5561f3d0ef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ac22640 1 -- 10.20.193.28:0/312378414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3ceef60 msgr2=0x5561f3d0d530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ac22640 1 --2- 10.20.193.28:0/312378414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3ceef60 0x5561f3d0d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ac22640 1 -- 10.20.193.28:0/312378414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f3d10330 con 0x5561f3cf3fb0 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ac22640 1 --2- 10.20.193.28:0/312378414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cf3fb0 0x5561f3d0da70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009bf0 tx=0x7f2e8000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c32105324d58c57 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e524e6640 1 -- 10.20.193.28:0/312378414 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80017070 con 0x5561f3cf3fb0 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e524e6640 1 -- 10.20.193.28:0/312378414 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2e80009e10 con 0x5561f3cf3fb0 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e524e6640 1 -- 10.20.193.28:0/312378414 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80006e60 con 0x5561f3cf3fb0 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/312378414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cf3fb0 msgr2=0x5561f3d0da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/312378414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cf3fb0 0x5561f3d0da70 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2e80009bf0 tx=0x7f2e8000b420 comp rx=0 tx=0).stop 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/312378414 shutdown_connections 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/312378414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cf3fb0 0x5561f3d0da70 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/312378414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3ceef60 0x5561f3d0d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/312378414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3cee5e0 0x5561f3d0ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/312378414 >> 10.20.193.28:0/312378414 conn(0x5561f3cb1240 msgr2=0x5561f3d0e800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:36.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.051+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/312378414 shutdown_connections 2026-02-20T03:18:36.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.052+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/312378414 wait complete. 2026-02-20T03:18:36.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.052+0000 7f2e8ebb1e00 1 -- start start 2026-02-20T03:18:36.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.052+0000 7f2e8ebb1e00 1 Processor -- start 2026-02-20T03:18:36.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.052+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d17f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:36.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.052+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3ceef60 0x5561f3d14220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8ebb1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3cf3fb0 0x5561f3d14760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00e480 con 0x5561f3cee5e0 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00f8f0 con 0x5561f3ceef60 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8ebb1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2c00eb50 con 0x5561f3cf3fb0 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8a421640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d17f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8a421640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d17f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54980/0 (socket says 10.20.193.28:54980) 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8a421640 1 -- 10.20.193.28:0/3486679256 learned_addr learned my addr 10.20.193.28:0/3486679256 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8a421640 1 -- 10.20.193.28:0/3486679256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3cf3fb0 msgr2=0x5561f3d14760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8a421640 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3cf3fb0 0x5561f3d14760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8a421640 1 -- 10.20.193.28:0/3486679256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3ceef60 msgr2=0x5561f3d14220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:36.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8a421640 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3ceef60 0x5561f3d14220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8a421640 1 -- 10.20.193.28:0/3486679256 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f3d09360 con 0x5561f3cee5e0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8a421640 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d17f50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2e74031000 tx=0x7f2e7402f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbc4e69b491b874 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e37fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e37fff640 1 -- 10.20.193.28:0/3486679256 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e740029f0 con 0x5561f3cee5e0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e37fff640 1 -- 10.20.193.28:0/3486679256 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5561f3c4f150 con 0x5561f3cee5e0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e37fff640 1 -- 10.20.193.28:0/3486679256 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7404d9b0 con 0x5561f3cee5e0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.053+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3486679256 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f3920870 con 0x5561f3cee5e0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e37fff640 1 -- 10.20.193.28:0/3486679256 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2e74042660 con 0x5561f3cee5e0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 10 client.16215 _ll_register_callbacks cb 0x7f2e740057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3486679256 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e74033040 con 0x5561f3cee5e0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e37fff640 1 -- 10.20.193.28:0/3486679256 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2e7406f060 con 0x5561f3cee5e0 2026-02-20T03:18:36.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 10 client.16215 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:36.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3486679256 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5561f3be13f0 con 0x5561f3cee5e0 2026-02-20T03:18:36.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e37fff640 1 -- 10.20.193.28:0/3486679256 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f2e7405f040 con 0x5561f3cee5e0 2026-02-20T03:18:36.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 10 client.16215 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:36.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:36.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 20 client.16215 populate_metadata read hostname 'trial028' 2026-02-20T03:18:36.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561f3d8bb60 0x5561f3d8e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:36.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 4 client.16215 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:18:36.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.054+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3486679256 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561f3c127c0 con 0x5561f3d8bb60 2026-02-20T03:18:36.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.070+0000 7f2e89c20640 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561f3d8bb60 0x5561f3d8e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:36.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.110+0000 7f2e89c20640 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561f3d8bb60 0x5561f3d8e020 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf5e16a316cb5950 server_cookie=7104ef8e320463a in_seq=0 out_seq=0 2026-02-20T03:18:36.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.110+0000 7f2e37fff640 10 client.16215 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:36.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e37fff640 1 -- 10.20.193.28:0/3486679256 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561f3c127c0 con 0x5561f3d8bb60 2026-02-20T03:18:36.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e37fff640 10 client.16215 handle_command_reply: tid=0 2026-02-20T03:18:36.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 client.16215 shutdown 2026-02-20T03:18:36.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3486679256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 msgr2=0x5561f3d17f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:36.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d17f50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2e74031000 tx=0x7f2e7402f920 comp rx=0 tx=0).stop 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3486679256 shutdown_connections 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561f3d8bb60 0x5561f3d8e020 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561f3cf3fb0 0x5561f3d14760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561f3ceef60 0x5561f3d14220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 --2- 10.20.193.28:0/3486679256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561f3cee5e0 0x5561f3d17f50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3486679256 >> 10.20.193.28:0/3486679256 conn(0x5561f3cb1240 msgr2=0x5561f3d0f020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e37fff640 0 client.16215 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3486679256 shutdown_connections 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 1 -- 10.20.193.28:0/3486679256 wait complete. 2026-02-20T03:18:36.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.124+0000 7f2e8ebb1e00 20 client.16215 trim_cache size 0 max 16384 2026-02-20T03:18:36.139 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 -- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e600b0d80 msgr2=0x7f2e600b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e600b0d80 0x7f2e600b3240 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2e74009950 tx=0x7f2e7402ff60 comp rx=0 tx=0).stop 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 -- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e84105340 msgr2=0x7f2e8419d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e84105340 0x7f2e8419d770 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800b570 tx=0x7f2e7800ba40 comp rx=0 tx=0).stop 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 -- 10.20.193.28:0/3946436735 shutdown_connections 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2e600b0d80 0x7f2e600b3240 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e8410a9a0 0x7f2e841a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e84105340 0x7f2e8419d770 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 --2- 10.20.193.28:0/3946436735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e841049a0 0x7f2e8419d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 -- 10.20.193.28:0/3946436735 >> 10.20.193.28:0/3946436735 conn(0x7f2e841006c0 msgr2=0x7f2e84101050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 -- 10.20.193.28:0/3946436735 shutdown_connections 2026-02-20T03:18:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:36.125+0000 7f2e8b423640 1 -- 10.20.193.28:0/3946436735 wait complete. 2026-02-20T03:18:36.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 301660 0.00 MB/sec execute 9 sec latency 17559.356 ms 2026-02-20T03:18:36.512 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:36 trial028 ceph-mon[38552]: pgmap v299: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 188 KiB/s rd, 3.3 MiB/s wr, 201 op/s 2026-02-20T03:18:36.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:36 trial126 ceph-mon[38476]: pgmap v299: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 188 KiB/s rd, 3.3 MiB/s wr, 201 op/s 2026-02-20T03:18:36.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:36 trial177 ceph-mon[43181]: pgmap v299: 129 pgs: 129 active+clean; 68 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 188 KiB/s rd, 3.3 MiB/s wr, 201 op/s 2026-02-20T03:18:37.298 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:18:37.299 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:18:37.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 304405 1.27 MB/sec execute 10 sec latency 17772.759 ms 2026-02-20T03:18:37.582 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.774+0000 7f3c35871640 1 -- 10.20.193.28:0/798205812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109ba0 msgr2=0x7f3c30115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.774+0000 7f3c35871640 1 --2- 10.20.193.28:0/798205812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109ba0 0x7f3c30115d10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c00b0a0 tx=0x7f3c2c02f410 comp rx=0 tx=0).stop 2026-02-20T03:18:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.774+0000 7f3c35871640 1 -- 10.20.193.28:0/798205812 shutdown_connections 2026-02-20T03:18:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.774+0000 7f3c35871640 1 --2- 10.20.193.28:0/798205812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109ba0 0x7f3c30115d10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.774+0000 7f3c35871640 1 --2- 10.20.193.28:0/798205812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c30109220 0x7f3c30109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.774+0000 7f3c35871640 1 --2- 10.20.193.28:0/798205812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c3010eef0 0x7f3c3010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.774+0000 7f3c35871640 1 -- 10.20.193.28:0/798205812 >> 10.20.193.28:0/798205812 conn(0x7f3c30078600 msgr2=0x7f3c3007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.774+0000 7f3c35871640 1 -- 10.20.193.28:0/798205812 shutdown_connections 2026-02-20T03:18:37.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.774+0000 7f3c35871640 1 -- 10.20.193.28:0/798205812 wait complete. 2026-02-20T03:18:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c35871640 1 Processor -- start 2026-02-20T03:18:37.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c35871640 1 -- start start 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c35871640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109220 0x7f3c301a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c35871640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c30109ba0 0x7f3c301a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c35871640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c3010eef0 0x7f3c301a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c35871640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3c30119090 con 0x7f3c30109220 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c35871640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3c30118f10 con 0x7f3c30109ba0 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c35871640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3c30119210 con 0x7f3c3010eef0 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c3486f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109220 0x7f3c301a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c3486f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109220 0x7f3c301a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54996/0 (socket says 10.20.193.28:54996) 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c3486f640 1 -- 10.20.193.28:0/2573018052 learned_addr learned my addr 10.20.193.28:0/2573018052 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c27fff640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c30109ba0 0x7f3c301a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.775+0000 7f3c35070640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c3010eef0 0x7f3c301a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c3486f640 1 -- 10.20.193.28:0/2573018052 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c3010eef0 msgr2=0x7f3c301a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c3486f640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c3010eef0 0x7f3c301a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c3486f640 1 -- 10.20.193.28:0/2573018052 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c30109ba0 msgr2=0x7f3c301a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c3486f640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c30109ba0 0x7f3c301a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c3486f640 1 -- 10.20.193.28:0/2573018052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c301a65a0 con 0x7f3c30109220 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c27fff640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c30109ba0 0x7f3c301a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c3486f640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109220 0x7f3c301a1550 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000d950 tx=0x7f3c2000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c25ffb640 1 -- 10.20.193.28:0/2573018052 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20014070 con 0x7f3c30109220 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c25ffb640 1 -- 10.20.193.28:0/2573018052 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3c200044e0 con 0x7f3c30109220 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c35871640 1 -- 10.20.193.28:0/2573018052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c301a6890 con 0x7f3c30109220 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c25ffb640 1 -- 10.20.193.28:0/2573018052 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20010460 con 0x7f3c30109220 2026-02-20T03:18:37.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.776+0000 7f3c35871640 1 -- 10.20.193.28:0/2573018052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c301ae0d0 con 0x7f3c30109220 2026-02-20T03:18:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.779+0000 7f3c25ffb640 1 -- 10.20.193.28:0/2573018052 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3c200026e0 con 0x7f3c30109220 2026-02-20T03:18:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.779+0000 7f3c38fffe00 1 Processor -- start 2026-02-20T03:18:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.779+0000 7f3c38fffe00 1 -- start start 2026-02-20T03:18:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a8b60 0x55af642a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55af641f6c00 con 0x55af642a40c0 2026-02-20T03:18:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55af641a43c0 con 0x55af642a4a70 2026-02-20T03:18:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55af641f2b30 con 0x55af642a8b60 2026-02-20T03:18:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c35070640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c35070640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642a44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55006/0 (socket says 10.20.193.28:55006) 2026-02-20T03:18:37.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c35070640 1 -- 10.20.193.28:0/244021714 learned_addr learned my addr 10.20.193.28:0/244021714 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:37.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c35070640 1 -- 10.20.193.28:0/244021714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a8b60 msgr2=0x55af642a8fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:37.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c35070640 1 --2- 10.20.193.28:0/244021714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a8b60 0x55af642a8fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c3486f640 1 --2- 10.20.193.28:0/244021714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c35070640 1 -- 10.20.193.28:0/244021714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 msgr2=0x55af642a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:37.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c35070640 1 --2- 10.20.193.28:0/244021714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c35070640 1 -- 10.20.193.28:0/244021714 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af6419d840 con 0x55af642a40c0 2026-02-20T03:18:37.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c3486f640 1 --2- 10.20.193.28:0/244021714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c25ffb640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c0c0b0e20 0x7f3c0c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c35070640 1 --2- 10.20.193.28:0/244021714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642a44a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c005c30 tx=0x7f3c2c0096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7881f59156653c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.780+0000 7f3c25ffb640 1 -- 10.20.193.28:0/2573018052 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3c200e0ce0 con 0x7f3c30109220 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3bfd4e4640 1 -- 10.20.193.28:0/244021714 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0040c0 con 0x55af642a40c0 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c3486f640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c0c0b0e20 0x7f3c0c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3bfd4e4640 1 -- 10.20.193.28:0/244021714 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3c2c033050 con 0x55af642a40c0 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3bfd4e4640 1 -- 10.20.193.28:0/244021714 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c004750 con 0x55af642a40c0 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c38fffe00 1 -- 10.20.193.28:0/244021714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 msgr2=0x55af642a44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/244021714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642a44a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c005c30 tx=0x7f3c2c0096e0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c3486f640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c0c0b0e20 0x7f3c0c0b32e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c20002410 tx=0x7f3c20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c38fffe00 1 -- 10.20.193.28:0/244021714 shutdown_connections 2026-02-20T03:18:37.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/244021714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a8b60 0x55af642a8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/244021714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/244021714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642a44a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c38fffe00 1 -- 10.20.193.28:0/244021714 >> 10.20.193.28:0/244021714 conn(0x55af6429cb60 msgr2=0x55af642a25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:37.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c38fffe00 1 -- 10.20.193.28:0/244021714 shutdown_connections 2026-02-20T03:18:37.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.781+0000 7f3c38fffe00 1 -- 10.20.193.28:0/244021714 wait complete. 2026-02-20T03:18:37.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.782+0000 7f3c38fffe00 1 -- start start 2026-02-20T03:18:37.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c38fffe00 1 Processor -- start 2026-02-20T03:18:37.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 0x55af642c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55af6419e1a0 con 0x55af642a8b60 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55af642b0cb0 con 0x55af642a40c0 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55af642c8ed0 con 0x55af642a4a70 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c27fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c27fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642bd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36512/0 (socket says 10.20.193.28:36512) 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c27fff640 1 -- 10.20.193.28:0/2209989074 learned_addr learned my addr 10.20.193.28:0/2209989074 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.783+0000 7f3c35070640 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3c35070640 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 0x55af642c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3c27fff640 1 -- 10.20.193.28:0/2209989074 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 msgr2=0x55af642bcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3c27fff640 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642bcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3c27fff640 1 -- 10.20.193.28:0/2209989074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 msgr2=0x55af642c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:37.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3c27fff640 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 0x55af642c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3c27fff640 1 -- 10.20.193.28:0/2209989074 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af642b6490 con 0x55af642a4a70 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3c35070640 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 0x55af642c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3c27fff640 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642bd2b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3c18002bb0 tx=0x7f3c1800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f0cd16468dc4c3c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3bee7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3bee7fc640 1 -- 10.20.193.28:0/2209989074 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18011640 con 0x55af642a4a70 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3bee7fc640 1 -- 10.20.193.28:0/2209989074 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3c18011c80 con 0x55af642a4a70 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3bee7fc640 1 -- 10.20.193.28:0/2209989074 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18019c20 con 0x55af642a4a70 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.784+0000 7f3c38fffe00 1 -- 10.20.193.28:0/2209989074 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af63fc5b60 con 0x55af642a4a70 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3bee7fc640 1 -- 10.20.193.28:0/2209989074 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3c180103d0 con 0x55af642a4a70 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 10 client.26008 _ll_register_callbacks cb 0x55af641a20d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 1 -- 10.20.193.28:0/2209989074 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af641fe7f0 con 0x55af642a4a70 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3bee7fc640 1 -- 10.20.193.28:0/2209989074 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3c18019400 con 0x55af642a4a70 2026-02-20T03:18:37.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 10 client.26008 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 1 -- 10.20.193.28:0/2209989074 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55af641c3430 con 0x55af642a4a70 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3bee7fc640 1 -- 10.20.193.28:0/2209989074 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3c18021030 con 0x55af642a4a70 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 10 client.26008 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 10 client.26008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 20 client.26008 populate_metadata read hostname 'trial028' 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af642cd280 0x55af642cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 4 client.26008 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.785+0000 7f3c38fffe00 1 -- 10.20.193.28:0/2209989074 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af64178c00 con 0x55af642cd280 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.786+0000 7f3c35070640 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af642cd280 0x55af642cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.786+0000 7f3c35070640 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af642cd280 0x55af642cf740 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c186902d4cb00b01 server_cookie=cb379b2032779830 in_seq=0 out_seq=0 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.786+0000 7f3bee7fc640 10 client.26008 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:37.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.787+0000 7f3bee7fc640 1 -- 10.20.193.28:0/2209989074 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55af64178c00 con 0x55af642cd280 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.787+0000 7f3bee7fc640 10 client.26008 handle_command_reply: tid=0 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.787+0000 7f3c38fffe00 1 client.26008 shutdown 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.787+0000 7f3c38fffe00 1 -- 10.20.193.28:0/2209989074 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 msgr2=0x55af642bd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.787+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642bd2b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3c18002bb0 tx=0x7f3c1800f730 comp rx=0 tx=0).stop 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3c38fffe00 1 -- 10.20.193.28:0/2209989074 shutdown_connections 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af642cd280 0x55af642cf740 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 0x55af642c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642bd2b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/2209989074 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642bcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3c38fffe00 1 -- 10.20.193.28:0/2209989074 >> 10.20.193.28:0/2209989074 conn(0x55af6429cb60 msgr2=0x55af642a7520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3bee7fc640 0 client.26008 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3c38fffe00 1 -- 10.20.193.28:0/2209989074 shutdown_connections 2026-02-20T03:18:37.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3c38fffe00 1 -- 10.20.193.28:0/2209989074 wait complete. 2026-02-20T03:18:37.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.788+0000 7f3c38fffe00 20 client.26008 trim_cache size 0 max 16384 2026-02-20T03:18:37.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c38fffe00 1 Processor -- start 2026-02-20T03:18:37.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c38fffe00 1 -- start start 2026-02-20T03:18:37.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642d5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642d5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a8b60 0x55af642c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd40126d0 con 0x55af642a40c0 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd400ff40 con 0x55af642a4a70 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd400dd90 con 0x55af642a8b60 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c27fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642d5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c35070640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642d5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c27fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642d5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53308/0 (socket says 10.20.193.28:53308) 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c27fff640 1 -- 10.20.193.28:0/4237400351 learned_addr learned my addr 10.20.193.28:0/4237400351 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c35070640 1 --2- 10.20.193.28:0/4237400351 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a8b60 0x55af642c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c35070640 1 -- 10.20.193.28:0/4237400351 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a8b60 msgr2=0x55af642c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c35070640 1 --2- 10.20.193.28:0/4237400351 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a8b60 0x55af642c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c35070640 1 -- 10.20.193.28:0/4237400351 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 msgr2=0x55af642d5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:37.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.797+0000 7f3c35070640 1 --2- 10.20.193.28:0/4237400351 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642d5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3c35070640 1 -- 10.20.193.28:0/4237400351 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af642b62c0 con 0x55af642a40c0 2026-02-20T03:18:37.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3c35070640 1 --2- 10.20.193.28:0/4237400351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642d5050 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c02f920 tx=0x7f3c2c03a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7707b139581993 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:37.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3bfcce3640 1 -- 10.20.193.28:0/4237400351 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c046040 con 0x55af642a40c0 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3bfcce3640 1 -- 10.20.193.28:0/4237400351 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3c2c047040 con 0x55af642a40c0 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3bfcce3640 1 -- 10.20.193.28:0/4237400351 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c007900 con 0x55af642a40c0 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3c38fffe00 1 -- 10.20.193.28:0/4237400351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 msgr2=0x55af642d5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/4237400351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642d5050 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c02f920 tx=0x7f3c2c03a040 comp rx=0 tx=0).stop 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3c38fffe00 1 -- 10.20.193.28:0/4237400351 shutdown_connections 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/4237400351 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a8b60 0x55af642c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/4237400351 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a4a70 0x55af642d5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/4237400351 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a40c0 0x55af642d5050 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.798+0000 7f3c38fffe00 1 -- 10.20.193.28:0/4237400351 >> 10.20.193.28:0/4237400351 conn(0x55af6429cb60 msgr2=0x55af642a8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.799+0000 7f3c38fffe00 1 -- 10.20.193.28:0/4237400351 shutdown_connections 2026-02-20T03:18:37.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.799+0000 7f3c38fffe00 1 -- 10.20.193.28:0/4237400351 wait complete. 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.799+0000 7f3c38fffe00 1 -- start start 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.799+0000 7f3c38fffe00 1 Processor -- start 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c38fffe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 0x55af64338240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd400e400 con 0x55af642a8b60 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd400f870 con 0x55af642a40c0 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c38fffe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd400ead0 con 0x55af642a4a70 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c27fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642c2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53316/0 (socket says 10.20.193.28:53316) 2026-02-20T03:18:37.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 -- 10.20.193.28:0/327753376 learned_addr learned my addr 10.20.193.28:0/327753376 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 0x55af64338240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 -- 10.20.193.28:0/327753376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 msgr2=0x55af642c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 -- 10.20.193.28:0/327753376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 msgr2=0x55af64338240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 0x55af64338240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 -- 10.20.193.28:0/327753376 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af63ed5900 con 0x55af642a40c0 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c27fff640 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3c35070640 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642c2f40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c004a90 tx=0x7f3c2c002750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90d6db4f50577398 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.800+0000 7f3bee7fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3bee7fc640 1 -- 10.20.193.28:0/327753376 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c046040 con 0x55af642a40c0 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3bee7fc640 1 -- 10.20.193.28:0/327753376 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3c2c0029d0 con 0x55af642a40c0 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3c38fffe00 1 -- 10.20.193.28:0/327753376 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af641b14d0 con 0x55af642a40c0 2026-02-20T03:18:37.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3c38fffe00 10 client.26009 _ll_register_callbacks cb 0x7f3c180027c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3c38fffe00 1 -- 10.20.193.28:0/327753376 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c2c033050 con 0x55af642a40c0 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3bee7fc640 1 -- 10.20.193.28:0/327753376 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0090c0 con 0x55af642a40c0 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3bee7fc640 1 -- 10.20.193.28:0/327753376 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3c2c009260 con 0x55af642a40c0 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3bee7fc640 1 -- 10.20.193.28:0/327753376 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3c2c068060 con 0x55af642a40c0 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3c38fffe00 10 client.26009 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.801+0000 7f3c38fffe00 1 -- 10.20.193.28:0/327753376 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55af642b6fb0 con 0x55af642a40c0 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3bee7fc640 1 -- 10.20.193.28:0/327753376 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f3c2c06b050 con 0x55af642a40c0 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3c38fffe00 10 client.26009 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3c38fffe00 10 client.26009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3c38fffe00 20 client.26009 populate_metadata read hostname 'trial028' 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af64339700 0x55af6433bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:37.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3c38fffe00 4 client.26009 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:18:37.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3c38fffe00 1 -- 10.20.193.28:0/327753376 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55af63f772b0 con 0x55af64339700 2026-02-20T03:18:37.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3c27fff640 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af64339700 0x55af6433bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3c27fff640 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af64339700 0x55af6433bb90 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73caeb86cf2fe90b server_cookie=3f5faea34806ea11 in_seq=0 out_seq=0 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.802+0000 7f3bee7fc640 10 client.26009 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3bee7fc640 1 -- 10.20.193.28:0/327753376 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55af63f772b0 con 0x55af64339700 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3bee7fc640 10 client.26009 handle_command_reply: tid=0 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 client.26009 shutdown 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 -- 10.20.193.28:0/327753376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 msgr2=0x55af642c2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642c2f40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c004a90 tx=0x7f3c2c002750 comp rx=0 tx=0).stop 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 -- 10.20.193.28:0/327753376 shutdown_connections 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af64339700 0x55af6433bb90 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af642a8b60 0x55af64338240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af642a4a70 0x55af642c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 --2- 10.20.193.28:0/327753376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af642a40c0 0x55af642c2f40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3bee7fc640 0 client.26009 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:37.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 -- 10.20.193.28:0/327753376 >> 10.20.193.28:0/327753376 conn(0x55af6429cb60 msgr2=0x55af642a9760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:37.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 -- 10.20.193.28:0/327753376 shutdown_connections 2026-02-20T03:18:37.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 1 -- 10.20.193.28:0/327753376 wait complete. 2026-02-20T03:18:37.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.803+0000 7f3c38fffe00 20 client.26009 trim_cache size 0 max 16384 2026-02-20T03:18:37.811 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:18:37.812 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:18:37.812 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "08d4ffc1-efce-486d-b29b-33596a3c57db", 2026-02-20T03:18:37.812 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:18:37.812 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:18:37.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 -- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c0c0b0e20 msgr2=0x7f3c0c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:37.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c0c0b0e20 0x7f3c0c0b32e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c20002410 tx=0x7f3c20005f90 comp rx=0 tx=0).stop 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 -- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109220 msgr2=0x7f3c301a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109220 0x7f3c301a1550 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000d950 tx=0x7f3c2000de20 comp rx=0 tx=0).stop 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 -- 10.20.193.28:0/2573018052 shutdown_connections 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c0c0b0e20 0x7f3c0c0b32e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c3010eef0 0x7f3c301a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c30109ba0 0x7f3c301a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 --2- 10.20.193.28:0/2573018052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c30109220 0x7f3c301a1550 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 -- 10.20.193.28:0/2573018052 >> 10.20.193.28:0/2573018052 conn(0x7f3c30078600 msgr2=0x7f3c30079d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 -- 10.20.193.28:0/2573018052 shutdown_connections 2026-02-20T03:18:37.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:37.804+0000 7f3c35871640 1 -- 10.20.193.28:0/2573018052 wait complete. 2026-02-20T03:18:37.953 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:18:38.252 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:18:38.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.495+0000 7f472ca24640 1 -- 10.20.193.28:0/1583951536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810b6e0 msgr2=0x7f472810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:38.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.495+0000 7f472ca24640 1 --2- 10.20.193.28:0/1583951536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810b6e0 0x7f472810bac0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f471c009a30 tx=0x7f471c02f260 comp rx=0 tx=0).stop 2026-02-20T03:18:38.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.495+0000 7f472ca24640 1 -- 10.20.193.28:0/1583951536 shutdown_connections 2026-02-20T03:18:38.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.495+0000 7f472ca24640 1 --2- 10.20.193.28:0/1583951536 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f47281104c0 0x7f4728118000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.495+0000 7f472ca24640 1 --2- 10.20.193.28:0/1583951536 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f472810c090 0x7f472810fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.495+0000 7f472ca24640 1 --2- 10.20.193.28:0/1583951536 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810b6e0 0x7f472810bac0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.495+0000 7f472ca24640 1 -- 10.20.193.28:0/1583951536 >> 10.20.193.28:0/1583951536 conn(0x7f4728071f80 msgr2=0x7f47280743a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:38.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.495+0000 7f472ca24640 1 -- 10.20.193.28:0/1583951536 shutdown_connections 2026-02-20T03:18:38.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.495+0000 7f472ca24640 1 -- 10.20.193.28:0/1583951536 wait complete. 2026-02-20T03:18:38.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f472ca24640 1 Processor -- start 2026-02-20T03:18:38.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f472ca24640 1 -- start start 2026-02-20T03:18:38.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f472ca24640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f472810b6e0 0x7f47281a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f472ca24640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810c090 0x7f47281a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f472ca24640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f47281104c0 0x7f47281a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f472ca24640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f472811b430 con 0x7f472810c090 2026-02-20T03:18:38.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f472ca24640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f472811b2b0 con 0x7f47281104c0 2026-02-20T03:18:38.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f472ca24640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f472811b5b0 con 0x7f472810b6e0 2026-02-20T03:18:38.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f4726575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810c090 0x7f47281a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:38.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f4726575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810c090 0x7f47281a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55040/0 (socket says 10.20.193.28:55040) 2026-02-20T03:18:38.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f4726575640 1 -- 10.20.193.28:0/3079022991 learned_addr learned my addr 10.20.193.28:0/3079022991 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:38.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f4726575640 1 -- 10.20.193.28:0/3079022991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f472810b6e0 msgr2=0x7f47281a9580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:38.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f4726575640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f472810b6e0 0x7f47281a9580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f4726575640 1 -- 10.20.193.28:0/3079022991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f47281104c0 msgr2=0x7f47281a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:38.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f4726575640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f47281104c0 0x7f47281a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.496+0000 7f4726575640 1 -- 10.20.193.28:0/3079022991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47281a3ee0 con 0x7f472810c090 2026-02-20T03:18:38.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.497+0000 7f4726575640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810c090 0x7f47281a9ac0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4710009a70 tx=0x7f4710009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:38.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.497+0000 7f46fffff640 1 -- 10.20.193.28:0/3079022991 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471000f460 con 0x7f472810c090 2026-02-20T03:18:38.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.497+0000 7f46fffff640 1 -- 10.20.193.28:0/3079022991 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4710014030 con 0x7f472810c090 2026-02-20T03:18:38.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.497+0000 7f46fffff640 1 -- 10.20.193.28:0/3079022991 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100029e0 con 0x7f472810c090 2026-02-20T03:18:38.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.497+0000 7f472ca24640 1 -- 10.20.193.28:0/3079022991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47281a4170 con 0x7f472810c090 2026-02-20T03:18:38.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.497+0000 7f472ca24640 1 -- 10.20.193.28:0/3079022991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f472806c450 con 0x7f472810c090 2026-02-20T03:18:38.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 305452 1.86 MB/sec execute 11 sec latency 669.458 ms 2026-02-20T03:18:38.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.500+0000 7f46fffff640 1 -- 10.20.193.28:0/3079022991 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4710010870 con 0x7f472810c090 2026-02-20T03:18:38.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f472f72ae00 1 Processor -- start 2026-02-20T03:18:38.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f472f72ae00 1 -- start start 2026-02-20T03:18:38.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088198000 0x55a0881983e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088192630 0x55a088192a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192fb0 0x55a08819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f472f72ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a088112e50 con 0x55a088192630 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f472f72ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a0880e59c0 con 0x55a088192fb0 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f472f72ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a088093240 con 0x55a088198000 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f4726d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088192630 0x55a088192a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f46fffff640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46f80b0e20 0x7f46f80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f4726d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088192630 0x55a088192a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55046/0 (socket says 10.20.193.28:55046) 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f4726d76640 1 -- 10.20.193.28:0/3395223586 learned_addr learned my addr 10.20.193.28:0/3395223586 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.501+0000 7f46fffff640 1 -- 10.20.193.28:0/3079022991 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f47100e4070 con 0x7f472810c090 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f4726d76640 1 -- 10.20.193.28:0/3395223586 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088198000 msgr2=0x55a0881983e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f4726d76640 1 --2- 10.20.193.28:0/3395223586 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088198000 0x55a0881983e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f4727577640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46f80b0e20 0x7f46f80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:38.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f4726d76640 1 -- 10.20.193.28:0/3395223586 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192fb0 msgr2=0x55a08819ee30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f4726d76640 1 --2- 10.20.193.28:0/3395223586 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192fb0 0x55a08819ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f4726d76640 1 -- 10.20.193.28:0/3395223586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0880a6420 con 0x55a088192630 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f4726d76640 1 --2- 10.20.193.28:0/3395223586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088192630 0x55a088192a70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f471c032040 tx=0x7f471c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71df7fa4491a6ef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f4727577640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46f80b0e20 0x7f46f80b32e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4718007be0 tx=0x7f47180071c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f46ff7fe640 1 -- 10.20.193.28:0/3395223586 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c002c30 con 0x55a088192630 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f46ff7fe640 1 -- 10.20.193.28:0/3395223586 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f471c033040 con 0x55a088192630 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f46ff7fe640 1 -- 10.20.193.28:0/3395223586 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c004340 con 0x55a088192630 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f472f72ae00 1 -- 10.20.193.28:0/3395223586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088192630 msgr2=0x55a088192a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.502+0000 7f472f72ae00 1 --2- 10.20.193.28:0/3395223586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088192630 0x55a088192a70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f471c032040 tx=0x7f471c005880 comp rx=0 tx=0).stop 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.503+0000 7f472f72ae00 1 -- 10.20.193.28:0/3395223586 shutdown_connections 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.503+0000 7f472f72ae00 1 --2- 10.20.193.28:0/3395223586 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192fb0 0x55a08819ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.503+0000 7f472f72ae00 1 --2- 10.20.193.28:0/3395223586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088192630 0x55a088192a70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.503+0000 7f472f72ae00 1 --2- 10.20.193.28:0/3395223586 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088198000 0x55a0881983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.503+0000 7f472f72ae00 1 -- 10.20.193.28:0/3395223586 >> 10.20.193.28:0/3395223586 conn(0x55a088155290 msgr2=0x55a088190d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.503+0000 7f472f72ae00 1 -- 10.20.193.28:0/3395223586 shutdown_connections 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.503+0000 7f472f72ae00 1 -- 10.20.193.28:0/3395223586 wait complete. 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.504+0000 7f472f72ae00 1 -- start start 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.504+0000 7f472f72ae00 1 Processor -- start 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192630 0x55a0881b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192fb0 0x55a0881b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f472f72ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0880e18f0 con 0x55a088198000 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f472f72ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a087ed3f50 con 0x55a088192fb0 2026-02-20T03:18:38.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f472f72ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a0881b4330 con 0x55a088192630 2026-02-20T03:18:38.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f4727577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:38.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f4727577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55058/0 (socket says 10.20.193.28:55058) 2026-02-20T03:18:38.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f4727577640 1 -- 10.20.193.28:0/145283474 learned_addr learned my addr 10.20.193.28:0/145283474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:38.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f4727577640 1 -- 10.20.193.28:0/145283474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192630 msgr2=0x55a0881b5540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f4727577640 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192630 0x55a0881b5540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f4727577640 1 -- 10.20.193.28:0/145283474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192fb0 msgr2=0x55a0881b5a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f4727577640 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192fb0 0x55a0881b5a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f4727577640 1 -- 10.20.193.28:0/145283474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0881ad490 con 0x55a088198000 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.505+0000 7f4727577640 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b3cf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4718016720 tx=0x7f4718004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae336a54aa84fd3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f46fcff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f46fcff9640 1 -- 10.20.193.28:0/145283474 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471800e040 con 0x55a088198000 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f46fcff9640 1 -- 10.20.193.28:0/145283474 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4718004a70 con 0x55a088198000 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f472f72ae00 1 -- 10.20.193.28:0/145283474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a087eb6b40 con 0x55a088198000 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f46fcff9640 1 -- 10.20.193.28:0/145283474 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718012ae0 con 0x55a088198000 2026-02-20T03:18:38.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f472f72ae00 10 client.16242 _ll_register_callbacks cb 0x55a08811ef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:38.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f472f72ae00 1 -- 10.20.193.28:0/145283474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0880f31a0 con 0x55a088198000 2026-02-20T03:18:38.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f46fcff9640 1 -- 10.20.193.28:0/145283474 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f4718012c80 con 0x55a088198000 2026-02-20T03:18:38.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f46fcff9640 1 -- 10.20.193.28:0/145283474 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4718014450 con 0x55a088198000 2026-02-20T03:18:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f472f72ae00 10 client.16242 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f472f72ae00 1 -- 10.20.193.28:0/145283474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a0880a0230 con 0x55a088198000 2026-02-20T03:18:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f46fcff9640 1 -- 10.20.193.28:0/145283474 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f4718029030 con 0x55a088198000 2026-02-20T03:18:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f472f72ae00 10 client.16242 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:38.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f472f72ae00 10 client.16242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:38.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f472f72ae00 20 client.16242 populate_metadata read hostname 'trial028' 2026-02-20T03:18:38.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.506+0000 7f472f72ae00 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0881c3e20 0x55a0881c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.507+0000 7f472f72ae00 4 client.16242 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:38.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.507+0000 7f472f72ae00 1 -- 10.20.193.28:0/145283474 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0880ed5b0 con 0x55a0881c3e20 2026-02-20T03:18:38.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.517+0000 7f4726d76640 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0881c3e20 0x55a0881c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:38.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.559+0000 7f4726d76640 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0881c3e20 0x55a0881c62c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cc4687bd23e0701 server_cookie=b8ebc2c698d4abc0 in_seq=0 out_seq=0 2026-02-20T03:18:38.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.560+0000 7f46fcff9640 10 client.16242 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:38.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.573+0000 7f46fcff9640 1 -- 10.20.193.28:0/145283474 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a0880ed5b0 con 0x55a0881c3e20 2026-02-20T03:18:38.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.573+0000 7f46fcff9640 10 client.16242 handle_command_reply: tid=0 2026-02-20T03:18:38.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.573+0000 7f472f72ae00 1 client.16242 shutdown 2026-02-20T03:18:38.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 -- 10.20.193.28:0/145283474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 msgr2=0x55a0881b3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:38.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b3cf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4718016720 tx=0x7f4718004cf0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 -- 10.20.193.28:0/145283474 shutdown_connections 2026-02-20T03:18:38.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0881c3e20 0x55a0881c62c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b3cf0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192fb0 0x55a0881b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 --2- 10.20.193.28:0/145283474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192630 0x55a0881b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f46fcff9640 0 client.16242 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:38.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 -- 10.20.193.28:0/145283474 >> 10.20.193.28:0/145283474 conn(0x55a088155290 msgr2=0x55a088191440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:38.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 -- 10.20.193.28:0/145283474 shutdown_connections 2026-02-20T03:18:38.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.574+0000 7f472f72ae00 1 -- 10.20.193.28:0/145283474 wait complete. 2026-02-20T03:18:38.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.575+0000 7f472f72ae00 20 client.16242 trim_cache size 0 max 16384 2026-02-20T03:18:38.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.584+0000 7f472f72ae00 1 Processor -- start 2026-02-20T03:18:38.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f472f72ae00 1 -- start start 2026-02-20T03:18:38.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192630 0x55a0881b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192fb0 0x55a0881b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a088191520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f472f72ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00127d0 con 0x55a088198000 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f472f72ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f46d0010040 con 0x55a088192630 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f472f72ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f46d000de90 con 0x55a088192fb0 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f4727577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a088191520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f4727577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a088191520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55066/0 (socket says 10.20.193.28:55066) 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f4727577640 1 -- 10.20.193.28:0/1344070053 learned_addr learned my addr 10.20.193.28:0/1344070053 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f4727577640 1 -- 10.20.193.28:0/1344070053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192fb0 msgr2=0x55a0881b5a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f4727577640 1 --2- 10.20.193.28:0/1344070053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192fb0 0x55a0881b5a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f4727577640 1 -- 10.20.193.28:0/1344070053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192630 msgr2=0x55a0881b5540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f4727577640 1 --2- 10.20.193.28:0/1344070053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192630 0x55a0881b5540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.585+0000 7f4727577640 1 -- 10.20.193.28:0/1344070053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0881ad2c0 con 0x55a088198000 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.586+0000 7f4727577640 1 --2- 10.20.193.28:0/1344070053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a088191520 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4718008030 tx=0x7f4718025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da4d7788beaab0b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.586+0000 7f46feffd640 1 -- 10.20.193.28:0/1344070053 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471800e070 con 0x55a088198000 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.586+0000 7f46feffd640 1 -- 10.20.193.28:0/1344070053 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55a0880f31a0 con 0x55a088198000 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.586+0000 7f46feffd640 1 -- 10.20.193.28:0/1344070053 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180047b0 con 0x55a088198000 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.586+0000 7f472f72ae00 1 -- 10.20.193.28:0/1344070053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 msgr2=0x55a088191520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.586+0000 7f472f72ae00 1 --2- 10.20.193.28:0/1344070053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a088191520 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4718008030 tx=0x7f4718025000 comp rx=0 tx=0).stop 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.586+0000 7f472f72ae00 1 -- 10.20.193.28:0/1344070053 shutdown_connections 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.587+0000 7f472f72ae00 1 --2- 10.20.193.28:0/1344070053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a088191520 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.587+0000 7f472f72ae00 1 --2- 10.20.193.28:0/1344070053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192fb0 0x55a0881b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.587+0000 7f472f72ae00 1 --2- 10.20.193.28:0/1344070053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192630 0x55a0881b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.587+0000 7f472f72ae00 1 -- 10.20.193.28:0/1344070053 >> 10.20.193.28:0/1344070053 conn(0x55a088155290 msgr2=0x55a088196f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:38.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.587+0000 7f472f72ae00 1 -- 10.20.193.28:0/1344070053 shutdown_connections 2026-02-20T03:18:38.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.587+0000 7f472f72ae00 1 -- 10.20.193.28:0/1344070053 wait complete. 2026-02-20T03:18:38.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.587+0000 7f472f72ae00 1 -- start start 2026-02-20T03:18:38.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.588+0000 7f472f72ae00 1 Processor -- start 2026-02-20T03:18:38.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.589+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192630 0x55a0881bb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.589+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192fb0 0x55a0881b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.589+0000 7f472f72ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.589+0000 7f472f72ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f46d000e500 con 0x55a088198000 2026-02-20T03:18:38.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.589+0000 7f472f72ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f46d000f970 con 0x55a088192630 2026-02-20T03:18:38.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.589+0000 7f472f72ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f46d000ebd0 con 0x55a088192fb0 2026-02-20T03:18:38.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.589+0000 7f4727577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:38.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.589+0000 7f4727577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55074/0 (socket says 10.20.193.28:55074) 2026-02-20T03:18:38.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.589+0000 7f4727577640 1 -- 10.20.193.28:0/4163003876 learned_addr learned my addr 10.20.193.28:0/4163003876 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:38.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f4727577640 1 -- 10.20.193.28:0/4163003876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192fb0 msgr2=0x55a0881b7c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:38.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f4727577640 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192fb0 0x55a0881b7c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f4727577640 1 -- 10.20.193.28:0/4163003876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192630 msgr2=0x55a0881bb970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:38.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f4727577640 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192630 0x55a0881bb970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f4727577640 1 -- 10.20.193.28:0/4163003876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a087dc4870 con 0x55a088198000 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f4727577640 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b8180 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4718012cf0 tx=0x7f4718016340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12b045619aafbf6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f46fcff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f46fcff9640 1 -- 10.20.193.28:0/4163003876 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718037020 con 0x55a088198000 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f46fcff9640 1 -- 10.20.193.28:0/4163003876 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f47180164e0 con 0x55a088198000 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.590+0000 7f46fcff9640 1 -- 10.20.193.28:0/4163003876 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471800e040 con 0x55a088198000 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.591+0000 7f472f72ae00 1 -- 10.20.193.28:0/4163003876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a088085440 con 0x55a088198000 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.591+0000 7f472f72ae00 10 client.16248 _ll_register_callbacks cb 0x7f471800b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.591+0000 7f472f72ae00 1 -- 10.20.193.28:0/4163003876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f471c033040 con 0x55a088198000 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.591+0000 7f46fcff9640 1 -- 10.20.193.28:0/4163003876 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f4718014930 con 0x55a088198000 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.591+0000 7f46fcff9640 1 -- 10.20.193.28:0/4163003876 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4718041050 con 0x55a088198000 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.591+0000 7f472f72ae00 10 client.16248 fetch_fsmap learned FSMap version 26 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.591+0000 7f472f72ae00 1 -- 10.20.193.28:0/4163003876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55a0881adfb0 con 0x55a088198000 2026-02-20T03:18:38.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.591+0000 7f46fcff9640 1 -- 10.20.193.28:0/4163003876 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 26) ==== 8362+0+0 (secure 0 0 0) 0x7f4718044020 con 0x55a088198000 2026-02-20T03:18:38.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.592+0000 7f472f72ae00 10 client.16248 fetch_fsmap finished waiting for FSMap version 26 2026-02-20T03:18:38.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.592+0000 7f472f72ae00 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:38.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.592+0000 7f472f72ae00 20 client.16248 populate_metadata read hostname 'trial028' 2026-02-20T03:18:38.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.592+0000 7f472f72ae00 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a08822f9c0 0x55a088231e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:38.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.592+0000 7f472f72ae00 4 client.16248 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:18:38.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.592+0000 7f472f72ae00 1 -- 10.20.193.28:0/4163003876 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a0880b6810 con 0x55a08822f9c0 2026-02-20T03:18:38.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.602+0000 7f4726d76640 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a08822f9c0 0x55a088231e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.644+0000 7f4726d76640 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a08822f9c0 0x55a088231e80 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=639612a614ee0461 server_cookie=6133d88320c94ad1 in_seq=0 out_seq=0 2026-02-20T03:18:38.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.644+0000 7f46fcff9640 10 client.16248 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:38.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.657+0000 7f46fcff9640 1 -- 10.20.193.28:0/4163003876 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a0880b6810 con 0x55a08822f9c0 2026-02-20T03:18:38.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.657+0000 7f46fcff9640 10 client.16248 handle_command_reply: tid=0 2026-02-20T03:18:38.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.657+0000 7f472f72ae00 1 client.16248 shutdown 2026-02-20T03:18:38.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 -- 10.20.193.28:0/4163003876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 msgr2=0x55a0881b8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:38.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b8180 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4718012cf0 tx=0x7f4718016340 comp rx=0 tx=0).stop 2026-02-20T03:18:38.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 -- 10.20.193.28:0/4163003876 shutdown_connections 2026-02-20T03:18:38.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a08822f9c0 0x55a088231e80 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a088198000 0x55a0881b8180 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a088192fb0 0x55a0881b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 --2- 10.20.193.28:0/4163003876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a088192630 0x55a0881bb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 -- 10.20.193.28:0/4163003876 >> 10.20.193.28:0/4163003876 conn(0x55a088155290 msgr2=0x55a0881b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f46fcff9640 0 client.16248 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 -- 10.20.193.28:0/4163003876 shutdown_connections 2026-02-20T03:18:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 1 -- 10.20.193.28:0/4163003876 wait complete. 2026-02-20T03:18:38.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.658+0000 7f472f72ae00 20 client.16248 trim_cache size 0 max 16384 2026-02-20T03:18:38.673 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:18:38.673 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:18:38.674 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:18:38.674 INFO:teuthology.orchestra.run.trial028.stdout: "08d4ffc1-efce-486d-b29b-33596a3c57db": { 2026-02-20T03:18:38.674 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:18:38.674 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "08d4ffc1-efce-486d-b29b-33596a3c57db", 2026-02-20T03:18:38.674 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:18:38.674 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:38.674 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:18:38.674 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:18:38.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 -- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46f80b0e20 msgr2=0x7f46f80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:38.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46f80b0e20 0x7f46f80b32e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4718007be0 tx=0x7f47180071c0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 -- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810c090 msgr2=0x7f47281a9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:38.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810c090 0x7f47281a9ac0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4710009a70 tx=0x7f4710009f40 comp rx=0 tx=0).stop 2026-02-20T03:18:38.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 -- 10.20.193.28:0/3079022991 shutdown_connections 2026-02-20T03:18:38.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46f80b0e20 0x7f46f80b32e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f47281104c0 0x7f47281a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f472810c090 0x7f47281a9ac0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 --2- 10.20.193.28:0/3079022991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f472810b6e0 0x7f47281a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:38.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 -- 10.20.193.28:0/3079022991 >> 10.20.193.28:0/3079022991 conn(0x7f4728071f80 msgr2=0x7f4728073320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:38.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 -- 10.20.193.28:0/3079022991 shutdown_connections 2026-02-20T03:18:38.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:18:38.659+0000 7f472ca24640 1 -- 10.20.193.28:0/3079022991 wait complete. 2026-02-20T03:18:38.816 INFO:tasks.cephfs.filesystem:scrub status for tag:08d4ffc1-efce-486d-b29b-33596a3c57db - {'path': '/', 'tag': '08d4ffc1-efce-486d-b29b-33596a3c57db', 'options': 'recursive,force'} 2026-02-20T03:18:39.250 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.251 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:39 trial028 ceph-mon[38552]: pgmap v300: 129 pgs: 129 active+clean; 67 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 179 KiB/s rd, 2.9 MiB/s wr, 176 op/s 2026-02-20T03:18:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:39 trial177 ceph-mon[43181]: pgmap v300: 129 pgs: 129 active+clean; 67 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 179 KiB/s rd, 2.9 MiB/s wr, 176 op/s 2026-02-20T03:18:39.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 305452 1.70 MB/sec execute 12 sec latency 1669.495 ms 2026-02-20T03:18:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:18:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:18:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:18:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:18:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:18:39.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:18:39.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:39 trial126 ceph-mon[38476]: pgmap v300: 129 pgs: 129 active+clean; 67 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 179 KiB/s rd, 2.9 MiB/s wr, 176 op/s 2026-02-20T03:18:40.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 305452 1.57 MB/sec execute 13 sec latency 2669.544 ms 2026-02-20T03:18:41.195 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:41 trial028 ceph-mon[38552]: pgmap v301: 129 pgs: 129 active+clean; 66 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 434 KiB/s rd, 3.2 MiB/s wr, 211 op/s 2026-02-20T03:18:41.196 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:41 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:18:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:41 trial177 ceph-mon[43181]: pgmap v301: 129 pgs: 129 active+clean; 66 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 434 KiB/s rd, 3.2 MiB/s wr, 211 op/s 2026-02-20T03:18:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:41 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:18:41.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 305452 1.46 MB/sec execute 14 sec latency 3669.585 ms 2026-02-20T03:18:41.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:41 trial126 ceph-mon[38476]: pgmap v301: 129 pgs: 129 active+clean; 66 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 434 KiB/s rd, 3.2 MiB/s wr, 211 op/s 2026-02-20T03:18:41.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:41 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:18:42.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- 10.20.193.28:0/1620161582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc37010a900 msgr2=0x7fc370111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:42.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1620161582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc37010a900 0x7fc370111480 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00b0a0 tx=0x7fc36c02f450 comp rx=0 tx=0).stop 2026-02-20T03:18:42.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- 10.20.193.28:0/1620161582 shutdown_connections 2026-02-20T03:18:42.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1620161582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc37010a900 0x7fc370111480 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1620161582 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc370109e60 0x7fc37010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1620161582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc370109490 0x7fc370109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- 10.20.193.28:0/1620161582 >> 10.20.193.28:0/1620161582 conn(0x7fc370077fe0 msgr2=0x7fc37007a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:42.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- 10.20.193.28:0/1620161582 shutdown_connections 2026-02-20T03:18:42.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- 10.20.193.28:0/1620161582 wait complete. 2026-02-20T03:18:42.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 Processor -- start 2026-02-20T03:18:42.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- start start 2026-02-20T03:18:42.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc370109490 0x7fc3701a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc370109e60 0x7fc3701a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc37010a900 0x7fc3701a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc370114a50 con 0x7fc370109e60 2026-02-20T03:18:42.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc3701148d0 con 0x7fc37010a900 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc370114bd0 con 0x7fc370109490 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc374fb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc370109e60 0x7fc3701a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc374fb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc370109e60 0x7fc3701a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55094/0 (socket says 10.20.193.28:55094) 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc374fb0640 1 -- 10.20.193.28:0/1329445977 learned_addr learned my addr 10.20.193.28:0/1329445977 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc374fb0640 1 -- 10.20.193.28:0/1329445977 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc370109490 msgr2=0x7fc3701a1040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc374fb0640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc370109490 0x7fc3701a1040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc374fb0640 1 -- 10.20.193.28:0/1329445977 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc37010a900 msgr2=0x7fc3701a85f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc374fb0640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc37010a900 0x7fc3701a85f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc374fb0640 1 -- 10.20.193.28:0/1329445977 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3701a8cf0 con 0x7fc370109e60 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc374fb0640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc370109e60 0x7fc3701a1580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc36400b570 tx=0x7fc36400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc35e7fc640 1 -- 10.20.193.28:0/1329445977 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364013020 con 0x7fc370109e60 2026-02-20T03:18:42.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc35e7fc640 1 -- 10.20.193.28:0/1329445977 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc364004480 con 0x7fc370109e60 2026-02-20T03:18:42.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc35e7fc640 1 -- 10.20.193.28:0/1329445977 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36400fb50 con 0x7fc370109e60 2026-02-20T03:18:42.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- 10.20.193.28:0/1329445977 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3701a8fe0 con 0x7fc370109e60 2026-02-20T03:18:42.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.365+0000 7fc3767b3640 1 -- 10.20.193.28:0/1329445977 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3701a9470 con 0x7fc370109e60 2026-02-20T03:18:42.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 Processor -- start 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- start start 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc35e7fc640 1 -- 10.20.193.28:0/1329445977 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc364002780 con 0x7fc370109e60 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e37907280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e379077c0 0x556e3790bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e3790e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556e378578f0 con 0x556e37906e80 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556e378052e0 con 0x556e3790c560 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556e37853820 con 0x556e379077c0 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e37907280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e37907280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55106/0 (socket says 10.20.193.28:55106) 2026-02-20T03:18:42.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 -- 10.20.193.28:0/511637208 learned_addr learned my addr 10.20.193.28:0/511637208 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 -- 10.20.193.28:0/511637208 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e379077c0 msgr2=0x556e3790bf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 --2- 10.20.193.28:0/511637208 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e379077c0 0x556e3790bf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 -- 10.20.193.28:0/511637208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 msgr2=0x556e3790e9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 --2- 10.20.193.28:0/511637208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e3790e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 -- 10.20.193.28:0/511637208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e377f75a0 con 0x556e37906e80 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 --2- 10.20.193.28:0/511637208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e37907280 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009850 tx=0x7fc36c009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e7c077c07edb1d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc33dbfe640 1 -- 10.20.193.28:0/511637208 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c004070 con 0x556e37906e80 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc33dbfe640 1 -- 10.20.193.28:0/511637208 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc36c033030 con 0x556e37906e80 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc33dbfe640 1 -- 10.20.193.28:0/511637208 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c002a60 con 0x556e37906e80 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/511637208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 msgr2=0x556e37907280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:42.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/511637208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e37907280 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009850 tx=0x7fc36c009d70 comp rx=0 tx=0).stop 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/511637208 shutdown_connections 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/511637208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e3790e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/511637208 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e379077c0 0x556e3790bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/511637208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e37907280 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/511637208 >> 10.20.193.28:0/511637208 conn(0x556e378fe6f0 msgr2=0x556e37905570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/511637208 shutdown_connections 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/511637208 wait complete. 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc35e7fc640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc34c0b0d80 0x7fc34c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc35e7fc640 1 -- 10.20.193.28:0/1329445977 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc3640e0400 con 0x7fc370109e60 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc34c0b0d80 0x7fc34c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:42.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc375fb2640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc34c0b0d80 0x7fc34c0b3240 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009820 tx=0x7fc36c0099e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:42.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- start start 2026-02-20T03:18:42.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 Processor -- start 2026-02-20T03:18:42.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e3791fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e379077c0 0x556e3791ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e37926f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556e377ff0c0 con 0x556e37906e80 2026-02-20T03:18:42.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556e3790f5b0 con 0x556e3790c560 2026-02-20T03:18:42.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556e37927490 con 0x556e379077c0 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc3757b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e3791fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc3757b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e3791fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55110/0 (socket says 10.20.193.28:55110) 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc3757b1640 1 -- 10.20.193.28:0/1282819399 learned_addr learned my addr 10.20.193.28:0/1282819399 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc3757b1640 1 -- 10.20.193.28:0/1282819399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e379077c0 msgr2=0x556e3791ff80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc3757b1640 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e379077c0 0x556e3791ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc3757b1640 1 -- 10.20.193.28:0/1282819399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 msgr2=0x556e37926f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc3757b1640 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e37926f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.371+0000 7fc3757b1640 1 -- 10.20.193.28:0/1282819399 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e379191b0 con 0x556e37906e80 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc3757b1640 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e3791fa40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc360009ea0 tx=0x7fc36000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7633bdbaa50d08e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc32affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc32affd640 1 -- 10.20.193.28:0/1282819399 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360016070 con 0x556e37906e80 2026-02-20T03:18:42.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc32affd640 1 -- 10.20.193.28:0/1282819399 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc360002780 con 0x556e37906e80 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc32affd640 1 -- 10.20.193.28:0/1282819399 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3600117e0 con 0x556e37906e80 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/1282819399 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e37813820 con 0x556e37906e80 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc32affd640 1 -- 10.20.193.28:0/1282819399 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc36001a3b0 con 0x556e37906e80 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 10 client.16260 _ll_register_callbacks cb 0x556e37802ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/1282819399 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556e3785f4e0 con 0x556e37906e80 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc32affd640 1 -- 10.20.193.28:0/1282819399 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc360004270 con 0x556e37906e80 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 10 client.16260 fetch_fsmap learned FSMap version 27 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/1282819399 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x556e37818380 con 0x556e37906e80 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc32affd640 1 -- 10.20.193.28:0/1282819399 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7fc360004410 con 0x556e37906e80 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 10 client.16260 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:18:42.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 10 client.16260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:42.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 20 client.16260 populate_metadata read hostname 'trial028' 2026-02-20T03:18:42.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e3792b8d0 0x556e3792dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 4 client.16260 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:42.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.377+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/1282819399 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e377d9bd0 con 0x556e3792b8d0 2026-02-20T03:18:42.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.397+0000 7fc374fb0640 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e3792b8d0 0x556e3792dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:42.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.437+0000 7fc374fb0640 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e3792b8d0 0x556e3792dd70 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bc2ec4565408cc7 server_cookie=9b4d18eb580c216b in_seq=0 out_seq=0 2026-02-20T03:18:42.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.437+0000 7fc32affd640 10 client.16260 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:42.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc32affd640 1 -- 10.20.193.28:0/1282819399 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556e377d9bd0 con 0x556e3792b8d0 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc32affd640 10 client.16260 handle_command_reply: tid=0 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 client.16260 shutdown 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/1282819399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 msgr2=0x556e3791fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e3791fa40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc360009ea0 tx=0x7fc36000b4b0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/1282819399 shutdown_connections 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e3792b8d0 0x556e3792dd70 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e37926f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e379077c0 0x556e3791ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/1282819399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e37906e80 0x556e3791fa40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/1282819399 >> 10.20.193.28:0/1282819399 conn(0x556e378fe6f0 msgr2=0x556e3790d910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:42.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc32affd640 0 client.16260 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:42.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/1282819399 shutdown_connections 2026-02-20T03:18:42.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/1282819399 wait complete. 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.451+0000 7fc37a8a2e00 20 client.16260 trim_cache size 0 max 16384 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 Processor -- start 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- start start 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e37906e80 0x556e37909240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e37926ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e3791e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c012780 con 0x556e379077c0 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c00ffc0 con 0x556e3790c560 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c00de10 con 0x556e37906e80 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e37926ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:42.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e37926ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55112/0 (socket says 10.20.193.28:55112) 2026-02-20T03:18:42.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 -- 10.20.193.28:0/3840180183 learned_addr learned my addr 10.20.193.28:0/3840180183 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:42.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 -- 10.20.193.28:0/3840180183 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e37906e80 msgr2=0x556e37909240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:42.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- 10.20.193.28:0/3840180183 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e37906e80 0x556e37909240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 -- 10.20.193.28:0/3840180183 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 msgr2=0x556e3791e710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:42.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- 10.20.193.28:0/3840180183 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e3791e710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 -- 10.20.193.28:0/3840180183 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e37918fe0 con 0x556e379077c0 2026-02-20T03:18:42.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- 10.20.193.28:0/3840180183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e37926ec0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc36400b540 tx=0x7fc3640ddf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b89bad49099145 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:42.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc33d3fd640 1 -- 10.20.193.28:0/3840180183 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3640ac590 con 0x556e379077c0 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc33d3fd640 1 -- 10.20.193.28:0/3840180183 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc3640b1440 con 0x556e379077c0 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc33d3fd640 1 -- 10.20.193.28:0/3840180183 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3640a4220 con 0x556e379077c0 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/3840180183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 msgr2=0x556e37926ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/3840180183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e37926ec0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc36400b540 tx=0x7fc3640ddf90 comp rx=0 tx=0).stop 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/3840180183 shutdown_connections 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/3840180183 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e3791e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/3840180183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e37926ec0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/3840180183 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e37906e80 0x556e37909240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/3840180183 >> 10.20.193.28:0/3840180183 conn(0x556e378fe6f0 msgr2=0x556e3791e000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/3840180183 shutdown_connections 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/3840180183 wait complete. 2026-02-20T03:18:42.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- start start 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 Processor -- start 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e37906e80 0x556e37926e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e379254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e379259f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c00e480 con 0x556e379077c0 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c00f8f0 con 0x556e3790c560 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc37a8a2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c00eb50 con 0x556e37906e80 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e379254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e379254b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55124/0 (socket says 10.20.193.28:55124) 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 -- 10.20.193.28:0/2948519769 learned_addr learned my addr 10.20.193.28:0/2948519769 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 -- 10.20.193.28:0/2948519769 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e37906e80 msgr2=0x556e37926e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:42.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e37906e80 0x556e37926e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 -- 10.20.193.28:0/2948519769 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 msgr2=0x556e379259f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:18:42.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e379259f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 -- 10.20.193.28:0/2948519769 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e37934370 con 0x556e379077c0 2026-02-20T03:18:42.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc374fb0640 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e379254b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc3640ddbc0 tx=0x7fc3640a8a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf9f4aee877ff9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:42.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.457+0000 7fc32affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:42.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc32affd640 1 -- 10.20.193.28:0/2948519769 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3640e0120 con 0x556e379077c0 2026-02-20T03:18:42.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/2948519769 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e375b7690 con 0x556e379077c0 2026-02-20T03:18:42.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc32affd640 1 -- 10.20.193.28:0/2948519769 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc3640a4220 con 0x556e379077c0 2026-02-20T03:18:42.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc32affd640 1 -- 10.20.193.28:0/2948519769 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc364094440 con 0x556e379077c0 2026-02-20T03:18:42.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 10 client.16266 _ll_register_callbacks cb 0x7fc360009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/2948519769 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556e37865290 con 0x556e379077c0 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc32affd640 1 -- 10.20.193.28:0/2948519769 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc3640a3900 con 0x556e379077c0 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc32affd640 1 -- 10.20.193.28:0/2948519769 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc3640c2020 con 0x556e379077c0 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 10 client.16266 fetch_fsmap learned FSMap version 27 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/2948519769 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x556e3781cb70 con 0x556e379077c0 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc32affd640 1 -- 10.20.193.28:0/2948519769 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7fc3640a3b00 con 0x556e379077c0 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 10 client.16266 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 10 client.16266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 20 client.16266 populate_metadata read hostname 'trial028' 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e37997c10 0x556e3799a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 4 client.16266 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:18:42.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.462+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/2948519769 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fc36c033030 con 0x556e37997c10 2026-02-20T03:18:42.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.478+0000 7fc3757b1640 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e37997c10 0x556e3799a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:42.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 305452 1.36 MB/sec execute 15 sec latency 4669.623 ms 2026-02-20T03:18:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.532+0000 7fc3757b1640 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e37997c10 0x556e3799a0d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70edb0b24623b12 server_cookie=194c633ae6dc3ba8 in_seq=0 out_seq=0 2026-02-20T03:18:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.532+0000 7fc32affd640 10 client.16266 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:42.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc32affd640 1 -- 10.20.193.28:0/2948519769 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fc36c033030 con 0x556e37997c10 2026-02-20T03:18:42.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc32affd640 10 client.16266 handle_command_reply: tid=0 2026-02-20T03:18:42.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 client.16266 shutdown 2026-02-20T03:18:42.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/2948519769 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 msgr2=0x556e379254b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:42.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e379254b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc3640ddbc0 tx=0x7fc3640a8a20 comp rx=0 tx=0).stop 2026-02-20T03:18:42.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/2948519769 shutdown_connections 2026-02-20T03:18:42.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e37997c10 0x556e3799a0d0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e3790c560 0x556e379259f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e379077c0 0x556e379254b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 --2- 10.20.193.28:0/2948519769 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e37906e80 0x556e37926e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/2948519769 >> 10.20.193.28:0/2948519769 conn(0x556e378fe6f0 msgr2=0x556e3791e820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:42.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc32affd640 0 client.16266 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:42.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/2948519769 shutdown_connections 2026-02-20T03:18:42.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 1 -- 10.20.193.28:0/2948519769 wait complete. 2026-02-20T03:18:42.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc37a8a2e00 20 client.16266 trim_cache size 0 max 16384 2026-02-20T03:18:42.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:18:42.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:18:42.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:18:42.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:18:42.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 -- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc34c0b0d80 msgr2=0x7fc34c0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:42.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc34c0b0d80 0x7fc34c0b3240 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc36c009820 tx=0x7fc36c0099e0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 -- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc370109e60 msgr2=0x7fc3701a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:42.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc370109e60 0x7fc3701a1580 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc36400b570 tx=0x7fc36400ba40 comp rx=0 tx=0).stop 2026-02-20T03:18:42.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 -- 10.20.193.28:0/1329445977 shutdown_connections 2026-02-20T03:18:42.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc34c0b0d80 0x7fc34c0b3240 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc37010a900 0x7fc3701a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc370109e60 0x7fc3701a1580 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 --2- 10.20.193.28:0/1329445977 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc370109490 0x7fc3701a1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:42.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 -- 10.20.193.28:0/1329445977 >> 10.20.193.28:0/1329445977 conn(0x7fc370077fe0 msgr2=0x7fc37010d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:42.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 -- 10.20.193.28:0/1329445977 shutdown_connections 2026-02-20T03:18:42.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:42.590+0000 7fc3767b3640 1 -- 10.20.193.28:0/1329445977 wait complete. 2026-02-20T03:18:43.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:43 trial028 ceph-mon[38552]: pgmap v302: 129 pgs: 129 active+clean; 69 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 508 KiB/s rd, 3.4 MiB/s wr, 196 op/s 2026-02-20T03:18:43.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:43 trial177 ceph-mon[43181]: pgmap v302: 129 pgs: 129 active+clean; 69 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 508 KiB/s rd, 3.4 MiB/s wr, 196 op/s 2026-02-20T03:18:43.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 305742 1.29 MB/sec execute 16 sec latency 4989.496 ms 2026-02-20T03:18:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:43 trial126 ceph-mon[38476]: pgmap v302: 129 pgs: 129 active+clean; 69 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 508 KiB/s rd, 3.4 MiB/s wr, 196 op/s 2026-02-20T03:18:44.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 305744 1.21 MB/sec execute 17 sec latency 1484.781 ms 2026-02-20T03:18:45.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:45 trial028 ceph-mon[38552]: pgmap v303: 129 pgs: 129 active+clean; 69 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 531 KiB/s rd, 3.0 MiB/s wr, 182 op/s 2026-02-20T03:18:45.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:45 trial177 ceph-mon[43181]: pgmap v303: 129 pgs: 129 active+clean; 69 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 531 KiB/s rd, 3.0 MiB/s wr, 182 op/s 2026-02-20T03:18:45.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 305776 1.15 MB/sec execute 18 sec latency 829.691 ms 2026-02-20T03:18:45.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:45 trial126 ceph-mon[38476]: pgmap v303: 129 pgs: 129 active+clean; 69 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 531 KiB/s rd, 3.0 MiB/s wr, 182 op/s 2026-02-20T03:18:46.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 305776 1.09 MB/sec execute 19 sec latency 1829.735 ms 2026-02-20T03:18:47.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:47 trial177 ceph-mon[43181]: pgmap v304: 129 pgs: 129 active+clean; 63 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 589 KiB/s rd, 3.5 MiB/s wr, 212 op/s 2026-02-20T03:18:47.501 INFO:tasks.workunit.client.0.trial028.stdout: 1 309001 1.98 MB/sec execute 20 sec latency 2046.860 ms 2026-02-20T03:18:47.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:47 trial126 ceph-mon[38476]: pgmap v304: 129 pgs: 129 active+clean; 63 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 589 KiB/s rd, 3.5 MiB/s wr, 212 op/s 2026-02-20T03:18:47.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:47 trial028 ceph-mon[38552]: pgmap v304: 129 pgs: 129 active+clean; 63 MiB data, 1.1 GiB used, 8.2 TiB / 8.2 TiB avail; 589 KiB/s rd, 3.5 MiB/s wr, 212 op/s 2026-02-20T03:18:48.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:48 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:18:48.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:48 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:18:48.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:48 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:18:48.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:48 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:18:48.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:48 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:18:48.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:48 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:18:48.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 311098 2.25 MB/sec execute 21 sec latency 236.791 ms 2026-02-20T03:18:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:48 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:18:48.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:48 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:18:48.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:48 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:18:49.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:49 trial028 ceph-mon[38552]: pgmap v305: 129 pgs: 129 active+clean; 64 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 651 KiB/s rd, 3.0 MiB/s wr, 208 op/s 2026-02-20T03:18:49.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:49 trial177 ceph-mon[43181]: pgmap v305: 129 pgs: 129 active+clean; 64 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 651 KiB/s rd, 3.0 MiB/s wr, 208 op/s 2026-02-20T03:18:49.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 311098 2.15 MB/sec execute 22 sec latency 1236.834 ms 2026-02-20T03:18:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:49 trial126 ceph-mon[38476]: pgmap v305: 129 pgs: 129 active+clean; 64 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 651 KiB/s rd, 3.0 MiB/s wr, 208 op/s 2026-02-20T03:18:50.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 311111 2.06 MB/sec execute 23 sec latency 2008.706 ms 2026-02-20T03:18:51.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:51 trial177 ceph-mon[43181]: pgmap v306: 129 pgs: 129 active+clean; 66 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 914 KiB/s rd, 3.3 MiB/s wr, 238 op/s 2026-02-20T03:18:51.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 314751 2.78 MB/sec execute 24 sec latency 155.450 ms 2026-02-20T03:18:51.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:51 trial126 ceph-mon[38476]: pgmap v306: 129 pgs: 129 active+clean; 66 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 914 KiB/s rd, 3.3 MiB/s wr, 238 op/s 2026-02-20T03:18:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:51 trial028 ceph-mon[38552]: pgmap v306: 129 pgs: 129 active+clean; 66 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 914 KiB/s rd, 3.3 MiB/s wr, 238 op/s 2026-02-20T03:18:52.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 318106 3.39 MB/sec execute 25 sec latency 11.527 ms 2026-02-20T03:18:53.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:53 trial177 ceph-mon[43181]: pgmap v307: 129 pgs: 129 active+clean; 61 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 977 KiB/s rd, 3.0 MiB/s wr, 207 op/s 2026-02-20T03:18:53.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 321828 4.04 MB/sec execute 26 sec latency 7.682 ms 2026-02-20T03:18:53.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:53 trial126 ceph-mon[38476]: pgmap v307: 129 pgs: 129 active+clean; 61 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 977 KiB/s rd, 3.0 MiB/s wr, 207 op/s 2026-02-20T03:18:53.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:53 trial028 ceph-mon[38552]: pgmap v307: 129 pgs: 129 active+clean; 61 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 977 KiB/s rd, 3.0 MiB/s wr, 207 op/s 2026-02-20T03:18:54.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 325723 4.76 MB/sec execute 27 sec latency 9.840 ms 2026-02-20T03:18:55.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:55 trial177 ceph-mon[43181]: pgmap v308: 129 pgs: 129 active+clean; 62 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 271 op/s 2026-02-20T03:18:55.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 329512 5.30 MB/sec execute 28 sec latency 6.745 ms 2026-02-20T03:18:55.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:55 trial126 ceph-mon[38476]: pgmap v308: 129 pgs: 129 active+clean; 62 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 271 op/s 2026-02-20T03:18:55.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:55 trial028 ceph-mon[38552]: pgmap v308: 129 pgs: 129 active+clean; 62 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 271 op/s 2026-02-20T03:18:55.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.667+0000 7f1391333640 1 -- 10.20.193.28:0/2821716404 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f138c10a5d0 msgr2=0x7f138c10ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:55.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.667+0000 7f1391333640 1 --2- 10.20.193.28:0/2821716404 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f138c10a5d0 0x7f138c10ca70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f138000b0a0 tx=0x7f138002f410 comp rx=0 tx=0).stop 2026-02-20T03:18:55.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.667+0000 7f1391333640 1 -- 10.20.193.28:0/2821716404 shutdown_connections 2026-02-20T03:18:55.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.667+0000 7f1391333640 1 --2- 10.20.193.28:0/2821716404 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f138c10a5d0 0x7f138c10ca70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.667+0000 7f1391333640 1 --2- 10.20.193.28:0/2821716404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f138c075a00 0x7f138c075e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.667+0000 7f1391333640 1 --2- 10.20.193.28:0/2821716404 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f138c077070 0x7f138c0754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.667+0000 7f1391333640 1 -- 10.20.193.28:0/2821716404 >> 10.20.193.28:0/2821716404 conn(0x7f138c0fde10 msgr2=0x7f138c100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:55.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.667+0000 7f1391333640 1 -- 10.20.193.28:0/2821716404 shutdown_connections 2026-02-20T03:18:55.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.667+0000 7f1391333640 1 -- 10.20.193.28:0/2821716404 wait complete. 2026-02-20T03:18:55.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f1391333640 1 Processor -- start 2026-02-20T03:18:55.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f1391333640 1 -- start start 2026-02-20T03:18:55.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f1391333640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f138c075a00 0x7f138c19c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f1391333640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f138c077070 0x7f138c19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f1391333640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f138c10a5d0 0x7f138c1a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f1391333640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f138c1103b0 con 0x7f138c075a00 2026-02-20T03:18:55.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f1391333640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f138c110230 con 0x7f138c10a5d0 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f1391333640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f138c110530 con 0x7f138c077070 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f138bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f138c075a00 0x7f138c19c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f138bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f138c075a00 0x7f138c19c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54380/0 (socket says 10.20.193.28:54380) 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.668+0000 7f138bfff640 1 -- 10.20.193.28:0/264305796 learned_addr learned my addr 10.20.193.28:0/264305796 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f138b7fe640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f138c077070 0x7f138c19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f138bfff640 1 -- 10.20.193.28:0/264305796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f138c077070 msgr2=0x7f138c19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f1390b32640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f138c10a5d0 0x7f138c1a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f138bfff640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f138c077070 0x7f138c19ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f138bfff640 1 -- 10.20.193.28:0/264305796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f138c10a5d0 msgr2=0x7f138c1a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f138bfff640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f138c10a5d0 0x7f138c1a3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f138bfff640 1 -- 10.20.193.28:0/264305796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138c1a4640 con 0x7f138c075a00 2026-02-20T03:18:55.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f138b7fe640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f138c077070 0x7f138c19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:18:55.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f138bfff640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f138c075a00 0x7f138c19c990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f13780027e0 tx=0x7f1378002cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:55.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f13897fa640 1 -- 10.20.193.28:0/264305796 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137800ed40 con 0x7f138c075a00 2026-02-20T03:18:55.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f1391333640 1 -- 10.20.193.28:0/264305796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138c1a4930 con 0x7f138c075a00 2026-02-20T03:18:55.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f13897fa640 1 -- 10.20.193.28:0/264305796 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f13780108d0 con 0x7f138c075a00 2026-02-20T03:18:55.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f13897fa640 1 -- 10.20.193.28:0/264305796 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137800f7c0 con 0x7f138c075a00 2026-02-20T03:18:55.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.669+0000 7f1391333640 1 -- 10.20.193.28:0/264305796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138c1a4ed0 con 0x7f138c075a00 2026-02-20T03:18:55.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.672+0000 7f13897fa640 1 -- 10.20.193.28:0/264305796 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1378010a80 con 0x7f138c075a00 2026-02-20T03:18:55.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.672+0000 7f1395418e00 1 Processor -- start 2026-02-20T03:18:55.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.672+0000 7f1395418e00 1 -- start start 2026-02-20T03:18:55.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.672+0000 7f1395418e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad169280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.672+0000 7f1395418e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad16df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.672+0000 7f1395418e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad1709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.672+0000 7f1395418e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e4ad0b98f0 con 0x55e4ad16e560 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.672+0000 7f1395418e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e4ad0672e0 con 0x55e4ad168e80 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.672+0000 7f1395418e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e4ad0b5820 con 0x55e4ad1697c0 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad1709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f1390b32640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad1709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54392/0 (socket says 10.20.193.28:54392) 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138b7fe640 1 -- 10.20.193.28:0/3977414020 learned_addr learned my addr 10.20.193.28:0/3977414020 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138bfff640 1 --2- 10.20.193.28:0/3977414020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad16df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138b7fe640 1 -- 10.20.193.28:0/3977414020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 msgr2=0x55e4ad16df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:55.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138b7fe640 1 --2- 10.20.193.28:0/3977414020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad16df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138b7fe640 1 -- 10.20.193.28:0/3977414020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 msgr2=0x55e4ad169280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138b7fe640 1 --2- 10.20.193.28:0/3977414020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad169280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138b7fe640 1 -- 10.20.193.28:0/3977414020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ad0595a0 con 0x55e4ad16e560 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f138b7fe640 1 --2- 10.20.193.28:0/3977414020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad1709f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f137c004590 tx=0x7f137c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4c6eaedec0cbb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f134ffff640 1 -- 10.20.193.28:0/3977414020 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c016070 con 0x55e4ad16e560 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f134ffff640 1 -- 10.20.193.28:0/3977414020 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f137c002cc0 con 0x55e4ad16e560 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f134ffff640 1 -- 10.20.193.28:0/3977414020 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137c011620 con 0x55e4ad16e560 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.673+0000 7f13897fa640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13600b0e20 0x7f13600b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f13897fa640 1 -- 10.20.193.28:0/264305796 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f13780e10c0 con 0x7f138c075a00 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1395418e00 1 -- 10.20.193.28:0/3977414020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 msgr2=0x55e4ad1709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:55.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1395418e00 1 --2- 10.20.193.28:0/3977414020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad1709f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f137c004590 tx=0x7f137c009b90 comp rx=0 tx=0).stop 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1395418e00 1 -- 10.20.193.28:0/3977414020 shutdown_connections 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1395418e00 1 --2- 10.20.193.28:0/3977414020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad1709f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1395418e00 1 --2- 10.20.193.28:0/3977414020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad16df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1395418e00 1 --2- 10.20.193.28:0/3977414020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad169280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1395418e00 1 -- 10.20.193.28:0/3977414020 >> 10.20.193.28:0/3977414020 conn(0x55e4ad1606f0 msgr2=0x55e4ad167570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1390b32640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13600b0e20 0x7f13600b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1395418e00 1 -- 10.20.193.28:0/3977414020 shutdown_connections 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1395418e00 1 -- 10.20.193.28:0/3977414020 wait complete. 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.674+0000 7f1390b32640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13600b0e20 0x7f13600b32e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1380009e60 tx=0x7f138003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.675+0000 7f1395418e00 1 -- start start 2026-02-20T03:18:55.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.675+0000 7f1395418e00 1 Processor -- start 2026-02-20T03:18:55.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f1395418e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad168e80 0x55e4ad181990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f1395418e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad181ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f1395418e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad16e560 0x55e4ad188e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f1395418e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e4ad0610c0 con 0x55e4ad168e80 2026-02-20T03:18:55.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f1395418e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e4ad171610 con 0x55e4ad16e560 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f1395418e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e4ad1893e0 con 0x55e4ad1697c0 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f138bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad168e80 0x55e4ad181990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f138bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad168e80 0x55e4ad181990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54398/0 (socket says 10.20.193.28:54398) 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f138bfff640 1 -- 10.20.193.28:0/1661043788 learned_addr learned my addr 10.20.193.28:0/1661043788 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f1390b32640 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad16e560 0x55e4ad188e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f138b7fe640 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad181ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f138bfff640 1 -- 10.20.193.28:0/1661043788 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 msgr2=0x55e4ad181ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f138bfff640 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad181ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f138bfff640 1 -- 10.20.193.28:0/1661043788 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad16e560 msgr2=0x55e4ad188e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f138bfff640 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad16e560 0x55e4ad188e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.676+0000 7f138bfff640 1 -- 10.20.193.28:0/1661043788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ad17b0e0 con 0x55e4ad168e80 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f138bfff640 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad168e80 0x55e4ad181990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f137800e720 tx=0x7f13780a82c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde73ac0b7eb955e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f134d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f134d7fa640 1 -- 10.20.193.28:0/1661043788 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13780b2000 con 0x55e4ad168e80 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f134d7fa640 1 -- 10.20.193.28:0/1661043788 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f13780a4de0 con 0x55e4ad168e80 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f134d7fa640 1 -- 10.20.193.28:0/1661043788 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137800cde0 con 0x55e4ad168e80 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f1395418e00 1 -- 10.20.193.28:0/1661043788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ad075820 con 0x55e4ad168e80 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f134d7fa640 1 -- 10.20.193.28:0/1661043788 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f13780b1040 con 0x55e4ad168e80 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f1395418e00 10 client.16278 _ll_register_callbacks cb 0x55e4ad064ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f1395418e00 1 -- 10.20.193.28:0/1661043788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e4ad0c14e0 con 0x55e4ad168e80 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f134d7fa640 1 -- 10.20.193.28:0/1661043788 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f13780ac020 con 0x55e4ad168e80 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f1395418e00 10 client.16278 fetch_fsmap learned FSMap version 27 2026-02-20T03:18:55.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.677+0000 7f1395418e00 1 -- 10.20.193.28:0/1661043788 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55e4ad07a380 con 0x55e4ad168e80 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.678+0000 7f134d7fa640 1 -- 10.20.193.28:0/1661043788 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f13780e3110 con 0x55e4ad168e80 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.678+0000 7f1395418e00 10 client.16278 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.678+0000 7f1395418e00 10 client.16278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.678+0000 7f1395418e00 20 client.16278 populate_metadata read hostname 'trial028' 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.678+0000 7f1395418e00 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e4ad18d780 0x55e4ad18fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.678+0000 7f1395418e00 4 client.16278 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.678+0000 7f1395418e00 1 -- 10.20.193.28:0/1661043788 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4ad03bbd0 con 0x55e4ad18d780 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.678+0000 7f138b7fe640 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e4ad18d780 0x55e4ad18fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.679+0000 7f138b7fe640 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e4ad18d780 0x55e4ad18fbf0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f05c8ed957de600f server_cookie=57122f38f96d3163 in_seq=0 out_seq=0 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.679+0000 7f134d7fa640 10 client.16278 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:55.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.679+0000 7f134d7fa640 1 -- 10.20.193.28:0/1661043788 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e4ad03bbd0 con 0x55e4ad18d780 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.679+0000 7f134d7fa640 10 client.16278 handle_command_reply: tid=0 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.679+0000 7f1395418e00 1 client.16278 shutdown 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 -- 10.20.193.28:0/1661043788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad168e80 msgr2=0x55e4ad181990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad168e80 0x55e4ad181990 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f137800e720 tx=0x7f13780a82c0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 -- 10.20.193.28:0/1661043788 shutdown_connections 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e4ad18d780 0x55e4ad18fbf0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad16e560 0x55e4ad188e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad181ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 --2- 10.20.193.28:0/1661043788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad168e80 0x55e4ad181990 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 -- 10.20.193.28:0/1661043788 >> 10.20.193.28:0/1661043788 conn(0x55e4ad1606f0 msgr2=0x55e4ad16f870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f134d7fa640 0 client.16278 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:55.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 -- 10.20.193.28:0/1661043788 shutdown_connections 2026-02-20T03:18:55.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 1 -- 10.20.193.28:0/1661043788 wait complete. 2026-02-20T03:18:55.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.680+0000 7f1395418e00 20 client.16278 trim_cache size 0 max 16384 2026-02-20T03:18:55.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.687+0000 7f1395418e00 1 Processor -- start 2026-02-20T03:18:55.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.687+0000 7f1395418e00 1 -- start start 2026-02-20T03:18:55.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f1395418e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad17f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f1395418e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad188e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f1395418e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad16f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f1395418e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1330012690 con 0x55e4ad16e560 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f1395418e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f133000fed0 con 0x55e4ad168e80 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f1395418e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f133000dd20 con 0x55e4ad1697c0 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f138bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad17f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f138bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad17f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39516/0 (socket says 10.20.193.28:39516) 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f138bfff640 1 -- 10.20.193.28:0/2363494353 learned_addr learned my addr 10.20.193.28:0/2363494353 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f138b7fe640 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad188e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f1390b32640 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad16f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f138bfff640 1 -- 10.20.193.28:0/2363494353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 msgr2=0x55e4ad188e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:55.693 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f138bfff640 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad188e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f138bfff640 1 -- 10.20.193.28:0/2363494353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 msgr2=0x55e4ad16f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f138bfff640 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad16f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f138bfff640 1 -- 10.20.193.28:0/2363494353 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ad17af10 con 0x55e4ad168e80 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.688+0000 7f1390b32640 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad16f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f138bfff640 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad17f580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13780e1360 tx=0x7f13780ab000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b6b7a6f2cba3993 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f134f7fe640 1 -- 10.20.193.28:0/2363494353 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13780a4de0 con 0x55e4ad168e80 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f134f7fe640 1 -- 10.20.193.28:0/2363494353 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e4ad0c14e0 con 0x55e4ad168e80 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f134f7fe640 1 -- 10.20.193.28:0/2363494353 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13780b1040 con 0x55e4ad168e80 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f1395418e00 1 -- 10.20.193.28:0/2363494353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 msgr2=0x55e4ad17f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f1395418e00 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad17f580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f13780e1360 tx=0x7f13780ab000 comp rx=0 tx=0).stop 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f1395418e00 1 -- 10.20.193.28:0/2363494353 shutdown_connections 2026-02-20T03:18:55.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f1395418e00 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad16f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f1395418e00 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad1697c0 0x55e4ad188e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f1395418e00 1 --2- 10.20.193.28:0/2363494353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad168e80 0x55e4ad17f580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f1395418e00 1 -- 10.20.193.28:0/2363494353 >> 10.20.193.28:0/2363494353 conn(0x55e4ad1606f0 msgr2=0x55e4ad17ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:55.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.689+0000 7f1395418e00 1 -- 10.20.193.28:0/2363494353 shutdown_connections 2026-02-20T03:18:55.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.690+0000 7f1395418e00 1 -- 10.20.193.28:0/2363494353 wait complete. 2026-02-20T03:18:55.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.690+0000 7f1395418e00 1 -- start start 2026-02-20T03:18:55.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.690+0000 7f1395418e00 1 Processor -- start 2026-02-20T03:18:55.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f1395418e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad168e80 0x55e4ad185040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f1395418e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad1697c0 0x55e4ad185580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f1395418e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad187f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f1395418e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f133000e390 con 0x55e4ad16e560 2026-02-20T03:18:55.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f1395418e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f133000f800 con 0x55e4ad1697c0 2026-02-20T03:18:55.698 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f1395418e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f133000ea60 con 0x55e4ad168e80 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f138bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad168e80 0x55e4ad185040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f138bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad168e80 0x55e4ad185040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49474/0 (socket says 10.20.193.28:49474) 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f138bfff640 1 -- 10.20.193.28:0/1799356441 learned_addr learned my addr 10.20.193.28:0/1799356441 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f138b7fe640 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad1697c0 0x55e4ad185580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f138bfff640 1 -- 10.20.193.28:0/1799356441 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad1697c0 msgr2=0x55e4ad185580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f138bfff640 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad1697c0 0x55e4ad185580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f138bfff640 1 -- 10.20.193.28:0/1799356441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 msgr2=0x55e4ad187f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f1390b32640 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad187f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f138bfff640 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad187f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f138bfff640 1 -- 10.20.193.28:0/1799356441 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4ad171370 con 0x55e4ad168e80 2026-02-20T03:18:55.699 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.691+0000 7f1390b32640 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad187f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f138bfff640 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad168e80 0x55e4ad185040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1378093040 tx=0x7f13780b1e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63b48d49b67f2243 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f134d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f134d7fa640 1 -- 10.20.193.28:0/1799356441 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137800ce60 con 0x55e4ad168e80 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f134d7fa640 1 -- 10.20.193.28:0/1799356441 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f13780b1040 con 0x55e4ad168e80 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f1395418e00 1 -- 10.20.193.28:0/1799356441 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4ace19690 con 0x55e4ad168e80 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f134d7fa640 1 -- 10.20.193.28:0/1799356441 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13780a7db0 con 0x55e4ad168e80 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f1395418e00 10 client.26029 _ll_register_callbacks cb 0x7f13780a8b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f1395418e00 1 -- 10.20.193.28:0/1799356441 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e4ace92520 con 0x55e4ad168e80 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f134d7fa640 1 -- 10.20.193.28:0/1799356441 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f13780c8070 con 0x55e4ad168e80 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f134d7fa640 1 -- 10.20.193.28:0/1799356441 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f13780c7030 con 0x55e4ad168e80 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f1395418e00 10 client.26029 fetch_fsmap learned FSMap version 27 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f1395418e00 1 -- 10.20.193.28:0/1799356441 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55e4ad07eb70 con 0x55e4ad168e80 2026-02-20T03:18:55.700 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f134d7fa640 1 -- 10.20.193.28:0/1799356441 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f1378010430 con 0x55e4ad168e80 2026-02-20T03:18:55.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f1395418e00 10 client.26029 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:18:55.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f1395418e00 10 client.26029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:18:55.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f1395418e00 20 client.26029 populate_metadata read hostname 'trial028' 2026-02-20T03:18:55.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.692+0000 7f1395418e00 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e4ad201360 0x55e4ad203820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:18:55.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.693+0000 7f1395418e00 4 client.26029 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:18:55.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.693+0000 7f1395418e00 1 -- 10.20.193.28:0/1799356441 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e4ad0c7290 con 0x55e4ad201360 2026-02-20T03:18:55.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.693+0000 7f138b7fe640 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e4ad201360 0x55e4ad203820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:18:55.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.693+0000 7f138b7fe640 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e4ad201360 0x55e4ad203820 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e98809041e030d7 server_cookie=6b1d41ffef3cca1e in_seq=0 out_seq=0 2026-02-20T03:18:55.701 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.693+0000 7f134d7fa640 10 client.26029 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:55.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.760+0000 7f134d7fa640 1 -- 10.20.193.28:0/1799356441 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e4ad0c7290 con 0x55e4ad201360 2026-02-20T03:18:55.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.760+0000 7f134d7fa640 10 client.26029 handle_command_reply: tid=0 2026-02-20T03:18:55.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.760+0000 7f1395418e00 1 client.26029 shutdown 2026-02-20T03:18:55.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.760+0000 7f1395418e00 1 -- 10.20.193.28:0/1799356441 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad168e80 msgr2=0x55e4ad185040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:55.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.760+0000 7f1395418e00 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad168e80 0x55e4ad185040 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1378093040 tx=0x7f13780b1e10 comp rx=0 tx=0).stop 2026-02-20T03:18:55.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1395418e00 1 -- 10.20.193.28:0/1799356441 shutdown_connections 2026-02-20T03:18:55.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1395418e00 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e4ad201360 0x55e4ad203820 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1395418e00 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e4ad16e560 0x55e4ad187f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1395418e00 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e4ad1697c0 0x55e4ad185580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1395418e00 1 --2- 10.20.193.28:0/1799356441 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e4ad168e80 0x55e4ad185040 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1395418e00 1 -- 10.20.193.28:0/1799356441 >> 10.20.193.28:0/1799356441 conn(0x55e4ad1606f0 msgr2=0x55e4ad16f870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:55.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f134d7fa640 0 client.26029 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:18:55.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1395418e00 1 -- 10.20.193.28:0/1799356441 shutdown_connections 2026-02-20T03:18:55.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1395418e00 1 -- 10.20.193.28:0/1799356441 wait complete. 2026-02-20T03:18:55.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1395418e00 20 client.26029 trim_cache size 0 max 16384 2026-02-20T03:18:55.765 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:18:55.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:18:55.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:18:55.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:18:55.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1391333640 1 -- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13600b0e20 msgr2=0x7f13600b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1391333640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13600b0e20 0x7f13600b32e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1380009e60 tx=0x7f138003a040 comp rx=0 tx=0).stop 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1391333640 1 -- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f138c075a00 msgr2=0x7f138c19c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.761+0000 7f1391333640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f138c075a00 0x7f138c19c990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f13780027e0 tx=0x7f1378002cb0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.762+0000 7f1391333640 1 -- 10.20.193.28:0/264305796 shutdown_connections 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.762+0000 7f1391333640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13600b0e20 0x7f13600b32e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.762+0000 7f1391333640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f138c10a5d0 0x7f138c1a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.762+0000 7f1391333640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f138c077070 0x7f138c19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.762+0000 7f1391333640 1 --2- 10.20.193.28:0/264305796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f138c075a00 0x7f138c19c990 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.762+0000 7f1391333640 1 -- 10.20.193.28:0/264305796 >> 10.20.193.28:0/264305796 conn(0x7f138c0fde10 msgr2=0x7f138c1065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.762+0000 7f1391333640 1 -- 10.20.193.28:0/264305796 shutdown_connections 2026-02-20T03:18:55.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:18:55.762+0000 7f1391333640 1 -- 10.20.193.28:0/264305796 wait complete. 2026-02-20T03:18:56.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 332809 5.75 MB/sec execute 29 sec latency 35.937 ms 2026-02-20T03:18:57.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:57 trial177 ceph-mon[43181]: pgmap v309: 129 pgs: 129 active+clean; 61 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 269 op/s 2026-02-20T03:18:57.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 336803 6.26 MB/sec execute 30 sec latency 6.419 ms 2026-02-20T03:18:57.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:57 trial126 ceph-mon[38476]: pgmap v309: 129 pgs: 129 active+clean; 61 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 269 op/s 2026-02-20T03:18:57.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:57 trial028 ceph-mon[38552]: pgmap v309: 129 pgs: 129 active+clean; 61 MiB data, 1.2 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 269 op/s 2026-02-20T03:18:58.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 340659 6.78 MB/sec execute 31 sec latency 7.516 ms 2026-02-20T03:18:59.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:18:59 trial177 ceph-mon[43181]: pgmap v310: 129 pgs: 129 active+clean; 65 MiB data, 1.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 315 op/s 2026-02-20T03:18:59.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 344356 7.20 MB/sec execute 32 sec latency 6.996 ms 2026-02-20T03:18:59.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:18:59 trial126 ceph-mon[38476]: pgmap v310: 129 pgs: 129 active+clean; 65 MiB data, 1.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 315 op/s 2026-02-20T03:18:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:18:59 trial028 ceph-mon[38552]: pgmap v310: 129 pgs: 129 active+clean; 65 MiB data, 1.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 2.4 MiB/s wr, 315 op/s 2026-02-20T03:19:00.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 348001 7.57 MB/sec execute 33 sec latency 6.536 ms 2026-02-20T03:19:01.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 351614 7.91 MB/sec execute 34 sec latency 7.466 ms 2026-02-20T03:19:01.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:01 trial126 ceph-mon[38476]: pgmap v311: 129 pgs: 129 active+clean; 66 MiB data, 1.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 411 op/s 2026-02-20T03:19:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:01 trial028 ceph-mon[38552]: pgmap v311: 129 pgs: 129 active+clean; 66 MiB data, 1.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 411 op/s 2026-02-20T03:19:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:01 trial177 ceph-mon[43181]: pgmap v311: 129 pgs: 129 active+clean; 66 MiB data, 1.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.6 MiB/s rd, 2.5 MiB/s wr, 411 op/s 2026-02-20T03:19:02.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 355320 8.23 MB/sec execute 35 sec latency 6.858 ms 2026-02-20T03:19:03.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 358935 8.54 MB/sec execute 36 sec latency 9.824 ms 2026-02-20T03:19:03.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:03 trial126 ceph-mon[38476]: pgmap v312: 129 pgs: 129 active+clean; 67 MiB data, 1.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 MiB/s rd, 2.0 MiB/s wr, 403 op/s 2026-02-20T03:19:03.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:03 trial028 ceph-mon[38552]: pgmap v312: 129 pgs: 129 active+clean; 67 MiB data, 1.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 MiB/s rd, 2.0 MiB/s wr, 403 op/s 2026-02-20T03:19:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:03 trial177 ceph-mon[43181]: pgmap v312: 129 pgs: 129 active+clean; 67 MiB data, 1.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.0 MiB/s rd, 2.0 MiB/s wr, 403 op/s 2026-02-20T03:19:04.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 362513 8.83 MB/sec execute 37 sec latency 6.055 ms 2026-02-20T03:19:05.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 366130 9.10 MB/sec execute 38 sec latency 9.122 ms 2026-02-20T03:19:05.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:05 trial126 ceph-mon[38476]: pgmap v313: 129 pgs: 129 active+clean; 73 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 493 op/s 2026-02-20T03:19:05.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:05 trial028 ceph-mon[38552]: pgmap v313: 129 pgs: 129 active+clean; 73 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 493 op/s 2026-02-20T03:19:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:05 trial177 ceph-mon[43181]: pgmap v313: 129 pgs: 129 active+clean; 73 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 493 op/s 2026-02-20T03:19:06.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 369810 9.37 MB/sec execute 39 sec latency 6.731 ms 2026-02-20T03:19:07.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 373410 9.61 MB/sec execute 40 sec latency 7.237 ms 2026-02-20T03:19:07.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:07 trial126 ceph-mon[38476]: pgmap v314: 129 pgs: 129 active+clean; 76 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 457 op/s 2026-02-20T03:19:07.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:07 trial028 ceph-mon[38552]: pgmap v314: 129 pgs: 129 active+clean; 76 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 457 op/s 2026-02-20T03:19:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:07 trial177 ceph-mon[43181]: pgmap v314: 129 pgs: 129 active+clean; 76 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 2.1 MiB/s wr, 457 op/s 2026-02-20T03:19:07.889 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-20T03:19:07.889 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2026-02-20T03:19:07.889 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:19:08.161 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:08.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.343+0000 7f109e412640 1 -- 10.20.193.28:0/4279040377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f109810eef0 msgr2=0x7f109810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:08.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.343+0000 7f109e412640 1 --2- 10.20.193.28:0/4279040377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f109810eef0 0x7f109810f2d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1088009a30 tx=0x7f108802f220 comp rx=0 tx=0).stop 2026-02-20T03:19:08.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.343+0000 7f109e412640 1 -- 10.20.193.28:0/4279040377 shutdown_connections 2026-02-20T03:19:08.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.343+0000 7f109e412640 1 --2- 10.20.193.28:0/4279040377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1098109ba0 0x7f1098115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.343+0000 7f109e412640 1 --2- 10.20.193.28:0/4279040377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1098109220 0x7f1098109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.343+0000 7f109e412640 1 --2- 10.20.193.28:0/4279040377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f109810eef0 0x7f109810f2d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.343+0000 7f109e412640 1 -- 10.20.193.28:0/4279040377 >> 10.20.193.28:0/4279040377 conn(0x7f1098078600 msgr2=0x7f109807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:08.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.343+0000 7f109e412640 1 -- 10.20.193.28:0/4279040377 shutdown_connections 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.343+0000 7f109e412640 1 -- 10.20.193.28:0/4279040377 wait complete. 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.344+0000 7f109e412640 1 Processor -- start 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.344+0000 7f109e412640 1 -- start start 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109e412640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1098109220 0x7f10981a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109e412640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1098109ba0 0x7f10981a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109e412640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f109810eef0 0x7f10981a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109e412640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f10981190b0 con 0x7f109810eef0 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109e412640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1098118f30 con 0x7f1098109ba0 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109e412640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1098119230 con 0x7f1098109220 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109cc0f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1098109ba0 0x7f10981a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109dc11640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f109810eef0 0x7f10981a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109cc0f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1098109ba0 0x7f10981a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39236/0 (socket says 10.20.193.28:39236) 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109cc0f640 1 -- 10.20.193.28:0/3707029566 learned_addr learned my addr 10.20.193.28:0/3707029566 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:08.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109d410640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1098109220 0x7f10981a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109dc11640 1 -- 10.20.193.28:0/3707029566 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1098109220 msgr2=0x7f10981a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109dc11640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1098109220 0x7f10981a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109dc11640 1 -- 10.20.193.28:0/3707029566 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1098109ba0 msgr2=0x7f10981a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109dc11640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1098109ba0 0x7f10981a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.345+0000 7f109dc11640 1 -- 10.20.193.28:0/3707029566 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10981a65c0 con 0x7f109810eef0 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.346+0000 7f109dc11640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f109810eef0 0x7f10981a5e40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f109400efc0 tx=0x7f109400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.346+0000 7f10867fc640 1 -- 10.20.193.28:0/3707029566 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094019070 con 0x7f109810eef0 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.346+0000 7f109e412640 1 -- 10.20.193.28:0/3707029566 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10981a6850 con 0x7f109810eef0 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.346+0000 7f10867fc640 1 -- 10.20.193.28:0/3707029566 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f10940092d0 con 0x7f109810eef0 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.346+0000 7f10867fc640 1 -- 10.20.193.28:0/3707029566 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094007500 con 0x7f109810eef0 2026-02-20T03:19:08.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.346+0000 7f109e412640 1 -- 10.20.193.28:0/3707029566 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10981ae0f0 con 0x7f109810eef0 2026-02-20T03:19:08.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.346+0000 7f1067fff640 1 -- 10.20.193.28:0/3707029566 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1098109660 con 0x7f109810eef0 2026-02-20T03:19:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.348+0000 7f10867fc640 1 -- 10.20.193.28:0/3707029566 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1094002a60 con 0x7f109810eef0 2026-02-20T03:19:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.350+0000 7f10867fc640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10740b0e20 0x7f10740b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.350+0000 7f10867fc640 1 -- 10.20.193.28:0/3707029566 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f10940e0990 con 0x7f109810eef0 2026-02-20T03:19:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.350+0000 7f10867fc640 1 -- 10.20.193.28:0/3707029566 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1094010040 con 0x7f109810eef0 2026-02-20T03:19:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.350+0000 7f109d410640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10740b0e20 0x7f10740b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.351+0000 7f109d410640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10740b0e20 0x7f10740b32e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f10880059c0 tx=0x7f1088005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:08.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.458+0000 7f1067fff640 1 -- 10.20.193.28:0/3707029566 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10981a28d0 con 0x7f109810eef0 2026-02-20T03:19:08.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.459+0000 7f10867fc640 1 -- 10.20.193.28:0/3707029566 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11925 (secure 0 0 0) 0x7f10940aca20 con 0x7f109810eef0 2026-02-20T03:19:08.461 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:19:08.461 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":27,"btime":"2026-02-20T03:18:40:102060+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:18:39.168872+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:19:08.461 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 27 2026-02-20T03:19:08.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 -- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10740b0e20 msgr2=0x7f10740b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:08.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10740b0e20 0x7f10740b32e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f10880059c0 tx=0x7f1088005950 comp rx=0 tx=0).stop 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 -- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f109810eef0 msgr2=0x7f10981a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f109810eef0 0x7f10981a5e40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f109400efc0 tx=0x7f109400c490 comp rx=0 tx=0).stop 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 -- 10.20.193.28:0/3707029566 shutdown_connections 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f10740b0e20 0x7f10740b32e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f109810eef0 0x7f10981a5e40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1098109ba0 0x7f10981a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 --2- 10.20.193.28:0/3707029566 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1098109220 0x7f10981a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.460+0000 7f1067fff640 1 -- 10.20.193.28:0/3707029566 >> 10.20.193.28:0/3707029566 conn(0x7f1098078600 msgr2=0x7f1098079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.461+0000 7f1067fff640 1 -- 10.20.193.28:0/3707029566 shutdown_connections 2026-02-20T03:19:08.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:08.461+0000 7f1067fff640 1 -- 10.20.193.28:0/3707029566 wait complete. 2026-02-20T03:19:08.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 376914 9.85 MB/sec execute 41 sec latency 7.092 ms 2026-02-20T03:19:08.583 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2026-02-20T03:19:08.583 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2026-02-20T03:19:08.817 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:19:08.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.838+0000 7f8a94caa640 1 -- 10.20.193.28:0/1692832505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 msgr2=0x7f8a9010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:08.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.838+0000 7f8a94caa640 1 --2- 10.20.193.28:0/1692832505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 0x7f8a9010a470 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009a30 tx=0x7f8a7c02f260 comp rx=0 tx=0).stop 2026-02-20T03:19:08.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.839+0000 7f8a94caa640 1 -- 10.20.193.28:0/1692832505 shutdown_connections 2026-02-20T03:19:08.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.839+0000 7f8a94caa640 1 --2- 10.20.193.28:0/1692832505 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a9010f6b0 0x7f8a90111aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.839+0000 7f8a94caa640 1 --2- 10.20.193.28:0/1692832505 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a9010a9b0 0x7f8a9010ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.839+0000 7f8a94caa640 1 --2- 10.20.193.28:0/1692832505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 0x7f8a9010a470 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.839+0000 7f8a94caa640 1 -- 10.20.193.28:0/1692832505 >> 10.20.193.28:0/1692832505 conn(0x7f8a9006f7e0 msgr2=0x7f8a90071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:08.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.839+0000 7f8a94caa640 1 -- 10.20.193.28:0/1692832505 shutdown_connections 2026-02-20T03:19:08.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.839+0000 7f8a94caa640 1 -- 10.20.193.28:0/1692832505 wait complete. 2026-02-20T03:19:08.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.840+0000 7f8a94caa640 1 Processor -- start 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.840+0000 7f8a94caa640 1 -- start start 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.840+0000 7f8a94caa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 0x7f8a901a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.840+0000 7f8a94caa640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a9010a9b0 0x7f8a901a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.840+0000 7f8a94caa640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a9010f6b0 0x7f8a901a8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 0x7f8a901a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 0x7f8a901a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55806/0 (socket says 10.20.193.28:55806) 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8f7fe640 1 -- 10.20.193.28:0/3204196853 learned_addr learned my addr 10.20.193.28:0/3204196853 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90116cf0 con 0x7f8a9006b3b0 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90116b70 con 0x7f8a9010f6b0 2026-02-20T03:19:08.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8a90116e70 con 0x7f8a9010a9b0 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8f7fe640 1 -- 10.20.193.28:0/3204196853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a9010a9b0 msgr2=0x7f8a901a15e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8f7fe640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a9010a9b0 0x7f8a901a15e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8f7fe640 1 -- 10.20.193.28:0/3204196853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a9010f6b0 msgr2=0x7f8a901a8650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8f7fe640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a9010f6b0 0x7f8a901a8650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8f7fe640 1 -- 10.20.193.28:0/3204196853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a901a8d50 con 0x7f8a9006b3b0 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8f7fe640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 0x7f8a901a10a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009950 tx=0x7f8a7c02fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8cff9640 1 -- 10.20.193.28:0/3204196853 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c004280 con 0x7f8a9006b3b0 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8cff9640 1 -- 10.20.193.28:0/3204196853 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8a7c004420 con 0x7f8a9006b3b0 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a8cff9640 1 -- 10.20.193.28:0/3204196853 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c004e30 con 0x7f8a9006b3b0 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.841+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a901a8fe0 con 0x7f8a9006b3b0 2026-02-20T03:19:08.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.842+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a901a9500 con 0x7f8a9006b3b0 2026-02-20T03:19:08.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.845+0000 7f8a98e71e00 1 Processor -- start 2026-02-20T03:19:08.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.845+0000 7f8a98e71e00 1 -- start start 2026-02-20T03:19:08.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.845+0000 7f8a8cff9640 1 -- 10.20.193.28:0/3204196853 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8a7c005030 con 0x7f8a9006b3b0 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.845+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab3e80 0x556634ab4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.845+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab47c0 0x556634ab8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.845+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634abb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.845+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556634a048f0 con 0x556634ab9560 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.845+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5566349b22e0 con 0x556634ab3e80 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.845+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556634a00820 con 0x556634ab47c0 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634abb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634abb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55808/0 (socket says 10.20.193.28:55808) 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8effd640 1 -- 10.20.193.28:0/1584931447 learned_addr learned my addr 10.20.193.28:0/1584931447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8effd640 1 -- 10.20.193.28:0/1584931447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab47c0 msgr2=0x556634ab8f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:08.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8effd640 1 --2- 10.20.193.28:0/1584931447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab47c0 0x556634ab8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8effd640 1 -- 10.20.193.28:0/1584931447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab3e80 msgr2=0x556634ab4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8effd640 1 --2- 10.20.193.28:0/1584931447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab3e80 0x556634ab4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8effd640 1 -- 10.20.193.28:0/1584931447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566349a45a0 con 0x556634ab9560 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8cff9640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a640b0e20 0x7f8a640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8cff9640 1 -- 10.20.193.28:0/3204196853 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8a7c1049a0 con 0x7f8a9006b3b0 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8effd640 1 --2- 10.20.193.28:0/1584931447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634abb9f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009840 tx=0x7f8a80009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f052fc40ef15f670 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.846+0000 7f8a8ffff640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a640b0e20 0x7f8a640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a5b7fe640 1 -- 10.20.193.28:0/1584931447 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a80016070 con 0x556634ab9560 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a5b7fe640 1 -- 10.20.193.28:0/1584931447 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8a80004480 con 0x556634ab9560 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a5b7fe640 1 -- 10.20.193.28:0/1584931447 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000bd00 con 0x556634ab9560 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a98e71e00 1 -- 10.20.193.28:0/1584931447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 msgr2=0x556634abb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/1584931447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634abb9f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009840 tx=0x7f8a80009d10 comp rx=0 tx=0).stop 2026-02-20T03:19:08.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a8ffff640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a640b0e20 0x7f8a640b32e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400aab0 tx=0x7f8a84009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:08.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a98e71e00 1 -- 10.20.193.28:0/1584931447 shutdown_connections 2026-02-20T03:19:08.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/1584931447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634abb9f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/1584931447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab47c0 0x556634ab8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/1584931447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab3e80 0x556634ab4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a98e71e00 1 -- 10.20.193.28:0/1584931447 >> 10.20.193.28:0/1584931447 conn(0x556634aab6f0 msgr2=0x556634ab2570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:08.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a98e71e00 1 -- 10.20.193.28:0/1584931447 shutdown_connections 2026-02-20T03:19:08.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.847+0000 7f8a98e71e00 1 -- 10.20.193.28:0/1584931447 wait complete. 2026-02-20T03:19:08.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a98e71e00 1 -- start start 2026-02-20T03:19:08.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a98e71e00 1 Processor -- start 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab3e80 0x556634acc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab47c0 0x556634accda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ad3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5566349ac0c0 con 0x556634ab9560 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556634abc610 con 0x556634ab47c0 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556634ad42b0 con 0x556634ab3e80 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ad3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ad3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55824/0 (socket says 10.20.193.28:55824) 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.849+0000 7f8a8ffff640 1 -- 10.20.193.28:0/3392783243 learned_addr learned my addr 10.20.193.28:0/3392783243 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a8ffff640 1 -- 10.20.193.28:0/3392783243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab3e80 msgr2=0x556634acc860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a8ffff640 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab3e80 0x556634acc860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a8ffff640 1 -- 10.20.193.28:0/3392783243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab47c0 msgr2=0x556634accda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a8ffff640 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab47c0 0x556634accda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a8ffff640 1 -- 10.20.193.28:0/3392783243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556634ac62b0 con 0x556634ab9560 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a8ffff640 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ad3d20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8a84004380 tx=0x7f8a84004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d0f28fa4884448 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a58ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3392783243 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8400d9a0 con 0x556634ab9560 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3392783243 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8a8401f020 con 0x556634ab9560 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3392783243 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8401ae00 con 0x556634ab9560 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3392783243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566349c0820 con 0x556634ab9560 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a98e71e00 10 client.16299 _ll_register_callbacks cb 0x5566349afff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3392783243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556634a0c4e0 con 0x556634ab9560 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3392783243 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8a84024410 con 0x556634ab9560 2026-02-20T03:19:08.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3392783243 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a840246f0 con 0x556634ab9560 2026-02-20T03:19:08.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a98e71e00 10 client.16299 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:08.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.850+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3392783243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5566349c5380 con 0x556634ab9560 2026-02-20T03:19:08.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.851+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3392783243 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f8a8401a430 con 0x556634ab9560 2026-02-20T03:19:08.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.851+0000 7f8a98e71e00 10 client.16299 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:08.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.851+0000 7f8a98e71e00 10 client.16299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:08.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.851+0000 7f8a98e71e00 20 client.16299 populate_metadata read hostname 'trial028' 2026-02-20T03:19:08.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.851+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556634ad8730 0x556634adabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.851+0000 7f8a98e71e00 4 client.16299 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:08.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.851+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3392783243 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556634986bd0 con 0x556634ad8730 2026-02-20T03:19:08.865 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:08.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.873+0000 7f8a8f7fe640 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556634ad8730 0x556634adabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.926+0000 7f8a58ff9640 10 client.16299 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:08.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.926+0000 7f8a8f7fe640 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556634ad8730 0x556634adabf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6436f9a499a50617 server_cookie=a4dfc8152c154b61 in_seq=0 out_seq=0 2026-02-20T03:19:08.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3392783243 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556634986bd0 con 0x556634ad8730 2026-02-20T03:19:08.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a58ff9640 10 client.16299 handle_command_reply: tid=0 2026-02-20T03:19:08.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 client.16299 shutdown 2026-02-20T03:19:08.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3392783243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 msgr2=0x556634ad3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:08.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ad3d20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8a84004380 tx=0x7f8a84004c40 comp rx=0 tx=0).stop 2026-02-20T03:19:08.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3392783243 shutdown_connections 2026-02-20T03:19:08.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556634ad8730 0x556634adabf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ad3d20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab47c0 0x556634accda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3392783243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab3e80 0x556634acc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3392783243 >> 10.20.193.28:0/3392783243 conn(0x556634aab6f0 msgr2=0x556634aba870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:08.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a58ff9640 0 client.16299 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:08.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3392783243 shutdown_connections 2026-02-20T03:19:08.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.940+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3392783243 wait complete. 2026-02-20T03:19:08.944 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.941+0000 7f8a98e71e00 20 client.16299 trim_cache size 0 max 16384 2026-02-20T03:19:08.953 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a98e71e00 1 Processor -- start 2026-02-20T03:19:08.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a98e71e00 1 -- start start 2026-02-20T03:19:08.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab3e80 0x556634ac93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab47c0 0x556634ad3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ac9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a34012780 con 0x556634ab9560 2026-02-20T03:19:08.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3400ffc0 con 0x556634ab3e80 2026-02-20T03:19:08.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3400de10 con 0x556634ab47c0 2026-02-20T03:19:08.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ac9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ac9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55840/0 (socket says 10.20.193.28:55840) 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a8ffff640 1 -- 10.20.193.28:0/4108369660 learned_addr learned my addr 10.20.193.28:0/4108369660 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a8ffff640 1 -- 10.20.193.28:0/4108369660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab47c0 msgr2=0x556634ad3ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a8ffff640 1 --2- 10.20.193.28:0/4108369660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab47c0 0x556634ad3ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a8ffff640 1 -- 10.20.193.28:0/4108369660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab3e80 msgr2=0x556634ac93c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a8ffff640 1 --2- 10.20.193.28:0/4108369660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab3e80 0x556634ac93c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.949+0000 7f8a8ffff640 1 -- 10.20.193.28:0/4108369660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556634ac60e0 con 0x556634ab9560 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a8ffff640 1 --2- 10.20.193.28:0/4108369660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ac9900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400d010 tx=0x7f8a84026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98083fa7aaf7c60e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a5affd640 1 -- 10.20.193.28:0/4108369660 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8401e020 con 0x556634ab9560 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a5affd640 1 -- 10.20.193.28:0/4108369660 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x556634a0c4e0 con 0x556634ab9560 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a5affd640 1 -- 10.20.193.28:0/4108369660 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84024890 con 0x556634ab9560 2026-02-20T03:19:08.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a98e71e00 1 -- 10.20.193.28:0/4108369660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 msgr2=0x556634ac9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:08.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/4108369660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ac9900 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400d010 tx=0x7f8a84026000 comp rx=0 tx=0).stop 2026-02-20T03:19:08.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a98e71e00 1 -- 10.20.193.28:0/4108369660 shutdown_connections 2026-02-20T03:19:08.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/4108369660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab9560 0x556634ac9900 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/4108369660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab47c0 0x556634ad3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/4108369660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab3e80 0x556634ac93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a98e71e00 1 -- 10.20.193.28:0/4108369660 >> 10.20.193.28:0/4108369660 conn(0x556634aab6f0 msgr2=0x556634acb640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:08.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a98e71e00 1 -- 10.20.193.28:0/4108369660 shutdown_connections 2026-02-20T03:19:08.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.950+0000 7f8a98e71e00 1 -- 10.20.193.28:0/4108369660 wait complete. 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.951+0000 7f8a98e71e00 1 -- start start 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.951+0000 7f8a98e71e00 1 Processor -- start 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.951+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab3e80 0x556634ad3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.951+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab47c0 0x556634ad39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.951+0000 7f8a98e71e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab9560 0x556634acffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.951+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3400e480 con 0x556634ab3e80 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.951+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3400f8f0 con 0x556634ab47c0 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.951+0000 7f8a98e71e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3400eb50 con 0x556634ab9560 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a8f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab3e80 0x556634ad3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a8f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab3e80 0x556634ad3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55844/0 (socket says 10.20.193.28:55844) 2026-02-20T03:19:08.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a8f7fe640 1 -- 10.20.193.28:0/3475010432 learned_addr learned my addr 10.20.193.28:0/3475010432 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a8f7fe640 1 -- 10.20.193.28:0/3475010432 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab9560 msgr2=0x556634acffe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a8f7fe640 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab9560 0x556634acffe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a8f7fe640 1 -- 10.20.193.28:0/3475010432 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab47c0 msgr2=0x556634ad39c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a8f7fe640 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab47c0 0x556634ad39c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a8f7fe640 1 -- 10.20.193.28:0/3475010432 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556634abc370 con 0x556634ab3e80 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a8f7fe640 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab3e80 0x556634ad3480 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0cc380 tx=0x7f8a7c02f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbdd4979cab573a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a58ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3475010432 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0f1070 con 0x556634ab3e80 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3475010432 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8a7c033070 con 0x556634ab3e80 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3475010432 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0d1bc0 con 0x556634ab3e80 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3475010432 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556634764690 con 0x556634ab3e80 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3475010432 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8a7c0d1d80 con 0x556634ab3e80 2026-02-20T03:19:08.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a98e71e00 10 client.16305 _ll_register_callbacks cb 0x7f8a8400cda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3475010432 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a80004480 con 0x556634ab3e80 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.952+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3475010432 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a7c0d0a30 con 0x556634ab3e80 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.953+0000 7f8a98e71e00 10 client.16305 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.953+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3475010432 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5566349c9b70 con 0x556634ab3e80 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.953+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3475010432 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f8a7c0c6bc0 con 0x556634ab3e80 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.953+0000 7f8a98e71e00 10 client.16305 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.953+0000 7f8a98e71e00 10 client.16305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.953+0000 7f8a98e71e00 20 client.16305 populate_metadata read hostname 'trial028' 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.953+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556634b447e0 0x556634b46ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.953+0000 7f8a98e71e00 4 client.16305 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:19:08.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.953+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3475010432 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5566349d56b0 con 0x556634b447e0 2026-02-20T03:19:08.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.967+0000 7f8a8effd640 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556634b447e0 0x556634b46ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:08.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.967+0000 7f8a8effd640 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556634b447e0 0x556634b46ca0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60026f9fffd48d54 server_cookie=4294d5d6e873de65 in_seq=0 out_seq=0 2026-02-20T03:19:08.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:08.967+0000 7f8a58ff9640 10 client.16305 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a58ff9640 1 -- 10.20.193.28:0/3475010432 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5566349d56b0 con 0x556634b447e0 2026-02-20T03:19:09.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a58ff9640 10 client.16305 handle_command_reply: tid=0 2026-02-20T03:19:09.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 client.16305 shutdown 2026-02-20T03:19:09.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3475010432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab3e80 msgr2=0x556634ad3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab3e80 0x556634ad3480 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0cc380 tx=0x7f8a7c02f260 comp rx=0 tx=0).stop 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3475010432 shutdown_connections 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556634b447e0 0x556634b46ca0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556634ab9560 0x556634acffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556634ab47c0 0x556634ad39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 --2- 10.20.193.28:0/3475010432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556634ab3e80 0x556634ad3480 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3475010432 >> 10.20.193.28:0/3475010432 conn(0x556634aab6f0 msgr2=0x556634acbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a58ff9640 0 client.16305 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3475010432 shutdown_connections 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.070+0000 7f8a98e71e00 1 -- 10.20.193.28:0/3475010432 wait complete. 2026-02-20T03:19:09.073 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.071+0000 7f8a98e71e00 20 client.16305 trim_cache size 0 max 16384 2026-02-20T03:19:09.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:19:09.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:19:09.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:19:09.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:19:09.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.071+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a640b0e20 msgr2=0x7f8a640b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.071+0000 7f8a94caa640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a640b0e20 0x7f8a640b32e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400aab0 tx=0x7f8a84009250 comp rx=0 tx=0).stop 2026-02-20T03:19:09.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.071+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 msgr2=0x7f8a901a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.071+0000 7f8a94caa640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 0x7f8a901a10a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009950 tx=0x7f8a7c02fdc0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.072+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 shutdown_connections 2026-02-20T03:19:09.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.072+0000 7f8a94caa640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a640b0e20 0x7f8a640b32e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.072+0000 7f8a94caa640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a9010f6b0 0x7f8a901a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.072+0000 7f8a94caa640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a9010a9b0 0x7f8a901a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.072+0000 7f8a94caa640 1 --2- 10.20.193.28:0/3204196853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a9006b3b0 0x7f8a901a10a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.072+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 >> 10.20.193.28:0/3204196853 conn(0x7f8a9006f7e0 msgr2=0x7f8a90071bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.072+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 shutdown_connections 2026-02-20T03:19:09.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:09.072+0000 7f8a94caa640 1 -- 10.20.193.28:0/3204196853 wait complete. 2026-02-20T03:19:09.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.108+0000 7faf200f5640 1 -- 10.20.193.28:0/1349745484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf1810f1e0 msgr2=0x7faf1810f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.108+0000 7faf200f5640 1 --2- 10.20.193.28:0/1349745484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf1810f1e0 0x7faf1810f5c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faf08009a30 tx=0x7faf0802f220 comp rx=0 tx=0).stop 2026-02-20T03:19:09.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.108+0000 7faf200f5640 1 -- 10.20.193.28:0/1349745484 shutdown_connections 2026-02-20T03:19:09.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.108+0000 7faf200f5640 1 --2- 10.20.193.28:0/1349745484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf18109bc0 0x7faf18115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.108+0000 7faf200f5640 1 --2- 10.20.193.28:0/1349745484 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faf18109220 0x7faf18109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.108+0000 7faf200f5640 1 --2- 10.20.193.28:0/1349745484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf1810f1e0 0x7faf1810f5c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.108+0000 7faf200f5640 1 -- 10.20.193.28:0/1349745484 >> 10.20.193.28:0/1349745484 conn(0x7faf18078860 msgr2=0x7faf1807ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.108+0000 7faf200f5640 1 -- 10.20.193.28:0/1349745484 shutdown_connections 2026-02-20T03:19:09.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.108+0000 7faf200f5640 1 -- 10.20.193.28:0/1349745484 wait complete. 2026-02-20T03:19:09.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.109+0000 7faf200f5640 1 Processor -- start 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.109+0000 7faf200f5640 1 -- start start 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf200f5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faf18109220 0x7faf181a7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf200f5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf18109bc0 0x7faf181a7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf200f5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf1810f1e0 0x7faf181a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf200f5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf181192a0 con 0x7faf1810f1e0 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf200f5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faf18119120 con 0x7faf18109bc0 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf200f5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf18119420 con 0x7faf18109220 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1d669640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf18109bc0 0x7faf181a7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1d669640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf18109bc0 0x7faf181a7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39300/0 (socket says 10.20.193.28:39300) 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1e66b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf1810f1e0 0x7faf181a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1d669640 1 -- 10.20.193.28:0/2163487825 learned_addr learned my addr 10.20.193.28:0/2163487825 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1de6a640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faf18109220 0x7faf181a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1d669640 1 -- 10.20.193.28:0/2163487825 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faf18109220 msgr2=0x7faf181a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1d669640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faf18109220 0x7faf181a7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1d669640 1 -- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf1810f1e0 msgr2=0x7faf181a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1d669640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf1810f1e0 0x7faf181a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1d669640 1 -- 10.20.193.28:0/2163487825 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf181a1da0 con 0x7faf18109bc0 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.110+0000 7faf1e66b640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf1810f1e0 0x7faf181a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.111+0000 7faf1d669640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf18109bc0 0x7faf181a7950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00d950 tx=0x7faf0c00de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.111+0000 7faf06ffd640 1 -- 10.20.193.28:0/2163487825 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c014070 con 0x7faf18109bc0 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.111+0000 7faf200f5640 1 -- 10.20.193.28:0/2163487825 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf181a2090 con 0x7faf18109bc0 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.111+0000 7faf200f5640 1 -- 10.20.193.28:0/2163487825 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1806ca60 con 0x7faf18109bc0 2026-02-20T03:19:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.111+0000 7faf06ffd640 1 -- 10.20.193.28:0/2163487825 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faf0c0044e0 con 0x7faf18109bc0 2026-02-20T03:19:09.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.111+0000 7faf06ffd640 1 -- 10.20.193.28:0/2163487825 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c005280 con 0x7faf18109bc0 2026-02-20T03:19:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.114+0000 7faf225fae00 1 Processor -- start 2026-02-20T03:19:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf225fae00 1 -- start start 2026-02-20T03:19:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf06ffd640 1 -- 10.20.193.28:0/2163487825 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7faf0c005420 con 0x7faf18109bc0 2026-02-20T03:19:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf225fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b518977450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf225fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b518971cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf225fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518972200 0x55b51897ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf225fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b5188c4410 con 0x55b518972200 2026-02-20T03:19:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf225fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b5188718b0 con 0x55b518971860 2026-02-20T03:19:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf225fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b5188c0340 con 0x55b518977070 2026-02-20T03:19:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf1e66b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b518977450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf1e66b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b518977450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48226/0 (socket says 10.20.193.28:48226) 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.115+0000 7faf1e66b640 1 -- 10.20.193.28:0/3440632054 learned_addr learned my addr 10.20.193.28:0/3440632054 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faf1de6a640 1 --2- 10.20.193.28:0/3440632054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b518971cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faf1de6a640 1 -- 10.20.193.28:0/3440632054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 msgr2=0x55b518977450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faf1de6a640 1 --2- 10.20.193.28:0/3440632054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b518977450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faf1de6a640 1 -- 10.20.193.28:0/3440632054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518972200 msgr2=0x55b51897ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faf1de6a640 1 --2- 10.20.193.28:0/3440632054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518972200 0x55b51897ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faf1de6a640 1 -- 10.20.193.28:0/3440632054 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5188638c0 con 0x55b518971860 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faf1de6a640 1 --2- 10.20.193.28:0/3440632054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b518971cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf08005ec0 tx=0x7faf080057d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccdfaa5aacd6f04c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faee64e6640 1 -- 10.20.193.28:0/3440632054 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0802fc80 con 0x55b518971860 2026-02-20T03:19:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faee64e6640 1 -- 10.20.193.28:0/3440632054 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faf08046070 con 0x55b518971860 2026-02-20T03:19:09.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.116+0000 7faee64e6640 1 -- 10.20.193.28:0/3440632054 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08038d60 con 0x55b518971860 2026-02-20T03:19:09.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.117+0000 7faf225fae00 1 -- 10.20.193.28:0/3440632054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 msgr2=0x55b518971cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.117+0000 7faf225fae00 1 --2- 10.20.193.28:0/3440632054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b518971cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf08005ec0 tx=0x7faf080057d0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.117+0000 7faf225fae00 1 -- 10.20.193.28:0/3440632054 shutdown_connections 2026-02-20T03:19:09.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.117+0000 7faf225fae00 1 --2- 10.20.193.28:0/3440632054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518972200 0x55b51897ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.117+0000 7faf225fae00 1 --2- 10.20.193.28:0/3440632054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b518971cc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.117+0000 7faf225fae00 1 --2- 10.20.193.28:0/3440632054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b518977450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.117+0000 7faf225fae00 1 -- 10.20.193.28:0/3440632054 >> 10.20.193.28:0/3440632054 conn(0x55b51896a3c0 msgr2=0x55b51896ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.118+0000 7faf225fae00 1 -- 10.20.193.28:0/3440632054 shutdown_connections 2026-02-20T03:19:09.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.118+0000 7faf225fae00 1 -- 10.20.193.28:0/3440632054 wait complete. 2026-02-20T03:19:09.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.118+0000 7faf06ffd640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faef40b0d80 0x7faef40b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.118+0000 7faf06ffd640 1 -- 10.20.193.28:0/2163487825 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7faf0c0e0870 con 0x7faf18109bc0 2026-02-20T03:19:09.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.119+0000 7faf1de6a640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faef40b0d80 0x7faef40b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.119+0000 7faf225fae00 1 -- start start 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.119+0000 7faf225fae00 1 Processor -- start 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faef40b0d80 0x7faef40b3240 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf080097c0 tx=0x7faf080023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf225fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b51898c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf225fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518972200 0x55b51898c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf225fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b51898aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf225fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b51886b4a0 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf225fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b51897e460 con 0x55b518972200 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf225fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b51898b060 con 0x55b518977070 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b51898c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b51898c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55898/0 (socket says 10.20.193.28:55898) 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 -- 10.20.193.28:0/1357138315 learned_addr learned my addr 10.20.193.28:0/1357138315 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1d669640 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518972200 0x55b51898c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1e66b640 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b51898aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 -- 10.20.193.28:0/1357138315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 msgr2=0x55b51898aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b51898aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 -- 10.20.193.28:0/1357138315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518972200 msgr2=0x55b51898c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518972200 0x55b51898c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 -- 10.20.193.28:0/1357138315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b518983d90 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faf1de6a640 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b51898c270 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faf08009a00 tx=0x7faf080057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62eb538703c5e7bc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.120+0000 7faed37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faed37fe640 1 -- 10.20.193.28:0/1357138315 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08059070 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faf225fae00 1 -- 10.20.193.28:0/1357138315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5186288a0 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faf225fae00 10 client.16314 _ll_register_callbacks cb 0x55b51886f3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faed37fe640 1 -- 10.20.193.28:0/1357138315 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faf08033040 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faed37fe640 1 -- 10.20.193.28:0/1357138315 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0804e070 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faf225fae00 1 -- 10.20.193.28:0/1357138315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5188cc000 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faed37fe640 1 -- 10.20.193.28:0/1357138315 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7faf08055430 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faed37fe640 1 -- 10.20.193.28:0/1357138315 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faf08063060 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faf225fae00 10 client.16314 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.121+0000 7faf225fae00 1 -- 10.20.193.28:0/1357138315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55b5186940e0 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.122+0000 7faed37fe640 1 -- 10.20.193.28:0/1357138315 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7faf08002af0 con 0x55b518971860 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.122+0000 7faf225fae00 10 client.16314 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:09.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.122+0000 7faf225fae00 10 client.16314 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.122+0000 7faf225fae00 20 client.16314 populate_metadata read hostname 'trial028' 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.122+0000 7faf225fae00 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b51899a360 0x55b51899c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.122+0000 7faf225fae00 4 client.16314 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.122+0000 7faf225fae00 1 -- 10.20.193.28:0/1357138315 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b518845f60 con 0x55b51899a360 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.122+0000 7faf1d669640 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b51899a360 0x55b51899c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.123+0000 7faed37fe640 10 client.16314 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.123+0000 7faf1d669640 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b51899a360 0x55b51899c750 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bab2e80f8479cfad server_cookie=85bc979e2a1f57e in_seq=0 out_seq=0 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.123+0000 7faed37fe640 1 -- 10.20.193.28:0/1357138315 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b518845f60 con 0x55b51899a360 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.123+0000 7faed37fe640 10 client.16314 handle_command_reply: tid=0 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.123+0000 7faf225fae00 1 client.16314 shutdown 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.123+0000 7faf225fae00 1 -- 10.20.193.28:0/1357138315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 msgr2=0x55b51898c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.123+0000 7faf225fae00 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b51898c270 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7faf08009a00 tx=0x7faf080057d0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faf225fae00 1 -- 10.20.193.28:0/1357138315 shutdown_connections 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faf225fae00 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b51899a360 0x55b51899c750 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faf225fae00 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b51898aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faf225fae00 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518972200 0x55b51898c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faf225fae00 1 --2- 10.20.193.28:0/1357138315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b51898c270 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faf225fae00 1 -- 10.20.193.28:0/1357138315 >> 10.20.193.28:0/1357138315 conn(0x55b51896a3c0 msgr2=0x55b518970670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faed37fe640 0 client.16314 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faf225fae00 1 -- 10.20.193.28:0/1357138315 shutdown_connections 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faf225fae00 1 -- 10.20.193.28:0/1357138315 wait complete. 2026-02-20T03:19:09.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.124+0000 7faf225fae00 20 client.16314 trim_cache size 0 max 16384 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf225fae00 1 Processor -- start 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf225fae00 1 -- start start 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf225fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b518987e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf225fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518972200 0x55b518988380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf225fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518977070 0x55b5189a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf225fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faec4012800 con 0x55b518971860 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf225fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faec4010040 con 0x55b518977070 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf225fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faec400de90 con 0x55b518972200 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1d669640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518972200 0x55b518988380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1d669640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518972200 0x55b518988380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48246/0 (socket says 10.20.193.28:48246) 2026-02-20T03:19:09.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1d669640 1 -- 10.20.193.28:0/3081037024 learned_addr learned my addr 10.20.193.28:0/3081037024 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1de6a640 1 --2- 10.20.193.28:0/3081037024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b518987e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1d669640 1 -- 10.20.193.28:0/3081037024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518977070 msgr2=0x55b5189a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1d669640 1 --2- 10.20.193.28:0/3081037024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518977070 0x55b5189a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1d669640 1 -- 10.20.193.28:0/3081037024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 msgr2=0x55b518987e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1d669640 1 --2- 10.20.193.28:0/3081037024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b518987e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1d669640 1 -- 10.20.193.28:0/3081037024 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b518983bc0 con 0x55b518972200 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.134+0000 7faf1de6a640 1 --2- 10.20.193.28:0/3081037024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b518987e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf1d669640 1 --2- 10.20.193.28:0/3081037024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518972200 0x55b518988380 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005fd0 tx=0x7faf0c004b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0bc0c7850c10d67 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faee5ce5640 1 -- 10.20.193.28:0/3081037024 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c01d040 con 0x55b518972200 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faee5ce5640 1 -- 10.20.193.28:0/3081037024 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55b518845f60 con 0x55b518972200 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faee5ce5640 1 -- 10.20.193.28:0/3081037024 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0a2ba0 con 0x55b518972200 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf225fae00 1 -- 10.20.193.28:0/3081037024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518972200 msgr2=0x55b518988380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf225fae00 1 --2- 10.20.193.28:0/3081037024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518972200 0x55b518988380 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005fd0 tx=0x7faf0c004b20 comp rx=0 tx=0).stop 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf225fae00 1 -- 10.20.193.28:0/3081037024 shutdown_connections 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf225fae00 1 --2- 10.20.193.28:0/3081037024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518977070 0x55b5189a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf225fae00 1 --2- 10.20.193.28:0/3081037024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518972200 0x55b518988380 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf225fae00 1 --2- 10.20.193.28:0/3081037024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518971860 0x55b518987e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf225fae00 1 -- 10.20.193.28:0/3081037024 >> 10.20.193.28:0/3081037024 conn(0x55b51896a3c0 msgr2=0x55b518989ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf225fae00 1 -- 10.20.193.28:0/3081037024 shutdown_connections 2026-02-20T03:19:09.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.135+0000 7faf225fae00 1 -- 10.20.193.28:0/3081037024 wait complete. 2026-02-20T03:19:09.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.136+0000 7faf225fae00 1 -- start start 2026-02-20T03:19:09.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.136+0000 7faf225fae00 1 Processor -- start 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.136+0000 7faf225fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b5189900d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.136+0000 7faf225fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518972200 0x55b518990610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.136+0000 7faf225fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b518990b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.136+0000 7faf225fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faec400e500 con 0x55b518972200 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1d669640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518972200 0x55b518990610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1de6a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b5189900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1de6a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b5189900d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39342/0 (socket says 10.20.193.28:39342) 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1de6a640 1 -- 10.20.193.28:0/1938507248 learned_addr learned my addr 10.20.193.28:0/1938507248 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faec400f970 con 0x55b518971860 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faec400ebd0 con 0x55b518977070 2026-02-20T03:19:09.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1e66b640 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b518990b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1de6a640 1 -- 10.20.193.28:0/1938507248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 msgr2=0x55b518990b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1de6a640 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b518990b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1de6a640 1 -- 10.20.193.28:0/1938507248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518972200 msgr2=0x55b518990610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1de6a640 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518972200 0x55b518990610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.137+0000 7faf1de6a640 1 -- 10.20.193.28:0/1938507248 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b518983780 con 0x55b518971860 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faf1de6a640 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b5189900d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf0802f240 tx=0x7faf08009880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57a3a6e193b5022d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faed37fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faed37fe640 1 -- 10.20.193.28:0/1938507248 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0804e070 con 0x55b518971860 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faed37fe640 1 -- 10.20.193.28:0/1938507248 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faf08033040 con 0x55b518971860 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5186457f0 con 0x55b518971860 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faed37fe640 1 -- 10.20.193.28:0/1938507248 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08059040 con 0x55b518971860 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faf225fae00 10 client.26045 _ll_register_callbacks cb 0x7faf08004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:09.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf08046070 con 0x55b518971860 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faed37fe640 1 -- 10.20.193.28:0/1938507248 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7faf0805e450 con 0x55b518971860 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faed37fe640 1 -- 10.20.193.28:0/1938507248 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faf0805e710 con 0x55b518971860 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faf225fae00 10 client.26045 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.138+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55b5189848b0 con 0x55b518971860 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.139+0000 7faed37fe640 1 -- 10.20.193.28:0/1938507248 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7faf08055890 con 0x55b518971860 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.139+0000 7faf225fae00 10 client.26045 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.139+0000 7faf225fae00 10 client.26045 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.139+0000 7faf225fae00 20 client.26045 populate_metadata read hostname 'trial028' 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.139+0000 7faf225fae00 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b518a07330 0x55b518a097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.139+0000 7faf225fae00 4 client.26045 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.139+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55b518634f60 con 0x55b518a07330 2026-02-20T03:19:09.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.139+0000 7faf1d669640 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b518a07330 0x55b518a097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.140+0000 7faf1d669640 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b518a07330 0x55b518a097f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d37157361e70ffa server_cookie=ba8963d739d0ef53 in_seq=0 out_seq=0 2026-02-20T03:19:09.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.140+0000 7faed37fe640 10 client.26045 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.153 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.161+0000 7faed37fe640 1 -- 10.20.193.28:0/1938507248 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b518634f60 con 0x55b518a07330 2026-02-20T03:19:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.161+0000 7faed37fe640 10 client.26045 handle_command_reply: tid=0 2026-02-20T03:19:09.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.161+0000 7faf225fae00 1 client.26045 shutdown 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.161+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 msgr2=0x55b5189900d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.161+0000 7faf225fae00 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b5189900d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faf0802f240 tx=0x7faf08009880 comp rx=0 tx=0).stop 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.161+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 shutdown_connections 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.161+0000 7faf225fae00 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b518a07330 0x55b518a097f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf225fae00 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b518977070 0x55b518990b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faed37fe640 0 client.26045 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf225fae00 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b518972200 0x55b518990610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf225fae00 1 --2- 10.20.193.28:0/1938507248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b518971860 0x55b5189900d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 >> 10.20.193.28:0/1938507248 conn(0x55b51896a3c0 msgr2=0x55b51899a740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 shutdown_connections 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf225fae00 1 -- 10.20.193.28:0/1938507248 wait complete. 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf225fae00 20 client.26045 trim_cache size 0 max 16384 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:19:09.163 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 27, 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 14, 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "3841e494": { 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "version": 14, 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf200f5640 1 -- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faef40b0d80 msgr2=0x7faef40b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf200f5640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faef40b0d80 0x7faef40b3240 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7faf080097c0 tx=0x7faf080023d0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf200f5640 1 -- 10.20.193.28:0/2163487825 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf18109bc0 msgr2=0x7faf181a7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.162+0000 7faf200f5640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf18109bc0 0x7faf181a7950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faf0c00d950 tx=0x7faf0c00de20 comp rx=0 tx=0).stop 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.163+0000 7faf200f5640 1 -- 10.20.193.28:0/2163487825 shutdown_connections 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.163+0000 7faf200f5640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faef40b0d80 0x7faef40b3240 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.163+0000 7faf200f5640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faf1810f1e0 0x7faf181a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.163+0000 7faf200f5640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faf18109bc0 0x7faf181a7950 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.163+0000 7faf200f5640 1 --2- 10.20.193.28:0/2163487825 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faf18109220 0x7faf181a7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.163+0000 7faf200f5640 1 -- 10.20.193.28:0/2163487825 >> 10.20.193.28:0/2163487825 conn(0x7faf18078860 msgr2=0x7faf1807a360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.163+0000 7faf200f5640 1 -- 10.20.193.28:0/2163487825 shutdown_connections 2026-02-20T03:19:09.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.163+0000 7faf200f5640 1 -- 10.20.193.28:0/2163487825 wait complete. 2026-02-20T03:19:09.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:09 trial028 ceph-mon[38552]: pgmap v315: 129 pgs: 129 active+clean; 80 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 MiB/s rd, 2.5 MiB/s wr, 525 op/s 2026-02-20T03:19:09.235 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:09 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3707029566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:09.263 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3841e494', quiesce took 1.4 seconds. Will release after: 28.6 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.370+0000 7f9072281640 1 -- 10.20.193.28:0/2511279371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906c10eef0 msgr2=0x7f906c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.370+0000 7f9072281640 1 --2- 10.20.193.28:0/2511279371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906c10eef0 0x7f906c10f2d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f905c009a30 tx=0x7f905c02f220 comp rx=0 tx=0).stop 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.370+0000 7f9072281640 1 -- 10.20.193.28:0/2511279371 shutdown_connections 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.370+0000 7f9072281640 1 --2- 10.20.193.28:0/2511279371 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f906c109ba0 0x7f906c115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.370+0000 7f9072281640 1 --2- 10.20.193.28:0/2511279371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f906c109220 0x7f906c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.370+0000 7f9072281640 1 --2- 10.20.193.28:0/2511279371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906c10eef0 0x7f906c10f2d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.370+0000 7f9072281640 1 -- 10.20.193.28:0/2511279371 >> 10.20.193.28:0/2511279371 conn(0x7f906c078600 msgr2=0x7f906c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.370+0000 7f9072281640 1 -- 10.20.193.28:0/2511279371 shutdown_connections 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.370+0000 7f9072281640 1 -- 10.20.193.28:0/2511279371 wait complete. 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.371+0000 7f9072281640 1 Processor -- start 2026-02-20T03:19:09.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.371+0000 7f9072281640 1 -- start start 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9072281640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906c109220 0x7f906c1a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9072281640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f906c109ba0 0x7f906c1a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9072281640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f906c10eef0 0x7f906c1a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9072281640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f906c1190a0 con 0x7f906c109220 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9072281640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f906c118f20 con 0x7f906c109ba0 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9072281640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f906c119220 con 0x7f906c10eef0 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f907127f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906c109220 0x7f906c1a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9070a7e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f906c109ba0 0x7f906c1a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9070a7e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f906c109ba0 0x7f906c1a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39364/0 (socket says 10.20.193.28:39364) 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9070a7e640 1 -- 10.20.193.28:0/1433919663 learned_addr learned my addr 10.20.193.28:0/1433919663 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f9071a80640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f906c10eef0 0x7f906c1a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f907127f640 1 -- 10.20.193.28:0/1433919663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f906c10eef0 msgr2=0x7f906c1a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f907127f640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f906c10eef0 0x7f906c1a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f907127f640 1 -- 10.20.193.28:0/1433919663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f906c109ba0 msgr2=0x7f906c1a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f907127f640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f906c109ba0 0x7f906c1a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f907127f640 1 -- 10.20.193.28:0/1433919663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906c1a65a0 con 0x7f906c109220 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f907127f640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906c109220 0x7f906c1a1550 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f905c009950 tx=0x7f905c004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.372+0000 7f905a7fc640 1 -- 10.20.193.28:0/1433919663 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c038770 con 0x7f906c109220 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.373+0000 7f905a7fc640 1 -- 10.20.193.28:0/1433919663 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f905c038db0 con 0x7f906c109220 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.373+0000 7f905a7fc640 1 -- 10.20.193.28:0/1433919663 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c041620 con 0x7f906c109220 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.373+0000 7f9072281640 1 -- 10.20.193.28:0/1433919663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906c1a6830 con 0x7f906c109220 2026-02-20T03:19:09.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.373+0000 7f9072281640 1 -- 10.20.193.28:0/1433919663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906c1ae0d0 con 0x7f906c109220 2026-02-20T03:19:09.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.375+0000 7f905a7fc640 1 -- 10.20.193.28:0/1433919663 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f905c002920 con 0x7f906c109220 2026-02-20T03:19:09.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9075a0fe00 1 Processor -- start 2026-02-20T03:19:09.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9075a0fe00 1 -- start start 2026-02-20T03:19:09.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d809000 0x55fd9d8093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803630 0x55fd9d803a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803fb0 0x55fd9d80fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd9d783e50 con 0x55fd9d809000 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fd9d7569c0 con 0x55fd9d803630 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd9d704240 con 0x55fd9d803fb0 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9071a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d809000 0x55fd9d8093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f907127f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803630 0x55fd9d803a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9071a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d809000 0x55fd9d8093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55936/0 (socket says 10.20.193.28:55936) 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9071a80640 1 -- 10.20.193.28:0/1003001632 learned_addr learned my addr 10.20.193.28:0/1003001632 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.376+0000 7f9070a7e640 1 --2- 10.20.193.28:0/1003001632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803fb0 0x55fd9d80fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9071a80640 1 -- 10.20.193.28:0/1003001632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803fb0 msgr2=0x55fd9d80fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9071a80640 1 --2- 10.20.193.28:0/1003001632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803fb0 0x55fd9d80fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9071a80640 1 -- 10.20.193.28:0/1003001632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803630 msgr2=0x55fd9d803a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9071a80640 1 --2- 10.20.193.28:0/1003001632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803630 0x55fd9d803a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9071a80640 1 -- 10.20.193.28:0/1003001632 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9d717420 con 0x55fd9d809000 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9071a80640 1 --2- 10.20.193.28:0/1003001632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d809000 0x55fd9d8093e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9068009500 tx=0x7f9068009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238b2abf7d1b019d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9039ce5640 1 -- 10.20.193.28:0/1003001632 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906801b070 con 0x55fd9d809000 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f905a7fc640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90480b0e20 0x7f90480b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9039ce5640 1 -- 10.20.193.28:0/1003001632 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9068004570 con 0x55fd9d809000 2026-02-20T03:19:09.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9039ce5640 1 -- 10.20.193.28:0/1003001632 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9068013a40 con 0x55fd9d809000 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f905a7fc640 1 -- 10.20.193.28:0/1433919663 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f905c105160 con 0x7f906c109220 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9075a0fe00 1 -- 10.20.193.28:0/1003001632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d809000 msgr2=0x55fd9d8093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/1003001632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d809000 0x55fd9d8093e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9068009500 tx=0x7f9068009920 comp rx=0 tx=0).stop 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.377+0000 7f907127f640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90480b0e20 0x7f90480b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.378+0000 7f9075a0fe00 1 -- 10.20.193.28:0/1003001632 shutdown_connections 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.378+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/1003001632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803fb0 0x55fd9d80fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.378+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/1003001632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803630 0x55fd9d803a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.378+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/1003001632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d809000 0x55fd9d8093e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.378+0000 7f9075a0fe00 1 -- 10.20.193.28:0/1003001632 >> 10.20.193.28:0/1003001632 conn(0x55fd9d7c6290 msgr2=0x55fd9d801d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.378+0000 7f9075a0fe00 1 -- 10.20.193.28:0/1003001632 shutdown_connections 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.378+0000 7f9075a0fe00 1 -- 10.20.193.28:0/1003001632 wait complete. 2026-02-20T03:19:09.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.378+0000 7f907127f640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90480b0e20 0x7f90480b32e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f905c004030 tx=0x7f905c108ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.379+0000 7f9075a0fe00 1 -- start start 2026-02-20T03:19:09.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.379+0000 7f9075a0fe00 1 Processor -- start 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 0x55fd9d81e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 0x55fd9d81c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd9d7528f0 con 0x55fd9d803630 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fd9d544f50 con 0x55fd9d803fb0 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd9d81ca70 con 0x55fd9d809000 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9070a7e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 0x55fd9d81e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55940/0 (socket says 10.20.193.28:55940) 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 -- 10.20.193.28:0/3717357852 learned_addr learned my addr 10.20.193.28:0/3717357852 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 0x55fd9d81c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 -- 10.20.193.28:0/3717357852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 msgr2=0x55fd9d81c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 0x55fd9d81c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 -- 10.20.193.28:0/3717357852 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 msgr2=0x55fd9d81e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 0x55fd9d81e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 -- 10.20.193.28:0/3717357852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9d815ad0 con 0x55fd9d803630 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9071a80640 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81e070 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9068006080 tx=0x7f90680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6cabfd9d70250a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.380+0000 7f9026ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9026ffd640 1 -- 10.20.193.28:0/3717357852 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906801b030 con 0x55fd9d803630 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9026ffd640 1 -- 10.20.193.28:0/3717357852 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f906801c040 con 0x55fd9d803630 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9026ffd640 1 -- 10.20.193.28:0/3717357852 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90680157d0 con 0x55fd9d803630 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9075a0fe00 1 -- 10.20.193.28:0/3717357852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9d527b40 con 0x55fd9d803630 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9075a0fe00 10 client.16332 _ll_register_callbacks cb 0x55fd9d78ff00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:09.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9075a0fe00 1 -- 10.20.193.28:0/3717357852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd9d7641a0 con 0x55fd9d803630 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9026ffd640 1 -- 10.20.193.28:0/3717357852 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f90680136c0 con 0x55fd9d803630 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9026ffd640 1 -- 10.20.193.28:0/3717357852 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9068013920 con 0x55fd9d803630 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9075a0fe00 10 client.16332 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.381+0000 7f9075a0fe00 1 -- 10.20.193.28:0/3717357852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55fd9d711230 con 0x55fd9d803630 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.382+0000 7f9026ffd640 1 -- 10.20.193.28:0/3717357852 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f9068021030 con 0x55fd9d803630 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.382+0000 7f9075a0fe00 10 client.16332 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.382+0000 7f9075a0fe00 10 client.16332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.382+0000 7f9075a0fe00 20 client.16332 populate_metadata read hostname 'trial028' 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.382+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd9d82c610 0x55fd9d82ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.382+0000 7f9075a0fe00 4 client.16332 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.382+0000 7f9075a0fe00 1 -- 10.20.193.28:0/3717357852 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd9d75e5b0 con 0x55fd9d82c610 2026-02-20T03:19:09.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.382+0000 7f9070a7e640 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd9d82c610 0x55fd9d82ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.383+0000 7f9070a7e640 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd9d82c610 0x55fd9d82ea00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=806d415e880a9018 server_cookie=2c685645ba4f3170 in_seq=0 out_seq=0 2026-02-20T03:19:09.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.383+0000 7f9026ffd640 10 client.16332 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.383+0000 7f9026ffd640 1 -- 10.20.193.28:0/3717357852 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fd9d75e5b0 con 0x55fd9d82c610 2026-02-20T03:19:09.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.383+0000 7f9026ffd640 10 client.16332 handle_command_reply: tid=0 2026-02-20T03:19:09.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.383+0000 7f9075a0fe00 1 client.16332 shutdown 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.383+0000 7f9075a0fe00 1 -- 10.20.193.28:0/3717357852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 msgr2=0x55fd9d81e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.383+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81e070 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9068006080 tx=0x7f90680090f0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.383+0000 7f9075a0fe00 1 -- 10.20.193.28:0/3717357852 shutdown_connections 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.383+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd9d82c610 0x55fd9d82ea00 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.384+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 0x55fd9d81c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.384+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 0x55fd9d81e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.384+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/3717357852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81e070 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.384+0000 7f9026ffd640 0 client.16332 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.384+0000 7f9075a0fe00 1 -- 10.20.193.28:0/3717357852 >> 10.20.193.28:0/3717357852 conn(0x55fd9d7c6290 msgr2=0x55fd9d802440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.384+0000 7f9075a0fe00 1 -- 10.20.193.28:0/3717357852 shutdown_connections 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.384+0000 7f9075a0fe00 1 -- 10.20.193.28:0/3717357852 wait complete. 2026-02-20T03:19:09.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.384+0000 7f9075a0fe00 20 client.16332 trim_cache size 0 max 16384 2026-02-20T03:19:09.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.392+0000 7f9075a0fe00 1 Processor -- start 2026-02-20T03:19:09.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.392+0000 7f9075a0fe00 1 -- start start 2026-02-20T03:19:09.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 0x55fd9d819960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 0x55fd9d819ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9018012780 con 0x55fd9d803630 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f901800ffc0 con 0x55fd9d803fb0 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f901800de10 con 0x55fd9d809000 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55942/0 (socket says 10.20.193.28:55942) 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 -- 10.20.193.28:0/4212838375 learned_addr learned my addr 10.20.193.28:0/4212838375 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9070a7e640 1 --2- 10.20.193.28:0/4212838375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 0x55fd9d819960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 --2- 10.20.193.28:0/4212838375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 0x55fd9d819ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 -- 10.20.193.28:0/4212838375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 msgr2=0x55fd9d819ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 --2- 10.20.193.28:0/4212838375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 0x55fd9d819ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 -- 10.20.193.28:0/4212838375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 msgr2=0x55fd9d819960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 --2- 10.20.193.28:0/4212838375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 0x55fd9d819960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 -- 10.20.193.28:0/4212838375 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9d815900 con 0x55fd9d803630 2026-02-20T03:19:09.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.393+0000 7f9071a80640 1 --2- 10.20.193.28:0/4212838375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81b3e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9068009310 tx=0x7f906802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ee9185576ebdc8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f90394e4640 1 -- 10.20.193.28:0/4212838375 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906801b070 con 0x55fd9d803630 2026-02-20T03:19:09.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f90394e4640 1 -- 10.20.193.28:0/4212838375 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f906801c040 con 0x55fd9d803630 2026-02-20T03:19:09.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f90394e4640 1 -- 10.20.193.28:0/4212838375 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90680223f0 con 0x55fd9d803630 2026-02-20T03:19:09.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f9075a0fe00 1 -- 10.20.193.28:0/4212838375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 msgr2=0x55fd9d81b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/4212838375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81b3e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9068009310 tx=0x7f906802a000 comp rx=0 tx=0).stop 2026-02-20T03:19:09.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f9075a0fe00 1 -- 10.20.193.28:0/4212838375 shutdown_connections 2026-02-20T03:19:09.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/4212838375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d809000 0x55fd9d819ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/4212838375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d803fb0 0x55fd9d819960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/4212838375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803630 0x55fd9d81b3e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f9075a0fe00 1 -- 10.20.193.28:0/4212838375 >> 10.20.193.28:0/4212838375 conn(0x55fd9d7c6290 msgr2=0x55fd9d81acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f9075a0fe00 1 -- 10.20.193.28:0/4212838375 shutdown_connections 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.394+0000 7f9075a0fe00 1 -- 10.20.193.28:0/4212838375 wait complete. 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9075a0fe00 1 -- start start 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9075a0fe00 1 Processor -- start 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803630 0x55fd9d8245d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803fb0 0x55fd9d820e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9075a0fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d809000 0x55fd9d8213d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f901800e480 con 0x55fd9d803fb0 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f901800f8f0 con 0x55fd9d809000 2026-02-20T03:19:09.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9075a0fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f901800eb50 con 0x55fd9d803630 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9071a80640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d809000 0x55fd9d8213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9070a7e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803fb0 0x55fd9d820e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9071a80640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803630 0x55fd9d8245d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9071a80640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803630 0x55fd9d8245d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48304/0 (socket says 10.20.193.28:48304) 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.395+0000 7f9071a80640 1 -- 10.20.193.28:0/967622395 learned_addr learned my addr 10.20.193.28:0/967622395 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9070a7e640 1 -- 10.20.193.28:0/967622395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803630 msgr2=0x55fd9d8245d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9070a7e640 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803630 0x55fd9d8245d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9070a7e640 1 -- 10.20.193.28:0/967622395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d809000 msgr2=0x55fd9d8213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9070a7e640 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d809000 0x55fd9d8213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9070a7e640 1 -- 10.20.193.28:0/967622395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9d435870 con 0x55fd9d803fb0 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9070a7e640 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803fb0 0x55fd9d820e90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55fd9d81bc50 tx=0x7f90600045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb734f79b10334bc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9026ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:09.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9026ffd640 1 -- 10.20.193.28:0/967622395 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060010630 con 0x55fd9d803fb0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9075a0fe00 1 -- 10.20.193.28:0/967622395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9d6f6440 con 0x55fd9d803fb0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9075a0fe00 10 client.16338 _ll_register_callbacks cb 0x7f9068019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9075a0fe00 1 -- 10.20.193.28:0/967622395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd9d75e5b0 con 0x55fd9d803fb0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9026ffd640 1 -- 10.20.193.28:0/967622395 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9060010c70 con 0x55fd9d803fb0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.396+0000 7f9026ffd640 1 -- 10.20.193.28:0/967622395 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906001ecd0 con 0x55fd9d803fb0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9026ffd640 1 -- 10.20.193.28:0/967622395 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f906002d450 con 0x55fd9d803fb0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9026ffd640 1 -- 10.20.193.28:0/967622395 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f90600107d0 con 0x55fd9d803fb0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9075a0fe00 10 client.16338 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9075a0fe00 1 -- 10.20.193.28:0/967622395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55fd9d8165f0 con 0x55fd9d803fb0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9026ffd640 1 -- 10.20.193.28:0/967622395 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f906001e390 con 0x55fd9d803fb0 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9075a0fe00 10 client.16338 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:09.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9075a0fe00 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9075a0fe00 20 client.16338 populate_metadata read hostname 'trial028' 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd9d8985c0 0x55fd9d89aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9075a0fe00 4 client.16338 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9075a0fe00 1 -- 10.20.193.28:0/967622395 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fd9d6d8a80 con 0x55fd9d8985c0 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.397+0000 7f9071a80640 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd9d8985c0 0x55fd9d89aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9071a80640 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd9d8985c0 0x55fd9d89aa80 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abab3518bbab9fdc server_cookie=705b3826281b687a in_seq=0 out_seq=0 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9026ffd640 10 client.16338 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9026ffd640 1 -- 10.20.193.28:0/967622395 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fd9d6d8a80 con 0x55fd9d8985c0 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9026ffd640 10 client.16338 handle_command_reply: tid=0 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 client.16338 shutdown 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 -- 10.20.193.28:0/967622395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803fb0 msgr2=0x55fd9d820e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803fb0 0x55fd9d820e90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55fd9d81bc50 tx=0x7f90600045c0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 -- 10.20.193.28:0/967622395 shutdown_connections 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd9d8985c0 0x55fd9d89aa80 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9d809000 0x55fd9d8213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9d803fb0 0x55fd9d820e90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 --2- 10.20.193.28:0/967622395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9d803630 0x55fd9d8245d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 -- 10.20.193.28:0/967622395 >> 10.20.193.28:0/967622395 conn(0x55fd9d7c6290 msgr2=0x55fd9d81b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9026ffd640 0 client.16338 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 -- 10.20.193.28:0/967622395 shutdown_connections 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 1 -- 10.20.193.28:0/967622395 wait complete. 2026-02-20T03:19:09.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.398+0000 7f9075a0fe00 20 client.16338 trim_cache size 0 max 16384 2026-02-20T03:19:09.406 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:19:09.406 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:19:09.406 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:19:09.406 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 -- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90480b0e20 msgr2=0x7f90480b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90480b0e20 0x7f90480b32e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f905c004030 tx=0x7f905c108ba0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 -- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906c109220 msgr2=0x7f906c1a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906c109220 0x7f906c1a1550 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f905c009950 tx=0x7f905c004300 comp rx=0 tx=0).stop 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 -- 10.20.193.28:0/1433919663 shutdown_connections 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90480b0e20 0x7f90480b32e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f906c10eef0 0x7f906c1a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f906c109ba0 0x7f906c1a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 --2- 10.20.193.28:0/1433919663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906c109220 0x7f906c1a1550 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 -- 10.20.193.28:0/1433919663 >> 10.20.193.28:0/1433919663 conn(0x7f906c078600 msgr2=0x7f906c079f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 -- 10.20.193.28:0/1433919663 shutdown_connections 2026-02-20T03:19:09.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.399+0000 7f9072281640 1 -- 10.20.193.28:0/1433919663 wait complete. 2026-02-20T03:19:09.497 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:19:09.497 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:19:09.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 9.71 MB/sec execute 42 sec latency 341.235 ms 2026-02-20T03:19:09.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:09 trial126 ceph-mon[38476]: pgmap v315: 129 pgs: 129 active+clean; 80 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 MiB/s rd, 2.5 MiB/s wr, 525 op/s 2026-02-20T03:19:09.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:09 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3707029566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:09 trial177 ceph-mon[43181]: pgmap v315: 129 pgs: 129 active+clean; 80 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.2 MiB/s rd, 2.5 MiB/s wr, 525 op/s 2026-02-20T03:19:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:09 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3707029566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:09.777 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:09.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 -- 10.20.193.28:0/3518111247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc10eef0 msgr2=0x7f2fbc10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 --2- 10.20.193.28:0/3518111247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc10eef0 0x7f2fbc10f2d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009a30 tx=0x7f2fac02f220 comp rx=0 tx=0).stop 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 -- 10.20.193.28:0/3518111247 shutdown_connections 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 --2- 10.20.193.28:0/3518111247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2fbc109ba0 0x7f2fbc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 --2- 10.20.193.28:0/3518111247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2fbc109220 0x7f2fbc109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 --2- 10.20.193.28:0/3518111247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc10eef0 0x7f2fbc10f2d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 -- 10.20.193.28:0/3518111247 >> 10.20.193.28:0/3518111247 conn(0x7f2fbc078600 msgr2=0x7f2fbc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 -- 10.20.193.28:0/3518111247 shutdown_connections 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 -- 10.20.193.28:0/3518111247 wait complete. 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.964+0000 7f2fc1816640 1 Processor -- start 2026-02-20T03:19:09.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1816640 1 -- start start 2026-02-20T03:19:09.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1816640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc109220 0x7f2fbc1a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1816640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2fbc109ba0 0x7f2fbc1a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1816640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2fbc10eef0 0x7f2fbc1a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1816640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc119080 con 0x7f2fbc109220 2026-02-20T03:19:09.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1816640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc118f00 con 0x7f2fbc109ba0 2026-02-20T03:19:09.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1816640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc119200 con 0x7f2fbc10eef0 2026-02-20T03:19:09.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc0814640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc109220 0x7f2fbc1a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1015640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2fbc10eef0 0x7f2fbc1a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1015640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2fbc10eef0 0x7f2fbc1a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48326/0 (socket says 10.20.193.28:48326) 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc1015640 1 -- 10.20.193.28:0/1526289241 learned_addr learned my addr 10.20.193.28:0/1526289241 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fc0814640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc109220 0x7f2fbc1a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55972/0 (socket says 10.20.193.28:55972) 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.965+0000 7f2fb3fff640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2fbc109ba0 0x7f2fbc1a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fc0814640 1 -- 10.20.193.28:0/1526289241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2fbc10eef0 msgr2=0x7f2fbc1a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fc0814640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2fbc10eef0 0x7f2fbc1a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fc0814640 1 -- 10.20.193.28:0/1526289241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2fbc109ba0 msgr2=0x7f2fbc1a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fc0814640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2fbc109ba0 0x7f2fbc1a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fc0814640 1 -- 10.20.193.28:0/1526289241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc1a6590 con 0x7f2fbc109220 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fc0814640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc109220 0x7f2fbc1a1540 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009950 tx=0x7f2fac0043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:09.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fb1ffb640 1 -- 10.20.193.28:0/1526289241 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac038980 con 0x7f2fbc109220 2026-02-20T03:19:09.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fb1ffb640 1 -- 10.20.193.28:0/1526289241 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2fac0026e0 con 0x7f2fbc109220 2026-02-20T03:19:09.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fb1ffb640 1 -- 10.20.193.28:0/1526289241 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0416d0 con 0x7f2fbc109220 2026-02-20T03:19:09.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc1a6820 con 0x7f2fbc109220 2026-02-20T03:19:09.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.966+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc1ae0c0 con 0x7f2fbc109220 2026-02-20T03:19:09.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.967+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fbc10a580 con 0x7f2fbc109220 2026-02-20T03:19:09.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.969+0000 7f2fb1ffb640 1 -- 10.20.193.28:0/1526289241 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2fac002890 con 0x7f2fbc109220 2026-02-20T03:19:09.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.971+0000 7f2fb1ffb640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2f980b0e20 0x7f2f980b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:09.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.971+0000 7f2fb1ffb640 1 -- 10.20.193.28:0/1526289241 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2fac105130 con 0x7f2fbc109220 2026-02-20T03:19:09.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.971+0000 7f2fb1ffb640 1 -- 10.20.193.28:0/1526289241 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f2fac047060 con 0x7f2fbc109220 2026-02-20T03:19:09.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.971+0000 7f2fb3fff640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2f980b0e20 0x7f2f980b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:09.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:09.971+0000 7f2fb3fff640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2f980b0e20 0x7f2f980b32e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc108d60 tx=0x7f2fa40073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:10.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.078+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fbc109660 con 0x7f2fbc109220 2026-02-20T03:19:10.081 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:19:10.081 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":27,"btime":"2026-02-20T03:18:40:102060+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:18:39.168872+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:19:10.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.079+0000 7f2fb1ffb640 1 -- 10.20.193.28:0/1526289241 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11925 (secure 0 0 0) 0x7f2fac0cd510 con 0x7f2fbc109220 2026-02-20T03:19:10.082 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 27 2026-02-20T03:19:10.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2f980b0e20 msgr2=0x7f2f980b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2f980b0e20 0x7f2f980b32e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc108d60 tx=0x7f2fa40073d0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc109220 msgr2=0x7f2fbc1a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc109220 0x7f2fbc1a1540 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009950 tx=0x7f2fac0043d0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 shutdown_connections 2026-02-20T03:19:10.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2f980b0e20 0x7f2f980b32e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2fbc10eef0 0x7f2fbc1a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2fbc109ba0 0x7f2fbc1a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 --2- 10.20.193.28:0/1526289241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2fbc109220 0x7f2fbc1a1540 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 >> 10.20.193.28:0/1526289241 conn(0x7f2fbc078600 msgr2=0x7f2fbc079f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 shutdown_connections 2026-02-20T03:19:10.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.080+0000 7f2fc1816640 1 -- 10.20.193.28:0/1526289241 wait complete. 2026-02-20T03:19:10.182 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:19:10.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:10 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1526289241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:10.485 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:10.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 9.49 MB/sec execute 43 sec latency 1341.265 ms 2026-02-20T03:19:10.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:10 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1526289241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:10.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.663+0000 7f11a7577640 1 -- 10.20.193.28:0/2217212959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 msgr2=0x7f11a8109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.663+0000 7f11a7577640 1 --2- 10.20.193.28:0/2217212959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 0x7f11a8109660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1190009a30 tx=0x7f119002f220 comp rx=0 tx=0).stop 2026-02-20T03:19:10.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.664+0000 7f11a7577640 1 -- 10.20.193.28:0/2217212959 shutdown_connections 2026-02-20T03:19:10.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.664+0000 7f11a7577640 1 --2- 10.20.193.28:0/2217212959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11a8109ba0 0x7f11a8115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.664+0000 7f11a7577640 1 --2- 10.20.193.28:0/2217212959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 0x7f11a8109660 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.664+0000 7f11a7577640 1 --2- 10.20.193.28:0/2217212959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11a810eef0 0x7f11a810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.664+0000 7f11a7577640 1 -- 10.20.193.28:0/2217212959 >> 10.20.193.28:0/2217212959 conn(0x7f11a8078600 msgr2=0x7f11a807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:10.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.664+0000 7f11a7577640 1 -- 10.20.193.28:0/2217212959 shutdown_connections 2026-02-20T03:19:10.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.664+0000 7f11a7577640 1 -- 10.20.193.28:0/2217212959 wait complete. 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.664+0000 7f11a7577640 1 Processor -- start 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.664+0000 7f11a7577640 1 -- start start 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a7577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 0x7f11a81a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a7577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11a8109ba0 0x7f11a81a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a7577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11a810eef0 0x7f11a81a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a7577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11a81190a0 con 0x7f11a8109220 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a7577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11a8118f20 con 0x7f11a8109ba0 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a7577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11a8119220 con 0x7f11a810eef0 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 0x7f11a81a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 0x7f11a81a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55992/0 (socket says 10.20.193.28:55992) 2026-02-20T03:19:10.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6575640 1 -- 10.20.193.28:0/2277302498 learned_addr learned my addr 10.20.193.28:0/2277302498 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6d76640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11a810eef0 0x7f11a81a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a5d74640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11a8109ba0 0x7f11a81a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6575640 1 -- 10.20.193.28:0/2277302498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11a810eef0 msgr2=0x7f11a81a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6575640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11a810eef0 0x7f11a81a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6575640 1 -- 10.20.193.28:0/2277302498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11a8109ba0 msgr2=0x7f11a81a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6575640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11a8109ba0 0x7f11a81a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6575640 1 -- 10.20.193.28:0/2277302498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a81a65b0 con 0x7f11a8109220 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.665+0000 7f11a6575640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 0x7f11a81a1560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f119c00ea10 tx=0x7f119c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.666+0000 7f118f7fe640 1 -- 10.20.193.28:0/2277302498 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c00ce50 con 0x7f11a8109220 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.666+0000 7f118f7fe640 1 -- 10.20.193.28:0/2277302498 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f119c004570 con 0x7f11a8109220 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.666+0000 7f118f7fe640 1 -- 10.20.193.28:0/2277302498 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c010690 con 0x7f11a8109220 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.666+0000 7f11a7577640 1 -- 10.20.193.28:0/2277302498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a81a68a0 con 0x7f11a8109220 2026-02-20T03:19:10.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.666+0000 7f11a7577640 1 -- 10.20.193.28:0/2277302498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a81ae0e0 con 0x7f11a8109220 2026-02-20T03:19:10.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11af16be00 1 Processor -- start 2026-02-20T03:19:10.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f118f7fe640 1 -- 10.20.193.28:0/2277302498 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f119c020030 con 0x7f11a8109220 2026-02-20T03:19:10.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11af16be00 1 -- start start 2026-02-20T03:19:10.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11af16be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b04390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11af16be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3afea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11af16be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afef60 0x55ecc3b0ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11af16be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3a7ee00 con 0x55ecc3afe5e0 2026-02-20T03:19:10.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11af16be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3a51970 con 0x55ecc3b03fb0 2026-02-20T03:19:10.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11af16be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ecc39ff1f0 con 0x55ecc3afef60 2026-02-20T03:19:10.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11a6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3afea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11a6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3afea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56002/0 (socket says 10.20.193.28:56002) 2026-02-20T03:19:10.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11a6575640 1 -- 10.20.193.28:0/757494340 learned_addr learned my addr 10.20.193.28:0/757494340 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11a6d76640 1 --2- 10.20.193.28:0/757494340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b04390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.669+0000 7f11a5d74640 1 --2- 10.20.193.28:0/757494340 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afef60 0x55ecc3b0ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f11a6575640 1 -- 10.20.193.28:0/757494340 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afef60 msgr2=0x55ecc3b0ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f11a6575640 1 --2- 10.20.193.28:0/757494340 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afef60 0x55ecc3b0ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f11a6575640 1 -- 10.20.193.28:0/757494340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 msgr2=0x55ecc3b04390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f11a6575640 1 --2- 10.20.193.28:0/757494340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b04390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f11a6575640 1 -- 10.20.193.28:0/757494340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc3a123d0 con 0x55ecc3afe5e0 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f11a6575640 1 --2- 10.20.193.28:0/757494340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3afea20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f119c0e4d20 tx=0x7f119c0e9650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ce54fb1723badf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f118cff9640 1 -- 10.20.193.28:0/757494340 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0f0070 con 0x55ecc3afe5e0 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f118cff9640 1 -- 10.20.193.28:0/757494340 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f119c0ec8a0 con 0x55ecc3afe5e0 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f118cff9640 1 -- 10.20.193.28:0/757494340 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0e5040 con 0x55ecc3afe5e0 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f118f7fe640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11800b0fc0 0x7f11800b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f11af16be00 1 -- 10.20.193.28:0/757494340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 msgr2=0x55ecc3afea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f11af16be00 1 --2- 10.20.193.28:0/757494340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3afea20 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f119c0e4d20 tx=0x7f119c0e9650 comp rx=0 tx=0).stop 2026-02-20T03:19:10.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.670+0000 7f118f7fe640 1 -- 10.20.193.28:0/2277302498 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f119c0e0b80 con 0x7f11a8109220 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.671+0000 7f11af16be00 1 -- 10.20.193.28:0/757494340 shutdown_connections 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.671+0000 7f11af16be00 1 --2- 10.20.193.28:0/757494340 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afef60 0x55ecc3b0ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.671+0000 7f11af16be00 1 --2- 10.20.193.28:0/757494340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3afea20 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.671+0000 7f11af16be00 1 --2- 10.20.193.28:0/757494340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b04390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.671+0000 7f11af16be00 1 -- 10.20.193.28:0/757494340 >> 10.20.193.28:0/757494340 conn(0x55ecc3ac1240 msgr2=0x55ecc3afcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.671+0000 7f11af16be00 1 -- 10.20.193.28:0/757494340 shutdown_connections 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.671+0000 7f11a6d76640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11800b0fc0 0x7f11800b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.671+0000 7f11af16be00 1 -- 10.20.193.28:0/757494340 wait complete. 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.671+0000 7f11a6d76640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11800b0fc0 0x7f11800b3480 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1198007550 tx=0x7f119800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.672+0000 7f11af16be00 1 -- start start 2026-02-20T03:19:10.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.672+0000 7f11af16be00 1 Processor -- start 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.672+0000 7f11af16be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b18b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.672+0000 7f11af16be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 0x55ecc3b19090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11af16be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b17290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11af16be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3a4d8a0 con 0x55ecc3afe5e0 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11af16be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ecc383ff50 con 0x55ecc3afef60 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11af16be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ecc3b17a10 con 0x55ecc3b03fb0 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b18b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b18b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56016/0 (socket says 10.20.193.28:56016) 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6575640 1 -- 10.20.193.28:0/1461472161 learned_addr learned my addr 10.20.193.28:0/1461472161 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6d76640 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b17290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a5d74640 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 0x55ecc3b19090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6575640 1 -- 10.20.193.28:0/1461472161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3b03fb0 msgr2=0x55ecc3b17290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6575640 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b17290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6575640 1 -- 10.20.193.28:0/1461472161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 msgr2=0x55ecc3b19090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6575640 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 0x55ecc3b19090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6575640 1 -- 10.20.193.28:0/1461472161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc3b10a30 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11a6575640 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b18b50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f119c0a8850 tx=0x7f119c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544bac4b170b8bbe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f1157fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f1157fff640 1 -- 10.20.193.28:0/1461472161 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0f0030 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f1157fff640 1 -- 10.20.193.28:0/1461472161 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f119c0cb070 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f1157fff640 1 -- 10.20.193.28:0/1461472161 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c0a7fc0 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.673+0000 7f11af16be00 1 -- 10.20.193.28:0/1461472161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc3822b40 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f1157fff640 1 -- 10.20.193.28:0/1461472161 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f119c0a4c60 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 10 client.16356 _ll_register_callbacks cb 0x55ecc3a8aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 1 -- 10.20.193.28:0/1461472161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ecc3a5f150 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f1157fff640 1 -- 10.20.193.28:0/1461472161 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f119c0a7de0 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 10 client.16356 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 1 -- 10.20.193.28:0/1461472161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55ecc3a0c1e0 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f1157fff640 1 -- 10.20.193.28:0/1461472161 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f119c0eb040 con 0x55ecc3afe5e0 2026-02-20T03:19:10.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 10 client.16356 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:10.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 10 client.16356 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:19:10.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 20 client.16356 populate_metadata read hostname 'trial028' 2026-02-20T03:19:10.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ecc3b26ea0 0x55ecc3b29290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 4 client.16356 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:10.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11af16be00 1 -- 10.20.193.28:0/1461472161 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecc3a59560 con 0x55ecc3b26ea0 2026-02-20T03:19:10.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.674+0000 7f11a5d74640 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ecc3b26ea0 0x55ecc3b29290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.675+0000 7f11a5d74640 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ecc3b26ea0 0x55ecc3b29290 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85aded00248fd6aa server_cookie=5fec9a8a4d7af487 in_seq=0 out_seq=0 2026-02-20T03:19:10.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.675+0000 7f1157fff640 10 client.16356 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.675+0000 7f1157fff640 1 -- 10.20.193.28:0/1461472161 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ecc3a59560 con 0x55ecc3b26ea0 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.675+0000 7f1157fff640 10 client.16356 handle_command_reply: tid=0 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.675+0000 7f11af16be00 1 client.16356 shutdown 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 -- 10.20.193.28:0/1461472161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 msgr2=0x55ecc3b18b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b18b50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f119c0a8850 tx=0x7f119c009800 comp rx=0 tx=0).stop 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 -- 10.20.193.28:0/1461472161 shutdown_connections 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b17290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 0x55ecc3b19090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ecc3b26ea0 0x55ecc3b29290 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 --2- 10.20.193.28:0/1461472161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b18b50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 -- 10.20.193.28:0/1461472161 >> 10.20.193.28:0/1461472161 conn(0x55ecc3ac1240 msgr2=0x55ecc3afd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f1157fff640 0 client.16356 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 -- 10.20.193.28:0/1461472161 shutdown_connections 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 1 -- 10.20.193.28:0/1461472161 wait complete. 2026-02-20T03:19:10.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.676+0000 7f11af16be00 20 client.16356 trim_cache size 0 max 16384 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.683+0000 7f11af16be00 1 Processor -- start 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.683+0000 7f11af16be00 1 -- start start 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11af16be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b14a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11af16be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 0x55ecc3b2ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11af16be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b2ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11af16be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f114c012780 con 0x55ecc3b03fb0 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11af16be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f114c00ffc0 con 0x55ecc3afef60 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11af16be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f114c00de10 con 0x55ecc3afe5e0 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b2ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b2ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56032/0 (socket says 10.20.193.28:56032) 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6d76640 1 -- 10.20.193.28:0/1246111386 learned_addr learned my addr 10.20.193.28:0/1246111386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6575640 1 --2- 10.20.193.28:0/1246111386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b14a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a5d74640 1 --2- 10.20.193.28:0/1246111386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 0x55ecc3b2ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6d76640 1 -- 10.20.193.28:0/1246111386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afe5e0 msgr2=0x55ecc3b14a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6d76640 1 --2- 10.20.193.28:0/1246111386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b14a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6d76640 1 -- 10.20.193.28:0/1246111386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 msgr2=0x55ecc3b2ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:10.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6d76640 1 --2- 10.20.193.28:0/1246111386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 0x55ecc3b2ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6d76640 1 -- 10.20.193.28:0/1246111386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc3b01e40 con 0x55ecc3b03fb0 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11a6d76640 1 --2- 10.20.193.28:0/1246111386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b2ef60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1198004160 tx=0x7f1198009050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a206d21e568a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.684+0000 7f11724e6640 1 -- 10.20.193.28:0/1246111386 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1198016850 con 0x55ecc3b03fb0 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11724e6640 1 -- 10.20.193.28:0/1246111386 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1198024440 con 0x55ecc3b03fb0 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11724e6640 1 -- 10.20.193.28:0/1246111386 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11980236a0 con 0x55ecc3b03fb0 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11af16be00 1 -- 10.20.193.28:0/1246111386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3b03fb0 msgr2=0x55ecc3b2ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11af16be00 1 --2- 10.20.193.28:0/1246111386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b2ef60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1198004160 tx=0x7f1198009050 comp rx=0 tx=0).stop 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11af16be00 1 -- 10.20.193.28:0/1246111386 shutdown_connections 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11af16be00 1 --2- 10.20.193.28:0/1246111386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b2ef60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11af16be00 1 --2- 10.20.193.28:0/1246111386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3afef60 0x55ecc3b2ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11af16be00 1 --2- 10.20.193.28:0/1246111386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b14a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11af16be00 1 -- 10.20.193.28:0/1246111386 >> 10.20.193.28:0/1246111386 conn(0x55ecc3ac1240 msgr2=0x55ecc3b15b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:10.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11af16be00 1 -- 10.20.193.28:0/1246111386 shutdown_connections 2026-02-20T03:19:10.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.685+0000 7f11af16be00 1 -- 10.20.193.28:0/1246111386 wait complete. 2026-02-20T03:19:10.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.686+0000 7f11af16be00 1 -- start start 2026-02-20T03:19:10.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.686+0000 7f11af16be00 1 Processor -- start 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.686+0000 7f11af16be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b220d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.686+0000 7f11af16be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afef60 0x55ecc3b1e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.686+0000 7f11af16be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b1e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.686+0000 7f11af16be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f114c00e480 con 0x55ecc3afef60 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.686+0000 7f11af16be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f114c00f8f0 con 0x55ecc3b03fb0 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.686+0000 7f11af16be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f114c00eb50 con 0x55ecc3afe5e0 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afef60 0x55ecc3b1e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afef60 0x55ecc3b1e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56034/0 (socket says 10.20.193.28:56034) 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a5d74640 1 -- 10.20.193.28:0/3813496068 learned_addr learned my addr 10.20.193.28:0/3813496068 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a6d76640 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b1e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a5d74640 1 -- 10.20.193.28:0/3813496068 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afe5e0 msgr2=0x55ecc3b220d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a5d74640 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a5d74640 1 -- 10.20.193.28:0/3813496068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 msgr2=0x55ecc3b1e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a5d74640 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b1e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a5d74640 1 -- 10.20.193.28:0/3813496068 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecc3b10860 con 0x55ecc3afef60 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11a5d74640 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afef60 0x55ecc3b1e3a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1190037000 tx=0x7f119002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19105a381ce55932 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:10.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f1157fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f1157fff640 1 -- 10.20.193.28:0/3813496068 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119004f070 con 0x55ecc3afef60 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f1157fff640 1 -- 10.20.193.28:0/3813496068 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1190033040 con 0x55ecc3afef60 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f1157fff640 1 -- 10.20.193.28:0/3813496068 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11900026e0 con 0x55ecc3afef60 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f11af16be00 1 -- 10.20.193.28:0/3813496068 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecc3730870 con 0x55ecc3afef60 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.687+0000 7f1157fff640 1 -- 10.20.193.28:0/3813496068 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1190002880 con 0x55ecc3afef60 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 10 client.16362 _ll_register_callbacks cb 0x7f1198009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 1 -- 10.20.193.28:0/3813496068 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ecc3a03ab0 con 0x55ecc3afef60 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f1157fff640 1 -- 10.20.193.28:0/3813496068 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1190038770 con 0x55ecc3afef60 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 10 client.16362 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 1 -- 10.20.193.28:0/3813496068 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55ecc39f13f0 con 0x55ecc3afef60 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f1157fff640 1 -- 10.20.193.28:0/3813496068 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f1190041040 con 0x55ecc3afef60 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 10 client.16362 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 10 client.16362 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 20 client.16362 populate_metadata read hostname 'trial028' 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ecc3b92c40 0x55ecc3b95100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 4 client.16362 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:19:10.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11af16be00 1 -- 10.20.193.28:0/3813496068 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f1198024440 con 0x55ecc3b92c40 2026-02-20T03:19:10.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.688+0000 7f11a6575640 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ecc3b92c40 0x55ecc3b95100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:10.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.689+0000 7f11a6575640 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ecc3b92c40 0x55ecc3b95100 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=141b3f78c15b9a41 server_cookie=fa5000c84b8aa65a in_seq=0 out_seq=0 2026-02-20T03:19:10.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.689+0000 7f1157fff640 10 client.16362 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.689+0000 7f1157fff640 1 -- 10.20.193.28:0/3813496068 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f1198024440 con 0x55ecc3b92c40 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.689+0000 7f1157fff640 10 client.16362 handle_command_reply: tid=0 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.689+0000 7f11af16be00 1 client.16362 shutdown 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 -- 10.20.193.28:0/3813496068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afef60 msgr2=0x55ecc3b1e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afef60 0x55ecc3b1e3a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1190037000 tx=0x7f119002f840 comp rx=0 tx=0).stop 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 -- 10.20.193.28:0/3813496068 shutdown_connections 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ecc3b03fb0 0x55ecc3b1e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ecc3b92c40 0x55ecc3b95100 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ecc3afef60 0x55ecc3b1e3a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 --2- 10.20.193.28:0/3813496068 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ecc3afe5e0 0x55ecc3b220d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 -- 10.20.193.28:0/3813496068 >> 10.20.193.28:0/3813496068 conn(0x55ecc3ac1240 msgr2=0x55ecc3b15f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f1157fff640 0 client.16362 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 -- 10.20.193.28:0/3813496068 shutdown_connections 2026-02-20T03:19:10.691 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 1 -- 10.20.193.28:0/3813496068 wait complete. 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11af16be00 20 client.16362 trim_cache size 0 max 16384 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11a7577640 1 -- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11800b0fc0 msgr2=0x7f11800b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11a7577640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11800b0fc0 0x7f11800b3480 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1198007550 tx=0x7f119800b040 comp rx=0 tx=0).stop 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11a7577640 1 -- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 msgr2=0x7f11a81a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.690+0000 7f11a7577640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 0x7f11a81a1560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f119c00ea10 tx=0x7f119c00eee0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.691+0000 7f11a7577640 1 -- 10.20.193.28:0/2277302498 shutdown_connections 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.691+0000 7f11a7577640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11800b0fc0 0x7f11800b3480 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.691+0000 7f11a7577640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11a810eef0 0x7f11a81a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.691+0000 7f11a7577640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11a8109ba0 0x7f11a81a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.691+0000 7f11a7577640 1 --2- 10.20.193.28:0/2277302498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11a8109220 0x7f11a81a1560 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.691+0000 7f11a7577640 1 -- 10.20.193.28:0/2277302498 >> 10.20.193.28:0/2277302498 conn(0x7f11a8078600 msgr2=0x7f11a8079ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.691+0000 7f11a7577640 1 -- 10.20.193.28:0/2277302498 shutdown_connections 2026-02-20T03:19:10.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:10.691+0000 7f11a7577640 1 -- 10.20.193.28:0/2277302498 wait complete. 2026-02-20T03:19:10.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:10 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1526289241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:10.790 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:19:11.049 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:11.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.223+0000 7f6abf76f640 1 -- 10.20.193.28:0/325646153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab810a990 msgr2=0x7f6ab810ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.223+0000 7f6abf76f640 1 --2- 10.20.193.28:0/325646153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab810a990 0x7f6ab810ad70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0009a60 tx=0x7f6ab002f250 comp rx=0 tx=0).stop 2026-02-20T03:19:11.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.223+0000 7f6abf76f640 1 -- 10.20.193.28:0/325646153 shutdown_connections 2026-02-20T03:19:11.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.223+0000 7f6abf76f640 1 --2- 10.20.193.28:0/325646153 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab8105330 0x7f6ab8111860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.223+0000 7f6abf76f640 1 --2- 10.20.193.28:0/325646153 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab8104990 0x7f6ab8104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.223+0000 7f6abf76f640 1 --2- 10.20.193.28:0/325646153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab810a990 0x7f6ab810ad70 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.223+0000 7f6abf76f640 1 -- 10.20.193.28:0/325646153 >> 10.20.193.28:0/325646153 conn(0x7f6ab8100690 msgr2=0x7f6ab8102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.223+0000 7f6abf76f640 1 -- 10.20.193.28:0/325646153 shutdown_connections 2026-02-20T03:19:11.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.223+0000 7f6abf76f640 1 -- 10.20.193.28:0/325646153 wait complete. 2026-02-20T03:19:11.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abf76f640 1 Processor -- start 2026-02-20T03:19:11.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abf76f640 1 -- start start 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abf76f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab8104990 0x7f6ab81116d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abf76f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab8105330 0x7f6ab810e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abf76f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab810a990 0x7f6ab810ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abf76f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab8114c00 con 0x7f6ab8104990 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abf76f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab8114a80 con 0x7f6ab8105330 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abf76f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab8114d80 con 0x7f6ab810a990 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abe76d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab8104990 0x7f6ab81116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abe76d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab8104990 0x7f6ab81116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56046/0 (socket says 10.20.193.28:56046) 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abe76d640 1 -- 10.20.193.28:0/3920244618 learned_addr learned my addr 10.20.193.28:0/3920244618 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab8105330 0x7f6ab810e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.224+0000 7f6abef6e640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab810a990 0x7f6ab810ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6abe76d640 1 -- 10.20.193.28:0/3920244618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab810a990 msgr2=0x7f6ab810ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6abe76d640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab810a990 0x7f6ab810ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6abe76d640 1 -- 10.20.193.28:0/3920244618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab8105330 msgr2=0x7f6ab810e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6abe76d640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab8105330 0x7f6ab810e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6abe76d640 1 -- 10.20.193.28:0/3920244618 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab81a3040 con 0x7f6ab8104990 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab8105330 0x7f6ab810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6abe76d640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab8104990 0x7f6ab81116d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6ab002fca0 tx=0x7f6ab002fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6aa37fe640 1 -- 10.20.193.28:0/3920244618 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0004240 con 0x7f6ab8104990 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6aa37fe640 1 -- 10.20.193.28:0/3920244618 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6ab00043e0 con 0x7f6ab8104990 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6aa37fe640 1 -- 10.20.193.28:0/3920244618 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0042660 con 0x7f6ab8104990 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6abf76f640 1 -- 10.20.193.28:0/3920244618 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab81a3270 con 0x7f6ab8104990 2026-02-20T03:19:11.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.225+0000 7f6abf76f640 1 -- 10.20.193.28:0/3920244618 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab81a3700 con 0x7f6ab8104990 2026-02-20T03:19:11.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.229+0000 7f6aa37fe640 1 -- 10.20.193.28:0/3920244618 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6ab0038770 con 0x7f6ab8104990 2026-02-20T03:19:11.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.229+0000 7f6ac2efde00 1 Processor -- start 2026-02-20T03:19:11.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.229+0000 7f6ac2efde00 1 -- start start 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.229+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2fb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.229+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a2f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.229+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a301de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56002a275e00 con 0x56002a2f55e0 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56002a248970 con 0x56002a2fafb0 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56002a1f61f0 con 0x56002a2f5f60 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6abef6e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6abef6e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2fb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39512/0 (socket says 10.20.193.28:39512) 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6abef6e640 1 -- 10.20.193.28:0/1851041671 learned_addr learned my addr 10.20.193.28:0/1851041671 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a301de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6abe76d640 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a2f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6abef6e640 1 -- 10.20.193.28:0/1851041671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 msgr2=0x56002a301de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6abef6e640 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a301de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6abef6e640 1 -- 10.20.193.28:0/1851041671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 msgr2=0x56002a2f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.230+0000 7f6abef6e640 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a2f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.231+0000 7f6abef6e640 1 -- 10.20.193.28:0/1851041671 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002a2093d0 con 0x56002a2fafb0 2026-02-20T03:19:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.231+0000 7f6abef6e640 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2fb390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009d90 tx=0x7f6aac002c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8d591c71757b2e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.231+0000 7f6aa0ff9640 1 -- 10.20.193.28:0/1851041671 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac007500 con 0x56002a2fafb0 2026-02-20T03:19:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.231+0000 7f6aa0ff9640 1 -- 10.20.193.28:0/1851041671 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6aac007b40 con 0x56002a2fafb0 2026-02-20T03:19:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.231+0000 7f6aa0ff9640 1 -- 10.20.193.28:0/1851041671 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac015d40 con 0x56002a2fafb0 2026-02-20T03:19:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.231+0000 7f6aa37fe640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a940b0e20 0x7f6a940b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6aa37fe640 1 -- 10.20.193.28:0/3920244618 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6ab0104910 con 0x7f6ab8104990 2026-02-20T03:19:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6abe76d640 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a2f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6ac2efde00 1 -- 10.20.193.28:0/1851041671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 msgr2=0x56002a2fb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2fb390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009d90 tx=0x7f6aac002c60 comp rx=0 tx=0).stop 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a301de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6abe76d640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a940b0e20 0x7f6a940b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6ac2efde00 1 -- 10.20.193.28:0/1851041671 shutdown_connections 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a301de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a2f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/1851041671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2fb390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6ac2efde00 1 -- 10.20.193.28:0/1851041671 >> 10.20.193.28:0/1851041671 conn(0x56002a2b8240 msgr2=0x56002a2f3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6ac2efde00 1 -- 10.20.193.28:0/1851041671 shutdown_connections 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6ac2efde00 1 -- 10.20.193.28:0/1851041671 wait complete. 2026-02-20T03:19:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.232+0000 7f6abe76d640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a940b0e20 0x7f6a940b32e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6ab003a040 tx=0x7f6ab0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.233+0000 7f6ac2efde00 1 -- start start 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.233+0000 7f6ac2efde00 1 Processor -- start 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2f55e0 0x56002a30e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 0x56002a30ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2fafb0 0x56002a30fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56002a2448a0 con 0x56002a2f5f60 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56002a036f50 con 0x56002a2f55e0 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56002a310130 con 0x56002a2fafb0 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abef6e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2f55e0 0x56002a30e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abdf6c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 0x56002a30ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abef6e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2f55e0 0x56002a30e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39518/0 (socket says 10.20.193.28:39518) 2026-02-20T03:19:11.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abef6e640 1 -- 10.20.193.28:0/3605100544 learned_addr learned my addr 10.20.193.28:0/3605100544 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abef6e640 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2fafb0 0x56002a30fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abef6e640 1 -- 10.20.193.28:0/3605100544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2fafb0 msgr2=0x56002a30fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abef6e640 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2fafb0 0x56002a30fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abef6e640 1 -- 10.20.193.28:0/3605100544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 msgr2=0x56002a30ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abef6e640 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 0x56002a30ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.234+0000 7f6abef6e640 1 -- 10.20.193.28:0/3605100544 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002a3078d0 con 0x56002a2f55e0 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6abef6e640 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2f55e0 0x56002a30e4d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6aac006080 tx=0x7f6aac003fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=553b63a18727cf35 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6a6bfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6a6bfff640 1 -- 10.20.193.28:0/3605100544 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac007500 con 0x56002a2f55e0 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6a6bfff640 1 -- 10.20.193.28:0/3605100544 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6aac01e470 con 0x56002a2f55e0 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6a6bfff640 1 -- 10.20.193.28:0/3605100544 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac022690 con 0x56002a2f55e0 2026-02-20T03:19:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3605100544 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56002a019b40 con 0x56002a2f55e0 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6a6bfff640 1 -- 10.20.193.28:0/3605100544 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6aac022830 con 0x56002a2f55e0 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6a6bfff640 10 client.26099 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6ac2efde00 10 client.26099 _ll_register_callbacks cb 0x56002a281eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3605100544 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56002a256150 con 0x56002a2f55e0 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6a6bfff640 1 -- 10.20.193.28:0/3605100544 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6aac031060 con 0x56002a2f55e0 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6ac2efde00 10 client.26099 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.235+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3605100544 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=27}) -- 0x56002a2031e0 con 0x56002a2f55e0 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.236+0000 7f6a6bfff640 1 -- 10.20.193.28:0/3605100544 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f6aac0076a0 con 0x56002a2f55e0 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.236+0000 7f6ac2efde00 10 client.26099 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.236+0000 7f6ac2efde00 10 client.26099 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.236+0000 7f6ac2efde00 20 client.26099 populate_metadata read hostname 'trial028' 2026-02-20T03:19:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.236+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56002a31e410 0x56002a320800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.236+0000 7f6ac2efde00 4 client.26099 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.236+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3605100544 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56002a250560 con 0x56002a31e410 2026-02-20T03:19:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.236+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56002a31e410 0x56002a320800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56002a31e410 0x56002a320800 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32ef6eba3ee028f5 server_cookie=6822f907ff8f999 in_seq=0 out_seq=0 2026-02-20T03:19:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6a6bfff640 10 client.26099 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:19:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6a6bfff640 1 -- 10.20.193.28:0/3605100544 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56002a250560 con 0x56002a31e410 2026-02-20T03:19:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6a6bfff640 10 client.26099 handle_command_reply: tid=0 2026-02-20T03:19:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 client.26099 shutdown 2026-02-20T03:19:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3605100544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2f55e0 msgr2=0x56002a30e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2f55e0 0x56002a30e4d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6aac006080 tx=0x7f6aac003fb0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3605100544 shutdown_connections 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56002a31e410 0x56002a320800 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2fafb0 0x56002a30fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 0x56002a30ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3605100544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2f55e0 0x56002a30e4d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3605100544 >> 10.20.193.28:0/3605100544 conn(0x56002a2b8240 msgr2=0x56002a2f43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6a6bfff640 0 client.26099 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.237+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3605100544 shutdown_connections 2026-02-20T03:19:11.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.238+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3605100544 wait complete. 2026-02-20T03:19:11.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.238+0000 7f6ac2efde00 20 client.26099 trim_cache size 0 max 16384 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.244+0000 7f6ac2efde00 1 Processor -- start 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6ac2efde00 1 -- start start 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f55e0 0x56002a30eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 0x56002a2f7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6a600126e0 con 0x56002a2f5f60 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000ff20 con 0x56002a2fafb0 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000dd70 con 0x56002a2f55e0 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abef6e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f55e0 0x56002a30eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abdf6c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 0x56002a2f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abef6e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f55e0 0x56002a30eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48438/0 (socket says 10.20.193.28:48438) 2026-02-20T03:19:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abef6e640 1 -- 10.20.193.28:0/3925156866 learned_addr learned my addr 10.20.193.28:0/3925156866 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abef6e640 1 --2- 10.20.193.28:0/3925156866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abdf6c640 1 -- 10.20.193.28:0/3925156866 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f55e0 msgr2=0x56002a30eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/3925156866 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f55e0 0x56002a30eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abdf6c640 1 -- 10.20.193.28:0/3925156866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 msgr2=0x56002a2f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/3925156866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abdf6c640 1 -- 10.20.193.28:0/3925156866 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002a307700 con 0x56002a2f5f60 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.245+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/3925156866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 0x56002a2f7120 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x56002a3065f0 tx=0x7f6aa40073d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e647f8e1679d41 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6a864e6640 1 -- 10.20.193.28:0/3925156866 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4011700 con 0x56002a2f5f60 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6a864e6640 1 -- 10.20.193.28:0/3925156866 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6aa401f030 con 0x56002a2f5f60 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6a864e6640 1 -- 10.20.193.28:0/3925156866 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4010ca0 con 0x56002a2f5f60 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3925156866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 msgr2=0x56002a2f7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3925156866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 0x56002a2f7120 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x56002a3065f0 tx=0x7f6aa40073d0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3925156866 shutdown_connections 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3925156866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a2f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3925156866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f5f60 0x56002a2f7120 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/3925156866 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f55e0 0x56002a30eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3925156866 >> 10.20.193.28:0/3925156866 conn(0x56002a2b8240 msgr2=0x56002a2f6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3925156866 shutdown_connections 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 -- 10.20.193.28:0/3925156866 wait complete. 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.246+0000 7f6ac2efde00 1 -- start start 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6ac2efde00 1 Processor -- start 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a319600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a319b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6ac2efde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a3890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000e3e0 con 0x56002a2f55e0 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000f850 con 0x56002a2fafb0 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6ac2efde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6000eab0 con 0x56002a2f5f60 2026-02-20T03:19:11.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abef6e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a319600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abdf6c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a319b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abef6e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a319600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56074/0 (socket says 10.20.193.28:56074) 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abef6e640 1 -- 10.20.193.28:0/189662158 learned_addr learned my addr 10.20.193.28:0/189662158 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abef6e640 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a3890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abdf6c640 1 -- 10.20.193.28:0/189662158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 msgr2=0x56002a3890e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a3890e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abdf6c640 1 -- 10.20.193.28:0/189662158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 msgr2=0x56002a319600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a319600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abdf6c640 1 -- 10.20.193.28:0/189662158 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560029f27870 con 0x56002a2f5f60 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.247+0000 7f6abef6e640 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a319600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6abdf6c640 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a319b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4004750 tx=0x7f6aa4010430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bba9b4b016aaff6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6a6bfff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6a6bfff640 1 -- 10.20.193.28:0/189662158 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4034070 con 0x56002a2f5f60 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6a6bfff640 1 -- 10.20.193.28:0/189662158 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6aa40107a0 con 0x56002a2f5f60 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6a6bfff640 1 -- 10.20.193.28:0/189662158 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4024420 con 0x56002a2f5f60 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6ac2efde00 1 -- 10.20.193.28:0/189662158 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56002a1e83f0 con 0x56002a2f5f60 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6a6bfff640 1 -- 10.20.193.28:0/189662158 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6aa40245c0 con 0x56002a2f5f60 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6ac2efde00 10 client.26107 _ll_register_callbacks cb 0x7f6aac009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6ac2efde00 1 -- 10.20.193.28:0/189662158 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56002a2197c0 con 0x56002a2f5f60 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6a6bfff640 1 -- 10.20.193.28:0/189662158 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6aa4011590 con 0x56002a2f5f60 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6ac2efde00 10 client.26107 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.248+0000 7f6ac2efde00 1 -- 10.20.193.28:0/189662158 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=27}) -- 0x56002a3083f0 con 0x56002a2f5f60 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6a6bfff640 1 -- 10.20.193.28:0/189662158 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f6aa4010a20 con 0x56002a2f5f60 2026-02-20T03:19:11.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6ac2efde00 10 client.26107 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:11.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6ac2efde00 10 client.26107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:19:11.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6ac2efde00 20 client.26107 populate_metadata read hostname 'trial028' 2026-02-20T03:19:11.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56002a38a870 0x56002a38cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6ac2efde00 4 client.26107 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:19:11.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6ac2efde00 1 -- 10.20.193.28:0/189662158 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56002a1faab0 con 0x56002a38a870 2026-02-20T03:19:11.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6abef6e640 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56002a38a870 0x56002a38cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6abef6e640 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56002a38a870 0x56002a38cd30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75b4a46a765bc744 server_cookie=c0557f0bd8bcf199 in_seq=0 out_seq=0 2026-02-20T03:19:11.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.249+0000 7f6a6bfff640 10 client.26107 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:19:11.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6a6bfff640 1 -- 10.20.193.28:0/189662158 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56002a1faab0 con 0x56002a38a870 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6a6bfff640 10 client.26107 handle_command_reply: tid=0 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 client.26107 shutdown 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 -- 10.20.193.28:0/189662158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 msgr2=0x56002a319b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a319b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4004750 tx=0x7f6aa4010430 comp rx=0 tx=0).stop 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 -- 10.20.193.28:0/189662158 shutdown_connections 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56002a38a870 0x56002a38cd30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56002a2fafb0 0x56002a3890e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56002a2f5f60 0x56002a319b40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 --2- 10.20.193.28:0/189662158 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56002a2f55e0 0x56002a319600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 -- 10.20.193.28:0/189662158 >> 10.20.193.28:0/189662158 conn(0x56002a2b8240 msgr2=0x56002a2f7230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6a6bfff640 0 client.26107 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:19:11.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 -- 10.20.193.28:0/189662158 shutdown_connections 2026-02-20T03:19:11.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 1 -- 10.20.193.28:0/189662158 wait complete. 2026-02-20T03:19:11.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6ac2efde00 20 client.26107 trim_cache size 0 max 16384 2026-02-20T03:19:11.258 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:19:11.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6abf76f640 1 -- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a940b0e20 msgr2=0x7f6a940b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6abf76f640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a940b0e20 0x7f6a940b32e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6ab003a040 tx=0x7f6ab0005e50 comp rx=0 tx=0).stop 2026-02-20T03:19:11.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6abf76f640 1 -- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab8104990 msgr2=0x7f6ab81116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.250+0000 7f6abf76f640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab8104990 0x7f6ab81116d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6ab002fca0 tx=0x7f6ab002fcd0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.251+0000 7f6abf76f640 1 -- 10.20.193.28:0/3920244618 shutdown_connections 2026-02-20T03:19:11.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.251+0000 7f6abf76f640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a940b0e20 0x7f6a940b32e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.251+0000 7f6abf76f640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab810a990 0x7f6ab810ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.251+0000 7f6abf76f640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab8105330 0x7f6ab810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.251+0000 7f6abf76f640 1 --2- 10.20.193.28:0/3920244618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab8104990 0x7f6ab81116d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.251+0000 7f6abf76f640 1 -- 10.20.193.28:0/3920244618 >> 10.20.193.28:0/3920244618 conn(0x7f6ab8100690 msgr2=0x7f6ab8101040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.251+0000 7f6abf76f640 1 -- 10.20.193.28:0/3920244618 shutdown_connections 2026-02-20T03:19:11.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.251+0000 7f6abf76f640 1 -- 10.20.193.28:0/3920244618 wait complete. 2026-02-20T03:19:11.350 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:11 trial028 ceph-mon[38552]: pgmap v316: 129 pgs: 129 active+clean; 82 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 514 op/s 2026-02-20T03:19:11.352 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:19:11.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 9.27 MB/sec execute 44 sec latency 2341.310 ms 2026-02-20T03:19:11.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:11 trial126 ceph-mon[38476]: pgmap v316: 129 pgs: 129 active+clean; 82 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 514 op/s 2026-02-20T03:19:11.613 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:11 trial177 ceph-mon[43181]: pgmap v316: 129 pgs: 129 active+clean; 82 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 514 op/s 2026-02-20T03:19:11.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 -- 10.20.193.28:0/1009770607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4c10eef0 msgr2=0x7f5e4c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1009770607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4c10eef0 0x7f5e4c10f2d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009a30 tx=0x7f5e3c02f220 comp rx=0 tx=0).stop 2026-02-20T03:19:11.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 -- 10.20.193.28:0/1009770607 shutdown_connections 2026-02-20T03:19:11.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1009770607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4c109ba0 0x7f5e4c115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1009770607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e4c109220 0x7f5e4c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1009770607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4c10eef0 0x7f5e4c10f2d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 -- 10.20.193.28:0/1009770607 >> 10.20.193.28:0/1009770607 conn(0x7f5e4c078600 msgr2=0x7f5e4c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 -- 10.20.193.28:0/1009770607 shutdown_connections 2026-02-20T03:19:11.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 -- 10.20.193.28:0/1009770607 wait complete. 2026-02-20T03:19:11.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.804+0000 7f5e52e24640 1 Processor -- start 2026-02-20T03:19:11.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e52e24640 1 -- start start 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e52e24640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e4c109220 0x7f5e4c1a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e52e24640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4c109ba0 0x7f5e4c1a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e52e24640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4c10eef0 0x7f5e4c1a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e52e24640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c1190a0 con 0x7f5e4c10eef0 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e52e24640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c118f20 con 0x7f5e4c109ba0 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e52e24640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c119220 con 0x7f5e4c109220 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e51e22640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e4c109220 0x7f5e4c1a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e52623640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4c10eef0 0x7f5e4c1a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e51e22640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e4c109220 0x7f5e4c1a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48460/0 (socket says 10.20.193.28:48460) 2026-02-20T03:19:11.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e51621640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4c109ba0 0x7f5e4c1a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e51e22640 1 -- 10.20.193.28:0/1242304924 learned_addr learned my addr 10.20.193.28:0/1242304924 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e51e22640 1 -- 10.20.193.28:0/1242304924 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4c109ba0 msgr2=0x7f5e4c1a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e51e22640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4c109ba0 0x7f5e4c1a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e51e22640 1 -- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4c10eef0 msgr2=0x7f5e4c1a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e51e22640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4c10eef0 0x7f5e4c1a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e51e22640 1 -- 10.20.193.28:0/1242304924 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c1a65a0 con 0x7f5e4c109220 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.805+0000 7f5e52623640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4c10eef0 0x7f5e4c1a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.806+0000 7f5e51e22640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e4c109220 0x7f5e4c1a1550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c005ec0 tx=0x7f5e3c004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.806+0000 7f5e3affd640 1 -- 10.20.193.28:0/1242304924 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c005020 con 0x7f5e4c109220 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.806+0000 7f5e3affd640 1 -- 10.20.193.28:0/1242304924 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e3c005660 con 0x7f5e4c109220 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.806+0000 7f5e52e24640 1 -- 10.20.193.28:0/1242304924 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4c1a6830 con 0x7f5e4c109220 2026-02-20T03:19:11.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.806+0000 7f5e3affd640 1 -- 10.20.193.28:0/1242304924 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c038aa0 con 0x7f5e4c109220 2026-02-20T03:19:11.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.806+0000 7f5e52e24640 1 -- 10.20.193.28:0/1242304924 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4c1ae0d0 con 0x7f5e4c109220 2026-02-20T03:19:11.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.808+0000 7f5e3affd640 1 -- 10.20.193.28:0/1242304924 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5e3c004a70 con 0x7f5e4c109220 2026-02-20T03:19:11.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.809+0000 7f5e565b2e00 1 Processor -- start 2026-02-20T03:19:11.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.809+0000 7f5e565b2e00 1 -- start start 2026-02-20T03:19:11.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.809+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a0983390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.809+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a097da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.809+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a0989de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.809+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5597a08fde00 con 0x5597a097d5e0 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.809+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5597a08d0970 con 0x5597a097df60 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.809+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5597a087e1f0 con 0x5597a0982fb0 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e52623640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a0983390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e52623640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a0983390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48474/0 (socket says 10.20.193.28:48474) 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e52623640 1 -- 10.20.193.28:0/2080206063 learned_addr learned my addr 10.20.193.28:0/2080206063 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e51e22640 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a097da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e51621640 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a0989de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e52623640 1 -- 10.20.193.28:0/2080206063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 msgr2=0x5597a0989de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e52623640 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a0989de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e52623640 1 -- 10.20.193.28:0/2080206063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 msgr2=0x5597a097da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e52623640 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a097da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e52623640 1 -- 10.20.193.28:0/2080206063 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a08913d0 con 0x5597a0982fb0 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e3affd640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e280b0da0 0x7f5e280b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e51e22640 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a097da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e3affd640 1 -- 10.20.193.28:0/1242304924 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5e3c104eb0 con 0x7f5e4c109220 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.810+0000 7f5e52623640 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a0983390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e480094f0 tx=0x7f5e48009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20582f0ff9932d74 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e51621640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e280b0da0 0x7f5e280b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e1a4e6640 1 -- 10.20.193.28:0/2080206063 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e48019020 con 0x5597a0982fb0 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e1a4e6640 1 -- 10.20.193.28:0/2080206063 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e48004570 con 0x5597a0982fb0 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e1a4e6640 1 -- 10.20.193.28:0/2080206063 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800ecb0 con 0x5597a0982fb0 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2080206063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 msgr2=0x5597a0983390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a0983390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e480094f0 tx=0x7f5e48009920 comp rx=0 tx=0).stop 2026-02-20T03:19:11.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e51621640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e280b0da0 0x7f5e280b3260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c10e630 tx=0x7f5e40009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2080206063 shutdown_connections 2026-02-20T03:19:11.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a0989de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a097da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2080206063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a0983390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2080206063 >> 10.20.193.28:0/2080206063 conn(0x5597a0940240 msgr2=0x5597a097bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2080206063 shutdown_connections 2026-02-20T03:19:11.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.811+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2080206063 wait complete. 2026-02-20T03:19:11.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.812+0000 7f5e565b2e00 1 -- start start 2026-02-20T03:19:11.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.813+0000 7f5e565b2e00 1 Processor -- start 2026-02-20T03:19:11.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.813+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a0997c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.813+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09981a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.813+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a09963a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.813+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5597a08cc8a0 con 0x5597a097d5e0 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.813+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5597a06bef50 con 0x5597a097df60 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5597a0996b20 con 0x5597a0982fb0 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51e22640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a0997c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51621640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51621640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39574/0 (socket says 10.20.193.28:39574) 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51621640 1 -- 10.20.193.28:0/377826849 learned_addr learned my addr 10.20.193.28:0/377826849 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e52623640 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a09963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51621640 1 -- 10.20.193.28:0/377826849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 msgr2=0x5597a09963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51621640 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a09963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51621640 1 -- 10.20.193.28:0/377826849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 msgr2=0x5597a0997c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51621640 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a0997c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51621640 1 -- 10.20.193.28:0/377826849 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a098fad0 con 0x5597a097df60 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.814+0000 7f5e51e22640 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a0997c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e51621640 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09981a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e40011790 tx=0x7f5e400047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6dcae84091b6b0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e077fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e077fe640 1 -- 10.20.193.28:0/377826849 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4001f930 con 0x5597a097df60 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e565b2e00 1 -- 10.20.193.28:0/377826849 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a06a1b40 con 0x5597a097df60 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e077fe640 1 -- 10.20.193.28:0/377826849 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e4001c3f0 con 0x5597a097df60 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e077fe640 1 -- 10.20.193.28:0/377826849 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40027600 con 0x5597a097df60 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e565b2e00 10 client.26117 _ll_register_callbacks cb 0x5597a0909eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e565b2e00 1 -- 10.20.193.28:0/377826849 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597a08de150 con 0x5597a097df60 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e077fe640 1 -- 10.20.193.28:0/377826849 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5e400277a0 con 0x5597a097df60 2026-02-20T03:19:11.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e077fe640 1 -- 10.20.193.28:0/377826849 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e4001fad0 con 0x5597a097df60 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e565b2e00 10 client.26117 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.815+0000 7f5e565b2e00 1 -- 10.20.193.28:0/377826849 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5597a088b1e0 con 0x5597a097df60 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e077fe640 1 -- 10.20.193.28:0/377826849 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f5e40026070 con 0x5597a097df60 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e565b2e00 10 client.26117 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e565b2e00 10 client.26117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e565b2e00 20 client.26117 populate_metadata read hostname 'trial028' 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597a09a6480 0x5597a09a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e565b2e00 4 client.26117 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e565b2e00 1 -- 10.20.193.28:0/377826849 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597a08d8560 con 0x5597a09a6480 2026-02-20T03:19:11.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e51e22640 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597a09a6480 0x5597a09a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e51e22640 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597a09a6480 0x5597a09a88d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af64bd97c0261564 server_cookie=11411e694f662e3 in_seq=0 out_seq=0 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.816+0000 7f5e077fe640 10 client.26117 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e077fe640 1 -- 10.20.193.28:0/377826849 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5597a08d8560 con 0x5597a09a6480 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e077fe640 10 client.26117 handle_command_reply: tid=0 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 client.26117 shutdown 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 -- 10.20.193.28:0/377826849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 msgr2=0x5597a09981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09981a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5e40011790 tx=0x7f5e400047c0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 -- 10.20.193.28:0/377826849 shutdown_connections 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597a09a6480 0x5597a09a88d0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a0982fb0 0x5597a09963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09981a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/377826849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097d5e0 0x5597a0997c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 -- 10.20.193.28:0/377826849 >> 10.20.193.28:0/377826849 conn(0x5597a0940240 msgr2=0x5597a097c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e077fe640 0 client.26117 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:11.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 -- 10.20.193.28:0/377826849 shutdown_connections 2026-02-20T03:19:11.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.817+0000 7f5e565b2e00 1 -- 10.20.193.28:0/377826849 wait complete. 2026-02-20T03:19:11.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.818+0000 7f5e565b2e00 20 client.26117 trim_cache size 0 max 16384 2026-02-20T03:19:11.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e565b2e00 1 Processor -- start 2026-02-20T03:19:11.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e565b2e00 1 -- start start 2026-02-20T03:19:11.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a0975ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09951e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a0982fb0 0x5597a09938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80127b0 con 0x5597a0982fb0 2026-02-20T03:19:11.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5df800fff0 con 0x5597a097df60 2026-02-20T03:19:11.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5df800de40 con 0x5597a097d5e0 2026-02-20T03:19:11.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e51e22640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a0975ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e51e22640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a0975ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48486/0 (socket says 10.20.193.28:48486) 2026-02-20T03:19:11.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e51e22640 1 -- 10.20.193.28:0/3041966310 learned_addr learned my addr 10.20.193.28:0/3041966310 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e52623640 1 --2- 10.20.193.28:0/3041966310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a0982fb0 0x5597a09938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.825+0000 7f5e51621640 1 --2- 10.20.193.28:0/3041966310 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e51e22640 1 -- 10.20.193.28:0/3041966310 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 msgr2=0x5597a09951e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e51e22640 1 --2- 10.20.193.28:0/3041966310 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09951e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e51e22640 1 -- 10.20.193.28:0/3041966310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a0982fb0 msgr2=0x5597a09938f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e51e22640 1 --2- 10.20.193.28:0/3041966310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a0982fb0 0x5597a09938f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e51e22640 1 -- 10.20.193.28:0/3041966310 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a098f900 con 0x5597a097d5e0 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e51e22640 1 --2- 10.20.193.28:0/3041966310 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a0975ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0c8f40 tx=0x7f5e3c0049e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7851dd012bc36a99 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e19ce5640 1 -- 10.20.193.28:0/3041966310 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0cc110 con 0x5597a097d5e0 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e19ce5640 1 -- 10.20.193.28:0/3041966310 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e3c033040 con 0x5597a097d5e0 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e19ce5640 1 -- 10.20.193.28:0/3041966310 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c038c40 con 0x5597a097d5e0 2026-02-20T03:19:11.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e565b2e00 1 -- 10.20.193.28:0/3041966310 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 msgr2=0x5597a0975ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/3041966310 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a0975ad0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0c8f40 tx=0x7f5e3c0049e0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e565b2e00 1 -- 10.20.193.28:0/3041966310 shutdown_connections 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/3041966310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a0982fb0 0x5597a09938f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/3041966310 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a097df60 0x5597a09951e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/3041966310 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a0975ad0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e565b2e00 1 -- 10.20.193.28:0/3041966310 >> 10.20.193.28:0/3041966310 conn(0x5597a0940240 msgr2=0x5597a0994ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e565b2e00 1 -- 10.20.193.28:0/3041966310 shutdown_connections 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.826+0000 7f5e565b2e00 1 -- 10.20.193.28:0/3041966310 wait complete. 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.827+0000 7f5e565b2e00 1 -- start start 2026-02-20T03:19:11.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.827+0000 7f5e565b2e00 1 Processor -- start 2026-02-20T03:19:11.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.827+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a099df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097df60 0x5597a099e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e565b2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a0982fb0 0x5597a099ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5df800e4b0 con 0x5597a097df60 2026-02-20T03:19:11.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5df800f920 con 0x5597a0982fb0 2026-02-20T03:19:11.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e565b2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5df800eb80 con 0x5597a097d5e0 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51621640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097df60 0x5597a099e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51621640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097df60 0x5597a099e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56122/0 (socket says 10.20.193.28:56122) 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51621640 1 -- 10.20.193.28:0/2325696730 learned_addr learned my addr 10.20.193.28:0/2325696730 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51e22640 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a099df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e52623640 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a0982fb0 0x5597a099ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51621640 1 -- 10.20.193.28:0/2325696730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 msgr2=0x5597a099df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51621640 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a099df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51621640 1 -- 10.20.193.28:0/2325696730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a0982fb0 msgr2=0x5597a099ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51621640 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a0982fb0 0x5597a099ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51621640 1 -- 10.20.193.28:0/2325696730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a05af870 con 0x5597a097df60 2026-02-20T03:19:11.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e52623640 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a0982fb0 0x5597a099ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e51621640 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097df60 0x5597a099e450 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5e40004090 tx=0x7f5e40009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cc5062a634fd4d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e077fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e077fe640 1 -- 10.20.193.28:0/2325696730 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4001cd80 con 0x5597a097df60 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e077fe640 1 -- 10.20.193.28:0/2325696730 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5597a08de150 con 0x5597a097df60 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e077fe640 1 -- 10.20.193.28:0/2325696730 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e40005020 con 0x5597a097df60 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.828+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2325696730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a08703f0 con 0x5597a097df60 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e077fe640 1 -- 10.20.193.28:0/2325696730 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5e400051c0 con 0x5597a097df60 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 10 client.16395 _ll_register_callbacks cb 0x7f5e400040c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2325696730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597a0882ab0 con 0x5597a097df60 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e077fe640 1 -- 10.20.193.28:0/2325696730 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e4003f060 con 0x5597a097df60 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 10 client.16395 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:11.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2325696730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5597a09905f0 con 0x5597a097df60 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e077fe640 1 -- 10.20.193.28:0/2325696730 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f5e40026040 con 0x5597a097df60 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 10 client.16395 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 20 client.16395 populate_metadata read hostname 'trial028' 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597a0a12110 0x5597a0a145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 4 client.16395 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2325696730 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5e48004570 con 0x5597a0a12110 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.829+0000 7f5e51e22640 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597a0a12110 0x5597a0a145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.830+0000 7f5e51e22640 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597a0a12110 0x5597a0a145d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a915a712f71d5b server_cookie=aec74d0602091634 in_seq=0 out_seq=0 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.830+0000 7f5e077fe640 10 client.16395 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.830+0000 7f5e077fe640 1 -- 10.20.193.28:0/2325696730 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5e48004570 con 0x5597a0a12110 2026-02-20T03:19:11.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.830+0000 7f5e077fe640 10 client.16395 handle_command_reply: tid=0 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.830+0000 7f5e565b2e00 1 client.16395 shutdown 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.830+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2325696730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097df60 msgr2=0x5597a099e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.830+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097df60 0x5597a099e450 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5e40004090 tx=0x7f5e40009ed0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2325696730 shutdown_connections 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597a0a12110 0x5597a0a145d0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597a0982fb0 0x5597a099ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597a097df60 0x5597a099e450 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e565b2e00 1 --2- 10.20.193.28:0/2325696730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597a097d5e0 0x5597a099df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e077fe640 0 client.16395 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2325696730 >> 10.20.193.28:0/2325696730 conn(0x5597a0940240 msgr2=0x5597a09952f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2325696730 shutdown_connections 2026-02-20T03:19:11.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e565b2e00 1 -- 10.20.193.28:0/2325696730 wait complete. 2026-02-20T03:19:11.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e565b2e00 20 client.16395 trim_cache size 0 max 16384 2026-02-20T03:19:11.840 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:19:11.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 -- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e280b0da0 msgr2=0x7f5e280b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e280b0da0 0x7f5e280b3260 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c10e630 tx=0x7f5e40009290 comp rx=0 tx=0).stop 2026-02-20T03:19:11.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 -- 10.20.193.28:0/1242304924 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e4c109220 msgr2=0x7f5e4c1a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:11.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e4c109220 0x7f5e4c1a1550 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c005ec0 tx=0x7f5e3c004290 comp rx=0 tx=0).stop 2026-02-20T03:19:11.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 -- 10.20.193.28:0/1242304924 shutdown_connections 2026-02-20T03:19:11.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e280b0da0 0x7f5e280b3260 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e4c10eef0 0x7f5e4c1a5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e4c109ba0 0x7f5e4c1a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 --2- 10.20.193.28:0/1242304924 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e4c109220 0x7f5e4c1a1550 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:11.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 -- 10.20.193.28:0/1242304924 >> 10.20.193.28:0/1242304924 conn(0x7f5e4c078600 msgr2=0x7f5e4c079f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:11.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 -- 10.20.193.28:0/1242304924 shutdown_connections 2026-02-20T03:19:11.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:11.831+0000 7f5e52e24640 1 -- 10.20.193.28:0/1242304924 wait complete. 2026-02-20T03:19:12.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 9.07 MB/sec execute 45 sec latency 3341.373 ms 2026-02-20T03:19:12.931 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:19:12.931 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:19:13.197 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.377+0000 7fc33667f640 1 -- 10.20.193.28:0/4012662898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 msgr2=0x7fc330115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.377+0000 7fc33667f640 1 --2- 10.20.193.28:0/4012662898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 0x7fc330115d10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00b0a0 tx=0x7fc32c02f410 comp rx=0 tx=0).stop 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.377+0000 7fc33667f640 1 -- 10.20.193.28:0/4012662898 shutdown_connections 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.377+0000 7fc33667f640 1 --2- 10.20.193.28:0/4012662898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 0x7fc330115d10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.377+0000 7fc33667f640 1 --2- 10.20.193.28:0/4012662898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc330109220 0x7fc330109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.377+0000 7fc33667f640 1 --2- 10.20.193.28:0/4012662898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc33010eef0 0x7fc33010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.377+0000 7fc33667f640 1 -- 10.20.193.28:0/4012662898 >> 10.20.193.28:0/4012662898 conn(0x7fc330078600 msgr2=0x7fc33007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.377+0000 7fc33667f640 1 -- 10.20.193.28:0/4012662898 shutdown_connections 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.377+0000 7fc33667f640 1 -- 10.20.193.28:0/4012662898 wait complete. 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc33667f640 1 Processor -- start 2026-02-20T03:19:13.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc33667f640 1 -- start start 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc33667f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc330109220 0x7fc3301a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc33667f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 0x7fc3301a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc33667f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc33010eef0 0x7fc3301a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc33667f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc3301190a0 con 0x7fc330109ba0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc33667f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc330118f20 con 0x7fc330109220 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc33667f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc330119220 con 0x7fc33010eef0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc334e7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 0x7fc3301a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc334e7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 0x7fc3301a1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56148/0 (socket says 10.20.193.28:56148) 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc33567d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc330109220 0x7fc3301a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc334e7c640 1 -- 10.20.193.28:0/1366937303 learned_addr learned my addr 10.20.193.28:0/1366937303 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.378+0000 7fc335e7e640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc33010eef0 0x7fc3301a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc334e7c640 1 -- 10.20.193.28:0/1366937303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc33010eef0 msgr2=0x7fc3301a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc334e7c640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc33010eef0 0x7fc3301a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc334e7c640 1 -- 10.20.193.28:0/1366937303 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc330109220 msgr2=0x7fc3301a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc334e7c640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc330109220 0x7fc3301a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc334e7c640 1 -- 10.20.193.28:0/1366937303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3301a6490 con 0x7fc330109ba0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc334e7c640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 0x7fc3301a1980 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc32400d950 tx=0x7fc32400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc31e7fc640 1 -- 10.20.193.28:0/1366937303 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324014070 con 0x7fc330109ba0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc31e7fc640 1 -- 10.20.193.28:0/1366937303 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc3240044e0 con 0x7fc330109ba0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc31e7fc640 1 -- 10.20.193.28:0/1366937303 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324005020 con 0x7fc330109ba0 2026-02-20T03:19:13.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc33667f640 1 -- 10.20.193.28:0/1366937303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3301a6780 con 0x7fc330109ba0 2026-02-20T03:19:13.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.379+0000 7fc33667f640 1 -- 10.20.193.28:0/1366937303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3301adfc0 con 0x7fc330109ba0 2026-02-20T03:19:13.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.382+0000 7fc31e7fc640 1 -- 10.20.193.28:0/1366937303 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc32400b900 con 0x7fc330109ba0 2026-02-20T03:19:13.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.382+0000 7fc339e0de00 1 Processor -- start 2026-02-20T03:19:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.382+0000 7fc339e0de00 1 -- start start 2026-02-20T03:19:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8a844a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a84a70 0x55c9c8a88540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a88b60 0x55c9c8a88fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc339e0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c9c89d6c00 con 0x55c9c8a840c0 2026-02-20T03:19:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc339e0de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c9c89843c0 con 0x55c9c8a84a70 2026-02-20T03:19:13.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc339e0de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c9c89d2b30 con 0x55c9c8a88b60 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc335e7e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8a844a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc335e7e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8a844a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56158/0 (socket says 10.20.193.28:56158) 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc335e7e640 1 -- 10.20.193.28:0/876586941 learned_addr learned my addr 10.20.193.28:0/876586941 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc33567d640 1 --2- 10.20.193.28:0/876586941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a84a70 0x55c9c8a88540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc334e7c640 1 --2- 10.20.193.28:0/876586941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a88b60 0x55c9c8a88fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc335e7e640 1 -- 10.20.193.28:0/876586941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a88b60 msgr2=0x55c9c8a88fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc335e7e640 1 --2- 10.20.193.28:0/876586941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a88b60 0x55c9c8a88fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc335e7e640 1 -- 10.20.193.28:0/876586941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a84a70 msgr2=0x55c9c8a88540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc335e7e640 1 --2- 10.20.193.28:0/876586941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a84a70 0x55c9c8a88540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc335e7e640 1 -- 10.20.193.28:0/876586941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c897d840 con 0x55c9c8a840c0 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc31e7fc640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc30c0b0e20 0x7fc30c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.383+0000 7fc31e7fc640 1 -- 10.20.193.28:0/1366937303 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc3240e0870 con 0x7fc330109ba0 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.384+0000 7fc33567d640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc30c0b0e20 0x7fc30c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.384+0000 7fc335e7e640 1 --2- 10.20.193.28:0/876586941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8a844a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005c00 tx=0x7fc32c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f3241df9c73598 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.384+0000 7fc2fdce5640 1 -- 10.20.193.28:0/876586941 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0090d0 con 0x55c9c8a840c0 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.384+0000 7fc2fdce5640 1 -- 10.20.193.28:0/876586941 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc32c033050 con 0x55c9c8a840c0 2026-02-20T03:19:13.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.384+0000 7fc2fdce5640 1 -- 10.20.193.28:0/876586941 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c0076a0 con 0x55c9c8a840c0 2026-02-20T03:19:13.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.384+0000 7fc33567d640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc30c0b0e20 0x7fc30c0b32e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55c9c8a85090 tx=0x7fc320009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.384+0000 7fc339e0de00 1 -- 10.20.193.28:0/876586941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 msgr2=0x55c9c8a844a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.384+0000 7fc339e0de00 1 --2- 10.20.193.28:0/876586941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8a844a0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005c00 tx=0x7fc32c00c000 comp rx=0 tx=0).stop 2026-02-20T03:19:13.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.385+0000 7fc339e0de00 1 -- 10.20.193.28:0/876586941 shutdown_connections 2026-02-20T03:19:13.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.385+0000 7fc339e0de00 1 --2- 10.20.193.28:0/876586941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a88b60 0x55c9c8a88fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.385+0000 7fc339e0de00 1 --2- 10.20.193.28:0/876586941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a84a70 0x55c9c8a88540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.385+0000 7fc339e0de00 1 --2- 10.20.193.28:0/876586941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8a844a0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.385+0000 7fc339e0de00 1 -- 10.20.193.28:0/876586941 >> 10.20.193.28:0/876586941 conn(0x55c9c8a7cb60 msgr2=0x55c9c8a825e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.385+0000 7fc339e0de00 1 -- 10.20.193.28:0/876586941 shutdown_connections 2026-02-20T03:19:13.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.385+0000 7fc339e0de00 1 -- 10.20.193.28:0/876586941 wait complete. 2026-02-20T03:19:13.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.386+0000 7fc339e0de00 1 -- start start 2026-02-20T03:19:13.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.386+0000 7fc339e0de00 1 Processor -- start 2026-02-20T03:19:13.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.386+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a840c0 0x55c9c8a9e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.386+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 0x55c9c8a9e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.386+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a88b60 0x55c9c8a9c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.386+0000 7fc339e0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c9c897e1a0 con 0x55c9c8a88b60 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.386+0000 7fc339e0de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c9c8a90cb0 con 0x55c9c8a840c0 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.386+0000 7fc339e0de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c9c8a9ce40 con 0x55c9c8a84a70 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc33567d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a840c0 0x55c9c8a9e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc33567d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a840c0 0x55c9c8a9e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39632/0 (socket says 10.20.193.28:39632) 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc33567d640 1 -- 10.20.193.28:0/972019077 learned_addr learned my addr 10.20.193.28:0/972019077 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc334e7c640 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 0x55c9c8a9e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc335e7e640 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a88b60 0x55c9c8a9c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc33567d640 1 -- 10.20.193.28:0/972019077 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 msgr2=0x55c9c8a9e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc33567d640 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 0x55c9c8a9e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc33567d640 1 -- 10.20.193.28:0/972019077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a88b60 msgr2=0x55c9c8a9c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc33567d640 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a88b60 0x55c9c8a9c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc33567d640 1 -- 10.20.193.28:0/972019077 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c8a96530 con 0x55c9c8a840c0 2026-02-20T03:19:13.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc335e7e640 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a88b60 0x55c9c8a9c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:13.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc33567d640 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a840c0 0x55c9c8a9e050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc320004750 tx=0x7fc3200047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32dd00dbcb538b11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.387+0000 7fc2eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:19:13.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc2eaffd640 1 -- 10.20.193.28:0/972019077 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32001f6c0 con 0x55c9c8a840c0 2026-02-20T03:19:13.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc2eaffd640 1 -- 10.20.193.28:0/972019077 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc32001fd00 con 0x55c9c8a840c0 2026-02-20T03:19:13.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc2eaffd640 1 -- 10.20.193.28:0/972019077 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3200273e0 con 0x55c9c8a840c0 2026-02-20T03:19:13.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc339e0de00 1 -- 10.20.193.28:0/972019077 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c87a5b60 con 0x55c9c8a840c0 2026-02-20T03:19:13.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc2eaffd640 1 -- 10.20.193.28:0/972019077 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc32001c760 con 0x55c9c8a840c0 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc339e0de00 10 client.26135 _ll_register_callbacks cb 0x55c9c89820d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc339e0de00 1 -- 10.20.193.28:0/972019077 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c9c89de7f0 con 0x55c9c8a840c0 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc2eaffd640 1 -- 10.20.193.28:0/972019077 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc32001c3f0 con 0x55c9c8a840c0 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc339e0de00 10 client.26135 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.388+0000 7fc339e0de00 1 -- 10.20.193.28:0/972019077 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55c9c89a3430 con 0x55c9c8a840c0 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.389+0000 7fc2eaffd640 1 -- 10.20.193.28:0/972019077 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7fc320026070 con 0x55c9c8a840c0 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.389+0000 7fc339e0de00 10 client.26135 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.389+0000 7fc339e0de00 10 client.26135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.389+0000 7fc339e0de00 20 client.26135 populate_metadata read hostname 'trial028' 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.389+0000 7fc339e0de00 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9c8aac8f0 0x55c9c8aaed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.389+0000 7fc339e0de00 4 client.26135 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:13.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.389+0000 7fc339e0de00 1 -- 10.20.193.28:0/972019077 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9c89de7f0 con 0x55c9c8aac8f0 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.389+0000 7fc334e7c640 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9c8aac8f0 0x55c9c8aaed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.390+0000 7fc334e7c640 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9c8aac8f0 0x55c9c8aaed80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d569932f36d945a1 server_cookie=64e94c338d701124 in_seq=0 out_seq=0 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.390+0000 7fc2eaffd640 10 client.26135 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.390+0000 7fc2eaffd640 1 -- 10.20.193.28:0/972019077 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c9c89de7f0 con 0x55c9c8aac8f0 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.390+0000 7fc2eaffd640 10 client.26135 handle_command_reply: tid=0 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.390+0000 7fc339e0de00 1 client.26135 shutdown 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.390+0000 7fc339e0de00 1 -- 10.20.193.28:0/972019077 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a840c0 msgr2=0x55c9c8a9e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.390+0000 7fc339e0de00 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a840c0 0x55c9c8a9e050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc320004750 tx=0x7fc3200047c0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc339e0de00 1 -- 10.20.193.28:0/972019077 shutdown_connections 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc339e0de00 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9c8aac8f0 0x55c9c8aaed80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc339e0de00 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a88b60 0x55c9c8a9c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc339e0de00 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 0x55c9c8a9e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc339e0de00 1 --2- 10.20.193.28:0/972019077 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a840c0 0x55c9c8a9e050 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc2eaffd640 0 client.26135 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:13.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc339e0de00 1 -- 10.20.193.28:0/972019077 >> 10.20.193.28:0/972019077 conn(0x55c9c8a7cb60 msgr2=0x55c9c8a87520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc339e0de00 1 -- 10.20.193.28:0/972019077 shutdown_connections 2026-02-20T03:19:13.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc339e0de00 1 -- 10.20.193.28:0/972019077 wait complete. 2026-02-20T03:19:13.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.391+0000 7fc339e0de00 20 client.26135 trim_cache size 0 max 16384 2026-02-20T03:19:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.399+0000 7fc339e0de00 1 Processor -- start 2026-02-20T03:19:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.399+0000 7fc339e0de00 1 -- start start 2026-02-20T03:19:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a840c0 0x55c9c8a88220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a84a70 0x55c9c8a89c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 0x55c9c8a8a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc339e0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc012770 con 0x55c9c8a84a70 2026-02-20T03:19:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc339e0de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc00ffb0 con 0x55c9c8a88b60 2026-02-20T03:19:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc339e0de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc00de00 con 0x55c9c8a840c0 2026-02-20T03:19:13.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc334e7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a84a70 0x55c9c8a89c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc33567d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a840c0 0x55c9c8a88220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc334e7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a84a70 0x55c9c8a89c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56184/0 (socket says 10.20.193.28:56184) 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc334e7c640 1 -- 10.20.193.28:0/71800316 learned_addr learned my addr 10.20.193.28:0/71800316 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc335e7e640 1 --2- 10.20.193.28:0/71800316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 0x55c9c8a8a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc334e7c640 1 -- 10.20.193.28:0/71800316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a840c0 msgr2=0x55c9c8a88220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc334e7c640 1 --2- 10.20.193.28:0/71800316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a840c0 0x55c9c8a88220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc334e7c640 1 -- 10.20.193.28:0/71800316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 msgr2=0x55c9c8a8a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc334e7c640 1 --2- 10.20.193.28:0/71800316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 0x55c9c8a8a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc334e7c640 1 -- 10.20.193.28:0/71800316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c8a84810 con 0x55c9c8a84a70 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc335e7e640 1 --2- 10.20.193.28:0/71800316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 0x55c9c8a8a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:19:13.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc334e7c640 1 --2- 10.20.193.28:0/71800316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a84a70 0x55c9c8a89c20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc3240040a0 tx=0x7fc324004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1cb3be9846b2545 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.400+0000 7fc2fd4e4640 1 -- 10.20.193.28:0/71800316 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32401d040 con 0x55c9c8a84a70 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc2fd4e4640 1 -- 10.20.193.28:0/71800316 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc3240047c0 con 0x55c9c8a84a70 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc2fd4e4640 1 -- 10.20.193.28:0/71800316 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3240b1580 con 0x55c9c8a84a70 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 -- 10.20.193.28:0/71800316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a84a70 msgr2=0x55c9c8a89c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 --2- 10.20.193.28:0/71800316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a84a70 0x55c9c8a89c20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc3240040a0 tx=0x7fc324004a80 comp rx=0 tx=0).stop 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 -- 10.20.193.28:0/71800316 shutdown_connections 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 --2- 10.20.193.28:0/71800316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 0x55c9c8a8a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 --2- 10.20.193.28:0/71800316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a84a70 0x55c9c8a89c20 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 --2- 10.20.193.28:0/71800316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a840c0 0x55c9c8a88220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 -- 10.20.193.28:0/71800316 >> 10.20.193.28:0/71800316 conn(0x55c9c8a7cb60 msgr2=0x55c9c8a89510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 -- 10.20.193.28:0/71800316 shutdown_connections 2026-02-20T03:19:13.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 -- 10.20.193.28:0/71800316 wait complete. 2026-02-20T03:19:13.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.401+0000 7fc339e0de00 1 -- start start 2026-02-20T03:19:13.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc339e0de00 1 Processor -- start 2026-02-20T03:19:13.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8aa4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 0x55c9c8aa1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc339e0de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 0x55c9c8aa24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc339e0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc00e470 con 0x55c9c8a840c0 2026-02-20T03:19:13.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc339e0de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc00f8e0 con 0x55c9c8a88b60 2026-02-20T03:19:13.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc339e0de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc00eb40 con 0x55c9c8a84a70 2026-02-20T03:19:13.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc33567d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8aa4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc33567d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8aa4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56198/0 (socket says 10.20.193.28:56198) 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc33567d640 1 -- 10.20.193.28:0/2896594617 learned_addr learned my addr 10.20.193.28:0/2896594617 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc334e7c640 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 0x55c9c8aa1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc335e7e640 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 0x55c9c8aa24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc33567d640 1 -- 10.20.193.28:0/2896594617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 msgr2=0x55c9c8aa1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc33567d640 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 0x55c9c8aa1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc33567d640 1 -- 10.20.193.28:0/2896594617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 msgr2=0x55c9c8aa24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc33567d640 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 0x55c9c8aa24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.402+0000 7fc33567d640 1 -- 10.20.193.28:0/2896594617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9c8a96360 con 0x55c9c8a840c0 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc33567d640 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8aa4930 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc320022040 tx=0x7fc320011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb5f0233c7a0340 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc2eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:13.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc2eaffd640 1 -- 10.20.193.28:0/2896594617 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32003e020 con 0x55c9c8a840c0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc2eaffd640 1 -- 10.20.193.28:0/2896594617 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc32001f040 con 0x55c9c8a840c0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 1 -- 10.20.193.28:0/2896594617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9c86b5900 con 0x55c9c8a840c0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc2eaffd640 1 -- 10.20.193.28:0/2896594617 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320005020 con 0x55c9c8a840c0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 10 client.16413 _ll_register_callbacks cb 0x7fc320009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 1 -- 10.20.193.28:0/2896594617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c9c8958c00 con 0x55c9c8a840c0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc2eaffd640 1 -- 10.20.193.28:0/2896594617 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc3200051c0 con 0x55c9c8a840c0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc2eaffd640 1 -- 10.20.193.28:0/2896594617 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc320049050 con 0x55c9c8a840c0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 10 client.16413 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 1 -- 10.20.193.28:0/2896594617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55c9c89914d0 con 0x55c9c8a840c0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc2eaffd640 1 -- 10.20.193.28:0/2896594617 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7fc320026040 con 0x55c9c8a840c0 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 10 client.16413 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:13.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 20 client.16413 populate_metadata read hostname 'trial028' 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9c8b19b90 0x55c9c8b1c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 4 client.16413 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.403+0000 7fc339e0de00 1 -- 10.20.193.28:0/2896594617 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c9c89e45a0 con 0x55c9c8b19b90 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.404+0000 7fc334e7c640 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9c8b19b90 0x55c9c8b1c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.404+0000 7fc334e7c640 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9c8b19b90 0x55c9c8b1c050 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b760e5c797b32b6 server_cookie=280c6fe2f0da2cff in_seq=0 out_seq=0 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.404+0000 7fc2eaffd640 10 client.16413 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc2eaffd640 1 -- 10.20.193.28:0/2896594617 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c9c89e45a0 con 0x55c9c8b19b90 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc2eaffd640 10 client.16413 handle_command_reply: tid=0 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 client.16413 shutdown 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 -- 10.20.193.28:0/2896594617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 msgr2=0x55c9c8aa4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8aa4930 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc320022040 tx=0x7fc320011580 comp rx=0 tx=0).stop 2026-02-20T03:19:13.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 -- 10.20.193.28:0/2896594617 shutdown_connections 2026-02-20T03:19:13.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c9c8b19b90 0x55c9c8b1c050 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c9c8a88b60 0x55c9c8aa24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c9c8a84a70 0x55c9c8aa1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 --2- 10.20.193.28:0/2896594617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c9c8a840c0 0x55c9c8aa4930 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc2eaffd640 0 client.16413 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:13.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 -- 10.20.193.28:0/2896594617 >> 10.20.193.28:0/2896594617 conn(0x55c9c8a7cb60 msgr2=0x55c9c8a89d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 -- 10.20.193.28:0/2896594617 shutdown_connections 2026-02-20T03:19:13.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 1 -- 10.20.193.28:0/2896594617 wait complete. 2026-02-20T03:19:13.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.405+0000 7fc339e0de00 20 client.16413 trim_cache size 0 max 16384 2026-02-20T03:19:13.415 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:19:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:19:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "418b6710-366c-4655-98a2-c5ee576064d0", 2026-02-20T03:19:13.415 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:19:13.415 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:19:13.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 -- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc30c0b0e20 msgr2=0x7fc30c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc30c0b0e20 0x7fc30c0b32e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55c9c8a85090 tx=0x7fc320009290 comp rx=0 tx=0).stop 2026-02-20T03:19:13.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 -- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 msgr2=0x7fc3301a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 0x7fc3301a1980 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc32400d950 tx=0x7fc32400de20 comp rx=0 tx=0).stop 2026-02-20T03:19:13.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 -- 10.20.193.28:0/1366937303 shutdown_connections 2026-02-20T03:19:13.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc30c0b0e20 0x7fc30c0b32e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc33010eef0 0x7fc3301a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc330109ba0 0x7fc3301a1980 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 --2- 10.20.193.28:0/1366937303 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc330109220 0x7fc3301a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 -- 10.20.193.28:0/1366937303 >> 10.20.193.28:0/1366937303 conn(0x7fc330078600 msgr2=0x7fc330079d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 -- 10.20.193.28:0/1366937303 shutdown_connections 2026-02-20T03:19:13.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.406+0000 7fc33667f640 1 -- 10.20.193.28:0/1366937303 wait complete. 2026-02-20T03:19:13.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 8.87 MB/sec execute 46 sec latency 4341.419 ms 2026-02-20T03:19:13.506 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:13 trial028 ceph-mon[38552]: pgmap v317: 129 pgs: 129 active+clean; 83 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 475 op/s 2026-02-20T03:19:13.509 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:19:13.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:13 trial126 ceph-mon[38476]: pgmap v317: 129 pgs: 129 active+clean; 83 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 475 op/s 2026-02-20T03:19:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:13 trial177 ceph-mon[43181]: pgmap v317: 129 pgs: 129 active+clean; 83 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 475 op/s 2026-02-20T03:19:13.774 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:13.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.955+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/303479455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc104da0 msgr2=0x7f6dbc105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.955+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/303479455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc104da0 0x7f6dbc105180 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009a30 tx=0x7f6dac02f220 comp rx=0 tx=0).stop 2026-02-20T03:19:13.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.955+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/303479455 shutdown_connections 2026-02-20T03:19:13.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.955+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/303479455 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6dbc109ed0 0x7f6dbc111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.955+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/303479455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6dbc105750 0x7f6dbc1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.955+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/303479455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc104da0 0x7f6dbc105180 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.955+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/303479455 >> 10.20.193.28:0/303479455 conn(0x7f6dbc100840 msgr2=0x7f6dbc102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.955+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/303479455 shutdown_connections 2026-02-20T03:19:13.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.956+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/303479455 wait complete. 2026-02-20T03:19:13.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc3ef2640 1 Processor -- start 2026-02-20T03:19:13.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc3ef2640 1 -- start start 2026-02-20T03:19:13.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc3ef2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6dbc104da0 0x7f6dbc19d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc3ef2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc105750 0x7f6dbc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc3ef2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6dbc109ed0 0x7f6dbc1a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc3ef2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc114da0 con 0x7f6dbc105750 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc3ef2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc114c20 con 0x7f6dbc109ed0 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc3ef2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc114f20 con 0x7f6dbc104da0 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc1466640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc105750 0x7f6dbc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc1466640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc105750 0x7f6dbc19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56206/0 (socket says 10.20.193.28:56206) 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc1466640 1 -- 10.20.193.28:0/1710199243 learned_addr learned my addr 10.20.193.28:0/1710199243 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6dbc104da0 0x7f6dbc19d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.957+0000 7f6dc2468640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6dbc109ed0 0x7f6dbc1a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6dc1466640 1 -- 10.20.193.28:0/1710199243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6dbc104da0 msgr2=0x7f6dbc19d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6dc1466640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6dbc104da0 0x7f6dbc19d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6dc1466640 1 -- 10.20.193.28:0/1710199243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6dbc109ed0 msgr2=0x7f6dbc1a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6dc1466640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6dbc109ed0 0x7f6dbc1a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6dc1466640 1 -- 10.20.193.28:0/1710199243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dbc1a2140 con 0x7f6dbc105750 2026-02-20T03:19:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6dc1466640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc105750 0x7f6dbc19d6d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6db000cab0 tx=0x7f6db000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6daaffd640 1 -- 10.20.193.28:0/1710199243 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db0013070 con 0x7f6dbc105750 2026-02-20T03:19:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6daaffd640 1 -- 10.20.193.28:0/1710199243 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6db0007dd0 con 0x7f6dbc105750 2026-02-20T03:19:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6daaffd640 1 -- 10.20.193.28:0/1710199243 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db000f450 con 0x7f6dbc105750 2026-02-20T03:19:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/1710199243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dbc1a2430 con 0x7f6dbc105750 2026-02-20T03:19:13.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.958+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/1710199243 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dbc1a9d10 con 0x7f6dbc105750 2026-02-20T03:19:13.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.961+0000 7f6daaffd640 1 -- 10.20.193.28:0/1710199243 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6db0007930 con 0x7f6dbc105750 2026-02-20T03:19:13.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.961+0000 7f6dc63f7e00 1 Processor -- start 2026-02-20T03:19:13.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.961+0000 7f6dc63f7e00 1 -- start start 2026-02-20T03:19:13.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 0x55cea7aa1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aa59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 0x55cea7aadca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cea7a21e50 con 0x55cea7aa1fe0 2026-02-20T03:19:13.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cea79f49c0 con 0x55cea7aa1630 2026-02-20T03:19:13.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cea79a2240 con 0x55cea7aa6120 2026-02-20T03:19:13.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1c67640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aa59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1c67640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aa59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56214/0 (socket says 10.20.193.28:56214) 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1c67640 1 -- 10.20.193.28:0/2630619688 learned_addr learned my addr 10.20.193.28:0/2630619688 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc2468640 1 --2- 10.20.193.28:0/2630619688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 0x55cea7aa1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1466640 1 --2- 10.20.193.28:0/2630619688 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 0x55cea7aadca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1c67640 1 -- 10.20.193.28:0/2630619688 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 msgr2=0x55cea7aadca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/2630619688 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 0x55cea7aadca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1c67640 1 -- 10.20.193.28:0/2630619688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 msgr2=0x55cea7aa1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/2630619688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 0x55cea7aa1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1c67640 1 -- 10.20.193.28:0/2630619688 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea79b5420 con 0x55cea7aa1fe0 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.962+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/2630619688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aa59f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6dac037000 tx=0x7f6dac02fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd534b72d9b37e3a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6d8a4e6640 1 -- 10.20.193.28:0/2630619688 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac004070 con 0x55cea7aa1fe0 2026-02-20T03:19:13.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6daaffd640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d980b0e20 0x7f6d980b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6d8a4e6640 1 -- 10.20.193.28:0/2630619688 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6dac033040 con 0x55cea7aa1fe0 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6d8a4e6640 1 -- 10.20.193.28:0/2630619688 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac004a20 con 0x55cea7aa1fe0 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6daaffd640 1 -- 10.20.193.28:0/1710199243 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6db00e05d0 con 0x7f6dbc105750 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/2630619688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 msgr2=0x55cea7aa59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/2630619688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aa59f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6dac037000 tx=0x7f6dac02fb30 comp rx=0 tx=0).stop 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/2630619688 shutdown_connections 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/2630619688 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 0x55cea7aadca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/2630619688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aa59f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/2630619688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 0x55cea7aa1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/2630619688 >> 10.20.193.28:0/2630619688 conn(0x55cea7a64290 msgr2=0x55cea7a9fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/2630619688 shutdown_connections 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/2630619688 wait complete. 2026-02-20T03:19:13.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.963+0000 7f6dc2468640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d980b0e20 0x7f6d980b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.964+0000 7f6dc2468640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d980b0e20 0x7f6d980b32e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6db8007b00 tx=0x7f6db8009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.964+0000 7f6dc63f7e00 1 -- start start 2026-02-20T03:19:13.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.964+0000 7f6dc63f7e00 1 Processor -- start 2026-02-20T03:19:13.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 0x55cea7ac4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7ac45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 0x55cea7ac2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cea79f08f0 con 0x55cea7aa1fe0 2026-02-20T03:19:13.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cea77e2f50 con 0x55cea7aa1630 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cea7ac2e70 con 0x55cea7aa6120 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc1466640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7ac45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc2468640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 0x55cea7ac2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc1466640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7ac45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56220/0 (socket says 10.20.193.28:56220) 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc1466640 1 -- 10.20.193.28:0/837960687 learned_addr learned my addr 10.20.193.28:0/837960687 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.965+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 0x55cea7ac4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc1466640 1 -- 10.20.193.28:0/837960687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 msgr2=0x55cea7ac2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc1466640 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 0x55cea7ac2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc1466640 1 -- 10.20.193.28:0/837960687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 msgr2=0x55cea7ac4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc1466640 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 0x55cea7ac4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc1466640 1 -- 10.20.193.28:0/837960687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea7abc2b0 con 0x55cea7aa1fe0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc2468640 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 0x55cea7ac2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc1466640 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7ac45c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6db00a40e0 tx=0x7f6db0007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ff53171b5486d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6d777fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6d777fe640 1 -- 10.20.193.28:0/837960687 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db001d070 con 0x55cea7aa1fe0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/837960687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cea77c5b40 con 0x55cea7aa1fe0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc63f7e00 10 client.16425 _ll_register_callbacks cb 0x55cea7a2df00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6d777fe640 1 -- 10.20.193.28:0/837960687 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6db00a89b0 con 0x55cea7aa1fe0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/837960687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cea7a021a0 con 0x55cea7aa1fe0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6d777fe640 1 -- 10.20.193.28:0/837960687 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db00ac110 con 0x55cea7aa1fe0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.966+0000 7f6d777fe640 1 -- 10.20.193.28:0/837960687 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6db00ac330 con 0x55cea7aa1fe0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6d777fe640 1 -- 10.20.193.28:0/837960687 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6db00a39d0 con 0x55cea7aa1fe0 2026-02-20T03:19:13.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6dc63f7e00 10 client.16425 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/837960687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55cea79af230 con 0x55cea7aa1fe0 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6d777fe640 1 -- 10.20.193.28:0/837960687 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f6db00a3b70 con 0x55cea7aa1fe0 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6dc63f7e00 10 client.16425 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6dc63f7e00 10 client.16425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6dc63f7e00 20 client.16425 populate_metadata read hostname 'trial028' 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cea7ab1c40 0x55cea7ab4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6dc63f7e00 4 client.16425 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/837960687 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cea79fc5b0 con 0x55cea7ab1c40 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.967+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cea7ab1c40 0x55cea7ab4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.968+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cea7ab1c40 0x55cea7ab4100 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1a25c858e4a6633 server_cookie=67f6d408dbdb56d7 in_seq=0 out_seq=0 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.968+0000 7f6d777fe640 10 client.16425 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:13.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6d777fe640 1 -- 10.20.193.28:0/837960687 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55cea79fc5b0 con 0x55cea7ab1c40 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6d777fe640 10 client.16425 handle_command_reply: tid=0 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 client.16425 shutdown 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/837960687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 msgr2=0x55cea7ac45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7ac45c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6db00a40e0 tx=0x7f6db0007d20 comp rx=0 tx=0).stop 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/837960687 shutdown_connections 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cea7ab1c40 0x55cea7ab4100 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa6120 0x55cea7ac2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7ac45c0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/837960687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1630 0x55cea7ac4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6d777fe640 0 client.16425 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/837960687 >> 10.20.193.28:0/837960687 conn(0x55cea7a64290 msgr2=0x55cea7a9d500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/837960687 shutdown_connections 2026-02-20T03:19:13.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/837960687 wait complete. 2026-02-20T03:19:13.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.969+0000 7f6dc63f7e00 20 client.16425 trim_cache size 0 max 16384 2026-02-20T03:19:13.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc63f7e00 1 Processor -- start 2026-02-20T03:19:13.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc63f7e00 1 -- start start 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7a64290 0x55cea7aa0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 0x55cea7ab2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1fe0 0x55cea7ab2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d68012780 con 0x55cea7a64290 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6800ffc0 con 0x55cea7aa1fe0 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6800de10 con 0x55cea7aa1630 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc1c67640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7a64290 0x55cea7aa0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc1c67640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7a64290 0x55cea7aa0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56226/0 (socket says 10.20.193.28:56226) 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc1466640 1 --2- 10.20.193.28:0/234891291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 0x55cea7ab2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc1c67640 1 -- 10.20.193.28:0/234891291 learned_addr learned my addr 10.20.193.28:0/234891291 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.978+0000 7f6dc2468640 1 --2- 10.20.193.28:0/234891291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1fe0 0x55cea7ab2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc1c67640 1 -- 10.20.193.28:0/234891291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 msgr2=0x55cea7ab2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/234891291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 0x55cea7ab2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc1c67640 1 -- 10.20.193.28:0/234891291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1fe0 msgr2=0x55cea7ab2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/234891291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1fe0 0x55cea7ab2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc1c67640 1 -- 10.20.193.28:0/234891291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea7abc0e0 con 0x55cea7a64290 2026-02-20T03:19:13.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/234891291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7a64290 0x55cea7aa0520 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6dac005610 tx=0x7f6dac02f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b2005791a592c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6d89ce5640 1 -- 10.20.193.28:0/234891291 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac02fd90 con 0x55cea7a64290 2026-02-20T03:19:13.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6d89ce5640 1 -- 10.20.193.28:0/234891291 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6dac004560 con 0x55cea7a64290 2026-02-20T03:19:13.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6d89ce5640 1 -- 10.20.193.28:0/234891291 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac0026e0 con 0x55cea7a64290 2026-02-20T03:19:13.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/234891291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7a64290 msgr2=0x55cea7aa0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/234891291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7a64290 0x55cea7aa0520 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6dac005610 tx=0x7f6dac02f220 comp rx=0 tx=0).stop 2026-02-20T03:19:13.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/234891291 shutdown_connections 2026-02-20T03:19:13.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/234891291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7aa1fe0 0x55cea7ab2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/234891291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 0x55cea7ab2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/234891291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7a64290 0x55cea7aa0520 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.979+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/234891291 >> 10.20.193.28:0/234891291 conn(0x55cea7ac4720 msgr2=0x55cea7ab2020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/234891291 shutdown_connections 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/234891291 wait complete. 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 -- start start 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 Processor -- start 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7a64290 0x55cea7ace930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 0x55cea7ac9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6800e480 con 0x55cea7aa1fe0 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6800f8f0 con 0x55cea7a64290 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.980+0000 7f6dc63f7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6800eb50 con 0x55cea7aa1630 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc2468640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc2468640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56236/0 (socket says 10.20.193.28:56236) 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc2468640 1 -- 10.20.193.28:0/226885235 learned_addr learned my addr 10.20.193.28:0/226885235 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7a64290 0x55cea7ace930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc1466640 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 0x55cea7ac9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc2468640 1 -- 10.20.193.28:0/226885235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 msgr2=0x55cea7ac9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc2468640 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 0x55cea7ac9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc2468640 1 -- 10.20.193.28:0/226885235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7a64290 msgr2=0x55cea7ace930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc2468640 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7a64290 0x55cea7ace930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc2468640 1 -- 10.20.193.28:0/226885235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea76d3870 con 0x55cea7aa1fe0 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6dc2468640 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aca530 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6db8014bf0 tx=0x7f6db8004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a49210965374db server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.981+0000 7f6d777fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6d777fe640 1 -- 10.20.193.28:0/226885235 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db801a070 con 0x55cea7aa1fe0 2026-02-20T03:19:13.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6d777fe640 1 -- 10.20.193.28:0/226885235 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6db80047d0 con 0x55cea7aa1fe0 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6d777fe640 1 -- 10.20.193.28:0/226885235 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db80215d0 con 0x55cea7aa1fe0 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/226885235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cea7994440 con 0x55cea7aa1fe0 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6d777fe640 1 -- 10.20.193.28:0/226885235 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6db8021770 con 0x55cea7aa1fe0 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 10 client.16431 _ll_register_callbacks cb 0x7f6db00047c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/226885235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cea79c5810 con 0x55cea7aa1fe0 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6d777fe640 1 -- 10.20.193.28:0/226885235 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6db8021970 con 0x55cea7aa1fe0 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 10 client.16431 fetch_fsmap learned FSMap version 27 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/226885235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55cea7abcdd0 con 0x55cea7aa1fe0 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6d777fe640 1 -- 10.20.193.28:0/226885235 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 27) ==== 8366+0+0 (secure 0 0 0) 0x7f6db8021b10 con 0x55cea7aa1fe0 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 10 client.16431 fetch_fsmap finished waiting for FSMap version 27 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 10 client.16431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:13.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 20 client.16431 populate_metadata read hostname 'trial028' 2026-02-20T03:19:13.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cea7aa6120 0x55cea7b4aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:13.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 4 client.16431 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:19:13.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.982+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/226885235 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cea79a6b00 con 0x55cea7aa6120 2026-02-20T03:19:13.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.983+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cea7aa6120 0x55cea7b4aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc1c67640 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cea7aa6120 0x55cea7b4aa40 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8542d83eb9fcd1cd server_cookie=391c6fa18f58a710 in_seq=0 out_seq=0 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6d777fe640 10 client.16431 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6d777fe640 1 -- 10.20.193.28:0/226885235 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55cea79a6b00 con 0x55cea7aa6120 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6d777fe640 10 client.16431 handle_command_reply: tid=0 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 client.16431 shutdown 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/226885235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 msgr2=0x55cea7aca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aca530 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6db8014bf0 tx=0x7f6db8004bb0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/226885235 shutdown_connections 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cea7aa6120 0x55cea7b4aa40 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cea7aa1fe0 0x55cea7aca530 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cea7aa1630 0x55cea7ac9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 --2- 10.20.193.28:0/226885235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cea7a64290 0x55cea7ace930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/226885235 >> 10.20.193.28:0/226885235 conn(0x55cea7ac4720 msgr2=0x55cea7ab2840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6d777fe640 0 client.16431 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:13.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/226885235 shutdown_connections 2026-02-20T03:19:13.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 1 -- 10.20.193.28:0/226885235 wait complete. 2026-02-20T03:19:13.992 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:19:13.992 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:19:13.992 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:19:13.992 INFO:teuthology.orchestra.run.trial028.stdout: "418b6710-366c-4655-98a2-c5ee576064d0": { 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "418b6710-366c-4655-98a2-c5ee576064d0", 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.984+0000 7f6dc63f7e00 20 client.16431 trim_cache size 0 max 16384 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d980b0e20 msgr2=0x7f6d980b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d980b0e20 0x7f6d980b32e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6db8007b00 tx=0x7f6db8009040 comp rx=0 tx=0).stop 2026-02-20T03:19:13.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc105750 msgr2=0x7f6dbc19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:13.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc105750 0x7f6dbc19d6d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6db000cab0 tx=0x7f6db000cf80 comp rx=0 tx=0).stop 2026-02-20T03:19:13.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/1710199243 shutdown_connections 2026-02-20T03:19:13.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d980b0e20 0x7f6d980b32e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6dbc109ed0 0x7f6dbc1a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6dbc105750 0x7f6dbc19d6d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 --2- 10.20.193.28:0/1710199243 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6dbc104da0 0x7f6dbc19d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:13.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/1710199243 >> 10.20.193.28:0/1710199243 conn(0x7f6dbc100840 msgr2=0x7f6dbc101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:13.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/1710199243 shutdown_connections 2026-02-20T03:19:13.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:13.985+0000 7f6dc3ef2640 1 -- 10.20.193.28:0/1710199243 wait complete. 2026-02-20T03:19:14.085 INFO:tasks.cephfs.filesystem:scrub status for tag:418b6710-366c-4655-98a2-c5ee576064d0 - {'path': '/', 'tag': '418b6710-366c-4655-98a2-c5ee576064d0', 'options': 'recursive,force'} 2026-02-20T03:19:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:14 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:19:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:14 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:14 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:19:14.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:14 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:14.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 8.68 MB/sec execute 47 sec latency 5341.459 ms 2026-02-20T03:19:14.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:14 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:19:14.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:14 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:14.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:14 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:19:14.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:14 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:14.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:14 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:19:14.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:14 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:14 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:19:14.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:14 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:15.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 8.50 MB/sec execute 48 sec latency 6341.503 ms 2026-02-20T03:19:15.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:15 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:19:15.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:15 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:15.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:15 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:19:15.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:15 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:15.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:15 trial126 ceph-mon[38476]: pgmap v318: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.2 MiB/s wr, 491 op/s 2026-02-20T03:19:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:15 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:19:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:15 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:15 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:19:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:15 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:15 trial028 ceph-mon[38552]: pgmap v318: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.2 MiB/s wr, 491 op/s 2026-02-20T03:19:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:15 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:19:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:15 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:15 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:19:15.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:15 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:15.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:15 trial177 ceph-mon[43181]: pgmap v318: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.2 MiB/s wr, 491 op/s 2026-02-20T03:19:16.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 8.33 MB/sec execute 49 sec latency 7341.535 ms 2026-02-20T03:19:17.502 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 8.16 MB/sec execute 50 sec latency 8341.569 ms 2026-02-20T03:19:17.503 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:17 trial028 ceph-mon[38552]: pgmap v319: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 1.6 MiB/s wr, 384 op/s 2026-02-20T03:19:17.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:17 trial126 ceph-mon[38476]: pgmap v319: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 1.6 MiB/s wr, 384 op/s 2026-02-20T03:19:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:17 trial177 ceph-mon[43181]: pgmap v319: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 1.6 MiB/s wr, 384 op/s 2026-02-20T03:19:18.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 8.00 MB/sec execute 51 sec latency 9341.611 ms 2026-02-20T03:19:19.348 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:19 trial028 ceph-mon[38552]: pgmap v320: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 1.3 MiB/s wr, 334 op/s 2026-02-20T03:19:19.348 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:19 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:19:19.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 7.85 MB/sec execute 52 sec latency 10341.653 ms 2026-02-20T03:19:19.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:19 trial126 ceph-mon[38476]: pgmap v320: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 1.3 MiB/s wr, 334 op/s 2026-02-20T03:19:19.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:19 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:19:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:19 trial177 ceph-mon[43181]: pgmap v320: 129 pgs: 129 active+clean; 76 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 1.3 MiB/s wr, 334 op/s 2026-02-20T03:19:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:19 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:19:20.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 7.70 MB/sec execute 53 sec latency 11341.689 ms 2026-02-20T03:19:21.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 7.56 MB/sec execute 54 sec latency 12341.729 ms 2026-02-20T03:19:21.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:21 trial126 ceph-mon[38476]: pgmap v321: 129 pgs: 129 active+clean; 78 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 255 op/s 2026-02-20T03:19:21.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:21 trial028 ceph-mon[38552]: pgmap v321: 129 pgs: 129 active+clean; 78 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 255 op/s 2026-02-20T03:19:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:21 trial177 ceph-mon[43181]: pgmap v321: 129 pgs: 129 active+clean; 78 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 255 op/s 2026-02-20T03:19:22.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.149+0000 7fc02bfff640 1 -- 10.20.193.28:0/2634936596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 msgr2=0x7fc02c104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:22.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.149+0000 7fc02bfff640 1 --2- 10.20.193.28:0/2634936596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 0x7fc02c104d40 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc020009a30 tx=0x7fc02002f220 comp rx=0 tx=0).stop 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.150+0000 7fc02bfff640 1 -- 10.20.193.28:0/2634936596 shutdown_connections 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.150+0000 7fc02bfff640 1 --2- 10.20.193.28:0/2634936596 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc02c1064f0 0x7fc02c10cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.150+0000 7fc02bfff640 1 --2- 10.20.193.28:0/2634936596 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc02c105b30 0x7fc02c105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.150+0000 7fc02bfff640 1 --2- 10.20.193.28:0/2634936596 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 0x7fc02c104d40 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.150+0000 7fc02bfff640 1 -- 10.20.193.28:0/2634936596 >> 10.20.193.28:0/2634936596 conn(0x7fc02c1000c0 msgr2=0x7fc02c1024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.150+0000 7fc02bfff640 1 -- 10.20.193.28:0/2634936596 shutdown_connections 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.150+0000 7fc02bfff640 1 -- 10.20.193.28:0/2634936596 wait complete. 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.150+0000 7fc02bfff640 1 Processor -- start 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.150+0000 7fc02bfff640 1 -- start start 2026-02-20T03:19:22.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 0x7fc02c19ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc02c105b30 0x7fc02c19cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc02c1064f0 0x7fc02c1a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c110430 con 0x7fc02c104940 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02bfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1102b0 con 0x7fc02c105b30 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02bfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1105b0 con 0x7fc02c1064f0 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 0x7fc02c19ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 0x7fc02c19ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48960/0 (socket says 10.20.193.28:48960) 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02affd640 1 -- 10.20.193.28:0/633135840 learned_addr learned my addr 10.20.193.28:0/633135840 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc02c105b30 0x7fc02c19cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02affd640 1 -- 10.20.193.28:0/633135840 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc02c1064f0 msgr2=0x7fc02c1a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02affd640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc02c1064f0 0x7fc02c1a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02affd640 1 -- 10.20.193.28:0/633135840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc02c105b30 msgr2=0x7fc02c19cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:22.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02affd640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc02c105b30 0x7fc02c19cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02affd640 1 -- 10.20.193.28:0/633135840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c1a4730 con 0x7fc02c104940 2026-02-20T03:19:22.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02affd640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 0x7fc02c19ca80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc020005bb0 tx=0x7fc02002fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:22.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc030a03640 1 -- 10.20.193.28:0/633135840 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020004240 con 0x7fc02c104940 2026-02-20T03:19:22.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc030a03640 1 -- 10.20.193.28:0/633135840 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc0200043e0 con 0x7fc02c104940 2026-02-20T03:19:22.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02bfff640 1 -- 10.20.193.28:0/633135840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c1a49c0 con 0x7fc02c104940 2026-02-20T03:19:22.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc030a03640 1 -- 10.20.193.28:0/633135840 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0200429e0 con 0x7fc02c104940 2026-02-20T03:19:22.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.151+0000 7fc02bfff640 1 -- 10.20.193.28:0/633135840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c1a4f00 con 0x7fc02c104940 2026-02-20T03:19:22.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.154+0000 7fc034867e00 1 Processor -- start 2026-02-20T03:19:22.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.154+0000 7fc030a03640 1 -- 10.20.193.28:0/633135840 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc02004a030 con 0x7fc02c104940 2026-02-20T03:19:22.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.154+0000 7fc034867e00 1 -- start start 2026-02-20T03:19:22.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.154+0000 7fc034867e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305d8f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.154+0000 7fc034867e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 0x55e305d93f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.154+0000 7fc034867e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305d969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.154+0000 7fc034867e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e305cdf8f0 con 0x55e305d94560 2026-02-20T03:19:22.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.154+0000 7fc034867e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e305c8d2e0 con 0x55e305d8ee80 2026-02-20T03:19:22.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.154+0000 7fc034867e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e305cdb820 con 0x55e305d8f7c0 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305d969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305d8f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 0x55e305d93f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305d969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48972/0 (socket says 10.20.193.28:48972) 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02a7fc640 1 -- 10.20.193.28:0/3561359345 learned_addr learned my addr 10.20.193.28:0/3561359345 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02a7fc640 1 -- 10.20.193.28:0/3561359345 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 msgr2=0x55e305d93f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/3561359345 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 0x55e305d93f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02a7fc640 1 -- 10.20.193.28:0/3561359345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 msgr2=0x55e305d8f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/3561359345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305d8f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02a7fc640 1 -- 10.20.193.28:0/3561359345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e305c7f5a0 con 0x55e305d94560 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02affd640 1 --2- 10.20.193.28:0/3561359345 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 0x55e305d93f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/3561359345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305d969f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc014003a90 tx=0x7fc014003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f34e4711664cf5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fbff77fe640 1 -- 10.20.193.28:0/3561359345 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014015070 con 0x55e305d94560 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.155+0000 7fbff77fe640 1 -- 10.20.193.28:0/3561359345 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc01400ec30 con 0x55e305d94560 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc034867e00 1 -- 10.20.193.28:0/3561359345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 msgr2=0x55e305d969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc034867e00 1 --2- 10.20.193.28:0/3561359345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305d969f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc014003a90 tx=0x7fc014003f60 comp rx=0 tx=0).stop 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc034867e00 1 -- 10.20.193.28:0/3561359345 shutdown_connections 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc034867e00 1 --2- 10.20.193.28:0/3561359345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305d969f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc034867e00 1 --2- 10.20.193.28:0/3561359345 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 0x55e305d93f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc034867e00 1 --2- 10.20.193.28:0/3561359345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305d8f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc034867e00 1 -- 10.20.193.28:0/3561359345 >> 10.20.193.28:0/3561359345 conn(0x55e305d866f0 msgr2=0x55e305d8d570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc030a03640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0000b0e20 0x7fc0000b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc034867e00 1 -- 10.20.193.28:0/3561359345 shutdown_connections 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc030a03640 1 -- 10.20.193.28:0/633135840 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc020104e70 con 0x7fc02c104940 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc034867e00 1 -- 10.20.193.28:0/3561359345 wait complete. 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc02b7fe640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0000b0e20 0x7fc0000b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.156+0000 7fc02b7fe640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0000b0e20 0x7fc0000b32e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009690 tx=0x7fc01c002ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.157+0000 7fc034867e00 1 -- start start 2026-02-20T03:19:22.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.157+0000 7fc034867e00 1 Processor -- start 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc034867e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305da7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc034867e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305da7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc034867e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305daee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc034867e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e305c870c0 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc034867e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e305d97660 con 0x55e305d8ee80 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc034867e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e305daf410 con 0x55e305d94560 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305da7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305da7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48988/0 (socket says 10.20.193.28:48988) 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02a7fc640 1 -- 10.20.193.28:0/1011591613 learned_addr learned my addr 10.20.193.28:0/1011591613 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02affd640 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305da7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02b7fe640 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305daee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02a7fc640 1 -- 10.20.193.28:0/1011591613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 msgr2=0x55e305daee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305daee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02a7fc640 1 -- 10.20.193.28:0/1011591613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 msgr2=0x55e305da7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305da7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02a7fc640 1 -- 10.20.193.28:0/1011591613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e305da10e0 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02b7fe640 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305daee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305da7fa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc014003800 tx=0x7fc014005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156075e80a3824a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fbff4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fbff4ff9640 1 -- 10.20.193.28:0/1011591613 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014015070 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc034867e00 1 -- 10.20.193.28:0/1011591613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e305c9b820 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc034867e00 10 client.16443 _ll_register_callbacks cb 0x55e305c8aff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fc034867e00 1 -- 10.20.193.28:0/1011591613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e305ce74e0 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fbff4ff9640 1 -- 10.20.193.28:0/1011591613 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc01400ede0 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.158+0000 7fbff4ff9640 1 -- 10.20.193.28:0/1011591613 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014002e20 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fbff4ff9640 1 -- 10.20.193.28:0/1011591613 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc014025470 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fbff4ff9640 1 -- 10.20.193.28:0/1011591613 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0140256f0 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fc034867e00 10 client.16443 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fc034867e00 1 -- 10.20.193.28:0/1011591613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e305ca0380 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fbff4ff9640 1 -- 10.20.193.28:0/1011591613 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fc01402d030 con 0x55e305d8f7c0 2026-02-20T03:19:22.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fc034867e00 10 client.16443 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fc034867e00 10 client.16443 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fc034867e00 20 client.16443 populate_metadata read hostname 'trial028' 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fc034867e00 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e305db33f0 0x55e305db57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fc034867e00 4 client.16443 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.159+0000 7fc034867e00 1 -- 10.20.193.28:0/1011591613 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e305c61bd0 con 0x55e305db33f0 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.160+0000 7fc02affd640 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e305db33f0 0x55e305db57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.160+0000 7fc02affd640 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e305db33f0 0x55e305db57e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3428952fd816ffd server_cookie=7ac5a41320192e51 in_seq=0 out_seq=0 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.160+0000 7fbff4ff9640 10 client.16443 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fbff4ff9640 1 -- 10.20.193.28:0/1011591613 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e305c61bd0 con 0x55e305db33f0 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fbff4ff9640 10 client.16443 handle_command_reply: tid=0 2026-02-20T03:19:22.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 client.16443 shutdown 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 -- 10.20.193.28:0/1011591613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 msgr2=0x55e305da7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305da7fa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc014003800 tx=0x7fc014005990 comp rx=0 tx=0).stop 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 -- 10.20.193.28:0/1011591613 shutdown_connections 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e305db33f0 0x55e305db57e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305daee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305da7fa0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 --2- 10.20.193.28:0/1011591613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305da7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 -- 10.20.193.28:0/1011591613 >> 10.20.193.28:0/1011591613 conn(0x55e305d866f0 msgr2=0x55e305d95870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fbff4ff9640 0 client.16443 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 -- 10.20.193.28:0/1011591613 shutdown_connections 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 1 -- 10.20.193.28:0/1011591613 wait complete. 2026-02-20T03:19:22.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.161+0000 7fc034867e00 20 client.16443 trim_cache size 0 max 16384 2026-02-20T03:19:22.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc034867e00 1 Processor -- start 2026-02-20T03:19:22.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc034867e00 1 -- start start 2026-02-20T03:19:22.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc034867e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305d95950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc034867e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305daee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc034867e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305d8fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc034867e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd0012780 con 0x55e305d8f7c0 2026-02-20T03:19:22.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc034867e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd0010020 con 0x55e305d8ee80 2026-02-20T03:19:22.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc034867e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd000de10 con 0x55e305d94560 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305daee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305d95950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305daee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48996/0 (socket says 10.20.193.28:48996) 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02a7fc640 1 -- 10.20.193.28:0/119876086 learned_addr learned my addr 10.20.193.28:0/119876086 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305d95950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:40166/0 (socket says 10.20.193.28:40166) 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02b7fe640 1 --2- 10.20.193.28:0/119876086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305d8fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02a7fc640 1 -- 10.20.193.28:0/119876086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 msgr2=0x55e305d8fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/119876086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305d8fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02a7fc640 1 -- 10.20.193.28:0/119876086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 msgr2=0x55e305d95950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/119876086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305d95950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02a7fc640 1 -- 10.20.193.28:0/119876086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e305da0f10 con 0x55e305d8f7c0 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02b7fe640 1 --2- 10.20.193.28:0/119876086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305d8fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.169+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/119876086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305daee40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc014003a90 tx=0x7fc014029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde55977611766bb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:22.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fbff6ffd640 1 -- 10.20.193.28:0/119876086 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014015030 con 0x55e305d8f7c0 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fbff6ffd640 1 -- 10.20.193.28:0/119876086 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc014033020 con 0x55e305d8f7c0 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fbff6ffd640 1 -- 10.20.193.28:0/119876086 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014025890 con 0x55e305d8f7c0 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 -- 10.20.193.28:0/119876086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 msgr2=0x55e305daee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 --2- 10.20.193.28:0/119876086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305daee40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc014003a90 tx=0x7fc014029000 comp rx=0 tx=0).stop 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 -- 10.20.193.28:0/119876086 shutdown_connections 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 --2- 10.20.193.28:0/119876086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d94560 0x55e305d8fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 --2- 10.20.193.28:0/119876086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d8f7c0 0x55e305daee40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 --2- 10.20.193.28:0/119876086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305d95950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 -- 10.20.193.28:0/119876086 >> 10.20.193.28:0/119876086 conn(0x55e305d866f0 msgr2=0x55e305da4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 -- 10.20.193.28:0/119876086 shutdown_connections 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 -- 10.20.193.28:0/119876086 wait complete. 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.170+0000 7fc034867e00 1 -- start start 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc034867e00 1 Processor -- start 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc034867e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305daafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc034867e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 0x55e305dab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc034867e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305dadfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc034867e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd000e4e0 con 0x55e305d94560 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc034867e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd000f950 con 0x55e305d8ee80 2026-02-20T03:19:22.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc034867e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd000ebb0 con 0x55e305d8f7c0 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc02affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305daafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc02affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305daafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:40176/0 (socket says 10.20.193.28:40176) 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc02affd640 1 -- 10.20.193.28:0/3785241277 learned_addr learned my addr 10.20.193.28:0/3785241277 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 0x55e305dab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc02b7fe640 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305dadfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc02affd640 1 -- 10.20.193.28:0/3785241277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 msgr2=0x55e305dab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc02affd640 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 0x55e305dab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.171+0000 7fc02affd640 1 -- 10.20.193.28:0/3785241277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 msgr2=0x55e305dadfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fc02affd640 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305dadfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fc02affd640 1 -- 10.20.193.28:0/3785241277 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e305a3f690 con 0x55e305d8ee80 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fc02b7fe640 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305dadfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fc02affd640 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305daafb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc0200ccae0 tx=0x7fc02002f220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7af8297508f4a133 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fbff4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:19:22.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fbff4ff9640 1 -- 10.20.193.28:0/3785241277 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020004590 con 0x55e305d8ee80 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fc034867e00 1 -- 10.20.193.28:0/3785241277 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e305ca4b70 con 0x55e305d8ee80 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fc034867e00 10 client.26165 _ll_register_callbacks cb 0x7fc014003490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fc034867e00 1 -- 10.20.193.28:0/3785241277 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc01400ec30 con 0x55e305d8ee80 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fbff4ff9640 1 -- 10.20.193.28:0/3785241277 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc020033040 con 0x55e305d8ee80 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fbff4ff9640 1 -- 10.20.193.28:0/3785241277 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020042b80 con 0x55e305d8ee80 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fbff4ff9640 1 -- 10.20.193.28:0/3785241277 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc0200f31b0 con 0x55e305d8ee80 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fbff4ff9640 1 -- 10.20.193.28:0/3785241277 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc020042d20 con 0x55e305d8ee80 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fc034867e00 10 client.26165 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.172+0000 7fc034867e00 1 -- 10.20.193.28:0/3785241277 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55e305da1c00 con 0x55e305d8ee80 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fbff4ff9640 1 -- 10.20.193.28:0/3785241277 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fc0200cbb60 con 0x55e305d8ee80 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fc034867e00 10 client.26165 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fc034867e00 10 client.26165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fc034867e00 20 client.26165 populate_metadata read hostname 'trial028' 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fc034867e00 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e305e1ec30 0x55e305e210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fc034867e00 4 client.26165 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:19:22.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fc034867e00 1 -- 10.20.193.28:0/3785241277 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e305ab8520 con 0x55e305e1ec30 2026-02-20T03:19:22.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e305e1ec30 0x55e305e210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:22.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fc02a7fc640 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e305e1ec30 0x55e305e210a0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1f5c13a12ed3c16 server_cookie=a247bbff1df2885c in_seq=0 out_seq=0 2026-02-20T03:19:22.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.173+0000 7fbff4ff9640 10 client.26165 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:22.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fbff4ff9640 1 -- 10.20.193.28:0/3785241277 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e305ab8520 con 0x55e305e1ec30 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fbff4ff9640 10 client.26165 handle_command_reply: tid=0 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 client.26165 shutdown 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 -- 10.20.193.28:0/3785241277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 msgr2=0x55e305daafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305daafb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc0200ccae0 tx=0x7fc02002f220 comp rx=0 tx=0).stop 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 -- 10.20.193.28:0/3785241277 shutdown_connections 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e305e1ec30 0x55e305e210a0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e305d94560 0x55e305dadfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e305d8f7c0 0x55e305dab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 --2- 10.20.193.28:0/3785241277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e305d8ee80 0x55e305daafb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fbff4ff9640 0 client.26165 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 -- 10.20.193.28:0/3785241277 >> 10.20.193.28:0/3785241277 conn(0x55e305d866f0 msgr2=0x55e305da4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 -- 10.20.193.28:0/3785241277 shutdown_connections 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 1 -- 10.20.193.28:0/3785241277 wait complete. 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.190+0000 7fc034867e00 20 client.26165 trim_cache size 0 max 16384 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:19:22.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 -- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0000b0e20 msgr2=0x7fc0000b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0000b0e20 0x7fc0000b32e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009690 tx=0x7fc01c002ba0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 -- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 msgr2=0x7fc02c19ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 0x7fc02c19ca80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc020005bb0 tx=0x7fc02002fcb0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 -- 10.20.193.28:0/633135840 shutdown_connections 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0000b0e20 0x7fc0000b32e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc02c1064f0 0x7fc02c1a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc02c105b30 0x7fc02c19cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 --2- 10.20.193.28:0/633135840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc02c104940 0x7fc02c19ca80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 -- 10.20.193.28:0/633135840 >> 10.20.193.28:0/633135840 conn(0x7fc02c1000c0 msgr2=0x7fc02c108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 -- 10.20.193.28:0/633135840 shutdown_connections 2026-02-20T03:19:22.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:22.191+0000 7fc02bfff640 1 -- 10.20.193.28:0/633135840 wait complete. 2026-02-20T03:19:22.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 7.42 MB/sec execute 55 sec latency 13341.778 ms 2026-02-20T03:19:23.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 7.29 MB/sec execute 56 sec latency 14341.826 ms 2026-02-20T03:19:23.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:23 trial126 ceph-mon[38476]: pgmap v322: 129 pgs: 129 active+clean; 79 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 630 KiB/s rd, 796 KiB/s wr, 174 op/s 2026-02-20T03:19:23.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:19:23.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:19:23.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:19:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:23 trial028 ceph-mon[38552]: pgmap v322: 129 pgs: 129 active+clean; 79 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 630 KiB/s rd, 796 KiB/s wr, 174 op/s 2026-02-20T03:19:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:19:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:19:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:19:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:23 trial177 ceph-mon[43181]: pgmap v322: 129 pgs: 129 active+clean; 79 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 630 KiB/s rd, 796 KiB/s wr, 174 op/s 2026-02-20T03:19:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:19:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:19:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:19:24.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 7.16 MB/sec execute 57 sec latency 15341.874 ms 2026-02-20T03:19:25.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 7.03 MB/sec execute 58 sec latency 16341.914 ms 2026-02-20T03:19:25.519 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:25 trial028 ceph-mon[38552]: pgmap v323: 129 pgs: 129 active+clean; 79 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 210 KiB/s rd, 487 KiB/s wr, 95 op/s 2026-02-20T03:19:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:25 trial126 ceph-mon[38476]: pgmap v323: 129 pgs: 129 active+clean; 79 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 210 KiB/s rd, 487 KiB/s wr, 95 op/s 2026-02-20T03:19:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:25 trial177 ceph-mon[43181]: pgmap v323: 129 pgs: 129 active+clean; 79 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 210 KiB/s rd, 487 KiB/s wr, 95 op/s 2026-02-20T03:19:26.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.91 MB/sec execute 59 sec latency 17341.951 ms 2026-02-20T03:19:27.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.80 MB/sec execute 60 sec latency 18341.995 ms 2026-02-20T03:19:27.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:27 trial126 ceph-mon[38476]: pgmap v324: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 850 KiB/s wr, 53 op/s 2026-02-20T03:19:27.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:27 trial028 ceph-mon[38552]: pgmap v324: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 850 KiB/s wr, 53 op/s 2026-02-20T03:19:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:27 trial177 ceph-mon[43181]: pgmap v324: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 23 KiB/s rd, 850 KiB/s wr, 53 op/s 2026-02-20T03:19:28.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.69 MB/sec execute 61 sec latency 19342.045 ms 2026-02-20T03:19:29.313 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:29 trial028 ceph-mon[38552]: pgmap v325: 129 pgs: 129 active+clean; 84 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 37 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2026-02-20T03:19:29.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.58 MB/sec execute 62 sec latency 20342.097 ms 2026-02-20T03:19:29.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:29 trial126 ceph-mon[38476]: pgmap v325: 129 pgs: 129 active+clean; 84 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 37 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2026-02-20T03:19:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:29 trial177 ceph-mon[43181]: pgmap v325: 129 pgs: 129 active+clean; 84 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 37 KiB/s rd, 1.1 MiB/s wr, 59 op/s 2026-02-20T03:19:30.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.48 MB/sec execute 63 sec latency 21342.135 ms 2026-02-20T03:19:31.492 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:31 trial028 ceph-mon[38552]: pgmap v326: 129 pgs: 129 active+clean; 86 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 79 op/s 2026-02-20T03:19:31.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.37 MB/sec execute 64 sec latency 22342.167 ms 2026-02-20T03:19:31.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:31 trial126 ceph-mon[38476]: pgmap v326: 129 pgs: 129 active+clean; 86 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 79 op/s 2026-02-20T03:19:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:31 trial177 ceph-mon[43181]: pgmap v326: 129 pgs: 129 active+clean; 86 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 79 op/s 2026-02-20T03:19:32.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.28 MB/sec execute 65 sec latency 23342.207 ms 2026-02-20T03:19:33.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.18 MB/sec execute 66 sec latency 24342.249 ms 2026-02-20T03:19:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:33 trial126 ceph-mon[38476]: pgmap v327: 129 pgs: 129 active+clean; 84 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 95 op/s 2026-02-20T03:19:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:33 trial028 ceph-mon[38552]: pgmap v327: 129 pgs: 129 active+clean; 84 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 95 op/s 2026-02-20T03:19:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:33 trial177 ceph-mon[43181]: pgmap v327: 129 pgs: 129 active+clean; 84 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 38 KiB/s rd, 2.0 MiB/s wr, 95 op/s 2026-02-20T03:19:34.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.09 MB/sec execute 67 sec latency 25342.286 ms 2026-02-20T03:19:35.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- 10.20.193.28:0/3382620182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd664105b20 msgr2=0x7fd664105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:35.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 --2- 10.20.193.28:0/3382620182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd664105b20 0x7fd664105fa0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd654009a30 tx=0x7fd65402f260 comp rx=0 tx=0).stop 2026-02-20T03:19:35.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- 10.20.193.28:0/3382620182 shutdown_connections 2026-02-20T03:19:35.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 --2- 10.20.193.28:0/3382620182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd6641064e0 0x7fd66410cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 --2- 10.20.193.28:0/3382620182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd664105b20 0x7fd664105fa0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 --2- 10.20.193.28:0/3382620182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd664104930 0x7fd664104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- 10.20.193.28:0/3382620182 >> 10.20.193.28:0/3382620182 conn(0x7fd6641000d0 msgr2=0x7fd6641024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:35.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- 10.20.193.28:0/3382620182 shutdown_connections 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- 10.20.193.28:0/3382620182 wait complete. 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 Processor -- start 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- start start 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd664104930 0x7fd66419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd664105b20 0x7fd66419d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6641064e0 0x7fd6641a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd6641104f0 con 0x7fd6641064e0 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd664110370 con 0x7fd664104930 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd664110670 con 0x7fd664105b20 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd663fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6641064e0 0x7fd6641a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:35.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd663fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6641064e0 0x7fd6641a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46184/0 (socket says 10.20.193.28:46184) 2026-02-20T03:19:35.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd663fff640 1 -- 10.20.193.28:0/1991745374 learned_addr learned my addr 10.20.193.28:0/1991745374 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:35.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd663fff640 1 -- 10.20.193.28:0/1991745374 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd664105b20 msgr2=0x7fd66419d020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:35.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd663fff640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd664105b20 0x7fd66419d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd663fff640 1 -- 10.20.193.28:0/1991745374 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd664104930 msgr2=0x7fd66419cae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd663fff640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd664104930 0x7fd66419cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd663fff640 1 -- 10.20.193.28:0/1991745374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6641a4790 con 0x7fd6641064e0 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd663fff640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6641064e0 0x7fd6641a4090 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd65800b990 tx=0x7fd65800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd660ff9640 1 -- 10.20.193.28:0/1991745374 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658006e60 con 0x7fd6641064e0 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd660ff9640 1 -- 10.20.193.28:0/1991745374 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd658010070 con 0x7fd6641064e0 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd660ff9640 1 -- 10.20.193.28:0/1991745374 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658004800 con 0x7fd6641064e0 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- 10.20.193.28:0/1991745374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6641a4a80 con 0x7fd6641064e0 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.265+0000 7fd6688e9640 1 -- 10.20.193.28:0/1991745374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6641a4fd0 con 0x7fd6641064e0 2026-02-20T03:19:35.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd660ff9640 1 -- 10.20.193.28:0/1991745374 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd65801d070 con 0x7fd6641064e0 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd66c9cee00 1 Processor -- start 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd66c9cee00 1 -- start start 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489ade80 0x55fd489ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ae7c0 0x55fd489b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489b3560 0x55fd489b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd488fe8f0 con 0x55fd489b3560 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fd488ac2e0 con 0x55fd489ade80 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd488fa820 con 0x55fd489ae7c0 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd662ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489b3560 0x55fd489b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd662ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489b3560 0x55fd489b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46198/0 (socket says 10.20.193.28:46198) 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.271+0000 7fd662ffd640 1 -- 10.20.193.28:0/3613981625 learned_addr learned my addr 10.20.193.28:0/3613981625 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:35.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd662ffd640 1 -- 10.20.193.28:0/3613981625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ae7c0 msgr2=0x55fd489b2f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd662ffd640 1 --2- 10.20.193.28:0/3613981625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ae7c0 0x55fd489b2f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd662ffd640 1 -- 10.20.193.28:0/3613981625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489ade80 msgr2=0x55fd489ae280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd662ffd640 1 --2- 10.20.193.28:0/3613981625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489ade80 0x55fd489ae280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd662ffd640 1 -- 10.20.193.28:0/3613981625 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4889e5a0 con 0x55fd489b3560 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd662ffd640 1 --2- 10.20.193.28:0/3613981625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489b3560 0x55fd489b59f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd654009950 tx=0x7fd654005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8add5759e7b0a800 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd660ff9640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd63c0b0e20 0x7fd63c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62f7fe640 1 -- 10.20.193.28:0/3613981625 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654038470 con 0x55fd489b3560 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62f7fe640 1 -- 10.20.193.28:0/3613981625 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd654033040 con 0x55fd489b3560 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62f7fe640 1 -- 10.20.193.28:0/3613981625 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654038790 con 0x55fd489b3560 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd660ff9640 1 -- 10.20.193.28:0/1991745374 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd6580e04b0 con 0x7fd6641064e0 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3613981625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489b3560 msgr2=0x55fd489b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:35.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3613981625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489b3560 0x55fd489b59f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd654009950 tx=0x7fd654005880 comp rx=0 tx=0).stop 2026-02-20T03:19:35.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd63c0b0e20 0x7fd63c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:35.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3613981625 shutdown_connections 2026-02-20T03:19:35.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3613981625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489b3560 0x55fd489b59f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3613981625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ae7c0 0x55fd489b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3613981625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489ade80 0x55fd489ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3613981625 >> 10.20.193.28:0/3613981625 conn(0x55fd489a56f0 msgr2=0x55fd489ac570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:35.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3613981625 shutdown_connections 2026-02-20T03:19:35.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3613981625 wait complete. 2026-02-20T03:19:35.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd63c0b0e20 0x7fd63c0b32e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55fd489aeeb0 tx=0x7fd650006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:35.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- start start 2026-02-20T03:19:35.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 Processor -- start 2026-02-20T03:19:35.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ade80 0x55fd489cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489ae7c0 0x55fd489cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489b3560 0x55fd489d6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd488a60c0 con 0x55fd489ade80 2026-02-20T03:19:35.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fd489b65b0 con 0x55fd489ae7c0 2026-02-20T03:19:35.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd489d6e10 con 0x55fd489b3560 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ade80 0x55fd489cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ade80 0x55fd489cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46210/0 (socket says 10.20.193.28:46210) 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 -- 10.20.193.28:0/3407155125 learned_addr learned my addr 10.20.193.28:0/3407155125 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 -- 10.20.193.28:0/3407155125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489b3560 msgr2=0x55fd489d6880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489b3560 0x55fd489d6880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 -- 10.20.193.28:0/3407155125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489ae7c0 msgr2=0x55fd489cf900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489ae7c0 0x55fd489cf900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 -- 10.20.193.28:0/3407155125 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd489c8b30 con 0x55fd489ade80 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd6637fe640 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ade80 0x55fd489cf3c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd650004690 tx=0x7fd6500047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e3e110700ad860 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62cff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62cff9640 1 -- 10.20.193.28:0/3407155125 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65000b730 con 0x55fd489ade80 2026-02-20T03:19:35.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62cff9640 1 -- 10.20.193.28:0/3407155125 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd65000bd70 con 0x55fd489ade80 2026-02-20T03:19:35.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62cff9640 1 -- 10.20.193.28:0/3407155125 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650020e50 con 0x55fd489ade80 2026-02-20T03:19:35.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3407155125 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd488ba820 con 0x55fd489ade80 2026-02-20T03:19:35.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 10 client.16461 _ll_register_callbacks cb 0x55fd488a9ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:35.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3407155125 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd489064e0 con 0x55fd489ade80 2026-02-20T03:19:35.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62cff9640 1 -- 10.20.193.28:0/3407155125 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd650011420 con 0x55fd489ade80 2026-02-20T03:19:35.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62cff9640 1 -- 10.20.193.28:0/3407155125 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd6500116e0 con 0x55fd489ade80 2026-02-20T03:19:35.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 10 client.16461 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:35.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3407155125 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55fd488bf380 con 0x55fd489ade80 2026-02-20T03:19:35.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd62cff9640 1 -- 10.20.193.28:0/3407155125 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fd650028030 con 0x55fd489ade80 2026-02-20T03:19:35.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 10 client.16461 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:35.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 10 client.16461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:35.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 20 client.16461 populate_metadata read hostname 'trial028' 2026-02-20T03:19:35.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd489db290 0x55fd489dd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 4 client.16461 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:35.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.274+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3407155125 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd48880bd0 con 0x55fd489db290 2026-02-20T03:19:35.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.300+0000 7fd662ffd640 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd489db290 0x55fd489dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.355+0000 7fd662ffd640 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd489db290 0x55fd489dd750 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5915a5bd54134341 server_cookie=8edbc28140109a5e in_seq=0 out_seq=0 2026-02-20T03:19:35.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.355+0000 7fd62cff9640 10 client.16461 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:35.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd62cff9640 1 -- 10.20.193.28:0/3407155125 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fd48880bd0 con 0x55fd489db290 2026-02-20T03:19:35.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd62cff9640 10 client.16461 handle_command_reply: tid=0 2026-02-20T03:19:35.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 client.16461 shutdown 2026-02-20T03:19:35.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3407155125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ade80 msgr2=0x55fd489cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:35.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ade80 0x55fd489cf3c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd650004690 tx=0x7fd6500047e0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3407155125 shutdown_connections 2026-02-20T03:19:35.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd489db290 0x55fd489dd750 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489b3560 0x55fd489d6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489ae7c0 0x55fd489cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/3407155125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ade80 0x55fd489cf3c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3407155125 >> 10.20.193.28:0/3407155125 conn(0x55fd489a56f0 msgr2=0x55fd489b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:35.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd62cff9640 0 client.16461 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:35.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3407155125 shutdown_connections 2026-02-20T03:19:35.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 1 -- 10.20.193.28:0/3407155125 wait complete. 2026-02-20T03:19:35.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.368+0000 7fd66c9cee00 20 client.16461 trim_cache size 0 max 16384 2026-02-20T03:19:35.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 Processor -- start 2026-02-20T03:19:35.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 -- start start 2026-02-20T03:19:35.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ade80 0x55fd489cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489b3560 0x55fd489ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd6080126d0 con 0x55fd489ae7c0 2026-02-20T03:19:35.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd60800ff70 con 0x55fd489b3560 2026-02-20T03:19:35.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd60800ddc0 con 0x55fd489ade80 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd662ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd662ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46226/0 (socket says 10.20.193.28:46226) 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd662ffd640 1 -- 10.20.193.28:0/2402660966 learned_addr learned my addr 10.20.193.28:0/2402660966 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd662ffd640 1 -- 10.20.193.28:0/2402660966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ade80 msgr2=0x55fd489cea80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd662ffd640 1 --2- 10.20.193.28:0/2402660966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ade80 0x55fd489cea80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd662ffd640 1 -- 10.20.193.28:0/2402660966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489b3560 msgr2=0x55fd489ccc10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd662ffd640 1 --2- 10.20.193.28:0/2402660966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489b3560 0x55fd489ccc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd662ffd640 1 -- 10.20.193.28:0/2402660966 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd489c8960 con 0x55fd489ae7c0 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd662ffd640 1 --2- 10.20.193.28:0/2402660966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d6840 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd654005ec0 tx=0x7fd654005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc15a285706f1fcd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd62effd640 1 -- 10.20.193.28:0/2402660966 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654058070 con 0x55fd489ae7c0 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd62effd640 1 -- 10.20.193.28:0/2402660966 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd6540384f0 con 0x55fd489ae7c0 2026-02-20T03:19:35.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd62effd640 1 -- 10.20.193.28:0/2402660966 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6540044e0 con 0x55fd489ae7c0 2026-02-20T03:19:35.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 -- 10.20.193.28:0/2402660966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 msgr2=0x55fd489d6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:35.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/2402660966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d6840 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd654005ec0 tx=0x7fd654005e50 comp rx=0 tx=0).stop 2026-02-20T03:19:35.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 -- 10.20.193.28:0/2402660966 shutdown_connections 2026-02-20T03:19:35.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/2402660966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489b3560 0x55fd489ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/2402660966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d6840 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/2402660966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ade80 0x55fd489cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 -- 10.20.193.28:0/2402660966 >> 10.20.193.28:0/2402660966 conn(0x55fd489a56f0 msgr2=0x55fd489ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:35.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 -- 10.20.193.28:0/2402660966 shutdown_connections 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.374+0000 7fd66c9cee00 1 -- 10.20.193.28:0/2402660966 wait complete. 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 -- start start 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 Processor -- start 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ade80 0x55fd489d6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489b3560 0x55fd489d3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd60800e430 con 0x55fd489ae7c0 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd60800f8a0 con 0x55fd489b3560 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd60800eb00 con 0x55fd489ade80 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd662ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:35.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd662ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46228/0 (socket says 10.20.193.28:46228) 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd662ffd640 1 -- 10.20.193.28:0/490355058 learned_addr learned my addr 10.20.193.28:0/490355058 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd662ffd640 1 -- 10.20.193.28:0/490355058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ade80 msgr2=0x55fd489d6480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd662ffd640 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ade80 0x55fd489d6480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd662ffd640 1 -- 10.20.193.28:0/490355058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489b3560 msgr2=0x55fd489d3520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd662ffd640 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489b3560 0x55fd489d3520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd662ffd640 1 -- 10.20.193.28:0/490355058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4865e690 con 0x55fd489ae7c0 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd662ffd640 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d2fe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd6540058c0 tx=0x7fd6540045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c596087ae411fe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd62cff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd62cff9640 1 -- 10.20.193.28:0/490355058 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654058070 con 0x55fd489ae7c0 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd62cff9640 1 -- 10.20.193.28:0/490355058 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd654038790 con 0x55fd489ae7c0 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd62cff9640 1 -- 10.20.193.28:0/490355058 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6540537b0 con 0x55fd489ae7c0 2026-02-20T03:19:35.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 -- 10.20.193.28:0/490355058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd488c3b70 con 0x55fd489ae7c0 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd62cff9640 1 -- 10.20.193.28:0/490355058 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd654053950 con 0x55fd489ae7c0 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 10 client.16467 _ll_register_callbacks cb 0x7fd650004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 -- 10.20.193.28:0/490355058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd654033040 con 0x55fd489ae7c0 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd62cff9640 1 -- 10.20.193.28:0/490355058 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd654062060 con 0x55fd489ae7c0 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 10 client.16467 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 -- 10.20.193.28:0/490355058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55fd489c9650 con 0x55fd489ae7c0 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd62cff9640 1 -- 10.20.193.28:0/490355058 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fd654053b50 con 0x55fd489ae7c0 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 10 client.16467 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 20 client.16467 populate_metadata read hostname 'trial028' 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd48a47050 0x55fd48a494e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:35.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 4 client.16467 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:19:35.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.379+0000 7fd66c9cee00 1 -- 10.20.193.28:0/490355058 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fd488cf6b0 con 0x55fd48a47050 2026-02-20T03:19:35.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.395+0000 7fd6637fe640 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd48a47050 0x55fd48a494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:35.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.448+0000 7fd6637fe640 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd48a47050 0x55fd48a494e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=278601cfffaaa1f7 server_cookie=1d1e3b0ee2f61edb in_seq=0 out_seq=0 2026-02-20T03:19:35.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.448+0000 7fd62cff9640 10 client.16467 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:35.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 6.00 MB/sec execute 68 sec latency 26342.326 ms 2026-02-20T03:19:35.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd62cff9640 1 -- 10.20.193.28:0/490355058 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fd488cf6b0 con 0x55fd48a47050 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd62cff9640 10 client.16467 handle_command_reply: tid=0 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 client.16467 shutdown 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 -- 10.20.193.28:0/490355058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 msgr2=0x55fd489d2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d2fe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd6540058c0 tx=0x7fd6540045e0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 -- 10.20.193.28:0/490355058 shutdown_connections 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd48a47050 0x55fd48a494e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd489b3560 0x55fd489d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd489ae7c0 0x55fd489d2fe0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 --2- 10.20.193.28:0/490355058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd489ade80 0x55fd489d6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 -- 10.20.193.28:0/490355058 >> 10.20.193.28:0/490355058 conn(0x55fd489a56f0 msgr2=0x55fd489cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd62cff9640 0 client.16467 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 -- 10.20.193.28:0/490355058 shutdown_connections 2026-02-20T03:19:35.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 1 -- 10.20.193.28:0/490355058 wait complete. 2026-02-20T03:19:35.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd66c9cee00 20 client.16467 trim_cache size 0 max 16384 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 -- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd63c0b0e20 msgr2=0x7fd63c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd63c0b0e20 0x7fd63c0b32e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55fd489aeeb0 tx=0x7fd650006cd0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 -- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6641064e0 msgr2=0x7fd6641a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6641064e0 0x7fd6641a4090 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd65800b990 tx=0x7fd65800be60 comp rx=0 tx=0).stop 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 -- 10.20.193.28:0/1991745374 shutdown_connections 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd63c0b0e20 0x7fd63c0b32e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6641064e0 0x7fd6641a4090 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd664105b20 0x7fd66419d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 --2- 10.20.193.28:0/1991745374 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd664104930 0x7fd66419cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 -- 10.20.193.28:0/1991745374 >> 10.20.193.28:0/1991745374 conn(0x7fd6641000d0 msgr2=0x7fd664108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:35.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 -- 10.20.193.28:0/1991745374 shutdown_connections 2026-02-20T03:19:35.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:35.504+0000 7fd6688e9640 1 -- 10.20.193.28:0/1991745374 wait complete. 2026-02-20T03:19:35.520 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:35 trial028 ceph-mon[38552]: pgmap v328: 129 pgs: 129 active+clean; 84 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 83 KiB/s rd, 2.2 MiB/s wr, 110 op/s 2026-02-20T03:19:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:35 trial126 ceph-mon[38476]: pgmap v328: 129 pgs: 129 active+clean; 84 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 83 KiB/s rd, 2.2 MiB/s wr, 110 op/s 2026-02-20T03:19:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:35 trial177 ceph-mon[43181]: pgmap v328: 129 pgs: 129 active+clean; 84 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 83 KiB/s rd, 2.2 MiB/s wr, 110 op/s 2026-02-20T03:19:36.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 5.91 MB/sec execute 69 sec latency 27342.370 ms 2026-02-20T03:19:36.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:19:36.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:19:36.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:19:36.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:36 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:19:36.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:19:36.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:19:36.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:19:36.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:36 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:19:36.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:19:36.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:19:36.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:19:36.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:36 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:19:37.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:37 trial028 ceph-mon[38552]: pgmap v329: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 82 KiB/s rd, 2.8 MiB/s wr, 125 op/s 2026-02-20T03:19:37.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 5.83 MB/sec execute 70 sec latency 28342.412 ms 2026-02-20T03:19:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:37 trial126 ceph-mon[38476]: pgmap v329: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 82 KiB/s rd, 2.8 MiB/s wr, 125 op/s 2026-02-20T03:19:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:37 trial177 ceph-mon[43181]: pgmap v329: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 82 KiB/s rd, 2.8 MiB/s wr, 125 op/s 2026-02-20T03:19:37.864 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:19:38.155 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:38.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1763187245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109220 msgr2=0x7fa3bc109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:38.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1763187245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109220 0x7fa3bc109660 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009a30 tx=0x7fa3a802f260 comp rx=0 tx=0).stop 2026-02-20T03:19:38.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1763187245 shutdown_connections 2026-02-20T03:19:38.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1763187245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa3bc109ba0 0x7fa3bc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1763187245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109220 0x7fa3bc109660 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1763187245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa3bc10eef0 0x7fa3bc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1763187245 >> 10.20.193.28:0/1763187245 conn(0x7fa3bc078600 msgr2=0x7fa3bc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:38.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1763187245 shutdown_connections 2026-02-20T03:19:38.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1763187245 wait complete. 2026-02-20T03:19:38.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 Processor -- start 2026-02-20T03:19:38.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- start start 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa3bc109220 0x7fa3bc1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109ba0 0x7fa3bc1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa3bc10eef0 0x7fa3bc1a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc1191b0 con 0x7fa3bc109ba0 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc119030 con 0x7fa3bc10eef0 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc119330 con 0x7fa3bc109220 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c1dd4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109ba0 0x7fa3bc1a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c1dd4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109ba0 0x7fa3bc1a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45472/0 (socket says 10.20.193.28:45472) 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c1dd4640 1 -- 10.20.193.28:0/1273012559 learned_addr learned my addr 10.20.193.28:0/1273012559 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c1dd4640 1 -- 10.20.193.28:0/1273012559 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa3bc109220 msgr2=0x7fa3bc1a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c1dd4640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa3bc109220 0x7fa3bc1a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c1dd4640 1 -- 10.20.193.28:0/1273012559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa3bc10eef0 msgr2=0x7fa3bc1a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:38.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c1dd4640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa3bc10eef0 0x7fa3bc1a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c1dd4640 1 -- 10.20.193.28:0/1273012559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc1a66c0 con 0x7fa3bc109ba0 2026-02-20T03:19:38.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c1dd4640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109ba0 0x7fa3bc1a1bb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8002fa0 tx=0x7fa3a8002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:38.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3a77fe640 1 -- 10.20.193.28:0/1273012559 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8004280 con 0x7fa3bc109ba0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3a77fe640 1 -- 10.20.193.28:0/1273012559 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa3a8004420 con 0x7fa3bc109ba0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3a77fe640 1 -- 10.20.193.28:0/1273012559 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8038d20 con 0x7fa3bc109ba0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3bc1a6950 con 0x7fa3bc109ba0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3bc1ae1f0 con 0x7fa3bc109ba0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.397+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3bc10a580 con 0x7fa3bc109ba0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.402+0000 7fa3a77fe640 1 -- 10.20.193.28:0/1273012559 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa3a804b080 con 0x7fa3bc109ba0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.402+0000 7fa3a77fe640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa3980b0ea0 0x7fa3980b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.402+0000 7fa3a77fe640 1 -- 10.20.193.28:0/1273012559 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa3a8104e10 con 0x7fa3bc109ba0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.402+0000 7fa3c25d5640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa3980b0ea0 0x7fa3980b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.402+0000 7fa3c25d5640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa3980b0ea0 0x7fa3980b3360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009770 tx=0x7fa3b4006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:38.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.402+0000 7fa3a77fe640 1 -- 10.20.193.28:0/1273012559 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa3a80cd1f0 con 0x7fa3bc109ba0 2026-02-20T03:19:38.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 5.75 MB/sec execute 71 sec latency 29342.445 ms 2026-02-20T03:19:38.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.513+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3bc109660 con 0x7fa3bc109ba0 2026-02-20T03:19:38.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.515+0000 7fa3a77fe640 1 -- 10.20.193.28:0/1273012559 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11922 (secure 0 0 0) 0x7fa3bc109660 con 0x7fa3bc109ba0 2026-02-20T03:19:38.518 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:19:38.518 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T03:19:18:240749+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:19:17.378192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:19:38.518 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T03:19:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa3980b0ea0 msgr2=0x7fa3980b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa3980b0ea0 0x7fa3980b3360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009770 tx=0x7fa3b4006cd0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109ba0 msgr2=0x7fa3bc1a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109ba0 0x7fa3bc1a1bb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8002fa0 tx=0x7fa3a8002910 comp rx=0 tx=0).stop 2026-02-20T03:19:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 shutdown_connections 2026-02-20T03:19:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa3980b0ea0 0x7fa3980b3360 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa3bc10eef0 0x7fa3bc1a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa3bc109ba0 0x7fa3bc1a1bb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 --2- 10.20.193.28:0/1273012559 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa3bc109220 0x7fa3bc1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 >> 10.20.193.28:0/1273012559 conn(0x7fa3bc078600 msgr2=0x7fa3bc079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 shutdown_connections 2026-02-20T03:19:38.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:38.516+0000 7fa3c35d7640 1 -- 10.20.193.28:0/1273012559 wait complete. 2026-02-20T03:19:38.664 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 3841e494 --release --await' 2026-02-20T03:19:38.664 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 3841e494 --release --await 2026-02-20T03:19:38.952 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:39.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- 10.20.193.28:0/432089236 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 msgr2=0x7fd47810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:39.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 --2- 10.20.193.28:0/432089236 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 0x7fd47810f7a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00b0d0 tx=0x7fd46c02f490 comp rx=0 tx=0).stop 2026-02-20T03:19:39.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- 10.20.193.28:0/432089236 shutdown_connections 2026-02-20T03:19:39.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 --2- 10.20.193.28:0/432089236 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 0x7fd47810f7a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 --2- 10.20.193.28:0/432089236 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4781028d0 0x7fd478102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 --2- 10.20.193.28:0/432089236 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4781088d0 0x7fd478108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- 10.20.193.28:0/432089236 >> 10.20.193.28:0/432089236 conn(0x7fd4780fe630 msgr2=0x7fd478100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:39.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- 10.20.193.28:0/432089236 shutdown_connections 2026-02-20T03:19:39.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- 10.20.193.28:0/432089236 wait complete. 2026-02-20T03:19:39.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 Processor -- start 2026-02-20T03:19:39.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- start start 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4781028d0 0x7fd478075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 0x7fd4780758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4781088d0 0x7fd478075df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd478112c20 con 0x7fd478103270 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd478112aa0 con 0x7fd4781028d0 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd478112da0 con 0x7fd4781088d0 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd476ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 0x7fd4780758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd476ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 0x7fd4780758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45488/0 (socket says 10.20.193.28:45488) 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd476ffd640 1 -- 10.20.193.28:0/4023471909 learned_addr learned my addr 10.20.193.28:0/4023471909 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd476ffd640 1 -- 10.20.193.28:0/4023471909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4781088d0 msgr2=0x7fd478075df0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:39.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd476ffd640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4781088d0 0x7fd478075df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd476ffd640 1 -- 10.20.193.28:0/4023471909 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4781028d0 msgr2=0x7fd478075370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:39.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd476ffd640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4781028d0 0x7fd478075370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd476ffd640 1 -- 10.20.193.28:0/4023471909 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4781a96d0 con 0x7fd478103270 2026-02-20T03:19:39.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd476ffd640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 0x7fd4780758b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd46800b570 tx=0x7fd46800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:39.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd474ff9640 1 -- 10.20.193.28:0/4023471909 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468013020 con 0x7fd478103270 2026-02-20T03:19:39.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd474ff9640 1 -- 10.20.193.28:0/4023471909 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd468004480 con 0x7fd478103270 2026-02-20T03:19:39.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd47daf1640 1 -- 10.20.193.28:0/4023471909 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4781a99c0 con 0x7fd478103270 2026-02-20T03:19:39.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.211+0000 7fd474ff9640 1 -- 10.20.193.28:0/4023471909 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46800fb50 con 0x7fd478103270 2026-02-20T03:19:39.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.214+0000 7fd47daf1640 1 -- 10.20.193.28:0/4023471909 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4781a9f00 con 0x7fd478103270 2026-02-20T03:19:39.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd474ff9640 1 -- 10.20.193.28:0/4023471909 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd468002780 con 0x7fd478103270 2026-02-20T03:19:39.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd47fff6e00 1 Processor -- start 2026-02-20T03:19:39.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd47fff6e00 1 -- start start 2026-02-20T03:19:39.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bdbb0 0x561c8f2c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2c1cd0 0x561c8f2c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c8f213a20 con 0x561c8f2bd200 2026-02-20T03:19:39.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561c8f1c12a0 con 0x561c8f2c1cd0 2026-02-20T03:19:39.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561c8f20f950 con 0x561c8f2bdbb0 2026-02-20T03:19:39.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd477fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:39.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd477fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2bd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45498/0 (socket says 10.20.193.28:45498) 2026-02-20T03:19:39.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd477fff640 1 -- 10.20.193.28:0/1577892068 learned_addr learned my addr 10.20.193.28:0/1577892068 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:39.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd477fff640 1 -- 10.20.193.28:0/1577892068 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bdbb0 msgr2=0x561c8f2c16b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:39.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd477fff640 1 --2- 10.20.193.28:0/1577892068 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bdbb0 0x561c8f2c16b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd477fff640 1 -- 10.20.193.28:0/1577892068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2c1cd0 msgr2=0x561c8f2c2130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd477fff640 1 --2- 10.20.193.28:0/1577892068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2c1cd0 0x561c8f2c2130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd477fff640 1 -- 10.20.193.28:0/1577892068 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8f1a40f0 con 0x561c8f2bd200 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd474ff9640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd44c0b0da0 0x7fd44c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd474ff9640 1 -- 10.20.193.28:0/4023471909 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd4680e05f0 con 0x7fd478103270 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.217+0000 7fd477fff640 1 --2- 10.20.193.28:0/1577892068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2bd5e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009d70 tx=0x7fd46c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08238c5a8b7915 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd4777fe640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd44c0b0da0 0x7fd44c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd43bfff640 1 -- 10.20.193.28:0/1577892068 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c004b40 con 0x561c8f2bd200 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd43bfff640 1 -- 10.20.193.28:0/1577892068 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd46c033030 con 0x561c8f2bd200 2026-02-20T03:19:39.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd43bfff640 1 -- 10.20.193.28:0/1577892068 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c002a60 con 0x561c8f2bd200 2026-02-20T03:19:39.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- 10.20.193.28:0/1577892068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 msgr2=0x561c8f2bd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:39.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/1577892068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2bd5e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009d70 tx=0x7fd46c009da0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd4777fe640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd44c0b0da0 0x7fd44c0b3260 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4640096f0 tx=0x7fd464006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:39.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- 10.20.193.28:0/1577892068 shutdown_connections 2026-02-20T03:19:39.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/1577892068 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2c1cd0 0x561c8f2c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/1577892068 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bdbb0 0x561c8f2c16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/1577892068 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2bd5e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- 10.20.193.28:0/1577892068 >> 10.20.193.28:0/1577892068 conn(0x561c8f2b81b0 msgr2=0x561c8f2c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:39.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- 10.20.193.28:0/1577892068 shutdown_connections 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- 10.20.193.28:0/1577892068 wait complete. 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- start start 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 Processor -- start 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bd200 0x561c8f2ec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2bdbb0 0x561c8f2eca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2c1cd0 0x561c8f2eac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c8f1bb080 con 0x561c8f2c1cd0 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561c8f2de990 con 0x561c8f2bdbb0 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561c8f2eb1e0 con 0x561c8f2bd200 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd477fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2c1cd0 0x561c8f2eac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:39.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd477fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2c1cd0 0x561c8f2eac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45514/0 (socket says 10.20.193.28:45514) 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd477fff640 1 -- 10.20.193.28:0/254409678 learned_addr learned my addr 10.20.193.28:0/254409678 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd477fff640 1 -- 10.20.193.28:0/254409678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bd200 msgr2=0x561c8f2ec510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd477fff640 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bd200 0x561c8f2ec510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd477fff640 1 -- 10.20.193.28:0/254409678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2bdbb0 msgr2=0x561c8f2eca50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd477fff640 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2bdbb0 0x561c8f2eca50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd477fff640 1 -- 10.20.193.28:0/254409678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8f2e40d0 con 0x561c8f2c1cd0 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd477fff640 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2c1cd0 0x561c8f2eac50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009170 tx=0x7fd46c0096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df1703154357bd4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd4397fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd4397fa640 1 -- 10.20.193.28:0/254409678 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c049070 con 0x561c8f2c1cd0 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd4397fa640 1 -- 10.20.193.28:0/254409678 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd46c0042d0 con 0x561c8f2c1cd0 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd4397fa640 1 -- 10.20.193.28:0/254409678 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c007bb0 con 0x561c8f2c1cd0 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- 10.20.193.28:0/254409678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c8efe4da0 con 0x561c8f2c1cd0 2026-02-20T03:19:39.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd4397fa640 1 -- 10.20.193.28:0/254409678 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd46c007d50 con 0x561c8f2c1cd0 2026-02-20T03:19:39.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 10 client.16485 _ll_register_callbacks cb 0x561c8f1befb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:39.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- 10.20.193.28:0/254409678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c8f21b610 con 0x561c8f2c1cd0 2026-02-20T03:19:39.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd4397fa640 1 -- 10.20.193.28:0/254409678 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd46c002a60 con 0x561c8f2c1cd0 2026-02-20T03:19:39.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 10 client.16485 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:39.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- 10.20.193.28:0/254409678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561c8f1d1020 con 0x561c8f2c1cd0 2026-02-20T03:19:39.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd4397fa640 1 -- 10.20.193.28:0/254409678 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fd46c03f020 con 0x561c8f2c1cd0 2026-02-20T03:19:39.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 10 client.16485 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:39.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 10 client.16485 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:19:39.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 20 client.16485 populate_metadata read hostname 'trial028' 2026-02-20T03:19:39.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c8f2fa730 0x561c8f2fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 4 client.16485 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:39.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.219+0000 7fd47fff6e00 1 -- 10.20.193.28:0/254409678 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c8f195b80 con 0x561c8f2fa730 2026-02-20T03:19:39.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.244+0000 7fd4777fe640 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c8f2fa730 0x561c8f2fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:39.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.297+0000 7fd4777fe640 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c8f2fa730 0x561c8f2fcb80 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f259d38005356dba server_cookie=9c636ef49687ddc8 in_seq=0 out_seq=0 2026-02-20T03:19:39.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.297+0000 7fd4397fa640 10 client.16485 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:39.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd4397fa640 1 -- 10.20.193.28:0/254409678 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561c8f195b80 con 0x561c8f2fa730 2026-02-20T03:19:39.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd4397fa640 10 client.16485 handle_command_reply: tid=0 2026-02-20T03:19:39.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 client.16485 shutdown 2026-02-20T03:19:39.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 -- 10.20.193.28:0/254409678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2c1cd0 msgr2=0x561c8f2eac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:39.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2c1cd0 0x561c8f2eac50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009170 tx=0x7fd46c0096a0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 -- 10.20.193.28:0/254409678 shutdown_connections 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c8f2fa730 0x561c8f2fcb80 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2c1cd0 0x561c8f2eac50 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2bdbb0 0x561c8f2eca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/254409678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bd200 0x561c8f2ec510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 -- 10.20.193.28:0/254409678 >> 10.20.193.28:0/254409678 conn(0x561c8f2b81b0 msgr2=0x561c8f2c0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd4397fa640 0 client.16485 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 -- 10.20.193.28:0/254409678 shutdown_connections 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 1 -- 10.20.193.28:0/254409678 wait complete. 2026-02-20T03:19:39.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.324+0000 7fd47fff6e00 20 client.16485 trim_cache size 0 max 16384 2026-02-20T03:19:39.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd47fff6e00 1 Processor -- start 2026-02-20T03:19:39.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd47fff6e00 1 -- start start 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2e9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2bdbb0 0x561c8f2c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2c1cd0 0x561c8f2e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c012720 con 0x561c8f2bd200 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00ffc0 con 0x561c8f2bdbb0 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00de10 con 0x561c8f2c1cd0 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd4777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2e9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd4777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2e9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45530/0 (socket says 10.20.193.28:45530) 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd4777fe640 1 -- 10.20.193.28:0/4110878039 learned_addr learned my addr 10.20.193.28:0/4110878039 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd4777fe640 1 -- 10.20.193.28:0/4110878039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2c1cd0 msgr2=0x561c8f2e8180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:39.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd4777fe640 1 --2- 10.20.193.28:0/4110878039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2c1cd0 0x561c8f2e8180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd4777fe640 1 -- 10.20.193.28:0/4110878039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2bdbb0 msgr2=0x561c8f2c14c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd4777fe640 1 --2- 10.20.193.28:0/4110878039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2bdbb0 0x561c8f2c14c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd4777fe640 1 -- 10.20.193.28:0/4110878039 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8f2e3f00 con 0x561c8f2bd200 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd4777fe640 1 --2- 10.20.193.28:0/4110878039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2e9ac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd46400b4b0 tx=0x7fd464010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918111af1b5e0a61 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd43b7fe640 1 -- 10.20.193.28:0/4110878039 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464009cf0 con 0x561c8f2bd200 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd43b7fe640 1 -- 10.20.193.28:0/4110878039 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd464002d00 con 0x561c8f2bd200 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.330+0000 7fd43b7fe640 1 -- 10.20.193.28:0/4110878039 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464013a80 con 0x561c8f2bd200 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 -- 10.20.193.28:0/4110878039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 msgr2=0x561c8f2e9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/4110878039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2e9ac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd46400b4b0 tx=0x7fd464010000 comp rx=0 tx=0).stop 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 -- 10.20.193.28:0/4110878039 shutdown_connections 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/4110878039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2c1cd0 0x561c8f2e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/4110878039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2bdbb0 0x561c8f2c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/4110878039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bd200 0x561c8f2e9ac0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 -- 10.20.193.28:0/4110878039 >> 10.20.193.28:0/4110878039 conn(0x561c8f2b81b0 msgr2=0x561c8f2efb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:39.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 -- 10.20.193.28:0/4110878039 shutdown_connections 2026-02-20T03:19:39.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 -- 10.20.193.28:0/4110878039 wait complete. 2026-02-20T03:19:39.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 -- start start 2026-02-20T03:19:39.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 Processor -- start 2026-02-20T03:19:39.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bd200 0x561c8f2f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bdbb0 0x561c8f2f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2c1cd0 0x561c8f2f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00e480 con 0x561c8f2bdbb0 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00f8f0 con 0x561c8f2c1cd0 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd47fff6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00eb50 con 0x561c8f2bd200 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd476ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bdbb0 0x561c8f2f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd476ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bdbb0 0x561c8f2f24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45538/0 (socket says 10.20.193.28:45538) 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd476ffd640 1 -- 10.20.193.28:0/2401399532 learned_addr learned my addr 10.20.193.28:0/2401399532 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd476ffd640 1 -- 10.20.193.28:0/2401399532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bd200 msgr2=0x561c8f2f71f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd476ffd640 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bd200 0x561c8f2f71f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd476ffd640 1 -- 10.20.193.28:0/2401399532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2c1cd0 msgr2=0x561c8f2f29f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd476ffd640 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2c1cd0 0x561c8f2f29f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.335+0000 7fd476ffd640 1 -- 10.20.193.28:0/2401399532 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8eef2ad0 con 0x561c8f2bdbb0 2026-02-20T03:19:39.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd476ffd640 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bdbb0 0x561c8f2f24b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd4680ddc60 tx=0x7fd4680a77f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae43f88e27d942fd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd4397fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd4397fa640 1 -- 10.20.193.28:0/2401399532 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4680b1530 con 0x561c8f2bdbb0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd4397fa640 1 -- 10.20.193.28:0/2401399532 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd4680e0070 con 0x561c8f2bdbb0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd4397fa640 1 -- 10.20.193.28:0/2401399532 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4680a3c50 con 0x561c8f2bdbb0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 1 -- 10.20.193.28:0/2401399532 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c8f19a370 con 0x561c8f2bdbb0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd4397fa640 1 -- 10.20.193.28:0/2401399532 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd4680a6d50 con 0x561c8f2bdbb0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 10 client.16491 _ll_register_callbacks cb 0x7fd46c02faf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 1 -- 10.20.193.28:0/2401399532 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd46c033030 con 0x561c8f2bdbb0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd4397fa640 1 -- 10.20.193.28:0/2401399532 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4680ac120 con 0x561c8f2bdbb0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 10 client.16491 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 1 -- 10.20.193.28:0/2401399532 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561c8f2e4bf0 con 0x561c8f2bdbb0 2026-02-20T03:19:39.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd4397fa640 1 -- 10.20.193.28:0/2401399532 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fd4680a6f50 con 0x561c8f2bdbb0 2026-02-20T03:19:39.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 10 client.16491 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:39.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 10 client.16491 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:19:39.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 20 client.16491 populate_metadata read hostname 'trial028' 2026-02-20T03:19:39.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c8f367660 0x561c8f369b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:39.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 4 client.16491 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3841e494", "release": true, "await": true}] 2026-02-20T03:19:39.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.337+0000 7fd47fff6e00 1 -- 10.20.193.28:0/2401399532 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3841e494", "release": true, "await": true}) -- 0x561c8ef94480 con 0x561c8f367660 2026-02-20T03:19:39.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.364+0000 7fd4777fe640 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c8f367660 0x561c8f369b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:39.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.431+0000 7fd4777fe640 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c8f367660 0x561c8f369b20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81e12b8b446107f2 server_cookie=98a6833255472c39 in_seq=0 out_seq=0 2026-02-20T03:19:39.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.431+0000 7fd4397fa640 10 client.16491 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:39.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd4397fa640 1 -- 10.20.193.28:0/2401399532 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561c8ef94480 con 0x561c8f367660 2026-02-20T03:19:39.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd4397fa640 10 client.16491 handle_command_reply: tid=0 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 client.16491 shutdown 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 -- 10.20.193.28:0/2401399532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bdbb0 msgr2=0x561c8f2f24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bdbb0 0x561c8f2f24b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd4680ddc60 tx=0x7fd4680a77f0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 -- 10.20.193.28:0/2401399532 shutdown_connections 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c8f367660 0x561c8f369b20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c8f2c1cd0 0x561c8f2f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c8f2bdbb0 0x561c8f2f24b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 --2- 10.20.193.28:0/2401399532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c8f2bd200 0x561c8f2f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 -- 10.20.193.28:0/2401399532 >> 10.20.193.28:0/2401399532 conn(0x561c8f2b81b0 msgr2=0x561c8f2c04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd4397fa640 0 client.16491 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:39.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 -- 10.20.193.28:0/2401399532 shutdown_connections 2026-02-20T03:19:39.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 1 -- 10.20.193.28:0/2401399532 wait complete. 2026-02-20T03:19:39.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47fff6e00 20 client.16491 trim_cache size 0 max 16384 2026-02-20T03:19:39.449 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:19:39.449 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T03:19:39.449 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:19:39.449 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 16, 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "3841e494": { 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "version": 16, 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:19:39.450 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:39.451 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:19:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 -- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd44c0b0da0 msgr2=0x7fd44c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd44c0b0da0 0x7fd44c0b3260 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd4640096f0 tx=0x7fd464006cd0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 -- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 msgr2=0x7fd4780758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 0x7fd4780758b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd46800b570 tx=0x7fd46800ba40 comp rx=0 tx=0).stop 2026-02-20T03:19:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 -- 10.20.193.28:0/4023471909 shutdown_connections 2026-02-20T03:19:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd44c0b0da0 0x7fd44c0b3260 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4781088d0 0x7fd478075df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd478103270 0x7fd4780758b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 --2- 10.20.193.28:0/4023471909 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4781028d0 0x7fd478075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:39.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 -- 10.20.193.28:0/4023471909 >> 10.20.193.28:0/4023471909 conn(0x7fd4780fe630 msgr2=0x7fd4780fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:39.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 -- 10.20.193.28:0/4023471909 shutdown_connections 2026-02-20T03:19:39.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:39.445+0000 7fd47daf1640 1 -- 10.20.193.28:0/4023471909 wait complete. 2026-02-20T03:19:39.498 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:39 trial028 ceph-mon[38552]: pgmap v330: 129 pgs: 129 active+clean; 78 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 110 KiB/s rd, 2.6 MiB/s wr, 124 op/s 2026-02-20T03:19:39.498 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:39 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1273012559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:39.503 INFO:tasks.workunit.client.0.trial028.stdout: 1 377532 5.67 MB/sec execute 72 sec latency 30342.478 ms 2026-02-20T03:19:39.578 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3841e494', total seconds elapsed: 31.7 2026-02-20T03:19:39.579 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2026-02-20T03:19:39.579 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:19:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:39 trial177 ceph-mon[43181]: pgmap v330: 129 pgs: 129 active+clean; 78 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 110 KiB/s rd, 2.6 MiB/s wr, 124 op/s 2026-02-20T03:19:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:39 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1273012559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:39.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:39 trial126 ceph-mon[38476]: pgmap v330: 129 pgs: 129 active+clean; 78 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 110 KiB/s rd, 2.6 MiB/s wr, 124 op/s 2026-02-20T03:19:39.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:39 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1273012559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:39.883 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:40.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 -- 10.20.193.28:0/2185474844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7748109220 msgr2=0x7f7748109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:40.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2185474844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7748109220 0x7f7748109660 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7734009a30 tx=0x7f773402f220 comp rx=0 tx=0).stop 2026-02-20T03:19:40.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 -- 10.20.193.28:0/2185474844 shutdown_connections 2026-02-20T03:19:40.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2185474844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7748109ba0 0x7f7748115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2185474844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7748109220 0x7f7748109660 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2185474844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f774810eef0 0x7f774810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 -- 10.20.193.28:0/2185474844 >> 10.20.193.28:0/2185474844 conn(0x7f7748078600 msgr2=0x7f774807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:40.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 -- 10.20.193.28:0/2185474844 shutdown_connections 2026-02-20T03:19:40.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 -- 10.20.193.28:0/2185474844 wait complete. 2026-02-20T03:19:40.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 Processor -- start 2026-02-20T03:19:40.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.071+0000 7f774d7a0640 1 -- start start 2026-02-20T03:19:40.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f774d7a0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7748109220 0x7f77481a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f774d7a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7748109ba0 0x7f77481a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f774d7a0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f774810eef0 0x7f77481a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f774d7a0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7748119090 con 0x7f7748109ba0 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f774d7a0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7748118f10 con 0x7f774810eef0 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f774d7a0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7748119210 con 0x7f7748109220 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f77477fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7748109ba0 0x7f77481a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f7747fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7748109220 0x7f77481a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f7747fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7748109220 0x7f77481a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:55940/0 (socket says 10.20.193.28:55940) 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f7747fff640 1 -- 10.20.193.28:0/2396866730 learned_addr learned my addr 10.20.193.28:0/2396866730 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f774cf9f640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f774810eef0 0x7f77481a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f7747fff640 1 -- 10.20.193.28:0/2396866730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f774810eef0 msgr2=0x7f77481a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:40.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f7747fff640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f774810eef0 0x7f77481a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f7747fff640 1 -- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7748109ba0 msgr2=0x7f77481a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f7747fff640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7748109ba0 0x7f77481a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f7747fff640 1 -- 10.20.193.28:0/2396866730 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77481a6570 con 0x7f7748109220 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.072+0000 7f77477fe640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7748109ba0 0x7f77481a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.073+0000 7f7747fff640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7748109220 0x7f77481a1520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f773800d980 tx=0x7f773800de50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.073+0000 7f77457fa640 1 -- 10.20.193.28:0/2396866730 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738014070 con 0x7f7748109220 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.073+0000 7f77457fa640 1 -- 10.20.193.28:0/2396866730 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f77380044e0 con 0x7f7748109220 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.073+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77481a6860 con 0x7f7748109220 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.073+0000 7f77457fa640 1 -- 10.20.193.28:0/2396866730 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738005040 con 0x7f7748109220 2026-02-20T03:19:40.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.073+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77481ae0a0 con 0x7f7748109220 2026-02-20T03:19:40.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.074+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774810a580 con 0x7f7748109220 2026-02-20T03:19:40.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.077+0000 7f77457fa640 1 -- 10.20.193.28:0/2396866730 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f77380047c0 con 0x7f7748109220 2026-02-20T03:19:40.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.079+0000 7f77457fa640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f771c0b0da0 0x7f771c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.079+0000 7f77457fa640 1 -- 10.20.193.28:0/2396866730 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f77380e0cd0 con 0x7f7748109220 2026-02-20T03:19:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.079+0000 7f77457fa640 1 -- 10.20.193.28:0/2396866730 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f77380e1150 con 0x7f7748109220 2026-02-20T03:19:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.079+0000 7f77477fe640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f771c0b0da0 0x7f771c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.079+0000 7f77477fe640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f771c0b0da0 0x7f771c0b3260 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f774810e5f0 tx=0x7f7734005830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:40.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.186+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7748109660 con 0x7f7748109220 2026-02-20T03:19:40.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.187+0000 7f77457fa640 1 -- 10.20.193.28:0/2396866730 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11922 (secure 0 0 0) 0x7f7748109660 con 0x7f7748109220 2026-02-20T03:19:40.190 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:19:40.190 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T03:19:18:240749+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:19:17.378192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:19:40.191 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T03:19:40.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.188+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f771c0b0da0 msgr2=0x7f771c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.188+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f771c0b0da0 0x7f771c0b3260 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f774810e5f0 tx=0x7f7734005830 comp rx=0 tx=0).stop 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.188+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7748109220 msgr2=0x7f77481a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.188+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7748109220 0x7f77481a1520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f773800d980 tx=0x7f773800de50 comp rx=0 tx=0).stop 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.189+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 shutdown_connections 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.189+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f771c0b0da0 0x7f771c0b3260 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.189+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f774810eef0 0x7f77481a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.189+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7748109ba0 0x7f77481a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.189+0000 7f774d7a0640 1 --2- 10.20.193.28:0/2396866730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7748109220 0x7f77481a1520 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.189+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 >> 10.20.193.28:0/2396866730 conn(0x7f7748078600 msgr2=0x7f7748079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.189+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 shutdown_connections 2026-02-20T03:19:40.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.189+0000 7f774d7a0640 1 -- 10.20.193.28:0/2396866730 wait complete. 2026-02-20T03:19:40.295 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2026-02-20T03:19:40.296 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2026-02-20T03:19:40.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:40 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2396866730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:40.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379986 5.78 MB/sec execute 73 sec latency 30467.931 ms 2026-02-20T03:19:40.579 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:40.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:40 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2396866730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.821+0000 7fc2c1b22640 1 -- 10.20.193.28:0/1933327522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 msgr2=0x7fc2bc115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.821+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/1933327522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 0x7fc2bc115900 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800b0a0 tx=0x7fc2b802f4e0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.821+0000 7fc2c1b22640 1 -- 10.20.193.28:0/1933327522 shutdown_connections 2026-02-20T03:19:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.821+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/1933327522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 0x7fc2bc115900 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.821+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/1933327522 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2bc075950 0x7fc2bc075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.821+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/1933327522 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2bc1065d0 0x7fc2bc075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.821+0000 7fc2c1b22640 1 -- 10.20.193.28:0/1933327522 >> 10.20.193.28:0/1933327522 conn(0x7fc2bc0fe440 msgr2=0x7fc2bc100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:40.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.821+0000 7fc2c1b22640 1 -- 10.20.193.28:0/1933327522 shutdown_connections 2026-02-20T03:19:40.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.821+0000 7fc2c1b22640 1 -- 10.20.193.28:0/1933327522 wait complete. 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.822+0000 7fc2c1b22640 1 Processor -- start 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.822+0000 7fc2c1b22640 1 -- start start 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1b22640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2bc075950 0x7fc2bc1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1b22640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2bc1065d0 0x7fc2bc1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1b22640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 0x7fc2bc1a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1b22640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1191d0 con 0x7fc2bc1134d0 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1b22640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc119050 con 0x7fc2bc1065d0 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1b22640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc119350 con 0x7fc2bc075950 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1321640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 0x7fc2bc1a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1321640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 0x7fc2bc1a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45566/0 (socket says 10.20.193.28:45566) 2026-02-20T03:19:40.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1321640 1 -- 10.20.193.28:0/3464496651 learned_addr learned my addr 10.20.193.28:0/3464496651 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:40.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1321640 1 -- 10.20.193.28:0/3464496651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2bc075950 msgr2=0x7fc2bc1a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1321640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2bc075950 0x7fc2bc1a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1321640 1 -- 10.20.193.28:0/3464496651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2bc1065d0 msgr2=0x7fc2bc1a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1321640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2bc1065d0 0x7fc2bc1a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1321640 1 -- 10.20.193.28:0/3464496651 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc1a66c0 con 0x7fc2bc1134d0 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.823+0000 7fc2c1321640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 0x7fc2bc1a5f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800b1d0 tx=0x7fc2b8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.824+0000 7fc2b1ffb640 1 -- 10.20.193.28:0/3464496651 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b80096a0 con 0x7fc2bc1134d0 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.824+0000 7fc2c1b22640 1 -- 10.20.193.28:0/3464496651 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2bc1a6950 con 0x7fc2bc1134d0 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.824+0000 7fc2b1ffb640 1 -- 10.20.193.28:0/3464496651 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc2b80075c0 con 0x7fc2bc1134d0 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.824+0000 7fc2b1ffb640 1 -- 10.20.193.28:0/3464496651 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b80096a0 con 0x7fc2bc1134d0 2026-02-20T03:19:40.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.824+0000 7fc2c1b22640 1 -- 10.20.193.28:0/3464496651 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2bc1ae1f0 con 0x7fc2bc1134d0 2026-02-20T03:19:40.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.829+0000 7fc2b1ffb640 1 -- 10.20.193.28:0/3464496651 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc2b8004b40 con 0x7fc2bc1134d0 2026-02-20T03:19:40.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.830+0000 7fc2c52b0e00 1 Processor -- start 2026-02-20T03:19:40.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.830+0000 7fc2c52b0e00 1 -- start start 2026-02-20T03:19:40.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.830+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3f170 0x55d2b6e3f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.830+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 0x55d2b6e39ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.830+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e45fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.830+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d2b6d8c410 con 0x55d2b6e3a220 2026-02-20T03:19:40.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.830+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d2b6d398b0 con 0x55d2b6e39860 2026-02-20T03:19:40.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.830+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d2b6d88340 con 0x55d2b6e3f170 2026-02-20T03:19:40.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.830+0000 7fc2b1ffb640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2980b11a0 0x7fc2980b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e45fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e45fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45582/0 (socket says 10.20.193.28:45582) 2026-02-20T03:19:40.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b3fff640 1 -- 10.20.193.28:0/2380418174 learned_addr learned my addr 10.20.193.28:0/2380418174 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:40.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b1ffb640 1 -- 10.20.193.28:0/3464496651 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc2b803e070 con 0x7fc2bc1134d0 2026-02-20T03:19:40.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2c1321640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2980b11a0 0x7fc2980b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b3fff640 1 -- 10.20.193.28:0/2380418174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3f170 msgr2=0x55d2b6e3f550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/2380418174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3f170 0x55d2b6e3f550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b3fff640 1 -- 10.20.193.28:0/2380418174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 msgr2=0x55d2b6e39ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/2380418174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 0x55d2b6e39ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b3fff640 1 -- 10.20.193.28:0/2380418174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b6d2b8c0 con 0x55d2b6e3a220 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/2380418174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e45fc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40098a0 tx=0x7fc2a4009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7101cf9699bf0b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2894e4640 1 -- 10.20.193.28:0/2380418174 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4016070 con 0x55d2b6e3a220 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2894e4640 1 -- 10.20.193.28:0/2380418174 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc2a4004570 con 0x55d2b6e3a220 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2894e4640 1 -- 10.20.193.28:0/2380418174 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a400bda0 con 0x55d2b6e3a220 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.831+0000 7fc2c1321640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2980b11a0 0x7fc2980b3660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80ccda0 tx=0x7fc2b802f4e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.832+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/2380418174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 msgr2=0x55d2b6e45fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:40.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.832+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/2380418174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e45fc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40098a0 tx=0x7fc2a4009d70 comp rx=0 tx=0).stop 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.832+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/2380418174 shutdown_connections 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.832+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/2380418174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e45fc0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.832+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/2380418174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 0x55d2b6e39ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.832+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/2380418174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3f170 0x55d2b6e3f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.832+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/2380418174 >> 10.20.193.28:0/2380418174 conn(0x55d2b6e323c0 msgr2=0x55d2b6e37f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.832+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/2380418174 shutdown_connections 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.832+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/2380418174 wait complete. 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.833+0000 7fc2c52b0e00 1 -- start start 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.833+0000 7fc2c52b0e00 1 Processor -- start 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.833+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 0x55d2b6e546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.833+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e54be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.833+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3f170 0x55d2b6e52de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.833+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d2b6d334a0 con 0x55d2b6e3a220 2026-02-20T03:19:40.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.833+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d2b6e466c0 con 0x55d2b6e39860 2026-02-20T03:19:40.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.833+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d2b6e53370 con 0x55d2b6e3f170 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc2c0b20640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e54be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc2c0b20640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e54be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45588/0 (socket says 10.20.193.28:45588) 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc2c0b20640 1 -- 10.20.193.28:0/3845178433 learned_addr learned my addr 10.20.193.28:0/3845178433 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc2c0b20640 1 -- 10.20.193.28:0/3845178433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3f170 msgr2=0x55d2b6e52de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc2c0b20640 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3f170 0x55d2b6e52de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc2c0b20640 1 -- 10.20.193.28:0/3845178433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 msgr2=0x55d2b6e546a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc2c0b20640 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 0x55d2b6e546a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc2c0b20640 1 -- 10.20.193.28:0/3845178433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b6e4c0a0 con 0x55d2b6e3a220 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc2c0b20640 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e54be0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009f00 tx=0x7fc2ac00b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7c5f2a20a70321 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc27a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:40.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.834+0000 7fc27a7fc640 1 -- 10.20.193.28:0/3845178433 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac016070 con 0x55d2b6e3a220 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/3845178433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b6af08a0 con 0x55d2b6e3a220 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 10 client.16509 _ll_register_callbacks cb 0x55d2b6d373d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/3845178433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d2b6d94000 con 0x55d2b6e3a220 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc27a7fc640 1 -- 10.20.193.28:0/3845178433 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc2ac002780 con 0x55d2b6e3a220 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc27a7fc640 1 -- 10.20.193.28:0/3845178433 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac0117a0 con 0x55d2b6e3a220 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc27a7fc640 1 -- 10.20.193.28:0/3845178433 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc2ac01b440 con 0x55d2b6e3a220 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc27a7fc640 1 -- 10.20.193.28:0/3845178433 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc2ac004270 con 0x55d2b6e3a220 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 10 client.16509 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/3845178433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d2b6b5c0e0 con 0x55d2b6e3a220 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc27a7fc640 1 -- 10.20.193.28:0/3845178433 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fc2ac023060 con 0x55d2b6e3a220 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 10 client.16509 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 10 client.16509 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:19:40.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 20 client.16509 populate_metadata read hostname 'trial028' 2026-02-20T03:19:40.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d2b6e62a50 0x55d2b6e64ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 4 client.16509 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:40.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.835+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/3845178433 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2b6d0df60 con 0x55d2b6e62a50 2026-02-20T03:19:40.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.839+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d2b6e62a50 0x55d2b6e64ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:40 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2396866730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:40.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.906+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d2b6e62a50 0x55d2b6e64ef0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de463bbb30e1ab30 server_cookie=443f6f5f30551b10 in_seq=0 out_seq=0 2026-02-20T03:19:40.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.906+0000 7fc27a7fc640 10 client.16509 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:40.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc27a7fc640 1 -- 10.20.193.28:0/3845178433 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d2b6d0df60 con 0x55d2b6e62a50 2026-02-20T03:19:40.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc27a7fc640 10 client.16509 handle_command_reply: tid=0 2026-02-20T03:19:40.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 client.16509 shutdown 2026-02-20T03:19:40.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/3845178433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 msgr2=0x55d2b6e54be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:40.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e54be0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009f00 tx=0x7fc2ac00b4b0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/3845178433 shutdown_connections 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d2b6e62a50 0x55d2b6e64ef0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3f170 0x55d2b6e52de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3a220 0x55d2b6e54be0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/3845178433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 0x55d2b6e546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/3845178433 >> 10.20.193.28:0/3845178433 conn(0x55d2b6e323c0 msgr2=0x55d2b6e38670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc27a7fc640 0 client.16509 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/3845178433 shutdown_connections 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/3845178433 wait complete. 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.933+0000 7fc2c52b0e00 20 client.16509 trim_cache size 0 max 16384 2026-02-20T03:19:40.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2c52b0e00 1 Processor -- start 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2c52b0e00 1 -- start start 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e39860 0x55d2b6e50110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3a220 0x55d2b6e50650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e3f170 0x55d2b6e6a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc260012820 con 0x55d2b6e39860 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc2600100c0 con 0x55d2b6e3f170 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc26000deb0 con 0x55d2b6e3a220 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2b3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e39860 0x55d2b6e50110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2b3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e39860 0x55d2b6e50110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45602/0 (socket says 10.20.193.28:45602) 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2b3fff640 1 -- 10.20.193.28:0/399181735 learned_addr learned my addr 10.20.193.28:0/399181735 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2b3fff640 1 -- 10.20.193.28:0/399181735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3a220 msgr2=0x55d2b6e50650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:40.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/399181735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3a220 0x55d2b6e50650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2b3fff640 1 -- 10.20.193.28:0/399181735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e3f170 msgr2=0x55d2b6e6a800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/399181735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e3f170 0x55d2b6e6a800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.942+0000 7fc2b3fff640 1 -- 10.20.193.28:0/399181735 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b6e4bed0 con 0x55d2b6e39860 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/399181735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e39860 0x55d2b6e50110 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55d2b6e52580 tx=0x7fc2a40040d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aeedfa78581c762 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc288ce3640 1 -- 10.20.193.28:0/399181735 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4016040 con 0x55d2b6e39860 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc288ce3640 1 -- 10.20.193.28:0/399181735 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc2a4004340 con 0x55d2b6e39860 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc288ce3640 1 -- 10.20.193.28:0/399181735 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a401f440 con 0x55d2b6e39860 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/399181735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e39860 msgr2=0x55d2b6e50110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/399181735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e39860 0x55d2b6e50110 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55d2b6e52580 tx=0x7fc2a40040d0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/399181735 shutdown_connections 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/399181735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e3f170 0x55d2b6e6a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/399181735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3a220 0x55d2b6e50650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/399181735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e39860 0x55d2b6e50110 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/399181735 >> 10.20.193.28:0/399181735 conn(0x55d2b6e323c0 msgr2=0x55d2b6e51600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:40.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/399181735 shutdown_connections 2026-02-20T03:19:40.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.943+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/399181735 wait complete. 2026-02-20T03:19:40.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.944+0000 7fc2c52b0e00 1 -- start start 2026-02-20T03:19:40.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.944+0000 7fc2c52b0e00 1 Processor -- start 2026-02-20T03:19:40.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.944+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 0x55d2b6e5bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.944+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3a220 0x55d2b6e5c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.944+0000 7fc2c52b0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3f170 0x55d2b6ec7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.944+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc26000e580 con 0x55d2b6e3f170 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.944+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc26000f9f0 con 0x55d2b6e39860 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.944+0000 7fc2c52b0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc26000ec50 con 0x55d2b6e3a220 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2b3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3f170 0x55d2b6ec7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2b3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3f170 0x55d2b6ec7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45614/0 (socket says 10.20.193.28:45614) 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2b3fff640 1 -- 10.20.193.28:0/1955440335 learned_addr learned my addr 10.20.193.28:0/1955440335 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2b3fff640 1 -- 10.20.193.28:0/1955440335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3a220 msgr2=0x55d2b6e5c500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3a220 0x55d2b6e5c500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2b3fff640 1 -- 10.20.193.28:0/1955440335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 msgr2=0x55d2b6e5bfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 0x55d2b6e5bfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2b3fff640 1 -- 10.20.193.28:0/1955440335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b6e4ba90 con 0x55d2b6e3f170 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2b3fff640 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3f170 0x55d2b6ec7a20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b4b0 tx=0x7fc2a40092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e03a8616c3aede6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:40.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc27a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc27a7fc640 1 -- 10.20.193.28:0/1955440335 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4016070 con 0x55d2b6e3f170 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc27a7fc640 1 -- 10.20.193.28:0/1955440335 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc2a400be00 con 0x55d2b6e3f170 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc27a7fc640 1 -- 10.20.193.28:0/1955440335 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a401fb90 con 0x55d2b6e3f170 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/1955440335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b6b0d7f0 con 0x55d2b6e3f170 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2c52b0e00 10 client.16515 _ll_register_callbacks cb 0x7fc2ac009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/1955440335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2a4004570 con 0x55d2b6e3f170 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.945+0000 7fc27a7fc640 1 -- 10.20.193.28:0/1955440335 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc2a402d070 con 0x55d2b6e3f170 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc27a7fc640 1 -- 10.20.193.28:0/1955440335 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc2a402c030 con 0x55d2b6e3f170 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc2c52b0e00 10 client.16515 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/1955440335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55d2b6e4cbc0 con 0x55d2b6e3f170 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc27a7fc640 1 -- 10.20.193.28:0/1955440335 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fc2a4002c10 con 0x55d2b6e3f170 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc2c52b0e00 10 client.16515 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc2c52b0e00 10 client.16515 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc2c52b0e00 20 client.16515 populate_metadata read hostname 'trial028' 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d2b6ecf220 0x55d2b6ed16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:40.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc2c52b0e00 4 client.16515 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2026-02-20T03:19:40.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.946+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/1955440335 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55d2b6e462f0 con 0x55d2b6ecf220 2026-02-20T03:19:40.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:40.960+0000 7fc2c0b20640 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d2b6ecf220 0x55d2b6ed16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:41.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:41.013+0000 7fc2c0b20640 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d2b6ecf220 0x55d2b6ed16b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db2a78b716103cd8 server_cookie=6a831798def9d2ba in_seq=0 out_seq=0 2026-02-20T03:19:41.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:41.013+0000 7fc27a7fc640 10 client.16515 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:41.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379986 5.70 MB/sec execute 74 sec latency 1205.605 ms 2026-02-20T03:19:41.553 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:41 trial028 ceph-mon[38552]: pgmap v331: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 247 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T03:19:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:41 trial177 ceph-mon[43181]: pgmap v331: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 247 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T03:19:41.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:41 trial126 ceph-mon[38476]: pgmap v331: 129 pgs: 129 active+clean; 81 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 247 KiB/s rd, 2.8 MiB/s wr, 135 op/s 2026-02-20T03:19:42.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379986 5.63 MB/sec execute 75 sec latency 2205.647 ms 2026-02-20T03:19:42.641 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:42 trial028 ceph-mon[38552]: pgmap v332: 129 pgs: 129 active+clean; 79 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 410 KiB/s rd, 2.2 MiB/s wr, 128 op/s 2026-02-20T03:19:42.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:42 trial177 ceph-mon[43181]: pgmap v332: 129 pgs: 129 active+clean; 79 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 410 KiB/s rd, 2.2 MiB/s wr, 128 op/s 2026-02-20T03:19:42.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:42 trial126 ceph-mon[38476]: pgmap v332: 129 pgs: 129 active+clean; 79 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 410 KiB/s rd, 2.2 MiB/s wr, 128 op/s 2026-02-20T03:19:43.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.244+0000 7fc27a7fc640 1 -- 10.20.193.28:0/1955440335 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55d2b6e462f0 con 0x55d2b6ecf220 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.244+0000 7fc27a7fc640 10 client.16515 handle_command_reply: tid=0 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.244+0000 7fc2c52b0e00 1 client.16515 shutdown 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/1955440335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3f170 msgr2=0x55d2b6ec7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3f170 0x55d2b6ec7a20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400b4b0 tx=0x7fc2a40092b0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/1955440335 shutdown_connections 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d2b6ecf220 0x55d2b6ed16b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d2b6e3f170 0x55d2b6ec7a20 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d2b6e3a220 0x55d2b6e5c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 --2- 10.20.193.28:0/1955440335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d2b6e39860 0x55d2b6e5bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc27a7fc640 0 client.16515 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/1955440335 >> 10.20.193.28:0/1955440335 conn(0x55d2b6e323c0 msgr2=0x55d2b6e62e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/1955440335 shutdown_connections 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 1 -- 10.20.193.28:0/1955440335 wait complete. 2026-02-20T03:19:43.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.245+0000 7fc2c52b0e00 20 client.16515 trim_cache size 0 max 16384 2026-02-20T03:19:43.249 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:19:43.249 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T03:19:43.249 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:19:43.249 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 18, 2026-02-20T03:19:43.249 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:19:43.249 INFO:teuthology.orchestra.run.trial028.stdout: "971cbbc": { 2026-02-20T03:19:43.249 INFO:teuthology.orchestra.run.trial028.stdout: "version": 18, 2026-02-20T03:19:43.249 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:19:43.249 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:43.250 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:19:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 -- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2980b11a0 msgr2=0x7fc2980b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2980b11a0 0x7fc2980b3660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80ccda0 tx=0x7fc2b802f4e0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 -- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 msgr2=0x7fc2bc1a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 0x7fc2bc1a5f40 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc2b800b1d0 tx=0x7fc2b8005bd0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 -- 10.20.193.28:0/3464496651 shutdown_connections 2026-02-20T03:19:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2980b11a0 0x7fc2980b3660 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2bc1134d0 0x7fc2bc1a5f40 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc2bc1065d0 0x7fc2bc1a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 --2- 10.20.193.28:0/3464496651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2bc075950 0x7fc2bc1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 -- 10.20.193.28:0/3464496651 >> 10.20.193.28:0/3464496651 conn(0x7fc2bc0fe440 msgr2=0x7fc2bc114c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 -- 10.20.193.28:0/3464496651 shutdown_connections 2026-02-20T03:19:43.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:43.246+0000 7fc2c1b22640 1 -- 10.20.193.28:0/3464496651 wait complete. 2026-02-20T03:19:43.359 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '971cbbc', quiesce took 3.8 seconds. Will release after: 26.2 2026-02-20T03:19:43.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 5.55 MB/sec execute 76 sec latency 2933.304 ms 2026-02-20T03:19:44.087 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:19:44.356 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:44.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 5.48 MB/sec execute 77 sec latency 1262.875 ms 2026-02-20T03:19:44.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.553+0000 7fa7914da640 1 -- 10.20.193.28:0/3562201093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa78c077620 msgr2=0x7fa78c077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:44.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.553+0000 7fa7914da640 1 --2- 10.20.193.28:0/3562201093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa78c077620 0x7fa78c077a00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa778009a30 tx=0x7fa77802f220 comp rx=0 tx=0).stop 2026-02-20T03:19:44.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.553+0000 7fa7914da640 1 -- 10.20.193.28:0/3562201093 shutdown_connections 2026-02-20T03:19:44.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.553+0000 7fa7914da640 1 --2- 10.20.193.28:0/3562201093 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa78c113820 0x7fa78c115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.553+0000 7fa7914da640 1 --2- 10.20.193.28:0/3562201093 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa78c077f40 0x7fa78c1132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.553+0000 7fa7914da640 1 --2- 10.20.193.28:0/3562201093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa78c077620 0x7fa78c077a00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.553+0000 7fa7914da640 1 -- 10.20.193.28:0/3562201093 >> 10.20.193.28:0/3562201093 conn(0x7fa78c100680 msgr2=0x7fa78c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:44.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.553+0000 7fa7914da640 1 -- 10.20.193.28:0/3562201093 shutdown_connections 2026-02-20T03:19:44.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.553+0000 7fa7914da640 1 -- 10.20.193.28:0/3562201093 wait complete. 2026-02-20T03:19:44.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.554+0000 7fa7914da640 1 Processor -- start 2026-02-20T03:19:44.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.554+0000 7fa7914da640 1 -- start start 2026-02-20T03:19:44.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.554+0000 7fa7914da640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa78c077620 0x7fa78c1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.554+0000 7fa7914da640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa78c077f40 0x7fa78c1a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.554+0000 7fa7914da640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa78c113820 0x7fa78c1a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.554+0000 7fa7914da640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c1190c0 con 0x7fa78c113820 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.554+0000 7fa7914da640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c118f40 con 0x7fa78c077f40 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.554+0000 7fa7914da640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c119240 con 0x7fa78c077620 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa790cd9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa78c113820 0x7fa78c1a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa78c077f40 0x7fa78c1a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa78c077620 0x7fa78c1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa78c077f40 0x7fa78c1a1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54360/0 (socket says 10.20.193.28:54360) 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78b7fe640 1 -- 10.20.193.28:0/3242870750 learned_addr learned my addr 10.20.193.28:0/3242870750 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78b7fe640 1 -- 10.20.193.28:0/3242870750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa78c077620 msgr2=0x7fa78c1a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78b7fe640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa78c077620 0x7fa78c1a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78b7fe640 1 -- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa78c113820 msgr2=0x7fa78c1a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:44.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78b7fe640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa78c113820 0x7fa78c1a5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78b7fe640 1 -- 10.20.193.28:0/3242870750 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c1a65d0 con 0x7fa78c077f40 2026-02-20T03:19:44.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa790cd9640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa78c113820 0x7fa78c1a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:44.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa78b7fe640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa78c077f40 0x7fa78c1a1ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00ea30 tx=0x7fa77c00ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:44.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa7897fa640 1 -- 10.20.193.28:0/3242870750 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00ce50 con 0x7fa78c077f40 2026-02-20T03:19:44.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa7914da640 1 -- 10.20.193.28:0/3242870750 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c1a68c0 con 0x7fa78c077f40 2026-02-20T03:19:44.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa7897fa640 1 -- 10.20.193.28:0/3242870750 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa77c004570 con 0x7fa78c077f40 2026-02-20T03:19:44.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa7914da640 1 -- 10.20.193.28:0/3242870750 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c1ae100 con 0x7fa78c077f40 2026-02-20T03:19:44.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.555+0000 7fa7897fa640 1 -- 10.20.193.28:0/3242870750 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c010690 con 0x7fa78c077f40 2026-02-20T03:19:44.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.558+0000 7fa794c68e00 1 Processor -- start 2026-02-20T03:19:44.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.558+0000 7fa7897fa640 1 -- 10.20.193.28:0/3242870750 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa77c0040d0 con 0x7fa78c077f40 2026-02-20T03:19:44.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.558+0000 7fa794c68e00 1 -- start start 2026-02-20T03:19:44.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e2e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 0x556d17e28a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e34e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa794c68e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556d17da8e50 con 0x556d17e28630 2026-02-20T03:19:44.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa794c68e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556d17d7b9c0 con 0x556d17e2e000 2026-02-20T03:19:44.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa794c68e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556d17d29240 con 0x556d17e28fb0 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa790cd9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e2e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa790cd9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e2e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54372/0 (socket says 10.20.193.28:54372) 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa790cd9640 1 -- 10.20.193.28:0/3527558349 learned_addr learned my addr 10.20.193.28:0/3527558349 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa78bfff640 1 --2- 10.20.193.28:0/3527558349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 0x556d17e28a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa790cd9640 1 -- 10.20.193.28:0/3527558349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 msgr2=0x556d17e34e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa790cd9640 1 --2- 10.20.193.28:0/3527558349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e34e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa790cd9640 1 -- 10.20.193.28:0/3527558349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 msgr2=0x556d17e28a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa790cd9640 1 --2- 10.20.193.28:0/3527558349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 0x556d17e28a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa790cd9640 1 -- 10.20.193.28:0/3527558349 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d17d3c420 con 0x556d17e2e000 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.559+0000 7fa78bfff640 1 --2- 10.20.193.28:0/3527558349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 0x556d17e28a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa7897fa640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7600b0e20 0x7fa7600b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa790cd9640 1 --2- 10.20.193.28:0/3527558349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e2e3e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa7800094f0 tx=0x7fa780009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a5b2032bfd3d19e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa7897fa640 1 -- 10.20.193.28:0/3242870750 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa77c0e0f30 con 0x7fa78c077f40 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa78bfff640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7600b0e20 0x7fa7600b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa75cce3640 1 -- 10.20.193.28:0/3527558349 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780019020 con 0x556d17e2e000 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa75cce3640 1 -- 10.20.193.28:0/3527558349 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa780004570 con 0x556d17e2e000 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa75cce3640 1 -- 10.20.193.28:0/3527558349 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78000ed20 con 0x556d17e2e000 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa794c68e00 1 -- 10.20.193.28:0/3527558349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 msgr2=0x556d17e2e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3527558349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e2e3e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa7800094f0 tx=0x7fa780009920 comp rx=0 tx=0).stop 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa794c68e00 1 -- 10.20.193.28:0/3527558349 shutdown_connections 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3527558349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e34e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3527558349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 0x556d17e28a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3527558349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e2e3e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.560+0000 7fa794c68e00 1 -- 10.20.193.28:0/3527558349 >> 10.20.193.28:0/3527558349 conn(0x556d17deb290 msgr2=0x556d17e26d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.561+0000 7fa78bfff640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7600b0e20 0x7fa7600b32e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa7780059c0 tx=0x7fa778005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:44.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.561+0000 7fa794c68e00 1 -- 10.20.193.28:0/3527558349 shutdown_connections 2026-02-20T03:19:44.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.561+0000 7fa794c68e00 1 -- 10.20.193.28:0/3527558349 wait complete. 2026-02-20T03:19:44.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.562+0000 7fa794c68e00 1 -- start start 2026-02-20T03:19:44.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.562+0000 7fa794c68e00 1 Processor -- start 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.562+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 0x556d17e41320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e41860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e46e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa794c68e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556d17d778f0 con 0x556d17e28630 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa794c68e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556d17b69f50 con 0x556d17e2e000 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa794c68e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556d17e47340 con 0x556d17e28fb0 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa78b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e41860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa78bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 0x556d17e41320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa78b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e41860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56022/0 (socket says 10.20.193.28:56022) 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa78b7fe640 1 -- 10.20.193.28:0/3845414365 learned_addr learned my addr 10.20.193.28:0/3845414365 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa790cd9640 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e46e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa78b7fe640 1 -- 10.20.193.28:0/3845414365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 msgr2=0x556d17e46e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa78b7fe640 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e46e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa78b7fe640 1 -- 10.20.193.28:0/3845414365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 msgr2=0x556d17e41320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa78b7fe640 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 0x556d17e41320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.563+0000 7fa78b7fe640 1 -- 10.20.193.28:0/3845414365 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d17e3aad0 con 0x556d17e28fb0 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa78b7fe640 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e41860 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0a5c90 tx=0x7fa77c002ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb659d1f0aca0b8e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa74dffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa74dffb640 1 -- 10.20.193.28:0/3845414365 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0b94d0 con 0x556d17e28fb0 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa74dffb640 1 -- 10.20.193.28:0/3845414365 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa77c0ad020 con 0x556d17e28fb0 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa74dffb640 1 -- 10.20.193.28:0/3845414365 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0af520 con 0x556d17e28fb0 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa794c68e00 1 -- 10.20.193.28:0/3845414365 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d17b4cb40 con 0x556d17e28fb0 2026-02-20T03:19:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa74dffb640 1 -- 10.20.193.28:0/3845414365 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa77c0cf210 con 0x556d17e28fb0 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa794c68e00 10 client.26179 _ll_register_callbacks cb 0x556d17db4f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa794c68e00 1 -- 10.20.193.28:0/3845414365 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556d17d891a0 con 0x556d17e28fb0 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.564+0000 7fa74dffb640 1 -- 10.20.193.28:0/3845414365 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa77c0cf070 con 0x556d17e28fb0 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.565+0000 7fa794c68e00 10 client.26179 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.565+0000 7fa794c68e00 1 -- 10.20.193.28:0/3845414365 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556d17d36230 con 0x556d17e28fb0 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.565+0000 7fa74dffb640 1 -- 10.20.193.28:0/3845414365 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fa77c0b1a40 con 0x556d17e28fb0 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.565+0000 7fa794c68e00 10 client.26179 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.565+0000 7fa794c68e00 10 client.26179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.565+0000 7fa794c68e00 20 client.26179 populate_metadata read hostname 'trial028' 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.565+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556d17e51260 0x556d17e53720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.565+0000 7fa794c68e00 4 client.26179 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:44.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.565+0000 7fa794c68e00 1 -- 10.20.193.28:0/3845414365 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d17d835b0 con 0x556d17e51260 2026-02-20T03:19:44.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.566+0000 7fa78bfff640 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556d17e51260 0x556d17e53720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.566+0000 7fa78bfff640 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556d17e51260 0x556d17e53720 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e037635ea7dfccf1 server_cookie=df99aa3b448b1d8c in_seq=0 out_seq=0 2026-02-20T03:19:44.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.566+0000 7fa74dffb640 10 client.26179 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:44.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.567+0000 7fa74dffb640 1 -- 10.20.193.28:0/3845414365 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556d17d835b0 con 0x556d17e51260 2026-02-20T03:19:44.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.567+0000 7fa74dffb640 10 client.26179 handle_command_reply: tid=0 2026-02-20T03:19:44.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.567+0000 7fa794c68e00 1 client.26179 shutdown 2026-02-20T03:19:44.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.567+0000 7fa794c68e00 1 -- 10.20.193.28:0/3845414365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 msgr2=0x556d17e41860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.567+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e41860 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0a5c90 tx=0x7fa77c002ac0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.568+0000 7fa794c68e00 1 -- 10.20.193.28:0/3845414365 shutdown_connections 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.568+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556d17e51260 0x556d17e53720 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.568+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e2e000 0x556d17e46e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.568+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e41860 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.568+0000 7fa794c68e00 1 --2- 10.20.193.28:0/3845414365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e28630 0x556d17e41320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.568+0000 7fa794c68e00 1 -- 10.20.193.28:0/3845414365 >> 10.20.193.28:0/3845414365 conn(0x556d17deb290 msgr2=0x556d17e27440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.568+0000 7fa74dffb640 0 client.26179 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.568+0000 7fa794c68e00 1 -- 10.20.193.28:0/3845414365 shutdown_connections 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.569+0000 7fa794c68e00 1 -- 10.20.193.28:0/3845414365 wait complete. 2026-02-20T03:19:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.569+0000 7fa794c68e00 20 client.26179 trim_cache size 0 max 16384 2026-02-20T03:19:44.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa794c68e00 1 Processor -- start 2026-02-20T03:19:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa794c68e00 1 -- start start 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28630 0x556d17e27520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e27a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e59080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa794c68e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa730012620 con 0x556d17e2e000 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa794c68e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa73000fec0 con 0x556d17e28630 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa794c68e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa73000dd10 con 0x556d17e28fb0 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa790cd9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e59080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa78b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e27a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa78bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28630 0x556d17e27520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa790cd9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e59080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45652/0 (socket says 10.20.193.28:45652) 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.578+0000 7fa790cd9640 1 -- 10.20.193.28:0/417452629 learned_addr learned my addr 10.20.193.28:0/417452629 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.579+0000 7fa790cd9640 1 -- 10.20.193.28:0/417452629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 msgr2=0x556d17e27a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.579+0000 7fa790cd9640 1 --2- 10.20.193.28:0/417452629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e27a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.579+0000 7fa790cd9640 1 -- 10.20.193.28:0/417452629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28630 msgr2=0x556d17e27520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.579+0000 7fa790cd9640 1 --2- 10.20.193.28:0/417452629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28630 0x556d17e27520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.579+0000 7fa790cd9640 1 -- 10.20.193.28:0/417452629 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d17e3a900 con 0x556d17e2e000 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.579+0000 7fa790cd9640 1 --2- 10.20.193.28:0/417452629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e59080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa7800090c0 tx=0x7fa7800092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5729a60c8203c51e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.579+0000 7fa74ffff640 1 -- 10.20.193.28:0/417452629 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780019040 con 0x556d17e2e000 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.579+0000 7fa74ffff640 1 -- 10.20.193.28:0/417452629 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa78000ee10 con 0x556d17e2e000 2026-02-20T03:19:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.579+0000 7fa74ffff640 1 -- 10.20.193.28:0/417452629 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780015450 con 0x556d17e2e000 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 -- 10.20.193.28:0/417452629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 msgr2=0x556d17e59080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 --2- 10.20.193.28:0/417452629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e59080 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa7800090c0 tx=0x7fa7800092f0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 -- 10.20.193.28:0/417452629 shutdown_connections 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 --2- 10.20.193.28:0/417452629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e59080 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 --2- 10.20.193.28:0/417452629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28fb0 0x556d17e27a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 --2- 10.20.193.28:0/417452629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28630 0x556d17e27520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 -- 10.20.193.28:0/417452629 >> 10.20.193.28:0/417452629 conn(0x556d17deb290 msgr2=0x556d17e40220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 -- 10.20.193.28:0/417452629 shutdown_connections 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 -- 10.20.193.28:0/417452629 wait complete. 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.580+0000 7fa794c68e00 1 -- start start 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa794c68e00 1 Processor -- start 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28630 0x556d17e4a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28fb0 0x556d17e4aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa794c68e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e4d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa794c68e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa73000e380 con 0x556d17e2e000 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa794c68e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa73000f7f0 con 0x556d17e28fb0 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa794c68e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa73000ea50 con 0x556d17e28630 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa790cd9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e4d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa78bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28630 0x556d17e4a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa790cd9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e4d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45662/0 (socket says 10.20.193.28:45662) 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa790cd9640 1 -- 10.20.193.28:0/1509845804 learned_addr learned my addr 10.20.193.28:0/1509845804 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa78b7fe640 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28fb0 0x556d17e4aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa790cd9640 1 -- 10.20.193.28:0/1509845804 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28630 msgr2=0x556d17e4a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa790cd9640 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28630 0x556d17e4a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa790cd9640 1 -- 10.20.193.28:0/1509845804 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28fb0 msgr2=0x556d17e4aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa790cd9640 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28fb0 0x556d17e4aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa790cd9640 1 -- 10.20.193.28:0/1509845804 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d17a5a870 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.581+0000 7fa78bfff640 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28630 0x556d17e4a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa790cd9640 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e4d030 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa780009010 tx=0x7fa780009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5edb9187c95986 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa74dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa74dffb640 1 -- 10.20.193.28:0/1509845804 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78002d070 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa74dffb640 1 -- 10.20.193.28:0/1509845804 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa780004a10 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa74dffb640 1 -- 10.20.193.28:0/1509845804 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa780019040 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa794c68e00 1 -- 10.20.193.28:0/1509845804 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d17d1b440 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa794c68e00 10 client.16533 _ll_register_callbacks cb 0x7fa77c002b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa794c68e00 1 -- 10.20.193.28:0/1509845804 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556d17d4c810 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa74dffb640 1 -- 10.20.193.28:0/1509845804 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa780015570 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa74dffb640 1 -- 10.20.193.28:0/1509845804 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa780015e20 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa794c68e00 10 client.16533 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.582+0000 7fa794c68e00 1 -- 10.20.193.28:0/1509845804 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x556d17e3b5f0 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa74dffb640 1 -- 10.20.193.28:0/1509845804 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fa780025020 con 0x556d17e2e000 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa794c68e00 10 client.16533 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa794c68e00 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa794c68e00 20 client.16533 populate_metadata read hostname 'trial028' 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa794c68e00 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556d17ebdb90 0x556d17ec0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa794c68e00 4 client.16533 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa794c68e00 1 -- 10.20.193.28:0/1509845804 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556d17d2db00 con 0x556d17ebdb90 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa78bfff640 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556d17ebdb90 0x556d17ec0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa78bfff640 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556d17ebdb90 0x556d17ec0020 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b58edb349579c08 server_cookie=14b4420039e1ac89 in_seq=0 out_seq=0 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.583+0000 7fa74dffb640 10 client.16533 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa74dffb640 1 -- 10.20.193.28:0/1509845804 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556d17d2db00 con 0x556d17ebdb90 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa74dffb640 10 client.16533 handle_command_reply: tid=0 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 client.16533 shutdown 2026-02-20T03:19:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 -- 10.20.193.28:0/1509845804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 msgr2=0x556d17e4d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e4d030 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa780009010 tx=0x7fa780009040 comp rx=0 tx=0).stop 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 -- 10.20.193.28:0/1509845804 shutdown_connections 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556d17ebdb90 0x556d17ec0020 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556d17e2e000 0x556d17e4d030 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556d17e28fb0 0x556d17e4aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 --2- 10.20.193.28:0/1509845804 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556d17e28630 0x556d17e4a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa74dffb640 0 client.16533 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 -- 10.20.193.28:0/1509845804 >> 10.20.193.28:0/1509845804 conn(0x556d17deb290 msgr2=0x556d17e51690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 -- 10.20.193.28:0/1509845804 shutdown_connections 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 1 -- 10.20.193.28:0/1509845804 wait complete. 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa794c68e00 20 client.16533 trim_cache size 0 max 16384 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:19:44.589 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.584+0000 7fa7914da640 1 -- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7600b0e20 msgr2=0x7fa7600b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7600b0e20 0x7fa7600b32e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa7780059c0 tx=0x7fa778005950 comp rx=0 tx=0).stop 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 -- 10.20.193.28:0/3242870750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa78c077f40 msgr2=0x7fa78c1a1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa78c077f40 0x7fa78c1a1ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00ea30 tx=0x7fa77c00ef00 comp rx=0 tx=0).stop 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 -- 10.20.193.28:0/3242870750 shutdown_connections 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7600b0e20 0x7fa7600b32e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa78c113820 0x7fa78c1a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa78c077f40 0x7fa78c1a1ac0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 --2- 10.20.193.28:0/3242870750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa78c077620 0x7fa78c1a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 -- 10.20.193.28:0/3242870750 >> 10.20.193.28:0/3242870750 conn(0x7fa78c100680 msgr2=0x7fa78c113ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 -- 10.20.193.28:0/3242870750 shutdown_connections 2026-02-20T03:19:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:44.585+0000 7fa7914da640 1 -- 10.20.193.28:0/3242870750 wait complete. 2026-02-20T03:19:44.687 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:19:44.687 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:19:44.952 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:45.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.150+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/4207873697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f94109220 msgr2=0x7f0f94109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.150+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/4207873697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f94109220 0x7f0f94109680 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009a30 tx=0x7f0f8402f220 comp rx=0 tx=0).stop 2026-02-20T03:19:45.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.150+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/4207873697 shutdown_connections 2026-02-20T03:19:45.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.150+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/4207873697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f94109bc0 0x7f0f94115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.150+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/4207873697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f94109220 0x7f0f94109680 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.150+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/4207873697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f9410f1e0 0x7f0f9410f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.150+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/4207873697 >> 10.20.193.28:0/4207873697 conn(0x7f0f94078860 msgr2=0x7f0f9407ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.150+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/4207873697 shutdown_connections 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.150+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/4207873697 wait complete. 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f9a7c3640 1 Processor -- start 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f9a7c3640 1 -- start start 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f9a7c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f94109220 0x7f0f941a7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f9a7c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f94109bc0 0x7f0f941a7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f9a7c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f9410f1e0 0x7f0f941a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f9a7c3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0f941192f0 con 0x7f0f9410f1e0 2026-02-20T03:19:45.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f9a7c3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0f94119170 con 0x7f0f94109220 2026-02-20T03:19:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f9a7c3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0f94119470 con 0x7f0f94109bc0 2026-02-20T03:19:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f93fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f94109220 0x7f0f941a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f93fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f94109220 0x7f0f941a7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54404/0 (socket says 10.20.193.28:54404) 2026-02-20T03:19:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f93fff640 1 -- 10.20.193.28:0/1047983770 learned_addr learned my addr 10.20.193.28:0/1047983770 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f937fe640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f94109bc0 0x7f0f941a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.151+0000 7f0f98d39640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f9410f1e0 0x7f0f941a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f937fe640 1 -- 10.20.193.28:0/1047983770 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f94109220 msgr2=0x7f0f941a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f937fe640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f94109220 0x7f0f941a7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f937fe640 1 -- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f9410f1e0 msgr2=0x7f0f941a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f937fe640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f9410f1e0 0x7f0f941a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f937fe640 1 -- 10.20.193.28:0/1047983770 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f941a1dd0 con 0x7f0f94109bc0 2026-02-20T03:19:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f937fe640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f94109bc0 0x7f0f941a7980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009950 tx=0x7f0f840043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f917fa640 1 -- 10.20.193.28:0/1047983770 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84004540 con 0x7f0f94109bc0 2026-02-20T03:19:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f941a2060 con 0x7f0f94109bc0 2026-02-20T03:19:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f917fa640 1 -- 10.20.193.28:0/1047983770 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0f84038e20 con 0x7f0f94109bc0 2026-02-20T03:19:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f917fa640 1 -- 10.20.193.28:0/1047983770 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84041620 con 0x7f0f94109bc0 2026-02-20T03:19:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.152+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f941ae310 con 0x7f0f94109bc0 2026-02-20T03:19:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.153+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f94109680 con 0x7f0f94109bc0 2026-02-20T03:19:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.155+0000 7f0f917fa640 1 -- 10.20.193.28:0/1047983770 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0f84002a00 con 0x7f0f94109bc0 2026-02-20T03:19:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.157+0000 7f0f917fa640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0f680b0e20 0x7f0f680b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.157+0000 7f0f917fa640 1 -- 10.20.193.28:0/1047983770 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f0f841052d0 con 0x7f0f94109bc0 2026-02-20T03:19:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.157+0000 7f0f93fff640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0f680b0e20 0x7f0f680b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.157+0000 7f0f917fa640 1 -- 10.20.193.28:0/1047983770 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0f84105750 con 0x7f0f94109bc0 2026-02-20T03:19:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.158+0000 7f0f93fff640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0f680b0e20 0x7f0f680b32e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009d90 tx=0x7f0f80009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:45.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.265+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f941a2b30 con 0x7f0f94109bc0 2026-02-20T03:19:45.268 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:45 trial028 ceph-mon[38552]: pgmap v333: 129 pgs: 129 active+clean; 74 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 874 KiB/s rd, 2.3 MiB/s wr, 154 op/s 2026-02-20T03:19:45.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.266+0000 7f0f917fa640 1 -- 10.20.193.28:0/1047983770 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11922 (secure 0 0 0) 0x7f0f941a2b30 con 0x7f0f94109bc0 2026-02-20T03:19:45.268 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:19:45.268 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T03:19:45.268 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T03:19:18:240749+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:19:17.378192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:19:45.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0f680b0e20 msgr2=0x7f0f680b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0f680b0e20 0x7f0f680b32e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009d90 tx=0x7f0f80009290 comp rx=0 tx=0).stop 2026-02-20T03:19:45.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f94109bc0 msgr2=0x7f0f941a7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f94109bc0 0x7f0f941a7980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009950 tx=0x7f0f840043d0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 shutdown_connections 2026-02-20T03:19:45.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0f680b0e20 0x7f0f680b32e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f9410f1e0 0x7f0f941a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f94109bc0 0x7f0f941a7980 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 --2- 10.20.193.28:0/1047983770 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f94109220 0x7f0f941a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 >> 10.20.193.28:0/1047983770 conn(0x7f0f94078860 msgr2=0x7f0f9407a270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:45.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 shutdown_connections 2026-02-20T03:19:45.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.267+0000 7f0f9a7c3640 1 -- 10.20.193.28:0/1047983770 wait complete. 2026-02-20T03:19:45.407 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:19:45.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:45 trial177 ceph-mon[43181]: pgmap v333: 129 pgs: 129 active+clean; 74 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 874 KiB/s rd, 2.3 MiB/s wr, 154 op/s 2026-02-20T03:19:45.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 5.41 MB/sec execute 78 sec latency 2262.918 ms 2026-02-20T03:19:45.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:45 trial126 ceph-mon[38476]: pgmap v333: 129 pgs: 129 active+clean; 74 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 874 KiB/s rd, 2.3 MiB/s wr, 154 op/s 2026-02-20T03:19:45.672 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.844+0000 7f5ea4503640 1 -- 10.20.193.28:0/1562053136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c109ed0 msgr2=0x7f5e9c111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.844+0000 7f5ea4503640 1 --2- 10.20.193.28:0/1562053136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c109ed0 0x7f5e9c111a50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800b0a0 tx=0x7f5e9802f410 comp rx=0 tx=0).stop 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.845+0000 7f5ea4503640 1 -- 10.20.193.28:0/1562053136 shutdown_connections 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.845+0000 7f5ea4503640 1 --2- 10.20.193.28:0/1562053136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c109ed0 0x7f5e9c111a50 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.845+0000 7f5ea4503640 1 --2- 10.20.193.28:0/1562053136 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e9c105750 0x7f5e9c1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.845+0000 7f5ea4503640 1 --2- 10.20.193.28:0/1562053136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e9c104da0 0x7f5e9c105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.845+0000 7f5ea4503640 1 -- 10.20.193.28:0/1562053136 >> 10.20.193.28:0/1562053136 conn(0x7f5e9c100840 msgr2=0x7f5e9c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.845+0000 7f5ea4503640 1 -- 10.20.193.28:0/1562053136 shutdown_connections 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.845+0000 7f5ea4503640 1 -- 10.20.193.28:0/1562053136 wait complete. 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea4503640 1 Processor -- start 2026-02-20T03:19:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea4503640 1 -- start start 2026-02-20T03:19:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea4503640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e9c104da0 0x7f5e9c19d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea4503640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c105750 0x7f5e9c19d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea4503640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e9c109ed0 0x7f5e9c1a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea4503640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c114da0 con 0x7f5e9c105750 2026-02-20T03:19:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea4503640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c114c20 con 0x7f5e9c104da0 2026-02-20T03:19:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea4503640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c114f20 con 0x7f5e9c109ed0 2026-02-20T03:19:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea1a77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c105750 0x7f5e9c19d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea1a77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c105750 0x7f5e9c19d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45698/0 (socket says 10.20.193.28:45698) 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea1a77640 1 -- 10.20.193.28:0/3964740339 learned_addr learned my addr 10.20.193.28:0/3964740339 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea2278640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e9c104da0 0x7f5e9c19d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.846+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e9c109ed0 0x7f5e9c1a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5ea1a77640 1 -- 10.20.193.28:0/3964740339 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e9c109ed0 msgr2=0x7f5e9c1a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e9c109ed0 0x7f5e9c1a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5ea1a77640 1 -- 10.20.193.28:0/3964740339 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e9c104da0 msgr2=0x7f5e9c19d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e9c104da0 0x7f5e9c19d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5ea1a77640 1 -- 10.20.193.28:0/3964740339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c1a2250 con 0x7f5e9c105750 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c105750 0x7f5e9c19d740 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000d980 tx=0x7f5e9000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5e837fe640 1 -- 10.20.193.28:0/3964740339 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90014070 con 0x7f5e9c105750 2026-02-20T03:19:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5e837fe640 1 -- 10.20.193.28:0/3964740339 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e900044e0 con 0x7f5e9c105750 2026-02-20T03:19:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5e837fe640 1 -- 10.20.193.28:0/3964740339 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90005040 con 0x7f5e9c105750 2026-02-20T03:19:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5ea4503640 1 -- 10.20.193.28:0/3964740339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9c1a2540 con 0x7f5e9c105750 2026-02-20T03:19:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.847+0000 7f5ea4503640 1 -- 10.20.193.28:0/3964740339 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9c1a9d80 con 0x7f5e9c105750 2026-02-20T03:19:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.850+0000 7f5ea6a08e00 1 Processor -- start 2026-02-20T03:19:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.850+0000 7f5e837fe640 1 -- 10.20.193.28:0/3964740339 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5e900047c0 con 0x7f5e9c105750 2026-02-20T03:19:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.850+0000 7f5ea6a08e00 1 -- start start 2026-02-20T03:19:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.850+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d1853d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.850+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d1859a0 0x56379d1893b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.850+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 0x56379d191660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.850+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56379d0fce00 con 0x56379d184ff0 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.850+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56379d0cf970 con 0x56379d189ae0 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.850+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56379d07d1f0 con 0x56379d1859a0 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea2278640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d1859a0 0x56379d1893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea2a79640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d1853d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea1a77640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 0x56379d191660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea2278640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d1859a0 0x56379d1893b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56076/0 (socket says 10.20.193.28:56076) 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea2278640 1 -- 10.20.193.28:0/1455624674 learned_addr learned my addr 10.20.193.28:0/1455624674 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea2a79640 1 -- 10.20.193.28:0/1455624674 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d1859a0 msgr2=0x56379d1893b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/1455624674 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d1859a0 0x56379d1893b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea2a79640 1 -- 10.20.193.28:0/1455624674 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 msgr2=0x56379d191660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/1455624674 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 0x56379d191660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.851+0000 7f5ea2a79640 1 -- 10.20.193.28:0/1455624674 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379d0903d0 con 0x56379d184ff0 2026-02-20T03:19:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/1455624674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d1853d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5e9802f920 tx=0x7f5e9800afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e793ec35a2c9d1c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5e80a08640 1 -- 10.20.193.28:0/1455624674 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e980040c0 con 0x56379d184ff0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5e80a08640 1 -- 10.20.193.28:0/1455624674 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e98033050 con 0x56379d184ff0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5e80a08640 1 -- 10.20.193.28:0/1455624674 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e98004710 con 0x56379d184ff0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/1455624674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 msgr2=0x56379d1853d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/1455624674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d1853d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5e9802f920 tx=0x7f5e9800afe0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/1455624674 shutdown_connections 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/1455624674 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 0x56379d191660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/1455624674 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d1859a0 0x56379d1893b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/1455624674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d1853d0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/1455624674 >> 10.20.193.28:0/1455624674 conn(0x56379d13f240 msgr2=0x56379d17ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5e837fe640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e780b0e20 0x7f5e780b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/1455624674 shutdown_connections 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5e837fe640 1 -- 10.20.193.28:0/3964740339 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5e900e0880 con 0x7f5e9c105750 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.852+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/1455624674 wait complete. 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.853+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e780b0e20 0x7f5e780b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.853+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e780b0e20 0x7f5e780b32e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e98004010 tx=0x7f5e980099e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea6a08e00 1 -- start start 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea6a08e00 1 Processor -- start 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d19f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 0x56379d19f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d189ae0 0x56379d19db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56379d0cb8a0 con 0x56379d189ae0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56379cebdf50 con 0x56379d1859a0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56379d19e2b0 con 0x56379d184ff0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea2278640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d19f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea2278640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d19f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56088/0 (socket says 10.20.193.28:56088) 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea2278640 1 -- 10.20.193.28:0/2655915412 learned_addr learned my addr 10.20.193.28:0/2655915412 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 0x56379d19f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.854+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d189ae0 0x56379d19db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5ea2278640 1 -- 10.20.193.28:0/2655915412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 msgr2=0x56379d19f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5ea2278640 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 0x56379d19f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5ea2278640 1 -- 10.20.193.28:0/2655915412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d189ae0 msgr2=0x56379d19db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5ea2278640 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d189ae0 0x56379d19db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5ea2278640 1 -- 10.20.193.28:0/2655915412 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379d197300 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d189ae0 0x56379d19db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5ea2278640 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d19f3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c002c20 tx=0x7f5e8c012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42b4ef4bdec21958 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5e4ffff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5e4ffff640 1 -- 10.20.193.28:0/2655915412 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c01a630 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5e4ffff640 1 -- 10.20.193.28:0/2655915412 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e8c01ac70 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5e4ffff640 1 -- 10.20.193.28:0/2655915412 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00fcc0 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.855+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2655915412 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379cea0b40 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5e4ffff640 1 -- 10.20.193.28:0/2655915412 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5e8c0103d0 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 10 client.26203 _ll_register_callbacks cb 0x56379d108eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2655915412 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56379d0dd150 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5e4ffff640 1 -- 10.20.193.28:0/2655915412 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e8c01ae20 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 10 client.26203 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2655915412 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56379d08a1e0 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5e4ffff640 1 -- 10.20.193.28:0/2655915412 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f5e8c00f3d0 con 0x56379d184ff0 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 10 client.26203 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 10 client.26203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 20 client.26203 populate_metadata read hostname 'trial028' 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56379d1adc10 0x56379d1b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 4 client.26203 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.856+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2655915412 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56379d0d7560 con 0x56379d1adc10 2026-02-20T03:19:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.857+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56379d1adc10 0x56379d1b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56379d1adc10 0x56379d1b00a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35cf9f684c974834 server_cookie=fec04797083b0fbe in_seq=0 out_seq=0 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5e4ffff640 10 client.26203 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5e4ffff640 1 -- 10.20.193.28:0/2655915412 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56379d0d7560 con 0x56379d1adc10 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5e4ffff640 10 client.26203 handle_command_reply: tid=0 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea6a08e00 1 client.26203 shutdown 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2655915412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 msgr2=0x56379d19f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d19f3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c002c20 tx=0x7f5e8c012820 comp rx=0 tx=0).stop 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2655915412 shutdown_connections 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56379d1adc10 0x56379d1b00a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d189ae0 0x56379d19db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 0x56379d19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2655915412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d19f3f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2655915412 >> 10.20.193.28:0/2655915412 conn(0x56379d13f240 msgr2=0x56379d188300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:45.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.858+0000 7f5e4ffff640 0 client.26203 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:19:45.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.859+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2655915412 shutdown_connections 2026-02-20T03:19:45.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.859+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2655915412 wait complete. 2026-02-20T03:19:45.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.859+0000 7f5ea6a08e00 20 client.26203 trim_cache size 0 max 16384 2026-02-20T03:19:45.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.865+0000 7f5ea6a08e00 1 Processor -- start 2026-02-20T03:19:45.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.865+0000 7f5ea6a08e00 1 -- start start 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d174d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 0x56379d19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d189ae0 0x56379d19b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e44012720 con 0x56379d184ff0 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4400ffc0 con 0x56379d1859a0 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4400de10 con 0x56379d189ae0 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2278640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d174d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2278640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d174d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45724/0 (socket says 10.20.193.28:45724) 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2278640 1 -- 10.20.193.28:0/2208772638 learned_addr learned my addr 10.20.193.28:0/2208772638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/2208772638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 0x56379d19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/2208772638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d189ae0 0x56379d19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2278640 1 -- 10.20.193.28:0/2208772638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d189ae0 msgr2=0x56379d19b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2278640 1 --2- 10.20.193.28:0/2208772638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d189ae0 0x56379d19b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2278640 1 -- 10.20.193.28:0/2208772638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 msgr2=0x56379d19b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2278640 1 --2- 10.20.193.28:0/2208772638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 0x56379d19b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2278640 1 -- 10.20.193.28:0/2208772638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379d197130 con 0x56379d184ff0 2026-02-20T03:19:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.866+0000 7f5ea2278640 1 --2- 10.20.193.28:0/2208772638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d174d00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c012db0 tx=0x7f5e8c004020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928b9611ca26f911 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5e6a4e6640 1 -- 10.20.193.28:0/2208772638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c032070 con 0x56379d184ff0 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5e6a4e6640 1 -- 10.20.193.28:0/2208772638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56379d0dd150 con 0x56379d184ff0 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5e6a4e6640 1 -- 10.20.193.28:0/2208772638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0052d0 con 0x56379d184ff0 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2208772638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 msgr2=0x56379d174d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2208772638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d174d00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c012db0 tx=0x7f5e8c004020 comp rx=0 tx=0).stop 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2208772638 shutdown_connections 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2208772638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d189ae0 0x56379d19b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2208772638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d1859a0 0x56379d19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/2208772638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d184ff0 0x56379d174d00 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2208772638 >> 10.20.193.28:0/2208772638 conn(0x56379d13f240 msgr2=0x56379d19ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2208772638 shutdown_connections 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.867+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/2208772638 wait complete. 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea6a08e00 1 -- start start 2026-02-20T03:19:45.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea6a08e00 1 Processor -- start 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d1a22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d1859a0 0x56379d1a2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea6a08e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 0x56379d1a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4400e480 con 0x56379d1859a0 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4400f8f0 con 0x56379d189ae0 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea6a08e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4400eb50 con 0x56379d184ff0 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea1a77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d1859a0 0x56379d1a2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea1a77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d1859a0 0x56379d1a2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45732/0 (socket says 10.20.193.28:45732) 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea1a77640 1 -- 10.20.193.28:0/3716125506 learned_addr learned my addr 10.20.193.28:0/3716125506 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea2278640 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d1a22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.868+0000 7f5ea2a79640 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 0x56379d1a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5ea1a77640 1 -- 10.20.193.28:0/3716125506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 msgr2=0x56379d1a22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d1a22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5ea1a77640 1 -- 10.20.193.28:0/3716125506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 msgr2=0x56379d1a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 0x56379d1a2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5ea1a77640 1 -- 10.20.193.28:0/3716125506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379cdae870 con 0x56379d1859a0 2026-02-20T03:19:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5ea1a77640 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d1859a0 0x56379d1a2830 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5e900a55e0 tx=0x7f5e900e0c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa35adfb2b8e7756 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:45.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5e4ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5e4ffff640 1 -- 10.20.193.28:0/3716125506 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9001d040 con 0x56379d1859a0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5e4ffff640 1 -- 10.20.193.28:0/3716125506 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e900a8cc0 con 0x56379d1859a0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5e4ffff640 1 -- 10.20.193.28:0/3716125506 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e900b15f0 con 0x56379d1859a0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.869+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/3716125506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56379d06f3f0 con 0x56379d1859a0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 10 client.16557 _ll_register_callbacks cb 0x7f5e8c004550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5e4ffff640 1 -- 10.20.193.28:0/3716125506 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5e900adb00 con 0x56379d1859a0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/3716125506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56379d081ab0 con 0x56379d1859a0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5e4ffff640 1 -- 10.20.193.28:0/3716125506 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5e900b1820 con 0x56379d1859a0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 10 client.16557 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/3716125506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56379d197e20 con 0x56379d1859a0 2026-02-20T03:19:45.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5e4ffff640 1 -- 10.20.193.28:0/3716125506 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f5e900a75d0 con 0x56379d1859a0 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 10 client.16557 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 10 client.16557 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 20 client.16557 populate_metadata read hostname 'trial028' 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56379d17d8a0 0x56379d17fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 4 client.16557 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/3716125506 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56379d0dd150 con 0x56379d17d8a0 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.870+0000 7f5ea2278640 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56379d17d8a0 0x56379d17fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5ea2278640 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56379d17d8a0 0x56379d17fd60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=715c28ab6d754099 server_cookie=f2d2f4ada4334ddd in_seq=0 out_seq=0 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5e4ffff640 10 client.16557 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5e4ffff640 1 -- 10.20.193.28:0/3716125506 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56379d0dd150 con 0x56379d17d8a0 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5e4ffff640 10 client.16557 handle_command_reply: tid=0 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5ea6a08e00 1 client.16557 shutdown 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/3716125506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d1859a0 msgr2=0x56379d1a2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d1859a0 0x56379d1a2830 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5e900a55e0 tx=0x7f5e900e0c50 comp rx=0 tx=0).stop 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/3716125506 shutdown_connections 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56379d189ae0 0x56379d1a2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.871+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56379d17d8a0 0x56379d17fd60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56379d1859a0 0x56379d1a2830 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea6a08e00 1 --2- 10.20.193.28:0/3716125506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56379d184ff0 0x56379d1a22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/3716125506 >> 10.20.193.28:0/3716125506 conn(0x56379d13f240 msgr2=0x56379d19c260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:45.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5e4ffff640 0 client.16557 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:19:45.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/3716125506 shutdown_connections 2026-02-20T03:19:45.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea6a08e00 1 -- 10.20.193.28:0/3716125506 wait complete. 2026-02-20T03:19:45.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea6a08e00 20 client.16557 trim_cache size 0 max 16384 2026-02-20T03:19:45.877 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:19:45.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 -- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e780b0e20 msgr2=0x7f5e780b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e780b0e20 0x7f5e780b32e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e98004010 tx=0x7f5e980099e0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 -- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c105750 msgr2=0x7f5e9c19d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c105750 0x7f5e9c19d740 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000d980 tx=0x7f5e9000de50 comp rx=0 tx=0).stop 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 -- 10.20.193.28:0/3964740339 shutdown_connections 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e780b0e20 0x7f5e780b32e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e9c109ed0 0x7f5e9c1a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e9c105750 0x7f5e9c19d740 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 --2- 10.20.193.28:0/3964740339 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e9c104da0 0x7f5e9c19d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 -- 10.20.193.28:0/3964740339 >> 10.20.193.28:0/3964740339 conn(0x7f5e9c100840 msgr2=0x7f5e9c101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 -- 10.20.193.28:0/3964740339 shutdown_connections 2026-02-20T03:19:45.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:45.872+0000 7f5ea4503640 1 -- 10.20.193.28:0/3964740339 wait complete. 2026-02-20T03:19:45.975 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:19:46.236 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:46.280 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:46 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1047983770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.415+0000 7f0059fd1640 1 -- 10.20.193.28:0/310502232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0054075950 msgr2=0x7f0054075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.415+0000 7f0059fd1640 1 --2- 10.20.193.28:0/310502232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0054075950 0x7f0054075d90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f003c009a30 tx=0x7f003c02f2b0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.415+0000 7f0059fd1640 1 -- 10.20.193.28:0/310502232 shutdown_connections 2026-02-20T03:19:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.415+0000 7f0059fd1640 1 --2- 10.20.193.28:0/310502232 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00541134d0 0x7f0054115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.415+0000 7f0059fd1640 1 --2- 10.20.193.28:0/310502232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0054075950 0x7f0054075d90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.415+0000 7f0059fd1640 1 --2- 10.20.193.28:0/310502232 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00541065d0 0x7f0054075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.415+0000 7f0059fd1640 1 -- 10.20.193.28:0/310502232 >> 10.20.193.28:0/310502232 conn(0x7f00540fe440 msgr2=0x7f0054100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.415+0000 7f0059fd1640 1 -- 10.20.193.28:0/310502232 shutdown_connections 2026-02-20T03:19:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.415+0000 7f0059fd1640 1 -- 10.20.193.28:0/310502232 wait complete. 2026-02-20T03:19:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.416+0000 7f0059fd1640 1 Processor -- start 2026-02-20T03:19:46.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.416+0000 7f0059fd1640 1 -- start start 2026-02-20T03:19:46.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0059fd1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0054075950 0x7f00541a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0059fd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00541065d0 0x7f00541a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0059fd1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00541134d0 0x7f00541a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0059fd1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f00541190a0 con 0x7f00541065d0 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0059fd1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0054118f20 con 0x7f0054075950 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0059fd1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0054119220 con 0x7f00541134d0 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f004bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00541065d0 0x7f00541a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f004bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00541065d0 0x7f00541a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46580/0 (socket says 10.20.193.28:46580) 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f004bfff640 1 -- 10.20.193.28:0/1162704166 learned_addr learned my addr 10.20.193.28:0/1162704166 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f00597d0640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00541134d0 0x7f00541a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0058fcf640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0054075950 0x7f00541a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f004bfff640 1 -- 10.20.193.28:0/1162704166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00541134d0 msgr2=0x7f00541a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f004bfff640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00541134d0 0x7f00541a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f004bfff640 1 -- 10.20.193.28:0/1162704166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0054075950 msgr2=0x7f00541a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f004bfff640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0054075950 0x7f00541a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f004bfff640 1 -- 10.20.193.28:0/1162704166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00541a6450 con 0x7f00541065d0 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f004bfff640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00541065d0 0x7f00541a19e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f003c002fa0 tx=0x7f003c002a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0049ffb640 1 -- 10.20.193.28:0/1162704166 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c0043c0 con 0x7f00541065d0 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0049ffb640 1 -- 10.20.193.28:0/1162704166 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f003c004560 con 0x7f00541065d0 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0049ffb640 1 -- 10.20.193.28:0/1162704166 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c038470 con 0x7f00541065d0 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.417+0000 7f0059fd1640 1 -- 10.20.193.28:0/1162704166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00541a66e0 con 0x7f00541065d0 2026-02-20T03:19:46.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.418+0000 7f0059fd1640 1 -- 10.20.193.28:0/1162704166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00541a6b70 con 0x7f00541065d0 2026-02-20T03:19:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.420+0000 7f005d75fe00 1 Processor -- start 2026-02-20T03:19:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f0049ffb640 1 -- 10.20.193.28:0/1162704166 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f003c005030 con 0x7f00541065d0 2026-02-20T03:19:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f005d75fe00 1 -- start start 2026-02-20T03:19:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca37910390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 0x55ca3790aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca37916de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f005d75fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca3788ae00 con 0x55ca3790ffb0 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f005d75fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ca3785d970 con 0x55ca3790af60 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f005d75fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ca3780b1f0 con 0x55ca3790a5e0 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f00597d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca37910390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f00597d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca37910390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46596/0 (socket says 10.20.193.28:46596) 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f00597d0640 1 -- 10.20.193.28:0/462363386 learned_addr learned my addr 10.20.193.28:0/462363386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f0058fcf640 1 --2- 10.20.193.28:0/462363386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 0x55ca3790aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f00597d0640 1 -- 10.20.193.28:0/462363386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 msgr2=0x55ca3790aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f00597d0640 1 --2- 10.20.193.28:0/462363386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 0x55ca3790aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f00597d0640 1 -- 10.20.193.28:0/462363386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 msgr2=0x55ca37916de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f00597d0640 1 --2- 10.20.193.28:0/462363386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca37916de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.421+0000 7f00597d0640 1 -- 10.20.193.28:0/462363386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3781e3d0 con 0x55ca3790ffb0 2026-02-20T03:19:46.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f00597d0640 1 --2- 10.20.193.28:0/462363386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca37910390 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0050007f70 tx=0x7f005000e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42e30e9b865ae3f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f00214e4640 1 -- 10.20.193.28:0/462363386 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050019070 con 0x55ca3790ffb0 2026-02-20T03:19:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f00214e4640 1 -- 10.20.193.28:0/462363386 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f00500040d0 con 0x55ca3790ffb0 2026-02-20T03:19:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f00214e4640 1 -- 10.20.193.28:0/462363386 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00500147b0 con 0x55ca3790ffb0 2026-02-20T03:19:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f005d75fe00 1 -- 10.20.193.28:0/462363386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 msgr2=0x55ca37910390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f005d75fe00 1 --2- 10.20.193.28:0/462363386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca37910390 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0050007f70 tx=0x7f005000e600 comp rx=0 tx=0).stop 2026-02-20T03:19:46.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f005d75fe00 1 -- 10.20.193.28:0/462363386 shutdown_connections 2026-02-20T03:19:46.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f005d75fe00 1 --2- 10.20.193.28:0/462363386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca37916de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f005d75fe00 1 --2- 10.20.193.28:0/462363386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 0x55ca3790aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f005d75fe00 1 --2- 10.20.193.28:0/462363386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca37910390 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f005d75fe00 1 -- 10.20.193.28:0/462363386 >> 10.20.193.28:0/462363386 conn(0x55ca378cd240 msgr2=0x55ca37908ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:46.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f0049ffb640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00300b0e20 0x7f00300b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f0049ffb640 1 -- 10.20.193.28:0/1162704166 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f003c104c70 con 0x7f00541065d0 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.422+0000 7f005d75fe00 1 -- 10.20.193.28:0/462363386 shutdown_connections 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.423+0000 7f005d75fe00 1 -- 10.20.193.28:0/462363386 wait complete. 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.423+0000 7f00597d0640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00300b0e20 0x7f00300b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.423+0000 7f00597d0640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00300b0e20 0x7f00300b32e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0050004ad0 tx=0x7f00500048c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f005d75fe00 1 -- start start 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f005d75fe00 1 Processor -- start 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790a5e0 0x55ca37924f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790af60 0x55ca379254a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 0x55ca379236a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f005d75fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ca378598a0 con 0x55ca3790af60 2026-02-20T03:19:46.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f005d75fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ca3764bf50 con 0x55ca3790a5e0 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f005d75fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ca37923e20 con 0x55ca3790ffb0 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f004bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790af60 0x55ca379254a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f004bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790af60 0x55ca379254a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46600/0 (socket says 10.20.193.28:46600) 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f004bfff640 1 -- 10.20.193.28:0/3208579366 learned_addr learned my addr 10.20.193.28:0/3208579366 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.424+0000 7f00597d0640 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 0x55ca379236a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f0058fcf640 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790a5e0 0x55ca37924f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f004bfff640 1 -- 10.20.193.28:0/3208579366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 msgr2=0x55ca379236a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f004bfff640 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 0x55ca379236a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f004bfff640 1 -- 10.20.193.28:0/3208579366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790a5e0 msgr2=0x55ca37924f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f004bfff640 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790a5e0 0x55ca37924f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f004bfff640 1 -- 10.20.193.28:0/3208579366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3791cad0 con 0x55ca3790af60 2026-02-20T03:19:46.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f00597d0640 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 0x55ca379236a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f004bfff640 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790af60 0x55ca379254a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f003c0cc740 tx=0x7f003c0cc140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b373efde335f60e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f00127fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f00127fc640 1 -- 10.20.193.28:0/3208579366 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c048070 con 0x55ca3790af60 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f005d75fe00 1 -- 10.20.193.28:0/3208579366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3762eb40 con 0x55ca3790af60 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f00127fc640 1 -- 10.20.193.28:0/3208579366 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f003c033030 con 0x55ca3790af60 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f00127fc640 1 -- 10.20.193.28:0/3208579366 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003c0edb70 con 0x55ca3790af60 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f00127fc640 1 -- 10.20.193.28:0/3208579366 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f003c0edd10 con 0x55ca3790af60 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f005d75fe00 10 client.16569 _ll_register_callbacks cb 0x55ca37896eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f005d75fe00 1 -- 10.20.193.28:0/3208579366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca3786b150 con 0x55ca3790af60 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f00127fc640 1 -- 10.20.193.28:0/3208579366 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f003c0d0df0 con 0x55ca3790af60 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f005d75fe00 10 client.16569 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.425+0000 7f005d75fe00 1 -- 10.20.193.28:0/3208579366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ca378181e0 con 0x55ca3790af60 2026-02-20T03:19:46.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.426+0000 7f00127fc640 1 -- 10.20.193.28:0/3208579366 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f003c0d3090 con 0x55ca3790af60 2026-02-20T03:19:46.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.426+0000 7f005d75fe00 10 client.16569 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:46.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.426+0000 7f005d75fe00 10 client.16569 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:19:46.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.426+0000 7f005d75fe00 20 client.16569 populate_metadata read hostname 'trial028' 2026-02-20T03:19:46.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.426+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ca37933960 0x55ca37935e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.426+0000 7f005d75fe00 4 client.16569 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:46.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.426+0000 7f005d75fe00 1 -- 10.20.193.28:0/3208579366 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca37865560 con 0x55ca37933960 2026-02-20T03:19:46.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.426+0000 7f0058fcf640 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ca37933960 0x55ca37935e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.427+0000 7f0058fcf640 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ca37933960 0x55ca37935e20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a9f722951824f99a server_cookie=ff7683e37dc2df3 in_seq=0 out_seq=0 2026-02-20T03:19:46.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.427+0000 7f00127fc640 10 client.16569 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:19:46.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f00127fc640 1 -- 10.20.193.28:0/3208579366 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ca37865560 con 0x55ca37933960 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f00127fc640 10 client.16569 handle_command_reply: tid=0 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 client.16569 shutdown 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 -- 10.20.193.28:0/3208579366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790af60 msgr2=0x55ca379254a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790af60 0x55ca379254a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f003c0cc740 tx=0x7f003c0cc140 comp rx=0 tx=0).stop 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 -- 10.20.193.28:0/3208579366 shutdown_connections 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ca37933960 0x55ca37935e20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 0x55ca379236a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790af60 0x55ca379254a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3208579366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790a5e0 0x55ca37924f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 -- 10.20.193.28:0/3208579366 >> 10.20.193.28:0/3208579366 conn(0x55ca378cd240 msgr2=0x55ca379093f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:46.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f00127fc640 0 client.16569 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:19:46.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 -- 10.20.193.28:0/3208579366 shutdown_connections 2026-02-20T03:19:46.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.428+0000 7f005d75fe00 1 -- 10.20.193.28:0/3208579366 wait complete. 2026-02-20T03:19:46.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.429+0000 7f005d75fe00 20 client.16569 trim_cache size 0 max 16384 2026-02-20T03:19:46.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.435+0000 7f005d75fe00 1 Processor -- start 2026-02-20T03:19:46.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.435+0000 7f005d75fe00 1 -- start start 2026-02-20T03:19:46.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 0x55ca3793b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3793bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca3792f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f005d75fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efff8012670 con 0x55ca3790ffb0 2026-02-20T03:19:46.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f005d75fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efff800ff10 con 0x55ca3790af60 2026-02-20T03:19:46.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f005d75fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efff800dd60 con 0x55ca3790a5e0 2026-02-20T03:19:46.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f00597d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca3792f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f00597d0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca3792f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46604/0 (socket says 10.20.193.28:46604) 2026-02-20T03:19:46.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f00597d0640 1 -- 10.20.193.28:0/3366184000 learned_addr learned my addr 10.20.193.28:0/3366184000 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f004bfff640 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3793bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f0058fcf640 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 0x55ca3793b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f00597d0640 1 -- 10.20.193.28:0/3366184000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 msgr2=0x55ca3793b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f00597d0640 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 0x55ca3793b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f00597d0640 1 -- 10.20.193.28:0/3366184000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 msgr2=0x55ca3793bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f00597d0640 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3793bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f00597d0640 1 -- 10.20.193.28:0/3366184000 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3791c900 con 0x55ca3790ffb0 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f004bfff640 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3793bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.436+0000 7f00597d0640 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca3792f000 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0050010000 tx=0x7f005001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d65c55eb375dff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f0020ce3640 1 -- 10.20.193.28:0/3366184000 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005002d070 con 0x55ca3790ffb0 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f0020ce3640 1 -- 10.20.193.28:0/3366184000 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0050023070 con 0x55ca3790ffb0 2026-02-20T03:19:46.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f0020ce3640 1 -- 10.20.193.28:0/3366184000 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050019040 con 0x55ca3790ffb0 2026-02-20T03:19:46.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f005d75fe00 1 -- 10.20.193.28:0/3366184000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 msgr2=0x55ca3792f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca3792f000 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0050010000 tx=0x7f005001c000 comp rx=0 tx=0).stop 2026-02-20T03:19:46.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f005d75fe00 1 -- 10.20.193.28:0/3366184000 shutdown_connections 2026-02-20T03:19:46.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790ffb0 0x55ca3792f000 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3793bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f005d75fe00 1 --2- 10.20.193.28:0/3366184000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790a5e0 0x55ca3793b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f005d75fe00 1 -- 10.20.193.28:0/3366184000 >> 10.20.193.28:0/3366184000 conn(0x55ca378cd240 msgr2=0x55ca379226c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:46.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f005d75fe00 1 -- 10.20.193.28:0/3366184000 shutdown_connections 2026-02-20T03:19:46.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.437+0000 7f005d75fe00 1 -- 10.20.193.28:0/3366184000 wait complete. 2026-02-20T03:19:46.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.438+0000 7f005d75fe00 1 -- start start 2026-02-20T03:19:46.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.438+0000 7f005d75fe00 1 Processor -- start 2026-02-20T03:19:46.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.438+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790a5e0 0x55ca3792da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.438+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3792df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.438+0000 7f005d75fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 0x55ca37997950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.438+0000 7f005d75fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efff800e3d0 con 0x55ca3790a5e0 2026-02-20T03:19:46.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.438+0000 7f005d75fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efff800f840 con 0x55ca3790af60 2026-02-20T03:19:46.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.438+0000 7f005d75fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efff800eaa0 con 0x55ca3790ffb0 2026-02-20T03:19:46.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f0058fcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790a5e0 0x55ca3792da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f0058fcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790a5e0 0x55ca3792da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46614/0 (socket says 10.20.193.28:46614) 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f0058fcf640 1 -- 10.20.193.28:0/1509130656 learned_addr learned my addr 10.20.193.28:0/1509130656 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f00597d0640 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 0x55ca37997950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f004bfff640 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3792df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f0058fcf640 1 -- 10.20.193.28:0/1509130656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 msgr2=0x55ca37997950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f0058fcf640 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 0x55ca37997950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f0058fcf640 1 -- 10.20.193.28:0/1509130656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 msgr2=0x55ca3792df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f0058fcf640 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3792df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f0058fcf640 1 -- 10.20.193.28:0/1509130656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca37929dd0 con 0x55ca3790a5e0 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f004bfff640 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3792df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f0058fcf640 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790a5e0 0x55ca3792da50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0044002410 tx=0x7f0044012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d567b2e5c0a1f57 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:46.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.439+0000 7f00127fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f00127fc640 1 -- 10.20.193.28:0/1509130656 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004401e070 con 0x55ca3790a5e0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 1 -- 10.20.193.28:0/1509130656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3753c870 con 0x55ca3790a5e0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f00127fc640 1 -- 10.20.193.28:0/1509130656 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0044010ce0 con 0x55ca3790a5e0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f00127fc640 1 -- 10.20.193.28:0/1509130656 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044022c00 con 0x55ca3790a5e0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 10 client.16575 _ll_register_callbacks cb 0x7f003c0c86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 1 -- 10.20.193.28:0/1509130656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca3780fab0 con 0x55ca3790a5e0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f00127fc640 1 -- 10.20.193.28:0/1509130656 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f0044022da0 con 0x55ca3790a5e0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f00127fc640 1 -- 10.20.193.28:0/1509130656 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f004402b480 con 0x55ca3790a5e0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 10 client.16575 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 1 -- 10.20.193.28:0/1509130656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55ca377fd3f0 con 0x55ca3790a5e0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f00127fc640 1 -- 10.20.193.28:0/1509130656 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f0044010840 con 0x55ca3790a5e0 2026-02-20T03:19:46.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 10 client.16575 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 10 client.16575 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 20 client.16575 populate_metadata read hostname 'trial028' 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ca3799f620 0x55ca379a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 4 client.16575 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.440+0000 7f005d75fe00 1 -- 10.20.193.28:0/1509130656 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0050023070 con 0x55ca3799f620 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.441+0000 7f004bfff640 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ca3799f620 0x55ca379a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.441+0000 7f004bfff640 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ca3799f620 0x55ca379a1ae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=269e7c0bc34a68bc server_cookie=837f526ba9fd2800 in_seq=0 out_seq=0 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.441+0000 7f00127fc640 10 client.16575 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.441+0000 7f00127fc640 1 -- 10.20.193.28:0/1509130656 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0050023070 con 0x55ca3799f620 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.441+0000 7f00127fc640 10 client.16575 handle_command_reply: tid=0 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 client.16575 shutdown 2026-02-20T03:19:46.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 -- 10.20.193.28:0/1509130656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790a5e0 msgr2=0x55ca3792da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790a5e0 0x55ca3792da50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0044002410 tx=0x7f0044012820 comp rx=0 tx=0).stop 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 -- 10.20.193.28:0/1509130656 shutdown_connections 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ca3799f620 0x55ca379a1ae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ca3790ffb0 0x55ca37997950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ca3790af60 0x55ca3792df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 --2- 10.20.193.28:0/1509130656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ca3790a5e0 0x55ca3792da50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f00127fc640 0 client.16575 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 -- 10.20.193.28:0/1509130656 >> 10.20.193.28:0/1509130656 conn(0x55ca378cd240 msgr2=0x55ca37933d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 -- 10.20.193.28:0/1509130656 shutdown_connections 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 1 -- 10.20.193.28:0/1509130656 wait complete. 2026-02-20T03:19:46.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.442+0000 7f005d75fe00 20 client.16575 trim_cache size 0 max 16384 2026-02-20T03:19:46.451 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 -- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00300b0e20 msgr2=0x7f00300b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00300b0e20 0x7f00300b32e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0050004ad0 tx=0x7f00500048c0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 -- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00541065d0 msgr2=0x7f00541a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00541065d0 0x7f00541a19e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f003c002fa0 tx=0x7f003c002a50 comp rx=0 tx=0).stop 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 -- 10.20.193.28:0/1162704166 shutdown_connections 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00300b0e20 0x7f00300b32e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00541134d0 0x7f00541a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00541065d0 0x7f00541a19e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 --2- 10.20.193.28:0/1162704166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0054075950 0x7f00541a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 -- 10.20.193.28:0/1162704166 >> 10.20.193.28:0/1162704166 conn(0x7f00540fe440 msgr2=0x7f005410f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:46.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 -- 10.20.193.28:0/1162704166 shutdown_connections 2026-02-20T03:19:46.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.443+0000 7f0059fd1640 1 -- 10.20.193.28:0/1162704166 wait complete. 2026-02-20T03:19:46.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:46 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1047983770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:46.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 5.34 MB/sec execute 79 sec latency 3262.953 ms 2026-02-20T03:19:46.544 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:19:46.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:46 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1047983770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:19:46.809 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.981+0000 7f53d5942640 1 -- 10.20.193.28:0/4006703433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d01030a0 msgr2=0x7f53d010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.981+0000 7f53d5942640 1 --2- 10.20.193.28:0/4006703433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d01030a0 0x7f53d010f5d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00b0d0 tx=0x7f53cc02f450 comp rx=0 tx=0).stop 2026-02-20T03:19:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.981+0000 7f53d5942640 1 -- 10.20.193.28:0/4006703433 shutdown_connections 2026-02-20T03:19:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.981+0000 7f53d5942640 1 --2- 10.20.193.28:0/4006703433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d01030a0 0x7f53d010f5d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.981+0000 7f53d5942640 1 --2- 10.20.193.28:0/4006703433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53d0102700 0x7f53d0102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.981+0000 7f53d5942640 1 --2- 10.20.193.28:0/4006703433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53d0108700 0x7f53d0108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.981+0000 7f53d5942640 1 -- 10.20.193.28:0/4006703433 >> 10.20.193.28:0/4006703433 conn(0x7f53d00fe440 msgr2=0x7f53d0100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:46.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.981+0000 7f53d5942640 1 -- 10.20.193.28:0/4006703433 shutdown_connections 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.981+0000 7f53d5942640 1 -- 10.20.193.28:0/4006703433 wait complete. 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.982+0000 7f53d5942640 1 Processor -- start 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.982+0000 7f53d5942640 1 -- start start 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.982+0000 7f53d5942640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d0102700 0x7f53d019ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.982+0000 7f53d5942640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53d01030a0 0x7f53d019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d5942640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53d0108700 0x7f53d019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d5942640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0112970 con 0x7f53d0102700 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d5942640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f53d01127f0 con 0x7f53d01030a0 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d5942640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0112af0 con 0x7f53d0108700 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d4940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d0102700 0x7f53d019ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d4940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d0102700 0x7f53d019ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46642/0 (socket says 10.20.193.28:46642) 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d4940640 1 -- 10.20.193.28:0/2357573899 learned_addr learned my addr 10.20.193.28:0/2357573899 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53c7fff640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53d01030a0 0x7f53d019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d5141640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53d0108700 0x7f53d019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d4940640 1 -- 10.20.193.28:0/2357573899 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53d0108700 msgr2=0x7f53d019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d4940640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53d0108700 0x7f53d019f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d4940640 1 -- 10.20.193.28:0/2357573899 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53d01030a0 msgr2=0x7f53d019b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d4940640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53d01030a0 0x7f53d019b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d4940640 1 -- 10.20.193.28:0/2357573899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d019fda0 con 0x7f53d0102700 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53c7fff640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53d01030a0 0x7f53d019b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.983+0000 7f53d4940640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d0102700 0x7f53d019ad50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f53c000d950 tx=0x7f53c000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.984+0000 7f53c5ffb640 1 -- 10.20.193.28:0/2357573899 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c0014070 con 0x7f53d0102700 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.984+0000 7f53c5ffb640 1 -- 10.20.193.28:0/2357573899 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f53c00044e0 con 0x7f53d0102700 2026-02-20T03:19:46.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.984+0000 7f53c5ffb640 1 -- 10.20.193.28:0/2357573899 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c0010460 con 0x7f53d0102700 2026-02-20T03:19:46.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.984+0000 7f53d5942640 1 -- 10.20.193.28:0/2357573899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d01a0090 con 0x7f53d0102700 2026-02-20T03:19:46.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.984+0000 7f53d5942640 1 -- 10.20.193.28:0/2357573899 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d01a78d0 con 0x7f53d0102700 2026-02-20T03:19:46.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.987+0000 7f53c5ffb640 1 -- 10.20.193.28:0/2357573899 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f53c0010600 con 0x7f53d0102700 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.987+0000 7f53d90d0e00 1 Processor -- start 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.987+0000 7f53d90d0e00 1 -- start start 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.987+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 0x55c44b5df390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.987+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d95e0 0x55c44b5d9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.987+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 0x55c44b5e5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.987+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c44b559e00 con 0x55c44b5d95e0 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.987+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c44b52c970 con 0x55c44b5defb0 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.987+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c44b4da1f0 con 0x55c44b5d9f60 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d4940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d95e0 0x55c44b5d9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d4940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d95e0 0x55c44b5d9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46648/0 (socket says 10.20.193.28:46648) 2026-02-20T03:19:46.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53c7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 0x55c44b5e5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d4940640 1 -- 10.20.193.28:0/2473610101 learned_addr learned my addr 10.20.193.28:0/2473610101 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d5141640 1 --2- 10.20.193.28:0/2473610101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 0x55c44b5df390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53c5ffb640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53ac0b0e20 0x7f53ac0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d5141640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53ac0b0e20 0x7f53ac0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d4940640 1 -- 10.20.193.28:0/2473610101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 msgr2=0x55c44b5e5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d4940640 1 --2- 10.20.193.28:0/2473610101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 0x55c44b5e5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d4940640 1 -- 10.20.193.28:0/2473610101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 msgr2=0x55c44b5df390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d4940640 1 --2- 10.20.193.28:0/2473610101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 0x55c44b5df390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d4940640 1 -- 10.20.193.28:0/2473610101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44b4ed3d0 con 0x55c44b5d95e0 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53d5141640 1 --2- 10.20.193.28:0/2473610101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 0x55c44b5df390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.988+0000 7f53c5ffb640 1 -- 10.20.193.28:0/2357573899 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f53c00e1c10 con 0x7f53d0102700 2026-02-20T03:19:46.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d4940640 1 --2- 10.20.193.28:0/2473610101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d95e0 0x55c44b5d9a20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f53c0014040 tx=0x7f53c0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55db32227c058423 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d5141640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53ac0b0e20 0x7f53ac0b32e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f53cc007590 tx=0x7f53cc02f450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f539d4e4640 1 -- 10.20.193.28:0/2473610101 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c00a9720 con 0x55c44b5d95e0 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f539d4e4640 1 -- 10.20.193.28:0/2473610101 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f53c00aa050 con 0x55c44b5d95e0 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f539d4e4640 1 -- 10.20.193.28:0/2473610101 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c00a8e70 con 0x55c44b5d95e0 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2473610101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d95e0 msgr2=0x55c44b5d9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2473610101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d95e0 0x55c44b5d9a20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f53c0014040 tx=0x7f53c0010000 comp rx=0 tx=0).stop 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2473610101 shutdown_connections 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2473610101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 0x55c44b5e5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2473610101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d95e0 0x55c44b5d9a20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2473610101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 0x55c44b5df390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2473610101 >> 10.20.193.28:0/2473610101 conn(0x55c44b59c240 msgr2=0x55c44b5d7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2473610101 shutdown_connections 2026-02-20T03:19:46.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.989+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2473610101 wait complete. 2026-02-20T03:19:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.991+0000 7f53d90d0e00 1 -- start start 2026-02-20T03:19:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.991+0000 7f53d90d0e00 1 Processor -- start 2026-02-20T03:19:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.991+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b5f8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.991+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d9f60 0x55c44b5f8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.991+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 0x55c44b5f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.991+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c44b5288a0 con 0x55c44b5d9f60 2026-02-20T03:19:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.991+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c44b31af50 con 0x55c44b5defb0 2026-02-20T03:19:46.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.991+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c44b5f7200 con 0x55c44b5d95e0 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d9f60 0x55c44b5f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d9f60 0x55c44b5f8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46656/0 (socket says 10.20.193.28:46656) 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53c7fff640 1 -- 10.20.193.28:0/1755270997 learned_addr learned my addr 10.20.193.28:0/1755270997 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53d4940640 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b5f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53d5141640 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 0x55c44b5f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53c7fff640 1 -- 10.20.193.28:0/1755270997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 msgr2=0x55c44b5f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53c7fff640 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b5f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53c7fff640 1 -- 10.20.193.28:0/1755270997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 msgr2=0x55c44b5f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53c7fff640 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 0x55c44b5f6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53c7fff640 1 -- 10.20.193.28:0/1755270997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44b5efed0 con 0x55c44b5d9f60 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53c7fff640 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d9f60 0x55c44b5f8880 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f53b8002cd0 tx=0x7f53b8012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53be56e89bbab20 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f538e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:47.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f538e7fc640 1 -- 10.20.193.28:0/1755270997 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8004aa0 con 0x55c44b5d9f60 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f538e7fc640 1 -- 10.20.193.28:0/1755270997 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f53b8004c40 con 0x55c44b5d9f60 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f538e7fc640 1 -- 10.20.193.28:0/1755270997 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b800fc10 con 0x55c44b5d9f60 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1755270997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c44b2fdb40 con 0x55c44b5d9f60 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53d90d0e00 10 client.16587 _ll_register_callbacks cb 0x55c44b565eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.992+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1755270997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c44b53a150 con 0x55c44b5d9f60 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f538e7fc640 1 -- 10.20.193.28:0/1755270997 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f53b800fdb0 con 0x55c44b5d9f60 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f538e7fc640 1 -- 10.20.193.28:0/1755270997 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53b8020060 con 0x55c44b5d9f60 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f53d90d0e00 10 client.16587 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1755270997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c44b4e71e0 con 0x55c44b5d9f60 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f538e7fc640 1 -- 10.20.193.28:0/1755270997 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f53b8019070 con 0x55c44b5d9f60 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f53d90d0e00 10 client.16587 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:47.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f53d90d0e00 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f53d90d0e00 20 client.16587 populate_metadata read hostname 'trial028' 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c44b606b30 0x55c44b608fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f53d90d0e00 4 client.16587 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.993+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1755270997 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c44b534560 con 0x55c44b606b30 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.994+0000 7f53d4940640 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c44b606b30 0x55c44b608fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.994+0000 7f53d4940640 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c44b606b30 0x55c44b608fc0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc7b82de4faf120e server_cookie=47808602efbb95cf in_seq=0 out_seq=0 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.994+0000 7f538e7fc640 10 client.16587 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f538e7fc640 1 -- 10.20.193.28:0/1755270997 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c44b534560 con 0x55c44b606b30 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f538e7fc640 10 client.16587 handle_command_reply: tid=0 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 client.16587 shutdown 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1755270997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d9f60 msgr2=0x55c44b5f8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:47.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d9f60 0x55c44b5f8880 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f53b8002cd0 tx=0x7f53b8012820 comp rx=0 tx=0).stop 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1755270997 shutdown_connections 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c44b606b30 0x55c44b608fc0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5defb0 0x55c44b5f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5d9f60 0x55c44b5f8880 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1755270997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b5f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1755270997 >> 10.20.193.28:0/1755270997 conn(0x55c44b59c240 msgr2=0x55c44b5d63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f538e7fc640 0 client.16587 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1755270997 shutdown_connections 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1755270997 wait complete. 2026-02-20T03:19:47.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:46.995+0000 7f53d90d0e00 20 client.16587 trim_cache size 0 max 16384 2026-02-20T03:19:47.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.002+0000 7f53d90d0e00 1 Processor -- start 2026-02-20T03:19:47.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.002+0000 7f53d90d0e00 1 -- start start 2026-02-20T03:19:47.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b60e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:47.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d9f60 0x55c44b60ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:47.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 0x55c44b5fe1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:47.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5374012720 con 0x55c44b5defb0 2026-02-20T03:19:47.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f537400ffc0 con 0x55c44b5d9f60 2026-02-20T03:19:47.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f537400de10 con 0x55c44b5d95e0 2026-02-20T03:19:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d4940640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b60e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d4940640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b60e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54464/0 (socket says 10.20.193.28:54464) 2026-02-20T03:19:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d4940640 1 -- 10.20.193.28:0/1490676360 learned_addr learned my addr 10.20.193.28:0/1490676360 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d5141640 1 --2- 10.20.193.28:0/1490676360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 0x55c44b5fe1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53c7fff640 1 --2- 10.20.193.28:0/1490676360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d9f60 0x55c44b60ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d4940640 1 -- 10.20.193.28:0/1490676360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d9f60 msgr2=0x55c44b60ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d4940640 1 --2- 10.20.193.28:0/1490676360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d9f60 0x55c44b60ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d4940640 1 -- 10.20.193.28:0/1490676360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 msgr2=0x55c44b5fe1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:47.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d4940640 1 --2- 10.20.193.28:0/1490676360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 0x55c44b5fe1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.003+0000 7f53d4940640 1 -- 10.20.193.28:0/1490676360 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44b5efd00 con 0x55c44b5d95e0 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f53d4940640 1 --2- 10.20.193.28:0/1490676360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b60e8d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53c00b2050 tx=0x7f53c00b0040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c890c5368ec74379 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f539cce3640 1 -- 10.20.193.28:0/1490676360 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c00a9050 con 0x55c44b5d95e0 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f539cce3640 1 -- 10.20.193.28:0/1490676360 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f53c00b2bb0 con 0x55c44b5d95e0 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f539cce3640 1 -- 10.20.193.28:0/1490676360 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c00b00b0 con 0x55c44b5d95e0 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1490676360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 msgr2=0x55c44b60e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1490676360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b60e8d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f53c00b2050 tx=0x7f53c00b0040 comp rx=0 tx=0).stop 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1490676360 shutdown_connections 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1490676360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 0x55c44b5fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1490676360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d9f60 0x55c44b60ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/1490676360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d95e0 0x55c44b60e8d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.004+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1490676360 >> 10.20.193.28:0/1490676360 conn(0x55c44b59c240 msgr2=0x55c44b5f5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.005+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1490676360 shutdown_connections 2026-02-20T03:19:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.005+0000 7f53d90d0e00 1 -- 10.20.193.28:0/1490676360 wait complete. 2026-02-20T03:19:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.005+0000 7f53d90d0e00 1 -- start start 2026-02-20T03:19:47.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.005+0000 7f53d90d0e00 1 Processor -- start 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d95e0 0x55c44b5fe1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 0x55c44b5fe720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d90d0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 0x55c44b5f9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f537400e480 con 0x55c44b5defb0 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f537400f8f0 con 0x55c44b5d95e0 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d90d0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f537400eb50 con 0x55c44b5d9f60 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d5141640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 0x55c44b5f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53c7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 0x55c44b5fe720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d4940640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d95e0 0x55c44b5fe1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53c7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 0x55c44b5fe720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54472/0 (socket says 10.20.193.28:54472) 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53c7fff640 1 -- 10.20.193.28:0/2093068137 learned_addr learned my addr 10.20.193.28:0/2093068137 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d5141640 1 -- 10.20.193.28:0/2093068137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 msgr2=0x55c44b5fe720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d5141640 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 0x55c44b5fe720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d5141640 1 -- 10.20.193.28:0/2093068137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d95e0 msgr2=0x55c44b5fe1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d5141640 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d95e0 0x55c44b5fe1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d5141640 1 -- 10.20.193.28:0/2093068137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c44b20b870 con 0x55c44b5defb0 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f53d5141640 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 0x55c44b5f9190 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009e60 tx=0x7f53cc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378e6d607124bbae server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.006+0000 7f538e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f538e7fc640 1 -- 10.20.193.28:0/2093068137 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc004900 con 0x55c44b5defb0 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f538e7fc640 1 -- 10.20.193.28:0/2093068137 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f53cc053070 con 0x55c44b5defb0 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f538e7fc640 1 -- 10.20.193.28:0/2093068137 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc038c50 con 0x55c44b5defb0 2026-02-20T03:19:47.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2093068137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c44b4cc3f0 con 0x55c44b5defb0 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f538e7fc640 1 -- 10.20.193.28:0/2093068137 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f53cc038df0 con 0x55c44b5defb0 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 10 client.16593 _ll_register_callbacks cb 0x7f53b80028e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2093068137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c44b4deab0 con 0x55c44b5defb0 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f538e7fc640 1 -- 10.20.193.28:0/2093068137 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53cc038420 con 0x55c44b5defb0 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 10 client.16593 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2093068137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c44b5f09f0 con 0x55c44b5defb0 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f538e7fc640 1 -- 10.20.193.28:0/2093068137 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f53cc0078b0 con 0x55c44b5defb0 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 10 client.16593 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 20 client.16593 populate_metadata read hostname 'trial028' 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c44b676c40 0x55c44b679100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 4 client.16593 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.007+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2093068137 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f53c00b2bb0 con 0x55c44b676c40 2026-02-20T03:19:47.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.008+0000 7f53d4940640 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c44b676c40 0x55c44b679100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.008+0000 7f53d4940640 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c44b676c40 0x55c44b679100 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465e2a3806d42af7 server_cookie=5996f50ba5095bf7 in_seq=0 out_seq=0 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.008+0000 7f538e7fc640 10 client.16593 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f538e7fc640 1 -- 10.20.193.28:0/2093068137 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f53c00b2bb0 con 0x55c44b676c40 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f538e7fc640 10 client.16593 handle_command_reply: tid=0 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 client.16593 shutdown 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2093068137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 msgr2=0x55c44b5f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 0x55c44b5f9190 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009e60 tx=0x7f53cc0099e0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2093068137 shutdown_connections 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c44b676c40 0x55c44b679100 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c44b5defb0 0x55c44b5f9190 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c44b5d9f60 0x55c44b5fe720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 --2- 10.20.193.28:0/2093068137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c44b5d95e0 0x55c44b5fe1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f538e7fc640 0 client.16593 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:47.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2093068137 >> 10.20.193.28:0/2093068137 conn(0x55c44b59c240 msgr2=0x55c44b606a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:47.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2093068137 shutdown_connections 2026-02-20T03:19:47.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 1 -- 10.20.193.28:0/2093068137 wait complete. 2026-02-20T03:19:47.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.009+0000 7f53d90d0e00 20 client.16593 trim_cache size 0 max 16384 2026-02-20T03:19:47.017 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:19:47.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 -- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53ac0b0e20 msgr2=0x7f53ac0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:47.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53ac0b0e20 0x7f53ac0b32e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f53cc007590 tx=0x7f53cc02f450 comp rx=0 tx=0).stop 2026-02-20T03:19:47.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 -- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d0102700 msgr2=0x7f53d019ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:47.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d0102700 0x7f53d019ad50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f53c000d950 tx=0x7f53c000de20 comp rx=0 tx=0).stop 2026-02-20T03:19:47.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 -- 10.20.193.28:0/2357573899 shutdown_connections 2026-02-20T03:19:47.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53ac0b0e20 0x7f53ac0b32e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f53d0108700 0x7f53d019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f53d01030a0 0x7f53d019b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 --2- 10.20.193.28:0/2357573899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f53d0102700 0x7f53d019ad50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:47.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 -- 10.20.193.28:0/2357573899 >> 10.20.193.28:0/2357573899 conn(0x7f53d00fe440 msgr2=0x7f53d00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:47.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 -- 10.20.193.28:0/2357573899 shutdown_connections 2026-02-20T03:19:47.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:47.010+0000 7f53d5942640 1 -- 10.20.193.28:0/2357573899 wait complete. 2026-02-20T03:19:47.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:47 trial177 ceph-mon[43181]: pgmap v334: 129 pgs: 129 active+clean; 67 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 852 KiB/s rd, 2.5 MiB/s wr, 164 op/s 2026-02-20T03:19:47.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 5.27 MB/sec execute 80 sec latency 4262.998 ms 2026-02-20T03:19:47.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:47 trial126 ceph-mon[38476]: pgmap v334: 129 pgs: 129 active+clean; 67 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 852 KiB/s rd, 2.5 MiB/s wr, 164 op/s 2026-02-20T03:19:47.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:47 trial028 ceph-mon[38552]: pgmap v334: 129 pgs: 129 active+clean; 67 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 852 KiB/s rd, 2.5 MiB/s wr, 164 op/s 2026-02-20T03:19:48.112 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:19:48.112 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:19:48.379 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:48.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 5.21 MB/sec execute 81 sec latency 5263.051 ms 2026-02-20T03:19:48.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.583+0000 7fe0bd50d640 1 -- 10.20.193.28:0/342481397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0b81026b0 msgr2=0x7fe0b8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.583+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/342481397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0b81026b0 0x7fe0b8102ab0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009a30 tx=0x7fe0a402f220 comp rx=0 tx=0).stop 2026-02-20T03:19:48.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.583+0000 7fe0bd50d640 1 -- 10.20.193.28:0/342481397 shutdown_connections 2026-02-20T03:19:48.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.583+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/342481397 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b8104260 0x7fe0b810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.583+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/342481397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0b81038a0 0x7fe0b8103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.583+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/342481397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0b81026b0 0x7fe0b8102ab0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.583+0000 7fe0bd50d640 1 -- 10.20.193.28:0/342481397 >> 10.20.193.28:0/342481397 conn(0x7fe0b80fde10 msgr2=0x7fe0b8100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.583+0000 7fe0bd50d640 1 -- 10.20.193.28:0/342481397 shutdown_connections 2026-02-20T03:19:48.587 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.583+0000 7fe0bd50d640 1 -- 10.20.193.28:0/342481397 wait complete. 2026-02-20T03:19:48.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.584+0000 7fe0bd50d640 1 Processor -- start 2026-02-20T03:19:48.588 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.584+0000 7fe0bd50d640 1 -- start start 2026-02-20T03:19:48.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.584+0000 7f030bfff640 1 -- 10.20.193.28:0/3535362622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f030c108700 msgr2=0x7f030c108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.584+0000 7f030bfff640 1 --2- 10.20.193.28:0/3535362622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f030c108700 0x7f030c108ae0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0300009a30 tx=0x7f030002f240 comp rx=0 tx=0).stop 2026-02-20T03:19:48.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bd50d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0b81026b0 0x7fe0b8076e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bd50d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b81038a0 0x7fe0b8075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.589 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bd50d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0b8104260 0x7fe0b80759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bd50d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b810e1a0 con 0x7fe0b81026b0 2026-02-20T03:19:48.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bd50d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b810e020 con 0x7fe0b8104260 2026-02-20T03:19:48.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bd50d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b810e320 con 0x7fe0b81038a0 2026-02-20T03:19:48.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.584+0000 7f030bfff640 1 -- 10.20.193.28:0/3535362622 shutdown_connections 2026-02-20T03:19:48.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.584+0000 7f030bfff640 1 --2- 10.20.193.28:0/3535362622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f030c1030a0 0x7f030c10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.584+0000 7f030bfff640 1 --2- 10.20.193.28:0/3535362622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f030c102700 0x7f030c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.584+0000 7f030bfff640 1 --2- 10.20.193.28:0/3535362622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f030c108700 0x7f030c108ae0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.584+0000 7f030bfff640 1 -- 10.20.193.28:0/3535362622 >> 10.20.193.28:0/3535362622 conn(0x7f030c0fe440 msgr2=0x7f030c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.585+0000 7f030bfff640 1 -- 10.20.193.28:0/3535362622 shutdown_connections 2026-02-20T03:19:48.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.585+0000 7f030bfff640 1 -- 10.20.193.28:0/3535362622 wait complete. 2026-02-20T03:19:48.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bcd0c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0b8104260 0x7fe0b80759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.591 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bcd0c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0b8104260 0x7fe0b80759a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35632/0 (socket says 10.20.193.28:35632) 2026-02-20T03:19:48.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/1749725529 learned_addr learned my addr 10.20.193.28:0/1749725529 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0b81026b0 0x7fe0b8076e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.592 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b81038a0 0x7fe0b8075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.585+0000 7f030bfff640 1 Processor -- start 2026-02-20T03:19:48.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/1749725529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b81038a0 msgr2=0x7fe0b8075460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b81038a0 0x7fe0b8075460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0b81026b0 msgr2=0x7fe0b8076e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0b81026b0 0x7fe0b8076e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/1749725529 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b8075ee0 con 0x7fe0b8104260 2026-02-20T03:19:48.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.585+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0b81026b0 0x7fe0b8076e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.585+0000 7f030bfff640 1 -- start start 2026-02-20T03:19:48.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.586+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0b8104260 0x7fe0b80759a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00ef30 tx=0x7fe0ac00c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f030c102700 0x7f030c19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f030c1030a0 0x7f030c19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.586+0000 7fe0b57fa640 1 -- 10.20.193.28:0/1749725529 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac019070 con 0x7fe0b8104260 2026-02-20T03:19:48.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.586+0000 7fe0b57fa640 1 -- 10.20.193.28:0/1749725529 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0ac0092d0 con 0x7fe0b8104260 2026-02-20T03:19:48.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.586+0000 7fe0b57fa640 1 -- 10.20.193.28:0/1749725529 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac007500 con 0x7fe0b8104260 2026-02-20T03:19:48.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.586+0000 7fe0bd50d640 1 -- 10.20.193.28:0/1749725529 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b8076170 con 0x7fe0b8104260 2026-02-20T03:19:48.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.586+0000 7fe0bd50d640 1 -- 10.20.193.28:0/1749725529 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b81a9540 con 0x7fe0b8104260 2026-02-20T03:19:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f030c102700 0x7f030c19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f030c102700 0x7f030c19cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35638/0 (socket says 10.20.193.28:35638) 2026-02-20T03:19:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f030c1030a0 0x7f030c19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f030c1030a0 0x7f030c19d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46700/0 (socket says 10.20.193.28:46700) 2026-02-20T03:19:48.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030affd640 1 -- 10.20.193.28:0/2158915991 learned_addr learned my addr 10.20.193.28:0/2158915991 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030bfff640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f030c108700 0x7f030c1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f030c1129c0 con 0x7f030c1030a0 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f030c112840 con 0x7f030c102700 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.586+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f030c112b40 con 0x7f030c108700 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f030b7fe640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f030c108700 0x7f030c1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f030a7fc640 1 -- 10.20.193.28:0/2158915991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f030c108700 msgr2=0x7f030c1a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f030a7fc640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f030c108700 0x7f030c1a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f030a7fc640 1 -- 10.20.193.28:0/2158915991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f030c102700 msgr2=0x7f030c19cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f030a7fc640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f030c102700 0x7f030c19cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f030a7fc640 1 -- 10.20.193.28:0/2158915991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c1a1ff0 con 0x7f030c1030a0 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f030a7fc640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f030c1030a0 0x7f030c19d4e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f02f400d750 tx=0x7f02f400dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f031091a640 1 -- 10.20.193.28:0/2158915991 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4014070 con 0x7f030c1030a0 2026-02-20T03:19:48.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030c1a22e0 con 0x7f030c1030a0 2026-02-20T03:19:48.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030c1a9b20 con 0x7f030c1030a0 2026-02-20T03:19:48.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.587+0000 7f031091a640 1 -- 10.20.193.28:0/2158915991 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f02f40044e0 con 0x7f030c1030a0 2026-02-20T03:19:48.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.588+0000 7f031091a640 1 -- 10.20.193.28:0/2158915991 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f401d060 con 0x7f030c1030a0 2026-02-20T03:19:48.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.589+0000 7fe0c15fde00 1 Processor -- start 2026-02-20T03:19:48.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0b57fa640 1 -- 10.20.193.28:0/1749725529 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe0ac0076a0 con 0x7fe0b8104260 2026-02-20T03:19:48.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0c15fde00 1 -- start start 2026-02-20T03:19:48.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cb7c0 0x55af691cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 0x55af691d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55af6911b8f0 con 0x55af691cae80 2026-02-20T03:19:48.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55af690c92e0 con 0x55af691d0560 2026-02-20T03:19:48.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55af69117820 con 0x55af691cb7c0 2026-02-20T03:19:48.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.590+0000 7f031091a640 1 -- 10.20.193.28:0/2158915991 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f02f4005020 con 0x7f030c1030a0 2026-02-20T03:19:48.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0b77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46716/0 (socket says 10.20.193.28:46716) 2026-02-20T03:19:48.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0b77fe640 1 -- 10.20.193.28:0/1792233388 learned_addr learned my addr 10.20.193.28:0/1792233388 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.590+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/1792233388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cb7c0 0x55af691cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.590+0000 7f0313e21e00 1 Processor -- start 2026-02-20T03:19:48.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.591+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/1792233388 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 0x55af691d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f0313e21e00 1 -- start start 2026-02-20T03:19:48.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.591+0000 7fe0b77fe640 1 -- 10.20.193.28:0/1792233388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cb7c0 msgr2=0x55af691cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.591+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/1792233388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cb7c0 0x55af691cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.591+0000 7fe0b77fe640 1 -- 10.20.193.28:0/1792233388 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 msgr2=0x55af691d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.591+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/1792233388 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 0x55af691d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.591+0000 7fe0b77fe640 1 -- 10.20.193.28:0/1792233388 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af690bb5a0 con 0x55af691cae80 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.591+0000 7fe0b57fa640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe08c0b0ea0 0x7fe08c0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.591+0000 7fe0b57fa640 1 -- 10.20.193.28:0/1749725529 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe0ac0e0980 con 0x7fe0b8104260 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe08c0b0ea0 0x7fe08c0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/1792233388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691cb280 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8002bd0 tx=0x7fe0a8004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cc01f8b1fe68c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe088bfe640 1 -- 10.20.193.28:0/1792233388 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800f480 con 0x55af691cae80 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe088bfe640 1 -- 10.20.193.28:0/1792233388 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0a800fac0 con 0x55af691cae80 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe088bfe640 1 -- 10.20.193.28:0/1792233388 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8012b40 con 0x55af691cae80 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe0c15fde00 1 -- 10.20.193.28:0/1792233388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 msgr2=0x55af691cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/1792233388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691cb280 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8002bd0 tx=0x7fe0a8004230 comp rx=0 tx=0).stop 2026-02-20T03:19:48.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 0x55cda39ff4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe08c0b0ea0 0x7fe08c0b3360 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4002410 tx=0x7fe0a4005b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe0c15fde00 1 -- 10.20.193.28:0/1792233388 shutdown_connections 2026-02-20T03:19:48.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/1792233388 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 0x55af691d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.592+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/1792233388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cb7c0 0x55af691cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.593+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/1792233388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691cb280 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.593+0000 7fe0c15fde00 1 -- 10.20.193.28:0/1792233388 >> 10.20.193.28:0/1792233388 conn(0x55af691c26f0 msgr2=0x55af691c9570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 0x55cda3a03540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a03fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f0313e21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cda3951c00 con 0x55cda39ffa70 2026-02-20T03:19:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f0313e21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cda38ff3c0 con 0x55cda3a03b60 2026-02-20T03:19:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f0313e21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cda394db30 con 0x55cda39ff0c0 2026-02-20T03:19:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f030a7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a03fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f030b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 0x55cda39ff4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f030a7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a03fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35666/0 (socket says 10.20.193.28:35666) 2026-02-20T03:19:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f030a7fc640 1 -- 10.20.193.28:0/2446142267 learned_addr learned my addr 10.20.193.28:0/2446142267 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f030a7fc640 1 -- 10.20.193.28:0/2446142267 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 msgr2=0x55cda39ff4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.593+0000 7fe0c15fde00 1 -- 10.20.193.28:0/1792233388 shutdown_connections 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f030a7fc640 1 --2- 10.20.193.28:0/2446142267 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 0x55cda39ff4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f030a7fc640 1 -- 10.20.193.28:0/2446142267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 msgr2=0x55cda3a03540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f030a7fc640 1 --2- 10.20.193.28:0/2446142267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 0x55cda3a03540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.591+0000 7f030a7fc640 1 -- 10.20.193.28:0/2446142267 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda38f8840 con 0x55cda3a03b60 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f030a7fc640 1 --2- 10.20.193.28:0/2446142267 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a03fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f02f40e6640 tx=0x7f02f40e6b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a752ea78cbf62927 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f02cffff640 1 -- 10.20.193.28:0/2446142267 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40f3070 con 0x55cda3a03b60 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f02cffff640 1 -- 10.20.193.28:0/2446142267 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f02f40e2070 con 0x55cda3a03b60 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f02cffff640 1 -- 10.20.193.28:0/2446142267 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40f3070 con 0x55cda3a03b60 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f031091a640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02e00b0fa0 0x7f02e00b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f0313e21e00 1 -- 10.20.193.28:0/2446142267 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 msgr2=0x55cda3a03fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2446142267 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a03fd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f02f40e6640 tx=0x7f02f40e6b10 comp rx=0 tx=0).stop 2026-02-20T03:19:48.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f031091a640 1 -- 10.20.193.28:0/2158915991 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f02f40e0540 con 0x7f030c1030a0 2026-02-20T03:19:48.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f030b7fe640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02e00b0fa0 0x7f02e00b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f0313e21e00 1 -- 10.20.193.28:0/2446142267 shutdown_connections 2026-02-20T03:19:48.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2446142267 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a03fd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2446142267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 0x55cda3a03540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2446142267 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 0x55cda39ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.592+0000 7f0313e21e00 1 -- 10.20.193.28:0/2446142267 >> 10.20.193.28:0/2446142267 conn(0x55cda39f7b60 msgr2=0x55cda39fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.593+0000 7f030b7fe640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02e00b0fa0 0x7f02e00b3460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009fd0 tx=0x7f02fc009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.593+0000 7fe0c15fde00 1 -- 10.20.193.28:0/1792233388 wait complete. 2026-02-20T03:19:48.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.593+0000 7f0313e21e00 1 -- 10.20.193.28:0/2446142267 shutdown_connections 2026-02-20T03:19:48.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.593+0000 7f0313e21e00 1 -- 10.20.193.28:0/2446142267 wait complete. 2026-02-20T03:19:48.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0c15fde00 1 -- start start 2026-02-20T03:19:48.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f0313e21e00 1 -- start start 2026-02-20T03:19:48.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f0313e21e00 1 Processor -- start 2026-02-20T03:19:48.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0c15fde00 1 Processor -- start 2026-02-20T03:19:48.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cae80 0x55af691e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cb7c0 0x55af691e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 0x55af691eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55af690c30c0 con 0x55af691cb7c0 2026-02-20T03:19:48.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55af691d3610 con 0x55af691d0560 2026-02-20T03:19:48.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 0x55cda3a3bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55af691fc860 con 0x55af691cae80 2026-02-20T03:19:48.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 0x55cda3a3c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0b7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cae80 0x55af691e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0b7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cae80 0x55af691e3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54516/0 (socket says 10.20.193.28:54516) 2026-02-20T03:19:48.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.595+0000 7fe0b7fff640 1 -- 10.20.193.28:0/2741858705 learned_addr learned my addr 10.20.193.28:0/2741858705 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a3a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f030affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 0x55cda3a3bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f0313e21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cda38f91a0 con 0x55cda39ffa70 2026-02-20T03:19:48.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f0313e21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cda3a0bd70 con 0x55cda3a03b60 2026-02-20T03:19:48.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.596+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cb7c0 0x55af691e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f030affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 0x55cda3a3bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54524/0 (socket says 10.20.193.28:54524) 2026-02-20T03:19:48.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f0313e21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cda3a3a980 con 0x55cda39ff0c0 2026-02-20T03:19:48.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.595+0000 7f030affd640 1 -- 10.20.193.28:0/1078437812 learned_addr learned my addr 10.20.193.28:0/1078437812 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f030a7fc640 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 0x55cda3a3c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f030b7fe640 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a3a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.596+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 0x55af691eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.596+0000 7fe0b7fff640 1 -- 10.20.193.28:0/2741858705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 msgr2=0x55af691eaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.618 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.596+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 0x55af691eaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f030a7fc640 1 -- 10.20.193.28:0/1078437812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 msgr2=0x55cda3a3bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f030a7fc640 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 0x55cda3a3bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f030a7fc640 1 -- 10.20.193.28:0/1078437812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 msgr2=0x55cda3a3a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f030a7fc640 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a3a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f030a7fc640 1 -- 10.20.193.28:0/1078437812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda3a33d60 con 0x55cda39ffa70 2026-02-20T03:19:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f030a7fc640 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 0x55cda3a3c0d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f02f40e6610 tx=0x7f02f40e6f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16034f708e9be040 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f02cd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:48.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.596+0000 7fe0b7fff640 1 -- 10.20.193.28:0/2741858705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cb7c0 msgr2=0x55af691e3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.596+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cb7c0 0x55af691e3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.596+0000 7fe0b7fff640 1 -- 10.20.193.28:0/2741858705 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af691dd150 con 0x55af691cae80 2026-02-20T03:19:48.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.596+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cb7c0 0x55af691e3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:48.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.596+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 0x55af691eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f02cd7fa640 1 -- 10.20.193.28:0/1078437812 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4014030 con 0x55cda39ffa70 2026-02-20T03:19:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f0313e21e00 1 -- 10.20.193.28:0/1078437812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cda3720b60 con 0x55cda39ffa70 2026-02-20T03:19:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f0313e21e00 10 client.16611 _ll_register_callbacks cb 0x55cda38fd0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f0313e21e00 1 -- 10.20.193.28:0/1078437812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cda39597f0 con 0x55cda39ffa70 2026-02-20T03:19:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f02cd7fa640 1 -- 10.20.193.28:0/1078437812 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f02f4004e40 con 0x55cda39ffa70 2026-02-20T03:19:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f02cd7fa640 1 -- 10.20.193.28:0/1078437812 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40f3070 con 0x55cda39ffa70 2026-02-20T03:19:48.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f02cd7fa640 1 -- 10.20.193.28:0/1078437812 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f02f40a5570 con 0x55cda39ffa70 2026-02-20T03:19:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f02cd7fa640 1 -- 10.20.193.28:0/1078437812 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02f40f3070 con 0x55cda39ffa70 2026-02-20T03:19:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f0313e21e00 10 client.16611 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:48.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.596+0000 7f0313e21e00 1 -- 10.20.193.28:0/1078437812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cda391e430 con 0x55cda39ffa70 2026-02-20T03:19:48.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cae80 0x55af691e3a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8103700 tx=0x7fe0a402f220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a6dc4e26f9ea1b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe079ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:19:48.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe079ffb640 1 -- 10.20.193.28:0/2741858705 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4005250 con 0x55af691cae80 2026-02-20T03:19:48.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe079ffb640 1 -- 10.20.193.28:0/2741858705 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0a4049050 con 0x55af691cae80 2026-02-20T03:19:48.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe079ffb640 1 -- 10.20.193.28:0/2741858705 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4042420 con 0x55af691cae80 2026-02-20T03:19:48.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe0c15fde00 1 -- 10.20.193.28:0/2741858705 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af690d7820 con 0x55af691cae80 2026-02-20T03:19:48.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.597+0000 7f02cd7fa640 1 -- 10.20.193.28:0/1078437812 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f02f40a5210 con 0x55cda39ffa70 2026-02-20T03:19:48.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.597+0000 7f0313e21e00 10 client.16611 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.597+0000 7f0313e21e00 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.597+0000 7f0313e21e00 20 client.16611 populate_metadata read hostname 'trial028' 2026-02-20T03:19:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.597+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cda3a49e10 0x55cda3a4c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.597+0000 7f0313e21e00 4 client.16611 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.597+0000 7f0313e21e00 1 -- 10.20.193.28:0/1078437812 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cda38d3c00 con 0x55cda3a49e10 2026-02-20T03:19:48.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe079ffb640 1 -- 10.20.193.28:0/2741858705 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe0a40425c0 con 0x55af691cae80 2026-02-20T03:19:48.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe079ffb640 10 client.26260 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:19:48.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.597+0000 7f030affd640 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cda3a49e10 0x55cda3a4c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe0c15fde00 10 client.26260 _ll_register_callbacks cb 0x55af690c6ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe0c15fde00 1 -- 10.20.193.28:0/2741858705 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55af691234e0 con 0x55af691cae80 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe079ffb640 1 -- 10.20.193.28:0/2741858705 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0a40045d0 con 0x55af691cae80 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe0c15fde00 10 client.26260 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.597+0000 7fe0c15fde00 1 -- 10.20.193.28:0/2741858705 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55af690dc380 con 0x55af691cae80 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe079ffb640 1 -- 10.20.193.28:0/2741858705 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fe0a40053f0 con 0x55af691cae80 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe0c15fde00 10 client.26260 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe0c15fde00 10 client.26260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe0c15fde00 20 client.26260 populate_metadata read hostname 'trial028' 2026-02-20T03:19:48.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af69200b80 0x55af69203020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.598+0000 7f030affd640 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cda3a49e10 0x55cda3a4c240 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be4af7825e56239b server_cookie=4e4ee773834058cf in_seq=0 out_seq=0 2026-02-20T03:19:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.598+0000 7f02cd7fa640 10 client.16611 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:48.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe0c15fde00 4 client.26260 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:48.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe0c15fde00 1 -- 10.20.193.28:0/2741858705 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af6909dbd0 con 0x55af69200b80 2026-02-20T03:19:48.627 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af69200b80 0x55af69203020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.598+0000 7f02cd7fa640 1 -- 10.20.193.28:0/1078437812 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55cda38d3c00 con 0x55cda3a49e10 2026-02-20T03:19:48.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.598+0000 7f02cd7fa640 10 client.16611 handle_command_reply: tid=0 2026-02-20T03:19:48.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.598+0000 7f0313e21e00 1 client.16611 shutdown 2026-02-20T03:19:48.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af69200b80 0x55af69203020 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=996224288ee19615 server_cookie=dddf707279248cac in_seq=0 out_seq=0 2026-02-20T03:19:48.628 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.598+0000 7fe079ffb640 10 client.26260 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.598+0000 7f0313e21e00 1 -- 10.20.193.28:0/1078437812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 msgr2=0x55cda3a3c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.598+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 0x55cda3a3c0d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f02f40e6610 tx=0x7f02f40e6f80 comp rx=0 tx=0).stop 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f0313e21e00 1 -- 10.20.193.28:0/1078437812 shutdown_connections 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cda3a49e10 0x55cda3a4c240 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a3a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ffa70 0x55cda3a3c0d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1078437812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ff0c0 0x55cda3a3bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f0313e21e00 1 -- 10.20.193.28:0/1078437812 >> 10.20.193.28:0/1078437812 conn(0x55cda39f7b60 msgr2=0x55cda3a02520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f02cd7fa640 0 client.16611 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f0313e21e00 1 -- 10.20.193.28:0/1078437812 shutdown_connections 2026-02-20T03:19:48.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f0313e21e00 1 -- 10.20.193.28:0/1078437812 wait complete. 2026-02-20T03:19:48.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.599+0000 7f0313e21e00 20 client.16611 trim_cache size 0 max 16384 2026-02-20T03:19:48.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe079ffb640 1 -- 10.20.193.28:0/2741858705 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55af6909dbd0 con 0x55af69200b80 2026-02-20T03:19:48.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe079ffb640 10 client.26260 handle_command_reply: tid=0 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 client.26260 shutdown 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 -- 10.20.193.28:0/2741858705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cae80 msgr2=0x55af691e3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cae80 0x55af691e3a00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8103700 tx=0x7fe0a402f220 comp rx=0 tx=0).stop 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 -- 10.20.193.28:0/2741858705 shutdown_connections 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af69200b80 0x55af69203020 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691d0560 0x55af691eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cb7c0 0x55af691e3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/2741858705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691cae80 0x55af691e3a00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 -- 10.20.193.28:0/2741858705 >> 10.20.193.28:0/2741858705 conn(0x55af691c26f0 msgr2=0x55af691d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe079ffb640 0 client.26260 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 -- 10.20.193.28:0/2741858705 shutdown_connections 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 1 -- 10.20.193.28:0/2741858705 wait complete. 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.599+0000 7fe0c15fde00 20 client.26260 trim_cache size 0 max 16384 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0c15fde00 1 Processor -- start 2026-02-20T03:19:48.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0c15fde00 1 -- start start 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 0x55af691eae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c012720 con 0x55af691cae80 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c00ffc0 con 0x55af691cb7c0 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c00de10 con 0x55af691d0560 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0bcd0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0bcd0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54532/0 (socket says 10.20.193.28:54532) 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0b77fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 0x55af691eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/751488460 learned_addr learned my addr 10.20.193.28:0/751488460 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/751488460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/751488460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 msgr2=0x55af691eae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/751488460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 0x55af691eae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.607+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/751488460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 msgr2=0x55af691ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/751488460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/751488460 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af691dcf80 con 0x55af691d0560 2026-02-20T03:19:48.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/751488460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:48.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/751488460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691c9460 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0a4490 tx=0x7fe0ac004330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfca9e115f781b9a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe07bfff640 1 -- 10.20.193.28:0/751488460 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0aca10 con 0x55af691d0560 2026-02-20T03:19:48.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe07bfff640 1 -- 10.20.193.28:0/751488460 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0ac0b18c0 con 0x55af691d0560 2026-02-20T03:19:48.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe07bfff640 1 -- 10.20.193.28:0/751488460 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0a2e00 con 0x55af691d0560 2026-02-20T03:19:48.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.608+0000 7f0313e21e00 1 Processor -- start 2026-02-20T03:19:48.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0c15fde00 1 -- 10.20.193.28:0/751488460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 msgr2=0x55af691c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/751488460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691c9460 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0a4490 tx=0x7fe0ac004330 comp rx=0 tx=0).stop 2026-02-20T03:19:48.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.608+0000 7f0313e21e00 1 -- start start 2026-02-20T03:19:48.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0c15fde00 1 -- 10.20.193.28:0/751488460 shutdown_connections 2026-02-20T03:19:48.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/751488460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691c9460 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/751488460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 0x55af691eae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/751488460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0c15fde00 1 -- 10.20.193.28:0/751488460 >> 10.20.193.28:0/751488460 conn(0x55af691c26f0 msgr2=0x55af691c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.608+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ff0c0 0x55cda39f7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.608+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a51b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0c15fde00 1 -- 10.20.193.28:0/751488460 shutdown_connections 2026-02-20T03:19:48.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.608+0000 7fe0c15fde00 1 -- 10.20.193.28:0/751488460 wait complete. 2026-02-20T03:19:48.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.608+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a52090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.608+0000 7f0313e21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f02b4012770 con 0x55cda39ff0c0 2026-02-20T03:19:48.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.608+0000 7f0313e21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f02b4010010 con 0x55cda3a03b60 2026-02-20T03:19:48.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.608+0000 7f0313e21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f02b400de60 con 0x55cda39ffa70 2026-02-20T03:19:48.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030a7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a51b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030a7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a51b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54534/0 (socket says 10.20.193.28:54534) 2026-02-20T03:19:48.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030a7fc640 1 -- 10.20.193.28:0/1916319989 learned_addr learned my addr 10.20.193.28:0/1916319989 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030b7fe640 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030affd640 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ff0c0 0x55cda39f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.609+0000 7fe0c15fde00 1 -- start start 2026-02-20T03:19:48.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030a7fc640 1 -- 10.20.193.28:0/1916319989 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 msgr2=0x55cda3a52090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.609+0000 7fe0c15fde00 1 Processor -- start 2026-02-20T03:19:48.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030a7fc640 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a52090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030a7fc640 1 -- 10.20.193.28:0/1916319989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ff0c0 msgr2=0x55cda39f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030a7fc640 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ff0c0 0x55cda39f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030a7fc640 1 -- 10.20.193.28:0/1916319989 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda39ff810 con 0x55cda39ffa70 2026-02-20T03:19:48.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030affd640 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ff0c0 0x55cda39f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:48.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f030a7fc640 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a51b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f02f40e6640 tx=0x7f02f401a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a1a681d6eeb8a3b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.609+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691e8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.609+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 0x55af691e9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.609+0000 7fe0c15fde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691ea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f02cf7fe640 1 -- 10.20.193.28:0/1916319989 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4014070 con 0x55cda39ffa70 2026-02-20T03:19:48.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f02cf7fe640 1 -- 10.20.193.28:0/1916319989 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55cda39597f0 con 0x55cda39ffa70 2026-02-20T03:19:48.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.609+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c00e480 con 0x55af691cae80 2026-02-20T03:19:48.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.609+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c00f8f0 con 0x55af691cb7c0 2026-02-20T03:19:48.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.609+0000 7fe0c15fde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c00eb50 con 0x55af691d0560 2026-02-20T03:19:48.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.609+0000 7f02cf7fe640 1 -- 10.20.193.28:0/1916319989 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40e6220 con 0x55cda39ffa70 2026-02-20T03:19:48.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0b7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691e8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0bcd0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691ea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0bcd0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691ea440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54546/0 (socket says 10.20.193.28:54546) 2026-02-20T03:19:48.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/3684633035 learned_addr learned my addr 10.20.193.28:0/3684633035 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 -- 10.20.193.28:0/1916319989 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 msgr2=0x55cda3a51b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a51b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f02f40e6640 tx=0x7f02f401a000 comp rx=0 tx=0).stop 2026-02-20T03:19:48.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 -- 10.20.193.28:0/1916319989 shutdown_connections 2026-02-20T03:19:48.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda3a03b60 0x55cda3a52090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/3684633035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 msgr2=0x55af691e9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0b77fe640 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 0x55af691e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 0x55af691e9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/3684633035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 msgr2=0x55af691e8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691e8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a51b50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 --2- 10.20.193.28:0/1916319989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda39ff0c0 0x55cda39f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 -- 10.20.193.28:0/1916319989 >> 10.20.193.28:0/1916319989 conn(0x55cda39f7b60 msgr2=0x55cda3a36d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 -- 10.20.193.28:0/1916319989 shutdown_connections 2026-02-20T03:19:48.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 -- 10.20.193.28:0/1916319989 wait complete. 2026-02-20T03:19:48.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0bcd0c640 1 -- 10.20.193.28:0/3684633035 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af691e1d70 con 0x55af691d0560 2026-02-20T03:19:48.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0bcd0c640 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691ea440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009510 tx=0x7fe0ac0a3c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc71f923cb73457d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe079ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:19:48.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 -- start start 2026-02-20T03:19:48.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe079ffb640 1 -- 10.20.193.28:0/3684633035 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac004d50 con 0x55af691d0560 2026-02-20T03:19:48.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe079ffb640 1 -- 10.20.193.28:0/3684633035 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0ac0a3d80 con 0x55af691d0560 2026-02-20T03:19:48.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0c15fde00 1 -- 10.20.193.28:0/3684633035 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af68e7b690 con 0x55af691d0560 2026-02-20T03:19:48.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.610+0000 7f0313e21e00 1 Processor -- start 2026-02-20T03:19:48.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe079ffb640 1 -- 10.20.193.28:0/3684633035 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac002a60 con 0x55af691d0560 2026-02-20T03:19:48.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0c15fde00 10 client.26272 _ll_register_callbacks cb 0x7fe0a402fdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:48.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.610+0000 7fe0c15fde00 1 -- 10.20.193.28:0/3684633035 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a800fac0 con 0x55af691d0560 2026-02-20T03:19:48.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe079ffb640 1 -- 10.20.193.28:0/3684633035 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe0ac002c00 con 0x55af691d0560 2026-02-20T03:19:48.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe079ffb640 1 -- 10.20.193.28:0/3684633035 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0ac0b0e00 con 0x55af691d0560 2026-02-20T03:19:48.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe0c15fde00 10 client.26272 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:48.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe0c15fde00 1 -- 10.20.193.28:0/3684633035 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55af690e0b70 con 0x55af691d0560 2026-02-20T03:19:48.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda39ff0c0 0x55cda3a40d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a412b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f0313e21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda3a03b60 0x55cda3abd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe079ffb640 1 -- 10.20.193.28:0/3684633035 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fe0ac0a3f30 con 0x55af691d0560 2026-02-20T03:19:48.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe0c15fde00 10 client.26272 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:48.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe0c15fde00 10 client.26272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:48.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe0c15fde00 20 client.26272 populate_metadata read hostname 'trial028' 2026-02-20T03:19:48.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af6926c730 0x55af6926ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe0c15fde00 4 client.26272 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:19:48.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe0c15fde00 1 -- 10.20.193.28:0/3684633035 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55af690ec6b0 con 0x55af6926c730 2026-02-20T03:19:48.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.611+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af6926c730 0x55af6926ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f0313e21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f02b400e4d0 con 0x55cda3a03b60 2026-02-20T03:19:48.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f0313e21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f02b400f940 con 0x55cda39ff0c0 2026-02-20T03:19:48.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f0313e21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f02b400eba0 con 0x55cda39ffa70 2026-02-20T03:19:48.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda39ff0c0 0x55cda3a40d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda3a03b60 0x55cda3abd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda39ff0c0 0x55cda3a40d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35706/0 (socket says 10.20.193.28:35706) 2026-02-20T03:19:48.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030affd640 1 -- 10.20.193.28:0/2970072316 learned_addr learned my addr 10.20.193.28:0/2970072316 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:48.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030a7fc640 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030b7fe640 1 -- 10.20.193.28:0/2970072316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 msgr2=0x55cda3a412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030b7fe640 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030b7fe640 1 -- 10.20.193.28:0/2970072316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda39ff0c0 msgr2=0x55cda3a40d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:48.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030b7fe640 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda39ff0c0 0x55cda3a40d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.611+0000 7f030b7fe640 1 -- 10.20.193.28:0/2970072316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda3a33b90 con 0x55cda3a03b60 2026-02-20T03:19:48.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.612+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af6926c730 0x55af6926ebf0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e07f2523f4c59f2c server_cookie=4f0914b2fe38ec69 in_seq=0 out_seq=0 2026-02-20T03:19:48.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.612+0000 7fe079ffb640 10 client.26272 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f030b7fe640 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda3a03b60 0x55cda3abd750 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0090e0 tx=0x7f02fc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4abfb941bb2f19 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f02cd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f02cd7fa640 1 -- 10.20.193.28:0/2970072316 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc008d70 con 0x55cda3a03b60 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f02cd7fa640 1 -- 10.20.193.28:0/2970072316 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f02fc02b8a0 con 0x55cda3a03b60 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f0313e21e00 1 -- 10.20.193.28:0/2970072316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cda3630900 con 0x55cda3a03b60 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f02cd7fa640 1 -- 10.20.193.28:0/2970072316 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc023960 con 0x55cda3a03b60 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f0313e21e00 10 client.16626 _ll_register_callbacks cb 0x7f02f40e6510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f0313e21e00 1 -- 10.20.193.28:0/2970072316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02f40e2070 con 0x55cda3a03b60 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f02cd7fa640 1 -- 10.20.193.28:0/2970072316 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f02fc02ba50 con 0x55cda3a03b60 2026-02-20T03:19:48.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f02cd7fa640 1 -- 10.20.193.28:0/2970072316 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02fc02be00 con 0x55cda3a03b60 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f0313e21e00 10 client.16626 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.612+0000 7f0313e21e00 1 -- 10.20.193.28:0/2970072316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55cda390c4d0 con 0x55cda3a03b60 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.613+0000 7f02cd7fa640 1 -- 10.20.193.28:0/2970072316 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f02fc033030 con 0x55cda3a03b60 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.613+0000 7f0313e21e00 10 client.16626 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.613+0000 7f0313e21e00 10 client.16626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.613+0000 7f0313e21e00 20 client.16626 populate_metadata read hostname 'trial028' 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.613+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cda3abf0d0 0x55cda3ac1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.613+0000 7f0313e21e00 4 client.16626 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.613+0000 7f0313e21e00 1 -- 10.20.193.28:0/2970072316 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cda36c1a20 con 0x55cda3abf0d0 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.613+0000 7f030affd640 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cda3abf0d0 0x55cda3ac1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.613+0000 7f030affd640 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cda3abf0d0 0x55cda3ac1590 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc94b135b9acfc4d server_cookie=81b762a6d680083a in_seq=0 out_seq=0 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.614+0000 7f02cd7fa640 10 client.16626 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.617+0000 7f02cd7fa640 1 -- 10.20.193.28:0/2970072316 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cda36c1a20 con 0x55cda3abf0d0 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.617+0000 7f02cd7fa640 10 client.16626 handle_command_reply: tid=0 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.617+0000 7f0313e21e00 1 client.16626 shutdown 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.618+0000 7f0313e21e00 1 -- 10.20.193.28:0/2970072316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda3a03b60 msgr2=0x55cda3abd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.618+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda3a03b60 0x55cda3abd750 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0090e0 tx=0x7f02fc004b40 comp rx=0 tx=0).stop 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.618+0000 7f0313e21e00 1 -- 10.20.193.28:0/2970072316 shutdown_connections 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.619+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cda3abf0d0 0x55cda3ac1590 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.619+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cda3a03b60 0x55cda3abd750 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.619+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cda39ffa70 0x55cda3a412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.619+0000 7f0313e21e00 1 --2- 10.20.193.28:0/2970072316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cda39ff0c0 0x55cda3a40d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.619+0000 7f0313e21e00 1 -- 10.20.193.28:0/2970072316 >> 10.20.193.28:0/2970072316 conn(0x55cda39f7b60 msgr2=0x55cda3a375a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.619+0000 7f02cd7fa640 0 client.16626 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.619+0000 7f0313e21e00 1 -- 10.20.193.28:0/2970072316 shutdown_connections 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.619+0000 7f0313e21e00 1 -- 10.20.193.28:0/2970072316 wait complete. 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.621+0000 7f0313e21e00 20 client.16626 trim_cache size 0 max 16384 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "abab9d6b-c28d-4670-968f-16e34554277e", 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02e00b0fa0 msgr2=0x7f02e00b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02e00b0fa0 0x7f02e00b3460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009fd0 tx=0x7f02fc009920 comp rx=0 tx=0).stop 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f030c1030a0 msgr2=0x7f030c19d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f030c1030a0 0x7f030c19d4e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f02f400d750 tx=0x7f02f400dc20 comp rx=0 tx=0).stop 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 shutdown_connections 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f02e00b0fa0 0x7f02e00b3460 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f030c108700 0x7f030c1a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f030c1030a0 0x7f030c19d4e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 --2- 10.20.193.28:0/2158915991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f030c102700 0x7f030c19cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 >> 10.20.193.28:0/2158915991 conn(0x7f030c0fe440 msgr2=0x7f030c10dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.624+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 shutdown_connections 2026-02-20T03:19:48.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:48.625+0000 7f030bfff640 1 -- 10.20.193.28:0/2158915991 wait complete. 2026-02-20T03:19:48.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe079ffb640 1 -- 10.20.193.28:0/3684633035 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55af690ec6b0 con 0x55af6926c730 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe079ffb640 10 client.26272 handle_command_reply: tid=0 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 client.26272 shutdown 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 -- 10.20.193.28:0/3684633035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 msgr2=0x55af691ea440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691ea440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009510 tx=0x7fe0ac0a3c20 comp rx=0 tx=0).stop 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 -- 10.20.193.28:0/3684633035 shutdown_connections 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55af6926c730 0x55af6926ebf0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55af691d0560 0x55af691ea440 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55af691cb7c0 0x55af691e9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 --2- 10.20.193.28:0/3684633035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55af691cae80 0x55af691e8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe079ffb640 0 client.26272 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 -- 10.20.193.28:0/3684633035 >> 10.20.193.28:0/3684633035 conn(0x55af691c26f0 msgr2=0x55af691c9570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 -- 10.20.193.28:0/3684633035 shutdown_connections 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 1 -- 10.20.193.28:0/3684633035 wait complete. 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.630+0000 7fe0c15fde00 20 client.26272 trim_cache size 0 max 16384 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:19:48.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 -- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe08c0b0ea0 msgr2=0x7fe08c0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe08c0b0ea0 0x7fe08c0b3360 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4002410 tx=0x7fe0a4005b00 comp rx=0 tx=0).stop 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 -- 10.20.193.28:0/1749725529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0b8104260 msgr2=0x7fe0b80759a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0b8104260 0x7fe0b80759a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00ef30 tx=0x7fe0ac00c560 comp rx=0 tx=0).stop 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 -- 10.20.193.28:0/1749725529 shutdown_connections 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe08c0b0ea0 0x7fe08c0b3360 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0b8104260 0x7fe0b80759a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0b81038a0 0x7fe0b8075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 --2- 10.20.193.28:0/1749725529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0b81026b0 0x7fe0b8076e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 -- 10.20.193.28:0/1749725529 >> 10.20.193.28:0/1749725529 conn(0x7fe0b80fde10 msgr2=0x7fe0b8106d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 -- 10.20.193.28:0/1749725529 shutdown_connections 2026-02-20T03:19:48.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:19:48.631+0000 7fe0bd50d640 1 -- 10.20.193.28:0/1749725529 wait complete. 2026-02-20T03:19:48.727 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:19:48.996 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:19:49.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.180+0000 7f75276e6640 1 -- 10.20.193.28:0/4137701108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 msgr2=0x7f7520115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.180+0000 7f75276e6640 1 --2- 10.20.193.28:0/4137701108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 0x7f7520115d10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7514009f90 tx=0x7f751402f390 comp rx=0 tx=0).stop 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.180+0000 7f75276e6640 1 -- 10.20.193.28:0/4137701108 shutdown_connections 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.180+0000 7f75276e6640 1 --2- 10.20.193.28:0/4137701108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 0x7f7520115d10 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.180+0000 7f75276e6640 1 --2- 10.20.193.28:0/4137701108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7520109220 0x7f7520109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.180+0000 7f75276e6640 1 --2- 10.20.193.28:0/4137701108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f752010eef0 0x7f752010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.180+0000 7f75276e6640 1 -- 10.20.193.28:0/4137701108 >> 10.20.193.28:0/4137701108 conn(0x7f7520078600 msgr2=0x7f752007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.180+0000 7f75276e6640 1 -- 10.20.193.28:0/4137701108 shutdown_connections 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.180+0000 7f75276e6640 1 -- 10.20.193.28:0/4137701108 wait complete. 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75276e6640 1 Processor -- start 2026-02-20T03:19:49.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75276e6640 1 -- start start 2026-02-20T03:19:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75276e6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7520109220 0x7f75201a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75276e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 0x7f75201a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75276e6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f752010eef0 0x7f75201a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75276e6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7520119090 con 0x7f7520109ba0 2026-02-20T03:19:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75276e6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7520118f10 con 0x7f7520109220 2026-02-20T03:19:49.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75276e6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7520119210 con 0x7f752010eef0 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75266e4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7520109220 0x7f75201a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f7525ee3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 0x7f75201a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75266e4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7520109220 0x7f75201a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35728/0 (socket says 10.20.193.28:35728) 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f75266e4640 1 -- 10.20.193.28:0/3318780141 learned_addr learned my addr 10.20.193.28:0/3318780141 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.181+0000 7f7525ee3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 0x7f75201a1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46782/0 (socket says 10.20.193.28:46782) 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f7526ee5640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f752010eef0 0x7f75201a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f7525ee3640 1 -- 10.20.193.28:0/3318780141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f752010eef0 msgr2=0x7f75201a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f7525ee3640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f752010eef0 0x7f75201a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f7525ee3640 1 -- 10.20.193.28:0/3318780141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7520109220 msgr2=0x7f75201a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f7525ee3640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7520109220 0x7f75201a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f7525ee3640 1 -- 10.20.193.28:0/3318780141 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75201a64a0 con 0x7f7520109ba0 2026-02-20T03:19:49.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f7525ee3640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 0x7f75201a1990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f750c00e9f0 tx=0x7f750c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:49.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f750b7fe640 1 -- 10.20.193.28:0/3318780141 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c00cd80 con 0x7f7520109ba0 2026-02-20T03:19:49.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f750b7fe640 1 -- 10.20.193.28:0/3318780141 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f750c004570 con 0x7f7520109ba0 2026-02-20T03:19:49.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f750b7fe640 1 -- 10.20.193.28:0/3318780141 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c010690 con 0x7f7520109ba0 2026-02-20T03:19:49.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f75276e6640 1 -- 10.20.193.28:0/3318780141 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75201a6790 con 0x7f7520109ba0 2026-02-20T03:19:49.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.182+0000 7f75276e6640 1 -- 10.20.193.28:0/3318780141 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75201adfd0 con 0x7f7520109ba0 2026-02-20T03:19:49.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.185+0000 7f750b7fe640 1 -- 10.20.193.28:0/3318780141 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f750c020030 con 0x7f7520109ba0 2026-02-20T03:19:49.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.185+0000 7f752ae74e00 1 Processor -- start 2026-02-20T03:19:49.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f752ae74e00 1 -- start start 2026-02-20T03:19:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05242a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052424a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052430e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f752ae74e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f0523a4e50 con 0x55f05242a000 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f752ae74e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f0523779c0 con 0x55f052424630 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f752ae74e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f052325240 con 0x55f052424fb0 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f75266e4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052424a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f7525ee3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052430e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f75266e4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052424a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35732/0 (socket says 10.20.193.28:35732) 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f75266e4640 1 -- 10.20.193.28:0/3539344949 learned_addr learned my addr 10.20.193.28:0/3539344949 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f7526ee5640 1 --2- 10.20.193.28:0/3539344949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05242a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f75266e4640 1 -- 10.20.193.28:0/3539344949 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 msgr2=0x55f052430e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f75266e4640 1 --2- 10.20.193.28:0/3539344949 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052430e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f75266e4640 1 -- 10.20.193.28:0/3539344949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 msgr2=0x55f05242a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:49.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f75266e4640 1 --2- 10.20.193.28:0/3539344949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05242a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f750b7fe640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74fc0b0ea0 0x7f74fc0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.186+0000 7f75266e4640 1 -- 10.20.193.28:0/3539344949 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f052338420 con 0x55f052424630 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.187+0000 7f7526ee5640 1 --2- 10.20.193.28:0/3539344949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05242a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.187+0000 7f750b7fe640 1 -- 10.20.193.28:0/3318780141 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f750c0e0bb0 con 0x7f7520109ba0 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.187+0000 7f75266e4640 1 --2- 10.20.193.28:0/3539344949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052424a70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7518007da0 tx=0x7f75180107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daf40103a710c83d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.187+0000 7f7525ee3640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74fc0b0ea0 0x7f74fc0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.187+0000 7f7508ff9640 1 -- 10.20.193.28:0/3539344949 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180042d0 con 0x55f052424630 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.187+0000 7f7508ff9640 1 -- 10.20.193.28:0/3539344949 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7518015030 con 0x55f052424630 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.187+0000 7f7508ff9640 1 -- 10.20.193.28:0/3539344949 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180117a0 con 0x55f052424630 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f752ae74e00 1 -- 10.20.193.28:0/3539344949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 msgr2=0x55f052424a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f752ae74e00 1 --2- 10.20.193.28:0/3539344949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052424a70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7518007da0 tx=0x7f75180107a0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f7525ee3640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74fc0b0ea0 0x7f74fc0b3360 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f750c0a8590 tx=0x7f750c002c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f752ae74e00 1 -- 10.20.193.28:0/3539344949 shutdown_connections 2026-02-20T03:19:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f752ae74e00 1 --2- 10.20.193.28:0/3539344949 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052430e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f752ae74e00 1 --2- 10.20.193.28:0/3539344949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052424a70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f752ae74e00 1 --2- 10.20.193.28:0/3539344949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05242a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f752ae74e00 1 -- 10.20.193.28:0/3539344949 >> 10.20.193.28:0/3539344949 conn(0x55f0523e7290 msgr2=0x55f052422d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f752ae74e00 1 -- 10.20.193.28:0/3539344949 shutdown_connections 2026-02-20T03:19:49.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.188+0000 7f752ae74e00 1 -- 10.20.193.28:0/3539344949 wait complete. 2026-02-20T03:19:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.189+0000 7f752ae74e00 1 -- start start 2026-02-20T03:19:49.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.189+0000 7f752ae74e00 1 Processor -- start 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 0x55f05243eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424fb0 0x55f05243f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05243d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f752ae74e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f0523738f0 con 0x55f05242a000 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f752ae74e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f052165f50 con 0x55f052424fb0 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f752ae74e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f05243da40 con 0x55f052424630 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f75266e4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424fb0 0x55f05243f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f7526ee5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05243d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f7526ee5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05243d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46800/0 (socket says 10.20.193.28:46800) 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f7526ee5640 1 -- 10.20.193.28:0/2131281366 learned_addr learned my addr 10.20.193.28:0/2131281366 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f7526ee5640 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 0x55f05243eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f7526ee5640 1 -- 10.20.193.28:0/2131281366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 msgr2=0x55f05243eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f7526ee5640 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 0x55f05243eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f7526ee5640 1 -- 10.20.193.28:0/2131281366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424fb0 msgr2=0x55f05243f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f7526ee5640 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424fb0 0x55f05243f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.190+0000 7f7526ee5640 1 -- 10.20.193.28:0/2131281366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f052436a80 con 0x55f05242a000 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f7526ee5640 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05243d2c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55f05243cb00 tx=0x7f7514009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f3890a4f86509a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f74d3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f74d3fff640 1 -- 10.20.193.28:0/2131281366 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514041040 con 0x55f05242a000 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f74d3fff640 1 -- 10.20.193.28:0/2131281366 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7514033040 con 0x55f05242a000 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f74d3fff640 1 -- 10.20.193.28:0/2131281366 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514002a60 con 0x55f05242a000 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f752ae74e00 1 -- 10.20.193.28:0/2131281366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f052148b40 con 0x55f05242a000 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f74d3fff640 1 -- 10.20.193.28:0/2131281366 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f7514002c00 con 0x55f05242a000 2026-02-20T03:19:49.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f752ae74e00 10 client.16638 _ll_register_callbacks cb 0x55f0523b0f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f752ae74e00 1 -- 10.20.193.28:0/2131281366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0523851a0 con 0x55f05242a000 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.191+0000 7f74d3fff640 1 -- 10.20.193.28:0/2131281366 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7514004520 con 0x55f05242a000 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f752ae74e00 10 client.16638 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f752ae74e00 1 -- 10.20.193.28:0/2131281366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f052332230 con 0x55f05242a000 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f74d3fff640 1 -- 10.20.193.28:0/2131281366 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f7514004b40 con 0x55f05242a000 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f752ae74e00 10 client.16638 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f752ae74e00 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f752ae74e00 20 client.16638 populate_metadata read hostname 'trial028' 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f05245e720 0x55f052460bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f752ae74e00 4 client.16638 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f752ae74e00 1 -- 10.20.193.28:0/2131281366 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f05237f5b0 con 0x55f05245e720 2026-02-20T03:19:49.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.192+0000 7f75266e4640 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f05245e720 0x55f052460bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.193+0000 7f75266e4640 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f05245e720 0x55f052460bc0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a992e991355357 server_cookie=54468770f3b356b5 in_seq=0 out_seq=0 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.193+0000 7f74d3fff640 10 client.16638 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.193+0000 7f74d3fff640 1 -- 10.20.193.28:0/2131281366 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f05237f5b0 con 0x55f05245e720 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.193+0000 7f74d3fff640 10 client.16638 handle_command_reply: tid=0 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 client.16638 shutdown 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 -- 10.20.193.28:0/2131281366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 msgr2=0x55f05243d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05243d2c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x55f05243cb00 tx=0x7f7514009920 comp rx=0 tx=0).stop 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 -- 10.20.193.28:0/2131281366 shutdown_connections 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f05245e720 0x55f052460bc0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f05243d2c0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424fb0 0x55f05243f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2131281366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 0x55f05243eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 -- 10.20.193.28:0/2131281366 >> 10.20.193.28:0/2131281366 conn(0x55f0523e7290 msgr2=0x55f052423440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:49.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f74d3fff640 0 client.16638 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:49.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 -- 10.20.193.28:0/2131281366 shutdown_connections 2026-02-20T03:19:49.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 1 -- 10.20.193.28:0/2131281366 wait complete. 2026-02-20T03:19:49.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.194+0000 7f752ae74e00 20 client.16638 trim_cache size 0 max 16384 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f752ae74e00 1 Processor -- start 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f752ae74e00 1 -- start start 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052423520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052423a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f0524664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f752ae74e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74c80126c0 con 0x55f05242a000 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f752ae74e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f74c800ff60 con 0x55f052424630 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f752ae74e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f74c800ddb0 con 0x55f052424fb0 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f7526ee5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052423520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f75266e4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052423a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f7526ee5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f0524664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f75266e4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052423a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54600/0 (socket says 10.20.193.28:54600) 2026-02-20T03:19:49.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f75266e4640 1 -- 10.20.193.28:0/2099991122 learned_addr learned my addr 10.20.193.28:0/2099991122 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f75266e4640 1 -- 10.20.193.28:0/2099991122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 msgr2=0x55f052423520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f75266e4640 1 --2- 10.20.193.28:0/2099991122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052423520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f75266e4640 1 -- 10.20.193.28:0/2099991122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 msgr2=0x55f0524664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f75266e4640 1 --2- 10.20.193.28:0/2099991122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f0524664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.203+0000 7f75266e4640 1 -- 10.20.193.28:0/2099991122 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0524368b0 con 0x55f052424fb0 2026-02-20T03:19:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f7526ee5640 1 --2- 10.20.193.28:0/2099991122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052423520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:19:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f75266e4640 1 --2- 10.20.193.28:0/2099991122 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052423a60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7518007da0 tx=0x7f7518002870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2758c81a4e0fd12c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:49.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f74ee4e6640 1 -- 10.20.193.28:0/2099991122 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518005980 con 0x55f052424fb0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f74ee4e6640 1 -- 10.20.193.28:0/2099991122 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f75180055f0 con 0x55f052424fb0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f74ee4e6640 1 -- 10.20.193.28:0/2099991122 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180278a0 con 0x55f052424fb0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f752ae74e00 1 -- 10.20.193.28:0/2099991122 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 msgr2=0x55f052423a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2099991122 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052423a60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7518007da0 tx=0x7f7518002870 comp rx=0 tx=0).stop 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f752ae74e00 1 -- 10.20.193.28:0/2099991122 shutdown_connections 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2099991122 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f05242a000 0x55f0524664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2099991122 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424fb0 0x55f052423a60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f752ae74e00 1 --2- 10.20.193.28:0/2099991122 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f052424630 0x55f052423520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f752ae74e00 1 -- 10.20.193.28:0/2099991122 >> 10.20.193.28:0/2099991122 conn(0x55f0523e7290 msgr2=0x55f05243c270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.204+0000 7f752ae74e00 1 -- 10.20.193.28:0/2099991122 shutdown_connections 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.205+0000 7f752ae74e00 1 -- 10.20.193.28:0/2099991122 wait complete. 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.205+0000 7f752ae74e00 1 -- start start 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.205+0000 7f752ae74e00 1 Processor -- start 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.205+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 0x55f0524419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.205+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f052424fb0 0x55f052441f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.205+0000 7f752ae74e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f05242a000 0x55f052442460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.205+0000 7f752ae74e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74c800e420 con 0x55f052424fb0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.205+0000 7f752ae74e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f74c800f890 con 0x55f05242a000 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.205+0000 7f752ae74e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f74c800eaf0 con 0x55f052424630 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f75266e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f052424fb0 0x55f052441f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f75266e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f052424fb0 0x55f052441f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46826/0 (socket says 10.20.193.28:46826) 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f75266e4640 1 -- 10.20.193.28:0/169014194 learned_addr learned my addr 10.20.193.28:0/169014194 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f7526ee5640 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 0x55f0524419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f7526ee5640 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f05242a000 0x55f052442460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f75266e4640 1 -- 10.20.193.28:0/169014194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 msgr2=0x55f0524419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f75266e4640 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 0x55f0524419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f75266e4640 1 -- 10.20.193.28:0/169014194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f05242a000 msgr2=0x55f052442460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f75266e4640 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f05242a000 0x55f052442460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f75266e4640 1 -- 10.20.193.28:0/169014194 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f052056870 con 0x55f052424fb0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f75266e4640 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f052424fb0 0x55f052441f20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7518007560 tx=0x7f75180026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502da47e885f5f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f74d3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f74d3fff640 1 -- 10.20.193.28:0/169014194 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75180071c0 con 0x55f052424fb0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f74d3fff640 1 -- 10.20.193.28:0/169014194 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7518015070 con 0x55f052424fb0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f74d3fff640 1 -- 10.20.193.28:0/169014194 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518011a60 con 0x55f052424fb0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f752ae74e00 1 -- 10.20.193.28:0/169014194 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f052317440 con 0x55f052424fb0 2026-02-20T03:19:49.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f752ae74e00 10 client.16644 _ll_register_callbacks cb 0x7f7514009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.206+0000 7f752ae74e00 1 -- 10.20.193.28:0/169014194 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75180055f0 con 0x55f052424fb0 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f74d3fff640 1 -- 10.20.193.28:0/169014194 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f75180029e0 con 0x55f052424fb0 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f74d3fff640 1 -- 10.20.193.28:0/169014194 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7518040050 con 0x55f052424fb0 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f752ae74e00 10 client.16644 fetch_fsmap learned FSMap version 28 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f752ae74e00 1 -- 10.20.193.28:0/169014194 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55f0524375a0 con 0x55f052424fb0 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f74d3fff640 1 -- 10.20.193.28:0/169014194 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f7518011c00 con 0x55f052424fb0 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f752ae74e00 10 client.16644 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f752ae74e00 10 client.16644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f752ae74e00 20 client.16644 populate_metadata read hostname 'trial028' 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f752ae74e00 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0524cab30 0x55f0524ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f752ae74e00 4 client.16644 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f752ae74e00 1 -- 10.20.193.28:0/169014194 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f05237f5b0 con 0x55f0524cab30 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.207+0000 7f7526ee5640 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0524cab30 0x55f0524ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f7526ee5640 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0524cab30 0x55f0524ccff0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9726aaa6fa832fdc server_cookie=5ace8b49f0fe926 in_seq=0 out_seq=0 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f74d3fff640 10 client.16644 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f74d3fff640 1 -- 10.20.193.28:0/169014194 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f05237f5b0 con 0x55f0524cab30 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f74d3fff640 10 client.16644 handle_command_reply: tid=0 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 client.16644 shutdown 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 -- 10.20.193.28:0/169014194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f052424fb0 msgr2=0x55f052441f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f052424fb0 0x55f052441f20 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7518007560 tx=0x7f75180026e0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 -- 10.20.193.28:0/169014194 shutdown_connections 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0524cab30 0x55f0524ccff0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f05242a000 0x55f052442460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f052424fb0 0x55f052441f20 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 --2- 10.20.193.28:0/169014194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f052424630 0x55f0524419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 -- 10.20.193.28:0/169014194 >> 10.20.193.28:0/169014194 conn(0x55f0523e7290 msgr2=0x55f05245eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f74d3fff640 0 client.16644 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 -- 10.20.193.28:0/169014194 shutdown_connections 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.208+0000 7f752ae74e00 1 -- 10.20.193.28:0/169014194 wait complete. 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f752ae74e00 20 client.16644 trim_cache size 0 max 16384 2026-02-20T03:19:49.213 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stdout: "abab9d6b-c28d-4670-968f-16e34554277e": { 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "abab9d6b-c28d-4670-968f-16e34554277e", 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 -- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74fc0b0ea0 msgr2=0x7f74fc0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74fc0b0ea0 0x7f74fc0b3360 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f750c0a8590 tx=0x7f750c002c60 comp rx=0 tx=0).stop 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 -- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 msgr2=0x7f75201a1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 0x7f75201a1990 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f750c00e9f0 tx=0x7f750c00eec0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 -- 10.20.193.28:0/3318780141 shutdown_connections 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74fc0b0ea0 0x7f74fc0b3360 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f752010eef0 0x7f75201a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7520109ba0 0x7f75201a1990 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 --2- 10.20.193.28:0/3318780141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7520109220 0x7f75201a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 -- 10.20.193.28:0/3318780141 >> 10.20.193.28:0/3318780141 conn(0x7f7520078600 msgr2=0x7f7520079cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 -- 10.20.193.28:0/3318780141 shutdown_connections 2026-02-20T03:19:49.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:19:49.209+0000 7f75276e6640 1 -- 10.20.193.28:0/3318780141 wait complete. 2026-02-20T03:19:49.310 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:49 trial028 ceph-mon[38552]: pgmap v335: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 883 KiB/s rd, 1.9 MiB/s wr, 151 op/s 2026-02-20T03:19:49.312 INFO:tasks.cephfs.filesystem:scrub status for tag:abab9d6b-c28d-4670-968f-16e34554277e - {'path': '/', 'tag': 'abab9d6b-c28d-4670-968f-16e34554277e', 'options': 'recursive,force'} 2026-02-20T03:19:49.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:49 trial177 ceph-mon[43181]: pgmap v335: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 883 KiB/s rd, 1.9 MiB/s wr, 151 op/s 2026-02-20T03:19:49.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 5.15 MB/sec execute 82 sec latency 6263.091 ms 2026-02-20T03:19:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:49 trial126 ceph-mon[38476]: pgmap v335: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 883 KiB/s rd, 1.9 MiB/s wr, 151 op/s 2026-02-20T03:19:50.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:50 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:19:50.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:50 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:50 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:19:50.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:50 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:19:50.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:50 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:50 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:19:50.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:50 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:50 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 5.08 MB/sec execute 83 sec latency 7263.139 ms 2026-02-20T03:19:50.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:50 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:19:50.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:50 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:50 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:19:50.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:50 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:19:50.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:50 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:50 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:19:50.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:50 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:50 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:50 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:19:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:50 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:50 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:19:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:50 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:19:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:50 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:50 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:19:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:50 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:50 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:19:51.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:51 trial177 ceph-mon[43181]: pgmap v336: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 855 KiB/s rd, 1.6 MiB/s wr, 141 op/s 2026-02-20T03:19:51.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 5.02 MB/sec execute 84 sec latency 8263.181 ms 2026-02-20T03:19:51.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:51 trial126 ceph-mon[38476]: pgmap v336: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 855 KiB/s rd, 1.6 MiB/s wr, 141 op/s 2026-02-20T03:19:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:51 trial028 ceph-mon[38552]: pgmap v336: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 855 KiB/s rd, 1.6 MiB/s wr, 141 op/s 2026-02-20T03:19:52.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.96 MB/sec execute 85 sec latency 9263.230 ms 2026-02-20T03:19:53.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:53 trial177 ceph-mon[43181]: pgmap v337: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 704 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2026-02-20T03:19:53.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.91 MB/sec execute 86 sec latency 10263.276 ms 2026-02-20T03:19:53.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:53 trial126 ceph-mon[38476]: pgmap v337: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 704 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2026-02-20T03:19:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:53 trial028 ceph-mon[38552]: pgmap v337: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 704 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2026-02-20T03:19:54.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.85 MB/sec execute 87 sec latency 11263.319 ms 2026-02-20T03:19:55.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:55 trial177 ceph-mon[43181]: pgmap v338: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 538 KiB/s rd, 977 KiB/s wr, 116 op/s 2026-02-20T03:19:55.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.80 MB/sec execute 88 sec latency 12263.368 ms 2026-02-20T03:19:55.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:55 trial126 ceph-mon[38476]: pgmap v338: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 538 KiB/s rd, 977 KiB/s wr, 116 op/s 2026-02-20T03:19:55.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:55 trial028 ceph-mon[38552]: pgmap v338: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 538 KiB/s rd, 977 KiB/s wr, 116 op/s 2026-02-20T03:19:56.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.74 MB/sec execute 89 sec latency 13263.401 ms 2026-02-20T03:19:57.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:57 trial177 ceph-mon[43181]: pgmap v339: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 75 KiB/s rd, 498 KiB/s wr, 69 op/s 2026-02-20T03:19:57.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.69 MB/sec execute 90 sec latency 14263.435 ms 2026-02-20T03:19:57.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:57 trial126 ceph-mon[38476]: pgmap v339: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 75 KiB/s rd, 498 KiB/s wr, 69 op/s 2026-02-20T03:19:57.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:57 trial028 ceph-mon[38552]: pgmap v339: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 75 KiB/s rd, 498 KiB/s wr, 69 op/s 2026-02-20T03:19:58.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:19:58.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:19:58.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.64 MB/sec execute 91 sec latency 15263.464 ms 2026-02-20T03:19:58.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:19:58.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:19:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:19:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:19:59.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:59 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:19:59.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:19:59 trial177 ceph-mon[43181]: pgmap v340: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 26 KiB/s wr, 41 op/s 2026-02-20T03:19:59.497 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:59 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:19:59.497 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:19:59 trial126 ceph-mon[38476]: pgmap v340: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 26 KiB/s wr, 41 op/s 2026-02-20T03:19:59.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.59 MB/sec execute 92 sec latency 16263.505 ms 2026-02-20T03:19:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:59 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:19:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:19:59 trial028 ceph-mon[38552]: pgmap v340: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 52 KiB/s rd, 26 KiB/s wr, 41 op/s 2026-02-20T03:20:00.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:00 trial177 ceph-mon[43181]: overall HEALTH_OK 2026-02-20T03:20:00.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.54 MB/sec execute 93 sec latency 17263.538 ms 2026-02-20T03:20:00.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:00 trial126 ceph-mon[38476]: overall HEALTH_OK 2026-02-20T03:20:00.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:00 trial028 ceph-mon[38552]: overall HEALTH_OK 2026-02-20T03:20:01.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:01 trial177 ceph-mon[43181]: pgmap v341: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 15 KiB/s wr, 33 op/s 2026-02-20T03:20:01.504 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.49 MB/sec execute 94 sec latency 18263.575 ms 2026-02-20T03:20:01.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:01 trial126 ceph-mon[38476]: pgmap v341: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 15 KiB/s wr, 33 op/s 2026-02-20T03:20:01.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:01 trial028 ceph-mon[38552]: pgmap v341: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 21 KiB/s rd, 15 KiB/s wr, 33 op/s 2026-02-20T03:20:01.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.709+0000 7f4651d54640 1 -- 10.20.193.28:0/1168631598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c10a900 msgr2=0x7f464c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:01.712 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.709+0000 7f4651d54640 1 --2- 10.20.193.28:0/1168631598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c10a900 0x7f464c111480 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f464800b0a0 tx=0x7f464802f410 comp rx=0 tx=0).stop 2026-02-20T03:20:01.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.709+0000 7f4651d54640 1 -- 10.20.193.28:0/1168631598 shutdown_connections 2026-02-20T03:20:01.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.709+0000 7f4651d54640 1 --2- 10.20.193.28:0/1168631598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c10a900 0x7f464c111480 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.709+0000 7f4651d54640 1 --2- 10.20.193.28:0/1168631598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f464c109e60 0x7f464c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.709+0000 7f4651d54640 1 --2- 10.20.193.28:0/1168631598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f464c109490 0x7f464c109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.709+0000 7f4651d54640 1 -- 10.20.193.28:0/1168631598 >> 10.20.193.28:0/1168631598 conn(0x7f464c077fe0 msgr2=0x7f464c07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:01.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.709+0000 7f4651d54640 1 -- 10.20.193.28:0/1168631598 shutdown_connections 2026-02-20T03:20:01.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.709+0000 7f4651d54640 1 -- 10.20.193.28:0/1168631598 wait complete. 2026-02-20T03:20:01.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4651d54640 1 Processor -- start 2026-02-20T03:20:01.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4651d54640 1 -- start start 2026-02-20T03:20:01.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4651d54640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f464c109490 0x7f464c1a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4651d54640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c109e60 0x7f464c1a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4651d54640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f464c10a900 0x7f464c1a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4651d54640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f464c114930 con 0x7f464c109e60 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4651d54640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f464c1147b0 con 0x7f464c10a900 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4651d54640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f464c114ab0 con 0x7f464c109490 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4643fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c109e60 0x7f464c1a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4650d52640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f464c109490 0x7f464c1a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4643fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c109e60 0x7f464c1a13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43382/0 (socket says 10.20.193.28:43382) 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.710+0000 7f4643fff640 1 -- 10.20.193.28:0/3340651417 learned_addr learned my addr 10.20.193.28:0/3340651417 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4651553640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f464c10a900 0x7f464c1a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4643fff640 1 -- 10.20.193.28:0/3340651417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f464c109490 msgr2=0x7f464c1a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:01.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4643fff640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f464c109490 0x7f464c1a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4643fff640 1 -- 10.20.193.28:0/3340651417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f464c10a900 msgr2=0x7f464c1a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4643fff640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f464c10a900 0x7f464c1a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4643fff640 1 -- 10.20.193.28:0/3340651417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464c1a8b60 con 0x7f464c109e60 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4651553640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f464c10a900 0x7f464c1a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4643fff640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c109e60 0x7f464c1a13f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f463400ea10 tx=0x7f463400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4641ffb640 1 -- 10.20.193.28:0/3340651417 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463400ce50 con 0x7f464c109e60 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4641ffb640 1 -- 10.20.193.28:0/3340651417 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f463400ce50 con 0x7f464c109e60 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4651d54640 1 -- 10.20.193.28:0/3340651417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f464c1a8e50 con 0x7f464c109e60 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4641ffb640 1 -- 10.20.193.28:0/3340651417 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634002e10 con 0x7f464c109e60 2026-02-20T03:20:01.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.711+0000 7f4651d54640 1 -- 10.20.193.28:0/3340651417 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f464c1a9360 con 0x7f464c109e60 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.714+0000 7f4641ffb640 1 -- 10.20.193.28:0/3340651417 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f46340040d0 con 0x7f464c109e60 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.714+0000 7f4655e37e00 1 Processor -- start 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4655e37e00 1 -- start start 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfb8a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfb8ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 0x5627bfb919f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4655e37e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5627bfada8f0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4655e37e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5627bfa882e0 con 0x5627bfb89e80 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4655e37e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5627bfad6820 con 0x5627bfb8f560 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4650d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfb8ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4651553640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfb8a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4650d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfb8ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43386/0 (socket says 10.20.193.28:43386) 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4650d52640 1 -- 10.20.193.28:0/993822426 learned_addr learned my addr 10.20.193.28:0/993822426 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4651553640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfb8a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35002/0 (socket says 10.20.193.28:35002) 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4643fff640 1 --2- 10.20.193.28:0/993822426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 0x5627bfb919f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4650d52640 1 -- 10.20.193.28:0/993822426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 msgr2=0x5627bfb919f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4650d52640 1 --2- 10.20.193.28:0/993822426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 0x5627bfb919f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4650d52640 1 -- 10.20.193.28:0/993822426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 msgr2=0x5627bfb8a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:01.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4650d52640 1 --2- 10.20.193.28:0/993822426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfb8a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4650d52640 1 -- 10.20.193.28:0/993822426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bfa7a5a0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4643fff640 1 --2- 10.20.193.28:0/993822426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 0x5627bfb919f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4650d52640 1 --2- 10.20.193.28:0/993822426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfb8ef40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f463c004590 tx=0x7f463c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef40e6355e93b384 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4641ffb640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46280b1020 0x7f46280b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.715+0000 7f4641ffb640 1 -- 10.20.193.28:0/3340651417 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f46340e0c80 con 0x7f464c109e60 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f46193fe640 1 -- 10.20.193.28:0/993822426 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c009e50 con 0x5627bfb8a7c0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f46193fe640 1 -- 10.20.193.28:0/993822426 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f463c01a8e0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f46193fe640 1 -- 10.20.193.28:0/993822426 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c010990 con 0x5627bfb8a7c0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4651553640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46280b1020 0x7f46280b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4655e37e00 1 -- 10.20.193.28:0/993822426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 msgr2=0x5627bfb8ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4655e37e00 1 --2- 10.20.193.28:0/993822426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfb8ef40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f463c004590 tx=0x7f463c009c50 comp rx=0 tx=0).stop 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4655e37e00 1 -- 10.20.193.28:0/993822426 shutdown_connections 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4655e37e00 1 --2- 10.20.193.28:0/993822426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 0x5627bfb919f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4655e37e00 1 --2- 10.20.193.28:0/993822426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfb8ef40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4655e37e00 1 --2- 10.20.193.28:0/993822426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfb8a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4655e37e00 1 -- 10.20.193.28:0/993822426 >> 10.20.193.28:0/993822426 conn(0x5627bfb816f0 msgr2=0x5627bfb88570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4655e37e00 1 -- 10.20.193.28:0/993822426 shutdown_connections 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4655e37e00 1 -- 10.20.193.28:0/993822426 wait complete. 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.716+0000 7f4651553640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46280b1020 0x7f46280b34e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4648009e60 tx=0x7f464803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.717+0000 7f4655e37e00 1 -- start start 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.717+0000 7f4655e37e00 1 Processor -- start 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfba2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 0x5627bfba9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4655e37e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5627bfa820c0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4655e37e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5627bfb92610 con 0x5627bfb89e80 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4655e37e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5627bfbaa2a0 con 0x5627bfb8f560 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4643fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4643fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43402/0 (socket says 10.20.193.28:43402) 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4643fff640 1 -- 10.20.193.28:0/3964955641 learned_addr learned my addr 10.20.193.28:0/3964955641 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4650d52640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfba2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4651553640 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 0x5627bfba9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4643fff640 1 -- 10.20.193.28:0/3964955641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 msgr2=0x5627bfba9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4643fff640 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 0x5627bfba9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4643fff640 1 -- 10.20.193.28:0/3964955641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 msgr2=0x5627bfba2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:01.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4643fff640 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfba2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4643fff640 1 -- 10.20.193.28:0/3964955641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bfb9c090 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f4643fff640 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba2e90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f46340a88f0 tx=0x7f4634002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef14399e757c718 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.718+0000 7f460a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f460a7fc640 1 -- 10.20.193.28:0/3964955641 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46340043f0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f460a7fc640 1 -- 10.20.193.28:0/3964955641 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f46340af0c0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f460a7fc640 1 -- 10.20.193.28:0/3964955641 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46340a43e0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 1 -- 10.20.193.28:0/3964955641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627bfa96820 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f460a7fc640 1 -- 10.20.193.28:0/3964955641 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f46340a73e0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f460a7fc640 10 client.16656 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 10 client.16656 _ll_register_callbacks cb 0x5627bfa85ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 1 -- 10.20.193.28:0/3964955641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5627bfae24e0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f460a7fc640 1 -- 10.20.193.28:0/3964955641 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f46340af270 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 10 client.16656 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 1 -- 10.20.193.28:0/3964955641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5627bfa9b380 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f460a7fc640 1 -- 10.20.193.28:0/3964955641 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f46340b1730 con 0x5627bfb8a7c0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 10 client.16656 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 20 client.16656 populate_metadata read hostname 'trial028' 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627bfbae530 0x5627bfbb09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 4 client.16656 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.719+0000 7f4655e37e00 1 -- 10.20.193.28:0/3964955641 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627bfa5cbd0 con 0x5627bfbae530 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.720+0000 7f4650d52640 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627bfbae530 0x5627bfbb09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.720+0000 7f4650d52640 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627bfbae530 0x5627bfbb09c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04b7f1b77e0406a server_cookie=b997b0cdc555511c in_seq=0 out_seq=0 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.720+0000 7f460a7fc640 10 client.16656 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f460a7fc640 1 -- 10.20.193.28:0/3964955641 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5627bfa5cbd0 con 0x5627bfbae530 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f460a7fc640 10 client.16656 handle_command_reply: tid=0 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 client.16656 shutdown 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 -- 10.20.193.28:0/3964955641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 msgr2=0x5627bfba2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba2e90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f46340a88f0 tx=0x7f4634002910 comp rx=0 tx=0).stop 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 -- 10.20.193.28:0/3964955641 shutdown_connections 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627bfbae530 0x5627bfbb09c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8f560 0x5627bfba9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba2e90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 --2- 10.20.193.28:0/3964955641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfba2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 -- 10.20.193.28:0/3964955641 >> 10.20.193.28:0/3964955641 conn(0x5627bfb816f0 msgr2=0x5627bfb90910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f460a7fc640 0 client.16656 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 -- 10.20.193.28:0/3964955641 shutdown_connections 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 1 -- 10.20.193.28:0/3964955641 wait complete. 2026-02-20T03:20:01.725 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.721+0000 7f4655e37e00 20 client.16656 trim_cache size 0 max 16384 2026-02-20T03:20:01.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4655e37e00 1 Processor -- start 2026-02-20T03:20:01.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4655e37e00 1 -- start start 2026-02-20T03:20:01.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb89e80 0x5627bfba19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb8f560 0x5627bfb9f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4655e37e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f45f0012650 con 0x5627bfb8a7c0 2026-02-20T03:20:01.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4655e37e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f45f000fef0 con 0x5627bfb8f560 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4655e37e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f45f000dd40 con 0x5627bfb89e80 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4643fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4643fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43418/0 (socket says 10.20.193.28:43418) 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4643fff640 1 -- 10.20.193.28:0/2266086366 learned_addr learned my addr 10.20.193.28:0/2266086366 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4650d52640 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb89e80 0x5627bfba19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4651553640 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb8f560 0x5627bfb9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4643fff640 1 -- 10.20.193.28:0/2266086366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb89e80 msgr2=0x5627bfba19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4643fff640 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb89e80 0x5627bfba19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4643fff640 1 -- 10.20.193.28:0/2266086366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb8f560 msgr2=0x5627bfb9f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4643fff640 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb8f560 0x5627bfb9f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4643fff640 1 -- 10.20.193.28:0/2266086366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bfb9bec0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.729+0000 7f4651553640 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb8f560 0x5627bfb9f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4643fff640 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba9cd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f463400e9e0 tx=0x7f46340ce000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef95c3ab646f19f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4618bfd640 1 -- 10.20.193.28:0/2266086366 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46340026e0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4618bfd640 1 -- 10.20.193.28:0/2266086366 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5627bfae24e0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4618bfd640 1 -- 10.20.193.28:0/2266086366 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46340a42e0 con 0x5627bfb8a7c0 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4655e37e00 1 -- 10.20.193.28:0/2266086366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 msgr2=0x5627bfba9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4655e37e00 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba9cd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f463400e9e0 tx=0x7f46340ce000 comp rx=0 tx=0).stop 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4655e37e00 1 -- 10.20.193.28:0/2266086366 shutdown_connections 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4655e37e00 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb8f560 0x5627bfb9f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4655e37e00 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8a7c0 0x5627bfba9cd0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4655e37e00 1 --2- 10.20.193.28:0/2266086366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb89e80 0x5627bfba19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4655e37e00 1 -- 10.20.193.28:0/2266086366 >> 10.20.193.28:0/2266086366 conn(0x5627bfb816f0 msgr2=0x5627bfb8b700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4655e37e00 1 -- 10.20.193.28:0/2266086366 shutdown_connections 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.730+0000 7f4655e37e00 1 -- 10.20.193.28:0/2266086366 wait complete. 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4655e37e00 1 -- start start 2026-02-20T03:20:01.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4655e37e00 1 Processor -- start 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfba7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8a7c0 0x5627bfba8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4655e37e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8f560 0x5627bfba92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4655e37e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f45f000e3b0 con 0x5627bfb8f560 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4655e37e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f45f000f820 con 0x5627bfb89e80 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4655e37e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f45f000ea80 con 0x5627bfb8a7c0 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4651553640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8f560 0x5627bfba92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4651553640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8f560 0x5627bfba92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43422/0 (socket says 10.20.193.28:43422) 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4651553640 1 -- 10.20.193.28:0/1901956086 learned_addr learned my addr 10.20.193.28:0/1901956086 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4650d52640 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfba7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4643fff640 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8a7c0 0x5627bfba8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4651553640 1 -- 10.20.193.28:0/1901956086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8a7c0 msgr2=0x5627bfba8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4651553640 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8a7c0 0x5627bfba8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4651553640 1 -- 10.20.193.28:0/1901956086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 msgr2=0x5627bfba7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4651553640 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfba7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.731+0000 7f4651553640 1 -- 10.20.193.28:0/1901956086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bfb92370 con 0x5627bfb8f560 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f4651553640 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8f560 0x5627bfba92b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4648036000 tx=0x7f464802f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd74f0f61b1fa0e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:01.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f460a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f460a7fc640 1 -- 10.20.193.28:0/1901956086 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648054070 con 0x5627bfb8f560 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f460a7fc640 1 -- 10.20.193.28:0/1901956086 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4648033050 con 0x5627bfb8f560 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f460a7fc640 1 -- 10.20.193.28:0/1901956086 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464804f990 con 0x5627bfb8f560 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f4655e37e00 1 -- 10.20.193.28:0/1901956086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627bf83a690 con 0x5627bfb8f560 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f4655e37e00 10 client.16662 _ll_register_callbacks cb 0x7f46340a8060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f4655e37e00 1 -- 10.20.193.28:0/1901956086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f463c01a8e0 con 0x5627bfb8f560 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f460a7fc640 1 -- 10.20.193.28:0/1901956086 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f464804fb30 con 0x5627bfb8f560 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f460a7fc640 1 -- 10.20.193.28:0/1901956086 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f464805e050 con 0x5627bfb8f560 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f4655e37e00 10 client.16662 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f4655e37e00 1 -- 10.20.193.28:0/1901956086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5627bfa9fb70 con 0x5627bfb8f560 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f460a7fc640 1 -- 10.20.193.28:0/1901956086 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f464804e070 con 0x5627bfb8f560 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f4655e37e00 10 client.16662 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f4655e37e00 10 client.16662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.732+0000 7f4655e37e00 20 client.16662 populate_metadata read hostname 'trial028' 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.733+0000 7f4655e37e00 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627bfc1a120 0x5627bfc1c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:01.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.733+0000 7f4655e37e00 4 client.16662 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:20:01.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.733+0000 7f4655e37e00 1 -- 10.20.193.28:0/1901956086 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5627bf8b3520 con 0x5627bfc1a120 2026-02-20T03:20:01.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.733+0000 7f4650d52640 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627bfc1a120 0x5627bfc1c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:01.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.734+0000 7f4650d52640 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627bfc1a120 0x5627bfc1c5e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11af390346d3994e server_cookie=aebc1018be9bf101 in_seq=0 out_seq=0 2026-02-20T03:20:01.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.734+0000 7f460a7fc640 10 client.16662 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:01.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f460a7fc640 1 -- 10.20.193.28:0/1901956086 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5627bf8b3520 con 0x5627bfc1a120 2026-02-20T03:20:01.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f460a7fc640 10 client.16662 handle_command_reply: tid=0 2026-02-20T03:20:01.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 client.16662 shutdown 2026-02-20T03:20:01.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 -- 10.20.193.28:0/1901956086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8f560 msgr2=0x5627bfba92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8f560 0x5627bfba92b0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4648036000 tx=0x7f464802f410 comp rx=0 tx=0).stop 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 -- 10.20.193.28:0/1901956086 shutdown_connections 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627bfc1a120 0x5627bfc1c5e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627bfb8f560 0x5627bfba92b0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5627bfb8a7c0 0x5627bfba8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 --2- 10.20.193.28:0/1901956086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627bfb89e80 0x5627bfba7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 -- 10.20.193.28:0/1901956086 >> 10.20.193.28:0/1901956086 conn(0x5627bfb816f0 msgr2=0x5627bfba1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f460a7fc640 0 client.16662 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 -- 10.20.193.28:0/1901956086 shutdown_connections 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 1 -- 10.20.193.28:0/1901956086 wait complete. 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.740+0000 7f4655e37e00 20 client.16662 trim_cache size 0 max 16384 2026-02-20T03:20:01.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 -- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46280b1020 msgr2=0x7f46280b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46280b1020 0x7f46280b34e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4648009e60 tx=0x7f464803a040 comp rx=0 tx=0).stop 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 -- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c109e60 msgr2=0x7f464c1a13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c109e60 0x7f464c1a13f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f463400ea10 tx=0x7f463400eee0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 -- 10.20.193.28:0/3340651417 shutdown_connections 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46280b1020 0x7f46280b34e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f464c10a900 0x7f464c1a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f464c109e60 0x7f464c1a13f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 --2- 10.20.193.28:0/3340651417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f464c109490 0x7f464c1a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 -- 10.20.193.28:0/3340651417 >> 10.20.193.28:0/3340651417 conn(0x7f464c077fe0 msgr2=0x7f464c10d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 -- 10.20.193.28:0/3340651417 shutdown_connections 2026-02-20T03:20:01.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:01.741+0000 7f4651d54640 1 -- 10.20.193.28:0/3340651417 wait complete. 2026-02-20T03:20:02.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.44 MB/sec execute 95 sec latency 19263.609 ms 2026-02-20T03:20:03.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:03 trial177 ceph-mon[43181]: pgmap v342: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 9.8 KiB/s wr, 21 op/s 2026-02-20T03:20:03.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.40 MB/sec execute 96 sec latency 20263.657 ms 2026-02-20T03:20:03.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:03 trial126 ceph-mon[38476]: pgmap v342: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 9.8 KiB/s wr, 21 op/s 2026-02-20T03:20:03.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:03 trial028 ceph-mon[38552]: pgmap v342: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 9.8 KiB/s wr, 21 op/s 2026-02-20T03:20:04.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.35 MB/sec execute 97 sec latency 21263.698 ms 2026-02-20T03:20:05.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:05 trial177 ceph-mon[43181]: pgmap v343: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 16 op/s 2026-02-20T03:20:05.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.31 MB/sec execute 98 sec latency 22263.744 ms 2026-02-20T03:20:05.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:05 trial126 ceph-mon[38476]: pgmap v343: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 16 op/s 2026-02-20T03:20:05.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:05 trial028 ceph-mon[38552]: pgmap v343: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 16 op/s 2026-02-20T03:20:06.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.26 MB/sec execute 99 sec latency 23263.777 ms 2026-02-20T03:20:07.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:07 trial177 ceph-mon[43181]: pgmap v344: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2026-02-20T03:20:07.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.22 MB/sec execute 100 sec latency 24263.806 ms 2026-02-20T03:20:07.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:07 trial126 ceph-mon[38476]: pgmap v344: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2026-02-20T03:20:07.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:07 trial028 ceph-mon[38552]: pgmap v344: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2026-02-20T03:20:08.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.18 MB/sec execute 101 sec latency 25263.837 ms 2026-02-20T03:20:09.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:09 trial177 ceph-mon[43181]: pgmap v345: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2026-02-20T03:20:09.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.14 MB/sec execute 102 sec latency 26263.882 ms 2026-02-20T03:20:09.559 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:20:09.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:09 trial126 ceph-mon[38476]: pgmap v345: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2026-02-20T03:20:09.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:09 trial028 ceph-mon[38552]: pgmap v345: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2026-02-20T03:20:09.825 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:10.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.011+0000 7f59a8e85640 1 -- 10.20.193.28:0/2022321104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4104da0 msgr2=0x7f59a4105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.011+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2022321104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4104da0 0x7f59a4105180 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5998009a30 tx=0x7f599802f220 comp rx=0 tx=0).stop 2026-02-20T03:20:10.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.011+0000 7f59a8e85640 1 -- 10.20.193.28:0/2022321104 shutdown_connections 2026-02-20T03:20:10.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.011+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2022321104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f59a4109ed0 0x7f59a4111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.011+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2022321104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f59a4105750 0x7f59a41097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.011+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2022321104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4104da0 0x7f59a4105180 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.011+0000 7f59a8e85640 1 -- 10.20.193.28:0/2022321104 >> 10.20.193.28:0/2022321104 conn(0x7f59a4100840 msgr2=0x7f59a4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:10.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.011+0000 7f59a8e85640 1 -- 10.20.193.28:0/2022321104 shutdown_connections 2026-02-20T03:20:10.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.011+0000 7f59a8e85640 1 -- 10.20.193.28:0/2022321104 wait complete. 2026-02-20T03:20:10.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a8e85640 1 Processor -- start 2026-02-20T03:20:10.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a8e85640 1 -- start start 2026-02-20T03:20:10.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a8e85640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f59a4104da0 0x7f59a419d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a8e85640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4105750 0x7f59a419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a8e85640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f59a4109ed0 0x7f59a41a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a8e85640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f59a4114da0 con 0x7f59a4105750 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a8e85640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f59a4114c20 con 0x7f59a4104da0 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a8e85640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f59a4114f20 con 0x7f59a4109ed0 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a1d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4105750 0x7f59a419d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a1d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4105750 0x7f59a419d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33204/0 (socket says 10.20.193.28:33204) 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a1d74640 1 -- 10.20.193.28:0/2368501234 learned_addr learned my addr 10.20.193.28:0/2368501234 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a2575640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f59a4104da0 0x7f59a419d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.012+0000 7f59a2d76640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f59a4109ed0 0x7f59a41a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f59a1d74640 1 -- 10.20.193.28:0/2368501234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f59a4109ed0 msgr2=0x7f59a41a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f59a1d74640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f59a4109ed0 0x7f59a41a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f59a1d74640 1 -- 10.20.193.28:0/2368501234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f59a4104da0 msgr2=0x7f59a419d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f59a1d74640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f59a4104da0 0x7f59a419d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f59a1d74640 1 -- 10.20.193.28:0/2368501234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a41a2250 con 0x7f59a4105750 2026-02-20T03:20:10.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f59a1d74640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4105750 0x7f59a419d740 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f598c00d980 tx=0x7f598c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:10.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f598b7fe640 1 -- 10.20.193.28:0/2368501234 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c014070 con 0x7f59a4105750 2026-02-20T03:20:10.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f598b7fe640 1 -- 10.20.193.28:0/2368501234 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f598c0044e0 con 0x7f59a4105750 2026-02-20T03:20:10.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f598b7fe640 1 -- 10.20.193.28:0/2368501234 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c005040 con 0x7f59a4105750 2026-02-20T03:20:10.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a41a2540 con 0x7f59a4105750 2026-02-20T03:20:10.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.013+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a41a9d80 con 0x7f59a4105750 2026-02-20T03:20:10.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.014+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a4105180 con 0x7f59a4105750 2026-02-20T03:20:10.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.016+0000 7f598b7fe640 1 -- 10.20.193.28:0/2368501234 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f598c0047c0 con 0x7f59a4105750 2026-02-20T03:20:10.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.018+0000 7f598b7fe640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f597c0b0ef0 0x7f597c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.018+0000 7f598b7fe640 1 -- 10.20.193.28:0/2368501234 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f598c0e0b50 con 0x7f59a4105750 2026-02-20T03:20:10.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.018+0000 7f598b7fe640 1 -- 10.20.193.28:0/2368501234 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f598c0accc0 con 0x7f59a4105750 2026-02-20T03:20:10.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.018+0000 7f59a2575640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f597c0b0ef0 0x7f597c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.018+0000 7f59a2575640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f597c0b0ef0 0x7f597c0b33b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f59980059c0 tx=0x7f5998005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:10.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.126+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59a419e560 con 0x7f59a4105750 2026-02-20T03:20:10.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.127+0000 7f598b7fe640 1 -- 10.20.193.28:0/2368501234 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11922 (secure 0 0 0) 0x7f598c0b1b70 con 0x7f59a4105750 2026-02-20T03:20:10.130 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:20:10.130 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T03:19:18:240749+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:19:17.378192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:20:10.131 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T03:20:10.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f597c0b0ef0 msgr2=0x7f597c0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f597c0b0ef0 0x7f597c0b33b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f59980059c0 tx=0x7f5998005950 comp rx=0 tx=0).stop 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4105750 msgr2=0x7f59a419d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4105750 0x7f59a419d740 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f598c00d980 tx=0x7f598c00de50 comp rx=0 tx=0).stop 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 shutdown_connections 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f597c0b0ef0 0x7f597c0b33b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f59a4109ed0 0x7f59a41a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f59a4105750 0x7f59a419d740 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 --2- 10.20.193.28:0/2368501234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f59a4104da0 0x7f59a419d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.128+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 >> 10.20.193.28:0/2368501234 conn(0x7f59a4100840 msgr2=0x7f59a4101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.129+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 shutdown_connections 2026-02-20T03:20:10.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.129+0000 7f59a8e85640 1 -- 10.20.193.28:0/2368501234 wait complete. 2026-02-20T03:20:10.234 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 971cbbc --release --await' 2026-02-20T03:20:10.234 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 971cbbc --release --await 2026-02-20T03:20:10.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:10 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2368501234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:20:10.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 379989 4.10 MB/sec execute 103 sec latency 27263.913 ms 2026-02-20T03:20:10.540 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:10.584 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:10 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2368501234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:20:10.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:10 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2368501234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:20:10.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.720+0000 7f8d93fff640 1 -- 10.20.193.28:0/1921652966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 msgr2=0x7f8d94111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.720+0000 7f8d93fff640 1 --2- 10.20.193.28:0/1921652966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 0x7f8d94111850 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400b0d0 tx=0x7f8d8402f450 comp rx=0 tx=0).stop 2026-02-20T03:20:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.720+0000 7f8d93fff640 1 -- 10.20.193.28:0/1921652966 shutdown_connections 2026-02-20T03:20:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.721+0000 7f8d93fff640 1 --2- 10.20.193.28:0/1921652966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 0x7f8d94111850 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.721+0000 7f8d93fff640 1 --2- 10.20.193.28:0/1921652966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d94104980 0x7f8d94104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.721+0000 7f8d93fff640 1 --2- 10.20.193.28:0/1921652966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d9410a980 0x7f8d9410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.721+0000 7f8d93fff640 1 -- 10.20.193.28:0/1921652966 >> 10.20.193.28:0/1921652966 conn(0x7f8d94100680 msgr2=0x7f8d94102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.721+0000 7f8d93fff640 1 -- 10.20.193.28:0/1921652966 shutdown_connections 2026-02-20T03:20:10.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.721+0000 7f8d93fff640 1 -- 10.20.193.28:0/1921652966 wait complete. 2026-02-20T03:20:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.721+0000 7f8d93fff640 1 Processor -- start 2026-02-20T03:20:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.721+0000 7f8d93fff640 1 -- start start 2026-02-20T03:20:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d93fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d94104980 0x7f8d9419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d93fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 0x7f8d9419d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d93fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d9410a980 0x7f8d941a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d93fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8d94114bf0 con 0x7f8d94105320 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d93fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8d94114a70 con 0x7f8d9410a980 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d93fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8d94114d70 con 0x7f8d94104980 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d927fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 0x7f8d9419d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d92ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d94104980 0x7f8d9419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d927fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 0x7f8d9419d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33222/0 (socket says 10.20.193.28:33222) 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d927fc640 1 -- 10.20.193.28:0/2025070048 learned_addr learned my addr 10.20.193.28:0/2025070048 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d937fe640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d9410a980 0x7f8d941a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d927fc640 1 -- 10.20.193.28:0/2025070048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d94104980 msgr2=0x7f8d9419d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d927fc640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d94104980 0x7f8d9419d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d927fc640 1 -- 10.20.193.28:0/2025070048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d9410a980 msgr2=0x7f8d941a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d927fc640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d9410a980 0x7f8d941a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d927fc640 1 -- 10.20.193.28:0/2025070048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d941a2060 con 0x7f8d94105320 2026-02-20T03:20:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.722+0000 7f8d927fc640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 0x7f8d9419d550 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00ea30 tx=0x7f8d7c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.723+0000 7f8d73fff640 1 -- 10.20.193.28:0/2025070048 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00ce50 con 0x7f8d94105320 2026-02-20T03:20:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.723+0000 7f8d73fff640 1 -- 10.20.193.28:0/2025070048 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8d7c004570 con 0x7f8d94105320 2026-02-20T03:20:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.723+0000 7f8d73fff640 1 -- 10.20.193.28:0/2025070048 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c010690 con 0x7f8d94105320 2026-02-20T03:20:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.723+0000 7f8d93fff640 1 -- 10.20.193.28:0/2025070048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d941a2350 con 0x7f8d94105320 2026-02-20T03:20:10.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.723+0000 7f8d93fff640 1 -- 10.20.193.28:0/2025070048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d941a9b90 con 0x7f8d94105320 2026-02-20T03:20:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.726+0000 7f8d73fff640 1 -- 10.20.193.28:0/2025070048 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8d7c0040d0 con 0x7f8d94105320 2026-02-20T03:20:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.726+0000 7f8d9bc2ce00 1 Processor -- start 2026-02-20T03:20:10.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d9bc2ce00 1 -- start start 2026-02-20T03:20:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 0x55dc266cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc2660ba20 con 0x55dc266c17e0 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dc265b92a0 con 0x55dc266c2970 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc26607950 con 0x55dc266c32f0 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266c1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33234/0 (socket says 10.20.193.28:33234) 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d937fe640 1 -- 10.20.193.28:0/1475966048 learned_addr learned my addr 10.20.193.28:0/1475966048 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/1475966048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d927fc640 1 --2- 10.20.193.28:0/1475966048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 0x55dc266cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d92ffd640 1 -- 10.20.193.28:0/1475966048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 msgr2=0x55dc266cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/1475966048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 0x55dc266cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d92ffd640 1 -- 10.20.193.28:0/1475966048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 msgr2=0x55dc266c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/1475966048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.727+0000 7f8d92ffd640 1 -- 10.20.193.28:0/1475966048 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2659c0f0 con 0x55dc266c2970 2026-02-20T03:20:10.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/1475966048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266c2db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d880045d0 tx=0x7f8d88009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd99d97308c183ea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:10.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d5b7fe640 1 -- 10.20.193.28:0/1475966048 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88002e60 con 0x55dc266c2970 2026-02-20T03:20:10.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d5b7fe640 1 -- 10.20.193.28:0/1475966048 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8d88009e50 con 0x55dc266c2970 2026-02-20T03:20:10.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d5b7fe640 1 -- 10.20.193.28:0/1475966048 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d880108f0 con 0x55dc266c2970 2026-02-20T03:20:10.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d73fff640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d640b0e20 0x7f8d640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d73fff640 1 -- 10.20.193.28:0/2025070048 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8d7c0e0f20 con 0x7f8d94105320 2026-02-20T03:20:10.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/1475966048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 msgr2=0x55dc266c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/1475966048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266c2db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d880045d0 tx=0x7f8d88009b90 comp rx=0 tx=0).stop 2026-02-20T03:20:10.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d937fe640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d640b0e20 0x7f8d640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/1475966048 shutdown_connections 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/1475966048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 0x55dc266cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/1475966048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266c2db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/1475966048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/1475966048 >> 10.20.193.28:0/1475966048 conn(0x55dc266b01b0 msgr2=0x55dc266b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.728+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/1475966048 shutdown_connections 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.729+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/1475966048 wait complete. 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.729+0000 7f8d937fe640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d640b0e20 0x7f8d640b32e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009e60 tx=0x7f8d8403a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d9bc2ce00 1 -- start start 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d9bc2ce00 1 Processor -- start 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c17e0 0x55dc266da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266dabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c32f0 0x55dc266def30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc265b3080 con 0x55dc266c32f0 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dc266ce3e0 con 0x55dc266c2970 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc266df470 con 0x55dc266c17e0 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d927fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266dabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.730+0000 7f8d937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c32f0 0x55dc266def30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d92ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c17e0 0x55dc266da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d927fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266dabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:51544/0 (socket says 10.20.193.28:51544) 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d927fc640 1 -- 10.20.193.28:0/912896783 learned_addr learned my addr 10.20.193.28:0/912896783 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d927fc640 1 -- 10.20.193.28:0/912896783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c17e0 msgr2=0x55dc266da6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d927fc640 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c17e0 0x55dc266da6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d927fc640 1 -- 10.20.193.28:0/912896783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c32f0 msgr2=0x55dc266def30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d927fc640 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c32f0 0x55dc266def30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d927fc640 1 -- 10.20.193.28:0/912896783 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc266d38f0 con 0x55dc266c2970 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d927fc640 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266dabf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0a4a30 tx=0x7f8d7c002ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=847c0f4b47b2201e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d58ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d58ff9640 1 -- 10.20.193.28:0/912896783 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0a89d0 con 0x55dc266c2970 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d58ff9640 1 -- 10.20.193.28:0/912896783 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8d7c0a9300 con 0x55dc266c2970 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d58ff9640 1 -- 10.20.193.28:0/912896783 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0a8120 con 0x55dc266c2970 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/912896783 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc263dcda0 con 0x55dc266c2970 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.731+0000 7f8d58ff9640 1 -- 10.20.193.28:0/912896783 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8d7c0af1c0 con 0x55dc266c2970 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 10 client.26327 _ll_register_callbacks cb 0x55dc265b6fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/912896783 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc26613610 con 0x55dc266c2970 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d58ff9640 1 -- 10.20.193.28:0/912896783 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8d7c0a8300 con 0x55dc266c2970 2026-02-20T03:20:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 10 client.26327 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:10.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/912896783 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dc265c9020 con 0x55dc266c2970 2026-02-20T03:20:10.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d58ff9640 1 -- 10.20.193.28:0/912896783 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f8d7c0cb090 con 0x55dc266c2970 2026-02-20T03:20:10.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 10 client.26327 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:10.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 10 client.26327 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:20:10.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 20 client.26327 populate_metadata read hostname 'trial028' 2026-02-20T03:20:10.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc266ea610 0x55dc266ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 4 client.26327 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:10.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/912896783 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc2658db80 con 0x55dc266ea610 2026-02-20T03:20:10.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.732+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc266ea610 0x55dc266ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.733+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc266ea610 0x55dc266ecad0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9af09cd9e9fb925 server_cookie=f0a4170b873d54cc in_seq=0 out_seq=0 2026-02-20T03:20:10.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.733+0000 7f8d58ff9640 10 client.26327 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:10.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d58ff9640 1 -- 10.20.193.28:0/912896783 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55dc2658db80 con 0x55dc266ea610 2026-02-20T03:20:10.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d58ff9640 10 client.26327 handle_command_reply: tid=0 2026-02-20T03:20:10.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 client.26327 shutdown 2026-02-20T03:20:10.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/912896783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 msgr2=0x55dc266dabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266dabf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0a4a30 tx=0x7f8d7c002ac0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/912896783 shutdown_connections 2026-02-20T03:20:10.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc266ea610 0x55dc266ecad0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c32f0 0x55dc266def30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c2970 0x55dc266dabf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/912896783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c17e0 0x55dc266da6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d58ff9640 0 client.26327 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:10.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/912896783 >> 10.20.193.28:0/912896783 conn(0x55dc266b01b0 msgr2=0x55dc266b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:10.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/912896783 shutdown_connections 2026-02-20T03:20:10.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/912896783 wait complete. 2026-02-20T03:20:10.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.734+0000 7f8d9bc2ce00 20 client.26327 trim_cache size 0 max 16384 2026-02-20T03:20:10.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d9bc2ce00 1 Processor -- start 2026-02-20T03:20:10.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d9bc2ce00 1 -- start start 2026-02-20T03:20:10.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c2970 0x55dc266d9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c32f0 0x55dc266d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8d380126d0 con 0x55dc266c17e0 2026-02-20T03:20:10.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3800ff70 con 0x55dc266c32f0 2026-02-20T03:20:10.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3800ddc0 con 0x55dc266c2970 2026-02-20T03:20:10.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d92ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d937fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c32f0 0x55dc266d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d92ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33250/0 (socket says 10.20.193.28:33250) 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d92ffd640 1 -- 10.20.193.28:0/982538932 learned_addr learned my addr 10.20.193.28:0/982538932 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.743+0000 7f8d927fc640 1 --2- 10.20.193.28:0/982538932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c2970 0x55dc266d9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d92ffd640 1 -- 10.20.193.28:0/982538932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c2970 msgr2=0x55dc266d9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/982538932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c2970 0x55dc266d9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d92ffd640 1 -- 10.20.193.28:0/982538932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c32f0 msgr2=0x55dc266d77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/982538932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c32f0 0x55dc266d77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d92ffd640 1 -- 10.20.193.28:0/982538932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc266d3720 con 0x55dc266c17e0 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d927fc640 1 --2- 10.20.193.28:0/982538932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c2970 0x55dc266d9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:10.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/982538932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266b1050 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8d880045a0 tx=0x7f8d88004100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92c7306a5b954b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d5affd640 1 -- 10.20.193.28:0/982538932 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88005310 con 0x55dc266c17e0 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d5affd640 1 -- 10.20.193.28:0/982538932 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55dc2658db80 con 0x55dc266c17e0 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d5affd640 1 -- 10.20.193.28:0/982538932 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d880276d0 con 0x55dc266c17e0 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/982538932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 msgr2=0x55dc266b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.744+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/982538932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266b1050 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8d880045a0 tx=0x7f8d88004100 comp rx=0 tx=0).stop 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.745+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/982538932 shutdown_connections 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.745+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/982538932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c32f0 0x55dc266d77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.745+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/982538932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c2970 0x55dc266d9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.745+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/982538932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c17e0 0x55dc266b1050 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.745+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/982538932 >> 10.20.193.28:0/982538932 conn(0x55dc266b01b0 msgr2=0x55dc266d8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.745+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/982538932 shutdown_connections 2026-02-20T03:20:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.745+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/982538932 wait complete. 2026-02-20T03:20:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.745+0000 7f8d9bc2ce00 1 -- start start 2026-02-20T03:20:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.745+0000 7f8d9bc2ce00 1 Processor -- start 2026-02-20T03:20:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c17e0 0x55dc266e2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c2970 0x55dc266e29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d9bc2ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 0x55dc2674f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3800e430 con 0x55dc266c2970 2026-02-20T03:20:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3800f8a0 con 0x55dc266c17e0 2026-02-20T03:20:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d9bc2ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3800eb00 con 0x55dc266c32f0 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d92ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c17e0 0x55dc266e2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d927fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c2970 0x55dc266e29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d927fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c2970 0x55dc266e29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33264/0 (socket says 10.20.193.28:33264) 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d927fc640 1 -- 10.20.193.28:0/3708641174 learned_addr learned my addr 10.20.193.28:0/3708641174 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d937fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 0x55dc2674f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d927fc640 1 -- 10.20.193.28:0/3708641174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 msgr2=0x55dc2674f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d927fc640 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 0x55dc2674f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d927fc640 1 -- 10.20.193.28:0/3708641174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c17e0 msgr2=0x55dc266e2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d927fc640 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c17e0 0x55dc266e2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d927fc640 1 -- 10.20.193.28:0/3708641174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc262eaad0 con 0x55dc266c2970 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c17e0 0x55dc266e2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d927fc640 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c2970 0x55dc266e29a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009fd0 tx=0x7f8d7c0e6060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ce09eeb2a4e58d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.746+0000 7f8d58ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d58ff9640 1 -- 10.20.193.28:0/3708641174 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0a8120 con 0x55dc266c2970 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/3708641174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc26592370 con 0x55dc266c2970 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 10 client.16686 _ll_register_callbacks cb 0x7f8d7c009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/3708641174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d88009e50 con 0x55dc266c2970 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d58ff9640 1 -- 10.20.193.28:0/3708641174 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8d7c0cf040 con 0x55dc266c2970 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d58ff9640 1 -- 10.20.193.28:0/3708641174 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0a89d0 con 0x55dc266c2970 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d58ff9640 1 -- 10.20.193.28:0/3708641174 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8d7c0a4320 con 0x55dc266c2970 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d58ff9640 1 -- 10.20.193.28:0/3708641174 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8d7c0a45a0 con 0x55dc266c2970 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 10 client.16686 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/3708641174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55dc266d4410 con 0x55dc266c2970 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d58ff9640 1 -- 10.20.193.28:0/3708641174 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f8d7c0a7c10 con 0x55dc266c2970 2026-02-20T03:20:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 10 client.16686 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 10 client.16686 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:20:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 20 client.16686 populate_metadata read hostname 'trial028' 2026-02-20T03:20:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc26756e60 0x55dc26759320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 4 client.16686 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "971cbbc", "release": true, "await": true}] 2026-02-20T03:20:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/3708641174 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "971cbbc", "release": true, "await": true}) -- 0x55dc2637bbf0 con 0x55dc26756e60 2026-02-20T03:20:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.747+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc26756e60 0x55dc26759320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.748+0000 7f8d92ffd640 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc26756e60 0x55dc26759320 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba084f2706eaa249 server_cookie=cd925a3dd07f3347 in_seq=0 out_seq=0 2026-02-20T03:20:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.748+0000 7f8d58ff9640 10 client.16686 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:10.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.751+0000 7f8d58ff9640 1 -- 10.20.193.28:0/3708641174 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55dc2637bbf0 con 0x55dc26756e60 2026-02-20T03:20:10.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.751+0000 7f8d58ff9640 10 client.16686 handle_command_reply: tid=0 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.751+0000 7f8d9bc2ce00 1 client.16686 shutdown 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.751+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/3708641174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c2970 msgr2=0x55dc266e29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.751+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c2970 0x55dc266e29a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c009fd0 tx=0x7f8d7c0e6060 comp rx=0 tx=0).stop 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/3708641174 shutdown_connections 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc26756e60 0x55dc26759320 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc266c32f0 0x55dc2674f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc266c2970 0x55dc266e29a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d9bc2ce00 1 --2- 10.20.193.28:0/3708641174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc266c17e0 0x55dc266e2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/3708641174 >> 10.20.193.28:0/3708641174 conn(0x55dc266b01b0 msgr2=0x55dc266d9530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d58ff9640 0 client.16686 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:10.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/3708641174 shutdown_connections 2026-02-20T03:20:10.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d9bc2ce00 1 -- 10.20.193.28:0/3708641174 wait complete. 2026-02-20T03:20:10.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.752+0000 7f8d9bc2ce00 20 client.16686 trim_cache size 0 max 16384 2026-02-20T03:20:10.758 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:20:10.758 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 28, 2026-02-20T03:20:10.758 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:20:10.758 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 20, 2026-02-20T03:20:10.758 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:20:10.758 INFO:teuthology.orchestra.run.trial028.stdout: "971cbbc": { 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "version": 20, 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:20:10.759 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:20:10.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:20:10.760 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:20:10.760 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:20:10.760 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:20:10.760 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:20:10.760 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:20:10.760 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:20:10.760 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:20:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 -- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d640b0e20 msgr2=0x7f8d640b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d640b0e20 0x7f8d640b32e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009e60 tx=0x7f8d8403a040 comp rx=0 tx=0).stop 2026-02-20T03:20:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 -- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 msgr2=0x7f8d9419d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 0x7f8d9419d550 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00ea30 tx=0x7f8d7c00ef00 comp rx=0 tx=0).stop 2026-02-20T03:20:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 -- 10.20.193.28:0/2025070048 shutdown_connections 2026-02-20T03:20:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d640b0e20 0x7f8d640b32e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d9410a980 0x7f8d941a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d94105320 0x7f8d9419d550 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 --2- 10.20.193.28:0/2025070048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d94104980 0x7f8d9419d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 -- 10.20.193.28:0/2025070048 >> 10.20.193.28:0/2025070048 conn(0x7f8d94100680 msgr2=0x7f8d94100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 -- 10.20.193.28:0/2025070048 shutdown_connections 2026-02-20T03:20:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:10.753+0000 7f8d93fff640 1 -- 10.20.193.28:0/2025070048 wait complete. 2026-02-20T03:20:10.855 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '971cbbc', total seconds elapsed: 31.3 2026-02-20T03:20:11.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:11 trial177 ceph-mon[43181]: pgmap v346: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 4.0 KiB/s wr, 10 op/s 2026-02-20T03:20:11.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 381959 4.13 MB/sec execute 104 sec latency 27513.626 ms 2026-02-20T03:20:11.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:11 trial126 ceph-mon[38476]: pgmap v346: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 4.0 KiB/s wr, 10 op/s 2026-02-20T03:20:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:11 trial028 ceph-mon[38552]: pgmap v346: 129 pgs: 129 active+clean; 64 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 6.9 KiB/s rd, 4.0 KiB/s wr, 10 op/s 2026-02-20T03:20:12.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 385475 4.27 MB/sec execute 105 sec latency 69.590 ms 2026-02-20T03:20:13.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:13 trial177 ceph-mon[43181]: pgmap v347: 129 pgs: 129 active+clean; 65 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 84 KiB/s wr, 10 op/s 2026-02-20T03:20:13.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 389173 4.42 MB/sec execute 106 sec latency 6.923 ms 2026-02-20T03:20:13.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:13 trial126 ceph-mon[38476]: pgmap v347: 129 pgs: 129 active+clean; 65 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 84 KiB/s wr, 10 op/s 2026-02-20T03:20:13.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:13 trial028 ceph-mon[38552]: pgmap v347: 129 pgs: 129 active+clean; 65 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 84 KiB/s wr, 10 op/s 2026-02-20T03:20:14.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 393119 4.59 MB/sec execute 107 sec latency 6.927 ms 2026-02-20T03:20:14.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.818+0000 7f6ab972a640 1 -- 10.20.193.28:0/4087058165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab4103840 msgr2=0x7f6ab4105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:14.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 --2- 10.20.193.28:0/4087058165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab4103840 0x7f6ab4105cb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009a30 tx=0x7f6aa402f220 comp rx=0 tx=0).stop 2026-02-20T03:20:14.823 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 -- 10.20.193.28:0/4087058165 shutdown_connections 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 --2- 10.20.193.28:0/4087058165 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab41061f0 0x7f6ab41066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 --2- 10.20.193.28:0/4087058165 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab4103840 0x7f6ab4105cb0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 --2- 10.20.193.28:0/4087058165 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab4100ef0 0x7f6ab4103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 -- 10.20.193.28:0/4087058165 >> 10.20.193.28:0/4087058165 conn(0x7f6ab40fcce0 msgr2=0x7f6ab40ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 -- 10.20.193.28:0/4087058165 shutdown_connections 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 -- 10.20.193.28:0/4087058165 wait complete. 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 Processor -- start 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.819+0000 7f6ab972a640 1 -- start start 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab972a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab4100ef0 0x7f6ab41a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab972a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab4103840 0x7f6ab41a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.824 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab972a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab41061f0 0x7f6ab41a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab972a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4114940 con 0x7f6ab4100ef0 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab972a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41147c0 con 0x7f6ab41061f0 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab972a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4114ac0 con 0x7f6ab4103840 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab4103840 0x7f6ab41a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab4103840 0x7f6ab41a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43210/0 (socket says 10.20.193.28:43210) 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab37fe640 1 -- 10.20.193.28:0/2755238124 learned_addr learned my addr 10.20.193.28:0/2755238124 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab4100ef0 0x7f6ab41a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab8f29640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab41061f0 0x7f6ab41a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab37fe640 1 -- 10.20.193.28:0/2755238124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab41061f0 msgr2=0x7f6ab41a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab37fe640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab41061f0 0x7f6ab41a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab37fe640 1 -- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab4100ef0 msgr2=0x7f6ab41a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:14.825 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab37fe640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab4100ef0 0x7f6ab41a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab37fe640 1 -- 10.20.193.28:0/2755238124 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab41a8ca0 con 0x7f6ab4103840 2026-02-20T03:20:14.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab4100ef0 0x7f6ab41a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:14.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.820+0000 7f6ab37fe640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab4103840 0x7f6ab41a1530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009b60 tx=0x7f6aa4002f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:14.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.821+0000 7f6ab17fa640 1 -- 10.20.193.28:0/2755238124 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4004030 con 0x7f6ab4103840 2026-02-20T03:20:14.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.821+0000 7f6ab17fa640 1 -- 10.20.193.28:0/2755238124 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6aa4038770 con 0x7f6ab4103840 2026-02-20T03:20:14.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.821+0000 7f6ab17fa640 1 -- 10.20.193.28:0/2755238124 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4042680 con 0x7f6ab4103840 2026-02-20T03:20:14.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.821+0000 7f6ab972a640 1 -- 10.20.193.28:0/2755238124 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab41a8f30 con 0x7f6ab4103840 2026-02-20T03:20:14.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.821+0000 7f6ab972a640 1 -- 10.20.193.28:0/2755238124 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab41a9340 con 0x7f6ab4103840 2026-02-20T03:20:14.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.824+0000 7f6ab17fa640 1 -- 10.20.193.28:0/2755238124 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6aa404a070 con 0x7f6ab4103840 2026-02-20T03:20:14.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.824+0000 7f6abd817e00 1 Processor -- start 2026-02-20T03:20:14.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.824+0000 7f6abd817e00 1 -- start start 2026-02-20T03:20:14.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 0x55690b0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6abd817e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55690affd8f0 con 0x55690b0ace80 2026-02-20T03:20:14.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6abd817e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55690afab2e0 con 0x55690b0ad7c0 2026-02-20T03:20:14.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6abd817e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55690aff9820 con 0x55690b0b2560 2026-02-20T03:20:14.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab8f29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0b1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:51588/0 (socket says 10.20.193.28:51588) 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab3fff640 1 -- 10.20.193.28:0/2616082602 learned_addr learned my addr 10.20.193.28:0/2616082602 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab37fe640 1 --2- 10.20.193.28:0/2616082602 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 0x55690b0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab8f29640 1 -- 10.20.193.28:0/2616082602 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 msgr2=0x55690b0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab8f29640 1 --2- 10.20.193.28:0/2616082602 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 0x55690b0b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab8f29640 1 -- 10.20.193.28:0/2616082602 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 msgr2=0x55690b0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab8f29640 1 --2- 10.20.193.28:0/2616082602 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab8f29640 1 -- 10.20.193.28:0/2616082602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690af9d5a0 con 0x55690b0ace80 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/2616082602 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab17fa640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a880b0ef0 0x7f6a880b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab17fa640 1 -- 10.20.193.28:0/2755238124 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6aa4104970 con 0x7f6ab4103840 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab8f29640 1 --2- 10.20.193.28:0/2616082602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ad280 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80093c0 tx=0x7f6aa8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d88302eba076120 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.825+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a880b0ef0 0x7f6a880b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6a84bfe640 1 -- 10.20.193.28:0/2616082602 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa80040d0 con 0x55690b0ace80 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6a84bfe640 1 -- 10.20.193.28:0/2616082602 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6aa801a070 con 0x55690b0ace80 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6a84bfe640 1 -- 10.20.193.28:0/2616082602 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8015b90 con 0x55690b0ace80 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6abd817e00 1 -- 10.20.193.28:0/2616082602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 msgr2=0x55690b0ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6abd817e00 1 --2- 10.20.193.28:0/2616082602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ad280 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80093c0 tx=0x7f6aa8009920 comp rx=0 tx=0).stop 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6abd817e00 1 -- 10.20.193.28:0/2616082602 shutdown_connections 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6abd817e00 1 --2- 10.20.193.28:0/2616082602 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 0x55690b0b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6abd817e00 1 --2- 10.20.193.28:0/2616082602 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a880b0ef0 0x7f6a880b33b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55690b0adeb0 tx=0x7f6aa0009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6abd817e00 1 --2- 10.20.193.28:0/2616082602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ad280 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6abd817e00 1 -- 10.20.193.28:0/2616082602 >> 10.20.193.28:0/2616082602 conn(0x55690b0a46f0 msgr2=0x55690b0ab570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6abd817e00 1 -- 10.20.193.28:0/2616082602 shutdown_connections 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.826+0000 7f6abd817e00 1 -- 10.20.193.28:0/2616082602 wait complete. 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.827+0000 7f6abd817e00 1 -- start start 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.827+0000 7f6abd817e00 1 Processor -- start 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ad7c0 0x55690b0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0b2560 0x55690b0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6abd817e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55690afa50c0 con 0x55690b0ace80 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6abd817e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55690b0b55b0 con 0x55690b0b2560 2026-02-20T03:20:14.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6abd817e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55690b0cd420 con 0x55690b0ad7c0 2026-02-20T03:20:14.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6ab3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6ab3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33296/0 (socket says 10.20.193.28:33296) 2026-02-20T03:20:14.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6ab3fff640 1 -- 10.20.193.28:0/179945445 learned_addr learned my addr 10.20.193.28:0/179945445 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:14.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.828+0000 7f6ab37fe640 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ad7c0 0x55690b0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6ab8f29640 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0b2560 0x55690b0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6ab3fff640 1 -- 10.20.193.28:0/179945445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ad7c0 msgr2=0x55690b0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:14.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ad7c0 0x55690b0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6ab3fff640 1 -- 10.20.193.28:0/179945445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0b2560 msgr2=0x55690b0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:14.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0b2560 0x55690b0cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6ab3fff640 1 -- 10.20.193.28:0/179945445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690b0bf120 con 0x55690b0ace80 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6ab8f29640 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0b2560 0x55690b0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0c59d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0012bb0 tx=0x7f6aa0004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deacba3dc13f04d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6a75ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6a75ffb640 1 -- 10.20.193.28:0/179945445 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0012cb0 con 0x55690b0ace80 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6a75ffb640 1 -- 10.20.193.28:0/179945445 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6aa0012e50 con 0x55690b0ace80 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6a75ffb640 1 -- 10.20.193.28:0/179945445 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00286d0 con 0x55690b0ace80 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.829+0000 7f6abd817e00 1 -- 10.20.193.28:0/179945445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55690afb9820 con 0x55690b0ace80 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6a75ffb640 1 -- 10.20.193.28:0/179945445 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6aa0028870 con 0x55690b0ace80 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6a75ffb640 10 client.16698 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 10 client.16698 _ll_register_callbacks cb 0x55690afa8ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:14.839 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 1 -- 10.20.193.28:0/179945445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55690b0054e0 con 0x55690b0ace80 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6a75ffb640 1 -- 10.20.193.28:0/179945445 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6aa0028a70 con 0x55690b0ace80 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 10 client.16698 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 1 -- 10.20.193.28:0/179945445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55690afbe380 con 0x55690b0ace80 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6a75ffb640 1 -- 10.20.193.28:0/179945445 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f6aa0027070 con 0x55690b0ace80 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 10 client.16698 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 10 client.16698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 20 client.16698 populate_metadata read hostname 'trial028' 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55690b0d1740 0x55690b0d3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 4 client.16698 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.830+0000 7f6abd817e00 1 -- 10.20.193.28:0/179945445 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55690af7fbd0 con 0x55690b0d1740 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.831+0000 7f6ab37fe640 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55690b0d1740 0x55690b0d3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.831+0000 7f6ab37fe640 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55690b0d1740 0x55690b0d3c00 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=338388cc3306e8c1 server_cookie=d6ed474e0c16f37f in_seq=0 out_seq=0 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.831+0000 7f6a75ffb640 10 client.16698 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.831+0000 7f6a75ffb640 1 -- 10.20.193.28:0/179945445 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55690af7fbd0 con 0x55690b0d1740 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.831+0000 7f6a75ffb640 10 client.16698 handle_command_reply: tid=0 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 client.16698 shutdown 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 -- 10.20.193.28:0/179945445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 msgr2=0x55690b0c59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0c59d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0012bb0 tx=0x7f6aa0004830 comp rx=0 tx=0).stop 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 -- 10.20.193.28:0/179945445 shutdown_connections 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55690b0d1740 0x55690b0d3c00 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0b2560 0x55690b0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ad7c0 0x55690b0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 --2- 10.20.193.28:0/179945445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0c59d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6a75ffb640 0 client.16698 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:14.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 -- 10.20.193.28:0/179945445 >> 10.20.193.28:0/179945445 conn(0x55690b0a46f0 msgr2=0x55690b0b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:14.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 -- 10.20.193.28:0/179945445 shutdown_connections 2026-02-20T03:20:14.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 1 -- 10.20.193.28:0/179945445 wait complete. 2026-02-20T03:20:14.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.832+0000 7f6abd817e00 20 client.16698 trim_cache size 0 max 16384 2026-02-20T03:20:14.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6abd817e00 1 Processor -- start 2026-02-20T03:20:14.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6abd817e00 1 -- start start 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 0x55690b0aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6abd817e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6a640126d0 con 0x55690b0ace80 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6abd817e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6400ff70 con 0x55690b0ad7c0 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6abd817e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6400ddc0 con 0x55690b0b2560 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6ab3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6ab37fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6ab3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ae5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33298/0 (socket says 10.20.193.28:33298) 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6ab3fff640 1 -- 10.20.193.28:0/2938357049 learned_addr learned my addr 10.20.193.28:0/2938357049 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:14.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.840+0000 7f6ab8f29640 1 --2- 10.20.193.28:0/2938357049 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 0x55690b0aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6ab3fff640 1 -- 10.20.193.28:0/2938357049 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 msgr2=0x55690b0aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/2938357049 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 0x55690b0aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6ab3fff640 1 -- 10.20.193.28:0/2938357049 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 msgr2=0x55690b0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/2938357049 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6ab3fff640 1 -- 10.20.193.28:0/2938357049 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690b0bef50 con 0x55690b0ace80 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/2938357049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ae5f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0020ca0 tx=0x7f6aa002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f906a8ffe46bab93 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6a77fff640 1 -- 10.20.193.28:0/2938357049 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00283e0 con 0x55690b0ace80 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6a77fff640 1 -- 10.20.193.28:0/2938357049 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55690b0054e0 con 0x55690b0ace80 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6a77fff640 1 -- 10.20.193.28:0/2938357049 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0029c30 con 0x55690b0ace80 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6abd817e00 1 -- 10.20.193.28:0/2938357049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 msgr2=0x55690b0ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:14.846 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6abd817e00 1 --2- 10.20.193.28:0/2938357049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ae5f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0020ca0 tx=0x7f6aa002e000 comp rx=0 tx=0).stop 2026-02-20T03:20:14.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6abd817e00 1 -- 10.20.193.28:0/2938357049 shutdown_connections 2026-02-20T03:20:14.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6abd817e00 1 --2- 10.20.193.28:0/2938357049 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0b2560 0x55690b0aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6abd817e00 1 --2- 10.20.193.28:0/2938357049 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6abd817e00 1 --2- 10.20.193.28:0/2938357049 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0ace80 0x55690b0ae5f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6abd817e00 1 -- 10.20.193.28:0/2938357049 >> 10.20.193.28:0/2938357049 conn(0x55690b0a46f0 msgr2=0x55690b0adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:14.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6abd817e00 1 -- 10.20.193.28:0/2938357049 shutdown_connections 2026-02-20T03:20:14.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.841+0000 7f6abd817e00 1 -- 10.20.193.28:0/2938357049 wait complete. 2026-02-20T03:20:14.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6abd817e00 1 -- start start 2026-02-20T03:20:14.847 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6abd817e00 1 Processor -- start 2026-02-20T03:20:14.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ace80 0x55690b0cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6abd817e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0b2560 0x55690b0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6ab3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ace80 0x55690b0cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6abd817e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6400e430 con 0x55690b0b2560 2026-02-20T03:20:14.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6abd817e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6400f8a0 con 0x55690b0ad7c0 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6abd817e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6400eb00 con 0x55690b0ace80 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6ab37fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6ab3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ace80 0x55690b0cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43244/0 (socket says 10.20.193.28:43244) 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6ab3fff640 1 -- 10.20.193.28:0/333327106 learned_addr learned my addr 10.20.193.28:0/333327106 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.842+0000 7f6ab8f29640 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0b2560 0x55690b0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6ab3fff640 1 -- 10.20.193.28:0/333327106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 msgr2=0x55690b0cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6ab3fff640 1 -- 10.20.193.28:0/333327106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0b2560 msgr2=0x55690b0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0b2560 0x55690b0cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6ab3fff640 1 -- 10.20.193.28:0/333327106 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690ad5d690 con 0x55690b0ace80 2026-02-20T03:20:14.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6ab3fff640 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ace80 0x55690b0cc770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0020da0 tx=0x7f6aa0029670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48677e09e36ceb0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6a75ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6a75ffb640 1 -- 10.20.193.28:0/333327106 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0012240 con 0x55690b0ace80 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6a75ffb640 1 -- 10.20.193.28:0/333327106 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6aa0029e50 con 0x55690b0ace80 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6abd817e00 1 -- 10.20.193.28:0/333327106 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55690afc2b70 con 0x55690b0ace80 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6a75ffb640 1 -- 10.20.193.28:0/333327106 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00116a0 con 0x55690b0ace80 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6a75ffb640 1 -- 10.20.193.28:0/333327106 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6aa0011900 con 0x55690b0ace80 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6abd817e00 10 client.26350 _ll_register_callbacks cb 0x7f6aa0012a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.843+0000 7f6abd817e00 1 -- 10.20.193.28:0/333327106 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aa801a070 con 0x55690b0ace80 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6a75ffb640 1 -- 10.20.193.28:0/333327106 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6aa004a060 con 0x55690b0ace80 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6abd817e00 10 client.26350 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6abd817e00 1 -- 10.20.193.28:0/333327106 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55690b0bfc40 con 0x55690b0ace80 2026-02-20T03:20:14.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6a75ffb640 1 -- 10.20.193.28:0/333327106 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f6aa0027040 con 0x55690b0ace80 2026-02-20T03:20:14.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6abd817e00 10 client.26350 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:14.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6abd817e00 10 client.26350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:14.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6abd817e00 20 client.26350 populate_metadata read hostname 'trial028' 2026-02-20T03:20:14.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6abd817e00 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55690b13d1d0 0x55690b13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:14.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6abd817e00 4 client.26350 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:20:14.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6abd817e00 1 -- 10.20.193.28:0/333327106 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55690afce6b0 con 0x55690b13d1d0 2026-02-20T03:20:14.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.844+0000 7f6ab37fe640 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55690b13d1d0 0x55690b13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:14.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.845+0000 7f6ab37fe640 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55690b13d1d0 0x55690b13f660 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=289946ecab9a32ce server_cookie=19c8985099edd684 in_seq=0 out_seq=0 2026-02-20T03:20:14.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.845+0000 7f6a75ffb640 10 client.26350 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:14.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.890+0000 7f6a75ffb640 1 -- 10.20.193.28:0/333327106 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55690afce6b0 con 0x55690b13d1d0 2026-02-20T03:20:14.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.890+0000 7f6a75ffb640 10 client.26350 handle_command_reply: tid=0 2026-02-20T03:20:14.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.890+0000 7f6abd817e00 1 client.26350 shutdown 2026-02-20T03:20:14.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.890+0000 7f6abd817e00 1 -- 10.20.193.28:0/333327106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ace80 msgr2=0x55690b0cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:14.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.890+0000 7f6abd817e00 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ace80 0x55690b0cc770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0020da0 tx=0x7f6aa0029670 comp rx=0 tx=0).stop 2026-02-20T03:20:14.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6abd817e00 1 -- 10.20.193.28:0/333327106 shutdown_connections 2026-02-20T03:20:14.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6abd817e00 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55690b13d1d0 0x55690b13f660 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6abd817e00 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55690b0b2560 0x55690b0cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6abd817e00 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55690b0ad7c0 0x55690b0cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6a75ffb640 0 client.26350 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:14.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6abd817e00 1 --2- 10.20.193.28:0/333327106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55690b0ace80 0x55690b0cc770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6abd817e00 1 -- 10.20.193.28:0/333327106 >> 10.20.193.28:0/333327106 conn(0x55690b0a46f0 msgr2=0x55690b0ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:14.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6abd817e00 1 -- 10.20.193.28:0/333327106 shutdown_connections 2026-02-20T03:20:14.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6abd817e00 1 -- 10.20.193.28:0/333327106 wait complete. 2026-02-20T03:20:14.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6abd817e00 20 client.26350 trim_cache size 0 max 16384 2026-02-20T03:20:14.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:20:14.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:20:14.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:20:14.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6ab972a640 1 -- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a880b0ef0 msgr2=0x7f6a880b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6ab972a640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a880b0ef0 0x7f6a880b33b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x55690b0adeb0 tx=0x7f6aa0009290 comp rx=0 tx=0).stop 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6ab972a640 1 -- 10.20.193.28:0/2755238124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab4103840 msgr2=0x7f6ab41a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.891+0000 7f6ab972a640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab4103840 0x7f6ab41a1530 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009b60 tx=0x7f6aa4002f70 comp rx=0 tx=0).stop 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.892+0000 7f6ab972a640 1 -- 10.20.193.28:0/2755238124 shutdown_connections 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.892+0000 7f6ab972a640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6a880b0ef0 0x7f6a880b33b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.892+0000 7f6ab972a640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6ab41061f0 0x7f6ab41a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.892+0000 7f6ab972a640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6ab4103840 0x7f6ab41a1530 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.892+0000 7f6ab972a640 1 --2- 10.20.193.28:0/2755238124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6ab4100ef0 0x7f6ab41a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:14.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.892+0000 7f6ab972a640 1 -- 10.20.193.28:0/2755238124 >> 10.20.193.28:0/2755238124 conn(0x7f6ab40fcce0 msgr2=0x7f6ab4101990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:14.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.892+0000 7f6ab972a640 1 -- 10.20.193.28:0/2755238124 shutdown_connections 2026-02-20T03:20:14.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:14.892+0000 7f6ab972a640 1 -- 10.20.193.28:0/2755238124 wait complete. 2026-02-20T03:20:15.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:15 trial177 ceph-mon[43181]: pgmap v348: 129 pgs: 129 active+clean; 67 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 467 KiB/s rd, 501 KiB/s wr, 69 op/s 2026-02-20T03:20:15.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 396740 4.73 MB/sec execute 108 sec latency 27.527 ms 2026-02-20T03:20:15.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:15 trial126 ceph-mon[38476]: pgmap v348: 129 pgs: 129 active+clean; 67 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 467 KiB/s rd, 501 KiB/s wr, 69 op/s 2026-02-20T03:20:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:15 trial028 ceph-mon[38552]: pgmap v348: 129 pgs: 129 active+clean; 67 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 467 KiB/s rd, 501 KiB/s wr, 69 op/s 2026-02-20T03:20:16.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 400623 4.88 MB/sec execute 109 sec latency 6.891 ms 2026-02-20T03:20:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:17 trial177 ceph-mon[43181]: pgmap v349: 129 pgs: 129 active+clean; 69 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 795 KiB/s wr, 100 op/s 2026-02-20T03:20:17.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 404366 5.04 MB/sec execute 110 sec latency 15.072 ms 2026-02-20T03:20:17.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:17 trial126 ceph-mon[38476]: pgmap v349: 129 pgs: 129 active+clean; 69 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 795 KiB/s wr, 100 op/s 2026-02-20T03:20:17.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:17 trial028 ceph-mon[38552]: pgmap v349: 129 pgs: 129 active+clean; 69 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 795 KiB/s wr, 100 op/s 2026-02-20T03:20:18.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 408063 5.17 MB/sec execute 111 sec latency 10.357 ms 2026-02-20T03:20:19.312 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:20:19.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:19 trial177 ceph-mon[43181]: pgmap v350: 129 pgs: 129 active+clean; 68 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 1.2 MiB/s wr, 190 op/s 2026-02-20T03:20:19.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 411702 5.30 MB/sec execute 112 sec latency 6.046 ms 2026-02-20T03:20:19.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:19 trial126 ceph-mon[38476]: pgmap v350: 129 pgs: 129 active+clean; 68 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 1.2 MiB/s wr, 190 op/s 2026-02-20T03:20:19.598 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:19.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:19 trial028 ceph-mon[38552]: pgmap v350: 129 pgs: 129 active+clean; 68 MiB data, 1.4 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 1.2 MiB/s wr, 190 op/s 2026-02-20T03:20:19.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.790+0000 7f1351afa640 1 -- 10.20.193.28:0/3715498702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10e0a0 msgr2=0x7f134c111fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:19.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.790+0000 7f1351afa640 1 --2- 10.20.193.28:0/3715498702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10e0a0 0x7f134c111fd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1334009a30 tx=0x7f133402f220 comp rx=0 tx=0).stop 2026-02-20T03:20:19.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.790+0000 7f1351afa640 1 -- 10.20.193.28:0/3715498702 shutdown_connections 2026-02-20T03:20:19.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.790+0000 7f1351afa640 1 --2- 10.20.193.28:0/3715498702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f134c112700 0x7f134c11a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.790+0000 7f1351afa640 1 --2- 10.20.193.28:0/3715498702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10e0a0 0x7f134c111fd0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.790+0000 7f1351afa640 1 --2- 10.20.193.28:0/3715498702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f134c10d6f0 0x7f134c10dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.790+0000 7f1351afa640 1 -- 10.20.193.28:0/3715498702 >> 10.20.193.28:0/3715498702 conn(0x7f134c06d500 msgr2=0x7f134c06d910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:19.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.791+0000 7f1351afa640 1 -- 10.20.193.28:0/3715498702 shutdown_connections 2026-02-20T03:20:19.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.791+0000 7f1351afa640 1 -- 10.20.193.28:0/3715498702 wait complete. 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.791+0000 7f1351afa640 1 Processor -- start 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1351afa640 1 -- start start 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1351afa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10d6f0 0x7f134c06e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1351afa640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f134c10e0a0 0x7f134c06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1351afa640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f134c112700 0x7f134c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1351afa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f134c11d590 con 0x7f134c10d6f0 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1351afa640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f134c11d410 con 0x7f134c10e0a0 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1351afa640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f134c11d710 con 0x7f134c112700 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1350af8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10d6f0 0x7f134c06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1343fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f134c10e0a0 0x7f134c06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f13512f9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f134c112700 0x7f134c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1350af8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10d6f0 0x7f134c06e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50964/0 (socket says 10.20.193.28:50964) 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1350af8640 1 -- 10.20.193.28:0/3281954606 learned_addr learned my addr 10.20.193.28:0/3281954606 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1350af8640 1 -- 10.20.193.28:0/3281954606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f134c112700 msgr2=0x7f134c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1350af8640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f134c112700 0x7f134c06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1350af8640 1 -- 10.20.193.28:0/3281954606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f134c10e0a0 msgr2=0x7f134c06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1350af8640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f134c10e0a0 0x7f134c06ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.792+0000 7f1350af8640 1 -- 10.20.193.28:0/3281954606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c1a5830 con 0x7f134c10d6f0 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.793+0000 7f1350af8640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10d6f0 0x7f134c06e730 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f133c00d980 tx=0x7f133c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.793+0000 7f1341ffb640 1 -- 10.20.193.28:0/3281954606 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c014070 con 0x7f134c10d6f0 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.793+0000 7f1341ffb640 1 -- 10.20.193.28:0/3281954606 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f133c0044e0 con 0x7f134c10d6f0 2026-02-20T03:20:19.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.793+0000 7f1341ffb640 1 -- 10.20.193.28:0/3281954606 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c010460 con 0x7f134c10d6f0 2026-02-20T03:20:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.793+0000 7f1351afa640 1 -- 10.20.193.28:0/3281954606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134c1a5b20 con 0x7f134c10d6f0 2026-02-20T03:20:19.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.794+0000 7f1351afa640 1 -- 10.20.193.28:0/3281954606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f134c1a5fe0 con 0x7f134c10d6f0 2026-02-20T03:20:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.796+0000 7f1341ffb640 1 -- 10.20.193.28:0/3281954606 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f133c0026e0 con 0x7f134c10d6f0 2026-02-20T03:20:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f1355288e00 1 Processor -- start 2026-02-20T03:20:19.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f1355288e00 1 -- start start 2026-02-20T03:20:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f1355288e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f1355288e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 0x55bc0e6aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f1355288e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f1355288e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc0e62ae50 con 0x55bc0e6aa630 2026-02-20T03:20:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f1355288e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bc0e5fd9c0 con 0x55bc0e6b0000 2026-02-20T03:20:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f1355288e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bc0e5ab240 con 0x55bc0e6aafb0 2026-02-20T03:20:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f13512f9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f13512f9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35704/0 (socket says 10.20.193.28:35704) 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f13512f9640 1 -- 10.20.193.28:0/2471415525 learned_addr learned my addr 10.20.193.28:0/2471415525 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.797+0000 7f1350af8640 1 --2- 10.20.193.28:0/2471415525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 0x55bc0e6aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f1343fff640 1 --2- 10.20.193.28:0/2471415525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f13512f9640 1 -- 10.20.193.28:0/2471415525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 msgr2=0x55bc0e6b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f13512f9640 1 --2- 10.20.193.28:0/2471415525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f13512f9640 1 -- 10.20.193.28:0/2471415525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 msgr2=0x55bc0e6aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f13512f9640 1 --2- 10.20.193.28:0/2471415525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 0x55bc0e6aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f13512f9640 1 -- 10.20.193.28:0/2471415525 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0e5be420 con 0x55bc0e6b0000 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f1341ffb640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13280b0e20 0x7f13280b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f1341ffb640 1 -- 10.20.193.28:0/3281954606 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f133c0e0860 con 0x7f134c10d6f0 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f13512f9640 1 --2- 10.20.193.28:0/2471415525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6b03e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1348009500 tx=0x7f1348009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf1cc333965de54 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f1350af8640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13280b0e20 0x7f13280b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f13194e4640 1 -- 10.20.193.28:0/2471415525 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134801b070 con 0x55bc0e6b0000 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f13194e4640 1 -- 10.20.193.28:0/2471415525 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f13480045b0 con 0x55bc0e6b0000 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f13194e4640 1 -- 10.20.193.28:0/2471415525 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348013ac0 con 0x55bc0e6b0000 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f1350af8640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13280b0e20 0x7f13280b32e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f133c0e0b00 tx=0x7f133c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f1355288e00 1 -- 10.20.193.28:0/2471415525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 msgr2=0x55bc0e6b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.798+0000 7f1355288e00 1 --2- 10.20.193.28:0/2471415525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6b03e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1348009500 tx=0x7f1348009920 comp rx=0 tx=0).stop 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.799+0000 7f1355288e00 1 -- 10.20.193.28:0/2471415525 shutdown_connections 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.799+0000 7f1355288e00 1 --2- 10.20.193.28:0/2471415525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.799+0000 7f1355288e00 1 --2- 10.20.193.28:0/2471415525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 0x55bc0e6aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.799+0000 7f1355288e00 1 --2- 10.20.193.28:0/2471415525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6b03e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.799+0000 7f1355288e00 1 -- 10.20.193.28:0/2471415525 >> 10.20.193.28:0/2471415525 conn(0x55bc0e66d290 msgr2=0x55bc0e6a8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.799+0000 7f1355288e00 1 -- 10.20.193.28:0/2471415525 shutdown_connections 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.799+0000 7f1355288e00 1 -- 10.20.193.28:0/2471415525 wait complete. 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.800+0000 7f1355288e00 1 -- start start 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.800+0000 7f1355288e00 1 Processor -- start 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.800+0000 7f1355288e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.800+0000 7f1355288e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.800+0000 7f1355288e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6b0000 0x55bc0e6c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f1355288e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bc0e5f98f0 con 0x55bc0e6b0000 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f1355288e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bc0e3ebf50 con 0x55bc0e6aafb0 2026-02-20T03:20:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f1355288e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bc0e6c39c0 con 0x55bc0e6aa630 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6b0000 0x55bc0e6c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33808/0 (socket says 10.20.193.28:33808) 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 -- 10.20.193.28:0/1050933353 learned_addr learned my addr 10.20.193.28:0/1050933353 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f1343fff640 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 -- 10.20.193.28:0/1050933353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6aafb0 msgr2=0x55bc0e6c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 -- 10.20.193.28:0/1050933353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6b0000 msgr2=0x55bc0e6c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6b0000 0x55bc0e6c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 -- 10.20.193.28:0/1050933353 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0e6bca30 con 0x55bc0e6aa630 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f13512f9640 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c4f90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f13480049d0 tx=0x7f1348009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56df008e39c07466 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f130a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:20:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.801+0000 7f130a7fc640 1 -- 10.20.193.28:0/1050933353 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134801b040 con 0x55bc0e6aa630 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f130a7fc640 1 -- 10.20.193.28:0/1050933353 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1348013740 con 0x55bc0e6aa630 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f130a7fc640 1 -- 10.20.193.28:0/1050933353 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13480156b0 con 0x55bc0e6aa630 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 1 -- 10.20.193.28:0/1050933353 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0e3ceb40 con 0x55bc0e6aa630 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f130a7fc640 1 -- 10.20.193.28:0/1050933353 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1348015850 con 0x55bc0e6aa630 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 10 client.26362 _ll_register_callbacks cb 0x55bc0e636f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 1 -- 10.20.193.28:0/1050933353 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc0e60b1a0 con 0x55bc0e6aa630 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f130a7fc640 1 -- 10.20.193.28:0/1050933353 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1348004b40 con 0x55bc0e6aa630 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 10 client.26362 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 1 -- 10.20.193.28:0/1050933353 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bc0e5b8230 con 0x55bc0e6aa630 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f130a7fc640 1 -- 10.20.193.28:0/1050933353 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f1348021070 con 0x55bc0e6aa630 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 10 client.26362 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 10 client.26362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 20 client.26362 populate_metadata read hostname 'trial028' 2026-02-20T03:20:19.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bc0e6d3450 0x55bc0e6d5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 4 client.26362 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:19.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.802+0000 7f1355288e00 1 -- 10.20.193.28:0/1050933353 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc0e6055b0 con 0x55bc0e6d3450 2026-02-20T03:20:19.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.803+0000 7f1343fff640 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bc0e6d3450 0x55bc0e6d5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.803+0000 7f1343fff640 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bc0e6d3450 0x55bc0e6d5840 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ad5882d66a0d9d server_cookie=e71dd0e690881555 in_seq=0 out_seq=0 2026-02-20T03:20:19.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.803+0000 7f130a7fc640 10 client.26362 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:19.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f130a7fc640 1 -- 10.20.193.28:0/1050933353 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55bc0e6055b0 con 0x55bc0e6d3450 2026-02-20T03:20:19.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f130a7fc640 10 client.26362 handle_command_reply: tid=0 2026-02-20T03:20:19.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 client.26362 shutdown 2026-02-20T03:20:19.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 -- 10.20.193.28:0/1050933353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 msgr2=0x55bc0e6c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:19.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c4f90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f13480049d0 tx=0x7f1348009920 comp rx=0 tx=0).stop 2026-02-20T03:20:19.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 -- 10.20.193.28:0/1050933353 shutdown_connections 2026-02-20T03:20:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bc0e6d3450 0x55bc0e6d5840 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6b0000 0x55bc0e6c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 --2- 10.20.193.28:0/1050933353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c4f90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f130a7fc640 0 client.26362 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 -- 10.20.193.28:0/1050933353 >> 10.20.193.28:0/1050933353 conn(0x55bc0e66d290 msgr2=0x55bc0e6a9440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 -- 10.20.193.28:0/1050933353 shutdown_connections 2026-02-20T03:20:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.804+0000 7f1355288e00 1 -- 10.20.193.28:0/1050933353 wait complete. 2026-02-20T03:20:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.805+0000 7f1355288e00 20 client.26362 trim_cache size 0 max 16384 2026-02-20T03:20:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1355288e00 1 Processor -- start 2026-02-20T03:20:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1355288e00 1 -- start start 2026-02-20T03:20:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1355288e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1355288e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1355288e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6daf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1355288e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0012710 con 0x55bc0e6aafb0 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1355288e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f12f000ffb0 con 0x55bc0e6b0000 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1355288e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12f000de00 con 0x55bc0e6aa630 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1343fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f13512f9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1343fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50990/0 (socket says 10.20.193.28:50990) 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.813+0000 7f1343fff640 1 -- 10.20.193.28:0/2669361625 learned_addr learned my addr 10.20.193.28:0/2669361625 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f13512f9640 1 --2- 10.20.193.28:0/2669361625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6daf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1343fff640 1 -- 10.20.193.28:0/2669361625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 msgr2=0x55bc0e6c08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1343fff640 1 --2- 10.20.193.28:0/2669361625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1343fff640 1 -- 10.20.193.28:0/2669361625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 msgr2=0x55bc0e6daf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:19.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1343fff640 1 --2- 10.20.193.28:0/2669361625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6daf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1343fff640 1 -- 10.20.193.28:0/2669361625 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0e6bc860 con 0x55bc0e6aafb0 2026-02-20T03:20:19.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f13512f9640 1 --2- 10.20.193.28:0/2669361625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6daf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:19.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1343fff640 1 --2- 10.20.193.28:0/2669361625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c0e00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1334009a30 tx=0x7f1334005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dacd7086635289 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1318ce3640 1 -- 10.20.193.28:0/2669361625 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334050070 con 0x55bc0e6aafb0 2026-02-20T03:20:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1318ce3640 1 -- 10.20.193.28:0/2669361625 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1334033040 con 0x55bc0e6aafb0 2026-02-20T03:20:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1318ce3640 1 -- 10.20.193.28:0/2669361625 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13340026e0 con 0x55bc0e6aafb0 2026-02-20T03:20:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1355288e00 1 -- 10.20.193.28:0/2669361625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aafb0 msgr2=0x55bc0e6c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1355288e00 1 --2- 10.20.193.28:0/2669361625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c0e00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1334009a30 tx=0x7f1334005950 comp rx=0 tx=0).stop 2026-02-20T03:20:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1355288e00 1 -- 10.20.193.28:0/2669361625 shutdown_connections 2026-02-20T03:20:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1355288e00 1 --2- 10.20.193.28:0/2669361625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6daf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1355288e00 1 --2- 10.20.193.28:0/2669361625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6c0e00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1355288e00 1 --2- 10.20.193.28:0/2669361625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aa630 0x55bc0e6c08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1355288e00 1 -- 10.20.193.28:0/2669361625 >> 10.20.193.28:0/2669361625 conn(0x55bc0e66d290 msgr2=0x55bc0e6c4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1355288e00 1 -- 10.20.193.28:0/2669361625 shutdown_connections 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.814+0000 7f1355288e00 1 -- 10.20.193.28:0/2669361625 wait complete. 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.815+0000 7f1355288e00 1 -- start start 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.815+0000 7f1355288e00 1 Processor -- start 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1355288e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 0x55bc0e6cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1355288e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1355288e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1355288e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12f000e470 con 0x55bc0e6aa630 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1355288e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f12f000f8e0 con 0x55bc0e6b0000 2026-02-20T03:20:19.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1355288e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12f000eb40 con 0x55bc0e6aafb0 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1343fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1343fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33828/0 (socket says 10.20.193.28:33828) 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1343fff640 1 -- 10.20.193.28:0/3582732635 learned_addr learned my addr 10.20.193.28:0/3582732635 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f13512f9640 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f13512f9640 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 0x55bc0e6cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1343fff640 1 -- 10.20.193.28:0/3582732635 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 msgr2=0x55bc0e6cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1343fff640 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1343fff640 1 -- 10.20.193.28:0/3582732635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 msgr2=0x55bc0e6cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1343fff640 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 0x55bc0e6cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1343fff640 1 -- 10.20.193.28:0/3582732635 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0e2dc870 con 0x55bc0e6aafb0 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f13512f9640 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 0x55bc0e6cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:19.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.816+0000 7f1343fff640 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6cfd10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f133404e040 tx=0x7f133402f220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94a23149761d3fc0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f130a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f130a7fc640 1 -- 10.20.193.28:0/3582732635 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334050040 con 0x55bc0e6aafb0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f130a7fc640 1 -- 10.20.193.28:0/3582732635 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1334009620 con 0x55bc0e6aafb0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 1 -- 10.20.193.28:0/3582732635 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0e59d440 con 0x55bc0e6aafb0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 10 client.26368 _ll_register_callbacks cb 0x7f1348004890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 1 -- 10.20.193.28:0/3582732635 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bc0e5afb00 con 0x55bc0e6aafb0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f130a7fc640 1 -- 10.20.193.28:0/3582732635 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334002ad0 con 0x55bc0e6aafb0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f130a7fc640 1 -- 10.20.193.28:0/3582732635 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1334002c70 con 0x55bc0e6aafb0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f130a7fc640 1 -- 10.20.193.28:0/3582732635 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1334044480 con 0x55bc0e6aafb0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 10 client.26368 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 1 -- 10.20.193.28:0/3582732635 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bc0e6bd550 con 0x55bc0e6aafb0 2026-02-20T03:20:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f130a7fc640 1 -- 10.20.193.28:0/3582732635 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f1334053070 con 0x55bc0e6aafb0 2026-02-20T03:20:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 10 client.26368 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 10 client.26368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 20 client.26368 populate_metadata read hostname 'trial028' 2026-02-20T03:20:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bc0e73ef40 0x55bc0e7413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 4 client.26368 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:20:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.817+0000 7f1355288e00 1 -- 10.20.193.28:0/3582732635 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f13480045b0 con 0x55bc0e73ef40 2026-02-20T03:20:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.818+0000 7f13512f9640 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bc0e73ef40 0x55bc0e7413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.818+0000 7f13512f9640 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bc0e73ef40 0x55bc0e7413d0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca40d1dfa23ecc4 server_cookie=77faa973732cd933 in_seq=0 out_seq=0 2026-02-20T03:20:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.818+0000 7f130a7fc640 10 client.26368 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f130a7fc640 1 -- 10.20.193.28:0/3582732635 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f13480045b0 con 0x55bc0e73ef40 2026-02-20T03:20:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f130a7fc640 10 client.26368 handle_command_reply: tid=0 2026-02-20T03:20:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 client.26368 shutdown 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 -- 10.20.193.28:0/3582732635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 msgr2=0x55bc0e6cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6cfd10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f133404e040 tx=0x7f133402f220 comp rx=0 tx=0).stop 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 -- 10.20.193.28:0/3582732635 shutdown_connections 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bc0e73ef40 0x55bc0e7413d0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bc0e6b0000 0x55bc0e6cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bc0e6aafb0 0x55bc0e6cfd10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 --2- 10.20.193.28:0/3582732635 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bc0e6aa630 0x55bc0e6cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 -- 10.20.193.28:0/3582732635 >> 10.20.193.28:0/3582732635 conn(0x55bc0e66d290 msgr2=0x55bc0e6bf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f130a7fc640 0 client.26368 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 -- 10.20.193.28:0/3582732635 shutdown_connections 2026-02-20T03:20:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 1 -- 10.20.193.28:0/3582732635 wait complete. 2026-02-20T03:20:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.819+0000 7f1355288e00 20 client.26368 trim_cache size 0 max 16384 2026-02-20T03:20:19.828 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:20:19.828 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:20:19.828 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:20:19.828 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:20:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 -- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13280b0e20 msgr2=0x7f13280b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13280b0e20 0x7f13280b32e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f133c0e0b00 tx=0x7f133c005f90 comp rx=0 tx=0).stop 2026-02-20T03:20:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 -- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10d6f0 msgr2=0x7f134c06e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10d6f0 0x7f134c06e730 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f133c00d980 tx=0x7f133c00de50 comp rx=0 tx=0).stop 2026-02-20T03:20:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 -- 10.20.193.28:0/3281954606 shutdown_connections 2026-02-20T03:20:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f13280b0e20 0x7f13280b32e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f134c112700 0x7f134c06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f134c10e0a0 0x7f134c06ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 --2- 10.20.193.28:0/3281954606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f134c10d6f0 0x7f134c06e730 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 -- 10.20.193.28:0/3281954606 >> 10.20.193.28:0/3281954606 conn(0x7f134c06d500 msgr2=0x7f134c10b760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 -- 10.20.193.28:0/3281954606 shutdown_connections 2026-02-20T03:20:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:19.820+0000 7f1351afa640 1 -- 10.20.193.28:0/3281954606 wait complete. 2026-02-20T03:20:19.922 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:20:19.923 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:20:20.194 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:20.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.375+0000 7f349a0ef640 1 -- 10.20.193.28:0/1298895001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3494109220 msgr2=0x7f3494109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.375+0000 7f349a0ef640 1 --2- 10.20.193.28:0/1298895001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3494109220 0x7f3494109660 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3488009a30 tx=0x7f348802f220 comp rx=0 tx=0).stop 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.375+0000 7f349a0ef640 1 -- 10.20.193.28:0/1298895001 shutdown_connections 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.375+0000 7f349a0ef640 1 --2- 10.20.193.28:0/1298895001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3494109ba0 0x7f3494115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.375+0000 7f349a0ef640 1 --2- 10.20.193.28:0/1298895001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3494109220 0x7f3494109660 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.375+0000 7f349a0ef640 1 --2- 10.20.193.28:0/1298895001 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f349410eef0 0x7f349410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.375+0000 7f349a0ef640 1 -- 10.20.193.28:0/1298895001 >> 10.20.193.28:0/1298895001 conn(0x7f3494078600 msgr2=0x7f349407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.375+0000 7f349a0ef640 1 -- 10.20.193.28:0/1298895001 shutdown_connections 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.375+0000 7f349a0ef640 1 -- 10.20.193.28:0/1298895001 wait complete. 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.376+0000 7f349a0ef640 1 Processor -- start 2026-02-20T03:20:20.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.376+0000 7f349a0ef640 1 -- start start 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.376+0000 7f349a0ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3494109220 0x7f3494074680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.376+0000 7f349a0ef640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3494109ba0 0x7f3494074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.376+0000 7f349a0ef640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f349410eef0 0x7f349406d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f349a0ef640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3494119090 con 0x7f3494109220 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f349a0ef640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3494118f10 con 0x7f3494109ba0 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f349a0ef640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3494119210 con 0x7f349410eef0 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34988ec640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3494109ba0 0x7f3494074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34988ec640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3494109ba0 0x7f3494074bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35766/0 (socket says 10.20.193.28:35766) 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34988ec640 1 -- 10.20.193.28:0/417666408 learned_addr learned my addr 10.20.193.28:0/417666408 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34990ed640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3494109220 0x7f3494074680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:20.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34998ee640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f349410eef0 0x7f349406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:20.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34990ed640 1 -- 10.20.193.28:0/417666408 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f349410eef0 msgr2=0x7f349406d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:20.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34990ed640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f349410eef0 0x7f349406d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34990ed640 1 -- 10.20.193.28:0/417666408 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3494109ba0 msgr2=0x7f3494074bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:20.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34990ed640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3494109ba0 0x7f3494074bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34990ed640 1 -- 10.20.193.28:0/417666408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349406e0f0 con 0x7f3494109220 2026-02-20T03:20:20.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34988ec640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3494109ba0 0x7f3494074bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:20.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.377+0000 7f34990ed640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3494109220 0x7f3494074680 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f348400e9f0 tx=0x7f348400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:20.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.378+0000 7f34827fc640 1 -- 10.20.193.28:0/417666408 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348400cd80 con 0x7f3494109220 2026-02-20T03:20:20.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.378+0000 7f34827fc640 1 -- 10.20.193.28:0/417666408 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3484004570 con 0x7f3494109220 2026-02-20T03:20:20.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.378+0000 7f34827fc640 1 -- 10.20.193.28:0/417666408 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484010690 con 0x7f3494109220 2026-02-20T03:20:20.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.378+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349406e3e0 con 0x7f3494109220 2026-02-20T03:20:20.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.378+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3494072380 con 0x7f3494109220 2026-02-20T03:20:20.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.378+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f349410a580 con 0x7f3494109220 2026-02-20T03:20:20.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.380+0000 7f34827fc640 1 -- 10.20.193.28:0/417666408 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3484002890 con 0x7f3494109220 2026-02-20T03:20:20.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.381+0000 7f34827fc640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34700b0e20 0x7f34700b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:20.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.382+0000 7f34827fc640 1 -- 10.20.193.28:0/417666408 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f34840e0df0 con 0x7f3494109220 2026-02-20T03:20:20.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.382+0000 7f34988ec640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34700b0e20 0x7f34700b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:20.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.382+0000 7f34988ec640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34700b0e20 0x7f34700b32e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f349406eed0 tx=0x7f3488005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:20.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.383+0000 7f34827fc640 1 -- 10.20.193.28:0/417666408 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f34840a91d0 con 0x7f3494109220 2026-02-20T03:20:20.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.490+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3494072e60 con 0x7f3494109220 2026-02-20T03:20:20.493 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:20 trial028 ceph-mon[38552]: pgmap v351: 129 pgs: 129 active+clean; 71 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 287 op/s 2026-02-20T03:20:20.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.491+0000 7f34827fc640 1 -- 10.20.193.28:0/417666408 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11922 (secure 0 0 0) 0x7f34840ace80 con 0x7f3494109220 2026-02-20T03:20:20.494 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:20:20.494 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":28,"btime":"2026-02-20T03:19:18:240749+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:19:17.378192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:20:20.495 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 28 2026-02-20T03:20:20.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.492+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34700b0e20 msgr2=0x7f34700b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.492+0000 7f349a0ef640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34700b0e20 0x7f34700b32e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f349406eed0 tx=0x7f3488005e50 comp rx=0 tx=0).stop 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.492+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3494109220 msgr2=0x7f3494074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.492+0000 7f349a0ef640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3494109220 0x7f3494074680 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f348400e9f0 tx=0x7f348400eec0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.493+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 shutdown_connections 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.493+0000 7f349a0ef640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34700b0e20 0x7f34700b32e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.493+0000 7f349a0ef640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f349410eef0 0x7f349406d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.493+0000 7f349a0ef640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3494109ba0 0x7f3494074bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.493+0000 7f349a0ef640 1 --2- 10.20.193.28:0/417666408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3494109220 0x7f3494074680 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.493+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 >> 10.20.193.28:0/417666408 conn(0x7f3494078600 msgr2=0x7f3494079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.493+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 shutdown_connections 2026-02-20T03:20:20.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:20.493+0000 7f349a0ef640 1 -- 10.20.193.28:0/417666408 wait complete. 2026-02-20T03:20:20.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 415155 5.41 MB/sec execute 113 sec latency 13.104 ms 2026-02-20T03:20:20.596 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:20:20.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:20 trial126 ceph-mon[38476]: pgmap v351: 129 pgs: 129 active+clean; 71 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 287 op/s 2026-02-20T03:20:20.855 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:20.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:20 trial177 ceph-mon[43181]: pgmap v351: 129 pgs: 129 active+clean; 71 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 287 op/s 2026-02-20T03:20:21.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.040+0000 7f6d14b06640 1 -- 10.20.193.28:0/3609528519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d1010a9a0 msgr2=0x7f6d1010ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.040+0000 7f6d14b06640 1 --2- 10.20.193.28:0/3609528519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d1010a9a0 0x7f6d1010ad80 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009a60 tx=0x7f6cfc02f260 comp rx=0 tx=0).stop 2026-02-20T03:20:21.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.040+0000 7f6d14b06640 1 -- 10.20.193.28:0/3609528519 shutdown_connections 2026-02-20T03:20:21.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.040+0000 7f6d14b06640 1 --2- 10.20.193.28:0/3609528519 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d10105340 0x7f6d10111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.040+0000 7f6d14b06640 1 --2- 10.20.193.28:0/3609528519 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d101049a0 0x7f6d10104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.040+0000 7f6d14b06640 1 --2- 10.20.193.28:0/3609528519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d1010a9a0 0x7f6d1010ad80 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.040+0000 7f6d14b06640 1 -- 10.20.193.28:0/3609528519 >> 10.20.193.28:0/3609528519 conn(0x7f6d101006c0 msgr2=0x7f6d10102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.040+0000 7f6d14b06640 1 -- 10.20.193.28:0/3609528519 shutdown_connections 2026-02-20T03:20:21.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.040+0000 7f6d14b06640 1 -- 10.20.193.28:0/3609528519 wait complete. 2026-02-20T03:20:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.041+0000 7f6d14b06640 1 Processor -- start 2026-02-20T03:20:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.041+0000 7f6d14b06640 1 -- start start 2026-02-20T03:20:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.041+0000 7f6d14b06640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d101049a0 0x7f6d1019d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.041+0000 7f6d14b06640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d10105340 0x7f6d1019d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.041+0000 7f6d14b06640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d1010a9a0 0x7f6d101a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.041+0000 7f6d14b06640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10114c10 con 0x7f6d101049a0 2026-02-20T03:20:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.041+0000 7f6d14b06640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10114a90 con 0x7f6d1010a9a0 2026-02-20T03:20:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.041+0000 7f6d14b06640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10114d90 con 0x7f6d10105340 2026-02-20T03:20:21.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d10105340 0x7f6d1019d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d1010a9a0 0x7f6d101a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d10105340 0x7f6d1019d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33866/0 (socket says 10.20.193.28:33866) 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0effd640 1 -- 10.20.193.28:0/1033951015 learned_addr learned my addr 10.20.193.28:0/1033951015 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d101049a0 0x7f6d1019d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0effd640 1 -- 10.20.193.28:0/1033951015 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d1010a9a0 msgr2=0x7f6d101a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0effd640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d1010a9a0 0x7f6d101a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0effd640 1 -- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d101049a0 msgr2=0x7f6d1019d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0effd640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d101049a0 0x7f6d1019d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0effd640 1 -- 10.20.193.28:0/1033951015 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d101a20e0 con 0x7f6d10105340 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d101049a0 0x7f6d1019d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0effd640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d10105340 0x7f6d1019d5d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000ea30 tx=0x7f6d0000ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0cff9640 1 -- 10.20.193.28:0/1033951015 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000ce50 con 0x7f6d10105340 2026-02-20T03:20:21.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d14b06640 1 -- 10.20.193.28:0/1033951015 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d101a23d0 con 0x7f6d10105340 2026-02-20T03:20:21.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0cff9640 1 -- 10.20.193.28:0/1033951015 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d00004570 con 0x7f6d10105340 2026-02-20T03:20:21.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.042+0000 7f6d0cff9640 1 -- 10.20.193.28:0/1033951015 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00010690 con 0x7f6d10105340 2026-02-20T03:20:21.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.043+0000 7f6d14b06640 1 -- 10.20.193.28:0/1033951015 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d101a9c10 con 0x7f6d10105340 2026-02-20T03:20:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d18294e00 1 Processor -- start 2026-02-20T03:20:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d18294e00 1 -- start start 2026-02-20T03:20:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d0cff9640 1 -- 10.20.193.28:0/1033951015 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6d000040d0 con 0x7f6d10105340 2026-02-20T03:20:21.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eab6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 0x55fd9eab1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eabd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d18294e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd9ea28e00 con 0x55fd9eab69c0 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d18294e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e9fb970 con 0x55fd9eab1970 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d18294e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e9a91f0 con 0x55fd9eab0ff0 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d0effd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eabd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eab6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d0effd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eabd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35790/0 (socket says 10.20.193.28:35790) 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d0effd640 1 -- 10.20.193.28:0/2481812780 learned_addr learned my addr 10.20.193.28:0/2481812780 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/2481812780 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 0x55fd9eab1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d0effd640 1 -- 10.20.193.28:0/2481812780 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 msgr2=0x55fd9eab1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d0effd640 1 --2- 10.20.193.28:0/2481812780 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 0x55fd9eab1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.046+0000 7f6d0effd640 1 -- 10.20.193.28:0/2481812780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 msgr2=0x55fd9eab6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6d0effd640 1 --2- 10.20.193.28:0/2481812780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eab6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6d0effd640 1 -- 10.20.193.28:0/2481812780 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9e9bc3d0 con 0x55fd9eab1970 2026-02-20T03:20:21.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/2481812780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eab6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:21.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6d0effd640 1 --2- 10.20.193.28:0/2481812780 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eabd7f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d000e90e0 tx=0x7f6d000e91e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81cbdd705740a30e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6cd3fff640 1 -- 10.20.193.28:0/2481812780 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d000f4070 con 0x55fd9eab1970 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6cd3fff640 1 -- 10.20.193.28:0/2481812780 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d000e9e30 con 0x55fd9eab1970 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6cd3fff640 1 -- 10.20.193.28:0/2481812780 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d000ee7d0 con 0x55fd9eab1970 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6d0cff9640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ce40b0e20 0x7f6ce40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6d18294e00 1 -- 10.20.193.28:0/2481812780 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 msgr2=0x55fd9eabd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2481812780 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eabd7f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d000e90e0 tx=0x7f6d000e91e0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.047+0000 7f6d0cff9640 1 -- 10.20.193.28:0/1033951015 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6d000e0f60 con 0x7f6d10105340 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.048+0000 7f6d18294e00 1 -- 10.20.193.28:0/2481812780 shutdown_connections 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.048+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2481812780 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eabd7f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.048+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2481812780 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 0x55fd9eab1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.048+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2481812780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eab6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.048+0000 7f6d18294e00 1 -- 10.20.193.28:0/2481812780 >> 10.20.193.28:0/2481812780 conn(0x55fd9ea6b240 msgr2=0x55fd9eaa6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.048+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ce40b0e20 0x7f6ce40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.048+0000 7f6d18294e00 1 -- 10.20.193.28:0/2481812780 shutdown_connections 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.048+0000 7f6d18294e00 1 -- 10.20.193.28:0/2481812780 wait complete. 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.048+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ce40b0e20 0x7f6ce40b32e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009550 tx=0x7f6d0400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.049+0000 7f6d18294e00 1 -- start start 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.049+0000 7f6d18294e00 1 Processor -- start 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.049+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.049+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 0x55fd9eaca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.049+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eacf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d18294e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e9f78a0 con 0x55fd9eab69c0 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d18294e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fd9e7e9f50 con 0x55fd9eab0ff0 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d18294e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd9eacfd00 con 0x55fd9eab1970 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35804/0 (socket says 10.20.193.28:35804) 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0f7fe640 1 -- 10.20.193.28:0/3241156750 learned_addr learned my addr 10.20.193.28:0/3241156750 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0effd640 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 0x55fd9eaca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eacf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0ffff640 1 -- 10.20.193.28:0/3241156750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 msgr2=0x55fd9eaca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 0x55fd9eaca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0ffff640 1 -- 10.20.193.28:0/3241156750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 msgr2=0x55fd9eac9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0ffff640 1 -- 10.20.193.28:0/3241156750 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9eac3490 con 0x55fd9eab69c0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eacf7c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6d04007a80 tx=0x7f6d04004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fb6c5fbb237c62 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6cd17fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6cd17fa640 1 -- 10.20.193.28:0/3241156750 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04016c70 con 0x55fd9eab69c0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d18294e00 1 -- 10.20.193.28:0/3241156750 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9e7ccb40 con 0x55fd9eab69c0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.050+0000 7f6d18294e00 10 client.16740 _ll_register_callbacks cb 0x55fd9ea34eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6d18294e00 1 -- 10.20.193.28:0/3241156750 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd9ea09150 con 0x55fd9eab69c0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6cd17fa640 1 -- 10.20.193.28:0/3241156750 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d04016e10 con 0x55fd9eab69c0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6cd17fa640 1 -- 10.20.193.28:0/3241156750 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d040155e0 con 0x55fd9eab69c0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6cd17fa640 1 -- 10.20.193.28:0/3241156750 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6d04015780 con 0x55fd9eab69c0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6cd17fa640 1 -- 10.20.193.28:0/3241156750 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d04015a40 con 0x55fd9eab69c0 2026-02-20T03:20:21.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6d18294e00 10 client.16740 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6d18294e00 1 -- 10.20.193.28:0/3241156750 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55fd9e9b61e0 con 0x55fd9eab69c0 2026-02-20T03:20:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6cd17fa640 1 -- 10.20.193.28:0/3241156750 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f6d04015be0 con 0x55fd9eab69c0 2026-02-20T03:20:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6d18294e00 10 client.16740 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:21.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6d18294e00 10 client.16740 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:20:21.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6d18294e00 20 client.16740 populate_metadata read hostname 'trial028' 2026-02-20T03:20:21.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6d18294e00 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fd9ead9d50 0x55fd9eadc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6d18294e00 4 client.16740 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.051+0000 7f6d18294e00 1 -- 10.20.193.28:0/3241156750 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd9ea03560 con 0x55fd9ead9d50 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.052+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fd9ead9d50 0x55fd9eadc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.052+0000 7f6cd17fa640 10 client.16740 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.052+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fd9ead9d50 0x55fd9eadc140 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69cb774a32dd0e27 server_cookie=14a958c3215fc836 in_seq=0 out_seq=0 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6cd17fa640 1 -- 10.20.193.28:0/3241156750 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fd9ea03560 con 0x55fd9ead9d50 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6cd17fa640 10 client.16740 handle_command_reply: tid=0 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 client.16740 shutdown 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 -- 10.20.193.28:0/3241156750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 msgr2=0x55fd9eacf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eacf7c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6d04007a80 tx=0x7f6d04004bb0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 -- 10.20.193.28:0/3241156750 shutdown_connections 2026-02-20T03:20:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fd9ead9d50 0x55fd9eadc140 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eacf7c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 0x55fd9eaca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 --2- 10.20.193.28:0/3241156750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 -- 10.20.193.28:0/3241156750 >> 10.20.193.28:0/3241156750 conn(0x55fd9ea6b240 msgr2=0x55fd9eaa73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6cd17fa640 0 client.16740 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:20:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 -- 10.20.193.28:0/3241156750 shutdown_connections 2026-02-20T03:20:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 1 -- 10.20.193.28:0/3241156750 wait complete. 2026-02-20T03:20:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.053+0000 7f6d18294e00 20 client.16740 trim_cache size 0 max 16384 2026-02-20T03:20:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d18294e00 1 Processor -- start 2026-02-20T03:20:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d18294e00 1 -- start start 2026-02-20T03:20:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eae1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eae1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d18294e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb40127a0 con 0x55fd9eab69c0 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d18294e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb4010040 con 0x55fd9eab1970 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d18294e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb400de90 con 0x55fd9eab0ff0 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eae1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eae1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51066/0 (socket says 10.20.193.28:51066) 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0ffff640 1 -- 10.20.193.28:0/1840707271 learned_addr learned my addr 10.20.193.28:0/1840707271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0effd640 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eae1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0ffff640 1 -- 10.20.193.28:0/1840707271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 msgr2=0x55fd9eac77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0ffff640 1 -- 10.20.193.28:0/1840707271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 msgr2=0x55fd9eae1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eae1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0ffff640 1 -- 10.20.193.28:0/1840707271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9eac32c0 con 0x55fd9eab69c0 2026-02-20T03:20:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.060+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:21.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.061+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eae1f90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6d04016870 tx=0x7f6d0402b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29733b7072ba6dd6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.061+0000 7f6cd37fe640 1 -- 10.20.193.28:0/1840707271 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04015ca0 con 0x55fd9eab69c0 2026-02-20T03:20:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.061+0000 7f6cd37fe640 1 -- 10.20.193.28:0/1840707271 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55fd9ea09150 con 0x55fd9eab69c0 2026-02-20T03:20:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.061+0000 7f6cd37fe640 1 -- 10.20.193.28:0/1840707271 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04022a40 con 0x55fd9eab69c0 2026-02-20T03:20:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 -- 10.20.193.28:0/1840707271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 msgr2=0x55fd9eae1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eae1f90 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6d04016870 tx=0x7f6d0402b000 comp rx=0 tx=0).stop 2026-02-20T03:20:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 -- 10.20.193.28:0/1840707271 shutdown_connections 2026-02-20T03:20:21.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9eae1f90 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab1970 0x55fd9eae1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 --2- 10.20.193.28:0/1840707271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab0ff0 0x55fd9eac77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 -- 10.20.193.28:0/1840707271 >> 10.20.193.28:0/1840707271 conn(0x55fd9ea6b240 msgr2=0x55fd9eadbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 -- 10.20.193.28:0/1840707271 shutdown_connections 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 -- 10.20.193.28:0/1840707271 wait complete. 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 -- start start 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.062+0000 7f6d18294e00 1 Processor -- start 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9ead61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 0x55fd9ead2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d18294e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9ead2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d18294e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb400e500 con 0x55fd9eab69c0 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d18294e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb400f970 con 0x55fd9eab0ff0 2026-02-20T03:20:21.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d18294e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb400ebd0 con 0x55fd9eab1970 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9ead61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 0x55fd9ead2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9ead61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35828/0 (socket says 10.20.193.28:35828) 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0f7fe640 1 -- 10.20.193.28:0/2800059646 learned_addr learned my addr 10.20.193.28:0/2800059646 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9ead2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0ffff640 1 -- 10.20.193.28:0/2800059646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 msgr2=0x55fd9ead2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 0x55fd9ead2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0ffff640 1 -- 10.20.193.28:0/2800059646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 msgr2=0x55fd9ead61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9ead61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.063+0000 7f6d0ffff640 1 -- 10.20.193.28:0/2800059646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd9e6da870 con 0x55fd9eab69c0 2026-02-20T03:20:21.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d0ffff640 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9ead2a50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6d04007a80 tx=0x7f6d040168a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6184ec07358cee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6cd17fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6cd17fa640 1 -- 10.20.193.28:0/2800059646 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04004a70 con 0x55fd9eab69c0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 1 -- 10.20.193.28:0/2800059646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd9e99b3f0 con 0x55fd9eab69c0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 10 client.16746 _ll_register_callbacks cb 0x7f6d04009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 1 -- 10.20.193.28:0/2800059646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd9e9cc7c0 con 0x55fd9eab69c0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6cd17fa640 1 -- 10.20.193.28:0/2800059646 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d04004a70 con 0x55fd9eab69c0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6cd17fa640 1 -- 10.20.193.28:0/2800059646 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04035670 con 0x55fd9eab69c0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6cd17fa640 1 -- 10.20.193.28:0/2800059646 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6d04035810 con 0x55fd9eab69c0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6cd17fa640 1 -- 10.20.193.28:0/2800059646 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d0404b060 con 0x55fd9eab69c0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 10 client.16746 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 1 -- 10.20.193.28:0/2800059646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55fd9eac3fb0 con 0x55fd9eab69c0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6cd17fa640 1 -- 10.20.193.28:0/2800059646 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f6d04022570 con 0x55fd9eab69c0 2026-02-20T03:20:21.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 10 client.16746 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 10 client.16746 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 20 client.16746 populate_metadata read hostname 'trial028' 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fd9eb459c0 0x55fd9eb47e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 4 client.16746 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.064+0000 7f6d18294e00 1 -- 10.20.193.28:0/2800059646 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd9e9adab0 con 0x55fd9eb459c0 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.065+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fd9eb459c0 0x55fd9eb47e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.065+0000 7f6d0f7fe640 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fd9eb459c0 0x55fd9eb47e80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b818538da9d5d67 server_cookie=c2e0515b9e7caf55 in_seq=0 out_seq=0 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.065+0000 7f6cd17fa640 10 client.16746 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6cd17fa640 1 -- 10.20.193.28:0/2800059646 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd9e9adab0 con 0x55fd9eb459c0 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6cd17fa640 10 client.16746 handle_command_reply: tid=0 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 client.16746 shutdown 2026-02-20T03:20:21.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 -- 10.20.193.28:0/2800059646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 msgr2=0x55fd9ead2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9ead2a50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6d04007a80 tx=0x7f6d040168a0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 -- 10.20.193.28:0/2800059646 shutdown_connections 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fd9eb459c0 0x55fd9eb47e80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd9eab69c0 0x55fd9ead2a50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd9eab1970 0x55fd9ead2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 --2- 10.20.193.28:0/2800059646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd9eab0ff0 0x55fd9ead61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 -- 10.20.193.28:0/2800059646 >> 10.20.193.28:0/2800059646 conn(0x55fd9ea6b240 msgr2=0x55fd9eadbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6cd17fa640 0 client.16746 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 -- 10.20.193.28:0/2800059646 shutdown_connections 2026-02-20T03:20:21.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 1 -- 10.20.193.28:0/2800059646 wait complete. 2026-02-20T03:20:21.076 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:20:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d18294e00 20 client.16746 trim_cache size 0 max 16384 2026-02-20T03:20:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.066+0000 7f6d14b06640 1 -- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ce40b0e20 msgr2=0x7f6ce40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ce40b0e20 0x7f6ce40b32e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009550 tx=0x7f6d0400b040 comp rx=0 tx=0).stop 2026-02-20T03:20:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 -- 10.20.193.28:0/1033951015 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d10105340 msgr2=0x7f6d1019d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d10105340 0x7f6d1019d5d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000ea30 tx=0x7f6d0000ef00 comp rx=0 tx=0).stop 2026-02-20T03:20:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 -- 10.20.193.28:0/1033951015 shutdown_connections 2026-02-20T03:20:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ce40b0e20 0x7f6ce40b32e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d1010a9a0 0x7f6d101a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d10105340 0x7f6d1019d5d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 --2- 10.20.193.28:0/1033951015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d101049a0 0x7f6d1019d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 -- 10.20.193.28:0/1033951015 >> 10.20.193.28:0/1033951015 conn(0x7f6d101006c0 msgr2=0x7f6d10100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 -- 10.20.193.28:0/1033951015 shutdown_connections 2026-02-20T03:20:21.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.067+0000 7f6d14b06640 1 -- 10.20.193.28:0/1033951015 wait complete. 2026-02-20T03:20:21.169 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:20:21.438 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:21.474 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:21 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/417666408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:20:21.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 418657 5.53 MB/sec execute 114 sec latency 24.395 ms 2026-02-20T03:20:21.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.621+0000 7fbef6845640 1 -- 10.20.193.28:0/545125963 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbef0105330 msgr2=0x7fbef0111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.621+0000 7fbef6845640 1 --2- 10.20.193.28:0/545125963 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbef0105330 0x7fbef0111860 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00b0d0 tx=0x7fbeec02f450 comp rx=0 tx=0).stop 2026-02-20T03:20:21.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.621+0000 7fbef6845640 1 -- 10.20.193.28:0/545125963 shutdown_connections 2026-02-20T03:20:21.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.621+0000 7fbef6845640 1 --2- 10.20.193.28:0/545125963 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbef0105330 0x7fbef0111860 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.621+0000 7fbef6845640 1 --2- 10.20.193.28:0/545125963 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbef0104990 0x7fbef0104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.621+0000 7fbef6845640 1 --2- 10.20.193.28:0/545125963 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbef010a990 0x7fbef010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.621+0000 7fbef6845640 1 -- 10.20.193.28:0/545125963 >> 10.20.193.28:0/545125963 conn(0x7fbef0100690 msgr2=0x7fbef0102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.621+0000 7fbef6845640 1 -- 10.20.193.28:0/545125963 shutdown_connections 2026-02-20T03:20:21.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.621+0000 7fbef6845640 1 -- 10.20.193.28:0/545125963 wait complete. 2026-02-20T03:20:21.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.622+0000 7fbef6845640 1 Processor -- start 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.622+0000 7fbef6845640 1 -- start start 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.622+0000 7fbef6845640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbef0104990 0x7fbef019d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6845640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbef0105330 0x7fbef019d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6845640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbef010a990 0x7fbef01a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6845640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0114c00 con 0x7fbef010a990 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6845640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0114a80 con 0x7fbef0105330 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6845640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0114d80 con 0x7fbef0104990 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef5843640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbef0104990 0x7fbef019d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef5042640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbef0105330 0x7fbef019d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6044640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbef010a990 0x7fbef01a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef5042640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbef0105330 0x7fbef019d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35846/0 (socket says 10.20.193.28:35846) 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef5042640 1 -- 10.20.193.28:0/3619201845 learned_addr learned my addr 10.20.193.28:0/3619201845 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6044640 1 -- 10.20.193.28:0/3619201845 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbef0104990 msgr2=0x7fbef019d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6044640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbef0104990 0x7fbef019d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6044640 1 -- 10.20.193.28:0/3619201845 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbef0105330 msgr2=0x7fbef019d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6044640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbef0105330 0x7fbef019d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef6044640 1 -- 10.20.193.28:0/3619201845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef01a2050 con 0x7fbef010a990 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.623+0000 7fbef5042640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbef0105330 0x7fbef019d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.624+0000 7fbef6044640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbef010a990 0x7fbef01a18d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00c090 tx=0x7fbeec009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.624+0000 7fbedeffd640 1 -- 10.20.193.28:0/3619201845 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec046070 con 0x7fbef010a990 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.624+0000 7fbedeffd640 1 -- 10.20.193.28:0/3619201845 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbeec0076a0 con 0x7fbef010a990 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.624+0000 7fbedeffd640 1 -- 10.20.193.28:0/3619201845 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0416e0 con 0x7fbef010a990 2026-02-20T03:20:21.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.624+0000 7fbef6845640 1 -- 10.20.193.28:0/3619201845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef01a22e0 con 0x7fbef010a990 2026-02-20T03:20:21.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.624+0000 7fbef6845640 1 -- 10.20.193.28:0/3619201845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef01a9b80 con 0x7fbef010a990 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.627+0000 7fbedeffd640 1 -- 10.20.193.28:0/3619201845 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbeec007b80 con 0x7fbef010a990 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.627+0000 7fbef9fd3e00 1 Processor -- start 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.627+0000 7fbef9fd3e00 1 -- start start 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 0x564265d24390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d1ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d2ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564265c9ee00 con 0x564265d1ef60 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564265c71970 con 0x564265d23fb0 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564265c1f1f0 con 0x564265d1e5e0 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef5042640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d2ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef5843640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d1ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef5843640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d1ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33904/0 (socket says 10.20.193.28:33904) 2026-02-20T03:20:21.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef5843640 1 -- 10.20.193.28:0/771868335 learned_addr learned my addr 10.20.193.28:0/771868335 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.628+0000 7fbef5042640 1 --2- 10.20.193.28:0/771868335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 0x564265d24390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbedeffd640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbecc0b0e20 0x7fbecc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbef5843640 1 -- 10.20.193.28:0/771868335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 msgr2=0x564265d24390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbef5843640 1 --2- 10.20.193.28:0/771868335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 0x564265d24390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbef5843640 1 -- 10.20.193.28:0/771868335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 msgr2=0x564265d2ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbef5843640 1 --2- 10.20.193.28:0/771868335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d2ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbef5843640 1 -- 10.20.193.28:0/771868335 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564265c323d0 con 0x564265d1e5e0 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbef5042640 1 --2- 10.20.193.28:0/771868335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d2ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbedeffd640 1 -- 10.20.193.28:0/3619201845 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fbeec105490 con 0x7fbef010a990 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbef6044640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbecc0b0e20 0x7fbecc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbef5843640 1 --2- 10.20.193.28:0/771868335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d1ea20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbee0007cd0 tx=0x7fbee00107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57a2f8073a08e929 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbebe4e6640 1 -- 10.20.193.28:0/771868335 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee00040d0 con 0x564265d1e5e0 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbebe4e6640 1 -- 10.20.193.28:0/771868335 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbee0015030 con 0x564265d1e5e0 2026-02-20T03:20:21.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbef6044640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbecc0b0e20 0x7fbecc0b32e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0cd160 tx=0x7fbeec004a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.629+0000 7fbebe4e6640 1 -- 10.20.193.28:0/771868335 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee00116a0 con 0x564265d1e5e0 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.630+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/771868335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 msgr2=0x564265d1ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.630+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/771868335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d1ea20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbee0007cd0 tx=0x7fbee00107a0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.630+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/771868335 shutdown_connections 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.630+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/771868335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d2ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.630+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/771868335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d1ea20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.630+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/771868335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 0x564265d24390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.630+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/771868335 >> 10.20.193.28:0/771868335 conn(0x564265ce1240 msgr2=0x564265d1cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.630+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/771868335 shutdown_connections 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.630+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/771868335 wait complete. 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.631+0000 7fbef9fd3e00 1 -- start start 2026-02-20T03:20:21.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.631+0000 7fbef9fd3e00 1 Processor -- start 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.631+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.631+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 0x564265d378d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.631+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d23fb0 0x564265d3ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.631+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564265c6d8a0 con 0x564265d23fb0 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.631+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564265a5ff50 con 0x564265d1ef60 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.631+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564265d38040 con 0x564265d1e5e0 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5042640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5843640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 0x564265d378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5042640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33916/0 (socket says 10.20.193.28:33916) 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5042640 1 -- 10.20.193.28:0/1620298123 learned_addr learned my addr 10.20.193.28:0/1620298123 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5042640 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d23fb0 0x564265d3ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5843640 1 -- 10.20.193.28:0/1620298123 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 msgr2=0x564265d37390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5843640 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5843640 1 -- 10.20.193.28:0/1620298123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d23fb0 msgr2=0x564265d3ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5843640 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d23fb0 0x564265d3ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5843640 1 -- 10.20.193.28:0/1620298123 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564265d30a30 con 0x564265d1ef60 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5042640 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d23fb0 0x564265d3ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbef5843640 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 0x564265d378d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbee0007cd0 tx=0x7fbee0007900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf3361528fe253b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.632+0000 7fbeab7fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbeab7fe640 1 -- 10.20.193.28:0/1620298123 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee0028070 con 0x564265d1ef60 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/1620298123 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564265a42b40 con 0x564265d1ef60 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 10 client.26402 _ll_register_callbacks cb 0x564265caaeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/1620298123 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564265c7f150 con 0x564265d1ef60 2026-02-20T03:20:21.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbeab7fe640 1 -- 10.20.193.28:0/1620298123 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbee0002e50 con 0x564265d1ef60 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbeab7fe640 1 -- 10.20.193.28:0/1620298123 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee0032050 con 0x564265d1ef60 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbeab7fe640 1 -- 10.20.193.28:0/1620298123 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fbee002d640 con 0x564265d1ef60 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbeab7fe640 1 -- 10.20.193.28:0/1620298123 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbee002d8c0 con 0x564265d1ef60 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 10 client.26402 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/1620298123 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564265c2c1e0 con 0x564265d1ef60 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbeab7fe640 1 -- 10.20.193.28:0/1620298123 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fbee002da60 con 0x564265d1ef60 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 10 client.26402 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 10 client.26402 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 20 client.26402 populate_metadata read hostname 'trial028' 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x564265d47290 0x564265d49680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 4 client.26402 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.633+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/1620298123 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564265c79560 con 0x564265d47290 2026-02-20T03:20:21.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.634+0000 7fbef5042640 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x564265d47290 0x564265d49680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.634+0000 7fbef5042640 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x564265d47290 0x564265d49680 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=155604c72f4fcfb5 server_cookie=7304a3819f044628 in_seq=0 out_seq=0 2026-02-20T03:20:21.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.634+0000 7fbeab7fe640 10 client.26402 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:20:21.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.635+0000 7fbeab7fe640 1 -- 10.20.193.28:0/1620298123 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x564265c79560 con 0x564265d47290 2026-02-20T03:20:21.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.635+0000 7fbeab7fe640 10 client.26402 handle_command_reply: tid=0 2026-02-20T03:20:21.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.635+0000 7fbef9fd3e00 1 client.26402 shutdown 2026-02-20T03:20:21.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.635+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/1620298123 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 msgr2=0x564265d378d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.635+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 0x564265d378d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbee0007cd0 tx=0x7fbee0007900 comp rx=0 tx=0).stop 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/1620298123 shutdown_connections 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x564265d47290 0x564265d49680 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d23fb0 0x564265d3ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 0x564265d378d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/1620298123 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/1620298123 >> 10.20.193.28:0/1620298123 conn(0x564265ce1240 msgr2=0x564265d1d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbeab7fe640 0 client.26402 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/1620298123 shutdown_connections 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/1620298123 wait complete. 2026-02-20T03:20:21.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.636+0000 7fbef9fd3e00 20 client.26402 trim_cache size 0 max 16384 2026-02-20T03:20:21.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef9fd3e00 1 Processor -- start 2026-02-20T03:20:21.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef9fd3e00 1 -- start start 2026-02-20T03:20:21.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d16d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 0x564265d35fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c0127d0 con 0x564265d1ef60 2026-02-20T03:20:21.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c010070 con 0x564265d23fb0 2026-02-20T03:20:21.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c00de60 con 0x564265d1e5e0 2026-02-20T03:20:21.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef5042640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef5042640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33930/0 (socket says 10.20.193.28:33930) 2026-02-20T03:20:21.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef5042640 1 -- 10.20.193.28:0/2034403060 learned_addr learned my addr 10.20.193.28:0/2034403060 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef5843640 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d16d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.643+0000 7fbef5042640 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 0x564265d35fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef5042640 1 -- 10.20.193.28:0/2034403060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 msgr2=0x564265d35fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef5042640 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 0x564265d35fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef5042640 1 -- 10.20.193.28:0/2034403060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 msgr2=0x564265d16d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef5042640 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d16d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef5042640 1 -- 10.20.193.28:0/2034403060 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564265d30860 con 0x564265d1e5e0 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef5843640 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d16d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef5042640 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37bb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbee4005fd0 tx=0x7fbee4007610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74848c77825e95c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbebdce5640 1 -- 10.20.193.28:0/2034403060 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee402f040 con 0x564265d1e5e0 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbebdce5640 1 -- 10.20.193.28:0/2034403060 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbee40048a0 con 0x564265d1e5e0 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbebdce5640 1 -- 10.20.193.28:0/2034403060 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4013920 con 0x564265d1e5e0 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2034403060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 msgr2=0x564265d37bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37bb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbee4005fd0 tx=0x7fbee4007610 comp rx=0 tx=0).stop 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2034403060 shutdown_connections 2026-02-20T03:20:21.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d23fb0 0x564265d35fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1ef60 0x564265d16d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2034403060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d1e5e0 0x564265d37bb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2034403060 >> 10.20.193.28:0/2034403060 conn(0x564265ce1240 msgr2=0x564265d358c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.644+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2034403060 shutdown_connections 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.645+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2034403060 wait complete. 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.645+0000 7fbef9fd3e00 1 -- start start 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.645+0000 7fbef9fd3e00 1 Processor -- start 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.645+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1e5e0 0x564265d43aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.645+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 0x564265d3fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.645+0000 7fbef9fd3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d23fb0 0x564265d40420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.645+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c00e530 con 0x564265d1e5e0 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.645+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c00f9a0 con 0x564265d1ef60 2026-02-20T03:20:21.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.645+0000 7fbef9fd3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9c00ec00 con 0x564265d23fb0 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5042640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1e5e0 0x564265d43aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5042640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1e5e0 0x564265d43aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51126/0 (socket says 10.20.193.28:51126) 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5042640 1 -- 10.20.193.28:0/2870378742 learned_addr learned my addr 10.20.193.28:0/2870378742 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5843640 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 0x564265d3fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5042640 1 -- 10.20.193.28:0/2870378742 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d23fb0 msgr2=0x564265d40420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5042640 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d23fb0 0x564265d40420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5042640 1 -- 10.20.193.28:0/2870378742 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 msgr2=0x564265d3fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5042640 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 0x564265d3fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5042640 1 -- 10.20.193.28:0/2870378742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564265950870 con 0x564265d1e5e0 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef5042640 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1e5e0 0x564265d43aa0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbee4004060 tx=0x7fbee4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5cca8cf87b20b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbeab7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:21.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbeab7fe640 1 -- 10.20.193.28:0/2870378742 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4038020 con 0x564265d1e5e0 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbeab7fe640 1 -- 10.20.193.28:0/2870378742 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbee401da50 con 0x564265d1e5e0 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbeab7fe640 1 -- 10.20.193.28:0/2870378742 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee4003030 con 0x564265d1e5e0 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2870378742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564265c113f0 con 0x564265d1e5e0 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbeab7fe640 1 -- 10.20.193.28:0/2870378742 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fbee40031d0 con 0x564265d1e5e0 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef9fd3e00 10 client.16764 _ll_register_callbacks cb 0x7fbee4007bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.646+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2870378742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbee0015030 con 0x564265d1e5e0 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbeab7fe640 1 -- 10.20.193.28:0/2870378742 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbee40138a0 con 0x564265d1e5e0 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbef9fd3e00 10 client.16764 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2870378742 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x564265d31550 con 0x564265d1e5e0 2026-02-20T03:20:21.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbeab7fe640 1 -- 10.20.193.28:0/2870378742 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fbee401dc00 con 0x564265d1e5e0 2026-02-20T03:20:21.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbef9fd3e00 10 client.16764 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbef9fd3e00 10 client.16764 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbef9fd3e00 20 client.16764 populate_metadata read hostname 'trial028' 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x564265db2ea0 0x564265db5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbef9fd3e00 4 client.16764 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2870378742 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564265c427c0 con 0x564265db2ea0 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.647+0000 7fbef5843640 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x564265db2ea0 0x564265db5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef5843640 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x564265db2ea0 0x564265db5360 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c0423d0b786abce server_cookie=570fd177c2c45497 in_seq=0 out_seq=0 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbeab7fe640 10 client.16764 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbeab7fe640 1 -- 10.20.193.28:0/2870378742 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564265c427c0 con 0x564265db2ea0 2026-02-20T03:20:21.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbeab7fe640 10 client.16764 handle_command_reply: tid=0 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 client.16764 shutdown 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2870378742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1e5e0 msgr2=0x564265d43aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1e5e0 0x564265d43aa0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbee4004060 tx=0x7fbee4004340 comp rx=0 tx=0).stop 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2870378742 shutdown_connections 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x564265db2ea0 0x564265db5360 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564265d23fb0 0x564265d40420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564265d1ef60 0x564265d3fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 --2- 10.20.193.28:0/2870378742 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564265d1e5e0 0x564265d43aa0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbeab7fe640 0 client.16764 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2870378742 >> 10.20.193.28:0/2870378742 conn(0x564265ce1240 msgr2=0x564265d360e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2870378742 shutdown_connections 2026-02-20T03:20:21.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 1 -- 10.20.193.28:0/2870378742 wait complete. 2026-02-20T03:20:21.657 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.648+0000 7fbef9fd3e00 20 client.16764 trim_cache size 0 max 16384 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 -- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbecc0b0e20 msgr2=0x7fbecc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbecc0b0e20 0x7fbecc0b32e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0cd160 tx=0x7fbeec004a20 comp rx=0 tx=0).stop 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 -- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbef010a990 msgr2=0x7fbef01a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbef010a990 0x7fbef01a18d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00c090 tx=0x7fbeec009300 comp rx=0 tx=0).stop 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 -- 10.20.193.28:0/3619201845 shutdown_connections 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbecc0b0e20 0x7fbecc0b32e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbef010a990 0x7fbef01a18d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbef0105330 0x7fbef019d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 --2- 10.20.193.28:0/3619201845 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbef0104990 0x7fbef019d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:21.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 -- 10.20.193.28:0/3619201845 >> 10.20.193.28:0/3619201845 conn(0x7fbef0100690 msgr2=0x7fbef0100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 -- 10.20.193.28:0/3619201845 shutdown_connections 2026-02-20T03:20:21.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:21.649+0000 7fbef6845640 1 -- 10.20.193.28:0/3619201845 wait complete. 2026-02-20T03:20:21.748 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:20:21.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:21 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/417666408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:20:21.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:21 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/417666408' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:20:22.016 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:22.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.201+0000 7f1202cad640 1 -- 10.20.193.28:0/2888053827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11fc10eef0 msgr2=0x7f11fc10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:22.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.201+0000 7f1202cad640 1 --2- 10.20.193.28:0/2888053827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11fc10eef0 0x7f11fc10f2d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009a30 tx=0x7f11ec02f220 comp rx=0 tx=0).stop 2026-02-20T03:20:22.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.201+0000 7f1202cad640 1 -- 10.20.193.28:0/2888053827 shutdown_connections 2026-02-20T03:20:22.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.201+0000 7f1202cad640 1 --2- 10.20.193.28:0/2888053827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11fc109ba0 0x7f11fc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.201+0000 7f1202cad640 1 --2- 10.20.193.28:0/2888053827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11fc109220 0x7f11fc109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.201+0000 7f1202cad640 1 --2- 10.20.193.28:0/2888053827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11fc10eef0 0x7f11fc10f2d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.201+0000 7f1202cad640 1 -- 10.20.193.28:0/2888053827 >> 10.20.193.28:0/2888053827 conn(0x7f11fc078600 msgr2=0x7f11fc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:22.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.201+0000 7f1202cad640 1 -- 10.20.193.28:0/2888053827 shutdown_connections 2026-02-20T03:20:22.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.201+0000 7f1202cad640 1 -- 10.20.193.28:0/2888053827 wait complete. 2026-02-20T03:20:22.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f1202cad640 1 Processor -- start 2026-02-20T03:20:22.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f1202cad640 1 -- start start 2026-02-20T03:20:22.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f1202cad640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11fc109220 0x7f11fc1a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f1202cad640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11fc109ba0 0x7f11fc1a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f1202cad640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11fc10eef0 0x7f11fc1a5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f1202cad640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11fc1190d0 con 0x7f11fc109ba0 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f1202cad640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11fc118f50 con 0x7f11fc10eef0 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f1202cad640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11fc119250 con 0x7f11fc109220 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f12014aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11fc109ba0 0x7f11fc1a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f12014aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11fc109ba0 0x7f11fc1a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51142/0 (socket says 10.20.193.28:51142) 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f12014aa640 1 -- 10.20.193.28:0/858284547 learned_addr learned my addr 10.20.193.28:0/858284547 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.202+0000 7f1201cab640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11fc109220 0x7f11fc1a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f12024ac640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11fc10eef0 0x7f11fc1a5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f12014aa640 1 -- 10.20.193.28:0/858284547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11fc109220 msgr2=0x7f11fc1a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:22.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f12014aa640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11fc109220 0x7f11fc1a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f12014aa640 1 -- 10.20.193.28:0/858284547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11fc10eef0 msgr2=0x7f11fc1a5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:22.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f12014aa640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11fc10eef0 0x7f11fc1a5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f12014aa640 1 -- 10.20.193.28:0/858284547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11fc1a6430 con 0x7f11fc109ba0 2026-02-20T03:20:22.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f12014aa640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11fc109ba0 0x7f11fc1a1920 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f11f000ea10 tx=0x7f11f000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:22.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f11eaffd640 1 -- 10.20.193.28:0/858284547 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f000ce50 con 0x7f11fc109ba0 2026-02-20T03:20:22.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f11eaffd640 1 -- 10.20.193.28:0/858284547 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f11f0004570 con 0x7f11fc109ba0 2026-02-20T03:20:22.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f1202cad640 1 -- 10.20.193.28:0/858284547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11fc1a6720 con 0x7f11fc109ba0 2026-02-20T03:20:22.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f11eaffd640 1 -- 10.20.193.28:0/858284547 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0010690 con 0x7f11fc109ba0 2026-02-20T03:20:22.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.203+0000 7f1202cad640 1 -- 10.20.193.28:0/858284547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11fc1adf60 con 0x7f11fc109ba0 2026-02-20T03:20:22.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.206+0000 7f11eaffd640 1 -- 10.20.193.28:0/858284547 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f11f0020030 con 0x7f11fc109ba0 2026-02-20T03:20:22.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.206+0000 7f120643be00 1 Processor -- start 2026-02-20T03:20:22.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.206+0000 7f120643be00 1 -- start start 2026-02-20T03:20:22.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f120643be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b6bfb0 0x5577c7b6c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f120643be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b665e0 0x5577c7b66a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f120643be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b72de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f120643be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577c7ae6e00 con 0x5577c7b6bfb0 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f120643be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5577c7ab9970 con 0x5577c7b665e0 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f120643be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5577c7a671f0 con 0x5577c7b66f60 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f12014aa640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b72de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f12014aa640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b72de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33952/0 (socket says 10.20.193.28:33952) 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f12014aa640 1 -- 10.20.193.28:0/2350130394 learned_addr learned my addr 10.20.193.28:0/2350130394 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f12014aa640 1 -- 10.20.193.28:0/2350130394 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b665e0 msgr2=0x5577c7b66a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f12014aa640 1 --2- 10.20.193.28:0/2350130394 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b665e0 0x5577c7b66a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f12014aa640 1 -- 10.20.193.28:0/2350130394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b6bfb0 msgr2=0x5577c7b6c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f12014aa640 1 --2- 10.20.193.28:0/2350130394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b6bfb0 0x5577c7b6c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.207+0000 7f12014aa640 1 -- 10.20.193.28:0/2350130394 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c7a7a3d0 con 0x5577c7b66f60 2026-02-20T03:20:22.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f12014aa640 1 --2- 10.20.193.28:0/2350130394 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b72de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f11f00e4ee0 tx=0x7f11f00e9810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c319c33d145dff3f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:22.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f11ca4e6640 1 -- 10.20.193.28:0/2350130394 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00f6070 con 0x5577c7b66f60 2026-02-20T03:20:22.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f11ca4e6640 1 -- 10.20.193.28:0/2350130394 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f11f00e7d30 con 0x5577c7b66f60 2026-02-20T03:20:22.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f120643be00 1 -- 10.20.193.28:0/2350130394 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 msgr2=0x5577c7b72de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:22.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f120643be00 1 --2- 10.20.193.28:0/2350130394 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b72de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f11f00e4ee0 tx=0x7f11f00e9810 comp rx=0 tx=0).stop 2026-02-20T03:20:22.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f120643be00 1 -- 10.20.193.28:0/2350130394 shutdown_connections 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f120643be00 1 --2- 10.20.193.28:0/2350130394 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b72de0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f120643be00 1 --2- 10.20.193.28:0/2350130394 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b665e0 0x5577c7b66a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f120643be00 1 --2- 10.20.193.28:0/2350130394 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b6bfb0 0x5577c7b6c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.208+0000 7f120643be00 1 -- 10.20.193.28:0/2350130394 >> 10.20.193.28:0/2350130394 conn(0x5577c7b29240 msgr2=0x5577c7b64ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.209+0000 7f120643be00 1 -- 10.20.193.28:0/2350130394 shutdown_connections 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.209+0000 7f11eaffd640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11d80b0ef0 0x7f11d80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.209+0000 7f120643be00 1 -- 10.20.193.28:0/2350130394 wait complete. 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.209+0000 7f11eaffd640 1 -- 10.20.193.28:0/858284547 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f11f00e0d40 con 0x7f11fc109ba0 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.209+0000 7f1201cab640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11d80b0ef0 0x7f11d80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f120643be00 1 -- start start 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f1201cab640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11d80b0ef0 0x7f11d80b33b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f11ec02f930 tx=0x7f11ec02f8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:22.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f120643be00 1 Processor -- start 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f120643be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b665e0 0x5577c7b80fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f120643be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b81500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f120643be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 0x5577c7b7f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f120643be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577c7ab58a0 con 0x5577c7b665e0 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f120643be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5577c78a7f50 con 0x5577c7b6bfb0 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f120643be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5577c7b7f9b0 con 0x5577c7b66f60 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f1201cab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b665e0 0x5577c7b80fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f1201cab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b665e0 0x5577c7b80fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51160/0 (socket says 10.20.193.28:51160) 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f1201cab640 1 -- 10.20.193.28:0/801332177 learned_addr learned my addr 10.20.193.28:0/801332177 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f12024ac640 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 0x5577c7b7f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.210+0000 7f12014aa640 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b81500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f1201cab640 1 -- 10.20.193.28:0/801332177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 msgr2=0x5577c7b81500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f1201cab640 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b81500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f1201cab640 1 -- 10.20.193.28:0/801332177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 msgr2=0x5577c7b7f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f1201cab640 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 0x5577c7b7f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f1201cab640 1 -- 10.20.193.28:0/801332177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c7b78a80 con 0x5577c7b665e0 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f1201cab640 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b665e0 0x5577c7b80fc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009a30 tx=0x7f11ec02f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4488dec7d9c761a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f11b77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f11b77fe640 1 -- 10.20.193.28:0/801332177 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec038cc0 con 0x5577c7b665e0 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f11b77fe640 1 -- 10.20.193.28:0/801332177 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f11ec033040 con 0x5577c7b665e0 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f11b77fe640 1 -- 10.20.193.28:0/801332177 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec045710 con 0x5577c7b665e0 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f120643be00 1 -- 10.20.193.28:0/801332177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c788ab40 con 0x5577c7b665e0 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.211+0000 7f11b77fe640 1 -- 10.20.193.28:0/801332177 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f11ec0458d0 con 0x5577c7b665e0 2026-02-20T03:20:22.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 10 client.16773 _ll_register_callbacks cb 0x5577c7af2eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:22.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 1 -- 10.20.193.28:0/801332177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5577c7ac7150 con 0x5577c7b665e0 2026-02-20T03:20:22.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f11b77fe640 1 -- 10.20.193.28:0/801332177 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11ec038e60 con 0x5577c7b665e0 2026-02-20T03:20:22.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 10 client.16773 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:22.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 1 -- 10.20.193.28:0/801332177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5577c7a741e0 con 0x5577c7b665e0 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f11b77fe640 1 -- 10.20.193.28:0/801332177 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f11ec04d070 con 0x5577c7b665e0 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 10 client.16773 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 20 client.16773 populate_metadata read hostname 'trial028' 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c7b8f530 0x5577c7b919c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 4 client.16773 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.212+0000 7f120643be00 1 -- 10.20.193.28:0/801332177 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577c7ac1560 con 0x5577c7b8f530 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.213+0000 7f12014aa640 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c7b8f530 0x5577c7b919c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.213+0000 7f12014aa640 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c7b8f530 0x5577c7b919c0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d3ccccef06276a9 server_cookie=5b57167ef7b0e200 in_seq=0 out_seq=0 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.213+0000 7f11b77fe640 10 client.16773 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:22.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.213+0000 7f11b77fe640 1 -- 10.20.193.28:0/801332177 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5577c7ac1560 con 0x5577c7b8f530 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.213+0000 7f11b77fe640 10 client.16773 handle_command_reply: tid=0 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 client.16773 shutdown 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 -- 10.20.193.28:0/801332177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b665e0 msgr2=0x5577c7b80fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b665e0 0x5577c7b80fc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009a30 tx=0x7f11ec02f220 comp rx=0 tx=0).stop 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 -- 10.20.193.28:0/801332177 shutdown_connections 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c7b8f530 0x5577c7b919c0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 0x5577c7b7f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b66f60 0x5577c7b81500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 --2- 10.20.193.28:0/801332177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b665e0 0x5577c7b80fc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 -- 10.20.193.28:0/801332177 >> 10.20.193.28:0/801332177 conn(0x5577c7b29240 msgr2=0x5577c7b653f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f11b77fe640 0 client.16773 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:22.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 -- 10.20.193.28:0/801332177 shutdown_connections 2026-02-20T03:20:22.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 1 -- 10.20.193.28:0/801332177 wait complete. 2026-02-20T03:20:22.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.214+0000 7f120643be00 20 client.16773 trim_cache size 0 max 16384 2026-02-20T03:20:22.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f120643be00 1 Processor -- start 2026-02-20T03:20:22.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f120643be00 1 -- start start 2026-02-20T03:20:22.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f120643be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b665e0 0x5577c7b7d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f120643be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 0x5577c7b972d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f120643be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b6bfb0 0x5577c7b97810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f120643be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11a80127e0 con 0x5577c7b66f60 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f120643be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11a8010080 con 0x5577c7b665e0 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f120643be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11a800ded0 con 0x5577c7b6bfb0 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f12024ac640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b6bfb0 0x5577c7b97810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f12024ac640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b6bfb0 0x5577c7b97810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33970/0 (socket says 10.20.193.28:33970) 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f12024ac640 1 -- 10.20.193.28:0/973352466 learned_addr learned my addr 10.20.193.28:0/973352466 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f1201cab640 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b665e0 0x5577c7b7d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.221+0000 7f12014aa640 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 0x5577c7b972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.222+0000 7f12024ac640 1 -- 10.20.193.28:0/973352466 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b665e0 msgr2=0x5577c7b7d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.222+0000 7f12024ac640 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b665e0 0x5577c7b7d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.222+0000 7f12024ac640 1 -- 10.20.193.28:0/973352466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 msgr2=0x5577c7b972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.222+0000 7f12024ac640 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 0x5577c7b972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.222+0000 7f12024ac640 1 -- 10.20.193.28:0/973352466 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c7b788b0 con 0x5577c7b6bfb0 2026-02-20T03:20:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.222+0000 7f12014aa640 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 0x5577c7b972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:22.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.222+0000 7f12024ac640 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b6bfb0 0x5577c7b97810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f11f8002e50 tx=0x7f11f8004420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c8cd9beb424c1af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:22.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f11c9ce5640 1 -- 10.20.193.28:0/973352466 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8007700 con 0x5577c7b6bfb0 2026-02-20T03:20:22.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f11c9ce5640 1 -- 10.20.193.28:0/973352466 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f11f80093a0 con 0x5577c7b6bfb0 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f11c9ce5640 1 -- 10.20.193.28:0/973352466 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8015c90 con 0x5577c7b6bfb0 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f120643be00 1 -- 10.20.193.28:0/973352466 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b6bfb0 msgr2=0x5577c7b97810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f120643be00 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b6bfb0 0x5577c7b97810 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f11f8002e50 tx=0x7f11f8004420 comp rx=0 tx=0).stop 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f120643be00 1 -- 10.20.193.28:0/973352466 shutdown_connections 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f120643be00 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b6bfb0 0x5577c7b97810 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f120643be00 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 0x5577c7b972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f120643be00 1 --2- 10.20.193.28:0/973352466 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b665e0 0x5577c7b7d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f120643be00 1 -- 10.20.193.28:0/973352466 >> 10.20.193.28:0/973352466 conn(0x5577c7b29240 msgr2=0x5577c7b7b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f120643be00 1 -- 10.20.193.28:0/973352466 shutdown_connections 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.223+0000 7f120643be00 1 -- 10.20.193.28:0/973352466 wait complete. 2026-02-20T03:20:22.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f120643be00 1 -- start start 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f120643be00 1 Processor -- start 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f120643be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b665e0 0x5577c7b83e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f120643be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 0x5577c7b84370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f120643be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 0x5577c7b848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f1201cab640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b665e0 0x5577c7b83e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f1201cab640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b665e0 0x5577c7b83e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33974/0 (socket says 10.20.193.28:33974) 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f1201cab640 1 -- 10.20.193.28:0/365178487 learned_addr learned my addr 10.20.193.28:0/365178487 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11a800e540 con 0x5577c7b66f60 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11a800f9b0 con 0x5577c7b6bfb0 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.224+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11a800ec10 con 0x5577c7b665e0 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f12014aa640 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 0x5577c7b84370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f12024ac640 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 0x5577c7b848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f1201cab640 1 -- 10.20.193.28:0/365178487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 msgr2=0x5577c7b848b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f1201cab640 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 0x5577c7b848b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f1201cab640 1 -- 10.20.193.28:0/365178487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 msgr2=0x5577c7b84370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f1201cab640 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 0x5577c7b84370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f1201cab640 1 -- 10.20.193.28:0/365178487 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c7798870 con 0x5577c7b665e0 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f1201cab640 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b665e0 0x5577c7b83e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009a00 tx=0x7f11ec002ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e7d0c30ad63aea0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f11b77fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f11b77fe640 1 -- 10.20.193.28:0/365178487 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec045420 con 0x5577c7b665e0 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f11b77fe640 1 -- 10.20.193.28:0/365178487 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f11ec033040 con 0x5577c7b665e0 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f11b77fe640 1 -- 10.20.193.28:0/365178487 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec04fa40 con 0x5577c7b665e0 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.225+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c7a593f0 con 0x5577c7b665e0 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f11b77fe640 1 -- 10.20.193.28:0/365178487 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f11ec04fbe0 con 0x5577c7b665e0 2026-02-20T03:20:22.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 10 client.26425 _ll_register_callbacks cb 0x7f11f0005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5577c7a8a7c0 con 0x5577c7b665e0 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f11b77fe640 1 -- 10.20.193.28:0/365178487 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11ec04fde0 con 0x5577c7b665e0 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 10 client.26425 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x5577c7b795a0 con 0x5577c7b665e0 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f11b77fe640 1 -- 10.20.193.28:0/365178487 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f11ec04d040 con 0x5577c7b665e0 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 10 client.26425 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 10 client.26425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 20 client.26425 populate_metadata read hostname 'trial028' 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c7bfb9e0 0x5577c7bfdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 4 client.26425 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577c7a6bab0 con 0x5577c7bfb9e0 2026-02-20T03:20:22.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.226+0000 7f12014aa640 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c7bfb9e0 0x5577c7bfdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:22.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f12014aa640 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c7bfb9e0 0x5577c7bfdea0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f55e9139d1aa7697 server_cookie=ab2c220f1032421b in_seq=0 out_seq=0 2026-02-20T03:20:22.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f11b77fe640 10 client.26425 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:22.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f11b77fe640 1 -- 10.20.193.28:0/365178487 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577c7a6bab0 con 0x5577c7bfb9e0 2026-02-20T03:20:22.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f11b77fe640 10 client.26425 handle_command_reply: tid=0 2026-02-20T03:20:22.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f120643be00 1 client.26425 shutdown 2026-02-20T03:20:22.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b665e0 msgr2=0x5577c7b83e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:22.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f120643be00 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b665e0 0x5577c7b83e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009a00 tx=0x7f11ec002ea0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 shutdown_connections 2026-02-20T03:20:22.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f120643be00 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c7bfb9e0 0x5577c7bfdea0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f120643be00 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c7b6bfb0 0x5577c7b848b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f120643be00 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c7b66f60 0x5577c7b84370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f120643be00 1 --2- 10.20.193.28:0/365178487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c7b665e0 0x5577c7b83e30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 >> 10.20.193.28:0/365178487 conn(0x5577c7b29240 msgr2=0x5577c7b7c100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:22.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.227+0000 7f11b77fe640 0 client.26425 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:22.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.228+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 shutdown_connections 2026-02-20T03:20:22.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.228+0000 7f120643be00 1 -- 10.20.193.28:0/365178487 wait complete. 2026-02-20T03:20:22.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.228+0000 7f120643be00 20 client.26425 trim_cache size 0 max 16384 2026-02-20T03:20:22.236 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:20:22.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.228+0000 7f1202cad640 1 -- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11d80b0ef0 msgr2=0x7f11d80b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:22.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.228+0000 7f1202cad640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11d80b0ef0 0x7f11d80b33b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f11ec02f930 tx=0x7f11ec02f8c0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.228+0000 7f1202cad640 1 -- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11fc109ba0 msgr2=0x7f11fc1a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.228+0000 7f1202cad640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11fc109ba0 0x7f11fc1a1920 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f11f000ea10 tx=0x7f11f000eee0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.229+0000 7f1202cad640 1 -- 10.20.193.28:0/858284547 shutdown_connections 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.229+0000 7f1202cad640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11d80b0ef0 0x7f11d80b33b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.229+0000 7f1202cad640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11fc10eef0 0x7f11fc1a5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.229+0000 7f1202cad640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11fc109ba0 0x7f11fc1a1920 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.229+0000 7f1202cad640 1 --2- 10.20.193.28:0/858284547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11fc109220 0x7f11fc1a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.229+0000 7f1202cad640 1 -- 10.20.193.28:0/858284547 >> 10.20.193.28:0/858284547 conn(0x7f11fc078600 msgr2=0x7f11fc079d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.229+0000 7f1202cad640 1 -- 10.20.193.28:0/858284547 shutdown_connections 2026-02-20T03:20:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:22.229+0000 7f1202cad640 1 -- 10.20.193.28:0/858284547 wait complete. 2026-02-20T03:20:22.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 422092 5.65 MB/sec execute 115 sec latency 14.009 ms 2026-02-20T03:20:22.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:22 trial028 ceph-mon[38552]: pgmap v352: 129 pgs: 129 active+clean; 75 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.0 MiB/s wr, 368 op/s 2026-02-20T03:20:22.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:22 trial126 ceph-mon[38476]: pgmap v352: 129 pgs: 129 active+clean; 75 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.0 MiB/s wr, 368 op/s 2026-02-20T03:20:22.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:22 trial177 ceph-mon[43181]: pgmap v352: 129 pgs: 129 active+clean; 75 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.0 MiB/s wr, 368 op/s 2026-02-20T03:20:23.333 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:20:23.334 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:20:23.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 425796 5.77 MB/sec execute 116 sec latency 12.233 ms 2026-02-20T03:20:23.605 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:23.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.785+0000 7f3d54df2640 1 -- 10.20.193.28:0/1809708933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d501069e0 msgr2=0x7f3d50107350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:23.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.785+0000 7f3d54df2640 1 --2- 10.20.193.28:0/1809708933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d501069e0 0x7f3d50107350 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400b0a0 tx=0x7f3d4402f410 comp rx=0 tx=0).stop 2026-02-20T03:20:23.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.785+0000 7f3d54df2640 1 -- 10.20.193.28:0/1809708933 shutdown_connections 2026-02-20T03:20:23.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.785+0000 7f3d54df2640 1 --2- 10.20.193.28:0/1809708933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d501069e0 0x7f3d50107350 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.785+0000 7f3d54df2640 1 --2- 10.20.193.28:0/1809708933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d50101700 0x7f3d501062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.785+0000 7f3d54df2640 1 --2- 10.20.193.28:0/1809708933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d50100d50 0x7f3d50101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.785+0000 7f3d54df2640 1 -- 10.20.193.28:0/1809708933 >> 10.20.193.28:0/1809708933 conn(0x7f3d500fca60 msgr2=0x7f3d500fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:23.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.785+0000 7f3d54df2640 1 -- 10.20.193.28:0/1809708933 shutdown_connections 2026-02-20T03:20:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.785+0000 7f3d54df2640 1 -- 10.20.193.28:0/1809708933 wait complete. 2026-02-20T03:20:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.786+0000 7f3d54df2640 1 Processor -- start 2026-02-20T03:20:23.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.786+0000 7f3d54df2640 1 -- start start 2026-02-20T03:20:23.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.786+0000 7f3d54df2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d50100d50 0x7f3d501a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.786+0000 7f3d54df2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50101700 0x7f3d501a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.786+0000 7f3d54df2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501069e0 0x7f3d501a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.786+0000 7f3d54df2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d501190c0 con 0x7f3d50101700 2026-02-20T03:20:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.786+0000 7f3d54df2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3d50118f40 con 0x7f3d501069e0 2026-02-20T03:20:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.786+0000 7f3d54df2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d50119240 con 0x7f3d50100d50 2026-02-20T03:20:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50101700 0x7f3d501a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50101700 0x7f3d501a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51204/0 (socket says 10.20.193.28:51204) 2026-02-20T03:20:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4effd640 1 -- 10.20.193.28:0/3957042670 learned_addr learned my addr 10.20.193.28:0/3957042670 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d50100d50 0x7f3d501a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4ffff640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501069e0 0x7f3d501a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4effd640 1 -- 10.20.193.28:0/3957042670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d50100d50 msgr2=0x7f3d501a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4effd640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d50100d50 0x7f3d501a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4effd640 1 -- 10.20.193.28:0/3957042670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501069e0 msgr2=0x7f3d501a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4effd640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501069e0 0x7f3d501a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4effd640 1 -- 10.20.193.28:0/3957042670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d501a6550 con 0x7f3d50101700 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4effd640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50101700 0x7f3d501a1a40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000d980 tx=0x7f3d4000de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4cff9640 1 -- 10.20.193.28:0/3957042670 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40014070 con 0x7f3d50101700 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4cff9640 1 -- 10.20.193.28:0/3957042670 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d400044e0 con 0x7f3d50101700 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.787+0000 7f3d4cff9640 1 -- 10.20.193.28:0/3957042670 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40005040 con 0x7f3d50101700 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.788+0000 7f3d54df2640 1 -- 10.20.193.28:0/3957042670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d501a6840 con 0x7f3d50101700 2026-02-20T03:20:23.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.788+0000 7f3d54df2640 1 -- 10.20.193.28:0/3957042670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d501ae080 con 0x7f3d50101700 2026-02-20T03:20:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d4cff9640 1 -- 10.20.193.28:0/3957042670 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3d400047c0 con 0x7f3d50101700 2026-02-20T03:20:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d58580e00 1 Processor -- start 2026-02-20T03:20:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d58580e00 1 -- start start 2026-02-20T03:20:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f3388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f338e80 0x56372f33c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f33d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d58580e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56372f279c00 con 0x56372f3384d0 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d58580e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56372f2273c0 con 0x56372f33cf70 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d58580e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56372f275b30 con 0x56372f338e80 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.791+0000 7f3d4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f3388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f3388b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51216/0 (socket says 10.20.193.28:51216) 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4ffff640 1 -- 10.20.193.28:0/2225978360 learned_addr learned my addr 10.20.193.28:0/2225978360 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f338e80 0x56372f33c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4effd640 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f33d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4ffff640 1 -- 10.20.193.28:0/2225978360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f338e80 msgr2=0x56372f33c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:23.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4ffff640 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f338e80 0x56372f33c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4ffff640 1 -- 10.20.193.28:0/2225978360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 msgr2=0x56372f33d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:23.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4ffff640 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f33d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4ffff640 1 -- 10.20.193.28:0/2225978360 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56372f220840 con 0x56372f3384d0 2026-02-20T03:20:23.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f338e80 0x56372f33c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:23.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4cff9640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d240b0ea0 0x7f3d240b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4ffff640 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f3388b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009710 tx=0x7f3d44009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6cae4a7e9cdda5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:23.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4cff9640 1 -- 10.20.193.28:0/3957042670 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3d400e0650 con 0x7f3d50101700 2026-02-20T03:20:23.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.792+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d240b0ea0 0x7f3d240b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.793+0000 7f3d13fff640 1 -- 10.20.193.28:0/2225978360 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d440042c0 con 0x56372f3384d0 2026-02-20T03:20:23.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.793+0000 7f3d13fff640 1 -- 10.20.193.28:0/2225978360 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d44033070 con 0x56372f3384d0 2026-02-20T03:20:23.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.793+0000 7f3d13fff640 1 -- 10.20.193.28:0/2225978360 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4405b850 con 0x56372f3384d0 2026-02-20T03:20:23.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.793+0000 7f3d58580e00 1 -- 10.20.193.28:0/2225978360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 msgr2=0x56372f3388b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:23.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.793+0000 7f3d58580e00 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f3388b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009710 tx=0x7f3d44009740 comp rx=0 tx=0).stop 2026-02-20T03:20:23.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.793+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d240b0ea0 0x7f3d240b3360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x56372f3394a0 tx=0x7f3d3c005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.794+0000 7f3d58580e00 1 -- 10.20.193.28:0/2225978360 shutdown_connections 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.794+0000 7f3d58580e00 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f33d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.794+0000 7f3d58580e00 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f338e80 0x56372f33c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.794+0000 7f3d58580e00 1 --2- 10.20.193.28:0/2225978360 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f3388b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.794+0000 7f3d58580e00 1 -- 10.20.193.28:0/2225978360 >> 10.20.193.28:0/2225978360 conn(0x56372f31fb60 msgr2=0x56372f3255e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.794+0000 7f3d58580e00 1 -- 10.20.193.28:0/2225978360 shutdown_connections 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.794+0000 7f3d58580e00 1 -- 10.20.193.28:0/2225978360 wait complete. 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.795+0000 7f3d58580e00 1 -- start start 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.795+0000 7f3d58580e00 1 Processor -- start 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 0x56372f337b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f332eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f3333f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d58580e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56372f2211a0 con 0x56372f338e80 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d58580e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56372f326fe0 con 0x56372f33cf70 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d58580e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56372f333a60 con 0x56372f3384d0 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 0x56372f337b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 0x56372f337b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34030/0 (socket says 10.20.193.28:34030) 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4f7fe640 1 -- 10.20.193.28:0/1230275838 learned_addr learned my addr 10.20.193.28:0/1230275838 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4effd640 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f332eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4effd640 1 -- 10.20.193.28:0/1230275838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 msgr2=0x56372f337b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4effd640 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 0x56372f337b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4effd640 1 -- 10.20.193.28:0/1230275838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 msgr2=0x56372f3333f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4effd640 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f3333f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4effd640 1 -- 10.20.193.28:0/1230275838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56372f32c8b0 con 0x56372f338e80 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d4effd640 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f332eb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000d950 tx=0x7f3d400a4070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d6809e27d3aa04 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.796+0000 7f3d117fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d117fa640 1 -- 10.20.193.28:0/1230275838 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400a7850 con 0x56372f338e80 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d117fa640 1 -- 10.20.193.28:0/1230275838 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d400df030 con 0x56372f338e80 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d117fa640 1 -- 10.20.193.28:0/1230275838 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400e0280 con 0x56372f338e80 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d58580e00 1 -- 10.20.193.28:0/1230275838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56372f048b60 con 0x56372f338e80 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d58580e00 10 client.16791 _ll_register_callbacks cb 0x56372f2250d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d58580e00 1 -- 10.20.193.28:0/1230275838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56372f2817f0 con 0x56372f338e80 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d117fa640 1 -- 10.20.193.28:0/1230275838 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3d400b1100 con 0x56372f338e80 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d117fa640 1 -- 10.20.193.28:0/1230275838 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3d400e0420 con 0x56372f338e80 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d58580e00 10 client.16791 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:23.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d58580e00 1 -- 10.20.193.28:0/1230275838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56372f246430 con 0x56372f338e80 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d117fa640 1 -- 10.20.193.28:0/1230275838 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f3d40092ac0 con 0x56372f338e80 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d58580e00 10 client.16791 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.797+0000 7f3d58580e00 10 client.16791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.798+0000 7f3d58580e00 20 client.16791 populate_metadata read hostname 'trial028' 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.798+0000 7f3d58580e00 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56372f34fbe0 0x56372f352030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.798+0000 7f3d58580e00 4 client.16791 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.798+0000 7f3d58580e00 1 -- 10.20.193.28:0/1230275838 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56372f1fbc00 con 0x56372f34fbe0 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.798+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56372f34fbe0 0x56372f352030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.798+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56372f34fbe0 0x56372f352030 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd867f9fdc3337f8 server_cookie=fc395fe0c4a9aee5 in_seq=0 out_seq=0 2026-02-20T03:20:23.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.798+0000 7f3d117fa640 10 client.16791 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.799+0000 7f3d117fa640 1 -- 10.20.193.28:0/1230275838 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56372f1fbc00 con 0x56372f34fbe0 2026-02-20T03:20:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.799+0000 7f3d117fa640 10 client.16791 handle_command_reply: tid=0 2026-02-20T03:20:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.799+0000 7f3d58580e00 1 client.16791 shutdown 2026-02-20T03:20:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.799+0000 7f3d58580e00 1 -- 10.20.193.28:0/1230275838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 msgr2=0x56372f332eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:23.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.799+0000 7f3d58580e00 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f332eb0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000d950 tx=0x7f3d400a4070 comp rx=0 tx=0).stop 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d58580e00 1 -- 10.20.193.28:0/1230275838 shutdown_connections 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d58580e00 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56372f34fbe0 0x56372f352030 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d58580e00 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f3333f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d58580e00 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f332eb0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d58580e00 1 --2- 10.20.193.28:0/1230275838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 0x56372f337b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d58580e00 1 -- 10.20.193.28:0/1230275838 >> 10.20.193.28:0/1230275838 conn(0x56372f31fb60 msgr2=0x56372f33b930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d117fa640 0 client.16791 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d58580e00 1 -- 10.20.193.28:0/1230275838 shutdown_connections 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d58580e00 1 -- 10.20.193.28:0/1230275838 wait complete. 2026-02-20T03:20:23.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.800+0000 7f3d58580e00 20 client.16791 trim_cache size 0 max 16384 2026-02-20T03:20:23.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.811+0000 7f3d58580e00 1 Processor -- start 2026-02-20T03:20:23.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.811+0000 7f3d58580e00 1 -- start start 2026-02-20T03:20:23.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.811+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 0x56372f33c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.811+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f334b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.811+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f357940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.811+0000 7f3d58580e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf4012670 con 0x56372f338e80 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.811+0000 7f3d58580e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf400ff10 con 0x56372f33cf70 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.811+0000 7f3d58580e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf400dd60 con 0x56372f3384d0 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f334b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f334b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51230/0 (socket says 10.20.193.28:51230) 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4effd640 1 -- 10.20.193.28:0/2588038164 learned_addr learned my addr 10.20.193.28:0/2588038164 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4ffff640 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f357940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 0x56372f33c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4effd640 1 -- 10.20.193.28:0/2588038164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 msgr2=0x56372f33c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:23.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4effd640 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 0x56372f33c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4effd640 1 -- 10.20.193.28:0/2588038164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 msgr2=0x56372f357940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4effd640 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f357940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4effd640 1 -- 10.20.193.28:0/2588038164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56372f32c6e0 con 0x56372f338e80 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4ffff640 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f357940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d4effd640 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f334b50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3d400a5350 tx=0x7f3d40094000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1bcab28cc4aee1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d137fe640 1 -- 10.20.193.28:0/2588038164 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400ac6e0 con 0x56372f338e80 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d137fe640 1 -- 10.20.193.28:0/2588038164 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d400df040 con 0x56372f338e80 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d137fe640 1 -- 10.20.193.28:0/2588038164 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400b1100 con 0x56372f338e80 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d58580e00 1 -- 10.20.193.28:0/2588038164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 msgr2=0x56372f334b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.812+0000 7f3d58580e00 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f334b50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3d400a5350 tx=0x7f3d40094000 comp rx=0 tx=0).stop 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.813+0000 7f3d58580e00 1 -- 10.20.193.28:0/2588038164 shutdown_connections 2026-02-20T03:20:23.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.813+0000 7f3d58580e00 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f33cf70 0x56372f357940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.813+0000 7f3d58580e00 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f338e80 0x56372f334b50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.813+0000 7f3d58580e00 1 --2- 10.20.193.28:0/2588038164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f3384d0 0x56372f33c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.813+0000 7f3d58580e00 1 -- 10.20.193.28:0/2588038164 >> 10.20.193.28:0/2588038164 conn(0x56372f31fb60 msgr2=0x56372f334440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:23.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.813+0000 7f3d58580e00 1 -- 10.20.193.28:0/2588038164 shutdown_connections 2026-02-20T03:20:23.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.813+0000 7f3d58580e00 1 -- 10.20.193.28:0/2588038164 wait complete. 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.813+0000 7f3d58580e00 1 -- start start 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.813+0000 7f3d58580e00 1 Processor -- start 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f346120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f338e80 0x56372f346660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d58580e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f33cf70 0x56372f346ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d58580e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf400e3d0 con 0x56372f3384d0 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d58580e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf400f840 con 0x56372f338e80 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d58580e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf400eaa0 con 0x56372f33cf70 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f346120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4effd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f338e80 0x56372f346660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f346120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51236/0 (socket says 10.20.193.28:51236) 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4f7fe640 1 -- 10.20.193.28:0/490979853 learned_addr learned my addr 10.20.193.28:0/490979853 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4ffff640 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f33cf70 0x56372f346ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4effd640 1 -- 10.20.193.28:0/490979853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f33cf70 msgr2=0x56372f346ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4effd640 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f33cf70 0x56372f346ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4effd640 1 -- 10.20.193.28:0/490979853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 msgr2=0x56372f346120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4effd640 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f346120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4effd640 1 -- 10.20.193.28:0/490979853 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56372ef58900 con 0x56372f338e80 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f346120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.814+0000 7f3d4ffff640 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f33cf70 0x56372f346ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d4effd640 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f338e80 0x56372f346660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x56372f2280f0 tx=0x7f3d40005cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccbc2eca7a5a8888 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:23.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d117fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d117fa640 1 -- 10.20.193.28:0/490979853 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4005a070 con 0x56372f338e80 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d58580e00 1 -- 10.20.193.28:0/490979853 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56372f2344d0 con 0x56372f338e80 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d117fa640 1 -- 10.20.193.28:0/490979853 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56372f2817f0 con 0x56372f338e80 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d58580e00 10 client.26438 _ll_register_callbacks cb 0x7f3d400e3b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d117fa640 1 -- 10.20.193.28:0/490979853 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d400a3cb0 con 0x56372f338e80 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d58580e00 1 -- 10.20.193.28:0/490979853 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56372f2875a0 con 0x56372f338e80 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d117fa640 1 -- 10.20.193.28:0/490979853 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3d400a6db0 con 0x56372f338e80 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d117fa640 1 -- 10.20.193.28:0/490979853 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3d400a70d0 con 0x56372f338e80 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d58580e00 10 client.26438 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d58580e00 1 -- 10.20.193.28:0/490979853 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=28}) -- 0x56372f32d3d0 con 0x56372f338e80 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d117fa640 1 -- 10.20.193.28:0/490979853 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f3d400a7340 con 0x56372f338e80 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d58580e00 10 client.26438 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:23.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d58580e00 10 client.26438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.815+0000 7f3d58580e00 20 client.26438 populate_metadata read hostname 'trial028' 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.816+0000 7f3d58580e00 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56372f3bb970 0x56372f3bde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.816+0000 7f3d58580e00 4 client.26438 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.816+0000 7f3d58580e00 1 -- 10.20.193.28:0/490979853 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f3d44033070 con 0x56372f3bb970 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.816+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56372f3bb970 0x56372f3bde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.816+0000 7f3d4f7fe640 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56372f3bb970 0x56372f3bde00 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=942583c105463c4b server_cookie=956b9eebc3711908 in_seq=0 out_seq=0 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.816+0000 7f3d117fa640 10 client.26438 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d117fa640 1 -- 10.20.193.28:0/490979853 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f3d44033070 con 0x56372f3bb970 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d117fa640 10 client.26438 handle_command_reply: tid=0 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 client.26438 shutdown 2026-02-20T03:20:23.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 -- 10.20.193.28:0/490979853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f338e80 msgr2=0x56372f346660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f338e80 0x56372f346660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x56372f2280f0 tx=0x7f3d40005cf0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 -- 10.20.193.28:0/490979853 shutdown_connections 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56372f3bb970 0x56372f3bde00 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56372f33cf70 0x56372f346ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56372f338e80 0x56372f346660 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 --2- 10.20.193.28:0/490979853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56372f3384d0 0x56372f346120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 -- 10.20.193.28:0/490979853 >> 10.20.193.28:0/490979853 conn(0x56372f31fb60 msgr2=0x56372f331de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d117fa640 0 client.26438 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 -- 10.20.193.28:0/490979853 shutdown_connections 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 1 -- 10.20.193.28:0/490979853 wait complete. 2026-02-20T03:20:23.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.817+0000 7f3d58580e00 20 client.26438 trim_cache size 0 max 16384 2026-02-20T03:20:23.827 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:20:23.827 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:20:23.827 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "44f9160e-f658-416e-91f3-febf09ef52b9", 2026-02-20T03:20:23.827 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:20:23.827 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:20:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 -- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d240b0ea0 msgr2=0x7f3d240b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d240b0ea0 0x7f3d240b3360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x56372f3394a0 tx=0x7f3d3c005f50 comp rx=0 tx=0).stop 2026-02-20T03:20:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 -- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50101700 msgr2=0x7f3d501a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50101700 0x7f3d501a1a40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000d980 tx=0x7f3d4000de50 comp rx=0 tx=0).stop 2026-02-20T03:20:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 -- 10.20.193.28:0/3957042670 shutdown_connections 2026-02-20T03:20:23.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d240b0ea0 0x7f3d240b3360 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d501069e0 0x7f3d501a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d50101700 0x7f3d501a1a40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 --2- 10.20.193.28:0/3957042670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d50100d50 0x7f3d501a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:23.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 -- 10.20.193.28:0/3957042670 >> 10.20.193.28:0/3957042670 conn(0x7f3d500fca60 msgr2=0x7f3d50104280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:23.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 -- 10.20.193.28:0/3957042670 shutdown_connections 2026-02-20T03:20:23.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:23.818+0000 7f3d54df2640 1 -- 10.20.193.28:0/3957042670 wait complete. 2026-02-20T03:20:23.921 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:20:24.195 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:24.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.380+0000 7f3f0bfff640 1 -- 10.20.193.28:0/1791757129 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10038470 con 0x7f3f1c104980 2026-02-20T03:20:24.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.380+0000 7f3f22768640 1 -- 10.20.193.28:0/1791757129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1c104980 msgr2=0x7f3f1c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:24.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.380+0000 7f3f22768640 1 --2- 10.20.193.28:0/1791757129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1c104980 0x7f3f1c104de0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009a60 tx=0x7f3f1002f250 comp rx=0 tx=0).stop 2026-02-20T03:20:24.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.381+0000 7f3f22768640 1 -- 10.20.193.28:0/1791757129 shutdown_connections 2026-02-20T03:20:24.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.381+0000 7f3f22768640 1 --2- 10.20.193.28:0/1791757129 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3f1c105320 0x7f3f1c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.381+0000 7f3f22768640 1 --2- 10.20.193.28:0/1791757129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1c104980 0x7f3f1c104de0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.381+0000 7f3f22768640 1 --2- 10.20.193.28:0/1791757129 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f1c10a980 0x7f3f1c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.381+0000 7f3f22768640 1 -- 10.20.193.28:0/1791757129 >> 10.20.193.28:0/1791757129 conn(0x7f3f1c100680 msgr2=0x7f3f1c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:24.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.381+0000 7f3f22768640 1 -- 10.20.193.28:0/1791757129 shutdown_connections 2026-02-20T03:20:24.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.381+0000 7f3f22768640 1 -- 10.20.193.28:0/1791757129 wait complete. 2026-02-20T03:20:24.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f22768640 1 Processor -- start 2026-02-20T03:20:24.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f22768640 1 -- start start 2026-02-20T03:20:24.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f22768640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f1c104980 0x7f3f1c19d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f22768640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3f1c105320 0x7f3f1c19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f22768640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1c10a980 0x7f3f1c1a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f22768640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c114bf0 con 0x7f3f1c10a980 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f22768640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c114a70 con 0x7f3f1c105320 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f22768640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c114d70 con 0x7f3f1c104980 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f20f65640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3f1c105320 0x7f3f1c19d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f20f65640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3f1c105320 0x7f3f1c19d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36004/0 (socket says 10.20.193.28:36004) 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.382+0000 7f3f20f65640 1 -- 10.20.193.28:0/4016761011 learned_addr learned my addr 10.20.193.28:0/4016761011 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f21766640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f1c104980 0x7f3f1c19d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f21f67640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1c10a980 0x7f3f1c1a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f20f65640 1 -- 10.20.193.28:0/4016761011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f1c104980 msgr2=0x7f3f1c19d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f20f65640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f1c104980 0x7f3f1c19d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f20f65640 1 -- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1c10a980 msgr2=0x7f3f1c1a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:24.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f20f65640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1c10a980 0x7f3f1c1a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f20f65640 1 -- 10.20.193.28:0/4016761011 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c1a20d0 con 0x7f3f1c105320 2026-02-20T03:20:24.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f21f67640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1c10a980 0x7f3f1c1a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:24.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f20f65640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3f1c105320 0x7f3f1c19d5c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3f10002410 tx=0x7f3f10002a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:24.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f0a7fc640 1 -- 10.20.193.28:0/4016761011 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1002fd00 con 0x7f3f1c105320 2026-02-20T03:20:24.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f22768640 1 -- 10.20.193.28:0/4016761011 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1c1a2360 con 0x7f3f1c105320 2026-02-20T03:20:24.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f0a7fc640 1 -- 10.20.193.28:0/4016761011 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3f10004570 con 0x7f3f1c105320 2026-02-20T03:20:24.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f0a7fc640 1 -- 10.20.193.28:0/4016761011 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10041620 con 0x7f3f1c105320 2026-02-20T03:20:24.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.383+0000 7f3f22768640 1 -- 10.20.193.28:0/4016761011 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1c1a9c00 con 0x7f3f1c105320 2026-02-20T03:20:24.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f25ef6e00 1 Processor -- start 2026-02-20T03:20:24.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f0a7fc640 1 -- 10.20.193.28:0/4016761011 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3f10038890 con 0x7f3f1c105320 2026-02-20T03:20:24.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f25ef6e00 1 -- start start 2026-02-20T03:20:24.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9dddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d8040 0x55764b9d8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9e4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55764b94fe50 con 0x55764b9d89c0 2026-02-20T03:20:24.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55764b9229c0 con 0x55764b9d8040 2026-02-20T03:20:24.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55764b8d0240 con 0x55764b9dda10 2026-02-20T03:20:24.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f20f65640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9e4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f21766640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d8040 0x55764b9d8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f21766640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d8040 0x55764b9d8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36010/0 (socket says 10.20.193.28:36010) 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f21766640 1 -- 10.20.193.28:0/3489600619 learned_addr learned my addr 10.20.193.28:0/3489600619 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.387+0000 7f3f20f65640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9e4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51262/0 (socket says 10.20.193.28:51262) 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f21f67640 1 --2- 10.20.193.28:0/3489600619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9dddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f21f67640 1 -- 10.20.193.28:0/3489600619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d8040 msgr2=0x55764b9d8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f21f67640 1 --2- 10.20.193.28:0/3489600619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d8040 0x55764b9d8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f21f67640 1 -- 10.20.193.28:0/3489600619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 msgr2=0x55764b9e4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f21f67640 1 --2- 10.20.193.28:0/3489600619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9e4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f21f67640 1 -- 10.20.193.28:0/3489600619 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55764b8e3420 con 0x55764b9dda10 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f21f67640 1 --2- 10.20.193.28:0/3489600619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9dddf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f18002d80 tx=0x7f3f18009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd69d2dba780fb33 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:24.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3ee9ce5640 1 -- 10.20.193.28:0/3489600619 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18007500 con 0x55764b9dda10 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3ee9ce5640 1 -- 10.20.193.28:0/3489600619 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3f18007b40 con 0x55764b9dda10 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3ee9ce5640 1 -- 10.20.193.28:0/3489600619 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18015d00 con 0x55764b9dda10 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f0a7fc640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3ef80b0e20 0x7f3ef80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f0a7fc640 1 -- 10.20.193.28:0/4016761011 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3f10105580 con 0x7f3f1c105320 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/3489600619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 msgr2=0x55764b9dddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.388+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/3489600619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9dddf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f18002d80 tx=0x7f3f18009920 comp rx=0 tx=0).stop 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.389+0000 7f3f21766640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3ef80b0e20 0x7f3ef80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.389+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/3489600619 shutdown_connections 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.389+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/3489600619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9e4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.389+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/3489600619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d8040 0x55764b9d8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.389+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/3489600619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9dddf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.389+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/3489600619 >> 10.20.193.28:0/3489600619 conn(0x55764b992290 msgr2=0x55764b9cdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.389+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/3489600619 shutdown_connections 2026-02-20T03:20:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.389+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/3489600619 wait complete. 2026-02-20T03:20:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.389+0000 7f3f21766640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3ef80b0e20 0x7f3ef80b32e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009210 tx=0x7f3f0c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:24.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.390+0000 7f3f25ef6e00 1 -- start start 2026-02-20T03:20:24.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.390+0000 7f3f25ef6e00 1 Processor -- start 2026-02-20T03:20:24.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9fb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9fb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 0x55764b9f98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55764b91e8f0 con 0x55764b9d89c0 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55764b710f50 con 0x55764b9dda10 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55764b9fa020 con 0x55764b9d8040 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f21766640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9fb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f20f65640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9fb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f20f65640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9fb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51278/0 (socket says 10.20.193.28:51278) 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f20f65640 1 -- 10.20.193.28:0/14258886 learned_addr learned my addr 10.20.193.28:0/14258886 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f21766640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9fb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34082/0 (socket says 10.20.193.28:34082) 2026-02-20T03:20:24.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f20f65640 1 -- 10.20.193.28:0/14258886 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 msgr2=0x55764b9fb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f20f65640 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9fb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f20f65640 1 -- 10.20.193.28:0/14258886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 msgr2=0x55764b9f98a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f20f65640 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 0x55764b9f98a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f20f65640 1 -- 10.20.193.28:0/14258886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55764b9d4d00 con 0x55764b9d89c0 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f20f65640 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9fb6a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3f100ca310 tx=0x7f3f10108af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844fbc410c64010d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3ed6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/14258886 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f100c8f60 con 0x55764b9d89c0 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/14258886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55764b6f3b40 con 0x55764b9d89c0 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f25ef6e00 10 client.16809 _ll_register_callbacks cb 0x55764b95bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.391+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/14258886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55764b9301a0 con 0x55764b9d89c0 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/14258886 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55764b9301a0 con 0x55764b9d89c0 2026-02-20T03:20:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/14258886 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f100cc810 con 0x55764b9d89c0 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/14258886 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3f100c8a10 con 0x55764b9d89c0 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/14258886 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f100cc9f0 con 0x55764b9d89c0 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3f25ef6e00 10 client.16809 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/14258886 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55764b8dd230 con 0x55764b9d89c0 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/14258886 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f3f100cc300 con 0x55764b9d89c0 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3f25ef6e00 10 client.16809 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3f25ef6e00 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.392+0000 7f3f25ef6e00 20 client.16809 populate_metadata read hostname 'trial028' 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.393+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55764ba099f0 0x55764ba0beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.393+0000 7f3f25ef6e00 4 client.16809 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.393+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/14258886 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55764b92a5b0 con 0x55764ba099f0 2026-02-20T03:20:24.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.393+0000 7f3f21766640 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55764ba099f0 0x55764ba0beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.393+0000 7f3f21766640 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55764ba099f0 0x55764ba0beb0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4321f353c793296 server_cookie=c3abfb749166a660 in_seq=0 out_seq=0 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.393+0000 7f3ed6ffd640 10 client.16809 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/14258886 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55764b92a5b0 con 0x55764ba099f0 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3ed6ffd640 10 client.16809 handle_command_reply: tid=0 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 client.16809 shutdown 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/14258886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 msgr2=0x55764b9fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9fb6a0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3f100ca310 tx=0x7f3f10108af0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/14258886 shutdown_connections 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55764ba099f0 0x55764ba0beb0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 0x55764b9f98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9fb6a0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/14258886 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/14258886 >> 10.20.193.28:0/14258886 conn(0x55764b992290 msgr2=0x55764b9ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:24.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3ed6ffd640 0 client.16809 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:24.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/14258886 shutdown_connections 2026-02-20T03:20:24.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/14258886 wait complete. 2026-02-20T03:20:24.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.394+0000 7f3f25ef6e00 20 client.16809 trim_cache size 0 max 16384 2026-02-20T03:20:24.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f25ef6e00 1 Processor -- start 2026-02-20T03:20:24.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f25ef6e00 1 -- start start 2026-02-20T03:20:24.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 0x55764b9cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec8012740 con 0x55764b9d89c0 2026-02-20T03:20:24.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec800ffe0 con 0x55764b9dda10 2026-02-20T03:20:24.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec800de30 con 0x55764b9d8040 2026-02-20T03:20:24.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f20f65640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f21f67640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 0x55764b9cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f21f67640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 0x55764b9cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36032/0 (socket says 10.20.193.28:36032) 2026-02-20T03:20:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f21f67640 1 -- 10.20.193.28:0/2994809676 learned_addr learned my addr 10.20.193.28:0/2994809676 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.403+0000 7f3f21766640 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f21f67640 1 -- 10.20.193.28:0/2994809676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 msgr2=0x55764b9f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f21f67640 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9f71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f21f67640 1 -- 10.20.193.28:0/2994809676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 msgr2=0x55764b9ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f21f67640 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f21f67640 1 -- 10.20.193.28:0/2994809676 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55764b9d4b30 con 0x55764b9dda10 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f20f65640 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f21766640 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f21f67640 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 0x55764b9cea60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f18005c80 tx=0x7f3f18002b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6015b4b0e1f30af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3ee94e4640 1 -- 10.20.193.28:0/2994809676 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18022070 con 0x55764b9dda10 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3ee94e4640 1 -- 10.20.193.28:0/2994809676 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3f18007700 con 0x55764b9dda10 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3ee94e4640 1 -- 10.20.193.28:0/2994809676 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1801e690 con 0x55764b9dda10 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/2994809676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 msgr2=0x55764b9cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.404+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 0x55764b9cea60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f18005c80 tx=0x7f3f18002b60 comp rx=0 tx=0).stop 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.405+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/2994809676 shutdown_connections 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.405+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9dda10 0x55764b9cea60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.405+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d89c0 0x55764b9ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.405+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/2994809676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9d8040 0x55764b9f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.405+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/2994809676 >> 10.20.193.28:0/2994809676 conn(0x55764b992290 msgr2=0x55764b9fb160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.405+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/2994809676 shutdown_connections 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.405+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/2994809676 wait complete. 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.405+0000 7f3f25ef6e00 1 -- start start 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.405+0000 7f3f25ef6e00 1 Processor -- start 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d8040 0x55764ba014e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d89c0 0x55764ba01a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f25ef6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9fe1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec800e4a0 con 0x55764b9d8040 2026-02-20T03:20:24.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec800f910 con 0x55764b9d89c0 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f25ef6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec800eb70 con 0x55764b9dda10 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f21766640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d8040 0x55764ba014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f21766640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d8040 0x55764ba014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51288/0 (socket says 10.20.193.28:51288) 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f21766640 1 -- 10.20.193.28:0/1841565623 learned_addr learned my addr 10.20.193.28:0/1841565623 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f21f67640 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9fe1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.406+0000 7f3f20f65640 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d89c0 0x55764ba01a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f21766640 1 -- 10.20.193.28:0/1841565623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 msgr2=0x55764b9fe1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f21766640 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9fe1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f21766640 1 -- 10.20.193.28:0/1841565623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d89c0 msgr2=0x55764ba01a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f21766640 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d89c0 0x55764ba01a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f21766640 1 -- 10.20.193.28:0/1841565623 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55764b601870 con 0x55764b9d8040 2026-02-20T03:20:24.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f21f67640 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:24.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f20f65640 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d89c0 0x55764ba01a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:24.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f21766640 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d8040 0x55764ba014e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0041d0 tx=0x7f3f0c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b461b13da1f27a7e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:24.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3ed6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:24.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/1841565623 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c011670 con 0x55764b9d8040 2026-02-20T03:20:24.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/1841565623 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55764b8c2440 con 0x55764b9d8040 2026-02-20T03:20:24.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.407+0000 7f3f25ef6e00 10 client.16815 _ll_register_callbacks cb 0x7f3f10108cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:24.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/1841565623 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55764b8d4b00 con 0x55764b9d8040 2026-02-20T03:20:24.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/1841565623 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3f0c02e030 con 0x55764b9d8040 2026-02-20T03:20:24.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/1841565623 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c020c60 con 0x55764b9d8040 2026-02-20T03:20:24.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/1841565623 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3f0c020e00 con 0x55764b9d8040 2026-02-20T03:20:24.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/1841565623 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3f0c020400 con 0x55764b9d8040 2026-02-20T03:20:24.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f25ef6e00 10 client.16815 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:24.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/1841565623 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55764b9d5820 con 0x55764b9d8040 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/1841565623 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f3f0c011810 con 0x55764b9d8040 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f25ef6e00 10 client.16815 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f25ef6e00 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f25ef6e00 20 client.16815 populate_metadata read hostname 'trial028' 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55764ba75900 0x55764ba77dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f25ef6e00 4 client.16815 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/1841565623 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3f18007b40 con 0x55764ba75900 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.408+0000 7f3f20f65640 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55764ba75900 0x55764ba77dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f20f65640 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55764ba75900 0x55764ba77dc0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96554c219a9f8bee server_cookie=517210b369860887 in_seq=0 out_seq=0 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3ed6ffd640 10 client.16815 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3ed6ffd640 1 -- 10.20.193.28:0/1841565623 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f3f18007b40 con 0x55764ba75900 2026-02-20T03:20:24.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3ed6ffd640 10 client.16815 handle_command_reply: tid=0 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f25ef6e00 1 client.16815 shutdown 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/1841565623 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d8040 msgr2=0x55764ba014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d8040 0x55764ba014e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0041d0 tx=0x7f3f0c0047c0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/1841565623 shutdown_connections 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55764ba75900 0x55764ba77dc0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55764b9dda10 0x55764b9fe1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55764b9d89c0 0x55764ba01a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f25ef6e00 1 --2- 10.20.193.28:0/1841565623 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55764b9d8040 0x55764ba014e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.409+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/1841565623 >> 10.20.193.28:0/1841565623 conn(0x55764b992290 msgr2=0x55764b9f7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.410+0000 7f3ed6ffd640 0 client.16815 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.410+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/1841565623 shutdown_connections 2026-02-20T03:20:24.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.410+0000 7f3f25ef6e00 1 -- 10.20.193.28:0/1841565623 wait complete. 2026-02-20T03:20:24.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.410+0000 7f3f25ef6e00 20 client.16815 trim_cache size 0 max 16384 2026-02-20T03:20:24.419 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:20:24.419 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:20:24.419 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:20:24.419 INFO:teuthology.orchestra.run.trial028.stdout: "44f9160e-f658-416e-91f3-febf09ef52b9": { 2026-02-20T03:20:24.419 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:20:24.419 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "44f9160e-f658-416e-91f3-febf09ef52b9", 2026-02-20T03:20:24.420 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:20:24.420 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:20:24.420 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:20:24.420 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:20:24.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.410+0000 7f3f22768640 1 -- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3ef80b0e20 msgr2=0x7f3ef80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:24.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.410+0000 7f3f22768640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3ef80b0e20 0x7f3ef80b32e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009210 tx=0x7f3f0c009290 comp rx=0 tx=0).stop 2026-02-20T03:20:24.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.410+0000 7f3f22768640 1 -- 10.20.193.28:0/4016761011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3f1c105320 msgr2=0x7f3f1c19d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:24.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.410+0000 7f3f22768640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3f1c105320 0x7f3f1c19d5c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3f10002410 tx=0x7f3f10002a50 comp rx=0 tx=0).stop 2026-02-20T03:20:24.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.411+0000 7f3f22768640 1 -- 10.20.193.28:0/4016761011 shutdown_connections 2026-02-20T03:20:24.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.411+0000 7f3f22768640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3ef80b0e20 0x7f3ef80b32e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.411+0000 7f3f22768640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3f1c10a980 0x7f3f1c1a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.411+0000 7f3f22768640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3f1c105320 0x7f3f1c19d5c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.411+0000 7f3f22768640 1 --2- 10.20.193.28:0/4016761011 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3f1c104980 0x7f3f1c19d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:24.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.411+0000 7f3f22768640 1 -- 10.20.193.28:0/4016761011 >> 10.20.193.28:0/4016761011 conn(0x7f3f1c100680 msgr2=0x7f3f1c101010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:24.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.411+0000 7f3f22768640 1 -- 10.20.193.28:0/4016761011 shutdown_connections 2026-02-20T03:20:24.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:24.411+0000 7f3f22768640 1 -- 10.20.193.28:0/4016761011 wait complete. 2026-02-20T03:20:24.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 429383 5.88 MB/sec execute 117 sec latency 8.047 ms 2026-02-20T03:20:24.514 INFO:tasks.cephfs.filesystem:scrub status for tag:44f9160e-f658-416e-91f3-febf09ef52b9 - {'path': '/', 'tag': '44f9160e-f658-416e-91f3-febf09ef52b9', 'options': 'recursive,force'} 2026-02-20T03:20:25.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:25 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:20:25.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:25 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:25 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:20:25.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:25 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:25 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:20:25.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:25 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:20:25.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:25 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:25 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:25 trial177 ceph-mon[43181]: pgmap v353: 129 pgs: 129 active+clean; 78 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 2.3 MiB/s wr, 430 op/s 2026-02-20T03:20:25.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 433009 6.00 MB/sec execute 118 sec latency 7.985 ms 2026-02-20T03:20:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:25 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:20:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:25 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:25 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:20:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:25 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:25 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:20:25.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:25 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:20:25.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:25 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:25 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:25 trial126 ceph-mon[38476]: pgmap v353: 129 pgs: 129 active+clean; 78 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 2.3 MiB/s wr, 430 op/s 2026-02-20T03:20:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:25 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:20:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:25 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:25 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:20:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:25 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:25 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:20:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:25 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:20:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:25 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:25 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:20:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:25 trial028 ceph-mon[38552]: pgmap v353: 129 pgs: 129 active+clean; 78 MiB data, 1.5 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 2.3 MiB/s wr, 430 op/s 2026-02-20T03:20:26.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 436621 6.11 MB/sec execute 119 sec latency 7.316 ms 2026-02-20T03:20:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:27 trial177 ceph-mon[43181]: pgmap v354: 129 pgs: 129 active+clean; 82 MiB data, 1.6 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.2 MiB/s wr, 438 op/s 2026-02-20T03:20:27.505 INFO:tasks.workunit.client.0.trial028.stdout: 1 440219 6.23 MB/sec execute 120 sec latency 11.592 ms 2026-02-20T03:20:27.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:27 trial126 ceph-mon[38476]: pgmap v354: 129 pgs: 129 active+clean; 82 MiB data, 1.6 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.2 MiB/s wr, 438 op/s 2026-02-20T03:20:27.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:27 trial028 ceph-mon[38552]: pgmap v354: 129 pgs: 129 active+clean; 82 MiB data, 1.6 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.2 MiB/s wr, 438 op/s 2026-02-20T03:20:27.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 -- 10.20.193.28:0/1067224957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d8105b10 msgr2=0x7fe0d8105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:27.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/1067224957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d8105b10 0x7fe0d8105f90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009960 tx=0x7fe0c002f160 comp rx=0 tx=0).stop 2026-02-20T03:20:27.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 -- 10.20.193.28:0/1067224957 shutdown_connections 2026-02-20T03:20:27.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/1067224957 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0d81064d0 0x7fe0d810cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/1067224957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d8105b10 0x7fe0d8105f90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/1067224957 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0d8104920 0x7fe0d8104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 -- 10.20.193.28:0/1067224957 >> 10.20.193.28:0/1067224957 conn(0x7fe0d8100080 msgr2=0x7fe0d81024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:27.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 -- 10.20.193.28:0/1067224957 shutdown_connections 2026-02-20T03:20:27.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 -- 10.20.193.28:0/1067224957 wait complete. 2026-02-20T03:20:27.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.969+0000 7fe0d7fff640 1 Processor -- start 2026-02-20T03:20:27.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d7fff640 1 -- start start 2026-02-20T03:20:27.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0d8104920 0x7fe0d819ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0d8105b10 0x7fe0d819cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d81064d0 0x7fe0d81a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d81103f0 con 0x7fe0d81064d0 2026-02-20T03:20:27.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d7fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8110270 con 0x7fe0d8105b10 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d7fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8110570 con 0x7fe0d8104920 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0d8104920 0x7fe0d819ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d81064d0 0x7fe0d81a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d81064d0 0x7fe0d81a3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47490/0 (socket says 10.20.193.28:47490) 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d77fe640 1 -- 10.20.193.28:0/2623687119 learned_addr learned my addr 10.20.193.28:0/2623687119 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.970+0000 7fe0d67fc640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0d8105b10 0x7fe0d819cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0d77fe640 1 -- 10.20.193.28:0/2623687119 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0d8104920 msgr2=0x7fe0d819ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0d8104920 0x7fe0d819ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0d77fe640 1 -- 10.20.193.28:0/2623687119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0d8105b10 msgr2=0x7fe0d819cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0d8105b10 0x7fe0d819cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0d77fe640 1 -- 10.20.193.28:0/2623687119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d81a46e0 con 0x7fe0d81064d0 2026-02-20T03:20:27.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d81064d0 0x7fe0d81a3fe0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800e3c0 tx=0x7fe0c800e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:27.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0b7fff640 1 -- 10.20.193.28:0/2623687119 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80040d0 con 0x7fe0d81064d0 2026-02-20T03:20:27.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0b7fff640 1 -- 10.20.193.28:0/2623687119 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0c8018070 con 0x7fe0d81064d0 2026-02-20T03:20:27.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0b7fff640 1 -- 10.20.193.28:0/2623687119 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8013a20 con 0x7fe0d81064d0 2026-02-20T03:20:27.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0d7fff640 1 -- 10.20.193.28:0/2623687119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d81a4970 con 0x7fe0d81064d0 2026-02-20T03:20:27.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.971+0000 7fe0d7fff640 1 -- 10.20.193.28:0/2623687119 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d81a4ec0 con 0x7fe0d81064d0 2026-02-20T03:20:27.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.974+0000 7fe0b7fff640 1 -- 10.20.193.28:0/2623687119 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe0c8004270 con 0x7fe0d81064d0 2026-02-20T03:20:27.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.974+0000 7fe0e065ce00 1 Processor -- start 2026-02-20T03:20:27.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.974+0000 7fe0e065ce00 1 -- start start 2026-02-20T03:20:27.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b502280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 0x55b16b506f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 0x55b16b5099f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b16b4528f0 con 0x55b16b5027c0 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b16b4002e0 con 0x55b16b501e80 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b16b44e820 con 0x55b16b507560 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d67fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b502280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 0x55b16b506f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d67fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b502280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48084/0 (socket says 10.20.193.28:48084) 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d67fc640 1 -- 10.20.193.28:0/4183022433 learned_addr learned my addr 10.20.193.28:0/4183022433 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d67fc640 1 --2- 10.20.193.28:0/4183022433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 0x55b16b5099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 0x55b16b506f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47496/0 (socket says 10.20.193.28:47496) 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d67fc640 1 -- 10.20.193.28:0/4183022433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 msgr2=0x55b16b5099f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d67fc640 1 --2- 10.20.193.28:0/4183022433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 0x55b16b5099f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d67fc640 1 -- 10.20.193.28:0/4183022433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 msgr2=0x55b16b506f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d67fc640 1 --2- 10.20.193.28:0/4183022433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 0x55b16b506f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.975+0000 7fe0d67fc640 1 -- 10.20.193.28:0/4183022433 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16b3f25a0 con 0x55b16b501e80 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.976+0000 7fe0d67fc640 1 --2- 10.20.193.28:0/4183022433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b502280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0037000 tx=0x7fe0c003a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a57198a0f4052be server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.976+0000 7fe09f7fe640 1 -- 10.20.193.28:0/4183022433 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0002c10 con 0x55b16b501e80 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.976+0000 7fe09f7fe640 1 -- 10.20.193.28:0/4183022433 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0c0033070 con 0x55b16b501e80 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.976+0000 7fe09f7fe640 1 -- 10.20.193.28:0/4183022433 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0038770 con 0x55b16b501e80 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.976+0000 7fe0b7fff640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0a80b0e20 0x7fe0a80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.976+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4183022433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 msgr2=0x55b16b502280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:27.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.976+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4183022433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b502280 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0037000 tx=0x7fe0c003a040 comp rx=0 tx=0).stop 2026-02-20T03:20:27.985 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0b7fff640 1 -- 10.20.193.28:0/2623687119 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe0c80e0c00 con 0x7fe0d81064d0 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4183022433 shutdown_connections 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4183022433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 0x55b16b5099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4183022433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 0x55b16b506f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4183022433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b502280 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4183022433 >> 10.20.193.28:0/4183022433 conn(0x55b16b4f96f0 msgr2=0x55b16b500570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4183022433 shutdown_connections 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0d6ffd640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0a80b0e20 0x7fe0a80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4183022433 wait complete. 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.977+0000 7fe0d6ffd640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0a80b0e20 0x7fe0a80b32e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x55b16b502eb0 tx=0x7fe0cc009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:27.986 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.978+0000 7fe0e065ce00 1 -- start start 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0e065ce00 1 Processor -- start 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b523370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 0x55b16b5238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b52a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b16b3fa0c0 con 0x55b16b507560 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b16b50a5b0 con 0x55b16b501e80 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b16b52adc0 con 0x55b16b5027c0 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b523370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d67fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 0x55b16b5238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b52a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b523370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48086/0 (socket says 10.20.193.28:48086) 2026-02-20T03:20:27.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d6ffd640 1 -- 10.20.193.28:0/4228826578 learned_addr learned my addr 10.20.193.28:0/4228826578 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d77fe640 1 -- 10.20.193.28:0/4228826578 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 msgr2=0x55b16b5238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 0x55b16b5238b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d77fe640 1 -- 10.20.193.28:0/4228826578 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 msgr2=0x55b16b523370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b523370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.979+0000 7fe0d77fe640 1 -- 10.20.193.28:0/4228826578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16b514080 con 0x55b16b507560 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b52a830 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80a5960 tx=0x7fe0c80a46a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68f18a51efceadb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe09cff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe09cff9640 1 -- 10.20.193.28:0/4228826578 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80accf0 con 0x55b16b507560 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe09cff9640 1 -- 10.20.193.28:0/4228826578 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0c80b1ba0 con 0x55b16b507560 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe09cff9640 1 -- 10.20.193.28:0/4228826578 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80a42c0 con 0x55b16b507560 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4228826578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16b40e820 con 0x55b16b507560 2026-02-20T03:20:27.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe09cff9640 1 -- 10.20.193.28:0/4228826578 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe0c80a73c0 con 0x55b16b507560 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 10 client.16827 _ll_register_callbacks cb 0x55b16b3fdff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4228826578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b16b45a4e0 con 0x55b16b507560 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe09cff9640 1 -- 10.20.193.28:0/4228826578 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0c8013e30 con 0x55b16b507560 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 10 client.16827 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4228826578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b16b413380 con 0x55b16b507560 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe09cff9640 1 -- 10.20.193.28:0/4228826578 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fe0c80a75c0 con 0x55b16b507560 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 10 client.16827 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 10 client.16827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 20 client.16827 populate_metadata read hostname 'trial028' 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b16b52f0b0 0x55b16b531540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 4 client.16827 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.980+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4228826578 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b16b3d4bd0 con 0x55b16b52f0b0 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.981+0000 7fe0d6ffd640 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b16b52f0b0 0x55b16b531540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.981+0000 7fe0d6ffd640 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b16b52f0b0 0x55b16b531540 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa1dd1cceefd47f2 server_cookie=ac33076be38f270b in_seq=0 out_seq=0 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.981+0000 7fe09cff9640 10 client.16827 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe09cff9640 1 -- 10.20.193.28:0/4228826578 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b16b3d4bd0 con 0x55b16b52f0b0 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe09cff9640 10 client.16827 handle_command_reply: tid=0 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 client.16827 shutdown 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4228826578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 msgr2=0x55b16b52a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b52a830 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80a5960 tx=0x7fe0c80a46a0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4228826578 shutdown_connections 2026-02-20T03:20:27.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b16b52f0b0 0x55b16b531540 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b52a830 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 0x55b16b5238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/4228826578 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b523370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4228826578 >> 10.20.193.28:0/4228826578 conn(0x55b16b4f96f0 msgr2=0x55b16b508910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:27.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe09cff9640 0 client.16827 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:27.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4228826578 shutdown_connections 2026-02-20T03:20:27.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 1 -- 10.20.193.28:0/4228826578 wait complete. 2026-02-20T03:20:27.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.982+0000 7fe0e065ce00 20 client.16827 trim_cache size 0 max 16384 2026-02-20T03:20:27.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.990+0000 7fe0e065ce00 1 Processor -- start 2026-02-20T03:20:27.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.990+0000 7fe0e065ce00 1 -- start start 2026-02-20T03:20:27.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.990+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b52bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.990+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 0x55b16b52a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.990+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b519740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:27.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.990+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c012680 con 0x55b16b507560 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.990+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c00ff20 con 0x55b16b501e80 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.990+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c00dd70 con 0x55b16b5027c0 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b519740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b519740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47512/0 (socket says 10.20.193.28:47512) 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d77fe640 1 -- 10.20.193.28:0/1427971980 learned_addr learned my addr 10.20.193.28:0/1427971980 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d67fc640 1 --2- 10.20.193.28:0/1427971980 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 0x55b16b52a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d6ffd640 1 --2- 10.20.193.28:0/1427971980 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b52bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d77fe640 1 -- 10.20.193.28:0/1427971980 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 msgr2=0x55b16b52a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/1427971980 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 0x55b16b52a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d77fe640 1 -- 10.20.193.28:0/1427971980 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 msgr2=0x55b16b52bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:27.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/1427971980 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b52bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d77fe640 1 -- 10.20.193.28:0/1427971980 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16b513eb0 con 0x55b16b507560 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/1427971980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b519740 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009fd0 tx=0x7fe0c8015050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d241f8460920fe65 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe09effd640 1 -- 10.20.193.28:0/1427971980 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80accf0 con 0x55b16b507560 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe09effd640 1 -- 10.20.193.28:0/1427971980 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55b16b45a4e0 con 0x55b16b507560 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe09effd640 1 -- 10.20.193.28:0/1427971980 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80b1710 con 0x55b16b507560 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0e065ce00 1 -- 10.20.193.28:0/1427971980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 msgr2=0x55b16b519740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/1427971980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b519740 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009fd0 tx=0x7fe0c8015050 comp rx=0 tx=0).stop 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0e065ce00 1 -- 10.20.193.28:0/1427971980 shutdown_connections 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/1427971980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b507560 0x55b16b519740 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/1427971980 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b5027c0 0x55b16b52a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/1427971980 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b52bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:27.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0e065ce00 1 -- 10.20.193.28:0/1427971980 >> 10.20.193.28:0/1427971980 conn(0x55b16b4f96f0 msgr2=0x55b16b523680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:27.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0e065ce00 1 -- 10.20.193.28:0/1427971980 shutdown_connections 2026-02-20T03:20:27.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.991+0000 7fe0e065ce00 1 -- 10.20.193.28:0/1427971980 wait complete. 2026-02-20T03:20:27.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.992+0000 7fe0e065ce00 1 -- start start 2026-02-20T03:20:27.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.992+0000 7fe0e065ce00 1 Processor -- start 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.992+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b528750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.992+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 0x55b16b528c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.992+0000 7fe0e065ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 0x55b16b529c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.992+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c00e3e0 con 0x55b16b5027c0 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.992+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c00f850 con 0x55b16b501e80 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.992+0000 7fe0e065ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c00eab0 con 0x55b16b507560 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b528750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 0x55b16b528c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b528750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48104/0 (socket says 10.20.193.28:48104) 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d6ffd640 1 -- 10.20.193.28:0/2647700549 learned_addr learned my addr 10.20.193.28:0/2647700549 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:28.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d77fe640 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 0x55b16b529c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d6ffd640 1 -- 10.20.193.28:0/2647700549 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 msgr2=0x55b16b529c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d6ffd640 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 0x55b16b529c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d6ffd640 1 -- 10.20.193.28:0/2647700549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 msgr2=0x55b16b528c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d6ffd640 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 0x55b16b528c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d6ffd640 1 -- 10.20.193.28:0/2647700549 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16b1b2690 con 0x55b16b501e80 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0d6ffd640 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b528750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55b16b531df0 tx=0x7fe0cc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af67f5f2e6eb325b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe09cff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe09cff9640 1 -- 10.20.193.28:0/2647700549 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc02b400 con 0x55b16b501e80 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0e065ce00 1 -- 10.20.193.28:0/2647700549 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16b417b70 con 0x55b16b501e80 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0e065ce00 10 client.26471 _ll_register_callbacks cb 0x7fe0c80a3f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe0e065ce00 1 -- 10.20.193.28:0/2647700549 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c0033070 con 0x55b16b501e80 2026-02-20T03:20:28.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe09cff9640 1 -- 10.20.193.28:0/2647700549 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe0cc02ba40 con 0x55b16b501e80 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.993+0000 7fe09cff9640 1 -- 10.20.193.28:0/2647700549 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc01c900 con 0x55b16b501e80 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe09cff9640 1 -- 10.20.193.28:0/2647700549 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe0cc01caa0 con 0x55b16b501e80 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe09cff9640 1 -- 10.20.193.28:0/2647700549 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0cc01cd20 con 0x55b16b501e80 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe0e065ce00 10 client.26471 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe0e065ce00 1 -- 10.20.193.28:0/2647700549 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55b16b514ba0 con 0x55b16b501e80 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe09cff9640 1 -- 10.20.193.28:0/2647700549 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7fe0cc02bbf0 con 0x55b16b501e80 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe0e065ce00 10 client.26471 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe0e065ce00 10 client.26471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe0e065ce00 20 client.26471 populate_metadata read hostname 'trial028' 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b16b59ad50 0x55b16b59d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe0e065ce00 4 client.26471 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe0e065ce00 1 -- 10.20.193.28:0/2647700549 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b16b22b520 con 0x55b16b59ad50 2026-02-20T03:20:28.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.994+0000 7fe0d67fc640 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b16b59ad50 0x55b16b59d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:28.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.995+0000 7fe0d67fc640 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b16b59ad50 0x55b16b59d1e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f56cc27898f7ae36 server_cookie=7468d5394b6bcec6 in_seq=0 out_seq=0 2026-02-20T03:20:28.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:27.995+0000 7fe09cff9640 10 client.26471 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:28.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.080+0000 7fe09cff9640 1 -- 10.20.193.28:0/2647700549 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b16b22b520 con 0x55b16b59ad50 2026-02-20T03:20:28.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.080+0000 7fe09cff9640 10 client.26471 handle_command_reply: tid=0 2026-02-20T03:20:28.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.080+0000 7fe0e065ce00 1 client.26471 shutdown 2026-02-20T03:20:28.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.080+0000 7fe0e065ce00 1 -- 10.20.193.28:0/2647700549 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 msgr2=0x55b16b528750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:28.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.080+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b528750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55b16b531df0 tx=0x7fe0cc0047c0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0e065ce00 1 -- 10.20.193.28:0/2647700549 shutdown_connections 2026-02-20T03:20:28.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b16b59ad50 0x55b16b59d1e0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b16b507560 0x55b16b529c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b16b5027c0 0x55b16b528c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0e065ce00 1 --2- 10.20.193.28:0/2647700549 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b16b501e80 0x55b16b528750 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe09cff9640 0 client.26471 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:28.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0e065ce00 1 -- 10.20.193.28:0/2647700549 >> 10.20.193.28:0/2647700549 conn(0x55b16b4f96f0 msgr2=0x55b16b519740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:28.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0e065ce00 1 -- 10.20.193.28:0/2647700549 shutdown_connections 2026-02-20T03:20:28.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0e065ce00 1 -- 10.20.193.28:0/2647700549 wait complete. 2026-02-20T03:20:28.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0e065ce00 20 client.26471 trim_cache size 0 max 16384 2026-02-20T03:20:28.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:20:28.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:20:28.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:20:28.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:20:28.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0d7fff640 1 -- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0a80b0e20 msgr2=0x7fe0a80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:28.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0a80b0e20 0x7fe0a80b32e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x55b16b502eb0 tx=0x7fe0cc009290 comp rx=0 tx=0).stop 2026-02-20T03:20:28.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0d7fff640 1 -- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d81064d0 msgr2=0x7fe0d81a3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:28.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.082+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d81064d0 0x7fe0d81a3fe0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800e3c0 tx=0x7fe0c800e890 comp rx=0 tx=0).stop 2026-02-20T03:20:28.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.083+0000 7fe0d7fff640 1 -- 10.20.193.28:0/2623687119 shutdown_connections 2026-02-20T03:20:28.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.083+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0a80b0e20 0x7fe0a80b32e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.083+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0d81064d0 0x7fe0d81a3fe0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.083+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0d8105b10 0x7fe0d819cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.083+0000 7fe0d7fff640 1 --2- 10.20.193.28:0/2623687119 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0d8104920 0x7fe0d819ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:28.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.083+0000 7fe0d7fff640 1 -- 10.20.193.28:0/2623687119 >> 10.20.193.28:0/2623687119 conn(0x7fe0d8100080 msgr2=0x7fe0d8108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:28.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.083+0000 7fe0d7fff640 1 -- 10.20.193.28:0/2623687119 shutdown_connections 2026-02-20T03:20:28.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:28.083+0000 7fe0d7fff640 1 -- 10.20.193.28:0/2623687119 wait complete. 2026-02-20T03:20:28.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 443684 6.33 MB/sec execute 121 sec latency 41.659 ms 2026-02-20T03:20:29.397 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:29 trial126 ceph-mon[38476]: pgmap v355: 129 pgs: 129 active+clean; 85 MiB data, 1.6 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 MiB/s rd, 2.3 MiB/s wr, 458 op/s 2026-02-20T03:20:29.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:29 trial177 ceph-mon[43181]: pgmap v355: 129 pgs: 129 active+clean; 85 MiB data, 1.6 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 MiB/s rd, 2.3 MiB/s wr, 458 op/s 2026-02-20T03:20:29.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 447361 6.44 MB/sec execute 122 sec latency 14.560 ms 2026-02-20T03:20:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:29 trial028 ceph-mon[38552]: pgmap v355: 129 pgs: 129 active+clean; 85 MiB data, 1.6 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 MiB/s rd, 2.3 MiB/s wr, 458 op/s 2026-02-20T03:20:30.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 451046 6.54 MB/sec execute 123 sec latency 6.733 ms 2026-02-20T03:20:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:31 trial177 ceph-mon[43181]: pgmap v356: 129 pgs: 129 active+clean; 89 MiB data, 1.6 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 MiB/s rd, 2.4 MiB/s wr, 500 op/s 2026-02-20T03:20:31.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 454723 6.64 MB/sec execute 124 sec latency 7.689 ms 2026-02-20T03:20:31.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:31 trial126 ceph-mon[38476]: pgmap v356: 129 pgs: 129 active+clean; 89 MiB data, 1.6 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 MiB/s rd, 2.4 MiB/s wr, 500 op/s 2026-02-20T03:20:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:31 trial028 ceph-mon[38552]: pgmap v356: 129 pgs: 129 active+clean; 89 MiB data, 1.6 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 MiB/s rd, 2.4 MiB/s wr, 500 op/s 2026-02-20T03:20:32.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 458323 6.74 MB/sec execute 125 sec latency 7.277 ms 2026-02-20T03:20:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:33 trial177 ceph-mon[43181]: pgmap v357: 129 pgs: 129 active+clean; 86 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.1 MiB/s wr, 452 op/s 2026-02-20T03:20:33.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:20:33.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:20:33.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 462180 7.01 MB/sec execute 126 sec latency 17.074 ms 2026-02-20T03:20:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:33 trial126 ceph-mon[38476]: pgmap v357: 129 pgs: 129 active+clean; 86 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.1 MiB/s wr, 452 op/s 2026-02-20T03:20:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:20:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:20:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:33 trial028 ceph-mon[38552]: pgmap v357: 129 pgs: 129 active+clean; 86 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.1 MiB/s wr, 452 op/s 2026-02-20T03:20:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:20:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:20:34.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:34 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:20:34.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 465890 7.10 MB/sec execute 127 sec latency 8.345 ms 2026-02-20T03:20:34.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:34 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:20:34.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:34 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:20:35.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:35 trial177 ceph-mon[43181]: pgmap v358: 129 pgs: 129 active+clean; 92 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 538 op/s 2026-02-20T03:20:35.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 469800 7.20 MB/sec execute 128 sec latency 7.253 ms 2026-02-20T03:20:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:35 trial126 ceph-mon[38476]: pgmap v358: 129 pgs: 129 active+clean; 92 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 538 op/s 2026-02-20T03:20:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:35 trial028 ceph-mon[38552]: pgmap v358: 129 pgs: 129 active+clean; 92 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.4 MiB/s wr, 538 op/s 2026-02-20T03:20:36.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 473924 7.33 MB/sec execute 129 sec latency 6.799 ms 2026-02-20T03:20:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:37 trial177 ceph-mon[43181]: pgmap v359: 129 pgs: 129 active+clean; 90 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 498 op/s 2026-02-20T03:20:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:20:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:20:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:20:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:20:37.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 478230 7.42 MB/sec execute 130 sec latency 6.887 ms 2026-02-20T03:20:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:37 trial126 ceph-mon[38476]: pgmap v359: 129 pgs: 129 active+clean; 90 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 498 op/s 2026-02-20T03:20:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:20:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:20:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:20:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:20:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:37 trial028 ceph-mon[38552]: pgmap v359: 129 pgs: 129 active+clean; 90 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.3 MiB/s wr, 498 op/s 2026-02-20T03:20:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:20:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:20:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:20:37.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:20:38.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 482438 7.55 MB/sec execute 131 sec latency 9.391 ms 2026-02-20T03:20:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:39 trial177 ceph-mon[43181]: pgmap v360: 129 pgs: 129 active+clean; 86 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 472 op/s 2026-02-20T03:20:39.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 486890 7.69 MB/sec execute 132 sec latency 6.672 ms 2026-02-20T03:20:39.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:39 trial126 ceph-mon[38476]: pgmap v360: 129 pgs: 129 active+clean; 86 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 472 op/s 2026-02-20T03:20:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:39 trial028 ceph-mon[38552]: pgmap v360: 129 pgs: 129 active+clean; 86 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.1 MiB/s wr, 472 op/s 2026-02-20T03:20:40.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 490586 7.79 MB/sec execute 133 sec latency 12.295 ms 2026-02-20T03:20:41.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 -- 10.20.193.28:0/3371626250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7020077050 msgr2=0x7f70200754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 --2- 10.20.193.28:0/3371626250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7020077050 0x7f70200754a0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f7010009a30 tx=0x7f701002f220 comp rx=0 tx=0).stop 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 -- 10.20.193.28:0/3371626250 shutdown_connections 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 --2- 10.20.193.28:0/3371626250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f702010a5f0 0x7f702010ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 --2- 10.20.193.28:0/3371626250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f70200759e0 0x7f7020075e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 --2- 10.20.193.28:0/3371626250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7020077050 0x7f70200754a0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 -- 10.20.193.28:0/3371626250 >> 10.20.193.28:0/3371626250 conn(0x7f70200fde10 msgr2=0x7f7020100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 -- 10.20.193.28:0/3371626250 shutdown_connections 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 -- 10.20.193.28:0/3371626250 wait complete. 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 Processor -- start 2026-02-20T03:20:41.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.160+0000 7f7026fa2640 1 -- start start 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7026fa2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70200759e0 0x7f702019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7026fa2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7020077050 0x7f702019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7026fa2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f702010a5f0 0x7f70201a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7026fa2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7020110410 con 0x7f70200759e0 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7026fa2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7020110290 con 0x7f7020077050 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7026fa2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7020110590 con 0x7f702010a5f0 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7025fa0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70200759e0 0x7f702019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7025fa0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70200759e0 0x7f702019cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44296/0 (socket says 10.20.193.28:44296) 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7025fa0640 1 -- 10.20.193.28:0/1733756445 learned_addr learned my addr 10.20.193.28:0/1733756445 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f702579f640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7020077050 0x7f702019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f70267a1640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f702010a5f0 0x7f70201a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7025fa0640 1 -- 10.20.193.28:0/1733756445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f702010a5f0 msgr2=0x7f70201a4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7025fa0640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f702010a5f0 0x7f70201a4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7025fa0640 1 -- 10.20.193.28:0/1733756445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7020077050 msgr2=0x7f702019cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7025fa0640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7020077050 0x7f702019cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7025fa0640 1 -- 10.20.193.28:0/1733756445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70201a4760 con 0x7f70200759e0 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.161+0000 7f7025fa0640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70200759e0 0x7f702019cab0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7010009b60 tx=0x7f701002fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.162+0000 7f700effd640 1 -- 10.20.193.28:0/1733756445 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010004240 con 0x7f70200759e0 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.162+0000 7f7026fa2640 1 -- 10.20.193.28:0/1733756445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70201a49f0 con 0x7f70200759e0 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.162+0000 7f700effd640 1 -- 10.20.193.28:0/1733756445 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f70100043e0 con 0x7f70200759e0 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.162+0000 7f700effd640 1 -- 10.20.193.28:0/1733756445 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010042800 con 0x7f70200759e0 2026-02-20T03:20:41.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.162+0000 7f7026fa2640 1 -- 10.20.193.28:0/1733756445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70201a4f30 con 0x7f70200759e0 2026-02-20T03:20:41.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.164+0000 7f700effd640 1 -- 10.20.193.28:0/1733756445 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f701004a030 con 0x7f70200759e0 2026-02-20T03:20:41.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.165+0000 7f702b08ae00 1 Processor -- start 2026-02-20T03:20:41.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.165+0000 7f702b08ae00 1 -- start start 2026-02-20T03:20:41.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.165+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b07e80 0x55c1e8b08280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.165+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 0x55c1e8b0cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.165+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b0d560 0x55c1e8b0f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.165+0000 7f702b08ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c1e8a588f0 con 0x55c1e8b0d560 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.165+0000 7f702b08ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c1e8a062e0 con 0x55c1e8b07e80 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.165+0000 7f702b08ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c1e8a54820 con 0x55c1e8b087c0 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f70267a1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b07e80 0x55c1e8b08280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f7025fa0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 0x55c1e8b0cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f702579f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b0d560 0x55c1e8b0f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f70267a1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b07e80 0x55c1e8b08280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35856/0 (socket says 10.20.193.28:35856) 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f70267a1640 1 -- 10.20.193.28:0/3542773080 learned_addr learned my addr 10.20.193.28:0/3542773080 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f700effd640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ffc0b0e20 0x7f6ffc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f700effd640 1 -- 10.20.193.28:0/1733756445 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f7010104eb0 con 0x7f70200759e0 2026-02-20T03:20:41.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f702579f640 1 -- 10.20.193.28:0/3542773080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 msgr2=0x55c1e8b0cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f702579f640 1 --2- 10.20.193.28:0/3542773080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 0x55c1e8b0cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f702579f640 1 -- 10.20.193.28:0/3542773080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b07e80 msgr2=0x55c1e8b08280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f702579f640 1 --2- 10.20.193.28:0/3542773080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b07e80 0x55c1e8b08280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f702579f640 1 -- 10.20.193.28:0/3542773080 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e89f85a0 con 0x55c1e8b0d560 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f70267a1640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ffc0b0e20 0x7f6ffc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f702579f640 1 --2- 10.20.193.28:0/3542773080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b0d560 0x55c1e8b0f9f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f70140044e0 tx=0x7f7014009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e3d5034bdf2233 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f70267a1640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ffc0b0e20 0x7f6ffc0b32e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f701c009e90 tx=0x7f701c004040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.166+0000 7f6fee3ff640 1 -- 10.20.193.28:0/3542773080 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701401a440 con 0x55c1e8b0d560 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f6fee3ff640 1 -- 10.20.193.28:0/3542773080 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f701401aa80 con 0x55c1e8b0d560 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f6fee3ff640 1 -- 10.20.193.28:0/3542773080 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014010970 con 0x55c1e8b0d560 2026-02-20T03:20:41.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f702b08ae00 1 -- 10.20.193.28:0/3542773080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b0d560 msgr2=0x55c1e8b0f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:41.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f702b08ae00 1 --2- 10.20.193.28:0/3542773080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b0d560 0x55c1e8b0f9f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f70140044e0 tx=0x7f7014009c70 comp rx=0 tx=0).stop 2026-02-20T03:20:41.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f702b08ae00 1 -- 10.20.193.28:0/3542773080 shutdown_connections 2026-02-20T03:20:41.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f702b08ae00 1 --2- 10.20.193.28:0/3542773080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b0d560 0x55c1e8b0f9f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f702b08ae00 1 --2- 10.20.193.28:0/3542773080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 0x55c1e8b0cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f702b08ae00 1 --2- 10.20.193.28:0/3542773080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b07e80 0x55c1e8b08280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f702b08ae00 1 -- 10.20.193.28:0/3542773080 >> 10.20.193.28:0/3542773080 conn(0x55c1e8aff6f0 msgr2=0x55c1e8b06570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:41.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f702b08ae00 1 -- 10.20.193.28:0/3542773080 shutdown_connections 2026-02-20T03:20:41.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.167+0000 7f702b08ae00 1 -- 10.20.193.28:0/3542773080 wait complete. 2026-02-20T03:20:41.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.168+0000 7f702b08ae00 1 -- start start 2026-02-20T03:20:41.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.168+0000 7f702b08ae00 1 Processor -- start 2026-02-20T03:20:41.175 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b209d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b20f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b27e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702b08ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c1e8a000c0 con 0x55c1e8b087c0 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702b08ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c1e8b10610 con 0x55c1e8b0d560 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702b08ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c1e8b28420 con 0x55c1e8b07e80 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702579f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b20f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702579f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b20f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44320/0 (socket says 10.20.193.28:44320) 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702579f640 1 -- 10.20.193.28:0/1047123932 learned_addr learned my addr 10.20.193.28:0/1047123932 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f7025fa0640 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f7025fa0640 1 -- 10.20.193.28:0/1047123932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 msgr2=0x55c1e8b27e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:41.176 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f7025fa0640 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b27e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f7025fa0640 1 -- 10.20.193.28:0/1047123932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 msgr2=0x55c1e8b20f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f7025fa0640 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b20f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f7025fa0640 1 -- 10.20.193.28:0/1047123932 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e8b1a0e0 con 0x55c1e8b07e80 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.169+0000 7f702579f640 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b20f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f7025fa0640 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b209d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70100c9bb0 tx=0x7f7010038e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b12c7ad5f9b9c6c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f6fdb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/1047123932 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70100c8800 con 0x55c1e8b07e80 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/1047123932 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7010033070 con 0x55c1e8b07e80 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f702b08ae00 1 -- 10.20.193.28:0/1047123932 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1e8a14820 con 0x55c1e8b07e80 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/1047123932 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70100cc0b0 con 0x55c1e8b07e80 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f702b08ae00 10 client.26491 _ll_register_callbacks cb 0x55c1e8a03ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:41.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f702b08ae00 1 -- 10.20.193.28:0/1047123932 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c1e8a604e0 con 0x55c1e8b07e80 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/1047123932 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f70100c8510 con 0x55c1e8b07e80 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/1047123932 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70100cc290 con 0x55c1e8b07e80 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f702b08ae00 10 client.26491 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.170+0000 7f702b08ae00 1 -- 10.20.193.28:0/1047123932 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c1e8a19380 con 0x55c1e8b07e80 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/1047123932 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f70100cb690 con 0x55c1e8b07e80 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f702b08ae00 10 client.26491 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f702b08ae00 10 client.26491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f702b08ae00 20 client.26491 populate_metadata read hostname 'trial028' 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f702b08ae00 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c1e8b2c7e0 0x55c1e8b2eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f702b08ae00 4 client.26491 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f702b08ae00 1 -- 10.20.193.28:0/1047123932 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1e89dabd0 con 0x55c1e8b2c7e0 2026-02-20T03:20:41.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f702579f640 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c1e8b2c7e0 0x55c1e8b2eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f702579f640 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c1e8b2c7e0 0x55c1e8b2eca0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cbf3be3eaeec41c server_cookie=e1fabad5a018fc26 in_seq=0 out_seq=0 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.171+0000 7f6fdb7fe640 10 client.26491 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/1047123932 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c1e89dabd0 con 0x55c1e8b2c7e0 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f6fdb7fe640 10 client.26491 handle_command_reply: tid=0 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 client.26491 shutdown 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 -- 10.20.193.28:0/1047123932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 msgr2=0x55c1e8b209d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b209d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70100c9bb0 tx=0x7f7010038e60 comp rx=0 tx=0).stop 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 -- 10.20.193.28:0/1047123932 shutdown_connections 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c1e8b2c7e0 0x55c1e8b2eca0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b27e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b20f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 --2- 10.20.193.28:0/1047123932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b209d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 -- 10.20.193.28:0/1047123932 >> 10.20.193.28:0/1047123932 conn(0x55c1e8aff6f0 msgr2=0x55c1e8b0e870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:41.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f6fdb7fe640 0 client.26491 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:41.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 -- 10.20.193.28:0/1047123932 shutdown_connections 2026-02-20T03:20:41.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 1 -- 10.20.193.28:0/1047123932 wait complete. 2026-02-20T03:20:41.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.172+0000 7f702b08ae00 20 client.26491 trim_cache size 0 max 16384 2026-02-20T03:20:41.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.179+0000 7f702b08ae00 1 Processor -- start 2026-02-20T03:20:41.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f702b08ae00 1 -- start start 2026-02-20T03:20:41.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b07e80 0x55c1e8b0e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 0x55c1e8b27e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b05d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f702b08ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc012650 con 0x55c1e8b07e80 2026-02-20T03:20:41.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f702b08ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc00fef0 con 0x55c1e8b0d560 2026-02-20T03:20:41.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f702b08ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc00dd40 con 0x55c1e8b087c0 2026-02-20T03:20:41.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f7025fa0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b07e80 0x55c1e8b0e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f7025fa0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b07e80 0x55c1e8b0e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44334/0 (socket says 10.20.193.28:44334) 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f7025fa0640 1 -- 10.20.193.28:0/941704985 learned_addr learned my addr 10.20.193.28:0/941704985 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f702579f640 1 --2- 10.20.193.28:0/941704985 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 0x55c1e8b27e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f70267a1640 1 --2- 10.20.193.28:0/941704985 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b05d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f7025fa0640 1 -- 10.20.193.28:0/941704985 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 msgr2=0x55c1e8b27e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f7025fa0640 1 --2- 10.20.193.28:0/941704985 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 0x55c1e8b27e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f7025fa0640 1 -- 10.20.193.28:0/941704985 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 msgr2=0x55c1e8b05d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f7025fa0640 1 --2- 10.20.193.28:0/941704985 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b05d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f7025fa0640 1 -- 10.20.193.28:0/941704985 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e8b19f10 con 0x55c1e8b07e80 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f7025fa0640 1 --2- 10.20.193.28:0/941704985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b07e80 0x55c1e8b0e950 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f70100c89c0 tx=0x7f7010031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b44d6173b755dec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:41.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f6fedbfe640 1 -- 10.20.193.28:0/941704985 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70100e1e60 con 0x55c1e8b07e80 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f6fedbfe640 1 -- 10.20.193.28:0/941704985 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7010033070 con 0x55c1e8b07e80 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.180+0000 7f6fedbfe640 1 -- 10.20.193.28:0/941704985 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70100cc960 con 0x55c1e8b07e80 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 -- 10.20.193.28:0/941704985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b07e80 msgr2=0x55c1e8b0e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 --2- 10.20.193.28:0/941704985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b07e80 0x55c1e8b0e950 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f70100c89c0 tx=0x7f7010031000 comp rx=0 tx=0).stop 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 -- 10.20.193.28:0/941704985 shutdown_connections 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 --2- 10.20.193.28:0/941704985 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b05d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 --2- 10.20.193.28:0/941704985 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b087c0 0x55c1e8b27e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 --2- 10.20.193.28:0/941704985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b07e80 0x55c1e8b0e950 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 -- 10.20.193.28:0/941704985 >> 10.20.193.28:0/941704985 conn(0x55c1e8aff6f0 msgr2=0x55c1e8b1f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 -- 10.20.193.28:0/941704985 shutdown_connections 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 -- 10.20.193.28:0/941704985 wait complete. 2026-02-20T03:20:41.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 -- start start 2026-02-20T03:20:41.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.181+0000 7f702b08ae00 1 Processor -- start 2026-02-20T03:20:41.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b26070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b265b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f702b08ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b26af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f702b08ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc00e3b0 con 0x55c1e8b087c0 2026-02-20T03:20:41.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f702b08ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc00f820 con 0x55c1e8b0d560 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f702b08ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6fcc00ea80 con 0x55c1e8b07e80 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f70267a1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b26af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f70267a1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b26af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:35878/0 (socket says 10.20.193.28:35878) 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f70267a1640 1 -- 10.20.193.28:0/2403280811 learned_addr learned my addr 10.20.193.28:0/2403280811 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f702579f640 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b265b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f7025fa0640 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b26070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f7025fa0640 1 -- 10.20.193.28:0/2403280811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 msgr2=0x55c1e8b26af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f7025fa0640 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b26af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f7025fa0640 1 -- 10.20.193.28:0/2403280811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 msgr2=0x55c1e8b265b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f7025fa0640 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b265b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f7025fa0640 1 -- 10.20.193.28:0/2403280811 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e8b10370 con 0x55c1e8b07e80 2026-02-20T03:20:41.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.182+0000 7f702579f640 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b265b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f7025fa0640 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b26070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70100c89c0 tx=0x7f7010038e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e263e83090c1f90 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f6fdb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/2403280811 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70100e1e60 con 0x55c1e8b07e80 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 1 -- 10.20.193.28:0/2403280811 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1e87b8690 con 0x55c1e8b07e80 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/2403280811 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55c1e8a604e0 con 0x55c1e8b07e80 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 10 client.26497 _ll_register_callbacks cb 0x7f7010004620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 1 -- 10.20.193.28:0/2403280811 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f701401aa80 con 0x55c1e8b07e80 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/2403280811 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70100c84b0 con 0x55c1e8b07e80 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/2403280811 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f70100d5330 con 0x55c1e8b07e80 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/2403280811 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f70100d56d0 con 0x55c1e8b07e80 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 10 client.26497 fetch_fsmap learned FSMap version 28 2026-02-20T03:20:41.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 1 -- 10.20.193.28:0/2403280811 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55c1e8a1db70 con 0x55c1e8b07e80 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/2403280811 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f70100d3140 con 0x55c1e8b07e80 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 10 client.26497 fetch_fsmap finished waiting for FSMap version 28 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 10 client.26497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 20 client.26497 populate_metadata read hostname 'trial028' 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c1e8ba0190 0x55c1e8ba2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 4 client.26497 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702b08ae00 1 -- 10.20.193.28:0/2403280811 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c1e8831520 con 0x55c1e8ba0190 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.183+0000 7f702579f640 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c1e8ba0190 0x55c1e8ba2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.184+0000 7f702579f640 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c1e8ba0190 0x55c1e8ba2580 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6194fc2b721c91c4 server_cookie=2060d966eb3eefa3 in_seq=0 out_seq=0 2026-02-20T03:20:41.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.184+0000 7f6fdb7fe640 10 client.26497 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:41.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.292+0000 7f6fdb7fe640 1 -- 10.20.193.28:0/2403280811 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c1e8831520 con 0x55c1e8ba0190 2026-02-20T03:20:41.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.292+0000 7f6fdb7fe640 10 client.26497 handle_command_reply: tid=0 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.292+0000 7f702b08ae00 1 client.26497 shutdown 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.292+0000 7f702b08ae00 1 -- 10.20.193.28:0/2403280811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 msgr2=0x55c1e8b26070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.292+0000 7f702b08ae00 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b26070 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70100c89c0 tx=0x7f7010038e60 comp rx=0 tx=0).stop 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.293+0000 7f702b08ae00 1 -- 10.20.193.28:0/2403280811 shutdown_connections 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.293+0000 7f702b08ae00 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c1e8ba0190 0x55c1e8ba2580 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.293+0000 7f702b08ae00 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1e8b0d560 0x55c1e8b26af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.293+0000 7f6fdb7fe640 0 client.26497 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.293+0000 7f702b08ae00 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1e8b087c0 0x55c1e8b265b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.293+0000 7f702b08ae00 1 --2- 10.20.193.28:0/2403280811 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1e8b07e80 0x55c1e8b26070 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.293+0000 7f702b08ae00 1 -- 10.20.193.28:0/2403280811 >> 10.20.193.28:0/2403280811 conn(0x55c1e8aff6f0 msgr2=0x55c1e8b0d940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:41.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.293+0000 7f702b08ae00 1 -- 10.20.193.28:0/2403280811 shutdown_connections 2026-02-20T03:20:41.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.293+0000 7f702b08ae00 1 -- 10.20.193.28:0/2403280811 wait complete. 2026-02-20T03:20:41.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.294+0000 7f702b08ae00 20 client.26497 trim_cache size 0 max 16384 2026-02-20T03:20:41.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:20:41.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:20:41.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:20:41.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:20:41.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.294+0000 7f7026fa2640 1 -- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ffc0b0e20 msgr2=0x7f6ffc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:41.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.294+0000 7f7026fa2640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ffc0b0e20 0x7f6ffc0b32e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f701c009e90 tx=0x7f701c004040 comp rx=0 tx=0).stop 2026-02-20T03:20:41.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.294+0000 7f7026fa2640 1 -- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70200759e0 msgr2=0x7f702019cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:41.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.294+0000 7f7026fa2640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70200759e0 0x7f702019cab0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7010009b60 tx=0x7f701002fcb0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.295+0000 7f7026fa2640 1 -- 10.20.193.28:0/1733756445 shutdown_connections 2026-02-20T03:20:41.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.295+0000 7f7026fa2640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6ffc0b0e20 0x7f6ffc0b32e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.295+0000 7f7026fa2640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f702010a5f0 0x7f70201a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.295+0000 7f7026fa2640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7020077050 0x7f702019cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.295+0000 7f7026fa2640 1 --2- 10.20.193.28:0/1733756445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70200759e0 0x7f702019cab0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:41.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.295+0000 7f7026fa2640 1 -- 10.20.193.28:0/1733756445 >> 10.20.193.28:0/1733756445 conn(0x7f70200fde10 msgr2=0x7f70201065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:41.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.295+0000 7f7026fa2640 1 -- 10.20.193.28:0/1733756445 shutdown_connections 2026-02-20T03:20:41.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:41.295+0000 7f7026fa2640 1 -- 10.20.193.28:0/1733756445 wait complete. 2026-02-20T03:20:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:41 trial177 ceph-mon[43181]: pgmap v361: 129 pgs: 129 active+clean; 91 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 3.4 MiB/s rd, 2.6 MiB/s wr, 575 op/s 2026-02-20T03:20:41.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 494175 7.87 MB/sec execute 134 sec latency 52.050 ms 2026-02-20T03:20:41.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:41 trial126 ceph-mon[38476]: pgmap v361: 129 pgs: 129 active+clean; 91 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 3.4 MiB/s rd, 2.6 MiB/s wr, 575 op/s 2026-02-20T03:20:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:41 trial028 ceph-mon[38552]: pgmap v361: 129 pgs: 129 active+clean; 91 MiB data, 1.7 GiB used, 8.2 TiB / 8.2 TiB avail; 3.4 MiB/s rd, 2.6 MiB/s wr, 575 op/s 2026-02-20T03:20:42.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 494642 7.82 MB/sec execute 135 sec latency 769.505 ms 2026-02-20T03:20:43.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:43 trial177 ceph-mon[43181]: pgmap v362: 129 pgs: 129 active+clean; 93 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 482 op/s 2026-02-20T03:20:43.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 497378 7.89 MB/sec execute 136 sec latency 1248.307 ms 2026-02-20T03:20:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:43 trial126 ceph-mon[38476]: pgmap v362: 129 pgs: 129 active+clean; 93 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 482 op/s 2026-02-20T03:20:43.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:43 trial028 ceph-mon[38552]: pgmap v362: 129 pgs: 129 active+clean; 93 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 482 op/s 2026-02-20T03:20:44.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 501166 7.98 MB/sec execute 137 sec latency 13.241 ms 2026-02-20T03:20:45.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:45 trial177 ceph-mon[43181]: pgmap v363: 129 pgs: 129 active+clean; 92 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 541 op/s 2026-02-20T03:20:45.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 504829 8.06 MB/sec execute 138 sec latency 10.923 ms 2026-02-20T03:20:45.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:45 trial126 ceph-mon[38476]: pgmap v363: 129 pgs: 129 active+clean; 92 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 541 op/s 2026-02-20T03:20:45.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:45 trial028 ceph-mon[38552]: pgmap v363: 129 pgs: 129 active+clean; 92 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 541 op/s 2026-02-20T03:20:46.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:46 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:20:46.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 508607 8.14 MB/sec execute 139 sec latency 6.128 ms 2026-02-20T03:20:46.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:46 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:20:46.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:46 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:20:47.433 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:47 trial028 ceph-mon[38552]: pgmap v364: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 455 op/s 2026-02-20T03:20:47.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:47 trial177 ceph-mon[43181]: pgmap v364: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 455 op/s 2026-02-20T03:20:47.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 510127 8.12 MB/sec execute 140 sec latency 624.831 ms 2026-02-20T03:20:47.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:47 trial126 ceph-mon[38476]: pgmap v364: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 455 op/s 2026-02-20T03:20:48.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 510127 8.07 MB/sec execute 141 sec latency 1624.871 ms 2026-02-20T03:20:49.242 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:49 trial028 ceph-mon[38552]: pgmap v365: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 449 op/s 2026-02-20T03:20:49.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:49 trial177 ceph-mon[43181]: pgmap v365: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 449 op/s 2026-02-20T03:20:49.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 510127 8.01 MB/sec execute 142 sec latency 2624.912 ms 2026-02-20T03:20:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:49 trial126 ceph-mon[38476]: pgmap v365: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 449 op/s 2026-02-20T03:20:50.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 510175 7.95 MB/sec execute 143 sec latency 3255.383 ms 2026-02-20T03:20:51.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:51 trial177 ceph-mon[43181]: pgmap v366: 129 pgs: 129 active+clean; 89 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 537 op/s 2026-02-20T03:20:51.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 513784 8.03 MB/sec execute 144 sec latency 484.593 ms 2026-02-20T03:20:51.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:51 trial126 ceph-mon[38476]: pgmap v366: 129 pgs: 129 active+clean; 89 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 537 op/s 2026-02-20T03:20:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:51 trial028 ceph-mon[38552]: pgmap v366: 129 pgs: 129 active+clean; 89 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 537 op/s 2026-02-20T03:20:52.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 515611 8.07 MB/sec execute 145 sec latency 459.249 ms 2026-02-20T03:20:53.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:53 trial028 ceph-mon[38552]: pgmap v367: 129 pgs: 129 active+clean; 90 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 688 KiB/s rd, 2.9 MiB/s wr, 402 op/s 2026-02-20T03:20:53.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:53 trial177 ceph-mon[43181]: pgmap v367: 129 pgs: 129 active+clean; 90 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 688 KiB/s rd, 2.9 MiB/s wr, 402 op/s 2026-02-20T03:20:53.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 515611 8.01 MB/sec execute 146 sec latency 1459.289 ms 2026-02-20T03:20:53.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:53 trial126 ceph-mon[38476]: pgmap v367: 129 pgs: 129 active+clean; 90 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 688 KiB/s rd, 2.9 MiB/s wr, 402 op/s 2026-02-20T03:20:54.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.381+0000 7efd1ffff640 1 -- 10.20.193.28:0/1992830734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 msgr2=0x7efd20111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:54.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.381+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1992830734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 0x7efd20111480 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7efd1000b0a0 tx=0x7efd1002f450 comp rx=0 tx=0).stop 2026-02-20T03:20:54.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.381+0000 7efd1ffff640 1 -- 10.20.193.28:0/1992830734 shutdown_connections 2026-02-20T03:20:54.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.381+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1992830734 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 0x7efd20111480 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.381+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1992830734 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd20109e60 0x7efd2010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.381+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1992830734 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd20109490 0x7efd20109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.381+0000 7efd1ffff640 1 -- 10.20.193.28:0/1992830734 >> 10.20.193.28:0/1992830734 conn(0x7efd20077fe0 msgr2=0x7efd2007a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:54.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 -- 10.20.193.28:0/1992830734 shutdown_connections 2026-02-20T03:20:54.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 -- 10.20.193.28:0/1992830734 wait complete. 2026-02-20T03:20:54.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 Processor -- start 2026-02-20T03:20:54.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 -- start start 2026-02-20T03:20:54.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd20109490 0x7efd201a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd20109e60 0x7efd201a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 0x7efd201a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efd20114a50 con 0x7efd2010a900 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efd201148d0 con 0x7efd20109e60 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd20114bd0 con 0x7efd20109490 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 0x7efd201a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 0x7efd201a85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52752/0 (socket says 10.20.193.28:52752) 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1f7fe640 1 -- 10.20.193.28:0/1191847644 learned_addr learned my addr 10.20.193.28:0/1191847644 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1f7fe640 1 -- 10.20.193.28:0/1191847644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd20109490 msgr2=0x7efd201a1010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1f7fe640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd20109490 0x7efd201a1010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1f7fe640 1 -- 10.20.193.28:0/1191847644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd20109e60 msgr2=0x7efd201a1550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:54.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1f7fe640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd20109e60 0x7efd201a1550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1f7fe640 1 -- 10.20.193.28:0/1191847644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd201a8cc0 con 0x7efd2010a900 2026-02-20T03:20:54.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1f7fe640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 0x7efd201a85c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7efd1000b1d0 tx=0x7efd10004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:54.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efcfffff640 1 -- 10.20.193.28:0/1191847644 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10004d40 con 0x7efd2010a900 2026-02-20T03:20:54.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efcfffff640 1 -- 10.20.193.28:0/1191847644 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efd100078c0 con 0x7efd2010a900 2026-02-20T03:20:54.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efcfffff640 1 -- 10.20.193.28:0/1191847644 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10005380 con 0x7efd2010a900 2026-02-20T03:20:54.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 -- 10.20.193.28:0/1191847644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd201a8f50 con 0x7efd2010a900 2026-02-20T03:20:54.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.382+0000 7efd1ffff640 1 -- 10.20.193.28:0/1191847644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd201a93e0 con 0x7efd2010a900 2026-02-20T03:20:54.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efcfffff640 1 -- 10.20.193.28:0/1191847644 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efd10007a70 con 0x7efd2010a900 2026-02-20T03:20:54.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 Processor -- start 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- start start 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7b4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b9600 0x55ff0a7bba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a7048f0 con 0x55ff0a7b3c50 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a6b22e0 con 0x55ff0a7b9600 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a700820 con 0x55ff0a7b45b0 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52764/0 (socket says 10.20.193.28:52764) 2026-02-20T03:20:54.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1e7fc640 1 -- 10.20.193.28:0/1628872295 learned_addr learned my addr 10.20.193.28:0/1628872295 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:54.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1e7fc640 1 -- 10.20.193.28:0/1628872295 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b45b0 msgr2=0x55ff0a7b8fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:54.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1e7fc640 1 --2- 10.20.193.28:0/1628872295 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7b8fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1e7fc640 1 -- 10.20.193.28:0/1628872295 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b9600 msgr2=0x55ff0a7bba30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:54.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1e7fc640 1 --2- 10.20.193.28:0/1628872295 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b9600 0x55ff0a7bba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1e7fc640 1 -- 10.20.193.28:0/1628872295 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0a6a45a0 con 0x55ff0a7b3c50 2026-02-20T03:20:54.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1e7fc640 1 --2- 10.20.193.28:0/1628872295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7b4070 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efd080098a0 tx=0x7efd08009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f4b32bfa6e072a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:54.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efcfd3fe640 1 -- 10.20.193.28:0/1628872295 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08016070 con 0x55ff0a7b3c50 2026-02-20T03:20:54.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efcfd3fe640 1 -- 10.20.193.28:0/1628872295 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efd0800b8d0 con 0x55ff0a7b3c50 2026-02-20T03:20:54.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efcfd3fe640 1 -- 10.20.193.28:0/1628872295 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08002e60 con 0x55ff0a7b3c50 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- 10.20.193.28:0/1628872295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 msgr2=0x55ff0a7b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- 10.20.193.28:0/1628872295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7b4070 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7efd080098a0 tx=0x7efd08009d70 comp rx=0 tx=0).stop 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- 10.20.193.28:0/1628872295 shutdown_connections 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- 10.20.193.28:0/1628872295 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b9600 0x55ff0a7bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- 10.20.193.28:0/1628872295 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- 10.20.193.28:0/1628872295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7b4070 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- 10.20.193.28:0/1628872295 >> 10.20.193.28:0/1628872295 conn(0x55ff0a7ab2d0 msgr2=0x55ff0a7b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- 10.20.193.28:0/1628872295 shutdown_connections 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- 10.20.193.28:0/1628872295 wait complete. 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efcfffff640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcf40b0e50 0x7efcf40b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efcfffff640 1 -- 10.20.193.28:0/1191847644 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efd10105900 con 0x7efd2010a900 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcf40b0e50 0x7efcf40b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcf40b0e50 0x7efcf40b3310 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efd2007b6a0 tx=0x7efd14006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- start start 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 Processor -- start 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b9600 0x55ff0a7d3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a6ac0c0 con 0x55ff0a7b3c50 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a7bc3f0 con 0x55ff0a7b45b0 2026-02-20T03:20:54.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ff0a7d43b0 con 0x55ff0a7b9600 2026-02-20T03:20:54.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:54.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52776/0 (socket says 10.20.193.28:52776) 2026-02-20T03:20:54.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 -- 10.20.193.28:0/1025617385 learned_addr learned my addr 10.20.193.28:0/1025617385 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:54.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 -- 10.20.193.28:0/1025617385 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b9600 msgr2=0x55ff0a7d3df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b9600 0x55ff0a7d3df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 -- 10.20.193.28:0/1025617385 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b45b0 msgr2=0x55ff0a7ccd10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7ccd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 -- 10.20.193.28:0/1025617385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0a7c5f00 con 0x55ff0a7b3c50 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd1effd640 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7cc7d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efd14002a00 tx=0x7efd140047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88807baf349b787 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efce8bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efce8bfc640 1 -- 10.20.193.28:0/1025617385 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14011630 con 0x55ff0a7b3c50 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efce8bfc640 1 -- 10.20.193.28:0/1025617385 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efd14011c70 con 0x55ff0a7b3c50 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efce8bfc640 1 -- 10.20.193.28:0/1025617385 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14020df0 con 0x55ff0a7b3c50 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- 10.20.193.28:0/1025617385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0a6c0820 con 0x55ff0a7b3c50 2026-02-20T03:20:54.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efce8bfc640 1 -- 10.20.193.28:0/1025617385 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efd14013410 con 0x55ff0a7b3c50 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 10 client.16863 _ll_register_callbacks cb 0x55ff0a6afff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- 10.20.193.28:0/1025617385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff0a70c4e0 con 0x55ff0a7b3c50 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efce8bfc640 1 -- 10.20.193.28:0/1025617385 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd14011e20 con 0x55ff0a7b3c50 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 10 client.16863 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- 10.20.193.28:0/1025617385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ff0a6c5380 con 0x55ff0a7b3c50 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efce8bfc640 1 -- 10.20.193.28:0/1025617385 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efd140117d0 con 0x55ff0a7b3c50 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 10 client.16863 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 10 client.16863 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 20 client.16863 populate_metadata read hostname 'trial028' 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff0a7d8830 0x55ff0a7dacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 4 client.16863 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:54.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.386+0000 7efd28284e00 1 -- 10.20.193.28:0/1025617385 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff0a686bd0 con 0x55ff0a7d8830 2026-02-20T03:20:54.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.411+0000 7efd1e7fc640 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff0a7d8830 0x55ff0a7dacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:54.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.478+0000 7efd1e7fc640 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff0a7d8830 0x55ff0a7dacc0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1a688c032211ea0 server_cookie=959d6bf44dc1b730 in_seq=0 out_seq=0 2026-02-20T03:20:54.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.478+0000 7efce8bfc640 10 client.16863 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:54.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.491+0000 7efce8bfc640 1 -- 10.20.193.28:0/1025617385 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ff0a686bd0 con 0x55ff0a7d8830 2026-02-20T03:20:54.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.491+0000 7efce8bfc640 10 client.16863 handle_command_reply: tid=0 2026-02-20T03:20:54.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.491+0000 7efd28284e00 1 client.16863 shutdown 2026-02-20T03:20:54.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 -- 10.20.193.28:0/1025617385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 msgr2=0x55ff0a7cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:54.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7cc7d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7efd14002a00 tx=0x7efd140047e0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 -- 10.20.193.28:0/1025617385 shutdown_connections 2026-02-20T03:20:54.495 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff0a7d8830 0x55ff0a7dacc0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b9600 0x55ff0a7d3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 --2- 10.20.193.28:0/1025617385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7cc7d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.496 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 -- 10.20.193.28:0/1025617385 >> 10.20.193.28:0/1025617385 conn(0x55ff0a7ab2d0 msgr2=0x55ff0a7ba950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:54.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efce8bfc640 0 client.16863 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:54.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 -- 10.20.193.28:0/1025617385 shutdown_connections 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 1 -- 10.20.193.28:0/1025617385 wait complete. 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.492+0000 7efd28284e00 20 client.16863 trim_cache size 0 max 16384 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 Processor -- start 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- start start 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7daca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b9600 0x55ff0a7c9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efcc40126d0 con 0x55ff0a7b9600 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efcc400ffa0 con 0x55ff0a7b3c50 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efcc400ddf0 con 0x55ff0a7b45b0 2026-02-20T03:20:54.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b9600 0x55ff0a7c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b9600 0x55ff0a7c9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52792/0 (socket says 10.20.193.28:52792) 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1f7fe640 1 -- 10.20.193.28:0/805169948 learned_addr learned my addr 10.20.193.28:0/805169948 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1f7fe640 1 -- 10.20.193.28:0/805169948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b45b0 msgr2=0x55ff0a7d3db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1f7fe640 1 --2- 10.20.193.28:0/805169948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7d3db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1f7fe640 1 -- 10.20.193.28:0/805169948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b3c50 msgr2=0x55ff0a7daca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1f7fe640 1 --2- 10.20.193.28:0/805169948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7daca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1f7fe640 1 -- 10.20.193.28:0/805169948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0a7c5d30 con 0x55ff0a7b9600 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1f7fe640 1 --2- 10.20.193.28:0/805169948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b9600 0x55ff0a7c9490 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efd100cd2e0 tx=0x7efd100cd480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4966ffe46cb93771 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efcfcbfd640 1 -- 10.20.193.28:0/805169948 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd100d1990 con 0x55ff0a7b9600 2026-02-20T03:20:54.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efcfcbfd640 1 -- 10.20.193.28:0/805169948 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efd10033070 con 0x55ff0a7b9600 2026-02-20T03:20:54.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efcfcbfd640 1 -- 10.20.193.28:0/805169948 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd100d63b0 con 0x55ff0a7b9600 2026-02-20T03:20:54.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- 10.20.193.28:0/805169948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b9600 msgr2=0x55ff0a7c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:54.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- 10.20.193.28:0/805169948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b9600 0x55ff0a7c9490 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7efd100cd2e0 tx=0x7efd100cd480 comp rx=0 tx=0).stop 2026-02-20T03:20:54.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- 10.20.193.28:0/805169948 shutdown_connections 2026-02-20T03:20:54.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- 10.20.193.28:0/805169948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b9600 0x55ff0a7c9490 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- 10.20.193.28:0/805169948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- 10.20.193.28:0/805169948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7daca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- 10.20.193.28:0/805169948 >> 10.20.193.28:0/805169948 conn(0x55ff0a7ab2d0 msgr2=0x55ff0a7cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- 10.20.193.28:0/805169948 shutdown_connections 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- 10.20.193.28:0/805169948 wait complete. 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- start start 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 Processor -- start 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7d3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7d3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b9600 0x55ff0a7d1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efcc400e460 con 0x55ff0a7b3c50 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efcc400f8d0 con 0x55ff0a7b45b0 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd28284e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efcc400eb30 con 0x55ff0a7b9600 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7d3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:54.511 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7d3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52802/0 (socket says 10.20.193.28:52802) 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1effd640 1 -- 10.20.193.28:0/3536167960 learned_addr learned my addr 10.20.193.28:0/3536167960 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1effd640 1 -- 10.20.193.28:0/3536167960 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b9600 msgr2=0x55ff0a7d1e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1effd640 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b9600 0x55ff0a7d1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1effd640 1 -- 10.20.193.28:0/3536167960 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b45b0 msgr2=0x55ff0a7d3cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1effd640 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7d3cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1effd640 1 -- 10.20.193.28:0/3536167960 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff0a464690 con 0x55ff0a7b3c50 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efd1effd640 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7d3780 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efd140206c0 tx=0x7efd14011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc056b0b1f662c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.498+0000 7efce8bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efce8bfc640 1 -- 10.20.193.28:0/3536167960 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14011840 con 0x55ff0a7b3c50 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efce8bfc640 1 -- 10.20.193.28:0/3536167960 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efd14030070 con 0x55ff0a7b3c50 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efce8bfc640 1 -- 10.20.193.28:0/3536167960 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1402a8a0 con 0x55ff0a7b3c50 2026-02-20T03:20:54.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 1 -- 10.20.193.28:0/3536167960 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0a6c9b70 con 0x55ff0a7b3c50 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efce8bfc640 1 -- 10.20.193.28:0/3536167960 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efd1402aa40 con 0x55ff0a7b3c50 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 10 client.16869 _ll_register_callbacks cb 0x7efd140045a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 1 -- 10.20.193.28:0/3536167960 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff0a4dd520 con 0x55ff0a7b3c50 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efce8bfc640 1 -- 10.20.193.28:0/3536167960 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd14039060 con 0x55ff0a7b3c50 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 10 client.16869 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 1 -- 10.20.193.28:0/3536167960 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ff0a7c6a20 con 0x55ff0a7b3c50 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efce8bfc640 1 -- 10.20.193.28:0/3536167960 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efd1403c050 con 0x55ff0a7b3c50 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 10 client.16869 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 10 client.16869 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 20 client.16869 populate_metadata read hostname 'trial028' 2026-02-20T03:20:54.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff0a8445c0 0x55ff0a846a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:54.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 4 client.16869 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:20:54.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.503+0000 7efd28284e00 1 -- 10.20.193.28:0/3536167960 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff0a712290 con 0x55ff0a8445c0 2026-02-20T03:20:54.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 515629 7.96 MB/sec execute 147 sec latency 2072.616 ms 2026-02-20T03:20:54.515 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:20:54.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.518+0000 7efd1e7fc640 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff0a8445c0 0x55ff0a846a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:54.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.546+0000 7efd1e7fc640 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff0a8445c0 0x55ff0a846a80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1341328fedbc7bd server_cookie=764fe7491674f7b4 in_seq=0 out_seq=0 2026-02-20T03:20:54.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.546+0000 7efce8bfc640 10 client.16869 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:54.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.651+0000 7efce8bfc640 1 -- 10.20.193.28:0/3536167960 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff0a712290 con 0x55ff0a8445c0 2026-02-20T03:20:54.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.651+0000 7efce8bfc640 10 client.16869 handle_command_reply: tid=0 2026-02-20T03:20:54.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.651+0000 7efd28284e00 1 client.16869 shutdown 2026-02-20T03:20:54.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 -- 10.20.193.28:0/3536167960 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 msgr2=0x55ff0a7d3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:54.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7d3780 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efd140206c0 tx=0x7efd14011c30 comp rx=0 tx=0).stop 2026-02-20T03:20:54.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 -- 10.20.193.28:0/3536167960 shutdown_connections 2026-02-20T03:20:54.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff0a8445c0 0x55ff0a846a80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff0a7b9600 0x55ff0a7d1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff0a7b45b0 0x55ff0a7d3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 --2- 10.20.193.28:0/3536167960 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff0a7b3c50 0x55ff0a7d3780 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 -- 10.20.193.28:0/3536167960 >> 10.20.193.28:0/3536167960 conn(0x55ff0a7ab2d0 msgr2=0x55ff0a7b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:54.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efce8bfc640 0 client.16869 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:54.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 -- 10.20.193.28:0/3536167960 shutdown_connections 2026-02-20T03:20:54.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 1 -- 10.20.193.28:0/3536167960 wait complete. 2026-02-20T03:20:54.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd28284e00 20 client.16869 trim_cache size 0 max 16384 2026-02-20T03:20:54.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:20:54.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:20:54.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:20:54.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 -- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcf40b0e50 msgr2=0x7efcf40b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcf40b0e50 0x7efcf40b3310 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efd2007b6a0 tx=0x7efd14006cd0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 -- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 msgr2=0x7efd201a85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 0x7efd201a85c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7efd1000b1d0 tx=0x7efd10004360 comp rx=0 tx=0).stop 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 -- 10.20.193.28:0/1191847644 shutdown_connections 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcf40b0e50 0x7efcf40b3310 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd2010a900 0x7efd201a85c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd20109e60 0x7efd201a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 --2- 10.20.193.28:0/1191847644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd20109490 0x7efd201a1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:54.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 -- 10.20.193.28:0/1191847644 >> 10.20.193.28:0/1191847644 conn(0x7efd20077fe0 msgr2=0x7efd2010d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:54.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 -- 10.20.193.28:0/1191847644 shutdown_connections 2026-02-20T03:20:54.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:20:54.652+0000 7efd1ffff640 1 -- 10.20.193.28:0/1191847644 wait complete. 2026-02-20T03:20:54.836 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:55.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- 10.20.193.28:0/3869297242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109ba0 msgr2=0x7f94b4115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 --2- 10.20.193.28:0/3869297242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109ba0 0x7f94b4115d10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f94b000b0a0 tx=0x7f94b002f450 comp rx=0 tx=0).stop 2026-02-20T03:20:55.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- 10.20.193.28:0/3869297242 shutdown_connections 2026-02-20T03:20:55.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 --2- 10.20.193.28:0/3869297242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109ba0 0x7f94b4115d10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 --2- 10.20.193.28:0/3869297242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b4109220 0x7f94b4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 --2- 10.20.193.28:0/3869297242 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b410eef0 0x7f94b410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- 10.20.193.28:0/3869297242 >> 10.20.193.28:0/3869297242 conn(0x7f94b4078600 msgr2=0x7f94b407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:55.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- 10.20.193.28:0/3869297242 shutdown_connections 2026-02-20T03:20:55.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- 10.20.193.28:0/3869297242 wait complete. 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 Processor -- start 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- start start 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4109ba0 0x7f94b41a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410eef0 0x7f94b41a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f94b41191b0 con 0x7f94b4109220 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4119030 con 0x7f94b4109ba0 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4119330 con 0x7f94b410eef0 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94b9db2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94b9db2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52818/0 (socket says 10.20.193.28:52818) 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94b9db2640 1 -- 10.20.193.28:0/2501648531 learned_addr learned my addr 10.20.193.28:0/2501648531 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94b9db2640 1 -- 10.20.193.28:0/2501648531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410eef0 msgr2=0x7f94b41a5ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:55.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94b9db2640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410eef0 0x7f94b41a5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94b9db2640 1 -- 10.20.193.28:0/2501648531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4109ba0 msgr2=0x7f94b41a1b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:55.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94b9db2640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4109ba0 0x7f94b41a1b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94b9db2640 1 -- 10.20.193.28:0/2501648531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b41a6660 con 0x7f94b4109220 2026-02-20T03:20:55.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94b9db2640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1610 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f94a400b570 tx=0x7f94a400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:55.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94a2ffd640 1 -- 10.20.193.28:0/2501648531 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a4013020 con 0x7f94b4109220 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94badb4640 1 -- 10.20.193.28:0/2501648531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b41a6950 con 0x7f94b4109220 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94a2ffd640 1 -- 10.20.193.28:0/2501648531 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f94a4004480 con 0x7f94b4109220 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.077+0000 7f94a2ffd640 1 -- 10.20.193.28:0/2501648531 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a400fb00 con 0x7f94b4109220 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.081+0000 7f94badb4640 1 -- 10.20.193.28:0/2501648531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b41ae190 con 0x7f94b4109220 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.082+0000 7f94a2ffd640 1 -- 10.20.193.28:0/2501648531 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f94a4002780 con 0x7f94b4109220 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.084+0000 7f94be542e00 1 Processor -- start 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.084+0000 7f94be542e00 1 -- start start 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.084+0000 7f94be542e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b96873e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.084+0000 7f94be542e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9681630 0x55f0b9681a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.084+0000 7f94be542e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681fb0 0x55f0b968de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.084+0000 7f94be542e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f0b9601e50 con 0x55f0b9687000 2026-02-20T03:20:55.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.084+0000 7f94be542e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f0b95d49c0 con 0x55f0b9681630 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.084+0000 7f94be542e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f0b9582240 con 0x55f0b9681fb0 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94ba5b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b96873e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94ba5b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b96873e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52820/0 (socket says 10.20.193.28:52820) 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94ba5b3640 1 -- 10.20.193.28:0/580770518 learned_addr learned my addr 10.20.193.28:0/580770518 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94ba5b3640 1 -- 10.20.193.28:0/580770518 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681fb0 msgr2=0x55f0b968de30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94ba5b3640 1 --2- 10.20.193.28:0/580770518 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681fb0 0x55f0b968de30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94ba5b3640 1 -- 10.20.193.28:0/580770518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9681630 msgr2=0x55f0b9681a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94ba5b3640 1 --2- 10.20.193.28:0/580770518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9681630 0x55f0b9681a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94ba5b3640 1 -- 10.20.193.28:0/580770518 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b9595420 con 0x55f0b9687000 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94ba5b3640 1 --2- 10.20.193.28:0/580770518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b96873e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009850 tx=0x7f94b0009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb2cc8ac05b01b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94a2ffd640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94824e6640 1 -- 10.20.193.28:0/580770518 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0004d40 con 0x55f0b9687000 2026-02-20T03:20:55.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94824e6640 1 -- 10.20.193.28:0/580770518 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f94b0033030 con 0x55f0b9687000 2026-02-20T03:20:55.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94824e6640 1 -- 10.20.193.28:0/580770518 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0002cc0 con 0x55f0b9687000 2026-02-20T03:20:55.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.085+0000 7f94a2ffd640 1 -- 10.20.193.28:0/2501648531 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f94a40e04a0 con 0x7f94b4109220 2026-02-20T03:20:55.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94b9db2640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94be542e00 1 -- 10.20.193.28:0/580770518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 msgr2=0x55f0b96873e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94be542e00 1 --2- 10.20.193.28:0/580770518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b96873e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009850 tx=0x7f94b0009e00 comp rx=0 tx=0).stop 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94be542e00 1 -- 10.20.193.28:0/580770518 shutdown_connections 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94be542e00 1 --2- 10.20.193.28:0/580770518 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681fb0 0x55f0b968de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94be542e00 1 --2- 10.20.193.28:0/580770518 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9681630 0x55f0b9681a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94be542e00 1 --2- 10.20.193.28:0/580770518 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b96873e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94be542e00 1 -- 10.20.193.28:0/580770518 >> 10.20.193.28:0/580770518 conn(0x55f0b9644290 msgr2=0x55f0b967fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94b9db2640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f94a40e0800 tx=0x7f94a4004850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94be542e00 1 -- 10.20.193.28:0/580770518 shutdown_connections 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.086+0000 7f94be542e00 1 -- 10.20.193.28:0/580770518 wait complete. 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94be542e00 1 -- start start 2026-02-20T03:20:55.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94be542e00 1 Processor -- start 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94be542e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681630 0x55f0b969c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94be542e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9681fb0 0x55f0b969c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94be542e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b969a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94be542e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f0b95d08f0 con 0x55f0b9687000 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94be542e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f0b93c2f50 con 0x55f0b9681fb0 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94be542e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f0b969ae70 con 0x55f0b9681630 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94ba5b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b969a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94ba5b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b969a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52824/0 (socket says 10.20.193.28:52824) 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94ba5b3640 1 -- 10.20.193.28:0/1233339475 learned_addr learned my addr 10.20.193.28:0/1233339475 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94ba5b3640 1 -- 10.20.193.28:0/1233339475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681630 msgr2=0x55f0b969c1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:55.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94ba5b3640 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681630 0x55f0b969c1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94ba5b3640 1 -- 10.20.193.28:0/1233339475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9681fb0 msgr2=0x55f0b969c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.088+0000 7f94ba5b3640 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9681fb0 0x55f0b969c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f94ba5b3640 1 -- 10.20.193.28:0/1233339475 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b9693c10 con 0x55f0b9687000 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f94ba5b3640 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b969a8e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f94b0004710 tx=0x7f94b00076b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5ad2dde02a479d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f946b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f946b7fe640 1 -- 10.20.193.28:0/1233339475 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0004910 con 0x55f0b9687000 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f946b7fe640 1 -- 10.20.193.28:0/1233339475 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f94b00096a0 con 0x55f0b9687000 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f946b7fe640 1 -- 10.20.193.28:0/1233339475 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0007b20 con 0x55f0b9687000 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f94be542e00 1 -- 10.20.193.28:0/1233339475 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b93a5b40 con 0x55f0b9687000 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f946b7fe640 1 -- 10.20.193.28:0/1233339475 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f94b0007cc0 con 0x55f0b9687000 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f94be542e00 10 client.16881 _ll_register_callbacks cb 0x55f0b960df00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.089+0000 7f94be542e00 1 -- 10.20.193.28:0/1233339475 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0b95e21a0 con 0x55f0b9687000 2026-02-20T03:20:55.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f946b7fe640 1 -- 10.20.193.28:0/1233339475 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f94b00090d0 con 0x55f0b9687000 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f94be542e00 10 client.16881 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f94be542e00 1 -- 10.20.193.28:0/1233339475 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f0b958f230 con 0x55f0b9687000 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f946b7fe640 1 -- 10.20.193.28:0/1233339475 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f94b0053030 con 0x55f0b9687000 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f94be542e00 10 client.16881 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f94be542e00 10 client.16881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f94be542e00 20 client.16881 populate_metadata read hostname 'trial028' 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f94be542e00 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0b96aa3c0 0x55f0b96ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f94be542e00 4 client.16881 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f94be542e00 1 -- 10.20.193.28:0/1233339475 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0b95dc5b0 con 0x55f0b96aa3c0 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.090+0000 7f94b95b1640 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0b96aa3c0 0x55f0b96ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.091+0000 7f94b95b1640 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0b96aa3c0 0x55f0b96ac7b0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de76c9ea17acd1f8 server_cookie=b97ffc739d312100 in_seq=0 out_seq=0 2026-02-20T03:20:55.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.091+0000 7f946b7fe640 10 client.16881 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.091+0000 7f946b7fe640 1 -- 10.20.193.28:0/1233339475 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f0b95dc5b0 con 0x55f0b96aa3c0 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.091+0000 7f946b7fe640 10 client.16881 handle_command_reply: tid=0 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 client.16881 shutdown 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 -- 10.20.193.28:0/1233339475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 msgr2=0x55f0b969a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b969a8e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f94b0004710 tx=0x7f94b00076b0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 -- 10.20.193.28:0/1233339475 shutdown_connections 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0b96aa3c0 0x55f0b96ac7b0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9687000 0x55f0b969a8e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9681fb0 0x55f0b969c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 --2- 10.20.193.28:0/1233339475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681630 0x55f0b969c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 -- 10.20.193.28:0/1233339475 >> 10.20.193.28:0/1233339475 conn(0x55f0b9644290 msgr2=0x55f0b9680440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:55.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f946b7fe640 0 client.16881 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:55.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 -- 10.20.193.28:0/1233339475 shutdown_connections 2026-02-20T03:20:55.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 1 -- 10.20.193.28:0/1233339475 wait complete. 2026-02-20T03:20:55.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.092+0000 7f94be542e00 20 client.16881 trim_cache size 0 max 16384 2026-02-20T03:20:55.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.095+0000 7f94be542e00 1 Processor -- start 2026-02-20T03:20:55.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.095+0000 7f94be542e00 1 -- start start 2026-02-20T03:20:55.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.095+0000 7f94be542e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b969a400 0x55f0b969c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9644290 0x55f0b96b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681630 0x55f0b96b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9460012600 con 0x55f0b9644290 2026-02-20T03:20:55.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f946000fed0 con 0x55f0b969a400 2026-02-20T03:20:55.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f946000dd20 con 0x55f0b9681630 2026-02-20T03:20:55.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9644290 0x55f0b96b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9644290 0x55f0b96b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52828/0 (socket says 10.20.193.28:52828) 2026-02-20T03:20:55.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 -- 10.20.193.28:0/201843865 learned_addr learned my addr 10.20.193.28:0/201843865 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:55.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 -- 10.20.193.28:0/201843865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681630 msgr2=0x55f0b96b25c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:55.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- 10.20.193.28:0/201843865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681630 0x55f0b96b25c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 -- 10.20.193.28:0/201843865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b969a400 msgr2=0x55f0b969c580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:55.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- 10.20.193.28:0/201843865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b969a400 0x55f0b969c580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 -- 10.20.193.28:0/201843865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b9693a40 con 0x55f0b9644290 2026-02-20T03:20:55.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- 10.20.193.28:0/201843865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9644290 0x55f0b96b2080 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x55f0b9692930 tx=0x7f94a8004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63928ab2c58f04e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:55.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f9481ce5640 1 -- 10.20.193.28:0/201843865 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8015040 con 0x55f0b9644290 2026-02-20T03:20:55.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f9481ce5640 1 -- 10.20.193.28:0/201843865 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55f0b95dc5b0 con 0x55f0b9644290 2026-02-20T03:20:55.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f9481ce5640 1 -- 10.20.193.28:0/201843865 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8013b30 con 0x55f0b9644290 2026-02-20T03:20:55.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- 10.20.193.28:0/201843865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9644290 msgr2=0x55f0b96b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- 10.20.193.28:0/201843865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9644290 0x55f0b96b2080 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x55f0b9692930 tx=0x7f94a8004850 comp rx=0 tx=0).stop 2026-02-20T03:20:55.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- 10.20.193.28:0/201843865 shutdown_connections 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- 10.20.193.28:0/201843865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b9681630 0x55f0b96b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- 10.20.193.28:0/201843865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9644290 0x55f0b96b2080 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- 10.20.193.28:0/201843865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b969a400 0x55f0b969c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- 10.20.193.28:0/201843865 >> 10.20.193.28:0/201843865 conn(0x55f0b9685080 msgr2=0x55f0b969be70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- 10.20.193.28:0/201843865 shutdown_connections 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- 10.20.193.28:0/201843865 wait complete. 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- start start 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 Processor -- start 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9644290 0x55f0b96a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9681630 0x55f0b96a5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b969a400 0x55f0b96a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f946000e390 con 0x55f0b9681630 2026-02-20T03:20:55.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f946000f800 con 0x55f0b9644290 2026-02-20T03:20:55.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f946000ea60 con 0x55f0b969a400 2026-02-20T03:20:55.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9681630 0x55f0b96a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9681630 0x55f0b96a5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52836/0 (socket says 10.20.193.28:52836) 2026-02-20T03:20:55.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 -- 10.20.193.28:0/815184428 learned_addr learned my addr 10.20.193.28:0/815184428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:55.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 -- 10.20.193.28:0/815184428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b969a400 msgr2=0x55f0b96a57b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:55.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b969a400 0x55f0b96a57b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 -- 10.20.193.28:0/815184428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9644290 msgr2=0x55f0b96a6f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:55.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9644290 0x55f0b96a6f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 -- 10.20.193.28:0/815184428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b92b3870 con 0x55f0b9681630 2026-02-20T03:20:55.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94b95b1640 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9681630 0x55f0b96a5270 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f94a8004900 tx=0x7f94a8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a59109f71412bc1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f946b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f946b7fe640 1 -- 10.20.193.28:0/815184428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8029070 con 0x55f0b9681630 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- 10.20.193.28:0/815184428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b9574440 con 0x55f0b9681630 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 10 client.16887 _ll_register_callbacks cb 0x7f94b0009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- 10.20.193.28:0/815184428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0b9586b00 con 0x55f0b9681630 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f946b7fe640 1 -- 10.20.193.28:0/815184428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55f0b9586b00 con 0x55f0b9681630 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f946b7fe640 1 -- 10.20.193.28:0/815184428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8033050 con 0x55f0b9681630 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f946b7fe640 1 -- 10.20.193.28:0/815184428 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f94a801bb00 con 0x55f0b9681630 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f946b7fe640 1 -- 10.20.193.28:0/815184428 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f94a8015040 con 0x55f0b9681630 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 10 client.16887 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- 10.20.193.28:0/815184428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f0b9694730 con 0x55f0b9681630 2026-02-20T03:20:55.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f946b7fe640 1 -- 10.20.193.28:0/815184428 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f94a8013ab0 con 0x55f0b9681630 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 10 client.16887 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 10 client.16887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 20 client.16887 populate_metadata read hostname 'trial028' 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0b9681fb0 0x55f0b9718330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 4 client.16887 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.101+0000 7f94be542e00 1 -- 10.20.193.28:0/815184428 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f94b0033030 con 0x55f0b9681fb0 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.108+0000 7f94ba5b3640 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0b9681fb0 0x55f0b9718330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94ba5b3640 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0b9681fb0 0x55f0b9718330 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52898f51401b7d52 server_cookie=10fce8c65439b35 in_seq=0 out_seq=0 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f946b7fe640 10 client.16887 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f946b7fe640 1 -- 10.20.193.28:0/815184428 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f94b0033030 con 0x55f0b9681fb0 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f946b7fe640 10 client.16887 handle_command_reply: tid=0 2026-02-20T03:20:55.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 client.16887 shutdown 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 -- 10.20.193.28:0/815184428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9681630 msgr2=0x55f0b96a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9681630 0x55f0b96a5270 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f94a8004900 tx=0x7f94a8009310 comp rx=0 tx=0).stop 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 -- 10.20.193.28:0/815184428 shutdown_connections 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f0b9681fb0 0x55f0b9718330 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0b969a400 0x55f0b96a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0b9681630 0x55f0b96a5270 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 --2- 10.20.193.28:0/815184428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0b9644290 0x55f0b96a6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 -- 10.20.193.28:0/815184428 >> 10.20.193.28:0/815184428 conn(0x55f0b9685080 msgr2=0x55f0b96aa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f946b7fe640 0 client.16887 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 -- 10.20.193.28:0/815184428 shutdown_connections 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 1 -- 10.20.193.28:0/815184428 wait complete. 2026-02-20T03:20:55.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.109+0000 7f94be542e00 20 client.16887 trim_cache size 0 max 16384 2026-02-20T03:20:55.116 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:20:55.116 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:20:55.116 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:20:55.116 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:20:55.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 -- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 msgr2=0x7f94900b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f94a40e0800 tx=0x7f94a4004850 comp rx=0 tx=0).stop 2026-02-20T03:20:55.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 -- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 msgr2=0x7f94b41a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1610 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f94a400b570 tx=0x7f94a400ba40 comp rx=0 tx=0).stop 2026-02-20T03:20:55.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 -- 10.20.193.28:0/2501648531 shutdown_connections 2026-02-20T03:20:55.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410eef0 0x7f94b41a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4109ba0 0x7f94b41a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 --2- 10.20.193.28:0/2501648531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4109220 0x7f94b41a1610 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 -- 10.20.193.28:0/2501648531 >> 10.20.193.28:0/2501648531 conn(0x7f94b4078600 msgr2=0x7f94b4079f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:55.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 -- 10.20.193.28:0/2501648531 shutdown_connections 2026-02-20T03:20:55.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.110+0000 7f94badb4640 1 -- 10.20.193.28:0/2501648531 wait complete. 2026-02-20T03:20:55.225 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:55 trial028 ceph-mon[38552]: pgmap v368: 129 pgs: 129 active+clean; 92 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 860 KiB/s rd, 3.2 MiB/s wr, 419 op/s 2026-02-20T03:20:55.304 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:20:55.304 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:20:55.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:55 trial177 ceph-mon[43181]: pgmap v368: 129 pgs: 129 active+clean; 92 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 860 KiB/s rd, 3.2 MiB/s wr, 419 op/s 2026-02-20T03:20:55.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 515629 7.90 MB/sec execute 148 sec latency 1373.111 ms 2026-02-20T03:20:55.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:55 trial126 ceph-mon[38476]: pgmap v368: 129 pgs: 129 active+clean; 92 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 860 KiB/s rd, 3.2 MiB/s wr, 419 op/s 2026-02-20T03:20:55.621 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:55.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- 10.20.193.28:0/3886225231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa941018e0 msgr2=0x7faa941073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 --2- 10.20.193.28:0/3886225231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa941018e0 0x7faa941073c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7faa84009a30 tx=0x7faa8402f220 comp rx=0 tx=0).stop 2026-02-20T03:20:55.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- 10.20.193.28:0/3886225231 shutdown_connections 2026-02-20T03:20:55.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 --2- 10.20.193.28:0/3886225231 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa94107af0 0x7faa9410f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 --2- 10.20.193.28:0/3886225231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa941018e0 0x7faa941073c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 --2- 10.20.193.28:0/3886225231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa94100f30 0x7faa94101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- 10.20.193.28:0/3886225231 >> 10.20.193.28:0/3886225231 conn(0x7faa94078230 msgr2=0x7faa94078640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:55.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- 10.20.193.28:0/3886225231 shutdown_connections 2026-02-20T03:20:55.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- 10.20.193.28:0/3886225231 wait complete. 2026-02-20T03:20:55.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 Processor -- start 2026-02-20T03:20:55.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- start start 2026-02-20T03:20:55.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa94100f30 0x7faa9419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa941018e0 0x7faa9419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa94107af0 0x7faa941a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa94112a00 con 0x7faa94100f30 2026-02-20T03:20:55.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faa94112880 con 0x7faa94107af0 2026-02-20T03:20:55.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa94112b80 con 0x7faa941018e0 2026-02-20T03:20:55.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa94100f30 0x7faa9419d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa94100f30 0x7faa9419d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52840/0 (socket says 10.20.193.28:52840) 2026-02-20T03:20:55.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa937fe640 1 -- 10.20.193.28:0/1508687312 learned_addr learned my addr 10.20.193.28:0/1508687312 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:55.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa937fe640 1 -- 10.20.193.28:0/1508687312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa941018e0 msgr2=0x7faa9419d650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:55.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa937fe640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa941018e0 0x7faa9419d650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa937fe640 1 -- 10.20.193.28:0/1508687312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa94107af0 msgr2=0x7faa941a19e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa937fe640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa94107af0 0x7faa941a19e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa937fe640 1 -- 10.20.193.28:0/1508687312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa941a2160 con 0x7faa94100f30 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa937fe640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa94100f30 0x7faa9419d110 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c970 tx=0x7faa8000ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa90ff9640 1 -- 10.20.193.28:0/1508687312 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80007c50 con 0x7faa94100f30 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa90ff9640 1 -- 10.20.193.28:0/1508687312 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faa80007df0 con 0x7faa94100f30 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa90ff9640 1 -- 10.20.193.28:0/1508687312 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa800188e0 con 0x7faa94100f30 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa941a2450 con 0x7faa94100f30 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa941a9c90 con 0x7faa94100f30 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa94101310 con 0x7faa94100f30 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.867+0000 7faa90ff9640 1 -- 10.20.193.28:0/1508687312 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7faa80020030 con 0x7faa94100f30 2026-02-20T03:20:55.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.873+0000 7faa90ff9640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa680b0e20 0x7faa680b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:55.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.873+0000 7faa90ff9640 1 -- 10.20.193.28:0/1508687312 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7faa800e0ba0 con 0x7faa94100f30 2026-02-20T03:20:55.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.874+0000 7faa90ff9640 1 -- 10.20.193.28:0/1508687312 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7faa80014030 con 0x7faa94100f30 2026-02-20T03:20:55.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.874+0000 7faa92ffd640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa680b0e20 0x7faa680b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:55.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.874+0000 7faa92ffd640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa680b0e20 0x7faa680b32e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faa84009950 tx=0x7faa840023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:55.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.983+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa9419e470 con 0x7faa94100f30 2026-02-20T03:20:55.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.983+0000 7faa90ff9640 1 -- 10.20.193.28:0/1508687312 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7faa800a9000 con 0x7faa94100f30 2026-02-20T03:20:55.991 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:20:55.991 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:20:55.992 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:20:55.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa680b0e20 msgr2=0x7faa680b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa680b0e20 0x7faa680b32e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faa84009950 tx=0x7faa840023d0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa94100f30 msgr2=0x7faa9419d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa94100f30 0x7faa9419d110 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7faa8000c970 tx=0x7faa8000ce40 comp rx=0 tx=0).stop 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 shutdown_connections 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa680b0e20 0x7faa680b32e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa94107af0 0x7faa941a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa941018e0 0x7faa9419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 --2- 10.20.193.28:0/1508687312 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa94100f30 0x7faa9419d110 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 >> 10.20.193.28:0/1508687312 conn(0x7faa94078230 msgr2=0x7faa940ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 shutdown_connections 2026-02-20T03:20:55.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:55.984+0000 7faa98823640 1 -- 10.20.193.28:0/1508687312 wait complete. 2026-02-20T03:20:56.137 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:20:56.285 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:56 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1508687312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:20:56.418 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:56.506 INFO:tasks.workunit.client.0.trial028.stdout: 1 516048 7.86 MB/sec execute 149 sec latency 2192.656 ms 2026-02-20T03:20:56.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:56 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1508687312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:20:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.599+0000 7f000afe1640 1 -- 10.20.193.28:0/4033935529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0004105320 msgr2=0x7f0004111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.599+0000 7f000afe1640 1 --2- 10.20.193.28:0/4033935529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0004105320 0x7f0004111850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f000000b0d0 tx=0x7f000002f450 comp rx=0 tx=0).stop 2026-02-20T03:20:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.599+0000 7f000afe1640 1 -- 10.20.193.28:0/4033935529 shutdown_connections 2026-02-20T03:20:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.599+0000 7f000afe1640 1 --2- 10.20.193.28:0/4033935529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0004105320 0x7f0004111850 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.599+0000 7f000afe1640 1 --2- 10.20.193.28:0/4033935529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0004104980 0x7f0004104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.599+0000 7f000afe1640 1 --2- 10.20.193.28:0/4033935529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f000410a980 0x7f000410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.599+0000 7f000afe1640 1 -- 10.20.193.28:0/4033935529 >> 10.20.193.28:0/4033935529 conn(0x7f0004100680 msgr2=0x7f0004102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.600+0000 7f000afe1640 1 -- 10.20.193.28:0/4033935529 shutdown_connections 2026-02-20T03:20:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.600+0000 7f000afe1640 1 -- 10.20.193.28:0/4033935529 wait complete. 2026-02-20T03:20:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.600+0000 7f000afe1640 1 Processor -- start 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.600+0000 7f000afe1640 1 -- start start 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f000afe1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0004104980 0x7f0004074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f000afe1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0004105320 0x7f0004074b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f000afe1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f000410a980 0x7f000406d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f000afe1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0004114ba0 con 0x7f0004104980 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f000afe1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0004114a20 con 0x7f000410a980 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f0009fdf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0004104980 0x7f0004074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f000afe1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0004114d20 con 0x7f0004105320 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f0009fdf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0004104980 0x7f0004074620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36876/0 (socket says 10.20.193.28:36876) 2026-02-20T03:20:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f0009fdf640 1 -- 10.20.193.28:0/3897252358 learned_addr learned my addr 10.20.193.28:0/3897252358 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f00097de640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0004105320 0x7f0004074b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.601+0000 7f000a7e0640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f000410a980 0x7f000406d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7f0009fdf640 1 -- 10.20.193.28:0/3897252358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0004105320 msgr2=0x7f0004074b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7f0009fdf640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0004105320 0x7f0004074b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7f0009fdf640 1 -- 10.20.193.28:0/3897252358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f000410a980 msgr2=0x7f000406d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7f0009fdf640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f000410a980 0x7f000406d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7f0009fdf640 1 -- 10.20.193.28:0/3897252358 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000406dff0 con 0x7f0004104980 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7f000a7e0640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f000410a980 0x7f000406d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7f0009fdf640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0004104980 0x7f0004074620 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efff400ea10 tx=0x7efff400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7efff2ffd640 1 -- 10.20.193.28:0/3897252358 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff400ce50 con 0x7f0004104980 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7f000afe1640 1 -- 10.20.193.28:0/3897252358 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000406e2e0 con 0x7f0004104980 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7efff2ffd640 1 -- 10.20.193.28:0/3897252358 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efff4004570 con 0x7f0004104980 2026-02-20T03:20:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7efff2ffd640 1 -- 10.20.193.28:0/3897252358 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4010690 con 0x7f0004104980 2026-02-20T03:20:56.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.602+0000 7f000afe1640 1 -- 10.20.193.28:0/3897252358 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0004072320 con 0x7f0004104980 2026-02-20T03:20:56.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.605+0000 7efff2ffd640 1 -- 10.20.193.28:0/3897252358 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efff40027e0 con 0x7f0004104980 2026-02-20T03:20:56.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.605+0000 7f000e76fe00 1 Processor -- start 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000e76fe00 1 -- start start 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bbd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 0x55f438bb7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bc3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000e76fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f438b37e00 con 0x55f438bbcfb0 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000e76fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f438b0a970 con 0x55f438bb75e0 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000e76fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f438ab81f0 con 0x55f438bb7f60 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000a7e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bbd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f00097de640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bc3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f0009fdf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 0x55f438bb7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000a7e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bbd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36884/0 (socket says 10.20.193.28:36884) 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.606+0000 7f000a7e0640 1 -- 10.20.193.28:0/4145703379 learned_addr learned my addr 10.20.193.28:0/4145703379 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7f000a7e0640 1 -- 10.20.193.28:0/4145703379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 msgr2=0x55f438bc3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7f000a7e0640 1 --2- 10.20.193.28:0/4145703379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bc3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7f000a7e0640 1 -- 10.20.193.28:0/4145703379 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 msgr2=0x55f438bb7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7f000a7e0640 1 --2- 10.20.193.28:0/4145703379 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 0x55f438bb7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7f000a7e0640 1 -- 10.20.193.28:0/4145703379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f438acb3d0 con 0x55f438bbcfb0 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7efff2ffd640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7effe00b0fc0 0x7effe00b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7f000a7e0640 1 --2- 10.20.193.28:0/4145703379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bbd390 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0000006130 tx=0x7f0000005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4f12cf237e1dd9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7effd24e6640 1 -- 10.20.193.28:0/4145703379 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00000090d0 con 0x55f438bbcfb0 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7efff2ffd640 1 -- 10.20.193.28:0/3897252358 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efff40e0f70 con 0x7f0004104980 2026-02-20T03:20:56.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7effd24e6640 1 -- 10.20.193.28:0/4145703379 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0000033030 con 0x55f438bbcfb0 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7effd24e6640 1 -- 10.20.193.28:0/4145703379 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000004900 con 0x55f438bbcfb0 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7f0009fdf640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7effe00b0fc0 0x7effe00b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7f000e76fe00 1 -- 10.20.193.28:0/4145703379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 msgr2=0x55f438bbd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.607+0000 7f000e76fe00 1 --2- 10.20.193.28:0/4145703379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bbd390 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0000006130 tx=0x7f0000005be0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.608+0000 7f000e76fe00 1 -- 10.20.193.28:0/4145703379 shutdown_connections 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.608+0000 7f000e76fe00 1 --2- 10.20.193.28:0/4145703379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bc3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.608+0000 7f000e76fe00 1 --2- 10.20.193.28:0/4145703379 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 0x55f438bb7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.608+0000 7f000e76fe00 1 --2- 10.20.193.28:0/4145703379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bbd390 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.608+0000 7f000e76fe00 1 -- 10.20.193.28:0/4145703379 >> 10.20.193.28:0/4145703379 conn(0x55f438b7a240 msgr2=0x55f438bb5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.608+0000 7f000e76fe00 1 -- 10.20.193.28:0/4145703379 shutdown_connections 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.608+0000 7f000e76fe00 1 -- 10.20.193.28:0/4145703379 wait complete. 2026-02-20T03:20:56.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.608+0000 7f0009fdf640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7effe00b0fc0 0x7effe00b3480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efff40e1210 tx=0x7efff40023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:56.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.609+0000 7f000e76fe00 1 -- start start 2026-02-20T03:20:56.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.609+0000 7f000e76fe00 1 Processor -- start 2026-02-20T03:20:56.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.609+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 0x55f438bda520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.609+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdaa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.609+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bd8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.609+0000 7f000e76fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f438b068a0 con 0x55f438bbcfb0 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.609+0000 7f000e76fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f4388f8f50 con 0x55f438bb75e0 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.609+0000 7f000e76fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f438bd93e0 con 0x55f438bb7f60 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f00097de640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f000a7e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bd8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f00097de640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:35726/0 (socket says 10.20.193.28:35726) 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f00097de640 1 -- 10.20.193.28:0/2367975258 learned_addr learned my addr 10.20.193.28:0/2367975258 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f000a7e0640 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 0x55f438bda520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f00097de640 1 -- 10.20.193.28:0/2367975258 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 msgr2=0x55f438bda520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:56.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f00097de640 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 0x55f438bda520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f00097de640 1 -- 10.20.193.28:0/2367975258 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 msgr2=0x55f438bd8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f00097de640 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bd8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f00097de640 1 -- 10.20.193.28:0/2367975258 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f438bd2400 con 0x55f438bb7f60 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f000a7e0640 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bd8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7f00097de640 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdaa60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efff8009d20 tx=0x7efff8002ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dd70dc1cc35f8fe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.610+0000 7effbf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7effbf7fe640 1 -- 10.20.193.28:0/2367975258 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8012540 con 0x55f438bb7f60 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7effbf7fe640 1 -- 10.20.193.28:0/2367975258 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efff8012b80 con 0x55f438bb7f60 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 1 -- 10.20.193.28:0/2367975258 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4388dbb40 con 0x55f438bb7f60 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7effbf7fe640 1 -- 10.20.193.28:0/2367975258 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8010d40 con 0x55f438bb7f60 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7effbf7fe640 1 -- 10.20.193.28:0/2367975258 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efff801c420 con 0x55f438bb7f60 2026-02-20T03:20:56.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 10 client.26509 _ll_register_callbacks cb 0x55f438b43eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 1 -- 10.20.193.28:0/2367975258 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f438b18150 con 0x55f438bb7f60 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7effbf7fe640 1 -- 10.20.193.28:0/2367975258 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efff80105c0 con 0x55f438bb7f60 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 10 client.26509 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 1 -- 10.20.193.28:0/2367975258 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f438ac51e0 con 0x55f438bb7f60 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7effbf7fe640 1 -- 10.20.193.28:0/2367975258 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efff80126e0 con 0x55f438bb7f60 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 10 client.26509 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 10 client.26509 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 20 client.26509 populate_metadata read hostname 'trial028' 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f438be8d40 0x55f438beb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 4 client.26509 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.611+0000 7f000e76fe00 1 -- 10.20.193.28:0/2367975258 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f438b12560 con 0x55f438be8d40 2026-02-20T03:20:56.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.612+0000 7f000a7e0640 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f438be8d40 0x55f438beb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.612+0000 7f000a7e0640 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f438be8d40 0x55f438beb200 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a7dfea229b8c0edc server_cookie=d60d31aba03e8a20 in_seq=0 out_seq=0 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.612+0000 7effbf7fe640 10 client.26509 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7effbf7fe640 1 -- 10.20.193.28:0/2367975258 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f438b12560 con 0x55f438be8d40 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7effbf7fe640 10 client.26509 handle_command_reply: tid=0 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 client.26509 shutdown 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 -- 10.20.193.28:0/2367975258 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 msgr2=0x55f438bdaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdaa60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efff8009d20 tx=0x7efff8002ab0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 -- 10.20.193.28:0/2367975258 shutdown_connections 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f438be8d40 0x55f438beb200 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bbcfb0 0x55f438bd8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7effbf7fe640 0 client.26509 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:20:56.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdaa60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2367975258 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb75e0 0x55f438bda520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 -- 10.20.193.28:0/2367975258 >> 10.20.193.28:0/2367975258 conn(0x55f438b7a240 msgr2=0x55f438bb63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 -- 10.20.193.28:0/2367975258 shutdown_connections 2026-02-20T03:20:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 1 -- 10.20.193.28:0/2367975258 wait complete. 2026-02-20T03:20:56.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.613+0000 7f000e76fe00 20 client.26509 trim_cache size 0 max 16384 2026-02-20T03:20:56.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.620+0000 7f000e76fe00 1 Processor -- start 2026-02-20T03:20:56.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.620+0000 7f000e76fe00 1 -- start start 2026-02-20T03:20:56.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bafd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb7f60 0x55f438bf0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bbcfb0 0x55f438bf1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000e76fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7effb0012670 con 0x55f438bb75e0 2026-02-20T03:20:56.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000e76fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7effb000ff40 con 0x55f438bb7f60 2026-02-20T03:20:56.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000e76fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7effb000dd90 con 0x55f438bbcfb0 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bbcfb0 0x55f438bf1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bafd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bafd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36904/0 (socket says 10.20.193.28:36904) 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 -- 10.20.193.28:0/2608985866 learned_addr learned my addr 10.20.193.28:0/2608985866 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 -- 10.20.193.28:0/2608985866 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bbcfb0 msgr2=0x55f438bf1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 --2- 10.20.193.28:0/2608985866 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bbcfb0 0x55f438bf1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 -- 10.20.193.28:0/2608985866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb7f60 msgr2=0x55f438bf0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 --2- 10.20.193.28:0/2608985866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb7f60 0x55f438bf0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 -- 10.20.193.28:0/2608985866 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f438bd2230 con 0x55f438bb75e0 2026-02-20T03:20:56.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.621+0000 7f000a7e0640 1 --2- 10.20.193.28:0/2608985866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bafd00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0000005bb0 tx=0x7f00000047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cd01b54b247115 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7effd1ce5640 1 -- 10.20.193.28:0/2608985866 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00000093e0 con 0x55f438bb75e0 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7effd1ce5640 1 -- 10.20.193.28:0/2608985866 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0000046040 con 0x55f438bb75e0 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7effd1ce5640 1 -- 10.20.193.28:0/2608985866 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000002d70 con 0x55f438bb75e0 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7f000e76fe00 1 -- 10.20.193.28:0/2608985866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 msgr2=0x55f438bafd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2608985866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bafd00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0000005bb0 tx=0x7f00000047f0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7f000e76fe00 1 -- 10.20.193.28:0/2608985866 shutdown_connections 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2608985866 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bbcfb0 0x55f438bf1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2608985866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bb7f60 0x55f438bf0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7f000e76fe00 1 --2- 10.20.193.28:0/2608985866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bafd00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7f000e76fe00 1 -- 10.20.193.28:0/2608985866 >> 10.20.193.28:0/2608985866 conn(0x55f438b7a240 msgr2=0x55f438bd53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7f000e76fe00 1 -- 10.20.193.28:0/2608985866 shutdown_connections 2026-02-20T03:20:56.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.622+0000 7f000e76fe00 1 -- 10.20.193.28:0/2608985866 wait complete. 2026-02-20T03:20:56.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000e76fe00 1 -- start start 2026-02-20T03:20:56.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000e76fe00 1 Processor -- start 2026-02-20T03:20:56.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000e76fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bdd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000a7e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bdd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000a7e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bdd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36910/0 (socket says 10.20.193.28:36910) 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000a7e0640 1 -- 10.20.193.28:0/1174969815 learned_addr learned my addr 10.20.193.28:0/1174969815 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000e76fe00 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000e76fe00 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bbcfb0 0x55f438c53cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7effb000e400 con 0x55f438bb75e0 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7effb000f870 con 0x55f438bbcfb0 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.623+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7effb000ead0 con 0x55f438bb7f60 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7f00097de640 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7f000a7e0640 1 -- 10.20.193.28:0/1174969815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 msgr2=0x55f438bdde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:56.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7f000a7e0640 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7f000a7e0640 1 -- 10.20.193.28:0/1174969815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bbcfb0 msgr2=0x55f438c53cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7f000a7e0640 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bbcfb0 0x55f438c53cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7f000a7e0640 1 -- 10.20.193.28:0/1174969815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4387e9870 con 0x55f438bb75e0 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7f000a7e0640 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bdd930 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0000009e60 tx=0x7f0000005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69076a1a2771ad7e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7effbf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7effbf7fe640 1 -- 10.20.193.28:0/1174969815 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00000044b0 con 0x55f438bb75e0 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7effbf7fe640 1 -- 10.20.193.28:0/1174969815 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0000033070 con 0x55f438bb75e0 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7effbf7fe640 1 -- 10.20.193.28:0/1174969815 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000007ac0 con 0x55f438bb75e0 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f438aaa3f0 con 0x55f438bb75e0 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7effbf7fe640 1 -- 10.20.193.28:0/1174969815 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f0000007c60 con 0x55f438bb75e0 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.624+0000 7effbf7fe640 10 client.16911 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 10 client.16911 _ll_register_callbacks cb 0x7efff80041e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:56.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f438abcab0 con 0x55f438bb75e0 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7effbf7fe640 1 -- 10.20.193.28:0/1174969815 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0000007e60 con 0x55f438bb75e0 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 10 client.16911 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f438bd2f20 con 0x55f438bb75e0 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7effbf7fe640 1 -- 10.20.193.28:0/1174969815 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f000004b040 con 0x55f438bb75e0 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 10 client.16911 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 10 client.16911 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 20 client.16911 populate_metadata read hostname 'trial028' 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f438be8d40 0x55f438c56f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 4 client.16911 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0000046040 con 0x55f438be8d40 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.625+0000 7f00097de640 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f438be8d40 0x55f438c56f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:56.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.626+0000 7f00097de640 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f438be8d40 0x55f438c56f90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=512dde6370108d21 server_cookie=e57a41c4e5024dd2 in_seq=0 out_seq=0 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.626+0000 7effbf7fe640 10 client.16911 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.626+0000 7effbf7fe640 1 -- 10.20.193.28:0/1174969815 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0000046040 con 0x55f438be8d40 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.626+0000 7effbf7fe640 10 client.16911 handle_command_reply: tid=0 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.626+0000 7f000e76fe00 1 client.16911 shutdown 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.626+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 msgr2=0x55f438bdd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.626+0000 7f000e76fe00 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bdd930 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0000009e60 tx=0x7f0000005be0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 shutdown_connections 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000e76fe00 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f438bbcfb0 0x55f438c53cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000e76fe00 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f438bb7f60 0x55f438bdde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000e76fe00 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f438be8d40 0x55f438c56f90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000e76fe00 1 --2- 10.20.193.28:0/1174969815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f438bb75e0 0x55f438bdd930 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 >> 10.20.193.28:0/1174969815 conn(0x55f438b7a240 msgr2=0x55f438bd5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:56.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7effbf7fe640 0 client.16911 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:20:56.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 shutdown_connections 2026-02-20T03:20:56.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000e76fe00 1 -- 10.20.193.28:0/1174969815 wait complete. 2026-02-20T03:20:56.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000e76fe00 20 client.16911 trim_cache size 0 max 16384 2026-02-20T03:20:56.635 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:20:56.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 -- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7effe00b0fc0 msgr2=0x7effe00b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:56.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7effe00b0fc0 0x7effe00b3480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efff40e1210 tx=0x7efff40023d0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 -- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0004104980 msgr2=0x7f0004074620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:56.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0004104980 0x7f0004074620 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7efff400ea10 tx=0x7efff400eee0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 -- 10.20.193.28:0/3897252358 shutdown_connections 2026-02-20T03:20:56.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7effe00b0fc0 0x7effe00b3480 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f000410a980 0x7f000406d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0004105320 0x7f0004074b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 --2- 10.20.193.28:0/3897252358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0004104980 0x7f0004074620 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:56.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.627+0000 7f000afe1640 1 -- 10.20.193.28:0/3897252358 >> 10.20.193.28:0/3897252358 conn(0x7f0004100680 msgr2=0x7f0004101d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:56.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.628+0000 7f000afe1640 1 -- 10.20.193.28:0/3897252358 shutdown_connections 2026-02-20T03:20:56.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:56.628+0000 7f000afe1640 1 -- 10.20.193.28:0/3897252358 wait complete. 2026-02-20T03:20:56.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:56 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1508687312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:20:56.727 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:20:56.995 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:57.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 -- 10.20.193.28:0/2337380995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd00077f40 msgr2=0x7efd001132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 --2- 10.20.193.28:0/2337380995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd00077f40 0x7efd001132e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efce8009a30 tx=0x7efce802f240 comp rx=0 tx=0).stop 2026-02-20T03:20:57.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 -- 10.20.193.28:0/2337380995 shutdown_connections 2026-02-20T03:20:57.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 --2- 10.20.193.28:0/2337380995 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd00113820 0x7efd00115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 --2- 10.20.193.28:0/2337380995 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd00077f40 0x7efd001132e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 --2- 10.20.193.28:0/2337380995 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd00077620 0x7efd00077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 -- 10.20.193.28:0/2337380995 >> 10.20.193.28:0/2337380995 conn(0x7efd00100680 msgr2=0x7efd00102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 -- 10.20.193.28:0/2337380995 shutdown_connections 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 -- 10.20.193.28:0/2337380995 wait complete. 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.199+0000 7efcff577640 1 Processor -- start 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcff577640 1 -- start start 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcff577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd00077620 0x7efd001a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcff577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd00077f40 0x7efd001a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcff577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd00113820 0x7efd001a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcff577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efd00119120 con 0x7efd00077f40 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcff577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efd00118fa0 con 0x7efd00077620 2026-02-20T03:20:57.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcff577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efd001192a0 con 0x7efd00113820 2026-02-20T03:20:57.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcfe575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd00077620 0x7efd001a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcfe575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd00077620 0x7efd001a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42496/0 (socket says 10.20.193.28:42496) 2026-02-20T03:20:57.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcfe575640 1 -- 10.20.193.28:0/565795654 learned_addr learned my addr 10.20.193.28:0/565795654 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:57.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcfdd74640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd00077f40 0x7efd001a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.200+0000 7efcfed76640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd00113820 0x7efd001a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efcfdd74640 1 -- 10.20.193.28:0/565795654 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd00113820 msgr2=0x7efd001a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efcfdd74640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd00113820 0x7efd001a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efcfdd74640 1 -- 10.20.193.28:0/565795654 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd00077620 msgr2=0x7efd001a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efcfdd74640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd00077620 0x7efd001a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efcfdd74640 1 -- 10.20.193.28:0/565795654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd001a6670 con 0x7efd00077f40 2026-02-20T03:20:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efcfdd74640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd00077f40 0x7efd001a1b60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efce802f750 tx=0x7efce802fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efce77fe640 1 -- 10.20.193.28:0/565795654 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce802fe40 con 0x7efd00077f40 2026-02-20T03:20:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efce77fe640 1 -- 10.20.193.28:0/565795654 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efce8005030 con 0x7efd00077f40 2026-02-20T03:20:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efce77fe640 1 -- 10.20.193.28:0/565795654 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce8004c70 con 0x7efd00077f40 2026-02-20T03:20:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.201+0000 7efcff577640 1 -- 10.20.193.28:0/565795654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd001a6900 con 0x7efd00077f40 2026-02-20T03:20:57.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.202+0000 7efcff577640 1 -- 10.20.193.28:0/565795654 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd001ae1a0 con 0x7efd00077f40 2026-02-20T03:20:57.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efd06ff0e00 1 Processor -- start 2026-02-20T03:20:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efd06ff0e00 1 -- start start 2026-02-20T03:20:57.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb6449d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb64497a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb64497f60 0x55fb644a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fb64417e00 con 0x55fb644975e0 2026-02-20T03:20:57.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fb643ea970 con 0x55fb64497f60 2026-02-20T03:20:57.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fb643981f0 con 0x55fb6449cfb0 2026-02-20T03:20:57.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efcfe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb64497a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efcfe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb64497a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36938/0 (socket says 10.20.193.28:36938) 2026-02-20T03:20:57.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efcfe575640 1 -- 10.20.193.28:0/2352246801 learned_addr learned my addr 10.20.193.28:0/2352246801 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.206+0000 7efce77fe640 1 -- 10.20.193.28:0/565795654 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efce8004280 con 0x7efd00077f40 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efcfe575640 1 -- 10.20.193.28:0/2352246801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 msgr2=0x55fb6449d390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efcfe575640 1 --2- 10.20.193.28:0/2352246801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb6449d390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efcfe575640 1 -- 10.20.193.28:0/2352246801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb64497f60 msgr2=0x55fb644a3de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efcfe575640 1 --2- 10.20.193.28:0/2352246801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb64497f60 0x55fb644a3de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efcfe575640 1 -- 10.20.193.28:0/2352246801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb643ab3d0 con 0x55fb644975e0 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efcfe575640 1 --2- 10.20.193.28:0/2352246801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb64497a20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efcf4004710 tx=0x7efcf400abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b6715660bf64e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efce4cf3640 1 -- 10.20.193.28:0/2352246801 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4019670 con 0x55fb644975e0 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efce4cf3640 1 -- 10.20.193.28:0/2352246801 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efcf4014070 con 0x55fb644975e0 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efce4cf3640 1 -- 10.20.193.28:0/2352246801 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf40109a0 con 0x55fb644975e0 2026-02-20T03:20:57.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efd06ff0e00 1 -- 10.20.193.28:0/2352246801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 msgr2=0x55fb64497a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.207+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/2352246801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb64497a20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efcf4004710 tx=0x7efcf400abf0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efd06ff0e00 1 -- 10.20.193.28:0/2352246801 shutdown_connections 2026-02-20T03:20:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/2352246801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb64497f60 0x55fb644a3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/2352246801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb64497a20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/2352246801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb6449d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efd06ff0e00 1 -- 10.20.193.28:0/2352246801 >> 10.20.193.28:0/2352246801 conn(0x55fb6445a240 msgr2=0x55fb64495ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efd06ff0e00 1 -- 10.20.193.28:0/2352246801 shutdown_connections 2026-02-20T03:20:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efd06ff0e00 1 -- 10.20.193.28:0/2352246801 wait complete. 2026-02-20T03:20:57.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efce77fe640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcd80b0d80 0x7efcd80b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efce77fe640 1 -- 10.20.193.28:0/565795654 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efce8104960 con 0x7efd00077f40 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.208+0000 7efcfe575640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcd80b0d80 0x7efcd80b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.209+0000 7efcfe575640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcd80b0d80 0x7efcd80b3240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efcf400a2a0 tx=0x7efcf4012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.209+0000 7efd06ff0e00 1 -- start start 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.209+0000 7efd06ff0e00 1 Processor -- start 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.209+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb644b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.209+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb64497f60 0x55fb644b2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.209+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb644b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.209+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fb643e68a0 con 0x55fb644975e0 2026-02-20T03:20:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.209+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fb641d8f50 con 0x55fb64497f60 2026-02-20T03:20:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.209+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fb644b0a90 con 0x55fb6449cfb0 2026-02-20T03:20:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcfe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb644b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcfe575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb644b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36946/0 (socket says 10.20.193.28:36946) 2026-02-20T03:20:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcfe575640 1 -- 10.20.193.28:0/1468404539 learned_addr learned my addr 10.20.193.28:0/1468404539 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcfe575640 1 -- 10.20.193.28:0/1468404539 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 msgr2=0x55fb644b0310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcfe575640 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb644b0310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcfe575640 1 -- 10.20.193.28:0/1468404539 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb64497f60 msgr2=0x55fb644b2110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcfe575640 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb64497f60 0x55fb644b2110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcfe575640 1 -- 10.20.193.28:0/1468404539 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb644a9ad0 con 0x55fb644975e0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcfe575640 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb644b1bd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efcf4018000 tx=0x7efcf400abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12822e5df75c9ad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.210+0000 7efcaffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efcaffff640 1 -- 10.20.193.28:0/1468404539 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4036070 con 0x55fb644975e0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 1 -- 10.20.193.28:0/1468404539 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb641bbb40 con 0x55fb644975e0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efcaffff640 1 -- 10.20.193.28:0/1468404539 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efcf4021070 con 0x55fb644975e0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efcaffff640 1 -- 10.20.193.28:0/1468404539 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4031410 con 0x55fb644975e0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 10 client.16923 _ll_register_callbacks cb 0x55fb64423eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 1 -- 10.20.193.28:0/1468404539 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb643f8150 con 0x55fb644975e0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efcaffff640 1 -- 10.20.193.28:0/1468404539 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efcf403a3f0 con 0x55fb644975e0 2026-02-20T03:20:57.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efcaffff640 1 -- 10.20.193.28:0/1468404539 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efcf403a670 con 0x55fb644975e0 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 10 client.16923 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 1 -- 10.20.193.28:0/1468404539 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55fb643a51e0 con 0x55fb644975e0 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efcaffff640 1 -- 10.20.193.28:0/1468404539 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efcf4010cc0 con 0x55fb644975e0 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 10 client.16923 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 10 client.16923 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 20 client.16923 populate_metadata read hostname 'trial028' 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55fb644c0370 0x55fb644c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 4 client.16923 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.211+0000 7efd06ff0e00 1 -- 10.20.193.28:0/1468404539 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb643f2560 con 0x55fb644c0370 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.218+0000 7efcfdd74640 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55fb644c0370 0x55fb644c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.218+0000 7efcfdd74640 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55fb644c0370 0x55fb644c2760 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9e3dbc45d532ac18 server_cookie=6d2553b1269f7c5d in_seq=0 out_seq=0 2026-02-20T03:20:57.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.218+0000 7efcaffff640 10 client.16923 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:20:57.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efcaffff640 1 -- 10.20.193.28:0/1468404539 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fb643f2560 con 0x55fb644c0370 2026-02-20T03:20:57.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efcaffff640 10 client.16923 handle_command_reply: tid=0 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efd06ff0e00 1 client.16923 shutdown 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efd06ff0e00 1 -- 10.20.193.28:0/1468404539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 msgr2=0x55fb644b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb644b1bd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7efcf4018000 tx=0x7efcf400abf0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efd06ff0e00 1 -- 10.20.193.28:0/1468404539 shutdown_connections 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55fb644c0370 0x55fb644c2760 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb644b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb64497f60 0x55fb644b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/1468404539 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb644975e0 0x55fb644b1bd0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efd06ff0e00 1 -- 10.20.193.28:0/1468404539 >> 10.20.193.28:0/1468404539 conn(0x55fb6445a240 msgr2=0x55fb644963f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.219+0000 7efcaffff640 0 client.16923 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:20:57.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.220+0000 7efd06ff0e00 1 -- 10.20.193.28:0/1468404539 shutdown_connections 2026-02-20T03:20:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.220+0000 7efd06ff0e00 1 -- 10.20.193.28:0/1468404539 wait complete. 2026-02-20T03:20:57.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.220+0000 7efd06ff0e00 20 client.16923 trim_cache size 0 max 16384 2026-02-20T03:20:57.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.227+0000 7efd06ff0e00 1 Processor -- start 2026-02-20T03:20:57.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.227+0000 7efd06ff0e00 1 -- start start 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb644975e0 0x55fb6449a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb6449cfb0 0x55fb64496a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efca4012770 con 0x55fb64497f60 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efca4010040 con 0x55fb6449cfb0 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efca400de90 con 0x55fb644975e0 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfe575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb644975e0 0x55fb6449a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfdd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfed76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb6449cfb0 0x55fb64496a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfed76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb6449cfb0 0x55fb64496a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42538/0 (socket says 10.20.193.28:42538) 2026-02-20T03:20:57.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfed76640 1 -- 10.20.193.28:0/3204229625 learned_addr learned my addr 10.20.193.28:0/3204229625 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfdd74640 1 -- 10.20.193.28:0/3204229625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb644975e0 msgr2=0x55fb6449a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfdd74640 1 --2- 10.20.193.28:0/3204229625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb644975e0 0x55fb6449a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfdd74640 1 -- 10.20.193.28:0/3204229625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb6449cfb0 msgr2=0x55fb64496a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfdd74640 1 --2- 10.20.193.28:0/3204229625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb6449cfb0 0x55fb64496a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.228+0000 7efcfdd74640 1 -- 10.20.193.28:0/3204229625 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb644a9900 con 0x55fb64497f60 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.229+0000 7efcfed76640 1 --2- 10.20.193.28:0/3204229625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb6449cfb0 0x55fb64496a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.229+0000 7efcfe575640 1 --2- 10.20.193.28:0/3204229625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb644975e0 0x55fb6449a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.229+0000 7efcfdd74640 1 --2- 10.20.193.28:0/3204229625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644964d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55fb644a87f0 tx=0x7efce8101ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f0aaf53d0f21d4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.229+0000 7efcca4e6640 1 -- 10.20.193.28:0/3204229625 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce80d09f0 con 0x55fb64497f60 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.229+0000 7efcca4e6640 1 -- 10.20.193.28:0/3204229625 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efce80f1030 con 0x55fb64497f60 2026-02-20T03:20:57.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.229+0000 7efcca4e6640 1 -- 10.20.193.28:0/3204229625 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce80d5670 con 0x55fb64497f60 2026-02-20T03:20:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.229+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3204229625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 msgr2=0x55fb644964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.229+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3204229625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644964d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x55fb644a87f0 tx=0x7efce8101ea0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.230+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3204229625 shutdown_connections 2026-02-20T03:20:57.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.230+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3204229625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb6449cfb0 0x55fb64496a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.230+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3204229625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644964d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.230+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3204229625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb644975e0 0x55fb6449a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.230+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3204229625 >> 10.20.193.28:0/3204229625 conn(0x55fb6445a240 msgr2=0x55fb644aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:57.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.230+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3204229625 shutdown_connections 2026-02-20T03:20:57.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.230+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3204229625 wait complete. 2026-02-20T03:20:57.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.231+0000 7efd06ff0e00 1 -- start start 2026-02-20T03:20:57.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.231+0000 7efd06ff0e00 1 Processor -- start 2026-02-20T03:20:57.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb644975e0 0x55fb644b8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efd06ff0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb644b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efca400e500 con 0x55fb64497f60 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efca400f970 con 0x55fb644975e0 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efd06ff0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efca400ebd0 con 0x55fb6449cfb0 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfdd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfdd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36954/0 (socket says 10.20.193.28:36954) 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfdd74640 1 -- 10.20.193.28:0/3546276245 learned_addr learned my addr 10.20.193.28:0/3546276245 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfe575640 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb644975e0 0x55fb644b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfed76640 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb644b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfdd74640 1 -- 10.20.193.28:0/3546276245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 msgr2=0x55fb644b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfdd74640 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb644b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfdd74640 1 -- 10.20.193.28:0/3546276245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb644975e0 msgr2=0x55fb644b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfdd74640 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb644975e0 0x55fb644b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.233+0000 7efcfdd74640 1 -- 10.20.193.28:0/3546276245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb640c9870 con 0x55fb64497f60 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efcfdd74640 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644b4a30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7efce80c9660 tx=0x7efce80c8860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc0869fde8ea0ac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efcaffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efcaffff640 1 -- 10.20.193.28:0/3546276245 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce80d09f0 con 0x55fb64497f60 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efcaffff640 1 -- 10.20.193.28:0/3546276245 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efce80e6070 con 0x55fb64497f60 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efcaffff640 1 -- 10.20.193.28:0/3546276245 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce80d1dc0 con 0x55fb64497f60 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3546276245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6438a3f0 con 0x55fb64497f60 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 10 client.16929 _ll_register_callbacks cb 0x7efcf4004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3546276245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb6439cab0 con 0x55fb64497f60 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efcaffff640 1 -- 10.20.193.28:0/3546276245 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efce80ed2f0 con 0x55fb64497f60 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efcaffff640 1 -- 10.20.193.28:0/3546276245 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efce80d5af0 con 0x55fb64497f60 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 10 client.16929 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3546276245 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55fb644aa5f0 con 0x55fb64497f60 2026-02-20T03:20:57.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efcaffff640 1 -- 10.20.193.28:0/3546276245 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efce80d3ce0 con 0x55fb64497f60 2026-02-20T03:20:57.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 10 client.16929 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:57.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 10 client.16929 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:20:57.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 20 client.16929 populate_metadata read hostname 'trial028' 2026-02-20T03:20:57.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55fb6452bef0 0x55fb6452e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 4 client.16929 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:20:57.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.234+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3546276245 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7efcf4014070 con 0x55fb6452bef0 2026-02-20T03:20:57.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efcfe575640 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55fb6452bef0 0x55fb6452e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efcfe575640 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55fb6452bef0 0x55fb6452e3b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b93bf8973ba0e5e server_cookie=c94b8adcd7e85834 in_seq=0 out_seq=0 2026-02-20T03:20:57.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efcaffff640 10 client.16929 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:20:57.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efcaffff640 1 -- 10.20.193.28:0/3546276245 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7efcf4014070 con 0x55fb6452bef0 2026-02-20T03:20:57.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efcaffff640 10 client.16929 handle_command_reply: tid=0 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efd06ff0e00 1 client.16929 shutdown 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3546276245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 msgr2=0x55fb644b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644b4a30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7efce80c9660 tx=0x7efce80c8860 comp rx=0 tx=0).stop 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3546276245 shutdown_connections 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55fb6452bef0 0x55fb6452e3b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb6449cfb0 0x55fb644b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb64497f60 0x55fb644b4a30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efd06ff0e00 1 --2- 10.20.193.28:0/3546276245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb644975e0 0x55fb644b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efcaffff640 0 client.16929 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.235+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3546276245 >> 10.20.193.28:0/3546276245 conn(0x55fb6445a240 msgr2=0x55fb644c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.236+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3546276245 shutdown_connections 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.236+0000 7efd06ff0e00 1 -- 10.20.193.28:0/3546276245 wait complete. 2026-02-20T03:20:57.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.236+0000 7efd06ff0e00 20 client.16929 trim_cache size 0 max 16384 2026-02-20T03:20:57.243 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:20:57.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.236+0000 7efcff577640 1 -- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcd80b0d80 msgr2=0x7efcd80b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.236+0000 7efcff577640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcd80b0d80 0x7efcd80b3240 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efcf400a2a0 tx=0x7efcf4012040 comp rx=0 tx=0).stop 2026-02-20T03:20:57.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.236+0000 7efcff577640 1 -- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd00077f40 msgr2=0x7efd001a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.236+0000 7efcff577640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd00077f40 0x7efd001a1b60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efce802f750 tx=0x7efce802fcd0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.237+0000 7efcff577640 1 -- 10.20.193.28:0/565795654 shutdown_connections 2026-02-20T03:20:57.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.237+0000 7efcff577640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efcd80b0d80 0x7efcd80b3240 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.237+0000 7efcff577640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efd00113820 0x7efd001a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.237+0000 7efcff577640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efd00077f40 0x7efd001a1b60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.237+0000 7efcff577640 1 --2- 10.20.193.28:0/565795654 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efd00077620 0x7efd001a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.237+0000 7efcff577640 1 -- 10.20.193.28:0/565795654 >> 10.20.193.28:0/565795654 conn(0x7efd00100680 msgr2=0x7efd00113e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:57.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.237+0000 7efcff577640 1 -- 10.20.193.28:0/565795654 shutdown_connections 2026-02-20T03:20:57.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.237+0000 7efcff577640 1 -- 10.20.193.28:0/565795654 wait complete. 2026-02-20T03:20:57.291 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:57 trial028 ceph-mon[38552]: pgmap v369: 129 pgs: 129 active+clean; 94 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 603 KiB/s rd, 3.5 MiB/s wr, 355 op/s 2026-02-20T03:20:57.371 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:20:57.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 518947 7.92 MB/sec execute 150 sec latency 412.462 ms 2026-02-20T03:20:57.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:57 trial126 ceph-mon[38476]: pgmap v369: 129 pgs: 129 active+clean; 94 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 603 KiB/s rd, 3.5 MiB/s wr, 355 op/s 2026-02-20T03:20:57.687 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:57 trial177 ceph-mon[43181]: pgmap v369: 129 pgs: 129 active+clean; 94 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 603 KiB/s rd, 3.5 MiB/s wr, 355 op/s 2026-02-20T03:20:57.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.933+0000 7fc86cba9640 1 -- 10.20.193.28:0/3621870522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc868109ba0 msgr2=0x7fc868115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.933+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3621870522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc868109ba0 0x7fc868115d10 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00b0a0 tx=0x7fc85c02f450 comp rx=0 tx=0).stop 2026-02-20T03:20:57.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.933+0000 7fc86cba9640 1 -- 10.20.193.28:0/3621870522 shutdown_connections 2026-02-20T03:20:57.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.933+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3621870522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc868109ba0 0x7fc868115d10 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.933+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3621870522 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc868109220 0x7fc868109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.933+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3621870522 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc86810eef0 0x7fc86810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.933+0000 7fc86cba9640 1 -- 10.20.193.28:0/3621870522 >> 10.20.193.28:0/3621870522 conn(0x7fc868078600 msgr2=0x7fc86807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:57.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.933+0000 7fc86cba9640 1 -- 10.20.193.28:0/3621870522 shutdown_connections 2026-02-20T03:20:57.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.933+0000 7fc86cba9640 1 -- 10.20.193.28:0/3621870522 wait complete. 2026-02-20T03:20:57.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc86cba9640 1 Processor -- start 2026-02-20T03:20:57.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc86cba9640 1 -- start start 2026-02-20T03:20:57.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc86cba9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc868109220 0x7fc8681a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc86cba9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc868109ba0 0x7fc8681a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc86cba9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc86810eef0 0x7fc8681a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc86cba9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc868119160 con 0x7fc86810eef0 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc86cba9640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc868118fe0 con 0x7fc868109ba0 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc86cba9640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681192e0 con 0x7fc868109220 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc867fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc86810eef0 0x7fc8681a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc867fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc86810eef0 0x7fc8681a5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36970/0 (socket says 10.20.193.28:36970) 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.934+0000 7fc867fff640 1 -- 10.20.193.28:0/3607043685 learned_addr learned my addr 10.20.193.28:0/3607043685 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc867fff640 1 -- 10.20.193.28:0/3607043685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc868109220 msgr2=0x7fc8681a1680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:57.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc867fff640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc868109220 0x7fc8681a1680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc867fff640 1 -- 10.20.193.28:0/3607043685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc868109ba0 msgr2=0x7fc8681a1bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:57.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc867fff640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc868109ba0 0x7fc8681a1bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc867fff640 1 -- 10.20.193.28:0/3607043685 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8681a66d0 con 0x7fc86810eef0 2026-02-20T03:20:57.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc867fff640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc86810eef0 0x7fc8681a5f50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0077f0 tx=0x7fc85c009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc864ff9640 1 -- 10.20.193.28:0/3607043685 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c004e00 con 0x7fc86810eef0 2026-02-20T03:20:57.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc864ff9640 1 -- 10.20.193.28:0/3607043685 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc85c002a60 con 0x7fc86810eef0 2026-02-20T03:20:57.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc864ff9640 1 -- 10.20.193.28:0/3607043685 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0436e0 con 0x7fc86810eef0 2026-02-20T03:20:57.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc86cba9640 1 -- 10.20.193.28:0/3607043685 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8681a6960 con 0x7fc86810eef0 2026-02-20T03:20:57.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.935+0000 7fc86cba9640 1 -- 10.20.193.28:0/3607043685 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8681ae200 con 0x7fc86810eef0 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.938+0000 7fc864ff9640 1 -- 10.20.193.28:0/3607043685 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc85c04b070 con 0x7fc86810eef0 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.938+0000 7fc870337e00 1 Processor -- start 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.938+0000 7fc870337e00 1 -- start start 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc870337e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d820fb0 0x561d3d821390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc870337e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81b5e0 0x561d3d81ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc870337e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d81bf60 0x561d3d827de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc870337e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561d3d79be00 con 0x561d3d820fb0 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc870337e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561d3d76e970 con 0x561d3d81b5e0 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc870337e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561d3d71c1f0 con 0x561d3d81bf60 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc866ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d820fb0 0x561d3d821390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc866ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d820fb0 0x561d3d821390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36982/0 (socket says 10.20.193.28:36982) 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc866ffd640 1 -- 10.20.193.28:0/942276234 learned_addr learned my addr 10.20.193.28:0/942276234 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc864ff9640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc83c0b0e20 0x7fc83c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc864ff9640 1 -- 10.20.193.28:0/3607043685 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc85c105ad0 con 0x7fc86810eef0 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc866ffd640 1 -- 10.20.193.28:0/942276234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d81bf60 msgr2=0x561d3d827de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc866ffd640 1 --2- 10.20.193.28:0/942276234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d81bf60 0x561d3d827de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc866ffd640 1 -- 10.20.193.28:0/942276234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81b5e0 msgr2=0x561d3d81ba20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc866ffd640 1 --2- 10.20.193.28:0/942276234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81b5e0 0x561d3d81ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc867fff640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc83c0b0e20 0x7fc83c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.939+0000 7fc866ffd640 1 -- 10.20.193.28:0/942276234 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3d72f3d0 con 0x561d3d820fb0 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc866ffd640 1 --2- 10.20.193.28:0/942276234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d820fb0 0x561d3d821390 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc8540098a0 tx=0x7fc854009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2448617086c96489 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc867fff640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc83c0b0e20 0x7fc83c0b32e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0095b0 tx=0x7fc85c009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc82bfff640 1 -- 10.20.193.28:0/942276234 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854016070 con 0x561d3d820fb0 2026-02-20T03:20:57.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc82bfff640 1 -- 10.20.193.28:0/942276234 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc854004480 con 0x561d3d820fb0 2026-02-20T03:20:57.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc82bfff640 1 -- 10.20.193.28:0/942276234 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85400bd90 con 0x561d3d820fb0 2026-02-20T03:20:57.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc870337e00 1 -- 10.20.193.28:0/942276234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d820fb0 msgr2=0x561d3d821390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:57.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc870337e00 1 --2- 10.20.193.28:0/942276234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d820fb0 0x561d3d821390 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc8540098a0 tx=0x7fc854009d70 comp rx=0 tx=0).stop 2026-02-20T03:20:57.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc870337e00 1 -- 10.20.193.28:0/942276234 shutdown_connections 2026-02-20T03:20:57.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc870337e00 1 --2- 10.20.193.28:0/942276234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d81bf60 0x561d3d827de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc870337e00 1 --2- 10.20.193.28:0/942276234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81b5e0 0x561d3d81ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc870337e00 1 --2- 10.20.193.28:0/942276234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d820fb0 0x561d3d821390 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc870337e00 1 -- 10.20.193.28:0/942276234 >> 10.20.193.28:0/942276234 conn(0x561d3d7de240 msgr2=0x561d3d819ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc870337e00 1 -- 10.20.193.28:0/942276234 shutdown_connections 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.940+0000 7fc870337e00 1 -- 10.20.193.28:0/942276234 wait complete. 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.941+0000 7fc870337e00 1 -- start start 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc870337e00 1 Processor -- start 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc870337e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d8346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc870337e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81bf60 0x561d3d834bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc870337e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 0x561d3d838ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc870337e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561d3d76a8a0 con 0x561d3d81b5e0 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc870337e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561d3d55cf50 con 0x561d3d81bf60 2026-02-20T03:20:57.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc870337e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561d3d839420 con 0x561d3d820fb0 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc866ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d8346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc866ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d8346b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36990/0 (socket says 10.20.193.28:36990) 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc866ffd640 1 -- 10.20.193.28:0/1183926764 learned_addr learned my addr 10.20.193.28:0/1183926764 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc866ffd640 1 -- 10.20.193.28:0/1183926764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 msgr2=0x561d3d838ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc866ffd640 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 0x561d3d838ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc866ffd640 1 -- 10.20.193.28:0/1183926764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81bf60 msgr2=0x561d3d834bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc866ffd640 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81bf60 0x561d3d834bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.942+0000 7fc866ffd640 1 -- 10.20.193.28:0/1183926764 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3d82db70 con 0x561d3d81b5e0 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc866ffd640 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d8346b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc85400b9b0 tx=0x7fc85400bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36218e63d1910fbb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc8297fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:57.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc8297fa640 1 -- 10.20.193.28:0/1183926764 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85401f070 con 0x561d3d81b5e0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc870337e00 1 -- 10.20.193.28:0/1183926764 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3d53fb40 con 0x561d3d81b5e0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc870337e00 10 client.16941 _ll_register_callbacks cb 0x561d3d7a7eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc8297fa640 1 -- 10.20.193.28:0/1183926764 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc854002c20 con 0x561d3d81b5e0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc8297fa640 1 -- 10.20.193.28:0/1183926764 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854016040 con 0x561d3d81b5e0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc870337e00 1 -- 10.20.193.28:0/1183926764 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561d3d77c150 con 0x561d3d81b5e0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc8297fa640 1 -- 10.20.193.28:0/1183926764 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc854011c90 con 0x561d3d81b5e0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc8297fa640 1 -- 10.20.193.28:0/1183926764 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc854002780 con 0x561d3d81b5e0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc870337e00 10 client.16941 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.943+0000 7fc870337e00 1 -- 10.20.193.28:0/1183926764 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561d3d7291e0 con 0x561d3d81b5e0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.944+0000 7fc8297fa640 1 -- 10.20.193.28:0/1183926764 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc854019070 con 0x561d3d81b5e0 2026-02-20T03:20:57.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.944+0000 7fc870337e00 10 client.16941 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.944+0000 7fc870337e00 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:57.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.944+0000 7fc870337e00 20 client.16941 populate_metadata read hostname 'trial028' 2026-02-20T03:20:57.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.944+0000 7fc870337e00 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d3d844710 0x561d3d846b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:57.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.944+0000 7fc870337e00 4 client.16941 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:57.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.944+0000 7fc870337e00 1 -- 10.20.193.28:0/1183926764 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d3d776560 con 0x561d3d844710 2026-02-20T03:20:57.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:57.957+0000 7fc8677fe640 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d3d844710 0x561d3d846b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.011+0000 7fc8677fe640 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d3d844710 0x561d3d846b00 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c422fe6b1a51a59b server_cookie=1c695c09208dd60b in_seq=0 out_seq=0 2026-02-20T03:20:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.011+0000 7fc8297fa640 10 client.16941 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:58.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.037+0000 7fc8297fa640 1 -- 10.20.193.28:0/1183926764 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561d3d776560 con 0x561d3d844710 2026-02-20T03:20:58.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.037+0000 7fc8297fa640 10 client.16941 handle_command_reply: tid=0 2026-02-20T03:20:58.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.037+0000 7fc870337e00 1 client.16941 shutdown 2026-02-20T03:20:58.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 -- 10.20.193.28:0/1183926764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 msgr2=0x561d3d8346b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:58.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d8346b0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc85400b9b0 tx=0x7fc85400bef0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 -- 10.20.193.28:0/1183926764 shutdown_connections 2026-02-20T03:20:58.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d3d844710 0x561d3d846b00 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 0x561d3d838ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81bf60 0x561d3d834bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 --2- 10.20.193.28:0/1183926764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d8346b0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 -- 10.20.193.28:0/1183926764 >> 10.20.193.28:0/1183926764 conn(0x561d3d7de240 msgr2=0x561d3d81a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:58.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc8297fa640 0 client.16941 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:58.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 -- 10.20.193.28:0/1183926764 shutdown_connections 2026-02-20T03:20:58.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 1 -- 10.20.193.28:0/1183926764 wait complete. 2026-02-20T03:20:58.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.038+0000 7fc870337e00 20 client.16941 trim_cache size 0 max 16384 2026-02-20T03:20:58.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.044+0000 7fc870337e00 1 Processor -- start 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc870337e00 1 -- start start 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc870337e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d813d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc870337e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81bf60 0x561d3d84c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc870337e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 0x561d3d84c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc870337e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c0126f0 con 0x561d3d81b5e0 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc870337e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c00ffc0 con 0x561d3d81bf60 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc870337e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c00de10 con 0x561d3d820fb0 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc866ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d813d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc866ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d813d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36994/0 (socket says 10.20.193.28:36994) 2026-02-20T03:20:58.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc866ffd640 1 -- 10.20.193.28:0/1456650644 learned_addr learned my addr 10.20.193.28:0/1456650644 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc866ffd640 1 -- 10.20.193.28:0/1456650644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 msgr2=0x561d3d84c8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc866ffd640 1 --2- 10.20.193.28:0/1456650644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 0x561d3d84c8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc866ffd640 1 -- 10.20.193.28:0/1456650644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81bf60 msgr2=0x561d3d84c360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc866ffd640 1 --2- 10.20.193.28:0/1456650644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81bf60 0x561d3d84c360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc866ffd640 1 -- 10.20.193.28:0/1456650644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3d82d9a0 con 0x561d3d81b5e0 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.045+0000 7fc866ffd640 1 --2- 10.20.193.28:0/1456650644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d813d00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc8540096b0 tx=0x7fc854008070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb17e2034dc36ad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc82b7fe640 1 -- 10.20.193.28:0/1456650644 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85401f070 con 0x561d3d81b5e0 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc82b7fe640 1 -- 10.20.193.28:0/1456650644 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x561d3d77c150 con 0x561d3d81b5e0 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc82b7fe640 1 -- 10.20.193.28:0/1456650644 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854002ce0 con 0x561d3d81b5e0 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc870337e00 1 -- 10.20.193.28:0/1456650644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 msgr2=0x561d3d813d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:58.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc870337e00 1 --2- 10.20.193.28:0/1456650644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d813d00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc8540096b0 tx=0x7fc854008070 comp rx=0 tx=0).stop 2026-02-20T03:20:58.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc870337e00 1 -- 10.20.193.28:0/1456650644 shutdown_connections 2026-02-20T03:20:58.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc870337e00 1 --2- 10.20.193.28:0/1456650644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 0x561d3d84c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc870337e00 1 --2- 10.20.193.28:0/1456650644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81bf60 0x561d3d84c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc870337e00 1 --2- 10.20.193.28:0/1456650644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81b5e0 0x561d3d813d00 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc870337e00 1 -- 10.20.193.28:0/1456650644 >> 10.20.193.28:0/1456650644 conn(0x561d3d7de240 msgr2=0x561d3d8346b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:58.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc870337e00 1 -- 10.20.193.28:0/1456650644 shutdown_connections 2026-02-20T03:20:58.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.046+0000 7fc870337e00 1 -- 10.20.193.28:0/1456650644 wait complete. 2026-02-20T03:20:58.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.047+0000 7fc870337e00 1 -- start start 2026-02-20T03:20:58.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.047+0000 7fc870337e00 1 Processor -- start 2026-02-20T03:20:58.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.047+0000 7fc870337e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81b5e0 0x561d3d83f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:58.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.047+0000 7fc870337e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81bf60 0x561d3d83b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:58.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.047+0000 7fc870337e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 0x561d3d83bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:58.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.047+0000 7fc870337e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c00e480 con 0x561d3d81bf60 2026-02-20T03:20:58.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.047+0000 7fc870337e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c00f8f0 con 0x561d3d81b5e0 2026-02-20T03:20:58.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.047+0000 7fc870337e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c00eb50 con 0x561d3d820fb0 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.047+0000 7fc8677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81bf60 0x561d3d83b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81bf60 0x561d3d83b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36998/0 (socket says 10.20.193.28:36998) 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8677fe640 1 -- 10.20.193.28:0/3615572311 learned_addr learned my addr 10.20.193.28:0/3615572311 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8677fe640 1 -- 10.20.193.28:0/3615572311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 msgr2=0x561d3d83bf00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8677fe640 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 0x561d3d83bf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8677fe640 1 -- 10.20.193.28:0/3615572311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81b5e0 msgr2=0x561d3d83f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8677fe640 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81b5e0 0x561d3d83f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8677fe640 1 -- 10.20.193.28:0/3615572311 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d3d44d870 con 0x561d3d81bf60 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8677fe640 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81bf60 0x561d3d83b9c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc858002410 tx=0x7fc858002780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1500dbfe82d32a43 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8297fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:58.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8297fa640 1 -- 10.20.193.28:0/3615572311 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858015040 con 0x561d3d81bf60 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8297fa640 1 -- 10.20.193.28:0/3615572311 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc858009b60 con 0x561d3d81bf60 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8297fa640 1 -- 10.20.193.28:0/3615572311 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858013b60 con 0x561d3d81bf60 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc870337e00 1 -- 10.20.193.28:0/3615572311 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d3d70e3f0 con 0x561d3d81bf60 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc8297fa640 1 -- 10.20.193.28:0/3615572311 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc858013d80 con 0x561d3d81bf60 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc870337e00 10 client.16947 _ll_register_callbacks cb 0x7fc854014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.048+0000 7fc870337e00 1 -- 10.20.193.28:0/3615572311 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561d3d720ab0 con 0x561d3d81bf60 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc8297fa640 1 -- 10.20.193.28:0/3615572311 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc8580133d0 con 0x561d3d81bf60 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc870337e00 10 client.16947 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc870337e00 1 -- 10.20.193.28:0/3615572311 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561d3d82e690 con 0x561d3d81bf60 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc8297fa640 1 -- 10.20.193.28:0/3615572311 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc858009d10 con 0x561d3d81bf60 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc870337e00 10 client.16947 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:58.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc870337e00 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:58.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc870337e00 20 client.16947 populate_metadata read hostname 'trial028' 2026-02-20T03:20:58.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc870337e00 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d3d8b0790 0x561d3d8b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:58.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc870337e00 4 client.16947 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:20:58.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.049+0000 7fc870337e00 1 -- 10.20.193.28:0/3615572311 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561d3d77c150 con 0x561d3d8b0790 2026-02-20T03:20:58.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.064+0000 7fc866ffd640 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d3d8b0790 0x561d3d8b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:58.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.131+0000 7fc866ffd640 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d3d8b0790 0x561d3d8b2c50 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=509132c996f723fc server_cookie=ffc386797c58e41b in_seq=0 out_seq=0 2026-02-20T03:20:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.131+0000 7fc8297fa640 10 client.16947 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc8297fa640 1 -- 10.20.193.28:0/3615572311 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561d3d77c150 con 0x561d3d8b0790 2026-02-20T03:20:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc8297fa640 10 client.16947 handle_command_reply: tid=0 2026-02-20T03:20:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc870337e00 1 client.16947 shutdown 2026-02-20T03:20:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc870337e00 1 -- 10.20.193.28:0/3615572311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81bf60 msgr2=0x561d3d83b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:58.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc870337e00 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81bf60 0x561d3d83b9c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc858002410 tx=0x7fc858002780 comp rx=0 tx=0).stop 2026-02-20T03:20:58.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc870337e00 1 -- 10.20.193.28:0/3615572311 shutdown_connections 2026-02-20T03:20:58.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc870337e00 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d3d8b0790 0x561d3d8b2c50 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc870337e00 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d3d820fb0 0x561d3d83bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc870337e00 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d3d81bf60 0x561d3d83b9c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc870337e00 1 --2- 10.20.193.28:0/3615572311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d3d81b5e0 0x561d3d83f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.144+0000 7fc870337e00 1 -- 10.20.193.28:0/3615572311 >> 10.20.193.28:0/3615572311 conn(0x561d3d7de240 msgr2=0x561d3d832cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:58.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc8297fa640 0 client.16947 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:58.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc870337e00 1 -- 10.20.193.28:0/3615572311 shutdown_connections 2026-02-20T03:20:58.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc870337e00 1 -- 10.20.193.28:0/3615572311 wait complete. 2026-02-20T03:20:58.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc870337e00 20 client.16947 trim_cache size 0 max 16384 2026-02-20T03:20:58.160 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 -- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc83c0b0e20 msgr2=0x7fc83c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc83c0b0e20 0x7fc83c0b32e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0095b0 tx=0x7fc85c009040 comp rx=0 tx=0).stop 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 -- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc86810eef0 msgr2=0x7fc8681a5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc86810eef0 0x7fc8681a5f50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0077f0 tx=0x7fc85c009370 comp rx=0 tx=0).stop 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 -- 10.20.193.28:0/3607043685 shutdown_connections 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc83c0b0e20 0x7fc83c0b32e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc86810eef0 0x7fc8681a5f50 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc868109ba0 0x7fc8681a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 --2- 10.20.193.28:0/3607043685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc868109220 0x7fc8681a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:58.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 -- 10.20.193.28:0/3607043685 >> 10.20.193.28:0/3607043685 conn(0x7fc868078600 msgr2=0x7fc868079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:58.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 -- 10.20.193.28:0/3607043685 shutdown_connections 2026-02-20T03:20:58.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:58.145+0000 7fc86cba9640 1 -- 10.20.193.28:0/3607043685 wait complete. 2026-02-20T03:20:58.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 518947 7.87 MB/sec execute 151 sec latency 1412.515 ms 2026-02-20T03:20:59.291 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:20:59.291 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:20:59.449 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:20:59 trial028 ceph-mon[38552]: pgmap v370: 129 pgs: 129 active+clean; 95 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 605 KiB/s rd, 3.6 MiB/s wr, 330 op/s 2026-02-20T03:20:59.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 518951 7.82 MB/sec execute 152 sec latency 1724.303 ms 2026-02-20T03:20:59.584 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:20:59.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:20:59 trial126 ceph-mon[38476]: pgmap v370: 129 pgs: 129 active+clean; 95 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 605 KiB/s rd, 3.6 MiB/s wr, 330 op/s 2026-02-20T03:20:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:20:59 trial177 ceph-mon[43181]: pgmap v370: 129 pgs: 129 active+clean; 95 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 605 KiB/s rd, 3.6 MiB/s wr, 330 op/s 2026-02-20T03:20:59.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.826+0000 7ff3459c3640 1 -- 10.20.193.28:0/3207946869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340105320 msgr2=0x7ff340111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:59.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.826+0000 7ff3459c3640 1 --2- 10.20.193.28:0/3207946869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340105320 0x7ff340111850 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00b0d0 tx=0x7ff33c02f490 comp rx=0 tx=0).stop 2026-02-20T03:20:59.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.826+0000 7ff3459c3640 1 -- 10.20.193.28:0/3207946869 shutdown_connections 2026-02-20T03:20:59.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.826+0000 7ff3459c3640 1 --2- 10.20.193.28:0/3207946869 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340105320 0x7ff340111850 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.826+0000 7ff3459c3640 1 --2- 10.20.193.28:0/3207946869 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff340104980 0x7ff340104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.826+0000 7ff3459c3640 1 --2- 10.20.193.28:0/3207946869 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff34010a980 0x7ff34010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.826+0000 7ff3459c3640 1 -- 10.20.193.28:0/3207946869 >> 10.20.193.28:0/3207946869 conn(0x7ff340100680 msgr2=0x7ff340102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:59.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.827+0000 7ff3459c3640 1 -- 10.20.193.28:0/3207946869 shutdown_connections 2026-02-20T03:20:59.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.827+0000 7ff3459c3640 1 -- 10.20.193.28:0/3207946869 wait complete. 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.827+0000 7ff3459c3640 1 Processor -- start 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.827+0000 7ff3459c3640 1 -- start start 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3459c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340104980 0x7ff34019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3459c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff340105320 0x7ff34019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3459c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff34010a980 0x7ff3401a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3459c3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff340114cd0 con 0x7ff340104980 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3459c3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff340114b50 con 0x7ff34010a980 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3459c3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff340114e50 con 0x7ff340105320 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3449c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340104980 0x7ff34019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3449c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340104980 0x7ff34019d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37012/0 (socket says 10.20.193.28:37012) 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3449c1640 1 -- 10.20.193.28:0/528400797 learned_addr learned my addr 10.20.193.28:0/528400797 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3449c1640 1 -- 10.20.193.28:0/528400797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff340105320 msgr2=0x7ff34019d6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3449c1640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff340105320 0x7ff34019d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3449c1640 1 -- 10.20.193.28:0/528400797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff34010a980 msgr2=0x7ff3401a1a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3449c1640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff34010a980 0x7ff3401a1a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3449c1640 1 -- 10.20.193.28:0/528400797 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3401a2200 con 0x7ff340104980 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.828+0000 7ff3449c1640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340104980 0x7ff34019d1b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff33000b570 tx=0x7ff33000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.829+0000 7ff335ffb640 1 -- 10.20.193.28:0/528400797 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330013020 con 0x7ff340104980 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.829+0000 7ff335ffb640 1 -- 10.20.193.28:0/528400797 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff330004480 con 0x7ff340104980 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.829+0000 7ff335ffb640 1 -- 10.20.193.28:0/528400797 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33000fb50 con 0x7ff340104980 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.829+0000 7ff3459c3640 1 -- 10.20.193.28:0/528400797 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3401a24f0 con 0x7ff340104980 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.829+0000 7ff3459c3640 1 -- 10.20.193.28:0/528400797 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3401a9d30 con 0x7ff340104980 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.831+0000 7ff335ffb640 1 -- 10.20.193.28:0/528400797 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff330002780 con 0x7ff340104980 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.832+0000 7ff349151e00 1 Processor -- start 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.832+0000 7ff349151e00 1 -- start start 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff349151e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb10c0 0x560f04fb14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff349151e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb1a70 0x560f04fb5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff349151e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f04fb5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff349151e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f04f03c00 con 0x560f04fb5b60 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff349151e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560f04eb13c0 con 0x560f04fb1a70 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff349151e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560f04effb30 con 0x560f04fb10c0 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff337fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f04fb5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff337fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f04fb5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37024/0 (socket says 10.20.193.28:37024) 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff337fff640 1 -- 10.20.193.28:0/2589913248 learned_addr learned my addr 10.20.193.28:0/2589913248 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff335ffb640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff31c0b0e20 0x7ff31c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff335ffb640 1 -- 10.20.193.28:0/528400797 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff3300e0550 con 0x7ff340104980 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff337fff640 1 -- 10.20.193.28:0/2589913248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb10c0 msgr2=0x560f04fb14a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff337fff640 1 --2- 10.20.193.28:0/2589913248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb10c0 0x560f04fb14a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff337fff640 1 -- 10.20.193.28:0/2589913248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb1a70 msgr2=0x560f04fb5540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff337fff640 1 --2- 10.20.193.28:0/2589913248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb1a70 0x560f04fb5540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff337fff640 1 -- 10.20.193.28:0/2589913248 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f04eaa840 con 0x560f04fb5b60 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff3451c2640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff31c0b0e20 0x7ff31c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.833+0000 7ff337fff640 1 --2- 10.20.193.28:0/2589913248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f04fb5fd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff328009840 tx=0x7ff328009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86de1975a33cd259 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff3451c2640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff31c0b0e20 0x7ff31c0b32e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff33c02f9a0 tx=0x7ff33c031040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff30d4e4640 1 -- 10.20.193.28:0/2589913248 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328016070 con 0x560f04fb5b60 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff30d4e4640 1 -- 10.20.193.28:0/2589913248 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff328004480 con 0x560f04fb5b60 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff30d4e4640 1 -- 10.20.193.28:0/2589913248 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32800bda0 con 0x560f04fb5b60 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff349151e00 1 -- 10.20.193.28:0/2589913248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 msgr2=0x560f04fb5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff349151e00 1 --2- 10.20.193.28:0/2589913248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f04fb5fd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff328009840 tx=0x7ff328009d10 comp rx=0 tx=0).stop 2026-02-20T03:20:59.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff349151e00 1 -- 10.20.193.28:0/2589913248 shutdown_connections 2026-02-20T03:20:59.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff349151e00 1 --2- 10.20.193.28:0/2589913248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f04fb5fd0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff349151e00 1 --2- 10.20.193.28:0/2589913248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb1a70 0x560f04fb5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff349151e00 1 --2- 10.20.193.28:0/2589913248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb10c0 0x560f04fb14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff349151e00 1 -- 10.20.193.28:0/2589913248 >> 10.20.193.28:0/2589913248 conn(0x560f04fa9b60 msgr2=0x560f04faf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:59.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff349151e00 1 -- 10.20.193.28:0/2589913248 shutdown_connections 2026-02-20T03:20:59.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.834+0000 7ff349151e00 1 -- 10.20.193.28:0/2589913248 wait complete. 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff349151e00 1 -- start start 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff349151e00 1 Processor -- start 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff349151e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb10c0 0x560f04fcb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff349151e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb1a70 0x560f04fcbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff349151e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb5b60 0x560f04fc9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff349151e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560f04eab1a0 con 0x560f04fb1a70 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff349151e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560f04fbdd70 con 0x560f04fb10c0 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff349151e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560f04fca490 con 0x560f04fb5b60 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff337fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb1a70 0x560f04fcbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff337fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb1a70 0x560f04fcbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37032/0 (socket says 10.20.193.28:37032) 2026-02-20T03:20:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff337fff640 1 -- 10.20.193.28:0/4033286025 learned_addr learned my addr 10.20.193.28:0/4033286025 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff337fff640 1 -- 10.20.193.28:0/4033286025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb5b60 msgr2=0x560f04fc9d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff337fff640 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb5b60 0x560f04fc9d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff337fff640 1 -- 10.20.193.28:0/4033286025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb10c0 msgr2=0x560f04fcb5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff337fff640 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb10c0 0x560f04fcb5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.836+0000 7ff337fff640 1 -- 10.20.193.28:0/4033286025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f04fc3730 con 0x560f04fb1a70 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff337fff640 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb1a70 0x560f04fcbb10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff328002f40 tx=0x7ff32800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c6da2c21203068 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff2fe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/4033286025 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328016040 con 0x560f04fb1a70 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff349151e00 1 -- 10.20.193.28:0/4033286025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f04cd2b60 con 0x560f04fb1a70 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff349151e00 10 client.16959 _ll_register_callbacks cb 0x560f04eaf0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff349151e00 1 -- 10.20.193.28:0/4033286025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560f04f0b7f0 con 0x560f04fb1a70 2026-02-20T03:20:59.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/4033286025 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff328002c20 con 0x560f04fb1a70 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/4033286025 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328011a50 con 0x560f04fb1a70 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/4033286025 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff328011bf0 con 0x560f04fb1a70 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/4033286025 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff32801a400 con 0x560f04fb1a70 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff349151e00 10 client.16959 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff349151e00 1 -- 10.20.193.28:0/4033286025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560f04ed0430 con 0x560f04fb1a70 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.837+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/4033286025 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff328002780 con 0x560f04fb1a70 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.838+0000 7ff349151e00 10 client.16959 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.838+0000 7ff349151e00 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.838+0000 7ff349151e00 20 client.16959 populate_metadata read hostname 'trial028' 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.838+0000 7ff349151e00 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560f04fd9d00 0x560f04fdc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.838+0000 7ff349151e00 4 client.16959 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:20:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.838+0000 7ff349151e00 1 -- 10.20.193.28:0/4033286025 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f04e85c00 con 0x560f04fd9d00 2026-02-20T03:20:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.861+0000 7ff3449c1640 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560f04fd9d00 0x560f04fdc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:59.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.928+0000 7ff3449c1640 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560f04fd9d00 0x560f04fdc0f0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a168826da2f66ee8 server_cookie=7124fd6f2262cb63 in_seq=0 out_seq=0 2026-02-20T03:20:59.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.928+0000 7ff2fe7fc640 10 client.16959 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:59.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/4033286025 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560f04e85c00 con 0x560f04fd9d00 2026-02-20T03:20:59.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff2fe7fc640 10 client.16959 handle_command_reply: tid=0 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff349151e00 1 client.16959 shutdown 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff349151e00 1 -- 10.20.193.28:0/4033286025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb1a70 msgr2=0x560f04fcbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff349151e00 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb1a70 0x560f04fcbb10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff328002f40 tx=0x7ff32800b6e0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff349151e00 1 -- 10.20.193.28:0/4033286025 shutdown_connections 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff349151e00 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560f04fd9d00 0x560f04fdc0f0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff349151e00 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb5b60 0x560f04fc9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff349151e00 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb1a70 0x560f04fcbb10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff349151e00 1 --2- 10.20.193.28:0/4033286025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb10c0 0x560f04fcb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff349151e00 1 -- 10.20.193.28:0/4033286025 >> 10.20.193.28:0/4033286025 conn(0x560f04fa9b60 msgr2=0x560f04fb4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.941+0000 7ff2fe7fc640 0 client.16959 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.942+0000 7ff349151e00 1 -- 10.20.193.28:0/4033286025 shutdown_connections 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.942+0000 7ff349151e00 1 -- 10.20.193.28:0/4033286025 wait complete. 2026-02-20T03:20:59.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.942+0000 7ff349151e00 20 client.16959 trim_cache size 0 max 16384 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.950+0000 7ff349151e00 1 Processor -- start 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.950+0000 7ff349151e00 1 -- start start 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.950+0000 7ff349151e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb10c0 0x560f04fe18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.950+0000 7ff349151e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb1a70 0x560f04fe1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.950+0000 7ff349151e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb5b60 0x560f04fd1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.950+0000 7ff349151e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e4012790 con 0x560f04fb10c0 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.950+0000 7ff349151e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e4010060 con 0x560f04fb1a70 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.950+0000 7ff349151e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e400de50 con 0x560f04fb5b60 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff3449c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb10c0 0x560f04fe18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff3449c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb10c0 0x560f04fe18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37036/0 (socket says 10.20.193.28:37036) 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff3449c1640 1 -- 10.20.193.28:0/2486858820 learned_addr learned my addr 10.20.193.28:0/2486858820 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:59.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff3449c1640 1 -- 10.20.193.28:0/2486858820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb5b60 msgr2=0x560f04fd1460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff3449c1640 1 --2- 10.20.193.28:0/2486858820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb5b60 0x560f04fd1460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff3449c1640 1 -- 10.20.193.28:0/2486858820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb1a70 msgr2=0x560f04fe1e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff3449c1640 1 --2- 10.20.193.28:0/2486858820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb1a70 0x560f04fe1e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff3449c1640 1 -- 10.20.193.28:0/2486858820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f04fb1810 con 0x560f04fb10c0 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff3449c1640 1 --2- 10.20.193.28:0/2486858820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb10c0 0x560f04fe18c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff3300a81c0 tx=0x7ff3300dda90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bb10f7f7c49643 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff30cce3640 1 -- 10.20.193.28:0/2486858820 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330002aa0 con 0x560f04fb10c0 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff30cce3640 1 -- 10.20.193.28:0/2486858820 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff3300ddcd0 con 0x560f04fb10c0 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.951+0000 7ff30cce3640 1 -- 10.20.193.28:0/2486858820 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3300ac170 con 0x560f04fb10c0 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 -- 10.20.193.28:0/2486858820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb10c0 msgr2=0x560f04fe18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 --2- 10.20.193.28:0/2486858820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb10c0 0x560f04fe18c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff3300a81c0 tx=0x7ff3300dda90 comp rx=0 tx=0).stop 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 -- 10.20.193.28:0/2486858820 shutdown_connections 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 --2- 10.20.193.28:0/2486858820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb5b60 0x560f04fd1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 --2- 10.20.193.28:0/2486858820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb1a70 0x560f04fe1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 --2- 10.20.193.28:0/2486858820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb10c0 0x560f04fe18c0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 -- 10.20.193.28:0/2486858820 >> 10.20.193.28:0/2486858820 conn(0x560f04fa9b60 msgr2=0x560f04fc6750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 -- 10.20.193.28:0/2486858820 shutdown_connections 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 -- 10.20.193.28:0/2486858820 wait complete. 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.952+0000 7ff349151e00 1 -- start start 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff349151e00 1 Processor -- start 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff349151e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb10c0 0x560f04fd0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff349151e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb1a70 0x560f04fd13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff349151e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f0503da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff349151e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e400e520 con 0x560f04fb5b60 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff349151e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e400f990 con 0x560f04fb10c0 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff349151e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e400ebf0 con 0x560f04fb1a70 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff3451c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f0503da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff3451c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f0503da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37042/0 (socket says 10.20.193.28:37042) 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff3451c2640 1 -- 10.20.193.28:0/1300473815 learned_addr learned my addr 10.20.193.28:0/1300473815 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff3451c2640 1 -- 10.20.193.28:0/1300473815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb1a70 msgr2=0x560f04fd13c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff3451c2640 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb1a70 0x560f04fd13c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff3451c2640 1 -- 10.20.193.28:0/1300473815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb10c0 msgr2=0x560f04fd0e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.953+0000 7ff3451c2640 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb10c0 0x560f04fd0e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff3451c2640 1 -- 10.20.193.28:0/1300473815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f04fc3560 con 0x560f04fb5b60 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff3451c2640 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f0503da70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff33c004820 tx=0x7ff33c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbf28b43f18f38d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff2fe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/1300473815 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c004920 con 0x560f04fb5b60 2026-02-20T03:20:59.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff349151e00 1 -- 10.20.193.28:0/1300473815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f04be2900 con 0x560f04fb5b60 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/1300473815 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff33c04b020 con 0x560f04fb5b60 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/1300473815 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0398f0 con 0x560f04fb5b60 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff349151e00 10 client.16965 _ll_register_callbacks cb 0x7ff32800be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff349151e00 1 -- 10.20.193.28:0/1300473815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff328004480 con 0x560f04fb5b60 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/1300473815 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff33c039a90 con 0x560f04fb5b60 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/1300473815 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff33c039d50 con 0x560f04fb5b60 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff349151e00 10 client.16965 fetch_fsmap learned FSMap version 29 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.954+0000 7ff349151e00 1 -- 10.20.193.28:0/1300473815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560f04ebe4d0 con 0x560f04fb5b60 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.955+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/1300473815 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff33c002c70 con 0x560f04fb5b60 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.955+0000 7ff349151e00 10 client.16965 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.955+0000 7ff349151e00 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.955+0000 7ff349151e00 20 client.16965 populate_metadata read hostname 'trial028' 2026-02-20T03:20:59.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.955+0000 7ff349151e00 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560f050469a0 0x560f05048e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:20:59.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.955+0000 7ff349151e00 4 client.16965 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:20:59.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.955+0000 7ff349151e00 1 -- 10.20.193.28:0/1300473815 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560f04c842b0 con 0x560f050469a0 2026-02-20T03:20:59.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:20:59.981+0000 7ff3449c1640 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560f050469a0 0x560f05048e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.048+0000 7ff3449c1640 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560f050469a0 0x560f05048e60 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eae59d776609619 server_cookie=d443b0f07f1fa13d in_seq=0 out_seq=0 2026-02-20T03:21:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.048+0000 7ff2fe7fc640 10 client.16965 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:00.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.061+0000 7ff2fe7fc640 1 -- 10.20.193.28:0/1300473815 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560f04c842b0 con 0x560f050469a0 2026-02-20T03:21:00.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.061+0000 7ff2fe7fc640 10 client.16965 handle_command_reply: tid=0 2026-02-20T03:21:00.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.061+0000 7ff349151e00 1 client.16965 shutdown 2026-02-20T03:21:00.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 -- 10.20.193.28:0/1300473815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 msgr2=0x560f0503da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:00.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f0503da70 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff33c004820 tx=0x7ff33c0099e0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 -- 10.20.193.28:0/1300473815 shutdown_connections 2026-02-20T03:21:00.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560f050469a0 0x560f05048e60 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff2fe7fc640 0 client.16965 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:00.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560f04fb5b60 0x560f0503da70 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560f04fb1a70 0x560f04fd13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 --2- 10.20.193.28:0/1300473815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560f04fb10c0 0x560f04fd0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 -- 10.20.193.28:0/1300473815 >> 10.20.193.28:0/1300473815 conn(0x560f04fa9b60 msgr2=0x560f04fc6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:00.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 -- 10.20.193.28:0/1300473815 shutdown_connections 2026-02-20T03:21:00.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 1 -- 10.20.193.28:0/1300473815 wait complete. 2026-02-20T03:21:00.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff349151e00 20 client.16965 trim_cache size 0 max 16384 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "907b60fd-b5e2-4be0-8c21-89a8e737ce2e", 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 -- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff31c0b0e20 msgr2=0x7ff31c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff31c0b0e20 0x7ff31c0b32e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff33c02f9a0 tx=0x7ff33c031040 comp rx=0 tx=0).stop 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 -- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340104980 msgr2=0x7ff34019d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340104980 0x7ff34019d1b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff33000b570 tx=0x7ff33000ba40 comp rx=0 tx=0).stop 2026-02-20T03:21:00.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 -- 10.20.193.28:0/528400797 shutdown_connections 2026-02-20T03:21:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff31c0b0e20 0x7ff31c0b32e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff34010a980 0x7ff3401a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff340105320 0x7ff34019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 --2- 10.20.193.28:0/528400797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff340104980 0x7ff34019d1b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.062+0000 7ff3459c3640 1 -- 10.20.193.28:0/528400797 >> 10.20.193.28:0/528400797 conn(0x7ff340100680 msgr2=0x7ff340100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.063+0000 7ff3459c3640 1 -- 10.20.193.28:0/528400797 shutdown_connections 2026-02-20T03:21:00.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.063+0000 7ff3459c3640 1 -- 10.20.193.28:0/528400797 wait complete. 2026-02-20T03:21:00.356 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:21:00.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 518951 7.77 MB/sec execute 153 sec latency 1688.043 ms 2026-02-20T03:21:00.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:00 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:21:00.531 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:00 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:00.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:00 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:21:00.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:00 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:00.667 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:21:00.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:00 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:21:00.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:00 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:00.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.975+0000 7fb17b3d6640 1 -- 10.20.193.28:0/567853628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 msgr2=0x7fb174106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:00.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.975+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/567853628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 0x7fb174106f30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb17000b0a0 tx=0x7fb17002f4e0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.975+0000 7fb17b3d6640 1 -- 10.20.193.28:0/567853628 shutdown_connections 2026-02-20T03:21:00.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.975+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/567853628 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 0x7fb174106f30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.975+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/567853628 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb174101f90 0x7fb174106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.975+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/567853628 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb174101670 0x7fb174101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.975+0000 7fb17b3d6640 1 -- 10.20.193.28:0/567853628 >> 10.20.193.28:0/567853628 conn(0x7fb1740fd2e0 msgr2=0x7fb1740ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:00.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.975+0000 7fb17b3d6640 1 -- 10.20.193.28:0/567853628 shutdown_connections 2026-02-20T03:21:00.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.975+0000 7fb17b3d6640 1 -- 10.20.193.28:0/567853628 wait complete. 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.976+0000 7fb17b3d6640 1 Processor -- start 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.976+0000 7fb17b3d6640 1 -- start start 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17b3d6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb174101670 0x7fb1741a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17b3d6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb174101f90 0x7fb1741a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17b3d6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 0x7fb1741a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17b3d6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb174119180 con 0x7fb174106a80 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17b3d6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb174119000 con 0x7fb174101670 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17b3d6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb174119300 con 0x7fb174101f90 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17abd5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 0x7fb1741a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:00.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17abd5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 0x7fb1741a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37062/0 (socket says 10.20.193.28:37062) 2026-02-20T03:21:00.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17abd5640 1 -- 10.20.193.28:0/3793598437 learned_addr learned my addr 10.20.193.28:0/3793598437 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:00.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17abd5640 1 -- 10.20.193.28:0/3793598437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb174101f90 msgr2=0x7fb1741a1c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:21:00.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17abd5640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb174101f90 0x7fb1741a1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17abd5640 1 -- 10.20.193.28:0/3793598437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb174101670 msgr2=0x7fb1741a1700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:21:00.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17abd5640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb174101670 0x7fb1741a1700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17abd5640 1 -- 10.20.193.28:0/3793598437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1741a6750 con 0x7fb174106a80 2026-02-20T03:21:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.977+0000 7fb17abd5640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 0x7fb1741a5fd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb17000b1d0 tx=0x7fb170004880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.978+0000 7fb15b7fe640 1 -- 10.20.193.28:0/3793598437 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170046070 con 0x7fb174106a80 2026-02-20T03:21:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.978+0000 7fb15b7fe640 1 -- 10.20.193.28:0/3793598437 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb1700075c0 con 0x7fb174106a80 2026-02-20T03:21:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.978+0000 7fb15b7fe640 1 -- 10.20.193.28:0/3793598437 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170037690 con 0x7fb174106a80 2026-02-20T03:21:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.978+0000 7fb17b3d6640 1 -- 10.20.193.28:0/3793598437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1741a69e0 con 0x7fb174106a80 2026-02-20T03:21:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.978+0000 7fb17b3d6640 1 -- 10.20.193.28:0/3793598437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1741ae280 con 0x7fb174106a80 2026-02-20T03:21:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.981+0000 7fb15b7fe640 1 -- 10.20.193.28:0/3793598437 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb170004b40 con 0x7fb174106a80 2026-02-20T03:21:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.981+0000 7fb17eb64e00 1 Processor -- start 2026-02-20T03:21:00.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb17eb64e00 1 -- start start 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x56546269b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695630 0x565462695a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695fb0 0x5654626a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x565462615e50 con 0x56546269b000 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5654625e89c0 con 0x565462695fb0 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x565462596240 con 0x565462695630 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb179bd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x56546269b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb179bd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x56546269b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37074/0 (socket says 10.20.193.28:37074) 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb179bd3640 1 -- 10.20.193.28:0/87488638 learned_addr learned my addr 10.20.193.28:0/87488638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb15b7fe640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1500b0e20 0x7fb1500b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb15b7fe640 1 -- 10.20.193.28:0/3793598437 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fb170105620 con 0x7fb174106a80 2026-02-20T03:21:00.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb179bd3640 1 -- 10.20.193.28:0/87488638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695630 msgr2=0x565462695a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb179bd3640 1 --2- 10.20.193.28:0/87488638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695630 0x565462695a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb179bd3640 1 -- 10.20.193.28:0/87488638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695fb0 msgr2=0x5654626a1e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb179bd3640 1 --2- 10.20.193.28:0/87488638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695fb0 0x5654626a1e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.982+0000 7fb179bd3640 1 -- 10.20.193.28:0/87488638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654625a9420 con 0x56546269b000 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.983+0000 7fb179bd3640 1 --2- 10.20.193.28:0/87488638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x56546269b3e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb1680098a0 tx=0x7fb168009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90da8b9fb4e071 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.983+0000 7fb17abd5640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1500b0e20 0x7fb1500b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.983+0000 7fb158cf3640 1 -- 10.20.193.28:0/87488638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168016070 con 0x56546269b000 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.983+0000 7fb158cf3640 1 -- 10.20.193.28:0/87488638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb1680044e0 con 0x56546269b000 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.983+0000 7fb17abd5640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1500b0e20 0x7fb1500b32e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb1700ca320 tx=0x7fb170009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.983+0000 7fb158cf3640 1 -- 10.20.193.28:0/87488638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168011400 con 0x56546269b000 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.983+0000 7fb17eb64e00 1 -- 10.20.193.28:0/87488638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 msgr2=0x56546269b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:00.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.983+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/87488638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x56546269b3e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb1680098a0 tx=0x7fb168009d70 comp rx=0 tx=0).stop 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.984+0000 7fb17eb64e00 1 -- 10.20.193.28:0/87488638 shutdown_connections 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.984+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/87488638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695fb0 0x5654626a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.984+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/87488638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695630 0x565462695a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.984+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/87488638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x56546269b3e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.984+0000 7fb17eb64e00 1 -- 10.20.193.28:0/87488638 >> 10.20.193.28:0/87488638 conn(0x565462658290 msgr2=0x565462693d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.984+0000 7fb17eb64e00 1 -- 10.20.193.28:0/87488638 shutdown_connections 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.984+0000 7fb17eb64e00 1 -- 10.20.193.28:0/87488638 wait complete. 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.985+0000 7fb17eb64e00 1 -- start start 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.985+0000 7fb17eb64e00 1 Processor -- start 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.985+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695630 0x5654626aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.985+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695fb0 0x5654626b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.985+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x5654626ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:00.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.985+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5654625e48f0 con 0x56546269b000 2026-02-20T03:21:00.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.985+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5654623d6f50 con 0x565462695630 2026-02-20T03:21:00.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.985+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5654626aed30 con 0x565462695fb0 2026-02-20T03:21:00.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb179bd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x5654626ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:00.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb179bd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x5654626ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37080/0 (socket says 10.20.193.28:37080) 2026-02-20T03:21:00.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb179bd3640 1 -- 10.20.193.28:0/3707347095 learned_addr learned my addr 10.20.193.28:0/3707347095 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:00.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb179bd3640 1 -- 10.20.193.28:0/3707347095 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695fb0 msgr2=0x5654626b0480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:00.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb179bd3640 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695fb0 0x5654626b0480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb179bd3640 1 -- 10.20.193.28:0/3707347095 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695630 msgr2=0x5654626aff40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:01.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb179bd3640 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695630 0x5654626aff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb179bd3640 1 -- 10.20.193.28:0/3707347095 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654626a7b20 con 0x56546269b000 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb179bd3640 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x5654626ae6f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb16800bca0 tx=0x7fb16800bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f67a9239f92080 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb127fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb127fff640 1 -- 10.20.193.28:0/3707347095 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16801f070 con 0x56546269b000 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb127fff640 1 -- 10.20.193.28:0/3707347095 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb1680094f0 con 0x56546269b000 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb127fff640 1 -- 10.20.193.28:0/3707347095 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168016040 con 0x56546269b000 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb17eb64e00 1 -- 10.20.193.28:0/3707347095 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654623b9b40 con 0x56546269b000 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.986+0000 7fb127fff640 1 -- 10.20.193.28:0/3707347095 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fb168011c40 con 0x56546269b000 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb127fff640 10 client.16977 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 10 client.16977 _ll_register_callbacks cb 0x565462621f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 1 -- 10.20.193.28:0/3707347095 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654625f61a0 con 0x56546269b000 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb127fff640 1 -- 10.20.193.28:0/3707347095 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb168011e40 con 0x56546269b000 2026-02-20T03:21:01.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 10 client.16977 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:01.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 1 -- 10.20.193.28:0/3707347095 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5654625a3230 con 0x56546269b000 2026-02-20T03:21:01.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb127fff640 1 -- 10.20.193.28:0/3707347095 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fb168019070 con 0x56546269b000 2026-02-20T03:21:01.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 10 client.16977 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:01.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 10 client.16977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:01.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 20 client.16977 populate_metadata read hostname 'trial028' 2026-02-20T03:21:01.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5654626be610 0x5654626c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:01.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 4 client.16977 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:01.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:00.987+0000 7fb17eb64e00 1 -- 10.20.193.28:0/3707347095 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654625f05b0 con 0x5654626be610 2026-02-20T03:21:01.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.012+0000 7fb17a3d4640 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5654626be610 0x5654626c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:01.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.078+0000 7fb17a3d4640 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5654626be610 0x5654626c0a00 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29375a7c3d4e496b server_cookie=1827ce3bda0aabc6 in_seq=0 out_seq=0 2026-02-20T03:21:01.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.078+0000 7fb127fff640 10 client.16977 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:01.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb127fff640 1 -- 10.20.193.28:0/3707347095 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5654625f05b0 con 0x5654626be610 2026-02-20T03:21:01.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb127fff640 10 client.16977 handle_command_reply: tid=0 2026-02-20T03:21:01.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 client.16977 shutdown 2026-02-20T03:21:01.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 -- 10.20.193.28:0/3707347095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 msgr2=0x5654626ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x5654626ae6f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb16800bca0 tx=0x7fb16800bcd0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 -- 10.20.193.28:0/3707347095 shutdown_connections 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5654626be610 0x5654626c0a00 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56546269b000 0x5654626ae6f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695fb0 0x5654626b0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/3707347095 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695630 0x5654626aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 -- 10.20.193.28:0/3707347095 >> 10.20.193.28:0/3707347095 conn(0x565462658290 msgr2=0x565462694440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb127fff640 0 client.16977 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 -- 10.20.193.28:0/3707347095 shutdown_connections 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 1 -- 10.20.193.28:0/3707347095 wait complete. 2026-02-20T03:21:01.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.092+0000 7fb17eb64e00 20 client.16977 trim_cache size 0 max 16384 2026-02-20T03:21:01.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb17eb64e00 1 Processor -- start 2026-02-20T03:21:01.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb17eb64e00 1 -- start start 2026-02-20T03:21:01.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x56546268dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:01.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695fb0 0x5654626ad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:01.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56546269b000 0x5654626c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:01.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c012600 con 0x565462695630 2026-02-20T03:21:01.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c00fed0 con 0x565462695fb0 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c00dd20 con 0x56546269b000 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb179bd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x56546268dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb179bd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x56546268dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37088/0 (socket says 10.20.193.28:37088) 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb179bd3640 1 -- 10.20.193.28:0/1921218149 learned_addr learned my addr 10.20.193.28:0/1921218149 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb179bd3640 1 -- 10.20.193.28:0/1921218149 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56546269b000 msgr2=0x5654626c61b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb179bd3640 1 --2- 10.20.193.28:0/1921218149 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56546269b000 0x5654626c61b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb179bd3640 1 -- 10.20.193.28:0/1921218149 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695fb0 msgr2=0x5654626ad600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb179bd3640 1 --2- 10.20.193.28:0/1921218149 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695fb0 0x5654626ad600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.101+0000 7fb179bd3640 1 -- 10.20.193.28:0/1921218149 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654626a7950 con 0x565462695630 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb179bd3640 1 --2- 10.20.193.28:0/1921218149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x56546268dd50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb168009680 tx=0x7fb16800b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a372cd14fe492ca server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb1424e6640 1 -- 10.20.193.28:0/1921218149 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168016070 con 0x565462695630 2026-02-20T03:21:01.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb1424e6640 1 -- 10.20.193.28:0/1921218149 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5654625f61a0 con 0x565462695630 2026-02-20T03:21:01.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb1424e6640 1 -- 10.20.193.28:0/1921218149 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16801f040 con 0x565462695630 2026-02-20T03:21:01.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb17eb64e00 1 -- 10.20.193.28:0/1921218149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 msgr2=0x56546268dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:01.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/1921218149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x56546268dd50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb168009680 tx=0x7fb16800b020 comp rx=0 tx=0).stop 2026-02-20T03:21:01.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb17eb64e00 1 -- 10.20.193.28:0/1921218149 shutdown_connections 2026-02-20T03:21:01.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/1921218149 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56546269b000 0x5654626c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/1921218149 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565462695fb0 0x5654626ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/1921218149 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x56546268dd50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb17eb64e00 1 -- 10.20.193.28:0/1921218149 >> 10.20.193.28:0/1921218149 conn(0x565462658290 msgr2=0x5654626acef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:01.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb17eb64e00 1 -- 10.20.193.28:0/1921218149 shutdown_connections 2026-02-20T03:21:01.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.102+0000 7fb17eb64e00 1 -- 10.20.193.28:0/1921218149 wait complete. 2026-02-20T03:21:01.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb17eb64e00 1 -- start start 2026-02-20T03:21:01.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb17eb64e00 1 Processor -- start 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x5654626b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695fb0 0x5654626b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb17eb64e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56546269b000 0x565462722360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c00e390 con 0x565462695630 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c00f800 con 0x56546269b000 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb17eb64e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb11c00ea60 con 0x565462695fb0 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb179bd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x5654626b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb179bd3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x5654626b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37090/0 (socket says 10.20.193.28:37090) 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb179bd3640 1 -- 10.20.193.28:0/4184282603 learned_addr learned my addr 10.20.193.28:0/4184282603 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb179bd3640 1 -- 10.20.193.28:0/4184282603 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695fb0 msgr2=0x5654626b4a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:01.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb179bd3640 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695fb0 0x5654626b4a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb179bd3640 1 -- 10.20.193.28:0/4184282603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56546269b000 msgr2=0x565462722360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb179bd3640 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56546269b000 0x565462722360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.103+0000 7fb179bd3640 1 -- 10.20.193.28:0/4184282603 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654622c7870 con 0x565462695630 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb179bd3640 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x5654626b44c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb168009580 tx=0x7fb1680095b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848bfd317309d850 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb127fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb127fff640 1 -- 10.20.193.28:0/4184282603 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168031030 con 0x565462695630 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb127fff640 1 -- 10.20.193.28:0/4184282603 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb168002d60 con 0x565462695630 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb127fff640 1 -- 10.20.193.28:0/4184282603 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168016070 con 0x565462695630 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb17eb64e00 1 -- 10.20.193.28:0/4184282603 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565462588440 con 0x565462695630 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb127fff640 1 -- 10.20.193.28:0/4184282603 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fb16802d730 con 0x565462695630 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb17eb64e00 10 client.16983 _ll_register_callbacks cb 0x7fb168014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb17eb64e00 1 -- 10.20.193.28:0/4184282603 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654625b9810 con 0x565462695630 2026-02-20T03:21:01.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb127fff640 1 -- 10.20.193.28:0/4184282603 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb16801f040 con 0x565462695630 2026-02-20T03:21:01.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb17eb64e00 10 client.16983 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:01.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.104+0000 7fb17eb64e00 1 -- 10.20.193.28:0/4184282603 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5654626a8640 con 0x565462695630 2026-02-20T03:21:01.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.105+0000 7fb127fff640 1 -- 10.20.193.28:0/4184282603 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fb168019070 con 0x565462695630 2026-02-20T03:21:01.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.105+0000 7fb17eb64e00 10 client.16983 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:01.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.105+0000 7fb17eb64e00 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:01.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.105+0000 7fb17eb64e00 20 client.16983 populate_metadata read hostname 'trial028' 2026-02-20T03:21:01.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.105+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565462729b50 0x56546272bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:01.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.105+0000 7fb17eb64e00 4 client.16983 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:21:01.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.105+0000 7fb17eb64e00 1 -- 10.20.193.28:0/4184282603 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56546259ab00 con 0x565462729b50 2026-02-20T03:21:01.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.119+0000 7fb17a3d4640 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565462729b50 0x56546272bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:01.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.185+0000 7fb17a3d4640 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565462729b50 0x56546272bfe0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f37589c3858c8f2 server_cookie=911701a3367f427c in_seq=0 out_seq=0 2026-02-20T03:21:01.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.185+0000 7fb127fff640 10 client.16983 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:01.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb127fff640 1 -- 10.20.193.28:0/4184282603 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x56546259ab00 con 0x565462729b50 2026-02-20T03:21:01.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb127fff640 10 client.16983 handle_command_reply: tid=0 2026-02-20T03:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 client.16983 shutdown 2026-02-20T03:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 -- 10.20.193.28:0/4184282603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 msgr2=0x5654626b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x5654626b44c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb168009580 tx=0x7fb1680095b0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 -- 10.20.193.28:0/4184282603 shutdown_connections 2026-02-20T03:21:01.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565462729b50 0x56546272bfe0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56546269b000 0x565462722360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565462695fb0 0x5654626b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 --2- 10.20.193.28:0/4184282603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565462695630 0x5654626b44c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 -- 10.20.193.28:0/4184282603 >> 10.20.193.28:0/4184282603 conn(0x565462658290 msgr2=0x5654626ad710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:01.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb127fff640 0 client.16983 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:01.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 -- 10.20.193.28:0/4184282603 shutdown_connections 2026-02-20T03:21:01.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 1 -- 10.20.193.28:0/4184282603 wait complete. 2026-02-20T03:21:01.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.199+0000 7fb17eb64e00 20 client.16983 trim_cache size 0 max 16384 2026-02-20T03:21:01.204 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:21:01.204 INFO:teuthology.orchestra.run.trial028.stdout: "status": "scrub active (0 inodes in the stack)", 2026-02-20T03:21:01.204 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:21:01.204 INFO:teuthology.orchestra.run.trial028.stdout: "907b60fd-b5e2-4be0-8c21-89a8e737ce2e": { 2026-02-20T03:21:01.204 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:21:01.204 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "907b60fd-b5e2-4be0-8c21-89a8e737ce2e", 2026-02-20T03:21:01.204 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:21:01.204 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:21:01.205 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:21:01.205 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:21:01.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 -- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1500b0e20 msgr2=0x7fb1500b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:01.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1500b0e20 0x7fb1500b32e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb1700ca320 tx=0x7fb170009040 comp rx=0 tx=0).stop 2026-02-20T03:21:01.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 -- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 msgr2=0x7fb1741a5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:01.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 0x7fb1741a5fd0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb17000b1d0 tx=0x7fb170004880 comp rx=0 tx=0).stop 2026-02-20T03:21:01.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 -- 10.20.193.28:0/3793598437 shutdown_connections 2026-02-20T03:21:01.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1500b0e20 0x7fb1500b32e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb174106a80 0x7fb1741a5fd0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb174101f90 0x7fb1741a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 --2- 10.20.193.28:0/3793598437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb174101670 0x7fb1741a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:01.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 -- 10.20.193.28:0/3793598437 >> 10.20.193.28:0/3793598437 conn(0x7fb1740fd2e0 msgr2=0x7fb1741105c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:01.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 -- 10.20.193.28:0/3793598437 shutdown_connections 2026-02-20T03:21:01.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:01.200+0000 7fb17b3d6640 1 -- 10.20.193.28:0/3793598437 wait complete. 2026-02-20T03:21:01.425 INFO:tasks.cephfs.filesystem:scrub status for tag:907b60fd-b5e2-4be0-8c21-89a8e737ce2e - {'path': '/', 'tag': '907b60fd-b5e2-4be0-8c21-89a8e737ce2e', 'options': 'recursive,force'} 2026-02-20T03:21:01.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 518954 7.72 MB/sec execute 154 sec latency 2088.243 ms 2026-02-20T03:21:01.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:01 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:21:01.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:01 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:01.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:01 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:21:01.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:01 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:21:01.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:01 trial028 ceph-mon[38552]: pgmap v371: 129 pgs: 129 active+clean; 85 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 672 KiB/s rd, 3.9 MiB/s wr, 379 op/s 2026-02-20T03:21:01.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:01 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:01.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:01 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:21:01.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:01 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:01.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:01 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:21:01.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:01 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:21:01.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:01 trial126 ceph-mon[38476]: pgmap v371: 129 pgs: 129 active+clean; 85 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 672 KiB/s rd, 3.9 MiB/s wr, 379 op/s 2026-02-20T03:21:01.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:01 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:01 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:21:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:01 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:01 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:21:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:01 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:21:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:01 trial177 ceph-mon[43181]: pgmap v371: 129 pgs: 129 active+clean; 85 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 672 KiB/s rd, 3.9 MiB/s wr, 379 op/s 2026-02-20T03:21:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:01 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:02.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 518954 7.67 MB/sec execute 155 sec latency 1599.840 ms 2026-02-20T03:21:03.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 518954 7.62 MB/sec execute 156 sec latency 2599.906 ms 2026-02-20T03:21:03.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:03 trial028 ceph-mon[38552]: pgmap v372: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 319 KiB/s rd, 3.4 MiB/s wr, 276 op/s 2026-02-20T03:21:03.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:03 trial126 ceph-mon[38476]: pgmap v372: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 319 KiB/s rd, 3.4 MiB/s wr, 276 op/s 2026-02-20T03:21:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:03 trial177 ceph-mon[43181]: pgmap v372: 129 pgs: 129 active+clean; 83 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 319 KiB/s rd, 3.4 MiB/s wr, 276 op/s 2026-02-20T03:21:04.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 518954 7.57 MB/sec execute 157 sec latency 3599.959 ms 2026-02-20T03:21:05.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:05 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:05.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:05 trial028 ceph-mon[38552]: pgmap v373: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 400 KiB/s rd, 3.1 MiB/s wr, 273 op/s 2026-02-20T03:21:05.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 518954 7.52 MB/sec execute 158 sec latency 4600.014 ms 2026-02-20T03:21:05.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:05 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:05.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:05 trial126 ceph-mon[38476]: pgmap v373: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 400 KiB/s rd, 3.1 MiB/s wr, 273 op/s 2026-02-20T03:21:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:05 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:05 trial177 ceph-mon[43181]: pgmap v373: 129 pgs: 129 active+clean; 84 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 400 KiB/s rd, 3.1 MiB/s wr, 273 op/s 2026-02-20T03:21:06.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 519272 7.48 MB/sec execute 159 sec latency 5103.619 ms 2026-02-20T03:21:07.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 523128 7.56 MB/sec execute 160 sec latency 10.303 ms 2026-02-20T03:21:07.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:07 trial126 ceph-mon[38476]: pgmap v374: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 230 KiB/s rd, 3.3 MiB/s wr, 247 op/s 2026-02-20T03:21:07.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:07 trial028 ceph-mon[38552]: pgmap v374: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 230 KiB/s rd, 3.3 MiB/s wr, 247 op/s 2026-02-20T03:21:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:07 trial177 ceph-mon[43181]: pgmap v374: 129 pgs: 129 active+clean; 82 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 230 KiB/s rd, 3.3 MiB/s wr, 247 op/s 2026-02-20T03:21:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.731+0000 7fd963fff640 1 -- 10.20.193.28:0/1870160428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96410a5d0 msgr2=0x7fd96410ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.731+0000 7fd963fff640 1 --2- 10.20.193.28:0/1870160428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96410a5d0 0x7fd96410ca70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd954009960 tx=0x7fd95402f140 comp rx=0 tx=0).stop 2026-02-20T03:21:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.731+0000 7fd963fff640 1 -- 10.20.193.28:0/1870160428 shutdown_connections 2026-02-20T03:21:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.731+0000 7fd963fff640 1 --2- 10.20.193.28:0/1870160428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96410a5d0 0x7fd96410ca70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.731+0000 7fd963fff640 1 --2- 10.20.193.28:0/1870160428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd964075a00 0x7fd964075e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.731+0000 7fd963fff640 1 --2- 10.20.193.28:0/1870160428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd964077070 0x7fd9640754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.731+0000 7fd963fff640 1 -- 10.20.193.28:0/1870160428 >> 10.20.193.28:0/1870160428 conn(0x7fd9640fde10 msgr2=0x7fd964100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.731+0000 7fd963fff640 1 -- 10.20.193.28:0/1870160428 shutdown_connections 2026-02-20T03:21:07.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.731+0000 7fd963fff640 1 -- 10.20.193.28:0/1870160428 wait complete. 2026-02-20T03:21:07.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd963fff640 1 Processor -- start 2026-02-20T03:21:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd963fff640 1 -- start start 2026-02-20T03:21:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd963fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd964075a00 0x7fd96419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd963fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd964077070 0x7fd96419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd963fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96410a5d0 0x7fd9641a3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd963fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd964110420 con 0x7fd964075a00 2026-02-20T03:21:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd963fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd9641102a0 con 0x7fd96410a5d0 2026-02-20T03:21:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd963fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd9641105a0 con 0x7fd964077070 2026-02-20T03:21:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd962ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd964075a00 0x7fd96419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd9637fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96410a5d0 0x7fd9641a3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd962ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd964075a00 0x7fd96419ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43284/0 (socket says 10.20.193.28:43284) 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd962ffd640 1 -- 10.20.193.28:0/2527302063 learned_addr learned my addr 10.20.193.28:0/2527302063 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.732+0000 7fd9627fc640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd964077070 0x7fd96419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd962ffd640 1 -- 10.20.193.28:0/2527302063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd964077070 msgr2=0x7fd96419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd962ffd640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd964077070 0x7fd96419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd962ffd640 1 -- 10.20.193.28:0/2527302063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96410a5d0 msgr2=0x7fd9641a3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd962ffd640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96410a5d0 0x7fd9641a3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd962ffd640 1 -- 10.20.193.28:0/2527302063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9641a46b0 con 0x7fd964075a00 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd9627fc640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd964077070 0x7fd96419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd962ffd640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd964075a00 0x7fd96419ca00 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c0c0 tx=0x7fd95800c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd943fff640 1 -- 10.20.193.28:0/2527302063 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958019070 con 0x7fd964075a00 2026-02-20T03:21:07.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd943fff640 1 -- 10.20.193.28:0/2527302063 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd9580092d0 con 0x7fd964075a00 2026-02-20T03:21:07.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd943fff640 1 -- 10.20.193.28:0/2527302063 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580075c0 con 0x7fd964075a00 2026-02-20T03:21:07.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd963fff640 1 -- 10.20.193.28:0/2527302063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9641a4940 con 0x7fd964075a00 2026-02-20T03:21:07.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.733+0000 7fd963fff640 1 -- 10.20.193.28:0/2527302063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9641a4e40 con 0x7fd964075a00 2026-02-20T03:21:07.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.736+0000 7fd943fff640 1 -- 10.20.193.28:0/2527302063 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd958004160 con 0x7fd964075a00 2026-02-20T03:21:07.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.736+0000 7fd96c661e00 1 Processor -- start 2026-02-20T03:21:07.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.736+0000 7fd96c661e00 1 -- start start 2026-02-20T03:21:07.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.736+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f12280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.736+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f16f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 0x555ce8f199f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd96c661e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555ce8e628f0 con 0x555ce8f17560 2026-02-20T03:21:07.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd96c661e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555ce8e102e0 con 0x555ce8f127c0 2026-02-20T03:21:07.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd96c661e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555ce8e5e820 con 0x555ce8f11e80 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9637fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f12280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9637fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f12280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60994/0 (socket says 10.20.193.28:60994) 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9637fe640 1 -- 10.20.193.28:0/3409608223 learned_addr learned my addr 10.20.193.28:0/3409608223 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9627fc640 1 --2- 10.20.193.28:0/3409608223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 0x555ce8f199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd962ffd640 1 --2- 10.20.193.28:0/3409608223 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f16f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9627fc640 1 -- 10.20.193.28:0/3409608223 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 msgr2=0x555ce8f12280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9627fc640 1 --2- 10.20.193.28:0/3409608223 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f12280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9627fc640 1 -- 10.20.193.28:0/3409608223 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 msgr2=0x555ce8f16f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9627fc640 1 --2- 10.20.193.28:0/3409608223 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f16f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9627fc640 1 -- 10.20.193.28:0/3409608223 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ce8e025a0 con 0x555ce8f17560 2026-02-20T03:21:07.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd943fff640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9340b0e20 0x7fd9340b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd943fff640 1 -- 10.20.193.28:0/2527302063 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd9580e0980 con 0x7fd964075a00 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9627fc640 1 --2- 10.20.193.28:0/3409608223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 0x555ce8f199f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd964077500 tx=0x7fd94c002c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7076aaec3bc5e7d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.737+0000 7fd9637fe640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9340b0e20 0x7fd9340b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd92b7fe640 1 -- 10.20.193.28:0/3409608223 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c002e60 con 0x555ce8f17560 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd92b7fe640 1 -- 10.20.193.28:0/3409608223 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd94c015070 con 0x555ce8f17560 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd92b7fe640 1 -- 10.20.193.28:0/3409608223 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c010680 con 0x555ce8f17560 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd96c661e00 1 -- 10.20.193.28:0/3409608223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 msgr2=0x555ce8f199f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd96c661e00 1 --2- 10.20.193.28:0/3409608223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 0x555ce8f199f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fd964077500 tx=0x7fd94c002c00 comp rx=0 tx=0).stop 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd9637fe640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9340b0e20 0x7fd9340b32e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd9540096f0 tx=0x7fd954031040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd96c661e00 1 -- 10.20.193.28:0/3409608223 shutdown_connections 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd96c661e00 1 --2- 10.20.193.28:0/3409608223 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 0x555ce8f199f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd96c661e00 1 --2- 10.20.193.28:0/3409608223 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f16f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd96c661e00 1 --2- 10.20.193.28:0/3409608223 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f12280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd96c661e00 1 -- 10.20.193.28:0/3409608223 >> 10.20.193.28:0/3409608223 conn(0x555ce8f096f0 msgr2=0x555ce8f10570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:07.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd96c661e00 1 -- 10.20.193.28:0/3409608223 shutdown_connections 2026-02-20T03:21:07.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.738+0000 7fd96c661e00 1 -- 10.20.193.28:0/3409608223 wait complete. 2026-02-20T03:21:07.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.739+0000 7fd96c661e00 1 -- start start 2026-02-20T03:21:07.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.739+0000 7fd96c661e00 1 Processor -- start 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f11e80 0x555ce8f2a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f127c0 0x555ce8f2ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 0x555ce8f31bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd96c661e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555ce8e0a0c0 con 0x555ce8f17560 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd96c661e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555ce8f1a610 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd96c661e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555ce8f32160 con 0x555ce8f127c0 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd962ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f11e80 0x555ce8f2a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd962ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f11e80 0x555ce8f2a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60180/0 (socket says 10.20.193.28:60180) 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd962ffd640 1 -- 10.20.193.28:0/58462465 learned_addr learned my addr 10.20.193.28:0/58462465 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd9627fc640 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f127c0 0x555ce8f2ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd9637fe640 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 0x555ce8f31bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd962ffd640 1 -- 10.20.193.28:0/58462465 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f127c0 msgr2=0x555ce8f2ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd962ffd640 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f127c0 0x555ce8f2ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd962ffd640 1 -- 10.20.193.28:0/58462465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 msgr2=0x555ce8f31bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd962ffd640 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 0x555ce8f31bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.740+0000 7fd962ffd640 1 -- 10.20.193.28:0/58462465 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ce8f242b0 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd962ffd640 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f11e80 0x555ce8f2a7f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9580090a0 tx=0x7fd9580a3d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c030c22301735cbf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd928ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd928ff9640 1 -- 10.20.193.28:0/58462465 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580a7e10 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd928ff9640 1 -- 10.20.193.28:0/58462465 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd9580aca10 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd928ff9640 1 -- 10.20.193.28:0/58462465 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580a7c30 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd96c661e00 1 -- 10.20.193.28:0/58462465 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ce8e1e820 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd928ff9640 1 -- 10.20.193.28:0/58462465 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd9580ac4d0 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd96c661e00 10 client.26516 _ll_register_callbacks cb 0x555ce8e0dff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd96c661e00 1 -- 10.20.193.28:0/58462465 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555ce8e6a4e0 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd928ff9640 1 -- 10.20.193.28:0/58462465 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd9580e2e60 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd96c661e00 10 client.26516 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd96c661e00 1 -- 10.20.193.28:0/58462465 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555ce8e23380 con 0x555ce8f11e80 2026-02-20T03:21:07.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.741+0000 7fd928ff9640 1 -- 10.20.193.28:0/58462465 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd9580ac160 con 0x555ce8f11e80 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.742+0000 7fd96c661e00 10 client.26516 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.742+0000 7fd96c661e00 10 client.26516 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.742+0000 7fd96c661e00 20 client.26516 populate_metadata read hostname 'trial028' 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.742+0000 7fd96c661e00 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555ce8f36440 0x555ce8f388d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.742+0000 7fd96c661e00 4 client.26516 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.742+0000 7fd96c661e00 1 -- 10.20.193.28:0/58462465 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ce8de4bd0 con 0x555ce8f36440 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.742+0000 7fd9627fc640 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555ce8f36440 0x555ce8f388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.742+0000 7fd9627fc640 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555ce8f36440 0x555ce8f388d0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d471730a76ad0af0 server_cookie=fd4338299b2f9010 in_seq=0 out_seq=0 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.742+0000 7fd928ff9640 10 client.26516 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd928ff9640 1 -- 10.20.193.28:0/58462465 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555ce8de4bd0 con 0x555ce8f36440 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd928ff9640 10 client.26516 handle_command_reply: tid=0 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 client.26516 shutdown 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 -- 10.20.193.28:0/58462465 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f11e80 msgr2=0x555ce8f2a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f11e80 0x555ce8f2a7f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd9580090a0 tx=0x7fd9580a3d30 comp rx=0 tx=0).stop 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 -- 10.20.193.28:0/58462465 shutdown_connections 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555ce8f36440 0x555ce8f388d0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f17560 0x555ce8f31bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f127c0 0x555ce8f2ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 --2- 10.20.193.28:0/58462465 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f11e80 0x555ce8f2a7f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 -- 10.20.193.28:0/58462465 >> 10.20.193.28:0/58462465 conn(0x555ce8f096f0 msgr2=0x555ce8f18870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd928ff9640 0 client.26516 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 -- 10.20.193.28:0/58462465 shutdown_connections 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 1 -- 10.20.193.28:0/58462465 wait complete. 2026-02-20T03:21:07.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.743+0000 7fd96c661e00 20 client.26516 trim_cache size 0 max 16384 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.750+0000 7fd96c661e00 1 Processor -- start 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.750+0000 7fd96c661e00 1 -- start start 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.750+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f28db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.750+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f127c0 0x555ce8f31b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.750+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f17560 0x555ce8f28360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.750+0000 7fd96c661e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd9080126f0 con 0x555ce8f127c0 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.750+0000 7fd96c661e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd90800ffc0 con 0x555ce8f17560 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.750+0000 7fd96c661e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd90800de10 con 0x555ce8f11e80 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd962ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f28db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd9627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f127c0 0x555ce8f31b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd962ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f28db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:32768/0 (socket says 10.20.193.28:32768) 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd962ffd640 1 -- 10.20.193.28:0/2524260723 learned_addr learned my addr 10.20.193.28:0/2524260723 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd9637fe640 1 --2- 10.20.193.28:0/2524260723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f17560 0x555ce8f28360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd9627fc640 1 -- 10.20.193.28:0/2524260723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 msgr2=0x555ce8f28db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd9627fc640 1 --2- 10.20.193.28:0/2524260723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f28db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd9627fc640 1 -- 10.20.193.28:0/2524260723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f17560 msgr2=0x555ce8f28360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd9627fc640 1 --2- 10.20.193.28:0/2524260723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f17560 0x555ce8f28360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd9627fc640 1 -- 10.20.193.28:0/2524260723 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ce8f240e0 con 0x555ce8f127c0 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd962ffd640 1 --2- 10.20.193.28:0/2524260723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f28db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd9627fc640 1 --2- 10.20.193.28:0/2524260723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f127c0 0x555ce8f31b90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x555ce8f2bb30 tx=0x7fd94c01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b191ba76e8526e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd92affd640 1 -- 10.20.193.28:0/2524260723 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c002e60 con 0x555ce8f127c0 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd92affd640 1 -- 10.20.193.28:0/2524260723 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd94c004380 con 0x555ce8f127c0 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.751+0000 7fd92affd640 1 -- 10.20.193.28:0/2524260723 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c005600 con 0x555ce8f127c0 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 -- 10.20.193.28:0/2524260723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f127c0 msgr2=0x555ce8f31b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 --2- 10.20.193.28:0/2524260723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f127c0 0x555ce8f31b90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x555ce8f2bb30 tx=0x7fd94c01c040 comp rx=0 tx=0).stop 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 -- 10.20.193.28:0/2524260723 shutdown_connections 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 --2- 10.20.193.28:0/2524260723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f17560 0x555ce8f28360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 --2- 10.20.193.28:0/2524260723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f127c0 0x555ce8f31b90 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 --2- 10.20.193.28:0/2524260723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f11e80 0x555ce8f28db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 -- 10.20.193.28:0/2524260723 >> 10.20.193.28:0/2524260723 conn(0x555ce8f096f0 msgr2=0x555ce8f2a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 -- 10.20.193.28:0/2524260723 shutdown_connections 2026-02-20T03:21:07.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 -- 10.20.193.28:0/2524260723 wait complete. 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 -- start start 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.752+0000 7fd96c661e00 1 Processor -- start 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f11e80 0x555ce8f313f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f31930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd96c661e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f17560 0x555ce8f2de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9627fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f31930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd96c661e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd90800e480 con 0x555ce8f11e80 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd96c661e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd90800f8f0 con 0x555ce8f127c0 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd962ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f11e80 0x555ce8f313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd96c661e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd90800eb50 con 0x555ce8f17560 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9627fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f31930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60212/0 (socket says 10.20.193.28:60212) 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9627fc640 1 -- 10.20.193.28:0/1374102968 learned_addr learned my addr 10.20.193.28:0/1374102968 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9637fe640 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f17560 0x555ce8f2de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9627fc640 1 -- 10.20.193.28:0/1374102968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f17560 msgr2=0x555ce8f2de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9627fc640 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f17560 0x555ce8f2de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9627fc640 1 -- 10.20.193.28:0/1374102968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f11e80 msgr2=0x555ce8f313f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:07.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9627fc640 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f11e80 0x555ce8f313f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9627fc640 1 -- 10.20.193.28:0/1374102968 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ce8f33360 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd962ffd640 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f11e80 0x555ce8f313f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd9627fc640 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f31930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd94c002c40 tx=0x7fd94c011e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69780e6e6c186bdf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.753+0000 7fd928ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd928ff9640 1 -- 10.20.193.28:0/1374102968 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c009d40 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 1 -- 10.20.193.28:0/1374102968 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ce8bc2690 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 10 client.26522 _ll_register_callbacks cb 0x7fd958009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 1 -- 10.20.193.28:0/1374102968 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd94c015070 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd928ff9640 1 -- 10.20.193.28:0/1374102968 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd94c011440 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd928ff9640 1 -- 10.20.193.28:0/1374102968 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c004940 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd928ff9640 1 -- 10.20.193.28:0/1374102968 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd94c004ae0 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd928ff9640 1 -- 10.20.193.28:0/1374102968 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd94c004de0 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 10 client.26522 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 1 -- 10.20.193.28:0/1374102968 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x555ce8e27b70 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd928ff9640 1 -- 10.20.193.28:0/1374102968 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd94c02c020 con 0x555ce8f127c0 2026-02-20T03:21:07.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 10 client.26522 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:07.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 10 client.26522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:07.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 20 client.26522 populate_metadata read hostname 'trial028' 2026-02-20T03:21:07.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555ce8fa20c0 0x555ce8fa4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:07.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 4 client.26522 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:21:07.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd96c661e00 1 -- 10.20.193.28:0/1374102968 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555ce8e336b0 con 0x555ce8fa20c0 2026-02-20T03:21:07.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.754+0000 7fd962ffd640 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555ce8fa20c0 0x555ce8fa4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:07.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.755+0000 7fd928ff9640 10 client.26522 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:07.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.755+0000 7fd962ffd640 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555ce8fa20c0 0x555ce8fa4550 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eee0e7182350528 server_cookie=8f5211476c92f3b9 in_seq=0 out_seq=0 2026-02-20T03:21:07.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd928ff9640 1 -- 10.20.193.28:0/1374102968 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555ce8e336b0 con 0x555ce8fa20c0 2026-02-20T03:21:07.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd928ff9640 10 client.26522 handle_command_reply: tid=0 2026-02-20T03:21:07.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 client.26522 shutdown 2026-02-20T03:21:07.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 -- 10.20.193.28:0/1374102968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 msgr2=0x555ce8f31930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f31930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd94c002c40 tx=0x7fd94c011e30 comp rx=0 tx=0).stop 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 -- 10.20.193.28:0/1374102968 shutdown_connections 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555ce8fa20c0 0x555ce8fa4550 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555ce8f17560 0x555ce8f2de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555ce8f127c0 0x555ce8f31930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 --2- 10.20.193.28:0/1374102968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555ce8f11e80 0x555ce8f313f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 -- 10.20.193.28:0/1374102968 >> 10.20.193.28:0/1374102968 conn(0x555ce8f096f0 msgr2=0x555ce8f27350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd928ff9640 0 client.26522 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 -- 10.20.193.28:0/1374102968 shutdown_connections 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 1 -- 10.20.193.28:0/1374102968 wait complete. 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.788+0000 7fd96c661e00 20 client.26522 trim_cache size 0 max 16384 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 -- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9340b0e20 msgr2=0x7fd9340b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9340b0e20 0x7fd9340b32e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd9540096f0 tx=0x7fd954031040 comp rx=0 tx=0).stop 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 -- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd964075a00 msgr2=0x7fd96419ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:07.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd964075a00 0x7fd96419ca00 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c0c0 tx=0x7fd95800c590 comp rx=0 tx=0).stop 2026-02-20T03:21:07.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 -- 10.20.193.28:0/2527302063 shutdown_connections 2026-02-20T03:21:07.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9340b0e20 0x7fd9340b32e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96410a5d0 0x7fd9641a3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd964077070 0x7fd96419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 --2- 10.20.193.28:0/2527302063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd964075a00 0x7fd96419ca00 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:07.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.789+0000 7fd963fff640 1 -- 10.20.193.28:0/2527302063 >> 10.20.193.28:0/2527302063 conn(0x7fd9640fde10 msgr2=0x7fd9641065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:07.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.790+0000 7fd963fff640 1 -- 10.20.193.28:0/2527302063 shutdown_connections 2026-02-20T03:21:07.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:07.790+0000 7fd963fff640 1 -- 10.20.193.28:0/2527302063 wait complete. 2026-02-20T03:21:08.399 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:21:08.399 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:21:08.399 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:21:08.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 524705 7.55 MB/sec execute 161 sec latency 660.813 ms 2026-02-20T03:21:08.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:21:08.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:21:08.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:21:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:21:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:21:08.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:21:09.494 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:09 trial028 ceph-mon[38552]: pgmap v375: 129 pgs: 129 active+clean; 81 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 278 KiB/s rd, 3.0 MiB/s wr, 244 op/s 2026-02-20T03:21:09.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 524705 7.51 MB/sec execute 162 sec latency 1660.850 ms 2026-02-20T03:21:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:09 trial177 ceph-mon[43181]: pgmap v375: 129 pgs: 129 active+clean; 81 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 278 KiB/s rd, 3.0 MiB/s wr, 244 op/s 2026-02-20T03:21:09.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:09 trial126 ceph-mon[38476]: pgmap v375: 129 pgs: 129 active+clean; 81 MiB data, 1.8 GiB used, 8.2 TiB / 8.2 TiB avail; 278 KiB/s rd, 3.0 MiB/s wr, 244 op/s 2026-02-20T03:21:10.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 524705 7.46 MB/sec execute 163 sec latency 2660.899 ms 2026-02-20T03:21:11.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:11 trial028 ceph-mon[38552]: pgmap v376: 129 pgs: 129 active+clean; 96 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 314 KiB/s rd, 4.2 MiB/s wr, 246 op/s 2026-02-20T03:21:11.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 524705 7.41 MB/sec execute 164 sec latency 3660.935 ms 2026-02-20T03:21:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:11 trial177 ceph-mon[43181]: pgmap v376: 129 pgs: 129 active+clean; 96 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 314 KiB/s rd, 4.2 MiB/s wr, 246 op/s 2026-02-20T03:21:11.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:11 trial126 ceph-mon[38476]: pgmap v376: 129 pgs: 129 active+clean; 96 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 314 KiB/s rd, 4.2 MiB/s wr, 246 op/s 2026-02-20T03:21:12.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:12 trial028 ceph-mon[38552]: pgmap v377: 129 pgs: 129 active+clean; 109 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 247 KiB/s rd, 5.1 MiB/s wr, 213 op/s 2026-02-20T03:21:12.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 524705 7.37 MB/sec execute 165 sec latency 4660.968 ms 2026-02-20T03:21:12.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:12 trial177 ceph-mon[43181]: pgmap v377: 129 pgs: 129 active+clean; 109 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 247 KiB/s rd, 5.1 MiB/s wr, 213 op/s 2026-02-20T03:21:12.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:12 trial126 ceph-mon[38476]: pgmap v377: 129 pgs: 129 active+clean; 109 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 247 KiB/s rd, 5.1 MiB/s wr, 213 op/s 2026-02-20T03:21:13.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 526486 7.39 MB/sec execute 166 sec latency 5123.269 ms 2026-02-20T03:21:14.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 526486 7.35 MB/sec execute 167 sec latency 1033.151 ms 2026-02-20T03:21:15.388 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:15 trial028 ceph-mon[38552]: pgmap v378: 129 pgs: 129 active+clean; 110 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 336 KiB/s rd, 5.0 MiB/s wr, 218 op/s 2026-02-20T03:21:15.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:15 trial177 ceph-mon[43181]: pgmap v378: 129 pgs: 129 active+clean; 110 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 336 KiB/s rd, 5.0 MiB/s wr, 218 op/s 2026-02-20T03:21:15.507 INFO:tasks.workunit.client.0.trial028.stdout: 1 526486 7.31 MB/sec execute 168 sec latency 2033.184 ms 2026-02-20T03:21:15.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:15 trial126 ceph-mon[38476]: pgmap v378: 129 pgs: 129 active+clean; 110 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 336 KiB/s rd, 5.0 MiB/s wr, 218 op/s 2026-02-20T03:21:16.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 526487 7.26 MB/sec execute 169 sec latency 2410.676 ms 2026-02-20T03:21:17.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:17 trial028 ceph-mon[38552]: pgmap v379: 129 pgs: 129 active+clean; 108 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 264 KiB/s rd, 5.4 MiB/s wr, 230 op/s 2026-02-20T03:21:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:17 trial177 ceph-mon[43181]: pgmap v379: 129 pgs: 129 active+clean; 108 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 264 KiB/s rd, 5.4 MiB/s wr, 230 op/s 2026-02-20T03:21:17.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 526572 7.22 MB/sec execute 170 sec latency 1585.236 ms 2026-02-20T03:21:17.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:17 trial126 ceph-mon[38476]: pgmap v379: 129 pgs: 129 active+clean; 108 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 264 KiB/s rd, 5.4 MiB/s wr, 230 op/s 2026-02-20T03:21:18.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 530494 7.30 MB/sec execute 171 sec latency 7.816 ms 2026-02-20T03:21:19.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:19 trial028 ceph-mon[38552]: pgmap v380: 129 pgs: 129 active+clean; 107 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 319 KiB/s rd, 5.0 MiB/s wr, 226 op/s 2026-02-20T03:21:19.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:19 trial177 ceph-mon[43181]: pgmap v380: 129 pgs: 129 active+clean; 107 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 319 KiB/s rd, 5.0 MiB/s wr, 226 op/s 2026-02-20T03:21:19.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 530966 7.28 MB/sec execute 172 sec latency 854.607 ms 2026-02-20T03:21:19.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:19 trial126 ceph-mon[38476]: pgmap v380: 129 pgs: 129 active+clean; 107 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 319 KiB/s rd, 5.0 MiB/s wr, 226 op/s 2026-02-20T03:21:20.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 530966 7.23 MB/sec execute 173 sec latency 1854.645 ms 2026-02-20T03:21:20.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- 10.20.193.28:0/102663426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 msgr2=0x7f6d80107890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:20.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 --2- 10.20.193.28:0/102663426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 0x7f6d80107890 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009a30 tx=0x7f6d7002f260 comp rx=0 tx=0).stop 2026-02-20T03:21:20.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- 10.20.193.28:0/102663426 shutdown_connections 2026-02-20T03:21:20.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 --2- 10.20.193.28:0/102663426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d8010a7e0 0x7f6d8010cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 --2- 10.20.193.28:0/102663426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d80107dd0 0x7f6d8010a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 --2- 10.20.193.28:0/102663426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 0x7f6d80107890 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- 10.20.193.28:0/102663426 >> 10.20.193.28:0/102663426 conn(0x7f6d800fcec0 msgr2=0x7f6d800ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:20.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- 10.20.193.28:0/102663426 shutdown_connections 2026-02-20T03:21:20.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- 10.20.193.28:0/102663426 wait complete. 2026-02-20T03:21:20.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 Processor -- start 2026-02-20T03:21:20.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- start start 2026-02-20T03:21:20.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 0x7f6d8019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d80107dd0 0x7f6d8019d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d8010a7e0 0x7f6d801a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d80110740 con 0x7f6d8006b8d0 2026-02-20T03:21:20.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d801105c0 con 0x7f6d80107dd0 2026-02-20T03:21:20.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d801108c0 con 0x7f6d8010a7e0 2026-02-20T03:21:20.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d84fc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 0x7f6d8019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d84fc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 0x7f6d8019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36306/0 (socket says 10.20.193.28:36306) 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d84fc9640 1 -- 10.20.193.28:0/1222273192 learned_addr learned my addr 10.20.193.28:0/1222273192 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d84fc9640 1 -- 10.20.193.28:0/1222273192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d8010a7e0 msgr2=0x7f6d801a4220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d8010a7e0 0x7f6d801a4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d84fc9640 1 -- 10.20.193.28:0/1222273192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d80107dd0 msgr2=0x7f6d8019d1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d80107dd0 0x7f6d8019d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d84fc9640 1 -- 10.20.193.28:0/1222273192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d801a4950 con 0x7f6d8006b8d0 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 0x7f6d8019cc80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009950 tx=0x7f6d7002fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d75ffb640 1 -- 10.20.193.28:0/1222273192 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70004240 con 0x7f6d8006b8d0 2026-02-20T03:21:20.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d75ffb640 1 -- 10.20.193.28:0/1222273192 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d700043e0 con 0x7f6d8006b8d0 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d75ffb640 1 -- 10.20.193.28:0/1222273192 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70042b30 con 0x7f6d8006b8d0 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- 10.20.193.28:0/1222273192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d801a4be0 con 0x7f6d8006b8d0 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d87254640 1 -- 10.20.193.28:0/1222273192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d801a5080 con 0x7f6d8006b8d0 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.866+0000 7f6d75ffb640 1 -- 10.20.193.28:0/1222273192 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6d7004a030 con 0x7f6d8006b8d0 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 Processor -- start 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 -- start start 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d448e80 0x55f48d449280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 0x55f48d44dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d450830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f48d3998f0 con 0x55f48d44e370 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f48d3472e0 con 0x55f48d448e80 2026-02-20T03:21:20.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f48d395820 con 0x55f48d4497c0 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d77fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d450830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d77fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d450830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36320/0 (socket says 10.20.193.28:36320) 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d77fff640 1 -- 10.20.193.28:0/2139199032 learned_addr learned my addr 10.20.193.28:0/2139199032 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d75ffb640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d5c0b0e20 0x7f6d5c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d77fff640 1 -- 10.20.193.28:0/2139199032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 msgr2=0x55f48d44dd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d77fff640 1 --2- 10.20.193.28:0/2139199032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 0x55f48d44dd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d77fff640 1 -- 10.20.193.28:0/2139199032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d448e80 msgr2=0x55f48d449280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d77fff640 1 --2- 10.20.193.28:0/2139199032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d448e80 0x55f48d449280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d77fff640 1 -- 10.20.193.28:0/2139199032 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f48d3395a0 con 0x55f48d44e370 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d75ffb640 1 -- 10.20.193.28:0/1222273192 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6d701052b0 con 0x7f6d8006b8d0 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d77fff640 1 --2- 10.20.193.28:0/2139199032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d450830 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009840 tx=0x7f6d68009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc715c0a1ae11b16 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:20.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d857ca640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d5c0b0e20 0x7f6d5c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d4d3fe640 1 -- 10.20.193.28:0/2139199032 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68016070 con 0x55f48d44e370 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d4d3fe640 1 -- 10.20.193.28:0/2139199032 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d68004480 con 0x55f48d44e370 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d4d3fe640 1 -- 10.20.193.28:0/2139199032 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800bd60 con 0x55f48d44e370 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2139199032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 msgr2=0x55f48d450830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2139199032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d450830 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009840 tx=0x7f6d68009d10 comp rx=0 tx=0).stop 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d857ca640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d5c0b0e20 0x7f6d5c0b32e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00aa00 tx=0x7f6d7c0091d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2139199032 shutdown_connections 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2139199032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d450830 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2139199032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 0x55f48d44dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2139199032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d448e80 0x55f48d449280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2139199032 >> 10.20.193.28:0/2139199032 conn(0x55f48d4406f0 msgr2=0x55f48d447570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:20.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2139199032 shutdown_connections 2026-02-20T03:21:20.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.871+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2139199032 wait complete. 2026-02-20T03:21:20.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 -- start start 2026-02-20T03:21:20.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 Processor -- start 2026-02-20T03:21:20.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d448e80 0x55f48d472d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d4497c0 0x55f48d473250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d47a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f48d3410c0 con 0x55f48d44e370 2026-02-20T03:21:20.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f48d462860 con 0x55f48d4497c0 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f48d47a760 con 0x55f48d448e80 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d857ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d47a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d857ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d47a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36330/0 (socket says 10.20.193.28:36330) 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d857ca640 1 -- 10.20.193.28:0/2796995567 learned_addr learned my addr 10.20.193.28:0/2796995567 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d857ca640 1 -- 10.20.193.28:0/2796995567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d448e80 msgr2=0x55f48d472d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d857ca640 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d448e80 0x55f48d472d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d857ca640 1 -- 10.20.193.28:0/2796995567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d4497c0 msgr2=0x55f48d473250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d857ca640 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d4497c0 0x55f48d473250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d857ca640 1 -- 10.20.193.28:0/2796995567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f48d46c420 con 0x55f48d44e370 2026-02-20T03:21:20.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d857ca640 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d47a1d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c004380 tx=0x7f6d7c004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d082497ef14aaf5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:20.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d3e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:20.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/2796995567 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c01b460 con 0x55f48d44e370 2026-02-20T03:21:20.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/2796995567 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d7c01baa0 con 0x55f48d44e370 2026-02-20T03:21:20.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/2796995567 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00ec10 con 0x55f48d44e370 2026-02-20T03:21:20.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2796995567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f48d355820 con 0x55f48d44e370 2026-02-20T03:21:20.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/2796995567 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6d7c00edd0 con 0x55f48d44e370 2026-02-20T03:21:20.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 10 client.17013 _ll_register_callbacks cb 0x55f48d344ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2796995567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f48d3a14e0 con 0x55f48d44e370 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/2796995567 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d7c01bc50 con 0x55f48d44e370 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 10 client.17013 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2796995567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f48d35a380 con 0x55f48d44e370 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/2796995567 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6d7c01b600 con 0x55f48d44e370 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 10 client.17013 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 10 client.17013 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 20 client.17013 populate_metadata read hostname 'trial028' 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f48d47eb20 0x55f48d480fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 4 client.17013 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:20.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.876+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2796995567 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f48d31bbd0 con 0x55f48d47eb20 2026-02-20T03:21:20.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.888+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f48d47eb20 0x55f48d480fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:20.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f48d47eb20 0x55f48d480fc0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b0ddcd1ca025ca4 server_cookie=79bfa92644f75dc2 in_seq=0 out_seq=0 2026-02-20T03:21:20.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d3e7fc640 10 client.17013 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:20.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/2796995567 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f48d31bbd0 con 0x55f48d47eb20 2026-02-20T03:21:20.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d3e7fc640 10 client.17013 handle_command_reply: tid=0 2026-02-20T03:21:20.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 client.17013 shutdown 2026-02-20T03:21:20.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2796995567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 msgr2=0x55f48d47a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:20.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d47a1d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c004380 tx=0x7f6d7c004c50 comp rx=0 tx=0).stop 2026-02-20T03:21:20.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2796995567 shutdown_connections 2026-02-20T03:21:20.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f48d47eb20 0x55f48d480fc0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d44e370 0x55f48d47a1d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d4497c0 0x55f48d473250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2796995567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d448e80 0x55f48d472d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2796995567 >> 10.20.193.28:0/2796995567 conn(0x55f48d4406f0 msgr2=0x55f48d44f680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:20.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d3e7fc640 0 client.17013 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:20.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.917+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2796995567 shutdown_connections 2026-02-20T03:21:20.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.918+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2796995567 wait complete. 2026-02-20T03:21:20.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.918+0000 7f6d8a0afe00 20 client.17013 trim_cache size 0 max 16384 2026-02-20T03:21:20.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 Processor -- start 2026-02-20T03:21:20.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- start start 2026-02-20T03:21:20.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d44e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 0x55f48d47a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d44e370 0x55f48d44ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d24012650 con 0x55f48d448e80 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2400ff20 con 0x55f48d44e370 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2400dd70 con 0x55f48d4497c0 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d44e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d44e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36340/0 (socket says 10.20.193.28:36340) 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 -- 10.20.193.28:0/2153153297 learned_addr learned my addr 10.20.193.28:0/2153153297 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 -- 10.20.193.28:0/2153153297 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 msgr2=0x55f48d47a190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/2153153297 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 0x55f48d47a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 -- 10.20.193.28:0/2153153297 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d44e370 msgr2=0x55f48d44ec90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:20.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/2153153297 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d44e370 0x55f48d44ec90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 -- 10.20.193.28:0/2153153297 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f48d46c250 con 0x55f48d448e80 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/2153153297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d44e750 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6d70002fa0 tx=0x7f6d701027f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9044ad74d89f6259 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d4cbfd640 1 -- 10.20.193.28:0/2153153297 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d700d1340 con 0x55f48d448e80 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d4cbfd640 1 -- 10.20.193.28:0/2153153297 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d70033040 con 0x55f48d448e80 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d4cbfd640 1 -- 10.20.193.28:0/2153153297 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d700b50b0 con 0x55f48d448e80 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2153153297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 msgr2=0x55f48d44e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2153153297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d44e750 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6d70002fa0 tx=0x7f6d701027f0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2153153297 shutdown_connections 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2153153297 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d44e370 0x55f48d44ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2153153297 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 0x55f48d47a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/2153153297 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d44e750 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2153153297 >> 10.20.193.28:0/2153153297 conn(0x55f48d4406f0 msgr2=0x55f48d46f550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:20.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2153153297 shutdown_connections 2026-02-20T03:21:20.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/2153153297 wait complete. 2026-02-20T03:21:20.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- start start 2026-02-20T03:21:20.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 Processor -- start 2026-02-20T03:21:20.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d4763a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 0x55f48d4768e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d44e370 0x55f48d4794c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2400e3e0 con 0x55f48d448e80 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2400f850 con 0x55f48d44e370 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d8a0afe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2400eab0 con 0x55f48d4497c0 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d4763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d4763a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36354/0 (socket says 10.20.193.28:36354) 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 -- 10.20.193.28:0/3109915188 learned_addr learned my addr 10.20.193.28:0/3109915188 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 -- 10.20.193.28:0/3109915188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 msgr2=0x55f48d4768e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 0x55f48d4768e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 -- 10.20.193.28:0/3109915188 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d44e370 msgr2=0x55f48d4794c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d44e370 0x55f48d4794c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 -- 10.20.193.28:0/3109915188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f48d473cb0 con 0x55f48d448e80 2026-02-20T03:21:20.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d84fc9640 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d4763a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6d700ccf20 tx=0x7f6d70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f824bb6887f188 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d3e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/3109915188 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d700d61f0 con 0x55f48d448e80 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/3109915188 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6d70035db0 con 0x55f48d448e80 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.924+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/3109915188 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d700389f0 con 0x55f48d448e80 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/3109915188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f48d0f9690 con 0x55f48d448e80 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 10 client.17019 _ll_register_callbacks cb 0x7f6d7c00ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/3109915188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d68004480 con 0x55f48d448e80 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/3109915188 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6d700cbfa0 con 0x55f48d448e80 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/3109915188 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d700d1340 con 0x55f48d448e80 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 10 client.17019 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/3109915188 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f48d35eb70 con 0x55f48d448e80 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/3109915188 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6d700c86b0 con 0x55f48d448e80 2026-02-20T03:21:20.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 10 client.17019 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:20.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 10 client.17019 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:20.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 20 client.17019 populate_metadata read hostname 'trial028' 2026-02-20T03:21:20.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f48d4ea340 0x55f48d4ec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:20.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 4 client.17019 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:21:20.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.929+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/3109915188 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f48d36a6b0 con 0x55f48d4ea340 2026-02-20T03:21:20.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.931+0000 7f6d77fff640 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f48d4ea340 0x55f48d4ec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:20.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.972+0000 7f6d77fff640 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f48d4ea340 0x55f48d4ec7d0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf247fe26e00b03a server_cookie=616b63091cb9e7c6 in_seq=0 out_seq=0 2026-02-20T03:21:20.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:20.972+0000 7f6d3e7fc640 10 client.17019 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:21.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.041+0000 7f6d3e7fc640 1 -- 10.20.193.28:0/3109915188 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f48d36a6b0 con 0x55f48d4ea340 2026-02-20T03:21:21.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.041+0000 7f6d3e7fc640 10 client.17019 handle_command_reply: tid=0 2026-02-20T03:21:21.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.041+0000 7f6d8a0afe00 1 client.17019 shutdown 2026-02-20T03:21:21.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/3109915188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 msgr2=0x55f48d4763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:21.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d4763a0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6d700ccf20 tx=0x7f6d70009780 comp rx=0 tx=0).stop 2026-02-20T03:21:21.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/3109915188 shutdown_connections 2026-02-20T03:21:21.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f48d4ea340 0x55f48d4ec7d0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:21.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f48d44e370 0x55f48d4794c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:21.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f48d4497c0 0x55f48d4768e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:21.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 --2- 10.20.193.28:0/3109915188 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f48d448e80 0x55f48d4763a0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:21.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/3109915188 >> 10.20.193.28:0/3109915188 conn(0x55f48d4406f0 msgr2=0x55f48d46fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:21.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d3e7fc640 0 client.17019 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:21.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/3109915188 shutdown_connections 2026-02-20T03:21:21.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 1 -- 10.20.193.28:0/3109915188 wait complete. 2026-02-20T03:21:21.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d8a0afe00 20 client.17019 trim_cache size 0 max 16384 2026-02-20T03:21:21.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:21:21.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:21:21.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:21:21.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d87254640 1 -- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d5c0b0e20 msgr2=0x7f6d5c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d87254640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d5c0b0e20 0x7f6d5c0b32e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00aa00 tx=0x7f6d7c0091d0 comp rx=0 tx=0).stop 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d87254640 1 -- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 msgr2=0x7f6d8019cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.042+0000 7f6d87254640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 0x7f6d8019cc80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009950 tx=0x7f6d7002fd60 comp rx=0 tx=0).stop 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.043+0000 7f6d87254640 1 -- 10.20.193.28:0/1222273192 shutdown_connections 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.043+0000 7f6d87254640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6d5c0b0e20 0x7f6d5c0b32e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.043+0000 7f6d87254640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6d8010a7e0 0x7f6d801a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.043+0000 7f6d87254640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6d80107dd0 0x7f6d8019d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.043+0000 7f6d87254640 1 --2- 10.20.193.28:0/1222273192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6d8006b8d0 0x7f6d8019cc80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:21.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.043+0000 7f6d87254640 1 -- 10.20.193.28:0/1222273192 >> 10.20.193.28:0/1222273192 conn(0x7f6d800fcec0 msgr2=0x7f6d801087b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:21.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.043+0000 7f6d87254640 1 -- 10.20.193.28:0/1222273192 shutdown_connections 2026-02-20T03:21:21.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:21.043+0000 7f6d87254640 1 -- 10.20.193.28:0/1222273192 wait complete. 2026-02-20T03:21:21.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:21 trial028 ceph-mon[38552]: pgmap v381: 129 pgs: 129 active+clean; 106 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 467 KiB/s rd, 5.1 MiB/s wr, 246 op/s 2026-02-20T03:21:21.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:21 trial177 ceph-mon[43181]: pgmap v381: 129 pgs: 129 active+clean; 106 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 467 KiB/s rd, 5.1 MiB/s wr, 246 op/s 2026-02-20T03:21:21.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 533108 7.27 MB/sec execute 174 sec latency 2447.241 ms 2026-02-20T03:21:21.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:21 trial126 ceph-mon[38476]: pgmap v381: 129 pgs: 129 active+clean; 106 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 467 KiB/s rd, 5.1 MiB/s wr, 246 op/s 2026-02-20T03:21:22.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 536806 7.34 MB/sec execute 175 sec latency 7.099 ms 2026-02-20T03:21:23.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:23 trial177 ceph-mon[43181]: pgmap v382: 129 pgs: 129 active+clean; 101 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 377 KiB/s rd, 3.9 MiB/s wr, 214 op/s 2026-02-20T03:21:23.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 540572 7.41 MB/sec execute 176 sec latency 6.201 ms 2026-02-20T03:21:23.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:23 trial126 ceph-mon[38476]: pgmap v382: 129 pgs: 129 active+clean; 101 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 377 KiB/s rd, 3.9 MiB/s wr, 214 op/s 2026-02-20T03:21:23.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:23 trial028 ceph-mon[38552]: pgmap v382: 129 pgs: 129 active+clean; 101 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 377 KiB/s rd, 3.9 MiB/s wr, 214 op/s 2026-02-20T03:21:24.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 541382 7.39 MB/sec execute 177 sec latency 767.619 ms 2026-02-20T03:21:25.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:25 trial177 ceph-mon[43181]: pgmap v383: 129 pgs: 129 active+clean; 97 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 435 KiB/s rd, 2.8 MiB/s wr, 220 op/s 2026-02-20T03:21:25.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 544244 7.43 MB/sec execute 178 sec latency 1026.744 ms 2026-02-20T03:21:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:25 trial126 ceph-mon[38476]: pgmap v383: 129 pgs: 129 active+clean; 97 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 435 KiB/s rd, 2.8 MiB/s wr, 220 op/s 2026-02-20T03:21:25.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:25 trial028 ceph-mon[38552]: pgmap v383: 129 pgs: 129 active+clean; 97 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 435 KiB/s rd, 2.8 MiB/s wr, 220 op/s 2026-02-20T03:21:26.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 548049 7.50 MB/sec execute 179 sec latency 8.262 ms 2026-02-20T03:21:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:27 trial177 ceph-mon[43181]: pgmap v384: 129 pgs: 129 active+clean; 97 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 688 KiB/s rd, 3.0 MiB/s wr, 284 op/s 2026-02-20T03:21:27.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 552101 7.59 MB/sec execute 180 sec latency 7.209 ms 2026-02-20T03:21:27.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:27 trial126 ceph-mon[38476]: pgmap v384: 129 pgs: 129 active+clean; 97 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 688 KiB/s rd, 3.0 MiB/s wr, 284 op/s 2026-02-20T03:21:27.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:27 trial028 ceph-mon[38552]: pgmap v384: 129 pgs: 129 active+clean; 97 MiB data, 1.9 GiB used, 8.2 TiB / 8.2 TiB avail; 688 KiB/s rd, 3.0 MiB/s wr, 284 op/s 2026-02-20T03:21:28.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 556301 7.66 MB/sec execute 181 sec latency 6.574 ms 2026-02-20T03:21:29.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:29 trial177 ceph-mon[43181]: pgmap v385: 129 pgs: 129 active+clean; 97 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 678 KiB/s rd, 2.5 MiB/s wr, 268 op/s 2026-02-20T03:21:29.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 558237 7.69 MB/sec execute 182 sec latency 472.919 ms 2026-02-20T03:21:29.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:29 trial126 ceph-mon[38476]: pgmap v385: 129 pgs: 129 active+clean; 97 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 678 KiB/s rd, 2.5 MiB/s wr, 268 op/s 2026-02-20T03:21:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:29 trial028 ceph-mon[38552]: pgmap v385: 129 pgs: 129 active+clean; 97 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 678 KiB/s rd, 2.5 MiB/s wr, 268 op/s 2026-02-20T03:21:30.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 561975 7.75 MB/sec execute 183 sec latency 15.441 ms 2026-02-20T03:21:31.426 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:21:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:31 trial177 ceph-mon[43181]: pgmap v386: 129 pgs: 129 active+clean; 102 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 374 op/s 2026-02-20T03:21:31.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:31 trial028 ceph-mon[38552]: pgmap v386: 129 pgs: 129 active+clean; 102 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 374 op/s 2026-02-20T03:21:31.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 565763 7.82 MB/sec execute 184 sec latency 9.125 ms 2026-02-20T03:21:31.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:31 trial126 ceph-mon[38476]: pgmap v386: 129 pgs: 129 active+clean; 102 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 374 op/s 2026-02-20T03:21:31.686 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:21:31.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.879+0000 7f3b42dc5640 1 -- 10.20.193.28:0/1793071495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c075950 msgr2=0x7f3b3c075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:31.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.879+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/1793071495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c075950 0x7f3b3c075d90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009a30 tx=0x7f3b3002f2b0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.879+0000 7f3b42dc5640 1 -- 10.20.193.28:0/1793071495 shutdown_connections 2026-02-20T03:21:31.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.879+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/1793071495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b3c1134d0 0x7f3b3c115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.879+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/1793071495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c075950 0x7f3b3c075d90 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.879+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/1793071495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b3c1065d0 0x7f3b3c075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.879+0000 7f3b42dc5640 1 -- 10.20.193.28:0/1793071495 >> 10.20.193.28:0/1793071495 conn(0x7f3b3c0fe440 msgr2=0x7f3b3c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:31.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.879+0000 7f3b42dc5640 1 -- 10.20.193.28:0/1793071495 shutdown_connections 2026-02-20T03:21:31.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.879+0000 7f3b42dc5640 1 -- 10.20.193.28:0/1793071495 wait complete. 2026-02-20T03:21:31.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b42dc5640 1 Processor -- start 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b42dc5640 1 -- start start 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b42dc5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b3c075950 0x7f3b3c1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b42dc5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b3c1065d0 0x7f3b3c1a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b42dc5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c1134d0 0x7f3b3c1a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b42dc5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c1190a0 con 0x7f3b3c1134d0 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b42dc5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c118f20 con 0x7f3b3c075950 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b42dc5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c119220 con 0x7f3b3c1065d0 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b425c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c1134d0 0x7f3b3c1a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b425c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c1134d0 0x7f3b3c1a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56456/0 (socket says 10.20.193.28:56456) 2026-02-20T03:21:31.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b425c4640 1 -- 10.20.193.28:0/2452752085 learned_addr learned my addr 10.20.193.28:0/2452752085 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b41dc3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b3c075950 0x7f3b3c1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.880+0000 7f3b415c2640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b3c1065d0 0x7f3b3c1a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b425c4640 1 -- 10.20.193.28:0/2452752085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b3c1065d0 msgr2=0x7f3b3c1a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b425c4640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b3c1065d0 0x7f3b3c1a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b425c4640 1 -- 10.20.193.28:0/2452752085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b3c075950 msgr2=0x7f3b3c1a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b425c4640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b3c075950 0x7f3b3c1a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b425c4640 1 -- 10.20.193.28:0/2452752085 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c1a6570 con 0x7f3b3c1134d0 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b415c2640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b3c1065d0 0x7f3b3c1a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b425c4640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c1134d0 0x7f3b3c1a5df0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3b38007ee0 tx=0x7f3b3800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b2affd640 1 -- 10.20.193.28:0/2452752085 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b38002a60 con 0x7f3b3c1134d0 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b42dc5640 1 -- 10.20.193.28:0/2452752085 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c1a6800 con 0x7f3b3c1134d0 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b42dc5640 1 -- 10.20.193.28:0/2452752085 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3c1ae0a0 con 0x7f3b3c1134d0 2026-02-20T03:21:31.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b2affd640 1 -- 10.20.193.28:0/2452752085 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3b38002c00 con 0x7f3b3c1134d0 2026-02-20T03:21:31.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.881+0000 7f3b2affd640 1 -- 10.20.193.28:0/2452752085 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380137b0 con 0x7f3b3c1134d0 2026-02-20T03:21:31.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.884+0000 7f3b46553e00 1 Processor -- start 2026-02-20T03:21:31.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.884+0000 7f3b2affd640 1 -- 10.20.193.28:0/2452752085 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3b38012070 con 0x7f3b3c1134d0 2026-02-20T03:21:31.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.884+0000 7f3b46553e00 1 -- start start 2026-02-20T03:21:31.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x55921748f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x559217489a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 0x559217495e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b46553e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559217409e50 con 0x55921748f000 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b46553e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5592173dc9c0 con 0x559217489630 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b46553e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55921738a240 con 0x559217489fb0 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x55921748f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x55921748f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56466/0 (socket says 10.20.193.28:56466) 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 -- 10.20.193.28:0/1406862293 learned_addr learned my addr 10.20.193.28:0/1406862293 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/1406862293 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x559217489a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 --2- 10.20.193.28:0/1406862293 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 0x559217495e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 -- 10.20.193.28:0/1406862293 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 msgr2=0x559217495e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 --2- 10.20.193.28:0/1406862293 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 0x559217495e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 -- 10.20.193.28:0/1406862293 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 msgr2=0x559217489a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:31.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 --2- 10.20.193.28:0/1406862293 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x559217489a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 -- 10.20.193.28:0/1406862293 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921739d420 con 0x55921748f000 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.885+0000 7f3b415c2640 1 --2- 10.20.193.28:0/1406862293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x55921748f3e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3b30002fd0 tx=0x7f3b3003a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a01cf365190e0b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b0a4e6640 1 -- 10.20.193.28:0/1406862293 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b300026e0 con 0x55921748f000 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b0a4e6640 1 -- 10.20.193.28:0/1406862293 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3b30033030 con 0x55921748f000 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b0a4e6640 1 -- 10.20.193.28:0/1406862293 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30005390 con 0x55921748f000 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b2affd640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b180b0e20 0x7f3b180b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b2affd640 1 -- 10.20.193.28:0/2452752085 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3b380e03d0 con 0x7f3b3c1134d0 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b46553e00 1 -- 10.20.193.28:0/1406862293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 msgr2=0x55921748f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1406862293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x55921748f3e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f3b30002fd0 tx=0x7f3b3003a040 comp rx=0 tx=0).stop 2026-02-20T03:21:31.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b180b0e20 0x7f3b180b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b46553e00 1 -- 10.20.193.28:0/1406862293 shutdown_connections 2026-02-20T03:21:31.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1406862293 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 0x559217495e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1406862293 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x559217489a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1406862293 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x55921748f3e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.886+0000 7f3b46553e00 1 -- 10.20.193.28:0/1406862293 >> 10.20.193.28:0/1406862293 conn(0x55921744c290 msgr2=0x559217487d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.887+0000 7f3b46553e00 1 -- 10.20.193.28:0/1406862293 shutdown_connections 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.887+0000 7f3b46553e00 1 -- 10.20.193.28:0/1406862293 wait complete. 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.887+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b180b0e20 0x7f3b180b32e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c004580 tx=0x7f3b2c0073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.888+0000 7f3b46553e00 1 -- start start 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.888+0000 7f3b46553e00 1 Processor -- start 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489630 0x5592174a2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489fb0 0x5592174a2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 0x5592174a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b46553e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592173d88f0 con 0x559217489630 2026-02-20T03:21:31.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b46553e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5592171caf50 con 0x559217489fb0 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b46553e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5592174a8340 con 0x55921748f000 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b41dc3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489630 0x5592174a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b425c4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 0x5592174a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b41dc3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489630 0x5592174a2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56472/0 (socket says 10.20.193.28:56472) 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b41dc3640 1 -- 10.20.193.28:0/1449761046 learned_addr learned my addr 10.20.193.28:0/1449761046 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b415c2640 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489fb0 0x5592174a2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b41dc3640 1 -- 10.20.193.28:0/1449761046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 msgr2=0x5592174a7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 0x5592174a7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b41dc3640 1 -- 10.20.193.28:0/1449761046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489fb0 msgr2=0x5592174a2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489fb0 0x5592174a2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b41dc3640 1 -- 10.20.193.28:0/1449761046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921749bad0 con 0x559217489630 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.889+0000 7f3b425c4640 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 0x5592174a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:31.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489630 0x5592174a2320 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c002ee0 tx=0x7f3b2c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9def91c8bedc6ca6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3af77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3af77fe640 1 -- 10.20.193.28:0/1449761046 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c010670 con 0x559217489630 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3af77fe640 1 -- 10.20.193.28:0/1449761046 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3b2c024020 con 0x559217489630 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3af77fe640 1 -- 10.20.193.28:0/1449761046 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c01f960 con 0x559217489630 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3b46553e00 1 -- 10.20.193.28:0/1449761046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592171adb40 con 0x559217489630 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3b46553e00 10 client.17031 _ll_register_callbacks cb 0x559217415f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3b46553e00 1 -- 10.20.193.28:0/1449761046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5592173ea1a0 con 0x559217489630 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3af77fe640 1 -- 10.20.193.28:0/1449761046 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3b2c010810 con 0x559217489630 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3af77fe640 1 -- 10.20.193.28:0/1449761046 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b2c023030 con 0x559217489630 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3b46553e00 10 client.17031 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.890+0000 7f3b46553e00 1 -- 10.20.193.28:0/1449761046 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559217397230 con 0x559217489630 2026-02-20T03:21:31.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.891+0000 7f3af77fe640 1 -- 10.20.193.28:0/1449761046 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3b2c01fb20 con 0x559217489630 2026-02-20T03:21:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.891+0000 7f3b46553e00 10 client.17031 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.891+0000 7f3b46553e00 10 client.17031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.891+0000 7f3b46553e00 20 client.17031 populate_metadata read hostname 'trial028' 2026-02-20T03:21:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.891+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592174b2410 0x5592174b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.891+0000 7f3b46553e00 4 client.17031 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.891+0000 7f3b46553e00 1 -- 10.20.193.28:0/1449761046 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592173e45b0 con 0x5592174b2410 2026-02-20T03:21:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.891+0000 7f3b415c2640 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592174b2410 0x5592174b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.892+0000 7f3b415c2640 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592174b2410 0x5592174b48d0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b3449c67ee04136 server_cookie=a1678418a0876b55 in_seq=0 out_seq=0 2026-02-20T03:21:31.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.892+0000 7f3af77fe640 10 client.17031 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.892+0000 7f3af77fe640 1 -- 10.20.193.28:0/1449761046 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5592173e45b0 con 0x5592174b2410 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.892+0000 7f3af77fe640 10 client.17031 handle_command_reply: tid=0 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.892+0000 7f3b46553e00 1 client.17031 shutdown 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.892+0000 7f3b46553e00 1 -- 10.20.193.28:0/1449761046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489630 msgr2=0x5592174a2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.892+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489630 0x5592174a2320 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c002ee0 tx=0x7f3b2c0047c0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.892+0000 7f3b46553e00 1 -- 10.20.193.28:0/1449761046 shutdown_connections 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.892+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592174b2410 0x5592174b48d0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.893+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 0x5592174a7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.893+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489fb0 0x5592174a2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.893+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1449761046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489630 0x5592174a2320 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.893+0000 7f3b46553e00 1 -- 10.20.193.28:0/1449761046 >> 10.20.193.28:0/1449761046 conn(0x55921744c290 msgr2=0x559217488440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.893+0000 7f3af77fe640 0 client.17031 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.893+0000 7f3b46553e00 1 -- 10.20.193.28:0/1449761046 shutdown_connections 2026-02-20T03:21:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.893+0000 7f3b46553e00 1 -- 10.20.193.28:0/1449761046 wait complete. 2026-02-20T03:21:31.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.893+0000 7f3b46553e00 20 client.17031 trim_cache size 0 max 16384 2026-02-20T03:21:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.901+0000 7f3b46553e00 1 Processor -- start 2026-02-20T03:21:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.901+0000 7f3b46553e00 1 -- start start 2026-02-20T03:21:31.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x5592174ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 0x5592174ba6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x5592174adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b46553e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae80126f0 con 0x55921748f000 2026-02-20T03:21:31.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b46553e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae800ffc0 con 0x559217489630 2026-02-20T03:21:31.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b46553e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae800de10 con 0x559217489fb0 2026-02-20T03:21:31.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b425c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x5592174adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b425c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x5592174adbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56484/0 (socket says 10.20.193.28:56484) 2026-02-20T03:21:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b425c4640 1 -- 10.20.193.28:0/1101730124 learned_addr learned my addr 10.20.193.28:0/1101730124 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/1101730124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x5592174ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b415c2640 1 --2- 10.20.193.28:0/1101730124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 0x5592174ba6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b425c4640 1 -- 10.20.193.28:0/1101730124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 msgr2=0x5592174ba6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b425c4640 1 --2- 10.20.193.28:0/1101730124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 0x5592174ba6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b425c4640 1 -- 10.20.193.28:0/1101730124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 msgr2=0x5592174ba1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b425c4640 1 --2- 10.20.193.28:0/1101730124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x5592174ba1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b425c4640 1 -- 10.20.193.28:0/1101730124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55921749b900 con 0x55921748f000 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b425c4640 1 --2- 10.20.193.28:0/1101730124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x5592174adbc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3b380dda40 tx=0x7f3b380048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5618a99385f62a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b09ce5640 1 -- 10.20.193.28:0/1101730124 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380b1310 con 0x55921748f000 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b09ce5640 1 -- 10.20.193.28:0/1101730124 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3b380ddb50 con 0x55921748f000 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.902+0000 7f3b09ce5640 1 -- 10.20.193.28:0/1101730124 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b380a6b30 con 0x55921748f000 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 -- 10.20.193.28:0/1101730124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 msgr2=0x5592174adbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1101730124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x5592174adbc0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3b380dda40 tx=0x7f3b380048d0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 -- 10.20.193.28:0/1101730124 shutdown_connections 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1101730124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55921748f000 0x5592174adbc0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1101730124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559217489fb0 0x5592174ba6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 --2- 10.20.193.28:0/1101730124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x5592174ba1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 -- 10.20.193.28:0/1101730124 >> 10.20.193.28:0/1101730124 conn(0x55921744c290 msgr2=0x559217487510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 -- 10.20.193.28:0/1101730124 shutdown_connections 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 -- 10.20.193.28:0/1101730124 wait complete. 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.903+0000 7f3b46553e00 1 -- start start 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b46553e00 1 Processor -- start 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x5592174aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489fb0 0x5592174af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b46553e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 0x5592174ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b46553e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae800e480 con 0x559217489fb0 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b46553e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae800f8f0 con 0x559217489630 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b46553e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae800eb50 con 0x55921748f000 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b415c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489fb0 0x5592174af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b415c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489fb0 0x5592174af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56494/0 (socket says 10.20.193.28:56494) 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b415c2640 1 -- 10.20.193.28:0/731525733 learned_addr learned my addr 10.20.193.28:0/731525733 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x5592174aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b425c4640 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 0x5592174ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b415c2640 1 -- 10.20.193.28:0/731525733 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 msgr2=0x5592174ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b415c2640 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 0x5592174ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b415c2640 1 -- 10.20.193.28:0/731525733 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 msgr2=0x5592174aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:31.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b415c2640 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x5592174aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.904+0000 7f3b415c2640 1 -- 10.20.193.28:0/731525733 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592170bb870 con 0x559217489fb0 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3b415c2640 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489fb0 0x5592174af150 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3b30002ae0 tx=0x7f3b30002a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e68e50ed7b6144 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3af77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3af77fe640 1 -- 10.20.193.28:0/731525733 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b300040b0 con 0x559217489fb0 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3af77fe640 1 -- 10.20.193.28:0/731525733 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3b30033040 con 0x559217489fb0 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3af77fe640 1 -- 10.20.193.28:0/731525733 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30004a20 con 0x559217489fb0 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3b46553e00 1 -- 10.20.193.28:0/731525733 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55921737c440 con 0x559217489fb0 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3af77fe640 1 -- 10.20.193.28:0/731525733 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3b30004bc0 con 0x559217489fb0 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3af77fe640 10 client.17037 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3b46553e00 10 client.17037 _ll_register_callbacks cb 0x7f3b2c0041f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:31.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3b46553e00 1 -- 10.20.193.28:0/731525733 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b380ddb50 con 0x559217489fb0 2026-02-20T03:21:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3af77fe640 1 -- 10.20.193.28:0/731525733 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b30004250 con 0x559217489fb0 2026-02-20T03:21:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3b46553e00 10 client.17037 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:31.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.905+0000 7f3b46553e00 1 -- 10.20.193.28:0/731525733 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55921749c5f0 con 0x559217489fb0 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.906+0000 7f3af77fe640 1 -- 10.20.193.28:0/731525733 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3b30061020 con 0x559217489fb0 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.906+0000 7f3b46553e00 10 client.17037 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.906+0000 7f3b46553e00 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.906+0000 7f3b46553e00 20 client.17037 populate_metadata read hostname 'trial028' 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.906+0000 7f3b46553e00 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55921751dbe0 0x55921751ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.906+0000 7f3b46553e00 4 client.17037 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.906+0000 7f3b46553e00 1 -- 10.20.193.28:0/731525733 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5592173e45b0 con 0x55921751dbe0 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.906+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55921751dbe0 0x55921751ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.907+0000 7f3b41dc3640 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55921751dbe0 0x55921751ffd0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f8ea4901d8c90c server_cookie=61c5a364e5bf5515 in_seq=0 out_seq=0 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.907+0000 7f3af77fe640 10 client.17037 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.907+0000 7f3af77fe640 1 -- 10.20.193.28:0/731525733 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5592173e45b0 con 0x55921751dbe0 2026-02-20T03:21:31.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.907+0000 7f3af77fe640 10 client.17037 handle_command_reply: tid=0 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.907+0000 7f3b46553e00 1 client.17037 shutdown 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.907+0000 7f3b46553e00 1 -- 10.20.193.28:0/731525733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489fb0 msgr2=0x5592174af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.907+0000 7f3b46553e00 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489fb0 0x5592174af150 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3b30002ae0 tx=0x7f3b30002a70 comp rx=0 tx=0).stop 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b46553e00 1 -- 10.20.193.28:0/731525733 shutdown_connections 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b46553e00 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55921751dbe0 0x55921751ffd0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b46553e00 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55921748f000 0x5592174ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b46553e00 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559217489fb0 0x5592174af150 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b46553e00 1 --2- 10.20.193.28:0/731525733 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559217489630 0x5592174aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b46553e00 1 -- 10.20.193.28:0/731525733 >> 10.20.193.28:0/731525733 conn(0x55921744c290 msgr2=0x559217487d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3af77fe640 0 client.17037 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b46553e00 1 -- 10.20.193.28:0/731525733 shutdown_connections 2026-02-20T03:21:31.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b46553e00 1 -- 10.20.193.28:0/731525733 wait complete. 2026-02-20T03:21:31.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b46553e00 20 client.17037 trim_cache size 0 max 16384 2026-02-20T03:21:31.917 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:21:31.917 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:21:31.917 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:21:31.917 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:21:31.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b42dc5640 1 -- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b180b0e20 msgr2=0x7f3b180b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:31.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b180b0e20 0x7f3b180b32e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c004580 tx=0x7f3b2c0073d0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b42dc5640 1 -- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c1134d0 msgr2=0x7f3b3c1a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:31.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.908+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c1134d0 0x7f3b3c1a5df0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3b38007ee0 tx=0x7f3b3800d4a0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.909+0000 7f3b42dc5640 1 -- 10.20.193.28:0/2452752085 shutdown_connections 2026-02-20T03:21:31.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.909+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3b180b0e20 0x7f3b180b32e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.909+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3b3c1134d0 0x7f3b3c1a5df0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.909+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3b3c1065d0 0x7f3b3c1a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.909+0000 7f3b42dc5640 1 --2- 10.20.193.28:0/2452752085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3b3c075950 0x7f3b3c1a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:31.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.909+0000 7f3b42dc5640 1 -- 10.20.193.28:0/2452752085 >> 10.20.193.28:0/2452752085 conn(0x7f3b3c0fe440 msgr2=0x7f3b3c111560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:31.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.909+0000 7f3b42dc5640 1 -- 10.20.193.28:0/2452752085 shutdown_connections 2026-02-20T03:21:31.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:31.909+0000 7f3b42dc5640 1 -- 10.20.193.28:0/2452752085 wait complete. 2026-02-20T03:21:32.016 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:21:32.017 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:21:32.283 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:21:32.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.466+0000 7f2b23577640 1 -- 10.20.193.28:0/2016861108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24108710 msgr2=0x7f2b24108af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.466+0000 7f2b23577640 1 --2- 10.20.193.28:0/2016861108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24108710 0x7f2b24108af0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009a60 tx=0x7f2b1802f250 comp rx=0 tx=0).stop 2026-02-20T03:21:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.466+0000 7f2b23577640 1 -- 10.20.193.28:0/2016861108 shutdown_connections 2026-02-20T03:21:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.466+0000 7f2b23577640 1 --2- 10.20.193.28:0/2016861108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b241030b0 0x7f2b2410f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.466+0000 7f2b23577640 1 --2- 10.20.193.28:0/2016861108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b24102710 0x7f2b24102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.466+0000 7f2b23577640 1 --2- 10.20.193.28:0/2016861108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24108710 0x7f2b24108af0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.466+0000 7f2b23577640 1 -- 10.20.193.28:0/2016861108 >> 10.20.193.28:0/2016861108 conn(0x7f2b240fe410 msgr2=0x7f2b24100830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.466+0000 7f2b23577640 1 -- 10.20.193.28:0/2016861108 shutdown_connections 2026-02-20T03:21:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.466+0000 7f2b23577640 1 -- 10.20.193.28:0/2016861108 wait complete. 2026-02-20T03:21:32.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b23577640 1 Processor -- start 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b23577640 1 -- start start 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b23577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24102710 0x7f2b24074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b23577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b241030b0 0x7f2b24074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b23577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b24108710 0x7f2b2406d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b23577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b24112930 con 0x7f2b241030b0 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b23577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b241127b0 con 0x7f2b24108710 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b23577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b24112ab0 con 0x7f2b24102710 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b22575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24102710 0x7f2b24074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b22575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24102710 0x7f2b24074690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48512/0 (socket says 10.20.193.28:48512) 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b22575640 1 -- 10.20.193.28:0/2145103979 learned_addr learned my addr 10.20.193.28:0/2145103979 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.467+0000 7f2b22d76640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b24108710 0x7f2b2406d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:32.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b21d74640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b241030b0 0x7f2b24074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b22575640 1 -- 10.20.193.28:0/2145103979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b24108710 msgr2=0x7f2b2406d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b22575640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b24108710 0x7f2b2406d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b22575640 1 -- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b241030b0 msgr2=0x7f2b24074bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b22575640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b241030b0 0x7f2b24074bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b22575640 1 -- 10.20.193.28:0/2145103979 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2406e100 con 0x7f2b24102710 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b22575640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24102710 0x7f2b24074690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2b1802f760 tx=0x7f2b18002a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b0b7fe640 1 -- 10.20.193.28:0/2145103979 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1802fd00 con 0x7f2b24102710 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b0b7fe640 1 -- 10.20.193.28:0/2145103979 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2b18004570 con 0x7f2b24102710 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2406e390 con 0x7f2b24102710 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b0b7fe640 1 -- 10.20.193.28:0/2145103979 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18041620 con 0x7f2b24102710 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.468+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b24072390 con 0x7f2b24102710 2026-02-20T03:21:32.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.469+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b24103e50 con 0x7f2b24102710 2026-02-20T03:21:32.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.471+0000 7f2b0b7fe640 1 -- 10.20.193.28:0/2145103979 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2b18038890 con 0x7f2b24102710 2026-02-20T03:21:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.472+0000 7f2b0b7fe640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2afc0b0da0 0x7f2afc0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.472+0000 7f2b0b7fe640 1 -- 10.20.193.28:0/2145103979 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2b18105560 con 0x7f2b24102710 2026-02-20T03:21:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.472+0000 7f2b21d74640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2afc0b0da0 0x7f2afc0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.473+0000 7f2b0b7fe640 1 -- 10.20.193.28:0/2145103979 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f2b181059e0 con 0x7f2b24102710 2026-02-20T03:21:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.473+0000 7f2b21d74640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2afc0b0da0 0x7f2afc0b3260 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2b2406eee0 tx=0x7f2b0c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:32.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 569499 7.89 MB/sec execute 185 sec latency 7.235 ms 2026-02-20T03:21:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.582+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b24072db0 con 0x7f2b24102710 2026-02-20T03:21:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.582+0000 7f2b0b7fe640 1 -- 10.20.193.28:0/2145103979 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f2b180cd9d0 con 0x7f2b24102710 2026-02-20T03:21:32.586 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:21:32.586 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:21:32.586 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2afc0b0da0 msgr2=0x7f2afc0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2afc0b0da0 0x7f2afc0b3260 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2b2406eee0 tx=0x7f2b0c009290 comp rx=0 tx=0).stop 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24102710 msgr2=0x7f2b24074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24102710 0x7f2b24074690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2b1802f760 tx=0x7f2b18002a50 comp rx=0 tx=0).stop 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 shutdown_connections 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2afc0b0da0 0x7f2afc0b3260 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b24108710 0x7f2b2406d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b241030b0 0x7f2b24074bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 --2- 10.20.193.28:0/2145103979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b24102710 0x7f2b24074690 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.583+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 >> 10.20.193.28:0/2145103979 conn(0x7f2b240fe410 msgr2=0x7f2b240ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.584+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 shutdown_connections 2026-02-20T03:21:32.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:32.584+0000 7f2b23577640 1 -- 10.20.193.28:0/2145103979 wait complete. 2026-02-20T03:21:32.683 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:21:32.953 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:21:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.148+0000 7f0493195640 1 -- 10.20.193.28:0/180202488 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f048c10f1e0 msgr2=0x7f048c10f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.148+0000 7f0493195640 1 --2- 10.20.193.28:0/180202488 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f048c10f1e0 0x7f048c10f5c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f047c009960 tx=0x7f047c02f140 comp rx=0 tx=0).stop 2026-02-20T03:21:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.148+0000 7f0493195640 1 -- 10.20.193.28:0/180202488 shutdown_connections 2026-02-20T03:21:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.148+0000 7f0493195640 1 --2- 10.20.193.28:0/180202488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f048c109bc0 0x7f048c115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.148+0000 7f0493195640 1 --2- 10.20.193.28:0/180202488 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f048c109220 0x7f048c109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.148+0000 7f0493195640 1 --2- 10.20.193.28:0/180202488 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f048c10f1e0 0x7f048c10f5c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.148+0000 7f0493195640 1 -- 10.20.193.28:0/180202488 >> 10.20.193.28:0/180202488 conn(0x7f048c078860 msgr2=0x7f048c07ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.148+0000 7f0493195640 1 -- 10.20.193.28:0/180202488 shutdown_connections 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.148+0000 7f0493195640 1 -- 10.20.193.28:0/180202488 wait complete. 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.149+0000 7f0493195640 1 Processor -- start 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.149+0000 7f0493195640 1 -- start start 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0493195640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f048c109220 0x7f048c1a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0493195640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f048c109bc0 0x7f048c1a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0493195640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f048c10f1e0 0x7f048c1a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0493195640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f048c119310 con 0x7f048c109220 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0493195640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f048c119190 con 0x7f048c10f1e0 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0493195640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f048c119490 con 0x7f048c109bc0 2026-02-20T03:21:33.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0490f0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f048c109220 0x7f048c1a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0490f0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f048c109220 0x7f048c1a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56536/0 (socket says 10.20.193.28:56536) 2026-02-20T03:21:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0490f0a640 1 -- 10.20.193.28:0/3112849247 learned_addr learned my addr 10.20.193.28:0/3112849247 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0483fff640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f048c109bc0 0x7f048c1a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f049170b640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f048c10f1e0 0x7f048c1a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0490f0a640 1 -- 10.20.193.28:0/3112849247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f048c109bc0 msgr2=0x7f048c1a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0490f0a640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f048c109bc0 0x7f048c1a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0490f0a640 1 -- 10.20.193.28:0/3112849247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f048c10f1e0 msgr2=0x7f048c1a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0490f0a640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f048c10f1e0 0x7f048c1a6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0490f0a640 1 -- 10.20.193.28:0/3112849247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c1a67a0 con 0x7f048c109220 2026-02-20T03:21:33.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.150+0000 7f0490f0a640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f048c109220 0x7f048c1a1750 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f047c009a90 tx=0x7f047c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.151+0000 7f0481ffb640 1 -- 10.20.193.28:0/3112849247 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c046070 con 0x7f048c109220 2026-02-20T03:21:33.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.151+0000 7f0481ffb640 1 -- 10.20.193.28:0/3112849247 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f047c004540 con 0x7f048c109220 2026-02-20T03:21:33.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.151+0000 7f0481ffb640 1 -- 10.20.193.28:0/3112849247 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c041410 con 0x7f048c109220 2026-02-20T03:21:33.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.151+0000 7f0493195640 1 -- 10.20.193.28:0/3112849247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048c1a6a30 con 0x7f048c109220 2026-02-20T03:21:33.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.151+0000 7f0493195640 1 -- 10.20.193.28:0/3112849247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048c1ae2d0 con 0x7f048c109220 2026-02-20T03:21:33.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.154+0000 7f0481ffb640 1 -- 10.20.193.28:0/3112849247 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f047c0026e0 con 0x7f048c109220 2026-02-20T03:21:33.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.154+0000 7f049569ae00 1 Processor -- start 2026-02-20T03:21:33.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049569ae00 1 -- start start 2026-02-20T03:21:33.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049569ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c5a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049569ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c5e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049170b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c5a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049569ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5f0d0 0x559206c66c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049569ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559206bdae00 con 0x559206c5a5e0 2026-02-20T03:21:33.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049170b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c5a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56544/0 (socket says 10.20.193.28:56544) 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049569ae00 1 -- 10.20.193.28:0/1971395055 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559206bad970 con 0x559206c5af90 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049170b640 1 -- 10.20.193.28:0/1971395055 learned_addr learned my addr 10.20.193.28:0/1971395055 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.155+0000 7f049569ae00 1 -- 10.20.193.28:0/1971395055 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559206b5b1f0 con 0x559206c5f0d0 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0490f0a640 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c5e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0481ffb640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04680b0e20 0x7f04680b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0481ffb640 1 -- 10.20.193.28:0/3112849247 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f047c104a40 con 0x7f048c109220 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0483fff640 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5f0d0 0x559206c66c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0490f0a640 1 -- 10.20.193.28:0/1971395055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5f0d0 msgr2=0x559206c66c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0490f0a640 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5f0d0 0x559206c66c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0490f0a640 1 -- 10.20.193.28:0/1971395055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 msgr2=0x559206c5a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0490f0a640 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c5a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0490f0a640 1 -- 10.20.193.28:0/1971395055 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559206b6e3d0 con 0x559206c5af90 2026-02-20T03:21:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0483fff640 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5f0d0 0x559206c66c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:21:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f049170b640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04680b0e20 0x7f04680b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.156+0000 7f0490f0a640 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c5e9a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f047c0cc420 tx=0x7f047c009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12fb2872824c9db8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f04594e4640 1 -- 10.20.193.28:0/1971395055 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0d0ad0 con 0x559206c5af90 2026-02-20T03:21:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f04594e4640 1 -- 10.20.193.28:0/1971395055 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f047c033060 con 0x559206c5af90 2026-02-20T03:21:33.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f04594e4640 1 -- 10.20.193.28:0/1971395055 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0cb1a0 con 0x559206c5af90 2026-02-20T03:21:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049569ae00 1 -- 10.20.193.28:0/1971395055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 msgr2=0x559206c5e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049170b640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04680b0e20 0x7f04680b32e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0488004250 tx=0x7f0488004040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049569ae00 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c5e9a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f047c0cc420 tx=0x7f047c009290 comp rx=0 tx=0).stop 2026-02-20T03:21:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049569ae00 1 -- 10.20.193.28:0/1971395055 shutdown_connections 2026-02-20T03:21:33.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049569ae00 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5f0d0 0x559206c66c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049569ae00 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c5e9a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049569ae00 1 --2- 10.20.193.28:0/1971395055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c5a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049569ae00 1 -- 10.20.193.28:0/1971395055 >> 10.20.193.28:0/1971395055 conn(0x559206c1d240 msgr2=0x559206c58ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049569ae00 1 -- 10.20.193.28:0/1971395055 shutdown_connections 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.157+0000 7f049569ae00 1 -- 10.20.193.28:0/1971395055 wait complete. 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.158+0000 7f049569ae00 1 -- start start 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.158+0000 7f049569ae00 1 Processor -- start 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f049569ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c72d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f049569ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5af90 0x559206c732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f049569ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5f0d0 0x559206c78830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f049569ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559206ba98a0 con 0x559206c5a5e0 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f049569ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55920699bf50 con 0x559206c5f0d0 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f049569ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559206c78d70 con 0x559206c5af90 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f0490f0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c72d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f0490f0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c72d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56560/0 (socket says 10.20.193.28:56560) 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f0490f0a640 1 -- 10.20.193.28:0/3092707776 learned_addr learned my addr 10.20.193.28:0/3092707776 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f0483fff640 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5af90 0x559206c732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f0490f0a640 1 -- 10.20.193.28:0/3092707776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5af90 msgr2=0x559206c732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f0490f0a640 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5af90 0x559206c732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f049170b640 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5f0d0 0x559206c78830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f0490f0a640 1 -- 10.20.193.28:0/3092707776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5f0d0 msgr2=0x559206c78830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f0490f0a640 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5f0d0 0x559206c78830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f0490f0a640 1 -- 10.20.193.28:0/3092707776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559206c6c540 con 0x559206c5a5e0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.159+0000 7f049170b640 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5f0d0 0x559206c78830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f0490f0a640 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c72d90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f047c009930 tx=0x7f047c0cb9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f837ce6a4ed1439 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f044a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f044a7fc640 1 -- 10.20.193.28:0/3092707776 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0d5980 con 0x559206c5a5e0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f044a7fc640 1 -- 10.20.193.28:0/3092707776 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f047c0d0ad0 con 0x559206c5a5e0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f044a7fc640 1 -- 10.20.193.28:0/3092707776 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0d5120 con 0x559206c5a5e0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f049569ae00 1 -- 10.20.193.28:0/3092707776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55920697eb40 con 0x559206c5a5e0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f049569ae00 10 client.17055 _ll_register_callbacks cb 0x559206be6eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f049569ae00 1 -- 10.20.193.28:0/3092707776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559206bbb150 con 0x559206c5a5e0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f044a7fc640 1 -- 10.20.193.28:0/3092707776 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f047c0cda50 con 0x559206c5a5e0 2026-02-20T03:21:33.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f044a7fc640 1 -- 10.20.193.28:0/3092707776 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f047c0d52c0 con 0x559206c5a5e0 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f049569ae00 10 client.17055 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.160+0000 7f049569ae00 1 -- 10.20.193.28:0/3092707776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559206b681e0 con 0x559206c5a5e0 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.161+0000 7f044a7fc640 1 -- 10.20.193.28:0/3092707776 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f047c0cb1a0 con 0x559206c5a5e0 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.161+0000 7f049569ae00 10 client.17055 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.161+0000 7f049569ae00 10 client.17055 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.161+0000 7f049569ae00 20 client.17055 populate_metadata read hostname 'trial028' 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.161+0000 7f049569ae00 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559206c82830 0x559206c84cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.161+0000 7f049569ae00 4 client.17055 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.161+0000 7f049569ae00 1 -- 10.20.193.28:0/3092707776 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559206bb5560 con 0x559206c82830 2026-02-20T03:21:33.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.161+0000 7f0483fff640 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559206c82830 0x559206c84cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.162+0000 7f0483fff640 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559206c82830 0x559206c84cc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=de85d2aacd7fdb2c server_cookie=6708e35054e5570e in_seq=0 out_seq=0 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.162+0000 7f044a7fc640 10 client.17055 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f044a7fc640 1 -- 10.20.193.28:0/3092707776 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559206bb5560 con 0x559206c82830 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f044a7fc640 10 client.17055 handle_command_reply: tid=0 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 client.17055 shutdown 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 -- 10.20.193.28:0/3092707776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 msgr2=0x559206c72d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c72d90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f047c009930 tx=0x7f047c0cb9e0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 -- 10.20.193.28:0/3092707776 shutdown_connections 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5f0d0 0x559206c78830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5af90 0x559206c732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559206c82830 0x559206c84cc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 --2- 10.20.193.28:0/3092707776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5a5e0 0x559206c72d90 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 -- 10.20.193.28:0/3092707776 >> 10.20.193.28:0/3092707776 conn(0x559206c1d240 msgr2=0x559206c5d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f044a7fc640 0 client.17055 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:21:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 -- 10.20.193.28:0/3092707776 shutdown_connections 2026-02-20T03:21:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 1 -- 10.20.193.28:0/3092707776 wait complete. 2026-02-20T03:21:33.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.163+0000 7f049569ae00 20 client.17055 trim_cache size 0 max 16384 2026-02-20T03:21:33.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.170+0000 7f049569ae00 1 Processor -- start 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.170+0000 7f049569ae00 1 -- start start 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.170+0000 7f049569ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 0x559206c8a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.170+0000 7f049569ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c8aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.170+0000 7f049569ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.170+0000 7f049569ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f04300126f0 con 0x559206c5f0d0 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.170+0000 7f049569ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f043000ffc0 con 0x559206c5af90 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.170+0000 7f049569ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f043000de10 con 0x559206c5a5e0 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f049170b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f0490f0a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 0x559206c8a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f0490f0a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 0x559206c8a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48564/0 (socket says 10.20.193.28:48564) 2026-02-20T03:21:33.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f049170b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56562/0 (socket says 10.20.193.28:56562) 2026-02-20T03:21:33.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f0490f0a640 1 -- 10.20.193.28:0/1110556918 learned_addr learned my addr 10.20.193.28:0/1110556918 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f0483fff640 1 --2- 10.20.193.28:0/1110556918 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c8aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f049170b640 1 -- 10.20.193.28:0/1110556918 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 msgr2=0x559206c8a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f049170b640 1 --2- 10.20.193.28:0/1110556918 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 0x559206c8a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f049170b640 1 -- 10.20.193.28:0/1110556918 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 msgr2=0x559206c8aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f049170b640 1 --2- 10.20.193.28:0/1110556918 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c8aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f049170b640 1 -- 10.20.193.28:0/1110556918 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559206c6c370 con 0x559206c5f0d0 2026-02-20T03:21:33.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f049170b640 1 --2- 10.20.193.28:0/1110556918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7e400 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f04880047f0 tx=0x7f048800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328b7dc17dad1594 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f0458ce3640 1 -- 10.20.193.28:0/1110556918 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488015b50 con 0x559206c5f0d0 2026-02-20T03:21:33.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f0458ce3640 1 -- 10.20.193.28:0/1110556918 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0488015cf0 con 0x559206c5f0d0 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.171+0000 7f0458ce3640 1 -- 10.20.193.28:0/1110556918 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04880267f0 con 0x559206c5f0d0 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.172+0000 7f049569ae00 1 -- 10.20.193.28:0/1110556918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 msgr2=0x559206c7e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.172+0000 7f049569ae00 1 --2- 10.20.193.28:0/1110556918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7e400 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f04880047f0 tx=0x7f048800b040 comp rx=0 tx=0).stop 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.172+0000 7f049569ae00 1 -- 10.20.193.28:0/1110556918 shutdown_connections 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.172+0000 7f049569ae00 1 --2- 10.20.193.28:0/1110556918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7e400 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.172+0000 7f049569ae00 1 --2- 10.20.193.28:0/1110556918 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c8aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.172+0000 7f049569ae00 1 --2- 10.20.193.28:0/1110556918 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 0x559206c8a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.172+0000 7f049569ae00 1 -- 10.20.193.28:0/1110556918 >> 10.20.193.28:0/1110556918 conn(0x559206c1d240 msgr2=0x559206c71b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.173+0000 7f049569ae00 1 -- 10.20.193.28:0/1110556918 shutdown_connections 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.173+0000 7f049569ae00 1 -- 10.20.193.28:0/1110556918 wait complete. 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.173+0000 7f049569ae00 1 -- start start 2026-02-20T03:21:33.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.173+0000 7f049569ae00 1 Processor -- start 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.173+0000 7f049569ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 0x559206c7be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049569ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c7c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049569ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049569ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f043000e480 con 0x559206c5f0d0 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049569ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f043000f8f0 con 0x559206c5af90 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049569ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f043000eb50 con 0x559206c5a5e0 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049170b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f0490f0a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 0x559206c7be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049170b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56568/0 (socket says 10.20.193.28:56568) 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049170b640 1 -- 10.20.193.28:0/660740278 learned_addr learned my addr 10.20.193.28:0/660740278 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f0483fff640 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c7c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049170b640 1 -- 10.20.193.28:0/660740278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 msgr2=0x559206c7be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049170b640 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 0x559206c7be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049170b640 1 -- 10.20.193.28:0/660740278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 msgr2=0x559206c7c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049170b640 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c7c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049170b640 1 -- 10.20.193.28:0/660740278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55920688c870 con 0x559206c5f0d0 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f049170b640 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7c8e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0488026490 tx=0x7f0488015b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f477ac69ea0d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.174+0000 7f044a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f044a7fc640 1 -- 10.20.193.28:0/660740278 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488015ea0 con 0x559206c5f0d0 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f044a7fc640 1 -- 10.20.193.28:0/660740278 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f048802b070 con 0x559206c5f0d0 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f044a7fc640 1 -- 10.20.193.28:0/660740278 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488018420 con 0x559206c5f0d0 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f049569ae00 1 -- 10.20.193.28:0/660740278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559206b4d3f0 con 0x559206c5f0d0 2026-02-20T03:21:33.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f044a7fc640 1 -- 10.20.193.28:0/660740278 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f04880185c0 con 0x559206c5f0d0 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f049569ae00 10 client.17061 _ll_register_callbacks cb 0x7f047c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f049569ae00 1 -- 10.20.193.28:0/660740278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559206b5fab0 con 0x559206c5f0d0 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f044a7fc640 1 -- 10.20.193.28:0/660740278 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f04880266c0 con 0x559206c5f0d0 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f049569ae00 10 client.17061 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f049569ae00 1 -- 10.20.193.28:0/660740278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559206c6d060 con 0x559206c5f0d0 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.175+0000 7f044a7fc640 1 -- 10.20.193.28:0/660740278 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f04880079d0 con 0x559206c5f0d0 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.176+0000 7f049569ae00 10 client.17061 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.176+0000 7f049569ae00 10 client.17061 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.176+0000 7f049569ae00 20 client.17061 populate_metadata read hostname 'trial028' 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.176+0000 7f049569ae00 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559206ceed50 0x559206cf1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.176+0000 7f049569ae00 4 client.17061 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:21:33.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.176+0000 7f049569ae00 1 -- 10.20.193.28:0/660740278 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0488015cf0 con 0x559206ceed50 2026-02-20T03:21:33.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.176+0000 7f0490f0a640 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559206ceed50 0x559206cf1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f0490f0a640 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559206ceed50 0x559206cf1210 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48775e1a07abdfb server_cookie=d0b2a740bf3e025a in_seq=0 out_seq=0 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f044a7fc640 10 client.17061 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f044a7fc640 1 -- 10.20.193.28:0/660740278 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0488015cf0 con 0x559206ceed50 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f044a7fc640 10 client.17061 handle_command_reply: tid=0 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f049569ae00 1 client.17061 shutdown 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f049569ae00 1 -- 10.20.193.28:0/660740278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 msgr2=0x559206c7c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f049569ae00 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7c8e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0488026490 tx=0x7f0488015b00 comp rx=0 tx=0).stop 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f049569ae00 1 -- 10.20.193.28:0/660740278 shutdown_connections 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f049569ae00 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559206ceed50 0x559206cf1210 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f049569ae00 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559206c5f0d0 0x559206c7c8e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f049569ae00 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559206c5af90 0x559206c7c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f044a7fc640 0 client.17061 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:21:33.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f049569ae00 1 --2- 10.20.193.28:0/660740278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559206c5a5e0 0x559206c7be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.177+0000 7f049569ae00 1 -- 10.20.193.28:0/660740278 >> 10.20.193.28:0/660740278 conn(0x559206c1d240 msgr2=0x559206c5f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.178+0000 7f049569ae00 1 -- 10.20.193.28:0/660740278 shutdown_connections 2026-02-20T03:21:33.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.178+0000 7f049569ae00 1 -- 10.20.193.28:0/660740278 wait complete. 2026-02-20T03:21:33.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.178+0000 7f049569ae00 20 client.17061 trim_cache size 0 max 16384 2026-02-20T03:21:33.186 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:21:33.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.178+0000 7f0493195640 1 -- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04680b0e20 msgr2=0x7f04680b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.178+0000 7f0493195640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04680b0e20 0x7f04680b32e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0488004250 tx=0x7f0488004040 comp rx=0 tx=0).stop 2026-02-20T03:21:33.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.178+0000 7f0493195640 1 -- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f048c109220 msgr2=0x7f048c1a1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.178+0000 7f0493195640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f048c109220 0x7f048c1a1750 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f047c009a90 tx=0x7f047c004290 comp rx=0 tx=0).stop 2026-02-20T03:21:33.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.179+0000 7f0493195640 1 -- 10.20.193.28:0/3112849247 shutdown_connections 2026-02-20T03:21:33.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.179+0000 7f0493195640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04680b0e20 0x7f04680b32e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.179+0000 7f0493195640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f048c10f1e0 0x7f048c1a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.179+0000 7f0493195640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f048c109bc0 0x7f048c1a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.179+0000 7f0493195640 1 --2- 10.20.193.28:0/3112849247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f048c109220 0x7f048c1a1750 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.179+0000 7f0493195640 1 -- 10.20.193.28:0/3112849247 >> 10.20.193.28:0/3112849247 conn(0x7f048c078860 msgr2=0x7f048c07a210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.179+0000 7f0493195640 1 -- 10.20.193.28:0/3112849247 shutdown_connections 2026-02-20T03:21:33.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.179+0000 7f0493195640 1 -- 10.20.193.28:0/3112849247 wait complete. 2026-02-20T03:21:33.281 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:33 trial028 ceph-mon[38552]: pgmap v387: 129 pgs: 129 active+clean; 102 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 940 KiB/s rd, 2.6 MiB/s wr, 327 op/s 2026-02-20T03:21:33.281 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:33 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2145103979' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:21:33.283 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:21:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:33 trial177 ceph-mon[43181]: pgmap v387: 129 pgs: 129 active+clean; 102 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 940 KiB/s rd, 2.6 MiB/s wr, 327 op/s 2026-02-20T03:21:33.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:33 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2145103979' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:21:33.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 573340 7.96 MB/sec execute 186 sec latency 6.724 ms 2026-02-20T03:21:33.550 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:21:33.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:33 trial126 ceph-mon[38476]: pgmap v387: 129 pgs: 129 active+clean; 102 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 940 KiB/s rd, 2.6 MiB/s wr, 327 op/s 2026-02-20T03:21:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:33 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2145103979' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.748+0000 7f06b1bee640 1 -- 10.20.193.28:0/2681490247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f06ac077f40 msgr2=0x7f06ac113300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.748+0000 7f06b1bee640 1 --2- 10.20.193.28:0/2681490247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f06ac077f40 0x7f06ac113300 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0694009a30 tx=0x7f069402f220 comp rx=0 tx=0).stop 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.748+0000 7f06b1bee640 1 -- 10.20.193.28:0/2681490247 shutdown_connections 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.748+0000 7f06b1bee640 1 --2- 10.20.193.28:0/2681490247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f06ac113840 0x7f06ac115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.748+0000 7f06b1bee640 1 --2- 10.20.193.28:0/2681490247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f06ac077f40 0x7f06ac113300 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.748+0000 7f06b1bee640 1 --2- 10.20.193.28:0/2681490247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f06ac077620 0x7f06ac077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.748+0000 7f06b1bee640 1 -- 10.20.193.28:0/2681490247 >> 10.20.193.28:0/2681490247 conn(0x7f06ac1006c0 msgr2=0x7f06ac102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.748+0000 7f06b1bee640 1 -- 10.20.193.28:0/2681490247 shutdown_connections 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.748+0000 7f06b1bee640 1 -- 10.20.193.28:0/2681490247 wait complete. 2026-02-20T03:21:33.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.749+0000 7f06b1bee640 1 Processor -- start 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.749+0000 7f06b1bee640 1 -- start start 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.749+0000 7f06b1bee640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f06ac077620 0x7f06ac112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.749+0000 7f06b1bee640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f06ac077f40 0x7f06ac1130f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.749+0000 7f06b1bee640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f06ac113840 0x7f06ac10bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.749+0000 7f06b1bee640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac119110 con 0x7f06ac077f40 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.749+0000 7f06b1bee640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac118f90 con 0x7f06ac077620 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.749+0000 7f06b1bee640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac119290 con 0x7f06ac113840 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06a3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f06ac077f40 0x7f06ac1130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06b13ed640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f06ac113840 0x7f06ac10bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06b13ed640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f06ac113840 0x7f06ac10bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48582/0 (socket says 10.20.193.28:48582) 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06b13ed640 1 -- 10.20.193.28:0/1392983384 learned_addr learned my addr 10.20.193.28:0/1392983384 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06b0bec640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f06ac077620 0x7f06ac112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06a3fff640 1 -- 10.20.193.28:0/1392983384 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f06ac113840 msgr2=0x7f06ac10bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06a3fff640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f06ac113840 0x7f06ac10bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06a3fff640 1 -- 10.20.193.28:0/1392983384 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f06ac077620 msgr2=0x7f06ac112bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06a3fff640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f06ac077620 0x7f06ac112bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06a3fff640 1 -- 10.20.193.28:0/1392983384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac10c560 con 0x7f06ac077f40 2026-02-20T03:21:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06b0bec640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f06ac077620 0x7f06ac112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:33.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.750+0000 7f06b13ed640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f06ac113840 0x7f06ac10bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:33.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.751+0000 7f06a3fff640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f06ac077f40 0x7f06ac1130f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0694009950 tx=0x7f0694004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.751+0000 7f06a1ffb640 1 -- 10.20.193.28:0/1392983384 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694038770 con 0x7f06ac077f40 2026-02-20T03:21:33.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.751+0000 7f06a1ffb640 1 -- 10.20.193.28:0/1392983384 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0694038db0 con 0x7f06ac077f40 2026-02-20T03:21:33.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.751+0000 7f06b1bee640 1 -- 10.20.193.28:0/1392983384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ac10c7f0 con 0x7f06ac077f40 2026-02-20T03:21:33.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.751+0000 7f06b1bee640 1 -- 10.20.193.28:0/1392983384 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ac1108b0 con 0x7f06ac077f40 2026-02-20T03:21:33.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.751+0000 7f06a1ffb640 1 -- 10.20.193.28:0/1392983384 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694041620 con 0x7f06ac077f40 2026-02-20T03:21:33.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.754+0000 7f06a1ffb640 1 -- 10.20.193.28:0/1392983384 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0694002920 con 0x7f06ac077f40 2026-02-20T03:21:33.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.754+0000 7f06b537ce00 1 Processor -- start 2026-02-20T03:21:33.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.754+0000 7f06b537ce00 1 -- start start 2026-02-20T03:21:33.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 0x55c72546d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c7254675e0 0x55c725467a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c725473de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b537ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c7253e7e00 con 0x55c725467f60 2026-02-20T03:21:33.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b537ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c7253ba970 con 0x55c7254675e0 2026-02-20T03:21:33.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b537ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c7253681f0 con 0x55c72546cfb0 2026-02-20T03:21:33.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b13ed640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 0x55c72546d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b13ed640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 0x55c72546d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48586/0 (socket says 10.20.193.28:48586) 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b13ed640 1 -- 10.20.193.28:0/4020245985 learned_addr learned my addr 10.20.193.28:0/4020245985 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b0bec640 1 --2- 10.20.193.28:0/4020245985 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c7254675e0 0x55c725467a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b13ed640 1 -- 10.20.193.28:0/4020245985 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c7254675e0 msgr2=0x55c725467a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b13ed640 1 --2- 10.20.193.28:0/4020245985 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c7254675e0 0x55c725467a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b13ed640 1 -- 10.20.193.28:0/4020245985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 msgr2=0x55c725473de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b13ed640 1 --2- 10.20.193.28:0/4020245985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c725473de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b13ed640 1 -- 10.20.193.28:0/4020245985 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c72537b3d0 con 0x55c72546cfb0 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.755+0000 7f06b13ed640 1 --2- 10.20.193.28:0/4020245985 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 0x55c72546d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f06a8007530 tx=0x7f06a8009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4612df87ea0cd42 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06794e4640 1 -- 10.20.193.28:0/4020245985 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a800e670 con 0x55c72546cfb0 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06794e4640 1 -- 10.20.193.28:0/4020245985 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f06a801a070 con 0x55c72546cfb0 2026-02-20T03:21:33.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06794e4640 1 -- 10.20.193.28:0/4020245985 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a8004710 con 0x55c72546cfb0 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06b537ce00 1 -- 10.20.193.28:0/4020245985 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 msgr2=0x55c72546d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06b537ce00 1 --2- 10.20.193.28:0/4020245985 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 0x55c72546d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f06a8007530 tx=0x7f06a8009920 comp rx=0 tx=0).stop 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06a1ffb640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f06880b0e20 0x7f06880b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06a1ffb640 1 -- 10.20.193.28:0/1392983384 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f06941050d0 con 0x7f06ac077f40 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06b13ed640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f06880b0e20 0x7f06880b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06b537ce00 1 -- 10.20.193.28:0/4020245985 shutdown_connections 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06b537ce00 1 --2- 10.20.193.28:0/4020245985 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c725473de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06b537ce00 1 --2- 10.20.193.28:0/4020245985 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c7254675e0 0x55c725467a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06b537ce00 1 --2- 10.20.193.28:0/4020245985 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 0x55c72546d390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06b537ce00 1 -- 10.20.193.28:0/4020245985 >> 10.20.193.28:0/4020245985 conn(0x55c72542a240 msgr2=0x55c725465ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.756+0000 7f06b537ce00 1 -- 10.20.193.28:0/4020245985 shutdown_connections 2026-02-20T03:21:33.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.757+0000 7f06b537ce00 1 -- 10.20.193.28:0/4020245985 wait complete. 2026-02-20T03:21:33.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.757+0000 7f06b13ed640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f06880b0e20 0x7f06880b32e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f06a8004040 tx=0x7f06a8009100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06b537ce00 1 -- start start 2026-02-20T03:21:33.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06b537ce00 1 Processor -- start 2026-02-20T03:21:33.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7254675e0 0x55c725481f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c725467f60 0x55c725482470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 0x55c725480670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06b537ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c7253b68a0 con 0x55c7254675e0 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06b537ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c7251a8f50 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06b537ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c725480df0 con 0x55c72546cfb0 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06a3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c725467f60 0x55c725482470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06a3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c725467f60 0x55c725482470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41646/0 (socket says 10.20.193.28:41646) 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.758+0000 7f06a3fff640 1 -- 10.20.193.28:0/998867427 learned_addr learned my addr 10.20.193.28:0/998867427 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06a3fff640 1 -- 10.20.193.28:0/998867427 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 msgr2=0x55c725480670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06a3fff640 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 0x55c725480670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06b0bec640 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7254675e0 0x55c725481f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06a3fff640 1 -- 10.20.193.28:0/998867427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7254675e0 msgr2=0x55c725481f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06a3fff640 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7254675e0 0x55c725481f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06a3fff640 1 -- 10.20.193.28:0/998867427 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c725479ad0 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06b0bec640 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7254675e0 0x55c725481f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06a3fff640 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c725467f60 0x55c725482470 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06940ccab0 tx=0x7f06940ccc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a872b6146457d967 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f066a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f066a7fc640 1 -- 10.20.193.28:0/998867427 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940d1160 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06b537ce00 1 -- 10.20.193.28:0/998867427 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c72518bb40 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f066a7fc640 1 -- 10.20.193.28:0/998867427 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f06940d0060 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f066a7fc640 1 -- 10.20.193.28:0/998867427 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694038b70 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06b537ce00 10 client.26573 _ll_register_callbacks cb 0x55c7253f3eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f06b537ce00 1 -- 10.20.193.28:0/998867427 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c7253c8150 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f066a7fc640 1 -- 10.20.193.28:0/998867427 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f06940cbdc0 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.759+0000 7f066a7fc640 1 -- 10.20.193.28:0/998867427 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f06940cbfc0 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f06b537ce00 10 client.26573 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f06b537ce00 1 -- 10.20.193.28:0/998867427 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c7253751e0 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f066a7fc640 1 -- 10.20.193.28:0/998867427 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f06940d3050 con 0x55c725467f60 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f06b537ce00 10 client.26573 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f06b537ce00 10 client.26573 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f06b537ce00 20 client.26573 populate_metadata read hostname 'trial028' 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f06b537ce00 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c725490590 0x55c725492a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f06b537ce00 4 client.26573 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f06b537ce00 1 -- 10.20.193.28:0/998867427 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7253c2560 con 0x55c725490590 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.760+0000 7f06b0bec640 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c725490590 0x55c725492a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.761+0000 7f06b0bec640 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c725490590 0x55c725492a50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=894a741948f0b298 server_cookie=d1a43d1ca4c2a744 in_seq=0 out_seq=0 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.761+0000 7f066a7fc640 10 client.26573 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:21:33.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.761+0000 7f066a7fc640 1 -- 10.20.193.28:0/998867427 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c7253c2560 con 0x55c725490590 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.761+0000 7f066a7fc640 10 client.26573 handle_command_reply: tid=0 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.761+0000 7f06b537ce00 1 client.26573 shutdown 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.761+0000 7f06b537ce00 1 -- 10.20.193.28:0/998867427 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c725467f60 msgr2=0x55c725482470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.761+0000 7f06b537ce00 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c725467f60 0x55c725482470 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06940ccab0 tx=0x7f06940ccc70 comp rx=0 tx=0).stop 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f06b537ce00 1 -- 10.20.193.28:0/998867427 shutdown_connections 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f06b537ce00 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c725490590 0x55c725492a50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f06b537ce00 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c72546cfb0 0x55c725480670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f06b537ce00 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c725467f60 0x55c725482470 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f06b537ce00 1 --2- 10.20.193.28:0/998867427 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c7254675e0 0x55c725481f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f06b537ce00 1 -- 10.20.193.28:0/998867427 >> 10.20.193.28:0/998867427 conn(0x55c72542a240 msgr2=0x55c7254663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f066a7fc640 0 client.26573 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f06b537ce00 1 -- 10.20.193.28:0/998867427 shutdown_connections 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f06b537ce00 1 -- 10.20.193.28:0/998867427 wait complete. 2026-02-20T03:21:33.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.762+0000 7f06b537ce00 20 client.26573 trim_cache size 0 max 16384 2026-02-20T03:21:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b537ce00 1 Processor -- start 2026-02-20T03:21:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b537ce00 1 -- start start 2026-02-20T03:21:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c72547df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c7254664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 0x55c725466a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b537ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f06500126f0 con 0x55c725467f60 2026-02-20T03:21:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b537ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f065000ffc0 con 0x55c72546cfb0 2026-02-20T03:21:33.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b537ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f065000de10 con 0x55c7254675e0 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b0bec640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c72547df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b0bec640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c72547df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48598/0 (socket says 10.20.193.28:48598) 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b0bec640 1 -- 10.20.193.28:0/3070867955 learned_addr learned my addr 10.20.193.28:0/3070867955 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06a3fff640 1 --2- 10.20.193.28:0/3070867955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c7254664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.769+0000 7f06b13ed640 1 --2- 10.20.193.28:0/3070867955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 0x55c725466a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b0bec640 1 -- 10.20.193.28:0/3070867955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 msgr2=0x55c725466a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b0bec640 1 --2- 10.20.193.28:0/3070867955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 0x55c725466a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b0bec640 1 -- 10.20.193.28:0/3070867955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 msgr2=0x55c7254664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b0bec640 1 --2- 10.20.193.28:0/3070867955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c7254664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b0bec640 1 -- 10.20.193.28:0/3070867955 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c725479900 con 0x55c7254675e0 2026-02-20T03:21:33.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b0bec640 1 --2- 10.20.193.28:0/3070867955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c72547df30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f069c0097c0 tx=0x7f069c009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc59ed03b64f9f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f0678ce3640 1 -- 10.20.193.28:0/3070867955 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c003d10 con 0x55c7254675e0 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f0678ce3640 1 -- 10.20.193.28:0/3070867955 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f069c020020 con 0x55c7254675e0 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f0678ce3640 1 -- 10.20.193.28:0/3070867955 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c0117c0 con 0x55c7254675e0 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b537ce00 1 -- 10.20.193.28:0/3070867955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 msgr2=0x55c72547df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b537ce00 1 --2- 10.20.193.28:0/3070867955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c72547df30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f069c0097c0 tx=0x7f069c009290 comp rx=0 tx=0).stop 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b537ce00 1 -- 10.20.193.28:0/3070867955 shutdown_connections 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b537ce00 1 --2- 10.20.193.28:0/3070867955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 0x55c725466a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b537ce00 1 --2- 10.20.193.28:0/3070867955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c7254664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b537ce00 1 --2- 10.20.193.28:0/3070867955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c72547df30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b537ce00 1 -- 10.20.193.28:0/3070867955 >> 10.20.193.28:0/3070867955 conn(0x55c72542a240 msgr2=0x55c725481f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b537ce00 1 -- 10.20.193.28:0/3070867955 shutdown_connections 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.770+0000 7f06b537ce00 1 -- 10.20.193.28:0/3070867955 wait complete. 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.771+0000 7f06b537ce00 1 -- start start 2026-02-20T03:21:33.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.771+0000 7f06b537ce00 1 Processor -- start 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.771+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c725487fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.771+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c7254884e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.771+0000 7f06b537ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 0x55c725484d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.771+0000 7f06b537ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f065000e480 con 0x55c725467f60 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.771+0000 7f06b537ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f065000f8f0 con 0x55c72546cfb0 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.771+0000 7f06b537ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f065000eb50 con 0x55c7254675e0 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06a3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c7254884e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b0bec640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c725487fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b0bec640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c725487fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48614/0 (socket says 10.20.193.28:48614) 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b0bec640 1 -- 10.20.193.28:0/267533 learned_addr learned my addr 10.20.193.28:0/267533 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b13ed640 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 0x55c725484d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b0bec640 1 -- 10.20.193.28:0/267533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 msgr2=0x55c725484d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b0bec640 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 0x55c725484d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b0bec640 1 -- 10.20.193.28:0/267533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 msgr2=0x55c7254884e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b0bec640 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c7254884e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b0bec640 1 -- 10.20.193.28:0/267533 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c725099870 con 0x55c7254675e0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b0bec640 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c725487fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f069c022040 tx=0x7f069c003f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70ce027606f78d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f066a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f066a7fc640 1 -- 10.20.193.28:0/267533 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c01d7d0 con 0x55c7254675e0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b537ce00 1 -- 10.20.193.28:0/267533 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c72535a3f0 con 0x55c7254675e0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f066a7fc640 1 -- 10.20.193.28:0/267533 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f069c02b070 con 0x55c7254675e0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f066a7fc640 1 -- 10.20.193.28:0/267533 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c030470 con 0x55c7254675e0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b537ce00 10 client.26593 _ll_register_callbacks cb 0x7f06940c8a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.772+0000 7f06b537ce00 1 -- 10.20.193.28:0/267533 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c72536cab0 con 0x55c7254675e0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f066a7fc640 1 -- 10.20.193.28:0/267533 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f069c025460 con 0x55c7254675e0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f066a7fc640 1 -- 10.20.193.28:0/267533 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f069c025720 con 0x55c7254675e0 2026-02-20T03:21:33.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f06b537ce00 10 client.26593 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f06b537ce00 1 -- 10.20.193.28:0/267533 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c72547a5f0 con 0x55c7254675e0 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f066a7fc640 1 -- 10.20.193.28:0/267533 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f069c011540 con 0x55c7254675e0 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f06b537ce00 10 client.26593 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f06b537ce00 10 client.26593 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f06b537ce00 20 client.26593 populate_metadata read hostname 'trial028' 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f06b537ce00 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c7254fbde0 0x55c7254fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f06b537ce00 4 client.26593 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f06b537ce00 1 -- 10.20.193.28:0/267533 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f06a801a070 con 0x55c7254fbde0 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.773+0000 7f06a3fff640 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c7254fbde0 0x55c7254fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06a3fff640 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c7254fbde0 0x55c7254fe2a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20243d43d5d3e447 server_cookie=aea4d521d4b8c229 in_seq=0 out_seq=0 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f066a7fc640 10 client.26593 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f066a7fc640 1 -- 10.20.193.28:0/267533 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f06a801a070 con 0x55c7254fbde0 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f066a7fc640 10 client.26593 handle_command_reply: tid=0 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 client.26593 shutdown 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 -- 10.20.193.28:0/267533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 msgr2=0x55c725487fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c725487fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f069c022040 tx=0x7f069c003f40 comp rx=0 tx=0).stop 2026-02-20T03:21:33.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 -- 10.20.193.28:0/267533 shutdown_connections 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c7254fbde0 0x55c7254fe2a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c72546cfb0 0x55c725484d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c725467f60 0x55c7254884e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 --2- 10.20.193.28:0/267533 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c7254675e0 0x55c725487fa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f066a7fc640 0 client.26593 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 -- 10.20.193.28:0/267533 >> 10.20.193.28:0/267533 conn(0x55c72542a240 msgr2=0x55c72547ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 -- 10.20.193.28:0/267533 shutdown_connections 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 1 -- 10.20.193.28:0/267533 wait complete. 2026-02-20T03:21:33.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.774+0000 7f06b537ce00 20 client.26593 trim_cache size 0 max 16384 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 -- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f06880b0e20 msgr2=0x7f06880b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f06880b0e20 0x7f06880b32e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f06a8004040 tx=0x7f06a8009100 comp rx=0 tx=0).stop 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 -- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f06ac077f40 msgr2=0x7f06ac1130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f06ac077f40 0x7f06ac1130f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0694009950 tx=0x7f0694004300 comp rx=0 tx=0).stop 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 -- 10.20.193.28:0/1392983384 shutdown_connections 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f06880b0e20 0x7f06880b32e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f06ac113840 0x7f06ac10bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f06ac077f40 0x7f06ac1130f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 --2- 10.20.193.28:0/1392983384 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f06ac077620 0x7f06ac112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 -- 10.20.193.28:0/1392983384 >> 10.20.193.28:0/1392983384 conn(0x7f06ac1006c0 msgr2=0x7f06ac114d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 -- 10.20.193.28:0/1392983384 shutdown_connections 2026-02-20T03:21:33.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:33.775+0000 7f06b1bee640 1 -- 10.20.193.28:0/1392983384 wait complete. 2026-02-20T03:21:33.874 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:21:34.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 -- 10.20.193.28:0/1976915703 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 msgr2=0x7ff67c102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1976915703 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 0x7ff67c102ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff668009960 tx=0x7ff66802f140 comp rx=0 tx=0).stop 2026-02-20T03:21:34.121 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 -- 10.20.193.28:0/1976915703 shutdown_connections 2026-02-20T03:21:34.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1976915703 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff67c104260 0x7ff67c10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1976915703 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff67c1038a0 0x7ff67c103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1976915703 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 0x7ff67c102ab0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 -- 10.20.193.28:0/1976915703 >> 10.20.193.28:0/1976915703 conn(0x7ff67c0fde10 msgr2=0x7ff67c100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 -- 10.20.193.28:0/1976915703 shutdown_connections 2026-02-20T03:21:34.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 -- 10.20.193.28:0/1976915703 wait complete. 2026-02-20T03:21:34.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.118+0000 7ff6816bb640 1 Processor -- start 2026-02-20T03:21:34.122 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff6816bb640 1 -- start start 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff6816bb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 0x7ff67c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff6816bb640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff67c1038a0 0x7ff67c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff6816bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff67c104260 0x7ff67c19fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff6816bb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10bf60 con 0x7ff67c104260 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff6816bb640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10bde0 con 0x7ff67c1038a0 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff6816bb640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10c0e0 con 0x7ff67c1026b0 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff67bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 0x7ff67c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff67bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 0x7ff67c198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48640/0 (socket says 10.20.193.28:48640) 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff67bfff640 1 -- 10.20.193.28:0/1909416362 learned_addr learned my addr 10.20.193.28:0/1909416362 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff67c1038a0 0x7ff67c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.119+0000 7ff680eba640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff67c104260 0x7ff67c19fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff67bfff640 1 -- 10.20.193.28:0/1909416362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff67c1038a0 msgr2=0x7ff67c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff67bfff640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff67c1038a0 0x7ff67c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff67bfff640 1 -- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff67c104260 msgr2=0x7ff67c19fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff67bfff640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff67c104260 0x7ff67c19fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff67bfff640 1 -- 10.20.193.28:0/1909416362 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c1a0210 con 0x7ff67c1026b0 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff67c1038a0 0x7ff67c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff680eba640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff67c104260 0x7ff67c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff67bfff640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 0x7ff67c198560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff668002410 tx=0x7ff66802fbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff6797fa640 1 -- 10.20.193.28:0/1909416362 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66804e070 con 0x7ff67c1026b0 2026-02-20T03:21:34.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff6816bb640 1 -- 10.20.193.28:0/1909416362 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c1a04a0 con 0x7ff67c1026b0 2026-02-20T03:21:34.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff6797fa640 1 -- 10.20.193.28:0/1909416362 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff668042040 con 0x7ff67c1026b0 2026-02-20T03:21:34.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff6797fa640 1 -- 10.20.193.28:0/1909416362 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668005360 con 0x7ff67c1026b0 2026-02-20T03:21:34.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.120+0000 7ff6816bb640 1 -- 10.20.193.28:0/1909416362 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c1a09e0 con 0x7ff67c1026b0 2026-02-20T03:21:34.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.123+0000 7ff6797fa640 1 -- 10.20.193.28:0/1909416362 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff668005500 con 0x7ff67c1026b0 2026-02-20T03:21:34.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.123+0000 7ff685883e00 1 Processor -- start 2026-02-20T03:21:34.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.123+0000 7ff685883e00 1 -- start start 2026-02-20T03:21:34.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.123+0000 7ff685883e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e88e80 0x5625c4e89280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.123+0000 7ff685883e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4e8df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff685883e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 0x5625c4e909f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff685883e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5625c4dd98f0 con 0x5625c4e88e80 2026-02-20T03:21:34.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff685883e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5625c4d872e0 con 0x5625c4e8e560 2026-02-20T03:21:34.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff685883e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5625c4dd5820 con 0x5625c4e897c0 2026-02-20T03:21:34.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff680eba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e88e80 0x5625c4e89280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff680eba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e88e80 0x5625c4e89280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56646/0 (socket says 10.20.193.28:56646) 2026-02-20T03:21:34.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff680eba640 1 -- 10.20.193.28:0/1220594033 learned_addr learned my addr 10.20.193.28:0/1220594033 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff67bfff640 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4e8df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 0x5625c4e909f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff67bfff640 1 -- 10.20.193.28:0/1220594033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 msgr2=0x5625c4e909f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff67bfff640 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 0x5625c4e909f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.124+0000 7ff67bfff640 1 -- 10.20.193.28:0/1220594033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e88e80 msgr2=0x5625c4e89280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff6797fa640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6500b0e20 0x7ff6500b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff6797fa640 1 -- 10.20.193.28:0/1909416362 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff66810dd50 con 0x7ff67c1026b0 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff67bfff640 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e88e80 0x5625c4e89280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff67bfff640 1 -- 10.20.193.28:0/1220594033 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c4d795a0 con 0x5625c4e897c0 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff680eba640 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e88e80 0x5625c4e89280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff67bfff640 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4e8df40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff66810b360 tx=0x7ff668002aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdea4f6b6c625b48 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6500b0e20 0x7ff6500b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff64cbfe640 1 -- 10.20.193.28:0/1220594033 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6680d16a0 con 0x5625c4e897c0 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff64cbfe640 1 -- 10.20.193.28:0/1220594033 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff668033020 con 0x5625c4e897c0 2026-02-20T03:21:34.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.125+0000 7ff64cbfe640 1 -- 10.20.193.28:0/1220594033 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6680d4f50 con 0x5625c4e897c0 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff685883e00 1 -- 10.20.193.28:0/1220594033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 msgr2=0x5625c4e8df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff685883e00 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4e8df40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff66810b360 tx=0x7ff668002aa0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6500b0e20 0x7ff6500b32e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff67c199a70 tx=0x7ff66c009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff685883e00 1 -- 10.20.193.28:0/1220594033 shutdown_connections 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff685883e00 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 0x5625c4e909f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff685883e00 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4e8df40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff685883e00 1 --2- 10.20.193.28:0/1220594033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e88e80 0x5625c4e89280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff685883e00 1 -- 10.20.193.28:0/1220594033 >> 10.20.193.28:0/1220594033 conn(0x5625c4e806f0 msgr2=0x5625c4e87570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff685883e00 1 -- 10.20.193.28:0/1220594033 shutdown_connections 2026-02-20T03:21:34.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.126+0000 7ff685883e00 1 -- 10.20.193.28:0/1220594033 wait complete. 2026-02-20T03:21:34.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.127+0000 7ff685883e00 1 -- start start 2026-02-20T03:21:34.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.127+0000 7ff685883e00 1 Processor -- start 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff685883e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 0x5625c4ea16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff685883e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4ea1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff685883e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e8e560 0x5625c4ea8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff685883e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5625c4d810c0 con 0x5625c4e8e560 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff685883e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5625c4e91370 con 0x5625c4e88e80 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff685883e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5625c4eba550 con 0x5625c4e897c0 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4ea1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 0x5625c4ea16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4ea1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48660/0 (socket says 10.20.193.28:48660) 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67b7fe640 1 -- 10.20.193.28:0/2234817700 learned_addr learned my addr 10.20.193.28:0/2234817700 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff680eba640 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e8e560 0x5625c4ea8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67b7fe640 1 -- 10.20.193.28:0/2234817700 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 msgr2=0x5625c4ea16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 0x5625c4ea16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67b7fe640 1 -- 10.20.193.28:0/2234817700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e8e560 msgr2=0x5625c4ea8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e8e560 0x5625c4ea8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67b7fe640 1 -- 10.20.193.28:0/2234817700 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c4e9ae40 con 0x5625c4e897c0 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff67bfff640 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 0x5625c4ea16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.128+0000 7ff680eba640 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e8e560 0x5625c4ea8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4ea1c30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff66c013830 tx=0x7ff66c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c71fc0e4cee60c4a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff63dffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff63dffb640 1 -- 10.20.193.28:0/2234817700 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c011b70 con 0x5625c4e897c0 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff63dffb640 1 -- 10.20.193.28:0/2234817700 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff66c023030 con 0x5625c4e897c0 2026-02-20T03:21:34.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff63dffb640 1 -- 10.20.193.28:0/2234817700 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c01f680 con 0x5625c4e897c0 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff685883e00 1 -- 10.20.193.28:0/2234817700 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c4d95820 con 0x5625c4e897c0 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff685883e00 10 client.26605 _ll_register_callbacks cb 0x5625c4d84ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff685883e00 1 -- 10.20.193.28:0/2234817700 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5625c4de14e0 con 0x5625c4e897c0 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff63dffb640 1 -- 10.20.193.28:0/2234817700 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff66c01f820 con 0x5625c4e897c0 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.129+0000 7ff63dffb640 1 -- 10.20.193.28:0/2234817700 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff66c02d060 con 0x5625c4e897c0 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.130+0000 7ff685883e00 10 client.26605 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.130+0000 7ff685883e00 1 -- 10.20.193.28:0/2234817700 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5625c4d9a380 con 0x5625c4e897c0 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.130+0000 7ff63dffb640 1 -- 10.20.193.28:0/2234817700 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff66c01fa20 con 0x5625c4e897c0 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.130+0000 7ff685883e00 10 client.26605 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.130+0000 7ff685883e00 10 client.26605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.130+0000 7ff685883e00 20 client.26605 populate_metadata read hostname 'trial028' 2026-02-20T03:21:34.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.130+0000 7ff685883e00 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625c4ebe8d0 0x5625c4ec0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.130+0000 7ff685883e00 4 client.26605 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.130+0000 7ff685883e00 1 -- 10.20.193.28:0/2234817700 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625c4d5bbd0 con 0x5625c4ebe8d0 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.131+0000 7ff67bfff640 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625c4ebe8d0 0x5625c4ec0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.131+0000 7ff67bfff640 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625c4ebe8d0 0x5625c4ec0d90 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1402b7bdaccf6b74 server_cookie=e2d23d6ca63801a9 in_seq=0 out_seq=0 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.131+0000 7ff63dffb640 10 client.26605 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff63dffb640 1 -- 10.20.193.28:0/2234817700 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5625c4d5bbd0 con 0x5625c4ebe8d0 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff63dffb640 10 client.26605 handle_command_reply: tid=0 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff685883e00 1 client.26605 shutdown 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff685883e00 1 -- 10.20.193.28:0/2234817700 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 msgr2=0x5625c4ea1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff685883e00 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4ea1c30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff66c013830 tx=0x7ff66c0047c0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff685883e00 1 -- 10.20.193.28:0/2234817700 shutdown_connections 2026-02-20T03:21:34.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff685883e00 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625c4ebe8d0 0x5625c4ec0d90 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff685883e00 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e8e560 0x5625c4ea8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff685883e00 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e897c0 0x5625c4ea1c30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff685883e00 1 --2- 10.20.193.28:0/2234817700 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 0x5625c4ea16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.132+0000 7ff685883e00 1 -- 10.20.193.28:0/2234817700 >> 10.20.193.28:0/2234817700 conn(0x5625c4e806f0 msgr2=0x5625c4e8f870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.133+0000 7ff63dffb640 0 client.26605 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:34.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.133+0000 7ff685883e00 1 -- 10.20.193.28:0/2234817700 shutdown_connections 2026-02-20T03:21:34.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.133+0000 7ff685883e00 1 -- 10.20.193.28:0/2234817700 wait complete. 2026-02-20T03:21:34.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.133+0000 7ff685883e00 20 client.26605 trim_cache size 0 max 16384 2026-02-20T03:21:34.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.141+0000 7ff685883e00 1 Processor -- start 2026-02-20T03:21:34.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.141+0000 7ff685883e00 1 -- start start 2026-02-20T03:21:34.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.141+0000 7ff685883e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e88e80 0x5625c4e9df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.141+0000 7ff685883e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 0x5625c4ea8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.141+0000 7ff685883e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 0x5625c4e9e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.141+0000 7ff685883e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff620012620 con 0x5625c4e897c0 2026-02-20T03:21:34.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.141+0000 7ff685883e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff62000fef0 con 0x5625c4e8e560 2026-02-20T03:21:34.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.141+0000 7ff685883e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff62000dd40 con 0x5625c4e88e80 2026-02-20T03:21:34.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e88e80 0x5625c4e9df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e88e80 0x5625c4e9df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48670/0 (socket says 10.20.193.28:48670) 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67bfff640 1 -- 10.20.193.28:0/2123533072 learned_addr learned my addr 10.20.193.28:0/2123533072 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff680eba640 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 0x5625c4e9e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 0x5625c4ea8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67bfff640 1 -- 10.20.193.28:0/2123533072 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 msgr2=0x5625c4e9e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67bfff640 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 0x5625c4e9e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67bfff640 1 -- 10.20.193.28:0/2123533072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 msgr2=0x5625c4ea8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67bfff640 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 0x5625c4ea8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67bfff640 1 -- 10.20.193.28:0/2123533072 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c4e9ac70 con 0x5625c4e88e80 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff680eba640 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 0x5625c4e9e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff67bfff640 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e88e80 0x5625c4e9df50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff668004570 tx=0x7ff668031040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6d02f5aa06cae3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff63ffff640 1 -- 10.20.193.28:0/2123533072 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6680d5130 con 0x5625c4e88e80 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff63ffff640 1 -- 10.20.193.28:0/2123533072 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff6680d6130 con 0x5625c4e88e80 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.142+0000 7ff63ffff640 1 -- 10.20.193.28:0/2123533072 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6680d5800 con 0x5625c4e88e80 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 -- 10.20.193.28:0/2123533072 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e88e80 msgr2=0x5625c4e9df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e88e80 0x5625c4e9df50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff668004570 tx=0x7ff668031040 comp rx=0 tx=0).stop 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 -- 10.20.193.28:0/2123533072 shutdown_connections 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e8e560 0x5625c4e9e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 0x5625c4ea8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 --2- 10.20.193.28:0/2123533072 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e88e80 0x5625c4e9df50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 -- 10.20.193.28:0/2123533072 >> 10.20.193.28:0/2123533072 conn(0x5625c4e806f0 msgr2=0x5625c4ea0640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 -- 10.20.193.28:0/2123533072 shutdown_connections 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 -- 10.20.193.28:0/2123533072 wait complete. 2026-02-20T03:21:34.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 -- start start 2026-02-20T03:21:34.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.143+0000 7ff685883e00 1 Processor -- start 2026-02-20T03:21:34.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff685883e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 0x5625c4ea4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff685883e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 0x5625c4ea4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff685883e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e8e560 0x5625c4ea7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff685883e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff62000e3b0 con 0x5625c4e897c0 2026-02-20T03:21:34.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff685883e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff62000f820 con 0x5625c4e88e80 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff685883e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff62000ea80 con 0x5625c4e8e560 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff680eba640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e8e560 0x5625c4ea7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff680eba640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e8e560 0x5625c4ea7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48672/0 (socket says 10.20.193.28:48672) 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff680eba640 1 -- 10.20.193.28:0/3278642237 learned_addr learned my addr 10.20.193.28:0/3278642237 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff67bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 0x5625c4ea4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff67b7fe640 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 0x5625c4ea4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff680eba640 1 -- 10.20.193.28:0/3278642237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 msgr2=0x5625c4ea4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff680eba640 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 0x5625c4ea4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff680eba640 1 -- 10.20.193.28:0/3278642237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 msgr2=0x5625c4ea4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff680eba640 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 0x5625c4ea4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff680eba640 1 -- 10.20.193.28:0/3278642237 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c4b39690 con 0x5625c4e8e560 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff680eba640 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e8e560 0x5625c4ea7ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff67000d360 tx=0x7ff67000d830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ff531e595709eb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.144+0000 7ff63dffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff63dffb640 1 -- 10.20.193.28:0/3278642237 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670019450 con 0x5625c4e8e560 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff63dffb640 1 -- 10.20.193.28:0/3278642237 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff670019a90 con 0x5625c4e8e560 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 1 -- 10.20.193.28:0/3278642237 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c4d9eb70 con 0x5625c4e8e560 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff63dffb640 1 -- 10.20.193.28:0/3278642237 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff670008af0 con 0x5625c4e8e560 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 10 client.26611 _ll_register_callbacks cb 0x7ff66c013530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 1 -- 10.20.193.28:0/3278642237 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff668033020 con 0x5625c4e8e560 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff63dffb640 1 -- 10.20.193.28:0/3278642237 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff670008cb0 con 0x5625c4e8e560 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff63dffb640 1 -- 10.20.193.28:0/3278642237 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff6700183e0 con 0x5625c4e8e560 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 10 client.26611 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 1 -- 10.20.193.28:0/3278642237 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5625c4e9b960 con 0x5625c4e8e560 2026-02-20T03:21:34.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff63dffb640 1 -- 10.20.193.28:0/3278642237 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff670016040 con 0x5625c4e8e560 2026-02-20T03:21:34.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 10 client.26611 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:34.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 10 client.26611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:34.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 20 client.26611 populate_metadata read hostname 'trial028' 2026-02-20T03:21:34.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625c4f2a000 0x5625c4f2c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 4 client.26611 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:21:34.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.145+0000 7ff685883e00 1 -- 10.20.193.28:0/3278642237 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625c4daa6b0 con 0x5625c4f2a000 2026-02-20T03:21:34.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.146+0000 7ff67bfff640 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625c4f2a000 0x5625c4f2c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.146+0000 7ff67bfff640 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625c4f2a000 0x5625c4f2c4c0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce645cde048bd65e server_cookie=1d5fd6970883ac6e in_seq=0 out_seq=0 2026-02-20T03:21:34.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.146+0000 7ff63dffb640 10 client.26611 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:34.155 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:21:34.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.263+0000 7ff63dffb640 1 -- 10.20.193.28:0/3278642237 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625c4daa6b0 con 0x5625c4f2a000 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.263+0000 7ff63dffb640 10 client.26611 handle_command_reply: tid=0 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.263+0000 7ff685883e00 1 client.26611 shutdown 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.263+0000 7ff685883e00 1 -- 10.20.193.28:0/3278642237 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e8e560 msgr2=0x5625c4ea7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.263+0000 7ff685883e00 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e8e560 0x5625c4ea7ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff67000d360 tx=0x7ff67000d830 comp rx=0 tx=0).stop 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff685883e00 1 -- 10.20.193.28:0/3278642237 shutdown_connections 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff685883e00 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625c4f2a000 0x5625c4f2c4c0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff685883e00 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625c4e8e560 0x5625c4ea7ad0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff685883e00 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625c4e897c0 0x5625c4ea4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff685883e00 1 --2- 10.20.193.28:0/3278642237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625c4e88e80 0x5625c4ea4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff63dffb640 0 client.26611 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:34.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff685883e00 1 -- 10.20.193.28:0/3278642237 >> 10.20.193.28:0/3278642237 conn(0x5625c4e806f0 msgr2=0x5625c4e9ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff685883e00 1 -- 10.20.193.28:0/3278642237 shutdown_connections 2026-02-20T03:21:34.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff685883e00 1 -- 10.20.193.28:0/3278642237 wait complete. 2026-02-20T03:21:34.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.264+0000 7ff685883e00 20 client.26611 trim_cache size 0 max 16384 2026-02-20T03:21:34.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:21:34.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:21:34.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:21:34.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:21:34.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 -- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6500b0e20 msgr2=0x7ff6500b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6500b0e20 0x7ff6500b32e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff67c199a70 tx=0x7ff66c009340 comp rx=0 tx=0).stop 2026-02-20T03:21:34.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 -- 10.20.193.28:0/1909416362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 msgr2=0x7ff67c198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 0x7ff67c198560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff668002410 tx=0x7ff66802fbd0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 -- 10.20.193.28:0/1909416362 shutdown_connections 2026-02-20T03:21:34.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6500b0e20 0x7ff6500b32e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff67c104260 0x7ff67c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff67c1038a0 0x7ff67c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 --2- 10.20.193.28:0/1909416362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff67c1026b0 0x7ff67c198560 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 -- 10.20.193.28:0/1909416362 >> 10.20.193.28:0/1909416362 conn(0x7ff67c0fde10 msgr2=0x7ff67c106cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 -- 10.20.193.28:0/1909416362 shutdown_connections 2026-02-20T03:21:34.270 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:34.265+0000 7ff6816bb640 1 -- 10.20.193.28:0/1909416362 wait complete. 2026-02-20T03:21:34.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.361+0000 7f3174f78640 1 -- 10.20.193.28:0/1010402591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3170105320 msgr2=0x7f3170111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.361+0000 7f3174f78640 1 --2- 10.20.193.28:0/1010402591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3170105320 0x7f3170111850 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3164009fc0 tx=0x7f316402f390 comp rx=0 tx=0).stop 2026-02-20T03:21:34.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.361+0000 7f3174f78640 1 -- 10.20.193.28:0/1010402591 shutdown_connections 2026-02-20T03:21:34.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.361+0000 7f3174f78640 1 --2- 10.20.193.28:0/1010402591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3170105320 0x7f3170111850 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.362+0000 7f3174f78640 1 --2- 10.20.193.28:0/1010402591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3170104980 0x7f3170104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.362+0000 7f3174f78640 1 --2- 10.20.193.28:0/1010402591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f317010a980 0x7f317010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.362+0000 7f3174f78640 1 -- 10.20.193.28:0/1010402591 >> 10.20.193.28:0/1010402591 conn(0x7f3170100680 msgr2=0x7f3170102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.362+0000 7f3174f78640 1 -- 10.20.193.28:0/1010402591 shutdown_connections 2026-02-20T03:21:34.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.362+0000 7f3174f78640 1 -- 10.20.193.28:0/1010402591 wait complete. 2026-02-20T03:21:34.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.363+0000 7f3174f78640 1 Processor -- start 2026-02-20T03:21:34.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.363+0000 7f3174f78640 1 -- start start 2026-02-20T03:21:34.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.363+0000 7f3174f78640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3170104980 0x7f317019d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.363+0000 7f3174f78640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3170105320 0x7f317019d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.363+0000 7f3174f78640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317010a980 0x7f31701a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.363+0000 7f3174f78640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3170114bf0 con 0x7f317010a980 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.363+0000 7f3174f78640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3170114a70 con 0x7f3170105320 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.363+0000 7f3174f78640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3170114d70 con 0x7f3170104980 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3170104980 0x7f317019d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316effd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3170105320 0x7f317019d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3170104980 0x7f317019d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48690/0 (socket says 10.20.193.28:48690) 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316f7fe640 1 -- 10.20.193.28:0/4038330795 learned_addr learned my addr 10.20.193.28:0/4038330795 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316ffff640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317010a980 0x7f31701a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316ffff640 1 -- 10.20.193.28:0/4038330795 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3170104980 msgr2=0x7f317019d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316ffff640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3170104980 0x7f317019d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316ffff640 1 -- 10.20.193.28:0/4038330795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3170105320 msgr2=0x7f317019d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316ffff640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3170105320 0x7f317019d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316ffff640 1 -- 10.20.193.28:0/4038330795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31701a20a0 con 0x7f317010a980 2026-02-20T03:21:34.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.364+0000 7f316ffff640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317010a980 0x7f31701a1920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3164036000 tx=0x7f3164004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.365+0000 7f316cff9640 1 -- 10.20.193.28:0/4038330795 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164002c60 con 0x7f317010a980 2026-02-20T03:21:34.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.365+0000 7f3174f78640 1 -- 10.20.193.28:0/4038330795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31701a2330 con 0x7f317010a980 2026-02-20T03:21:34.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.365+0000 7f316cff9640 1 -- 10.20.193.28:0/4038330795 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3164009350 con 0x7f317010a980 2026-02-20T03:21:34.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.365+0000 7f316cff9640 1 -- 10.20.193.28:0/4038330795 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164042420 con 0x7f317010a980 2026-02-20T03:21:34.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.365+0000 7f3174f78640 1 -- 10.20.193.28:0/4038330795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31701a9bd0 con 0x7f317010a980 2026-02-20T03:21:34.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.367+0000 7f316cff9640 1 -- 10.20.193.28:0/4038330795 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3164004520 con 0x7f317010a980 2026-02-20T03:21:34.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f3178706e00 1 Processor -- start 2026-02-20T03:21:34.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f3178706e00 1 -- start start 2026-02-20T03:21:34.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f3178706e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1278390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f3178706e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e12725e0 0x55c8e1272a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f3178706e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1272f60 0x55c8e127ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f3178706e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c8e11f2e00 con 0x55c8e1272f60 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f3178706e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c8e11c5970 con 0x55c8e12725e0 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f3178706e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c8e11731f0 con 0x55c8e1277fb0 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f316effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1278390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f316effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1272f60 0x55c8e127ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f316f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e12725e0 0x55c8e1272a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f316effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1272f60 0x55c8e127ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56680/0 (socket says 10.20.193.28:56680) 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.368+0000 7f316effd640 1 -- 10.20.193.28:0/875688392 learned_addr learned my addr 10.20.193.28:0/875688392 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316cff9640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e20 0x7f31440b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316cff9640 1 -- 10.20.193.28:0/4038330795 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3164104e20 con 0x7f317010a980 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316f7fe640 1 -- 10.20.193.28:0/875688392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 msgr2=0x55c8e1278390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316f7fe640 1 --2- 10.20.193.28:0/875688392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1278390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316f7fe640 1 -- 10.20.193.28:0/875688392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1272f60 msgr2=0x55c8e127ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316f7fe640 1 --2- 10.20.193.28:0/875688392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1272f60 0x55c8e127ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316f7fe640 1 -- 10.20.193.28:0/875688392 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e11863d0 con 0x55c8e12725e0 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316effd640 1 --2- 10.20.193.28:0/875688392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1278390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316ffff640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e20 0x7f31440b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316f7fe640 1 --2- 10.20.193.28:0/875688392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e12725e0 0x55c8e1272a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f315c007c80 tx=0x7f315c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9bd80b649a7b608 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f3133fff640 1 -- 10.20.193.28:0/875688392 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c0040d0 con 0x55c8e12725e0 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f316ffff640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e20 0x7f31440b32e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f31640060b0 tx=0x7f31640c8040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f3133fff640 1 -- 10.20.193.28:0/875688392 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f315c015030 con 0x55c8e12725e0 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.369+0000 7f3133fff640 1 -- 10.20.193.28:0/875688392 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c011730 con 0x55c8e12725e0 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.370+0000 7f3178706e00 1 -- 10.20.193.28:0/875688392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e12725e0 msgr2=0x55c8e1272a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.370+0000 7f3178706e00 1 --2- 10.20.193.28:0/875688392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e12725e0 0x55c8e1272a20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f315c007c80 tx=0x7f315c0107a0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.370+0000 7f3178706e00 1 -- 10.20.193.28:0/875688392 shutdown_connections 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.370+0000 7f3178706e00 1 --2- 10.20.193.28:0/875688392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1272f60 0x55c8e127ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.370+0000 7f3178706e00 1 --2- 10.20.193.28:0/875688392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e12725e0 0x55c8e1272a20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.370+0000 7f3178706e00 1 --2- 10.20.193.28:0/875688392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1278390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.370+0000 7f3178706e00 1 -- 10.20.193.28:0/875688392 >> 10.20.193.28:0/875688392 conn(0x55c8e1235240 msgr2=0x55c8e1270ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.370+0000 7f3178706e00 1 -- 10.20.193.28:0/875688392 shutdown_connections 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.370+0000 7f3178706e00 1 -- 10.20.193.28:0/875688392 wait complete. 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.371+0000 7f3178706e00 1 -- start start 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.371+0000 7f3178706e00 1 Processor -- start 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f3178706e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e128b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f3178706e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e128bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f3178706e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e128cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f3178706e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c8e11c18a0 con 0x55c8e12725e0 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f3178706e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c8e0fb3f50 con 0x55c8e1272f60 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f3178706e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c8e128d1d0 con 0x55c8e1277fb0 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e128b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e128bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e128b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56686/0 (socket says 10.20.193.28:56686) 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316effd640 1 -- 10.20.193.28:0/50588993 learned_addr learned my addr 10.20.193.28:0/50588993 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316effd640 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e128cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316f7fe640 1 -- 10.20.193.28:0/50588993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 msgr2=0x55c8e128cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316f7fe640 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e128cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316f7fe640 1 -- 10.20.193.28:0/50588993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 msgr2=0x55c8e128b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316f7fe640 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e128b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316f7fe640 1 -- 10.20.193.28:0/50588993 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e1284990 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.372+0000 7f316effd640 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e128b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.373+0000 7f316f7fe640 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e128bb00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f315c006010 tx=0x7f315c007d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03a11f007f9b0eb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.373+0000 7f31317fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.373+0000 7f31317fa640 1 -- 10.20.193.28:0/50588993 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c0042e0 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.373+0000 7f31317fa640 1 -- 10.20.193.28:0/50588993 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f315c002b80 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.373+0000 7f31317fa640 1 -- 10.20.193.28:0/50588993 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c005660 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.373+0000 7f3178706e00 1 -- 10.20.193.28:0/50588993 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e0f96b40 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f3178706e00 10 client.26606 _ll_register_callbacks cb 0x55c8e11feeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f31317fa640 1 -- 10.20.193.28:0/50588993 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f315c004480 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f3178706e00 1 -- 10.20.193.28:0/50588993 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c8e11d3150 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f31317fa640 1 -- 10.20.193.28:0/50588993 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f315c0026e0 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f3178706e00 10 client.26606 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f3178706e00 1 -- 10.20.193.28:0/50588993 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c8e11801e0 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f31317fa640 1 -- 10.20.193.28:0/50588993 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f315c02e030 con 0x55c8e1272f60 2026-02-20T03:21:34.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f3178706e00 10 client.26606 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:34.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f3178706e00 10 client.26606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:34.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.374+0000 7f3178706e00 20 client.26606 populate_metadata read hostname 'trial028' 2026-02-20T03:21:34.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.375+0000 7f3178706e00 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e129b3f0 0x55c8e129d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.375+0000 7f3178706e00 4 client.26606 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:34.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.375+0000 7f3178706e00 1 -- 10.20.193.28:0/50588993 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8e11cd560 con 0x55c8e129b3f0 2026-02-20T03:21:34.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.375+0000 7f316effd640 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e129b3f0 0x55c8e129d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.375+0000 7f316effd640 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e129b3f0 0x55c8e129d7e0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6587e62f641446f9 server_cookie=cdb718362854051c in_seq=0 out_seq=0 2026-02-20T03:21:34.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.375+0000 7f31317fa640 10 client.26606 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f31317fa640 1 -- 10.20.193.28:0/50588993 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c8e11cd560 con 0x55c8e129b3f0 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f31317fa640 10 client.26606 handle_command_reply: tid=0 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 client.26606 shutdown 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 -- 10.20.193.28:0/50588993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 msgr2=0x55c8e128bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e128bb00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f315c006010 tx=0x7f315c007d80 comp rx=0 tx=0).stop 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 -- 10.20.193.28:0/50588993 shutdown_connections 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e129b3f0 0x55c8e129d7e0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e128cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e128bb00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 --2- 10.20.193.28:0/50588993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e128b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 -- 10.20.193.28:0/50588993 >> 10.20.193.28:0/50588993 conn(0x55c8e1235240 msgr2=0x55c8e12713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f31317fa640 0 client.26606 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 -- 10.20.193.28:0/50588993 shutdown_connections 2026-02-20T03:21:34.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.376+0000 7f3178706e00 1 -- 10.20.193.28:0/50588993 wait complete. 2026-02-20T03:21:34.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.377+0000 7f3178706e00 20 client.26606 trim_cache size 0 max 16384 2026-02-20T03:21:34.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.383+0000 7f3178706e00 1 Processor -- start 2026-02-20T03:21:34.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.383+0000 7f3178706e00 1 -- start start 2026-02-20T03:21:34.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.383+0000 7f3178706e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e1276db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.383+0000 7f3178706e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e1288830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.383+0000 7f3178706e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1288d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.383+0000 7f3178706e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31140126f0 con 0x55c8e12725e0 2026-02-20T03:21:34.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.383+0000 7f3178706e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f311400ffc0 con 0x55c8e1272f60 2026-02-20T03:21:34.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.383+0000 7f3178706e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f311400de10 con 0x55c8e1277fb0 2026-02-20T03:21:34.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e1288830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e1288830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41766/0 (socket says 10.20.193.28:41766) 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316f7fe640 1 -- 10.20.193.28:0/1098021994 learned_addr learned my addr 10.20.193.28:0/1098021994 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e1276db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316effd640 1 --2- 10.20.193.28:0/1098021994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1288d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316f7fe640 1 -- 10.20.193.28:0/1098021994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 msgr2=0x55c8e1288d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316f7fe640 1 --2- 10.20.193.28:0/1098021994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1288d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316f7fe640 1 -- 10.20.193.28:0/1098021994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 msgr2=0x55c8e1276db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316f7fe640 1 --2- 10.20.193.28:0/1098021994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e1276db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316f7fe640 1 -- 10.20.193.28:0/1098021994 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e12847c0 con 0x55c8e1272f60 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316effd640 1 --2- 10.20.193.28:0/1098021994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1288d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:34.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f316f7fe640 1 --2- 10.20.193.28:0/1098021994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e1288830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55c8e128c670 tx=0x7f315c02a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38491c8d2ebf6670 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.384+0000 7f31337fe640 1 -- 10.20.193.28:0/1098021994 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c0042e0 con 0x55c8e1272f60 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f31337fe640 1 -- 10.20.193.28:0/1098021994 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55c8e11d3150 con 0x55c8e1272f60 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f31337fe640 1 -- 10.20.193.28:0/1098021994 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c026d10 con 0x55c8e1272f60 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 -- 10.20.193.28:0/1098021994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 msgr2=0x55c8e1288830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 --2- 10.20.193.28:0/1098021994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e1288830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55c8e128c670 tx=0x7f315c02a000 comp rx=0 tx=0).stop 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 -- 10.20.193.28:0/1098021994 shutdown_connections 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 --2- 10.20.193.28:0/1098021994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e1277fb0 0x55c8e1288d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 --2- 10.20.193.28:0/1098021994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e1288830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 --2- 10.20.193.28:0/1098021994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e12725e0 0x55c8e1276db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 -- 10.20.193.28:0/1098021994 >> 10.20.193.28:0/1098021994 conn(0x55c8e1235240 msgr2=0x55c8e128b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 -- 10.20.193.28:0/1098021994 shutdown_connections 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 -- 10.20.193.28:0/1098021994 wait complete. 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.385+0000 7f3178706e00 1 -- start start 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.386+0000 7f3178706e00 1 Processor -- start 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.386+0000 7f3178706e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e12725e0 0x55c8e1292d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.386+0000 7f3178706e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e12932a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.386+0000 7f3178706e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1277fb0 0x55c8e128fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.386+0000 7f3178706e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f311400e480 con 0x55c8e1277fb0 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.386+0000 7f3178706e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f311400f8f0 con 0x55c8e1272f60 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.386+0000 7f3178706e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f311400eb50 con 0x55c8e12725e0 2026-02-20T03:21:34.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.386+0000 7f316effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e12725e0 0x55c8e1292d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.386+0000 7f316effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1277fb0 0x55c8e128fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.387+0000 7f316f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e12932a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.387+0000 7f316effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1277fb0 0x55c8e128fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56702/0 (socket says 10.20.193.28:56702) 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.387+0000 7f316effd640 1 -- 10.20.193.28:0/3716722228 learned_addr learned my addr 10.20.193.28:0/3716722228 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.387+0000 7f316f7fe640 1 -- 10.20.193.28:0/3716722228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e12725e0 msgr2=0x55c8e1292d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.387+0000 7f316f7fe640 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e12725e0 0x55c8e1292d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.387+0000 7f316f7fe640 1 -- 10.20.193.28:0/3716722228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1277fb0 msgr2=0x55c8e128fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.387+0000 7f316f7fe640 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1277fb0 0x55c8e128fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.387+0000 7f316f7fe640 1 -- 10.20.193.28:0/3716722228 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e0ea4870 con 0x55c8e1272f60 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.387+0000 7f316effd640 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e12725e0 0x55c8e1292d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f316f7fe640 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e12932a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f315c002410 tx=0x7f315c010cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=919aa34c3845ba9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:34.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f31317fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f31317fa640 1 -- 10.20.193.28:0/3716722228 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c0042e0 con 0x55c8e1272f60 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f31317fa640 1 -- 10.20.193.28:0/3716722228 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f315c004480 con 0x55c8e1272f60 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f31317fa640 1 -- 10.20.193.28:0/3716722228 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c004930 con 0x55c8e1272f60 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f3178706e00 1 -- 10.20.193.28:0/3716722228 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e11653f0 con 0x55c8e1272f60 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f3178706e00 10 client.26612 _ll_register_callbacks cb 0x7f315c0078e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f3178706e00 1 -- 10.20.193.28:0/3716722228 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c8e1277490 con 0x55c8e1272f60 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f31317fa640 1 -- 10.20.193.28:0/3716722228 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f315c004ad0 con 0x55c8e1272f60 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f31317fa640 1 -- 10.20.193.28:0/3716722228 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f315c004d50 con 0x55c8e1272f60 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f3178706e00 10 client.26612 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.388+0000 7f3178706e00 1 -- 10.20.193.28:0/3716722228 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c8e12854b0 con 0x55c8e1272f60 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f31317fa640 1 -- 10.20.193.28:0/3716722228 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f315c02e070 con 0x55c8e1272f60 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f3178706e00 10 client.26612 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f3178706e00 10 client.26612 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:34.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f3178706e00 20 client.26612 populate_metadata read hostname 'trial028' 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f3178706e00 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e1306470 0x55c8e1308930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f3178706e00 4 client.26612 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f3178706e00 1 -- 10.20.193.28:0/3716722228 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c8e1177ab0 con 0x55c8e1306470 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f316effd640 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e1306470 0x55c8e1308930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f316effd640 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e1306470 0x55c8e1308930 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc90996d206c27b server_cookie=f218b1b89e18934c in_seq=0 out_seq=0 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f31317fa640 10 client.26612 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f31317fa640 1 -- 10.20.193.28:0/3716722228 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c8e1177ab0 con 0x55c8e1306470 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f31317fa640 10 client.26612 handle_command_reply: tid=0 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.389+0000 7f3178706e00 1 client.26612 shutdown 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 -- 10.20.193.28:0/3716722228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 msgr2=0x55c8e12932a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e12932a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f315c002410 tx=0x7f315c010cb0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 -- 10.20.193.28:0/3716722228 shutdown_connections 2026-02-20T03:21:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e1306470 0x55c8e1308930 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e1277fb0 0x55c8e128fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e1272f60 0x55c8e12932a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 --2- 10.20.193.28:0/3716722228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e12725e0 0x55c8e1292d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 -- 10.20.193.28:0/3716722228 >> 10.20.193.28:0/3716722228 conn(0x55c8e1235240 msgr2=0x55c8e1289cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f31317fa640 0 client.26612 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:34.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 -- 10.20.193.28:0/3716722228 shutdown_connections 2026-02-20T03:21:34.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 1 -- 10.20.193.28:0/3716722228 wait complete. 2026-02-20T03:21:34.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3178706e00 20 client.26612 trim_cache size 0 max 16384 2026-02-20T03:21:34.397 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:21:34.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3174f78640 1 -- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e20 msgr2=0x7f31440b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3174f78640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e20 0x7f31440b32e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f31640060b0 tx=0x7f31640c8040 comp rx=0 tx=0).stop 2026-02-20T03:21:34.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3174f78640 1 -- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317010a980 msgr2=0x7f31701a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:34.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.390+0000 7f3174f78640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317010a980 0x7f31701a1920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3164036000 tx=0x7f3164004290 comp rx=0 tx=0).stop 2026-02-20T03:21:34.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.391+0000 7f3174f78640 1 -- 10.20.193.28:0/4038330795 shutdown_connections 2026-02-20T03:21:34.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.391+0000 7f3174f78640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e20 0x7f31440b32e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.391+0000 7f3174f78640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317010a980 0x7f31701a1920 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.391+0000 7f3174f78640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3170105320 0x7f317019d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.391+0000 7f3174f78640 1 --2- 10.20.193.28:0/4038330795 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3170104980 0x7f317019d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:34.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.391+0000 7f3174f78640 1 -- 10.20.193.28:0/4038330795 >> 10.20.193.28:0/4038330795 conn(0x7f3170100680 msgr2=0x7f3170100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:34.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.391+0000 7f3174f78640 1 -- 10.20.193.28:0/4038330795 shutdown_connections 2026-02-20T03:21:34.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:34.391+0000 7f3174f78640 1 -- 10.20.193.28:0/4038330795 wait complete. 2026-02-20T03:21:34.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 576612 8.01 MB/sec execute 187 sec latency 51.327 ms 2026-02-20T03:21:35.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:35 trial177 ceph-mon[43181]: pgmap v388: 129 pgs: 129 active+clean; 103 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 967 KiB/s rd, 2.5 MiB/s wr, 323 op/s 2026-02-20T03:21:35.491 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:21:35.491 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:21:35.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 580636 8.08 MB/sec execute 188 sec latency 6.602 ms 2026-02-20T03:21:35.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:35 trial028 ceph-mon[38552]: pgmap v388: 129 pgs: 129 active+clean; 103 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 967 KiB/s rd, 2.5 MiB/s wr, 323 op/s 2026-02-20T03:21:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:35 trial126 ceph-mon[38476]: pgmap v388: 129 pgs: 129 active+clean; 103 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 967 KiB/s rd, 2.5 MiB/s wr, 323 op/s 2026-02-20T03:21:35.765 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:21:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.939+0000 7f3470850640 1 -- 10.20.193.28:0/3291520710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f346c10a980 msgr2=0x7f346c10ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.939+0000 7f3470850640 1 --2- 10.20.193.28:0/3291520710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f346c10a980 0x7f346c10ad60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3460009a60 tx=0x7f346002f250 comp rx=0 tx=0).stop 2026-02-20T03:21:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.939+0000 7f3470850640 1 -- 10.20.193.28:0/3291520710 shutdown_connections 2026-02-20T03:21:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.939+0000 7f3470850640 1 --2- 10.20.193.28:0/3291520710 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f346c105320 0x7f346c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.939+0000 7f3470850640 1 --2- 10.20.193.28:0/3291520710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f346c104980 0x7f346c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.939+0000 7f3470850640 1 --2- 10.20.193.28:0/3291520710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f346c10a980 0x7f346c10ad60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.939+0000 7f3470850640 1 -- 10.20.193.28:0/3291520710 >> 10.20.193.28:0/3291520710 conn(0x7f346c100680 msgr2=0x7f346c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:35.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.939+0000 7f3470850640 1 -- 10.20.193.28:0/3291520710 shutdown_connections 2026-02-20T03:21:35.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.939+0000 7f3470850640 1 -- 10.20.193.28:0/3291520710 wait complete. 2026-02-20T03:21:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.940+0000 7f3470850640 1 Processor -- start 2026-02-20T03:21:35.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.940+0000 7f3470850640 1 -- start start 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.940+0000 7f3470850640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f346c104980 0x7f346c19d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.940+0000 7f3470850640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f346c105320 0x7f346c19d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.940+0000 7f3470850640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f346c10a980 0x7f346c1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.940+0000 7f3470850640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f346c114ba0 con 0x7f346c104980 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.940+0000 7f3470850640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f346c114a20 con 0x7f346c105320 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.940+0000 7f3470850640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f346c114d20 con 0x7f346c10a980 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f346c104980 0x7f346c19d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f346c104980 0x7f346c19d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56724/0 (socket says 10.20.193.28:56724) 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346ad76640 1 -- 10.20.193.28:0/600256015 learned_addr learned my addr 10.20.193.28:0/600256015 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346a575640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f346c105320 0x7f346c19d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346b577640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f346c10a980 0x7f346c1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346ad76640 1 -- 10.20.193.28:0/600256015 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f346c10a980 msgr2=0x7f346c1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346ad76640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f346c10a980 0x7f346c1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346ad76640 1 -- 10.20.193.28:0/600256015 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f346c105320 msgr2=0x7f346c19d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346ad76640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f346c105320 0x7f346c19d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346ad76640 1 -- 10.20.193.28:0/600256015 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c1a2090 con 0x7f346c104980 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346b577640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f346c10a980 0x7f346c1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f346ad76640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f346c104980 0x7f346c19d040 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f346002f760 tx=0x7f346002fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f344bfff640 1 -- 10.20.193.28:0/600256015 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460004260 con 0x7f346c104980 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f3470850640 1 -- 10.20.193.28:0/600256015 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346c1a2320 con 0x7f346c104980 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f344bfff640 1 -- 10.20.193.28:0/600256015 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3460004400 con 0x7f346c104980 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f344bfff640 1 -- 10.20.193.28:0/600256015 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460041620 con 0x7f346c104980 2026-02-20T03:21:35.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.941+0000 7f3470850640 1 -- 10.20.193.28:0/600256015 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346c1a9bc0 con 0x7f346c104980 2026-02-20T03:21:35.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.944+0000 7f344bfff640 1 -- 10.20.193.28:0/600256015 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3460038770 con 0x7f346c104980 2026-02-20T03:21:35.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.944+0000 7f3473556e00 1 Processor -- start 2026-02-20T03:21:35.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f3473556e00 1 -- start start 2026-02-20T03:21:35.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f3473556e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c5410c0 0x56411c5414a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f3473556e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 0x56411c545540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f3473556e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 0x56411c545fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f3473556e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56411c493c00 con 0x56411c545b60 2026-02-20T03:21:35.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f3473556e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56411c4413c0 con 0x56411c5410c0 2026-02-20T03:21:35.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f3473556e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56411c48fb30 con 0x56411c541a70 2026-02-20T03:21:35.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346b577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c5410c0 0x56411c5414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346b577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c5410c0 0x56411c5414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41810/0 (socket says 10.20.193.28:41810) 2026-02-20T03:21:35.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346b577640 1 -- 10.20.193.28:0/1751883020 learned_addr learned my addr 10.20.193.28:0/1751883020 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:35.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346ad76640 1 --2- 10.20.193.28:0/1751883020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 0x56411c545540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346a575640 1 --2- 10.20.193.28:0/1751883020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 0x56411c545fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346b577640 1 -- 10.20.193.28:0/1751883020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 msgr2=0x56411c545540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346b577640 1 --2- 10.20.193.28:0/1751883020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 0x56411c545540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346b577640 1 -- 10.20.193.28:0/1751883020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 msgr2=0x56411c545fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346b577640 1 --2- 10.20.193.28:0/1751883020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 0x56411c545fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346b577640 1 -- 10.20.193.28:0/1751883020 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411c43a840 con 0x56411c5410c0 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.945+0000 7f346b577640 1 --2- 10.20.193.28:0/1751883020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c5410c0 0x56411c5414a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f345c009c90 tx=0x7f345c004420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2742f1aa9b3851c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f34377fe640 1 -- 10.20.193.28:0/1751883020 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c019070 con 0x56411c5410c0 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f34377fe640 1 -- 10.20.193.28:0/1751883020 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f345c0079a0 con 0x56411c5410c0 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f34377fe640 1 -- 10.20.193.28:0/1751883020 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c014990 con 0x56411c5410c0 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f3473556e00 1 -- 10.20.193.28:0/1751883020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c5410c0 msgr2=0x56411c5414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f3473556e00 1 --2- 10.20.193.28:0/1751883020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c5410c0 0x56411c5414a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f345c009c90 tx=0x7f345c004420 comp rx=0 tx=0).stop 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f3473556e00 1 -- 10.20.193.28:0/1751883020 shutdown_connections 2026-02-20T03:21:35.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f3473556e00 1 --2- 10.20.193.28:0/1751883020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 0x56411c545fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f3473556e00 1 --2- 10.20.193.28:0/1751883020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 0x56411c545540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f3473556e00 1 --2- 10.20.193.28:0/1751883020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c5410c0 0x56411c5414a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f3473556e00 1 -- 10.20.193.28:0/1751883020 >> 10.20.193.28:0/1751883020 conn(0x56411c539b60 msgr2=0x56411c53f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f3473556e00 1 -- 10.20.193.28:0/1751883020 shutdown_connections 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f3473556e00 1 -- 10.20.193.28:0/1751883020 wait complete. 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f344bfff640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34400b0d80 0x7f34400b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.946+0000 7f344bfff640 1 -- 10.20.193.28:0/600256015 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3460105480 con 0x7f346c104980 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.947+0000 7f346b577640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34400b0d80 0x7f34400b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.947+0000 7f346b577640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34400b0d80 0x7f34400b3240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f345c014670 tx=0x7f345c0096d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.947+0000 7f3473556e00 1 -- start start 2026-02-20T03:21:35.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.947+0000 7f3473556e00 1 Processor -- start 2026-02-20T03:21:35.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3473556e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c5410c0 0x56411c563d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3473556e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 0x56411c5642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3473556e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 0x56411c562530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3473556e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56411c43b1a0 con 0x56411c5410c0 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3473556e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56411c54dd70 con 0x56411c545b60 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3473556e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56411c562b70 con 0x56411c541a70 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c5410c0 0x56411c563d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346b577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 0x56411c562530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c5410c0 0x56411c563d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56740/0 (socket says 10.20.193.28:56740) 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346ad76640 1 -- 10.20.193.28:0/422266867 learned_addr learned my addr 10.20.193.28:0/422266867 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346a575640 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 0x56411c5642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346ad76640 1 -- 10.20.193.28:0/422266867 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 msgr2=0x56411c5642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:35.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346ad76640 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 0x56411c5642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346ad76640 1 -- 10.20.193.28:0/422266867 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 msgr2=0x56411c562530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346ad76640 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 0x56411c562530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346ad76640 1 -- 10.20.193.28:0/422266867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411c55bf80 con 0x56411c5410c0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f346ad76640 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c5410c0 0x56411c563d80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3460005ec0 tx=0x7f3460108b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d46cb5cf08928a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3434ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3434ff9640 1 -- 10.20.193.28:0/422266867 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600c8e30 con 0x56411c5410c0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3434ff9640 1 -- 10.20.193.28:0/422266867 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3460033020 con 0x56411c5410c0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.948+0000 7f3434ff9640 1 -- 10.20.193.28:0/422266867 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600cc6e0 con 0x56411c5410c0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 1 -- 10.20.193.28:0/422266867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411c262b60 con 0x56411c5410c0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3434ff9640 1 -- 10.20.193.28:0/422266867 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f34600c88e0 con 0x56411c5410c0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 10 client.17118 _ll_register_callbacks cb 0x56411c43f0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 1 -- 10.20.193.28:0/422266867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56411c49b7f0 con 0x56411c5410c0 2026-02-20T03:21:35.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3434ff9640 1 -- 10.20.193.28:0/422266867 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f34600cc8c0 con 0x56411c5410c0 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 10 client.17118 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 1 -- 10.20.193.28:0/422266867 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56411c460430 con 0x56411c5410c0 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3434ff9640 1 -- 10.20.193.28:0/422266867 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f34600ef070 con 0x56411c5410c0 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 10 client.17118 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 10 client.17118 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 20 client.17118 populate_metadata read hostname 'trial028' 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56411c572540 0x56411c574a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 4 client.17118 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f3473556e00 1 -- 10.20.193.28:0/422266867 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56411c415c00 con 0x56411c572540 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.949+0000 7f346a575640 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56411c572540 0x56411c574a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.950+0000 7f346a575640 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56411c572540 0x56411c574a00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d376310d9b477fcc server_cookie=541a3d94bd1a68f0 in_seq=0 out_seq=0 2026-02-20T03:21:35.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.950+0000 7f3434ff9640 10 client.17118 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3434ff9640 1 -- 10.20.193.28:0/422266867 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56411c415c00 con 0x56411c572540 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3434ff9640 10 client.17118 handle_command_reply: tid=0 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 client.17118 shutdown 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 -- 10.20.193.28:0/422266867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c5410c0 msgr2=0x56411c563d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c5410c0 0x56411c563d80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3460005ec0 tx=0x7f3460108b50 comp rx=0 tx=0).stop 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 -- 10.20.193.28:0/422266867 shutdown_connections 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56411c572540 0x56411c574a00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 0x56411c562530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c541a70 0x56411c5642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 --2- 10.20.193.28:0/422266867 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c5410c0 0x56411c563d80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3434ff9640 0 client.17118 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:35.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 -- 10.20.193.28:0/422266867 >> 10.20.193.28:0/422266867 conn(0x56411c539b60 msgr2=0x56411c544520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:35.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 -- 10.20.193.28:0/422266867 shutdown_connections 2026-02-20T03:21:35.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 1 -- 10.20.193.28:0/422266867 wait complete. 2026-02-20T03:21:35.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.951+0000 7f3473556e00 20 client.17118 trim_cache size 0 max 16384 2026-02-20T03:21:35.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.963+0000 7f3473556e00 1 Processor -- start 2026-02-20T03:21:35.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.963+0000 7f3473556e00 1 -- start start 2026-02-20T03:21:35.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.963+0000 7f3473556e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c5451d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.963+0000 7f3473556e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c541a70 0x56411c567720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f3473556e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 0x56411c55ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346ad76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c5451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f3473556e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3410012690 con 0x56411c541a70 2026-02-20T03:21:35.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f3473556e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f341000ff60 con 0x56411c545b60 2026-02-20T03:21:35.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f3473556e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f341000ddb0 con 0x56411c5410c0 2026-02-20T03:21:35.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346ad76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c5451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48782/0 (socket says 10.20.193.28:48782) 2026-02-20T03:21:35.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346ad76640 1 -- 10.20.193.28:0/2636384711 learned_addr learned my addr 10.20.193.28:0/2636384711 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:35.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346a575640 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c541a70 0x56411c567720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346ad76640 1 -- 10.20.193.28:0/2636384711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 msgr2=0x56411c55ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346b577640 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 0x56411c55ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346ad76640 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 0x56411c55ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346ad76640 1 -- 10.20.193.28:0/2636384711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c541a70 msgr2=0x56411c567720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346ad76640 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c541a70 0x56411c567720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346ad76640 1 -- 10.20.193.28:0/2636384711 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411c55bdb0 con 0x56411c5410c0 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346b577640 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 0x56411c55ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346a575640 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c541a70 0x56411c567720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f346ad76640 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c5451d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3460108d00 tx=0x7f346010a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a2967897ff40934 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f3436ffd640 1 -- 10.20.193.28:0/2636384711 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600ccf90 con 0x56411c5410c0 2026-02-20T03:21:35.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f3436ffd640 1 -- 10.20.193.28:0/2636384711 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56411c49b7f0 con 0x56411c5410c0 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.964+0000 7f3436ffd640 1 -- 10.20.193.28:0/2636384711 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600cbc40 con 0x56411c5410c0 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.965+0000 7f3473556e00 1 -- 10.20.193.28:0/2636384711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 msgr2=0x56411c5451d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.965+0000 7f3473556e00 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c5451d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3460108d00 tx=0x7f346010a050 comp rx=0 tx=0).stop 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.965+0000 7f3473556e00 1 -- 10.20.193.28:0/2636384711 shutdown_connections 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.965+0000 7f3473556e00 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c545b60 0x56411c55ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.965+0000 7f3473556e00 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c541a70 0x56411c567720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.965+0000 7f3473556e00 1 --2- 10.20.193.28:0/2636384711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c5451d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.965+0000 7f3473556e00 1 -- 10.20.193.28:0/2636384711 >> 10.20.193.28:0/2636384711 conn(0x56411c539b60 msgr2=0x56411c561500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.965+0000 7f3473556e00 1 -- 10.20.193.28:0/2636384711 shutdown_connections 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.965+0000 7f3473556e00 1 -- 10.20.193.28:0/2636384711 wait complete. 2026-02-20T03:21:35.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.966+0000 7f3473556e00 1 -- start start 2026-02-20T03:21:35.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.966+0000 7f3473556e00 1 Processor -- start 2026-02-20T03:21:35.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f3473556e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c56abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f3473556e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c541a70 0x56411c56b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f3473556e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 0x56411c56b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f346a575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c541a70 0x56411c56b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f346a575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c541a70 0x56411c56b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41828/0 (socket says 10.20.193.28:41828) 2026-02-20T03:21:35.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f3473556e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f341000e420 con 0x56411c545b60 2026-02-20T03:21:35.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f3473556e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f341000f890 con 0x56411c541a70 2026-02-20T03:21:35.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f3473556e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f341000eaf0 con 0x56411c5410c0 2026-02-20T03:21:35.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f346ad76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c56abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f346a575640 1 -- 10.20.193.28:0/1948793670 learned_addr learned my addr 10.20.193.28:0/1948793670 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.967+0000 7f346b577640 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 0x56411c56b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.968+0000 7f346a575640 1 -- 10.20.193.28:0/1948793670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 msgr2=0x56411c56abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.968+0000 7f346a575640 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c56abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.968+0000 7f346a575640 1 -- 10.20.193.28:0/1948793670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 msgr2=0x56411c56b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.968+0000 7f346a575640 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 0x56411c56b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.968+0000 7f346a575640 1 -- 10.20.193.28:0/1948793670 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411c172900 con 0x56411c541a70 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.968+0000 7f346a575640 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c541a70 0x56411c56b120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x56411c562400 tx=0x7f3454009f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dc4524ff10b267 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.968+0000 7f3434ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.968+0000 7f3434ff9640 1 -- 10.20.193.28:0/1948793670 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454024640 con 0x56411c541a70 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 1 -- 10.20.193.28:0/1948793670 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411c44e4d0 con 0x56411c541a70 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3434ff9640 1 -- 10.20.193.28:0/1948793670 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f34540108d0 con 0x56411c541a70 2026-02-20T03:21:35.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3434ff9640 1 -- 10.20.193.28:0/1948793670 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345401d990 con 0x56411c541a70 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 10 client.26627 _ll_register_callbacks cb 0x7f3460005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 1 -- 10.20.193.28:0/1948793670 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56411c203a20 con 0x56411c541a70 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3434ff9640 1 -- 10.20.193.28:0/1948793670 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f345401db30 con 0x56411c541a70 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3434ff9640 1 -- 10.20.193.28:0/1948793670 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f345402d440 con 0x56411c541a70 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 10 client.26627 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 1 -- 10.20.193.28:0/1948793670 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56411c55caa0 con 0x56411c541a70 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3434ff9640 1 -- 10.20.193.28:0/1948793670 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3454022070 con 0x56411c541a70 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 10 client.26627 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 10 client.26627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 20 client.26627 populate_metadata read hostname 'trial028' 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56411c5dfa90 0x56411c5e1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 4 client.26627 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:21:35.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.969+0000 7f3473556e00 1 -- 10.20.193.28:0/1948793670 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56411c4a15a0 con 0x56411c5dfa90 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.970+0000 7f346ad76640 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56411c5dfa90 0x56411c5e1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.970+0000 7f346ad76640 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56411c5dfa90 0x56411c5e1f50 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9280012fd99e49b1 server_cookie=521d06441699f67b in_seq=0 out_seq=0 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.970+0000 7f3434ff9640 10 client.26627 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3434ff9640 1 -- 10.20.193.28:0/1948793670 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56411c4a15a0 con 0x56411c5dfa90 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3434ff9640 10 client.26627 handle_command_reply: tid=0 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 client.26627 shutdown 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 -- 10.20.193.28:0/1948793670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c541a70 msgr2=0x56411c56b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c541a70 0x56411c56b120 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x56411c562400 tx=0x7f3454009f00 comp rx=0 tx=0).stop 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 -- 10.20.193.28:0/1948793670 shutdown_connections 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56411c5dfa90 0x56411c5e1f50 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56411c545b60 0x56411c56b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56411c541a70 0x56411c56b120 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 --2- 10.20.193.28:0/1948793670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56411c5410c0 0x56411c56abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3434ff9640 0 client.26627 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:35.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 -- 10.20.193.28:0/1948793670 >> 10.20.193.28:0/1948793670 conn(0x56411c539b60 msgr2=0x56411c5441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:35.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 -- 10.20.193.28:0/1948793670 shutdown_connections 2026-02-20T03:21:35.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 1 -- 10.20.193.28:0/1948793670 wait complete. 2026-02-20T03:21:35.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.971+0000 7f3473556e00 20 client.26627 trim_cache size 0 max 16384 2026-02-20T03:21:35.979 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:21:35.980 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:21:35.980 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "61baf17a-bb07-4bba-aba0-1908fc3ef362", 2026-02-20T03:21:35.980 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:21:35.980 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 -- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34400b0d80 msgr2=0x7f34400b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34400b0d80 0x7f34400b3240 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f345c014670 tx=0x7f345c0096d0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 -- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f346c104980 msgr2=0x7f346c19d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f346c104980 0x7f346c19d040 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f346002f760 tx=0x7f346002fca0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 -- 10.20.193.28:0/600256015 shutdown_connections 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34400b0d80 0x7f34400b3240 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f346c10a980 0x7f346c1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f346c105320 0x7f346c19d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 --2- 10.20.193.28:0/600256015 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f346c104980 0x7f346c19d040 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:35.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 -- 10.20.193.28:0/600256015 >> 10.20.193.28:0/600256015 conn(0x7f346c100680 msgr2=0x7f346c101070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:35.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 -- 10.20.193.28:0/600256015 shutdown_connections 2026-02-20T03:21:35.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:35.972+0000 7f3470850640 1 -- 10.20.193.28:0/600256015 wait complete. 2026-02-20T03:21:36.074 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:21:36.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:36 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:21:36.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:36 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:36.379 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:21:36.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:36 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:21:36.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:36 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:36.508 INFO:tasks.workunit.client.0.trial028.stdout: 1 584341 8.14 MB/sec execute 189 sec latency 9.931 ms 2026-02-20T03:21:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.566+0000 7f522db92640 1 -- 10.20.193.28:0/2398353033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5228109220 msgr2=0x7f5228109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.566+0000 7f522db92640 1 --2- 10.20.193.28:0/2398353033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5228109220 0x7f5228109680 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5218009a30 tx=0x7f521802f220 comp rx=0 tx=0).stop 2026-02-20T03:21:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.566+0000 7f522db92640 1 -- 10.20.193.28:0/2398353033 shutdown_connections 2026-02-20T03:21:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.566+0000 7f522db92640 1 --2- 10.20.193.28:0/2398353033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5228109bc0 0x7f5228115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.566+0000 7f522db92640 1 --2- 10.20.193.28:0/2398353033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5228109220 0x7f5228109680 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.566+0000 7f522db92640 1 --2- 10.20.193.28:0/2398353033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f522810f1e0 0x7f522810f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.566+0000 7f522db92640 1 -- 10.20.193.28:0/2398353033 >> 10.20.193.28:0/2398353033 conn(0x7f5228078860 msgr2=0x7f522807ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:36.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.566+0000 7f522db92640 1 -- 10.20.193.28:0/2398353033 shutdown_connections 2026-02-20T03:21:36.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.566+0000 7f522db92640 1 -- 10.20.193.28:0/2398353033 wait complete. 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.567+0000 7f522db92640 1 Processor -- start 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.567+0000 7f522db92640 1 -- start start 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.567+0000 7f522db92640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5228109220 0x7f5228083830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.567+0000 7f522db92640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5228109bc0 0x7f5228083d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.567+0000 7f522db92640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f522810f1e0 0x7f522807c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.567+0000 7f522db92640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f52281192f0 con 0x7f5228109220 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.567+0000 7f522db92640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5228119170 con 0x7f5228109bc0 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.567+0000 7f522db92640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5228119470 con 0x7f522810f1e0 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f52277fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5228109220 0x7f5228083830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f5227fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f522810f1e0 0x7f522807c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f5227fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f522810f1e0 0x7f522807c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:46462/0 (socket says 10.20.193.28:46462) 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f5227fff640 1 -- 10.20.193.28:0/317215562 learned_addr learned my addr 10.20.193.28:0/317215562 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f5226ffd640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5228109bc0 0x7f5228083d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f52277fe640 1 -- 10.20.193.28:0/317215562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f522810f1e0 msgr2=0x7f522807c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f52277fe640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f522810f1e0 0x7f522807c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f52277fe640 1 -- 10.20.193.28:0/317215562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5228109bc0 msgr2=0x7f5228083d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f52277fe640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5228109bc0 0x7f5228083d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f52277fe640 1 -- 10.20.193.28:0/317215562 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522807d250 con 0x7f5228109220 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f5226ffd640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5228109bc0 0x7f5228083d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f52277fe640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5228109220 0x7f5228083830 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f521400d730 tx=0x7f521400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f5224ff9640 1 -- 10.20.193.28:0/317215562 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214014070 con 0x7f5228109220 2026-02-20T03:21:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f522db92640 1 -- 10.20.193.28:0/317215562 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522807d540 con 0x7f5228109220 2026-02-20T03:21:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f5224ff9640 1 -- 10.20.193.28:0/317215562 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f52140044e0 con 0x7f5228109220 2026-02-20T03:21:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f5224ff9640 1 -- 10.20.193.28:0/317215562 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214005020 con 0x7f5228109220 2026-02-20T03:21:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.568+0000 7f522db92640 1 -- 10.20.193.28:0/317215562 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5228081530 con 0x7f5228109220 2026-02-20T03:21:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.571+0000 7f5224ff9640 1 -- 10.20.193.28:0/317215562 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f52140047c0 con 0x7f5228109220 2026-02-20T03:21:36.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.572+0000 7f5230097e00 1 Processor -- start 2026-02-20T03:21:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.572+0000 7f5230097e00 1 -- start start 2026-02-20T03:21:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5230097e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 0x55791b5f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5230097e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5fe0 0x55791b5f99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5230097e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5fa120 0x55791b601ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5230097e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55791b575e50 con 0x55791b5fa120 2026-02-20T03:21:36.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5230097e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55791b5489c0 con 0x55791b5f5630 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5230097e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55791b4f6240 con 0x55791b5f5fe0 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f52277fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5fe0 0x55791b5f99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5226ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5fa120 0x55791b601ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5226ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5fa120 0x55791b601ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60028/0 (socket says 10.20.193.28:60028) 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5226ffd640 1 -- 10.20.193.28:0/2406712685 learned_addr learned my addr 10.20.193.28:0/2406712685 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5227fff640 1 --2- 10.20.193.28:0/2406712685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 0x55791b5f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5226ffd640 1 -- 10.20.193.28:0/2406712685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5fe0 msgr2=0x55791b5f99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5226ffd640 1 --2- 10.20.193.28:0/2406712685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5fe0 0x55791b5f99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5226ffd640 1 -- 10.20.193.28:0/2406712685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 msgr2=0x55791b5f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.573+0000 7f5224ff9640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51fc0b0e20 0x7f51fc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.574+0000 7f5224ff9640 1 -- 10.20.193.28:0/317215562 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f52140e0b00 con 0x7f5228109220 2026-02-20T03:21:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.574+0000 7f5226ffd640 1 --2- 10.20.193.28:0/2406712685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 0x55791b5f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.574+0000 7f5226ffd640 1 -- 10.20.193.28:0/2406712685 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55791b509420 con 0x55791b5fa120 2026-02-20T03:21:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.574+0000 7f5227fff640 1 --2- 10.20.193.28:0/2406712685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 0x55791b5f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:21:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.574+0000 7f5226ffd640 1 --2- 10.20.193.28:0/2406712685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5fa120 0x55791b601ca0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5218037000 tx=0x7f52180057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d546b0bad47552 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.574+0000 7f5227fff640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51fc0b0e20 0x7f51fc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.574+0000 7f51ebfff640 1 -- 10.20.193.28:0/2406712685 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521802fc80 con 0x55791b5fa120 2026-02-20T03:21:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.574+0000 7f51ebfff640 1 -- 10.20.193.28:0/2406712685 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5218033040 con 0x55791b5fa120 2026-02-20T03:21:36.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.574+0000 7f51ebfff640 1 -- 10.20.193.28:0/2406712685 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218038e20 con 0x55791b5fa120 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5230097e00 1 -- 10.20.193.28:0/2406712685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5fa120 msgr2=0x55791b601ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5230097e00 1 --2- 10.20.193.28:0/2406712685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5fa120 0x55791b601ca0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5218037000 tx=0x7f52180057d0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5227fff640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51fc0b0e20 0x7f51fc0b32e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f521c009690 tx=0x7f521c004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5230097e00 1 -- 10.20.193.28:0/2406712685 shutdown_connections 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5230097e00 1 --2- 10.20.193.28:0/2406712685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5fa120 0x55791b601ca0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5230097e00 1 --2- 10.20.193.28:0/2406712685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5fe0 0x55791b5f99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5230097e00 1 --2- 10.20.193.28:0/2406712685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 0x55791b5f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5230097e00 1 -- 10.20.193.28:0/2406712685 >> 10.20.193.28:0/2406712685 conn(0x55791b5b8290 msgr2=0x55791b5f3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5230097e00 1 -- 10.20.193.28:0/2406712685 shutdown_connections 2026-02-20T03:21:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.575+0000 7f5230097e00 1 -- 10.20.193.28:0/2406712685 wait complete. 2026-02-20T03:21:36.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.577+0000 7f5230097e00 1 -- start start 2026-02-20T03:21:36.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.578+0000 7f5230097e00 1 Processor -- start 2026-02-20T03:21:36.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.578+0000 7f5230097e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 0x55791b621140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.578+0000 7f5230097e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b621680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.579+0000 7f5226ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b621680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.579+0000 7f5226ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b621680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60032/0 (socket says 10.20.193.28:60032) 2026-02-20T03:21:36.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.579+0000 7f5230097e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5fa120 0x55791b61f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.579+0000 7f5230097e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55791b5448f0 con 0x55791b5f5fe0 2026-02-20T03:21:36.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.579+0000 7f5230097e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55791b336f50 con 0x55791b5fa120 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.579+0000 7f5230097e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55791b61fb40 con 0x55791b5f5630 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.580+0000 7f5226ffd640 1 -- 10.20.193.28:0/1054546027 learned_addr learned my addr 10.20.193.28:0/1054546027 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.580+0000 7f52277fe640 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 0x55791b621140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.580+0000 7f5227fff640 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5fa120 0x55791b61f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.580+0000 7f52277fe640 1 -- 10.20.193.28:0/1054546027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5fa120 msgr2=0x55791b61f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.580+0000 7f52277fe640 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5fa120 0x55791b61f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.580+0000 7f52277fe640 1 -- 10.20.193.28:0/1054546027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 msgr2=0x55791b621680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.580+0000 7f52277fe640 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b621680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.580+0000 7f52277fe640 1 -- 10.20.193.28:0/1054546027 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55791b618ba0 con 0x55791b5f5630 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f52277fe640 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 0x55791b621140 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55791b5f64d0 tx=0x7f52140a8680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1a13afdd9cdcad1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:36.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f51e97fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f51e97fa640 1 -- 10.20.193.28:0/1054546027 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521401d070 con 0x55791b5f5630 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f5230097e00 1 -- 10.20.193.28:0/1054546027 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55791b319b40 con 0x55791b5f5630 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f5230097e00 10 client.26656 _ll_register_callbacks cb 0x55791b581f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f5230097e00 1 -- 10.20.193.28:0/1054546027 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55791b5561a0 con 0x55791b5f5630 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f51e97fa640 1 -- 10.20.193.28:0/1054546027 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f52140ea040 con 0x55791b5f5630 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f51e97fa640 1 -- 10.20.193.28:0/1054546027 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52140e9030 con 0x55791b5f5630 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f51e97fa640 1 -- 10.20.193.28:0/1054546027 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5214004ae0 con 0x55791b5f5630 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f51e97fa640 1 -- 10.20.193.28:0/1054546027 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f52140b15b0 con 0x55791b5f5630 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f5230097e00 10 client.26656 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f5230097e00 1 -- 10.20.193.28:0/1054546027 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55791b503230 con 0x55791b5f5630 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f51e97fa640 1 -- 10.20.193.28:0/1054546027 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f52140a77f0 con 0x55791b5f5630 2026-02-20T03:21:36.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f5230097e00 10 client.26656 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f5230097e00 10 client.26656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.581+0000 7f5230097e00 20 client.26656 populate_metadata read hostname 'trial028' 2026-02-20T03:21:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.582+0000 7f5230097e00 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55791b62f7e0 0x55791b631c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.582+0000 7f5230097e00 4 client.26656 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.582+0000 7f5230097e00 1 -- 10.20.193.28:0/1054546027 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55791b5505b0 con 0x55791b62f7e0 2026-02-20T03:21:36.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.582+0000 7f5226ffd640 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55791b62f7e0 0x55791b631c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.582+0000 7f5226ffd640 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55791b62f7e0 0x55791b631c30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2031fc32628120c6 server_cookie=14e6f26b38cf6cab in_seq=0 out_seq=0 2026-02-20T03:21:36.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.582+0000 7f51e97fa640 10 client.26656 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f51e97fa640 1 -- 10.20.193.28:0/1054546027 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55791b5505b0 con 0x55791b62f7e0 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f51e97fa640 10 client.26656 handle_command_reply: tid=0 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f5230097e00 1 client.26656 shutdown 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f5230097e00 1 -- 10.20.193.28:0/1054546027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 msgr2=0x55791b621140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f5230097e00 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 0x55791b621140 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55791b5f64d0 tx=0x7f52140a8680 comp rx=0 tx=0).stop 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f5230097e00 1 -- 10.20.193.28:0/1054546027 shutdown_connections 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f5230097e00 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55791b62f7e0 0x55791b631c30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f5230097e00 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5fa120 0x55791b61f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f5230097e00 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b621680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f51e97fa640 0 client.26656 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:36.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f5230097e00 1 --2- 10.20.193.28:0/1054546027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 0x55791b621140 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.583+0000 7f5230097e00 1 -- 10.20.193.28:0/1054546027 >> 10.20.193.28:0/1054546027 conn(0x55791b5b8290 msgr2=0x55791b5f8940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.584+0000 7f5230097e00 1 -- 10.20.193.28:0/1054546027 shutdown_connections 2026-02-20T03:21:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.584+0000 7f5230097e00 1 -- 10.20.193.28:0/1054546027 wait complete. 2026-02-20T03:21:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.584+0000 7f5230097e00 20 client.26656 trim_cache size 0 max 16384 2026-02-20T03:21:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5230097e00 1 Processor -- start 2026-02-20T03:21:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5230097e00 1 -- start start 2026-02-20T03:21:36.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:36 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:21:36.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:36 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5230097e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 0x55791b5edd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5230097e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b61ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5230097e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5fa120 0x55791b61cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5230097e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc012770 con 0x55791b5f5fe0 2026-02-20T03:21:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5230097e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc010040 con 0x55791b5f5630 2026-02-20T03:21:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5230097e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc00de90 con 0x55791b5fa120 2026-02-20T03:21:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5226ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b61ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5226ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b61ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60036/0 (socket says 10.20.193.28:60036) 2026-02-20T03:21:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5226ffd640 1 -- 10.20.193.28:0/1575960246 learned_addr learned my addr 10.20.193.28:0/1575960246 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f52277fe640 1 --2- 10.20.193.28:0/1575960246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 0x55791b5edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.593+0000 7f5227fff640 1 --2- 10.20.193.28:0/1575960246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5fa120 0x55791b61cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.594+0000 7f5226ffd640 1 -- 10.20.193.28:0/1575960246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5fa120 msgr2=0x55791b61cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.594+0000 7f5226ffd640 1 --2- 10.20.193.28:0/1575960246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5fa120 0x55791b61cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.594+0000 7f5226ffd640 1 -- 10.20.193.28:0/1575960246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 msgr2=0x55791b5edd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.594+0000 7f5226ffd640 1 --2- 10.20.193.28:0/1575960246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 0x55791b5edd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.594+0000 7f5226ffd640 1 -- 10.20.193.28:0/1575960246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55791b6189d0 con 0x55791b5f5fe0 2026-02-20T03:21:36.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.595+0000 7f5226ffd640 1 --2- 10.20.193.28:0/1575960246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b61ca30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5218005840 tx=0x7f5218004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f036fcd9936134 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:36.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.595+0000 7f51eb7fe640 1 -- 10.20.193.28:0/1575960246 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218038e20 con 0x55791b5f5fe0 2026-02-20T03:21:36.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.595+0000 7f51eb7fe640 1 -- 10.20.193.28:0/1575960246 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f52180040b0 con 0x55791b5f5fe0 2026-02-20T03:21:36.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.595+0000 7f51eb7fe640 1 -- 10.20.193.28:0/1575960246 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52180029d0 con 0x55791b5f5fe0 2026-02-20T03:21:36.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.595+0000 7f5230097e00 1 -- 10.20.193.28:0/1575960246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 msgr2=0x55791b61ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:36.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.595+0000 7f5230097e00 1 --2- 10.20.193.28:0/1575960246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b61ca30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5218005840 tx=0x7f5218004040 comp rx=0 tx=0).stop 2026-02-20T03:21:36.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.596+0000 7f5230097e00 1 -- 10.20.193.28:0/1575960246 shutdown_connections 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.596+0000 7f5230097e00 1 --2- 10.20.193.28:0/1575960246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5fa120 0x55791b61cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.596+0000 7f5230097e00 1 --2- 10.20.193.28:0/1575960246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b61ca30 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.596+0000 7f5230097e00 1 --2- 10.20.193.28:0/1575960246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5f5630 0x55791b5edd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.596+0000 7f5230097e00 1 -- 10.20.193.28:0/1575960246 >> 10.20.193.28:0/1575960246 conn(0x55791b5b8290 msgr2=0x55791b61e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.596+0000 7f5230097e00 1 -- 10.20.193.28:0/1575960246 shutdown_connections 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.596+0000 7f5230097e00 1 -- 10.20.193.28:0/1575960246 wait complete. 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.596+0000 7f5230097e00 1 -- start start 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.596+0000 7f5230097e00 1 Processor -- start 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5230097e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 0x55791b628440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5230097e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b628980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5230097e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5fa120 0x55791b628ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5230097e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc00e500 con 0x55791b5f5fe0 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5230097e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc00f970 con 0x55791b5fa120 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5230097e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f51cc00ebd0 con 0x55791b5f5630 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5226ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b628980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5226ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b628980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60044/0 (socket says 10.20.193.28:60044) 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5226ffd640 1 -- 10.20.193.28:0/4153626757 learned_addr learned my addr 10.20.193.28:0/4153626757 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f52277fe640 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 0x55791b628440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5226ffd640 1 -- 10.20.193.28:0/4153626757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 msgr2=0x55791b628440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5226ffd640 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 0x55791b628440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5226ffd640 1 -- 10.20.193.28:0/4153626757 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5fa120 msgr2=0x55791b628ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5226ffd640 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5fa120 0x55791b628ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5226ffd640 1 -- 10.20.193.28:0/4153626757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55791b227870 con 0x55791b5f5fe0 2026-02-20T03:21:36.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f5226ffd640 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b628980 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5218005fd0 tx=0x7f5218005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f0af16892e7fa2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:36.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.597+0000 7f51e97fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:36.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.598+0000 7f51e97fa640 1 -- 10.20.193.28:0/4153626757 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218056070 con 0x55791b5f5fe0 2026-02-20T03:21:36.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.598+0000 7f51e97fa640 1 -- 10.20.193.28:0/4153626757 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5218033070 con 0x55791b5f5fe0 2026-02-20T03:21:36.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.599+0000 7f51e97fa640 1 -- 10.20.193.28:0/4153626757 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218042690 con 0x55791b5f5fe0 2026-02-20T03:21:36.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.599+0000 7f5230097e00 1 -- 10.20.193.28:0/4153626757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55791b4e8440 con 0x55791b5f5fe0 2026-02-20T03:21:36.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.599+0000 7f5230097e00 10 client.17142 _ll_register_callbacks cb 0x7f521400de60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:36.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.599+0000 7f5230097e00 1 -- 10.20.193.28:0/4153626757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55791b519810 con 0x55791b5f5fe0 2026-02-20T03:21:36.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.600+0000 7f51e97fa640 1 -- 10.20.193.28:0/4153626757 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5218002850 con 0x55791b5f5fe0 2026-02-20T03:21:36.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.600+0000 7f51e97fa640 1 -- 10.20.193.28:0/4153626757 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5218004260 con 0x55791b5f5fe0 2026-02-20T03:21:36.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f5230097e00 10 client.17142 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:36.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f5230097e00 1 -- 10.20.193.28:0/4153626757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55791b6196c0 con 0x55791b5f5fe0 2026-02-20T03:21:36.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f51e97fa640 1 -- 10.20.193.28:0/4153626757 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5218042830 con 0x55791b5f5fe0 2026-02-20T03:21:36.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f5230097e00 10 client.17142 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:36.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f5230097e00 10 client.17142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:36.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f5230097e00 20 client.17142 populate_metadata read hostname 'trial028' 2026-02-20T03:21:36.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f5230097e00 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55791b69b6c0 0x55791b69dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:36.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f5230097e00 4 client.17142 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:21:36.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f5230097e00 1 -- 10.20.193.28:0/4153626757 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55791b4fab00 con 0x55791b69b6c0 2026-02-20T03:21:36.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.602+0000 7f52277fe640 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55791b69b6c0 0x55791b69dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:36.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.603+0000 7f52277fe640 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55791b69b6c0 0x55791b69dab0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d326959cc7b9ff76 server_cookie=fda341bddbd9113a in_seq=0 out_seq=0 2026-02-20T03:21:36.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.603+0000 7f51e97fa640 10 client.17142 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:36.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.603+0000 7f51e97fa640 1 -- 10.20.193.28:0/4153626757 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55791b4fab00 con 0x55791b69b6c0 2026-02-20T03:21:36.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.603+0000 7f51e97fa640 10 client.17142 handle_command_reply: tid=0 2026-02-20T03:21:36.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.603+0000 7f5230097e00 1 client.17142 shutdown 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 -- 10.20.193.28:0/4153626757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 msgr2=0x55791b628980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b628980 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f5218005fd0 tx=0x7f5218005e50 comp rx=0 tx=0).stop 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 -- 10.20.193.28:0/4153626757 shutdown_connections 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55791b69b6c0 0x55791b69dab0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55791b5fa120 0x55791b628ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55791b5f5fe0 0x55791b628980 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 --2- 10.20.193.28:0/4153626757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55791b5f5630 0x55791b628440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 -- 10.20.193.28:0/4153626757 >> 10.20.193.28:0/4153626757 conn(0x55791b5b8290 msgr2=0x55791b5f8650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f51e97fa640 0 client.17142 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 -- 10.20.193.28:0/4153626757 shutdown_connections 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 1 -- 10.20.193.28:0/4153626757 wait complete. 2026-02-20T03:21:36.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.604+0000 7f5230097e00 20 client.17142 trim_cache size 0 max 16384 2026-02-20T03:21:36.609 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:21:36.609 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:21:36.609 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:21:36.609 INFO:teuthology.orchestra.run.trial028.stdout: "61baf17a-bb07-4bba-aba0-1908fc3ef362": { 2026-02-20T03:21:36.609 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:21:36.610 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "61baf17a-bb07-4bba-aba0-1908fc3ef362", 2026-02-20T03:21:36.610 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:21:36.610 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:21:36.610 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:21:36.610 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:21:36.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.605+0000 7f522db92640 1 -- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51fc0b0e20 msgr2=0x7f51fc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:36.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.605+0000 7f522db92640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51fc0b0e20 0x7f51fc0b32e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f521c009690 tx=0x7f521c004b40 comp rx=0 tx=0).stop 2026-02-20T03:21:36.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.605+0000 7f522db92640 1 -- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5228109220 msgr2=0x7f5228083830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:36.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.605+0000 7f522db92640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5228109220 0x7f5228083830 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f521400d730 tx=0x7f521400dc00 comp rx=0 tx=0).stop 2026-02-20T03:21:36.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.605+0000 7f522db92640 1 -- 10.20.193.28:0/317215562 shutdown_connections 2026-02-20T03:21:36.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.606+0000 7f522db92640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f51fc0b0e20 0x7f51fc0b32e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.606+0000 7f522db92640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f522810f1e0 0x7f522807c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.606+0000 7f522db92640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5228109bc0 0x7f5228083d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.606+0000 7f522db92640 1 --2- 10.20.193.28:0/317215562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5228109220 0x7f5228083830 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:36.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.606+0000 7f522db92640 1 -- 10.20.193.28:0/317215562 >> 10.20.193.28:0/317215562 conn(0x7f5228078860 msgr2=0x7f522807a290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:36.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.606+0000 7f522db92640 1 -- 10.20.193.28:0/317215562 shutdown_connections 2026-02-20T03:21:36.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:21:36.606+0000 7f522db92640 1 -- 10.20.193.28:0/317215562 wait complete. 2026-02-20T03:21:36.770 INFO:tasks.cephfs.filesystem:scrub status for tag:61baf17a-bb07-4bba-aba0-1908fc3ef362 - {'path': '/', 'tag': '61baf17a-bb07-4bba-aba0-1908fc3ef362', 'options': 'recursive,force'} 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: pgmap v389: 129 pgs: 129 active+clean; 101 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 462 op/s 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:37 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 588163 8.20 MB/sec execute 190 sec latency 13.601 ms 2026-02-20T03:21:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:21:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:21:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:21:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:37.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:37.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: pgmap v389: 129 pgs: 129 active+clean; 101 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 462 op/s 2026-02-20T03:21:37.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:21:37.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:37 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:21:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:21:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:21:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:21:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: pgmap v389: 129 pgs: 129 active+clean; 101 MiB data, 2.0 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 462 op/s 2026-02-20T03:21:37.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:21:37.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:37.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:37 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:38.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 592076 8.27 MB/sec execute 191 sec latency 7.367 ms 2026-02-20T03:21:38.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:38.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:38.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:21:38.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:21:38.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:21:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:21:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:38.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:38.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:21:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:21:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:21:39.395 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:39 trial028 ceph-mon[38552]: pgmap v390: 129 pgs: 129 active+clean; 102 MiB data, 2.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 421 op/s 2026-02-20T03:21:39.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 593965 8.29 MB/sec execute 192 sec latency 432.053 ms 2026-02-20T03:21:39.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:39 trial126 ceph-mon[38476]: pgmap v390: 129 pgs: 129 active+clean; 102 MiB data, 2.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 421 op/s 2026-02-20T03:21:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:39 trial177 ceph-mon[43181]: pgmap v390: 129 pgs: 129 active+clean; 102 MiB data, 2.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 421 op/s 2026-02-20T03:21:40.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 594617 8.27 MB/sec execute 193 sec latency 667.164 ms 2026-02-20T03:21:41.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 598406 8.32 MB/sec execute 194 sec latency 11.148 ms 2026-02-20T03:21:41.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:41 trial126 ceph-mon[38476]: pgmap v391: 129 pgs: 129 active+clean; 109 MiB data, 2.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 569 op/s 2026-02-20T03:21:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:41 trial028 ceph-mon[38552]: pgmap v391: 129 pgs: 129 active+clean; 109 MiB data, 2.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 569 op/s 2026-02-20T03:21:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:41 trial177 ceph-mon[43181]: pgmap v391: 129 pgs: 129 active+clean; 109 MiB data, 2.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 569 op/s 2026-02-20T03:21:42.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 602644 8.39 MB/sec execute 195 sec latency 8.069 ms 2026-02-20T03:21:43.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 606683 8.47 MB/sec execute 196 sec latency 6.859 ms 2026-02-20T03:21:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:43 trial126 ceph-mon[38476]: pgmap v392: 129 pgs: 129 active+clean; 111 MiB data, 2.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 451 op/s 2026-02-20T03:21:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:43 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:21:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:43 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:21:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:43 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:21:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:43 trial028 ceph-mon[38552]: pgmap v392: 129 pgs: 129 active+clean; 111 MiB data, 2.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 451 op/s 2026-02-20T03:21:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:43 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:21:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:43 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:21:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:43 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:21:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:43 trial177 ceph-mon[43181]: pgmap v392: 129 pgs: 129 active+clean; 111 MiB data, 2.1 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 451 op/s 2026-02-20T03:21:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:43 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:21:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:43 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:21:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:43 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:21:44.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 609323 8.49 MB/sec execute 197 sec latency 205.345 ms 2026-02-20T03:21:45.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 613271 8.55 MB/sec execute 198 sec latency 10.883 ms 2026-02-20T03:21:45.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:45 trial126 ceph-mon[38476]: pgmap v393: 129 pgs: 129 active+clean; 113 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 492 op/s 2026-02-20T03:21:45.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:45 trial028 ceph-mon[38552]: pgmap v393: 129 pgs: 129 active+clean; 113 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 492 op/s 2026-02-20T03:21:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:45 trial177 ceph-mon[43181]: pgmap v393: 129 pgs: 129 active+clean; 113 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 492 op/s 2026-02-20T03:21:46.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 617214 8.62 MB/sec execute 199 sec latency 6.662 ms 2026-02-20T03:21:47.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.343+0000 7f12fbfff640 1 -- 10.20.193.28:0/3244732588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 msgr2=0x7f12fc109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:47.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.343+0000 7f12fbfff640 1 --2- 10.20.193.28:0/3244732588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 0x7f12fc109890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009a30 tx=0x7f12f002f220 comp rx=0 tx=0).stop 2026-02-20T03:21:47.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.343+0000 7f12fbfff640 1 -- 10.20.193.28:0/3244732588 shutdown_connections 2026-02-20T03:21:47.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.343+0000 7f12fbfff640 1 --2- 10.20.193.28:0/3244732588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12fc10a900 0x7f12fc111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.343+0000 7f12fbfff640 1 --2- 10.20.193.28:0/3244732588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f12fc109e60 0x7f12fc10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.343+0000 7f12fbfff640 1 --2- 10.20.193.28:0/3244732588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 0x7f12fc109890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.343+0000 7f12fbfff640 1 -- 10.20.193.28:0/3244732588 >> 10.20.193.28:0/3244732588 conn(0x7f12fc077fe0 msgr2=0x7f12fc07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.343+0000 7f12fbfff640 1 -- 10.20.193.28:0/3244732588 shutdown_connections 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.343+0000 7f12fbfff640 1 -- 10.20.193.28:0/3244732588 wait complete. 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fbfff640 1 Processor -- start 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fbfff640 1 -- start start 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fbfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 0x7f12fc1a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fbfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f12fc109e60 0x7f12fc1a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12fc10a900 0x7f12fc1a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc114910 con 0x7f12fc10a900 2026-02-20T03:21:47.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fbfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc114790 con 0x7f12fc109490 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fbfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12fc114a90 con 0x7f12fc109e60 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12faffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 0x7f12fc1a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12faffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 0x7f12fc1a0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38066/0 (socket says 10.20.193.28:38066) 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12faffd640 1 -- 10.20.193.28:0/1127858709 learned_addr learned my addr 10.20.193.28:0/1127858709 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12fc10a900 0x7f12fc1a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12fa7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f12fc109e60 0x7f12fc1a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12faffd640 1 -- 10.20.193.28:0/1127858709 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f12fc109e60 msgr2=0x7f12fc1a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12faffd640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f12fc109e60 0x7f12fc1a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12faffd640 1 -- 10.20.193.28:0/1127858709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12fc10a900 msgr2=0x7f12fc1a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12faffd640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12fc10a900 0x7f12fc1a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.344+0000 7f12faffd640 1 -- 10.20.193.28:0/1127858709 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12fc1a8bb0 con 0x7f12fc109490 2026-02-20T03:21:47.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.345+0000 7f12faffd640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 0x7f12fc1a0f90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12f0002fd0 tx=0x7f12f002fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:47.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.345+0000 7f12d3fff640 1 -- 10.20.193.28:0/1127858709 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f002fe30 con 0x7f12fc109490 2026-02-20T03:21:47.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.345+0000 7f12d3fff640 1 -- 10.20.193.28:0/1127858709 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f12f0038770 con 0x7f12fc109490 2026-02-20T03:21:47.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.345+0000 7f12fbfff640 1 -- 10.20.193.28:0/1127858709 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12fc1a8e40 con 0x7f12fc109490 2026-02-20T03:21:47.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.345+0000 7f12d3fff640 1 -- 10.20.193.28:0/1127858709 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f0042950 con 0x7f12fc109490 2026-02-20T03:21:47.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.345+0000 7f12fbfff640 1 -- 10.20.193.28:0/1127858709 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12fc1a92a0 con 0x7f12fc109490 2026-02-20T03:21:47.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.347+0000 7f12d3fff640 1 -- 10.20.193.28:0/1127858709 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f12f004a030 con 0x7f12fc109490 2026-02-20T03:21:47.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.348+0000 7f1304494e00 1 Processor -- start 2026-02-20T03:21:47.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.348+0000 7f1304494e00 1 -- start start 2026-02-20T03:21:47.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f1304494e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e30ee80 0x55b65e30f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f1304494e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 0x55b65e313f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f1304494e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e314560 0x55b65e3169f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f1304494e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b65e25f8f0 con 0x55b65e314560 2026-02-20T03:21:47.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f1304494e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b65e20d2e0 con 0x55b65e30ee80 2026-02-20T03:21:47.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f1304494e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b65e25b820 con 0x55b65e30f7c0 2026-02-20T03:21:47.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fb7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e30ee80 0x55b65e30f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12d3fff640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12cc0b0e20 0x7f12cc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fb7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e30ee80 0x55b65e30f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38072/0 (socket says 10.20.193.28:38072) 2026-02-20T03:21:47.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fb7fe640 1 -- 10.20.193.28:0/2695931901 learned_addr learned my addr 10.20.193.28:0/2695931901 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:47.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fa7fc640 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e314560 0x55b65e3169f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12faffd640 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 0x55b65e313f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12d3fff640 1 -- 10.20.193.28:0/1127858709 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f12f0104c50 con 0x7f12fc109490 2026-02-20T03:21:47.355 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12cc0b0e20 0x7f12cc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fb7fe640 1 -- 10.20.193.28:0/2695931901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 msgr2=0x55b65e313f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 0x55b65e313f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fb7fe640 1 -- 10.20.193.28:0/2695931901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e314560 msgr2=0x55b65e3169f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e314560 0x55b65e3169f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fb7fe640 1 -- 10.20.193.28:0/2695931901 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b65e1ff5a0 con 0x55b65e30ee80 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.349+0000 7f12fa7fc640 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e314560 0x55b65e3169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e30ee80 0x55b65e30f280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f12ec004530 tx=0x7f12ec004a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8f363638239702a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12cc0b0e20 0x7f12cc0b32e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00a000 tx=0x7f12ec01a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f12d37fe640 1 -- 10.20.193.28:0/2695931901 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec016cc0 con 0x55b65e30ee80 2026-02-20T03:21:47.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f12d37fe640 1 -- 10.20.193.28:0/2695931901 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f12ec01d070 con 0x55b65e30ee80 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f12d37fe640 1 -- 10.20.193.28:0/2695931901 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec0035d0 con 0x55b65e30ee80 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f1304494e00 1 -- 10.20.193.28:0/2695931901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e30ee80 msgr2=0x55b65e30f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f1304494e00 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e30ee80 0x55b65e30f280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f12ec004530 tx=0x7f12ec004a00 comp rx=0 tx=0).stop 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f1304494e00 1 -- 10.20.193.28:0/2695931901 shutdown_connections 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f1304494e00 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e314560 0x55b65e3169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f1304494e00 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 0x55b65e313f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f1304494e00 1 --2- 10.20.193.28:0/2695931901 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e30ee80 0x55b65e30f280 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f1304494e00 1 -- 10.20.193.28:0/2695931901 >> 10.20.193.28:0/2695931901 conn(0x55b65e3066f0 msgr2=0x55b65e30d570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f1304494e00 1 -- 10.20.193.28:0/2695931901 shutdown_connections 2026-02-20T03:21:47.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.350+0000 7f1304494e00 1 -- 10.20.193.28:0/2695931901 wait complete. 2026-02-20T03:21:47.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.351+0000 7f1304494e00 1 -- start start 2026-02-20T03:21:47.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.351+0000 7f1304494e00 1 Processor -- start 2026-02-20T03:21:47.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f1304494e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 0x55b65e327a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f1304494e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e327f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f1304494e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f1304494e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b65e2070c0 con 0x55b65e30f7c0 2026-02-20T03:21:47.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f1304494e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b65e317610 con 0x55b65e314560 2026-02-20T03:21:47.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f1304494e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b65e32f470 con 0x55b65e30ee80 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12fa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e327f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12fb7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12fa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e327f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45810/0 (socket says 10.20.193.28:45810) 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12fa7fc640 1 -- 10.20.193.28:0/4240186106 learned_addr learned my addr 10.20.193.28:0/4240186106 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12faffd640 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 0x55b65e327a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12faffd640 1 -- 10.20.193.28:0/4240186106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 msgr2=0x55b65e32eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12faffd640 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12faffd640 1 -- 10.20.193.28:0/4240186106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 msgr2=0x55b65e327f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12faffd640 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e327f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12faffd640 1 -- 10.20.193.28:0/4240186106 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b65e321150 con 0x55b65e30ee80 2026-02-20T03:21:47.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12faffd640 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 0x55b65e327a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f12f00d3fd0 tx=0x7f12f0038c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=234ed6230c5e76a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.352+0000 7f12d0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f12d0ff9640 1 -- 10.20.193.28:0/4240186106 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00ef0e0 con 0x55b65e30ee80 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f12d0ff9640 1 -- 10.20.193.28:0/4240186106 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f12f0033070 con 0x55b65e30ee80 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 1 -- 10.20.193.28:0/4240186106 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b65e21b820 con 0x55b65e30ee80 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f12d0ff9640 1 -- 10.20.193.28:0/4240186106 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00044a0 con 0x55b65e30ee80 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f12d0ff9640 1 -- 10.20.193.28:0/4240186106 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f12f0042af0 con 0x55b65e30ee80 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 10 client.26671 _ll_register_callbacks cb 0x55b65e20aff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 1 -- 10.20.193.28:0/4240186106 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b65e2674e0 con 0x55b65e30ee80 2026-02-20T03:21:47.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f12d0ff9640 1 -- 10.20.193.28:0/4240186106 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12f00cd030 con 0x55b65e30ee80 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 10 client.26671 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 1 -- 10.20.193.28:0/4240186106 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55b65e220380 con 0x55b65e30ee80 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f12d0ff9640 1 -- 10.20.193.28:0/4240186106 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f12f00cb940 con 0x55b65e30ee80 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 10 client.26671 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 10 client.26671 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 20 client.26671 populate_metadata read hostname 'trial028' 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b65e333720 0x55b65e335be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 4 client.26671 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.353+0000 7f1304494e00 1 -- 10.20.193.28:0/4240186106 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b65e1e1bd0 con 0x55b65e333720 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.354+0000 7f12fa7fc640 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b65e333720 0x55b65e335be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.354+0000 7f12fa7fc640 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b65e333720 0x55b65e335be0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d41fdb5d9e82a55 server_cookie=41f8fff27cf45dde in_seq=0 out_seq=0 2026-02-20T03:21:47.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.354+0000 7f12d0ff9640 10 client.26671 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:47.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f12d0ff9640 1 -- 10.20.193.28:0/4240186106 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b65e1e1bd0 con 0x55b65e333720 2026-02-20T03:21:47.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f12d0ff9640 10 client.26671 handle_command_reply: tid=0 2026-02-20T03:21:47.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 client.26671 shutdown 2026-02-20T03:21:47.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 -- 10.20.193.28:0/4240186106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 msgr2=0x55b65e327a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:47.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 0x55b65e327a20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f12f00d3fd0 tx=0x7f12f0038c00 comp rx=0 tx=0).stop 2026-02-20T03:21:47.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 -- 10.20.193.28:0/4240186106 shutdown_connections 2026-02-20T03:21:47.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b65e333720 0x55b65e335be0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e327f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 --2- 10.20.193.28:0/4240186106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 0x55b65e327a20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 -- 10.20.193.28:0/4240186106 >> 10.20.193.28:0/4240186106 conn(0x55b65e3066f0 msgr2=0x55b65e3158f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:47.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f12d0ff9640 0 client.26671 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:47.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 -- 10.20.193.28:0/4240186106 shutdown_connections 2026-02-20T03:21:47.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 1 -- 10.20.193.28:0/4240186106 wait complete. 2026-02-20T03:21:47.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.355+0000 7f1304494e00 20 client.26671 trim_cache size 0 max 16384 2026-02-20T03:21:47.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.362+0000 7f1304494e00 1 Processor -- start 2026-02-20T03:21:47.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.362+0000 7f1304494e00 1 -- start start 2026-02-20T03:21:47.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f1304494e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 0x55b65e326000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f1304494e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e32eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f1304494e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e325270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f1304494e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12a0012620 con 0x55b65e30f7c0 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f1304494e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f12a000fef0 con 0x55b65e314560 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f1304494e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12a000dd40 con 0x55b65e30ee80 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12fa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e32eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12fa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e32eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45816/0 (socket says 10.20.193.28:45816) 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12fa7fc640 1 -- 10.20.193.28:0/1554283051 learned_addr learned my addr 10.20.193.28:0/1554283051 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/1554283051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e325270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12faffd640 1 --2- 10.20.193.28:0/1554283051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 0x55b65e326000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12fb7fe640 1 -- 10.20.193.28:0/1554283051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 msgr2=0x55b65e326000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:47.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/1554283051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 0x55b65e326000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12fb7fe640 1 -- 10.20.193.28:0/1554283051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 msgr2=0x55b65e32eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/1554283051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e32eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.363+0000 7f12fb7fe640 1 -- 10.20.193.28:0/1554283051 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b65e320f80 con 0x55b65e314560 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/1554283051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e325270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12ec004500 tx=0x7f12ec006020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4db4bcc7f315be9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f12d2ffd640 1 -- 10.20.193.28:0/1554283051 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec003f50 con 0x55b65e314560 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f12d2ffd640 1 -- 10.20.193.28:0/1554283051 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f12ec003030 con 0x55b65e314560 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f12d2ffd640 1 -- 10.20.193.28:0/1554283051 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ec02c6a0 con 0x55b65e314560 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f1304494e00 1 -- 10.20.193.28:0/1554283051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 msgr2=0x55b65e325270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f1304494e00 1 --2- 10.20.193.28:0/1554283051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e325270 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f12ec004500 tx=0x7f12ec006020 comp rx=0 tx=0).stop 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f1304494e00 1 -- 10.20.193.28:0/1554283051 shutdown_connections 2026-02-20T03:21:47.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f1304494e00 1 --2- 10.20.193.28:0/1554283051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e325270 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f1304494e00 1 --2- 10.20.193.28:0/1554283051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30f7c0 0x55b65e32eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f1304494e00 1 --2- 10.20.193.28:0/1554283051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30ee80 0x55b65e326000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f1304494e00 1 -- 10.20.193.28:0/1554283051 >> 10.20.193.28:0/1554283051 conn(0x55b65e3066f0 msgr2=0x55b65e327900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f1304494e00 1 -- 10.20.193.28:0/1554283051 shutdown_connections 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.364+0000 7f1304494e00 1 -- 10.20.193.28:0/1554283051 wait complete. 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f1304494e00 1 -- start start 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f1304494e00 1 Processor -- start 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f1304494e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30ee80 0x55b65e32b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f1304494e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 0x55b65e32b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f1304494e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f1304494e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12a000e3b0 con 0x55b65e30ee80 2026-02-20T03:21:47.373 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f1304494e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f12a000f820 con 0x55b65e314560 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f1304494e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12a000ea80 con 0x55b65e30f7c0 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f12faffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30ee80 0x55b65e32b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f12faffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30ee80 0x55b65e32b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45822/0 (socket says 10.20.193.28:45822) 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f12faffd640 1 -- 10.20.193.28:0/47080623 learned_addr learned my addr 10.20.193.28:0/47080623 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.365+0000 7f12fa7fc640 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 0x55b65e32b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12faffd640 1 -- 10.20.193.28:0/47080623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 msgr2=0x55b65e32b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12faffd640 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 0x55b65e32b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12faffd640 1 -- 10.20.193.28:0/47080623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 msgr2=0x55b65e32e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:21:47.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12faffd640 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12faffd640 1 -- 10.20.193.28:0/47080623 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b65dfbf690 con 0x55b65e30ee80 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12fb7fe640 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12faffd640 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30ee80 0x55b65e32b0b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009a00 tx=0x7f12f0106030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48516fbc93f65cc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12d0ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12d0ff9640 1 -- 10.20.193.28:0/47080623 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00ef0e0 con 0x55b65e30ee80 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f1304494e00 1 -- 10.20.193.28:0/47080623 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b65e224b70 con 0x55b65e30ee80 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12d0ff9640 1 -- 10.20.193.28:0/47080623 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f12f0033070 con 0x55b65e30ee80 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f1304494e00 10 client.17157 _ll_register_callbacks cb 0x7f12f00c8670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f1304494e00 1 -- 10.20.193.28:0/47080623 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12ec01d070 con 0x55b65e30ee80 2026-02-20T03:21:47.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12d0ff9640 1 -- 10.20.193.28:0/47080623 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12f00ef0e0 con 0x55b65e30ee80 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12d0ff9640 1 -- 10.20.193.28:0/47080623 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f12f00d5740 con 0x55b65e30ee80 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12d0ff9640 1 -- 10.20.193.28:0/47080623 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12f0042af0 con 0x55b65e30ee80 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f1304494e00 10 client.17157 fetch_fsmap learned FSMap version 29 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f1304494e00 1 -- 10.20.193.28:0/47080623 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55b65e321c70 con 0x55b65e30ee80 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.366+0000 7f12d0ff9640 1 -- 10.20.193.28:0/47080623 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f12f0042c90 con 0x55b65e30ee80 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.367+0000 7f1304494e00 10 client.17157 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.367+0000 7f1304494e00 10 client.17157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.367+0000 7f1304494e00 20 client.17157 populate_metadata read hostname 'trial028' 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.367+0000 7f1304494e00 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b65e3b03e0 0x55b65e3b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.367+0000 7f1304494e00 4 client.17157 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.367+0000 7f1304494e00 1 -- 10.20.193.28:0/47080623 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b65e2306b0 con 0x55b65e3b03e0 2026-02-20T03:21:47.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.367+0000 7f12fa7fc640 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b65e3b03e0 0x55b65e3b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:21:47.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.368+0000 7f12fa7fc640 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b65e3b03e0 0x55b65e3b28a0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=234d5258c57dbe97 server_cookie=11aa274c2d4b93bd in_seq=0 out_seq=0 2026-02-20T03:21:47.377 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.368+0000 7f12d0ff9640 10 client.17157 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:47.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f12d0ff9640 1 -- 10.20.193.28:0/47080623 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b65e2306b0 con 0x55b65e3b03e0 2026-02-20T03:21:47.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f12d0ff9640 10 client.17157 handle_command_reply: tid=0 2026-02-20T03:21:47.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 client.17157 shutdown 2026-02-20T03:21:47.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 -- 10.20.193.28:0/47080623 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30ee80 msgr2=0x55b65e32b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30ee80 0x55b65e32b0b0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009a00 tx=0x7f12f0106030 comp rx=0 tx=0).stop 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 -- 10.20.193.28:0/47080623 shutdown_connections 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b65e3b03e0 0x55b65e3b28a0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b65e314560 0x55b65e32e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b65e30f7c0 0x55b65e32b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 --2- 10.20.193.28:0/47080623 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b65e30ee80 0x55b65e32b0b0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f12d0ff9640 0 client.17157 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 -- 10.20.193.28:0/47080623 >> 10.20.193.28:0/47080623 conn(0x55b65e3066f0 msgr2=0x55b65e324260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 -- 10.20.193.28:0/47080623 shutdown_connections 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 1 -- 10.20.193.28:0/47080623 wait complete. 2026-02-20T03:21:47.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.459+0000 7f1304494e00 20 client.17157 trim_cache size 0 max 16384 2026-02-20T03:21:47.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:21:47.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:21:47.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:21:47.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:21:47.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 -- 10.20.193.28:0/1127858709 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12cc0b0e20 msgr2=0x7f12cc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:47.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12cc0b0e20 0x7f12cc0b32e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f12ec00a000 tx=0x7f12ec01a000 comp rx=0 tx=0).stop 2026-02-20T03:21:47.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 -- 10.20.193.28:0/1127858709 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 msgr2=0x7f12fc1a0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:21:47.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 0x7f12fc1a0f90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12f0002fd0 tx=0x7f12f002fc90 comp rx=0 tx=0).stop 2026-02-20T03:21:47.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 -- 10.20.193.28:0/1127858709 shutdown_connections 2026-02-20T03:21:47.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12cc0b0e20 0x7f12cc0b32e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12fc10a900 0x7f12fc1a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f12fc109e60 0x7f12fc1a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 --2- 10.20.193.28:0/1127858709 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12fc109490 0x7f12fc1a0f90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:21:47.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 -- 10.20.193.28:0/1127858709 >> 10.20.193.28:0/1127858709 conn(0x7f12fc077fe0 msgr2=0x7f12fc10d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:21:47.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 -- 10.20.193.28:0/1127858709 shutdown_connections 2026-02-20T03:21:47.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:21:47.460+0000 7f12fbfff640 1 -- 10.20.193.28:0/1127858709 wait complete. 2026-02-20T03:21:47.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 620886 8.68 MB/sec execute 200 sec latency 39.649 ms 2026-02-20T03:21:47.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:47 trial126 ceph-mon[38476]: pgmap v394: 129 pgs: 129 active+clean; 114 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 518 op/s 2026-02-20T03:21:47.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:47 trial028 ceph-mon[38552]: pgmap v394: 129 pgs: 129 active+clean; 114 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 518 op/s 2026-02-20T03:21:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:47 trial177 ceph-mon[43181]: pgmap v394: 129 pgs: 129 active+clean; 114 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 518 op/s 2026-02-20T03:21:48.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 625134 8.76 MB/sec execute 201 sec latency 5.606 ms 2026-02-20T03:21:49.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 628413 8.80 MB/sec execute 202 sec latency 128.645 ms 2026-02-20T03:21:49.530 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:49 trial028 ceph-mon[38552]: pgmap v395: 129 pgs: 129 active+clean; 118 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 431 op/s 2026-02-20T03:21:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:49 trial126 ceph-mon[38476]: pgmap v395: 129 pgs: 129 active+clean; 118 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 431 op/s 2026-02-20T03:21:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:49 trial177 ceph-mon[43181]: pgmap v395: 129 pgs: 129 active+clean; 118 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 431 op/s 2026-02-20T03:21:50.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 629000 8.78 MB/sec execute 203 sec latency 891.501 ms 2026-02-20T03:21:51.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 632763 8.83 MB/sec execute 204 sec latency 5.684 ms 2026-02-20T03:21:51.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:51 trial126 ceph-mon[38476]: pgmap v396: 129 pgs: 129 active+clean; 119 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 517 op/s 2026-02-20T03:21:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:51 trial028 ceph-mon[38552]: pgmap v396: 129 pgs: 129 active+clean; 119 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 517 op/s 2026-02-20T03:21:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:51 trial177 ceph-mon[43181]: pgmap v396: 129 pgs: 129 active+clean; 119 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 517 op/s 2026-02-20T03:21:52.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 636577 8.88 MB/sec execute 205 sec latency 9.390 ms 2026-02-20T03:21:53.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 640444 8.94 MB/sec execute 206 sec latency 10.240 ms 2026-02-20T03:21:53.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:53 trial126 ceph-mon[38476]: pgmap v397: 129 pgs: 129 active+clean; 121 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 403 op/s 2026-02-20T03:21:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:53 trial028 ceph-mon[38552]: pgmap v397: 129 pgs: 129 active+clean; 121 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 403 op/s 2026-02-20T03:21:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:53 trial177 ceph-mon[43181]: pgmap v397: 129 pgs: 129 active+clean; 121 MiB data, 2.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 2.5 MiB/s wr, 403 op/s 2026-02-20T03:21:54.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 644235 9.00 MB/sec execute 207 sec latency 56.081 ms 2026-02-20T03:21:55.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 644235 8.96 MB/sec execute 208 sec latency 1056.118 ms 2026-02-20T03:21:55.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:55 trial028 ceph-mon[38552]: pgmap v398: 129 pgs: 129 active+clean; 120 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 482 op/s 2026-02-20T03:21:55.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:55 trial126 ceph-mon[38476]: pgmap v398: 129 pgs: 129 active+clean; 120 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 482 op/s 2026-02-20T03:21:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:55 trial177 ceph-mon[43181]: pgmap v398: 129 pgs: 129 active+clean; 120 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 482 op/s 2026-02-20T03:21:56.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 644323 8.92 MB/sec execute 209 sec latency 1622.578 ms 2026-02-20T03:21:57.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 647821 8.96 MB/sec execute 210 sec latency 23.750 ms 2026-02-20T03:21:57.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:57 trial126 ceph-mon[38476]: pgmap v399: 129 pgs: 129 active+clean; 124 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 485 op/s 2026-02-20T03:21:57.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:57 trial028 ceph-mon[38552]: pgmap v399: 129 pgs: 129 active+clean; 124 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 485 op/s 2026-02-20T03:21:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:57 trial177 ceph-mon[43181]: pgmap v399: 129 pgs: 129 active+clean; 124 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 485 op/s 2026-02-20T03:21:58.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 651586 9.01 MB/sec execute 211 sec latency 6.532 ms 2026-02-20T03:21:59.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 655738 9.07 MB/sec execute 212 sec latency 7.556 ms 2026-02-20T03:21:59.521 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:21:59 trial177 ceph-mon[43181]: pgmap v400: 129 pgs: 129 active+clean; 129 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 480 op/s 2026-02-20T03:21:59.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:21:59 trial126 ceph-mon[38476]: pgmap v400: 129 pgs: 129 active+clean; 129 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 480 op/s 2026-02-20T03:21:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:21:59 trial028 ceph-mon[38552]: pgmap v400: 129 pgs: 129 active+clean; 129 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 480 op/s 2026-02-20T03:22:00.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 655918 9.03 MB/sec execute 213 sec latency 934.063 ms 2026-02-20T03:22:00.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- 10.20.193.28:0/1493757745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 msgr2=0x7f6cb4109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:00.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 --2- 10.20.193.28:0/1493757745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 0x7f6cb4109890 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009a30 tx=0x7f6ca802f260 comp rx=0 tx=0).stop 2026-02-20T03:22:00.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- 10.20.193.28:0/1493757745 shutdown_connections 2026-02-20T03:22:00.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 --2- 10.20.193.28:0/1493757745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cb410a900 0x7f6cb4111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 --2- 10.20.193.28:0/1493757745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cb4109e60 0x7f6cb410a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 --2- 10.20.193.28:0/1493757745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 0x7f6cb4109890 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- 10.20.193.28:0/1493757745 >> 10.20.193.28:0/1493757745 conn(0x7f6cb4077fe0 msgr2=0x7f6cb407a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:00.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- 10.20.193.28:0/1493757745 shutdown_connections 2026-02-20T03:22:00.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- 10.20.193.28:0/1493757745 wait complete. 2026-02-20T03:22:00.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 Processor -- start 2026-02-20T03:22:00.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- start start 2026-02-20T03:22:00.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 0x7f6cb41a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cb4109e60 0x7f6cb41a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cb410a900 0x7f6cb41a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb4114a00 con 0x7f6cb4109490 2026-02-20T03:22:00.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb4114880 con 0x7f6cb410a900 2026-02-20T03:22:00.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb4114b80 con 0x7f6cb4109e60 2026-02-20T03:22:00.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 0x7f6cb41a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:00.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 0x7f6cb41a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50694/0 (socket says 10.20.193.28:50694) 2026-02-20T03:22:00.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb2d76640 1 -- 10.20.193.28:0/889111225 learned_addr learned my addr 10.20.193.28:0/889111225 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:00.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb2d76640 1 -- 10.20.193.28:0/889111225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cb4109e60 msgr2=0x7f6cb41a1560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:00.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cb4109e60 0x7f6cb41a1560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb2d76640 1 -- 10.20.193.28:0/889111225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cb410a900 msgr2=0x7f6cb41a85d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:00.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cb410a900 0x7f6cb41a85d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb2d76640 1 -- 10.20.193.28:0/889111225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb41a8cd0 con 0x7f6cb4109490 2026-02-20T03:22:00.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 0x7f6cb41a1020 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009950 tx=0x7f6ca802fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:00.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6c93fff640 1 -- 10.20.193.28:0/889111225 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80043b0 con 0x7f6cb4109490 2026-02-20T03:22:00.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6c93fff640 1 -- 10.20.193.28:0/889111225 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6ca8004550 con 0x7f6cb4109490 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6c93fff640 1 -- 10.20.193.28:0/889111225 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8005050 con 0x7f6cb4109490 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- 10.20.193.28:0/889111225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb41a8f60 con 0x7f6cb4109490 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.535+0000 7f6cb8895640 1 -- 10.20.193.28:0/889111225 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb41a9450 con 0x7f6cb4109490 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6c93fff640 1 -- 10.20.193.28:0/889111225 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6ca80051f0 con 0x7f6cb4109490 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cbbfd8e00 1 Processor -- start 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cbbfd8e00 1 -- start start 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d28ee80 0x55607d28f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d293f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d294560 0x55607d2969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55607d1df8f0 con 0x55607d28f7c0 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55607d18d2e0 con 0x55607d294560 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55607d1db820 con 0x55607d28ee80 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d293f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d293f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50706/0 (socket says 10.20.193.28:50706) 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cb2d76640 1 -- 10.20.193.28:0/2961925298 learned_addr learned my addr 10.20.193.28:0/2961925298 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cb2d76640 1 -- 10.20.193.28:0/2961925298 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d28ee80 msgr2=0x55607d28f280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/2961925298 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d28ee80 0x55607d28f280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cb2d76640 1 -- 10.20.193.28:0/2961925298 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d294560 msgr2=0x55607d2969f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/2961925298 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d294560 0x55607d2969f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.540+0000 7f6cb2d76640 1 -- 10.20.193.28:0/2961925298 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607d17f5a0 con 0x55607d28f7c0 2026-02-20T03:22:00.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/2961925298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d293f40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6ca810ba90 tx=0x7f6ca810bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4fb8073a3add9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:00.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6c913fe640 1 -- 10.20.193.28:0/2961925298 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8114070 con 0x55607d28f7c0 2026-02-20T03:22:00.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6c913fe640 1 -- 10.20.193.28:0/2961925298 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6ca810de50 con 0x55607d28f7c0 2026-02-20T03:22:00.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6c913fe640 1 -- 10.20.193.28:0/2961925298 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8107570 con 0x55607d28f7c0 2026-02-20T03:22:00.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6c93fff640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c880b0e20 0x7f6c880b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6c93fff640 1 -- 10.20.193.28:0/889111225 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6ca8105920 con 0x7f6cb4109490 2026-02-20T03:22:00.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2961925298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 msgr2=0x55607d293f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:00.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2961925298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d293f40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6ca810ba90 tx=0x7f6ca810bf60 comp rx=0 tx=0).stop 2026-02-20T03:22:00.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2961925298 shutdown_connections 2026-02-20T03:22:00.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2961925298 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d294560 0x55607d2969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2961925298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d293f40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2961925298 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d28ee80 0x55607d28f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2961925298 >> 10.20.193.28:0/2961925298 conn(0x55607d2866f0 msgr2=0x55607d28d570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:00.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cb3577640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c880b0e20 0x7f6c880b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:00.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2961925298 shutdown_connections 2026-02-20T03:22:00.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.542+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2961925298 wait complete. 2026-02-20T03:22:00.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.543+0000 7f6cb3577640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c880b0e20 0x7f6c880b32e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400aab0 tx=0x7f6ca4009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.543+0000 7f6cbbfd8e00 1 -- start start 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 Processor -- start 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28ee80 0x55607d2a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d28f7c0 0x55607d2a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d294560 0x55607d2aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55607d1870c0 con 0x55607d28ee80 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55607d297370 con 0x55607d294560 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55607d2af230 con 0x55607d28f7c0 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28ee80 0x55607d2a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:00.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28ee80 0x55607d2a77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50722/0 (socket says 10.20.193.28:50722) 2026-02-20T03:22:00.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cb2d76640 1 -- 10.20.193.28:0/3439622771 learned_addr learned my addr 10.20.193.28:0/3439622771 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:00.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cb2d76640 1 -- 10.20.193.28:0/3439622771 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d28f7c0 msgr2=0x55607d2a7d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:00.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d28f7c0 0x55607d2a7d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cb2d76640 1 -- 10.20.193.28:0/3439622771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d294560 msgr2=0x55607d2aeca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:00.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d294560 0x55607d2aeca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cb2d76640 1 -- 10.20.193.28:0/3439622771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607d2a0ef0 con 0x55607d28ee80 2026-02-20T03:22:00.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28ee80 0x55607d2a77e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80c9430 tx=0x7f6ca802f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748fcf6648b526f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:00.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6c7cbfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:00.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/3439622771 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8114020 con 0x55607d28ee80 2026-02-20T03:22:00.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/3439622771 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6ca8033070 con 0x55607d28ee80 2026-02-20T03:22:00.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/3439622771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55607d19b820 con 0x55607d28ee80 2026-02-20T03:22:00.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/3439622771 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8110d50 con 0x55607d28ee80 2026-02-20T03:22:00.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/3439622771 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6ca80cd0d0 con 0x55607d28ee80 2026-02-20T03:22:00.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 10 client.17169 _ll_register_callbacks cb 0x55607d18aff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:00.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/3439622771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55607d1e74e0 con 0x55607d28ee80 2026-02-20T03:22:00.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/3439622771 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ca80ccd00 con 0x55607d28ee80 2026-02-20T03:22:00.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 10 client.17169 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:00.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/3439622771 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55607d1a0380 con 0x55607d28ee80 2026-02-20T03:22:00.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/3439622771 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6ca80d63d0 con 0x55607d28ee80 2026-02-20T03:22:00.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 10 client.17169 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:00.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 10 client.17169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:00.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 20 client.17169 populate_metadata read hostname 'trial028' 2026-02-20T03:22:00.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55607d2b3170 0x55607d2b5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 4 client.17169 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:00.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.544+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/3439622771 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55607d161bd0 con 0x55607d2b3170 2026-02-20T03:22:00.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.569+0000 7f6cb2575640 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55607d2b3170 0x55607d2b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:00.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.636+0000 7f6cb2575640 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55607d2b3170 0x55607d2b5630 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99bde3611c4107ee server_cookie=60ab2c6d89388b8e in_seq=0 out_seq=0 2026-02-20T03:22:00.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.636+0000 7f6c7cbfc640 10 client.17169 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:00.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/3439622771 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55607d161bd0 con 0x55607d2b3170 2026-02-20T03:22:00.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6c7cbfc640 10 client.17169 handle_command_reply: tid=0 2026-02-20T03:22:00.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 client.17169 shutdown 2026-02-20T03:22:00.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/3439622771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28ee80 msgr2=0x55607d2a77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:00.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28ee80 0x55607d2a77e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80c9430 tx=0x7f6ca802f260 comp rx=0 tx=0).stop 2026-02-20T03:22:00.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/3439622771 shutdown_connections 2026-02-20T03:22:00.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55607d2b3170 0x55607d2b5630 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d294560 0x55607d2aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d28f7c0 0x55607d2a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/3439622771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28ee80 0x55607d2a77e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/3439622771 >> 10.20.193.28:0/3439622771 conn(0x55607d2866f0 msgr2=0x55607d295910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:00.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6c7cbfc640 0 client.17169 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:00.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/3439622771 shutdown_connections 2026-02-20T03:22:00.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/3439622771 wait complete. 2026-02-20T03:22:00.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.649+0000 7f6cbbfd8e00 20 client.17169 trim_cache size 0 max 16384 2026-02-20T03:22:00.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 Processor -- start 2026-02-20T03:22:00.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- start start 2026-02-20T03:22:00.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d28ee80 0x55607d2a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d294560 0x55607d2a4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c58012600 con 0x55607d28f7c0 2026-02-20T03:22:00.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5800fed0 con 0x55607d28ee80 2026-02-20T03:22:00.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5800dd20 con 0x55607d294560 2026-02-20T03:22:00.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cb2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:00.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cb2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50726/0 (socket says 10.20.193.28:50726) 2026-02-20T03:22:00.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cb2575640 1 -- 10.20.193.28:0/1668053974 learned_addr learned my addr 10.20.193.28:0/1668053974 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:00.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cb2575640 1 -- 10.20.193.28:0/1668053974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d294560 msgr2=0x55607d2a4020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:00.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cb2575640 1 --2- 10.20.193.28:0/1668053974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d294560 0x55607d2a4020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cb2575640 1 -- 10.20.193.28:0/1668053974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d28ee80 msgr2=0x55607d2a6ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:00.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cb2575640 1 --2- 10.20.193.28:0/1668053974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d28ee80 0x55607d2a6ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cb2575640 1 -- 10.20.193.28:0/1668053974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607d2a0d20 con 0x55607d28f7c0 2026-02-20T03:22:00.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cb2575640 1 --2- 10.20.193.28:0/1668053974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2aec60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009590 tx=0x7f6c9c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71dd9b2350a0e1f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:00.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6c90bfd640 1 -- 10.20.193.28:0/1668053974 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c01e070 con 0x55607d28f7c0 2026-02-20T03:22:00.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6c90bfd640 1 -- 10.20.193.28:0/1668053974 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6c9c002e20 con 0x55607d28f7c0 2026-02-20T03:22:00.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6c90bfd640 1 -- 10.20.193.28:0/1668053974 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c015040 con 0x55607d28f7c0 2026-02-20T03:22:00.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/1668053974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 msgr2=0x55607d2aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:00.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/1668053974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2aec60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009590 tx=0x7f6c9c0047e0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/1668053974 shutdown_connections 2026-02-20T03:22:00.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/1668053974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d294560 0x55607d2a4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/1668053974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2aec60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/1668053974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d28ee80 0x55607d2a6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/1668053974 >> 10.20.193.28:0/1668053974 conn(0x55607d2866f0 msgr2=0x55607d2a65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:00.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/1668053974 shutdown_connections 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/1668053974 wait complete. 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 -- start start 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.654+0000 7f6cbbfd8e00 1 Processor -- start 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d28ee80 0x55607d2ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2acf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d294560 0x55607d2ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5800e390 con 0x55607d28f7c0 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5800f800 con 0x55607d28ee80 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c5800ea60 con 0x55607d294560 2026-02-20T03:22:00.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cb2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cb2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2acf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50734/0 (socket says 10.20.193.28:50734) 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cb2575640 1 -- 10.20.193.28:0/2975911803 learned_addr learned my addr 10.20.193.28:0/2975911803 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cb2575640 1 -- 10.20.193.28:0/2975911803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d294560 msgr2=0x55607d2ad490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cb2575640 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d294560 0x55607d2ad490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cb2575640 1 -- 10.20.193.28:0/2975911803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d28ee80 msgr2=0x55607d2ae7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cb2575640 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d28ee80 0x55607d2ae7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cb2575640 1 -- 10.20.193.28:0/2975911803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55607cf3f690 con 0x55607d28f7c0 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cb2575640 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2acf50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c004890 tx=0x7f6c9c0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b316d591f3e63718 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6c7cbfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/2975911803 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c015030 con 0x55607d28f7c0 2026-02-20T03:22:00.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/2975911803 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6c9c028070 con 0x55607d28f7c0 2026-02-20T03:22:00.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/2975911803 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c01e040 con 0x55607d28f7c0 2026-02-20T03:22:00.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2975911803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55607d1a4b70 con 0x55607d28f7c0 2026-02-20T03:22:00.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/2975911803 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6c9c023760 con 0x55607d28f7c0 2026-02-20T03:22:00.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 10 client.17175 _ll_register_callbacks cb 0x7f6ca810b300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:00.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2975911803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ca810de50 con 0x55607d28f7c0 2026-02-20T03:22:00.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/2975911803 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c9c019aa0 con 0x55607d28f7c0 2026-02-20T03:22:00.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 10 client.17175 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:00.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2975911803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55607d2a1a10 con 0x55607d28f7c0 2026-02-20T03:22:00.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/2975911803 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6c9c019c40 con 0x55607d28f7c0 2026-02-20T03:22:00.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 10 client.17175 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:00.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 10 client.17175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:00.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 20 client.17175 populate_metadata read hostname 'trial028' 2026-02-20T03:22:00.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55607d31f1d0 0x55607d321660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:00.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 4 client.17175 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:22:00.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.659+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2975911803 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55607d1b06b0 con 0x55607d31f1d0 2026-02-20T03:22:00.678 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.676+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55607d31f1d0 0x55607d321660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:00.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.703+0000 7f6cb2d76640 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55607d31f1d0 0x55607d321660 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69637a8e5e7a0d0a server_cookie=a8a11c94b034fa96 in_seq=0 out_seq=0 2026-02-20T03:22:00.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.703+0000 7f6c7cbfc640 10 client.17175 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:00.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.837+0000 7f6c7cbfc640 1 -- 10.20.193.28:0/2975911803 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55607d1b06b0 con 0x55607d31f1d0 2026-02-20T03:22:00.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.837+0000 7f6c7cbfc640 10 client.17175 handle_command_reply: tid=0 2026-02-20T03:22:00.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.837+0000 7f6cbbfd8e00 1 client.17175 shutdown 2026-02-20T03:22:00.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2975911803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 msgr2=0x55607d2acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:00.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2acf50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c004890 tx=0x7f6c9c0194b0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2975911803 shutdown_connections 2026-02-20T03:22:00.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55607d31f1d0 0x55607d321660 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55607d294560 0x55607d2ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55607d28f7c0 0x55607d2acf50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 --2- 10.20.193.28:0/2975911803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55607d28ee80 0x55607d2ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2975911803 >> 10.20.193.28:0/2975911803 conn(0x55607d2866f0 msgr2=0x55607d28cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:00.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6c7cbfc640 0 client.17175 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:00.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2975911803 shutdown_connections 2026-02-20T03:22:00.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 1 -- 10.20.193.28:0/2975911803 wait complete. 2026-02-20T03:22:00.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.838+0000 7f6cbbfd8e00 20 client.17175 trim_cache size 0 max 16384 2026-02-20T03:22:00.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:22:00.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:22:00.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:22:00.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:22:00.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 -- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c880b0e20 msgr2=0x7f6c880b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:00.844 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c880b0e20 0x7f6c880b32e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400aab0 tx=0x7f6ca4009250 comp rx=0 tx=0).stop 2026-02-20T03:22:00.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 -- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 msgr2=0x7f6cb41a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:00.845 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 0x7f6cb41a1020 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009950 tx=0x7f6ca802fdc0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 -- 10.20.193.28:0/889111225 shutdown_connections 2026-02-20T03:22:00.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c880b0e20 0x7f6c880b32e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6cb410a900 0x7f6cb41a85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6cb4109e60 0x7f6cb41a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 --2- 10.20.193.28:0/889111225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6cb4109490 0x7f6cb41a1020 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 -- 10.20.193.28:0/889111225 >> 10.20.193.28:0/889111225 conn(0x7f6cb4077fe0 msgr2=0x7f6cb410d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 -- 10.20.193.28:0/889111225 shutdown_connections 2026-02-20T03:22:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:00.839+0000 7f6cb8895640 1 -- 10.20.193.28:0/889111225 wait complete. 2026-02-20T03:22:01.485 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:01 trial028 ceph-mon[38552]: pgmap v401: 129 pgs: 129 active+clean; 133 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 437 op/s 2026-02-20T03:22:01.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 655924 8.99 MB/sec execute 214 sec latency 1440.145 ms 2026-02-20T03:22:01.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:01 trial126 ceph-mon[38476]: pgmap v401: 129 pgs: 129 active+clean; 133 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 437 op/s 2026-02-20T03:22:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:01 trial177 ceph-mon[43181]: pgmap v401: 129 pgs: 129 active+clean; 133 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.2 MiB/s wr, 437 op/s 2026-02-20T03:22:02.285 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2026-02-20T03:22:02.286 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:22:02.509 INFO:tasks.workunit.client.0.trial028.stdout: 1 655924 8.95 MB/sec execute 215 sec latency 1493.895 ms 2026-02-20T03:22:02.572 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:02.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.844+0000 7ff4390d7640 1 -- 10.20.193.28:0/2176036310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 msgr2=0x7ff434111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:02.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.844+0000 7ff4390d7640 1 --2- 10.20.193.28:0/2176036310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 0x7ff434111850 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff42800b0d0 tx=0x7ff42802f450 comp rx=0 tx=0).stop 2026-02-20T03:22:02.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.844+0000 7ff4390d7640 1 -- 10.20.193.28:0/2176036310 shutdown_connections 2026-02-20T03:22:02.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.844+0000 7ff4390d7640 1 --2- 10.20.193.28:0/2176036310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 0x7ff434111850 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:02.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.844+0000 7ff4390d7640 1 --2- 10.20.193.28:0/2176036310 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff434104980 0x7ff434104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:02.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.844+0000 7ff4390d7640 1 --2- 10.20.193.28:0/2176036310 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff43410a980 0x7ff43410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:02.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.844+0000 7ff4390d7640 1 -- 10.20.193.28:0/2176036310 >> 10.20.193.28:0/2176036310 conn(0x7ff434100680 msgr2=0x7ff434102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:02.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.844+0000 7ff4390d7640 1 -- 10.20.193.28:0/2176036310 shutdown_connections 2026-02-20T03:22:02.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.844+0000 7ff4390d7640 1 -- 10.20.193.28:0/2176036310 wait complete. 2026-02-20T03:22:02.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4390d7640 1 Processor -- start 2026-02-20T03:22:02.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4390d7640 1 -- start start 2026-02-20T03:22:02.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4390d7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff434104980 0x7ff43419d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:02.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4390d7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 0x7ff43419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4390d7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff43410a980 0x7ff4341a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4390d7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff434114c90 con 0x7ff434105320 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4390d7640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff434114b10 con 0x7ff43410a980 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4390d7640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff434114e10 con 0x7ff434104980 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4337fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 0x7ff43419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4337fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 0x7ff43419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50742/0 (socket says 10.20.193.28:50742) 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4337fe640 1 -- 10.20.193.28:0/849892648 learned_addr learned my addr 10.20.193.28:0/849892648 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4337fe640 1 -- 10.20.193.28:0/849892648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff434104980 msgr2=0x7ff43419d0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4337fe640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff434104980 0x7ff43419d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:02.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4337fe640 1 -- 10.20.193.28:0/849892648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff43410a980 msgr2=0x7ff4341a19c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:02.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4337fe640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff43410a980 0x7ff4341a19c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:02.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4337fe640 1 -- 10.20.193.28:0/849892648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4341a2140 con 0x7ff434105320 2026-02-20T03:22:02.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4337fe640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 0x7ff43419d630 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff42400b780 tx=0x7ff42400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:02.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4317fa640 1 -- 10.20.193.28:0/849892648 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424004480 con 0x7ff434105320 2026-02-20T03:22:02.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4317fa640 1 -- 10.20.193.28:0/849892648 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff424010070 con 0x7ff434105320 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.845+0000 7ff4317fa640 1 -- 10.20.193.28:0/849892648 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42400cae0 con 0x7ff434105320 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.847+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4341a2430 con 0x7ff434105320 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.847+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4341a9c70 con 0x7ff434105320 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.847+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff434104de0 con 0x7ff434105320 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.847+0000 7ff4317fa640 1 -- 10.20.193.28:0/849892648 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff42401d030 con 0x7ff434105320 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.851+0000 7ff4317fa640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff4080b0e20 0x7ff4080b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.851+0000 7ff4317fa640 1 -- 10.20.193.28:0/849892648 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff4240dfcc0 con 0x7ff434105320 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.851+0000 7ff433fff640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff4080b0e20 0x7ff4080b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.851+0000 7ff4317fa640 1 -- 10.20.193.28:0/849892648 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff4240a80a0 con 0x7ff434105320 2026-02-20T03:22:02.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.851+0000 7ff433fff640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff4080b0e20 0x7ff4080b32e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097b0 tx=0x7ff420006d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:02.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.963+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff43419e450 con 0x7ff434105320 2026-02-20T03:22:02.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.964+0000 7ff4317fa640 1 -- 10.20.193.28:0/849892648 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7ff43419e450 con 0x7ff434105320 2026-02-20T03:22:02.970 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:22:02.970 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:22:02.971 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:22:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff4080b0e20 msgr2=0x7ff4080b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:02.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff4080b0e20 0x7ff4080b32e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff4200097b0 tx=0x7ff420006d20 comp rx=0 tx=0).stop 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 msgr2=0x7ff43419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 0x7ff43419d630 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff42400b780 tx=0x7ff42400bc50 comp rx=0 tx=0).stop 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 shutdown_connections 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff4080b0e20 0x7ff4080b32e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff43410a980 0x7ff4341a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff434105320 0x7ff43419d630 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 --2- 10.20.193.28:0/849892648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff434104980 0x7ff43419d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 >> 10.20.193.28:0/849892648 conn(0x7ff434100680 msgr2=0x7ff434100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 shutdown_connections 2026-02-20T03:22:02.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:02.966+0000 7ff4390d7640 1 -- 10.20.193.28:0/849892648 wait complete. 2026-02-20T03:22:03.118 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2026-02-20T03:22:03.118 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2026-02-20T03:22:03.349 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:03 trial028 ceph-mon[38552]: pgmap v402: 129 pgs: 129 active+clean; 135 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 896 KiB/s rd, 3.2 MiB/s wr, 341 op/s 2026-02-20T03:22:03.349 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:03 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/849892648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:03.404 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:03.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 656448 8.93 MB/sec execute 216 sec latency 2387.920 ms 2026-02-20T03:22:03.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.588+0000 7f620ffff640 1 -- 10.20.193.28:0/2593394689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621010a980 msgr2=0x7f621010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:03.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.588+0000 7f620ffff640 1 --2- 10.20.193.28:0/2593394689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621010a980 0x7f621010ad60 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6204009a60 tx=0x7f620402f250 comp rx=0 tx=0).stop 2026-02-20T03:22:03.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.589+0000 7f620ffff640 1 -- 10.20.193.28:0/2593394689 shutdown_connections 2026-02-20T03:22:03.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.589+0000 7f620ffff640 1 --2- 10.20.193.28:0/2593394689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6210105320 0x7f6210111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.589+0000 7f620ffff640 1 --2- 10.20.193.28:0/2593394689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6210104980 0x7f6210104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.589+0000 7f620ffff640 1 --2- 10.20.193.28:0/2593394689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621010a980 0x7f621010ad60 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.589+0000 7f620ffff640 1 -- 10.20.193.28:0/2593394689 >> 10.20.193.28:0/2593394689 conn(0x7f6210100680 msgr2=0x7f6210102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:03.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.589+0000 7f620ffff640 1 -- 10.20.193.28:0/2593394689 shutdown_connections 2026-02-20T03:22:03.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.589+0000 7f620ffff640 1 -- 10.20.193.28:0/2593394689 wait complete. 2026-02-20T03:22:03.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.589+0000 7f620ffff640 1 Processor -- start 2026-02-20T03:22:03.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620ffff640 1 -- start start 2026-02-20T03:22:03.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6210104980 0x7f621019d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6210105320 0x7f621019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f621010a980 0x7f62101a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6210114bf0 con 0x7f6210104980 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6210114a70 con 0x7f621010a980 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6210114d70 con 0x7f6210105320 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6210104980 0x7f621019d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6210104980 0x7f621019d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50754/0 (socket says 10.20.193.28:50754) 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620effd640 1 -- 10.20.193.28:0/106348448 learned_addr learned my addr 10.20.193.28:0/106348448 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620e7fc640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6210105320 0x7f621019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620f7fe640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f621010a980 0x7f62101a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620effd640 1 -- 10.20.193.28:0/106348448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6210105320 msgr2=0x7f621019d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620effd640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6210105320 0x7f621019d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620effd640 1 -- 10.20.193.28:0/106348448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f621010a980 msgr2=0x7f62101a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620effd640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f621010a980 0x7f62101a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.590+0000 7f620effd640 1 -- 10.20.193.28:0/106348448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62101a20b0 con 0x7f6210104980 2026-02-20T03:22:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.591+0000 7f620effd640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6210104980 0x7f621019d060 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f620402fca0 tx=0x7f620402fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.591+0000 7f61effff640 1 -- 10.20.193.28:0/106348448 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040384e0 con 0x7f6210104980 2026-02-20T03:22:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.591+0000 7f61effff640 1 -- 10.20.193.28:0/106348448 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6204038770 con 0x7f6210104980 2026-02-20T03:22:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.591+0000 7f61effff640 1 -- 10.20.193.28:0/106348448 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204042680 con 0x7f6210104980 2026-02-20T03:22:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.591+0000 7f620ffff640 1 -- 10.20.193.28:0/106348448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62101a2340 con 0x7f6210104980 2026-02-20T03:22:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.591+0000 7f620ffff640 1 -- 10.20.193.28:0/106348448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62101a9be0 con 0x7f6210104980 2026-02-20T03:22:03.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:03 trial126 ceph-mon[38476]: pgmap v402: 129 pgs: 129 active+clean; 135 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 896 KiB/s rd, 3.2 MiB/s wr, 341 op/s 2026-02-20T03:22:03.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:03 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/849892648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:03.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.594+0000 7f61effff640 1 -- 10.20.193.28:0/106348448 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f620404a030 con 0x7f6210104980 2026-02-20T03:22:03.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.594+0000 7f6217836e00 1 Processor -- start 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.594+0000 7f6217836e00 1 -- start start 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.594+0000 7f6217836e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.594+0000 7f6217836e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.594+0000 7f6217836e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.594+0000 7f6217836e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558554fec410 con 0x5585550a2090 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.594+0000 7f6217836e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558554f998b0 con 0x5585550a2a10 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.594+0000 7f6217836e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558554fe8340 con 0x5585550a7c00 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550a24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50770/0 (socket says 10.20.193.28:50770) 2026-02-20T03:22:03.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620effd640 1 -- 10.20.193.28:0/1994893805 learned_addr learned my addr 10.20.193.28:0/1994893805 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620f7fe640 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620e7fc640 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620effd640 1 -- 10.20.193.28:0/1994893805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 msgr2=0x5585550a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620effd640 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620effd640 1 -- 10.20.193.28:0/1994893805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 msgr2=0x5585550ae9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620effd640 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550ae9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620effd640 1 -- 10.20.193.28:0/1994893805 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558554f8b8c0 con 0x5585550a2090 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620f7fe640 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620e7fc640 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f61effff640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e40b0e20 0x7f61e40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620effd640 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550a24d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6204108b90 tx=0x7f620410d640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79be8b67326c078b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f61effff640 1 -- 10.20.193.28:0/106348448 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6204104bf0 con 0x7f6210104980 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f61db7fe640 1 -- 10.20.193.28:0/1994893805 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6204114020 con 0x5585550a2090 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f61db7fe640 1 -- 10.20.193.28:0/1994893805 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f62040ccfd0 con 0x5585550a2090 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f61db7fe640 1 -- 10.20.193.28:0/1994893805 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62040cc6a0 con 0x5585550a2090 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.595+0000 7f620f7fe640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e40b0e20 0x7f61e40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f6217836e00 1 -- 10.20.193.28:0/1994893805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 msgr2=0x5585550a24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f6217836e00 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550a24d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6204108b90 tx=0x7f620410d640 comp rx=0 tx=0).stop 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f6217836e00 1 -- 10.20.193.28:0/1994893805 shutdown_connections 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f6217836e00 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550ae9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f6217836e00 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550a24d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f6217836e00 1 --2- 10.20.193.28:0/1994893805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f6217836e00 1 -- 10.20.193.28:0/1994893805 >> 10.20.193.28:0/1994893805 conn(0x5585550923c0 msgr2=0x5585550a0970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:03.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f6217836e00 1 -- 10.20.193.28:0/1994893805 shutdown_connections 2026-02-20T03:22:03.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f620f7fe640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e40b0e20 0x7f61e40b32e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6200009fd0 tx=0x7f6200009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:03.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.596+0000 7f6217836e00 1 -- 10.20.193.28:0/1994893805 wait complete. 2026-02-20T03:22:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.597+0000 7f6217836e00 1 -- start start 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f6217836e00 1 Processor -- start 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f6217836e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a2090 0x5585550bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f6217836e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f6217836e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a7c00 0x5585550bb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f6217836e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558554f934a0 con 0x5585550a7c00 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f6217836e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558554fec410 con 0x5585550a2a10 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f6217836e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5585550bba60 con 0x5585550a2090 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f620effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a2090 0x5585550bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f620e7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f620e7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55528/0 (socket says 10.20.193.28:55528) 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.598+0000 7f620e7fc640 1 -- 10.20.193.28:0/2062104516 learned_addr learned my addr 10.20.193.28:0/2062104516 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f620f7fe640 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a7c00 0x5585550bb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f620e7fc640 1 -- 10.20.193.28:0/2062104516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a2090 msgr2=0x5585550bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f620e7fc640 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a2090 0x5585550bcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f620e7fc640 1 -- 10.20.193.28:0/2062104516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a7c00 msgr2=0x5585550bb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f620e7fc640 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a7c00 0x5585550bb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f620e7fc640 1 -- 10.20.193.28:0/2062104516 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585550b4680 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f620effd640 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a2090 0x5585550bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f620e7fc640 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009d20 tx=0x7f61f8002ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ff5821ebe8f9786 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f61d8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f61d8ff9640 1 -- 10.20.193.28:0/2062104516 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8012540 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f6217836e00 1 -- 10.20.193.28:0/2062104516 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558554d508a0 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f61d8ff9640 1 -- 10.20.193.28:0/2062104516 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f61f8012b80 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.599+0000 7f61d8ff9640 1 -- 10.20.193.28:0/2062104516 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8010da0 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f61d8ff9640 1 -- 10.20.193.28:0/2062104516 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f61f800f3c0 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 10 client.26669 _ll_register_callbacks cb 0x558554f973d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 1 -- 10.20.193.28:0/2062104516 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558554ff4000 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f61d8ff9640 1 -- 10.20.193.28:0/2062104516 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61f8021060 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 10 client.26669 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 1 -- 10.20.193.28:0/2062104516 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x558554dbc0e0 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f61d8ff9640 1 -- 10.20.193.28:0/2062104516 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f61f8010430 con 0x5585550a2a10 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 10 client.26669 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 10 client.26669 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 20 client.26669 populate_metadata read hostname 'trial028' 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5585550cb380 0x5585550cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 4 client.26669 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.600+0000 7f6217836e00 1 -- 10.20.193.28:0/2062104516 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558554f6df60 con 0x5585550cb380 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.601+0000 7f620effd640 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5585550cb380 0x5585550cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.601+0000 7f620effd640 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5585550cb380 0x5585550cd820 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96b9624feee7c146 server_cookie=103602c45307ac95 in_seq=0 out_seq=0 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.601+0000 7f61d8ff9640 10 client.26669 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f61d8ff9640 1 -- 10.20.193.28:0/2062104516 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x558554f6df60 con 0x5585550cb380 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f61d8ff9640 10 client.26669 handle_command_reply: tid=0 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 client.26669 shutdown 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 -- 10.20.193.28:0/2062104516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 msgr2=0x5585550bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009d20 tx=0x7f61f8002ab0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 -- 10.20.193.28:0/2062104516 shutdown_connections 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5585550cb380 0x5585550cd820 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a7c00 0x5585550bb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 --2- 10.20.193.28:0/2062104516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a2090 0x5585550bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 -- 10.20.193.28:0/2062104516 >> 10.20.193.28:0/2062104516 conn(0x5585550923c0 msgr2=0x5585550a1190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f61d8ff9640 0 client.26669 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.602+0000 7f6217836e00 1 -- 10.20.193.28:0/2062104516 shutdown_connections 2026-02-20T03:22:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.603+0000 7f6217836e00 1 -- 10.20.193.28:0/2062104516 wait complete. 2026-02-20T03:22:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.603+0000 7f6217836e00 20 client.26669 trim_cache size 0 max 16384 2026-02-20T03:22:03.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f6217836e00 1 Processor -- start 2026-02-20T03:22:03.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f6217836e00 1 -- start start 2026-02-20T03:22:03.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f6217836e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f6217836e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f6217836e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f6217836e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f61b40126e0 con 0x5585550a2090 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f6217836e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f61b400ffb0 con 0x5585550a2a10 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f6217836e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61b400de00 con 0x5585550a7c00 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f620e7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f620effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f620e7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55536/0 (socket says 10.20.193.28:55536) 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.611+0000 7f620e7fc640 1 -- 10.20.193.28:0/2029795284 learned_addr learned my addr 10.20.193.28:0/2029795284 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f620f7fe640 1 --2- 10.20.193.28:0/2029795284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f620e7fc640 1 -- 10.20.193.28:0/2029795284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 msgr2=0x5585550b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:03.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f620e7fc640 1 --2- 10.20.193.28:0/2029795284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f620e7fc640 1 -- 10.20.193.28:0/2029795284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 msgr2=0x5585550bcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:03.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f620e7fc640 1 --2- 10.20.193.28:0/2029795284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550bcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f620e7fc640 1 -- 10.20.193.28:0/2029795284 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585550a8350 con 0x5585550a2a10 2026-02-20T03:22:03.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f620e7fc640 1 --2- 10.20.193.28:0/2029795284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f61f80126a0 tx=0x7f61f801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cf0089551c8b3b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:03.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f61daffd640 1 -- 10.20.193.28:0/2029795284 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8030020 con 0x5585550a2a10 2026-02-20T03:22:03.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f61daffd640 1 -- 10.20.193.28:0/2029795284 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x558554ff4000 con 0x5585550a2a10 2026-02-20T03:22:03.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f61daffd640 1 -- 10.20.193.28:0/2029795284 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f80105b0 con 0x5585550a2a10 2026-02-20T03:22:03.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f6217836e00 1 -- 10.20.193.28:0/2029795284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 msgr2=0x5585550bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:03.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.612+0000 7f6217836e00 1 --2- 10.20.193.28:0/2029795284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f61f80126a0 tx=0x7f61f801f000 comp rx=0 tx=0).stop 2026-02-20T03:22:03.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.613+0000 7f6217836e00 1 -- 10.20.193.28:0/2029795284 shutdown_connections 2026-02-20T03:22:03.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.613+0000 7f6217836e00 1 --2- 10.20.193.28:0/2029795284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.613+0000 7f6217836e00 1 --2- 10.20.193.28:0/2029795284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bd400 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.613+0000 7f6217836e00 1 --2- 10.20.193.28:0/2029795284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550bcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.613+0000 7f6217836e00 1 -- 10.20.193.28:0/2029795284 >> 10.20.193.28:0/2029795284 conn(0x5585550923c0 msgr2=0x5585550a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.613+0000 7f6217836e00 1 -- 10.20.193.28:0/2029795284 shutdown_connections 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.613+0000 7f6217836e00 1 -- 10.20.193.28:0/2029795284 wait complete. 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.613+0000 7f6217836e00 1 -- start start 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.613+0000 7f6217836e00 1 Processor -- start 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f6217836e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f6217836e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f6217836e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f6217836e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f61b400e470 con 0x5585550a2090 2026-02-20T03:22:03.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f6217836e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f61b400f8e0 con 0x5585550a2a10 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f6217836e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f61b400eb40 con 0x5585550a7c00 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550bfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:41078/0 (socket says 10.20.193.28:41078) 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620f7fe640 1 -- 10.20.193.28:0/622690815 learned_addr learned my addr 10.20.193.28:0/622690815 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620e7fc640 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620f7fe640 1 -- 10.20.193.28:0/622690815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 msgr2=0x5585550bf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620f7fe640 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620f7fe640 1 -- 10.20.193.28:0/622690815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 msgr2=0x5585550c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620f7fe640 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620f7fe640 1 -- 10.20.193.28:0/622690815 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585550b44b0 con 0x5585550a7c00 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.614+0000 7f620e7fc640 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f620f7fe640 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550bfc10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6200009080 tx=0x7f6200004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e357d633aa0400b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f61d8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f61d8ff9640 1 -- 10.20.193.28:0/622690815 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200018b80 con 0x5585550a7c00 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f61d8ff9640 1 -- 10.20.193.28:0/622690815 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f620002a070 con 0x5585550a7c00 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f6217836e00 1 -- 10.20.193.28:0/622690815 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585550b4070 con 0x5585550a7c00 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f6217836e00 10 client.26695 _ll_register_callbacks cb 0x7f61f8009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f61d8ff9640 1 -- 10.20.193.28:0/622690815 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200025680 con 0x5585550a7c00 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f6217836e00 1 -- 10.20.193.28:0/622690815 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5585550b1a50 con 0x5585550a7c00 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f61d8ff9640 1 -- 10.20.193.28:0/622690815 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6200016460 con 0x5585550a7c00 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f61d8ff9640 1 -- 10.20.193.28:0/622690815 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6200016720 con 0x5585550a7c00 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f6217836e00 10 client.26695 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.615+0000 7f6217836e00 1 -- 10.20.193.28:0/622690815 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x558554d6d7f0 con 0x5585550a7c00 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.616+0000 7f61d8ff9640 1 -- 10.20.193.28:0/622690815 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6200025820 con 0x5585550a7c00 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.616+0000 7f6217836e00 10 client.26695 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:03.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.616+0000 7f6217836e00 10 client.26695 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:22:03.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.616+0000 7f6217836e00 20 client.26695 populate_metadata read hostname 'trial028' 2026-02-20T03:22:03.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.616+0000 7f6217836e00 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558555137430 0x5585551398f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:03.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.616+0000 7f6217836e00 4 client.26695 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2026-02-20T03:22:03.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.616+0000 7f6217836e00 1 -- 10.20.193.28:0/622690815 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x558554ff9db0 con 0x558555137430 2026-02-20T03:22:03.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.616+0000 7f620effd640 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558555137430 0x5585551398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:03.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.617+0000 7f620effd640 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558555137430 0x5585551398f0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af858c091345d6d5 server_cookie=aeb77a27648e4653 in_seq=0 out_seq=0 2026-02-20T03:22:03.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.617+0000 7f61d8ff9640 10 client.26695 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:03.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f61d8ff9640 1 -- 10.20.193.28:0/622690815 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558554ff9db0 con 0x558555137430 2026-02-20T03:22:03.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f61d8ff9640 10 client.26695 handle_command_reply: tid=0 2026-02-20T03:22:03.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 client.26695 shutdown 2026-02-20T03:22:03.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 -- 10.20.193.28:0/622690815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 msgr2=0x5585550bfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:03.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550bfc10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6200009080 tx=0x7f6200004b40 comp rx=0 tx=0).stop 2026-02-20T03:22:03.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 -- 10.20.193.28:0/622690815 shutdown_connections 2026-02-20T03:22:03.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558555137430 0x5585551398f0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5585550a7c00 0x5585550bfc10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5585550a2a10 0x5585550bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 --2- 10.20.193.28:0/622690815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5585550a2090 0x5585550c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 -- 10.20.193.28:0/622690815 >> 10.20.193.28:0/622690815 conn(0x5585550923c0 msgr2=0x5585550a55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f61d8ff9640 0 client.26695 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 -- 10.20.193.28:0/622690815 shutdown_connections 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.668+0000 7f6217836e00 1 -- 10.20.193.28:0/622690815 wait complete. 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f6217836e00 20 client.26695 trim_cache size 0 max 16384 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 22, 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stdout: "764c82a8": { 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stdout: "version": 22, 2026-02-20T03:22:03.672 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 140.5, 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:03.673 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 -- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e40b0e20 msgr2=0x7f61e40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e40b0e20 0x7f61e40b32e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6200009fd0 tx=0x7f6200009920 comp rx=0 tx=0).stop 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 -- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6210104980 msgr2=0x7f621019d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6210104980 0x7f621019d060 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f620402fca0 tx=0x7f620402fcd0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 -- 10.20.193.28:0/106348448 shutdown_connections 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e40b0e20 0x7f61e40b32e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f621010a980 0x7f62101a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6210105320 0x7f621019d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 --2- 10.20.193.28:0/106348448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6210104980 0x7f621019d060 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.669+0000 7f620ffff640 1 -- 10.20.193.28:0/106348448 >> 10.20.193.28:0/106348448 conn(0x7f6210100680 msgr2=0x7f6210101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.670+0000 7f620ffff640 1 -- 10.20.193.28:0/106348448 shutdown_connections 2026-02-20T03:22:03.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:03.670+0000 7f620ffff640 1 -- 10.20.193.28:0/106348448 wait complete. 2026-02-20T03:22:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:03 trial177 ceph-mon[43181]: pgmap v402: 129 pgs: 129 active+clean; 135 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 896 KiB/s rd, 3.2 MiB/s wr, 341 op/s 2026-02-20T03:22:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:03 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/849892648' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:03.830 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '764c82a8', quiesce took 1.5 seconds. Will release after: 19.0 2026-02-20T03:22:04.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.91 MB/sec execute 217 sec latency 860.241 ms 2026-02-20T03:22:05.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:05 trial028 ceph-mon[38552]: pgmap v403: 129 pgs: 129 active+clean; 134 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 968 KiB/s rd, 3.5 MiB/s wr, 375 op/s 2026-02-20T03:22:05.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.87 MB/sec execute 218 sec latency 1860.292 ms 2026-02-20T03:22:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:05 trial177 ceph-mon[43181]: pgmap v403: 129 pgs: 129 active+clean; 134 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 968 KiB/s rd, 3.5 MiB/s wr, 375 op/s 2026-02-20T03:22:05.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:05 trial126 ceph-mon[38476]: pgmap v403: 129 pgs: 129 active+clean; 134 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 968 KiB/s rd, 3.5 MiB/s wr, 375 op/s 2026-02-20T03:22:06.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.83 MB/sec execute 219 sec latency 2860.339 ms 2026-02-20T03:22:06.771 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:22:07.058 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:07.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- 10.20.193.28:0/731328222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181134d0 msgr2=0x7f2018115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:07.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 --2- 10.20.193.28:0/731328222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181134d0 0x7f2018115900 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f201400b0a0 tx=0x7f201402f4e0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- 10.20.193.28:0/731328222 shutdown_connections 2026-02-20T03:22:07.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 --2- 10.20.193.28:0/731328222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181134d0 0x7f2018115900 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 --2- 10.20.193.28:0/731328222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2018075950 0x7f2018075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 --2- 10.20.193.28:0/731328222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20181065d0 0x7f2018075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- 10.20.193.28:0/731328222 >> 10.20.193.28:0/731328222 conn(0x7f20180fe440 msgr2=0x7f2018100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- 10.20.193.28:0/731328222 shutdown_connections 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- 10.20.193.28:0/731328222 wait complete. 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 Processor -- start 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- start start 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2018075950 0x7f20181a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181065d0 0x7f20181a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20181134d0 0x7f20181a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f20181191d0 con 0x7f20181065d0 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2018119050 con 0x7f20181134d0 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2018119350 con 0x7f2018075950 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201db0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181065d0 0x7f20181a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201db0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181065d0 0x7f20181a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60264/0 (socket says 10.20.193.28:60264) 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201db0f640 1 -- 10.20.193.28:0/2799073450 learned_addr learned my addr 10.20.193.28:0/2799073450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201db0f640 1 -- 10.20.193.28:0/2799073450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2018075950 msgr2=0x7f20181a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201db0f640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2018075950 0x7f20181a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201db0f640 1 -- 10.20.193.28:0/2799073450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20181134d0 msgr2=0x7f20181a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201db0f640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20181134d0 0x7f20181a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201db0f640 1 -- 10.20.193.28:0/2799073450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20181a66c0 con 0x7f20181065d0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201db0f640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181065d0 0x7f20181a1bb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f200c00b570 tx=0x7f200c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f1fff7fe640 1 -- 10.20.193.28:0/2799073450 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c013020 con 0x7f20181065d0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- 10.20.193.28:0/2799073450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20181a69b0 con 0x7f20181065d0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f201f312640 1 -- 10.20.193.28:0/2799073450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20181ae1f0 con 0x7f20181065d0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f1fff7fe640 1 -- 10.20.193.28:0/2799073450 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f200c004480 con 0x7f20181065d0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.298+0000 7f1fff7fe640 1 -- 10.20.193.28:0/2799073450 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c013020 con 0x7f20181065d0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f1fff7fe640 1 -- 10.20.193.28:0/2799073450 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f200c00fa80 con 0x7f20181065d0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 Processor -- start 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 -- start start 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c8a000 0x5648b5c8a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c84630 0x5648b5c84a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c90e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5648b5c04e50 con 0x5648b5c84fb0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5648b5bd79c0 con 0x5648b5c84630 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5648b5b85240 con 0x5648b5c8a000 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f1fff7fe640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ff40b1020 0x7f1ff40b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f1fff7fe640 1 -- 10.20.193.28:0/2799073450 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f200c0e0220 con 0x7f20181065d0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201eb11640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ff40b1020 0x7f1ff40b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201db0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c90e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201db0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c90e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60274/0 (socket says 10.20.193.28:60274) 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201db0f640 1 -- 10.20.193.28:0/1362599834 learned_addr learned my addr 10.20.193.28:0/1362599834 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201db0f640 1 -- 10.20.193.28:0/1362599834 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c8a000 msgr2=0x5648b5c8a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201db0f640 1 --2- 10.20.193.28:0/1362599834 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c8a000 0x5648b5c8a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201db0f640 1 -- 10.20.193.28:0/1362599834 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c84630 msgr2=0x5648b5c84a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201db0f640 1 --2- 10.20.193.28:0/1362599834 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c84630 0x5648b5c84a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201db0f640 1 -- 10.20.193.28:0/1362599834 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b5b98420 con 0x5648b5c84fb0 2026-02-20T03:22:07.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201db0f640 1 --2- 10.20.193.28:0/1362599834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c90e30 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f200c0dd800 tx=0x7f200c00f560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d9751fcdcea612 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f201eb11640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ff40b1020 0x7f1ff40b34e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2014007600 tx=0x7f2014005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f1ffccf3640 1 -- 10.20.193.28:0/1362599834 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0ad210 con 0x5648b5c84fb0 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f1ffccf3640 1 -- 10.20.193.28:0/1362599834 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f200c0b20c0 con 0x5648b5c84fb0 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f1ffccf3640 1 -- 10.20.193.28:0/1362599834 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0a80d0 con 0x5648b5c84fb0 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1362599834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 msgr2=0x5648b5c90e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/1362599834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c90e30 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f200c0dd800 tx=0x7f200c00f560 comp rx=0 tx=0).stop 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1362599834 shutdown_connections 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/1362599834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c90e30 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/1362599834 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c84630 0x5648b5c84a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/1362599834 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c8a000 0x5648b5c8a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1362599834 >> 10.20.193.28:0/1362599834 conn(0x5648b5c47290 msgr2=0x5648b5c82d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1362599834 shutdown_connections 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.303+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1362599834 wait complete. 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.308+0000 7f2022aa0e00 1 -- start start 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.308+0000 7f2022aa0e00 1 Processor -- start 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c84630 0x5648b5c9ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c9f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c8a000 0x5648b5c9d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5648b5bd38f0 con 0x5648b5c84fb0 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5648b59c5f50 con 0x5648b5c84630 2026-02-20T03:22:07.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5648b5c9de40 con 0x5648b5c8a000 2026-02-20T03:22:07.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f201db0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c9f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:07.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f201db0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c9f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60286/0 (socket says 10.20.193.28:60286) 2026-02-20T03:22:07.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f201db0f640 1 -- 10.20.193.28:0/126351204 learned_addr learned my addr 10.20.193.28:0/126351204 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:07.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f201db0f640 1 -- 10.20.193.28:0/126351204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c8a000 msgr2=0x5648b5c9d6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:07.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f201db0f640 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c8a000 0x5648b5c9d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f201db0f640 1 -- 10.20.193.28:0/126351204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c84630 msgr2=0x5648b5c9ef80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:07.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f201db0f640 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c84630 0x5648b5c9ef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f201db0f640 1 -- 10.20.193.28:0/126351204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b5c96b20 con 0x5648b5c84fb0 2026-02-20T03:22:07.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f201db0f640 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c9f4c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f200c0e0190 tx=0x7f200c0a5170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e3b8cca965cca7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f1fc3fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f1fc3fff640 1 -- 10.20.193.28:0/126351204 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0a4ea0 con 0x5648b5c84fb0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f1fc3fff640 1 -- 10.20.193.28:0/126351204 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f200c0ad210 con 0x5648b5c84fb0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f1fc3fff640 1 -- 10.20.193.28:0/126351204 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0cf1c0 con 0x5648b5c84fb0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 -- 10.20.193.28:0/126351204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b59a8b40 con 0x5648b5c84fb0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f1fc3fff640 1 -- 10.20.193.28:0/126351204 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f200c0c0020 con 0x5648b5c84fb0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 10 client.17211 _ll_register_callbacks cb 0x5648b5c10f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 -- 10.20.193.28:0/126351204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5648b5be51a0 con 0x5648b5c84fb0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f1fc3fff640 1 -- 10.20.193.28:0/126351204 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f200c08fdd0 con 0x5648b5c84fb0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 10 client.17211 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 -- 10.20.193.28:0/126351204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5648b5b92230 con 0x5648b5c84fb0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f1fc3fff640 1 -- 10.20.193.28:0/126351204 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f200c0cf360 con 0x5648b5c84fb0 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 10 client.17211 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 10 client.17211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 20 client.17211 populate_metadata read hostname 'trial028' 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5648b5cad330 0x5648b5caf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 4 client.17211 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:07.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.309+0000 7f2022aa0e00 1 -- 10.20.193.28:0/126351204 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648b5bdf5b0 con 0x5648b5cad330 2026-02-20T03:22:07.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.336+0000 7f201e310640 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5648b5cad330 0x5648b5caf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:07.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.377+0000 7f201e310640 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5648b5cad330 0x5648b5caf720 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10f45ca9f20e1a2f server_cookie=6ee9f833c9a6150c in_seq=0 out_seq=0 2026-02-20T03:22:07.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.377+0000 7f1fc3fff640 10 client.17211 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:07.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.390+0000 7f1fc3fff640 1 -- 10.20.193.28:0/126351204 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5648b5bdf5b0 con 0x5648b5cad330 2026-02-20T03:22:07.393 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:07 trial028 ceph-mon[38552]: pgmap v404: 129 pgs: 129 active+clean; 130 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 730 KiB/s rd, 3.4 MiB/s wr, 345 op/s 2026-02-20T03:22:07.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.390+0000 7f1fc3fff640 10 client.17211 handle_command_reply: tid=0 2026-02-20T03:22:07.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.390+0000 7f2022aa0e00 1 client.17211 shutdown 2026-02-20T03:22:07.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 -- 10.20.193.28:0/126351204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 msgr2=0x5648b5c9f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:07.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c9f4c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f200c0e0190 tx=0x7f200c0a5170 comp rx=0 tx=0).stop 2026-02-20T03:22:07.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 -- 10.20.193.28:0/126351204 shutdown_connections 2026-02-20T03:22:07.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5648b5cad330 0x5648b5caf720 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c8a000 0x5648b5c9d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5c9f4c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/126351204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c84630 0x5648b5c9ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f1fc3fff640 0 client.17211 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:07.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 -- 10.20.193.28:0/126351204 >> 10.20.193.28:0/126351204 conn(0x5648b5c47290 msgr2=0x5648b5c83440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:07.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 -- 10.20.193.28:0/126351204 shutdown_connections 2026-02-20T03:22:07.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 1 -- 10.20.193.28:0/126351204 wait complete. 2026-02-20T03:22:07.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.391+0000 7f2022aa0e00 20 client.17211 trim_cache size 0 max 16384 2026-02-20T03:22:07.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 Processor -- start 2026-02-20T03:22:07.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 -- start start 2026-02-20T03:22:07.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c84630 0x5648b5cb4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5cb54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c8a000 0x5648b5ca4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0126f0 con 0x5648b5c84fb0 2026-02-20T03:22:07.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc00ffc0 con 0x5648b5c8a000 2026-02-20T03:22:07.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc00de10 con 0x5648b5c84630 2026-02-20T03:22:07.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f201db0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5cb54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f201db0f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5cb54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60302/0 (socket says 10.20.193.28:60302) 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f201db0f640 1 -- 10.20.193.28:0/1352218615 learned_addr learned my addr 10.20.193.28:0/1352218615 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f201db0f640 1 -- 10.20.193.28:0/1352218615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c84630 msgr2=0x5648b5cb4fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f201db0f640 1 --2- 10.20.193.28:0/1352218615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c84630 0x5648b5cb4fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f201db0f640 1 -- 10.20.193.28:0/1352218615 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c8a000 msgr2=0x5648b5ca4e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f201db0f640 1 --2- 10.20.193.28:0/1352218615 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c8a000 0x5648b5ca4e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f201db0f640 1 -- 10.20.193.28:0/1352218615 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b5c96950 con 0x5648b5c84fb0 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f201db0f640 1 --2- 10.20.193.28:0/1352218615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5cb54e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f200c0a5e80 tx=0x7f200c0c9f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3ea4c50e6d1f9a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f1fe64e6640 1 -- 10.20.193.28:0/1352218615 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0c8060 con 0x5648b5c84fb0 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f1fe64e6640 1 -- 10.20.193.28:0/1352218615 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5648b5be51a0 con 0x5648b5c84fb0 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f1fe64e6640 1 -- 10.20.193.28:0/1352218615 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c0cf4c0 con 0x5648b5c84fb0 2026-02-20T03:22:07.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1352218615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 msgr2=0x5648b5cb54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:07.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/1352218615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5cb54e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f200c0a5e80 tx=0x7f200c0c9f90 comp rx=0 tx=0).stop 2026-02-20T03:22:07.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1352218615 shutdown_connections 2026-02-20T03:22:07.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/1352218615 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c8a000 0x5648b5ca4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/1352218615 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84fb0 0x5648b5cb54e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/1352218615 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c84630 0x5648b5cb4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1352218615 >> 10.20.193.28:0/1352218615 conn(0x5648b5c47290 msgr2=0x5648b5c9c630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:07.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1352218615 shutdown_connections 2026-02-20T03:22:07.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.396+0000 7f2022aa0e00 1 -- 10.20.193.28:0/1352218615 wait complete. 2026-02-20T03:22:07.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 -- start start 2026-02-20T03:22:07.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 Processor -- start 2026-02-20T03:22:07.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84630 0x5648b5ca3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c84fb0 0x5648b5ca4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c8a000 0x5648b5ca4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc00e480 con 0x5648b5c84630 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc00f8f0 con 0x5648b5c8a000 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc00eb50 con 0x5648b5c84fb0 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f201e310640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84630 0x5648b5ca3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f201e310640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84630 0x5648b5ca3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60318/0 (socket says 10.20.193.28:60318) 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f201e310640 1 -- 10.20.193.28:0/3919855962 learned_addr learned my addr 10.20.193.28:0/3919855962 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f201e310640 1 -- 10.20.193.28:0/3919855962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c84fb0 msgr2=0x5648b5ca4400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f201e310640 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c84fb0 0x5648b5ca4400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f201e310640 1 -- 10.20.193.28:0/3919855962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c8a000 msgr2=0x5648b5ca4940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:07.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f201e310640 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c8a000 0x5648b5ca4940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f201e310640 1 -- 10.20.193.28:0/3919855962 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b58b6870 con 0x5648b5c84630 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f201e310640 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84630 0x5648b5ca3ec0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x5648b5caff40 tx=0x7f2008009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bcf46727b3136f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f1fcbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f1fcbfff640 1 -- 10.20.193.28:0/3919855962 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200801e070 con 0x5648b5c84630 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f1fcbfff640 1 -- 10.20.193.28:0/3919855962 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2008009e80 con 0x5648b5c84630 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 -- 10.20.193.28:0/3919855962 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b5b77440 con 0x5648b5c84630 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 10 client.17217 _ll_register_callbacks cb 0x7f200c0a8560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 -- 10.20.193.28:0/3919855962 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5648b5ba8810 con 0x5648b5c84630 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f1fcbfff640 1 -- 10.20.193.28:0/3919855962 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008015040 con 0x5648b5c84630 2026-02-20T03:22:07.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f1fcbfff640 1 -- 10.20.193.28:0/3919855962 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2008013340 con 0x5648b5c84630 2026-02-20T03:22:07.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f1fcbfff640 1 -- 10.20.193.28:0/3919855962 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2008028050 con 0x5648b5c84630 2026-02-20T03:22:07.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 10 client.17217 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:07.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 -- 10.20.193.28:0/3919855962 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5648b5c97640 con 0x5648b5c84630 2026-02-20T03:22:07.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f1fcbfff640 1 -- 10.20.193.28:0/3919855962 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f200802b020 con 0x5648b5c84630 2026-02-20T03:22:07.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 10 client.17217 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:07.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:07.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 20 client.17217 populate_metadata read hostname 'trial028' 2026-02-20T03:22:07.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5648b5d198b0 0x5648b5d1bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:07.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 4 client.17217 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:22:07.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.401+0000 7f2022aa0e00 1 -- 10.20.193.28:0/3919855962 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5648b5b89b00 con 0x5648b5d198b0 2026-02-20T03:22:07.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.404+0000 7f201db0f640 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5648b5d198b0 0x5648b5d1bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:07.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.471+0000 7f201db0f640 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5648b5d198b0 0x5648b5d1bd70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2905bd5ecb90c631 server_cookie=a9dc269e4168bf18 in_seq=0 out_seq=0 2026-02-20T03:22:07.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.471+0000 7f1fcbfff640 10 client.17217 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:07.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f1fcbfff640 1 -- 10.20.193.28:0/3919855962 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5648b5b89b00 con 0x5648b5d198b0 2026-02-20T03:22:07.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f1fcbfff640 10 client.17217 handle_command_reply: tid=0 2026-02-20T03:22:07.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 client.17217 shutdown 2026-02-20T03:22:07.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 -- 10.20.193.28:0/3919855962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84630 msgr2=0x5648b5ca3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:07.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84630 0x5648b5ca3ec0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x5648b5caff40 tx=0x7f2008009390 comp rx=0 tx=0).stop 2026-02-20T03:22:07.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 -- 10.20.193.28:0/3919855962 shutdown_connections 2026-02-20T03:22:07.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5648b5d198b0 0x5648b5d1bd70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5648b5c8a000 0x5648b5ca4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5648b5c84fb0 0x5648b5ca4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 --2- 10.20.193.28:0/3919855962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5648b5c84630 0x5648b5ca3ec0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 -- 10.20.193.28:0/3919855962 >> 10.20.193.28:0/3919855962 conn(0x5648b5c47290 msgr2=0x5648b5cad710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f1fcbfff640 0 client.17217 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 -- 10.20.193.28:0/3919855962 shutdown_connections 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 1 -- 10.20.193.28:0/3919855962 wait complete. 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f2022aa0e00 20 client.17217 trim_cache size 0 max 16384 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:22:07.487 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 -- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ff40b1020 msgr2=0x7f1ff40b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ff40b1020 0x7f1ff40b34e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2014007600 tx=0x7f2014005bd0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 -- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181065d0 msgr2=0x7f20181a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181065d0 0x7f20181a1bb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f200c00b570 tx=0x7f200c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 -- 10.20.193.28:0/2799073450 shutdown_connections 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ff40b1020 0x7f1ff40b34e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f20181134d0 0x7f20181a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f20181065d0 0x7f20181a1bb0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 --2- 10.20.193.28:0/2799073450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2018075950 0x7f20181a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 -- 10.20.193.28:0/2799073450 >> 10.20.193.28:0/2799073450 conn(0x7f20180fe440 msgr2=0x7f2018114cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 -- 10.20.193.28:0/2799073450 shutdown_connections 2026-02-20T03:22:07.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:07.484+0000 7f201f312640 1 -- 10.20.193.28:0/2799073450 wait complete. 2026-02-20T03:22:07.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.79 MB/sec execute 220 sec latency 3860.371 ms 2026-02-20T03:22:07.682 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:22:07.683 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:22:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:07 trial177 ceph-mon[43181]: pgmap v404: 129 pgs: 129 active+clean; 130 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 730 KiB/s rd, 3.4 MiB/s wr, 345 op/s 2026-02-20T03:22:07.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:07 trial126 ceph-mon[38476]: pgmap v404: 129 pgs: 129 active+clean; 130 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 730 KiB/s rd, 3.4 MiB/s wr, 345 op/s 2026-02-20T03:22:08.019 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:08.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- 10.20.193.28:0/2695902961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c10f0c0 msgr2=0x7f855c1114b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 --2- 10.20.193.28:0/2695902961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c10f0c0 0x7f855c1114b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f855000b0a0 tx=0x7f855002f450 comp rx=0 tx=0).stop 2026-02-20T03:22:08.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- 10.20.193.28:0/2695902961 shutdown_connections 2026-02-20T03:22:08.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 --2- 10.20.193.28:0/2695902961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c10f0c0 0x7f855c1114b0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 --2- 10.20.193.28:0/2695902961 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f855c075d40 0x7f855c10eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 --2- 10.20.193.28:0/2695902961 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f855c075390 0x7f855c075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- 10.20.193.28:0/2695902961 >> 10.20.193.28:0/2695902961 conn(0x7f855c0fe3e0 msgr2=0x7f855c100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:08.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- 10.20.193.28:0/2695902961 shutdown_connections 2026-02-20T03:22:08.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- 10.20.193.28:0/2695902961 wait complete. 2026-02-20T03:22:08.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 Processor -- start 2026-02-20T03:22:08.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- start start 2026-02-20T03:22:08.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c075390 0x7f855c19d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f855c075d40 0x7f855c19d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f855c10f0c0 0x7f855c1a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f855c114ce0 con 0x7f855c075390 2026-02-20T03:22:08.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f855c114b60 con 0x7f855c10f0c0 2026-02-20T03:22:08.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f855c114e60 con 0x7f855c075d40 2026-02-20T03:22:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f855bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c075390 0x7f855c19d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f855bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c075390 0x7f855c19d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60336/0 (socket says 10.20.193.28:60336) 2026-02-20T03:22:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f855bfff640 1 -- 10.20.193.28:0/4169851589 learned_addr learned my addr 10.20.193.28:0/4169851589 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f855bfff640 1 -- 10.20.193.28:0/4169851589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f855c075d40 msgr2=0x7f855c19d5c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f855bfff640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f855c075d40 0x7f855c19d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f855bfff640 1 -- 10.20.193.28:0/4169851589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f855c10f0c0 msgr2=0x7f855c1a1950 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f855bfff640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f855c10f0c0 0x7f855c1a1950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f855bfff640 1 -- 10.20.193.28:0/4169851589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c1a20d0 con 0x7f855c075390 2026-02-20T03:22:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f855bfff640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c075390 0x7f855c19d080 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f854800b570 tx=0x7f854800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85597fa640 1 -- 10.20.193.28:0/4169851589 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548013020 con 0x7f855c075390 2026-02-20T03:22:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85597fa640 1 -- 10.20.193.28:0/4169851589 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8548004480 con 0x7f855c075390 2026-02-20T03:22:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85597fa640 1 -- 10.20.193.28:0/4169851589 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854800fb50 con 0x7f855c075390 2026-02-20T03:22:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c1a23c0 con 0x7f855c075390 2026-02-20T03:22:08.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.269+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c1a9c00 con 0x7f855c075390 2026-02-20T03:22:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.274+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c075770 con 0x7f855c075390 2026-02-20T03:22:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.274+0000 7f85597fa640 1 -- 10.20.193.28:0/4169851589 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8548002780 con 0x7f855c075390 2026-02-20T03:22:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.274+0000 7f85597fa640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85300b0e20 0x7f85300b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.274+0000 7f85597fa640 1 -- 10.20.193.28:0/4169851589 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f85480e0c10 con 0x7f855c075390 2026-02-20T03:22:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.274+0000 7f85597fa640 1 -- 10.20.193.28:0/4169851589 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f854801d020 con 0x7f855c075390 2026-02-20T03:22:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.274+0000 7f855b7fe640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85300b0e20 0x7f85300b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.274+0000 7f855b7fe640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85300b0e20 0x7f85300b32e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f855c101f50 tx=0x7f854c006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:08.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.383+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f855c19e3e0 con 0x7f855c075390 2026-02-20T03:22:08.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85597fa640 1 -- 10.20.193.28:0/4169851589 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f85480a8ff0 con 0x7f855c075390 2026-02-20T03:22:08.388 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:22:08.390 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:22:08.391 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:22:08.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85300b0e20 msgr2=0x7f85300b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85300b0e20 0x7f85300b32e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f855c101f50 tx=0x7f854c006cd0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c075390 msgr2=0x7f855c19d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c075390 0x7f855c19d080 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f854800b570 tx=0x7f854800ba40 comp rx=0 tx=0).stop 2026-02-20T03:22:08.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 shutdown_connections 2026-02-20T03:22:08.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85300b0e20 0x7f85300b32e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f855c10f0c0 0x7f855c1a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f855c075d40 0x7f855c19d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 --2- 10.20.193.28:0/4169851589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f855c075390 0x7f855c19d080 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 >> 10.20.193.28:0/4169851589 conn(0x7f855c0fe3e0 msgr2=0x7f855c0fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:08.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 shutdown_connections 2026-02-20T03:22:08.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.386+0000 7f85617fc640 1 -- 10.20.193.28:0/4169851589 wait complete. 2026-02-20T03:22:08.468 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:22:08.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.75 MB/sec execute 221 sec latency 4860.413 ms 2026-02-20T03:22:08.761 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.942+0000 7f9a07c32640 1 -- 10.20.193.28:0/3204268234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a00109ed0 msgr2=0x7f9a00111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.942+0000 7f9a07c32640 1 --2- 10.20.193.28:0/3204268234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a00109ed0 0x7f9a00111a50 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00b0a0 tx=0x7f99fc02f410 comp rx=0 tx=0).stop 2026-02-20T03:22:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.942+0000 7f9a07c32640 1 -- 10.20.193.28:0/3204268234 shutdown_connections 2026-02-20T03:22:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.942+0000 7f9a07c32640 1 --2- 10.20.193.28:0/3204268234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a00109ed0 0x7f9a00111a50 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.942+0000 7f9a07c32640 1 --2- 10.20.193.28:0/3204268234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a00105750 0x7f9a001097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.942+0000 7f9a07c32640 1 --2- 10.20.193.28:0/3204268234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a00104da0 0x7f9a00105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.942+0000 7f9a07c32640 1 -- 10.20.193.28:0/3204268234 >> 10.20.193.28:0/3204268234 conn(0x7f9a00100840 msgr2=0x7f9a00102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.942+0000 7f9a07c32640 1 -- 10.20.193.28:0/3204268234 shutdown_connections 2026-02-20T03:22:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.942+0000 7f9a07c32640 1 -- 10.20.193.28:0/3204268234 wait complete. 2026-02-20T03:22:08.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a07c32640 1 Processor -- start 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a07c32640 1 -- start start 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a07c32640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a00104da0 0x7f9a0019d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a07c32640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a00105750 0x7f9a0019d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a07c32640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a00109ed0 0x7f9a001a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a07c32640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00114da0 con 0x7f9a00105750 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a07c32640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00114c20 con 0x7f9a00109ed0 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a07c32640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9a00114f20 con 0x7f9a00104da0 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a051a6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a00105750 0x7f9a0019d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a061a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a00109ed0 0x7f9a001a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a061a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a00109ed0 0x7f9a001a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54682/0 (socket says 10.20.193.28:54682) 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a061a8640 1 -- 10.20.193.28:0/1706877782 learned_addr learned my addr 10.20.193.28:0/1706877782 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.943+0000 7f9a059a7640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a00104da0 0x7f9a0019d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f9a061a8640 1 -- 10.20.193.28:0/1706877782 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a00104da0 msgr2=0x7f9a0019d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f9a061a8640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a00104da0 0x7f9a0019d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f9a061a8640 1 -- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a00105750 msgr2=0x7f9a0019d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f9a061a8640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a00105750 0x7f9a0019d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f9a061a8640 1 -- 10.20.193.28:0/1706877782 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a001a2250 con 0x7f9a00109ed0 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f9a051a6640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a00105750 0x7f9a0019d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f9a061a8640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a00109ed0 0x7f9a001a1ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f99fc006030 tx=0x7f99fc009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f99eeffd640 1 -- 10.20.193.28:0/1706877782 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc046070 con 0x7f9a00109ed0 2026-02-20T03:22:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f9a07c32640 1 -- 10.20.193.28:0/1706877782 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a001a24e0 con 0x7f9a00109ed0 2026-02-20T03:22:08.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f99eeffd640 1 -- 10.20.193.28:0/1706877782 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f99fc0076a0 con 0x7f9a00109ed0 2026-02-20T03:22:08.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f99eeffd640 1 -- 10.20.193.28:0/1706877782 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0416e0 con 0x7f9a00109ed0 2026-02-20T03:22:08.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.944+0000 7f9a07c32640 1 -- 10.20.193.28:0/1706877782 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a001a9d80 con 0x7f9a00109ed0 2026-02-20T03:22:08.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.947+0000 7f9a0a137e00 1 Processor -- start 2026-02-20T03:22:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.947+0000 7f99eeffd640 1 -- 10.20.193.28:0/1706877782 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f99fc0044b0 con 0x7f9a00109ed0 2026-02-20T03:22:08.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.947+0000 7f9a0a137e00 1 -- start start 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 0x55887c8b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b9f90 0x55887c8bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8be0d0 0x55887c8c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55887c839e00 con 0x55887c8b95e0 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55887c80c970 con 0x55887c8b9f90 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55887c7ba1f0 con 0x55887c8be0d0 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a059a7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b9f90 0x55887c8bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a059a7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b9f90 0x55887c8bd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54694/0 (socket says 10.20.193.28:54694) 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a059a7640 1 -- 10.20.193.28:0/1694109426 learned_addr learned my addr 10.20.193.28:0/1694109426 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a051a6640 1 --2- 10.20.193.28:0/1694109426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 0x55887c8b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a051a6640 1 --2- 10.20.193.28:0/1694109426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8be0d0 0x55887c8c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a051a6640 1 -- 10.20.193.28:0/1694109426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8be0d0 msgr2=0x55887c8c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a051a6640 1 --2- 10.20.193.28:0/1694109426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8be0d0 0x55887c8c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a051a6640 1 -- 10.20.193.28:0/1694109426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b9f90 msgr2=0x55887c8bd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a051a6640 1 --2- 10.20.193.28:0/1694109426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b9f90 0x55887c8bd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a051a6640 1 -- 10.20.193.28:0/1694109426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887c7cd3d0 con 0x55887c8b95e0 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f9a051a6640 1 --2- 10.20.193.28:0/1694109426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 0x55887c8b99c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f99f40045a0 tx=0x7f99f4005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7440f746d955e48 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f99ce4e6640 1 -- 10.20.193.28:0/1694109426 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f40135a0 con 0x55887c8b95e0 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f99ce4e6640 1 -- 10.20.193.28:0/1694109426 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f99f4013be0 con 0x55887c8b95e0 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.948+0000 7f99ce4e6640 1 -- 10.20.193.28:0/1694109426 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4010c10 con 0x55887c8b95e0 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1694109426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 msgr2=0x55887c8b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1694109426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 0x55887c8b99c0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f99f40045a0 tx=0x7f99f4005950 comp rx=0 tx=0).stop 2026-02-20T03:22:08.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f99eeffd640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99dc0b0da0 0x7f99dc0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f99eeffd640 1 -- 10.20.193.28:0/1706877782 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f99fc105340 con 0x7f9a00109ed0 2026-02-20T03:22:08.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1694109426 shutdown_connections 2026-02-20T03:22:08.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1694109426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8be0d0 0x55887c8c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1694109426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b9f90 0x55887c8bd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1694109426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 0x55887c8b99c0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1694109426 >> 10.20.193.28:0/1694109426 conn(0x55887c87c240 msgr2=0x55887c8b7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:08.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a051a6640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99dc0b0da0 0x7f99dc0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1694109426 shutdown_connections 2026-02-20T03:22:08.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.949+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1694109426 wait complete. 2026-02-20T03:22:08.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.950+0000 7f9a051a6640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99dc0b0da0 0x7f99dc0b3260 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f99f40108f0 tx=0x7f99f4013370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:08.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.951+0000 7f9a0a137e00 1 -- start start 2026-02-20T03:22:08.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.951+0000 7f9a0a137e00 1 Processor -- start 2026-02-20T03:22:08.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.951+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 0x55887c8e4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.951+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 0x55887c8e5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.951+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8e3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.951+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55887c8088a0 con 0x55887c8b95e0 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.951+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55887c5faf50 con 0x55887c8be0d0 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.951+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55887c8e3b40 con 0x55887c8b9f90 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.951+0000 7f9a061a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a061a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8e3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54704/0 (socket says 10.20.193.28:54704) 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a061a8640 1 -- 10.20.193.28:0/713593727 learned_addr learned my addr 10.20.193.28:0/713593727 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a051a6640 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 0x55887c8e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a059a7640 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 0x55887c8e4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a051a6640 1 -- 10.20.193.28:0/713593727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 msgr2=0x55887c8e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a051a6640 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a051a6640 1 -- 10.20.193.28:0/713593727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 msgr2=0x55887c8e4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a051a6640 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 0x55887c8e4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a051a6640 1 -- 10.20.193.28:0/713593727 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887c8dccb0 con 0x55887c8b9f90 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a051a6640 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 0x55887c8e5290 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f99f40059c0 tx=0x7f99f40107f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0aa2dc746a166a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f99bb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f99bb7fe640 1 -- 10.20.193.28:0/713593727 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4020420 con 0x55887c8b9f90 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a0a137e00 1 -- 10.20.193.28:0/713593727 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55887c5ddb40 con 0x55887c8b9f90 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f99bb7fe640 1 -- 10.20.193.28:0/713593727 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f99f4025070 con 0x55887c8b9f90 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f99bb7fe640 1 -- 10.20.193.28:0/713593727 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f402c670 con 0x55887c8b9f90 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a0a137e00 10 client.26707 _ll_register_callbacks cb 0x55887c845eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.952+0000 7f9a0a137e00 1 -- 10.20.193.28:0/713593727 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55887c81a150 con 0x55887c8b9f90 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f99bb7fe640 1 -- 10.20.193.28:0/713593727 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f99f402c810 con 0x55887c8b9f90 2026-02-20T03:22:08.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f99bb7fe640 1 -- 10.20.193.28:0/713593727 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99f40205c0 con 0x55887c8b9f90 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f9a0a137e00 10 client.26707 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f9a0a137e00 1 -- 10.20.193.28:0/713593727 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55887c7c71e0 con 0x55887c8b9f90 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f99bb7fe640 1 -- 10.20.193.28:0/713593727 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f99f4028070 con 0x55887c8b9f90 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f9a0a137e00 10 client.26707 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f9a0a137e00 10 client.26707 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f9a0a137e00 20 client.26707 populate_metadata read hostname 'trial028' 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55887c8f3370 0x55887c8f5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f9a0a137e00 4 client.26707 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f9a0a137e00 1 -- 10.20.193.28:0/713593727 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55887c814560 con 0x55887c8f3370 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.953+0000 7f9a059a7640 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55887c8f3370 0x55887c8f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.954+0000 7f9a059a7640 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55887c8f3370 0x55887c8f5780 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f29de6136e644723 server_cookie=208e4907b880975c in_seq=0 out_seq=0 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.954+0000 7f99bb7fe640 10 client.26707 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.954+0000 7f99bb7fe640 1 -- 10.20.193.28:0/713593727 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55887c814560 con 0x55887c8f3370 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.954+0000 7f99bb7fe640 10 client.26707 handle_command_reply: tid=0 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.954+0000 7f9a0a137e00 1 client.26707 shutdown 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 -- 10.20.193.28:0/713593727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 msgr2=0x55887c8e5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 0x55887c8e5290 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f99f40059c0 tx=0x7f99f40107f0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 -- 10.20.193.28:0/713593727 shutdown_connections 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 0x55887c8e5290 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55887c8f3370 0x55887c8f5780 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/713593727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b95e0 0x55887c8e4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 -- 10.20.193.28:0/713593727 >> 10.20.193.28:0/713593727 conn(0x55887c87c240 msgr2=0x55887c8bc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:08.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f99bb7fe640 0 client.26707 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:22:08.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 -- 10.20.193.28:0/713593727 shutdown_connections 2026-02-20T03:22:08.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 1 -- 10.20.193.28:0/713593727 wait complete. 2026-02-20T03:22:08.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.955+0000 7f9a0a137e00 20 client.26707 trim_cache size 0 max 16384 2026-02-20T03:22:08.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.961+0000 7f9a0a137e00 1 Processor -- start 2026-02-20T03:22:08.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.961+0000 7f9a0a137e00 1 -- start start 2026-02-20T03:22:08.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b95e0 0x55887c8bd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b9f90 0x55887c8b8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8fb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac012670 con 0x55887c8b9f90 2026-02-20T03:22:08.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac00ff40 con 0x55887c8be0d0 2026-02-20T03:22:08.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac00dd90 con 0x55887c8b95e0 2026-02-20T03:22:08.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a051a6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b9f90 0x55887c8b8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a059a7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b95e0 0x55887c8bd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a059a7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b95e0 0x55887c8bd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50510/0 (socket says 10.20.193.28:50510) 2026-02-20T03:22:08.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a059a7640 1 -- 10.20.193.28:0/3527176573 learned_addr learned my addr 10.20.193.28:0/3527176573 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:08.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a051a6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b9f90 0x55887c8b8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60386/0 (socket says 10.20.193.28:60386) 2026-02-20T03:22:08.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a061a8640 1 --2- 10.20.193.28:0/3527176573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a051a6640 1 -- 10.20.193.28:0/3527176573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b95e0 msgr2=0x55887c8bd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:08.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a051a6640 1 --2- 10.20.193.28:0/3527176573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b95e0 0x55887c8bd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a051a6640 1 -- 10.20.193.28:0/3527176573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 msgr2=0x55887c8fb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:08.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a051a6640 1 --2- 10.20.193.28:0/3527176573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8fb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a051a6640 1 -- 10.20.193.28:0/3527176573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887c8dcae0 con 0x55887c8b9f90 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a061a8640 1 --2- 10.20.193.28:0/3527176573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8fb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.962+0000 7f9a051a6640 1 --2- 10.20.193.28:0/3527176573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b9f90 0x55887c8b8680 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f99f4016010 tx=0x7f99f4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ceb0aaa62681d2a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f99cdce5640 1 -- 10.20.193.28:0/3527176573 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4020420 con 0x55887c8b9f90 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f99cdce5640 1 -- 10.20.193.28:0/3527176573 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f99f4025040 con 0x55887c8b9f90 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f99cdce5640 1 -- 10.20.193.28:0/3527176573 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f402c900 con 0x55887c8b9f90 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f9a0a137e00 1 -- 10.20.193.28:0/3527176573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b9f90 msgr2=0x55887c8b8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/3527176573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b9f90 0x55887c8b8680 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f99f4016010 tx=0x7f99f4036000 comp rx=0 tx=0).stop 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f9a0a137e00 1 -- 10.20.193.28:0/3527176573 shutdown_connections 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/3527176573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8be0d0 0x55887c8fb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/3527176573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8b9f90 0x55887c8b8680 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/3527176573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b95e0 0x55887c8bd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f9a0a137e00 1 -- 10.20.193.28:0/3527176573 >> 10.20.193.28:0/3527176573 conn(0x55887c87c240 msgr2=0x55887c8e2560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:08.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f9a0a137e00 1 -- 10.20.193.28:0/3527176573 shutdown_connections 2026-02-20T03:22:08.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.963+0000 7f9a0a137e00 1 -- 10.20.193.28:0/3527176573 wait complete. 2026-02-20T03:22:08.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.964+0000 7f9a0a137e00 1 -- start start 2026-02-20T03:22:08.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.964+0000 7f9a0a137e00 1 Processor -- start 2026-02-20T03:22:08.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.964+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b95e0 0x55887c8e9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 0x55887c8e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a0a137e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8be0d0 0x55887c8ea530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac00e400 con 0x55887c8be0d0 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac00f870 con 0x55887c8b95e0 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a0a137e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99ac00ead0 con 0x55887c8b9f90 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a051a6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 0x55887c8e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a061a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8be0d0 0x55887c8ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a059a7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b95e0 0x55887c8e9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a061a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8be0d0 0x55887c8ea530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60396/0 (socket says 10.20.193.28:60396) 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a061a8640 1 -- 10.20.193.28:0/1317743576 learned_addr learned my addr 10.20.193.28:0/1317743576 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a061a8640 1 -- 10.20.193.28:0/1317743576 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 msgr2=0x55887c8e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a061a8640 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 0x55887c8e9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a061a8640 1 -- 10.20.193.28:0/1317743576 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b95e0 msgr2=0x55887c8e9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:08.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a061a8640 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b95e0 0x55887c8e9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a061a8640 1 -- 10.20.193.28:0/1317743576 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55887c4eb870 con 0x55887c8be0d0 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a059a7640 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b95e0 0x55887c8e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a061a8640 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8be0d0 0x55887c8ea530 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0cd120 tx=0x7f99fc0cc890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c11d4d4fd18b55 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f99bb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f99bb7fe640 1 -- 10.20.193.28:0/1317743576 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0d1490 con 0x55887c8be0d0 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f99bb7fe640 1 -- 10.20.193.28:0/1317743576 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f99fc033040 con 0x55887c8be0d0 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1317743576 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55887c7ac3f0 con 0x55887c8be0d0 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f99bb7fe640 1 -- 10.20.193.28:0/1317743576 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0efdb0 con 0x55887c8be0d0 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.965+0000 7f9a0a137e00 10 client.17241 _ll_register_callbacks cb 0x7f99f0004090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1317743576 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55887c7beab0 con 0x55887c8be0d0 2026-02-20T03:22:08.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f99bb7fe640 1 -- 10.20.193.28:0/1317743576 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f99fc0b9170 con 0x55887c8be0d0 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f99bb7fe640 1 -- 10.20.193.28:0/1317743576 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99fc0b9470 con 0x55887c8be0d0 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a0a137e00 10 client.17241 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1317743576 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55887c8dd7d0 con 0x55887c8be0d0 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f99bb7fe640 1 -- 10.20.193.28:0/1317743576 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f99fc0cbc10 con 0x55887c8be0d0 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a0a137e00 10 client.17241 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a0a137e00 10 client.17241 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a0a137e00 20 client.17241 populate_metadata read hostname 'trial028' 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55887c968190 0x55887c96a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a0a137e00 4 client.17241 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1317743576 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f99f4013be0 con 0x55887c968190 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.966+0000 7f9a059a7640 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55887c968190 0x55887c96a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a059a7640 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55887c968190 0x55887c96a620 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dae047e109a05b0a server_cookie=8c6ee5bd57a0bcdf in_seq=0 out_seq=0 2026-02-20T03:22:08.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f99bb7fe640 10 client.17241 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f99bb7fe640 1 -- 10.20.193.28:0/1317743576 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f99f4013be0 con 0x55887c968190 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f99bb7fe640 10 client.17241 handle_command_reply: tid=0 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 client.17241 shutdown 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1317743576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8be0d0 msgr2=0x55887c8ea530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8be0d0 0x55887c8ea530 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0cd120 tx=0x7f99fc0cc890 comp rx=0 tx=0).stop 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1317743576 shutdown_connections 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55887c968190 0x55887c96a620 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55887c8be0d0 0x55887c8ea530 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55887c8b9f90 0x55887c8e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 --2- 10.20.193.28:0/1317743576 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55887c8b95e0 0x55887c8e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f99bb7fe640 0 client.17241 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:22:08.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1317743576 >> 10.20.193.28:0/1317743576 conn(0x55887c87c240 msgr2=0x55887c8bc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:08.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1317743576 shutdown_connections 2026-02-20T03:22:08.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 1 -- 10.20.193.28:0/1317743576 wait complete. 2026-02-20T03:22:08.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.967+0000 7f9a0a137e00 20 client.17241 trim_cache size 0 max 16384 2026-02-20T03:22:08.977 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:22:08.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 -- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99dc0b0da0 msgr2=0x7f99dc0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99dc0b0da0 0x7f99dc0b3260 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f99f40108f0 tx=0x7f99f4013370 comp rx=0 tx=0).stop 2026-02-20T03:22:08.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 -- 10.20.193.28:0/1706877782 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a00109ed0 msgr2=0x7f9a001a1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:08.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a00109ed0 0x7f9a001a1ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f99fc006030 tx=0x7f99fc009300 comp rx=0 tx=0).stop 2026-02-20T03:22:08.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 -- 10.20.193.28:0/1706877782 shutdown_connections 2026-02-20T03:22:08.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99dc0b0da0 0x7f99dc0b3260 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a00109ed0 0x7f9a001a1ad0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a00105750 0x7f9a0019d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 --2- 10.20.193.28:0/1706877782 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a00104da0 0x7f9a0019d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:08.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 -- 10.20.193.28:0/1706877782 >> 10.20.193.28:0/1706877782 conn(0x7f9a00100840 msgr2=0x7f9a00101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:08.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 -- 10.20.193.28:0/1706877782 shutdown_connections 2026-02-20T03:22:08.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:08.968+0000 7f9a07c32640 1 -- 10.20.193.28:0/1706877782 wait complete. 2026-02-20T03:22:09.070 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:22:09.335 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:09.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.71 MB/sec execute 222 sec latency 5860.460 ms 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.516+0000 7f5c7a50e640 1 -- 10.20.193.28:0/759768629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c74102f60 msgr2=0x7f5c74106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.516+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/759768629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c74102f60 0x7f5c74106430 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009990 tx=0x7f5c6402f1b0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.516+0000 7f5c7a50e640 1 -- 10.20.193.28:0/759768629 shutdown_connections 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.516+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/759768629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c74106b90 0x7f5c7410e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.516+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/759768629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c74102f60 0x7f5c74106430 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.516+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/759768629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c741025b0 0x7f5c74102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.516+0000 7f5c7a50e640 1 -- 10.20.193.28:0/759768629 >> 10.20.193.28:0/759768629 conn(0x7f5c740fc7e0 msgr2=0x7f5c740fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.516+0000 7f5c7a50e640 1 -- 10.20.193.28:0/759768629 shutdown_connections 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.516+0000 7f5c7a50e640 1 -- 10.20.193.28:0/759768629 wait complete. 2026-02-20T03:22:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.517+0000 7f5c7a50e640 1 Processor -- start 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.517+0000 7f5c7a50e640 1 -- start start 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.517+0000 7f5c7a50e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c741025b0 0x7f5c7419d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.517+0000 7f5c7a50e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c74102f60 0x7f5c7419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.517+0000 7f5c7a50e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c74106b90 0x7f5c741a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c7a50e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5c741119c0 con 0x7f5c74106b90 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c73fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c741025b0 0x7f5c7419d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c7a50e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74111840 con 0x7f5c741025b0 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c7a50e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74111b40 con 0x7f5c74102f60 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c73fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c741025b0 0x7f5c7419d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54734/0 (socket says 10.20.193.28:54734) 2026-02-20T03:22:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c73fff640 1 -- 10.20.193.28:0/1328835460 learned_addr learned my addr 10.20.193.28:0/1328835460 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:09.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c78a84640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c74106b90 0x7f5c741a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c737fe640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c74102f60 0x7f5c7419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c73fff640 1 -- 10.20.193.28:0/1328835460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c74102f60 msgr2=0x7f5c7419d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:09.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c73fff640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c74102f60 0x7f5c7419d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c73fff640 1 -- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c74106b90 msgr2=0x7f5c741a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:09.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c73fff640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c74106b90 0x7f5c741a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c73fff640 1 -- 10.20.193.28:0/1328835460 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c741a22a0 con 0x7f5c741025b0 2026-02-20T03:22:09.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c737fe640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c74102f60 0x7f5c7419d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:22:09.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c78a84640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c74106b90 0x7f5c741a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:09.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c73fff640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c741025b0 0x7f5c7419d250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c600027e0 tx=0x7f5c60002cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:09.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c717fa640 1 -- 10.20.193.28:0/1328835460 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6000ed40 con 0x7f5c741025b0 2026-02-20T03:22:09.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c7a50e640 1 -- 10.20.193.28:0/1328835460 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c741a2590 con 0x7f5c741025b0 2026-02-20T03:22:09.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c717fa640 1 -- 10.20.193.28:0/1328835460 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c600108d0 con 0x7f5c741025b0 2026-02-20T03:22:09.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c717fa640 1 -- 10.20.193.28:0/1328835460 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6000f820 con 0x7f5c741025b0 2026-02-20T03:22:09.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.518+0000 7f5c7a50e640 1 -- 10.20.193.28:0/1328835460 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c741a9dd0 con 0x7f5c741025b0 2026-02-20T03:22:09.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c7ca13e00 1 Processor -- start 2026-02-20T03:22:09.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c7ca13e00 1 -- start start 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b49028d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902919a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c717fa640 1 -- 10.20.193.28:0/1328835460 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5c60010a80 con 0x7f5c741025b0 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4902920d0 0x55b490299c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c7ca13e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b49020de00 con 0x55b49028d5e0 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c7ca13e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b4901e0970 con 0x55b49028df90 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c7ca13e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b49018e1f0 con 0x55b4902920d0 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c78a84640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b49028d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c78a84640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b49028d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60430/0 (socket says 10.20.193.28:60430) 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c78a84640 1 -- 10.20.193.28:0/2942119333 learned_addr learned my addr 10.20.193.28:0/2942119333 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c737fe640 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4902920d0 0x55b490299c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c78a84640 1 -- 10.20.193.28:0/2942119333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4902920d0 msgr2=0x55b490299c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c78a84640 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4902920d0 0x55b490299c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c78a84640 1 -- 10.20.193.28:0/2942119333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 msgr2=0x55b4902919a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c73fff640 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902919a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c78a84640 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902919a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c78a84640 1 -- 10.20.193.28:0/2942119333 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4901a13d0 con 0x55b49028d5e0 2026-02-20T03:22:09.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c73fff640 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902919a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:22:09.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.522+0000 7f5c78a84640 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b49028d9c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009520 tx=0x7f5c68009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29568f4c3e59fdab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:09.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c717fa640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c480b0e20 0x7f5c480b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c717fa640 1 -- 10.20.193.28:0/1328835460 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5c600e1110 con 0x7f5c741025b0 2026-02-20T03:22:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c44ce3640 1 -- 10.20.193.28:0/2942119333 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68019020 con 0x55b49028d5e0 2026-02-20T03:22:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c44ce3640 1 -- 10.20.193.28:0/2942119333 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c68004570 con 0x55b49028d5e0 2026-02-20T03:22:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c44ce3640 1 -- 10.20.193.28:0/2942119333 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800ec90 con 0x55b49028d5e0 2026-02-20T03:22:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2942119333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 msgr2=0x55b49028d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b49028d9c0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009520 tx=0x7f5c68009920 comp rx=0 tx=0).stop 2026-02-20T03:22:09.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2942119333 shutdown_connections 2026-02-20T03:22:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4902920d0 0x55b490299c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902919a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2942119333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b49028d9c0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2942119333 >> 10.20.193.28:0/2942119333 conn(0x55b490250240 msgr2=0x55b49028bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2942119333 shutdown_connections 2026-02-20T03:22:09.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.524+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2942119333 wait complete. 2026-02-20T03:22:09.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.525+0000 7f5c73fff640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c480b0e20 0x7f5c480b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.525+0000 7f5c73fff640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c480b0e20 0x7f5c480b32e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5c600a8d80 tx=0x7f5c600023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.525+0000 7f5c7ca13e00 1 -- start start 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c7ca13e00 1 Processor -- start 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 0x55b4902aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4902af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b4902b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c7ca13e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b4901dc8a0 con 0x55b4902920d0 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c7ca13e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b48ffcef50 con 0x55b49028d5e0 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c7ca13e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b4902b4a70 con 0x55b49028df90 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c78a84640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 0x55b4902aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c78a84640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b4902b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.526+0000 7f5c737fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4902af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c737fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4902af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50552/0 (socket says 10.20.193.28:50552) 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c737fe640 1 -- 10.20.193.28:0/2081398593 learned_addr learned my addr 10.20.193.28:0/2081398593 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c78a84640 1 -- 10.20.193.28:0/2081398593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 msgr2=0x55b4902af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c78a84640 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4902af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c78a84640 1 -- 10.20.193.28:0/2081398593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 msgr2=0x55b4902aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c78a84640 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 0x55b4902aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c78a84640 1 -- 10.20.193.28:0/2081398593 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4902a8200 con 0x55b4902920d0 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c78a84640 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b4902b4530 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009010 tx=0x7f5c68002750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df33cbb8063d0a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:09.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c35ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:09.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c35ffb640 1 -- 10.20.193.28:0/2081398593 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68023070 con 0x55b4902920d0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c35ffb640 1 -- 10.20.193.28:0/2081398593 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c6800ec40 con 0x55b4902920d0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c35ffb640 1 -- 10.20.193.28:0/2081398593 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68019040 con 0x55b4902920d0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2081398593 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b48ffb1b40 con 0x55b4902920d0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c7ca13e00 10 client.17253 _ll_register_callbacks cb 0x55b490219eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2081398593 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4901ee150 con 0x55b4902920d0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c35ffb640 1 -- 10.20.193.28:0/2081398593 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5c6800edf0 con 0x55b4902920d0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c35ffb640 1 -- 10.20.193.28:0/2081398593 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5c680055a0 con 0x55b4902920d0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c7ca13e00 10 client.17253 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.528+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2081398593 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55b49019b1e0 con 0x55b4902920d0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c35ffb640 1 -- 10.20.193.28:0/2081398593 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5c68005740 con 0x55b4902920d0 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c7ca13e00 10 client.17253 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:09.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c7ca13e00 10 client.17253 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c7ca13e00 20 client.17253 populate_metadata read hostname 'trial028' 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b4902be9f0 0x55b4902c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c7ca13e00 4 client.17253 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2081398593 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4901e8560 con 0x55b4902be9f0 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c737fe640 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b4902be9f0 0x55b4902c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c737fe640 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b4902be9f0 0x55b4902c0de0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5471e51c312b2cf5 server_cookie=ab0e708c55c72ac4 in_seq=0 out_seq=0 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.529+0000 7f5c35ffb640 10 client.17253 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c35ffb640 1 -- 10.20.193.28:0/2081398593 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b4901e8560 con 0x55b4902be9f0 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c35ffb640 10 client.17253 handle_command_reply: tid=0 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 client.17253 shutdown 2026-02-20T03:22:09.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2081398593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 msgr2=0x55b4902b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b4902b4530 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009010 tx=0x7f5c68002750 comp rx=0 tx=0).stop 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2081398593 shutdown_connections 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b4902be9f0 0x55b4902c0de0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b4902b4530 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4902af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/2081398593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 0x55b4902aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2081398593 >> 10.20.193.28:0/2081398593 conn(0x55b490250240 msgr2=0x55b4902908f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c35ffb640 0 client.17253 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2081398593 shutdown_connections 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/2081398593 wait complete. 2026-02-20T03:22:09.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.531+0000 7f5c7ca13e00 20 client.17253 trim_cache size 0 max 16384 2026-02-20T03:22:09.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.540+0000 7f5c7ca13e00 1 Processor -- start 2026-02-20T03:22:09.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.540+0000 7f5c7ca13e00 1 -- start start 2026-02-20T03:22:09.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.540+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b490291530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.540+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902bb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.540+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4902920d0 0x55b4902bb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.540+0000 7f5c7ca13e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18012770 con 0x55b49028d5e0 2026-02-20T03:22:09.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.540+0000 7f5c7ca13e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18010040 con 0x55b49028df90 2026-02-20T03:22:09.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.540+0000 7f5c7ca13e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1800de90 con 0x55b4902920d0 2026-02-20T03:22:09.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c737fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c737fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902bb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54772/0 (socket says 10.20.193.28:54772) 2026-02-20T03:22:09.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c737fe640 1 -- 10.20.193.28:0/361626134 learned_addr learned my addr 10.20.193.28:0/361626134 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:09.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c78a84640 1 --2- 10.20.193.28:0/361626134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b490291530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c737fe640 1 -- 10.20.193.28:0/361626134 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4902920d0 msgr2=0x55b4902bb7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:09.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c737fe640 1 --2- 10.20.193.28:0/361626134 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4902920d0 0x55b4902bb7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c737fe640 1 -- 10.20.193.28:0/361626134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 msgr2=0x55b490291530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c737fe640 1 --2- 10.20.193.28:0/361626134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b490291530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c737fe640 1 -- 10.20.193.28:0/361626134 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4902a8030 con 0x55b49028df90 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.541+0000 7f5c737fe640 1 --2- 10.20.193.28:0/361626134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902bb270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55b4902ae0b0 tx=0x7f5c6402fbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd4b6897ce55d9e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c37fff640 1 -- 10.20.193.28:0/361626134 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64004070 con 0x55b49028df90 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c37fff640 1 -- 10.20.193.28:0/361626134 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c64033040 con 0x55b49028df90 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c37fff640 1 -- 10.20.193.28:0/361626134 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64004720 con 0x55b49028df90 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/361626134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 msgr2=0x55b4902bb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/361626134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902bb270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55b4902ae0b0 tx=0x7f5c6402fbf0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/361626134 shutdown_connections 2026-02-20T03:22:09.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/361626134 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4902920d0 0x55b4902bb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/361626134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028df90 0x55b4902bb270 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/361626134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49028d5e0 0x55b490291530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/361626134 >> 10.20.193.28:0/361626134 conn(0x55b490250240 msgr2=0x55b490290e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:09.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/361626134 shutdown_connections 2026-02-20T03:22:09.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.542+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/361626134 wait complete. 2026-02-20T03:22:09.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.544+0000 7f5c7ca13e00 1 -- start start 2026-02-20T03:22:09.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.544+0000 7f5c7ca13e00 1 Processor -- start 2026-02-20T03:22:09.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.544+0000 7f5c7ca13e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 0x55b490324280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.544+0000 7f5c78a84640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 0x55b490324280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.544+0000 7f5c78a84640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 0x55b490324280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54780/0 (socket says 10.20.193.28:54780) 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c78a84640 1 -- 10.20.193.28:0/127883837 learned_addr learned my addr 10.20.193.28:0/127883837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4903247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b490324d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1800e500 con 0x55b4902920d0 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1800f970 con 0x55b49028d5e0 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1800ebd0 con 0x55b49028df90 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c737fe640 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4903247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c78a84640 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b490324d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c737fe640 1 -- 10.20.193.28:0/127883837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 msgr2=0x55b490324280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:09.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c737fe640 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 0x55b490324280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c737fe640 1 -- 10.20.193.28:0/127883837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 msgr2=0x55b490324d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:09.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c737fe640 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b490324d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.546+0000 7f5c737fe640 1 -- 10.20.193.28:0/127883837 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b48febf870 con 0x55b49028df90 2026-02-20T03:22:09.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.547+0000 7f5c78a84640 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b490324d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:22:09.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.547+0000 7f5c737fe640 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4903247c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55b49028e4d0 tx=0x7f5c640092a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6156bcbc05a86e6f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:09.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.547+0000 7f5c35ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:22:09.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.547+0000 7f5c35ffb640 1 -- 10.20.193.28:0/127883837 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6402fd60 con 0x55b49028df90 2026-02-20T03:22:09.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.547+0000 7f5c35ffb640 1 -- 10.20.193.28:0/127883837 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c64055070 con 0x55b49028df90 2026-02-20T03:22:09.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.547+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4901803f0 con 0x55b49028df90 2026-02-20T03:22:09.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.547+0000 7f5c7ca13e00 10 client.26725 _ll_register_callbacks cb 0x7f5c680093f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:09.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.547+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4901b17c0 con 0x55b49028df90 2026-02-20T03:22:09.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c35ffb640 1 -- 10.20.193.28:0/127883837 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64004a90 con 0x55b49028df90 2026-02-20T03:22:09.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c35ffb640 1 -- 10.20.193.28:0/127883837 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5c64004cf0 con 0x55b49028df90 2026-02-20T03:22:09.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c35ffb640 1 -- 10.20.193.28:0/127883837 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5c640026e0 con 0x55b49028df90 2026-02-20T03:22:09.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c7ca13e00 10 client.26725 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:09.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55b4902a8d20 con 0x55b49028df90 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c35ffb640 1 -- 10.20.193.28:0/127883837 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5c64004fd0 con 0x55b49028df90 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c7ca13e00 10 client.26725 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c7ca13e00 10 client.26725 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c7ca13e00 20 client.26725 populate_metadata read hostname 'trial028' 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b49029f660 0x55b4902a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c7ca13e00 4 client.26725 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b490192ab0 con 0x55b49029f660 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.548+0000 7f5c78a84640 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b49029f660 0x55b4902a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.550+0000 7f5c35ffb640 10 client.26725 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.550+0000 7f5c78a84640 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b49029f660 0x55b4902a1b20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47357f6575a9137b server_cookie=1b6a4a8b50df4c99 in_seq=0 out_seq=0 2026-02-20T03:22:09.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.550+0000 7f5c35ffb640 1 -- 10.20.193.28:0/127883837 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b490192ab0 con 0x55b49029f660 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.550+0000 7f5c35ffb640 10 client.26725 handle_command_reply: tid=0 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.550+0000 7f5c7ca13e00 1 client.26725 shutdown 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 msgr2=0x55b4903247c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4903247c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55b49028e4d0 tx=0x7f5c640092a0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 shutdown_connections 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b49029f660 0x55b4902a1b20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4902920d0 0x55b490324d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49028df90 0x55b4903247c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 --2- 10.20.193.28:0/127883837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49028d5e0 0x55b490324280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 >> 10.20.193.28:0/127883837 conn(0x55b490250240 msgr2=0x55b4902aada0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c35ffb640 0 client.26725 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 shutdown_connections 2026-02-20T03:22:09.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 1 -- 10.20.193.28:0/127883837 wait complete. 2026-02-20T03:22:09.555 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:22:09.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.551+0000 7f5c7ca13e00 20 client.26725 trim_cache size 0 max 16384 2026-02-20T03:22:09.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 -- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c480b0e20 msgr2=0x7f5c480b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:09.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c480b0e20 0x7f5c480b32e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5c600a8d80 tx=0x7f5c600023d0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 -- 10.20.193.28:0/1328835460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c741025b0 msgr2=0x7f5c7419d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:09.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c741025b0 0x7f5c7419d250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5c600027e0 tx=0x7f5c60002cb0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 -- 10.20.193.28:0/1328835460 shutdown_connections 2026-02-20T03:22:09.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5c480b0e20 0x7f5c480b32e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c74106b90 0x7f5c741a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c74102f60 0x7f5c7419d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 --2- 10.20.193.28:0/1328835460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c741025b0 0x7f5c7419d250 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:09.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.552+0000 7f5c7a50e640 1 -- 10.20.193.28:0/1328835460 >> 10.20.193.28:0/1328835460 conn(0x7f5c740fc7e0 msgr2=0x7f5c74101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:09.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.553+0000 7f5c7a50e640 1 -- 10.20.193.28:0/1328835460 shutdown_connections 2026-02-20T03:22:09.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:09.553+0000 7f5c7a50e640 1 -- 10.20.193.28:0/1328835460 wait complete. 2026-02-20T03:22:09.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:09 trial028 ceph-mon[38552]: pgmap v405: 129 pgs: 129 active+clean; 132 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 566 KiB/s rd, 3.4 MiB/s wr, 316 op/s 2026-02-20T03:22:09.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:09 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4169851589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:09.658 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:22:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:09 trial177 ceph-mon[43181]: pgmap v405: 129 pgs: 129 active+clean; 132 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 566 KiB/s rd, 3.4 MiB/s wr, 316 op/s 2026-02-20T03:22:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:09 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4169851589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:09.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:09 trial126 ceph-mon[38476]: pgmap v405: 129 pgs: 129 active+clean; 132 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 566 KiB/s rd, 3.4 MiB/s wr, 316 op/s 2026-02-20T03:22:09.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:09 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4169851589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:09.945 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:10.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.190+0000 7f358edb1640 1 -- 10.20.193.28:0/2671127222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 msgr2=0x7f3588075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:10.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.190+0000 7f358edb1640 1 --2- 10.20.193.28:0/2671127222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 0x7f3588075410 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3578009a30 tx=0x7f357802f260 comp rx=0 tx=0).stop 2026-02-20T03:22:10.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.191+0000 7f358edb1640 1 -- 10.20.193.28:0/2671127222 shutdown_connections 2026-02-20T03:22:10.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.191+0000 7f358edb1640 1 --2- 10.20.193.28:0/2671127222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3588113560 0x7f3588115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.191+0000 7f358edb1640 1 --2- 10.20.193.28:0/2671127222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35880759e0 0x7f3588075e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.191+0000 7f358edb1640 1 --2- 10.20.193.28:0/2671127222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 0x7f3588075410 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.191+0000 7f358edb1640 1 -- 10.20.193.28:0/2671127222 >> 10.20.193.28:0/2671127222 conn(0x7f35880fe3e0 msgr2=0x7f3588100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.191+0000 7f358edb1640 1 -- 10.20.193.28:0/2671127222 shutdown_connections 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.191+0000 7f358edb1640 1 -- 10.20.193.28:0/2671127222 wait complete. 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358edb1640 1 Processor -- start 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358edb1640 1 -- start start 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358edb1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35880759e0 0x7f35881a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358edb1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 0x7f35881a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358edb1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3588113560 0x7f35881a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358edb1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3588119240 con 0x7f3588106660 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358edb1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f35881190c0 con 0x7f35880759e0 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358edb1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f35881193c0 con 0x7f3588113560 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358d5ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 0x7f35881a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358d5ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 0x7f35881a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60472/0 (socket says 10.20.193.28:60472) 2026-02-20T03:22:10.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358d5ae640 1 -- 10.20.193.28:0/3537293894 learned_addr learned my addr 10.20.193.28:0/3537293894 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358d5ae640 1 -- 10.20.193.28:0/3537293894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3588113560 msgr2=0x7f35881a5f70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358d5ae640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3588113560 0x7f35881a5f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358d5ae640 1 -- 10.20.193.28:0/3537293894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35880759e0 msgr2=0x7f35881a16a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358d5ae640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35880759e0 0x7f35881a16a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.192+0000 7f358d5ae640 1 -- 10.20.193.28:0/3537293894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35881a66f0 con 0x7f3588106660 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.193+0000 7f358d5ae640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 0x7f35881a1be0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f357c00b570 tx=0x7f357c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.193+0000 7f3576ffd640 1 -- 10.20.193.28:0/3537293894 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c013020 con 0x7f3588106660 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.193+0000 7f3576ffd640 1 -- 10.20.193.28:0/3537293894 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f357c004480 con 0x7f3588106660 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.193+0000 7f3576ffd640 1 -- 10.20.193.28:0/3537293894 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c00fb50 con 0x7f3588106660 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.193+0000 7f358edb1640 1 -- 10.20.193.28:0/3537293894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35881a69e0 con 0x7f3588106660 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.193+0000 7f358edb1640 1 -- 10.20.193.28:0/3537293894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35881ae220 con 0x7f3588106660 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.194+0000 7f3576ffd640 1 -- 10.20.193.28:0/3537293894 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f357c002780 con 0x7f3588106660 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.194+0000 7f359253fe00 1 Processor -- start 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.194+0000 7f359253fe00 1 -- start start 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.194+0000 7f359253fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e8fb0 0x55bd097e9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.194+0000 7f359253fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e35e0 0x55bd097e3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.194+0000 7f359253fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e3f60 0x55bd097efde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.194+0000 7f359253fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd09763e00 con 0x55bd097e35e0 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.194+0000 7f359253fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bd09736970 con 0x55bd097e3f60 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.194+0000 7f359253fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bd096e41f0 con 0x55bd097e8fb0 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.197+0000 7f3576ffd640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f35640b0e20 0x7f35640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.197+0000 7f3576ffd640 1 -- 10.20.193.28:0/3537293894 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f357c0e0570 con 0x7f3588106660 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358ddaf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e35e0 0x55bd097e3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358e5b0640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f35640b0e20 0x7f35640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358ddaf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e35e0 0x55bd097e3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60482/0 (socket says 10.20.193.28:60482) 2026-02-20T03:22:10.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358ddaf640 1 -- 10.20.193.28:0/645036450 learned_addr learned my addr 10.20.193.28:0/645036450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358ddaf640 1 -- 10.20.193.28:0/645036450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e8fb0 msgr2=0x55bd097e9390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358ddaf640 1 --2- 10.20.193.28:0/645036450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e8fb0 0x55bd097e9390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358ddaf640 1 -- 10.20.193.28:0/645036450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e3f60 msgr2=0x55bd097efde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358ddaf640 1 --2- 10.20.193.28:0/645036450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e3f60 0x55bd097efde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358ddaf640 1 -- 10.20.193.28:0/645036450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd096f73d0 con 0x55bd097e35e0 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358e5b0640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f35640b0e20 0x7f35640b32e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f358806bf60 tx=0x7f3584009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f358ddaf640 1 --2- 10.20.193.28:0/645036450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e35e0 0x55bd097e3a20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3578032040 tx=0x7f3578005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286105ae51f45b03 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f35564e6640 1 -- 10.20.193.28:0/645036450 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578038470 con 0x55bd097e35e0 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f35564e6640 1 -- 10.20.193.28:0/645036450 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3578033040 con 0x55bd097e35e0 2026-02-20T03:22:10.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f35564e6640 1 -- 10.20.193.28:0/645036450 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578004290 con 0x55bd097e35e0 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f359253fe00 1 -- 10.20.193.28:0/645036450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e35e0 msgr2=0x55bd097e3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.198+0000 7f359253fe00 1 --2- 10.20.193.28:0/645036450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e35e0 0x55bd097e3a20 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3578032040 tx=0x7f3578005880 comp rx=0 tx=0).stop 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.199+0000 7f359253fe00 1 -- 10.20.193.28:0/645036450 shutdown_connections 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.199+0000 7f359253fe00 1 --2- 10.20.193.28:0/645036450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e3f60 0x55bd097efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.199+0000 7f359253fe00 1 --2- 10.20.193.28:0/645036450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e35e0 0x55bd097e3a20 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.199+0000 7f359253fe00 1 --2- 10.20.193.28:0/645036450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e8fb0 0x55bd097e9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.199+0000 7f359253fe00 1 -- 10.20.193.28:0/645036450 >> 10.20.193.28:0/645036450 conn(0x55bd097a6240 msgr2=0x55bd097e1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.199+0000 7f359253fe00 1 -- 10.20.193.28:0/645036450 shutdown_connections 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.199+0000 7f359253fe00 1 -- 10.20.193.28:0/645036450 wait complete. 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.200+0000 7f359253fe00 1 -- start start 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.200+0000 7f359253fe00 1 Processor -- start 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.200+0000 7f359253fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e35e0 0x55bd097fdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.200+0000 7f359253fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e3f60 0x55bd097fe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.200+0000 7f359253fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e8fb0 0x55bd097fc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.200+0000 7f359253fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd097328a0 con 0x55bd097e8fb0 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.200+0000 7f359253fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bd09524f50 con 0x55bd097e3f60 2026-02-20T03:22:10.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.200+0000 7f359253fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bd097fcad0 con 0x55bd097e35e0 2026-02-20T03:22:10.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f358e5b0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e8fb0 0x55bd097fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:10.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f358e5b0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e8fb0 0x55bd097fc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60492/0 (socket says 10.20.193.28:60492) 2026-02-20T03:22:10.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f358e5b0640 1 -- 10.20.193.28:0/3928483193 learned_addr learned my addr 10.20.193.28:0/3928483193 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:10.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f358e5b0640 1 -- 10.20.193.28:0/3928483193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e35e0 msgr2=0x55bd097fdc10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:10.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f358e5b0640 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e35e0 0x55bd097fdc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f358e5b0640 1 -- 10.20.193.28:0/3928483193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e3f60 msgr2=0x55bd097fe150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:10.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f358e5b0640 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e3f60 0x55bd097fe150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f358e5b0640 1 -- 10.20.193.28:0/3928483193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd097f5ad0 con 0x55bd097e8fb0 2026-02-20T03:22:10.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f358e5b0640 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e8fb0 0x55bd097fc350 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f35840046b0 tx=0x7f3584004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1748cc6efbd49bd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f35437fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f35437fe640 1 -- 10.20.193.28:0/3928483193 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358400dc60 con 0x55bd097e8fb0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f35437fe640 1 -- 10.20.193.28:0/3928483193 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f358401f020 con 0x55bd097e8fb0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f35437fe640 1 -- 10.20.193.28:0/3928483193 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584016610 con 0x55bd097e8fb0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f359253fe00 1 -- 10.20.193.28:0/3928483193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd09507b40 con 0x55bd097e8fb0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f359253fe00 10 client.17268 _ll_register_callbacks cb 0x55bd0976feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.201+0000 7f359253fe00 1 -- 10.20.193.28:0/3928483193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bd09744150 con 0x55bd097e8fb0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f35437fe640 1 -- 10.20.193.28:0/3928483193 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f35840167b0 con 0x55bd097e8fb0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f35437fe640 1 -- 10.20.193.28:0/3928483193 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3584016a90 con 0x55bd097e8fb0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f359253fe00 10 client.17268 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f359253fe00 1 -- 10.20.193.28:0/3928483193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55bd096f11e0 con 0x55bd097e8fb0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f35437fe640 1 -- 10.20.193.28:0/3928483193 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3584016c30 con 0x55bd097e8fb0 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f359253fe00 10 client.17268 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f359253fe00 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f359253fe00 20 client.17268 populate_metadata read hostname 'trial028' 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f359253fe00 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bd0980c4e0 0x55bd0980e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f359253fe00 4 client.17268 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:10.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.202+0000 7f359253fe00 1 -- 10.20.193.28:0/3928483193 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd0973e560 con 0x55bd0980c4e0 2026-02-20T03:22:10.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.227+0000 7f358ddaf640 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bd0980c4e0 0x55bd0980e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.294+0000 7f358ddaf640 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bd0980c4e0 0x55bd0980e970 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c45735e4e1ccdb6f server_cookie=3b8726af5de1966 in_seq=0 out_seq=0 2026-02-20T03:22:10.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.294+0000 7f35437fe640 10 client.17268 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:10.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f35437fe640 1 -- 10.20.193.28:0/3928483193 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55bd0973e560 con 0x55bd0980c4e0 2026-02-20T03:22:10.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f35437fe640 10 client.17268 handle_command_reply: tid=0 2026-02-20T03:22:10.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 client.17268 shutdown 2026-02-20T03:22:10.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 -- 10.20.193.28:0/3928483193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e8fb0 msgr2=0x55bd097fc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:10.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e8fb0 0x55bd097fc350 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f35840046b0 tx=0x7f3584004cc0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 -- 10.20.193.28:0/3928483193 shutdown_connections 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bd0980c4e0 0x55bd0980e970 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e8fb0 0x55bd097fc350 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e3f60 0x55bd097fe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 --2- 10.20.193.28:0/3928483193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e35e0 0x55bd097fdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f35437fe640 0 client.17268 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 -- 10.20.193.28:0/3928483193 >> 10.20.193.28:0/3928483193 conn(0x55bd097a6240 msgr2=0x55bd097e23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 -- 10.20.193.28:0/3928483193 shutdown_connections 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 1 -- 10.20.193.28:0/3928483193 wait complete. 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.321+0000 7f359253fe00 20 client.17268 trim_cache size 0 max 16384 2026-02-20T03:22:10.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.327+0000 7f359253fe00 1 Processor -- start 2026-02-20T03:22:10.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.327+0000 7f359253fe00 1 -- start start 2026-02-20T03:22:10.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.327+0000 7f359253fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e35e0 0x55bd097dbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.327+0000 7f359253fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd097e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.327+0000 7f359253fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e8fb0 0x55bd097e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.327+0000 7f359253fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3534012770 con 0x55bd097e3f60 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.327+0000 7f359253fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3534010040 con 0x55bd097e35e0 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.327+0000 7f359253fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f353400de90 con 0x55bd097e8fb0 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.328+0000 7f358d5ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd097e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.328+0000 7f358d5ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd097e24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60494/0 (socket says 10.20.193.28:60494) 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.328+0000 7f358d5ae640 1 -- 10.20.193.28:0/2734449475 learned_addr learned my addr 10.20.193.28:0/2734449475 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.328+0000 7f358d5ae640 1 -- 10.20.193.28:0/2734449475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e8fb0 msgr2=0x55bd097e2a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.328+0000 7f358d5ae640 1 --2- 10.20.193.28:0/2734449475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e8fb0 0x55bd097e2a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.328+0000 7f358d5ae640 1 -- 10.20.193.28:0/2734449475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e35e0 msgr2=0x55bd097dbad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.328+0000 7f358d5ae640 1 --2- 10.20.193.28:0/2734449475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e35e0 0x55bd097dbad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.328+0000 7f358d5ae640 1 -- 10.20.193.28:0/2734449475 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd097f5900 con 0x55bd097e3f60 2026-02-20T03:22:10.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 --2- 10.20.193.28:0/2734449475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd097e24d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f357c002410 tx=0x7f357c0a8950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3582f220f9c19aba server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:10.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f3555ce5640 1 -- 10.20.193.28:0/2734449475 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c0b14b0 con 0x55bd097e3f60 2026-02-20T03:22:10.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f3555ce5640 1 -- 10.20.193.28:0/2734449475 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f357c002aa0 con 0x55bd097e3f60 2026-02-20T03:22:10.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f3555ce5640 1 -- 10.20.193.28:0/2734449475 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c0a3970 con 0x55bd097e3f60 2026-02-20T03:22:10.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- 10.20.193.28:0/2734449475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 msgr2=0x55bd097e24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:10.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 --2- 10.20.193.28:0/2734449475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd097e24d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f357c002410 tx=0x7f357c0a8950 comp rx=0 tx=0).stop 2026-02-20T03:22:10.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- 10.20.193.28:0/2734449475 shutdown_connections 2026-02-20T03:22:10.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 --2- 10.20.193.28:0/2734449475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e8fb0 0x55bd097e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 --2- 10.20.193.28:0/2734449475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd097e24d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 --2- 10.20.193.28:0/2734449475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e35e0 0x55bd097dbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- 10.20.193.28:0/2734449475 >> 10.20.193.28:0/2734449475 conn(0x55bd097a6240 msgr2=0x55bd097fb260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- 10.20.193.28:0/2734449475 shutdown_connections 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- 10.20.193.28:0/2734449475 wait complete. 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- start start 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 Processor -- start 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e35e0 0x55bd09805010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd09805550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e8fb0 0x55bd09805a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f353400e500 con 0x55bd097e3f60 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f353400f970 con 0x55bd097e8fb0 2026-02-20T03:22:10.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f353400ebd0 con 0x55bd097e35e0 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd09805550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd09805550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60496/0 (socket says 10.20.193.28:60496) 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 -- 10.20.193.28:0/10608452 learned_addr learned my addr 10.20.193.28:0/10608452 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 -- 10.20.193.28:0/10608452 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e35e0 msgr2=0x55bd09805010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e35e0 0x55bd09805010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 -- 10.20.193.28:0/10608452 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e8fb0 msgr2=0x55bd09805a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e8fb0 0x55bd09805a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 -- 10.20.193.28:0/10608452 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd09415870 con 0x55bd097e3f60 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f358d5ae640 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd09805550 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f357c0a78e0 tx=0x7f357c0a45f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101a1211fecb939 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f35437fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f35437fe640 1 -- 10.20.193.28:0/10608452 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c0ac160 con 0x55bd097e3f60 2026-02-20T03:22:10.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f35437fe640 1 -- 10.20.193.28:0/10608452 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f357c0ac300 con 0x55bd097e3f60 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f35437fe640 1 -- 10.20.193.28:0/10608452 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c094420 con 0x55bd097e3f60 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- 10.20.193.28:0/10608452 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd096d63f0 con 0x55bd097e3f60 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f35437fe640 1 -- 10.20.193.28:0/10608452 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f357c0c25c0 con 0x55bd097e3f60 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f35437fe640 10 client.17274 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 10 client.17274 _ll_register_callbacks cb 0x7f3584006f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- 10.20.193.28:0/10608452 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bd096e8ab0 con 0x55bd097e3f60 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f35437fe640 1 -- 10.20.193.28:0/10608452 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f357c0c27c0 con 0x55bd097e3f60 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 10 client.17274 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- 10.20.193.28:0/10608452 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55bd097f65f0 con 0x55bd097e3f60 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f35437fe640 1 -- 10.20.193.28:0/10608452 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f357c0a7260 con 0x55bd097e3f60 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 10 client.17274 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:10.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 20 client.17274 populate_metadata read hostname 'trial028' 2026-02-20T03:22:10.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bd09878bc0 0x55bd0987b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:10.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 4 client.17274 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:22:10.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.329+0000 7f359253fe00 1 -- 10.20.193.28:0/10608452 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3578033040 con 0x55bd09878bc0 2026-02-20T03:22:10.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.347+0000 7f358ddaf640 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bd09878bc0 0x55bd0987b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:10.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.401+0000 7f358ddaf640 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bd09878bc0 0x55bd0987b080 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b46b3b2986481cc0 server_cookie=f1e163a24126beb8 in_seq=0 out_seq=0 2026-02-20T03:22:10.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.401+0000 7f35437fe640 10 client.17274 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:10.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f35437fe640 1 -- 10.20.193.28:0/10608452 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3578033040 con 0x55bd09878bc0 2026-02-20T03:22:10.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f35437fe640 10 client.17274 handle_command_reply: tid=0 2026-02-20T03:22:10.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 client.17274 shutdown 2026-02-20T03:22:10.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 -- 10.20.193.28:0/10608452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 msgr2=0x55bd09805550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:10.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd09805550 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f357c0a78e0 tx=0x7f357c0a45f0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 -- 10.20.193.28:0/10608452 shutdown_connections 2026-02-20T03:22:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bd09878bc0 0x55bd0987b080 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd097e8fb0 0x55bd09805a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd097e3f60 0x55bd09805550 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 --2- 10.20.193.28:0/10608452 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd097e35e0 0x55bd09805010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f35437fe640 0 client.17274 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 -- 10.20.193.28:0/10608452 >> 10.20.193.28:0/10608452 conn(0x55bd097a6240 msgr2=0x55bd0980c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:10.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 -- 10.20.193.28:0/10608452 shutdown_connections 2026-02-20T03:22:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 1 -- 10.20.193.28:0/10608452 wait complete. 2026-02-20T03:22:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f359253fe00 20 client.17274 trim_cache size 0 max 16384 2026-02-20T03:22:10.419 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:22:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 -- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f35640b0e20 msgr2=0x7f35640b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:10.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f35640b0e20 0x7f35640b32e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f358806bf60 tx=0x7f3584009230 comp rx=0 tx=0).stop 2026-02-20T03:22:10.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 -- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 msgr2=0x7f35881a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:10.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 0x7f35881a1be0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f357c00b570 tx=0x7f357c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:22:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 -- 10.20.193.28:0/3537293894 shutdown_connections 2026-02-20T03:22:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f35640b0e20 0x7f35640b32e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3588113560 0x7f35881a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3588106660 0x7f35881a1be0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 --2- 10.20.193.28:0/3537293894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f35880759e0 0x7f35881a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 -- 10.20.193.28:0/3537293894 >> 10.20.193.28:0/3537293894 conn(0x7f35880fe3e0 msgr2=0x7f3588114d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 -- 10.20.193.28:0/3537293894 shutdown_connections 2026-02-20T03:22:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:10.414+0000 7f358edb1640 1 -- 10.20.193.28:0/3537293894 wait complete. 2026-02-20T03:22:10.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.67 MB/sec execute 223 sec latency 6860.496 ms 2026-02-20T03:22:11.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.63 MB/sec execute 224 sec latency 7860.535 ms 2026-02-20T03:22:11.537 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:11 trial028 ceph-mon[38552]: pgmap v406: 129 pgs: 129 active+clean; 132 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 440 KiB/s rd, 3.3 MiB/s wr, 300 op/s 2026-02-20T03:22:11.588 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:22:11.589 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:22:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:11 trial177 ceph-mon[43181]: pgmap v406: 129 pgs: 129 active+clean; 132 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 440 KiB/s rd, 3.3 MiB/s wr, 300 op/s 2026-02-20T03:22:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:11 trial126 ceph-mon[38476]: pgmap v406: 129 pgs: 129 active+clean; 132 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 440 KiB/s rd, 3.3 MiB/s wr, 300 op/s 2026-02-20T03:22:11.885 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:12.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- 10.20.193.28:0/990959768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18104da0 msgr2=0x7f5c18105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:12.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 --2- 10.20.193.28:0/990959768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18104da0 0x7f5c18105180 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c009a30 tx=0x7f5c0c02f260 comp rx=0 tx=0).stop 2026-02-20T03:22:12.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- 10.20.193.28:0/990959768 shutdown_connections 2026-02-20T03:22:12.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 --2- 10.20.193.28:0/990959768 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c18109ed0 0x7f5c18111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 --2- 10.20.193.28:0/990959768 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c18105750 0x7f5c181097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 --2- 10.20.193.28:0/990959768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18104da0 0x7f5c18105180 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- 10.20.193.28:0/990959768 >> 10.20.193.28:0/990959768 conn(0x7f5c18100840 msgr2=0x7f5c18102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:12.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- 10.20.193.28:0/990959768 shutdown_connections 2026-02-20T03:22:12.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- 10.20.193.28:0/990959768 wait complete. 2026-02-20T03:22:12.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 Processor -- start 2026-02-20T03:22:12.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- start start 2026-02-20T03:22:12.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c18104da0 0x7f5c1819d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18105750 0x7f5c1819d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c18109ed0 0x7f5c181a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18114e80 con 0x7f5c18105750 2026-02-20T03:22:12.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18114d00 con 0x7f5c18104da0 2026-02-20T03:22:12.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18115000 con 0x7f5c18109ed0 2026-02-20T03:22:12.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c167fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18105750 0x7f5c1819d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:12.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c167fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18105750 0x7f5c1819d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60504/0 (socket says 10.20.193.28:60504) 2026-02-20T03:22:12.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c167fc640 1 -- 10.20.193.28:0/3157438412 learned_addr learned my addr 10.20.193.28:0/3157438412 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:12.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c167fc640 1 -- 10.20.193.28:0/3157438412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c18109ed0 msgr2=0x7f5c181a1bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:12.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c167fc640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c18109ed0 0x7f5c181a1bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c167fc640 1 -- 10.20.193.28:0/3157438412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c18104da0 msgr2=0x7f5c1819d300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c167fc640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c18104da0 0x7f5c1819d300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c167fc640 1 -- 10.20.193.28:0/3157438412 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c181a2350 con 0x7f5c18105750 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c167fc640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18105750 0x7f5c1819d840 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000b570 tx=0x7f5c0000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5bf7fff640 1 -- 10.20.193.28:0/3157438412 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00013020 con 0x7f5c18105750 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5bf7fff640 1 -- 10.20.193.28:0/3157438412 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c00004480 con 0x7f5c18105750 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5bf7fff640 1 -- 10.20.193.28:0/3157438412 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0000fb50 con 0x7f5c18105750 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- 10.20.193.28:0/3157438412 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c181a2640 con 0x7f5c18105750 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.139+0000 7f5c1d646640 1 -- 10.20.193.28:0/3157438412 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c181a9e80 con 0x7f5c18105750 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5bf7fff640 1 -- 10.20.193.28:0/3157438412 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5c00002780 con 0x7f5c18105750 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 Processor -- start 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 -- start start 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0d1630 0x561c3d0d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 0x561c3d0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0cd8a0 0x561c3d0d95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c3d01fc00 con 0x561c3d0cd8a0 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561c3cfcd3c0 con 0x561c3d0ccee0 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561c3d01bb30 con 0x561c3d0d1630 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5bf7fff640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5be80b0e20 0x7f5be80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5bf7fff640 1 -- 10.20.193.28:0/3157438412 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5c000e0570 con 0x7f5c18105750 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c177fe640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5be80b0e20 0x7f5be80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c167fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0cd8a0 0x561c3d0d95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c167fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0cd8a0 0x561c3d0d95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60518/0 (socket says 10.20.193.28:60518) 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c167fc640 1 -- 10.20.193.28:0/3257634481 learned_addr learned my addr 10.20.193.28:0/3257634481 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:12.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c177fe640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5be80b0e20 0x7f5be80b32e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800ab10 tx=0x7f5c08009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c167fc640 1 -- 10.20.193.28:0/3257634481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0d1630 msgr2=0x561c3d0d1a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c167fc640 1 --2- 10.20.193.28:0/3257634481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0d1630 0x561c3d0d1a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c167fc640 1 -- 10.20.193.28:0/3257634481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 msgr2=0x561c3d0cd360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c167fc640 1 --2- 10.20.193.28:0/3257634481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 0x561c3d0cd360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c167fc640 1 -- 10.20.193.28:0/3257634481 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3cfc6840 con 0x561c3d0cd8a0 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c167fc640 1 --2- 10.20.193.28:0/3257634481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0cd8a0 0x561c3d0d95c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000bf50 tx=0x7f5c000a8aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d74b9351e83ef908 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5bdf7fe640 1 -- 10.20.193.28:0/3257634481 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00002d40 con 0x561c3d0cd8a0 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5bdf7fe640 1 -- 10.20.193.28:0/3257634481 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c000a4290 con 0x561c3d0cd8a0 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5bdf7fe640 1 -- 10.20.193.28:0/3257634481 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c000a3970 con 0x561c3d0cd8a0 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/3257634481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0cd8a0 msgr2=0x561c3d0d95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/3257634481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0cd8a0 0x561c3d0d95c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000bf50 tx=0x7f5c000a8aa0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/3257634481 shutdown_connections 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/3257634481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0cd8a0 0x561c3d0d95c0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/3257634481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 0x561c3d0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/3257634481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0d1630 0x561c3d0d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/3257634481 >> 10.20.193.28:0/3257634481 conn(0x561c3d0c5aa0 msgr2=0x561c3d0cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/3257634481 shutdown_connections 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.145+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/3257634481 wait complete. 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 -- start start 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 Processor -- start 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0ccee0 0x561c3d0efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 0x561c3d0f0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0d1630 0x561c3d0ee500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c3cfc71a0 con 0x561c3d0ccee0 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561c3d0d9cc0 con 0x561c3d0d1630 2026-02-20T03:22:12.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561c3d0eec80 con 0x561c3d0cd8a0 2026-02-20T03:22:12.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0ccee0 0x561c3d0efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:12.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0ccee0 0x561c3d0efdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60524/0 (socket says 10.20.193.28:60524) 2026-02-20T03:22:12.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c16ffd640 1 -- 10.20.193.28:0/2883724544 learned_addr learned my addr 10.20.193.28:0/2883724544 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:12.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c16ffd640 1 -- 10.20.193.28:0/2883724544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 msgr2=0x561c3d0f0300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:12.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c16ffd640 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 0x561c3d0f0300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c16ffd640 1 -- 10.20.193.28:0/2883724544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0d1630 msgr2=0x561c3d0ee500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:12.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c16ffd640 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0d1630 0x561c3d0ee500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c16ffd640 1 -- 10.20.193.28:0/2883724544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3d0e7f10 con 0x561c3d0ccee0 2026-02-20T03:22:12.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c16ffd640 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0ccee0 0x561c3d0efdc0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c032040 tx=0x7f5c0c009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540e40ad173895d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5bdcff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2883724544 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c02fcd0 con 0x561c3d0ccee0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2883724544 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c0c033040 con 0x561c3d0ccee0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2883724544 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0389f0 con 0x561c3d0ccee0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2883724544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c3cdeeb60 con 0x561c3d0ccee0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 10 client.17286 _ll_register_callbacks cb 0x561c3cfcb0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2883724544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c3d0277f0 con 0x561c3d0ccee0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2883724544 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5c0c038b90 con 0x561c3d0ccee0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2883724544 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5c0c04b3f0 con 0x561c3d0ccee0 2026-02-20T03:22:12.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 10 client.17286 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2883724544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561c3cfec430 con 0x561c3d0ccee0 2026-02-20T03:22:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2883724544 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5c0c004030 con 0x561c3d0ccee0 2026-02-20T03:22:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 10 client.17286 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 20 client.17286 populate_metadata read hostname 'trial028' 2026-02-20T03:22:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c3d0fe5f0 0x561c3d100a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 4 client.17286 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.148+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2883724544 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c3cfa1c00 con 0x561c3d0fe5f0 2026-02-20T03:22:12.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.175+0000 7f5c167fc640 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c3d0fe5f0 0x561c3d100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:12.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.242+0000 7f5c167fc640 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c3d0fe5f0 0x561c3d100a00 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1becf807d56c289c server_cookie=491c5725a2cab2ee in_seq=0 out_seq=0 2026-02-20T03:22:12.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.242+0000 7f5bdcff9640 10 client.17286 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.255+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2883724544 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561c3cfa1c00 con 0x561c3d0fe5f0 2026-02-20T03:22:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.255+0000 7f5bdcff9640 10 client.17286 handle_command_reply: tid=0 2026-02-20T03:22:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.255+0000 7f5c1fb4be00 1 client.17286 shutdown 2026-02-20T03:22:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2883724544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0ccee0 msgr2=0x561c3d0efdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:12.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0ccee0 0x561c3d0efdc0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c032040 tx=0x7f5c0c009760 comp rx=0 tx=0).stop 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2883724544 shutdown_connections 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c3d0fe5f0 0x561c3d100a00 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0d1630 0x561c3d0ee500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 0x561c3d0f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2883724544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0ccee0 0x561c3d0efdc0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2883724544 >> 10.20.193.28:0/2883724544 conn(0x561c3d0c5aa0 msgr2=0x561c3d0d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5bdcff9640 0 client.17286 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2883724544 shutdown_connections 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2883724544 wait complete. 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.256+0000 7f5c1fb4be00 20 client.17286 trim_cache size 0 max 16384 2026-02-20T03:22:12.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 Processor -- start 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 -- start start 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 0x561c3d0ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 0x561c3d0d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d105300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc0126f0 con 0x561c3d0d1630 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc00ffc0 con 0x561c3d0ccee0 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc00de10 con 0x561c3d0cd8a0 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d105300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d105300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60538/0 (socket says 10.20.193.28:60538) 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c177fe640 1 -- 10.20.193.28:0/1219650461 learned_addr learned my addr 10.20.193.28:0/1219650461 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c177fe640 1 -- 10.20.193.28:0/1219650461 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 msgr2=0x561c3d0d2a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c177fe640 1 --2- 10.20.193.28:0/1219650461 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 0x561c3d0d2a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c177fe640 1 -- 10.20.193.28:0/1219650461 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 msgr2=0x561c3d0ebf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c177fe640 1 --2- 10.20.193.28:0/1219650461 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 0x561c3d0ebf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c177fe640 1 -- 10.20.193.28:0/1219650461 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3d0e7d40 con 0x561c3d0d1630 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c177fe640 1 --2- 10.20.193.28:0/1219650461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d105300 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800cef0 tx=0x7f5c0800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2556c85bb39d668c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5bdeffd640 1 -- 10.20.193.28:0/1219650461 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08004a70 con 0x561c3d0d1630 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5bdeffd640 1 -- 10.20.193.28:0/1219650461 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c0801f020 con 0x561c3d0d1630 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5bdeffd640 1 -- 10.20.193.28:0/1219650461 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0800db00 con 0x561c3d0d1630 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/1219650461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 msgr2=0x561c3d105300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/1219650461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d105300 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800cef0 tx=0x7f5c0800f000 comp rx=0 tx=0).stop 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/1219650461 shutdown_connections 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/1219650461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d105300 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/1219650461 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 0x561c3d0d2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/1219650461 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 0x561c3d0ebf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/1219650461 >> 10.20.193.28:0/1219650461 conn(0x561c3d0c5aa0 msgr2=0x561c3d0d2370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:12.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/1219650461 shutdown_connections 2026-02-20T03:22:12.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.262+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/1219650461 wait complete. 2026-02-20T03:22:12.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 -- start start 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 Processor -- start 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 0x561c3d0f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 0x561c3d0f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d0f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc00e480 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc00f8f0 con 0x561c3d0ccee0 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc00eb50 con 0x561c3d0cd8a0 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d0f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d0f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60552/0 (socket says 10.20.193.28:60552) 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c177fe640 1 -- 10.20.193.28:0/2180971239 learned_addr learned my addr 10.20.193.28:0/2180971239 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c177fe640 1 -- 10.20.193.28:0/2180971239 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 msgr2=0x561c3d0f40b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c177fe640 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 0x561c3d0f40b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c177fe640 1 -- 10.20.193.28:0/2180971239 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 msgr2=0x561c3d0f3b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c177fe640 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 0x561c3d0f3b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c177fe640 1 -- 10.20.193.28:0/2180971239 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c3ccfe900 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c177fe640 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d0f45f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800d440 tx=0x7f5c0800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e43c880af473f6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5bdcff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2180971239 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0801e030 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2180971239 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5c08011070 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2180971239 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c3cfda4d0 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 10 client.17292 _ll_register_callbacks cb 0x7f5c0c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2180971239 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08024a10 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2180971239 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c000a4290 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2180971239 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f5c08024bb0 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2180971239 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5c08024db0 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 10 client.17292 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2180971239 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561c3d0e8a30 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.267+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2180971239 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5c0802c070 con 0x561c3d0d1630 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.269+0000 7f5c1fb4be00 10 client.17292 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.269+0000 7f5c1fb4be00 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.269+0000 7f5c1fb4be00 20 client.17292 populate_metadata read hostname 'trial028' 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.269+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c3d16bbb0 0x561c3d16e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.269+0000 7f5c1fb4be00 4 client.17292 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:22:12.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.269+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2180971239 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561c3cd8fa20 con 0x561c3d16bbb0 2026-02-20T03:22:12.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.282+0000 7f5c16ffd640 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c3d16bbb0 0x561c3d16e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:12.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.336+0000 7f5c16ffd640 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c3d16bbb0 0x561c3d16e070 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f026b6b5bab3796f server_cookie=980f15132c2779a8 in_seq=0 out_seq=0 2026-02-20T03:22:12.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.336+0000 7f5bdcff9640 10 client.17292 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:12.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5bdcff9640 1 -- 10.20.193.28:0/2180971239 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561c3cd8fa20 con 0x561c3d16bbb0 2026-02-20T03:22:12.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5bdcff9640 10 client.17292 handle_command_reply: tid=0 2026-02-20T03:22:12.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 client.17292 shutdown 2026-02-20T03:22:12.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2180971239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 msgr2=0x561c3d0f45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:12.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d0f45f0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800d440 tx=0x7f5c0800a8f0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2180971239 shutdown_connections 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561c3d16bbb0 0x561c3d16e070 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c3d0d1630 0x561c3d0f45f0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c3d0cd8a0 0x561c3d0f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 --2- 10.20.193.28:0/2180971239 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c3d0ccee0 0x561c3d0f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2180971239 >> 10.20.193.28:0/2180971239 conn(0x561c3d0c5aa0 msgr2=0x561c3d0d2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5bdcff9640 0 client.17292 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2180971239 shutdown_connections 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.350+0000 7f5c1fb4be00 1 -- 10.20.193.28:0/2180971239 wait complete. 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.363+0000 7f5c1fb4be00 20 client.17292 trim_cache size 0 max 16384 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "8bc2bf79-a7cc-4ec0-8e82-cf159877addf", 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 -- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5be80b0e20 msgr2=0x7f5be80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5be80b0e20 0x7f5be80b32e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800ab10 tx=0x7f5c08009230 comp rx=0 tx=0).stop 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 -- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18105750 msgr2=0x7f5c1819d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:12.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18105750 0x7f5c1819d840 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000b570 tx=0x7f5c0000ba40 comp rx=0 tx=0).stop 2026-02-20T03:22:12.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 -- 10.20.193.28:0/3157438412 shutdown_connections 2026-02-20T03:22:12.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5be80b0e20 0x7f5be80b32e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c18109ed0 0x7f5c181a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c18105750 0x7f5c1819d840 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 --2- 10.20.193.28:0/3157438412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c18104da0 0x7f5c1819d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:12.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 -- 10.20.193.28:0/3157438412 >> 10.20.193.28:0/3157438412 conn(0x7f5c18100840 msgr2=0x7f5c18101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:12.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 -- 10.20.193.28:0/3157438412 shutdown_connections 2026-02-20T03:22:12.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:12.364+0000 7f5c1d646640 1 -- 10.20.193.28:0/3157438412 wait complete. 2026-02-20T03:22:12.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.59 MB/sec execute 225 sec latency 8860.570 ms 2026-02-20T03:22:12.522 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:22:12.831 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:13.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.075+0000 7f45261d4640 1 -- 10.20.193.28:0/1998070897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f452010a470 msgr2=0x7f452010a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.075+0000 7f45261d4640 1 --2- 10.20.193.28:0/1998070897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f452010a470 0x7f452010a8d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f451000abb0 tx=0x7f4510030630 comp rx=0 tx=0).stop 2026-02-20T03:22:13.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.075+0000 7f45261d4640 1 -- 10.20.193.28:0/1998070897 shutdown_connections 2026-02-20T03:22:13.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.075+0000 7f45261d4640 1 --2- 10.20.193.28:0/1998070897 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f452010ae10 0x7f45201167c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.075+0000 7f45261d4640 1 --2- 10.20.193.28:0/1998070897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f452010a470 0x7f452010a8d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.075+0000 7f45261d4640 1 --2- 10.20.193.28:0/1998070897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f452010f980 0x7f452010fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.075+0000 7f45261d4640 1 -- 10.20.193.28:0/1998070897 >> 10.20.193.28:0/1998070897 conn(0x7f452006ed80 msgr2=0x7f452006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.075+0000 7f45261d4640 1 -- 10.20.193.28:0/1998070897 shutdown_connections 2026-02-20T03:22:13.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.075+0000 7f45261d4640 1 -- 10.20.193.28:0/1998070897 wait complete. 2026-02-20T03:22:13.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.076+0000 7f45261d4640 1 Processor -- start 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f45261d4640 1 -- start start 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f45261d4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f452010a470 0x7f45201a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f45261d4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f452010ae10 0x7f45201a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f45261d4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f452010f980 0x7f45201a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f45261d4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4520119220 con 0x7f452010f980 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f45261d4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f45201190a0 con 0x7f452010ae10 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f45261d4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f45201193a0 con 0x7f452010a470 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f452010a470 0x7f45201a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451effd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f452010ae10 0x7f45201a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f452010f980 0x7f45201a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f452010a470 0x7f45201a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50714/0 (socket says 10.20.193.28:50714) 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451f7fe640 1 -- 10.20.193.28:0/2054790425 learned_addr learned my addr 10.20.193.28:0/2054790425 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451f7fe640 1 -- 10.20.193.28:0/2054790425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f452010ae10 msgr2=0x7f45201a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451f7fe640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f452010ae10 0x7f45201a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451f7fe640 1 -- 10.20.193.28:0/2054790425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f452010f980 msgr2=0x7f45201a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451f7fe640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f452010f980 0x7f45201a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.077+0000 7f451f7fe640 1 -- 10.20.193.28:0/2054790425 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45201a1f60 con 0x7f452010a470 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.078+0000 7f451f7fe640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f452010a470 0x7f45201a84b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f450c00ea10 tx=0x7f450c00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.078+0000 7f451cff9640 1 -- 10.20.193.28:0/2054790425 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c00ce50 con 0x7f452010a470 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.078+0000 7f45261d4640 1 -- 10.20.193.28:0/2054790425 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45201a2250 con 0x7f452010a470 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.078+0000 7f45261d4640 1 -- 10.20.193.28:0/2054790425 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45201a6270 con 0x7f452010a470 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.078+0000 7f451cff9640 1 -- 10.20.193.28:0/2054790425 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f450c004570 con 0x7f452010a470 2026-02-20T03:22:13.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.078+0000 7f451cff9640 1 -- 10.20.193.28:0/2054790425 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c010690 con 0x7f452010a470 2026-02-20T03:22:13.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.081+0000 7f451cff9640 1 -- 10.20.193.28:0/2054790425 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f450c020030 con 0x7f452010a470 2026-02-20T03:22:13.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.081+0000 7f45286d9e00 1 Processor -- start 2026-02-20T03:22:13.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.082+0000 7f451cff9640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f44f40b0fc0 0x7f44f40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.082+0000 7f45286d9e00 1 -- start start 2026-02-20T03:22:13.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.082+0000 7f451ffff640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f44f40b0fc0 0x7f44f40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619630 0x55d99c619a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c61d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c61e120 0x55d99c625ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f45286d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d99c599e50 con 0x55d99c619630 2026-02-20T03:22:13.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f45286d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d99c56c9c0 con 0x55d99c61e120 2026-02-20T03:22:13.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f45286d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d99c51a240 con 0x55d99c619fe0 2026-02-20T03:22:13.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451cff9640 1 -- 10.20.193.28:0/2054790425 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f450c0e0b60 con 0x7f452010a470 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c61d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c61d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50724/0 (socket says 10.20.193.28:50724) 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451effd640 1 -- 10.20.193.28:0/755893225 learned_addr learned my addr 10.20.193.28:0/755893225 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451ffff640 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c61e120 0x55d99c625ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451f7fe640 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619630 0x55d99c619a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451ffff640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f44f40b0fc0 0x7f44f40b3480 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4514009490 tx=0x7f451400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451effd640 1 -- 10.20.193.28:0/755893225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c61e120 msgr2=0x55d99c625ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451effd640 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c61e120 0x55d99c625ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451effd640 1 -- 10.20.193.28:0/755893225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619630 msgr2=0x55d99c619a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451effd640 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619630 0x55d99c619a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451effd640 1 -- 10.20.193.28:0/755893225 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99c52d420 con 0x55d99c619fe0 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.083+0000 7f451ffff640 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c61e120 0x55d99c625ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:13.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f451effd640 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c61d9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f451000abb0 tx=0x7f4510005950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea1150c50559ea2d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f44e3fff640 1 -- 10.20.193.28:0/755893225 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510048020 con 0x55d99c619fe0 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f44e3fff640 1 -- 10.20.193.28:0/755893225 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4510004310 con 0x55d99c619fe0 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f44e3fff640 1 -- 10.20.193.28:0/755893225 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451003d040 con 0x55d99c619fe0 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f45286d9e00 1 -- 10.20.193.28:0/755893225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 msgr2=0x55d99c61d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f45286d9e00 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c61d9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f451000abb0 tx=0x7f4510005950 comp rx=0 tx=0).stop 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f45286d9e00 1 -- 10.20.193.28:0/755893225 shutdown_connections 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f45286d9e00 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c61e120 0x55d99c625ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f45286d9e00 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c61d9f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f45286d9e00 1 --2- 10.20.193.28:0/755893225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619630 0x55d99c619a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f45286d9e00 1 -- 10.20.193.28:0/755893225 >> 10.20.193.28:0/755893225 conn(0x55d99c5dc290 msgr2=0x55d99c617d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.084+0000 7f45286d9e00 1 -- 10.20.193.28:0/755893225 shutdown_connections 2026-02-20T03:22:13.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.085+0000 7f45286d9e00 1 -- 10.20.193.28:0/755893225 wait complete. 2026-02-20T03:22:13.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.086+0000 7f45286d9e00 1 -- start start 2026-02-20T03:22:13.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.086+0000 7f45286d9e00 1 Processor -- start 2026-02-20T03:22:13.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.086+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c633d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.086+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c634290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.086+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 0x55d99c632490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.086+0000 7f45286d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d99c5688f0 con 0x55d99c619fe0 2026-02-20T03:22:13.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.086+0000 7f45286d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d99c35af50 con 0x55d99c619630 2026-02-20T03:22:13.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.086+0000 7f45286d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d99c632c10 con 0x55d99c61e120 2026-02-20T03:22:13.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.086+0000 7f451effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c634290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c633d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c634290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60598/0 (socket says 10.20.193.28:60598) 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451effd640 1 -- 10.20.193.28:0/1094162687 learned_addr learned my addr 10.20.193.28:0/1094162687 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451ffff640 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 0x55d99c632490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451effd640 1 -- 10.20.193.28:0/1094162687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 msgr2=0x55d99c632490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451effd640 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 0x55d99c632490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451effd640 1 -- 10.20.193.28:0/1094162687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 msgr2=0x55d99c633d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451effd640 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c633d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451effd640 1 -- 10.20.193.28:0/1094162687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99c62b8f0 con 0x55d99c619fe0 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451f7fe640 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c633d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f451effd640 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c634290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f451000aaa0 tx=0x7f4510044500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7a7e11f5ec5613 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f44e17fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:13.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f44e17fa640 1 -- 10.20.193.28:0/1094162687 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510058070 con 0x55d99c619fe0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f44e17fa640 1 -- 10.20.193.28:0/1094162687 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f451000a770 con 0x55d99c619fe0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f44e17fa640 1 -- 10.20.193.28:0/1094162687 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510048070 con 0x55d99c619fe0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f45286d9e00 1 -- 10.20.193.28:0/1094162687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99c33db40 con 0x55d99c619fe0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f44e17fa640 1 -- 10.20.193.28:0/1094162687 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f4510044d60 con 0x55d99c619fe0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f45286d9e00 10 client.17304 _ll_register_callbacks cb 0x55d99c5a5f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.087+0000 7f45286d9e00 1 -- 10.20.193.28:0/1094162687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d99c57a1a0 con 0x55d99c619fe0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f44e17fa640 1 -- 10.20.193.28:0/1094162687 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f45100445e0 con 0x55d99c619fe0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f45286d9e00 10 client.17304 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f45286d9e00 1 -- 10.20.193.28:0/1094162687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55d99c527230 con 0x55d99c619fe0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f44e17fa640 1 -- 10.20.193.28:0/1094162687 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f45100028f0 con 0x55d99c619fe0 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f45286d9e00 10 client.17304 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f45286d9e00 10 client.17304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f45286d9e00 20 client.17304 populate_metadata read hostname 'trial028' 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d99c642100 0x55d99c6444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f45286d9e00 4 client.17304 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f45286d9e00 1 -- 10.20.193.28:0/1094162687 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d99c5745b0 con 0x55d99c642100 2026-02-20T03:22:13.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.088+0000 7f451f7fe640 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d99c642100 0x55d99c6444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.089+0000 7f451f7fe640 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d99c642100 0x55d99c6444f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94ffa42ae2e9d9cf server_cookie=362639a7368e1bc3 in_seq=0 out_seq=0 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.089+0000 7f44e17fa640 10 client.17304 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.089+0000 7f44e17fa640 1 -- 10.20.193.28:0/1094162687 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d99c5745b0 con 0x55d99c642100 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.089+0000 7f44e17fa640 10 client.17304 handle_command_reply: tid=0 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.089+0000 7f45286d9e00 1 client.17304 shutdown 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.089+0000 7f45286d9e00 1 -- 10.20.193.28:0/1094162687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 msgr2=0x55d99c634290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.089+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c634290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f451000aaa0 tx=0x7f4510044500 comp rx=0 tx=0).stop 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f45286d9e00 1 -- 10.20.193.28:0/1094162687 shutdown_connections 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d99c642100 0x55d99c6444f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 0x55d99c632490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c634290 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1094162687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c633d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f45286d9e00 1 -- 10.20.193.28:0/1094162687 >> 10.20.193.28:0/1094162687 conn(0x55d99c5dc290 msgr2=0x55d99c61c940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f44e17fa640 0 client.17304 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:13.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f45286d9e00 1 -- 10.20.193.28:0/1094162687 shutdown_connections 2026-02-20T03:22:13.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f45286d9e00 1 -- 10.20.193.28:0/1094162687 wait complete. 2026-02-20T03:22:13.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.090+0000 7f45286d9e00 20 client.17304 trim_cache size 0 max 16384 2026-02-20T03:22:13.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.098+0000 7f45286d9e00 1 Processor -- start 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.098+0000 7f45286d9e00 1 -- start start 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.098+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c62fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.098+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c6372c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 0x55d99c649d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f45286d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f44c40126a0 con 0x55d99c619fe0 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f45286d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f44c400ff70 con 0x55d99c619630 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f45286d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f44c400ddc0 con 0x55d99c61e120 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c62fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c62fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54922/0 (socket says 10.20.193.28:54922) 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451f7fe640 1 -- 10.20.193.28:0/1513532797 learned_addr learned my addr 10.20.193.28:0/1513532797 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451effd640 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c6372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451ffff640 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 0x55d99c649d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451effd640 1 -- 10.20.193.28:0/1513532797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 msgr2=0x55d99c649d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451effd640 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 0x55d99c649d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451effd640 1 -- 10.20.193.28:0/1513532797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 msgr2=0x55d99c62fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451effd640 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c62fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451effd640 1 -- 10.20.193.28:0/1513532797 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99c62b720 con 0x55d99c619fe0 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451f7fe640 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c62fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f451effd640 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c6372c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f45100058c0 tx=0x55d99c633790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cdbebea418053c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f44e37fe640 1 -- 10.20.193.28:0/1513532797 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510048070 con 0x55d99c619fe0 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f44e37fe640 1 -- 10.20.193.28:0/1513532797 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4510064020 con 0x55d99c619fe0 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.099+0000 7f44e37fe640 1 -- 10.20.193.28:0/1513532797 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510058040 con 0x55d99c619fe0 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.100+0000 7f45286d9e00 1 -- 10.20.193.28:0/1513532797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 msgr2=0x55d99c6372c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.100+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c6372c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f45100058c0 tx=0x55d99c633790 comp rx=0 tx=0).stop 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.100+0000 7f45286d9e00 1 -- 10.20.193.28:0/1513532797 shutdown_connections 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.100+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c61e120 0x55d99c649d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.100+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c619fe0 0x55d99c6372c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.100+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1513532797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c62fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.100+0000 7f45286d9e00 1 -- 10.20.193.28:0/1513532797 >> 10.20.193.28:0/1513532797 conn(0x55d99c5dc290 msgr2=0x55d99c636bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.100+0000 7f45286d9e00 1 -- 10.20.193.28:0/1513532797 shutdown_connections 2026-02-20T03:22:13.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.100+0000 7f45286d9e00 1 -- 10.20.193.28:0/1513532797 wait complete. 2026-02-20T03:22:13.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f45286d9e00 1 -- start start 2026-02-20T03:22:13.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f45286d9e00 1 Processor -- start 2026-02-20T03:22:13.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c63d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c639c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f45286d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c61e120 0x55d99c63a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f45286d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f44c400e430 con 0x55d99c61e120 2026-02-20T03:22:13.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f45286d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f44c400f8a0 con 0x55d99c619630 2026-02-20T03:22:13.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f45286d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f44c400eb00 con 0x55d99c619fe0 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f451f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c63d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f451f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c63d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54936/0 (socket says 10.20.193.28:54936) 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f451f7fe640 1 -- 10.20.193.28:0/1996057968 learned_addr learned my addr 10.20.193.28:0/1996057968 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f451effd640 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c639c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.101+0000 7f451ffff640 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c61e120 0x55d99c63a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f451f7fe640 1 -- 10.20.193.28:0/1996057968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 msgr2=0x55d99c639c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f451f7fe640 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c639c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f451f7fe640 1 -- 10.20.193.28:0/1996057968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c61e120 msgr2=0x55d99c63a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f451f7fe640 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c61e120 0x55d99c63a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f451f7fe640 1 -- 10.20.193.28:0/1996057968 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d99c24b870 con 0x55d99c619630 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f451effd640 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c639c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f451f7fe640 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c63d570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f450c0a8540 tx=0x7f450c0cb0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bce8420174eca7e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f44e17fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f44e17fa640 1 -- 10.20.193.28:0/1996057968 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c0a9d70 con 0x55d99c619630 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f45286d9e00 1 -- 10.20.193.28:0/1996057968 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d99c50c440 con 0x55d99c619630 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f44e17fa640 1 -- 10.20.193.28:0/1996057968 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f450c0c2070 con 0x55d99c619630 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f45286d9e00 10 client.26723 _ll_register_callbacks cb 0x7f450c00ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f45286d9e00 1 -- 10.20.193.28:0/1996057968 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d99c53d810 con 0x55d99c619630 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f44e17fa640 1 -- 10.20.193.28:0/1996057968 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c0c7020 con 0x55d99c619630 2026-02-20T03:22:13.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f44e17fa640 1 -- 10.20.193.28:0/1996057968 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f450c004300 con 0x55d99c619630 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f44e17fa640 1 -- 10.20.193.28:0/1996057968 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f450c0a3f60 con 0x55d99c619630 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f45286d9e00 10 client.26723 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.102+0000 7f45286d9e00 1 -- 10.20.193.28:0/1996057968 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55d99c62c410 con 0x55d99c619630 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f44e17fa640 1 -- 10.20.193.28:0/1996057968 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f450c0a4100 con 0x55d99c619630 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f45286d9e00 10 client.26723 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f45286d9e00 10 client.26723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f45286d9e00 20 client.26723 populate_metadata read hostname 'trial028' 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d99c6ae0c0 0x55d99c6b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f45286d9e00 4 client.26723 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f45286d9e00 1 -- 10.20.193.28:0/1996057968 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d99c51eb00 con 0x55d99c6ae0c0 2026-02-20T03:22:13.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f451effd640 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d99c6ae0c0 0x55d99c6b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f451effd640 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d99c6ae0c0 0x55d99c6b0580 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8779820556aa7af3 server_cookie=a581f4d3d7dbb698 in_seq=0 out_seq=0 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.103+0000 7f44e17fa640 10 client.26723 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f44e17fa640 1 -- 10.20.193.28:0/1996057968 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d99c51eb00 con 0x55d99c6ae0c0 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f44e17fa640 10 client.26723 handle_command_reply: tid=0 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 client.26723 shutdown 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 -- 10.20.193.28:0/1996057968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 msgr2=0x55d99c63d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c63d570 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f450c0a8540 tx=0x7f450c0cb0d0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 -- 10.20.193.28:0/1996057968 shutdown_connections 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d99c6ae0c0 0x55d99c6b0580 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d99c61e120 0x55d99c63a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d99c619fe0 0x55d99c639c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f44e17fa640 0 client.26723 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 --2- 10.20.193.28:0/1996057968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d99c619630 0x55d99c63d570 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 -- 10.20.193.28:0/1996057968 >> 10.20.193.28:0/1996057968 conn(0x55d99c5dc290 msgr2=0x55d99c6373d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout: "8bc2bf79-a7cc-4ec0-8e82-cf159877addf": { 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "8bc2bf79-a7cc-4ec0-8e82-cf159877addf", 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 -- 10.20.193.28:0/1996057968 shutdown_connections 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 1 -- 10.20.193.28:0/1996057968 wait complete. 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45286d9e00 20 client.26723 trim_cache size 0 max 16384 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 -- 10.20.193.28:0/2054790425 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f44f40b0fc0 msgr2=0x7f44f40b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f44f40b0fc0 0x7f44f40b3480 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4514009490 tx=0x7f451400b040 comp rx=0 tx=0).stop 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 -- 10.20.193.28:0/2054790425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f452010a470 msgr2=0x7f45201a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f452010a470 0x7f45201a84b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f450c00ea10 tx=0x7f450c00eee0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 -- 10.20.193.28:0/2054790425 shutdown_connections 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f44f40b0fc0 0x7f44f40b3480 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f452010f980 0x7f45201a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f452010ae10 0x7f45201a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 --2- 10.20.193.28:0/2054790425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f452010a470 0x7f45201a84b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.104+0000 7f45261d4640 1 -- 10.20.193.28:0/2054790425 >> 10.20.193.28:0/2054790425 conn(0x7f452006ed80 msgr2=0x7f4520072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.105+0000 7f45261d4640 1 -- 10.20.193.28:0/2054790425 shutdown_connections 2026-02-20T03:22:13.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:13.105+0000 7f45261d4640 1 -- 10.20.193.28:0/2054790425 wait complete. 2026-02-20T03:22:13.200 INFO:tasks.cephfs.filesystem:scrub status for tag:8bc2bf79-a7cc-4ec0-8e82-cf159877addf - {'path': '/', 'tag': '8bc2bf79-a7cc-4ec0-8e82-cf159877addf', 'options': 'recursive,force'} 2026-02-20T03:22:13.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.55 MB/sec execute 226 sec latency 9860.613 ms 2026-02-20T03:22:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:13 trial177 ceph-mon[43181]: pgmap v407: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 368 KiB/s rd, 3.1 MiB/s wr, 275 op/s 2026-02-20T03:22:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:13 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:22:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:13 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:13 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:22:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:13 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:22:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:13 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:22:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:13 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:13 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:13 trial126 ceph-mon[38476]: pgmap v407: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 368 KiB/s rd, 3.1 MiB/s wr, 275 op/s 2026-02-20T03:22:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:13 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:22:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:13 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:13 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:22:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:13 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:22:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:13 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:22:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:13 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:13 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:13 trial028 ceph-mon[38552]: pgmap v407: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 368 KiB/s rd, 3.1 MiB/s wr, 275 op/s 2026-02-20T03:22:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:13 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:22:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:13 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:13 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:22:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:13 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:22:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:13 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:22:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:13 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:13 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.918+0000 7f84e9342640 1 -- 10.20.193.28:0/1932921542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e41064e0 msgr2=0x7f84e410cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.918+0000 7f84e9342640 1 --2- 10.20.193.28:0/1932921542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e41064e0 0x7f84e410cd70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f84d800b0a0 tx=0x7f84d802f410 comp rx=0 tx=0).stop 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.918+0000 7f84e9342640 1 -- 10.20.193.28:0/1932921542 shutdown_connections 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.918+0000 7f84e9342640 1 --2- 10.20.193.28:0/1932921542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e41064e0 0x7f84e410cd70 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.918+0000 7f84e9342640 1 --2- 10.20.193.28:0/1932921542 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e4105b20 0x7f84e4105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.918+0000 7f84e9342640 1 --2- 10.20.193.28:0/1932921542 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e4104930 0x7f84e4104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.918+0000 7f84e9342640 1 -- 10.20.193.28:0/1932921542 >> 10.20.193.28:0/1932921542 conn(0x7f84e41000d0 msgr2=0x7f84e41024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.918+0000 7f84e9342640 1 -- 10.20.193.28:0/1932921542 shutdown_connections 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.918+0000 7f84e9342640 1 -- 10.20.193.28:0/1932921542 wait complete. 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.919+0000 7f84e9342640 1 Processor -- start 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.919+0000 7f84e9342640 1 -- start start 2026-02-20T03:22:13.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.919+0000 7f84e9342640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e4104930 0x7f84e419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.919+0000 7f84e9342640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e4105b20 0x7f84e419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.919+0000 7f84e9342640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e41064e0 0x7f84e41a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.919+0000 7f84e9342640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4110420 con 0x7f84e4105b20 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.919+0000 7f84e9342640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41102a0 con 0x7f84e41064e0 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.919+0000 7f84e9342640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41105a0 con 0x7f84e4104930 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e4105b20 0x7f84e419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e4105b20 0x7f84e419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60624/0 (socket says 10.20.193.28:60624) 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e37fe640 1 -- 10.20.193.28:0/1642878966 learned_addr learned my addr 10.20.193.28:0/1642878966 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e3fff640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e4104930 0x7f84e419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e8b41640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e41064e0 0x7f84e41a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e37fe640 1 -- 10.20.193.28:0/1642878966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e4104930 msgr2=0x7f84e419c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e37fe640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e4104930 0x7f84e419c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e37fe640 1 -- 10.20.193.28:0/1642878966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e41064e0 msgr2=0x7f84e41a3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e37fe640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e41064e0 0x7f84e41a3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e37fe640 1 -- 10.20.193.28:0/1642878966 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41a4600 con 0x7f84e4105b20 2026-02-20T03:22:13.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e3fff640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e4104930 0x7f84e419c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:13.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e37fe640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e4105b20 0x7f84e419ce90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f84d400ea30 tx=0x7f84d400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e17fa640 1 -- 10.20.193.28:0/1642878966 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d400ce50 con 0x7f84e4105b20 2026-02-20T03:22:13.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e17fa640 1 -- 10.20.193.28:0/1642878966 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84d4004570 con 0x7f84e4105b20 2026-02-20T03:22:13.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e17fa640 1 -- 10.20.193.28:0/1642878966 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4010690 con 0x7f84e4105b20 2026-02-20T03:22:13.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e9342640 1 -- 10.20.193.28:0/1642878966 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e41a48f0 con 0x7f84e4105b20 2026-02-20T03:22:13.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.920+0000 7f84e9342640 1 -- 10.20.193.28:0/1642878966 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41a4df0 con 0x7f84e4105b20 2026-02-20T03:22:13.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84ed424e00 1 Processor -- start 2026-02-20T03:22:13.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84e17fa640 1 -- 10.20.193.28:0/1642878966 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f84d40040d0 con 0x7f84e4105b20 2026-02-20T03:22:13.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84ed424e00 1 -- start start 2026-02-20T03:22:13.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d31168c50 0x557d31169070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d311695b0 0x557d3116dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31170a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84ed424e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557d310b98f0 con 0x557d31168c50 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84ed424e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557d310672e0 con 0x557d3116e600 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84ed424e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557d310b5820 con 0x557d311695b0 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84e8b41640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d31168c50 0x557d31169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84e8b41640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d31168c50 0x557d31169070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60634/0 (socket says 10.20.193.28:60634) 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.923+0000 7f84e8b41640 1 -- 10.20.193.28:0/2423761370 learned_addr learned my addr 10.20.193.28:0/2423761370 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84e3fff640 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d311695b0 0x557d3116dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84e37fe640 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31170a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84e8b41640 1 -- 10.20.193.28:0/2423761370 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d311695b0 msgr2=0x557d3116dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84e8b41640 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d311695b0 0x557d3116dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84e8b41640 1 -- 10.20.193.28:0/2423761370 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 msgr2=0x557d31170a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84e8b41640 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31170a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84e8b41640 1 -- 10.20.193.28:0/2423761370 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d310595a0 con 0x557d31168c50 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84e37fe640 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31170a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84e8b41640 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d31168c50 0x557d31169070 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f84d8007550 tx=0x7f84d800afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d40057fb7537d40 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84a7fff640 1 -- 10.20.193.28:0/2423761370 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d80040c0 con 0x557d31168c50 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84a7fff640 1 -- 10.20.193.28:0/2423761370 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84d8033050 con 0x557d31168c50 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84a7fff640 1 -- 10.20.193.28:0/2423761370 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8002d90 con 0x557d31168c50 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84ed424e00 1 -- 10.20.193.28:0/2423761370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d31168c50 msgr2=0x557d31169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.924+0000 7f84ed424e00 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d31168c50 0x557d31169070 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f84d8007550 tx=0x7f84d800afe0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84e17fa640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84b80b0e20 0x7f84b80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84e17fa640 1 -- 10.20.193.28:0/1642878966 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f84d40e10d0 con 0x7f84e4105b20 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84ed424e00 1 -- 10.20.193.28:0/2423761370 shutdown_connections 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84ed424e00 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31170a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84ed424e00 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d311695b0 0x557d3116dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84ed424e00 1 --2- 10.20.193.28:0/2423761370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d31168c50 0x557d31169070 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84ed424e00 1 -- 10.20.193.28:0/2423761370 >> 10.20.193.28:0/2423761370 conn(0x557d311602d0 msgr2=0x557d31167150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84e8b41640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84b80b0e20 0x7f84b80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84ed424e00 1 -- 10.20.193.28:0/2423761370 shutdown_connections 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84ed424e00 1 -- 10.20.193.28:0/2423761370 wait complete. 2026-02-20T03:22:13.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.925+0000 7f84e8b41640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84b80b0e20 0x7f84b80b32e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009e60 tx=0x7f84d802f410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.926+0000 7f84ed424e00 1 -- start start 2026-02-20T03:22:13.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.926+0000 7f84ed424e00 1 Processor -- start 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31181940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31181e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31188d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84ed424e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557d310610c0 con 0x557d311695b0 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84ed424e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557d31171590 con 0x557d3116e600 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84ed424e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557d311892f0 con 0x557d31168c50 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31181940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31181940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50782/0 (socket says 10.20.193.28:50782) 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e3fff640 1 -- 10.20.193.28:0/536282437 learned_addr learned my addr 10.20.193.28:0/536282437 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e37fe640 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31181e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e8b41640 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31188d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e37fe640 1 -- 10.20.193.28:0/536282437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 msgr2=0x557d31181940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e37fe640 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31181940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e37fe640 1 -- 10.20.193.28:0/536282437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 msgr2=0x557d31188d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e37fe640 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31188d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e37fe640 1 -- 10.20.193.28:0/536282437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d3117afc0 con 0x557d311695b0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e3fff640 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31181940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84e37fe640 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31181e80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c770 tx=0x7f84d4002ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156380f419c07a1f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84a57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.927+0000 7f84a57fa640 1 -- 10.20.193.28:0/536282437 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d40a84b0 con 0x557d311695b0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84a57fa640 1 -- 10.20.193.28:0/536282437 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84d40a94b0 con 0x557d311695b0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 1 -- 10.20.193.28:0/536282437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d31075820 con 0x557d311695b0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84a57fa640 1 -- 10.20.193.28:0/536282437 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d40a82d0 con 0x557d311695b0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84a57fa640 1 -- 10.20.193.28:0/536282437 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f84d408fb10 con 0x557d311695b0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 10 client.17322 _ll_register_callbacks cb 0x557d31064ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 1 -- 10.20.193.28:0/536282437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d310c14e0 con 0x557d311695b0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84a57fa640 1 -- 10.20.193.28:0/536282437 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f84d40ad160 con 0x557d311695b0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 10 client.17322 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 1 -- 10.20.193.28:0/536282437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557d3107a380 con 0x557d311695b0 2026-02-20T03:22:13.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84a57fa640 1 -- 10.20.193.28:0/536282437 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f84d40af050 con 0x557d311695b0 2026-02-20T03:22:13.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 10 client.17322 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:13.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 10 client.17322 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:13.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 20 client.17322 populate_metadata read hostname 'trial028' 2026-02-20T03:22:13.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d3118d5d0 0x557d3118fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 4 client.17322 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:13.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.928+0000 7f84ed424e00 1 -- 10.20.193.28:0/536282437 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d3103bbd0 con 0x557d3118d5d0 2026-02-20T03:22:13.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.929+0000 7f84e3fff640 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d3118d5d0 0x557d3118fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.929+0000 7f84e3fff640 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d3118d5d0 0x557d3118fa60 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ef86b3832ae6042 server_cookie=d874e60e63875a36 in_seq=0 out_seq=0 2026-02-20T03:22:13.930 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.929+0000 7f84a57fa640 10 client.17322 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.929+0000 7f84a57fa640 1 -- 10.20.193.28:0/536282437 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557d3103bbd0 con 0x557d3118d5d0 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.929+0000 7f84a57fa640 10 client.17322 handle_command_reply: tid=0 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 client.17322 shutdown 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 -- 10.20.193.28:0/536282437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 msgr2=0x557d31181e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31181e80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f84d400c770 tx=0x7f84d4002ac0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 -- 10.20.193.28:0/536282437 shutdown_connections 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d3118d5d0 0x557d3118fa60 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31188d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31181e80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84a57fa640 0 client.17322 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 --2- 10.20.193.28:0/536282437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31181940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 -- 10.20.193.28:0/536282437 >> 10.20.193.28:0/536282437 conn(0x557d311602d0 msgr2=0x557d3116f950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 -- 10.20.193.28:0/536282437 shutdown_connections 2026-02-20T03:22:13.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 1 -- 10.20.193.28:0/536282437 wait complete. 2026-02-20T03:22:13.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.930+0000 7f84ed424e00 20 client.17322 trim_cache size 0 max 16384 2026-02-20T03:22:13.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.937+0000 7f84ed424e00 1 Processor -- start 2026-02-20T03:22:13.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.937+0000 7f84ed424e00 1 -- start start 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.937+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d31168c50 0x557d31167040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.937+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31188d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.937+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d3116e600 0x557d31169f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.937+0000 7f84ed424e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8488012650 con 0x557d311695b0 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.937+0000 7f84ed424e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f848800ff20 con 0x557d31168c50 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.937+0000 7f84ed424e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f848800dd70 con 0x557d3116e600 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31188d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d31168c50 0x557d31167040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31188d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60656/0 (socket says 10.20.193.28:60656) 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e37fe640 1 -- 10.20.193.28:0/2187100649 learned_addr learned my addr 10.20.193.28:0/2187100649 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d31168c50 0x557d31167040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:54982/0 (socket says 10.20.193.28:54982) 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e8b41640 1 --2- 10.20.193.28:0/2187100649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d3116e600 0x557d31169f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e37fe640 1 -- 10.20.193.28:0/2187100649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d3116e600 msgr2=0x557d31169f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e37fe640 1 --2- 10.20.193.28:0/2187100649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d3116e600 0x557d31169f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e37fe640 1 -- 10.20.193.28:0/2187100649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d31168c50 msgr2=0x557d31167040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e37fe640 1 --2- 10.20.193.28:0/2187100649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d31168c50 0x557d31167040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e37fe640 1 -- 10.20.193.28:0/2187100649 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d3117adf0 con 0x557d311695b0 2026-02-20T03:22:13.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e3fff640 1 --2- 10.20.193.28:0/2187100649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d31168c50 0x557d31167040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:13.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84e37fe640 1 --2- 10.20.193.28:0/2187100649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31188d20 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f84d40a8ab0 tx=0x7f84d40cb070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f6dd6b14ad9477 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84a77fe640 1 -- 10.20.193.28:0/2187100649 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d40a94b0 con 0x557d311695b0 2026-02-20T03:22:13.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84a77fe640 1 -- 10.20.193.28:0/2187100649 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x557d310c14e0 con 0x557d311695b0 2026-02-20T03:22:13.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84a77fe640 1 -- 10.20.193.28:0/2187100649 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d40a7dc0 con 0x557d311695b0 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84ed424e00 1 -- 10.20.193.28:0/2187100649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 msgr2=0x557d31188d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.938+0000 7f84ed424e00 1 --2- 10.20.193.28:0/2187100649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31188d20 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f84d40a8ab0 tx=0x7f84d40cb070 comp rx=0 tx=0).stop 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 -- 10.20.193.28:0/2187100649 shutdown_connections 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 --2- 10.20.193.28:0/2187100649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d3116e600 0x557d31169f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 --2- 10.20.193.28:0/2187100649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31188d20 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 --2- 10.20.193.28:0/2187100649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d31168c50 0x557d31167040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 -- 10.20.193.28:0/2187100649 >> 10.20.193.28:0/2187100649 conn(0x557d311602d0 msgr2=0x557d31166930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 -- 10.20.193.28:0/2187100649 shutdown_connections 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 -- 10.20.193.28:0/2187100649 wait complete. 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 -- start start 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 Processor -- start 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31186810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31186d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31187d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f848800e3e0 con 0x557d311695b0 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f848800f850 con 0x557d3116e600 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.939+0000 7f84ed424e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f848800eab0 con 0x557d31168c50 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31186810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31186d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31186810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50802/0 (socket says 10.20.193.28:50802) 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e3fff640 1 -- 10.20.193.28:0/4256606292 learned_addr learned my addr 10.20.193.28:0/4256606292 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e8b41640 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31187d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e3fff640 1 -- 10.20.193.28:0/4256606292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 msgr2=0x557d31187d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e3fff640 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31187d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e3fff640 1 -- 10.20.193.28:0/4256606292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 msgr2=0x557d31186d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e3fff640 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31186d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e3fff640 1 -- 10.20.193.28:0/4256606292 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d3118bef0 con 0x557d31168c50 2026-02-20T03:22:13.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e37fe640 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31186d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84e3fff640 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31186810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x557d31190310 tx=0x7f84d0002e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=774016c2442dde4a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84a57fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84a57fa640 1 -- 10.20.193.28:0/4256606292 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d00048a0 con 0x557d31168c50 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84a57fa640 1 -- 10.20.193.28:0/4256606292 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84d0005050 con 0x557d31168c50 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84ed424e00 1 -- 10.20.193.28:0/4256606292 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d30e19690 con 0x557d31168c50 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84ed424e00 10 client.26761 _ll_register_callbacks cb 0x7f84d4009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.940+0000 7f84ed424e00 1 -- 10.20.193.28:0/4256606292 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d310c7290 con 0x557d31168c50 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84a57fa640 1 -- 10.20.193.28:0/4256606292 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d00032d0 con 0x557d31168c50 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84a57fa640 1 -- 10.20.193.28:0/4256606292 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f84d0003470 con 0x557d31168c50 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84a57fa640 1 -- 10.20.193.28:0/4256606292 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f84d00036b0 con 0x557d31168c50 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84ed424e00 10 client.26761 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:13.945 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84ed424e00 1 -- 10.20.193.28:0/4256606292 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557d3107eb70 con 0x557d31168c50 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84a57fa640 1 -- 10.20.193.28:0/4256606292 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f84d0004a40 con 0x557d31168c50 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84ed424e00 10 client.26761 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84ed424e00 10 client.26761 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84ed424e00 20 client.26761 populate_metadata read hostname 'trial028' 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84ed424e00 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d31201830 0x557d31203cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84ed424e00 4 client.26761 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84ed424e00 1 -- 10.20.193.28:0/4256606292 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f84d8033050 con 0x557d31201830 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.941+0000 7f84e37fe640 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d31201830 0x557d31203cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.942+0000 7f84e37fe640 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d31201830 0x557d31203cc0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6cd301ed6f39541 server_cookie=f12ae87d2b62f4a5 in_seq=0 out_seq=0 2026-02-20T03:22:13.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.942+0000 7f84a57fa640 10 client.26761 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:13.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84a57fa640 1 -- 10.20.193.28:0/4256606292 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f84d8033050 con 0x557d31201830 2026-02-20T03:22:13.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84a57fa640 10 client.26761 handle_command_reply: tid=0 2026-02-20T03:22:13.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 client.26761 shutdown 2026-02-20T03:22:13.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 -- 10.20.193.28:0/4256606292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 msgr2=0x557d31186810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31186810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x557d31190310 tx=0x7f84d0002e90 comp rx=0 tx=0).stop 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 -- 10.20.193.28:0/4256606292 shutdown_connections 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d31201830 0x557d31203cc0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d3116e600 0x557d31187d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d311695b0 0x557d31186d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84a57fa640 0 client.26761 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 --2- 10.20.193.28:0/4256606292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d31168c50 0x557d31186810 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 -- 10.20.193.28:0/4256606292 >> 10.20.193.28:0/4256606292 conn(0x557d311602d0 msgr2=0x557d31167150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 -- 10.20.193.28:0/4256606292 shutdown_connections 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.962+0000 7f84ed424e00 1 -- 10.20.193.28:0/4256606292 wait complete. 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84ed424e00 20 client.26761 trim_cache size 0 max 16384 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:22:13.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 -- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84b80b0e20 msgr2=0x7f84b80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84b80b0e20 0x7f84b80b32e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009e60 tx=0x7f84d802f410 comp rx=0 tx=0).stop 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 -- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e4105b20 msgr2=0x7f84e419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e4105b20 0x7f84e419ce90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f84d400ea30 tx=0x7f84d400ef00 comp rx=0 tx=0).stop 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 -- 10.20.193.28:0/1642878966 shutdown_connections 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84b80b0e20 0x7f84b80b32e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e41064e0 0x7f84e41a3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e4105b20 0x7f84e419ce90 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 --2- 10.20.193.28:0/1642878966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e4104930 0x7f84e419c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 -- 10.20.193.28:0/1642878966 >> 10.20.193.28:0/1642878966 conn(0x7f84e41000d0 msgr2=0x7f84e4108e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 -- 10.20.193.28:0/1642878966 shutdown_connections 2026-02-20T03:22:13.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:13.963+0000 7f84e9342640 1 -- 10.20.193.28:0/1642878966 wait complete. 2026-02-20T03:22:14.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.52 MB/sec execute 227 sec latency 10860.651 ms 2026-02-20T03:22:14.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:14 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:14.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:14 trial177 ceph-mon[43181]: pgmap v408: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 338 KiB/s rd, 2.7 MiB/s wr, 252 op/s 2026-02-20T03:22:14.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:14 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:14.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:14 trial126 ceph-mon[38476]: pgmap v408: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 338 KiB/s rd, 2.7 MiB/s wr, 252 op/s 2026-02-20T03:22:14.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:14 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:14.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:14 trial028 ceph-mon[38552]: pgmap v408: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 338 KiB/s rd, 2.7 MiB/s wr, 252 op/s 2026-02-20T03:22:15.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.48 MB/sec execute 228 sec latency 11860.701 ms 2026-02-20T03:22:16.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.44 MB/sec execute 229 sec latency 12860.739 ms 2026-02-20T03:22:17.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:17 trial028 ceph-mon[38552]: pgmap v409: 129 pgs: 129 active+clean; 126 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 163 KiB/s rd, 2.8 MiB/s wr, 200 op/s 2026-02-20T03:22:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:17 trial177 ceph-mon[43181]: pgmap v409: 129 pgs: 129 active+clean; 126 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 163 KiB/s rd, 2.8 MiB/s wr, 200 op/s 2026-02-20T03:22:17.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.41 MB/sec execute 230 sec latency 13860.791 ms 2026-02-20T03:22:17.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:17 trial126 ceph-mon[38476]: pgmap v409: 129 pgs: 129 active+clean; 126 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 163 KiB/s rd, 2.8 MiB/s wr, 200 op/s 2026-02-20T03:22:18.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.37 MB/sec execute 231 sec latency 14860.833 ms 2026-02-20T03:22:19.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:19 trial028 ceph-mon[38552]: pgmap v410: 129 pgs: 129 active+clean; 126 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 215 KiB/s rd, 2.8 MiB/s wr, 162 op/s 2026-02-20T03:22:19.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:19 trial177 ceph-mon[43181]: pgmap v410: 129 pgs: 129 active+clean; 126 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 215 KiB/s rd, 2.8 MiB/s wr, 162 op/s 2026-02-20T03:22:19.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.33 MB/sec execute 232 sec latency 15860.878 ms 2026-02-20T03:22:19.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:19 trial126 ceph-mon[38476]: pgmap v410: 129 pgs: 129 active+clean; 126 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 215 KiB/s rd, 2.8 MiB/s wr, 162 op/s 2026-02-20T03:22:20.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.30 MB/sec execute 233 sec latency 16860.922 ms 2026-02-20T03:22:21.400 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:21 trial028 ceph-mon[38552]: pgmap v411: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 146 KiB/s rd, 2.7 MiB/s wr, 151 op/s 2026-02-20T03:22:21.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:21 trial177 ceph-mon[43181]: pgmap v411: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 146 KiB/s rd, 2.7 MiB/s wr, 151 op/s 2026-02-20T03:22:21.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.26 MB/sec execute 234 sec latency 17860.958 ms 2026-02-20T03:22:21.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:21 trial126 ceph-mon[38476]: pgmap v411: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 146 KiB/s rd, 2.7 MiB/s wr, 151 op/s 2026-02-20T03:22:22.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.23 MB/sec execute 235 sec latency 18860.985 ms 2026-02-20T03:22:22.831 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:22:23.117 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:23.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:23 trial028 ceph-mon[38552]: pgmap v412: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 153 KiB/s rd, 2.6 MiB/s wr, 134 op/s 2026-02-20T03:22:23.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:22:23.304 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:22:23.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 -- 10.20.193.28:0/1737139980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba8104980 msgr2=0x7f8ba8104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:23.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 --2- 10.20.193.28:0/1737139980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba8104980 0x7f8ba8104de0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009a60 tx=0x7f8b9c02f290 comp rx=0 tx=0).stop 2026-02-20T03:22:23.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 -- 10.20.193.28:0/1737139980 shutdown_connections 2026-02-20T03:22:23.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 --2- 10.20.193.28:0/1737139980 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ba8105320 0x7f8ba8111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 --2- 10.20.193.28:0/1737139980 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba8104980 0x7f8ba8104de0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 --2- 10.20.193.28:0/1737139980 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ba810a980 0x7f8ba810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 -- 10.20.193.28:0/1737139980 >> 10.20.193.28:0/1737139980 conn(0x7f8ba8100680 msgr2=0x7f8ba8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:23.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 -- 10.20.193.28:0/1737139980 shutdown_connections 2026-02-20T03:22:23.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 -- 10.20.193.28:0/1737139980 wait complete. 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 Processor -- start 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 -- start start 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ba8104980 0x7f8ba819d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ba8105320 0x7f8ba819d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba810a980 0x7f8ba81a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8114cd0 con 0x7f8ba810a980 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8114b50 con 0x7f8ba8104980 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8bae793640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8114e50 con 0x7f8ba8105320 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8badf92640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba810a980 0x7f8ba81a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8badf92640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba810a980 0x7f8ba81a1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60282/0 (socket says 10.20.193.28:60282) 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8badf92640 1 -- 10.20.193.28:0/1663361235 learned_addr learned my addr 10.20.193.28:0/1663361235 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8badf92640 1 -- 10.20.193.28:0/1663361235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ba8105320 msgr2=0x7f8ba819d790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8badf92640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ba8105320 0x7f8ba819d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8badf92640 1 -- 10.20.193.28:0/1663361235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ba8104980 msgr2=0x7f8ba819d250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8badf92640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ba8104980 0x7f8ba819d250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.395+0000 7f8badf92640 1 -- 10.20.193.28:0/1663361235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba81a22a0 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8badf92640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba810a980 0x7f8ba81a1b20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400b990 tx=0x7f8ba400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8b967fc640 1 -- 10.20.193.28:0/1663361235 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4006e60 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8b967fc640 1 -- 10.20.193.28:0/1663361235 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ba4010070 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba81a2590 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba81a9dd0 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8b967fc640 1 -- 10.20.193.28:0/1663361235 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4004800 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba8104e60 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8b967fc640 1 -- 10.20.193.28:0/1663361235 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8ba400c790 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8b967fc640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b840b0e70 0x7f8b840b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.400+0000 7f8b967fc640 1 -- 10.20.193.28:0/1663361235 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8ba40e0580 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.405+0000 7f8bad791640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b840b0e70 0x7f8b840b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.405+0000 7f8b967fc640 1 -- 10.20.193.28:0/1663361235 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8ba40a8960 con 0x7f8ba810a980 2026-02-20T03:22:23.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.405+0000 7f8bad791640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b840b0e70 0x7f8b840b3330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009770 tx=0x7f8b98006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:23.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:23 trial177 ceph-mon[43181]: pgmap v412: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 153 KiB/s rd, 2.6 MiB/s wr, 134 op/s 2026-02-20T03:22:23.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:22:23.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:22:23.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657066 8.19 MB/sec execute 236 sec latency 19861.017 ms 2026-02-20T03:22:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.507+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ba810c9e0 con 0x7f8ba810a980 2026-02-20T03:22:23.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.512+0000 7f8b967fc640 1 -- 10.20.193.28:0/1663361235 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f8ba40ac610 con 0x7f8ba810a980 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.512+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b840b0e70 msgr2=0x7f8b840b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.512+0000 7f8bae793640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b840b0e70 0x7f8b840b3330 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009770 tx=0x7f8b98006cd0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.512+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba810a980 msgr2=0x7f8ba81a1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.512+0000 7f8bae793640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba810a980 0x7f8ba81a1b20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400b990 tx=0x7f8ba400be60 comp rx=0 tx=0).stop 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.513+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 shutdown_connections 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.513+0000 7f8bae793640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b840b0e70 0x7f8b840b3330 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.513+0000 7f8bae793640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ba810a980 0x7f8ba81a1b20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.513+0000 7f8bae793640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ba8105320 0x7f8ba819d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.513+0000 7f8bae793640 1 --2- 10.20.193.28:0/1663361235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ba8104980 0x7f8ba819d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.513+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 >> 10.20.193.28:0/1663361235 conn(0x7f8ba8100680 msgr2=0x7f8ba8101130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.513+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 shutdown_connections 2026-02-20T03:22:23.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:23.513+0000 7f8bae793640 1 -- 10.20.193.28:0/1663361235 wait complete. 2026-02-20T03:22:23.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:23 trial126 ceph-mon[38476]: pgmap v412: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 153 KiB/s rd, 2.6 MiB/s wr, 134 op/s 2026-02-20T03:22:23.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:22:23.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:22:23.612 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 764c82a8 --release --await' 2026-02-20T03:22:23.612 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 764c82a8 --release --await 2026-02-20T03:22:23.940 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:24.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 -- 10.20.193.28:0/2702709776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430108700 msgr2=0x7f6430108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:24.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 --2- 10.20.193.28:0/2702709776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430108700 0x7f6430108ae0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6420009a60 tx=0x7f642002f290 comp rx=0 tx=0).stop 2026-02-20T03:22:24.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 -- 10.20.193.28:0/2702709776 shutdown_connections 2026-02-20T03:22:24.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 --2- 10.20.193.28:0/2702709776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f64301030a0 0x7f643010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 --2- 10.20.193.28:0/2702709776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6430102700 0x7f6430102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 --2- 10.20.193.28:0/2702709776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430108700 0x7f6430108ae0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 -- 10.20.193.28:0/2702709776 >> 10.20.193.28:0/2702709776 conn(0x7f64300fe440 msgr2=0x7f6430100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 -- 10.20.193.28:0/2702709776 shutdown_connections 2026-02-20T03:22:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 -- 10.20.193.28:0/2702709776 wait complete. 2026-02-20T03:22:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 Processor -- start 2026-02-20T03:22:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 -- start start 2026-02-20T03:22:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430102700 0x7f643019d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f64301030a0 0x7f643019d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6430108700 0x7f64301a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6430112a50 con 0x7f6430102700 2026-02-20T03:22:24.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f64301128d0 con 0x7f64301030a0 2026-02-20T03:22:24.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6436243640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6430112bd0 con 0x7f6430108700 2026-02-20T03:22:24.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6435241640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430102700 0x7f643019d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:24.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6435241640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430102700 0x7f643019d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60304/0 (socket says 10.20.193.28:60304) 2026-02-20T03:22:24.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.184+0000 7f6435241640 1 -- 10.20.193.28:0/3876012201 learned_addr learned my addr 10.20.193.28:0/3876012201 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f6435241640 1 -- 10.20.193.28:0/3876012201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6430108700 msgr2=0x7f64301a1bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f6435241640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6430108700 0x7f64301a1bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f6435241640 1 -- 10.20.193.28:0/3876012201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f64301030a0 msgr2=0x7f643019d830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f6435241640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f64301030a0 0x7f643019d830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f6435241640 1 -- 10.20.193.28:0/3876012201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64301a2340 con 0x7f6430102700 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f6435241640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430102700 0x7f643019d2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6420009a30 tx=0x7f642002fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f641e7fc640 1 -- 10.20.193.28:0/3876012201 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642002fe50 con 0x7f6430102700 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f641e7fc640 1 -- 10.20.193.28:0/3876012201 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6420005030 con 0x7f6430102700 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f641e7fc640 1 -- 10.20.193.28:0/3876012201 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6420004c00 con 0x7f6430102700 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f6436243640 1 -- 10.20.193.28:0/3876012201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64301a25d0 con 0x7f6430102700 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.187+0000 7f6436243640 1 -- 10.20.193.28:0/3876012201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64301a9e70 con 0x7f6430102700 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.189+0000 7f641e7fc640 1 -- 10.20.193.28:0/3876012201 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f642004b060 con 0x7f6430102700 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 Processor -- start 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- start start 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a02bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a03970 0x558db3a03db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a042f0 0x558db3a0ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558db394ca20 con 0x558db3a027e0 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558db38fa2a0 con 0x558db3a03970 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558db3948950 con 0x558db3a042f0 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435a42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a02bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435a42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a02bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60306/0 (socket says 10.20.193.28:60306) 2026-02-20T03:22:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435a42640 1 -- 10.20.193.28:0/1379067326 learned_addr learned my addr 10.20.193.28:0/1379067326 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:24.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435a42640 1 -- 10.20.193.28:0/1379067326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a042f0 msgr2=0x558db3a0ece0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:24.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435a42640 1 --2- 10.20.193.28:0/1379067326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a042f0 0x558db3a0ece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435a42640 1 -- 10.20.193.28:0/1379067326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a03970 msgr2=0x558db3a03db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435a42640 1 --2- 10.20.193.28:0/1379067326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a03970 0x558db3a03db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435a42640 1 -- 10.20.193.28:0/1379067326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558db38dd0f0 con 0x558db3a027e0 2026-02-20T03:22:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435a42640 1 --2- 10.20.193.28:0/1379067326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a02bc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f642c009d20 tx=0x7f642c00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6769f7ad1e98771 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f641e7fc640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f640c0b0fc0 0x7f640c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f641e7fc640 1 -- 10.20.193.28:0/3876012201 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6420104d30 con 0x7f6430102700 2026-02-20T03:22:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63fdce5640 1 -- 10.20.193.28:0/1379067326 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c017070 con 0x558db3a027e0 2026-02-20T03:22:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435241640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f640c0b0fc0 0x7f640c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63fdce5640 1 -- 10.20.193.28:0/1379067326 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f642c00bd50 con 0x558db3a027e0 2026-02-20T03:22:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63fdce5640 1 -- 10.20.193.28:0/1379067326 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c006e60 con 0x558db3a027e0 2026-02-20T03:22:24.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- 10.20.193.28:0/1379067326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 msgr2=0x558db3a02bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:24.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1379067326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a02bc0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f642c009d20 tx=0x7f642c00b420 comp rx=0 tx=0).stop 2026-02-20T03:22:24.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6435241640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f640c0b0fc0 0x7f640c0b3480 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f64200c8840 tx=0x7f642002f8f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:24.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- 10.20.193.28:0/1379067326 shutdown_connections 2026-02-20T03:22:24.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1379067326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a042f0 0x558db3a0ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1379067326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a03970 0x558db3a03db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1379067326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a02bc0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- 10.20.193.28:0/1379067326 >> 10.20.193.28:0/1379067326 conn(0x558db39f11b0 msgr2=0x558db39f8030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:24.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- 10.20.193.28:0/1379067326 shutdown_connections 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- 10.20.193.28:0/1379067326 wait complete. 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- start start 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 Processor -- start 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a027e0 0x558db3a1cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a1d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 0x558db3a1b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558db38f4080 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558db3a0f3e0 con 0x558db3a042f0 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558db3a1bda0 con 0x558db3a027e0 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6434a40640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a1d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6434a40640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a1d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60310/0 (socket says 10.20.193.28:60310) 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6434a40640 1 -- 10.20.193.28:0/3558897928 learned_addr learned my addr 10.20.193.28:0/3558897928 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6434a40640 1 -- 10.20.193.28:0/3558897928 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a027e0 msgr2=0x558db3a1cfb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6434a40640 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a027e0 0x558db3a1cfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6434a40640 1 -- 10.20.193.28:0/3558897928 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 msgr2=0x558db3a1b760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6434a40640 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 0x558db3a1b760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6434a40640 1 -- 10.20.193.28:0/3558897928 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558db3a14940 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f6434a40640 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a1d4f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6424009ed0 tx=0x7f642400b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e26570db5a26929 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63eaffd640 1 -- 10.20.193.28:0/3558897928 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424016070 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63eaffd640 1 -- 10.20.193.28:0/3558897928 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6424002780 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- 10.20.193.28:0/3558897928 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558db371dda0 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63eaffd640 1 -- 10.20.193.28:0/3558897928 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64240117e0 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63eaffd640 1 -- 10.20.193.28:0/3558897928 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f642401a3b0 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63eaffd640 10 client.17346 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 10 client.17346 _ll_register_callbacks cb 0x558db38f7fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- 10.20.193.28:0/3558897928 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558db3954610 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63eaffd640 1 -- 10.20.193.28:0/3558897928 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6424004270 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 10 client.17346 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 1 -- 10.20.193.28:0/3558897928 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x558db390a020 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f63eaffd640 1 -- 10.20.193.28:0/3558897928 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6424023020 con 0x558db3a03970 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 10 client.17346 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 10 client.17346 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.191+0000 7f64399d1e00 20 client.17346 populate_metadata read hostname 'trial028' 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.197+0000 7f64399d1e00 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558db3a2b860 0x558db3a2dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.197+0000 7f64399d1e00 4 client.17346 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:24.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.197+0000 7f64399d1e00 1 -- 10.20.193.28:0/3558897928 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558db38ceb80 con 0x558db3a2b860 2026-02-20T03:22:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.218+0000 7f6435a42640 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558db3a2b860 0x558db3a2dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:24.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.272+0000 7f6435a42640 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558db3a2b860 0x558db3a2dcb0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5adfef1adc4a1a server_cookie=dd1a83fdfb3894b5 in_seq=0 out_seq=0 2026-02-20T03:22:24.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.272+0000 7f63eaffd640 10 client.17346 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:24.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f63eaffd640 1 -- 10.20.193.28:0/3558897928 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x558db38ceb80 con 0x558db3a2b860 2026-02-20T03:22:24.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f63eaffd640 10 client.17346 handle_command_reply: tid=0 2026-02-20T03:22:24.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 client.17346 shutdown 2026-02-20T03:22:24.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 -- 10.20.193.28:0/3558897928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 msgr2=0x558db3a1d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:24.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a1d4f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6424009ed0 tx=0x7f642400b4b0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 -- 10.20.193.28:0/3558897928 shutdown_connections 2026-02-20T03:22:24.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558db3a2b860 0x558db3a2dcb0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 0x558db3a1b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a1d4f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 --2- 10.20.193.28:0/3558897928 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a027e0 0x558db3a1cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 -- 10.20.193.28:0/3558897928 >> 10.20.193.28:0/3558897928 conn(0x558db39f11b0 msgr2=0x558db39f8740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:24.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f63eaffd640 0 client.17346 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:24.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 -- 10.20.193.28:0/3558897928 shutdown_connections 2026-02-20T03:22:24.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 1 -- 10.20.193.28:0/3558897928 wait complete. 2026-02-20T03:22:24.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.285+0000 7f64399d1e00 20 client.17346 trim_cache size 0 max 16384 2026-02-20T03:22:24.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f64399d1e00 1 Processor -- start 2026-02-20T03:22:24.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f64399d1e00 1 -- start start 2026-02-20T03:22:24.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a027e0 0x558db3a335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a33b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 0x558db3a22eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f64399d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc0126f0 con 0x558db3a03970 2026-02-20T03:22:24.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f64399d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc00ffc0 con 0x558db3a042f0 2026-02-20T03:22:24.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f64399d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc00de10 con 0x558db3a027e0 2026-02-20T03:22:24.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f6434a40640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a33b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:24.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f6434a40640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a33b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60316/0 (socket says 10.20.193.28:60316) 2026-02-20T03:22:24.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f6434a40640 1 -- 10.20.193.28:0/2746331363 learned_addr learned my addr 10.20.193.28:0/2746331363 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:24.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f6434a40640 1 -- 10.20.193.28:0/2746331363 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a027e0 msgr2=0x558db3a335c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:24.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f6434a40640 1 --2- 10.20.193.28:0/2746331363 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a027e0 0x558db3a335c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f6434a40640 1 -- 10.20.193.28:0/2746331363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 msgr2=0x558db3a22eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:24.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f6434a40640 1 --2- 10.20.193.28:0/2746331363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 0x558db3a22eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f6434a40640 1 -- 10.20.193.28:0/2746331363 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558db3a14770 con 0x558db3a03970 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f6434a40640 1 --2- 10.20.193.28:0/2746331363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a33b00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6424014040 tx=0x7f6424019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190c9868afa57a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f63fd4e4640 1 -- 10.20.193.28:0/2746331363 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642402a070 con 0x558db3a03970 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f63fd4e4640 1 -- 10.20.193.28:0/2746331363 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x558db3954610 con 0x558db3a03970 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.291+0000 7f63fd4e4640 1 -- 10.20.193.28:0/2746331363 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424016070 con 0x558db3a03970 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- 10.20.193.28:0/2746331363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 msgr2=0x558db3a33b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 --2- 10.20.193.28:0/2746331363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a33b00 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6424014040 tx=0x7f6424019000 comp rx=0 tx=0).stop 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- 10.20.193.28:0/2746331363 shutdown_connections 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 --2- 10.20.193.28:0/2746331363 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 0x558db3a22eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 --2- 10.20.193.28:0/2746331363 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a03970 0x558db3a33b00 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 --2- 10.20.193.28:0/2746331363 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a027e0 0x558db3a335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- 10.20.193.28:0/2746331363 >> 10.20.193.28:0/2746331363 conn(0x558db39f11b0 msgr2=0x558db3a19f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- 10.20.193.28:0/2746331363 shutdown_connections 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- 10.20.193.28:0/2746331363 wait complete. 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- start start 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 Processor -- start 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a21d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a03970 0x558db3a22270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 0x558db3a227b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc00e480 con 0x558db3a027e0 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc00f8f0 con 0x558db3a042f0 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63dc00eb50 con 0x558db3a03970 2026-02-20T03:22:24.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f6435a42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a21d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f6435a42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a21d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60332/0 (socket says 10.20.193.28:60332) 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f6435a42640 1 -- 10.20.193.28:0/1895646342 learned_addr learned my addr 10.20.193.28:0/1895646342 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f6435a42640 1 -- 10.20.193.28:0/1895646342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a03970 msgr2=0x558db3a22270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f6435a42640 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a03970 0x558db3a22270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f6435a42640 1 -- 10.20.193.28:0/1895646342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 msgr2=0x558db3a227b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f6435a42640 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 0x558db3a227b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f6435a42640 1 -- 10.20.193.28:0/1895646342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558db362bad0 con 0x558db3a027e0 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f6435a42640 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a21d30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f642c009b30 tx=0x7f642c009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b61cbf175a3f33c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f63eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f63eaffd640 1 -- 10.20.193.28:0/1895646342 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c017040 con 0x558db3a027e0 2026-02-20T03:22:24.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f63eaffd640 1 -- 10.20.193.28:0/1895646342 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f642c018040 con 0x558db3a027e0 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f63eaffd640 1 -- 10.20.193.28:0/1895646342 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c01e6c0 con 0x558db3a027e0 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- 10.20.193.28:0/1895646342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558db38d3370 con 0x558db3a027e0 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 10 client.17352 _ll_register_callbacks cb 0x7f6424009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- 10.20.193.28:0/1895646342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f642c00bd50 con 0x558db3a027e0 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f63eaffd640 1 -- 10.20.193.28:0/1895646342 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f642c004040 con 0x558db3a027e0 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f63eaffd640 1 -- 10.20.193.28:0/1895646342 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f642c002b00 con 0x558db3a027e0 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 10 client.17352 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f64399d1e00 1 -- 10.20.193.28:0/1895646342 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x558db3a15460 con 0x558db3a027e0 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.296+0000 7f63eaffd640 1 -- 10.20.193.28:0/1895646342 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f642c023070 con 0x558db3a027e0 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.299+0000 7f64399d1e00 10 client.17352 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.299+0000 7f64399d1e00 10 client.17352 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:22:24.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.299+0000 7f64399d1e00 20 client.17352 populate_metadata read hostname 'trial028' 2026-02-20T03:22:24.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.299+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558db3a97a00 0x558db3a99ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:24.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.299+0000 7f64399d1e00 4 client.17352 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "764c82a8", "release": true, "await": true}] 2026-02-20T03:22:24.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.299+0000 7f64399d1e00 1 -- 10.20.193.28:0/1895646342 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "764c82a8", "release": true, "await": true}) -- 0x558db36cd480 con 0x558db3a97a00 2026-02-20T03:22:24.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.312+0000 7f6434a40640 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558db3a97a00 0x558db3a99ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:24.328 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:24 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:22:24.328 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:24 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1663361235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:24.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.379+0000 7f6434a40640 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558db3a97a00 0x558db3a99ec0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd15dab0d76f5fc server_cookie=61621406d69ac983 in_seq=0 out_seq=0 2026-02-20T03:22:24.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.379+0000 7f63eaffd640 10 client.17352 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f63eaffd640 1 -- 10.20.193.28:0/1895646342 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558db36cd480 con 0x558db3a97a00 2026-02-20T03:22:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f63eaffd640 10 client.17352 handle_command_reply: tid=0 2026-02-20T03:22:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 client.17352 shutdown 2026-02-20T03:22:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 -- 10.20.193.28:0/1895646342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 msgr2=0x558db3a21d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a21d30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f642c009b30 tx=0x7f642c009940 comp rx=0 tx=0).stop 2026-02-20T03:22:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 -- 10.20.193.28:0/1895646342 shutdown_connections 2026-02-20T03:22:24.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558db3a97a00 0x558db3a99ec0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558db3a042f0 0x558db3a227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558db3a03970 0x558db3a22270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 --2- 10.20.193.28:0/1895646342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558db3a027e0 0x558db3a21d30 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f63eaffd640 0 client.17352 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:24.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 -- 10.20.193.28:0/1895646342 >> 10.20.193.28:0/1895646342 conn(0x558db39f11b0 msgr2=0x558db3a04a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:24.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 -- 10.20.193.28:0/1895646342 shutdown_connections 2026-02-20T03:22:24.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 1 -- 10.20.193.28:0/1895646342 wait complete. 2026-02-20T03:22:24.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f64399d1e00 20 client.17352 trim_cache size 0 max 16384 2026-02-20T03:22:24.398 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:22:24.398 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T03:22:24.398 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:22:24.398 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 24, 2026-02-20T03:22:24.398 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:22:24.398 INFO:teuthology.orchestra.run.trial028.stdout: "764c82a8": { 2026-02-20T03:22:24.398 INFO:teuthology.orchestra.run.trial028.stdout: "version": 24, 2026-02-20T03:22:24.399 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:22:24.399 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:22:24.399 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:22:24.399 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:22:24.399 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:22:24.399 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:22:24.399 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 140.5, 2026-02-20T03:22:24.399 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:22:24.399 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:24.400 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:22:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 -- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f640c0b0fc0 msgr2=0x7f640c0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f640c0b0fc0 0x7f640c0b3480 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f64200c8840 tx=0x7f642002f8f0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 -- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430102700 msgr2=0x7f643019d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:24.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430102700 0x7f643019d2f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6420009a30 tx=0x7f642002fce0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 -- 10.20.193.28:0/3876012201 shutdown_connections 2026-02-20T03:22:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f640c0b0fc0 0x7f640c0b3480 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6430108700 0x7f64301a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f64301030a0 0x7f643019d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 --2- 10.20.193.28:0/3876012201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6430102700 0x7f643019d2f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 -- 10.20.193.28:0/3876012201 >> 10.20.193.28:0/3876012201 conn(0x7f64300fe440 msgr2=0x7f64300feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 -- 10.20.193.28:0/3876012201 shutdown_connections 2026-02-20T03:22:24.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:24.393+0000 7f6436243640 1 -- 10.20.193.28:0/3876012201 wait complete. 2026-02-20T03:22:24.468 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '764c82a8', total seconds elapsed: 22.2 2026-02-20T03:22:24.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 657193 8.16 MB/sec execute 237 sec latency 20774.948 ms 2026-02-20T03:22:24.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:24 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:22:24.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:24 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1663361235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:24 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:22:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:24 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1663361235' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:25.448 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:25 trial028 ceph-mon[38552]: pgmap v413: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 163 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T03:22:25.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 659185 8.15 MB/sec execute 238 sec latency 316.166 ms 2026-02-20T03:22:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:25 trial126 ceph-mon[38476]: pgmap v413: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 163 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T03:22:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:25 trial177 ceph-mon[43181]: pgmap v413: 129 pgs: 129 active+clean; 127 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 163 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2026-02-20T03:22:26.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 659185 8.12 MB/sec execute 239 sec latency 1033.740 ms 2026-02-20T03:22:27.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 -- 10.20.193.28:0/1855673584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104550 msgr2=0x7f04141049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:27.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 --2- 10.20.193.28:0/1855673584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104550 0x7f04141049d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009a30 tx=0x7f03fc02f260 comp rx=0 tx=0).stop 2026-02-20T03:22:27.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 -- 10.20.193.28:0/1855673584 shutdown_connections 2026-02-20T03:22:27.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 --2- 10.20.193.28:0/1855673584 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0414104f10 0x7f041410cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 --2- 10.20.193.28:0/1855673584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104550 0x7f04141049d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 --2- 10.20.193.28:0/1855673584 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0414106020 0x7f0414106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 -- 10.20.193.28:0/1855673584 >> 10.20.193.28:0/1855673584 conn(0x7f04141000e0 msgr2=0x7f0414102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:27.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 -- 10.20.193.28:0/1855673584 shutdown_connections 2026-02-20T03:22:27.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 -- 10.20.193.28:0/1855673584 wait complete. 2026-02-20T03:22:27.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.038+0000 7f0419b5b640 1 Processor -- start 2026-02-20T03:22:27.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0419b5b640 1 -- start start 2026-02-20T03:22:27.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0419b5b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0414104550 0x7f041419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.043 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0419b5b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104f10 0x7f041419d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0419b5b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0414106020 0x7f04141a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0419b5b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0414110650 con 0x7f0414104f10 2026-02-20T03:22:27.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0419b5b640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f04141104d0 con 0x7f0414106020 2026-02-20T03:22:27.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0419b5b640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f04141107d0 con 0x7f0414104550 2026-02-20T03:22:27.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f040bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104f10 0x7f041419d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:27.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f040bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104f10 0x7f041419d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43618/0 (socket says 10.20.193.28:43618) 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f040bfff640 1 -- 10.20.193.28:0/3755213485 learned_addr learned my addr 10.20.193.28:0/3755213485 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f040bfff640 1 -- 10.20.193.28:0/3755213485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0414104550 msgr2=0x7f041419cc50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f040bfff640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0414104550 0x7f041419cc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f040bfff640 1 -- 10.20.193.28:0/3755213485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0414106020 msgr2=0x7f04141a41c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f040bfff640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0414106020 0x7f04141a41c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f040bfff640 1 -- 10.20.193.28:0/3755213485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04141a48f0 con 0x7f0414104f10 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f040bfff640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104f10 0x7f041419d190 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009950 tx=0x7f03fc02fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0409ffb640 1 -- 10.20.193.28:0/3755213485 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc004240 con 0x7f0414104f10 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0409ffb640 1 -- 10.20.193.28:0/3755213485 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03fc0043e0 con 0x7f0414104f10 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0409ffb640 1 -- 10.20.193.28:0/3755213485 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc042b00 con 0x7f0414104f10 2026-02-20T03:22:27.048 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0419b5b640 1 -- 10.20.193.28:0/3755213485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04141a4b80 con 0x7f0414104f10 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0419b5b640 1 -- 10.20.193.28:0/3755213485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04141a5020 con 0x7f0414104f10 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 Processor -- start 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0409ffb640 1 -- 10.20.193.28:0/3755213485 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f03fc04a030 con 0x7f0414104f10 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 -- start start 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 0x557424fb2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fb6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 0x557424fb9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557424f028f0 con 0x557424fb27c0 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557424eb02e0 con 0x557424fb1e80 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557424efe820 con 0x557424fb75a0 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fb6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:27.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fb6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43632/0 (socket says 10.20.193.28:43632) 2026-02-20T03:22:27.050 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 -- 10.20.193.28:0/4182720457 learned_addr learned my addr 10.20.193.28:0/4182720457 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:27.050 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 -- 10.20.193.28:0/4182720457 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 msgr2=0x557424fb9a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:27.050 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 --2- 10.20.193.28:0/4182720457 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 0x557424fb9a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.050 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 -- 10.20.193.28:0/4182720457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 msgr2=0x557424fb2280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 --2- 10.20.193.28:0/4182720457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 0x557424fb2280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 -- 10.20.193.28:0/4182720457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557424ea25a0 con 0x557424fb27c0 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 --2- 10.20.193.28:0/4182720457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fb6f80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0404009810 tx=0x7f0404009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e3a22763ca83db server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f03d3fff640 1 -- 10.20.193.28:0/4182720457 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404016070 con 0x557424fb27c0 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f03d3fff640 1 -- 10.20.193.28:0/4182720457 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0404004480 con 0x557424fb27c0 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f03d3fff640 1 -- 10.20.193.28:0/4182720457 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040400bda0 con 0x557424fb27c0 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 -- 10.20.193.28:0/4182720457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 msgr2=0x557424fb6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/4182720457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fb6f80 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f0404009810 tx=0x7f0404009ce0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 -- 10.20.193.28:0/4182720457 shutdown_connections 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/4182720457 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 0x557424fb9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/4182720457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fb6f80 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/4182720457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 0x557424fb2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 -- 10.20.193.28:0/4182720457 >> 10.20.193.28:0/4182720457 conn(0x557424fa96f0 msgr2=0x557424fb0570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0409ffb640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03f00b0e20 0x7f03f00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 -- 10.20.193.28:0/4182720457 shutdown_connections 2026-02-20T03:22:27.057 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0409ffb640 1 -- 10.20.193.28:0/3755213485 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f03fc105110 con 0x7f0414104f10 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f041dc4ae00 1 -- 10.20.193.28:0/4182720457 wait complete. 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.039+0000 7f0418b59640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03f00b0e20 0x7f03f00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03f00b0e20 0x7f03f00b32e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0404014040 tx=0x7f0404009460 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 -- start start 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 Processor -- start 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb1e80 0x557424fcaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb27c0 0x557424fcafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 0x557424fd1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557424eaa0c0 con 0x557424fb1e80 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557424fba650 con 0x557424fb27c0 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557424fdaee0 con 0x557424fb75a0 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb1e80 0x557424fcaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb1e80 0x557424fcaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43642/0 (socket says 10.20.193.28:43642) 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 -- 10.20.193.28:0/540270557 learned_addr learned my addr 10.20.193.28:0/540270557 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 -- 10.20.193.28:0/540270557 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 msgr2=0x557424fd1f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 0x557424fd1f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 -- 10.20.193.28:0/540270557 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb27c0 msgr2=0x557424fcafc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb27c0 0x557424fcafc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 -- 10.20.193.28:0/540270557 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557424fc41b0 con 0x557424fb1e80 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f0418b59640 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb1e80 0x557424fcaa80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f040400bf10 tx=0x7f0404009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc40f2e3e7145452 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f03d1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:27.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f03d1ffb640 1 -- 10.20.193.28:0/540270557 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404022040 con 0x557424fb1e80 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f03d1ffb640 1 -- 10.20.193.28:0/540270557 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f040402b070 con 0x557424fb1e80 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f03d1ffb640 1 -- 10.20.193.28:0/540270557 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404016040 con 0x557424fb1e80 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 -- 10.20.193.28:0/540270557 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557424ebe820 con 0x557424fb1e80 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f03d1ffb640 1 -- 10.20.193.28:0/540270557 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f040401c680 con 0x557424fb1e80 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 10 client.17364 _ll_register_callbacks cb 0x557424eadff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 -- 10.20.193.28:0/540270557 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557424f0a4e0 con 0x557424fb1e80 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f03d1ffb640 1 -- 10.20.193.28:0/540270557 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f040401c880 con 0x557424fb1e80 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 10 client.17364 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 -- 10.20.193.28:0/540270557 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557424ec3380 con 0x557424fb1e80 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f03d1ffb640 1 -- 10.20.193.28:0/540270557 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0404025070 con 0x557424fb1e80 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 10 client.17364 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 10 client.17364 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 20 client.17364 populate_metadata read hostname 'trial028' 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557424fdf0d0 0x557424fe1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 4 client.17364 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.045+0000 7f041dc4ae00 1 -- 10.20.193.28:0/540270557 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557424e84bd0 con 0x557424fdf0d0 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.051+0000 7f040bfff640 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557424fdf0d0 0x557424fe1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.052+0000 7f040bfff640 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557424fdf0d0 0x557424fe1550 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ceca4dff4c7aeaa server_cookie=2d9d5460b1a8777b in_seq=0 out_seq=0 2026-02-20T03:22:27.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.052+0000 7f03d1ffb640 10 client.17364 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:27.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f03d1ffb640 1 -- 10.20.193.28:0/540270557 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557424e84bd0 con 0x557424fdf0d0 2026-02-20T03:22:27.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f03d1ffb640 10 client.17364 handle_command_reply: tid=0 2026-02-20T03:22:27.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 client.17364 shutdown 2026-02-20T03:22:27.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 -- 10.20.193.28:0/540270557 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb1e80 msgr2=0x557424fcaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:27.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb1e80 0x557424fcaa80 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f040400bf10 tx=0x7f0404009ce0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 -- 10.20.193.28:0/540270557 shutdown_connections 2026-02-20T03:22:27.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557424fdf0d0 0x557424fe1550 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 0x557424fd1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb27c0 0x557424fcafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/540270557 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb1e80 0x557424fcaa80 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 -- 10.20.193.28:0/540270557 >> 10.20.193.28:0/540270557 conn(0x557424fa96f0 msgr2=0x557424fb8950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:27.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f03d1ffb640 0 client.17364 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:27.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 -- 10.20.193.28:0/540270557 shutdown_connections 2026-02-20T03:22:27.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 1 -- 10.20.193.28:0/540270557 wait complete. 2026-02-20T03:22:27.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.066+0000 7f041dc4ae00 20 client.17364 trim_cache size 0 max 16384 2026-02-20T03:22:27.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 Processor -- start 2026-02-20T03:22:27.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- start start 2026-02-20T03:22:27.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 0x557424fc98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fd1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 0x557424fc72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f03c0012610 con 0x557424fb27c0 2026-02-20T03:22:27.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f03c000fee0 con 0x557424fb1e80 2026-02-20T03:22:27.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f03c000dd30 con 0x557424fb75a0 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f040bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fd1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f040bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fd1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43648/0 (socket says 10.20.193.28:43648) 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f040bfff640 1 -- 10.20.193.28:0/3208398908 learned_addr learned my addr 10.20.193.28:0/3208398908 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f040bfff640 1 -- 10.20.193.28:0/3208398908 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 msgr2=0x557424fc72c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f040bfff640 1 --2- 10.20.193.28:0/3208398908 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 0x557424fc72c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f040bfff640 1 -- 10.20.193.28:0/3208398908 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 msgr2=0x557424fc98a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f040bfff640 1 --2- 10.20.193.28:0/3208398908 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 0x557424fc98a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f040bfff640 1 -- 10.20.193.28:0/3208398908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557424fc3fe0 con 0x557424fb27c0 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f040bfff640 1 --2- 10.20.193.28:0/3208398908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fd1f00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f03fc002c90 tx=0x7f03fc1026c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ee02894c1b2c8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f0419b5b640 1 -- 10.20.193.28:0/3208398908 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc0d6490 con 0x557424fb27c0 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f0419b5b640 1 -- 10.20.193.28:0/3208398908 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03fc1028d0 con 0x557424fb27c0 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f0419b5b640 1 -- 10.20.193.28:0/3208398908 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc035e10 con 0x557424fb27c0 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3208398908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 msgr2=0x557424fd1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3208398908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fd1f00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f03fc002c90 tx=0x7f03fc1026c0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3208398908 shutdown_connections 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3208398908 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb75a0 0x557424fc72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3208398908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb27c0 0x557424fd1f00 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3208398908 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 0x557424fc98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3208398908 >> 10.20.193.28:0/3208398908 conn(0x557424fa96f0 msgr2=0x557424fc9190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:27.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3208398908 shutdown_connections 2026-02-20T03:22:27.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3208398908 wait complete. 2026-02-20T03:22:27.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- start start 2026-02-20T03:22:27.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 Processor -- start 2026-02-20T03:22:27.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 0x557424fcfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb27c0 0x557424fd0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb75a0 0x557424fd13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f03c000e3a0 con 0x557424fb75a0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f03c000f810 con 0x557424fb1e80 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f03c000ea70 con 0x557424fb27c0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041935a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb75a0 0x557424fd13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041935a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb75a0 0x557424fd13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43652/0 (socket says 10.20.193.28:43652) 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041935a640 1 -- 10.20.193.28:0/3436642831 learned_addr learned my addr 10.20.193.28:0/3436642831 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041935a640 1 -- 10.20.193.28:0/3436642831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb27c0 msgr2=0x557424fd0380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041935a640 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb27c0 0x557424fd0380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041935a640 1 -- 10.20.193.28:0/3436642831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 msgr2=0x557424fcfe40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041935a640 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 0x557424fcfe40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041935a640 1 -- 10.20.193.28:0/3436642831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557424c62690 con 0x557424fb75a0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041935a640 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb75a0 0x557424fd13b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f041000b440 tx=0x7f041000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc3816a91bf9540 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f03d1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f03d1ffb640 1 -- 10.20.193.28:0/3436642831 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410017070 con 0x557424fb75a0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f03d1ffb640 1 -- 10.20.193.28:0/3436642831 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0410002d10 con 0x557424fb75a0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f03d1ffb640 1 -- 10.20.193.28:0/3436642831 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0410006e60 con 0x557424fb75a0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3436642831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557424ec7b70 con 0x557424fb75a0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f03d1ffb640 1 -- 10.20.193.28:0/3436642831 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f041001b3b0 con 0x557424fb75a0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 10 client.17370 _ll_register_callbacks cb 0x7f040400bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:27.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3436642831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0404004480 con 0x557424fb75a0 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f03d1ffb640 1 -- 10.20.193.28:0/3436642831 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f04100047a0 con 0x557424fb75a0 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 10 client.17370 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3436642831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557424fc4cd0 con 0x557424fb75a0 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f03d1ffb640 1 -- 10.20.193.28:0/3436642831 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f04100040b0 con 0x557424fb75a0 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 10 client.17370 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 10 client.17370 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 20 client.17370 populate_metadata read hostname 'trial028' 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55742504ae10 0x55742504d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 4 client.17370 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:22:27.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.074+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3436642831 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557424ed36b0 con 0x55742504ae10 2026-02-20T03:22:27.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.093+0000 7f0418b59640 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55742504ae10 0x55742504d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:27.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.160+0000 7f0418b59640 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55742504ae10 0x55742504d2d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13e37f8b2a09a42 server_cookie=c62d586ffd603c25 in_seq=0 out_seq=0 2026-02-20T03:22:27.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.160+0000 7f03d1ffb640 10 client.17370 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:27.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.297+0000 7f03d1ffb640 1 -- 10.20.193.28:0/3436642831 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557424ed36b0 con 0x55742504ae10 2026-02-20T03:22:27.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.297+0000 7f03d1ffb640 10 client.17370 handle_command_reply: tid=0 2026-02-20T03:22:27.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.297+0000 7f041dc4ae00 1 client.17370 shutdown 2026-02-20T03:22:27.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3436642831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb75a0 msgr2=0x557424fd13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb75a0 0x557424fd13b0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f041000b440 tx=0x7f041000b910 comp rx=0 tx=0).stop 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3436642831 shutdown_connections 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55742504ae10 0x55742504d2d0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557424fb75a0 0x557424fd13b0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557424fb27c0 0x557424fd0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 --2- 10.20.193.28:0/3436642831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557424fb1e80 0x557424fcfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f03d1ffb640 0 client.17370 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3436642831 >> 10.20.193.28:0/3436642831 conn(0x557424fa96f0 msgr2=0x557424fc99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3436642831 shutdown_connections 2026-02-20T03:22:27.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 1 -- 10.20.193.28:0/3436642831 wait complete. 2026-02-20T03:22:27.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f041dc4ae00 20 client.17370 trim_cache size 0 max 16384 2026-02-20T03:22:27.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:22:27.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:22:27.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:22:27.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:22:27.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f03e17ff640 1 -- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03f00b0e20 msgr2=0x7f03f00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:27.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.298+0000 7f03e17ff640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03f00b0e20 0x7f03f00b32e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0404014040 tx=0x7f0404009460 comp rx=0 tx=0).stop 2026-02-20T03:22:27.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 -- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104f10 msgr2=0x7f041419d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:27.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104f10 0x7f041419d190 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009950 tx=0x7f03fc02fd60 comp rx=0 tx=0).stop 2026-02-20T03:22:27.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 -- 10.20.193.28:0/3755213485 shutdown_connections 2026-02-20T03:22:27.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03f00b0e20 0x7f03f00b32e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0414106020 0x7f04141a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0414104f10 0x7f041419d190 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 --2- 10.20.193.28:0/3755213485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0414104550 0x7f041419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:27.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 -- 10.20.193.28:0/3755213485 >> 10.20.193.28:0/3755213485 conn(0x7f04141000e0 msgr2=0x7f0414108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:27.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 -- 10.20.193.28:0/3755213485 shutdown_connections 2026-02-20T03:22:27.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:27.299+0000 7f03e17ff640 1 -- 10.20.193.28:0/3755213485 wait complete. 2026-02-20T03:22:27.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:27 trial028 ceph-mon[38552]: pgmap v414: 129 pgs: 129 active+clean; 123 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 275 KiB/s rd, 2.7 MiB/s wr, 139 op/s 2026-02-20T03:22:27.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 659185 8.09 MB/sec execute 240 sec latency 2033.780 ms 2026-02-20T03:22:27.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:27 trial126 ceph-mon[38476]: pgmap v414: 129 pgs: 129 active+clean; 123 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 275 KiB/s rd, 2.7 MiB/s wr, 139 op/s 2026-02-20T03:22:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:27 trial177 ceph-mon[43181]: pgmap v414: 129 pgs: 129 active+clean; 123 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 275 KiB/s rd, 2.7 MiB/s wr, 139 op/s 2026-02-20T03:22:28.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 660744 8.11 MB/sec execute 241 sec latency 2211.094 ms 2026-02-20T03:22:29.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 664325 8.15 MB/sec execute 242 sec latency 13.075 ms 2026-02-20T03:22:29.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:29 trial126 ceph-mon[38476]: pgmap v415: 129 pgs: 129 active+clean; 115 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 369 KiB/s rd, 2.5 MiB/s wr, 147 op/s 2026-02-20T03:22:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:29 trial028 ceph-mon[38552]: pgmap v415: 129 pgs: 129 active+clean; 115 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 369 KiB/s rd, 2.5 MiB/s wr, 147 op/s 2026-02-20T03:22:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:29 trial177 ceph-mon[43181]: pgmap v415: 129 pgs: 129 active+clean; 115 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 369 KiB/s rd, 2.5 MiB/s wr, 147 op/s 2026-02-20T03:22:30.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 666866 8.16 MB/sec execute 243 sec latency 207.379 ms 2026-02-20T03:22:31.374 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:31 trial028 ceph-mon[38552]: pgmap v416: 129 pgs: 129 active+clean; 112 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 208 op/s 2026-02-20T03:22:31.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 666867 8.13 MB/sec execute 244 sec latency 739.060 ms 2026-02-20T03:22:31.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:31 trial126 ceph-mon[38476]: pgmap v416: 129 pgs: 129 active+clean; 112 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 208 op/s 2026-02-20T03:22:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:31 trial177 ceph-mon[43181]: pgmap v416: 129 pgs: 129 active+clean; 112 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 3.0 MiB/s wr, 208 op/s 2026-02-20T03:22:32.510 INFO:tasks.workunit.client.0.trial028.stdout: 1 666971 8.10 MB/sec execute 245 sec latency 1726.688 ms 2026-02-20T03:22:33.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 670493 8.14 MB/sec execute 246 sec latency 14.905 ms 2026-02-20T03:22:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:33 trial126 ceph-mon[38476]: pgmap v417: 129 pgs: 129 active+clean; 113 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 220 op/s 2026-02-20T03:22:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:33 trial028 ceph-mon[38552]: pgmap v417: 129 pgs: 129 active+clean; 113 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 220 op/s 2026-02-20T03:22:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:33 trial177 ceph-mon[43181]: pgmap v417: 129 pgs: 129 active+clean; 113 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 220 op/s 2026-02-20T03:22:34.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 673968 8.19 MB/sec execute 247 sec latency 7.591 ms 2026-02-20T03:22:35.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 677332 8.22 MB/sec execute 248 sec latency 40.015 ms 2026-02-20T03:22:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:35 trial126 ceph-mon[38476]: pgmap v418: 129 pgs: 129 active+clean; 114 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 230 op/s 2026-02-20T03:22:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:35 trial028 ceph-mon[38552]: pgmap v418: 129 pgs: 129 active+clean; 114 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 230 op/s 2026-02-20T03:22:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:35 trial177 ceph-mon[43181]: pgmap v418: 129 pgs: 129 active+clean; 114 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 230 op/s 2026-02-20T03:22:36.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 680913 8.26 MB/sec execute 249 sec latency 36.582 ms 2026-02-20T03:22:37.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 684624 8.32 MB/sec execute 250 sec latency 7.788 ms 2026-02-20T03:22:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:37 trial126 ceph-mon[38476]: pgmap v419: 129 pgs: 129 active+clean; 116 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2026-02-20T03:22:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:37 trial028 ceph-mon[38552]: pgmap v419: 129 pgs: 129 active+clean; 116 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2026-02-20T03:22:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:37 trial177 ceph-mon[43181]: pgmap v419: 129 pgs: 129 active+clean; 116 MiB data, 2.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 293 op/s 2026-02-20T03:22:38.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 688177 8.36 MB/sec execute 251 sec latency 7.282 ms 2026-02-20T03:22:38.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:38 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:22:38.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:38 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:22:38.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:38 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:22:39.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 691826 8.41 MB/sec execute 252 sec latency 10.094 ms 2026-02-20T03:22:39.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:39 trial126 ceph-mon[38476]: pgmap v420: 129 pgs: 129 active+clean; 115 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 309 op/s 2026-02-20T03:22:39.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:22:39.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:22:39.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:22:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:39 trial028 ceph-mon[38552]: pgmap v420: 129 pgs: 129 active+clean; 115 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 309 op/s 2026-02-20T03:22:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:22:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:22:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:22:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:39 trial177 ceph-mon[43181]: pgmap v420: 129 pgs: 129 active+clean; 115 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 309 op/s 2026-02-20T03:22:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:22:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:22:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:22:40.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/1940207265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 msgr2=0x7fbb84104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:40.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/1940207265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 0x7fbb84104d40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009a30 tx=0x7fbb7402f220 comp rx=0 tx=0).stop 2026-02-20T03:22:40.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/1940207265 shutdown_connections 2026-02-20T03:22:40.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/1940207265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb841064f0 0x7fbb8410cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/1940207265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb84105b30 0x7fbb84105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/1940207265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 0x7fbb84104d40 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/1940207265 >> 10.20.193.28:0/1940207265 conn(0x7fbb841000c0 msgr2=0x7fbb841024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/1940207265 shutdown_connections 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/1940207265 wait complete. 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.376+0000 7fbb8a7a2640 1 Processor -- start 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb8a7a2640 1 -- start start 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb8a7a2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 0x7fbb8419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb8a7a2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb84105b30 0x7fbb8419cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb8a7a2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb841064f0 0x7fbb841a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb8a7a2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbb841103e0 con 0x7fbb84104940 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb8a7a2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbb84110260 con 0x7fbb841064f0 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb8a7a2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb84110560 con 0x7fbb84105b30 2026-02-20T03:22:40.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 0x7fbb8419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 0x7fbb8419ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41282/0 (socket says 10.20.193.28:41282) 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb897a0640 1 -- 10.20.193.28:0/84645212 learned_addr learned my addr 10.20.193.28:0/84645212 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb89fa1640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb841064f0 0x7fbb841a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb84105b30 0x7fbb8419cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb897a0640 1 -- 10.20.193.28:0/84645212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb84105b30 msgr2=0x7fbb8419cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb897a0640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb84105b30 0x7fbb8419cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb897a0640 1 -- 10.20.193.28:0/84645212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb841064f0 msgr2=0x7fbb841a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb897a0640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb841064f0 0x7fbb841a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.377+0000 7fbb897a0640 1 -- 10.20.193.28:0/84645212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb841a46d0 con 0x7fbb84104940 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.378+0000 7fbb897a0640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 0x7fbb8419ca20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbb74002410 tx=0x7fbb7402fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:40.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.378+0000 7fbb727fc640 1 -- 10.20.193.28:0/84645212 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74004260 con 0x7fbb84104940 2026-02-20T03:22:40.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.378+0000 7fbb727fc640 1 -- 10.20.193.28:0/84645212 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb74004400 con 0x7fbb84104940 2026-02-20T03:22:40.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.378+0000 7fbb727fc640 1 -- 10.20.193.28:0/84645212 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74041820 con 0x7fbb84104940 2026-02-20T03:22:40.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.378+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/84645212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb841a4960 con 0x7fbb84104940 2026-02-20T03:22:40.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.378+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/84645212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb841a4e00 con 0x7fbb84104940 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.380+0000 7fbb727fc640 1 -- 10.20.193.28:0/84645212 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbb740419c0 con 0x7fbb84104940 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb8e88de00 1 Processor -- start 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb8e88de00 1 -- start start 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aa1d0 0x56205c9ae950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aef70 0x56205c9b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56205c8f18f0 con 0x56205c9aef70 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56205c89f2e0 con 0x56205c9a9890 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56205c8ed820 con 0x56205c9aa1d0 2026-02-20T03:22:40.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb89fa1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aa1d0 0x56205c9ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aa1d0 0x56205c9ae950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50908/0 (socket says 10.20.193.28:50908) 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb897a0640 1 -- 10.20.193.28:0/3806978237 learned_addr learned my addr 10.20.193.28:0/3806978237 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.381+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/3806978237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aef70 0x56205c9b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb88f9f640 1 -- 10.20.193.28:0/3806978237 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aa1d0 msgr2=0x56205c9ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/3806978237 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aa1d0 0x56205c9ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb88f9f640 1 -- 10.20.193.28:0/3806978237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 msgr2=0x56205c9a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/3806978237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb88f9f640 1 -- 10.20.193.28:0/3806978237 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205c8915a0 con 0x56205c9aef70 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/3806978237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aef70 0x56205c9b1400 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fbb78005fd0 tx=0x7fbb78002e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849955d7cb426a59 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb51bfe640 1 -- 10.20.193.28:0/3806978237 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7800fc30 con 0x56205c9aef70 2026-02-20T03:22:40.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb51bfe640 1 -- 10.20.193.28:0/3806978237 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb7800fdd0 con 0x56205c9aef70 2026-02-20T03:22:40.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb51bfe640 1 -- 10.20.193.28:0/3806978237 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb780107b0 con 0x56205c9aef70 2026-02-20T03:22:40.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb727fc640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb600b0e20 0x7fbb600b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb8e88de00 1 -- 10.20.193.28:0/3806978237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aef70 msgr2=0x56205c9b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:40.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/3806978237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aef70 0x56205c9b1400 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fbb78005fd0 tx=0x7fbb78002e90 comp rx=0 tx=0).stop 2026-02-20T03:22:40.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb727fc640 1 -- 10.20.193.28:0/84645212 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fbb741053a0 con 0x7fbb84104940 2026-02-20T03:22:40.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.382+0000 7fbb89fa1640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb600b0e20 0x7fbb600b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.383+0000 7fbb8e88de00 1 -- 10.20.193.28:0/3806978237 shutdown_connections 2026-02-20T03:22:40.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.383+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/3806978237 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aef70 0x56205c9b1400 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.389 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.383+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/3806978237 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aa1d0 0x56205c9ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.383+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/3806978237 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.383+0000 7fbb8e88de00 1 -- 10.20.193.28:0/3806978237 >> 10.20.193.28:0/3806978237 conn(0x56205c9986f0 msgr2=0x56205c9a7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:40.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.383+0000 7fbb8e88de00 1 -- 10.20.193.28:0/3806978237 shutdown_connections 2026-02-20T03:22:40.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.383+0000 7fbb8e88de00 1 -- 10.20.193.28:0/3806978237 wait complete. 2026-02-20T03:22:40.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.383+0000 7fbb89fa1640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb600b0e20 0x7fbb600b32e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009dc0 tx=0x7fbb8000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:40.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.384+0000 7fbb8e88de00 1 -- start start 2026-02-20T03:22:40.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.384+0000 7fbb8e88de00 1 Processor -- start 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.384+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.384+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.384+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.384+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56205c8990c0 con 0x56205c9aa1d0 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.384+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56205c9b2020 con 0x56205c9a9890 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.384+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56205c9c9df0 con 0x56205c9aef70 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb88f9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb88f9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41300/0 (socket says 10.20.193.28:41300) 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb88f9f640 1 -- 10.20.193.28:0/672209605 learned_addr learned my addr 10.20.193.28:0/672209605 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:40.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41932/0 (socket says 10.20.193.28:41932) 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb89fa1640 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb88f9f640 1 -- 10.20.193.28:0/672209605 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 msgr2=0x56205c9c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb88f9f640 1 -- 10.20.193.28:0/672209605 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 msgr2=0x56205c9c23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb88f9f640 1 -- 10.20.193.28:0/672209605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205c9bbaf0 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c28e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800fc70 tx=0x7fbb7800fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1235b08cbee2c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb3effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb3effd640 1 -- 10.20.193.28:0/672209605 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb780049d0 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb3effd640 1 -- 10.20.193.28:0/672209605 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb780054e0 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.385+0000 7fbb3effd640 1 -- 10.20.193.28:0/672209605 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb780116a0 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 1 -- 10.20.193.28:0/672209605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56205c8ad820 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 10 client.17382 _ll_register_callbacks cb 0x56205c89cff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 1 -- 10.20.193.28:0/672209605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56205c8f94e0 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb3effd640 1 -- 10.20.193.28:0/672209605 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fbb78005690 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb3effd640 1 -- 10.20.193.28:0/672209605 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb78004e50 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 10 client.17382 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 1 -- 10.20.193.28:0/672209605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56205c8b2380 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb3effd640 1 -- 10.20.193.28:0/672209605 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fbb78005040 con 0x56205c9aa1d0 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 10 client.17382 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 10 client.17382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 20 client.17382 populate_metadata read hostname 'trial028' 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56205c9cdef0 0x56205c9d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 4 client.17382 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.386+0000 7fbb8e88de00 1 -- 10.20.193.28:0/672209605 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56205c873bd0 con 0x56205c9cdef0 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.387+0000 7fbb897a0640 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56205c9cdef0 0x56205c9d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.387+0000 7fbb897a0640 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56205c9cdef0 0x56205c9d0380 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df76b3f25668d30 server_cookie=e53ff9f00167ccaa in_seq=0 out_seq=0 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.387+0000 7fbb3effd640 10 client.17382 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb3effd640 1 -- 10.20.193.28:0/672209605 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56205c873bd0 con 0x56205c9cdef0 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb3effd640 10 client.17382 handle_command_reply: tid=0 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 client.17382 shutdown 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 -- 10.20.193.28:0/672209605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 msgr2=0x56205c9c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c28e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800fc70 tx=0x7fbb7800fca0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 -- 10.20.193.28:0/672209605 shutdown_connections 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56205c9cdef0 0x56205c9d0380 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c28e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/672209605 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 -- 10.20.193.28:0/672209605 >> 10.20.193.28:0/672209605 conn(0x56205c9986f0 msgr2=0x56205c9a7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb3effd640 0 client.17382 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 -- 10.20.193.28:0/672209605 shutdown_connections 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 1 -- 10.20.193.28:0/672209605 wait complete. 2026-02-20T03:22:40.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.388+0000 7fbb8e88de00 20 client.17382 trim_cache size 0 max 16384 2026-02-20T03:22:40.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.395+0000 7fbb8e88de00 1 Processor -- start 2026-02-20T03:22:40.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.395+0000 7fbb8e88de00 1 -- start start 2026-02-20T03:22:40.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.395+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9a9890 0x56205c9c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.395+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9aa1d0 0x56205c9c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.395+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.395+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30012670 con 0x56205c9a9890 2026-02-20T03:22:40.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.395+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3000ff40 con 0x56205c9aa1d0 2026-02-20T03:22:40.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.395+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3000dd90 con 0x56205c9aef70 2026-02-20T03:22:40.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9a9890 0x56205c9c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9a9890 0x56205c9c16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41314/0 (socket says 10.20.193.28:41314) 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb897a0640 1 -- 10.20.193.28:0/838795116 learned_addr learned my addr 10.20.193.28:0/838795116 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/838795116 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9aa1d0 0x56205c9c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb89fa1640 1 --2- 10.20.193.28:0/838795116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb897a0640 1 -- 10.20.193.28:0/838795116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 msgr2=0x56205c9c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb897a0640 1 --2- 10.20.193.28:0/838795116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb897a0640 1 -- 10.20.193.28:0/838795116 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9aa1d0 msgr2=0x56205c9c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb897a0640 1 --2- 10.20.193.28:0/838795116 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9aa1d0 0x56205c9c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb897a0640 1 -- 10.20.193.28:0/838795116 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205c9bb920 con 0x56205c9a9890 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb897a0640 1 --2- 10.20.193.28:0/838795116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9a9890 0x56205c9c16e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbb740046d0 tx=0x7fbb74108de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932bbb856b9be798 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:40.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb513fd640 1 -- 10.20.193.28:0/838795116 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb740c8cf0 con 0x56205c9a9890 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb513fd640 1 -- 10.20.193.28:0/838795116 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb74033040 con 0x56205c9a9890 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.396+0000 7fbb513fd640 1 -- 10.20.193.28:0/838795116 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb740cc5a0 con 0x56205c9a9890 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 -- 10.20.193.28:0/838795116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9a9890 msgr2=0x56205c9c16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/838795116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9a9890 0x56205c9c16e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbb740046d0 tx=0x7fbb74108de0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 -- 10.20.193.28:0/838795116 shutdown_connections 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/838795116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/838795116 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9aa1d0 0x56205c9c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/838795116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9a9890 0x56205c9c16e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 -- 10.20.193.28:0/838795116 >> 10.20.193.28:0/838795116 conn(0x56205c9986f0 msgr2=0x56205c9a7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 -- 10.20.193.28:0/838795116 shutdown_connections 2026-02-20T03:22:40.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 -- 10.20.193.28:0/838795116 wait complete. 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.397+0000 7fbb8e88de00 1 -- start start 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb8e88de00 1 Processor -- start 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb8e88de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3000e400 con 0x56205c9aa1d0 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3000f870 con 0x56205c9a9890 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb8e88de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb3000ead0 con 0x56205c9aef70 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb88f9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb897a0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41950/0 (socket says 10.20.193.28:41950) 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb897a0640 1 -- 10.20.193.28:0/2271889701 learned_addr learned my addr 10.20.193.28:0/2271889701 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb88f9f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41318/0 (socket says 10.20.193.28:41318) 2026-02-20T03:22:40.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb89fa1640 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb897a0640 1 -- 10.20.193.28:0/2271889701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 msgr2=0x56205c9c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb897a0640 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb897a0640 1 -- 10.20.193.28:0/2271889701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 msgr2=0x56205c9c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb897a0640 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb897a0640 1 -- 10.20.193.28:0/2271889701 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56205c651690 con 0x56205c9a9890 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.398+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb897a0640 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c91a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbb7402ffa0 tx=0x7fbb74038e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794c9fa3c5d8d613 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb3effd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb3effd640 1 -- 10.20.193.28:0/2271889701 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb740cc780 con 0x56205c9a9890 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 1 -- 10.20.193.28:0/2271889701 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56205c8b6b70 con 0x56205c9a9890 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb3effd640 1 -- 10.20.193.28:0/2271889701 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb740cd780 con 0x56205c9a9890 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb3effd640 1 -- 10.20.193.28:0/2271889701 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb740cce50 con 0x56205c9a9890 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 10 client.26759 _ll_register_callbacks cb 0x7fbb78002870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 1 -- 10.20.193.28:0/2271889701 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56205c6ca520 con 0x56205c9a9890 2026-02-20T03:22:40.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb3effd640 1 -- 10.20.193.28:0/2271889701 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fbb740d5e50 con 0x56205c9a9890 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb3effd640 1 -- 10.20.193.28:0/2271889701 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb740d60b0 con 0x56205c9a9890 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 10 client.26759 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 1 -- 10.20.193.28:0/2271889701 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56205c9bc610 con 0x56205c9a9890 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb3effd640 1 -- 10.20.193.28:0/2271889701 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fbb740b9120 con 0x56205c9a9890 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 10 client.26759 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 10 client.26759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 20 client.26759 populate_metadata read hostname 'trial028' 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56205ca39e60 0x56205ca3c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 4 client.26759 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.399+0000 7fbb8e88de00 1 -- 10.20.193.28:0/2271889701 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56205c8ff290 con 0x56205ca39e60 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.400+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56205ca39e60 0x56205ca3c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.400+0000 7fbb88f9f640 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56205ca39e60 0x56205ca3c2f0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fc990711531ade server_cookie=ae4bf51940636433 in_seq=0 out_seq=0 2026-02-20T03:22:40.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.400+0000 7fbb3effd640 10 client.26759 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:40.497 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb3effd640 1 -- 10.20.193.28:0/2271889701 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56205c8ff290 con 0x56205ca39e60 2026-02-20T03:22:40.497 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb3effd640 10 client.26759 handle_command_reply: tid=0 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 client.26759 shutdown 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 -- 10.20.193.28:0/2271889701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 msgr2=0x56205c9c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c91a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbb7402ffa0 tx=0x7fbb74038e60 comp rx=0 tx=0).stop 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 -- 10.20.193.28:0/2271889701 shutdown_connections 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56205ca39e60 0x56205ca3c2f0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56205c9aef70 0x56205c9c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56205c9aa1d0 0x56205c9c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 --2- 10.20.193.28:0/2271889701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56205c9a9890 0x56205c9c91a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb3effd640 0 client.26759 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:40.498 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 -- 10.20.193.28:0/2271889701 >> 10.20.193.28:0/2271889701 conn(0x56205c9986f0 msgr2=0x56205c9a87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:40.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 -- 10.20.193.28:0/2271889701 shutdown_connections 2026-02-20T03:22:40.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.494+0000 7fbb8e88de00 1 -- 10.20.193.28:0/2271889701 wait complete. 2026-02-20T03:22:40.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8e88de00 20 client.26759 trim_cache size 0 max 16384 2026-02-20T03:22:40.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:22:40.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:22:40.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:22:40.499 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:22:40.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb600b0e20 msgr2=0x7fbb600b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:40.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb600b0e20 0x7fbb600b32e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009dc0 tx=0x7fbb8000b040 comp rx=0 tx=0).stop 2026-02-20T03:22:40.500 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 msgr2=0x7fbb8419ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:40.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 0x7fbb8419ca20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbb74002410 tx=0x7fbb7402fcb0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/84645212 shutdown_connections 2026-02-20T03:22:40.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb600b0e20 0x7fbb600b32e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb841064f0 0x7fbb841a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb84105b30 0x7fbb8419cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 --2- 10.20.193.28:0/84645212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb84104940 0x7fbb8419ca20 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:40.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/84645212 >> 10.20.193.28:0/84645212 conn(0x7fbb841000c0 msgr2=0x7fbb84108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:40.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/84645212 shutdown_connections 2026-02-20T03:22:40.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:40.495+0000 7fbb8a7a2640 1 -- 10.20.193.28:0/84645212 wait complete. 2026-02-20T03:22:40.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 694959 8.43 MB/sec execute 253 sec latency 40.283 ms 2026-02-20T03:22:41.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 698483 8.47 MB/sec execute 254 sec latency 11.577 ms 2026-02-20T03:22:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:41 trial126 ceph-mon[38476]: pgmap v421: 129 pgs: 129 active+clean; 120 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 383 op/s 2026-02-20T03:22:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:41 trial028 ceph-mon[38552]: pgmap v421: 129 pgs: 129 active+clean; 120 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 383 op/s 2026-02-20T03:22:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:41 trial177 ceph-mon[43181]: pgmap v421: 129 pgs: 129 active+clean; 120 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 383 op/s 2026-02-20T03:22:42.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 702084 8.52 MB/sec execute 255 sec latency 6.297 ms 2026-02-20T03:22:43.200 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:22:43.470 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:43.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 705508 8.56 MB/sec execute 256 sec latency 9.654 ms 2026-02-20T03:22:43.514 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:43 trial028 ceph-mon[38552]: pgmap v422: 129 pgs: 129 active+clean; 122 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 336 op/s 2026-02-20T03:22:43.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:43 trial126 ceph-mon[38476]: pgmap v422: 129 pgs: 129 active+clean; 122 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 336 op/s 2026-02-20T03:22:43.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.662+0000 7f7b77fff640 1 -- 10.20.193.28:0/2033651924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 msgr2=0x7f7b781114b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:43.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.662+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2033651924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 0x7f7b781114b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800b0a0 tx=0x7f7b6802f410 comp rx=0 tx=0).stop 2026-02-20T03:22:43.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.662+0000 7f7b77fff640 1 -- 10.20.193.28:0/2033651924 shutdown_connections 2026-02-20T03:22:43.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.662+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2033651924 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 0x7f7b781114b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.662+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2033651924 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7b78075d40 0x7f7b7810eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.662+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2033651924 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78075390 0x7f7b78075770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.662+0000 7f7b77fff640 1 -- 10.20.193.28:0/2033651924 >> 10.20.193.28:0/2033651924 conn(0x7f7b780fe3e0 msgr2=0x7f7b78100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:43.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.663+0000 7f7b77fff640 1 -- 10.20.193.28:0/2033651924 shutdown_connections 2026-02-20T03:22:43.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.663+0000 7f7b77fff640 1 -- 10.20.193.28:0/2033651924 wait complete. 2026-02-20T03:22:43.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b77fff640 1 Processor -- start 2026-02-20T03:22:43.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b77fff640 1 -- start start 2026-02-20T03:22:43.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b77fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78075390 0x7f7b7819cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b77fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7b78075d40 0x7f7b7819d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b77fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 0x7f7b781a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b77fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78114be0 con 0x7f7b7810f0c0 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b77fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78114a60 con 0x7f7b78075390 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b77fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78114d60 con 0x7f7b78075d40 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 0x7f7b781a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b76ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78075390 0x7f7b7819cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 0x7f7b781a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41328/0 (socket says 10.20.193.28:41328) 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b777fe640 1 -- 10.20.193.28:0/2098804426 learned_addr learned my addr 10.20.193.28:0/2098804426 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.664+0000 7f7b767fc640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7b78075d40 0x7f7b7819d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b76ffd640 1 -- 10.20.193.28:0/2098804426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7b78075d40 msgr2=0x7f7b7819d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:43.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7b78075d40 0x7f7b7819d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b76ffd640 1 -- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 msgr2=0x7f7b781a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:43.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 0x7f7b781a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b76ffd640 1 -- 10.20.193.28:0/2098804426 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b781a2000 con 0x7f7b78075390 2026-02-20T03:22:43.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b777fe640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 0x7f7b781a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:43.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78075390 0x7f7b7819cfb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00e9f0 tx=0x7f7b6c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:43.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b7c9e3640 1 -- 10.20.193.28:0/2098804426 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c00cd80 con 0x7f7b78075390 2026-02-20T03:22:43.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b7c9e3640 1 -- 10.20.193.28:0/2098804426 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7b6c004570 con 0x7f7b78075390 2026-02-20T03:22:43.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b77fff640 1 -- 10.20.193.28:0/2098804426 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b781a22f0 con 0x7f7b78075390 2026-02-20T03:22:43.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b77fff640 1 -- 10.20.193.28:0/2098804426 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b781a9b30 con 0x7f7b78075390 2026-02-20T03:22:43.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.665+0000 7f7b7c9e3640 1 -- 10.20.193.28:0/2098804426 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c010690 con 0x7f7b78075390 2026-02-20T03:22:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.668+0000 7f7b7c9e3640 1 -- 10.20.193.28:0/2098804426 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7b6c020030 con 0x7f7b78075390 2026-02-20T03:22:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.668+0000 7f7b7feeae00 1 Processor -- start 2026-02-20T03:22:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b7feeae00 1 -- start start 2026-02-20T03:22:43.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09f630 0x55e5aa09fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e5aa01fe50 con 0x55e5aa0a5000 2026-02-20T03:22:43.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e5a9ff29c0 con 0x55e5aa09ffb0 2026-02-20T03:22:43.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e5a9fa0240 con 0x55e5aa09f630 2026-02-20T03:22:43.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b76ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09f630 0x55e5aa09fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b76ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09f630 0x55e5aa09fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50976/0 (socket says 10.20.193.28:50976) 2026-02-20T03:22:43.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b76ffd640 1 -- 10.20.193.28:0/3809192911 learned_addr learned my addr 10.20.193.28:0/3809192911 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:43.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b777fe640 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b767fc640 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b76ffd640 1 -- 10.20.193.28:0/3809192911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 msgr2=0x55e5aa0abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b76ffd640 1 -- 10.20.193.28:0/3809192911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 msgr2=0x55e5aa0a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0a53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.669+0000 7f7b76ffd640 1 -- 10.20.193.28:0/3809192911 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a9fb3420 con 0x55e5aa09f630 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.670+0000 7f7b7c9e3640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7b4c0b0da0 0x7f7b4c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.670+0000 7f7b777fe640 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0a53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.670+0000 7f7b7c9e3640 1 -- 10.20.193.28:0/2098804426 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f7b6c0e0ae0 con 0x7f7b78075390 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.670+0000 7f7b777fe640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7b4c0b0da0 0x7f7b4c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.670+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09f630 0x55e5aa09fa70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0e4a00 tx=0x7f7b6c0e4ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=debc327bb03f80ce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.670+0000 7f7b3bfff640 1 -- 10.20.193.28:0/3809192911 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0afe60 con 0x55e5aa09f630 2026-02-20T03:22:43.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.670+0000 7f7b3bfff640 1 -- 10.20.193.28:0/3809192911 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7b6c0a8ec0 con 0x55e5aa09f630 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3809192911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09f630 msgr2=0x55e5aa09fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09f630 0x55e5aa09fa70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0e4a00 tx=0x7f7b6c0e4ed0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b777fe640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7b4c0b0da0 0x7f7b4c0b3260 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7b68004450 tx=0x7f7b6803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b3bfff640 1 -- 10.20.193.28:0/3809192911 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0afe60 con 0x55e5aa09f630 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3809192911 shutdown_connections 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09f630 0x55e5aa09fa70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3809192911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0a53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3809192911 >> 10.20.193.28:0/3809192911 conn(0x55e5aa062290 msgr2=0x55e5aa09dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3809192911 shutdown_connections 2026-02-20T03:22:43.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.671+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3809192911 wait complete. 2026-02-20T03:22:43.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.672+0000 7f7b7feeae00 1 -- start start 2026-02-20T03:22:43.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b7feeae00 1 Processor -- start 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa0b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa0a5000 0x55e5aa0b8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e5a9fee8f0 con 0x55e5aa09f630 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e5a9de0f50 con 0x55e5aa09ffb0 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e5aa0b8880 con 0x55e5aa0a5000 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b767fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b767fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41990/0 (socket says 10.20.193.28:41990) 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b767fc640 1 -- 10.20.193.28:0/3237402438 learned_addr learned my addr 10.20.193.28:0/3237402438 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa0b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.673+0000 7f7b777fe640 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa0a5000 0x55e5aa0b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b76ffd640 1 -- 10.20.193.28:0/3237402438 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa0a5000 msgr2=0x55e5aa0b8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa0a5000 0x55e5aa0b8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b76ffd640 1 -- 10.20.193.28:0/3237402438 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 msgr2=0x55e5aa0b9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b76ffd640 1 -- 10.20.193.28:0/3237402438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5aa0b1a80 con 0x55e5aa09f630 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b767fc640 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b777fe640 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa0a5000 0x55e5aa0b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa0b99c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0a9070 tx=0x7f7b6c0a82b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71aa4fe1024746e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b397fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b397fa640 1 -- 10.20.193.28:0/3237402438 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0afe60 con 0x55e5aa09f630 2026-02-20T03:22:43.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b397fa640 1 -- 10.20.193.28:0/3237402438 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7b6c0acb70 con 0x55e5aa09f630 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b397fa640 1 -- 10.20.193.28:0/3237402438 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0a4430 con 0x55e5aa09f630 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3237402438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a9dc3b40 con 0x55e5aa09f630 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b7feeae00 10 client.17400 _ll_register_callbacks cb 0x55e5aa02bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3237402438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e5aa0001a0 con 0x55e5aa09f630 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b397fa640 1 -- 10.20.193.28:0/3237402438 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f7b6c004070 con 0x55e5aa09f630 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b397fa640 1 -- 10.20.193.28:0/3237402438 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b6c0a7ec0 con 0x55e5aa09f630 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b7feeae00 10 client.17400 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.674+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3237402438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e5a9fad230 con 0x55e5aa09f630 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b397fa640 1 -- 10.20.193.28:0/3237402438 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7b6c0a77d0 con 0x55e5aa09f630 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b7feeae00 10 client.17400 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b7feeae00 10 client.17400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b7feeae00 20 client.17400 populate_metadata read hostname 'trial028' 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e5aa0c7de0 0x55e5aa0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b7feeae00 4 client.17400 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3237402438 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5a9ffa5b0 con 0x55e5aa0c7de0 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b767fc640 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e5aa0c7de0 0x55e5aa0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b767fc640 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e5aa0c7de0 0x55e5aa0ca1d0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b53ccf1881902dad server_cookie=6280555ea4c9b619 in_seq=0 out_seq=0 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.675+0000 7f7b397fa640 10 client.17400 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b397fa640 1 -- 10.20.193.28:0/3237402438 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e5a9ffa5b0 con 0x55e5aa0c7de0 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b397fa640 10 client.17400 handle_command_reply: tid=0 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 client.17400 shutdown 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3237402438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 msgr2=0x55e5aa0b99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa0b99c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0a9070 tx=0x7f7b6c0a82b0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3237402438 shutdown_connections 2026-02-20T03:22:43.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e5aa0c7de0 0x55e5aa0ca1d0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa0a5000 0x55e5aa0b8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/3237402438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa0b99c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b397fa640 0 client.17400 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:43.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3237402438 >> 10.20.193.28:0/3237402438 conn(0x55e5aa062290 msgr2=0x55e5aa09e440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:43.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3237402438 shutdown_connections 2026-02-20T03:22:43.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 1 -- 10.20.193.28:0/3237402438 wait complete. 2026-02-20T03:22:43.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.676+0000 7f7b7feeae00 20 client.17400 trim_cache size 0 max 16384 2026-02-20T03:22:43.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.685+0000 7f7b7feeae00 1 Processor -- start 2026-02-20T03:22:43.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.685+0000 7f7b7feeae00 1 -- start start 2026-02-20T03:22:43.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa097d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa0a5000 0x55e5aa09e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c0126f0 con 0x55e5aa09f630 2026-02-20T03:22:43.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c00ffc0 con 0x55e5aa0a5000 2026-02-20T03:22:43.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c00de10 con 0x55e5aa09ffb0 2026-02-20T03:22:43.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b76ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa097d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b76ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa097d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41334/0 (socket says 10.20.193.28:41334) 2026-02-20T03:22:43.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b76ffd640 1 -- 10.20.193.28:0/1928954428 learned_addr learned my addr 10.20.193.28:0/1928954428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b777fe640 1 --2- 10.20.193.28:0/1928954428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa0a5000 0x55e5aa09e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b767fc640 1 --2- 10.20.193.28:0/1928954428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b76ffd640 1 -- 10.20.193.28:0/1928954428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 msgr2=0x55e5aa0b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/1928954428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b76ffd640 1 -- 10.20.193.28:0/1928954428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa0a5000 msgr2=0x55e5aa09e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/1928954428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa0a5000 0x55e5aa09e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b76ffd640 1 -- 10.20.193.28:0/1928954428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5aa0b8470 con 0x55e5aa09f630 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.686+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/1928954428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa097d50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0a45f0 tx=0x55e5aa0b9400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b783fde3972121e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b3b7fe640 1 -- 10.20.193.28:0/1928954428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0afe60 con 0x55e5aa09f630 2026-02-20T03:22:43.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b3b7fe640 1 -- 10.20.193.28:0/1928954428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e5aa0001a0 con 0x55e5aa09f630 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b3b7fe640 1 -- 10.20.193.28:0/1928954428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0a8590 con 0x55e5aa09f630 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1928954428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 msgr2=0x55e5aa097d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1928954428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa097d50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0a45f0 tx=0x55e5aa0b9400 comp rx=0 tx=0).stop 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1928954428 shutdown_connections 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1928954428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa0a5000 0x55e5aa09e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1928954428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1928954428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa09f630 0x55e5aa097d50 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1928954428 >> 10.20.193.28:0/1928954428 conn(0x55e5aa062290 msgr2=0x55e5aa0b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1928954428 shutdown_connections 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.687+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1928954428 wait complete. 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.688+0000 7f7b7feeae00 1 -- start start 2026-02-20T03:22:43.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.688+0000 7f7b7feeae00 1 Processor -- start 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.688+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09f630 0x55e5aa0c0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.688+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0bc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.688+0000 7f7b7feeae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.688+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c00e480 con 0x55e5aa0a5000 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.688+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c00f8f0 con 0x55e5aa09f630 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.688+0000 7f7b7feeae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c00eb50 con 0x55e5aa09ffb0 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b76ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09f630 0x55e5aa0c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b76ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09f630 0x55e5aa0c0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41998/0 (socket says 10.20.193.28:41998) 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b76ffd640 1 -- 10.20.193.28:0/1361497342 learned_addr learned my addr 10.20.193.28:0/1361497342 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b777fe640 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b767fc640 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b76ffd640 1 -- 10.20.193.28:0/1361497342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 msgr2=0x55e5aa0bc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0bc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b76ffd640 1 -- 10.20.193.28:0/1361497342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 msgr2=0x55e5aa0bcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0bcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b76ffd640 1 -- 10.20.193.28:0/1361497342 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a9d62990 con 0x55e5aa09f630 2026-02-20T03:22:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b767fc640 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:43.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b777fe640 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:43.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b76ffd640 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09f630 0x55e5aa0c0010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0a57e0 tx=0x7f7b6c0a7c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a98b6d8d5b84fd9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b397fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b397fa640 1 -- 10.20.193.28:0/1361497342 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0afe60 con 0x55e5aa09f630 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1361497342 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5aa0ca600 con 0x55e5aa09f630 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b7feeae00 10 client.26777 _ll_register_callbacks cb 0x7f7b60005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1361497342 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e5a9fc3810 con 0x55e5aa09f630 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b397fa640 1 -- 10.20.193.28:0/1361497342 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7b6c0a8ec0 con 0x55e5aa09f630 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.689+0000 7f7b397fa640 1 -- 10.20.193.28:0/1361497342 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0a9af0 con 0x55e5aa09f630 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b397fa640 1 -- 10.20.193.28:0/1361497342 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f7b6c0a9d50 con 0x55e5aa09f630 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b397fa640 1 -- 10.20.193.28:0/1361497342 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b6c0c9050 con 0x55e5aa09f630 2026-02-20T03:22:43.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b7feeae00 10 client.26777 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1361497342 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e5aa0b18b0 con 0x55e5aa09f630 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b397fa640 1 -- 10.20.193.28:0/1361497342 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7b6c004070 con 0x55e5aa09f630 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b7feeae00 10 client.26777 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b7feeae00 10 client.26777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b7feeae00 20 client.26777 populate_metadata read hostname 'trial028' 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e5aa1332a0 0x55e5aa135760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b7feeae00 4 client.26777 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1361497342 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e5a9fa4b00 con 0x55e5aa1332a0 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.690+0000 7f7b767fc640 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e5aa1332a0 0x55e5aa135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b767fc640 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e5aa1332a0 0x55e5aa135760 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c203e22591dbe6d7 server_cookie=2aea23beb7f97fe2 in_seq=0 out_seq=0 2026-02-20T03:22:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b397fa640 10 client.26777 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b397fa640 1 -- 10.20.193.28:0/1361497342 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e5a9fa4b00 con 0x55e5aa1332a0 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b397fa640 10 client.26777 handle_command_reply: tid=0 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 client.26777 shutdown 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1361497342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09f630 msgr2=0x55e5aa0c0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09f630 0x55e5aa0c0010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0a57e0 tx=0x7f7b6c0a7c30 comp rx=0 tx=0).stop 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1361497342 shutdown_connections 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e5aa1332a0 0x55e5aa135760 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e5aa0a5000 0x55e5aa0bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e5aa09ffb0 0x55e5aa0bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 --2- 10.20.193.28:0/1361497342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e5aa09f630 0x55e5aa0c0010 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1361497342 >> 10.20.193.28:0/1361497342 conn(0x55e5aa062290 msgr2=0x55e5aa0b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b397fa640 0 client.26777 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1361497342 shutdown_connections 2026-02-20T03:22:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 1 -- 10.20.193.28:0/1361497342 wait complete. 2026-02-20T03:22:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.691+0000 7f7b7feeae00 20 client.26777 trim_cache size 0 max 16384 2026-02-20T03:22:43.700 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:22:43.700 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:22:43.700 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:22:43.700 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:22:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.692+0000 7f7b77fff640 1 -- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7b4c0b0da0 msgr2=0x7f7b4c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.692+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7b4c0b0da0 0x7f7b4c0b3260 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7b68004450 tx=0x7f7b6803a040 comp rx=0 tx=0).stop 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 -- 10.20.193.28:0/2098804426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78075390 msgr2=0x7f7b7819cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78075390 0x7f7b7819cfb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c00e9f0 tx=0x7f7b6c00eec0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 -- 10.20.193.28:0/2098804426 shutdown_connections 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7b4c0b0da0 0x7f7b4c0b3260 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7b7810f0c0 0x7f7b781a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7b78075d40 0x7f7b7819d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 --2- 10.20.193.28:0/2098804426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7b78075390 0x7f7b7819cfb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 -- 10.20.193.28:0/2098804426 >> 10.20.193.28:0/2098804426 conn(0x7f7b780fe3e0 msgr2=0x7f7b780ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 -- 10.20.193.28:0/2098804426 shutdown_connections 2026-02-20T03:22:43.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:43.693+0000 7f7b77fff640 1 -- 10.20.193.28:0/2098804426 wait complete. 2026-02-20T03:22:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:43 trial177 ceph-mon[43181]: pgmap v422: 129 pgs: 129 active+clean; 122 MiB data, 2.4 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 336 op/s 2026-02-20T03:22:43.795 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:22:43.795 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:22:44.067 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:44.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.250+0000 7fada3577640 1 -- 10.20.193.28:0/3983858397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada410eef0 msgr2=0x7fada410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:44.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.250+0000 7fada3577640 1 --2- 10.20.193.28:0/3983858397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada410eef0 0x7fada410f2d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fad98009a30 tx=0x7fad9802f220 comp rx=0 tx=0).stop 2026-02-20T03:22:44.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.251+0000 7fada3577640 1 -- 10.20.193.28:0/3983858397 shutdown_connections 2026-02-20T03:22:44.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.251+0000 7fada3577640 1 --2- 10.20.193.28:0/3983858397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada4109ba0 0x7fada4115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.251+0000 7fada3577640 1 --2- 10.20.193.28:0/3983858397 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada4109220 0x7fada4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.251+0000 7fada3577640 1 --2- 10.20.193.28:0/3983858397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada410eef0 0x7fada410f2d0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.251+0000 7fada3577640 1 -- 10.20.193.28:0/3983858397 >> 10.20.193.28:0/3983858397 conn(0x7fada4078600 msgr2=0x7fada407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:44.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.251+0000 7fada3577640 1 -- 10.20.193.28:0/3983858397 shutdown_connections 2026-02-20T03:22:44.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.251+0000 7fada3577640 1 -- 10.20.193.28:0/3983858397 wait complete. 2026-02-20T03:22:44.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada3577640 1 Processor -- start 2026-02-20T03:22:44.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada3577640 1 -- start start 2026-02-20T03:22:44.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada3577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada4109220 0x7fada41a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada4109ba0 0x7fada41a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada3577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada410eef0 0x7fada41a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada3577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fada41190a0 con 0x7fada4109ba0 2026-02-20T03:22:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada3577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fada4118f20 con 0x7fada4109220 2026-02-20T03:22:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada3577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fada4119220 con 0x7fada410eef0 2026-02-20T03:22:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada2575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada4109220 0x7fada41a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada2575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada4109220 0x7fada41a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42016/0 (socket says 10.20.193.28:42016) 2026-02-20T03:22:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada2575640 1 -- 10.20.193.28:0/1336061903 learned_addr learned my addr 10.20.193.28:0/1336061903 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:44.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.252+0000 7fada2d76640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada410eef0 0x7fada41a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fada2575640 1 -- 10.20.193.28:0/1336061903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada410eef0 msgr2=0x7fada41a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fada2575640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada410eef0 0x7fada41a5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fada2575640 1 -- 10.20.193.28:0/1336061903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada4109ba0 msgr2=0x7fada41a1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fada2575640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada4109ba0 0x7fada41a1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fada2575640 1 -- 10.20.193.28:0/1336061903 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada41a65d0 con 0x7fada4109220 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fada2575640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada4109220 0x7fada41a1580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad9802f730 tx=0x7fad98004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fad8b7fe640 1 -- 10.20.193.28:0/1336061903 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98004550 con 0x7fada4109220 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fad8b7fe640 1 -- 10.20.193.28:0/1336061903 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad98038e20 con 0x7fada4109220 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fad8b7fe640 1 -- 10.20.193.28:0/1336061903 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98004b80 con 0x7fada4109220 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada41a6860 con 0x7fada4109220 2026-02-20T03:22:44.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.253+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada41ae100 con 0x7fada4109220 2026-02-20T03:22:44.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.254+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada410a580 con 0x7fada4109220 2026-02-20T03:22:44.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.256+0000 7fad8b7fe640 1 -- 10.20.193.28:0/1336061903 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fad98005320 con 0x7fada4109220 2026-02-20T03:22:44.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.258+0000 7fad8b7fe640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad7c0b0e20 0x7fad7c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.258+0000 7fad8b7fe640 1 -- 10.20.193.28:0/1336061903 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fad98105270 con 0x7fada4109220 2026-02-20T03:22:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.258+0000 7fad8b7fe640 1 -- 10.20.193.28:0/1336061903 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fad98047060 con 0x7fada4109220 2026-02-20T03:22:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.259+0000 7fada1d74640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad7c0b0e20 0x7fad7c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:44.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.259+0000 7fada1d74640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad7c0b0e20 0x7fad7c0b32e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fad8c005fd0 tx=0x7fad8c005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:44.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.368+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fada41a28e0 con 0x7fada4109220 2026-02-20T03:22:44.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.368+0000 7fad8b7fe640 1 -- 10.20.193.28:0/1336061903 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7fad980cd650 con 0x7fada4109220 2026-02-20T03:22:44.371 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:22:44.371 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:22:44.371 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad7c0b0e20 msgr2=0x7fad7c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad7c0b0e20 0x7fad7c0b32e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fad8c005fd0 tx=0x7fad8c005950 comp rx=0 tx=0).stop 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada4109220 msgr2=0x7fada41a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada4109220 0x7fada41a1580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad9802f730 tx=0x7fad98004360 comp rx=0 tx=0).stop 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 shutdown_connections 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad7c0b0e20 0x7fad7c0b32e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada410eef0 0x7fada41a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada4109ba0 0x7fada41a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 --2- 10.20.193.28:0/1336061903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada4109220 0x7fada41a1580 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 >> 10.20.193.28:0/1336061903 conn(0x7fada4078600 msgr2=0x7fada4079f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 shutdown_connections 2026-02-20T03:22:44.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.370+0000 7fada3577640 1 -- 10.20.193.28:0/1336061903 wait complete. 2026-02-20T03:22:44.509 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:22:44.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 708713 8.59 MB/sec execute 257 sec latency 8.201 ms 2026-02-20T03:22:44.781 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:44.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.975+0000 7fc49e754640 1 -- 10.20.193.28:0/2100873383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc498105320 msgr2=0x7fc498111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:44.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.975+0000 7fc49e754640 1 --2- 10.20.193.28:0/2100873383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc498105320 0x7fc498111850 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc494009fc0 tx=0x7fc49402f390 comp rx=0 tx=0).stop 2026-02-20T03:22:44.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.975+0000 7fc49e754640 1 -- 10.20.193.28:0/2100873383 shutdown_connections 2026-02-20T03:22:44.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.975+0000 7fc49e754640 1 --2- 10.20.193.28:0/2100873383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc498105320 0x7fc498111850 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.975+0000 7fc49e754640 1 --2- 10.20.193.28:0/2100873383 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc498104980 0x7fc498104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.975+0000 7fc49e754640 1 --2- 10.20.193.28:0/2100873383 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc49810a980 0x7fc49810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.975+0000 7fc49e754640 1 -- 10.20.193.28:0/2100873383 >> 10.20.193.28:0/2100873383 conn(0x7fc498100680 msgr2=0x7fc498102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:44.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.975+0000 7fc49e754640 1 -- 10.20.193.28:0/2100873383 shutdown_connections 2026-02-20T03:22:44.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.975+0000 7fc49e754640 1 -- 10.20.193.28:0/2100873383 wait complete. 2026-02-20T03:22:44.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.976+0000 7fc49e754640 1 Processor -- start 2026-02-20T03:22:44.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.976+0000 7fc49e754640 1 -- start start 2026-02-20T03:22:44.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.976+0000 7fc49e754640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc498104980 0x7fc49819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.976+0000 7fc49e754640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc498105320 0x7fc49819d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.976+0000 7fc49e754640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc49810a980 0x7fc4981a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.976+0000 7fc49e754640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc498114bf0 con 0x7fc498105320 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.976+0000 7fc49e754640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc498114a70 con 0x7fc498104980 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.976+0000 7fc49e754640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc498114d70 con 0x7fc49810a980 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49d752640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc498104980 0x7fc49819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49cf51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc498105320 0x7fc49819d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49d752640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc498104980 0x7fc49819cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42042/0 (socket says 10.20.193.28:42042) 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49d752640 1 -- 10.20.193.28:0/351000161 learned_addr learned my addr 10.20.193.28:0/351000161 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49df53640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc49810a980 0x7fc4981a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49df53640 1 -- 10.20.193.28:0/351000161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc498104980 msgr2=0x7fc49819cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49df53640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc498104980 0x7fc49819cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49df53640 1 -- 10.20.193.28:0/351000161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc498105320 msgr2=0x7fc49819d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:44.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49df53640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc498105320 0x7fc49819d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.977+0000 7fc49df53640 1 -- 10.20.193.28:0/351000161 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4981a2040 con 0x7fc49810a980 2026-02-20T03:22:44.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.978+0000 7fc49df53640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc49810a980 0x7fc4981a18c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc49402f8a0 tx=0x7fc494005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:44.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.978+0000 7fc4867fc640 1 -- 10.20.193.28:0/351000161 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494004520 con 0x7fc49810a980 2026-02-20T03:22:44.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.978+0000 7fc49e754640 1 -- 10.20.193.28:0/351000161 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4981a22d0 con 0x7fc49810a980 2026-02-20T03:22:44.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.978+0000 7fc49e754640 1 -- 10.20.193.28:0/351000161 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4981a9b70 con 0x7fc49810a980 2026-02-20T03:22:44.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.978+0000 7fc4867fc640 1 -- 10.20.193.28:0/351000161 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc494009c20 con 0x7fc49810a980 2026-02-20T03:22:44.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.978+0000 7fc4867fc640 1 -- 10.20.193.28:0/351000161 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494007c10 con 0x7fc49810a980 2026-02-20T03:22:44.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 Processor -- start 2026-02-20T03:22:44.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- start start 2026-02-20T03:22:44.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b439049390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4390435e0 0x55b439043a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b43904fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b438fc3e00 con 0x55b439048fb0 2026-02-20T03:22:44.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b438f96970 con 0x55b439043f60 2026-02-20T03:22:44.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b438f441f0 con 0x55b4390435e0 2026-02-20T03:22:44.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc49cf51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b439049390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:44.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc49cf51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b439049390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41406/0 (socket says 10.20.193.28:41406) 2026-02-20T03:22:44.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc49cf51640 1 -- 10.20.193.28:0/3752350194 learned_addr learned my addr 10.20.193.28:0/3752350194 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:44.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc49cf51640 1 -- 10.20.193.28:0/3752350194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4390435e0 msgr2=0x55b439043a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:44.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc49cf51640 1 --2- 10.20.193.28:0/3752350194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4390435e0 0x55b439043a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc49cf51640 1 -- 10.20.193.28:0/3752350194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 msgr2=0x55b43904fde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:44.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc49cf51640 1 --2- 10.20.193.28:0/3752350194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b43904fde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc49cf51640 1 -- 10.20.193.28:0/3752350194 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b438f573d0 con 0x55b439048fb0 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc49cf51640 1 --2- 10.20.193.28:0/3752350194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b439049390 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc48c004580 tx=0x7fc48c009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90babab163852bcf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc465ce5640 1 -- 10.20.193.28:0/3752350194 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c01a440 con 0x55b439048fb0 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc465ce5640 1 -- 10.20.193.28:0/3752350194 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc48c0108d0 con 0x55b439048fb0 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc465ce5640 1 -- 10.20.193.28:0/3752350194 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c019800 con 0x55b439048fb0 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3752350194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 msgr2=0x55b439049390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3752350194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b439049390 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc48c004580 tx=0x7fc48c009c70 comp rx=0 tx=0).stop 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3752350194 shutdown_connections 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3752350194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b43904fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3752350194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4390435e0 0x55b439043a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3752350194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b439049390 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3752350194 >> 10.20.193.28:0/3752350194 conn(0x55b439006240 msgr2=0x55b439041ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:44.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3752350194 shutdown_connections 2026-02-20T03:22:44.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3752350194 wait complete. 2026-02-20T03:22:44.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 -- start start 2026-02-20T03:22:44.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.979+0000 7fc4a1ee2e00 1 Processor -- start 2026-02-20T03:22:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4390435e0 0x55b43905df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b43905e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b43905c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b438f928a0 con 0x55b439048fb0 2026-02-20T03:22:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b438d84f50 con 0x55b439043f60 2026-02-20T03:22:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b43905c9f0 con 0x55b4390435e0 2026-02-20T03:22:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc49cf51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b43905c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc49cf51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b43905c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41418/0 (socket says 10.20.193.28:41418) 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc49cf51640 1 -- 10.20.193.28:0/30723818 learned_addr learned my addr 10.20.193.28:0/30723818 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc49cf51640 1 -- 10.20.193.28:0/30723818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4390435e0 msgr2=0x55b43905df70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc49cf51640 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4390435e0 0x55b43905df70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc49cf51640 1 -- 10.20.193.28:0/30723818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 msgr2=0x55b43905e4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc49cf51640 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b43905e4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc49cf51640 1 -- 10.20.193.28:0/30723818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b439055a80 con 0x55b439048fb0 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc49cf51640 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b43905c460 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0108a0 tx=0x7fc48c002ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ce985db3b18f12 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc452ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc452ffd640 1 -- 10.20.193.28:0/30723818 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c01f040 con 0x55b439048fb0 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/30723818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b438d67b40 con 0x55b439048fb0 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 10 client.17421 _ll_register_callbacks cb 0x55b438fcfeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/30723818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b438fa4150 con 0x55b439048fb0 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc452ffd640 1 -- 10.20.193.28:0/30723818 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc48c029070 con 0x55b439048fb0 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc452ffd640 1 -- 10.20.193.28:0/30723818 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c01a900 con 0x55b439048fb0 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc452ffd640 1 -- 10.20.193.28:0/30723818 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc48c019680 con 0x55b439048fb0 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc452ffd640 1 -- 10.20.193.28:0/30723818 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc48c019900 con 0x55b439048fb0 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 10 client.17421 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/30723818 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55b438f511e0 con 0x55b439048fb0 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc452ffd640 1 -- 10.20.193.28:0/30723818 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc48c018070 con 0x55b439048fb0 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 10 client.17421 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 10 client.17421 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 20 client.17421 populate_metadata read hostname 'trial028' 2026-02-20T03:22:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55b43906c660 0x55b43906ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 4 client.17421 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:45.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.985+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/30723818 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b438f9e560 con 0x55b43906c660 2026-02-20T03:22:45.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.993+0000 7fc49d752640 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55b43906c660 0x55b43906ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.993+0000 7fc49d752640 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55b43906c660 0x55b43906ea50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6cdbd6c8f676a902 server_cookie=13721d1983e0cb78 in_seq=0 out_seq=0 2026-02-20T03:22:45.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.993+0000 7fc452ffd640 10 client.17421 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:22:45.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.994+0000 7fc452ffd640 1 -- 10.20.193.28:0/30723818 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b438f9e560 con 0x55b43906c660 2026-02-20T03:22:45.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.994+0000 7fc452ffd640 10 client.17421 handle_command_reply: tid=0 2026-02-20T03:22:45.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.994+0000 7fc4a1ee2e00 1 client.17421 shutdown 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.994+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/30723818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 msgr2=0x55b43905c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.994+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b43905c460 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0108a0 tx=0x7fc48c002ef0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4867fc640 1 -- 10.20.193.28:0/351000161 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc494002a60 con 0x7fc49810a980 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/30723818 shutdown_connections 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55b43906c660 0x55b43906ea50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439048fb0 0x55b43905c460 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b43905e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/30723818 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b4390435e0 0x55b43905df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc452ffd640 0 client.17421 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/30723818 >> 10.20.193.28:0/30723818 conn(0x55b439006240 msgr2=0x55b4390423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/30723818 shutdown_connections 2026-02-20T03:22:45.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/30723818 wait complete. 2026-02-20T03:22:45.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.995+0000 7fc4a1ee2e00 20 client.17421 trim_cache size 0 max 16384 2026-02-20T03:22:45.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.996+0000 7fc4867fc640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4740b0d30 0x7fc4740b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.997+0000 7fc4867fc640 1 -- 10.20.193.28:0/351000161 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc494104ea0 con 0x7fc49810a980 2026-02-20T03:22:45.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.997+0000 7fc49d752640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4740b0d30 0x7fc4740b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:44.997+0000 7fc49d752640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4740b0d30 0x7fc4740b31f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55b43905cb30 tx=0x7fc488004830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.002+0000 7fc4a1ee2e00 1 Processor -- start 2026-02-20T03:22:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.002+0000 7fc4a1ee2e00 1 -- start start 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.002+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b4390435e0 0x55b43905b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.002+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439043f60 0x55b439059910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.002+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 0x55b439059e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc44401b130 con 0x55b439043f60 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc444018a00 con 0x55b4390435e0 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc444016850 con 0x55b439048fb0 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49cf51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439043f60 0x55b439059910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49d752640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b4390435e0 0x55b43905b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49cf51640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439043f60 0x55b439059910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41432/0 (socket says 10.20.193.28:41432) 2026-02-20T03:22:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49cf51640 1 -- 10.20.193.28:0/4053892756 learned_addr learned my addr 10.20.193.28:0/4053892756 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:45.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49df53640 1 --2- 10.20.193.28:0/4053892756 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 0x55b439059e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49cf51640 1 -- 10.20.193.28:0/4053892756 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 msgr2=0x55b439059e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49cf51640 1 --2- 10.20.193.28:0/4053892756 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 0x55b439059e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49cf51640 1 -- 10.20.193.28:0/4053892756 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b4390435e0 msgr2=0x55b43905b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49cf51640 1 --2- 10.20.193.28:0/4053892756 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b4390435e0 0x55b43905b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49cf51640 1 -- 10.20.193.28:0/4053892756 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4390558b0 con 0x55b439043f60 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc49cf51640 1 --2- 10.20.193.28:0/4053892756 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439043f60 0x55b439059910 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc48c004350 tx=0x7fc48c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fee96cb52221bbb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc4654e4640 1 -- 10.20.193.28:0/4053892756 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c01a440 con 0x55b439043f60 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc4654e4640 1 -- 10.20.193.28:0/4053892756 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc48c029040 con 0x55b439043f60 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.003+0000 7fc4654e4640 1 -- 10.20.193.28:0/4053892756 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c019d50 con 0x55b439043f60 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/4053892756 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439043f60 msgr2=0x55b439059910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/4053892756 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439043f60 0x55b439059910 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc48c004350 tx=0x7fc48c02e000 comp rx=0 tx=0).stop 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/4053892756 shutdown_connections 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/4053892756 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 0x55b439059e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/4053892756 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b439043f60 0x55b439059910 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/4053892756 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b4390435e0 0x55b43905b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/4053892756 >> 10.20.193.28:0/4053892756 conn(0x55b439006240 msgr2=0x55b43905ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/4053892756 shutdown_connections 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/4053892756 wait complete. 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 -- start start 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.004+0000 7fc4a1ee2e00 1 Processor -- start 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4390435e0 0x55b439061220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b439061760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc4a1ee2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 0x55b4390d7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc444016ec0 con 0x55b4390435e0 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc444018330 con 0x55b439043f60 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc4a1ee2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc444017590 con 0x55b439048fb0 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49cf51640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b439061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49d752640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4390435e0 0x55b439061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49cf51640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b439061760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42068/0 (socket says 10.20.193.28:42068) 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49cf51640 1 -- 10.20.193.28:0/3543249952 learned_addr learned my addr 10.20.193.28:0/3543249952 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49df53640 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 0x55b4390d7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49cf51640 1 -- 10.20.193.28:0/3543249952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 msgr2=0x55b4390d7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49cf51640 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 0x55b4390d7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49cf51640 1 -- 10.20.193.28:0/3543249952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4390435e0 msgr2=0x55b439061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49cf51640 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4390435e0 0x55b439061220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49cf51640 1 -- 10.20.193.28:0/3543249952 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b438c75870 con 0x55b439043f60 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.005+0000 7fc49df53640 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 0x55b4390d7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc49cf51640 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b439061760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0093c0 tx=0x7fc48c0197a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be956e1a0e8c33d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc452ffd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:22:45.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc452ffd640 1 -- 10.20.193.28:0/3543249952 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c019450 con 0x55b439043f60 2026-02-20T03:22:45.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3543249952 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b438f363f0 con 0x55b439043f60 2026-02-20T03:22:45.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc4a1ee2e00 10 client.26795 _ll_register_callbacks cb 0x7fc48c004480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:45.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3543249952 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b438f677c0 con 0x55b439043f60 2026-02-20T03:22:45.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc452ffd640 1 -- 10.20.193.28:0/3543249952 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55b438fa4150 con 0x55b439043f60 2026-02-20T03:22:45.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc452ffd640 1 -- 10.20.193.28:0/3543249952 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c004c10 con 0x55b439043f60 2026-02-20T03:22:45.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc452ffd640 1 -- 10.20.193.28:0/3543249952 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc48c004db0 con 0x55b439043f60 2026-02-20T03:22:45.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc452ffd640 1 -- 10.20.193.28:0/3543249952 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc48c049050 con 0x55b439043f60 2026-02-20T03:22:45.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc4a1ee2e00 10 client.26795 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:45.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.006+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3543249952 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55b4390565a0 con 0x55b439043f60 2026-02-20T03:22:45.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.007+0000 7fc452ffd640 1 -- 10.20.193.28:0/3543249952 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc48c03f070 con 0x55b439043f60 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.007+0000 7fc4a1ee2e00 10 client.26795 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.007+0000 7fc4a1ee2e00 10 client.26795 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.007+0000 7fc4a1ee2e00 20 client.26795 populate_metadata read hostname 'trial028' 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.007+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55b4390d8ae0 0x55b4390daf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.007+0000 7fc4a1ee2e00 4 client.26795 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.007+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3543249952 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b438f48ab0 con 0x55b4390d8ae0 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.007+0000 7fc49d752640 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55b4390d8ae0 0x55b4390daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.008+0000 7fc49d752640 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55b4390d8ae0 0x55b4390daf70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6344055400653459 server_cookie=838fa0410687e848 in_seq=0 out_seq=0 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.008+0000 7fc452ffd640 10 client.26795 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc452ffd640 1 -- 10.20.193.28:0/3543249952 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b438f48ab0 con 0x55b4390d8ae0 2026-02-20T03:22:45.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc452ffd640 10 client.26795 handle_command_reply: tid=0 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 client.26795 shutdown 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3543249952 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 msgr2=0x55b439061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b439061760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0093c0 tx=0x7fc48c0197a0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3543249952 shutdown_connections 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b439048fb0 0x55b4390d7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b439043f60 0x55b439061760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55b4390d8ae0 0x55b4390daf70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 --2- 10.20.193.28:0/3543249952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b4390435e0 0x55b439061220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3543249952 >> 10.20.193.28:0/3543249952 conn(0x55b439006240 msgr2=0x55b43905b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc452ffd640 0 client.26795 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3543249952 shutdown_connections 2026-02-20T03:22:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 1 -- 10.20.193.28:0/3543249952 wait complete. 2026-02-20T03:22:45.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.009+0000 7fc4a1ee2e00 20 client.26795 trim_cache size 0 max 16384 2026-02-20T03:22:45.018 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:22:45.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 -- 10.20.193.28:0/351000161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4740b0d30 msgr2=0x7fc4740b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4740b0d30 0x7fc4740b31f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x55b43905cb30 tx=0x7fc488004830 comp rx=0 tx=0).stop 2026-02-20T03:22:45.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 -- 10.20.193.28:0/351000161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc49810a980 msgr2=0x7fc4981a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc49810a980 0x7fc4981a18c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc49402f8a0 tx=0x7fc494005be0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 -- 10.20.193.28:0/351000161 shutdown_connections 2026-02-20T03:22:45.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4740b0d30 0x7fc4740b31f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc49810a980 0x7fc4981a18c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc498105320 0x7fc49819d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 --2- 10.20.193.28:0/351000161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc498104980 0x7fc49819cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 -- 10.20.193.28:0/351000161 >> 10.20.193.28:0/351000161 conn(0x7fc498100680 msgr2=0x7fc498101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 -- 10.20.193.28:0/351000161 shutdown_connections 2026-02-20T03:22:45.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.010+0000 7fc49e754640 1 -- 10.20.193.28:0/351000161 wait complete. 2026-02-20T03:22:45.149 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:22:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:45 trial028 ceph-mon[38552]: pgmap v423: 129 pgs: 129 active+clean; 125 MiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 399 op/s 2026-02-20T03:22:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:45 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1336061903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:45.419 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:45.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 712089 8.63 MB/sec execute 258 sec latency 14.456 ms 2026-02-20T03:22:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:45 trial126 ceph-mon[38476]: pgmap v423: 129 pgs: 129 active+clean; 125 MiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 399 op/s 2026-02-20T03:22:45.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:45 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1336061903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:45.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.594+0000 7ff0f39e4640 1 -- 10.20.193.28:0/703202527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec102150 msgr2=0x7ff0ec106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.594+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/703202527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec102150 0x7ff0ec106620 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009960 tx=0x7ff0e002f100 comp rx=0 tx=0).stop 2026-02-20T03:22:45.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.594+0000 7ff0f39e4640 1 -- 10.20.193.28:0/703202527 shutdown_connections 2026-02-20T03:22:45.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.594+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/703202527 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0ec106d00 0x7ff0ec1071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.594+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/703202527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec102150 0x7ff0ec106620 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.594+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/703202527 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0ec101830 0x7ff0ec101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.594+0000 7ff0f39e4640 1 -- 10.20.193.28:0/703202527 >> 10.20.193.28:0/703202527 conn(0x7ff0ec0fd480 msgr2=0x7ff0ec0ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.594+0000 7ff0f39e4640 1 -- 10.20.193.28:0/703202527 shutdown_connections 2026-02-20T03:22:45.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.594+0000 7ff0f39e4640 1 -- 10.20.193.28:0/703202527 wait complete. 2026-02-20T03:22:45.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.595+0000 7ff0f39e4640 1 Processor -- start 2026-02-20T03:22:45.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.595+0000 7ff0f39e4640 1 -- start start 2026-02-20T03:22:45.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.595+0000 7ff0f39e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec101830 0x7ff0ec1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.595+0000 7ff0f39e4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0ec102150 0x7ff0ec1a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.595+0000 7ff0f39e4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0ec106d00 0x7ff0ec1a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.595+0000 7ff0f39e4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec119220 con 0x7ff0ec101830 2026-02-20T03:22:45.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.595+0000 7ff0f39e4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec1190a0 con 0x7ff0ec102150 2026-02-20T03:22:45.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.595+0000 7ff0f39e4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec1193a0 con 0x7ff0ec106d00 2026-02-20T03:22:45.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1759640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec101830 0x7ff0ec1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1759640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec101830 0x7ff0ec1a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41470/0 (socket says 10.20.193.28:41470) 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1759640 1 -- 10.20.193.28:0/3158918197 learned_addr learned my addr 10.20.193.28:0/3158918197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1f5a640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0ec106d00 0x7ff0ec1a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0ec102150 0x7ff0ec1a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1759640 1 -- 10.20.193.28:0/3158918197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0ec106d00 msgr2=0x7ff0ec1a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1759640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0ec106d00 0x7ff0ec1a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1759640 1 -- 10.20.193.28:0/3158918197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0ec102150 msgr2=0x7ff0ec1a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1759640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0ec102150 0x7ff0ec1a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1759640 1 -- 10.20.193.28:0/3158918197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ec1a6750 con 0x7ff0ec101830 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f1759640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec101830 0x7ff0ec1a1700 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00d950 tx=0x7ff0dc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0da7fc640 1 -- 10.20.193.28:0/3158918197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc014070 con 0x7ff0ec101830 2026-02-20T03:22:45.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0da7fc640 1 -- 10.20.193.28:0/3158918197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0dc0044e0 con 0x7ff0ec101830 2026-02-20T03:22:45.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0da7fc640 1 -- 10.20.193.28:0/3158918197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc010460 con 0x7ff0ec101830 2026-02-20T03:22:45.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f39e4640 1 -- 10.20.193.28:0/3158918197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ec1a6a40 con 0x7ff0ec101830 2026-02-20T03:22:45.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.596+0000 7ff0f39e4640 1 -- 10.20.193.28:0/3158918197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ec1ae280 con 0x7ff0ec101830 2026-02-20T03:22:45.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.600+0000 7ff0da7fc640 1 -- 10.20.193.28:0/3158918197 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff0dc0026e0 con 0x7ff0ec101830 2026-02-20T03:22:45.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.600+0000 7ff0f5ee9e00 1 Processor -- start 2026-02-20T03:22:45.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f5ee9e00 1 -- start start 2026-02-20T03:22:45.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x5598423089c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x55984230c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x559842314c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559842288e00 con 0x55984230d0d0 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55984225b970 con 0x559842308f90 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5598422091f0 con 0x5598423085e0 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f1f5a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x5598423089c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f1759640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x55984230c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f0f58640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x559842314c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f0f58640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x559842314c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41484/0 (socket says 10.20.193.28:41484) 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f0f58640 1 -- 10.20.193.28:0/3210632429 learned_addr learned my addr 10.20.193.28:0/3210632429 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f0f58640 1 -- 10.20.193.28:0/3210632429 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 msgr2=0x5598423089c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/3210632429 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x5598423089c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f0f58640 1 -- 10.20.193.28:0/3210632429 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 msgr2=0x55984230c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.601+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/3210632429 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x55984230c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f0f58640 1 -- 10.20.193.28:0/3210632429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55984221c3d0 con 0x55984230d0d0 2026-02-20T03:22:45.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0da7fc640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0c80b0e20 0x7ff0c80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0da7fc640 1 -- 10.20.193.28:0/3158918197 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff0dc0e0920 con 0x7ff0ec101830 2026-02-20T03:22:45.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/3210632429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x559842314c50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0037000 tx=0x7ff0e00096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fc6dfe2f447728 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:45.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0b9ce5640 1 -- 10.20.193.28:0/3210632429 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0046070 con 0x55984230d0d0 2026-02-20T03:22:45.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0b9ce5640 1 -- 10.20.193.28:0/3210632429 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0e0033040 con 0x55984230d0d0 2026-02-20T03:22:45.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0b9ce5640 1 -- 10.20.193.28:0/3210632429 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e00387b0 con 0x55984230d0d0 2026-02-20T03:22:45.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3210632429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 msgr2=0x559842314c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3210632429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x559842314c50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0037000 tx=0x7ff0e00096b0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f1f5a640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0c80b0e20 0x7ff0c80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3210632429 shutdown_connections 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3210632429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x559842314c50 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3210632429 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x55984230c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3210632429 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x5598423089c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.602+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3210632429 >> 10.20.193.28:0/3210632429 conn(0x5598422cb240 msgr2=0x559842306ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.603+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3210632429 shutdown_connections 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.603+0000 7ff0f1f5a640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0c80b0e20 0x7ff0c80b32e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80095c0 tx=0x7ff0e800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.603+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3210632429 wait complete. 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.604+0000 7ff0f5ee9e00 1 -- start start 2026-02-20T03:22:45.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.604+0000 7ff0f5ee9e00 1 Processor -- start 2026-02-20T03:22:45.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.604+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842322a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.604+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x559842322fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423211a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5598422578a0 con 0x55984230d0d0 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559842049f50 con 0x559842308f90 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559842321920 con 0x5598423085e0 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f1f5a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f1f5a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423211a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41488/0 (socket says 10.20.193.28:41488) 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f1f5a640 1 -- 10.20.193.28:0/3501015344 learned_addr learned my addr 10.20.193.28:0/3501015344 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f1f5a640 1 -- 10.20.193.28:0/3501015344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 msgr2=0x559842322a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f1f5a640 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842322a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x559842322fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f1f5a640 1 -- 10.20.193.28:0/3501015344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 msgr2=0x559842322fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f1f5a640 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x559842322fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f1f5a640 1 -- 10.20.193.28:0/3501015344 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55984231a8f0 con 0x55984230d0d0 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x559842322fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f1f5a640 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423211a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8016e00 tx=0x7ff0e8004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb2fa41b5ceede1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0a6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/3501015344 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8023860 con 0x55984230d0d0 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/3501015344 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0e8015e10 con 0x55984230d0d0 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/3501015344 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8022ce0 con 0x55984230d0d0 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.605+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3501015344 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55984202cb40 con 0x55984230d0d0 2026-02-20T03:22:45.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/3501015344 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff0e8021340 con 0x55984230d0d0 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 10 client.17439 _ll_register_callbacks cb 0x559842294eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3501015344 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559842269150 con 0x55984230d0d0 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/3501015344 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff0e8030060 con 0x55984230d0d0 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 10 client.17439 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3501015344 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5598422161e0 con 0x55984230d0d0 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/3501015344 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff0e8023a00 con 0x55984230d0d0 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 10 client.17439 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 10 client.17439 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 20 client.17439 populate_metadata read hostname 'trial028' 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5598423313d0 0x559842333870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 4 client.17439 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:45.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.606+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3501015344 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559842263560 con 0x5598423313d0 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.607+0000 7ff0f1759640 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5598423313d0 0x559842333870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.607+0000 7ff0a6ffd640 10 client.17439 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.607+0000 7ff0f1759640 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5598423313d0 0x559842333870 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82e48aae4909721a server_cookie=150eba5d1f9fcd22 in_seq=0 out_seq=0 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/3501015344 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559842263560 con 0x5598423313d0 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0a6ffd640 10 client.17439 handle_command_reply: tid=0 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 client.17439 shutdown 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3501015344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 msgr2=0x5598423211a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423211a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8016e00 tx=0x7ff0e8004bb0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3501015344 shutdown_connections 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5598423313d0 0x559842333870 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423211a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x559842322fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/3501015344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842322a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3501015344 >> 10.20.193.28:0/3501015344 conn(0x5598422cb240 msgr2=0x55984230b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0a6ffd640 0 client.17439 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:22:45.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3501015344 shutdown_connections 2026-02-20T03:22:45.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.608+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/3501015344 wait complete. 2026-02-20T03:22:45.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.609+0000 7ff0f5ee9e00 20 client.17439 trim_cache size 0 max 16384 2026-02-20T03:22:45.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.615+0000 7ff0f5ee9e00 1 Processor -- start 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.615+0000 7ff0f5ee9e00 1 -- start start 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.615+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842339180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423396c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423288f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff0980126f0 con 0x55984230d0d0 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff09800ffc0 con 0x559842308f90 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff09800de10 con 0x5598423085e0 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f0f58640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f1f5a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423288f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f0f58640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423396c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42108/0 (socket says 10.20.193.28:42108) 2026-02-20T03:22:45.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f0f58640 1 -- 10.20.193.28:0/4226317651 learned_addr learned my addr 10.20.193.28:0/4226317651 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:45.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f1759640 1 --2- 10.20.193.28:0/4226317651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842339180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f0f58640 1 -- 10.20.193.28:0/4226317651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 msgr2=0x559842339180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/4226317651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842339180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f0f58640 1 -- 10.20.193.28:0/4226317651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 msgr2=0x5598423288f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/4226317651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423288f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f0f58640 1 -- 10.20.193.28:0/4226317651 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55984231a720 con 0x559842308f90 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.616+0000 7ff0f1f5a640 1 --2- 10.20.193.28:0/4226317651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423288f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/4226317651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423396c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0044040 tx=0x7ff0e00023d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68b4d235cbd7d79c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0b94e4640 1 -- 10.20.193.28:0/4226317651 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0050070 con 0x559842308f90 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0b94e4640 1 -- 10.20.193.28:0/4226317651 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0e002fe00 con 0x559842308f90 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0b94e4640 1 -- 10.20.193.28:0/4226317651 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0046040 con 0x559842308f90 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/4226317651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 msgr2=0x5598423396c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/4226317651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423396c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0044040 tx=0x7ff0e00023d0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/4226317651 shutdown_connections 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/4226317651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423288f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/4226317651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423396c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/4226317651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842339180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/4226317651 >> 10.20.193.28:0/4226317651 conn(0x5598422cb240 msgr2=0x559842322a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/4226317651 shutdown_connections 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.617+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/4226317651 wait complete. 2026-02-20T03:22:45.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f5ee9e00 1 -- start start 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f5ee9e00 1 Processor -- start 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842329010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423273a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f5ee9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423278e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff09800e480 con 0x55984230d0d0 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff09800f8f0 con 0x559842308f90 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f5ee9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff09800eb50 con 0x5598423085e0 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f0f58640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f1f5a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f1759640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842329010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f0f58640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423273a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42122/0 (socket says 10.20.193.28:42122) 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.618+0000 7ff0f0f58640 1 -- 10.20.193.28:0/2776107610 learned_addr learned my addr 10.20.193.28:0/2776107610 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f0f58640 1 -- 10.20.193.28:0/2776107610 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 msgr2=0x559842329010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842329010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f0f58640 1 -- 10.20.193.28:0/2776107610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 msgr2=0x5598423278e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423278e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f0f58640 1 -- 10.20.193.28:0/2776107610 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559841f3a870 con 0x559842308f90 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f1759640 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842329010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:45.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f1f5a640 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423278e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f0f58640 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423273a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff0e004e040 tx=0x7ff0e0009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c85152c784e9554 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0a6ffd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/2776107610 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0050070 con 0x559842308f90 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/2776107610 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598421fb3f0 con 0x559842308f90 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f5ee9e00 10 client.26810 _ll_register_callbacks cb 0x7ff0e801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/2776107610 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55984220dab0 con 0x559842308f90 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/2776107610 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0e0033070 con 0x559842308f90 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.619+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/2776107610 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0050070 con 0x559842308f90 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/2776107610 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff0e0038810 con 0x559842308f90 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/2776107610 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff0e0046040 con 0x559842308f90 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0f5ee9e00 10 client.26810 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/2776107610 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55984231b410 con 0x559842308f90 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/2776107610 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff0e00029d0 con 0x559842308f90 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0f5ee9e00 10 client.26810 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0f5ee9e00 10 client.26810 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0f5ee9e00 20 client.26810 populate_metadata read hostname 'trial028' 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55984239cf00 0x55984239f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0f5ee9e00 4 client.26810 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:22:45.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/2776107610 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff0e002fe00 con 0x55984239cf00 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.620+0000 7ff0f1759640 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55984239cf00 0x55984239f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f1759640 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55984239cf00 0x55984239f310 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7ad9e513036e5c8 server_cookie=57728e82e60b9b2a in_seq=0 out_seq=0 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0a6ffd640 10 client.26810 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0a6ffd640 1 -- 10.20.193.28:0/2776107610 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff0e002fe00 con 0x55984239cf00 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0a6ffd640 10 client.26810 handle_command_reply: tid=0 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f5ee9e00 1 client.26810 shutdown 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/2776107610 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 msgr2=0x5598423273a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423273a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff0e004e040 tx=0x7ff0e0009290 comp rx=0 tx=0).stop 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/2776107610 shutdown_connections 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55984239cf00 0x55984239f310 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55984230d0d0 0x5598423278e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559842308f90 0x5598423273a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f5ee9e00 1 --2- 10.20.193.28:0/2776107610 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5598423085e0 0x559842329010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/2776107610 >> 10.20.193.28:0/2776107610 conn(0x5598422cb240 msgr2=0x55984230d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.621+0000 7ff0a6ffd640 0 client.26810 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/2776107610 shutdown_connections 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f5ee9e00 1 -- 10.20.193.28:0/2776107610 wait complete. 2026-02-20T03:22:45.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f5ee9e00 20 client.26810 trim_cache size 0 max 16384 2026-02-20T03:22:45.629 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:22:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 -- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0c80b0e20 msgr2=0x7ff0c80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0c80b0e20 0x7ff0c80b32e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80095c0 tx=0x7ff0e800b040 comp rx=0 tx=0).stop 2026-02-20T03:22:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 -- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec101830 msgr2=0x7ff0ec1a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec101830 0x7ff0ec1a1700 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00d950 tx=0x7ff0dc00de20 comp rx=0 tx=0).stop 2026-02-20T03:22:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 -- 10.20.193.28:0/3158918197 shutdown_connections 2026-02-20T03:22:45.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0c80b0e20 0x7ff0c80b32e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0ec106d00 0x7ff0ec1a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0ec102150 0x7ff0ec1a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 --2- 10.20.193.28:0/3158918197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0ec101830 0x7ff0ec1a1700 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 -- 10.20.193.28:0/3158918197 >> 10.20.193.28:0/3158918197 conn(0x7ff0ec0fd480 msgr2=0x7ff0ec104540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.622+0000 7ff0f39e4640 1 -- 10.20.193.28:0/3158918197 shutdown_connections 2026-02-20T03:22:45.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:45.623+0000 7ff0f39e4640 1 -- 10.20.193.28:0/3158918197 wait complete. 2026-02-20T03:22:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:45 trial177 ceph-mon[43181]: pgmap v423: 129 pgs: 129 active+clean; 125 MiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 399 op/s 2026-02-20T03:22:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:45 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1336061903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:22:45.726 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:22:45.996 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.183+0000 7fd77f4e8640 1 -- 10.20.193.28:0/568825271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd778104980 msgr2=0x7fd778104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.183+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/568825271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd778104980 0x7fd778104de0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009a30 tx=0x7fd76c02f220 comp rx=0 tx=0).stop 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.183+0000 7fd77f4e8640 1 -- 10.20.193.28:0/568825271 shutdown_connections 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.183+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/568825271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd778105320 0x7fd778111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.183+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/568825271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd778104980 0x7fd778104de0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.183+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/568825271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd77810a980 0x7fd77810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.183+0000 7fd77f4e8640 1 -- 10.20.193.28:0/568825271 >> 10.20.193.28:0/568825271 conn(0x7fd778100680 msgr2=0x7fd778102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.183+0000 7fd77f4e8640 1 -- 10.20.193.28:0/568825271 shutdown_connections 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.183+0000 7fd77f4e8640 1 -- 10.20.193.28:0/568825271 wait complete. 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77f4e8640 1 Processor -- start 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77f4e8640 1 -- start start 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77f4e8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd778104980 0x7fd77819d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77f4e8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd778105320 0x7fd77819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77f4e8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd77810a980 0x7fd7781a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77f4e8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd778114bf0 con 0x7fd778105320 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77f4e8640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd778114a70 con 0x7fd77810a980 2026-02-20T03:22:46.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77f4e8640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd778114d70 con 0x7fd778104980 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77dce5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd778105320 0x7fd77819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77ece7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd77810a980 0x7fd7781a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77dce5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd778105320 0x7fd77819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60770/0 (socket says 10.20.193.28:60770) 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77e4e6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd778104980 0x7fd77819d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.184+0000 7fd77dce5640 1 -- 10.20.193.28:0/2885708872 learned_addr learned my addr 10.20.193.28:0/2885708872 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd77ece7640 1 -- 10.20.193.28:0/2885708872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd778104980 msgr2=0x7fd77819d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd77ece7640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd778104980 0x7fd77819d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd77ece7640 1 -- 10.20.193.28:0/2885708872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd778105320 msgr2=0x7fd77819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd77ece7640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd778105320 0x7fd77819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd77ece7640 1 -- 10.20.193.28:0/2885708872 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7781a2140 con 0x7fd77810a980 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd77ece7640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd77810a980 0x7fd7781a19c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd774007f00 tx=0x7fd77400e510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd767fff640 1 -- 10.20.193.28:0/2885708872 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774002a60 con 0x7fd77810a980 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd767fff640 1 -- 10.20.193.28:0/2885708872 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd774002c00 con 0x7fd77810a980 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd767fff640 1 -- 10.20.193.28:0/2885708872 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd774013680 con 0x7fd77810a980 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd77f4e8640 1 -- 10.20.193.28:0/2885708872 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7781a23d0 con 0x7fd77810a980 2026-02-20T03:22:46.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.185+0000 7fd77f4e8640 1 -- 10.20.193.28:0/2885708872 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7781a9c70 con 0x7fd77810a980 2026-02-20T03:22:46.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.188+0000 7fd782c76e00 1 Processor -- start 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.188+0000 7fd767fff640 1 -- 10.20.193.28:0/2885708872 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd7740040d0 con 0x7fd77810a980 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.188+0000 7fd782c76e00 1 -- start start 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780b29c0 0x55f6780b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 0x55f6780ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780ad970 0x55f6780b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd782c76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f678024e00 con 0x55f6780b29c0 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd782c76e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f677ff7970 con 0x55f6780ad970 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd782c76e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f677fa51f0 con 0x55f6780acff0 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77e4e6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 0x55f6780ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77dce5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780b29c0 0x55f6780b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77dce5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780b29c0 0x55f6780b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60776/0 (socket says 10.20.193.28:60776) 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77dce5640 1 -- 10.20.193.28:0/2522265776 learned_addr learned my addr 10.20.193.28:0/2522265776 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77dce5640 1 -- 10.20.193.28:0/2522265776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 msgr2=0x55f6780ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77dce5640 1 --2- 10.20.193.28:0/2522265776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 0x55f6780ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77dce5640 1 -- 10.20.193.28:0/2522265776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780ad970 msgr2=0x55f6780b97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77dce5640 1 --2- 10.20.193.28:0/2522265776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780ad970 0x55f6780b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77dce5640 1 -- 10.20.193.28:0/2522265776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f677fb83d0 con 0x55f6780b29c0 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd77dce5640 1 --2- 10.20.193.28:0/2522265776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780b29c0 0x55f6780b2da0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd76c005c90 tx=0x7fd76c005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c379d267da006d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd75effd640 1 -- 10.20.193.28:0/2522265776 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c046070 con 0x55f6780b29c0 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd75effd640 1 -- 10.20.193.28:0/2522265776 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd76c033040 con 0x55f6780b29c0 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.189+0000 7fd75effd640 1 -- 10.20.193.28:0/2522265776 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0045e0 con 0x55f6780b29c0 2026-02-20T03:22:46.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd782c76e00 1 -- 10.20.193.28:0/2522265776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780b29c0 msgr2=0x55f6780b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd782c76e00 1 --2- 10.20.193.28:0/2522265776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780b29c0 0x55f6780b2da0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fd76c005c90 tx=0x7fd76c005cc0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd767fff640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7480b0e20 0x7fd7480b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd767fff640 1 -- 10.20.193.28:0/2885708872 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd7740e07a0 con 0x7fd77810a980 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd782c76e00 1 -- 10.20.193.28:0/2522265776 shutdown_connections 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd782c76e00 1 --2- 10.20.193.28:0/2522265776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780ad970 0x55f6780b97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd782c76e00 1 --2- 10.20.193.28:0/2522265776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 0x55f6780ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd782c76e00 1 --2- 10.20.193.28:0/2522265776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780b29c0 0x55f6780b2da0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd782c76e00 1 -- 10.20.193.28:0/2522265776 >> 10.20.193.28:0/2522265776 conn(0x55f678067240 msgr2=0x55f6780a2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd782c76e00 1 -- 10.20.193.28:0/2522265776 shutdown_connections 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd77e4e6640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7480b0e20 0x7fd7480b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd782c76e00 1 -- 10.20.193.28:0/2522265776 wait complete. 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.190+0000 7fd77e4e6640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7480b0e20 0x7fd7480b32e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd768004590 tx=0x7fd768009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.191+0000 7fd782c76e00 1 -- start start 2026-02-20T03:22:46.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.191+0000 7fd782c76e00 1 Processor -- start 2026-02-20T03:22:46.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780acff0 0x55f6780d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780ad970 0x55f6780d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 0x55f6780ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd782c76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f677ff38a0 con 0x55f6780acff0 2026-02-20T03:22:46.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd782c76e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f677de5f50 con 0x55f6780ad970 2026-02-20T03:22:46.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd782c76e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f6780ced10 con 0x55f6780b29c0 2026-02-20T03:22:46.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77e4e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780acff0 0x55f6780d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77e4e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780acff0 0x55f6780d0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60782/0 (socket says 10.20.193.28:60782) 2026-02-20T03:22:46.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77e4e6640 1 -- 10.20.193.28:0/1370828195 learned_addr learned my addr 10.20.193.28:0/1370828195 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77ece7640 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 0x55f6780ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77e4e6640 1 -- 10.20.193.28:0/1370828195 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 msgr2=0x55f6780ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77e4e6640 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 0x55f6780ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77e4e6640 1 -- 10.20.193.28:0/1370828195 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780ad970 msgr2=0x55f6780d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77e4e6640 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780ad970 0x55f6780d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77e4e6640 1 -- 10.20.193.28:0/1370828195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6780a9d10 con 0x55f6780acff0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd77e4e6640 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780acff0 0x55f6780d0040 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd768009240 tx=0x7fd768004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b51edebb26f9c6e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd72ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd72ffff640 1 -- 10.20.193.28:0/1370828195 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76801e510 con 0x55f6780acff0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd72ffff640 1 -- 10.20.193.28:0/1370828195 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd76801eb50 con 0x55f6780acff0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd72ffff640 1 -- 10.20.193.28:0/1370828195 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76801c9f0 con 0x55f6780acff0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.192+0000 7fd782c76e00 1 -- 10.20.193.28:0/1370828195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f677dc8b40 con 0x55f6780acff0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd72ffff640 1 -- 10.20.193.28:0/1370828195 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd76801cb90 con 0x55f6780acff0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd72ffff640 10 client.17457 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 10 client.17457 _ll_register_callbacks cb 0x55f678030eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 1 -- 10.20.193.28:0/1370828195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f678005150 con 0x55f6780acff0 2026-02-20T03:22:46.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd72ffff640 1 -- 10.20.193.28:0/1370828195 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd76801cd90 con 0x55f6780acff0 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 10 client.17457 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 1 -- 10.20.193.28:0/1370828195 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f677fb21e0 con 0x55f6780acff0 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd72ffff640 1 -- 10.20.193.28:0/1370828195 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd76801e6b0 con 0x55f6780acff0 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 10 client.17457 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 20 client.17457 populate_metadata read hostname 'trial028' 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f6780de8b0 0x55f6780e0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 4 client.17457 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.193+0000 7fd782c76e00 1 -- 10.20.193.28:0/1370828195 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f677fff560 con 0x55f6780de8b0 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.194+0000 7fd77dce5640 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f6780de8b0 0x55f6780e0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.194+0000 7fd77dce5640 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f6780de8b0 0x55f6780e0d40 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b7d5619354a5e22 server_cookie=6ecea6d2471baa41 in_seq=0 out_seq=0 2026-02-20T03:22:46.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.194+0000 7fd72ffff640 10 client.17457 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.194+0000 7fd72ffff640 1 -- 10.20.193.28:0/1370828195 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f677fff560 con 0x55f6780de8b0 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.194+0000 7fd72ffff640 10 client.17457 handle_command_reply: tid=0 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.194+0000 7fd782c76e00 1 client.17457 shutdown 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 -- 10.20.193.28:0/1370828195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780acff0 msgr2=0x55f6780d0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780acff0 0x55f6780d0040 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fd768009240 tx=0x7fd768004830 comp rx=0 tx=0).stop 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 -- 10.20.193.28:0/1370828195 shutdown_connections 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f6780de8b0 0x55f6780e0d40 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 0x55f6780ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd72ffff640 0 client.17457 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780ad970 0x55f6780d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1370828195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780acff0 0x55f6780d0040 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 -- 10.20.193.28:0/1370828195 >> 10.20.193.28:0/1370828195 conn(0x55f678067240 msgr2=0x55f6780a33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 -- 10.20.193.28:0/1370828195 shutdown_connections 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 1 -- 10.20.193.28:0/1370828195 wait complete. 2026-02-20T03:22:46.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.195+0000 7fd782c76e00 20 client.17457 trim_cache size 0 max 16384 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.202+0000 7fd782c76e00 1 Processor -- start 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.202+0000 7fd782c76e00 1 -- start start 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780acff0 0x55f6780cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780db130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 0x55f6780a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd782c76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd7240126a0 con 0x55f6780ad970 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd782c76e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd72400ff70 con 0x55f6780acff0 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd782c76e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd72400ddc0 con 0x55f6780b29c0 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77e4e6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780acff0 0x55f6780cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77ece7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 0x55f6780a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77e4e6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780acff0 0x55f6780cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56460/0 (socket says 10.20.193.28:56460) 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77dce5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780db130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77ece7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 0x55f6780a34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40844/0 (socket says 10.20.193.28:40844) 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77ece7640 1 -- 10.20.193.28:0/3056682926 learned_addr learned my addr 10.20.193.28:0/3056682926 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77dce5640 1 -- 10.20.193.28:0/3056682926 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 msgr2=0x55f6780a34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77dce5640 1 --2- 10.20.193.28:0/3056682926 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 0x55f6780a34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77dce5640 1 -- 10.20.193.28:0/3056682926 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780acff0 msgr2=0x55f6780cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77dce5640 1 --2- 10.20.193.28:0/3056682926 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780acff0 0x55f6780cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77dce5640 1 -- 10.20.193.28:0/3056682926 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6780a9b40 con 0x55f6780ad970 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.203+0000 7fd77e4e6640 1 --2- 10.20.193.28:0/3056682926 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780acff0 0x55f6780cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd77dce5640 1 --2- 10.20.193.28:0/3056682926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780db130 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x55f6780a8a30 tx=0x7fd76c005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2a5f45bd00cc37 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd75e7fc640 1 -- 10.20.193.28:0/3056682926 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c046040 con 0x55f6780ad970 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd75e7fc640 1 -- 10.20.193.28:0/3056682926 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd76c005e50 con 0x55f6780ad970 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd75e7fc640 1 -- 10.20.193.28:0/3056682926 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c041770 con 0x55f6780ad970 2026-02-20T03:22:46.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd782c76e00 1 -- 10.20.193.28:0/3056682926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 msgr2=0x55f6780db130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd782c76e00 1 --2- 10.20.193.28:0/3056682926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780db130 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x55f6780a8a30 tx=0x7fd76c005950 comp rx=0 tx=0).stop 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd782c76e00 1 -- 10.20.193.28:0/3056682926 shutdown_connections 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd782c76e00 1 --2- 10.20.193.28:0/3056682926 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780b29c0 0x55f6780a34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd782c76e00 1 --2- 10.20.193.28:0/3056682926 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780db130 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd782c76e00 1 --2- 10.20.193.28:0/3056682926 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780acff0 0x55f6780cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd782c76e00 1 -- 10.20.193.28:0/3056682926 >> 10.20.193.28:0/3056682926 conn(0x55f678067240 msgr2=0x55f6780ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.204+0000 7fd782c76e00 1 -- 10.20.193.28:0/3056682926 shutdown_connections 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.205+0000 7fd782c76e00 1 -- 10.20.193.28:0/3056682926 wait complete. 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.205+0000 7fd782c76e00 1 -- start start 2026-02-20T03:22:46.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.205+0000 7fd782c76e00 1 Processor -- start 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 0x55f6780d7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780d82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd782c76e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780b29c0 0x55f678149830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd782c76e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd72400e430 con 0x55f6780ad970 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd782c76e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd72400f8a0 con 0x55f6780b29c0 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd782c76e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd72400eb00 con 0x55f6780acff0 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77dce5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780d82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77ece7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780b29c0 0x55f678149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77dce5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780d82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60800/0 (socket says 10.20.193.28:60800) 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77dce5640 1 -- 10.20.193.28:0/1747472269 learned_addr learned my addr 10.20.193.28:0/1747472269 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:46.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77e4e6640 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 0x55f6780d7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77dce5640 1 -- 10.20.193.28:0/1747472269 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 msgr2=0x55f6780d7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77dce5640 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 0x55f6780d7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77dce5640 1 -- 10.20.193.28:0/1747472269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780b29c0 msgr2=0x55f678149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77dce5640 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780b29c0 0x55f678149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.206+0000 7fd77dce5640 1 -- 10.20.193.28:0/1747472269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f677cd6870 con 0x55f6780ad970 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd77dce5640 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780d82a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd76c044040 tx=0x7fd76c005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c72819dd17419c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd72ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd72ffff640 1 -- 10.20.193.28:0/1747472269 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c057070 con 0x55f6780ad970 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd72ffff640 1 -- 10.20.193.28:0/1747472269 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd76c033050 con 0x55f6780ad970 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd72ffff640 1 -- 10.20.193.28:0/1747472269 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c046040 con 0x55f6780ad970 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd782c76e00 1 -- 10.20.193.28:0/1747472269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f677f973f0 con 0x55f6780ad970 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd72ffff640 1 -- 10.20.193.28:0/1747472269 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd76c038c40 con 0x55f6780ad970 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd72ffff640 10 client.17463 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd782c76e00 10 client.17463 _ll_register_callbacks cb 0x7fd768004240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:46.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd782c76e00 1 -- 10.20.193.28:0/1747472269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f677fa9ab0 con 0x55f6780ad970 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd72ffff640 1 -- 10.20.193.28:0/1747472269 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd76c060060 con 0x55f6780ad970 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd782c76e00 10 client.17463 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.207+0000 7fd782c76e00 1 -- 10.20.193.28:0/1747472269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55f6780aa830 con 0x55f6780ad970 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd72ffff640 1 -- 10.20.193.28:0/1747472269 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd76c002650 con 0x55f6780ad970 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd782c76e00 10 client.17463 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd782c76e00 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd782c76e00 20 client.17463 populate_metadata read hostname 'trial028' 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f67814aad0 0x55f67814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd782c76e00 4 client.17463 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd782c76e00 1 -- 10.20.193.28:0/1747472269 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd76c005e50 con 0x55f67814aad0 2026-02-20T03:22:46.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd77e4e6640 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f67814aad0 0x55f67814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd77e4e6640 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f67814aad0 0x55f67814cec0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4868f52123c80f69 server_cookie=3c00cdc1c18680ed in_seq=0 out_seq=0 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.208+0000 7fd72ffff640 10 client.17463 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd72ffff640 1 -- 10.20.193.28:0/1747472269 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd76c005e50 con 0x55f67814aad0 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd72ffff640 10 client.17463 handle_command_reply: tid=0 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 client.17463 shutdown 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 -- 10.20.193.28:0/1747472269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 msgr2=0x55f6780d82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780d82a0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd76c044040 tx=0x7fd76c005b40 comp rx=0 tx=0).stop 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 -- 10.20.193.28:0/1747472269 shutdown_connections 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f67814aad0 0x55f67814cec0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f6780b29c0 0x55f678149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f6780ad970 0x55f6780d82a0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 --2- 10.20.193.28:0/1747472269 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f6780acff0 0x55f6780d7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 -- 10.20.193.28:0/1747472269 >> 10.20.193.28:0/1747472269 conn(0x55f678067240 msgr2=0x55f6780cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd72ffff640 0 client.17463 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:46.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 -- 10.20.193.28:0/1747472269 shutdown_connections 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 1 -- 10.20.193.28:0/1747472269 wait complete. 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.209+0000 7fd782c76e00 20 client.17463 trim_cache size 0 max 16384 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 -- 10.20.193.28:0/2885708872 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7480b0e20 msgr2=0x7fd7480b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7480b0e20 0x7fd7480b32e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd768004590 tx=0x7fd768009290 comp rx=0 tx=0).stop 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 -- 10.20.193.28:0/2885708872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd77810a980 msgr2=0x7fd7781a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd77810a980 0x7fd7781a19c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd774007f00 tx=0x7fd77400e510 comp rx=0 tx=0).stop 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 -- 10.20.193.28:0/2885708872 shutdown_connections 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7480b0e20 0x7fd7480b32e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd77810a980 0x7fd7781a19c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd778105320 0x7fd77819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 --2- 10.20.193.28:0/2885708872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd778104980 0x7fd77819d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 -- 10.20.193.28:0/2885708872 >> 10.20.193.28:0/2885708872 conn(0x7fd778100680 msgr2=0x7fd778101050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 -- 10.20.193.28:0/2885708872 shutdown_connections 2026-02-20T03:22:46.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:46.210+0000 7fd77f4e8640 1 -- 10.20.193.28:0/2885708872 wait complete. 2026-02-20T03:22:46.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 715299 8.67 MB/sec execute 259 sec latency 11.526 ms 2026-02-20T03:22:47.352 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:22:47.352 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:22:47.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 718920 8.71 MB/sec execute 260 sec latency 8.427 ms 2026-02-20T03:22:47.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:47 trial126 ceph-mon[38476]: pgmap v424: 129 pgs: 129 active+clean; 123 MiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 470 op/s 2026-02-20T03:22:47.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:47 trial028 ceph-mon[38552]: pgmap v424: 129 pgs: 129 active+clean; 123 MiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 470 op/s 2026-02-20T03:22:47.617 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:47 trial177 ceph-mon[43181]: pgmap v424: 129 pgs: 129 active+clean; 123 MiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 470 op/s 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 -- 10.20.193.28:0/34004046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa48109ba0 msgr2=0x7faa48115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 --2- 10.20.193.28:0/34004046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa48109ba0 0x7faa48115d10 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7faa4400b0a0 tx=0x7faa4402f430 comp rx=0 tx=0).stop 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 -- 10.20.193.28:0/34004046 shutdown_connections 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 --2- 10.20.193.28:0/34004046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa48109ba0 0x7faa48115d10 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 --2- 10.20.193.28:0/34004046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa48109220 0x7faa48109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 --2- 10.20.193.28:0/34004046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa4810eef0 0x7faa4810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 -- 10.20.193.28:0/34004046 >> 10.20.193.28:0/34004046 conn(0x7faa48078600 msgr2=0x7faa4807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 -- 10.20.193.28:0/34004046 shutdown_connections 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 -- 10.20.193.28:0/34004046 wait complete. 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.825+0000 7faa4e255640 1 Processor -- start 2026-02-20T03:22:47.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4e255640 1 -- start start 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4e255640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa48109220 0x7faa481a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4e255640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa48109ba0 0x7faa481a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4e255640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa4810eef0 0x7faa481a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4e255640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa48119060 con 0x7faa4810eef0 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4e255640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faa48118ee0 con 0x7faa48109220 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4e255640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa481191e0 con 0x7faa48109ba0 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4ca52640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa48109ba0 0x7faa481a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4ca52640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa48109ba0 0x7faa481a1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40878/0 (socket says 10.20.193.28:40878) 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4ca52640 1 -- 10.20.193.28:0/1336924721 learned_addr learned my addr 10.20.193.28:0/1336924721 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4d253640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa48109220 0x7faa481a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4da54640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa4810eef0 0x7faa481a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4ca52640 1 -- 10.20.193.28:0/1336924721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa48109220 msgr2=0x7faa481a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4ca52640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa48109220 0x7faa481a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4ca52640 1 -- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa4810eef0 msgr2=0x7faa481a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4ca52640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa4810eef0 0x7faa481a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.826+0000 7faa4ca52640 1 -- 10.20.193.28:0/1336924721 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa481a6470 con 0x7faa48109ba0 2026-02-20T03:22:47.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.827+0000 7faa4ca52640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa48109ba0 0x7faa481a1960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00d980 tx=0x7faa3c00de50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.827+0000 7faa367fc640 1 -- 10.20.193.28:0/1336924721 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c014070 con 0x7faa48109ba0 2026-02-20T03:22:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.827+0000 7faa367fc640 1 -- 10.20.193.28:0/1336924721 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faa3c0044e0 con 0x7faa48109ba0 2026-02-20T03:22:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.827+0000 7faa367fc640 1 -- 10.20.193.28:0/1336924721 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c005040 con 0x7faa48109ba0 2026-02-20T03:22:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.827+0000 7faa4e255640 1 -- 10.20.193.28:0/1336924721 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa481a6760 con 0x7faa48109ba0 2026-02-20T03:22:47.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.827+0000 7faa4e255640 1 -- 10.20.193.28:0/1336924721 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa481adfa0 con 0x7faa48109ba0 2026-02-20T03:22:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.830+0000 7faa519e3e00 1 Processor -- start 2026-02-20T03:22:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.831+0000 7faa519e3e00 1 -- start start 2026-02-20T03:22:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.831+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bec0c0 0x563e68bec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.831+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68beca70 0x563e68bf0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.831+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bf0b60 0x563e68bf0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.831+0000 7faa519e3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563e68b3ec00 con 0x563e68beca70 2026-02-20T03:22:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.831+0000 7faa519e3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563e68aec3c0 con 0x563e68bec0c0 2026-02-20T03:22:47.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.831+0000 7faa519e3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563e68b3ab30 con 0x563e68bf0b60 2026-02-20T03:22:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.831+0000 7faa4d253640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68beca70 0x563e68bf0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.831+0000 7faa367fc640 1 -- 10.20.193.28:0/1336924721 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7faa3c0047c0 con 0x7faa48109ba0 2026-02-20T03:22:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.832+0000 7faa4da54640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bec0c0 0x563e68bec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.832+0000 7faa4da54640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bec0c0 0x563e68bec4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56502/0 (socket says 10.20.193.28:56502) 2026-02-20T03:22:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.832+0000 7faa4d253640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68beca70 0x563e68bf0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60846/0 (socket says 10.20.193.28:60846) 2026-02-20T03:22:47.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.832+0000 7faa4d253640 1 -- 10.20.193.28:0/1646909888 learned_addr learned my addr 10.20.193.28:0/1646909888 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:47.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa4ca52640 1 --2- 10.20.193.28:0/1646909888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bf0b60 0x563e68bf0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa367fc640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa240b0ea0 0x7faa240b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa367fc640 1 -- 10.20.193.28:0/1336924721 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7faa3c0e05e0 con 0x7faa48109ba0 2026-02-20T03:22:47.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa4ca52640 1 -- 10.20.193.28:0/1646909888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bec0c0 msgr2=0x563e68bec4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:47.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa4ca52640 1 --2- 10.20.193.28:0/1646909888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bec0c0 0x563e68bec4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa4ca52640 1 -- 10.20.193.28:0/1646909888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68beca70 msgr2=0x563e68bf0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:47.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa4ca52640 1 --2- 10.20.193.28:0/1646909888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68beca70 0x563e68bf0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa4ca52640 1 -- 10.20.193.28:0/1646909888 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e68ae5840 con 0x563e68bf0b60 2026-02-20T03:22:47.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa4d253640 1 --2- 10.20.193.28:0/1646909888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68beca70 0x563e68bf0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:47.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.833+0000 7faa4ca52640 1 --2- 10.20.193.28:0/1646909888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bf0b60 0x563e68bf0fd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0ddc20 tx=0x7faa3c004690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395bed519f044dd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:47.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.834+0000 7faa4da54640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa240b0ea0 0x7faa240b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.834+0000 7faa15ce5640 1 -- 10.20.193.28:0/1646909888 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0a79c0 con 0x563e68bf0b60 2026-02-20T03:22:47.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.834+0000 7faa15ce5640 1 -- 10.20.193.28:0/1646909888 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faa3c0a89c0 con 0x563e68bf0b60 2026-02-20T03:22:47.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.834+0000 7faa15ce5640 1 -- 10.20.193.28:0/1646909888 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0a77e0 con 0x563e68bf0b60 2026-02-20T03:22:47.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.834+0000 7faa519e3e00 1 -- 10.20.193.28:0/1646909888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bf0b60 msgr2=0x563e68bf0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:47.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.834+0000 7faa519e3e00 1 --2- 10.20.193.28:0/1646909888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bf0b60 0x563e68bf0fd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0ddc20 tx=0x7faa3c004690 comp rx=0 tx=0).stop 2026-02-20T03:22:47.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.835+0000 7faa519e3e00 1 -- 10.20.193.28:0/1646909888 shutdown_connections 2026-02-20T03:22:47.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.835+0000 7faa519e3e00 1 --2- 10.20.193.28:0/1646909888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bf0b60 0x563e68bf0fd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.835+0000 7faa519e3e00 1 --2- 10.20.193.28:0/1646909888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68beca70 0x563e68bf0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.835+0000 7faa519e3e00 1 --2- 10.20.193.28:0/1646909888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bec0c0 0x563e68bec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.835+0000 7faa519e3e00 1 -- 10.20.193.28:0/1646909888 >> 10.20.193.28:0/1646909888 conn(0x563e68be4b60 msgr2=0x563e68bea5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:47.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.835+0000 7faa519e3e00 1 -- 10.20.193.28:0/1646909888 shutdown_connections 2026-02-20T03:22:47.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.835+0000 7faa519e3e00 1 -- 10.20.193.28:0/1646909888 wait complete. 2026-02-20T03:22:47.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.835+0000 7faa4da54640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa240b0ea0 0x7faa240b3360 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faa4402f940 tx=0x7faa4402f430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:47.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.836+0000 7faa519e3e00 1 -- start start 2026-02-20T03:22:47.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.836+0000 7faa519e3e00 1 Processor -- start 2026-02-20T03:22:47.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.836+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 0x563e68c174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.836+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c17a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.836+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c15c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.836+0000 7faa519e3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563e68ae61a0 con 0x563e68bf0b60 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.836+0000 7faa519e3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563e68c0a120 con 0x563e68beca70 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.836+0000 7faa519e3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563e68c162b0 con 0x563e68bec0c0 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4d253640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 0x563e68c174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4ca52640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c17a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4d253640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 0x563e68c174c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40888/0 (socket says 10.20.193.28:40888) 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4d253640 1 -- 10.20.193.28:0/4230438802 learned_addr learned my addr 10.20.193.28:0/4230438802 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4da54640 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c15c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4ca52640 1 -- 10.20.193.28:0/4230438802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 msgr2=0x563e68c174c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4ca52640 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 0x563e68c174c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4ca52640 1 -- 10.20.193.28:0/4230438802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 msgr2=0x563e68c15c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4ca52640 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c15c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4ca52640 1 -- 10.20.193.28:0/4230438802 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e68c0f9a0 con 0x563e68beca70 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa4ca52640 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c17a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0a8250 tx=0x7faa3c0a79c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c86b4515535f1523 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa02ffd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa02ffd640 1 -- 10.20.193.28:0/4230438802 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0b1520 con 0x563e68beca70 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa02ffd640 1 -- 10.20.193.28:0/4230438802 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faa3c00b760 con 0x563e68beca70 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.837+0000 7faa519e3e00 1 -- 10.20.193.28:0/4230438802 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e6890db60 con 0x563e68beca70 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa02ffd640 1 -- 10.20.193.28:0/4230438802 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0a3cf0 con 0x563e68beca70 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa02ffd640 1 -- 10.20.193.28:0/4230438802 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7faa3c0ac150 con 0x563e68beca70 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa02ffd640 10 client.26834 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 10 client.26834 _ll_register_callbacks cb 0x563e68aea0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 1 -- 10.20.193.28:0/4230438802 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e68b467f0 con 0x563e68beca70 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa02ffd640 1 -- 10.20.193.28:0/4230438802 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa3c0ac350 con 0x563e68beca70 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 10 client.26834 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:47.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 1 -- 10.20.193.28:0/4230438802 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563e68b0b430 con 0x563e68beca70 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa02ffd640 1 -- 10.20.193.28:0/4230438802 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7faa3c0a72d0 con 0x563e68beca70 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 10 client.26834 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 10 client.26834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 20 client.26834 populate_metadata read hostname 'trial028' 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e68c25830 0x563e68c27c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 4 client.26834 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.838+0000 7faa519e3e00 1 -- 10.20.193.28:0/4230438802 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e68ac0c00 con 0x563e68c25830 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.839+0000 7faa4d253640 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e68c25830 0x563e68c27c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.839+0000 7faa02ffd640 10 client.26834 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:47.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.839+0000 7faa4d253640 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e68c25830 0x563e68c27c20 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a72c9feca8bef888 server_cookie=8aa922c621b1b902 in_seq=0 out_seq=0 2026-02-20T03:22:47.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa02ffd640 1 -- 10.20.193.28:0/4230438802 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563e68ac0c00 con 0x563e68c25830 2026-02-20T03:22:47.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa02ffd640 10 client.26834 handle_command_reply: tid=0 2026-02-20T03:22:47.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 client.26834 shutdown 2026-02-20T03:22:47.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 -- 10.20.193.28:0/4230438802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 msgr2=0x563e68c17a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:47.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c17a00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faa3c0a8250 tx=0x7faa3c0a79c0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 -- 10.20.193.28:0/4230438802 shutdown_connections 2026-02-20T03:22:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e68c25830 0x563e68c27c20 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c15c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c17a00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 --2- 10.20.193.28:0/4230438802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 0x563e68c174c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 -- 10.20.193.28:0/4230438802 >> 10.20.193.28:0/4230438802 conn(0x563e68be4b60 msgr2=0x563e68be7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa02ffd640 0 client.26834 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 -- 10.20.193.28:0/4230438802 shutdown_connections 2026-02-20T03:22:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 1 -- 10.20.193.28:0/4230438802 wait complete. 2026-02-20T03:22:47.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.840+0000 7faa519e3e00 20 client.26834 trim_cache size 0 max 16384 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.849+0000 7faa519e3e00 1 Processor -- start 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.849+0000 7faa519e3e00 1 -- start start 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.849+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 0x563e68c2d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.849+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c2d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.849+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c1d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.849+0000 7faa519e3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f4012610 con 0x563e68bf0b60 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.849+0000 7faa519e3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f400fee0 con 0x563e68beca70 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.849+0000 7faa519e3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f400dd30 con 0x563e68bec0c0 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4da54640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c1d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4ca52640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c2d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4da54640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c1d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60852/0 (socket says 10.20.193.28:60852) 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4da54640 1 -- 10.20.193.28:0/2076053619 learned_addr learned my addr 10.20.193.28:0/2076053619 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4d253640 1 --2- 10.20.193.28:0/2076053619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 0x563e68c2d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4da54640 1 -- 10.20.193.28:0/2076053619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 msgr2=0x563e68c2d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4da54640 1 --2- 10.20.193.28:0/2076053619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 0x563e68c2d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4da54640 1 -- 10.20.193.28:0/2076053619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 msgr2=0x563e68c2d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4da54640 1 --2- 10.20.193.28:0/2076053619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c2d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4da54640 1 -- 10.20.193.28:0/2076053619 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e68bec810 con 0x563e68bf0b60 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4ca52640 1 --2- 10.20.193.28:0/2076053619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c2d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa4da54640 1 --2- 10.20.193.28:0/2076053619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c1d3c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7faa44036000 tx=0x7faa44006230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f040a60807a9dee3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa154e4640 1 -- 10.20.193.28:0/2076053619 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44055070 con 0x563e68bf0b60 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa154e4640 1 -- 10.20.193.28:0/2076053619 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faa44033040 con 0x563e68bf0b60 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.850+0000 7faa154e4640 1 -- 10.20.193.28:0/2076053619 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44041040 con 0x563e68bf0b60 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 -- 10.20.193.28:0/2076053619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 msgr2=0x563e68c1d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 --2- 10.20.193.28:0/2076053619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c1d3c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7faa44036000 tx=0x7faa44006230 comp rx=0 tx=0).stop 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 -- 10.20.193.28:0/2076053619 shutdown_connections 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 --2- 10.20.193.28:0/2076053619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bf0b60 0x563e68c1d3c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 --2- 10.20.193.28:0/2076053619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68beca70 0x563e68c2d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 --2- 10.20.193.28:0/2076053619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68bec0c0 0x563e68c2d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 -- 10.20.193.28:0/2076053619 >> 10.20.193.28:0/2076053619 conn(0x563e68be4b60 msgr2=0x563e68bea5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 -- 10.20.193.28:0/2076053619 shutdown_connections 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 -- 10.20.193.28:0/2076053619 wait complete. 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.851+0000 7faa519e3e00 1 -- start start 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa519e3e00 1 Processor -- start 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bec0c0 0x563e68c1d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68beca70 0x563e68c1d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa519e3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bf0b60 0x563e68c89cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa519e3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f400e3a0 con 0x563e68bec0c0 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa519e3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f400f810 con 0x563e68bf0b60 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa519e3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f400ea70 con 0x563e68beca70 2026-02-20T03:22:47.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4ca52640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68beca70 0x563e68c1d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4ca52640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68beca70 0x563e68c1d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40904/0 (socket says 10.20.193.28:40904) 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4ca52640 1 -- 10.20.193.28:0/252463941 learned_addr learned my addr 10.20.193.28:0/252463941 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4d253640 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bec0c0 0x563e68c1d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4da54640 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bf0b60 0x563e68c89cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4ca52640 1 -- 10.20.193.28:0/252463941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bf0b60 msgr2=0x563e68c89cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4ca52640 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bf0b60 0x563e68c89cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4ca52640 1 -- 10.20.193.28:0/252463941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bec0c0 msgr2=0x563e68c1d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4ca52640 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bec0c0 0x563e68c1d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4ca52640 1 -- 10.20.193.28:0/252463941 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e68c0f7d0 con 0x563e68beca70 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.852+0000 7faa4d253640 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bec0c0 0x563e68c1d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa4ca52640 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68beca70 0x563e68c1d850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00d950 tx=0x7faa3c0a45b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27d0e94069c01a49 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa02ffd640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa02ffd640 1 -- 10.20.193.28:0/252463941 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0b1520 con 0x563e68beca70 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa519e3e00 1 -- 10.20.193.28:0/252463941 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e6881d900 con 0x563e68beca70 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa02ffd640 1 -- 10.20.193.28:0/252463941 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x563e68b467f0 con 0x563e68beca70 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa02ffd640 1 -- 10.20.193.28:0/252463941 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0a6d40 con 0x563e68beca70 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa519e3e00 10 client.26866 _ll_register_callbacks cb 0x7faa3c0a77e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:47.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa519e3e00 1 -- 10.20.193.28:0/252463941 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa3c0a89c0 con 0x563e68beca70 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa02ffd640 1 -- 10.20.193.28:0/252463941 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7faa3c0a6fa0 con 0x563e68beca70 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa02ffd640 1 -- 10.20.193.28:0/252463941 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa3c05a120 con 0x563e68beca70 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa519e3e00 10 client.26866 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa519e3e00 1 -- 10.20.193.28:0/252463941 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563e68af94d0 con 0x563e68beca70 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.853+0000 7faa02ffd640 1 -- 10.20.193.28:0/252463941 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7faa3c05a2c0 con 0x563e68beca70 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.854+0000 7faa519e3e00 10 client.26866 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.854+0000 7faa519e3e00 10 client.26866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.854+0000 7faa519e3e00 20 client.26866 populate_metadata read hostname 'trial028' 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.854+0000 7faa519e3e00 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e68c924c0 0x563e68c94950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.854+0000 7faa519e3e00 4 client.26866 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.854+0000 7faa519e3e00 1 -- 10.20.193.28:0/252463941 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563e688aea20 con 0x563e68c924c0 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.854+0000 7faa4d253640 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e68c924c0 0x563e68c94950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.854+0000 7faa4d253640 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e68c924c0 0x563e68c94950 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d4d77b0fca688a6 server_cookie=838e31ef4aaa0e92 in_seq=0 out_seq=0 2026-02-20T03:22:47.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.854+0000 7faa02ffd640 10 client.26866 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:47.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa02ffd640 1 -- 10.20.193.28:0/252463941 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563e688aea20 con 0x563e68c924c0 2026-02-20T03:22:47.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa02ffd640 10 client.26866 handle_command_reply: tid=0 2026-02-20T03:22:47.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa519e3e00 1 client.26866 shutdown 2026-02-20T03:22:47.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa519e3e00 1 -- 10.20.193.28:0/252463941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68beca70 msgr2=0x563e68c1d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:47.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa519e3e00 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68beca70 0x563e68c1d850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00d950 tx=0x7faa3c0a45b0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa519e3e00 1 -- 10.20.193.28:0/252463941 shutdown_connections 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa519e3e00 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e68c924c0 0x563e68c94950 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa519e3e00 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e68bf0b60 0x563e68c89cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa519e3e00 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e68beca70 0x563e68c1d850 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa519e3e00 1 --2- 10.20.193.28:0/252463941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e68bec0c0 0x563e68c1d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa519e3e00 1 -- 10.20.193.28:0/252463941 >> 10.20.193.28:0/252463941 conn(0x563e68be4b60 msgr2=0x563e68c129c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.855+0000 7faa02ffd640 0 client.26866 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.856+0000 7faa519e3e00 1 -- 10.20.193.28:0/252463941 shutdown_connections 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.856+0000 7faa519e3e00 1 -- 10.20.193.28:0/252463941 wait complete. 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.856+0000 7faa519e3e00 20 client.26866 trim_cache size 0 max 16384 2026-02-20T03:22:47.859 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:22:47.860 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:22:47.860 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "164ff0c3-3162-4031-9d74-497d1a8ae75c", 2026-02-20T03:22:47.860 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:22:47.860 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:22:47.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 -- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa240b0ea0 msgr2=0x7faa240b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa240b0ea0 0x7faa240b3360 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7faa4402f940 tx=0x7faa4402f430 comp rx=0 tx=0).stop 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 -- 10.20.193.28:0/1336924721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa48109ba0 msgr2=0x7faa481a1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa48109ba0 0x7faa481a1960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00d980 tx=0x7faa3c00de50 comp rx=0 tx=0).stop 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 -- 10.20.193.28:0/1336924721 shutdown_connections 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa240b0ea0 0x7faa240b3360 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa4810eef0 0x7faa481a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa48109ba0 0x7faa481a1960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 --2- 10.20.193.28:0/1336924721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa48109220 0x7faa481a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 -- 10.20.193.28:0/1336924721 >> 10.20.193.28:0/1336924721 conn(0x7faa48078600 msgr2=0x7faa48079dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 -- 10.20.193.28:0/1336924721 shutdown_connections 2026-02-20T03:22:47.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:47.857+0000 7faa4e255640 1 -- 10.20.193.28:0/1336924721 wait complete. 2026-02-20T03:22:47.956 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:22:48.223 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:22:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.408+0000 7f4ee3366640 1 -- 10.20.193.28:0/2366838005 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4edc077620 msgr2=0x7f4edc077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.408+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2366838005 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4edc077620 0x7f4edc077a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009960 tx=0x7f4ecc02f140 comp rx=0 tx=0).stop 2026-02-20T03:22:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.408+0000 7f4ee3366640 1 -- 10.20.193.28:0/2366838005 shutdown_connections 2026-02-20T03:22:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.408+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2366838005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4edc113840 0x7f4edc115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.408+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2366838005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4edc077f40 0x7f4edc113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.408+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2366838005 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4edc077620 0x7f4edc077a00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.408+0000 7f4ee3366640 1 -- 10.20.193.28:0/2366838005 >> 10.20.193.28:0/2366838005 conn(0x7f4edc1006c0 msgr2=0x7f4edc102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.408+0000 7f4ee3366640 1 -- 10.20.193.28:0/2366838005 shutdown_connections 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.408+0000 7f4ee3366640 1 -- 10.20.193.28:0/2366838005 wait complete. 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.409+0000 7f4ee3366640 1 Processor -- start 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.409+0000 7f4ee3366640 1 -- start start 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee3366640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4edc077620 0x7f4edc10c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee3366640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4edc077f40 0x7f4edc1049a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee3366640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4edc113840 0x7f4edc104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee3366640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc119110 con 0x7f4edc077620 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee3366640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc118f90 con 0x7f4edc077f40 2026-02-20T03:22:48.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee3366640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc119290 con 0x7f4edc113840 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee2364640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4edc077620 0x7f4edc10c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee2364640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4edc077620 0x7f4edc10c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60880/0 (socket says 10.20.193.28:60880) 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee2364640 1 -- 10.20.193.28:0/2232988125 learned_addr learned my addr 10.20.193.28:0/2232988125 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4edc077f40 0x7f4edc1049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee2b65640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4edc113840 0x7f4edc104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee1b63640 1 -- 10.20.193.28:0/2232988125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4edc113840 msgr2=0x7f4edc104ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4edc113840 0x7f4edc104ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee1b63640 1 -- 10.20.193.28:0/2232988125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4edc077620 msgr2=0x7f4edc10c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4edc077620 0x7f4edc10c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee1b63640 1 -- 10.20.193.28:0/2232988125 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4edc105610 con 0x7f4edc077f40 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.410+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4edc077f40 0x7f4edc1049a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000e9f0 tx=0x7f4ed000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:48.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.411+0000 7f4ec37fe640 1 -- 10.20.193.28:0/2232988125 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed000cd80 con 0x7f4edc077f40 2026-02-20T03:22:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.411+0000 7f4ec37fe640 1 -- 10.20.193.28:0/2232988125 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4ed0004570 con 0x7f4edc077f40 2026-02-20T03:22:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.411+0000 7f4ee3366640 1 -- 10.20.193.28:0/2232988125 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4edc1b6780 con 0x7f4edc077f40 2026-02-20T03:22:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.411+0000 7f4ec37fe640 1 -- 10.20.193.28:0/2232988125 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0010690 con 0x7f4edc077f40 2026-02-20T03:22:48.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.411+0000 7f4ee3366640 1 -- 10.20.193.28:0/2232988125 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4edc1b6bd0 con 0x7f4edc077f40 2026-02-20T03:22:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.413+0000 7f4ec37fe640 1 -- 10.20.193.28:0/2232988125 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4ed0002890 con 0x7f4edc077f40 2026-02-20T03:22:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.414+0000 7f4ee6af4e00 1 Processor -- start 2026-02-20T03:22:48.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.414+0000 7f4ee6af4e00 1 -- start start 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.414+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 0x556f8980a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.414+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89804a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.414+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f89810e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.414+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556f89784e50 con 0x556f8980a000 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.414+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556f897579c0 con 0x556f89804630 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.414+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556f89705240 con 0x556f89804fb0 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2364640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89804a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2b65640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 0x556f8980a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2364640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89804a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56556/0 (socket says 10.20.193.28:56556) 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2364640 1 -- 10.20.193.28:0/961940137 learned_addr learned my addr 10.20.193.28:0/961940137 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:48.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/961940137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f89810e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2364640 1 -- 10.20.193.28:0/961940137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 msgr2=0x556f89810e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2364640 1 --2- 10.20.193.28:0/961940137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f89810e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2364640 1 -- 10.20.193.28:0/961940137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 msgr2=0x556f8980a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2364640 1 --2- 10.20.193.28:0/961940137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 0x556f8980a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2364640 1 -- 10.20.193.28:0/961940137 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f89718420 con 0x556f89804630 2026-02-20T03:22:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/961940137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f89810e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:22:48.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ec37fe640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4eb80b0e20 0x7f4eb80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ec37fe640 1 -- 10.20.193.28:0/2232988125 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f4ed00e0e10 con 0x7f4edc077f40 2026-02-20T03:22:48.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.415+0000 7f4ee2364640 1 --2- 10.20.193.28:0/961940137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89804a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc005b90 tx=0x7f4ecc005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce09facb2a3bc383 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:48.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ec0cf3640 1 -- 10.20.193.28:0/961940137 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc046070 con 0x556f89804630 2026-02-20T03:22:48.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ec0cf3640 1 -- 10.20.193.28:0/961940137 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4ecc033040 con 0x556f89804630 2026-02-20T03:22:48.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ec0cf3640 1 -- 10.20.193.28:0/961940137 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc038ce0 con 0x556f89804630 2026-02-20T03:22:48.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/961940137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 msgr2=0x556f89804a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:48.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/961940137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89804a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc005b90 tx=0x7f4ecc005bc0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ee2b65640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4eb80b0e20 0x7f4eb80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/961940137 shutdown_connections 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/961940137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f89810e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/961940137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89804a70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.416+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/961940137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 0x556f8980a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.417+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/961940137 >> 10.20.193.28:0/961940137 conn(0x556f897c7290 msgr2=0x556f89802d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.417+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/961940137 shutdown_connections 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.417+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/961940137 wait complete. 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.417+0000 7f4ee2b65640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4eb80b0e20 0x7f4eb80b32e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009fd0 tx=0x7f4ed800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.418+0000 7f4ee6af4e00 1 -- start start 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.418+0000 7f4ee6af4e00 1 Processor -- start 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f8981d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f8981dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 0x556f8981ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556f897538f0 con 0x556f8980a000 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556f89545f50 con 0x556f89804630 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556f8981f190 con 0x556f89804fb0 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee1b63640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f8981dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee2364640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f8981d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee2364640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f8981d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56568/0 (socket says 10.20.193.28:56568) 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee2364640 1 -- 10.20.193.28:0/3996428733 learned_addr learned my addr 10.20.193.28:0/3996428733 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee2b65640 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 0x556f8981ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee2364640 1 -- 10.20.193.28:0/3996428733 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 msgr2=0x556f8981dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee2364640 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f8981dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee2364640 1 -- 10.20.193.28:0/3996428733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 msgr2=0x556f8981ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee2364640 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 0x556f8981ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.419+0000 7f4ee2364640 1 -- 10.20.193.28:0/3996428733 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f89816980 con 0x556f89804630 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f8981dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4ee2364640 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f8981d860 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009a90 tx=0x7f4ecc02f140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa78cce437fc4af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4e8ffff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4e8ffff640 1 -- 10.20.193.28:0/3996428733 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc051070 con 0x556f89804630 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4e8ffff640 1 -- 10.20.193.28:0/3996428733 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4ecc0044d0 con 0x556f89804630 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4e8ffff640 1 -- 10.20.193.28:0/3996428733 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc046070 con 0x556f89804630 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/3996428733 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f89528b40 con 0x556f89804630 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4ee6af4e00 10 client.26852 _ll_register_callbacks cb 0x556f89790f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/3996428733 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556f897651a0 con 0x556f89804630 2026-02-20T03:22:48.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4e8ffff640 1 -- 10.20.193.28:0/3996428733 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f4ecc0026e0 con 0x556f89804630 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4e8ffff640 1 -- 10.20.193.28:0/3996428733 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ecc038920 con 0x556f89804630 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4ee6af4e00 10 client.26852 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.420+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/3996428733 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556f89712230 con 0x556f89804630 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.421+0000 7f4e8ffff640 1 -- 10.20.193.28:0/3996428733 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4ecc038b40 con 0x556f89804630 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.421+0000 7f4ee6af4e00 10 client.26852 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.421+0000 7f4ee6af4e00 10 client.26852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.421+0000 7f4ee6af4e00 20 client.26852 populate_metadata read hostname 'trial028' 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.421+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556f8982d110 0x556f8982f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.421+0000 7f4ee6af4e00 4 client.26852 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.421+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/3996428733 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f8975f5b0 con 0x556f8982d110 2026-02-20T03:22:48.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.421+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556f8982d110 0x556f8982f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.422+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556f8982d110 0x556f8982f540 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36956dc1be5cbb5e server_cookie=14d830f6278c6024 in_seq=0 out_seq=0 2026-02-20T03:22:48.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.422+0000 7f4e8ffff640 10 client.26852 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:48.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.422+0000 7f4e8ffff640 1 -- 10.20.193.28:0/3996428733 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556f8975f5b0 con 0x556f8982d110 2026-02-20T03:22:48.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.422+0000 7f4e8ffff640 10 client.26852 handle_command_reply: tid=0 2026-02-20T03:22:48.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.422+0000 7f4ee6af4e00 1 client.26852 shutdown 2026-02-20T03:22:48.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.422+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/3996428733 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 msgr2=0x556f8981d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:48.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.422+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f8981d860 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009a90 tx=0x7f4ecc02f140 comp rx=0 tx=0).stop 2026-02-20T03:22:48.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/3996428733 shutdown_connections 2026-02-20T03:22:48.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556f8982d110 0x556f8982f540 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f8980a000 0x556f8981ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f89804fb0 0x556f8981dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/3996428733 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f8981d860 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/3996428733 >> 10.20.193.28:0/3996428733 conn(0x556f897c7290 msgr2=0x556f89803440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:48.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4e8ffff640 0 client.26852 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:48.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/3996428733 shutdown_connections 2026-02-20T03:22:48.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/3996428733 wait complete. 2026-02-20T03:22:48.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.423+0000 7f4ee6af4e00 20 client.26852 trim_cache size 0 max 16384 2026-02-20T03:22:48.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.431+0000 7f4ee6af4e00 1 Processor -- start 2026-02-20T03:22:48.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.431+0000 7f4ee6af4e00 1 -- start start 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.431+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804630 0x556f8981d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.431+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804fb0 0x556f8981dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.431+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f8980a000 0x556f89803520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.431+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4e84012670 con 0x556f89804630 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.431+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8400ff40 con 0x556f89804fb0 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.431+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8400dd90 con 0x556f8980a000 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee1b63640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804fb0 0x556f8981dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee1b63640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804fb0 0x556f8981dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56584/0 (socket says 10.20.193.28:56584) 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee1b63640 1 -- 10.20.193.28:0/346040058 learned_addr learned my addr 10.20.193.28:0/346040058 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee2b65640 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f8980a000 0x556f89803520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee2364640 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804630 0x556f8981d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee1b63640 1 -- 10.20.193.28:0/346040058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f8980a000 msgr2=0x556f89803520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:48.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f8980a000 0x556f89803520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee1b63640 1 -- 10.20.193.28:0/346040058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804630 msgr2=0x556f8981d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:48.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804630 0x556f8981d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee1b63640 1 -- 10.20.193.28:0/346040058 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f898167b0 con 0x556f89804fb0 2026-02-20T03:22:48.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee2364640 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804630 0x556f8981d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:22:48.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804fb0 0x556f8981dda0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000cfd0 tx=0x7f4ed00de350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9bd3caa06ff202 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:48.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.432+0000 7f4ea64e6640 1 -- 10.20.193.28:0/346040058 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00acea0 con 0x556f89804fb0 2026-02-20T03:22:48.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ea64e6640 1 -- 10.20.193.28:0/346040058 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4ed00b1d50 con 0x556f89804fb0 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ea64e6640 1 -- 10.20.193.28:0/346040058 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00a7b00 con 0x556f89804fb0 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/346040058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804fb0 msgr2=0x556f8981dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804fb0 0x556f8981dda0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000cfd0 tx=0x7f4ed00de350 comp rx=0 tx=0).stop 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/346040058 shutdown_connections 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f8980a000 0x556f89803520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804fb0 0x556f8981dda0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/346040058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804630 0x556f8981d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/346040058 >> 10.20.193.28:0/346040058 conn(0x556f897c7290 msgr2=0x556f8982f120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/346040058 shutdown_connections 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.433+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/346040058 wait complete. 2026-02-20T03:22:48.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee6af4e00 1 -- start start 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee6af4e00 1 Processor -- start 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89825430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804fb0 0x556f89821750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee6af4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f8980a000 0x556f89821c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8400e400 con 0x556f89804fb0 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8400f870 con 0x556f89804630 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee6af4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8400ead0 con 0x556f8980a000 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee2364640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89825430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee2364640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89825430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56596/0 (socket says 10.20.193.28:56596) 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.434+0000 7f4ee2364640 1 -- 10.20.193.28:0/592416624 learned_addr learned my addr 10.20.193.28:0/592416624 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee2364640 1 -- 10.20.193.28:0/592416624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f8980a000 msgr2=0x556f89821c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:22:48.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee2364640 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f8980a000 0x556f89821c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee2364640 1 -- 10.20.193.28:0/592416624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804fb0 msgr2=0x556f89821750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee2364640 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804fb0 0x556f89821750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee2364640 1 -- 10.20.193.28:0/592416624 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f89436870 con 0x556f89804630 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee2364640 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89825430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc02f850 tx=0x7f4ecc038cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac68fdd2103e92be server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4e8ffff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4e8ffff640 1 -- 10.20.193.28:0/592416624 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc046040 con 0x556f89804630 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4e8ffff640 1 -- 10.20.193.28:0/592416624 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4ecc033070 con 0x556f89804630 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/592416624 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f896f7440 con 0x556f89804630 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee6af4e00 10 client.26858 _ll_register_callbacks cb 0x7f4ecc044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/592416624 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556f89728810 con 0x556f89804630 2026-02-20T03:22:48.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4e8ffff640 1 -- 10.20.193.28:0/592416624 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc051040 con 0x556f89804630 2026-02-20T03:22:48.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4e8ffff640 1 -- 10.20.193.28:0/592416624 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f4ecc0056a0 con 0x556f89804630 2026-02-20T03:22:48.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4e8ffff640 1 -- 10.20.193.28:0/592416624 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ecc0047c0 con 0x556f89804630 2026-02-20T03:22:48.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee6af4e00 10 client.26858 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:48.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.435+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/592416624 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556f898174a0 con 0x556f89804630 2026-02-20T03:22:48.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.436+0000 7f4e8ffff640 1 -- 10.20.193.28:0/592416624 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4ecc069030 con 0x556f89804630 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.436+0000 7f4ee6af4e00 10 client.26858 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.436+0000 7f4ee6af4e00 10 client.26858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.436+0000 7f4ee6af4e00 20 client.26858 populate_metadata read hostname 'trial028' 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.436+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556f89898c70 0x556f8989b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.436+0000 7f4ee6af4e00 4 client.26858 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.436+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/592416624 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556f89709b00 con 0x556f89898c70 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.436+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556f89898c70 0x556f8989b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee1b63640 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556f89898c70 0x556f8989b130 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f895ca8681f32f80 server_cookie=4512855271950ecc in_seq=0 out_seq=0 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4e8ffff640 10 client.26858 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4e8ffff640 1 -- 10.20.193.28:0/592416624 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556f89709b00 con 0x556f89898c70 2026-02-20T03:22:48.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4e8ffff640 10 client.26858 handle_command_reply: tid=0 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 client.26858 shutdown 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/592416624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 msgr2=0x556f89825430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89825430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc02f850 tx=0x7f4ecc038cf0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/592416624 shutdown_connections 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556f89898c70 0x556f8989b130 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556f8980a000 0x556f89821c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556f89804fb0 0x556f89821750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 --2- 10.20.193.28:0/592416624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556f89804630 0x556f89825430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/592416624 >> 10.20.193.28:0/592416624 conn(0x556f897c7290 msgr2=0x556f8981d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4e8ffff640 0 client.26858 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/592416624 shutdown_connections 2026-02-20T03:22:48.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 1 -- 10.20.193.28:0/592416624 wait complete. 2026-02-20T03:22:48.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.437+0000 7f4ee6af4e00 20 client.26858 trim_cache size 0 max 16384 2026-02-20T03:22:48.446 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:22:48.446 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:22:48.446 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:22:48.446 INFO:teuthology.orchestra.run.trial028.stdout: "164ff0c3-3162-4031-9d74-497d1a8ae75c": { 2026-02-20T03:22:48.446 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:22:48.446 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "164ff0c3-3162-4031-9d74-497d1a8ae75c", 2026-02-20T03:22:48.447 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:22:48.447 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:48.447 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:22:48.447 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 -- 10.20.193.28:0/2232988125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4eb80b0e20 msgr2=0x7f4eb80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4eb80b0e20 0x7f4eb80b32e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009fd0 tx=0x7f4ed800b040 comp rx=0 tx=0).stop 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 -- 10.20.193.28:0/2232988125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4edc077f40 msgr2=0x7f4edc1049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4edc077f40 0x7f4edc1049a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000e9f0 tx=0x7f4ed000eec0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 -- 10.20.193.28:0/2232988125 shutdown_connections 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4eb80b0e20 0x7f4eb80b32e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4edc113840 0x7f4edc104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4edc077f40 0x7f4edc1049a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 --2- 10.20.193.28:0/2232988125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4edc077620 0x7f4edc10c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:48.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 -- 10.20.193.28:0/2232988125 >> 10.20.193.28:0/2232988125 conn(0x7f4edc1006c0 msgr2=0x7f4edc102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:48.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 -- 10.20.193.28:0/2232988125 shutdown_connections 2026-02-20T03:22:48.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:22:48.438+0000 7f4ee3366640 1 -- 10.20.193.28:0/2232988125 wait complete. 2026-02-20T03:22:48.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 722266 8.75 MB/sec execute 261 sec latency 8.749 ms 2026-02-20T03:22:48.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:48 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:22:48.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:48 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:48.537 INFO:tasks.cephfs.filesystem:scrub status for tag:164ff0c3-3162-4031-9d74-497d1a8ae75c - {'path': '/', 'tag': '164ff0c3-3162-4031-9d74-497d1a8ae75c', 'options': 'recursive,force'} 2026-02-20T03:22:48.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:48 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:22:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:48 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:48.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:48 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:22:48.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:48 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 725644 8.78 MB/sec execute 262 sec latency 6.756 ms 2026-02-20T03:22:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:49 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:22:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:49 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:49 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:22:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:49 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:22:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:49 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:49 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:22:49.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:49 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:49 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:49 trial126 ceph-mon[38476]: pgmap v425: 129 pgs: 129 active+clean; 127 MiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 467 op/s 2026-02-20T03:22:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:49 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:22:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:49 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:49 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:22:49.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:49 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:22:49.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:49 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:49 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:22:49.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:49 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:49 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:49 trial028 ceph-mon[38552]: pgmap v425: 129 pgs: 129 active+clean; 127 MiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 467 op/s 2026-02-20T03:22:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:49 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:22:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:49 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:49 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:22:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:49 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:22:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:49 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:49 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:22:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:49 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:49 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:22:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:49 trial177 ceph-mon[43181]: pgmap v425: 129 pgs: 129 active+clean; 127 MiB data, 2.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 467 op/s 2026-02-20T03:22:50.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 729130 8.82 MB/sec execute 263 sec latency 14.010 ms 2026-02-20T03:22:51.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 732675 8.86 MB/sec execute 264 sec latency 7.605 ms 2026-02-20T03:22:51.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:51 trial126 ceph-mon[38476]: pgmap v426: 129 pgs: 129 active+clean; 132 MiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 514 op/s 2026-02-20T03:22:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:51 trial028 ceph-mon[38552]: pgmap v426: 129 pgs: 129 active+clean; 132 MiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 514 op/s 2026-02-20T03:22:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:51 trial177 ceph-mon[43181]: pgmap v426: 129 pgs: 129 active+clean; 132 MiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 514 op/s 2026-02-20T03:22:52.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 736105 8.90 MB/sec execute 265 sec latency 11.560 ms 2026-02-20T03:22:53.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 739750 8.93 MB/sec execute 266 sec latency 6.950 ms 2026-02-20T03:22:53.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- 10.20.193.28:0/1131666925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 msgr2=0x7fbe20079f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:53.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/1131666925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 0x7fbe20079f30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b0a0 tx=0x7fbe1c02f410 comp rx=0 tx=0).stop 2026-02-20T03:22:53.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- 10.20.193.28:0/1131666925 shutdown_connections 2026-02-20T03:22:53.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/1131666925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 0x7fbe20079f30 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/1131666925 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe20078cf0 0x7fbe20079150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/1131666925 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe20077ab0 0x7fbe20077eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- 10.20.193.28:0/1131666925 >> 10.20.193.28:0/1131666925 conn(0x7fbe201000c0 msgr2=0x7fbe201024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:53.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- 10.20.193.28:0/1131666925 shutdown_connections 2026-02-20T03:22:53.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- 10.20.193.28:0/1131666925 wait complete. 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 Processor -- start 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- start start 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe20077ab0 0x7fbe201a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe20078cf0 0x7fbe201a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 0x7fbe201a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20114960 con 0x7fbe20079690 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201147e0 con 0x7fbe20078cf0 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20114ae0 con 0x7fbe20077ab0 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe253d7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 0x7fbe201a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe253d7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 0x7fbe201a8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60948/0 (socket says 10.20.193.28:60948) 2026-02-20T03:22:53.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe253d7640 1 -- 10.20.193.28:0/2084942190 learned_addr learned my addr 10.20.193.28:0/2084942190 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe20077ab0 0x7fbe201a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe17fff640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe20078cf0 0x7fbe201a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe253d7640 1 -- 10.20.193.28:0/2084942190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe20077ab0 msgr2=0x7fbe201a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe253d7640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe20077ab0 0x7fbe201a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe253d7640 1 -- 10.20.193.28:0/2084942190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe20078cf0 msgr2=0x7fbe201a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe253d7640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe20078cf0 0x7fbe201a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe253d7640 1 -- 10.20.193.28:0/2084942190 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe201a8b60 con 0x7fbe20079690 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe17fff640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe20078cf0 0x7fbe201a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe253d7640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 0x7fbe201a8460 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00c090 tx=0x7fbe1c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe15ffb640 1 -- 10.20.193.28:0/2084942190 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c002a60 con 0x7fbe20079690 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe15ffb640 1 -- 10.20.193.28:0/2084942190 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbe1c002c00 con 0x7fbe20079690 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe15ffb640 1 -- 10.20.193.28:0/2084942190 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0388b0 con 0x7fbe20079690 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.573+0000 7fbe25bd8640 1 -- 10.20.193.28:0/2084942190 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe201a8df0 con 0x7fbe20079690 2026-02-20T03:22:53.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.575+0000 7fbe25bd8640 1 -- 10.20.193.28:0/2084942190 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe201a92b0 con 0x7fbe20079690 2026-02-20T03:22:53.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.577+0000 7fbe15ffb640 1 -- 10.20.193.28:0/2084942190 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbe1c038a50 con 0x7fbe20079690 2026-02-20T03:22:53.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe29cc3e00 1 Processor -- start 2026-02-20T03:22:53.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe29cc3e00 1 -- start start 2026-02-20T03:22:53.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 0x55a0b4537f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 0x55a0b453a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0b44838f0 con 0x55a0b4532e80 2026-02-20T03:22:53.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a0b44312e0 con 0x55a0b4538560 2026-02-20T03:22:53.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a0b447f820 con 0x55a0b45337c0 2026-02-20T03:22:53.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe24bd6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 0x55a0b4537f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe24bd6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 0x55a0b4537f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40974/0 (socket says 10.20.193.28:40974) 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe24bd6640 1 -- 10.20.193.28:0/2236757921 learned_addr learned my addr 10.20.193.28:0/2236757921 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60964/0 (socket says 10.20.193.28:60964) 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe17fff640 1 --2- 10.20.193.28:0/2236757921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 0x55a0b453a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe17fff640 1 -- 10.20.193.28:0/2236757921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 msgr2=0x55a0b4537f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe17fff640 1 --2- 10.20.193.28:0/2236757921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 0x55a0b4537f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe17fff640 1 -- 10.20.193.28:0/2236757921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 msgr2=0x55a0b453a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe17fff640 1 --2- 10.20.193.28:0/2236757921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 0x55a0b453a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.578+0000 7fbe17fff640 1 -- 10.20.193.28:0/2236757921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b44235a0 con 0x55a0b4532e80 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe15ffb640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdfc0b0e20 0x7fbdfc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe15ffb640 1 -- 10.20.193.28:0/2084942190 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fbe1c105630 con 0x7fbe20079690 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe17fff640 1 --2- 10.20.193.28:0/2236757921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533280 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009260 tx=0x7fbe08004110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62486231f32d63dd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbdecffe640 1 -- 10.20.193.28:0/2236757921 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08010460 con 0x55a0b4532e80 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdfc0b0e20 0x7fbdfc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbdecffe640 1 -- 10.20.193.28:0/2236757921 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbe08010aa0 con 0x55a0b4532e80 2026-02-20T03:22:53.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbdecffe640 1 -- 10.20.193.28:0/2236757921 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0800fb70 con 0x55a0b4532e80 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2236757921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 msgr2=0x55a0b4533280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2236757921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533280 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009260 tx=0x7fbe08004110 comp rx=0 tx=0).stop 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdfc0b0e20 0x7fbdfc0b32e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x55a0b4533eb0 tx=0x7fbe10007450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2236757921 shutdown_connections 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2236757921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 0x55a0b453a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2236757921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 0x55a0b4537f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2236757921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533280 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2236757921 >> 10.20.193.28:0/2236757921 conn(0x55a0b452a6f0 msgr2=0x55a0b4531570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.579+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2236757921 shutdown_connections 2026-02-20T03:22:53.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.580+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2236757921 wait complete. 2026-02-20T03:22:53.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe29cc3e00 1 -- start start 2026-02-20T03:22:53.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe29cc3e00 1 Processor -- start 2026-02-20T03:22:53.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b454ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 0x55a0b454bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 0x55a0b4552ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0b442b0c0 con 0x55a0b4532e80 2026-02-20T03:22:53.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a0b453b610 con 0x55a0b45337c0 2026-02-20T03:22:53.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a0b4553460 con 0x55a0b4538560 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe24bd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b454ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe24bd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b454ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60966/0 (socket says 10.20.193.28:60966) 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe24bd6640 1 -- 10.20.193.28:0/2176355403 learned_addr learned my addr 10.20.193.28:0/2176355403 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe17fff640 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 0x55a0b454bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.581+0000 7fbe253d7640 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 0x55a0b4552ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe24bd6640 1 -- 10.20.193.28:0/2176355403 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 msgr2=0x55a0b4552ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 0x55a0b4552ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe24bd6640 1 -- 10.20.193.28:0/2176355403 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 msgr2=0x55a0b454bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 0x55a0b454bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe24bd6640 1 -- 10.20.193.28:0/2176355403 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b4545130 con 0x55a0b4532e80 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b454ba10 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbe10005cc0 tx=0x7fbe10004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f425978dcf71948 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbde5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbde5ffb640 1 -- 10.20.193.28:0/2176355403 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1001c650 con 0x55a0b4532e80 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbde5ffb640 1 -- 10.20.193.28:0/2176355403 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbe1001cc90 con 0x55a0b4532e80 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbde5ffb640 1 -- 10.20.193.28:0/2176355403 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1001ed30 con 0x55a0b4532e80 2026-02-20T03:22:53.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2176355403 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b443f820 con 0x55a0b4532e80 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbde5ffb640 1 -- 10.20.193.28:0/2176355403 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fbe10010460 con 0x55a0b4532e80 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe29cc3e00 10 client.17505 _ll_register_callbacks cb 0x55a0b442eff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2176355403 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0b448b4e0 con 0x55a0b4532e80 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbde5ffb640 1 -- 10.20.193.28:0/2176355403 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe1002e060 con 0x55a0b4532e80 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe29cc3e00 10 client.17505 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.582+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2176355403 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a0b4444380 con 0x55a0b4532e80 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.583+0000 7fbde5ffb640 1 -- 10.20.193.28:0/2176355403 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fbe1001e430 con 0x55a0b4532e80 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.583+0000 7fbe29cc3e00 10 client.17505 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.583+0000 7fbe29cc3e00 10 client.17505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.583+0000 7fbe29cc3e00 20 client.17505 populate_metadata read hostname 'trial028' 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.583+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0b4557860 0x55a0b4559c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.583+0000 7fbe29cc3e00 4 client.17505 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.583+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2176355403 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0b4405bd0 con 0x55a0b4557860 2026-02-20T03:22:53.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.583+0000 7fbe17fff640 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0b4557860 0x55a0b4559c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.584+0000 7fbe17fff640 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0b4557860 0x55a0b4559c90 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec57fec958eb9bb server_cookie=e67bbc52f126a78c in_seq=0 out_seq=0 2026-02-20T03:22:53.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.584+0000 7fbde5ffb640 10 client.17505 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:53.585 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.584+0000 7fbde5ffb640 1 -- 10.20.193.28:0/2176355403 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a0b4405bd0 con 0x55a0b4557860 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.584+0000 7fbde5ffb640 10 client.17505 handle_command_reply: tid=0 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.584+0000 7fbe29cc3e00 1 client.17505 shutdown 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2176355403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 msgr2=0x55a0b454ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b454ba10 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbe10005cc0 tx=0x7fbe10004830 comp rx=0 tx=0).stop 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2176355403 shutdown_connections 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0b4557860 0x55a0b4559c90 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 0x55a0b4552ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 0x55a0b454bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/2176355403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b454ba10 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbde5ffb640 0 client.17505 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2176355403 >> 10.20.193.28:0/2176355403 conn(0x55a0b452a6f0 msgr2=0x55a0b4539910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2176355403 shutdown_connections 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/2176355403 wait complete. 2026-02-20T03:22:53.586 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.585+0000 7fbe29cc3e00 20 client.17505 trim_cache size 0 max 16384 2026-02-20T03:22:53.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.593+0000 7fbe29cc3e00 1 Processor -- start 2026-02-20T03:22:53.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.593+0000 7fbe29cc3e00 1 -- start start 2026-02-20T03:22:53.594 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.593+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.593+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 0x55a0b4552e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.593+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 0x55a0b4533ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.593+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc40126a0 con 0x55a0b4532e80 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.593+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc400ff70 con 0x55a0b4538560 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.593+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc400ddc0 con 0x55a0b45337c0 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.593+0000 7fbe24bd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe24bd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60976/0 (socket says 10.20.193.28:60976) 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe24bd6640 1 -- 10.20.193.28:0/441263069 learned_addr learned my addr 10.20.193.28:0/441263069 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe17fff640 1 --2- 10.20.193.28:0/441263069 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 0x55a0b4552e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe253d7640 1 --2- 10.20.193.28:0/441263069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 0x55a0b4533ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe24bd6640 1 -- 10.20.193.28:0/441263069 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 msgr2=0x55a0b4552e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/441263069 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 0x55a0b4552e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe24bd6640 1 -- 10.20.193.28:0/441263069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 msgr2=0x55a0b4533ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/441263069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 0x55a0b4533ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe24bd6640 1 -- 10.20.193.28:0/441263069 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b4544f60 con 0x55a0b4532e80 2026-02-20T03:22:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:53 trial126 ceph-mon[38476]: pgmap v427: 129 pgs: 129 active+clean; 133 MiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 405 op/s 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/441263069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533260 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbe10004180 tx=0x7fbe1002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9237b2aac48987f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbde7fff640 1 -- 10.20.193.28:0/441263069 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1001e8c0 con 0x55a0b4532e80 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbde7fff640 1 -- 10.20.193.28:0/441263069 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55a0b448b4e0 con 0x55a0b4532e80 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbde7fff640 1 -- 10.20.193.28:0/441263069 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1001ca20 con 0x55a0b4532e80 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/441263069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 msgr2=0x55a0b4533260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/441263069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533260 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbe10004180 tx=0x7fbe1002c000 comp rx=0 tx=0).stop 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/441263069 shutdown_connections 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/441263069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b4538560 0x55a0b4533ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/441263069 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b45337c0 0x55a0b4552e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/441263069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4533260 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.594+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/441263069 >> 10.20.193.28:0/441263069 conn(0x55a0b452a6f0 msgr2=0x55a0b454a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.595+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/441263069 shutdown_connections 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.595+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/441263069 wait complete. 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.595+0000 7fbe29cc3e00 1 -- start start 2026-02-20T03:22:53.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.595+0000 7fbe29cc3e00 1 Processor -- start 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4552780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 0x55a0b4552cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe29cc3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 0x55a0b4550e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc400e430 con 0x55a0b4532e80 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc400f8a0 con 0x55a0b45337c0 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe29cc3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc400eb00 con 0x55a0b4538560 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe24bd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4552780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe24bd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4552780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60992/0 (socket says 10.20.193.28:60992) 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe24bd6640 1 -- 10.20.193.28:0/3583954489 learned_addr learned my addr 10.20.193.28:0/3583954489 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe253d7640 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 0x55a0b4550e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe17fff640 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 0x55a0b4552cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe24bd6640 1 -- 10.20.193.28:0/3583954489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 msgr2=0x55a0b4550e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 0x55a0b4550e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe24bd6640 1 -- 10.20.193.28:0/3583954489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 msgr2=0x55a0b4552cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 0x55a0b4552cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe24bd6640 1 -- 10.20.193.28:0/3583954489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b41e3690 con 0x55a0b4532e80 2026-02-20T03:22:53.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe17fff640 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 0x55a0b4552cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe24bd6640 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4552780 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbe100043e0 tx=0x7fbe1001c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc734eb7fad3431 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbde5ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbde5ffb640 1 -- 10.20.193.28:0/3583954489 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1001ca20 con 0x55a0b4532e80 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbde5ffb640 1 -- 10.20.193.28:0/3583954489 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbe1001cbc0 con 0x55a0b4532e80 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbde5ffb640 1 -- 10.20.193.28:0/3583954489 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10004ad0 con 0x55a0b4532e80 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.596+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/3583954489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b4448b70 con 0x55a0b4532e80 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbde5ffb640 1 -- 10.20.193.28:0/3583954489 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fbe10004c70 con 0x55a0b4532e80 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 10 client.17511 _ll_register_callbacks cb 0x7fbe100041d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/3583954489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0b4491290 con 0x55a0b4532e80 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbde5ffb640 1 -- 10.20.193.28:0/3583954489 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe10005630 con 0x55a0b4532e80 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 10 client.17511 fetch_fsmap learned FSMap version 29 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/3583954489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a0b4545c50 con 0x55a0b4532e80 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbde5ffb640 1 -- 10.20.193.28:0/3583954489 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fbe1004b030 con 0x55a0b4532e80 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 10 client.17511 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 10 client.17511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 20 client.17511 populate_metadata read hostname 'trial028' 2026-02-20T03:22:53.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0b45c3330 0x55a0b45c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:22:53.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 4 client.17511 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:22:53.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/3583954489 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a0b448b4e0 con 0x55a0b45c3330 2026-02-20T03:22:53.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.597+0000 7fbe17fff640 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0b45c3330 0x55a0b45c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:22:53.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.598+0000 7fbe17fff640 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0b45c3330 0x55a0b45c57f0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0dcd7d5824c5d01 server_cookie=82d92668716ea3d2 in_seq=0 out_seq=0 2026-02-20T03:22:53.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.598+0000 7fbde5ffb640 10 client.17511 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:53.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:53 trial028 ceph-mon[38552]: pgmap v427: 129 pgs: 129 active+clean; 133 MiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 405 op/s 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.707+0000 7fbde5ffb640 1 -- 10.20.193.28:0/3583954489 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a0b448b4e0 con 0x55a0b45c3330 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.707+0000 7fbde5ffb640 10 client.17511 handle_command_reply: tid=0 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.707+0000 7fbe29cc3e00 1 client.17511 shutdown 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/3583954489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 msgr2=0x55a0b4552780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4552780 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fbe100043e0 tx=0x7fbe1001c6d0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/3583954489 shutdown_connections 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0b45c3330 0x55a0b45c57f0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0b4538560 0x55a0b4550e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0b45337c0 0x55a0b4552cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 --2- 10.20.193.28:0/3583954489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0b4532e80 0x55a0b4552780 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbde5ffb640 0 client.17511 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:22:53.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/3583954489 >> 10.20.193.28:0/3583954489 conn(0x55a0b452a6f0 msgr2=0x55a0b4530d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/3583954489 shutdown_connections 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 1 -- 10.20.193.28:0/3583954489 wait complete. 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.708+0000 7fbe29cc3e00 20 client.17511 trim_cache size 0 max 16384 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 -- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdfc0b0e20 msgr2=0x7fbdfc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdfc0b0e20 0x7fbdfc0b32e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x55a0b4533eb0 tx=0x7fbe10007450 comp rx=0 tx=0).stop 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 -- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 msgr2=0x7fbe201a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 0x7fbe201a8460 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00c090 tx=0x7fbe1c004290 comp rx=0 tx=0).stop 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 -- 10.20.193.28:0/2084942190 shutdown_connections 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdfc0b0e20 0x7fbdfc0b32e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe20079690 0x7fbe201a8460 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe20078cf0 0x7fbe201a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 --2- 10.20.193.28:0/2084942190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe20077ab0 0x7fbe201a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:22:53.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 -- 10.20.193.28:0/2084942190 >> 10.20.193.28:0/2084942190 conn(0x7fbe201000c0 msgr2=0x7fbe20101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:22:53.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 -- 10.20.193.28:0/2084942190 shutdown_connections 2026-02-20T03:22:53.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:22:53.709+0000 7fbe25bd8640 1 -- 10.20.193.28:0/2084942190 wait complete. 2026-02-20T03:22:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:53 trial177 ceph-mon[43181]: pgmap v427: 129 pgs: 129 active+clean; 133 MiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 405 op/s 2026-02-20T03:22:54.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 742863 8.97 MB/sec execute 267 sec latency 53.094 ms 2026-02-20T03:22:55.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 746296 9.00 MB/sec execute 268 sec latency 7.729 ms 2026-02-20T03:22:55.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:55 trial126 ceph-mon[38476]: pgmap v428: 129 pgs: 129 active+clean; 136 MiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 444 op/s 2026-02-20T03:22:55.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:55 trial028 ceph-mon[38552]: pgmap v428: 129 pgs: 129 active+clean; 136 MiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 444 op/s 2026-02-20T03:22:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:55 trial177 ceph-mon[43181]: pgmap v428: 129 pgs: 129 active+clean; 136 MiB data, 2.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 444 op/s 2026-02-20T03:22:56.511 INFO:tasks.workunit.client.0.trial028.stdout: 1 749027 9.02 MB/sec execute 269 sec latency 201.947 ms 2026-02-20T03:22:57.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 752728 9.07 MB/sec execute 270 sec latency 8.347 ms 2026-02-20T03:22:57.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:57 trial126 ceph-mon[38476]: pgmap v429: 129 pgs: 129 active+clean; 137 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 481 op/s 2026-02-20T03:22:57.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:57 trial028 ceph-mon[38552]: pgmap v429: 129 pgs: 129 active+clean; 137 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 481 op/s 2026-02-20T03:22:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:57 trial177 ceph-mon[43181]: pgmap v429: 129 pgs: 129 active+clean; 137 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 481 op/s 2026-02-20T03:22:58.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 756071 9.10 MB/sec execute 271 sec latency 51.055 ms 2026-02-20T03:22:58.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:22:58.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:22:58.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:22:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:22:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:22:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:22:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:22:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:22:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:22:59.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 759869 9.15 MB/sec execute 272 sec latency 9.104 ms 2026-02-20T03:22:59.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:22:59 trial126 ceph-mon[38476]: pgmap v430: 129 pgs: 129 active+clean; 134 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 437 op/s 2026-02-20T03:22:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:22:59 trial028 ceph-mon[38552]: pgmap v430: 129 pgs: 129 active+clean; 134 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 437 op/s 2026-02-20T03:22:59.618 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:22:59 trial177 ceph-mon[43181]: pgmap v430: 129 pgs: 129 active+clean; 134 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 437 op/s 2026-02-20T03:23:00.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 763498 9.18 MB/sec execute 273 sec latency 17.382 ms 2026-02-20T03:23:01.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 764674 9.16 MB/sec execute 274 sec latency 452.339 ms 2026-02-20T03:23:01.585 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:01 trial028 ceph-mon[38552]: pgmap v431: 129 pgs: 129 active+clean; 140 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 512 op/s 2026-02-20T03:23:01.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:01 trial126 ceph-mon[38476]: pgmap v431: 129 pgs: 129 active+clean; 140 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 512 op/s 2026-02-20T03:23:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:01 trial177 ceph-mon[43181]: pgmap v431: 129 pgs: 129 active+clean; 140 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 512 op/s 2026-02-20T03:23:02.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 764684 9.13 MB/sec execute 275 sec latency 1444.881 ms 2026-02-20T03:23:02.540 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2026-02-20T03:23:02.540 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:23:02.819 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:03.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.006+0000 7f33d3756640 1 -- 10.20.193.28:0/2373350844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109220 msgr2=0x7f33cc109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.006+0000 7f33d3756640 1 --2- 10.20.193.28:0/2373350844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109220 0x7f33cc109660 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f33b8009a30 tx=0x7f33b802f220 comp rx=0 tx=0).stop 2026-02-20T03:23:03.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.006+0000 7f33d3756640 1 -- 10.20.193.28:0/2373350844 shutdown_connections 2026-02-20T03:23:03.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.006+0000 7f33d3756640 1 --2- 10.20.193.28:0/2373350844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f33cc109ba0 0x7f33cc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.006+0000 7f33d3756640 1 --2- 10.20.193.28:0/2373350844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109220 0x7f33cc109660 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.006+0000 7f33d3756640 1 --2- 10.20.193.28:0/2373350844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33cc10eef0 0x7f33cc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.006+0000 7f33d3756640 1 -- 10.20.193.28:0/2373350844 >> 10.20.193.28:0/2373350844 conn(0x7f33cc078600 msgr2=0x7f33cc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:03.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.007+0000 7f33d3756640 1 -- 10.20.193.28:0/2373350844 shutdown_connections 2026-02-20T03:23:03.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.007+0000 7f33d3756640 1 -- 10.20.193.28:0/2373350844 wait complete. 2026-02-20T03:23:03.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.007+0000 7f33d3756640 1 Processor -- start 2026-02-20T03:23:03.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.007+0000 7f33d3756640 1 -- start start 2026-02-20T03:23:03.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d3756640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33cc109220 0x7f33cc1a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d3756640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109ba0 0x7f33cc1a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d3756640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f33cc10eef0 0x7f33cc1a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d3756640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc1190a0 con 0x7f33cc109ba0 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d3756640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc118f20 con 0x7f33cc109220 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d3756640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc119220 con 0x7f33cc10eef0 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d1f53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109ba0 0x7f33cc1a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d1f53640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109ba0 0x7f33cc1a1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33586/0 (socket says 10.20.193.28:33586) 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d1f53640 1 -- 10.20.193.28:0/3974596024 learned_addr learned my addr 10.20.193.28:0/3974596024 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d2f55640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f33cc10eef0 0x7f33cc1a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d2754640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33cc109220 0x7f33cc1a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d1f53640 1 -- 10.20.193.28:0/3974596024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f33cc10eef0 msgr2=0x7f33cc1a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d1f53640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f33cc10eef0 0x7f33cc1a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d1f53640 1 -- 10.20.193.28:0/3974596024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33cc109220 msgr2=0x7f33cc1a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d1f53640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33cc109220 0x7f33cc1a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.008+0000 7f33d1f53640 1 -- 10.20.193.28:0/3974596024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc1a65b0 con 0x7f33cc109ba0 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.009+0000 7f33d1f53640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109ba0 0x7f33cc1a1aa0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f33b8005ec0 tx=0x7f33b8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.009+0000 7f33b77fe640 1 -- 10.20.193.28:0/3974596024 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8005020 con 0x7f33cc109ba0 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.009+0000 7f33b77fe640 1 -- 10.20.193.28:0/3974596024 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f33b8005660 con 0x7f33cc109ba0 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.009+0000 7f33b77fe640 1 -- 10.20.193.28:0/3974596024 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b8038aa0 con 0x7f33cc109ba0 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.009+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33cc1a6840 con 0x7f33cc109ba0 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.009+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33cc1ae0e0 con 0x7f33cc109ba0 2026-02-20T03:23:03.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.009+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33cc10a580 con 0x7f33cc109ba0 2026-02-20T03:23:03.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.011+0000 7f33b77fe640 1 -- 10.20.193.28:0/3974596024 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f33b8004a70 con 0x7f33cc109ba0 2026-02-20T03:23:03.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.013+0000 7f33b77fe640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33a40b0e20 0x7f33a40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.013+0000 7f33b77fe640 1 -- 10.20.193.28:0/3974596024 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f33b81050d0 con 0x7f33cc109ba0 2026-02-20T03:23:03.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.013+0000 7f33d2754640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33a40b0e20 0x7f33a40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.013+0000 7f33b77fe640 1 -- 10.20.193.28:0/3974596024 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f33b8047060 con 0x7f33cc109ba0 2026-02-20T03:23:03.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.014+0000 7f33d2754640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33a40b0e20 0x7f33a40b32e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f33c4004480 tx=0x7f33c4009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:03.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.121+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33cc1a28c0 con 0x7f33cc109ba0 2026-02-20T03:23:03.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.122+0000 7f33b77fe640 1 -- 10.20.193.28:0/3974596024 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f33b80cd4b0 con 0x7f33cc109ba0 2026-02-20T03:23:03.125 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:23:03.126 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:23:03.126 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:23:03.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33a40b0e20 msgr2=0x7f33a40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33a40b0e20 0x7f33a40b32e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f33c4004480 tx=0x7f33c4009290 comp rx=0 tx=0).stop 2026-02-20T03:23:03.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109ba0 msgr2=0x7f33cc1a1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109ba0 0x7f33cc1a1aa0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f33b8005ec0 tx=0x7f33b8004290 comp rx=0 tx=0).stop 2026-02-20T03:23:03.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 shutdown_connections 2026-02-20T03:23:03.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33a40b0e20 0x7f33a40b32e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f33cc10eef0 0x7f33cc1a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f33cc109ba0 0x7f33cc1a1aa0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 --2- 10.20.193.28:0/3974596024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33cc109220 0x7f33cc1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 >> 10.20.193.28:0/3974596024 conn(0x7f33cc078600 msgr2=0x7f33cc079ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:03.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 shutdown_connections 2026-02-20T03:23:03.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.124+0000 7f33d3756640 1 -- 10.20.193.28:0/3974596024 wait complete. 2026-02-20T03:23:03.240 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2026-02-20T03:23:03.240 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2026-02-20T03:23:03.507 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:03.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 768081 9.16 MB/sec execute 276 sec latency 40.962 ms 2026-02-20T03:23:03.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:03 trial028 ceph-mon[38552]: pgmap v432: 129 pgs: 129 active+clean; 142 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 425 op/s 2026-02-20T03:23:03.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:03 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3974596024' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:03 trial126 ceph-mon[38476]: pgmap v432: 129 pgs: 129 active+clean; 142 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 425 op/s 2026-02-20T03:23:03.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:03 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3974596024' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 -- 10.20.193.28:0/3726075613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc060101700 msgr2=0x7fc0601062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 --2- 10.20.193.28:0/3726075613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc060101700 0x7fc0601062b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc054009a30 tx=0x7fc05402f240 comp rx=0 tx=0).stop 2026-02-20T03:23:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 -- 10.20.193.28:0/3726075613 shutdown_connections 2026-02-20T03:23:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 --2- 10.20.193.28:0/3726075613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0601069e0 0x7fc060107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 --2- 10.20.193.28:0/3726075613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc060101700 0x7fc0601062b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 --2- 10.20.193.28:0/3726075613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc060100d50 0x7fc060101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 -- 10.20.193.28:0/3726075613 >> 10.20.193.28:0/3726075613 conn(0x7fc0600fca60 msgr2=0x7fc0600fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 -- 10.20.193.28:0/3726075613 shutdown_connections 2026-02-20T03:23:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 -- 10.20.193.28:0/3726075613 wait complete. 2026-02-20T03:23:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.700+0000 7fc066c62640 1 Processor -- start 2026-02-20T03:23:03.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066c62640 1 -- start start 2026-02-20T03:23:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066c62640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc060100d50 0x7fc0601a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066c62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc060101700 0x7fc0601a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066c62640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0601069e0 0x7fc0601a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066c62640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc060119030 con 0x7fc060101700 2026-02-20T03:23:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066c62640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc060118eb0 con 0x7fc060100d50 2026-02-20T03:23:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066c62640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0601191b0 con 0x7fc0601069e0 2026-02-20T03:23:03.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc06545f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc060101700 0x7fc0601a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066461640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0601069e0 0x7fc0601a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066461640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0601069e0 0x7fc0601a5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50920/0 (socket says 10.20.193.28:50920) 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066461640 1 -- 10.20.193.28:0/2135105087 learned_addr learned my addr 10.20.193.28:0/2135105087 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc065c60640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc060100d50 0x7fc0601a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066461640 1 -- 10.20.193.28:0/2135105087 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc060100d50 msgr2=0x7fc0601a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066461640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc060100d50 0x7fc0601a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066461640 1 -- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc060101700 msgr2=0x7fc0601a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.701+0000 7fc066461640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc060101700 0x7fc0601a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.702+0000 7fc066461640 1 -- 10.20.193.28:0/2135105087 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0601a64e0 con 0x7fc0601069e0 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.702+0000 7fc06545f640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc060101700 0x7fc0601a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.702+0000 7fc066461640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0601069e0 0x7fc0601a5d60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00ef30 tx=0x7fc05c00c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:03.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.702+0000 7fc04effd640 1 -- 10.20.193.28:0/2135105087 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c019070 con 0x7fc0601069e0 2026-02-20T03:23:03.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.702+0000 7fc04effd640 1 -- 10.20.193.28:0/2135105087 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc05c0092d0 con 0x7fc0601069e0 2026-02-20T03:23:03.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.702+0000 7fc04effd640 1 -- 10.20.193.28:0/2135105087 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c007500 con 0x7fc0601069e0 2026-02-20T03:23:03.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.702+0000 7fc066c62640 1 -- 10.20.193.28:0/2135105087 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0601a6770 con 0x7fc0601069e0 2026-02-20T03:23:03.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.702+0000 7fc066c62640 1 -- 10.20.193.28:0/2135105087 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0601ae010 con 0x7fc0601069e0 2026-02-20T03:23:03.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.705+0000 7fc06a3f0e00 1 Processor -- start 2026-02-20T03:23:03.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.706+0000 7fc04effd640 1 -- 10.20.193.28:0/2135105087 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc05c002a60 con 0x7fc0601069e0 2026-02-20T03:23:03.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.706+0000 7fc06a3f0e00 1 -- start start 2026-02-20T03:23:03.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.706+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a03a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.706+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a034860 0x56391a034ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.706+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a035220 0x56391a040fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.706+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563919f87410 con 0x56391a03a170 2026-02-20T03:23:03.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.706+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563919f348b0 con 0x56391a035220 2026-02-20T03:23:03.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.706+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563919f83340 con 0x56391a034860 2026-02-20T03:23:03.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a03a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a03a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33614/0 (socket says 10.20.193.28:33614) 2026-02-20T03:23:03.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 -- 10.20.193.28:0/1038344567 learned_addr learned my addr 10.20.193.28:0/1038344567 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:03.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 --2- 10.20.193.28:0/1038344567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a035220 0x56391a040fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 -- 10.20.193.28:0/1038344567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a034860 msgr2=0x56391a034ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:03.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 --2- 10.20.193.28:0/1038344567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a034860 0x56391a034ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 -- 10.20.193.28:0/1038344567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a035220 msgr2=0x56391a040fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 --2- 10.20.193.28:0/1038344567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a035220 0x56391a040fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 -- 10.20.193.28:0/1038344567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563919f268c0 con 0x56391a03a170 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc06545f640 1 --2- 10.20.193.28:0/1038344567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a03a550 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc0540386a0 tx=0x7fc054005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369d8381e3d444e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.707+0000 7fc02e4e6640 1 -- 10.20.193.28:0/1038344567 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05402fca0 con 0x56391a03a170 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc02e4e6640 1 -- 10.20.193.28:0/1038344567 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc054033040 con 0x56391a03a170 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc02e4e6640 1 -- 10.20.193.28:0/1038344567 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054038d10 con 0x56391a03a170 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1038344567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 msgr2=0x56391a03a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1038344567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a03a550 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc0540386a0 tx=0x7fc054005c50 comp rx=0 tx=0).stop 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1038344567 shutdown_connections 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1038344567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a035220 0x56391a040fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1038344567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a034860 0x56391a034ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1038344567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a03a550 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1038344567 >> 10.20.193.28:0/1038344567 conn(0x56391a02d3c0 msgr2=0x56391a032f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:03.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1038344567 shutdown_connections 2026-02-20T03:23:03.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1038344567 wait complete. 2026-02-20T03:23:03.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.708+0000 7fc04effd640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc03c0b0e00 0x7fc03c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.709+0000 7fc065c60640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc03c0b0e00 0x7fc03c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.709+0000 7fc04effd640 1 -- 10.20.193.28:0/2135105087 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc05c0e0360 con 0x7fc0601069e0 2026-02-20T03:23:03.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.710+0000 7fc065c60640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc03c0b0e00 0x7fc03c0b32c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc050005fd0 tx=0x7fc0500047c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:03.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.710+0000 7fc06a3f0e00 1 -- start start 2026-02-20T03:23:03.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.710+0000 7fc06a3f0e00 1 Processor -- start 2026-02-20T03:23:03.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.710+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a034860 0x56391a04f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.710+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a04fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a03a170 0x56391a04dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563919f2e4a0 con 0x56391a034860 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06545f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a04fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc066461640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a03a170 0x56391a04dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06545f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a04fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50932/0 (socket says 10.20.193.28:50932) 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06545f640 1 -- 10.20.193.28:0/2737242954 learned_addr learned my addr 10.20.193.28:0/2737242954 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc065c60640 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a034860 0x56391a04f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56391a041660 con 0x56391a03a170 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56391a04e390 con 0x56391a035220 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06545f640 1 -- 10.20.193.28:0/2737242954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a03a170 msgr2=0x56391a04dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:03.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06545f640 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a03a170 0x56391a04dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06545f640 1 -- 10.20.193.28:0/2737242954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a034860 msgr2=0x56391a04f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06545f640 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a034860 0x56391a04f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc06545f640 1 -- 10.20.193.28:0/2737242954 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391a046f50 con 0x56391a035220 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.711+0000 7fc065c60640 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a034860 0x56391a04f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc06545f640 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a04fa10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc054005e00 tx=0x7fc054038560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c213add22ba60c44 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc01b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc01b7fe640 1 -- 10.20.193.28:0/2737242954 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054056070 con 0x56391a035220 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc01b7fe640 1 -- 10.20.193.28:0/2737242954 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc054038990 con 0x56391a035220 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc01b7fe640 1 -- 10.20.193.28:0/2737242954 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054048450 con 0x56391a035220 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563919ceb8a0 con 0x56391a035220 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc01b7fe640 1 -- 10.20.193.28:0/2737242954 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc0540485f0 con 0x56391a035220 2026-02-20T03:23:03.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc06a3f0e00 10 client.26911 _ll_register_callbacks cb 0x563919f323d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563919f8f000 con 0x56391a035220 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc01b7fe640 1 -- 10.20.193.28:0/2737242954 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc054038b40 con 0x56391a035220 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc06a3f0e00 10 client.26911 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.712+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563919d570e0 con 0x56391a035220 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.713+0000 7fc01b7fe640 1 -- 10.20.193.28:0/2737242954 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc05402faa0 con 0x56391a035220 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.713+0000 7fc06a3f0e00 10 client.26911 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.713+0000 7fc06a3f0e00 10 client.26911 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.713+0000 7fc06a3f0e00 20 client.26911 populate_metadata read hostname 'trial028' 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.713+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56391a05d4f0 0x56391a05f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.713+0000 7fc06a3f0e00 4 client.26911 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.713+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563919f08f60 con 0x56391a05d4f0 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.713+0000 7fc065c60640 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56391a05d4f0 0x56391a05f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.714+0000 7fc065c60640 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56391a05d4f0 0x56391a05f9b0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b80d7eb61bc4a70 server_cookie=3998eb15e680f4bd in_seq=0 out_seq=0 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.714+0000 7fc01b7fe640 10 client.26911 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.714+0000 7fc01b7fe640 1 -- 10.20.193.28:0/2737242954 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563919f08f60 con 0x56391a05d4f0 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.714+0000 7fc01b7fe640 10 client.26911 handle_command_reply: tid=0 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.714+0000 7fc06a3f0e00 1 client.26911 shutdown 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.714+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 msgr2=0x56391a04fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.714+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a04fa10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc054005e00 tx=0x7fc054038560 comp rx=0 tx=0).stop 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 shutdown_connections 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56391a05d4f0 0x56391a05f9b0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a03a170 0x56391a04dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a04fa10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/2737242954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a034860 0x56391a04f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 >> 10.20.193.28:0/2737242954 conn(0x56391a02d3c0 msgr2=0x56391a033670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:03.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc01b7fe640 0 client.26911 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:03.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 shutdown_connections 2026-02-20T03:23:03.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/2737242954 wait complete. 2026-02-20T03:23:03.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.715+0000 7fc06a3f0e00 20 client.26911 trim_cache size 0 max 16384 2026-02-20T03:23:03.723 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:03 trial177 ceph-mon[43181]: pgmap v432: 129 pgs: 129 active+clean; 142 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 425 op/s 2026-02-20T03:23:03.724 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:03 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3974596024' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:03.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.724+0000 7fc06a3f0e00 1 Processor -- start 2026-02-20T03:23:03.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.724+0000 7fc06a3f0e00 1 -- start start 2026-02-20T03:23:03.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.724+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a04cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.724+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a035220 0x56391a04b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.724+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a03a170 0x56391a04b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.724+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c0126f0 con 0x56391a035220 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.724+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00ffc0 con 0x56391a034860 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.724+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00de10 con 0x56391a03a170 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.724+0000 7fc065c60640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a04cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc065c60640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a04cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60030/0 (socket says 10.20.193.28:60030) 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc065c60640 1 -- 10.20.193.28:0/1443203232 learned_addr learned my addr 10.20.193.28:0/1443203232 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc066461640 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a03a170 0x56391a04b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc06545f640 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a035220 0x56391a04b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc065c60640 1 -- 10.20.193.28:0/1443203232 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a03a170 msgr2=0x56391a04b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc065c60640 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a03a170 0x56391a04b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc065c60640 1 -- 10.20.193.28:0/1443203232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a035220 msgr2=0x56391a04b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:03.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc065c60640 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a035220 0x56391a04b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc065c60640 1 -- 10.20.193.28:0/1443203232 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391a046d80 con 0x56391a034860 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc06545f640 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a035220 0x56391a04b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc065c60640 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a04cde0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x56391a04d3b0 tx=0x7fc050013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a1550a3726f635b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc02dce5640 1 -- 10.20.193.28:0/1443203232 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05001d610 con 0x56391a034860 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc02dce5640 1 -- 10.20.193.28:0/1443203232 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc05001dc50 con 0x56391a034860 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1443203232 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 msgr2=0x56391a04cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.725+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a04cde0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x56391a04d3b0 tx=0x7fc050013000 comp rx=0 tx=0).stop 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1443203232 shutdown_connections 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a03a170 0x56391a04b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a035220 0x56391a04b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1443203232 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a04cde0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1443203232 >> 10.20.193.28:0/1443203232 conn(0x56391a02d3c0 msgr2=0x56391a05e120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:03.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1443203232 shutdown_connections 2026-02-20T03:23:03.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1443203232 wait complete. 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 -- start start 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 Processor -- start 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a052a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.726+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a052f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc06a3f0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00e480 con 0x56391a03a170 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00f8f0 con 0x56391a034860 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc06a3f0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00eb50 con 0x56391a035220 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc065c60640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a052a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc065c60640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a052a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60044/0 (socket says 10.20.193.28:60044) 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc065c60640 1 -- 10.20.193.28:0/1185883571 learned_addr learned my addr 10.20.193.28:0/1185883571 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc06545f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a052f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc066461640 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc065c60640 1 -- 10.20.193.28:0/1185883571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 msgr2=0x56391a052f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc065c60640 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a052f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc065c60640 1 -- 10.20.193.28:0/1185883571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 msgr2=0x56391a0c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc065c60640 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a0c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc065c60640 1 -- 10.20.193.28:0/1185883571 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56391a046940 con 0x56391a034860 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc066461640 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc065c60640 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a052a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc05001a730 tx=0x7fc0500074d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50fc2276ee863511 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc01b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc01b7fe640 1 -- 10.20.193.28:0/1185883571 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050035030 con 0x56391a034860 2026-02-20T03:23:03.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1185883571 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563919d087f0 con 0x56391a034860 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc01b7fe640 1 -- 10.20.193.28:0/1185883571 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc05001de00 con 0x56391a034860 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc06a3f0e00 10 client.26900 _ll_register_callbacks cb 0x7fc054002a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.727+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1185883571 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563919cf7f60 con 0x56391a034860 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc01b7fe640 1 -- 10.20.193.28:0/1185883571 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050042050 con 0x56391a034860 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc01b7fe640 1 -- 10.20.193.28:0/1185883571 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fc05001adb0 con 0x56391a034860 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc01b7fe640 1 -- 10.20.193.28:0/1185883571 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc05001d470 con 0x56391a034860 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc06a3f0e00 10 client.26900 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1185883571 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56391a047a70 con 0x56391a034860 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc01b7fe640 1 -- 10.20.193.28:0/1185883571 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc050004830 con 0x56391a034860 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc06a3f0e00 10 client.26900 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc06a3f0e00 10 client.26900 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc06a3f0e00 20 client.26900 populate_metadata read hostname 'trial028' 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56391a0c9d40 0x56391a0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc06a3f0e00 4 client.26900 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2026-02-20T03:23:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1185883571 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x563919f94db0 con 0x56391a0c9d40 2026-02-20T03:23:03.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.728+0000 7fc06545f640 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56391a0c9d40 0x56391a0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:03.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.729+0000 7fc06545f640 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56391a0c9d40 0x56391a0cc200 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2f1989d3af22f4e server_cookie=a9891132a56e8b30 in_seq=0 out_seq=0 2026-02-20T03:23:03.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.729+0000 7fc01b7fe640 10 client.26900 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:03.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc01b7fe640 1 -- 10.20.193.28:0/1185883571 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563919f94db0 con 0x56391a0c9d40 2026-02-20T03:23:03.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc01b7fe640 10 client.26900 handle_command_reply: tid=0 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 client.26900 shutdown 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1185883571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 msgr2=0x56391a052a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a052a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc05001a730 tx=0x7fc0500074d0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1185883571 shutdown_connections 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56391a0c9d40 0x56391a0cc200 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56391a03a170 0x56391a0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56391a035220 0x56391a052f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 --2- 10.20.193.28:0/1185883571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56391a034860 0x56391a052a50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc01b7fe640 0 client.26900 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1185883571 >> 10.20.193.28:0/1185883571 conn(0x56391a02d3c0 msgr2=0x56391a04bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:03.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1185883571 shutdown_connections 2026-02-20T03:23:03.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 1 -- 10.20.193.28:0/1185883571 wait complete. 2026-02-20T03:23:03.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.808+0000 7fc06a3f0e00 20 client.26900 trim_cache size 0 max 16384 2026-02-20T03:23:03.813 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:23:03.813 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 26, 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "351a8ce9": { 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "version": 26, 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:23:03.814 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 130.0, 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:03.815 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:03.816 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:23:03.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 -- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc03c0b0e00 msgr2=0x7fc03c0b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc03c0b0e00 0x7fc03c0b32c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc050005fd0 tx=0x7fc0500047c0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 -- 10.20.193.28:0/2135105087 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0601069e0 msgr2=0x7fc0601a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0601069e0 0x7fc0601a5d60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00ef30 tx=0x7fc05c00c560 comp rx=0 tx=0).stop 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 -- 10.20.193.28:0/2135105087 shutdown_connections 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc03c0b0e00 0x7fc03c0b32c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0601069e0 0x7fc0601a5d60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc060101700 0x7fc0601a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 --2- 10.20.193.28:0/2135105087 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc060100d50 0x7fc0601a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.809+0000 7fc066c62640 1 -- 10.20.193.28:0/2135105087 >> 10.20.193.28:0/2135105087 conn(0x7fc0600fca60 msgr2=0x7fc060104280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.810+0000 7fc066c62640 1 -- 10.20.193.28:0/2135105087 shutdown_connections 2026-02-20T03:23:03.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:03.810+0000 7fc066c62640 1 -- 10.20.193.28:0/2135105087 wait complete. 2026-02-20T03:23:03.908 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '351a8ce9', quiesce took 1.4 seconds. Will release after: 8.6 2026-02-20T03:23:04.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 9.14 MB/sec execute 277 sec latency 697.426 ms 2026-02-20T03:23:05.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 9.11 MB/sec execute 278 sec latency 1697.474 ms 2026-02-20T03:23:05.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:05 trial028 ceph-mon[38552]: pgmap v433: 129 pgs: 129 active+clean; 144 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 456 op/s 2026-02-20T03:23:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:05 trial177 ceph-mon[43181]: pgmap v433: 129 pgs: 129 active+clean; 144 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 456 op/s 2026-02-20T03:23:05.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:05 trial126 ceph-mon[38476]: pgmap v433: 129 pgs: 129 active+clean; 144 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 456 op/s 2026-02-20T03:23:06.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 9.08 MB/sec execute 279 sec latency 2697.525 ms 2026-02-20T03:23:06.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.786+0000 7f8f517fc640 1 -- 10.20.193.28:0/1797779637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 msgr2=0x7f8f4c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:06.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.786+0000 7f8f4affd640 1 -- 10.20.193.28:0/1797779637 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3802fcc0 con 0x7f8f4c077050 2026-02-20T03:23:06.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.786+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1797779637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 0x7f8f4c0754a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009a30 tx=0x7f8f3802f260 comp rx=0 tx=0).stop 2026-02-20T03:23:06.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.787+0000 7f8f517fc640 1 -- 10.20.193.28:0/1797779637 shutdown_connections 2026-02-20T03:23:06.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.787+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1797779637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f4c10a5f0 0x7f8f4c10ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.787+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1797779637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f4c0759e0 0x7f8f4c075e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.787+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1797779637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 0x7f8f4c0754a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.787+0000 7f8f517fc640 1 -- 10.20.193.28:0/1797779637 >> 10.20.193.28:0/1797779637 conn(0x7f8f4c0fde10 msgr2=0x7f8f4c100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:06.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.787+0000 7f8f517fc640 1 -- 10.20.193.28:0/1797779637 shutdown_connections 2026-02-20T03:23:06.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.787+0000 7f8f517fc640 1 -- 10.20.193.28:0/1797779637 wait complete. 2026-02-20T03:23:06.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f517fc640 1 Processor -- start 2026-02-20T03:23:06.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f517fc640 1 -- start start 2026-02-20T03:23:06.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f517fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f4c0759e0 0x7f8f4c072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f517fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 0x7f8f4c072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f517fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f4c10a5f0 0x7f8f4c073b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f517fc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c06cdd0 con 0x7f8f4c077050 2026-02-20T03:23:06.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f517fc640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c06cc50 con 0x7f8f4c0759e0 2026-02-20T03:23:06.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f517fc640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c06cf50 con 0x7f8f4c10a5f0 2026-02-20T03:23:06.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f4b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 0x7f8f4c072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f4b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 0x7f8f4c072ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60650/0 (socket says 10.20.193.28:60650) 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/1110195470 learned_addr learned my addr 10.20.193.28:0/1110195470 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/1110195470 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f4c10a5f0 msgr2=0x7f8f4c073b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f4b7fe640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f4c10a5f0 0x7f8f4c073b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/1110195470 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f4c0759e0 msgr2=0x7f8f4c072580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f4b7fe640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f4c0759e0 0x7f8f4c072580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.788+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/1110195470 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c074200 con 0x7f8f4c077050 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.789+0000 7f8f4b7fe640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 0x7f8f4c072ac0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00b570 tx=0x7f8f3c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.789+0000 7f8f497fa640 1 -- 10.20.193.28:0/1110195470 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c013020 con 0x7f8f4c077050 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.789+0000 7f8f517fc640 1 -- 10.20.193.28:0/1110195470 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4c0744f0 con 0x7f8f4c077050 2026-02-20T03:23:06.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.789+0000 7f8f517fc640 1 -- 10.20.193.28:0/1110195470 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4c074a40 con 0x7f8f4c077050 2026-02-20T03:23:06.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.789+0000 7f8f497fa640 1 -- 10.20.193.28:0/1110195470 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f3c004480 con 0x7f8f4c077050 2026-02-20T03:23:06.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.789+0000 7f8f497fa640 1 -- 10.20.193.28:0/1110195470 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c013020 con 0x7f8f4c077050 2026-02-20T03:23:06.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.791+0000 7f8f497fa640 1 -- 10.20.193.28:0/1110195470 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8f3c018400 con 0x7f8f4c077050 2026-02-20T03:23:06.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f559c2e00 1 Processor -- start 2026-02-20T03:23:06.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f559c2e00 1 -- start start 2026-02-20T03:23:06.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9ee80 0x559ec3f9f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9f7c0 0x559ec3fa3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3fa4560 0x559ec3fa69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ec3eef8f0 con 0x559ec3f9ee80 2026-02-20T03:23:06.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559ec3e9d2e0 con 0x559ec3f9f7c0 2026-02-20T03:23:06.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559ec3eeb820 con 0x559ec3fa4560 2026-02-20T03:23:06.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f50ffb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9ee80 0x559ec3f9f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:06.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f50ffb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9ee80 0x559ec3f9f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60654/0 (socket says 10.20.193.28:60654) 2026-02-20T03:23:06.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.792+0000 7f8f50ffb640 1 -- 10.20.193.28:0/2180223636 learned_addr learned my addr 10.20.193.28:0/2180223636 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f50ffb640 1 -- 10.20.193.28:0/2180223636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3fa4560 msgr2=0x559ec3fa69f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f50ffb640 1 --2- 10.20.193.28:0/2180223636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3fa4560 0x559ec3fa69f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f50ffb640 1 -- 10.20.193.28:0/2180223636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9f7c0 msgr2=0x559ec3fa3f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f50ffb640 1 --2- 10.20.193.28:0/2180223636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9f7c0 0x559ec3fa3f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f50ffb640 1 -- 10.20.193.28:0/2180223636 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec3e8f5a0 con 0x559ec3f9ee80 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f50ffb640 1 --2- 10.20.193.28:0/2180223636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9ee80 0x559ec3f9f280 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009d20 tx=0x7f8f4000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329f9d1dcf8a7be6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f497fa640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f200b0fa0 0x7f8f200b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f497fa640 1 -- 10.20.193.28:0/1110195470 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8f3c0dfb60 con 0x7f8f4c077050 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f1cbfe640 1 -- 10.20.193.28:0/2180223636 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40017070 con 0x559ec3f9ee80 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f1cbfe640 1 -- 10.20.193.28:0/2180223636 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f4000bd50 con 0x559ec3f9ee80 2026-02-20T03:23:06.806 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f1cbfe640 1 -- 10.20.193.28:0/2180223636 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40006e60 con 0x559ec3f9ee80 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f4bfff640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f200b0fa0 0x7f8f200b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f559c2e00 1 -- 10.20.193.28:0/2180223636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9ee80 msgr2=0x559ec3f9f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/2180223636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9ee80 0x559ec3f9f280 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009d20 tx=0x7f8f4000b420 comp rx=0 tx=0).stop 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f559c2e00 1 -- 10.20.193.28:0/2180223636 shutdown_connections 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/2180223636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3fa4560 0x559ec3fa69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/2180223636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9f7c0 0x559ec3fa3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/2180223636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9ee80 0x559ec3f9f280 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f559c2e00 1 -- 10.20.193.28:0/2180223636 >> 10.20.193.28:0/2180223636 conn(0x559ec3f966f0 msgr2=0x559ec3f9d570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.793+0000 7f8f559c2e00 1 -- 10.20.193.28:0/2180223636 shutdown_connections 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.794+0000 7f8f559c2e00 1 -- 10.20.193.28:0/2180223636 wait complete. 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.794+0000 7f8f4bfff640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f200b0fa0 0x7f8f200b3460 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8f38005d20 tx=0x7f8f38005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:06.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.795+0000 7f8f559c2e00 1 -- start start 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.795+0000 7f8f559c2e00 1 Processor -- start 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.795+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3f9ee80 0x559ec3fb7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.795+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fb7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.795+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3fa4560 0x559ec3fbef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.795+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ec3e970c0 con 0x559ec3f9f7c0 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.795+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559ec3fa7610 con 0x559ec3fa4560 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.795+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559ec3fbf4a0 con 0x559ec3f9ee80 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f4b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fb7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f4b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fb7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60664/0 (socket says 10.20.193.28:60664) 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/914390380 learned_addr learned my addr 10.20.193.28:0/914390380 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/914390380 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3f9ee80 msgr2=0x559ec3fb7a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:06.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f4b7fe640 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3f9ee80 0x559ec3fb7a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/914390380 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3fa4560 msgr2=0x559ec3fbef10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f4b7fe640 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3fa4560 0x559ec3fbef10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/914390380 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec3fb1180 con 0x559ec3f9f7c0 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f4b7fe640 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fb7f90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0a3670 tx=0x7f8f3c0a8090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9aaf64a6776c0cc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f0dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f0dffb640 1 -- 10.20.193.28:0/914390380 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0a8b70 con 0x559ec3f9f7c0 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f0dffb640 1 -- 10.20.193.28:0/914390380 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f3c004480 con 0x559ec3f9f7c0 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f0dffb640 1 -- 10.20.193.28:0/914390380 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0a6520 con 0x559ec3f9f7c0 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f559c2e00 1 -- 10.20.193.28:0/914390380 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec3eab820 con 0x559ec3f9f7c0 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f0dffb640 1 -- 10.20.193.28:0/914390380 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8f3c005a70 con 0x559ec3f9f7c0 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.796+0000 7f8f0dffb640 10 client.17544 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:23:06.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 10 client.17544 _ll_register_callbacks cb 0x559ec3e9aff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 1 -- 10.20.193.28:0/914390380 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ec3ef74e0 con 0x559ec3f9f7c0 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f0dffb640 1 -- 10.20.193.28:0/914390380 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8f3c0a8d10 con 0x559ec3f9f7c0 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 10 client.17544 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 1 -- 10.20.193.28:0/914390380 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559ec3eb0380 con 0x559ec3f9f7c0 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f0dffb640 1 -- 10.20.193.28:0/914390380 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f8f3c005c70 con 0x559ec3f9f7c0 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 10 client.17544 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 10 client.17544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 20 client.17544 populate_metadata read hostname 'trial028' 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ec3fc36f0 0x559ec3fc5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 4 client.17544 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:06.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.797+0000 7f8f559c2e00 1 -- 10.20.193.28:0/914390380 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ec3e71bd0 con 0x559ec3fc36f0 2026-02-20T03:23:06.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.812+0000 7f8f4bfff640 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ec3fc36f0 0x559ec3fc5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:06.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.813+0000 7f8f4bfff640 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ec3fc36f0 0x559ec3fc5bb0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76bd30a122943394 server_cookie=acfc901f3ec6d52 in_seq=0 out_seq=0 2026-02-20T03:23:06.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.813+0000 7f8f0dffb640 10 client.17544 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:06.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.814+0000 7f8f0dffb640 1 -- 10.20.193.28:0/914390380 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559ec3e71bd0 con 0x559ec3fc36f0 2026-02-20T03:23:06.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.814+0000 7f8f0dffb640 10 client.17544 handle_command_reply: tid=0 2026-02-20T03:23:06.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.814+0000 7f8f559c2e00 1 client.17544 shutdown 2026-02-20T03:23:06.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.814+0000 7f8f559c2e00 1 -- 10.20.193.28:0/914390380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 msgr2=0x559ec3fb7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:06.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.814+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fb7f90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0a3670 tx=0x7f8f3c0a8090 comp rx=0 tx=0).stop 2026-02-20T03:23:06.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.815+0000 7f8f559c2e00 1 -- 10.20.193.28:0/914390380 shutdown_connections 2026-02-20T03:23:06.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.815+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ec3fc36f0 0x559ec3fc5bb0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.815+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3fa4560 0x559ec3fbef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.826 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.815+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fb7f90 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.815+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/914390380 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3f9ee80 0x559ec3fb7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.815+0000 7f8f559c2e00 1 -- 10.20.193.28:0/914390380 >> 10.20.193.28:0/914390380 conn(0x559ec3f966f0 msgr2=0x559ec3fa5910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:06.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.815+0000 7f8f0dffb640 0 client.17544 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:06.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.816+0000 7f8f559c2e00 1 -- 10.20.193.28:0/914390380 shutdown_connections 2026-02-20T03:23:06.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.816+0000 7f8f559c2e00 1 -- 10.20.193.28:0/914390380 wait complete. 2026-02-20T03:23:06.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.816+0000 7f8f559c2e00 20 client.17544 trim_cache size 0 max 16384 2026-02-20T03:23:06.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.823+0000 7f8f559c2e00 1 Processor -- start 2026-02-20T03:23:06.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.823+0000 7f8f559c2e00 1 -- start start 2026-02-20T03:23:06.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9ee80 0x559ec3fb7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3f9f7c0 0x559ec3fbeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3fa4560 0x559ec3f9fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef00126f0 con 0x559ec3fa4560 2026-02-20T03:23:06.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef000ffc0 con 0x559ec3f9ee80 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef000de10 con 0x559ec3f9f7c0 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f50ffb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3fa4560 0x559ec3f9fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f50ffb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3fa4560 0x559ec3f9fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60678/0 (socket says 10.20.193.28:60678) 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f50ffb640 1 -- 10.20.193.28:0/4110095275 learned_addr learned my addr 10.20.193.28:0/4110095275 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f50ffb640 1 -- 10.20.193.28:0/4110095275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3f9f7c0 msgr2=0x559ec3fbeed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f50ffb640 1 --2- 10.20.193.28:0/4110095275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3f9f7c0 0x559ec3fbeed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f50ffb640 1 -- 10.20.193.28:0/4110095275 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9ee80 msgr2=0x559ec3fb7170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f50ffb640 1 --2- 10.20.193.28:0/4110095275 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9ee80 0x559ec3fb7170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f50ffb640 1 -- 10.20.193.28:0/4110095275 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec3fb0fb0 con 0x559ec3fa4560 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.824+0000 7f8f50ffb640 1 --2- 10.20.193.28:0/4110095275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3fa4560 0x559ec3f9fee0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009a40 tx=0x7f8f40009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffcced2bceb3b76 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:06.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f0ffff640 1 -- 10.20.193.28:0/4110095275 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40017070 con 0x559ec3fa4560 2026-02-20T03:23:06.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f0ffff640 1 -- 10.20.193.28:0/4110095275 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f40018040 con 0x559ec3fa4560 2026-02-20T03:23:06.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f0ffff640 1 -- 10.20.193.28:0/4110095275 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4001cd50 con 0x559ec3fa4560 2026-02-20T03:23:06.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f559c2e00 1 -- 10.20.193.28:0/4110095275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3fa4560 msgr2=0x559ec3f9fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:06.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/4110095275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3fa4560 0x559ec3f9fee0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009a40 tx=0x7f8f40009a70 comp rx=0 tx=0).stop 2026-02-20T03:23:06.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f559c2e00 1 -- 10.20.193.28:0/4110095275 shutdown_connections 2026-02-20T03:23:06.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/4110095275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3fa4560 0x559ec3f9fee0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/4110095275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3f9f7c0 0x559ec3fbeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/4110095275 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9ee80 0x559ec3fb7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.831 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f559c2e00 1 -- 10.20.193.28:0/4110095275 >> 10.20.193.28:0/4110095275 conn(0x559ec3f966f0 msgr2=0x559ec3f9d570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f559c2e00 1 -- 10.20.193.28:0/4110095275 shutdown_connections 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.825+0000 7f8f559c2e00 1 -- 10.20.193.28:0/4110095275 wait complete. 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f559c2e00 1 -- start start 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f559c2e00 1 Processor -- start 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9ee80 0x559ec3fbcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fbd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f559c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3fa4560 0x559ec3fbe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef000e480 con 0x559ec3f9f7c0 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef000f8f0 con 0x559ec3f9ee80 2026-02-20T03:23:06.834 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f559c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef000eb50 con 0x559ec3fa4560 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f4b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fbd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f4b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fbd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60688/0 (socket says 10.20.193.28:60688) 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/3213145378 learned_addr learned my addr 10.20.193.28:0/3213145378 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/3213145378 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3fa4560 msgr2=0x559ec3fbe4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f4b7fe640 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3fa4560 0x559ec3fbe4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/3213145378 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9ee80 msgr2=0x559ec3fbcfd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f4b7fe640 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9ee80 0x559ec3fbcfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.826+0000 7f8f4b7fe640 1 -- 10.20.193.28:0/3213145378 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec3c4f690 con 0x559ec3f9f7c0 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f4b7fe640 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fbd510 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0a7540 tx=0x7f8f3c0a34b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef272f3dae83e7b9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f0dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f0dffb640 1 -- 10.20.193.28:0/3213145378 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c004480 con 0x559ec3f9f7c0 2026-02-20T03:23:06.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f0dffb640 1 -- 10.20.193.28:0/3213145378 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x559ec3ef74e0 con 0x559ec3f9f7c0 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f0dffb640 1 -- 10.20.193.28:0/3213145378 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c005d60 con 0x559ec3f9f7c0 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 1 -- 10.20.193.28:0/3213145378 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec3eb4b70 con 0x559ec3f9f7c0 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f0dffb640 1 -- 10.20.193.28:0/3213145378 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8f3c0c8670 con 0x559ec3f9f7c0 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 10 client.17550 _ll_register_callbacks cb 0x7f8f3c0a6d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 1 -- 10.20.193.28:0/3213145378 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f4000bd50 con 0x559ec3f9f7c0 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f0dffb640 1 -- 10.20.193.28:0/3213145378 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8f3c0c6060 con 0x559ec3f9f7c0 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 10 client.17550 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 1 -- 10.20.193.28:0/3213145378 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559ec3fb1ca0 con 0x559ec3f9f7c0 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f0dffb640 1 -- 10.20.193.28:0/3213145378 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f8f3c0c82f0 con 0x559ec3f9f7c0 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 10 client.17550 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 10 client.17550 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 20 client.17550 populate_metadata read hostname 'trial028' 2026-02-20T03:23:06.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ec402f0b0 0x559ec4031570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:06.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 4 client.17550 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:23:06.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.827+0000 7f8f559c2e00 1 -- 10.20.193.28:0/3213145378 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559ec3ec06b0 con 0x559ec402f0b0 2026-02-20T03:23:06.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.828+0000 7f8f4bfff640 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ec402f0b0 0x559ec4031570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:06.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.869+0000 7f8f4bfff640 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ec402f0b0 0x559ec4031570 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a4dbe2b62e33c9 server_cookie=ee23eb8437ea6690 in_seq=0 out_seq=0 2026-02-20T03:23:06.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:06.869+0000 7f8f0dffb640 10 client.17550 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:07.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.012+0000 7f8f0dffb640 1 -- 10.20.193.28:0/3213145378 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559ec3ec06b0 con 0x559ec402f0b0 2026-02-20T03:23:07.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.012+0000 7f8f0dffb640 10 client.17550 handle_command_reply: tid=0 2026-02-20T03:23:07.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.012+0000 7f8f559c2e00 1 client.17550 shutdown 2026-02-20T03:23:07.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 -- 10.20.193.28:0/3213145378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 msgr2=0x559ec3fbd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:07.016 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fbd510 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0a7540 tx=0x7f8f3c0a34b0 comp rx=0 tx=0).stop 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 -- 10.20.193.28:0/3213145378 shutdown_connections 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ec402f0b0 0x559ec4031570 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f0dffb640 0 client.17550 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ec3fa4560 0x559ec3fbe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ec3f9f7c0 0x559ec3fbd510 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 --2- 10.20.193.28:0/3213145378 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ec3f9ee80 0x559ec3fbcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 -- 10.20.193.28:0/3213145378 >> 10.20.193.28:0/3213145378 conn(0x559ec3f966f0 msgr2=0x559ec3fb6160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 -- 10.20.193.28:0/3213145378 shutdown_connections 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 1 -- 10.20.193.28:0/3213145378 wait complete. 2026-02-20T03:23:07.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.013+0000 7f8f559c2e00 20 client.17550 trim_cache size 0 max 16384 2026-02-20T03:23:07.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:23:07.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:23:07.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:23:07.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:23:07.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 -- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f200b0fa0 msgr2=0x7f8f200b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f200b0fa0 0x7f8f200b3460 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8f38005d20 tx=0x7f8f38005c50 comp rx=0 tx=0).stop 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 -- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 msgr2=0x7f8f4c072ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 0x7f8f4c072ac0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00b570 tx=0x7f8f3c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 -- 10.20.193.28:0/1110195470 shutdown_connections 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f200b0fa0 0x7f8f200b3460 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f4c10a5f0 0x7f8f4c073b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f4c077050 0x7f8f4c072ac0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 --2- 10.20.193.28:0/1110195470 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f4c0759e0 0x7f8f4c072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 -- 10.20.193.28:0/1110195470 >> 10.20.193.28:0/1110195470 conn(0x7f8f4c0fde10 msgr2=0x7f8f4c1065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:07.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 -- 10.20.193.28:0/1110195470 shutdown_connections 2026-02-20T03:23:07.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:07.014+0000 7f8f517fc640 1 -- 10.20.193.28:0/1110195470 wait complete. 2026-02-20T03:23:07.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 9.05 MB/sec execute 280 sec latency 3697.574 ms 2026-02-20T03:23:07.522 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:07 trial028 ceph-mon[38552]: pgmap v434: 129 pgs: 129 active+clean; 147 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 440 op/s 2026-02-20T03:23:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:07 trial177 ceph-mon[43181]: pgmap v434: 129 pgs: 129 active+clean; 147 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 440 op/s 2026-02-20T03:23:07.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:07 trial126 ceph-mon[38476]: pgmap v434: 129 pgs: 129 active+clean; 147 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 440 op/s 2026-02-20T03:23:08.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 9.01 MB/sec execute 281 sec latency 4697.613 ms 2026-02-20T03:23:09.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 8.98 MB/sec execute 282 sec latency 5697.655 ms 2026-02-20T03:23:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:09 trial177 ceph-mon[43181]: pgmap v435: 129 pgs: 129 active+clean; 147 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 332 op/s 2026-02-20T03:23:09.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:09 trial126 ceph-mon[38476]: pgmap v435: 129 pgs: 129 active+clean; 147 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 332 op/s 2026-02-20T03:23:09.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:09 trial028 ceph-mon[38552]: pgmap v435: 129 pgs: 129 active+clean; 147 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 332 op/s 2026-02-20T03:23:10.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 8.95 MB/sec execute 283 sec latency 6697.710 ms 2026-02-20T03:23:11.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 8.92 MB/sec execute 284 sec latency 7697.759 ms 2026-02-20T03:23:11.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:11 trial028 ceph-mon[38552]: pgmap v436: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 340 op/s 2026-02-20T03:23:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:11 trial177 ceph-mon[43181]: pgmap v436: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 340 op/s 2026-02-20T03:23:11.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:11 trial126 ceph-mon[38476]: pgmap v436: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 340 op/s 2026-02-20T03:23:12.510 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:23:12.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 8.89 MB/sec execute 285 sec latency 8697.799 ms 2026-02-20T03:23:12.686 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:12 trial028 ceph-mon[38552]: pgmap v437: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 548 KiB/s rd, 2.2 MiB/s wr, 212 op/s 2026-02-20T03:23:12.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:12 trial177 ceph-mon[43181]: pgmap v437: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 548 KiB/s rd, 2.2 MiB/s wr, 212 op/s 2026-02-20T03:23:12.795 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:12.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:12 trial126 ceph-mon[38476]: pgmap v437: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 548 KiB/s rd, 2.2 MiB/s wr, 212 op/s 2026-02-20T03:23:13.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- 10.20.193.28:0/305750979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6214104980 msgr2=0x7f6214104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:13.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 --2- 10.20.193.28:0/305750979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6214104980 0x7f6214104de0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f6204009a60 tx=0x7f620402f290 comp rx=0 tx=0).stop 2026-02-20T03:23:13.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- 10.20.193.28:0/305750979 shutdown_connections 2026-02-20T03:23:13.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 --2- 10.20.193.28:0/305750979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6214105320 0x7f6214111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 --2- 10.20.193.28:0/305750979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6214104980 0x7f6214104de0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 --2- 10.20.193.28:0/305750979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f621410a980 0x7f621410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- 10.20.193.28:0/305750979 >> 10.20.193.28:0/305750979 conn(0x7f6214100680 msgr2=0x7f6214102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- 10.20.193.28:0/305750979 shutdown_connections 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- 10.20.193.28:0/305750979 wait complete. 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 Processor -- start 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- start start 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6214104980 0x7f621419d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6214105320 0x7f621419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621410a980 0x7f62141a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6214114cd0 con 0x7f621410a980 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6214114b50 con 0x7f6214105320 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6214114e50 con 0x7f6214104980 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6213fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621410a980 0x7f62141a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6213fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621410a980 0x7f62141a1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60696/0 (socket says 10.20.193.28:60696) 2026-02-20T03:23:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6213fff640 1 -- 10.20.193.28:0/3146299565 learned_addr learned my addr 10.20.193.28:0/3146299565 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:13.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6213fff640 1 -- 10.20.193.28:0/3146299565 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6214104980 msgr2=0x7f621419d270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:13.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6213fff640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6214104980 0x7f621419d270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6213fff640 1 -- 10.20.193.28:0/3146299565 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6214105320 msgr2=0x7f621419d7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:13.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6213fff640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6214105320 0x7f621419d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6213fff640 1 -- 10.20.193.28:0/3146299565 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62141a22c0 con 0x7f621410a980 2026-02-20T03:23:13.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6213fff640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621410a980 0x7f62141a1b40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f620800b990 tx=0x7f620800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:13.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6210ff9640 1 -- 10.20.193.28:0/3146299565 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208006e60 con 0x7f621410a980 2026-02-20T03:23:13.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62141a25b0 con 0x7f621410a980 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62141a9df0 con 0x7f621410a980 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6210ff9640 1 -- 10.20.193.28:0/3146299565 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6208010070 con 0x7f621410a980 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f6210ff9640 1 -- 10.20.193.28:0/3146299565 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208004800 con 0x7f621410a980 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.047+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6214104e60 con 0x7f621410a980 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.053+0000 7f6210ff9640 1 -- 10.20.193.28:0/3146299565 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f620801d030 con 0x7f621410a980 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.053+0000 7f6210ff9640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e80b0e20 0x7f61e80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.053+0000 7f6210ff9640 1 -- 10.20.193.28:0/3146299565 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f62080e01f0 con 0x7f621410a980 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.053+0000 7f6210ff9640 1 -- 10.20.193.28:0/3146299565 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f620801c2f0 con 0x7f621410a980 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.053+0000 7f62137fe640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e80b0e20 0x7f61e80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:13.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.053+0000 7f62137fe640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e80b0e20 0x7f61e80b32e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6200009770 tx=0x7f6200006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:13.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.163+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f621410ca50 con 0x7f621410a980 2026-02-20T03:23:13.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.163+0000 7f6210ff9640 1 -- 10.20.193.28:0/3146299565 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f62080a85d0 con 0x7f621410a980 2026-02-20T03:23:13.168 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:23:13.168 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:23:13.169 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:23:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e80b0e20 msgr2=0x7f61e80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e80b0e20 0x7f61e80b32e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f6200009770 tx=0x7f6200006cd0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621410a980 msgr2=0x7f62141a1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621410a980 0x7f62141a1b40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f620800b990 tx=0x7f620800be60 comp rx=0 tx=0).stop 2026-02-20T03:23:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 shutdown_connections 2026-02-20T03:23:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61e80b0e20 0x7f61e80b32e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f621410a980 0x7f62141a1b40 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6214105320 0x7f621419d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 --2- 10.20.193.28:0/3146299565 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6214104980 0x7f621419d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 >> 10.20.193.28:0/3146299565 conn(0x7f6214100680 msgr2=0x7f6214101090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 shutdown_connections 2026-02-20T03:23:13.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.164+0000 7f62189d4640 1 -- 10.20.193.28:0/3146299565 wait complete. 2026-02-20T03:23:13.330 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 351a8ce9 --release --await' 2026-02-20T03:23:13.330 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 351a8ce9 --release --await 2026-02-20T03:23:13.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:13 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3146299565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:13.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 8.86 MB/sec execute 286 sec latency 9697.837 ms 2026-02-20T03:23:13.641 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:13 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3146299565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:13 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3146299565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:13.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.895+0000 7fa953577640 1 -- 10.20.193.28:0/345828454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 msgr2=0x7fa95410ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:13.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.895+0000 7fa953577640 1 --2- 10.20.193.28:0/345828454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 0x7fa95410ad80 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa948009a60 tx=0x7fa94802f290 comp rx=0 tx=0).stop 2026-02-20T03:23:13.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.895+0000 7fa953577640 1 -- 10.20.193.28:0/345828454 shutdown_connections 2026-02-20T03:23:13.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.895+0000 7fa953577640 1 --2- 10.20.193.28:0/345828454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa954105340 0x7fa954111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.895+0000 7fa953577640 1 --2- 10.20.193.28:0/345828454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9541049a0 0x7fa954104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.895+0000 7fa953577640 1 --2- 10.20.193.28:0/345828454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 0x7fa95410ad80 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.895+0000 7fa953577640 1 -- 10.20.193.28:0/345828454 >> 10.20.193.28:0/345828454 conn(0x7fa9541006c0 msgr2=0x7fa954102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:13.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.895+0000 7fa953577640 1 -- 10.20.193.28:0/345828454 shutdown_connections 2026-02-20T03:23:13.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.895+0000 7fa953577640 1 -- 10.20.193.28:0/345828454 wait complete. 2026-02-20T03:23:13.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.896+0000 7fa953577640 1 Processor -- start 2026-02-20T03:23:13.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.896+0000 7fa953577640 1 -- start start 2026-02-20T03:23:13.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.896+0000 7fa953577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9541049a0 0x7fa95419d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.896+0000 7fa953577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa954105340 0x7fa95419d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.896+0000 7fa953577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 0x7fa9541a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.896+0000 7fa953577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa954114cf0 con 0x7fa95410a9a0 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.896+0000 7fa953577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa954114b70 con 0x7fa9541049a0 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.896+0000 7fa953577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa954114e70 con 0x7fa954105340 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.896+0000 7fa952d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 0x7fa9541a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa952d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 0x7fa9541a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60720/0 (socket says 10.20.193.28:60720) 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa952d76640 1 -- 10.20.193.28:0/3978915702 learned_addr learned my addr 10.20.193.28:0/3978915702 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa952d76640 1 -- 10.20.193.28:0/3978915702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa954105340 msgr2=0x7fa95419d750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa952d76640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa954105340 0x7fa95419d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa952d76640 1 -- 10.20.193.28:0/3978915702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9541049a0 msgr2=0x7fa95419d210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa952d76640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9541049a0 0x7fa95419d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa952d76640 1 -- 10.20.193.28:0/3978915702 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9541a2260 con 0x7fa95410a9a0 2026-02-20T03:23:13.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa952d76640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 0x7fa9541a1ae0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa94400b990 tx=0x7fa94400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:13.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa93b7fe640 1 -- 10.20.193.28:0/3978915702 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa944006e60 con 0x7fa95410a9a0 2026-02-20T03:23:13.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa93b7fe640 1 -- 10.20.193.28:0/3978915702 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa944010070 con 0x7fa95410a9a0 2026-02-20T03:23:13.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa953577640 1 -- 10.20.193.28:0/3978915702 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9541a2550 con 0x7fa95410a9a0 2026-02-20T03:23:13.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa93b7fe640 1 -- 10.20.193.28:0/3978915702 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa944004800 con 0x7fa95410a9a0 2026-02-20T03:23:13.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.897+0000 7fa953577640 1 -- 10.20.193.28:0/3978915702 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9541a9d90 con 0x7fa95410a9a0 2026-02-20T03:23:13.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa93b7fe640 1 -- 10.20.193.28:0/3978915702 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa94401d030 con 0x7fa95410a9a0 2026-02-20T03:23:13.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 Processor -- start 2026-02-20T03:23:13.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- start start 2026-02-20T03:23:13.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb2c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb2d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe7ea7ea20 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fe7ea2c2a0 con 0x55fe7eb2bdd0 2026-02-20T03:23:13.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fe7ea7a950 con 0x55fe7eb2cf60 2026-02-20T03:23:13.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa951d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:13.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa951d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60730/0 (socket says 10.20.193.28:60730) 2026-02-20T03:23:13.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa951d74640 1 -- 10.20.193.28:0/3777162638 learned_addr learned my addr 10.20.193.28:0/3777162638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:13.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa951d74640 1 -- 10.20.193.28:0/3777162638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2cf60 msgr2=0x55fe7eb2d3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa951d74640 1 --2- 10.20.193.28:0/3777162638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb2d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa951d74640 1 -- 10.20.193.28:0/3777162638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2bdd0 msgr2=0x55fe7eb2c1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa951d74640 1 --2- 10.20.193.28:0/3777162638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb2c1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa951d74640 1 -- 10.20.193.28:0/3777162638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7ea0f0f0 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa93b7fe640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa92c0b0e20 0x7fa92c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa951d74640 1 --2- 10.20.193.28:0/3777162638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb382d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009b00 tx=0x7fa93c00b0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a43c594c5c9cd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa93b7fe640 1 -- 10.20.193.28:0/3978915702 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa9440dffe0 con 0x7fa95410a9a0 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa938ff9640 1 -- 10.20.193.28:0/3777162638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c016070 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa938ff9640 1 -- 10.20.193.28:0/3777162638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa93c002870 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa938ff9640 1 -- 10.20.193.28:0/3777162638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c011400 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- 10.20.193.28:0/3777162638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 msgr2=0x55fe7eb382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:13.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3777162638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb382d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009b00 tx=0x7fa93c00b0e0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952575640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa92c0b0e20 0x7fa92c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- 10.20.193.28:0/3777162638 shutdown_connections 2026-02-20T03:23:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3777162638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb382d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3777162638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb2d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3777162638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb2c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- 10.20.193.28:0/3777162638 >> 10.20.193.28:0/3777162638 conn(0x55fe7eb231b0 msgr2=0x55fe7eb2a030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- 10.20.193.28:0/3777162638 shutdown_connections 2026-02-20T03:23:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- 10.20.193.28:0/3777162638 wait complete. 2026-02-20T03:23:13.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952575640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa92c0b0e20 0x7fa92c0b32e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa948009950 tx=0x7fa9480023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:13.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- start start 2026-02-20T03:23:13.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 Processor -- start 2026-02-20T03:23:13.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb4f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb4f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb44b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fe7ea26080 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fe7eb389d0 con 0x55fe7eb2cf60 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fe7eb45090 con 0x55fe7eb2bdd0 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb44b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb44b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60740/0 (socket says 10.20.193.28:60740) 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952d76640 1 -- 10.20.193.28:0/3773930028 learned_addr learned my addr 10.20.193.28:0/3773930028 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952d76640 1 -- 10.20.193.28:0/3773930028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2bdd0 msgr2=0x55fe7eb4f060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952d76640 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb4f060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952d76640 1 -- 10.20.193.28:0/3773930028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2cf60 msgr2=0x55fe7eb4f5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952d76640 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb4f5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:13.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952d76640 1 -- 10.20.193.28:0/3773930028 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7eb3df30 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa952d76640 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb44b00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa9440a3b50 tx=0x7fa9440a7960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a18ae78cc6f22e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa903fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa903fff640 1 -- 10.20.193.28:0/3773930028 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94400cdc0 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa903fff640 1 -- 10.20.193.28:0/3773930028 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa9440c8e50 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- 10.20.193.28:0/3773930028 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7e84fda0 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 10 client.17568 _ll_register_callbacks cb 0x55fe7ea29fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa903fff640 1 -- 10.20.193.28:0/3773930028 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440a36a0 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- 10.20.193.28:0/3773930028 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe7ea86610 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa903fff640 1 -- 10.20.193.28:0/3773930028 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa9440a69b0 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa903fff640 1 -- 10.20.193.28:0/3773930028 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa9440ce1b0 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 10 client.17568 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- 10.20.193.28:0/3773930028 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55fe7ea3c020 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa903fff640 1 -- 10.20.193.28:0/3773930028 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa9440ae300 con 0x55fe7eb2d8e0 2026-02-20T03:23:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 10 client.17568 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 10 client.17568 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:23:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 20 client.17568 populate_metadata read hostname 'trial028' 2026-02-20T03:23:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fe7eb5d8a0 0x55fe7eb5fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:13.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 4 client.17568 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:13.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.901+0000 7fa95b233e00 1 -- 10.20.193.28:0/3773930028 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe7ea86610 con 0x55fe7eb5d8a0 2026-02-20T03:23:13.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.927+0000 7fa952575640 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fe7eb5d8a0 0x55fe7eb5fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:13.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.994+0000 7fa952575640 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fe7eb5d8a0 0x55fe7eb5fd40 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c134e43fea2d0b3 server_cookie=e1ee331db30698e9 in_seq=0 out_seq=0 2026-02-20T03:23:13.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:13.994+0000 7fa903fff640 10 client.17568 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:14.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa903fff640 1 -- 10.20.193.28:0/3773930028 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fe7ea86610 con 0x55fe7eb5d8a0 2026-02-20T03:23:14.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa903fff640 10 client.17568 handle_command_reply: tid=0 2026-02-20T03:23:14.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 client.17568 shutdown 2026-02-20T03:23:14.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 -- 10.20.193.28:0/3773930028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 msgr2=0x55fe7eb44b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:14.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb44b00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa9440a3b50 tx=0x7fa9440a7960 comp rx=0 tx=0).stop 2026-02-20T03:23:14.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 -- 10.20.193.28:0/3773930028 shutdown_connections 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fe7eb5d8a0 0x55fe7eb5fd40 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb44b00 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb4f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 --2- 10.20.193.28:0/3773930028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb4f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 -- 10.20.193.28:0/3773930028 >> 10.20.193.28:0/3773930028 conn(0x55fe7eb231b0 msgr2=0x55fe7eb30080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa903fff640 0 client.17568 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 -- 10.20.193.28:0/3773930028 shutdown_connections 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 1 -- 10.20.193.28:0/3773930028 wait complete. 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.007+0000 7fa95b233e00 20 client.17568 trim_cache size 0 max 16384 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa95b233e00 1 Processor -- start 2026-02-20T03:23:14.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa95b233e00 1 -- start start 2026-02-20T03:23:14.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb30080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:14.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:14.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb65650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:14.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa95b233e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f80126f0 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa95b233e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f800ffc0 con 0x55fe7eb2bdd0 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa95b233e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f800de10 con 0x55fe7eb2cf60 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa952d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb65650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa952d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb65650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60752/0 (socket says 10.20.193.28:60752) 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa952d76640 1 -- 10.20.193.28:0/738628773 learned_addr learned my addr 10.20.193.28:0/738628773 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa952d76640 1 -- 10.20.193.28:0/738628773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2cf60 msgr2=0x55fe7eb305c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa952d76640 1 --2- 10.20.193.28:0/738628773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb305c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa952d76640 1 -- 10.20.193.28:0/738628773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2bdd0 msgr2=0x55fe7eb30080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa952d76640 1 --2- 10.20.193.28:0/738628773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb30080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa952d76640 1 -- 10.20.193.28:0/738628773 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7eb2b070 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa952d76640 1 --2- 10.20.193.28:0/738628773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb65650 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa944009810 tx=0x7fa944091000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4026b07657ade91 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:14.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa91e4e6640 1 -- 10.20.193.28:0/738628773 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94400cdc0 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.013+0000 7fa91e4e6640 1 -- 10.20.193.28:0/738628773 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa9440c8e50 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa91e4e6640 1 -- 10.20.193.28:0/738628773 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440ce350 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- 10.20.193.28:0/738628773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 msgr2=0x55fe7eb65650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:14.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 --2- 10.20.193.28:0/738628773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb65650 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa944009810 tx=0x7fa944091000 comp rx=0 tx=0).stop 2026-02-20T03:23:14.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- 10.20.193.28:0/738628773 shutdown_connections 2026-02-20T03:23:14.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 --2- 10.20.193.28:0/738628773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7eb65650 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 --2- 10.20.193.28:0/738628773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb305c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 --2- 10.20.193.28:0/738628773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb30080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- 10.20.193.28:0/738628773 >> 10.20.193.28:0/738628773 conn(0x55fe7eb231b0 msgr2=0x55fe7eb43320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:14.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- 10.20.193.28:0/738628773 shutdown_connections 2026-02-20T03:23:14.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- 10.20.193.28:0/738628773 wait complete. 2026-02-20T03:23:14.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- start start 2026-02-20T03:23:14.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 Processor -- start 2026-02-20T03:23:14.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb54a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:14.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb54f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:14.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7ebc1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:14.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f800e480 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f800f8f0 con 0x55fe7eb2cf60 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f800eb50 con 0x55fe7eb2bdd0 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa952d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7ebc1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa952d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7ebc1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60764/0 (socket says 10.20.193.28:60764) 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa952d76640 1 -- 10.20.193.28:0/1012656932 learned_addr learned my addr 10.20.193.28:0/1012656932 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa952d76640 1 -- 10.20.193.28:0/1012656932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2bdd0 msgr2=0x55fe7eb54a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa952d76640 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb54a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa952d76640 1 -- 10.20.193.28:0/1012656932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2cf60 msgr2=0x55fe7eb54f60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa952d76640 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb54f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa952d76640 1 -- 10.20.193.28:0/1012656932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7eb3dd60 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa952d76640 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7ebc1950 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa944002790 tx=0x7fa944004220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3edfeb0ac3b442 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:14.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa903fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa903fff640 1 -- 10.20.193.28:0/1012656932 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440a75e0 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- 10.20.193.28:0/1012656932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7e75dad0 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa903fff640 1 -- 10.20.193.28:0/1012656932 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa94400cdc0 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa903fff640 1 -- 10.20.193.28:0/1012656932 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94408ea80 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 10 client.17574 _ll_register_callbacks cb 0x7fa9440a3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- 10.20.193.28:0/1012656932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe7ea00b80 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa903fff640 1 -- 10.20.193.28:0/1012656932 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa9440b2060 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa903fff640 1 -- 10.20.193.28:0/1012656932 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa9440b9050 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 10 client.17574 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.018+0000 7fa95b233e00 1 -- 10.20.193.28:0/1012656932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55fe7ea05370 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.021+0000 7fa903fff640 1 -- 10.20.193.28:0/1012656932 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa94400c790 con 0x55fe7eb2d8e0 2026-02-20T03:23:14.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.021+0000 7fa95b233e00 10 client.17574 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:14.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.021+0000 7fa95b233e00 10 client.17574 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:23:14.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.021+0000 7fa95b233e00 20 client.17574 populate_metadata read hostname 'trial028' 2026-02-20T03:23:14.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.021+0000 7fa95b233e00 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fe7ebc9f90 0x55fe7ebcc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:14.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.021+0000 7fa95b233e00 4 client.17574 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "351a8ce9", "release": true, "await": true}] 2026-02-20T03:23:14.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.021+0000 7fa95b233e00 1 -- 10.20.193.28:0/1012656932 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "351a8ce9", "release": true, "await": true}) -- 0x55fe7ea8c3c0 con 0x55fe7ebc9f90 2026-02-20T03:23:14.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.048+0000 7fa952575640 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fe7ebc9f90 0x55fe7ebcc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:14.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.101+0000 7fa952575640 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fe7ebc9f90 0x55fe7ebcc450 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe90fbf346da4625 server_cookie=5da8895a51026a54 in_seq=0 out_seq=0 2026-02-20T03:23:14.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.101+0000 7fa903fff640 10 client.17574 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:14.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.114+0000 7fa903fff640 1 -- 10.20.193.28:0/1012656932 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55fe7ea8c3c0 con 0x55fe7ebc9f90 2026-02-20T03:23:14.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.114+0000 7fa903fff640 10 client.17574 handle_command_reply: tid=0 2026-02-20T03:23:14.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.114+0000 7fa95b233e00 1 client.17574 shutdown 2026-02-20T03:23:14.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 -- 10.20.193.28:0/1012656932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 msgr2=0x55fe7ebc1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:14.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7ebc1950 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa944002790 tx=0x7fa944004220 comp rx=0 tx=0).stop 2026-02-20T03:23:14.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 -- 10.20.193.28:0/1012656932 shutdown_connections 2026-02-20T03:23:14.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fe7ebc9f90 0x55fe7ebcc450 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fe7eb2d8e0 0x55fe7ebc1950 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fe7eb2cf60 0x55fe7eb54f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 --2- 10.20.193.28:0/1012656932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fe7eb2bdd0 0x55fe7eb54a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 -- 10.20.193.28:0/1012656932 >> 10.20.193.28:0/1012656932 conn(0x55fe7eb231b0 msgr2=0x55fe7eb30080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:14.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa903fff640 0 client.17574 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:14.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 -- 10.20.193.28:0/1012656932 shutdown_connections 2026-02-20T03:23:14.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 1 -- 10.20.193.28:0/1012656932 wait complete. 2026-02-20T03:23:14.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa95b233e00 20 client.17574 trim_cache size 0 max 16384 2026-02-20T03:23:14.119 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 28, 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "351a8ce9": { 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "version": 28, 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:23:14.120 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 130.0, 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:14.121 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:14.122 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:14.122 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:14.122 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:23:14.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 -- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa92c0b0e20 msgr2=0x7fa92c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:14.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa92c0b0e20 0x7fa92c0b32e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa948009950 tx=0x7fa9480023d0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 -- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 msgr2=0x7fa9541a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:14.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 0x7fa9541a1ae0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa94400b990 tx=0x7fa94400be60 comp rx=0 tx=0).stop 2026-02-20T03:23:14.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 -- 10.20.193.28:0/3978915702 shutdown_connections 2026-02-20T03:23:14.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa92c0b0e20 0x7fa92c0b32e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa95410a9a0 0x7fa9541a1ae0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa954105340 0x7fa95419d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 --2- 10.20.193.28:0/3978915702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9541049a0 0x7fa95419d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:14.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 -- 10.20.193.28:0/3978915702 >> 10.20.193.28:0/3978915702 conn(0x7fa9541006c0 msgr2=0x7fa954101040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:14.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 -- 10.20.193.28:0/3978915702 shutdown_connections 2026-02-20T03:23:14.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:14.115+0000 7fa953577640 1 -- 10.20.193.28:0/3978915702 wait complete. 2026-02-20T03:23:14.275 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '351a8ce9', total seconds elapsed: 11.7 2026-02-20T03:23:14.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769000 8.83 MB/sec execute 287 sec latency 10697.869 ms 2026-02-20T03:23:14.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:14 trial028 ceph-mon[38552]: pgmap v438: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 549 KiB/s rd, 2.3 MiB/s wr, 218 op/s 2026-02-20T03:23:14.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:14 trial126 ceph-mon[38476]: pgmap v438: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 549 KiB/s rd, 2.3 MiB/s wr, 218 op/s 2026-02-20T03:23:14.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:14 trial177 ceph-mon[43181]: pgmap v438: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 549 KiB/s rd, 2.3 MiB/s wr, 218 op/s 2026-02-20T03:23:15.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 769048 8.80 MB/sec execute 288 sec latency 10891.864 ms 2026-02-20T03:23:16.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 771443 8.81 MB/sec execute 289 sec latency 941.875 ms 2026-02-20T03:23:17.188 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:17 trial028 ceph-mon[38552]: pgmap v439: 129 pgs: 129 active+clean; 146 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 409 KiB/s rd, 2.7 MiB/s wr, 207 op/s 2026-02-20T03:23:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:17 trial177 ceph-mon[43181]: pgmap v439: 129 pgs: 129 active+clean; 146 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 409 KiB/s rd, 2.7 MiB/s wr, 207 op/s 2026-02-20T03:23:17.512 INFO:tasks.workunit.client.0.trial028.stdout: 1 773266 8.82 MB/sec execute 290 sec latency 633.592 ms 2026-02-20T03:23:17.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:17 trial126 ceph-mon[38476]: pgmap v439: 129 pgs: 129 active+clean; 146 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 409 KiB/s rd, 2.7 MiB/s wr, 207 op/s 2026-02-20T03:23:18.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 773268 8.79 MB/sec execute 291 sec latency 1180.247 ms 2026-02-20T03:23:18.538 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:23:18.824 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:19.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 -- 10.20.193.28:0/939142996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 msgr2=0x7efe48105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:19.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 --2- 10.20.193.28:0/939142996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 0x7efe48105180 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7efe34009a30 tx=0x7efe3402f260 comp rx=0 tx=0).stop 2026-02-20T03:23:19.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 -- 10.20.193.28:0/939142996 shutdown_connections 2026-02-20T03:23:19.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 --2- 10.20.193.28:0/939142996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe48109ed0 0x7efe48111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 --2- 10.20.193.28:0/939142996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe48105750 0x7efe481097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 --2- 10.20.193.28:0/939142996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 0x7efe48105180 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 -- 10.20.193.28:0/939142996 >> 10.20.193.28:0/939142996 conn(0x7efe48100840 msgr2=0x7efe48102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:19.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 -- 10.20.193.28:0/939142996 shutdown_connections 2026-02-20T03:23:19.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 -- 10.20.193.28:0/939142996 wait complete. 2026-02-20T03:23:19.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.077+0000 7efe4e88e640 1 Processor -- start 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe4e88e640 1 -- start start 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe4e88e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 0x7efe4819d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe4e88e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe48105750 0x7efe4819d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe4e88e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe48109ed0 0x7efe481a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe4e88e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe48114e30 con 0x7efe48104da0 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe4e88e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efe48114cb0 con 0x7efe48105750 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe4e88e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe48114fb0 con 0x7efe48109ed0 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 0x7efe4819d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 0x7efe4819d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46314/0 (socket says 10.20.193.28:46314) 2026-02-20T03:23:19.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 -- 10.20.193.28:0/551730680 learned_addr learned my addr 10.20.193.28:0/551730680 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:19.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 -- 10.20.193.28:0/551730680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe48109ed0 msgr2=0x7efe481a1c20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:19.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe48109ed0 0x7efe481a1c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 -- 10.20.193.28:0/551730680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe48105750 msgr2=0x7efe4819d890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:19.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe48105750 0x7efe4819d890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 -- 10.20.193.28:0/551730680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe481a23a0 con 0x7efe48104da0 2026-02-20T03:23:19.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 0x7efe4819d350 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7efe34009a00 tx=0x7efe34002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe457fa640 1 -- 10.20.193.28:0/551730680 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34004260 con 0x7efe48104da0 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe457fa640 1 -- 10.20.193.28:0/551730680 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efe34004400 con 0x7efe48104da0 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe457fa640 1 -- 10.20.193.28:0/551730680 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34041950 con 0x7efe48104da0 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe4e88e640 1 -- 10.20.193.28:0/551730680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe481a2630 con 0x7efe48104da0 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe4e88e640 1 -- 10.20.193.28:0/551730680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe481a9ed0 con 0x7efe48104da0 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe457fa640 1 -- 10.20.193.28:0/551730680 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efe34038790 con 0x7efe48104da0 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe50d93e00 1 Processor -- start 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe50d93e00 1 -- start start 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5a630 0x560162f5aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5afe0 0x560162f5e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5f120 0x560162f66ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe50d93e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560162edae50 con 0x560162f5afe0 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe50d93e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560162ead9c0 con 0x560162f5a630 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe50d93e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560162e5b240 con 0x560162f5f120 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5afe0 0x560162f5e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5afe0 0x560162f5e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46326/0 (socket says 10.20.193.28:46326) 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 -- 10.20.193.28:0/1262602209 learned_addr learned my addr 10.20.193.28:0/1262602209 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 -- 10.20.193.28:0/1262602209 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5f120 msgr2=0x560162f66ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- 10.20.193.28:0/1262602209 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5f120 0x560162f66ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 -- 10.20.193.28:0/1262602209 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5a630 msgr2=0x560162f5aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- 10.20.193.28:0/1262602209 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5a630 0x560162f5aa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 -- 10.20.193.28:0/1262602209 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560162e6e420 con 0x560162f5afe0 2026-02-20T03:23:19.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe457fa640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe1c0b0e20 0x7efe1c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe47fff640 1 --2- 10.20.193.28:0/1262602209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5afe0 0x560162f5e9f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7efe3410ba90 tx=0x7efe3410bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77408845fe64f8cd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.079+0000 7efe457fa640 1 -- 10.20.193.28:0/551730680 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efe34105800 con 0x7efe48104da0 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe18ce3640 1 -- 10.20.193.28:0/1262602209 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe340c9150 con 0x560162f5afe0 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe18ce3640 1 -- 10.20.193.28:0/1262602209 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efe34033030 con 0x560162f5afe0 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe4ce04640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe1c0b0e20 0x7efe1c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe18ce3640 1 -- 10.20.193.28:0/1262602209 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe340c9150 con 0x560162f5afe0 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 -- 10.20.193.28:0/1262602209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5afe0 msgr2=0x560162f5e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 --2- 10.20.193.28:0/1262602209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5afe0 0x560162f5e9f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7efe3410ba90 tx=0x7efe3410bf60 comp rx=0 tx=0).stop 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 -- 10.20.193.28:0/1262602209 shutdown_connections 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 --2- 10.20.193.28:0/1262602209 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5f120 0x560162f66ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 --2- 10.20.193.28:0/1262602209 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5afe0 0x560162f5e9f0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 --2- 10.20.193.28:0/1262602209 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5a630 0x560162f5aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 -- 10.20.193.28:0/1262602209 >> 10.20.193.28:0/1262602209 conn(0x560162f1d290 msgr2=0x560162f58d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 -- 10.20.193.28:0/1262602209 shutdown_connections 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe4ce04640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe1c0b0e20 0x7efe1c0b32e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00aab0 tx=0x7efe3c009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 -- 10.20.193.28:0/1262602209 wait complete. 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.085+0000 7efe50d93e00 1 -- start start 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 Processor -- start 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5a630 0x560162f7cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5afe0 0x560162f7d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f7b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560162ea98f0 con 0x560162f5f120 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560162c9bf50 con 0x560162f5afe0 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560162f7bb50 con 0x560162f5a630 2026-02-20T03:23:19.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe4ce04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f7b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe4ce04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f7b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46330/0 (socket says 10.20.193.28:46330) 2026-02-20T03:23:19.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe4ce04640 1 -- 10.20.193.28:0/2914417010 learned_addr learned my addr 10.20.193.28:0/2914417010 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:19.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe4ce04640 1 -- 10.20.193.28:0/2914417010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5a630 msgr2=0x560162f7cd60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:19.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe4ce04640 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5a630 0x560162f7cd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe4ce04640 1 -- 10.20.193.28:0/2914417010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5afe0 msgr2=0x560162f7d2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:19.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe4ce04640 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5afe0 0x560162f7d2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe4ce04640 1 -- 10.20.193.28:0/2914417010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560162f74fa0 con 0x560162f5f120 2026-02-20T03:23:19.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe4ce04640 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f7b510 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7efe3c004380 tx=0x7efe3c004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff8222257334092 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:19.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe09ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:19.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe09ffb640 1 -- 10.20.193.28:0/2914417010 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c006e60 con 0x560162f5f120 2026-02-20T03:23:19.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 -- 10.20.193.28:0/2914417010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560162c7eb40 con 0x560162f5f120 2026-02-20T03:23:19.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 10 client.17586 _ll_register_callbacks cb 0x560162ee6f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 -- 10.20.193.28:0/2914417010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560162ebb1a0 con 0x560162f5f120 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe09ffb640 1 -- 10.20.193.28:0/2914417010 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x560162ebb1a0 con 0x560162f5f120 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe09ffb640 1 -- 10.20.193.28:0/2914417010 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c01e020 con 0x560162f5f120 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe09ffb640 1 -- 10.20.193.28:0/2914417010 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efe3c01a430 con 0x560162f5f120 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe09ffb640 1 -- 10.20.193.28:0/2914417010 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efe3c01a710 con 0x560162f5f120 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 10 client.17586 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 -- 10.20.193.28:0/2914417010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560162e68230 con 0x560162f5f120 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe09ffb640 1 -- 10.20.193.28:0/2914417010 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efe3c00d9a0 con 0x560162f5f120 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 10 client.17586 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 10 client.17586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 20 client.17586 populate_metadata read hostname 'trial028' 2026-02-20T03:23:19.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560162f8b6b0 0x560162f8db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 4 client.17586 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:19.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.086+0000 7efe50d93e00 1 -- 10.20.193.28:0/2914417010 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560162eb55b0 con 0x560162f8b6b0 2026-02-20T03:23:19.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.113+0000 7efe47fff640 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560162f8b6b0 0x560162f8db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.140+0000 7efe47fff640 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560162f8b6b0 0x560162f8db50 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e73340f00f0f54aa server_cookie=80ae1db64b8e5da in_seq=0 out_seq=0 2026-02-20T03:23:19.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.140+0000 7efe09ffb640 10 client.17586 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:19.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe09ffb640 1 -- 10.20.193.28:0/2914417010 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560162eb55b0 con 0x560162f8b6b0 2026-02-20T03:23:19.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe09ffb640 10 client.17586 handle_command_reply: tid=0 2026-02-20T03:23:19.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 client.17586 shutdown 2026-02-20T03:23:19.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 -- 10.20.193.28:0/2914417010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 msgr2=0x560162f7b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:19.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f7b510 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7efe3c004380 tx=0x7efe3c004bd0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 -- 10.20.193.28:0/2914417010 shutdown_connections 2026-02-20T03:23:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560162f8b6b0 0x560162f8db50 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f7b510 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5afe0 0x560162f7d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2914417010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5a630 0x560162f7cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe09ffb640 0 client.17586 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 -- 10.20.193.28:0/2914417010 >> 10.20.193.28:0/2914417010 conn(0x560162f1d290 msgr2=0x560162f5d940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:19.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 -- 10.20.193.28:0/2914417010 shutdown_connections 2026-02-20T03:23:19.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 1 -- 10.20.193.28:0/2914417010 wait complete. 2026-02-20T03:23:19.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.142+0000 7efe50d93e00 20 client.17586 trim_cache size 0 max 16384 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 Processor -- start 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 -- start start 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5a630 0x560162f5e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5afe0 0x560162f78de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f82c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efdec0126f0 con 0x560162f5f120 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efdec00ffc0 con 0x560162f5a630 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efdec00de10 con 0x560162f5afe0 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe4ce04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f82c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe4ce04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f82c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46344/0 (socket says 10.20.193.28:46344) 2026-02-20T03:23:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe4ce04640 1 -- 10.20.193.28:0/2734306887 learned_addr learned my addr 10.20.193.28:0/2734306887 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe4ce04640 1 -- 10.20.193.28:0/2734306887 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5afe0 msgr2=0x560162f78de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe4ce04640 1 --2- 10.20.193.28:0/2734306887 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5afe0 0x560162f78de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe4ce04640 1 -- 10.20.193.28:0/2734306887 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5a630 msgr2=0x560162f5e530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe4ce04640 1 --2- 10.20.193.28:0/2734306887 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5a630 0x560162f5e530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe4ce04640 1 -- 10.20.193.28:0/2734306887 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560162f74dd0 con 0x560162f5f120 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe4ce04640 1 --2- 10.20.193.28:0/2734306887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f82c60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00c970 tx=0x7efe3c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7850755ff353d168 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe0bfff640 1 -- 10.20.193.28:0/2734306887 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c01e040 con 0x560162f5f120 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe0bfff640 1 -- 10.20.193.28:0/2734306887 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efe3c01f020 con 0x560162f5f120 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe0bfff640 1 -- 10.20.193.28:0/2734306887 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c02e860 con 0x560162f5f120 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 -- 10.20.193.28:0/2734306887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 msgr2=0x560162f82c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.148+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2734306887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f82c60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00c970 tx=0x7efe3c004270 comp rx=0 tx=0).stop 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- 10.20.193.28:0/2734306887 shutdown_connections 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2734306887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162f82c60 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2734306887 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5afe0 0x560162f78de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 --2- 10.20.193.28:0/2734306887 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5a630 0x560162f5e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- 10.20.193.28:0/2734306887 >> 10.20.193.28:0/2734306887 conn(0x560162f1d290 msgr2=0x560162f5de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- 10.20.193.28:0/2734306887 shutdown_connections 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- 10.20.193.28:0/2734306887 wait complete. 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- start start 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 Processor -- start 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5a630 0x560162fec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5afe0 0x560162fecb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162fed060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efdec00e480 con 0x560162f5f120 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efdec00f8f0 con 0x560162f5afe0 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efdec00eb50 con 0x560162f5a630 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe4ce04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162fed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe4ce04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162fed060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46354/0 (socket says 10.20.193.28:46354) 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe4ce04640 1 -- 10.20.193.28:0/139408947 learned_addr learned my addr 10.20.193.28:0/139408947 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe4ce04640 1 -- 10.20.193.28:0/139408947 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5a630 msgr2=0x560162fec5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe4ce04640 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5a630 0x560162fec5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe4ce04640 1 -- 10.20.193.28:0/139408947 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5afe0 msgr2=0x560162fecb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe4ce04640 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5afe0 0x560162fecb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe4ce04640 1 -- 10.20.193.28:0/139408947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560162b8c870 con 0x560162f5f120 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe4ce04640 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162fed060 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00ddd0 tx=0x7efe3c01a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbec66f38b0cae5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe09ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe09ffb640 1 -- 10.20.193.28:0/139408947 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c01e040 con 0x560162f5f120 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe09ffb640 1 -- 10.20.193.28:0/139408947 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efe3c011070 con 0x560162f5f120 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe09ffb640 1 -- 10.20.193.28:0/139408947 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c042850 con 0x560162f5f120 2026-02-20T03:23:19.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- 10.20.193.28:0/139408947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560162e4d440 con 0x560162f5f120 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe09ffb640 1 -- 10.20.193.28:0/139408947 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7efe3c0429f0 con 0x560162f5f120 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 10 client.17592 _ll_register_callbacks cb 0x7efe3c002b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- 10.20.193.28:0/139408947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560162eb55b0 con 0x560162f5f120 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe09ffb640 1 -- 10.20.193.28:0/139408947 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efe3c02e9b0 con 0x560162f5f120 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 10 client.17592 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- 10.20.193.28:0/139408947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x560162f75ac0 con 0x560162f5f120 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe09ffb640 1 -- 10.20.193.28:0/139408947 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7efe3c04a030 con 0x560162f5f120 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 10 client.17592 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 10 client.17592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 20 client.17592 populate_metadata read hostname 'trial028' 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560162ff8ae0 0x560162ffafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 4 client.17592 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:23:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.153+0000 7efe50d93e00 1 -- 10.20.193.28:0/139408947 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560162e2fa80 con 0x560162ff8ae0 2026-02-20T03:23:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.156+0000 7efe47fff640 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560162ff8ae0 0x560162ffafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe47fff640 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560162ff8ae0 0x560162ffafa0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1847b64db704f71b server_cookie=5b50f74953f37c03 in_seq=0 out_seq=0 2026-02-20T03:23:19.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe09ffb640 10 client.17592 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:19.188 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:23:19.188 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:23:19.188 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:23:19.188 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:23:19.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe09ffb640 1 -- 10.20.193.28:0/139408947 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560162e2fa80 con 0x560162ff8ae0 2026-02-20T03:23:19.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe09ffb640 10 client.17592 handle_command_reply: tid=0 2026-02-20T03:23:19.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 client.17592 shutdown 2026-02-20T03:23:19.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 -- 10.20.193.28:0/139408947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 msgr2=0x560162fed060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:19.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162fed060 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00ddd0 tx=0x7efe3c01a5f0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 -- 10.20.193.28:0/139408947 shutdown_connections 2026-02-20T03:23:19.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560162ff8ae0 0x560162ffafa0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560162f5f120 0x560162fed060 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560162f5afe0 0x560162fecb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 --2- 10.20.193.28:0/139408947 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560162f5a630 0x560162fec5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 -- 10.20.193.28:0/139408947 >> 10.20.193.28:0/139408947 conn(0x560162f1d290 msgr2=0x560162f77dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe09ffb640 0 client.17592 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 -- 10.20.193.28:0/139408947 shutdown_connections 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 1 -- 10.20.193.28:0/139408947 wait complete. 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.184+0000 7efe50d93e00 20 client.17592 trim_cache size 0 max 16384 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 -- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe1c0b0e20 msgr2=0x7efe1c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe1c0b0e20 0x7efe1c0b32e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efe3c00aab0 tx=0x7efe3c009250 comp rx=0 tx=0).stop 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 -- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 msgr2=0x7efe4819d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 0x7efe4819d350 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7efe34009a00 tx=0x7efe34002910 comp rx=0 tx=0).stop 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 -- 10.20.193.28:0/551730680 shutdown_connections 2026-02-20T03:23:19.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe1c0b0e20 0x7efe1c0b32e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe48109ed0 0x7efe481a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe48105750 0x7efe4819d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 --2- 10.20.193.28:0/551730680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe48104da0 0x7efe4819d350 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 -- 10.20.193.28:0/551730680 >> 10.20.193.28:0/551730680 conn(0x7efe48100840 msgr2=0x7efe48101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:19.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 -- 10.20.193.28:0/551730680 shutdown_connections 2026-02-20T03:23:19.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.185+0000 7efe4e88e640 1 -- 10.20.193.28:0/551730680 wait complete. 2026-02-20T03:23:19.343 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:23:19.343 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:23:19.359 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:19 trial028 ceph-mon[38552]: pgmap v440: 129 pgs: 129 active+clean; 144 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 127 KiB/s rd, 2.4 MiB/s wr, 158 op/s 2026-02-20T03:23:19.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:19 trial177 ceph-mon[43181]: pgmap v440: 129 pgs: 129 active+clean; 144 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 127 KiB/s rd, 2.4 MiB/s wr, 158 op/s 2026-02-20T03:23:19.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 773268 8.76 MB/sec execute 292 sec latency 1453.407 ms 2026-02-20T03:23:19.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:19 trial126 ceph-mon[38476]: pgmap v440: 129 pgs: 129 active+clean; 144 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 127 KiB/s rd, 2.4 MiB/s wr, 158 op/s 2026-02-20T03:23:19.643 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:19.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- 10.20.193.28:0/1634595663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f01069e0 msgr2=0x7ff6f0107350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:19.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/1634595663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f01069e0 0x7ff6f0107350 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400b0a0 tx=0x7ff6e402f450 comp rx=0 tx=0).stop 2026-02-20T03:23:19.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- 10.20.193.28:0/1634595663 shutdown_connections 2026-02-20T03:23:19.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/1634595663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f01069e0 0x7ff6f0107350 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/1634595663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6f0101700 0x7ff6f01062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/1634595663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6f0100d50 0x7ff6f0101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- 10.20.193.28:0/1634595663 >> 10.20.193.28:0/1634595663 conn(0x7ff6f00fca60 msgr2=0x7ff6f00fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:19.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- 10.20.193.28:0/1634595663 shutdown_connections 2026-02-20T03:23:19.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- 10.20.193.28:0/1634595663 wait complete. 2026-02-20T03:23:19.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 Processor -- start 2026-02-20T03:23:19.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- start start 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f0100d50 0x7ff6f01a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6f0101700 0x7ff6f01a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6f01069e0 0x7ff6f01a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f01191c0 con 0x7ff6f0100d50 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0119040 con 0x7ff6f01069e0 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f0119340 con 0x7ff6f0101700 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f0100d50 0x7ff6f01a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f0100d50 0x7ff6f01a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46368/0 (socket says 10.20.193.28:46368) 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ef7fe640 1 -- 10.20.193.28:0/2285183400 learned_addr learned my addr 10.20.193.28:0/2285183400 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ef7fe640 1 -- 10.20.193.28:0/2285183400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6f0101700 msgr2=0x7ff6f01a1af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:19.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ef7fe640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6f0101700 0x7ff6f01a1af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ef7fe640 1 -- 10.20.193.28:0/2285183400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6f01069e0 msgr2=0x7ff6f01a5e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:19.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ef7fe640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6f01069e0 0x7ff6f01a5e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:19.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ef7fe640 1 -- 10.20.193.28:0/2285183400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f01a6600 con 0x7ff6f0100d50 2026-02-20T03:23:19.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ef7fe640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f0100d50 0x7ff6f01a15b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b570 tx=0x7ff6dc00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ecff9640 1 -- 10.20.193.28:0/2285183400 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc013020 con 0x7ff6f0100d50 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ecff9640 1 -- 10.20.193.28:0/2285183400 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff6dc004480 con 0x7ff6f0100d50 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ecff9640 1 -- 10.20.193.28:0/2285183400 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc00fb50 con 0x7ff6f0100d50 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f01a68f0 con 0x7ff6f0100d50 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f01ae130 con 0x7ff6f0100d50 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6f0106330 con 0x7ff6f0100d50 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.894+0000 7ff6ecff9640 1 -- 10.20.193.28:0/2285183400 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff6dc002780 con 0x7ff6f0100d50 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.900+0000 7ff6ecff9640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c00b0e20 0x7ff6c00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.900+0000 7ff6ecff9640 1 -- 10.20.193.28:0/2285183400 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff6dc0e0c30 con 0x7ff6f0100d50 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.902+0000 7ff6eeffd640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c00b0e20 0x7ff6c00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:19.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.902+0000 7ff6ecff9640 1 -- 10.20.193.28:0/2285183400 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff6dc01d020 con 0x7ff6f0100d50 2026-02-20T03:23:19.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:19.902+0000 7ff6eeffd640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c00b0e20 0x7ff6c00b32e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00feeb0 tx=0x7ff6e0006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.011+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6f01a2910 con 0x7ff6f0100d50 2026-02-20T03:23:20.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.011+0000 7ff6ecff9640 1 -- 10.20.193.28:0/2285183400 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7ff6dc0a9010 con 0x7ff6f0100d50 2026-02-20T03:23:20.015 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:23:20.016 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:23:20.017 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:23:20.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c00b0e20 msgr2=0x7ff6c00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c00b0e20 0x7ff6c00b32e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00feeb0 tx=0x7ff6e0006cd0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f0100d50 msgr2=0x7ff6f01a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f0100d50 0x7ff6f01a15b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b570 tx=0x7ff6dc00ba40 comp rx=0 tx=0).stop 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 shutdown_connections 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6c00b0e20 0x7ff6c00b32e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff6f01069e0 0x7ff6f01a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff6f0101700 0x7ff6f01a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 --2- 10.20.193.28:0/2285183400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff6f0100d50 0x7ff6f01a15b0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 >> 10.20.193.28:0/2285183400 conn(0x7ff6f00fca60 msgr2=0x7ff6f0110df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 shutdown_connections 2026-02-20T03:23:20.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.013+0000 7ff6f4a55640 1 -- 10.20.193.28:0/2285183400 wait complete. 2026-02-20T03:23:20.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 -- 10.20.193.28:0/3087334793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c10a900 msgr2=0x7f908c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 --2- 10.20.193.28:0/3087334793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c10a900 0x7f908c111480 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f908000b0a0 tx=0x7f908002f450 comp rx=0 tx=0).stop 2026-02-20T03:23:20.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 -- 10.20.193.28:0/3087334793 shutdown_connections 2026-02-20T03:23:20.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 --2- 10.20.193.28:0/3087334793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c10a900 0x7f908c111480 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 --2- 10.20.193.28:0/3087334793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f908c109e60 0x7f908c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 --2- 10.20.193.28:0/3087334793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f908c109490 0x7f908c109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 -- 10.20.193.28:0/3087334793 >> 10.20.193.28:0/3087334793 conn(0x7f908c077fe0 msgr2=0x7f908c07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 -- 10.20.193.28:0/3087334793 shutdown_connections 2026-02-20T03:23:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 -- 10.20.193.28:0/3087334793 wait complete. 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 Processor -- start 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 -- start start 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c109490 0x7f908c1a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f908c109e60 0x7f908c1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f908c10a900 0x7f908c1a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f908c114a50 con 0x7f908c109490 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1148d0 con 0x7f908c10a900 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.091+0000 7f9090b20640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f908c114bd0 con 0x7f908c109e60 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f908b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c109490 0x7f908c1a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f908b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c109490 0x7f908c1a1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46380/0 (socket says 10.20.193.28:46380) 2026-02-20T03:23:20.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f908b7fe640 1 -- 10.20.193.28:0/1550236770 learned_addr learned my addr 10.20.193.28:0/1550236770 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f908b7fe640 1 -- 10.20.193.28:0/1550236770 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f908c109e60 msgr2=0x7f908c1a15a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f908b7fe640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f908c109e60 0x7f908c1a15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f908b7fe640 1 -- 10.20.193.28:0/1550236770 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f908c10a900 msgr2=0x7f908c1a8610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f908b7fe640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f908c10a900 0x7f908c1a8610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f908b7fe640 1 -- 10.20.193.28:0/1550236770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c1a8d10 con 0x7f908c109490 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f908b7fe640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c109490 0x7f908c1a1060 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f907800b750 tx=0x7f907800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f9088ff9640 1 -- 10.20.193.28:0/1550236770 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078004480 con 0x7f908c109490 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f9090b20640 1 -- 10.20.193.28:0/1550236770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908c1a8fa0 con 0x7f908c109490 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f9090b20640 1 -- 10.20.193.28:0/1550236770 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908c1a9560 con 0x7f908c109490 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f9088ff9640 1 -- 10.20.193.28:0/1550236770 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9078010070 con 0x7f908c109490 2026-02-20T03:23:20.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.094+0000 7f9088ff9640 1 -- 10.20.193.28:0/1550236770 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907800ca90 con 0x7f908c109490 2026-02-20T03:23:20.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f9094c0ce00 1 Processor -- start 2026-02-20T03:23:20.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f9094c0ce00 1 -- start start 2026-02-20T03:23:20.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b4c50 0x561dcf7b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7b9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7ba600 0x561dcf7bca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561dcf7058f0 con 0x561dcf7b55b0 2026-02-20T03:23:20.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561dcf6b32e0 con 0x561dcf7b4c50 2026-02-20T03:23:20.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561dcf701820 con 0x561dcf7ba600 2026-02-20T03:23:20.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f908b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7b9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f908b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7b9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46384/0 (socket says 10.20.193.28:46384) 2026-02-20T03:23:20.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f908b7fe640 1 -- 10.20.193.28:0/2585065942 learned_addr learned my addr 10.20.193.28:0/2585065942 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f908b7fe640 1 -- 10.20.193.28:0/2585065942 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7ba600 msgr2=0x561dcf7bca30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f908b7fe640 1 --2- 10.20.193.28:0/2585065942 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7ba600 0x561dcf7bca30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f908b7fe640 1 -- 10.20.193.28:0/2585065942 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b4c50 msgr2=0x561dcf7b5070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f908b7fe640 1 --2- 10.20.193.28:0/2585065942 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b4c50 0x561dcf7b5070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f908b7fe640 1 -- 10.20.193.28:0/2585065942 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf6a55a0 con 0x561dcf7b55b0 2026-02-20T03:23:20.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.096+0000 7f908b7fe640 1 --2- 10.20.193.28:0/2585065942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7b9fe0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f9078006fd0 tx=0x7f9078002d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa75a7837abdb44 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.101+0000 7f90577fe640 1 -- 10.20.193.28:0/2585065942 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078015dd0 con 0x561dcf7b55b0 2026-02-20T03:23:20.113 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.101+0000 7f90577fe640 1 -- 10.20.193.28:0/2585065942 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f907802d070 con 0x561dcf7b55b0 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.101+0000 7f90577fe640 1 -- 10.20.193.28:0/2585065942 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907801e650 con 0x561dcf7b55b0 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.101+0000 7f9094c0ce00 1 -- 10.20.193.28:0/2585065942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 msgr2=0x561dcf7b9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.101+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/2585065942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7b9fe0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f9078006fd0 tx=0x7f9078002d50 comp rx=0 tx=0).stop 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.102+0000 7f9088ff9640 1 -- 10.20.193.28:0/1550236770 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f907801d030 con 0x7f908c109490 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.102+0000 7f9094c0ce00 1 -- 10.20.193.28:0/2585065942 shutdown_connections 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.102+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/2585065942 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7ba600 0x561dcf7bca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.102+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/2585065942 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7b9fe0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.102+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/2585065942 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b4c50 0x561dcf7b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.102+0000 7f9094c0ce00 1 -- 10.20.193.28:0/2585065942 >> 10.20.193.28:0/2585065942 conn(0x561dcf7ac2d0 msgr2=0x561dcf7b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.109+0000 7f9094c0ce00 1 -- 10.20.193.28:0/2585065942 shutdown_connections 2026-02-20T03:23:20.114 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.109+0000 7f9094c0ce00 1 -- 10.20.193.28:0/2585065942 wait complete. 2026-02-20T03:23:20.115 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.109+0000 7f9088ff9640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90600b0d80 0x7f90600b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.109+0000 7f9088ff9640 1 -- 10.20.193.28:0/1550236770 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f90780e3080 con 0x7f908c109490 2026-02-20T03:23:20.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90600b0d80 0x7f90600b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 -- start start 2026-02-20T03:23:20.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 Processor -- start 2026-02-20T03:23:20.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90600b0d80 0x7f90600b3240 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f90800045f0 tx=0x7f9080009de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b4c50 0x561dcf7cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b55b0 0x561dcf7cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561dcf6ad0c0 con 0x561dcf7ba600 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561dcf7bd590 con 0x561dcf7b55b0 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561dcf7d5170 con 0x561dcf7b4c50 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46394/0 (socket says 10.20.193.28:46394) 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 -- 10.20.193.28:0/905900028 learned_addr learned my addr 10.20.193.28:0/905900028 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 -- 10.20.193.28:0/905900028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b4c50 msgr2=0x561dcf7cd820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b4c50 0x561dcf7cd820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 -- 10.20.193.28:0/905900028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b55b0 msgr2=0x561dcf7cdd60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b55b0 0x561dcf7cdd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 -- 10.20.193.28:0/905900028 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf7c7010 con 0x561dcf7ba600 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f908bfff640 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d4be0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9080004960 tx=0x7f90800099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae7caeb63da9b9b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9054ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9054ff9640 1 -- 10.20.193.28:0/905900028 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90800078c0 con 0x561dcf7ba600 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 -- 10.20.193.28:0/905900028 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcf6c1820 con 0x561dcf7ba600 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9054ff9640 1 -- 10.20.193.28:0/905900028 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9080047030 con 0x561dcf7ba600 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 10 client.17610 _ll_register_callbacks cb 0x561dcf6b0ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 -- 10.20.193.28:0/905900028 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561dcf70d4e0 con 0x561dcf7ba600 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9054ff9640 1 -- 10.20.193.28:0/905900028 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080051060 con 0x561dcf7ba600 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9054ff9640 1 -- 10.20.193.28:0/905900028 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f908004c470 con 0x561dcf7ba600 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9054ff9640 1 -- 10.20.193.28:0/905900028 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f908004c730 con 0x561dcf7ba600 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 10 client.17610 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:20.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 -- 10.20.193.28:0/905900028 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561dcf6c6380 con 0x561dcf7ba600 2026-02-20T03:23:20.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9054ff9640 1 -- 10.20.193.28:0/905900028 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f908003f030 con 0x561dcf7ba600 2026-02-20T03:23:20.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 10 client.17610 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:20.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 10 client.17610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:20.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 20 client.17610 populate_metadata read hostname 'trial028' 2026-02-20T03:23:20.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561dcf7d9510 0x561dcf7db960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 4 client.17610 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:20.133 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.111+0000 7f9094c0ce00 1 -- 10.20.193.28:0/905900028 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dcf687bd0 con 0x561dcf7d9510 2026-02-20T03:23:20.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.151+0000 7f908b7fe640 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561dcf7d9510 0x561dcf7db960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.202+0000 7f908b7fe640 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561dcf7d9510 0x561dcf7db960 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cd4f3a04e3bfa4f server_cookie=29c09b88a1447d15 in_seq=0 out_seq=0 2026-02-20T03:23:20.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.202+0000 7f9054ff9640 10 client.17610 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:20.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9054ff9640 1 -- 10.20.193.28:0/905900028 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561dcf687bd0 con 0x561dcf7d9510 2026-02-20T03:23:20.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9054ff9640 10 client.17610 handle_command_reply: tid=0 2026-02-20T03:23:20.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 client.17610 shutdown 2026-02-20T03:23:20.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 -- 10.20.193.28:0/905900028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 msgr2=0x561dcf7d4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d4be0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9080004960 tx=0x7f90800099e0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 -- 10.20.193.28:0/905900028 shutdown_connections 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561dcf7d9510 0x561dcf7db960 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d4be0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b55b0 0x561dcf7cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/905900028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b4c50 0x561dcf7cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 -- 10.20.193.28:0/905900028 >> 10.20.193.28:0/905900028 conn(0x561dcf7ac2d0 msgr2=0x561dcf7bb930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9054ff9640 0 client.17610 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 -- 10.20.193.28:0/905900028 shutdown_connections 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 1 -- 10.20.193.28:0/905900028 wait complete. 2026-02-20T03:23:20.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.216+0000 7f9094c0ce00 20 client.17610 trim_cache size 0 max 16384 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f9094c0ce00 1 Processor -- start 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f9094c0ce00 1 -- start start 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b4c50 0x561dcf7cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7d4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7ba600 0x561dcf7ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90300126f0 con 0x561dcf7b55b0 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f903000ffc0 con 0x561dcf7ba600 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f903000de10 con 0x561dcf7b4c50 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f908affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7d4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f908affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7d4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46404/0 (socket says 10.20.193.28:46404) 2026-02-20T03:23:20.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f908affd640 1 -- 10.20.193.28:0/428100413 learned_addr learned my addr 10.20.193.28:0/428100413 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f908affd640 1 -- 10.20.193.28:0/428100413 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b4c50 msgr2=0x561dcf7cb5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f908affd640 1 --2- 10.20.193.28:0/428100413 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b4c50 0x561dcf7cb5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f908affd640 1 -- 10.20.193.28:0/428100413 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7ba600 msgr2=0x561dcf7ccf00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f908affd640 1 --2- 10.20.193.28:0/428100413 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7ba600 0x561dcf7ccf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f908affd640 1 -- 10.20.193.28:0/428100413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf7c6e40 con 0x561dcf7b55b0 2026-02-20T03:23:20.232 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:23:20.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.220+0000 7f908affd640 1 --2- 10.20.193.28:0/428100413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7d4ba0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f907c009590 tx=0x7f907c009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738a0d1b8a9e9b35 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9056ffd640 1 -- 10.20.193.28:0/428100413 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c016070 con 0x561dcf7b55b0 2026-02-20T03:23:20.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9056ffd640 1 -- 10.20.193.28:0/428100413 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f907c004480 con 0x561dcf7b55b0 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9056ffd640 1 -- 10.20.193.28:0/428100413 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c011af0 con 0x561dcf7b55b0 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- 10.20.193.28:0/428100413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 msgr2=0x561dcf7d4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/428100413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7d4ba0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f907c009590 tx=0x7f907c009a60 comp rx=0 tx=0).stop 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- 10.20.193.28:0/428100413 shutdown_connections 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/428100413 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7ba600 0x561dcf7ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/428100413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7b55b0 0x561dcf7d4ba0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/428100413 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b4c50 0x561dcf7cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- 10.20.193.28:0/428100413 >> 10.20.193.28:0/428100413 conn(0x561dcf7ac2d0 msgr2=0x561dcf7cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- 10.20.193.28:0/428100413 shutdown_connections 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- 10.20.193.28:0/428100413 wait complete. 2026-02-20T03:23:20.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- start start 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 Processor -- start 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b4c50 0x561dcf7d4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b55b0 0x561dcf7d49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f903000e480 con 0x561dcf7ba600 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f903000f8f0 con 0x561dcf7b4c50 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f903000eb50 con 0x561dcf7b55b0 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f908bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f908bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46418/0 (socket says 10.20.193.28:46418) 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f908bfff640 1 -- 10.20.193.28:0/3401191894 learned_addr learned my addr 10.20.193.28:0/3401191894 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f908bfff640 1 -- 10.20.193.28:0/3401191894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b55b0 msgr2=0x561dcf7d49a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f908bfff640 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b55b0 0x561dcf7d49a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f908bfff640 1 -- 10.20.193.28:0/3401191894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b4c50 msgr2=0x561dcf7d4460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f908bfff640 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b4c50 0x561dcf7d4460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f908bfff640 1 -- 10.20.193.28:0/3401191894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf465690 con 0x561dcf7ba600 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f908bfff640 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d10b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f90800074e0 tx=0x7f908004c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2778c64e3663e855 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9054ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9054ff9640 1 -- 10.20.193.28:0/3401191894 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90800078c0 con 0x561dcf7ba600 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9054ff9640 1 -- 10.20.193.28:0/3401191894 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9080047040 con 0x561dcf7ba600 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9054ff9640 1 -- 10.20.193.28:0/3401191894 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90800429b0 con 0x561dcf7ba600 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- 10.20.193.28:0/3401191894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcf6cab70 con 0x561dcf7ba600 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9054ff9640 1 -- 10.20.193.28:0/3401191894 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f9080042b50 con 0x561dcf7ba600 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 10 client.17616 _ll_register_callbacks cb 0x7f90800047f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:20.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- 10.20.193.28:0/3401191894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f907802d070 con 0x561dcf7ba600 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9054ff9640 1 -- 10.20.193.28:0/3401191894 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9080007a60 con 0x561dcf7ba600 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 10 client.17616 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- 10.20.193.28:0/3401191894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561dcf7c7b30 con 0x561dcf7ba600 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9054ff9640 1 -- 10.20.193.28:0/3401191894 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f908005e070 con 0x561dcf7ba600 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 10 client.17616 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 10 client.17616 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 20 client.17616 populate_metadata read hostname 'trial028' 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561dcf845420 0x561dcf8478e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 4 client.17616 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:23:20.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.225+0000 7f9094c0ce00 1 -- 10.20.193.28:0/3401191894 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561dcf4de520 con 0x561dcf845420 2026-02-20T03:23:20.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.243+0000 7f908b7fe640 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561dcf845420 0x561dcf8478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.309+0000 7f9054ff9640 10 client.17616 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:20.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.309+0000 7f908b7fe640 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561dcf845420 0x561dcf8478e0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4f178f73eb612c7 server_cookie=6b9b17f1781736ee in_seq=0 out_seq=0 2026-02-20T03:23:20.448 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:20 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2285183400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:20.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:20 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2285183400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:20.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9054ff9640 1 -- 10.20.193.28:0/3401191894 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561dcf4de520 con 0x561dcf845420 2026-02-20T03:23:20.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9054ff9640 10 client.17616 handle_command_reply: tid=0 2026-02-20T03:23:20.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 client.17616 shutdown 2026-02-20T03:23:20.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 -- 10.20.193.28:0/3401191894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 msgr2=0x561dcf7d10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d10b0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f90800074e0 tx=0x7f908004c470 comp rx=0 tx=0).stop 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 -- 10.20.193.28:0/3401191894 shutdown_connections 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561dcf845420 0x561dcf8478e0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561dcf7ba600 0x561dcf7d10b0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561dcf7b55b0 0x561dcf7d49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 --2- 10.20.193.28:0/3401191894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561dcf7b4c50 0x561dcf7d4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 -- 10.20.193.28:0/3401191894 >> 10.20.193.28:0/3401191894 conn(0x561dcf7ac2d0 msgr2=0x561dcf7cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9054ff9640 0 client.17616 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 -- 10.20.193.28:0/3401191894 shutdown_connections 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 1 -- 10.20.193.28:0/3401191894 wait complete. 2026-02-20T03:23:20.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9094c0ce00 20 client.17616 trim_cache size 0 max 16384 2026-02-20T03:23:20.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:23:20.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:23:20.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:23:20.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:23:20.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9090b20640 1 -- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90600b0d80 msgr2=0x7f90600b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9090b20640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90600b0d80 0x7f90600b3240 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f90800045f0 tx=0x7f9080009de0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9090b20640 1 -- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c109490 msgr2=0x7f908c1a1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.489 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.474+0000 7f9090b20640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c109490 0x7f908c1a1060 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f907800b750 tx=0x7f907800bc20 comp rx=0 tx=0).stop 2026-02-20T03:23:20.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.476+0000 7f9090b20640 1 -- 10.20.193.28:0/1550236770 shutdown_connections 2026-02-20T03:23:20.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.476+0000 7f9090b20640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90600b0d80 0x7f90600b3240 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.476+0000 7f9090b20640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f908c10a900 0x7f908c1a8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.476+0000 7f9090b20640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f908c109e60 0x7f908c1a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.476+0000 7f9090b20640 1 --2- 10.20.193.28:0/1550236770 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f908c109490 0x7f908c1a1060 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.476+0000 7f9090b20640 1 -- 10.20.193.28:0/1550236770 >> 10.20.193.28:0/1550236770 conn(0x7f908c077fe0 msgr2=0x7f908c10d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.476+0000 7f9090b20640 1 -- 10.20.193.28:0/1550236770 shutdown_connections 2026-02-20T03:23:20.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:20.476+0000 7f9090b20640 1 -- 10.20.193.28:0/1550236770 wait complete. 2026-02-20T03:23:20.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 773268 8.73 MB/sec execute 293 sec latency 2453.439 ms 2026-02-20T03:23:20.558 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:20.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:20 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2285183400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:20.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- 10.20.193.28:0/2245541622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 msgr2=0x7f6410111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 --2- 10.20.193.28:0/2245541622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 0x7f6410111850 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f640c00b0d0 tx=0x7f640c02f470 comp rx=0 tx=0).stop 2026-02-20T03:23:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- 10.20.193.28:0/2245541622 shutdown_connections 2026-02-20T03:23:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 --2- 10.20.193.28:0/2245541622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 0x7f6410111850 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 --2- 10.20.193.28:0/2245541622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6410104980 0x7f6410104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 --2- 10.20.193.28:0/2245541622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f641010a980 0x7f641010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- 10.20.193.28:0/2245541622 >> 10.20.193.28:0/2245541622 conn(0x7f6410100680 msgr2=0x7f6410102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- 10.20.193.28:0/2245541622 shutdown_connections 2026-02-20T03:23:20.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- 10.20.193.28:0/2245541622 wait complete. 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 Processor -- start 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- start start 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6410104980 0x7f641019d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 0x7f641019d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f641010a980 0x7f64101a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6410114c90 con 0x7f6410105320 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6410114b10 con 0x7f641010a980 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6410114e10 con 0x7f6410104980 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f6415c4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 0x7f641019d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f6415c4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 0x7f641019d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46436/0 (socket says 10.20.193.28:46436) 2026-02-20T03:23:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f6415c4a640 1 -- 10.20.193.28:0/510272806 learned_addr learned my addr 10.20.193.28:0/510272806 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f6415c4a640 1 -- 10.20.193.28:0/510272806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6410104980 msgr2=0x7f641019d0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f6415c4a640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6410104980 0x7f641019d0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f6415c4a640 1 -- 10.20.193.28:0/510272806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f641010a980 msgr2=0x7f64101a1980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f6415c4a640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f641010a980 0x7f64101a1980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f6415c4a640 1 -- 10.20.193.28:0/510272806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64101a2100 con 0x7f6410105320 2026-02-20T03:23:20.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f6415c4a640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 0x7f641019d5f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f640400b780 tx=0x7f640400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f63f77fe640 1 -- 10.20.193.28:0/510272806 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404004480 con 0x7f6410105320 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f63f77fe640 1 -- 10.20.193.28:0/510272806 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6404010070 con 0x7f6410105320 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f63f77fe640 1 -- 10.20.193.28:0/510272806 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640400ca90 con 0x7f6410105320 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- 10.20.193.28:0/510272806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64101a23f0 con 0x7f6410105320 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.797+0000 7f641744d640 1 -- 10.20.193.28:0/510272806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64101a9c30 con 0x7f6410105320 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f63f77fe640 1 -- 10.20.193.28:0/510272806 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f640401d030 con 0x7f6410105320 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 Processor -- start 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 -- start start 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2fd9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd35e0 0x55a2f2fd3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd3f60 0x55a2f2fdfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a2f2f53e00 con 0x55a2f2fd8fb0 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a2f2f26970 con 0x55a2f2fd3f60 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a2f2ed41f0 con 0x55a2f2fd35e0 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f6416c4c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2fd9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f6416c4c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2fd9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46440/0 (socket says 10.20.193.28:46440) 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f6416c4c640 1 -- 10.20.193.28:0/855144431 learned_addr learned my addr 10.20.193.28:0/855144431 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f6416c4c640 1 -- 10.20.193.28:0/855144431 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd35e0 msgr2=0x55a2f2fd3a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f6416c4c640 1 --2- 10.20.193.28:0/855144431 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd35e0 0x55a2f2fd3a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f6416c4c640 1 -- 10.20.193.28:0/855144431 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd3f60 msgr2=0x55a2f2fdfde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f6416c4c640 1 --2- 10.20.193.28:0/855144431 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd3f60 0x55a2f2fdfde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f6416c4c640 1 -- 10.20.193.28:0/855144431 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f2ee73d0 con 0x55a2f2fd8fb0 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f6416c4c640 1 --2- 10.20.193.28:0/855144431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2fd9390 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f640c009e20 tx=0x7f640c0074c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99862926080e589 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f63f4cf3640 1 -- 10.20.193.28:0/855144431 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c0042e0 con 0x55a2f2fd8fb0 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f63f4cf3640 1 -- 10.20.193.28:0/855144431 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f640c04e070 con 0x55a2f2fd8fb0 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f63f4cf3640 1 -- 10.20.193.28:0/855144431 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c004760 con 0x55a2f2fd8fb0 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f63f77fe640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63ec0b0ea0 0x7f63ec0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f63f77fe640 1 -- 10.20.193.28:0/510272806 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f64040df870 con 0x7f6410105320 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 -- 10.20.193.28:0/855144431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd8fb0 msgr2=0x55a2f2fd9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.803+0000 7f641abdbe00 1 --2- 10.20.193.28:0/855144431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2fd9390 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f640c009e20 tx=0x7f640c0074c0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.806+0000 7f641abdbe00 1 -- 10.20.193.28:0/855144431 shutdown_connections 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.806+0000 7f641abdbe00 1 --2- 10.20.193.28:0/855144431 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd3f60 0x55a2f2fdfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.806+0000 7f641abdbe00 1 --2- 10.20.193.28:0/855144431 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd35e0 0x55a2f2fd3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.806+0000 7f641abdbe00 1 --2- 10.20.193.28:0/855144431 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2fd9390 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.806+0000 7f641abdbe00 1 -- 10.20.193.28:0/855144431 >> 10.20.193.28:0/855144431 conn(0x55a2f2f96240 msgr2=0x55a2f2fd1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.806+0000 7f641644b640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63ec0b0ea0 0x7f63ec0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.806+0000 7f641abdbe00 1 -- 10.20.193.28:0/855144431 shutdown_connections 2026-02-20T03:23:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.806+0000 7f641abdbe00 1 -- 10.20.193.28:0/855144431 wait complete. 2026-02-20T03:23:20.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.806+0000 7f641644b640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63ec0b0ea0 0x7f63ec0b3360 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6400009690 tx=0x7f6400006cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 -- start start 2026-02-20T03:23:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 Processor -- start 2026-02-20T03:23:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd35e0 0x55a2f2ff6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ff6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2ff50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a2f2f228a0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a2f2d14f50 con 0x55a2f2fd8fb0 2026-02-20T03:23:20.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a2f2ff5710 con 0x55a2f2fd35e0 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f6415c4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ff6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f6415c4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ff6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46454/0 (socket says 10.20.193.28:46454) 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f6415c4a640 1 -- 10.20.193.28:0/1188499147 learned_addr learned my addr 10.20.193.28:0/1188499147 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f6415c4a640 1 -- 10.20.193.28:0/1188499147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd35e0 msgr2=0x55a2f2ff6920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f6415c4a640 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd35e0 0x55a2f2ff6920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f6415c4a640 1 -- 10.20.193.28:0/1188499147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd8fb0 msgr2=0x55a2f2ff50d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f6415c4a640 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2ff50d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f6415c4a640 1 -- 10.20.193.28:0/1188499147 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f2fee4e0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f6415c4a640 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ff6e60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f64040a7250 tx=0x7f64040a6d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d164f1cbaeec6e99 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f63dcce3640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f63dcce3640 1 -- 10.20.193.28:0/1188499147 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040b07b0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f63dcce3640 1 -- 10.20.193.28:0/1188499147 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f64040b0530 con 0x55a2f2fd3f60 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f63dcce3640 1 -- 10.20.193.28:0/1188499147 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6404005ac0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 -- 10.20.193.28:0/1188499147 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f2cf7b40 con 0x55a2f2fd3f60 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 10 client.17628 _ll_register_callbacks cb 0x55a2f2f5feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 -- 10.20.193.28:0/1188499147 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a2f2f34150 con 0x55a2f2fd3f60 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f63dcce3640 1 -- 10.20.193.28:0/1188499147 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6404002770 con 0x55a2f2fd3f60 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f63dcce3640 1 -- 10.20.193.28:0/1188499147 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6404005c60 con 0x55a2f2fd3f60 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 10 client.17628 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.807+0000 7f641abdbe00 1 -- 10.20.193.28:0/1188499147 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a2f2ee11e0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.811+0000 7f63dcce3640 1 -- 10.20.193.28:0/1188499147 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f64040a6560 con 0x55a2f2fd3f60 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.811+0000 7f641abdbe00 10 client.17628 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:20.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.811+0000 7f641abdbe00 10 client.17628 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:23:20.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.811+0000 7f641abdbe00 20 client.17628 populate_metadata read hostname 'trial028' 2026-02-20T03:23:20.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.811+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55a2f30051c0 0x55a2f3007680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.811+0000 7f641abdbe00 4 client.17628 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:20.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.811+0000 7f641abdbe00 1 -- 10.20.193.28:0/1188499147 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2f2f2e560 con 0x55a2f30051c0 2026-02-20T03:23:20.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.823+0000 7f641644b640 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55a2f30051c0 0x55a2f3007680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.865+0000 7f641644b640 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55a2f30051c0 0x55a2f3007680 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4fb2d0940a6d5f21 server_cookie=9fb441016760fe4b in_seq=0 out_seq=0 2026-02-20T03:23:20.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.865+0000 7f63dcce3640 10 client.17628 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:23:20.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.878+0000 7f63dcce3640 1 -- 10.20.193.28:0/1188499147 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a2f2f2e560 con 0x55a2f30051c0 2026-02-20T03:23:20.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.878+0000 7f63dcce3640 10 client.17628 handle_command_reply: tid=0 2026-02-20T03:23:20.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 client.17628 shutdown 2026-02-20T03:23:20.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 -- 10.20.193.28:0/1188499147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 msgr2=0x55a2f2ff6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ff6e60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f64040a7250 tx=0x7f64040a6d20 comp rx=0 tx=0).stop 2026-02-20T03:23:20.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 -- 10.20.193.28:0/1188499147 shutdown_connections 2026-02-20T03:23:20.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2ff50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55a2f30051c0 0x55a2f3007680 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ff6e60 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1188499147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd35e0 0x55a2f2ff6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 -- 10.20.193.28:0/1188499147 >> 10.20.193.28:0/1188499147 conn(0x55a2f2f96240 msgr2=0x55a2f2fd23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f63dcce3640 0 client.17628 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:23:20.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 -- 10.20.193.28:0/1188499147 shutdown_connections 2026-02-20T03:23:20.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 1 -- 10.20.193.28:0/1188499147 wait complete. 2026-02-20T03:23:20.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.879+0000 7f641abdbe00 20 client.17628 trim_cache size 0 max 16384 2026-02-20T03:23:20.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 Processor -- start 2026-02-20T03:23:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- start start 2026-02-20T03:23:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd35e0 0x55a2f2fd23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2fd2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd8fb0 0x55a2f300cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63b40126f0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f63b400ffc0 con 0x55a2f2fd35e0 2026-02-20T03:23:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63b400de10 con 0x55a2f2fd8fb0 2026-02-20T03:23:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2fd2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2fd2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46462/0 (socket says 10.20.193.28:46462) 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 -- 10.20.193.28:0/1257992950 learned_addr learned my addr 10.20.193.28:0/1257992950 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 -- 10.20.193.28:0/1257992950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd8fb0 msgr2=0x55a2f300cf90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- 10.20.193.28:0/1257992950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd8fb0 0x55a2f300cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 -- 10.20.193.28:0/1257992950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd35e0 msgr2=0x55a2f2fd23f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- 10.20.193.28:0/1257992950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd35e0 0x55a2f2fd23f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 -- 10.20.193.28:0/1257992950 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f2ff54c0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- 10.20.193.28:0/1257992950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2fd2930 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f64040a74e0 tx=0x7f640400e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7384c368d460f617 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f63d7fff640 1 -- 10.20.193.28:0/1257992950 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040b07b0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f63d7fff640 1 -- 10.20.193.28:0/1257992950 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f64040c6020 con 0x55a2f2fd3f60 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f63d7fff640 1 -- 10.20.193.28:0/1257992950 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040c82d0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- 10.20.193.28:0/1257992950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 msgr2=0x55a2f2fd2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1257992950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2fd2930 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f64040a74e0 tx=0x7f640400e070 comp rx=0 tx=0).stop 2026-02-20T03:23:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- 10.20.193.28:0/1257992950 shutdown_connections 2026-02-20T03:23:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1257992950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd8fb0 0x55a2f300cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1257992950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2fd2930 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- 10.20.193.28:0/1257992950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd35e0 0x55a2f2fd23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- 10.20.193.28:0/1257992950 >> 10.20.193.28:0/1257992950 conn(0x55a2f2f96240 msgr2=0x55a2f2fd1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- 10.20.193.28:0/1257992950 shutdown_connections 2026-02-20T03:23:20.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- 10.20.193.28:0/1257992950 wait complete. 2026-02-20T03:23:20.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- start start 2026-02-20T03:23:20.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 Processor -- start 2026-02-20T03:23:20.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd35e0 0x55a2f2ffb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ffbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2ffc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63b400e480 con 0x55a2f2fd3f60 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f63b400f8f0 con 0x55a2f2fd35e0 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f641abdbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f63b400eb50 con 0x55a2f2fd8fb0 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ffbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ffbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46470/0 (socket says 10.20.193.28:46470) 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 -- 10.20.193.28:0/3801472101 learned_addr learned my addr 10.20.193.28:0/3801472101 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 -- 10.20.193.28:0/3801472101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd8fb0 msgr2=0x55a2f2ffc180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2ffc180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 -- 10.20.193.28:0/3801472101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd35e0 msgr2=0x55a2f2ffb700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd35e0 0x55a2f2ffb700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 -- 10.20.193.28:0/3801472101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f2f7bb70 con 0x55a2f2fd3f60 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f6415c4a640 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ffbc40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6404002410 tx=0x7f64040a6d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2753e8ff4e7c8259 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.885+0000 7f63dcce3640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f63dcce3640 1 -- 10.20.193.28:0/3801472101 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040a38f0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 1 -- 10.20.193.28:0/3801472101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f2ff6490 con 0x55a2f2fd3f60 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f63dcce3640 1 -- 10.20.193.28:0/3801472101 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55a2f2f34150 con 0x55a2f2fd3f60 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f63dcce3640 1 -- 10.20.193.28:0/3801472101 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64040a62e0 con 0x55a2f2fd3f60 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 10 client.17634 _ll_register_callbacks cb 0x7f64040a7320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 1 -- 10.20.193.28:0/3801472101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f640c04e070 con 0x55a2f2fd3f60 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f63dcce3640 1 -- 10.20.193.28:0/3801472101 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f64040aca90 con 0x55a2f2fd3f60 2026-02-20T03:23:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f63dcce3640 1 -- 10.20.193.28:0/3801472101 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6404087050 con 0x55a2f2fd3f60 2026-02-20T03:23:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 10 client.17634 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 1 -- 10.20.193.28:0/3801472101 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a2f2fee310 con 0x55a2f2fd3f60 2026-02-20T03:23:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f63dcce3640 1 -- 10.20.193.28:0/3801472101 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f640408a020 con 0x55a2f2fd3f60 2026-02-20T03:23:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 10 client.17634 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 10 client.17634 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:23:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 20 client.17634 populate_metadata read hostname 'trial028' 2026-02-20T03:23:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55a2f3070f80 0x55a2f3073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 4 client.17634 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:23:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.890+0000 7f641abdbe00 1 -- 10.20.193.28:0/3801472101 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2f2ef77c0 con 0x55a2f3070f80 2026-02-20T03:23:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.906+0000 7f641644b640 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55a2f3070f80 0x55a2f3073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641644b640 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55a2f3070f80 0x55a2f3073440 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a2a10d9f6c9bfb0 server_cookie=ceb9d558d9e79b44 in_seq=0 out_seq=0 2026-02-20T03:23:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f63dcce3640 10 client.17634 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:23:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f63dcce3640 1 -- 10.20.193.28:0/3801472101 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2f2ef77c0 con 0x55a2f3070f80 2026-02-20T03:23:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f63dcce3640 10 client.17634 handle_command_reply: tid=0 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 client.17634 shutdown 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 -- 10.20.193.28:0/3801472101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 msgr2=0x55a2f2ffbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ffbc40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6404002410 tx=0x7f64040a6d20 comp rx=0 tx=0).stop 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 -- 10.20.193.28:0/3801472101 shutdown_connections 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a2f2fd8fb0 0x55a2f2ffc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55a2f3070f80 0x55a2f3073440 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a2f2fd3f60 0x55a2f2ffbc40 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 --2- 10.20.193.28:0/3801472101 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a2f2fd35e0 0x55a2f2ffb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 -- 10.20.193.28:0/3801472101 >> 10.20.193.28:0/3801472101 conn(0x55a2f2f96240 msgr2=0x55a2f2fd23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f63dcce3640 0 client.17634 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 -- 10.20.193.28:0/3801472101 shutdown_connections 2026-02-20T03:23:20.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 1 -- 10.20.193.28:0/3801472101 wait complete. 2026-02-20T03:23:20.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.920+0000 7f641abdbe00 20 client.17634 trim_cache size 0 max 16384 2026-02-20T03:23:20.925 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:23:20.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 -- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63ec0b0ea0 msgr2=0x7f63ec0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63ec0b0ea0 0x7f63ec0b3360 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6400009690 tx=0x7f6400006cc0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 -- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 msgr2=0x7f641019d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:20.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 0x7f641019d5f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f640400b780 tx=0x7f640400bc50 comp rx=0 tx=0).stop 2026-02-20T03:23:20.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 -- 10.20.193.28:0/510272806 shutdown_connections 2026-02-20T03:23:20.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63ec0b0ea0 0x7f63ec0b3360 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f641010a980 0x7f64101a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6410105320 0x7f641019d5f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 --2- 10.20.193.28:0/510272806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6410104980 0x7f641019d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:20.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 -- 10.20.193.28:0/510272806 >> 10.20.193.28:0/510272806 conn(0x7f6410100680 msgr2=0x7f6410100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:20.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 -- 10.20.193.28:0/510272806 shutdown_connections 2026-02-20T03:23:20.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:20.921+0000 7f641744d640 1 -- 10.20.193.28:0/510272806 wait complete. 2026-02-20T03:23:21.066 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:23:21.312 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:21 trial028 ceph-mon[38552]: pgmap v441: 129 pgs: 129 active+clean; 142 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 426 KiB/s rd, 3.0 MiB/s wr, 205 op/s 2026-02-20T03:23:21.395 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:21.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:21 trial177 ceph-mon[43181]: pgmap v441: 129 pgs: 129 active+clean; 142 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 426 KiB/s rd, 3.0 MiB/s wr, 205 op/s 2026-02-20T03:23:21.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 773268 8.70 MB/sec execute 294 sec latency 3453.472 ms 2026-02-20T03:23:21.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:21 trial126 ceph-mon[38476]: pgmap v441: 129 pgs: 129 active+clean; 142 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 426 KiB/s rd, 3.0 MiB/s wr, 205 op/s 2026-02-20T03:23:21.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.786+0000 7f2bc0831640 1 -- 10.20.193.28:0/4045695746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc06f670 msgr2=0x7f2bbc06fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:21.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.786+0000 7f2bc0831640 1 --2- 10.20.193.28:0/4045695746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc06f670 0x7f2bbc06fa50 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009a30 tx=0x7f2bb002f260 comp rx=0 tx=0).stop 2026-02-20T03:23:21.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.786+0000 7f2bc0831640 1 -- 10.20.193.28:0/4045695746 shutdown_connections 2026-02-20T03:23:21.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.786+0000 7f2bc0831640 1 --2- 10.20.193.28:0/4045695746 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bbc10c2e0 0x7f2bbc10cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.786+0000 7f2bc0831640 1 --2- 10.20.193.28:0/4045695746 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bbc070020 0x7f2bbc10bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.786+0000 7f2bc0831640 1 --2- 10.20.193.28:0/4045695746 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc06f670 0x7f2bbc06fa50 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.786+0000 7f2bc0831640 1 -- 10.20.193.28:0/4045695746 >> 10.20.193.28:0/4045695746 conn(0x7f2bbc0740a0 msgr2=0x7f2bbc0744b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:21.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.786+0000 7f2bc0831640 1 -- 10.20.193.28:0/4045695746 shutdown_connections 2026-02-20T03:23:21.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.786+0000 7f2bc0831640 1 -- 10.20.193.28:0/4045695746 wait complete. 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.787+0000 7f2bc0831640 1 Processor -- start 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.787+0000 7f2bc0831640 1 -- start start 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.787+0000 7f2bc0831640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bbc06f670 0x7f2bbc1aa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.787+0000 7f2bc0831640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc070020 0x7f2bbc1aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.787+0000 7f2bc0831640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bbc10c2e0 0x7f2bbc1aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.787+0000 7f2bc0831640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc121be0 con 0x7f2bbc070020 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.787+0000 7f2bc0831640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc121a60 con 0x7f2bbc06f670 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.787+0000 7f2bc0831640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc121d60 con 0x7f2bbc10c2e0 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bba575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc070020 0x7f2bbc1aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bba575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc070020 0x7f2bbc1aa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46488/0 (socket says 10.20.193.28:46488) 2026-02-20T03:23:21.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bba575640 1 -- 10.20.193.28:0/746780505 learned_addr learned my addr 10.20.193.28:0/746780505 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:21.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bba575640 1 -- 10.20.193.28:0/746780505 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bbc10c2e0 msgr2=0x7f2bbc1aea30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:21.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bba575640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bbc10c2e0 0x7f2bbc1aea30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bba575640 1 -- 10.20.193.28:0/746780505 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bbc06f670 msgr2=0x7f2bbc1aa160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:21.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bba575640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bbc06f670 0x7f2bbc1aa160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bba575640 1 -- 10.20.193.28:0/746780505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc1af1b0 con 0x7f2bbc070020 2026-02-20T03:23:21.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bba575640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc070020 0x7f2bbc1aa6a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b570 tx=0x7f2ba400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:21.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2b9bfff640 1 -- 10.20.193.28:0/746780505 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4013020 con 0x7f2bbc070020 2026-02-20T03:23:21.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2b9bfff640 1 -- 10.20.193.28:0/746780505 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2ba4004480 con 0x7f2bbc070020 2026-02-20T03:23:21.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2b9bfff640 1 -- 10.20.193.28:0/746780505 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400fb50 con 0x7f2bbc070020 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bc0831640 1 -- 10.20.193.28:0/746780505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc1af4a0 con 0x7f2bbc070020 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.788+0000 7f2bc0831640 1 -- 10.20.193.28:0/746780505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc1b6ce0 con 0x7f2bbc070020 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.791+0000 7f2b9bfff640 1 -- 10.20.193.28:0/746780505 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2ba4002780 con 0x7f2bbc070020 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.792+0000 7f2bc3537e00 1 Processor -- start 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.792+0000 7f2bc3537e00 1 -- start start 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.792+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542ec5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.792+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 0x563542ebfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.792+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542ecbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.792+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563542e3fe00 con 0x563542ec4fb0 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.792+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563542e12970 con 0x563542ebf5e0 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.792+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563542dc01f0 con 0x563542ebff60 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542ec5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542ec5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46494/0 (socket says 10.20.193.28:46494) 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 -- 10.20.193.28:0/872667870 learned_addr learned my addr 10.20.193.28:0/872667870 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2b9bfff640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b8c0b0e20 0x7f2b8c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2b9bfff640 1 -- 10.20.193.28:0/746780505 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2ba40e0490 con 0x7f2bbc070020 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 -- 10.20.193.28:0/872667870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 msgr2=0x563542ecbde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 --2- 10.20.193.28:0/872667870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542ecbde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 -- 10.20.193.28:0/872667870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 msgr2=0x563542ebfa20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 --2- 10.20.193.28:0/872667870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 0x563542ebfa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 -- 10.20.193.28:0/872667870 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563542dd33d0 con 0x563542ec4fb0 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b8c0b0e20 0x7f2b8c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.793+0000 7f2bbb577640 1 --2- 10.20.193.28:0/872667870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542ec5390 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009db0 tx=0x7f2bac00b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeec079d5823933d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2b937fe640 1 -- 10.20.193.28:0/872667870 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac014030 con 0x563542ec4fb0 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2b937fe640 1 -- 10.20.193.28:0/872667870 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bac00edd0 con 0x563542ec4fb0 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2b937fe640 1 -- 10.20.193.28:0/872667870 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac018710 con 0x563542ec4fb0 2026-02-20T03:23:21.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bc3537e00 1 -- 10.20.193.28:0/872667870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 msgr2=0x563542ec5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/872667870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542ec5390 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009db0 tx=0x7f2bac00b7a0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bbb577640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b8c0b0e20 0x7f2b8c0b32e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2bac01d000 tx=0x7f2bac01a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bc3537e00 1 -- 10.20.193.28:0/872667870 shutdown_connections 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/872667870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542ecbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/872667870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 0x563542ebfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/872667870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542ec5390 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bc3537e00 1 -- 10.20.193.28:0/872667870 >> 10.20.193.28:0/872667870 conn(0x563542e82240 msgr2=0x563542ebdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bc3537e00 1 -- 10.20.193.28:0/872667870 shutdown_connections 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.794+0000 7f2bc3537e00 1 -- 10.20.193.28:0/872667870 wait complete. 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.795+0000 7f2bc3537e00 1 -- start start 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.795+0000 7f2bc3537e00 1 Processor -- start 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebf5e0 0x563542ed9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542eda400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ec4fb0 0x563542ed8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563542e0e8a0 con 0x563542ebf5e0 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563542c00f50 con 0x563542ec4fb0 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563542ed8cb0 con 0x563542ebff60 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bbad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebf5e0 0x563542ed9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bbad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebf5e0 0x563542ed9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46510/0 (socket says 10.20.193.28:46510) 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bbad76640 1 -- 10.20.193.28:0/649778650 learned_addr learned my addr 10.20.193.28:0/649778650 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bba575640 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542eda400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.796+0000 7f2bbb577640 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ec4fb0 0x563542ed8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.797+0000 7f2bbad76640 1 -- 10.20.193.28:0/649778650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 msgr2=0x563542eda400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.797+0000 7f2bbad76640 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542eda400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.797+0000 7f2bbad76640 1 -- 10.20.193.28:0/649778650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ec4fb0 msgr2=0x563542ed8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.797+0000 7f2bbad76640 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ec4fb0 0x563542ed8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.797+0000 7f2bbad76640 1 -- 10.20.193.28:0/649778650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563542ed1ad0 con 0x563542ebf5e0 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.797+0000 7f2bbad76640 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebf5e0 0x563542ed9ec0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0032040 tx=0x7f2bb0009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5c58cde02478d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.797+0000 7f2b90ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2b90ff9640 1 -- 10.20.193.28:0/649778650 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb002fcd0 con 0x563542ebf5e0 2026-02-20T03:23:21.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2b90ff9640 1 -- 10.20.193.28:0/649778650 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bb0033040 con 0x563542ebf5e0 2026-02-20T03:23:21.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2b90ff9640 1 -- 10.20.193.28:0/649778650 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0038aa0 con 0x563542ebf5e0 2026-02-20T03:23:21.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2bc3537e00 1 -- 10.20.193.28:0/649778650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563542be3b40 con 0x563542ebf5e0 2026-02-20T03:23:21.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2bc3537e00 10 client.17646 _ll_register_callbacks cb 0x563542e4beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:21.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2b90ff9640 1 -- 10.20.193.28:0/649778650 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2bb00026e0 con 0x563542ebf5e0 2026-02-20T03:23:21.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2bc3537e00 1 -- 10.20.193.28:0/649778650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563542e20150 con 0x563542ebf5e0 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2b90ff9640 1 -- 10.20.193.28:0/649778650 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2bb00028e0 con 0x563542ebf5e0 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2bc3537e00 10 client.17646 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.798+0000 7f2bc3537e00 1 -- 10.20.193.28:0/649778650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563542dcd1e0 con 0x563542ebf5e0 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.799+0000 7f2b90ff9640 1 -- 10.20.193.28:0/649778650 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2bb004a030 con 0x563542ebf5e0 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.799+0000 7f2bc3537e00 10 client.17646 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.799+0000 7f2bc3537e00 10 client.17646 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.799+0000 7f2bc3537e00 20 client.17646 populate_metadata read hostname 'trial028' 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.799+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x563542ee85a0 0x563542eea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.799+0000 7f2bc3537e00 4 client.17646 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.799+0000 7f2bc3537e00 1 -- 10.20.193.28:0/649778650 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563542e1a560 con 0x563542ee85a0 2026-02-20T03:23:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.810+0000 7f2bba575640 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x563542ee85a0 0x563542eea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.838+0000 7f2bba575640 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x563542ee85a0 0x563542eea9f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=493f5d5d1918e59d server_cookie=1b02917e1f32276d in_seq=0 out_seq=0 2026-02-20T03:23:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.838+0000 7f2b90ff9640 10 client.17646 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:23:21.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.852+0000 7f2b90ff9640 1 -- 10.20.193.28:0/649778650 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563542e1a560 con 0x563542ee85a0 2026-02-20T03:23:21.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.852+0000 7f2b90ff9640 10 client.17646 handle_command_reply: tid=0 2026-02-20T03:23:21.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.852+0000 7f2bc3537e00 1 client.17646 shutdown 2026-02-20T03:23:21.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.852+0000 7f2bc3537e00 1 -- 10.20.193.28:0/649778650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebf5e0 msgr2=0x563542ed9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:21.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.852+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebf5e0 0x563542ed9ec0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0032040 tx=0x7f2bb0009760 comp rx=0 tx=0).stop 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2bc3537e00 1 -- 10.20.193.28:0/649778650 shutdown_connections 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x563542ee85a0 0x563542eea9f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ec4fb0 0x563542ed8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2b90ff9640 0 client.17646 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542eda400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/649778650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebf5e0 0x563542ed9ec0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2bc3537e00 1 -- 10.20.193.28:0/649778650 >> 10.20.193.28:0/649778650 conn(0x563542e82240 msgr2=0x563542ebe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2bc3537e00 1 -- 10.20.193.28:0/649778650 shutdown_connections 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2bc3537e00 1 -- 10.20.193.28:0/649778650 wait complete. 2026-02-20T03:23:21.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.853+0000 7f2bc3537e00 20 client.17646 trim_cache size 0 max 16384 2026-02-20T03:23:21.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bc3537e00 1 Processor -- start 2026-02-20T03:23:21.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bc3537e00 1 -- start start 2026-02-20T03:23:21.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 0x563542ed7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebff60 0x563542ebe4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ec4fb0 0x563542ebea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b600127c0 con 0x563542ebff60 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b60010090 con 0x563542ebf5e0 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6000dee0 con 0x563542ec4fb0 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bba575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebff60 0x563542ebe4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bba575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebff60 0x563542ebe4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46514/0 (socket says 10.20.193.28:46514) 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.860+0000 7f2bba575640 1 -- 10.20.193.28:0/2347855450 learned_addr learned my addr 10.20.193.28:0/2347855450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bba575640 1 -- 10.20.193.28:0/2347855450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ec4fb0 msgr2=0x563542ebea10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bba575640 1 --2- 10.20.193.28:0/2347855450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ec4fb0 0x563542ebea10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bba575640 1 -- 10.20.193.28:0/2347855450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 msgr2=0x563542ed7490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bba575640 1 --2- 10.20.193.28:0/2347855450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 0x563542ed7490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bba575640 1 -- 10.20.193.28:0/2347855450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563542ed1900 con 0x563542ebff60 2026-02-20T03:23:21.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bba575640 1 --2- 10.20.193.28:0/2347855450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebff60 0x563542ebe4d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40094b0 tx=0x7f2ba40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1347a0ceb9febe44 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:21.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2b92ffd640 1 -- 10.20.193.28:0/2347855450 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40ddc10 con 0x563542ebff60 2026-02-20T03:23:21.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2b92ffd640 1 -- 10.20.193.28:0/2347855450 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2ba4002d40 con 0x563542ebff60 2026-02-20T03:23:21.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2b92ffd640 1 -- 10.20.193.28:0/2347855450 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba40a3890 con 0x563542ebff60 2026-02-20T03:23:21.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2347855450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebff60 msgr2=0x563542ebe4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:21.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2347855450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebff60 0x563542ebe4d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40094b0 tx=0x7f2ba40047e0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2347855450 shutdown_connections 2026-02-20T03:23:21.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2347855450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ec4fb0 0x563542ebea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2347855450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ebff60 0x563542ebe4d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2347855450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 0x563542ed7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.861+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2347855450 >> 10.20.193.28:0/2347855450 conn(0x563542e82240 msgr2=0x563542ed6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.862+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2347855450 shutdown_connections 2026-02-20T03:23:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.862+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2347855450 wait complete. 2026-02-20T03:23:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.862+0000 7f2bc3537e00 1 -- start start 2026-02-20T03:23:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.862+0000 7f2bc3537e00 1 Processor -- start 2026-02-20T03:23:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 0x563542edcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542edd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bc3537e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542edd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6000e550 con 0x563542ec4fb0 2026-02-20T03:23:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6000f9c0 con 0x563542ebf5e0 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bc3537e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6000ec20 con 0x563542ebff60 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bbb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542edd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bbb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542edd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46522/0 (socket says 10.20.193.28:46522) 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bbb577640 1 -- 10.20.193.28:0/2547216721 learned_addr learned my addr 10.20.193.28:0/2547216721 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bbb577640 1 -- 10.20.193.28:0/2547216721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 msgr2=0x563542edd2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bbb577640 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542edd2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bbb577640 1 -- 10.20.193.28:0/2547216721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 msgr2=0x563542edcd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bbb577640 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 0x563542edcd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bbb577640 1 -- 10.20.193.28:0/2547216721 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563542af1870 con 0x563542ec4fb0 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2bbb577640 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542edd810 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009fd0 tx=0x7f2bac0096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0932709979cdb2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.863+0000 7f2b90ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2b90ff9640 1 -- 10.20.193.28:0/2547216721 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac014050 con 0x563542ec4fb0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2b90ff9640 1 -- 10.20.193.28:0/2547216721 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bac015040 con 0x563542ec4fb0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2b90ff9640 1 -- 10.20.193.28:0/2547216721 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac00c840 con 0x563542ec4fb0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2547216721 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563542db23f0 con 0x563542ec4fb0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2b90ff9640 1 -- 10.20.193.28:0/2547216721 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2bac00c9e0 con 0x563542ec4fb0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2bc3537e00 10 client.17652 _ll_register_callbacks cb 0x7f2bb0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2547216721 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ba4002d40 con 0x563542ec4fb0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2b90ff9640 1 -- 10.20.193.28:0/2547216721 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2bac00cbe0 con 0x563542ec4fb0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2bc3537e00 10 client.17652 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2547216721 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x563542ed25f0 con 0x563542ec4fb0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2b90ff9640 1 -- 10.20.193.28:0/2547216721 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2bac00e8b0 con 0x563542ec4fb0 2026-02-20T03:23:21.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2bc3537e00 10 client.17652 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2bc3537e00 10 client.17652 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:23:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2bc3537e00 20 client.17652 populate_metadata read hostname 'trial028' 2026-02-20T03:23:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.864+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x563542ee85a0 0x563542f56810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.865+0000 7f2bc3537e00 4 client.17652 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:23:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.865+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2547216721 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563542e1a560 con 0x563542ee85a0 2026-02-20T03:23:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.866+0000 7f2bbad76640 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x563542ee85a0 0x563542f56810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:21.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.881+0000 7f2bbad76640 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x563542ee85a0 0x563542f56810 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24e9f4f7e3fc1f34 server_cookie=552057e928570244 in_seq=0 out_seq=0 2026-02-20T03:23:21.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.881+0000 7f2b90ff9640 10 client.17652 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:23:21.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.881+0000 7f2b90ff9640 1 -- 10.20.193.28:0/2547216721 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563542e1a560 con 0x563542ee85a0 2026-02-20T03:23:21.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.881+0000 7f2b90ff9640 10 client.17652 handle_command_reply: tid=0 2026-02-20T03:23:21.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.881+0000 7f2bc3537e00 1 client.17652 shutdown 2026-02-20T03:23:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.882+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2547216721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 msgr2=0x563542edd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.882+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542edd810 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009fd0 tx=0x7f2bac0096a0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2547216721 shutdown_connections 2026-02-20T03:23:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x563542ee85a0 0x563542f56810 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563542ec4fb0 0x563542edd810 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563542ebff60 0x563542edd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2bc3537e00 1 --2- 10.20.193.28:0/2547216721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563542ebf5e0 0x563542edcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2547216721 >> 10.20.193.28:0/2547216721 conn(0x563542e82240 msgr2=0x563542ed75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2b90ff9640 0 client.17652 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:23:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2547216721 shutdown_connections 2026-02-20T03:23:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2bc3537e00 1 -- 10.20.193.28:0/2547216721 wait complete. 2026-02-20T03:23:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.883+0000 7f2bc3537e00 20 client.17652 trim_cache size 0 max 16384 2026-02-20T03:23:21.887 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:23:21.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 -- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b8c0b0e20 msgr2=0x7f2b8c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:21.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b8c0b0e20 0x7f2b8c0b32e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2bac01d000 tx=0x7f2bac01a000 comp rx=0 tx=0).stop 2026-02-20T03:23:21.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 -- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc070020 msgr2=0x7f2bbc1aa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:21.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc070020 0x7f2bbc1aa6a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b570 tx=0x7f2ba400ba40 comp rx=0 tx=0).stop 2026-02-20T03:23:21.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 -- 10.20.193.28:0/746780505 shutdown_connections 2026-02-20T03:23:21.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b8c0b0e20 0x7f2b8c0b32e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bbc10c2e0 0x7f2bbc1aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bbc070020 0x7f2bbc1aa6a0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 --2- 10.20.193.28:0/746780505 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bbc06f670 0x7f2bbc1aa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:21.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.884+0000 7f2bc0831640 1 -- 10.20.193.28:0/746780505 >> 10.20.193.28:0/746780505 conn(0x7f2bbc0740a0 msgr2=0x7f2bbc10fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:21.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.885+0000 7f2bc0831640 1 -- 10.20.193.28:0/746780505 shutdown_connections 2026-02-20T03:23:21.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:21.885+0000 7f2bc0831640 1 -- 10.20.193.28:0/746780505 wait complete. 2026-02-20T03:23:22.079 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:23:22.361 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:22.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 773838 8.68 MB/sec execute 295 sec latency 3825.473 ms 2026-02-20T03:23:22.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- 10.20.193.28:0/1022922475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e810eef0 msgr2=0x7f04e810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:22.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 --2- 10.20.193.28:0/1022922475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e810eef0 0x7f04e810f2d0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009a30 tx=0x7f04d802f260 comp rx=0 tx=0).stop 2026-02-20T03:23:22.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- 10.20.193.28:0/1022922475 shutdown_connections 2026-02-20T03:23:22.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 --2- 10.20.193.28:0/1022922475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f04e8109ba0 0x7f04e8115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 --2- 10.20.193.28:0/1022922475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f04e8109220 0x7f04e8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 --2- 10.20.193.28:0/1022922475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e810eef0 0x7f04e810f2d0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- 10.20.193.28:0/1022922475 >> 10.20.193.28:0/1022922475 conn(0x7f04e8078600 msgr2=0x7f04e807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- 10.20.193.28:0/1022922475 shutdown_connections 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- 10.20.193.28:0/1022922475 wait complete. 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 Processor -- start 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- start start 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e8109220 0x7f04e81a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f04e8109ba0 0x7f04e81a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f04e810eef0 0x7f04e81a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f04e81191b0 con 0x7f04e8109220 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8119030 con 0x7f04e8109ba0 2026-02-20T03:23:22.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8119330 con 0x7f04e810eef0 2026-02-20T03:23:22.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ed13f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e8109220 0x7f04e81a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:22.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ed13f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e8109220 0x7f04e81a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46536/0 (socket says 10.20.193.28:46536) 2026-02-20T03:23:22.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ed13f640 1 -- 10.20.193.28:0/4276192448 learned_addr learned my addr 10.20.193.28:0/4276192448 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:22.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ed13f640 1 -- 10.20.193.28:0/4276192448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f04e810eef0 msgr2=0x7f04e81a6000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ed13f640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f04e810eef0 0x7f04e81a6000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ed13f640 1 -- 10.20.193.28:0/4276192448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f04e8109ba0 msgr2=0x7f04e81a1c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ed13f640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f04e8109ba0 0x7f04e81a1c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ed13f640 1 -- 10.20.193.28:0/4276192448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e81a6780 con 0x7f04e8109220 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ed13f640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e8109220 0x7f04e81a1730 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009950 tx=0x7f04d8002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04d67fc640 1 -- 10.20.193.28:0/4276192448 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8002a00 con 0x7f04e8109220 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04d67fc640 1 -- 10.20.193.28:0/4276192448 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f04d8005030 con 0x7f04e8109220 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04d67fc640 1 -- 10.20.193.28:0/4276192448 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8004d80 con 0x7f04e8109220 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- 10.20.193.28:0/4276192448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e81a6a10 con 0x7f04e8109220 2026-02-20T03:23:22.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.602+0000 7f04ee141640 1 -- 10.20.193.28:0/4276192448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e81ae2b0 con 0x7f04e8109220 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 Processor -- start 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- start start 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3c1fb0 0x55988f3c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3bc5e0 0x55988f3bca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55988f33ce00 con 0x55988f3bcf60 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55988f30f970 con 0x55988f3bc5e0 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55988f2bd1f0 con 0x55988f3c1fb0 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ec93e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ec93e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46540/0 (socket says 10.20.193.28:46540) 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ec93e640 1 -- 10.20.193.28:0/571621097 learned_addr learned my addr 10.20.193.28:0/571621097 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:22.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ec93e640 1 -- 10.20.193.28:0/571621097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3c1fb0 msgr2=0x55988f3c2390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ec93e640 1 --2- 10.20.193.28:0/571621097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3c1fb0 0x55988f3c2390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ec93e640 1 -- 10.20.193.28:0/571621097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3bc5e0 msgr2=0x55988f3bca20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:23:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ec93e640 1 --2- 10.20.193.28:0/571621097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3bc5e0 0x55988f3bca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ec93e640 1 -- 10.20.193.28:0/571621097 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988f2d03d0 con 0x55988f3bcf60 2026-02-20T03:23:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ec93e640 1 --2- 10.20.193.28:0/571621097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3c8de0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009840 tx=0x7f04dc009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e200fb25d4da41f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04b5ce5640 1 -- 10.20.193.28:0/571621097 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc016070 con 0x55988f3bcf60 2026-02-20T03:23:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04b5ce5640 1 -- 10.20.193.28:0/571621097 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f04dc004480 con 0x55988f3bcf60 2026-02-20T03:23:22.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04b5ce5640 1 -- 10.20.193.28:0/571621097 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc00bd80 con 0x55988f3bcf60 2026-02-20T03:23:22.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04d67fc640 1 -- 10.20.193.28:0/4276192448 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f04d804b060 con 0x7f04e8109220 2026-02-20T03:23:22.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- 10.20.193.28:0/571621097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 msgr2=0x55988f3c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:22.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/571621097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3c8de0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009840 tx=0x7f04dc009d10 comp rx=0 tx=0).stop 2026-02-20T03:23:22.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- 10.20.193.28:0/571621097 shutdown_connections 2026-02-20T03:23:22.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/571621097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3c8de0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/571621097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3bc5e0 0x55988f3bca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/571621097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3c1fb0 0x55988f3c2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- 10.20.193.28:0/571621097 >> 10.20.193.28:0/571621097 conn(0x55988f37f240 msgr2=0x55988f3bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- 10.20.193.28:0/571621097 shutdown_connections 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- 10.20.193.28:0/571621097 wait complete. 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04d67fc640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04c40b0d80 0x7f04c40b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04d67fc640 1 -- 10.20.193.28:0/4276192448 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f04d8104cb0 con 0x7f04e8109220 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 -- start start 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04ed940640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04c40b0d80 0x7f04c40b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.608+0000 7f04f18cfe00 1 Processor -- start 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ed940640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04c40b0d80 0x7f04c40b3240 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f04e400aab0 tx=0x7f04e4009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bc5e0 0x55988f3d6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3d7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3c1fb0 0x55988f3d5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55988f30b8a0 con 0x55988f3bcf60 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55988f0fdf50 con 0x55988f3c1fb0 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55988f3d5af0 con 0x55988f3bc5e0 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ec93e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3d7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ec93e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3d7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46544/0 (socket says 10.20.193.28:46544) 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ec93e640 1 -- 10.20.193.28:0/798252842 learned_addr learned my addr 10.20.193.28:0/798252842 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ec93e640 1 -- 10.20.193.28:0/798252842 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bc5e0 msgr2=0x55988f3d6c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ec93e640 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bc5e0 0x55988f3d6c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ec93e640 1 -- 10.20.193.28:0/798252842 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3c1fb0 msgr2=0x55988f3d5370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ec93e640 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3c1fb0 0x55988f3d5370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ec93e640 1 -- 10.20.193.28:0/798252842 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988f3ceb20 con 0x55988f3bcf60 2026-02-20T03:23:22.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04ec93e640 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3d7170 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f04dc002410 tx=0x7f04dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243a765ae3772e1e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:22.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04a2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:22.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04a2ffd640 1 -- 10.20.193.28:0/798252842 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc016040 con 0x55988f3bcf60 2026-02-20T03:23:22.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04a2ffd640 1 -- 10.20.193.28:0/798252842 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f04dc002c20 con 0x55988f3bcf60 2026-02-20T03:23:22.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04a2ffd640 1 -- 10.20.193.28:0/798252842 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc011b80 con 0x55988f3bcf60 2026-02-20T03:23:22.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 -- 10.20.193.28:0/798252842 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988f0e0b40 con 0x55988f3bcf60 2026-02-20T03:23:22.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 10 client.17664 _ll_register_callbacks cb 0x55988f348eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:22.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 -- 10.20.193.28:0/798252842 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55988f31d150 con 0x55988f3bcf60 2026-02-20T03:23:22.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04a2ffd640 1 -- 10.20.193.28:0/798252842 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f04dc011d20 con 0x55988f3bcf60 2026-02-20T03:23:22.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04a2ffd640 1 -- 10.20.193.28:0/798252842 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f04dc027060 con 0x55988f3bcf60 2026-02-20T03:23:22.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 10 client.17664 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:22.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 -- 10.20.193.28:0/798252842 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55988f2ca1e0 con 0x55988f3bcf60 2026-02-20T03:23:22.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04a2ffd640 1 -- 10.20.193.28:0/798252842 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f04dc002780 con 0x55988f3bcf60 2026-02-20T03:23:22.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 10 client.17664 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:22.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 10 client.17664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:22.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 20 client.17664 populate_metadata read hostname 'trial028' 2026-02-20T03:23:22.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55988f3e53a0 0x55988f3e7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 4 client.17664 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:22.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.612+0000 7f04f18cfe00 1 -- 10.20.193.28:0/798252842 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55988f317560 con 0x55988f3e53a0 2026-02-20T03:23:22.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.639+0000 7f04ed13f640 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55988f3e53a0 0x55988f3e7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.706+0000 7f04ed13f640 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55988f3e53a0 0x55988f3e7790 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34392f46dbb9b864 server_cookie=1b49f8d5bdb7cd81 in_seq=0 out_seq=0 2026-02-20T03:23:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.706+0000 7f04a2ffd640 10 client.17664 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04a2ffd640 1 -- 10.20.193.28:0/798252842 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55988f317560 con 0x55988f3e53a0 2026-02-20T03:23:22.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04a2ffd640 10 client.17664 handle_command_reply: tid=0 2026-02-20T03:23:22.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 client.17664 shutdown 2026-02-20T03:23:22.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 -- 10.20.193.28:0/798252842 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 msgr2=0x55988f3d7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:22.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3d7170 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f04dc002410 tx=0x7f04dc00bea0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 -- 10.20.193.28:0/798252842 shutdown_connections 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55988f3e53a0 0x55988f3e7790 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3c1fb0 0x55988f3d5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bcf60 0x55988f3d7170 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/798252842 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bc5e0 0x55988f3d6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 -- 10.20.193.28:0/798252842 >> 10.20.193.28:0/798252842 conn(0x55988f37f240 msgr2=0x55988f3bb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04a2ffd640 0 client.17664 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.719+0000 7f04f18cfe00 1 -- 10.20.193.28:0/798252842 shutdown_connections 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.720+0000 7f04f18cfe00 1 -- 10.20.193.28:0/798252842 wait complete. 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.720+0000 7f04f18cfe00 20 client.17664 trim_cache size 0 max 16384 2026-02-20T03:23:22.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 Processor -- start 2026-02-20T03:23:22.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- start start 2026-02-20T03:23:22.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f37f240 0x55988f3d2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bc5e0 0x55988f3d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bcf60 0x55988f3ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0494012770 con 0x55988f3bc5e0 2026-02-20T03:23:22.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0494010040 con 0x55988f37f240 2026-02-20T03:23:22.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f049400de90 con 0x55988f3bcf60 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ec93e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bc5e0 0x55988f3d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ec93e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bc5e0 0x55988f3d2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46560/0 (socket says 10.20.193.28:46560) 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ec93e640 1 -- 10.20.193.28:0/265357407 learned_addr learned my addr 10.20.193.28:0/265357407 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ec93e640 1 -- 10.20.193.28:0/265357407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bcf60 msgr2=0x55988f3ecfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ec93e640 1 --2- 10.20.193.28:0/265357407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bcf60 0x55988f3ecfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ec93e640 1 -- 10.20.193.28:0/265357407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f37f240 msgr2=0x55988f3d2940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ec93e640 1 --2- 10.20.193.28:0/265357407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f37f240 0x55988f3d2940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ec93e640 1 -- 10.20.193.28:0/265357407 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988f3ce950 con 0x55988f3bc5e0 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ec93e640 1 --2- 10.20.193.28:0/265357407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bc5e0 0x55988f3d2e80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0026b0 tx=0x7f04dc025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c69cda9bad58b11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04b54e4640 1 -- 10.20.193.28:0/265357407 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc016070 con 0x55988f3bc5e0 2026-02-20T03:23:22.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04b54e4640 1 -- 10.20.193.28:0/265357407 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55988f31d150 con 0x55988f3bc5e0 2026-02-20T03:23:22.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04b54e4640 1 -- 10.20.193.28:0/265357407 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04dc011b50 con 0x55988f3bc5e0 2026-02-20T03:23:22.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- 10.20.193.28:0/265357407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bc5e0 msgr2=0x55988f3d2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:22.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/265357407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bc5e0 0x55988f3d2e80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0026b0 tx=0x7f04dc025000 comp rx=0 tx=0).stop 2026-02-20T03:23:22.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- 10.20.193.28:0/265357407 shutdown_connections 2026-02-20T03:23:22.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/265357407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bcf60 0x55988f3ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/265357407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f3bc5e0 0x55988f3d2e80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/265357407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f37f240 0x55988f3d2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- 10.20.193.28:0/265357407 >> 10.20.193.28:0/265357407 conn(0x55988f3c0030 msgr2=0x55988f3d42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- 10.20.193.28:0/265357407 shutdown_connections 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- 10.20.193.28:0/265357407 wait complete. 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- start start 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 Processor -- start 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f37f240 0x55988f3d9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3bc5e0 0x55988f3da080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bcf60 0x55988f3da5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f049400e500 con 0x55988f37f240 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f049400f970 con 0x55988f3bc5e0 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f049400ebd0 con 0x55988f3bcf60 2026-02-20T03:23:22.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ed13f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f37f240 0x55988f3d9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ed13f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f37f240 0x55988f3d9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46574/0 (socket says 10.20.193.28:46574) 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ed13f640 1 -- 10.20.193.28:0/504759497 learned_addr learned my addr 10.20.193.28:0/504759497 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ed13f640 1 -- 10.20.193.28:0/504759497 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bcf60 msgr2=0x55988f3da5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ed13f640 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bcf60 0x55988f3da5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ed13f640 1 -- 10.20.193.28:0/504759497 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3bc5e0 msgr2=0x55988f3da080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ed13f640 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3bc5e0 0x55988f3da080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ed13f640 1 -- 10.20.193.28:0/504759497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55988efee870 con 0x55988f37f240 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04ed13f640 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f37f240 0x55988f3d9b40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f04d80c99b0 tx=0x7f04d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60f8e82b66f54df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04a2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04a2ffd640 1 -- 10.20.193.28:0/504759497 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d8048040 con 0x55988f37f240 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04a2ffd640 1 -- 10.20.193.28:0/504759497 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f04d8033030 con 0x55988f37f240 2026-02-20T03:23:22.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04a2ffd640 1 -- 10.20.193.28:0/504759497 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d80d5760 con 0x55988f37f240 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- 10.20.193.28:0/504759497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55988f2af3f0 con 0x55988f37f240 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04a2ffd640 1 -- 10.20.193.28:0/504759497 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f04d80d5920 con 0x55988f37f240 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04a2ffd640 10 client.17670 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 10 client.17670 _ll_register_callbacks cb 0x7f04dc014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- 10.20.193.28:0/504759497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55988f2e07c0 con 0x55988f37f240 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04a2ffd640 1 -- 10.20.193.28:0/504759497 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f04d80c89d0 con 0x55988f37f240 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 10 client.17670 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- 10.20.193.28:0/504759497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55988f3cf640 con 0x55988f37f240 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04a2ffd640 1 -- 10.20.193.28:0/504759497 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f04d8004280 con 0x55988f37f240 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 10 client.17670 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 10 client.17670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 20 client.17670 populate_metadata read hostname 'trial028' 2026-02-20T03:23:22.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55988f3c1fb0 0x55988f453960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:22.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 4 client.17670 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:23:22.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.727+0000 7f04f18cfe00 1 -- 10.20.193.28:0/504759497 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55988f2c1ab0 con 0x55988f3c1fb0 2026-02-20T03:23:22.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.746+0000 7f04ec93e640 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55988f3c1fb0 0x55988f453960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:22.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04ec93e640 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55988f3c1fb0 0x55988f453960 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cacdbe89e81e68c server_cookie=bad82f0922924218 in_seq=0 out_seq=0 2026-02-20T03:23:22.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04a2ffd640 10 client.17670 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:22.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04a2ffd640 1 -- 10.20.193.28:0/504759497 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55988f2c1ab0 con 0x55988f3c1fb0 2026-02-20T03:23:22.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04a2ffd640 10 client.17670 handle_command_reply: tid=0 2026-02-20T03:23:22.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04f18cfe00 1 client.17670 shutdown 2026-02-20T03:23:22.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04f18cfe00 1 -- 10.20.193.28:0/504759497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f37f240 msgr2=0x55988f3d9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:22.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f37f240 0x55988f3d9b40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f04d80c99b0 tx=0x7f04d80047c0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04f18cfe00 1 -- 10.20.193.28:0/504759497 shutdown_connections 2026-02-20T03:23:22.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55988f3c1fb0 0x55988f453960 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55988f3bcf60 0x55988f3da5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55988f3bc5e0 0x55988f3da080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04f18cfe00 1 --2- 10.20.193.28:0/504759497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55988f37f240 0x55988f3d9b40 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.774+0000 7f04f18cfe00 1 -- 10.20.193.28:0/504759497 >> 10.20.193.28:0/504759497 conn(0x55988f3c0030 msgr2=0x55988f3e5780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:22.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.776+0000 7f04a2ffd640 0 client.17670 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:22.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.776+0000 7f04f18cfe00 1 -- 10.20.193.28:0/504759497 shutdown_connections 2026-02-20T03:23:22.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.776+0000 7f04f18cfe00 1 -- 10.20.193.28:0/504759497 wait complete. 2026-02-20T03:23:22.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.776+0000 7f04f18cfe00 20 client.17670 trim_cache size 0 max 16384 2026-02-20T03:23:22.790 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:23:22.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 -- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04c40b0d80 msgr2=0x7f04c40b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:22.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04c40b0d80 0x7f04c40b3240 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f04e400aab0 tx=0x7f04e4009250 comp rx=0 tx=0).stop 2026-02-20T03:23:22.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 -- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e8109220 msgr2=0x7f04e81a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:22.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e8109220 0x7f04e81a1730 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009950 tx=0x7f04d8002910 comp rx=0 tx=0).stop 2026-02-20T03:23:22.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 -- 10.20.193.28:0/4276192448 shutdown_connections 2026-02-20T03:23:22.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f04c40b0d80 0x7f04c40b3240 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f04e810eef0 0x7f04e81a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f04e8109ba0 0x7f04e81a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 --2- 10.20.193.28:0/4276192448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f04e8109220 0x7f04e81a1730 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:22.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 -- 10.20.193.28:0/4276192448 >> 10.20.193.28:0/4276192448 conn(0x7f04e8078600 msgr2=0x7f04e807a080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:22.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 -- 10.20.193.28:0/4276192448 shutdown_connections 2026-02-20T03:23:22.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:22.777+0000 7f04ee141640 1 -- 10.20.193.28:0/4276192448 wait complete. 2026-02-20T03:23:23.443 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:23 trial028 ceph-mon[38552]: pgmap v442: 129 pgs: 129 active+clean; 142 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 384 KiB/s rd, 2.8 MiB/s wr, 168 op/s 2026-02-20T03:23:23.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 773838 8.65 MB/sec execute 296 sec latency 1296.397 ms 2026-02-20T03:23:23.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:23 trial126 ceph-mon[38476]: pgmap v442: 129 pgs: 129 active+clean; 142 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 384 KiB/s rd, 2.8 MiB/s wr, 168 op/s 2026-02-20T03:23:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:23 trial177 ceph-mon[43181]: pgmap v442: 129 pgs: 129 active+clean; 142 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 384 KiB/s rd, 2.8 MiB/s wr, 168 op/s 2026-02-20T03:23:23.925 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:23:23.926 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:23:24.210 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:24.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- 10.20.193.28:0/947078792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230105320 msgr2=0x7f1230111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:24.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 --2- 10.20.193.28:0/947078792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230105320 0x7f1230111850 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f122c00b0d0 tx=0x7f122c02f490 comp rx=0 tx=0).stop 2026-02-20T03:23:24.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- 10.20.193.28:0/947078792 shutdown_connections 2026-02-20T03:23:24.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 --2- 10.20.193.28:0/947078792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230105320 0x7f1230111850 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 --2- 10.20.193.28:0/947078792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1230104980 0x7f1230104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 --2- 10.20.193.28:0/947078792 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f123010a980 0x7f123010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- 10.20.193.28:0/947078792 >> 10.20.193.28:0/947078792 conn(0x7f1230100680 msgr2=0x7f1230102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:24.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- 10.20.193.28:0/947078792 shutdown_connections 2026-02-20T03:23:24.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- 10.20.193.28:0/947078792 wait complete. 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 Processor -- start 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- start start 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230104980 0x7f123019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1230105320 0x7f123019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010a980 0x7f12301a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1230114cd0 con 0x7f1230104980 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1230114b50 con 0x7f1230105320 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1230114e50 con 0x7f123010a980 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1235ecc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230104980 0x7f123019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1235ecc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230104980 0x7f123019d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46594/0 (socket says 10.20.193.28:46594) 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1235ecc640 1 -- 10.20.193.28:0/2565745489 learned_addr learned my addr 10.20.193.28:0/2565745489 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1235ecc640 1 -- 10.20.193.28:0/2565745489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010a980 msgr2=0x7f12301a1a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1235ecc640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010a980 0x7f12301a1a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1235ecc640 1 -- 10.20.193.28:0/2565745489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1230105320 msgr2=0x7f123019d6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1235ecc640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1230105320 0x7f123019d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1235ecc640 1 -- 10.20.193.28:0/2565745489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12301a2200 con 0x7f1230104980 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1235ecc640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230104980 0x7f123019d1b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f122000b570 tx=0x7f122000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f121effd640 1 -- 10.20.193.28:0/2565745489 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220013020 con 0x7f1230104980 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f121effd640 1 -- 10.20.193.28:0/2565745489 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1220004480 con 0x7f1230104980 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f121effd640 1 -- 10.20.193.28:0/2565745489 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122000fb50 con 0x7f1230104980 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- 10.20.193.28:0/2565745489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12301a24f0 con 0x7f1230104980 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.464+0000 7f1236ece640 1 -- 10.20.193.28:0/2565745489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12301a9d30 con 0x7f1230104980 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f121effd640 1 -- 10.20.193.28:0/2565745489 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1220002780 con 0x7f1230104980 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 Processor -- start 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 -- start start 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4340eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4341480 0x55bba4344f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4345570 0x55bba43459e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bba428ac00 con 0x55bba4340ad0 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bba42383c0 con 0x55bba4341480 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bba4286b30 con 0x55bba4345570 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f12366cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4340eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f12366cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4340eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46596/0 (socket says 10.20.193.28:46596) 2026-02-20T03:23:24.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f12366cd640 1 -- 10.20.193.28:0/314554055 learned_addr learned my addr 10.20.193.28:0/314554055 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f12366cd640 1 -- 10.20.193.28:0/314554055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4345570 msgr2=0x55bba43459e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f12366cd640 1 --2- 10.20.193.28:0/314554055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4345570 0x55bba43459e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f12366cd640 1 -- 10.20.193.28:0/314554055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4341480 msgr2=0x55bba4344f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f12366cd640 1 --2- 10.20.193.28:0/314554055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4341480 0x55bba4344f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f12366cd640 1 -- 10.20.193.28:0/314554055 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bba4231840 con 0x55bba4340ad0 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f121effd640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f120c0b0e20 0x7f120c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f12366cd640 1 --2- 10.20.193.28:0/314554055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4340eb0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f122c009d70 tx=0x7f122c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01d3de1df2251d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f121effd640 1 -- 10.20.193.28:0/2565745489 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f12200e0550 con 0x7f1230104980 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f11fe4e6640 1 -- 10.20.193.28:0/314554055 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c004b40 con 0x55bba4340ad0 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f11fe4e6640 1 -- 10.20.193.28:0/314554055 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f122c033030 con 0x55bba4340ad0 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f1235ecc640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f120c0b0e20 0x7f120c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f11fe4e6640 1 -- 10.20.193.28:0/314554055 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c0078c0 con 0x55bba4340ad0 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 -- 10.20.193.28:0/314554055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 msgr2=0x55bba4340eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.470+0000 7f123a65ce00 1 --2- 10.20.193.28:0/314554055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4340eb0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f122c009d70 tx=0x7f122c009da0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f1235ecc640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f120c0b0e20 0x7f120c0b32e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1220002410 tx=0x7f1220004850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- 10.20.193.28:0/314554055 shutdown_connections 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 --2- 10.20.193.28:0/314554055 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4345570 0x55bba43459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 --2- 10.20.193.28:0/314554055 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4341480 0x55bba4344f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 --2- 10.20.193.28:0/314554055 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4340eb0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- 10.20.193.28:0/314554055 >> 10.20.193.28:0/314554055 conn(0x55bba4330b60 msgr2=0x55bba43365e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:24.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- 10.20.193.28:0/314554055 shutdown_connections 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- 10.20.193.28:0/314554055 wait complete. 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- start start 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 Processor -- start 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba435ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4341480 0x55bba435b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4345570 0x55bba4359630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bba42321a0 con 0x55bba4340ad0 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bba434d720 con 0x55bba4341480 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bba4359c70 con 0x55bba4345570 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f12366cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba435ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f12366cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba435ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46604/0 (socket says 10.20.193.28:46604) 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f12366cd640 1 -- 10.20.193.28:0/543656991 learned_addr learned my addr 10.20.193.28:0/543656991 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f12366cd640 1 -- 10.20.193.28:0/543656991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4345570 msgr2=0x55bba4359630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f12366cd640 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4345570 0x55bba4359630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f12366cd640 1 -- 10.20.193.28:0/543656991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4341480 msgr2=0x55bba435b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:24.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f12366cd640 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4341480 0x55bba435b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f12366cd640 1 -- 10.20.193.28:0/543656991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bba4353040 con 0x55bba4340ad0 2026-02-20T03:23:24.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f12366cd640 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba435ae80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f122c02f4d0 tx=0x7f122c02fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7778fc0f71f68dc6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:24.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f11e77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f11e77fe640 1 -- 10.20.193.28:0/543656991 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c0093d0 con 0x55bba4340ad0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f11e77fe640 1 -- 10.20.193.28:0/543656991 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f122c0090d0 con 0x55bba4340ad0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- 10.20.193.28:0/543656991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bba4059b60 con 0x55bba4340ad0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 10 client.17682 _ll_register_callbacks cb 0x55bba42360d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- 10.20.193.28:0/543656991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bba42927f0 con 0x55bba4340ad0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f11e77fe640 1 -- 10.20.193.28:0/543656991 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c007c20 con 0x55bba4340ad0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f11e77fe640 1 -- 10.20.193.28:0/543656991 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f122c0040d0 con 0x55bba4340ad0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f11e77fe640 1 -- 10.20.193.28:0/543656991 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f122c050060 con 0x55bba4340ad0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 10 client.17682 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- 10.20.193.28:0/543656991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55bba4257430 con 0x55bba4340ad0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f11e77fe640 1 -- 10.20.193.28:0/543656991 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f122c049070 con 0x55bba4340ad0 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 10 client.17682 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 20 client.17682 populate_metadata read hostname 'trial028' 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bba4369150 0x55bba436b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 4 client.17682 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:24.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.474+0000 7f123a65ce00 1 -- 10.20.193.28:0/543656991 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bba420cc00 con 0x55bba4369150 2026-02-20T03:23:24.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.501+0000 7f12356cb640 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bba4369150 0x55bba436b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:24.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 773838 8.62 MB/sec execute 297 sec latency 2296.434 ms 2026-02-20T03:23:24.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.568+0000 7f12356cb640 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bba4369150 0x55bba436b580 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50136bf415dc6944 server_cookie=a0b1b51a630d5989 in_seq=0 out_seq=0 2026-02-20T03:23:24.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.568+0000 7f11e77fe640 10 client.17682 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:24.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f11e77fe640 1 -- 10.20.193.28:0/543656991 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55bba420cc00 con 0x55bba4369150 2026-02-20T03:23:24.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f11e77fe640 10 client.17682 handle_command_reply: tid=0 2026-02-20T03:23:24.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 client.17682 shutdown 2026-02-20T03:23:24.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 -- 10.20.193.28:0/543656991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 msgr2=0x55bba435ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:24.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba435ae80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f122c02f4d0 tx=0x7f122c02fb80 comp rx=0 tx=0).stop 2026-02-20T03:23:24.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 -- 10.20.193.28:0/543656991 shutdown_connections 2026-02-20T03:23:24.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bba4369150 0x55bba436b580 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4345570 0x55bba4359630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4341480 0x55bba435b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 --2- 10.20.193.28:0/543656991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba435ae80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f11e77fe640 0 client.17682 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:24.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 -- 10.20.193.28:0/543656991 >> 10.20.193.28:0/543656991 conn(0x55bba4330b60 msgr2=0x55bba4343f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:24.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 -- 10.20.193.28:0/543656991 shutdown_connections 2026-02-20T03:23:24.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 1 -- 10.20.193.28:0/543656991 wait complete. 2026-02-20T03:23:24.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.582+0000 7f123a65ce00 20 client.17682 trim_cache size 0 max 16384 2026-02-20T03:23:24.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f123a65ce00 1 Processor -- start 2026-02-20T03:23:24.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f123a65ce00 1 -- start start 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4370e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4341480 0x55bba43713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4345570 0x55bba4360d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f123a65ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc0126c0 con 0x55bba4340ad0 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f123a65ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00ff90 con 0x55bba4345570 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f123a65ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00dde0 con 0x55bba4341480 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f12366cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4370e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f12366cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4370e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46618/0 (socket says 10.20.193.28:46618) 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.587+0000 7f12366cd640 1 -- 10.20.193.28:0/198710878 learned_addr learned my addr 10.20.193.28:0/198710878 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:24.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 -- 10.20.193.28:0/198710878 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4341480 msgr2=0x55bba43713d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 --2- 10.20.193.28:0/198710878 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4341480 0x55bba43713d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 -- 10.20.193.28:0/198710878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4345570 msgr2=0x55bba4360d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 --2- 10.20.193.28:0/198710878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4345570 0x55bba4360d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 -- 10.20.193.28:0/198710878 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bba4352e70 con 0x55bba4340ad0 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 --2- 10.20.193.28:0/198710878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4370e90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f122c004520 tx=0x7f122c031030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c11f0db0ba91d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f11fdce5640 1 -- 10.20.193.28:0/198710878 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c0040d0 con 0x55bba4340ad0 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f11fdce5640 1 -- 10.20.193.28:0/198710878 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55bba42927f0 con 0x55bba4340ad0 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f11fdce5640 1 -- 10.20.193.28:0/198710878 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c04b6e0 con 0x55bba4340ad0 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 -- 10.20.193.28:0/198710878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 msgr2=0x55bba4370e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 --2- 10.20.193.28:0/198710878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4370e90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f122c004520 tx=0x7f122c031030 comp rx=0 tx=0).stop 2026-02-20T03:23:24.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 -- 10.20.193.28:0/198710878 shutdown_connections 2026-02-20T03:23:24.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 --2- 10.20.193.28:0/198710878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4345570 0x55bba4360d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 --2- 10.20.193.28:0/198710878 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4341480 0x55bba43713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 --2- 10.20.193.28:0/198710878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4340ad0 0x55bba4370e90 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 -- 10.20.193.28:0/198710878 >> 10.20.193.28:0/198710878 conn(0x55bba4330b60 msgr2=0x55bba4356060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:24.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 -- 10.20.193.28:0/198710878 shutdown_connections 2026-02-20T03:23:24.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 -- 10.20.193.28:0/198710878 wait complete. 2026-02-20T03:23:24.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 -- start start 2026-02-20T03:23:24.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 Processor -- start 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4340ad0 0x55bba43609e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4341480 0x55bba4360f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4345570 0x55bba43cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00e450 con 0x55bba4345570 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00f8c0 con 0x55bba4340ad0 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f123a65ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc00eb20 con 0x55bba4341480 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4345570 0x55bba43cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4345570 0x55bba43cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46628/0 (socket says 10.20.193.28:46628) 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 -- 10.20.193.28:0/369321558 learned_addr learned my addr 10.20.193.28:0/369321558 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 -- 10.20.193.28:0/369321558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4341480 msgr2=0x55bba4360f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:24.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4341480 0x55bba4360f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 -- 10.20.193.28:0/369321558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4340ad0 msgr2=0x55bba43609e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4340ad0 0x55bba43609e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.592+0000 7f12366cd640 1 -- 10.20.193.28:0/369321558 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bba3f69900 con 0x55bba4345570 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f12366cd640 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4345570 0x55bba43cd2d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f122c002790 tx=0x7f122c009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410641757f4f55c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f11e77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f11e77fe640 1 -- 10.20.193.28:0/369321558 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c04b680 con 0x55bba4345570 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f11e77fe640 1 -- 10.20.193.28:0/369321558 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f122c05b070 con 0x55bba4345570 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f11e77fe640 1 -- 10.20.193.28:0/369321558 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c055420 con 0x55bba4345570 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 1 -- 10.20.193.28:0/369321558 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bba42454d0 con 0x55bba4345570 2026-02-20T03:23:24.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 10 client.17688 _ll_register_callbacks cb 0x7f122c006000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:24.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 1 -- 10.20.193.28:0/369321558 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f122c033030 con 0x55bba4345570 2026-02-20T03:23:24.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f11e77fe640 1 -- 10.20.193.28:0/369321558 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f122c04b900 con 0x55bba4345570 2026-02-20T03:23:24.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f11e77fe640 1 -- 10.20.193.28:0/369321558 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f122c04bbc0 con 0x55bba4345570 2026-02-20T03:23:24.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 10 client.17688 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:24.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 1 -- 10.20.193.28:0/369321558 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55bba4353b60 con 0x55bba4345570 2026-02-20T03:23:24.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f11e77fe640 1 -- 10.20.193.28:0/369321558 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f122c049040 con 0x55bba4345570 2026-02-20T03:23:24.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 10 client.17688 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:24.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:24.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 20 client.17688 populate_metadata read hostname 'trial028' 2026-02-20T03:23:24.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bba43d5960 0x55bba43d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:24.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 4 client.17688 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:23:24.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.595+0000 7f123a65ce00 1 -- 10.20.193.28:0/369321558 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bba3ffaa20 con 0x55bba43d5960 2026-02-20T03:23:24.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.622+0000 7f12356cb640 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bba43d5960 0x55bba43d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:24.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.662+0000 7f12356cb640 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bba43d5960 0x55bba43d7e20 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d65b445e2a618b2f server_cookie=ce308d4ef25ba9d3 in_seq=0 out_seq=0 2026-02-20T03:23:24.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.662+0000 7f11e77fe640 10 client.17688 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:24.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f11e77fe640 1 -- 10.20.193.28:0/369321558 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bba3ffaa20 con 0x55bba43d5960 2026-02-20T03:23:24.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f11e77fe640 10 client.17688 handle_command_reply: tid=0 2026-02-20T03:23:24.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 client.17688 shutdown 2026-02-20T03:23:24.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 -- 10.20.193.28:0/369321558 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4345570 msgr2=0x55bba43cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:24.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4345570 0x55bba43cd2d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f122c002790 tx=0x7f122c009720 comp rx=0 tx=0).stop 2026-02-20T03:23:24.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 -- 10.20.193.28:0/369321558 shutdown_connections 2026-02-20T03:23:24.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bba43d5960 0x55bba43d7e20 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bba4345570 0x55bba43cd2d0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bba4341480 0x55bba4360f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 --2- 10.20.193.28:0/369321558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bba4340ad0 0x55bba43609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 -- 10.20.193.28:0/369321558 >> 10.20.193.28:0/369321558 conn(0x55bba4330b60 msgr2=0x55bba4356880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:24.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f11e77fe640 0 client.17688 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:24.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 -- 10.20.193.28:0/369321558 shutdown_connections 2026-02-20T03:23:24.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 1 -- 10.20.193.28:0/369321558 wait complete. 2026-02-20T03:23:24.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.676+0000 7f123a65ce00 20 client.17688 trim_cache size 0 max 16384 2026-02-20T03:23:24.682 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:23:24.682 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:23:24.682 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "80cc25f0-be80-4bd2-85a9-f4721bc45c72", 2026-02-20T03:23:24.682 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:23:24.682 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:23:24.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 -- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f120c0b0e20 msgr2=0x7f120c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:24.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f120c0b0e20 0x7f120c0b32e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1220002410 tx=0x7f1220004850 comp rx=0 tx=0).stop 2026-02-20T03:23:24.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 -- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230104980 msgr2=0x7f123019d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230104980 0x7f123019d1b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f122000b570 tx=0x7f122000ba40 comp rx=0 tx=0).stop 2026-02-20T03:23:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 -- 10.20.193.28:0/2565745489 shutdown_connections 2026-02-20T03:23:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f120c0b0e20 0x7f120c0b32e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123010a980 0x7f12301a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1230105320 0x7f123019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 --2- 10.20.193.28:0/2565745489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1230104980 0x7f123019d1b0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.678+0000 7f1236ece640 1 -- 10.20.193.28:0/2565745489 >> 10.20.193.28:0/2565745489 conn(0x7f1230100680 msgr2=0x7f1230100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.679+0000 7f1236ece640 1 -- 10.20.193.28:0/2565745489 shutdown_connections 2026-02-20T03:23:24.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:24.679+0000 7f1236ece640 1 -- 10.20.193.28:0/2565745489 wait complete. 2026-02-20T03:23:24.838 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:23:25.139 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:25.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:25 trial028 ceph-mon[38552]: pgmap v443: 129 pgs: 129 active+clean; 138 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 389 KiB/s rd, 3.1 MiB/s wr, 177 op/s 2026-02-20T03:23:25.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:25 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:23:25.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:25 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:25.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- 10.20.193.28:0/2066125898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 msgr2=0x7f15a01097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:25.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 --2- 10.20.193.28:0/2066125898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 0x7f15a01097a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f1590009a30 tx=0x7f159002f260 comp rx=0 tx=0).stop 2026-02-20T03:23:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- 10.20.193.28:0/2066125898 shutdown_connections 2026-02-20T03:23:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 --2- 10.20.193.28:0/2066125898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f15a0109ed0 0x7f15a0111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 --2- 10.20.193.28:0/2066125898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 0x7f15a01097a0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 --2- 10.20.193.28:0/2066125898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a0104da0 0x7f15a0105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- 10.20.193.28:0/2066125898 >> 10.20.193.28:0/2066125898 conn(0x7f15a0100840 msgr2=0x7f15a0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:25.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- 10.20.193.28:0/2066125898 shutdown_connections 2026-02-20T03:23:25.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- 10.20.193.28:0/2066125898 wait complete. 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 Processor -- start 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- start start 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a0104da0 0x7f15a019d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 0x7f15a019d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f15a0109ed0 0x7f15a01a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0114e80 con 0x7f15a0105750 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0114d00 con 0x7f15a0109ed0 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0115000 con 0x7f15a0104da0 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 0x7f15a019d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 0x7f15a019d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46646/0 (socket says 10.20.193.28:46646) 2026-02-20T03:23:25.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159f7fe640 1 -- 10.20.193.28:0/3311707161 learned_addr learned my addr 10.20.193.28:0/3311707161 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:25.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159f7fe640 1 -- 10.20.193.28:0/3311707161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a0104da0 msgr2=0x7f15a019d320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:25.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159f7fe640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a0104da0 0x7f15a019d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159f7fe640 1 -- 10.20.193.28:0/3311707161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f15a0109ed0 msgr2=0x7f15a01a1bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159f7fe640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f15a0109ed0 0x7f15a01a1bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159f7fe640 1 -- 10.20.193.28:0/3311707161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15a01a2370 con 0x7f15a0105750 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159f7fe640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 0x7f15a019d860 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1590002fa0 tx=0x7f1590002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159d7fa640 1 -- 10.20.193.28:0/3311707161 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590004280 con 0x7f15a0105750 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159d7fa640 1 -- 10.20.193.28:0/3311707161 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1590004420 con 0x7f15a0105750 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f159d7fa640 1 -- 10.20.193.28:0/3311707161 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590038d20 con 0x7f15a0105750 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- 10.20.193.28:0/3311707161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a01a2600 con 0x7f15a0105750 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.420+0000 7f15a69f3640 1 -- 10.20.193.28:0/3311707161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a01a9ea0 con 0x7f15a0105750 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159d7fa640 1 -- 10.20.193.28:0/3311707161 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f15900047c0 con 0x7f15a0105750 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 Processor -- start 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- start start 2026-02-20T03:23:25.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e169612a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e1696169f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169617120 0x55e16961eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e169592e50 con 0x55e169612fe0 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e1695659c0 con 0x55e169617120 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e169513240 con 0x55e169612630 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e1696169f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e1696169f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46650/0 (socket says 10.20.193.28:46650) 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159ffff640 1 -- 10.20.193.28:0/1665796226 learned_addr learned my addr 10.20.193.28:0/1665796226 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159ffff640 1 -- 10.20.193.28:0/1665796226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 msgr2=0x55e169612a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159ffff640 1 --2- 10.20.193.28:0/1665796226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e169612a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159ffff640 1 -- 10.20.193.28:0/1665796226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169617120 msgr2=0x55e16961eca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:25.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159ffff640 1 --2- 10.20.193.28:0/1665796226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169617120 0x55e16961eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159ffff640 1 -- 10.20.193.28:0/1665796226 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e169526420 con 0x55e169612fe0 2026-02-20T03:23:25.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159ffff640 1 --2- 10.20.193.28:0/1665796226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e1696169f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f158c009ad0 tx=0x7f158c00b0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42144ada7c2cbd0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:25.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159d7fa640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f15740b0e20 0x7f15740b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f1570ce3640 1 -- 10.20.193.28:0/1665796226 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c016070 con 0x55e169612fe0 2026-02-20T03:23:25.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f159d7fa640 1 -- 10.20.193.28:0/3311707161 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1590104df0 con 0x7f15a0105750 2026-02-20T03:23:25.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f1570ce3640 1 -- 10.20.193.28:0/1665796226 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f158c00b8c0 con 0x55e169612fe0 2026-02-20T03:23:25.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f1570ce3640 1 -- 10.20.193.28:0/1665796226 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c002d90 con 0x55e169612fe0 2026-02-20T03:23:25.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/1665796226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 msgr2=0x55e1696169f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:25.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/1665796226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e1696169f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f158c009ad0 tx=0x7f158c00b0e0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a4f69640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f15740b0e20 0x7f15740b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/1665796226 shutdown_connections 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/1665796226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169617120 0x55e16961eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/1665796226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e1696169f0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/1665796226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e169612a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/1665796226 >> 10.20.193.28:0/1665796226 conn(0x55e1695d5290 msgr2=0x55e169610d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/1665796226 shutdown_connections 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/1665796226 wait complete. 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a4f69640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f15740b0e20 0x7f15740b32e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f159400aab0 tx=0x7f1594009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 -- start start 2026-02-20T03:23:25.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.426+0000 7f15a8ef8e00 1 Processor -- start 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e16962cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169612fe0 0x55e16962d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e16962b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e1695618f0 con 0x55e169617120 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e169353f50 con 0x55e169612fe0 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e16962b920 con 0x55e169612630 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a4f69640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e16962b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a4f69640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e16962b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46660/0 (socket says 10.20.193.28:46660) 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a4f69640 1 -- 10.20.193.28:0/4206697500 learned_addr learned my addr 10.20.193.28:0/4206697500 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a4f69640 1 -- 10.20.193.28:0/4206697500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 msgr2=0x55e16962cc50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a4f69640 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e16962cc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a4f69640 1 -- 10.20.193.28:0/4206697500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169612fe0 msgr2=0x55e16962d190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:25.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a4f69640 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169612fe0 0x55e16962d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a4f69640 1 -- 10.20.193.28:0/4206697500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1696249f0 con 0x55e169617120 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a4f69640 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e16962b390 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1594004380 tx=0x7f1594004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2fd256f276153c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f1561ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f1561ffb640 1 -- 10.20.193.28:0/4206697500 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594006e60 con 0x55e169617120 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f1561ffb640 1 -- 10.20.193.28:0/4206697500 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f159401f020 con 0x55e169617120 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f1561ffb640 1 -- 10.20.193.28:0/4206697500 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f159401ae30 con 0x55e169617120 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4206697500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e169336b40 con 0x55e169617120 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f1561ffb640 1 -- 10.20.193.28:0/4206697500 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1594024410 con 0x55e169617120 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f1561ffb640 10 client.17700 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 10 client.17700 _ll_register_callbacks cb 0x55e16959ef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:25.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4206697500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e1695731a0 con 0x55e169617120 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f1561ffb640 1 -- 10.20.193.28:0/4206697500 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f159401e020 con 0x55e169617120 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 10 client.17700 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4206697500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e169520230 con 0x55e169617120 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f1561ffb640 1 -- 10.20.193.28:0/4206697500 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f159400d9a0 con 0x55e169617120 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 10 client.17700 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 10 client.17700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 20 client.17700 populate_metadata read hostname 'trial028' 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e16963b470 0x55e16963d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 4 client.17700 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:25.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.431+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4206697500 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e16956d5b0 con 0x55e16963b470 2026-02-20T03:23:25.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.458+0000 7f159ffff640 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e16963b470 0x55e16963d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 773840 8.59 MB/sec execute 298 sec latency 2840.808 ms 2026-02-20T03:23:25.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.511+0000 7f159ffff640 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e16963b470 0x55e16963d900 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb0d2545ebe2f901 server_cookie=88f48608b7476ffb in_seq=0 out_seq=0 2026-02-20T03:23:25.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.511+0000 7f1561ffb640 10 client.17700 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:25.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.511+0000 7f1561ffb640 1 -- 10.20.193.28:0/4206697500 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e16956d5b0 con 0x55e16963b470 2026-02-20T03:23:25.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.511+0000 7f1561ffb640 10 client.17700 handle_command_reply: tid=0 2026-02-20T03:23:25.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 client.17700 shutdown 2026-02-20T03:23:25.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4206697500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 msgr2=0x55e16962b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:25.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e16962b390 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1594004380 tx=0x7f1594004bd0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4206697500 shutdown_connections 2026-02-20T03:23:25.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e16963b470 0x55e16963d900 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e16962b390 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169612fe0 0x55e16962d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4206697500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e16962cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4206697500 >> 10.20.193.28:0/4206697500 conn(0x55e1695d5290 msgr2=0x55e169615940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:25.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f1561ffb640 0 client.17700 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:25.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4206697500 shutdown_connections 2026-02-20T03:23:25.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4206697500 wait complete. 2026-02-20T03:23:25.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.512+0000 7f15a8ef8e00 20 client.17700 trim_cache size 0 max 16384 2026-02-20T03:23:25.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.520+0000 7f15a8ef8e00 1 Processor -- start 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f15a8ef8e00 1 -- start start 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169612630 0x55e169637d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612fe0 0x55e169618090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e169628830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f15440126a0 con 0x55e169617120 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f154400ff70 con 0x55e169612630 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f154400ddc0 con 0x55e169612fe0 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f15a4f69640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e169628830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f159f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612fe0 0x55e169618090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f159ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169612630 0x55e169637d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f159f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612fe0 0x55e169618090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48150/0 (socket says 10.20.193.28:48150) 2026-02-20T03:23:25.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f159f7fe640 1 -- 10.20.193.28:0/3907772168 learned_addr learned my addr 10.20.193.28:0/3907772168 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:25.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f159f7fe640 1 -- 10.20.193.28:0/3907772168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169612630 msgr2=0x55e169637d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:25.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f159f7fe640 1 --2- 10.20.193.28:0/3907772168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169612630 0x55e169637d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f159f7fe640 1 -- 10.20.193.28:0/3907772168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 msgr2=0x55e169628830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:25.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f159f7fe640 1 --2- 10.20.193.28:0/3907772168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e169628830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f159f7fe640 1 -- 10.20.193.28:0/3907772168 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e169624820 con 0x55e169612fe0 2026-02-20T03:23:25.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.521+0000 7f15a4f69640 1 --2- 10.20.193.28:0/3907772168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e169628830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:23:25.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f159f7fe640 1 --2- 10.20.193.28:0/3907772168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612fe0 0x55e169618090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1590002410 tx=0x7f159002fee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd1569781d2cfc12 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:25.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f1563fff640 1 -- 10.20.193.28:0/3907772168 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15900cde60 con 0x55e169612fe0 2026-02-20T03:23:25.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f1563fff640 1 -- 10.20.193.28:0/3907772168 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1590033020 con 0x55e169612fe0 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f1563fff640 1 -- 10.20.193.28:0/3907772168 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590004cf0 con 0x55e169612fe0 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/3907772168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612fe0 msgr2=0x55e169618090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/3907772168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612fe0 0x55e169618090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1590002410 tx=0x7f159002fee0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/3907772168 shutdown_connections 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/3907772168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169617120 0x55e169628830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/3907772168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612fe0 0x55e169618090 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/3907772168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169612630 0x55e169637d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/3907772168 >> 10.20.193.28:0/3907772168 conn(0x55e1695d5290 msgr2=0x55e169617980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/3907772168 shutdown_connections 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.522+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/3907772168 wait complete. 2026-02-20T03:23:25.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.523+0000 7f15a8ef8e00 1 -- start start 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.523+0000 7f15a8ef8e00 1 Processor -- start 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.523+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e1696344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.523+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e169634a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.523+0000 7f15a8ef8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169617120 0x55e169634f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.523+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f154400e430 con 0x55e169612fe0 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.523+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f154400f8a0 con 0x55e169617120 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.523+0000 7f15a8ef8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f154400eb00 con 0x55e169612630 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e1696344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e169634a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e1696344e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48164/0 (socket says 10.20.193.28:48164) 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159ffff640 1 -- 10.20.193.28:0/4245013314 learned_addr learned my addr 10.20.193.28:0/4245013314 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f15a4f69640 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169617120 0x55e169634f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159f7fe640 1 -- 10.20.193.28:0/4245013314 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 msgr2=0x55e1696344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159f7fe640 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e1696344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159f7fe640 1 -- 10.20.193.28:0/4245013314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169617120 msgr2=0x55e169634f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159f7fe640 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169617120 0x55e169634f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159f7fe640 1 -- 10.20.193.28:0/4245013314 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e169244870 con 0x55e169612fe0 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f159f7fe640 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e169634a20 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x55e1695b93f0 tx=0x7f1590005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cedf317c02dfcad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f1561ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f1561ffb640 1 -- 10.20.193.28:0/4245013314 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15900cde60 con 0x55e169612fe0 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f1561ffb640 1 -- 10.20.193.28:0/4245013314 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f15900d0ee0 con 0x55e169612fe0 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f1561ffb640 1 -- 10.20.193.28:0/4245013314 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15900d30f0 con 0x55e169612fe0 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4245013314 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e169505440 con 0x55e169612fe0 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f15a8ef8e00 10 client.17706 _ll_register_callbacks cb 0x7f1594002b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:25.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4245013314 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e169517b00 con 0x55e169612fe0 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.524+0000 7f1561ffb640 1 -- 10.20.193.28:0/4245013314 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f15900e1e00 con 0x55e169612fe0 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f1561ffb640 1 -- 10.20.193.28:0/4245013314 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15900d5d90 con 0x55e169612fe0 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f15a8ef8e00 10 client.17706 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4245013314 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e169625510 con 0x55e169612fe0 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f1561ffb640 1 -- 10.20.193.28:0/4245013314 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f15900b8030 con 0x55e169612fe0 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f15a8ef8e00 10 client.17706 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f15a8ef8e00 10 client.17706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f15a8ef8e00 20 client.17706 populate_metadata read hostname 'trial028' 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e1696a7480 0x55e1696a9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f15a8ef8e00 4 client.17706 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4245013314 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1590033020 con 0x55e1696a7480 2026-02-20T03:23:25.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.525+0000 7f159ffff640 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e1696a7480 0x55e1696a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f159ffff640 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e1696a7480 0x55e1696a9940 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b438d20b2bf6ea1 server_cookie=f941bf3b31e08b83 in_seq=0 out_seq=0 2026-02-20T03:23:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f1561ffb640 10 client.17706 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f1561ffb640 1 -- 10.20.193.28:0/4245013314 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f1590033020 con 0x55e1696a7480 2026-02-20T03:23:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f1561ffb640 10 client.17706 handle_command_reply: tid=0 2026-02-20T03:23:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 client.17706 shutdown 2026-02-20T03:23:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4245013314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 msgr2=0x55e169634a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e169634a20 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x55e1695b93f0 tx=0x7f1590005c70 comp rx=0 tx=0).stop 2026-02-20T03:23:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4245013314 shutdown_connections 2026-02-20T03:23:25.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e1696a7480 0x55e1696a9940 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e169617120 0x55e169634f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e169612fe0 0x55e169634a20 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 --2- 10.20.193.28:0/4245013314 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e169612630 0x55e1696344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f1561ffb640 0 client.17706 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4245013314 >> 10.20.193.28:0/4245013314 conn(0x55e1695d5290 msgr2=0x55e1696181a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4245013314 shutdown_connections 2026-02-20T03:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 1 -- 10.20.193.28:0/4245013314 wait complete. 2026-02-20T03:23:25.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.526+0000 7f15a8ef8e00 20 client.17706 trim_cache size 0 max 16384 2026-02-20T03:23:25.535 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:23:25.536 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:23:25.536 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:23:25.536 INFO:teuthology.orchestra.run.trial028.stdout: "80cc25f0-be80-4bd2-85a9-f4721bc45c72": { 2026-02-20T03:23:25.536 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:23:25.536 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "80cc25f0-be80-4bd2-85a9-f4721bc45c72", 2026-02-20T03:23:25.536 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:23:25.536 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:25.536 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:25.536 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:23:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 -- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f15740b0e20 msgr2=0x7f15740b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f15740b0e20 0x7f15740b32e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f159400aab0 tx=0x7f1594009250 comp rx=0 tx=0).stop 2026-02-20T03:23:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 -- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 msgr2=0x7f15a019d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 0x7f15a019d860 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1590002fa0 tx=0x7f1590002910 comp rx=0 tx=0).stop 2026-02-20T03:23:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 -- 10.20.193.28:0/3311707161 shutdown_connections 2026-02-20T03:23:25.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f15740b0e20 0x7f15740b32e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f15a0109ed0 0x7f15a01a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15a0105750 0x7f15a019d860 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 --2- 10.20.193.28:0/3311707161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15a0104da0 0x7f15a019d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:25.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 -- 10.20.193.28:0/3311707161 >> 10.20.193.28:0/3311707161 conn(0x7f15a0100840 msgr2=0x7f15a0101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:25.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 -- 10.20.193.28:0/3311707161 shutdown_connections 2026-02-20T03:23:25.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:25.527+0000 7f15a69f3640 1 -- 10.20.193.28:0/3311707161 wait complete. 2026-02-20T03:23:25.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:25 trial126 ceph-mon[38476]: pgmap v443: 129 pgs: 129 active+clean; 138 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 389 KiB/s rd, 3.1 MiB/s wr, 177 op/s 2026-02-20T03:23:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:25 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:23:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:25 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:25.633 INFO:tasks.cephfs.filesystem:scrub status for tag:80cc25f0-be80-4bd2-85a9-f4721bc45c72 - {'path': '/', 'tag': '80cc25f0-be80-4bd2-85a9-f4721bc45c72', 'options': 'recursive,force'} 2026-02-20T03:23:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:25 trial177 ceph-mon[43181]: pgmap v443: 129 pgs: 129 active+clean; 138 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 389 KiB/s rd, 3.1 MiB/s wr, 177 op/s 2026-02-20T03:23:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:25 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:23:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:25 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:26.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 777589 8.64 MB/sec execute 299 sec latency 457.865 ms 2026-02-20T03:23:26.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:26 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:23:26.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:26 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:26.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:26 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:23:26.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:26 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:23:26.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:26 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:26.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:26 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:26.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:26 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:23:26.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:26 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:26.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:26 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:23:26.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:26 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:23:26.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:26 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:26.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:26 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:26.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:26 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:23:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:26 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:26 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:23:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:26 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:23:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:26 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:26 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:23:27.396 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:27 trial028 ceph-mon[38552]: pgmap v444: 129 pgs: 129 active+clean; 133 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 499 KiB/s rd, 3.5 MiB/s wr, 211 op/s 2026-02-20T03:23:27.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 779149 8.63 MB/sec execute 300 sec latency 363.633 ms 2026-02-20T03:23:27.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:27 trial126 ceph-mon[38476]: pgmap v444: 129 pgs: 129 active+clean; 133 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 499 KiB/s rd, 3.5 MiB/s wr, 211 op/s 2026-02-20T03:23:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:27 trial177 ceph-mon[43181]: pgmap v444: 129 pgs: 129 active+clean; 133 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 499 KiB/s rd, 3.5 MiB/s wr, 211 op/s 2026-02-20T03:23:28.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 779149 8.60 MB/sec execute 301 sec latency 1363.669 ms 2026-02-20T03:23:29.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 779149 8.58 MB/sec execute 302 sec latency 2363.715 ms 2026-02-20T03:23:29.518 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:29 trial028 ceph-mon[38552]: pgmap v445: 129 pgs: 129 active+clean; 131 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 459 KiB/s rd, 3.0 MiB/s wr, 208 op/s 2026-02-20T03:23:29.519 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:29 trial177 ceph-mon[43181]: pgmap v445: 129 pgs: 129 active+clean; 131 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 459 KiB/s rd, 3.0 MiB/s wr, 208 op/s 2026-02-20T03:23:29.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:29 trial126 ceph-mon[38476]: pgmap v445: 129 pgs: 129 active+clean; 131 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 459 KiB/s rd, 3.0 MiB/s wr, 208 op/s 2026-02-20T03:23:30.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 779181 8.55 MB/sec execute 303 sec latency 3010.797 ms 2026-02-20T03:23:31.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 781822 8.57 MB/sec execute 304 sec latency 631.572 ms 2026-02-20T03:23:31.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:31 trial126 ceph-mon[38476]: pgmap v446: 129 pgs: 129 active+clean; 139 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 762 KiB/s rd, 3.7 MiB/s wr, 268 op/s 2026-02-20T03:23:31.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:31 trial028 ceph-mon[38552]: pgmap v446: 129 pgs: 129 active+clean; 139 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 762 KiB/s rd, 3.7 MiB/s wr, 268 op/s 2026-02-20T03:23:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:31 trial177 ceph-mon[43181]: pgmap v446: 129 pgs: 129 active+clean; 139 MiB data, 2.7 GiB used, 8.2 TiB / 8.2 TiB avail; 762 KiB/s rd, 3.7 MiB/s wr, 268 op/s 2026-02-20T03:23:32.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 784921 8.60 MB/sec execute 305 sec latency 287.703 ms 2026-02-20T03:23:32.847 INFO:tasks.quiescer.fs.[cephfs]:Total duration (56.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-20T03:23:32.847 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.15 2026-02-20T03:23:32.848 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:23:33.167 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:33.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:33 trial028 ceph-mon[38552]: pgmap v447: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 463 KiB/s rd, 3.1 MiB/s wr, 206 op/s 2026-02-20T03:23:33.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:23:33.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:23:33.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:23:33.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- 10.20.193.28:0/1006904499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2010109ba0 msgr2=0x7f2010115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 --2- 10.20.193.28:0/1006904499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2010109ba0 0x7f2010115d10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f200c00b0a0 tx=0x7f200c02f450 comp rx=0 tx=0).stop 2026-02-20T03:23:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- 10.20.193.28:0/1006904499 shutdown_connections 2026-02-20T03:23:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 --2- 10.20.193.28:0/1006904499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2010109ba0 0x7f2010115d10 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 --2- 10.20.193.28:0/1006904499 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2010109220 0x7f2010109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 --2- 10.20.193.28:0/1006904499 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f201010eef0 0x7f201010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- 10.20.193.28:0/1006904499 >> 10.20.193.28:0/1006904499 conn(0x7f2010078600 msgr2=0x7f201007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- 10.20.193.28:0/1006904499 shutdown_connections 2026-02-20T03:23:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- 10.20.193.28:0/1006904499 wait complete. 2026-02-20T03:23:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 Processor -- start 2026-02-20T03:23:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- start start 2026-02-20T03:23:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2010109220 0x7f20101a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2010109ba0 0x7f20101a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f201010eef0 0x7f20101a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f20101191b0 con 0x7f201010eef0 2026-02-20T03:23:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2010119030 con 0x7f2010109ba0 2026-02-20T03:23:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2010119330 con 0x7f2010109220 2026-02-20T03:23:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20161e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f201010eef0 0x7f20101a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20161e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f201010eef0 0x7f20101a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43328/0 (socket says 10.20.193.28:43328) 2026-02-20T03:23:33.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20161e1640 1 -- 10.20.193.28:0/1020503920 learned_addr learned my addr 10.20.193.28:0/1020503920 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20161e1640 1 -- 10.20.193.28:0/1020503920 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2010109220 msgr2=0x7f20101a1630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20161e1640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2010109220 0x7f20101a1630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20161e1640 1 -- 10.20.193.28:0/1020503920 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2010109ba0 msgr2=0x7f20101a1b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:33.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20161e1640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2010109ba0 0x7f20101a1b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20161e1640 1 -- 10.20.193.28:0/1020503920 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20101a6680 con 0x7f201010eef0 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20161e1640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f201010eef0 0x7f20101a5f00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f200c00b1d0 tx=0x7f200c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f1ffeffd640 1 -- 10.20.193.28:0/1020503920 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c004590 con 0x7f201010eef0 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f1ffeffd640 1 -- 10.20.193.28:0/1020503920 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f200c004730 con 0x7f201010eef0 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f1ffeffd640 1 -- 10.20.193.28:0/1020503920 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c038680 con 0x7f201010eef0 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20101a6910 con 0x7f201010eef0 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.419+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20101ae1b0 con 0x7f201010eef0 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.424+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20101096e0 con 0x7f201010eef0 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.424+0000 7f1ffeffd640 1 -- 10.20.193.28:0/1020503920 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f200c002a60 con 0x7f201010eef0 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.424+0000 7f1ffeffd640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fec0b0e20 0x7f1fec0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.424+0000 7f1ffeffd640 1 -- 10.20.193.28:0/1020503920 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f200c106330 con 0x7f201010eef0 2026-02-20T03:23:33.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.424+0000 7f1ffeffd640 1 -- 10.20.193.28:0/1020503920 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f200c050030 con 0x7f201010eef0 2026-02-20T03:23:33.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.424+0000 7f20159e0640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fec0b0e20 0x7f1fec0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.424+0000 7f20159e0640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fec0b0e20 0x7f1fec0b32e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2000009770 tx=0x7f2000006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:33.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 784921 8.57 MB/sec execute 306 sec latency 1287.739 ms 2026-02-20T03:23:33.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2010110e30 con 0x7f201010eef0 2026-02-20T03:23:33.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f1ffeffd640 1 -- 10.20.193.28:0/1020503920 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f200c03d070 con 0x7f201010eef0 2026-02-20T03:23:33.540 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:23:33.541 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:23:33.542 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:23:33.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fec0b0e20 msgr2=0x7f1fec0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fec0b0e20 0x7f1fec0b32e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2000009770 tx=0x7f2000006cd0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f201010eef0 msgr2=0x7f20101a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f201010eef0 0x7f20101a5f00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f200c00b1d0 tx=0x7f200c009300 comp rx=0 tx=0).stop 2026-02-20T03:23:33.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 shutdown_connections 2026-02-20T03:23:33.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fec0b0e20 0x7f1fec0b32e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f201010eef0 0x7f20101a5f00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2010109ba0 0x7f20101a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 --2- 10.20.193.28:0/1020503920 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2010109220 0x7f20101a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 >> 10.20.193.28:0/1020503920 conn(0x7f2010078600 msgr2=0x7f2010079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:33.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 shutdown_connections 2026-02-20T03:23:33.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:33.536+0000 7f20169e2640 1 -- 10.20.193.28:0/1020503920 wait complete. 2026-02-20T03:23:33.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- 10.20.193.28:0/2168213886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8077070 msgr2=0x7fe0a80754c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/2168213886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8077070 0x7fe0a80754c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fe094009a30 tx=0x7fe09402f260 comp rx=0 tx=0).stop 2026-02-20T03:23:33.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- 10.20.193.28:0/2168213886 shutdown_connections 2026-02-20T03:23:33.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/2168213886 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0a810a5d0 0x7fe0a810ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/2168213886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0a8075a00 0x7fe0a8075e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/2168213886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8077070 0x7fe0a80754c0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- 10.20.193.28:0/2168213886 >> 10.20.193.28:0/2168213886 conn(0x7fe0a80fde10 msgr2=0x7fe0a8100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:33.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- 10.20.193.28:0/2168213886 shutdown_connections 2026-02-20T03:23:33.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- 10.20.193.28:0/2168213886 wait complete. 2026-02-20T03:23:33.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 Processor -- start 2026-02-20T03:23:33.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- start start 2026-02-20T03:23:33.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8075a00 0x7fe0a819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0a8077070 0x7fe0a819d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0a810a5d0 0x7fe0a81a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a81104f0 con 0x7fe0a8075a00 2026-02-20T03:23:33.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a8110370 con 0x7fe0a810a5d0 2026-02-20T03:23:33.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a8110670 con 0x7fe0a8077070 2026-02-20T03:23:33.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8075a00 0x7fe0a819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8075a00 0x7fe0a819cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43358/0 (socket says 10.20.193.28:43358) 2026-02-20T03:23:33.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a7fff640 1 -- 10.20.193.28:0/3451256416 learned_addr learned my addr 10.20.193.28:0/3451256416 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:33.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a7fff640 1 -- 10.20.193.28:0/3451256416 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0a8077070 msgr2=0x7fe0a819d090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:33.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a7fff640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0a8077070 0x7fe0a819d090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a7fff640 1 -- 10.20.193.28:0/3451256416 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0a810a5d0 msgr2=0x7fe0a81a4100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:33.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a7fff640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0a810a5d0 0x7fe0a81a4100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a7fff640 1 -- 10.20.193.28:0/3451256416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a81a4800 con 0x7fe0a8075a00 2026-02-20T03:23:33.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a7fff640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8075a00 0x7fe0a819cb50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe094009950 tx=0x7fe09402fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:33.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a57fa640 1 -- 10.20.193.28:0/3451256416 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0940043b0 con 0x7fe0a8075a00 2026-02-20T03:23:33.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a57fa640 1 -- 10.20.193.28:0/3451256416 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe094004550 con 0x7fe0a8075a00 2026-02-20T03:23:33.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0a57fa640 1 -- 10.20.193.28:0/3451256416 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094005050 con 0x7fe0a8075a00 2026-02-20T03:23:33.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- 10.20.193.28:0/3451256416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a81a4a90 con 0x7fe0a8075a00 2026-02-20T03:23:33.566 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.553+0000 7fe0ad55a640 1 -- 10.20.193.28:0/3451256416 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a81a4fb0 con 0x7fe0a8075a00 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a57fa640 1 -- 10.20.193.28:0/3451256416 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe0940051f0 con 0x7fe0a8075a00 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 Processor -- start 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 -- start start 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b3e80 0x55bfa38b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b47c0 0x55bfa38b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b9560 0x55bfa38bb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bfa38048f0 con 0x55bfa38b9560 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bfa37b22e0 con 0x55bfa38b47c0 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bfa3800820 con 0x55bfa38b3e80 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b9560 0x55bfa38bb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a57fa640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe07c0b0da0 0x7fe07c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b9560 0x55bfa38bb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43372/0 (socket says 10.20.193.28:43372) 2026-02-20T03:23:33.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a77fe640 1 -- 10.20.193.28:0/3376011658 learned_addr learned my addr 10.20.193.28:0/3376011658 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:33.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a57fa640 1 -- 10.20.193.28:0/3451256416 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe094105960 con 0x7fe0a8075a00 2026-02-20T03:23:33.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0acd59640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe07c0b0da0 0x7fe07c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a77fe640 1 -- 10.20.193.28:0/3376011658 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b3e80 msgr2=0x55bfa38b4280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:33.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/3376011658 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b3e80 0x55bfa38b4280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a77fe640 1 -- 10.20.193.28:0/3376011658 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b47c0 msgr2=0x55bfa38b8f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:33.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/3376011658 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b47c0 0x55bfa38b8f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a77fe640 1 -- 10.20.193.28:0/3376011658 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfa37a45a0 con 0x55bfa38b9560 2026-02-20T03:23:33.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/3376011658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b9560 0x55bfa38bb9f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe098009810 tx=0x7fe098009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5e05a81017349 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0acd59640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe07c0b0da0 0x7fe07c0b3260 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00ab10 tx=0x7fe09c009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe078bfe640 1 -- 10.20.193.28:0/3376011658 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098016070 con 0x55bfa38b9560 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe078bfe640 1 -- 10.20.193.28:0/3376011658 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe098004480 con 0x55bfa38b9560 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe078bfe640 1 -- 10.20.193.28:0/3376011658 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09800bda0 con 0x55bfa38b9560 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3376011658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b9560 msgr2=0x55bfa38bb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3376011658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b9560 0x55bfa38bb9f0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe098009810 tx=0x7fe098009ce0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3376011658 shutdown_connections 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3376011658 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b9560 0x55bfa38bb9f0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3376011658 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b47c0 0x55bfa38b8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3376011658 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b3e80 0x55bfa38b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3376011658 >> 10.20.193.28:0/3376011658 conn(0x55bfa38ab6f0 msgr2=0x55bfa38b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3376011658 shutdown_connections 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.558+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3376011658 wait complete. 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 -- start start 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 Processor -- start 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b3e80 0x55bfa38d5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b47c0 0x55bfa38d5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b9560 0x55bfa38dc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bfa37ac0c0 con 0x55bfa38b3e80 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bfa38c5020 con 0x55bfa38b9560 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bfa38dcf50 con 0x55bfa38b47c0 2026-02-20T03:23:33.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0a7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b3e80 0x55bfa38d5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0a7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b3e80 0x55bfa38d5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43380/0 (socket says 10.20.193.28:43380) 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0a7fff640 1 -- 10.20.193.28:0/2193064219 learned_addr learned my addr 10.20.193.28:0/2193064219 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0a7fff640 1 -- 10.20.193.28:0/2193064219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b47c0 msgr2=0x55bfa38d5a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0a7fff640 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b47c0 0x55bfa38d5a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0a7fff640 1 -- 10.20.193.28:0/2193064219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b9560 msgr2=0x55bfa38dc9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0a7fff640 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b9560 0x55bfa38dc9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0a7fff640 1 -- 10.20.193.28:0/2193064219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfa38cec20 con 0x55bfa38b3e80 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0a7fff640 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b3e80 0x55bfa38d5500 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe09402ff50 tx=0x7fe0940cd410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3bbc14a6868d6a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe069ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe069ffb640 1 -- 10.20.193.28:0/2193064219 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0940cdd40 con 0x55bfa38b3e80 2026-02-20T03:23:33.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe069ffb640 1 -- 10.20.193.28:0/2193064219 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe094033020 con 0x55bfa38b3e80 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe069ffb640 1 -- 10.20.193.28:0/2193064219 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0940c8d60 con 0x55bfa38b3e80 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 -- 10.20.193.28:0/2193064219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfa37c0820 con 0x55bfa38b3e80 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe069ffb640 1 -- 10.20.193.28:0/2193064219 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe0940c8f00 con 0x55bfa38b3e80 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe069ffb640 10 client.17724 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 10 client.17724 _ll_register_callbacks cb 0x55bfa37afff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 -- 10.20.193.28:0/2193064219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bfa380c4e0 con 0x55bfa38b3e80 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe069ffb640 1 -- 10.20.193.28:0/2193064219 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe0940d68a0 con 0x55bfa38b3e80 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 10 client.17724 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.563+0000 7fe0b1644e00 1 -- 10.20.193.28:0/2193064219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55bfa37c5380 con 0x55bfa38b3e80 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.567+0000 7fe069ffb640 1 -- 10.20.193.28:0/2193064219 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe0940d4ce0 con 0x55bfa38b3e80 2026-02-20T03:23:33.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.567+0000 7fe0b1644e00 10 client.17724 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:33.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.567+0000 7fe0b1644e00 10 client.17724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:33.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.567+0000 7fe0b1644e00 20 client.17724 populate_metadata read hostname 'trial028' 2026-02-20T03:23:33.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.567+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bfa38e1280 0x55bfa38e3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.567+0000 7fe0b1644e00 4 client.17724 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:33.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.567+0000 7fe0b1644e00 1 -- 10.20.193.28:0/2193064219 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfa3786bd0 con 0x55bfa38e1280 2026-02-20T03:23:33.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.594+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bfa38e1280 0x55bfa38e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:33 trial126 ceph-mon[38476]: pgmap v447: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 463 KiB/s rd, 3.1 MiB/s wr, 206 op/s 2026-02-20T03:23:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:23:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:23:33.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:23:33.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.659+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bfa38e1280 0x55bfa38e3740 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9064e0c85c31f31d server_cookie=8908c61d19ec737d in_seq=0 out_seq=0 2026-02-20T03:23:33.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.659+0000 7fe069ffb640 10 client.17724 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:33.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe069ffb640 1 -- 10.20.193.28:0/2193064219 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55bfa3786bd0 con 0x55bfa38e1280 2026-02-20T03:23:33.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe069ffb640 10 client.17724 handle_command_reply: tid=0 2026-02-20T03:23:33.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 client.17724 shutdown 2026-02-20T03:23:33.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 -- 10.20.193.28:0/2193064219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b3e80 msgr2=0x55bfa38d5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b3e80 0x55bfa38d5500 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe09402ff50 tx=0x7fe0940cd410 comp rx=0 tx=0).stop 2026-02-20T03:23:33.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 -- 10.20.193.28:0/2193064219 shutdown_connections 2026-02-20T03:23:33.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bfa38e1280 0x55bfa38e3740 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b9560 0x55bfa38dc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b47c0 0x55bfa38d5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/2193064219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b3e80 0x55bfa38d5500 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 -- 10.20.193.28:0/2193064219 >> 10.20.193.28:0/2193064219 conn(0x55bfa38ab6f0 msgr2=0x55bfa38ba870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:33.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe069ffb640 0 client.17724 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:33.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 -- 10.20.193.28:0/2193064219 shutdown_connections 2026-02-20T03:23:33.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 1 -- 10.20.193.28:0/2193064219 wait complete. 2026-02-20T03:23:33.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.686+0000 7fe0b1644e00 20 client.17724 trim_cache size 0 max 16384 2026-02-20T03:23:33.701 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 148.15 --await-for 45.0' 2026-02-20T03:23:33.701 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 148.15 --await-for 45.0 2026-02-20T03:23:33.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0b1644e00 1 Processor -- start 2026-02-20T03:23:33.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0b1644e00 1 -- start start 2026-02-20T03:23:33.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b3e80 0x55bfa38b9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38dc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b9560 0x55bfa38b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c0126f0 con 0x55bfa38b47c0 2026-02-20T03:23:33.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c00ffc0 con 0x55bfa38b3e80 2026-02-20T03:23:33.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c00de10 con 0x55bfa38b9560 2026-02-20T03:23:33.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38dc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38dc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43390/0 (socket says 10.20.193.28:43390) 2026-02-20T03:23:33.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0a77fe640 1 -- 10.20.193.28:0/1210465369 learned_addr learned my addr 10.20.193.28:0/1210465369 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:33.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0a77fe640 1 -- 10.20.193.28:0/1210465369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b9560 msgr2=0x55bfa38b9e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:33.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/1210465369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b9560 0x55bfa38b9e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0a77fe640 1 -- 10.20.193.28:0/1210465369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b3e80 msgr2=0x55bfa38b9940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:33.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/1210465369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b3e80 0x55bfa38b9940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.691+0000 7fe0a77fe640 1 -- 10.20.193.28:0/1210465369 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfa38cea50 con 0x55bfa38b47c0 2026-02-20T03:23:33.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/1210465369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38dc980 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe098009730 tx=0x7fe09800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f819c6fee86f788 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:33.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe06bfff640 1 -- 10.20.193.28:0/1210465369 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098016040 con 0x55bfa38b47c0 2026-02-20T03:23:33.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe06bfff640 1 -- 10.20.193.28:0/1210465369 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe09800bd70 con 0x55bfa38b47c0 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe06bfff640 1 -- 10.20.193.28:0/1210465369 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09801e430 con 0x55bfa38b47c0 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- 10.20.193.28:0/1210465369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 msgr2=0x55bfa38dc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/1210465369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38dc980 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fe098009730 tx=0x7fe09800b860 comp rx=0 tx=0).stop 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- 10.20.193.28:0/1210465369 shutdown_connections 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/1210465369 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b9560 0x55bfa38b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/1210465369 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38dc980 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/1210465369 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b3e80 0x55bfa38b9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- 10.20.193.28:0/1210465369 >> 10.20.193.28:0/1210465369 conn(0x55bfa38ab6f0 msgr2=0x55bfa38d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- 10.20.193.28:0/1210465369 shutdown_connections 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- 10.20.193.28:0/1210465369 wait complete. 2026-02-20T03:23:33.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- start start 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 Processor -- start 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b3e80 0x55bfa38dc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38d9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b9560 0x55bfa38d9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c00e480 con 0x55bfa38b47c0 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c00f8f0 con 0x55bfa38b3e80 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c00eb50 con 0x55bfa38b9560 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38d9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38d9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43400/0 (socket says 10.20.193.28:43400) 2026-02-20T03:23:33.709 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 -- 10.20.193.28:0/3517501219 learned_addr learned my addr 10.20.193.28:0/3517501219 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:33.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 -- 10.20.193.28:0/3517501219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b9560 msgr2=0x55bfa38d9660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:33.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b9560 0x55bfa38d9660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 -- 10.20.193.28:0/3517501219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b3e80 msgr2=0x55bfa38dc650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:33.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b3e80 0x55bfa38dc650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 -- 10.20.193.28:0/3517501219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfa3564690 con 0x55bfa38b47c0 2026-02-20T03:23:33.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0a77fe640 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38d9120 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fe09800b0b0 tx=0x7fe098009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1e7a2559533d15 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:33.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe069ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:33.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe069ffb640 1 -- 10.20.193.28:0/3517501219 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098032070 con 0x55bfa38b47c0 2026-02-20T03:23:33.710 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe069ffb640 1 -- 10.20.193.28:0/3517501219 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe098009420 con 0x55bfa38b47c0 2026-02-20T03:23:33.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe069ffb640 1 -- 10.20.193.28:0/3517501219 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098016040 con 0x55bfa38b47c0 2026-02-20T03:23:33.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.696+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3517501219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfa37c9b70 con 0x55bfa38b47c0 2026-02-20T03:23:33.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe069ffb640 1 -- 10.20.193.28:0/3517501219 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe09801e430 con 0x55bfa38b47c0 2026-02-20T03:23:33.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 10 client.17730 _ll_register_callbacks cb 0x7fe0940c9380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:33.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3517501219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe098004480 con 0x55bfa38b47c0 2026-02-20T03:23:33.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe069ffb640 1 -- 10.20.193.28:0/3517501219 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe09802d440 con 0x55bfa38b47c0 2026-02-20T03:23:33.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 10 client.17730 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:33.711 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3517501219 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55bfa38cf740 con 0x55bfa38b47c0 2026-02-20T03:23:33.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe069ffb640 1 -- 10.20.193.28:0/3517501219 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe098023040 con 0x55bfa38b47c0 2026-02-20T03:23:33.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 10 client.17730 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:33.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 10 client.17730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:33.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 20 client.17730 populate_metadata read hostname 'trial028' 2026-02-20T03:23:33.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bfa394d460 0x55bfa394f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:33.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 4 client.17730 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:23:33.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.699+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3517501219 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bfa37d56b0 con 0x55bfa394d460 2026-02-20T03:23:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:33 trial177 ceph-mon[43181]: pgmap v447: 129 pgs: 129 active+clean; 140 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 463 KiB/s rd, 3.1 MiB/s wr, 206 op/s 2026-02-20T03:23:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:23:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:23:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:23:33.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.726+0000 7fe0a7fff640 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bfa394d460 0x55bfa394f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:33.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.767+0000 7fe0a7fff640 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bfa394d460 0x55bfa394f8f0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a30a9ada8e514717 server_cookie=73503b10e36c8471 in_seq=0 out_seq=0 2026-02-20T03:23:33.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.767+0000 7fe069ffb640 10 client.17730 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:33.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe069ffb640 1 -- 10.20.193.28:0/3517501219 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bfa37d56b0 con 0x55bfa394d460 2026-02-20T03:23:33.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe069ffb640 10 client.17730 handle_command_reply: tid=0 2026-02-20T03:23:33.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 client.17730 shutdown 2026-02-20T03:23:33.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3517501219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 msgr2=0x55bfa38d9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38d9120 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fe09800b0b0 tx=0x7fe098009190 comp rx=0 tx=0).stop 2026-02-20T03:23:33.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3517501219 shutdown_connections 2026-02-20T03:23:33.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55bfa394d460 0x55bfa394f8f0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bfa38b9560 0x55bfa38d9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bfa38b47c0 0x55bfa38d9120 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 --2- 10.20.193.28:0/3517501219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bfa38b3e80 0x55bfa38dc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3517501219 >> 10.20.193.28:0/3517501219 conn(0x55bfa38ab6f0 msgr2=0x55bfa38b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:33.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe069ffb640 0 client.17730 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:33.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3517501219 shutdown_connections 2026-02-20T03:23:33.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 1 -- 10.20.193.28:0/3517501219 wait complete. 2026-02-20T03:23:33.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0b1644e00 20 client.17730 trim_cache size 0 max 16384 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 -- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe07c0b0da0 msgr2=0x7fe07c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe07c0b0da0 0x7fe07c0b3260 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe09c00ab10 tx=0x7fe09c009230 comp rx=0 tx=0).stop 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 -- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8075a00 msgr2=0x7fe0a819cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8075a00 0x7fe0a819cb50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fe094009950 tx=0x7fe09402fdc0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 -- 10.20.193.28:0/3451256416 shutdown_connections 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe07c0b0da0 0x7fe07c0b3260 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0a810a5d0 0x7fe0a81a4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0a8077070 0x7fe0a819d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 --2- 10.20.193.28:0/3451256416 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0a8075a00 0x7fe0a819cb50 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 -- 10.20.193.28:0/3451256416 >> 10.20.193.28:0/3451256416 conn(0x7fe0a80fde10 msgr2=0x7fe0a81065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 -- 10.20.193.28:0/3451256416 shutdown_connections 2026-02-20T03:23:33.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:33.868+0000 7fe0ad55a640 1 -- 10.20.193.28:0/3451256416 wait complete. 2026-02-20T03:23:34.006 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/2726734420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f981065d0 msgr2=0x7f6f98075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/2726734420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f981065d0 0x7f6f98075410 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009a30 tx=0x7f6f8802f2f0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/2726734420 shutdown_connections 2026-02-20T03:23:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/2726734420 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f981134d0 0x7f6f98115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/2726734420 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f98075950 0x7f6f98075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/2726734420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f981065d0 0x7f6f98075410 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/2726734420 >> 10.20.193.28:0/2726734420 conn(0x7f6f980fe440 msgr2=0x7f6f98100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:34.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/2726734420 shutdown_connections 2026-02-20T03:23:34.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/2726734420 wait complete. 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 Processor -- start 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- start start 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f98075950 0x7f6f981a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f981065d0 0x7f6f981a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f981134d0 0x7f6f981a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6f981191d0 con 0x7f6f98075950 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98119050 con 0x7f6f981065d0 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6f98119350 con 0x7f6f981134d0 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9cdb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f98075950 0x7f6f981a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9cdb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f98075950 0x7f6f981a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43428/0 (socket says 10.20.193.28:43428) 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3501058099 learned_addr learned my addr 10.20.193.28:0/3501058099 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3501058099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f981134d0 msgr2=0x7f6f981a5fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f981134d0 0x7f6f981a5fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3501058099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f981065d0 msgr2=0x7f6f981a1c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f981065d0 0x7f6f981a1c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3501058099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f981a6760 con 0x7f6f98075950 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f98075950 0x7f6f981a1710 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f6f8802f800 tx=0x7f6f88002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f8dffb640 1 -- 10.20.193.28:0/3501058099 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88002d10 con 0x7f6f98075950 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f8dffb640 1 -- 10.20.193.28:0/3501058099 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f88004c60 con 0x7f6f98075950 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f8dffb640 1 -- 10.20.193.28:0/3501058099 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88038470 con 0x7f6f98075950 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.252+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/3501058099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f981a69f0 con 0x7f6f98075950 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/3501058099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f981ae290 con 0x7f6f98075950 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6f8dffb640 1 -- 10.20.193.28:0/3501058099 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6f880047c0 con 0x7f6f98075950 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6fa1540e00 1 Processor -- start 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6fa1540e00 1 -- start start 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d15722def0 0x55d15722e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d157228ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d157228ff0 0x55d157234d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d1571a7cf0 con 0x55d157228670 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d15717aa10 con 0x55d157228ff0 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.256+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d157128330 con 0x55d15722def0 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9d5b1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d15722def0 0x55d15722e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f8ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d157228ff0 0x55d157234d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9d5b1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d15722def0 0x55d15722e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43106/0 (socket says 10.20.193.28:43106) 2026-02-20T03:23:34.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9d5b1640 1 -- 10.20.193.28:0/3207802097 learned_addr learned my addr 10.20.193.28:0/3207802097 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f8dffb640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6f740b0e20 0x7f6f740b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f8dffb640 1 -- 10.20.193.28:0/3501058099 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6f881053d0 con 0x7f6f98075950 2026-02-20T03:23:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9d5b1640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6f740b0e20 0x7f6f740b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3207802097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d157228ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3207802097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d15722def0 msgr2=0x55d15722e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3207802097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d15722def0 0x55d15722e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3207802097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d157228ff0 msgr2=0x55d157234d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3207802097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d157228ff0 0x55d157234d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3207802097 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15713b510 con 0x55d157228670 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9d5b1640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6f740b0e20 0x7f6f740b32e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6f94010530 tx=0x7f6f94009970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3207802097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d157228ab0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f6f88102a40 tx=0x7f6f880cce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ef56de8ea54fd2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f654e4640 1 -- 10.20.193.28:0/3207802097 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f880cd7b0 con 0x55d157228670 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f654e4640 1 -- 10.20.193.28:0/3207802097 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f88033030 con 0x55d157228670 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6f654e4640 1 -- 10.20.193.28:0/3207802097 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f880c90f0 con 0x55d157228670 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3207802097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 msgr2=0x55d157228ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3207802097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d157228ab0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f6f88102a40 tx=0x7f6f880cce80 comp rx=0 tx=0).stop 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3207802097 shutdown_connections 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3207802097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d157228ff0 0x55d157234d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3207802097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d157228ab0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3207802097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d15722def0 0x55d15722e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.259+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3207802097 >> 10.20.193.28:0/3207802097 conn(0x55d1571eb4b0 msgr2=0x55d157226f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3207802097 shutdown_connections 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3207802097 wait complete. 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- start start 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 Processor -- start 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228670 0x55d157241d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157242270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 0x55d1572404e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d157176940 con 0x55d157228ff0 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d156fdc910 con 0x55d15722def0 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d157240b20 con 0x55d157228670 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157242270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157242270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43440/0 (socket says 10.20.193.28:43440) 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f8ffff640 1 -- 10.20.193.28:0/2267701740 learned_addr learned my addr 10.20.193.28:0/2267701740 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f8ffff640 1 -- 10.20.193.28:0/2267701740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228670 msgr2=0x55d157241d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f8ffff640 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228670 0x55d157241d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f8ffff640 1 -- 10.20.193.28:0/2267701740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 msgr2=0x55d1572404e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f8ffff640 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 0x55d1572404e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f8ffff640 1 -- 10.20.193.28:0/2267701740 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15723a800 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f8ffff640 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157242270 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000d260 tx=0x7f6f8000d730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f15fa2a5b8747e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f567fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f567fc640 1 -- 10.20.193.28:0/2267701740 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800042e0 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f567fc640 1 -- 10.20.193.28:0/2267701740 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f80017070 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f567fc640 1 -- 10.20.193.28:0/2267701740 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f80012840 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- 10.20.193.28:0/2267701740 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d156f4a110 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f567fc640 1 -- 10.20.193.28:0/2267701740 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6f800129e0 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f567fc640 10 client.17742 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 10 client.17742 _ll_register_callbacks cb 0x55d157125e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- 10.20.193.28:0/2267701740 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d157182600 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f567fc640 1 -- 10.20.193.28:0/2267701740 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f80012be0 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 10 client.17742 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- 10.20.193.28:0/2267701740 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55d15710adb0 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6f567fc640 1 -- 10.20.193.28:0/2267701740 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6f80002780 con 0x55d157228ff0 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 10 client.17742 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 10 client.17742 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 20 client.17742 populate_metadata read hostname 'trial028' 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d157250570 0x55d157252a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 4 client.17742 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.261+0000 7f6fa1540e00 1 -- 10.20.193.28:0/2267701740 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1570fcb70 con 0x55d157250570 2026-02-20T03:23:34.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.273+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d157250570 0x55d157252a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.300+0000 7f6f567fc640 10 client.17742 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:34.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.299+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d157250570 0x55d157252a00 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52dc02da890ffe40 server_cookie=88c5523e0221d7c2 in_seq=0 out_seq=0 2026-02-20T03:23:34.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6f567fc640 1 -- 10.20.193.28:0/2267701740 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d1570fcb70 con 0x55d157250570 2026-02-20T03:23:34.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6f567fc640 10 client.17742 handle_command_reply: tid=0 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 client.17742 shutdown 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 -- 10.20.193.28:0/2267701740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 msgr2=0x55d157242270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157242270 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000d260 tx=0x7f6f8000d730 comp rx=0 tx=0).stop 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 -- 10.20.193.28:0/2267701740 shutdown_connections 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d157250570 0x55d157252a00 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 0x55d1572404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157242270 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/2267701740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228670 0x55d157241d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 -- 10.20.193.28:0/2267701740 >> 10.20.193.28:0/2267701740 conn(0x55d1571eb4b0 msgr2=0x55d157227660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6f567fc640 0 client.17742 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 -- 10.20.193.28:0/2267701740 shutdown_connections 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 1 -- 10.20.193.28:0/2267701740 wait complete. 2026-02-20T03:23:34.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.314+0000 7f6fa1540e00 20 client.17742 trim_cache size 0 max 16384 2026-02-20T03:23:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6fa1540e00 1 Processor -- start 2026-02-20T03:23:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6fa1540e00 1 -- start start 2026-02-20T03:23:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d1572582d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228ff0 0x55d157258810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 0x55d157247c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c0127c0 con 0x55d157228670 2026-02-20T03:23:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c010090 con 0x55d15722def0 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c00dee0 con 0x55d157228ff0 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f9cdb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d1572582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f9cdb0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d1572582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43446/0 (socket says 10.20.193.28:43446) 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3351916250 learned_addr learned my addr 10.20.193.28:0/3351916250 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3351916250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228ff0 msgr2=0x55d157258810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3351916250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228ff0 0x55d157258810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3351916250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 msgr2=0x55d157247c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3351916250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 0x55d157247c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f9cdb0640 1 -- 10.20.193.28:0/3351916250 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15722e640 con 0x55d157228670 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3351916250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d1572582d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6f8802fa60 tx=0x7f6f88005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a191d00253fd34 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f64ce3640 1 -- 10.20.193.28:0/3351916250 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f880d1460 con 0x55d157228670 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f64ce3640 1 -- 10.20.193.28:0/3351916250 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f880d6310 con 0x55d157228670 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.319+0000 7f6f64ce3640 1 -- 10.20.193.28:0/3351916250 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f88102b50 con 0x55d157228670 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3351916250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 msgr2=0x55d1572582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3351916250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d1572582d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6f8802fa60 tx=0x7f6f88005280 comp rx=0 tx=0).stop 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3351916250 shutdown_connections 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3351916250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 0x55d157247c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3351916250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228ff0 0x55d157258810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3351916250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228670 0x55d1572582d0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3351916250 >> 10.20.193.28:0/3351916250 conn(0x55d1571eb4b0 msgr2=0x55d15723cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3351916250 shutdown_connections 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3351916250 wait complete. 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- start start 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 Processor -- start 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228670 0x55d1572454d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157245a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 0x55d157247b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c00e550 con 0x55d157228ff0 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c00f9c0 con 0x55d15722def0 2026-02-20T03:23:34.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c00ec20 con 0x55d157228670 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157245a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157245a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43452/0 (socket says 10.20.193.28:43452) 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f8ffff640 1 -- 10.20.193.28:0/3308857622 learned_addr learned my addr 10.20.193.28:0/3308857622 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f8ffff640 1 -- 10.20.193.28:0/3308857622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228670 msgr2=0x55d1572454d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f8ffff640 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228670 0x55d1572454d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f8ffff640 1 -- 10.20.193.28:0/3308857622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 msgr2=0x55d157247b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f8ffff640 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 0x55d157247b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f8ffff640 1 -- 10.20.193.28:0/3308857622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d15723a630 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f8ffff640 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157245a10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x55d1572393c0 tx=0x7f6f8000dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254285944f96024c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f567fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f567fc640 1 -- 10.20.193.28:0/3308857622 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8002a030 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f567fc640 1 -- 10.20.193.28:0/3308857622 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f80017030 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f567fc640 1 -- 10.20.193.28:0/3308857622 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800042e0 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3308857622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d156ede8d0 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f567fc640 1 -- 10.20.193.28:0/3308857622 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6f8002f460 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 10 client.17748 _ll_register_callbacks cb 0x7f6f8000bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3308857622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d156eeaf90 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f567fc640 1 -- 10.20.193.28:0/3308857622 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f80012420 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 10 client.17748 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3308857622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55d157138060 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6f567fc640 1 -- 10.20.193.28:0/3308857622 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6f8002f660 con 0x55d157228ff0 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 10 client.17748 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 10 client.17748 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 20 client.17748 populate_metadata read hostname 'trial028' 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d1572bd250 0x55d1572bf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 4 client.17748 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.15, "await_for": 45.0}] 2026-02-20T03:23:34.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.324+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3308857622 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.15, "await_for": 45.0}) -- 0x55d15714b960 con 0x55d1572bd250 2026-02-20T03:23:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.341+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d1572bd250 0x55d1572bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.395+0000 7f6f9cdb0640 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d1572bd250 0x55d1572bf710 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56b1f965221225b8 server_cookie=86b17bffc1c3ec0f in_seq=0 out_seq=0 2026-02-20T03:23:34.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:34.395+0000 7f6f567fc640 10 client.17748 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:34.452 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:34 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1020503920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:34.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.54 MB/sec execute 307 sec latency 2035.809 ms 2026-02-20T03:23:34.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:34 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1020503920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:34 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1020503920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:35.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f567fc640 1 -- 10.20.193.28:0/3308857622 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55d15714b960 con 0x55d1572bd250 2026-02-20T03:23:35.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f567fc640 10 client.17748 handle_command_reply: tid=0 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 client.17748 shutdown 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3308857622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 msgr2=0x55d157245a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157245a10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x55d1572393c0 tx=0x7f6f8000dd50 comp rx=0 tx=0).stop 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3308857622 shutdown_connections 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d1572bd250 0x55d1572bf710 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d15722def0 0x55d157247b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d157228ff0 0x55d157245a10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 --2- 10.20.193.28:0/3308857622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d157228670 0x55d1572454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3308857622 >> 10.20.193.28:0/3308857622 conn(0x55d1571eb4b0 msgr2=0x55d15723d600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:35.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f567fc640 0 client.17748 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:35.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3308857622 shutdown_connections 2026-02-20T03:23:35.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 1 -- 10.20.193.28:0/3308857622 wait complete. 2026-02-20T03:23:35.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6fa1540e00 20 client.17748 trim_cache size 0 max 16384 2026-02-20T03:23:35.050 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:23:35.050 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T03:23:35.050 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:23:35.050 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 30, 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "f09dd84": { 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "version": 30, 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 148.2, 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:23:35.051 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:23:35.052 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:23:35.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6f740b0e20 msgr2=0x7f6f740b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:35.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6f740b0e20 0x7f6f740b32e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6f94010530 tx=0x7f6f94009970 comp rx=0 tx=0).stop 2026-02-20T03:23:35.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f98075950 msgr2=0x7f6f981a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:35.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f98075950 0x7f6f981a1710 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f6f8802f800 tx=0x7f6f88002910 comp rx=0 tx=0).stop 2026-02-20T03:23:35.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/3501058099 shutdown_connections 2026-02-20T03:23:35.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6f740b0e20 0x7f6f740b32e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:35.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f981134d0 0x7f6f981a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:35.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f981065d0 0x7f6f981a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:35.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 --2- 10.20.193.28:0/3501058099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f98075950 0x7f6f981a1710 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:35.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/3501058099 >> 10.20.193.28:0/3501058099 conn(0x7f6f980fe440 msgr2=0x7f6f98114cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:35.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/3501058099 shutdown_connections 2026-02-20T03:23:35.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:35.046+0000 7f6f9ddb2640 1 -- 10.20.193.28:0/3501058099 wait complete. 2026-02-20T03:23:35.148 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f09dd84', quiesce took 2.3 seconds. Will release after: 25.849999999999998 2026-02-20T03:23:35.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.52 MB/sec execute 308 sec latency 1238.110 ms 2026-02-20T03:23:35.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:35 trial126 ceph-mon[38476]: pgmap v448: 129 pgs: 129 active+clean; 139 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 488 KiB/s rd, 3.0 MiB/s wr, 206 op/s 2026-02-20T03:23:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:35 trial028 ceph-mon[38552]: pgmap v448: 129 pgs: 129 active+clean; 139 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 488 KiB/s rd, 3.0 MiB/s wr, 206 op/s 2026-02-20T03:23:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:35 trial177 ceph-mon[43181]: pgmap v448: 129 pgs: 129 active+clean; 139 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 488 KiB/s rd, 3.0 MiB/s wr, 206 op/s 2026-02-20T03:23:36.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.49 MB/sec execute 309 sec latency 2238.147 ms 2026-02-20T03:23:37.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.46 MB/sec execute 310 sec latency 3238.207 ms 2026-02-20T03:23:37.574 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:37 trial028 ceph-mon[38552]: pgmap v449: 129 pgs: 129 active+clean; 131 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 732 KiB/s rd, 3.0 MiB/s wr, 252 op/s 2026-02-20T03:23:37.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:37 trial126 ceph-mon[38476]: pgmap v449: 129 pgs: 129 active+clean; 131 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 732 KiB/s rd, 3.0 MiB/s wr, 252 op/s 2026-02-20T03:23:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:37 trial177 ceph-mon[43181]: pgmap v449: 129 pgs: 129 active+clean; 131 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 732 KiB/s rd, 3.0 MiB/s wr, 252 op/s 2026-02-20T03:23:38.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.43 MB/sec execute 311 sec latency 4238.250 ms 2026-02-20T03:23:39.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.41 MB/sec execute 312 sec latency 5238.294 ms 2026-02-20T03:23:39.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:39 trial126 ceph-mon[38476]: pgmap v450: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 619 KiB/s rd, 2.8 MiB/s wr, 237 op/s 2026-02-20T03:23:39.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:39 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:23:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:39 trial028 ceph-mon[38552]: pgmap v450: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 619 KiB/s rd, 2.8 MiB/s wr, 237 op/s 2026-02-20T03:23:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:39 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:23:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:39 trial177 ceph-mon[43181]: pgmap v450: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 619 KiB/s rd, 2.8 MiB/s wr, 237 op/s 2026-02-20T03:23:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:39 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:23:40.513 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.38 MB/sec execute 313 sec latency 6238.343 ms 2026-02-20T03:23:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:23:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:23:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:23:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:23:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:23:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:23:40.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:23:40.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:23:40.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:23:41.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.35 MB/sec execute 314 sec latency 7238.398 ms 2026-02-20T03:23:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:41 trial126 ceph-mon[38476]: pgmap v451: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 659 KiB/s rd, 2.7 MiB/s wr, 240 op/s 2026-02-20T03:23:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:41 trial028 ceph-mon[38552]: pgmap v451: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 659 KiB/s rd, 2.7 MiB/s wr, 240 op/s 2026-02-20T03:23:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:41 trial177 ceph-mon[43181]: pgmap v451: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 659 KiB/s rd, 2.7 MiB/s wr, 240 op/s 2026-02-20T03:23:42.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.33 MB/sec execute 315 sec latency 8238.431 ms 2026-02-20T03:23:43.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.30 MB/sec execute 316 sec latency 9238.479 ms 2026-02-20T03:23:43.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:43 trial126 ceph-mon[38476]: pgmap v452: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 313 KiB/s rd, 1.8 MiB/s wr, 167 op/s 2026-02-20T03:23:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:43 trial028 ceph-mon[38552]: pgmap v452: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 313 KiB/s rd, 1.8 MiB/s wr, 167 op/s 2026-02-20T03:23:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:43 trial177 ceph-mon[43181]: pgmap v452: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 313 KiB/s rd, 1.8 MiB/s wr, 167 op/s 2026-02-20T03:23:44.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.27 MB/sec execute 317 sec latency 10238.521 ms 2026-02-20T03:23:45.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.25 MB/sec execute 318 sec latency 11238.567 ms 2026-02-20T03:23:45.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:45 trial126 ceph-mon[38476]: pgmap v453: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 314 KiB/s rd, 1.5 MiB/s wr, 161 op/s 2026-02-20T03:23:45.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:45 trial028 ceph-mon[38552]: pgmap v453: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 314 KiB/s rd, 1.5 MiB/s wr, 161 op/s 2026-02-20T03:23:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:45 trial177 ceph-mon[43181]: pgmap v453: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 314 KiB/s rd, 1.5 MiB/s wr, 161 op/s 2026-02-20T03:23:46.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.22 MB/sec execute 319 sec latency 12238.607 ms 2026-02-20T03:23:46.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 -- 10.20.193.28:0/2106280934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4840109490 msgr2=0x7f4840109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:46.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 --2- 10.20.193.28:0/2106280934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4840109490 0x7f4840109890 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f4834009960 tx=0x7f483402f140 comp rx=0 tx=0).stop 2026-02-20T03:23:46.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 -- 10.20.193.28:0/2106280934 shutdown_connections 2026-02-20T03:23:46.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 --2- 10.20.193.28:0/2106280934 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f484010a900 0x7f4840111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 --2- 10.20.193.28:0/2106280934 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4840109e60 0x7f484010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 --2- 10.20.193.28:0/2106280934 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4840109490 0x7f4840109890 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 -- 10.20.193.28:0/2106280934 >> 10.20.193.28:0/2106280934 conn(0x7f4840077fe0 msgr2=0x7f484007a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:46.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 -- 10.20.193.28:0/2106280934 shutdown_connections 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 -- 10.20.193.28:0/2106280934 wait complete. 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.949+0000 7f483ffff640 1 Processor -- start 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483ffff640 1 -- start start 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4840109490 0x7f48401a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4840109e60 0x7f48401a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f484010a900 0x7f48401a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4840114910 con 0x7f484010a900 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4840114790 con 0x7f4840109490 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4840114a90 con 0x7f4840109e60 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483e7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4840109e60 0x7f48401a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f484010a900 0x7f48401a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483e7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4840109e60 0x7f48401a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52618/0 (socket says 10.20.193.28:52618) 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483e7fc640 1 -- 10.20.193.28:0/2699633640 learned_addr learned my addr 10.20.193.28:0/2699633640 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483effd640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4840109490 0x7f48401a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483f7fe640 1 -- 10.20.193.28:0/2699633640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4840109e60 msgr2=0x7f48401a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483f7fe640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4840109e60 0x7f48401a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483f7fe640 1 -- 10.20.193.28:0/2699633640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4840109490 msgr2=0x7f48401a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483f7fe640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4840109490 0x7f48401a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.950+0000 7f483f7fe640 1 -- 10.20.193.28:0/2699633640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48401a8c30 con 0x7f484010a900 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.951+0000 7f483f7fe640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f484010a900 0x7f48401a8530 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f483000efc0 tx=0x7f483000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.951+0000 7f481ffff640 1 -- 10.20.193.28:0/2699633640 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830019070 con 0x7f484010a900 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.951+0000 7f481ffff640 1 -- 10.20.193.28:0/2699633640 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f48300092d0 con 0x7f484010a900 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.951+0000 7f483ffff640 1 -- 10.20.193.28:0/2699633640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48401a8ec0 con 0x7f484010a900 2026-02-20T03:23:46.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.951+0000 7f481ffff640 1 -- 10.20.193.28:0/2699633640 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4830019070 con 0x7f484010a900 2026-02-20T03:23:46.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.951+0000 7f483ffff640 1 -- 10.20.193.28:0/2699633640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48401a9380 con 0x7f484010a900 2026-02-20T03:23:46.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.954+0000 7f481ffff640 1 -- 10.20.193.28:0/2699633640 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4830004760 con 0x7f484010a900 2026-02-20T03:23:46.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.954+0000 7f484847be00 1 Processor -- start 2026-02-20T03:23:46.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.954+0000 7f484847be00 1 -- start start 2026-02-20T03:23:46.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.954+0000 7f484847be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c07fb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.954+0000 7f484847be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c07fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.954+0000 7f484847be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 0x5576c08029f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.954+0000 7f484847be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5576c074b8f0 con 0x5576c07fb7c0 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.954+0000 7f484847be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5576c06f92e0 con 0x5576c07fae80 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.954+0000 7f484847be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5576c0747820 con 0x5576c0800560 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c07fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c07fff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59698/0 (socket says 10.20.193.28:59698) 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483effd640 1 -- 10.20.193.28:0/4267262727 learned_addr learned my addr 10.20.193.28:0/4267262727 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483e7fc640 1 --2- 10.20.193.28:0/4267262727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 0x5576c08029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483e7fc640 1 --2- 10.20.193.28:0/4267262727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c07fb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483effd640 1 -- 10.20.193.28:0/4267262727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 msgr2=0x5576c08029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483effd640 1 --2- 10.20.193.28:0/4267262727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 0x5576c08029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483effd640 1 -- 10.20.193.28:0/4267262727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 msgr2=0x5576c07fb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483effd640 1 --2- 10.20.193.28:0/4267262727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c07fb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483effd640 1 -- 10.20.193.28:0/4267262727 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c06eb5a0 con 0x5576c07fb7c0 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f483effd640 1 --2- 10.20.193.28:0/4267262727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c07fff40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4834037000 tx=0x7f4834005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff4985bc6adbf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f48077fe640 1 -- 10.20.193.28:0/4267262727 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48340384f0 con 0x5576c07fb7c0 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f48077fe640 1 -- 10.20.193.28:0/4267262727 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4834033040 con 0x5576c07fb7c0 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f481ffff640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48100b0fa0 0x7f48100b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f484847be00 1 -- 10.20.193.28:0/4267262727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 msgr2=0x5576c07fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f481ffff640 1 -- 10.20.193.28:0/2699633640 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f48300e0590 con 0x7f484010a900 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.955+0000 7f484847be00 1 --2- 10.20.193.28:0/4267262727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c07fff40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4834037000 tx=0x7f4834005d90 comp rx=0 tx=0).stop 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.956+0000 7f483e7fc640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48100b0fa0 0x7f48100b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.956+0000 7f484847be00 1 -- 10.20.193.28:0/4267262727 shutdown_connections 2026-02-20T03:23:46.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.956+0000 7f484847be00 1 --2- 10.20.193.28:0/4267262727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 0x5576c08029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.956+0000 7f484847be00 1 --2- 10.20.193.28:0/4267262727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c07fff40 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.956+0000 7f484847be00 1 --2- 10.20.193.28:0/4267262727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c07fb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.956+0000 7f484847be00 1 -- 10.20.193.28:0/4267262727 >> 10.20.193.28:0/4267262727 conn(0x5576c07f26f0 msgr2=0x5576c07f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:46.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.956+0000 7f484847be00 1 -- 10.20.193.28:0/4267262727 shutdown_connections 2026-02-20T03:23:46.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.956+0000 7f484847be00 1 -- 10.20.193.28:0/4267262727 wait complete. 2026-02-20T03:23:46.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.957+0000 7f483e7fc640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48100b0fa0 0x7f48100b3460 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4828004210 tx=0x7f4828009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.957+0000 7f484847be00 1 -- start start 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.957+0000 7f484847be00 1 Processor -- start 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.957+0000 7f484847be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c08138e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.957+0000 7f484847be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c0813e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.957+0000 7f484847be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 0x5576c081ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.957+0000 7f484847be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5576c06f30c0 con 0x5576c07fb7c0 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.957+0000 7f484847be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5576c0803600 con 0x5576c07fae80 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.957+0000 7f484847be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5576c081b330 con 0x5576c0800560 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c0813e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483effd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c08138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c0813e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59700/0 (socket says 10.20.193.28:59700) 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483e7fc640 1 -- 10.20.193.28:0/889128189 learned_addr learned my addr 10.20.193.28:0/889128189 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483f7fe640 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 0x5576c081ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483e7fc640 1 -- 10.20.193.28:0/889128189 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 msgr2=0x5576c081ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483e7fc640 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 0x5576c081ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483e7fc640 1 -- 10.20.193.28:0/889128189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 msgr2=0x5576c08138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483e7fc640 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c08138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483e7fc640 1 -- 10.20.193.28:0/889128189 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c080d080 con 0x5576c07fb7c0 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483effd640 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c08138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f483e7fc640 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c0813e20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4828010850 tx=0x7f48280041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65fe6766aa7507fe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f4804ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:46.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f4804ff9640 1 -- 10.20.193.28:0/889128189 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482802c070 con 0x5576c07fb7c0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f4804ff9640 1 -- 10.20.193.28:0/889128189 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4828004490 con 0x5576c07fb7c0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f4804ff9640 1 -- 10.20.193.28:0/889128189 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828027410 con 0x5576c07fb7c0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.958+0000 7f484847be00 1 -- 10.20.193.28:0/889128189 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c0707820 con 0x5576c07fb7c0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f4804ff9640 1 -- 10.20.193.28:0/889128189 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f482801c3d0 con 0x5576c07fb7c0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 10 client.17760 _ll_register_callbacks cb 0x5576c06f6ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 1 -- 10.20.193.28:0/889128189 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5576c07534e0 con 0x5576c07fb7c0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f4804ff9640 1 -- 10.20.193.28:0/889128189 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f482801d470 con 0x5576c07fb7c0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 10 client.17760 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 1 -- 10.20.193.28:0/889128189 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5576c070c380 con 0x5576c07fb7c0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f4804ff9640 1 -- 10.20.193.28:0/889128189 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f482801f990 con 0x5576c07fb7c0 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 10 client.17760 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 10 client.17760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:46.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 20 client.17760 populate_metadata read hostname 'trial028' 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5576c081f6f0 0x5576c0821b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 4 client.17760 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f484847be00 1 -- 10.20.193.28:0/889128189 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576c06cdbd0 con 0x5576c081f6f0 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.959+0000 7f483effd640 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5576c081f6f0 0x5576c0821b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.960+0000 7f483effd640 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5576c081f6f0 0x5576c0821b90 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb61bad62cde92e7 server_cookie=d7af87292aeabc3a in_seq=0 out_seq=0 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.960+0000 7f4804ff9640 10 client.17760 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.960+0000 7f4804ff9640 1 -- 10.20.193.28:0/889128189 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5576c06cdbd0 con 0x5576c081f6f0 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.960+0000 7f4804ff9640 10 client.17760 handle_command_reply: tid=0 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.960+0000 7f484847be00 1 client.17760 shutdown 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.960+0000 7f484847be00 1 -- 10.20.193.28:0/889128189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 msgr2=0x5576c0813e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:46.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.960+0000 7f484847be00 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c0813e20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4828010850 tx=0x7f48280041a0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f484847be00 1 -- 10.20.193.28:0/889128189 shutdown_connections 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f484847be00 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5576c081f6f0 0x5576c0821b90 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f484847be00 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c0800560 0x5576c081ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f484847be00 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c0813e20 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f484847be00 1 --2- 10.20.193.28:0/889128189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c08138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f484847be00 1 -- 10.20.193.28:0/889128189 >> 10.20.193.28:0/889128189 conn(0x5576c07f26f0 msgr2=0x5576c0801910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f4804ff9640 0 client.17760 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f484847be00 1 -- 10.20.193.28:0/889128189 shutdown_connections 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f484847be00 1 -- 10.20.193.28:0/889128189 wait complete. 2026-02-20T03:23:46.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.961+0000 7f484847be00 20 client.17760 trim_cache size 0 max 16384 2026-02-20T03:23:46.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f484847be00 1 Processor -- start 2026-02-20T03:23:46.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f484847be00 1 -- start start 2026-02-20T03:23:46.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f484847be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fae80 0x5576c07f9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f484847be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c081ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f484847be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c0800560 0x5576c07fbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f484847be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47e40126f0 con 0x5576c07fb7c0 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f484847be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f47e400ffc0 con 0x5576c0800560 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f484847be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f47e400de10 con 0x5576c07fae80 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f483effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fae80 0x5576c07f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f483e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c081ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f483f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c0800560 0x5576c07fbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f483f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c0800560 0x5576c07fbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49544/0 (socket says 10.20.193.28:49544) 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f483f7fe640 1 -- 10.20.193.28:0/2455769726 learned_addr learned my addr 10.20.193.28:0/2455769726 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f483effd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fae80 0x5576c07f9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52640/0 (socket says 10.20.193.28:52640) 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f483e7fc640 1 -- 10.20.193.28:0/2455769726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fae80 msgr2=0x5576c07f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f483e7fc640 1 --2- 10.20.193.28:0/2455769726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fae80 0x5576c07f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.970+0000 7f483e7fc640 1 -- 10.20.193.28:0/2455769726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c0800560 msgr2=0x5576c07fbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:46.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f483e7fc640 1 --2- 10.20.193.28:0/2455769726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c0800560 0x5576c07fbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f483e7fc640 1 -- 10.20.193.28:0/2455769726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c080ceb0 con 0x5576c07fb7c0 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f483e7fc640 1 --2- 10.20.193.28:0/2455769726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c081ad60 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f48280104d0 tx=0x7f482802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bbf416ac3e761c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f4806ffd640 1 -- 10.20.193.28:0/2455769726 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482802c070 con 0x5576c07fb7c0 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f4806ffd640 1 -- 10.20.193.28:0/2455769726 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5576c07534e0 con 0x5576c07fb7c0 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f4806ffd640 1 -- 10.20.193.28:0/2455769726 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828005520 con 0x5576c07fb7c0 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f484847be00 1 -- 10.20.193.28:0/2455769726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 msgr2=0x5576c081ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f484847be00 1 --2- 10.20.193.28:0/2455769726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c081ad60 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f48280104d0 tx=0x7f482802f000 comp rx=0 tx=0).stop 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f484847be00 1 -- 10.20.193.28:0/2455769726 shutdown_connections 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f484847be00 1 --2- 10.20.193.28:0/2455769726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c0800560 0x5576c07fbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f484847be00 1 --2- 10.20.193.28:0/2455769726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c07fb7c0 0x5576c081ad60 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f484847be00 1 --2- 10.20.193.28:0/2455769726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fae80 0x5576c07f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f484847be00 1 -- 10.20.193.28:0/2455769726 >> 10.20.193.28:0/2455769726 conn(0x5576c07f26f0 msgr2=0x5576c07f8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:46.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f484847be00 1 -- 10.20.193.28:0/2455769726 shutdown_connections 2026-02-20T03:23:46.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.971+0000 7f484847be00 1 -- 10.20.193.28:0/2455769726 wait complete. 2026-02-20T03:23:46.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f484847be00 1 -- start start 2026-02-20T03:23:46.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f484847be00 1 Processor -- start 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f484847be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c0818570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f484847be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fb7c0 0x5576c0818ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f484847be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c0800560 0x5576c0819a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f484847be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47e400e480 con 0x5576c0800560 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f484847be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f47e400f8f0 con 0x5576c07fae80 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f484847be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f47e400eb50 con 0x5576c07fb7c0 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f483f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c0800560 0x5576c0819a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f483e7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fb7c0 0x5576c0818ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f483e7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fb7c0 0x5576c0818ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52648/0 (socket says 10.20.193.28:52648) 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f483e7fc640 1 -- 10.20.193.28:0/1677228001 learned_addr learned my addr 10.20.193.28:0/1677228001 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:46.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f483f7fe640 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c0800560 0x5576c0819a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59728/0 (socket says 10.20.193.28:59728) 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.972+0000 7f483effd640 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c0818570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f483e7fc640 1 -- 10.20.193.28:0/1677228001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 msgr2=0x5576c0818570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f483e7fc640 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c0818570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f483e7fc640 1 -- 10.20.193.28:0/1677228001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c0800560 msgr2=0x5576c0819a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f483e7fc640 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c0800560 0x5576c0819a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f483e7fc640 1 -- 10.20.193.28:0/1677228001 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c04ab690 con 0x5576c07fb7c0 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f483f7fe640 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c0800560 0x5576c0819a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f483e7fc640 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fb7c0 0x5576c0818ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4828004610 tx=0x7f4828005f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71e1ecba87739a78 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f4804ff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f4804ff9640 1 -- 10.20.193.28:0/1677228001 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f482802c040 con 0x5576c07fb7c0 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f4804ff9640 1 -- 10.20.193.28:0/1677228001 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4828004bd0 con 0x5576c07fb7c0 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f484847be00 1 -- 10.20.193.28:0/1677228001 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c0710b70 con 0x5576c07fb7c0 2026-02-20T03:23:46.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f4804ff9640 1 -- 10.20.193.28:0/1677228001 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4828031440 con 0x5576c07fb7c0 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f4804ff9640 1 -- 10.20.193.28:0/1677228001 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f48280315e0 con 0x5576c07fb7c0 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f484847be00 10 client.26947 _ll_register_callbacks cb 0x7f4828010500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f484847be00 1 -- 10.20.193.28:0/1677228001 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4834033040 con 0x5576c07fb7c0 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.973+0000 7f4804ff9640 1 -- 10.20.193.28:0/1677228001 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f482801d610 con 0x5576c07fb7c0 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f484847be00 10 client.26947 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f484847be00 1 -- 10.20.193.28:0/1677228001 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5576c080dba0 con 0x5576c07fb7c0 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f4804ff9640 1 -- 10.20.193.28:0/1677228001 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4828005220 con 0x5576c07fb7c0 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f484847be00 10 client.26947 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f484847be00 10 client.26947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f484847be00 20 client.26947 populate_metadata read hostname 'trial028' 2026-02-20T03:23:46.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f484847be00 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5576c088a730 0x5576c088cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:46.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f484847be00 4 client.26947 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:23:46.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f484847be00 1 -- 10.20.193.28:0/1677228001 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5576c0524520 con 0x5576c088a730 2026-02-20T03:23:46.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f483effd640 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5576c088a730 0x5576c088cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:46.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f483effd640 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5576c088a730 0x5576c088cbc0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a632884ae65c3cb3 server_cookie=77d379ffda910728 in_seq=0 out_seq=0 2026-02-20T03:23:46.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.974+0000 7f4804ff9640 10 client.26947 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:46.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f4804ff9640 1 -- 10.20.193.28:0/1677228001 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5576c0524520 con 0x5576c088a730 2026-02-20T03:23:46.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f4804ff9640 10 client.26947 handle_command_reply: tid=0 2026-02-20T03:23:46.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 client.26947 shutdown 2026-02-20T03:23:46.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 -- 10.20.193.28:0/1677228001 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fb7c0 msgr2=0x5576c0818ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:46.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fb7c0 0x5576c0818ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4828004610 tx=0x7f4828005f70 comp rx=0 tx=0).stop 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 -- 10.20.193.28:0/1677228001 shutdown_connections 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5576c088a730 0x5576c088cbc0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5576c0800560 0x5576c0819a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5576c07fb7c0 0x5576c0818ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 --2- 10.20.193.28:0/1677228001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5576c07fae80 0x5576c0818570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f4804ff9640 0 client.26947 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 -- 10.20.193.28:0/1677228001 >> 10.20.193.28:0/1677228001 conn(0x5576c07f26f0 msgr2=0x5576c07f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 -- 10.20.193.28:0/1677228001 shutdown_connections 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 1 -- 10.20.193.28:0/1677228001 wait complete. 2026-02-20T03:23:46.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.990+0000 7f484847be00 20 client.26947 trim_cache size 0 max 16384 2026-02-20T03:23:46.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:23:46.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:23:46.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:23:46.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:23:46.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 -- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48100b0fa0 msgr2=0x7f48100b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:46.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48100b0fa0 0x7f48100b3460 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4828004210 tx=0x7f4828009340 comp rx=0 tx=0).stop 2026-02-20T03:23:46.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 -- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f484010a900 msgr2=0x7f48401a8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:46.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f484010a900 0x7f48401a8530 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f483000efc0 tx=0x7f483000c490 comp rx=0 tx=0).stop 2026-02-20T03:23:46.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 -- 10.20.193.28:0/2699633640 shutdown_connections 2026-02-20T03:23:46.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48100b0fa0 0x7f48100b3460 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f484010a900 0x7f48401a8530 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4840109e60 0x7f48401a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 --2- 10.20.193.28:0/2699633640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4840109490 0x7f48401a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:46.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 -- 10.20.193.28:0/2699633640 >> 10.20.193.28:0/2699633640 conn(0x7f4840077fe0 msgr2=0x7f484010d670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:46.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 -- 10.20.193.28:0/2699633640 shutdown_connections 2026-02-20T03:23:46.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:23:46.991+0000 7f483ffff640 1 -- 10.20.193.28:0/2699633640 wait complete. 2026-02-20T03:23:47.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.20 MB/sec execute 320 sec latency 13238.650 ms 2026-02-20T03:23:47.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:47 trial126 ceph-mon[38476]: pgmap v454: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 307 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2026-02-20T03:23:47.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:47 trial028 ceph-mon[38552]: pgmap v454: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 307 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2026-02-20T03:23:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:47 trial177 ceph-mon[43181]: pgmap v454: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 307 KiB/s rd, 1.1 MiB/s wr, 146 op/s 2026-02-20T03:23:48.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.17 MB/sec execute 321 sec latency 14238.708 ms 2026-02-20T03:23:49.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.15 MB/sec execute 322 sec latency 15238.755 ms 2026-02-20T03:23:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:49 trial028 ceph-mon[38552]: pgmap v455: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 672 KiB/s wr, 70 op/s 2026-02-20T03:23:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:49 trial177 ceph-mon[43181]: pgmap v455: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 672 KiB/s wr, 70 op/s 2026-02-20T03:23:49.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:49 trial126 ceph-mon[38476]: pgmap v455: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 59 KiB/s rd, 672 KiB/s wr, 70 op/s 2026-02-20T03:23:50.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.12 MB/sec execute 323 sec latency 16238.801 ms 2026-02-20T03:23:51.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.10 MB/sec execute 324 sec latency 17238.857 ms 2026-02-20T03:23:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:51 trial028 ceph-mon[38552]: pgmap v456: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 411 KiB/s wr, 49 op/s 2026-02-20T03:23:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:51 trial177 ceph-mon[43181]: pgmap v456: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 411 KiB/s wr, 49 op/s 2026-02-20T03:23:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:51 trial126 ceph-mon[38476]: pgmap v456: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 411 KiB/s wr, 49 op/s 2026-02-20T03:23:52.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.07 MB/sec execute 325 sec latency 18238.901 ms 2026-02-20T03:23:53.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.05 MB/sec execute 326 sec latency 19238.943 ms 2026-02-20T03:23:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:53 trial028 ceph-mon[38552]: pgmap v457: 129 pgs: 129 active+clean; 130 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 26 KiB/s rd, 352 KiB/s wr, 28 op/s 2026-02-20T03:23:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:53 trial177 ceph-mon[43181]: pgmap v457: 129 pgs: 129 active+clean; 130 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 26 KiB/s rd, 352 KiB/s wr, 28 op/s 2026-02-20T03:23:53.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:53 trial126 ceph-mon[38476]: pgmap v457: 129 pgs: 129 active+clean; 130 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 26 KiB/s rd, 352 KiB/s wr, 28 op/s 2026-02-20T03:23:54.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.02 MB/sec execute 327 sec latency 20238.986 ms 2026-02-20T03:23:55.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 8.00 MB/sec execute 328 sec latency 21239.033 ms 2026-02-20T03:23:55.633 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:23:55.688 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:55 trial028 ceph-mon[38552]: pgmap v458: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 319 KiB/s wr, 30 op/s 2026-02-20T03:23:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:55 trial177 ceph-mon[43181]: pgmap v458: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 319 KiB/s wr, 30 op/s 2026-02-20T03:23:55.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:55 trial126 ceph-mon[38476]: pgmap v458: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 27 KiB/s rd, 319 KiB/s wr, 30 op/s 2026-02-20T03:23:55.908 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:56.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.085+0000 7f6f26d06640 1 -- 10.20.193.28:0/3046500758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f201065d0 msgr2=0x7f6f20075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.085+0000 7f6f26d06640 1 --2- 10.20.193.28:0/3046500758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f201065d0 0x7f6f20075410 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009960 tx=0x7f6f1002f1d0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.085+0000 7f6f26d06640 1 -- 10.20.193.28:0/3046500758 shutdown_connections 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.085+0000 7f6f26d06640 1 --2- 10.20.193.28:0/3046500758 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f201134d0 0x7f6f20115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.085+0000 7f6f26d06640 1 --2- 10.20.193.28:0/3046500758 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f20075950 0x7f6f20075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.085+0000 7f6f26d06640 1 --2- 10.20.193.28:0/3046500758 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f201065d0 0x7f6f20075410 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.085+0000 7f6f26d06640 1 -- 10.20.193.28:0/3046500758 >> 10.20.193.28:0/3046500758 conn(0x7f6f200fe440 msgr2=0x7f6f20100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.085+0000 7f6f26d06640 1 -- 10.20.193.28:0/3046500758 shutdown_connections 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.085+0000 7f6f26d06640 1 -- 10.20.193.28:0/3046500758 wait complete. 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f26d06640 1 Processor -- start 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f26d06640 1 -- start start 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f26d06640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f20075950 0x7f6f201a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f26d06640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f201065d0 0x7f6f201a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f26d06640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f201134d0 0x7f6f201a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f26d06640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20119060 con 0x7f6f20075950 2026-02-20T03:23:56.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f26d06640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20118ee0 con 0x7f6f201065d0 2026-02-20T03:23:56.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f26d06640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201191e0 con 0x7f6f201134d0 2026-02-20T03:23:56.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f25d04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f20075950 0x7f6f201a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f25d04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f20075950 0x7f6f201a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52222/0 (socket says 10.20.193.28:52222) 2026-02-20T03:23:56.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.086+0000 7f6f25d04640 1 -- 10.20.193.28:0/2753870803 learned_addr learned my addr 10.20.193.28:0/2753870803 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:56.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f25503640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f201065d0 0x7f6f201a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f26505640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f201134d0 0x7f6f201a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f25d04640 1 -- 10.20.193.28:0/2753870803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f201134d0 msgr2=0x7f6f201a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f25d04640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f201134d0 0x7f6f201a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f25d04640 1 -- 10.20.193.28:0/2753870803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f201065d0 msgr2=0x7f6f201a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f25d04640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f201065d0 0x7f6f201a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f25d04640 1 -- 10.20.193.28:0/2753870803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f201a6510 con 0x7f6f20075950 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f26505640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f201134d0 0x7f6f201a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f25d04640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f20075950 0x7f6f201a14c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6f10004600 tx=0x7f6f10004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f0effd640 1 -- 10.20.193.28:0/2753870803 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10046070 con 0x7f6f20075950 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f0effd640 1 -- 10.20.193.28:0/2753870803 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f10038470 con 0x7f6f20075950 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f0effd640 1 -- 10.20.193.28:0/2753870803 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10041670 con 0x7f6f20075950 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f26d06640 1 -- 10.20.193.28:0/2753870803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f201a67a0 con 0x7f6f20075950 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.087+0000 7f6f26d06640 1 -- 10.20.193.28:0/2753870803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f201ae040 con 0x7f6f20075950 2026-02-20T03:23:56.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.090+0000 7f6f0effd640 1 -- 10.20.193.28:0/2753870803 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6f10038620 con 0x7f6f20075950 2026-02-20T03:23:56.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f0effd640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6efc0b0e20 0x7f6efc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f0effd640 1 -- 10.20.193.28:0/2753870803 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6f10104a00 con 0x7f6f20075950 2026-02-20T03:23:56.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f2a494e00 1 Processor -- start 2026-02-20T03:23:56.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f25503640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6efc0b0e20 0x7f6efc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f2a494e00 1 -- start start 2026-02-20T03:23:56.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 0x5617ae1143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10e630 0x5617ae10ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10efb0 0x5617ae11ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5617ae08ee50 con 0x5617ae10e630 2026-02-20T03:23:56.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5617ae0619c0 con 0x5617ae10efb0 2026-02-20T03:23:56.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5617ae00f240 con 0x5617ae114000 2026-02-20T03:23:56.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f25503640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10e630 0x5617ae10ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f25503640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6efc0b0e20 0x7f6efc0b32e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6f140097c0 tx=0x7f6f14009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:56.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f25d04640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 0x5617ae1143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f25503640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10e630 0x5617ae10ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52232/0 (socket says 10.20.193.28:52232) 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.092+0000 7f6f25503640 1 -- 10.20.193.28:0/405275558 learned_addr learned my addr 10.20.193.28:0/405275558 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6f26505640 1 --2- 10.20.193.28:0/405275558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10efb0 0x5617ae11ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6f25d04640 1 -- 10.20.193.28:0/405275558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10efb0 msgr2=0x5617ae11ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6f25d04640 1 --2- 10.20.193.28:0/405275558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10efb0 0x5617ae11ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6f25d04640 1 -- 10.20.193.28:0/405275558 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10e630 msgr2=0x5617ae10ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6f25d04640 1 --2- 10.20.193.28:0/405275558 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10e630 0x5617ae10ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6f25d04640 1 -- 10.20.193.28:0/405275558 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ae022420 con 0x5617ae114000 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6f25d04640 1 --2- 10.20.193.28:0/405275558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 0x5617ae1143e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6f10038940 tx=0x7f6f1002f1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=642d405a9d0498a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6eee4e6640 1 -- 10.20.193.28:0/405275558 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100d0a90 con 0x5617ae114000 2026-02-20T03:23:56.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6eee4e6640 1 -- 10.20.193.28:0/405275558 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f100f0020 con 0x5617ae114000 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.093+0000 7f6eee4e6640 1 -- 10.20.193.28:0/405275558 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100cb950 con 0x5617ae114000 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.094+0000 7f6f2a494e00 1 -- 10.20.193.28:0/405275558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 msgr2=0x5617ae1143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.094+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/405275558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 0x5617ae1143e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6f10038940 tx=0x7f6f1002f1d0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.094+0000 7f6f2a494e00 1 -- 10.20.193.28:0/405275558 shutdown_connections 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.094+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/405275558 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10efb0 0x5617ae11ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.094+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/405275558 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10e630 0x5617ae10ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.094+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/405275558 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 0x5617ae1143e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.094+0000 7f6f2a494e00 1 -- 10.20.193.28:0/405275558 >> 10.20.193.28:0/405275558 conn(0x5617ae0d1290 msgr2=0x5617ae10cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.094+0000 7f6f2a494e00 1 -- 10.20.193.28:0/405275558 shutdown_connections 2026-02-20T03:23:56.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.094+0000 7f6f2a494e00 1 -- 10.20.193.28:0/405275558 wait complete. 2026-02-20T03:23:56.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.095+0000 7f6f2a494e00 1 -- start start 2026-02-20T03:23:56.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.095+0000 7f6f2a494e00 1 Processor -- start 2026-02-20T03:23:56.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae128c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 0x5617ae1291b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1273b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5617ae05d8f0 con 0x5617ae114000 2026-02-20T03:23:56.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5617ade4ff50 con 0x5617ae10e630 2026-02-20T03:23:56.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5617ae127b30 con 0x5617ae10efb0 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f25d04640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae128c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f26505640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f25503640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 0x5617ae1291b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f25503640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 0x5617ae1291b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43940/0 (socket says 10.20.193.28:43940) 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f25503640 1 -- 10.20.193.28:0/673334714 learned_addr learned my addr 10.20.193.28:0/673334714 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f25d04640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae128c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53332/0 (socket says 10.20.193.28:53332) 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f26505640 1 -- 10.20.193.28:0/673334714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 msgr2=0x5617ae1291b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f26505640 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 0x5617ae1291b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f26505640 1 -- 10.20.193.28:0/673334714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 msgr2=0x5617ae128c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f26505640 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae128c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f26505640 1 -- 10.20.193.28:0/673334714 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ae120810 con 0x5617ae114000 2026-02-20T03:23:56.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6f26505640 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1273b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c004720 tx=0x7f6f1c013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359ed364c616847f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.096+0000 7f6edb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6edb7fe640 1 -- 10.20.193.28:0/673334714 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0092d0 con 0x5617ae114000 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6edb7fe640 1 -- 10.20.193.28:0/673334714 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f1c0048e0 con 0x5617ae114000 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6edb7fe640 1 -- 10.20.193.28:0/673334714 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c016810 con 0x5617ae114000 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6f2a494e00 1 -- 10.20.193.28:0/673334714 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ade32b40 con 0x5617ae114000 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6edb7fe640 1 -- 10.20.193.28:0/673334714 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6f1c0169b0 con 0x5617ae114000 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6edb7fe640 10 client.17778 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6f2a494e00 10 client.17778 _ll_register_callbacks cb 0x5617ae09af00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6f2a494e00 1 -- 10.20.193.28:0/673334714 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5617ae06f1a0 con 0x5617ae114000 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6edb7fe640 1 -- 10.20.193.28:0/673334714 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f1c016bb0 con 0x5617ae114000 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6f2a494e00 10 client.17778 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.097+0000 7f6f2a494e00 1 -- 10.20.193.28:0/673334714 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5617ae01c230 con 0x5617ae114000 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.098+0000 7f6edb7fe640 1 -- 10.20.193.28:0/673334714 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6f1c007500 con 0x5617ae114000 2026-02-20T03:23:56.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.098+0000 7f6f2a494e00 10 client.17778 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:56.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.098+0000 7f6f2a494e00 10 client.17778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:56.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.098+0000 7f6f2a494e00 20 client.17778 populate_metadata read hostname 'trial028' 2026-02-20T03:23:56.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.098+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617ae137380 0x5617ae139840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.098+0000 7f6f2a494e00 4 client.17778 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:56.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.098+0000 7f6f2a494e00 1 -- 10.20.193.28:0/673334714 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617ae0695b0 con 0x5617ae137380 2026-02-20T03:23:56.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.098+0000 7f6f25d04640 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617ae137380 0x5617ae139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.099+0000 7f6f25d04640 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617ae137380 0x5617ae139840 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=515bc9497c8a25cc server_cookie=ea9027c19207452c in_seq=0 out_seq=0 2026-02-20T03:23:56.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.099+0000 7f6edb7fe640 10 client.17778 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:56.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6edb7fe640 1 -- 10.20.193.28:0/673334714 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5617ae0695b0 con 0x5617ae137380 2026-02-20T03:23:56.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6edb7fe640 10 client.17778 handle_command_reply: tid=0 2026-02-20T03:23:56.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 client.17778 shutdown 2026-02-20T03:23:56.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 -- 10.20.193.28:0/673334714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 msgr2=0x5617ae1273b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1273b0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c004720 tx=0x7f6f1c013680 comp rx=0 tx=0).stop 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 -- 10.20.193.28:0/673334714 shutdown_connections 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617ae137380 0x5617ae139840 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1273b0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 0x5617ae1291b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/673334714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae128c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 -- 10.20.193.28:0/673334714 >> 10.20.193.28:0/673334714 conn(0x5617ae0d1290 msgr2=0x5617ae10d440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6edb7fe640 0 client.17778 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 -- 10.20.193.28:0/673334714 shutdown_connections 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 1 -- 10.20.193.28:0/673334714 wait complete. 2026-02-20T03:23:56.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.100+0000 7f6f2a494e00 20 client.17778 trim_cache size 0 max 16384 2026-02-20T03:23:56.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f2a494e00 1 Processor -- start 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f2a494e00 1 -- start start 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae106b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10efb0 0x5617ae124c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 0x5617ae13f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc012670 con 0x5617ae10efb0 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc00ff40 con 0x5617ae10e630 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc00dd90 con 0x5617ae114000 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f25503640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10efb0 0x5617ae124c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f25503640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10efb0 0x5617ae124c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52258/0 (socket says 10.20.193.28:52258) 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f25d04640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae106b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f25503640 1 -- 10.20.193.28:0/4077482666 learned_addr learned my addr 10.20.193.28:0/4077482666 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.109+0000 7f6f26505640 1 --2- 10.20.193.28:0/4077482666 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 0x5617ae13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f25503640 1 -- 10.20.193.28:0/4077482666 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 msgr2=0x5617ae13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f25503640 1 --2- 10.20.193.28:0/4077482666 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 0x5617ae13f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f25503640 1 -- 10.20.193.28:0/4077482666 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 msgr2=0x5617ae106b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f25503640 1 --2- 10.20.193.28:0/4077482666 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae106b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f25503640 1 -- 10.20.193.28:0/4077482666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ae127720 con 0x5617ae10efb0 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f25503640 1 --2- 10.20.193.28:0/4077482666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10efb0 0x5617ae124c70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f6f140095f0 tx=0x7f6f14014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236b0c978463d1ec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6eedce5640 1 -- 10.20.193.28:0/4077482666 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1402b070 con 0x5617ae10efb0 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6eedce5640 1 -- 10.20.193.28:0/4077482666 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f140268a0 con 0x5617ae10efb0 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6eedce5640 1 -- 10.20.193.28:0/4077482666 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1401b9a0 con 0x5617ae10efb0 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f2a494e00 1 -- 10.20.193.28:0/4077482666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10efb0 msgr2=0x5617ae124c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/4077482666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10efb0 0x5617ae124c70 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f6f140095f0 tx=0x7f6f14014000 comp rx=0 tx=0).stop 2026-02-20T03:23:56.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f2a494e00 1 -- 10.20.193.28:0/4077482666 shutdown_connections 2026-02-20T03:23:56.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/4077482666 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae114000 0x5617ae13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/4077482666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae10efb0 0x5617ae124c70 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/4077482666 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f2a494e00 1 -- 10.20.193.28:0/4077482666 >> 10.20.193.28:0/4077482666 conn(0x5617ae0d1290 msgr2=0x5617ae111ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:56.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.110+0000 7f6f2a494e00 1 -- 10.20.193.28:0/4077482666 shutdown_connections 2026-02-20T03:23:56.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.111+0000 7f6f2a494e00 1 -- 10.20.193.28:0/4077482666 wait complete. 2026-02-20T03:23:56.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.111+0000 7f6f2a494e00 1 -- start start 2026-02-20T03:23:56.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.111+0000 7f6f2a494e00 1 Processor -- start 2026-02-20T03:23:56.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae12b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 0x5617ae12b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f2a494e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1a1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc00e400 con 0x5617ae114000 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc00f870 con 0x5617ae10e630 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f2a494e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6ecc00ead0 con 0x5617ae10efb0 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25d04640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae12b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25d04640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae12b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53346/0 (socket says 10.20.193.28:53346) 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25d04640 1 -- 10.20.193.28:0/2788197858 learned_addr learned my addr 10.20.193.28:0/2788197858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25503640 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 0x5617ae12b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f26505640 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25d04640 1 -- 10.20.193.28:0/2788197858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 msgr2=0x5617ae12b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25d04640 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 0x5617ae12b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25d04640 1 -- 10.20.193.28:0/2788197858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 msgr2=0x5617ae1a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25d04640 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25d04640 1 -- 10.20.193.28:0/2788197858 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ae114750 con 0x5617ae10e630 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f26505640 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6f25d04640 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae12b0b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f100c9700 tx=0x7f6f10009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4b4fd5af9fa2791 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.112+0000 7f6edb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6edb7fe640 1 -- 10.20.193.28:0/2788197858 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100c8a80 con 0x5617ae10e630 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 1 -- 10.20.193.28:0/2788197858 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ae120640 con 0x5617ae10e630 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 10 client.26948 _ll_register_callbacks cb 0x7f6f1c009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 1 -- 10.20.193.28:0/2788197858 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5617ae013b00 con 0x5617ae10e630 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6edb7fe640 1 -- 10.20.193.28:0/2788197858 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6f100e6e50 con 0x5617ae10e630 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6edb7fe640 1 -- 10.20.193.28:0/2788197858 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100c8060 con 0x5617ae10e630 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6edb7fe640 1 -- 10.20.193.28:0/2788197858 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f6f10038990 con 0x5617ae10e630 2026-02-20T03:23:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6edb7fe640 1 -- 10.20.193.28:0/2788197858 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f100cb9e0 con 0x5617ae10e630 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 10 client.26948 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 1 -- 10.20.193.28:0/2788197858 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5617add40870 con 0x5617ae10e630 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6edb7fe640 1 -- 10.20.193.28:0/2788197858 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6f100d5b90 con 0x5617ae10e630 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 10 client.26948 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 10 client.26948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 20 client.26948 populate_metadata read hostname 'trial028' 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617ae1a2940 0x5617ae1a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 4 client.26948 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.113+0000 7f6f2a494e00 1 -- 10.20.193.28:0/2788197858 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f6f100f0020 con 0x5617ae1a2940 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.114+0000 7f6f25503640 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617ae1a2940 0x5617ae1a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.114+0000 7f6f25503640 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617ae1a2940 0x5617ae1a4e00 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15b00472d7287a24 server_cookie=2f69205c7ff3642b in_seq=0 out_seq=0 2026-02-20T03:23:56.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.114+0000 7f6edb7fe640 10 client.26948 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.114+0000 7f6edb7fe640 1 -- 10.20.193.28:0/2788197858 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f6f100f0020 con 0x5617ae1a2940 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.114+0000 7f6edb7fe640 10 client.26948 handle_command_reply: tid=0 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.114+0000 7f6f2a494e00 1 client.26948 shutdown 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.114+0000 7f6f2a494e00 1 -- 10.20.193.28:0/2788197858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 msgr2=0x5617ae12b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.114+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae12b0b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f100c9700 tx=0x7f6f10009290 comp rx=0 tx=0).stop 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f2a494e00 1 -- 10.20.193.28:0/2788197858 shutdown_connections 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617ae1a2940 0x5617ae1a4e00 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617ae114000 0x5617ae1a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6edb7fe640 0 client.26948 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617ae10efb0 0x5617ae12b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f2a494e00 1 --2- 10.20.193.28:0/2788197858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617ae10e630 0x5617ae12b0b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f2a494e00 1 -- 10.20.193.28:0/2788197858 >> 10.20.193.28:0/2788197858 conn(0x5617ae0d1290 msgr2=0x5617ae111ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:56.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f2a494e00 1 -- 10.20.193.28:0/2788197858 shutdown_connections 2026-02-20T03:23:56.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f2a494e00 1 -- 10.20.193.28:0/2788197858 wait complete. 2026-02-20T03:23:56.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f2a494e00 20 client.26948 trim_cache size 0 max 16384 2026-02-20T03:23:56.124 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:23:56.124 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:23:56.124 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:23:56.124 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:23:56.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 -- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6efc0b0e20 msgr2=0x7f6efc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6efc0b0e20 0x7f6efc0b32e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6f140097c0 tx=0x7f6f14009340 comp rx=0 tx=0).stop 2026-02-20T03:23:56.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 -- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f20075950 msgr2=0x7f6f201a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f20075950 0x7f6f201a14c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6f10004600 tx=0x7f6f10004630 comp rx=0 tx=0).stop 2026-02-20T03:23:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 -- 10.20.193.28:0/2753870803 shutdown_connections 2026-02-20T03:23:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6efc0b0e20 0x7f6efc0b32e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6f201134d0 0x7f6f201a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6f201065d0 0x7f6f201a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 --2- 10.20.193.28:0/2753870803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6f20075950 0x7f6f201a14c0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.115+0000 7f6f26d06640 1 -- 10.20.193.28:0/2753870803 >> 10.20.193.28:0/2753870803 conn(0x7f6f200fe440 msgr2=0x7f6f20111560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.116+0000 7f6f26d06640 1 -- 10.20.193.28:0/2753870803 shutdown_connections 2026-02-20T03:23:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.116+0000 7f6f26d06640 1 -- 10.20.193.28:0/2753870803 wait complete. 2026-02-20T03:23:56.217 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:23:56.217 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:23:56.488 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:56.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 7.97 MB/sec execute 329 sec latency 22239.064 ms 2026-02-20T03:23:56.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.673+0000 7f94ba476640 1 -- 10.20.193.28:0/377714700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b41049a0 msgr2=0x7f94b4104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.673+0000 7f94ba476640 1 --2- 10.20.193.28:0/377714700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b41049a0 0x7f94b4104e00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009a60 tx=0x7f94a802f260 comp rx=0 tx=0).stop 2026-02-20T03:23:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.673+0000 7f94ba476640 1 -- 10.20.193.28:0/377714700 shutdown_connections 2026-02-20T03:23:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.673+0000 7f94ba476640 1 --2- 10.20.193.28:0/377714700 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b4105340 0x7f94b4111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.673+0000 7f94ba476640 1 --2- 10.20.193.28:0/377714700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b41049a0 0x7f94b4104e00 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.673+0000 7f94ba476640 1 --2- 10.20.193.28:0/377714700 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410a9a0 0x7f94b410ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.673+0000 7f94ba476640 1 -- 10.20.193.28:0/377714700 >> 10.20.193.28:0/377714700 conn(0x7f94b41006c0 msgr2=0x7f94b4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.673+0000 7f94ba476640 1 -- 10.20.193.28:0/377714700 shutdown_connections 2026-02-20T03:23:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.674+0000 7f94ba476640 1 -- 10.20.193.28:0/377714700 wait complete. 2026-02-20T03:23:56.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94ba476640 1 Processor -- start 2026-02-20T03:23:56.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94ba476640 1 -- start start 2026-02-20T03:23:56.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94ba476640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b41049a0 0x7f94b419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94ba476640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4105340 0x7f94b419d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94ba476640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410a9a0 0x7f94b41a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94ba476640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4114c10 con 0x7f94b4105340 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94ba476640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4114a90 con 0x7f94b41049a0 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94ba476640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94b4114d90 con 0x7f94b410a9a0 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b8c73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4105340 0x7f94b419d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b8c73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4105340 0x7f94b419d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52296/0 (socket says 10.20.193.28:52296) 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b8c73640 1 -- 10.20.193.28:0/1650193292 learned_addr learned my addr 10.20.193.28:0/1650193292 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b9474640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b41049a0 0x7f94b419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b9c75640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410a9a0 0x7f94b41a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b8c73640 1 -- 10.20.193.28:0/1650193292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410a9a0 msgr2=0x7f94b41a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b8c73640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410a9a0 0x7f94b41a1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b8c73640 1 -- 10.20.193.28:0/1650193292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b41049a0 msgr2=0x7f94b419d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b8c73640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b41049a0 0x7f94b419d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.675+0000 7f94b8c73640 1 -- 10.20.193.28:0/1650193292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b41a20e0 con 0x7f94b4105340 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.676+0000 7f94b8c73640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4105340 0x7f94b419d5d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f94a802ffa0 tx=0x7f94a80043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.676+0000 7f94a27fc640 1 -- 10.20.193.28:0/1650193292 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8004540 con 0x7f94b4105340 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.676+0000 7f94a27fc640 1 -- 10.20.193.28:0/1650193292 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f94a8038e20 con 0x7f94b4105340 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.676+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b41a2370 con 0x7f94b4105340 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.676+0000 7f94a27fc640 1 -- 10.20.193.28:0/1650193292 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8040370 con 0x7f94b4105340 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.676+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b41a9c10 con 0x7f94b4105340 2026-02-20T03:23:56.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.677+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b4104e00 con 0x7f94b4105340 2026-02-20T03:23:56.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.679+0000 7f94a27fc640 1 -- 10.20.193.28:0/1650193292 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f94a8041670 con 0x7f94b4105340 2026-02-20T03:23:56.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.680+0000 7f94a27fc640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:56.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.680+0000 7f94a27fc640 1 -- 10.20.193.28:0/1650193292 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f94a81053a0 con 0x7f94b4105340 2026-02-20T03:23:56.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.681+0000 7f94a27fc640 1 -- 10.20.193.28:0/1650193292 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f94a8047060 con 0x7f94b4105340 2026-02-20T03:23:56.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.681+0000 7f94b9474640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:56.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.681+0000 7f94b9474640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005fd0 tx=0x7f94a4002d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:56.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.787+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94b410c910 con 0x7f94b4105340 2026-02-20T03:23:56.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.788+0000 7f94a27fc640 1 -- 10.20.193.28:0/1650193292 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f94a80ef090 con 0x7f94b4105340 2026-02-20T03:23:56.791 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:23:56.791 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:23:56.791 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 msgr2=0x7f94900b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f94a4005fd0 tx=0x7f94a4002d90 comp rx=0 tx=0).stop 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4105340 msgr2=0x7f94b419d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4105340 0x7f94b419d5d0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f94a802ffa0 tx=0x7f94a80043d0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 shutdown_connections 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94900b0e20 0x7f94900b32e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94b410a9a0 0x7f94b41a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94b4105340 0x7f94b419d5d0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 --2- 10.20.193.28:0/1650193292 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94b41049a0 0x7f94b419d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 >> 10.20.193.28:0/1650193292 conn(0x7f94b41006c0 msgr2=0x7f94b4101020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 shutdown_connections 2026-02-20T03:23:56.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:56.789+0000 7f94ba476640 1 -- 10.20.193.28:0/1650193292 wait complete. 2026-02-20T03:23:56.893 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:23:57.163 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:57.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.344+0000 7fada9e35640 1 -- 10.20.193.28:0/3012984629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41134d0 msgr2=0x7fada4115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.344+0000 7fada9e35640 1 --2- 10.20.193.28:0/3012984629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41134d0 0x7fada4115900 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fada000b0a0 tx=0x7fada002f4a0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.345+0000 7fada9e35640 1 -- 10.20.193.28:0/3012984629 shutdown_connections 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.345+0000 7fada9e35640 1 --2- 10.20.193.28:0/3012984629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41134d0 0x7fada4115900 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.345+0000 7fada9e35640 1 --2- 10.20.193.28:0/3012984629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada4075950 0x7fada4075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.345+0000 7fada9e35640 1 --2- 10.20.193.28:0/3012984629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada41065d0 0x7fada4075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.345+0000 7fada9e35640 1 -- 10.20.193.28:0/3012984629 >> 10.20.193.28:0/3012984629 conn(0x7fada40fe440 msgr2=0x7fada4100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.345+0000 7fada9e35640 1 -- 10.20.193.28:0/3012984629 shutdown_connections 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.345+0000 7fada9e35640 1 -- 10.20.193.28:0/3012984629 wait complete. 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.345+0000 7fada9e35640 1 Processor -- start 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.345+0000 7fada9e35640 1 -- start start 2026-02-20T03:23:57.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fada9e35640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada4075950 0x7fada4112810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fada9e35640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41065d0 0x7fada4112d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fada9e35640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada41134d0 0x7fada410b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fada9e35640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fada41190d0 con 0x7fada41065d0 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fada9e35640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fada4118f50 con 0x7fada41134d0 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fada9e35640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fada4119250 con 0x7fada4075950 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fad9bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41065d0 0x7fada4112d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fad9bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41065d0 0x7fada4112d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52314/0 (socket says 10.20.193.28:52314) 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fad9bfff640 1 -- 10.20.193.28:0/1735541386 learned_addr learned my addr 10.20.193.28:0/1735541386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fada8e33640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada4075950 0x7fada4112810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fada9634640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada41134d0 0x7fada410b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fad9bfff640 1 -- 10.20.193.28:0/1735541386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada4075950 msgr2=0x7fada4112810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fad9bfff640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada4075950 0x7fada4112810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fad9bfff640 1 -- 10.20.193.28:0/1735541386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada41134d0 msgr2=0x7fada410b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fad9bfff640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada41134d0 0x7fada410b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fad9bfff640 1 -- 10.20.193.28:0/1735541386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada410c1f0 con 0x7fada41065d0 2026-02-20T03:23:57.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.346+0000 7fada9634640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada41134d0 0x7fada410b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:23:57.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.347+0000 7fad9bfff640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41065d0 0x7fada4112d50 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00ea30 tx=0x7fad8c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.347+0000 7fad99ffb640 1 -- 10.20.193.28:0/1735541386 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00ce50 con 0x7fada41065d0 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.347+0000 7fad99ffb640 1 -- 10.20.193.28:0/1735541386 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad8c004570 con 0x7fada41065d0 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.347+0000 7fad99ffb640 1 -- 10.20.193.28:0/1735541386 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8c010690 con 0x7fada41065d0 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.347+0000 7fada9e35640 1 -- 10.20.193.28:0/1735541386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada410c4e0 con 0x7fada41065d0 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.347+0000 7fada9e35640 1 -- 10.20.193.28:0/1735541386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada4110510 con 0x7fada41065d0 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fad99ffb640 1 -- 10.20.193.28:0/1735541386 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fad8c0040d0 con 0x7fada41065d0 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fadad5c3e00 1 Processor -- start 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fadad5c3e00 1 -- start start 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563acf60 0x55fb563b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fb5632ce00 con 0x55fb563b1fb0 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fb562ff970 con 0x55fb563ac5e0 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fb562ad1f0 con 0x55fb563acf60 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fada8e33640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fada9634640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fada9634640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563b2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52320/0 (socket says 10.20.193.28:52320) 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fada9634640 1 -- 10.20.193.28:0/2104312512 learned_addr learned my addr 10.20.193.28:0/2104312512 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.350+0000 7fad9bfff640 1 --2- 10.20.193.28:0/2104312512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563acf60 0x55fb563b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fada9634640 1 -- 10.20.193.28:0/2104312512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563acf60 msgr2=0x55fb563b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fada9634640 1 --2- 10.20.193.28:0/2104312512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563acf60 0x55fb563b8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fada9634640 1 -- 10.20.193.28:0/2104312512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 msgr2=0x55fb563aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:57.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fada9634640 1 --2- 10.20.193.28:0/2104312512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fada9634640 1 -- 10.20.193.28:0/2104312512 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb562c03d0 con 0x55fb563b1fb0 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fada8e33640 1 --2- 10.20.193.28:0/2104312512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fada9634640 1 --2- 10.20.193.28:0/2104312512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563b2390 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fada0009770 tx=0x7fada00097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7746660d0093e959 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fad714e4640 1 -- 10.20.193.28:0/2104312512 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0045070 con 0x55fb563b1fb0 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fad99ffb640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad800b0e20 0x7fad800b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fad714e4640 1 -- 10.20.193.28:0/2104312512 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fada0033070 con 0x55fb563b1fb0 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fad714e4640 1 -- 10.20.193.28:0/2104312512 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0002cc0 con 0x55fb563b1fb0 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.351+0000 7fad99ffb640 1 -- 10.20.193.28:0/1735541386 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fad8c0e0fd0 con 0x7fada41065d0 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2104312512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 msgr2=0x55fb563b2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2104312512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563b2390 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fada0009770 tx=0x7fada00097a0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2104312512 shutdown_connections 2026-02-20T03:23:57.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2104312512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563acf60 0x55fb563b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2104312512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2104312512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563b2390 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2104312512 >> 10.20.193.28:0/2104312512 conn(0x55fb5636f240 msgr2=0x55fb563aace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:57.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fada8e33640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad800b0e20 0x7fad800b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2104312512 shutdown_connections 2026-02-20T03:23:57.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.352+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2104312512 wait complete. 2026-02-20T03:23:57.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.353+0000 7fada8e33640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad800b0e20 0x7fad800b32e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fad940044c0 tx=0x7fad94009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.353+0000 7fadad5c3e00 1 -- start start 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.353+0000 7fadad5c3e00 1 Processor -- start 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563c5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb563cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fb562fb8a0 con 0x55fb563acf60 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fb560edf50 con 0x55fb563ac5e0 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fb563cb360 con 0x55fb563b1fb0 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fad9bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fada9634640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb563cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fad9bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52322/0 (socket says 10.20.193.28:52322) 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fad9bfff640 1 -- 10.20.193.28:0/2876688502 learned_addr learned my addr 10.20.193.28:0/2876688502 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fada8e33640 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fada9634640 1 -- 10.20.193.28:0/2876688502 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 msgr2=0x55fb563c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fada9634640 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fada9634640 1 -- 10.20.193.28:0/2876688502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 msgr2=0x55fb563c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fada9634640 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fada9634640 1 -- 10.20.193.28:0/2876688502 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb563bea80 con 0x55fb563b1fb0 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fada9634640 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb563cae20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fada002f9b0 tx=0x7fada0009d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1263b899d84a7f08 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.354+0000 7fad627fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fad627fc640 1 -- 10.20.193.28:0/2876688502 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0045040 con 0x55fb563b1fb0 2026-02-20T03:23:57.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fad627fc640 1 -- 10.20.193.28:0/2876688502 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fada00090d0 con 0x55fb563b1fb0 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fad627fc640 1 -- 10.20.193.28:0/2876688502 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0007720 con 0x55fb563b1fb0 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2876688502 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb560d0b40 con 0x55fb563b1fb0 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fad627fc640 1 -- 10.20.193.28:0/2876688502 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fada00078c0 con 0x55fb563b1fb0 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fad627fc640 10 client.26983 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 10 client.26983 _ll_register_callbacks cb 0x55fb56338eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2876688502 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb5630d150 con 0x55fb563b1fb0 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fad627fc640 1 -- 10.20.193.28:0/2876688502 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fada0002a60 con 0x55fb563b1fb0 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 10 client.26983 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2876688502 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55fb562ba1e0 con 0x55fb563b1fb0 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fad627fc640 1 -- 10.20.193.28:0/2876688502 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fada003f030 con 0x55fb563b1fb0 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 10 client.26983 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:57.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 10 client.26983 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 20 client.26983 populate_metadata read hostname 'trial028' 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fb563d4e00 0x55fb563d72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.355+0000 7fadad5c3e00 4 client.26983 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.356+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2876688502 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb56307560 con 0x55fb563d4e00 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.356+0000 7fada8e33640 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fb563d4e00 0x55fb563d72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.356+0000 7fada8e33640 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fb563d4e00 0x55fb563d72c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=680c4085d890aa0f server_cookie=79470989686be2e4 in_seq=0 out_seq=0 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.356+0000 7fad627fc640 10 client.26983 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fad627fc640 1 -- 10.20.193.28:0/2876688502 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fb56307560 con 0x55fb563d4e00 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fad627fc640 10 client.26983 handle_command_reply: tid=0 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 client.26983 shutdown 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2876688502 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 msgr2=0x55fb563cae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb563cae20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fada002f9b0 tx=0x7fada0009d00 comp rx=0 tx=0).stop 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2876688502 shutdown_connections 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb563cae20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fb563d4e00 0x55fb563d72c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2876688502 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2876688502 >> 10.20.193.28:0/2876688502 conn(0x55fb5636f240 msgr2=0x55fb563ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fad627fc640 0 client.26983 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2876688502 shutdown_connections 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2876688502 wait complete. 2026-02-20T03:23:57.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.357+0000 7fadad5c3e00 20 client.26983 trim_cache size 0 max 16384 2026-02-20T03:23:57.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.364+0000 7fadad5c3e00 1 Processor -- start 2026-02-20T03:23:57.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.364+0000 7fadad5c3e00 1 -- start start 2026-02-20T03:23:57.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.364+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563d5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.364+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563acf60 0x55fb563d5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.364+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.364+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad480126f0 con 0x55fb563b1fb0 2026-02-20T03:23:57.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.364+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fad4800ffc0 con 0x55fb563ac5e0 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.364+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad4800de10 con 0x55fb563acf60 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada9634640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada9634640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52330/0 (socket says 10.20.193.28:52330) 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada9634640 1 -- 10.20.193.28:0/4100164781 learned_addr learned my addr 10.20.193.28:0/4100164781 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada8e33640 1 --2- 10.20.193.28:0/4100164781 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563d5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada9634640 1 -- 10.20.193.28:0/4100164781 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563acf60 msgr2=0x55fb563d5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada9634640 1 --2- 10.20.193.28:0/4100164781 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563acf60 0x55fb563d5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada9634640 1 -- 10.20.193.28:0/4100164781 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 msgr2=0x55fb563d5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada9634640 1 --2- 10.20.193.28:0/4100164781 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563d5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada9634640 1 -- 10.20.193.28:0/4100164781 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb563be8b0 con 0x55fb563b1fb0 2026-02-20T03:23:57.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.365+0000 7fada9634640 1 --2- 10.20.193.28:0/4100164781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563ab4d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fada0006030 tx=0x7fada0052000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1963083d0841a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fad70ce3640 1 -- 10.20.193.28:0/4100164781 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0045070 con 0x55fb563b1fb0 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fad70ce3640 1 -- 10.20.193.28:0/4100164781 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55fb5630d150 con 0x55fb563b1fb0 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fad70ce3640 1 -- 10.20.193.28:0/4100164781 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0038940 con 0x55fb563b1fb0 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fadad5c3e00 1 -- 10.20.193.28:0/4100164781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 msgr2=0x55fb563ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/4100164781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563ab4d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fada0006030 tx=0x7fada0052000 comp rx=0 tx=0).stop 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fadad5c3e00 1 -- 10.20.193.28:0/4100164781 shutdown_connections 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/4100164781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563b1fb0 0x55fb563ab4d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/4100164781 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563acf60 0x55fb563d5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/4100164781 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563d5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fadad5c3e00 1 -- 10.20.193.28:0/4100164781 >> 10.20.193.28:0/4100164781 conn(0x55fb5636f240 msgr2=0x55fb563d5210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fadad5c3e00 1 -- 10.20.193.28:0/4100164781 shutdown_connections 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.366+0000 7fadad5c3e00 1 -- 10.20.193.28:0/4100164781 wait complete. 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fadad5c3e00 1 -- start start 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fadad5c3e00 1 Processor -- start 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fadad5c3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb5643fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad4800e480 con 0x55fb563acf60 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fad4800f8f0 con 0x55fb563ac5e0 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fadad5c3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad4800eb50 con 0x55fb563b1fb0 2026-02-20T03:23:57.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fada8e33640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fada8e33640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53430/0 (socket says 10.20.193.28:53430) 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fada8e33640 1 -- 10.20.193.28:0/2910678459 learned_addr learned my addr 10.20.193.28:0/2910678459 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.367+0000 7fada9634640 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb5643fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fad9bfff640 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fada8e33640 1 -- 10.20.193.28:0/2910678459 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 msgr2=0x55fb5643fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fada8e33640 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb5643fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fada8e33640 1 -- 10.20.193.28:0/2910678459 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 msgr2=0x55fb563cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fada8e33640 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fada8e33640 1 -- 10.20.193.28:0/2910678459 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb55fde870 con 0x55fb563ac5e0 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fada9634640 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb5643fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:23:57.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fad9bfff640 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:23:57.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fada8e33640 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563ce870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad94002ab0 tx=0x7fad940047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92e1f934180b857 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fad627fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:23:57.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fad627fc640 1 -- 10.20.193.28:0/2910678459 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9402a690 con 0x55fb563ac5e0 2026-02-20T03:23:57.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fad627fc640 1 -- 10.20.193.28:0/2910678459 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad9402acd0 con 0x55fb563ac5e0 2026-02-20T03:23:57.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fad627fc640 1 -- 10.20.193.28:0/2910678459 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9401cbf0 con 0x55fb563ac5e0 2026-02-20T03:23:57.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2910678459 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb5629f3f0 con 0x55fb563ac5e0 2026-02-20T03:23:57.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fad627fc640 1 -- 10.20.193.28:0/2910678459 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fad9401cd90 con 0x55fb563ac5e0 2026-02-20T03:23:57.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fadad5c3e00 10 client.26969 _ll_register_callbacks cb 0x7fada0043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:57.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.368+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2910678459 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb56307560 con 0x55fb563ac5e0 2026-02-20T03:23:57.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fad627fc640 1 -- 10.20.193.28:0/2910678459 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad9402a830 con 0x55fb563ac5e0 2026-02-20T03:23:57.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fadad5c3e00 10 client.26969 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:57.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2910678459 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55fb563bf5a0 con 0x55fb563ac5e0 2026-02-20T03:23:57.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fad627fc640 1 -- 10.20.193.28:0/2910678459 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fad94002ce0 con 0x55fb563ac5e0 2026-02-20T03:23:57.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fadad5c3e00 10 client.26969 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:57.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fadad5c3e00 10 client.26969 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:23:57.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fadad5c3e00 20 client.26969 populate_metadata read hostname 'trial028' 2026-02-20T03:23:57.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fb56441890 0x55fb56443d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fadad5c3e00 4 client.26969 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:23:57.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2910678459 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb56281a30 con 0x55fb56441890 2026-02-20T03:23:57.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.369+0000 7fad9bfff640 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fb56441890 0x55fb56443d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fad9bfff640 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fb56441890 0x55fb56443d50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=edd56f3a77a0dc81 server_cookie=76587626fa09dde9 in_seq=0 out_seq=0 2026-02-20T03:23:57.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fad627fc640 10 client.26969 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:23:57.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fad627fc640 1 -- 10.20.193.28:0/2910678459 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb56281a30 con 0x55fb56441890 2026-02-20T03:23:57.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fad627fc640 10 client.26969 handle_command_reply: tid=0 2026-02-20T03:23:57.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 client.26969 shutdown 2026-02-20T03:23:57.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2910678459 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 msgr2=0x55fb563ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563ce870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad94002ab0 tx=0x7fad940047c0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2910678459 shutdown_connections 2026-02-20T03:23:57.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fb563b1fb0 0x55fb5643fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fb56441890 0x55fb56443d50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fb563acf60 0x55fb563cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 --2- 10.20.193.28:0/2910678459 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fb563ac5e0 0x55fb563ce870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2910678459 >> 10.20.193.28:0/2910678459 conn(0x55fb5636f240 msgr2=0x55fb563d5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:57.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fad627fc640 0 client.26969 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:23:57.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2910678459 shutdown_connections 2026-02-20T03:23:57.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 1 -- 10.20.193.28:0/2910678459 wait complete. 2026-02-20T03:23:57.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.370+0000 7fadad5c3e00 20 client.26969 trim_cache size 0 max 16384 2026-02-20T03:23:57.384 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:23:57.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 -- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad800b0e20 msgr2=0x7fad800b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad800b0e20 0x7fad800b32e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fad940044c0 tx=0x7fad94009290 comp rx=0 tx=0).stop 2026-02-20T03:23:57.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 -- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41065d0 msgr2=0x7fada4112d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41065d0 0x7fada4112d50 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00ea30 tx=0x7fad8c00ef00 comp rx=0 tx=0).stop 2026-02-20T03:23:57.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 -- 10.20.193.28:0/1735541386 shutdown_connections 2026-02-20T03:23:57.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fad800b0e20 0x7fad800b32e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fada41134d0 0x7fada410b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fada41065d0 0x7fada4112d50 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 --2- 10.20.193.28:0/1735541386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fada4075950 0x7fada4112810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 -- 10.20.193.28:0/1735541386 >> 10.20.193.28:0/1735541386 conn(0x7fada40fe440 msgr2=0x7fada4114b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:57.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 -- 10.20.193.28:0/1735541386 shutdown_connections 2026-02-20T03:23:57.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.371+0000 7fada9e35640 1 -- 10.20.193.28:0/1735541386 wait complete. 2026-02-20T03:23:57.467 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:57 trial028 ceph-mon[38552]: pgmap v459: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 346 KiB/s wr, 33 op/s 2026-02-20T03:23:57.468 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:57 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1650193292' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:57.470 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:23:57.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 7.95 MB/sec execute 330 sec latency 23239.113 ms 2026-02-20T03:23:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:57 trial177 ceph-mon[43181]: pgmap v459: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 346 KiB/s wr, 33 op/s 2026-02-20T03:23:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:57 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1650193292' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:57.733 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:57.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:57 trial126 ceph-mon[38476]: pgmap v459: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 346 KiB/s wr, 33 op/s 2026-02-20T03:23:57.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:57 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1650193292' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:23:57.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.953+0000 7f4891ade640 1 -- 10.20.193.28:0/2102541326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 msgr2=0x7f488c104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.953+0000 7f4891ade640 1 --2- 10.20.193.28:0/2102541326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 0x7f488c104de0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f4874009a60 tx=0x7f487402f250 comp rx=0 tx=0).stop 2026-02-20T03:23:57.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.953+0000 7f4891ade640 1 -- 10.20.193.28:0/2102541326 shutdown_connections 2026-02-20T03:23:57.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.953+0000 7f4891ade640 1 --2- 10.20.193.28:0/2102541326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f488c105320 0x7f488c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.953+0000 7f4891ade640 1 --2- 10.20.193.28:0/2102541326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 0x7f488c104de0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.953+0000 7f4891ade640 1 --2- 10.20.193.28:0/2102541326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f488c10a980 0x7f488c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.953+0000 7f4891ade640 1 -- 10.20.193.28:0/2102541326 >> 10.20.193.28:0/2102541326 conn(0x7f488c100680 msgr2=0x7f488c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:57.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.953+0000 7f4891ade640 1 -- 10.20.193.28:0/2102541326 shutdown_connections 2026-02-20T03:23:57.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.953+0000 7f4891ade640 1 -- 10.20.193.28:0/2102541326 wait complete. 2026-02-20T03:23:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4891ade640 1 Processor -- start 2026-02-20T03:23:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4891ade640 1 -- start start 2026-02-20T03:23:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4891ade640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 0x7f488c19d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4891ade640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f488c105320 0x7f488c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4891ade640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f488c10a980 0x7f488c1a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4891ade640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f488c114bf0 con 0x7f488c104980 2026-02-20T03:23:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4891ade640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f488c114a70 con 0x7f488c105320 2026-02-20T03:23:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4891ade640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f488c114d70 con 0x7f488c10a980 2026-02-20T03:23:57.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4890adc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 0x7f488c19d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4890adc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 0x7f488c19d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52356/0 (socket says 10.20.193.28:52356) 2026-02-20T03:23:57.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4890adc640 1 -- 10.20.193.28:0/3230994747 learned_addr learned my addr 10.20.193.28:0/3230994747 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:57.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4890adc640 1 -- 10.20.193.28:0/3230994747 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f488c10a980 msgr2=0x7f488c1a19e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:57.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4890adc640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f488c10a980 0x7f488c1a19e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4890adc640 1 -- 10.20.193.28:0/3230994747 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f488c105320 msgr2=0x7f488c19d650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4890adc640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f488c105320 0x7f488c19d650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.954+0000 7f4890adc640 1 -- 10.20.193.28:0/3230994747 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c1a20c0 con 0x7f488c104980 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.955+0000 7f4890adc640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 0x7f488c19d110 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f487c00d980 tx=0x7f487c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.955+0000 7f4881ffb640 1 -- 10.20.193.28:0/3230994747 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c014070 con 0x7f488c104980 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.955+0000 7f4881ffb640 1 -- 10.20.193.28:0/3230994747 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f487c0044e0 con 0x7f488c104980 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.955+0000 7f4881ffb640 1 -- 10.20.193.28:0/3230994747 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c005040 con 0x7f488c104980 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.955+0000 7f4891ade640 1 -- 10.20.193.28:0/3230994747 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c1a23b0 con 0x7f488c104980 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.955+0000 7f4891ade640 1 -- 10.20.193.28:0/3230994747 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1a9c90 con 0x7f488c104980 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.958+0000 7f4881ffb640 1 -- 10.20.193.28:0/3230994747 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f487c0047c0 con 0x7f488c104980 2026-02-20T03:23:57.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.958+0000 7f489526ce00 1 Processor -- start 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.958+0000 7f489526ce00 1 -- start start 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.958+0000 7f489526ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa6d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.958+0000 7f489526ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 0x55c1aaa67a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.958+0000 7f489526ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 0x55c1aaa73de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f489526ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c1aa9e7e00 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f489526ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c1aa9ba970 con 0x55c1aaa675e0 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f489526ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c1aa9681f0 con 0x55c1aaa67f60 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48912dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa6d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48912dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa6d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52372/0 (socket says 10.20.193.28:52372) 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48912dd640 1 -- 10.20.193.28:0/3306051346 learned_addr learned my addr 10.20.193.28:0/3306051346 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:57.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48912dd640 1 -- 10.20.193.28:0/3306051346 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 msgr2=0x55c1aaa73de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48912dd640 1 --2- 10.20.193.28:0/3306051346 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 0x55c1aaa73de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48912dd640 1 -- 10.20.193.28:0/3306051346 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 msgr2=0x55c1aaa67a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48912dd640 1 --2- 10.20.193.28:0/3306051346 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 0x55c1aaa67a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48912dd640 1 -- 10.20.193.28:0/3306051346 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1aa97b3d0 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48912dd640 1 --2- 10.20.193.28:0/3306051346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa6d390 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f488800c110 tx=0x7f488800c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd85ff70daaea8e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48594e4640 1 -- 10.20.193.28:0/3306051346 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888017070 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f4881ffb640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48680b0e20 0x7f48680b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48594e4640 1 -- 10.20.193.28:0/3306051346 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f488800ce20 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.959+0000 7f48594e4640 1 -- 10.20.193.28:0/3306051346 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48880128d0 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f489526ce00 1 -- 10.20.193.28:0/3306051346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 msgr2=0x55c1aaa6d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f489526ce00 1 --2- 10.20.193.28:0/3306051346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa6d390 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f488800c110 tx=0x7f488800c5e0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f4890adc640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48680b0e20 0x7f48680b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f4881ffb640 1 -- 10.20.193.28:0/3230994747 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f487c0e08f0 con 0x7f488c104980 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f489526ce00 1 -- 10.20.193.28:0/3306051346 shutdown_connections 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f489526ce00 1 --2- 10.20.193.28:0/3306051346 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 0x55c1aaa73de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f489526ce00 1 --2- 10.20.193.28:0/3306051346 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 0x55c1aaa67a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f489526ce00 1 --2- 10.20.193.28:0/3306051346 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa6d390 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f489526ce00 1 -- 10.20.193.28:0/3306051346 >> 10.20.193.28:0/3306051346 conn(0x55c1aaa2a240 msgr2=0x55c1aaa65ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f489526ce00 1 -- 10.20.193.28:0/3306051346 shutdown_connections 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f489526ce00 1 -- 10.20.193.28:0/3306051346 wait complete. 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.960+0000 7f4890adc640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48680b0e20 0x7f48680b32e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f487c004ff0 tx=0x7f487c015640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.961+0000 7f489526ce00 1 -- start start 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f489526ce00 1 Processor -- start 2026-02-20T03:23:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f489526ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 0x55c1aaa8a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f489526ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 0x55c1aaa8aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f489526ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa88e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f489526ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c1aa9b68a0 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f489526ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c1aa7a8f50 con 0x55c1aaa675e0 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f489526ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c1aaa89400 con 0x55c1aaa67f60 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f48912dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa88e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f48912dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa88e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52374/0 (socket says 10.20.193.28:52374) 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f48912dd640 1 -- 10.20.193.28:0/2096894589 learned_addr learned my addr 10.20.193.28:0/2096894589 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f48912dd640 1 -- 10.20.193.28:0/2096894589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 msgr2=0x55c1aaa8aec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f48912dd640 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 0x55c1aaa8aec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f48912dd640 1 -- 10.20.193.28:0/2096894589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 msgr2=0x55c1aaa8a980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:57.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f48912dd640 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 0x55c1aaa8a980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.962+0000 7f48912dd640 1 -- 10.20.193.28:0/2096894589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1aaa82490 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f48912dd640 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa88e70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f48880075e0 tx=0x7f48880128a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3968fbf3530520 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f484a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f484a7fc640 1 -- 10.20.193.28:0/2096894589 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888022070 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f484a7fc640 1 -- 10.20.193.28:0/2096894589 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4888018040 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f484a7fc640 1 -- 10.20.193.28:0/2096894589 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888017070 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f489526ce00 1 -- 10.20.193.28:0/2096894589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1aa78bb40 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f489526ce00 10 client.17820 _ll_register_callbacks cb 0x55c1aa9f3eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f489526ce00 1 -- 10.20.193.28:0/2096894589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c1aa9c8150 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f484a7fc640 1 -- 10.20.193.28:0/2096894589 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f48880040d0 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f484a7fc640 1 -- 10.20.193.28:0/2096894589 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48880046b0 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f489526ce00 10 client.17820 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.963+0000 7f489526ce00 1 -- 10.20.193.28:0/2096894589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c1aa9751e0 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.964+0000 7f484a7fc640 1 -- 10.20.193.28:0/2096894589 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4888012a10 con 0x55c1aaa6cfb0 2026-02-20T03:23:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.964+0000 7f489526ce00 10 client.17820 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.964+0000 7f489526ce00 10 client.17820 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:23:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.964+0000 7f489526ce00 20 client.17820 populate_metadata read hostname 'trial028' 2026-02-20T03:23:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.964+0000 7f489526ce00 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c1aaa98ff0 0x55c1aaa9b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.964+0000 7f489526ce00 4 client.17820 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.964+0000 7f489526ce00 1 -- 10.20.193.28:0/2096894589 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1aa9c2560 con 0x55c1aaa98ff0 2026-02-20T03:23:57.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.965+0000 7f4883fff640 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c1aaa98ff0 0x55c1aaa9b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:57.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.979+0000 7f484a7fc640 10 client.17820 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:23:57.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.979+0000 7f4883fff640 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c1aaa98ff0 0x55c1aaa9b3e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35b288d561a18898 server_cookie=dccbd34e200fb32a in_seq=0 out_seq=0 2026-02-20T03:23:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f484a7fc640 1 -- 10.20.193.28:0/2096894589 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c1aa9c2560 con 0x55c1aaa98ff0 2026-02-20T03:23:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f484a7fc640 10 client.17820 handle_command_reply: tid=0 2026-02-20T03:23:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 client.17820 shutdown 2026-02-20T03:23:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 -- 10.20.193.28:0/2096894589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 msgr2=0x55c1aaa88e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa88e70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f48880075e0 tx=0x7f48880128a0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 -- 10.20.193.28:0/2096894589 shutdown_connections 2026-02-20T03:23:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c1aaa98ff0 0x55c1aaa9b3e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa88e70 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 0x55c1aaa8aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 --2- 10.20.193.28:0/2096894589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 0x55c1aaa8a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 -- 10.20.193.28:0/2096894589 >> 10.20.193.28:0/2096894589 conn(0x55c1aaa2a240 msgr2=0x55c1aaa663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f484a7fc640 0 client.17820 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:23:58.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 -- 10.20.193.28:0/2096894589 shutdown_connections 2026-02-20T03:23:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 1 -- 10.20.193.28:0/2096894589 wait complete. 2026-02-20T03:23:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:57.993+0000 7f489526ce00 20 client.17820 trim_cache size 0 max 16384 2026-02-20T03:23:58.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f489526ce00 1 Processor -- start 2026-02-20T03:23:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f489526ce00 1 -- start start 2026-02-20T03:23:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f489526ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 0x55c1aaa664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f489526ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa67f60 0x55c1aaa66a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f489526ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaaa0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f489526ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4830012650 con 0x55c1aaa67f60 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f489526ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f483000ff20 con 0x55c1aaa675e0 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f489526ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f483000dd70 con 0x55c1aaa6cfb0 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f4883fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa67f60 0x55c1aaa66a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f4883fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa67f60 0x55c1aaa66a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52390/0 (socket says 10.20.193.28:52390) 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.000+0000 7f4883fff640 1 -- 10.20.193.28:0/2665305358 learned_addr learned my addr 10.20.193.28:0/2665305358 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f4883fff640 1 -- 10.20.193.28:0/2665305358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa6cfb0 msgr2=0x55c1aaaa0bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f4883fff640 1 --2- 10.20.193.28:0/2665305358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaaa0bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f4883fff640 1 -- 10.20.193.28:0/2665305358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 msgr2=0x55c1aaa664d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f4883fff640 1 --2- 10.20.193.28:0/2665305358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 0x55c1aaa664d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f4883fff640 1 -- 10.20.193.28:0/2665305358 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1aaa822c0 con 0x55c1aaa67f60 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f4883fff640 1 --2- 10.20.193.28:0/2665305358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa67f60 0x55c1aaa66a10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f488c102dd0 tx=0x7f4874038600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ca7ea1cd594c02 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f4858ce3640 1 -- 10.20.193.28:0/2665305358 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874002e00 con 0x55c1aaa67f60 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f4858ce3640 1 -- 10.20.193.28:0/2665305358 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4874033040 con 0x55c1aaa67f60 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f4858ce3640 1 -- 10.20.193.28:0/2665305358 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874038770 con 0x55c1aaa67f60 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f489526ce00 1 -- 10.20.193.28:0/2665305358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa67f60 msgr2=0x55c1aaa66a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f489526ce00 1 --2- 10.20.193.28:0/2665305358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa67f60 0x55c1aaa66a10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f488c102dd0 tx=0x7f4874038600 comp rx=0 tx=0).stop 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f489526ce00 1 -- 10.20.193.28:0/2665305358 shutdown_connections 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f489526ce00 1 --2- 10.20.193.28:0/2665305358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaaa0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f489526ce00 1 --2- 10.20.193.28:0/2665305358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa67f60 0x55c1aaa66a10 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f489526ce00 1 --2- 10.20.193.28:0/2665305358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa675e0 0x55c1aaa664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.001+0000 7f489526ce00 1 -- 10.20.193.28:0/2665305358 >> 10.20.193.28:0/2665305358 conn(0x55c1aaa2a240 msgr2=0x55c1aaa8a980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 -- 10.20.193.28:0/2665305358 shutdown_connections 2026-02-20T03:23:58.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 -- 10.20.193.28:0/2665305358 wait complete. 2026-02-20T03:23:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 -- start start 2026-02-20T03:23:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 Processor -- start 2026-02-20T03:23:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa675e0 0x55c1aaa90e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 0x55c1aaa8d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa8d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f483000e3e0 con 0x55c1aaa675e0 2026-02-20T03:23:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f483000f850 con 0x55c1aaa6cfb0 2026-02-20T03:23:58.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.002+0000 7f489526ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f483000eab0 con 0x55c1aaa67f60 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f48912dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa675e0 0x55c1aaa90e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f48912dd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa675e0 0x55c1aaa90e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52392/0 (socket says 10.20.193.28:52392) 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f48912dd640 1 -- 10.20.193.28:0/1053343150 learned_addr learned my addr 10.20.193.28:0/1053343150 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f48912dd640 1 -- 10.20.193.28:0/1053343150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 msgr2=0x55c1aaa8d100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f48912dd640 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 0x55c1aaa8d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f48912dd640 1 -- 10.20.193.28:0/1053343150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa6cfb0 msgr2=0x55c1aaa8d640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f48912dd640 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa8d640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f48912dd640 1 -- 10.20.193.28:0/1053343150 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1aa699870 con 0x55c1aaa675e0 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f48912dd640 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa675e0 0x55c1aaa90e30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f4888007f20 tx=0x7f4888006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2428262302c0ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f484a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.003+0000 7f484a7fc640 1 -- 10.20.193.28:0/1053343150 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888017070 con 0x55c1aaa675e0 2026-02-20T03:23:58.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f484a7fc640 1 -- 10.20.193.28:0/1053343150 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55c1aa9c8150 con 0x55c1aaa675e0 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 1 -- 10.20.193.28:0/1053343150 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1aa95a3f0 con 0x55c1aaa675e0 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 10 client.17826 _ll_register_callbacks cb 0x7f4888015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 1 -- 10.20.193.28:0/1053343150 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c1aa98b7c0 con 0x55c1aaa675e0 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f484a7fc640 1 -- 10.20.193.28:0/1053343150 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888022050 con 0x55c1aaa675e0 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f484a7fc640 1 -- 10.20.193.28:0/1053343150 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f48880126f0 con 0x55c1aaa675e0 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f484a7fc640 1 -- 10.20.193.28:0/1053343150 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4888037020 con 0x55c1aaa675e0 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 10 client.17826 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 1 -- 10.20.193.28:0/1053343150 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c1aaa82fb0 con 0x55c1aaa675e0 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f484a7fc640 1 -- 10.20.193.28:0/1053343150 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4888003f90 con 0x55c1aaa675e0 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 10 client.17826 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 10 client.17826 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:23:58.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 20 client.17826 populate_metadata read hostname 'trial028' 2026-02-20T03:23:58.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c1aab04bc0 0x55c1aab07080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 4 client.17826 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:23:58.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.004+0000 7f489526ce00 1 -- 10.20.193.28:0/1053343150 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1aa96cab0 con 0x55c1aab04bc0 2026-02-20T03:23:58.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.019+0000 7f4883fff640 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c1aab04bc0 0x55c1aab07080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.073+0000 7f4883fff640 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c1aab04bc0 0x55c1aab07080 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ebeeaa4fd427ef45 server_cookie=22486fd67a2bbdf8 in_seq=0 out_seq=0 2026-02-20T03:23:58.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.073+0000 7f484a7fc640 10 client.17826 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:23:58.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f484a7fc640 1 -- 10.20.193.28:0/1053343150 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1aa96cab0 con 0x55c1aab04bc0 2026-02-20T03:23:58.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f484a7fc640 10 client.17826 handle_command_reply: tid=0 2026-02-20T03:23:58.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 client.17826 shutdown 2026-02-20T03:23:58.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 -- 10.20.193.28:0/1053343150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa675e0 msgr2=0x55c1aaa90e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa675e0 0x55c1aaa90e30 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f4888007f20 tx=0x7f4888006000 comp rx=0 tx=0).stop 2026-02-20T03:23:58.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 -- 10.20.193.28:0/1053343150 shutdown_connections 2026-02-20T03:23:58.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c1aab04bc0 0x55c1aab07080 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c1aaa6cfb0 0x55c1aaa8d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c1aaa67f60 0x55c1aaa8d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 --2- 10.20.193.28:0/1053343150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c1aaa675e0 0x55c1aaa90e30 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 -- 10.20.193.28:0/1053343150 >> 10.20.193.28:0/1053343150 conn(0x55c1aaa2a240 msgr2=0x55c1aaa654c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f484a7fc640 0 client.17826 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:23:58.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.086+0000 7f489526ce00 1 -- 10.20.193.28:0/1053343150 shutdown_connections 2026-02-20T03:23:58.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f489526ce00 1 -- 10.20.193.28:0/1053343150 wait complete. 2026-02-20T03:23:58.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f489526ce00 20 client.17826 trim_cache size 0 max 16384 2026-02-20T03:23:58.092 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:23:58.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 -- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48680b0e20 msgr2=0x7f48680b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48680b0e20 0x7f48680b32e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f487c004ff0 tx=0x7f487c015640 comp rx=0 tx=0).stop 2026-02-20T03:23:58.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 -- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 msgr2=0x7f488c19d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 0x7f488c19d110 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f487c00d980 tx=0x7f487c00de50 comp rx=0 tx=0).stop 2026-02-20T03:23:58.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 -- 10.20.193.28:0/3230994747 shutdown_connections 2026-02-20T03:23:58.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f48680b0e20 0x7f48680b32e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f488c10a980 0x7f488c1a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f488c105320 0x7f488c19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 --2- 10.20.193.28:0/3230994747 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f488c104980 0x7f488c19d110 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 -- 10.20.193.28:0/3230994747 >> 10.20.193.28:0/3230994747 conn(0x7f488c100680 msgr2=0x7f488c1010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 -- 10.20.193.28:0/3230994747 shutdown_connections 2026-02-20T03:23:58.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.087+0000 7f4891ade640 1 -- 10.20.193.28:0/3230994747 wait complete. 2026-02-20T03:23:58.258 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:23:58.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 7.92 MB/sec execute 331 sec latency 24239.144 ms 2026-02-20T03:23:58.624 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:23:58.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd667fc640 1 -- 10.20.193.28:0/3835916696 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd58038470 con 0x7fcd68104980 2026-02-20T03:23:58.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/3835916696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd68104980 msgr2=0x7fcd68104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/3835916696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd68104980 0x7fcd68104de0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009a30 tx=0x7fcd5802f220 comp rx=0 tx=0).stop 2026-02-20T03:23:58.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/3835916696 shutdown_connections 2026-02-20T03:23:58.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/3835916696 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcd68105320 0x7fcd68111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/3835916696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd68104980 0x7fcd68104de0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/3835916696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd6810a980 0x7fcd6810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/3835916696 >> 10.20.193.28:0/3835916696 conn(0x7fcd68100680 msgr2=0x7fcd68102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/3835916696 shutdown_connections 2026-02-20T03:23:58.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.880+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/3835916696 wait complete. 2026-02-20T03:23:58.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.881+0000 7fcd6cbe5640 1 Processor -- start 2026-02-20T03:23:58.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.881+0000 7fcd6cbe5640 1 -- start start 2026-02-20T03:23:58.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.881+0000 7fcd6cbe5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd68104980 0x7fcd6819cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.881+0000 7fcd6cbe5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd68105320 0x7fcd6819d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.881+0000 7fcd6cbe5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcd6810a980 0x7fcd681a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd6cbe5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68114ba0 con 0x7fcd68104980 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd6cbe5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68114a20 con 0x7fcd68105320 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd6cbe5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcd68114d20 con 0x7fcd6810a980 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd68104980 0x7fcd6819cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd66ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd68105320 0x7fcd6819d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd68104980 0x7fcd6819cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52412/0 (socket says 10.20.193.28:52412) 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd677fe640 1 -- 10.20.193.28:0/2087281177 learned_addr learned my addr 10.20.193.28:0/2087281177 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd67fff640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcd6810a980 0x7fcd681a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd677fe640 1 -- 10.20.193.28:0/2087281177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcd6810a980 msgr2=0x7fcd681a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd677fe640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcd6810a980 0x7fcd681a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd677fe640 1 -- 10.20.193.28:0/2087281177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd68105320 msgr2=0x7fcd6819d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd677fe640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd68105320 0x7fcd6819d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd677fe640 1 -- 10.20.193.28:0/2087281177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd681a2010 con 0x7fcd68104980 2026-02-20T03:23:58.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd677fe640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd68104980 0x7fcd6819cfc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fcd540027e0 tx=0x7fcd54002cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:58.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd64ff9640 1 -- 10.20.193.28:0/2087281177 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400ed40 con 0x7fcd68104980 2026-02-20T03:23:58.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd64ff9640 1 -- 10.20.193.28:0/2087281177 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcd540108d0 con 0x7fcd68104980 2026-02-20T03:23:58.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd64ff9640 1 -- 10.20.193.28:0/2087281177 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400f7c0 con 0x7fcd68104980 2026-02-20T03:23:58.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/2087281177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd681a2300 con 0x7fcd68104980 2026-02-20T03:23:58.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.882+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/2087281177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd681a9b40 con 0x7fcd68104980 2026-02-20T03:23:58.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.885+0000 7fcd64ff9640 1 -- 10.20.193.28:0/2087281177 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fcd54010a80 con 0x7fcd68104980 2026-02-20T03:23:58.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd70373e00 1 Processor -- start 2026-02-20T03:23:58.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd70373e00 1 -- start start 2026-02-20T03:23:58.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0ca1fb0 0x5617e0ca2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0c9ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0c9cf60 0x5617e0ca8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd70373e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5617e0c1ce00 con 0x5617e0c9c5e0 2026-02-20T03:23:58.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd70373e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5617e0bef970 con 0x5617e0ca1fb0 2026-02-20T03:23:58.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd70373e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5617e0b9d1f0 con 0x5617e0c9cf60 2026-02-20T03:23:58.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd64ff9640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcd3c0b0e20 0x7fcd3c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd64ff9640 1 -- 10.20.193.28:0/2087281177 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fcd540e0f90 con 0x7fcd68104980 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.887+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0ca1fb0 0x5617e0ca2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0ca1fb0 0x5617e0ca2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53518/0 (socket says 10.20.193.28:53518) 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 -- 10.20.193.28:0/4256946649 learned_addr learned my addr 10.20.193.28:0/4256946649 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd66ffd640 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0c9cf60 0x5617e0ca8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd677fe640 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0c9ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcd3c0b0e20 0x7fcd3c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 -- 10.20.193.28:0/4256946649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0c9cf60 msgr2=0x5617e0ca8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0c9cf60 0x5617e0ca8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 -- 10.20.193.28:0/4256946649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 msgr2=0x5617e0c9ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:58.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0c9ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 -- 10.20.193.28:0/4256946649 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617e0bb03d0 con 0x5617e0ca1fb0 2026-02-20T03:23:58.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd677fe640 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0c9ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:23:58.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd66ffd640 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0c9cf60 0x5617e0ca8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:23:58.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcd3c0b0e20 0x7fcd3c0b32e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c002fd0 tx=0x7fcd5c00f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:58.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd67fff640 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0ca1fb0 0x5617e0ca2390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0047e0 tx=0x7fcd5c019740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3104d577a4a2909f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:58.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd2bfff640 1 -- 10.20.193.28:0/4256946649 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c01f070 con 0x5617e0ca1fb0 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd2bfff640 1 -- 10.20.193.28:0/4256946649 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcd5c0042c0 con 0x5617e0ca1fb0 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.888+0000 7fcd2bfff640 1 -- 10.20.193.28:0/4256946649 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c007c00 con 0x5617e0ca1fb0 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.889+0000 7fcd70373e00 1 -- 10.20.193.28:0/4256946649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0ca1fb0 msgr2=0x5617e0ca2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.889+0000 7fcd70373e00 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0ca1fb0 0x5617e0ca2390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0047e0 tx=0x7fcd5c019740 comp rx=0 tx=0).stop 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.889+0000 7fcd70373e00 1 -- 10.20.193.28:0/4256946649 shutdown_connections 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.889+0000 7fcd70373e00 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0c9cf60 0x5617e0ca8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.889+0000 7fcd70373e00 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0c9ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.889+0000 7fcd70373e00 1 --2- 10.20.193.28:0/4256946649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0ca1fb0 0x5617e0ca2390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.889+0000 7fcd70373e00 1 -- 10.20.193.28:0/4256946649 >> 10.20.193.28:0/4256946649 conn(0x5617e0c5f240 msgr2=0x5617e0c9ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.889+0000 7fcd70373e00 1 -- 10.20.193.28:0/4256946649 shutdown_connections 2026-02-20T03:23:58.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.889+0000 7fcd70373e00 1 -- 10.20.193.28:0/4256946649 wait complete. 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.890+0000 7fcd70373e00 1 -- start start 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.890+0000 7fcd70373e00 1 Processor -- start 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 0x5617e0cb74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd70373e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5617e0beb8a0 con 0x5617e0c9c5e0 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd70373e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5617e09ddf50 con 0x5617e0c9cf60 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd70373e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5617e0cb5a10 con 0x5617e0ca1fb0 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52436/0 (socket says 10.20.193.28:52436) 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd677fe640 1 -- 10.20.193.28:0/38431494 learned_addr learned my addr 10.20.193.28:0/38431494 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:58.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd66ffd640 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 0x5617e0cb74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd67fff640 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.891+0000 7fcd67fff640 1 -- 10.20.193.28:0/38431494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 msgr2=0x5617e0cb74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd67fff640 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 0x5617e0cb74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd67fff640 1 -- 10.20.193.28:0/38431494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 msgr2=0x5617e0cb6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd67fff640 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd67fff640 1 -- 10.20.193.28:0/38431494 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617e0caea30 con 0x5617e0ca1fb0 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd66ffd640 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 0x5617e0cb74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd67fff640 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb54d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009150 tx=0x7fcd5c0099b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f5e7ff4eccbbda6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd297fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd297fa640 1 -- 10.20.193.28:0/38431494 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c01f070 con 0x5617e0ca1fb0 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd297fa640 1 -- 10.20.193.28:0/38431494 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcd5c007ba0 con 0x5617e0ca1fb0 2026-02-20T03:23:58.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd70373e00 1 -- 10.20.193.28:0/38431494 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617e09c0b40 con 0x5617e0ca1fb0 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd297fa640 1 -- 10.20.193.28:0/38431494 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c0256d0 con 0x5617e0ca1fb0 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd70373e00 10 client.27001 _ll_register_callbacks cb 0x5617e0c28eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd70373e00 1 -- 10.20.193.28:0/38431494 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5617e0bfd150 con 0x5617e0ca1fb0 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd297fa640 1 -- 10.20.193.28:0/38431494 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fcd5c025870 con 0x5617e0ca1fb0 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd297fa640 1 -- 10.20.193.28:0/38431494 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd5c025b70 con 0x5617e0ca1fb0 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd70373e00 10 client.27001 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.892+0000 7fcd70373e00 1 -- 10.20.193.28:0/38431494 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5617e0baa1e0 con 0x5617e0ca1fb0 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd297fa640 1 -- 10.20.193.28:0/38431494 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fcd5c018040 con 0x5617e0ca1fb0 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd70373e00 10 client.27001 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd70373e00 10 client.27001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd70373e00 20 client.27001 populate_metadata read hostname 'trial028' 2026-02-20T03:23:58.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd70373e00 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617e0cc53e0 0x5617e0cc77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd70373e00 4 client.27001 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:23:58.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd70373e00 1 -- 10.20.193.28:0/38431494 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617e0bf7560 con 0x5617e0cc53e0 2026-02-20T03:23:58.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd677fe640 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617e0cc53e0 0x5617e0cc77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd677fe640 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617e0cc53e0 0x5617e0cc77d0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1834d4a48815ff88 server_cookie=a884a1d495293ef9 in_seq=0 out_seq=0 2026-02-20T03:23:58.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.893+0000 7fcd297fa640 10 client.27001 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:58.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd297fa640 1 -- 10.20.193.28:0/38431494 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5617e0bf7560 con 0x5617e0cc53e0 2026-02-20T03:23:58.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd297fa640 10 client.27001 handle_command_reply: tid=0 2026-02-20T03:23:58.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 client.27001 shutdown 2026-02-20T03:23:58.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 -- 10.20.193.28:0/38431494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 msgr2=0x5617e0cb54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb54d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c009150 tx=0x7fcd5c0099b0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 -- 10.20.193.28:0/38431494 shutdown_connections 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617e0cc53e0 0x5617e0cc77d0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb54d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 0x5617e0cb74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd297fa640 0 client.27001 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 --2- 10.20.193.28:0/38431494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 -- 10.20.193.28:0/38431494 >> 10.20.193.28:0/38431494 conn(0x5617e0c5f240 msgr2=0x5617e0c9b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 -- 10.20.193.28:0/38431494 shutdown_connections 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 1 -- 10.20.193.28:0/38431494 wait complete. 2026-02-20T03:23:58.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.894+0000 7fcd70373e00 20 client.27001 trim_cache size 0 max 16384 2026-02-20T03:23:58.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.901+0000 7fcd70373e00 1 Processor -- start 2026-02-20T03:23:58.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.901+0000 7fcd70373e00 1 -- start start 2026-02-20T03:23:58.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.901+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.901+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 0x5617e0cb74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.901+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.901+0000 7fcd70373e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c012660 con 0x5617e0c9c5e0 2026-02-20T03:23:58.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.901+0000 7fcd70373e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c00ff30 con 0x5617e0c9cf60 2026-02-20T03:23:58.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.901+0000 7fcd70373e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c00dd80 con 0x5617e0ca1fb0 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd67fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:44118/0 (socket says 10.20.193.28:44118) 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd67fff640 1 -- 10.20.193.28:0/1825904992 learned_addr learned my addr 10.20.193.28:0/1825904992 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd66ffd640 1 --2- 10.20.193.28:0/1825904992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 0x5617e0cb74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd677fe640 1 -- 10.20.193.28:0/1825904992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 msgr2=0x5617e0cb3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd677fe640 1 --2- 10.20.193.28:0/1825904992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd677fe640 1 -- 10.20.193.28:0/1825904992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 msgr2=0x5617e0cb74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd677fe640 1 --2- 10.20.193.28:0/1825904992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 0x5617e0cb74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd677fe640 1 -- 10.20.193.28:0/1825904992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617e0cae860 con 0x5617e0c9c5e0 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd677fe640 1 --2- 10.20.193.28:0/1825904992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fcd540de600 tx=0x7fcd540de4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3857d4033b0fb7b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:58.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd2b7fe640 1 -- 10.20.193.28:0/1825904992 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd540cf1f0 con 0x5617e0c9c5e0 2026-02-20T03:23:58.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd2b7fe640 1 -- 10.20.193.28:0/1825904992 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcd540a4cb0 con 0x5617e0c9c5e0 2026-02-20T03:23:58.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.902+0000 7fcd2b7fe640 1 -- 10.20.193.28:0/1825904992 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd540a7ee0 con 0x5617e0c9c5e0 2026-02-20T03:23:58.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 -- 10.20.193.28:0/1825904992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 msgr2=0x5617e0cb6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 --2- 10.20.193.28:0/1825904992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fcd540de600 tx=0x7fcd540de4d0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 -- 10.20.193.28:0/1825904992 shutdown_connections 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 --2- 10.20.193.28:0/1825904992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0cb3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 --2- 10.20.193.28:0/1825904992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9cf60 0x5617e0cb74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 --2- 10.20.193.28:0/1825904992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9c5e0 0x5617e0cb6f70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 -- 10.20.193.28:0/1825904992 >> 10.20.193.28:0/1825904992 conn(0x5617e0c5f240 msgr2=0x5617e0c9f950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 -- 10.20.193.28:0/1825904992 shutdown_connections 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 -- 10.20.193.28:0/1825904992 wait complete. 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.903+0000 7fcd70373e00 1 -- start start 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd70373e00 1 Processor -- start 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9c5e0 0x5617e0ccce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9cf60 0x5617e0ccd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd70373e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0ccd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd70373e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c00e3f0 con 0x5617e0c9cf60 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd70373e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c00f860 con 0x5617e0c9c5e0 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd70373e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0c00eac0 con 0x5617e0ca1fb0 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd66ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9cf60 0x5617e0ccd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9c5e0 0x5617e0ccce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9c5e0 0x5617e0ccce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53548/0 (socket says 10.20.193.28:53548) 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd677fe640 1 -- 10.20.193.28:0/3148256179 learned_addr learned my addr 10.20.193.28:0/3148256179 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd67fff640 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0ccd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd677fe640 1 -- 10.20.193.28:0/3148256179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 msgr2=0x5617e0ccd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd677fe640 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0ccd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd677fe640 1 -- 10.20.193.28:0/3148256179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9cf60 msgr2=0x5617e0ccd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:23:58.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd677fe640 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9cf60 0x5617e0ccd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd677fe640 1 -- 10.20.193.28:0/3148256179 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617e08ce870 con 0x5617e0c9c5e0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.904+0000 7fcd66ffd640 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9cf60 0x5617e0ccd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd677fe640 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9c5e0 0x5617e0ccce90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcd54002410 tx=0x7fcd540b1d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81e00300ac4c7068 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd297fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd297fa640 1 -- 10.20.193.28:0/3148256179 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54010430 con 0x5617e0c9c5e0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 1 -- 10.20.193.28:0/3148256179 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617e0b8f3f0 con 0x5617e0c9c5e0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 10 client.26987 _ll_register_callbacks cb 0x7fcd54004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 1 -- 10.20.193.28:0/3148256179 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5617e0bc07c0 con 0x5617e0c9c5e0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd297fa640 1 -- 10.20.193.28:0/3148256179 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcd540bc070 con 0x5617e0c9c5e0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd297fa640 1 -- 10.20.193.28:0/3148256179 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd540c2060 con 0x5617e0c9c5e0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd297fa640 1 -- 10.20.193.28:0/3148256179 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fcd540a4390 con 0x5617e0c9c5e0 2026-02-20T03:23:58.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd297fa640 1 -- 10.20.193.28:0/3148256179 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd540a4630 con 0x5617e0c9c5e0 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 10 client.26987 fetch_fsmap learned FSMap version 29 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 1 -- 10.20.193.28:0/3148256179 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5617e0caf550 con 0x5617e0c9c5e0 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd297fa640 1 -- 10.20.193.28:0/3148256179 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fcd540a7c80 con 0x5617e0c9c5e0 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 10 client.26987 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 10 client.26987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 20 client.26987 populate_metadata read hostname 'trial028' 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617e0d38eb0 0x5617e0d3b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 4 client.26987 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.905+0000 7fcd70373e00 1 -- 10.20.193.28:0/3148256179 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5617e0ba1ab0 con 0x5617e0d38eb0 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.906+0000 7fcd66ffd640 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617e0d38eb0 0x5617e0d3b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.906+0000 7fcd66ffd640 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617e0d38eb0 0x5617e0d3b370 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f5a91e0c8d5a609 server_cookie=96437112725d8c86 in_seq=0 out_seq=0 2026-02-20T03:23:58.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.906+0000 7fcd297fa640 10 client.26987 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.906+0000 7fcd297fa640 1 -- 10.20.193.28:0/3148256179 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5617e0ba1ab0 con 0x5617e0d38eb0 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.906+0000 7fcd297fa640 10 client.26987 handle_command_reply: tid=0 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.906+0000 7fcd70373e00 1 client.26987 shutdown 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.906+0000 7fcd70373e00 1 -- 10.20.193.28:0/3148256179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9c5e0 msgr2=0x5617e0ccce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.906+0000 7fcd70373e00 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9c5e0 0x5617e0ccce90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcd54002410 tx=0x7fcd540b1d50 comp rx=0 tx=0).stop 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd70373e00 1 -- 10.20.193.28:0/3148256179 shutdown_connections 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd70373e00 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5617e0d38eb0 0x5617e0d3b370 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd70373e00 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5617e0ca1fb0 0x5617e0ccd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd70373e00 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5617e0c9cf60 0x5617e0ccd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd70373e00 1 --2- 10.20.193.28:0/3148256179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5617e0c9c5e0 0x5617e0ccce90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd70373e00 1 -- 10.20.193.28:0/3148256179 >> 10.20.193.28:0/3148256179 conn(0x5617e0c5f240 msgr2=0x5617e0c9f950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd297fa640 0 client.26987 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:23:58.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd70373e00 1 -- 10.20.193.28:0/3148256179 shutdown_connections 2026-02-20T03:23:58.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd70373e00 1 -- 10.20.193.28:0/3148256179 wait complete. 2026-02-20T03:23:58.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd70373e00 20 client.26987 trim_cache size 0 max 16384 2026-02-20T03:23:58.916 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:23:58.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcd3c0b0e20 msgr2=0x7fcd3c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcd3c0b0e20 0x7fcd3c0b32e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c002fd0 tx=0x7fcd5c00f000 comp rx=0 tx=0).stop 2026-02-20T03:23:58.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd68104980 msgr2=0x7fcd6819cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:23:58.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd68104980 0x7fcd6819cfc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fcd540027e0 tx=0x7fcd54002cb0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/2087281177 shutdown_connections 2026-02-20T03:23:58.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fcd3c0b0e20 0x7fcd3c0b32e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcd6810a980 0x7fcd681a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcd68105320 0x7fcd6819d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 --2- 10.20.193.28:0/2087281177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcd68104980 0x7fcd6819cfc0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:23:58.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.907+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/2087281177 >> 10.20.193.28:0/2087281177 conn(0x7fcd68100680 msgr2=0x7fcd68100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:23:58.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.908+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/2087281177 shutdown_connections 2026-02-20T03:23:58.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:23:58.908+0000 7fcd6cbe5640 1 -- 10.20.193.28:0/2087281177 wait complete. 2026-02-20T03:23:59.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 7.90 MB/sec execute 332 sec latency 25239.186 ms 2026-02-20T03:23:59.648 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:23:59 trial126 ceph-mon[38476]: pgmap v460: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 439 KiB/s wr, 30 op/s 2026-02-20T03:23:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:23:59 trial177 ceph-mon[43181]: pgmap v460: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 439 KiB/s wr, 30 op/s 2026-02-20T03:23:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:23:59 trial028 ceph-mon[38552]: pgmap v460: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 22 KiB/s rd, 439 KiB/s wr, 30 op/s 2026-02-20T03:24:00.007 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:24:00.008 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:24:00.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.070+0000 7f930300d640 1 -- 10.20.193.28:0/4030064882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 msgr2=0x7f92fc115790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.070+0000 7f930300d640 1 --2- 10.20.193.28:0/4030064882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 0x7f92fc115790 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f92f800b0a0 tx=0x7f92f802f410 comp rx=0 tx=0).stop 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.070+0000 7f930300d640 1 -- 10.20.193.28:0/4030064882 shutdown_connections 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.070+0000 7f930300d640 1 --2- 10.20.193.28:0/4030064882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 0x7f92fc115790 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.070+0000 7f930300d640 1 --2- 10.20.193.28:0/4030064882 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f92fc10e540 0x7f92fc10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.070+0000 7f930300d640 1 --2- 10.20.193.28:0/4030064882 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f92fc10d830 0x7f92fc10dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.070+0000 7f930300d640 1 -- 10.20.193.28:0/4030064882 >> 10.20.193.28:0/4030064882 conn(0x7f92fc06c660 msgr2=0x7f92fc06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.070+0000 7f930300d640 1 -- 10.20.193.28:0/4030064882 shutdown_connections 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.070+0000 7f930300d640 1 -- 10.20.193.28:0/4030064882 wait complete. 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930300d640 1 Processor -- start 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930300d640 1 -- start start 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930300d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f92fc10d830 0x7f92fc1a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930300d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f92fc10e540 0x7f92fc1a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930300d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 0x7f92fc1ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930300d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc118e30 con 0x7f92fc10eee0 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930300d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc118cb0 con 0x7f92fc10d830 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930300d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f92fc118fb0 con 0x7f92fc10e540 2026-02-20T03:24:00.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930280c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 0x7f92fc1ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930280c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 0x7f92fc1ac940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52464/0 (socket says 10.20.193.28:52464) 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930280c640 1 -- 10.20.193.28:0/1161387956 learned_addr learned my addr 10.20.193.28:0/1161387956 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930200b640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f92fc10d830 0x7f92fc1a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.071+0000 7f930180a640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f92fc10e540 0x7f92fc1a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f930280c640 1 -- 10.20.193.28:0/1161387956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f92fc10e540 msgr2=0x7f92fc1a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f930280c640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f92fc10e540 0x7f92fc1a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f930280c640 1 -- 10.20.193.28:0/1161387956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f92fc10d830 msgr2=0x7f92fc1a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f930280c640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f92fc10d830 0x7f92fc1a5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f930280c640 1 -- 10.20.193.28:0/1161387956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92fc1ad040 con 0x7f92fc10eee0 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f930280c640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 0x7f92fc1ac940 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f92f800c090 tx=0x7f92f8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f92e37fe640 1 -- 10.20.193.28:0/1161387956 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8002a60 con 0x7f92fc10eee0 2026-02-20T03:24:00.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f92e37fe640 1 -- 10.20.193.28:0/1161387956 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f92f8002c00 con 0x7f92fc10eee0 2026-02-20T03:24:00.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f92e37fe640 1 -- 10.20.193.28:0/1161387956 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f80388b0 con 0x7f92fc10eee0 2026-02-20T03:24:00.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f930300d640 1 -- 10.20.193.28:0/1161387956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92fc1ad2d0 con 0x7f92fc10eee0 2026-02-20T03:24:00.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.072+0000 7f930300d640 1 -- 10.20.193.28:0/1161387956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92fc1ad710 con 0x7f92fc10eee0 2026-02-20T03:24:00.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.075+0000 7f92e37fe640 1 -- 10.20.193.28:0/1161387956 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f92f8038a50 con 0x7f92fc10eee0 2026-02-20T03:24:00.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.075+0000 7f93071d7e00 1 Processor -- start 2026-02-20T03:24:00.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.075+0000 7f93071d7e00 1 -- start start 2026-02-20T03:24:00.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.075+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49f330 0x56529c49f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.075+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49fc90 0x56529c4a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.075+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c4a4ce0 0x56529c4a7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.075+0000 7f93071d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56529c3f38f0 con 0x56529c4a4ce0 2026-02-20T03:24:00.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.075+0000 7f93071d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56529c3a12e0 con 0x56529c49fc90 2026-02-20T03:24:00.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.075+0000 7f93071d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56529c3ef820 con 0x56529c49f330 2026-02-20T03:24:00.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930200b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49fc90 0x56529c4a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930200b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49fc90 0x56529c4a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53582/0 (socket says 10.20.193.28:53582) 2026-02-20T03:24:00.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930200b640 1 -- 10.20.193.28:0/1728980291 learned_addr learned my addr 10.20.193.28:0/1728980291 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930180a640 1 --2- 10.20.193.28:0/1728980291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c4a4ce0 0x56529c4a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930200b640 1 -- 10.20.193.28:0/1728980291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49f330 msgr2=0x56529c49f750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930200b640 1 --2- 10.20.193.28:0/1728980291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49f330 0x56529c49f750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930200b640 1 -- 10.20.193.28:0/1728980291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c4a4ce0 msgr2=0x56529c4a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930200b640 1 --2- 10.20.193.28:0/1728980291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c4a4ce0 0x56529c4a7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930200b640 1 -- 10.20.193.28:0/1728980291 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56529c3935a0 con 0x56529c49fc90 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f930180a640 1 --2- 10.20.193.28:0/1728980291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c4a4ce0 0x56529c4a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.076+0000 7f92e37fe640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92d80b0e20 0x7f92d80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f92e37fe640 1 -- 10.20.193.28:0/1161387956 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f92f8104ee0 con 0x7f92fc10eee0 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f930200b640 1 --2- 10.20.193.28:0/1728980291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49fc90 0x56529c4a46c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f92ec004670 tx=0x7f92ec009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=199e17c14ddb3e5d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f930180a640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92d80b0e20 0x7f92d80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f92ca3ff640 1 -- 10.20.193.28:0/1728980291 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec010630 con 0x56529c49fc90 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f92ca3ff640 1 -- 10.20.193.28:0/1728980291 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f92ec010c70 con 0x56529c49fc90 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f92ca3ff640 1 -- 10.20.193.28:0/1728980291 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec00ece0 con 0x56529c49fc90 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f93071d7e00 1 -- 10.20.193.28:0/1728980291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49fc90 msgr2=0x56529c4a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1728980291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49fc90 0x56529c4a46c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f92ec004670 tx=0x7f92ec009c50 comp rx=0 tx=0).stop 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f930180a640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92d80b0e20 0x7f92d80b32e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x56529c4a0630 tx=0x7f92f0004250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f93071d7e00 1 -- 10.20.193.28:0/1728980291 shutdown_connections 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1728980291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c4a4ce0 0x56529c4a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1728980291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49fc90 0x56529c4a46c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1728980291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49f330 0x56529c49f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f93071d7e00 1 -- 10.20.193.28:0/1728980291 >> 10.20.193.28:0/1728980291 conn(0x56529c49a2d0 msgr2=0x56529c4a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f93071d7e00 1 -- 10.20.193.28:0/1728980291 shutdown_connections 2026-02-20T03:24:00.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.077+0000 7f93071d7e00 1 -- 10.20.193.28:0/1728980291 wait complete. 2026-02-20T03:24:00.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f93071d7e00 1 -- start start 2026-02-20T03:24:00.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f93071d7e00 1 Processor -- start 2026-02-20T03:24:00.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49f330 0x56529c4ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49fc90 0x56529c4cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c4a4ce0 0x56529c4d41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f93071d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56529c39b0c0 con 0x56529c49fc90 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f93071d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56529c4bca90 con 0x56529c49f330 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f93071d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56529c4d4760 con 0x56529c4a4ce0 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f930180a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49fc90 0x56529c4cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f930200b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49f330 0x56529c4ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f930180a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49fc90 0x56529c4cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52482/0 (socket says 10.20.193.28:52482) 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f930180a640 1 -- 10.20.193.28:0/1204051246 learned_addr learned my addr 10.20.193.28:0/1204051246 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.079+0000 7f930280c640 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c4a4ce0 0x56529c4d41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f930180a640 1 -- 10.20.193.28:0/1204051246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c4a4ce0 msgr2=0x56529c4d41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f930180a640 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c4a4ce0 0x56529c4d41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f930180a640 1 -- 10.20.193.28:0/1204051246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49f330 msgr2=0x56529c4ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f930180a640 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49f330 0x56529c4ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f930180a640 1 -- 10.20.193.28:0/1204051246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56529c4c6430 con 0x56529c49fc90 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f930180a640 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49fc90 0x56529c4cd250 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f92f001d420 tx=0x7f92f00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891c5aca24a9f493 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f92b77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f92b77fe640 1 -- 10.20.193.28:0/1204051246 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f001e830 con 0x56529c49fc90 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f92b77fe640 1 -- 10.20.193.28:0/1204051246 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f92f0022070 con 0x56529c49fc90 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f93071d7e00 1 -- 10.20.193.28:0/1204051246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56529c3af820 con 0x56529c49fc90 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f93071d7e00 10 client.17856 _ll_register_callbacks cb 0x56529c39eff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.080+0000 7f93071d7e00 1 -- 10.20.193.28:0/1204051246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56529c3fb4e0 con 0x56529c49fc90 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f92b77fe640 1 -- 10.20.193.28:0/1204051246 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0027de0 con 0x56529c49fc90 2026-02-20T03:24:00.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f92b77fe640 1 -- 10.20.193.28:0/1204051246 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f92f0027470 con 0x56529c49fc90 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f92b77fe640 1 -- 10.20.193.28:0/1204051246 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f92f0027750 con 0x56529c49fc90 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f93071d7e00 10 client.17856 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f93071d7e00 1 -- 10.20.193.28:0/1204051246 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56529c3b4380 con 0x56529c49fc90 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f92b77fe640 1 -- 10.20.193.28:0/1204051246 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f92f002f050 con 0x56529c49fc90 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f93071d7e00 10 client.17856 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f93071d7e00 10 client.17856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f93071d7e00 20 client.17856 populate_metadata read hostname 'trial028' 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56529c4d8ad0 0x56529c4daf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f93071d7e00 4 client.17856 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:00.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.081+0000 7f93071d7e00 1 -- 10.20.193.28:0/1204051246 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56529c375bd0 con 0x56529c4d8ad0 2026-02-20T03:24:00.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.082+0000 7f930200b640 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56529c4d8ad0 0x56529c4daf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.082+0000 7f92b77fe640 10 client.17856 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:00.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.082+0000 7f930200b640 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56529c4d8ad0 0x56529c4daf40 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe01cfd9d9e679b3 server_cookie=115a587dbf6661e0 in_seq=0 out_seq=0 2026-02-20T03:24:00.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f92b77fe640 1 -- 10.20.193.28:0/1204051246 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56529c375bd0 con 0x56529c4d8ad0 2026-02-20T03:24:00.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f92b77fe640 10 client.17856 handle_command_reply: tid=0 2026-02-20T03:24:00.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 client.17856 shutdown 2026-02-20T03:24:00.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 -- 10.20.193.28:0/1204051246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49fc90 msgr2=0x56529c4cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49fc90 0x56529c4cd250 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f92f001d420 tx=0x7f92f00047c0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 -- 10.20.193.28:0/1204051246 shutdown_connections 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56529c4d8ad0 0x56529c4daf40 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c4a4ce0 0x56529c4d41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49fc90 0x56529c4cd250 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 --2- 10.20.193.28:0/1204051246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c49f330 0x56529c4ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f92b77fe640 0 client.17856 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 -- 10.20.193.28:0/1204051246 >> 10.20.193.28:0/1204051246 conn(0x56529c49a2d0 msgr2=0x56529c4a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 -- 10.20.193.28:0/1204051246 shutdown_connections 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 1 -- 10.20.193.28:0/1204051246 wait complete. 2026-02-20T03:24:00.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.083+0000 7f93071d7e00 20 client.17856 trim_cache size 0 max 16384 2026-02-20T03:24:00.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.090+0000 7f93071d7e00 1 Processor -- start 2026-02-20T03:24:00.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.090+0000 7f93071d7e00 1 -- start start 2026-02-20T03:24:00.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 0x56529c4d4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f93071d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92a80126a0 con 0x56529c49f330 2026-02-20T03:24:00.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f93071d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f92a800ff70 con 0x56529c4a4ce0 2026-02-20T03:24:00.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f93071d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f92a800ddc0 con 0x56529c49fc90 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930200b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930200b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52488/0 (socket says 10.20.193.28:52488) 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930200b640 1 -- 10.20.193.28:0/4227462644 learned_addr learned my addr 10.20.193.28:0/4227462644 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930180a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930280c640 1 --2- 10.20.193.28:0/4227462644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 0x56529c4d4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930180a640 1 -- 10.20.193.28:0/4227462644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 msgr2=0x56529c4d4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930180a640 1 --2- 10.20.193.28:0/4227462644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 0x56529c4d4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930180a640 1 -- 10.20.193.28:0/4227462644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 msgr2=0x56529c4cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930180a640 1 --2- 10.20.193.28:0/4227462644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930180a640 1 -- 10.20.193.28:0/4227462644 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56529c4c6260 con 0x56529c49fc90 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930200b640 1 --2- 10.20.193.28:0/4227462644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:00.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.091+0000 7f930180a640 1 --2- 10.20.193.28:0/4227462644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4a9a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f92f001dd90 tx=0x7f92f0029000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc507b121e40d934 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f92c9bfe640 1 -- 10.20.193.28:0/4227462644 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0027d30 con 0x56529c49fc90 2026-02-20T03:24:00.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f92c9bfe640 1 -- 10.20.193.28:0/4227462644 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f92f0037030 con 0x56529c49fc90 2026-02-20T03:24:00.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f92c9bfe640 1 -- 10.20.193.28:0/4227462644 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0005020 con 0x56529c49fc90 2026-02-20T03:24:00.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 -- 10.20.193.28:0/4227462644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 msgr2=0x56529c4a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 --2- 10.20.193.28:0/4227462644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4a9a80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f92f001dd90 tx=0x7f92f0029000 comp rx=0 tx=0).stop 2026-02-20T03:24:00.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 -- 10.20.193.28:0/4227462644 shutdown_connections 2026-02-20T03:24:00.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 --2- 10.20.193.28:0/4227462644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 0x56529c4d4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 --2- 10.20.193.28:0/4227462644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4a9a80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 --2- 10.20.193.28:0/4227462644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 -- 10.20.193.28:0/4227462644 >> 10.20.193.28:0/4227462644 conn(0x56529c49a2d0 msgr2=0x56529c4cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 -- 10.20.193.28:0/4227462644 shutdown_connections 2026-02-20T03:24:00.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 -- 10.20.193.28:0/4227462644 wait complete. 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.092+0000 7f93071d7e00 1 -- start start 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f93071d7e00 1 Processor -- start 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f93071d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 0x56529c4d36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f93071d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92a800e430 con 0x56529c49f330 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f93071d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f92a800f8a0 con 0x56529c4a4ce0 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f93071d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f92a800eb00 con 0x56529c49fc90 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930200b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930180a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930180a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:44190/0 (socket says 10.20.193.28:44190) 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930180a640 1 -- 10.20.193.28:0/3979302704 learned_addr learned my addr 10.20.193.28:0/3979302704 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930280c640 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 0x56529c4d36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930200b640 1 -- 10.20.193.28:0/3979302704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 msgr2=0x56529c4d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930200b640 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930200b640 1 -- 10.20.193.28:0/3979302704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 msgr2=0x56529c4d36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930200b640 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 0x56529c4d36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.093+0000 7f930200b640 1 -- 10.20.193.28:0/3979302704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56529c153690 con 0x56529c49f330 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f930200b640 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4d0140 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f92ec002ab0 tx=0x7f92ec009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9ea960828d1a31 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f92b77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:00.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f92b77fe640 1 -- 10.20.193.28:0/3979302704 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0046a0 con 0x56529c49f330 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f92b77fe640 1 -- 10.20.193.28:0/3979302704 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f92ec004ce0 con 0x56529c49f330 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f92b77fe640 1 -- 10.20.193.28:0/3979302704 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec010ae0 con 0x56529c49f330 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f93071d7e00 1 -- 10.20.193.28:0/3979302704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56529c3b8b70 con 0x56529c49f330 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f92b77fe640 1 -- 10.20.193.28:0/3979302704 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f92ec028420 con 0x56529c49f330 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f92b77fe640 10 client.17862 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f93071d7e00 10 client.17862 _ll_register_callbacks cb 0x7f92f0003d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f93071d7e00 1 -- 10.20.193.28:0/3979302704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56529c375bd0 con 0x56529c49f330 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f92b77fe640 1 -- 10.20.193.28:0/3979302704 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f92ec034060 con 0x56529c49f330 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f93071d7e00 10 client.17862 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f93071d7e00 1 -- 10.20.193.28:0/3979302704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56529c4c6f50 con 0x56529c49f330 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.094+0000 7f92b77fe640 1 -- 10.20.193.28:0/3979302704 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f92ec037050 con 0x56529c49f330 2026-02-20T03:24:00.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.095+0000 7f93071d7e00 10 client.17862 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:00.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.095+0000 7f93071d7e00 10 client.17862 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:00.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.095+0000 7f93071d7e00 20 client.17862 populate_metadata read hostname 'trial028' 2026-02-20T03:24:00.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.095+0000 7f93071d7e00 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56529c544510 0x56529c5469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.095+0000 7f93071d7e00 4 client.17862 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:24:00.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.095+0000 7f93071d7e00 1 -- 10.20.193.28:0/3979302704 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56529c3c46b0 con 0x56529c544510 2026-02-20T03:24:00.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.095+0000 7f930180a640 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56529c544510 0x56529c5469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.095+0000 7f92b77fe640 10 client.17862 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:00.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.095+0000 7f930180a640 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56529c544510 0x56529c5469d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6974032359258587 server_cookie=e8942a2b8c6c33c7 in_seq=0 out_seq=0 2026-02-20T03:24:00.115 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.112+0000 7f92b77fe640 1 -- 10.20.193.28:0/3979302704 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56529c3c46b0 con 0x56529c544510 2026-02-20T03:24:00.115 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.112+0000 7f92b77fe640 10 client.17862 handle_command_reply: tid=0 2026-02-20T03:24:00.115 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.112+0000 7f93071d7e00 1 client.17862 shutdown 2026-02-20T03:24:00.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.112+0000 7f93071d7e00 1 -- 10.20.193.28:0/3979302704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 msgr2=0x56529c4d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.112+0000 7f93071d7e00 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4d0140 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f92ec002ab0 tx=0x7f92ec009f40 comp rx=0 tx=0).stop 2026-02-20T03:24:00.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.112+0000 7f93071d7e00 1 -- 10.20.193.28:0/3979302704 shutdown_connections 2026-02-20T03:24:00.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.112+0000 7f93071d7e00 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56529c544510 0x56529c5469d0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f93071d7e00 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56529c4a4ce0 0x56529c4d36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f93071d7e00 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56529c49fc90 0x56529c4d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f93071d7e00 1 --2- 10.20.193.28:0/3979302704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56529c49f330 0x56529c4d0140 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.116 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f93071d7e00 1 -- 10.20.193.28:0/3979302704 >> 10.20.193.28:0/3979302704 conn(0x56529c49a2d0 msgr2=0x56529c4aa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f92b77fe640 0 client.17862 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f93071d7e00 1 -- 10.20.193.28:0/3979302704 shutdown_connections 2026-02-20T03:24:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f93071d7e00 1 -- 10.20.193.28:0/3979302704 wait complete. 2026-02-20T03:24:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f93071d7e00 20 client.17862 trim_cache size 0 max 16384 2026-02-20T03:24:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:24:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:24:00.117 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:24:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:24:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 -- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92d80b0e20 msgr2=0x7f92d80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92d80b0e20 0x7f92d80b32e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x56529c4a0630 tx=0x7f92f0004250 comp rx=0 tx=0).stop 2026-02-20T03:24:00.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 -- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 msgr2=0x7f92fc1ac940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 0x7f92fc1ac940 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f92f800c090 tx=0x7f92f8004290 comp rx=0 tx=0).stop 2026-02-20T03:24:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 -- 10.20.193.28:0/1161387956 shutdown_connections 2026-02-20T03:24:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92d80b0e20 0x7f92d80b32e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f92fc10eee0 0x7f92fc1ac940 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f92fc10e540 0x7f92fc1a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 --2- 10.20.193.28:0/1161387956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f92fc10d830 0x7f92fc1a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 -- 10.20.193.28:0/1161387956 >> 10.20.193.28:0/1161387956 conn(0x7f92fc06c660 msgr2=0x7f92fc111930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 -- 10.20.193.28:0/1161387956 shutdown_connections 2026-02-20T03:24:00.119 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:00.113+0000 7f930300d640 1 -- 10.20.193.28:0/1161387956 wait complete. 2026-02-20T03:24:00.284 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:00.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.461+0000 7f84b1782640 1 -- 10.20.193.28:0/409697568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84ac109ed0 msgr2=0x7f84ac111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.461+0000 7f84b1782640 1 --2- 10.20.193.28:0/409697568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84ac109ed0 0x7f84ac111a50 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f849c00b0a0 tx=0x7f849c02f410 comp rx=0 tx=0).stop 2026-02-20T03:24:00.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.461+0000 7f84b1782640 1 -- 10.20.193.28:0/409697568 shutdown_connections 2026-02-20T03:24:00.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.461+0000 7f84b1782640 1 --2- 10.20.193.28:0/409697568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84ac109ed0 0x7f84ac111a50 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.461+0000 7f84b1782640 1 --2- 10.20.193.28:0/409697568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84ac105750 0x7f84ac1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.461+0000 7f84b1782640 1 --2- 10.20.193.28:0/409697568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84ac104da0 0x7f84ac105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.461+0000 7f84b1782640 1 -- 10.20.193.28:0/409697568 >> 10.20.193.28:0/409697568 conn(0x7f84ac100840 msgr2=0x7f84ac102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.461+0000 7f84b1782640 1 -- 10.20.193.28:0/409697568 shutdown_connections 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.461+0000 7f84b1782640 1 -- 10.20.193.28:0/409697568 wait complete. 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.462+0000 7f84b1782640 1 Processor -- start 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.462+0000 7f84b1782640 1 -- start start 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.462+0000 7f84b1782640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84ac104da0 0x7f84ac077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.462+0000 7f84b1782640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84ac105750 0x7f84ac077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.462+0000 7f84b1782640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84ac109ed0 0x7f84ac078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.462+0000 7f84b1782640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac114da0 con 0x7f84ac104da0 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.462+0000 7f84b1782640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac114c20 con 0x7f84ac105750 2026-02-20T03:24:00.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.462+0000 7f84b1782640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac114f20 con 0x7f84ac109ed0 2026-02-20T03:24:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84ac104da0 0x7f84ac077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aa7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84ac105750 0x7f84ac077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aa7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84ac105750 0x7f84ac077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53634/0 (socket says 10.20.193.28:53634) 2026-02-20T03:24:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aa7fc640 1 -- 10.20.193.28:0/2824173607 learned_addr learned my addr 10.20.193.28:0/2824173607 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84ac109ed0 0x7f84ac078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aaffd640 1 -- 10.20.193.28:0/2824173607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84ac109ed0 msgr2=0x7f84ac078080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aaffd640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84ac109ed0 0x7f84ac078080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aaffd640 1 -- 10.20.193.28:0/2824173607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84ac105750 msgr2=0x7f84ac077b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aaffd640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84ac105750 0x7f84ac077b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aaffd640 1 -- 10.20.193.28:0/2824173607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac1ad940 con 0x7f84ac104da0 2026-02-20T03:24:00.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84aaffd640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84ac104da0 0x7f84ac077600 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f84a000ea20 tx=0x7f84a000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f848bfff640 1 -- 10.20.193.28:0/2824173607 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a000ce50 con 0x7f84ac104da0 2026-02-20T03:24:00.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f848bfff640 1 -- 10.20.193.28:0/2824173607 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84a0004570 con 0x7f84ac104da0 2026-02-20T03:24:00.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f848bfff640 1 -- 10.20.193.28:0/2824173607 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0010690 con 0x7f84ac104da0 2026-02-20T03:24:00.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84b1782640 1 -- 10.20.193.28:0/2824173607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac1adc30 con 0x7f84ac104da0 2026-02-20T03:24:00.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.463+0000 7f84b1782640 1 -- 10.20.193.28:0/2824173607 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac1ae120 con 0x7f84ac104da0 2026-02-20T03:24:00.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.466+0000 7f848bfff640 1 -- 10.20.193.28:0/2824173607 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f84a0002920 con 0x7f84ac104da0 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84b3c87e00 1 Processor -- start 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84b3c87e00 1 -- start start 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad142a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13dee0 0x5618ad13e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13e8a0 0x5618ad14a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5618ad090c00 con 0x5618ad13e8a0 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5618ad03e3c0 con 0x5618ad13dee0 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5618ad08cb30 con 0x5618ad142630 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84aa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13e8a0 0x5618ad14a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84ab7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84ab7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad142a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:44220/0 (socket says 10.20.193.28:44220) 2026-02-20T03:24:00.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84ab7fe640 1 -- 10.20.193.28:0/1977922826 learned_addr learned my addr 10.20.193.28:0/1977922826 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84ab7fe640 1 -- 10.20.193.28:0/1977922826 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13dee0 msgr2=0x5618ad13e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/1977922826 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13dee0 0x5618ad13e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84ab7fe640 1 -- 10.20.193.28:0/1977922826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13e8a0 msgr2=0x5618ad14a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/1977922826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13e8a0 0x5618ad14a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.467+0000 7f84ab7fe640 1 -- 10.20.193.28:0/1977922826 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618ad037840 con 0x5618ad142630 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.468+0000 7f84aa7fc640 1 --2- 10.20.193.28:0/1977922826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13e8a0 0x5618ad14a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.468+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/1977922826 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad142a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f849c007550 tx=0x7f849c00c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8466cacf5f80e030 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.468+0000 7f847b7fe640 1 -- 10.20.193.28:0/1977922826 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0042c0 con 0x5618ad142630 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.468+0000 7f847b7fe640 1 -- 10.20.193.28:0/1977922826 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f849c033050 con 0x5618ad142630 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.468+0000 7f847b7fe640 1 -- 10.20.193.28:0/1977922826 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0076a0 con 0x5618ad142630 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.468+0000 7f848bfff640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f847c0b0e20 0x7f847c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.468+0000 7f84b3c87e00 1 -- 10.20.193.28:0/1977922826 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 msgr2=0x5618ad142a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.468+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/1977922826 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad142a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f849c007550 tx=0x7f849c00c000 comp rx=0 tx=0).stop 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f84b3c87e00 1 -- 10.20.193.28:0/1977922826 shutdown_connections 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/1977922826 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13e8a0 0x5618ad14a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/1977922826 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13dee0 0x5618ad13e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/1977922826 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad142a10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f84b3c87e00 1 -- 10.20.193.28:0/1977922826 >> 10.20.193.28:0/1977922826 conn(0x5618ad136aa0 msgr2=0x5618ad13c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f84aaffd640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f847c0b0e20 0x7f847c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f84b3c87e00 1 -- 10.20.193.28:0/1977922826 shutdown_connections 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f848bfff640 1 -- 10.20.193.28:0/2824173607 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f84a00e0ec0 con 0x7f84ac104da0 2026-02-20T03:24:00.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f84b3c87e00 1 -- 10.20.193.28:0/1977922826 wait complete. 2026-02-20T03:24:00.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.469+0000 7f84aaffd640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f847c0b0e20 0x7f847c0b32e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f84a000c770 tx=0x7f84a001a660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.470+0000 7f84b3c87e00 1 -- start start 2026-02-20T03:24:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.470+0000 7f84b3c87e00 1 Processor -- start 2026-02-20T03:24:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad158250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13e8a0 0x5618ad158790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad156990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5618ad0381a0 con 0x5618ad13dee0 2026-02-20T03:24:00.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5618ad14aba0 con 0x5618ad13e8a0 2026-02-20T03:24:00.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5618ad157110 con 0x5618ad142630 2026-02-20T03:24:00.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84aa7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13e8a0 0x5618ad158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84aa7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13e8a0 0x5618ad158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53658/0 (socket says 10.20.193.28:53658) 2026-02-20T03:24:00.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84aa7fc640 1 -- 10.20.193.28:0/3566084344 learned_addr learned my addr 10.20.193.28:0/3566084344 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84ab7fe640 1 -- 10.20.193.28:0/3566084344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13e8a0 msgr2=0x5618ad158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13e8a0 0x5618ad158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84ab7fe640 1 -- 10.20.193.28:0/3566084344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 msgr2=0x5618ad158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.471+0000 7f84ab7fe640 1 -- 10.20.193.28:0/3566084344 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618ad150360 con 0x5618ad142630 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.472+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad156990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f849c009850 tx=0x7f849c0045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d3221c677fd86e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.472+0000 7f8478ff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.472+0000 7f8478ff9640 1 -- 10.20.193.28:0/3566084344 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0092d0 con 0x5618ad142630 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.472+0000 7f8478ff9640 1 -- 10.20.193.28:0/3566084344 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f849c0076a0 con 0x5618ad142630 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.472+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3566084344 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618ace5fb60 con 0x5618ad142630 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.472+0000 7f8478ff9640 1 -- 10.20.193.28:0/3566084344 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0426c0 con 0x5618ad142630 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.472+0000 7f8478ff9640 1 -- 10.20.193.28:0/3566084344 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f849c042860 con 0x5618ad142630 2026-02-20T03:24:00.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.472+0000 7f84b3c87e00 10 client.27034 _ll_register_callbacks cb 0x5618ad03c0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.472+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3566084344 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5618ad0987f0 con 0x5618ad142630 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f8478ff9640 1 -- 10.20.193.28:0/3566084344 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f849c007850 con 0x5618ad142630 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f84b3c87e00 10 client.27034 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3566084344 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5618ad05d430 con 0x5618ad142630 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f8478ff9640 1 -- 10.20.193.28:0/3566084344 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f849c04b070 con 0x5618ad142630 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f84b3c87e00 10 client.27034 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f84b3c87e00 10 client.27034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f84b3c87e00 20 client.27034 populate_metadata read hostname 'trial028' 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5618ad1664b0 0x5618ad1688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f84b3c87e00 4 client.27034 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3566084344 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618ad012c00 con 0x5618ad1664b0 2026-02-20T03:24:00.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.473+0000 7f84aa7fc640 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5618ad1664b0 0x5618ad1688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.474+0000 7f84aa7fc640 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5618ad1664b0 0x5618ad1688a0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2e1462c7c09d30a server_cookie=f050d2a153294fd3 in_seq=0 out_seq=0 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.474+0000 7f8478ff9640 10 client.27034 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f8478ff9640 1 -- 10.20.193.28:0/3566084344 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5618ad012c00 con 0x5618ad1664b0 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f8478ff9640 10 client.27034 handle_command_reply: tid=0 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 client.27034 shutdown 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3566084344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 msgr2=0x5618ad156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad156990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f849c009850 tx=0x7f849c0045f0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3566084344 shutdown_connections 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5618ad1664b0 0x5618ad1688a0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad142630 0x5618ad156990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad13e8a0 0x5618ad158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3566084344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3566084344 >> 10.20.193.28:0/3566084344 conn(0x5618ad136aa0 msgr2=0x5618ad139db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f8478ff9640 0 client.27034 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:00.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3566084344 shutdown_connections 2026-02-20T03:24:00.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3566084344 wait complete. 2026-02-20T03:24:00.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.475+0000 7f84b3c87e00 20 client.27034 trim_cache size 0 max 16384 2026-02-20T03:24:00.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84b3c87e00 1 Processor -- start 2026-02-20T03:24:00.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84b3c87e00 1 -- start start 2026-02-20T03:24:00.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 0x5618ad1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 0x5618ad155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8450012670 con 0x5618ad13dee0 2026-02-20T03:24:00.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f845000ff40 con 0x5618ad136aa0 2026-02-20T03:24:00.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f845000dd90 con 0x5618ad13e8a0 2026-02-20T03:24:00.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84ab7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 0x5618ad1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84aa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84aa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52528/0 (socket says 10.20.193.28:52528) 2026-02-20T03:24:00.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.484+0000 7f84aa7fc640 1 -- 10.20.193.28:0/3159438333 learned_addr learned my addr 10.20.193.28:0/3159438333 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/3159438333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 0x5618ad155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f84ab7fe640 1 -- 10.20.193.28:0/3159438333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 msgr2=0x5618ad155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/3159438333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 0x5618ad155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f84ab7fe640 1 -- 10.20.193.28:0/3159438333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 msgr2=0x5618ad1555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/3159438333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad1555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f84ab7fe640 1 -- 10.20.193.28:0/3159438333 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618ad150190 con 0x5618ad136aa0 2026-02-20T03:24:00.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/3159438333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 0x5618ad1543b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f849c02f920 tx=0x7f849c03a030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4216d82fcb3c169e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f847affd640 1 -- 10.20.193.28:0/3159438333 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c063040 con 0x5618ad136aa0 2026-02-20T03:24:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f847affd640 1 -- 10.20.193.28:0/3159438333 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5618ad0987f0 con 0x5618ad136aa0 2026-02-20T03:24:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.485+0000 7f847affd640 1 -- 10.20.193.28:0/3159438333 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0516a0 con 0x5618ad136aa0 2026-02-20T03:24:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3159438333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 msgr2=0x5618ad1543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3159438333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 0x5618ad1543b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f849c02f920 tx=0x7f849c03a030 comp rx=0 tx=0).stop 2026-02-20T03:24:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3159438333 shutdown_connections 2026-02-20T03:24:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3159438333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 0x5618ad155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3159438333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad1555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/3159438333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 0x5618ad1543b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3159438333 >> 10.20.193.28:0/3159438333 conn(0x5618ad168ba0 msgr2=0x5618ad154e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3159438333 shutdown_connections 2026-02-20T03:24:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 -- 10.20.193.28:0/3159438333 wait complete. 2026-02-20T03:24:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 -- start start 2026-02-20T03:24:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.486+0000 7f84b3c87e00 1 Processor -- start 2026-02-20T03:24:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 0x5618ad1617c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad15eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84b3c87e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 0x5618ad15efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f845000e400 con 0x5618ad13dee0 2026-02-20T03:24:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f845000f870 con 0x5618ad136aa0 2026-02-20T03:24:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84b3c87e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f845000ead0 con 0x5618ad13e8a0 2026-02-20T03:24:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84aa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad15eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84aa7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad15eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52534/0 (socket says 10.20.193.28:52534) 2026-02-20T03:24:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84aa7fc640 1 -- 10.20.193.28:0/2256131375 learned_addr learned my addr 10.20.193.28:0/2256131375 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 0x5618ad1617c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 0x5618ad15efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84aa7fc640 1 -- 10.20.193.28:0/2256131375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 msgr2=0x5618ad15efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84aa7fc640 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 0x5618ad15efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84aa7fc640 1 -- 10.20.193.28:0/2256131375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 msgr2=0x5618ad1617c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:00.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84aa7fc640 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 0x5618ad1617c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.487+0000 7f84aa7fc640 1 -- 10.20.193.28:0/2256131375 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618acd6f900 con 0x5618ad13dee0 2026-02-20T03:24:00.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f84aa7fc640 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad15eaa0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8494009dd0 tx=0x7f8494004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5364eb3cbf8d92c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:00.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f8478ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:00.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f8478ff9640 1 -- 10.20.193.28:0/2256131375 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8494029070 con 0x5618ad13dee0 2026-02-20T03:24:00.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f8478ff9640 1 -- 10.20.193.28:0/2256131375 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8494003f20 con 0x5618ad13dee0 2026-02-20T03:24:00.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f8478ff9640 1 -- 10.20.193.28:0/2256131375 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84940247d0 con 0x5618ad13dee0 2026-02-20T03:24:00.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f84b3c87e00 1 -- 10.20.193.28:0/2256131375 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618ad04b4d0 con 0x5618ad13dee0 2026-02-20T03:24:00.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f84b3c87e00 10 client.17880 _ll_register_callbacks cb 0x7f849c004360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:00.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f84b3c87e00 1 -- 10.20.193.28:0/2256131375 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f849c033050 con 0x5618ad13dee0 2026-02-20T03:24:00.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f8478ff9640 1 -- 10.20.193.28:0/2256131375 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8494010a80 con 0x5618ad13dee0 2026-02-20T03:24:00.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f8478ff9640 1 -- 10.20.193.28:0/2256131375 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8494010430 con 0x5618ad13dee0 2026-02-20T03:24:00.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f84b3c87e00 10 client.17880 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:00.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.488+0000 7f84b3c87e00 1 -- 10.20.193.28:0/2256131375 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5618ad150e80 con 0x5618ad13dee0 2026-02-20T03:24:00.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.489+0000 7f8478ff9640 1 -- 10.20.193.28:0/2256131375 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f84940105d0 con 0x5618ad13dee0 2026-02-20T03:24:00.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.489+0000 7f84b3c87e00 10 client.17880 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:00.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.489+0000 7f84b3c87e00 10 client.17880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:00.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.489+0000 7f84b3c87e00 20 client.17880 populate_metadata read hostname 'trial028' 2026-02-20T03:24:00.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.489+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5618ad142630 0x5618ad1d5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:00.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.489+0000 7f84b3c87e00 4 client.17880 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:24:00.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.489+0000 7f84b3c87e00 1 -- 10.20.193.28:0/2256131375 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5618ace00a20 con 0x5618ad142630 2026-02-20T03:24:00.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.489+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5618ad142630 0x5618ad1d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:00.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.490+0000 7f84ab7fe640 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5618ad142630 0x5618ad1d5460 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ed479f783d74618 server_cookie=ed013997a2d6f189 in_seq=0 out_seq=0 2026-02-20T03:24:00.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.490+0000 7f8478ff9640 10 client.17880 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:00.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.490+0000 7f8478ff9640 1 -- 10.20.193.28:0/2256131375 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5618ace00a20 con 0x5618ad142630 2026-02-20T03:24:00.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.490+0000 7f8478ff9640 10 client.17880 handle_command_reply: tid=0 2026-02-20T03:24:00.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.490+0000 7f84b3c87e00 1 client.17880 shutdown 2026-02-20T03:24:00.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 -- 10.20.193.28:0/2256131375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 msgr2=0x5618ad15eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad15eaa0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8494009dd0 tx=0x7f8494004500 comp rx=0 tx=0).stop 2026-02-20T03:24:00.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 -- 10.20.193.28:0/2256131375 shutdown_connections 2026-02-20T03:24:00.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5618ad142630 0x5618ad1d5460 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5618ad13e8a0 0x5618ad15efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5618ad13dee0 0x5618ad15eaa0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 --2- 10.20.193.28:0/2256131375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5618ad136aa0 0x5618ad1617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 -- 10.20.193.28:0/2256131375 >> 10.20.193.28:0/2256131375 conn(0x5618ad168ba0 msgr2=0x5618ad1556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f8478ff9640 0 client.17880 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:00.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 -- 10.20.193.28:0/2256131375 shutdown_connections 2026-02-20T03:24:00.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 1 -- 10.20.193.28:0/2256131375 wait complete. 2026-02-20T03:24:00.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b3c87e00 20 client.17880 trim_cache size 0 max 16384 2026-02-20T03:24:00.502 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:24:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:24:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "d3232473-d56a-43fe-af4f-bd25cbd31d36", 2026-02-20T03:24:00.503 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:24:00.503 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:24:00.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b1782640 1 -- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f847c0b0e20 msgr2=0x7f847c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b1782640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f847c0b0e20 0x7f847c0b32e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f84a000c770 tx=0x7f84a001a660 comp rx=0 tx=0).stop 2026-02-20T03:24:00.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b1782640 1 -- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84ac104da0 msgr2=0x7f84ac077600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:00.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.491+0000 7f84b1782640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84ac104da0 0x7f84ac077600 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f84a000ea20 tx=0x7f84a000eef0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.492+0000 7f84b1782640 1 -- 10.20.193.28:0/2824173607 shutdown_connections 2026-02-20T03:24:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.492+0000 7f84b1782640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f847c0b0e20 0x7f847c0b32e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.492+0000 7f84b1782640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84ac109ed0 0x7f84ac078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.492+0000 7f84b1782640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84ac105750 0x7f84ac077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.492+0000 7f84b1782640 1 --2- 10.20.193.28:0/2824173607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84ac104da0 0x7f84ac077600 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.492+0000 7f84b1782640 1 -- 10.20.193.28:0/2824173607 >> 10.20.193.28:0/2824173607 conn(0x7f84ac100840 msgr2=0x7f84ac101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.492+0000 7f84b1782640 1 -- 10.20.193.28:0/2824173607 shutdown_connections 2026-02-20T03:24:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:00.492+0000 7f84b1782640 1 -- 10.20.193.28:0/2824173607 wait complete. 2026-02-20T03:24:00.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 7.88 MB/sec execute 333 sec latency 26239.222 ms 2026-02-20T03:24:00.594 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:24:00.846 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:24:00 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:24:00.505+0000 7ff740af4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000029 [...2,head] /volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX/ auth{1=1,2=1} v118540 ap=3 f(v4597 m2026-02-20T03:23:31.876234+0000 24=24+0) n(v36 rc2026-02-20T03:23:31.876234+0000 b5230239 25=24+1) (inest sync->mix g=1,2) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:481 nref=3)) caps={25141=pAsLsXsFs/pAsLsXsFsx@15565} mcw={1=AsLsXsFs} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557551c2bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000029:[<0x100000005e6/PARADOX v2552>,<0x100000005e5/~dmtmp v34>,<0x100000005e4/client0 v18>,<0x100000005e3/clients v8>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v28>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v37>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000029:[<0x100000005e6/PARADOX v118540>,<0x100000005e5/~dmtmp v37204>,<0x100000005e4/client0 v763>,<0x100000005e3/clients v713>,<0x100000005e2/tmp v707>,<0x100000001fb/client.0 v710>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v723>,<0x10000000001/sv_1 v733>,<0x10000000000/qa v704>,<0x1/volumes v675>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2026-02-20T03:23:31.868234+0000 25=25+0)","ondisk_value.rstat":"n(v0 rc2026-02-20T03:23:31.876234+0000 b5230239 25=24+1)","memory_value.dirstat":"f(v4597 m2026-02-20T03:23:31.876234+0000 24=24+0)","memory_value.rstat":"n(v36 rc2026-02-20T03:23:31.876234+0000 b5230239 25=24+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2026-02-20T03:24:00.865 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:00.999 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:24:01.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.035+0000 7fafe1f12640 1 -- 10.20.193.28:0/794569343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 msgr2=0x7fafdc104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.035+0000 7fafe1f12640 1 --2- 10.20.193.28:0/794569343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 0x7fafdc104de0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fafc4009990 tx=0x7fafc402f170 comp rx=0 tx=0).stop 2026-02-20T03:24:01.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.035+0000 7fafe1f12640 1 -- 10.20.193.28:0/794569343 shutdown_connections 2026-02-20T03:24:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.035+0000 7fafe1f12640 1 --2- 10.20.193.28:0/794569343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafdc105320 0x7fafdc111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.035+0000 7fafe1f12640 1 --2- 10.20.193.28:0/794569343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 0x7fafdc104de0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.035+0000 7fafe1f12640 1 --2- 10.20.193.28:0/794569343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafdc10a980 0x7fafdc10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.035+0000 7fafe1f12640 1 -- 10.20.193.28:0/794569343 >> 10.20.193.28:0/794569343 conn(0x7fafdc100680 msgr2=0x7fafdc102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.036+0000 7fafe1f12640 1 -- 10.20.193.28:0/794569343 shutdown_connections 2026-02-20T03:24:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.036+0000 7fafe1f12640 1 -- 10.20.193.28:0/794569343 wait complete. 2026-02-20T03:24:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.036+0000 7fafe1f12640 1 Processor -- start 2026-02-20T03:24:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.036+0000 7fafe1f12640 1 -- start start 2026-02-20T03:24:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.036+0000 7fafe1f12640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 0x7fafdc19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.036+0000 7fafe1f12640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafdc105320 0x7fafdc19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe1f12640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafdc10a980 0x7fafdc1a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe1f12640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc114bf0 con 0x7fafdc104980 2026-02-20T03:24:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe1f12640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc114a70 con 0x7fafdc10a980 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe1f12640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafdc114d70 con 0x7fafdc105320 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe0f10640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 0x7fafdc19d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe0f10640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 0x7fafdc19d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52540/0 (socket says 10.20.193.28:52540) 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe0f10640 1 -- 10.20.193.28:0/3167194667 learned_addr learned my addr 10.20.193.28:0/3167194667 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafd3fff640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafdc105320 0x7fafdc19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe1711640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafdc10a980 0x7fafdc1a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe0f10640 1 -- 10.20.193.28:0/3167194667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafdc105320 msgr2=0x7fafdc19d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe0f10640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafdc105320 0x7fafdc19d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe0f10640 1 -- 10.20.193.28:0/3167194667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafdc10a980 msgr2=0x7fafdc1a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe0f10640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafdc10a980 0x7fafdc1a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe0f10640 1 -- 10.20.193.28:0/3167194667 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafdc1a2120 con 0x7fafdc104980 2026-02-20T03:24:01.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe0f10640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 0x7fafdc19d0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00ea10 tx=0x7fafcc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:01.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafd1ffb640 1 -- 10.20.193.28:0/3167194667 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00ce50 con 0x7fafdc104980 2026-02-20T03:24:01.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafd1ffb640 1 -- 10.20.193.28:0/3167194667 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafcc004570 con 0x7fafdc104980 2026-02-20T03:24:01.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafe1f12640 1 -- 10.20.193.28:0/3167194667 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafdc1a2410 con 0x7fafdc104980 2026-02-20T03:24:01.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.037+0000 7fafd1ffb640 1 -- 10.20.193.28:0/3167194667 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc010670 con 0x7fafdc104980 2026-02-20T03:24:01.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.038+0000 7fafe1f12640 1 -- 10.20.193.28:0/3167194667 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafdc1a9c50 con 0x7fafdc104980 2026-02-20T03:24:01.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.040+0000 7fafd1ffb640 1 -- 10.20.193.28:0/3167194667 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fafcc0040d0 con 0x7fafdc104980 2026-02-20T03:24:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe56a0e00 1 Processor -- start 2026-02-20T03:24:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe56a0e00 1 -- start start 2026-02-20T03:24:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7affb0 0x5593cb7bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5593cb72fe50 con 0x5593cb7b5000 2026-02-20T03:24:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5593cb7029c0 con 0x5593cb7af630 2026-02-20T03:24:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5593cb6b0240 con 0x5593cb7affb0 2026-02-20T03:24:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe1711640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe0f10640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe1711640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52554/0 (socket says 10.20.193.28:52554) 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.041+0000 7fafe1711640 1 -- 10.20.193.28:0/1446625142 learned_addr learned my addr 10.20.193.28:0/1446625142 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafe1711640 1 -- 10.20.193.28:0/1446625142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7affb0 msgr2=0x5593cb7bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafe1711640 1 --2- 10.20.193.28:0/1446625142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7affb0 0x5593cb7bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafe1711640 1 -- 10.20.193.28:0/1446625142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 msgr2=0x5593cb7afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafe1711640 1 --2- 10.20.193.28:0/1446625142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafe1711640 1 -- 10.20.193.28:0/1446625142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593cb6c3420 con 0x5593cb7b5000 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafe0f10640 1 --2- 10.20.193.28:0/1446625142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafd1ffb640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fafb80b0fc0 0x7fafb80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafe1711640 1 --2- 10.20.193.28:0/1446625142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7b53e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fafd8002e50 tx=0x7fafd8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2372d0c2000445bd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafd1ffb640 1 -- 10.20.193.28:0/3167194667 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fafcc0e0fe0 con 0x7fafdc104980 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafe0f10640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fafb80b0fc0 0x7fafb80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafa94e4640 1 -- 10.20.193.28:0/1446625142 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd801b070 con 0x5593cb7b5000 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafa94e4640 1 -- 10.20.193.28:0/1446625142 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafd80079a0 con 0x5593cb7b5000 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.042+0000 7fafa94e4640 1 -- 10.20.193.28:0/1446625142 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd801b070 con 0x5593cb7b5000 2026-02-20T03:24:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe56a0e00 1 -- 10.20.193.28:0/1446625142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 msgr2=0x5593cb7b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/1446625142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7b53e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fafd8002e50 tx=0x7fafd8009920 comp rx=0 tx=0).stop 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe0f10640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fafb80b0fc0 0x7fafb80b3480 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0a89c0 tx=0x7fafcc002d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe56a0e00 1 -- 10.20.193.28:0/1446625142 shutdown_connections 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/1446625142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7affb0 0x5593cb7bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/1446625142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/1446625142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7b53e0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe56a0e00 1 -- 10.20.193.28:0/1446625142 >> 10.20.193.28:0/1446625142 conn(0x5593cb772290 msgr2=0x5593cb7add30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe56a0e00 1 -- 10.20.193.28:0/1446625142 shutdown_connections 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.043+0000 7fafe56a0e00 1 -- 10.20.193.28:0/1446625142 wait complete. 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.044+0000 7fafe56a0e00 1 -- start start 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.044+0000 7fafe56a0e00 1 Processor -- start 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7af630 0x5593cb7c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7ca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 0x5593cb7c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5593cb6fe8f0 con 0x5593cb7af630 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5593cb4f0f50 con 0x5593cb7affb0 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5593cb7c8d30 con 0x5593cb7b5000 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe1711640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7af630 0x5593cb7c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafd3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafd3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53710/0 (socket says 10.20.193.28:53710) 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafd3fff640 1 -- 10.20.193.28:0/4161546688 learned_addr learned my addr 10.20.193.28:0/4161546688 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe1711640 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 0x5593cb7c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe1711640 1 -- 10.20.193.28:0/4161546688 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 msgr2=0x5593cb7c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe1711640 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 0x5593cb7c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe1711640 1 -- 10.20.193.28:0/4161546688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 msgr2=0x5593cb7ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe1711640 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe1711640 1 -- 10.20.193.28:0/4161546688 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593cb7c1b20 con 0x5593cb7af630 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafd3fff640 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7fafe1711640 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7af630 0x5593cb7c9f40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fafd8002c60 tx=0x7fafd8012650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8ded58757c4cab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.045+0000 7faf9a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7faf9a7fc640 1 -- 10.20.193.28:0/4161546688 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd801b070 con 0x5593cb7af630 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4161546688 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593cb4d3b40 con 0x5593cb7af630 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 10 client.17892 _ll_register_callbacks cb 0x5593cb73bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4161546688 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5593cb7101a0 con 0x5593cb7af630 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7faf9a7fc640 1 -- 10.20.193.28:0/4161546688 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5593cb7101a0 con 0x5593cb7af630 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7faf9a7fc640 1 -- 10.20.193.28:0/4161546688 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd802e6b0 con 0x5593cb7af630 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7faf9a7fc640 1 -- 10.20.193.28:0/4161546688 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fafd802e850 con 0x5593cb7af630 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7faf9a7fc640 1 -- 10.20.193.28:0/4161546688 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fafd802eb50 con 0x5593cb7af630 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 10 client.17892 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4161546688 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5593cb6bd230 con 0x5593cb7af630 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7faf9a7fc640 1 -- 10.20.193.28:0/4161546688 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fafd80126f0 con 0x5593cb7af630 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 10 client.17892 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 10 client.17892 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 20 client.17892 populate_metadata read hostname 'trial028' 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5593cb7d85d0 0x5593cb7da9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 4 client.17892 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.046+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4161546688 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593cb70a5b0 con 0x5593cb7d85d0 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.047+0000 7fafd3fff640 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5593cb7d85d0 0x5593cb7da9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.047+0000 7fafd3fff640 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5593cb7d85d0 0x5593cb7da9c0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d09b14d4287fe7bf server_cookie=f420318f8aae8e87 in_seq=0 out_seq=0 2026-02-20T03:24:01.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.047+0000 7faf9a7fc640 10 client.17892 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:01.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.047+0000 7faf9a7fc640 1 -- 10.20.193.28:0/4161546688 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5593cb70a5b0 con 0x5593cb7d85d0 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.048+0000 7faf9a7fc640 10 client.17892 handle_command_reply: tid=0 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.048+0000 7fafe56a0e00 1 client.17892 shutdown 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.048+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4161546688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7af630 msgr2=0x5593cb7c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.048+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7af630 0x5593cb7c9f40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fafd8002c60 tx=0x7fafd8012650 comp rx=0 tx=0).stop 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.048+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4161546688 shutdown_connections 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.048+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5593cb7d85d0 0x5593cb7da9c0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.049+0000 7faf9a7fc640 0 client.17892 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.048+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 0x5593cb7c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.049+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.049+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4161546688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7af630 0x5593cb7c9f40 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.049+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4161546688 >> 10.20.193.28:0/4161546688 conn(0x5593cb772290 msgr2=0x5593cb7ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.049+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4161546688 shutdown_connections 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.049+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4161546688 wait complete. 2026-02-20T03:24:01.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.049+0000 7fafe56a0e00 20 client.17892 trim_cache size 0 max 16384 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe56a0e00 1 Processor -- start 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe56a0e00 1 -- start start 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7af630 0x5593cb7a7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7c7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf80012770 con 0x5593cb7b5000 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faf80010040 con 0x5593cb7affb0 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf8000de90 con 0x5593cb7af630 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafd3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafd3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53726/0 (socket says 10.20.193.28:53726) 2026-02-20T03:24:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafd3fff640 1 -- 10.20.193.28:0/4184693046 learned_addr learned my addr 10.20.193.28:0/4184693046 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe1711640 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7af630 0x5593cb7a7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.058+0000 7fafe1711640 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafd3fff640 1 -- 10.20.193.28:0/4184693046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7af630 msgr2=0x5593cb7a7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafd3fff640 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7af630 0x5593cb7a7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafd3fff640 1 -- 10.20.193.28:0/4184693046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 msgr2=0x5593cb7c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafd3fff640 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7c5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafd3fff640 1 -- 10.20.193.28:0/4184693046 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593cb7c1950 con 0x5593cb7affb0 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafe1711640 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7af630 0x5593cb7a7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafd3fff640 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7c7600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5593cb7c0840 tx=0x7fafc4009270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afac2be5623de23a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafa8ce3640 1 -- 10.20.193.28:0/4184693046 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40042c0 con 0x5593cb7affb0 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafa8ce3640 1 -- 10.20.193.28:0/4184693046 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafc4044e50 con 0x5593cb7affb0 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.059+0000 7fafa8ce3640 1 -- 10.20.193.28:0/4184693046 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc40026e0 con 0x5593cb7affb0 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.060+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4184693046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 msgr2=0x5593cb7c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.060+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7c7600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x5593cb7c0840 tx=0x7fafc4009270 comp rx=0 tx=0).stop 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.060+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4184693046 shutdown_connections 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.060+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7b5000 0x5593cb7c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.060+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7affb0 0x5593cb7c7600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.060+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/4184693046 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7af630 0x5593cb7a7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.060+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4184693046 >> 10.20.193.28:0/4184693046 conn(0x5593cb772290 msgr2=0x5593cb7c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.060+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4184693046 shutdown_connections 2026-02-20T03:24:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.060+0000 7fafe56a0e00 1 -- 10.20.193.28:0/4184693046 wait complete. 2026-02-20T03:24:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe56a0e00 1 -- start start 2026-02-20T03:24:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe56a0e00 1 Processor -- start 2026-02-20T03:24:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7affb0 0x5593cb7ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe56a0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 0x5593cb842280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf8000e500 con 0x5593cb7affb0 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faf8000f970 con 0x5593cb7af630 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe56a0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf8000ebd0 con 0x5593cb7b5000 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe1711640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe1711640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7cc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53738/0 (socket says 10.20.193.28:53738) 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe1711640 1 -- 10.20.193.28:0/93048407 learned_addr learned my addr 10.20.193.28:0/93048407 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafd3fff640 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7affb0 0x5593cb7ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.061+0000 7fafe1711640 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 0x5593cb842280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafe1711640 1 -- 10.20.193.28:0/93048407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 msgr2=0x5593cb842280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafe1711640 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 0x5593cb842280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafe1711640 1 -- 10.20.193.28:0/93048407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7affb0 msgr2=0x5593cb7ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafe1711640 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7affb0 0x5593cb7ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafe1711640 1 -- 10.20.193.28:0/93048407 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593cb3e1870 con 0x5593cb7af630 2026-02-20T03:24:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafd3fff640 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7affb0 0x5593cb7ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafe1711640 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7cc570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fafd802eb20 tx=0x7fafd8002a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b3f97dc8b201c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7faf9a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7faf9a7fc640 1 -- 10.20.193.28:0/93048407 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd801b070 con 0x5593cb7af630 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafe56a0e00 1 -- 10.20.193.28:0/93048407 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593cb6a2440 con 0x5593cb7af630 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafe56a0e00 10 client.27038 _ll_register_callbacks cb 0x7fafd8019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7fafe56a0e00 1 -- 10.20.193.28:0/93048407 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafc4044e50 con 0x5593cb7af630 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7faf9a7fc640 1 -- 10.20.193.28:0/93048407 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafd8036030 con 0x5593cb7af630 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.062+0000 7faf9a7fc640 1 -- 10.20.193.28:0/93048407 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd8015440 con 0x5593cb7af630 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7faf9a7fc640 1 -- 10.20.193.28:0/93048407 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fafd80155e0 con 0x5593cb7af630 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7faf9a7fc640 1 -- 10.20.193.28:0/93048407 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fafd8045060 con 0x5593cb7af630 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7fafe56a0e00 10 client.27038 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7fafe56a0e00 1 -- 10.20.193.28:0/93048407 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5593cb7c2640 con 0x5593cb7af630 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7faf9a7fc640 1 -- 10.20.193.28:0/93048407 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fafd8048050 con 0x5593cb7af630 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7fafe56a0e00 10 client.27038 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7fafe56a0e00 10 client.27038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7fafe56a0e00 20 client.27038 populate_metadata read hostname 'trial028' 2026-02-20T03:24:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5593cb7d85d0 0x5593cb845b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7fafe56a0e00 4 client.27038 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:24:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7fafe56a0e00 1 -- 10.20.193.28:0/93048407 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5593cb70a5b0 con 0x5593cb7d85d0 2026-02-20T03:24:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.063+0000 7fafd3fff640 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5593cb7d85d0 0x5593cb845b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafd3fff640 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5593cb7d85d0 0x5593cb845b10 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d7375a5d8aac42 server_cookie=1a93982d3589a291 in_seq=0 out_seq=0 2026-02-20T03:24:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7faf9a7fc640 10 client.27038 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7faf9a7fc640 1 -- 10.20.193.28:0/93048407 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5593cb70a5b0 con 0x5593cb7d85d0 2026-02-20T03:24:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7faf9a7fc640 10 client.27038 handle_command_reply: tid=0 2026-02-20T03:24:01.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 client.27038 shutdown 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 -- 10.20.193.28:0/93048407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 msgr2=0x5593cb7cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7cc570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fafd802eb20 tx=0x7fafd8002a60 comp rx=0 tx=0).stop 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 -- 10.20.193.28:0/93048407 shutdown_connections 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5593cb7d85d0 0x5593cb845b10 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5593cb7b5000 0x5593cb842280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5593cb7affb0 0x5593cb7ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 --2- 10.20.193.28:0/93048407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5593cb7af630 0x5593cb7cc570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 -- 10.20.193.28:0/93048407 >> 10.20.193.28:0/93048407 conn(0x5593cb772290 msgr2=0x5593cb7c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7faf9a7fc640 0 client.27038 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:01.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 -- 10.20.193.28:0/93048407 shutdown_connections 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.064+0000 7fafe56a0e00 1 -- 10.20.193.28:0/93048407 wait complete. 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe56a0e00 20 client.27038 trim_cache size 0 max 16384 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout: "d3232473-d56a-43fe-af4f-bd25cbd31d36": { 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "d3232473-d56a-43fe-af4f-bd25cbd31d36", 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:01.071 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 -- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fafb80b0fc0 msgr2=0x7fafb80b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fafb80b0fc0 0x7fafb80b3480 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fafcc0a89c0 tx=0x7fafcc002d00 comp rx=0 tx=0).stop 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 -- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 msgr2=0x7fafdc19d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 0x7fafdc19d0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00ea10 tx=0x7fafcc00eee0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 -- 10.20.193.28:0/3167194667 shutdown_connections 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fafb80b0fc0 0x7fafb80b3480 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafdc10a980 0x7fafdc1a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafdc105320 0x7fafdc19d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 --2- 10.20.193.28:0/3167194667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafdc104980 0x7fafdc19d0d0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 -- 10.20.193.28:0/3167194667 >> 10.20.193.28:0/3167194667 conn(0x7fafdc100680 msgr2=0x7fafdc100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:01.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 -- 10.20.193.28:0/3167194667 shutdown_connections 2026-02-20T03:24:01.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.065+0000 7fafe1f12640 1 -- 10.20.193.28:0/3167194667 wait complete. 2026-02-20T03:24:01.169 INFO:tasks.cephfs.filesystem:scrub status for tag:d3232473-d56a-43fe-af4f-bd25cbd31d36 - {'path': '/', 'tag': 'd3232473-d56a-43fe-af4f-bd25cbd31d36', 'options': 'recursive,force'} 2026-02-20T03:24:01.271 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:01.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 -- 10.20.193.28:0/4068737531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 msgr2=0x7f328c109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 --2- 10.20.193.28:0/4068737531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 0x7f328c109660 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f327c009a30 tx=0x7f327c02f260 comp rx=0 tx=0).stop 2026-02-20T03:24:01.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 -- 10.20.193.28:0/4068737531 shutdown_connections 2026-02-20T03:24:01.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 --2- 10.20.193.28:0/4068737531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f328c109ba0 0x7f328c115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 --2- 10.20.193.28:0/4068737531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 0x7f328c109660 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 --2- 10.20.193.28:0/4068737531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f328c10eef0 0x7f328c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 -- 10.20.193.28:0/4068737531 >> 10.20.193.28:0/4068737531 conn(0x7f328c078600 msgr2=0x7f328c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:01.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 -- 10.20.193.28:0/4068737531 shutdown_connections 2026-02-20T03:24:01.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 -- 10.20.193.28:0/4068737531 wait complete. 2026-02-20T03:24:01.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.450+0000 7f3291727640 1 Processor -- start 2026-02-20T03:24:01.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f3291727640 1 -- start start 2026-02-20T03:24:01.455 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:01 trial028 ceph-mon[38552]: pgmap v461: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 675 KiB/s wr, 37 op/s 2026-02-20T03:24:01.455 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:01 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:24:01.455 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:01 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:01.455 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:01 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:24:01.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f3291727640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 0x7f328c1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f3291727640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f328c109ba0 0x7f328c1a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f3291727640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f328c10eef0 0x7f328c1a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f3291727640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f328c119090 con 0x7f328c109220 2026-02-20T03:24:01.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f3291727640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f328c118f10 con 0x7f328c10eef0 2026-02-20T03:24:01.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f3291727640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f328c119210 con 0x7f328c109ba0 2026-02-20T03:24:01.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 0x7f328c1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 0x7f328c1a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52596/0 (socket says 10.20.193.28:52596) 2026-02-20T03:24:01.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328bfff640 1 -- 10.20.193.28:0/3707889191 learned_addr learned my addr 10.20.193.28:0/3707889191 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:01.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f3290f26640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f328c10eef0 0x7f328c1a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328b7fe640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f328c109ba0 0x7f328c1a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328bfff640 1 -- 10.20.193.28:0/3707889191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f328c109ba0 msgr2=0x7f328c1a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328bfff640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f328c109ba0 0x7f328c1a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328bfff640 1 -- 10.20.193.28:0/3707889191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f328c10eef0 msgr2=0x7f328c1a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328bfff640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f328c10eef0 0x7f328c1a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328bfff640 1 -- 10.20.193.28:0/3707889191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328c1a6570 con 0x7f328c109220 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f3290f26640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f328c10eef0 0x7f328c1a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.451+0000 7f328bfff640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 0x7f328c1a1520 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f327800ea30 tx=0x7f327800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.452+0000 7f32897fa640 1 -- 10.20.193.28:0/3707889191 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327800ce50 con 0x7f328c109220 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.452+0000 7f32897fa640 1 -- 10.20.193.28:0/3707889191 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3278004570 con 0x7f328c109220 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.452+0000 7f32897fa640 1 -- 10.20.193.28:0/3707889191 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278010690 con 0x7f328c109220 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.452+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328c1a6860 con 0x7f328c109220 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.452+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328c1ae0a0 con 0x7f328c109220 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.452+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328c10a580 con 0x7f328c109220 2026-02-20T03:24:01.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.454+0000 7f32897fa640 1 -- 10.20.193.28:0/3707889191 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f32780040d0 con 0x7f328c109220 2026-02-20T03:24:01.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.456+0000 7f32897fa640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32600b0e20 0x7f32600b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:01.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.456+0000 7f32897fa640 1 -- 10.20.193.28:0/3707889191 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f32780e10c0 con 0x7f328c109220 2026-02-20T03:24:01.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.456+0000 7f328b7fe640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32600b0e20 0x7f32600b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:01.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.456+0000 7f32897fa640 1 -- 10.20.193.28:0/3707889191 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f32780e1540 con 0x7f328c109220 2026-02-20T03:24:01.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.457+0000 7f328b7fe640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32600b0e20 0x7f32600b32e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f328c10e5f0 tx=0x7f327c03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:01.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 784925 7.85 MB/sec execute 334 sec latency 27239.269 ms 2026-02-20T03:24:01.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.563+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f328c109660 con 0x7f328c109220 2026-02-20T03:24:01.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.564+0000 7f32897fa640 1 -- 10.20.193.28:0/3707889191 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f328c109660 con 0x7f328c109220 2026-02-20T03:24:01.568 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:24:01.568 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:24:01.569 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:24:01.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32600b0e20 msgr2=0x7f32600b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32600b0e20 0x7f32600b32e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f328c10e5f0 tx=0x7f327c03a040 comp rx=0 tx=0).stop 2026-02-20T03:24:01.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 msgr2=0x7f328c1a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:01.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 0x7f328c1a1520 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f327800ea30 tx=0x7f327800ef00 comp rx=0 tx=0).stop 2026-02-20T03:24:01.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 shutdown_connections 2026-02-20T03:24:01.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32600b0e20 0x7f32600b32e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f328c10eef0 0x7f328c1a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f328c109ba0 0x7f328c1a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 --2- 10.20.193.28:0/3707889191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f328c109220 0x7f328c1a1520 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:01.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 >> 10.20.193.28:0/3707889191 conn(0x7f328c078600 msgr2=0x7f328c079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:01.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 shutdown_connections 2026-02-20T03:24:01.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:01.565+0000 7f3291727640 1 -- 10.20.193.28:0/3707889191 wait complete. 2026-02-20T03:24:01.668 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id f09dd84 --release --await' 2026-02-20T03:24:01.668 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id f09dd84 --release --await 2026-02-20T03:24:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:01 trial177 ceph-mon[43181]: pgmap v461: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 675 KiB/s wr, 37 op/s 2026-02-20T03:24:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:01 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:24:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:01 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:01 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:24:01.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:01 trial126 ceph-mon[38476]: pgmap v461: 129 pgs: 129 active+clean; 129 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 31 KiB/s rd, 675 KiB/s wr, 37 op/s 2026-02-20T03:24:01.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:01 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:24:01.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:01 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:01.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:01 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:24:01.937 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.113+0000 7f11b4f8e640 1 -- 10.20.193.28:0/3036897907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0104980 msgr2=0x7f11b0104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.113+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/3036897907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0104980 0x7f11b0104de0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f11a0009a60 tx=0x7f11a002f250 comp rx=0 tx=0).stop 2026-02-20T03:24:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.113+0000 7f11b4f8e640 1 -- 10.20.193.28:0/3036897907 shutdown_connections 2026-02-20T03:24:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.113+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/3036897907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11b0105320 0x7f11b0111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.113+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/3036897907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0104980 0x7f11b0104de0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.113+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/3036897907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11b010a980 0x7f11b010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.113+0000 7f11b4f8e640 1 -- 10.20.193.28:0/3036897907 >> 10.20.193.28:0/3036897907 conn(0x7f11b0100680 msgr2=0x7f11b0102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.113+0000 7f11b4f8e640 1 -- 10.20.193.28:0/3036897907 shutdown_connections 2026-02-20T03:24:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.113+0000 7f11b4f8e640 1 -- 10.20.193.28:0/3036897907 wait complete. 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11b4f8e640 1 Processor -- start 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11b4f8e640 1 -- start start 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11b4f8e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11b0104980 0x7f11b019d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11b4f8e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0105320 0x7f11b019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11b4f8e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11b010a980 0x7f11b01a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11b4f8e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0114bf0 con 0x7f11b0105320 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11b4f8e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0114a70 con 0x7f11b010a980 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11b4f8e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11b0114d70 con 0x7f11b0104980 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11aeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0105320 0x7f11b019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.114+0000 7f11af7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11b0104980 0x7f11b019d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11aeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0105320 0x7f11b019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52610/0 (socket says 10.20.193.28:52610) 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11aeffd640 1 -- 10.20.193.28:0/1905927030 learned_addr learned my addr 10.20.193.28:0/1905927030 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11affff640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11b010a980 0x7f11b01a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11aeffd640 1 -- 10.20.193.28:0/1905927030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11b0104980 msgr2=0x7f11b019d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11aeffd640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11b0104980 0x7f11b019d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11aeffd640 1 -- 10.20.193.28:0/1905927030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11b010a980 msgr2=0x7f11b01a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11aeffd640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11b010a980 0x7f11b01a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11aeffd640 1 -- 10.20.193.28:0/1905927030 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b01a2110 con 0x7f11b0105320 2026-02-20T03:24:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11aeffd640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0105320 0x7f11b019d600 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f11a002fca0 tx=0x7f11a002fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11acff9640 1 -- 10.20.193.28:0/1905927030 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00384e0 con 0x7f11b0105320 2026-02-20T03:24:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11acff9640 1 -- 10.20.193.28:0/1905927030 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f11a0038770 con 0x7f11b0105320 2026-02-20T03:24:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11b4f8e640 1 -- 10.20.193.28:0/1905927030 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b01a23a0 con 0x7f11b0105320 2026-02-20T03:24:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11acff9640 1 -- 10.20.193.28:0/1905927030 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0042680 con 0x7f11b0105320 2026-02-20T03:24:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.115+0000 7f11b4f8e640 1 -- 10.20.193.28:0/1905927030 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b01a9c40 con 0x7f11b0105320 2026-02-20T03:24:02.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.118+0000 7f11acff9640 1 -- 10.20.193.28:0/1905927030 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f11a0038920 con 0x7f11b0105320 2026-02-20T03:24:02.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.119+0000 7f11b871ce00 1 Processor -- start 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.119+0000 7f11b871ce00 1 -- start start 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.119+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d631371b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.119+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 0x564d631383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.119+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 0x564d631432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.119+0000 7f11b871ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564d63089a20 con 0x564d63137f60 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.119+0000 7f11b871ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564d630372a0 con 0x564d63136dd0 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.119+0000 7f11b871ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564d63085950 con 0x564d631388e0 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11affff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d631371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11aeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 0x564d631432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11af7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 0x564d631383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11affff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d631371b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53792/0 (socket says 10.20.193.28:53792) 2026-02-20T03:24:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11affff640 1 -- 10.20.193.28:0/2020704270 learned_addr learned my addr 10.20.193.28:0/2020704270 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11affff640 1 -- 10.20.193.28:0/2020704270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 msgr2=0x564d631432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11affff640 1 --2- 10.20.193.28:0/2020704270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 0x564d631432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11affff640 1 -- 10.20.193.28:0/2020704270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 msgr2=0x564d631383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11affff640 1 --2- 10.20.193.28:0/2020704270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 0x564d631383a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11affff640 1 -- 10.20.193.28:0/2020704270 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d6301a0f0 con 0x564d63136dd0 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11acff9640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11840b0e20 0x7f11840b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11acff9640 1 -- 10.20.193.28:0/1905927030 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f11a0104a10 con 0x7f11b0105320 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11affff640 1 --2- 10.20.193.28:0/2020704270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d631371b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009500 tx=0x7f11a4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46f24669fc11e803 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f11af7fe640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11840b0e20 0x7f11840b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.120+0000 7f1173fff640 1 -- 10.20.193.28:0/2020704270 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a401b070 con 0x564d63136dd0 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f1173fff640 1 -- 10.20.193.28:0/2020704270 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f11a4004570 con 0x564d63136dd0 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f1173fff640 1 -- 10.20.193.28:0/2020704270 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4013a40 con 0x564d63136dd0 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11b871ce00 1 -- 10.20.193.28:0/2020704270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 msgr2=0x564d631371b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11af7fe640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11840b0e20 0x7f11840b32e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x564d630dc010 tx=0x7f119c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11b871ce00 1 --2- 10.20.193.28:0/2020704270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d631371b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11a4009500 tx=0x7f11a4009920 comp rx=0 tx=0).stop 2026-02-20T03:24:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11b871ce00 1 -- 10.20.193.28:0/2020704270 shutdown_connections 2026-02-20T03:24:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11b871ce00 1 --2- 10.20.193.28:0/2020704270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 0x564d631432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11b871ce00 1 --2- 10.20.193.28:0/2020704270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 0x564d631383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11b871ce00 1 --2- 10.20.193.28:0/2020704270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d631371b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11b871ce00 1 -- 10.20.193.28:0/2020704270 >> 10.20.193.28:0/2020704270 conn(0x564d6312e1b0 msgr2=0x564d63135030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11b871ce00 1 -- 10.20.193.28:0/2020704270 shutdown_connections 2026-02-20T03:24:02.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.121+0000 7f11b871ce00 1 -- 10.20.193.28:0/2020704270 wait complete. 2026-02-20T03:24:02.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.123+0000 7f11b871ce00 1 -- start start 2026-02-20T03:24:02.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.123+0000 7f11b871ce00 1 Processor -- start 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.123+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d63151240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.123+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 0x564d63151780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.123+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d631388e0 0x564d6314f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.123+0000 7f11b871ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564d63031080 con 0x564d631388e0 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.123+0000 7f11b871ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564d631439d0 con 0x564d63136dd0 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.123+0000 7f11b871ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564d63150100 con 0x564d63137f60 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.123+0000 7f11af7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d63151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11af7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d63151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53796/0 (socket says 10.20.193.28:53796) 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11af7fe640 1 -- 10.20.193.28:0/1491286706 learned_addr learned my addr 10.20.193.28:0/1491286706 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11aeffd640 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 0x564d63151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11affff640 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d631388e0 0x564d6314f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11af7fe640 1 -- 10.20.193.28:0/1491286706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 msgr2=0x564d63151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11af7fe640 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 0x564d63151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11af7fe640 1 -- 10.20.193.28:0/1491286706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d631388e0 msgr2=0x564d6314f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11af7fe640 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d631388e0 0x564d6314f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11af7fe640 1 -- 10.20.193.28:0/1491286706 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d63148e90 con 0x564d63136dd0 2026-02-20T03:24:02.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11af7fe640 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d63151240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f119c011720 tx=0x7f119c004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75af466a35b49b3f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11717fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.124+0000 7f11717fa640 1 -- 10.20.193.28:0/1491286706 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c01e0d0 con 0x564d63136dd0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11717fa640 1 -- 10.20.193.28:0/1491286706 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f119c01ed30 con 0x564d63136dd0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11717fa640 1 -- 10.20.193.28:0/1491286706 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c01ca50 con 0x564d63136dd0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 1 -- 10.20.193.28:0/1491286706 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d62e5ada0 con 0x564d63136dd0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 10 client.27056 _ll_register_callbacks cb 0x564d63034fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11717fa640 1 -- 10.20.193.28:0/1491286706 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f119c01cbf0 con 0x564d63136dd0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 1 -- 10.20.193.28:0/1491286706 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d63091610 con 0x564d63136dd0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11717fa640 1 -- 10.20.193.28:0/1491286706 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f119c01e270 con 0x564d63136dd0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 10 client.27056 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 1 -- 10.20.193.28:0/1491286706 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x564d63047020 con 0x564d63136dd0 2026-02-20T03:24:02.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11717fa640 1 -- 10.20.193.28:0/1491286706 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f119c01e890 con 0x564d63136dd0 2026-02-20T03:24:02.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 10 client.27056 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:02.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 10 client.27056 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:24:02.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 20 client.27056 populate_metadata read hostname 'trial028' 2026-02-20T03:24:02.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d6315f960 0x564d63161e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 4 client.27056 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:02.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.125+0000 7f11b871ce00 1 -- 10.20.193.28:0/1491286706 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d6300bb80 con 0x564d6315f960 2026-02-20T03:24:02.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.126+0000 7f11aeffd640 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d6315f960 0x564d63161e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.126+0000 7f11aeffd640 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d6315f960 0x564d63161e20 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5a0305b39103891 server_cookie=4e51bc04f6d83f61 in_seq=0 out_seq=0 2026-02-20T03:24:02.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.126+0000 7f11717fa640 10 client.27056 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11717fa640 1 -- 10.20.193.28:0/1491286706 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x564d6300bb80 con 0x564d6315f960 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11717fa640 10 client.27056 handle_command_reply: tid=0 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 client.27056 shutdown 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 -- 10.20.193.28:0/1491286706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 msgr2=0x564d63151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d63151240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f119c011720 tx=0x7f119c004830 comp rx=0 tx=0).stop 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 -- 10.20.193.28:0/1491286706 shutdown_connections 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d6315f960 0x564d63161e20 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d631388e0 0x564d6314f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 0x564d63151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1491286706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d63151240 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11717fa640 0 client.27056 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 -- 10.20.193.28:0/1491286706 >> 10.20.193.28:0/1491286706 conn(0x564d6312e1b0 msgr2=0x564d63135740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 -- 10.20.193.28:0/1491286706 shutdown_connections 2026-02-20T03:24:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 1 -- 10.20.193.28:0/1491286706 wait complete. 2026-02-20T03:24:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.127+0000 7f11b871ce00 20 client.27056 trim_cache size 0 max 16384 2026-02-20T03:24:02.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.136+0000 7f11b871ce00 1 Processor -- start 2026-02-20T03:24:02.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.136+0000 7f11b871ce00 1 -- start start 2026-02-20T03:24:02.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d6315c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 0x564d6314e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 0x564d6314cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11b871ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1154012650 con 0x564d63137f60 2026-02-20T03:24:02.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11b871ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f115400ff20 con 0x564d63136dd0 2026-02-20T03:24:02.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11b871ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f115400dd70 con 0x564d631388e0 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11af7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d6315c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11aeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 0x564d6314e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11af7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d6315c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53802/0 (socket says 10.20.193.28:53802) 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11af7fe640 1 -- 10.20.193.28:0/1470326629 learned_addr learned my addr 10.20.193.28:0/1470326629 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11affff640 1 --2- 10.20.193.28:0/1470326629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 0x564d6314cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11aeffd640 1 -- 10.20.193.28:0/1470326629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 msgr2=0x564d6314cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11aeffd640 1 --2- 10.20.193.28:0/1470326629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 0x564d6314cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11aeffd640 1 -- 10.20.193.28:0/1470326629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 msgr2=0x564d6315c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11aeffd640 1 --2- 10.20.193.28:0/1470326629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d6315c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11aeffd640 1 -- 10.20.193.28:0/1470326629 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d63148cc0 con 0x564d63137f60 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.137+0000 7f11aeffd640 1 --2- 10.20.193.28:0/1470326629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 0x564d6314e830 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f11a0009a30 tx=0x7f11a010a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fbc6020f1ba473 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:02.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11737fe640 1 -- 10.20.193.28:0/1470326629 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00cbdf0 con 0x564d63137f60 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11737fe640 1 -- 10.20.193.28:0/1470326629 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f11a0033030 con 0x564d63137f60 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11737fe640 1 -- 10.20.193.28:0/1470326629 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00cbc10 con 0x564d63137f60 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11b871ce00 1 -- 10.20.193.28:0/1470326629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 msgr2=0x564d6314e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1470326629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 0x564d6314e830 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f11a0009a30 tx=0x7f11a010a4b0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11b871ce00 1 -- 10.20.193.28:0/1470326629 shutdown_connections 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1470326629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d631388e0 0x564d6314cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1470326629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63137f60 0x564d6314e830 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11b871ce00 1 --2- 10.20.193.28:0/1470326629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d63136dd0 0x564d6315c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11b871ce00 1 -- 10.20.193.28:0/1470326629 >> 10.20.193.28:0/1470326629 conn(0x564d6312e1b0 msgr2=0x564d63160560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11b871ce00 1 -- 10.20.193.28:0/1470326629 shutdown_connections 2026-02-20T03:24:02.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.138+0000 7f11b871ce00 1 -- 10.20.193.28:0/1470326629 wait complete. 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11b871ce00 1 -- start start 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11b871ce00 1 Processor -- start 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63136dd0 0x564d63157890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 0x564d63154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11b871ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d631388e0 0x564d63155100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11b871ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f115400e3e0 con 0x564d63136dd0 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11b871ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f115400f850 con 0x564d631388e0 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11b871ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f115400eab0 con 0x564d63137f60 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11af7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63136dd0 0x564d63157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11af7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63136dd0 0x564d63157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52642/0 (socket says 10.20.193.28:52642) 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11af7fe640 1 -- 10.20.193.28:0/4231973271 learned_addr learned my addr 10.20.193.28:0/4231973271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11aeffd640 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 0x564d63154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.139+0000 7f11affff640 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d631388e0 0x564d63155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11af7fe640 1 -- 10.20.193.28:0/4231973271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 msgr2=0x564d63154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11af7fe640 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 0x564d63154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11af7fe640 1 -- 10.20.193.28:0/4231973271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d631388e0 msgr2=0x564d63155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11af7fe640 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d631388e0 0x564d63155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11af7fe640 1 -- 10.20.193.28:0/4231973271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d62d68ad0 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11affff640 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d631388e0 0x564d63155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11af7fe640 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63136dd0 0x564d63157890 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f119c004450 tx=0x7f119c005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8831e650e74a5da9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11717fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11717fa640 1 -- 10.20.193.28:0/4231973271 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c03e020 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11b871ce00 1 -- 10.20.193.28:0/4231973271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d63010370 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11717fa640 1 -- 10.20.193.28:0/4231973271 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x564d63091610 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11717fa640 1 -- 10.20.193.28:0/4231973271 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119c028660 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11b871ce00 10 client.17922 _ll_register_callbacks cb 0x7f119c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11b871ce00 1 -- 10.20.193.28:0/4231973271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d63142ea0 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.140+0000 7f11717fa640 1 -- 10.20.193.28:0/4231973271 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f119c0288c0 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11717fa640 1 -- 10.20.193.28:0/4231973271 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f119c028b80 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11b871ce00 10 client.17922 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11b871ce00 1 -- 10.20.193.28:0/4231973271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x564d631499b0 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11717fa640 1 -- 10.20.193.28:0/4231973271 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f119c03a470 con 0x564d63136dd0 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11b871ce00 10 client.17922 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11b871ce00 10 client.17922 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:24:02.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11b871ce00 20 client.17922 populate_metadata read hostname 'trial028' 2026-02-20T03:24:02.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11b871ce00 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d631ccb40 0x564d631cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11b871ce00 4 client.17922 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f09dd84", "release": true, "await": true}] 2026-02-20T03:24:02.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11b871ce00 1 -- 10.20.193.28:0/4231973271 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f09dd84", "release": true, "await": true}) -- 0x564d630973c0 con 0x564d631ccb40 2026-02-20T03:24:02.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.141+0000 7f11aeffd640 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d631ccb40 0x564d631cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.142+0000 7f11aeffd640 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d631ccb40 0x564d631cf000 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52e5f253a17a2244 server_cookie=d1cbc58b6b00e483 in_seq=0 out_seq=0 2026-02-20T03:24:02.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.142+0000 7f11717fa640 10 client.17922 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:02.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11717fa640 1 -- 10.20.193.28:0/4231973271 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x564d630973c0 con 0x564d631ccb40 2026-02-20T03:24:02.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11717fa640 10 client.17922 handle_command_reply: tid=0 2026-02-20T03:24:02.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 client.17922 shutdown 2026-02-20T03:24:02.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 -- 10.20.193.28:0/4231973271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63136dd0 msgr2=0x564d63157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63136dd0 0x564d63157890 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f119c004450 tx=0x7f119c005c10 comp rx=0 tx=0).stop 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 -- 10.20.193.28:0/4231973271 shutdown_connections 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d631ccb40 0x564d631cf000 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d631388e0 0x564d63155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11717fa640 0 client.17922 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d63137f60 0x564d63154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 --2- 10.20.193.28:0/4231973271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d63136dd0 0x564d63157890 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 -- 10.20.193.28:0/4231973271 >> 10.20.193.28:0/4231973271 conn(0x564d6312e1b0 msgr2=0x564d63134810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 -- 10.20.193.28:0/4231973271 shutdown_connections 2026-02-20T03:24:02.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 1 -- 10.20.193.28:0/4231973271 wait complete. 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.145+0000 7f11b871ce00 20 client.17922 trim_cache size 0 max 16384 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 32, 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "f09dd84": { 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "version": 32, 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:24:02.149 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 148.2, 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:02.150 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 -- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11840b0e20 msgr2=0x7f11840b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11840b0e20 0x7f11840b32e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x564d630dc010 tx=0x7f119c009290 comp rx=0 tx=0).stop 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 -- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0105320 msgr2=0x7f11b019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0105320 0x7f11b019d600 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f11a002fca0 tx=0x7f11a002fcd0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 -- 10.20.193.28:0/1905927030 shutdown_connections 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11840b0e20 0x7f11840b32e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f11b010a980 0x7f11b01a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f11b0105320 0x7f11b019d600 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 --2- 10.20.193.28:0/1905927030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f11b0104980 0x7f11b019d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 -- 10.20.193.28:0/1905927030 >> 10.20.193.28:0/1905927030 conn(0x7f11b0100680 msgr2=0x7f11b0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 -- 10.20.193.28:0/1905927030 shutdown_connections 2026-02-20T03:24:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.146+0000 7f11b4f8e640 1 -- 10.20.193.28:0/1905927030 wait complete. 2026-02-20T03:24:02.249 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f09dd84', total seconds elapsed: 29.4 2026-02-20T03:24:02.249 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.15 2026-02-20T03:24:02.250 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:24:02.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 785565 7.83 MB/sec execute 335 sec latency 27873.383 ms 2026-02-20T03:24:02.533 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:02.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:02 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:24:02.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:02 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:02.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:02 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:24:02.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:02 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:02.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:02 trial028 ceph-mon[38552]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:24:02.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:02 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:02.583 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:02 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3707889191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:02.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:02 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:24:02.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:02 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:02.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:02 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:24:02.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:02 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:02.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:02 trial177 ceph-mon[43181]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:24:02.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:02 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:02.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:02 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3707889191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.734+0000 7fa012f32640 1 -- 10.20.193.28:0/1309579847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c108700 msgr2=0x7fa00c108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.734+0000 7fa012f32640 1 --2- 10.20.193.28:0/1309579847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c108700 0x7fa00c108ae0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009990 tx=0x7f9ffc02f170 comp rx=0 tx=0).stop 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.735+0000 7fa012f32640 1 -- 10.20.193.28:0/1309579847 shutdown_connections 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.735+0000 7fa012f32640 1 --2- 10.20.193.28:0/1309579847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa00c1030a0 0x7fa00c10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.735+0000 7fa012f32640 1 --2- 10.20.193.28:0/1309579847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa00c102700 0x7fa00c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.735+0000 7fa012f32640 1 --2- 10.20.193.28:0/1309579847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c108700 0x7fa00c108ae0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.735+0000 7fa012f32640 1 -- 10.20.193.28:0/1309579847 >> 10.20.193.28:0/1309579847 conn(0x7fa00c0fe440 msgr2=0x7fa00c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.735+0000 7fa012f32640 1 -- 10.20.193.28:0/1309579847 shutdown_connections 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.735+0000 7fa012f32640 1 -- 10.20.193.28:0/1309579847 wait complete. 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.736+0000 7fa012f32640 1 Processor -- start 2026-02-20T03:24:02.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.736+0000 7fa012f32640 1 -- start start 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.736+0000 7fa012f32640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa00c102700 0x7fa00c075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.736+0000 7fa012f32640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c1030a0 0x7fa00c0758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.736+0000 7fa012f32640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa00c108700 0x7fa00c075df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.736+0000 7fa012f32640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c112970 con 0x7fa00c1030a0 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.736+0000 7fa012f32640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c1127f0 con 0x7fa00c102700 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.736+0000 7fa012f32640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c112af0 con 0x7fa00c108700 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa01172f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c1030a0 0x7fa00c0758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa011f30640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa00c102700 0x7fa00c075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa01172f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c1030a0 0x7fa00c0758b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52666/0 (socket says 10.20.193.28:52666) 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa01172f640 1 -- 10.20.193.28:0/4004128582 learned_addr learned my addr 10.20.193.28:0/4004128582 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:02.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa012731640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa00c108700 0x7fa00c075df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa01172f640 1 -- 10.20.193.28:0/4004128582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa00c108700 msgr2=0x7fa00c075df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa01172f640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa00c108700 0x7fa00c075df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa01172f640 1 -- 10.20.193.28:0/4004128582 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa00c102700 msgr2=0x7fa00c075370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa01172f640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa00c102700 0x7fa00c075370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa01172f640 1 -- 10.20.193.28:0/4004128582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c1a9420 con 0x7fa00c1030a0 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa01172f640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c1030a0 0x7fa00c0758b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa00000ea30 tx=0x7fa00000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7f9ffaffd640 1 -- 10.20.193.28:0/4004128582 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00000ce50 con 0x7fa00c1030a0 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7f9ffaffd640 1 -- 10.20.193.28:0/4004128582 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa000004570 con 0x7fa00c1030a0 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7f9ffaffd640 1 -- 10.20.193.28:0/4004128582 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa000010690 con 0x7fa00c1030a0 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00c1a9710 con 0x7fa00c1030a0 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.737+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00c1a9c00 con 0x7fa00c1030a0 2026-02-20T03:24:02.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.738+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00c102b60 con 0x7fa00c1030a0 2026-02-20T03:24:02.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.741+0000 7f9ffaffd640 1 -- 10.20.193.28:0/4004128582 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa000002920 con 0x7fa00c1030a0 2026-02-20T03:24:02.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.742+0000 7f9ffaffd640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9fe80b0ea0 0x7f9fe80b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:02.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.742+0000 7f9ffaffd640 1 -- 10.20.193.28:0/4004128582 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa0000e0f60 con 0x7fa00c1030a0 2026-02-20T03:24:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.742+0000 7f9ffaffd640 1 -- 10.20.193.28:0/4004128582 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa0000a93d0 con 0x7fa00c1030a0 2026-02-20T03:24:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.742+0000 7fa011f30640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9fe80b0ea0 0x7f9fe80b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:02.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.743+0000 7fa011f30640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9fe80b0ea0 0x7f9fe80b3360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0096f0 tx=0x7f9ffc0023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:02.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:02 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:24:02.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:02 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:02.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:02 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:24:02.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:02 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:02.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:02 trial126 ceph-mon[38476]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:24:02.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:02 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:02.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:02 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3707889191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:02.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.849+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa00c10a6e0 con 0x7fa00c1030a0 2026-02-20T03:24:02.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.850+0000 7f9ffaffd640 1 -- 10.20.193.28:0/4004128582 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7fa0000ad080 con 0x7fa00c1030a0 2026-02-20T03:24:02.853 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:24:02.854 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:24:02.855 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:24:02.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.851+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9fe80b0ea0 msgr2=0x7f9fe80b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.851+0000 7fa012f32640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9fe80b0ea0 0x7f9fe80b3360 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc0096f0 tx=0x7f9ffc0023d0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.851+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c1030a0 msgr2=0x7fa00c0758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:02.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.851+0000 7fa012f32640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c1030a0 0x7fa00c0758b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fa00000ea30 tx=0x7fa00000ef00 comp rx=0 tx=0).stop 2026-02-20T03:24:02.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.852+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 shutdown_connections 2026-02-20T03:24:02.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.852+0000 7fa012f32640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9fe80b0ea0 0x7f9fe80b3360 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.852+0000 7fa012f32640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa00c108700 0x7fa00c075df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.852+0000 7fa012f32640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa00c1030a0 0x7fa00c0758b0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.852+0000 7fa012f32640 1 --2- 10.20.193.28:0/4004128582 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa00c102700 0x7fa00c075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:02.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.852+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 >> 10.20.193.28:0/4004128582 conn(0x7fa00c0fe440 msgr2=0x7fa00c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:02.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.852+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 shutdown_connections 2026-02-20T03:24:02.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:02.852+0000 7fa012f32640 1 -- 10.20.193.28:0/4004128582 wait complete. 2026-02-20T03:24:02.968 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 148.15 --await-for 45.0' 2026-02-20T03:24:02.968 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 148.15 --await-for 45.0 2026-02-20T03:24:03.246 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:03.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.478+0000 7f12826b3640 1 -- 10.20.193.28:0/1437153899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c109ed0 msgr2=0x7f127c111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:03.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.478+0000 7f12826b3640 1 --2- 10.20.193.28:0/1437153899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c109ed0 0x7f127c111a50 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f127000b0a0 tx=0x7f127002f450 comp rx=0 tx=0).stop 2026-02-20T03:24:03.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 -- 10.20.193.28:0/1437153899 shutdown_connections 2026-02-20T03:24:03.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 --2- 10.20.193.28:0/1437153899 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c109ed0 0x7f127c111a50 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 --2- 10.20.193.28:0/1437153899 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f127c105750 0x7f127c1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 --2- 10.20.193.28:0/1437153899 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f127c104da0 0x7f127c105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 -- 10.20.193.28:0/1437153899 >> 10.20.193.28:0/1437153899 conn(0x7f127c100840 msgr2=0x7f127c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:03.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 -- 10.20.193.28:0/1437153899 shutdown_connections 2026-02-20T03:24:03.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 -- 10.20.193.28:0/1437153899 wait complete. 2026-02-20T03:24:03.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 Processor -- start 2026-02-20T03:24:03.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 -- start start 2026-02-20T03:24:03.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c104da0 0x7f127c19d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f127c105750 0x7f127c19d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f127c109ed0 0x7f127c1a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f127c114e80 con 0x7f127c104da0 2026-02-20T03:24:03.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f127c114d00 con 0x7f127c105750 2026-02-20T03:24:03.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f127c115000 con 0x7f127c109ed0 2026-02-20T03:24:03.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f127bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c104da0 0x7f127c19d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:03.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f127bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c104da0 0x7f127c19d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52686/0 (socket says 10.20.193.28:52686) 2026-02-20T03:24:03.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f127bfff640 1 -- 10.20.193.28:0/1258607315 learned_addr learned my addr 10.20.193.28:0/1258607315 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:03.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f127bfff640 1 -- 10.20.193.28:0/1258607315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f127c109ed0 msgr2=0x7f127c1a1c10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:24:03.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f127bfff640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f127c109ed0 0x7f127c1a1c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f127bfff640 1 -- 10.20.193.28:0/1258607315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f127c105750 msgr2=0x7f127c19d880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f127bfff640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f127c105750 0x7f127c19d880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f127bfff640 1 -- 10.20.193.28:0/1258607315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c1a2390 con 0x7f127c104da0 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f127bfff640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c104da0 0x7f127c19d340 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f126800b570 tx=0x7f126800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12797fa640 1 -- 10.20.193.28:0/1258607315 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268013020 con 0x7f127c104da0 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12797fa640 1 -- 10.20.193.28:0/1258607315 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1268004480 con 0x7f127c104da0 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12797fa640 1 -- 10.20.193.28:0/1258607315 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126800fb50 con 0x7f127c104da0 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.480+0000 7f12826b3640 1 -- 10.20.193.28:0/1258607315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127c1a2680 con 0x7f127c104da0 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.483+0000 7f12826b3640 1 -- 10.20.193.28:0/1258607315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127c1a9ec0 con 0x7f127c104da0 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f12797fa640 1 -- 10.20.193.28:0/1258607315 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1268002780 con 0x7f127c104da0 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 Processor -- start 2026-02-20T03:24:03.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 -- start start 2026-02-20T03:24:03.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d70f70 0x55c641d6f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d6f6a0 0x55c641d6fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c641ce5cf0 con 0x55c641d705c0 2026-02-20T03:24:03.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c641cb8a10 con 0x55c641d70f70 2026-02-20T03:24:03.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c641c66330 con 0x55c641d6f6a0 2026-02-20T03:24:03.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1280c29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:03.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1280c29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52692/0 (socket says 10.20.193.28:52692) 2026-02-20T03:24:03.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1280c29640 1 -- 10.20.193.28:0/3670732802 learned_addr learned my addr 10.20.193.28:0/3670732802 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:03.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1280c29640 1 -- 10.20.193.28:0/3670732802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d6f6a0 msgr2=0x55c641d6fb00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:24:03.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1280c29640 1 --2- 10.20.193.28:0/3670732802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d6f6a0 0x55c641d6fb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1280c29640 1 -- 10.20.193.28:0/3670732802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d70f70 msgr2=0x55c641d6f080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:24:03.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1280c29640 1 --2- 10.20.193.28:0/3670732802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d70f70 0x55c641d6f080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1280c29640 1 -- 10.20.193.28:0/3670732802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c641c79510 con 0x55c641d705c0 2026-02-20T03:24:03.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1280c29640 1 --2- 10.20.193.28:0/3670732802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d709a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f1270009850 tx=0x7f1270009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f86b6744c81a47 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:03.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f124cce3640 1 -- 10.20.193.28:0/3670732802 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270004d40 con 0x55c641d705c0 2026-02-20T03:24:03.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f124cce3640 1 -- 10.20.193.28:0/3670732802 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1270033030 con 0x55c641d705c0 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f124cce3640 1 -- 10.20.193.28:0/3670732802 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270002cc0 con 0x55c641d705c0 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f12797fa640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12500b0e20 0x7f12500b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f12797fa640 1 -- 10.20.193.28:0/1258607315 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f12680e0550 con 0x7f127c104da0 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 -- 10.20.193.28:0/3670732802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 msgr2=0x55c641d709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.485+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/3670732802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d709a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f1270009850 tx=0x7f1270009e00 comp rx=0 tx=0).stop 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f127bfff640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12500b0e20 0x7f12500b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 -- 10.20.193.28:0/3670732802 shutdown_connections 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/3670732802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d6f6a0 0x55c641d6fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/3670732802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d70f70 0x55c641d6f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/3670732802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d709a0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 -- 10.20.193.28:0/3670732802 >> 10.20.193.28:0/3670732802 conn(0x55c641d294b0 msgr2=0x55c641d6d960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:03.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 -- 10.20.193.28:0/3670732802 shutdown_connections 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 -- 10.20.193.28:0/3670732802 wait complete. 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f127bfff640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12500b0e20 0x7f12500b32e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1268002410 tx=0x7f1268004850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 -- start start 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 Processor -- start 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d6f6a0 0x55c641d88d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d705c0 0x55c641d892a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d70f70 0x55c641d874a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c641cb4940 con 0x55c641d70f70 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c641b1a910 con 0x55c641d6f6a0 2026-02-20T03:24:03.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c641d87a30 con 0x55c641d705c0 2026-02-20T03:24:03.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1280c29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d70f70 0x55c641d874a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:03.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1280c29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d70f70 0x55c641d874a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52700/0 (socket says 10.20.193.28:52700) 2026-02-20T03:24:03.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1280c29640 1 -- 10.20.193.28:0/1291645791 learned_addr learned my addr 10.20.193.28:0/1291645791 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:03.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1280c29640 1 -- 10.20.193.28:0/1291645791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d705c0 msgr2=0x55c641d892a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:24:03.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1280c29640 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d705c0 0x55c641d892a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1280c29640 1 -- 10.20.193.28:0/1291645791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d6f6a0 msgr2=0x55c641d88d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:24:03.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1280c29640 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d6f6a0 0x55c641d88d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1280c29640 1 -- 10.20.193.28:0/1291645791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c641d813e0 con 0x55c641d70f70 2026-02-20T03:24:03.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f1280c29640 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d70f70 0x55c641d874a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f12700060b0 tx=0x7f1270004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24feba790b0e7b39 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f123dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.487+0000 7f123dffb640 1 -- 10.20.193.28:0/1291645791 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270004910 con 0x55c641d70f70 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 1 -- 10.20.193.28:0/1291645791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c641a88110 con 0x55c641d70f70 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f123dffb640 1 -- 10.20.193.28:0/1291645791 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1270004910 con 0x55c641d70f70 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f123dffb640 1 -- 10.20.193.28:0/1291645791 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12700078c0 con 0x55c641d70f70 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f123dffb640 1 -- 10.20.193.28:0/1291645791 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1270004300 con 0x55c641d70f70 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 10 client.17940 _ll_register_callbacks cb 0x55c641c63e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 1 -- 10.20.193.28:0/1291645791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c641cc0600 con 0x55c641d70f70 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f123dffb640 1 -- 10.20.193.28:0/1291645791 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12700078c0 con 0x55c641d70f70 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 10 client.17940 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 1 -- 10.20.193.28:0/1291645791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c641c48db0 con 0x55c641d70f70 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f123dffb640 1 -- 10.20.193.28:0/1291645791 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f127003f020 con 0x55c641d70f70 2026-02-20T03:24:03.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 10 client.17940 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:03.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 10 client.17940 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:24:03.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 20 client.17940 populate_metadata read hostname 'trial028' 2026-02-20T03:24:03.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c641d96f60 0x55c641d993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 4 client.17940 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:03.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.490+0000 7f1284bb8e00 1 -- 10.20.193.28:0/1291645791 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c641c3ab70 con 0x55c641d96f60 2026-02-20T03:24:03.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.512+0000 7f127b7fe640 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c641d96f60 0x55c641d993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:03.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787290 7.83 MB/sec execute 336 sec latency 535.163 ms 2026-02-20T03:24:03.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.566+0000 7f127b7fe640 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c641d96f60 0x55c641d993f0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da331fb03c01ead4 server_cookie=1622dc9dbcf8f808 in_seq=0 out_seq=0 2026-02-20T03:24:03.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.566+0000 7f123dffb640 10 client.17940 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f123dffb640 1 -- 10.20.193.28:0/1291645791 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c641c3ab70 con 0x55c641d96f60 2026-02-20T03:24:03.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f123dffb640 10 client.17940 handle_command_reply: tid=0 2026-02-20T03:24:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 client.17940 shutdown 2026-02-20T03:24:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 -- 10.20.193.28:0/1291645791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d70f70 msgr2=0x55c641d874a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:03.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d70f70 0x55c641d874a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f12700060b0 tx=0x7f1270004630 comp rx=0 tx=0).stop 2026-02-20T03:24:03.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 -- 10.20.193.28:0/1291645791 shutdown_connections 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c641d96f60 0x55c641d993f0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d70f70 0x55c641d874a0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d705c0 0x55c641d892a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/1291645791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d6f6a0 0x55c641d88d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 -- 10.20.193.28:0/1291645791 >> 10.20.193.28:0/1291645791 conn(0x55c641d294b0 msgr2=0x55c641d74d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f123dffb640 0 client.17940 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 -- 10.20.193.28:0/1291645791 shutdown_connections 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 1 -- 10.20.193.28:0/1291645791 wait complete. 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.593+0000 7f1284bb8e00 20 client.17940 trim_cache size 0 max 16384 2026-02-20T03:24:03.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 Processor -- start 2026-02-20T03:24:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 -- start start 2026-02-20T03:24:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d6f6a0 0x55c641d8c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d849d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d70f70 0x55c641d84f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f12200126e0 con 0x55c641d705c0 2026-02-20T03:24:03.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f122000ffb0 con 0x55c641d6f6a0 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f122000de00 con 0x55c641d70f70 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f127b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d849d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f127b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d849d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52706/0 (socket says 10.20.193.28:52706) 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f127b7fe640 1 -- 10.20.193.28:0/627896181 learned_addr learned my addr 10.20.193.28:0/627896181 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f127b7fe640 1 -- 10.20.193.28:0/627896181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d70f70 msgr2=0x55c641d84f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f127b7fe640 1 --2- 10.20.193.28:0/627896181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d70f70 0x55c641d84f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f127b7fe640 1 -- 10.20.193.28:0/627896181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d6f6a0 msgr2=0x55c641d8c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f127b7fe640 1 --2- 10.20.193.28:0/627896181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d6f6a0 0x55c641d8c2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f127b7fe640 1 -- 10.20.193.28:0/627896181 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c641d81210 con 0x55c641d705c0 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f127b7fe640 1 --2- 10.20.193.28:0/627896181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d849d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x55c641d8dde0 tx=0x7f126c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b553215df41d865b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f123ffff640 1 -- 10.20.193.28:0/627896181 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c01e070 con 0x55c641d705c0 2026-02-20T03:24:03.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f123ffff640 1 -- 10.20.193.28:0/627896181 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f126c009dc0 con 0x55c641d705c0 2026-02-20T03:24:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f123ffff640 1 -- 10.20.193.28:0/627896181 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c015040 con 0x55c641d705c0 2026-02-20T03:24:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 -- 10.20.193.28:0/627896181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 msgr2=0x55c641d849d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/627896181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d849d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x55c641d8dde0 tx=0x7f126c0047e0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 -- 10.20.193.28:0/627896181 shutdown_connections 2026-02-20T03:24:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/627896181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d70f70 0x55c641d84f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/627896181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d705c0 0x55c641d849d0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/627896181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d6f6a0 0x55c641d8c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 -- 10.20.193.28:0/627896181 >> 10.20.193.28:0/627896181 conn(0x55c641d294b0 msgr2=0x55c641d8bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 -- 10.20.193.28:0/627896181 shutdown_connections 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.599+0000 7f1284bb8e00 1 -- 10.20.193.28:0/627896181 wait complete. 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 -- start start 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 Processor -- start 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d6f6a0 0x55c641d9e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d705c0 0x55c641d9ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d70f70 0x55c641e01ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f122000e470 con 0x55c641d6f6a0 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f122000f8e0 con 0x55c641d705c0 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f122000eb40 con 0x55c641d70f70 2026-02-20T03:24:03.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1280c29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d6f6a0 0x55c641d9e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1280c29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d6f6a0 0x55c641d9e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52720/0 (socket says 10.20.193.28:52720) 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1280c29640 1 -- 10.20.193.28:0/701511436 learned_addr learned my addr 10.20.193.28:0/701511436 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1280c29640 1 -- 10.20.193.28:0/701511436 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d70f70 msgr2=0x55c641e01ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1280c29640 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d70f70 0x55c641e01ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1280c29640 1 -- 10.20.193.28:0/701511436 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d705c0 msgr2=0x55c641d9ecb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1280c29640 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d705c0 0x55c641d9ecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1280c29640 1 -- 10.20.193.28:0/701511436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c641a1c8d0 con 0x55c641d6f6a0 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1280c29640 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d6f6a0 0x55c641d9e770 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f127002f490 tx=0x7f1270004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c3474445ec00be server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f123dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f123dffb640 1 -- 10.20.193.28:0/701511436 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270004b40 con 0x55c641d6f6a0 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f123dffb640 1 -- 10.20.193.28:0/701511436 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55c641cc0600 con 0x55c641d6f6a0 2026-02-20T03:24:03.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f123dffb640 1 -- 10.20.193.28:0/701511436 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12700416a0 con 0x55c641d6f6a0 2026-02-20T03:24:03.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 -- 10.20.193.28:0/701511436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c641c76060 con 0x55c641d6f6a0 2026-02-20T03:24:03.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 10 client.17946 _ll_register_callbacks cb 0x7f1270006000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:03.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f1284bb8e00 1 -- 10.20.193.28:0/701511436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1270033030 con 0x55c641d6f6a0 2026-02-20T03:24:03.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.604+0000 7f123dffb640 1 -- 10.20.193.28:0/701511436 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1270043cb0 con 0x55c641d6f6a0 2026-02-20T03:24:03.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f123dffb640 1 -- 10.20.193.28:0/701511436 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1270061060 con 0x55c641d6f6a0 2026-02-20T03:24:03.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f1284bb8e00 10 client.17946 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:03.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f1284bb8e00 1 -- 10.20.193.28:0/701511436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c641d81f00 con 0x55c641d6f6a0 2026-02-20T03:24:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f123dffb640 1 -- 10.20.193.28:0/701511436 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f127003f040 con 0x55c641d6f6a0 2026-02-20T03:24:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f1284bb8e00 10 client.17946 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f1284bb8e00 10 client.17946 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:24:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f1284bb8e00 20 client.17946 populate_metadata read hostname 'trial028' 2026-02-20T03:24:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c641e034a0 0x55c641e05930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f1284bb8e00 4 client.17946 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.15, "await_for": 45.0}] 2026-02-20T03:24:03.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.606+0000 7f1284bb8e00 1 -- 10.20.193.28:0/701511436 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 148.15, "await_for": 45.0}) -- 0x55c641a39820 con 0x55c641e034a0 2026-02-20T03:24:03.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.633+0000 7f127b7fe640 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c641e034a0 0x55c641e05930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:03.648 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:03 trial028 ceph-mon[38552]: pgmap v462: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 550 KiB/s wr, 31 op/s 2026-02-20T03:24:03.649 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:03 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4004128582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.700+0000 7f127b7fe640 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c641e034a0 0x55c641e05930 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3f5aec9bd79b0c5 server_cookie=65cee98a4f52d090 in_seq=0 out_seq=0 2026-02-20T03:24:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.700+0000 7f123dffb640 10 client.17946 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:03 trial177 ceph-mon[43181]: pgmap v462: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 550 KiB/s wr, 31 op/s 2026-02-20T03:24:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:03 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4004128582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f123dffb640 1 -- 10.20.193.28:0/701511436 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c641a39820 con 0x55c641e034a0 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f123dffb640 10 client.17946 handle_command_reply: tid=0 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 client.17946 shutdown 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 -- 10.20.193.28:0/701511436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d6f6a0 msgr2=0x55c641d9e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d6f6a0 0x55c641d9e770 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f127002f490 tx=0x7f1270004a70 comp rx=0 tx=0).stop 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 -- 10.20.193.28:0/701511436 shutdown_connections 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c641e034a0 0x55c641e05930 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c641d70f70 0x55c641e01ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c641d705c0 0x55c641d9ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 --2- 10.20.193.28:0/701511436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c641d6f6a0 0x55c641d9e770 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f123dffb640 0 client.17946 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 -- 10.20.193.28:0/701511436 >> 10.20.193.28:0/701511436 conn(0x55c641d294b0 msgr2=0x55c641d8c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.822+0000 7f1284bb8e00 1 -- 10.20.193.28:0/701511436 shutdown_connections 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f1284bb8e00 1 -- 10.20.193.28:0/701511436 wait complete. 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f1284bb8e00 20 client.17946 trim_cache size 0 max 16384 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:24:03.826 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 34, 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "317e3c6c": { 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "version": 34, 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 148.2, 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 -- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12500b0e20 msgr2=0x7f12500b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12500b0e20 0x7f12500b32e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1268002410 tx=0x7f1268004850 comp rx=0 tx=0).stop 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 -- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c104da0 msgr2=0x7f127c19d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c104da0 0x7f127c19d340 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f126800b570 tx=0x7f126800ba40 comp rx=0 tx=0).stop 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 -- 10.20.193.28:0/1258607315 shutdown_connections 2026-02-20T03:24:03.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12500b0e20 0x7f12500b32e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f127c109ed0 0x7f127c1a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f127c105750 0x7f127c19d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 --2- 10.20.193.28:0/1258607315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f127c104da0 0x7f127c19d340 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:03.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 -- 10.20.193.28:0/1258607315 >> 10.20.193.28:0/1258607315 conn(0x7f127c100840 msgr2=0x7f127c101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:03.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 -- 10.20.193.28:0/1258607315 shutdown_connections 2026-02-20T03:24:03.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:03.823+0000 7f12826b3640 1 -- 10.20.193.28:0/1258607315 wait complete. 2026-02-20T03:24:03.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:03 trial126 ceph-mon[38476]: pgmap v462: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 25 KiB/s rd, 550 KiB/s wr, 31 op/s 2026-02-20T03:24:03.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:03 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4004128582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:03.926 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '317e3c6c', quiesce took 1.7 seconds. Will release after: 26.45 2026-02-20T03:24:04.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.81 MB/sec execute 337 sec latency 835.977 ms 2026-02-20T03:24:05.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.78 MB/sec execute 338 sec latency 1699.286 ms 2026-02-20T03:24:05.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:05 trial177 ceph-mon[43181]: pgmap v463: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 49 KiB/s rd, 541 KiB/s wr, 38 op/s 2026-02-20T03:24:05.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:05 trial126 ceph-mon[38476]: pgmap v463: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 49 KiB/s rd, 541 KiB/s wr, 38 op/s 2026-02-20T03:24:05.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:05 trial028 ceph-mon[38552]: pgmap v463: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 49 KiB/s rd, 541 KiB/s wr, 38 op/s 2026-02-20T03:24:06.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.76 MB/sec execute 339 sec latency 2699.329 ms 2026-02-20T03:24:07.514 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.74 MB/sec execute 340 sec latency 3699.361 ms 2026-02-20T03:24:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:07 trial177 ceph-mon[43181]: pgmap v464: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 162 KiB/s rd, 907 KiB/s wr, 73 op/s 2026-02-20T03:24:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:07 trial126 ceph-mon[38476]: pgmap v464: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 162 KiB/s rd, 907 KiB/s wr, 73 op/s 2026-02-20T03:24:07.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:07 trial028 ceph-mon[38552]: pgmap v464: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 162 KiB/s rd, 907 KiB/s wr, 73 op/s 2026-02-20T03:24:08.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.72 MB/sec execute 341 sec latency 4699.392 ms 2026-02-20T03:24:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:24:08.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:24:08.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:24:08.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:24:08.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:24:08.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:24:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:24:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:24:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:24:09.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.69 MB/sec execute 342 sec latency 5699.431 ms 2026-02-20T03:24:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:09 trial177 ceph-mon[43181]: pgmap v465: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 170 KiB/s rd, 1.1 MiB/s wr, 80 op/s 2026-02-20T03:24:09.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:09 trial126 ceph-mon[38476]: pgmap v465: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 170 KiB/s rd, 1.1 MiB/s wr, 80 op/s 2026-02-20T03:24:09.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:09 trial028 ceph-mon[38552]: pgmap v465: 129 pgs: 129 active+clean; 128 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 170 KiB/s rd, 1.1 MiB/s wr, 80 op/s 2026-02-20T03:24:10.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.67 MB/sec execute 343 sec latency 6699.469 ms 2026-02-20T03:24:11.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.65 MB/sec execute 344 sec latency 7699.502 ms 2026-02-20T03:24:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:11 trial177 ceph-mon[43181]: pgmap v466: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 191 KiB/s rd, 1005 KiB/s wr, 85 op/s 2026-02-20T03:24:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:11 trial126 ceph-mon[38476]: pgmap v466: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 191 KiB/s rd, 1005 KiB/s wr, 85 op/s 2026-02-20T03:24:11.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:11 trial028 ceph-mon[38552]: pgmap v466: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 191 KiB/s rd, 1005 KiB/s wr, 85 op/s 2026-02-20T03:24:12.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.63 MB/sec execute 345 sec latency 8699.535 ms 2026-02-20T03:24:13.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 -- 10.20.193.28:0/2149773383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c1064e0 msgr2=0x7fe07c10cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 --2- 10.20.193.28:0/2149773383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c1064e0 0x7fe07c10cd70 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b0a0 tx=0x7fe07802f410 comp rx=0 tx=0).stop 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 -- 10.20.193.28:0/2149773383 shutdown_connections 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 --2- 10.20.193.28:0/2149773383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c1064e0 0x7fe07c10cd70 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 --2- 10.20.193.28:0/2149773383 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c105b20 0x7fe07c105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 --2- 10.20.193.28:0/2149773383 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c104930 0x7fe07c104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 -- 10.20.193.28:0/2149773383 >> 10.20.193.28:0/2149773383 conn(0x7fe07c1000d0 msgr2=0x7fe07c1024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 -- 10.20.193.28:0/2149773383 shutdown_connections 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 -- 10.20.193.28:0/2149773383 wait complete. 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.192+0000 7fe083154640 1 Processor -- start 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe083154640 1 -- start start 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe083154640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c104930 0x7fe07c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe083154640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c105b20 0x7fe07c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe083154640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c1064e0 0x7fe07c1a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe083154640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c110420 con 0x7fe07c104930 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe083154640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c1102a0 con 0x7fe07c1064e0 2026-02-20T03:24:13.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe083154640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c1105a0 con 0x7fe07c105b20 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082152640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c104930 0x7fe07c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082152640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c104930 0x7fe07c19c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39022/0 (socket says 10.20.193.28:39022) 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082152640 1 -- 10.20.193.28:0/899332461 learned_addr learned my addr 10.20.193.28:0/899332461 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe081951640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c105b20 0x7fe07c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082953640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c1064e0 0x7fe07c1a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082152640 1 -- 10.20.193.28:0/899332461 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c105b20 msgr2=0x7fe07c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082152640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c105b20 0x7fe07c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082152640 1 -- 10.20.193.28:0/899332461 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c1064e0 msgr2=0x7fe07c1a3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082152640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c1064e0 0x7fe07c1a3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082152640 1 -- 10.20.193.28:0/899332461 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c1a4600 con 0x7fe07c104930 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082953640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c1064e0 0x7fe07c1a3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe082152640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c104930 0x7fe07c19c950 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00d980 tx=0x7fe06c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe0637fe640 1 -- 10.20.193.28:0/899332461 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c014070 con 0x7fe07c104930 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe0637fe640 1 -- 10.20.193.28:0/899332461 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe06c0044e0 con 0x7fe07c104930 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe0637fe640 1 -- 10.20.193.28:0/899332461 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c010460 con 0x7fe07c104930 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.193+0000 7fe083154640 1 -- 10.20.193.28:0/899332461 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c1a48f0 con 0x7fe07c104930 2026-02-20T03:24:13.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.194+0000 7fe083154640 1 -- 10.20.193.28:0/899332461 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c1a4df0 con 0x7fe07c104930 2026-02-20T03:24:13.198 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.196+0000 7fe0637fe640 1 -- 10.20.193.28:0/899332461 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe06c00b840 con 0x7fe07c104930 2026-02-20T03:24:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe087237e00 1 Processor -- start 2026-02-20T03:24:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe087237e00 1 -- start start 2026-02-20T03:24:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe087237e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe087237e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a17c0 0x5635968a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe087237e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe087237e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635967f18f0 con 0x5635968a0e80 2026-02-20T03:24:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe087237e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56359679f2e0 con 0x5635968a6560 2026-02-20T03:24:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe087237e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5635967ed820 con 0x5635968a17c0 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe082953640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe082953640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39034/0 (socket says 10.20.193.28:39034) 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe082953640 1 -- 10.20.193.28:0/2982688474 learned_addr learned my addr 10.20.193.28:0/2982688474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe082152640 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a17c0 0x5635968a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.197+0000 7fe081951640 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe082953640 1 -- 10.20.193.28:0/2982688474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a17c0 msgr2=0x5635968a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe082953640 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a17c0 0x5635968a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe082953640 1 -- 10.20.193.28:0/2982688474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 msgr2=0x5635968a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe082953640 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe082953640 1 -- 10.20.193.28:0/2982688474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635967915a0 con 0x5635968a0e80 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe081951640 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe082953640 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a1280 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe078009bb0 tx=0x7fe07800afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c09a6c5ab438e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:13.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe04a3ff640 1 -- 10.20.193.28:0/2982688474 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0780040c0 con 0x5635968a0e80 2026-02-20T03:24:13.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe04a3ff640 1 -- 10.20.193.28:0/2982688474 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe078033050 con 0x5635968a0e80 2026-02-20T03:24:13.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe04a3ff640 1 -- 10.20.193.28:0/2982688474 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0780076a0 con 0x5635968a0e80 2026-02-20T03:24:13.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe0637fe640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0580b0da0 0x7fe0580b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe0637fe640 1 -- 10.20.193.28:0/899332461 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe06c0e0ca0 con 0x7fe07c104930 2026-02-20T03:24:13.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe087237e00 1 -- 10.20.193.28:0/2982688474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 msgr2=0x5635968a1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:13.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe087237e00 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a1280 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe078009bb0 tx=0x7fe07800afe0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe082152640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0580b0da0 0x7fe0580b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe087237e00 1 -- 10.20.193.28:0/2982688474 shutdown_connections 2026-02-20T03:24:13.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe087237e00 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe087237e00 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a17c0 0x5635968a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe087237e00 1 --2- 10.20.193.28:0/2982688474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a1280 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe087237e00 1 -- 10.20.193.28:0/2982688474 >> 10.20.193.28:0/2982688474 conn(0x5635968986f0 msgr2=0x56359689f570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:13.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe087237e00 1 -- 10.20.193.28:0/2982688474 shutdown_connections 2026-02-20T03:24:13.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.198+0000 7fe087237e00 1 -- 10.20.193.28:0/2982688474 wait complete. 2026-02-20T03:24:13.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.199+0000 7fe082152640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0580b0da0 0x7fe0580b3260 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0a8680 tx=0x7fe06c002930 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:13.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.200+0000 7fe087237e00 1 -- start start 2026-02-20T03:24:13.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.200+0000 7fe087237e00 1 Processor -- start 2026-02-20T03:24:13.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.200+0000 7fe087237e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.200+0000 7fe087237e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 0x5635968c26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.200+0000 7fe087237e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a6560 0x5635968c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.200+0000 7fe087237e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635967990c0 con 0x5635968a6560 2026-02-20T03:24:13.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.200+0000 7fe087237e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5635968a95b0 con 0x5635968a17c0 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.200+0000 7fe087237e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5635968c9ad0 con 0x5635968a0e80 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a6560 0x5635968c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe081951640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 0x5635968c26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59428/0 (socket says 10.20.193.28:59428) 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 -- 10.20.193.28:0/246841933 learned_addr learned my addr 10.20.193.28:0/246841933 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 -- 10.20.193.28:0/246841933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 msgr2=0x5635968c26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 0x5635968c26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 -- 10.20.193.28:0/246841933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a6560 msgr2=0x5635968c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a6560 0x5635968c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 -- 10.20.193.28:0/246841933 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635968bbc10 con 0x5635968a0e80 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe081951640 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 0x5635968c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe082953640 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c2160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe07802f920 tx=0x7fe078002b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d47b64b0904688c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.201+0000 7fe0377fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe0377fe640 1 -- 10.20.193.28:0/246841933 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078007900 con 0x5635968a0e80 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe0377fe640 1 -- 10.20.193.28:0/246841933 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe078049040 con 0x5635968a0e80 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe0377fe640 1 -- 10.20.193.28:0/246841933 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078052d80 con 0x5635968a0e80 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 1 -- 10.20.193.28:0/246841933 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635967ad820 con 0x5635968a0e80 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 10 client.27097 _ll_register_callbacks cb 0x56359679cff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 1 -- 10.20.193.28:0/246841933 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635967f94e0 con 0x5635968a0e80 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe0377fe640 1 -- 10.20.193.28:0/246841933 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe07805b440 con 0x5635968a0e80 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe0377fe640 1 -- 10.20.193.28:0/246841933 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe07805b720 con 0x5635968a0e80 2026-02-20T03:24:13.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 10 client.27097 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 1 -- 10.20.193.28:0/246841933 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5635967b2380 con 0x5635968a0e80 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe0377fe640 1 -- 10.20.193.28:0/246841933 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe078052480 con 0x5635968a0e80 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 10 client.27097 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 10 client.27097 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 20 client.27097 populate_metadata read hostname 'trial028' 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635968cd800 0x5635968cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 4 client.27097 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.202+0000 7fe087237e00 1 -- 10.20.193.28:0/246841933 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563596773bd0 con 0x5635968cd800 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.203+0000 7fe081951640 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635968cd800 0x5635968cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.203+0000 7fe081951640 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635968cd800 0x5635968cfc70 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cff2417913a2d57 server_cookie=1ab248e8f2dc00e in_seq=0 out_seq=0 2026-02-20T03:24:13.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.203+0000 7fe0377fe640 10 client.27097 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe0377fe640 1 -- 10.20.193.28:0/246841933 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563596773bd0 con 0x5635968cd800 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe0377fe640 10 client.27097 handle_command_reply: tid=0 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 client.27097 shutdown 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 -- 10.20.193.28:0/246841933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 msgr2=0x5635968c2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c2160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe07802f920 tx=0x7fe078002b00 comp rx=0 tx=0).stop 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 -- 10.20.193.28:0/246841933 shutdown_connections 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635968cd800 0x5635968cfc70 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a6560 0x5635968c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 0x5635968c26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 --2- 10.20.193.28:0/246841933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c2160 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 -- 10.20.193.28:0/246841933 >> 10.20.193.28:0/246841933 conn(0x5635968986f0 msgr2=0x5635968a7910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:13.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe0377fe640 0 client.27097 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:13.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 -- 10.20.193.28:0/246841933 shutdown_connections 2026-02-20T03:24:13.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 1 -- 10.20.193.28:0/246841933 wait complete. 2026-02-20T03:24:13.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.204+0000 7fe087237e00 20 client.27097 trim_cache size 0 max 16384 2026-02-20T03:24:13.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.211+0000 7fe087237e00 1 Processor -- start 2026-02-20T03:24:13.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.211+0000 7fe087237e00 1 -- start start 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.211+0000 7fe087237e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.211+0000 7fe087237e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 0x5635968c9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.211+0000 7fe087237e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a6560 0x5635968c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.211+0000 7fe087237e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe028012770 con 0x5635968a0e80 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.211+0000 7fe087237e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe028010040 con 0x5635968a17c0 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.211+0000 7fe087237e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe02800de90 con 0x5635968a6560 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.211+0000 7fe082953640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe081951640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 0x5635968c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe082953640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39044/0 (socket says 10.20.193.28:39044) 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe082953640 1 -- 10.20.193.28:0/3556995917 learned_addr learned my addr 10.20.193.28:0/3556995917 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:13.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe082953640 1 --2- 10.20.193.28:0/3556995917 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a6560 0x5635968c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe082953640 1 -- 10.20.193.28:0/3556995917 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a6560 msgr2=0x5635968c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe082953640 1 --2- 10.20.193.28:0/3556995917 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a6560 0x5635968c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe082953640 1 -- 10.20.193.28:0/3556995917 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 msgr2=0x5635968c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe082953640 1 --2- 10.20.193.28:0/3556995917 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 0x5635968c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe082953640 1 -- 10.20.193.28:0/3556995917 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635968bba40 con 0x5635968a0e80 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe082953640 1 --2- 10.20.193.28:0/3556995917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a0380 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe078006130 tx=0x7fe07805b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e70c31a40983d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe049bfe640 1 -- 10.20.193.28:0/3556995917 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07805b440 con 0x5635968a0e80 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe049bfe640 1 -- 10.20.193.28:0/3556995917 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe078060020 con 0x5635968a0e80 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe049bfe640 1 -- 10.20.193.28:0/3556995917 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078052b80 con 0x5635968a0e80 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe087237e00 1 -- 10.20.193.28:0/3556995917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 msgr2=0x5635968a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe087237e00 1 --2- 10.20.193.28:0/3556995917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a0380 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe078006130 tx=0x7fe07805b000 comp rx=0 tx=0).stop 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe087237e00 1 -- 10.20.193.28:0/3556995917 shutdown_connections 2026-02-20T03:24:13.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe087237e00 1 --2- 10.20.193.28:0/3556995917 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a6560 0x5635968c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe087237e00 1 --2- 10.20.193.28:0/3556995917 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a17c0 0x5635968c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe087237e00 1 --2- 10.20.193.28:0/3556995917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a0e80 0x5635968a0380 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe087237e00 1 -- 10.20.193.28:0/3556995917 >> 10.20.193.28:0/3556995917 conn(0x5635968986f0 msgr2=0x5635968c1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:13.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe087237e00 1 -- 10.20.193.28:0/3556995917 shutdown_connections 2026-02-20T03:24:13.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.212+0000 7fe087237e00 1 -- 10.20.193.28:0/3556995917 wait complete. 2026-02-20T03:24:13.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.213+0000 7fe087237e00 1 -- start start 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.213+0000 7fe087237e00 1 Processor -- start 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.213+0000 7fe087237e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.213+0000 7fe087237e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a17c0 0x5635968c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe087237e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe087237e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe02800e500 con 0x5635968a17c0 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe087237e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe02800f970 con 0x5635968a6560 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe087237e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe02800ebd0 con 0x5635968a0e80 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe081951640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a17c0 0x5635968c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe082953640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe082953640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44436/0 (socket says 10.20.193.28:44436) 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe082953640 1 -- 10.20.193.28:0/3434994854 learned_addr learned my addr 10.20.193.28:0/3434994854 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe082953640 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe081951640 1 -- 10.20.193.28:0/3434994854 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 msgr2=0x5635968c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe081951640 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe081951640 1 -- 10.20.193.28:0/3434994854 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 msgr2=0x5635968c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe081951640 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe081951640 1 -- 10.20.193.28:0/3434994854 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635968cc340 con 0x5635968a17c0 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe081951640 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a17c0 0x5635968c75e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x5635968d04c0 tx=0x7fe070007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91fb9a61f2f5d3f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe0377fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe0377fe640 1 -- 10.20.193.28:0/3434994854 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070024670 con 0x5635968a17c0 2026-02-20T03:24:13.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe0377fe640 1 -- 10.20.193.28:0/3434994854 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe07001f070 con 0x5635968a17c0 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe0377fe640 1 -- 10.20.193.28:0/3434994854 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0700119f0 con 0x5635968a17c0 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.214+0000 7fe087237e00 1 -- 10.20.193.28:0/3434994854 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563596551690 con 0x5635968a17c0 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe0377fe640 1 -- 10.20.193.28:0/3434994854 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fe070011b90 con 0x5635968a17c0 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe0377fe640 10 client.17964 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 10 client.17964 _ll_register_callbacks cb 0x7fe078004680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 1 -- 10.20.193.28:0/3434994854 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe078033050 con 0x5635968a17c0 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe0377fe640 1 -- 10.20.193.28:0/3434994854 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe070011d90 con 0x5635968a17c0 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 10 client.17964 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 1 -- 10.20.193.28:0/3434994854 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5635967b6b70 con 0x5635968a17c0 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe0377fe640 1 -- 10.20.193.28:0/3434994854 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe070004830 con 0x5635968a17c0 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 10 client.17964 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:13.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 10 client.17964 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:13.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 20 client.17964 populate_metadata read hostname 'trial028' 2026-02-20T03:24:13.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563596938f80 0x56359693b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:13.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 4 client.17964 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:24:13.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe087237e00 1 -- 10.20.193.28:0/3434994854 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5635967c26b0 con 0x563596938f80 2026-02-20T03:24:13.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.215+0000 7fe082953640 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563596938f80 0x56359693b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:13.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.216+0000 7fe082953640 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563596938f80 0x56359693b440 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62a689fe3cc28adb server_cookie=6a1dd18deedbf224 in_seq=0 out_seq=0 2026-02-20T03:24:13.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.216+0000 7fe0377fe640 10 client.17964 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe0377fe640 1 -- 10.20.193.28:0/3434994854 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5635967c26b0 con 0x563596938f80 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe0377fe640 10 client.17964 handle_command_reply: tid=0 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 client.17964 shutdown 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 -- 10.20.193.28:0/3434994854 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a17c0 msgr2=0x5635968c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a17c0 0x5635968c75e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x5635968d04c0 tx=0x7fe070007cb0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 -- 10.20.193.28:0/3434994854 shutdown_connections 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563596938f80 0x56359693b440 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635968a6560 0x5635968c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635968a17c0 0x5635968c75e0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 --2- 10.20.193.28:0/3434994854 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635968a0e80 0x5635968c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe0377fe640 0 client.17964 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 -- 10.20.193.28:0/3434994854 >> 10.20.193.28:0/3434994854 conn(0x5635968986f0 msgr2=0x5635968c2580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 -- 10.20.193.28:0/3434994854 shutdown_connections 2026-02-20T03:24:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 1 -- 10.20.193.28:0/3434994854 wait complete. 2026-02-20T03:24:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe087237e00 20 client.17964 trim_cache size 0 max 16384 2026-02-20T03:24:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:24:13.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:24:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:24:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:24:13.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 -- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0580b0da0 msgr2=0x7fe0580b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0580b0da0 0x7fe0580b3260 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0a8680 tx=0x7fe06c002930 comp rx=0 tx=0).stop 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 -- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c104930 msgr2=0x7fe07c19c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c104930 0x7fe07c19c950 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00d980 tx=0x7fe06c00de50 comp rx=0 tx=0).stop 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 -- 10.20.193.28:0/899332461 shutdown_connections 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0580b0da0 0x7fe0580b3260 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe07c1064e0 0x7fe07c1a3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe07c105b20 0x7fe07c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 --2- 10.20.193.28:0/899332461 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe07c104930 0x7fe07c19c950 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 -- 10.20.193.28:0/899332461 >> 10.20.193.28:0/899332461 conn(0x7fe07c1000d0 msgr2=0x7fe07c108e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 -- 10.20.193.28:0/899332461 shutdown_connections 2026-02-20T03:24:13.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:13.239+0000 7fe083154640 1 -- 10.20.193.28:0/899332461 wait complete. 2026-02-20T03:24:13.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.60 MB/sec execute 346 sec latency 9699.573 ms 2026-02-20T03:24:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:13 trial177 ceph-mon[43181]: pgmap v467: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 181 KiB/s rd, 767 KiB/s wr, 75 op/s 2026-02-20T03:24:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:13 trial126 ceph-mon[38476]: pgmap v467: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 181 KiB/s rd, 767 KiB/s wr, 75 op/s 2026-02-20T03:24:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:13 trial028 ceph-mon[38552]: pgmap v467: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 181 KiB/s rd, 767 KiB/s wr, 75 op/s 2026-02-20T03:24:14.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.58 MB/sec execute 347 sec latency 10699.616 ms 2026-02-20T03:24:14.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:14 trial177 ceph-mon[43181]: pgmap v468: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 180 KiB/s rd, 716 KiB/s wr, 71 op/s 2026-02-20T03:24:14.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:14 trial126 ceph-mon[38476]: pgmap v468: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 180 KiB/s rd, 716 KiB/s wr, 71 op/s 2026-02-20T03:24:14.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:14 trial028 ceph-mon[38552]: pgmap v468: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 180 KiB/s rd, 716 KiB/s wr, 71 op/s 2026-02-20T03:24:15.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.56 MB/sec execute 348 sec latency 11699.663 ms 2026-02-20T03:24:16.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.54 MB/sec execute 349 sec latency 12699.704 ms 2026-02-20T03:24:17.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:17 trial177 ceph-mon[43181]: pgmap v469: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 162 KiB/s rd, 604 KiB/s wr, 69 op/s 2026-02-20T03:24:17.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.52 MB/sec execute 350 sec latency 13699.745 ms 2026-02-20T03:24:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:17 trial126 ceph-mon[38476]: pgmap v469: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 162 KiB/s rd, 604 KiB/s wr, 69 op/s 2026-02-20T03:24:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:17 trial028 ceph-mon[38552]: pgmap v469: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 162 KiB/s rd, 604 KiB/s wr, 69 op/s 2026-02-20T03:24:18.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.50 MB/sec execute 351 sec latency 14699.779 ms 2026-02-20T03:24:19.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:19 trial177 ceph-mon[43181]: pgmap v470: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 236 KiB/s wr, 34 op/s 2026-02-20T03:24:19.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.47 MB/sec execute 352 sec latency 15699.812 ms 2026-02-20T03:24:19.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:19 trial126 ceph-mon[38476]: pgmap v470: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 236 KiB/s wr, 34 op/s 2026-02-20T03:24:19.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:19 trial028 ceph-mon[38552]: pgmap v470: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 48 KiB/s rd, 236 KiB/s wr, 34 op/s 2026-02-20T03:24:20.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.45 MB/sec execute 353 sec latency 16699.854 ms 2026-02-20T03:24:21.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:21 trial177 ceph-mon[43181]: pgmap v471: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 19 KiB/s wr, 24 op/s 2026-02-20T03:24:21.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.43 MB/sec execute 354 sec latency 17699.891 ms 2026-02-20T03:24:21.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:21 trial126 ceph-mon[38476]: pgmap v471: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 19 KiB/s wr, 24 op/s 2026-02-20T03:24:21.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:21 trial028 ceph-mon[38552]: pgmap v471: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 19 KiB/s wr, 24 op/s 2026-02-20T03:24:22.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.41 MB/sec execute 355 sec latency 18699.940 ms 2026-02-20T03:24:23.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:23 trial177 ceph-mon[43181]: pgmap v472: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.4 KiB/s rd, 8.4 KiB/s wr, 16 op/s 2026-02-20T03:24:23.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.39 MB/sec execute 356 sec latency 19699.973 ms 2026-02-20T03:24:23.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:23 trial126 ceph-mon[38476]: pgmap v472: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.4 KiB/s rd, 8.4 KiB/s wr, 16 op/s 2026-02-20T03:24:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:23 trial028 ceph-mon[38552]: pgmap v472: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.4 KiB/s rd, 8.4 KiB/s wr, 16 op/s 2026-02-20T03:24:24.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.37 MB/sec execute 357 sec latency 20700.010 ms 2026-02-20T03:24:25.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:25 trial177 ceph-mon[43181]: pgmap v473: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 8.4 KiB/s wr, 17 op/s 2026-02-20T03:24:25.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.35 MB/sec execute 358 sec latency 21700.048 ms 2026-02-20T03:24:25.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:25 trial126 ceph-mon[38476]: pgmap v473: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 8.4 KiB/s wr, 17 op/s 2026-02-20T03:24:25.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:25 trial028 ceph-mon[38552]: pgmap v473: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.8 KiB/s rd, 8.4 KiB/s wr, 17 op/s 2026-02-20T03:24:26.323 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.318+0000 7f45c7fff640 1 -- 10.20.193.28:0/326297075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 msgr2=0x7f45c810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:26.323 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.318+0000 7f45c7fff640 1 --2- 10.20.193.28:0/326297075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 0x7f45c810a2e0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009a30 tx=0x7f45b002f220 comp rx=0 tx=0).stop 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.318+0000 7f45c7fff640 1 -- 10.20.193.28:0/326297075 shutdown_connections 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.318+0000 7f45c7fff640 1 --2- 10.20.193.28:0/326297075 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45c810a900 0x7f45c8111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.318+0000 7f45c7fff640 1 --2- 10.20.193.28:0/326297075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 0x7f45c810a2e0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.318+0000 7f45c7fff640 1 --2- 10.20.193.28:0/326297075 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45c8109490 0x7f45c8109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.318+0000 7f45c7fff640 1 -- 10.20.193.28:0/326297075 >> 10.20.193.28:0/326297075 conn(0x7f45c8077fe0 msgr2=0x7f45c807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.318+0000 7f45c7fff640 1 -- 10.20.193.28:0/326297075 shutdown_connections 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.318+0000 7f45c7fff640 1 -- 10.20.193.28:0/326297075 wait complete. 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c7fff640 1 Processor -- start 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c7fff640 1 -- start start 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45c8109490 0x7f45c81a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 0x7f45c81a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45c810a900 0x7f45c81a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f45c8114930 con 0x7f45c8109e60 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c7fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f45c81147b0 con 0x7f45c810a900 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c7fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f45c8114ab0 con 0x7f45c8109490 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 0x7f45c81a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 0x7f45c81a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42124/0 (socket says 10.20.193.28:42124) 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c67fc640 1 -- 10.20.193.28:0/4242270799 learned_addr learned my addr 10.20.193.28:0/4242270799 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c77fe640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45c810a900 0x7f45c81a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.319+0000 7f45c6ffd640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45c8109490 0x7f45c81a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45c67fc640 1 -- 10.20.193.28:0/4242270799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45c8109490 msgr2=0x7f45c81a0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:26.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45c67fc640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45c8109490 0x7f45c81a0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45c67fc640 1 -- 10.20.193.28:0/4242270799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45c810a900 msgr2=0x7f45c81a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:26.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45c67fc640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45c810a900 0x7f45c81a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45c67fc640 1 -- 10.20.193.28:0/4242270799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c81a8bf0 con 0x7f45c8109e60 2026-02-20T03:24:26.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45c67fc640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 0x7f45c81a1480 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009b60 tx=0x7f45b0002f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:26.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45cc9eb640 1 -- 10.20.193.28:0/4242270799 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0004030 con 0x7f45c8109e60 2026-02-20T03:24:26.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45cc9eb640 1 -- 10.20.193.28:0/4242270799 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45b0038770 con 0x7f45c8109e60 2026-02-20T03:24:26.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45cc9eb640 1 -- 10.20.193.28:0/4242270799 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0042620 con 0x7f45c8109e60 2026-02-20T03:24:26.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45c7fff640 1 -- 10.20.193.28:0/4242270799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c81a8e80 con 0x7f45c8109e60 2026-02-20T03:24:26.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.320+0000 7f45c7fff640 1 -- 10.20.193.28:0/4242270799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c81a9290 con 0x7f45c8109e60 2026-02-20T03:24:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.323+0000 7f45cc9eb640 1 -- 10.20.193.28:0/4242270799 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f45b0038920 con 0x7f45c8109e60 2026-02-20T03:24:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.323+0000 7f45d084be00 1 Processor -- start 2026-02-20T03:24:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.323+0000 7f45d084be00 1 -- start start 2026-02-20T03:24:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.323+0000 7f45d084be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f100c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.323+0000 7f45d084be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 0x55c3f1010f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.323+0000 7f45d084be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f10139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.323+0000 7f45d084be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0f5c8f0 con 0x55c3f100be80 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.323+0000 7f45d084be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0f0a2e0 con 0x55c3f1011560 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.323+0000 7f45d084be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0f58820 con 0x55c3f100c7c0 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f100c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f100c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42126/0 (socket says 10.20.193.28:42126) 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 0x55c3f1010f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c77fe640 1 -- 10.20.193.28:0/282745136 learned_addr learned my addr 10.20.193.28:0/282745136 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c67fc640 1 --2- 10.20.193.28:0/282745136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f10139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c77fe640 1 -- 10.20.193.28:0/282745136 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 msgr2=0x55c3f1010f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c77fe640 1 --2- 10.20.193.28:0/282745136 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 0x55c3f1010f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c77fe640 1 -- 10.20.193.28:0/282745136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 msgr2=0x55c3f10139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:26.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c77fe640 1 --2- 10.20.193.28:0/282745136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f10139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c77fe640 1 -- 10.20.193.28:0/282745136 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f0efc5a0 con 0x55c3f100be80 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c67fc640 1 --2- 10.20.193.28:0/282745136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f10139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c77fe640 1 --2- 10.20.193.28:0/282745136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f100c280 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009500 tx=0x7f45b8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c06580ed8e57fbc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45cc9eb640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f459c0b0e20 0x7f459c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45cc9eb640 1 -- 10.20.193.28:0/4242270799 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f45b0104830 con 0x7f45c8109e60 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45937fe640 1 -- 10.20.193.28:0/282745136 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b801b070 con 0x55c3f100be80 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45937fe640 1 -- 10.20.193.28:0/282745136 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45b8004570 con 0x55c3f100be80 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45937fe640 1 -- 10.20.193.28:0/282745136 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8013a40 con 0x55c3f100be80 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.324+0000 7f45c6ffd640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f459c0b0e20 0x7f459c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45d084be00 1 -- 10.20.193.28:0/282745136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 msgr2=0x55c3f100c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:26.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45d084be00 1 --2- 10.20.193.28:0/282745136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f100c280 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009500 tx=0x7f45b8009920 comp rx=0 tx=0).stop 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45d084be00 1 -- 10.20.193.28:0/282745136 shutdown_connections 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45d084be00 1 --2- 10.20.193.28:0/282745136 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f10139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45d084be00 1 --2- 10.20.193.28:0/282745136 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 0x55c3f1010f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45d084be00 1 --2- 10.20.193.28:0/282745136 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f100c280 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45d084be00 1 -- 10.20.193.28:0/282745136 >> 10.20.193.28:0/282745136 conn(0x55c3f10036f0 msgr2=0x55c3f100a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45d084be00 1 -- 10.20.193.28:0/282745136 shutdown_connections 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45d084be00 1 -- 10.20.193.28:0/282745136 wait complete. 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.325+0000 7f45c6ffd640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f459c0b0e20 0x7f459c0b32e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55c3f100ceb0 tx=0x7f45bc009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.326+0000 7f45d084be00 1 -- start start 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.326+0000 7f45d084be00 1 Processor -- start 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.326+0000 7f45d084be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 0x55c3f1024a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.326+0000 7f45d084be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f100c7c0 0x55c3f1024f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.326+0000 7f45d084be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f1011560 0x55c3f102bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.326+0000 7f45d084be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c3f0f040c0 con 0x55c3f1011560 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.326+0000 7f45d084be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c3f1014610 con 0x55c3f100c7c0 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.326+0000 7f45d084be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c3f102c460 con 0x55c3f100be80 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c67fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f100c7c0 0x55c3f1024f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 0x55c3f1024a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c67fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f100c7c0 0x55c3f1024f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48796/0 (socket says 10.20.193.28:48796) 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c67fc640 1 -- 10.20.193.28:0/65080070 learned_addr learned my addr 10.20.193.28:0/65080070 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c77fe640 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f1011560 0x55c3f102bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c67fc640 1 -- 10.20.193.28:0/65080070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 msgr2=0x55c3f1024a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c67fc640 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 0x55c3f1024a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c67fc640 1 -- 10.20.193.28:0/65080070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f1011560 msgr2=0x55c3f102bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c67fc640 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f1011560 0x55c3f102bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c67fc640 1 -- 10.20.193.28:0/65080070 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f101e130 con 0x55c3f100c7c0 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45c67fc640 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f100c7c0 0x55c3f1024f50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f45b00c83a0 tx=0x7f45b0005cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1cafad9430d9987 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f4590ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f4590ff9640 1 -- 10.20.193.28:0/65080070 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00ccc70 con 0x55c3f100c7c0 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f4590ff9640 1 -- 10.20.193.28:0/65080070 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45b0033070 con 0x55c3f100c7c0 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f4590ff9640 1 -- 10.20.193.28:0/65080070 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00c6ab0 con 0x55c3f100c7c0 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.327+0000 7f45d084be00 1 -- 10.20.193.28:0/65080070 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f0f18820 con 0x55c3f100c7c0 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f4590ff9640 1 -- 10.20.193.28:0/65080070 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f45b00c6c50 con 0x55c3f100c7c0 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f4590ff9640 10 client.27095 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 10 client.27095 _ll_register_callbacks cb 0x55c3f0f07ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:26.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 1 -- 10.20.193.28:0/65080070 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c3f0f644e0 con 0x55c3f100c7c0 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f4590ff9640 1 -- 10.20.193.28:0/65080070 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f45b00c6e50 con 0x55c3f100c7c0 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 10 client.27095 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 1 -- 10.20.193.28:0/65080070 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c3f0f1d380 con 0x55c3f100c7c0 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f4590ff9640 1 -- 10.20.193.28:0/65080070 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f45b0104ce0 con 0x55c3f100c7c0 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 10 client.27095 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 10 client.27095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 20 client.27095 populate_metadata read hostname 'trial028' 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c3f1030680 0x55c3f1032b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 4 client.27095 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45d084be00 1 -- 10.20.193.28:0/65080070 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3f0edebd0 con 0x55c3f1030680 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.328+0000 7f45c6ffd640 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c3f1030680 0x55c3f1032b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.329+0000 7f4590ff9640 10 client.27095 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.329+0000 7f45c6ffd640 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c3f1030680 0x55c3f1032b40 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ed5a281fc25802 server_cookie=ca8ddc90a4e31387 in_seq=0 out_seq=0 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.329+0000 7f4590ff9640 1 -- 10.20.193.28:0/65080070 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c3f0edebd0 con 0x55c3f1030680 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.329+0000 7f4590ff9640 10 client.27095 handle_command_reply: tid=0 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.329+0000 7f45d084be00 1 client.27095 shutdown 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.329+0000 7f45d084be00 1 -- 10.20.193.28:0/65080070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f100c7c0 msgr2=0x55c3f1024f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.329+0000 7f45d084be00 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f100c7c0 0x55c3f1024f50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f45b00c83a0 tx=0x7f45b0005cd0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f45d084be00 1 -- 10.20.193.28:0/65080070 shutdown_connections 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f45d084be00 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c3f1030680 0x55c3f1032b40 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f45d084be00 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f1011560 0x55c3f102bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f45d084be00 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f100c7c0 0x55c3f1024f50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f45d084be00 1 --2- 10.20.193.28:0/65080070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 0x55c3f1024a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f4590ff9640 0 client.27095 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f45d084be00 1 -- 10.20.193.28:0/65080070 >> 10.20.193.28:0/65080070 conn(0x55c3f10036f0 msgr2=0x55c3f1012910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f45d084be00 1 -- 10.20.193.28:0/65080070 shutdown_connections 2026-02-20T03:24:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f45d084be00 1 -- 10.20.193.28:0/65080070 wait complete. 2026-02-20T03:24:26.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.330+0000 7f45d084be00 20 client.27095 trim_cache size 0 max 16384 2026-02-20T03:24:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45d084be00 1 Processor -- start 2026-02-20T03:24:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45d084be00 1 -- start start 2026-02-20T03:24:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45d084be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 0x55c3f1009d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45d084be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100c7c0 0x55c3f100de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45d084be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f102be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45d084be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f456c0126a0 con 0x55c3f100c7c0 2026-02-20T03:24:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45d084be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f456c00ff70 con 0x55c3f1011560 2026-02-20T03:24:26.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45d084be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f456c00ddc0 con 0x55c3f100be80 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c77fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f102be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100c7c0 0x55c3f100de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c77fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f102be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48806/0 (socket says 10.20.193.28:48806) 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c77fe640 1 -- 10.20.193.28:0/3709119547 learned_addr learned my addr 10.20.193.28:0/3709119547 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c6ffd640 1 --2- 10.20.193.28:0/3709119547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 0x55c3f1009d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c67fc640 1 -- 10.20.193.28:0/3709119547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 msgr2=0x55c3f1009d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c67fc640 1 --2- 10.20.193.28:0/3709119547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 0x55c3f1009d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c67fc640 1 -- 10.20.193.28:0/3709119547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 msgr2=0x55c3f102be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c67fc640 1 --2- 10.20.193.28:0/3709119547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f102be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.337+0000 7f45c67fc640 1 -- 10.20.193.28:0/3709119547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f101df60 con 0x55c3f100c7c0 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45c67fc640 1 --2- 10.20.193.28:0/3709119547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100c7c0 0x55c3f100de10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f45b0038c40 tx=0x7f45b00f1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba613ddea2c7cbd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:26.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f4592ffd640 1 -- 10.20.193.28:0/3709119547 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00d0920 con 0x55c3f100c7c0 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f4592ffd640 1 -- 10.20.193.28:0/3709119547 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45b0033070 con 0x55c3f100c7c0 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f4592ffd640 1 -- 10.20.193.28:0/3709119547 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b00d1ab0 con 0x55c3f100c7c0 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45d084be00 1 -- 10.20.193.28:0/3709119547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100c7c0 msgr2=0x55c3f100de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45d084be00 1 --2- 10.20.193.28:0/3709119547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100c7c0 0x55c3f100de10 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f45b0038c40 tx=0x7f45b00f1000 comp rx=0 tx=0).stop 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45d084be00 1 -- 10.20.193.28:0/3709119547 shutdown_connections 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45d084be00 1 --2- 10.20.193.28:0/3709119547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f102be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45d084be00 1 --2- 10.20.193.28:0/3709119547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100c7c0 0x55c3f100de10 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45d084be00 1 --2- 10.20.193.28:0/3709119547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100be80 0x55c3f1009d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45d084be00 1 -- 10.20.193.28:0/3709119547 >> 10.20.193.28:0/3709119547 conn(0x55c3f10036f0 msgr2=0x55c3f100d700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45d084be00 1 -- 10.20.193.28:0/3709119547 shutdown_connections 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.338+0000 7f45d084be00 1 -- 10.20.193.28:0/3709119547 wait complete. 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.339+0000 7f45d084be00 1 -- start start 2026-02-20T03:24:26.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.339+0000 7f45d084be00 1 Processor -- start 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.339+0000 7f45d084be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f102b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45d084be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 0x55c3f102bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45d084be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f1029e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45d084be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f456c00e430 con 0x55c3f100be80 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45d084be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f456c00f8a0 con 0x55c3f1011560 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45d084be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f456c00eb00 con 0x55c3f100c7c0 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f102b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f102b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42144/0 (socket says 10.20.193.28:42144) 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c6ffd640 1 -- 10.20.193.28:0/3993503648 learned_addr learned my addr 10.20.193.28:0/3993503648 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c77fe640 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f1029e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c67fc640 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 0x55c3f102bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c6ffd640 1 -- 10.20.193.28:0/3993503648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 msgr2=0x55c3f102bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c6ffd640 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 0x55c3f102bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c6ffd640 1 -- 10.20.193.28:0/3993503648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 msgr2=0x55c3f1029e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c6ffd640 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f1029e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c6ffd640 1 -- 10.20.193.28:0/3993503648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f0cbc690 con 0x55c3f100be80 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45c6ffd640 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f102b810 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009d10 tx=0x7f45bc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd936523795fda88 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f4590ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f4590ff9640 1 -- 10.20.193.28:0/3993503648 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc01ecc0 con 0x55c3f100be80 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f4590ff9640 1 -- 10.20.193.28:0/3993503648 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45bc004d40 con 0x55c3f100be80 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f4590ff9640 1 -- 10.20.193.28:0/3993503648 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc031480 con 0x55c3f100be80 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.340+0000 7f45d084be00 1 -- 10.20.193.28:0/3993503648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f0f21b70 con 0x55c3f100be80 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f4590ff9640 1 -- 10.20.193.28:0/3993503648 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f45bc0048a0 con 0x55c3f100be80 2026-02-20T03:24:26.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 10 client.17982 _ll_register_callbacks cb 0x7f45b00c81e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 1 -- 10.20.193.28:0/3993503648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b8004570 con 0x55c3f100be80 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f4590ff9640 1 -- 10.20.193.28:0/3993503648 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f45bc004aa0 con 0x55c3f100be80 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 10 client.17982 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 1 -- 10.20.193.28:0/3993503648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55c3f101ec50 con 0x55c3f100be80 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f4590ff9640 1 -- 10.20.193.28:0/3993503648 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f45bc039030 con 0x55c3f100be80 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 10 client.17982 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 10 client.17982 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 20 client.17982 populate_metadata read hostname 'trial028' 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c3f109c5c0 0x55c3f109ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 4 client.17982 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45d084be00 1 -- 10.20.193.28:0/3993503648 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3f0d35520 con 0x55c3f109c5c0 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.341+0000 7f45c67fc640 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c3f109c5c0 0x55c3f109ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:26.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.342+0000 7f45c67fc640 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c3f109c5c0 0x55c3f109ea80 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c1b5a89df3d8ad8 server_cookie=da5ffa7b3cef0ab0 in_seq=0 out_seq=0 2026-02-20T03:24:26.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.342+0000 7f4590ff9640 10 client.17982 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:26.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f4590ff9640 1 -- 10.20.193.28:0/3993503648 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3f0d35520 con 0x55c3f109c5c0 2026-02-20T03:24:26.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f4590ff9640 10 client.17982 handle_command_reply: tid=0 2026-02-20T03:24:26.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 client.17982 shutdown 2026-02-20T03:24:26.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 -- 10.20.193.28:0/3993503648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 msgr2=0x55c3f102b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:26.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f102b810 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009d10 tx=0x7f45bc0047c0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 -- 10.20.193.28:0/3993503648 shutdown_connections 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c3f109c5c0 0x55c3f109ea80 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3f1011560 0x55c3f1029e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3f100c7c0 0x55c3f102bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 --2- 10.20.193.28:0/3993503648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3f100be80 0x55c3f102b810 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 -- 10.20.193.28:0/3993503648 >> 10.20.193.28:0/3993503648 conn(0x55c3f10036f0 msgr2=0x55c3f100de10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f4590ff9640 0 client.17982 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 -- 10.20.193.28:0/3993503648 shutdown_connections 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 1 -- 10.20.193.28:0/3993503648 wait complete. 2026-02-20T03:24:26.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.353+0000 7f45d084be00 20 client.17982 trim_cache size 0 max 16384 2026-02-20T03:24:26.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:24:26.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:24:26.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:24:26.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:24:26.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 -- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f459c0b0e20 msgr2=0x7f459c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f459c0b0e20 0x7f459c0b32e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55c3f100ceb0 tx=0x7f45bc009290 comp rx=0 tx=0).stop 2026-02-20T03:24:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 -- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 msgr2=0x7f45c81a1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 0x7f45c81a1480 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009b60 tx=0x7f45b0002f70 comp rx=0 tx=0).stop 2026-02-20T03:24:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 -- 10.20.193.28:0/4242270799 shutdown_connections 2026-02-20T03:24:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f459c0b0e20 0x7f459c0b32e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f45c810a900 0x7f45c81a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45c8109e60 0x7f45c81a1480 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 --2- 10.20.193.28:0/4242270799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f45c8109490 0x7f45c81a0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 -- 10.20.193.28:0/4242270799 >> 10.20.193.28:0/4242270799 conn(0x7f45c8077fe0 msgr2=0x7f45c810d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 -- 10.20.193.28:0/4242270799 shutdown_connections 2026-02-20T03:24:26.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:26.354+0000 7f45c7fff640 1 -- 10.20.193.28:0/4242270799 wait complete. 2026-02-20T03:24:26.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.33 MB/sec execute 359 sec latency 22700.082 ms 2026-02-20T03:24:27.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:27 trial177 ceph-mon[43181]: pgmap v474: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T03:24:27.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.31 MB/sec execute 360 sec latency 23700.122 ms 2026-02-20T03:24:27.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:27 trial126 ceph-mon[38476]: pgmap v474: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T03:24:27.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:27 trial028 ceph-mon[38552]: pgmap v474: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 18 op/s 2026-02-20T03:24:28.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.29 MB/sec execute 361 sec latency 24700.166 ms 2026-02-20T03:24:29.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:29 trial177 ceph-mon[43181]: pgmap v475: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2026-02-20T03:24:29.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.27 MB/sec execute 362 sec latency 25700.200 ms 2026-02-20T03:24:29.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:29 trial126 ceph-mon[38476]: pgmap v475: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2026-02-20T03:24:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:29 trial028 ceph-mon[38552]: pgmap v475: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2026-02-20T03:24:30.377 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:24:30.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.25 MB/sec execute 363 sec latency 26700.233 ms 2026-02-20T03:24:30.650 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:30.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.833+0000 7f8db0d64640 1 -- 10.20.193.28:0/4080563313 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac100d50 msgr2=0x7f8dac101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:30.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.833+0000 7f8db0d64640 1 --2- 10.20.193.28:0/4080563313 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac100d50 0x7f8dac101130 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009a30 tx=0x7f8d9802f240 comp rx=0 tx=0).stop 2026-02-20T03:24:30.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.833+0000 7f8db0d64640 1 -- 10.20.193.28:0/4080563313 shutdown_connections 2026-02-20T03:24:30.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.833+0000 7f8db0d64640 1 --2- 10.20.193.28:0/4080563313 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8dac1069e0 0x7f8dac107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.833+0000 7f8db0d64640 1 --2- 10.20.193.28:0/4080563313 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8dac101700 0x7f8dac1062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.833+0000 7f8db0d64640 1 --2- 10.20.193.28:0/4080563313 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac100d50 0x7f8dac101130 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.833+0000 7f8db0d64640 1 -- 10.20.193.28:0/4080563313 >> 10.20.193.28:0/4080563313 conn(0x7f8dac0fca60 msgr2=0x7f8dac0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:30.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.833+0000 7f8db0d64640 1 -- 10.20.193.28:0/4080563313 shutdown_connections 2026-02-20T03:24:30.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.833+0000 7f8db0d64640 1 -- 10.20.193.28:0/4080563313 wait complete. 2026-02-20T03:24:30.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8db0d64640 1 Processor -- start 2026-02-20T03:24:30.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8db0d64640 1 -- start start 2026-02-20T03:24:30.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8db0d64640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8dac100d50 0x7f8dac1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:30.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8db0d64640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8dac101700 0x7f8dac1a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:30.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8db0d64640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac1069e0 0x7f8dac1a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:30.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8db0d64640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac119090 con 0x7f8dac1069e0 2026-02-20T03:24:30.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8db0d64640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac118f10 con 0x7f8dac100d50 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8db0d64640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac119210 con 0x7f8dac101700 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8dabfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac1069e0 0x7f8dac1a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8dab7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8dac100d50 0x7f8dac1a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.834+0000 7f8dabfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac1069e0 0x7f8dac1a5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42164/0 (socket says 10.20.193.28:42164) 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8dabfff640 1 -- 10.20.193.28:0/3842564126 learned_addr learned my addr 10.20.193.28:0/3842564126 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8daaffd640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8dac101700 0x7f8dac1a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8dabfff640 1 -- 10.20.193.28:0/3842564126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8dac101700 msgr2=0x7f8dac1a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8dabfff640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8dac101700 0x7f8dac1a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8dabfff640 1 -- 10.20.193.28:0/3842564126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8dac100d50 msgr2=0x7f8dac1a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8dabfff640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8dac100d50 0x7f8dac1a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8dabfff640 1 -- 10.20.193.28:0/3842564126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac1a65f0 con 0x7f8dac1069e0 2026-02-20T03:24:30.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8daaffd640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8dac101700 0x7f8dac1a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:30.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8dabfff640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac1069e0 0x7f8dac1a5e70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8da0004820 tx=0x7f8da000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:30.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8da8ff9640 1 -- 10.20.193.28:0/3842564126 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da00090d0 con 0x7f8dac1069e0 2026-02-20T03:24:30.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8da8ff9640 1 -- 10.20.193.28:0/3842564126 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8da0009270 con 0x7f8dac1069e0 2026-02-20T03:24:30.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8da8ff9640 1 -- 10.20.193.28:0/3842564126 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0013810 con 0x7f8dac1069e0 2026-02-20T03:24:30.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac1a6880 con 0x7f8dac1069e0 2026-02-20T03:24:30.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.835+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dac1ae120 con 0x7f8dac1069e0 2026-02-20T03:24:30.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.836+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dac1062b0 con 0x7f8dac1069e0 2026-02-20T03:24:30.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.838+0000 7f8da8ff9640 1 -- 10.20.193.28:0/3842564126 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8da0012070 con 0x7f8dac1069e0 2026-02-20T03:24:30.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.840+0000 7f8da8ff9640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d800b0e20 0x7f8d800b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:30.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.840+0000 7f8da8ff9640 1 -- 10.20.193.28:0/3842564126 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f8da00e07a0 con 0x7f8dac1069e0 2026-02-20T03:24:30.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.840+0000 7f8dab7fe640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d800b0e20 0x7f8d800b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:30.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.840+0000 7f8da8ff9640 1 -- 10.20.193.28:0/3842564126 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8da0010070 con 0x7f8dac1069e0 2026-02-20T03:24:30.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.840+0000 7f8dab7fe640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d800b0e20 0x7f8d800b32e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8d980058c0 tx=0x7f8d98005830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:30.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.948+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dac1ae380 con 0x7f8dac1069e0 2026-02-20T03:24:30.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.948+0000 7f8da8ff9640 1 -- 10.20.193.28:0/3842564126 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f8da00a8b80 con 0x7f8dac1069e0 2026-02-20T03:24:30.952 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:24:30.952 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d800b0e20 msgr2=0x7f8d800b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d800b0e20 0x7f8d800b32e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8d980058c0 tx=0x7f8d98005830 comp rx=0 tx=0).stop 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac1069e0 msgr2=0x7f8dac1a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac1069e0 0x7f8dac1a5e70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f8da0004820 tx=0x7f8da000d4a0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 shutdown_connections 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d800b0e20 0x7f8d800b32e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8dac1069e0 0x7f8dac1a5e70 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8dac101700 0x7f8dac1a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 --2- 10.20.193.28:0/3842564126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8dac100d50 0x7f8dac1a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:30.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 >> 10.20.193.28:0/3842564126 conn(0x7f8dac0fca60 msgr2=0x7f8dac110df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:30.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 shutdown_connections 2026-02-20T03:24:30.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:30.950+0000 7f8db0d64640 1 -- 10.20.193.28:0/3842564126 wait complete. 2026-02-20T03:24:31.053 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 317e3c6c --release --await' 2026-02-20T03:24:31.053 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 317e3c6c --release --await 2026-02-20T03:24:31.170 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:24:31.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:31 trial028 ceph-mon[38552]: pgmap v476: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2026-02-20T03:24:31.223 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:31 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3842564126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:31.323 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:31 trial177 ceph-mon[43181]: pgmap v476: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2026-02-20T03:24:31.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:31 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3842564126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:31.510 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:31.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 787291 7.23 MB/sec execute 364 sec latency 27700.269 ms 2026-02-20T03:24:31.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.528+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4094183207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf0109220 msgr2=0x7f0cf0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.528+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4094183207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf0109220 0x7f0cf0109660 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009a30 tx=0x7f0ce002f220 comp rx=0 tx=0).stop 2026-02-20T03:24:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.529+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4094183207 shutdown_connections 2026-02-20T03:24:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.529+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4094183207 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf0109ba0 0x7f0cf0115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.529+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4094183207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf0109220 0x7f0cf0109660 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.529+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4094183207 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf010eef0 0x7f0cf010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.529+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4094183207 >> 10.20.193.28:0/4094183207 conn(0x7f0cf0078600 msgr2=0x7f0cf007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.529+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4094183207 shutdown_connections 2026-02-20T03:24:31.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.529+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4094183207 wait complete. 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.529+0000 7f0cf4ca0640 1 Processor -- start 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0cf4ca0640 1 -- start start 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0cf4ca0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf0109220 0x7f0cf01a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0cf4ca0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf0109ba0 0x7f0cf01a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0cf4ca0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf010eef0 0x7f0cf01a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0cf4ca0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf0119090 con 0x7f0cf0109220 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0cf4ca0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf0118f10 con 0x7f0cf010eef0 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0cf4ca0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf0119210 con 0x7f0cf0109ba0 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0ceeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf0109ba0 0x7f0cf01a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0ceeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf0109ba0 0x7f0cf01a1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59008/0 (socket says 10.20.193.28:59008) 2026-02-20T03:24:31.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0ceeffd640 1 -- 10.20.193.28:0/4164122999 learned_addr learned my addr 10.20.193.28:0/4164122999 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0ceffff640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf010eef0 0x7f0cf01a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.530+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf0109220 0x7f0cf01a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cef7fe640 1 -- 10.20.193.28:0/4164122999 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf0109ba0 msgr2=0x7f0cf01a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf0109ba0 0x7f0cf01a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cef7fe640 1 -- 10.20.193.28:0/4164122999 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf010eef0 msgr2=0x7f0cf01a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf010eef0 0x7f0cf01a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cef7fe640 1 -- 10.20.193.28:0/4164122999 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf01a65b0 con 0x7f0cf0109220 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf0109220 0x7f0cf01a1560 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00e9f0 tx=0x7f0cdc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cecff9640 1 -- 10.20.193.28:0/4164122999 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00cd80 con 0x7f0cf0109220 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cecff9640 1 -- 10.20.193.28:0/4164122999 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0cdc004570 con 0x7f0cf0109220 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cecff9640 1 -- 10.20.193.28:0/4164122999 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc010690 con 0x7f0cf0109220 2026-02-20T03:24:31.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4164122999 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf01a68a0 con 0x7f0cf0109220 2026-02-20T03:24:31.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.531+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4164122999 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf01ae0e0 con 0x7f0cf0109220 2026-02-20T03:24:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.534+0000 7f0cecff9640 1 -- 10.20.193.28:0/4164122999 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0cdc002890 con 0x7f0cf0109220 2026-02-20T03:24:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.534+0000 7f0cf842ee00 1 Processor -- start 2026-02-20T03:24:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.535+0000 7f0cf842ee00 1 -- start start 2026-02-20T03:24:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.535+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05edd0 0x5564ef05f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.535+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 0x5564ef0603a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.535+0000 7f0ceffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05edd0 0x5564ef05f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.535+0000 7f0ceffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05edd0 0x5564ef05f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48872/0 (socket says 10.20.193.28:48872) 2026-02-20T03:24:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.535+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef06b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.535+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5564eefb1a20 con 0x5564ef0608e0 2026-02-20T03:24:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.535+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5564eef5f2a0 con 0x5564ef05edd0 2026-02-20T03:24:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.535+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5564eefad950 con 0x5564ef05ff60 2026-02-20T03:24:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0ceffff640 1 -- 10.20.193.28:0/3210460624 learned_addr learned my addr 10.20.193.28:0/3210460624 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/3210460624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 0x5564ef0603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0ceeffd640 1 --2- 10.20.193.28:0/3210460624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef06b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0cecff9640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cc40b0e20 0x7f0cc40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0ceeffd640 1 -- 10.20.193.28:0/3210460624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 msgr2=0x5564ef0603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0ceeffd640 1 --2- 10.20.193.28:0/3210460624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 0x5564ef0603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0ceeffd640 1 -- 10.20.193.28:0/3210460624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05edd0 msgr2=0x5564ef05f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0ceeffd640 1 --2- 10.20.193.28:0/3210460624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05edd0 0x5564ef05f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0ceeffd640 1 -- 10.20.193.28:0/3210460624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564eef420f0 con 0x5564ef0608e0 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0cecff9640 1 -- 10.20.193.28:0/4164122999 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f0cdc0e0df0 con 0x7f0cf0109220 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0ceffff640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cc40b0e20 0x7f0cc40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0ceeffd640 1 --2- 10.20.193.28:0/3210460624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef06b2d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0002410 tx=0x7f0ce0005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da2af91b0e09162 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.536+0000 7f0cb3fff640 1 -- 10.20.193.28:0/3210460624 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce002fc80 con 0x5564ef0608e0 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0ceffff640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cc40b0e20 0x7f0cc40b32e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4002b20 tx=0x7f0ce4004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cb3fff640 1 -- 10.20.193.28:0/3210460624 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0ce0052070 con 0x5564ef0608e0 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cb3fff640 1 -- 10.20.193.28:0/3210460624 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0038e60 con 0x5564ef0608e0 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3210460624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 msgr2=0x5564ef06b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3210460624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef06b2d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0002410 tx=0x7f0ce0005870 comp rx=0 tx=0).stop 2026-02-20T03:24:31.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3210460624 shutdown_connections 2026-02-20T03:24:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3210460624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef06b2d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3210460624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 0x5564ef0603a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3210460624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05edd0 0x5564ef05f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3210460624 >> 10.20.193.28:0/3210460624 conn(0x5564ef0561b0 msgr2=0x5564ef05d030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3210460624 shutdown_connections 2026-02-20T03:24:31.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.537+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3210460624 wait complete. 2026-02-20T03:24:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.539+0000 7f0cf842ee00 1 -- start start 2026-02-20T03:24:31.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.539+0000 7f0cf842ee00 1 Processor -- start 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.539+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef078e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 0x5564ef0793b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0775b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5564eef59080 con 0x5564ef0608e0 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5564ef06b970 con 0x5564ef05ff60 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5564ef077d30 con 0x5564ef05edd0 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0775b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceeffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 0x5564ef0793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0775b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42190/0 (socket says 10.20.193.28:42190) 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceffff640 1 -- 10.20.193.28:0/3513141959 learned_addr learned my addr 10.20.193.28:0/3513141959 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef078e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceffff640 1 -- 10.20.193.28:0/3513141959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 msgr2=0x5564ef078e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceffff640 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef078e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceffff640 1 -- 10.20.193.28:0/3513141959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 msgr2=0x5564ef0793b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceffff640 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 0x5564ef0793b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceffff640 1 -- 10.20.193.28:0/3513141959 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ef070de0 con 0x5564ef0608e0 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceeffd640 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 0x5564ef0793b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0ceffff640 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0775b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4007ae0 tx=0x7f0ce400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf192e09200b814 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.540+0000 7f0cb17fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cb17fa640 1 -- 10.20.193.28:0/3513141959 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4019d40 con 0x5564ef0608e0 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3513141959 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564eed82da0 con 0x5564ef0608e0 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 10 client.18000 _ll_register_callbacks cb 0x5564eef5cfb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:31.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3513141959 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564eefb9610 con 0x5564ef0608e0 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cb17fa640 1 -- 10.20.193.28:0/3513141959 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0ce4017910 con 0x5564ef0608e0 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cb17fa640 1 -- 10.20.193.28:0/3513141959 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4019d40 con 0x5564ef0608e0 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cb17fa640 1 -- 10.20.193.28:0/3513141959 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f0ce4016570 con 0x5564ef0608e0 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cb17fa640 1 -- 10.20.193.28:0/3513141959 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ce4016830 con 0x5564ef0608e0 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 10 client.18000 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3513141959 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5564eef6f020 con 0x5564ef0608e0 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cb17fa640 1 -- 10.20.193.28:0/3513141959 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0ce4017470 con 0x5564ef0608e0 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 10 client.18000 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 10 client.18000 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 20 client.18000 populate_metadata read hostname 'trial028' 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564ef0876b0 0x5564ef089ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 4 client.18000 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.541+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3513141959 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564eef33b80 con 0x5564ef0876b0 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.542+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564ef0876b0 0x5564ef089ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.543+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564ef0876b0 0x5564ef089ac0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19afd1fb6546c133 server_cookie=be8684e3e8e5e687 in_seq=0 out_seq=0 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.543+0000 7f0cb17fa640 10 client.18000 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.543+0000 7f0cb17fa640 1 -- 10.20.193.28:0/3513141959 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5564eef33b80 con 0x5564ef0876b0 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.543+0000 7f0cb17fa640 10 client.18000 handle_command_reply: tid=0 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.543+0000 7f0cf842ee00 1 client.18000 shutdown 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.543+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3513141959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 msgr2=0x5564ef0775b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.543+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0775b0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4007ae0 tx=0x7f0ce400b040 comp rx=0 tx=0).stop 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3513141959 shutdown_connections 2026-02-20T03:24:31.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564ef0876b0 0x5564ef089ac0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0775b0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 0x5564ef0793b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3513141959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef078e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3513141959 >> 10.20.193.28:0/3513141959 conn(0x5564ef0561b0 msgr2=0x5564ef063080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cb17fa640 0 client.18000 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:31.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3513141959 shutdown_connections 2026-02-20T03:24:31.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3513141959 wait complete. 2026-02-20T03:24:31.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.544+0000 7f0cf842ee00 20 client.18000 trim_cache size 0 max 16384 2026-02-20T03:24:31.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.552+0000 7f0cf842ee00 1 Processor -- start 2026-02-20T03:24:31.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.552+0000 7f0cf842ee00 1 -- start start 2026-02-20T03:24:31.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef05edd0 0x5564ef064750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 0x5564ef064c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef0608e0 0x5564ef074e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0c94012840 con 0x5564ef05edd0 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0c94010110 con 0x5564ef0608e0 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9400df00 con 0x5564ef05ff60 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0ceeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 0x5564ef064c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef05edd0 0x5564ef064750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0ceeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 0x5564ef064c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59042/0 (socket says 10.20.193.28:59042) 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0ceeffd640 1 -- 10.20.193.28:0/3822137242 learned_addr learned my addr 10.20.193.28:0/3822137242 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0ceffff640 1 --2- 10.20.193.28:0/3822137242 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef0608e0 0x5564ef074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cef7fe640 1 -- 10.20.193.28:0/3822137242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 msgr2=0x5564ef064c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/3822137242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 0x5564ef064c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cef7fe640 1 -- 10.20.193.28:0/3822137242 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef0608e0 msgr2=0x5564ef074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/3822137242 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef0608e0 0x5564ef074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0cef7fe640 1 -- 10.20.193.28:0/3822137242 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ef070c10 con 0x5564ef05edd0 2026-02-20T03:24:31.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.553+0000 7f0ceffff640 1 --2- 10.20.193.28:0/3822137242 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef0608e0 0x5564ef074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:31.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/3822137242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef05edd0 0x5564ef064750 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x5564ef004010 tx=0x7f0cdc002c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb47aee3d16b43c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cb37fe640 1 -- 10.20.193.28:0/3822137242 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0b1040 con 0x5564ef05edd0 2026-02-20T03:24:31.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cb37fe640 1 -- 10.20.193.28:0/3822137242 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0cdc0ace80 con 0x5564ef05edd0 2026-02-20T03:24:31.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cb37fe640 1 -- 10.20.193.28:0/3822137242 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0b18a0 con 0x5564ef05edd0 2026-02-20T03:24:31.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3822137242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef05edd0 msgr2=0x5564ef064750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3822137242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef05edd0 0x5564ef064750 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x5564ef004010 tx=0x7f0cdc002c30 comp rx=0 tx=0).stop 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3822137242 shutdown_connections 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3822137242 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef0608e0 0x5564ef074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3822137242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05ff60 0x5564ef064c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/3822137242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef05edd0 0x5564ef064750 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.554+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3822137242 >> 10.20.193.28:0/3822137242 conn(0x5564ef0561b0 msgr2=0x5564ef064040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.555+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3822137242 shutdown_connections 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.555+0000 7f0cf842ee00 1 -- 10.20.193.28:0/3822137242 wait complete. 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.555+0000 7f0cf842ee00 1 -- start start 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cf842ee00 1 Processor -- start 2026-02-20T03:24:31.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef07e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 0x5564ef07e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cf842ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9400e5d0 con 0x5564ef0608e0 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9400fa40 con 0x5564ef05ff60 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cf842ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9400eca0 con 0x5564ef05edd0 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cef7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef07e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cef7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef07e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59058/0 (socket says 10.20.193.28:59058) 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cef7fe640 1 -- 10.20.193.28:0/2512992039 learned_addr learned my addr 10.20.193.28:0/2512992039 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0ceeffd640 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 0x5564ef07e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0ceffff640 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cef7fe640 1 -- 10.20.193.28:0/2512992039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 msgr2=0x5564ef07e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 0x5564ef07e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cef7fe640 1 -- 10.20.193.28:0/2512992039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 msgr2=0x5564ef0f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.556+0000 7f0cef7fe640 1 -- 10.20.193.28:0/2512992039 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564eec90ad0 con 0x5564ef05edd0 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0ceffff640 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cef7fe640 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef07e030 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0a4900 tx=0x7f0cdc0a9290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c114d9297b31459 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cb17fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cb17fa640 1 -- 10.20.193.28:0/2512992039 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0cf020 con 0x5564ef05edd0 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cb17fa640 1 -- 10.20.193.28:0/2512992039 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0cdc0b1d30 con 0x5564ef05edd0 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cf842ee00 1 -- 10.20.193.28:0/2512992039 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564eef38370 con 0x5564ef05edd0 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cf842ee00 10 client.27145 _ll_register_callbacks cb 0x7f0ce40077e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cf842ee00 1 -- 10.20.193.28:0/2512992039 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564eefbf3c0 con 0x5564ef05edd0 2026-02-20T03:24:31.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cb17fa640 1 -- 10.20.193.28:0/2512992039 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0b1030 con 0x5564ef05edd0 2026-02-20T03:24:31.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cb17fa640 1 -- 10.20.193.28:0/2512992039 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f0cdc0040c0 con 0x5564ef05edd0 2026-02-20T03:24:31.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.557+0000 7f0cb17fa640 1 -- 10.20.193.28:0/2512992039 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0cdc0b1b00 con 0x5564ef05edd0 2026-02-20T03:24:31.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.558+0000 7f0cf842ee00 10 client.27145 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:31.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.558+0000 7f0cf842ee00 1 -- 10.20.193.28:0/2512992039 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5564ef071900 con 0x5564ef05edd0 2026-02-20T03:24:31.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.558+0000 7f0cb17fa640 1 -- 10.20.193.28:0/2512992039 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0cdc0a7ae0 con 0x5564ef05edd0 2026-02-20T03:24:31.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.558+0000 7f0cf842ee00 10 client.27145 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:31.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.558+0000 7f0cf842ee00 10 client.27145 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:24:31.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.558+0000 7f0cf842ee00 20 client.27145 populate_metadata read hostname 'trial028' 2026-02-20T03:24:31.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.558+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564ef0f3c90 0x5564ef0f6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.558+0000 7f0cf842ee00 4 client.27145 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "317e3c6c", "release": true, "await": true}] 2026-02-20T03:24:31.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.558+0000 7f0cf842ee00 1 -- 10.20.193.28:0/2512992039 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "317e3c6c", "release": true, "await": true}) -- 0x7f0cdc0ace80 con 0x5564ef0f3c90 2026-02-20T03:24:31.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.559+0000 7f0ceeffd640 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564ef0f3c90 0x5564ef0f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.559+0000 7f0ceeffd640 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564ef0f3c90 0x5564ef0f6120 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2f80078c3f124cf server_cookie=3320d1ef92eaf579 in_seq=0 out_seq=0 2026-02-20T03:24:31.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.559+0000 7f0cb17fa640 10 client.27145 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:31.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cb17fa640 1 -- 10.20.193.28:0/2512992039 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f0cdc0ace80 con 0x5564ef0f3c90 2026-02-20T03:24:31.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cb17fa640 10 client.27145 handle_command_reply: tid=0 2026-02-20T03:24:31.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 client.27145 shutdown 2026-02-20T03:24:31.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 -- 10.20.193.28:0/2512992039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 msgr2=0x5564ef07e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef07e030 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0a4900 tx=0x7f0cdc0a9290 comp rx=0 tx=0).stop 2026-02-20T03:24:31.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 -- 10.20.193.28:0/2512992039 shutdown_connections 2026-02-20T03:24:31.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564ef0f3c90 0x5564ef0f6120 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564ef0608e0 0x5564ef0f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564ef05ff60 0x5564ef07e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 --2- 10.20.193.28:0/2512992039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564ef05edd0 0x5564ef07e030 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 -- 10.20.193.28:0/2512992039 >> 10.20.193.28:0/2512992039 conn(0x5564ef0561b0 msgr2=0x5564ef064860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cb17fa640 0 client.27145 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:31.568 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:24:31.568 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 29, 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 36, 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "317e3c6c": { 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "version": 36, 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:24:31.569 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 148.2, 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:31.570 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.563+0000 7f0cf842ee00 1 -- 10.20.193.28:0/2512992039 shutdown_connections 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf842ee00 1 -- 10.20.193.28:0/2512992039 wait complete. 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf842ee00 20 client.27145 trim_cache size 0 max 16384 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cc40b0e20 msgr2=0x7f0cc40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cc40b0e20 0x7f0cc40b32e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4002b20 tx=0x7f0ce4004b40 comp rx=0 tx=0).stop 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf0109220 msgr2=0x7f0cf01a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf0109220 0x7f0cf01a1560 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00e9f0 tx=0x7f0cdc00eec0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4164122999 shutdown_connections 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0cc40b0e20 0x7f0cc40b32e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0cf010eef0 0x7f0cf01a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0cf0109ba0 0x7f0cf01a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 --2- 10.20.193.28:0/4164122999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0cf0109220 0x7f0cf01a1560 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.564+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4164122999 >> 10.20.193.28:0/4164122999 conn(0x7f0cf0078600 msgr2=0x7f0cf0079eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.565+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4164122999 shutdown_connections 2026-02-20T03:24:31.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.565+0000 7f0cf4ca0640 1 -- 10.20.193.28:0/4164122999 wait complete. 2026-02-20T03:24:31.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:31 trial126 ceph-mon[38476]: pgmap v476: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2026-02-20T03:24:31.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:31 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3842564126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:31.704 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '317e3c6c', total seconds elapsed: 29.5 2026-02-20T03:24:31.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.735+0000 7f1f9b39b640 1 -- 10.20.193.28:0/1171725339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f94105350 msgr2=0x7f1f94111990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.735+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/1171725339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f94105350 0x7f1f94111990 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000b0d0 tx=0x7f1f9002f450 comp rx=0 tx=0).stop 2026-02-20T03:24:31.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.735+0000 7f1f9b39b640 1 -- 10.20.193.28:0/1171725339 shutdown_connections 2026-02-20T03:24:31.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.735+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/1171725339 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f94105350 0x7f1f94111990 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.735+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/1171725339 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f941049b0 0x7f1f94104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.735+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/1171725339 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f9410aac0 0x7f1f9410aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.735+0000 7f1f9b39b640 1 -- 10.20.193.28:0/1171725339 >> 10.20.193.28:0/1171725339 conn(0x7f1f94100690 msgr2=0x7f1f94102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.735+0000 7f1f9b39b640 1 -- 10.20.193.28:0/1171725339 shutdown_connections 2026-02-20T03:24:31.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.735+0000 7f1f9b39b640 1 -- 10.20.193.28:0/1171725339 wait complete. 2026-02-20T03:24:31.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.736+0000 7f1f9b39b640 1 Processor -- start 2026-02-20T03:24:31.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.736+0000 7f1f9b39b640 1 -- start start 2026-02-20T03:24:31.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9b39b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f941049b0 0x7f1f9419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9b39b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f94105350 0x7f1f9419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9b39b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f9410aac0 0x7f1f941a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9b39b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f94114d30 con 0x7f1f94105350 2026-02-20T03:24:31.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9b39b640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1f94114bb0 con 0x7f1f941049b0 2026-02-20T03:24:31.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9b39b640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f94114eb0 con 0x7f1f9410aac0 2026-02-20T03:24:31.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9a399640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f941049b0 0x7f1f9419d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f99b98640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f94105350 0x7f1f9419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9a399640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f941049b0 0x7f1f9419d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48904/0 (socket says 10.20.193.28:48904) 2026-02-20T03:24:31.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9a399640 1 -- 10.20.193.28:0/2860663464 learned_addr learned my addr 10.20.193.28:0/2860663464 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9ab9a640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f9410aac0 0x7f1f941a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9a399640 1 -- 10.20.193.28:0/2860663464 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f9410aac0 msgr2=0x7f1f941a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9a399640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f9410aac0 0x7f1f941a19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9a399640 1 -- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f94105350 msgr2=0x7f1f9419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9a399640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f94105350 0x7f1f9419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9a399640 1 -- 10.20.193.28:0/2860663464 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f941a20c0 con 0x7f1f941049b0 2026-02-20T03:24:31.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f99b98640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f94105350 0x7f1f9419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:31.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.737+0000 7f1f9a399640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f941049b0 0x7f1f9419d110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400ea10 tx=0x7f1f8400eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.738+0000 7f1f7b7fe640 1 -- 10.20.193.28:0/2860663464 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8400ce50 con 0x7f1f941049b0 2026-02-20T03:24:31.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.738+0000 7f1f9b39b640 1 -- 10.20.193.28:0/2860663464 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f941a23b0 con 0x7f1f941049b0 2026-02-20T03:24:31.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.738+0000 7f1f7b7fe640 1 -- 10.20.193.28:0/2860663464 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1f84004570 con 0x7f1f941049b0 2026-02-20T03:24:31.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.738+0000 7f1f7b7fe640 1 -- 10.20.193.28:0/2860663464 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84010690 con 0x7f1f941049b0 2026-02-20T03:24:31.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.738+0000 7f1f9b39b640 1 -- 10.20.193.28:0/2860663464 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f941a9c90 con 0x7f1f941049b0 2026-02-20T03:24:31.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.740+0000 7f1f9eb29e00 1 Processor -- start 2026-02-20T03:24:31.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f9eb29e00 1 -- start start 2026-02-20T03:24:31.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 0x5635ea65d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea657a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657fb0 0x5635ea663e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635ea5d7e50 con 0x5635ea657fb0 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5635ea5aa9c0 con 0x5635ea65d000 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5635ea558240 con 0x5635ea657630 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f7b7fe640 1 -- 10.20.193.28:0/2860663464 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1f84020030 con 0x7f1f941049b0 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f99b98640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657fb0 0x5635ea663e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f99b98640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657fb0 0x5635ea663e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42220/0 (socket says 10.20.193.28:42220) 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f99b98640 1 -- 10.20.193.28:0/4127628849 learned_addr learned my addr 10.20.193.28:0/4127628849 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f99b98640 1 -- 10.20.193.28:0/4127628849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 msgr2=0x5635ea657a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f99b98640 1 --2- 10.20.193.28:0/4127628849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea657a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f99b98640 1 -- 10.20.193.28:0/4127628849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 msgr2=0x5635ea65d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f99b98640 1 --2- 10.20.193.28:0/4127628849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 0x5635ea65d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f99b98640 1 -- 10.20.193.28:0/4127628849 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ea56b420 con 0x5635ea657fb0 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.741+0000 7f1f99b98640 1 --2- 10.20.193.28:0/4127628849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657fb0 0x5635ea663e30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1f88004200 tx=0x7f1f880026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc819b78500868e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f78cf3640 1 -- 10.20.193.28:0/4127628849 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88010840 con 0x5635ea657fb0 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f78cf3640 1 -- 10.20.193.28:0/4127628849 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1f88014070 con 0x5635ea657fb0 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f78cf3640 1 -- 10.20.193.28:0/4127628849 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8800fdb0 con 0x5635ea657fb0 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4127628849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657fb0 msgr2=0x5635ea663e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/4127628849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657fb0 0x5635ea663e30 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f1f88004200 tx=0x7f1f880026e0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4127628849 shutdown_connections 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/4127628849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657fb0 0x5635ea663e30 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/4127628849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea657a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/4127628849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 0x5635ea65d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4127628849 >> 10.20.193.28:0/4127628849 conn(0x5635ea61a290 msgr2=0x5635ea655d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4127628849 shutdown_connections 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.742+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4127628849 wait complete. 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.743+0000 7f1f7b7fe640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f700b0f20 0x7f1f700b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.743+0000 7f1f7b7fe640 1 -- 10.20.193.28:0/2860663464 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1f840e0b30 con 0x7f1f941049b0 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.743+0000 7f1f9ab9a640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f700b0f20 0x7f1f700b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.743+0000 7f1f9ab9a640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f700b0f20 0x7f1f700b33e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1f9002f960 tx=0x7f1f9000c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.743+0000 7f1f9eb29e00 1 -- start start 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.743+0000 7f1f9eb29e00 1 Processor -- start 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea67abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 0x5635ea67b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea679310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5635ea5a68f0 con 0x5635ea65d000 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5635ea398f50 con 0x5635ea657fb0 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5635ea679a90 con 0x5635ea657630 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9ab9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea679310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9ab9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea679310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42236/0 (socket says 10.20.193.28:42236) 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9a399640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea67abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9ab9a640 1 -- 10.20.193.28:0/2326461788 learned_addr learned my addr 10.20.193.28:0/2326461788 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f99b98640 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 0x5635ea67b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9a399640 1 -- 10.20.193.28:0/2326461788 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 msgr2=0x5635ea67b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9a399640 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 0x5635ea67b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9a399640 1 -- 10.20.193.28:0/2326461788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 msgr2=0x5635ea679310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9a399640 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea679310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.744+0000 7f1f9a399640 1 -- 10.20.193.28:0/2326461788 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ea669bc0 con 0x5635ea657630 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9a399640 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea67abd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c770 tx=0x7f1f84002ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f500822f94c7bdad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f47fff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f47fff640 1 -- 10.20.193.28:0/2326461788 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840acbc0 con 0x5635ea657630 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/2326461788 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ea37bb40 con 0x5635ea657630 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f47fff640 1 -- 10.20.193.28:0/2326461788 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1f840b1a70 con 0x5635ea657630 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f47fff640 1 -- 10.20.193.28:0/2326461788 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f840a74f0 con 0x5635ea657630 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9eb29e00 10 client.27151 _ll_register_callbacks cb 0x5635ea5e3f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/2326461788 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635ea5b81a0 con 0x5635ea657630 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f47fff640 1 -- 10.20.193.28:0/2326461788 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1f840bdae0 con 0x5635ea657630 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f47fff640 1 -- 10.20.193.28:0/2326461788 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f840bde20 con 0x5635ea657630 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9eb29e00 10 client.27151 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:31.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/2326461788 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5635ea565230 con 0x5635ea657630 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f47fff640 1 -- 10.20.193.28:0/2326461788 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f1f840a7820 con 0x5635ea657630 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9eb29e00 10 client.27151 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9eb29e00 10 client.27151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9eb29e00 20 client.27151 populate_metadata read hostname 'trial028' 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.745+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635ea689260 0x5635ea68b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.746+0000 7f1f9eb29e00 4 client.27151 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.746+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/2326461788 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635ea5b25b0 con 0x5635ea689260 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.746+0000 7f1f99b98640 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635ea689260 0x5635ea68b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.746+0000 7f1f99b98640 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635ea689260 0x5635ea68b700 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fdaf08b9e624355 server_cookie=8d6d0643abbab69f in_seq=0 out_seq=0 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.746+0000 7f1f47fff640 10 client.27151 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f47fff640 1 -- 10.20.193.28:0/2326461788 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5635ea5b25b0 con 0x5635ea689260 2026-02-20T03:24:31.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f47fff640 10 client.27151 handle_command_reply: tid=0 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 client.27151 shutdown 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/2326461788 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 msgr2=0x5635ea67abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea67abd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c770 tx=0x7f1f84002ac0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/2326461788 shutdown_connections 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635ea689260 0x5635ea68b700 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea679310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 0x5635ea67b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/2326461788 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea67abd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f47fff640 0 client.27151 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/2326461788 >> 10.20.193.28:0/2326461788 conn(0x5635ea61a290 msgr2=0x5635ea656440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/2326461788 shutdown_connections 2026-02-20T03:24:31.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.747+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/2326461788 wait complete. 2026-02-20T03:24:31.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.748+0000 7f1f9eb29e00 20 client.27151 trim_cache size 0 max 16384 2026-02-20T03:24:31.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.756+0000 7f1f9eb29e00 1 Processor -- start 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.756+0000 7f1f9eb29e00 1 -- start start 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657630 0x5635ea66e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657fb0 0x5635ea66e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 0x5635ea656520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c012670 con 0x5635ea657630 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c00ff40 con 0x5635ea65d000 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c00dd90 con 0x5635ea657fb0 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9ab9a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 0x5635ea656520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9a399640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657630 0x5635ea66e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9ab9a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 0x5635ea656520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48946/0 (socket says 10.20.193.28:48946) 2026-02-20T03:24:31.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9ab9a640 1 -- 10.20.193.28:0/4031462650 learned_addr learned my addr 10.20.193.28:0/4031462650 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f99b98640 1 --2- 10.20.193.28:0/4031462650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657fb0 0x5635ea66e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9ab9a640 1 -- 10.20.193.28:0/4031462650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657fb0 msgr2=0x5635ea66e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9ab9a640 1 --2- 10.20.193.28:0/4031462650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657fb0 0x5635ea66e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9ab9a640 1 -- 10.20.193.28:0/4031462650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657630 msgr2=0x5635ea66e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9ab9a640 1 --2- 10.20.193.28:0/4031462650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657630 0x5635ea66e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9ab9a640 1 -- 10.20.193.28:0/4031462650 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ea6699f0 con 0x5635ea65d000 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.757+0000 7f1f9ab9a640 1 --2- 10.20.193.28:0/4031462650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 0x5635ea656520 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1f90004410 tx=0x7f1f90041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536f4a8c11528ca6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f624e6640 1 -- 10.20.193.28:0/4031462650 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90053070 con 0x5635ea65d000 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f624e6640 1 -- 10.20.193.28:0/4031462650 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1f900047f0 con 0x5635ea65d000 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f624e6640 1 -- 10.20.193.28:0/4031462650 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9004e9a0 con 0x5635ea65d000 2026-02-20T03:24:31.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4031462650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 msgr2=0x5635ea656520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/4031462650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 0x5635ea656520 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1f90004410 tx=0x7f1f90041000 comp rx=0 tx=0).stop 2026-02-20T03:24:31.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4031462650 shutdown_connections 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/4031462650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea65d000 0x5635ea656520 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/4031462650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657fb0 0x5635ea66e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/4031462650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea657630 0x5635ea66e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4031462650 >> 10.20.193.28:0/4031462650 conn(0x5635ea61a290 msgr2=0x5635ea67abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4031462650 shutdown_connections 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.758+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/4031462650 wait complete. 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.759+0000 7f1f9eb29e00 1 -- start start 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.759+0000 7f1f9eb29e00 1 Processor -- start 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.759+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea680dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.759+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 0x5635ea681310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9eb29e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea67da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c00e400 con 0x5635ea65d000 2026-02-20T03:24:31.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c00f870 con 0x5635ea657fb0 2026-02-20T03:24:31.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9eb29e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c00ead0 con 0x5635ea657630 2026-02-20T03:24:31.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f99b98640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 0x5635ea681310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9ab9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea67da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9a399640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea680dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9ab9a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea67da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42258/0 (socket says 10.20.193.28:42258) 2026-02-20T03:24:31.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9ab9a640 1 -- 10.20.193.28:0/1176973908 learned_addr learned my addr 10.20.193.28:0/1176973908 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9ab9a640 1 -- 10.20.193.28:0/1176973908 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 msgr2=0x5635ea680dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9ab9a640 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea680dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9ab9a640 1 -- 10.20.193.28:0/1176973908 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 msgr2=0x5635ea681310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9ab9a640 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 0x5635ea681310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.760+0000 7f1f9ab9a640 1 -- 10.20.193.28:0/1176973908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ea289870 con 0x5635ea65d000 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f9ab9a640 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea67da90 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f1f90002fd0 tx=0x7f1f9004eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e07fb1023c91943 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f47fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f47fff640 1 -- 10.20.193.28:0/1176973908 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9005d020 con 0x5635ea65d000 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f47fff640 1 -- 10.20.193.28:0/1176973908 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1f90007b40 con 0x5635ea65d000 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/1176973908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ea54a440 con 0x5635ea65d000 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f47fff640 1 -- 10.20.193.28:0/1176973908 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f90053070 con 0x5635ea65d000 2026-02-20T03:24:31.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f9eb29e00 10 client.18021 _ll_register_callbacks cb 0x7f1f84009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/1176973908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5635ea55cb00 con 0x5635ea65d000 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f47fff640 1 -- 10.20.193.28:0/1176973908 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1f900076a0 con 0x5635ea65d000 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f47fff640 1 -- 10.20.193.28:0/1176973908 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f90068050 con 0x5635ea65d000 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f9eb29e00 10 client.18021 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.761+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/1176973908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5635ea66a6e0 con 0x5635ea65d000 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f47fff640 1 -- 10.20.193.28:0/1176973908 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f1f9004d070 con 0x5635ea65d000 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f9eb29e00 10 client.18021 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f9eb29e00 10 client.18021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f9eb29e00 20 client.18021 populate_metadata read hostname 'trial028' 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635ea6f4e60 0x5635ea6f7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:31.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f9eb29e00 4 client.18021 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:24:31.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/1176973908 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1f88014070 con 0x5635ea6f4e60 2026-02-20T03:24:31.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f9a399640 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635ea6f4e60 0x5635ea6f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:31.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f9a399640 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635ea6f4e60 0x5635ea6f7320 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=262a16ac91c57dcf server_cookie=693fbbbb097ea942 in_seq=0 out_seq=0 2026-02-20T03:24:31.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.762+0000 7f1f47fff640 10 client.18021 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:31.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f47fff640 1 -- 10.20.193.28:0/1176973908 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f1f88014070 con 0x5635ea6f4e60 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f47fff640 10 client.18021 handle_command_reply: tid=0 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f9eb29e00 1 client.18021 shutdown 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/1176973908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 msgr2=0x5635ea67da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea67da90 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f1f90002fd0 tx=0x7f1f9004eb40 comp rx=0 tx=0).stop 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/1176973908 shutdown_connections 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5635ea6f4e60 0x5635ea6f7320 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5635ea65d000 0x5635ea67da90 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5635ea657fb0 0x5635ea681310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f9eb29e00 1 --2- 10.20.193.28:0/1176973908 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5635ea657630 0x5635ea680dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/1176973908 >> 10.20.193.28:0/1176973908 conn(0x5635ea61a290 msgr2=0x5635ea66f070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.763+0000 7f1f47fff640 0 client.18021 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:31.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/1176973908 shutdown_connections 2026-02-20T03:24:31.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9eb29e00 1 -- 10.20.193.28:0/1176973908 wait complete. 2026-02-20T03:24:31.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9eb29e00 20 client.18021 trim_cache size 0 max 16384 2026-02-20T03:24:31.773 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:24:31.773 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:24:31.773 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:24:31.774 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 -- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f700b0f20 msgr2=0x7f1f700b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f700b0f20 0x7f1f700b33e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1f9002f960 tx=0x7f1f9000c000 comp rx=0 tx=0).stop 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 -- 10.20.193.28:0/2860663464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f941049b0 msgr2=0x7f1f9419d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f941049b0 0x7f1f9419d110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400ea10 tx=0x7f1f8400eee0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 -- 10.20.193.28:0/2860663464 shutdown_connections 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f700b0f20 0x7f1f700b33e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f9410aac0 0x7f1f941a19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f94105350 0x7f1f9419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 --2- 10.20.193.28:0/2860663464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f941049b0 0x7f1f9419d110 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:31.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 -- 10.20.193.28:0/2860663464 >> 10.20.193.28:0/2860663464 conn(0x7f1f94100690 msgr2=0x7f1f94100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 -- 10.20.193.28:0/2860663464 shutdown_connections 2026-02-20T03:24:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:31.764+0000 7f1f9b39b640 1 -- 10.20.193.28:0/2860663464 wait complete. 2026-02-20T03:24:31.866 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:24:31.867 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:24:32.175 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:32.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.355+0000 7ff7f66c3640 1 -- 10.20.193.28:0/82215404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 msgr2=0x7ff7f0115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:32.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.355+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/82215404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 0x7ff7f0115900 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00b0a0 tx=0x7ff7ec02f4a0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.356+0000 7ff7f66c3640 1 -- 10.20.193.28:0/82215404 shutdown_connections 2026-02-20T03:24:32.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.356+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/82215404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 0x7ff7f0115900 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.356+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/82215404 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7f0075950 0x7ff7f0075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.356+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/82215404 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7f01065d0 0x7ff7f0075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.356+0000 7ff7f66c3640 1 -- 10.20.193.28:0/82215404 >> 10.20.193.28:0/82215404 conn(0x7ff7f00fe440 msgr2=0x7ff7f0100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:32.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.356+0000 7ff7f66c3640 1 -- 10.20.193.28:0/82215404 shutdown_connections 2026-02-20T03:24:32.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.356+0000 7ff7f66c3640 1 -- 10.20.193.28:0/82215404 wait complete. 2026-02-20T03:24:32.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f66c3640 1 Processor -- start 2026-02-20T03:24:32.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f66c3640 1 -- start start 2026-02-20T03:24:32.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f66c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7f0075950 0x7ff7f01a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:32.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f66c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7f01065d0 0x7ff7f01a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:32.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f66c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 0x7ff7f01a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f66c3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0119060 con 0x7ff7f01134d0 2026-02-20T03:24:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f66c3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f0118ee0 con 0x7ff7f01065d0 2026-02-20T03:24:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f66c3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f01191e0 con 0x7ff7f0075950 2026-02-20T03:24:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f5ec2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 0x7ff7f01a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f56c1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7f0075950 0x7ff7f01a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f56c1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7f0075950 0x7ff7f01a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59134/0 (socket says 10.20.193.28:59134) 2026-02-20T03:24:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f5ec2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 0x7ff7f01a5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42286/0 (socket says 10.20.193.28:42286) 2026-02-20T03:24:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.357+0000 7ff7f56c1640 1 -- 10.20.193.28:0/2304699864 learned_addr learned my addr 10.20.193.28:0/2304699864 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7f4ec0640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7f01065d0 0x7ff7f01a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7f5ec2640 1 -- 10.20.193.28:0/2304699864 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7f0075950 msgr2=0x7ff7f01a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7f5ec2640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7f0075950 0x7ff7f01a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7f5ec2640 1 -- 10.20.193.28:0/2304699864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7f01065d0 msgr2=0x7ff7f01a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7f5ec2640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7f01065d0 0x7ff7f01a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7f5ec2640 1 -- 10.20.193.28:0/2304699864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f01a64b0 con 0x7ff7f01134d0 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7f5ec2640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 0x7ff7f01a5d30 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00c090 tx=0x7ff7ec0093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7de7fc640 1 -- 10.20.193.28:0/2304699864 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec002a60 con 0x7ff7f01134d0 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7de7fc640 1 -- 10.20.193.28:0/2304699864 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff7ec002c00 con 0x7ff7f01134d0 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7de7fc640 1 -- 10.20.193.28:0/2304699864 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec038710 con 0x7ff7f01134d0 2026-02-20T03:24:32.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f01a6740 con 0x7ff7f01134d0 2026-02-20T03:24:32.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.358+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f01adfe0 con 0x7ff7f01134d0 2026-02-20T03:24:32.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.359+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f0075d90 con 0x7ff7f01134d0 2026-02-20T03:24:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.361+0000 7ff7de7fc640 1 -- 10.20.193.28:0/2304699864 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff7ec0388b0 con 0x7ff7f01134d0 2026-02-20T03:24:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.362+0000 7ff7de7fc640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7cc0b0e20 0x7ff7cc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.362+0000 7ff7de7fc640 1 -- 10.20.193.28:0/2304699864 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff7ec105200 con 0x7ff7f01134d0 2026-02-20T03:24:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.362+0000 7ff7de7fc640 1 -- 10.20.193.28:0/2304699864 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff7ec105680 con 0x7ff7f01134d0 2026-02-20T03:24:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.363+0000 7ff7f56c1640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7cc0b0e20 0x7ff7cc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.363+0000 7ff7f56c1640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7cc0b0e20 0x7ff7cc0b32e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0005fd0 tx=0x7ff7e00074e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:32.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.473+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7f01ae240 con 0x7ff7f01134d0 2026-02-20T03:24:32.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.474+0000 7ff7de7fc640 1 -- 10.20.193.28:0/2304699864 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7ff7ec0cd660 con 0x7ff7f01134d0 2026-02-20T03:24:32.477 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:24:32.478 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.475+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7cc0b0e20 msgr2=0x7ff7cc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.475+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7cc0b0e20 0x7ff7cc0b32e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0005fd0 tx=0x7ff7e00074e0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.475+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 msgr2=0x7ff7f01a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.475+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 0x7ff7f01a5d30 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00c090 tx=0x7ff7ec0093f0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.476+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 shutdown_connections 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.476+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff7cc0b0e20 0x7ff7cc0b32e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.476+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7f01134d0 0x7ff7f01a5d30 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.476+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7f01065d0 0x7ff7f01a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.476+0000 7ff7f66c3640 1 --2- 10.20.193.28:0/2304699864 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7f0075950 0x7ff7f01a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:32.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.476+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 >> 10.20.193.28:0/2304699864 conn(0x7ff7f00fe440 msgr2=0x7ff7f0114b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:32.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.476+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 shutdown_connections 2026-02-20T03:24:32.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:32.476+0000 7ff7f66c3640 1 -- 10.20.193.28:0/2304699864 wait complete. 2026-02-20T03:24:32.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 790208 7.25 MB/sec execute 365 sec latency 27749.955 ms 2026-02-20T03:24:32.614 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:24:32.880 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.053+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1550185024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 msgr2=0x7f3e90104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.053+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1550185024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 0x7f3e90104de0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009a60 tx=0x7f3e7802f250 comp rx=0 tx=0).stop 2026-02-20T03:24:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.053+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1550185024 shutdown_connections 2026-02-20T03:24:33.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.053+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1550185024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e90105320 0x7f3e90111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.053+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1550185024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 0x7f3e90104de0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.053+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1550185024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e9010a980 0x7f3e9010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.053+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1550185024 >> 10.20.193.28:0/1550185024 conn(0x7f3e90100660 msgr2=0x7f3e90102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.053+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1550185024 shutdown_connections 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.053+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1550185024 wait complete. 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.054+0000 7f3e8ffff640 1 Processor -- start 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.054+0000 7f3e8ffff640 1 -- start start 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.054+0000 7f3e8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 0x7f3e9019d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.054+0000 7f3e8ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e90105320 0x7f3e9019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9010a980 0x7f3e901a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90114ba0 con 0x7f3e90104980 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90114a20 con 0x7f3e9010a980 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e90114d20 con 0x7f3e90105320 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 0x7f3e9019d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 0x7f3e9019d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42306/0 (socket says 10.20.193.28:42306) 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8effd640 1 -- 10.20.193.28:0/1833430559 learned_addr learned my addr 10.20.193.28:0/1833430559 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e90105320 0x7f3e9019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9010a980 0x7f3e901a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8effd640 1 -- 10.20.193.28:0/1833430559 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e90105320 msgr2=0x7f3e9019d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8effd640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e90105320 0x7f3e9019d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8effd640 1 -- 10.20.193.28:0/1833430559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9010a980 msgr2=0x7f3e901a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8effd640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9010a980 0x7f3e901a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8effd640 1 -- 10.20.193.28:0/1833430559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e901a20b0 con 0x7f3e90104980 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8effd640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 0x7f3e9019d060 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400ea30 tx=0x7f3e8400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e6ffff640 1 -- 10.20.193.28:0/1833430559 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400ce50 con 0x7f3e90104980 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e6ffff640 1 -- 10.20.193.28:0/1833430559 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e84004570 con 0x7f3e90104980 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e6ffff640 1 -- 10.20.193.28:0/1833430559 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84010690 con 0x7f3e90104980 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.055+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1833430559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e901a23a0 con 0x7f3e90104980 2026-02-20T03:24:33.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.056+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1833430559 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e901a9be0 con 0x7f3e90104980 2026-02-20T03:24:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e979f3e00 1 Processor -- start 2026-02-20T03:24:33.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e979f3e00 1 -- start start 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e6ffff640 1 -- 10.20.193.28:0/1833430559 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3e840040d0 con 0x7f3e90104980 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc47fb0 0x56285fc48390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc425e0 0x56285fc42a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc4ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56285fbc2e00 con 0x56285fc42f60 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56285fb95970 con 0x56285fc425e0 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56285fb431f0 con 0x56285fc47fb0 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e8e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc4ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e8e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc4ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42312/0 (socket says 10.20.193.28:42312) 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.059+0000 7f3e8e7fc640 1 -- 10.20.193.28:0/3450893931 learned_addr learned my addr 10.20.193.28:0/3450893931 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc47fb0 0x56285fc48390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e8effd640 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc425e0 0x56285fc42a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e8e7fc640 1 -- 10.20.193.28:0/3450893931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc47fb0 msgr2=0x56285fc48390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc47fb0 0x56285fc48390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e8e7fc640 1 -- 10.20.193.28:0/3450893931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc425e0 msgr2=0x56285fc42a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc425e0 0x56285fc42a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e8e7fc640 1 -- 10.20.193.28:0/3450893931 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56285fb563d0 con 0x56285fc42f60 2026-02-20T03:24:33.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e8effd640 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc425e0 0x56285fc42a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc4ede0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3e78037000 tx=0x7f3e78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac672ea0a2cbbd2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e577fe640 1 -- 10.20.193.28:0/3450893931 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78046070 con 0x56285fc42f60 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e577fe640 1 -- 10.20.193.28:0/3450893931 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e78033040 con 0x56285fc42f60 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e577fe640 1 -- 10.20.193.28:0/3450893931 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78004340 con 0x56285fc42f60 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e6ffff640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e600b0e20 0x7f3e600b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3450893931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 msgr2=0x56285fc4ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.060+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc4ede0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3e78037000 tx=0x7f3e78005880 comp rx=0 tx=0).stop 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e6ffff640 1 -- 10.20.193.28:0/1833430559 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3e840e0850 con 0x7f3e90104980 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3450893931 shutdown_connections 2026-02-20T03:24:33.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc4ede0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc425e0 0x56285fc42a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3450893931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc47fb0 0x56285fc48390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3450893931 >> 10.20.193.28:0/3450893931 conn(0x56285fc05240 msgr2=0x56285fc40ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e600b0e20 0x7f3e600b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3450893931 shutdown_connections 2026-02-20T03:24:33.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3450893931 wait complete. 2026-02-20T03:24:33.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.061+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e600b0e20 0x7f3e600b32e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3e800097e0 tx=0x7f3e80002c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.062+0000 7f3e979f3e00 1 -- start start 2026-02-20T03:24:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.062+0000 7f3e979f3e00 1 Processor -- start 2026-02-20T03:24:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 0x56285fc5b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc5bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 0x56285fc5cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56285fb918a0 con 0x56285fc42f60 2026-02-20T03:24:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56285f983f50 con 0x56285fc47fb0 2026-02-20T03:24:33.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56285fc5d190 con 0x56285fc425e0 2026-02-20T03:24:33.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc5bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc5bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42318/0 (socket says 10.20.193.28:42318) 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8e7fc640 1 -- 10.20.193.28:0/3375239726 learned_addr learned my addr 10.20.193.28:0/3375239726 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 0x56285fc5cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8effd640 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 0x56285fc5b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8e7fc640 1 -- 10.20.193.28:0/3375239726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 msgr2=0x56285fc5b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 0x56285fc5b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8e7fc640 1 -- 10.20.193.28:0/3375239726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 msgr2=0x56285fc5cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 0x56285fc5cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8e7fc640 1 -- 10.20.193.28:0/3375239726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56285fc549e0 con 0x56285fc42f60 2026-02-20T03:24:33.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.063+0000 7f3e8effd640 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 0x56285fc5b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc5bca0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f3e78002910 tx=0x7f3e78009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9401457f6f2485c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e54ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e54ff9640 1 -- 10.20.193.28:0/3375239726 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78051070 con 0x56285fc42f60 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e54ff9640 1 -- 10.20.193.28:0/3375239726 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e78009620 con 0x56285fc42f60 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e54ff9640 1 -- 10.20.193.28:0/3375239726 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78046040 con 0x56285fc42f60 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3375239726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56285f966b40 con 0x56285fc42f60 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e979f3e00 10 client.18039 _ll_register_callbacks cb 0x56285fbceeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e54ff9640 1 -- 10.20.193.28:0/3375239726 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3e78038770 con 0x56285fc42f60 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3375239726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56285fba3150 con 0x56285fc42f60 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e54ff9640 1 -- 10.20.193.28:0/3375239726 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3e78004250 con 0x56285fc42f60 2026-02-20T03:24:33.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e979f3e00 10 client.18039 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.064+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3375239726 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56285fb501e0 con 0x56285fc42f60 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.065+0000 7f3e54ff9640 1 -- 10.20.193.28:0/3375239726 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3e78049030 con 0x56285fc42f60 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.065+0000 7f3e979f3e00 10 client.18039 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.065+0000 7f3e979f3e00 10 client.18039 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.065+0000 7f3e979f3e00 20 client.18039 populate_metadata read hostname 'trial028' 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.065+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56285fc6b210 0x56285fc6d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.065+0000 7f3e979f3e00 4 client.18039 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.065+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3375239726 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56285fb9d560 con 0x56285fc6b210 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.065+0000 7f3e8effd640 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56285fc6b210 0x56285fc6d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.066+0000 7f3e8effd640 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56285fc6b210 0x56285fc6d600 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8140a3f570becce server_cookie=a176b610eb7dc514 in_seq=0 out_seq=0 2026-02-20T03:24:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.066+0000 7f3e54ff9640 10 client.18039 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:24:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.066+0000 7f3e54ff9640 1 -- 10.20.193.28:0/3375239726 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56285fb9d560 con 0x56285fc6b210 2026-02-20T03:24:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.066+0000 7f3e54ff9640 10 client.18039 handle_command_reply: tid=0 2026-02-20T03:24:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 client.18039 shutdown 2026-02-20T03:24:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3375239726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 msgr2=0x56285fc5bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc5bca0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f3e78002910 tx=0x7f3e78009340 comp rx=0 tx=0).stop 2026-02-20T03:24:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3375239726 shutdown_connections 2026-02-20T03:24:33.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 0x56285fc5cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56285fc6b210 0x56285fc6d600 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc42f60 0x56285fc5bca0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/3375239726 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 0x56285fc5b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3375239726 >> 10.20.193.28:0/3375239726 conn(0x56285fc05240 msgr2=0x56285fc413f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e54ff9640 0 client.18039 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:24:33.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3375239726 shutdown_connections 2026-02-20T03:24:33.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 1 -- 10.20.193.28:0/3375239726 wait complete. 2026-02-20T03:24:33.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.067+0000 7f3e979f3e00 20 client.18039 trim_cache size 0 max 16384 2026-02-20T03:24:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e979f3e00 1 Processor -- start 2026-02-20T03:24:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e979f3e00 1 -- start start 2026-02-20T03:24:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 0x56285fc3ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc42f60 0x56285fc414d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc47fb0 0x56285fc41a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e340127c0 con 0x56285fc47fb0 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e34010090 con 0x56285fc42f60 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3400dee0 con 0x56285fc425e0 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc47fb0 0x56285fc41a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc47fb0 0x56285fc41a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42324/0 (socket says 10.20.193.28:42324) 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/1493481092 learned_addr learned my addr 10.20.193.28:0/1493481092 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/1493481092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc42f60 0x56285fc414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8effd640 1 --2- 10.20.193.28:0/1493481092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 0x56285fc3ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/1493481092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 msgr2=0x56285fc3ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/1493481092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 0x56285fc3ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/1493481092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc42f60 msgr2=0x56285fc414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/1493481092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc42f60 0x56285fc414d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.074+0000 7f3e8f7fe640 1 -- 10.20.193.28:0/1493481092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56285fc54810 con 0x56285fc47fb0 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/1493481092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc47fb0 0x56285fc41a10 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3e80002c50 tx=0x7f3e80014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fa3bb37ce47055 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e56ffd640 1 -- 10.20.193.28:0/1493481092 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8001d030 con 0x56285fc47fb0 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e56ffd640 1 -- 10.20.193.28:0/1493481092 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e80028070 con 0x56285fc47fb0 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e56ffd640 1 -- 10.20.193.28:0/1493481092 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e800238c0 con 0x56285fc47fb0 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e979f3e00 1 -- 10.20.193.28:0/1493481092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc47fb0 msgr2=0x56285fc41a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/1493481092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc47fb0 0x56285fc41a10 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3e80002c50 tx=0x7f3e80014000 comp rx=0 tx=0).stop 2026-02-20T03:24:33.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e979f3e00 1 -- 10.20.193.28:0/1493481092 shutdown_connections 2026-02-20T03:24:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/1493481092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc47fb0 0x56285fc41a10 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/1493481092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc42f60 0x56285fc414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/1493481092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc425e0 0x56285fc3ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e979f3e00 1 -- 10.20.193.28:0/1493481092 >> 10.20.193.28:0/1493481092 conn(0x56285fc05240 msgr2=0x56285fc6d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e979f3e00 1 -- 10.20.193.28:0/1493481092 shutdown_connections 2026-02-20T03:24:33.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.075+0000 7f3e979f3e00 1 -- 10.20.193.28:0/1493481092 wait complete. 2026-02-20T03:24:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.076+0000 7f3e979f3e00 1 -- start start 2026-02-20T03:24:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.076+0000 7f3e979f3e00 1 Processor -- start 2026-02-20T03:24:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.076+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc425e0 0x56285fc63140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.076+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc42f60 0x56285fc63680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.076+0000 7f3e979f3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 0x56285fc616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.076+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3400e550 con 0x56285fc425e0 2026-02-20T03:24:33.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.076+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3400f9c0 con 0x56285fc47fb0 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.076+0000 7f3e979f3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3400ec20 con 0x56285fc42f60 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc425e0 0x56285fc63140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc425e0 0x56285fc63140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42340/0 (socket says 10.20.193.28:42340) 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8effd640 1 -- 10.20.193.28:0/2580501007 learned_addr learned my addr 10.20.193.28:0/2580501007 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8f7fe640 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 0x56285fc616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc42f60 0x56285fc63680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8effd640 1 -- 10.20.193.28:0/2580501007 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc42f60 msgr2=0x56285fc63680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8effd640 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc42f60 0x56285fc63680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8effd640 1 -- 10.20.193.28:0/2580501007 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 msgr2=0x56285fc616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8effd640 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 0x56285fc616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8effd640 1 -- 10.20.193.28:0/2580501007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56285f874870 con 0x56285fc425e0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e8effd640 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc425e0 0x56285fc63140 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3e840a55b0 tx=0x7f3e840a4320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c474cf9c904b7c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.077+0000 7f3e54ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e54ff9640 1 -- 10.20.193.28:0/2580501007 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840a8c90 con 0x56285fc425e0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e54ff9640 1 -- 10.20.193.28:0/2580501007 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e840ac940 con 0x56285fc425e0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e54ff9640 1 -- 10.20.193.28:0/2580501007 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840adad0 con 0x56285fc425e0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 1 -- 10.20.193.28:0/2580501007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56285fb353f0 con 0x56285fc425e0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e54ff9640 1 -- 10.20.193.28:0/2580501007 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f3e840adc70 con 0x56285fc425e0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e54ff9640 10 client.18045 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 10 client.18045 _ll_register_callbacks cb 0x7f3e78044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 1 -- 10.20.193.28:0/2580501007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e80028070 con 0x56285fc425e0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e54ff9640 1 -- 10.20.193.28:0/2580501007 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3e840c2060 con 0x56285fc425e0 2026-02-20T03:24:33.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 10 client.18045 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 1 -- 10.20.193.28:0/2580501007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56285fc55500 con 0x56285fc425e0 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e54ff9640 1 -- 10.20.193.28:0/2580501007 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3e84090040 con 0x56285fc425e0 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 10 client.18045 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 10 client.18045 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 20 client.18045 populate_metadata read hostname 'trial028' 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56285fcd6d90 0x56285fcd9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 4 client.18045 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.078+0000 7f3e979f3e00 1 -- 10.20.193.28:0/2580501007 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56285fb9d560 con 0x56285fcd6d90 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.079+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56285fcd6d90 0x56285fcd9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e8e7fc640 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56285fcd6d90 0x56285fcd9250 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eb8b977504de6a91 server_cookie=a62813a309a4cdbe in_seq=0 out_seq=0 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e54ff9640 10 client.18045 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:24:33.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e54ff9640 1 -- 10.20.193.28:0/2580501007 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56285fb9d560 con 0x56285fcd6d90 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e54ff9640 10 client.18045 handle_command_reply: tid=0 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 client.18045 shutdown 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 -- 10.20.193.28:0/2580501007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc425e0 msgr2=0x56285fc63140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc425e0 0x56285fc63140 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3e840a55b0 tx=0x7f3e840a4320 comp rx=0 tx=0).stop 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 -- 10.20.193.28:0/2580501007 shutdown_connections 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56285fc47fb0 0x56285fc616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56285fc42f60 0x56285fc63680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56285fcd6d90 0x56285fcd9250 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 --2- 10.20.193.28:0/2580501007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56285fc425e0 0x56285fc63140 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 -- 10.20.193.28:0/2580501007 >> 10.20.193.28:0/2580501007 conn(0x56285fc05240 msgr2=0x56285fc6d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e54ff9640 0 client.18045 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:24:33.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 -- 10.20.193.28:0/2580501007 shutdown_connections 2026-02-20T03:24:33.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.080+0000 7f3e979f3e00 1 -- 10.20.193.28:0/2580501007 wait complete. 2026-02-20T03:24:33.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e979f3e00 20 client.18045 trim_cache size 0 max 16384 2026-02-20T03:24:33.090 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:24:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e600b0e20 msgr2=0x7f3e600b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e600b0e20 0x7f3e600b32e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3e800097e0 tx=0x7f3e80002c80 comp rx=0 tx=0).stop 2026-02-20T03:24:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 msgr2=0x7f3e9019d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 0x7f3e9019d060 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400ea30 tx=0x7f3e8400ef00 comp rx=0 tx=0).stop 2026-02-20T03:24:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1833430559 shutdown_connections 2026-02-20T03:24:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e600b0e20 0x7f3e600b32e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9010a980 0x7f3e901a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e90105320 0x7f3e9019d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 --2- 10.20.193.28:0/1833430559 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e90104980 0x7f3e9019d060 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1833430559 >> 10.20.193.28:0/1833430559 conn(0x7f3e90100660 msgr2=0x7f3e90100f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1833430559 shutdown_connections 2026-02-20T03:24:33.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.081+0000 7f3e8ffff640 1 -- 10.20.193.28:0/1833430559 wait complete. 2026-02-20T03:24:33.184 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:24:33.451 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:33 trial177 ceph-mon[43181]: pgmap v477: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2026-02-20T03:24:33.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:33 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2304699864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:33.495 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:33 trial028 ceph-mon[38552]: pgmap v477: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2026-02-20T03:24:33.495 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:33 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2304699864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:33.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 793331 7.29 MB/sec execute 366 sec latency 8.010 ms 2026-02-20T03:24:33.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:33 trial126 ceph-mon[38476]: pgmap v477: 129 pgs: 129 active+clean; 126 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 5.1 KiB/s wr, 9 op/s 2026-02-20T03:24:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:33 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2304699864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:24:33.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.628+0000 7f2bea0f7640 1 -- 10.20.193.28:0/2591910481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be4104980 msgr2=0x7f2be4104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.628+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/2591910481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be4104980 0x7f2be4104de0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009990 tx=0x7f2bd802f170 comp rx=0 tx=0).stop 2026-02-20T03:24:33.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.628+0000 7f2bea0f7640 1 -- 10.20.193.28:0/2591910481 shutdown_connections 2026-02-20T03:24:33.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.628+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/2591910481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2be4105320 0x7f2be4111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.628+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/2591910481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be4104980 0x7f2be4104de0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.628+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/2591910481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2be410a980 0x7f2be410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.628+0000 7f2bea0f7640 1 -- 10.20.193.28:0/2591910481 >> 10.20.193.28:0/2591910481 conn(0x7f2be4100680 msgr2=0x7f2be4102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.628+0000 7f2bea0f7640 1 -- 10.20.193.28:0/2591910481 shutdown_connections 2026-02-20T03:24:33.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.628+0000 7f2bea0f7640 1 -- 10.20.193.28:0/2591910481 wait complete. 2026-02-20T03:24:33.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2bea0f7640 1 Processor -- start 2026-02-20T03:24:33.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2bea0f7640 1 -- start start 2026-02-20T03:24:33.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2bea0f7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2be4104980 0x7f2be4077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2bea0f7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2be4105320 0x7f2be4077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2bea0f7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be410a980 0x7f2be4078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2bea0f7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2be4114bb0 con 0x7f2be410a980 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2bea0f7640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2be4114a30 con 0x7f2be4105320 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2bea0f7640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2be4114d30 con 0x7f2be4104980 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2be98f6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be410a980 0x7f2be4078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2be98f6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be410a980 0x7f2be4078080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42362/0 (socket says 10.20.193.28:42362) 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2be98f6640 1 -- 10.20.193.28:0/1112856171 learned_addr learned my addr 10.20.193.28:0/1112856171 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.629+0000 7f2be90f5640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2be4104980 0x7f2be4077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2be88f4640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2be4105320 0x7f2be4077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2be98f6640 1 -- 10.20.193.28:0/1112856171 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2be4104980 msgr2=0x7f2be4077600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2be98f6640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2be4104980 0x7f2be4077600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2be98f6640 1 -- 10.20.193.28:0/1112856171 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2be4105320 msgr2=0x7f2be4077b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2be98f6640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2be4105320 0x7f2be4077b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2be98f6640 1 -- 10.20.193.28:0/1112856171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be419ce90 con 0x7f2be410a980 2026-02-20T03:24:33.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2be98f6640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be410a980 0x7f2be4078080 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2be000c140 tx=0x7f2be000c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2bd27fc640 1 -- 10.20.193.28:0/1112856171 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0019070 con 0x7f2be410a980 2026-02-20T03:24:33.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2bd27fc640 1 -- 10.20.193.28:0/1112856171 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2be00092d0 con 0x7f2be410a980 2026-02-20T03:24:33.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2bd27fc640 1 -- 10.20.193.28:0/1112856171 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be00075c0 con 0x7f2be410a980 2026-02-20T03:24:33.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.630+0000 7f2bea0f7640 1 -- 10.20.193.28:0/1112856171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be419d120 con 0x7f2be410a980 2026-02-20T03:24:33.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.631+0000 7f2bea0f7640 1 -- 10.20.193.28:0/1112856171 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be419d5e0 con 0x7f2be410a980 2026-02-20T03:24:33.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.634+0000 7f2bd27fc640 1 -- 10.20.193.28:0/1112856171 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2be0007760 con 0x7f2be410a980 2026-02-20T03:24:33.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.635+0000 7f2bd27fc640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bc00b0e20 0x7f2bc00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2bd27fc640 1 -- 10.20.193.28:0/1112856171 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2be00e02b0 con 0x7f2be410a980 2026-02-20T03:24:33.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2be90f5640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bc00b0e20 0x7f2bc00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2bed885e00 1 Processor -- start 2026-02-20T03:24:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2be90f5640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bc00b0e20 0x7f2bc00b32e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4007bc0 tx=0x7f2bd40073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2bed885e00 1 -- start start 2026-02-20T03:24:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbd1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcb5e0 0x55867cbcba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbd7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2bed885e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55867cb4be00 con 0x55867cbd0fb0 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2bed885e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55867cb1e970 con 0x55867cbcbf60 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.636+0000 7f2bed885e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55867cacc1f0 con 0x55867cbcb5e0 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be90f5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbd1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be90f5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbd1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42364/0 (socket says 10.20.193.28:42364) 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be90f5640 1 -- 10.20.193.28:0/534713627 learned_addr learned my addr 10.20.193.28:0/534713627 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be98f6640 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbd7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be88f4640 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcb5e0 0x55867cbcba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be90f5640 1 -- 10.20.193.28:0/534713627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcb5e0 msgr2=0x55867cbcba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be90f5640 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcb5e0 0x55867cbcba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be90f5640 1 -- 10.20.193.28:0/534713627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 msgr2=0x55867cbd7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be90f5640 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbd7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be90f5640 1 -- 10.20.193.28:0/534713627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867cadf3d0 con 0x55867cbd0fb0 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be88f4640 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcb5e0 0x55867cbcba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2be90f5640 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbd1390 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4011440 tx=0x7f2bd4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7b6b6f23a9eb42 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2bb1ce5640 1 -- 10.20.193.28:0/534713627 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4011d90 con 0x55867cbd0fb0 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2bb1ce5640 1 -- 10.20.193.28:0/534713627 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bd4021030 con 0x55867cbd0fb0 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2bb1ce5640 1 -- 10.20.193.28:0/534713627 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd401d790 con 0x55867cbd0fb0 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2bed885e00 1 -- 10.20.193.28:0/534713627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 msgr2=0x55867cbd1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.637+0000 7f2bed885e00 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbd1390 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4011440 tx=0x7f2bd4013000 comp rx=0 tx=0).stop 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.638+0000 7f2bed885e00 1 -- 10.20.193.28:0/534713627 shutdown_connections 2026-02-20T03:24:33.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.638+0000 7f2bed885e00 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbd7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.638+0000 7f2bed885e00 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcb5e0 0x55867cbcba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.638+0000 7f2bed885e00 1 --2- 10.20.193.28:0/534713627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbd1390 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.638+0000 7f2bed885e00 1 -- 10.20.193.28:0/534713627 >> 10.20.193.28:0/534713627 conn(0x55867cb8e240 msgr2=0x55867cbc9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.638+0000 7f2bed885e00 1 -- 10.20.193.28:0/534713627 shutdown_connections 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.638+0000 7f2bed885e00 1 -- 10.20.193.28:0/534713627 wait complete. 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2bed885e00 1 -- start start 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2bed885e00 1 Processor -- start 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcb5e0 0x55867cbe45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 0x55867cbe4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbe8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2bed885e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55867cb1a8a0 con 0x55867cbd0fb0 2026-02-20T03:24:33.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2bed885e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55867c90cf50 con 0x55867cbcb5e0 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2bed885e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55867cbe9370 con 0x55867cbcbf60 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2be98f6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbe8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2be98f6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbe8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42376/0 (socket says 10.20.193.28:42376) 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.639+0000 7f2be98f6640 1 -- 10.20.193.28:0/2294642035 learned_addr learned my addr 10.20.193.28:0/2294642035 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2be88f4640 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 0x55867cbe4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2be98f6640 1 -- 10.20.193.28:0/2294642035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 msgr2=0x55867cbe4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2be98f6640 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 0x55867cbe4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2be98f6640 1 -- 10.20.193.28:0/2294642035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcb5e0 msgr2=0x55867cbe45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2be98f6640 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcb5e0 0x55867cbe45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2be98f6640 1 -- 10.20.193.28:0/2294642035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867cbdda80 con 0x55867cbd0fb0 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2be98f6640 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbe8e30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f2be00a7c90 tx=0x7f2be00a7580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5082b41927f23368 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2b9effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2b9effd640 1 -- 10.20.193.28:0/2294642035 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be00ac340 con 0x55867cbd0fb0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2b9effd640 1 -- 10.20.193.28:0/2294642035 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2be00b11f0 con 0x55867cbd0fb0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2b9effd640 1 -- 10.20.193.28:0/2294642035 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be00a3910 con 0x55867cbd0fb0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2bed885e00 1 -- 10.20.193.28:0/2294642035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55867c8efb40 con 0x55867cbd0fb0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2b9effd640 1 -- 10.20.193.28:0/2294642035 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2be00a6a10 con 0x55867cbd0fb0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2b9effd640 10 client.18057 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2bed885e00 10 client.18057 _ll_register_callbacks cb 0x55867cb57eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.640+0000 7f2bed885e00 1 -- 10.20.193.28:0/2294642035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55867cb2c150 con 0x55867cbd0fb0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2b9effd640 1 -- 10.20.193.28:0/2294642035 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2be0004110 con 0x55867cbd0fb0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2bed885e00 10 client.18057 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2bed885e00 1 -- 10.20.193.28:0/2294642035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55867cad91e0 con 0x55867cbd0fb0 2026-02-20T03:24:33.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2b9effd640 1 -- 10.20.193.28:0/2294642035 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2be00a6c10 con 0x55867cbd0fb0 2026-02-20T03:24:33.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2bed885e00 10 client.18057 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:33.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2bed885e00 10 client.18057 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:24:33.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2bed885e00 20 client.18057 populate_metadata read hostname 'trial028' 2026-02-20T03:24:33.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2bed885e00 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55867cbf4660 0x55867cbf6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2bed885e00 4 client.18057 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:33.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2bed885e00 1 -- 10.20.193.28:0/2294642035 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55867cb26560 con 0x55867cbf4660 2026-02-20T03:24:33.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.641+0000 7f2be90f5640 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55867cbf4660 0x55867cbf6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.642+0000 7f2b9effd640 10 client.18057 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:24:33.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.642+0000 7f2be90f5640 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55867cbf4660 0x55867cbf6a70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ecb3677639d4648 server_cookie=d77f9d62187011dd in_seq=0 out_seq=0 2026-02-20T03:24:33.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.643+0000 7f2b9effd640 1 -- 10.20.193.28:0/2294642035 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55867cb26560 con 0x55867cbf4660 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.643+0000 7f2b9effd640 10 client.18057 handle_command_reply: tid=0 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 client.18057 shutdown 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 -- 10.20.193.28:0/2294642035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 msgr2=0x55867cbe8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbe8e30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f2be00a7c90 tx=0x7f2be00a7580 comp rx=0 tx=0).stop 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 -- 10.20.193.28:0/2294642035 shutdown_connections 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55867cbf4660 0x55867cbf6a70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbd0fb0 0x55867cbe8e30 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 0x55867cbe4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 --2- 10.20.193.28:0/2294642035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcb5e0 0x55867cbe45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2b9effd640 0 client.18057 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 -- 10.20.193.28:0/2294642035 >> 10.20.193.28:0/2294642035 conn(0x55867cb8e240 msgr2=0x55867cbca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 -- 10.20.193.28:0/2294642035 shutdown_connections 2026-02-20T03:24:33.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 1 -- 10.20.193.28:0/2294642035 wait complete. 2026-02-20T03:24:33.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.644+0000 7f2bed885e00 20 client.18057 trim_cache size 0 max 16384 2026-02-20T03:24:33.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.651+0000 7f2bed885e00 1 Processor -- start 2026-02-20T03:24:33.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.651+0000 7f2bed885e00 1 -- start start 2026-02-20T03:24:33.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.651+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbe1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.651+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbe1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbd0fb0 0x55867cbfc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2bed885e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90012600 con 0x55867cbcb5e0 2026-02-20T03:24:33.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2bed885e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9000fed0 con 0x55867cbcbf60 2026-02-20T03:24:33.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2bed885e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9000dd20 con 0x55867cbd0fb0 2026-02-20T03:24:33.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be88f4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbe1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be88f4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbe1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49072/0 (socket says 10.20.193.28:49072) 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be88f4640 1 -- 10.20.193.28:0/1909552035 learned_addr learned my addr 10.20.193.28:0/1909552035 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be98f6640 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbd0fb0 0x55867cbfc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be90f5640 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbe1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be88f4640 1 -- 10.20.193.28:0/1909552035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbd0fb0 msgr2=0x55867cbfc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be88f4640 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbd0fb0 0x55867cbfc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be88f4640 1 -- 10.20.193.28:0/1909552035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 msgr2=0x55867cbe1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be88f4640 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbe1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be88f4640 1 -- 10.20.193.28:0/1909552035 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867cbdd8b0 con 0x55867cbcbf60 2026-02-20T03:24:33.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.652+0000 7f2be90f5640 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbe1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:33.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2be88f4640 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbe1c50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8002410 tx=0x7f2bd8009640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5323e00fe4085081 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bb14e4640 1 -- 10.20.193.28:0/1909552035 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd802fb90 con 0x55867cbcbf60 2026-02-20T03:24:33.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bb14e4640 1 -- 10.20.193.28:0/1909552035 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bd8033040 con 0x55867cbcbf60 2026-02-20T03:24:33.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bed885e00 1 -- 10.20.193.28:0/1909552035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 msgr2=0x55867cbe1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbe1c50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8002410 tx=0x7f2bd8009640 comp rx=0 tx=0).stop 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bed885e00 1 -- 10.20.193.28:0/1909552035 shutdown_connections 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbd0fb0 0x55867cbfc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbcbf60 0x55867cbe1c50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1909552035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbe1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bed885e00 1 -- 10.20.193.28:0/1909552035 >> 10.20.193.28:0/1909552035 conn(0x55867cb8e240 msgr2=0x55867cbe45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.653+0000 7f2bed885e00 1 -- 10.20.193.28:0/1909552035 shutdown_connections 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.654+0000 7f2bed885e00 1 -- 10.20.193.28:0/1909552035 wait complete. 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.654+0000 7f2bed885e00 1 -- start start 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.654+0000 7f2bed885e00 1 Processor -- start 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.654+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbf0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.654+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 0x55867cbece30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.654+0000 7f2bed885e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbd0fb0 0x55867cbed370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.654+0000 7f2bed885e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9000e390 con 0x55867cbcb5e0 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.654+0000 7f2bed885e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9000f800 con 0x55867cbd0fb0 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.654+0000 7f2bed885e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9000ea60 con 0x55867cbcbf60 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be98f6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbd0fb0 0x55867cbed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be98f6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbd0fb0 0x55867cbed370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49074/0 (socket says 10.20.193.28:49074) 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be98f6640 1 -- 10.20.193.28:0/1400943617 learned_addr learned my addr 10.20.193.28:0/1400943617 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be90f5640 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbf0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be88f4640 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 0x55867cbece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be90f5640 1 -- 10.20.193.28:0/1400943617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 msgr2=0x55867cbece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be90f5640 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 0x55867cbece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be90f5640 1 -- 10.20.193.28:0/1400943617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbd0fb0 msgr2=0x55867cbed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:33.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be90f5640 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbd0fb0 0x55867cbed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be90f5640 1 -- 10.20.193.28:0/1400943617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55867c7fd870 con 0x55867cbcb5e0 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be98f6640 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbd0fb0 0x55867cbed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2be90f5640 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbf0b60 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40079a0 tx=0x7f2bd4011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770253259739fba8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2b9effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2b9effd640 1 -- 10.20.193.28:0/1400943617 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd401c410 con 0x55867cbcb5e0 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2b9effd640 1 -- 10.20.193.28:0/1400943617 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bd4034070 con 0x55867cbcb5e0 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2b9effd640 1 -- 10.20.193.28:0/1400943617 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4026ae0 con 0x55867cbcb5e0 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.655+0000 7f2bed885e00 1 -- 10.20.193.28:0/1400943617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55867cabe3f0 con 0x55867cbcb5e0 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2b9effd640 1 -- 10.20.193.28:0/1400943617 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2bd4026c80 con 0x55867cbcb5e0 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 10 client.18063 _ll_register_callbacks cb 0x7f2be00a7690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:33.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 1 -- 10.20.193.28:0/1400943617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bd4021030 con 0x55867cbcb5e0 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2b9effd640 1 -- 10.20.193.28:0/1400943617 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2bd403e060 con 0x55867cbcb5e0 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 10 client.18063 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 1 -- 10.20.193.28:0/1400943617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55867cbde5a0 con 0x55867cbcb5e0 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2b9effd640 1 -- 10.20.193.28:0/1400943617 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2bd401c5b0 con 0x55867cbcb5e0 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 10 client.18063 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 10 client.18063 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 20 client.18063 populate_metadata read hostname 'trial028' 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55867cc60230 0x55867cc626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 4 client.18063 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2bed885e00 1 -- 10.20.193.28:0/1400943617 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55867caef7c0 con 0x55867cc60230 2026-02-20T03:24:33.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.656+0000 7f2be88f4640 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55867cc60230 0x55867cc626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:33.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2be88f4640 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55867cc60230 0x55867cc626f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bfa53cd9f3e9f6c9 server_cookie=f06391c9f0664b1b in_seq=0 out_seq=0 2026-02-20T03:24:33.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2b9effd640 10 client.18063 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:24:33.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2b9effd640 1 -- 10.20.193.28:0/1400943617 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55867caef7c0 con 0x55867cc60230 2026-02-20T03:24:33.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2b9effd640 10 client.18063 handle_command_reply: tid=0 2026-02-20T03:24:33.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 client.18063 shutdown 2026-02-20T03:24:33.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 -- 10.20.193.28:0/1400943617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 msgr2=0x55867cbf0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbf0b60 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40079a0 tx=0x7f2bd4011d00 comp rx=0 tx=0).stop 2026-02-20T03:24:33.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 -- 10.20.193.28:0/1400943617 shutdown_connections 2026-02-20T03:24:33.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55867cc60230 0x55867cc626f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55867cbd0fb0 0x55867cbed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55867cbcbf60 0x55867cbece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 --2- 10.20.193.28:0/1400943617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55867cbcb5e0 0x55867cbf0b60 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 -- 10.20.193.28:0/1400943617 >> 10.20.193.28:0/1400943617 conn(0x55867cb8e240 msgr2=0x55867cbe5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2b9effd640 0 client.18063 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:24:33.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 -- 10.20.193.28:0/1400943617 shutdown_connections 2026-02-20T03:24:33.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.657+0000 7f2bed885e00 1 -- 10.20.193.28:0/1400943617 wait complete. 2026-02-20T03:24:33.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bed885e00 20 client.18063 trim_cache size 0 max 16384 2026-02-20T03:24:33.667 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:24:33.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 -- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bc00b0e20 msgr2=0x7f2bc00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bc00b0e20 0x7f2bc00b32e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4007bc0 tx=0x7f2bd40073d0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 -- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be410a980 msgr2=0x7f2be4078080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:33.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be410a980 0x7f2be4078080 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2be000c140 tx=0x7f2be000c610 comp rx=0 tx=0).stop 2026-02-20T03:24:33.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 -- 10.20.193.28:0/1112856171 shutdown_connections 2026-02-20T03:24:33.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2bc00b0e20 0x7f2bc00b32e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2be410a980 0x7f2be4078080 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2be4105320 0x7f2be4077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 --2- 10.20.193.28:0/1112856171 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2be4104980 0x7f2be4077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:33.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 -- 10.20.193.28:0/1112856171 >> 10.20.193.28:0/1112856171 conn(0x7f2be4100680 msgr2=0x7f2be4100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:33.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 -- 10.20.193.28:0/1112856171 shutdown_connections 2026-02-20T03:24:33.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:33.658+0000 7f2bea0f7640 1 -- 10.20.193.28:0/1112856171 wait complete. 2026-02-20T03:24:33.838 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:24:34.130 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:34.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.306+0000 7fd38b490640 1 -- 10.20.193.28:0/3619001792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd384100a20 msgr2=0x7fd384100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:34.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.306+0000 7fd38b490640 1 --2- 10.20.193.28:0/3619001792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd384100a20 0x7fd384100e00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fd374009a60 tx=0x7fd37402f260 comp rx=0 tx=0).stop 2026-02-20T03:24:34.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.306+0000 7fd38b490640 1 -- 10.20.193.28:0/3619001792 shutdown_connections 2026-02-20T03:24:34.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.306+0000 7fd38b490640 1 --2- 10.20.193.28:0/3619001792 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd384108c80 0x7fd38410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.306+0000 7fd38b490640 1 --2- 10.20.193.28:0/3619001792 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd3841013d0 0x7fd384108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.306+0000 7fd38b490640 1 --2- 10.20.193.28:0/3619001792 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd384100a20 0x7fd384100e00 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.306+0000 7fd38b490640 1 -- 10.20.193.28:0/3619001792 >> 10.20.193.28:0/3619001792 conn(0x7fd3840fc5f0 msgr2=0x7fd3840fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:34.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.306+0000 7fd38b490640 1 -- 10.20.193.28:0/3619001792 shutdown_connections 2026-02-20T03:24:34.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.306+0000 7fd38b490640 1 -- 10.20.193.28:0/3619001792 wait complete. 2026-02-20T03:24:34.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.307+0000 7fd38b490640 1 Processor -- start 2026-02-20T03:24:34.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.307+0000 7fd38b490640 1 -- start start 2026-02-20T03:24:34.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38b490640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd384100a20 0x7fd3841a2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38b490640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3841013d0 0x7fd3841a32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38b490640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd384108c80 0x7fd38419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38b490640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd384102fd0 con 0x7fd3841013d0 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38b490640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd384102e50 con 0x7fd384100a20 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38b490640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd384103150 con 0x7fd384108c80 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38a48e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd384100a20 0x7fd3841a2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38a48e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd384100a20 0x7fd3841a2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49092/0 (socket says 10.20.193.28:49092) 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38a48e640 1 -- 10.20.193.28:0/1721737836 learned_addr learned my addr 10.20.193.28:0/1721737836 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd389c8d640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3841013d0 0x7fd3841a32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd384108c80 0x7fd38419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38a48e640 1 -- 10.20.193.28:0/1721737836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd384108c80 msgr2=0x7fd38419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38a48e640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd384108c80 0x7fd38419cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.308+0000 7fd38a48e640 1 -- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3841013d0 msgr2=0x7fd3841a32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.309+0000 7fd38a48e640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3841013d0 0x7fd3841a32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.309+0000 7fd38a48e640 1 -- 10.20.193.28:0/1721737836 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38419d750 con 0x7fd384100a20 2026-02-20T03:24:34.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.309+0000 7fd389c8d640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3841013d0 0x7fd3841a32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:34.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.309+0000 7fd38a48e640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd384100a20 0x7fd3841a2db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd374002410 tx=0x7fd374004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:34.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.309+0000 7fd36b7fe640 1 -- 10.20.193.28:0/1721737836 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374038770 con 0x7fd384100a20 2026-02-20T03:24:34.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.309+0000 7fd36b7fe640 1 -- 10.20.193.28:0/1721737836 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd374038db0 con 0x7fd384100a20 2026-02-20T03:24:34.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.309+0000 7fd36b7fe640 1 -- 10.20.193.28:0/1721737836 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374041e60 con 0x7fd384100a20 2026-02-20T03:24:34.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.309+0000 7fd38b490640 1 -- 10.20.193.28:0/1721737836 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38419d9e0 con 0x7fd384100a20 2026-02-20T03:24:34.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.309+0000 7fd38b490640 1 -- 10.20.193.28:0/1721737836 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3841a9b60 con 0x7fd384100a20 2026-02-20T03:24:34.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.312+0000 7fd38ec1ee00 1 Processor -- start 2026-02-20T03:24:34.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.312+0000 7fd38ec1ee00 1 -- start start 2026-02-20T03:24:34.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.312+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe41390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.312+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe3ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe47de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a6ebdbbe00 con 0x55a6ebe3bf60 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a6ebd8e970 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a6ebd3c1f0 con 0x55a6ebe40fb0 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd389c8d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe47de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd38ac8f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe41390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd389c8d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe47de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42400/0 (socket says 10.20.193.28:42400) 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd389c8d640 1 -- 10.20.193.28:0/1450814201 learned_addr learned my addr 10.20.193.28:0/1450814201 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd389c8d640 1 -- 10.20.193.28:0/1450814201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe40fb0 msgr2=0x55a6ebe41390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd389c8d640 1 --2- 10.20.193.28:0/1450814201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe41390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd389c8d640 1 -- 10.20.193.28:0/1450814201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3b5e0 msgr2=0x55a6ebe3ba20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd389c8d640 1 --2- 10.20.193.28:0/1450814201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe3ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd389c8d640 1 -- 10.20.193.28:0/1450814201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ebd4f3d0 con 0x55a6ebe3bf60 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd36b7fe640 1 -- 10.20.193.28:0/1721737836 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd374041570 con 0x7fd384100a20 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/1450814201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe41390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.313+0000 7fd389c8d640 1 --2- 10.20.193.28:0/1450814201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe47de0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd378004680 tx=0x7fd378009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53ea9b8b4fa25b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd368cf3640 1 -- 10.20.193.28:0/1450814201 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378009e60 con 0x55a6ebe3bf60 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd368cf3640 1 -- 10.20.193.28:0/1450814201 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd378016030 con 0x55a6ebe3bf60 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd368cf3640 1 -- 10.20.193.28:0/1450814201 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378011810 con 0x55a6ebe3bf60 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1450814201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3bf60 msgr2=0x55a6ebe47de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1450814201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe47de0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd378004680 tx=0x7fd378009c60 comp rx=0 tx=0).stop 2026-02-20T03:24:34.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1450814201 shutdown_connections 2026-02-20T03:24:34.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1450814201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe47de0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1450814201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe3ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1450814201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe41390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.314+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1450814201 >> 10.20.193.28:0/1450814201 conn(0x55a6ebdfe240 msgr2=0x55a6ebe39ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:34.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.315+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1450814201 shutdown_connections 2026-02-20T03:24:34.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.315+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1450814201 wait complete. 2026-02-20T03:24:34.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.315+0000 7fd36b7fe640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3600b0d00 0x7fd3600b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.315+0000 7fd36b7fe640 1 -- 10.20.193.28:0/1721737836 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd374105290 con 0x7fd384100a20 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3600b0d00 0x7fd3600b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ec1ee00 1 -- start start 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ec1ee00 1 Processor -- start 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3600b0d00 0x7fd3600b31c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd380009fd0 tx=0x7fd38000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe55f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe56440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe54640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a6ebd8a8a0 con 0x55a6ebe40fb0 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a6ebb7cf50 con 0x55a6ebe3bf60 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.316+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a6ebe54dc0 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd389c8d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe56440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38ac8f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe54640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38a48e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe55f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38a48e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe55f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59276/0 (socket says 10.20.193.28:59276) 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38a48e640 1 -- 10.20.193.28:0/2225070904 learned_addr learned my addr 10.20.193.28:0/2225070904 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38ac8f640 1 -- 10.20.193.28:0/2225070904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 msgr2=0x55a6ebe55f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe55f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38ac8f640 1 -- 10.20.193.28:0/2225070904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 msgr2=0x55a6ebe56440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe56440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38ac8f640 1 -- 10.20.193.28:0/2225070904 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ebe4dad0 con 0x55a6ebe40fb0 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38a48e640 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe55f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe54640 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd380004410 tx=0x7fd380004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb121ed4592d2cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:34.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.317+0000 7fd337fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd337fff640 1 -- 10.20.193.28:0/2225070904 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380026070 con 0x55a6ebe40fb0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd337fff640 1 -- 10.20.193.28:0/2225070904 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd380016e20 con 0x55a6ebe40fb0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd337fff640 1 -- 10.20.193.28:0/2225070904 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd380021d40 con 0x55a6ebe40fb0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/2225070904 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6ebb5fb40 con 0x55a6ebe40fb0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd337fff640 1 -- 10.20.193.28:0/2225070904 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd380016980 con 0x55a6ebe40fb0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd38ec1ee00 10 client.18075 _ll_register_callbacks cb 0x55a6ebdc7eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/2225070904 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a6ebd9c150 con 0x55a6ebe40fb0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd337fff640 1 -- 10.20.193.28:0/2225070904 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3800094f0 con 0x55a6ebe40fb0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd38ec1ee00 10 client.18075 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/2225070904 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a6ebd491e0 con 0x55a6ebe40fb0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.318+0000 7fd337fff640 1 -- 10.20.193.28:0/2225070904 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd380021400 con 0x55a6ebe40fb0 2026-02-20T03:24:34.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.319+0000 7fd38ec1ee00 10 client.18075 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.319+0000 7fd38ec1ee00 10 client.18075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.319+0000 7fd38ec1ee00 20 client.18075 populate_metadata read hostname 'trial028' 2026-02-20T03:24:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.319+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a6ebe75f30 0x55a6ebe783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.319+0000 7fd38ec1ee00 4 client.18075 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.319+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/2225070904 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6ebd96560 con 0x55a6ebe75f30 2026-02-20T03:24:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.319+0000 7fd38a48e640 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a6ebe75f30 0x55a6ebe783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38a48e640 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a6ebe75f30 0x55a6ebe783f0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c60220e45375064 server_cookie=9d26c9a9c66ab5e2 in_seq=0 out_seq=0 2026-02-20T03:24:34.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd337fff640 10 client.18075 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd337fff640 1 -- 10.20.193.28:0/2225070904 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a6ebd96560 con 0x55a6ebe75f30 2026-02-20T03:24:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd337fff640 10 client.18075 handle_command_reply: tid=0 2026-02-20T03:24:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 client.18075 shutdown 2026-02-20T03:24:34.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/2225070904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 msgr2=0x55a6ebe54640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe54640 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd380004410 tx=0x7fd380004bb0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/2225070904 shutdown_connections 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a6ebe75f30 0x55a6ebe783f0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe54640 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe56440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/2225070904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe55f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/2225070904 >> 10.20.193.28:0/2225070904 conn(0x55a6ebdfe240 msgr2=0x55a6ebe3a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd337fff640 0 client.18075 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/2225070904 shutdown_connections 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.320+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/2225070904 wait complete. 2026-02-20T03:24:34.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.321+0000 7fd38ec1ee00 20 client.18075 trim_cache size 0 max 16384 2026-02-20T03:24:34.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.327+0000 7fd38ec1ee00 1 Processor -- start 2026-02-20T03:24:34.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.327+0000 7fd38ec1ee00 1 -- start start 2026-02-20T03:24:34.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.327+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe3eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.327+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe7dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.327+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe7e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.327+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c0127c0 con 0x55a6ebe40fb0 2026-02-20T03:24:34.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.327+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c010090 con 0x55a6ebe3bf60 2026-02-20T03:24:34.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.327+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c00dee0 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd38a48e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe3eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd389c8d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe7dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd38a48e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe3eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59284/0 (socket says 10.20.193.28:59284) 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd38a48e640 1 -- 10.20.193.28:0/3747872951 learned_addr learned my addr 10.20.193.28:0/3747872951 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd389c8d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe7dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49112/0 (socket says 10.20.193.28:49112) 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/3747872951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe7e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd389c8d640 1 -- 10.20.193.28:0/3747872951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 msgr2=0x55a6ebe3eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd389c8d640 1 --2- 10.20.193.28:0/3747872951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe3eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd389c8d640 1 -- 10.20.193.28:0/3747872951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 msgr2=0x55a6ebe7e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd389c8d640 1 --2- 10.20.193.28:0/3747872951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe7e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd389c8d640 1 -- 10.20.193.28:0/3747872951 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6ebe4d900 con 0x55a6ebe3bf60 2026-02-20T03:24:34.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/3747872951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe7e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:34.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd389c8d640 1 --2- 10.20.193.28:0/3747872951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe7dd00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd378004650 tx=0x7fd378003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d6d22e3ba68dcdf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:34.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.328+0000 7fd3524e6640 1 -- 10.20.193.28:0/3747872951 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37802c070 con 0x55a6ebe3bf60 2026-02-20T03:24:34.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd3524e6640 1 -- 10.20.193.28:0/3747872951 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd3780128f0 con 0x55a6ebe3bf60 2026-02-20T03:24:34.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd3524e6640 1 -- 10.20.193.28:0/3747872951 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd378027aa0 con 0x55a6ebe3bf60 2026-02-20T03:24:34.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/3747872951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 msgr2=0x55a6ebe7dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:34.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/3747872951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe7dd00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd378004650 tx=0x7fd378003cd0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/3747872951 shutdown_connections 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/3747872951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe7e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/3747872951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe7dd00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/3747872951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe3eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/3747872951 >> 10.20.193.28:0/3747872951 conn(0x55a6ebdfe240 msgr2=0x55a6ebe536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/3747872951 shutdown_connections 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.329+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/3747872951 wait complete. 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ec1ee00 1 -- start start 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ec1ee00 1 Processor -- start 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe5a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe5ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ec1ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe5bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c00e550 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c00f9c0 con 0x55a6ebe40fb0 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ec1ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd32c00ec20 con 0x55a6ebe3bf60 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ac8f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe5bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ac8f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe5bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49118/0 (socket says 10.20.193.28:49118) 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38ac8f640 1 -- 10.20.193.28:0/1281446070 learned_addr learned my addr 10.20.193.28:0/1281446070 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.330+0000 7fd38a48e640 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe5a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd389c8d640 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe5ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd38a48e640 1 -- 10.20.193.28:0/1281446070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3bf60 msgr2=0x55a6ebe5ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd38a48e640 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe5ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd38a48e640 1 -- 10.20.193.28:0/1281446070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe40fb0 msgr2=0x55a6ebe5bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd38a48e640 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe5bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd38a48e640 1 -- 10.20.193.28:0/1281446070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6eba6d870 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd38ac8f640 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe5bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd38a48e640 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe5a720 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd374042000 tx=0x7fd374038f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e952d3ead46b23c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd337fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd337fff640 1 -- 10.20.193.28:0/1281446070 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3740b9020 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd337fff640 1 -- 10.20.193.28:0/1281446070 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55a6ebd96560 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd337fff640 1 -- 10.20.193.28:0/1281446070 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3740cbf80 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.331+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1281446070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6ebd2e3f0 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.332+0000 7fd38ec1ee00 10 client.18081 _ll_register_callbacks cb 0x7fd3800090c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.332+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1281446070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd378016030 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.332+0000 7fd337fff640 1 -- 10.20.193.28:0/1281446070 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fd3740cc140 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.332+0000 7fd337fff640 1 -- 10.20.193.28:0/1281446070 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd374105080 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.332+0000 7fd38ec1ee00 10 client.18081 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:34.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.332+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1281446070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a6ebe4e5f0 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd337fff640 1 -- 10.20.193.28:0/1281446070 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd374038910 con 0x55a6ebe3b5e0 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd38ec1ee00 10 client.18081 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd38ec1ee00 10 client.18081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd38ec1ee00 20 client.18081 populate_metadata read hostname 'trial028' 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a6ebeea5f0 0x55a6ebeecab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd38ec1ee00 4 client.18081 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1281446070 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6ebd5f7c0 con 0x55a6ebeea5f0 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd389c8d640 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a6ebeea5f0 0x55a6ebeecab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd389c8d640 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a6ebeea5f0 0x55a6ebeecab0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72f394fbdfa7c300 server_cookie=bcc95e599d81298 in_seq=0 out_seq=0 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.333+0000 7fd337fff640 10 client.18081 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:34.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd337fff640 1 -- 10.20.193.28:0/1281446070 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6ebd5f7c0 con 0x55a6ebeea5f0 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd337fff640 10 client.18081 handle_command_reply: tid=0 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 client.18081 shutdown 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1281446070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3b5e0 msgr2=0x55a6ebe5a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe5a720 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd374042000 tx=0x7fd374038f60 comp rx=0 tx=0).stop 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1281446070 shutdown_connections 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a6ebeea5f0 0x55a6ebeecab0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a6ebe40fb0 0x55a6ebe5bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a6ebe3bf60 0x55a6ebe5ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 --2- 10.20.193.28:0/1281446070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a6ebe3b5e0 0x55a6ebe5a720 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd337fff640 0 client.18081 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1281446070 >> 10.20.193.28:0/1281446070 conn(0x55a6ebdfe240 msgr2=0x55a6ebe76310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:34.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1281446070 shutdown_connections 2026-02-20T03:24:34.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 1 -- 10.20.193.28:0/1281446070 wait complete. 2026-02-20T03:24:34.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.334+0000 7fd38ec1ee00 20 client.18081 trim_cache size 0 max 16384 2026-02-20T03:24:34.343 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:24:34.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 -- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3600b0d00 msgr2=0x7fd3600b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:34.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3600b0d00 0x7fd3600b31c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd380009fd0 tx=0x7fd38000b040 comp rx=0 tx=0).stop 2026-02-20T03:24:34.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 -- 10.20.193.28:0/1721737836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd384100a20 msgr2=0x7fd3841a2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:34.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd384100a20 0x7fd3841a2db0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd374002410 tx=0x7fd374004300 comp rx=0 tx=0).stop 2026-02-20T03:24:34.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 -- 10.20.193.28:0/1721737836 shutdown_connections 2026-02-20T03:24:34.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3600b0d00 0x7fd3600b31c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd384108c80 0x7fd38419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3841013d0 0x7fd3841a32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 --2- 10.20.193.28:0/1721737836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd384100a20 0x7fd3841a2db0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:34.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 -- 10.20.193.28:0/1721737836 >> 10.20.193.28:0/1721737836 conn(0x7fd3840fc5f0 msgr2=0x7fd3840fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:34.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 -- 10.20.193.28:0/1721737836 shutdown_connections 2026-02-20T03:24:34.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:34.335+0000 7fd38b490640 1 -- 10.20.193.28:0/1721737836 wait complete. 2026-02-20T03:24:34.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 795644 7.30 MB/sec execute 367 sec latency 371.820 ms 2026-02-20T03:24:35.433 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:24:35.433 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:24:35.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:35 trial177 ceph-mon[43181]: pgmap v478: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 197 KiB/s rd, 58 KiB/s wr, 14 op/s 2026-02-20T03:24:35.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:35 trial028 ceph-mon[38552]: pgmap v478: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 197 KiB/s rd, 58 KiB/s wr, 14 op/s 2026-02-20T03:24:35.515 INFO:tasks.workunit.client.0.trial028.stdout: 1 799090 7.34 MB/sec execute 368 sec latency 16.941 ms 2026-02-20T03:24:35.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:35 trial126 ceph-mon[38476]: pgmap v478: 129 pgs: 129 active+clean; 127 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 197 KiB/s rd, 58 KiB/s wr, 14 op/s 2026-02-20T03:24:35.698 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:35.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.901+0000 7f3178a3a640 1 -- 10.20.193.28:0/1161195694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3174109220 msgr2=0x7f3174109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.901+0000 7f3178a3a640 1 --2- 10.20.193.28:0/1161195694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3174109220 0x7f3174109660 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f315c009960 tx=0x7f315c02f140 comp rx=0 tx=0).stop 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.901+0000 7f3178a3a640 1 -- 10.20.193.28:0/1161195694 shutdown_connections 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.901+0000 7f3178a3a640 1 --2- 10.20.193.28:0/1161195694 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3174109ba0 0x7f3174115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.901+0000 7f3178a3a640 1 --2- 10.20.193.28:0/1161195694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3174109220 0x7f3174109660 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.901+0000 7f3178a3a640 1 --2- 10.20.193.28:0/1161195694 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f317410eef0 0x7f317410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.901+0000 7f3178a3a640 1 -- 10.20.193.28:0/1161195694 >> 10.20.193.28:0/1161195694 conn(0x7f3174078600 msgr2=0x7f317407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.901+0000 7f3178a3a640 1 -- 10.20.193.28:0/1161195694 shutdown_connections 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.901+0000 7f3178a3a640 1 -- 10.20.193.28:0/1161195694 wait complete. 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3178a3a640 1 Processor -- start 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3178a3a640 1 -- start start 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3178a3a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3174109220 0x7f31741a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3178a3a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3174109ba0 0x7f31741a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3178a3a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317410eef0 0x7f31741a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3178a3a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3174119070 con 0x7f317410eef0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3178a3a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3174118ef0 con 0x7f3174109ba0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3178a3a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31741191f0 con 0x7f3174109220 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3173577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317410eef0 0x7f31741a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3172575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3174109ba0 0x7f31741a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3173577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317410eef0 0x7f31741a5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42442/0 (socket says 10.20.193.28:42442) 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3173577640 1 -- 10.20.193.28:0/2701353921 learned_addr learned my addr 10.20.193.28:0/2701353921 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.902+0000 7f3172d76640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3174109220 0x7f31741a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3173577640 1 -- 10.20.193.28:0/2701353921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3174109220 msgr2=0x7f31741a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3173577640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3174109220 0x7f31741a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3173577640 1 -- 10.20.193.28:0/2701353921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3174109ba0 msgr2=0x7f31741a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3173577640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3174109ba0 0x7f31741a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3173577640 1 -- 10.20.193.28:0/2701353921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31741a6550 con 0x7f317410eef0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3173577640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317410eef0 0x7f31741a5dd0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f316400c110 tx=0x7f316400c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3153fff640 1 -- 10.20.193.28:0/2701353921 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164019070 con 0x7f317410eef0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3153fff640 1 -- 10.20.193.28:0/2701353921 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f31640092d0 con 0x7f317410eef0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3178a3a640 1 -- 10.20.193.28:0/2701353921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31741a67e0 con 0x7f317410eef0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3178a3a640 1 -- 10.20.193.28:0/2701353921 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741ae080 con 0x7f317410eef0 2026-02-20T03:24:35.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.903+0000 7f3153fff640 1 -- 10.20.193.28:0/2701353921 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640075c0 con 0x7f317410eef0 2026-02-20T03:24:35.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.906+0000 7f3153fff640 1 -- 10.20.193.28:0/2701353921 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3164002a60 con 0x7f317410eef0 2026-02-20T03:24:35.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.906+0000 7f317b740e00 1 Processor -- start 2026-02-20T03:24:35.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.906+0000 7f317b740e00 1 -- start start 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.906+0000 7f317b740e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591da0c0 0x55a0591da4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.906+0000 7f317b740e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 0x55a0591de540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.906+0000 7f317b740e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591deb60 0x55a0591defd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.906+0000 7f317b740e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a05912cc00 con 0x55a0591deb60 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.906+0000 7f317b740e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a0590da3c0 con 0x55a0591da0c0 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.906+0000 7f317b740e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a059128b30 con 0x55a0591daa70 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591da0c0 0x55a0591da4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591deb60 0x55a0591defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591deb60 0x55a0591defd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42458/0 (socket says 10.20.193.28:42458) 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172575640 1 -- 10.20.193.28:0/3096596529 learned_addr learned my addr 10.20.193.28:0/3096596529 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172575640 1 -- 10.20.193.28:0/3096596529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 msgr2=0x55a0591de540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:35.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172d76640 1 --2- 10.20.193.28:0/3096596529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 0x55a0591de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172575640 1 --2- 10.20.193.28:0/3096596529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 0x55a0591de540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172575640 1 -- 10.20.193.28:0/3096596529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591da0c0 msgr2=0x55a0591da4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172575640 1 --2- 10.20.193.28:0/3096596529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591da0c0 0x55a0591da4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3172575640 1 -- 10.20.193.28:0/3096596529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0590d3840 con 0x55a0591deb60 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3153fff640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e70 0x7f31440b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.907+0000 7f3153fff640 1 -- 10.20.193.28:0/2701353921 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f31640e04f0 con 0x7f317410eef0 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f3172575640 1 --2- 10.20.193.28:0/3096596529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591deb60 0x55a0591defd0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f315c009960 tx=0x7f315c02f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a270fa2ec85f3b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f3172d76640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e70 0x7f31440b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f313b7fe640 1 -- 10.20.193.28:0/3096596529 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c02fb90 con 0x55a0591deb60 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f313b7fe640 1 -- 10.20.193.28:0/3096596529 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f315c033070 con 0x55a0591deb60 2026-02-20T03:24:35.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f313b7fe640 1 -- 10.20.193.28:0/3096596529 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c005530 con 0x55a0591deb60 2026-02-20T03:24:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f317b740e00 1 -- 10.20.193.28:0/3096596529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591deb60 msgr2=0x55a0591defd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f317b740e00 1 --2- 10.20.193.28:0/3096596529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591deb60 0x55a0591defd0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f315c009960 tx=0x7f315c02f140 comp rx=0 tx=0).stop 2026-02-20T03:24:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f3172d76640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e70 0x7f31440b3330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55a0591db090 tx=0x7f3168009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f317b740e00 1 -- 10.20.193.28:0/3096596529 shutdown_connections 2026-02-20T03:24:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f317b740e00 1 --2- 10.20.193.28:0/3096596529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591deb60 0x55a0591defd0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f317b740e00 1 --2- 10.20.193.28:0/3096596529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 0x55a0591de540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f317b740e00 1 --2- 10.20.193.28:0/3096596529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591da0c0 0x55a0591da4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f317b740e00 1 -- 10.20.193.28:0/3096596529 >> 10.20.193.28:0/3096596529 conn(0x55a0591d2b60 msgr2=0x55a0591d85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:35.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.908+0000 7f317b740e00 1 -- 10.20.193.28:0/3096596529 shutdown_connections 2026-02-20T03:24:35.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.909+0000 7f317b740e00 1 -- 10.20.193.28:0/3096596529 wait complete. 2026-02-20T03:24:35.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.910+0000 7f317b740e00 1 -- start start 2026-02-20T03:24:35.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.910+0000 7f317b740e00 1 Processor -- start 2026-02-20T03:24:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f317b740e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591f4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f317b740e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591daa70 0x55a0591f4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f317b740e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591deb60 0x55a0591f2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f317b740e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a0590d41a0 con 0x55a0591da0c0 2026-02-20T03:24:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f317b740e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a0591e6d10 con 0x55a0591daa70 2026-02-20T03:24:35.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f317b740e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a0591f3000 con 0x55a0591deb60 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f3173577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591deb60 0x55a0591f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f3172d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f3173577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591deb60 0x55a0591f2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59338/0 (socket says 10.20.193.28:59338) 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f3173577640 1 -- 10.20.193.28:0/1484787405 learned_addr learned my addr 10.20.193.28:0/1484787405 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.911+0000 7f3172575640 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591daa70 0x55a0591f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3173577640 1 -- 10.20.193.28:0/1484787405 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591daa70 msgr2=0x55a0591f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3173577640 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591daa70 0x55a0591f4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3173577640 1 -- 10.20.193.28:0/1484787405 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 msgr2=0x55a0591f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3173577640 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3173577640 1 -- 10.20.193.28:0/1484787405 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0591ec590 con 0x55a0591deb60 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3173577640 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591deb60 0x55a0591f2880 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3164004a90 tx=0x7f31640a8000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73aedddfec414e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3138ff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3138ff9640 1 -- 10.20.193.28:0/1484787405 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640a8930 con 0x55a0591deb60 2026-02-20T03:24:35.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3138ff9640 1 -- 10.20.193.28:0/1484787405 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f31640ac5e0 con 0x55a0591deb60 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f317b740e00 1 -- 10.20.193.28:0/1484787405 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a058efbb60 con 0x55a0591deb60 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3138ff9640 1 -- 10.20.193.28:0/1484787405 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640a3bb0 con 0x55a0591deb60 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3138ff9640 1 -- 10.20.193.28:0/1484787405 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f31640a6cb0 con 0x55a0591deb60 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.912+0000 7f3138ff9640 10 client.27214 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 10 client.27214 _ll_register_callbacks cb 0x55a0590d80d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 1 -- 10.20.193.28:0/1484787405 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a0591347f0 con 0x55a0591deb60 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f3138ff9640 1 -- 10.20.193.28:0/1484787405 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f31640b1490 con 0x55a0591deb60 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 10 client.27214 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 1 -- 10.20.193.28:0/1484787405 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a0590f9430 con 0x55a0591deb60 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f3138ff9640 1 -- 10.20.193.28:0/1484787405 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f31640a6eb0 con 0x55a0591deb60 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 10 client.27214 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 10 client.27214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 20 client.27214 populate_metadata read hostname 'trial028' 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a059202880 0x55a059204cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 4 client.27214 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f317b740e00 1 -- 10.20.193.28:0/1484787405 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0590aec00 con 0x55a059202880 2026-02-20T03:24:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.913+0000 7f3172d76640 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a059202880 0x55a059204cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.914+0000 7f3172d76640 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a059202880 0x55a059204cd0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f35dc6e755e7c130 server_cookie=a575f6cab165acf2 in_seq=0 out_seq=0 2026-02-20T03:24:35.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.914+0000 7f3138ff9640 10 client.27214 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.914+0000 7f3138ff9640 1 -- 10.20.193.28:0/1484787405 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a0590aec00 con 0x55a059202880 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.914+0000 7f3138ff9640 10 client.27214 handle_command_reply: tid=0 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.914+0000 7f317b740e00 1 client.27214 shutdown 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 -- 10.20.193.28:0/1484787405 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591deb60 msgr2=0x55a0591f2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591deb60 0x55a0591f2880 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3164004a90 tx=0x7f31640a8000 comp rx=0 tx=0).stop 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 -- 10.20.193.28:0/1484787405 shutdown_connections 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a059202880 0x55a059204cd0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591deb60 0x55a0591f2880 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591daa70 0x55a0591f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 --2- 10.20.193.28:0/1484787405 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 -- 10.20.193.28:0/1484787405 >> 10.20.193.28:0/1484787405 conn(0x55a0591d2b60 msgr2=0x55a0591dd520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f3138ff9640 0 client.27214 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:35.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 -- 10.20.193.28:0/1484787405 shutdown_connections 2026-02-20T03:24:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 1 -- 10.20.193.28:0/1484787405 wait complete. 2026-02-20T03:24:35.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.915+0000 7f317b740e00 20 client.27214 trim_cache size 0 max 16384 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.924+0000 7f317b740e00 1 Processor -- start 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.924+0000 7f317b740e00 1 -- start start 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f317b740e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591dff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f317b740e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 0x55a0591efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f317b740e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a0591f0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f317b740e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3118012660 con 0x55a0591da0c0 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f317b740e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f311800ff30 con 0x55a0591deb60 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f317b740e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f311800dd80 con 0x55a0591daa70 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591dff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42470/0 (socket says 10.20.193.28:42470) 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172d76640 1 -- 10.20.193.28:0/2082421667 learned_addr learned my addr 10.20.193.28:0/2082421667 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172575640 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 0x55a0591efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3173577640 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a0591f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172d76640 1 -- 10.20.193.28:0/2082421667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 msgr2=0x55a0591efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172d76640 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 0x55a0591efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172d76640 1 -- 10.20.193.28:0/2082421667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 msgr2=0x55a0591f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172d76640 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a0591f0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172d76640 1 -- 10.20.193.28:0/2082421667 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0591f2bf0 con 0x55a0591da0c0 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.925+0000 7f3172575640 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 0x55a0591efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f3172d76640 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591dff50 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3168004140 tx=0x7f3168014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c780c70311136cff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f313affd640 1 -- 10.20.193.28:0/2082421667 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168011b90 con 0x55a0591da0c0 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f313affd640 1 -- 10.20.193.28:0/2082421667 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3168011d30 con 0x55a0591da0c0 2026-02-20T03:24:35.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f313affd640 1 -- 10.20.193.28:0/2082421667 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168027670 con 0x55a0591da0c0 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f317b740e00 1 -- 10.20.193.28:0/2082421667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 msgr2=0x55a0591dff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f317b740e00 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591dff50 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3168004140 tx=0x7f3168014000 comp rx=0 tx=0).stop 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f317b740e00 1 -- 10.20.193.28:0/2082421667 shutdown_connections 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f317b740e00 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a0591f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f317b740e00 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591daa70 0x55a0591efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f317b740e00 1 --2- 10.20.193.28:0/2082421667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591da0c0 0x55a0591dff50 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f317b740e00 1 -- 10.20.193.28:0/2082421667 >> 10.20.193.28:0/2082421667 conn(0x55a0591d2b60 msgr2=0x55a0591ef5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f317b740e00 1 -- 10.20.193.28:0/2082421667 shutdown_connections 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.926+0000 7f317b740e00 1 -- 10.20.193.28:0/2082421667 wait complete. 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.927+0000 7f317b740e00 1 -- start start 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.927+0000 7f317b740e00 1 Processor -- start 2026-02-20T03:24:35.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.927+0000 7f317b740e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591da0c0 0x55a059269d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.927+0000 7f317b740e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591daa70 0x55a05926a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.927+0000 7f317b740e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a059263810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.927+0000 7f317b740e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f311800e3f0 con 0x55a0591daa70 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.927+0000 7f317b740e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f311800f860 con 0x55a0591deb60 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.927+0000 7f317b740e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f311800eac0 con 0x55a0591da0c0 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3173577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a059263810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3173577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a059263810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49172/0 (socket says 10.20.193.28:49172) 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3173577640 1 -- 10.20.193.28:0/2899566647 learned_addr learned my addr 10.20.193.28:0/2899566647 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3172d76640 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591da0c0 0x55a059269d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3172575640 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591daa70 0x55a05926a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3173577640 1 -- 10.20.193.28:0/2899566647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591da0c0 msgr2=0x55a059269d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3173577640 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591da0c0 0x55a059269d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3173577640 1 -- 10.20.193.28:0/2899566647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591daa70 msgr2=0x55a05926a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3173577640 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591daa70 0x55a05926a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3173577640 1 -- 10.20.193.28:0/2899566647 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0591ec3c0 con 0x55a0591deb60 2026-02-20T03:24:35.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3172575640 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591daa70 0x55a05926a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3173577640 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a059263810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f31640a7f30 tx=0x7f31640a7a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bc982bce6274242 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3138ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3138ff9640 1 -- 10.20.193.28:0/2899566647 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640c2020 con 0x55a0591deb60 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f317b740e00 1 -- 10.20.193.28:0/2899566647 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a058e0b900 con 0x55a0591deb60 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f317b740e00 10 client.27203 _ll_register_callbacks cb 0x7f31640df040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f317b740e00 1 -- 10.20.193.28:0/2899566647 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f315c033070 con 0x55a0591deb60 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3138ff9640 1 -- 10.20.193.28:0/2899566647 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55a0591347f0 con 0x55a0591deb60 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.928+0000 7f3138ff9640 1 -- 10.20.193.28:0/2899566647 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316405a120 con 0x55a0591deb60 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f3138ff9640 1 -- 10.20.193.28:0/2899566647 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f316405a2c0 con 0x55a0591deb60 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f3138ff9640 1 -- 10.20.193.28:0/2899566647 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f31640a6cb0 con 0x55a0591deb60 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f317b740e00 10 client.27203 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f317b740e00 1 -- 10.20.193.28:0/2899566647 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55a0590e74d0 con 0x55a0591deb60 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f3138ff9640 1 -- 10.20.193.28:0/2899566647 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f31640a6e50 con 0x55a0591deb60 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f317b740e00 10 client.27203 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f317b740e00 10 client.27203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f317b740e00 20 client.27203 populate_metadata read hostname 'trial028' 2026-02-20T03:24:35.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f317b740e00 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0592681e0 0x55a059283bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f317b740e00 4 client.27203 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:24:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f317b740e00 1 -- 10.20.193.28:0/2899566647 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a058e9ca20 con 0x55a0592681e0 2026-02-20T03:24:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.929+0000 7f3172d76640 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0592681e0 0x55a059283bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.930+0000 7f3172d76640 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0592681e0 0x55a059283bf0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c07db117f5f78d3a server_cookie=1d745a3b0dcee791 in_seq=0 out_seq=0 2026-02-20T03:24:35.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.930+0000 7f3138ff9640 10 client.27203 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.930+0000 7f3138ff9640 1 -- 10.20.193.28:0/2899566647 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a058e9ca20 con 0x55a0592681e0 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.930+0000 7f3138ff9640 10 client.27203 handle_command_reply: tid=0 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.930+0000 7f317b740e00 1 client.27203 shutdown 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 -- 10.20.193.28:0/2899566647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 msgr2=0x55a059263810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a059263810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f31640a7f30 tx=0x7f31640a7a30 comp rx=0 tx=0).stop 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 -- 10.20.193.28:0/2899566647 shutdown_connections 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a0592681e0 0x55a059283bf0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a0591deb60 0x55a059263810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a0591daa70 0x55a05926a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 --2- 10.20.193.28:0/2899566647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a0591da0c0 0x55a059269d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 -- 10.20.193.28:0/2899566647 >> 10.20.193.28:0/2899566647 conn(0x55a0591d2b60 msgr2=0x55a0591efdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f3138ff9640 0 client.27203 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 -- 10.20.193.28:0/2899566647 shutdown_connections 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 1 -- 10.20.193.28:0/2899566647 wait complete. 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f317b740e00 20 client.27203 trim_cache size 0 max 16384 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:24:35.933 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "93a9550a-118a-41d4-868e-3e62e0169b65", 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f3178a3a640 1 -- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e70 msgr2=0x7f31440b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f3178a3a640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e70 0x7f31440b3330 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x55a0591db090 tx=0x7f3168009290 comp rx=0 tx=0).stop 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f3178a3a640 1 -- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317410eef0 msgr2=0x7f31741a5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.931+0000 7f3178a3a640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317410eef0 0x7f31741a5dd0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f316400c110 tx=0x7f316400c5e0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.932+0000 7f3178a3a640 1 -- 10.20.193.28:0/2701353921 shutdown_connections 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.932+0000 7f3178a3a640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31440b0e70 0x7f31440b3330 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.932+0000 7f3178a3a640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f317410eef0 0x7f31741a5dd0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.932+0000 7f3178a3a640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3174109ba0 0x7f31741a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.932+0000 7f3178a3a640 1 --2- 10.20.193.28:0/2701353921 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3174109220 0x7f31741a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.932+0000 7f3178a3a640 1 -- 10.20.193.28:0/2701353921 >> 10.20.193.28:0/2701353921 conn(0x7f3174078600 msgr2=0x7f3174079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.932+0000 7f3178a3a640 1 -- 10.20.193.28:0/2701353921 shutdown_connections 2026-02-20T03:24:35.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:35.932+0000 7f3178a3a640 1 -- 10.20.193.28:0/2701353921 wait complete. 2026-02-20T03:24:36.032 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:24:36.301 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:24:36.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.492+0000 7fee04e06640 1 -- 10.20.193.28:0/1298594775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee00109220 msgr2=0x7fee00109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:36.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.492+0000 7fee04e06640 1 --2- 10.20.193.28:0/1298594775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee00109220 0x7fee00109660 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009960 tx=0x7fedf002f140 comp rx=0 tx=0).stop 2026-02-20T03:24:36.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.492+0000 7fee04e06640 1 -- 10.20.193.28:0/1298594775 shutdown_connections 2026-02-20T03:24:36.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.492+0000 7fee04e06640 1 --2- 10.20.193.28:0/1298594775 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee00109ba0 0x7fee00115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.492+0000 7fee04e06640 1 --2- 10.20.193.28:0/1298594775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee00109220 0x7fee00109660 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.492+0000 7fee04e06640 1 --2- 10.20.193.28:0/1298594775 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee0010eef0 0x7fee0010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.492+0000 7fee04e06640 1 -- 10.20.193.28:0/1298594775 >> 10.20.193.28:0/1298594775 conn(0x7fee00078600 msgr2=0x7fee0007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:36.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.492+0000 7fee04e06640 1 -- 10.20.193.28:0/1298594775 shutdown_connections 2026-02-20T03:24:36.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.492+0000 7fee04e06640 1 -- 10.20.193.28:0/1298594775 wait complete. 2026-02-20T03:24:36.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.493+0000 7fee04e06640 1 Processor -- start 2026-02-20T03:24:36.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.493+0000 7fee04e06640 1 -- start start 2026-02-20T03:24:36.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.493+0000 7fee04e06640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee00109220 0x7fee001a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.493+0000 7fee04e06640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee00109ba0 0x7fee001a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.493+0000 7fee04e06640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee0010eef0 0x7fee001a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.493+0000 7fee04e06640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fee00119090 con 0x7fee0010eef0 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.493+0000 7fee04e06640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fee00118f10 con 0x7fee00109220 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.493+0000 7fee04e06640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fee00119210 con 0x7fee00109ba0 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedff7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee00109220 0x7fee001a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedff7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee00109220 0x7fee001a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48126/0 (socket says 10.20.193.28:48126) 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedff7fe640 1 -- 10.20.193.28:0/3407272876 learned_addr learned my addr 10.20.193.28:0/3407272876 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfffff640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee0010eef0 0x7fee001a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfeffd640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee00109ba0 0x7fee001a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfffff640 1 -- 10.20.193.28:0/3407272876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee00109ba0 msgr2=0x7fee001a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfffff640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee00109ba0 0x7fee001a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfffff640 1 -- 10.20.193.28:0/3407272876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee00109220 msgr2=0x7fee001a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfffff640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee00109220 0x7fee001a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfffff640 1 -- 10.20.193.28:0/3407272876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee001a6570 con 0x7fee0010eef0 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfeffd640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee00109ba0 0x7fee001a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedff7fe640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee00109220 0x7fee001a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfffff640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee0010eef0 0x7fee001a5df0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fedf400efc0 tx=0x7fedf400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfcff9640 1 -- 10.20.193.28:0/3407272876 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4019070 con 0x7fee0010eef0 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fee04e06640 1 -- 10.20.193.28:0/3407272876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee001a6800 con 0x7fee0010eef0 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fee04e06640 1 -- 10.20.193.28:0/3407272876 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee001ae0a0 con 0x7fee0010eef0 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfcff9640 1 -- 10.20.193.28:0/3407272876 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fedf40092d0 con 0x7fee0010eef0 2026-02-20T03:24:36.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.494+0000 7fedfcff9640 1 -- 10.20.193.28:0/3407272876 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4007500 con 0x7fee0010eef0 2026-02-20T03:24:36.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.497+0000 7fedfcff9640 1 -- 10.20.193.28:0/3407272876 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fedf40076a0 con 0x7fee0010eef0 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.497+0000 7fee08594e00 1 Processor -- start 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.498+0000 7fee08594e00 1 -- start start 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.498+0000 7fee08594e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc9000 0x559091dc93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.498+0000 7fee08594e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3630 0x559091dc3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.498+0000 7fee08594e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3fb0 0x559091dcfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.498+0000 7fee08594e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559091d43e50 con 0x559091dc3630 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.498+0000 7fee08594e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559091d169c0 con 0x559091dc3fb0 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.498+0000 7fee08594e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559091cc4240 con 0x559091dc9000 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.498+0000 7fedfcff9640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedd40b0e20 0x7fedd40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.498+0000 7fedfcff9640 1 -- 10.20.193.28:0/3407272876 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fedf40e0910 con 0x7fee0010eef0 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedfffff640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedd40b0e20 0x7fedd40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3630 0x559091dc3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedfeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc9000 0x559091dc93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3630 0x559091dc3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46292/0 (socket says 10.20.193.28:46292) 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedff7fe640 1 -- 10.20.193.28:0/1712722773 learned_addr learned my addr 10.20.193.28:0/1712722773 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedfeffd640 1 --2- 10.20.193.28:0/1712722773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3fb0 0x559091dcfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedfffff640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedd40b0e20 0x7fedd40b32e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fedf40a82f0 tx=0x7fedf4009e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedff7fe640 1 -- 10.20.193.28:0/1712722773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc9000 msgr2=0x559091dc93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedff7fe640 1 --2- 10.20.193.28:0/1712722773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc9000 0x559091dc93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedff7fe640 1 -- 10.20.193.28:0/1712722773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3fb0 msgr2=0x559091dcfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedff7fe640 1 --2- 10.20.193.28:0/1712722773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3fb0 0x559091dcfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedff7fe640 1 -- 10.20.193.28:0/1712722773 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559091cd7420 con 0x559091dc3630 2026-02-20T03:24:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedfeffd640 1 --2- 10.20.193.28:0/1712722773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3fb0 0x559091dcfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedff7fe640 1 --2- 10.20.193.28:0/1712722773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3630 0x559091dc3a70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fedec0042b0 tx=0x7fedec002ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d68b3a8d43781a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.499+0000 7fedc3fff640 1 -- 10.20.193.28:0/1712722773 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec01a640 con 0x559091dc3630 2026-02-20T03:24:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fedc3fff640 1 -- 10.20.193.28:0/1712722773 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fedec01ac80 con 0x559091dc3630 2026-02-20T03:24:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fedc3fff640 1 -- 10.20.193.28:0/1712722773 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec010e10 con 0x559091dc3630 2026-02-20T03:24:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fee08594e00 1 -- 10.20.193.28:0/1712722773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3630 msgr2=0x559091dc3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:36.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fee08594e00 1 --2- 10.20.193.28:0/1712722773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3630 0x559091dc3a70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fedec0042b0 tx=0x7fedec002ab0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fee08594e00 1 -- 10.20.193.28:0/1712722773 shutdown_connections 2026-02-20T03:24:36.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fee08594e00 1 --2- 10.20.193.28:0/1712722773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3fb0 0x559091dcfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fee08594e00 1 --2- 10.20.193.28:0/1712722773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3630 0x559091dc3a70 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fee08594e00 1 --2- 10.20.193.28:0/1712722773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc9000 0x559091dc93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fee08594e00 1 -- 10.20.193.28:0/1712722773 >> 10.20.193.28:0/1712722773 conn(0x559091d86290 msgr2=0x559091dc1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fee08594e00 1 -- 10.20.193.28:0/1712722773 shutdown_connections 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.500+0000 7fee08594e00 1 -- 10.20.193.28:0/1712722773 wait complete. 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.501+0000 7fee08594e00 1 -- start start 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fee08594e00 1 Processor -- start 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fee08594e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3630 0x559091ddc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fee08594e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3fb0 0x559091ddc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fee08594e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc9000 0x559091de1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fee08594e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559091d128f0 con 0x559091dc9000 2026-02-20T03:24:36.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fee08594e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559091b04f50 con 0x559091dc3630 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fee08594e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559091de2340 con 0x559091dc3fb0 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fedfeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc9000 0x559091de1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fedff7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3fb0 0x559091ddc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fedff7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3fb0 0x559091ddc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60794/0 (socket says 10.20.193.28:60794) 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fedff7fe640 1 -- 10.20.193.28:0/59091005 learned_addr learned my addr 10.20.193.28:0/59091005 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.502+0000 7fedfeffd640 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3630 0x559091ddc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedfeffd640 1 -- 10.20.193.28:0/59091005 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3fb0 msgr2=0x559091ddc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedfeffd640 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3fb0 0x559091ddc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedfeffd640 1 -- 10.20.193.28:0/59091005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3630 msgr2=0x559091ddc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedfeffd640 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3630 0x559091ddc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedfeffd640 1 -- 10.20.193.28:0/59091005 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559091dd5ad0 con 0x559091dc9000 2026-02-20T03:24:36.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedfeffd640 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc9000 0x559091de1e00 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009930 tx=0x7fedf0009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ebf5158a9f924c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedc17fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedc17fa640 1 -- 10.20.193.28:0/59091005 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf002fbb0 con 0x559091dc9000 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedc17fa640 1 -- 10.20.193.28:0/59091005 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fedf0033040 con 0x559091dc9000 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedc17fa640 1 -- 10.20.193.28:0/59091005 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0002a10 con 0x559091dc9000 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fee08594e00 1 -- 10.20.193.28:0/59091005 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559091ae7b40 con 0x559091dc9000 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.503+0000 7fedc17fa640 1 -- 10.20.193.28:0/59091005 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fedf0002bb0 con 0x559091dc9000 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fedc17fa640 10 client.18111 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 10 client.18111 _ll_register_callbacks cb 0x559091d4ff00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 1 -- 10.20.193.28:0/59091005 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559091d241a0 con 0x559091dc9000 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fedc17fa640 1 -- 10.20.193.28:0/59091005 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fedf0038770 con 0x559091dc9000 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 10 client.18111 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:36.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 1 -- 10.20.193.28:0/59091005 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559091cd1230 con 0x559091dc9000 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fedc17fa640 1 -- 10.20.193.28:0/59091005 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fedf0038910 con 0x559091dc9000 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 10 client.18111 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 10 client.18111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 20 client.18111 populate_metadata read hostname 'trial028' 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559091dec350 0x559091dee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 4 client.18111 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fee08594e00 1 -- 10.20.193.28:0/59091005 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559091d1e5b0 con 0x559091dec350 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.504+0000 7fedff7fe640 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559091dec350 0x559091dee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.505+0000 7fedff7fe640 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559091dec350 0x559091dee7e0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb465dfac471bae8 server_cookie=3b6654a708e6ad80 in_seq=0 out_seq=0 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.505+0000 7fedc17fa640 10 client.18111 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.505+0000 7fedc17fa640 1 -- 10.20.193.28:0/59091005 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559091d1e5b0 con 0x559091dec350 2026-02-20T03:24:36.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.505+0000 7fedc17fa640 10 client.18111 handle_command_reply: tid=0 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.505+0000 7fee08594e00 1 client.18111 shutdown 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 -- 10.20.193.28:0/59091005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc9000 msgr2=0x559091de1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc9000 0x559091de1e00 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009930 tx=0x7fedf0009290 comp rx=0 tx=0).stop 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 -- 10.20.193.28:0/59091005 shutdown_connections 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559091dec350 0x559091dee7e0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc9000 0x559091de1e00 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3fb0 0x559091ddc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 --2- 10.20.193.28:0/59091005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc3630 0x559091ddc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fedc17fa640 0 client.18111 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 -- 10.20.193.28:0/59091005 >> 10.20.193.28:0/59091005 conn(0x559091d86290 msgr2=0x559091dc2440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 -- 10.20.193.28:0/59091005 shutdown_connections 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 1 -- 10.20.193.28:0/59091005 wait complete. 2026-02-20T03:24:36.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.506+0000 7fee08594e00 20 client.18111 trim_cache size 0 max 16384 2026-02-20T03:24:36.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 802480 7.36 MB/sec execute 369 sec latency 16.733 ms 2026-02-20T03:24:36.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.515+0000 7fee08594e00 1 Processor -- start 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.515+0000 7fee08594e00 1 -- start start 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.515+0000 7fee08594e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091dc2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.515+0000 7fee08594e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 0x559091dc2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.515+0000 7fee08594e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 0x559091df30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.515+0000 7fee08594e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feda40126f0 con 0x559091dc3fb0 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.515+0000 7fee08594e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7feda400ffc0 con 0x559091dc9000 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.515+0000 7fee08594e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7feda400de10 con 0x559091dc3630 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091dc2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 0x559091dc2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091dc2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60800/0 (socket says 10.20.193.28:60800) 2026-02-20T03:24:36.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 -- 10.20.193.28:0/2214092920 learned_addr learned my addr 10.20.193.28:0/2214092920 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 --2- 10.20.193.28:0/2214092920 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 0x559091df30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 -- 10.20.193.28:0/2214092920 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 msgr2=0x559091df30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 --2- 10.20.193.28:0/2214092920 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 0x559091df30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 -- 10.20.193.28:0/2214092920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 msgr2=0x559091dc2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 --2- 10.20.193.28:0/2214092920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 0x559091dc2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 -- 10.20.193.28:0/2214092920 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559091dd5900 con 0x559091dc3630 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedff7fe640 1 --2- 10.20.193.28:0/2214092920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 0x559091dc2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedfeffd640 1 --2- 10.20.193.28:0/2214092920 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091dc2520 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fedf0039ff0 tx=0x7fedf004d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38598cd29cf32972 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedc37fe640 1 -- 10.20.193.28:0/2214092920 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0063070 con 0x559091dc3630 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedc37fe640 1 -- 10.20.193.28:0/2214092920 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fedf0033040 con 0x559091dc3630 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.516+0000 7fedc37fe640 1 -- 10.20.193.28:0/2214092920 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf005ea50 con 0x559091dc3630 2026-02-20T03:24:36.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 -- 10.20.193.28:0/2214092920 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 msgr2=0x559091dc2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:36.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 --2- 10.20.193.28:0/2214092920 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091dc2520 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fedf0039ff0 tx=0x7fedf004d000 comp rx=0 tx=0).stop 2026-02-20T03:24:36.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 -- 10.20.193.28:0/2214092920 shutdown_connections 2026-02-20T03:24:36.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 --2- 10.20.193.28:0/2214092920 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 0x559091df30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 --2- 10.20.193.28:0/2214092920 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 0x559091dc2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 --2- 10.20.193.28:0/2214092920 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091dc2520 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 -- 10.20.193.28:0/2214092920 >> 10.20.193.28:0/2214092920 conn(0x559091d86290 msgr2=0x559091decf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:36.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 -- 10.20.193.28:0/2214092920 shutdown_connections 2026-02-20T03:24:36.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 -- 10.20.193.28:0/2214092920 wait complete. 2026-02-20T03:24:36.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.517+0000 7fee08594e00 1 -- start start 2026-02-20T03:24:36.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fee08594e00 1 Processor -- start 2026-02-20T03:24:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fee08594e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091e50580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fee08594e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 0x559091e50ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fee08594e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 0x559091de7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fee08594e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feda400e480 con 0x559091dc3fb0 2026-02-20T03:24:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fee08594e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7feda400f8f0 con 0x559091dc9000 2026-02-20T03:24:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fee08594e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7feda400eb50 con 0x559091dc3630 2026-02-20T03:24:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedfeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091e50580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 0x559091e50ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedfeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091e50580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60808/0 (socket says 10.20.193.28:60808) 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedfeffd640 1 -- 10.20.193.28:0/4025851916 learned_addr learned my addr 10.20.193.28:0/4025851916 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedfeffd640 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 0x559091de7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedfeffd640 1 -- 10.20.193.28:0/4025851916 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 msgr2=0x559091de7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedfeffd640 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 0x559091de7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedfeffd640 1 -- 10.20.193.28:0/4025851916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 msgr2=0x559091e50ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedfeffd640 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 0x559091e50ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.518+0000 7fedfeffd640 1 -- 10.20.193.28:0/4025851916 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590919f5870 con 0x559091dc3630 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fedfeffd640 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091e50580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fedf0004030 tx=0x7fedf0009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c126c0bea9eb419 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fedc17fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fedc17fa640 1 -- 10.20.193.28:0/4025851916 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0063070 con 0x559091dc3630 2026-02-20T03:24:36.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fee08594e00 1 -- 10.20.193.28:0/4025851916 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559091cb6440 con 0x559091dc3630 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fedc17fa640 1 -- 10.20.193.28:0/4025851916 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x559091d241a0 con 0x559091dc3630 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fedc17fa640 1 -- 10.20.193.28:0/4025851916 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0050d60 con 0x559091dc3630 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fee08594e00 10 client.27238 _ll_register_callbacks cb 0x7fedec0091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fee08594e00 1 -- 10.20.193.28:0/4025851916 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559091cc8b00 con 0x559091dc3630 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fedc17fa640 1 -- 10.20.193.28:0/4025851916 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fedf00743f0 con 0x559091dc3630 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fedc17fa640 1 -- 10.20.193.28:0/4025851916 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fedf0074650 con 0x559091dc3630 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fee08594e00 10 client.27238 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fee08594e00 1 -- 10.20.193.28:0/4025851916 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559091dd65f0 con 0x559091dc3630 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.519+0000 7fedc17fa640 1 -- 10.20.193.28:0/4025851916 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fedf00029b0 con 0x559091dc3630 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.520+0000 7fee08594e00 10 client.27238 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.520+0000 7fee08594e00 10 client.27238 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.520+0000 7fee08594e00 20 client.27238 populate_metadata read hostname 'trial028' 2026-02-20T03:24:36.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.520+0000 7fee08594e00 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559091e58c50 0x559091e5b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.520+0000 7fee08594e00 4 client.27238 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.520+0000 7fee08594e00 1 -- 10.20.193.28:0/4025851916 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fedf0033040 con 0x559091e58c50 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.520+0000 7fedff7fe640 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559091e58c50 0x559091e5b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.520+0000 7fedff7fe640 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559091e58c50 0x559091e5b0e0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36d2f325cb677685 server_cookie=cb989e62f32dd2f2 in_seq=0 out_seq=0 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.520+0000 7fedc17fa640 10 client.27238 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fedc17fa640 1 -- 10.20.193.28:0/4025851916 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fedf0033040 con 0x559091e58c50 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fedc17fa640 10 client.27238 handle_command_reply: tid=0 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 client.27238 shutdown 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 -- 10.20.193.28:0/4025851916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 msgr2=0x559091e50580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091e50580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fedf0004030 tx=0x7fedf0009810 comp rx=0 tx=0).stop 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 -- 10.20.193.28:0/4025851916 shutdown_connections 2026-02-20T03:24:36.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559091e58c50 0x559091e5b0e0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559091dc9000 0x559091de7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559091dc3fb0 0x559091e50ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 --2- 10.20.193.28:0/4025851916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559091dc3630 0x559091e50580 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 -- 10.20.193.28:0/4025851916 >> 10.20.193.28:0/4025851916 conn(0x559091d86290 msgr2=0x559091dc1510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fedc17fa640 0 client.27238 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 -- 10.20.193.28:0/4025851916 shutdown_connections 2026-02-20T03:24:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 1 -- 10.20.193.28:0/4025851916 wait complete. 2026-02-20T03:24:36.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.521+0000 7fee08594e00 20 client.27238 trim_cache size 0 max 16384 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout: "93a9550a-118a-41d4-868e-3e62e0169b65": { 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "93a9550a-118a-41d4-868e-3e62e0169b65", 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:24:36.531 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:24:36.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 -- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedd40b0e20 msgr2=0x7fedd40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:36.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedd40b0e20 0x7fedd40b32e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fedf40a82f0 tx=0x7fedf4009e90 comp rx=0 tx=0).stop 2026-02-20T03:24:36.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 -- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee0010eef0 msgr2=0x7fee001a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:36.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee0010eef0 0x7fee001a5df0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fedf400efc0 tx=0x7fedf400c490 comp rx=0 tx=0).stop 2026-02-20T03:24:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 -- 10.20.193.28:0/3407272876 shutdown_connections 2026-02-20T03:24:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedd40b0e20 0x7fedd40b32e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fee0010eef0 0x7fee001a5df0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fee00109ba0 0x7fee001a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 --2- 10.20.193.28:0/3407272876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fee00109220 0x7fee001a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 -- 10.20.193.28:0/3407272876 >> 10.20.193.28:0/3407272876 conn(0x7fee00078600 msgr2=0x7fee00079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 -- 10.20.193.28:0/3407272876 shutdown_connections 2026-02-20T03:24:36.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:24:36.522+0000 7fee04e06640 1 -- 10.20.193.28:0/3407272876 wait complete. 2026-02-20T03:24:36.623 INFO:tasks.cephfs.filesystem:scrub status for tag:93a9550a-118a-41d4-868e-3e62e0169b65 - {'path': '/', 'tag': '93a9550a-118a-41d4-868e-3e62e0169b65', 'options': 'recursive,force'} 2026-02-20T03:24:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:37 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:24:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:37 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:37 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:24:37.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:37 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:37 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:24:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:37 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:24:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:37 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:37 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:37 trial177 ceph-mon[43181]: pgmap v479: 129 pgs: 129 active+clean; 130 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 963 KiB/s rd, 438 KiB/s wr, 89 op/s 2026-02-20T03:24:37.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 806177 7.40 MB/sec execute 370 sec latency 7.160 ms 2026-02-20T03:24:37.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:37 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:24:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:37 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:37 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:24:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:37 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:37 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:24:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:37 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:24:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:37 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:37 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:37 trial126 ceph-mon[38476]: pgmap v479: 129 pgs: 129 active+clean; 130 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 963 KiB/s rd, 438 KiB/s wr, 89 op/s 2026-02-20T03:24:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:37 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:24:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:37 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:37 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:24:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:37 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:37 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:24:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:37 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:24:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:37 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:37 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:24:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:37 trial028 ceph-mon[38552]: pgmap v479: 129 pgs: 129 active+clean; 130 MiB data, 2.8 GiB used, 8.2 TiB / 8.2 TiB avail; 963 KiB/s rd, 438 KiB/s wr, 89 op/s 2026-02-20T03:24:38.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 809754 7.43 MB/sec execute 371 sec latency 12.341 ms 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.431+0000 7f145f2a3640 1 -- 10.20.193.28:0/3461334916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 msgr2=0x7f1458104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.431+0000 7f145f2a3640 1 --2- 10.20.193.28:0/3461334916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 0x7f1458104d30 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f145400b0a0 tx=0x7f145402f450 comp rx=0 tx=0).stop 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.431+0000 7f145f2a3640 1 -- 10.20.193.28:0/3461334916 shutdown_connections 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.431+0000 7f145f2a3640 1 --2- 10.20.193.28:0/3461334916 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14581064e0 0x7f145810cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.431+0000 7f145f2a3640 1 --2- 10.20.193.28:0/3461334916 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1458105b20 0x7f1458105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.431+0000 7f145f2a3640 1 --2- 10.20.193.28:0/3461334916 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 0x7f1458104d30 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.431+0000 7f145f2a3640 1 -- 10.20.193.28:0/3461334916 >> 10.20.193.28:0/3461334916 conn(0x7f1458100090 msgr2=0x7f14581024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.431+0000 7f145f2a3640 1 -- 10.20.193.28:0/3461334916 shutdown_connections 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.431+0000 7f145f2a3640 1 -- 10.20.193.28:0/3461334916 wait complete. 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.432+0000 7f145f2a3640 1 Processor -- start 2026-02-20T03:24:39.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.432+0000 7f145f2a3640 1 -- start start 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.432+0000 7f145f2a3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 0x7f14580727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.432+0000 7f145f2a3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1458105b20 0x7f1458072ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.432+0000 7f145f2a3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14581064e0 0x7f1458073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.432+0000 7f145f2a3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f145806cdd0 con 0x7f1458104930 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.432+0000 7f145f2a3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f145806cc50 con 0x7f14581064e0 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.432+0000 7f145f2a3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f145806cf50 con 0x7f1458105b20 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145e2a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 0x7f14580727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145e2a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 0x7f14580727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46324/0 (socket says 10.20.193.28:46324) 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145e2a1640 1 -- 10.20.193.28:0/204050545 learned_addr learned my addr 10.20.193.28:0/204050545 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145daa0640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1458105b20 0x7f1458072ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145eaa2640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14581064e0 0x7f1458073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145e2a1640 1 -- 10.20.193.28:0/204050545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1458105b20 msgr2=0x7f1458072ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145e2a1640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1458105b20 0x7f1458072ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145e2a1640 1 -- 10.20.193.28:0/204050545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14581064e0 msgr2=0x7f1458073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145e2a1640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14581064e0 0x7f1458073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145e2a1640 1 -- 10.20.193.28:0/204050545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1458074420 con 0x7f1458104930 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145daa0640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1458105b20 0x7f1458072ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:39.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145e2a1640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 0x7f14580727a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1454004510 tx=0x7f1454004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:39.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f143f7fe640 1 -- 10.20.193.28:0/204050545 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454046070 con 0x7f1458104930 2026-02-20T03:24:39.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145f2a3640 1 -- 10.20.193.28:0/204050545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14580746b0 con 0x7f1458104930 2026-02-20T03:24:39.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f145f2a3640 1 -- 10.20.193.28:0/204050545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1458074bf0 con 0x7f1458104930 2026-02-20T03:24:39.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.433+0000 7f143f7fe640 1 -- 10.20.193.28:0/204050545 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1454009420 con 0x7f1458104930 2026-02-20T03:24:39.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.434+0000 7f143f7fe640 1 -- 10.20.193.28:0/204050545 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540418a0 con 0x7f1458104930 2026-02-20T03:24:39.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f1463464e00 1 Processor -- start 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f1463464e00 1 -- start start 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f1463464e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341b660 0x5566d341ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f143f7fe640 1 -- 10.20.193.28:0/204050545 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1454041a40 con 0x7f1458104930 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f1463464e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341bfc0 0x5566d34209f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f1463464e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d3423440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f1463464e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5566d33638f0 con 0x5566d3421010 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f1463464e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5566d33112e0 con 0x5566d341bfc0 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f1463464e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5566d335f820 con 0x5566d341b660 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f145daa0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d3423440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f145daa0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d3423440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46326/0 (socket says 10.20.193.28:46326) 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f145daa0640 1 -- 10.20.193.28:0/4280625221 learned_addr learned my addr 10.20.193.28:0/4280625221 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.438+0000 7f145eaa2640 1 --2- 10.20.193.28:0/4280625221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341b660 0x5566d341ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f145daa0640 1 -- 10.20.193.28:0/4280625221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341b660 msgr2=0x5566d341ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f145daa0640 1 --2- 10.20.193.28:0/4280625221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341b660 0x5566d341ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f145daa0640 1 -- 10.20.193.28:0/4280625221 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341bfc0 msgr2=0x5566d34209f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f145daa0640 1 --2- 10.20.193.28:0/4280625221 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341bfc0 0x5566d34209f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f145daa0640 1 -- 10.20.193.28:0/4280625221 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d33035a0 con 0x5566d3421010 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f145daa0640 1 --2- 10.20.193.28:0/4280625221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d3423440 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1448002b90 tx=0x7f1448002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbecc84f7cf5636f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:39.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f14263ff640 1 -- 10.20.193.28:0/4280625221 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144800fd30 con 0x5566d3421010 2026-02-20T03:24:39.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f14263ff640 1 -- 10.20.193.28:0/4280625221 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f14480118e0 con 0x5566d3421010 2026-02-20T03:24:39.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f14263ff640 1 -- 10.20.193.28:0/4280625221 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14480198d0 con 0x5566d3421010 2026-02-20T03:24:39.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f1463464e00 1 -- 10.20.193.28:0/4280625221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 msgr2=0x5566d3423440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:39.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f1463464e00 1 --2- 10.20.193.28:0/4280625221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d3423440 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1448002b90 tx=0x7f1448002f90 comp rx=0 tx=0).stop 2026-02-20T03:24:39.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.439+0000 7f143f7fe640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14340b0ea0 0x7f14340b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.440+0000 7f143f7fe640 1 -- 10.20.193.28:0/204050545 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1454105640 con 0x7f1458104930 2026-02-20T03:24:39.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.440+0000 7f145eaa2640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14340b0ea0 0x7f14340b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.440+0000 7f1463464e00 1 -- 10.20.193.28:0/4280625221 shutdown_connections 2026-02-20T03:24:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.440+0000 7f1463464e00 1 --2- 10.20.193.28:0/4280625221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d3423440 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.440+0000 7f1463464e00 1 --2- 10.20.193.28:0/4280625221 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341bfc0 0x5566d34209f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.440+0000 7f1463464e00 1 --2- 10.20.193.28:0/4280625221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341b660 0x5566d341ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.440+0000 7f1463464e00 1 -- 10.20.193.28:0/4280625221 >> 10.20.193.28:0/4280625221 conn(0x5566d340a2d0 msgr2=0x5566d3411150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:39.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.440+0000 7f1463464e00 1 -- 10.20.193.28:0/4280625221 shutdown_connections 2026-02-20T03:24:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.440+0000 7f1463464e00 1 -- 10.20.193.28:0/4280625221 wait complete. 2026-02-20T03:24:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.441+0000 7f145eaa2640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14340b0ea0 0x7f14340b3360 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5566d341c960 tx=0x7f144c004180 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.441+0000 7f1463464e00 1 -- start start 2026-02-20T03:24:39.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.442+0000 7f1463464e00 1 Processor -- start 2026-02-20T03:24:39.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f1463464e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 0x5566d343cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f1463464e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341bfc0 0x5566d343d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f1463464e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d3421010 0x5566d3444120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f1463464e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5566d330b0c0 con 0x5566d341bfc0 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f1463464e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5566d3412e60 con 0x5566d341b660 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f1463464e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5566d34446b0 con 0x5566d3421010 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f145e2a1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 0x5566d343cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f145e2a1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 0x5566d343cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48182/0 (socket says 10.20.193.28:48182) 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f145e2a1640 1 -- 10.20.193.28:0/4291170058 learned_addr learned my addr 10.20.193.28:0/4291170058 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f145daa0640 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341bfc0 0x5566d343d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.443+0000 7f145eaa2640 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d3421010 0x5566d3444120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f145daa0640 1 -- 10.20.193.28:0/4291170058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d3421010 msgr2=0x5566d3444120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f145daa0640 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d3421010 0x5566d3444120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f145daa0640 1 -- 10.20.193.28:0/4291170058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 msgr2=0x5566d343cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:39.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f145daa0640 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 0x5566d343cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f145daa0640 1 -- 10.20.193.28:0/4291170058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d3436480 con 0x5566d341bfc0 2026-02-20T03:24:39.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f145daa0640 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341bfc0 0x5566d343d2a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1448002b60 tx=0x7f14480116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ae78575a065237 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:39.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f14137fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f14137fe640 1 -- 10.20.193.28:0/4291170058 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144800fd40 con 0x5566d341bfc0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f14137fe640 1 -- 10.20.193.28:0/4291170058 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1448005030 con 0x5566d341bfc0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f14137fe640 1 -- 10.20.193.28:0/4291170058 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448004b10 con 0x5566d341bfc0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f1463464e00 1 -- 10.20.193.28:0/4291170058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566d331f820 con 0x5566d341bfc0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f1463464e00 10 client.18129 _ll_register_callbacks cb 0x5566d330eff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.444+0000 7f1463464e00 1 -- 10.20.193.28:0/4291170058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566d336b4e0 con 0x5566d341bfc0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f14137fe640 1 -- 10.20.193.28:0/4291170058 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f1448004cb0 con 0x5566d341bfc0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f14137fe640 1 -- 10.20.193.28:0/4291170058 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1448011a90 con 0x5566d341bfc0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f1463464e00 10 client.18129 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f1463464e00 1 -- 10.20.193.28:0/4291170058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5566d3324380 con 0x5566d341bfc0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f14137fe640 1 -- 10.20.193.28:0/4291170058 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f144802c030 con 0x5566d341bfc0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f1463464e00 10 client.18129 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f1463464e00 10 client.18129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f1463464e00 20 client.18129 populate_metadata read hostname 'trial028' 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f1463464e00 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566d3448660 0x5566d344ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f1463464e00 4 client.18129 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.445+0000 7f1463464e00 1 -- 10.20.193.28:0/4291170058 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566d32e5bd0 con 0x5566d3448660 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.446+0000 7f145e2a1640 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566d3448660 0x5566d344ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.446+0000 7f145e2a1640 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566d3448660 0x5566d344ab20 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee4a4f0667eef1f1 server_cookie=34fac416a2d4eba5 in_seq=0 out_seq=0 2026-02-20T03:24:39.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.446+0000 7f14137fe640 10 client.18129 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.447+0000 7f14137fe640 1 -- 10.20.193.28:0/4291170058 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5566d32e5bd0 con 0x5566d3448660 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.447+0000 7f14137fe640 10 client.18129 handle_command_reply: tid=0 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.447+0000 7f1463464e00 1 client.18129 shutdown 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 -- 10.20.193.28:0/4291170058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341bfc0 msgr2=0x5566d343d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341bfc0 0x5566d343d2a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1448002b60 tx=0x7f14480116e0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 -- 10.20.193.28:0/4291170058 shutdown_connections 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566d3448660 0x5566d344ab20 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d3421010 0x5566d3444120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341bfc0 0x5566d343d2a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 --2- 10.20.193.28:0/4291170058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 0x5566d343cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 -- 10.20.193.28:0/4291170058 >> 10.20.193.28:0/4291170058 conn(0x5566d340a2d0 msgr2=0x5566d3422320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f14137fe640 0 client.18129 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 -- 10.20.193.28:0/4291170058 shutdown_connections 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 1 -- 10.20.193.28:0/4291170058 wait complete. 2026-02-20T03:24:39.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.448+0000 7f1463464e00 20 client.18129 trim_cache size 0 max 16384 2026-02-20T03:24:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f1463464e00 1 Processor -- start 2026-02-20T03:24:39.458 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f1463464e00 1 -- start start 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f1463464e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 0x5566d341c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f1463464e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341bfc0 0x5566d34440e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f1463464e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d341ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f1463464e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1404012720 con 0x5566d3421010 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f1463464e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f140400fff0 con 0x5566d341b660 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f1463464e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f140400de40 con 0x5566d341bfc0 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f145daa0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341bfc0 0x5566d34440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f145eaa2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d341ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f145daa0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341bfc0 0x5566d34440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60838/0 (socket says 10.20.193.28:60838) 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.456+0000 7f145daa0640 1 -- 10.20.193.28:0/442463999 learned_addr learned my addr 10.20.193.28:0/442463999 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f145e2a1640 1 --2- 10.20.193.28:0/442463999 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 0x5566d341c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f145eaa2640 1 -- 10.20.193.28:0/442463999 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341bfc0 msgr2=0x5566d34440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f145eaa2640 1 --2- 10.20.193.28:0/442463999 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341bfc0 0x5566d34440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f145eaa2640 1 -- 10.20.193.28:0/442463999 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 msgr2=0x5566d341c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f145eaa2640 1 --2- 10.20.193.28:0/442463999 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 0x5566d341c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f145eaa2640 1 -- 10.20.193.28:0/442463999 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d34362b0 con 0x5566d3421010 2026-02-20T03:24:39.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f145eaa2640 1 --2- 10.20.193.28:0/442463999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d341ced0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f144c012820 tx=0x7f144c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b22756f7a44387 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f1425bfe640 1 -- 10.20.193.28:0/442463999 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c01b620 con 0x5566d3421010 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f1425bfe640 1 -- 10.20.193.28:0/442463999 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f144c01fe50 con 0x5566d3421010 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f1425bfe640 1 -- 10.20.193.28:0/442463999 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c027c10 con 0x5566d3421010 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f1463464e00 1 -- 10.20.193.28:0/442463999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 msgr2=0x5566d341ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.457+0000 7f1463464e00 1 --2- 10.20.193.28:0/442463999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d341ced0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f144c012820 tx=0x7f144c015000 comp rx=0 tx=0).stop 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.458+0000 7f1463464e00 1 -- 10.20.193.28:0/442463999 shutdown_connections 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.458+0000 7f1463464e00 1 --2- 10.20.193.28:0/442463999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d3421010 0x5566d341ced0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.458+0000 7f1463464e00 1 --2- 10.20.193.28:0/442463999 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d341bfc0 0x5566d34440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.458+0000 7f1463464e00 1 --2- 10.20.193.28:0/442463999 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341b660 0x5566d341c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.458+0000 7f1463464e00 1 -- 10.20.193.28:0/442463999 >> 10.20.193.28:0/442463999 conn(0x5566d340a2d0 msgr2=0x5566d34213f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:39.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.458+0000 7f1463464e00 1 -- 10.20.193.28:0/442463999 shutdown_connections 2026-02-20T03:24:39.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.458+0000 7f1463464e00 1 -- 10.20.193.28:0/442463999 wait complete. 2026-02-20T03:24:39.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f1463464e00 1 -- start start 2026-02-20T03:24:39.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f1463464e00 1 Processor -- start 2026-02-20T03:24:39.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f1463464e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341b660 0x5566d3444010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f1463464e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341bfc0 0x5566d3440b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f1463464e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d3421010 0x5566d3441070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f1463464e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f140400e4b0 con 0x5566d341b660 2026-02-20T03:24:39.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f1463464e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f140400f920 con 0x5566d341bfc0 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f1463464e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f140400eb80 con 0x5566d3421010 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f145e2a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341b660 0x5566d3444010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f145e2a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341b660 0x5566d3444010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:46354/0 (socket says 10.20.193.28:46354) 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.459+0000 7f145e2a1640 1 -- 10.20.193.28:0/4274493042 learned_addr learned my addr 10.20.193.28:0/4274493042 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f145daa0640 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341bfc0 0x5566d3440b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f145e2a1640 1 -- 10.20.193.28:0/4274493042 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d3421010 msgr2=0x5566d3441070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f145e2a1640 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d3421010 0x5566d3441070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f145e2a1640 1 -- 10.20.193.28:0/4274493042 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341bfc0 msgr2=0x5566d3440b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f145e2a1640 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341bfc0 0x5566d3440b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f145e2a1640 1 -- 10.20.193.28:0/4274493042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d341e1a0 con 0x5566d341b660 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f145e2a1640 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341b660 0x5566d3444010 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f14540c89d0 tx=0x7f14540096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4388a48071e9d75 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f14137fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f14137fe640 1 -- 10.20.193.28:0/4274493042 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454104040 con 0x5566d341b660 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f14137fe640 1 -- 10.20.193.28:0/4274493042 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1454033030 con 0x5566d341b660 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f14137fe640 1 -- 10.20.193.28:0/4274493042 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14540c8ca0 con 0x5566d341b660 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f1463464e00 1 -- 10.20.193.28:0/4274493042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566d30c3690 con 0x5566d341b660 2026-02-20T03:24:39.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f14137fe640 1 -- 10.20.193.28:0/4274493042 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f14540d1120 con 0x5566d341b660 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f14137fe640 10 client.18135 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f1463464e00 10 client.18135 _ll_register_callbacks cb 0x7f1448002850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f1463464e00 1 -- 10.20.193.28:0/4274493042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566d313c520 con 0x5566d341b660 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f14137fe640 1 -- 10.20.193.28:0/4274493042 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f14540c9360 con 0x5566d341b660 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f1463464e00 10 client.18135 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f1463464e00 1 -- 10.20.193.28:0/4274493042 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5566d3328b70 con 0x5566d341b660 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.460+0000 7f14137fe640 1 -- 10.20.193.28:0/4274493042 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f14540d1320 con 0x5566d341b660 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.461+0000 7f1463464e00 10 client.18135 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.461+0000 7f1463464e00 10 client.18135 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.461+0000 7f1463464e00 20 client.18135 populate_metadata read hostname 'trial028' 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.461+0000 7f1463464e00 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566d34b49b0 0x5566d34b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.461+0000 7f1463464e00 4 client.18135 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.461+0000 7f1463464e00 1 -- 10.20.193.28:0/4274493042 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5566d3371290 con 0x5566d34b49b0 2026-02-20T03:24:39.463 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.461+0000 7f145daa0640 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566d34b49b0 0x5566d34b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.462+0000 7f145daa0640 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566d34b49b0 0x5566d34b6e70 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95a092f66ba103c7 server_cookie=89249b07dfec4088 in_seq=0 out_seq=0 2026-02-20T03:24:39.464 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.462+0000 7f14137fe640 10 client.18135 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:39 trial177 ceph-mon[43181]: pgmap v480: 129 pgs: 129 active+clean; 131 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 606 KiB/s wr, 108 op/s 2026-02-20T03:24:39.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 813273 7.46 MB/sec execute 372 sec latency 32.526 ms 2026-02-20T03:24:39.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f14137fe640 1 -- 10.20.193.28:0/4274493042 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5566d3371290 con 0x5566d34b49b0 2026-02-20T03:24:39.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f14137fe640 10 client.18135 handle_command_reply: tid=0 2026-02-20T03:24:39.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f1463464e00 1 client.18135 shutdown 2026-02-20T03:24:39.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f1463464e00 1 -- 10.20.193.28:0/4274493042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341b660 msgr2=0x5566d3444010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:39.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f1463464e00 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341b660 0x5566d3444010 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f14540c89d0 tx=0x7f14540096e0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f1463464e00 1 -- 10.20.193.28:0/4274493042 shutdown_connections 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f1463464e00 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566d34b49b0 0x5566d34b6e70 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f1463464e00 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566d3421010 0x5566d3441070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f1463464e00 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566d341bfc0 0x5566d3440b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f1463464e00 1 --2- 10.20.193.28:0/4274493042 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566d341b660 0x5566d3444010 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f1463464e00 1 -- 10.20.193.28:0/4274493042 >> 10.20.193.28:0/4274493042 conn(0x5566d340a2d0 msgr2=0x5566d3421c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.545+0000 7f14137fe640 0 client.18135 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.546+0000 7f1463464e00 1 -- 10.20.193.28:0/4274493042 shutdown_connections 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.546+0000 7f1463464e00 1 -- 10.20.193.28:0/4274493042 wait complete. 2026-02-20T03:24:39.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.546+0000 7f1463464e00 20 client.18135 trim_cache size 0 max 16384 2026-02-20T03:24:39.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:24:39.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:24:39.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:24:39.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:24:39.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.547+0000 7f145f2a3640 1 -- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14340b0ea0 msgr2=0x7f14340b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:39.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.547+0000 7f145f2a3640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14340b0ea0 0x7f14340b3360 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x5566d341c960 tx=0x7f144c004180 comp rx=0 tx=0).stop 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.547+0000 7f145f2a3640 1 -- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 msgr2=0x7f14580727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.547+0000 7f145f2a3640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 0x7f14580727a0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1454004510 tx=0x7f1454004290 comp rx=0 tx=0).stop 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.548+0000 7f145f2a3640 1 -- 10.20.193.28:0/204050545 shutdown_connections 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.548+0000 7f145f2a3640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14340b0ea0 0x7f14340b3360 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.548+0000 7f145f2a3640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f14581064e0 0x7f1458073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.548+0000 7f145f2a3640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1458105b20 0x7f1458072ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.548+0000 7f145f2a3640 1 --2- 10.20.193.28:0/204050545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1458104930 0x7f14580727a0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.548+0000 7f145f2a3640 1 -- 10.20.193.28:0/204050545 >> 10.20.193.28:0/204050545 conn(0x7f1458100090 msgr2=0x7f1458108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.548+0000 7f145f2a3640 1 -- 10.20.193.28:0/204050545 shutdown_connections 2026-02-20T03:24:39.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:39.548+0000 7f145f2a3640 1 -- 10.20.193.28:0/204050545 wait complete. 2026-02-20T03:24:39.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:39 trial126 ceph-mon[38476]: pgmap v480: 129 pgs: 129 active+clean; 131 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 606 KiB/s wr, 108 op/s 2026-02-20T03:24:39.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:39 trial028 ceph-mon[38552]: pgmap v480: 129 pgs: 129 active+clean; 131 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 606 KiB/s wr, 108 op/s 2026-02-20T03:24:40.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:24:40.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:24:40.469 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 816729 7.49 MB/sec execute 373 sec latency 16.102 ms 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:24:40.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:24:40.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:24:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:24:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:41 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial177 to 16915M 2026-02-20T03:24:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:41 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial126 to 16915M 2026-02-20T03:24:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:41 trial177 ceph-mon[43181]: Adjusting osd_memory_target on trial028 to 16917M 2026-02-20T03:24:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:41 trial177 ceph-mon[43181]: pgmap v481: 129 pgs: 129 active+clean; 136 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2026-02-20T03:24:41.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 820244 7.52 MB/sec execute 374 sec latency 9.449 ms 2026-02-20T03:24:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:41 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial177 to 16915M 2026-02-20T03:24:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:41 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial126 to 16915M 2026-02-20T03:24:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:41 trial126 ceph-mon[38476]: Adjusting osd_memory_target on trial028 to 16917M 2026-02-20T03:24:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:41 trial126 ceph-mon[38476]: pgmap v481: 129 pgs: 129 active+clean; 136 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2026-02-20T03:24:41.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:41 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial177 to 16915M 2026-02-20T03:24:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:41 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial126 to 16915M 2026-02-20T03:24:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:41 trial028 ceph-mon[38552]: Adjusting osd_memory_target on trial028 to 16917M 2026-02-20T03:24:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:41 trial028 ceph-mon[38552]: pgmap v481: 129 pgs: 129 active+clean; 136 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 1.3 MiB/s wr, 249 op/s 2026-02-20T03:24:42.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 823813 7.55 MB/sec execute 375 sec latency 7.383 ms 2026-02-20T03:24:43.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:43 trial177 ceph-mon[43181]: pgmap v482: 129 pgs: 129 active+clean; 137 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2026-02-20T03:24:43.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:43 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:24:43.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:43 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:24:43.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 827373 7.58 MB/sec execute 376 sec latency 7.067 ms 2026-02-20T03:24:43.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:43 trial126 ceph-mon[38476]: pgmap v482: 129 pgs: 129 active+clean; 137 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2026-02-20T03:24:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:43 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:24:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:43 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:24:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:43 trial028 ceph-mon[38552]: pgmap v482: 129 pgs: 129 active+clean; 137 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 MiB/s rd, 1.3 MiB/s wr, 265 op/s 2026-02-20T03:24:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:43 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:24:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:43 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:24:44.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:44 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:24:44.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 831037 7.62 MB/sec execute 377 sec latency 7.409 ms 2026-02-20T03:24:44.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:44 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:24:44.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:44 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:24:45.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:45 trial177 ceph-mon[43181]: pgmap v483: 129 pgs: 129 active+clean; 142 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 1.9 MiB/s wr, 401 op/s 2026-02-20T03:24:45.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 834693 7.65 MB/sec execute 378 sec latency 8.327 ms 2026-02-20T03:24:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:45 trial126 ceph-mon[38476]: pgmap v483: 129 pgs: 129 active+clean; 142 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 1.9 MiB/s wr, 401 op/s 2026-02-20T03:24:45.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:45 trial028 ceph-mon[38552]: pgmap v483: 129 pgs: 129 active+clean; 142 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 1.9 MiB/s wr, 401 op/s 2026-02-20T03:24:46.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 838301 7.68 MB/sec execute 379 sec latency 8.316 ms 2026-02-20T03:24:47.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:47 trial177 ceph-mon[43181]: pgmap v484: 129 pgs: 129 active+clean; 140 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.1 MiB/s wr, 439 op/s 2026-02-20T03:24:47.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 841882 7.71 MB/sec execute 380 sec latency 7.540 ms 2026-02-20T03:24:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:47 trial126 ceph-mon[38476]: pgmap v484: 129 pgs: 129 active+clean; 140 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.1 MiB/s wr, 439 op/s 2026-02-20T03:24:47.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:47 trial028 ceph-mon[38552]: pgmap v484: 129 pgs: 129 active+clean; 140 MiB data, 2.9 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.1 MiB/s wr, 439 op/s 2026-02-20T03:24:48.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 845475 7.74 MB/sec execute 381 sec latency 9.900 ms 2026-02-20T03:24:49.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:49 trial177 ceph-mon[43181]: pgmap v485: 129 pgs: 129 active+clean; 145 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 464 op/s 2026-02-20T03:24:49.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 849153 7.77 MB/sec execute 382 sec latency 6.304 ms 2026-02-20T03:24:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:49 trial126 ceph-mon[38476]: pgmap v485: 129 pgs: 129 active+clean; 145 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 464 op/s 2026-02-20T03:24:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:49 trial028 ceph-mon[38552]: pgmap v485: 129 pgs: 129 active+clean; 145 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 464 op/s 2026-02-20T03:24:50.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 852794 7.80 MB/sec execute 383 sec latency 11.098 ms 2026-02-20T03:24:51.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:51 trial177 ceph-mon[43181]: pgmap v486: 129 pgs: 129 active+clean; 148 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 MiB/s rd, 2.4 MiB/s wr, 490 op/s 2026-02-20T03:24:51.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 856337 7.83 MB/sec execute 384 sec latency 7.433 ms 2026-02-20T03:24:51.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:51 trial126 ceph-mon[38476]: pgmap v486: 129 pgs: 129 active+clean; 148 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 MiB/s rd, 2.4 MiB/s wr, 490 op/s 2026-02-20T03:24:51.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:51 trial028 ceph-mon[38552]: pgmap v486: 129 pgs: 129 active+clean; 148 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 5.6 MiB/s rd, 2.4 MiB/s wr, 490 op/s 2026-02-20T03:24:52.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 859924 7.86 MB/sec execute 385 sec latency 6.887 ms 2026-02-20T03:24:52.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.628+0000 7f4766f75640 1 -- 10.20.193.28:0/1761657322 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4760109490 msgr2=0x7f4760109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:52.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.628+0000 7f4766f75640 1 --2- 10.20.193.28:0/1761657322 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4760109490 0x7f4760109890 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4750009a30 tx=0x7f475002f220 comp rx=0 tx=0).stop 2026-02-20T03:24:52.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 -- 10.20.193.28:0/1761657322 shutdown_connections 2026-02-20T03:24:52.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 --2- 10.20.193.28:0/1761657322 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f476010a900 0x7f4760111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 --2- 10.20.193.28:0/1761657322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4760109e60 0x7f476010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 --2- 10.20.193.28:0/1761657322 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4760109490 0x7f4760109890 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 -- 10.20.193.28:0/1761657322 >> 10.20.193.28:0/1761657322 conn(0x7f4760077fe0 msgr2=0x7f476007a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:52.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 -- 10.20.193.28:0/1761657322 shutdown_connections 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 -- 10.20.193.28:0/1761657322 wait complete. 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 Processor -- start 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 -- start start 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4760109490 0x7f47601a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4760109e60 0x7f47601a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f476010a900 0x7f47601a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47601148f0 con 0x7f4760109490 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4760114770 con 0x7f476010a900 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.629+0000 7f4766f75640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4760114a70 con 0x7f4760109e60 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765f73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4760109490 0x7f47601a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765772640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4760109e60 0x7f47601a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765f73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4760109490 0x7f47601a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35274/0 (socket says 10.20.193.28:35274) 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765f73640 1 -- 10.20.193.28:0/3980183698 learned_addr learned my addr 10.20.193.28:0/3980183698 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:52.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4766774640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f476010a900 0x7f47601a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765f73640 1 -- 10.20.193.28:0/3980183698 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4760109e60 msgr2=0x7f47601a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765f73640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4760109e60 0x7f47601a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765f73640 1 -- 10.20.193.28:0/3980183698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f476010a900 msgr2=0x7f47601a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765f73640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f476010a900 0x7f47601a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765f73640 1 -- 10.20.193.28:0/3980183698 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47601a8bb0 con 0x7f4760109490 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4766774640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f476010a900 0x7f47601a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4765f73640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4760109490 0x7f47601a0f00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4750005a40 tx=0x7f4750002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f474effd640 1 -- 10.20.193.28:0/3980183698 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475002fe10 con 0x7f4760109490 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f474effd640 1 -- 10.20.193.28:0/3980183698 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f47500044f0 con 0x7f4760109490 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f474effd640 1 -- 10.20.193.28:0/3980183698 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4750041620 con 0x7f4760109490 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4766f75640 1 -- 10.20.193.28:0/3980183698 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47601a8e40 con 0x7f4760109490 2026-02-20T03:24:52.633 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.630+0000 7f4766f75640 1 -- 10.20.193.28:0/3980183698 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47601a91f0 con 0x7f4760109490 2026-02-20T03:24:52.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f474effd640 1 -- 10.20.193.28:0/3980183698 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4750004050 con 0x7f4760109490 2026-02-20T03:24:52.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f476b060e00 1 Processor -- start 2026-02-20T03:24:52.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f476b060e00 1 -- start start 2026-02-20T03:24:52.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f476b060e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f259e80 0x56106f25a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f476b060e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25a7c0 0x56106f25ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f476b060e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f25f560 0x56106f2619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f476b060e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56106f1aa8f0 con 0x56106f25f560 2026-02-20T03:24:52.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f476b060e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56106f1582e0 con 0x56106f25a7c0 2026-02-20T03:24:52.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f476b060e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56106f1a6820 con 0x56106f259e80 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4766774640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f259e80 0x56106f25a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4765772640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f25f560 0x56106f2619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4766774640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f259e80 0x56106f25a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33948/0 (socket says 10.20.193.28:33948) 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4766774640 1 -- 10.20.193.28:0/2935742150 learned_addr learned my addr 10.20.193.28:0/2935742150 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4765f73640 1 --2- 10.20.193.28:0/2935742150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25a7c0 0x56106f25ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4766774640 1 -- 10.20.193.28:0/2935742150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25a7c0 msgr2=0x56106f25ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4766774640 1 --2- 10.20.193.28:0/2935742150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25a7c0 0x56106f25ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4766774640 1 -- 10.20.193.28:0/2935742150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f25f560 msgr2=0x56106f2619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4766774640 1 --2- 10.20.193.28:0/2935742150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f25f560 0x56106f2619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.634+0000 7f4766774640 1 -- 10.20.193.28:0/2935742150 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106f14a5a0 con 0x56106f259e80 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f4766774640 1 --2- 10.20.193.28:0/2935742150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f259e80 0x56106f25a280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f475c002e60 tx=0x7f475c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7efb70f85f7f9bd4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f472e3ff640 1 -- 10.20.193.28:0/2935742150 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c01b070 con 0x56106f259e80 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f472e3ff640 1 -- 10.20.193.28:0/2935742150 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f475c0079a0 con 0x56106f259e80 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f472e3ff640 1 -- 10.20.193.28:0/2935742150 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c014aa0 con 0x56106f259e80 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f476b060e00 1 -- 10.20.193.28:0/2935742150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f259e80 msgr2=0x56106f25a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:52.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f476b060e00 1 --2- 10.20.193.28:0/2935742150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f259e80 0x56106f25a280 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f475c002e60 tx=0x7f475c009920 comp rx=0 tx=0).stop 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f476b060e00 1 -- 10.20.193.28:0/2935742150 shutdown_connections 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f476b060e00 1 --2- 10.20.193.28:0/2935742150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f25f560 0x56106f2619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f476b060e00 1 --2- 10.20.193.28:0/2935742150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25a7c0 0x56106f25ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f476b060e00 1 --2- 10.20.193.28:0/2935742150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f259e80 0x56106f25a280 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f476b060e00 1 -- 10.20.193.28:0/2935742150 >> 10.20.193.28:0/2935742150 conn(0x56106f2516f0 msgr2=0x56106f258570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f476b060e00 1 -- 10.20.193.28:0/2935742150 shutdown_connections 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f476b060e00 1 -- 10.20.193.28:0/2935742150 wait complete. 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f474effd640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f473c0b0d80 0x7f473c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.635+0000 7f474effd640 1 -- 10.20.193.28:0/3980183698 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f4750105310 con 0x7f4760109490 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.636+0000 7f4765772640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f473c0b0d80 0x7f473c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.636+0000 7f4765772640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f473c0b0d80 0x7f473c0b3240 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f47601a2410 tx=0x7f4754009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:52.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.636+0000 7f476b060e00 1 -- start start 2026-02-20T03:24:52.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f476b060e00 1 Processor -- start 2026-02-20T03:24:52.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f476b060e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f272950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f476b060e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f272e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f476b060e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f279d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f476b060e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56106f1520c0 con 0x56106f259e80 2026-02-20T03:24:52.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f476b060e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56106f262610 con 0x56106f25f560 2026-02-20T03:24:52.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f476b060e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56106f27a2a0 con 0x56106f25a7c0 2026-02-20T03:24:52.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765772640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f272e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765f73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f272950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765f73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f272950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35302/0 (socket says 10.20.193.28:35302) 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765f73640 1 -- 10.20.193.28:0/1762291701 learned_addr learned my addr 10.20.193.28:0/1762291701 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4766774640 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f279d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765f73640 1 -- 10.20.193.28:0/1762291701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 msgr2=0x56106f272e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765f73640 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f272e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765f73640 1 -- 10.20.193.28:0/1762291701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 msgr2=0x56106f279d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765f73640 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f279d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765f73640 1 -- 10.20.193.28:0/1762291701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106f26c090 con 0x56106f259e80 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f4765f73640 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f272950 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f47500ca010 tx=0x7f47500046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bddab01dcbf8f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.637+0000 7f471b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f471b7fe640 1 -- 10.20.193.28:0/1762291701 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47500c8c60 con 0x56106f259e80 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f471b7fe640 1 -- 10.20.193.28:0/1762291701 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4750033070 con 0x56106f259e80 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f471b7fe640 1 -- 10.20.193.28:0/1762291701 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47500cc510 con 0x56106f259e80 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 1 -- 10.20.193.28:0/1762291701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56106f166820 con 0x56106f259e80 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f471b7fe640 1 -- 10.20.193.28:0/1762291701 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f47500c8970 con 0x56106f259e80 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f471b7fe640 10 client.18147 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 10 client.18147 _ll_register_callbacks cb 0x56106f155ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:52.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 1 -- 10.20.193.28:0/1762291701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56106f1b24e0 con 0x56106f259e80 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f471b7fe640 1 -- 10.20.193.28:0/1762291701 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f47500cc6f0 con 0x56106f259e80 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 10 client.18147 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 1 -- 10.20.193.28:0/1762291701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56106f16b380 con 0x56106f259e80 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f471b7fe640 1 -- 10.20.193.28:0/1762291701 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f47500b5040 con 0x56106f259e80 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 10 client.18147 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 10 client.18147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 20 client.18147 populate_metadata read hostname 'trial028' 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56106f27e550 0x56106f280a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 4 client.18147 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.638+0000 7f476b060e00 1 -- 10.20.193.28:0/1762291701 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56106f12cbd0 con 0x56106f27e550 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.639+0000 7f4765772640 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56106f27e550 0x56106f280a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.639+0000 7f4765772640 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56106f27e550 0x56106f280a10 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=514b3530fc1e4c server_cookie=250be68f4c6c7ba2 in_seq=0 out_seq=0 2026-02-20T03:24:52.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.639+0000 7f471b7fe640 10 client.18147 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:52.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f471b7fe640 1 -- 10.20.193.28:0/1762291701 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56106f12cbd0 con 0x56106f27e550 2026-02-20T03:24:52.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f471b7fe640 10 client.18147 handle_command_reply: tid=0 2026-02-20T03:24:52.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 client.18147 shutdown 2026-02-20T03:24:52.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 -- 10.20.193.28:0/1762291701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 msgr2=0x56106f272950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:52.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f272950 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f47500ca010 tx=0x7f47500046a0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 -- 10.20.193.28:0/1762291701 shutdown_connections 2026-02-20T03:24:52.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56106f27e550 0x56106f280a10 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f279d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f272e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 --2- 10.20.193.28:0/1762291701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f272950 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f471b7fe640 0 client.18147 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:52.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 -- 10.20.193.28:0/1762291701 >> 10.20.193.28:0/1762291701 conn(0x56106f2516f0 msgr2=0x56106f2608f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:52.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 -- 10.20.193.28:0/1762291701 shutdown_connections 2026-02-20T03:24:52.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 1 -- 10.20.193.28:0/1762291701 wait complete. 2026-02-20T03:24:52.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.640+0000 7f476b060e00 20 client.18147 trim_cache size 0 max 16384 2026-02-20T03:24:52.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f476b060e00 1 Processor -- start 2026-02-20T03:24:52.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f476b060e00 1 -- start start 2026-02-20T03:24:52.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f476b060e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f257d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f476b060e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f279cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f476b060e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f258290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f476b060e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f470c0126a0 con 0x56106f259e80 2026-02-20T03:24:52.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f476b060e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f470c00ff70 con 0x56106f25f560 2026-02-20T03:24:52.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f476b060e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f470c00ddc0 con 0x56106f25a7c0 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765f73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f257d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765772640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f279cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765f73640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f257d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35304/0 (socket says 10.20.193.28:35304) 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765f73640 1 -- 10.20.193.28:0/52672439 learned_addr learned my addr 10.20.193.28:0/52672439 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765772640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f279cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33960/0 (socket says 10.20.193.28:33960) 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4766774640 1 --2- 10.20.193.28:0/52672439 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f258290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765772640 1 -- 10.20.193.28:0/52672439 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 msgr2=0x56106f258290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765772640 1 --2- 10.20.193.28:0/52672439 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f258290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765772640 1 -- 10.20.193.28:0/52672439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 msgr2=0x56106f257d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765772640 1 --2- 10.20.193.28:0/52672439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f257d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765772640 1 -- 10.20.193.28:0/52672439 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106f26bec0 con 0x56106f25a7c0 2026-02-20T03:24:52.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.648+0000 7f4765f73640 1 --2- 10.20.193.28:0/52672439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f257d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f4765772640 1 --2- 10.20.193.28:0/52672439 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f279cd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x56106f281290 tx=0x7f475400e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96e11d954f387406 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f472dbfe640 1 -- 10.20.193.28:0/52672439 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475402a420 con 0x56106f25a7c0 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f472dbfe640 1 -- 10.20.193.28:0/52672439 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f475402aa60 con 0x56106f25a7c0 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f472dbfe640 1 -- 10.20.193.28:0/52672439 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475401c8a0 con 0x56106f25a7c0 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f476b060e00 1 -- 10.20.193.28:0/52672439 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 msgr2=0x56106f279cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f476b060e00 1 --2- 10.20.193.28:0/52672439 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f279cd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x56106f281290 tx=0x7f475400e000 comp rx=0 tx=0).stop 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f476b060e00 1 -- 10.20.193.28:0/52672439 shutdown_connections 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f476b060e00 1 --2- 10.20.193.28:0/52672439 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f258290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f476b060e00 1 --2- 10.20.193.28:0/52672439 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f279cd0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f476b060e00 1 --2- 10.20.193.28:0/52672439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f257d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f476b060e00 1 -- 10.20.193.28:0/52672439 >> 10.20.193.28:0/52672439 conn(0x56106f2516f0 msgr2=0x56106f25f940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f476b060e00 1 -- 10.20.193.28:0/52672439 shutdown_connections 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.649+0000 7f476b060e00 1 -- 10.20.193.28:0/52672439 wait complete. 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f476b060e00 1 -- start start 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f476b060e00 1 Processor -- start 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f476b060e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f2799d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f476b060e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f276560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f476b060e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f276aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f476b060e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f470c00e430 con 0x56106f259e80 2026-02-20T03:24:52.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f476b060e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f470c00f8a0 con 0x56106f25f560 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f476b060e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f470c00eb00 con 0x56106f25a7c0 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4765772640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f276560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4765772640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f276560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33972/0 (socket says 10.20.193.28:33972) 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4765772640 1 -- 10.20.193.28:0/3190705245 learned_addr learned my addr 10.20.193.28:0/3190705245 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4766774640 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f276aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4765f73640 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f2799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4765772640 1 -- 10.20.193.28:0/3190705245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 msgr2=0x56106f276aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4765772640 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f276aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4765772640 1 -- 10.20.193.28:0/3190705245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 msgr2=0x56106f2799d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4765772640 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f2799d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.650+0000 7f4765772640 1 -- 10.20.193.28:0/3190705245 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56106f27ab20 con 0x56106f25a7c0 2026-02-20T03:24:52.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f4765f73640 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f2799d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f4765772640 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f276560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x56106f281260 tx=0x7f4754005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1b2bc6b3418f193 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f471b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f471b7fe640 1 -- 10.20.193.28:0/3190705245 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475402ac10 con 0x56106f25a7c0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f471b7fe640 1 -- 10.20.193.28:0/3190705245 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f475402adb0 con 0x56106f25a7c0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f471b7fe640 1 -- 10.20.193.28:0/3190705245 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475401ce10 con 0x56106f25a7c0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f476b060e00 1 -- 10.20.193.28:0/3190705245 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56106ef0a690 con 0x56106f25a7c0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f476b060e00 10 client.27271 _ll_register_callbacks cb 0x7f4750004370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f476b060e00 1 -- 10.20.193.28:0/3190705245 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f475c0079a0 con 0x56106f25a7c0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f471b7fe640 1 -- 10.20.193.28:0/3190705245 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f475403b470 con 0x56106f25a7c0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f471b7fe640 1 -- 10.20.193.28:0/3190705245 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f475403b710 con 0x56106f25a7c0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f476b060e00 10 client.27271 fetch_fsmap learned FSMap version 29 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.651+0000 7f476b060e00 1 -- 10.20.193.28:0/3190705245 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56106f16fb70 con 0x56106f25a7c0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.652+0000 7f471b7fe640 1 -- 10.20.193.28:0/3190705245 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f475404c020 con 0x56106f25a7c0 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.652+0000 7f476b060e00 10 client.27271 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.652+0000 7f476b060e00 10 client.27271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.652+0000 7f476b060e00 20 client.27271 populate_metadata read hostname 'trial028' 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.652+0000 7f476b060e00 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56106f2ea9c0 0x56106f2ece80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:24:52.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.652+0000 7f476b060e00 4 client.27271 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:24:52.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.652+0000 7f476b060e00 1 -- 10.20.193.28:0/3190705245 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56106ef83520 con 0x56106f2ea9c0 2026-02-20T03:24:52.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.652+0000 7f4765f73640 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56106f2ea9c0 0x56106f2ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:24:52.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.653+0000 7f4765f73640 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56106f2ea9c0 0x56106f2ece80 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8f9b632606de0bd server_cookie=52ed4603e36ba4d1 in_seq=0 out_seq=0 2026-02-20T03:24:52.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.653+0000 7f471b7fe640 10 client.27271 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:52.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f471b7fe640 1 -- 10.20.193.28:0/3190705245 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56106ef83520 con 0x56106f2ea9c0 2026-02-20T03:24:52.766 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f471b7fe640 10 client.27271 handle_command_reply: tid=0 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 client.27271 shutdown 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 -- 10.20.193.28:0/3190705245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 msgr2=0x56106f276560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f276560 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x56106f281260 tx=0x7f4754005840 comp rx=0 tx=0).stop 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 -- 10.20.193.28:0/3190705245 shutdown_connections 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56106f2ea9c0 0x56106f2ece80 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56106f25f560 0x56106f276aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56106f25a7c0 0x56106f276560 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 --2- 10.20.193.28:0/3190705245 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56106f259e80 0x56106f2799d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f471b7fe640 0 client.27271 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 -- 10.20.193.28:0/3190705245 >> 10.20.193.28:0/3190705245 conn(0x56106f2516f0 msgr2=0x56106f260160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 -- 10.20.193.28:0/3190705245 shutdown_connections 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.764+0000 7f476b060e00 1 -- 10.20.193.28:0/3190705245 wait complete. 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f476b060e00 20 client.27271 trim_cache size 0 max 16384 2026-02-20T03:24:52.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 -- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f473c0b0d80 msgr2=0x7f473c0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f473c0b0d80 0x7f473c0b3240 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f47601a2410 tx=0x7f4754009290 comp rx=0 tx=0).stop 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 -- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4760109490 msgr2=0x7f47601a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4760109490 0x7f47601a0f00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4750005a40 tx=0x7f4750002f90 comp rx=0 tx=0).stop 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 -- 10.20.193.28:0/3980183698 shutdown_connections 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f473c0b0d80 0x7f473c0b3240 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f476010a900 0x7f47601a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4760109e60 0x7f47601a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 --2- 10.20.193.28:0/3980183698 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4760109490 0x7f47601a0f00 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.765+0000 7f4766f75640 1 -- 10.20.193.28:0/3980183698 >> 10.20.193.28:0/3980183698 conn(0x7f4760077fe0 msgr2=0x7f476010d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.766+0000 7f4766f75640 1 -- 10.20.193.28:0/3980183698 shutdown_connections 2026-02-20T03:24:52.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:24:52.766+0000 7f4766f75640 1 -- 10.20.193.28:0/3980183698 wait complete. 2026-02-20T03:24:53.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:53 trial177 ceph-mon[43181]: pgmap v487: 129 pgs: 129 active+clean; 151 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.1 MiB/s wr, 406 op/s 2026-02-20T03:24:53.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 863297 7.89 MB/sec execute 386 sec latency 36.209 ms 2026-02-20T03:24:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:53 trial126 ceph-mon[38476]: pgmap v487: 129 pgs: 129 active+clean; 151 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.1 MiB/s wr, 406 op/s 2026-02-20T03:24:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:53 trial028 ceph-mon[38552]: pgmap v487: 129 pgs: 129 active+clean; 151 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.1 MiB/s wr, 406 op/s 2026-02-20T03:24:54.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 866838 7.91 MB/sec execute 387 sec latency 10.501 ms 2026-02-20T03:24:55.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:55 trial177 ceph-mon[43181]: pgmap v488: 129 pgs: 129 active+clean; 150 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.4 MiB/s wr, 494 op/s 2026-02-20T03:24:55.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 870402 7.94 MB/sec execute 388 sec latency 6.160 ms 2026-02-20T03:24:55.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:55 trial126 ceph-mon[38476]: pgmap v488: 129 pgs: 129 active+clean; 150 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.4 MiB/s wr, 494 op/s 2026-02-20T03:24:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:55 trial028 ceph-mon[38552]: pgmap v488: 129 pgs: 129 active+clean; 150 MiB data, 3.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.4 MiB/s wr, 494 op/s 2026-02-20T03:24:56.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 873959 7.97 MB/sec execute 389 sec latency 8.425 ms 2026-02-20T03:24:57.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:57 trial177 ceph-mon[43181]: pgmap v489: 129 pgs: 129 active+clean; 153 MiB data, 3.1 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 MiB/s rd, 2.1 MiB/s wr, 447 op/s 2026-02-20T03:24:57.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 877475 8.00 MB/sec execute 390 sec latency 11.244 ms 2026-02-20T03:24:57.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:57 trial126 ceph-mon[38476]: pgmap v489: 129 pgs: 129 active+clean; 153 MiB data, 3.1 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 MiB/s rd, 2.1 MiB/s wr, 447 op/s 2026-02-20T03:24:57.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:57 trial028 ceph-mon[38552]: pgmap v489: 129 pgs: 129 active+clean; 153 MiB data, 3.1 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 MiB/s rd, 2.1 MiB/s wr, 447 op/s 2026-02-20T03:24:58.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 880980 8.03 MB/sec execute 391 sec latency 7.566 ms 2026-02-20T03:24:59.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:24:59 trial177 ceph-mon[43181]: pgmap v490: 129 pgs: 129 active+clean; 154 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.4 MiB/s wr, 556 op/s 2026-02-20T03:24:59.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 884489 8.06 MB/sec execute 392 sec latency 9.908 ms 2026-02-20T03:24:59.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:24:59 trial126 ceph-mon[38476]: pgmap v490: 129 pgs: 129 active+clean; 154 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.4 MiB/s wr, 556 op/s 2026-02-20T03:24:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:24:59 trial028 ceph-mon[38552]: pgmap v490: 129 pgs: 129 active+clean; 154 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 2.4 MiB/s wr, 556 op/s 2026-02-20T03:25:00.516 INFO:tasks.workunit.client.0.trial028.stdout: 1 888041 8.09 MB/sec execute 393 sec latency 7.585 ms 2026-02-20T03:25:01.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 891480 8.11 MB/sec execute 394 sec latency 23.754 ms 2026-02-20T03:25:01.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:01 trial126 ceph-mon[38476]: pgmap v491: 129 pgs: 129 active+clean; 157 MiB data, 3.1 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 2.3 MiB/s wr, 506 op/s 2026-02-20T03:25:01.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:01 trial028 ceph-mon[38552]: pgmap v491: 129 pgs: 129 active+clean; 157 MiB data, 3.1 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 2.3 MiB/s wr, 506 op/s 2026-02-20T03:25:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:01 trial177 ceph-mon[43181]: pgmap v491: 129 pgs: 129 active+clean; 157 MiB data, 3.1 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 2.3 MiB/s wr, 506 op/s 2026-02-20T03:25:02.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 894991 8.14 MB/sec execute 395 sec latency 8.028 ms 2026-02-20T03:25:03.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 898502 8.17 MB/sec execute 396 sec latency 9.558 ms 2026-02-20T03:25:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:03 trial126 ceph-mon[38476]: pgmap v492: 129 pgs: 129 active+clean; 160 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 MiB/s rd, 2.3 MiB/s wr, 533 op/s 2026-02-20T03:25:03.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:03 trial028 ceph-mon[38552]: pgmap v492: 129 pgs: 129 active+clean; 160 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 MiB/s rd, 2.3 MiB/s wr, 533 op/s 2026-02-20T03:25:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:03 trial177 ceph-mon[43181]: pgmap v492: 129 pgs: 129 active+clean; 160 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 MiB/s rd, 2.3 MiB/s wr, 533 op/s 2026-02-20T03:25:04.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 901817 8.19 MB/sec execute 397 sec latency 113.337 ms 2026-02-20T03:25:05.238 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:05 trial028 ceph-mon[38552]: pgmap v493: 129 pgs: 129 active+clean; 162 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 2.1 MiB/s wr, 500 op/s 2026-02-20T03:25:05.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 901817 8.17 MB/sec execute 398 sec latency 1113.388 ms 2026-02-20T03:25:05.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:05 trial126 ceph-mon[38476]: pgmap v493: 129 pgs: 129 active+clean; 162 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 2.1 MiB/s wr, 500 op/s 2026-02-20T03:25:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:05 trial177 ceph-mon[43181]: pgmap v493: 129 pgs: 129 active+clean; 162 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 2.1 MiB/s wr, 500 op/s 2026-02-20T03:25:05.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- 10.20.193.28:0/3737251146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 msgr2=0x7f27ac10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:05.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 --2- 10.20.193.28:0/3737251146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 0x7f27ac10a2e0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f279c009a30 tx=0x7f279c02f260 comp rx=0 tx=0).stop 2026-02-20T03:25:05.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- 10.20.193.28:0/3737251146 shutdown_connections 2026-02-20T03:25:05.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 --2- 10.20.193.28:0/3737251146 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27ac10a900 0x7f27ac111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 --2- 10.20.193.28:0/3737251146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 0x7f27ac10a2e0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 --2- 10.20.193.28:0/3737251146 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27ac109490 0x7f27ac109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- 10.20.193.28:0/3737251146 >> 10.20.193.28:0/3737251146 conn(0x7f27ac077fe0 msgr2=0x7f27ac07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:05.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- 10.20.193.28:0/3737251146 shutdown_connections 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- 10.20.193.28:0/3737251146 wait complete. 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 Processor -- start 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- start start 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27ac109490 0x7f27ac1a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 0x7f27ac1a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27ac10a900 0x7f27ac1a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac114a50 con 0x7f27ac109e60 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac1148d0 con 0x7f27ac109490 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac114bd0 con 0x7f27ac10a900 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 0x7f27ac1a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 0x7f27ac1a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60460/0 (socket says 10.20.193.28:60460) 2026-02-20T03:25:05.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27ab7fe640 1 -- 10.20.193.28:0/1639507637 learned_addr learned my addr 10.20.193.28:0/1639507637 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:05.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27ab7fe640 1 -- 10.20.193.28:0/1639507637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27ac10a900 msgr2=0x7f27ac1a8670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:05.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27ac10a900 0x7f27ac1a8670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27ab7fe640 1 -- 10.20.193.28:0/1639507637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27ac109490 msgr2=0x7f27ac1a10c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:05.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27ac109490 0x7f27ac1a10c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27ab7fe640 1 -- 10.20.193.28:0/1639507637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac1a8d70 con 0x7f27ac109e60 2026-02-20T03:25:05.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 0x7f27ac1a1600 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f279c009950 tx=0x7f279c02fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:05.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27a97fa640 1 -- 10.20.193.28:0/1639507637 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c004240 con 0x7f27ac109e60 2026-02-20T03:25:05.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27a97fa640 1 -- 10.20.193.28:0/1639507637 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f279c0043e0 con 0x7f27ac109e60 2026-02-20T03:25:05.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- 10.20.193.28:0/1639507637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac1a9000 con 0x7f27ac109e60 2026-02-20T03:25:05.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27a97fa640 1 -- 10.20.193.28:0/1639507637 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c042b00 con 0x7f27ac109e60 2026-02-20T03:25:05.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.848+0000 7f27b16c2640 1 -- 10.20.193.28:0/1639507637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac1a95c0 con 0x7f27ac109e60 2026-02-20T03:25:05.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27a97fa640 1 -- 10.20.193.28:0/1639507637 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f279c04a030 con 0x7f27ac109e60 2026-02-20T03:25:05.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 Processor -- start 2026-02-20T03:25:05.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 -- start start 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 0x56015dd1d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd1d7c0 0x56015dd21f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd22560 0x56015dd249f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56015dc6d8f0 con 0x56015dd22560 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56015dc1b2e0 con 0x56015dd1ce80 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56015dc69820 con 0x56015dd1d7c0 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27a97fa640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27800b0ea0 0x7f27800b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27a97fa640 1 -- 10.20.193.28:0/1639507637 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f279c105170 con 0x7f27ac109e60 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b0ec1640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27800b0ea0 0x7f27800b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd22560 0x56015dd249f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd22560 0x56015dd249f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60476/0 (socket says 10.20.193.28:60476) 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27ab7fe640 1 -- 10.20.193.28:0/111215387 learned_addr learned my addr 10.20.193.28:0/111215387 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27ab7fe640 1 -- 10.20.193.28:0/111215387 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd1d7c0 msgr2=0x56015dd21f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/111215387 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd1d7c0 0x56015dd21f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27ab7fe640 1 -- 10.20.193.28:0/111215387 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 msgr2=0x56015dd1d280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/111215387 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 0x56015dd1d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27ab7fe640 1 -- 10.20.193.28:0/111215387 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015dc0d5a0 con 0x56015dd22560 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b0ec1640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27800b0ea0 0x7f27800b3360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f27a000ab10 tx=0x7f27a0009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/111215387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd22560 0x56015dd249f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f279c0ccb50 tx=0x7f279c02f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce75b8f0ebae2cee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f277cbfe640 1 -- 10.20.193.28:0/111215387 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0cd550 con 0x56015dd22560 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f277cbfe640 1 -- 10.20.193.28:0/111215387 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f279c0cf030 con 0x56015dd22560 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f277cbfe640 1 -- 10.20.193.28:0/111215387 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0b3bb0 con 0x56015dd22560 2026-02-20T03:25:05.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 -- 10.20.193.28:0/111215387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd22560 msgr2=0x56015dd249f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 --2- 10.20.193.28:0/111215387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd22560 0x56015dd249f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f279c0ccb50 tx=0x7f279c02f260 comp rx=0 tx=0).stop 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 -- 10.20.193.28:0/111215387 shutdown_connections 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 --2- 10.20.193.28:0/111215387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd22560 0x56015dd249f0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 --2- 10.20.193.28:0/111215387 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd1d7c0 0x56015dd21f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 --2- 10.20.193.28:0/111215387 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 0x56015dd1d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 -- 10.20.193.28:0/111215387 >> 10.20.193.28:0/111215387 conn(0x56015dd146f0 msgr2=0x56015dd1b570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 -- 10.20.193.28:0/111215387 shutdown_connections 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.854+0000 7f27b588ae00 1 -- 10.20.193.28:0/111215387 wait complete. 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 -- start start 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 Processor -- start 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd1ce80 0x56015dd35740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd35c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd22560 0x56015dd3cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56015dc150c0 con 0x56015dd1d7c0 2026-02-20T03:25:05.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56015dd25370 con 0x56015dd22560 2026-02-20T03:25:05.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56015dd3d190 con 0x56015dd1ce80 2026-02-20T03:25:05.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd35c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd35c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60482/0 (socket says 10.20.193.28:60482) 2026-02-20T03:25:05.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27ab7fe640 1 -- 10.20.193.28:0/3326782238 learned_addr learned my addr 10.20.193.28:0/3326782238 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:05.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27ab7fe640 1 -- 10.20.193.28:0/3326782238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd1ce80 msgr2=0x56015dd35740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:05.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd1ce80 0x56015dd35740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27ab7fe640 1 -- 10.20.193.28:0/3326782238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd22560 msgr2=0x56015dd3cc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:05.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd22560 0x56015dd3cc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27ab7fe640 1 -- 10.20.193.28:0/3326782238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015dd2ee90 con 0x56015dd1d7c0 2026-02-20T03:25:05.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd35c80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f279c0cc4e0 tx=0x7f279c042420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f672cb067b16d24f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:05.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f276dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:05.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f276dffb640 1 -- 10.20.193.28:0/3326782238 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0d60b0 con 0x56015dd1d7c0 2026-02-20T03:25:05.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f276dffb640 1 -- 10.20.193.28:0/3326782238 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f279c033070 con 0x56015dd1d7c0 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f276dffb640 1 -- 10.20.193.28:0/3326782238 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0c87d0 con 0x56015dd1d7c0 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 -- 10.20.193.28:0/3326782238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015dc29820 con 0x56015dd1d7c0 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f276dffb640 1 -- 10.20.193.28:0/3326782238 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f279c0d5030 con 0x56015dd1d7c0 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f276dffb640 10 client.18165 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 10 client.18165 _ll_register_callbacks cb 0x56015dc18ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 -- 10.20.193.28:0/3326782238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56015dc754e0 con 0x56015dd1d7c0 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f276dffb640 1 -- 10.20.193.28:0/3326782238 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f279c0d1200 con 0x56015dd1d7c0 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 10 client.18165 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 -- 10.20.193.28:0/3326782238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56015dc2e380 con 0x56015dd1d7c0 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f276dffb640 1 -- 10.20.193.28:0/3326782238 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f279c0d5230 con 0x56015dd1d7c0 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 10 client.18165 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 10 client.18165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 20 client.18165 populate_metadata read hostname 'trial028' 2026-02-20T03:25:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56015dd41060 0x56015dd434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 4 client.18165 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.858+0000 7f27b588ae00 1 -- 10.20.193.28:0/3326782238 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56015dbefbd0 con 0x56015dd41060 2026-02-20T03:25:05.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.885+0000 7f27abfff640 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56015dd41060 0x56015dd434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.953 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.951+0000 7f27abfff640 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56015dd41060 0x56015dd434f0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e117a8e92c49c760 server_cookie=31f56d0707bccfa in_seq=0 out_seq=0 2026-02-20T03:25:05.953 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.951+0000 7f276dffb640 10 client.18165 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:05.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.978+0000 7f276dffb640 1 -- 10.20.193.28:0/3326782238 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56015dbefbd0 con 0x56015dd41060 2026-02-20T03:25:05.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.978+0000 7f276dffb640 10 client.18165 handle_command_reply: tid=0 2026-02-20T03:25:05.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.978+0000 7f27b588ae00 1 client.18165 shutdown 2026-02-20T03:25:05.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 -- 10.20.193.28:0/3326782238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 msgr2=0x56015dd35c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:05.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd35c80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f279c0cc4e0 tx=0x7f279c042420 comp rx=0 tx=0).stop 2026-02-20T03:25:05.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 -- 10.20.193.28:0/3326782238 shutdown_connections 2026-02-20T03:25:05.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56015dd41060 0x56015dd434f0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd22560 0x56015dd3cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd35c80 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3326782238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd1ce80 0x56015dd35740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 -- 10.20.193.28:0/3326782238 >> 10.20.193.28:0/3326782238 conn(0x56015dd146f0 msgr2=0x56015dd238b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:05.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f276dffb640 0 client.18165 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:05.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 -- 10.20.193.28:0/3326782238 shutdown_connections 2026-02-20T03:25:05.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 1 -- 10.20.193.28:0/3326782238 wait complete. 2026-02-20T03:25:05.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.979+0000 7f27b588ae00 20 client.18165 trim_cache size 0 max 16384 2026-02-20T03:25:05.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.986+0000 7f27b588ae00 1 Processor -- start 2026-02-20T03:25:05.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.986+0000 7f27b588ae00 1 -- start start 2026-02-20T03:25:05.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.986+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 0x56015dd34e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.986+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd3cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.986+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 0x56015dd32ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.986+0000 7f27b588ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2750012600 con 0x56015dd1d7c0 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.986+0000 7f27b588ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f275000fed0 con 0x56015dd1ce80 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.986+0000 7f27b588ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f275000dd20 con 0x56015dd22560 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd3cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27b0ec1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 0x56015dd32ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd3cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60490/0 (socket says 10.20.193.28:60490) 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27ab7fe640 1 -- 10.20.193.28:0/3328358600 learned_addr learned my addr 10.20.193.28:0/3328358600 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27abfff640 1 --2- 10.20.193.28:0/3328358600 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 0x56015dd34e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27ab7fe640 1 -- 10.20.193.28:0/3328358600 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 msgr2=0x56015dd32ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/3328358600 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 0x56015dd32ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27ab7fe640 1 -- 10.20.193.28:0/3328358600 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 msgr2=0x56015dd34e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/3328358600 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 0x56015dd34e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27ab7fe640 1 -- 10.20.193.28:0/3328358600 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015dd2ecc0 con 0x56015dd1d7c0 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27abfff640 1 --2- 10.20.193.28:0/3328358600 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 0x56015dd34e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/3328358600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd3cbc0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f279c0389d0 tx=0x7f279c031050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d52868854b7cad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f276ffff640 1 -- 10.20.193.28:0/3328358600 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0d60b0 con 0x56015dd1d7c0 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f276ffff640 1 -- 10.20.193.28:0/3328358600 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f279c033070 con 0x56015dd1d7c0 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.987+0000 7f276ffff640 1 -- 10.20.193.28:0/3328358600 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c0d3400 con 0x56015dd1d7c0 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 -- 10.20.193.28:0/3328358600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 msgr2=0x56015dd3cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3328358600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd3cbc0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f279c0389d0 tx=0x7f279c031050 comp rx=0 tx=0).stop 2026-02-20T03:25:05.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 -- 10.20.193.28:0/3328358600 shutdown_connections 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3328358600 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 0x56015dd32ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3328358600 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1d7c0 0x56015dd3cbc0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 --2- 10.20.193.28:0/3328358600 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1ce80 0x56015dd34e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 -- 10.20.193.28:0/3328358600 >> 10.20.193.28:0/3328358600 conn(0x56015dd146f0 msgr2=0x56015dd327c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 -- 10.20.193.28:0/3328358600 shutdown_connections 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 -- 10.20.193.28:0/3328358600 wait complete. 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 -- start start 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 Processor -- start 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1ce80 0x56015dd38d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.988+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1d7c0 0x56015dd39270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27b588ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 0x56015dd3bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27b588ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f275000e390 con 0x56015dd1ce80 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27b588ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f275000f800 con 0x56015dd1d7c0 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27b588ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f275000ea60 con 0x56015dd22560 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27abfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1ce80 0x56015dd38d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1d7c0 0x56015dd39270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27b0ec1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 0x56015dd3bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27ab7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1d7c0 0x56015dd39270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49686/0 (socket says 10.20.193.28:49686) 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27ab7fe640 1 -- 10.20.193.28:0/2719457014 learned_addr learned my addr 10.20.193.28:0/2719457014 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27abfff640 1 -- 10.20.193.28:0/2719457014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 msgr2=0x56015dd3bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27abfff640 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 0x56015dd3bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27abfff640 1 -- 10.20.193.28:0/2719457014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1d7c0 msgr2=0x56015dd39270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:05.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27abfff640 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1d7c0 0x56015dd39270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27abfff640 1 -- 10.20.193.28:0/2719457014 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015d9cd690 con 0x56015dd1ce80 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27abfff640 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1ce80 0x56015dd38d30 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x56015dd43d40 tx=0x7f2798004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd374e1afef73415 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f276dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f276dffb640 1 -- 10.20.193.28:0/2719457014 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798015040 con 0x56015dd1ce80 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f276dffb640 1 -- 10.20.193.28:0/2719457014 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2798009b60 con 0x56015dd1ce80 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f276dffb640 1 -- 10.20.193.28:0/2719457014 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798019b30 con 0x56015dd1ce80 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.989+0000 7f27b588ae00 1 -- 10.20.193.28:0/2719457014 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56015dc32b70 con 0x56015dd1ce80 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f276dffb640 1 -- 10.20.193.28:0/2719457014 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f2798019cf0 con 0x56015dd1ce80 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f276dffb640 10 client.18171 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 10 client.18171 _ll_register_callbacks cb 0x7f279c0b3f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 1 -- 10.20.193.28:0/2719457014 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f279c0cf030 con 0x56015dd1ce80 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f276dffb640 1 -- 10.20.193.28:0/2719457014 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2798019430 con 0x56015dd1ce80 2026-02-20T03:25:05.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 10 client.18171 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 1 -- 10.20.193.28:0/2719457014 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x56015dd2f9b0 con 0x56015dd1ce80 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f276dffb640 1 -- 10.20.193.28:0/2719457014 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2798018070 con 0x56015dd1ce80 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 10 client.18171 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 10 client.18171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 20 client.18171 populate_metadata read hostname 'trial028' 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56015ddac9e0 0x56015ddaeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 4 client.18171 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27b588ae00 1 -- 10.20.193.28:0/2719457014 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56015dc3e6b0 con 0x56015ddac9e0 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.990+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56015ddac9e0 0x56015ddaeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.991+0000 7f27ab7fe640 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56015ddac9e0 0x56015ddaeea0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad869f080c4dcf7f server_cookie=b54c28d8e0eda0e2 in_seq=0 out_seq=0 2026-02-20T03:25:05.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:05.991+0000 7f276dffb640 10 client.18171 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:06.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f276dffb640 1 -- 10.20.193.28:0/2719457014 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56015dc3e6b0 con 0x56015ddac9e0 2026-02-20T03:25:06.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f276dffb640 10 client.18171 handle_command_reply: tid=0 2026-02-20T03:25:06.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f27b588ae00 1 client.18171 shutdown 2026-02-20T03:25:06.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f27b588ae00 1 -- 10.20.193.28:0/2719457014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1ce80 msgr2=0x56015dd38d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:06.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f27b588ae00 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1ce80 0x56015dd38d30 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x56015dd43d40 tx=0x7f2798004710 comp rx=0 tx=0).stop 2026-02-20T03:25:06.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f27b588ae00 1 -- 10.20.193.28:0/2719457014 shutdown_connections 2026-02-20T03:25:06.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f27b588ae00 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56015ddac9e0 0x56015ddaeea0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:06.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f27b588ae00 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015dd22560 0x56015dd3bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:06.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f27b588ae00 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015dd1d7c0 0x56015dd39270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:06.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f27b588ae00 1 --2- 10.20.193.28:0/2719457014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015dd1ce80 0x56015dd38d30 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:06.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.076+0000 7f27b588ae00 1 -- 10.20.193.28:0/2719457014 >> 10.20.193.28:0/2719457014 conn(0x56015dd146f0 msgr2=0x56015dd32ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:06.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.077+0000 7f276dffb640 0 client.18171 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:06.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.077+0000 7f27b588ae00 1 -- 10.20.193.28:0/2719457014 shutdown_connections 2026-02-20T03:25:06.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.077+0000 7f27b588ae00 1 -- 10.20.193.28:0/2719457014 wait complete. 2026-02-20T03:25:06.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.077+0000 7f27b588ae00 20 client.18171 trim_cache size 0 max 16384 2026-02-20T03:25:06.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:25:06.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:25:06.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:25:06.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:25:06.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.077+0000 7f27b16c2640 1 -- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27800b0ea0 msgr2=0x7f27800b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:06.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.077+0000 7f27b16c2640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27800b0ea0 0x7f27800b3360 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f27a000ab10 tx=0x7f27a0009230 comp rx=0 tx=0).stop 2026-02-20T03:25:06.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.077+0000 7f27b16c2640 1 -- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 msgr2=0x7f27ac1a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:06.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.077+0000 7f27b16c2640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 0x7f27ac1a1600 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f279c009950 tx=0x7f279c02fd60 comp rx=0 tx=0).stop 2026-02-20T03:25:06.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.078+0000 7f27b16c2640 1 -- 10.20.193.28:0/1639507637 shutdown_connections 2026-02-20T03:25:06.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.078+0000 7f27b16c2640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27800b0ea0 0x7f27800b3360 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:06.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.078+0000 7f27b16c2640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27ac10a900 0x7f27ac1a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:06.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.078+0000 7f27b16c2640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27ac109e60 0x7f27ac1a1600 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:06.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.078+0000 7f27b16c2640 1 --2- 10.20.193.28:0/1639507637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27ac109490 0x7f27ac1a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:06.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.078+0000 7f27b16c2640 1 -- 10.20.193.28:0/1639507637 >> 10.20.193.28:0/1639507637 conn(0x7f27ac077fe0 msgr2=0x7f27ac10d670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:06.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.078+0000 7f27b16c2640 1 -- 10.20.193.28:0/1639507637 shutdown_connections 2026-02-20T03:25:06.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:06.078+0000 7f27b16c2640 1 -- 10.20.193.28:0/1639507637 wait complete. 2026-02-20T03:25:06.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 902692 8.16 MB/sec execute 399 sec latency 1588.994 ms 2026-02-20T03:25:06.624 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:25:06.894 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:07.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.076+0000 7f6463349640 1 -- 10.20.193.28:0/2663609674 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 msgr2=0x7f645c10ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.076+0000 7f6463349640 1 --2- 10.20.193.28:0/2663609674 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 0x7f645c10ad60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f644c009a30 tx=0x7f644c02f260 comp rx=0 tx=0).stop 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.076+0000 7f6463349640 1 -- 10.20.193.28:0/2663609674 shutdown_connections 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.076+0000 7f6463349640 1 --2- 10.20.193.28:0/2663609674 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f645c105320 0x7f645c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.076+0000 7f6463349640 1 --2- 10.20.193.28:0/2663609674 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f645c104980 0x7f645c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.076+0000 7f6463349640 1 --2- 10.20.193.28:0/2663609674 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 0x7f645c10ad60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.076+0000 7f6463349640 1 -- 10.20.193.28:0/2663609674 >> 10.20.193.28:0/2663609674 conn(0x7f645c100680 msgr2=0x7f645c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.076+0000 7f6463349640 1 -- 10.20.193.28:0/2663609674 shutdown_connections 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.076+0000 7f6463349640 1 -- 10.20.193.28:0/2663609674 wait complete. 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6463349640 1 Processor -- start 2026-02-20T03:25:07.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6463349640 1 -- start start 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6463349640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f645c104980 0x7f645c111650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6463349640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f645c105320 0x7f645c10e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6463349640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 0x7f645c10ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6463349640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f645c114ba0 con 0x7f645c105320 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6463349640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f645c114a20 con 0x7f645c10a980 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6463349640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f645c114d20 con 0x7f645c104980 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6462347640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f645c104980 0x7f645c111650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6461b46640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f645c105320 0x7f645c10e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6462b48640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 0x7f645c10ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6461b46640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f645c105320 0x7f645c10e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49030/0 (socket says 10.20.193.28:49030) 2026-02-20T03:25:07.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6461b46640 1 -- 10.20.193.28:0/2890733992 learned_addr learned my addr 10.20.193.28:0/2890733992 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.077+0000 7f6462b48640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 0x7f645c10ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56348/0 (socket says 10.20.193.28:56348) 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f6462b48640 1 -- 10.20.193.28:0/2890733992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f645c104980 msgr2=0x7f645c111650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f6462b48640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f645c104980 0x7f645c111650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f6462b48640 1 -- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f645c105320 msgr2=0x7f645c10e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f6462b48640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f645c105320 0x7f645c10e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f6462b48640 1 -- 10.20.193.28:0/2890733992 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645c1ada00 con 0x7f645c10a980 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f6461b46640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f645c105320 0x7f645c10e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f6462b48640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 0x7f645c10ec40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f645800efc0 tx=0x7f645800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f64437fe640 1 -- 10.20.193.28:0/2890733992 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458019070 con 0x7f645c10a980 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f64437fe640 1 -- 10.20.193.28:0/2890733992 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f64580092d0 con 0x7f645c10a980 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f64437fe640 1 -- 10.20.193.28:0/2890733992 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458007500 con 0x7f645c10a980 2026-02-20T03:25:07.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f6463349640 1 -- 10.20.193.28:0/2890733992 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c1adbd0 con 0x7f645c10a980 2026-02-20T03:25:07.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.078+0000 7f6463349640 1 -- 10.20.193.28:0/2890733992 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c1adf70 con 0x7f645c10a980 2026-02-20T03:25:07.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.081+0000 7f64437fe640 1 -- 10.20.193.28:0/2890733992 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6458002a60 con 0x7f645c10a980 2026-02-20T03:25:07.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.081+0000 7f6466ad7e00 1 Processor -- start 2026-02-20T03:25:07.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6466ad7e00 1 -- start start 2026-02-20T03:25:07.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55629211e000 0x55629211e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118630 0x556292118a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292124e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556292098e50 con 0x556292118630 2026-02-20T03:25:07.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55629206b9c0 con 0x556292118fb0 2026-02-20T03:25:07.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556292019240 con 0x55629211e000 2026-02-20T03:25:07.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6462347640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118630 0x556292118a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6461b46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55629211e000 0x55629211e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6462347640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118630 0x556292118a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49036/0 (socket says 10.20.193.28:49036) 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6461b46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55629211e000 0x55629211e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47774/0 (socket says 10.20.193.28:47774) 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6462347640 1 -- 10.20.193.28:0/1263847633 learned_addr learned my addr 10.20.193.28:0/1263847633 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f6461b46640 1 --2- 10.20.193.28:0/1263847633 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292124e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.082+0000 7f64437fe640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f64380b0f70 0x7f64380b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6461b46640 1 -- 10.20.193.28:0/1263847633 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 msgr2=0x556292124e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6461b46640 1 --2- 10.20.193.28:0/1263847633 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292124e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6461b46640 1 -- 10.20.193.28:0/1263847633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118630 msgr2=0x556292118a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6461b46640 1 --2- 10.20.193.28:0/1263847633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118630 0x556292118a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6461b46640 1 -- 10.20.193.28:0/1263847633 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55629202c420 con 0x55629211e000 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6462b48640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f64380b0f70 0x7f64380b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f64437fe640 1 -- 10.20.193.28:0/2890733992 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f64580e0600 con 0x7f645c10a980 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6461b46640 1 --2- 10.20.193.28:0/1263847633 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55629211e000 0x55629211e3e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f645c10fec0 tx=0x7f6450009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8fdca7177f7f7f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6440cf3640 1 -- 10.20.193.28:0/1263847633 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645000fc30 con 0x55629211e000 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6440cf3640 1 -- 10.20.193.28:0/1263847633 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6450004570 con 0x55629211e000 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.083+0000 7f6440cf3640 1 -- 10.20.193.28:0/1263847633 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6450005280 con 0x55629211e000 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6462b48640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f64380b0f70 0x7f64380b3430 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f645800ef90 tx=0x7f6458009e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1263847633 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55629211e000 msgr2=0x55629211e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/1263847633 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55629211e000 0x55629211e3e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f645c10fec0 tx=0x7f6450009650 comp rx=0 tx=0).stop 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1263847633 shutdown_connections 2026-02-20T03:25:07.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/1263847633 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292124e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/1263847633 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118630 0x556292118a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/1263847633 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55629211e000 0x55629211e3e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1263847633 >> 10.20.193.28:0/1263847633 conn(0x5562920db290 msgr2=0x556292116d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:07.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1263847633 shutdown_connections 2026-02-20T03:25:07.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.084+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1263847633 wait complete. 2026-02-20T03:25:07.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.085+0000 7f6466ad7e00 1 -- start start 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.085+0000 7f6466ad7e00 1 Processor -- start 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.086+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 0x556292131340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.086+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292131880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.086+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 0x556292136e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.086+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5562920678f0 con 0x55629211e000 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.086+0000 7f6461b46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 0x556292131340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.086+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556291e59f50 con 0x556292118fb0 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.086+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5562921373b0 con 0x556292118630 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.086+0000 7f6462347640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292131880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.086+0000 7f6462347640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292131880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56372/0 (socket says 10.20.193.28:56372) 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.087+0000 7f6462347640 1 -- 10.20.193.28:0/821072959 learned_addr learned my addr 10.20.193.28:0/821072959 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:07.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.087+0000 7f6461b46640 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 0x556292136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.087+0000 7f6462347640 1 -- 10.20.193.28:0/821072959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 msgr2=0x556292131340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.087+0000 7f6462347640 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 0x556292131340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.087+0000 7f6462347640 1 -- 10.20.193.28:0/821072959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 msgr2=0x556292136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.087+0000 7f6462347640 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 0x556292136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.087+0000 7f6462347640 1 -- 10.20.193.28:0/821072959 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55629212aad0 con 0x556292118fb0 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.087+0000 7f6462347640 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292131880 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f644c002410 tx=0x7f644c002910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=357677269337dec4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.087+0000 7f640ffff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f640ffff640 1 -- 10.20.193.28:0/821072959 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c004190 con 0x556292118fb0 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f640ffff640 1 -- 10.20.193.28:0/821072959 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f644c047070 con 0x556292118fb0 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f640ffff640 1 -- 10.20.193.28:0/821072959 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c038d00 con 0x556292118fb0 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f6466ad7e00 1 -- 10.20.193.28:0/821072959 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556291e3cb40 con 0x556292118fb0 2026-02-20T03:25:07.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f640ffff640 1 -- 10.20.193.28:0/821072959 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f644c04c460 con 0x556292118fb0 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f6466ad7e00 10 client.27269 _ll_register_callbacks cb 0x5562920a4f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f6466ad7e00 1 -- 10.20.193.28:0/821072959 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5562920791a0 con 0x556292118fb0 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f640ffff640 10 client.27269 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f640ffff640 1 -- 10.20.193.28:0/821072959 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f644c004330 con 0x556292118fb0 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f6466ad7e00 10 client.27269 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.088+0000 7f6466ad7e00 1 -- 10.20.193.28:0/821072959 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556292026230 con 0x556292118fb0 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f640ffff640 1 -- 10.20.193.28:0/821072959 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f644c038470 con 0x556292118fb0 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f6466ad7e00 10 client.27269 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f6466ad7e00 10 client.27269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f6466ad7e00 20 client.27269 populate_metadata read hostname 'trial028' 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556292141370 0x556292143830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f6466ad7e00 4 client.27269 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:07.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f6466ad7e00 1 -- 10.20.193.28:0/821072959 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562920735b0 con 0x556292141370 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f6461b46640 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556292141370 0x556292143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f6461b46640 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556292141370 0x556292143830 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5063009de5f060ba server_cookie=a8c69bfd6b3e8a17 in_seq=0 out_seq=0 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.089+0000 7f640ffff640 10 client.27269 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f640ffff640 1 -- 10.20.193.28:0/821072959 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5562920735b0 con 0x556292141370 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f640ffff640 10 client.27269 handle_command_reply: tid=0 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 client.27269 shutdown 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 -- 10.20.193.28:0/821072959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 msgr2=0x556292131880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292131880 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f644c002410 tx=0x7f644c002910 comp rx=0 tx=0).stop 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 -- 10.20.193.28:0/821072959 shutdown_connections 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556292141370 0x556292143830 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 0x556292136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118fb0 0x556292131880 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/821072959 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 0x556292131340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f640ffff640 0 client.27269 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:07.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 -- 10.20.193.28:0/821072959 >> 10.20.193.28:0/821072959 conn(0x5562920db290 msgr2=0x556292117440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:07.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 -- 10.20.193.28:0/821072959 shutdown_connections 2026-02-20T03:25:07.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.090+0000 7f6466ad7e00 1 -- 10.20.193.28:0/821072959 wait complete. 2026-02-20T03:25:07.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.091+0000 7f6466ad7e00 20 client.27269 trim_cache size 0 max 16384 2026-02-20T03:25:07.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6466ad7e00 1 Processor -- start 2026-02-20T03:25:07.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6466ad7e00 1 -- start start 2026-02-20T03:25:07.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118630 0x55629213dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118fb0 0x55629212e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 0x55629212eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6404012670 con 0x55629211e000 2026-02-20T03:25:07.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f640400ff40 con 0x556292118630 2026-02-20T03:25:07.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f640400dd90 con 0x556292118fb0 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6461b46640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118630 0x55629213dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6462347640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118fb0 0x55629212e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6462347640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118fb0 0x55629212e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47786/0 (socket says 10.20.193.28:47786) 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.100+0000 7f6462347640 1 -- 10.20.193.28:0/1616180970 learned_addr learned my addr 10.20.193.28:0/1616180970 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f6462347640 1 -- 10.20.193.28:0/1616180970 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118630 msgr2=0x55629213dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f6462347640 1 --2- 10.20.193.28:0/1616180970 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118630 0x55629213dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f6461b46640 1 --2- 10.20.193.28:0/1616180970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 0x55629212eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f6462347640 1 -- 10.20.193.28:0/1616180970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 msgr2=0x55629212eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f6462347640 1 --2- 10.20.193.28:0/1616180970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 0x55629212eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f6462347640 1 -- 10.20.193.28:0/1616180970 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55629212a900 con 0x556292118fb0 2026-02-20T03:25:07.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f6461b46640 1 --2- 10.20.193.28:0/1616180970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 0x55629212eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:07.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f6462347640 1 --2- 10.20.193.28:0/1616180970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118fb0 0x55629212e600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f644c009a30 tx=0x7f644c04c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=755b5ed9adf4b9a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:07.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f642a4e6640 1 -- 10.20.193.28:0/1616180970 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c0044d0 con 0x556292118fb0 2026-02-20T03:25:07.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f642a4e6640 1 -- 10.20.193.28:0/1616180970 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f644c047040 con 0x556292118fb0 2026-02-20T03:25:07.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.101+0000 7f642a4e6640 1 -- 10.20.193.28:0/1616180970 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c04c6c0 con 0x556292118fb0 2026-02-20T03:25:07.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1616180970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118fb0 msgr2=0x55629212e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/1616180970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118fb0 0x55629212e600 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f644c009a30 tx=0x7f644c04c000 comp rx=0 tx=0).stop 2026-02-20T03:25:07.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1616180970 shutdown_connections 2026-02-20T03:25:07.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/1616180970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55629211e000 0x55629212eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/1616180970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118fb0 0x55629212e600 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/1616180970 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556292118630 0x55629213dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1616180970 >> 10.20.193.28:0/1616180970 conn(0x5562920db290 msgr2=0x556292130220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:07.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1616180970 shutdown_connections 2026-02-20T03:25:07.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 -- 10.20.193.28:0/1616180970 wait complete. 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 -- start start 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.102+0000 7f6466ad7e00 1 Processor -- start 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 0x55629213ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118fb0 0x55629213b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6466ad7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55629211e000 0x5562921ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f640400e400 con 0x556292118fb0 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f640400f870 con 0x55629211e000 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6466ad7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f640400ead0 con 0x556292118630 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6462347640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118fb0 0x55629213b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6462347640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118fb0 0x55629213b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49050/0 (socket says 10.20.193.28:49050) 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6461b46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 0x55629213ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6462347640 1 -- 10.20.193.28:0/109780850 learned_addr learned my addr 10.20.193.28:0/109780850 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6461b46640 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55629211e000 0x5562921ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6462347640 1 -- 10.20.193.28:0/109780850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 msgr2=0x55629213ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6462347640 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 0x55629213ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6462347640 1 -- 10.20.193.28:0/109780850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55629211e000 msgr2=0x5562921ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6462347640 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55629211e000 0x5562921ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6462347640 1 -- 10.20.193.28:0/109780850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556291d4a870 con 0x556292118fb0 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6461b46640 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55629211e000 0x5562921ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f6462347640 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118fb0 0x55629213b050 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f644c002ba0 tx=0x7f644c02fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0726dec0f7d88a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.103+0000 7f640ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.104+0000 7f640ffff640 1 -- 10.20.193.28:0/109780850 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c05f070 con 0x556292118fb0 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.104+0000 7f6466ad7e00 1 -- 10.20.193.28:0/109780850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55629200b440 con 0x556292118fb0 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.104+0000 7f6466ad7e00 10 client.18186 _ll_register_callbacks cb 0x7f644c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:07.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.104+0000 7f6466ad7e00 1 -- 10.20.193.28:0/109780850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55629201db00 con 0x556292118fb0 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.104+0000 7f640ffff640 1 -- 10.20.193.28:0/109780850 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5562920791a0 con 0x556292118fb0 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.104+0000 7f640ffff640 1 -- 10.20.193.28:0/109780850 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c042bf0 con 0x556292118fb0 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.104+0000 7f640ffff640 1 -- 10.20.193.28:0/109780850 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f644c042d90 con 0x556292118fb0 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.104+0000 7f640ffff640 1 -- 10.20.193.28:0/109780850 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f644c0389d0 con 0x556292118fb0 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.104+0000 7f6466ad7e00 10 client.18186 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.105+0000 7f6466ad7e00 1 -- 10.20.193.28:0/109780850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55629212b5f0 con 0x556292118fb0 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.105+0000 7f640ffff640 1 -- 10.20.193.28:0/109780850 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f644c038b70 con 0x556292118fb0 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.105+0000 7f6466ad7e00 10 client.18186 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.105+0000 7f6466ad7e00 10 client.18186 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.105+0000 7f6466ad7e00 20 client.18186 populate_metadata read hostname 'trial028' 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.105+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5562921ad800 0x5562921afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.105+0000 7f6466ad7e00 4 client.18186 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.105+0000 7f6466ad7e00 1 -- 10.20.193.28:0/109780850 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f644c047040 con 0x5562921ad800 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.105+0000 7f6461b46640 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5562921ad800 0x5562921afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6461b46640 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5562921ad800 0x5562921afc90 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b13ab327c4a8048c server_cookie=ca94dc1d3badd7ab in_seq=0 out_seq=0 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f640ffff640 10 client.18186 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f640ffff640 1 -- 10.20.193.28:0/109780850 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f644c047040 con 0x5562921ad800 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f640ffff640 10 client.18186 handle_command_reply: tid=0 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6466ad7e00 1 client.18186 shutdown 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6466ad7e00 1 -- 10.20.193.28:0/109780850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118fb0 msgr2=0x55629213b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118fb0 0x55629213b050 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f644c002ba0 tx=0x7f644c02fdf0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6466ad7e00 1 -- 10.20.193.28:0/109780850 shutdown_connections 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5562921ad800 0x5562921afc90 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55629211e000 0x5562921ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556292118fb0 0x55629213b050 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6466ad7e00 1 --2- 10.20.193.28:0/109780850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556292118630 0x55629213ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.106+0000 7f6466ad7e00 1 -- 10.20.193.28:0/109780850 >> 10.20.193.28:0/109780850 conn(0x5562920db290 msgr2=0x556292141750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:07.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.107+0000 7f640ffff640 0 client.18186 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:07.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.107+0000 7f6466ad7e00 1 -- 10.20.193.28:0/109780850 shutdown_connections 2026-02-20T03:25:07.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.107+0000 7f6466ad7e00 1 -- 10.20.193.28:0/109780850 wait complete. 2026-02-20T03:25:07.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.107+0000 7f6466ad7e00 20 client.18186 trim_cache size 0 max 16384 2026-02-20T03:25:07.114 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:25:07.115 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:25:07.115 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:25:07.115 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:25:07.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.107+0000 7f6463349640 1 -- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f64380b0f70 msgr2=0x7f64380b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.107+0000 7f6463349640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f64380b0f70 0x7f64380b3430 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f645800ef90 tx=0x7f6458009e90 comp rx=0 tx=0).stop 2026-02-20T03:25:07.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.107+0000 7f6463349640 1 -- 10.20.193.28:0/2890733992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 msgr2=0x7f645c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.107+0000 7f6463349640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 0x7f645c10ec40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f645800efc0 tx=0x7f645800c490 comp rx=0 tx=0).stop 2026-02-20T03:25:07.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.108+0000 7f6463349640 1 -- 10.20.193.28:0/2890733992 shutdown_connections 2026-02-20T03:25:07.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.108+0000 7f6463349640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f64380b0f70 0x7f64380b3430 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.108+0000 7f6463349640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f645c10a980 0x7f645c10ec40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.108+0000 7f6463349640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f645c105320 0x7f645c10e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.108+0000 7f6463349640 1 --2- 10.20.193.28:0/2890733992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f645c104980 0x7f645c111650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.108+0000 7f6463349640 1 -- 10.20.193.28:0/2890733992 >> 10.20.193.28:0/2890733992 conn(0x7f645c100680 msgr2=0x7f645c100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:07.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.108+0000 7f6463349640 1 -- 10.20.193.28:0/2890733992 shutdown_connections 2026-02-20T03:25:07.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.108+0000 7f6463349640 1 -- 10.20.193.28:0/2890733992 wait complete. 2026-02-20T03:25:07.207 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:25:07.208 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:25:07.469 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:07.515 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:07 trial028 ceph-mon[38552]: pgmap v494: 129 pgs: 129 active+clean; 168 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 2.4 MiB/s wr, 469 op/s 2026-02-20T03:25:07.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 906012 8.18 MB/sec execute 400 sec latency 11.072 ms 2026-02-20T03:25:07.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:07 trial126 ceph-mon[38476]: pgmap v494: 129 pgs: 129 active+clean; 168 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 2.4 MiB/s wr, 469 op/s 2026-02-20T03:25:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.653+0000 7f4346b33640 1 -- 10.20.193.28:0/3153533241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f434010a470 msgr2=0x7f434010a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.653+0000 7f4346b33640 1 --2- 10.20.193.28:0/3153533241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f434010a470 0x7f434010a850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4330009a30 tx=0x7f433002f2d0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.653+0000 7f4346b33640 1 -- 10.20.193.28:0/3153533241 shutdown_connections 2026-02-20T03:25:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.653+0000 7f4346b33640 1 --2- 10.20.193.28:0/3153533241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4340115df0 0x7f43401181e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.653+0000 7f4346b33640 1 --2- 10.20.193.28:0/3153533241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f434010ad90 0x7f43401158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.653+0000 7f4346b33640 1 --2- 10.20.193.28:0/3153533241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f434010a470 0x7f434010a850 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.653+0000 7f4346b33640 1 -- 10.20.193.28:0/3153533241 >> 10.20.193.28:0/3153533241 conn(0x7f434006ed80 msgr2=0x7f434006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.653+0000 7f4346b33640 1 -- 10.20.193.28:0/3153533241 shutdown_connections 2026-02-20T03:25:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.653+0000 7f4346b33640 1 -- 10.20.193.28:0/3153533241 wait complete. 2026-02-20T03:25:07.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.654+0000 7f4346b33640 1 Processor -- start 2026-02-20T03:25:07.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.654+0000 7f4346b33640 1 -- start start 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.654+0000 7f4346b33640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f434010a470 0x7f434010d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.654+0000 7f4346b33640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f434010ad90 0x7f434010de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4346b33640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4340115df0 0x7f434010e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4346b33640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f434011b580 con 0x7f434010a470 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4346b33640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f434011b400 con 0x7f4340115df0 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4346b33640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f434011b700 con 0x7f434010ad90 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4337fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f434010ad90 0x7f434010de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4337fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f434010ad90 0x7f434010de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47818/0 (socket says 10.20.193.28:47818) 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4337fff640 1 -- 10.20.193.28:0/4083087411 learned_addr learned my addr 10.20.193.28:0/4083087411 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f43450a9640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4340115df0 0x7f434010e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f43448a8640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f434010a470 0x7f434010d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4337fff640 1 -- 10.20.193.28:0/4083087411 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4340115df0 msgr2=0x7f434010e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4337fff640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4340115df0 0x7f434010e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4337fff640 1 -- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f434010a470 msgr2=0x7f434010d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4337fff640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f434010a470 0x7f434010d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f4337fff640 1 -- 10.20.193.28:0/4083087411 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43401b64f0 con 0x7f434010ad90 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.655+0000 7f43448a8640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f434010a470 0x7f434010d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.656+0000 7f4337fff640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f434010ad90 0x7f434010de60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f432800d980 tx=0x7f432800de50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.656+0000 7f4335ffb640 1 -- 10.20.193.28:0/4083087411 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328014070 con 0x7f434010ad90 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.656+0000 7f4335ffb640 1 -- 10.20.193.28:0/4083087411 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f43280044e0 con 0x7f434010ad90 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.656+0000 7f4335ffb640 1 -- 10.20.193.28:0/4083087411 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328010460 con 0x7f434010ad90 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.656+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43401b67e0 con 0x7f434010ad90 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.656+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43401b6d50 con 0x7f434010ad90 2026-02-20T03:25:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.657+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4340074500 con 0x7f434010ad90 2026-02-20T03:25:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.659+0000 7f4335ffb640 1 -- 10.20.193.28:0/4083087411 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f43280026e0 con 0x7f434010ad90 2026-02-20T03:25:07.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.661+0000 7f4335ffb640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f431c0b0e20 0x7f431c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.661+0000 7f43448a8640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f431c0b0e20 0x7f431c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:07.663 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.661+0000 7f4335ffb640 1 -- 10.20.193.28:0/4083087411 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f43280e10b0 con 0x7f434010ad90 2026-02-20T03:25:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.662+0000 7f4335ffb640 1 -- 10.20.193.28:0/4083087411 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f43280e1530 con 0x7f434010ad90 2026-02-20T03:25:07.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.662+0000 7f43448a8640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f431c0b0e20 0x7f431c0b32e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f43300097c0 tx=0x7f433003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:07.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:07 trial177 ceph-mon[43181]: pgmap v494: 129 pgs: 129 active+clean; 168 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 2.4 MiB/s wr, 469 op/s 2026-02-20T03:25:07.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.770+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f434010a850 con 0x7f434010ad90 2026-02-20T03:25:07.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.771+0000 7f4335ffb640 1 -- 10.20.193.28:0/4083087411 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7f434010a850 con 0x7f434010ad90 2026-02-20T03:25:07.773 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:25:07.774 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":29,"btime":"2026-02-20T03:20:45:147754+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:20:44.164885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_25774":{"gid":25774,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1716979260","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1716979260},{"type":"v1","addr":"10.20.193.177:6837","nonce":1716979260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:25:07.775 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 29 2026-02-20T03:25:07.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f431c0b0e20 msgr2=0x7f431c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f431c0b0e20 0x7f431c0b32e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f43300097c0 tx=0x7f433003a040 comp rx=0 tx=0).stop 2026-02-20T03:25:07.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f434010ad90 msgr2=0x7f434010de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:07.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f434010ad90 0x7f434010de60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f432800d980 tx=0x7f432800de50 comp rx=0 tx=0).stop 2026-02-20T03:25:07.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 shutdown_connections 2026-02-20T03:25:07.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f431c0b0e20 0x7f431c0b32e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4340115df0 0x7f434010e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f434010ad90 0x7f434010de60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 --2- 10.20.193.28:0/4083087411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f434010a470 0x7f434010d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:07.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.774+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 >> 10.20.193.28:0/4083087411 conn(0x7f434006ed80 msgr2=0x7f434010b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:07.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.775+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 shutdown_connections 2026-02-20T03:25:07.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:07.775+0000 7f4346b33640 1 -- 10.20.193.28:0/4083087411 wait complete. 2026-02-20T03:25:07.881 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:25:08.152 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.327+0000 7ff0e639b640 1 -- 10.20.193.28:0/3549645163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0106a80 msgr2=0x7ff0e0106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.327+0000 7ff0e639b640 1 --2- 10.20.193.28:0/3549645163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0106a80 0x7ff0e0106f30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009f90 tx=0x7ff0dc02f430 comp rx=0 tx=0).stop 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.327+0000 7ff0e639b640 1 -- 10.20.193.28:0/3549645163 shutdown_connections 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.327+0000 7ff0e639b640 1 --2- 10.20.193.28:0/3549645163 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0106a80 0x7ff0e0106f30 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.327+0000 7ff0e639b640 1 --2- 10.20.193.28:0/3549645163 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0e0101f90 0x7ff0e0106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.327+0000 7ff0e639b640 1 --2- 10.20.193.28:0/3549645163 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0e0101670 0x7ff0e0101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.327+0000 7ff0e639b640 1 -- 10.20.193.28:0/3549645163 >> 10.20.193.28:0/3549645163 conn(0x7ff0e00fd2e0 msgr2=0x7ff0e00ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.327+0000 7ff0e639b640 1 -- 10.20.193.28:0/3549645163 shutdown_connections 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.327+0000 7ff0e639b640 1 -- 10.20.193.28:0/3549645163 wait complete. 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e639b640 1 Processor -- start 2026-02-20T03:25:08.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e639b640 1 -- start start 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e639b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0e0101670 0x7ff0e01a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e639b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0101f90 0x7ff0e01a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e639b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0e0106a80 0x7ff0e01a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e639b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e01190b0 con 0x7ff0e0101f90 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e639b640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0118f30 con 0x7ff0e0101670 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e639b640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e0119230 con 0x7ff0e0106a80 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e4b98640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0101f90 0x7ff0e01a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e5b9a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0e0106a80 0x7ff0e01a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e4b98640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0101f90 0x7ff0e01a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49086/0 (socket says 10.20.193.28:49086) 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e4b98640 1 -- 10.20.193.28:0/2242477478 learned_addr learned my addr 10.20.193.28:0/2242477478 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e5b9a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0e0106a80 0x7ff0e01a5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47836/0 (socket says 10.20.193.28:47836) 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.328+0000 7ff0e5399640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0e0101670 0x7ff0e01a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0e5b9a640 1 -- 10.20.193.28:0/2242477478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0e0101670 msgr2=0x7ff0e01a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0e5b9a640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0e0101670 0x7ff0e01a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0e5b9a640 1 -- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0101f90 msgr2=0x7ff0e01a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0e5b9a640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0101f90 0x7ff0e01a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0e5b9a640 1 -- 10.20.193.28:0/2242477478 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e01a6500 con 0x7ff0e0106a80 2026-02-20T03:25:08.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0101f90 0x7ff0e01a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:08.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0e5b9a640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0e0106a80 0x7ff0e01a5d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009f90 tx=0x7ff0dc004460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0ce7fc640 1 -- 10.20.193.28:0/2242477478 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc004b40 con 0x7ff0e0106a80 2026-02-20T03:25:08.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0ce7fc640 1 -- 10.20.193.28:0/2242477478 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0dc004ce0 con 0x7ff0e0106a80 2026-02-20T03:25:08.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0ce7fc640 1 -- 10.20.193.28:0/2242477478 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc007e10 con 0x7ff0e0106a80 2026-02-20T03:25:08.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0e639b640 1 -- 10.20.193.28:0/2242477478 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e01a6790 con 0x7ff0e0106a80 2026-02-20T03:25:08.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.329+0000 7ff0e639b640 1 -- 10.20.193.28:0/2242477478 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e01ae030 con 0x7ff0e0106a80 2026-02-20T03:25:08.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.332+0000 7ff0ce7fc640 1 -- 10.20.193.28:0/2242477478 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff0dc007400 con 0x7ff0e0106a80 2026-02-20T03:25:08.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.332+0000 7ff0e9b29e00 1 Processor -- start 2026-02-20T03:25:08.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.332+0000 7ff0e9b29e00 1 -- start start 2026-02-20T03:25:08.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbd1fb0 0x557c1cbd2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbcca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbccf60 0x557c1cbd8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c1cb4ce00 con 0x557c1cbcc5e0 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557c1cb1f970 con 0x557c1cbd1fb0 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557c1cacd1f0 con 0x557c1cbccf60 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e4b98640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbd1fb0 0x557c1cbd2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e4b98640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbd1fb0 0x557c1cbd2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56442/0 (socket says 10.20.193.28:56442) 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e4b98640 1 -- 10.20.193.28:0/4134488175 learned_addr learned my addr 10.20.193.28:0/4134488175 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e5399640 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbcca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbccf60 0x557c1cbd8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0ce7fc640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0bc0b0e20 0x7ff0bc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e5399640 1 -- 10.20.193.28:0/4134488175 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbccf60 msgr2=0x557c1cbd8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e5399640 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbccf60 0x557c1cbd8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e5399640 1 -- 10.20.193.28:0/4134488175 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbd1fb0 msgr2=0x557c1cbd2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e5399640 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbd1fb0 0x557c1cbd2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e5399640 1 -- 10.20.193.28:0/4134488175 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c1cae03d0 con 0x557c1cbcc5e0 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbd1fb0 0x557c1cbd2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.333+0000 7ff0ce7fc640 1 -- 10.20.193.28:0/2242477478 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff0dc1053b0 con 0x7ff0e0106a80 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e5399640 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbcca20 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0004510 tx=0x7ff0d0009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe4a3f7b001c98d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e5b9a640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0bc0b0e20 0x7ff0bc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0adce5640 1 -- 10.20.193.28:0/4134488175 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d001a440 con 0x557c1cbcc5e0 2026-02-20T03:25:08.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0adce5640 1 -- 10.20.193.28:0/4134488175 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0d001aa80 con 0x557c1cbcc5e0 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0adce5640 1 -- 10.20.193.28:0/4134488175 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0010a20 con 0x557c1cbcc5e0 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/4134488175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 msgr2=0x557c1cbcca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbcca20 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0004510 tx=0x7ff0d0009c70 comp rx=0 tx=0).stop 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/4134488175 shutdown_connections 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbccf60 0x557c1cbd8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbcca20 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/4134488175 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbd1fb0 0x557c1cbd2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/4134488175 >> 10.20.193.28:0/4134488175 conn(0x557c1cb8f240 msgr2=0x557c1cbcace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/4134488175 shutdown_connections 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e5b9a640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0bc0b0e20 0x7ff0bc0b32e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0cce20 tx=0x7ff0dc009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.334+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/4134488175 wait complete. 2026-02-20T03:25:08.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e9b29e00 1 -- start start 2026-02-20T03:25:08.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e9b29e00 1 Processor -- start 2026-02-20T03:25:08.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbf6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557c1cb1b8a0 con 0x557c1cbcc5e0 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557c1c90df50 con 0x557c1cbccf60 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557c1cbf6da0 con 0x557c1cbd1fb0 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e4b98640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e4b98640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49100/0 (socket says 10.20.193.28:49100) 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.336+0000 7ff0e4b98640 1 -- 10.20.193.28:0/250230561 learned_addr learned my addr 10.20.193.28:0/250230561 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff0e5399640 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbf6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff0e4b98640 1 -- 10.20.193.28:0/250230561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 msgr2=0x557c1cbf6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbf6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff0e4b98640 1 -- 10.20.193.28:0/250230561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 msgr2=0x557c1cbf88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff0e4b98640 1 -- 10.20.193.28:0/250230561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c1cbefe90 con 0x557c1cbcc5e0 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009e10 tx=0x7ff0d4004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb0ac25112b62b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff09affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:08.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff09affd640 1 -- 10.20.193.28:0/250230561 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4020450 con 0x557c1cbcc5e0 2026-02-20T03:25:08.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff09affd640 1 -- 10.20.193.28:0/250230561 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0d40108d0 con 0x557c1cbcc5e0 2026-02-20T03:25:08.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff09affd640 1 -- 10.20.193.28:0/250230561 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400e830 con 0x557c1cbcc5e0 2026-02-20T03:25:08.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.337+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/250230561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c1c8f0b40 con 0x557c1cbcc5e0 2026-02-20T03:25:08.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff09affd640 1 -- 10.20.193.28:0/250230561 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff0d400e9d0 con 0x557c1cbcc5e0 2026-02-20T03:25:08.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff09affd640 10 client.18204 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:25:08.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff0e9b29e00 10 client.18204 _ll_register_callbacks cb 0x557c1cb58eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:08.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/250230561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c1cb2d150 con 0x557c1cbcc5e0 2026-02-20T03:25:08.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff09affd640 1 -- 10.20.193.28:0/250230561 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff0d400ebd0 con 0x557c1cbcc5e0 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff0e9b29e00 10 client.18204 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/250230561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557c1cada1e0 con 0x557c1cbcc5e0 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff09affd640 1 -- 10.20.193.28:0/250230561 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff0d4010430 con 0x557c1cbcc5e0 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff0e9b29e00 10 client.18204 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.338+0000 7ff0e9b29e00 10 client.18204 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.339+0000 7ff0e9b29e00 20 client.18204 populate_metadata read hostname 'trial028' 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.339+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557c1cc06a60 0x557c1cc08ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.339+0000 7ff0e9b29e00 4 client.18204 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.339+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/250230561 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c1cb27560 con 0x557c1cc06a60 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.339+0000 7ff0e5399640 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557c1cc06a60 0x557c1cc08ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.339+0000 7ff0e5399640 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557c1cc06a60 0x557c1cc08ef0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3dcc7fdf828d17cb server_cookie=fde32fc52521b627 in_seq=0 out_seq=0 2026-02-20T03:25:08.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.339+0000 7ff09affd640 10 client.18204 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:25:08.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff09affd640 1 -- 10.20.193.28:0/250230561 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557c1cb27560 con 0x557c1cc06a60 2026-02-20T03:25:08.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff09affd640 10 client.18204 handle_command_reply: tid=0 2026-02-20T03:25:08.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff0e9b29e00 1 client.18204 shutdown 2026-02-20T03:25:08.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/250230561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 msgr2=0x557c1cbf8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009e10 tx=0x7ff0d4004830 comp rx=0 tx=0).stop 2026-02-20T03:25:08.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/250230561 shutdown_connections 2026-02-20T03:25:08.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbf6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557c1cc06a60 0x557c1cc08ef0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/250230561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/250230561 >> 10.20.193.28:0/250230561 conn(0x557c1cb8f240 msgr2=0x557c1cbcb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.340+0000 7ff09affd640 0 client.18204 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:25:08.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.341+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/250230561 shutdown_connections 2026-02-20T03:25:08.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.341+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/250230561 wait complete. 2026-02-20T03:25:08.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.341+0000 7ff0e9b29e00 20 client.18204 trim_cache size 0 max 16384 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.347+0000 7ff0e9b29e00 1 Processor -- start 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.347+0000 7ff0e9b29e00 1 -- start start 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbf5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c0127c0 con 0x557c1cbcc5e0 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c010090 con 0x557c1cbccf60 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c00dee0 con 0x557c1cbd1fb0 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e5399640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e5399640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56450/0 (socket says 10.20.193.28:56450) 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e5399640 1 -- 10.20.193.28:0/2434853443 learned_addr learned my addr 10.20.193.28:0/2434853443 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/2434853443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e5399640 1 -- 10.20.193.28:0/2434853443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 msgr2=0x557c1cbf5070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e5399640 1 --2- 10.20.193.28:0/2434853443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbf5070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e5399640 1 -- 10.20.193.28:0/2434853443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 msgr2=0x557c1cbf8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e5399640 1 --2- 10.20.193.28:0/2434853443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e5399640 1 -- 10.20.193.28:0/2434853443 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c1cbefcc0 con 0x557c1cbccf60 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.348+0000 7ff0e5399640 1 --2- 10.20.193.28:0/2434853443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0002410 tx=0x7ff0d0009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a2c3fd67576fd11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0ad4e4640 1 -- 10.20.193.28:0/2434853443 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d001a880 con 0x557c1cbccf60 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0ad4e4640 1 -- 10.20.193.28:0/2434853443 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x557c1cb27560 con 0x557c1cbccf60 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0ad4e4640 1 -- 10.20.193.28:0/2434853443 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00053c0 con 0x557c1cbccf60 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/2434853443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 msgr2=0x557c1cbf88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/2434853443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0002410 tx=0x7ff0d0009290 comp rx=0 tx=0).stop 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/2434853443 shutdown_connections 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/2434853443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbf5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/2434853443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbccf60 0x557c1cbf88a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/2434853443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbcc5e0 0x557c1cbf8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/2434853443 >> 10.20.193.28:0/2434853443 conn(0x557c1cb8f240 msgr2=0x557c1cc08a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/2434853443 shutdown_connections 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.349+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/2434853443 wait complete. 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e9b29e00 1 -- start start 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e9b29e00 1 Processor -- start 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbcc5e0 0x557c1cbfe440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbccf60 0x557c1cbfe980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e9b29e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbfb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c00e550 con 0x557c1cbccf60 2026-02-20T03:25:08.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c00f9c0 con 0x557c1cbcc5e0 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e9b29e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c00ec20 con 0x557c1cbd1fb0 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e4b98640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbcc5e0 0x557c1cbfe440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e5399640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbccf60 0x557c1cbfe980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e5399640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbccf60 0x557c1cbfe980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49120/0 (socket says 10.20.193.28:49120) 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e5399640 1 -- 10.20.193.28:0/1540232104 learned_addr learned my addr 10.20.193.28:0/1540232104 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.350+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbfb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e5399640 1 -- 10.20.193.28:0/1540232104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 msgr2=0x557c1cbfb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e5399640 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbfb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e5399640 1 -- 10.20.193.28:0/1540232104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbcc5e0 msgr2=0x557c1cbfe440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e5399640 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbcc5e0 0x557c1cbfe440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e5399640 1 -- 10.20.193.28:0/1540232104 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c1c7fe870 con 0x557c1cbccf60 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbcc5e0 0x557c1cbfe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e5399640 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbccf60 0x557c1cbfe980 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0002410 tx=0x7ff0d0009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c6e4639c5daabf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff09affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff09affd640 1 -- 10.20.193.28:0/1540232104 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d001a890 con 0x557c1cbccf60 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/1540232104 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c1cabf3f0 con 0x557c1cbccf60 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e9b29e00 10 client.18210 _ll_register_callbacks cb 0x7ff0d4002c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff09affd640 1 -- 10.20.193.28:0/1540232104 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff0d00055e0 con 0x557c1cbccf60 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/1540232104 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0d001aa80 con 0x557c1cbccf60 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.351+0000 7ff09affd640 1 -- 10.20.193.28:0/1540232104 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0010620 con 0x557c1cbccf60 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff09affd640 1 -- 10.20.193.28:0/1540232104 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff0d00107c0 con 0x557c1cbccf60 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff09affd640 1 -- 10.20.193.28:0/1540232104 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff0d0010aa0 con 0x557c1cbccf60 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff0e9b29e00 10 client.18210 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/1540232104 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x557c1cbf09b0 con 0x557c1cbccf60 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff09affd640 1 -- 10.20.193.28:0/1540232104 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff0d0018020 con 0x557c1cbccf60 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff0e9b29e00 10 client.18210 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff0e9b29e00 10 client.18210 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:25:08.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff0e9b29e00 20 client.18210 populate_metadata read hostname 'trial028' 2026-02-20T03:25:08.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557c1cc72000 0x557c1cc74490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff0e9b29e00 4 client.18210 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:25:08.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/1540232104 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c1caf07c0 con 0x557c1cc72000 2026-02-20T03:25:08.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.352+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557c1cc72000 0x557c1cc74490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.353+0000 7ff09affd640 10 client.18210 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:25:08.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.353+0000 7ff0e4b98640 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557c1cc72000 0x557c1cc74490 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa66221324f9a71f server_cookie=23a39c91866a5e6a in_seq=0 out_seq=0 2026-02-20T03:25:08.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.353+0000 7ff09affd640 1 -- 10.20.193.28:0/1540232104 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c1caf07c0 con 0x557c1cc72000 2026-02-20T03:25:08.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.353+0000 7ff09affd640 10 client.18210 handle_command_reply: tid=0 2026-02-20T03:25:08.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.353+0000 7ff0e9b29e00 1 client.18210 shutdown 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.353+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/1540232104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbccf60 msgr2=0x557c1cbfe980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.353+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbccf60 0x557c1cbfe980 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0002410 tx=0x7ff0d0009740 comp rx=0 tx=0).stop 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/1540232104 shutdown_connections 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557c1cbd1fb0 0x557c1cbfb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557c1cc72000 0x557c1cc74490 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557c1cbccf60 0x557c1cbfe980 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e9b29e00 1 --2- 10.20.193.28:0/1540232104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557c1cbcc5e0 0x557c1cbfe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff09affd640 0 client.18210 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/1540232104 >> 10.20.193.28:0/1540232104 conn(0x557c1cb8f240 msgr2=0x557c1cbf8360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/1540232104 shutdown_connections 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e9b29e00 1 -- 10.20.193.28:0/1540232104 wait complete. 2026-02-20T03:25:08.355 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e9b29e00 20 client.18210 trim_cache size 0 max 16384 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 -- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0bc0b0e20 msgr2=0x7ff0bc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0bc0b0e20 0x7ff0bc0b32e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0cce20 tx=0x7ff0dc009040 comp rx=0 tx=0).stop 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 -- 10.20.193.28:0/2242477478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0e0106a80 msgr2=0x7ff0e01a5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0e0106a80 0x7ff0e01a5d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009f90 tx=0x7ff0dc004460 comp rx=0 tx=0).stop 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 -- 10.20.193.28:0/2242477478 shutdown_connections 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff0bc0b0e20 0x7ff0bc0b32e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff0e0106a80 0x7ff0e01a5d80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff0e0101f90 0x7ff0e01a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 --2- 10.20.193.28:0/2242477478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff0e0101670 0x7ff0e01a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 -- 10.20.193.28:0/2242477478 >> 10.20.193.28:0/2242477478 conn(0x7ff0e00fd2e0 msgr2=0x7ff0e01105c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 -- 10.20.193.28:0/2242477478 shutdown_connections 2026-02-20T03:25:08.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.354+0000 7ff0e639b640 1 -- 10.20.193.28:0/2242477478 wait complete. 2026-02-20T03:25:08.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:08 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4083087411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:25:08.456 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:25:08.517 INFO:tasks.workunit.client.0.trial028.stdout: 1 909285 8.21 MB/sec execute 401 sec latency 16.806 ms 2026-02-20T03:25:08.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:08 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4083087411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:25:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:08 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4083087411' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:25:08.726 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:08.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.911+0000 7f34cb577640 1 -- 10.20.193.28:0/869520289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc104980 msgr2=0x7f34cc104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.911+0000 7f34cb577640 1 --2- 10.20.193.28:0/869520289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc104980 0x7f34cc104de0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009a60 tx=0x7f34b402f250 comp rx=0 tx=0).stop 2026-02-20T03:25:08.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.911+0000 7f34cb577640 1 -- 10.20.193.28:0/869520289 shutdown_connections 2026-02-20T03:25:08.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.911+0000 7f34cb577640 1 --2- 10.20.193.28:0/869520289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34cc105320 0x7f34cc111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.911+0000 7f34cb577640 1 --2- 10.20.193.28:0/869520289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc104980 0x7f34cc104de0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.911+0000 7f34cb577640 1 --2- 10.20.193.28:0/869520289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f34cc10a980 0x7f34cc10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.911+0000 7f34cb577640 1 -- 10.20.193.28:0/869520289 >> 10.20.193.28:0/869520289 conn(0x7f34cc100680 msgr2=0x7f34cc102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.911+0000 7f34cb577640 1 -- 10.20.193.28:0/869520289 shutdown_connections 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.911+0000 7f34cb577640 1 -- 10.20.193.28:0/869520289 wait complete. 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34cb577640 1 Processor -- start 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34cb577640 1 -- start start 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34cb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34cc104980 0x7f34cc077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34cb577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc105320 0x7f34cc077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34cb577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f34cc10a980 0x7f34cc078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34cb577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc114bf0 con 0x7f34cc104980 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34cb577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc114a70 con 0x7f34cc10a980 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34cb577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc114d70 con 0x7f34cc105320 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34c9d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc105320 0x7f34cc077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34ca575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34cc104980 0x7f34cc077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34c9d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc105320 0x7f34cc077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47868/0 (socket says 10.20.193.28:47868) 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.912+0000 7f34c9d74640 1 -- 10.20.193.28:0/3845893202 learned_addr learned my addr 10.20.193.28:0/3845893202 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34cad76640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f34cc10a980 0x7f34cc078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34c9d74640 1 -- 10.20.193.28:0/3845893202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f34cc10a980 msgr2=0x7f34cc078080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34c9d74640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f34cc10a980 0x7f34cc078080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34c9d74640 1 -- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34cc104980 msgr2=0x7f34cc077600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34c9d74640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34cc104980 0x7f34cc077600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34c9d74640 1 -- 10.20.193.28:0/3845893202 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc1ad930 con 0x7f34cc105320 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34ca575640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34cc104980 0x7f34cc077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34c9d74640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc105320 0x7f34cc077b40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f34b402fca0 tx=0x7f34b402fcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34b37fe640 1 -- 10.20.193.28:0/3845893202 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4002a30 con 0x7f34cc105320 2026-02-20T03:25:08.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34b37fe640 1 -- 10.20.193.28:0/3845893202 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f34b40384e0 con 0x7f34cc105320 2026-02-20T03:25:08.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34cb577640 1 -- 10.20.193.28:0/3845893202 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc1adbc0 con 0x7f34cc105320 2026-02-20T03:25:08.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34b37fe640 1 -- 10.20.193.28:0/3845893202 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40416f0 con 0x7f34cc105320 2026-02-20T03:25:08.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.913+0000 7f34cb577640 1 -- 10.20.193.28:0/3845893202 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc1ae0f0 con 0x7f34cc105320 2026-02-20T03:25:08.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.916+0000 7f34b37fe640 1 -- 10.20.193.28:0/3845893202 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f34b4038a20 con 0x7f34cc105320 2026-02-20T03:25:08.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.916+0000 7f34d3387e00 1 Processor -- start 2026-02-20T03:25:08.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.916+0000 7f34d3387e00 1 -- start start 2026-02-20T03:25:08.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab09f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 0x55e0ab099a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34d3387e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e0ab019e00 con 0x55e0ab09efb0 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34d3387e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e0aafec970 con 0x55e0ab0995e0 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34d3387e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e0aaf9a1f0 con 0x55e0ab099f60 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34cad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab09f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34cad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab09f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49140/0 (socket says 10.20.193.28:49140) 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34cad76640 1 -- 10.20.193.28:0/1031138500 learned_addr learned my addr 10.20.193.28:0/1031138500 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34ca575640 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 0x55e0ab099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34c9d74640 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34cad76640 1 -- 10.20.193.28:0/1031138500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 msgr2=0x55e0ab0a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34cad76640 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34cad76640 1 -- 10.20.193.28:0/1031138500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 msgr2=0x55e0ab099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34cad76640 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 0x55e0ab099a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34cad76640 1 -- 10.20.193.28:0/1031138500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aafad3d0 con 0x55e0ab09efb0 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34c9d74640 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34cad76640 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab09f390 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009490 tx=0x7f34bc002f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf06839b8d43d7d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.917+0000 7f34b0ff9640 1 -- 10.20.193.28:0/1031138500 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc01a070 con 0x55e0ab09efb0 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.918+0000 7f34b0ff9640 1 -- 10.20.193.28:0/1031138500 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f34bc007ba0 con 0x55e0ab09efb0 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.918+0000 7f34b0ff9640 1 -- 10.20.193.28:0/1031138500 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc015c30 con 0x55e0ab09efb0 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.918+0000 7f34d3387e00 1 -- 10.20.193.28:0/1031138500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 msgr2=0x55e0ab09f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.918+0000 7f34d3387e00 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab09f390 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009490 tx=0x7f34bc002f00 comp rx=0 tx=0).stop 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.918+0000 7f34b37fe640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34a40b0e20 0x7f34a40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34b37fe640 1 -- 10.20.193.28:0/3845893202 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f34b4105080 con 0x7f34cc105320 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34d3387e00 1 -- 10.20.193.28:0/1031138500 shutdown_connections 2026-02-20T03:25:08.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34d3387e00 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34d3387e00 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 0x55e0ab099a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34d3387e00 1 --2- 10.20.193.28:0/1031138500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab09f390 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34d3387e00 1 -- 10.20.193.28:0/1031138500 >> 10.20.193.28:0/1031138500 conn(0x55e0ab05c240 msgr2=0x55e0ab097ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34d3387e00 1 -- 10.20.193.28:0/1031138500 shutdown_connections 2026-02-20T03:25:08.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34d3387e00 1 -- 10.20.193.28:0/1031138500 wait complete. 2026-02-20T03:25:08.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34cad76640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34a40b0e20 0x7f34a40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.919+0000 7f34cad76640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34a40b0e20 0x7f34a40b32e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f34bc018040 tx=0x7f34bc0157d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.920+0000 7f34d3387e00 1 -- start start 2026-02-20T03:25:08.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.920+0000 7f34d3387e00 1 Processor -- start 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.920+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab0c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.920+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab099f60 0x55e0ab0c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.920+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.920+0000 7f34d3387e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e0aafe88a0 con 0x55e0ab09efb0 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.920+0000 7f34d3387e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e0aaddaf50 con 0x55e0ab099f60 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.920+0000 7f34d3387e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e0ab0c3fa0 con 0x55e0ab0995e0 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34c9d74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab099f60 0x55e0ab0c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34c9d74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab099f60 0x55e0ab0c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56480/0 (socket says 10.20.193.28:56480) 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34c9d74640 1 -- 10.20.193.28:0/2661640453 learned_addr learned my addr 10.20.193.28:0/2661640453 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34ca575640 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab0c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34c9d74640 1 -- 10.20.193.28:0/2661640453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 msgr2=0x55e0ab0c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34c9d74640 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab0c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34c9d74640 1 -- 10.20.193.28:0/2661640453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 msgr2=0x55e0ab0c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34c9d74640 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34c9d74640 1 -- 10.20.193.28:0/2661640453 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ab0bce20 con 0x55e0ab099f60 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34c9d74640 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab099f60 0x55e0ab0c56f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f34b41026f0 tx=0x7f34b4005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a53805736cfea64 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f347bfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f347bfff640 1 -- 10.20.193.28:0/2661640453 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40d1110 con 0x55e0ab099f60 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34d3387e00 1 -- 10.20.193.28:0/2661640453 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0aadbdb40 con 0x55e0ab099f60 2026-02-20T03:25:08.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.921+0000 7f34d3387e00 10 client.27311 _ll_register_callbacks cb 0x55e0ab025eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:08.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f34d3387e00 1 -- 10.20.193.28:0/2661640453 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0aaffa150 con 0x55e0ab099f60 2026-02-20T03:25:08.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f347bfff640 1 -- 10.20.193.28:0/2661640453 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f34b4033030 con 0x55e0ab099f60 2026-02-20T03:25:08.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f347bfff640 1 -- 10.20.193.28:0/2661640453 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40cbfd0 con 0x55e0ab099f60 2026-02-20T03:25:08.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f347bfff640 1 -- 10.20.193.28:0/2661640453 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f34b40f31b0 con 0x55e0ab099f60 2026-02-20T03:25:08.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f347bfff640 1 -- 10.20.193.28:0/2661640453 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f34b40f3450 con 0x55e0ab099f60 2026-02-20T03:25:08.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f34d3387e00 10 client.27311 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:08.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f34d3387e00 1 -- 10.20.193.28:0/2661640453 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e0aafa71e0 con 0x55e0ab099f60 2026-02-20T03:25:08.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f347bfff640 1 -- 10.20.193.28:0/2661640453 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f34b4107110 con 0x55e0ab099f60 2026-02-20T03:25:08.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f34d3387e00 10 client.27311 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f34d3387e00 10 client.27311 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f34d3387e00 20 client.27311 populate_metadata read hostname 'trial028' 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f34d3387e00 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e0ab0d39a0 0x55e0ab0d5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f34d3387e00 4 client.27311 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.922+0000 7f34d3387e00 1 -- 10.20.193.28:0/2661640453 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0aaff4560 con 0x55e0ab0d39a0 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.923+0000 7f34ca575640 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e0ab0d39a0 0x55e0ab0d5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.923+0000 7f34ca575640 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e0ab0d39a0 0x55e0ab0d5e60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6221e85eb7b733b8 server_cookie=6b5623351aec02aa in_seq=0 out_seq=0 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.923+0000 7f347bfff640 10 client.27311 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f347bfff640 1 -- 10.20.193.28:0/2661640453 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e0aaff4560 con 0x55e0ab0d39a0 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f347bfff640 10 client.27311 handle_command_reply: tid=0 2026-02-20T03:25:08.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 client.27311 shutdown 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 -- 10.20.193.28:0/2661640453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab099f60 msgr2=0x55e0ab0c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab099f60 0x55e0ab0c56f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f34b41026f0 tx=0x7f34b4005e50 comp rx=0 tx=0).stop 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 -- 10.20.193.28:0/2661640453 shutdown_connections 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e0ab0d39a0 0x55e0ab0d5e60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab0c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab099f60 0x55e0ab0c56f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 --2- 10.20.193.28:0/2661640453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab0c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 -- 10.20.193.28:0/2661640453 >> 10.20.193.28:0/2661640453 conn(0x55e0ab05c240 msgr2=0x55e0ab0983f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f347bfff640 0 client.27311 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.924+0000 7f34d3387e00 1 -- 10.20.193.28:0/2661640453 shutdown_connections 2026-02-20T03:25:08.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.925+0000 7f34d3387e00 1 -- 10.20.193.28:0/2661640453 wait complete. 2026-02-20T03:25:08.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.925+0000 7f34d3387e00 20 client.27311 trim_cache size 0 max 16384 2026-02-20T03:25:08.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.931+0000 7f34d3387e00 1 Processor -- start 2026-02-20T03:25:08.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.931+0000 7f34d3387e00 1 -- start start 2026-02-20T03:25:08.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab09ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab099f60 0x55e0ab0db770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab09efb0 0x55e0ab0dbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34d3387e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f34700126d0 con 0x55e0ab099f60 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34d3387e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f347000ffa0 con 0x55e0ab09efb0 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34d3387e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f347000ddf0 con 0x55e0ab0995e0 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34ca575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab09ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34cad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab09efb0 0x55e0ab0dbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34ca575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab09ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47902/0 (socket says 10.20.193.28:47902) 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34ca575640 1 -- 10.20.193.28:0/3746802023 learned_addr learned my addr 10.20.193.28:0/3746802023 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34c9d74640 1 --2- 10.20.193.28:0/3746802023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab099f60 0x55e0ab0db770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34ca575640 1 -- 10.20.193.28:0/3746802023 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab09efb0 msgr2=0x55e0ab0dbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34ca575640 1 --2- 10.20.193.28:0/3746802023 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab09efb0 0x55e0ab0dbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34ca575640 1 -- 10.20.193.28:0/3746802023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab099f60 msgr2=0x55e0ab0db770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34ca575640 1 --2- 10.20.193.28:0/3746802023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab099f60 0x55e0ab0db770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.932+0000 7f34ca575640 1 -- 10.20.193.28:0/3746802023 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0ab0bcc50 con 0x55e0ab0995e0 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.933+0000 7f34ca575640 1 --2- 10.20.193.28:0/3746802023 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab09ca20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f34c00041b0 tx=0x7f34c0009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e22d1ee277e2b6b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.933+0000 7f34964e6640 1 -- 10.20.193.28:0/3746802023 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c00106f0 con 0x55e0ab0995e0 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.933+0000 7f34964e6640 1 -- 10.20.193.28:0/3746802023 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f34c0010d30 con 0x55e0ab0995e0 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.933+0000 7f34d3387e00 1 -- 10.20.193.28:0/3746802023 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 msgr2=0x55e0ab09ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.933+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3746802023 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab09ca20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f34c00041b0 tx=0x7f34c0009290 comp rx=0 tx=0).stop 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.934+0000 7f34d3387e00 1 -- 10.20.193.28:0/3746802023 shutdown_connections 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.934+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3746802023 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab09efb0 0x55e0ab0dbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.934+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3746802023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab099f60 0x55e0ab0db770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.934+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3746802023 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab0995e0 0x55e0ab09ca20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.934+0000 7f34d3387e00 1 -- 10.20.193.28:0/3746802023 >> 10.20.193.28:0/3746802023 conn(0x55e0ab05c240 msgr2=0x55e0ab0c29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.934+0000 7f34d3387e00 1 -- 10.20.193.28:0/3746802023 shutdown_connections 2026-02-20T03:25:08.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.934+0000 7f34d3387e00 1 -- 10.20.193.28:0/3746802023 wait complete. 2026-02-20T03:25:08.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.934+0000 7f34d3387e00 1 -- start start 2026-02-20T03:25:08.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.934+0000 7f34d3387e00 1 Processor -- start 2026-02-20T03:25:08.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 0x55e0ab0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34d3387e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34d3387e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f347000e460 con 0x55e0ab09efb0 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34d3387e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f347000f8d0 con 0x55e0ab0995e0 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34d3387e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f347000eb30 con 0x55e0ab099f60 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34ca575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 0x55e0ab0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34ca575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 0x55e0ab0cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56484/0 (socket says 10.20.193.28:56484) 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34ca575640 1 -- 10.20.193.28:0/3621096473 learned_addr learned my addr 10.20.193.28:0/3621096473 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34c9d74640 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34cad76640 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34c9d74640 1 -- 10.20.193.28:0/3621096473 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 msgr2=0x55e0ab0cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34c9d74640 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 0x55e0ab0cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34c9d74640 1 -- 10.20.193.28:0/3621096473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 msgr2=0x55e0ab0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34c9d74640 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab0ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.935+0000 7f34c9d74640 1 -- 10.20.193.28:0/3621096473 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aaccb870 con 0x55e0ab099f60 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f34c9d74640 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0c9bd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f34b40c8b90 tx=0x7f34b40b5280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c77cdff090b42a22 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f347bfff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f347bfff640 1 -- 10.20.193.28:0/3621096473 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40d5500 con 0x55e0ab099f60 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f347bfff640 1 -- 10.20.193.28:0/3621096473 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f34b4033040 con 0x55e0ab099f60 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f347bfff640 1 -- 10.20.193.28:0/3621096473 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40d3310 con 0x55e0ab099f60 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f34d3387e00 1 -- 10.20.193.28:0/3621096473 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0aaf8c3f0 con 0x55e0ab099f60 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f34d3387e00 10 client.27328 _ll_register_callbacks cb 0x7f34b4009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f34d3387e00 1 -- 10.20.193.28:0/3621096473 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0aaf9eab0 con 0x55e0ab099f60 2026-02-20T03:25:08.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f347bfff640 1 -- 10.20.193.28:0/3621096473 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f34b40d3530 con 0x55e0ab099f60 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f347bfff640 1 -- 10.20.193.28:0/3621096473 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f34b40e5060 con 0x55e0ab099f60 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f34d3387e00 10 client.27328 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.936+0000 7f34d3387e00 1 -- 10.20.193.28:0/3621096473 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55e0ab0bd940 con 0x55e0ab099f60 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f347bfff640 1 -- 10.20.193.28:0/3621096473 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f34b40cbd70 con 0x55e0ab099f60 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f34d3387e00 10 client.27328 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f34d3387e00 10 client.27328 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f34d3387e00 20 client.27328 populate_metadata read hostname 'trial028' 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e0ab13f530 0x55e0ab1419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f34d3387e00 4 client.27328 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f34d3387e00 1 -- 10.20.193.28:0/3621096473 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f34bc007ba0 con 0x55e0ab13f530 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f34ca575640 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e0ab13f530 0x55e0ab1419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:08.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f34ca575640 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e0ab13f530 0x55e0ab1419c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4bad9f1f389e302f server_cookie=2974448c7ab063ef in_seq=0 out_seq=0 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.937+0000 7f347bfff640 10 client.27328 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f347bfff640 1 -- 10.20.193.28:0/3621096473 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f34bc007ba0 con 0x55e0ab13f530 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f347bfff640 10 client.27328 handle_command_reply: tid=0 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f34d3387e00 1 client.27328 shutdown 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f34d3387e00 1 -- 10.20.193.28:0/3621096473 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 msgr2=0x55e0ab0c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0c9bd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f34b40c8b90 tx=0x7f34b40b5280 comp rx=0 tx=0).stop 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f34d3387e00 1 -- 10.20.193.28:0/3621096473 shutdown_connections 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e0ab13f530 0x55e0ab1419c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0ab09efb0 0x55e0ab0ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0ab099f60 0x55e0ab0c9bd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f34d3387e00 1 --2- 10.20.193.28:0/3621096473 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e0ab0995e0 0x55e0ab0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f34d3387e00 1 -- 10.20.193.28:0/3621096473 >> 10.20.193.28:0/3621096473 conn(0x55e0ab05c240 msgr2=0x55e0ab0d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.938+0000 7f347bfff640 0 client.27328 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:25:08.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.939+0000 7f34d3387e00 1 -- 10.20.193.28:0/3621096473 shutdown_connections 2026-02-20T03:25:08.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.939+0000 7f34d3387e00 1 -- 10.20.193.28:0/3621096473 wait complete. 2026-02-20T03:25:08.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.939+0000 7f34d3387e00 20 client.27328 trim_cache size 0 max 16384 2026-02-20T03:25:08.947 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:25:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.939+0000 7f34cb577640 1 -- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34a40b0e20 msgr2=0x7f34a40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.939+0000 7f34cb577640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34a40b0e20 0x7f34a40b32e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f34bc018040 tx=0x7f34bc0157d0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.939+0000 7f34cb577640 1 -- 10.20.193.28:0/3845893202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc105320 msgr2=0x7f34cc077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.939+0000 7f34cb577640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc105320 0x7f34cc077b40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f34b402fca0 tx=0x7f34b402fcd0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.940+0000 7f34cb577640 1 -- 10.20.193.28:0/3845893202 shutdown_connections 2026-02-20T03:25:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.940+0000 7f34cb577640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f34a40b0e20 0x7f34a40b32e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.940+0000 7f34cb577640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f34cc10a980 0x7f34cc078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.940+0000 7f34cb577640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f34cc105320 0x7f34cc077b40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.940+0000 7f34cb577640 1 --2- 10.20.193.28:0/3845893202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f34cc104980 0x7f34cc077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.940+0000 7f34cb577640 1 -- 10.20.193.28:0/3845893202 >> 10.20.193.28:0/3845893202 conn(0x7f34cc100680 msgr2=0x7f34cc101040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.940+0000 7f34cb577640 1 -- 10.20.193.28:0/3845893202 shutdown_connections 2026-02-20T03:25:08.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:08.940+0000 7f34cb577640 1 -- 10.20.193.28:0/3845893202 wait complete. 2026-02-20T03:25:09.040 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:25:09.307 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:09.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:09 trial028 ceph-mon[38552]: pgmap v495: 129 pgs: 129 active+clean; 163 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 2.6 MiB/s wr, 454 op/s 2026-02-20T03:25:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.483+0000 7f57e261c640 1 -- 10.20.193.28:0/3554476576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc109220 msgr2=0x7f57dc109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:09.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.483+0000 7f57e261c640 1 --2- 10.20.193.28:0/3554476576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc109220 0x7f57dc109660 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009a30 tx=0x7f57d002f220 comp rx=0 tx=0).stop 2026-02-20T03:25:09.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.483+0000 7f57e261c640 1 -- 10.20.193.28:0/3554476576 shutdown_connections 2026-02-20T03:25:09.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.483+0000 7f57e261c640 1 --2- 10.20.193.28:0/3554476576 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57dc109ba0 0x7f57dc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.483+0000 7f57e261c640 1 --2- 10.20.193.28:0/3554476576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc109220 0x7f57dc109660 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.483+0000 7f57e261c640 1 --2- 10.20.193.28:0/3554476576 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57dc10eef0 0x7f57dc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.483+0000 7f57e261c640 1 -- 10.20.193.28:0/3554476576 >> 10.20.193.28:0/3554476576 conn(0x7f57dc078600 msgr2=0x7f57dc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:09.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.483+0000 7f57e261c640 1 -- 10.20.193.28:0/3554476576 shutdown_connections 2026-02-20T03:25:09.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.483+0000 7f57e261c640 1 -- 10.20.193.28:0/3554476576 wait complete. 2026-02-20T03:25:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e261c640 1 Processor -- start 2026-02-20T03:25:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e261c640 1 -- start start 2026-02-20T03:25:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e261c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57dc109220 0x7f57dc1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e261c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57dc109ba0 0x7f57dc1a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e261c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc10eef0 0x7f57dc1a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e261c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc119090 con 0x7f57dc10eef0 2026-02-20T03:25:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e261c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc118f10 con 0x7f57dc109220 2026-02-20T03:25:09.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e261c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc119210 con 0x7f57dc109ba0 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e161a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57dc109220 0x7f57dc1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e1e1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc10eef0 0x7f57dc1a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e0e19640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57dc109ba0 0x7f57dc1a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e161a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57dc109220 0x7f57dc1a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56504/0 (socket says 10.20.193.28:56504) 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.484+0000 7f57e161a640 1 -- 10.20.193.28:0/759121200 learned_addr learned my addr 10.20.193.28:0/759121200 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57e1e1b640 1 -- 10.20.193.28:0/759121200 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57dc109ba0 msgr2=0x7f57dc1a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57e1e1b640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57dc109ba0 0x7f57dc1a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57e1e1b640 1 -- 10.20.193.28:0/759121200 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57dc109220 msgr2=0x7f57dc1a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57e1e1b640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57dc109220 0x7f57dc1a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57e1e1b640 1 -- 10.20.193.28:0/759121200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc1a6570 con 0x7f57dc10eef0 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57e1e1b640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc10eef0 0x7f57dc1a5df0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f57d800efc0 tx=0x7f57d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:09.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57ca7fc640 1 -- 10.20.193.28:0/759121200 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8019070 con 0x7f57dc10eef0 2026-02-20T03:25:09.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57e261c640 1 -- 10.20.193.28:0/759121200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc1a6800 con 0x7f57dc10eef0 2026-02-20T03:25:09.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57ca7fc640 1 -- 10.20.193.28:0/759121200 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f57d80092d0 con 0x7f57dc10eef0 2026-02-20T03:25:09.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57ca7fc640 1 -- 10.20.193.28:0/759121200 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8007500 con 0x7f57dc10eef0 2026-02-20T03:25:09.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.485+0000 7f57e261c640 1 -- 10.20.193.28:0/759121200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc1ae0a0 con 0x7f57dc10eef0 2026-02-20T03:25:09.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.488+0000 7f57e5daae00 1 Processor -- start 2026-02-20T03:25:09.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.489+0000 7f57ca7fc640 1 -- 10.20.193.28:0/759121200 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f57d80076a0 con 0x7f57dc10eef0 2026-02-20T03:25:09.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e5daae00 1 -- start start 2026-02-20T03:25:09.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a61390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a67de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e5daae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aaa49dbe00 con 0x55aaa4a5bf60 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e5daae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55aaa49ae970 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e5daae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55aaa495c1f0 con 0x55aaa4a60fb0 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e0e19640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a61390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e0e19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a67de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e161a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e0e19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a67de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49206/0 (socket says 10.20.193.28:49206) 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e161a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56518/0 (socket says 10.20.193.28:56518) 2026-02-20T03:25:09.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e161a640 1 -- 10.20.193.28:0/2111654931 learned_addr learned my addr 10.20.193.28:0/2111654931 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e161a640 1 -- 10.20.193.28:0/2111654931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a60fb0 msgr2=0x55aaa4a61390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e161a640 1 --2- 10.20.193.28:0/2111654931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a61390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e161a640 1 -- 10.20.193.28:0/2111654931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 msgr2=0x55aaa4a67de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e161a640 1 --2- 10.20.193.28:0/2111654931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a67de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.490+0000 7f57e161a640 1 -- 10.20.193.28:0/2111654931 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaa496f3d0 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e161a640 1 --2- 10.20.193.28:0/2111654931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5ba20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009ee0 tx=0x7f57cc004420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d4df776fe2c1f2b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57a9ce5640 1 -- 10.20.193.28:0/2111654931 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc010630 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57a9ce5640 1 -- 10.20.193.28:0/2111654931 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f57cc010c70 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57a9ce5640 1 -- 10.20.193.28:0/2111654931 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc01acf0 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e5daae00 1 -- 10.20.193.28:0/2111654931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 msgr2=0x55aaa4a5ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2111654931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5ba20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009ee0 tx=0x7f57cc004420 comp rx=0 tx=0).stop 2026-02-20T03:25:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e5daae00 1 -- 10.20.193.28:0/2111654931 shutdown_connections 2026-02-20T03:25:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2111654931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a67de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2111654931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5ba20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2111654931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a61390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e5daae00 1 -- 10.20.193.28:0/2111654931 >> 10.20.193.28:0/2111654931 conn(0x55aaa4a1e240 msgr2=0x55aaa4a59ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e5daae00 1 -- 10.20.193.28:0/2111654931 shutdown_connections 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.491+0000 7f57e5daae00 1 -- 10.20.193.28:0/2111654931 wait complete. 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.492+0000 7f57ca7fc640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57b80b0d80 0x7f57b80b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.492+0000 7f57ca7fc640 1 -- 10.20.193.28:0/759121200 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f57d80e0860 con 0x7f57dc10eef0 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.492+0000 7f57e0e19640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57b80b0d80 0x7f57b80b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.492+0000 7f57e0e19640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57b80b0d80 0x7f57b80b3240 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f57dc10e5f0 tx=0x7f57d0005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e5daae00 1 -- start start 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e5daae00 1 Processor -- start 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a856e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a85c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a8b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e5daae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aaa49aa8a0 con 0x55aaa4a5bf60 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e5daae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55aaa479cf50 con 0x55aaa4a60fb0 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e5daae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55aaa4a86390 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e0e19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a85c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e0e19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a85c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49210/0 (socket says 10.20.193.28:49210) 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.493+0000 7f57e0e19640 1 -- 10.20.193.28:0/2464661745 learned_addr learned my addr 10.20.193.28:0/2464661745 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e161a640 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a856e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e1e1b640 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a8b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e0e19640 1 -- 10.20.193.28:0/2464661745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 msgr2=0x55aaa4a856e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e0e19640 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a856e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e0e19640 1 -- 10.20.193.28:0/2464661745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 msgr2=0x55aaa4a8b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:09.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e0e19640 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a8b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e0e19640 1 -- 10.20.193.28:0/2464661745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaa4a7ed80 con 0x55aaa4a5bf60 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e0e19640 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a85c20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f57d0037000 tx=0x7f57d0031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700057428cc1fbda server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f5796ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f5796ffd640 1 -- 10.20.193.28:0/2464661745 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0056070 con 0x55aaa4a5bf60 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e5daae00 1 -- 10.20.193.28:0/2464661745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaa477fb40 con 0x55aaa4a5bf60 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e5daae00 10 client.18237 _ll_register_callbacks cb 0x55aaa49e7eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f57e5daae00 1 -- 10.20.193.28:0/2464661745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aaa49bc150 con 0x55aaa4a5bf60 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f5796ffd640 1 -- 10.20.193.28:0/2464661745 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f57d0033040 con 0x55aaa4a5bf60 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.494+0000 7f5796ffd640 1 -- 10.20.193.28:0/2464661745 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0051870 con 0x55aaa4a5bf60 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f5796ffd640 1 -- 10.20.193.28:0/2464661745 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f57d0051b30 con 0x55aaa4a5bf60 2026-02-20T03:25:09.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f5796ffd640 1 -- 10.20.193.28:0/2464661745 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f57d0060050 con 0x55aaa4a5bf60 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f57e5daae00 10 client.18237 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f57e5daae00 1 -- 10.20.193.28:0/2464661745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55aaa49691e0 con 0x55aaa4a5bf60 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f5796ffd640 1 -- 10.20.193.28:0/2464661745 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f57d0063020 con 0x55aaa4a5bf60 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f57e5daae00 10 client.18237 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f57e5daae00 10 client.18237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f57e5daae00 20 client.18237 populate_metadata read hostname 'trial028' 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aaa4a956c0 0x55aaa4a97b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f57e5daae00 4 client.18237 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f57e5daae00 1 -- 10.20.193.28:0/2464661745 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aaa49b6560 con 0x55aaa4a956c0 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.495+0000 7f57e161a640 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aaa4a956c0 0x55aaa4a97b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.496+0000 7f57e161a640 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aaa4a956c0 0x55aaa4a97b10 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be2834550a69b176 server_cookie=f175c847918c44fb in_seq=0 out_seq=0 2026-02-20T03:25:09.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.496+0000 7f5796ffd640 10 client.18237 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:09.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.496+0000 7f5796ffd640 1 -- 10.20.193.28:0/2464661745 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55aaa49b6560 con 0x55aaa4a956c0 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.496+0000 7f5796ffd640 10 client.18237 handle_command_reply: tid=0 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.496+0000 7f57e5daae00 1 client.18237 shutdown 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 -- 10.20.193.28:0/2464661745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 msgr2=0x55aaa4a85c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a85c20 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f57d0037000 tx=0x7f57d0031040 comp rx=0 tx=0).stop 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 -- 10.20.193.28:0/2464661745 shutdown_connections 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aaa4a956c0 0x55aaa4a97b10 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a8b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a85c20 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2464661745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a856e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 -- 10.20.193.28:0/2464661745 >> 10.20.193.28:0/2464661745 conn(0x55aaa4a1e240 msgr2=0x55aaa4a5a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:09.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f5796ffd640 0 client.18237 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:09.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 -- 10.20.193.28:0/2464661745 shutdown_connections 2026-02-20T03:25:09.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 1 -- 10.20.193.28:0/2464661745 wait complete. 2026-02-20T03:25:09.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.497+0000 7f57e5daae00 20 client.18237 trim_cache size 0 max 16384 2026-02-20T03:25:09.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.503+0000 7f57e5daae00 1 Processor -- start 2026-02-20T03:25:09.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e5daae00 1 -- start start 2026-02-20T03:25:09.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a84450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a828b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e5daae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57880126f0 con 0x55aaa4a5bf60 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e5daae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f578800ffc0 con 0x55aaa4a60fb0 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e5daae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f578800de10 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e0e19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a84450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e161a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e0e19640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a84450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49212/0 (socket says 10.20.193.28:49212) 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e0e19640 1 -- 10.20.193.28:0/1285092865 learned_addr learned my addr 10.20.193.28:0/1285092865 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e1e1b640 1 --2- 10.20.193.28:0/1285092865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a828b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e0e19640 1 -- 10.20.193.28:0/1285092865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 msgr2=0x55aaa4a5fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:09.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e0e19640 1 --2- 10.20.193.28:0/1285092865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e0e19640 1 -- 10.20.193.28:0/1285092865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 msgr2=0x55aaa4a828b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:09.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e0e19640 1 --2- 10.20.193.28:0/1285092865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a828b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e0e19640 1 -- 10.20.193.28:0/1285092865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaa4a7ebb0 con 0x55aaa4a5bf60 2026-02-20T03:25:09.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.504+0000 7f57e0e19640 1 --2- 10.20.193.28:0/1285092865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a84450 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f57d0039b50 tx=0x7f57d0059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab9026d25bb88e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:09.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57a94e4640 1 -- 10.20.193.28:0/1285092865 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0056070 con 0x55aaa4a5bf60 2026-02-20T03:25:09.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57a94e4640 1 -- 10.20.193.28:0/1285092865 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f57d0033040 con 0x55aaa4a5bf60 2026-02-20T03:25:09.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57a94e4640 1 -- 10.20.193.28:0/1285092865 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0002730 con 0x55aaa4a5bf60 2026-02-20T03:25:09.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57e5daae00 1 -- 10.20.193.28:0/1285092865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 msgr2=0x55aaa4a84450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:09.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57e5daae00 1 --2- 10.20.193.28:0/1285092865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a84450 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f57d0039b50 tx=0x7f57d0059000 comp rx=0 tx=0).stop 2026-02-20T03:25:09.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57e5daae00 1 -- 10.20.193.28:0/1285092865 shutdown_connections 2026-02-20T03:25:09.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57e5daae00 1 --2- 10.20.193.28:0/1285092865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a828b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57e5daae00 1 --2- 10.20.193.28:0/1285092865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a84450 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57e5daae00 1 --2- 10.20.193.28:0/1285092865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a5fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57e5daae00 1 -- 10.20.193.28:0/1285092865 >> 10.20.193.28:0/1285092865 conn(0x55aaa4a1e240 msgr2=0x55aaa4a83d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57e5daae00 1 -- 10.20.193.28:0/1285092865 shutdown_connections 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.505+0000 7f57e5daae00 1 -- 10.20.193.28:0/1285092865 wait complete. 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e5daae00 1 -- start start 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e5daae00 1 Processor -- start 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a91e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a8e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e5daae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a8e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e5daae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f578800e480 con 0x55aaa4a60fb0 2026-02-20T03:25:09.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e5daae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f578800f8f0 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e5daae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f578800eb50 con 0x55aaa4a5bf60 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e0e19640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a8e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.506+0000 7f57e161a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a91e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e1e1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a8e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e161a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a91e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:56544/0 (socket says 10.20.193.28:56544) 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e161a640 1 -- 10.20.193.28:0/2093331652 learned_addr learned my addr 10.20.193.28:0/2093331652 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e161a640 1 -- 10.20.193.28:0/2093331652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5bf60 msgr2=0x55aaa4a8e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e161a640 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a8e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e161a640 1 -- 10.20.193.28:0/2093331652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a60fb0 msgr2=0x55aaa4a8e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e161a640 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a8e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e161a640 1 -- 10.20.193.28:0/2093331652 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaa468d870 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e1e1b640 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a8e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f57e161a640 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a91e50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0092d0 tx=0x7f57cc009410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1122ec1fd32937e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.507+0000 7f5796ffd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f5796ffd640 1 -- 10.20.193.28:0/2093331652 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc035070 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f5796ffd640 1 -- 10.20.193.28:0/2093331652 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f57cc01ae60 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f5796ffd640 1 -- 10.20.193.28:0/2093331652 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc030480 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 1 -- 10.20.193.28:0/2093331652 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaa494e3f0 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f5796ffd640 1 -- 10.20.193.28:0/2093331652 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f57cc005020 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f5796ffd640 10 client.27335 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 10 client.27335 _ll_register_callbacks cb 0x7f57cc005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 1 -- 10.20.193.28:0/2093331652 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aaa4960ab0 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f5796ffd640 1 -- 10.20.193.28:0/2093331652 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f57cc01a5c0 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 10 client.27335 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:09.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 1 -- 10.20.193.28:0/2093331652 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55aaa4a7f8a0 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f5796ffd640 1 -- 10.20.193.28:0/2093331652 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f57cc01a9c0 con 0x55aaa4a5b5e0 2026-02-20T03:25:09.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 10 client.27335 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:09.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 10 client.27335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:09.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 20 client.27335 populate_metadata read hostname 'trial028' 2026-02-20T03:25:09.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aaa4b01630 0x55aaa4b03af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:09.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 4 client.27335 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:25:09.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.508+0000 7f57e5daae00 1 -- 10.20.193.28:0/2093331652 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f57cc010c70 con 0x55aaa4b01630 2026-02-20T03:25:09.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.509+0000 7f57e0e19640 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aaa4b01630 0x55aaa4b03af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:09.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.509+0000 7f57e0e19640 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aaa4b01630 0x55aaa4b03af0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0b086aae7f43774 server_cookie=94e857ef702b5e04 in_seq=0 out_seq=0 2026-02-20T03:25:09.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.509+0000 7f5796ffd640 10 client.27335 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:09.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f5796ffd640 1 -- 10.20.193.28:0/2093331652 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f57cc010c70 con 0x55aaa4b01630 2026-02-20T03:25:09.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f5796ffd640 10 client.27335 handle_command_reply: tid=0 2026-02-20T03:25:09.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 client.27335 shutdown 2026-02-20T03:25:09.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 -- 10.20.193.28:0/2093331652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 msgr2=0x55aaa4a91e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:09.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a91e50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0092d0 tx=0x7f57cc009410 comp rx=0 tx=0).stop 2026-02-20T03:25:09.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 -- 10.20.193.28:0/2093331652 shutdown_connections 2026-02-20T03:25:09.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aaa4b01630 0x55aaa4b03af0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aaa4a60fb0 0x55aaa4a8e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aaa4a5bf60 0x55aaa4a8e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 --2- 10.20.193.28:0/2093331652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aaa4a5b5e0 0x55aaa4a91e50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 -- 10.20.193.28:0/2093331652 >> 10.20.193.28:0/2093331652 conn(0x55aaa4a1e240 msgr2=0x55aaa4a84560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:09.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f5796ffd640 0 client.27335 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:09.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 -- 10.20.193.28:0/2093331652 shutdown_connections 2026-02-20T03:25:09.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 1 -- 10.20.193.28:0/2093331652 wait complete. 2026-02-20T03:25:09.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.510+0000 7f57e5daae00 20 client.27335 trim_cache size 0 max 16384 2026-02-20T03:25:09.518 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:25:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.511+0000 7f57e261c640 1 -- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57b80b0d80 msgr2=0x7f57b80b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:09.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.511+0000 7f57e261c640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57b80b0d80 0x7f57b80b3240 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f57dc10e5f0 tx=0x7f57d0005950 comp rx=0 tx=0).stop 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.512+0000 7f57e261c640 1 -- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc10eef0 msgr2=0x7f57dc1a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.512+0000 7f57e261c640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc10eef0 0x7f57dc1a5df0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f57d800efc0 tx=0x7f57d800c490 comp rx=0 tx=0).stop 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.513+0000 7f57e261c640 1 -- 10.20.193.28:0/759121200 shutdown_connections 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.513+0000 7f57e261c640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57b80b0d80 0x7f57b80b3240 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.513+0000 7f57e261c640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57dc10eef0 0x7f57dc1a5df0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.513+0000 7f57e261c640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57dc109ba0 0x7f57dc1a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.513+0000 7f57e261c640 1 --2- 10.20.193.28:0/759121200 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57dc109220 0x7f57dc1a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.513+0000 7f57e261c640 1 -- 10.20.193.28:0/759121200 >> 10.20.193.28:0/759121200 conn(0x7f57dc078600 msgr2=0x7f57dc079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.517+0000 7f57e261c640 1 -- 10.20.193.28:0/759121200 shutdown_connections 2026-02-20T03:25:09.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:09.517+0000 7f57e261c640 1 -- 10.20.193.28:0/759121200 wait complete. 2026-02-20T03:25:09.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 912695 8.24 MB/sec execute 402 sec latency 12.774 ms 2026-02-20T03:25:09.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:09 trial126 ceph-mon[38476]: pgmap v495: 129 pgs: 129 active+clean; 163 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 2.6 MiB/s wr, 454 op/s 2026-02-20T03:25:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:09 trial177 ceph-mon[43181]: pgmap v495: 129 pgs: 129 active+clean; 163 MiB data, 3.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 2.6 MiB/s wr, 454 op/s 2026-02-20T03:25:10.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 912708 8.22 MB/sec execute 403 sec latency 978.649 ms 2026-02-20T03:25:10.746 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:25:10.747 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:25:11.066 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:11.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- 10.20.193.28:0/711751992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 msgr2=0x7fa80010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:11.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 --2- 10.20.193.28:0/711751992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 0x7fa80010ad60 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009a60 tx=0x7fa7f402f290 comp rx=0 tx=0).stop 2026-02-20T03:25:11.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- 10.20.193.28:0/711751992 shutdown_connections 2026-02-20T03:25:11.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 --2- 10.20.193.28:0/711751992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa800105320 0x7fa800111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 --2- 10.20.193.28:0/711751992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa800104980 0x7fa800104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 --2- 10.20.193.28:0/711751992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 0x7fa80010ad60 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- 10.20.193.28:0/711751992 >> 10.20.193.28:0/711751992 conn(0x7fa800100680 msgr2=0x7fa800102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:11.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- 10.20.193.28:0/711751992 shutdown_connections 2026-02-20T03:25:11.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- 10.20.193.28:0/711751992 wait complete. 2026-02-20T03:25:11.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 Processor -- start 2026-02-20T03:25:11.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- start start 2026-02-20T03:25:11.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa800104980 0x7fa800077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa800105320 0x7fa800077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 0x7fa800078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa800114cd0 con 0x7fa80010a980 2026-02-20T03:25:11.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa800114b50 con 0x7fa800105320 2026-02-20T03:25:11.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa800114e50 con 0x7fa800104980 2026-02-20T03:25:11.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7ff577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 0x7fa800078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:11.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7ff577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 0x7fa800078080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49224/0 (socket says 10.20.193.28:49224) 2026-02-20T03:25:11.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7ff577640 1 -- 10.20.193.28:0/4233336130 learned_addr learned my addr 10.20.193.28:0/4233336130 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:11.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7ff577640 1 -- 10.20.193.28:0/4233336130 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa800104980 msgr2=0x7fa800077600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:11.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7ff577640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa800104980 0x7fa800077600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7ff577640 1 -- 10.20.193.28:0/4233336130 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa800105320 msgr2=0x7fa800077b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:11.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7ff577640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa800105320 0x7fa800077b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7ff577640 1 -- 10.20.193.28:0/4233336130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8001adb30 con 0x7fa80010a980 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7ff577640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 0x7fa800078080 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000b9c0 tx=0x7fa7f000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7dffff640 1 -- 10.20.193.28:0/4233336130 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0006e60 con 0x7fa80010a980 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7dffff640 1 -- 10.20.193.28:0/4233336130 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7f0010070 con 0x7fa80010a980 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7dffff640 1 -- 10.20.193.28:0/4233336130 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00047f0 con 0x7fa80010a980 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- 10.20.193.28:0/4233336130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8001ade20 con 0x7fa80010a980 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa804a7b640 1 -- 10.20.193.28:0/4233336130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8001ae280 con 0x7fa80010a980 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa7dffff640 1 -- 10.20.193.28:0/4233336130 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa7f000c790 con 0x7fa80010a980 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.307+0000 7fa807781e00 1 Processor -- start 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa807781e00 1 -- start start 2026-02-20T03:25:11.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa807781e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c810c0 0x559fb0c814a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa807781e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c81a70 0x559fb0c85540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa807781e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 0x559fb0c85fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa807781e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559fb0bd3c00 con 0x559fb0c81a70 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa807781e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559fb0b813c0 con 0x559fb0c85b60 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa807781e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559fb0bcfb30 con 0x559fb0c810c0 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c81a70 0x559fb0c85540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c81a70 0x559fb0c85540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49232/0 (socket says 10.20.193.28:49232) 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7fed76640 1 -- 10.20.193.28:0/4226823080 learned_addr learned my addr 10.20.193.28:0/4226823080 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7fed76640 1 -- 10.20.193.28:0/4226823080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c810c0 msgr2=0x559fb0c814a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7fed76640 1 --2- 10.20.193.28:0/4226823080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c810c0 0x559fb0c814a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7fed76640 1 -- 10.20.193.28:0/4226823080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 msgr2=0x559fb0c85fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:11.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7fed76640 1 --2- 10.20.193.28:0/4226823080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 0x559fb0c85fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7fed76640 1 -- 10.20.193.28:0/4226823080 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb0b7a840 con 0x559fb0c81a70 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7fed76640 1 --2- 10.20.193.28:0/4226823080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c81a70 0x559fb0c85540 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005880 tx=0x7fa7f4038470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae66d04b065156c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7cb7fe640 1 -- 10.20.193.28:0/4226823080 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4002c00 con 0x559fb0c81a70 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7dffff640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7d40b0e20 0x7fa7d40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7cb7fe640 1 -- 10.20.193.28:0/4226823080 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7f4033040 con 0x559fb0c81a70 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7cb7fe640 1 -- 10.20.193.28:0/4226823080 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4004320 con 0x559fb0c81a70 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.313+0000 7fa7dffff640 1 -- 10.20.193.28:0/4233336130 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa7f00e0370 con 0x7fa80010a980 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 -- 10.20.193.28:0/4226823080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c81a70 msgr2=0x559fb0c85540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 --2- 10.20.193.28:0/4226823080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c81a70 0x559fb0c85540 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4005880 tx=0x7fa7f4038470 comp rx=0 tx=0).stop 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa7fe575640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7d40b0e20 0x7fa7d40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 -- 10.20.193.28:0/4226823080 shutdown_connections 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 --2- 10.20.193.28:0/4226823080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 0x559fb0c85fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 --2- 10.20.193.28:0/4226823080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c81a70 0x559fb0c85540 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 --2- 10.20.193.28:0/4226823080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c810c0 0x559fb0c814a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 -- 10.20.193.28:0/4226823080 >> 10.20.193.28:0/4226823080 conn(0x559fb0c79b60 msgr2=0x559fb0c7f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:11.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 -- 10.20.193.28:0/4226823080 shutdown_connections 2026-02-20T03:25:11.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 -- 10.20.193.28:0/4226823080 wait complete. 2026-02-20T03:25:11.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa7fe575640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7d40b0e20 0x7fa7d40b32e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8006fd0 tx=0x7fa7e8006d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:11.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 -- start start 2026-02-20T03:25:11.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.314+0000 7fa807781e00 1 Processor -- start 2026-02-20T03:25:11.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 0x559fb0c9b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 0x559fb0c998d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559fb0b7b1a0 con 0x559fb0c810c0 2026-02-20T03:25:11.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559fb0c8dd60 con 0x559fb0c85b60 2026-02-20T03:25:11.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559fb0c9a050 con 0x559fb0c81a70 2026-02-20T03:25:11.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:11.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49246/0 (socket says 10.20.193.28:49246) 2026-02-20T03:25:11.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7fed76640 1 -- 10.20.193.28:0/2009111520 learned_addr learned my addr 10.20.193.28:0/2009111520 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:11.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7fed76640 1 -- 10.20.193.28:0/2009111520 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 msgr2=0x559fb0c9b6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:11.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7fed76640 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 0x559fb0c9b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7fed76640 1 -- 10.20.193.28:0/2009111520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 msgr2=0x559fb0c998d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:11.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7fed76640 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 0x559fb0c998d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7fed76640 1 -- 10.20.193.28:0/2009111520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb0c935e0 con 0x559fb0c810c0 2026-02-20T03:25:11.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7fed76640 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9b190 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4002910 tx=0x7fa7f4009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bfd8315d169158 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:11.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7c8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:11.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/2009111520 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40042b0 con 0x559fb0c810c0 2026-02-20T03:25:11.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/2009111520 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7f404a070 con 0x559fb0c810c0 2026-02-20T03:25:11.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/2009111520 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4042460 con 0x559fb0c810c0 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 -- 10.20.193.28:0/2009111520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb09a2b60 con 0x559fb0c810c0 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 10 client.18255 _ll_register_callbacks cb 0x559fb0b7f0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 -- 10.20.193.28:0/2009111520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559fb0bdb7f0 con 0x559fb0c810c0 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/2009111520 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa7f4004450 con 0x559fb0c810c0 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/2009111520 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa7f4038730 con 0x559fb0c810c0 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 10 client.18255 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 -- 10.20.193.28:0/2009111520 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559fb0ba0430 con 0x559fb0c810c0 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/2009111520 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa7f4042660 con 0x559fb0c810c0 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 10 client.18255 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 10 client.18255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 20 client.18255 populate_metadata read hostname 'trial028' 2026-02-20T03:25:11.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559fb0ca9590 0x559fb0cab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 4 client.18255 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:11.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.316+0000 7fa807781e00 1 -- 10.20.193.28:0/2009111520 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fb0b55c00 con 0x559fb0ca9590 2026-02-20T03:25:11.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.343+0000 7fa7fe575640 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559fb0ca9590 0x559fb0cab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:11.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.396+0000 7fa7fe575640 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559fb0ca9590 0x559fb0cab980 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e47e3d3ea5fb4c5 server_cookie=8342c03019a6700f in_seq=0 out_seq=0 2026-02-20T03:25:11.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.396+0000 7fa7c8ff9640 10 client.18255 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/2009111520 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559fb0b55c00 con 0x559fb0ca9590 2026-02-20T03:25:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa7c8ff9640 10 client.18255 handle_command_reply: tid=0 2026-02-20T03:25:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 client.18255 shutdown 2026-02-20T03:25:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 -- 10.20.193.28:0/2009111520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 msgr2=0x559fb0c9b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9b190 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4002910 tx=0x7fa7f4009340 comp rx=0 tx=0).stop 2026-02-20T03:25:11.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 -- 10.20.193.28:0/2009111520 shutdown_connections 2026-02-20T03:25:11.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559fb0ca9590 0x559fb0cab980 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 0x559fb0c998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 0x559fb0c9b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 --2- 10.20.193.28:0/2009111520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9b190 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 -- 10.20.193.28:0/2009111520 >> 10.20.193.28:0/2009111520 conn(0x559fb0c79b60 msgr2=0x559fb0c84520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:11.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa7c8ff9640 0 client.18255 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:11.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.410+0000 7fa807781e00 1 -- 10.20.193.28:0/2009111520 shutdown_connections 2026-02-20T03:25:11.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.411+0000 7fa807781e00 1 -- 10.20.193.28:0/2009111520 wait complete. 2026-02-20T03:25:11.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.411+0000 7fa807781e00 20 client.18255 trim_cache size 0 max 16384 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 Processor -- start 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- start start 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c810c0 0x559fb0cb1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 0x559fb0cb1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c85b60 0x559fb0ca1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a40126e0 con 0x559fb0c85b60 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a400ffb0 con 0x559fb0c810c0 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a400de00 con 0x559fb0c81a70 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7ff577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c85b60 0x559fb0ca1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:11.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7ff577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c85b60 0x559fb0ca1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49258/0 (socket says 10.20.193.28:49258) 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7ff577640 1 -- 10.20.193.28:0/3901716738 learned_addr learned my addr 10.20.193.28:0/3901716738 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7ff577640 1 -- 10.20.193.28:0/3901716738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 msgr2=0x559fb0cb1690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7ff577640 1 --2- 10.20.193.28:0/3901716738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 0x559fb0cb1690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7ff577640 1 -- 10.20.193.28:0/3901716738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c810c0 msgr2=0x559fb0cb1150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7ff577640 1 --2- 10.20.193.28:0/3901716738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c810c0 0x559fb0cb1150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7ff577640 1 -- 10.20.193.28:0/3901716738 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb0c93410 con 0x559fb0c85b60 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7ff577640 1 --2- 10.20.193.28:0/3901716738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c85b60 0x559fb0ca1020 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00a5070 tx=0x7fa7f00a7750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81df7b76e6f3b2e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7caffd640 1 -- 10.20.193.28:0/3901716738 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0012320 con 0x559fb0c85b60 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7caffd640 1 -- 10.20.193.28:0/3901716738 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7f00ca040 con 0x559fb0c85b60 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa7caffd640 1 -- 10.20.193.28:0/3901716738 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00b0e20 con 0x559fb0c85b60 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- 10.20.193.28:0/3901716738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c85b60 msgr2=0x559fb0ca1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:11.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 --2- 10.20.193.28:0/3901716738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c85b60 0x559fb0ca1020 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00a5070 tx=0x7fa7f00a7750 comp rx=0 tx=0).stop 2026-02-20T03:25:11.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- 10.20.193.28:0/3901716738 shutdown_connections 2026-02-20T03:25:11.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 --2- 10.20.193.28:0/3901716738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c85b60 0x559fb0ca1020 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 --2- 10.20.193.28:0/3901716738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 0x559fb0cb1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 --2- 10.20.193.28:0/3901716738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c810c0 0x559fb0cb1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- 10.20.193.28:0/3901716738 >> 10.20.193.28:0/3901716738 conn(0x559fb0c79b60 msgr2=0x559fb0c98860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:11.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- 10.20.193.28:0/3901716738 shutdown_connections 2026-02-20T03:25:11.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- 10.20.193.28:0/3901716738 wait complete. 2026-02-20T03:25:11.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.417+0000 7fa807781e00 1 -- start start 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 1 Processor -- start 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 0x559fb0c9f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 0x559fb0c9fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a400e470 con 0x559fb0c810c0 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a400f8e0 con 0x559fb0c85b60 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a400eb40 con 0x559fb0c81a70 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7fed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49260/0 (socket says 10.20.193.28:49260) 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7fed76640 1 -- 10.20.193.28:0/1280252903 learned_addr learned my addr 10.20.193.28:0/1280252903 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7fed76640 1 -- 10.20.193.28:0/1280252903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 msgr2=0x559fb0c9f520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7fed76640 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 0x559fb0c9f520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7fed76640 1 -- 10.20.193.28:0/1280252903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 msgr2=0x559fb0c9fa60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7fed76640 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 0x559fb0c9fa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7fed76640 1 -- 10.20.193.28:0/1280252903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb08b2900 con 0x559fb0c810c0 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7fed76640 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9efe0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4038490 tx=0x7fa7f4009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5303959ed5e0a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7c8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/1280252903 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40029f0 con 0x559fb0c810c0 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/1280252903 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7f404a070 con 0x559fb0c810c0 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/1280252903 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f404f6c0 con 0x559fb0c810c0 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 1 -- 10.20.193.28:0/1280252903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb0b8e4d0 con 0x559fb0c810c0 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/1280252903 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7fa7f404f860 con 0x559fb0c810c0 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa7c8ff9640 10 client.18261 inactive, discarding osd_map(94..94 src has 1..94) 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 10 client.18261 _ll_register_callbacks cb 0x7fa7f4009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:11.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.422+0000 7fa807781e00 1 -- 10.20.193.28:0/1280252903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7f4033040 con 0x559fb0c810c0 2026-02-20T03:25:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/1280252903 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa7f40388d0 con 0x559fb0c810c0 2026-02-20T03:25:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa807781e00 10 client.18261 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa807781e00 1 -- 10.20.193.28:0/1280252903 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x559fb0c94100 con 0x559fb0c810c0 2026-02-20T03:25:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/1280252903 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa7f4060070 con 0x559fb0c810c0 2026-02-20T03:25:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa807781e00 10 client.18261 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa807781e00 10 client.18261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:11.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa807781e00 20 client.18261 populate_metadata read hostname 'trial028' 2026-02-20T03:25:11.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa807781e00 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559fb0d167b0 0x559fb0d18c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:11.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa807781e00 4 client.18261 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:25:11.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.423+0000 7fa807781e00 1 -- 10.20.193.28:0/1280252903 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559fb0943a20 con 0x559fb0d167b0 2026-02-20T03:25:11.453 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:11 trial028 ceph-mon[38552]: pgmap v496: 129 pgs: 129 active+clean; 169 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 MiB/s rd, 3.2 MiB/s wr, 471 op/s 2026-02-20T03:25:11.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.450+0000 7fa7fe575640 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559fb0d167b0 0x559fb0d18c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:11.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.490+0000 7fa7fe575640 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559fb0d167b0 0x559fb0d18c70 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a6db4762710e5a5 server_cookie=b4b67078984cf2e3 in_seq=0 out_seq=0 2026-02-20T03:25:11.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.490+0000 7fa7c8ff9640 10 client.18261 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:11.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa7c8ff9640 1 -- 10.20.193.28:0/1280252903 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559fb0943a20 con 0x559fb0d167b0 2026-02-20T03:25:11.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa7c8ff9640 10 client.18261 handle_command_reply: tid=0 2026-02-20T03:25:11.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 client.18261 shutdown 2026-02-20T03:25:11.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 -- 10.20.193.28:0/1280252903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 msgr2=0x559fb0c9efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:11.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9efe0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4038490 tx=0x7fa7f4009a00 comp rx=0 tx=0).stop 2026-02-20T03:25:11.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 -- 10.20.193.28:0/1280252903 shutdown_connections 2026-02-20T03:25:11.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559fb0d167b0 0x559fb0d18c70 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559fb0c85b60 0x559fb0c9fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559fb0c81a70 0x559fb0c9f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa7c8ff9640 0 client.18261 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:11.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 --2- 10.20.193.28:0/1280252903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559fb0c810c0 0x559fb0c9efe0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 -- 10.20.193.28:0/1280252903 >> 10.20.193.28:0/1280252903 conn(0x559fb0c79b60 msgr2=0x559fb0c98040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:11.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 -- 10.20.193.28:0/1280252903 shutdown_connections 2026-02-20T03:25:11.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 1 -- 10.20.193.28:0/1280252903 wait complete. 2026-02-20T03:25:11.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa807781e00 20 client.18261 trim_cache size 0 max 16384 2026-02-20T03:25:11.509 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:25:11.509 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:25:11.509 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "6e19d5cc-c071-4b21-90c8-aabc46068dfc", 2026-02-20T03:25:11.510 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:25:11.510 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:25:11.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 -- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7d40b0e20 msgr2=0x7fa7d40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:11.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7d40b0e20 0x7fa7d40b32e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8006fd0 tx=0x7fa7e8006d60 comp rx=0 tx=0).stop 2026-02-20T03:25:11.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 -- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 msgr2=0x7fa800078080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:11.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 0x7fa800078080 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000b9c0 tx=0x7fa7f000be90 comp rx=0 tx=0).stop 2026-02-20T03:25:11.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 -- 10.20.193.28:0/4233336130 shutdown_connections 2026-02-20T03:25:11.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa7d40b0e20 0x7fa7d40b32e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa80010a980 0x7fa800078080 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa800105320 0x7fa800077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 --2- 10.20.193.28:0/4233336130 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa800104980 0x7fa800077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:11.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 -- 10.20.193.28:0/4233336130 >> 10.20.193.28:0/4233336130 conn(0x7fa800100680 msgr2=0x7fa8001011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:11.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 -- 10.20.193.28:0/4233336130 shutdown_connections 2026-02-20T03:25:11.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:11.504+0000 7fa804a7b640 1 -- 10.20.193.28:0/4233336130 wait complete. 2026-02-20T03:25:11.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 912708 8.20 MB/sec execute 404 sec latency 1978.686 ms 2026-02-20T03:25:11.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:11 trial126 ceph-mon[38476]: pgmap v496: 129 pgs: 129 active+clean; 169 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 MiB/s rd, 3.2 MiB/s wr, 471 op/s 2026-02-20T03:25:11.664 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:25:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:11 trial177 ceph-mon[43181]: pgmap v496: 129 pgs: 129 active+clean; 169 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 4.6 MiB/s rd, 3.2 MiB/s wr, 471 op/s 2026-02-20T03:25:11.981 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:12.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- 10.20.193.28:0/937923342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c10eef0 msgr2=0x7f9d8c10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:12.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 --2- 10.20.193.28:0/937923342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c10eef0 0x7f9d8c10f2d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009a30 tx=0x7f9d7c02f260 comp rx=0 tx=0).stop 2026-02-20T03:25:12.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- 10.20.193.28:0/937923342 shutdown_connections 2026-02-20T03:25:12.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 --2- 10.20.193.28:0/937923342 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d8c109ba0 0x7f9d8c115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 --2- 10.20.193.28:0/937923342 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d8c109220 0x7f9d8c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 --2- 10.20.193.28:0/937923342 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c10eef0 0x7f9d8c10f2d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- 10.20.193.28:0/937923342 >> 10.20.193.28:0/937923342 conn(0x7f9d8c078600 msgr2=0x7f9d8c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:12.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- 10.20.193.28:0/937923342 shutdown_connections 2026-02-20T03:25:12.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- 10.20.193.28:0/937923342 wait complete. 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 Processor -- start 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- start start 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d8c109220 0x7f9d8c1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c109ba0 0x7f9d8c1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d8c10eef0 0x7f9d8c1a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c1191b0 con 0x7f9d8c109ba0 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c119030 con 0x7f9d8c10eef0 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c119330 con 0x7f9d8c109220 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d90804640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c109ba0 0x7f9d8c1a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d90804640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c109ba0 0x7f9d8c1a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49276/0 (socket says 10.20.193.28:49276) 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d90804640 1 -- 10.20.193.28:0/2584030898 learned_addr learned my addr 10.20.193.28:0/2584030898 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:12.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d90804640 1 -- 10.20.193.28:0/2584030898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d8c109220 msgr2=0x7f9d8c1a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:12.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d90804640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d8c109220 0x7f9d8c1a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d90804640 1 -- 10.20.193.28:0/2584030898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d8c10eef0 msgr2=0x7f9d8c1a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:12.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d90804640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d8c10eef0 0x7f9d8c1a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d90804640 1 -- 10.20.193.28:0/2584030898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c1a66c0 con 0x7f9d8c109ba0 2026-02-20T03:25:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d90804640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c109ba0 0x7f9d8c1a1bb0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000b570 tx=0x7f9d8000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d7a7fc640 1 -- 10.20.193.28:0/2584030898 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80013020 con 0x7f9d8c109ba0 2026-02-20T03:25:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d7a7fc640 1 -- 10.20.193.28:0/2584030898 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9d80004480 con 0x7f9d8c109ba0 2026-02-20T03:25:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d7a7fc640 1 -- 10.20.193.28:0/2584030898 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000fb50 con 0x7f9d8c109ba0 2026-02-20T03:25:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- 10.20.193.28:0/2584030898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8c1a69b0 con 0x7f9d8c109ba0 2026-02-20T03:25:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.221+0000 7f9d92007640 1 -- 10.20.193.28:0/2584030898 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d8c1ae1f0 con 0x7f9d8c109ba0 2026-02-20T03:25:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d7a7fc640 1 -- 10.20.193.28:0/2584030898 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9d80002780 con 0x7f9d8c109ba0 2026-02-20T03:25:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d95795e00 1 Processor -- start 2026-02-20T03:25:12.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d95795e00 1 -- start start 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8bf000 0x556a8d8bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9fb0 0x556a8d8c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d95795e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556a8d839e50 con 0x556a8d8b9630 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d95795e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556a8d80c9c0 con 0x556a8d8bf000 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d95795e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556a8d7ba240 con 0x556a8d8b9fb0 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d91005640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d91005640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49290/0 (socket says 10.20.193.28:49290) 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d91005640 1 -- 10.20.193.28:0/887214772 learned_addr learned my addr 10.20.193.28:0/887214772 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d91005640 1 -- 10.20.193.28:0/887214772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9fb0 msgr2=0x556a8d8c5e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d91005640 1 --2- 10.20.193.28:0/887214772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9fb0 0x556a8d8c5e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d91005640 1 -- 10.20.193.28:0/887214772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8bf000 msgr2=0x556a8d8bf3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d91005640 1 --2- 10.20.193.28:0/887214772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8bf000 0x556a8d8bf3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d91005640 1 -- 10.20.193.28:0/887214772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8d7cd420 con 0x556a8d8b9630 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d91005640 1 --2- 10.20.193.28:0/887214772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8b9a70 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c032040 tx=0x7f9d7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf039d1f10755abb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d7a7fc640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d680b0e20 0x7f9d680b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.227+0000 7f9d7a7fc640 1 -- 10.20.193.28:0/2584030898 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f9d800e05e0 con 0x7f9d8c109ba0 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.230+0000 7f9d59ce5640 1 -- 10.20.193.28:0/887214772 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0384f0 con 0x556a8d8b9630 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.230+0000 7f9d59ce5640 1 -- 10.20.193.28:0/887214772 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9d7c033040 con 0x556a8d8b9630 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.230+0000 7f9d59ce5640 1 -- 10.20.193.28:0/887214772 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0043b0 con 0x556a8d8b9630 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.230+0000 7f9d91806640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d680b0e20 0x7f9d680b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 -- 10.20.193.28:0/887214772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 msgr2=0x556a8d8b9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 --2- 10.20.193.28:0/887214772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8b9a70 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c032040 tx=0x7f9d7c005880 comp rx=0 tx=0).stop 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d91806640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d680b0e20 0x7f9d680b32e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800ab00 tx=0x7f9d88009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 -- 10.20.193.28:0/887214772 shutdown_connections 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 --2- 10.20.193.28:0/887214772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9fb0 0x556a8d8c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 --2- 10.20.193.28:0/887214772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8b9a70 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 --2- 10.20.193.28:0/887214772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8bf000 0x556a8d8bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 -- 10.20.193.28:0/887214772 >> 10.20.193.28:0/887214772 conn(0x556a8d87c290 msgr2=0x556a8d8b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 -- 10.20.193.28:0/887214772 shutdown_connections 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 -- 10.20.193.28:0/887214772 wait complete. 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 -- start start 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.231+0000 7f9d95795e00 1 Processor -- start 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9fb0 0x556a8d8d43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8bf000 0x556a8d8d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556a8d8088f0 con 0x556a8d8b9630 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556a8d5faf50 con 0x556a8d8bf000 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556a8d8d2d20 con 0x556a8d8b9fb0 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d91005640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:12.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d91005640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8d3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49302/0 (socket says 10.20.193.28:49302) 2026-02-20T03:25:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d91005640 1 -- 10.20.193.28:0/208734821 learned_addr learned my addr 10.20.193.28:0/208734821 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d91005640 1 -- 10.20.193.28:0/208734821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9fb0 msgr2=0x556a8d8d43a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d91005640 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9fb0 0x556a8d8d43a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d91005640 1 -- 10.20.193.28:0/208734821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8bf000 msgr2=0x556a8d8d25a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:12.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d91005640 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8bf000 0x556a8d8d25a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d91005640 1 -- 10.20.193.28:0/208734821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8d8cbb70 con 0x556a8d8b9630 2026-02-20T03:25:12.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d91005640 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8d3e60 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c02f770 tx=0x7f9d7c002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a589e1a968576cd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d46ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d46ffd640 1 -- 10.20.193.28:0/208734821 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c02fcd0 con 0x556a8d8b9630 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d46ffd640 1 -- 10.20.193.28:0/208734821 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9d7c046070 con 0x556a8d8b9630 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d46ffd640 1 -- 10.20.193.28:0/208734821 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c04b470 con 0x556a8d8b9630 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 -- 10.20.193.28:0/208734821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a8d5ddb40 con 0x556a8d8b9630 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 10 client.18273 _ll_register_callbacks cb 0x556a8d845f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 -- 10.20.193.28:0/208734821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556a8d81a1a0 con 0x556a8d8b9630 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d46ffd640 1 -- 10.20.193.28:0/208734821 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f9d7c038790 con 0x556a8d8b9630 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d46ffd640 1 -- 10.20.193.28:0/208734821 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d7c0040a0 con 0x556a8d8b9630 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 10 client.18273 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 -- 10.20.193.28:0/208734821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556a8d7c7230 con 0x556a8d8b9630 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d46ffd640 1 -- 10.20.193.28:0/208734821 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f9d7c053020 con 0x556a8d8b9630 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 10 client.18273 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 10 client.18273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 20 client.18273 populate_metadata read hostname 'trial028' 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556a8d8e2310 0x556a8d8e4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 4 client.18273 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:12.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.233+0000 7f9d95795e00 1 -- 10.20.193.28:0/208734821 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a8d8145b0 con 0x556a8d8e2310 2026-02-20T03:25:12.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.258+0000 7f9d90804640 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556a8d8e2310 0x556a8d8e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:12.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.312+0000 7f9d90804640 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556a8d8e2310 0x556a8d8e4700 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d514696889da5cc3 server_cookie=a3c4a4bdf7278e19 in_seq=0 out_seq=0 2026-02-20T03:25:12.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.312+0000 7f9d46ffd640 10 client.18273 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:12.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d46ffd640 1 -- 10.20.193.28:0/208734821 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556a8d8145b0 con 0x556a8d8e2310 2026-02-20T03:25:12.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d46ffd640 10 client.18273 handle_command_reply: tid=0 2026-02-20T03:25:12.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 client.18273 shutdown 2026-02-20T03:25:12.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 -- 10.20.193.28:0/208734821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 msgr2=0x556a8d8d3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:12.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8d3e60 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c02f770 tx=0x7f9d7c002910 comp rx=0 tx=0).stop 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 -- 10.20.193.28:0/208734821 shutdown_connections 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556a8d8e2310 0x556a8d8e4700 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8bf000 0x556a8d8d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9fb0 0x556a8d8d43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 --2- 10.20.193.28:0/208734821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8b9630 0x556a8d8d3e60 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 -- 10.20.193.28:0/208734821 >> 10.20.193.28:0/208734821 conn(0x556a8d87c290 msgr2=0x556a8d8b8440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d46ffd640 0 client.18273 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 -- 10.20.193.28:0/208734821 shutdown_connections 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 1 -- 10.20.193.28:0/208734821 wait complete. 2026-02-20T03:25:12.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.339+0000 7f9d95795e00 20 client.18273 trim_cache size 0 max 16384 2026-02-20T03:25:12.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 Processor -- start 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- start start 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9630 0x556a8d8bde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8b9fb0 0x556a8d8e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8e3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38012770 con 0x556a8d8bf000 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38010040 con 0x556a8d8b9fb0 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3800de90 con 0x556a8d8b9630 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d91806640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d91806640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8e3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49314/0 (socket says 10.20.193.28:49314) 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d91806640 1 -- 10.20.193.28:0/828478443 learned_addr learned my addr 10.20.193.28:0/828478443 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:12.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d91806640 1 -- 10.20.193.28:0/828478443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9630 msgr2=0x556a8d8bde80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d91806640 1 --2- 10.20.193.28:0/828478443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9630 0x556a8d8bde80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d91806640 1 -- 10.20.193.28:0/828478443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8b9fb0 msgr2=0x556a8d8e2e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d91806640 1 --2- 10.20.193.28:0/828478443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8b9fb0 0x556a8d8e2e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d91806640 1 -- 10.20.193.28:0/828478443 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8d8cb9a0 con 0x556a8d8bf000 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d91806640 1 --2- 10.20.193.28:0/828478443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8e3340 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800cc40 tx=0x7f9d8800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bafce86b7b7212 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d594e4640 1 -- 10.20.193.28:0/828478443 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88006e60 con 0x556a8d8bf000 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d594e4640 1 -- 10.20.193.28:0/828478443 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9d8801f020 con 0x556a8d8bf000 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d594e4640 1 -- 10.20.193.28:0/828478443 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800d680 con 0x556a8d8bf000 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- 10.20.193.28:0/828478443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 msgr2=0x556a8d8e3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- 10.20.193.28:0/828478443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8e3340 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800cc40 tx=0x7f9d8800f000 comp rx=0 tx=0).stop 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- 10.20.193.28:0/828478443 shutdown_connections 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- 10.20.193.28:0/828478443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8e3340 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- 10.20.193.28:0/828478443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8b9fb0 0x556a8d8e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- 10.20.193.28:0/828478443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9630 0x556a8d8bde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- 10.20.193.28:0/828478443 >> 10.20.193.28:0/828478443 conn(0x556a8d87c290 msgr2=0x556a8d8e26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- 10.20.193.28:0/828478443 shutdown_connections 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- 10.20.193.28:0/828478443 wait complete. 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- start start 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 Processor -- start 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9630 0x556a8d8d6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8b9fb0 0x556a8d8d71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8d7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3800e500 con 0x556a8d8bf000 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3800f970 con 0x556a8d8b9fb0 2026-02-20T03:25:12.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.345+0000 7f9d95795e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3800ebd0 con 0x556a8d8b9630 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d91806640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8d7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d91806640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8d7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49324/0 (socket says 10.20.193.28:49324) 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d91806640 1 -- 10.20.193.28:0/873319806 learned_addr learned my addr 10.20.193.28:0/873319806 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d91806640 1 -- 10.20.193.28:0/873319806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9630 msgr2=0x556a8d8d6c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d91806640 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9630 0x556a8d8d6c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d91806640 1 -- 10.20.193.28:0/873319806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8b9fb0 msgr2=0x556a8d8d71c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d91806640 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8b9fb0 0x556a8d8d71c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d91806640 1 -- 10.20.193.28:0/873319806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a8d4eb870 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d91806640 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8d7700 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f9d88004040 tx=0x7f9d8801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c47205af2262cb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d46ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d46ffd640 1 -- 10.20.193.28:0/873319806 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8801e070 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d46ffd640 1 -- 10.20.193.28:0/873319806 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9d88011070 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d46ffd640 1 -- 10.20.193.28:0/873319806 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88024850 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d95795e00 1 -- 10.20.193.28:0/873319806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a8d7ac440 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d46ffd640 1 -- 10.20.193.28:0/873319806 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7f9d8802e640 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d95795e00 10 client.18279 _ll_register_callbacks cb 0x7f9d7c0057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d95795e00 1 -- 10.20.193.28:0/873319806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556a8d7beb00 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d46ffd640 1 -- 10.20.193.28:0/873319806 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d8802e840 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d95795e00 10 client.18279 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.351+0000 7f9d95795e00 1 -- 10.20.193.28:0/873319806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x556a8d8cc690 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.352+0000 7f9d46ffd640 1 -- 10.20.193.28:0/873319806 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f9d88036070 con 0x556a8d8bf000 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.352+0000 7f9d95795e00 10 client.18279 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.352+0000 7f9d95795e00 10 client.18279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.352+0000 7f9d95795e00 20 client.18279 populate_metadata read hostname 'trial028' 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.352+0000 7f9d95795e00 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556a8d94e790 0x556a8d950c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.352+0000 7f9d95795e00 4 client.18279 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.352+0000 7f9d95795e00 1 -- 10.20.193.28:0/873319806 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f9d7c033040 con 0x556a8d94e790 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.352+0000 7f9d91005640 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556a8d94e790 0x556a8d950c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.353+0000 7f9d91005640 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556a8d94e790 0x556a8d950c50 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5407b8d43df9474 server_cookie=f2ce7c46594bcb13 in_seq=0 out_seq=0 2026-02-20T03:25:12.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.353+0000 7f9d46ffd640 10 client.18279 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.353+0000 7f9d46ffd640 1 -- 10.20.193.28:0/873319806 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f9d7c033040 con 0x556a8d94e790 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.353+0000 7f9d46ffd640 10 client.18279 handle_command_reply: tid=0 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.353+0000 7f9d95795e00 1 client.18279 shutdown 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 -- 10.20.193.28:0/873319806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 msgr2=0x556a8d8d7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8d7700 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f9d88004040 tx=0x7f9d8801ac70 comp rx=0 tx=0).stop 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 -- 10.20.193.28:0/873319806 shutdown_connections 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556a8d94e790 0x556a8d950c50 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556a8d8bf000 0x556a8d8d7700 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556a8d8b9fb0 0x556a8d8d71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 --2- 10.20.193.28:0/873319806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556a8d8b9630 0x556a8d8d6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 -- 10.20.193.28:0/873319806 >> 10.20.193.28:0/873319806 conn(0x556a8d87c290 msgr2=0x556a8d8e2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d46ffd640 0 client.18279 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 -- 10.20.193.28:0/873319806 shutdown_connections 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 1 -- 10.20.193.28:0/873319806 wait complete. 2026-02-20T03:25:12.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d95795e00 20 client.18279 trim_cache size 0 max 16384 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout: "6e19d5cc-c071-4b21-90c8-aabc46068dfc": { 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "6e19d5cc-c071-4b21-90c8-aabc46068dfc", 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 -- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d680b0e20 msgr2=0x7f9d680b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d680b0e20 0x7f9d680b32e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800ab00 tx=0x7f9d88009250 comp rx=0 tx=0).stop 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 -- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c109ba0 msgr2=0x7f9d8c1a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c109ba0 0x7f9d8c1a1bb0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000b570 tx=0x7f9d8000ba40 comp rx=0 tx=0).stop 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 -- 10.20.193.28:0/2584030898 shutdown_connections 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d680b0e20 0x7f9d680b32e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9d8c10eef0 0x7f9d8c1a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9d8c109ba0 0x7f9d8c1a1bb0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 --2- 10.20.193.28:0/2584030898 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9d8c109220 0x7f9d8c1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:12.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 -- 10.20.193.28:0/2584030898 >> 10.20.193.28:0/2584030898 conn(0x7f9d8c078600 msgr2=0x7f9d8c079f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:12.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 -- 10.20.193.28:0/2584030898 shutdown_connections 2026-02-20T03:25:12.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:12.354+0000 7f9d92007640 1 -- 10.20.193.28:0/2584030898 wait complete. 2026-02-20T03:25:12.514 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:12 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:25:12.514 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:12 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:12.518 INFO:tasks.cephfs.filesystem:scrub status for tag:6e19d5cc-c071-4b21-90c8-aabc46068dfc - {'path': '/', 'tag': '6e19d5cc-c071-4b21-90c8-aabc46068dfc', 'options': 'recursive,force'} 2026-02-20T03:25:12.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 912709 8.18 MB/sec execute 405 sec latency 2830.097 ms 2026-02-20T03:25:12.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:12 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:25:12.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:12 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:12.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:12 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:25:12.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:12 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.343 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:13 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:25:13.343 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:13 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.343 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:13 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:25:13.343 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:13 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:25:13.343 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:13 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.343 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:13 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.343 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:13 trial028 ceph-mon[38552]: pgmap v497: 129 pgs: 129 active+clean; 171 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 433 op/s 2026-02-20T03:25:13.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 912709 8.16 MB/sec execute 406 sec latency 1148.750 ms 2026-02-20T03:25:13.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:13 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:25:13.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:13 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:13 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:25:13.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:13 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:25:13.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:13 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:13 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:13 trial126 ceph-mon[38476]: pgmap v497: 129 pgs: 129 active+clean; 171 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 433 op/s 2026-02-20T03:25:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:13 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:25:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:13 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:13 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:25:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:13 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:25:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:13 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:13 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:13 trial177 ceph-mon[43181]: pgmap v497: 129 pgs: 129 active+clean; 171 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.5 MiB/s rd, 3.1 MiB/s wr, 433 op/s 2026-02-20T03:25:14.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 916072 8.18 MB/sec execute 407 sec latency 1253.730 ms 2026-02-20T03:25:15.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:15 trial028 ceph-mon[38552]: pgmap v498: 129 pgs: 129 active+clean; 172 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 376 op/s 2026-02-20T03:25:15.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 916250 8.16 MB/sec execute 408 sec latency 699.952 ms 2026-02-20T03:25:15.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:15 trial126 ceph-mon[38476]: pgmap v498: 129 pgs: 129 active+clean; 172 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 376 op/s 2026-02-20T03:25:15.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:15 trial177 ceph-mon[43181]: pgmap v498: 129 pgs: 129 active+clean; 172 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 376 op/s 2026-02-20T03:25:16.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 916250 8.14 MB/sec execute 409 sec latency 1699.996 ms 2026-02-20T03:25:17.341 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:17 trial028 ceph-mon[38552]: pgmap v499: 129 pgs: 129 active+clean; 173 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 3.7 MiB/s wr, 410 op/s 2026-02-20T03:25:17.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 916250 8.12 MB/sec execute 410 sec latency 2700.036 ms 2026-02-20T03:25:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:17 trial126 ceph-mon[38476]: pgmap v499: 129 pgs: 129 active+clean; 173 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 3.7 MiB/s wr, 410 op/s 2026-02-20T03:25:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:17 trial177 ceph-mon[43181]: pgmap v499: 129 pgs: 129 active+clean; 173 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 3.7 MiB/s wr, 410 op/s 2026-02-20T03:25:18.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 917019 8.13 MB/sec execute 411 sec latency 3232.880 ms 2026-02-20T03:25:18.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:25:18.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:25:18.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:25:18.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:25:18.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:25:18.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:25:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:25:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:25:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:25:19.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.153+0000 7ff410fce640 1 -- 10.20.193.28:0/3477740439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff40c105b30 msgr2=0x7ff40c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:19.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.153+0000 7ff410fce640 1 --2- 10.20.193.28:0/3477740439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff40c105b30 0x7ff40c105fb0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009a30 tx=0x7ff3fc02f220 comp rx=0 tx=0).stop 2026-02-20T03:25:19.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.153+0000 7ff410fce640 1 -- 10.20.193.28:0/3477740439 shutdown_connections 2026-02-20T03:25:19.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.153+0000 7ff410fce640 1 --2- 10.20.193.28:0/3477740439 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff40c1064f0 0x7ff40c10cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.153+0000 7ff410fce640 1 --2- 10.20.193.28:0/3477740439 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff40c105b30 0x7ff40c105fb0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.153+0000 7ff410fce640 1 --2- 10.20.193.28:0/3477740439 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff40c104940 0x7ff40c104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.153+0000 7ff410fce640 1 -- 10.20.193.28:0/3477740439 >> 10.20.193.28:0/3477740439 conn(0x7ff40c1000c0 msgr2=0x7ff40c1024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.153+0000 7ff410fce640 1 -- 10.20.193.28:0/3477740439 shutdown_connections 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.153+0000 7ff410fce640 1 -- 10.20.193.28:0/3477740439 wait complete. 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff410fce640 1 Processor -- start 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff410fce640 1 -- start start 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff410fce640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff40c104940 0x7ff40c19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff410fce640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff40c105b30 0x7ff40c19cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff410fce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff40c1064f0 0x7ff40c1a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff410fce640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c110430 con 0x7ff40c1064f0 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff410fce640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c1102b0 con 0x7ff40c104940 2026-02-20T03:25:19.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff410fce640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff40c1105b0 con 0x7ff40c105b30 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff40c104940 0x7ff40c19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff40c1064f0 0x7ff40c1a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff40c105b30 0x7ff40c19cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff40c105b30 0x7ff40c19cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:46002/0 (socket says 10.20.193.28:46002) 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40affd640 1 -- 10.20.193.28:0/3504809381 learned_addr learned my addr 10.20.193.28:0/3504809381 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff40c1064f0 0x7ff40c1a4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40726/0 (socket says 10.20.193.28:40726) 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40affd640 1 -- 10.20.193.28:0/3504809381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff40c104940 msgr2=0x7ff40c19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40affd640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff40c104940 0x7ff40c19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40affd640 1 -- 10.20.193.28:0/3504809381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff40c1064f0 msgr2=0x7ff40c1a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40affd640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff40c1064f0 0x7ff40c1a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.154+0000 7ff40affd640 1 -- 10.20.193.28:0/3504809381 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40c1a4700 con 0x7ff40c105b30 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.155+0000 7ff40affd640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff40c105b30 0x7ff40c19cf90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009b60 tx=0x7ff3fc002f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.155+0000 7ff408ff9640 1 -- 10.20.193.28:0/3504809381 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc004030 con 0x7ff40c105b30 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.155+0000 7ff410fce640 1 -- 10.20.193.28:0/3504809381 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40c1a4990 con 0x7ff40c105b30 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.155+0000 7ff408ff9640 1 -- 10.20.193.28:0/3504809381 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff3fc038770 con 0x7ff40c105b30 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.155+0000 7ff408ff9640 1 -- 10.20.193.28:0/3504809381 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc042620 con 0x7ff40c105b30 2026-02-20T03:25:19.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.155+0000 7ff410fce640 1 -- 10.20.193.28:0/3504809381 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40c1a4e80 con 0x7ff40c105b30 2026-02-20T03:25:19.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.158+0000 7ff408ff9640 1 -- 10.20.193.28:0/3504809381 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff3fc038920 con 0x7ff40c105b30 2026-02-20T03:25:19.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.158+0000 7ff4150b7e00 1 Processor -- start 2026-02-20T03:25:19.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.158+0000 7ff4150b7e00 1 -- start start 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.158+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.158+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 0x55db0c2d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.158+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 0x55db0c2d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.158+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55db0c21d8f0 con 0x55db0c2d2560 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.158+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55db0c1cb2e0 con 0x55db0c2cd7c0 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.158+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55db0c219820 con 0x55db0c2cce80 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:46014/0 (socket says 10.20.193.28:46014) 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40bfff640 1 -- 10.20.193.28:0/1746861475 learned_addr learned my addr 10.20.193.28:0/1746861475 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40affd640 1 --2- 10.20.193.28:0/1746861475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 0x55db0c2d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40b7fe640 1 --2- 10.20.193.28:0/1746861475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 0x55db0c2d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40bfff640 1 -- 10.20.193.28:0/1746861475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 msgr2=0x55db0c2d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40bfff640 1 --2- 10.20.193.28:0/1746861475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 0x55db0c2d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40bfff640 1 -- 10.20.193.28:0/1746861475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 msgr2=0x55db0c2d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40bfff640 1 --2- 10.20.193.28:0/1746861475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 0x55db0c2d49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40bfff640 1 -- 10.20.193.28:0/1746861475 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0c1bd5a0 con 0x55db0c2cce80 2026-02-20T03:25:19.161 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff40bfff640 1 --2- 10.20.193.28:0/1746861475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2cd280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff400009500 tx=0x7ff400009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0012778578b8898 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff408ff9640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3e00b0da0 0x7ff3e00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff408ff9640 1 -- 10.20.193.28:0/3504809381 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff3fc105080 con 0x7ff40c105b30 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff3cffff640 1 -- 10.20.193.28:0/1746861475 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40001b070 con 0x55db0c2cce80 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.159+0000 7ff3cffff640 1 -- 10.20.193.28:0/1746861475 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff400004570 con 0x55db0c2cce80 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff3cffff640 1 -- 10.20.193.28:0/1746861475 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff400013a40 con 0x55db0c2cce80 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff40b7fe640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3e00b0da0 0x7ff3e00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff4150b7e00 1 -- 10.20.193.28:0/1746861475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 msgr2=0x55db0c2cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/1746861475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2cd280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff400009500 tx=0x7ff400009920 comp rx=0 tx=0).stop 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff4150b7e00 1 -- 10.20.193.28:0/1746861475 shutdown_connections 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/1746861475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 0x55db0c2d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/1746861475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 0x55db0c2d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/1746861475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2cd280 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff4150b7e00 1 -- 10.20.193.28:0/1746861475 >> 10.20.193.28:0/1746861475 conn(0x55db0c2c46f0 msgr2=0x55db0c2cb570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff4150b7e00 1 -- 10.20.193.28:0/1746861475 shutdown_connections 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff4150b7e00 1 -- 10.20.193.28:0/1746861475 wait complete. 2026-02-20T03:25:19.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.160+0000 7ff40b7fe640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3e00b0da0 0x7ff3e00b3260 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x55db0c2cdeb0 tx=0x7ff3f8009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:19.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.161+0000 7ff4150b7e00 1 -- start start 2026-02-20T03:25:19.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.161+0000 7ff4150b7e00 1 Processor -- start 2026-02-20T03:25:19.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.164 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 0x55db0c2eced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55db0c1c50c0 con 0x55db0c2d2560 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55db0c2d5610 con 0x55db0c2cd7c0 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55db0c2ed460 con 0x55db0c2cce80 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:46022/0 (socket says 10.20.193.28:46022) 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40b7fe640 1 -- 10.20.193.28:0/3918291784 learned_addr learned my addr 10.20.193.28:0/3918291784 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40affd640 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40bfff640 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 0x55db0c2eced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40b7fe640 1 -- 10.20.193.28:0/3918291784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 msgr2=0x55db0c2e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40b7fe640 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40b7fe640 1 -- 10.20.193.28:0/3918291784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 msgr2=0x55db0c2eced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40b7fe640 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 0x55db0c2eced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.165 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.162+0000 7ff40b7fe640 1 -- 10.20.193.28:0/3918291784 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0c2df130 con 0x55db0c2cce80 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.163+0000 7ff40b7fe640 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e5a10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8011790 tx=0x7ff3f8004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83a7783cc0f209a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.163+0000 7ff3cd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.163+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3918291784 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f801e0d0 con 0x55db0c2cce80 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.163+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3918291784 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff3f801ed30 con 0x55db0c2cce80 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.163+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3918291784 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f801c9c0 con 0x55db0c2cce80 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.163+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3918291784 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0c1d9820 con 0x55db0c2cce80 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.163+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3918291784 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff3f801cbe0 con 0x55db0c2cce80 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.163+0000 7ff4150b7e00 10 client.27355 _ll_register_callbacks cb 0x55db0c1c8ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.163+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3918291784 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55db0c2254e0 con 0x55db0c2cce80 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3918291784 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3f801e270 con 0x55db0c2cce80 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff4150b7e00 10 client.27355 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:19.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3918291784 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55db0c1de380 con 0x55db0c2cce80 2026-02-20T03:25:19.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3918291784 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff3f801c3f0 con 0x55db0c2cce80 2026-02-20T03:25:19.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff4150b7e00 10 client.27355 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:19.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff4150b7e00 10 client.27355 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:19.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff4150b7e00 20 client.27355 populate_metadata read hostname 'trial028' 2026-02-20T03:25:19.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55db0c2f1760 0x55db0c2f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff4150b7e00 4 client.27355 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:19.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.164+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3918291784 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db0c19fbd0 con 0x55db0c2f1760 2026-02-20T03:25:19.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.165+0000 7ff40affd640 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55db0c2f1760 0x55db0c2f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.165+0000 7ff40affd640 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55db0c2f1760 0x55db0c2f3c20 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735b7859270a623 server_cookie=9e55b4b8204314ca in_seq=0 out_seq=0 2026-02-20T03:25:19.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.165+0000 7ff3cd7fa640 10 client.27355 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:19.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.166+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3918291784 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55db0c19fbd0 con 0x55db0c2f1760 2026-02-20T03:25:19.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.166+0000 7ff3cd7fa640 10 client.27355 handle_command_reply: tid=0 2026-02-20T03:25:19.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.166+0000 7ff4150b7e00 1 client.27355 shutdown 2026-02-20T03:25:19.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3918291784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 msgr2=0x55db0c2e5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:19.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e5a10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8011790 tx=0x7ff3f8004830 comp rx=0 tx=0).stop 2026-02-20T03:25:19.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3918291784 shutdown_connections 2026-02-20T03:25:19.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55db0c2f1760 0x55db0c2f3c20 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2d2560 0x55db0c2eced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3918291784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e5a10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3918291784 >> 10.20.193.28:0/3918291784 conn(0x55db0c2c46f0 msgr2=0x55db0c2d38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:19.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff3cd7fa640 0 client.27355 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:19.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3918291784 shutdown_connections 2026-02-20T03:25:19.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3918291784 wait complete. 2026-02-20T03:25:19.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.167+0000 7ff4150b7e00 20 client.27355 trim_cache size 0 max 16384 2026-02-20T03:25:19.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff4150b7e00 1 Processor -- start 2026-02-20T03:25:19.177 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff4150b7e00 1 -- start start 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cce80 0x55db0c2d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2ece40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2d2560 0x55db0c2cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b00126f0 con 0x55db0c2cd7c0 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b000ffc0 con 0x55db0c2cce80 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b000de10 con 0x55db0c2d2560 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cce80 0x55db0c2d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cce80 0x55db0c2d3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41804/0 (socket says 10.20.193.28:41804) 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40b7fe640 1 -- 10.20.193.28:0/3884384969 learned_addr learned my addr 10.20.193.28:0/3884384969 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40bfff640 1 --2- 10.20.193.28:0/3884384969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2d2560 0x55db0c2cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40affd640 1 -- 10.20.193.28:0/3884384969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2d2560 msgr2=0x55db0c2cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40affd640 1 --2- 10.20.193.28:0/3884384969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2d2560 0x55db0c2cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40affd640 1 -- 10.20.193.28:0/3884384969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cce80 msgr2=0x55db0c2d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40affd640 1 --2- 10.20.193.28:0/3884384969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cce80 0x55db0c2d3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40affd640 1 -- 10.20.193.28:0/3884384969 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0c2def60 con 0x55db0c2cd7c0 2026-02-20T03:25:19.178 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.175+0000 7ff40b7fe640 1 --2- 10.20.193.28:0/3884384969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cce80 0x55db0c2d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:19.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff40affd640 1 --2- 10.20.193.28:0/3884384969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2ece40 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc1026f0 tx=0x7ff3fc108ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f79fabda4984ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:19.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff3cf7fe640 1 -- 10.20.193.28:0/3884384969 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0cc460 con 0x55db0c2cd7c0 2026-02-20T03:25:19.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff3cf7fe640 1 -- 10.20.193.28:0/3884384969 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff3fc033040 con 0x55db0c2cd7c0 2026-02-20T03:25:19.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff3cf7fe640 1 -- 10.20.193.28:0/3884384969 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0cc280 con 0x55db0c2cd7c0 2026-02-20T03:25:19.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3884384969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 msgr2=0x55db0c2ece40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:19.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3884384969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2ece40 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc1026f0 tx=0x7ff3fc108ac0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3884384969 shutdown_connections 2026-02-20T03:25:19.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3884384969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2d2560 0x55db0c2cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3884384969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2ece40 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3884384969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2cce80 0x55db0c2d3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3884384969 >> 10.20.193.28:0/3884384969 conn(0x55db0c2c46f0 msgr2=0x55db0c2e47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:19.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3884384969 shutdown_connections 2026-02-20T03:25:19.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.176+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3884384969 wait complete. 2026-02-20T03:25:19.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff4150b7e00 1 -- start start 2026-02-20T03:25:19.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff4150b7e00 1 Processor -- start 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff4150b7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2d2560 0x55db0c2ec670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b000e480 con 0x55db0c2cd7c0 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b000f8f0 con 0x55db0c2d2560 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff4150b7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b000eb50 con 0x55db0c2cce80 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40770/0 (socket says 10.20.193.28:40770) 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40affd640 1 -- 10.20.193.28:0/3788103578 learned_addr learned my addr 10.20.193.28:0/3788103578 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40bfff640 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2d2560 0x55db0c2ec670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40affd640 1 -- 10.20.193.28:0/3788103578 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 msgr2=0x55db0c2e90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40affd640 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40affd640 1 -- 10.20.193.28:0/3788103578 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2d2560 msgr2=0x55db0c2ec670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40affd640 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2d2560 0x55db0c2ec670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40affd640 1 -- 10.20.193.28:0/3788103578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db0bf7d690 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.177+0000 7ff40bfff640 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2d2560 0x55db0c2ec670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff40affd640 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e9630 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc02f730 tx=0x7ff3fc005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963375b8c0201817 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff3cd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3788103578 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0cc460 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3788103578 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff3fc0cd460 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3788103578 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0d5b30 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3788103578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db0c1e2b70 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 10 client.18297 _ll_register_callbacks cb 0x7ff3f8011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3788103578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff400004570 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3788103578 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(94..94 src has 1..94) ==== 9297+0+0 (secure 0 0 0) 0x7ff3fc0d5cd0 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3788103578 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff3fc0d1110 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 10 client.18297 fetch_fsmap learned FSMap version 29 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3788103578 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55db0c2dfc50 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3788103578 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff3fc102bb0 con 0x55db0c2cd7c0 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 10 client.18297 fetch_fsmap finished waiting for FSMap version 29 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 10 client.18297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 20 client.18297 populate_metadata read hostname 'trial028' 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55db0c35d2d0 0x55db0c35f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 4 client.18297 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:25:19.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.178+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3788103578 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db0bff6520 con 0x55db0c35d2d0 2026-02-20T03:25:19.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.179+0000 7ff40b7fe640 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55db0c35d2d0 0x55db0c35f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:19.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.179+0000 7ff40b7fe640 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55db0c35d2d0 0x55db0c35f760 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f659020b41ca48a7 server_cookie=b61bff3c77b684fa in_seq=0 out_seq=0 2026-02-20T03:25:19.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.180+0000 7ff3cd7fa640 10 client.18297 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:19.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.242+0000 7ff3cd7fa640 1 -- 10.20.193.28:0/3788103578 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55db0bff6520 con 0x55db0c35d2d0 2026-02-20T03:25:19.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.242+0000 7ff3cd7fa640 10 client.18297 handle_command_reply: tid=0 2026-02-20T03:25:19.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.242+0000 7ff4150b7e00 1 client.18297 shutdown 2026-02-20T03:25:19.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.243+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3788103578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 msgr2=0x55db0c2e9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:19.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.243+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e9630 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc02f730 tx=0x7ff3fc005e50 comp rx=0 tx=0).stop 2026-02-20T03:25:19.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.243+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3788103578 shutdown_connections 2026-02-20T03:25:19.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.243+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55db0c35d2d0 0x55db0c35f760 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.243+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55db0c2d2560 0x55db0c2ec670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.243+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55db0c2cd7c0 0x55db0c2e9630 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.243+0000 7ff4150b7e00 1 --2- 10.20.193.28:0/3788103578 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55db0c2cce80 0x55db0c2e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.243+0000 7ff3cd7fa640 0 client.18297 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.243+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3788103578 >> 10.20.193.28:0/3788103578 conn(0x55db0c2c46f0 msgr2=0x55db0c2d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.244+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3788103578 shutdown_connections 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.244+0000 7ff4150b7e00 1 -- 10.20.193.28:0/3788103578 wait complete. 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.244+0000 7ff4150b7e00 20 client.18297 trim_cache size 0 max 16384 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:25:19.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.244+0000 7ff410fce640 1 -- 10.20.193.28:0/3504809381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3e00b0da0 msgr2=0x7ff3e00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.244+0000 7ff410fce640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3e00b0da0 0x7ff3e00b3260 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x55db0c2cdeb0 tx=0x7ff3f8009290 comp rx=0 tx=0).stop 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.244+0000 7ff410fce640 1 -- 10.20.193.28:0/3504809381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff40c105b30 msgr2=0x7ff40c19cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.244+0000 7ff410fce640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff40c105b30 0x7ff40c19cf90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009b60 tx=0x7ff3fc002f70 comp rx=0 tx=0).stop 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.245+0000 7ff410fce640 1 -- 10.20.193.28:0/3504809381 shutdown_connections 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.245+0000 7ff410fce640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3e00b0da0 0x7ff3e00b3260 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.245+0000 7ff410fce640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff40c1064f0 0x7ff40c1a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.245+0000 7ff410fce640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff40c105b30 0x7ff40c19cf90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.245+0000 7ff410fce640 1 --2- 10.20.193.28:0/3504809381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff40c104940 0x7ff40c19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.245+0000 7ff410fce640 1 -- 10.20.193.28:0/3504809381 >> 10.20.193.28:0/3504809381 conn(0x7ff40c1000c0 msgr2=0x7ff40c108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.245+0000 7ff410fce640 1 -- 10.20.193.28:0/3504809381 shutdown_connections 2026-02-20T03:25:19.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:19.245+0000 7ff410fce640 1 -- 10.20.193.28:0/3504809381 wait complete. 2026-02-20T03:25:19.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 920566 8.18 MB/sec execute 412 sec latency 26.272 ms 2026-02-20T03:25:19.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:19 trial126 ceph-mon[38476]: pgmap v500: 129 pgs: 129 active+clean; 175 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 354 op/s 2026-02-20T03:25:19.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:19 trial028 ceph-mon[38552]: pgmap v500: 129 pgs: 129 active+clean; 175 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 354 op/s 2026-02-20T03:25:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:19 trial177 ceph-mon[43181]: pgmap v500: 129 pgs: 129 active+clean; 175 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 354 op/s 2026-02-20T03:25:19.718 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:25:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setuser ceph since I am not root 2026-02-20T03:25:19.718 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:25:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setgroup ceph since I am not root 2026-02-20T03:25:19.718 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:25:19 trial177 ceph-mds[71178]: -- 10.20.193.177:0/1725972782 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564180bbcb40 con 0x56417fde2800 2026-02-20T03:25:19.718 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:25:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: starting mds.c at 2026-02-20T03:25:20.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 923258 8.19 MB/sec execute 413 sec latency 173.659 ms 2026-02-20T03:25:20.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:20 trial028 ceph-mon[38552]: daemon mds.c restarted 2026-02-20T03:25:20.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:20 trial028 ceph-mon[38552]: osdmap e95: 12 total, 12 up, 12 in 2026-02-20T03:25:20.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:20 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6836/3766107775,v1:10.20.193.177:6837/3766107775] up:boot 2026-02-20T03:25:20.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:20 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:25:20.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:20 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:25:20.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:20 trial126 ceph-mon[38476]: daemon mds.c restarted 2026-02-20T03:25:20.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:20 trial126 ceph-mon[38476]: osdmap e95: 12 total, 12 up, 12 in 2026-02-20T03:25:20.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:20 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6836/3766107775,v1:10.20.193.177:6837/3766107775] up:boot 2026-02-20T03:25:20.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:20 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:25:20.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:20 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:25:20.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:20 trial177 ceph-mon[43181]: daemon mds.c restarted 2026-02-20T03:25:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:20 trial177 ceph-mon[43181]: osdmap e95: 12 total, 12 up, 12 in 2026-02-20T03:25:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:20 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6836/3766107775,v1:10.20.193.177:6837/3766107775] up:boot 2026-02-20T03:25:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:20 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:25:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:20 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:25:21.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:21 trial028 ceph-mon[38552]: pgmap v502: 129 pgs: 129 active+clean; 165 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 249 op/s 2026-02-20T03:25:21.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 923258 8.17 MB/sec execute 414 sec latency 1173.707 ms 2026-02-20T03:25:21.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:21 trial126 ceph-mon[38476]: pgmap v502: 129 pgs: 129 active+clean; 165 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 249 op/s 2026-02-20T03:25:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:21 trial177 ceph-mon[43181]: pgmap v502: 129 pgs: 129 active+clean; 165 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.0 MiB/s wr, 249 op/s 2026-02-20T03:25:22.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 923258 8.15 MB/sec execute 415 sec latency 2173.743 ms 2026-02-20T03:25:23.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 923258 8.13 MB/sec execute 416 sec latency 3173.781 ms 2026-02-20T03:25:23.579 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:23 trial028 ceph-mon[38552]: pgmap v503: 129 pgs: 129 active+clean; 160 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 879 KiB/s rd, 3.2 MiB/s wr, 271 op/s 2026-02-20T03:25:23.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:23 trial126 ceph-mon[38476]: pgmap v503: 129 pgs: 129 active+clean; 160 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 879 KiB/s rd, 3.2 MiB/s wr, 271 op/s 2026-02-20T03:25:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:23 trial177 ceph-mon[43181]: pgmap v503: 129 pgs: 129 active+clean; 160 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 879 KiB/s rd, 3.2 MiB/s wr, 271 op/s 2026-02-20T03:25:24.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 923919 8.13 MB/sec execute 417 sec latency 4043.179 ms 2026-02-20T03:25:25.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 926976 8.14 MB/sec execute 418 sec latency 72.631 ms 2026-02-20T03:25:25.586 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:25 trial028 ceph-mon[38552]: pgmap v504: 129 pgs: 129 active+clean; 156 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 853 KiB/s rd, 3.1 MiB/s wr, 296 op/s 2026-02-20T03:25:25.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:25 trial126 ceph-mon[38476]: pgmap v504: 129 pgs: 129 active+clean; 156 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 853 KiB/s rd, 3.1 MiB/s wr, 296 op/s 2026-02-20T03:25:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:25 trial177 ceph-mon[43181]: pgmap v504: 129 pgs: 129 active+clean; 156 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 853 KiB/s rd, 3.1 MiB/s wr, 296 op/s 2026-02-20T03:25:26.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 926976 8.12 MB/sec execute 419 sec latency 1072.673 ms 2026-02-20T03:25:27.498 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:27 trial028 ceph-mon[38552]: pgmap v505: 129 pgs: 129 active+clean; 151 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 611 KiB/s rd, 3.2 MiB/s wr, 291 op/s 2026-02-20T03:25:27.520 INFO:tasks.workunit.client.0.trial028.stdout: 1 926976 8.10 MB/sec execute 420 sec latency 2072.735 ms 2026-02-20T03:25:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:27 trial177 ceph-mon[43181]: pgmap v505: 129 pgs: 129 active+clean; 151 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 611 KiB/s rd, 3.2 MiB/s wr, 291 op/s 2026-02-20T03:25:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:27 trial126 ceph-mon[38476]: pgmap v505: 129 pgs: 129 active+clean; 151 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 611 KiB/s rd, 3.2 MiB/s wr, 291 op/s 2026-02-20T03:25:28.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 926976 8.08 MB/sec execute 421 sec latency 3072.775 ms 2026-02-20T03:25:29.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 928762 8.09 MB/sec execute 422 sec latency 3437.797 ms 2026-02-20T03:25:29.647 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:29 trial126 ceph-mon[38476]: pgmap v506: 129 pgs: 129 active+clean; 148 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 580 KiB/s rd, 2.9 MiB/s wr, 303 op/s 2026-02-20T03:25:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:29 trial177 ceph-mon[43181]: pgmap v506: 129 pgs: 129 active+clean; 148 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 580 KiB/s rd, 2.9 MiB/s wr, 303 op/s 2026-02-20T03:25:29.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:29 trial028 ceph-mon[38552]: pgmap v506: 129 pgs: 129 active+clean; 148 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 580 KiB/s rd, 2.9 MiB/s wr, 303 op/s 2026-02-20T03:25:30.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 932268 8.12 MB/sec execute 423 sec latency 20.845 ms 2026-02-20T03:25:31.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:31 trial028 ceph-mon[38552]: pgmap v507: 129 pgs: 129 active+clean; 148 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 602 KiB/s rd, 3.8 MiB/s wr, 340 op/s 2026-02-20T03:25:31.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 932284 8.10 MB/sec execute 424 sec latency 912.820 ms 2026-02-20T03:25:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:31 trial177 ceph-mon[43181]: pgmap v507: 129 pgs: 129 active+clean; 148 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 602 KiB/s rd, 3.8 MiB/s wr, 340 op/s 2026-02-20T03:25:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:31 trial126 ceph-mon[38476]: pgmap v507: 129 pgs: 129 active+clean; 148 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 602 KiB/s rd, 3.8 MiB/s wr, 340 op/s 2026-02-20T03:25:32.323 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3999563815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301038a0 msgr2=0x7f0d30103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:32.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3999563815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301038a0 0x7f0d30103d20 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0d18009a30 tx=0x7f0d1802f260 comp rx=0 tx=0).stop 2026-02-20T03:25:32.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3999563815 shutdown_connections 2026-02-20T03:25:32.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3999563815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d30104260 0x7f0d3010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3999563815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301038a0 0x7f0d30103d20 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3999563815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d301026b0 0x7f0d30102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3999563815 >> 10.20.193.28:0/3999563815 conn(0x7f0d300fde10 msgr2=0x7f0d30100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3999563815 shutdown_connections 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3999563815 wait complete. 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 Processor -- start 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- start start 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301026b0 0x7f0d3019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d301038a0 0x7f0d3019d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d30104260 0x7f0d301a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30075a70 con 0x7f0d301026b0 2026-02-20T03:25:32.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0d300758f0 con 0x7f0d301038a0 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30075bf0 con 0x7f0d30104260 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301026b0 0x7f0d3019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301026b0 0x7f0d3019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45220/0 (socket says 10.20.193.28:45220) 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2effd640 1 -- 10.20.193.28:0/3878044745 learned_addr learned my addr 10.20.193.28:0/3878044745 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2effd640 1 -- 10.20.193.28:0/3878044745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d30104260 msgr2=0x7f0d301a4180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2effd640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d30104260 0x7f0d301a4180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2effd640 1 -- 10.20.193.28:0/3878044745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d301038a0 msgr2=0x7f0d3019d110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2effd640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d301038a0 0x7f0d3019d110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2effd640 1 -- 10.20.193.28:0/3878044745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d301a4880 con 0x7f0d301026b0 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2effd640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301026b0 0x7f0d3019cbd0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b750 tx=0x7f0d2400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d0ffff640 1 -- 10.20.193.28:0/3878044745 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24004480 con 0x7f0d301026b0 2026-02-20T03:25:32.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d0ffff640 1 -- 10.20.193.28:0/3878044745 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d24010070 con 0x7f0d301026b0 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d0ffff640 1 -- 10.20.193.28:0/3878044745 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400ca90 con 0x7f0d301026b0 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3878044745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d301a4b70 con 0x7f0d301026b0 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3878044745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d301a50c0 con 0x7f0d301026b0 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.319+0000 7f0d0ffff640 1 -- 10.20.193.28:0/3878044745 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0d2401d030 con 0x7f0d301026b0 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 Processor -- start 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- start start 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 0x5592e1b5d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b5d7c0 0x5592e1b61f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592e1aad8f0 con 0x5592e1b62560 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5592e1a5b2e0 con 0x5592e1b5ce80 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5592e1aa9820 con 0x5592e1b5d7c0 2026-02-20T03:25:32.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b649f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45234/0 (socket says 10.20.193.28:45234) 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2e7fc640 1 -- 10.20.193.28:0/1540283365 learned_addr learned my addr 10.20.193.28:0/1540283365 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d0ffff640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d040b0da0 0x7f0d040b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2e7fc640 1 -- 10.20.193.28:0/1540283365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b5d7c0 msgr2=0x5592e1b61f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2e7fc640 1 --2- 10.20.193.28:0/1540283365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b5d7c0 0x5592e1b61f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2e7fc640 1 -- 10.20.193.28:0/1540283365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 msgr2=0x5592e1b5d280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2e7fc640 1 --2- 10.20.193.28:0/1540283365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 0x5592e1b5d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2e7fc640 1 -- 10.20.193.28:0/1540283365 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592e1a4d5a0 con 0x5592e1b62560 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d0ffff640 1 -- 10.20.193.28:0/3878044745 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f0d240df940 con 0x7f0d301026b0 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d040b0da0 0x7f0d040b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2e7fc640 1 --2- 10.20.193.28:0/1540283365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b649f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0d1802f770 tx=0x7f0d18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89570eedbfd03192 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d0d3fe640 1 -- 10.20.193.28:0/1540283365 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18038530 con 0x5592e1b62560 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d0d3fe640 1 -- 10.20.193.28:0/1540283365 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d18033040 con 0x5592e1b62560 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d0d3fe640 1 -- 10.20.193.28:0/1540283365 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18004500 con 0x5592e1b62560 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1540283365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 msgr2=0x5592e1b649f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:32.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1540283365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b649f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0d1802f770 tx=0x7f0d18005880 comp rx=0 tx=0).stop 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d040b0da0 0x7f0d040b3260 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000aa00 tx=0x7f0d200091d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1540283365 shutdown_connections 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1540283365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b649f0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1540283365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b5d7c0 0x5592e1b61f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1540283365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 0x5592e1b5d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1540283365 >> 10.20.193.28:0/1540283365 conn(0x5592e1b546f0 msgr2=0x5592e1b5b570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1540283365 shutdown_connections 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1540283365 wait complete. 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- start start 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 Processor -- start 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 0x5592e1b759b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b5d7c0 0x5592e1b75ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b7ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592e1a550c0 con 0x5592e1b62560 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5592e1b655b0 con 0x5592e1b5ce80 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5592e1b7d400 con 0x5592e1b5d7c0 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b7ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b7ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45246/0 (socket says 10.20.193.28:45246) 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 -- 10.20.193.28:0/1656277530 learned_addr learned my addr 10.20.193.28:0/1656277530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 -- 10.20.193.28:0/1656277530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b5d7c0 msgr2=0x5592e1b75ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b5d7c0 0x5592e1b75ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 -- 10.20.193.28:0/1656277530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 msgr2=0x5592e1b759b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 0x5592e1b759b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 -- 10.20.193.28:0/1656277530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592e1b6f0d0 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d2f7fe640 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b7ce70 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f0d20004380 tx=0x7f0d20004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6007c3edbb82d5e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0cf8bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1656277530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2001b460 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1656277530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d2001baa0 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1656277530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000ec10 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1656277530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592e1a69820 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1656277530 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f0d2000edd0 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 10 client.18309 _ll_register_callbacks cb 0x5592e1a58ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.325+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1656277530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5592e1ab54e0 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1656277530 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0d2000e410 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0d383c5e00 10 client.18309 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1656277530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5592e1a6e380 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1656277530 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0d2001bc50 con 0x5592e1b62560 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0d383c5e00 10 client.18309 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0d383c5e00 10 client.18309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0d383c5e00 20 client.18309 populate_metadata read hostname 'trial028' 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592e1b81810 0x5592e1b83c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0d383c5e00 4 client.18309 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:32.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.330+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1656277530 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592e1a2fbd0 con 0x5592e1b81810 2026-02-20T03:25:32.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.344+0000 7f0d2effd640 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592e1b81810 0x5592e1b83c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:32.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.385+0000 7f0d2effd640 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592e1b81810 0x5592e1b83c40 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d9dcb58ceacb95a server_cookie=1df0850e3b9d420e in_seq=0 out_seq=0 2026-02-20T03:25:32.387 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.385+0000 7f0cf8bfc640 10 client.18309 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1656277530 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5592e1a2fbd0 con 0x5592e1b81810 2026-02-20T03:25:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0cf8bfc640 10 client.18309 handle_command_reply: tid=0 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 client.18309 shutdown 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1656277530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 msgr2=0x5592e1b7ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b7ce70 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f0d20004380 tx=0x7f0d20004c50 comp rx=0 tx=0).stop 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1656277530 shutdown_connections 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592e1b81810 0x5592e1b83c40 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b62560 0x5592e1b7ce70 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0cf8bfc640 0 client.18309 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b5d7c0 0x5592e1b75ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1656277530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 0x5592e1b759b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1656277530 >> 10.20.193.28:0/1656277530 conn(0x5592e1b546f0 msgr2=0x5592e1b63870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1656277530 shutdown_connections 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1656277530 wait complete. 2026-02-20T03:25:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.399+0000 7f0d383c5e00 20 client.18309 trim_cache size 0 max 16384 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 Processor -- start 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- start start 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5ce80 0x5592e1b75f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5d7c0 0x5592e1b7ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b62560 0x5592e1b74a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd40126a0 con 0x5592e1b5ce80 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd400ff70 con 0x5592e1b5d7c0 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd400ddc0 con 0x5592e1b62560 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5ce80 0x5592e1b75f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5ce80 0x5592e1b75f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45250/0 (socket says 10.20.193.28:45250) 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2effd640 1 -- 10.20.193.28:0/4031201817 learned_addr learned my addr 10.20.193.28:0/4031201817 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2effd640 1 -- 10.20.193.28:0/4031201817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b62560 msgr2=0x5592e1b74a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2effd640 1 --2- 10.20.193.28:0/4031201817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b62560 0x5592e1b74a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2effd640 1 -- 10.20.193.28:0/4031201817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5d7c0 msgr2=0x5592e1b7ce30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2effd640 1 --2- 10.20.193.28:0/4031201817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5d7c0 0x5592e1b7ce30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2effd640 1 -- 10.20.193.28:0/4031201817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592e1b6ef00 con 0x5592e1b5ce80 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2effd640 1 --2- 10.20.193.28:0/4031201817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5ce80 0x5592e1b75f60 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0d240a3450 tx=0x7f0d240dce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f13e4f809ed75fe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d0cbfd640 1 -- 10.20.193.28:0/4031201817 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d240dd0c0 con 0x5592e1b5ce80 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d0cbfd640 1 -- 10.20.193.28:0/4031201817 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d240a3660 con 0x5592e1b5ce80 2026-02-20T03:25:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d0cbfd640 1 -- 10.20.193.28:0/4031201817 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24012b80 con 0x5592e1b5ce80 2026-02-20T03:25:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- 10.20.193.28:0/4031201817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5ce80 msgr2=0x5592e1b75f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/4031201817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5ce80 0x5592e1b75f60 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f0d240a3450 tx=0x7f0d240dce80 comp rx=0 tx=0).stop 2026-02-20T03:25:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- 10.20.193.28:0/4031201817 shutdown_connections 2026-02-20T03:25:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/4031201817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b62560 0x5592e1b74a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/4031201817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5d7c0 0x5592e1b7ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/4031201817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5ce80 0x5592e1b75f60 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- 10.20.193.28:0/4031201817 >> 10.20.193.28:0/4031201817 conn(0x5592e1b546f0 msgr2=0x5592e1b75850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:32.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- 10.20.193.28:0/4031201817 shutdown_connections 2026-02-20T03:25:32.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- 10.20.193.28:0/4031201817 wait complete. 2026-02-20T03:25:32.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- start start 2026-02-20T03:25:32.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 Processor -- start 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 0x5592e1b79040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5d7c0 0x5592e1b79580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b62560 0x5592e1b7c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd400e430 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd400f8a0 con 0x5592e1b5ce80 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd400eb00 con 0x5592e1b62560 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5d7c0 0x5592e1b79580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5d7c0 0x5592e1b79580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45256/0 (socket says 10.20.193.28:45256) 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2e7fc640 1 -- 10.20.193.28:0/1360575479 learned_addr learned my addr 10.20.193.28:0/1360575479 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2e7fc640 1 -- 10.20.193.28:0/1360575479 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b62560 msgr2=0x5592e1b7c170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2e7fc640 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b62560 0x5592e1b7c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2e7fc640 1 -- 10.20.193.28:0/1360575479 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 msgr2=0x5592e1b79040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2e7fc640 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 0x5592e1b79040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2e7fc640 1 -- 10.20.193.28:0/1360575479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592e180d690 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d2e7fc640 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5d7c0 0x5592e1b79580 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0d18002fd0 tx=0x7f0d18038670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82754c5c3bfd77f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0cf8bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1360575479 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1802fcd0 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1360575479 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d18004560 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1360575479 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d18042420 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1360575479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592e1a72b70 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1360575479 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f0d180425c0 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 10 client.18315 _ll_register_callbacks cb 0x7f0d2000ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1360575479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d18033040 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1360575479 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0d1804f060 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 10 client.18315 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.405+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1360575479 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5592e1b6fbf0 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.410+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1360575479 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0d180040e0 con 0x5592e1b5d7c0 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.410+0000 7f0d383c5e00 10 client.18315 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.410+0000 7f0d383c5e00 10 client.18315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.410+0000 7f0d383c5e00 20 client.18315 populate_metadata read hostname 'trial028' 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.410+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592e1beccf0 0x5592e1bef180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.410+0000 7f0d383c5e00 4 client.18315 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:25:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.410+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1360575479 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5592e1886520 con 0x5592e1beccf0 2026-02-20T03:25:32.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.426+0000 7f0d2effd640 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592e1beccf0 0x5592e1bef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:32.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.492+0000 7f0cf8bfc640 10 client.18315 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:32.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.492+0000 7f0d2effd640 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592e1beccf0 0x5592e1bef180 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d19ace8cce754340 server_cookie=8e9f37ca3394dc3a in_seq=0 out_seq=0 2026-02-20T03:25:32.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 932284 8.08 MB/sec execute 425 sec latency 1107.435 ms 2026-02-20T03:25:32.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0cf8bfc640 1 -- 10.20.193.28:0/1360575479 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5592e1886520 con 0x5592e1beccf0 2026-02-20T03:25:32.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0cf8bfc640 10 client.18315 handle_command_reply: tid=0 2026-02-20T03:25:32.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 client.18315 shutdown 2026-02-20T03:25:32.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1360575479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5d7c0 msgr2=0x5592e1b79580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:32.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5d7c0 0x5592e1b79580 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f0d18002fd0 tx=0x7f0d18038670 comp rx=0 tx=0).stop 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1360575479 shutdown_connections 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592e1beccf0 0x5592e1bef180 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592e1b62560 0x5592e1b7c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592e1b5d7c0 0x5592e1b79580 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 --2- 10.20.193.28:0/1360575479 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592e1b5ce80 0x5592e1b79040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1360575479 >> 10.20.193.28:0/1360575479 conn(0x5592e1b546f0 msgr2=0x5592e1b63870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0cf8bfc640 0 client.18315 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1360575479 shutdown_connections 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 1 -- 10.20.193.28:0/1360575479 wait complete. 2026-02-20T03:25:32.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d383c5e00 20 client.18315 trim_cache size 0 max 16384 2026-02-20T03:25:32.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:25:32.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:25:32.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:25:32.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d040b0da0 msgr2=0x7f0d040b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d040b0da0 0x7f0d040b3260 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000aa00 tx=0x7f0d200091d0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301026b0 msgr2=0x7f0d3019cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301026b0 0x7f0d3019cbd0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b750 tx=0x7f0d2400bc20 comp rx=0 tx=0).stop 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3878044745 shutdown_connections 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d040b0da0 0x7f0d040b3260 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d30104260 0x7f0d301a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d301038a0 0x7f0d3019d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 --2- 10.20.193.28:0/3878044745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d301026b0 0x7f0d3019cbd0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3878044745 >> 10.20.193.28:0/3878044745 conn(0x7f0d300fde10 msgr2=0x7f0d300fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3878044745 shutdown_connections 2026-02-20T03:25:32.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:32.580+0000 7f0d2ffff640 1 -- 10.20.193.28:0/3878044745 wait complete. 2026-02-20T03:25:33.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 932284 8.06 MB/sec execute 426 sec latency 2107.469 ms 2026-02-20T03:25:33.584 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:33 trial028 ceph-mon[38552]: pgmap v508: 129 pgs: 129 active+clean; 149 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 386 KiB/s rd, 3.4 MiB/s wr, 255 op/s 2026-02-20T03:25:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:33 trial177 ceph-mon[43181]: pgmap v508: 129 pgs: 129 active+clean; 149 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 386 KiB/s rd, 3.4 MiB/s wr, 255 op/s 2026-02-20T03:25:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:33 trial126 ceph-mon[38476]: pgmap v508: 129 pgs: 129 active+clean; 149 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 386 KiB/s rd, 3.4 MiB/s wr, 255 op/s 2026-02-20T03:25:34.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 934501 8.07 MB/sec execute 427 sec latency 2196.933 ms 2026-02-20T03:25:35.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 938217 8.10 MB/sec execute 428 sec latency 11.762 ms 2026-02-20T03:25:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:35 trial177 ceph-mon[43181]: pgmap v509: 129 pgs: 129 active+clean; 150 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 379 KiB/s rd, 3.4 MiB/s wr, 248 op/s 2026-02-20T03:25:35.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:35 trial126 ceph-mon[38476]: pgmap v509: 129 pgs: 129 active+clean; 150 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 379 KiB/s rd, 3.4 MiB/s wr, 248 op/s 2026-02-20T03:25:35.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:35 trial028 ceph-mon[38552]: pgmap v509: 129 pgs: 129 active+clean; 150 MiB data, 3.3 GiB used, 8.2 TiB / 8.2 TiB avail; 379 KiB/s rd, 3.4 MiB/s wr, 248 op/s 2026-02-20T03:25:36.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 940213 8.09 MB/sec execute 429 sec latency 322.217 ms 2026-02-20T03:25:36.685 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:36 trial028 ceph-mon[38552]: pgmap v510: 129 pgs: 129 active+clean; 150 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 492 KiB/s rd, 3.8 MiB/s wr, 276 op/s 2026-02-20T03:25:36.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:36 trial177 ceph-mon[43181]: pgmap v510: 129 pgs: 129 active+clean; 150 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 492 KiB/s rd, 3.8 MiB/s wr, 276 op/s 2026-02-20T03:25:36.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:36 trial126 ceph-mon[38476]: pgmap v510: 129 pgs: 129 active+clean; 150 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 492 KiB/s rd, 3.8 MiB/s wr, 276 op/s 2026-02-20T03:25:37.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 940213 8.08 MB/sec execute 430 sec latency 1064.839 ms 2026-02-20T03:25:38.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 940213 8.06 MB/sec execute 431 sec latency 2064.882 ms 2026-02-20T03:25:39.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:39 trial177 ceph-mon[43181]: pgmap v511: 129 pgs: 129 active+clean; 147 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 496 KiB/s rd, 3.3 MiB/s wr, 292 op/s 2026-02-20T03:25:39.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 942285 8.07 MB/sec execute 432 sec latency 2458.727 ms 2026-02-20T03:25:39.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:39 trial126 ceph-mon[38476]: pgmap v511: 129 pgs: 129 active+clean; 147 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 496 KiB/s rd, 3.3 MiB/s wr, 292 op/s 2026-02-20T03:25:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:39 trial028 ceph-mon[38552]: pgmap v511: 129 pgs: 129 active+clean; 147 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 496 KiB/s rd, 3.3 MiB/s wr, 292 op/s 2026-02-20T03:25:40.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:40 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:25:40.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 945978 8.10 MB/sec execute 433 sec latency 8.884 ms 2026-02-20T03:25:40.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:40 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:25:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:40 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:25:41.450 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:41 trial028 ceph-mon[38552]: pgmap v512: 129 pgs: 129 active+clean; 145 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 531 KiB/s rd, 4.0 MiB/s wr, 309 op/s 2026-02-20T03:25:41.450 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:25:41.450 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:25:41.451 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:25:41.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:41 trial177 ceph-mon[43181]: pgmap v512: 129 pgs: 129 active+clean; 145 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 531 KiB/s rd, 4.0 MiB/s wr, 309 op/s 2026-02-20T03:25:41.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:25:41.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:25:41.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:25:41.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 949053 8.12 MB/sec execute 434 sec latency 266.765 ms 2026-02-20T03:25:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:41 trial126 ceph-mon[38476]: pgmap v512: 129 pgs: 129 active+clean; 145 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 531 KiB/s rd, 4.0 MiB/s wr, 309 op/s 2026-02-20T03:25:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:25:41.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:25:41.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:25:42.519 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:25:42.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 949061 8.10 MB/sec execute 435 sec latency 937.958 ms 2026-02-20T03:25:42.817 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:43.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 -- 10.20.193.28:0/3230950677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 msgr2=0x7f0a24104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3230950677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 0x7f0a24104de0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009a60 tx=0x7f0a0c02f290 comp rx=0 tx=0).stop 2026-02-20T03:25:43.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 -- 10.20.193.28:0/3230950677 shutdown_connections 2026-02-20T03:25:43.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3230950677 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a24105320 0x7f0a24111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3230950677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 0x7f0a24104de0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3230950677 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a2410a980 0x7f0a2410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 -- 10.20.193.28:0/3230950677 >> 10.20.193.28:0/3230950677 conn(0x7f0a24100680 msgr2=0x7f0a24102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:43.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 -- 10.20.193.28:0/3230950677 shutdown_connections 2026-02-20T03:25:43.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 -- 10.20.193.28:0/3230950677 wait complete. 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 Processor -- start 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 -- start start 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 0x7f0a24111750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a24105320 0x7f0a2410e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a2410a980 0x7f0a2410eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24114cd0 con 0x7f0a24104980 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24114b50 con 0x7f0a24105320 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a23fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24114e50 con 0x7f0a2410a980 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 0x7f0a24111750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 0x7f0a24111750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53572/0 (socket says 10.20.193.28:53572) 2026-02-20T03:25:43.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a22ffd640 1 -- 10.20.193.28:0/3725438548 learned_addr learned my addr 10.20.193.28:0/3725438548 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:43.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a22ffd640 1 -- 10.20.193.28:0/3725438548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a2410a980 msgr2=0x7f0a2410eed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:43.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a2410a980 0x7f0a2410eed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a22ffd640 1 -- 10.20.193.28:0/3725438548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a24105320 msgr2=0x7f0a2410e800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:43.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a24105320 0x7f0a2410e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.048+0000 7f0a22ffd640 1 -- 10.20.193.28:0/3725438548 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a241adb70 con 0x7f0a24104980 2026-02-20T03:25:43.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 0x7f0a24111750 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800b570 tx=0x7f0a1800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a03fff640 1 -- 10.20.193.28:0/3725438548 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18013020 con 0x7f0a24104980 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a03fff640 1 -- 10.20.193.28:0/3725438548 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a18004480 con 0x7f0a24104980 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a03fff640 1 -- 10.20.193.28:0/3725438548 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1800fb50 con 0x7f0a24104980 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a23fff640 1 -- 10.20.193.28:0/3725438548 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a241adda0 con 0x7f0a24104980 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a23fff640 1 -- 10.20.193.28:0/3725438548 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a241ae1a0 con 0x7f0a24104980 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a03fff640 1 -- 10.20.193.28:0/3725438548 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0a18020060 con 0x7f0a24104980 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a2b816e00 1 Processor -- start 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a2b816e00 1 -- start start 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca5c000 0x5625fca5c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca56a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56fb0 0x5625fca62e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5625fc9d6e50 con 0x5625fca56630 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5625fc9a99c0 con 0x5625fca56fb0 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5625fc957240 con 0x5625fca5c000 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a03fff640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09f80b0e20 0x7f09f80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca56a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca56a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53578/0 (socket says 10.20.193.28:53578) 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a22ffd640 1 -- 10.20.193.28:0/2744987755 learned_addr learned my addr 10.20.193.28:0/2744987755 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.054+0000 7f0a03fff640 1 -- 10.20.193.28:0/3725438548 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f0a180e0300 con 0x7f0a24104980 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f0a22ffd640 1 -- 10.20.193.28:0/2744987755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca5c000 msgr2=0x5625fca5c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/2744987755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca5c000 0x5625fca5c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f0a22ffd640 1 -- 10.20.193.28:0/2744987755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56fb0 msgr2=0x5625fca62e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/2744987755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56fb0 0x5625fca62e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f0a22ffd640 1 -- 10.20.193.28:0/2744987755 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625fc96a420 con 0x5625fca56630 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f0a237fe640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09f80b0e20 0x7f09f80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/2744987755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca56a70 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f0a180a5000 tx=0x7f0a180a7500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431eefa1bb9234a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f09ef7fe640 1 -- 10.20.193.28:0/2744987755 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a180ac390 con 0x5625fca56630 2026-02-20T03:25:43.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f09ef7fe640 1 -- 10.20.193.28:0/2744987755 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a180b1240 con 0x5625fca56630 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f09ef7fe640 1 -- 10.20.193.28:0/2744987755 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a180b0db0 con 0x5625fca56630 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2744987755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 msgr2=0x5625fca56a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.059+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2744987755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca56a70 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f0a180a5000 tx=0x7f0a180a7500 comp rx=0 tx=0).stop 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a237fe640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09f80b0e20 0x7f09f80b32e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400aae0 tx=0x7f0a14009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2744987755 shutdown_connections 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2744987755 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56fb0 0x5625fca62e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2744987755 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca56a70 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2744987755 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca5c000 0x5625fca5c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2744987755 >> 10.20.193.28:0/2744987755 conn(0x5625fca19290 msgr2=0x5625fca54d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:43.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2744987755 shutdown_connections 2026-02-20T03:25:43.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2744987755 wait complete. 2026-02-20T03:25:43.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- start start 2026-02-20T03:25:43.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 Processor -- start 2026-02-20T03:25:43.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56630 0x5625fca70bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56fb0 0x5625fca71100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca5c000 0x5625fca6f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5625fc9a58f0 con 0x5625fca56fb0 2026-02-20T03:25:43.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5625fc797f50 con 0x5625fca56630 2026-02-20T03:25:43.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5625fca6fa80 con 0x5625fca5c000 2026-02-20T03:25:43.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a227fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56fb0 0x5625fca71100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a227fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56fb0 0x5625fca71100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53586/0 (socket says 10.20.193.28:53586) 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a227fc640 1 -- 10.20.193.28:0/3182877235 learned_addr learned my addr 10.20.193.28:0/3182877235 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a227fc640 1 -- 10.20.193.28:0/3182877235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca5c000 msgr2=0x5625fca6f300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a227fc640 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca5c000 0x5625fca6f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a227fc640 1 -- 10.20.193.28:0/3182877235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56630 msgr2=0x5625fca70bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a227fc640 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56630 0x5625fca70bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a227fc640 1 -- 10.20.193.28:0/3182877235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625fca68a50 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a227fc640 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56fb0 0x5625fca71100 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0058c0 tx=0x7f0a0c009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bb919eb1bd7c50 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f09ecff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f09ecff9640 1 -- 10.20.193.28:0/3182877235 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0028f0 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- 10.20.193.28:0/3182877235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625fc77ab40 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 10 client.18327 _ll_register_callbacks cb 0x5625fc9e2f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- 10.20.193.28:0/3182877235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5625fc9b71a0 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f09ecff9640 1 -- 10.20.193.28:0/3182877235 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a0c033040 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f09ecff9640 1 -- 10.20.193.28:0/3182877235 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0028f0 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f09ecff9640 1 -- 10.20.193.28:0/3182877235 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f0a0c004030 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f09ecff9640 1 -- 10.20.193.28:0/3182877235 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0a0c004230 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 10 client.18327 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- 10.20.193.28:0/3182877235 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5625fc964230 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f09ecff9640 1 -- 10.20.193.28:0/3182877235 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0a0c049060 con 0x5625fca56fb0 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 10 client.18327 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 10 client.18327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:43.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 20 client.18327 populate_metadata read hostname 'trial028' 2026-02-20T03:25:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625fca7f360 0x5625fca817f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 4 client.18327 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.060+0000 7f0a2b816e00 1 -- 10.20.193.28:0/3182877235 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625fc9b15b0 con 0x5625fca7f360 2026-02-20T03:25:43.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.073+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625fca7f360 0x5625fca817f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.087+0000 7f09ecff9640 10 client.18327 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:43.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.087+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625fca7f360 0x5625fca817f0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed3002ea216de54 server_cookie=fe1ef13e4a688e5e in_seq=0 out_seq=0 2026-02-20T03:25:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f09ecff9640 1 -- 10.20.193.28:0/3182877235 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5625fc9b15b0 con 0x5625fca7f360 2026-02-20T03:25:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f09ecff9640 10 client.18327 handle_command_reply: tid=0 2026-02-20T03:25:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 client.18327 shutdown 2026-02-20T03:25:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 -- 10.20.193.28:0/3182877235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56fb0 msgr2=0x5625fca71100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56fb0 0x5625fca71100 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c0058c0 tx=0x7f0a0c009690 comp rx=0 tx=0).stop 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 -- 10.20.193.28:0/3182877235 shutdown_connections 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625fca7f360 0x5625fca817f0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca5c000 0x5625fca6f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56fb0 0x5625fca71100 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/3182877235 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56630 0x5625fca70bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 -- 10.20.193.28:0/3182877235 >> 10.20.193.28:0/3182877235 conn(0x5625fca19290 msgr2=0x5625fca55440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f09ecff9640 0 client.18327 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 -- 10.20.193.28:0/3182877235 shutdown_connections 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 1 -- 10.20.193.28:0/3182877235 wait complete. 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.114+0000 7f0a2b816e00 20 client.18327 trim_cache size 0 max 16384 2026-02-20T03:25:43.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 Processor -- start 2026-02-20T03:25:43.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- start start 2026-02-20T03:25:43.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca56630 0x5625fca4eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56fb0 0x5625fca6e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca5c000 0x5625fca55520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8012680 con 0x5625fca5c000 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f09c800ff50 con 0x5625fca56fb0 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f09c800dda0 con 0x5625fca56630 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca5c000 0x5625fca55520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a237fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca5c000 0x5625fca55520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53590/0 (socket says 10.20.193.28:53590) 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a237fe640 1 -- 10.20.193.28:0/270109552 learned_addr learned my addr 10.20.193.28:0/270109552 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a237fe640 1 -- 10.20.193.28:0/270109552 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca56630 msgr2=0x5625fca4eb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a237fe640 1 --2- 10.20.193.28:0/270109552 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca56630 0x5625fca4eb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a237fe640 1 -- 10.20.193.28:0/270109552 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56fb0 msgr2=0x5625fca6e180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a237fe640 1 --2- 10.20.193.28:0/270109552 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56fb0 0x5625fca6e180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a237fe640 1 -- 10.20.193.28:0/270109552 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625fca68880 con 0x5625fca5c000 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a237fe640 1 --2- 10.20.193.28:0/270109552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca5c000 0x5625fca55520 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400cea0 tx=0x7f0a1400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1e397558247d6e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f09eeffd640 1 -- 10.20.193.28:0/270109552 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14004a70 con 0x5625fca5c000 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f09eeffd640 1 -- 10.20.193.28:0/270109552 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a1401f020 con 0x5625fca5c000 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f09eeffd640 1 -- 10.20.193.28:0/270109552 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400dae0 con 0x5625fca5c000 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- 10.20.193.28:0/270109552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca5c000 msgr2=0x5625fca55520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/270109552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca5c000 0x5625fca55520 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400cea0 tx=0x7f0a1400f000 comp rx=0 tx=0).stop 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- 10.20.193.28:0/270109552 shutdown_connections 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/270109552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca5c000 0x5625fca55520 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/270109552 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca56fb0 0x5625fca6e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/270109552 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca56630 0x5625fca4eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- 10.20.193.28:0/270109552 >> 10.20.193.28:0/270109552 conn(0x5625fca19290 msgr2=0x5625fca6da70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- 10.20.193.28:0/270109552 shutdown_connections 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- 10.20.193.28:0/270109552 wait complete. 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 -- start start 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.120+0000 7f0a2b816e00 1 Processor -- start 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca73da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca56fb0 0x5625fca742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca5c000 0x5625fcaea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f09c800e410 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f09c800f880 con 0x5625fca5c000 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f09c800eae0 con 0x5625fca56fb0 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca73da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca73da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53598/0 (socket says 10.20.193.28:53598) 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a22ffd640 1 -- 10.20.193.28:0/2671570374 learned_addr learned my addr 10.20.193.28:0/2671570374 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a22ffd640 1 -- 10.20.193.28:0/2671570374 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca56fb0 msgr2=0x5625fca742e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca56fb0 0x5625fca742e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a22ffd640 1 -- 10.20.193.28:0/2671570374 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca5c000 msgr2=0x5625fcaea2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca5c000 0x5625fcaea2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a22ffd640 1 -- 10.20.193.28:0/2671570374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625fc688870 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a22ffd640 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca73da0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0a180a7ce0 tx=0x7f0a180a8760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e28ac99884a286 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f09ecff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f09ecff9640 1 -- 10.20.193.28:0/2671570374 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a18094170 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f09ecff9640 1 -- 10.20.193.28:0/2671570374 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a180a4020 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f09ecff9640 1 -- 10.20.193.28:0/2671570374 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a180b1010 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2671570374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625fc949440 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f09ecff9640 1 -- 10.20.193.28:0/2671570374 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f0a18090090 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 10 client.18333 _ll_register_callbacks cb 0x7f0a0c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2671570374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5625fc95bb00 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f09ecff9640 1 -- 10.20.193.28:0/2671570374 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0a18090290 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 10 client.18333 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2671570374 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5625fca69570 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f09ecff9640 1 -- 10.20.193.28:0/2671570374 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f0a180a6ff0 con 0x5625fca56630 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 10 client.18333 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 10 client.18333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 20 client.18333 populate_metadata read hostname 'trial028' 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625fcaeb540 0x5625fcaed930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 4 client.18333 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.125+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2671570374 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f0a180b1240 con 0x5625fcaeb540 2026-02-20T03:25:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.127+0000 7f0a227fc640 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625fcaeb540 0x5625fcaed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.195+0000 7f0a227fc640 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625fcaeb540 0x5625fcaed930 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=988ef8f542bbff7f server_cookie=69f40efa843838d6 in_seq=0 out_seq=0 2026-02-20T03:25:43.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.195+0000 7f09ecff9640 10 client.18333 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:43.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f09ecff9640 1 -- 10.20.193.28:0/2671570374 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f0a180b1240 con 0x5625fcaeb540 2026-02-20T03:25:43.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f09ecff9640 10 client.18333 handle_command_reply: tid=0 2026-02-20T03:25:43.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 client.18333 shutdown 2026-02-20T03:25:43.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2671570374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 msgr2=0x5625fca73da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca73da0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0a180a7ce0 tx=0x7f0a180a8760 comp rx=0 tx=0).stop 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2671570374 shutdown_connections 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5625fcaeb540 0x5625fcaed930 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5625fca5c000 0x5625fcaea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5625fca56fb0 0x5625fca742e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 --2- 10.20.193.28:0/2671570374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5625fca56630 0x5625fca73da0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2671570374 >> 10.20.193.28:0/2671570374 conn(0x5625fca19290 msgr2=0x5625fca6e290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f09ecff9640 0 client.18333 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.207+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2671570374 shutdown_connections 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.208+0000 7f0a2b816e00 1 -- 10.20.193.28:0/2671570374 wait complete. 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a2b816e00 20 client.18333 trim_cache size 0 max 16384 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:25:43.223 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 -- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09f80b0e20 msgr2=0x7f09f80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09f80b0e20 0x7f09f80b32e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400aae0 tx=0x7f0a14009230 comp rx=0 tx=0).stop 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 -- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 msgr2=0x7f0a24111750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 0x7f0a24111750 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800b570 tx=0x7f0a1800ba40 comp rx=0 tx=0).stop 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 -- 10.20.193.28:0/3725438548 shutdown_connections 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09f80b0e20 0x7f09f80b32e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a2410a980 0x7f0a2410eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a24105320 0x7f0a2410e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 --2- 10.20.193.28:0/3725438548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a24104980 0x7f0a24111750 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 -- 10.20.193.28:0/3725438548 >> 10.20.193.28:0/3725438548 conn(0x7f0a24100680 msgr2=0x7f0a24101130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 -- 10.20.193.28:0/3725438548 shutdown_connections 2026-02-20T03:25:43.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.221+0000 7f0a23fff640 1 -- 10.20.193.28:0/3725438548 wait complete. 2026-02-20T03:25:43.306 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:43 trial028 ceph-mon[38552]: pgmap v513: 129 pgs: 129 active+clean; 145 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 474 KiB/s rd, 3.0 MiB/s wr, 268 op/s 2026-02-20T03:25:43.379 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:25:43.379 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:25:43.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:43 trial177 ceph-mon[43181]: pgmap v513: 129 pgs: 129 active+clean; 145 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 474 KiB/s rd, 3.0 MiB/s wr, 268 op/s 2026-02-20T03:25:43.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 949211 8.08 MB/sec execute 436 sec latency 946.691 ms 2026-02-20T03:25:43.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:43 trial126 ceph-mon[38476]: pgmap v513: 129 pgs: 129 active+clean; 145 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 474 KiB/s rd, 3.0 MiB/s wr, 268 op/s 2026-02-20T03:25:43.667 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:43.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.852+0000 7f55b1b14640 1 -- 10.20.193.28:0/2224744088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 msgr2=0x7f55ac105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.852+0000 7f55b1b14640 1 --2- 10.20.193.28:0/2224744088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 0x7f55ac105180 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f5598009a30 tx=0x7f559802f220 comp rx=0 tx=0).stop 2026-02-20T03:25:43.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.852+0000 7f55b1b14640 1 -- 10.20.193.28:0/2224744088 shutdown_connections 2026-02-20T03:25:43.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.852+0000 7f55b1b14640 1 --2- 10.20.193.28:0/2224744088 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55ac109ed0 0x7f55ac111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.852+0000 7f55b1b14640 1 --2- 10.20.193.28:0/2224744088 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55ac105750 0x7f55ac1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.852+0000 7f55b1b14640 1 --2- 10.20.193.28:0/2224744088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 0x7f55ac105180 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.852+0000 7f55b1b14640 1 -- 10.20.193.28:0/2224744088 >> 10.20.193.28:0/2224744088 conn(0x7f55ac100840 msgr2=0x7f55ac102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.852+0000 7f55b1b14640 1 -- 10.20.193.28:0/2224744088 shutdown_connections 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.852+0000 7f55b1b14640 1 -- 10.20.193.28:0/2224744088 wait complete. 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55b1b14640 1 Processor -- start 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55b1b14640 1 -- start start 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55b1b14640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 0x7f55ac19d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55b1b14640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55ac105750 0x7f55ac19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55b1b14640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55ac109ed0 0x7f55ac1a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55b1b14640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac114d50 con 0x7f55ac104da0 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55b1b14640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac114bd0 con 0x7f55ac109ed0 2026-02-20T03:25:43.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55b1b14640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac114ed0 con 0x7f55ac105750 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 0x7f55ac19d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55aaffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55ac105750 0x7f55ac19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 0x7f55ac19d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53608/0 (socket says 10.20.193.28:53608) 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55ab7fe640 1 -- 10.20.193.28:0/3991489489 learned_addr learned my addr 10.20.193.28:0/3991489489 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55abfff640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55ac109ed0 0x7f55ac1a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55ab7fe640 1 -- 10.20.193.28:0/3991489489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55ac105750 msgr2=0x7f55ac19d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55ab7fe640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55ac105750 0x7f55ac19d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55ab7fe640 1 -- 10.20.193.28:0/3991489489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55ac109ed0 msgr2=0x7f55ac1a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55ab7fe640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55ac109ed0 0x7f55ac1a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.853+0000 7f55ab7fe640 1 -- 10.20.193.28:0/3991489489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac1a2260 con 0x7f55ac104da0 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.854+0000 7f55ab7fe640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 0x7f55ac19d210 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f559802f730 tx=0x7f5598004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:43.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.854+0000 7f55a8ff9640 1 -- 10.20.193.28:0/3991489489 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598004550 con 0x7f55ac104da0 2026-02-20T03:25:43.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.854+0000 7f55a8ff9640 1 -- 10.20.193.28:0/3991489489 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5598038e20 con 0x7f55ac104da0 2026-02-20T03:25:43.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.854+0000 7f55a8ff9640 1 -- 10.20.193.28:0/3991489489 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598004c60 con 0x7f55ac104da0 2026-02-20T03:25:43.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.854+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac1a24f0 con 0x7f55ac104da0 2026-02-20T03:25:43.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.854+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac1a9d90 con 0x7f55ac104da0 2026-02-20T03:25:43.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.855+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ac105180 con 0x7f55ac104da0 2026-02-20T03:25:43.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.857+0000 7f55a8ff9640 1 -- 10.20.193.28:0/3991489489 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5598005340 con 0x7f55ac104da0 2026-02-20T03:25:43.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.858+0000 7f55a8ff9640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f55800b0e20 0x7f55800b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:43.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.858+0000 7f55a8ff9640 1 -- 10.20.193.28:0/3991489489 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5598105320 con 0x7f55ac104da0 2026-02-20T03:25:43.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.859+0000 7f55a8ff9640 1 -- 10.20.193.28:0/3991489489 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f55980cd780 con 0x7f55ac104da0 2026-02-20T03:25:43.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.859+0000 7f55aaffd640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f55800b0e20 0x7f55800b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:43.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.859+0000 7f55aaffd640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f55800b0e20 0x7f55800b32e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f55ac102dd0 tx=0x7f559c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:43.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.967+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55ac10cb20 con 0x7f55ac104da0 2026-02-20T03:25:43.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.968+0000 7f55a8ff9640 1 -- 10.20.193.28:0/3991489489 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11921 (secure 0 0 0) 0x7f55980d1430 con 0x7f55ac104da0 2026-02-20T03:25:43.972 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:25:43.972 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T03:25:19:519285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:25:19.519275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:25:43.973 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T03:25:43.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f55800b0e20 msgr2=0x7f55800b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f55800b0e20 0x7f55800b32e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f55ac102dd0 tx=0x7f559c009290 comp rx=0 tx=0).stop 2026-02-20T03:25:43.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 msgr2=0x7f55ac19d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:43.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 0x7f55ac19d210 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f559802f730 tx=0x7f5598004360 comp rx=0 tx=0).stop 2026-02-20T03:25:43.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 shutdown_connections 2026-02-20T03:25:43.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f55800b0e20 0x7f55800b32e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f55ac109ed0 0x7f55ac1a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f55ac105750 0x7f55ac19d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 --2- 10.20.193.28:0/3991489489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f55ac104da0 0x7f55ac19d210 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:43.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 >> 10.20.193.28:0/3991489489 conn(0x7f55ac100840 msgr2=0x7f55ac101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:43.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 shutdown_connections 2026-02-20T03:25:43.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:43.969+0000 7f55b1b14640 1 -- 10.20.193.28:0/3991489489 wait complete. 2026-02-20T03:25:44.109 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:25:44.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:44 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3991489489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:25:44.372 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:44.467 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:44 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3991489489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:25:44.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 952771 8.11 MB/sec execute 437 sec latency 11.776 ms 2026-02-20T03:25:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.563+0000 7f96e9bd2640 1 -- 10.20.193.28:0/214936474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109220 msgr2=0x7f96e4109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.563+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/214936474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109220 0x7f96e4109660 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009a30 tx=0x7f96cc02f220 comp rx=0 tx=0).stop 2026-02-20T03:25:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.563+0000 7f96e9bd2640 1 -- 10.20.193.28:0/214936474 shutdown_connections 2026-02-20T03:25:44.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.563+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/214936474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f96e4109ba0 0x7f96e4115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.563+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/214936474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109220 0x7f96e4109660 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.563+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/214936474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96e410eef0 0x7f96e410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.563+0000 7f96e9bd2640 1 -- 10.20.193.28:0/214936474 >> 10.20.193.28:0/214936474 conn(0x7f96e4078600 msgr2=0x7f96e407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:44.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.563+0000 7f96e9bd2640 1 -- 10.20.193.28:0/214936474 shutdown_connections 2026-02-20T03:25:44.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.563+0000 7f96e9bd2640 1 -- 10.20.193.28:0/214936474 wait complete. 2026-02-20T03:25:44.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.564+0000 7f96e9bd2640 1 Processor -- start 2026-02-20T03:25:44.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.564+0000 7f96e9bd2640 1 -- start start 2026-02-20T03:25:44.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.564+0000 7f96e9bd2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f96e4109220 0x7f96e41a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.564+0000 7f96e9bd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109ba0 0x7f96e41a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.564+0000 7f96e9bd2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96e410eef0 0x7f96e41a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.564+0000 7f96e9bd2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f96e4119070 con 0x7f96e4109ba0 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.564+0000 7f96e9bd2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f96e4118ef0 con 0x7f96e410eef0 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.564+0000 7f96e9bd2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f96e41191f0 con 0x7f96e4109220 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.565+0000 7f96e8bd0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f96e4109220 0x7f96e41a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.565+0000 7f96dbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109ba0 0x7f96e41a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.565+0000 7f96dbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109ba0 0x7f96e41a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53626/0 (socket says 10.20.193.28:53626) 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.565+0000 7f96dbfff640 1 -- 10.20.193.28:0/2479489894 learned_addr learned my addr 10.20.193.28:0/2479489894 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.565+0000 7f96e93d1640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96e410eef0 0x7f96e41a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.565+0000 7f96e93d1640 1 -- 10.20.193.28:0/2479489894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f96e4109220 msgr2=0x7f96e41a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.565+0000 7f96e93d1640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f96e4109220 0x7f96e41a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.565+0000 7f96e93d1640 1 -- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109ba0 msgr2=0x7f96e41a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96e93d1640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109ba0 0x7f96e41a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96e93d1640 1 -- 10.20.193.28:0/2479489894 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e41a65e0 con 0x7f96e410eef0 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96e8bd0640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f96e4109220 0x7f96e41a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96dbfff640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109ba0 0x7f96e41a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96e93d1640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96e410eef0 0x7f96e41a5e60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f96e0007f10 tx=0x7f96e000d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96d9ffb640 1 -- 10.20.193.28:0/2479489894 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0002a60 con 0x7f96e410eef0 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96e9bd2640 1 -- 10.20.193.28:0/2479489894 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e41a6870 con 0x7f96e410eef0 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96d9ffb640 1 -- 10.20.193.28:0/2479489894 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f96e0002c00 con 0x7f96e410eef0 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96d9ffb640 1 -- 10.20.193.28:0/2479489894 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0002a60 con 0x7f96e410eef0 2026-02-20T03:25:44.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.566+0000 7f96e9bd2640 1 -- 10.20.193.28:0/2479489894 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e41ae110 con 0x7f96e410eef0 2026-02-20T03:25:44.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.570+0000 7f96d9ffb640 1 -- 10.20.193.28:0/2479489894 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f96e0012070 con 0x7f96e410eef0 2026-02-20T03:25:44.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.570+0000 7f96ed360e00 1 Processor -- start 2026-02-20T03:25:44.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.570+0000 7f96ed360e00 1 -- start start 2026-02-20T03:25:44.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.570+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11d3fb0 0x559aa11d4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.570+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11ce5e0 0x559aa11cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.570+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 0x559aa11dade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.570+0000 7f96ed360e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559aa114ee00 con 0x559aa11ce5e0 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.570+0000 7f96ed360e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559aa1121970 con 0x559aa11cef60 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.570+0000 7f96ed360e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559aa10cf1f0 con 0x559aa11d3fb0 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96dbfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11d3fb0 0x559aa11d4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96dbfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11d3fb0 0x559aa11d4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47956/0 (socket says 10.20.193.28:47956) 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96dbfff640 1 -- 10.20.193.28:0/686700510 learned_addr learned my addr 10.20.193.28:0/686700510 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96dbfff640 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 0x559aa11dade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96e8bd0640 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11ce5e0 0x559aa11cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96dbfff640 1 -- 10.20.193.28:0/686700510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 msgr2=0x559aa11dade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96dbfff640 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 0x559aa11dade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96dbfff640 1 -- 10.20.193.28:0/686700510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11ce5e0 msgr2=0x559aa11cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:44.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96dbfff640 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11ce5e0 0x559aa11cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96dbfff640 1 -- 10.20.193.28:0/686700510 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa10e23d0 con 0x559aa11d3fb0 2026-02-20T03:25:44.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.571+0000 7f96e8bd0640 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11ce5e0 0x559aa11cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:44.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96d9ffb640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f96c00b0fa0 0x7f96c00b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96dbfff640 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11d3fb0 0x559aa11d4390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f96cc02ffa0 tx=0x7f96cc031040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a7c6a1852419167 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:44.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96d9ffb640 1 -- 10.20.193.28:0/2479489894 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f96e00dff70 con 0x7f96e410eef0 2026-02-20T03:25:44.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96b14e4640 1 -- 10.20.193.28:0/686700510 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0041a0 con 0x559aa11d3fb0 2026-02-20T03:25:44.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96b14e4640 1 -- 10.20.193.28:0/686700510 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f96cc033070 con 0x559aa11d3fb0 2026-02-20T03:25:44.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96b14e4640 1 -- 10.20.193.28:0/686700510 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc002940 con 0x559aa11d3fb0 2026-02-20T03:25:44.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96e8bd0640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f96c00b0fa0 0x7f96c00b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96ed360e00 1 -- 10.20.193.28:0/686700510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11d3fb0 msgr2=0x559aa11d4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96ed360e00 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11d3fb0 0x559aa11d4390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f96cc02ffa0 tx=0x7f96cc031040 comp rx=0 tx=0).stop 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96ed360e00 1 -- 10.20.193.28:0/686700510 shutdown_connections 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96ed360e00 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 0x559aa11dade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96ed360e00 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11ce5e0 0x559aa11cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96ed360e00 1 --2- 10.20.193.28:0/686700510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11d3fb0 0x559aa11d4390 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96ed360e00 1 -- 10.20.193.28:0/686700510 >> 10.20.193.28:0/686700510 conn(0x559aa1191240 msgr2=0x559aa11ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.572+0000 7f96ed360e00 1 -- 10.20.193.28:0/686700510 shutdown_connections 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.573+0000 7f96ed360e00 1 -- 10.20.193.28:0/686700510 wait complete. 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.573+0000 7f96e8bd0640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f96c00b0fa0 0x7f96c00b3460 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009a00 tx=0x7f96d4009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.574+0000 7f96ed360e00 1 -- start start 2026-02-20T03:25:44.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.574+0000 7f96ed360e00 1 Processor -- start 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11ce5e0 0x559aa11e8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11cef60 0x559aa11e8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11e6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96ed360e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559aa111d8a0 con 0x559aa11d3fb0 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96ed360e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559aa0f0ff50 con 0x559aa11ce5e0 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96ed360e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559aa11e7750 con 0x559aa11cef60 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96e8bd0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11ce5e0 0x559aa11e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96dbfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11cef60 0x559aa11e8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96e8bd0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11ce5e0 0x559aa11e8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:40864/0 (socket says 10.20.193.28:40864) 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96e8bd0640 1 -- 10.20.193.28:0/3171394687 learned_addr learned my addr 10.20.193.28:0/3171394687 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96e93d1640 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11e6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96dbfff640 1 -- 10.20.193.28:0/3171394687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11ce5e0 msgr2=0x559aa11e8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96dbfff640 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11ce5e0 0x559aa11e8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96dbfff640 1 -- 10.20.193.28:0/3171394687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 msgr2=0x559aa11e6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96dbfff640 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11e6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96dbfff640 1 -- 10.20.193.28:0/3171394687 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa11e0a80 con 0x559aa11cef60 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96e93d1640 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11e6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96dbfff640 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11cef60 0x559aa11e8dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f96cc031010 tx=0x7f96cc0043d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1eecfd283637da4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.575+0000 7f96a27fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96a27fc640 1 -- 10.20.193.28:0/3171394687 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc050070 con 0x559aa11cef60 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96a27fc640 1 -- 10.20.193.28:0/3171394687 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f96cc0045c0 con 0x559aa11cef60 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 1 -- 10.20.193.28:0/3171394687 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa0ef2b40 con 0x559aa11cef60 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96a27fc640 1 -- 10.20.193.28:0/3171394687 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc049460 con 0x559aa11cef60 2026-02-20T03:25:44.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96a27fc640 1 -- 10.20.193.28:0/3171394687 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f96cc049600 con 0x559aa11cef60 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 10 client.27382 _ll_register_callbacks cb 0x559aa115aeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 1 -- 10.20.193.28:0/3171394687 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559aa112f150 con 0x559aa11cef60 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96a27fc640 1 -- 10.20.193.28:0/3171394687 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f96cc059060 con 0x559aa11cef60 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 10 client.27382 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 1 -- 10.20.193.28:0/3171394687 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559aa10dc1e0 con 0x559aa11cef60 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96a27fc640 1 -- 10.20.193.28:0/3171394687 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f96cc047040 con 0x559aa11cef60 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 10 client.27382 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 10 client.27382 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 20 client.27382 populate_metadata read hostname 'trial028' 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559aa11f6a20 0x559aa11f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 4 client.27382 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:44.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.576+0000 7f96ed360e00 1 -- 10.20.193.28:0/3171394687 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559aa1129560 con 0x559aa11f6a20 2026-02-20T03:25:44.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.577+0000 7f96e8bd0640 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559aa11f6a20 0x559aa11f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.577+0000 7f96e8bd0640 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559aa11f6a20 0x559aa11f8ee0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d99b065abb13d701 server_cookie=da897fa0081134e7 in_seq=0 out_seq=0 2026-02-20T03:25:44.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.577+0000 7f96a27fc640 10 client.27382 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:25:44.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96a27fc640 1 -- 10.20.193.28:0/3171394687 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559aa1129560 con 0x559aa11f6a20 2026-02-20T03:25:44.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96a27fc640 10 client.27382 handle_command_reply: tid=0 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 client.27382 shutdown 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 -- 10.20.193.28:0/3171394687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11cef60 msgr2=0x559aa11e8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11cef60 0x559aa11e8dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f96cc031010 tx=0x7f96cc0043d0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 -- 10.20.193.28:0/3171394687 shutdown_connections 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559aa11f6a20 0x559aa11f8ee0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11e6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11cef60 0x559aa11e8dd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 --2- 10.20.193.28:0/3171394687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11ce5e0 0x559aa11e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96a27fc640 0 client.27382 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 -- 10.20.193.28:0/3171394687 >> 10.20.193.28:0/3171394687 conn(0x559aa1191240 msgr2=0x559aa11cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:44.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 -- 10.20.193.28:0/3171394687 shutdown_connections 2026-02-20T03:25:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 1 -- 10.20.193.28:0/3171394687 wait complete. 2026-02-20T03:25:44.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.578+0000 7f96ed360e00 20 client.27382 trim_cache size 0 max 16384 2026-02-20T03:25:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96ed360e00 1 Processor -- start 2026-02-20T03:25:44.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96ed360e00 1 -- start start 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa11e48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11cef60 0x559aa11e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11d3fb0 0x559aa11e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96ed360e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9688012660 con 0x559aa11cef60 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96ed360e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f968800ff30 con 0x559aa11d3fb0 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96ed360e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f968800dd80 con 0x559aa11ce5e0 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96e8bd0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa11e48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96dbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11cef60 0x559aa11e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96e8bd0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa11e48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47970/0 (socket says 10.20.193.28:47970) 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.585+0000 7f96e8bd0640 1 -- 10.20.193.28:0/2123892044 learned_addr learned my addr 10.20.193.28:0/2123892044 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96e93d1640 1 --2- 10.20.193.28:0/2123892044 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11d3fb0 0x559aa11e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96dbfff640 1 -- 10.20.193.28:0/2123892044 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 msgr2=0x559aa11e48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96dbfff640 1 --2- 10.20.193.28:0/2123892044 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa11e48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96dbfff640 1 -- 10.20.193.28:0/2123892044 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11d3fb0 msgr2=0x559aa11e5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96dbfff640 1 --2- 10.20.193.28:0/2123892044 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11d3fb0 0x559aa11e5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96dbfff640 1 -- 10.20.193.28:0/2123892044 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa11e08b0 con 0x559aa11cef60 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96dbfff640 1 --2- 10.20.193.28:0/2123892044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11cef60 0x559aa11e4de0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x559aa11e07e0 tx=0x559aa11e82d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180af2040d025b78 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96b0ce3640 1 -- 10.20.193.28:0/2123892044 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc050070 con 0x559aa11cef60 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96b0ce3640 1 -- 10.20.193.28:0/2123892044 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x559aa112f150 con 0x559aa11cef60 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.586+0000 7f96b0ce3640 1 -- 10.20.193.28:0/2123892044 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc038980 con 0x559aa11cef60 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 -- 10.20.193.28:0/2123892044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11cef60 msgr2=0x559aa11e4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:44.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 --2- 10.20.193.28:0/2123892044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11cef60 0x559aa11e4de0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x559aa11e07e0 tx=0x559aa11e82d0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 -- 10.20.193.28:0/2123892044 shutdown_connections 2026-02-20T03:25:44.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 --2- 10.20.193.28:0/2123892044 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11d3fb0 0x559aa11e5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 --2- 10.20.193.28:0/2123892044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11cef60 0x559aa11e4de0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 --2- 10.20.193.28:0/2123892044 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa11e48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 -- 10.20.193.28:0/2123892044 >> 10.20.193.28:0/2123892044 conn(0x559aa1191240 msgr2=0x559aa11f7900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:44.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 -- 10.20.193.28:0/2123892044 shutdown_connections 2026-02-20T03:25:44.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 -- 10.20.193.28:0/2123892044 wait complete. 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 -- start start 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.587+0000 7f96ed360e00 1 Processor -- start 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa125ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 0x559aa125b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96ed360e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11ebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96e8bd0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa125ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96e8bd0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa125ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47972/0 (socket says 10.20.193.28:47972) 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96ed360e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f968800e3f0 con 0x559aa11d3fb0 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96ed360e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f968800f860 con 0x559aa11cef60 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96ed360e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f968800eac0 con 0x559aa11ce5e0 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96e93d1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11ebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.588+0000 7f96e8bd0640 1 -- 10.20.193.28:0/1413118256 learned_addr learned my addr 10.20.193.28:0/1413118256 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96dbfff640 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 0x559aa125b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96e93d1640 1 -- 10.20.193.28:0/1413118256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 msgr2=0x559aa125ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96e93d1640 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa125ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96e93d1640 1 -- 10.20.193.28:0/1413118256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 msgr2=0x559aa125b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96e93d1640 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 0x559aa125b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96e93d1640 1 -- 10.20.193.28:0/1413118256 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa0e00870 con 0x559aa11d3fb0 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96e93d1640 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11ebdf0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f96e00dd5e0 tx=0x7f96e0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3aa0471cfa0d8d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96a27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96a27fc640 1 -- 10.20.193.28:0/1413118256 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e00a6e70 con 0x559aa11d3fb0 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96a27fc640 1 -- 10.20.193.28:0/1413118256 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f96e00ae200 con 0x559aa11d3fb0 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.589+0000 7f96a27fc640 1 -- 10.20.193.28:0/1413118256 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e00a6930 con 0x559aa11d3fb0 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.590+0000 7f96ed360e00 1 -- 10.20.193.28:0/1413118256 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa10c13f0 con 0x559aa11d3fb0 2026-02-20T03:25:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.590+0000 7f96ed360e00 10 client.18354 _ll_register_callbacks cb 0x7f96d4009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.590+0000 7f96ed360e00 1 -- 10.20.193.28:0/1413118256 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559aa10f27c0 con 0x559aa11d3fb0 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.590+0000 7f96a27fc640 1 -- 10.20.193.28:0/1413118256 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f96e00ae3b0 con 0x559aa11d3fb0 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.590+0000 7f96a27fc640 1 -- 10.20.193.28:0/1413118256 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f96e00a3370 con 0x559aa11d3fb0 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.590+0000 7f96ed360e00 10 client.18354 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.590+0000 7f96ed360e00 1 -- 10.20.193.28:0/1413118256 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559aa11e15a0 con 0x559aa11d3fb0 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.591+0000 7f96a27fc640 1 -- 10.20.193.28:0/1413118256 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f96e00ce180 con 0x559aa11d3fb0 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.591+0000 7f96ed360e00 10 client.18354 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.591+0000 7f96ed360e00 10 client.18354 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.591+0000 7f96ed360e00 20 client.18354 populate_metadata read hostname 'trial028' 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.591+0000 7f96ed360e00 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559aa1263700 0x559aa1265bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.591+0000 7f96ed360e00 4 client.18354 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:25:44.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.591+0000 7f96ed360e00 1 -- 10.20.193.28:0/1413118256 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559aa10d3ab0 con 0x559aa1263700 2026-02-20T03:25:44.598 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:44 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3991489489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:25:44.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.591+0000 7f96e8bd0640 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559aa1263700 0x559aa1265bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:44.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96e8bd0640 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559aa1263700 0x559aa1265bc0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf888b7b3cdb55db server_cookie=2463c648934f1315 in_seq=0 out_seq=0 2026-02-20T03:25:44.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96a27fc640 10 client.18354 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:25:44.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96a27fc640 1 -- 10.20.193.28:0/1413118256 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559aa10d3ab0 con 0x559aa1263700 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96a27fc640 10 client.18354 handle_command_reply: tid=0 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96ed360e00 1 client.18354 shutdown 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96ed360e00 1 -- 10.20.193.28:0/1413118256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 msgr2=0x559aa11ebdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96ed360e00 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11ebdf0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f96e00dd5e0 tx=0x7f96e0009310 comp rx=0 tx=0).stop 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96ed360e00 1 -- 10.20.193.28:0/1413118256 shutdown_connections 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96ed360e00 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x559aa1263700 0x559aa1265bc0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96ed360e00 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559aa11d3fb0 0x559aa11ebdf0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96ed360e00 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559aa11cef60 0x559aa125b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96ed360e00 1 --2- 10.20.193.28:0/1413118256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559aa11ce5e0 0x559aa125ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96ed360e00 1 -- 10.20.193.28:0/1413118256 >> 10.20.193.28:0/1413118256 conn(0x559aa1191240 msgr2=0x559aa11e5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.592+0000 7f96a27fc640 0 client.18354 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:25:44.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.593+0000 7f96ed360e00 1 -- 10.20.193.28:0/1413118256 shutdown_connections 2026-02-20T03:25:44.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.593+0000 7f96ed360e00 1 -- 10.20.193.28:0/1413118256 wait complete. 2026-02-20T03:25:44.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.593+0000 7f96ed360e00 20 client.18354 trim_cache size 0 max 16384 2026-02-20T03:25:44.601 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:25:44.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.594+0000 7f96e9bd2640 1 -- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f96c00b0fa0 msgr2=0x7f96c00b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:44.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.594+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f96c00b0fa0 0x7f96c00b3460 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009a00 tx=0x7f96d4009290 comp rx=0 tx=0).stop 2026-02-20T03:25:44.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.594+0000 7f96e9bd2640 1 -- 10.20.193.28:0/2479489894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96e410eef0 msgr2=0x7f96e41a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:44.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.594+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96e410eef0 0x7f96e41a5e60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f96e0007f10 tx=0x7f96e000d4a0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.595+0000 7f96e9bd2640 1 -- 10.20.193.28:0/2479489894 shutdown_connections 2026-02-20T03:25:44.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.595+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f96c00b0fa0 0x7f96c00b3460 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.595+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f96e410eef0 0x7f96e41a5e60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.595+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f96e4109ba0 0x7f96e41a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.595+0000 7f96e9bd2640 1 --2- 10.20.193.28:0/2479489894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f96e4109220 0x7f96e41a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:44.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.595+0000 7f96e9bd2640 1 -- 10.20.193.28:0/2479489894 >> 10.20.193.28:0/2479489894 conn(0x7f96e4078600 msgr2=0x7f96e407a000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:44.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.595+0000 7f96e9bd2640 1 -- 10.20.193.28:0/2479489894 shutdown_connections 2026-02-20T03:25:44.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:44.595+0000 7f96e9bd2640 1 -- 10.20.193.28:0/2479489894 wait complete. 2026-02-20T03:25:44.696 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:25:44.966 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:45.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.144+0000 7fd935aeb640 1 -- 10.20.193.28:0/2992536418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd930109220 msgr2=0x7fd930109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.144+0000 7fd935aeb640 1 --2- 10.20.193.28:0/2992536418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd930109220 0x7fd930109660 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd918009a30 tx=0x7fd91802f220 comp rx=0 tx=0).stop 2026-02-20T03:25:45.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.144+0000 7fd935aeb640 1 -- 10.20.193.28:0/2992536418 shutdown_connections 2026-02-20T03:25:45.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.144+0000 7fd935aeb640 1 --2- 10.20.193.28:0/2992536418 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd930109ba0 0x7fd930115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.144+0000 7fd935aeb640 1 --2- 10.20.193.28:0/2992536418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd930109220 0x7fd930109660 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.144+0000 7fd935aeb640 1 --2- 10.20.193.28:0/2992536418 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd93010eef0 0x7fd93010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.144+0000 7fd935aeb640 1 -- 10.20.193.28:0/2992536418 >> 10.20.193.28:0/2992536418 conn(0x7fd930078600 msgr2=0x7fd93007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.144+0000 7fd935aeb640 1 -- 10.20.193.28:0/2992536418 shutdown_connections 2026-02-20T03:25:45.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.144+0000 7fd935aeb640 1 -- 10.20.193.28:0/2992536418 wait complete. 2026-02-20T03:25:45.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.145+0000 7fd935aeb640 1 Processor -- start 2026-02-20T03:25:45.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.145+0000 7fd935aeb640 1 -- start start 2026-02-20T03:25:45.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd935aeb640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd930109220 0x7fd9301a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd935aeb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd930109ba0 0x7fd9301a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd935aeb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd93010eef0 0x7fd9301a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd935aeb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd9301190a0 con 0x7fd93010eef0 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd935aeb640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd930118f20 con 0x7fd930109220 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd935aeb640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd930119220 con 0x7fd930109ba0 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd934ae9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd930109220 0x7fd9301a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd934ae9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd930109220 0x7fd9301a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:40882/0 (socket says 10.20.193.28:40882) 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd934ae9640 1 -- 10.20.193.28:0/506799196 learned_addr learned my addr 10.20.193.28:0/506799196 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd9352ea640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd93010eef0 0x7fd9301a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd927fff640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd930109ba0 0x7fd9301a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd934ae9640 1 -- 10.20.193.28:0/506799196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd930109ba0 msgr2=0x7fd9301a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd934ae9640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd930109ba0 0x7fd9301a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd934ae9640 1 -- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd93010eef0 msgr2=0x7fd9301a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd934ae9640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd93010eef0 0x7fd9301a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd934ae9640 1 -- 10.20.193.28:0/506799196 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9301a65b0 con 0x7fd930109220 2026-02-20T03:25:45.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.146+0000 7fd934ae9640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd930109220 0x7fd9301a1560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd92000d950 tx=0x7fd92000de20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.147+0000 7fd925ffb640 1 -- 10.20.193.28:0/506799196 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920014070 con 0x7fd930109220 2026-02-20T03:25:45.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.147+0000 7fd935aeb640 1 -- 10.20.193.28:0/506799196 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9301a68a0 con 0x7fd930109220 2026-02-20T03:25:45.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.147+0000 7fd935aeb640 1 -- 10.20.193.28:0/506799196 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9301ae0e0 con 0x7fd930109220 2026-02-20T03:25:45.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.147+0000 7fd925ffb640 1 -- 10.20.193.28:0/506799196 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd9200044e0 con 0x7fd930109220 2026-02-20T03:25:45.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.147+0000 7fd925ffb640 1 -- 10.20.193.28:0/506799196 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd920005020 con 0x7fd930109220 2026-02-20T03:25:45.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.150+0000 7fd939279e00 1 Processor -- start 2026-02-20T03:25:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.151+0000 7fd925ffb640 1 -- 10.20.193.28:0/506799196 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd92000b900 con 0x7fd930109220 2026-02-20T03:25:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.151+0000 7fd939279e00 1 -- start start 2026-02-20T03:25:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd939279e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21d92390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd939279e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 0x562e21d8ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd939279e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21d98de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd939279e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562e21d0ce00 con 0x562e21d8cf60 2026-02-20T03:25:45.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd939279e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562e21cdf970 con 0x562e21d8c5e0 2026-02-20T03:25:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd939279e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562e21c8d1f0 con 0x562e21d91fb0 2026-02-20T03:25:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd9352ea640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21d92390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd9352ea640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21d92390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48000/0 (socket says 10.20.193.28:48000) 2026-02-20T03:25:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd9352ea640 1 -- 10.20.193.28:0/2454639604 learned_addr learned my addr 10.20.193.28:0/2454639604 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd934ae9640 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 0x562e21d8ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd927fff640 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21d98de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd9352ea640 1 -- 10.20.193.28:0/2454639604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 msgr2=0x562e21d8ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd9352ea640 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 0x562e21d8ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd9352ea640 1 -- 10.20.193.28:0/2454639604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 msgr2=0x562e21d98de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd9352ea640 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21d98de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd9352ea640 1 -- 10.20.193.28:0/2454639604 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e21ca03d0 con 0x562e21d91fb0 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd927fff640 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21d98de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.152+0000 7fd9352ea640 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21d92390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009500 tx=0x7fd92c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d73f5bc1a454053 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd8fd4e4640 1 -- 10.20.193.28:0/2454639604 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c01b070 con 0x562e21d91fb0 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd8fd4e4640 1 -- 10.20.193.28:0/2454639604 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd92c004570 con 0x562e21d91fb0 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd8fd4e4640 1 -- 10.20.193.28:0/2454639604 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c013a40 con 0x562e21d91fb0 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd939279e00 1 -- 10.20.193.28:0/2454639604 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 msgr2=0x562e21d92390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd939279e00 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21d92390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009500 tx=0x7fd92c009920 comp rx=0 tx=0).stop 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd939279e00 1 -- 10.20.193.28:0/2454639604 shutdown_connections 2026-02-20T03:25:45.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd939279e00 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21d98de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd939279e00 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 0x562e21d8ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd939279e00 1 --2- 10.20.193.28:0/2454639604 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21d92390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd939279e00 1 -- 10.20.193.28:0/2454639604 >> 10.20.193.28:0/2454639604 conn(0x562e21d4f240 msgr2=0x562e21d8ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd939279e00 1 -- 10.20.193.28:0/2454639604 shutdown_connections 2026-02-20T03:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd939279e00 1 -- 10.20.193.28:0/2454639604 wait complete. 2026-02-20T03:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd925ffb640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd90c0b0d80 0x7fd90c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.153+0000 7fd925ffb640 1 -- 10.20.193.28:0/506799196 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd9200e0810 con 0x7fd930109220 2026-02-20T03:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.154+0000 7fd9352ea640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd90c0b0d80 0x7fd90c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.154+0000 7fd939279e00 1 -- start start 2026-02-20T03:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.154+0000 7fd939279e00 1 Processor -- start 2026-02-20T03:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.154+0000 7fd9352ea640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd90c0b0d80 0x7fd90c0b3240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009310 tx=0x7fd92c006000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd939279e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 0x562e21da5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd939279e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd939279e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21daad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd939279e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562e21cdb8a0 con 0x562e21d8cf60 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd939279e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562e21acdf50 con 0x562e21d8c5e0 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd939279e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562e21dab2c0 con 0x562e21d91fb0 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd9352ea640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21daad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd927fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd934ae9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 0x562e21da5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd9352ea640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21daad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48002/0 (socket says 10.20.193.28:48002) 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd9352ea640 1 -- 10.20.193.28:0/1162755512 learned_addr learned my addr 10.20.193.28:0/1162755512 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd927fff640 1 -- 10.20.193.28:0/1162755512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 msgr2=0x562e21daad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd927fff640 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21daad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd927fff640 1 -- 10.20.193.28:0/1162755512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 msgr2=0x562e21da5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd927fff640 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 0x562e21da5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd927fff640 1 -- 10.20.193.28:0/1162755512 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e21d9ea30 con 0x562e21d8cf60 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.155+0000 7fd934ae9640 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 0x562e21da5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd927fff640 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da57d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd918009a00 tx=0x7fd918005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e14914d184dbdf2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd8ee7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/1162755512 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918004480 con 0x562e21d8cf60 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/1162755512 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd918033040 con 0x562e21d8cf60 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/1162755512 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd918038bf0 con 0x562e21d8cf60 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd939279e00 1 -- 10.20.193.28:0/1162755512 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e21ab0b40 con 0x562e21d8cf60 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/1162755512 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd918005030 con 0x562e21d8cf60 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd939279e00 10 client.18363 _ll_register_callbacks cb 0x562e21d18eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd939279e00 1 -- 10.20.193.28:0/1162755512 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e21ced150 con 0x562e21d8cf60 2026-02-20T03:25:45.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.156+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/1162755512 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd918038e10 con 0x562e21d8cf60 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd939279e00 10 client.18363 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd939279e00 1 -- 10.20.193.28:0/1162755512 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x562e21c9a1e0 con 0x562e21d8cf60 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/1162755512 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd918005230 con 0x562e21d8cf60 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd939279e00 10 client.18363 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd939279e00 10 client.18363 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd939279e00 20 client.18363 populate_metadata read hostname 'trial028' 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd939279e00 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562e21dc6700 0x562e21dc8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd939279e00 4 client.18363 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd939279e00 1 -- 10.20.193.28:0/1162755512 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e21ce7560 con 0x562e21dc6700 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.157+0000 7fd934ae9640 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562e21dc6700 0x562e21dc8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd934ae9640 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562e21dc6700 0x562e21dc8b90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c5e2162ce4b689d4 server_cookie=32165d8eec57ef03 in_seq=0 out_seq=0 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd8ee7fc640 10 client.18363 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/1162755512 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562e21ce7560 con 0x562e21dc6700 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd8ee7fc640 10 client.18363 handle_command_reply: tid=0 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd939279e00 1 client.18363 shutdown 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd939279e00 1 -- 10.20.193.28:0/1162755512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 msgr2=0x562e21da57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd939279e00 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da57d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd918009a00 tx=0x7fd918005b00 comp rx=0 tx=0).stop 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd939279e00 1 -- 10.20.193.28:0/1162755512 shutdown_connections 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd939279e00 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562e21dc6700 0x562e21dc8b90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd939279e00 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d91fb0 0x562e21daad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd939279e00 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da57d0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd939279e00 1 --2- 10.20.193.28:0/1162755512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8c5e0 0x562e21da5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd939279e00 1 -- 10.20.193.28:0/1162755512 >> 10.20.193.28:0/1162755512 conn(0x562e21d4f240 msgr2=0x562e21d8b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.158+0000 7fd8ee7fc640 0 client.18363 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:25:45.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.159+0000 7fd939279e00 1 -- 10.20.193.28:0/1162755512 shutdown_connections 2026-02-20T03:25:45.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.159+0000 7fd939279e00 1 -- 10.20.193.28:0/1162755512 wait complete. 2026-02-20T03:25:45.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.159+0000 7fd939279e00 20 client.18363 trim_cache size 0 max 16384 2026-02-20T03:25:45.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd939279e00 1 Processor -- start 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd939279e00 1 -- start start 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd939279e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21d8fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd939279e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd939279e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d91fb0 0x562e21da28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd939279e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d40126a0 con 0x562e21d8cf60 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd939279e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d400ff70 con 0x562e21d91fb0 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd939279e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d400ddc0 con 0x562e21d8c5e0 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd934ae9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21d8fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd934ae9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21d8fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48006/0 (socket says 10.20.193.28:48006) 2026-02-20T03:25:45.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd934ae9640 1 -- 10.20.193.28:0/25758761 learned_addr learned my addr 10.20.193.28:0/25758761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd9352ea640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d91fb0 0x562e21da28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.166+0000 7fd927fff640 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd9352ea640 1 -- 10.20.193.28:0/25758761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 msgr2=0x562e21d8fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd9352ea640 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21d8fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd9352ea640 1 -- 10.20.193.28:0/25758761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 msgr2=0x562e21da23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd9352ea640 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd9352ea640 1 -- 10.20.193.28:0/25758761 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e21d9e860 con 0x562e21d91fb0 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd934ae9640 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21d8fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd927fff640 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd9352ea640 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d91fb0 0x562e21da28e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd92c018000 tx=0x7fd92c021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5164501bdc3c61d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd8fcce3640 1 -- 10.20.193.28:0/25758761 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c004d00 con 0x562e21d91fb0 2026-02-20T03:25:45.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd8fcce3640 1 -- 10.20.193.28:0/25758761 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd92c01c040 con 0x562e21d91fb0 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.167+0000 7fd8fcce3640 1 -- 10.20.193.28:0/25758761 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c005800 con 0x562e21d91fb0 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 -- 10.20.193.28:0/25758761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d91fb0 msgr2=0x562e21da28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d91fb0 0x562e21da28e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd92c018000 tx=0x7fd92c021000 comp rx=0 tx=0).stop 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 -- 10.20.193.28:0/25758761 shutdown_connections 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d91fb0 0x562e21da28e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d8cf60 0x562e21da23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 --2- 10.20.193.28:0/25758761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21d8fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 -- 10.20.193.28:0/25758761 >> 10.20.193.28:0/25758761 conn(0x562e21d4f240 msgr2=0x562e21da4110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 -- 10.20.193.28:0/25758761 shutdown_connections 2026-02-20T03:25:45.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 -- 10.20.193.28:0/25758761 wait complete. 2026-02-20T03:25:45.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 -- start start 2026-02-20T03:25:45.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.168+0000 7fd939279e00 1 Processor -- start 2026-02-20T03:25:45.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd939279e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21dae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd939279e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8cf60 0x562e21dae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd939279e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d91fb0 0x562e21daeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd939279e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d400e430 con 0x562e21d91fb0 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd939279e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d400f8a0 con 0x562e21d8cf60 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd939279e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d400eb00 con 0x562e21d8c5e0 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd927fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8cf60 0x562e21dae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd934ae9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21dae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd927fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8cf60 0x562e21dae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:40928/0 (socket says 10.20.193.28:40928) 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd927fff640 1 -- 10.20.193.28:0/2467769110 learned_addr learned my addr 10.20.193.28:0/2467769110 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd9352ea640 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d91fb0 0x562e21daeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd934ae9640 1 -- 10.20.193.28:0/2467769110 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8cf60 msgr2=0x562e21dae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd934ae9640 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8cf60 0x562e21dae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd934ae9640 1 -- 10.20.193.28:0/2467769110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d91fb0 msgr2=0x562e21daeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd934ae9640 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d91fb0 0x562e21daeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd934ae9640 1 -- 10.20.193.28:0/2467769110 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e219be870 con 0x562e21d8c5e0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.169+0000 7fd927fff640 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8cf60 0x562e21dae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd934ae9640 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21dae0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd920002410 tx=0x7fd920004690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a740a4ee6d651f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd8ee7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/2467769110 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9200e6040 con 0x562e21d8c5e0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 1 -- 10.20.193.28:0/2467769110 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e21c7f3f0 con 0x562e21d8c5e0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/2467769110 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd9200ac8a0 con 0x562e21d8c5e0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/2467769110 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92001d040 con 0x562e21d8c5e0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 10 client.27406 _ll_register_callbacks cb 0x7fd92c0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 1 -- 10.20.193.28:0/2467769110 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e21cb07c0 con 0x562e21d8c5e0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/2467769110 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd9200afb90 con 0x562e21d8c5e0 2026-02-20T03:25:45.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/2467769110 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd9200afe50 con 0x562e21d8c5e0 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 10 client.27406 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 1 -- 10.20.193.28:0/2467769110 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x562e21d9f550 con 0x562e21d8c5e0 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/2467769110 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd9200a7500 con 0x562e21d8c5e0 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 10 client.27406 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 10 client.27406 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 20 client.27406 populate_metadata read hostname 'trial028' 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562e21e32d00 0x562e21e351c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 4 client.27406 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.170+0000 7fd939279e00 1 -- 10.20.193.28:0/2467769110 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e21c91ab0 con 0x562e21e32d00 2026-02-20T03:25:45.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd927fff640 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562e21e32d00 0x562e21e351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd927fff640 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562e21e32d00 0x562e21e351c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e316b227c1bd70fd server_cookie=af7cc92e1507727e in_seq=0 out_seq=0 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd8ee7fc640 10 client.27406 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd8ee7fc640 1 -- 10.20.193.28:0/2467769110 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562e21c91ab0 con 0x562e21e32d00 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd8ee7fc640 10 client.27406 handle_command_reply: tid=0 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 client.27406 shutdown 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 -- 10.20.193.28:0/2467769110 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 msgr2=0x562e21dae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21dae0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd920002410 tx=0x7fd920004690 comp rx=0 tx=0).stop 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 -- 10.20.193.28:0/2467769110 shutdown_connections 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562e21e32d00 0x562e21e351c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e21d91fb0 0x562e21daeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e21d8cf60 0x562e21dae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 --2- 10.20.193.28:0/2467769110 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e21d8c5e0 0x562e21dae0a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 -- 10.20.193.28:0/2467769110 >> 10.20.193.28:0/2467769110 conn(0x562e21d4f240 msgr2=0x562e21dc6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd8ee7fc640 0 client.27406 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:25:45.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.171+0000 7fd939279e00 1 -- 10.20.193.28:0/2467769110 shutdown_connections 2026-02-20T03:25:45.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd939279e00 1 -- 10.20.193.28:0/2467769110 wait complete. 2026-02-20T03:25:45.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd939279e00 20 client.27406 trim_cache size 0 max 16384 2026-02-20T03:25:45.181 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:25:45.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 -- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd90c0b0d80 msgr2=0x7fd90c0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd90c0b0d80 0x7fd90c0b3240 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009310 tx=0x7fd92c006000 comp rx=0 tx=0).stop 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 -- 10.20.193.28:0/506799196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd930109220 msgr2=0x7fd9301a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd930109220 0x7fd9301a1560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd92000d950 tx=0x7fd92000de20 comp rx=0 tx=0).stop 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 -- 10.20.193.28:0/506799196 shutdown_connections 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd90c0b0d80 0x7fd90c0b3240 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd93010eef0 0x7fd9301a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd930109ba0 0x7fd9301a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 --2- 10.20.193.28:0/506799196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd930109220 0x7fd9301a1560 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 -- 10.20.193.28:0/506799196 >> 10.20.193.28:0/506799196 conn(0x7fd930078600 msgr2=0x7fd930079ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 -- 10.20.193.28:0/506799196 shutdown_connections 2026-02-20T03:25:45.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.172+0000 7fd935aeb640 1 -- 10.20.193.28:0/506799196 wait complete. 2026-02-20T03:25:45.270 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:45 trial028 ceph-mon[38552]: pgmap v514: 129 pgs: 129 active+clean; 146 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 560 KiB/s rd, 3.1 MiB/s wr, 293 op/s 2026-02-20T03:25:45.272 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:25:45.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:45 trial177 ceph-mon[43181]: pgmap v514: 129 pgs: 129 active+clean; 146 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 560 KiB/s rd, 3.1 MiB/s wr, 293 op/s 2026-02-20T03:25:45.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 956337 8.13 MB/sec execute 438 sec latency 7.374 ms 2026-02-20T03:25:45.540 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:45 trial126 ceph-mon[38476]: pgmap v514: 129 pgs: 129 active+clean; 146 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 560 KiB/s rd, 3.1 MiB/s wr, 293 op/s 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.656+0000 7fc514d89640 1 -- 10.20.193.28:0/3799917784 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500038470 con 0x7fc5101026b0 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 -- 10.20.193.28:0/3799917784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 msgr2=0x7fc510102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 --2- 10.20.193.28:0/3799917784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 0x7fc510102ab0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc500009a30 tx=0x7fc50002f220 comp rx=0 tx=0).stop 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 -- 10.20.193.28:0/3799917784 shutdown_connections 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 --2- 10.20.193.28:0/3799917784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc510104260 0x7fc51010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 --2- 10.20.193.28:0/3799917784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5101038a0 0x7fc510103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 --2- 10.20.193.28:0/3799917784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 0x7fc510102ab0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 -- 10.20.193.28:0/3799917784 >> 10.20.193.28:0/3799917784 conn(0x7fc5100fde10 msgr2=0x7fc510100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 -- 10.20.193.28:0/3799917784 shutdown_connections 2026-02-20T03:25:45.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 -- 10.20.193.28:0/3799917784 wait complete. 2026-02-20T03:25:45.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.657+0000 7fc516d8d640 1 Processor -- start 2026-02-20T03:25:45.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc516d8d640 1 -- start start 2026-02-20T03:25:45.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc516d8d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 0x7fc51019ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc516d8d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5101038a0 0x7fc51019cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc516d8d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc510104260 0x7fc5101a3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc516d8d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc51010e150 con 0x7fc510104260 2026-02-20T03:25:45.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc516d8d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc51010dfd0 con 0x7fc5101038a0 2026-02-20T03:25:45.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc516d8d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc51010e2d0 con 0x7fc5101026b0 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc515d8b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 0x7fc51019ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc515d8b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 0x7fc51019ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48028/0 (socket says 10.20.193.28:48028) 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc515d8b640 1 -- 10.20.193.28:0/439631618 learned_addr learned my addr 10.20.193.28:0/439631618 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc51558a640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5101038a0 0x7fc51019cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc515d8b640 1 -- 10.20.193.28:0/439631618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5101038a0 msgr2=0x7fc51019cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc515d8b640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5101038a0 0x7fc51019cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc515d8b640 1 -- 10.20.193.28:0/439631618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc510104260 msgr2=0x7fc5101a3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc515d8b640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc510104260 0x7fc5101a3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.658+0000 7fc515d8b640 1 -- 10.20.193.28:0/439631618 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5101a46e0 con 0x7fc5101026b0 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.659+0000 7fc515d8b640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 0x7fc51019ca30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc500005a40 tx=0x7fc500002f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.659+0000 7fc4feffd640 1 -- 10.20.193.28:0/439631618 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50002fe10 con 0x7fc5101026b0 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.659+0000 7fc516d8d640 1 -- 10.20.193.28:0/439631618 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5101a4970 con 0x7fc5101026b0 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.659+0000 7fc4feffd640 1 -- 10.20.193.28:0/439631618 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc5000044f0 con 0x7fc5101026b0 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.659+0000 7fc516d8d640 1 -- 10.20.193.28:0/439631618 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5101a4eb0 con 0x7fc5101026b0 2026-02-20T03:25:45.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.659+0000 7fc4feffd640 1 -- 10.20.193.28:0/439631618 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500041620 con 0x7fc5101026b0 2026-02-20T03:25:45.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.662+0000 7fc4feffd640 1 -- 10.20.193.28:0/439631618 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc500038900 con 0x7fc5101026b0 2026-02-20T03:25:45.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.663+0000 7fc51ae71e00 1 Processor -- start 2026-02-20T03:25:45.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.663+0000 7fc51ae71e00 1 -- start start 2026-02-20T03:25:45.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.663+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bde750 0x561db0bdeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.663+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0be3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.663+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 0x561db0be6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.663+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561db0b328f0 con 0x561db0be3e60 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.663+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561db0ae02e0 con 0x561db0bdf090 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.663+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561db0b2e820 con 0x561db0bde750 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.663+0000 7fc51658c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bde750 0x561db0bdeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51658c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bde750 0x561db0bdeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48040/0 (socket says 10.20.193.28:48040) 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51658c640 1 -- 10.20.193.28:0/2845404986 learned_addr learned my addr 10.20.193.28:0/2845404986 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc4feffd640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4ec0b0e20 0x7fc4ec0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc515d8b640 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0be3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc4feffd640 1 -- 10.20.193.28:0/439631618 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fc5001052e0 con 0x7fc5101026b0 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51558a640 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 0x561db0be6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51658c640 1 -- 10.20.193.28:0/2845404986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 msgr2=0x561db0be3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51658c640 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0be3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51658c640 1 -- 10.20.193.28:0/2845404986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 msgr2=0x561db0be6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51658c640 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 0x561db0be6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51658c640 1 -- 10.20.193.28:0/2845404986 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561db0ad25a0 con 0x561db0bde750 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc515d8b640 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0be3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51558a640 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 0x561db0be6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.664+0000 7fc51658c640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4ec0b0e20 0x7fc4ec0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc51658c640 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bde750 0x561db0bdeb50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00e5c0 tx=0x7fc50c00ea90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e9bb20e852151ed server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc51658c640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4ec0b0e20 0x7fc4ec0b32e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc50c01f000 tx=0x7fc50c01c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc4de3ff640 1 -- 10.20.193.28:0/2845404986 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c019040 con 0x561db0bde750 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc4de3ff640 1 -- 10.20.193.28:0/2845404986 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc50c020dc0 con 0x561db0bde750 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2845404986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bde750 msgr2=0x561db0bdeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bde750 0x561db0bdeb50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc50c00e5c0 tx=0x7fc50c00ea90 comp rx=0 tx=0).stop 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2845404986 shutdown_connections 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 0x561db0be6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0be3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/2845404986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bde750 0x561db0bdeb50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.665+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2845404986 >> 10.20.193.28:0/2845404986 conn(0x561db0bd96f0 msgr2=0x561db0be8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.666+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2845404986 shutdown_connections 2026-02-20T03:25:45.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.666+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2845404986 wait complete. 2026-02-20T03:25:45.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.667+0000 7fc51ae71e00 1 -- start start 2026-02-20T03:25:45.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.667+0000 7fc51ae71e00 1 Processor -- start 2026-02-20T03:25:45.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.667+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.667+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bdf090 0x561db0c0bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.667+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 0x561db0c12ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.667+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561db0ada0c0 con 0x561db0be3e60 2026-02-20T03:25:45.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.667+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561db0bfbab0 con 0x561db0bde750 2026-02-20T03:25:45.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.667+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561db0c13470 con 0x561db0bdf090 2026-02-20T03:25:45.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc515d8b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc515d8b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:40954/0 (socket says 10.20.193.28:40954) 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc515d8b640 1 -- 10.20.193.28:0/3673643078 learned_addr learned my addr 10.20.193.28:0/3673643078 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc51558a640 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bdf090 0x561db0c0bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc51658c640 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 0x561db0c12ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc515d8b640 1 -- 10.20.193.28:0/3673643078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bdf090 msgr2=0x561db0c0bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc515d8b640 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bdf090 0x561db0c0bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc515d8b640 1 -- 10.20.193.28:0/3673643078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 msgr2=0x561db0c12ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc515d8b640 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 0x561db0c12ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc515d8b640 1 -- 10.20.193.28:0/3673643078 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561db0c05460 con 0x561db0bde750 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc515d8b640 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0ba20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc5000386a0 tx=0x7fc500038ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b77ef0c17fe765d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc4cb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/3673643078 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000ccd90 con 0x561db0bde750 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/3673643078 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc500033030 con 0x561db0bde750 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/3673643078 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000cc4e0 con 0x561db0bde750 2026-02-20T03:25:45.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.668+0000 7fc51ae71e00 1 -- 10.20.193.28:0/3673643078 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561db0aee820 con 0x561db0bde750 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/3673643078 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fc5000b91b0 con 0x561db0bde750 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 10 client.27410 _ll_register_callbacks cb 0x561db0addff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 1 -- 10.20.193.28:0/3673643078 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561db0b3a4e0 con 0x561db0bde750 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/3673643078 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc5000cc6c0 con 0x561db0bde750 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 10 client.27410 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 1 -- 10.20.193.28:0/3673643078 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561db0af3380 con 0x561db0bde750 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/3673643078 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc5000e4070 con 0x561db0bde750 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 10 client.27410 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 10 client.27410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 20 client.27410 populate_metadata read hostname 'trial028' 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561db0c17800 0x561db0c19cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 4 client.27410 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51ae71e00 1 -- 10.20.193.28:0/3673643078 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561db0ab4bd0 con 0x561db0c17800 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.669+0000 7fc51558a640 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561db0c17800 0x561db0c19cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.670+0000 7fc51558a640 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561db0c17800 0x561db0c19cc0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d661a3e2ef19f502 server_cookie=f0dcc5ad18fc7435 in_seq=0 out_seq=0 2026-02-20T03:25:45.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.670+0000 7fc4cb7fe640 10 client.27410 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/3673643078 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561db0ab4bd0 con 0x561db0c17800 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc4cb7fe640 10 client.27410 handle_command_reply: tid=0 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 client.27410 shutdown 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 -- 10.20.193.28:0/3673643078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 msgr2=0x561db0c0ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0ba20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc5000386a0 tx=0x7fc500038ca0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 -- 10.20.193.28:0/3673643078 shutdown_connections 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561db0c17800 0x561db0c19cc0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0be3e60 0x561db0c12ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0bdf090 0x561db0c0bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/3673643078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0ba20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 -- 10.20.193.28:0/3673643078 >> 10.20.193.28:0/3673643078 conn(0x561db0bd96f0 msgr2=0x561db0be8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc4cb7fe640 0 client.27410 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 -- 10.20.193.28:0/3673643078 shutdown_connections 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 1 -- 10.20.193.28:0/3673643078 wait complete. 2026-02-20T03:25:45.677 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.671+0000 7fc51ae71e00 20 client.27410 trim_cache size 0 max 16384 2026-02-20T03:25:45.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.678+0000 7fc51ae71e00 1 Processor -- start 2026-02-20T03:25:45.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.678+0000 7fc51ae71e00 1 -- start start 2026-02-20T03:25:45.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.678+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.678+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bdf090 0x561db0c0a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.678+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 0x561db0c12ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.678+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc012620 con 0x561db0bdf090 2026-02-20T03:25:45.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.678+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc00fef0 con 0x561db0bde750 2026-02-20T03:25:45.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.678+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc00dd40 con 0x561db0be3e60 2026-02-20T03:25:45.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc515d8b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc515d8b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:40970/0 (socket says 10.20.193.28:40970) 2026-02-20T03:25:45.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc51558a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bdf090 0x561db0c0a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc515d8b640 1 -- 10.20.193.28:0/2298951979 learned_addr learned my addr 10.20.193.28:0/2298951979 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc51658c640 1 --2- 10.20.193.28:0/2298951979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 0x561db0c12ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc515d8b640 1 -- 10.20.193.28:0/2298951979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 msgr2=0x561db0c12ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc515d8b640 1 --2- 10.20.193.28:0/2298951979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 0x561db0c12ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc515d8b640 1 -- 10.20.193.28:0/2298951979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bdf090 msgr2=0x561db0c0a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc515d8b640 1 --2- 10.20.193.28:0/2298951979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bdf090 0x561db0c0a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc515d8b640 1 -- 10.20.193.28:0/2298951979 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561db0c05290 con 0x561db0bde750 2026-02-20T03:25:45.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc515d8b640 1 --2- 10.20.193.28:0/2298951979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0a1c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc5000c9310 tx=0x7fc5000d3000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca6f6a2f87b82d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc4ddbfe640 1 -- 10.20.193.28:0/2298951979 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000cc4e0 con 0x561db0bde750 2026-02-20T03:25:45.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc4ddbfe640 1 -- 10.20.193.28:0/2298951979 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc500033050 con 0x561db0bde750 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc4ddbfe640 1 -- 10.20.193.28:0/2298951979 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5000ccd90 con 0x561db0bde750 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2298951979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 msgr2=0x561db0c0a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.679+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/2298951979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0a1c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc5000c9310 tx=0x7fc5000d3000 comp rx=0 tx=0).stop 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2298951979 shutdown_connections 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/2298951979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 0x561db0c12ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/2298951979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bdf090 0x561db0c0a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/2298951979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bde750 0x561db0c0a1c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2298951979 >> 10.20.193.28:0/2298951979 conn(0x561db0bd96f0 msgr2=0x561db0c09ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2298951979 shutdown_connections 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 -- 10.20.193.28:0/2298951979 wait complete. 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 -- start start 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 Processor -- start 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bde750 0x561db0c129a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0c12ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 0x561db0c11060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.685 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc00e3b0 con 0x561db0bde750 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc00f820 con 0x561db0bdf090 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.680+0000 7fc51ae71e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc00ea80 con 0x561db0be3e60 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc515d8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bde750 0x561db0c129a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51558a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0c12ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc515d8b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bde750 0x561db0c129a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53806/0 (socket says 10.20.193.28:53806) 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51558a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0c12ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:40976/0 (socket says 10.20.193.28:40976) 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc515d8b640 1 -- 10.20.193.28:0/1676718677 learned_addr learned my addr 10.20.193.28:0/1676718677 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51658c640 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 0x561db0c11060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51558a640 1 -- 10.20.193.28:0/1676718677 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 msgr2=0x561db0c11060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51558a640 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 0x561db0c11060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51558a640 1 -- 10.20.193.28:0/1676718677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bde750 msgr2=0x561db0c129a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51558a640 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bde750 0x561db0c129a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51558a640 1 -- 10.20.193.28:0/1676718677 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561db0892690 con 0x561db0bdf090 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51558a640 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0c12ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561db0c1a540 tx=0x7fc504009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f7e645d47e53d7c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc4cb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:25:45.686 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/1676718677 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504027070 con 0x561db0bdf090 2026-02-20T03:25:45.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/1676718677 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc50400fac0 con 0x561db0bdf090 2026-02-20T03:25:45.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/1676718677 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504022a20 con 0x561db0bdf090 2026-02-20T03:25:45.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.681+0000 7fc51ae71e00 1 -- 10.20.193.28:0/1676718677 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561db0af7b70 con 0x561db0bdf090 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/1676718677 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fc50402b3b0 con 0x561db0bdf090 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc4cb7fe640 10 client.27416 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 10 client.27416 _ll_register_callbacks cb 0x7fc500009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 1 -- 10.20.193.28:0/1676718677 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc50c020dc0 con 0x561db0bdf090 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/1676718677 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc50400fc70 con 0x561db0bdf090 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 10 client.27416 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 1 -- 10.20.193.28:0/1676718677 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561db0c05f80 con 0x561db0bdf090 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/1676718677 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc504022bc0 con 0x561db0bdf090 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 10 client.27416 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 10 client.27416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 20 client.27416 populate_metadata read hostname 'trial028' 2026-02-20T03:25:45.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561db0c837f0 0x561db0c85cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 4 client.27416 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:25:45.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.682+0000 7fc51ae71e00 1 -- 10.20.193.28:0/1676718677 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561db0b036b0 con 0x561db0c837f0 2026-02-20T03:25:45.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.683+0000 7fc515d8b640 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561db0c837f0 0x561db0c85cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.683+0000 7fc515d8b640 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561db0c837f0 0x561db0c85cb0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85b388af04d96446 server_cookie=78903775a6132e06 in_seq=0 out_seq=0 2026-02-20T03:25:45.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.683+0000 7fc4cb7fe640 10 client.27416 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:45.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.739+0000 7fdd67577640 1 -- 10.20.193.28:0/42326192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68101670 msgr2=0x7fdd68101a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.740+0000 7fdd67577640 1 --2- 10.20.193.28:0/42326192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68101670 0x7fdd68101a50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009a30 tx=0x7fdd5c02f2b0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.740+0000 7fdd67577640 1 -- 10.20.193.28:0/42326192 shutdown_connections 2026-02-20T03:25:45.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.740+0000 7fdd67577640 1 --2- 10.20.193.28:0/42326192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd68106a80 0x7fdd68106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.740+0000 7fdd67577640 1 --2- 10.20.193.28:0/42326192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd68101f90 0x7fdd68106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.740+0000 7fdd67577640 1 --2- 10.20.193.28:0/42326192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68101670 0x7fdd68101a50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.740+0000 7fdd67577640 1 -- 10.20.193.28:0/42326192 >> 10.20.193.28:0/42326192 conn(0x7fdd680fd2e0 msgr2=0x7fdd680ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.740+0000 7fdd67577640 1 -- 10.20.193.28:0/42326192 shutdown_connections 2026-02-20T03:25:45.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.741+0000 7fdd67577640 1 -- 10.20.193.28:0/42326192 wait complete. 2026-02-20T03:25:45.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.741+0000 7fdd67577640 1 Processor -- start 2026-02-20T03:25:45.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.742+0000 7fdd67577640 1 -- start start 2026-02-20T03:25:45.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.742+0000 7fdd67577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd68101670 0x7fdd68110a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd67577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd68101f90 0x7fdd68110f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd67577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68106a80 0x7fdd68109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd67577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd681190a0 con 0x7fdd68101f90 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd67577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68118f20 con 0x7fdd68101670 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd67577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdd68119220 con 0x7fdd68106a80 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd66d76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68106a80 0x7fdd68109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd66d76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68106a80 0x7fdd68109b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48074/0 (socket says 10.20.193.28:48074) 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd66d76640 1 -- 10.20.193.28:0/880075112 learned_addr learned my addr 10.20.193.28:0/880075112 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd65d74640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd68101f90 0x7fdd68110f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd66d76640 1 -- 10.20.193.28:0/880075112 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd68101670 msgr2=0x7fdd68110a20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd66d76640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd68101670 0x7fdd68110a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd66d76640 1 -- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd68101f90 msgr2=0x7fdd68110f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd66d76640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd68101f90 0x7fdd68110f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.743+0000 7fdd66d76640 1 -- 10.20.193.28:0/880075112 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6810a440 con 0x7fdd68106a80 2026-02-20T03:25:45.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.744+0000 7fdd66d76640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68106a80 0x7fdd68109b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdd58007ee0 tx=0x7fdd5800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.744+0000 7fdd577fe640 1 -- 10.20.193.28:0/880075112 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58002a60 con 0x7fdd68106a80 2026-02-20T03:25:45.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.744+0000 7fdd577fe640 1 -- 10.20.193.28:0/880075112 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdd58002c00 con 0x7fdd68106a80 2026-02-20T03:25:45.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.744+0000 7fdd577fe640 1 -- 10.20.193.28:0/880075112 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58013850 con 0x7fdd68106a80 2026-02-20T03:25:45.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.744+0000 7fdd67577640 1 -- 10.20.193.28:0/880075112 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6810a6d0 con 0x7fdd68106a80 2026-02-20T03:25:45.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.745+0000 7fdd67577640 1 -- 10.20.193.28:0/880075112 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6810e720 con 0x7fdd68106a80 2026-02-20T03:25:45.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.757+0000 7fdd577fe640 1 -- 10.20.193.28:0/880075112 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fdd58012070 con 0x7fdd68106a80 2026-02-20T03:25:45.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.759+0000 7fdd577fe640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd400b0e20 0x7fdd400b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.759+0000 7fdd577fe640 1 -- 10.20.193.28:0/880075112 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fdd580e02d0 con 0x7fdd68106a80 2026-02-20T03:25:45.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.760+0000 7fdd66575640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd400b0e20 0x7fdd400b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.760+0000 7fdd66575640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd400b0e20 0x7fdd400b32e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c005d20 tx=0x7fdd5c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.762+0000 7fdd6f00de00 1 Processor -- start 2026-02-20T03:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.762+0000 7fdd6f00de00 1 -- start start 2026-02-20T03:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c339390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c3335e0 0x55570c333a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c333f60 0x55570c33fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55570c2b3e00 con 0x55570c338fb0 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55570c286970 con 0x55570c333f60 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55570c2341f0 con 0x55570c3335e0 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd66d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c333f60 0x55570c33fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd66d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c333f60 0x55570c33fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41002/0 (socket says 10.20.193.28:41002) 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd66575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c339390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd66d76640 1 -- 10.20.193.28:0/567256823 learned_addr learned my addr 10.20.193.28:0/567256823 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd65d74640 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c3335e0 0x55570c333a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd66575640 1 -- 10.20.193.28:0/567256823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c3335e0 msgr2=0x55570c333a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.763+0000 7fc4cb7fe640 1 -- 10.20.193.28:0/1676718677 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561db0b036b0 con 0x561db0c837f0 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.763+0000 7fc4cb7fe640 10 client.27416 handle_command_reply: tid=0 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 client.27416 shutdown 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 -- 10.20.193.28:0/1676718677 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 msgr2=0x561db0c12ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0c12ee0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x561db0c1a540 tx=0x7fc504009da0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 -- 10.20.193.28:0/1676718677 shutdown_connections 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561db0c837f0 0x561db0c85cb0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561db0be3e60 0x561db0c11060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561db0bdf090 0x561db0c12ee0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 --2- 10.20.193.28:0/1676718677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561db0bde750 0x561db0c129a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc4cb7fe640 0 client.27416 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:45.767 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 -- 10.20.193.28:0/1676718677 >> 10.20.193.28:0/1676718677 conn(0x561db0bd96f0 msgr2=0x561db0c0a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.763+0000 7fdd66575640 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c3335e0 0x55570c333a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.764+0000 7fdd66575640 1 -- 10.20.193.28:0/567256823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c333f60 msgr2=0x55570c33fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.764+0000 7fdd66575640 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c333f60 0x55570c33fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.764+0000 7fdd66575640 1 -- 10.20.193.28:0/567256823 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55570c2473d0 con 0x55570c338fb0 2026-02-20T03:25:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 -- 10.20.193.28:0/1676718677 shutdown_connections 2026-02-20T03:25:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 1 -- 10.20.193.28:0/1676718677 wait complete. 2026-02-20T03:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.764+0000 7fdd66d76640 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c333f60 0x55570c33fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:45.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.764+0000 7fdd65d74640 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c3335e0 0x55570c333a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.764+0000 7fc51ae71e00 20 client.27416 trim_cache size 0 max 16384 2026-02-20T03:25:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:25:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:25:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:25:45.768 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.764+0000 7fdd66575640 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c339390 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009a00 tx=0x7fdd5c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464c43b858b409e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 -- 10.20.193.28:0/439631618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4ec0b0e20 msgr2=0x7fc4ec0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4ec0b0e20 0x7fc4ec0b32e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc50c01f000 tx=0x7fc50c01c000 comp rx=0 tx=0).stop 2026-02-20T03:25:45.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 -- 10.20.193.28:0/439631618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 msgr2=0x7fc51019ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 0x7fc51019ca30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc500005a40 tx=0x7fc500002f90 comp rx=0 tx=0).stop 2026-02-20T03:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.765+0000 7fdd54cf3640 1 -- 10.20.193.28:0/567256823 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c03d070 con 0x55570c338fb0 2026-02-20T03:25:45.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.765+0000 7fdd54cf3640 1 -- 10.20.193.28:0/567256823 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdd5c033040 con 0x55570c338fb0 2026-02-20T03:25:45.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 -- 10.20.193.28:0/439631618 shutdown_connections 2026-02-20T03:25:45.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc4ec0b0e20 0x7fc4ec0b32e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc510104260 0x7fc5101a3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5101038a0 0x7fc51019cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 --2- 10.20.193.28:0/439631618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5101026b0 0x7fc51019ca30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 -- 10.20.193.28:0/439631618 >> 10.20.193.28:0/439631618 conn(0x7fc5100fde10 msgr2=0x7fc510109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 -- 10.20.193.28:0/439631618 shutdown_connections 2026-02-20T03:25:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.765+0000 7fdd54cf3640 1 -- 10.20.193.28:0/567256823 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c039c00 con 0x55570c338fb0 2026-02-20T03:25:45.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:45.765+0000 7fc516d8d640 1 -- 10.20.193.28:0/439631618 wait complete. 2026-02-20T03:25:45.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.766+0000 7fdd6f00de00 1 -- 10.20.193.28:0/567256823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 msgr2=0x55570c339390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.766+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c339390 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009a00 tx=0x7fdd5c03d000 comp rx=0 tx=0).stop 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.766+0000 7fdd6f00de00 1 -- 10.20.193.28:0/567256823 shutdown_connections 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.766+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c333f60 0x55570c33fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.766+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c3335e0 0x55570c333a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.766+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/567256823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c339390 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.766+0000 7fdd6f00de00 1 -- 10.20.193.28:0/567256823 >> 10.20.193.28:0/567256823 conn(0x55570c2f6240 msgr2=0x55570c331ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.766+0000 7fdd6f00de00 1 -- 10.20.193.28:0/567256823 shutdown_connections 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.766+0000 7fdd6f00de00 1 -- 10.20.193.28:0/567256823 wait complete. 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.768+0000 7fdd6f00de00 1 -- start start 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.769+0000 7fdd6f00de00 1 Processor -- start 2026-02-20T03:25:45.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.769+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c34ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.769+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c34e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.769+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c34c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.769+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55570c2828a0 con 0x55570c3335e0 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.769+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55570c074f50 con 0x55570c338fb0 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.769+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55570c34cc90 con 0x55570c333f60 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd66575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c34ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd66575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c34ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53842/0 (socket says 10.20.193.28:53842) 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd66d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c34c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd65d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c34e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd65d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c34e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:48080/0 (socket says 10.20.193.28:48080) 2026-02-20T03:25:45.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd65d74640 1 -- 10.20.193.28:0/2061899159 learned_addr learned my addr 10.20.193.28:0/2061899159 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd66575640 1 -- 10.20.193.28:0/2061899159 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 msgr2=0x55570c34e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd66575640 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c34e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd66575640 1 -- 10.20.193.28:0/2061899159 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 msgr2=0x55570c34c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd66575640 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c34c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd66575640 1 -- 10.20.193.28:0/2061899159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55570c345930 con 0x55570c3335e0 2026-02-20T03:25:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd66575640 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c34ddd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009a00 tx=0x7fdd5c004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f27c3f7fac847f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.770+0000 7fdd17fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.771+0000 7fdd17fff640 1 -- 10.20.193.28:0/2061899159 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c039880 con 0x55570c3335e0 2026-02-20T03:25:45.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.771+0000 7fdd17fff640 1 -- 10.20.193.28:0/2061899159 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdd5c059070 con 0x55570c3335e0 2026-02-20T03:25:45.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.771+0000 7fdd17fff640 1 -- 10.20.193.28:0/2061899159 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c041c90 con 0x55570c3335e0 2026-02-20T03:25:45.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.771+0000 7fdd6f00de00 1 -- 10.20.193.28:0/2061899159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55570c057b40 con 0x55570c3335e0 2026-02-20T03:25:45.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.771+0000 7fdd17fff640 1 -- 10.20.193.28:0/2061899159 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fdd5c05d410 con 0x55570c3335e0 2026-02-20T03:25:45.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.771+0000 7fdd17fff640 10 client.18390 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:25:45.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.771+0000 7fdd6f00de00 10 client.18390 _ll_register_callbacks cb 0x55570c2bfeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:45.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd6f00de00 1 -- 10.20.193.28:0/2061899159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55570c294150 con 0x55570c3335e0 2026-02-20T03:25:45.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd17fff640 1 -- 10.20.193.28:0/2061899159 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdd5c03d030 con 0x55570c3335e0 2026-02-20T03:25:45.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd6f00de00 10 client.18390 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:45.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd6f00de00 1 -- 10.20.193.28:0/2061899159 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55570c2411e0 con 0x55570c3335e0 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd17fff640 1 -- 10.20.193.28:0/2061899159 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fdd5c041420 con 0x55570c3335e0 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd6f00de00 10 client.18390 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd6f00de00 10 client.18390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd6f00de00 20 client.18390 populate_metadata read hostname 'trial028' 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55570c35c170 0x55570c35e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd6f00de00 4 client.18390 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd6f00de00 1 -- 10.20.193.28:0/2061899159 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55570c28e560 con 0x55570c35c170 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.772+0000 7fdd65d74640 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55570c35c170 0x55570c35e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.773+0000 7fdd65d74640 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55570c35c170 0x55570c35e560 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d597d89bf1bfdcad server_cookie=89c0a5b8667fa9ad in_seq=0 out_seq=0 2026-02-20T03:25:45.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.773+0000 7fdd17fff640 10 client.18390 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd17fff640 1 -- 10.20.193.28:0/2061899159 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55570c28e560 con 0x55570c35c170 2026-02-20T03:25:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd17fff640 10 client.18390 handle_command_reply: tid=0 2026-02-20T03:25:45.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd6f00de00 1 client.18390 shutdown 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd6f00de00 1 -- 10.20.193.28:0/2061899159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 msgr2=0x55570c34ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c34ddd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009a00 tx=0x7fdd5c004320 comp rx=0 tx=0).stop 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd6f00de00 1 -- 10.20.193.28:0/2061899159 shutdown_connections 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55570c35c170 0x55570c35e560 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c34c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c34e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/2061899159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c34ddd0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd6f00de00 1 -- 10.20.193.28:0/2061899159 >> 10.20.193.28:0/2061899159 conn(0x55570c2f6240 msgr2=0x55570c3323f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.774+0000 7fdd17fff640 0 client.18390 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.775+0000 7fdd6f00de00 1 -- 10.20.193.28:0/2061899159 shutdown_connections 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.775+0000 7fdd6f00de00 1 -- 10.20.193.28:0/2061899159 wait complete. 2026-02-20T03:25:45.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.775+0000 7fdd6f00de00 20 client.18390 trim_cache size 0 max 16384 2026-02-20T03:25:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.781+0000 7fdd6f00de00 1 Processor -- start 2026-02-20T03:25:45.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd6f00de00 1 -- start start 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c349770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c349cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c3323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c0127b0 con 0x55570c3335e0 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c010080 con 0x55570c338fb0 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c00ded0 con 0x55570c333f60 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd66d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c3323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd66d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c3323f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41014/0 (socket says 10.20.193.28:41014) 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd66d76640 1 -- 10.20.193.28:0/1843941992 learned_addr learned my addr 10.20.193.28:0/1843941992 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd66575640 1 --2- 10.20.193.28:0/1843941992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c349770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd66d76640 1 -- 10.20.193.28:0/1843941992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 msgr2=0x55570c349cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd66d76640 1 --2- 10.20.193.28:0/1843941992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c349cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.782+0000 7fdd66d76640 1 -- 10.20.193.28:0/1843941992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 msgr2=0x55570c349770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.783+0000 7fdd66d76640 1 --2- 10.20.193.28:0/1843941992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c349770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.783+0000 7fdd66d76640 1 -- 10.20.193.28:0/1843941992 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55570c345760 con 0x55570c338fb0 2026-02-20T03:25:45.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.783+0000 7fdd66575640 1 --2- 10.20.193.28:0/1843941992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c349770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:45.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.783+0000 7fdd66d76640 1 --2- 10.20.193.28:0/1843941992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c3323f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdd580a7fa0 tx=0x7fdd580df040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f282d0808a85d189 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.783+0000 7fdd324e6640 1 -- 10.20.193.28:0/1843941992 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd580dde60 con 0x55570c338fb0 2026-02-20T03:25:45.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.783+0000 7fdd324e6640 1 -- 10.20.193.28:0/1843941992 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdd58002db0 con 0x55570c338fb0 2026-02-20T03:25:45.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.783+0000 7fdd324e6640 1 -- 10.20.193.28:0/1843941992 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd580a3990 con 0x55570c338fb0 2026-02-20T03:25:45.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.784+0000 7fdd6f00de00 1 -- 10.20.193.28:0/1843941992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 msgr2=0x55570c3323f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.784+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/1843941992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c3323f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdd580a7fa0 tx=0x7fdd580df040 comp rx=0 tx=0).stop 2026-02-20T03:25:45.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.784+0000 7fdd6f00de00 1 -- 10.20.193.28:0/1843941992 shutdown_connections 2026-02-20T03:25:45.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.784+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/1843941992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c338fb0 0x55570c3323f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.784+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/1843941992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c349cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.784+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/1843941992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c3335e0 0x55570c349770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.784+0000 7fdd6f00de00 1 -- 10.20.193.28:0/1843941992 >> 10.20.193.28:0/1843941992 conn(0x55570c2f6240 msgr2=0x55570c331ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.784+0000 7fdd6f00de00 1 -- 10.20.193.28:0/1843941992 shutdown_connections 2026-02-20T03:25:45.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.784+0000 7fdd6f00de00 1 -- 10.20.193.28:0/1843941992 wait complete. 2026-02-20T03:25:45.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.785+0000 7fdd6f00de00 1 -- start start 2026-02-20T03:25:45.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.785+0000 7fdd6f00de00 1 Processor -- start 2026-02-20T03:25:45.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.785+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c3335e0 0x55570c3542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.785+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c350580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.785+0000 7fdd6f00de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c350ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.785+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c00e540 con 0x55570c338fb0 2026-02-20T03:25:45.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.785+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c00f9b0 con 0x55570c3335e0 2026-02-20T03:25:45.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.785+0000 7fdd6f00de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c00ec10 con 0x55570c333f60 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c3335e0 0x55570c3542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd65d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c350580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c3335e0 0x55570c3542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41030/0 (socket says 10.20.193.28:41030) 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66575640 1 -- 10.20.193.28:0/918759059 learned_addr learned my addr 10.20.193.28:0/918759059 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66d76640 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c350ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66575640 1 -- 10.20.193.28:0/918759059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 msgr2=0x55570c350580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66575640 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c350580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66575640 1 -- 10.20.193.28:0/918759059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 msgr2=0x55570c350ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66575640 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c350ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66575640 1 -- 10.20.193.28:0/918759059 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55570bf65870 con 0x55570c3335e0 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66d76640 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c350ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd66575640 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c3335e0 0x55570c3542b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c039db0 tx=0x7fdd5c045020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2a1366f81ab0a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd17fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd17fff640 1 -- 10.20.193.28:0/918759059 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c06d070 con 0x55570c3335e0 2026-02-20T03:25:45.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd17fff640 1 -- 10.20.193.28:0/918759059 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdd5c059070 con 0x55570c3335e0 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd17fff640 1 -- 10.20.193.28:0/918759059 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c041ce0 con 0x55570c3335e0 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.786+0000 7fdd6f00de00 1 -- 10.20.193.28:0/918759059 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55570c2263f0 con 0x55570c3335e0 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 10 client.27428 _ll_register_callbacks cb 0x7fdd58004840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 1 -- 10.20.193.28:0/918759059 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55570c238ab0 con 0x55570c3335e0 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd17fff640 1 -- 10.20.193.28:0/918759059 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fdd5c041420 con 0x55570c3335e0 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd17fff640 1 -- 10.20.193.28:0/918759059 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdd5c004320 con 0x55570c3335e0 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 10 client.27428 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 1 -- 10.20.193.28:0/918759059 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55570c346450 con 0x55570c3335e0 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd17fff640 1 -- 10.20.193.28:0/918759059 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fdd5c068420 con 0x55570c3335e0 2026-02-20T03:25:45.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 10 client.27428 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 10 client.27428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 20 client.27428 populate_metadata read hostname 'trial028' 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55570c3c7b10 0x55570c3c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 4 client.27428 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd6f00de00 1 -- 10.20.193.28:0/918759059 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fdd58002db0 con 0x55570c3c7b10 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.787+0000 7fdd65d74640 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55570c3c7b10 0x55570c3c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.788+0000 7fdd65d74640 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55570c3c7b10 0x55570c3c9fd0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43d7898ce7b1f44c server_cookie=d520f41478707688 in_seq=0 out_seq=0 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.788+0000 7fdd17fff640 10 client.27428 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd17fff640 1 -- 10.20.193.28:0/918759059 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fdd58002db0 con 0x55570c3c7b10 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd17fff640 10 client.27428 handle_command_reply: tid=0 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 client.27428 shutdown 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 -- 10.20.193.28:0/918759059 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c3335e0 msgr2=0x55570c3542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c3335e0 0x55570c3542b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c039db0 tx=0x7fdd5c045020 comp rx=0 tx=0).stop 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 -- 10.20.193.28:0/918759059 shutdown_connections 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55570c3c7b10 0x55570c3c9fd0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55570c338fb0 0x55570c350ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55570c333f60 0x55570c350580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 --2- 10.20.193.28:0/918759059 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55570c3335e0 0x55570c3542b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd17fff640 0 client.27428 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 -- 10.20.193.28:0/918759059 >> 10.20.193.28:0/918759059 conn(0x55570c2f6240 msgr2=0x55570c3323f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 -- 10.20.193.28:0/918759059 shutdown_connections 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 1 -- 10.20.193.28:0/918759059 wait complete. 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd6f00de00 20 client.27428 trim_cache size 0 max 16384 2026-02-20T03:25:45.792 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd67577640 1 -- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd400b0e20 msgr2=0x7fdd400b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd67577640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd400b0e20 0x7fdd400b32e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c005d20 tx=0x7fdd5c005c70 comp rx=0 tx=0).stop 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd67577640 1 -- 10.20.193.28:0/880075112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68106a80 msgr2=0x7fdd68109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.789+0000 7fdd67577640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68106a80 0x7fdd68109b80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdd58007ee0 tx=0x7fdd5800d4a0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.790+0000 7fdd67577640 1 -- 10.20.193.28:0/880075112 shutdown_connections 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.790+0000 7fdd67577640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd400b0e20 0x7fdd400b32e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.790+0000 7fdd67577640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd68106a80 0x7fdd68109b80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.790+0000 7fdd67577640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd68101f90 0x7fdd68110f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.790+0000 7fdd67577640 1 --2- 10.20.193.28:0/880075112 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd68101670 0x7fdd68110a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.790+0000 7fdd67577640 1 -- 10.20.193.28:0/880075112 >> 10.20.193.28:0/880075112 conn(0x7fdd680fd2e0 msgr2=0x7fdd681043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.790+0000 7fdd67577640 1 -- 10.20.193.28:0/880075112 shutdown_connections 2026-02-20T03:25:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:45.790+0000 7fdd67577640 1 -- 10.20.193.28:0/880075112 wait complete. 2026-02-20T03:25:46.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 959598 8.16 MB/sec execute 439 sec latency 148.065 ms 2026-02-20T03:25:46.892 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:25:46.892 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:25:47.196 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:47.222 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:47 trial028 ceph-mon[38552]: pgmap v515: 129 pgs: 129 active+clean; 146 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 602 KiB/s rd, 3.3 MiB/s wr, 302 op/s 2026-02-20T03:25:47.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.382+0000 7f2949519640 1 -- 10.20.193.28:0/1462825457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2944105320 msgr2=0x7f2944111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.382+0000 7f2949519640 1 --2- 10.20.193.28:0/1462825457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2944105320 0x7f2944111850 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f293800b0d0 tx=0x7f293802f450 comp rx=0 tx=0).stop 2026-02-20T03:25:47.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.382+0000 7f2949519640 1 -- 10.20.193.28:0/1462825457 shutdown_connections 2026-02-20T03:25:47.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.382+0000 7f2949519640 1 --2- 10.20.193.28:0/1462825457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2944105320 0x7f2944111850 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.382+0000 7f2949519640 1 --2- 10.20.193.28:0/1462825457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2944104980 0x7f2944104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.382+0000 7f2949519640 1 --2- 10.20.193.28:0/1462825457 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f294410a980 0x7f294410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.382+0000 7f2949519640 1 -- 10.20.193.28:0/1462825457 >> 10.20.193.28:0/1462825457 conn(0x7f2944100680 msgr2=0x7f2944102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.382+0000 7f2949519640 1 -- 10.20.193.28:0/1462825457 shutdown_connections 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.382+0000 7f2949519640 1 -- 10.20.193.28:0/1462825457 wait complete. 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.383+0000 7f2949519640 1 Processor -- start 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.383+0000 7f2949519640 1 -- start start 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.383+0000 7f2949519640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2944104980 0x7f29441115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2949519640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2944105320 0x7f294410e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2949519640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f294410a980 0x7f294410ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2949519640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2944114bf0 con 0x7f2944104980 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2949519640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2944114a70 con 0x7f294410a980 2026-02-20T03:25:47.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2949519640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2944114d70 con 0x7f2944105320 2026-02-20T03:25:47.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2948d18640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f294410a980 0x7f294410ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f29437fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2944105320 0x7f294410e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2943fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2944104980 0x7f29441115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2948d18640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f294410a980 0x7f294410ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44066/0 (socket says 10.20.193.28:44066) 2026-02-20T03:25:47.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2948d18640 1 -- 10.20.193.28:0/3611303702 learned_addr learned my addr 10.20.193.28:0/3611303702 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:47.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2948d18640 1 -- 10.20.193.28:0/3611303702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2944105320 msgr2=0x7f294410e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2948d18640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2944105320 0x7f294410e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2948d18640 1 -- 10.20.193.28:0/3611303702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2944104980 msgr2=0x7f29441115f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2948d18640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2944104980 0x7f29441115f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.384+0000 7f2948d18640 1 -- 10.20.193.28:0/3611303702 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294410f4a0 con 0x7f294410a980 2026-02-20T03:25:47.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.385+0000 7f2948d18640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f294410a980 0x7f294410ebe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2938032040 tx=0x7f2938009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.385+0000 7f29417fa640 1 -- 10.20.193.28:0/3611303702 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29380044b0 con 0x7f294410a980 2026-02-20T03:25:47.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.385+0000 7f2949519640 1 -- 10.20.193.28:0/3611303702 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29441adb10 con 0x7f294410a980 2026-02-20T03:25:47.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.385+0000 7f2949519640 1 -- 10.20.193.28:0/3611303702 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29441ae020 con 0x7f294410a980 2026-02-20T03:25:47.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.385+0000 7f29417fa640 1 -- 10.20.193.28:0/3611303702 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2938004650 con 0x7f294410a980 2026-02-20T03:25:47.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.385+0000 7f29417fa640 1 -- 10.20.193.28:0/3611303702 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2938038680 con 0x7f294410a980 2026-02-20T03:25:47.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.387+0000 7f29417fa640 1 -- 10.20.193.28:0/3611303702 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f29380076a0 con 0x7f294410a980 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f294cca7e00 1 Processor -- start 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f294cca7e00 1 -- start start 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230254a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23025a70 0x556e23029540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23029b60 0x556e23029fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f294cca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556e22f77c00 con 0x556e230250c0 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f294cca7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556e22f253c0 con 0x556e23029b60 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f294cca7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556e22f73b30 con 0x556e23025a70 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f29437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230254a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f29437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230254a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44024/0 (socket says 10.20.193.28:44024) 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.388+0000 7f29437fe640 1 -- 10.20.193.28:0/1635964653 learned_addr learned my addr 10.20.193.28:0/1635964653 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f29437fe640 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23029b60 0x556e23029fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f2943fff640 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23025a70 0x556e23029540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f29437fe640 1 -- 10.20.193.28:0/1635964653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23025a70 msgr2=0x556e23029540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f29437fe640 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23025a70 0x556e23029540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f29437fe640 1 -- 10.20.193.28:0/1635964653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23029b60 msgr2=0x556e23029fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f29437fe640 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23029b60 0x556e23029fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f29437fe640 1 -- 10.20.193.28:0/1635964653 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e22f1e840 con 0x556e230250c0 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f29417fa640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29180b0da0 0x7f29180b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f29437fe640 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230254a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2934012800 tx=0x7f29340073d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa874c94274ff38b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f29417fa640 1 -- 10.20.193.28:0/3611303702 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f29381052f0 con 0x7f294410a980 2026-02-20T03:25:47.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f2914ce3640 1 -- 10.20.193.28:0/1635964653 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934012e60 con 0x556e230250c0 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f2914ce3640 1 -- 10.20.193.28:0/1635964653 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2934004570 con 0x556e230250c0 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f2914ce3640 1 -- 10.20.193.28:0/1635964653 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293400ed10 con 0x556e230250c0 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f294cca7e00 1 -- 10.20.193.28:0/1635964653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 msgr2=0x556e230254a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.389+0000 7f294cca7e00 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230254a0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2934012800 tx=0x7f29340073d0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.390+0000 7f2943fff640 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23025a70 0x556e23029540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.390+0000 7f294cca7e00 1 -- 10.20.193.28:0/1635964653 shutdown_connections 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.390+0000 7f294cca7e00 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23029b60 0x556e23029fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.390+0000 7f294cca7e00 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23025a70 0x556e23029540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.390+0000 7f294cca7e00 1 --2- 10.20.193.28:0/1635964653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230254a0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.390+0000 7f294cca7e00 1 -- 10.20.193.28:0/1635964653 >> 10.20.193.28:0/1635964653 conn(0x556e2301db60 msgr2=0x556e230235e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.390+0000 7f2943fff640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29180b0da0 0x7f29180b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.390+0000 7f294cca7e00 1 -- 10.20.193.28:0/1635964653 shutdown_connections 2026-02-20T03:25:47.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.390+0000 7f294cca7e00 1 -- 10.20.193.28:0/1635964653 wait complete. 2026-02-20T03:25:47.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.391+0000 7f2943fff640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29180b0da0 0x7f29180b3260 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x556e23026090 tx=0x7f29300073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.391+0000 7f294cca7e00 1 -- start start 2026-02-20T03:25:47.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.391+0000 7f294cca7e00 1 Processor -- start 2026-02-20T03:25:47.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e230250c0 0x556e2303dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e23025a70 0x556e2303e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e23049940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f294cca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556e22f1f1a0 con 0x556e23025a70 2026-02-20T03:25:47.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f294cca7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556e23031cb0 con 0x556e230250c0 2026-02-20T03:25:47.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f294cca7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556e23049e80 con 0x556e23029b60 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f29437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e23025a70 0x556e2303e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f2943fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e230250c0 0x556e2303dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f29437fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e23025a70 0x556e2303e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44038/0 (socket says 10.20.193.28:44038) 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f29437fe640 1 -- 10.20.193.28:0/4239444996 learned_addr learned my addr 10.20.193.28:0/4239444996 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f29437fe640 1 -- 10.20.193.28:0/4239444996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 msgr2=0x556e23049940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f29437fe640 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e23049940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f29437fe640 1 -- 10.20.193.28:0/4239444996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e230250c0 msgr2=0x556e2303dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f29437fe640 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e230250c0 0x556e2303dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f29437fe640 1 -- 10.20.193.28:0/4239444996 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e23037440 con 0x556e23025a70 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f29437fe640 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e23025a70 0x556e2303e200 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f293400e9f0 tx=0x7f2934005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65ff9efd4a8e4e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.392+0000 7f2905ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f2905ffb640 1 -- 10.20.193.28:0/4239444996 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934012e60 con 0x556e23025a70 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f2905ffb640 1 -- 10.20.193.28:0/4239444996 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f29340042e0 con 0x556e23025a70 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f2905ffb640 1 -- 10.20.193.28:0/4239444996 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934005050 con 0x556e23025a70 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 1 -- 10.20.193.28:0/4239444996 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e22d46b60 con 0x556e23025a70 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f2905ffb640 1 -- 10.20.193.28:0/4239444996 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f293400ea90 con 0x556e23025a70 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 10 client.18405 _ll_register_callbacks cb 0x556e22f230d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 1 -- 10.20.193.28:0/4239444996 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556e22f7f7f0 con 0x556e23025a70 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f2905ffb640 1 -- 10.20.193.28:0/4239444996 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2934004760 con 0x556e23025a70 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 10 client.18405 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:47.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 1 -- 10.20.193.28:0/4239444996 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x556e22f44430 con 0x556e23025a70 2026-02-20T03:25:47.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f2905ffb640 1 -- 10.20.193.28:0/4239444996 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f293400ec90 con 0x556e23025a70 2026-02-20T03:25:47.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 10 client.18405 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:47.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 10 client.18405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:47.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 20 client.18405 populate_metadata read hostname 'trial028' 2026-02-20T03:25:47.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e2304dbf0 0x556e2304ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 4 client.18405 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:47.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.393+0000 7f294cca7e00 1 -- 10.20.193.28:0/4239444996 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e22ef9c00 con 0x556e2304dbf0 2026-02-20T03:25:47.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.394+0000 7f2943fff640 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e2304dbf0 0x556e2304ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.394+0000 7f2943fff640 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e2304dbf0 0x556e2304ffe0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e3e88cdbe176369 server_cookie=bc351796926de4e5 in_seq=0 out_seq=0 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.394+0000 7f2905ffb640 10 client.18405 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f2905ffb640 1 -- 10.20.193.28:0/4239444996 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556e22ef9c00 con 0x556e2304dbf0 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f2905ffb640 10 client.18405 handle_command_reply: tid=0 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 client.18405 shutdown 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 -- 10.20.193.28:0/4239444996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e23025a70 msgr2=0x556e2303e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e23025a70 0x556e2303e200 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f293400e9f0 tx=0x7f2934005a00 comp rx=0 tx=0).stop 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 -- 10.20.193.28:0/4239444996 shutdown_connections 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e2304dbf0 0x556e2304ffe0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e23049940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e23025a70 0x556e2303e200 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 --2- 10.20.193.28:0/4239444996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e230250c0 0x556e2303dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 -- 10.20.193.28:0/4239444996 >> 10.20.193.28:0/4239444996 conn(0x556e2301db60 msgr2=0x556e23028520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:47.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f2905ffb640 0 client.18405 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:47.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 -- 10.20.193.28:0/4239444996 shutdown_connections 2026-02-20T03:25:47.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 1 -- 10.20.193.28:0/4239444996 wait complete. 2026-02-20T03:25:47.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.395+0000 7f294cca7e00 20 client.18405 trim_cache size 0 max 16384 2026-02-20T03:25:47.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f294cca7e00 1 Processor -- start 2026-02-20T03:25:47.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f294cca7e00 1 -- start start 2026-02-20T03:25:47.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e2302ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 0x556e2302b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e23055830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f294cca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f28e80126e0 con 0x556e230250c0 2026-02-20T03:25:47.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f294cca7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f28e800ffb0 con 0x556e23025a70 2026-02-20T03:25:47.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f294cca7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f28e800de00 con 0x556e23029b60 2026-02-20T03:25:47.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f2943fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e2302ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f2943fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e2302ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44054/0 (socket says 10.20.193.28:44054) 2026-02-20T03:25:47.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f2943fff640 1 -- 10.20.193.28:0/136230967 learned_addr learned my addr 10.20.193.28:0/136230967 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:47.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f29437fe640 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 0x556e2302b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f2948d18640 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e23055830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f2943fff640 1 -- 10.20.193.28:0/136230967 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 msgr2=0x556e23055830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f2943fff640 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e23055830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f2943fff640 1 -- 10.20.193.28:0/136230967 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 msgr2=0x556e2302b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f2943fff640 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 0x556e2302b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f2943fff640 1 -- 10.20.193.28:0/136230967 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e23037270 con 0x556e230250c0 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.404+0000 7f29437fe640 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 0x556e2302b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f2943fff640 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e2302ac20 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x556e230507a0 tx=0x7f2930014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64afc9828eefb6bf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f2907fff640 1 -- 10.20.193.28:0/136230967 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930012450 con 0x556e230250c0 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f2907fff640 1 -- 10.20.193.28:0/136230967 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f293002e070 con 0x556e230250c0 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f2907fff640 1 -- 10.20.193.28:0/136230967 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29300206a0 con 0x556e230250c0 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f294cca7e00 1 -- 10.20.193.28:0/136230967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 msgr2=0x556e2302ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f294cca7e00 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e2302ac20 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x556e230507a0 tx=0x7f2930014000 comp rx=0 tx=0).stop 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f294cca7e00 1 -- 10.20.193.28:0/136230967 shutdown_connections 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f294cca7e00 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e23055830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f294cca7e00 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 0x556e2302b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f294cca7e00 1 --2- 10.20.193.28:0/136230967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e2302ac20 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f294cca7e00 1 -- 10.20.193.28:0/136230967 >> 10.20.193.28:0/136230967 conn(0x556e2301db60 msgr2=0x556e2302a510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:47.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f294cca7e00 1 -- 10.20.193.28:0/136230967 shutdown_connections 2026-02-20T03:25:47.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.405+0000 7f294cca7e00 1 -- 10.20.193.28:0/136230967 wait complete. 2026-02-20T03:25:47.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.406+0000 7f294cca7e00 1 -- start start 2026-02-20T03:25:47.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.406+0000 7f294cca7e00 1 Processor -- start 2026-02-20T03:25:47.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.406+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.406+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 0x556e23044810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.406+0000 7f294cca7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e230b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.406+0000 7f294cca7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f28e800e470 con 0x556e230250c0 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.406+0000 7f294cca7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f28e800f8e0 con 0x556e23025a70 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.406+0000 7f294cca7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f28e800eb40 con 0x556e23029b60 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.406+0000 7f2943fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2948d18640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e230b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2943fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230442d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44062/0 (socket says 10.20.193.28:44062) 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2943fff640 1 -- 10.20.193.28:0/3740862761 learned_addr learned my addr 10.20.193.28:0/3740862761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f29437fe640 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 0x556e23044810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2943fff640 1 -- 10.20.193.28:0/3740862761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 msgr2=0x556e230b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2943fff640 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e230b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2943fff640 1 -- 10.20.193.28:0/3740862761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 msgr2=0x556e23044810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2943fff640 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 0x556e23044810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2943fff640 1 -- 10.20.193.28:0/3740862761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e22c56900 con 0x556e230250c0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2943fff640 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230442d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2930003010 tx=0x7f29300221e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61a8a4bb874ac8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2905ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2905ffb640 1 -- 10.20.193.28:0/3740862761 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930036070 con 0x556e230250c0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2905ffb640 1 -- 10.20.193.28:0/3740862761 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2930016070 con 0x556e230250c0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2905ffb640 1 -- 10.20.193.28:0/3740862761 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930020a00 con 0x556e230250c0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f294cca7e00 1 -- 10.20.193.28:0/3740862761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e22f324d0 con 0x556e230250c0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f2905ffb640 1 -- 10.20.193.28:0/3740862761 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f2930020ba0 con 0x556e230250c0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f294cca7e00 10 client.18411 _ll_register_callbacks cb 0x7f2934007df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.407+0000 7f294cca7e00 1 -- 10.20.193.28:0/3740862761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2934004570 con 0x556e230250c0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f2905ffb640 1 -- 10.20.193.28:0/3740862761 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2930020da0 con 0x556e230250c0 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f294cca7e00 10 client.18411 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:47.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f294cca7e00 1 -- 10.20.193.28:0/3740862761 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x556e23037f60 con 0x556e230250c0 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f2905ffb640 1 -- 10.20.193.28:0/3740862761 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f2930012660 con 0x556e230250c0 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f294cca7e00 10 client.18411 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f294cca7e00 10 client.18411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f294cca7e00 20 client.18411 populate_metadata read hostname 'trial028' 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f294cca7e00 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e230ba750 0x556e230bcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f294cca7e00 4 client.18411 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f294cca7e00 1 -- 10.20.193.28:0/3740862761 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556e22cf82b0 con 0x556e230ba750 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.408+0000 7f29437fe640 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e230ba750 0x556e230bcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.409+0000 7f29437fe640 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e230ba750 0x556e230bcc10 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=520f0aed6af24da server_cookie=1bc6186665bfdf45 in_seq=0 out_seq=0 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.409+0000 7f2905ffb640 10 client.18411 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:47.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f2905ffb640 1 -- 10.20.193.28:0/3740862761 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556e22cf82b0 con 0x556e230ba750 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f2905ffb640 10 client.18411 handle_command_reply: tid=0 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 client.18411 shutdown 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 -- 10.20.193.28:0/3740862761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 msgr2=0x556e230442d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230442d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f2930003010 tx=0x7f29300221e0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 -- 10.20.193.28:0/3740862761 shutdown_connections 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556e230ba750 0x556e230bcc10 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556e23029b60 0x556e230b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556e23025a70 0x556e23044810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 --2- 10.20.193.28:0/3740862761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556e230250c0 0x556e230442d0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f2905ffb640 0 client.18411 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 -- 10.20.193.28:0/3740862761 >> 10.20.193.28:0/3740862761 conn(0x556e2301db60 msgr2=0x556e2302ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:47.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 -- 10.20.193.28:0/3740862761 shutdown_connections 2026-02-20T03:25:47.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 1 -- 10.20.193.28:0/3740862761 wait complete. 2026-02-20T03:25:47.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.410+0000 7f294cca7e00 20 client.18411 trim_cache size 0 max 16384 2026-02-20T03:25:47.419 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:25:47.419 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:25:47.419 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "f35344be-c344-4b7e-a9e8-6c2cb30642d4", 2026-02-20T03:25:47.419 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:25:47.419 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:25:47.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 -- 10.20.193.28:0/3611303702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29180b0da0 msgr2=0x7f29180b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29180b0da0 0x7f29180b3260 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x556e23026090 tx=0x7f29300073d0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 -- 10.20.193.28:0/3611303702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f294410a980 msgr2=0x7f294410ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f294410a980 0x7f294410ebe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2938032040 tx=0x7f2938009300 comp rx=0 tx=0).stop 2026-02-20T03:25:47.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 -- 10.20.193.28:0/3611303702 shutdown_connections 2026-02-20T03:25:47.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29180b0da0 0x7f29180b3260 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f294410a980 0x7f294410ebe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2944105320 0x7f294410e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 --2- 10.20.193.28:0/3611303702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2944104980 0x7f29441115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 -- 10.20.193.28:0/3611303702 >> 10.20.193.28:0/3611303702 conn(0x7f2944100680 msgr2=0x7f2944101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:47.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 -- 10.20.193.28:0/3611303702 shutdown_connections 2026-02-20T03:25:47.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.411+0000 7f2949519640 1 -- 10.20.193.28:0/3611303702 wait complete. 2026-02-20T03:25:47.515 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:25:47.521 INFO:tasks.workunit.client.0.trial028.stdout: 1 960008 8.14 MB/sec execute 440 sec latency 505.950 ms 2026-02-20T03:25:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:47 trial126 ceph-mon[38476]: pgmap v515: 129 pgs: 129 active+clean; 146 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 602 KiB/s rd, 3.3 MiB/s wr, 302 op/s 2026-02-20T03:25:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:47 trial177 ceph-mon[43181]: pgmap v515: 129 pgs: 129 active+clean; 146 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 602 KiB/s rd, 3.3 MiB/s wr, 302 op/s 2026-02-20T03:25:47.779 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:25:47.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.969+0000 7fd0575bc640 1 -- 10.20.193.28:0/3821231562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050105330 msgr2=0x7fd050111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.969+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3821231562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050105330 0x7fd050111860 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fd04400b0d0 tx=0x7fd04402f450 comp rx=0 tx=0).stop 2026-02-20T03:25:47.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.969+0000 7fd0575bc640 1 -- 10.20.193.28:0/3821231562 shutdown_connections 2026-02-20T03:25:47.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.969+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3821231562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050105330 0x7fd050111860 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.969+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3821231562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd050104990 0x7fd050104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.969+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3821231562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd05010a990 0x7fd05010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.969+0000 7fd0575bc640 1 -- 10.20.193.28:0/3821231562 >> 10.20.193.28:0/3821231562 conn(0x7fd050100690 msgr2=0x7fd050102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:47.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.969+0000 7fd0575bc640 1 -- 10.20.193.28:0/3821231562 shutdown_connections 2026-02-20T03:25:47.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.971+0000 7fd0575bc640 1 -- 10.20.193.28:0/3821231562 wait complete. 2026-02-20T03:25:47.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.971+0000 7fd0575bc640 1 Processor -- start 2026-02-20T03:25:47.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.971+0000 7fd0575bc640 1 -- start start 2026-02-20T03:25:47.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0575bc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050104990 0x7fd05019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0575bc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd050105330 0x7fd05019d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0575bc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd05010a990 0x7fd0501a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0575bc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd050114c00 con 0x7fd050104990 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0575bc640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd050114a80 con 0x7fd050105330 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0575bc640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd050114d80 con 0x7fd05010a990 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0565ba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050104990 0x7fd05019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd056dbb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd05010a990 0x7fd0501a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0565ba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050104990 0x7fd05019cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44068/0 (socket says 10.20.193.28:44068) 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0565ba640 1 -- 10.20.193.28:0/3263265096 learned_addr learned my addr 10.20.193.28:0/3263265096 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd055db9640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd050105330 0x7fd05019d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0565ba640 1 -- 10.20.193.28:0/3263265096 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd05010a990 msgr2=0x7fd0501a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0565ba640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd05010a990 0x7fd0501a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0565ba640 1 -- 10.20.193.28:0/3263265096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd050105330 msgr2=0x7fd05019d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0565ba640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd050105330 0x7fd05019d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0565ba640 1 -- 10.20.193.28:0/3263265096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0501a2030 con 0x7fd050104990 2026-02-20T03:25:47.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd055db9640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd050105330 0x7fd05019d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:47.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.972+0000 7fd0565ba640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050104990 0x7fd05019cfe0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd04800d950 tx=0x7fd04800de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.973+0000 7fd03b7fe640 1 -- 10.20.193.28:0/3263265096 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048014070 con 0x7fd050104990 2026-02-20T03:25:47.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.973+0000 7fd03b7fe640 1 -- 10.20.193.28:0/3263265096 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd0480044e0 con 0x7fd050104990 2026-02-20T03:25:47.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.973+0000 7fd03b7fe640 1 -- 10.20.193.28:0/3263265096 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048005020 con 0x7fd050104990 2026-02-20T03:25:47.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.973+0000 7fd0575bc640 1 -- 10.20.193.28:0/3263265096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0501a2320 con 0x7fd050104990 2026-02-20T03:25:47.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.973+0000 7fd0575bc640 1 -- 10.20.193.28:0/3263265096 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0501a9b60 con 0x7fd050104990 2026-02-20T03:25:47.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.975+0000 7fd03b7fe640 1 -- 10.20.193.28:0/3263265096 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd04800b900 con 0x7fd050104990 2026-02-20T03:25:47.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.976+0000 7fd05ad4ae00 1 Processor -- start 2026-02-20T03:25:47.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.976+0000 7fd05ad4ae00 1 -- start start 2026-02-20T03:25:47.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.976+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e06103e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.976+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e060aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.976+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e061f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.976+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5643e058ae50 con 0x5643e0610000 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.976+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5643e055d9c0 con 0x5643e060a630 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.976+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5643e050b240 con 0x5643e060afb0 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd0565ba640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e060aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd0565ba640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e060aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44122/0 (socket says 10.20.193.28:44122) 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd0565ba640 1 -- 10.20.193.28:0/4066139176 learned_addr learned my addr 10.20.193.28:0/4066139176 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd056dbb640 1 --2- 10.20.193.28:0/4066139176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e06103e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd055db9640 1 --2- 10.20.193.28:0/4066139176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e061f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd0565ba640 1 -- 10.20.193.28:0/4066139176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 msgr2=0x5643e061f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd0565ba640 1 --2- 10.20.193.28:0/4066139176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e061f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd0565ba640 1 -- 10.20.193.28:0/4066139176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 msgr2=0x5643e06103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd0565ba640 1 --2- 10.20.193.28:0/4066139176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e06103e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd0565ba640 1 -- 10.20.193.28:0/4066139176 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e051e420 con 0x5643e060a630 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd03b7fe640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd02c0b0e20 0x7fd02c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd056dbb640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd02c0b0e20 0x7fd02c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.977+0000 7fd03b7fe640 1 -- 10.20.193.28:0/3263265096 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd0480e0890 con 0x7fd050104990 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd0565ba640 1 --2- 10.20.193.28:0/4066139176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e060aa70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd0480e6c50 tx=0x7fd0480e8670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73adc7445d356634 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd038cf3640 1 -- 10.20.193.28:0/4066139176 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04801d020 con 0x5643e060a630 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd038cf3640 1 -- 10.20.193.28:0/4066139176 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd0480a8c70 con 0x5643e060a630 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd038cf3640 1 -- 10.20.193.28:0/4066139176 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0480a7a90 con 0x5643e060a630 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/4066139176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 msgr2=0x5643e060aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/4066139176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e060aa70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd0480e6c50 tx=0x7fd0480e8670 comp rx=0 tx=0).stop 2026-02-20T03:25:47.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd056dbb640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd02c0b0e20 0x7fd02c0b32e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd044009e60 tx=0x7fd04403a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/4066139176 shutdown_connections 2026-02-20T03:25:47.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/4066139176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e061f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/4066139176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e060aa70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/4066139176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e06103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/4066139176 >> 10.20.193.28:0/4066139176 conn(0x5643e05cd290 msgr2=0x5643e0608d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:47.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/4066139176 shutdown_connections 2026-02-20T03:25:47.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.978+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/4066139176 wait complete. 2026-02-20T03:25:47.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.979+0000 7fd05ad4ae00 1 -- start start 2026-02-20T03:25:47.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.979+0000 7fd05ad4ae00 1 Processor -- start 2026-02-20T03:25:47.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060a630 0x5643e062d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060afb0 0x5643e062db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e062bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5643e05598f0 con 0x5643e0610000 2026-02-20T03:25:47.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5643e034bf50 con 0x5643e060afb0 2026-02-20T03:25:47.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5643e062c4a0 con 0x5643e060a630 2026-02-20T03:25:47.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd0565ba640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060a630 0x5643e062d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd056dbb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e062bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd056dbb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e062bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44088/0 (socket says 10.20.193.28:44088) 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd056dbb640 1 -- 10.20.193.28:0/1797974437 learned_addr learned my addr 10.20.193.28:0/1797974437 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd055db9640 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060afb0 0x5643e062db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd056dbb640 1 -- 10.20.193.28:0/1797974437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060a630 msgr2=0x5643e062d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd056dbb640 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060a630 0x5643e062d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd056dbb640 1 -- 10.20.193.28:0/1797974437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060afb0 msgr2=0x5643e062db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd056dbb640 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060afb0 0x5643e062db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd056dbb640 1 -- 10.20.193.28:0/1797974437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e06254c0 con 0x5643e0610000 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.980+0000 7fd056dbb640 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e062bd20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd0440043b0 tx=0x7fd04402f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e81a605096fe392 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd003fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:47.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd003fff640 1 -- 10.20.193.28:0/1797974437 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0440046c0 con 0x5643e0610000 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/1797974437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e032eb40 con 0x5643e0610000 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd05ad4ae00 10 client.18423 _ll_register_callbacks cb 0x5643e0596f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/1797974437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5643e056b1a0 con 0x5643e0610000 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd003fff640 1 -- 10.20.193.28:0/1797974437 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd044004860 con 0x5643e0610000 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd003fff640 1 -- 10.20.193.28:0/1797974437 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044045ae0 con 0x5643e0610000 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd003fff640 1 -- 10.20.193.28:0/1797974437 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd044045c80 con 0x5643e0610000 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd003fff640 1 -- 10.20.193.28:0/1797974437 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd044045480 con 0x5643e0610000 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd05ad4ae00 10 client.18423 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/1797974437 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5643e0518230 con 0x5643e0610000 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.981+0000 7fd003fff640 1 -- 10.20.193.28:0/1797974437 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd0440076a0 con 0x5643e0610000 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.982+0000 7fd05ad4ae00 10 client.18423 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:47.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.982+0000 7fd05ad4ae00 10 client.18423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.982+0000 7fd05ad4ae00 20 client.18423 populate_metadata read hostname 'trial028' 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.982+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5643e063bd80 0x5643e063e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.982+0000 7fd05ad4ae00 4 client.18423 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.982+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/1797974437 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643e05655b0 con 0x5643e063bd80 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.982+0000 7fd0565ba640 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5643e063bd80 0x5643e063e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.982+0000 7fd0565ba640 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5643e063bd80 0x5643e063e1d0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d77f74248359523 server_cookie=89ed50504eb48025 in_seq=0 out_seq=0 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.982+0000 7fd003fff640 10 client.18423 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd003fff640 1 -- 10.20.193.28:0/1797974437 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5643e05655b0 con 0x5643e063bd80 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd003fff640 10 client.18423 handle_command_reply: tid=0 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd05ad4ae00 1 client.18423 shutdown 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/1797974437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 msgr2=0x5643e062bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:47.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e062bd20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fd0440043b0 tx=0x7fd04402f450 comp rx=0 tx=0).stop 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/1797974437 shutdown_connections 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5643e063bd80 0x5643e063e1d0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e0610000 0x5643e062bd20 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060afb0 0x5643e062db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/1797974437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060a630 0x5643e062d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/1797974437 >> 10.20.193.28:0/1797974437 conn(0x5643e05cd290 msgr2=0x5643e061e760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.983+0000 7fd003fff640 0 client.18423 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.984+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/1797974437 shutdown_connections 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.984+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/1797974437 wait complete. 2026-02-20T03:25:47.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.984+0000 7fd05ad4ae00 20 client.18423 trim_cache size 0 max 16384 2026-02-20T03:25:47.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd05ad4ae00 1 Processor -- start 2026-02-20T03:25:47.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd05ad4ae00 1 -- start start 2026-02-20T03:25:47.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060a630 0x5643e0608c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e060ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e0610000 0x5643e060cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:47.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcff80126f0 con 0x5643e060a630 2026-02-20T03:25:47.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcff800ffc0 con 0x5643e0610000 2026-02-20T03:25:47.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcff800de10 con 0x5643e060afb0 2026-02-20T03:25:47.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd055db9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e060ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd055db9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e060ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36130/0 (socket says 10.20.193.28:36130) 2026-02-20T03:25:47.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd055db9640 1 -- 10.20.193.28:0/2554096721 learned_addr learned my addr 10.20.193.28:0/2554096721 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:47.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd056dbb640 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e0610000 0x5643e060cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd0565ba640 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060a630 0x5643e0608c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd055db9640 1 -- 10.20.193.28:0/2554096721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e0610000 msgr2=0x5643e060cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd055db9640 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e0610000 0x5643e060cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd055db9640 1 -- 10.20.193.28:0/2554096721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060a630 msgr2=0x5643e0608c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd055db9640 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060a630 0x5643e0608c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd055db9640 1 -- 10.20.193.28:0/2554096721 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e06252f0 con 0x5643e060afb0 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.993+0000 7fd0565ba640 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060a630 0x5643e0608c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd055db9640 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e060ca70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd03c003b50 tx=0x7fd03c004020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b059c6b8eaa6de8f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd01e4e6640 1 -- 10.20.193.28:0/2554096721 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c012be0 con 0x5643e060afb0 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd01e4e6640 1 -- 10.20.193.28:0/2554096721 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd03c012d80 con 0x5643e060afb0 2026-02-20T03:25:47.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd01e4e6640 1 -- 10.20.193.28:0/2554096721 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c01c420 con 0x5643e060afb0 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/2554096721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 msgr2=0x5643e060ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e060ca70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd03c003b50 tx=0x7fd03c004020 comp rx=0 tx=0).stop 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/2554096721 shutdown_connections 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e0610000 0x5643e060cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e060afb0 0x5643e060ca70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/2554096721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060a630 0x5643e0608c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.994+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/2554096721 >> 10.20.193.28:0/2554096721 conn(0x5643e05cd290 msgr2=0x5643e0608510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.995+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/2554096721 shutdown_connections 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.995+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/2554096721 wait complete. 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.995+0000 7fd05ad4ae00 1 -- start start 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.995+0000 7fd05ad4ae00 1 Processor -- start 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e0633150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:48.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060afb0 0x5643e0633690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd05ad4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e0610000 0x5643e06a0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcff800e480 con 0x5643e060afb0 2026-02-20T03:25:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcff800f8f0 con 0x5643e060a630 2026-02-20T03:25:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd05ad4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcff800eb50 con 0x5643e0610000 2026-02-20T03:25:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd055db9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060afb0 0x5643e0633690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd0565ba640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e0633150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd055db9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060afb0 0x5643e0633690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44114/0 (socket says 10.20.193.28:44114) 2026-02-20T03:25:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd055db9640 1 -- 10.20.193.28:0/3648140366 learned_addr learned my addr 10.20.193.28:0/3648140366 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:48.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd056dbb640 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e0610000 0x5643e06a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:48.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd055db9640 1 -- 10.20.193.28:0/3648140366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e0610000 msgr2=0x5643e06a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd055db9640 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e0610000 0x5643e06a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd055db9640 1 -- 10.20.193.28:0/3648140366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 msgr2=0x5643e0633150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd055db9640 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e0633150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.996+0000 7fd055db9640 1 -- 10.20.193.28:0/3648140366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e023c870 con 0x5643e060afb0 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd055db9640 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060afb0 0x5643e0633690 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd03c005990 tx=0x7fd03c0029f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746b4ac00e459b29 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd003fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd0565ba640 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e0633150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd056dbb640 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e0610000 0x5643e06a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd003fff640 1 -- 10.20.193.28:0/3648140366 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c012be0 con 0x5643e060afb0 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd003fff640 1 -- 10.20.193.28:0/3648140366 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd03c0054c0 con 0x5643e060afb0 2026-02-20T03:25:48.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd003fff640 1 -- 10.20.193.28:0/3648140366 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03c01c630 con 0x5643e060afb0 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/3648140366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e04fd440 con 0x5643e060afb0 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd003fff640 1 -- 10.20.193.28:0/3648140366 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd03c0047c0 con 0x5643e060afb0 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd05ad4ae00 10 client.18429 _ll_register_callbacks cb 0x7fd044004270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/3648140366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0480a8c70 con 0x5643e060afb0 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd003fff640 1 -- 10.20.193.28:0/3648140366 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd03c005670 con 0x5643e060afb0 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd05ad4ae00 10 client.18429 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.997+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/3648140366 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5643e0625fe0 con 0x5643e060afb0 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.998+0000 7fd003fff640 1 -- 10.20.193.28:0/3648140366 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd03c004f50 con 0x5643e060afb0 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.998+0000 7fd05ad4ae00 10 client.18429 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.998+0000 7fd05ad4ae00 10 client.18429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.998+0000 7fd05ad4ae00 20 client.18429 populate_metadata read hostname 'trial028' 2026-02-20T03:25:48.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.998+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5643e06a8e00 0x5643e06ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.998+0000 7fd05ad4ae00 4 client.18429 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.998+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/3648140366 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5643e052e810 con 0x5643e06a8e00 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.998+0000 7fd0565ba640 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5643e06a8e00 0x5643e06ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd0565ba640 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5643e06a8e00 0x5643e06ab290 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ef6fb45b5fa8a2f server_cookie=998906bd80b50 in_seq=0 out_seq=0 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd003fff640 10 client.18429 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd003fff640 1 -- 10.20.193.28:0/3648140366 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5643e052e810 con 0x5643e06a8e00 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd003fff640 10 client.18429 handle_command_reply: tid=0 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 client.18429 shutdown 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/3648140366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060afb0 msgr2=0x5643e0633690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060afb0 0x5643e0633690 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fd03c005990 tx=0x7fd03c0029f0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/3648140366 shutdown_connections 2026-02-20T03:25:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5643e06a8e00 0x5643e06ab290 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5643e0610000 0x5643e06a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5643e060afb0 0x5643e0633690 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.007 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:25:48.007 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:25:48.007 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:25:48.007 INFO:teuthology.orchestra.run.trial028.stdout: "f35344be-c344-4b7e-a9e8-6c2cb30642d4": { 2026-02-20T03:25:48.007 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:25:48.008 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "f35344be-c344-4b7e-a9e8-6c2cb30642d4", 2026-02-20T03:25:48.008 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:25:48.008 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:25:48.008 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:25:48.008 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:25:48.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 --2- 10.20.193.28:0/3648140366 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5643e060a630 0x5643e0633150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/3648140366 >> 10.20.193.28:0/3648140366 conn(0x5643e05cd290 msgr2=0x5643e0608d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:48.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd003fff640 0 client.18429 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:48.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/3648140366 shutdown_connections 2026-02-20T03:25:48.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 1 -- 10.20.193.28:0/3648140366 wait complete. 2026-02-20T03:25:48.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:47.999+0000 7fd05ad4ae00 20 client.18429 trim_cache size 0 max 16384 2026-02-20T03:25:48.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 -- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd02c0b0e20 msgr2=0x7fd02c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:48.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd02c0b0e20 0x7fd02c0b32e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd044009e60 tx=0x7fd04403a040 comp rx=0 tx=0).stop 2026-02-20T03:25:48.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 -- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050104990 msgr2=0x7fd05019cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:48.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050104990 0x7fd05019cfe0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fd04800d950 tx=0x7fd04800de20 comp rx=0 tx=0).stop 2026-02-20T03:25:48.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 -- 10.20.193.28:0/3263265096 shutdown_connections 2026-02-20T03:25:48.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd02c0b0e20 0x7fd02c0b32e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd05010a990 0x7fd0501a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd050105330 0x7fd05019d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 --2- 10.20.193.28:0/3263265096 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd050104990 0x7fd05019cfe0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:48.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 -- 10.20.193.28:0/3263265096 >> 10.20.193.28:0/3263265096 conn(0x7fd050100690 msgr2=0x7fd050100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:48.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 -- 10.20.193.28:0/3263265096 shutdown_connections 2026-02-20T03:25:48.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:25:48.000+0000 7fd0575bc640 1 -- 10.20.193.28:0/3263265096 wait complete. 2026-02-20T03:25:48.100 INFO:tasks.cephfs.filesystem:scrub status for tag:f35344be-c344-4b7e-a9e8-6c2cb30642d4 - {'path': '/', 'tag': 'f35344be-c344-4b7e-a9e8-6c2cb30642d4', 'options': 'recursive,force'} 2026-02-20T03:25:48.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:48 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:25:48.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:48 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:48.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:48 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:25:48.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:48 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:48.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:48 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:25:48.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:48 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:25:48.352 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:48 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:48.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 963643 8.17 MB/sec execute 441 sec latency 7.956 ms 2026-02-20T03:25:48.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:48 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:25:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:48 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:48 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:25:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:48 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:48 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:25:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:48 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:25:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:48 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:48 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:25:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:48 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:48 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:25:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:48 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:48 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:25:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:48 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:25:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:48 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:49.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 967491 8.19 MB/sec execute 442 sec latency 6.729 ms 2026-02-20T03:25:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:49 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:49 trial126 ceph-mon[38476]: pgmap v516: 129 pgs: 129 active+clean; 146 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 735 KiB/s rd, 3.0 MiB/s wr, 337 op/s 2026-02-20T03:25:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:49 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:49 trial028 ceph-mon[38552]: pgmap v516: 129 pgs: 129 active+clean; 146 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 735 KiB/s rd, 3.0 MiB/s wr, 337 op/s 2026-02-20T03:25:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:49 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:25:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:49 trial177 ceph-mon[43181]: pgmap v516: 129 pgs: 129 active+clean; 146 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 735 KiB/s rd, 3.0 MiB/s wr, 337 op/s 2026-02-20T03:25:50.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 971359 8.23 MB/sec execute 443 sec latency 7.281 ms 2026-02-20T03:25:51.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 974878 8.25 MB/sec execute 444 sec latency 34.561 ms 2026-02-20T03:25:51.571 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:51 trial028 ceph-mon[38552]: pgmap v517: 129 pgs: 129 active+clean; 143 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 732 KiB/s rd, 3.3 MiB/s wr, 364 op/s 2026-02-20T03:25:51.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:51 trial126 ceph-mon[38476]: pgmap v517: 129 pgs: 129 active+clean; 143 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 732 KiB/s rd, 3.3 MiB/s wr, 364 op/s 2026-02-20T03:25:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:51 trial177 ceph-mon[43181]: pgmap v517: 129 pgs: 129 active+clean; 143 MiB data, 3.4 GiB used, 8.2 TiB / 8.2 TiB avail; 732 KiB/s rd, 3.3 MiB/s wr, 364 op/s 2026-02-20T03:25:52.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 974893 8.23 MB/sec execute 445 sec latency 904.818 ms 2026-02-20T03:25:53.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 977334 8.24 MB/sec execute 446 sec latency 1337.278 ms 2026-02-20T03:25:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:53 trial126 ceph-mon[38476]: pgmap v518: 129 pgs: 129 active+clean; 142 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 660 KiB/s rd, 2.3 MiB/s wr, 324 op/s 2026-02-20T03:25:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:53 trial028 ceph-mon[38552]: pgmap v518: 129 pgs: 129 active+clean; 142 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 660 KiB/s rd, 2.3 MiB/s wr, 324 op/s 2026-02-20T03:25:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:53 trial177 ceph-mon[43181]: pgmap v518: 129 pgs: 129 active+clean; 142 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 660 KiB/s rd, 2.3 MiB/s wr, 324 op/s 2026-02-20T03:25:54.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 980969 8.27 MB/sec execute 447 sec latency 8.198 ms 2026-02-20T03:25:55.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 984704 8.29 MB/sec execute 448 sec latency 6.814 ms 2026-02-20T03:25:55.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:55 trial126 ceph-mon[38476]: pgmap v519: 129 pgs: 129 active+clean; 151 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 810 KiB/s rd, 3.0 MiB/s wr, 370 op/s 2026-02-20T03:25:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:55 trial028 ceph-mon[38552]: pgmap v519: 129 pgs: 129 active+clean; 151 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 810 KiB/s rd, 3.0 MiB/s wr, 370 op/s 2026-02-20T03:25:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:55 trial177 ceph-mon[43181]: pgmap v519: 129 pgs: 129 active+clean; 151 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 810 KiB/s rd, 3.0 MiB/s wr, 370 op/s 2026-02-20T03:25:56.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 988431 8.32 MB/sec execute 449 sec latency 7.155 ms 2026-02-20T03:25:57.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:57 trial028 ceph-mon[38552]: pgmap v520: 129 pgs: 129 active+clean; 163 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 820 KiB/s rd, 4.0 MiB/s wr, 375 op/s 2026-02-20T03:25:57.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 989498 8.31 MB/sec execute 450 sec latency 640.027 ms 2026-02-20T03:25:57.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:57 trial126 ceph-mon[38476]: pgmap v520: 129 pgs: 129 active+clean; 163 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 820 KiB/s rd, 4.0 MiB/s wr, 375 op/s 2026-02-20T03:25:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:57 trial177 ceph-mon[43181]: pgmap v520: 129 pgs: 129 active+clean; 163 MiB data, 3.5 GiB used, 8.2 TiB / 8.2 TiB avail; 820 KiB/s rd, 4.0 MiB/s wr, 375 op/s 2026-02-20T03:25:58.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 993627 8.34 MB/sec execute 451 sec latency 13.710 ms 2026-02-20T03:25:58.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:25:58.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:25:58.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:58 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:25:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:25:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:25:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:58 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:25:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:25:58.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:25:58.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:58 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:25:58.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.846+0000 7f7875f5b640 1 -- 10.20.193.28:0/3008422314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7870109e60 msgr2=0x7f787010a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:58.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.846+0000 7f7875f5b640 1 --2- 10.20.193.28:0/3008422314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7870109e60 0x7f787010a2e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f7858009a30 tx=0x7f785802f220 comp rx=0 tx=0).stop 2026-02-20T03:25:58.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.846+0000 7f7875f5b640 1 -- 10.20.193.28:0/3008422314 shutdown_connections 2026-02-20T03:25:58.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.846+0000 7f7875f5b640 1 --2- 10.20.193.28:0/3008422314 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f787010a900 0x7f7870111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.846+0000 7f7875f5b640 1 --2- 10.20.193.28:0/3008422314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7870109e60 0x7f787010a2e0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.846+0000 7f7875f5b640 1 --2- 10.20.193.28:0/3008422314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7870109490 0x7f7870109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.846+0000 7f7875f5b640 1 -- 10.20.193.28:0/3008422314 >> 10.20.193.28:0/3008422314 conn(0x7f7870077fe0 msgr2=0x7f787007a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:58.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.846+0000 7f7875f5b640 1 -- 10.20.193.28:0/3008422314 shutdown_connections 2026-02-20T03:25:58.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.846+0000 7f7875f5b640 1 -- 10.20.193.28:0/3008422314 wait complete. 2026-02-20T03:25:58.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.847+0000 7f7875f5b640 1 Processor -- start 2026-02-20T03:25:58.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.847+0000 7f7875f5b640 1 -- start start 2026-02-20T03:25:58.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.847+0000 7f7875f5b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7870109490 0x7f78701a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.847+0000 7f7875f5b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7870109e60 0x7f78701a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.847+0000 7f7875f5b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f787010a900 0x7f78701a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.847+0000 7f7875f5b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7870114910 con 0x7f7870109e60 2026-02-20T03:25:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.847+0000 7f7875f5b640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7870114790 con 0x7f787010a900 2026-02-20T03:25:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.847+0000 7f7875f5b640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7870114a90 con 0x7f7870109490 2026-02-20T03:25:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7867fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7870109e60 0x7f78701a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7874f59640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7870109490 0x7f78701a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7874f59640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7870109490 0x7f78701a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:53486/0 (socket says 10.20.193.28:53486) 2026-02-20T03:25:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7874f59640 1 -- 10.20.193.28:0/4943668 learned_addr learned my addr 10.20.193.28:0/4943668 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f787575a640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f787010a900 0x7f78701a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7867fff640 1 -- 10.20.193.28:0/4943668 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7870109490 msgr2=0x7f78701a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7867fff640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7870109490 0x7f78701a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7867fff640 1 -- 10.20.193.28:0/4943668 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f787010a900 msgr2=0x7f78701a8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7867fff640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f787010a900 0x7f78701a8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7867fff640 1 -- 10.20.193.28:0/4943668 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78701a8c30 con 0x7f7870109e60 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7867fff640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7870109e60 0x7f78701a14c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7858009950 tx=0x7f785802fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7865ffb640 1 -- 10.20.193.28:0/4943668 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858004240 con 0x7f7870109e60 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7865ffb640 1 -- 10.20.193.28:0/4943668 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f78580043e0 con 0x7f7870109e60 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7875f5b640 1 -- 10.20.193.28:0/4943668 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78701a8ec0 con 0x7f7870109e60 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7865ffb640 1 -- 10.20.193.28:0/4943668 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858042980 con 0x7f7870109e60 2026-02-20T03:25:58.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.848+0000 7f7875f5b640 1 -- 10.20.193.28:0/4943668 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78701a9330 con 0x7f7870109e60 2026-02-20T03:25:58.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.851+0000 7f7865ffb640 1 -- 10.20.193.28:0/4943668 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7858038ca0 con 0x7f7870109e60 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.851+0000 7f787a052e00 1 Processor -- start 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.851+0000 7f787a052e00 1 -- start start 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f787a052e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 0x55eeec89f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f787a052e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89f7c0 0x55eeec8a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f787a052e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f787a052e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eeec7ef8f0 con 0x55eeec8a4560 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f787a052e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55eeec79d2e0 con 0x55eeec89ee80 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f787a052e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55eeec7eb820 con 0x55eeec89f7c0 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f7867fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f7865ffb640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f784c0b0e20 0x7f784c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f7867fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58310/0 (socket says 10.20.193.28:58310) 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f7867fff640 1 -- 10.20.193.28:0/1186083976 learned_addr learned my addr 10.20.193.28:0/1186083976 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f787575a640 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 0x55eeec89f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f7874f59640 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89f7c0 0x55eeec8a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f7865ffb640 1 -- 10.20.193.28:0/4943668 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f78581051b0 con 0x7f7870109e60 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.852+0000 7f787575a640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f784c0b0e20 0x7f784c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f7867fff640 1 -- 10.20.193.28:0/1186083976 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89f7c0 msgr2=0x55eeec8a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f7867fff640 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89f7c0 0x55eeec8a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f7867fff640 1 -- 10.20.193.28:0/1186083976 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 msgr2=0x55eeec89f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f7867fff640 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 0x55eeec89f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f7867fff640 1 -- 10.20.193.28:0/1186083976 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeec78f5a0 con 0x55eeec8a4560 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f7874f59640 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89f7c0 0x55eeec8a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f7867fff640 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8a69f0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7858105450 tx=0x7f7858005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304806f0d060097d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f783d3fe640 1 -- 10.20.193.28:0/1186083976 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858004590 con 0x55eeec8a4560 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f783d3fe640 1 -- 10.20.193.28:0/1186083976 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7858033020 con 0x55eeec8a4560 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f783d3fe640 1 -- 10.20.193.28:0/1186083976 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78580ce1c0 con 0x55eeec8a4560 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f787a052e00 1 -- 10.20.193.28:0/1186083976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 msgr2=0x55eeec8a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f787a052e00 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8a69f0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7858105450 tx=0x7f7858005e50 comp rx=0 tx=0).stop 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.853+0000 7f787575a640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f784c0b0e20 0x7f784c0b32e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f786c009fd0 tx=0x7f786c009a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.854+0000 7f787a052e00 1 -- 10.20.193.28:0/1186083976 shutdown_connections 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.854+0000 7f787a052e00 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8a69f0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.854+0000 7f787a052e00 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89f7c0 0x55eeec8a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.854+0000 7f787a052e00 1 --2- 10.20.193.28:0/1186083976 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 0x55eeec89f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.854+0000 7f787a052e00 1 -- 10.20.193.28:0/1186083976 >> 10.20.193.28:0/1186083976 conn(0x55eeec8966f0 msgr2=0x55eeec89d570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.854+0000 7f787a052e00 1 -- 10.20.193.28:0/1186083976 shutdown_connections 2026-02-20T03:25:58.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.854+0000 7f787a052e00 1 -- 10.20.193.28:0/1186083976 wait complete. 2026-02-20T03:25:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.855+0000 7f787a052e00 1 -- start start 2026-02-20T03:25:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.855+0000 7f787a052e00 1 Processor -- start 2026-02-20T03:25:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f787a052e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 0x55eeec8b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f787a052e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec89f7c0 0x55eeec8b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f787a052e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec8a4560 0x55eeec8be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f787a052e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eeec7970c0 con 0x55eeec89f7c0 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f787a052e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55eeec8a7370 con 0x55eeec89ee80 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f787a052e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55eeec8bee80 con 0x55eeec8a4560 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7867fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec89f7c0 0x55eeec8b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7867fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec89f7c0 0x55eeec8b7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58322/0 (socket says 10.20.193.28:58322) 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7867fff640 1 -- 10.20.193.28:0/1661336941 learned_addr learned my addr 10.20.193.28:0/1661336941 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7874f59640 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 0x55eeec8b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f787575a640 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec8a4560 0x55eeec8be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7867fff640 1 -- 10.20.193.28:0/1661336941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec8a4560 msgr2=0x55eeec8be8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7867fff640 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec8a4560 0x55eeec8be8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7867fff640 1 -- 10.20.193.28:0/1661336941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 msgr2=0x55eeec8b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7867fff640 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 0x55eeec8b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7867fff640 1 -- 10.20.193.28:0/1661336941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeec8b0fc0 con 0x55eeec89f7c0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f7867fff640 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec89f7c0 0x55eeec8b7a50 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f78580ccb40 tx=0x7f78580424b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f62f67756bff85 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.856+0000 7f782e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f782e7fc640 1 -- 10.20.193.28:0/1661336941 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858004590 con 0x55eeec89f7c0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f782e7fc640 1 -- 10.20.193.28:0/1661336941 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f78580d1240 con 0x55eeec89f7c0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f782e7fc640 1 -- 10.20.193.28:0/1661336941 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858042b20 con 0x55eeec89f7c0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 1 -- 10.20.193.28:0/1661336941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeec7ab820 con 0x55eeec89f7c0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f782e7fc640 1 -- 10.20.193.28:0/1661336941 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7858042ce0 con 0x55eeec89f7c0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 10 client.18441 _ll_register_callbacks cb 0x55eeec79aff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 1 -- 10.20.193.28:0/1661336941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eeec7f74e0 con 0x55eeec89f7c0 2026-02-20T03:25:58.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f782e7fc640 1 -- 10.20.193.28:0/1661336941 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f78580f3030 con 0x55eeec89f7c0 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 10 client.18441 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 1 -- 10.20.193.28:0/1661336941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55eeec7b0380 con 0x55eeec89f7c0 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f782e7fc640 1 -- 10.20.193.28:0/1661336941 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7858102ce0 con 0x55eeec89f7c0 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 10 client.18441 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 10 client.18441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 20 client.18441 populate_metadata read hostname 'trial028' 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eeec8c2c70 0x55eeec8c5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 4 client.18441 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.857+0000 7f787a052e00 1 -- 10.20.193.28:0/1661336941 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eeec771bd0 con 0x55eeec8c2c70 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.858+0000 7f7874f59640 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eeec8c2c70 0x55eeec8c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.858+0000 7f7874f59640 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eeec8c2c70 0x55eeec8c5100 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=830eb5666915f375 server_cookie=39f628ac37f8c61e in_seq=0 out_seq=0 2026-02-20T03:25:58.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.858+0000 7f782e7fc640 10 client.18441 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.858+0000 7f782e7fc640 1 -- 10.20.193.28:0/1661336941 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55eeec771bd0 con 0x55eeec8c2c70 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.858+0000 7f782e7fc640 10 client.18441 handle_command_reply: tid=0 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 client.18441 shutdown 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 -- 10.20.193.28:0/1661336941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec89f7c0 msgr2=0x55eeec8b7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec89f7c0 0x55eeec8b7a50 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f78580ccb40 tx=0x7f78580424b0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 -- 10.20.193.28:0/1661336941 shutdown_connections 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eeec8c2c70 0x55eeec8c5100 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec8a4560 0x55eeec8be8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec89f7c0 0x55eeec8b7a50 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 --2- 10.20.193.28:0/1661336941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89ee80 0x55eeec8b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f782e7fc640 0 client.18441 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:58.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 -- 10.20.193.28:0/1661336941 >> 10.20.193.28:0/1661336941 conn(0x55eeec8966f0 msgr2=0x55eeec8a58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:58.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 -- 10.20.193.28:0/1661336941 shutdown_connections 2026-02-20T03:25:58.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 1 -- 10.20.193.28:0/1661336941 wait complete. 2026-02-20T03:25:58.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.859+0000 7f787a052e00 20 client.18441 trim_cache size 0 max 16384 2026-02-20T03:25:58.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.866+0000 7f787a052e00 1 Processor -- start 2026-02-20T03:25:58.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.866+0000 7f787a052e00 1 -- start start 2026-02-20T03:25:58.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f787a052e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f787a052e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 0x55eeec8be8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f787a052e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f787a052e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7814012600 con 0x55eeec8a4560 2026-02-20T03:25:58.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f787a052e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f781400fed0 con 0x55eeec89f7c0 2026-02-20T03:25:58.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f787a052e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f781400dd20 con 0x55eeec89ee80 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7874f59640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7874f59640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:53512/0 (socket says 10.20.193.28:53512) 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7874f59640 1 -- 10.20.193.28:0/2244515503 learned_addr learned my addr 10.20.193.28:0/2244515503 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7867fff640 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 0x55eeec8be8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f787575a640 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7874f59640 1 -- 10.20.193.28:0/2244515503 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 msgr2=0x55eeec8be8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7874f59640 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 0x55eeec8be8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7874f59640 1 -- 10.20.193.28:0/2244515503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 msgr2=0x55eeec8b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7874f59640 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7874f59640 1 -- 10.20.193.28:0/2244515503 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeec8b0df0 con 0x55eeec89ee80 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f787575a640 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:25:58.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.867+0000 7f7874f59640 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8b78a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55eeec89feb0 tx=0x7f7860007480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5124cdcac9f3b783 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f783cbfd640 1 -- 10.20.193.28:0/2244515503 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860002c10 con 0x55eeec89ee80 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f783cbfd640 1 -- 10.20.193.28:0/2244515503 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f786001f020 con 0x55eeec89ee80 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f783cbfd640 1 -- 10.20.193.28:0/2244515503 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78600116a0 con 0x55eeec89ee80 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f787a052e00 1 -- 10.20.193.28:0/2244515503 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 msgr2=0x55eeec8b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f787a052e00 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8b78a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55eeec89feb0 tx=0x7f7860007480 comp rx=0 tx=0).stop 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f787a052e00 1 -- 10.20.193.28:0/2244515503 shutdown_connections 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f787a052e00 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f787a052e00 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 0x55eeec8be8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f787a052e00 1 --2- 10.20.193.28:0/2244515503 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8b78a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f787a052e00 1 -- 10.20.193.28:0/2244515503 >> 10.20.193.28:0/2244515503 conn(0x55eeec8966f0 msgr2=0x55eeec8b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f787a052e00 1 -- 10.20.193.28:0/2244515503 shutdown_connections 2026-02-20T03:25:58.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.868+0000 7f787a052e00 1 -- 10.20.193.28:0/2244515503 wait complete. 2026-02-20T03:25:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f787a052e00 1 -- start start 2026-02-20T03:25:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f787a052e00 1 Processor -- start 2026-02-20T03:25:58.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f787a052e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f787a052e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 0x55eeec8bae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f787a052e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8bb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f787a052e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f781400e390 con 0x55eeec8a4560 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f787a052e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f781400f800 con 0x55eeec89f7c0 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f787a052e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f781400ea60 con 0x55eeec89ee80 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f7874f59640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f7874f59640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8be3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:53522/0 (socket says 10.20.193.28:53522) 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f7874f59640 1 -- 10.20.193.28:0/1083198333 learned_addr learned my addr 10.20.193.28:0/1083198333 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f7867fff640 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 0x55eeec8bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.869+0000 7f787575a640 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8bb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f7874f59640 1 -- 10.20.193.28:0/1083198333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 msgr2=0x55eeec8bae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f7874f59640 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 0x55eeec8bae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f7874f59640 1 -- 10.20.193.28:0/1083198333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 msgr2=0x55eeec8bb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f7874f59640 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8bb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f7874f59640 1 -- 10.20.193.28:0/1083198333 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeec8a6c00 con 0x55eeec89ee80 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f7867fff640 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 0x55eeec8bae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f787575a640 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8bb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f7874f59640 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8be3e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7860002410 tx=0x7f7860003d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c93bf97bdc036d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f782e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f782e7fc640 1 -- 10.20.193.28:0/1083198333 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860004c40 con 0x55eeec89ee80 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f782e7fc640 1 -- 10.20.193.28:0/1083198333 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7860029070 con 0x55eeec89ee80 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f782e7fc640 1 -- 10.20.193.28:0/1083198333 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786001c830 con 0x55eeec89ee80 2026-02-20T03:25:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.870+0000 7f787a052e00 1 -- 10.20.193.28:0/1083198333 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeec54f690 con 0x55eeec89ee80 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f782e7fc640 1 -- 10.20.193.28:0/1083198333 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f786001c9d0 con 0x55eeec89ee80 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 10 client.27481 _ll_register_callbacks cb 0x7f78580d60f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 1 -- 10.20.193.28:0/1083198333 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7858033020 con 0x55eeec89ee80 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f782e7fc640 1 -- 10.20.193.28:0/1083198333 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7860004de0 con 0x55eeec89ee80 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 10 client.27481 fetch_fsmap learned FSMap version 30 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 1 -- 10.20.193.28:0/1083198333 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55eeec7b4b70 con 0x55eeec89ee80 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f782e7fc640 1 -- 10.20.193.28:0/1083198333 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7860036030 con 0x55eeec89ee80 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 10 client.27481 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 10 client.27481 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 20 client.27481 populate_metadata read hostname 'trial028' 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eeec92edb0 0x55eeec931270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 4 client.27481 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:25:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.871+0000 7f787a052e00 1 -- 10.20.193.28:0/1083198333 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f7858033020 con 0x55eeec92edb0 2026-02-20T03:25:58.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.872+0000 7f7867fff640 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eeec92edb0 0x55eeec931270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:25:58.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.872+0000 7f7867fff640 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eeec92edb0 0x55eeec931270 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c33e84756de6bcf server_cookie=91601d9434eda971 in_seq=0 out_seq=0 2026-02-20T03:25:58.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.872+0000 7f782e7fc640 10 client.27481 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:58.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f782e7fc640 1 -- 10.20.193.28:0/1083198333 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f7858033020 con 0x55eeec92edb0 2026-02-20T03:25:58.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f782e7fc640 10 client.27481 handle_command_reply: tid=0 2026-02-20T03:25:58.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 client.27481 shutdown 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 -- 10.20.193.28:0/1083198333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 msgr2=0x55eeec8be3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8be3e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7860002410 tx=0x7f7860003d80 comp rx=0 tx=0).stop 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 -- 10.20.193.28:0/1083198333 shutdown_connections 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eeec92edb0 0x55eeec931270 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eeec8a4560 0x55eeec8bb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eeec89f7c0 0x55eeec8bae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 --2- 10.20.193.28:0/1083198333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eeec89ee80 0x55eeec8be3e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f782e7fc640 0 client.27481 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 -- 10.20.193.28:0/1083198333 >> 10.20.193.28:0/1083198333 conn(0x55eeec8966f0 msgr2=0x55eeec8b77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 -- 10.20.193.28:0/1083198333 shutdown_connections 2026-02-20T03:25:58.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 1 -- 10.20.193.28:0/1083198333 wait complete. 2026-02-20T03:25:58.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.973+0000 7f787a052e00 20 client.27481 trim_cache size 0 max 16384 2026-02-20T03:25:58.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:25:58.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:25:58.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:25:58.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:25:58.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 -- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f784c0b0e20 msgr2=0x7f784c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:58.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f784c0b0e20 0x7f784c0b32e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f786c009fd0 tx=0x7f786c009a00 comp rx=0 tx=0).stop 2026-02-20T03:25:58.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 -- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7870109e60 msgr2=0x7f78701a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:25:58.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7870109e60 0x7f78701a14c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f7858009950 tx=0x7f785802fcb0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 -- 10.20.193.28:0/4943668 shutdown_connections 2026-02-20T03:25:58.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f784c0b0e20 0x7f784c0b32e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f787010a900 0x7f78701a8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7870109e60 0x7f78701a14c0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 --2- 10.20.193.28:0/4943668 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7870109490 0x7f78701a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:25:58.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 -- 10.20.193.28:0/4943668 >> 10.20.193.28:0/4943668 conn(0x7f7870077fe0 msgr2=0x7f787010d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:25:58.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 -- 10.20.193.28:0/4943668 shutdown_connections 2026-02-20T03:25:58.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:25:58.974+0000 7f7875f5b640 1 -- 10.20.193.28:0/4943668 wait complete. 2026-02-20T03:25:59.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 997172 8.36 MB/sec execute 452 sec latency 48.778 ms 2026-02-20T03:25:59.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:25:59 trial126 ceph-mon[38476]: pgmap v521: 129 pgs: 129 active+clean; 168 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 909 KiB/s rd, 4.0 MiB/s wr, 377 op/s 2026-02-20T03:25:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:25:59 trial028 ceph-mon[38552]: pgmap v521: 129 pgs: 129 active+clean; 168 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 909 KiB/s rd, 4.0 MiB/s wr, 377 op/s 2026-02-20T03:25:59.618 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:25:59 trial177 ceph-mon[43181]: pgmap v521: 129 pgs: 129 active+clean; 168 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 909 KiB/s rd, 4.0 MiB/s wr, 377 op/s 2026-02-20T03:26:00.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1001091 8.39 MB/sec execute 453 sec latency 7.031 ms 2026-02-20T03:26:01.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1004650 8.42 MB/sec execute 454 sec latency 12.203 ms 2026-02-20T03:26:01.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:01 trial126 ceph-mon[38476]: pgmap v522: 129 pgs: 129 active+clean; 174 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 4.4 MiB/s wr, 459 op/s 2026-02-20T03:26:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:01 trial028 ceph-mon[38552]: pgmap v522: 129 pgs: 129 active+clean; 174 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 4.4 MiB/s wr, 459 op/s 2026-02-20T03:26:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:01 trial177 ceph-mon[43181]: pgmap v522: 129 pgs: 129 active+clean; 174 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 4.4 MiB/s wr, 459 op/s 2026-02-20T03:26:02.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1005634 8.42 MB/sec execute 455 sec latency 740.374 ms 2026-02-20T03:26:03.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1005880 8.40 MB/sec execute 456 sec latency 1501.603 ms 2026-02-20T03:26:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:03 trial126 ceph-mon[38476]: pgmap v523: 129 pgs: 129 active+clean; 175 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 925 KiB/s rd, 4.0 MiB/s wr, 385 op/s 2026-02-20T03:26:03.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:03 trial028 ceph-mon[38552]: pgmap v523: 129 pgs: 129 active+clean; 175 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 925 KiB/s rd, 4.0 MiB/s wr, 385 op/s 2026-02-20T03:26:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:03 trial177 ceph-mon[43181]: pgmap v523: 129 pgs: 129 active+clean; 175 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 925 KiB/s rd, 4.0 MiB/s wr, 385 op/s 2026-02-20T03:26:04.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1005880 8.38 MB/sec execute 457 sec latency 1051.514 ms 2026-02-20T03:26:05.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1005880 8.36 MB/sec execute 458 sec latency 2051.574 ms 2026-02-20T03:26:05.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:05 trial126 ceph-mon[38476]: pgmap v524: 129 pgs: 129 active+clean; 173 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 448 op/s 2026-02-20T03:26:05.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:05 trial028 ceph-mon[38552]: pgmap v524: 129 pgs: 129 active+clean; 173 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 448 op/s 2026-02-20T03:26:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:05 trial177 ceph-mon[43181]: pgmap v524: 129 pgs: 129 active+clean; 173 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 448 op/s 2026-02-20T03:26:06.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1005880 8.34 MB/sec execute 459 sec latency 3051.628 ms 2026-02-20T03:26:07.417 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:07 trial028 ceph-mon[38552]: pgmap v525: 129 pgs: 129 active+clean; 174 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 412 op/s 2026-02-20T03:26:07.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1005880 8.33 MB/sec execute 460 sec latency 4051.665 ms 2026-02-20T03:26:07.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:07 trial126 ceph-mon[38476]: pgmap v525: 129 pgs: 129 active+clean; 174 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 412 op/s 2026-02-20T03:26:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:07 trial177 ceph-mon[43181]: pgmap v525: 129 pgs: 129 active+clean; 174 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 412 op/s 2026-02-20T03:26:08.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1005998 8.31 MB/sec execute 461 sec latency 5005.988 ms 2026-02-20T03:26:09.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1009680 8.33 MB/sec execute 462 sec latency 12.118 ms 2026-02-20T03:26:09.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:09 trial126 ceph-mon[38476]: pgmap v526: 129 pgs: 129 active+clean; 174 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 923 KiB/s rd, 2.5 MiB/s wr, 365 op/s 2026-02-20T03:26:09.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:09 trial028 ceph-mon[38552]: pgmap v526: 129 pgs: 129 active+clean; 174 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 923 KiB/s rd, 2.5 MiB/s wr, 365 op/s 2026-02-20T03:26:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:09 trial177 ceph-mon[43181]: pgmap v526: 129 pgs: 129 active+clean; 174 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 923 KiB/s rd, 2.5 MiB/s wr, 365 op/s 2026-02-20T03:26:10.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1013305 8.36 MB/sec execute 463 sec latency 9.024 ms 2026-02-20T03:26:11.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1017029 8.38 MB/sec execute 464 sec latency 6.040 ms 2026-02-20T03:26:11.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:11 trial126 ceph-mon[38476]: pgmap v527: 129 pgs: 129 active+clean; 175 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 854 KiB/s rd, 2.2 MiB/s wr, 369 op/s 2026-02-20T03:26:11.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:11 trial028 ceph-mon[38552]: pgmap v527: 129 pgs: 129 active+clean; 175 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 854 KiB/s rd, 2.2 MiB/s wr, 369 op/s 2026-02-20T03:26:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:11 trial177 ceph-mon[43181]: pgmap v527: 129 pgs: 129 active+clean; 175 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 854 KiB/s rd, 2.2 MiB/s wr, 369 op/s 2026-02-20T03:26:12.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.058+0000 7fd5f7577640 1 -- 10.20.193.28:0/609758314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f81026b0 msgr2=0x7fd5f8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:12.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.058+0000 7fd5f7577640 1 --2- 10.20.193.28:0/609758314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f81026b0 0x7fd5f8102ab0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009a30 tx=0x7fd5ec02f220 comp rx=0 tx=0).stop 2026-02-20T03:26:12.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.058+0000 7fd5f7577640 1 -- 10.20.193.28:0/609758314 shutdown_connections 2026-02-20T03:26:12.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.058+0000 7fd5f7577640 1 --2- 10.20.193.28:0/609758314 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5f8104260 0x7fd5f810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.058+0000 7fd5f7577640 1 --2- 10.20.193.28:0/609758314 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5f81038a0 0x7fd5f8103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.058+0000 7fd5f7577640 1 --2- 10.20.193.28:0/609758314 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f81026b0 0x7fd5f8102ab0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.058+0000 7fd5f7577640 1 -- 10.20.193.28:0/609758314 >> 10.20.193.28:0/609758314 conn(0x7fd5f80fde10 msgr2=0x7fd5f8100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.058+0000 7fd5f7577640 1 -- 10.20.193.28:0/609758314 shutdown_connections 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.058+0000 7fd5f7577640 1 -- 10.20.193.28:0/609758314 wait complete. 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f7577640 1 Processor -- start 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f7577640 1 -- start start 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f7577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5f81026b0 0x7fd5f8076e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f7577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5f81038a0 0x7fd5f8075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f7577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f8104260 0x7fd5f80759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f7577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f810e1b0 con 0x7fd5f8104260 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f7577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f810e030 con 0x7fd5f81026b0 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f7577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f810e330 con 0x7fd5f81038a0 2026-02-20T03:26:12.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f8104260 0x7fd5f80759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f8104260 0x7fd5f80759a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36706/0 (socket says 10.20.193.28:36706) 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f6d76640 1 -- 10.20.193.28:0/1144702478 learned_addr learned my addr 10.20.193.28:0/1144702478 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f6575640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5f81026b0 0x7fd5f8076e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f5d74640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5f81038a0 0x7fd5f8075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f6d76640 1 -- 10.20.193.28:0/1144702478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5f81038a0 msgr2=0x7fd5f8075460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f6d76640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5f81038a0 0x7fd5f8075460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f6d76640 1 -- 10.20.193.28:0/1144702478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5f81026b0 msgr2=0x7fd5f8076e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f6d76640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5f81026b0 0x7fd5f8076e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.059+0000 7fd5f6d76640 1 -- 10.20.193.28:0/1144702478 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f8075ee0 con 0x7fd5f8104260 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.060+0000 7fd5f6d76640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f8104260 0x7fd5f80759a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8007ee0 tx=0x7fd5e800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.060+0000 7fd5df7fe640 1 -- 10.20.193.28:0/1144702478 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8002a60 con 0x7fd5f8104260 2026-02-20T03:26:12.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.060+0000 7fd5df7fe640 1 -- 10.20.193.28:0/1144702478 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd5e8002c00 con 0x7fd5f8104260 2026-02-20T03:26:12.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.060+0000 7fd5df7fe640 1 -- 10.20.193.28:0/1144702478 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80137b0 con 0x7fd5f8104260 2026-02-20T03:26:12.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.060+0000 7fd5f7577640 1 -- 10.20.193.28:0/1144702478 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f8076170 con 0x7fd5f8104260 2026-02-20T03:26:12.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.060+0000 7fd5f7577640 1 -- 10.20.193.28:0/1144702478 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f81a95b0 con 0x7fd5f8104260 2026-02-20T03:26:12.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.063+0000 7fd5df7fe640 1 -- 10.20.193.28:0/1144702478 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd5e8012070 con 0x7fd5f8104260 2026-02-20T03:26:12.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.065+0000 7fd5df7fe640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5c80b0ea0 0x7fd5c80b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.065+0000 7fd5df7fe640 1 -- 10.20.193.28:0/1144702478 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd5e80e03b0 con 0x7fd5f8104260 2026-02-20T03:26:12.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.065+0000 7fd5ffc06e00 1 Processor -- start 2026-02-20T03:26:12.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.065+0000 7fd5ffc06e00 1 -- start start 2026-02-20T03:26:12.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 0x55b2d6992280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d6996f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d6997560 0x55b2d69999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b2d68e28f0 con 0x55b2d69927c0 2026-02-20T03:26:12.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b2d68902e0 con 0x55b2d6997560 2026-02-20T03:26:12.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b2d68de820 con 0x55b2d6991e80 2026-02-20T03:26:12.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f6575640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5c80b0ea0 0x7fd5c80b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d6996f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d6996f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36708/0 (socket says 10.20.193.28:36708) 2026-02-20T03:26:12.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f5d74640 1 -- 10.20.193.28:0/3154038400 learned_addr learned my addr 10.20.193.28:0/3154038400 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:12.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f5d74640 1 -- 10.20.193.28:0/3154038400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 msgr2=0x55b2d6992280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:12.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f5d74640 1 --2- 10.20.193.28:0/3154038400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 0x55b2d6992280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f5d74640 1 -- 10.20.193.28:0/3154038400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d6997560 msgr2=0x55b2d69999f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:12.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f5d74640 1 --2- 10.20.193.28:0/3154038400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d6997560 0x55b2d69999f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f5d74640 1 -- 10.20.193.28:0/3154038400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d68825a0 con 0x55b2d69927c0 2026-02-20T03:26:12.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f6575640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5c80b0ea0 0x7fd5c80b3360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec002410 tx=0x7fd5ec0057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:12.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5f5d74640 1 --2- 10.20.193.28:0/3154038400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d6996f40 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0002760 tx=0x7fd5e0002c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6969c2cb977a906 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:12.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5dcff9640 1 -- 10.20.193.28:0/3154038400 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0009e10 con 0x55b2d69927c0 2026-02-20T03:26:12.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5dcff9640 1 -- 10.20.193.28:0/3154038400 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd5e0015070 con 0x55b2d69927c0 2026-02-20T03:26:12.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.066+0000 7fd5dcff9640 1 -- 10.20.193.28:0/3154038400 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e001a750 con 0x55b2d69927c0 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/3154038400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 msgr2=0x55b2d6996f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/3154038400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d6996f40 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0002760 tx=0x7fd5e0002c30 comp rx=0 tx=0).stop 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/3154038400 shutdown_connections 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/3154038400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d6997560 0x55b2d69999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/3154038400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d6996f40 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/3154038400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 0x55b2d6992280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/3154038400 >> 10.20.193.28:0/3154038400 conn(0x55b2d69896f0 msgr2=0x55b2d6990570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/3154038400 shutdown_connections 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/3154038400 wait complete. 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- start start 2026-02-20T03:26:12.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 Processor -- start 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 0x55b2d69aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d69927c0 0x55b2d69aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6997560 0x55b2d69b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b2d688a0c0 con 0x55b2d6997560 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b2d699a610 con 0x55b2d69927c0 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b2d69b24f0 con 0x55b2d6991e80 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6997560 0x55b2d69b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6997560 0x55b2d69b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36722/0 (socket says 10.20.193.28:36722) 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5f6d76640 1 -- 10.20.193.28:0/1959832303 learned_addr learned my addr 10.20.193.28:0/1959832303 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5f6d76640 1 -- 10.20.193.28:0/1959832303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 msgr2=0x55b2d69aaaa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5f6d76640 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 0x55b2d69aaaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5f6d76640 1 -- 10.20.193.28:0/1959832303 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d69927c0 msgr2=0x55b2d69aafe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:12.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5f6d76640 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d69927c0 0x55b2d69aafe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5f6d76640 1 -- 10.20.193.28:0/1959832303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d69a41d0 con 0x55b2d6997560 2026-02-20T03:26:12.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5f6d76640 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6997560 0x55b2d69b1f60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80dda20 tx=0x7fd5e80a7880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6904351582996a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:12.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5a7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:12.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5a7fff640 1 -- 10.20.193.28:0/1959832303 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80b12f0 con 0x55b2d6997560 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5a7fff640 1 -- 10.20.193.28:0/1959832303 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd5e80e0160 con 0x55b2d6997560 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5a7fff640 1 -- 10.20.193.28:0/1959832303 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8090330 con 0x55b2d6997560 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/1959832303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2d689e820 con 0x55b2d6997560 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5a7fff640 1 -- 10.20.193.28:0/1959832303 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd5e80ac0d0 con 0x55b2d6997560 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 10 client.18456 _ll_register_callbacks cb 0x55b2d688dff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/1959832303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b2d68ea4e0 con 0x55b2d6997560 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5a7fff640 1 -- 10.20.193.28:0/1959832303 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd5e80a6b10 con 0x55b2d6997560 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 10 client.18456 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/1959832303 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b2d68a3380 con 0x55b2d6997560 2026-02-20T03:26:12.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5a7fff640 1 -- 10.20.193.28:0/1959832303 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd5e8094130 con 0x55b2d6997560 2026-02-20T03:26:12.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 10 client.18456 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:12.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 10 client.18456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:12.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 20 client.18456 populate_metadata read hostname 'trial028' 2026-02-20T03:26:12.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b2d69b67e0 0x55b2d69b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 4 client.18456 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:12.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.067+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/1959832303 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2d6864bd0 con 0x55b2d69b67e0 2026-02-20T03:26:12.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.077+0000 7fd5f6575640 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b2d69b67e0 0x55b2d69b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.079+0000 7fd5f6575640 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b2d69b67e0 0x55b2d69b8ca0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d83c94c781a88676 server_cookie=f38011506be4fead in_seq=0 out_seq=0 2026-02-20T03:26:12.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.079+0000 7fd5a7fff640 10 client.18456 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:12.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.079+0000 7fd5a7fff640 1 -- 10.20.193.28:0/1959832303 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b2d6864bd0 con 0x55b2d69b67e0 2026-02-20T03:26:12.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.079+0000 7fd5a7fff640 10 client.18456 handle_command_reply: tid=0 2026-02-20T03:26:12.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.079+0000 7fd5ffc06e00 1 client.18456 shutdown 2026-02-20T03:26:12.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.080+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/1959832303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6997560 msgr2=0x55b2d69b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:12.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.080+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6997560 0x55b2d69b1f60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd5e80dda20 tx=0x7fd5e80a7880 comp rx=0 tx=0).stop 2026-02-20T03:26:12.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.081+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/1959832303 shutdown_connections 2026-02-20T03:26:12.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.081+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b2d69b67e0 0x55b2d69b8ca0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.081+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6997560 0x55b2d69b1f60 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.081+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d69927c0 0x55b2d69aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.081+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/1959832303 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 0x55b2d69aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.081+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/1959832303 >> 10.20.193.28:0/1959832303 conn(0x55b2d69896f0 msgr2=0x55b2d6998910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:12.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.081+0000 7fd5a7fff640 0 client.18456 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:12.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.081+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/1959832303 shutdown_connections 2026-02-20T03:26:12.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.081+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/1959832303 wait complete. 2026-02-20T03:26:12.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.082+0000 7fd5ffc06e00 20 client.18456 trim_cache size 0 max 16384 2026-02-20T03:26:12.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5ffc06e00 1 Processor -- start 2026-02-20T03:26:12.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5ffc06e00 1 -- start start 2026-02-20T03:26:12.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6991e80 0x55b2d69bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d69927c0 0x55b2d69bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6997560 0x55b2d69b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c012750 con 0x55b2d6991e80 2026-02-20T03:26:12.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c010020 con 0x55b2d69927c0 2026-02-20T03:26:12.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c00de10 con 0x55b2d6997560 2026-02-20T03:26:12.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5f6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6991e80 0x55b2d69bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5f6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6991e80 0x55b2d69bd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36738/0 (socket says 10.20.193.28:36738) 2026-02-20T03:26:12.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.090+0000 7fd5f6575640 1 -- 10.20.193.28:0/2578045031 learned_addr learned my addr 10.20.193.28:0/2578045031 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:12.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5f6575640 1 -- 10.20.193.28:0/2578045031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6997560 msgr2=0x55b2d69b1f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:12.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5f6575640 1 --2- 10.20.193.28:0/2578045031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6997560 0x55b2d69b1f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5f6575640 1 -- 10.20.193.28:0/2578045031 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d69927c0 msgr2=0x55b2d69bdaa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5f6575640 1 --2- 10.20.193.28:0/2578045031 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d69927c0 0x55b2d69bdaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5f6575640 1 -- 10.20.193.28:0/2578045031 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d69a4000 con 0x55b2d6991e80 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5f6575640 1 --2- 10.20.193.28:0/2578045031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6991e80 0x55b2d69bd560 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009a30 tx=0x7fd5ec03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902e39bc54ea856d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5be3ff640 1 -- 10.20.193.28:0/2578045031 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec038770 con 0x55b2d6991e80 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5be3ff640 1 -- 10.20.193.28:0/2578045031 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd5ec033040 con 0x55b2d6991e80 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5be3ff640 1 -- 10.20.193.28:0/2578045031 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec038770 con 0x55b2d6991e80 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/2578045031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6991e80 msgr2=0x55b2d69bd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/2578045031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6991e80 0x55b2d69bd560 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009a30 tx=0x7fd5ec03f000 comp rx=0 tx=0).stop 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.091+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/2578045031 shutdown_connections 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/2578045031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6997560 0x55b2d69b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/2578045031 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d69927c0 0x55b2d69bdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/2578045031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d6991e80 0x55b2d69bd560 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/2578045031 >> 10.20.193.28:0/2578045031 conn(0x55b2d69896f0 msgr2=0x55b2d69a72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/2578045031 shutdown_connections 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/2578045031 wait complete. 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 -- start start 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 Processor -- start 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 0x55b2d69b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d69b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d6997560 0x55b2d69b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c00e4e0 con 0x55b2d69927c0 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c00f950 con 0x55b2d6997560 2026-02-20T03:26:12.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.092+0000 7fd5ffc06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd59c00ebb0 con 0x55b2d6991e80 2026-02-20T03:26:12.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5f5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d69b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5f5d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d69b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36746/0 (socket says 10.20.193.28:36746) 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5f5d74640 1 -- 10.20.193.28:0/461269950 learned_addr learned my addr 10.20.193.28:0/461269950 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5f5d74640 1 -- 10.20.193.28:0/461269950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 msgr2=0x55b2d69b1a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5f5d74640 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 0x55b2d69b1a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5f5d74640 1 -- 10.20.193.28:0/461269950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d6997560 msgr2=0x55b2d69b01f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5f5d74640 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d6997560 0x55b2d69b01f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5f5d74640 1 -- 10.20.193.28:0/461269950 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2d6642690 con 0x55b2d69927c0 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5f5d74640 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d69b1fb0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x55b2d6992eb0 tx=0x7fd5e0009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa55e663d1bd97d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5a7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:12.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5a7fff640 1 -- 10.20.193.28:0/461269950 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0011650 con 0x55b2d69927c0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5a7fff640 1 -- 10.20.193.28:0/461269950 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd5e0011c90 con 0x55b2d69927c0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5a7fff640 1 -- 10.20.193.28:0/461269950 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0027c40 con 0x55b2d69927c0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/461269950 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2d68a7b70 con 0x55b2d69927c0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5a7fff640 1 -- 10.20.193.28:0/461269950 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd5e001a420 con 0x55b2d69927c0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5ffc06e00 10 client.18462 _ll_register_callbacks cb 0x7fd5e80a7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.093+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/461269950 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5e0015070 con 0x55b2d69927c0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5a7fff640 1 -- 10.20.193.28:0/461269950 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd5e0011e40 con 0x55b2d69927c0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5ffc06e00 10 client.18462 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/461269950 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b2d69a4cf0 con 0x55b2d69927c0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5a7fff640 1 -- 10.20.193.28:0/461269950 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd5e002f030 con 0x55b2d69927c0 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5ffc06e00 10 client.18462 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5ffc06e00 10 client.18462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:12.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5ffc06e00 20 client.18462 populate_metadata read hostname 'trial028' 2026-02-20T03:26:12.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b2d6a22570 0x55b2d6a24a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:12.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5ffc06e00 4 client.18462 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:26:12.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.094+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/461269950 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2d68b36b0 con 0x55b2d6a22570 2026-02-20T03:26:12.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.103+0000 7fd5f6575640 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b2d6a22570 0x55b2d6a24a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:12.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.103+0000 7fd5f6575640 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b2d6a22570 0x55b2d6a24a00 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b2d83d665a0a619 server_cookie=9e9de4fca5d41661 in_seq=0 out_seq=0 2026-02-20T03:26:12.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.103+0000 7fd5a7fff640 10 client.18462 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:12.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.246+0000 7fd5a7fff640 1 -- 10.20.193.28:0/461269950 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2d68b36b0 con 0x55b2d6a22570 2026-02-20T03:26:12.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.246+0000 7fd5a7fff640 10 client.18462 handle_command_reply: tid=0 2026-02-20T03:26:12.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.246+0000 7fd5ffc06e00 1 client.18462 shutdown 2026-02-20T03:26:12.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/461269950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 msgr2=0x55b2d69b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:12.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d69b1fb0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x55b2d6992eb0 tx=0x7fd5e0009e40 comp rx=0 tx=0).stop 2026-02-20T03:26:12.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/461269950 shutdown_connections 2026-02-20T03:26:12.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b2d6a22570 0x55b2d6a24a00 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b2d6997560 0x55b2d69b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b2d69927c0 0x55b2d69b1fb0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 --2- 10.20.193.28:0/461269950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b2d6991e80 0x55b2d69b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5a7fff640 0 client.18462 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:12.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/461269950 >> 10.20.193.28:0/461269950 conn(0x55b2d69896f0 msgr2=0x55b2d69a7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:12.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/461269950 shutdown_connections 2026-02-20T03:26:12.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 1 -- 10.20.193.28:0/461269950 wait complete. 2026-02-20T03:26:12.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5ffc06e00 20 client.18462 trim_cache size 0 max 16384 2026-02-20T03:26:12.262 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:26:12.263 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:26:12.263 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:26:12.263 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:26:12.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5f7577640 1 -- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5c80b0ea0 msgr2=0x7fd5c80b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:12.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.247+0000 7fd5f7577640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5c80b0ea0 0x7fd5c80b3360 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec002410 tx=0x7fd5ec0057d0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 -- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f8104260 msgr2=0x7fd5f80759a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:12.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f8104260 0x7fd5f80759a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8007ee0 tx=0x7fd5e800d4a0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 -- 10.20.193.28:0/1144702478 shutdown_connections 2026-02-20T03:26:12.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5c80b0ea0 0x7fd5c80b3360 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd5f8104260 0x7fd5f80759a0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd5f81038a0 0x7fd5f8075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 --2- 10.20.193.28:0/1144702478 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd5f81026b0 0x7fd5f8076e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:12.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 -- 10.20.193.28:0/1144702478 >> 10.20.193.28:0/1144702478 conn(0x7fd5f80fde10 msgr2=0x7fd5f8106d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:12.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 -- 10.20.193.28:0/1144702478 shutdown_connections 2026-02-20T03:26:12.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:12.248+0000 7fd5f7577640 1 -- 10.20.193.28:0/1144702478 wait complete. 2026-02-20T03:26:12.522 INFO:tasks.workunit.client.0.trial028.stdout: 1 1019557 8.40 MB/sec execute 465 sec latency 512.025 ms 2026-02-20T03:26:13.339 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:13 trial028 ceph-mon[38552]: pgmap v528: 129 pgs: 129 active+clean; 175 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 472 KiB/s rd, 1.6 MiB/s wr, 200 op/s 2026-02-20T03:26:13.523 INFO:tasks.workunit.client.0.trial028.stdout: 1 1019557 8.38 MB/sec execute 466 sec latency 1512.065 ms 2026-02-20T03:26:13.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:13 trial126 ceph-mon[38476]: pgmap v528: 129 pgs: 129 active+clean; 175 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 472 KiB/s rd, 1.6 MiB/s wr, 200 op/s 2026-02-20T03:26:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:13 trial177 ceph-mon[43181]: pgmap v528: 129 pgs: 129 active+clean; 175 MiB data, 3.6 GiB used, 8.2 TiB / 8.2 TiB avail; 472 KiB/s rd, 1.6 MiB/s wr, 200 op/s 2026-02-20T03:26:14.523 INFO:tasks.workunit.client.0.trial028.stdout: 1 1020202 8.36 MB/sec execute 467 sec latency 1693.632 ms 2026-02-20T03:26:15.523 INFO:tasks.workunit.client.0.trial028.stdout: 1 1023822 8.39 MB/sec execute 468 sec latency 9.875 ms 2026-02-20T03:26:15.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:15 trial126 ceph-mon[38476]: pgmap v529: 129 pgs: 129 active+clean; 175 MiB data, 3.7 GiB used, 8.2 TiB / 8.2 TiB avail; 749 KiB/s rd, 1.9 MiB/s wr, 267 op/s 2026-02-20T03:26:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:15 trial028 ceph-mon[38552]: pgmap v529: 129 pgs: 129 active+clean; 175 MiB data, 3.7 GiB used, 8.2 TiB / 8.2 TiB avail; 749 KiB/s rd, 1.9 MiB/s wr, 267 op/s 2026-02-20T03:26:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:15 trial177 ceph-mon[43181]: pgmap v529: 129 pgs: 129 active+clean; 175 MiB data, 3.7 GiB used, 8.2 TiB / 8.2 TiB avail; 749 KiB/s rd, 1.9 MiB/s wr, 267 op/s 2026-02-20T03:26:16.262 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2026-02-20T03:26:16.262 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2026-02-20T03:26:16.262 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:26:16.523 INFO:tasks.workunit.client.0.trial028.stdout: 1 1027411 8.41 MB/sec execute 469 sec latency 6.483 ms 2026-02-20T03:26:16.537 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:16.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.732+0000 7f90b28b4640 1 -- 10.20.193.28:0/162392407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109ba0 msgr2=0x7f90ac115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:16.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.732+0000 7f90b28b4640 1 --2- 10.20.193.28:0/162392407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109ba0 0x7f90ac115d10 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f90a800b0a0 tx=0x7f90a802f450 comp rx=0 tx=0).stop 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.732+0000 7f90b28b4640 1 -- 10.20.193.28:0/162392407 shutdown_connections 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.732+0000 7f90b28b4640 1 --2- 10.20.193.28:0/162392407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109ba0 0x7f90ac115d10 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.732+0000 7f90b28b4640 1 --2- 10.20.193.28:0/162392407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ac109220 0x7f90ac109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.732+0000 7f90b28b4640 1 --2- 10.20.193.28:0/162392407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ac10eef0 0x7f90ac10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.732+0000 7f90b28b4640 1 -- 10.20.193.28:0/162392407 >> 10.20.193.28:0/162392407 conn(0x7f90ac078600 msgr2=0x7f90ac07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.732+0000 7f90b28b4640 1 -- 10.20.193.28:0/162392407 shutdown_connections 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.732+0000 7f90b28b4640 1 -- 10.20.193.28:0/162392407 wait complete. 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.733+0000 7f90b28b4640 1 Processor -- start 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.733+0000 7f90b28b4640 1 -- start start 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.733+0000 7f90b28b4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109220 0x7f90ac1a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:16.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.733+0000 7f90b28b4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ac109ba0 0x7f90ac1a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.733+0000 7f90b28b4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ac10eef0 0x7f90ac1a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b28b4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac1190a0 con 0x7f90ac109220 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b28b4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac118f20 con 0x7f90ac10eef0 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b28b4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac119220 con 0x7f90ac109ba0 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b18b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109220 0x7f90ac1a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b18b2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109220 0x7f90ac1a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51480/0 (socket says 10.20.193.28:51480) 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b18b2640 1 -- 10.20.193.28:0/3177481321 learned_addr learned my addr 10.20.193.28:0/3177481321 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b20b3640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ac10eef0 0x7f90ac1a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b10b1640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ac109ba0 0x7f90ac1a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b18b2640 1 -- 10.20.193.28:0/3177481321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ac109ba0 msgr2=0x7f90ac1a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:16.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b18b2640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ac109ba0 0x7f90ac1a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:16.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b18b2640 1 -- 10.20.193.28:0/3177481321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ac10eef0 msgr2=0x7f90ac1a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:16.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b18b2640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ac10eef0 0x7f90ac1a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:16.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b18b2640 1 -- 10.20.193.28:0/3177481321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac1a6490 con 0x7f90ac109220 2026-02-20T03:26:16.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b18b2640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109220 0x7f90ac1a1440 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f909c00ea30 tx=0x7f909c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:16.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f909affd640 1 -- 10.20.193.28:0/3177481321 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c00ce50 con 0x7f90ac109220 2026-02-20T03:26:16.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f909affd640 1 -- 10.20.193.28:0/3177481321 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f909c004570 con 0x7f90ac109220 2026-02-20T03:26:16.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f909affd640 1 -- 10.20.193.28:0/3177481321 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c010690 con 0x7f90ac109220 2026-02-20T03:26:16.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac1a6780 con 0x7f90ac109220 2026-02-20T03:26:16.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.734+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac1adfc0 con 0x7f90ac109220 2026-02-20T03:26:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.735+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9074005390 con 0x7f90ac109220 2026-02-20T03:26:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.737+0000 7f909affd640 1 -- 10.20.193.28:0/3177481321 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f909c0040d0 con 0x7f90ac109220 2026-02-20T03:26:16.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.738+0000 7f909affd640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90880b0e20 0x7f90880b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.739+0000 7f909affd640 1 -- 10.20.193.28:0/3177481321 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f909c0e0fa0 con 0x7f90ac109220 2026-02-20T03:26:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.739+0000 7f90b10b1640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90880b0e20 0x7f90880b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.739+0000 7f90b10b1640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90880b0e20 0x7f90880b32e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f90ac10e570 tx=0x7f90a0005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:16.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.740+0000 7f909affd640 1 -- 10.20.193.28:0/3177481321 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f909c0a9380 con 0x7f90ac109220 2026-02-20T03:26:16.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.849+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9074005680 con 0x7f90ac109220 2026-02-20T03:26:16.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.850+0000 7f909affd640 1 -- 10.20.193.28:0/3177481321 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11921 (secure 0 0 0) 0x7f909c0ad030 con 0x7f90ac109220 2026-02-20T03:26:16.853 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:26:16.853 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T03:25:19:519285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:25:19.519275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:26:16.854 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T03:26:16.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90880b0e20 msgr2=0x7f90880b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:16.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90880b0e20 0x7f90880b32e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f90ac10e570 tx=0x7f90a0005f50 comp rx=0 tx=0).stop 2026-02-20T03:26:16.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109220 msgr2=0x7f90ac1a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:16.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109220 0x7f90ac1a1440 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f909c00ea30 tx=0x7f909c00ef00 comp rx=0 tx=0).stop 2026-02-20T03:26:16.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 shutdown_connections 2026-02-20T03:26:16.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90880b0e20 0x7f90880b32e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:16.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f90ac10eef0 0x7f90ac1a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:16.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90ac109ba0 0x7f90ac1a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:16.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 --2- 10.20.193.28:0/3177481321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f90ac109220 0x7f90ac1a1440 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:16.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 >> 10.20.193.28:0/3177481321 conn(0x7f90ac078600 msgr2=0x7f90ac079d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:16.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 shutdown_connections 2026-02-20T03:26:16.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:16.851+0000 7f90b28b4640 1 -- 10.20.193.28:0/3177481321 wait complete. 2026-02-20T03:26:16.954 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2026-02-20T03:26:16.955 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2026-02-20T03:26:17.241 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:17.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:17 trial028 ceph-mon[38552]: pgmap v530: 129 pgs: 129 active+clean; 176 MiB data, 3.7 GiB used, 8.2 TiB / 8.2 TiB avail; 590 KiB/s rd, 2.3 MiB/s wr, 279 op/s 2026-02-20T03:26:17.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:17 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3177481321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:17.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.501+0000 7fbc003d4640 1 -- 10.20.193.28:0/2336334522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8104da0 msgr2=0x7fbbf8105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:17.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.501+0000 7fbc003d4640 1 --2- 10.20.193.28:0/2336334522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8104da0 0x7fbbf8105180 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009a30 tx=0x7fbbe802f260 comp rx=0 tx=0).stop 2026-02-20T03:26:17.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.501+0000 7fbc003d4640 1 -- 10.20.193.28:0/2336334522 shutdown_connections 2026-02-20T03:26:17.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.501+0000 7fbc003d4640 1 --2- 10.20.193.28:0/2336334522 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbbf8109ed0 0x7fbbf8111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.501+0000 7fbc003d4640 1 --2- 10.20.193.28:0/2336334522 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbf8105750 0x7fbbf81097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.501+0000 7fbc003d4640 1 --2- 10.20.193.28:0/2336334522 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8104da0 0x7fbbf8105180 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.501+0000 7fbc003d4640 1 -- 10.20.193.28:0/2336334522 >> 10.20.193.28:0/2336334522 conn(0x7fbbf8100840 msgr2=0x7fbbf8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:17.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.501+0000 7fbc003d4640 1 -- 10.20.193.28:0/2336334522 shutdown_connections 2026-02-20T03:26:17.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.501+0000 7fbc003d4640 1 -- 10.20.193.28:0/2336334522 wait complete. 2026-02-20T03:26:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.502+0000 7fbc003d4640 1 Processor -- start 2026-02-20T03:26:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.502+0000 7fbc003d4640 1 -- start start 2026-02-20T03:26:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.502+0000 7fbc003d4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbbf8104da0 0x7fbbf8077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.502+0000 7fbc003d4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbf8105750 0x7fbbf8077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.502+0000 7fbc003d4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8109ed0 0x7fbbf8078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.502+0000 7fbc003d4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf8114e80 con 0x7fbbf8109ed0 2026-02-20T03:26:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.502+0000 7fbc003d4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf8114d00 con 0x7fbbf8105750 2026-02-20T03:26:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.502+0000 7fbc003d4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf8115000 con 0x7fbbf8104da0 2026-02-20T03:26:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.502+0000 7fbbfe94a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8109ed0 0x7fbbf8078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbfe94a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8109ed0 0x7fbbf8078080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51504/0 (socket says 10.20.193.28:51504) 2026-02-20T03:26:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbfe94a640 1 -- 10.20.193.28:0/1350656661 learned_addr learned my addr 10.20.193.28:0/1350656661 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbfe94a640 1 -- 10.20.193.28:0/1350656661 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbbf8104da0 msgr2=0x7fbbf8077600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbbf8104da0 0x7fbbf8077600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbfe94a640 1 -- 10.20.193.28:0/1350656661 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbf8105750 msgr2=0x7fbbf8077b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbf8105750 0x7fbbf8077b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbfe94a640 1 -- 10.20.193.28:0/1350656661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf81adb70 con 0x7fbbf8109ed0 2026-02-20T03:26:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8109ed0 0x7fbbf8078080 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400b9c0 tx=0x7fbbf400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbdf7fe640 1 -- 10.20.193.28:0/1350656661 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4006e60 con 0x7fbbf8109ed0 2026-02-20T03:26:17.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbdf7fe640 1 -- 10.20.193.28:0/1350656661 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbbf4010070 con 0x7fbbf8109ed0 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbbdf7fe640 1 -- 10.20.193.28:0/1350656661 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40047f0 con 0x7fbbf8109ed0 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbc003d4640 1 -- 10.20.193.28:0/1350656661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf81ade60 con 0x7fbbf8109ed0 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.503+0000 7fbc003d4640 1 -- 10.20.193.28:0/1350656661 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf81ae2c0 con 0x7fbbf8109ed0 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.506+0000 7fbbdf7fe640 1 -- 10.20.193.28:0/1350656661 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbbf400c790 con 0x7fbbf8109ed0 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.506+0000 7fbc028d9e00 1 Processor -- start 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbc028d9e00 1 -- start start 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed0d070 0x560b3ed0d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed07860 0x560b3ed07cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed13dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560b3ec5a410 con 0x560b3ed08200 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560b3ec078b0 con 0x560b3ed07860 2026-02-20T03:26:17.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560b3ec56340 con 0x560b3ed0d070 2026-02-20T03:26:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbbfd948640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed13dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbbfd948640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed13dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51520/0 (socket says 10.20.193.28:51520) 2026-02-20T03:26:17.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbbfd948640 1 -- 10.20.193.28:0/1973729638 learned_addr learned my addr 10.20.193.28:0/1973729638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbbfd948640 1 -- 10.20.193.28:0/1973729638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed0d070 msgr2=0x560b3ed0d450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbbfd948640 1 --2- 10.20.193.28:0/1973729638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed0d070 0x560b3ed0d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbbfd948640 1 -- 10.20.193.28:0/1973729638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed07860 msgr2=0x560b3ed07cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbbfd948640 1 --2- 10.20.193.28:0/1973729638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed07860 0x560b3ed07cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.507+0000 7fbbfd948640 1 -- 10.20.193.28:0/1973729638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3ebf98c0 con 0x560b3ed08200 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbbfd948640 1 --2- 10.20.193.28:0/1973729638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed13dc0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009860 tx=0x7fbbec009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5513f5c64e8afcbf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbbdca08640 1 -- 10.20.193.28:0/1973729638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec016070 con 0x560b3ed08200 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbbdca08640 1 -- 10.20.193.28:0/1973729638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbbec002870 con 0x560b3ed08200 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbbdca08640 1 -- 10.20.193.28:0/1973729638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec004600 con 0x560b3ed08200 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbbdf7fe640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbbd40b0e20 0x7fbbd40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbbdf7fe640 1 -- 10.20.193.28:0/1350656661 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fbbf40e0360 con 0x7fbbf8109ed0 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1973729638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 msgr2=0x560b3ed13dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1973729638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed13dc0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009860 tx=0x7fbbec009d30 comp rx=0 tx=0).stop 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1973729638 shutdown_connections 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1973729638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed13dc0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1973729638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed07860 0x560b3ed07cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1973729638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed0d070 0x560b3ed0d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1973729638 >> 10.20.193.28:0/1973729638 conn(0x560b3ed003c0 msgr2=0x560b3ed05f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbbfe149640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbbd40b0e20 0x7fbbd40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:17.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1973729638 shutdown_connections 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.508+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1973729638 wait complete. 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbc028d9e00 1 -- start start 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbbfe149640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbbd40b0e20 0x7fbbd40b32e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbbe802f770 tx=0x7fbbe80023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbc028d9e00 1 Processor -- start 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed07860 0x560b3ed222e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed08200 0x560b3ed22820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed0d070 0x560b3ed20a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560b3ec014a0 con 0x560b3ed0d070 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560b3ed14460 con 0x560b3ed08200 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560b3ed210d0 con 0x560b3ed07860 2026-02-20T03:26:17.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbbfe94a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed0d070 0x560b3ed20a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbbfe94a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed0d070 0x560b3ed20a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51530/0 (socket says 10.20.193.28:51530) 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.510+0000 7fbbfe94a640 1 -- 10.20.193.28:0/1005885190 learned_addr learned my addr 10.20.193.28:0/1005885190 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbfe94a640 1 -- 10.20.193.28:0/1005885190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed07860 msgr2=0x560b3ed222e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed07860 0x560b3ed222e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbfe94a640 1 -- 10.20.193.28:0/1005885190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed08200 msgr2=0x560b3ed22820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed08200 0x560b3ed22820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbfe94a640 1 -- 10.20.193.28:0/1005885190 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3ed19dc0 con 0x560b3ed0d070 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed0d070 0x560b3ed20a90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40a7fd0 tx=0x7fbbf400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cee4b69cd7a7090 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbabfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbabfff640 1 -- 10.20.193.28:0/1005885190 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ca030 con 0x560b3ed0d070 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbabfff640 1 -- 10.20.193.28:0/1005885190 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbbf40ac3f0 con 0x560b3ed0d070 2026-02-20T03:26:17.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbabfff640 1 -- 10.20.193.28:0/1005885190 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40cad40 con 0x560b3ed0d070 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1005885190 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3e9be8a0 con 0x560b3ed0d070 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbc028d9e00 10 client.18480 _ll_register_callbacks cb 0x560b3ec053d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1005885190 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b3ec62000 con 0x560b3ed0d070 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbabfff640 1 -- 10.20.193.28:0/1005885190 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fbbf4094170 con 0x560b3ed0d070 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbbabfff640 1 -- 10.20.193.28:0/1005885190 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbbf4090420 con 0x560b3ed0d070 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbc028d9e00 10 client.18480 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.511+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1005885190 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x560b3ea2a0e0 con 0x560b3ed0d070 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.512+0000 7fbbabfff640 1 -- 10.20.193.28:0/1005885190 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fbbf40a7050 con 0x560b3ed0d070 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.512+0000 7fbc028d9e00 10 client.18480 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.512+0000 7fbc028d9e00 10 client.18480 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.512+0000 7fbc028d9e00 20 client.18480 populate_metadata read hostname 'trial028' 2026-02-20T03:26:17.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.512+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b3ed30840 0x560b3ed32c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.512+0000 7fbc028d9e00 4 client.18480 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:17.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.512+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1005885190 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b3ebdbf60 con 0x560b3ed30840 2026-02-20T03:26:17.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030194 8.43 MB/sec execute 470 sec latency 282.462 ms 2026-02-20T03:26:17.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.533+0000 7fbbfe149640 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b3ed30840 0x560b3ed32c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:17 trial126 ceph-mon[38476]: pgmap v530: 129 pgs: 129 active+clean; 176 MiB data, 3.7 GiB used, 8.2 TiB / 8.2 TiB avail; 590 KiB/s rd, 2.3 MiB/s wr, 279 op/s 2026-02-20T03:26:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:17 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3177481321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:17.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.600+0000 7fbbfe149640 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b3ed30840 0x560b3ed32c90 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbac50c80d291338 server_cookie=a4e8fb1763d80ffe in_seq=0 out_seq=0 2026-02-20T03:26:17.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.600+0000 7fbbabfff640 10 client.18480 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:17.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbbabfff640 1 -- 10.20.193.28:0/1005885190 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560b3ebdbf60 con 0x560b3ed30840 2026-02-20T03:26:17.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbbabfff640 10 client.18480 handle_command_reply: tid=0 2026-02-20T03:26:17.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 client.18480 shutdown 2026-02-20T03:26:17.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1005885190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed0d070 msgr2=0x560b3ed20a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:17.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed0d070 0x560b3ed20a90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40a7fd0 tx=0x7fbbf400cd30 comp rx=0 tx=0).stop 2026-02-20T03:26:17.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1005885190 shutdown_connections 2026-02-20T03:26:17.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b3ed30840 0x560b3ed32c90 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed0d070 0x560b3ed20a90 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed08200 0x560b3ed22820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/1005885190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed07860 0x560b3ed222e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1005885190 >> 10.20.193.28:0/1005885190 conn(0x560b3ed003c0 msgr2=0x560b3ed06670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:17.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbbabfff640 0 client.18480 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:17.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1005885190 shutdown_connections 2026-02-20T03:26:17.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 1 -- 10.20.193.28:0/1005885190 wait complete. 2026-02-20T03:26:17.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.627+0000 7fbc028d9e00 20 client.18480 trim_cache size 0 max 16384 2026-02-20T03:26:17.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.636+0000 7fbc028d9e00 1 Processor -- start 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.636+0000 7fbc028d9e00 1 -- start start 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.636+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed003c0 0x560b3ed1de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.636+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed07860 0x560b3ed1e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.636+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.636+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbba0012770 con 0x560b3ed08200 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.636+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbba0010040 con 0x560b3ed003c0 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.636+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbba000de90 con 0x560b3ed07860 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbfe94a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbfe94a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51532/0 (socket says 10.20.193.28:51532) 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbfe94a640 1 -- 10.20.193.28:0/3226997274 learned_addr learned my addr 10.20.193.28:0/3226997274 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:17.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbfe94a640 1 -- 10.20.193.28:0/3226997274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed07860 msgr2=0x560b3ed1e3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/3226997274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed07860 0x560b3ed1e3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbfe94a640 1 -- 10.20.193.28:0/3226997274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed003c0 msgr2=0x560b3ed1de70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/3226997274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed003c0 0x560b3ed1de70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbfe94a640 1 -- 10.20.193.28:0/3226997274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3ed19bf0 con 0x560b3ed08200 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/3226997274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed385a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40a7cf0 tx=0x7fbbf4093000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af45fedcfba983dc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbc64e6640 1 -- 10.20.193.28:0/3226997274 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ca040 con 0x560b3ed08200 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbc64e6640 1 -- 10.20.193.28:0/3226997274 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x560b3ec62000 con 0x560b3ed08200 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbbc64e6640 1 -- 10.20.193.28:0/3226997274 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40a7050 con 0x560b3ed08200 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbc028d9e00 1 -- 10.20.193.28:0/3226997274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 msgr2=0x560b3ed385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.637+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/3226997274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed385a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40a7cf0 tx=0x7fbbf4093000 comp rx=0 tx=0).stop 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.638+0000 7fbc028d9e00 1 -- 10.20.193.28:0/3226997274 shutdown_connections 2026-02-20T03:26:17.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.638+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/3226997274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed385a0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.638+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/3226997274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed07860 0x560b3ed1e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.638+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/3226997274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed003c0 0x560b3ed1de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.638+0000 7fbc028d9e00 1 -- 10.20.193.28:0/3226997274 >> 10.20.193.28:0/3226997274 conn(0x560b3ed32df0 msgr2=0x560b3ed222e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.638+0000 7fbc028d9e00 1 -- 10.20.193.28:0/3226997274 shutdown_connections 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.638+0000 7fbc028d9e00 1 -- 10.20.193.28:0/3226997274 wait complete. 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.638+0000 7fbc028d9e00 1 -- start start 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.638+0000 7fbc028d9e00 1 Processor -- start 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed003c0 0x560b3ed28730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed07860 0x560b3ed25a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbc028d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed25fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbba000e500 con 0x560b3ed08200 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbba000f970 con 0x560b3ed07860 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbc028d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbba000ebd0 con 0x560b3ed003c0 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbfe94a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed25fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbfe94a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed25fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51534/0 (socket says 10.20.193.28:51534) 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbfe94a640 1 -- 10.20.193.28:0/2592612305 learned_addr learned my addr 10.20.193.28:0/2592612305 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbfe94a640 1 -- 10.20.193.28:0/2592612305 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed003c0 msgr2=0x560b3ed28730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed003c0 0x560b3ed28730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbfe94a640 1 -- 10.20.193.28:0/2592612305 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed07860 msgr2=0x560b3ed25a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed07860 0x560b3ed25a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbfe94a640 1 -- 10.20.193.28:0/2592612305 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3ed197b0 con 0x560b3ed08200 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbfe94a640 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed25fa0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400b990 tx=0x7fbbf400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0092888328f294 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:17.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbabfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbabfff640 1 -- 10.20.193.28:0/2592612305 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40b6070 con 0x560b3ed08200 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbabfff640 1 -- 10.20.193.28:0/2592612305 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbbf40ac3f0 con 0x560b3ed08200 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbbabfff640 1 -- 10.20.193.28:0/2592612305 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ca040 con 0x560b3ed08200 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.639+0000 7fbc028d9e00 1 -- 10.20.193.28:0/2592612305 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b3e9db7f0 con 0x560b3ed08200 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.640+0000 7fbbabfff640 1 -- 10.20.193.28:0/2592612305 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fbbf40a38d0 con 0x560b3ed08200 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.640+0000 7fbc028d9e00 10 client.18486 _ll_register_callbacks cb 0x7fbbf40a7740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.640+0000 7fbc028d9e00 1 -- 10.20.193.28:0/2592612305 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbec002870 con 0x560b3ed08200 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.640+0000 7fbbabfff640 1 -- 10.20.193.28:0/2592612305 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fbbf40a3ad0 con 0x560b3ed08200 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.640+0000 7fbc028d9e00 10 client.18486 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.640+0000 7fbc028d9e00 1 -- 10.20.193.28:0/2592612305 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x560b3ed1a8e0 con 0x560b3ed08200 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.641+0000 7fbbabfff640 1 -- 10.20.193.28:0/2592612305 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fbbf40900f0 con 0x560b3ed08200 2026-02-20T03:26:17.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.641+0000 7fbc028d9e00 10 client.18486 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:17.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.641+0000 7fbc028d9e00 10 client.18486 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:26:17.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.641+0000 7fbc028d9e00 20 client.18486 populate_metadata read hostname 'trial028' 2026-02-20T03:26:17.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.641+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b3ed0d070 0x560b3ed9f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:17.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.641+0000 7fbc028d9e00 4 client.18486 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2026-02-20T03:26:17.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.641+0000 7fbc028d9e00 1 -- 10.20.193.28:0/2592612305 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x560b3e9caf60 con 0x560b3ed0d070 2026-02-20T03:26:17.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.667+0000 7fbbfe149640 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b3ed0d070 0x560b3ed9f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:17 trial177 ceph-mon[43181]: pgmap v530: 129 pgs: 129 active+clean; 176 MiB data, 3.7 GiB used, 8.2 TiB / 8.2 TiB avail; 590 KiB/s rd, 2.3 MiB/s wr, 279 op/s 2026-02-20T03:26:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:17 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3177481321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:17.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.733+0000 7fbbfe149640 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b3ed0d070 0x560b3ed9f080 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f30339f6659bb029 server_cookie=ddd6a3b2f5d35ec8 in_seq=0 out_seq=0 2026-02-20T03:26:17.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:17.733+0000 7fbbabfff640 10 client.18486 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:18.101 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:26:18.394 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:18.523 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030194 8.41 MB/sec execute 471 sec latency 1108.547 ms 2026-02-20T03:26:18.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.646+0000 7ff54ffff640 1 -- 10.20.193.28:0/1443441511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 msgr2=0x7ff550104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:18.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.646+0000 7ff54ffff640 1 --2- 10.20.193.28:0/1443441511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 0x7ff550104de0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ff538009a60 tx=0x7ff53802f290 comp rx=0 tx=0).stop 2026-02-20T03:26:18.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.646+0000 7ff54ffff640 1 -- 10.20.193.28:0/1443441511 shutdown_connections 2026-02-20T03:26:18.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.646+0000 7ff54ffff640 1 --2- 10.20.193.28:0/1443441511 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff550105320 0x7ff550111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.646+0000 7ff54ffff640 1 --2- 10.20.193.28:0/1443441511 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 0x7ff550104de0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.646+0000 7ff54ffff640 1 --2- 10.20.193.28:0/1443441511 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff55010a980 0x7ff55010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.646+0000 7ff54ffff640 1 -- 10.20.193.28:0/1443441511 >> 10.20.193.28:0/1443441511 conn(0x7ff550100680 msgr2=0x7ff550102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:18.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.646+0000 7ff54ffff640 1 -- 10.20.193.28:0/1443441511 shutdown_connections 2026-02-20T03:26:18.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.646+0000 7ff54ffff640 1 -- 10.20.193.28:0/1443441511 wait complete. 2026-02-20T03:26:18.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 Processor -- start 2026-02-20T03:26:18.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 -- start start 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 0x7ff550077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff550105320 0x7ff550077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff55010a980 0x7ff550078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff550114cd0 con 0x7ff550104980 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff550114b50 con 0x7ff55010a980 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff550114e50 con 0x7ff550105320 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 0x7ff550077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 0x7ff550077600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51558/0 (socket says 10.20.193.28:51558) 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54effd640 1 -- 10.20.193.28:0/689509025 learned_addr learned my addr 10.20.193.28:0/689509025 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54effd640 1 -- 10.20.193.28:0/689509025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff550105320 msgr2=0x7ff550077b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:18.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54effd640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff550105320 0x7ff550077b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54effd640 1 -- 10.20.193.28:0/689509025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff55010a980 msgr2=0x7ff550078080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:18.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54effd640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff55010a980 0x7ff550078080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54effd640 1 -- 10.20.193.28:0/689509025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5501adab0 con 0x7ff550104980 2026-02-20T03:26:18.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54effd640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 0x7ff550077600 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff54400b5a0 tx=0x7ff54400ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:18.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff52ffff640 1 -- 10.20.193.28:0/689509025 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544012070 con 0x7ff550104980 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff52ffff640 1 -- 10.20.193.28:0/689509025 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff544004480 con 0x7ff550104980 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff52ffff640 1 -- 10.20.193.28:0/689509025 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54400dac0 con 0x7ff550104980 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 -- 10.20.193.28:0/689509025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5501adda0 con 0x7ff550104980 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff54ffff640 1 -- 10.20.193.28:0/689509025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5501ae260 con 0x7ff550104980 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff52ffff640 1 -- 10.20.193.28:0/689509025 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff54400dce0 con 0x7ff550104980 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.649+0000 7ff557b72e00 1 Processor -- start 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff557b72e00 1 -- start start 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a66e000 0x557d1a66e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff54f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a66e000 0x557d1a66e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff54f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a66e000 0x557d1a66e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51560/0 (socket says 10.20.193.28:51560) 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a668630 0x557d1a668a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff54f7fe640 1 -- 10.20.193.28:0/1017182730 learned_addr learned my addr 10.20.193.28:0/1017182730 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1017182730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 0x557d1a674e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff557b72e00 1 -- 10.20.193.28:0/1017182730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557d1a5e8e50 con 0x557d1a66e000 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff557b72e00 1 -- 10.20.193.28:0/1017182730 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557d1a5bb9c0 con 0x557d1a668fb0 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff557b72e00 1 -- 10.20.193.28:0/1017182730 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557d1a569240 con 0x557d1a668630 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff54f7fe640 1 -- 10.20.193.28:0/1017182730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a668630 msgr2=0x557d1a668a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/1017182730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a668630 0x557d1a668a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff54f7fe640 1 -- 10.20.193.28:0/1017182730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 msgr2=0x557d1a674e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/1017182730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 0x557d1a674e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff54f7fe640 1 -- 10.20.193.28:0/1017182730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1a57c420 con 0x557d1a66e000 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff52ffff640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff5200b0ea0 0x7ff5200b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/1017182730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a66e000 0x557d1a66e3e0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff540009d20 tx=0x7ff54000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50575347e907523 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:18.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.654+0000 7ff52ffff640 1 -- 10.20.193.28:0/689509025 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ff5440e00d0 con 0x7ff550104980 2026-02-20T03:26:18.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff5177fe640 1 -- 10.20.193.28:0/1017182730 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540017070 con 0x557d1a66e000 2026-02-20T03:26:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff54effd640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff5200b0ea0 0x7ff5200b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff5177fe640 1 -- 10.20.193.28:0/1017182730 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff54000bd50 con 0x557d1a66e000 2026-02-20T03:26:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff5177fe640 1 -- 10.20.193.28:0/1017182730 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540006e60 con 0x557d1a66e000 2026-02-20T03:26:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 -- 10.20.193.28:0/1017182730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a66e000 msgr2=0x557d1a66e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1017182730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a66e000 0x557d1a66e3e0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff540009d20 tx=0x7ff54000b420 comp rx=0 tx=0).stop 2026-02-20T03:26:18.664 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 -- 10.20.193.28:0/1017182730 shutdown_connections 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1017182730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 0x557d1a674e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1017182730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a668630 0x557d1a668a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1017182730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a66e000 0x557d1a66e3e0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 -- 10.20.193.28:0/1017182730 >> 10.20.193.28:0/1017182730 conn(0x557d1a62b290 msgr2=0x557d1a666d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 -- 10.20.193.28:0/1017182730 shutdown_connections 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff54effd640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff5200b0ea0 0x7ff5200b3360 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff5440a7ab0 tx=0x7ff54400d510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 -- 10.20.193.28:0/1017182730 wait complete. 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 -- start start 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 Processor -- start 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a682ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 0x557d1a683430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a66e000 0x557d1a6816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557d1a5b78f0 con 0x557d1a668630 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557d1a3a9f50 con 0x557d1a668fb0 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.655+0000 7ff557b72e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557d1a681ce0 con 0x557d1a66e000 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff54f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a682ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff54f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a682ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51562/0 (socket says 10.20.193.28:51562) 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff54f7fe640 1 -- 10.20.193.28:0/1454422326 learned_addr learned my addr 10.20.193.28:0/1454422326 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff54f7fe640 1 -- 10.20.193.28:0/1454422326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a66e000 msgr2=0x557d1a6816a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a66e000 0x557d1a6816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff54f7fe640 1 -- 10.20.193.28:0/1454422326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 msgr2=0x557d1a683430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 0x557d1a683430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff54f7fe640 1 -- 10.20.193.28:0/1454422326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1a67ab20 con 0x557d1a668630 2026-02-20T03:26:18.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a682ef0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff5400049e0 tx=0x7ff540004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31abdeff4f082e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff514ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff514ff9640 1 -- 10.20.193.28:0/1454422326 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540017050 con 0x557d1a668630 2026-02-20T03:26:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff514ff9640 1 -- 10.20.193.28:0/1454422326 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff540018040 con 0x557d1a668630 2026-02-20T03:26:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff514ff9640 1 -- 10.20.193.28:0/1454422326 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54001cdf0 con 0x557d1a668630 2026-02-20T03:26:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 1 -- 10.20.193.28:0/1454422326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d1a38cb40 con 0x557d1a668630 2026-02-20T03:26:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff514ff9640 1 -- 10.20.193.28:0/1454422326 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ff54001e410 con 0x557d1a668630 2026-02-20T03:26:18.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff514ff9640 10 client.18498 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:26:18.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 10 client.18498 _ll_register_callbacks cb 0x557d1a5f4f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:18.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 1 -- 10.20.193.28:0/1454422326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d1a5c91a0 con 0x557d1a668630 2026-02-20T03:26:18.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff514ff9640 1 -- 10.20.193.28:0/1454422326 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff540002d10 con 0x557d1a668630 2026-02-20T03:26:18.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 10 client.18498 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:18.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 1 -- 10.20.193.28:0/1454422326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557d1a576230 con 0x557d1a668630 2026-02-20T03:26:18.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff514ff9640 1 -- 10.20.193.28:0/1454422326 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff540031060 con 0x557d1a668630 2026-02-20T03:26:18.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 10 client.18498 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:18.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 10 client.18498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:18.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 20 client.18498 populate_metadata read hostname 'trial028' 2026-02-20T03:26:18.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d1a6916d0 0x557d1a693ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 4 client.18498 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:18.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.658+0000 7ff557b72e00 1 -- 10.20.193.28:0/1454422326 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d1a5c35b0 con 0x557d1a6916d0 2026-02-20T03:26:18.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.685+0000 7ff54e7fc640 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d1a6916d0 0x557d1a693ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:18.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.738+0000 7ff54e7fc640 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d1a6916d0 0x557d1a693ac0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0c0590ec56737 server_cookie=f117b62a53163139 in_seq=0 out_seq=0 2026-02-20T03:26:18.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.738+0000 7ff514ff9640 10 client.18498 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:18.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff514ff9640 1 -- 10.20.193.28:0/1454422326 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557d1a5c35b0 con 0x557d1a6916d0 2026-02-20T03:26:18.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff514ff9640 10 client.18498 handle_command_reply: tid=0 2026-02-20T03:26:18.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 client.18498 shutdown 2026-02-20T03:26:18.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 -- 10.20.193.28:0/1454422326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 msgr2=0x557d1a682ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:18.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a682ef0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff5400049e0 tx=0x7ff540004a10 comp rx=0 tx=0).stop 2026-02-20T03:26:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 -- 10.20.193.28:0/1454422326 shutdown_connections 2026-02-20T03:26:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d1a6916d0 0x557d1a693ac0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a66e000 0x557d1a6816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 0x557d1a683430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 --2- 10.20.193.28:0/1454422326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a682ef0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff514ff9640 0 client.18498 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:18.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 -- 10.20.193.28:0/1454422326 >> 10.20.193.28:0/1454422326 conn(0x557d1a62b290 msgr2=0x557d1a667440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:18.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 -- 10.20.193.28:0/1454422326 shutdown_connections 2026-02-20T03:26:18.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 1 -- 10.20.193.28:0/1454422326 wait complete. 2026-02-20T03:26:18.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.765+0000 7ff557b72e00 20 client.18498 trim_cache size 0 max 16384 2026-02-20T03:26:18.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff557b72e00 1 Processor -- start 2026-02-20T03:26:18.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff557b72e00 1 -- start start 2026-02-20T03:26:18.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a6991a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 0x557d1a6996e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a66e000 0x557d1a688df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff557b72e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f4012620 con 0x557d1a668630 2026-02-20T03:26:18.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff557b72e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f400fef0 con 0x557d1a668fb0 2026-02-20T03:26:18.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff557b72e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f400dd40 con 0x557d1a66e000 2026-02-20T03:26:18.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff54f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a6991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:18.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff54f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a6991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51564/0 (socket says 10.20.193.28:51564) 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff54f7fe640 1 -- 10.20.193.28:0/3626727152 learned_addr learned my addr 10.20.193.28:0/3626727152 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff54f7fe640 1 -- 10.20.193.28:0/3626727152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a66e000 msgr2=0x557d1a688df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/3626727152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a66e000 0x557d1a688df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff54f7fe640 1 -- 10.20.193.28:0/3626727152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 msgr2=0x557d1a6996e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/3626727152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 0x557d1a6996e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.770+0000 7ff54f7fe640 1 -- 10.20.193.28:0/3626727152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1a67a950 con 0x557d1a668630 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/3626727152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a6991a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff54001d040 tx=0x7ff540027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a3551b15c6324f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff516ffd640 1 -- 10.20.193.28:0/3626727152 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540017070 con 0x557d1a668630 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff516ffd640 1 -- 10.20.193.28:0/3626727152 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff540018040 con 0x557d1a668630 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff516ffd640 1 -- 10.20.193.28:0/3626727152 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54001e670 con 0x557d1a668630 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- 10.20.193.28:0/3626727152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 msgr2=0x557d1a6991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:18.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3626727152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a6991a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff54001d040 tx=0x7ff540027000 comp rx=0 tx=0).stop 2026-02-20T03:26:18.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- 10.20.193.28:0/3626727152 shutdown_connections 2026-02-20T03:26:18.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3626727152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a66e000 0x557d1a688df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3626727152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a668fb0 0x557d1a6996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3626727152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a6991a0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- 10.20.193.28:0/3626727152 >> 10.20.193.28:0/3626727152 conn(0x557d1a62b290 msgr2=0x557d1a68dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:18.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- 10.20.193.28:0/3626727152 shutdown_connections 2026-02-20T03:26:18.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- 10.20.193.28:0/3626727152 wait complete. 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- start start 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 Processor -- start 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a689770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a668fb0 0x557d1a687ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a66e000 0x557d1a688130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f400e3b0 con 0x557d1a668630 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f400f820 con 0x557d1a66e000 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f400ea80 con 0x557d1a668fb0 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a689770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a689770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51578/0 (socket says 10.20.193.28:51578) 2026-02-20T03:26:18.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 -- 10.20.193.28:0/3775930626 learned_addr learned my addr 10.20.193.28:0/3775930626 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 -- 10.20.193.28:0/3775930626 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a668fb0 msgr2=0x557d1a687ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a668fb0 0x557d1a687ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 -- 10.20.193.28:0/3775930626 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a66e000 msgr2=0x557d1a688130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a66e000 0x557d1a688130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 -- 10.20.193.28:0/3775930626 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1a29a870 con 0x557d1a668630 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff54f7fe640 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a689770 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff540007110 tx=0x7ff540004b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8965aee6c01b2af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff514ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff514ff9640 1 -- 10.20.193.28:0/3775930626 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff540017040 con 0x557d1a668630 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff514ff9640 1 -- 10.20.193.28:0/3775930626 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x557d1a5c91a0 con 0x557d1a668630 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff514ff9640 1 -- 10.20.193.28:0/3775930626 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54001ea60 con 0x557d1a668630 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- 10.20.193.28:0/3775930626 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d1a55b440 con 0x557d1a668630 2026-02-20T03:26:18.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff514ff9640 1 -- 10.20.193.28:0/3775930626 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ff54001ec00 con 0x557d1a668630 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 10 client.18504 _ll_register_callbacks cb 0x7ff540015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- 10.20.193.28:0/3775930626 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d1a56db00 con 0x557d1a668630 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff514ff9640 1 -- 10.20.193.28:0/3775930626 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff54001e410 con 0x557d1a668630 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 10 client.18504 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.775+0000 7ff557b72e00 1 -- 10.20.193.28:0/3775930626 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557d1a67b640 con 0x557d1a668630 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.778+0000 7ff514ff9640 1 -- 10.20.193.28:0/3775930626 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff54001c7e0 con 0x557d1a668630 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.778+0000 7ff557b72e00 10 client.18504 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.778+0000 7ff557b72e00 10 client.18504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.778+0000 7ff557b72e00 20 client.18504 populate_metadata read hostname 'trial028' 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.778+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d1a6fd170 0x557d1a6ff630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:18.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.778+0000 7ff557b72e00 4 client.18504 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:26:18.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.778+0000 7ff557b72e00 1 -- 10.20.193.28:0/3775930626 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ff540018040 con 0x557d1a6fd170 2026-02-20T03:26:18.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.805+0000 7ff54e7fc640 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d1a6fd170 0x557d1a6ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:18.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.846+0000 7ff54e7fc640 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d1a6fd170 0x557d1a6ff630 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c769a758b8578e server_cookie=3dfd6cca99ee1691 in_seq=0 out_seq=0 2026-02-20T03:26:18.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.846+0000 7ff514ff9640 10 client.18504 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff514ff9640 1 -- 10.20.193.28:0/3775930626 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7ff540018040 con 0x557d1a6fd170 2026-02-20T03:26:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff514ff9640 10 client.18504 handle_command_reply: tid=0 2026-02-20T03:26:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 client.18504 shutdown 2026-02-20T03:26:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 -- 10.20.193.28:0/3775930626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 msgr2=0x557d1a689770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a689770 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff540007110 tx=0x7ff540004b90 comp rx=0 tx=0).stop 2026-02-20T03:26:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 -- 10.20.193.28:0/3775930626 shutdown_connections 2026-02-20T03:26:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557d1a6fd170 0x557d1a6ff630 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d1a66e000 0x557d1a688130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d1a668fb0 0x557d1a687ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 --2- 10.20.193.28:0/3775930626 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d1a668630 0x557d1a689770 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 -- 10.20.193.28:0/3775930626 >> 10.20.193.28:0/3775930626 conn(0x557d1a62b290 msgr2=0x557d1a691ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff514ff9640 0 client.18504 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 -- 10.20.193.28:0/3775930626 shutdown_connections 2026-02-20T03:26:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 1 -- 10.20.193.28:0/3775930626 wait complete. 2026-02-20T03:26:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff557b72e00 20 client.18504 trim_cache size 0 max 16384 2026-02-20T03:26:18.865 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:26:18.865 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:26:18.866 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:26:18.866 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:26:18.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 -- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff5200b0ea0 msgr2=0x7ff5200b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff5200b0ea0 0x7ff5200b3360 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff5440a7ab0 tx=0x7ff54400d510 comp rx=0 tx=0).stop 2026-02-20T03:26:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 -- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 msgr2=0x7ff550077600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 0x7ff550077600 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff54400b5a0 tx=0x7ff54400ba70 comp rx=0 tx=0).stop 2026-02-20T03:26:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 -- 10.20.193.28:0/689509025 shutdown_connections 2026-02-20T03:26:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff5200b0ea0 0x7ff5200b3360 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff55010a980 0x7ff550078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff550105320 0x7ff550077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 --2- 10.20.193.28:0/689509025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff550104980 0x7ff550077600 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:18.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 -- 10.20.193.28:0/689509025 >> 10.20.193.28:0/689509025 conn(0x7ff550100680 msgr2=0x7ff550101090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:18.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 -- 10.20.193.28:0/689509025 shutdown_connections 2026-02-20T03:26:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:18.859+0000 7ff54ffff640 1 -- 10.20.193.28:0/689509025 wait complete. 2026-02-20T03:26:19.024 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:26:19.024 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:26:19.310 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:19.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbbabfff640 1 -- 10.20.193.28:0/2592612305 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x560b3e9caf60 con 0x560b3ed0d070 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbbabfff640 10 client.18486 handle_command_reply: tid=0 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 client.18486 shutdown 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 -- 10.20.193.28:0/2592612305 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 msgr2=0x560b3ed25fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed25fa0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400b990 tx=0x7fbbf400cd30 comp rx=0 tx=0).stop 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 -- 10.20.193.28:0/2592612305 shutdown_connections 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b3ed0d070 0x560b3ed9f080 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b3ed08200 0x560b3ed25fa0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b3ed07860 0x560b3ed25a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 --2- 10.20.193.28:0/2592612305 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b3ed003c0 0x560b3ed28730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 -- 10.20.193.28:0/2592612305 >> 10.20.193.28:0/2592612305 conn(0x560b3ed32df0 msgr2=0x560b3ed08960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbbabfff640 0 client.18486 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 -- 10.20.193.28:0/2592612305 shutdown_connections 2026-02-20T03:26:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 1 -- 10.20.193.28:0/2592612305 wait complete. 2026-02-20T03:26:19.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.384+0000 7fbc028d9e00 20 client.18486 trim_cache size 0 max 16384 2026-02-20T03:26:19.389 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:26:19.389 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 38, 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: "f407835": { 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: "version": 38, 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:26:19.390 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:19.391 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:19.392 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:26:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 -- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbbd40b0e20 msgr2=0x7fbbd40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbbd40b0e20 0x7fbbd40b32e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbbe802f770 tx=0x7fbbe80023d0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 -- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8109ed0 msgr2=0x7fbbf8078080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8109ed0 0x7fbbf8078080 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400b9c0 tx=0x7fbbf400be90 comp rx=0 tx=0).stop 2026-02-20T03:26:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 -- 10.20.193.28:0/1350656661 shutdown_connections 2026-02-20T03:26:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbbd40b0e20 0x7fbbd40b32e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbbf8109ed0 0x7fbbf8078080 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbbf8105750 0x7fbbf8077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 --2- 10.20.193.28:0/1350656661 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbbf8104da0 0x7fbbf8077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.385+0000 7fbc003d4640 1 -- 10.20.193.28:0/1350656661 >> 10.20.193.28:0/1350656661 conn(0x7fbbf8100840 msgr2=0x7fbbf8101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.386+0000 7fbc003d4640 1 -- 10.20.193.28:0/1350656661 shutdown_connections 2026-02-20T03:26:19.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.386+0000 7fbc003d4640 1 -- 10.20.193.28:0/1350656661 wait complete. 2026-02-20T03:26:19.490 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f407835', quiesce took 3.2 seconds. Will release after: 26.8 2026-02-20T03:26:19.523 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.39 MB/sec execute 472 sec latency 1949.776 ms 2026-02-20T03:26:19.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.525+0000 7f36eaa66640 1 -- 10.20.193.28:0/3528396392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36e4109ba0 msgr2=0x7f36e4115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:19.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.525+0000 7f36eaa66640 1 --2- 10.20.193.28:0/3528396392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36e4109ba0 0x7f36e4115d10 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f36e000b0a0 tx=0x7f36e002f410 comp rx=0 tx=0).stop 2026-02-20T03:26:19.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.525+0000 7f36eaa66640 1 -- 10.20.193.28:0/3528396392 shutdown_connections 2026-02-20T03:26:19.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.525+0000 7f36eaa66640 1 --2- 10.20.193.28:0/3528396392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36e4109ba0 0x7f36e4115d10 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.525+0000 7f36eaa66640 1 --2- 10.20.193.28:0/3528396392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f36e4109220 0x7f36e4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.525+0000 7f36eaa66640 1 --2- 10.20.193.28:0/3528396392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f36e410eef0 0x7f36e410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.525+0000 7f36eaa66640 1 -- 10.20.193.28:0/3528396392 >> 10.20.193.28:0/3528396392 conn(0x7f36e4078600 msgr2=0x7f36e407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:19.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.525+0000 7f36eaa66640 1 -- 10.20.193.28:0/3528396392 shutdown_connections 2026-02-20T03:26:19.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.525+0000 7f36eaa66640 1 -- 10.20.193.28:0/3528396392 wait complete. 2026-02-20T03:26:19.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36eaa66640 1 Processor -- start 2026-02-20T03:26:19.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36eaa66640 1 -- start start 2026-02-20T03:26:19.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36eaa66640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f36e4109220 0x7f36e4083770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:19.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36eaa66640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f36e4109ba0 0x7f36e4083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:19.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36eaa66640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36e410eef0 0x7f36e407c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:19.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36eaa66640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f36e4119090 con 0x7f36e410eef0 2026-02-20T03:26:19.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36eaa66640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f36e4118f10 con 0x7f36e4109220 2026-02-20T03:26:19.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36eaa66640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36e4119210 con 0x7f36e4109ba0 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36e9a64640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f36e4109220 0x7f36e4083770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36ea265640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36e410eef0 0x7f36e407c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36e9263640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f36e4109ba0 0x7f36e4083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36e9a64640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f36e4109220 0x7f36e4083770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44102/0 (socket says 10.20.193.28:44102) 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.526+0000 7f36e9a64640 1 -- 10.20.193.28:0/161750244 learned_addr learned my addr 10.20.193.28:0/161750244 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36ea265640 1 -- 10.20.193.28:0/161750244 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f36e4109ba0 msgr2=0x7f36e4083cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36ea265640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f36e4109ba0 0x7f36e4083cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36ea265640 1 -- 10.20.193.28:0/161750244 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f36e4109220 msgr2=0x7f36e4083770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36ea265640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f36e4109220 0x7f36e4083770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36ea265640 1 -- 10.20.193.28:0/161750244 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e407d0e0 con 0x7f36e410eef0 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36ea265640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36e410eef0 0x7f36e407c820 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f36e0032040 tx=0x7f36e0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:19.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36d2ffd640 1 -- 10.20.193.28:0/161750244 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00044b0 con 0x7f36e410eef0 2026-02-20T03:26:19.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36d2ffd640 1 -- 10.20.193.28:0/161750244 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f36e0004650 con 0x7f36e410eef0 2026-02-20T03:26:19.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36d2ffd640 1 -- 10.20.193.28:0/161750244 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0038710 con 0x7f36e410eef0 2026-02-20T03:26:19.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e407d370 con 0x7f36e410eef0 2026-02-20T03:26:19.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.527+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e40812a0 con 0x7f36e410eef0 2026-02-20T03:26:19.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.528+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36ac005390 con 0x7f36e410eef0 2026-02-20T03:26:19.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.529+0000 7f36d2ffd640 1 -- 10.20.193.28:0/161750244 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f36e00076a0 con 0x7f36e410eef0 2026-02-20T03:26:19.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.531+0000 7f36d2ffd640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f36c00b0e20 0x7f36c00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:19.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.531+0000 7f36d2ffd640 1 -- 10.20.193.28:0/161750244 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f36e0105130 con 0x7f36e410eef0 2026-02-20T03:26:19.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.531+0000 7f36e9a64640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f36c00b0e20 0x7f36c00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:19.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.531+0000 7f36d2ffd640 1 -- 10.20.193.28:0/161750244 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f36e00cd590 con 0x7f36e410eef0 2026-02-20T03:26:19.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.532+0000 7f36e9a64640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f36c00b0e20 0x7f36c00b32e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f36d4005fd0 tx=0x7f36d4007540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:19.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:19 trial126 ceph-mon[38476]: pgmap v531: 129 pgs: 129 active+clean; 178 MiB data, 3.7 GiB used, 8.2 TiB / 8.2 TiB avail; 736 KiB/s rd, 2.3 MiB/s wr, 329 op/s 2026-02-20T03:26:19.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:19 trial028 ceph-mon[38552]: pgmap v531: 129 pgs: 129 active+clean; 178 MiB data, 3.7 GiB used, 8.2 TiB / 8.2 TiB avail; 736 KiB/s rd, 2.3 MiB/s wr, 329 op/s 2026-02-20T03:26:19.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.642+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36ac005680 con 0x7f36e410eef0 2026-02-20T03:26:19.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.642+0000 7f36d2ffd640 1 -- 10.20.193.28:0/161750244 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11921 (secure 0 0 0) 0x7f36e00d1240 con 0x7f36e410eef0 2026-02-20T03:26:19.646 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:26:19.646 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T03:26:19.646 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T03:25:19:519285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:25:19.519275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:26:19.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f36c00b0e20 msgr2=0x7f36c00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:19.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f36c00b0e20 0x7f36c00b32e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f36d4005fd0 tx=0x7f36d4007540 comp rx=0 tx=0).stop 2026-02-20T03:26:19.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36e410eef0 msgr2=0x7f36e407c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:19.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36e410eef0 0x7f36e407c820 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f36e0032040 tx=0x7f36e0009300 comp rx=0 tx=0).stop 2026-02-20T03:26:19.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 shutdown_connections 2026-02-20T03:26:19.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f36c00b0e20 0x7f36c00b32e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f36e410eef0 0x7f36e407c820 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f36e4109ba0 0x7f36e4083cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 --2- 10.20.193.28:0/161750244 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f36e4109220 0x7f36e4083770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:19.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.645+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 >> 10.20.193.28:0/161750244 conn(0x7f36e4078600 msgr2=0x7f36e4079cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:19.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.646+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 shutdown_connections 2026-02-20T03:26:19.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:19.646+0000 7f36eaa66640 1 -- 10.20.193.28:0/161750244 wait complete. 2026-02-20T03:26:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:19 trial177 ceph-mon[43181]: pgmap v531: 129 pgs: 129 active+clean; 178 MiB data, 3.7 GiB used, 8.2 TiB / 8.2 TiB avail; 736 KiB/s rd, 2.3 MiB/s wr, 329 op/s 2026-02-20T03:26:19.787 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:26:20.096 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:20.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.275+0000 7fae4e7e6640 1 -- 10.20.193.28:0/3153956991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae48109bc0 msgr2=0x7fae48115ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.275+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/3153956991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae48109bc0 0x7fae48115ea0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00b0a0 tx=0x7fae3c02f410 comp rx=0 tx=0).stop 2026-02-20T03:26:20.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.275+0000 7fae4e7e6640 1 -- 10.20.193.28:0/3153956991 shutdown_connections 2026-02-20T03:26:20.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.275+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/3153956991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae48109bc0 0x7fae48115ea0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.275+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/3153956991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae48109220 0x7fae48109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.275+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/3153956991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae4810f1e0 0x7fae4810f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.275+0000 7fae4e7e6640 1 -- 10.20.193.28:0/3153956991 >> 10.20.193.28:0/3153956991 conn(0x7fae48078860 msgr2=0x7fae4807ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.275+0000 7fae4e7e6640 1 -- 10.20.193.28:0/3153956991 shutdown_connections 2026-02-20T03:26:20.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.275+0000 7fae4e7e6640 1 -- 10.20.193.28:0/3153956991 wait complete. 2026-02-20T03:26:20.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.276+0000 7fae4e7e6640 1 Processor -- start 2026-02-20T03:26:20.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.276+0000 7fae4e7e6640 1 -- start start 2026-02-20T03:26:20.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.276+0000 7fae4e7e6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae48109220 0x7fae481a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.276+0000 7fae4e7e6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae48109bc0 0x7fae481a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.276+0000 7fae4e7e6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae4810f1e0 0x7fae481a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.276+0000 7fae4e7e6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fae48119310 con 0x7fae4810f1e0 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.276+0000 7fae4e7e6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fae48119190 con 0x7fae48109bc0 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.276+0000 7fae4e7e6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fae48119490 con 0x7fae48109220 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae47fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae48109220 0x7fae481a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae477fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae48109bc0 0x7fae481a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae477fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae48109bc0 0x7fae481a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44126/0 (socket says 10.20.193.28:44126) 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae477fe640 1 -- 10.20.193.28:0/2281001234 learned_addr learned my addr 10.20.193.28:0/2281001234 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae4810f1e0 0x7fae481a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae477fe640 1 -- 10.20.193.28:0/2281001234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae48109220 msgr2=0x7fae481a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae477fe640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae48109220 0x7fae481a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae477fe640 1 -- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae4810f1e0 msgr2=0x7fae481a5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae477fe640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae4810f1e0 0x7fae481a5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae477fe640 1 -- 10.20.193.28:0/2281001234 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae481a66e0 con 0x7fae48109bc0 2026-02-20T03:26:20.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae477fe640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae48109bc0 0x7fae481a1bd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fae3800ea30 tx=0x7fae3800ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae457fa640 1 -- 10.20.193.28:0/2281001234 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3800ce50 con 0x7fae48109bc0 2026-02-20T03:26:20.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae457fa640 1 -- 10.20.193.28:0/2281001234 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fae38004570 con 0x7fae48109bc0 2026-02-20T03:26:20.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae457fa640 1 -- 10.20.193.28:0/2281001234 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38010690 con 0x7fae48109bc0 2026-02-20T03:26:20.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.277+0000 7fae4e7e6640 1 -- 10.20.193.28:0/2281001234 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae481a69d0 con 0x7fae48109bc0 2026-02-20T03:26:20.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.278+0000 7fae4e7e6640 1 -- 10.20.193.28:0/2281001234 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae481ae210 con 0x7fae48109bc0 2026-02-20T03:26:20.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.280+0000 7fae457fa640 1 -- 10.20.193.28:0/2281001234 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fae380040d0 con 0x7fae48109bc0 2026-02-20T03:26:20.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.280+0000 7fae50cebe00 1 Processor -- start 2026-02-20T03:26:20.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae50cebe00 1 -- start start 2026-02-20T03:26:20.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d9863479c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d986347f90 0x55d98634b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d98634c0d0 0x55d986353c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae50cebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d9862c7e00 con 0x55d986347f90 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae50cebe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d98629a970 con 0x55d98634c0d0 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae50cebe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9862481f0 con 0x55d9863475e0 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d986347f90 0x55d98634b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d986347f90 0x55d98634b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51632/0 (socket says 10.20.193.28:51632) 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae47fff640 1 -- 10.20.193.28:0/832838548 learned_addr learned my addr 10.20.193.28:0/832838548 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae477fe640 1 --2- 10.20.193.28:0/832838548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d98634c0d0 0x55d986353c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/832838548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d9863479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae47fff640 1 -- 10.20.193.28:0/832838548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 msgr2=0x55d9863479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae47fff640 1 --2- 10.20.193.28:0/832838548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d9863479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae47fff640 1 -- 10.20.193.28:0/832838548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d98634c0d0 msgr2=0x55d986353c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae47fff640 1 --2- 10.20.193.28:0/832838548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d98634c0d0 0x55d986353c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae47fff640 1 -- 10.20.193.28:0/832838548 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d98625b3d0 con 0x55d986347f90 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.281+0000 7fae47fff640 1 --2- 10.20.193.28:0/832838548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d986347f90 0x55d98634b9a0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fae340045a0 tx=0x7fae34009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc609575006974f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae18ce3640 1 -- 10.20.193.28:0/832838548 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34010630 con 0x55d986347f90 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae18ce3640 1 -- 10.20.193.28:0/832838548 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fae34010c70 con 0x55d986347f90 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae18ce3640 1 -- 10.20.193.28:0/832838548 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3400ec20 con 0x55d986347f90 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae50cebe00 1 -- 10.20.193.28:0/832838548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d986347f90 msgr2=0x55d98634b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae50cebe00 1 --2- 10.20.193.28:0/832838548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d986347f90 0x55d98634b9a0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fae340045a0 tx=0x7fae34009c70 comp rx=0 tx=0).stop 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae50cebe00 1 -- 10.20.193.28:0/832838548 shutdown_connections 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae50cebe00 1 --2- 10.20.193.28:0/832838548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d98634c0d0 0x55d986353c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae50cebe00 1 --2- 10.20.193.28:0/832838548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d986347f90 0x55d98634b9a0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae50cebe00 1 --2- 10.20.193.28:0/832838548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d9863479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae50cebe00 1 -- 10.20.193.28:0/832838548 >> 10.20.193.28:0/832838548 conn(0x55d98630a240 msgr2=0x55d986345ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae50cebe00 1 -- 10.20.193.28:0/832838548 shutdown_connections 2026-02-20T03:26:20.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.282+0000 7fae50cebe00 1 -- 10.20.193.28:0/832838548 wait complete. 2026-02-20T03:26:20.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.283+0000 7fae457fa640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fae1c0b0d80 0x7fae1c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.283+0000 7fae457fa640 1 -- 10.20.193.28:0/2281001234 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fae380e0f30 con 0x7fae48109bc0 2026-02-20T03:26:20.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.283+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fae1c0b0d80 0x7fae1c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.283+0000 7fae50cebe00 1 -- start start 2026-02-20T03:26:20.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.283+0000 7fae50cebe00 1 Processor -- start 2026-02-20T03:26:20.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fae1c0b0d80 0x7fae1c0b3240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009e60 tx=0x7fae3c03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d986361960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d986347f90 0x55d986361ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986360110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae50cebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d9862968a0 con 0x55d98634c0d0 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae50cebe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d986088f50 con 0x55d986347f90 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae50cebe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d986360750 con 0x55d9863475e0 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae4cd5c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986360110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae477fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d986347f90 0x55d986361ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae47fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d986361960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae47fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d986361960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47680/0 (socket says 10.20.193.28:47680) 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae47fff640 1 -- 10.20.193.28:0/3907366124 learned_addr learned my addr 10.20.193.28:0/3907366124 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae4cd5c640 1 -- 10.20.193.28:0/3907366124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 msgr2=0x55d986361960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d986361960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae4cd5c640 1 -- 10.20.193.28:0/3907366124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d986347f90 msgr2=0x55d986361ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d986347f90 0x55d986361ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae4cd5c640 1 -- 10.20.193.28:0/3907366124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9863598a0 con 0x55d98634c0d0 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.284+0000 7fae47fff640 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d986361960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.285+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986360110 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fae3c032040 tx=0x7fae3c02f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87508c23d501031a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.285+0000 7fae09ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.285+0000 7fae09ffb640 1 -- 10.20.193.28:0/3907366124 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0044b0 con 0x55d98634c0d0 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.285+0000 7fae09ffb640 1 -- 10.20.193.28:0/3907366124 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fae3c004650 con 0x55d98634c0d0 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.285+0000 7fae09ffb640 1 -- 10.20.193.28:0/3907366124 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c038840 con 0x55d98634c0d0 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.285+0000 7fae50cebe00 1 -- 10.20.193.28:0/3907366124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d98606bb40 con 0x55d98634c0d0 2026-02-20T03:26:20.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.285+0000 7fae09ffb640 1 -- 10.20.193.28:0/3907366124 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fae3c0389e0 con 0x55d98634c0d0 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.285+0000 7fae50cebe00 10 client.18522 _ll_register_callbacks cb 0x55d9862d3eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.285+0000 7fae50cebe00 1 -- 10.20.193.28:0/3907366124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9862a8150 con 0x55d98634c0d0 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae09ffb640 1 -- 10.20.193.28:0/3907366124 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fae3c054060 con 0x55d98634c0d0 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae50cebe00 10 client.18522 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae50cebe00 1 -- 10.20.193.28:0/3907366124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d9862551e0 con 0x55d98634c0d0 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae09ffb640 1 -- 10.20.193.28:0/3907366124 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fae3c057050 con 0x55d98634c0d0 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae50cebe00 10 client.18522 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae50cebe00 10 client.18522 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae50cebe00 20 client.18522 populate_metadata read hostname 'trial028' 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d9863700f0 0x55d9863725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae50cebe00 4 client.18522 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:20.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae50cebe00 1 -- 10.20.193.28:0/3907366124 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9862a2560 con 0x55d9863700f0 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.286+0000 7fae47fff640 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d9863700f0 0x55d9863725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae47fff640 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d9863700f0 0x55d9863725b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2928b431ba24eba server_cookie=5adddf84cd850f40 in_seq=0 out_seq=0 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae09ffb640 10 client.18522 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae09ffb640 1 -- 10.20.193.28:0/3907366124 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d9862a2560 con 0x55d9863700f0 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae09ffb640 10 client.18522 handle_command_reply: tid=0 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae50cebe00 1 client.18522 shutdown 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae50cebe00 1 -- 10.20.193.28:0/3907366124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 msgr2=0x55d986360110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986360110 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fae3c032040 tx=0x7fae3c02f410 comp rx=0 tx=0).stop 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae50cebe00 1 -- 10.20.193.28:0/3907366124 shutdown_connections 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d9863700f0 0x55d9863725b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986360110 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d986347f90 0x55d986361ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3907366124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9863475e0 0x55d986361960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.287+0000 7fae50cebe00 1 -- 10.20.193.28:0/3907366124 >> 10.20.193.28:0/3907366124 conn(0x55d98630a240 msgr2=0x55d9863434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.288+0000 7fae09ffb640 0 client.18522 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:26:20.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.288+0000 7fae50cebe00 1 -- 10.20.193.28:0/3907366124 shutdown_connections 2026-02-20T03:26:20.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.288+0000 7fae50cebe00 1 -- 10.20.193.28:0/3907366124 wait complete. 2026-02-20T03:26:20.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.288+0000 7fae50cebe00 20 client.18522 trim_cache size 0 max 16384 2026-02-20T03:26:20.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.294+0000 7fae50cebe00 1 Processor -- start 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae50cebe00 1 -- start start 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 0x55d98634b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986372100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986377ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae50cebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fadec0126f0 con 0x55d98634c0d0 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae50cebe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fadec00ffc0 con 0x55d9863475e0 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae50cebe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fadec00de10 con 0x55d986347f90 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae477fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986372100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae4cd5c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986377ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae477fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986372100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47682/0 (socket says 10.20.193.28:47682) 2026-02-20T03:26:20.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae477fe640 1 -- 10.20.193.28:0/1604856646 learned_addr learned my addr 10.20.193.28:0/1604856646 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae47fff640 1 --2- 10.20.193.28:0/1604856646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 0x55d98634b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae4cd5c640 1 -- 10.20.193.28:0/1604856646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 msgr2=0x55d986372100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/1604856646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986372100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae4cd5c640 1 -- 10.20.193.28:0/1604856646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 msgr2=0x55d98634b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/1604856646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 0x55d98634b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae4cd5c640 1 -- 10.20.193.28:0/1604856646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9863596d0 con 0x55d98634c0d0 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.295+0000 7fae477fe640 1 --2- 10.20.193.28:0/1604856646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986372100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/1604856646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986377ed0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fae3c032040 tx=0x7fae3c052000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d1922e2a62ca86 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae0bfff640 1 -- 10.20.193.28:0/1604856646 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0044b0 con 0x55d98634c0d0 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae0bfff640 1 -- 10.20.193.28:0/1604856646 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d9862a8150 con 0x55d98634c0d0 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae0bfff640 1 -- 10.20.193.28:0/1604856646 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c007c90 con 0x55d98634c0d0 2026-02-20T03:26:20.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae50cebe00 1 -- 10.20.193.28:0/1604856646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 msgr2=0x55d986377ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae50cebe00 1 --2- 10.20.193.28:0/1604856646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986377ed0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fae3c032040 tx=0x7fae3c052000 comp rx=0 tx=0).stop 2026-02-20T03:26:20.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae50cebe00 1 -- 10.20.193.28:0/1604856646 shutdown_connections 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae50cebe00 1 --2- 10.20.193.28:0/1604856646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986377ed0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae50cebe00 1 --2- 10.20.193.28:0/1604856646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986372100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae50cebe00 1 --2- 10.20.193.28:0/1604856646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 0x55d98634b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae50cebe00 1 -- 10.20.193.28:0/1604856646 >> 10.20.193.28:0/1604856646 conn(0x55d98630a240 msgr2=0x55d98635f080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae50cebe00 1 -- 10.20.193.28:0/1604856646 shutdown_connections 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.296+0000 7fae50cebe00 1 -- 10.20.193.28:0/1604856646 wait complete. 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.297+0000 7fae50cebe00 1 -- start start 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.297+0000 7fae50cebe00 1 Processor -- start 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.297+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 0x55d986364910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.297+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986364e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae50cebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986365390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae50cebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fadec00e480 con 0x55d98634c0d0 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae50cebe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fadec00f8f0 con 0x55d9863475e0 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae50cebe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fadec00eb50 con 0x55d986347f90 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae47fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 0x55d986364910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae477fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986364e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae477fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986364e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47692/0 (socket says 10.20.193.28:47692) 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae477fe640 1 -- 10.20.193.28:0/3840630911 learned_addr learned my addr 10.20.193.28:0/3840630911 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae47fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 0x55d986364910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44162/0 (socket says 10.20.193.28:44162) 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986365390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae477fe640 1 -- 10.20.193.28:0/3840630911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 msgr2=0x55d986364910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae477fe640 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 0x55d986364910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae477fe640 1 -- 10.20.193.28:0/3840630911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 msgr2=0x55d986365390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae477fe640 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986365390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae477fe640 1 -- 10.20.193.28:0/3840630911 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d985f79870 con 0x55d986347f90 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae4cd5c640 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986365390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae477fe640 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986364e50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fae380a8910 tx=0x7fae38002ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f26de8e65465b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae09ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae09ffb640 1 -- 10.20.193.28:0/3840630911 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae380a89e0 con 0x55d986347f90 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae09ffb640 1 -- 10.20.193.28:0/3840630911 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fae380a9310 con 0x55d986347f90 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae09ffb640 1 -- 10.20.193.28:0/3840630911 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae380a8130 con 0x55d986347f90 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.298+0000 7fae50cebe00 1 -- 10.20.193.28:0/3840630911 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d98623a3f0 con 0x55d986347f90 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae09ffb640 1 -- 10.20.193.28:0/3840630911 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fae380af430 con 0x55d986347f90 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae09ffb640 10 client.27517 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:26:20.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 10 client.27517 _ll_register_callbacks cb 0x7fae4810fd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 1 -- 10.20.193.28:0/3840630911 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d98624cab0 con 0x55d986347f90 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae09ffb640 1 -- 10.20.193.28:0/3840630911 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fae380a8310 con 0x55d986347f90 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 10 client.27517 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 1 -- 10.20.193.28:0/3840630911 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d98635a3c0 con 0x55d986347f90 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae09ffb640 1 -- 10.20.193.28:0/3840630911 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fae380cf170 con 0x55d986347f90 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 10 client.27517 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 10 client.27517 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 20 client.27517 populate_metadata read hostname 'trial028' 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d9863dc900 0x55d9863dedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 4 client.27517 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae50cebe00 1 -- 10.20.193.28:0/3840630911 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9862a8150 con 0x55d9863dc900 2026-02-20T03:26:20.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.299+0000 7fae47fff640 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d9863dc900 0x55d9863dedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae47fff640 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d9863dc900 0x55d9863dedc0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7bdae4034ff57acd server_cookie=866af8fa18563bb0 in_seq=0 out_seq=0 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae09ffb640 10 client.27517 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae09ffb640 1 -- 10.20.193.28:0/3840630911 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9862a8150 con 0x55d9863dc900 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae09ffb640 10 client.27517 handle_command_reply: tid=0 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 client.27517 shutdown 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 -- 10.20.193.28:0/3840630911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 msgr2=0x55d986364e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986364e50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fae380a8910 tx=0x7fae38002ac0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 -- 10.20.193.28:0/3840630911 shutdown_connections 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d9863dc900 0x55d9863dedc0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d98634c0d0 0x55d986365390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d986347f90 0x55d986364e50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 --2- 10.20.193.28:0/3840630911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9863475e0 0x55d986364910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 -- 10.20.193.28:0/3840630911 >> 10.20.193.28:0/3840630911 conn(0x55d98630a240 msgr2=0x55d986372100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae09ffb640 0 client.27517 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:26:20.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 -- 10.20.193.28:0/3840630911 shutdown_connections 2026-02-20T03:26:20.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.300+0000 7fae50cebe00 1 -- 10.20.193.28:0/3840630911 wait complete. 2026-02-20T03:26:20.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae50cebe00 20 client.27517 trim_cache size 0 max 16384 2026-02-20T03:26:20.310 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:26:20.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 -- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fae1c0b0d80 msgr2=0x7fae1c0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fae1c0b0d80 0x7fae1c0b3240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009e60 tx=0x7fae3c03a040 comp rx=0 tx=0).stop 2026-02-20T03:26:20.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 -- 10.20.193.28:0/2281001234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae48109bc0 msgr2=0x7fae481a1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae48109bc0 0x7fae481a1bd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fae3800ea30 tx=0x7fae3800ef00 comp rx=0 tx=0).stop 2026-02-20T03:26:20.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 -- 10.20.193.28:0/2281001234 shutdown_connections 2026-02-20T03:26:20.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fae1c0b0d80 0x7fae1c0b3240 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fae4810f1e0 0x7fae481a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fae48109bc0 0x7fae481a1bd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 --2- 10.20.193.28:0/2281001234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fae48109220 0x7fae481a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 -- 10.20.193.28:0/2281001234 >> 10.20.193.28:0/2281001234 conn(0x7fae48078860 msgr2=0x7fae4807a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 -- 10.20.193.28:0/2281001234 shutdown_connections 2026-02-20T03:26:20.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.301+0000 7fae4e7e6640 1 -- 10.20.193.28:0/2281001234 wait complete. 2026-02-20T03:26:20.360 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:20 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/161750244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:20.439 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:26:20.523 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.38 MB/sec execute 473 sec latency 1143.049 ms 2026-02-20T03:26:20.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:20 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/161750244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:20.707 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:20 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/161750244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:20.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.887+0000 7f1dedd74640 1 -- 10.20.193.28:0/2471907567 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4038470 con 0x7f1df010a980 2026-02-20T03:26:20.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 -- 10.20.193.28:0/2471907567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 msgr2=0x7f1df010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 --2- 10.20.193.28:0/2471907567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 0x7f1df010ad60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009a30 tx=0x7f1de402f220 comp rx=0 tx=0).stop 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 -- 10.20.193.28:0/2471907567 shutdown_connections 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 --2- 10.20.193.28:0/2471907567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1df0105320 0x7f1df0111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 --2- 10.20.193.28:0/2471907567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df0104980 0x7f1df0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 --2- 10.20.193.28:0/2471907567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 0x7f1df010ad60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 -- 10.20.193.28:0/2471907567 >> 10.20.193.28:0/2471907567 conn(0x7f1df0100680 msgr2=0x7f1df0102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 -- 10.20.193.28:0/2471907567 shutdown_connections 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 -- 10.20.193.28:0/2471907567 wait complete. 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.888+0000 7f1df4a46640 1 Processor -- start 2026-02-20T03:26:20.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1df4a46640 1 -- start start 2026-02-20T03:26:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1df4a46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1df0104980 0x7f1df019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1df4a46640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df0105320 0x7f1df019d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1df4a46640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 0x7f1df01a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1df4a46640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0114ba0 con 0x7f1df0105320 2026-02-20T03:26:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1df4a46640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0114a20 con 0x7f1df010a980 2026-02-20T03:26:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1df4a46640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0114d20 con 0x7f1df0104980 2026-02-20T03:26:20.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1dee575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df0105320 0x7f1df019d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1def577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 0x7f1df01a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1def577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 0x7f1df01a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44188/0 (socket says 10.20.193.28:44188) 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1def577640 1 -- 10.20.193.28:0/1190850784 learned_addr learned my addr 10.20.193.28:0/1190850784 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1deed76640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1df0104980 0x7f1df019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1def577640 1 -- 10.20.193.28:0/1190850784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1df0104980 msgr2=0x7f1df019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1def577640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1df0104980 0x7f1df019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1def577640 1 -- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df0105320 msgr2=0x7f1df019d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.889+0000 7f1def577640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df0105320 0x7f1df019d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.890+0000 7f1def577640 1 -- 10.20.193.28:0/1190850784 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df01a2000 con 0x7f1df010a980 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.890+0000 7f1dee575640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df0105320 0x7f1df019d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.890+0000 7f1def577640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 0x7f1df01a1880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1de000ef30 tx=0x7f1de000c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.890+0000 7f1dcffff640 1 -- 10.20.193.28:0/1190850784 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de0019070 con 0x7f1df010a980 2026-02-20T03:26:20.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.890+0000 7f1dcffff640 1 -- 10.20.193.28:0/1190850784 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1de00092d0 con 0x7f1df010a980 2026-02-20T03:26:20.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.890+0000 7f1df4a46640 1 -- 10.20.193.28:0/1190850784 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df01a2290 con 0x7f1df010a980 2026-02-20T03:26:20.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.890+0000 7f1df4a46640 1 -- 10.20.193.28:0/1190850784 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df01a9b30 con 0x7f1df010a980 2026-02-20T03:26:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.890+0000 7f1dcffff640 1 -- 10.20.193.28:0/1190850784 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de0007500 con 0x7f1df010a980 2026-02-20T03:26:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.893+0000 7f1dcffff640 1 -- 10.20.193.28:0/1190850784 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1de0002a60 con 0x7f1df010a980 2026-02-20T03:26:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.893+0000 7f1df774ce00 1 Processor -- start 2026-02-20T03:26:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.893+0000 7f1df774ce00 1 -- start start 2026-02-20T03:26:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada1d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada17a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada23de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1df774ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad997e00 con 0x55b8ada17f60 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1df774ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad96a970 con 0x55b8ada1cfb0 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1df774ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad9181f0 con 0x55b8ada175e0 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1dee575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada1d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1dee575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada23de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1deed76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada17a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1deed76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada17a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47736/0 (socket says 10.20.193.28:47736) 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1deed76640 1 -- 10.20.193.28:0/3182150280 learned_addr learned my addr 10.20.193.28:0/3182150280 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1dee575640 1 -- 10.20.193.28:0/3182150280 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 msgr2=0x55b8ada17a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1dee575640 1 --2- 10.20.193.28:0/3182150280 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada17a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1dee575640 1 -- 10.20.193.28:0/3182150280 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 msgr2=0x55b8ada1d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1dee575640 1 --2- 10.20.193.28:0/3182150280 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada1d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1dee575640 1 -- 10.20.193.28:0/3182150280 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ad92b3d0 con 0x55b8ada17f60 2026-02-20T03:26:20.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.894+0000 7f1dee575640 1 --2- 10.20.193.28:0/3182150280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada23de0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009830 tx=0x7f1dd8009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e0fcf8ca7effa5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1dbb7fe640 1 -- 10.20.193.28:0/3182150280 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8016030 con 0x55b8ada17f60 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1dcffff640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dc40b0da0 0x7f1dc40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1dbb7fe640 1 -- 10.20.193.28:0/3182150280 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1dd800fe30 con 0x55b8ada17f60 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1dbb7fe640 1 -- 10.20.193.28:0/3182150280 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8019040 con 0x55b8ada17f60 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1dcffff640 1 -- 10.20.193.28:0/1190850784 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f1de00e07b0 con 0x7f1df010a980 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1deed76640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dc40b0da0 0x7f1dc40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1df774ce00 1 -- 10.20.193.28:0/3182150280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 msgr2=0x55b8ada23de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1df774ce00 1 --2- 10.20.193.28:0/3182150280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada23de0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8009830 tx=0x7f1dd8009290 comp rx=0 tx=0).stop 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1df774ce00 1 -- 10.20.193.28:0/3182150280 shutdown_connections 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1df774ce00 1 --2- 10.20.193.28:0/3182150280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada23de0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1df774ce00 1 --2- 10.20.193.28:0/3182150280 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada17a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1df774ce00 1 --2- 10.20.193.28:0/3182150280 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada1d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1df774ce00 1 -- 10.20.193.28:0/3182150280 >> 10.20.193.28:0/3182150280 conn(0x55b8ad9da240 msgr2=0x55b8ada15ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1df774ce00 1 -- 10.20.193.28:0/3182150280 shutdown_connections 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1df774ce00 1 -- 10.20.193.28:0/3182150280 wait complete. 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.895+0000 7f1deed76640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dc40b0da0 0x7f1dc40b3260 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1de40097c0 tx=0x7f1de4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.896+0000 7f1df774ce00 1 -- start start 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.896+0000 7f1df774ce00 1 Processor -- start 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada175e0 0x55b8ada31f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada17f60 0x55b8ada324b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada30460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1df774ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad9668a0 con 0x55b8ada175e0 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1df774ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b8ad758f50 con 0x55b8ada1cfb0 2026-02-20T03:26:20.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1df774ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b8ada309f0 con 0x55b8ada17f60 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1deed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada175e0 0x55b8ada31f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1def577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada30460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1dee575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada17f60 0x55b8ada324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1dee575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada17f60 0x55b8ada324b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47746/0 (socket says 10.20.193.28:47746) 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1dee575640 1 -- 10.20.193.28:0/602920335 learned_addr learned my addr 10.20.193.28:0/602920335 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1dee575640 1 -- 10.20.193.28:0/602920335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 msgr2=0x55b8ada30460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1dee575640 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada30460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1dee575640 1 -- 10.20.193.28:0/602920335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada175e0 msgr2=0x55b8ada31f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1dee575640 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada175e0 0x55b8ada31f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1dee575640 1 -- 10.20.193.28:0/602920335 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ada29a80 con 0x55b8ada17f60 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1deed76640 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada175e0 0x55b8ada31f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1dee575640 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada17f60 0x55b8ada324b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8004490 tx=0x7f1dd80044c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9739b5f33ecc998d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.897+0000 7f1db8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1db8ff9640 1 -- 10.20.193.28:0/602920335 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8016070 con 0x55b8ada17f60 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1db8ff9640 1 -- 10.20.193.28:0/602920335 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1dd8010a60 con 0x55b8ada17f60 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1df774ce00 1 -- 10.20.193.28:0/602920335 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8ad73bb40 con 0x55b8ada17f60 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1db8ff9640 1 -- 10.20.193.28:0/602920335 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8005620 con 0x55b8ada17f60 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1df774ce00 10 client.27529 _ll_register_callbacks cb 0x55b8ad9a3eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1db8ff9640 1 -- 10.20.193.28:0/602920335 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f1dd80049d0 con 0x55b8ada17f60 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1df774ce00 1 -- 10.20.193.28:0/602920335 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b8ad978150 con 0x55b8ada17f60 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1db8ff9640 1 -- 10.20.193.28:0/602920335 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1dd802f060 con 0x55b8ada17f60 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1df774ce00 10 client.27529 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1df774ce00 1 -- 10.20.193.28:0/602920335 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b8ad9251e0 con 0x55b8ada17f60 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1db8ff9640 1 -- 10.20.193.28:0/602920335 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1dd8004bd0 con 0x55b8ada17f60 2026-02-20T03:26:20.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1df774ce00 10 client.27529 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:20.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1df774ce00 10 client.27529 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:26:20.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.898+0000 7f1df774ce00 20 client.27529 populate_metadata read hostname 'trial028' 2026-02-20T03:26:20.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.899+0000 7f1df774ce00 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b8ada40480 0x55b8ada42870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.899+0000 7f1df774ce00 4 client.27529 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:20.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.899+0000 7f1df774ce00 1 -- 10.20.193.28:0/602920335 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8ad972560 con 0x55b8ada40480 2026-02-20T03:26:20.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.899+0000 7f1deed76640 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b8ada40480 0x55b8ada42870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.899+0000 7f1deed76640 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b8ada40480 0x55b8ada42870 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=65bf0802aa5348d5 server_cookie=af4b8ba3d44e0a68 in_seq=0 out_seq=0 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.899+0000 7f1db8ff9640 10 client.27529 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1db8ff9640 1 -- 10.20.193.28:0/602920335 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b8ad972560 con 0x55b8ada40480 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1db8ff9640 10 client.27529 handle_command_reply: tid=0 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 client.27529 shutdown 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 -- 10.20.193.28:0/602920335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada17f60 msgr2=0x55b8ada324b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada17f60 0x55b8ada324b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8004490 tx=0x7f1dd80044c0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 -- 10.20.193.28:0/602920335 shutdown_connections 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b8ada40480 0x55b8ada42870 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada30460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada17f60 0x55b8ada324b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 --2- 10.20.193.28:0/602920335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada175e0 0x55b8ada31f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1db8ff9640 0 client.27529 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:26:20.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 -- 10.20.193.28:0/602920335 >> 10.20.193.28:0/602920335 conn(0x55b8ad9da240 msgr2=0x55b8ada163f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 -- 10.20.193.28:0/602920335 shutdown_connections 2026-02-20T03:26:20.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 1 -- 10.20.193.28:0/602920335 wait complete. 2026-02-20T03:26:20.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.900+0000 7f1df774ce00 20 client.27529 trim_cache size 0 max 16384 2026-02-20T03:26:20.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1df774ce00 1 Processor -- start 2026-02-20T03:26:20.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1df774ce00 1 -- start start 2026-02-20T03:26:20.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada175e0 0x55b8ada2f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada2d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada1cfb0 0x55b8ada2de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1df774ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1d94012620 con 0x55b8ada17f60 2026-02-20T03:26:20.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1df774ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400fef0 con 0x55b8ada175e0 2026-02-20T03:26:20.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1df774ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400dd40 con 0x55b8ada1cfb0 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1deed76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada175e0 0x55b8ada2f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1deed76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada175e0 0x55b8ada2f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44214/0 (socket says 10.20.193.28:44214) 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1deed76640 1 -- 10.20.193.28:0/537930981 learned_addr learned my addr 10.20.193.28:0/537930981 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1def577640 1 --2- 10.20.193.28:0/537930981 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada1cfb0 0x55b8ada2de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1dee575640 1 --2- 10.20.193.28:0/537930981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada2d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1deed76640 1 -- 10.20.193.28:0/537930981 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada1cfb0 msgr2=0x55b8ada2de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1deed76640 1 --2- 10.20.193.28:0/537930981 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada1cfb0 0x55b8ada2de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1deed76640 1 -- 10.20.193.28:0/537930981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 msgr2=0x55b8ada2d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1deed76640 1 --2- 10.20.193.28:0/537930981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada2d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.907+0000 7f1deed76640 1 -- 10.20.193.28:0/537930981 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ada298b0 con 0x55b8ada175e0 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1deed76640 1 --2- 10.20.193.28:0/537930981 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada175e0 0x55b8ada2f390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009a00 tx=0x7f1de4040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c77c2824328c924 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1dbaffd640 1 -- 10.20.193.28:0/537930981 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de402fd90 con 0x55b8ada175e0 2026-02-20T03:26:20.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1dbaffd640 1 -- 10.20.193.28:0/537930981 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1de4049040 con 0x55b8ada175e0 2026-02-20T03:26:20.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1dbaffd640 1 -- 10.20.193.28:0/537930981 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de40389d0 con 0x55b8ada175e0 2026-02-20T03:26:20.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1df774ce00 1 -- 10.20.193.28:0/537930981 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada175e0 msgr2=0x55b8ada2f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1df774ce00 1 --2- 10.20.193.28:0/537930981 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada175e0 0x55b8ada2f390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009a00 tx=0x7f1de4040000 comp rx=0 tx=0).stop 2026-02-20T03:26:20.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1df774ce00 1 -- 10.20.193.28:0/537930981 shutdown_connections 2026-02-20T03:26:20.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1df774ce00 1 --2- 10.20.193.28:0/537930981 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada1cfb0 0x55b8ada2de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1df774ce00 1 --2- 10.20.193.28:0/537930981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada2d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1df774ce00 1 --2- 10.20.193.28:0/537930981 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada175e0 0x55b8ada2f390 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1df774ce00 1 -- 10.20.193.28:0/537930981 >> 10.20.193.28:0/537930981 conn(0x55b8ad9da240 msgr2=0x55b8ada2ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1df774ce00 1 -- 10.20.193.28:0/537930981 shutdown_connections 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.908+0000 7f1df774ce00 1 -- 10.20.193.28:0/537930981 wait complete. 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1df774ce00 1 -- start start 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1df774ce00 1 Processor -- start 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada38050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada38590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1df774ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada34e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1df774ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400e3b0 con 0x55b8ada17f60 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1df774ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400f820 con 0x55b8ada1cfb0 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1df774ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400ea80 con 0x55b8ada175e0 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1deed76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada38050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.909+0000 7f1dee575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada38590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1deed76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada38050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47778/0 (socket says 10.20.193.28:47778) 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1deed76640 1 -- 10.20.193.28:0/2873581625 learned_addr learned my addr 10.20.193.28:0/2873581625 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1def577640 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada34e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1deed76640 1 -- 10.20.193.28:0/2873581625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 msgr2=0x55b8ada34e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1deed76640 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada34e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1deed76640 1 -- 10.20.193.28:0/2873581625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 msgr2=0x55b8ada38590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1deed76640 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada38590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1deed76640 1 -- 10.20.193.28:0/2873581625 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ad649870 con 0x55b8ada175e0 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1dee575640 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada38590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1deed76640 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada38050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1de4005ec0 tx=0x7f1de402fa80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af9416cb887b7a9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1db8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:26:20.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1db8ff9640 1 -- 10.20.193.28:0/2873581625 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4004c10 con 0x55b8ada175e0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1db8ff9640 1 -- 10.20.193.28:0/2873581625 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1de4063070 con 0x55b8ada175e0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1db8ff9640 1 -- 10.20.193.28:0/2873581625 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4038c70 con 0x55b8ada175e0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1df774ce00 1 -- 10.20.193.28:0/2873581625 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8ad90a3f0 con 0x55b8ada175e0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1df774ce00 10 client.27535 _ll_register_callbacks cb 0x7f1dd8010f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.910+0000 7f1df774ce00 1 -- 10.20.193.28:0/2873581625 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b8ad93b7c0 con 0x55b8ada175e0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1db8ff9640 1 -- 10.20.193.28:0/2873581625 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f1de4038e10 con 0x55b8ada175e0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1db8ff9640 1 -- 10.20.193.28:0/2873581625 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1de4068470 con 0x55b8ada175e0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1df774ce00 10 client.27535 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1df774ce00 1 -- 10.20.193.28:0/2873581625 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b8ada2a5a0 con 0x55b8ada175e0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1db8ff9640 1 -- 10.20.193.28:0/2873581625 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1de4070030 con 0x55b8ada175e0 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1df774ce00 10 client.27535 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1df774ce00 10 client.27535 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:26:20.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1df774ce00 20 client.27535 populate_metadata read hostname 'trial028' 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1df774ce00 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b8adaabcb0 0x55b8adaae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1df774ce00 4 client.27535 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1df774ce00 1 -- 10.20.193.28:0/2873581625 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8ad91cab0 con 0x55b8adaabcb0 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.911+0000 7f1dee575640 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b8adaabcb0 0x55b8adaae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1dee575640 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b8adaabcb0 0x55b8adaae170 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72f137f2295cc019 server_cookie=fdbe3bb5b18f3b06 in_seq=0 out_seq=0 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1db8ff9640 10 client.27535 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1db8ff9640 1 -- 10.20.193.28:0/2873581625 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8ad91cab0 con 0x55b8adaabcb0 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1db8ff9640 10 client.27535 handle_command_reply: tid=0 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 client.27535 shutdown 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 -- 10.20.193.28:0/2873581625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 msgr2=0x55b8ada38050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada38050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1de4005ec0 tx=0x7f1de402fa80 comp rx=0 tx=0).stop 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 -- 10.20.193.28:0/2873581625 shutdown_connections 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55b8adaabcb0 0x55b8adaae170 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b8ada1cfb0 0x55b8ada34e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b8ada17f60 0x55b8ada38590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 --2- 10.20.193.28:0/2873581625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b8ada175e0 0x55b8ada38050 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 -- 10.20.193.28:0/2873581625 >> 10.20.193.28:0/2873581625 conn(0x55b8ad9da240 msgr2=0x55b8ada2f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1db8ff9640 0 client.27535 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 -- 10.20.193.28:0/2873581625 shutdown_connections 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 1 -- 10.20.193.28:0/2873581625 wait complete. 2026-02-20T03:26:20.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.912+0000 7f1df774ce00 20 client.27535 trim_cache size 0 max 16384 2026-02-20T03:26:20.922 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:26:20.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 -- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dc40b0da0 msgr2=0x7f1dc40b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dc40b0da0 0x7f1dc40b3260 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1de40097c0 tx=0x7f1de4005e50 comp rx=0 tx=0).stop 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 -- 10.20.193.28:0/1190850784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 msgr2=0x7f1df01a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 0x7f1df01a1880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1de000ef30 tx=0x7f1de000c560 comp rx=0 tx=0).stop 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 -- 10.20.193.28:0/1190850784 shutdown_connections 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1dc40b0da0 0x7f1dc40b3260 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1df010a980 0x7f1df01a1880 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1df0105320 0x7f1df019d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 --2- 10.20.193.28:0/1190850784 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1df0104980 0x7f1df019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 -- 10.20.193.28:0/1190850784 >> 10.20.193.28:0/1190850784 conn(0x7f1df0100680 msgr2=0x7f1df0102060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 -- 10.20.193.28:0/1190850784 shutdown_connections 2026-02-20T03:26:20.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:20.913+0000 7f1df4a46640 1 -- 10.20.193.28:0/1190850784 wait complete. 2026-02-20T03:26:21.016 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:26:21.283 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:21.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.461+0000 7f2766a55640 1 -- 10.20.193.28:0/3133614287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760104da0 msgr2=0x7f2760105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:21.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.461+0000 7f2766a55640 1 --2- 10.20.193.28:0/3133614287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760104da0 0x7f2760105180 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f274c009a30 tx=0x7f274c02f220 comp rx=0 tx=0).stop 2026-02-20T03:26:21.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.461+0000 7f2766a55640 1 -- 10.20.193.28:0/3133614287 shutdown_connections 2026-02-20T03:26:21.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.461+0000 7f2766a55640 1 --2- 10.20.193.28:0/3133614287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2760109ed0 0x7f2760111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.461+0000 7f2766a55640 1 --2- 10.20.193.28:0/3133614287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2760105750 0x7f27601097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.461+0000 7f2766a55640 1 --2- 10.20.193.28:0/3133614287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760104da0 0x7f2760105180 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.461+0000 7f2766a55640 1 -- 10.20.193.28:0/3133614287 >> 10.20.193.28:0/3133614287 conn(0x7f2760100840 msgr2=0x7f2760102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:21.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.461+0000 7f2766a55640 1 -- 10.20.193.28:0/3133614287 shutdown_connections 2026-02-20T03:26:21.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.462+0000 7f2766a55640 1 -- 10.20.193.28:0/3133614287 wait complete. 2026-02-20T03:26:21.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.462+0000 7f2766a55640 1 Processor -- start 2026-02-20T03:26:21.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.462+0000 7f2766a55640 1 -- start start 2026-02-20T03:26:21.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2766a55640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2760104da0 0x7f276019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2766a55640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2760105750 0x7f276019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2766a55640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760109ed0 0x7f27601a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2766a55640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2760114da0 con 0x7f2760109ed0 2026-02-20T03:26:21.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2766a55640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2760114c20 con 0x7f2760105750 2026-02-20T03:26:21.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2766a55640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2760114f20 con 0x7f2760104da0 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2764fcb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760109ed0 0x7f27601a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f275f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2760105750 0x7f276019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f275ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2760104da0 0x7f276019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2764fcb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760109ed0 0x7f27601a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51720/0 (socket says 10.20.193.28:51720) 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2764fcb640 1 -- 10.20.193.28:0/1496320135 learned_addr learned my addr 10.20.193.28:0/1496320135 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2764fcb640 1 -- 10.20.193.28:0/1496320135 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2760104da0 msgr2=0x7f276019d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2764fcb640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2760104da0 0x7f276019d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2764fcb640 1 -- 10.20.193.28:0/1496320135 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2760105750 msgr2=0x7f276019d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2764fcb640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2760105750 0x7f276019d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.463+0000 7f2764fcb640 1 -- 10.20.193.28:0/1496320135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27601a2260 con 0x7f2760109ed0 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.464+0000 7f2764fcb640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760109ed0 0x7f27601a1ae0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f2754004820 tx=0x7f275400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.464+0000 7f275d7fa640 1 -- 10.20.193.28:0/1496320135 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540090d0 con 0x7f2760109ed0 2026-02-20T03:26:21.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.464+0000 7f275d7fa640 1 -- 10.20.193.28:0/1496320135 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2754009270 con 0x7f2760109ed0 2026-02-20T03:26:21.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.464+0000 7f2766a55640 1 -- 10.20.193.28:0/1496320135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27601a24f0 con 0x7f2760109ed0 2026-02-20T03:26:21.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.464+0000 7f2766a55640 1 -- 10.20.193.28:0/1496320135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27601a9d90 con 0x7f2760109ed0 2026-02-20T03:26:21.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.464+0000 7f275d7fa640 1 -- 10.20.193.28:0/1496320135 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754013810 con 0x7f2760109ed0 2026-02-20T03:26:21.469 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.467+0000 7f2768f5ae00 1 Processor -- start 2026-02-20T03:26:21.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.467+0000 7f275d7fa640 1 -- 10.20.193.28:0/1496320135 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2754012070 con 0x7f2760109ed0 2026-02-20T03:26:21.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.467+0000 7f2768f5ae00 1 -- start start 2026-02-20T03:26:21.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.467+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3ad5e0 0x55b46e3ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.467+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3adf90 0x55b46e3b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.467+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3b9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.467+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b46e32de00 con 0x55b46e3ad5e0 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.467+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b46e300970 con 0x55b46e3b20d0 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.467+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b46e2ae1f0 con 0x55b46e3adf90 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3ad5e0 0x55b46e3ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3adf90 0x55b46e3b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3adf90 0x55b46e3b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47802/0 (socket says 10.20.193.28:47802) 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275ffff640 1 -- 10.20.193.28:0/206197772 learned_addr learned my addr 10.20.193.28:0/206197772 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275f7fe640 1 --2- 10.20.193.28:0/206197772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3b9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275f7fe640 1 -- 10.20.193.28:0/206197772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3adf90 msgr2=0x55b46e3b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275f7fe640 1 --2- 10.20.193.28:0/206197772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3adf90 0x55b46e3b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275f7fe640 1 -- 10.20.193.28:0/206197772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 msgr2=0x55b46e3b9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:21.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275f7fe640 1 --2- 10.20.193.28:0/206197772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3b9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275f7fe640 1 -- 10.20.193.28:0/206197772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46e2c13d0 con 0x55b46e3ad5e0 2026-02-20T03:26:21.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f275f7fe640 1 --2- 10.20.193.28:0/206197772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3ad5e0 0x55b46e3ad9c0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f2760100c60 tx=0x7f27500041e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc60d141ff14117f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:21.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f2730ce3640 1 -- 10.20.193.28:0/206197772 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750002e60 con 0x55b46e3ad5e0 2026-02-20T03:26:21.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f2730ce3640 1 -- 10.20.193.28:0/206197772 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f27500108d0 con 0x55b46e3ad5e0 2026-02-20T03:26:21.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.468+0000 7f2730ce3640 1 -- 10.20.193.28:0/206197772 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275000ea20 con 0x55b46e3ad5e0 2026-02-20T03:26:21.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f2768f5ae00 1 -- 10.20.193.28:0/206197772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3ad5e0 msgr2=0x55b46e3ad9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:21.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/206197772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3ad5e0 0x55b46e3ad9c0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f2760100c60 tx=0x7f27500041e0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f2768f5ae00 1 -- 10.20.193.28:0/206197772 shutdown_connections 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/206197772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3b9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/206197772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3adf90 0x55b46e3b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/206197772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3ad5e0 0x55b46e3ad9c0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f2768f5ae00 1 -- 10.20.193.28:0/206197772 >> 10.20.193.28:0/206197772 conn(0x55b46e370240 msgr2=0x55b46e3abce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f275d7fa640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27340b0e20 0x7f27340b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f2768f5ae00 1 -- 10.20.193.28:0/206197772 shutdown_connections 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f275d7fa640 1 -- 10.20.193.28:0/1496320135 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f27540e01f0 con 0x7f2760109ed0 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f2768f5ae00 1 -- 10.20.193.28:0/206197772 wait complete. 2026-02-20T03:26:21.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.469+0000 7f275f7fe640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27340b0e20 0x7f27340b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.470+0000 7f275f7fe640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27340b0e20 0x7f27340b32e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f275000e500 tx=0x7f2750004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.470+0000 7f2768f5ae00 1 -- start start 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.470+0000 7f2768f5ae00 1 Processor -- start 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.470+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.470+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3adf90 0x55b46e3d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.470+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3b20d0 0x55b46e3ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.470+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b46e2fc8a0 con 0x55b46e3b20d0 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.470+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b46e0eef50 con 0x55b46e3adf90 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.470+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b46e3cf170 con 0x55b46e3ad5e0 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f275f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3adf90 0x55b46e3d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2764fcb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3b20d0 0x55b46e3ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f275f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3adf90 0x55b46e3d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:44264/0 (socket says 10.20.193.28:44264) 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f275f7fe640 1 -- 10.20.193.28:0/2416109841 learned_addr learned my addr 10.20.193.28:0/2416109841 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f275ffff640 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2764fcb640 1 -- 10.20.193.28:0/2416109841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 msgr2=0x55b46e3d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2764fcb640 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2764fcb640 1 -- 10.20.193.28:0/2416109841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3adf90 msgr2=0x55b46e3d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2764fcb640 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3adf90 0x55b46e3d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2764fcb640 1 -- 10.20.193.28:0/2416109841 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46e3c8300 con 0x55b46e3b20d0 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f275f7fe640 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3adf90 0x55b46e3d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2764fcb640 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3b20d0 0x55b46e3ceb30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f275400d9b0 tx=0x7f27540a77a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd58e9b3db74847 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2721ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2721ffb640 1 -- 10.20.193.28:0/2416109841 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27540902c0 con 0x55b46e3b20d0 2026-02-20T03:26:21.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2768f5ae00 1 -- 10.20.193.28:0/2416109841 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b46e0d1b40 con 0x55b46e3b20d0 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2768f5ae00 10 client.18558 _ll_register_callbacks cb 0x55b46e339eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2721ffb640 1 -- 10.20.193.28:0/2416109841 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f27540a36a0 con 0x55b46e3b20d0 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2721ffb640 1 -- 10.20.193.28:0/2416109841 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754007760 con 0x55b46e3b20d0 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.471+0000 7f2768f5ae00 1 -- 10.20.193.28:0/2416109841 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b46e30e150 con 0x55b46e3b20d0 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2721ffb640 1 -- 10.20.193.28:0/2416109841 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f27540ce510 con 0x55b46e3b20d0 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2721ffb640 1 -- 10.20.193.28:0/2416109841 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f2754007900 con 0x55b46e3b20d0 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2768f5ae00 10 client.18558 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2768f5ae00 1 -- 10.20.193.28:0/2416109841 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b46e2bb1e0 con 0x55b46e3b20d0 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2721ffb640 1 -- 10.20.193.28:0/2416109841 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f275408ece0 con 0x55b46e3b20d0 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2768f5ae00 10 client.18558 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2768f5ae00 10 client.18558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:21.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2768f5ae00 20 client.18558 populate_metadata read hostname 'trial028' 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b46e3deb10 0x55b46e3e0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2768f5ae00 4 client.18558 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f2768f5ae00 1 -- 10.20.193.28:0/2416109841 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b46e308560 con 0x55b46e3deb10 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.472+0000 7f275ffff640 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b46e3deb10 0x55b46e3e0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f275ffff640 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b46e3deb10 0x55b46e3e0fd0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af7d00eab19d047b server_cookie=5954e8c045a9fd9 in_seq=0 out_seq=0 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2721ffb640 10 client.18558 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2721ffb640 1 -- 10.20.193.28:0/2416109841 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b46e308560 con 0x55b46e3deb10 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2721ffb640 10 client.18558 handle_command_reply: tid=0 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2768f5ae00 1 client.18558 shutdown 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2768f5ae00 1 -- 10.20.193.28:0/2416109841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3b20d0 msgr2=0x55b46e3ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3b20d0 0x55b46e3ceb30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f275400d9b0 tx=0x7f27540a77a0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2768f5ae00 1 -- 10.20.193.28:0/2416109841 shutdown_connections 2026-02-20T03:26:21.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b46e3deb10 0x55b46e3e0fd0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3b20d0 0x55b46e3ceb30 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3adf90 0x55b46e3d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/2416109841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2721ffb640 0 client.18558 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:21.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.473+0000 7f2768f5ae00 1 -- 10.20.193.28:0/2416109841 >> 10.20.193.28:0/2416109841 conn(0x55b46e370240 msgr2=0x55b46e3b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:21.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.474+0000 7f2768f5ae00 1 -- 10.20.193.28:0/2416109841 shutdown_connections 2026-02-20T03:26:21.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.474+0000 7f2768f5ae00 1 -- 10.20.193.28:0/2416109841 wait complete. 2026-02-20T03:26:21.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.474+0000 7f2768f5ae00 20 client.18558 trim_cache size 0 max 16384 2026-02-20T03:26:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f2768f5ae00 1 Processor -- start 2026-02-20T03:26:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f2768f5ae00 1 -- start start 2026-02-20T03:26:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 0x55b46e3a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3cc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f27040126a0 con 0x55b46e3adf90 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f270400ff70 con 0x55b46e3b20d0 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f270400ddc0 con 0x55b46e3ad5e0 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f275ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f275ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47820/0 (socket says 10.20.193.28:47820) 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f275ffff640 1 -- 10.20.193.28:0/606485616 learned_addr learned my addr 10.20.193.28:0/606485616 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.480+0000 7f2764fcb640 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f275f7fe640 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 0x55b46e3a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f275ffff640 1 -- 10.20.193.28:0/606485616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 msgr2=0x55b46e3cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f275ffff640 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f275ffff640 1 -- 10.20.193.28:0/606485616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 msgr2=0x55b46e3a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f275ffff640 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 0x55b46e3a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f275ffff640 1 -- 10.20.193.28:0/606485616 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46e3c8130 con 0x55b46e3ad5e0 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f275f7fe640 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 0x55b46e3a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f275ffff640 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3b1610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f274c009a00 tx=0x7f274c005950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e779152ddefd8ac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2723fff640 1 -- 10.20.193.28:0/606485616 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0040c0 con 0x55b46e3ad5e0 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2723fff640 1 -- 10.20.193.28:0/606485616 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f274c033040 con 0x55b46e3ad5e0 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2723fff640 1 -- 10.20.193.28:0/606485616 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c005300 con 0x55b46e3ad5e0 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2768f5ae00 1 -- 10.20.193.28:0/606485616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 msgr2=0x55b46e3b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3b1610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f274c009a00 tx=0x7f274c005950 comp rx=0 tx=0).stop 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2768f5ae00 1 -- 10.20.193.28:0/606485616 shutdown_connections 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 0x55b46e3a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/606485616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3b1610 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2768f5ae00 1 -- 10.20.193.28:0/606485616 >> 10.20.193.28:0/606485616 conn(0x55b46e370240 msgr2=0x55b46e3cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:21.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.481+0000 7f2768f5ae00 1 -- 10.20.193.28:0/606485616 shutdown_connections 2026-02-20T03:26:21.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.482+0000 7f2768f5ae00 1 -- 10.20.193.28:0/606485616 wait complete. 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.482+0000 7f2768f5ae00 1 -- start start 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.482+0000 7f2768f5ae00 1 Processor -- start 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 0x55b46e3d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2768f5ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3d3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f270400e430 con 0x55b46e3adf90 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f270400f8a0 con 0x55b46e3b20d0 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2768f5ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f270400eb00 con 0x55b46e3ad5e0 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 0x55b46e3d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47826/0 (socket says 10.20.193.28:47826) 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275ffff640 1 -- 10.20.193.28:0/727260296 learned_addr learned my addr 10.20.193.28:0/727260296 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2764fcb640 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3d3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275ffff640 1 -- 10.20.193.28:0/727260296 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 msgr2=0x55b46e3d3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275ffff640 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3d3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275ffff640 1 -- 10.20.193.28:0/727260296 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 msgr2=0x55b46e3d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275ffff640 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 0x55b46e3d3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275ffff640 1 -- 10.20.193.28:0/727260296 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b46dfdf870 con 0x55b46e3ad5e0 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f275ffff640 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d3250 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f274c005ed0 tx=0x7f274c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc65fd756631d707 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2721ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2721ffb640 1 -- 10.20.193.28:0/727260296 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c052070 con 0x55b46e3ad5e0 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2721ffb640 1 -- 10.20.193.28:0/727260296 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f274c004c60 con 0x55b46e3ad5e0 2026-02-20T03:26:21.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2768f5ae00 1 -- 10.20.193.28:0/727260296 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b46e2a03f0 con 0x55b46e3ad5e0 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2768f5ae00 10 client.27553 _ll_register_callbacks cb 0x7f2754002f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.483+0000 7f2768f5ae00 1 -- 10.20.193.28:0/727260296 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b46e2b2ab0 con 0x55b46e3ad5e0 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2721ffb640 1 -- 10.20.193.28:0/727260296 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0056b0 con 0x55b46e3ad5e0 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2721ffb640 1 -- 10.20.193.28:0/727260296 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f274c038770 con 0x55b46e3ad5e0 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2721ffb640 1 -- 10.20.193.28:0/727260296 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f274c038a30 con 0x55b46e3ad5e0 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2768f5ae00 10 client.27553 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2768f5ae00 1 -- 10.20.193.28:0/727260296 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b46e3c8e20 con 0x55b46e3ad5e0 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2721ffb640 1 -- 10.20.193.28:0/727260296 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f274c038bd0 con 0x55b46e3ad5e0 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2768f5ae00 10 client.27553 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2768f5ae00 10 client.27553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2768f5ae00 20 client.27553 populate_metadata read hostname 'trial028' 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b46e44af10 0x55b46e44d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:21.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2768f5ae00 4 client.27553 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f2768f5ae00 1 -- 10.20.193.28:0/727260296 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f27500108d0 con 0x55b46e44af10 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.484+0000 7f275f7fe640 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b46e44af10 0x55b46e44d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f275f7fe640 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b46e44af10 0x55b46e44d3d0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d2b9147f9f098db server_cookie=26fd7900fa312895 in_seq=0 out_seq=0 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2721ffb640 10 client.27553 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2721ffb640 1 -- 10.20.193.28:0/727260296 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f27500108d0 con 0x55b46e44af10 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2721ffb640 10 client.27553 handle_command_reply: tid=0 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 client.27553 shutdown 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 -- 10.20.193.28:0/727260296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 msgr2=0x55b46e3d3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d3250 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f274c005ed0 tx=0x7f274c009780 comp rx=0 tx=0).stop 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 -- 10.20.193.28:0/727260296 shutdown_connections 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b46e44af10 0x55b46e44d3d0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b46e3b20d0 0x55b46e3d3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2721ffb640 0 client.27553 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b46e3adf90 0x55b46e3d3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 --2- 10.20.193.28:0/727260296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b46e3ad5e0 0x55b46e3d3250 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 -- 10.20.193.28:0/727260296 >> 10.20.193.28:0/727260296 conn(0x55b46e370240 msgr2=0x55b46e3b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:21.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 -- 10.20.193.28:0/727260296 shutdown_connections 2026-02-20T03:26:21.494 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:26:21.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.485+0000 7f2768f5ae00 1 -- 10.20.193.28:0/727260296 wait complete. 2026-02-20T03:26:21.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2768f5ae00 20 client.27553 trim_cache size 0 max 16384 2026-02-20T03:26:21.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 -- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27340b0e20 msgr2=0x7f27340b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:21.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27340b0e20 0x7f27340b32e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f275000e500 tx=0x7f2750004100 comp rx=0 tx=0).stop 2026-02-20T03:26:21.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 -- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760109ed0 msgr2=0x7f27601a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:21.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760109ed0 0x7f27601a1ae0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f2754004820 tx=0x7f275400d4a0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 -- 10.20.193.28:0/1496320135 shutdown_connections 2026-02-20T03:26:21.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27340b0e20 0x7f27340b32e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2760109ed0 0x7f27601a1ae0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2760105750 0x7f276019d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 --2- 10.20.193.28:0/1496320135 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2760104da0 0x7f276019d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:21.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 -- 10.20.193.28:0/1496320135 >> 10.20.193.28:0/1496320135 conn(0x7f2760100840 msgr2=0x7f2760101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:21.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 -- 10.20.193.28:0/1496320135 shutdown_connections 2026-02-20T03:26:21.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:21.486+0000 7f2766a55640 1 -- 10.20.193.28:0/1496320135 wait complete. 2026-02-20T03:26:21.525 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.36 MB/sec execute 474 sec latency 2145.496 ms 2026-02-20T03:26:21.584 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:21 trial028 ceph-mon[38552]: pgmap v532: 129 pgs: 129 active+clean; 178 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 786 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2026-02-20T03:26:21.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:21 trial126 ceph-mon[38476]: pgmap v532: 129 pgs: 129 active+clean; 178 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 786 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2026-02-20T03:26:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:21 trial177 ceph-mon[43181]: pgmap v532: 129 pgs: 129 active+clean; 178 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 786 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2026-02-20T03:26:22.525 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.34 MB/sec execute 475 sec latency 3145.536 ms 2026-02-20T03:26:22.586 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:26:22.586 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:26:22.874 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:23.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.126+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/914853376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88106a90 msgr2=0x7f1f88106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:23.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.126+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/914853376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88106a90 0x7f1f88106f40 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00b0a0 tx=0x7f1f7c02f4e0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/914853376 shutdown_connections 2026-02-20T03:26:23.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/914853376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88106a90 0x7f1f88106f40 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/914853376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f88101fa0 0x7f1f88106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/914853376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f88101680 0x7f1f88101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/914853376 >> 10.20.193.28:0/914853376 conn(0x7f1f880fd330 msgr2=0x7f1f880ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:23.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/914853376 shutdown_connections 2026-02-20T03:26:23.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/914853376 wait complete. 2026-02-20T03:26:23.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 Processor -- start 2026-02-20T03:26:23.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- start start 2026-02-20T03:26:23.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88101680 0x7f1f881159b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f88101fa0 0x7f1f88115ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f88106a90 0x7f1f8810eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88119190 con 0x7f1f88101680 2026-02-20T03:26:23.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88119010 con 0x7f1f88101fa0 2026-02-20T03:26:23.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88119310 con 0x7f1f88106a90 2026-02-20T03:26:23.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88101680 0x7f1f881159b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:23.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88101680 0x7f1f881159b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51788/0 (socket says 10.20.193.28:51788) 2026-02-20T03:26:23.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f877fe640 1 -- 10.20.193.28:0/3376087164 learned_addr learned my addr 10.20.193.28:0/3376087164 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:23.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f877fe640 1 -- 10.20.193.28:0/3376087164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f88106a90 msgr2=0x7f1f8810eae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:23.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f877fe640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f88106a90 0x7f1f8810eae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f877fe640 1 -- 10.20.193.28:0/3376087164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f88101fa0 msgr2=0x7f1f88115ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f877fe640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f88101fa0 0x7f1f88115ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f877fe640 1 -- 10.20.193.28:0/3376087164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8810f3a0 con 0x7f1f88101680 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f877fe640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88101680 0x7f1f881159b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400b570 tx=0x7f1f7400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f84ff9640 1 -- 10.20.193.28:0/3376087164 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74013020 con 0x7f1f88101680 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f84ff9640 1 -- 10.20.193.28:0/3376087164 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1f74004480 con 0x7f1f88101680 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f84ff9640 1 -- 10.20.193.28:0/3376087164 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400fb50 con 0x7f1f88101680 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/3376087164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8810f690 con 0x7f1f88101680 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/3376087164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f881136b0 con 0x7f1f88101680 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.127+0000 7f1f84ff9640 1 -- 10.20.193.28:0/3376087164 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1f74020060 con 0x7f1f88101680 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f901b9e00 1 Processor -- start 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f901b9e00 1 -- start start 2026-02-20T03:26:23.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ad0c0 0x55f4917ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ada70 0x55f4917b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f4917b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f4916ffc00 con 0x55f4917b1b60 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f4916ad3c0 con 0x55f4917ad0c0 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f4916fbb30 con 0x55f4917ada70 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f86ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f4917b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f86ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f4917b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51796/0 (socket says 10.20.193.28:51796) 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f86ffd640 1 -- 10.20.193.28:0/705261448 learned_addr learned my addr 10.20.193.28:0/705261448 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f84ff9640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f5c0b0e20 0x7f1f5c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f84ff9640 1 -- 10.20.193.28:0/3376087164 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f1f740e0300 con 0x7f1f88101680 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f86ffd640 1 -- 10.20.193.28:0/705261448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ada70 msgr2=0x55f4917b1540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f86ffd640 1 --2- 10.20.193.28:0/705261448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ada70 0x55f4917b1540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f86ffd640 1 -- 10.20.193.28:0/705261448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ad0c0 msgr2=0x55f4917ad4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f86ffd640 1 --2- 10.20.193.28:0/705261448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ad0c0 0x55f4917ad4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f86ffd640 1 -- 10.20.193.28:0/705261448 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4916a6840 con 0x55f4917b1b60 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f87fff640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f5c0b0e20 0x7f1f5c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.132+0000 7f1f86ffd640 1 --2- 10.20.193.28:0/705261448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f4917b1fd0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009810 tx=0x7f1f78009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4910836c120792c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f4bfff640 1 -- 10.20.193.28:0/705261448 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78016070 con 0x55f4917b1b60 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f4bfff640 1 -- 10.20.193.28:0/705261448 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1f78004480 con 0x55f4917b1b60 2026-02-20T03:26:23.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f4bfff640 1 -- 10.20.193.28:0/705261448 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7800bcf0 con 0x55f4917b1b60 2026-02-20T03:26:23.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- 10.20.193.28:0/705261448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 msgr2=0x55f4917b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:23.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/705261448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f4917b1fd0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009810 tx=0x7f1f78009ce0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f87fff640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f5c0b0e20 0x7f1f5c0b32e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c007600 tx=0x7f1f7c009da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:23.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- 10.20.193.28:0/705261448 shutdown_connections 2026-02-20T03:26:23.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/705261448 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f4917b1fd0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/705261448 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ada70 0x55f4917b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/705261448 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ad0c0 0x55f4917ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- 10.20.193.28:0/705261448 >> 10.20.193.28:0/705261448 conn(0x55f4917a5b60 msgr2=0x55f4917ab5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:23.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- 10.20.193.28:0/705261448 shutdown_connections 2026-02-20T03:26:23.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- 10.20.193.28:0/705261448 wait complete. 2026-02-20T03:26:23.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- start start 2026-02-20T03:26:23.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 Processor -- start 2026-02-20T03:26:23.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ad0c0 0x55f4917c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917b1b60 0x55f4917c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f4916a71a0 con 0x55f4917ada70 2026-02-20T03:26:23.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f4917b9d70 con 0x55f4917ad0c0 2026-02-20T03:26:23.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f4917c6400 con 0x55f4917b1b60 2026-02-20T03:26:23.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f86ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:23.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f86ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51806/0 (socket says 10.20.193.28:51806) 2026-02-20T03:26:23.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f86ffd640 1 -- 10.20.193.28:0/3967106193 learned_addr learned my addr 10.20.193.28:0/3967106193 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:23.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f86ffd640 1 -- 10.20.193.28:0/3967106193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917b1b60 msgr2=0x55f4917c5c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f86ffd640 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917b1b60 0x55f4917c5c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f86ffd640 1 -- 10.20.193.28:0/3967106193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ad0c0 msgr2=0x55f4917c7540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f86ffd640 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ad0c0 0x55f4917c7540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f86ffd640 1 -- 10.20.193.28:0/3967106193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4917bf690 con 0x55f4917ada70 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f86ffd640 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917c7a80 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f1f78014040 tx=0x7f1f7800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d165e052294034fb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f497fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f497fa640 1 -- 10.20.193.28:0/3967106193 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7801e070 con 0x55f4917ada70 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f497fa640 1 -- 10.20.193.28:0/3967106193 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1f78006b80 con 0x55f4917ada70 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- 10.20.193.28:0/3967106193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4914ceb60 con 0x55f4917ada70 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 10 client.18576 _ll_register_callbacks cb 0x55f4916ab0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- 10.20.193.28:0/3967106193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f4917077f0 con 0x55f4917ada70 2026-02-20T03:26:23.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f497fa640 1 -- 10.20.193.28:0/3967106193 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7801e070 con 0x55f4917ada70 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f497fa640 1 -- 10.20.193.28:0/3967106193 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f1f78002780 con 0x55f4917ada70 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f497fa640 1 -- 10.20.193.28:0/3967106193 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1f78016040 con 0x55f4917ada70 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 10 client.18576 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- 10.20.193.28:0/3967106193 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f4916cc430 con 0x55f4917ada70 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f497fa640 1 -- 10.20.193.28:0/3967106193 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1f7801a870 con 0x55f4917ada70 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 10 client.18576 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 10 client.18576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 20 client.18576 populate_metadata read hostname 'trial028' 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f4917d5bf0 0x55f4917d7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 4 client.18576 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:23.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.134+0000 7f1f901b9e00 1 -- 10.20.193.28:0/3967106193 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f491681c00 con 0x55f4917d5bf0 2026-02-20T03:26:23.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.161+0000 7f1f877fe640 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f4917d5bf0 0x55f4917d7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:23.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.188+0000 7f1f877fe640 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f4917d5bf0 0x55f4917d7fe0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e60c558dcf5be182 server_cookie=f80cf875d6e804af in_seq=0 out_seq=0 2026-02-20T03:26:23.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.188+0000 7f1f497fa640 10 client.18576 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:23.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f497fa640 1 -- 10.20.193.28:0/3967106193 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f491681c00 con 0x55f4917d5bf0 2026-02-20T03:26:23.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f497fa640 10 client.18576 handle_command_reply: tid=0 2026-02-20T03:26:23.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 client.18576 shutdown 2026-02-20T03:26:23.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 -- 10.20.193.28:0/3967106193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 msgr2=0x55f4917c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917c7a80 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f1f78014040 tx=0x7f1f7800bf50 comp rx=0 tx=0).stop 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 -- 10.20.193.28:0/3967106193 shutdown_connections 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f4917d5bf0 0x55f4917d7fe0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917b1b60 0x55f4917c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917c7a80 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/3967106193 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ad0c0 0x55f4917c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 -- 10.20.193.28:0/3967106193 >> 10.20.193.28:0/3967106193 conn(0x55f4917a5b60 msgr2=0x55f4917b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f497fa640 0 client.18576 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 -- 10.20.193.28:0/3967106193 shutdown_connections 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 1 -- 10.20.193.28:0/3967106193 wait complete. 2026-02-20T03:26:23.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.189+0000 7f1f901b9e00 20 client.18576 trim_cache size 0 max 16384 2026-02-20T03:26:23.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 Processor -- start 2026-02-20T03:26:23.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- start start 2026-02-20T03:26:23.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ad0c0 0x55f4917dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917ddd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917b1b60 0x55f4917cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c012740 con 0x55f4917ada70 2026-02-20T03:26:23.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c010010 con 0x55f4917b1b60 2026-02-20T03:26:23.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c00de60 con 0x55f4917ad0c0 2026-02-20T03:26:23.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f86ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917ddd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:23.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f86ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917ddd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51814/0 (socket says 10.20.193.28:51814) 2026-02-20T03:26:23.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f86ffd640 1 -- 10.20.193.28:0/225224226 learned_addr learned my addr 10.20.193.28:0/225224226 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:23.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f86ffd640 1 -- 10.20.193.28:0/225224226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ad0c0 msgr2=0x55f4917dd7e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:23.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f86ffd640 1 --2- 10.20.193.28:0/225224226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ad0c0 0x55f4917dd7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f86ffd640 1 -- 10.20.193.28:0/225224226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917b1b60 msgr2=0x55f4917cd3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:23.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f86ffd640 1 --2- 10.20.193.28:0/225224226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917b1b60 0x55f4917cd3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f86ffd640 1 -- 10.20.193.28:0/225224226 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4917c4c00 con 0x55f4917ada70 2026-02-20T03:26:23.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f86ffd640 1 --2- 10.20.193.28:0/225224226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917ddd20 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800b860 tx=0x7f1f78029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c84d9b619d16c4a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:23.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f4b7fe640 1 -- 10.20.193.28:0/225224226 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78032070 con 0x55f4917ada70 2026-02-20T03:26:23.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f4b7fe640 1 -- 10.20.193.28:0/225224226 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55f4917077f0 con 0x55f4917ada70 2026-02-20T03:26:23.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f4b7fe640 1 -- 10.20.193.28:0/225224226 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7801e040 con 0x55f4917ada70 2026-02-20T03:26:23.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- 10.20.193.28:0/225224226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 msgr2=0x55f4917ddd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:23.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/225224226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917ddd20 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800b860 tx=0x7f1f78029000 comp rx=0 tx=0).stop 2026-02-20T03:26:23.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- 10.20.193.28:0/225224226 shutdown_connections 2026-02-20T03:26:23.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/225224226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917b1b60 0x55f4917cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/225224226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917ada70 0x55f4917ddd20 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/225224226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ad0c0 0x55f4917dd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- 10.20.193.28:0/225224226 >> 10.20.193.28:0/225224226 conn(0x55f4917a5b60 msgr2=0x55f4917c26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:23.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- 10.20.193.28:0/225224226 shutdown_connections 2026-02-20T03:26:23.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- 10.20.193.28:0/225224226 wait complete. 2026-02-20T03:26:23.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 -- start start 2026-02-20T03:26:23.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.196+0000 7f1f901b9e00 1 Processor -- start 2026-02-20T03:26:23.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ad0c0 0x55f4917cd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ada70 0x55f4917cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f491839cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c00e4d0 con 0x55f4917b1b60 2026-02-20T03:26:23.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c00f940 con 0x55f4917ada70 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c00eba0 con 0x55f4917ad0c0 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f491839cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f491839cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51818/0 (socket says 10.20.193.28:51818) 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f87fff640 1 -- 10.20.193.28:0/64398301 learned_addr learned my addr 10.20.193.28:0/64398301 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f87fff640 1 -- 10.20.193.28:0/64398301 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ad0c0 msgr2=0x55f4917cd030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f87fff640 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ad0c0 0x55f4917cd030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f87fff640 1 -- 10.20.193.28:0/64398301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ada70 msgr2=0x55f4917cd570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f87fff640 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ada70 0x55f4917cd570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f87fff640 1 -- 10.20.193.28:0/64398301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4917bf4c0 con 0x55f4917b1b60 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f87fff640 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f491839cd0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c036000 tx=0x7f1f7c02f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abfdbcf88f167a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:23.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f497fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f497fa640 1 -- 10.20.193.28:0/64398301 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c004d50 con 0x55f4917b1b60 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f497fa640 1 -- 10.20.193.28:0/64398301 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1f7c0044f0 con 0x55f4917b1b60 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f497fa640 1 -- 10.20.193.28:0/64398301 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c007d80 con 0x55f4917b1b60 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 -- 10.20.193.28:0/64398301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4913de900 con 0x55f4917b1b60 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 10 client.18582 _ll_register_callbacks cb 0x7f1f7800bdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 -- 10.20.193.28:0/64398301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f78004480 con 0x55f4917b1b60 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f497fa640 1 -- 10.20.193.28:0/64398301 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f1f7c007670 con 0x55f4917b1b60 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f497fa640 1 -- 10.20.193.28:0/64398301 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1f7c0046a0 con 0x55f4917b1b60 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 10 client.18582 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 -- 10.20.193.28:0/64398301 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f4916ba4d0 con 0x55f4917b1b60 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f497fa640 1 -- 10.20.193.28:0/64398301 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1f7c055050 con 0x55f4917b1b60 2026-02-20T03:26:23.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 10 client.18582 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:23.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 10 client.18582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:23.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 20 client.18582 populate_metadata read hostname 'trial028' 2026-02-20T03:26:23.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f491842b90 0x55f491845050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 4 client.18582 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:26:23.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.201+0000 7f1f901b9e00 1 -- 10.20.193.28:0/64398301 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f49146fa20 con 0x55f491842b90 2026-02-20T03:26:23.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.204+0000 7f1f877fe640 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f491842b90 0x55f491845050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:23.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.271+0000 7f1f877fe640 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f491842b90 0x55f491845050 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2271a4581c5420 server_cookie=25a7c68dbd1a7753 in_seq=0 out_seq=0 2026-02-20T03:26:23.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.271+0000 7f1f497fa640 10 client.18582 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:23.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f497fa640 1 -- 10.20.193.28:0/64398301 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f49146fa20 con 0x55f491842b90 2026-02-20T03:26:23.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f497fa640 10 client.18582 handle_command_reply: tid=0 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 client.18582 shutdown 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 -- 10.20.193.28:0/64398301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 msgr2=0x55f491839cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f491839cd0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c036000 tx=0x7f1f7c02f4e0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 -- 10.20.193.28:0/64398301 shutdown_connections 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f491842b90 0x55f491845050 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f4917b1b60 0x55f491839cd0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f4917ada70 0x55f4917cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 --2- 10.20.193.28:0/64398301 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f4917ad0c0 0x55f4917cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 -- 10.20.193.28:0/64398301 >> 10.20.193.28:0/64398301 conn(0x55f4917a5b60 msgr2=0x55f4917b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f497fa640 0 client.18582 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:23.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 -- 10.20.193.28:0/64398301 shutdown_connections 2026-02-20T03:26:23.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 1 -- 10.20.193.28:0/64398301 wait complete. 2026-02-20T03:26:23.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f901b9e00 20 client.18582 trim_cache size 0 max 16384 2026-02-20T03:26:23.300 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:26:23.300 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:26:23.300 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "daec2d1f-1305-43bc-8289-ef495c5b0077", 2026-02-20T03:26:23.300 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:26:23.300 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:26:23.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f5c0b0e20 msgr2=0x7f1f5c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:23.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f5c0b0e20 0x7f1f5c0b32e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c007600 tx=0x7f1f7c009da0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88101680 msgr2=0x7f1f881159b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:23.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88101680 0x7f1f881159b0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400b570 tx=0x7f1f7400ba40 comp rx=0 tx=0).stop 2026-02-20T03:26:23.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/3376087164 shutdown_connections 2026-02-20T03:26:23.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1f5c0b0e20 0x7f1f5c0b32e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1f88106a90 0x7f1f8810eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1f88101fa0 0x7f1f88115ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 --2- 10.20.193.28:0/3376087164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1f88101680 0x7f1f881159b0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/3376087164 >> 10.20.193.28:0/3376087164 conn(0x7f1f880fd330 msgr2=0x7f1f881043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:23.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/3376087164 shutdown_connections 2026-02-20T03:26:23.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.284+0000 7f1f8ca2b640 1 -- 10.20.193.28:0/3376087164 wait complete. 2026-02-20T03:26:23.431 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:26:23.525 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.32 MB/sec execute 476 sec latency 4145.574 ms 2026-02-20T03:26:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:23 trial028 ceph-mon[38552]: pgmap v533: 129 pgs: 129 active+clean; 178 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 741 KiB/s rd, 2.7 MiB/s wr, 340 op/s 2026-02-20T03:26:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:23 trial177 ceph-mon[43181]: pgmap v533: 129 pgs: 129 active+clean; 178 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 741 KiB/s rd, 2.7 MiB/s wr, 340 op/s 2026-02-20T03:26:23.742 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:23 trial126 ceph-mon[38476]: pgmap v533: 129 pgs: 129 active+clean; 178 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 741 KiB/s rd, 2.7 MiB/s wr, 340 op/s 2026-02-20T03:26:23.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- 10.20.193.28:0/3422428537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb410eef0 msgr2=0x7fafb410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:23.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 --2- 10.20.193.28:0/3422428537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb410eef0 0x7fafb410f2d0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009a30 tx=0x7fafa802f260 comp rx=0 tx=0).stop 2026-02-20T03:26:23.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- 10.20.193.28:0/3422428537 shutdown_connections 2026-02-20T03:26:23.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 --2- 10.20.193.28:0/3422428537 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafb4109ba0 0x7fafb4115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 --2- 10.20.193.28:0/3422428537 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafb4109220 0x7fafb4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 --2- 10.20.193.28:0/3422428537 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb410eef0 0x7fafb410f2d0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:23.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- 10.20.193.28:0/3422428537 >> 10.20.193.28:0/3422428537 conn(0x7fafb4078600 msgr2=0x7fafb407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:23.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- 10.20.193.28:0/3422428537 shutdown_connections 2026-02-20T03:26:23.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- 10.20.193.28:0/3422428537 wait complete. 2026-02-20T03:26:23.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 Processor -- start 2026-02-20T03:26:23.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- start start 2026-02-20T03:26:23.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb4109220 0x7fafb40837d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafb4109ba0 0x7fafb4083d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafb410eef0 0x7fafb407c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4119200 con 0x7fafb4109220 2026-02-20T03:26:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4119080 con 0x7fafb410eef0 2026-02-20T03:26:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4119380 con 0x7fafb4109ba0 2026-02-20T03:26:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb4109220 0x7fafb40837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb4109220 0x7fafb40837d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51826/0 (socket says 10.20.193.28:51826) 2026-02-20T03:26:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb2575640 1 -- 10.20.193.28:0/118715837 learned_addr learned my addr 10.20.193.28:0/118715837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb2575640 1 -- 10.20.193.28:0/118715837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafb4109ba0 msgr2=0x7fafb4083d10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:23.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb2575640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafb4109ba0 0x7fafb4083d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb2575640 1 -- 10.20.193.28:0/118715837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafb410eef0 msgr2=0x7fafb407c8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:24.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb2575640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafb410eef0 0x7fafb407c8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb2575640 1 -- 10.20.193.28:0/118715837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb407d1a0 con 0x7fafb4109220 2026-02-20T03:26:24.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb2575640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb4109220 0x7fafb40837d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fafa802f770 tx=0x7fafa8002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:24.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7faf9b7fe640 1 -- 10.20.193.28:0/118715837 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8004280 con 0x7fafb4109220 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7faf9b7fe640 1 -- 10.20.193.28:0/118715837 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafa8004420 con 0x7fafb4109220 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7faf9b7fe640 1 -- 10.20.193.28:0/118715837 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8038e30 con 0x7fafb4109220 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- 10.20.193.28:0/118715837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb407d430 con 0x7fafb4109220 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.988+0000 7fafb3577640 1 -- 10.20.193.28:0/118715837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb40814d0 con 0x7fafb4109220 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 Processor -- start 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 -- start start 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7faf9b7fe640 1 -- 10.20.193.28:0/118715837 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fafa80047c0 con 0x7fafb4109220 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84bfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5631f843fe50 con 0x5631f84c5000 2026-02-20T03:26:24.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5631f84129c0 con 0x5631f84bffb0 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5631f83c0240 con 0x5631f84bf630 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84c53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51838/0 (socket says 10.20.193.28:51838) 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 -- 10.20.193.28:0/2361452332 learned_addr learned my addr 10.20.193.28:0/2361452332 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 -- 10.20.193.28:0/2361452332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 msgr2=0x5631f84bfa70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 --2- 10.20.193.28:0/2361452332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84bfa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 -- 10.20.193.28:0/2361452332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 msgr2=0x5631f84cbe30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 --2- 10.20.193.28:0/2361452332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84cbe30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 -- 10.20.193.28:0/2361452332 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f83d3420 con 0x5631f84c5000 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 --2- 10.20.193.28:0/2361452332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84c53e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009cf0 tx=0x7fafa400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f157c14dab4ee32 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7faf98ff9640 1 -- 10.20.193.28:0/2361452332 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4017070 con 0x5631f84c5000 2026-02-20T03:26:24.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7faf98ff9640 1 -- 10.20.193.28:0/2361452332 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafa400bd50 con 0x5631f84c5000 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7faf98ff9640 1 -- 10.20.193.28:0/2361452332 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4006e60 con 0x5631f84c5000 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/2361452332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 msgr2=0x5631f84c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/2361452332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84c53e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009cf0 tx=0x7fafa400b420 comp rx=0 tx=0).stop 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7faf9b7fe640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf8c0b0da0 0x7faf8c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/2361452332 shutdown_connections 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/2361452332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/2361452332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84bfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/2361452332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84c53e0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/2361452332 >> 10.20.193.28:0/2361452332 conn(0x5631f8482290 msgr2=0x5631f84bdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/2361452332 shutdown_connections 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7faf9b7fe640 1 -- 10.20.193.28:0/118715837 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fafa81052f0 con 0x7fafb4109220 2026-02-20T03:26:24.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/2361452332 wait complete. 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.994+0000 7fafb2d76640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf8c0b0da0 0x7faf8c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.999+0000 7fafb2d76640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf8c0b0da0 0x7faf8c0b3260 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fafa4004530 tx=0x7fafa4004590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:23.999+0000 7fafbb0a9e00 1 -- start start 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafbb0a9e00 1 Processor -- start 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84d9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84da510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84d8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5631f840e8f0 con 0x5631f84c5000 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5631f8200f50 con 0x5631f84bffb0 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5631f84d8e90 con 0x5631f84bf630 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84d8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:24.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84d8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51840/0 (socket says 10.20.193.28:51840) 2026-02-20T03:26:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafb2d76640 1 -- 10.20.193.28:0/4085064971 learned_addr learned my addr 10.20.193.28:0/4085064971 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafb2d76640 1 -- 10.20.193.28:0/4085064971 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 msgr2=0x5631f84d9fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafb2d76640 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84d9fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafb2d76640 1 -- 10.20.193.28:0/4085064971 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 msgr2=0x5631f84da510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:24.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafb2d76640 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84da510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafb2d76640 1 -- 10.20.193.28:0/4085064971 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f84d1b20 con 0x5631f84c5000 2026-02-20T03:26:24.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7fafb2d76640 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84d8710 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009cf0 tx=0x7fafa400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a41c1b9bd248a5a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:24.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.001+0000 7faf63fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7faf63fff640 1 -- 10.20.193.28:0/4085064971 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4004980 con 0x5631f84c5000 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/4085064971 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f81e3b40 con 0x5631f84c5000 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 10 client.18594 _ll_register_callbacks cb 0x5631f844bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/4085064971 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5631f84201a0 con 0x5631f84c5000 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7faf63fff640 1 -- 10.20.193.28:0/4085064971 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafa402d070 con 0x5631f84c5000 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7faf63fff640 1 -- 10.20.193.28:0/4085064971 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40283f0 con 0x5631f84c5000 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7faf63fff640 1 -- 10.20.193.28:0/4085064971 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fafa4028670 con 0x5631f84c5000 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7faf63fff640 1 -- 10.20.193.28:0/4085064971 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fafa4028950 con 0x5631f84c5000 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 10 client.18594 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/4085064971 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5631f83cd230 con 0x5631f84c5000 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7faf63fff640 1 -- 10.20.193.28:0/4085064971 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fafa401b070 con 0x5631f84c5000 2026-02-20T03:26:24.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 10 client.18594 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 10 client.18594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 20 client.18594 populate_metadata read hostname 'trial028' 2026-02-20T03:26:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5631f84e87f0 0x5631f84eabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 4 client.18594 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.002+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/4085064971 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631f841a5b0 con 0x5631f84e87f0 2026-02-20T03:26:24.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.013+0000 7fafb2575640 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5631f84e87f0 0x5631f84eabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:24.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.041+0000 7faf63fff640 10 client.18594 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:24.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.041+0000 7fafb2575640 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5631f84e87f0 0x5631f84eabe0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8791018c63b7aeb7 server_cookie=a0f06a678bf46ab1 in_seq=0 out_seq=0 2026-02-20T03:26:24.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7faf63fff640 1 -- 10.20.193.28:0/4085064971 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5631f841a5b0 con 0x5631f84e87f0 2026-02-20T03:26:24.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7faf63fff640 10 client.18594 handle_command_reply: tid=0 2026-02-20T03:26:24.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 client.18594 shutdown 2026-02-20T03:26:24.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/4085064971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 msgr2=0x5631f84d8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:24.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84d8710 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009cf0 tx=0x7fafa400b420 comp rx=0 tx=0).stop 2026-02-20T03:26:24.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/4085064971 shutdown_connections 2026-02-20T03:26:24.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5631f84e87f0 0x5631f84eabe0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84d8710 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84da510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/4085064971 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84d9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/4085064971 >> 10.20.193.28:0/4085064971 conn(0x5631f8482290 msgr2=0x5631f84be440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:24.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7faf63fff640 0 client.18594 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:24.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/4085064971 shutdown_connections 2026-02-20T03:26:24.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/4085064971 wait complete. 2026-02-20T03:26:24.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.056+0000 7fafbb0a9e00 20 client.18594 trim_cache size 0 max 16384 2026-02-20T03:26:24.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafbb0a9e00 1 Processor -- start 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafbb0a9e00 1 -- start start 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bf630 0x5631f84b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84bffb0 0x5631f84d7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84c5000 0x5631f84f0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf58012770 con 0x5631f84bffb0 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faf58010040 con 0x5631f84bf630 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf5800de90 con 0x5631f84c5000 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafb1d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84bffb0 0x5631f84d7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafb1d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84bffb0 0x5631f84d7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51844/0 (socket says 10.20.193.28:51844) 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.062+0000 7fafb1d74640 1 -- 10.20.193.28:0/3243589181 learned_addr learned my addr 10.20.193.28:0/3243589181 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:24.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafb1d74640 1 -- 10.20.193.28:0/3243589181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84c5000 msgr2=0x5631f84f0290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafb1d74640 1 --2- 10.20.193.28:0/3243589181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84c5000 0x5631f84f0290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafb1d74640 1 -- 10.20.193.28:0/3243589181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bf630 msgr2=0x5631f84b7d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafb1d74640 1 --2- 10.20.193.28:0/3243589181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bf630 0x5631f84b7d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafb1d74640 1 -- 10.20.193.28:0/3243589181 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f84d1950 con 0x5631f84bffb0 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafb1d74640 1 --2- 10.20.193.28:0/3243589181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84bffb0 0x5631f84d7620 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fafb407e0b0 tx=0x7faf9c009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ed7614ee134874 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7faf7e4e6640 1 -- 10.20.193.28:0/3243589181 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9c016070 con 0x5631f84bffb0 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7faf7e4e6640 1 -- 10.20.193.28:0/3243589181 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faf9c004500 con 0x5631f84bffb0 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7faf7e4e6640 1 -- 10.20.193.28:0/3243589181 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9c011b80 con 0x5631f84bffb0 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/3243589181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84bffb0 msgr2=0x5631f84d7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/3243589181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84bffb0 0x5631f84d7620 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fafb407e0b0 tx=0x7faf9c009a30 comp rx=0 tx=0).stop 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/3243589181 shutdown_connections 2026-02-20T03:26:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/3243589181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84c5000 0x5631f84f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/3243589181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84bffb0 0x5631f84d7620 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/3243589181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bf630 0x5631f84b7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/3243589181 >> 10.20.193.28:0/3243589181 conn(0x5631f8482290 msgr2=0x5631f84d6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/3243589181 shutdown_connections 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/3243589181 wait complete. 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 -- start start 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.067+0000 7fafbb0a9e00 1 Processor -- start 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84e07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84de770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf5800e500 con 0x5631f84c5000 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faf5800f970 con 0x5631f84bffb0 2026-02-20T03:26:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf5800ebd0 con 0x5631f84bf630 2026-02-20T03:26:24.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84de770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:24.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:24.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb1d74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84e07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:24.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84de770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51846/0 (socket says 10.20.193.28:51846) 2026-02-20T03:26:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2d76640 1 -- 10.20.193.28:0/1262810743 learned_addr learned my addr 10.20.193.28:0/1262810743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2d76640 1 -- 10.20.193.28:0/1262810743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 msgr2=0x5631f84e02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2d76640 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84e02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2d76640 1 -- 10.20.193.28:0/1262810743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 msgr2=0x5631f84e07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2d76640 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84e07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2d76640 1 -- 10.20.193.28:0/1262810743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631f80f1870 con 0x5631f84c5000 2026-02-20T03:26:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafb2d76640 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84de770 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fafa4004560 tx=0x7fafa4009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b56f649673466d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7faf63fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7faf63fff640 1 -- 10.20.193.28:0/1262810743 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4040070 con 0x5631f84c5000 2026-02-20T03:26:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/1262810743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631f83b2440 con 0x5631f84c5000 2026-02-20T03:26:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 10 client.18600 _ll_register_callbacks cb 0x7fafa4015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/1262810743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafa400bd50 con 0x5631f84c5000 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7faf63fff640 1 -- 10.20.193.28:0/1262810743 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafa402d070 con 0x5631f84c5000 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7faf63fff640 1 -- 10.20.193.28:0/1262810743 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa40128f0 con 0x5631f84c5000 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7faf63fff640 1 -- 10.20.193.28:0/1262810743 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fafa4012410 con 0x5631f84c5000 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7faf63fff640 1 -- 10.20.193.28:0/1262810743 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fafa4004390 con 0x5631f84c5000 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 10 client.18600 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/1262810743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5631f84d2640 con 0x5631f84c5000 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7faf63fff640 1 -- 10.20.193.28:0/1262810743 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fafa401b040 con 0x5631f84c5000 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 10 client.18600 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 10 client.18600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 20 client.18600 populate_metadata read hostname 'trial028' 2026-02-20T03:26:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5631f8553fb0 0x5631f8556470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 4 client.18600 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:26:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.069+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/1262810743 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5631f83e3810 con 0x5631f8553fb0 2026-02-20T03:26:24.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.083+0000 7fafb2575640 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5631f8553fb0 0x5631f8556470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:24.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.111+0000 7fafb2575640 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5631f8553fb0 0x5631f8556470 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b565c98985b7a1c server_cookie=587a9e61d27f4faf in_seq=0 out_seq=0 2026-02-20T03:26:24.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.111+0000 7faf63fff640 10 client.18600 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:24.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7faf63fff640 1 -- 10.20.193.28:0/1262810743 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5631f83e3810 con 0x5631f8553fb0 2026-02-20T03:26:24.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7faf63fff640 10 client.18600 handle_command_reply: tid=0 2026-02-20T03:26:24.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 client.18600 shutdown 2026-02-20T03:26:24.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/1262810743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 msgr2=0x5631f84de770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:24.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84de770 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fafa4004560 tx=0x7fafa4009c40 comp rx=0 tx=0).stop 2026-02-20T03:26:24.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/1262810743 shutdown_connections 2026-02-20T03:26:24.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5631f8553fb0 0x5631f8556470 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631f84c5000 0x5631f84de770 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631f84bffb0 0x5631f84e07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 --2- 10.20.193.28:0/1262810743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631f84bf630 0x5631f84e02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/1262810743 >> 10.20.193.28:0/1262810743 conn(0x5631f8482290 msgr2=0x5631f84d7730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:24.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7faf63fff640 0 client.18600 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:24.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/1262810743 shutdown_connections 2026-02-20T03:26:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 1 -- 10.20.193.28:0/1262810743 wait complete. 2026-02-20T03:26:24.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafbb0a9e00 20 client.18600 trim_cache size 0 max 16384 2026-02-20T03:26:24.141 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:26:24.141 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:26:24.142 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:26:24.142 INFO:teuthology.orchestra.run.trial028.stdout: "daec2d1f-1305-43bc-8289-ef495c5b0077": { 2026-02-20T03:26:24.142 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:26:24.142 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "daec2d1f-1305-43bc-8289-ef495c5b0077", 2026-02-20T03:26:24.142 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:26:24.142 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:24.142 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:24.142 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:26:24.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 -- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf8c0b0da0 msgr2=0x7faf8c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:24.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf8c0b0da0 0x7faf8c0b3260 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fafa4004530 tx=0x7fafa4004590 comp rx=0 tx=0).stop 2026-02-20T03:26:24.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 -- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb4109220 msgr2=0x7fafb40837d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:24.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb4109220 0x7fafb40837d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fafa802f770 tx=0x7fafa8002910 comp rx=0 tx=0).stop 2026-02-20T03:26:24.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 -- 10.20.193.28:0/118715837 shutdown_connections 2026-02-20T03:26:24.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf8c0b0da0 0x7faf8c0b3260 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafb410eef0 0x7fafb407c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafb4109ba0 0x7fafb4083d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 --2- 10.20.193.28:0/118715837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafb4109220 0x7fafb40837d0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:24.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 -- 10.20.193.28:0/118715837 >> 10.20.193.28:0/118715837 conn(0x7fafb4078600 msgr2=0x7fafb4079ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:24.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 -- 10.20.193.28:0/118715837 shutdown_connections 2026-02-20T03:26:24.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:24.125+0000 7fafb3577640 1 -- 10.20.193.28:0/118715837 wait complete. 2026-02-20T03:26:24.271 INFO:tasks.cephfs.filesystem:scrub status for tag:daec2d1f-1305-43bc-8289-ef495c5b0077 - {'path': '/', 'tag': 'daec2d1f-1305-43bc-8289-ef495c5b0077', 'options': 'recursive,force'} 2026-02-20T03:26:24.525 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.31 MB/sec execute 477 sec latency 5145.605 ms 2026-02-20T03:26:24.635 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:24 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:26:24.635 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:24 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.635 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:24 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:26:24.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:24 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:26:24.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:24 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:26:24.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:24 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:24 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.636 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:24 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:24 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:26:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:24 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:24 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:26:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:24 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:26:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:24 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:26:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:24 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:24 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:24 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:24 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:26:24.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:24 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:24 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:26:24.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:24 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:26:24.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:24 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:26:24.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:24 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:24 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:24.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:24 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:25.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.323+0000 7f1241964640 1 -- 10.20.193.28:0/2016942917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c1026b0 msgr2=0x7f123c102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:25.326 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.323+0000 7f1241964640 1 --2- 10.20.193.28:0/2016942917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c1026b0 0x7f123c102ab0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f122c009a30 tx=0x7f122c02f260 comp rx=0 tx=0).stop 2026-02-20T03:26:25.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.323+0000 7f1241964640 1 -- 10.20.193.28:0/2016942917 shutdown_connections 2026-02-20T03:26:25.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.323+0000 7f1241964640 1 --2- 10.20.193.28:0/2016942917 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f123c104260 0x7f123c10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.323+0000 7f1241964640 1 --2- 10.20.193.28:0/2016942917 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123c1038a0 0x7f123c103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.327 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.323+0000 7f1241964640 1 --2- 10.20.193.28:0/2016942917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c1026b0 0x7f123c102ab0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.323+0000 7f1241964640 1 -- 10.20.193.28:0/2016942917 >> 10.20.193.28:0/2016942917 conn(0x7f123c0fde10 msgr2=0x7f123c100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:25.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.323+0000 7f1241964640 1 -- 10.20.193.28:0/2016942917 shutdown_connections 2026-02-20T03:26:25.328 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.323+0000 7f1241964640 1 -- 10.20.193.28:0/2016942917 wait complete. 2026-02-20T03:26:25.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 Processor -- start 2026-02-20T03:26:25.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 -- start start 2026-02-20T03:26:25.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123c1026b0 0x7f123c19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f123c1038a0 0x7f123c19d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c104260 0x7f123c1a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f123c10e2c0 con 0x7f123c104260 2026-02-20T03:26:25.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f123c10e140 con 0x7f123c1038a0 2026-02-20T03:26:25.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f123c10e440 con 0x7f123c1026b0 2026-02-20T03:26:25.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241163640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c104260 0x7f123c1a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241163640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c104260 0x7f123c1a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51868/0 (socket says 10.20.193.28:51868) 2026-02-20T03:26:25.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241163640 1 -- 10.20.193.28:0/2346602495 learned_addr learned my addr 10.20.193.28:0/2346602495 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:25.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241163640 1 -- 10.20.193.28:0/2346602495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123c1026b0 msgr2=0x7f123c19cb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:25.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241163640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123c1026b0 0x7f123c19cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241163640 1 -- 10.20.193.28:0/2346602495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f123c1038a0 msgr2=0x7f123c19d0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241163640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f123c1038a0 0x7f123c19d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241163640 1 -- 10.20.193.28:0/2346602495 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c1a4840 con 0x7f123c104260 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241163640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c104260 0x7f123c1a4140 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f123800b990 tx=0x7f123800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1231ffb640 1 -- 10.20.193.28:0/2346602495 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238006e60 con 0x7f123c104260 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1231ffb640 1 -- 10.20.193.28:0/2346602495 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1238010070 con 0x7f123c104260 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1231ffb640 1 -- 10.20.193.28:0/2346602495 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238004800 con 0x7f123c104260 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 -- 10.20.193.28:0/2346602495 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123c1a4b30 con 0x7f123c104260 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1241964640 1 -- 10.20.193.28:0/2346602495 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123c1a50b0 con 0x7f123c104260 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.324+0000 7f1231ffb640 1 -- 10.20.193.28:0/2346602495 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f123801d030 con 0x7f123c104260 2026-02-20T03:26:25.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1231ffb640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12180b0e20 0x7f12180b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1231ffb640 1 -- 10.20.193.28:0/2346602495 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f12380dfff0 con 0x7f123c104260 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 Processor -- start 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1240962640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12180b0e20 0x7f12180b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- start start 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74d4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74db9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1241163640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74db9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1241163640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74db9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51876/0 (socket says 10.20.193.28:51876) 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1241163640 1 -- 10.20.193.28:0/3270571954 learned_addr learned my addr 10.20.193.28:0/3270571954 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:25.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- 10.20.193.28:0/3270571954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0c74248f0 con 0x55c0c74d9560 2026-02-20T03:26:25.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- 10.20.193.28:0/3270571954 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c0c73d22e0 con 0x55c0c74d47c0 2026-02-20T03:26:25.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- 10.20.193.28:0/3270571954 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c0c7420820 con 0x55c0c74d3e80 2026-02-20T03:26:25.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1241163640 1 -- 10.20.193.28:0/3270571954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 msgr2=0x55c0c74d4280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:25.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1241163640 1 --2- 10.20.193.28:0/3270571954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74d4280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1241163640 1 -- 10.20.193.28:0/3270571954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 msgr2=0x55c0c74d8f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1241163640 1 --2- 10.20.193.28:0/3270571954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74d8f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1241163640 1 -- 10.20.193.28:0/3270571954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c73c45a0 con 0x55c0c74d9560 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1240962640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12180b0e20 0x7f12180b32e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f122c002b60 tx=0x7f122c0023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1241163640 1 --2- 10.20.193.28:0/3270571954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74db9f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f12380a3b00 tx=0x7f12380a74d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd6003b61fc4d05 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1208ffe640 1 -- 10.20.193.28:0/3270571954 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123801c2f0 con 0x55c0c74d9560 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1208ffe640 1 -- 10.20.193.28:0/3270571954 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f12380a83d0 con 0x55c0c74d9560 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1208ffe640 1 -- 10.20.193.28:0/3270571954 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12380dddf0 con 0x55c0c74d9560 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- 10.20.193.28:0/3270571954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 msgr2=0x55c0c74db9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- 10.20.193.28:0/3270571954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74db9f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f12380a3b00 tx=0x7f12380a74d0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- 10.20.193.28:0/3270571954 shutdown_connections 2026-02-20T03:26:25.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- 10.20.193.28:0/3270571954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74db9f0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- 10.20.193.28:0/3270571954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74d8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- 10.20.193.28:0/3270571954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74d4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- 10.20.193.28:0/3270571954 >> 10.20.193.28:0/3270571954 conn(0x55c0c74cb6f0 msgr2=0x55c0c74d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- 10.20.193.28:0/3270571954 shutdown_connections 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- 10.20.193.28:0/3270571954 wait complete. 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- start start 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 Processor -- start 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74eca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c0c73cc0c0 con 0x55c0c74d9560 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c0c74dc610 con 0x55c0c74d47c0 2026-02-20T03:26:25.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.329+0000 7f1245a4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c0c7505890 con 0x55c0c74d3e80 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1241163640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1241163640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51886/0 (socket says 10.20.193.28:51886) 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1241163640 1 -- 10.20.193.28:0/1091257066 learned_addr learned my addr 10.20.193.28:0/1091257066 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1241163640 1 -- 10.20.193.28:0/1091257066 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 msgr2=0x55c0c74eca30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1241163640 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74eca30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1241163640 1 -- 10.20.193.28:0/1091257066 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 msgr2=0x55c0c74ecf70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1241163640 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74ecf70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1241163640 1 -- 10.20.193.28:0/1091257066 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c74e6180 con 0x55c0c74d9560 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1241163640 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f3ef0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f123800bfd0 tx=0x7f123801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0668993760e07dd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1201ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:25.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1201ffb640 1 -- 10.20.193.28:0/1091257066 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12380b0f30 con 0x55c0c74d9560 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1201ffb640 1 -- 10.20.193.28:0/1091257066 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f12380ac080 con 0x55c0c74d9560 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1201ffb640 1 -- 10.20.193.28:0/1091257066 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12380a3650 con 0x55c0c74d9560 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1245a4be00 1 -- 10.20.193.28:0/1091257066 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c73e0820 con 0x55c0c74d9560 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1201ffb640 1 -- 10.20.193.28:0/1091257066 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f12380a6750 con 0x55c0c74d9560 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.334+0000 7f1201ffb640 10 client.18612 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 10 client.18612 _ll_register_callbacks cb 0x55c0c73cfff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 1 -- 10.20.193.28:0/1091257066 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c0c742c4e0 con 0x55c0c74d9560 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1201ffb640 1 -- 10.20.193.28:0/1091257066 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f12380c1060 con 0x55c0c74d9560 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 10 client.18612 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 1 -- 10.20.193.28:0/1091257066 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c0c73e5380 con 0x55c0c74d9560 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1201ffb640 1 -- 10.20.193.28:0/1091257066 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f12380a6950 con 0x55c0c74d9560 2026-02-20T03:26:25.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 10 client.18612 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:25.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 10 client.18612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:25.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 20 client.18612 populate_metadata read hostname 'trial028' 2026-02-20T03:26:25.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c0c75095b0 0x55c0c750ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 4 client.18612 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:25.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.335+0000 7f1245a4be00 1 -- 10.20.193.28:0/1091257066 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0c73a6bd0 con 0x55c0c75095b0 2026-02-20T03:26:25.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.362+0000 7f1240962640 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c0c75095b0 0x55c0c750ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.389+0000 7f1240962640 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c0c75095b0 0x55c0c750ba40 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87f9bafc18e157dd server_cookie=1eb26057a6dd4294 in_seq=0 out_seq=0 2026-02-20T03:26:25.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.389+0000 7f1201ffb640 10 client.18612 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:25.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1201ffb640 1 -- 10.20.193.28:0/1091257066 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c0c73a6bd0 con 0x55c0c75095b0 2026-02-20T03:26:25.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1201ffb640 10 client.18612 handle_command_reply: tid=0 2026-02-20T03:26:25.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 client.18612 shutdown 2026-02-20T03:26:25.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 -- 10.20.193.28:0/1091257066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 msgr2=0x55c0c74f3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:25.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f3ef0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f123800bfd0 tx=0x7f123801c460 comp rx=0 tx=0).stop 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 -- 10.20.193.28:0/1091257066 shutdown_connections 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c0c75095b0 0x55c0c750ba40 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f3ef0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74ecf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1091257066 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74eca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 -- 10.20.193.28:0/1091257066 >> 10.20.193.28:0/1091257066 conn(0x55c0c74cb6f0 msgr2=0x55c0c74da8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1201ffb640 0 client.18612 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 -- 10.20.193.28:0/1091257066 shutdown_connections 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 1 -- 10.20.193.28:0/1091257066 wait complete. 2026-02-20T03:26:25.395 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.391+0000 7f1245a4be00 20 client.18612 trim_cache size 0 max 16384 2026-02-20T03:26:25.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.399+0000 7f1245a4be00 1 Processor -- start 2026-02-20T03:26:25.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.399+0000 7f1245a4be00 1 -- start start 2026-02-20T03:26:25.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.399+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d3e80 0x55c0c74da950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.399+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.399+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d9560 0x55c0c74ea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.399+0000 7f1245a4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11e0012770 con 0x55c0c74d3e80 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.399+0000 7f1245a4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11e0010040 con 0x55c0c74d47c0 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.399+0000 7f1245a4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11e000de90 con 0x55c0c74d9560 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1240962640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d3e80 0x55c0c74da950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1233fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1240962640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d3e80 0x55c0c74da950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51898/0 (socket says 10.20.193.28:51898) 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1240962640 1 -- 10.20.193.28:0/3620057594 learned_addr learned my addr 10.20.193.28:0/3620057594 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1241163640 1 --2- 10.20.193.28:0/3620057594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d9560 0x55c0c74ea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1240962640 1 -- 10.20.193.28:0/3620057594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d9560 msgr2=0x55c0c74ea1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:25.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1240962640 1 --2- 10.20.193.28:0/3620057594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d9560 0x55c0c74ea1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1240962640 1 -- 10.20.193.28:0/3620057594 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 msgr2=0x55c0c74f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1240962640 1 --2- 10.20.193.28:0/3620057594 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1240962640 1 -- 10.20.193.28:0/3620057594 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c74e5fb0 con 0x55c0c74d3e80 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1240962640 1 --2- 10.20.193.28:0/3620057594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d3e80 0x55c0c74da950 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f122c002fd0 tx=0x7f122c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161a93a1fd3aeb27 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1203fff640 1 -- 10.20.193.28:0/3620057594 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c052030 con 0x55c0c74d3e80 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1203fff640 1 -- 10.20.193.28:0/3620057594 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f122c033040 con 0x55c0c74d3e80 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1203fff640 1 -- 10.20.193.28:0/3620057594 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c038a20 con 0x55c0c74d3e80 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1245a4be00 1 -- 10.20.193.28:0/3620057594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d3e80 msgr2=0x55c0c74da950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.400+0000 7f1245a4be00 1 --2- 10.20.193.28:0/3620057594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d3e80 0x55c0c74da950 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f122c002fd0 tx=0x7f122c040000 comp rx=0 tx=0).stop 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.401+0000 7f1245a4be00 1 -- 10.20.193.28:0/3620057594 shutdown_connections 2026-02-20T03:26:25.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.401+0000 7f1245a4be00 1 --2- 10.20.193.28:0/3620057594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d9560 0x55c0c74ea1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.401+0000 7f1245a4be00 1 --2- 10.20.193.28:0/3620057594 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.401+0000 7f1245a4be00 1 --2- 10.20.193.28:0/3620057594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d3e80 0x55c0c74da950 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.401+0000 7f1245a4be00 1 -- 10.20.193.28:0/3620057594 >> 10.20.193.28:0/3620057594 conn(0x55c0c74cb6f0 msgr2=0x55c0c74e9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:25.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.401+0000 7f1245a4be00 1 -- 10.20.193.28:0/3620057594 shutdown_connections 2026-02-20T03:26:25.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.401+0000 7f1245a4be00 1 -- 10.20.193.28:0/3620057594 wait complete. 2026-02-20T03:26:25.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.401+0000 7f1245a4be00 1 -- start start 2026-02-20T03:26:25.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.401+0000 7f1245a4be00 1 Processor -- start 2026-02-20T03:26:25.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1245a4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1245a4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11e000e500 con 0x55c0c74d9560 2026-02-20T03:26:25.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1245a4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11e000f970 con 0x55c0c74d47c0 2026-02-20T03:26:25.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1245a4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11e000ebd0 con 0x55c0c74d3e80 2026-02-20T03:26:25.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1240962640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1233fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1240962640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74f19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47980/0 (socket says 10.20.193.28:47980) 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1240962640 1 -- 10.20.193.28:0/1265429724 learned_addr learned my addr 10.20.193.28:0/1265429724 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1241163640 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1233fff640 1 -- 10.20.193.28:0/1265429724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 msgr2=0x55c0c74f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1233fff640 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1233fff640 1 -- 10.20.193.28:0/1265429724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 msgr2=0x55c0c74f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1233fff640 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1233fff640 1 -- 10.20.193.28:0/1265429724 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c7184690 con 0x55c0c74d47c0 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1241163640 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1233fff640 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74f1f00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55c0c74ed920 tx=0x7f1224009640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59d07c2a25cf0683 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:25.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1201ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1201ffb640 1 -- 10.20.193.28:0/1265429724 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224016020 con 0x55c0c74d47c0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1201ffb640 1 -- 10.20.193.28:0/1265429724 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1224012890 con 0x55c0c74d47c0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.402+0000 7f1245a4be00 1 -- 10.20.193.28:0/1265429724 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c73e9b70 con 0x55c0c74d47c0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1201ffb640 1 -- 10.20.193.28:0/1265429724 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224011750 con 0x55c0c74d47c0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 10 client.27551 _ll_register_callbacks cb 0x7f123801c2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 1 -- 10.20.193.28:0/1265429724 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12380a83d0 con 0x55c0c74d47c0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1201ffb640 1 -- 10.20.193.28:0/1265429724 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f12240118f0 con 0x55c0c74d47c0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1201ffb640 1 -- 10.20.193.28:0/1265429724 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1224011bf0 con 0x55c0c74d47c0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 10 client.27551 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 1 -- 10.20.193.28:0/1265429724 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c0c74e6ca0 con 0x55c0c74d47c0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1201ffb640 1 -- 10.20.193.28:0/1265429724 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f12240123f0 con 0x55c0c74d47c0 2026-02-20T03:26:25.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 10 client.27551 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:25.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 10 client.27551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:25.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 20 client.27551 populate_metadata read hostname 'trial028' 2026-02-20T03:26:25.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c0c7574e90 0x55c0c7577320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:25.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 4 client.27551 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:26:25.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1245a4be00 1 -- 10.20.193.28:0/1265429724 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c0c73f56b0 con 0x55c0c7574e90 2026-02-20T03:26:25.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.403+0000 7f1240962640 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c0c7574e90 0x55c0c7577320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:25.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.404+0000 7f1240962640 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c0c7574e90 0x55c0c7577320 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e721b73f1087f46e server_cookie=846475bc2d4b8fb0 in_seq=0 out_seq=0 2026-02-20T03:26:25.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.404+0000 7f1201ffb640 10 client.27551 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:25.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1201ffb640 1 -- 10.20.193.28:0/1265429724 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c0c73f56b0 con 0x55c0c7574e90 2026-02-20T03:26:25.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1201ffb640 10 client.27551 handle_command_reply: tid=0 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 client.27551 shutdown 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 -- 10.20.193.28:0/1265429724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 msgr2=0x55c0c74f1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74f1f00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55c0c74ed920 tx=0x7f1224009640 comp rx=0 tx=0).stop 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 -- 10.20.193.28:0/1265429724 shutdown_connections 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c0c7574e90 0x55c0c7577320 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c0c74d9560 0x55c0c74f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c0c74d47c0 0x55c0c74f1f00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 --2- 10.20.193.28:0/1265429724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c0c74d3e80 0x55c0c74f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 -- 10.20.193.28:0/1265429724 >> 10.20.193.28:0/1265429724 conn(0x55c0c74cb6f0 msgr2=0x55c0c74ea1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1201ffb640 0 client.27551 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:25.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 -- 10.20.193.28:0/1265429724 shutdown_connections 2026-02-20T03:26:25.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 1 -- 10.20.193.28:0/1265429724 wait complete. 2026-02-20T03:26:25.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.450+0000 7f1245a4be00 20 client.27551 trim_cache size 0 max 16384 2026-02-20T03:26:25.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:26:25.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:26:25.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:26:25.455 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:26:25.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 -- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12180b0e20 msgr2=0x7f12180b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:25.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12180b0e20 0x7f12180b32e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f122c002b60 tx=0x7f122c0023d0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 -- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c104260 msgr2=0x7f123c1a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:25.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c104260 0x7f123c1a4140 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f123800b990 tx=0x7f123800be60 comp rx=0 tx=0).stop 2026-02-20T03:26:25.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 -- 10.20.193.28:0/2346602495 shutdown_connections 2026-02-20T03:26:25.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12180b0e20 0x7f12180b32e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f123c104260 0x7f123c1a4140 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f123c1038a0 0x7f123c19d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 --2- 10.20.193.28:0/2346602495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f123c1026b0 0x7f123c19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:25.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 -- 10.20.193.28:0/2346602495 >> 10.20.193.28:0/2346602495 conn(0x7f123c0fde10 msgr2=0x7f123c1091c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:25.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 -- 10.20.193.28:0/2346602495 shutdown_connections 2026-02-20T03:26:25.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:25.451+0000 7f1241964640 1 -- 10.20.193.28:0/2346602495 wait complete. 2026-02-20T03:26:25.525 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.29 MB/sec execute 478 sec latency 6145.649 ms 2026-02-20T03:26:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:25 trial028 ceph-mon[38552]: pgmap v534: 129 pgs: 129 active+clean; 179 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 768 KiB/s rd, 2.7 MiB/s wr, 343 op/s 2026-02-20T03:26:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:25 trial177 ceph-mon[43181]: pgmap v534: 129 pgs: 129 active+clean; 179 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 768 KiB/s rd, 2.7 MiB/s wr, 343 op/s 2026-02-20T03:26:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:25 trial126 ceph-mon[38476]: pgmap v534: 129 pgs: 129 active+clean; 179 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 768 KiB/s rd, 2.7 MiB/s wr, 343 op/s 2026-02-20T03:26:26.525 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.27 MB/sec execute 479 sec latency 7145.699 ms 2026-02-20T03:26:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:26 trial177 ceph-mon[43181]: pgmap v535: 129 pgs: 129 active+clean; 177 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 503 KiB/s rd, 2.7 MiB/s wr, 276 op/s 2026-02-20T03:26:26.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:26 trial126 ceph-mon[38476]: pgmap v535: 129 pgs: 129 active+clean; 177 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 503 KiB/s rd, 2.7 MiB/s wr, 276 op/s 2026-02-20T03:26:26.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:26 trial028 ceph-mon[38552]: pgmap v535: 129 pgs: 129 active+clean; 177 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 503 KiB/s rd, 2.7 MiB/s wr, 276 op/s 2026-02-20T03:26:27.525 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.25 MB/sec execute 480 sec latency 8145.754 ms 2026-02-20T03:26:28.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.24 MB/sec execute 481 sec latency 9145.799 ms 2026-02-20T03:26:29.261 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:29 trial028 ceph-mon[38552]: pgmap v536: 129 pgs: 129 active+clean; 174 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 450 KiB/s rd, 2.4 MiB/s wr, 224 op/s 2026-02-20T03:26:29.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.22 MB/sec execute 482 sec latency 10145.858 ms 2026-02-20T03:26:29.548 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:29 trial126 ceph-mon[38476]: pgmap v536: 129 pgs: 129 active+clean; 174 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 450 KiB/s rd, 2.4 MiB/s wr, 224 op/s 2026-02-20T03:26:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:29 trial177 ceph-mon[43181]: pgmap v536: 129 pgs: 129 active+clean; 174 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 450 KiB/s rd, 2.4 MiB/s wr, 224 op/s 2026-02-20T03:26:30.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.20 MB/sec execute 483 sec latency 11145.896 ms 2026-02-20T03:26:31.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.19 MB/sec execute 484 sec latency 12145.943 ms 2026-02-20T03:26:31.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:31 trial126 ceph-mon[38476]: pgmap v537: 129 pgs: 129 active+clean; 180 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 201 KiB/s rd, 2.8 MiB/s wr, 175 op/s 2026-02-20T03:26:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:31 trial028 ceph-mon[38552]: pgmap v537: 129 pgs: 129 active+clean; 180 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 201 KiB/s rd, 2.8 MiB/s wr, 175 op/s 2026-02-20T03:26:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:31 trial177 ceph-mon[43181]: pgmap v537: 129 pgs: 129 active+clean; 180 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 201 KiB/s rd, 2.8 MiB/s wr, 175 op/s 2026-02-20T03:26:32.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.17 MB/sec execute 485 sec latency 13145.979 ms 2026-02-20T03:26:33.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:33 trial028 ceph-mon[38552]: pgmap v538: 129 pgs: 129 active+clean; 180 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 147 KiB/s rd, 2.3 MiB/s wr, 135 op/s 2026-02-20T03:26:33.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:26:33.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:26:33.337 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:26:33.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.15 MB/sec execute 486 sec latency 14146.019 ms 2026-02-20T03:26:33.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:33 trial126 ceph-mon[38476]: pgmap v538: 129 pgs: 129 active+clean; 180 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 147 KiB/s rd, 2.3 MiB/s wr, 135 op/s 2026-02-20T03:26:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:26:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:26:33.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:26:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:33 trial177 ceph-mon[43181]: pgmap v538: 129 pgs: 129 active+clean; 180 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 147 KiB/s rd, 2.3 MiB/s wr, 135 op/s 2026-02-20T03:26:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:26:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:26:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:26:34.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.14 MB/sec execute 487 sec latency 15146.054 ms 2026-02-20T03:26:35.276 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:35 trial028 ceph-mon[38552]: pgmap v539: 129 pgs: 129 active+clean; 178 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 132 KiB/s rd, 2.2 MiB/s wr, 134 op/s 2026-02-20T03:26:35.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.12 MB/sec execute 488 sec latency 16146.099 ms 2026-02-20T03:26:35.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:35 trial126 ceph-mon[38476]: pgmap v539: 129 pgs: 129 active+clean; 178 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 132 KiB/s rd, 2.2 MiB/s wr, 134 op/s 2026-02-20T03:26:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:35 trial177 ceph-mon[43181]: pgmap v539: 129 pgs: 129 active+clean; 178 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 132 KiB/s rd, 2.2 MiB/s wr, 134 op/s 2026-02-20T03:26:36.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.10 MB/sec execute 489 sec latency 17146.150 ms 2026-02-20T03:26:37.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.09 MB/sec execute 490 sec latency 18146.202 ms 2026-02-20T03:26:37.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:37 trial126 ceph-mon[38476]: pgmap v540: 129 pgs: 129 active+clean; 180 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 98 KiB/s rd, 2.7 MiB/s wr, 140 op/s 2026-02-20T03:26:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:37 trial028 ceph-mon[38552]: pgmap v540: 129 pgs: 129 active+clean; 180 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 98 KiB/s rd, 2.7 MiB/s wr, 140 op/s 2026-02-20T03:26:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:37 trial177 ceph-mon[43181]: pgmap v540: 129 pgs: 129 active+clean; 180 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 98 KiB/s rd, 2.7 MiB/s wr, 140 op/s 2026-02-20T03:26:38.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.07 MB/sec execute 491 sec latency 19146.236 ms 2026-02-20T03:26:38.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.529+0000 7fd7eeb41640 1 -- 10.20.193.28:0/1115234424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7e81038a0 msgr2=0x7fd7e8103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:38.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.529+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/1115234424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7e81038a0 0x7fd7e8103d20 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009a30 tx=0x7fd7dc02f220 comp rx=0 tx=0).stop 2026-02-20T03:26:38.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.529+0000 7fd7eeb41640 1 -- 10.20.193.28:0/1115234424 shutdown_connections 2026-02-20T03:26:38.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.529+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/1115234424 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd7e8104260 0x7fd7e810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.529+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/1115234424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7e81038a0 0x7fd7e8103d20 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.529+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/1115234424 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7e81026b0 0x7fd7e8102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.529+0000 7fd7eeb41640 1 -- 10.20.193.28:0/1115234424 >> 10.20.193.28:0/1115234424 conn(0x7fd7e80fde10 msgr2=0x7fd7e8100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:38.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.529+0000 7fd7eeb41640 1 -- 10.20.193.28:0/1115234424 shutdown_connections 2026-02-20T03:26:38.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.529+0000 7fd7eeb41640 1 -- 10.20.193.28:0/1115234424 wait complete. 2026-02-20T03:26:38.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7eeb41640 1 Processor -- start 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7eeb41640 1 -- start start 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7eeb41640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd7e81026b0 0x7fd7e819ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7eeb41640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7e81038a0 0x7fd7e819cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7eeb41640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7e8104260 0x7fd7e81a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7eeb41640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e810e1a0 con 0x7fd7e8104260 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7eeb41640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e810e020 con 0x7fd7e81038a0 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7eeb41640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e810e320 con 0x7fd7e81026b0 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7edb3f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd7e81026b0 0x7fd7e819ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7ee340640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7e8104260 0x7fd7e81a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7edb3f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd7e81026b0 0x7fd7e819ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47198/0 (socket says 10.20.193.28:47198) 2026-02-20T03:26:38.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7edb3f640 1 -- 10.20.193.28:0/3154791779 learned_addr learned my addr 10.20.193.28:0/3154791779 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:38.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7ed33e640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7e81038a0 0x7fd7e819cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7edb3f640 1 -- 10.20.193.28:0/3154791779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7e81038a0 msgr2=0x7fd7e819cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:38.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7e81038a0 0x7fd7e819cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7edb3f640 1 -- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7e8104260 msgr2=0x7fd7e81a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:38.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7e8104260 0x7fd7e81a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.530+0000 7fd7edb3f640 1 -- 10.20.193.28:0/3154791779 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e81a4730 con 0x7fd7e81026b0 2026-02-20T03:26:38.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.531+0000 7fd7ee340640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7e8104260 0x7fd7e81a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:38.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.531+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd7e81026b0 0x7fd7e819ca80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800e9e0 tx=0x7fd7d800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:38.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.531+0000 7fd7d6ffd640 1 -- 10.20.193.28:0/3154791779 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800cde0 con 0x7fd7e81026b0 2026-02-20T03:26:38.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.531+0000 7fd7d6ffd640 1 -- 10.20.193.28:0/3154791779 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd7d8004570 con 0x7fd7e81026b0 2026-02-20T03:26:38.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.531+0000 7fd7d6ffd640 1 -- 10.20.193.28:0/3154791779 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8010690 con 0x7fd7e81026b0 2026-02-20T03:26:38.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.531+0000 7fd7eeb41640 1 -- 10.20.193.28:0/3154791779 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e81a4a20 con 0x7fd7e81026b0 2026-02-20T03:26:38.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.531+0000 7fd7eeb41640 1 -- 10.20.193.28:0/3154791779 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e81a4ef0 con 0x7fd7e81026b0 2026-02-20T03:26:38.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.533+0000 7fd7d6ffd640 1 -- 10.20.193.28:0/3154791779 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd7d80040d0 con 0x7fd7e81026b0 2026-02-20T03:26:38.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.534+0000 7fd7f2c28e00 1 Processor -- start 2026-02-20T03:26:38.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.534+0000 7fd7f2c28e00 1 -- start start 2026-02-20T03:26:38.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.534+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80a5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.534+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.534+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80aa560 0x5564b80ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.534+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5564b7ff58f0 con 0x5564b80a57c0 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.534+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5564b7fa32e0 con 0x5564b80aa560 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.534+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5564b7ff1820 con 0x5564b80a4e80 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7edb3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7ee340640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7ee340640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80a5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47212/0 (socket says 10.20.193.28:47212) 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7ee340640 1 -- 10.20.193.28:0/3832749124 learned_addr learned my addr 10.20.193.28:0/3832749124 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7edb3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80a9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34992/0 (socket says 10.20.193.28:34992) 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7ed33e640 1 --2- 10.20.193.28:0/3832749124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80aa560 0x5564b80ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7edb3f640 1 -- 10.20.193.28:0/3832749124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 msgr2=0x5564b80a5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/3832749124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80a5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7edb3f640 1 -- 10.20.193.28:0/3832749124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80aa560 msgr2=0x5564b80ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/3832749124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80aa560 0x5564b80ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7edb3f640 1 -- 10.20.193.28:0/3832749124 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b7f955a0 con 0x5564b80a57c0 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7d6ffd640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7c40b0da0 0x7fd7c40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/3832749124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80a9f40 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80de5f0 tx=0x7fd7d80e9230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf071477d78a311 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7d6ffd640 1 -- 10.20.193.28:0/3154791779 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd7d80e0fe0 con 0x7fd7e81026b0 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7b5bfe640 1 -- 10.20.193.28:0/3832749124 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80a4930 con 0x5564b80a57c0 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7ee340640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7c40b0da0 0x7fd7c40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7b5bfe640 1 -- 10.20.193.28:0/3832749124 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd7d80a93c0 con 0x5564b80a57c0 2026-02-20T03:26:38.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7b5bfe640 1 -- 10.20.193.28:0/3832749124 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80a81e0 con 0x5564b80a57c0 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/3832749124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 msgr2=0x5564b80a9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.535+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/3832749124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80a9f40 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd7d80de5f0 tx=0x7fd7d80e9230 comp rx=0 tx=0).stop 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.536+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/3832749124 shutdown_connections 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.536+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/3832749124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80aa560 0x5564b80ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.536+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/3832749124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80a9f40 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.536+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/3832749124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80a5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.536+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/3832749124 >> 10.20.193.28:0/3832749124 conn(0x5564b809c6f0 msgr2=0x5564b80a3570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.536+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/3832749124 shutdown_connections 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.536+0000 7fd7ee340640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7c40b0da0 0x7fd7c40b3260 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009550 tx=0x7fd7e400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.536+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/3832749124 wait complete. 2026-02-20T03:26:38.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.537+0000 7fd7f2c28e00 1 -- start start 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.537+0000 7fd7f2c28e00 1 Processor -- start 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.537+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a4e80 0x5564b80c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.537+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 0x5564b80c6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.537+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.537+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5564b7f9d0c0 con 0x5564b80a4e80 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.537+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5564b80ad610 con 0x5564b80a57c0 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.537+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5564b80cde50 con 0x5564b80aa560 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7edb3f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a4e80 0x5564b80c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ee340640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ee340640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47214/0 (socket says 10.20.193.28:47214) 2026-02-20T03:26:38.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ee340640 1 -- 10.20.193.28:0/1000588646 learned_addr learned my addr 10.20.193.28:0/1000588646 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ed33e640 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 0x5564b80c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ee340640 1 -- 10.20.193.28:0/1000588646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 msgr2=0x5564b80c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ee340640 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 0x5564b80c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ee340640 1 -- 10.20.193.28:0/1000588646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a4e80 msgr2=0x5564b80c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ee340640 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a4e80 0x5564b80c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ee340640 1 -- 10.20.193.28:0/1000588646 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b80bfb40 con 0x5564b80aa560 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a4e80 0x5564b80c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7ee340640 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80cd8c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4016400 tx=0x7fd7e4004bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b29b22cc03a9375d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7a2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/1000588646 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4026070 con 0x5564b80aa560 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.538+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/1000588646 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd7e4022cd0 con 0x5564b80aa560 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/1000588646 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4020d90 con 0x5564b80aa560 2026-02-20T03:26:38.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/1000588646 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b7fb1820 con 0x5564b80aa560 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 10 client.27574 _ll_register_callbacks cb 0x5564b7fa0ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/1000588646 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564b7ffd4e0 con 0x5564b80aa560 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/1000588646 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd7e4020440 con 0x5564b80aa560 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/1000588646 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd7e4022830 con 0x5564b80aa560 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 10 client.27574 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/1000588646 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5564b7fb6380 con 0x5564b80aa560 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/1000588646 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd7e402a410 con 0x5564b80aa560 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 10 client.27574 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 10 client.27574 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 20 client.27574 populate_metadata read hostname 'trial028' 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564b80d21a0 0x5564b80d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 4 client.27574 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.539+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/1000588646 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564b7f77bd0 con 0x5564b80d21a0 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.540+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564b80d21a0 0x5564b80d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.540+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564b80d21a0 0x5564b80d4660 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e9d0cb436e66abb server_cookie=98324c06bb73f6af in_seq=0 out_seq=0 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.540+0000 7fd7a2ffd640 10 client.27574 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.540+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/1000588646 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5564b7f77bd0 con 0x5564b80d21a0 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.540+0000 7fd7a2ffd640 10 client.27574 handle_command_reply: tid=0 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 client.27574 shutdown 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/1000588646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 msgr2=0x5564b80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80cd8c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4016400 tx=0x7fd7e4004bb0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/1000588646 shutdown_connections 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564b80d21a0 0x5564b80d4660 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.550 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80cd8c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 0x5564b80c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/1000588646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a4e80 0x5564b80c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/1000588646 >> 10.20.193.28:0/1000588646 conn(0x5564b809c6f0 msgr2=0x5564b80ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:38.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7a2ffd640 0 client.27574 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:38.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/1000588646 shutdown_connections 2026-02-20T03:26:38.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/1000588646 wait complete. 2026-02-20T03:26:38.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.541+0000 7fd7f2c28e00 20 client.27574 trim_cache size 0 max 16384 2026-02-20T03:26:38.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.548+0000 7fd7f2c28e00 1 Processor -- start 2026-02-20T03:26:38.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.548+0000 7fd7f2c28e00 1 -- start start 2026-02-20T03:26:38.555 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.548+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.548+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 0x5564b80cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.548+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80aa560 0x5564b80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.548+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd7940126f0 con 0x5564b80aa560 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.548+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd79400ffc0 con 0x5564b80a57c0 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.548+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd79400de10 con 0x5564b80a4e80 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7edb3f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7ee340640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80aa560 0x5564b80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7edb3f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47222/0 (socket says 10.20.193.28:47222) 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7edb3f640 1 -- 10.20.193.28:0/4152940250 learned_addr learned my addr 10.20.193.28:0/4152940250 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7ed33e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 0x5564b80cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7ee340640 1 -- 10.20.193.28:0/4152940250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 msgr2=0x5564b80c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7ee340640 1 --2- 10.20.193.28:0/4152940250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7ee340640 1 -- 10.20.193.28:0/4152940250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 msgr2=0x5564b80cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7ee340640 1 --2- 10.20.193.28:0/4152940250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 0x5564b80cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7ee340640 1 -- 10.20.193.28:0/4152940250 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b80bf970 con 0x5564b80aa560 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7ee340640 1 --2- 10.20.193.28:0/4152940250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80aa560 0x5564b80c49a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400e930 tx=0x7fd7e402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6775ad3f1fad0394 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7b53fd640 1 -- 10.20.193.28:0/4152940250 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4026040 con 0x5564b80aa560 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7b53fd640 1 -- 10.20.193.28:0/4152940250 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5564b7ffd4e0 con 0x5564b80aa560 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7b53fd640 1 -- 10.20.193.28:0/4152940250 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e403c700 con 0x5564b80aa560 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/4152940250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80aa560 msgr2=0x5564b80c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.549+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/4152940250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80aa560 0x5564b80c49a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400e930 tx=0x7fd7e402e000 comp rx=0 tx=0).stop 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.550+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/4152940250 shutdown_connections 2026-02-20T03:26:38.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.550+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/4152940250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80aa560 0x5564b80c49a0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.550+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/4152940250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a57c0 0x5564b80cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.550+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/4152940250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80a4e80 0x5564b80c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.550+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/4152940250 >> 10.20.193.28:0/4152940250 conn(0x5564b809c6f0 msgr2=0x5564b80c62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.550+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/4152940250 shutdown_connections 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.550+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/4152940250 wait complete. 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.550+0000 7fd7f2c28e00 1 -- start start 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.550+0000 7fd7f2c28e00 1 Processor -- start 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a4e80 0x5564b80c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7f2c28e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd79400e480 con 0x5564b80a57c0 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd79400f8f0 con 0x5564b80a4e80 2026-02-20T03:26:38.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7f2c28e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd79400eb50 con 0x5564b80aa560 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ed33e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7edb3f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a4e80 0x5564b80c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ed33e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35026/0 (socket says 10.20.193.28:35026) 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ed33e640 1 -- 10.20.193.28:0/2939335147 learned_addr learned my addr 10.20.193.28:0/2939335147 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ee340640 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ed33e640 1 -- 10.20.193.28:0/2939335147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 msgr2=0x5564b80ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ed33e640 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ed33e640 1 -- 10.20.193.28:0/2939335147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a4e80 msgr2=0x5564b80c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ed33e640 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a4e80 0x5564b80c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ed33e640 1 -- 10.20.193.28:0/2939335147 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b80ce970 con 0x5564b80a57c0 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a4e80 0x5564b80c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:38.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7ed33e640 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80c9f30 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc032040 tx=0x7fd7dc002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32aae8399a3d4464 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.551+0000 7fd7a2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/2939335147 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02fc90 con 0x5564b80a57c0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/2939335147 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd7dc033040 con 0x5564b80a57c0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/2939335147 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc004a20 con 0x5564b80a57c0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/2939335147 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b7d55690 con 0x5564b80a57c0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/2939335147 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd7dc004bc0 con 0x5564b80a57c0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 10 client.18636 _ll_register_callbacks cb 0x7fd7e400ed20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/2939335147 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564b7dce520 con 0x5564b80a57c0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/2939335147 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd7dc0056a0 con 0x5564b80a57c0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 10 client.18636 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/2939335147 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5564b7fbab70 con 0x5564b80a57c0 2026-02-20T03:26:38.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/2939335147 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd7dc004190 con 0x5564b80a57c0 2026-02-20T03:26:38.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 10 client.18636 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:38.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 10 client.18636 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:38.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 20 client.18636 populate_metadata read hostname 'trial028' 2026-02-20T03:26:38.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564b813de60 0x5564b8140320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:38.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 4 client.18636 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:26:38.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.552+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/2939335147 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564b8003290 con 0x5564b813de60 2026-02-20T03:26:38.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.553+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564b813de60 0x5564b8140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:38.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.553+0000 7fd7edb3f640 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564b813de60 0x5564b8140320 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b0a3c57edd8d39a server_cookie=12fb733ba8a716d2 in_seq=0 out_seq=0 2026-02-20T03:26:38.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.553+0000 7fd7a2ffd640 10 client.18636 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:38.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.567+0000 7fd7a2ffd640 1 -- 10.20.193.28:0/2939335147 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564b8003290 con 0x5564b813de60 2026-02-20T03:26:38.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.567+0000 7fd7a2ffd640 10 client.18636 handle_command_reply: tid=0 2026-02-20T03:26:38.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 client.18636 shutdown 2026-02-20T03:26:38.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/2939335147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 msgr2=0x5564b80c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:38.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80c9f30 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc032040 tx=0x7fd7dc002910 comp rx=0 tx=0).stop 2026-02-20T03:26:38.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/2939335147 shutdown_connections 2026-02-20T03:26:38.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564b813de60 0x5564b8140320 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564b80aa560 0x5564b80ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564b80a57c0 0x5564b80c9f30 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 --2- 10.20.193.28:0/2939335147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564b80a4e80 0x5564b80c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7a2ffd640 0 client.18636 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:38.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/2939335147 >> 10.20.193.28:0/2939335147 conn(0x5564b809c6f0 msgr2=0x5564b80aa940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:38.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/2939335147 shutdown_connections 2026-02-20T03:26:38.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 1 -- 10.20.193.28:0/2939335147 wait complete. 2026-02-20T03:26:38.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7f2c28e00 20 client.18636 trim_cache size 0 max 16384 2026-02-20T03:26:38.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:26:38.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:26:38.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:26:38.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7eeb41640 1 -- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7c40b0da0 msgr2=0x7fd7c40b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7c40b0da0 0x7fd7c40b3260 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009550 tx=0x7fd7e400b040 comp rx=0 tx=0).stop 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7eeb41640 1 -- 10.20.193.28:0/3154791779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd7e81026b0 msgr2=0x7fd7e819ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd7e81026b0 0x7fd7e819ca80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800e9e0 tx=0x7fd7d800eeb0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.568+0000 7fd7eeb41640 1 -- 10.20.193.28:0/3154791779 shutdown_connections 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.569+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd7c40b0da0 0x7fd7c40b3260 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.569+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd7e8104260 0x7fd7e81a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.569+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd7e81038a0 0x7fd7e819cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.569+0000 7fd7eeb41640 1 --2- 10.20.193.28:0/3154791779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd7e81026b0 0x7fd7e819ca80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.569+0000 7fd7eeb41640 1 -- 10.20.193.28:0/3154791779 >> 10.20.193.28:0/3154791779 conn(0x7fd7e80fde10 msgr2=0x7fd7e8109110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:38.573 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.569+0000 7fd7eeb41640 1 -- 10.20.193.28:0/3154791779 shutdown_connections 2026-02-20T03:26:38.574 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:38.569+0000 7fd7eeb41640 1 -- 10.20.193.28:0/3154791779 wait complete. 2026-02-20T03:26:39.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.05 MB/sec execute 492 sec latency 20146.290 ms 2026-02-20T03:26:39.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:39 trial126 ceph-mon[38476]: pgmap v541: 129 pgs: 129 active+clean; 179 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 135 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2026-02-20T03:26:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:39 trial028 ceph-mon[38552]: pgmap v541: 129 pgs: 129 active+clean; 179 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 135 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2026-02-20T03:26:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:39 trial177 ceph-mon[43181]: pgmap v541: 129 pgs: 129 active+clean; 179 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 135 KiB/s rd, 2.5 MiB/s wr, 137 op/s 2026-02-20T03:26:40.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.04 MB/sec execute 493 sec latency 21146.342 ms 2026-02-20T03:26:41.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:41 trial177 ceph-mon[43181]: pgmap v542: 129 pgs: 129 active+clean; 169 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 97 KiB/s rd, 2.1 MiB/s wr, 125 op/s 2026-02-20T03:26:41.468 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:41 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:26:41.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.02 MB/sec execute 494 sec latency 22146.379 ms 2026-02-20T03:26:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:41 trial126 ceph-mon[38476]: pgmap v542: 129 pgs: 129 active+clean; 169 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 97 KiB/s rd, 2.1 MiB/s wr, 125 op/s 2026-02-20T03:26:41.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:41 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:26:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:41 trial028 ceph-mon[38552]: pgmap v542: 129 pgs: 129 active+clean; 169 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 97 KiB/s rd, 2.1 MiB/s wr, 125 op/s 2026-02-20T03:26:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:41 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:26:42.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 8.00 MB/sec execute 495 sec latency 23146.414 ms 2026-02-20T03:26:42.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:42 trial126 ceph-mon[38476]: pgmap v543: 129 pgs: 129 active+clean; 168 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 91 KiB/s rd, 1.3 MiB/s wr, 90 op/s 2026-02-20T03:26:42.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:42 trial028 ceph-mon[38552]: pgmap v543: 129 pgs: 129 active+clean; 168 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 91 KiB/s rd, 1.3 MiB/s wr, 90 op/s 2026-02-20T03:26:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:42 trial177 ceph-mon[43181]: pgmap v543: 129 pgs: 129 active+clean; 168 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 91 KiB/s rd, 1.3 MiB/s wr, 90 op/s 2026-02-20T03:26:43.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 7.99 MB/sec execute 496 sec latency 24146.448 ms 2026-02-20T03:26:43.765 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:43 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:26:43.765 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:43 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:26:43.765 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:43 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:43 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:26:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:43 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:26:43.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:43 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:43.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:43 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:26:43.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:43 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:26:43.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:43 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:26:44.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 7.97 MB/sec execute 497 sec latency 25146.482 ms 2026-02-20T03:26:44.585 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:44 trial028 ceph-mon[38552]: pgmap v544: 129 pgs: 129 active+clean; 170 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 95 KiB/s rd, 1.5 MiB/s wr, 90 op/s 2026-02-20T03:26:44.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:44 trial126 ceph-mon[38476]: pgmap v544: 129 pgs: 129 active+clean; 170 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 95 KiB/s rd, 1.5 MiB/s wr, 90 op/s 2026-02-20T03:26:44.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:44 trial177 ceph-mon[43181]: pgmap v544: 129 pgs: 129 active+clean; 170 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 95 KiB/s rd, 1.5 MiB/s wr, 90 op/s 2026-02-20T03:26:45.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 7.96 MB/sec execute 498 sec latency 26146.523 ms 2026-02-20T03:26:46.291 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:26:46.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 7.94 MB/sec execute 499 sec latency 27146.555 ms 2026-02-20T03:26:46.579 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.770+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/758451361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 msgr2=0x7fbcf010dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.770+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/758451361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 0x7fbcf010dcb0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009a60 tx=0x7fbce002f250 comp rx=0 tx=0).stop 2026-02-20T03:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.770+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/758451361 shutdown_connections 2026-02-20T03:26:46.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.770+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/758451361 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcf010e3c0 0x7fbcf0115f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.770+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/758451361 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 0x7fbcf010dcb0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.770+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/758451361 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcf0109480 0x7fbcf0109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.770+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/758451361 >> 10.20.193.28:0/758451361 conn(0x7fbcf00786f0 msgr2=0x7fbcf007ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.770+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/758451361 shutdown_connections 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.770+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/758451361 wait complete. 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.771+0000 7fbcf5bfd640 1 Processor -- start 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.771+0000 7fbcf5bfd640 1 -- start start 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbcf5bfd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcf0109480 0x7fbcf01a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbcf5bfd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 0x7fbcf01a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbcf5bfd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcf010e3c0 0x7fbcf01a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbcf5bfd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0119200 con 0x7fbcf0109e30 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbcf5bfd640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0119080 con 0x7fbcf0109480 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbcf5bfd640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0119380 con 0x7fbcf010e3c0 2026-02-20T03:26:46.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbcef7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcf0109480 0x7fbcf01a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbceeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 0x7fbcf01a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbcef7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcf0109480 0x7fbcf01a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38860/0 (socket says 10.20.193.28:38860) 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbceeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 0x7fbcf01a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44162/0 (socket says 10.20.193.28:44162) 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbcef7fe640 1 -- 10.20.193.28:0/3047691516 learned_addr learned my addr 10.20.193.28:0/3047691516 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbceffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcf010e3c0 0x7fbcf01a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbceeffd640 1 -- 10.20.193.28:0/3047691516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcf010e3c0 msgr2=0x7fbcf01a5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbceeffd640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcf010e3c0 0x7fbcf01a5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbceeffd640 1 -- 10.20.193.28:0/3047691516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcf0109480 msgr2=0x7fbcf01a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbceeffd640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcf0109480 0x7fbcf01a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbceeffd640 1 -- 10.20.193.28:0/3047691516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf01a66f0 con 0x7fbcf0109e30 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.772+0000 7fbceeffd640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 0x7fbcf01a1be0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fbcf006c090 tx=0x7fbce0002a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.773+0000 7fbcecff9640 1 -- 10.20.193.28:0/3047691516 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce002fd40 con 0x7fbcf0109e30 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.773+0000 7fbcecff9640 1 -- 10.20.193.28:0/3047691516 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbce0004570 con 0x7fbcf0109e30 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.773+0000 7fbcecff9640 1 -- 10.20.193.28:0/3047691516 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0041620 con 0x7fbcf0109e30 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.773+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf01a6980 con 0x7fbcf0109e30 2026-02-20T03:26:46.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.773+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf01ae220 con 0x7fbcf0109e30 2026-02-20T03:26:46.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.773+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf010a610 con 0x7fbcf0109e30 2026-02-20T03:26:46.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.775+0000 7fbcecff9640 1 -- 10.20.193.28:0/3047691516 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbce0038890 con 0x7fbcf0109e30 2026-02-20T03:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.777+0000 7fbcecff9640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbcc40b0e20 0x7fbcc40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:46.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.777+0000 7fbcecff9640 1 -- 10.20.193.28:0/3047691516 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fbce01052a0 con 0x7fbcf0109e30 2026-02-20T03:26:46.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.777+0000 7fbcef7fe640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbcc40b0e20 0x7fbcc40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:46.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.777+0000 7fbcef7fe640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbcc40b0e20 0x7fbcc40b32e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009e10 tx=0x7fbcdc009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:46.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.778+0000 7fbcecff9640 1 -- 10.20.193.28:0/3047691516 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fbce0047060 con 0x7fbcf0109e30 2026-02-20T03:26:46.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.884+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcf0110f30 con 0x7fbcf0109e30 2026-02-20T03:26:46.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.885+0000 7fbcecff9640 1 -- 10.20.193.28:0/3047691516 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11921 (secure 0 0 0) 0x7fbce0047060 con 0x7fbcf0109e30 2026-02-20T03:26:46.889 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:26:46.889 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T03:25:19:519285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:25:19.519275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:26:46.889 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbcc40b0e20 msgr2=0x7fbcc40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbcc40b0e20 0x7fbcc40b32e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009e10 tx=0x7fbcdc009290 comp rx=0 tx=0).stop 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 msgr2=0x7fbcf01a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 0x7fbcf01a1be0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fbcf006c090 tx=0x7fbce0002a50 comp rx=0 tx=0).stop 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 shutdown_connections 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbcc40b0e20 0x7fbcc40b32e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbcf010e3c0 0x7fbcf01a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbcf0109e30 0x7fbcf01a1be0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 --2- 10.20.193.28:0/3047691516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbcf0109480 0x7fbcf01a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 >> 10.20.193.28:0/3047691516 conn(0x7fbcf00786f0 msgr2=0x7fbcf010aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:46.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 shutdown_connections 2026-02-20T03:26:46.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:46.886+0000 7fbcf5bfd640 1 -- 10.20.193.28:0/3047691516 wait complete. 2026-02-20T03:26:46.985 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id f407835 --release --await' 2026-02-20T03:26:46.986 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id f407835 --release --await 2026-02-20T03:26:47.260 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:47.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.459+0000 7ff1328b1640 1 -- 10.20.193.28:0/3053847222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff12c10a9a0 msgr2=0x7ff12c10ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:47.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.459+0000 7ff1328b1640 1 --2- 10.20.193.28:0/3053847222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff12c10a9a0 0x7ff12c10ad80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009a60 tx=0x7ff11c02f250 comp rx=0 tx=0).stop 2026-02-20T03:26:47.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.459+0000 7ff1328b1640 1 -- 10.20.193.28:0/3053847222 shutdown_connections 2026-02-20T03:26:47.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.459+0000 7ff1328b1640 1 --2- 10.20.193.28:0/3053847222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff12c105340 0x7ff12c111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.459+0000 7ff1328b1640 1 --2- 10.20.193.28:0/3053847222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12c1049a0 0x7ff12c104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.459+0000 7ff1328b1640 1 --2- 10.20.193.28:0/3053847222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff12c10a9a0 0x7ff12c10ad80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.459+0000 7ff1328b1640 1 -- 10.20.193.28:0/3053847222 >> 10.20.193.28:0/3053847222 conn(0x7ff12c1006c0 msgr2=0x7ff12c102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.459+0000 7ff1328b1640 1 -- 10.20.193.28:0/3053847222 shutdown_connections 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.459+0000 7ff1328b1640 1 -- 10.20.193.28:0/3053847222 wait complete. 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.460+0000 7ff1328b1640 1 Processor -- start 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.460+0000 7ff1328b1640 1 -- start start 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.460+0000 7ff1328b1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff12c1049a0 0x7ff12c19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.460+0000 7ff1328b1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12c105340 0x7ff12c19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.460+0000 7ff1328b1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff12c10a9a0 0x7ff12c1a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.460+0000 7ff1328b1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c114c10 con 0x7ff12c10a9a0 2026-02-20T03:26:47.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.460+0000 7ff1328b1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c114a90 con 0x7ff12c105340 2026-02-20T03:26:47.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.460+0000 7ff1328b1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c114d90 con 0x7ff12c1049a0 2026-02-20T03:26:47.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1318af640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff12c1049a0 0x7ff12c19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1318af640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff12c1049a0 0x7ff12c19d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59710/0 (socket says 10.20.193.28:59710) 2026-02-20T03:26:47.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1318af640 1 -- 10.20.193.28:0/1770557126 learned_addr learned my addr 10.20.193.28:0/1770557126 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:47.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1310ae640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12c105340 0x7ff12c19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1320b0640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff12c10a9a0 0x7ff12c1a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1320b0640 1 -- 10.20.193.28:0/1770557126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff12c1049a0 msgr2=0x7ff12c19d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1320b0640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff12c1049a0 0x7ff12c19d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1320b0640 1 -- 10.20.193.28:0/1770557126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12c105340 msgr2=0x7ff12c19d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1320b0640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12c105340 0x7ff12c19d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1320b0640 1 -- 10.20.193.28:0/1770557126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c1a2100 con 0x7ff12c10a9a0 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1320b0640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff12c10a9a0 0x7ff12c1a1980 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff128007f00 tx=0x7ff12800e510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff11affd640 1 -- 10.20.193.28:0/1770557126 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128002a60 con 0x7ff12c10a9a0 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff11affd640 1 -- 10.20.193.28:0/1770557126 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff128002c00 con 0x7ff12c10a9a0 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff1328b1640 1 -- 10.20.193.28:0/1770557126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c1a2390 con 0x7ff12c10a9a0 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.461+0000 7ff11affd640 1 -- 10.20.193.28:0/1770557126 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128013680 con 0x7ff12c10a9a0 2026-02-20T03:26:47.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.462+0000 7ff1328b1640 1 -- 10.20.193.28:0/1770557126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c1a9c30 con 0x7ff12c10a9a0 2026-02-20T03:26:47.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.464+0000 7ff11affd640 1 -- 10.20.193.28:0/1770557126 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff1280040d0 con 0x7ff12c10a9a0 2026-02-20T03:26:47.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.465+0000 7ff13603fe00 1 Processor -- start 2026-02-20T03:26:47.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.465+0000 7ff13603fe00 1 -- start start 2026-02-20T03:26:47.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 0x563492bf21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492bf33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf38e0 0x563492bfe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff13603fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563492b44a20 con 0x563492bf2f60 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff13603fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563492af22a0 con 0x563492bf1dd0 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff13603fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563492b40950 con 0x563492bf38e0 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1318af640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492bf33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1310ae640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 0x563492bf21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1310ae640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 0x563492bf21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38890/0 (socket says 10.20.193.28:38890) 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1310ae640 1 -- 10.20.193.28:0/1562808653 learned_addr learned my addr 10.20.193.28:0/1562808653 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1310ae640 1 --2- 10.20.193.28:0/1562808653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf38e0 0x563492bfe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1318af640 1 -- 10.20.193.28:0/1562808653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf38e0 msgr2=0x563492bfe2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:47.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1318af640 1 --2- 10.20.193.28:0/1562808653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf38e0 0x563492bfe2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1318af640 1 -- 10.20.193.28:0/1562808653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 msgr2=0x563492bf21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1318af640 1 --2- 10.20.193.28:0/1562808653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 0x563492bf21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1318af640 1 -- 10.20.193.28:0/1562808653 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492ad50f0 con 0x563492bf2f60 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff11affd640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff1080b0e20 0x7ff1080b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff11affd640 1 -- 10.20.193.28:0/1770557126 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ff1280e02f0 con 0x7ff12c10a9a0 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1318af640 1 --2- 10.20.193.28:0/1562808653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492bf33a0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff11c02f760 tx=0x7ff11c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a343165a874151 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.466+0000 7ff1320b0640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff1080b0e20 0x7ff1080b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff0fa4e6640 1 -- 10.20.193.28:0/1562808653 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c046070 con 0x563492bf2f60 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff0fa4e6640 1 -- 10.20.193.28:0/1562808653 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff11c033040 con 0x563492bf2f60 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff0fa4e6640 1 -- 10.20.193.28:0/1562808653 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c004290 con 0x563492bf2f60 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff13603fe00 1 -- 10.20.193.28:0/1562808653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 msgr2=0x563492bf33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:47.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff13603fe00 1 --2- 10.20.193.28:0/1562808653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492bf33a0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7ff11c02f760 tx=0x7ff11c005840 comp rx=0 tx=0).stop 2026-02-20T03:26:47.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff1320b0640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff1080b0e20 0x7ff1080b32e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff128002790 tx=0x7ff128009ac0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:47.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff13603fe00 1 -- 10.20.193.28:0/1562808653 shutdown_connections 2026-02-20T03:26:47.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff13603fe00 1 --2- 10.20.193.28:0/1562808653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf38e0 0x563492bfe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff13603fe00 1 --2- 10.20.193.28:0/1562808653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492bf33a0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff13603fe00 1 --2- 10.20.193.28:0/1562808653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 0x563492bf21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff13603fe00 1 -- 10.20.193.28:0/1562808653 >> 10.20.193.28:0/1562808653 conn(0x563492be91b0 msgr2=0x563492bf0030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:47.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff13603fe00 1 -- 10.20.193.28:0/1562808653 shutdown_connections 2026-02-20T03:26:47.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.467+0000 7ff13603fe00 1 -- 10.20.193.28:0/1562808653 wait complete. 2026-02-20T03:26:47.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.469+0000 7ff13603fe00 1 -- start start 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.469+0000 7ff13603fe00 1 Processor -- start 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.469+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492c0c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.469+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c0cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.469+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 0x563492c0aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.469+0000 7ff13603fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563492aec080 con 0x563492bf2f60 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.469+0000 7ff13603fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563492bfe970 con 0x563492bf38e0 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.469+0000 7ff13603fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563492c0afd0 con 0x563492bf1dd0 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.469+0000 7ff1318af640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c0cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1318af640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c0cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44200/0 (socket says 10.20.193.28:44200) 2026-02-20T03:26:47.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1318af640 1 -- 10.20.193.28:0/575612034 learned_addr learned my addr 10.20.193.28:0/575612034 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1310ae640 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492c0c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1310ae640 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 0x563492c0aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1318af640 1 -- 10.20.193.28:0/575612034 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 msgr2=0x563492c0c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1318af640 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492c0c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1318af640 1 -- 10.20.193.28:0/575612034 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 msgr2=0x563492c0aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1318af640 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 0x563492c0aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1318af640 1 -- 10.20.193.28:0/575612034 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492c03e80 con 0x563492bf2f60 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1310ae640 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 0x563492c0aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff1318af640 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c0cc60 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff11c02f290 tx=0x7ff11c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ea50461ad27539 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff0e77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff0e77fe640 1 -- 10.20.193.28:0/575612034 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c04f070 con 0x563492bf2f60 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff0e77fe640 1 -- 10.20.193.28:0/575612034 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff11c009620 con 0x563492bf2f60 2026-02-20T03:26:47.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff0e77fe640 1 -- 10.20.193.28:0/575612034 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c046040 con 0x563492bf2f60 2026-02-20T03:26:47.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.470+0000 7ff13603fe00 1 -- 10.20.193.28:0/575612034 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563492915da0 con 0x563492bf2f60 2026-02-20T03:26:47.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff0e77fe640 1 -- 10.20.193.28:0/575612034 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ff11c0413f0 con 0x563492bf2f60 2026-02-20T03:26:47.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff0e77fe640 10 client.18654 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:26:47.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 10 client.18654 _ll_register_callbacks cb 0x563492aeffb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:47.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 1 -- 10.20.193.28:0/575612034 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563492b4c610 con 0x563492bf2f60 2026-02-20T03:26:47.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff0e77fe640 1 -- 10.20.193.28:0/575612034 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff11c038770 con 0x563492bf2f60 2026-02-20T03:26:47.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:47 trial028 ceph-mon[38552]: pgmap v545: 129 pgs: 129 active+clean; 174 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 96 KiB/s rd, 1.7 MiB/s wr, 89 op/s 2026-02-20T03:26:47.478 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:47 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3047691516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:47.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 10 client.18654 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:47.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 1 -- 10.20.193.28:0/575612034 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x563492b02020 con 0x563492bf2f60 2026-02-20T03:26:47.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff0e77fe640 1 -- 10.20.193.28:0/575612034 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff11c049070 con 0x563492bf2f60 2026-02-20T03:26:47.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 10 client.18654 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:47.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 10 client.18654 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:26:47.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 20 client.18654 populate_metadata read hostname 'trial028' 2026-02-20T03:26:47.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563492c1a8c0 0x563492c1ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 4 client.18654 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.471+0000 7ff13603fe00 1 -- 10.20.193.28:0/575612034 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563492ac6b80 con 0x563492c1a8c0 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.472+0000 7ff1310ae640 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563492c1a8c0 0x563492c1ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.472+0000 7ff1310ae640 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563492c1a8c0 0x563492c1ccb0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=740bdaa21c4fd81b server_cookie=f6ccd162265dbd44 in_seq=0 out_seq=0 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.472+0000 7ff0e77fe640 10 client.18654 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff0e77fe640 1 -- 10.20.193.28:0/575612034 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563492ac6b80 con 0x563492c1a8c0 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff0e77fe640 10 client.18654 handle_command_reply: tid=0 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 client.18654 shutdown 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 -- 10.20.193.28:0/575612034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 msgr2=0x563492c0cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c0cc60 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7ff11c02f290 tx=0x7ff11c005ef0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 -- 10.20.193.28:0/575612034 shutdown_connections 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563492c1a8c0 0x563492c1ccb0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 0x563492c0aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c0cc60 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 --2- 10.20.193.28:0/575612034 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492c0c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 -- 10.20.193.28:0/575612034 >> 10.20.193.28:0/575612034 conn(0x563492be91b0 msgr2=0x563492bf6080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:47.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff0e77fe640 0 client.18654 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:47.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 -- 10.20.193.28:0/575612034 shutdown_connections 2026-02-20T03:26:47.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 1 -- 10.20.193.28:0/575612034 wait complete. 2026-02-20T03:26:47.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.473+0000 7ff13603fe00 20 client.18654 trim_cache size 0 max 16384 2026-02-20T03:26:47.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff13603fe00 1 Processor -- start 2026-02-20T03:26:47.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff13603fe00 1 -- start start 2026-02-20T03:26:47.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492bf6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c22480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 0x563492c229c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff13603fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d80126f0 con 0x563492bf2f60 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff13603fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d800ffc0 con 0x563492bf38e0 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff13603fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d800de10 con 0x563492bf1dd0 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff1310ae640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492bf6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff1318af640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c22480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff1310ae640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492bf6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59730/0 (socket says 10.20.193.28:59730) 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff1310ae640 1 -- 10.20.193.28:0/1308806515 learned_addr learned my addr 10.20.193.28:0/1308806515 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.482+0000 7ff1310ae640 1 --2- 10.20.193.28:0/1308806515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 0x563492c229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff1310ae640 1 -- 10.20.193.28:0/1308806515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 msgr2=0x563492c229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff1310ae640 1 --2- 10.20.193.28:0/1308806515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 0x563492c229c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff1310ae640 1 -- 10.20.193.28:0/1308806515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 msgr2=0x563492c22480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:47.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff1310ae640 1 --2- 10.20.193.28:0/1308806515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c22480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff1310ae640 1 -- 10.20.193.28:0/1308806515 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492c03cb0 con 0x563492bf1dd0 2026-02-20T03:26:47.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff1318af640 1 --2- 10.20.193.28:0/1308806515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c22480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff1310ae640 1 --2- 10.20.193.28:0/1308806515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492bf6790 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff120009d40 tx=0x7ff120009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ff83bfa847bc14 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff0f9ce5640 1 -- 10.20.193.28:0/1308806515 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1200128f0 con 0x563492bf1dd0 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff0f9ce5640 1 -- 10.20.193.28:0/1308806515 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff120010430 con 0x563492bf1dd0 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff0f9ce5640 1 -- 10.20.193.28:0/1308806515 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12002b650 con 0x563492bf1dd0 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff13603fe00 1 -- 10.20.193.28:0/1308806515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 msgr2=0x563492bf6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff13603fe00 1 --2- 10.20.193.28:0/1308806515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492bf6790 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff120009d40 tx=0x7ff120009290 comp rx=0 tx=0).stop 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff13603fe00 1 -- 10.20.193.28:0/1308806515 shutdown_connections 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff13603fe00 1 --2- 10.20.193.28:0/1308806515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf38e0 0x563492c229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff13603fe00 1 --2- 10.20.193.28:0/1308806515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf2f60 0x563492c22480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff13603fe00 1 --2- 10.20.193.28:0/1308806515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf1dd0 0x563492bf6790 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff13603fe00 1 -- 10.20.193.28:0/1308806515 >> 10.20.193.28:0/1308806515 conn(0x563492be91b0 msgr2=0x563492bf6080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff13603fe00 1 -- 10.20.193.28:0/1308806515 shutdown_connections 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.483+0000 7ff13603fe00 1 -- 10.20.193.28:0/1308806515 wait complete. 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.484+0000 7ff13603fe00 1 -- start start 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.484+0000 7ff13603fe00 1 Processor -- start 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 0x563492c11710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf2f60 0x563492c11c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff13603fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf38e0 0x563492c12190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff13603fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d800e480 con 0x563492bf38e0 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff13603fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d800f8f0 con 0x563492bf1dd0 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff13603fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d800eb50 con 0x563492bf2f60 2026-02-20T03:26:47.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1310ae640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 0x563492c11710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1318af640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf2f60 0x563492c11c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1318af640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf2f60 0x563492c11c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59740/0 (socket says 10.20.193.28:59740) 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1318af640 1 -- 10.20.193.28:0/3510415078 learned_addr learned my addr 10.20.193.28:0/3510415078 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1310ae640 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf38e0 0x563492c12190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1318af640 1 -- 10.20.193.28:0/3510415078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 msgr2=0x563492c11710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1318af640 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 0x563492c11710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1318af640 1 -- 10.20.193.28:0/3510415078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf38e0 msgr2=0x563492c12190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1318af640 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf38e0 0x563492c12190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1318af640 1 -- 10.20.193.28:0/3510415078 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563492823ad0 con 0x563492bf2f60 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff1318af640 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf2f60 0x563492c11c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0386a0 tx=0x7ff11c002a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8747f32b6c3de362 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff0e77fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff0e77fe640 1 -- 10.20.193.28:0/3510415078 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c046070 con 0x563492bf2f60 2026-02-20T03:26:47.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff0e77fe640 1 -- 10.20.193.28:0/3510415078 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff11c033050 con 0x563492bf2f60 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff0e77fe640 1 -- 10.20.193.28:0/3510415078 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c04f040 con 0x563492bf2f60 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.485+0000 7ff13603fe00 1 -- 10.20.193.28:0/3510415078 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563492acb370 con 0x563492bf2f60 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff0e77fe640 1 -- 10.20.193.28:0/3510415078 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ff11c005040 con 0x563492bf2f60 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 10 client.27604 _ll_register_callbacks cb 0x7ff120004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 1 -- 10.20.193.28:0/3510415078 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563492b523c0 con 0x563492bf2f60 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff0e77fe640 1 -- 10.20.193.28:0/3510415078 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff11c0047c0 con 0x563492bf2f60 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 10 client.27604 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 1 -- 10.20.193.28:0/3510415078 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x563492c049a0 con 0x563492bf2f60 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff0e77fe640 1 -- 10.20.193.28:0/3510415078 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff11c049040 con 0x563492bf2f60 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 10 client.27604 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 10 client.27604 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:26:47.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 20 client.27604 populate_metadata read hostname 'trial028' 2026-02-20T03:26:47.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563492c868e0 0x563492c88da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:47.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 4 client.27604 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f407835", "release": true, "await": true}] 2026-02-20T03:26:47.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff13603fe00 1 -- 10.20.193.28:0/3510415078 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f407835", "release": true, "await": true}) -- 0x7ff120010430 con 0x563492c868e0 2026-02-20T03:26:47.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.486+0000 7ff1310ae640 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563492c868e0 0x563492c88da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:47.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.487+0000 7ff1310ae640 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563492c868e0 0x563492c88da0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b21ffbbadb1238f5 server_cookie=fc232448ddbdacde in_seq=0 out_seq=0 2026-02-20T03:26:47.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.487+0000 7ff0e77fe640 10 client.27604 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:47.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff0e77fe640 1 -- 10.20.193.28:0/3510415078 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x7ff120010430 con 0x563492c868e0 2026-02-20T03:26:47.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff0e77fe640 10 client.27604 handle_command_reply: tid=0 2026-02-20T03:26:47.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 client.27604 shutdown 2026-02-20T03:26:47.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 -- 10.20.193.28:0/3510415078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf2f60 msgr2=0x563492c11c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:47.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf2f60 0x563492c11c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0386a0 tx=0x7ff11c002a60 comp rx=0 tx=0).stop 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 -- 10.20.193.28:0/3510415078 shutdown_connections 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563492c868e0 0x563492c88da0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563492bf38e0 0x563492c12190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563492bf2f60 0x563492c11c50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 --2- 10.20.193.28:0/3510415078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563492bf1dd0 0x563492c11710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 -- 10.20.193.28:0/3510415078 >> 10.20.193.28:0/3510415078 conn(0x563492be91b0 msgr2=0x563492c09120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff0e77fe640 0 client.27604 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 -- 10.20.193.28:0/3510415078 shutdown_connections 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 1 -- 10.20.193.28:0/3510415078 wait complete. 2026-02-20T03:26:47.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff13603fe00 20 client.27604 trim_cache size 0 max 16384 2026-02-20T03:26:47.507 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:26:47.507 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T03:26:47.507 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:26:47.507 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 40, 2026-02-20T03:26:47.507 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:26:47.507 INFO:teuthology.orchestra.run.trial028.stdout: "f407835": { 2026-02-20T03:26:47.507 INFO:teuthology.orchestra.run.trial028.stdout: "version": 40, 2026-02-20T03:26:47.507 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:26:47.507 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:47.508 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:47.509 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:47.509 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:47.509 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:47.509 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:26:47.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff1328b1640 1 -- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff1080b0e20 msgr2=0x7ff1080b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:47.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff1328b1640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff1080b0e20 0x7ff1080b32e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff128002790 tx=0x7ff128009ac0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff1328b1640 1 -- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff12c10a9a0 msgr2=0x7ff12c1a1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:47.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.502+0000 7ff1328b1640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff12c10a9a0 0x7ff12c1a1980 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7ff128007f00 tx=0x7ff12800e510 comp rx=0 tx=0).stop 2026-02-20T03:26:47.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.503+0000 7ff1328b1640 1 -- 10.20.193.28:0/1770557126 shutdown_connections 2026-02-20T03:26:47.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.503+0000 7ff1328b1640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff1080b0e20 0x7ff1080b32e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.503+0000 7ff1328b1640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff12c10a9a0 0x7ff12c1a1980 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.503+0000 7ff1328b1640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff12c105340 0x7ff12c19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.503+0000 7ff1328b1640 1 --2- 10.20.193.28:0/1770557126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff12c1049a0 0x7ff12c19d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:47.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.503+0000 7ff1328b1640 1 -- 10.20.193.28:0/1770557126 >> 10.20.193.28:0/1770557126 conn(0x7ff12c1006c0 msgr2=0x7ff12c100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:47.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.503+0000 7ff1328b1640 1 -- 10.20.193.28:0/1770557126 shutdown_connections 2026-02-20T03:26:47.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:47.504+0000 7ff1328b1640 1 -- 10.20.193.28:0/1770557126 wait complete. 2026-02-20T03:26:47.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1030197 7.92 MB/sec execute 500 sec latency 28146.590 ms 2026-02-20T03:26:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:47 trial126 ceph-mon[38476]: pgmap v545: 129 pgs: 129 active+clean; 174 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 96 KiB/s rd, 1.7 MiB/s wr, 89 op/s 2026-02-20T03:26:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:47 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3047691516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:47.658 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f407835', total seconds elapsed: 31.4 2026-02-20T03:26:47.658 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2026-02-20T03:26:47.658 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:26:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:47 trial177 ceph-mon[43181]: pgmap v545: 129 pgs: 129 active+clean; 174 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 96 KiB/s rd, 1.7 MiB/s wr, 89 op/s 2026-02-20T03:26:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:47 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3047691516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:47.946 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:48.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.117+0000 7facdd09c640 1 -- 10.20.193.28:0/961691365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8102700 msgr2=0x7facd8102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:48.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.117+0000 7facdd09c640 1 --2- 10.20.193.28:0/961691365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8102700 0x7facd8102b60 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7facc8009a60 tx=0x7facc802f250 comp rx=0 tx=0).stop 2026-02-20T03:26:48.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.117+0000 7facdd09c640 1 -- 10.20.193.28:0/961691365 shutdown_connections 2026-02-20T03:26:48.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.117+0000 7facdd09c640 1 --2- 10.20.193.28:0/961691365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facd81030a0 0x7facd810f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.117+0000 7facdd09c640 1 --2- 10.20.193.28:0/961691365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8102700 0x7facd8102b60 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.117+0000 7facdd09c640 1 --2- 10.20.193.28:0/961691365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7facd8108700 0x7facd8108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.117+0000 7facdd09c640 1 -- 10.20.193.28:0/961691365 >> 10.20.193.28:0/961691365 conn(0x7facd80fe440 msgr2=0x7facd8100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:48.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.117+0000 7facdd09c640 1 -- 10.20.193.28:0/961691365 shutdown_connections 2026-02-20T03:26:48.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.117+0000 7facdd09c640 1 -- 10.20.193.28:0/961691365 wait complete. 2026-02-20T03:26:48.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.118+0000 7facdd09c640 1 Processor -- start 2026-02-20T03:26:48.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.118+0000 7facdd09c640 1 -- start start 2026-02-20T03:26:48.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facdd09c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facd8102700 0x7facd81a6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facdd09c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7facd81030a0 0x7facd81a6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facdd09c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8108700 0x7facd810c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facdd09c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7facd8112920 con 0x7facd8108700 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facdd09c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7facd81127a0 con 0x7facd8102700 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facdd09c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7facd8112aa0 con 0x7facd81030a0 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facdc89b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8108700 0x7facd810c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facdc89b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8108700 0x7facd810c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44230/0 (socket says 10.20.193.28:44230) 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facdc89b640 1 -- 10.20.193.28:0/1521822045 learned_addr learned my addr 10.20.193.28:0/1521822045 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facd77fe640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7facd81030a0 0x7facd81a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.119+0000 7facd7fff640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facd8102700 0x7facd81a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facdc89b640 1 -- 10.20.193.28:0/1521822045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7facd81030a0 msgr2=0x7facd81a6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facdc89b640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7facd81030a0 0x7facd81a6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facdc89b640 1 -- 10.20.193.28:0/1521822045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facd8102700 msgr2=0x7facd81a6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facdc89b640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facd8102700 0x7facd81a6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facdc89b640 1 -- 10.20.193.28:0/1521822045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd810cf80 con 0x7facd8108700 2026-02-20T03:26:48.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facd7fff640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facd8102700 0x7facd81a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:48.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facdc89b640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8108700 0x7facd810c6c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7faccc00ef30 tx=0x7faccc00c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:48.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facd57fa640 1 -- 10.20.193.28:0/1521822045 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc019070 con 0x7facd8108700 2026-02-20T03:26:48.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facd57fa640 1 -- 10.20.193.28:0/1521822045 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faccc0092d0 con 0x7facd8108700 2026-02-20T03:26:48.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facd57fa640 1 -- 10.20.193.28:0/1521822045 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc007500 con 0x7facd8108700 2026-02-20T03:26:48.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd810d210 con 0x7facd8108700 2026-02-20T03:26:48.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.120+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd81ae0e0 con 0x7facd8108700 2026-02-20T03:26:48.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.121+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd8102b60 con 0x7facd8108700 2026-02-20T03:26:48.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.123+0000 7facd57fa640 1 -- 10.20.193.28:0/1521822045 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7faccc004b40 con 0x7facd8108700 2026-02-20T03:26:48.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.124+0000 7facd57fa640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facac0b0ef0 0x7facac0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.124+0000 7facd57fa640 1 -- 10.20.193.28:0/1521822045 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7faccc0e0630 con 0x7facd8108700 2026-02-20T03:26:48.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.124+0000 7facd7fff640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facac0b0ef0 0x7facac0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.124+0000 7facd57fa640 1 -- 10.20.193.28:0/1521822045 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7faccc010040 con 0x7facd8108700 2026-02-20T03:26:48.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.125+0000 7facd7fff640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facac0b0ef0 0x7facac0b33b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7facc4004160 tx=0x7facc4009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:48.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.232+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facd81ae2b0 con 0x7facd8108700 2026-02-20T03:26:48.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.232+0000 7facd57fa640 1 -- 10.20.193.28:0/1521822045 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11921 (secure 0 0 0) 0x7faccc0ac740 con 0x7facd8108700 2026-02-20T03:26:48.236 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:26:48.236 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T03:25:19:519285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:25:19.519275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:26:48.236 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T03:26:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facac0b0ef0 msgr2=0x7facac0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facac0b0ef0 0x7facac0b33b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7facc4004160 tx=0x7facc4009290 comp rx=0 tx=0).stop 2026-02-20T03:26:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8108700 msgr2=0x7facd810c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8108700 0x7facd810c6c0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7faccc00ef30 tx=0x7faccc00c560 comp rx=0 tx=0).stop 2026-02-20T03:26:48.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 shutdown_connections 2026-02-20T03:26:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facac0b0ef0 0x7facac0b33b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7facd8108700 0x7facd810c6c0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7facd81030a0 0x7facd81a6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 --2- 10.20.193.28:0/1521822045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7facd8102700 0x7facd81a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 >> 10.20.193.28:0/1521822045 conn(0x7facd80fe440 msgr2=0x7facd810da90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 shutdown_connections 2026-02-20T03:26:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.234+0000 7facdd09c640 1 -- 10.20.193.28:0/1521822045 wait complete. 2026-02-20T03:26:48.340 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2026-02-20T03:26:48.340 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2026-02-20T03:26:48.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031641 7.92 MB/sec execute 501 sec latency 28195.079 ms 2026-02-20T03:26:48.620 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:48.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.872+0000 7f229e506640 1 -- 10.20.193.28:0/3912555896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 msgr2=0x7f2298105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:48.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.872+0000 7f229e506640 1 --2- 10.20.193.28:0/3912555896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 0x7f2298105180 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2284009a30 tx=0x7f228402f260 comp rx=0 tx=0).stop 2026-02-20T03:26:48.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.872+0000 7f229e506640 1 -- 10.20.193.28:0/3912555896 shutdown_connections 2026-02-20T03:26:48.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.872+0000 7f229e506640 1 --2- 10.20.193.28:0/3912555896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2298109ed0 0x7f2298111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.872+0000 7f229e506640 1 --2- 10.20.193.28:0/3912555896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2298105750 0x7f22981097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.872+0000 7f229e506640 1 --2- 10.20.193.28:0/3912555896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 0x7f2298105180 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.872+0000 7f229e506640 1 -- 10.20.193.28:0/3912555896 >> 10.20.193.28:0/3912555896 conn(0x7f2298100840 msgr2=0x7f2298102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:48.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.872+0000 7f229e506640 1 -- 10.20.193.28:0/3912555896 shutdown_connections 2026-02-20T03:26:48.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.872+0000 7f229e506640 1 -- 10.20.193.28:0/3912555896 wait complete. 2026-02-20T03:26:48.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.873+0000 7f229e506640 1 Processor -- start 2026-02-20T03:26:48.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.873+0000 7f229e506640 1 -- start start 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.873+0000 7f229e506640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 0x7f2298111890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.873+0000 7f229e506640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2298105750 0x7f229810e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.873+0000 7f229e506640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2298109ed0 0x7f229810eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.873+0000 7f229e506640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2298114e80 con 0x7f2298104da0 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.873+0000 7f229e506640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2298114d00 con 0x7f2298105750 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.873+0000 7f229e506640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2298115000 con 0x7f2298109ed0 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f2297fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 0x7f2298111890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f2297fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 0x7f2298111890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44256/0 (socket says 10.20.193.28:44256) 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f2297fff640 1 -- 10.20.193.28:0/717931177 learned_addr learned my addr 10.20.193.28:0/717931177 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f2297fff640 1 -- 10.20.193.28:0/717931177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2298109ed0 msgr2=0x7f229810eea0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:48.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f2297fff640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2298109ed0 0x7f229810eea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f2297fff640 1 -- 10.20.193.28:0/717931177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2298105750 msgr2=0x7f229810e940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:26:48.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f2297fff640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2298105750 0x7f229810e940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f2297fff640 1 -- 10.20.193.28:0/717931177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229810f760 con 0x7f2298104da0 2026-02-20T03:26:48.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f2297fff640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 0x7f2298111890 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2284002fa0 tx=0x7f2284002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:48.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.874+0000 7f22957fa640 1 -- 10.20.193.28:0/717931177 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284004280 con 0x7f2298104da0 2026-02-20T03:26:48.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.875+0000 7f229e506640 1 -- 10.20.193.28:0/717931177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22981adde0 con 0x7f2298104da0 2026-02-20T03:26:48.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.875+0000 7f229e506640 1 -- 10.20.193.28:0/717931177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22981ae2e0 con 0x7f2298104da0 2026-02-20T03:26:48.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.875+0000 7f22957fa640 1 -- 10.20.193.28:0/717931177 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2284004420 con 0x7f2298104da0 2026-02-20T03:26:48.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.875+0000 7f22957fa640 1 -- 10.20.193.28:0/717931177 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284038d20 con 0x7f2298104da0 2026-02-20T03:26:48.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.878+0000 7f22957fa640 1 -- 10.20.193.28:0/717931177 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f228404b060 con 0x7f2298104da0 2026-02-20T03:26:48.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.879+0000 7f22a0a0be00 1 Processor -- start 2026-02-20T03:26:48.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.879+0000 7f22a0a0be00 1 -- start start 2026-02-20T03:26:48.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.879+0000 7f22957fa640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f226c0b0e20 0x7f226c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f22957fa640 1 -- 10.20.193.28:0/717931177 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f2284105190 con 0x7f2298104da0 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b855070 0x55c07b855450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b84f860 0x55c07b84fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b85bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c07b7a2410 con 0x55c07b850200 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c07b74f8b0 con 0x55c07b855070 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c07b79e340 con 0x55c07b84f860 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f229ca7c640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f226c0b0e20 0x7f226c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f229ca7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b85bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f229ca7c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b85bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44270/0 (socket says 10.20.193.28:44270) 2026-02-20T03:26:48.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f229ca7c640 1 -- 10.20.193.28:0/2191853407 learned_addr learned my addr 10.20.193.28:0/2191853407 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:48.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f229ca7c640 1 -- 10.20.193.28:0/2191853407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b84f860 msgr2=0x55c07b84fcc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:48.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f229ca7c640 1 --2- 10.20.193.28:0/2191853407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b84f860 0x55c07b84fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f229ca7c640 1 -- 10.20.193.28:0/2191853407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b855070 msgr2=0x55c07b855450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:48.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f229ca7c640 1 --2- 10.20.193.28:0/2191853407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b855070 0x55c07b855450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.880+0000 7f229ca7c640 1 -- 10.20.193.28:0/2191853407 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07b7418c0 con 0x55c07b850200 2026-02-20T03:26:48.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.881+0000 7f229ca7c640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f226c0b0e20 0x7f226c0b32e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f228c0136e0 tx=0x7f228c009a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.881+0000 7f229ca7c640 1 --2- 10.20.193.28:0/2191853407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b85bdc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f228c013f20 tx=0x7f228c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c8c0766e88181b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.881+0000 7f2268ce3640 1 -- 10.20.193.28:0/2191853407 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c015ea0 con 0x55c07b850200 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.881+0000 7f2268ce3640 1 -- 10.20.193.28:0/2191853407 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f228c002d00 con 0x55c07b850200 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.881+0000 7f2268ce3640 1 -- 10.20.193.28:0/2191853407 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c006400 con 0x55c07b850200 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.881+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2191853407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 msgr2=0x55c07b85bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.881+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2191853407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b85bdc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f228c013f20 tx=0x7f228c018000 comp rx=0 tx=0).stop 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.882+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2191853407 shutdown_connections 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.882+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2191853407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b85bdc0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.882+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2191853407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b84f860 0x55c07b84fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.882+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2191853407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b855070 0x55c07b855450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.882+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2191853407 >> 10.20.193.28:0/2191853407 conn(0x55c07b8483c0 msgr2=0x55c07b84df60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:48.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.882+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2191853407 shutdown_connections 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.882+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2191853407 wait complete. 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.883+0000 7f22a0a0be00 1 -- start start 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.883+0000 7f22a0a0be00 1 Processor -- start 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.883+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b8689c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.883+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b850200 0x55c07b868f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.883+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b855070 0x55c07b86e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.883+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c07b7494a0 con 0x55c07b84f860 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.883+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c07b85c460 con 0x55c07b855070 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.883+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c07b86ea40 con 0x55c07b850200 2026-02-20T03:26:48.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2297fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b8689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2297fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b8689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44272/0 (socket says 10.20.193.28:44272) 2026-02-20T03:26:48.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2297fff640 1 -- 10.20.193.28:0/2149845120 learned_addr learned my addr 10.20.193.28:0/2149845120 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:48.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2297fff640 1 -- 10.20.193.28:0/2149845120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b850200 msgr2=0x55c07b868f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2297fff640 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b850200 0x55c07b868f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2297fff640 1 -- 10.20.193.28:0/2149845120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b855070 msgr2=0x55c07b86e480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2297fff640 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b855070 0x55c07b86e480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2297fff640 1 -- 10.20.193.28:0/2149845120 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07b861d70 con 0x55c07b84f860 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2297fff640 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b8689c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f22840ca990 tx=0x7f2284009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5521a020d542a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2259ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.884+0000 7f2259ffb640 1 -- 10.20.193.28:0/2149845120 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284048040 con 0x55c07b84f860 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f2259ffb640 1 -- 10.20.193.28:0/2149845120 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2284033030 con 0x55c07b84f860 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f2259ffb640 1 -- 10.20.193.28:0/2149845120 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284004a20 con 0x55c07b84f860 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2149845120 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c07b5068a0 con 0x55c07b84f860 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f2259ffb640 1 -- 10.20.193.28:0/2149845120 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f22840c9090 con 0x55c07b84f860 2026-02-20T03:26:48.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 10 client.18678 _ll_register_callbacks cb 0x55c07b74d3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2149845120 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c07b7aa000 con 0x55c07b84f860 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f2259ffb640 1 -- 10.20.193.28:0/2149845120 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f22840d1d20 con 0x55c07b84f860 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 10 client.18678 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2149845120 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c07b5720e0 con 0x55c07b84f860 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f2259ffb640 1 -- 10.20.193.28:0/2149845120 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f22840c9290 con 0x55c07b84f860 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 10 client.18678 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 10 client.18678 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 20 client.18678 populate_metadata read hostname 'trial028' 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c07b8786e0 0x55c07b87aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 4 client.18678 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:48.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.885+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2149845120 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c07b723f60 con 0x55c07b8786e0 2026-02-20T03:26:48.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.902+0000 7f22977fe640 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c07b8786e0 0x55c07b87aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.930+0000 7f22977fe640 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c07b8786e0 0x55c07b87aba0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f945abd4b5157c66 server_cookie=fc27a78e2e382f7a in_seq=0 out_seq=0 2026-02-20T03:26:48.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.930+0000 7f2259ffb640 10 client.18678 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f2259ffb640 1 -- 10.20.193.28:0/2149845120 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c07b723f60 con 0x55c07b8786e0 2026-02-20T03:26:48.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f2259ffb640 10 client.18678 handle_command_reply: tid=0 2026-02-20T03:26:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 client.18678 shutdown 2026-02-20T03:26:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2149845120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 msgr2=0x55c07b8689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:48.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b8689c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f22840ca990 tx=0x7f2284009340 comp rx=0 tx=0).stop 2026-02-20T03:26:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2149845120 shutdown_connections 2026-02-20T03:26:48.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c07b8786e0 0x55c07b87aba0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b855070 0x55c07b86e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b850200 0x55c07b868f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2149845120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b8689c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f2259ffb640 0 client.18678 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2149845120 >> 10.20.193.28:0/2149845120 conn(0x55c07b8483c0 msgr2=0x55c07b84e670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.945+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2149845120 shutdown_connections 2026-02-20T03:26:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.946+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2149845120 wait complete. 2026-02-20T03:26:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.946+0000 7f22a0a0be00 20 client.18678 trim_cache size 0 max 16384 2026-02-20T03:26:48.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.954+0000 7f22a0a0be00 1 Processor -- start 2026-02-20T03:26:48.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22a0a0be00 1 -- start start 2026-02-20T03:26:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b84f860 0x55c07b8675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b865b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b855070 0x55c07b866070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f223c012770 con 0x55c07b850200 2026-02-20T03:26:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f223c010040 con 0x55c07b84f860 2026-02-20T03:26:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f223c00de90 con 0x55c07b855070 2026-02-20T03:26:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b865b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b865b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44278/0 (socket says 10.20.193.28:44278) 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22977fe640 1 -- 10.20.193.28:0/2267333056 learned_addr learned my addr 10.20.193.28:0/2267333056 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22977fe640 1 -- 10.20.193.28:0/2267333056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b855070 msgr2=0x55c07b866070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22977fe640 1 --2- 10.20.193.28:0/2267333056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b855070 0x55c07b866070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22977fe640 1 -- 10.20.193.28:0/2267333056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b84f860 msgr2=0x55c07b8675a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22977fe640 1 --2- 10.20.193.28:0/2267333056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b84f860 0x55c07b8675a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22977fe640 1 -- 10.20.193.28:0/2267333056 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07b861ba0 con 0x55c07b850200 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.955+0000 7f22977fe640 1 --2- 10.20.193.28:0/2267333056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b865b30 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x55c07b7f4df0 tx=0x7f22880047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7679ea9d224dea27 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f225bfff640 1 -- 10.20.193.28:0/2267333056 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228801e070 con 0x55c07b850200 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f225bfff640 1 -- 10.20.193.28:0/2267333056 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2288009dc0 con 0x55c07b850200 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f225bfff640 1 -- 10.20.193.28:0/2267333056 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288015040 con 0x55c07b850200 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2267333056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 msgr2=0x55c07b865b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:48.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2267333056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b865b30 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x55c07b7f4df0 tx=0x7f22880047e0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2267333056 shutdown_connections 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2267333056 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b855070 0x55c07b866070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2267333056 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b850200 0x55c07b865b30 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/2267333056 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b84f860 0x55c07b8675a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2267333056 >> 10.20.193.28:0/2267333056 conn(0x55c07b8483c0 msgr2=0x55c07b866e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2267333056 shutdown_connections 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.956+0000 7f22a0a0be00 1 -- 10.20.193.28:0/2267333056 wait complete. 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f22a0a0be00 1 -- start start 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f22a0a0be00 1 Processor -- start 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b871cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b850200 0x55c07b872210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f22a0a0be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b855070 0x55c07b8e3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f223c00e500 con 0x55c07b84f860 2026-02-20T03:26:48.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f223c00f970 con 0x55c07b850200 2026-02-20T03:26:48.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f22a0a0be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f223c00ebd0 con 0x55c07b855070 2026-02-20T03:26:48.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f2297fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b871cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f2297fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b871cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44292/0 (socket says 10.20.193.28:44292) 2026-02-20T03:26:48.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.957+0000 7f2297fff640 1 -- 10.20.193.28:0/3798248715 learned_addr learned my addr 10.20.193.28:0/3798248715 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.958+0000 7f229ca7c640 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b855070 0x55c07b8e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.959+0000 7f2297fff640 1 -- 10.20.193.28:0/3798248715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b855070 msgr2=0x55c07b8e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.959+0000 7f2297fff640 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b855070 0x55c07b8e3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.959+0000 7f2297fff640 1 -- 10.20.193.28:0/3798248715 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b850200 msgr2=0x55c07b872210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.959+0000 7f2297fff640 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b850200 0x55c07b872210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.959+0000 7f2297fff640 1 -- 10.20.193.28:0/3798248715 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c07b861760 con 0x55c07b84f860 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.959+0000 7f2297fff640 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b871cd0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f228402f770 tx=0x7f22840f1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369d57e5cd76d5ce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.959+0000 7f2259ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.959+0000 7f2259ffb640 1 -- 10.20.193.28:0/3798248715 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284048020 con 0x55c07b84f860 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f2259ffb640 1 -- 10.20.193.28:0/3798248715 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2284033070 con 0x55c07b84f860 2026-02-20T03:26:48.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f2259ffb640 1 -- 10.20.193.28:0/3798248715 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22840cc6e0 con 0x55c07b84f860 2026-02-20T03:26:48.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f22a0a0be00 1 -- 10.20.193.28:0/3798248715 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c07b5237f0 con 0x55c07b84f860 2026-02-20T03:26:48.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f22a0a0be00 10 client.18684 _ll_register_callbacks cb 0x7f22840c96d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:48.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f22a0a0be00 1 -- 10.20.193.28:0/3798248715 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f228c002d00 con 0x55c07b84f860 2026-02-20T03:26:48.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f2259ffb640 1 -- 10.20.193.28:0/3798248715 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f22840eeaa0 con 0x55c07b84f860 2026-02-20T03:26:48.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f2259ffb640 1 -- 10.20.193.28:0/3798248715 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f22840eece0 con 0x55c07b84f860 2026-02-20T03:26:48.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f22a0a0be00 10 client.18684 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:48.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f22a0a0be00 1 -- 10.20.193.28:0/3798248715 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c07b862890 con 0x55c07b84f860 2026-02-20T03:26:48.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f2259ffb640 1 -- 10.20.193.28:0/3798248715 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f22840c9090 con 0x55c07b84f860 2026-02-20T03:26:48.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f22a0a0be00 10 client.18684 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:48.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f22a0a0be00 10 client.18684 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:26:48.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.960+0000 7f22a0a0be00 20 client.18684 populate_metadata read hostname 'trial028' 2026-02-20T03:26:48.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.961+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c07b8e4be0 0x55c07b8e7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:48.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.961+0000 7f22a0a0be00 4 client.18684 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2026-02-20T03:26:48.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.961+0000 7f22a0a0be00 1 -- 10.20.193.28:0/3798248715 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55c07b512f60 con 0x55c07b8e4be0 2026-02-20T03:26:48.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:48.972+0000 7f22977fe640 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c07b8e4be0 0x55c07b8e7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:49.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:49.013+0000 7f22977fe640 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c07b8e4be0 0x55c07b8e7070 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7884fd7264249e77 server_cookie=6b880f53b52ddf2e in_seq=0 out_seq=0 2026-02-20T03:26:49.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:49.013+0000 7f2259ffb640 10 client.18684 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:49.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:49 trial028 ceph-mon[38552]: pgmap v546: 129 pgs: 129 active+clean; 176 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 91 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2026-02-20T03:26:49.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:49 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1521822045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:49.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031656 7.91 MB/sec execute 502 sec latency 853.916 ms 2026-02-20T03:26:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:49 trial126 ceph-mon[38476]: pgmap v546: 129 pgs: 129 active+clean; 176 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 91 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2026-02-20T03:26:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:49 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1521822045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:49 trial177 ceph-mon[43181]: pgmap v546: 129 pgs: 129 active+clean; 176 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 91 KiB/s rd, 1.3 MiB/s wr, 73 op/s 2026-02-20T03:26:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:49 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1521822045' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:50.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.246+0000 7f2259ffb640 1 -- 10.20.193.28:0/3798248715 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55c07b512f60 con 0x55c07b8e4be0 2026-02-20T03:26:50.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.246+0000 7f2259ffb640 10 client.18684 handle_command_reply: tid=0 2026-02-20T03:26:50.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.246+0000 7f22a0a0be00 1 client.18684 shutdown 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 -- 10.20.193.28:0/3798248715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 msgr2=0x55c07b871cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b871cd0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f228402f770 tx=0x7f22840f1000 comp rx=0 tx=0).stop 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 -- 10.20.193.28:0/3798248715 shutdown_connections 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c07b8e4be0 0x55c07b8e7070 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c07b855070 0x55c07b8e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c07b850200 0x55c07b872210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 --2- 10.20.193.28:0/3798248715 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c07b84f860 0x55c07b871cd0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f2259ffb640 0 client.18684 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 -- 10.20.193.28:0/3798248715 >> 10.20.193.28:0/3798248715 conn(0x55c07b8483c0 msgr2=0x55c07b8676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:50.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 -- 10.20.193.28:0/3798248715 shutdown_connections 2026-02-20T03:26:50.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 1 -- 10.20.193.28:0/3798248715 wait complete. 2026-02-20T03:26:50.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.247+0000 7f22a0a0be00 20 client.18684 trim_cache size 0 max 16384 2026-02-20T03:26:50.252 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:26:50.252 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T03:26:50.252 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:26:50.252 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 42, 2026-02-20T03:26:50.252 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:26:50.252 INFO:teuthology.orchestra.run.trial028.stdout: "29b98b59": { 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "version": 42, 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:26:50.253 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:26:50.254 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:26:50.254 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:26:50.254 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:50.254 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:50.254 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:50.254 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:50.254 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:50.254 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:26:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 -- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f226c0b0e20 msgr2=0x7f226c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f226c0b0e20 0x7f226c0b32e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f228c0136e0 tx=0x7f228c009a80 comp rx=0 tx=0).stop 2026-02-20T03:26:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 -- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 msgr2=0x7f2298111890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 0x7f2298111890 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2284002fa0 tx=0x7f2284002910 comp rx=0 tx=0).stop 2026-02-20T03:26:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 -- 10.20.193.28:0/717931177 shutdown_connections 2026-02-20T03:26:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f226c0b0e20 0x7f226c0b32e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2298109ed0 0x7f229810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2298105750 0x7f229810e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:50.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 --2- 10.20.193.28:0/717931177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2298104da0 0x7f2298111890 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 -- 10.20.193.28:0/717931177 >> 10.20.193.28:0/717931177 conn(0x7f2298100840 msgr2=0x7f2298101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 -- 10.20.193.28:0/717931177 shutdown_connections 2026-02-20T03:26:50.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:50.248+0000 7f229e506640 1 -- 10.20.193.28:0/717931177 wait complete. 2026-02-20T03:26:50.353 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '29b98b59', quiesce took 2.7 seconds. Will release after: 27.3 2026-02-20T03:26:50.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.89 MB/sec execute 503 sec latency 1575.744 ms 2026-02-20T03:26:51.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.87 MB/sec execute 504 sec latency 1278.269 ms 2026-02-20T03:26:51.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:51 trial126 ceph-mon[38476]: pgmap v547: 129 pgs: 129 active+clean; 172 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 532 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2026-02-20T03:26:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:51 trial028 ceph-mon[38552]: pgmap v547: 129 pgs: 129 active+clean; 172 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 532 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2026-02-20T03:26:51.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.643+0000 7fd636964640 1 -- 10.20.193.28:0/627005035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6301064f0 msgr2=0x7fd63010cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:51.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.643+0000 7fd636964640 1 --2- 10.20.193.28:0/627005035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6301064f0 0x7fd63010cd80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fd62c00b0a0 tx=0x7fd62c02f410 comp rx=0 tx=0).stop 2026-02-20T03:26:51.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 -- 10.20.193.28:0/627005035 shutdown_connections 2026-02-20T03:26:51.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 --2- 10.20.193.28:0/627005035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6301064f0 0x7fd63010cd80 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 --2- 10.20.193.28:0/627005035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd630105b30 0x7fd630105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 --2- 10.20.193.28:0/627005035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd630104940 0x7fd630104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 -- 10.20.193.28:0/627005035 >> 10.20.193.28:0/627005035 conn(0x7fd6301000c0 msgr2=0x7fd6301024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:51.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 -- 10.20.193.28:0/627005035 shutdown_connections 2026-02-20T03:26:51.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 -- 10.20.193.28:0/627005035 wait complete. 2026-02-20T03:26:51.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 Processor -- start 2026-02-20T03:26:51.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 -- start start 2026-02-20T03:26:51.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd630104940 0x7fd6301a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd630105b30 0x7fd6301a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6301064f0 0x7fd6301a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd630110430 con 0x7fd6301064f0 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301102b0 con 0x7fd630105b30 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.644+0000 7fd636964640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6301105b0 con 0x7fd630104940 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd636163640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6301064f0 0x7fd6301a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd635962640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd630104940 0x7fd6301a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd635962640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd630104940 0x7fd6301a0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59804/0 (socket says 10.20.193.28:59804) 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd635962640 1 -- 10.20.193.28:0/3722615155 learned_addr learned my addr 10.20.193.28:0/3722615155 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd635161640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd630105b30 0x7fd6301a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd636163640 1 -- 10.20.193.28:0/3722615155 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd630104940 msgr2=0x7fd6301a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:51.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd636163640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd630104940 0x7fd6301a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd636163640 1 -- 10.20.193.28:0/3722615155 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd630105b30 msgr2=0x7fd6301a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:51.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd636163640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd630105b30 0x7fd6301a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd636163640 1 -- 10.20.193.28:0/3722615155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6301a8b70 con 0x7fd6301064f0 2026-02-20T03:26:51.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd636163640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6301064f0 0x7fd6301a8470 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd62c032040 tx=0x7fd62c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:51.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd61effd640 1 -- 10.20.193.28:0/3722615155 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0096e0 con 0x7fd6301064f0 2026-02-20T03:26:51.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd61effd640 1 -- 10.20.193.28:0/3722615155 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd62c0076a0 con 0x7fd6301064f0 2026-02-20T03:26:51.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd636964640 1 -- 10.20.193.28:0/3722615155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6301a8e00 con 0x7fd6301064f0 2026-02-20T03:26:51.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd61effd640 1 -- 10.20.193.28:0/3722615155 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c038660 con 0x7fd6301064f0 2026-02-20T03:26:51.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.645+0000 7fd636964640 1 -- 10.20.193.28:0/3722615155 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6301a9200 con 0x7fd6301064f0 2026-02-20T03:26:51.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.648+0000 7fd61effd640 1 -- 10.20.193.28:0/3722615155 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd62c007bc0 con 0x7fd6301064f0 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.648+0000 7fd63aa4de00 1 Processor -- start 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.648+0000 7fd63aa4de00 1 -- start start 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.648+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b75280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.648+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 0x565553b79f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.648+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 0x565553b7c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.648+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x565553ac58f0 con 0x565553b757c0 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.648+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x565553a732e0 con 0x565553b74e80 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.648+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x565553ac1820 con 0x565553b7a560 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b75280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b75280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39022/0 (socket says 10.20.193.28:39022) 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 -- 10.20.193.28:0/2679798014 learned_addr learned my addr 10.20.193.28:0/2679798014 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 0x565553b7c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635962640 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 0x565553b79f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 -- 10.20.193.28:0/2679798014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 msgr2=0x565553b7c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 0x565553b7c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 -- 10.20.193.28:0/2679798014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 msgr2=0x565553b79f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 0x565553b79f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 -- 10.20.193.28:0/2679798014 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565553a655a0 con 0x565553b74e80 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635962640 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 0x565553b79f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd635161640 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b75280 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd624004560 tx=0x7fd6240098f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=770c4d0e34fe740d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd5fdbfe640 1 -- 10.20.193.28:0/2679798014 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6240048a0 con 0x565553b74e80 2026-02-20T03:26:51.659 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd5fdbfe640 1 -- 10.20.193.28:0/2679798014 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd624005020 con 0x565553b74e80 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd5fdbfe640 1 -- 10.20.193.28:0/2679798014 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6240106c0 con 0x565553b74e80 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd63aa4de00 1 -- 10.20.193.28:0/2679798014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 msgr2=0x565553b75280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.649+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b75280 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd624004560 tx=0x7fd6240098f0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd63aa4de00 1 -- 10.20.193.28:0/2679798014 shutdown_connections 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 0x565553b7c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 0x565553b79f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/2679798014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b75280 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd63aa4de00 1 -- 10.20.193.28:0/2679798014 >> 10.20.193.28:0/2679798014 conn(0x565553b6c6f0 msgr2=0x565553b73570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd63aa4de00 1 -- 10.20.193.28:0/2679798014 shutdown_connections 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd63aa4de00 1 -- 10.20.193.28:0/2679798014 wait complete. 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd61effd640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd60c0b0e20 0x7fd60c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd61effd640 1 -- 10.20.193.28:0/3722615155 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd62c104ee0 con 0x7fd6301064f0 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.650+0000 7fd635161640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd60c0b0e20 0x7fd60c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.651+0000 7fd635161640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd60c0b0e20 0x7fd60c0b32e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd62401d040 tx=0x7fd624003f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.651+0000 7fd63aa4de00 1 -- start start 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.651+0000 7fd63aa4de00 1 Processor -- start 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.651+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b8d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.651+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 0x565553b8ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.651+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b94c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.651+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x565553a6d0c0 con 0x565553b74e80 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.651+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x565553b7d5b0 con 0x565553b7a560 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.651+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x565553b95200 con 0x565553b757c0 2026-02-20T03:26:51.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd635161640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 0x565553b8ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd635161640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 0x565553b8ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59820/0 (socket says 10.20.193.28:59820) 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd635161640 1 -- 10.20.193.28:0/970663332 learned_addr learned my addr 10.20.193.28:0/970663332 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd636163640 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b94c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd635962640 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b8d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd636163640 1 -- 10.20.193.28:0/970663332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 msgr2=0x565553b8ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd636163640 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 0x565553b8ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd636163640 1 -- 10.20.193.28:0/970663332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 msgr2=0x565553b8d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd636163640 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b8d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd636163640 1 -- 10.20.193.28:0/970663332 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565553b87030 con 0x565553b7a560 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd636163640 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b94c70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd62c004a70 tx=0x7fd62c0cc420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3322928df8fdbecc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd5eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:26:51.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd5eaffd640 1 -- 10.20.193.28:0/970663332 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0d1000 con 0x565553b7a560 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd5eaffd640 1 -- 10.20.193.28:0/970663332 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd62c033030 con 0x565553b7a560 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd63aa4de00 1 -- 10.20.193.28:0/970663332 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565553a81820 con 0x565553b7a560 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd63aa4de00 10 client.27611 _ll_register_callbacks cb 0x565553a70ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd63aa4de00 1 -- 10.20.193.28:0/970663332 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565553acd4e0 con 0x565553b7a560 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.652+0000 7fd5eaffd640 1 -- 10.20.193.28:0/970663332 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c0d3530 con 0x565553b7a560 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd5eaffd640 1 -- 10.20.193.28:0/970663332 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd62c0f31a0 con 0x565553b7a560 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd5eaffd640 1 -- 10.20.193.28:0/970663332 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd62c0c8370 con 0x565553b7a560 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd63aa4de00 10 client.27611 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd63aa4de00 1 -- 10.20.193.28:0/970663332 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x565553a86380 con 0x565553b7a560 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd5eaffd640 1 -- 10.20.193.28:0/970663332 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd62c0d5040 con 0x565553b7a560 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd63aa4de00 10 client.27611 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd63aa4de00 10 client.27611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:51.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd63aa4de00 20 client.27611 populate_metadata read hostname 'trial028' 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565553b99450 0x565553b9b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd63aa4de00 4 client.27611 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd63aa4de00 1 -- 10.20.193.28:0/970663332 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565553a47bd0 con 0x565553b99450 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.653+0000 7fd635962640 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565553b99450 0x565553b9b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.654+0000 7fd635962640 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565553b99450 0x565553b9b910 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=326828a2dee7df1f server_cookie=585d211f32e012d8 in_seq=0 out_seq=0 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.654+0000 7fd5eaffd640 10 client.27611 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.654+0000 7fd5eaffd640 1 -- 10.20.193.28:0/970663332 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x565553a47bd0 con 0x565553b99450 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.654+0000 7fd5eaffd640 10 client.27611 handle_command_reply: tid=0 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.654+0000 7fd63aa4de00 1 client.27611 shutdown 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.654+0000 7fd63aa4de00 1 -- 10.20.193.28:0/970663332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 msgr2=0x565553b94c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:51.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.654+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b94c70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd62c004a70 tx=0x7fd62c0cc420 comp rx=0 tx=0).stop 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd63aa4de00 1 -- 10.20.193.28:0/970663332 shutdown_connections 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565553b99450 0x565553b9b910 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b94c70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 0x565553b8ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/970663332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b8d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd63aa4de00 1 -- 10.20.193.28:0/970663332 >> 10.20.193.28:0/970663332 conn(0x565553b6c6f0 msgr2=0x565553b7b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd5eaffd640 0 client.27611 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd63aa4de00 1 -- 10.20.193.28:0/970663332 shutdown_connections 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd63aa4de00 1 -- 10.20.193.28:0/970663332 wait complete. 2026-02-20T03:26:51.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.655+0000 7fd63aa4de00 20 client.27611 trim_cache size 0 max 16384 2026-02-20T03:26:51.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd63aa4de00 1 Processor -- start 2026-02-20T03:26:51.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd63aa4de00 1 -- start start 2026-02-20T03:26:51.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b72d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 0x565553b76e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 0x565553b94c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc0126f0 con 0x565553b757c0 2026-02-20T03:26:51.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc00ffc0 con 0x565553b74e80 2026-02-20T03:26:51.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc00de10 con 0x565553b7a560 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd635962640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b72d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd635161640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 0x565553b76e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd636163640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 0x565553b94c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd635962640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b72d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39026/0 (socket says 10.20.193.28:39026) 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd635962640 1 -- 10.20.193.28:0/3984489857 learned_addr learned my addr 10.20.193.28:0/3984489857 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd635962640 1 -- 10.20.193.28:0/3984489857 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 msgr2=0x565553b94c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd635962640 1 --2- 10.20.193.28:0/3984489857 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 0x565553b94c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd635962640 1 -- 10.20.193.28:0/3984489857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 msgr2=0x565553b76e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd635962640 1 --2- 10.20.193.28:0/3984489857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 0x565553b76e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.662+0000 7fd635962640 1 -- 10.20.193.28:0/3984489857 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565553b86e60 con 0x565553b74e80 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd635962640 1 --2- 10.20.193.28:0/3984489857 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b72d50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd620009f40 tx=0x7fd620004590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dce40ddc8d18fd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:51.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd5fd3fd640 1 -- 10.20.193.28:0/3984489857 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200126b0 con 0x565553b74e80 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd5fd3fd640 1 -- 10.20.193.28:0/3984489857 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd620003e20 con 0x565553b74e80 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd5fd3fd640 1 -- 10.20.193.28:0/3984489857 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62001cc00 con 0x565553b74e80 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd63aa4de00 1 -- 10.20.193.28:0/3984489857 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 msgr2=0x565553b72d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/3984489857 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b72d50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd620009f40 tx=0x7fd620004590 comp rx=0 tx=0).stop 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd63aa4de00 1 -- 10.20.193.28:0/3984489857 shutdown_connections 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/3984489857 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b7a560 0x565553b94c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/3984489857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b757c0 0x565553b76e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/3984489857 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b74e80 0x565553b72d50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd63aa4de00 1 -- 10.20.193.28:0/3984489857 >> 10.20.193.28:0/3984489857 conn(0x565553b6c6f0 msgr2=0x565553b76700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd63aa4de00 1 -- 10.20.193.28:0/3984489857 shutdown_connections 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.663+0000 7fd63aa4de00 1 -- 10.20.193.28:0/3984489857 wait complete. 2026-02-20T03:26:51.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd63aa4de00 1 -- start start 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd63aa4de00 1 Processor -- start 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b93300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 0x565553b93840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd63aa4de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b93d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc00e480 con 0x565553b74e80 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc00f8f0 con 0x565553b7a560 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd63aa4de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc00eb50 con 0x565553b757c0 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd635962640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b93300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd635962640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b93300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44344/0 (socket says 10.20.193.28:44344) 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd635962640 1 -- 10.20.193.28:0/4015082170 learned_addr learned my addr 10.20.193.28:0/4015082170 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:51.673 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd636163640 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b93d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.664+0000 7fd635161640 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 0x565553b93840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd635962640 1 -- 10.20.193.28:0/4015082170 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 msgr2=0x565553b93840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd635962640 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 0x565553b93840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd635962640 1 -- 10.20.193.28:0/4015082170 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 msgr2=0x565553b93d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd635962640 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b93d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd635962640 1 -- 10.20.193.28:0/4015082170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565553b7c950 con 0x565553b74e80 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd636163640 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b93d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd635962640 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b93300 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fd620002410 tx=0x7fd620005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0fad8ecc5ab493 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd5eaffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd5eaffd640 1 -- 10.20.193.28:0/4015082170 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62001cb90 con 0x565553b74e80 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd5eaffd640 1 -- 10.20.193.28:0/4015082170 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd62001cd30 con 0x565553b74e80 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd5eaffd640 1 -- 10.20.193.28:0/4015082170 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620010690 con 0x565553b74e80 2026-02-20T03:26:51.674 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd63aa4de00 1 -- 10.20.193.28:0/4015082170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565553825690 con 0x565553b74e80 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd5eaffd640 1 -- 10.20.193.28:0/4015082170 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd6200108b0 con 0x565553b74e80 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd5eaffd640 10 client.18699 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd63aa4de00 10 client.18699 _ll_register_callbacks cb 0x7fd62c0cca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.665+0000 7fd63aa4de00 1 -- 10.20.193.28:0/4015082170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565553ad3290 con 0x565553b74e80 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd5eaffd640 1 -- 10.20.193.28:0/4015082170 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd620035060 con 0x565553b74e80 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd63aa4de00 10 client.18699 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd63aa4de00 1 -- 10.20.193.28:0/4015082170 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x565553a8ab70 con 0x565553b74e80 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd5eaffd640 1 -- 10.20.193.28:0/4015082170 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fd620010ab0 con 0x565553b74e80 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd63aa4de00 10 client.18699 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd63aa4de00 10 client.18699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd63aa4de00 20 client.18699 populate_metadata read hostname 'trial028' 2026-02-20T03:26:51.675 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565553c05970 0x565553c07e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:51.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd63aa4de00 4 client.18699 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:26:51.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd63aa4de00 1 -- 10.20.193.28:0/4015082170 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd620003e20 con 0x565553c05970 2026-02-20T03:26:51.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd635161640 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565553c05970 0x565553c07e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:51.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd635161640 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565553c05970 0x565553c07e30 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d377668d3a054f9 server_cookie=baeabcb1a66c6e60 in_seq=0 out_seq=0 2026-02-20T03:26:51.676 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.666+0000 7fd5eaffd640 10 client.18699 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:51.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd5eaffd640 1 -- 10.20.193.28:0/4015082170 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fd620003e20 con 0x565553c05970 2026-02-20T03:26:51.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd5eaffd640 10 client.18699 handle_command_reply: tid=0 2026-02-20T03:26:51.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 client.18699 shutdown 2026-02-20T03:26:51.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 -- 10.20.193.28:0/4015082170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 msgr2=0x565553b93300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:51.687 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b93300 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fd620002410 tx=0x7fd620005a70 comp rx=0 tx=0).stop 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 -- 10.20.193.28:0/4015082170 shutdown_connections 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565553c05970 0x565553c07e30 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565553b7a560 0x565553b93d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd5eaffd640 0 client.18699 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565553b757c0 0x565553b93840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 --2- 10.20.193.28:0/4015082170 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565553b74e80 0x565553b93300 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 -- 10.20.193.28:0/4015082170 >> 10.20.193.28:0/4015082170 conn(0x565553b6c6f0 msgr2=0x565553b76e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 -- 10.20.193.28:0/4015082170 shutdown_connections 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 1 -- 10.20.193.28:0/4015082170 wait complete. 2026-02-20T03:26:51.688 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.684+0000 7fd63aa4de00 20 client.18699 trim_cache size 0 max 16384 2026-02-20T03:26:51.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:26:51.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:26:51.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:26:51.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:26:51.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 -- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd60c0b0e20 msgr2=0x7fd60c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:51.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd60c0b0e20 0x7fd60c0b32e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd62401d040 tx=0x7fd624003f90 comp rx=0 tx=0).stop 2026-02-20T03:26:51.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 -- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6301064f0 msgr2=0x7fd6301a8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:51.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6301064f0 0x7fd6301a8470 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fd62c032040 tx=0x7fd62c004290 comp rx=0 tx=0).stop 2026-02-20T03:26:51.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 -- 10.20.193.28:0/3722615155 shutdown_connections 2026-02-20T03:26:51.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd60c0b0e20 0x7fd60c0b32e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6301064f0 0x7fd6301a8470 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd630105b30 0x7fd6301a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 --2- 10.20.193.28:0/3722615155 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd630104940 0x7fd6301a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:51.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 -- 10.20.193.28:0/3722615155 >> 10.20.193.28:0/3722615155 conn(0x7fd6301000c0 msgr2=0x7fd630079540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:51.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 -- 10.20.193.28:0/3722615155 shutdown_connections 2026-02-20T03:26:51.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:26:51.685+0000 7fd636964640 1 -- 10.20.193.28:0/3722615155 wait complete. 2026-02-20T03:26:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:51 trial177 ceph-mon[43181]: pgmap v547: 129 pgs: 129 active+clean; 172 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 532 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2026-02-20T03:26:52.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.86 MB/sec execute 505 sec latency 2278.326 ms 2026-02-20T03:26:53.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.84 MB/sec execute 506 sec latency 3278.376 ms 2026-02-20T03:26:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:53 trial126 ceph-mon[38476]: pgmap v548: 129 pgs: 129 active+clean; 171 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 684 KiB/s rd, 1.6 MiB/s wr, 88 op/s 2026-02-20T03:26:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:53 trial028 ceph-mon[38552]: pgmap v548: 129 pgs: 129 active+clean; 171 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 684 KiB/s rd, 1.6 MiB/s wr, 88 op/s 2026-02-20T03:26:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:53 trial177 ceph-mon[43181]: pgmap v548: 129 pgs: 129 active+clean; 171 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 684 KiB/s rd, 1.6 MiB/s wr, 88 op/s 2026-02-20T03:26:54.271 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:26:54.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.83 MB/sec execute 507 sec latency 4278.405 ms 2026-02-20T03:26:54.540 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:54.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.719+0000 7f7dd92c5640 1 -- 10.20.193.28:0/2407333819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7dd4109ed0 msgr2=0x7f7dd4111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:54.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.719+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/2407333819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7dd4109ed0 0x7f7dd4111a50 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400b0a0 tx=0x7f7dc402f410 comp rx=0 tx=0).stop 2026-02-20T03:26:54.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.719+0000 7f7dd92c5640 1 -- 10.20.193.28:0/2407333819 shutdown_connections 2026-02-20T03:26:54.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.719+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/2407333819 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7dd4109ed0 0x7f7dd4111a50 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.719+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/2407333819 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dd4105750 0x7f7dd41097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.719+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/2407333819 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd4104da0 0x7f7dd4105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.719+0000 7f7dd92c5640 1 -- 10.20.193.28:0/2407333819 >> 10.20.193.28:0/2407333819 conn(0x7f7dd4100840 msgr2=0x7f7dd4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:54.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.719+0000 7f7dd92c5640 1 -- 10.20.193.28:0/2407333819 shutdown_connections 2026-02-20T03:26:54.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.719+0000 7f7dd92c5640 1 -- 10.20.193.28:0/2407333819 wait complete. 2026-02-20T03:26:54.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd92c5640 1 Processor -- start 2026-02-20T03:26:54.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd92c5640 1 -- start start 2026-02-20T03:26:54.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd92c5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dd4104da0 0x7f7dd419d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd92c5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd4105750 0x7f7dd419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd92c5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7dd4109ed0 0x7f7dd41a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd92c5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4114d50 con 0x7f7dd4109ed0 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd92c5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4114bd0 con 0x7f7dd4105750 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd92c5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd4114ed0 con 0x7f7dd4104da0 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dd4104da0 0x7f7dd419d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.720+0000 7f7dd37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7dd4109ed0 0x7f7dd41a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dd4104da0 0x7f7dd419d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59854/0 (socket says 10.20.193.28:59854) 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/3537458653 learned_addr learned my addr 10.20.193.28:0/3537458653 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd4105750 0x7f7dd419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7dd37fe640 1 -- 10.20.193.28:0/3537458653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dd4104da0 msgr2=0x7f7dd419d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7dd37fe640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dd4104da0 0x7f7dd419d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7dd37fe640 1 -- 10.20.193.28:0/3537458653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd4105750 msgr2=0x7f7dd419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:54.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7dd37fe640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd4105750 0x7f7dd419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7dd37fe640 1 -- 10.20.193.28:0/3537458653 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd41a2150 con 0x7f7dd4109ed0 2026-02-20T03:26:54.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7dd37fe640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7dd4109ed0 0x7f7dd41a19d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400b070 tx=0x7f7dc4009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:54.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7db3fff640 1 -- 10.20.193.28:0/3537458653 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4046070 con 0x7f7dd4109ed0 2026-02-20T03:26:54.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7db3fff640 1 -- 10.20.193.28:0/3537458653 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7dc40076a0 con 0x7f7dd4109ed0 2026-02-20T03:26:54.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.721+0000 7f7db3fff640 1 -- 10.20.193.28:0/3537458653 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40416e0 con 0x7f7dd4109ed0 2026-02-20T03:26:54.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.722+0000 7f7dd92c5640 1 -- 10.20.193.28:0/3537458653 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd41a23e0 con 0x7f7dd4109ed0 2026-02-20T03:26:54.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.722+0000 7f7dd92c5640 1 -- 10.20.193.28:0/3537458653 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd41a9c80 con 0x7f7dd4109ed0 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.724+0000 7f7db3fff640 1 -- 10.20.193.28:0/3537458653 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7dc4007b70 con 0x7f7dd4109ed0 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7ddb7cae00 1 Processor -- start 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7ddb7cae00 1 -- start start 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bcca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bccfe0 0x55dda4bd09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 0x55dda4bd8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dda4b4ce50 con 0x55dda4bcc630 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dda4b1f9c0 con 0x55dda4bd1120 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dda4acd240 con 0x55dda4bccfe0 2026-02-20T03:26:54.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bccfe0 0x55dda4bd09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bccfe0 0x55dda4bd09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59868/0 (socket says 10.20.193.28:59868) 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/2001443390 learned_addr learned my addr 10.20.193.28:0/2001443390 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/2001443390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bcca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/2001443390 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 msgr2=0x55dda4bd8ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/2001443390 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 0x55dda4bd8ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/2001443390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 msgr2=0x55dda4bcca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.725+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/2001443390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bcca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/2001443390 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda4ae0420 con 0x55dda4bccfe0 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/2001443390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bcca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7db3fff640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7da40b0e20 0x7f7da40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/2001443390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bccfe0 0x55dda4bd09f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8007df0 tx=0x7f7dc80107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a90c02e882f88b4c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:54.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7db3fff640 1 -- 10.20.193.28:0/3537458653 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7dc4105240 con 0x7f7dd4109ed0 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7da40b0e20 0x7f7da40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7d9b7fe640 1 -- 10.20.193.28:0/2001443390 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc80042d0 con 0x55dda4bccfe0 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7d9b7fe640 1 -- 10.20.193.28:0/2001443390 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7dc8015030 con 0x55dda4bccfe0 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7d9b7fe640 1 -- 10.20.193.28:0/2001443390 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8011860 con 0x55dda4bccfe0 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/2001443390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bccfe0 msgr2=0x55dda4bd09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/2001443390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bccfe0 0x55dda4bd09f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8007df0 tx=0x7f7dc80107a0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.726+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7da40b0e20 0x7f7da40b32e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4100c60 tx=0x7f7dbc009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.727+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/2001443390 shutdown_connections 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.727+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/2001443390 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 0x55dda4bd8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.727+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/2001443390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bccfe0 0x55dda4bd09f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.727+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/2001443390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bcca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.727+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/2001443390 >> 10.20.193.28:0/2001443390 conn(0x55dda4b8f290 msgr2=0x55dda4bcad30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:54.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.727+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/2001443390 shutdown_connections 2026-02-20T03:26:54.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.727+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/2001443390 wait complete. 2026-02-20T03:26:54.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.728+0000 7f7ddb7cae00 1 -- start start 2026-02-20T03:26:54.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.728+0000 7f7ddb7cae00 1 Processor -- start 2026-02-20T03:26:54.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4be6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4be7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 0x55dda4be54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dda4b1b8f0 con 0x55dda4bcc630 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dda490df50 con 0x55dda4bccfe0 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dda4be5b20 con 0x55dda4bd1120 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4be6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4be6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44390/0 (socket says 10.20.193.28:44390) 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/96333754 learned_addr learned my addr 10.20.193.28:0/96333754 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4be7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd37fe640 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 0x55dda4be54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd27fc640 1 -- 10.20.193.28:0/96333754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 msgr2=0x55dda4be54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:54.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 0x55dda4be54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd27fc640 1 -- 10.20.193.28:0/96333754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 msgr2=0x55dda4be6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4be6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd27fc640 1 -- 10.20.193.28:0/96333754 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda4bde8f0 con 0x55dda4bccfe0 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.729+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4be6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4be7270 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0116c0 tx=0x7f7dbc004830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46422be8ab99f95f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7d98ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7d98ff9640 1 -- 10.20.193.28:0/96333754 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc011c60 con 0x55dda4bccfe0 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/96333754 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda48f0b40 con 0x55dda4bccfe0 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7ddb7cae00 10 client.27626 _ll_register_callbacks cb 0x55dda4b58f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7d98ff9640 1 -- 10.20.193.28:0/96333754 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7dbc011e00 con 0x55dda4bccfe0 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7d98ff9640 1 -- 10.20.193.28:0/96333754 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc01c8a0 con 0x55dda4bccfe0 2026-02-20T03:26:54.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/96333754 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dda4b2d1a0 con 0x55dda4bccfe0 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7d98ff9640 1 -- 10.20.193.28:0/96333754 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7dbc01caa0 con 0x55dda4bccfe0 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7d98ff9640 1 -- 10.20.193.28:0/96333754 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7dbc01cce0 con 0x55dda4bccfe0 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7ddb7cae00 10 client.27626 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.730+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/96333754 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55dda4ada230 con 0x55dda4bccfe0 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.731+0000 7f7d98ff9640 1 -- 10.20.193.28:0/96333754 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7dbc01e910 con 0x55dda4bccfe0 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.731+0000 7f7ddb7cae00 10 client.27626 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.731+0000 7f7ddb7cae00 10 client.27626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.731+0000 7f7ddb7cae00 20 client.27626 populate_metadata read hostname 'trial028' 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.731+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dda4bf5610 0x55dda4bf7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.731+0000 7f7ddb7cae00 4 client.27626 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.731+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/96333754 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dda4b275b0 con 0x55dda4bf5610 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.731+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dda4bf5610 0x55dda4bf7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dda4bf5610 0x55dda4bf7ab0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e06e5be1d8eeac07 server_cookie=9b1a83cce71e6ae6 in_seq=0 out_seq=0 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7d98ff9640 10 client.27626 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7d98ff9640 1 -- 10.20.193.28:0/96333754 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55dda4b275b0 con 0x55dda4bf5610 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7d98ff9640 10 client.27626 handle_command_reply: tid=0 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7ddb7cae00 1 client.27626 shutdown 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/96333754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 msgr2=0x55dda4be7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4be7270 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0116c0 tx=0x7f7dbc004830 comp rx=0 tx=0).stop 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/96333754 shutdown_connections 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dda4bf5610 0x55dda4bf7ab0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 0x55dda4be54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4be7270 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/96333754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4be6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.732+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/96333754 >> 10.20.193.28:0/96333754 conn(0x55dda4b8f290 msgr2=0x55dda4bcf940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:54.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.733+0000 7f7d98ff9640 0 client.27626 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:54.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.733+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/96333754 shutdown_connections 2026-02-20T03:26:54.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.733+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/96333754 wait complete. 2026-02-20T03:26:54.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.733+0000 7f7ddb7cae00 20 client.27626 trim_cache size 0 max 16384 2026-02-20T03:26:54.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.741+0000 7f7ddb7cae00 1 Processor -- start 2026-02-20T03:26:54.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.741+0000 7f7ddb7cae00 1 -- start start 2026-02-20T03:26:54.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.741+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bf7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4bd21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 0x55dda4bfd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7d780126f0 con 0x55dda4bcc630 2026-02-20T03:26:54.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7800ffc0 con 0x55dda4bccfe0 2026-02-20T03:26:54.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7800de10 con 0x55dda4bd1120 2026-02-20T03:26:54.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bf7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd27fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4bd21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 0x55dda4bfd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd27fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4bd21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39070/0 (socket says 10.20.193.28:39070) 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bf7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44400/0 (socket says 10.20.193.28:44400) 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd27fc640 1 -- 10.20.193.28:0/3689841682 learned_addr learned my addr 10.20.193.28:0/3689841682 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/3689841682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 msgr2=0x55dda4bfd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/3689841682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 0x55dda4bfd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/3689841682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 msgr2=0x55dda4bd21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/3689841682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4bd21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/3689841682 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda4bde720 con 0x55dda4bcc630 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/3689841682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bf7620 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8002410 tx=0x7f7dc8004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d08ab5874308293 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7d9affd640 1 -- 10.20.193.28:0/3689841682 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8004550 con 0x55dda4bcc630 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7d9affd640 1 -- 10.20.193.28:0/3689841682 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7dc8002b80 con 0x55dda4bcc630 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.742+0000 7f7d9affd640 1 -- 10.20.193.28:0/3689841682 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8005040 con 0x55dda4bcc630 2026-02-20T03:26:54.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/3689841682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 msgr2=0x55dda4bf7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/3689841682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bf7620 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8002410 tx=0x7f7dc8004260 comp rx=0 tx=0).stop 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/3689841682 shutdown_connections 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/3689841682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bd1120 0x55dda4bfd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/3689841682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bccfe0 0x55dda4bd21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/3689841682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bcc630 0x55dda4bf7620 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/3689841682 >> 10.20.193.28:0/3689841682 conn(0x55dda4b8f290 msgr2=0x55dda4bd1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/3689841682 shutdown_connections 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/3689841682 wait complete. 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 -- start start 2026-02-20T03:26:54.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.743+0000 7f7ddb7cae00 1 Processor -- start 2026-02-20T03:26:54.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bcc630 0x55dda4bed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bccfe0 0x55dda4beb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7ddb7cae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 0x55dda4bebaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7800e480 con 0x55dda4bccfe0 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7800f8f0 con 0x55dda4bd1120 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7ddb7cae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7800eb50 con 0x55dda4bcc630 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bccfe0 0x55dda4beb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bcc630 0x55dda4bed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd37fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 0x55dda4bebaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bcc630 0x55dda4bed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59896/0 (socket says 10.20.193.28:59896) 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd2ffd640 1 -- 10.20.193.28:0/4195865321 learned_addr learned my addr 10.20.193.28:0/4195865321 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd27fc640 1 -- 10.20.193.28:0/4195865321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bcc630 msgr2=0x55dda4bed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bcc630 0x55dda4bed220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd27fc640 1 -- 10.20.193.28:0/4195865321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 msgr2=0x55dda4bebaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 0x55dda4bebaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd27fc640 1 -- 10.20.193.28:0/4195865321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dda47fe870 con 0x55dda4bccfe0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.744+0000 7f7dd37fe640 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 0x55dda4bebaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7dd27fc640 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bccfe0 0x55dda4beb5b0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc004790 tx=0x7f7dbc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb2fcf0612ce33f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7d98ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7d98ff9640 1 -- 10.20.193.28:0/4195865321 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc03e030 con 0x55dda4bccfe0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7d98ff9640 1 -- 10.20.193.28:0/4195865321 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55dda4b2d1a0 con 0x55dda4bccfe0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/4195865321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dda4abf440 con 0x55dda4bccfe0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7d98ff9640 1 -- 10.20.193.28:0/4195865321 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc031670 con 0x55dda4bccfe0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7ddb7cae00 10 client.18717 _ll_register_callbacks cb 0x7f7dbc009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/4195865321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dda4af0810 con 0x55dda4bccfe0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7d98ff9640 1 -- 10.20.193.28:0/4195865321 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7dbc031810 con 0x55dda4bccfe0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7d98ff9640 1 -- 10.20.193.28:0/4195865321 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7dbc031af0 con 0x55dda4bccfe0 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7ddb7cae00 10 client.18717 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:54.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.745+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/4195865321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55dda4bdf410 con 0x55dda4bccfe0 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7d98ff9640 1 -- 10.20.193.28:0/4195865321 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7dbc04b050 con 0x55dda4bccfe0 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7ddb7cae00 10 client.18717 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7ddb7cae00 10 client.18717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7ddb7cae00 20 client.18717 populate_metadata read hostname 'trial028' 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dda4c613c0 0x55dda4c63850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7ddb7cae00 4 client.18717 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/4195865321 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dda4ad1b00 con 0x55dda4c613c0 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dda4c613c0 0x55dda4c63850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7dd2ffd640 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dda4c613c0 0x55dda4c63850 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=334210729f841079 server_cookie=6947c5f1a90b808b in_seq=0 out_seq=0 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.746+0000 7f7d98ff9640 10 client.18717 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7d98ff9640 1 -- 10.20.193.28:0/4195865321 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dda4ad1b00 con 0x55dda4c613c0 2026-02-20T03:26:54.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7d98ff9640 10 client.18717 handle_command_reply: tid=0 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 client.18717 shutdown 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/4195865321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bccfe0 msgr2=0x55dda4beb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bccfe0 0x55dda4beb5b0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc004790 tx=0x7f7dbc02c000 comp rx=0 tx=0).stop 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/4195865321 shutdown_connections 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dda4c613c0 0x55dda4c63850 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dda4bd1120 0x55dda4bebaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dda4bccfe0 0x55dda4beb5b0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 --2- 10.20.193.28:0/4195865321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dda4bcc630 0x55dda4bed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/4195865321 >> 10.20.193.28:0/4195865321 conn(0x55dda4b8f290 msgr2=0x55dda4bc8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7d98ff9640 0 client.18717 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/4195865321 shutdown_connections 2026-02-20T03:26:54.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 1 -- 10.20.193.28:0/4195865321 wait complete. 2026-02-20T03:26:54.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7ddb7cae00 20 client.18717 trim_cache size 0 max 16384 2026-02-20T03:26:54.756 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:26:54.756 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:26:54.756 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:26:54.756 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:26:54.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7dd92c5640 1 -- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7da40b0e20 msgr2=0x7f7da40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:54.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7da40b0e20 0x7f7da40b32e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4100c60 tx=0x7f7dbc009290 comp rx=0 tx=0).stop 2026-02-20T03:26:54.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7dd92c5640 1 -- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7dd4109ed0 msgr2=0x7f7dd41a19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:54.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.747+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7dd4109ed0 0x7f7dd41a19d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f7dc400b070 tx=0x7f7dc4009380 comp rx=0 tx=0).stop 2026-02-20T03:26:54.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.748+0000 7f7dd92c5640 1 -- 10.20.193.28:0/3537458653 shutdown_connections 2026-02-20T03:26:54.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.748+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7da40b0e20 0x7f7da40b32e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.748+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7dd4109ed0 0x7f7dd41a19d0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.748+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7dd4105750 0x7f7dd419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.748+0000 7f7dd92c5640 1 --2- 10.20.193.28:0/3537458653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7dd4104da0 0x7f7dd419d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:54.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.748+0000 7f7dd92c5640 1 -- 10.20.193.28:0/3537458653 >> 10.20.193.28:0/3537458653 conn(0x7f7dd4100840 msgr2=0x7f7dd4101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:54.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.748+0000 7f7dd92c5640 1 -- 10.20.193.28:0/3537458653 shutdown_connections 2026-02-20T03:26:54.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:54.748+0000 7f7dd92c5640 1 -- 10.20.193.28:0/3537458653 wait complete. 2026-02-20T03:26:54.851 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:26:54.852 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:26:55.122 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:55.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.299+0000 7f928edd1640 1 -- 10.20.193.28:0/2745877677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f928810eef0 msgr2=0x7f928810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:55.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.299+0000 7f928edd1640 1 --2- 10.20.193.28:0/2745877677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f928810eef0 0x7f928810f2d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f9278009a30 tx=0x7f927802f220 comp rx=0 tx=0).stop 2026-02-20T03:26:55.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.299+0000 7f928edd1640 1 -- 10.20.193.28:0/2745877677 shutdown_connections 2026-02-20T03:26:55.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.299+0000 7f928edd1640 1 --2- 10.20.193.28:0/2745877677 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9288109ba0 0x7f9288115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:55.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.299+0000 7f928edd1640 1 --2- 10.20.193.28:0/2745877677 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288109220 0x7f9288109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:55.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.299+0000 7f928edd1640 1 --2- 10.20.193.28:0/2745877677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f928810eef0 0x7f928810f2d0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:55.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.299+0000 7f928edd1640 1 -- 10.20.193.28:0/2745877677 >> 10.20.193.28:0/2745877677 conn(0x7f9288078600 msgr2=0x7f928807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:55.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.299+0000 7f928edd1640 1 -- 10.20.193.28:0/2745877677 shutdown_connections 2026-02-20T03:26:55.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.299+0000 7f928edd1640 1 -- 10.20.193.28:0/2745877677 wait complete. 2026-02-20T03:26:55.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.300+0000 7f928edd1640 1 Processor -- start 2026-02-20T03:26:55.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.300+0000 7f928edd1640 1 -- start start 2026-02-20T03:26:55.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.300+0000 7f928edd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288109220 0x7f92881a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:55.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.300+0000 7f928edd1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288109ba0 0x7f92881a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:55.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.300+0000 7f928edd1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f928810eef0 0x7f92881a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:55.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.300+0000 7f928edd1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f92881190b0 con 0x7f9288109220 2026-02-20T03:26:55.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.300+0000 7f928edd1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9288118f30 con 0x7f9288109ba0 2026-02-20T03:26:55.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.300+0000 7f928edd1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9288119230 con 0x7f928810eef0 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.300+0000 7f928ddcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288109220 0x7f92881a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928ddcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288109220 0x7f92881a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44416/0 (socket says 10.20.193.28:44416) 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928ddcf640 1 -- 10.20.193.28:0/1606423489 learned_addr learned my addr 10.20.193.28:0/1606423489 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928e5d0640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f928810eef0 0x7f92881a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928d5ce640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288109ba0 0x7f92881a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928ddcf640 1 -- 10.20.193.28:0/1606423489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f928810eef0 msgr2=0x7f92881a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928ddcf640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f928810eef0 0x7f92881a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928ddcf640 1 -- 10.20.193.28:0/1606423489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288109ba0 msgr2=0x7f92881a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928ddcf640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288109ba0 0x7f92881a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928ddcf640 1 -- 10.20.193.28:0/1606423489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92881a65c0 con 0x7f9288109220 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928ddcf640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288109220 0x7f92881a1570 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f927802f730 tx=0x7f9278004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:55.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f9276ffd640 1 -- 10.20.193.28:0/1606423489 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278004550 con 0x7f9288109220 2026-02-20T03:26:55.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f9276ffd640 1 -- 10.20.193.28:0/1606423489 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9278038e20 con 0x7f9288109220 2026-02-20T03:26:55.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f9276ffd640 1 -- 10.20.193.28:0/1606423489 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9278004c20 con 0x7f9288109220 2026-02-20T03:26:55.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92881a6850 con 0x7f9288109220 2026-02-20T03:26:55.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.301+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92881ae0f0 con 0x7f9288109220 2026-02-20T03:26:55.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.302+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f928810a580 con 0x7f9288109220 2026-02-20T03:26:55.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.304+0000 7f9276ffd640 1 -- 10.20.193.28:0/1606423489 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9278005340 con 0x7f9288109220 2026-02-20T03:26:55.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.306+0000 7f9276ffd640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:55.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.306+0000 7f9276ffd640 1 -- 10.20.193.28:0/1606423489 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f92781052d0 con 0x7f9288109220 2026-02-20T03:26:55.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.306+0000 7f928d5ce640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:55.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.306+0000 7f9276ffd640 1 -- 10.20.193.28:0/1606423489 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f92780cd710 con 0x7f9288109220 2026-02-20T03:26:55.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.306+0000 7f928d5ce640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f927c005e00 tx=0x7f927c005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:55.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.418+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9288110e30 con 0x7f9288109220 2026-02-20T03:26:55.422 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:55 trial028 ceph-mon[38552]: pgmap v549: 129 pgs: 129 active+clean; 169 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 771 KiB/s rd, 1.8 MiB/s wr, 109 op/s 2026-02-20T03:26:55.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.419+0000 7f9276ffd640 1 -- 10.20.193.28:0/1606423489 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11921 (secure 0 0 0) 0x7f92780d13c0 con 0x7f9288109220 2026-02-20T03:26:55.423 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:26:55.423 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T03:25:19:519285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:25:19.519275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:26:55.424 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T03:26:55.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 msgr2=0x7f92640b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:55.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f927c005e00 tx=0x7f927c005d50 comp rx=0 tx=0).stop 2026-02-20T03:26:55.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288109220 msgr2=0x7f92881a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:55.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288109220 0x7f92881a1570 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f927802f730 tx=0x7f9278004360 comp rx=0 tx=0).stop 2026-02-20T03:26:55.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 shutdown_connections 2026-02-20T03:26:55.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:55.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f928810eef0 0x7f92881a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:55.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288109ba0 0x7f92881a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:55.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 --2- 10.20.193.28:0/1606423489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288109220 0x7f92881a1570 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:55.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 >> 10.20.193.28:0/1606423489 conn(0x7f9288078600 msgr2=0x7f9288079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:55.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 shutdown_connections 2026-02-20T03:26:55.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.420+0000 7f928edd1640 1 -- 10.20.193.28:0/1606423489 wait complete. 2026-02-20T03:26:55.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.81 MB/sec execute 508 sec latency 5278.434 ms 2026-02-20T03:26:55.559 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:26:55.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:55 trial126 ceph-mon[38476]: pgmap v549: 129 pgs: 129 active+clean; 169 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 771 KiB/s rd, 1.8 MiB/s wr, 109 op/s 2026-02-20T03:26:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:55 trial177 ceph-mon[43181]: pgmap v549: 129 pgs: 129 active+clean; 169 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 771 KiB/s rd, 1.8 MiB/s wr, 109 op/s 2026-02-20T03:26:55.823 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:56.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.997+0000 7f23dffff640 1 -- 10.20.193.28:0/3546108039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e0109220 msgr2=0x7f23e0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.997+0000 7f23dffff640 1 --2- 10.20.193.28:0/3546108039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e0109220 0x7f23e0109660 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009a30 tx=0x7f23c802f220 comp rx=0 tx=0).stop 2026-02-20T03:26:56.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.997+0000 7f23dffff640 1 -- 10.20.193.28:0/3546108039 shutdown_connections 2026-02-20T03:26:56.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.997+0000 7f23dffff640 1 --2- 10.20.193.28:0/3546108039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e0109ba0 0x7f23e0115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.997+0000 7f23dffff640 1 --2- 10.20.193.28:0/3546108039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e0109220 0x7f23e0109660 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.997+0000 7f23dffff640 1 --2- 10.20.193.28:0/3546108039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e010eef0 0x7f23e010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.997+0000 7f23dffff640 1 -- 10.20.193.28:0/3546108039 >> 10.20.193.28:0/3546108039 conn(0x7f23e0078600 msgr2=0x7f23e007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.997+0000 7f23dffff640 1 -- 10.20.193.28:0/3546108039 shutdown_connections 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.997+0000 7f23dffff640 1 -- 10.20.193.28:0/3546108039 wait complete. 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.998+0000 7f23dffff640 1 Processor -- start 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.998+0000 7f23dffff640 1 -- start start 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.998+0000 7f23dffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e0109220 0x7f23e01a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.998+0000 7f23dffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e0109ba0 0x7f23e01a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.998+0000 7f23dffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e010eef0 0x7f23e01a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.998+0000 7f23dffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0119070 con 0x7f23e010eef0 2026-02-20T03:26:56.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.998+0000 7f23dffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0118ef0 con 0x7f23e0109ba0 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.998+0000 7f23dffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f23e01191f0 con 0x7f23e0109220 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.998+0000 7f23deffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e0109220 0x7f23e01a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23de7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e0109ba0 0x7f23e01a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23deffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e0109220 0x7f23e01a1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:59932/0 (socket says 10.20.193.28:59932) 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23deffd640 1 -- 10.20.193.28:0/2700046875 learned_addr learned my addr 10.20.193.28:0/2700046875 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23de7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e0109ba0 0x7f23e01a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39108/0 (socket says 10.20.193.28:39108) 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23df7fe640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e010eef0 0x7f23e01a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23de7fc640 1 -- 10.20.193.28:0/2700046875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e0109220 msgr2=0x7f23e01a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23de7fc640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e0109220 0x7f23e01a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23de7fc640 1 -- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e010eef0 msgr2=0x7f23e01a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23de7fc640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e010eef0 0x7f23e01a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23de7fc640 1 -- 10.20.193.28:0/2700046875 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e01a6550 con 0x7f23e0109ba0 2026-02-20T03:26:56.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23df7fe640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e010eef0 0x7f23e01a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:56.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:55.999+0000 7f23de7fc640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e0109ba0 0x7f23e01a1a40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009950 tx=0x7f23c8004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.000+0000 7f23e497c640 1 -- 10.20.193.28:0/2700046875 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8038770 con 0x7f23e0109ba0 2026-02-20T03:26:56.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.000+0000 7f23e497c640 1 -- 10.20.193.28:0/2700046875 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23c8038db0 con 0x7f23e0109ba0 2026-02-20T03:26:56.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.000+0000 7f23dffff640 1 -- 10.20.193.28:0/2700046875 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e01a67e0 con 0x7f23e0109ba0 2026-02-20T03:26:56.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.000+0000 7f23e497c640 1 -- 10.20.193.28:0/2700046875 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8041620 con 0x7f23e0109ba0 2026-02-20T03:26:56.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.000+0000 7f23dffff640 1 -- 10.20.193.28:0/2700046875 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e01ae080 con 0x7f23e0109ba0 2026-02-20T03:26:56.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.003+0000 7f23e497c640 1 -- 10.20.193.28:0/2700046875 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f23c8002920 con 0x7f23e0109ba0 2026-02-20T03:26:56.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.003+0000 7f23e7e83e00 1 Processor -- start 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.003+0000 7f23e7e83e00 1 -- start start 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.003+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 0x55f0588fb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.003+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.003+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f5f60 0x55f058901de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f058875e00 con 0x55f0588f55e0 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f058848970 con 0x55f0588f5f60 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f0587f61f0 con 0x55f0588fafb0 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23de7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f5f60 0x55f058901de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48468/0 (socket says 10.20.193.28:48468) 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23deffd640 1 -- 10.20.193.28:0/3624565030 learned_addr learned my addr 10.20.193.28:0/3624565030 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23df7fe640 1 --2- 10.20.193.28:0/3624565030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 0x55f0588fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23de7fc640 1 -- 10.20.193.28:0/3624565030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 msgr2=0x55f0588fb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23de7fc640 1 --2- 10.20.193.28:0/3624565030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 0x55f0588fb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23de7fc640 1 -- 10.20.193.28:0/3624565030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 msgr2=0x55f0588f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23de7fc640 1 --2- 10.20.193.28:0/3624565030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23de7fc640 1 -- 10.20.193.28:0/3624565030 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0588093d0 con 0x55f0588f5f60 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23deffd640 1 --2- 10.20.193.28:0/3624565030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23de7fc640 1 --2- 10.20.193.28:0/3624565030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f5f60 0x55f058901de0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f23c81026e0 tx=0x7f23c810d4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e226128bda8278ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.004+0000 7f23e497c640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b40b0da0 0x7f23b40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23a3fff640 1 -- 10.20.193.28:0/3624565030 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c80c91b0 con 0x55f0588f5f60 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e497c640 1 -- 10.20.193.28:0/2700046875 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f23c81050d0 con 0x7f23e0109ba0 2026-02-20T03:26:56.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23df7fe640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b40b0da0 0x7f23b40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23a3fff640 1 -- 10.20.193.28:0/3624565030 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23c8112030 con 0x55f0588f5f60 2026-02-20T03:26:56.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23a3fff640 1 -- 10.20.193.28:0/3624565030 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c80cc4b0 con 0x55f0588f5f60 2026-02-20T03:26:56.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e7e83e00 1 -- 10.20.193.28:0/3624565030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f5f60 msgr2=0x55f058901de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/3624565030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f5f60 0x55f058901de0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f23c81026e0 tx=0x7f23c810d4b0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e7e83e00 1 -- 10.20.193.28:0/3624565030 shutdown_connections 2026-02-20T03:26:56.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/3624565030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f5f60 0x55f058901de0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/3624565030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/3624565030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 0x55f0588fb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e7e83e00 1 -- 10.20.193.28:0/3624565030 >> 10.20.193.28:0/3624565030 conn(0x55f0588b8240 msgr2=0x55f0588f3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23df7fe640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b40b0da0 0x7f23b40b3260 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f23d0008620 tx=0x7f23d000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e7e83e00 1 -- 10.20.193.28:0/3624565030 shutdown_connections 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.005+0000 7f23e7e83e00 1 -- 10.20.193.28:0/3624565030 wait complete. 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.006+0000 7f23e7e83e00 1 -- start start 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23e7e83e00 1 Processor -- start 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f05890f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 0x55f05890fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 0x55f05890dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f0588448a0 con 0x55f0588f55e0 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f058636f50 con 0x55f0588fafb0 2026-02-20T03:26:56.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f05890e4c0 con 0x55f0588f5f60 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f05890f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23de7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 0x55f05890fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f05890f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48474/0 (socket says 10.20.193.28:48474) 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23df7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 0x55f05890dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23deffd640 1 -- 10.20.193.28:0/1715387683 learned_addr learned my addr 10.20.193.28:0/1715387683 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23de7fc640 1 -- 10.20.193.28:0/1715387683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 msgr2=0x55f05890dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.007+0000 7f23de7fc640 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 0x55f05890dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23de7fc640 1 -- 10.20.193.28:0/1715387683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 msgr2=0x55f05890f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23de7fc640 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f05890f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23de7fc640 1 -- 10.20.193.28:0/1715387683 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0589077f0 con 0x55f0588f5f60 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23de7fc640 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 0x55f05890fb40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f23c8108710 tx=0x7f23c8002cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd03073caf971db4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23a17fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:26:56.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23a17fa640 1 -- 10.20.193.28:0/1715387683 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c80cc6a0 con 0x55f0588f5f60 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23a17fa640 1 -- 10.20.193.28:0/1715387683 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23c8033070 con 0x55f0588f5f60 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23e7e83e00 1 -- 10.20.193.28:0/1715387683 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f058619b40 con 0x55f0588f5f60 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23e7e83e00 10 client.27664 _ll_register_callbacks cb 0x55f058881eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23e7e83e00 1 -- 10.20.193.28:0/1715387683 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f058856150 con 0x55f0588f5f60 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23a17fa640 1 -- 10.20.193.28:0/1715387683 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c80cc8f0 con 0x55f0588f5f60 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23a17fa640 1 -- 10.20.193.28:0/1715387683 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f23c80c8df0 con 0x55f0588f5f60 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23a17fa640 1 -- 10.20.193.28:0/1715387683 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23c80ccb80 con 0x55f0588f5f60 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23e7e83e00 10 client.27664 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.008+0000 7f23e7e83e00 1 -- 10.20.193.28:0/1715387683 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f0588031e0 con 0x55f0588f5f60 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.009+0000 7f23a17fa640 1 -- 10.20.193.28:0/1715387683 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f23c80d3040 con 0x55f0588f5f60 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.009+0000 7f23e7e83e00 10 client.27664 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:56.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.009+0000 7f23e7e83e00 10 client.27664 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.009+0000 7f23e7e83e00 20 client.27664 populate_metadata read hostname 'trial028' 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.009+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f05891d8a0 0x55f05891fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.009+0000 7f23e7e83e00 4 client.27664 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.009+0000 7f23e7e83e00 1 -- 10.20.193.28:0/1715387683 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f058850560 con 0x55f05891d8a0 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.009+0000 7f23deffd640 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f05891d8a0 0x55f05891fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.010+0000 7f23deffd640 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f05891d8a0 0x55f05891fd60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c54dbb35cf6242a server_cookie=42befe118739b09f in_seq=0 out_seq=0 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.010+0000 7f23a17fa640 10 client.27664 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.010+0000 7f23a17fa640 1 -- 10.20.193.28:0/1715387683 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f058850560 con 0x55f05891d8a0 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.010+0000 7f23a17fa640 10 client.27664 handle_command_reply: tid=0 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.010+0000 7f23e7e83e00 1 client.27664 shutdown 2026-02-20T03:26:56.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 -- 10.20.193.28:0/1715387683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 msgr2=0x55f05890fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 0x55f05890fb40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f23c8108710 tx=0x7f23c8002cc0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 -- 10.20.193.28:0/1715387683 shutdown_connections 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 0x55f05890dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 0x55f05890fb40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f05891d8a0 0x55f05891fd60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/1715387683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f05890f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23a17fa640 0 client.27664 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 -- 10.20.193.28:0/1715387683 >> 10.20.193.28:0/1715387683 conn(0x55f0588b8240 msgr2=0x55f0588f43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 -- 10.20.193.28:0/1715387683 shutdown_connections 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 1 -- 10.20.193.28:0/1715387683 wait complete. 2026-02-20T03:26:56.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.011+0000 7f23e7e83e00 20 client.27664 trim_cache size 0 max 16384 2026-02-20T03:26:56.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.017+0000 7f23e7e83e00 1 Processor -- start 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.017+0000 7f23e7e83e00 1 -- start start 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 0x55f0588f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 0x55f0588f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2384012670 con 0x55f0588f55e0 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f238400ff40 con 0x55f0588fafb0 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f238400dd90 con 0x55f0588f5f60 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48478/0 (socket says 10.20.193.28:48478) 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23deffd640 1 -- 10.20.193.28:0/2843551844 learned_addr learned my addr 10.20.193.28:0/2843551844 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23de7fc640 1 --2- 10.20.193.28:0/2843551844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 0x55f0588f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23df7fe640 1 --2- 10.20.193.28:0/2843551844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 0x55f0588f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23deffd640 1 -- 10.20.193.28:0/2843551844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 msgr2=0x55f0588f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23deffd640 1 --2- 10.20.193.28:0/2843551844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 0x55f0588f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23deffd640 1 -- 10.20.193.28:0/2843551844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 msgr2=0x55f0588f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23deffd640 1 --2- 10.20.193.28:0/2843551844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 0x55f0588f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23deffd640 1 -- 10.20.193.28:0/2843551844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f058907620 con 0x55f0588f55e0 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.018+0000 7f23deffd640 1 --2- 10.20.193.28:0/2843551844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f8a20 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x55f0589204e0 tx=0x7f23d4003ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a20e1b5e102c3a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23a37fe640 1 -- 10.20.193.28:0/2843551844 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d401d640 con 0x55f0588f55e0 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23a37fe640 1 -- 10.20.193.28:0/2843551844 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23d40045d0 con 0x55f0588f55e0 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23a37fe640 1 -- 10.20.193.28:0/2843551844 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4010c90 con 0x55f0588f55e0 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2843551844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 msgr2=0x55f0588f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2843551844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f8a20 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x55f0589204e0 tx=0x7f23d4003ac0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2843551844 shutdown_connections 2026-02-20T03:26:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2843551844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588fafb0 0x55f0588f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2843551844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588f5f60 0x55f0588f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2843551844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f55e0 0x55f0588f8a20 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2843551844 >> 10.20.193.28:0/2843551844 conn(0x55f0588b8240 msgr2=0x55f058912c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2843551844 shutdown_connections 2026-02-20T03:26:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2843551844 wait complete. 2026-02-20T03:26:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.019+0000 7f23e7e83e00 1 -- start start 2026-02-20T03:26:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23e7e83e00 1 Processor -- start 2026-02-20T03:26:56.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f55e0 0x55f058918ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f5f60 0x55f058915dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23e7e83e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 0x55f058916300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f238400e400 con 0x55f0588f5f60 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f238400f870 con 0x55f0588f55e0 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23e7e83e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f238400ead0 con 0x55f0588fafb0 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23deffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f55e0 0x55f058918ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23de7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f5f60 0x55f058915dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23deffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f55e0 0x55f058918ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55004/0 (socket says 10.20.193.28:55004) 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23deffd640 1 -- 10.20.193.28:0/2666057085 learned_addr learned my addr 10.20.193.28:0/2666057085 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23df7fe640 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 0x55f058916300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23de7fc640 1 -- 10.20.193.28:0/2666057085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 msgr2=0x55f058916300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23de7fc640 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 0x55f058916300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23de7fc640 1 -- 10.20.193.28:0/2666057085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f55e0 msgr2=0x55f058918ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23de7fc640 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f55e0 0x55f058918ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.020+0000 7f23de7fc640 1 -- 10.20.193.28:0/2666057085 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f058527870 con 0x55f0588f5f60 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23de7fc640 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f5f60 0x55f058915dc0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f23c802f990 tx=0x7f23c802f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef73cd8bf9abd639 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23a17fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23a17fa640 1 -- 10.20.193.28:0/2666057085 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c80c84d0 con 0x55f0588f5f60 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2666057085 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0587e83f0 con 0x55f0588f5f60 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23e7e83e00 10 client.18741 _ll_register_callbacks cb 0x7f23d4009960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2666057085 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23d40045d0 con 0x55f0588f5f60 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23a17fa640 1 -- 10.20.193.28:0/2666057085 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23c8033040 con 0x55f0588f5f60 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23a17fa640 1 -- 10.20.193.28:0/2666057085 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c80c8850 con 0x55f0588f5f60 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23a17fa640 1 -- 10.20.193.28:0/2666057085 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f23c80d5d90 con 0x55f0588f5f60 2026-02-20T03:26:56.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23a17fa640 1 -- 10.20.193.28:0/2666057085 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23c80c8a20 con 0x55f0588f5f60 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23e7e83e00 10 client.18741 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.021+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2666057085 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f058908310 con 0x55f0588f5f60 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.022+0000 7f23a17fa640 1 -- 10.20.193.28:0/2666057085 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f23c80d3040 con 0x55f0588f5f60 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.022+0000 7f23e7e83e00 10 client.18741 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.022+0000 7f23e7e83e00 10 client.18741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.022+0000 7f23e7e83e00 20 client.18741 populate_metadata read hostname 'trial028' 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.022+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f058989fe0 0x55f05898c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.022+0000 7f23e7e83e00 4 client.18741 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.022+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2666057085 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f058850560 con 0x55f058989fe0 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.022+0000 7f23deffd640 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f058989fe0 0x55f05898c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23a17fa640 10 client.18741 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:26:56.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23deffd640 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f058989fe0 0x55f05898c470 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=27f30cb66bc3bc88 server_cookie=8f9fe4705622062 in_seq=0 out_seq=0 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23a17fa640 1 -- 10.20.193.28:0/2666057085 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f058850560 con 0x55f058989fe0 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23a17fa640 10 client.18741 handle_command_reply: tid=0 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 client.18741 shutdown 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2666057085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f5f60 msgr2=0x55f058915dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f5f60 0x55f058915dc0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f23c802f990 tx=0x7f23c802f920 comp rx=0 tx=0).stop 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2666057085 shutdown_connections 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f0588fafb0 0x55f058916300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55f058989fe0 0x55f05898c470 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f0588f5f60 0x55f058915dc0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 --2- 10.20.193.28:0/2666057085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f0588f55e0 0x55f058918ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2666057085 >> 10.20.193.28:0/2666057085 conn(0x55f0588b8240 msgr2=0x55f05890a600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23a17fa640 0 client.18741 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:26:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2666057085 shutdown_connections 2026-02-20T03:26:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 1 -- 10.20.193.28:0/2666057085 wait complete. 2026-02-20T03:26:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23e7e83e00 20 client.18741 trim_cache size 0 max 16384 2026-02-20T03:26:56.032 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:26:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23dffff640 1 -- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b40b0da0 msgr2=0x7f23b40b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23dffff640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b40b0da0 0x7f23b40b3260 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f23d0008620 tx=0x7f23d000b040 comp rx=0 tx=0).stop 2026-02-20T03:26:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23dffff640 1 -- 10.20.193.28:0/2700046875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e0109ba0 msgr2=0x7f23e01a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.023+0000 7f23dffff640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e0109ba0 0x7f23e01a1a40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009950 tx=0x7f23c8004300 comp rx=0 tx=0).stop 2026-02-20T03:26:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.024+0000 7f23dffff640 1 -- 10.20.193.28:0/2700046875 shutdown_connections 2026-02-20T03:26:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.024+0000 7f23dffff640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23b40b0da0 0x7f23b40b3260 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.024+0000 7f23dffff640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23e010eef0 0x7f23e01a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.024+0000 7f23dffff640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23e0109ba0 0x7f23e01a1a40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.024+0000 7f23dffff640 1 --2- 10.20.193.28:0/2700046875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23e0109220 0x7f23e01a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.024+0000 7f23dffff640 1 -- 10.20.193.28:0/2700046875 >> 10.20.193.28:0/2700046875 conn(0x7f23e0078600 msgr2=0x7f23e0079ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.024+0000 7f23dffff640 1 -- 10.20.193.28:0/2700046875 shutdown_connections 2026-02-20T03:26:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.024+0000 7f23dffff640 1 -- 10.20.193.28:0/2700046875 wait complete. 2026-02-20T03:26:56.126 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:26:56.392 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:56.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:56 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1606423489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:56.526 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.80 MB/sec execute 509 sec latency 6278.463 ms 2026-02-20T03:26:56.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 -- 10.20.193.28:0/3841476994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff37c10aac0 msgr2=0x7ff37c10aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 --2- 10.20.193.28:0/3841476994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff37c10aac0 0x7ff37c10aea0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff368009a30 tx=0x7ff36802f220 comp rx=0 tx=0).stop 2026-02-20T03:26:56.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 -- 10.20.193.28:0/3841476994 shutdown_connections 2026-02-20T03:26:56.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 --2- 10.20.193.28:0/3841476994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff37c105350 0x7ff37c111990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 --2- 10.20.193.28:0/3841476994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff37c1049b0 0x7ff37c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 --2- 10.20.193.28:0/3841476994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff37c10aac0 0x7ff37c10aea0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 -- 10.20.193.28:0/3841476994 >> 10.20.193.28:0/3841476994 conn(0x7ff37c100690 msgr2=0x7ff37c102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 -- 10.20.193.28:0/3841476994 shutdown_connections 2026-02-20T03:26:56.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 -- 10.20.193.28:0/3841476994 wait complete. 2026-02-20T03:26:56.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.572+0000 7ff3812a5640 1 Processor -- start 2026-02-20T03:26:56.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff3812a5640 1 -- start start 2026-02-20T03:26:56.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff3812a5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff37c1049b0 0x7ff37c19d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff3812a5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff37c105350 0x7ff37c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff3812a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff37c10aac0 0x7ff37c1a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff3812a5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c114ce0 con 0x7ff37c10aac0 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff3812a5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c114b60 con 0x7ff37c1049b0 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff3812a5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff37c114e60 con 0x7ff37c105350 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff37c105350 0x7ff37c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff37c1049b0 0x7ff37c19d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff37c105350 0x7ff37c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52192/0 (socket says 10.20.193.28:52192) 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37b7fe640 1 -- 10.20.193.28:0/906448323 learned_addr learned my addr 10.20.193.28:0/906448323 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff380aa4640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff37c10aac0 0x7ff37c1a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37b7fe640 1 -- 10.20.193.28:0/906448323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff37c1049b0 msgr2=0x7ff37c19d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37b7fe640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff37c1049b0 0x7ff37c19d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37b7fe640 1 -- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff37c10aac0 msgr2=0x7ff37c1a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37b7fe640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff37c10aac0 0x7ff37c1a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37b7fe640 1 -- 10.20.193.28:0/906448323 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37c1a2170 con 0x7ff37c105350 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff37bfff640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff37c1049b0 0x7ff37c19d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.573+0000 7ff380aa4640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff37c10aac0 0x7ff37c1a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.574+0000 7ff37b7fe640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff37c105350 0x7ff37c19d660 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0027e0 tx=0x7ff36c002cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.574+0000 7ff3797fa640 1 -- 10.20.193.28:0/906448323 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00ed40 con 0x7ff37c105350 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.574+0000 7ff3812a5640 1 -- 10.20.193.28:0/906448323 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff37c1a2460 con 0x7ff37c105350 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.574+0000 7ff3797fa640 1 -- 10.20.193.28:0/906448323 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff36c0108d0 con 0x7ff37c105350 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.574+0000 7ff3797fa640 1 -- 10.20.193.28:0/906448323 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c00f7c0 con 0x7ff37c105350 2026-02-20T03:26:56.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.574+0000 7ff3812a5640 1 -- 10.20.193.28:0/906448323 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff37c1a9ca0 con 0x7ff37c105350 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff384a33e00 1 Processor -- start 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff3797fa640 1 -- 10.20.193.28:0/906448323 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff36c010a80 con 0x7ff37c105350 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff384a33e00 1 -- start start 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3a4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3ac820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff384a33e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ee7e317e00 con 0x55ee7e3a0090 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff384a33e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ee7e2ea970 con 0x55ee7e3a4c80 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff384a33e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ee7e2981f0 con 0x55ee7e3a0a40 2026-02-20T03:26:56.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff380aa4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff380aa4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48508/0 (socket says 10.20.193.28:48508) 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff380aa4640 1 -- 10.20.193.28:0/3088168141 learned_addr learned my addr 10.20.193.28:0/3088168141 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff37bfff640 1 --2- 10.20.193.28:0/3088168141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3a4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.577+0000 7ff37b7fe640 1 --2- 10.20.193.28:0/3088168141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff380aa4640 1 -- 10.20.193.28:0/3088168141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 msgr2=0x55ee7e3a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff380aa4640 1 --2- 10.20.193.28:0/3088168141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3a4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff380aa4640 1 -- 10.20.193.28:0/3088168141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a4c80 msgr2=0x55ee7e3ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff380aa4640 1 --2- 10.20.193.28:0/3088168141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff380aa4640 1 -- 10.20.193.28:0/3088168141 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7e2ab3d0 con 0x55ee7e3a0090 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff380aa4640 1 --2- 10.20.193.28:0/3088168141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a0470 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff3700094f0 tx=0x7ff370009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f79121dcd82a51 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff34cce3640 1 -- 10.20.193.28:0/3088168141 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370019020 con 0x55ee7e3a0090 2026-02-20T03:26:56.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff34cce3640 1 -- 10.20.193.28:0/3088168141 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff370004570 con 0x55ee7e3a0090 2026-02-20T03:26:56.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff34cce3640 1 -- 10.20.193.28:0/3088168141 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37000ec50 con 0x55ee7e3a0090 2026-02-20T03:26:56.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff384a33e00 1 -- 10.20.193.28:0/3088168141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0090 msgr2=0x55ee7e3a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.578+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3088168141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a0470 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ff3700094f0 tx=0x7ff370009920 comp rx=0 tx=0).stop 2026-02-20T03:26:56.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff3797fa640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3500b0e20 0x7ff3500b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff3797fa640 1 -- 10.20.193.28:0/906448323 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ff36c0e0f70 con 0x7ff37c105350 2026-02-20T03:26:56.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff384a33e00 1 -- 10.20.193.28:0/3088168141 shutdown_connections 2026-02-20T03:26:56.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3088168141 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3088168141 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3a4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3088168141 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a0470 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff380aa4640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3500b0e20 0x7ff3500b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff384a33e00 1 -- 10.20.193.28:0/3088168141 >> 10.20.193.28:0/3088168141 conn(0x55ee7e35a240 msgr2=0x55ee7e39e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff384a33e00 1 -- 10.20.193.28:0/3088168141 shutdown_connections 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff384a33e00 1 -- 10.20.193.28:0/3088168141 wait complete. 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.579+0000 7ff380aa4640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3500b0e20 0x7ff3500b32e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff37000efd0 tx=0x7ff370009ac0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.580+0000 7ff384a33e00 1 -- start start 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.580+0000 7ff384a33e00 1 Processor -- start 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff384a33e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ee7e2e68a0 con 0x55ee7e3a4c80 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff384a33e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ee7e0d8f50 con 0x55ee7e3a0090 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff384a33e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ee7e3c1e50 con 0x55ee7e3a0a40 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff37bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff37bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55040/0 (socket says 10.20.193.28:55040) 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff37bfff640 1 -- 10.20.193.28:0/3519961640 learned_addr learned my addr 10.20.193.28:0/3519961640 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff380aa4640 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff37b7fe640 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff380aa4640 1 -- 10.20.193.28:0/3519961640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 msgr2=0x55ee7e3c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff380aa4640 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff380aa4640 1 -- 10.20.193.28:0/3519961640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 msgr2=0x55ee7e3c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff380aa4640 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.581+0000 7ff380aa4640 1 -- 10.20.193.28:0/3519961640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7e39cb30 con 0x55ee7e3a4c80 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff380aa4640 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c16d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff370002790 tx=0x7ff37000e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8167f279992293e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff33dffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff33dffb640 1 -- 10.20.193.28:0/3519961640 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370030070 con 0x55ee7e3a4c80 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff33dffb640 1 -- 10.20.193.28:0/3519961640 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff37002cb20 con 0x55ee7e3a4c80 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff33dffb640 1 -- 10.20.193.28:0/3519961640 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370019030 con 0x55ee7e3a4c80 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff384a33e00 1 -- 10.20.193.28:0/3519961640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7e0bbb40 con 0x55ee7e3a4c80 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff384a33e00 10 client.18753 _ll_register_callbacks cb 0x55ee7e323eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff384a33e00 1 -- 10.20.193.28:0/3519961640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee7e2f8150 con 0x55ee7e3a4c80 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff33dffb640 1 -- 10.20.193.28:0/3519961640 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ff37002c680 con 0x55ee7e3a4c80 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff33dffb640 1 -- 10.20.193.28:0/3519961640 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff37003a060 con 0x55ee7e3a4c80 2026-02-20T03:26:56.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff384a33e00 10 client.18753 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:56.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.582+0000 7ff384a33e00 1 -- 10.20.193.28:0/3519961640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ee7e2a51e0 con 0x55ee7e3a4c80 2026-02-20T03:26:56.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.583+0000 7ff33dffb640 1 -- 10.20.193.28:0/3519961640 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff370029050 con 0x55ee7e3a4c80 2026-02-20T03:26:56.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.583+0000 7ff384a33e00 10 client.18753 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:56.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.583+0000 7ff384a33e00 10 client.18753 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:26:56.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.583+0000 7ff384a33e00 20 client.18753 populate_metadata read hostname 'trial028' 2026-02-20T03:26:56.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.583+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ee7e3d15f0 0x55ee7e3d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.583+0000 7ff384a33e00 4 client.18753 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:56.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.583+0000 7ff384a33e00 1 -- 10.20.193.28:0/3519961640 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee7e2f2560 con 0x55ee7e3d15f0 2026-02-20T03:26:56.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.583+0000 7ff37bfff640 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ee7e3d15f0 0x55ee7e3d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.584+0000 7ff37bfff640 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ee7e3d15f0 0x55ee7e3d39e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ee1e118837d0919 server_cookie=2925e55bc952cc74 in_seq=0 out_seq=0 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.584+0000 7ff33dffb640 10 client.18753 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.584+0000 7ff33dffb640 1 -- 10.20.193.28:0/3519961640 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ee7e2f2560 con 0x55ee7e3d15f0 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.584+0000 7ff33dffb640 10 client.18753 handle_command_reply: tid=0 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.584+0000 7ff384a33e00 1 client.18753 shutdown 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.584+0000 7ff384a33e00 1 -- 10.20.193.28:0/3519961640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 msgr2=0x55ee7e3c16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.584+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c16d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ff370002790 tx=0x7ff37000e7f0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff384a33e00 1 -- 10.20.193.28:0/3519961640 shutdown_connections 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ee7e3d15f0 0x55ee7e3d39e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c16d0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff384a33e00 1 --2- 10.20.193.28:0/3519961640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff33dffb640 0 client.18753 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:26:56.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff384a33e00 1 -- 10.20.193.28:0/3519961640 >> 10.20.193.28:0/3519961640 conn(0x55ee7e35a240 msgr2=0x55ee7e3a5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff384a33e00 1 -- 10.20.193.28:0/3519961640 shutdown_connections 2026-02-20T03:26:56.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff384a33e00 1 -- 10.20.193.28:0/3519961640 wait complete. 2026-02-20T03:26:56.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.585+0000 7ff384a33e00 20 client.18753 trim_cache size 0 max 16384 2026-02-20T03:26:56.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.591+0000 7ff384a33e00 1 Processor -- start 2026-02-20T03:26:56.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.591+0000 7ff384a33e00 1 -- start start 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3bf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3a7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff384a33e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff320012770 con 0x55ee7e3a0a40 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff384a33e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff320010040 con 0x55ee7e3a0090 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff384a33e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff32000de90 con 0x55ee7e3a4c80 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55048/0 (socket says 10.20.193.28:55048) 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37bfff640 1 -- 10.20.193.28:0/180251779 learned_addr learned my addr 10.20.193.28:0/180251779 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37b7fe640 1 --2- 10.20.193.28:0/180251779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:56 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1606423489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:56.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37bfff640 1 -- 10.20.193.28:0/180251779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a4c80 msgr2=0x55ee7e3a7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37bfff640 1 --2- 10.20.193.28:0/180251779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3a7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37bfff640 1 -- 10.20.193.28:0/180251779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0a40 msgr2=0x55ee7e3bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37bfff640 1 --2- 10.20.193.28:0/180251779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37bfff640 1 -- 10.20.193.28:0/180251779 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7e39c960 con 0x55ee7e3a0090 2026-02-20T03:26:56.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff37bfff640 1 --2- 10.20.193.28:0/180251779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a91b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff36802f730 tx=0x7ff368005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339ba1448e836389 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff33ffff640 1 -- 10.20.193.28:0/180251779 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36802fc80 con 0x55ee7e3a0090 2026-02-20T03:26:56.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff33ffff640 1 -- 10.20.193.28:0/180251779 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff368033040 con 0x55ee7e3a0090 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.592+0000 7ff33ffff640 1 -- 10.20.193.28:0/180251779 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368004c60 con 0x55ee7e3a0090 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 -- 10.20.193.28:0/180251779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 msgr2=0x55ee7e3a91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 --2- 10.20.193.28:0/180251779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a91b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff36802f730 tx=0x7ff368005e50 comp rx=0 tx=0).stop 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 -- 10.20.193.28:0/180251779 shutdown_connections 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 --2- 10.20.193.28:0/180251779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3a7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 --2- 10.20.193.28:0/180251779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 --2- 10.20.193.28:0/180251779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3a91b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 -- 10.20.193.28:0/180251779 >> 10.20.193.28:0/180251779 conn(0x55ee7e35a240 msgr2=0x55ee7e3c0640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 -- 10.20.193.28:0/180251779 shutdown_connections 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 -- 10.20.193.28:0/180251779 wait complete. 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.593+0000 7ff384a33e00 1 -- start start 2026-02-20T03:26:56.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff384a33e00 1 Processor -- start 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff384a33e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff384a33e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff32000e500 con 0x55ee7e3a4c80 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff384a33e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff32000f970 con 0x55ee7e3a0090 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff384a33e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff32000ebd0 con 0x55ee7e3a0a40 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff37bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff380aa4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff37bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55056/0 (socket says 10.20.193.28:55056) 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff37bfff640 1 -- 10.20.193.28:0/1556182062 learned_addr learned my addr 10.20.193.28:0/1556182062 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff37b7fe640 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff37bfff640 1 -- 10.20.193.28:0/1556182062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 msgr2=0x55ee7e3c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff37bfff640 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff37bfff640 1 -- 10.20.193.28:0/1556182062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 msgr2=0x55ee7e3c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff37bfff640 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff37bfff640 1 -- 10.20.193.28:0/1556182062 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7dfc9870 con 0x55ee7e3a0090 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.594+0000 7ff380aa4640 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff37bfff640 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c9680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff368009950 tx=0x7ff3680047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85d8fc1039b76176 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff33dffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff33dffb640 1 -- 10.20.193.28:0/1556182062 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368059070 con 0x55ee7e3a0090 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff33dffb640 1 -- 10.20.193.28:0/1556182062 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff36802fc80 con 0x55ee7e3a0090 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff33dffb640 1 -- 10.20.193.28:0/1556182062 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368050040 con 0x55ee7e3a0090 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff384a33e00 1 -- 10.20.193.28:0/1556182062 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7e28a3f0 con 0x55ee7e3a0090 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff384a33e00 10 client.27674 _ll_register_callbacks cb 0x7ff3700097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:56.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff384a33e00 1 -- 10.20.193.28:0/1556182062 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee7e29cab0 con 0x55ee7e3a0090 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff33dffb640 1 -- 10.20.193.28:0/1556182062 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ff3680049e0 con 0x55ee7e3a0090 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff33dffb640 1 -- 10.20.193.28:0/1556182062 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff368004030 con 0x55ee7e3a0090 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff384a33e00 10 client.27674 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.595+0000 7ff384a33e00 1 -- 10.20.193.28:0/1556182062 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ee7e39d650 con 0x55ee7e3a0090 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff33dffb640 1 -- 10.20.193.28:0/1556182062 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7ff368053070 con 0x55ee7e3a0090 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff384a33e00 10 client.27674 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff384a33e00 10 client.27674 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff384a33e00 20 client.27674 populate_metadata read hostname 'trial028' 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff384a33e00 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ee7e43d540 0x55ee7e43fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff384a33e00 4 client.27674 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff384a33e00 1 -- 10.20.193.28:0/1556182062 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff370004570 con 0x55ee7e43d540 2026-02-20T03:26:56.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff37b7fe640 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ee7e43d540 0x55ee7e43fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff37b7fe640 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ee7e43d540 0x55ee7e43fa00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f9c49c8fcf0875c server_cookie=9b70892804b9888c in_seq=0 out_seq=0 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.596+0000 7ff33dffb640 10 client.27674 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff33dffb640 1 -- 10.20.193.28:0/1556182062 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff370004570 con 0x55ee7e43d540 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff33dffb640 10 client.27674 handle_command_reply: tid=0 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 client.27674 shutdown 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 -- 10.20.193.28:0/1556182062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 msgr2=0x55ee7e3c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c9680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff368009950 tx=0x7ff3680047c0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 -- 10.20.193.28:0/1556182062 shutdown_connections 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55ee7e43d540 0x55ee7e43fa00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ee7e3a4c80 0x55ee7e3c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ee7e3a0a40 0x55ee7e3c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 --2- 10.20.193.28:0/1556182062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ee7e3a0090 0x55ee7e3c9680 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 -- 10.20.193.28:0/1556182062 >> 10.20.193.28:0/1556182062 conn(0x55ee7e35a240 msgr2=0x55ee7e3be170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff33dffb640 0 client.27674 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:26:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 -- 10.20.193.28:0/1556182062 shutdown_connections 2026-02-20T03:26:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 1 -- 10.20.193.28:0/1556182062 wait complete. 2026-02-20T03:26:56.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff384a33e00 20 client.27674 trim_cache size 0 max 16384 2026-02-20T03:26:56.606 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:26:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff3812a5640 1 -- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3500b0e20 msgr2=0x7ff3500b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.597+0000 7ff3812a5640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3500b0e20 0x7ff3500b32e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff37000efd0 tx=0x7ff370009ac0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 -- 10.20.193.28:0/906448323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff37c105350 msgr2=0x7ff37c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:56.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff37c105350 0x7ff37c19d660 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0027e0 tx=0x7ff36c002cb0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 -- 10.20.193.28:0/906448323 shutdown_connections 2026-02-20T03:26:56.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3500b0e20 0x7ff3500b32e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff37c10aac0 0x7ff37c1a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff37c105350 0x7ff37c19d660 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 --2- 10.20.193.28:0/906448323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff37c1049b0 0x7ff37c19d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:56.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 -- 10.20.193.28:0/906448323 >> 10.20.193.28:0/906448323 conn(0x7ff37c100690 msgr2=0x7ff37c100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:56.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 -- 10.20.193.28:0/906448323 shutdown_connections 2026-02-20T03:26:56.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:56.598+0000 7ff3812a5640 1 -- 10.20.193.28:0/906448323 wait complete. 2026-02-20T03:26:56.697 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:26:56.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:56 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1606423489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:26:56.963 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:57.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.150+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2353826403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 msgr2=0x7f9dc8115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:57.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.150+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2353826403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 0x7f9dc8115d10 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009f90 tx=0x7f9dbc02f390 comp rx=0 tx=0).stop 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.150+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2353826403 shutdown_connections 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.150+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2353826403 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 0x7f9dc8115d10 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.150+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2353826403 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9dc8109220 0x7f9dc8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.150+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2353826403 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9dc810eef0 0x7f9dc810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.150+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2353826403 >> 10.20.193.28:0/2353826403 conn(0x7f9dc8078600 msgr2=0x7f9dc807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.150+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2353826403 shutdown_connections 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.150+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2353826403 wait complete. 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dcd54e640 1 Processor -- start 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dcd54e640 1 -- start start 2026-02-20T03:26:57.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dcd54e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9dc8109220 0x7f9dc8074680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dcd54e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 0x7f9dc8074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dcd54e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9dc810eef0 0x7f9dc806d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dcd54e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc8119090 con 0x7f9dc8109ba0 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dcd54e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc8118f10 con 0x7f9dc8109220 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dcd54e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc8119210 con 0x7f9dc810eef0 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dc77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 0x7f9dc8074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dc7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9dc8109220 0x7f9dc8074680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dc77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 0x7f9dc8074bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48554/0 (socket says 10.20.193.28:48554) 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dc77fe640 1 -- 10.20.193.28:0/2879247023 learned_addr learned my addr 10.20.193.28:0/2879247023 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:57.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.151+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9dc810eef0 0x7f9dc806d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dc77fe640 1 -- 10.20.193.28:0/2879247023 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9dc810eef0 msgr2=0x7f9dc806d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:57.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9dc810eef0 0x7f9dc806d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dc77fe640 1 -- 10.20.193.28:0/2879247023 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9dc8109220 msgr2=0x7f9dc8074680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:57.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9dc8109220 0x7f9dc8074680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dc77fe640 1 -- 10.20.193.28:0/2879247023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc806e0a0 con 0x7f9dc8109ba0 2026-02-20T03:26:57.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 0x7f9dc8074bc0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f9db80027e0 tx=0x7f9db8002cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:57.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dc57fa640 1 -- 10.20.193.28:0/2879247023 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db800ed40 con 0x7f9dc8109ba0 2026-02-20T03:26:57.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dc57fa640 1 -- 10.20.193.28:0/2879247023 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9db80108d0 con 0x7f9dc8109ba0 2026-02-20T03:26:57.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dc57fa640 1 -- 10.20.193.28:0/2879247023 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db800f7e0 con 0x7f9dc8109ba0 2026-02-20T03:26:57.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2879247023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc806e390 con 0x7f9dc8109ba0 2026-02-20T03:26:57.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.152+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2879247023 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc8072380 con 0x7f9dc8109ba0 2026-02-20T03:26:57.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.155+0000 7f9dc57fa640 1 -- 10.20.193.28:0/2879247023 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9db8010a80 con 0x7f9dc8109ba0 2026-02-20T03:26:57.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dd0cdce00 1 Processor -- start 2026-02-20T03:26:57.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dd0cdce00 1 -- start start 2026-02-20T03:26:57.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f05390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2effa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2f0bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dd0cdce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5638b2e7fe00 con 0x5638b2efff60 2026-02-20T03:26:57.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dd0cdce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5638b2e52970 con 0x5638b2eff5e0 2026-02-20T03:26:57.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dd0cdce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5638b2e001f0 con 0x5638b2f04fb0 2026-02-20T03:26:57.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2f0bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2effa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2f0bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48564/0 (socket says 10.20.193.28:48564) 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc77fe640 1 -- 10.20.193.28:0/1222932530 learned_addr learned my addr 10.20.193.28:0/1222932530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/1222932530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2effa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55092/0 (socket says 10.20.193.28:55092) 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/1222932530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f05390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc77fe640 1 -- 10.20.193.28:0/1222932530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 msgr2=0x5638b2f05390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/1222932530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f05390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc77fe640 1 -- 10.20.193.28:0/1222932530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 msgr2=0x5638b2effa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/1222932530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2effa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc77fe640 1 -- 10.20.193.28:0/1222932530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b2e133d0 con 0x5638b2efff60 2026-02-20T03:26:57.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.156+0000 7f9dc57fa640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d9c0b0e20 0x7f9d9c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/1222932530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2f0bde0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9db80e90e0 tx=0x7f9db80e91e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec97ca02105a022 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dc57fa640 1 -- 10.20.193.28:0/2879247023 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f9db80e10d0 con 0x7f9dc8109ba0 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9d98ce3640 1 -- 10.20.193.28:0/1222932530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80a4a20 con 0x5638b2efff60 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9d98ce3640 1 -- 10.20.193.28:0/1222932530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9db8010df0 con 0x5638b2efff60 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9d98ce3640 1 -- 10.20.193.28:0/1222932530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80a82d0 con 0x5638b2efff60 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d9c0b0e20 0x7f9d9c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1222932530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 msgr2=0x5638b2f0bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1222932530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2f0bde0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9db80e90e0 tx=0x7f9db80e91e0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1222932530 shutdown_connections 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1222932530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2f0bde0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1222932530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2effa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1222932530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f05390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1222932530 >> 10.20.193.28:0/1222932530 conn(0x5638b2ec2240 msgr2=0x5638b2efdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1222932530 shutdown_connections 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1222932530 wait complete. 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.157+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d9c0b0e20 0x7f9d9c0b32e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009da0 tx=0x7f9dbc005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.158+0000 7f9dd0cdce00 1 -- start start 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.158+0000 7f9dd0cdce00 1 Processor -- start 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2eff5e0 0x5638b2f1a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f187d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dd0cdce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5638b2e4e8a0 con 0x5638b2eff5e0 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dd0cdce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5638b2c40f50 con 0x5638b2efff60 2026-02-20T03:26:57.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dd0cdce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5638b2f18e10 con 0x5638b2f04fb0 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dc7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2eff5e0 0x5638b2f1a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dccd4d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f187d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dc7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2eff5e0 0x5638b2f1a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48568/0 (socket says 10.20.193.28:48568) 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dc7fff640 1 -- 10.20.193.28:0/1664219571 learned_addr learned my addr 10.20.193.28:0/1664219571 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dc77fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dccd4d640 1 -- 10.20.193.28:0/1664219571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 msgr2=0x5638b2f1a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dccd4d640 1 -- 10.20.193.28:0/1664219571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2eff5e0 msgr2=0x5638b2f1a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2eff5e0 0x5638b2f1a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dccd4d640 1 -- 10.20.193.28:0/1664219571 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b2f11a80 con 0x5638b2f04fb0 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.159+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2eff5e0 0x5638b2f1a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:57.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f187d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc02f8a0 tx=0x7f9dbc02f390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6565010c7ebd635d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9d89ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9d89ffb640 1 -- 10.20.193.28:0/1664219571 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc052070 con 0x5638b2f04fb0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1664219571 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b2c23b40 con 0x5638b2f04fb0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9dd0cdce00 10 client.27697 _ll_register_callbacks cb 0x5638b2e8beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1664219571 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638b2e5a560 con 0x5638b2f04fb0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9d89ffb640 1 -- 10.20.193.28:0/1664219571 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9dbc033040 con 0x5638b2f04fb0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9d89ffb640 1 -- 10.20.193.28:0/1664219571 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc043440 con 0x5638b2f04fb0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9d89ffb640 1 -- 10.20.193.28:0/1664219571 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f9dbc0435e0 con 0x5638b2f04fb0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9d89ffb640 1 -- 10.20.193.28:0/1664219571 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9dbc0438c0 con 0x5638b2f04fb0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9dd0cdce00 10 client.27697 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.160+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1664219571 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5638b2e0d1e0 con 0x5638b2f04fb0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.161+0000 7f9d89ffb640 1 -- 10.20.193.28:0/1664219571 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9dbc05f060 con 0x5638b2f04fb0 2026-02-20T03:26:57.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.161+0000 7f9dd0cdce00 10 client.27697 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.161+0000 7f9dd0cdce00 10 client.27697 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.161+0000 7f9dd0cdce00 20 client.27697 populate_metadata read hostname 'trial028' 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.161+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5638b2f28810 0x5638b2f2ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.161+0000 7f9dd0cdce00 4 client.27697 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.161+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1664219571 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638b2dd4a30 con 0x5638b2f28810 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.161+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5638b2f28810 0x5638b2f2ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5638b2f28810 0x5638b2f2ac60 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eb11ed161f97460 server_cookie=c7cfa30d02782634 in_seq=0 out_seq=0 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9d89ffb640 10 client.27697 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9d89ffb640 1 -- 10.20.193.28:0/1664219571 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5638b2dd4a30 con 0x5638b2f28810 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9d89ffb640 10 client.27697 handle_command_reply: tid=0 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 client.27697 shutdown 2026-02-20T03:26:57.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1664219571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 msgr2=0x5638b2f187d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f187d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc02f8a0 tx=0x7f9dbc02f390 comp rx=0 tx=0).stop 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1664219571 shutdown_connections 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5638b2f28810 0x5638b2f2ac60 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f187d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9d89ffb640 0 client.27697 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/1664219571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2eff5e0 0x5638b2f1a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1664219571 >> 10.20.193.28:0/1664219571 conn(0x5638b2ec2240 msgr2=0x5638b2efe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.162+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1664219571 shutdown_connections 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.163+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/1664219571 wait complete. 2026-02-20T03:26:57.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.163+0000 7f9dd0cdce00 20 client.27697 trim_cache size 0 max 16384 2026-02-20T03:26:57.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.170+0000 7f9dd0cdce00 1 Processor -- start 2026-02-20T03:26:57.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.170+0000 7f9dd0cdce00 1 -- start start 2026-02-20T03:26:57.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.170+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2efe4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.170+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2efea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.170+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f30570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2efe4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dd0cdce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c0126f0 con 0x5638b2efff60 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dd0cdce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c00ffc0 con 0x5638b2eff5e0 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dd0cdce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c00de10 con 0x5638b2f04fb0 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2efe4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55118/0 (socket says 10.20.193.28:55118) 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc7fff640 1 -- 10.20.193.28:0/3516556738 learned_addr learned my addr 10.20.193.28:0/3516556738 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/3516556738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2efea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/3516556738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f30570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc7fff640 1 -- 10.20.193.28:0/3516556738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 msgr2=0x5638b2f30570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/3516556738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f30570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc7fff640 1 -- 10.20.193.28:0/3516556738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 msgr2=0x5638b2efea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:57.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/3516556738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2efea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc7fff640 1 -- 10.20.193.28:0/3516556738 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b2f118b0 con 0x5638b2eff5e0 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/3516556738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2efe4d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5638b2f2b510 tx=0x7f9db4003ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894d13d6a170d7e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9d8bfff640 1 -- 10.20.193.28:0/3516556738 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4016030 con 0x5638b2eff5e0 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9d8bfff640 1 -- 10.20.193.28:0/3516556738 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9db401eb90 con 0x5638b2eff5e0 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.171+0000 7f9d8bfff640 1 -- 10.20.193.28:0/3516556738 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4010d80 con 0x5638b2eff5e0 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.172+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3516556738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 msgr2=0x5638b2efe4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.172+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3516556738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2efe4d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x5638b2f2b510 tx=0x7f9db4003ac0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.172+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3516556738 shutdown_connections 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.172+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3516556738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2f04fb0 0x5638b2f30570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.172+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3516556738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2efff60 0x5638b2efea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.172+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3516556738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2eff5e0 0x5638b2efe4d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.172+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3516556738 >> 10.20.193.28:0/3516556738 conn(0x5638b2ec2240 msgr2=0x5638b2f17010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.172+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3516556738 shutdown_connections 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.172+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3516556738 wait complete. 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dd0cdce00 1 -- start start 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dd0cdce00 1 Processor -- start 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2eff5e0 0x5638b2f20470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dd0cdce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2f04fb0 0x5638b2f1d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dc77fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dc77fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55134/0 (socket says 10.20.193.28:55134) 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c00e480 con 0x5638b2f04fb0 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c00f8f0 con 0x5638b2efff60 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6c00eb50 con 0x5638b2eff5e0 2026-02-20T03:26:57.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.173+0000 7f9dc77fe640 1 -- 10.20.193.28:0/3649702616 learned_addr learned my addr 10.20.193.28:0/3649702616 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2f04fb0 0x5638b2f1d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2eff5e0 0x5638b2f20470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dc77fe640 1 -- 10.20.193.28:0/3649702616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2eff5e0 msgr2=0x5638b2f20470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2eff5e0 0x5638b2f20470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dc77fe640 1 -- 10.20.193.28:0/3649702616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2f04fb0 msgr2=0x5638b2f1d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2f04fb0 0x5638b2f1d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dc77fe640 1 -- 10.20.193.28:0/3649702616 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638b2b31870 con 0x5638b2efff60 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dccd4d640 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2f04fb0 0x5638b2f1d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dc77fe640 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1cef0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9db800e720 tx=0x7f9db80e1350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf5de39bdc9f7094 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9d89ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9d89ffb640 1 -- 10.20.193.28:0/3649702616 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80a84b0 con 0x5638b2efff60 2026-02-20T03:26:57.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9d89ffb640 1 -- 10.20.193.28:0/3649702616 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9db8009620 con 0x5638b2efff60 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9d89ffb640 1 -- 10.20.193.28:0/3649702616 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80a8b80 con 0x5638b2efff60 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.174+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638b2df23f0 con 0x5638b2efff60 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9d89ffb640 1 -- 10.20.193.28:0/3649702616 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f9db80b1b80 con 0x5638b2efff60 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 10 client.27692 _ll_register_callbacks cb 0x7f9db4005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638b2bc2990 con 0x5638b2efff60 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9d89ffb640 1 -- 10.20.193.28:0/3649702616 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9db80a4a20 con 0x5638b2efff60 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 10 client.27692 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5638b2f125a0 con 0x5638b2efff60 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9d89ffb640 1 -- 10.20.193.28:0/3649702616 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9db80af020 con 0x5638b2efff60 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 10 client.27692 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 10 client.27692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 20 client.27692 populate_metadata read hostname 'trial028' 2026-02-20T03:26:57.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5638b2f940d0 0x5638b2f96570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:57.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 4 client.27692 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:26:57.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5638b2e60150 con 0x5638b2f940d0 2026-02-20T03:26:57.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.175+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5638b2f940d0 0x5638b2f96570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:57.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dc7fff640 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5638b2f940d0 0x5638b2f96570 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=544b5cefee590a70 server_cookie=c969c537588185fc in_seq=0 out_seq=0 2026-02-20T03:26:57.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9d89ffb640 10 client.27692 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:57.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9d89ffb640 1 -- 10.20.193.28:0/3649702616 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5638b2e60150 con 0x5638b2f940d0 2026-02-20T03:26:57.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9d89ffb640 10 client.27692 handle_command_reply: tid=0 2026-02-20T03:26:57.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 client.27692 shutdown 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 msgr2=0x5638b2f1cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1cef0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9db800e720 tx=0x7f9db80e1350 comp rx=0 tx=0).stop 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 shutdown_connections 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5638b2f940d0 0x5638b2f96570 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5638b2f04fb0 0x5638b2f1d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5638b2efff60 0x5638b2f1cef0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 --2- 10.20.193.28:0/3649702616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5638b2eff5e0 0x5638b2f20470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9d89ffb640 0 client.27692 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 >> 10.20.193.28:0/3649702616 conn(0x5638b2ec2240 msgr2=0x5638b2f28bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 shutdown_connections 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 1 -- 10.20.193.28:0/3649702616 wait complete. 2026-02-20T03:26:57.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.176+0000 7f9dd0cdce00 20 client.27692 trim_cache size 0 max 16384 2026-02-20T03:26:57.187 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d9c0b0e20 msgr2=0x7f9d9c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d9c0b0e20 0x7f9d9c0b32e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009da0 tx=0x7f9dbc005bd0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 msgr2=0x7f9dc8074bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 0x7f9dc8074bc0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f9db80027e0 tx=0x7f9db8002cb0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2879247023 shutdown_connections 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d9c0b0e20 0x7f9d9c0b32e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9dc810eef0 0x7f9dc806d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9dc8109ba0 0x7f9dc8074bc0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 --2- 10.20.193.28:0/2879247023 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9dc8109220 0x7f9dc8074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:57.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2879247023 >> 10.20.193.28:0/2879247023 conn(0x7f9dc8078600 msgr2=0x7f9dc8079d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:57.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2879247023 shutdown_connections 2026-02-20T03:26:57.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:57.177+0000 7f9dcd54e640 1 -- 10.20.193.28:0/2879247023 wait complete. 2026-02-20T03:26:57.276 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:57 trial028 ceph-mon[38552]: pgmap v550: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 754 KiB/s rd, 1.5 MiB/s wr, 112 op/s 2026-02-20T03:26:57.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.78 MB/sec execute 510 sec latency 7278.501 ms 2026-02-20T03:26:57.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:57 trial126 ceph-mon[38476]: pgmap v550: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 754 KiB/s rd, 1.5 MiB/s wr, 112 op/s 2026-02-20T03:26:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:57 trial177 ceph-mon[43181]: pgmap v550: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 754 KiB/s rd, 1.5 MiB/s wr, 112 op/s 2026-02-20T03:26:58.279 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:26:58.279 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:26:58.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.77 MB/sec execute 511 sec latency 8278.535 ms 2026-02-20T03:26:58.542 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:58.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.722+0000 7f565b577640 1 -- 10.20.193.28:0/4041815728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c105320 msgr2=0x7f565c111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:58.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.722+0000 7f565b577640 1 --2- 10.20.193.28:0/4041815728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c105320 0x7f565c111850 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f564c00b0d0 tx=0x7f564c02f450 comp rx=0 tx=0).stop 2026-02-20T03:26:58.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.722+0000 7f565b577640 1 -- 10.20.193.28:0/4041815728 shutdown_connections 2026-02-20T03:26:58.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.722+0000 7f565b577640 1 --2- 10.20.193.28:0/4041815728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c105320 0x7f565c111850 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.722+0000 7f565b577640 1 --2- 10.20.193.28:0/4041815728 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f565c104980 0x7f565c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.722+0000 7f565b577640 1 --2- 10.20.193.28:0/4041815728 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f565c10a980 0x7f565c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.722+0000 7f565b577640 1 -- 10.20.193.28:0/4041815728 >> 10.20.193.28:0/4041815728 conn(0x7f565c100680 msgr2=0x7f565c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:58.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.722+0000 7f565b577640 1 -- 10.20.193.28:0/4041815728 shutdown_connections 2026-02-20T03:26:58.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.722+0000 7f565b577640 1 -- 10.20.193.28:0/4041815728 wait complete. 2026-02-20T03:26:58.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.723+0000 7f565b577640 1 Processor -- start 2026-02-20T03:26:58.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.723+0000 7f565b577640 1 -- start start 2026-02-20T03:26:58.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.723+0000 7f565b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c104980 0x7f565c19d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.723+0000 7f565b577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f565c105320 0x7f565c19d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.723+0000 7f565b577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f565c10a980 0x7f565c1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.723+0000 7f565b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f565c114bf0 con 0x7f565c104980 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.723+0000 7f565b577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f565c114a70 con 0x7f565c10a980 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.723+0000 7f565b577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f565c114d70 con 0x7f565c105320 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c104980 0x7f565c19d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f5659d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f565c105320 0x7f565c19d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c104980 0x7f565c19d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48592/0 (socket says 10.20.193.28:48592) 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565a575640 1 -- 10.20.193.28:0/2976351126 learned_addr learned my addr 10.20.193.28:0/2976351126 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565ad76640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f565c10a980 0x7f565c1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565a575640 1 -- 10.20.193.28:0/2976351126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f565c105320 msgr2=0x7f565c19d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:58.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565a575640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f565c105320 0x7f565c19d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565a575640 1 -- 10.20.193.28:0/2976351126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f565c10a980 msgr2=0x7f565c1a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565a575640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f565c10a980 0x7f565c1a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565a575640 1 -- 10.20.193.28:0/2976351126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f565c1a2080 con 0x7f565c104980 2026-02-20T03:26:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f565a575640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c104980 0x7f565c19d030 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f565000ea10 tx=0x7f565000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.724+0000 7f56437fe640 1 -- 10.20.193.28:0/2976351126 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565000ce50 con 0x7f565c104980 2026-02-20T03:26:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.725+0000 7f56437fe640 1 -- 10.20.193.28:0/2976351126 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5650004570 con 0x7f565c104980 2026-02-20T03:26:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.725+0000 7f56437fe640 1 -- 10.20.193.28:0/2976351126 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650010690 con 0x7f565c104980 2026-02-20T03:26:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.725+0000 7f565b577640 1 -- 10.20.193.28:0/2976351126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f565c1a2370 con 0x7f565c104980 2026-02-20T03:26:58.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.725+0000 7f565b577640 1 -- 10.20.193.28:0/2976351126 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f565c1a9bb0 con 0x7f565c104980 2026-02-20T03:26:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.727+0000 7f56437fe640 1 -- 10.20.193.28:0/2976351126 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5650020030 con 0x7f565c104980 2026-02-20T03:26:58.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f56632dde00 1 Processor -- start 2026-02-20T03:26:58.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f56632dde00 1 -- start start 2026-02-20T03:26:58.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f56632dde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f56632dde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 0x559d0f6a4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f56632dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f6a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f56632dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d0f5f2c00 con 0x559d0f6a4b60 2026-02-20T03:26:58.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f56632dde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559d0f5a03c0 con 0x559d0f6a0a70 2026-02-20T03:26:58.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f56632dde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559d0f5eeb30 con 0x559d0f6a00c0 2026-02-20T03:26:58.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f5659d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f6a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f565ad76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f5659d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f6a4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48608/0 (socket says 10.20.193.28:48608) 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f5659d74640 1 -- 10.20.193.28:0/4162538872 learned_addr learned my addr 10.20.193.28:0/4162538872 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.728+0000 7f565a575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 0x559d0f6a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f5659d74640 1 -- 10.20.193.28:0/4162538872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 msgr2=0x559d0f6a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f5659d74640 1 --2- 10.20.193.28:0/4162538872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f5659d74640 1 -- 10.20.193.28:0/4162538872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 msgr2=0x559d0f6a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f5659d74640 1 --2- 10.20.193.28:0/4162538872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 0x559d0f6a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f5659d74640 1 -- 10.20.193.28:0/4162538872 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0f599840 con 0x559d0f6a4b60 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f5659d74640 1 --2- 10.20.193.28:0/4162538872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f6a4fd0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f5644007d00 tx=0x7f56440107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb53f87f9e722258 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f56437fe640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56340b0fc0 0x7f56340b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f5640ff9640 1 -- 10.20.193.28:0/4162538872 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56440040d0 con 0x559d0f6a4b60 2026-02-20T03:26:58.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f5640ff9640 1 -- 10.20.193.28:0/4162538872 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5644015030 con 0x559d0f6a4b60 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f5640ff9640 1 -- 10.20.193.28:0/4162538872 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56440116a0 con 0x559d0f6a4b60 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f56437fe640 1 -- 10.20.193.28:0/2976351126 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f56500e0be0 con 0x7f565c104980 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f56632dde00 1 -- 10.20.193.28:0/4162538872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 msgr2=0x559d0f6a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f56632dde00 1 --2- 10.20.193.28:0/4162538872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f6a4fd0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f5644007d00 tx=0x7f56440107a0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.729+0000 7f565ad76640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56340b0fc0 0x7f56340b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.730+0000 7f56632dde00 1 -- 10.20.193.28:0/4162538872 shutdown_connections 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.730+0000 7f56632dde00 1 --2- 10.20.193.28:0/4162538872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f6a4fd0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.730+0000 7f56632dde00 1 --2- 10.20.193.28:0/4162538872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 0x559d0f6a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.730+0000 7f56632dde00 1 --2- 10.20.193.28:0/4162538872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.730+0000 7f56632dde00 1 -- 10.20.193.28:0/4162538872 >> 10.20.193.28:0/4162538872 conn(0x559d0f698b60 msgr2=0x559d0f69e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.730+0000 7f56632dde00 1 -- 10.20.193.28:0/4162538872 shutdown_connections 2026-02-20T03:26:58.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.730+0000 7f56632dde00 1 -- 10.20.193.28:0/4162538872 wait complete. 2026-02-20T03:26:58.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.730+0000 7f565ad76640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56340b0fc0 0x7f56340b3480 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f564c009e60 tx=0x7f564c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:58.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.731+0000 7f56632dde00 1 -- start start 2026-02-20T03:26:58.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.731+0000 7f56632dde00 1 Processor -- start 2026-02-20T03:26:58.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.731+0000 7f56632dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.731+0000 7f56632dde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.731+0000 7f56632dde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 0x559d0f6c1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.731+0000 7f56632dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d0f59a1a0 con 0x559d0f6a00c0 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.731+0000 7f56632dde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559d0f6acd70 con 0x559d0f6a4b60 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.731+0000 7f56632dde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559d0f6c1cc0 con 0x559d0f6a0a70 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f5659d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f565ad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 0x559d0f6c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f5659d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52328/0 (socket says 10.20.193.28:52328) 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f5659d74640 1 -- 10.20.193.28:0/558548057 learned_addr learned my addr 10.20.193.28:0/558548057 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f565a575640 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f5659d74640 1 -- 10.20.193.28:0/558548057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 msgr2=0x559d0f6c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f5659d74640 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 0x559d0f6c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f5659d74640 1 -- 10.20.193.28:0/558548057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 msgr2=0x559d0f6c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f5659d74640 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f5659d74640 1 -- 10.20.193.28:0/558548057 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0f6baf60 con 0x559d0f6a0a70 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f5659d74640 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c3340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5644007650 tx=0x7f5644005860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64cd4c68319dd10 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f560bfff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f560bfff640 1 -- 10.20.193.28:0/558548057 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564402a070 con 0x559d0f6a0a70 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f560bfff640 1 -- 10.20.193.28:0/558548057 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5644004570 con 0x559d0f6a0a70 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.732+0000 7f560bfff640 1 -- 10.20.193.28:0/558548057 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644011900 con 0x559d0f6a0a70 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 1 -- 10.20.193.28:0/558548057 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d0f3c1b60 con 0x559d0f6a0a70 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 10 client.27712 _ll_register_callbacks cb 0x559d0f59e0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 1 -- 10.20.193.28:0/558548057 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d0f5fa7f0 con 0x559d0f6a0a70 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f560bfff640 1 -- 10.20.193.28:0/558548057 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5644002b00 con 0x559d0f6a0a70 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f560bfff640 1 -- 10.20.193.28:0/558548057 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f56440026e0 con 0x559d0f6a0a70 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 10 client.27712 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 1 -- 10.20.193.28:0/558548057 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559d0f5bf430 con 0x559d0f6a0a70 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f560bfff640 1 -- 10.20.193.28:0/558548057 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5644004070 con 0x559d0f6a0a70 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 10 client.27712 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 10 client.27712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 20 client.27712 populate_metadata read hostname 'trial028' 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d0f6d1460 0x559d0f6d3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 4 client.27712 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.733+0000 7f56632dde00 1 -- 10.20.193.28:0/558548057 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d0f574c00 con 0x559d0f6d1460 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.734+0000 7f565a575640 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d0f6d1460 0x559d0f6d3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.734+0000 7f565a575640 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d0f6d1460 0x559d0f6d3850 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9706ef18348614d server_cookie=6140d8facbc893e9 in_seq=0 out_seq=0 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.734+0000 7f560bfff640 10 client.27712 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f560bfff640 1 -- 10.20.193.28:0/558548057 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559d0f574c00 con 0x559d0f6d1460 2026-02-20T03:26:58.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f560bfff640 10 client.27712 handle_command_reply: tid=0 2026-02-20T03:26:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f56632dde00 1 client.27712 shutdown 2026-02-20T03:26:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f56632dde00 1 -- 10.20.193.28:0/558548057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 msgr2=0x559d0f6c3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f56632dde00 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c3340 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5644007650 tx=0x7f5644005860 comp rx=0 tx=0).stop 2026-02-20T03:26:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f56632dde00 1 -- 10.20.193.28:0/558548057 shutdown_connections 2026-02-20T03:26:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f56632dde00 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d0f6d1460 0x559d0f6d3850 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f56632dde00 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 0x559d0f6c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f56632dde00 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c3340 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f56632dde00 1 --2- 10.20.193.28:0/558548057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.735+0000 7f56632dde00 1 -- 10.20.193.28:0/558548057 >> 10.20.193.28:0/558548057 conn(0x559d0f698b60 msgr2=0x559d0f6a3520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.736+0000 7f560bfff640 0 client.27712 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.736+0000 7f56632dde00 1 -- 10.20.193.28:0/558548057 shutdown_connections 2026-02-20T03:26:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.736+0000 7f56632dde00 1 -- 10.20.193.28:0/558548057 wait complete. 2026-02-20T03:26:58.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.736+0000 7f56632dde00 20 client.27712 trim_cache size 0 max 16384 2026-02-20T03:26:58.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f56632dde00 1 Processor -- start 2026-02-20T03:26:58.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f56632dde00 1 -- start start 2026-02-20T03:26:58.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f56632dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6bef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f56632dde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f56632dde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 0x559d0f6c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f56632dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56000126e0 con 0x559d0f6a00c0 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f56632dde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f560000ffb0 con 0x559d0f6a4b60 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f56632dde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f560000de00 con 0x559d0f6a0a70 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f565a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6bef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f565a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6bef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48636/0 (socket says 10.20.193.28:48636) 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.744+0000 7f565a575640 1 -- 10.20.193.28:0/1750820790 learned_addr learned my addr 10.20.193.28:0/1750820790 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f565ad76640 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 0x559d0f6c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f5659d74640 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f565a575640 1 -- 10.20.193.28:0/1750820790 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 msgr2=0x559d0f6c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:58.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f565a575640 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f565a575640 1 -- 10.20.193.28:0/1750820790 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 msgr2=0x559d0f6c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:58.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f565a575640 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 0x559d0f6c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f565a575640 1 -- 10.20.193.28:0/1750820790 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0f6c04a0 con 0x559d0f6a00c0 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f5659d74640 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f565a575640 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6bef90 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f5650002410 tx=0x7f56500de120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f16f401fb805297 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56264e6640 1 -- 10.20.193.28:0/1750820790 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500acc70 con 0x559d0f6a00c0 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56264e6640 1 -- 10.20.193.28:0/1750820790 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56500b1b20 con 0x559d0f6a00c0 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56264e6640 1 -- 10.20.193.28:0/1750820790 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500a4900 con 0x559d0f6a00c0 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56632dde00 1 -- 10.20.193.28:0/1750820790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 msgr2=0x559d0f6bef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56632dde00 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6bef90 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f5650002410 tx=0x7f56500de120 comp rx=0 tx=0).stop 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56632dde00 1 -- 10.20.193.28:0/1750820790 shutdown_connections 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56632dde00 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a4b60 0x559d0f6c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56632dde00 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a0a70 0x559d0f6c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56632dde00 1 --2- 10.20.193.28:0/1750820790 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a00c0 0x559d0f6bef90 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56632dde00 1 -- 10.20.193.28:0/1750820790 >> 10.20.193.28:0/1750820790 conn(0x559d0f698b60 msgr2=0x559d0f6a4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.745+0000 7f56632dde00 1 -- 10.20.193.28:0/1750820790 shutdown_connections 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.746+0000 7f56632dde00 1 -- 10.20.193.28:0/1750820790 wait complete. 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.746+0000 7f56632dde00 1 -- start start 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.746+0000 7f56632dde00 1 Processor -- start 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f56632dde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f56632dde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 0x559d0f6c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f56632dde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f7358e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f56632dde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f560000e470 con 0x559d0f6a4b60 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f56632dde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f560000f8e0 con 0x559d0f6a0a70 2026-02-20T03:26:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f56632dde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f560000eb40 con 0x559d0f6a00c0 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f565ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f7358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f565a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f565a575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52346/0 (socket says 10.20.193.28:52346) 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f565a575640 1 -- 10.20.193.28:0/1861646377 learned_addr learned my addr 10.20.193.28:0/1861646377 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f5659d74640 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 0x559d0f6c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f565ad76640 1 -- 10.20.193.28:0/1861646377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 msgr2=0x559d0f6c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f565ad76640 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f565ad76640 1 -- 10.20.193.28:0/1861646377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 msgr2=0x559d0f6c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f565ad76640 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 0x559d0f6c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f565ad76640 1 -- 10.20.193.28:0/1861646377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0f6bad90 con 0x559d0f6a4b60 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.747+0000 7f5659d74640 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 0x559d0f6c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f565a575640 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:26:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f565ad76640 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f7358e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f564c02f960 tx=0x7f564c02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ca71090e5d96d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f560bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f560bfff640 1 -- 10.20.193.28:0/1861646377 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c0044b0 con 0x559d0f6a4b60 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f560bfff640 1 -- 10.20.193.28:0/1861646377 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f564c033040 con 0x559d0f6a4b60 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f560bfff640 1 -- 10.20.193.28:0/1861646377 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564c044420 con 0x559d0f6a4b60 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f56632dde00 1 -- 10.20.193.28:0/1861646377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d0f2d1900 con 0x559d0f6a4b60 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f560bfff640 1 -- 10.20.193.28:0/1861646377 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f564c0445e0 con 0x559d0f6a4b60 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f56632dde00 10 client.18795 _ll_register_callbacks cb 0x7f5644003f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f56632dde00 1 -- 10.20.193.28:0/1861646377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5644015030 con 0x559d0f6a4b60 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f560bfff640 1 -- 10.20.193.28:0/1861646377 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f564c0047c0 con 0x559d0f6a4b60 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f56632dde00 10 client.18795 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.748+0000 7f56632dde00 1 -- 10.20.193.28:0/1861646377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559d0f5ad4d0 con 0x559d0f6a4b60 2026-02-20T03:26:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.749+0000 7f560bfff640 1 -- 10.20.193.28:0/1861646377 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f564c0076a0 con 0x559d0f6a4b60 2026-02-20T03:26:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.749+0000 7f56632dde00 10 client.18795 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.749+0000 7f56632dde00 10 client.18795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.749+0000 7f56632dde00 20 client.18795 populate_metadata read hostname 'trial028' 2026-02-20T03:26:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.749+0000 7f56632dde00 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d0f73e780 0x559d0f740c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.749+0000 7f56632dde00 4 client.18795 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:26:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.749+0000 7f56632dde00 1 -- 10.20.193.28:0/1861646377 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559d0f362a20 con 0x559d0f73e780 2026-02-20T03:26:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.749+0000 7f565a575640 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d0f73e780 0x559d0f740c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:58.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.750+0000 7f565a575640 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d0f73e780 0x559d0f740c40 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2437998f6ba738c8 server_cookie=ee4844f9dc33a4d2 in_seq=0 out_seq=0 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.750+0000 7f560bfff640 10 client.18795 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.750+0000 7f560bfff640 1 -- 10.20.193.28:0/1861646377 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559d0f362a20 con 0x559d0f73e780 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.750+0000 7f560bfff640 10 client.18795 handle_command_reply: tid=0 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.750+0000 7f56632dde00 1 client.18795 shutdown 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 -- 10.20.193.28:0/1861646377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 msgr2=0x559d0f7358e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f7358e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f564c02f960 tx=0x7f564c02f450 comp rx=0 tx=0).stop 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 -- 10.20.193.28:0/1861646377 shutdown_connections 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d0f73e780 0x559d0f740c40 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d0f6a4b60 0x559d0f7358e0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d0f6a0a70 0x559d0f6c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 --2- 10.20.193.28:0/1861646377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d0f6a00c0 0x559d0f6c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 -- 10.20.193.28:0/1861646377 >> 10.20.193.28:0/1861646377 conn(0x559d0f698b60 msgr2=0x559d0f6a5760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:58.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f560bfff640 0 client.18795 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:58.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 -- 10.20.193.28:0/1861646377 shutdown_connections 2026-02-20T03:26:58.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 1 -- 10.20.193.28:0/1861646377 wait complete. 2026-02-20T03:26:58.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.751+0000 7f56632dde00 20 client.18795 trim_cache size 0 max 16384 2026-02-20T03:26:58.759 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:26:58.759 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:26:58.759 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "cffec838-611b-4308-9401-1d62df2fa093", 2026-02-20T03:26:58.760 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:26:58.760 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:26:58.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 -- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56340b0fc0 msgr2=0x7f56340b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56340b0fc0 0x7f56340b3480 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f564c009e60 tx=0x7f564c005b50 comp rx=0 tx=0).stop 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 -- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c104980 msgr2=0x7f565c19d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c104980 0x7f565c19d030 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f565000ea10 tx=0x7f565000eee0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 -- 10.20.193.28:0/2976351126 shutdown_connections 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56340b0fc0 0x7f56340b3480 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f565c10a980 0x7f565c1a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f565c105320 0x7f565c19d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 --2- 10.20.193.28:0/2976351126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f565c104980 0x7f565c19d030 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 -- 10.20.193.28:0/2976351126 >> 10.20.193.28:0/2976351126 conn(0x7f565c100680 msgr2=0x7f565c100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 -- 10.20.193.28:0/2976351126 shutdown_connections 2026-02-20T03:26:58.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:58.752+0000 7f565b577640 1 -- 10.20.193.28:0/2976351126 wait complete. 2026-02-20T03:26:58.853 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:26:59.117 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:26:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.296+0000 7f7da60c5640 1 -- 10.20.193.28:0/1021963711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da010eef0 msgr2=0x7f7da010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.296+0000 7f7da60c5640 1 --2- 10.20.193.28:0/1021963711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da010eef0 0x7f7da010f2d0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009a30 tx=0x7f7d9002f220 comp rx=0 tx=0).stop 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.296+0000 7f7da60c5640 1 -- 10.20.193.28:0/1021963711 shutdown_connections 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.296+0000 7f7da60c5640 1 --2- 10.20.193.28:0/1021963711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7da0109ba0 0x7f7da0115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.296+0000 7f7da60c5640 1 --2- 10.20.193.28:0/1021963711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7da0109220 0x7f7da0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.296+0000 7f7da60c5640 1 --2- 10.20.193.28:0/1021963711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da010eef0 0x7f7da010f2d0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.296+0000 7f7da60c5640 1 -- 10.20.193.28:0/1021963711 >> 10.20.193.28:0/1021963711 conn(0x7f7da0078600 msgr2=0x7f7da007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.296+0000 7f7da60c5640 1 -- 10.20.193.28:0/1021963711 shutdown_connections 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.296+0000 7f7da60c5640 1 -- 10.20.193.28:0/1021963711 wait complete. 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da60c5640 1 Processor -- start 2026-02-20T03:26:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da60c5640 1 -- start start 2026-02-20T03:26:59.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da60c5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7da0109220 0x7f7da01a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da60c5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da0109ba0 0x7f7da01a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da60c5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7da010eef0 0x7f7da01a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da60c5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0119060 con 0x7f7da0109ba0 2026-02-20T03:26:59.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da60c5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7da0118ee0 con 0x7f7da0109220 2026-02-20T03:26:59.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da60c5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7da01191e0 con 0x7f7da010eef0 2026-02-20T03:26:59.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da48c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da0109ba0 0x7f7da01a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da50c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7da0109220 0x7f7da01a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da48c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da0109ba0 0x7f7da01a1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48646/0 (socket says 10.20.193.28:48646) 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da48c2640 1 -- 10.20.193.28:0/3410536665 learned_addr learned my addr 10.20.193.28:0/3410536665 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.297+0000 7f7da58c4640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7da010eef0 0x7f7da01a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7da48c2640 1 -- 10.20.193.28:0/3410536665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7da010eef0 msgr2=0x7f7da01a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7da48c2640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7da010eef0 0x7f7da01a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7da48c2640 1 -- 10.20.193.28:0/3410536665 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7da0109220 msgr2=0x7f7da01a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7da48c2640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7da0109220 0x7f7da01a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7da48c2640 1 -- 10.20.193.28:0/3410536665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da01a6510 con 0x7f7da0109ba0 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7da48c2640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da0109ba0 0x7f7da01a1a00 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400d950 tx=0x7f7d9400de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7d8e7fc640 1 -- 10.20.193.28:0/3410536665 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94014070 con 0x7f7da0109ba0 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7da60c5640 1 -- 10.20.193.28:0/3410536665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da01a6800 con 0x7f7da0109ba0 2026-02-20T03:26:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7d8e7fc640 1 -- 10.20.193.28:0/3410536665 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d940044e0 con 0x7f7da0109ba0 2026-02-20T03:26:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7d8e7fc640 1 -- 10.20.193.28:0/3410536665 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9401d060 con 0x7f7da0109ba0 2026-02-20T03:26:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.298+0000 7f7da60c5640 1 -- 10.20.193.28:0/3410536665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da01ae040 con 0x7f7da0109ba0 2026-02-20T03:26:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.301+0000 7f7da9853e00 1 Processor -- start 2026-02-20T03:26:59.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.301+0000 7f7da9853e00 1 -- start start 2026-02-20T03:26:59.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7d8e7fc640 1 -- 10.20.193.28:0/3410536665 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7d9400b900 con 0x7f7da0109ba0 2026-02-20T03:26:59.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 0x55a66b0fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b103e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da9853e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a66b077e50 con 0x55a66b0f7fb0 2026-02-20T03:26:59.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da9853e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a66b04a9c0 con 0x55a66b0fd000 2026-02-20T03:26:59.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da9853e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a66aff8240 con 0x55a66b0f7630 2026-02-20T03:26:59.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da50c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da50c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0f7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52368/0 (socket says 10.20.193.28:52368) 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da50c3640 1 -- 10.20.193.28:0/1720931229 learned_addr learned my addr 10.20.193.28:0/1720931229 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da48c2640 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b103e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da58c4640 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 0x55a66b0fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da50c3640 1 -- 10.20.193.28:0/1720931229 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 msgr2=0x55a66b0fd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.302+0000 7f7da50c3640 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 0x55a66b0fd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7da50c3640 1 -- 10.20.193.28:0/1720931229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 msgr2=0x55a66b103e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7da50c3640 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b103e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7da50c3640 1 -- 10.20.193.28:0/1720931229 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66b00b420 con 0x55a66b0f7630 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7da48c2640 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7da50c3640 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0f7a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009a30 tx=0x7f7d900057d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bbb925b401de185 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:59.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7d6dce5640 1 -- 10.20.193.28:0/1720931229 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9002fc80 con 0x55a66b0f7630 2026-02-20T03:26:59.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7d6dce5640 1 -- 10.20.193.28:0/1720931229 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d90046070 con 0x55a66b0f7630 2026-02-20T03:26:59.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7d6dce5640 1 -- 10.20.193.28:0/1720931229 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90038dd0 con 0x55a66b0f7630 2026-02-20T03:26:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7d8e7fc640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7d7c0b0e20 0x7f7d7c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7d8e7fc640 1 -- 10.20.193.28:0/3410536665 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7d940e0860 con 0x7f7da0109ba0 2026-02-20T03:26:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7da9853e00 1 -- 10.20.193.28:0/1720931229 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 msgr2=0x55a66b0f7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.303+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0f7a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009a30 tx=0x7f7d900057d0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.304+0000 7f7da9853e00 1 -- 10.20.193.28:0/1720931229 shutdown_connections 2026-02-20T03:26:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.304+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.304+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0f7a70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.304+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1720931229 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 0x55a66b0fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.304+0000 7f7da9853e00 1 -- 10.20.193.28:0/1720931229 >> 10.20.193.28:0/1720931229 conn(0x55a66b0ba290 msgr2=0x55a66b0f5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.304+0000 7f7da58c4640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7d7c0b0e20 0x7f7d7c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.304+0000 7f7da9853e00 1 -- 10.20.193.28:0/1720931229 shutdown_connections 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.304+0000 7f7da9853e00 1 -- 10.20.193.28:0/1720931229 wait complete. 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.304+0000 7f7da58c4640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7d7c0b0e20 0x7f7d7c0b32e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c007550 tx=0x7f7d9c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.305+0000 7f7da9853e00 1 -- start start 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.305+0000 7f7da9853e00 1 Processor -- start 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7630 0x55a66b111b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b112090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0fd000 0x55a66b110290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da9853e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a66b0468f0 con 0x55a66b0f7fb0 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da9853e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a66ae38f50 con 0x55a66b0f7630 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da9853e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a66b110a10 con 0x55a66b0fd000 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da50c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7630 0x55a66b111b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da50c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7630 0x55a66b111b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55226/0 (socket says 10.20.193.28:55226) 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da50c3640 1 -- 10.20.193.28:0/1019630078 learned_addr learned my addr 10.20.193.28:0/1019630078 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da48c2640 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da58c4640 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0fd000 0x55a66b110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da48c2640 1 -- 10.20.193.28:0/1019630078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0fd000 msgr2=0x55a66b110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da48c2640 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0fd000 0x55a66b110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da48c2640 1 -- 10.20.193.28:0/1019630078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7630 msgr2=0x55a66b111b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:59.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da48c2640 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7630 0x55a66b111b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da48c2640 1 -- 10.20.193.28:0/1019630078 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66b1099e0 con 0x55a66b0f7fb0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da48c2640 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b112090 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f7d940a8580 tx=0x7f7d940049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc104917f2485fa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7d5affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7d5affd640 1 -- 10.20.193.28:0/1019630078 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d940a7b10 con 0x55a66b0f7fb0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7d5affd640 1 -- 10.20.193.28:0/1019630078 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d940ac8f0 con 0x55a66b0f7fb0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7da9853e00 1 -- 10.20.193.28:0/1019630078 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a66ae1bb40 con 0x55a66b0f7fb0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7d5affd640 1 -- 10.20.193.28:0/1019630078 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d940a3d10 con 0x55a66b0f7fb0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.306+0000 7f7d5affd640 1 -- 10.20.193.28:0/1019630078 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7d940a3ed0 con 0x55a66b0f7fb0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7d5affd640 10 client.18807 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 10 client.18807 _ll_register_callbacks cb 0x55a66b083f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 1 -- 10.20.193.28:0/1019630078 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a66b0581a0 con 0x55a66b0f7fb0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7d5affd640 1 -- 10.20.193.28:0/1019630078 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7d940b17a0 con 0x55a66b0f7fb0 2026-02-20T03:26:59.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 10 client.18807 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 1 -- 10.20.193.28:0/1019630078 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55a66b005230 con 0x55a66b0f7fb0 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7d5affd640 1 -- 10.20.193.28:0/1019630078 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7d9400bc20 con 0x55a66b0f7fb0 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 10 client.18807 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 10 client.18807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 20 client.18807 populate_metadata read hostname 'trial028' 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a66b1202c0 0x55a66b122760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 4 client.18807 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da9853e00 1 -- 10.20.193.28:0/1019630078 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a66b0525b0 con 0x55a66b1202c0 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.307+0000 7f7da50c3640 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a66b1202c0 0x55a66b122760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.308+0000 7f7da50c3640 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a66b1202c0 0x55a66b122760 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be6c58267c6fff25 server_cookie=7be0202bff419807 in_seq=0 out_seq=0 2026-02-20T03:26:59.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.308+0000 7f7d5affd640 10 client.18807 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:59.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7d5affd640 1 -- 10.20.193.28:0/1019630078 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a66b0525b0 con 0x55a66b1202c0 2026-02-20T03:26:59.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7d5affd640 10 client.18807 handle_command_reply: tid=0 2026-02-20T03:26:59.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 client.18807 shutdown 2026-02-20T03:26:59.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 -- 10.20.193.28:0/1019630078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 msgr2=0x55a66b112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:59.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b112090 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f7d940a8580 tx=0x7f7d940049f0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 -- 10.20.193.28:0/1019630078 shutdown_connections 2026-02-20T03:26:59.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a66b1202c0 0x55a66b122760 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0fd000 0x55a66b110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7fb0 0x55a66b112090 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1019630078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7630 0x55a66b111b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 -- 10.20.193.28:0/1019630078 >> 10.20.193.28:0/1019630078 conn(0x55a66b0ba290 msgr2=0x55a66b0f6440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7d5affd640 0 client.18807 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 -- 10.20.193.28:0/1019630078 shutdown_connections 2026-02-20T03:26:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 1 -- 10.20.193.28:0/1019630078 wait complete. 2026-02-20T03:26:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.309+0000 7f7da9853e00 20 client.18807 trim_cache size 0 max 16384 2026-02-20T03:26:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da9853e00 1 Processor -- start 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da9853e00 1 -- start start 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0efd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7fb0 0x55a66b10f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0fd000 0x55a66b0f6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da9853e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c012610 con 0x55a66b0fd000 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da9853e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c00fee0 con 0x55a66b0f7fb0 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da9853e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c00dd30 con 0x55a66b0f7630 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da50c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da58c4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0fd000 0x55a66b0f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da50c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0efd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52382/0 (socket says 10.20.193.28:52382) 2026-02-20T03:26:59.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da50c3640 1 -- 10.20.193.28:0/3807231131 learned_addr learned my addr 10.20.193.28:0/3807231131 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da48c2640 1 --2- 10.20.193.28:0/3807231131 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7fb0 0x55a66b10f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da50c3640 1 -- 10.20.193.28:0/3807231131 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7fb0 msgr2=0x55a66b10f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da50c3640 1 --2- 10.20.193.28:0/3807231131 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7fb0 0x55a66b10f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da50c3640 1 -- 10.20.193.28:0/3807231131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0fd000 msgr2=0x55a66b0f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da50c3640 1 --2- 10.20.193.28:0/3807231131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0fd000 0x55a66b0f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da50c3640 1 -- 10.20.193.28:0/3807231131 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66b109810 con 0x55a66b0f7630 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.318+0000 7f7da58c4640 1 --2- 10.20.193.28:0/3807231131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0fd000 0x55a66b0f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da50c3640 1 --2- 10.20.193.28:0/3807231131 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0efd50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7d90038960 tx=0x7f7d900023d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24e3009ad2ede54b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7d6d4e4640 1 -- 10.20.193.28:0/3807231131 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90058070 con 0x55a66b0f7630 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7d6d4e4640 1 -- 10.20.193.28:0/3807231131 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d90033040 con 0x55a66b0f7630 2026-02-20T03:26:59.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7d6d4e4640 1 -- 10.20.193.28:0/3807231131 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d900047c0 con 0x55a66b0f7630 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da9853e00 1 -- 10.20.193.28:0/3807231131 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 msgr2=0x55a66b0efd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da9853e00 1 --2- 10.20.193.28:0/3807231131 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0efd50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7d90038960 tx=0x7f7d900023d0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da9853e00 1 -- 10.20.193.28:0/3807231131 shutdown_connections 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da9853e00 1 --2- 10.20.193.28:0/3807231131 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0fd000 0x55a66b0f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da9853e00 1 --2- 10.20.193.28:0/3807231131 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0f7fb0 0x55a66b10f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da9853e00 1 --2- 10.20.193.28:0/3807231131 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7630 0x55a66b0efd50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da9853e00 1 -- 10.20.193.28:0/3807231131 >> 10.20.193.28:0/3807231131 conn(0x55a66b0ba290 msgr2=0x55a66b10ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da9853e00 1 -- 10.20.193.28:0/3807231131 shutdown_connections 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.319+0000 7f7da9853e00 1 -- 10.20.193.28:0/3807231131 wait complete. 2026-02-20T03:26:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.320+0000 7f7da9853e00 1 -- start start 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.320+0000 7f7da9853e00 1 Processor -- start 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.320+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7630 0x55a66b117fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.320+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7fb0 0x55a66b1149b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da9853e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 0x55a66b114ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da9853e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c00e3a0 con 0x55a66b0f7630 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da9853e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c00f810 con 0x55a66b0fd000 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da9853e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4c00ea70 con 0x55a66b0f7fb0 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da50c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7630 0x55a66b117fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da50c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7630 0x55a66b117fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48678/0 (socket says 10.20.193.28:48678) 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da50c3640 1 -- 10.20.193.28:0/1834300084 learned_addr learned my addr 10.20.193.28:0/1834300084 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da58c4640 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 0x55a66b114ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da48c2640 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7fb0 0x55a66b1149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da50c3640 1 -- 10.20.193.28:0/1834300084 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7fb0 msgr2=0x55a66b1149b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da50c3640 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7fb0 0x55a66b1149b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da50c3640 1 -- 10.20.193.28:0/1834300084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 msgr2=0x55a66b114ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da50c3640 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 0x55a66b114ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da50c3640 1 -- 10.20.193.28:0/1834300084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a66ad29870 con 0x55a66b0f7630 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da50c3640 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7630 0x55a66b117fb0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f7d90038890 tx=0x7f7d90005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d95864d30f2eb50 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7d5affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7d5affd640 1 -- 10.20.193.28:0/1834300084 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90058020 con 0x55a66b0f7630 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7d5affd640 1 -- 10.20.193.28:0/1834300084 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d90046070 con 0x55a66b0f7630 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da9853e00 1 -- 10.20.193.28:0/1834300084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a66afea440 con 0x55a66b0f7630 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7d5affd640 1 -- 10.20.193.28:0/1834300084 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90005050 con 0x55a66b0f7630 2026-02-20T03:26:59.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.321+0000 7f7da9853e00 10 client.18813 _ll_register_callbacks cb 0x7f7d940e6220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da9853e00 1 -- 10.20.193.28:0/1834300084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d90033040 con 0x55a66b0f7630 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7d5affd640 1 -- 10.20.193.28:0/1834300084 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7d900047c0 con 0x55a66b0f7630 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7d5affd640 1 -- 10.20.193.28:0/1834300084 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7d90004a40 con 0x55a66b0f7630 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da9853e00 10 client.18813 fetch_fsmap learned FSMap version 30 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da9853e00 1 -- 10.20.193.28:0/1834300084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55a66b10a500 con 0x55a66b0f7630 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7d5affd640 1 -- 10.20.193.28:0/1834300084 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7d900051f0 con 0x55a66b0f7630 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da9853e00 10 client.18813 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da9853e00 10 client.18813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da9853e00 20 client.18813 populate_metadata read hostname 'trial028' 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a66b18bbf0 0x55a66b18e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da9853e00 4 client.18813 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:26:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da9853e00 1 -- 10.20.193.28:0/1834300084 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a66b0525b0 con 0x55a66b18bbf0 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.322+0000 7f7da48c2640 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a66b18bbf0 0x55a66b18e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.323+0000 7f7da48c2640 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a66b18bbf0 0x55a66b18e040 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d9ecbead25451f server_cookie=2571df421829f8c9 in_seq=0 out_seq=0 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.323+0000 7f7d5affd640 10 client.18813 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7d5affd640 1 -- 10.20.193.28:0/1834300084 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a66b0525b0 con 0x55a66b18bbf0 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7d5affd640 10 client.18813 handle_command_reply: tid=0 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 client.18813 shutdown 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 -- 10.20.193.28:0/1834300084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7630 msgr2=0x55a66b117fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7630 0x55a66b117fb0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f7d90038890 tx=0x7f7d90005f70 comp rx=0 tx=0).stop 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 -- 10.20.193.28:0/1834300084 shutdown_connections 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a66b18bbf0 0x55a66b18e040 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a66b0fd000 0x55a66b114ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a66b0f7fb0 0x55a66b1149b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 --2- 10.20.193.28:0/1834300084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a66b0f7630 0x55a66b117fb0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 -- 10.20.193.28:0/1834300084 >> 10.20.193.28:0/1834300084 conn(0x55a66b0ba290 msgr2=0x55a66b10f220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7d5affd640 0 client.18813 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:26:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 -- 10.20.193.28:0/1834300084 shutdown_connections 2026-02-20T03:26:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 1 -- 10.20.193.28:0/1834300084 wait complete. 2026-02-20T03:26:59.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.324+0000 7f7da9853e00 20 client.18813 trim_cache size 0 max 16384 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout: "cffec838-611b-4308-9401-1d62df2fa093": { 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "cffec838-611b-4308-9401-1d62df2fa093", 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:26:59.333 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:26:59.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 -- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7d7c0b0e20 msgr2=0x7f7d7c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:59.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7d7c0b0e20 0x7f7d7c0b32e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c007550 tx=0x7f7d9c00b040 comp rx=0 tx=0).stop 2026-02-20T03:26:59.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 -- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da0109ba0 msgr2=0x7f7da01a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:26:59.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da0109ba0 0x7f7da01a1a00 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400d950 tx=0x7f7d9400de20 comp rx=0 tx=0).stop 2026-02-20T03:26:59.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 -- 10.20.193.28:0/3410536665 shutdown_connections 2026-02-20T03:26:59.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7d7c0b0e20 0x7f7d7c0b32e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7da010eef0 0x7f7da01a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7da0109ba0 0x7f7da01a1a00 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 --2- 10.20.193.28:0/3410536665 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7da0109220 0x7f7da01a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:26:59.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 -- 10.20.193.28:0/3410536665 >> 10.20.193.28:0/3410536665 conn(0x7f7da0078600 msgr2=0x7f7da0079ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:26:59.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 -- 10.20.193.28:0/3410536665 shutdown_connections 2026-02-20T03:26:59.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:26:59.325+0000 7f7da60c5640 1 -- 10.20.193.28:0/3410536665 wait complete. 2026-02-20T03:26:59.424 INFO:tasks.cephfs.filesystem:scrub status for tag:cffec838-611b-4308-9401-1d62df2fa093 - {'path': '/', 'tag': 'cffec838-611b-4308-9401-1d62df2fa093', 'options': 'recursive,force'} 2026-02-20T03:26:59.425 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:59 trial028 ceph-mon[38552]: pgmap v551: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 750 KiB/s rd, 1.1 MiB/s wr, 104 op/s 2026-02-20T03:26:59.425 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:59 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:26:59.425 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:26:59 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:59.519 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:59 trial177 ceph-mon[43181]: pgmap v551: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 750 KiB/s rd, 1.1 MiB/s wr, 104 op/s 2026-02-20T03:26:59.520 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:59 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:26:59.520 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:26:59 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:26:59.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.75 MB/sec execute 512 sec latency 9278.573 ms 2026-02-20T03:26:59.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:59 trial126 ceph-mon[38476]: pgmap v551: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 750 KiB/s rd, 1.1 MiB/s wr, 104 op/s 2026-02-20T03:26:59.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:59 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:26:59.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:26:59 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:00.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.74 MB/sec execute 513 sec latency 10278.624 ms 2026-02-20T03:27:00.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:00 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:27:00.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:00 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:00.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:00 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:27:00.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:00 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:27:00.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:00 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:00.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:00 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:00.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:00 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:27:00.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:00 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:00.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:00 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:27:00.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:00 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:27:00.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:00 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:00.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:00 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:00.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:00 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:27:00.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:00 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:00.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:00 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:27:00.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:00 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:27:00.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:00 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:00.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:00 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:01.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.72 MB/sec execute 514 sec latency 11278.678 ms 2026-02-20T03:27:01.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:01 trial126 ceph-mon[38476]: pgmap v552: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 748 KiB/s rd, 904 KiB/s wr, 99 op/s 2026-02-20T03:27:01.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:01 trial028 ceph-mon[38552]: pgmap v552: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 748 KiB/s rd, 904 KiB/s wr, 99 op/s 2026-02-20T03:27:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:01 trial177 ceph-mon[43181]: pgmap v552: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 748 KiB/s rd, 904 KiB/s wr, 99 op/s 2026-02-20T03:27:02.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.71 MB/sec execute 515 sec latency 12278.719 ms 2026-02-20T03:27:03.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.69 MB/sec execute 516 sec latency 13278.765 ms 2026-02-20T03:27:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:03 trial126 ceph-mon[38476]: pgmap v553: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 258 KiB/s rd, 456 KiB/s wr, 60 op/s 2026-02-20T03:27:03.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:03 trial028 ceph-mon[38552]: pgmap v553: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 258 KiB/s rd, 456 KiB/s wr, 60 op/s 2026-02-20T03:27:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:03 trial177 ceph-mon[43181]: pgmap v553: 129 pgs: 129 active+clean; 165 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 258 KiB/s rd, 456 KiB/s wr, 60 op/s 2026-02-20T03:27:04.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.68 MB/sec execute 517 sec latency 14278.803 ms 2026-02-20T03:27:04.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.764+0000 7efe0a840640 1 -- 10.20.193.28:0/3178317655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe041061b0 msgr2=0x7efe04106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:04.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.764+0000 7efe0a840640 1 --2- 10.20.193.28:0/3178317655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe041061b0 0x7efe04106660 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7efe0000b0a0 tx=0x7efe0002f410 comp rx=0 tx=0).stop 2026-02-20T03:27:04.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.764+0000 7efe0a840640 1 -- 10.20.193.28:0/3178317655 shutdown_connections 2026-02-20T03:27:04.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.764+0000 7efe0a840640 1 --2- 10.20.193.28:0/3178317655 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe041061b0 0x7efe04106660 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.764+0000 7efe0a840640 1 --2- 10.20.193.28:0/3178317655 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe04103800 0x7efe04105c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.764+0000 7efe0a840640 1 --2- 10.20.193.28:0/3178317655 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe04100eb0 0x7efe041032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.764+0000 7efe0a840640 1 -- 10.20.193.28:0/3178317655 >> 10.20.193.28:0/3178317655 conn(0x7efe040fcca0 msgr2=0x7efe040ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.764+0000 7efe0a840640 1 -- 10.20.193.28:0/3178317655 shutdown_connections 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.764+0000 7efe0a840640 1 -- 10.20.193.28:0/3178317655 wait complete. 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0a840640 1 Processor -- start 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0a840640 1 -- start start 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0a840640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe04100eb0 0x7efe041a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0a840640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe04103800 0x7efe041a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0a840640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe041061b0 0x7efe041a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0a840640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe04114900 con 0x7efe041061b0 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0a840640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efe04114780 con 0x7efe04103800 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0a840640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe04114a80 con 0x7efe04100eb0 2026-02-20T03:27:04.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0983e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe04100eb0 0x7efe041a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0a03f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe041061b0 0x7efe041a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0983e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe04100eb0 0x7efe041a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52404/0 (socket says 10.20.193.28:52404) 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0983e640 1 -- 10.20.193.28:0/3698001580 learned_addr learned my addr 10.20.193.28:0/3698001580 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.765+0000 7efe0903d640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe04103800 0x7efe041a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efe0a03f640 1 -- 10.20.193.28:0/3698001580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe04100eb0 msgr2=0x7efe041a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efe0a03f640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe04100eb0 0x7efe041a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efe0a03f640 1 -- 10.20.193.28:0/3698001580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe04103800 msgr2=0x7efe041a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efe0a03f640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe04103800 0x7efe041a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efe0a03f640 1 -- 10.20.193.28:0/3698001580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe041a8b60 con 0x7efe041061b0 2026-02-20T03:27:04.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efe0a03f640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe041061b0 0x7efe041a8460 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7efe00032040 tx=0x7efe00004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:04.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efdf2ffd640 1 -- 10.20.193.28:0/3698001580 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe000096e0 con 0x7efe041061b0 2026-02-20T03:27:04.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efdf2ffd640 1 -- 10.20.193.28:0/3698001580 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efe000076a0 con 0x7efe041061b0 2026-02-20T03:27:04.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efdf2ffd640 1 -- 10.20.193.28:0/3698001580 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00038660 con 0x7efe041061b0 2026-02-20T03:27:04.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efe0a840640 1 -- 10.20.193.28:0/3698001580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe041a8df0 con 0x7efe041061b0 2026-02-20T03:27:04.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.766+0000 7efe0a840640 1 -- 10.20.193.28:0/3698001580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe041a91d0 con 0x7efe041061b0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.769+0000 7efdf2ffd640 1 -- 10.20.193.28:0/3698001580 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efe00007bc0 con 0x7efe041061b0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.769+0000 7efe0ea06e00 1 Processor -- start 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.769+0000 7efe0ea06e00 1 -- start start 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.769+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.769+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.769+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898bb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.769+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff898048f0 con 0x55ff898b47c0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.769+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ff897b22e0 con 0x55ff898b3e80 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.769+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ff89800820 con 0x55ff898b9560 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0983e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0903d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0983e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898b8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48698/0 (socket says 10.20.193.28:48698) 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0983e640 1 -- 10.20.193.28:0/57230861 learned_addr learned my addr 10.20.193.28:0/57230861 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0903d640 1 --2- 10.20.193.28:0/57230861 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898bb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0983e640 1 -- 10.20.193.28:0/57230861 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 msgr2=0x55ff898bb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0983e640 1 --2- 10.20.193.28:0/57230861 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898bb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0983e640 1 -- 10.20.193.28:0/57230861 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 msgr2=0x55ff898b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0983e640 1 --2- 10.20.193.28:0/57230861 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0983e640 1 -- 10.20.193.28:0/57230861 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff897a45a0 con 0x55ff898b47c0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0903d640 1 --2- 10.20.193.28:0/57230861 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0983e640 1 --2- 10.20.193.28:0/57230861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898b8f40 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009f40 tx=0x7efdf40044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e4b704b5c79c96 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efdd1bfe640 1 -- 10.20.193.28:0/57230861 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4010630 con 0x55ff898b47c0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efdd1bfe640 1 -- 10.20.193.28:0/57230861 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efdf4010c70 con 0x55ff898b47c0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efdd1bfe640 1 -- 10.20.193.28:0/57230861 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf400ece0 con 0x55ff898b47c0 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0ea06e00 1 -- 10.20.193.28:0/57230861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 msgr2=0x55ff898b8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/57230861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898b8f40 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009f40 tx=0x7efdf40044f0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0ea06e00 1 -- 10.20.193.28:0/57230861 shutdown_connections 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/57230861 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898bb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/57230861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898b8f40 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/57230861 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0ea06e00 1 -- 10.20.193.28:0/57230861 >> 10.20.193.28:0/57230861 conn(0x55ff898ab6f0 msgr2=0x55ff898b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.770+0000 7efe0ea06e00 1 -- 10.20.193.28:0/57230861 shutdown_connections 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.771+0000 7efe0ea06e00 1 -- 10.20.193.28:0/57230861 wait complete. 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.771+0000 7efdf2ffd640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efde00b0d80 0x7efde00b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.771+0000 7efdf2ffd640 1 -- 10.20.193.28:0/3698001580 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7efe00104ef0 con 0x7efe041061b0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.771+0000 7efe0983e640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efde00b0d80 0x7efde00b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.771+0000 7efe0983e640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efde00b0d80 0x7efde00b3240 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efdf400e860 tx=0x7efdf4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0ea06e00 1 -- start start 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0ea06e00 1 Processor -- start 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898d3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff897ac0c0 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ff898bc610 con 0x55ff898b3e80 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ff898d43b0 con 0x55ff898b9560 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0983e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0903d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0983e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55278/0 (socket says 10.20.193.28:55278) 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.772+0000 7efe0983e640 1 -- 10.20.193.28:0/735588260 learned_addr learned my addr 10.20.193.28:0/735588260 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0a03f640 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898d3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0903d640 1 -- 10.20.193.28:0/735588260 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 msgr2=0x55ff898d3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0903d640 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898d3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0903d640 1 -- 10.20.193.28:0/735588260 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 msgr2=0x55ff898cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0903d640 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0903d640 1 -- 10.20.193.28:0/735588260 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff898c60e0 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0903d640 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898ccea0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7efe041a23c0 tx=0x7efdf8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984fe41be8d4abdf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efdbeffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efdbeffd640 1 -- 10.20.193.28:0/735588260 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf8019070 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0ea06e00 1 -- 10.20.193.28:0/735588260 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff897c0820 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0ea06e00 10 client.18825 _ll_register_callbacks cb 0x55ff897afff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0ea06e00 1 -- 10.20.193.28:0/735588260 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff8980c4e0 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efdbeffd640 1 -- 10.20.193.28:0/735588260 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efdf80044e0 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efdbeffd640 1 -- 10.20.193.28:0/735588260 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf8005280 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efdbeffd640 1 -- 10.20.193.28:0/735588260 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7efdf8005420 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efdbeffd640 1 -- 10.20.193.28:0/735588260 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efdf80056c0 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0ea06e00 10 client.18825 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efe0ea06e00 1 -- 10.20.193.28:0/735588260 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ff897c5380 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.773+0000 7efdbeffd640 1 -- 10.20.193.28:0/735588260 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7efdf80048a0 con 0x55ff898b47c0 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.774+0000 7efe0ea06e00 10 client.18825 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.774+0000 7efe0ea06e00 10 client.18825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:04.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.774+0000 7efe0ea06e00 20 client.18825 populate_metadata read hostname 'trial028' 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.774+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff898d8720 0x55ff898dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.774+0000 7efe0ea06e00 4 client.18825 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.774+0000 7efe0ea06e00 1 -- 10.20.193.28:0/735588260 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff89786bd0 con 0x55ff898d8720 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.774+0000 7efe0983e640 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff898d8720 0x55ff898dabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0983e640 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff898d8720 0x55ff898dabb0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40bb5bee1634a5cb server_cookie=94b7669656850f18 in_seq=0 out_seq=0 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efdbeffd640 10 client.18825 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efdbeffd640 1 -- 10.20.193.28:0/735588260 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ff89786bd0 con 0x55ff898d8720 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efdbeffd640 10 client.18825 handle_command_reply: tid=0 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0ea06e00 1 client.18825 shutdown 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0ea06e00 1 -- 10.20.193.28:0/735588260 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 msgr2=0x55ff898ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898ccea0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7efe041a23c0 tx=0x7efdf8009f90 comp rx=0 tx=0).stop 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0ea06e00 1 -- 10.20.193.28:0/735588260 shutdown_connections 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff898d8720 0x55ff898dabb0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898d3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898ccea0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/735588260 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b3e80 0x55ff898cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efe0ea06e00 1 -- 10.20.193.28:0/735588260 >> 10.20.193.28:0/735588260 conn(0x55ff898ab6f0 msgr2=0x55ff898ba910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.775+0000 7efdbeffd640 0 client.18825 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.776+0000 7efe0ea06e00 1 -- 10.20.193.28:0/735588260 shutdown_connections 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.776+0000 7efe0ea06e00 1 -- 10.20.193.28:0/735588260 wait complete. 2026-02-20T03:27:04.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.776+0000 7efe0ea06e00 20 client.18825 trim_cache size 0 max 16384 2026-02-20T03:27:04.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0ea06e00 1 Processor -- start 2026-02-20T03:27:04.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0ea06e00 1 -- start start 2026-02-20T03:27:04.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b3e80 0x55ff898caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898d3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b9560 0x55ff898c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efdb00126f0 con 0x55ff898b47c0 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efdb000ffc0 con 0x55ff898b9560 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efdb000de10 con 0x55ff898b3e80 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0983e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b3e80 0x55ff898caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0983e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b3e80 0x55ff898caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52442/0 (socket says 10.20.193.28:52442) 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0983e640 1 -- 10.20.193.28:0/4103726613 learned_addr learned my addr 10.20.193.28:0/4103726613 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0a03f640 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b9560 0x55ff898c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0903d640 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898d3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0983e640 1 -- 10.20.193.28:0/4103726613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b9560 msgr2=0x55ff898c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0983e640 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b9560 0x55ff898c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0983e640 1 -- 10.20.193.28:0/4103726613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 msgr2=0x55ff898d3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0983e640 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898d3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.783+0000 7efe0983e640 1 -- 10.20.193.28:0/4103726613 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff898c5f10 con 0x55ff898b3e80 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0903d640 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898d3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0983e640 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b3e80 0x55ff898caf00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009e60 tx=0x7efdf4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1476a708a1c5f899 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:04.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efdd13fd640 1 -- 10.20.193.28:0/4103726613 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf400ee90 con 0x55ff898b3e80 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efdd13fd640 1 -- 10.20.193.28:0/4103726613 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efdf4010980 con 0x55ff898b3e80 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efdd13fd640 1 -- 10.20.193.28:0/4103726613 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4005500 con 0x55ff898b3e80 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0ea06e00 1 -- 10.20.193.28:0/4103726613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b3e80 msgr2=0x55ff898caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b3e80 0x55ff898caf00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009e60 tx=0x7efdf4017000 comp rx=0 tx=0).stop 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0ea06e00 1 -- 10.20.193.28:0/4103726613 shutdown_connections 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b9560 0x55ff898c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b47c0 0x55ff898d3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/4103726613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b3e80 0x55ff898caf00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0ea06e00 1 -- 10.20.193.28:0/4103726613 >> 10.20.193.28:0/4103726613 conn(0x55ff898ab6f0 msgr2=0x55ff898b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0ea06e00 1 -- 10.20.193.28:0/4103726613 shutdown_connections 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.784+0000 7efe0ea06e00 1 -- 10.20.193.28:0/4103726613 wait complete. 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0ea06e00 1 -- start start 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0ea06e00 1 Processor -- start 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b3e80 0x55ff898d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b47c0 0x55ff898d20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0ea06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898d25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efdb000e480 con 0x55ff898b3e80 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efdb000f8f0 con 0x55ff898b47c0 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0ea06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efdb000eb50 con 0x55ff898b9560 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0983e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b3e80 0x55ff898d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0903d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b47c0 0x55ff898d20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0983e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b3e80 0x55ff898d39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48742/0 (socket says 10.20.193.28:48742) 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0903d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b47c0 0x55ff898d20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55294/0 (socket says 10.20.193.28:55294) 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0983e640 1 -- 10.20.193.28:0/2897774644 learned_addr learned my addr 10.20.193.28:0/2897774644 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.785+0000 7efe0a03f640 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898d25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0983e640 1 -- 10.20.193.28:0/2897774644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 msgr2=0x55ff898d25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0983e640 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898d25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0983e640 1 -- 10.20.193.28:0/2897774644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b47c0 msgr2=0x55ff898d20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0983e640 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b47c0 0x55ff898d20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0983e640 1 -- 10.20.193.28:0/2897774644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff898bc370 con 0x55ff898b3e80 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0903d640 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b47c0 0x55ff898d20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:04.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0983e640 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b3e80 0x55ff898d39e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7efdf4002ab0 tx=0x7efdf4011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a136165749e966 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efdbeffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efdbeffd640 1 -- 10.20.193.28:0/2897774644 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4041020 con 0x55ff898b3e80 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efdbeffd640 1 -- 10.20.193.28:0/2897774644 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efdf400ee90 con 0x55ff898b3e80 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efdbeffd640 1 -- 10.20.193.28:0/2897774644 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4034440 con 0x55ff898b3e80 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0ea06e00 1 -- 10.20.193.28:0/2897774644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff89564690 con 0x55ff898b3e80 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efdbeffd640 1 -- 10.20.193.28:0/2897774644 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7efdf40345e0 con 0x55ff898b3e80 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efdbeffd640 10 client.18831 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0ea06e00 10 client.18831 _ll_register_callbacks cb 0x7efdf8013530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0ea06e00 1 -- 10.20.193.28:0/2897774644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdf4010c70 con 0x55ff898b3e80 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efdbeffd640 1 -- 10.20.193.28:0/2897774644 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efdf4009b40 con 0x55ff898b3e80 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0ea06e00 10 client.18831 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.786+0000 7efe0ea06e00 1 -- 10.20.193.28:0/2897774644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55ff897c9b70 con 0x55ff898b3e80 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efdbeffd640 1 -- 10.20.193.28:0/2897774644 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7efdf4005280 con 0x55ff898b3e80 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efe0ea06e00 10 client.18831 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efe0ea06e00 10 client.18831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efe0ea06e00 20 client.18831 populate_metadata read hostname 'trial028' 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff899445a0 0x55ff89946a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efe0ea06e00 4 client.18831 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efe0ea06e00 1 -- 10.20.193.28:0/2897774644 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff895dd520 con 0x55ff899445a0 2026-02-20T03:27:04.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efe0903d640 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff899445a0 0x55ff89946a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:04.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efe0903d640 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff899445a0 0x55ff89946a60 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb809f5004b7d13d server_cookie=10da648520917062 in_seq=0 out_seq=0 2026-02-20T03:27:04.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.787+0000 7efdbeffd640 10 client.18831 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.798+0000 7efdbeffd640 1 -- 10.20.193.28:0/2897774644 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff895dd520 con 0x55ff899445a0 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.798+0000 7efdbeffd640 10 client.18831 handle_command_reply: tid=0 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.798+0000 7efe0ea06e00 1 client.18831 shutdown 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.798+0000 7efe0ea06e00 1 -- 10.20.193.28:0/2897774644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b3e80 msgr2=0x55ff898d39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.798+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b3e80 0x55ff898d39e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7efdf4002ab0 tx=0x7efdf4011f90 comp rx=0 tx=0).stop 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.798+0000 7efe0ea06e00 1 -- 10.20.193.28:0/2897774644 shutdown_connections 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.798+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff899445a0 0x55ff89946a60 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff898b9560 0x55ff898d25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff898b47c0 0x55ff898d20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0ea06e00 1 --2- 10.20.193.28:0/2897774644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff898b3e80 0x55ff898d39e0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efdbeffd640 0 client.18831 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:04.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0ea06e00 1 -- 10.20.193.28:0/2897774644 >> 10.20.193.28:0/2897774644 conn(0x55ff898ab6f0 msgr2=0x55ff898cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:04.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0ea06e00 1 -- 10.20.193.28:0/2897774644 shutdown_connections 2026-02-20T03:27:04.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0ea06e00 1 -- 10.20.193.28:0/2897774644 wait complete. 2026-02-20T03:27:04.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0ea06e00 20 client.18831 trim_cache size 0 max 16384 2026-02-20T03:27:04.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:27:04.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:27:04.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:27:04.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:27:04.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 -- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efde00b0d80 msgr2=0x7efde00b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:04.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efde00b0d80 0x7efde00b3240 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efdf400e860 tx=0x7efdf4005e50 comp rx=0 tx=0).stop 2026-02-20T03:27:04.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 -- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe041061b0 msgr2=0x7efe041a8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:04.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe041061b0 0x7efe041a8460 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7efe00032040 tx=0x7efe00004290 comp rx=0 tx=0).stop 2026-02-20T03:27:04.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 -- 10.20.193.28:0/3698001580 shutdown_connections 2026-02-20T03:27:04.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efde00b0d80 0x7efde00b3240 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efe041061b0 0x7efe041a8460 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efe04103800 0x7efe041a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 --2- 10.20.193.28:0/3698001580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efe04100eb0 0x7efe041a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:04.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 -- 10.20.193.28:0/3698001580 >> 10.20.193.28:0/3698001580 conn(0x7efe040fcca0 msgr2=0x7efe04101770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:04.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 -- 10.20.193.28:0/3698001580 shutdown_connections 2026-02-20T03:27:04.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:04.799+0000 7efe0a840640 1 -- 10.20.193.28:0/3698001580 wait complete. 2026-02-20T03:27:05.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.66 MB/sec execute 518 sec latency 15278.846 ms 2026-02-20T03:27:05.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:05 trial126 ceph-mon[38476]: pgmap v554: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 103 KiB/s rd, 166 KiB/s wr, 47 op/s 2026-02-20T03:27:05.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:05 trial028 ceph-mon[38552]: pgmap v554: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 103 KiB/s rd, 166 KiB/s wr, 47 op/s 2026-02-20T03:27:05.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:05 trial177 ceph-mon[43181]: pgmap v554: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 103 KiB/s rd, 166 KiB/s wr, 47 op/s 2026-02-20T03:27:06.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.65 MB/sec execute 519 sec latency 16278.892 ms 2026-02-20T03:27:07.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.63 MB/sec execute 520 sec latency 17278.934 ms 2026-02-20T03:27:07.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:07 trial126 ceph-mon[38476]: pgmap v555: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 24 op/s 2026-02-20T03:27:07.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:07 trial028 ceph-mon[38552]: pgmap v555: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 24 op/s 2026-02-20T03:27:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:07 trial177 ceph-mon[43181]: pgmap v555: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 24 op/s 2026-02-20T03:27:08.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.62 MB/sec execute 521 sec latency 18278.970 ms 2026-02-20T03:27:08.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:27:08.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:27:08.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:08 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:27:08.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:27:08.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:27:08.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:08 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:27:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:27:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:27:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:08 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:27:09.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.60 MB/sec execute 522 sec latency 19279.028 ms 2026-02-20T03:27:09.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:09 trial126 ceph-mon[38476]: pgmap v556: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2026-02-20T03:27:09.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:09 trial028 ceph-mon[38552]: pgmap v556: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2026-02-20T03:27:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:09 trial177 ceph-mon[43181]: pgmap v556: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2026-02-20T03:27:10.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.59 MB/sec execute 523 sec latency 20279.075 ms 2026-02-20T03:27:11.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.57 MB/sec execute 524 sec latency 21279.104 ms 2026-02-20T03:27:11.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:11 trial126 ceph-mon[38476]: pgmap v557: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 5.6 KiB/s wr, 15 op/s 2026-02-20T03:27:11.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:11 trial028 ceph-mon[38552]: pgmap v557: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 5.6 KiB/s wr, 15 op/s 2026-02-20T03:27:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:11 trial177 ceph-mon[43181]: pgmap v557: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 5.6 KiB/s wr, 15 op/s 2026-02-20T03:27:12.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.56 MB/sec execute 525 sec latency 22279.136 ms 2026-02-20T03:27:13.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.55 MB/sec execute 526 sec latency 23279.170 ms 2026-02-20T03:27:13.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:13 trial126 ceph-mon[38476]: pgmap v558: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2026-02-20T03:27:13.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:13 trial028 ceph-mon[38552]: pgmap v558: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2026-02-20T03:27:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:13 trial177 ceph-mon[43181]: pgmap v558: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2026-02-20T03:27:14.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.53 MB/sec execute 527 sec latency 24279.200 ms 2026-02-20T03:27:15.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.52 MB/sec execute 528 sec latency 25279.229 ms 2026-02-20T03:27:15.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:15 trial126 ceph-mon[38476]: pgmap v559: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2026-02-20T03:27:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:15 trial028 ceph-mon[38552]: pgmap v559: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2026-02-20T03:27:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:15 trial177 ceph-mon[43181]: pgmap v559: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2026-02-20T03:27:16.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.50 MB/sec execute 529 sec latency 26279.257 ms 2026-02-20T03:27:17.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.49 MB/sec execute 530 sec latency 27279.285 ms 2026-02-20T03:27:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:17 trial126 ceph-mon[38476]: pgmap v560: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2026-02-20T03:27:17.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:17 trial028 ceph-mon[38552]: pgmap v560: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2026-02-20T03:27:17.654 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:27:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:17 trial177 ceph-mon[43181]: pgmap v560: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 3.9 KiB/s wr, 10 op/s 2026-02-20T03:27:17.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 -- 10.20.193.28:0/899443614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f297810a900 msgr2=0x7f2978111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:17.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 --2- 10.20.193.28:0/899443614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f297810a900 0x7f2978111480 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f297400b0a0 tx=0x7f297402f450 comp rx=0 tx=0).stop 2026-02-20T03:27:17.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 -- 10.20.193.28:0/899443614 shutdown_connections 2026-02-20T03:27:17.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 --2- 10.20.193.28:0/899443614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f297810a900 0x7f2978111480 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 --2- 10.20.193.28:0/899443614 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2978109e60 0x7f297810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 --2- 10.20.193.28:0/899443614 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2978109490 0x7f2978109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 -- 10.20.193.28:0/899443614 >> 10.20.193.28:0/899443614 conn(0x7f2978077fe0 msgr2=0x7f297807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:17.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 -- 10.20.193.28:0/899443614 shutdown_connections 2026-02-20T03:27:17.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 -- 10.20.193.28:0/899443614 wait complete. 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 Processor -- start 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 -- start start 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2978109490 0x7f2978080990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2978109e60 0x7f2978080ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f297810a900 0x7f29781b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2978114910 con 0x7f2978109e60 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2978114790 con 0x7f2978109490 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297f25a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2978114a90 con 0x7f297810a900 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297e258640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2978109490 0x7f2978080990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297e258640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2978109490 0x7f2978080990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39526/0 (socket says 10.20.193.28:39526) 2026-02-20T03:27:17.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297e258640 1 -- 10.20.193.28:0/1996871850 learned_addr learned my addr 10.20.193.28:0/1996871850 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297da57640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2978109e60 0x7f2978080ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.877+0000 7f297ea59640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f297810a900 0x7f29781b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f297e258640 1 -- 10.20.193.28:0/1996871850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f297810a900 msgr2=0x7f29781b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f297e258640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f297810a900 0x7f29781b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f297e258640 1 -- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2978109e60 msgr2=0x7f2978080ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f297e258640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2978109e60 0x7f2978080ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f297e258640 1 -- 10.20.193.28:0/1996871850 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29780840e0 con 0x7f2978109490 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f297da57640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2978109e60 0x7f2978080ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f297e258640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2978109490 0x7f2978080990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f296800e9e0 tx=0x7f296800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f295f7fe640 1 -- 10.20.193.28:0/1996871850 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296800cde0 con 0x7f2978109490 2026-02-20T03:27:17.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f295f7fe640 1 -- 10.20.193.28:0/1996871850 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2968004570 con 0x7f2978109490 2026-02-20T03:27:17.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f295f7fe640 1 -- 10.20.193.28:0/1996871850 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2968010690 con 0x7f2978109490 2026-02-20T03:27:17.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f297f25a640 1 -- 10.20.193.28:0/1996871850 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29781b18c0 con 0x7f2978109490 2026-02-20T03:27:17.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.878+0000 7f297f25a640 1 -- 10.20.193.28:0/1996871850 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29781b1d60 con 0x7f2978109490 2026-02-20T03:27:17.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.881+0000 7f298341de00 1 Processor -- start 2026-02-20T03:27:17.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.881+0000 7f298341de00 1 -- start start 2026-02-20T03:27:17.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f295f7fe640 1 -- 10.20.193.28:0/1996871850 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f29680040d0 con 0x7f2978109490 2026-02-20T03:27:17.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f298341de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e74e80 0x562fe7e75280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f298341de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e79f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f298341de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 0x562fe7e7c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f298341de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fe7dc58f0 con 0x562fe7e74e80 2026-02-20T03:27:17.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f298341de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562fe7d732e0 con 0x562fe7e757c0 2026-02-20T03:27:17.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f298341de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562fe7dc1820 con 0x562fe7e7a560 2026-02-20T03:27:17.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297ea59640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e74e80 0x562fe7e75280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297ea59640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e74e80 0x562fe7e75280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35944/0 (socket says 10.20.193.28:35944) 2026-02-20T03:27:17.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297ea59640 1 -- 10.20.193.28:0/368897806 learned_addr learned my addr 10.20.193.28:0/368897806 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:17.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297da57640 1 --2- 10.20.193.28:0/368897806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 0x562fe7e7c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297e258640 1 --2- 10.20.193.28:0/368897806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e79f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297ea59640 1 -- 10.20.193.28:0/368897806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 msgr2=0x562fe7e7c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:17.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297ea59640 1 --2- 10.20.193.28:0/368897806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 0x562fe7e7c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297ea59640 1 -- 10.20.193.28:0/368897806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 msgr2=0x562fe7e79f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:17.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297ea59640 1 --2- 10.20.193.28:0/368897806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e79f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297ea59640 1 -- 10.20.193.28:0/368897806 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe7d655a0 con 0x562fe7e74e80 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.882+0000 7f297ea59640 1 --2- 10.20.193.28:0/368897806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e74e80 0x562fe7e75280 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f29740074f0 tx=0x7f29740044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394739a80118609d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f29463ff640 1 -- 10.20.193.28:0/368897806 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29740045b0 con 0x562fe7e74e80 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f29463ff640 1 -- 10.20.193.28:0/368897806 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2974033050 con 0x562fe7e74e80 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f29463ff640 1 -- 10.20.193.28:0/368897806 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974002e60 con 0x562fe7e74e80 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f298341de00 1 -- 10.20.193.28:0/368897806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e74e80 msgr2=0x562fe7e75280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f298341de00 1 --2- 10.20.193.28:0/368897806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e74e80 0x562fe7e75280 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f29740074f0 tx=0x7f29740044b0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f298341de00 1 -- 10.20.193.28:0/368897806 shutdown_connections 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f298341de00 1 --2- 10.20.193.28:0/368897806 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 0x562fe7e7c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f298341de00 1 --2- 10.20.193.28:0/368897806 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e79f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f298341de00 1 --2- 10.20.193.28:0/368897806 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e74e80 0x562fe7e75280 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f298341de00 1 -- 10.20.193.28:0/368897806 >> 10.20.193.28:0/368897806 conn(0x562fe7e6c6f0 msgr2=0x562fe7e73570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:17.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f295f7fe640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29540b0e20 0x7f29540b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f298341de00 1 -- 10.20.193.28:0/368897806 shutdown_connections 2026-02-20T03:27:17.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f295f7fe640 1 -- 10.20.193.28:0/1996871850 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f29680e0ee0 con 0x7f2978109490 2026-02-20T03:27:17.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f298341de00 1 -- 10.20.193.28:0/368897806 wait complete. 2026-02-20T03:27:17.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.883+0000 7f297ea59640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29540b0e20 0x7f29540b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.885+0000 7f298341de00 1 -- start start 2026-02-20T03:27:17.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.885+0000 7f298341de00 1 Processor -- start 2026-02-20T03:27:17.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.885+0000 7f298341de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 0x562fe7e8d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.885+0000 7f298341de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e8dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.885+0000 7f297ea59640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29540b0e20 0x7f29540b32e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2974002ba0 tx=0x7f297402f450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:17.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.885+0000 7f298341de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 0x562fe7e94b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.885+0000 7f298341de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562fe7d6d0c0 con 0x562fe7e7a560 2026-02-20T03:27:17.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.885+0000 7f298341de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562fe7e7d5b0 con 0x562fe7e757c0 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.885+0000 7f298341de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562fe7e950d0 con 0x562fe7e74e80 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297ea59640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 0x562fe7e94b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297da57640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e8dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297da57640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e8dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39548/0 (socket says 10.20.193.28:39548) 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297da57640 1 -- 10.20.193.28:0/2349467269 learned_addr learned my addr 10.20.193.28:0/2349467269 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297ea59640 1 -- 10.20.193.28:0/2349467269 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 msgr2=0x562fe7e8d760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297ea59640 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 0x562fe7e8d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297ea59640 1 -- 10.20.193.28:0/2349467269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 msgr2=0x562fe7e8dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297ea59640 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e8dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297ea59640 1 -- 10.20.193.28:0/2349467269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe7e87250 con 0x562fe7e7a560 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f297ea59640 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 0x562fe7e94b60 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f29740074c0 tx=0x7f297400b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f9be239280077 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:17.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f29337fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f29337fe640 1 -- 10.20.193.28:0/2349467269 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f297405d070 con 0x562fe7e7a560 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f29337fe640 1 -- 10.20.193.28:0/2349467269 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2974007b70 con 0x562fe7e7a560 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f29337fe640 1 -- 10.20.193.28:0/2349467269 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974058470 con 0x562fe7e7a560 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.886+0000 7f298341de00 1 -- 10.20.193.28:0/2349467269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe7d81820 con 0x562fe7e7a560 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 10 client.18843 _ll_register_callbacks cb 0x562fe7d70ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f29337fe640 1 -- 10.20.193.28:0/2349467269 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f2974007d20 con 0x562fe7e7a560 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 1 -- 10.20.193.28:0/2349467269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562fe7dcd4e0 con 0x562fe7e7a560 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f29337fe640 1 -- 10.20.193.28:0/2349467269 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f297404d480 con 0x562fe7e7a560 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 10 client.18843 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 1 -- 10.20.193.28:0/2349467269 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x562fe7d86380 con 0x562fe7e7a560 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f29337fe640 1 -- 10.20.193.28:0/2349467269 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f297404d6e0 con 0x562fe7e7a560 2026-02-20T03:27:17.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 10 client.18843 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 10 client.18843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 20 client.18843 populate_metadata read hostname 'trial028' 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562fe7e98f10 0x562fe7e9b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 4 client.18843 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.887+0000 7f298341de00 1 -- 10.20.193.28:0/2349467269 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fe7d47bd0 con 0x562fe7e98f10 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.888+0000 7f297e258640 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562fe7e98f10 0x562fe7e9b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.888+0000 7f297e258640 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562fe7e98f10 0x562fe7e9b3d0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aed485aac9d7e4f4 server_cookie=a94a8b7094e99adc in_seq=0 out_seq=0 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.888+0000 7f29337fe640 10 client.18843 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.888+0000 7f29337fe640 1 -- 10.20.193.28:0/2349467269 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562fe7d47bd0 con 0x562fe7e98f10 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.888+0000 7f29337fe640 10 client.18843 handle_command_reply: tid=0 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 client.18843 shutdown 2026-02-20T03:27:17.897 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 -- 10.20.193.28:0/2349467269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 msgr2=0x562fe7e94b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 0x562fe7e94b60 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f29740074c0 tx=0x7f297400b000 comp rx=0 tx=0).stop 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 -- 10.20.193.28:0/2349467269 shutdown_connections 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562fe7e98f10 0x562fe7e9b3d0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 0x562fe7e94b60 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e8dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 --2- 10.20.193.28:0/2349467269 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 0x562fe7e8d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 -- 10.20.193.28:0/2349467269 >> 10.20.193.28:0/2349467269 conn(0x562fe7e6c6f0 msgr2=0x562fe7e7b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f29337fe640 0 client.18843 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 -- 10.20.193.28:0/2349467269 shutdown_connections 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 1 -- 10.20.193.28:0/2349467269 wait complete. 2026-02-20T03:27:17.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.889+0000 7f298341de00 20 client.18843 trim_cache size 0 max 16384 2026-02-20T03:27:17.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.897+0000 7f298341de00 1 Processor -- start 2026-02-20T03:27:17.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.897+0000 7f298341de00 1 -- start start 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.897+0000 7f298341de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e74e80 0x562fe7e8ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.897+0000 7f298341de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e757c0 0x562fe7e94b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.897+0000 7f298341de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 0x562fe7e8d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.897+0000 7f298341de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2924012670 con 0x562fe7e757c0 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.897+0000 7f298341de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f292400ff40 con 0x562fe7e74e80 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.897+0000 7f298341de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f292400dd90 con 0x562fe7e7a560 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.897+0000 7f297da57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e757c0 0x562fe7e94b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297e258640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e74e80 0x562fe7e8ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297da57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e757c0 0x562fe7e94b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35962/0 (socket says 10.20.193.28:35962) 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297da57640 1 -- 10.20.193.28:0/3103865434 learned_addr learned my addr 10.20.193.28:0/3103865434 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297ea59640 1 --2- 10.20.193.28:0/3103865434 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 0x562fe7e8d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.902 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297e258640 1 -- 10.20.193.28:0/3103865434 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 msgr2=0x562fe7e8d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297e258640 1 --2- 10.20.193.28:0/3103865434 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 0x562fe7e8d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297e258640 1 -- 10.20.193.28:0/3103865434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e757c0 msgr2=0x562fe7e94b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297e258640 1 --2- 10.20.193.28:0/3103865434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e757c0 0x562fe7e94b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297e258640 1 -- 10.20.193.28:0/3103865434 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe7e87080 con 0x562fe7e74e80 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f297e258640 1 --2- 10.20.193.28:0/3103865434 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e74e80 0x562fe7e8ce40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f29680de600 tx=0x7f2968004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc4150ba573393b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f2945bfe640 1 -- 10.20.193.28:0/3103865434 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680a89f0 con 0x562fe7e74e80 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f2945bfe640 1 -- 10.20.193.28:0/3103865434 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f29680a9320 con 0x562fe7e74e80 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f2945bfe640 1 -- 10.20.193.28:0/3103865434 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680a8140 con 0x562fe7e74e80 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f298341de00 1 -- 10.20.193.28:0/3103865434 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e74e80 msgr2=0x562fe7e8ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.898+0000 7f298341de00 1 --2- 10.20.193.28:0/3103865434 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e74e80 0x562fe7e8ce40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f29680de600 tx=0x7f2968004040 comp rx=0 tx=0).stop 2026-02-20T03:27:17.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.899+0000 7f298341de00 1 -- 10.20.193.28:0/3103865434 shutdown_connections 2026-02-20T03:27:17.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.899+0000 7f298341de00 1 --2- 10.20.193.28:0/3103865434 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e7a560 0x562fe7e8d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.899+0000 7f298341de00 1 --2- 10.20.193.28:0/3103865434 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e757c0 0x562fe7e94b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.899+0000 7f298341de00 1 --2- 10.20.193.28:0/3103865434 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e74e80 0x562fe7e8ce40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.899+0000 7f298341de00 1 -- 10.20.193.28:0/3103865434 >> 10.20.193.28:0/3103865434 conn(0x562fe7e6c6f0 msgr2=0x562fe7e8c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:17.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.899+0000 7f298341de00 1 -- 10.20.193.28:0/3103865434 shutdown_connections 2026-02-20T03:27:17.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.899+0000 7f298341de00 1 -- 10.20.193.28:0/3103865434 wait complete. 2026-02-20T03:27:17.906 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.899+0000 7f298341de00 1 -- start start 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.899+0000 7f298341de00 1 Processor -- start 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f298341de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 0x562fe7e94440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f298341de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e94980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f298341de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 0x562fe7e92a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f298341de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f292400e400 con 0x562fe7e7a560 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f298341de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f292400f870 con 0x562fe7e757c0 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f298341de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f292400ead0 con 0x562fe7e74e80 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297e258640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 0x562fe7e94440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297e258640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 0x562fe7e94440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43916/0 (socket says 10.20.193.28:43916) 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297e258640 1 -- 10.20.193.28:0/516110711 learned_addr learned my addr 10.20.193.28:0/516110711 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:17.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297da57640 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e94980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297ea59640 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 0x562fe7e92a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297e258640 1 -- 10.20.193.28:0/516110711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 msgr2=0x562fe7e94980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297e258640 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e94980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297e258640 1 -- 10.20.193.28:0/516110711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 msgr2=0x562fe7e92a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297e258640 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 0x562fe7e92a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297e258640 1 -- 10.20.193.28:0/516110711 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fe7b25690 con 0x562fe7e74e80 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f297e258640 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 0x562fe7e94440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f29680a94d0 tx=0x7f2968005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dda0d4c15d81904 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.900+0000 7f29337fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f29337fe640 1 -- 10.20.193.28:0/516110711 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680a8320 con 0x562fe7e74e80 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f29337fe640 1 -- 10.20.193.28:0/516110711 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f29680acfd0 con 0x562fe7e74e80 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 1 -- 10.20.193.28:0/516110711 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fe7d8ab70 con 0x562fe7e74e80 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f29337fe640 1 -- 10.20.193.28:0/516110711 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29680b1c50 con 0x562fe7e74e80 2026-02-20T03:27:17.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 10 client.27760 _ll_register_callbacks cb 0x7f29740094b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 1 -- 10.20.193.28:0/516110711 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2974033050 con 0x562fe7e74e80 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f29337fe640 1 -- 10.20.193.28:0/516110711 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f29680cf1b0 con 0x562fe7e74e80 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f29337fe640 1 -- 10.20.193.28:0/516110711 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f29680af1e0 con 0x562fe7e74e80 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 10 client.27760 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 1 -- 10.20.193.28:0/516110711 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x562fe7e87d70 con 0x562fe7e74e80 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f29337fe640 1 -- 10.20.193.28:0/516110711 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f2968092030 con 0x562fe7e74e80 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 10 client.27760 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 10 client.27760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 20 client.27760 populate_metadata read hostname 'trial028' 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562fe7f04c50 0x562fe7f07110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 4 client.27760 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:27:17.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f298341de00 1 -- 10.20.193.28:0/516110711 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562fe7d966b0 con 0x562fe7f04c50 2026-02-20T03:27:17.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.901+0000 7f297da57640 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562fe7f04c50 0x562fe7f07110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:17.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.902+0000 7f297da57640 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562fe7f04c50 0x562fe7f07110 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64fd68595da7648f server_cookie=7f08f3f9cd713ed1 in_seq=0 out_seq=0 2026-02-20T03:27:17.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.902+0000 7f29337fe640 10 client.27760 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:17.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f29337fe640 1 -- 10.20.193.28:0/516110711 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562fe7d966b0 con 0x562fe7f04c50 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f29337fe640 10 client.27760 handle_command_reply: tid=0 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f298341de00 1 client.27760 shutdown 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f298341de00 1 -- 10.20.193.28:0/516110711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 msgr2=0x562fe7e94440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f298341de00 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 0x562fe7e94440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f29680a94d0 tx=0x7f2968005bb0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f298341de00 1 -- 10.20.193.28:0/516110711 shutdown_connections 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f298341de00 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562fe7f04c50 0x562fe7f07110 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f298341de00 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562fe7e7a560 0x562fe7e92a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f298341de00 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562fe7e757c0 0x562fe7e94980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f298341de00 1 --2- 10.20.193.28:0/516110711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562fe7e74e80 0x562fe7e94440 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.911+0000 7f298341de00 1 -- 10.20.193.28:0/516110711 >> 10.20.193.28:0/516110711 conn(0x562fe7e6c6f0 msgr2=0x562fe7e72d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:17.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f29337fe640 0 client.27760 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:17.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f298341de00 1 -- 10.20.193.28:0/516110711 shutdown_connections 2026-02-20T03:27:17.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f298341de00 1 -- 10.20.193.28:0/516110711 wait complete. 2026-02-20T03:27:17.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f298341de00 20 client.27760 trim_cache size 0 max 16384 2026-02-20T03:27:17.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:27:17.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:27:17.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:27:17.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:27:17.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 -- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29540b0e20 msgr2=0x7f29540b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:17.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29540b0e20 0x7f29540b32e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2974002ba0 tx=0x7f297402f450 comp rx=0 tx=0).stop 2026-02-20T03:27:17.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 -- 10.20.193.28:0/1996871850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2978109490 msgr2=0x7f2978080990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:17.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2978109490 0x7f2978080990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f296800e9e0 tx=0x7f296800eeb0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 -- 10.20.193.28:0/1996871850 shutdown_connections 2026-02-20T03:27:17.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f29540b0e20 0x7f29540b32e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f297810a900 0x7f29781b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2978109e60 0x7f2978080ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 --2- 10.20.193.28:0/1996871850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2978109490 0x7f2978080990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:17.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.912+0000 7f297f25a640 1 -- 10.20.193.28:0/1996871850 >> 10.20.193.28:0/1996871850 conn(0x7f2978077fe0 msgr2=0x7f297810d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:17.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.913+0000 7f297f25a640 1 -- 10.20.193.28:0/1996871850 shutdown_connections 2026-02-20T03:27:17.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:17.913+0000 7f297f25a640 1 -- 10.20.193.28:0/1996871850 wait complete. 2026-02-20T03:27:17.929 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:27:18.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.104+0000 7f91cffff640 1 -- 10.20.193.28:0/141550592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91d0109ba0 msgr2=0x7f91d0115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.104+0000 7f91cffff640 1 --2- 10.20.193.28:0/141550592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91d0109ba0 0x7f91d0115d10 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f91c000b0a0 tx=0x7f91c002f410 comp rx=0 tx=0).stop 2026-02-20T03:27:18.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.104+0000 7f91cffff640 1 -- 10.20.193.28:0/141550592 shutdown_connections 2026-02-20T03:27:18.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.104+0000 7f91cffff640 1 --2- 10.20.193.28:0/141550592 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91d0109ba0 0x7f91d0115d10 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.104+0000 7f91cffff640 1 --2- 10.20.193.28:0/141550592 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d0109220 0x7f91d0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.104+0000 7f91cffff640 1 --2- 10.20.193.28:0/141550592 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f91d010eef0 0x7f91d010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.104+0000 7f91cffff640 1 -- 10.20.193.28:0/141550592 >> 10.20.193.28:0/141550592 conn(0x7f91d0078600 msgr2=0x7f91d007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:18.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.104+0000 7f91cffff640 1 -- 10.20.193.28:0/141550592 shutdown_connections 2026-02-20T03:27:18.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.104+0000 7f91cffff640 1 -- 10.20.193.28:0/141550592 wait complete. 2026-02-20T03:27:18.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.105+0000 7f91cffff640 1 Processor -- start 2026-02-20T03:27:18.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.105+0000 7f91cffff640 1 -- start start 2026-02-20T03:27:18.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.105+0000 7f91cffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f91d0109220 0x7f91d01a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.105+0000 7f91cffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91d0109ba0 0x7f91d01a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.105+0000 7f91cffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d010eef0 0x7f91d01a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.105+0000 7f91cffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f91d01190b0 con 0x7f91d0109ba0 2026-02-20T03:27:18.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.105+0000 7f91cffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0118f30 con 0x7f91d0109220 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.105+0000 7f91cffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f91d0119230 con 0x7f91d010eef0 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ceffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f91d0109220 0x7f91d01a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ce7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91d0109ba0 0x7f91d01a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ceffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f91d0109220 0x7f91d01a1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39586/0 (socket says 10.20.193.28:39586) 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ceffd640 1 -- 10.20.193.28:0/1411527423 learned_addr learned my addr 10.20.193.28:0/1411527423 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91cf7fe640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d010eef0 0x7f91d01a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ce7fc640 1 -- 10.20.193.28:0/1411527423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d010eef0 msgr2=0x7f91d01a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ce7fc640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d010eef0 0x7f91d01a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ce7fc640 1 -- 10.20.193.28:0/1411527423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f91d0109220 msgr2=0x7f91d01a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ce7fc640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f91d0109220 0x7f91d01a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ce7fc640 1 -- 10.20.193.28:0/1411527423 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d01a6480 con 0x7f91d0109ba0 2026-02-20T03:27:18.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91cf7fe640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d010eef0 0x7f91d01a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:27:18.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91ce7fc640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91d0109ba0 0x7f91d01a1970 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f91b800e9f0 tx=0x7f91b800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:18.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91affff640 1 -- 10.20.193.28:0/1411527423 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b800cd80 con 0x7f91d0109ba0 2026-02-20T03:27:18.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91affff640 1 -- 10.20.193.28:0/1411527423 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f91b8004570 con 0x7f91d0109ba0 2026-02-20T03:27:18.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91affff640 1 -- 10.20.193.28:0/1411527423 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8010690 con 0x7f91d0109ba0 2026-02-20T03:27:18.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.106+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91d01a6770 con 0x7f91d0109ba0 2026-02-20T03:27:18.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.107+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91d01adfb0 con 0x7f91d0109ba0 2026-02-20T03:27:18.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.107+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d010a580 con 0x7f91d0109ba0 2026-02-20T03:27:18.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.109+0000 7f91affff640 1 -- 10.20.193.28:0/1411527423 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f91b8002890 con 0x7f91d0109ba0 2026-02-20T03:27:18.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.110+0000 7f91affff640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f91a00b0e20 0x7f91a00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.110+0000 7f91affff640 1 -- 10.20.193.28:0/1411527423 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f91b80e0fc0 con 0x7f91d0109ba0 2026-02-20T03:27:18.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.111+0000 7f91ceffd640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f91a00b0e20 0x7f91a00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.111+0000 7f91affff640 1 -- 10.20.193.28:0/1411527423 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f91b80a9430 con 0x7f91d0109ba0 2026-02-20T03:27:18.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.111+0000 7f91ceffd640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f91a00b0e20 0x7f91a00b32e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009d90 tx=0x7f91c4009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:18.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.218+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91d0109660 con 0x7f91d0109ba0 2026-02-20T03:27:18.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.219+0000 7f91affff640 1 -- 10.20.193.28:0/1411527423 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11921 (secure 0 0 0) 0x7f91d0109660 con 0x7f91d0109ba0 2026-02-20T03:27:18.222 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:27:18.222 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T03:25:19:519285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:25:19.519275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:27:18.223 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T03:27:18.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.220+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f91a00b0e20 msgr2=0x7f91a00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.220+0000 7f91cffff640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f91a00b0e20 0x7f91a00b32e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009d90 tx=0x7f91c4009290 comp rx=0 tx=0).stop 2026-02-20T03:27:18.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.220+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91d0109ba0 msgr2=0x7f91d01a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.220+0000 7f91cffff640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91d0109ba0 0x7f91d01a1970 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f91b800e9f0 tx=0x7f91b800eec0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.221+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 shutdown_connections 2026-02-20T03:27:18.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.221+0000 7f91cffff640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f91a00b0e20 0x7f91a00b32e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.221+0000 7f91cffff640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f91d010eef0 0x7f91d01a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.221+0000 7f91cffff640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f91d0109ba0 0x7f91d01a1970 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.221+0000 7f91cffff640 1 --2- 10.20.193.28:0/1411527423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f91d0109220 0x7f91d01a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.221+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 >> 10.20.193.28:0/1411527423 conn(0x7f91d0078600 msgr2=0x7f91d0079cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:18.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.221+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 shutdown_connections 2026-02-20T03:27:18.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.221+0000 7f91cffff640 1 -- 10.20.193.28:0/1411527423 wait complete. 2026-02-20T03:27:18.363 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 29b98b59 --release --await' 2026-02-20T03:27:18.363 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 29b98b59 --release --await 2026-02-20T03:27:18.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1031657 7.47 MB/sec execute 531 sec latency 28279.317 ms 2026-02-20T03:27:18.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:18 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1411527423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:27:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:18 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1411527423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:27:18.670 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:27:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:18 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1411527423' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:27:18.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.853+0000 7f232cbaf640 1 -- 10.20.193.28:0/3604407330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 msgr2=0x7f2328104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.853+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3604407330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 0x7f2328104de0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f2318009a60 tx=0x7f231802f270 comp rx=0 tx=0).stop 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.853+0000 7f232cbaf640 1 -- 10.20.193.28:0/3604407330 shutdown_connections 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.853+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3604407330 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2328105320 0x7f2328111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.853+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3604407330 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 0x7f2328104de0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.853+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3604407330 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f232810a980 0x7f232810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.853+0000 7f232cbaf640 1 -- 10.20.193.28:0/3604407330 >> 10.20.193.28:0/3604407330 conn(0x7f2328100680 msgr2=0x7f2328102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.853+0000 7f232cbaf640 1 -- 10.20.193.28:0/3604407330 shutdown_connections 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.854+0000 7f232cbaf640 1 -- 10.20.193.28:0/3604407330 wait complete. 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.854+0000 7f232cbaf640 1 Processor -- start 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.854+0000 7f232cbaf640 1 -- start start 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.854+0000 7f232cbaf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 0x7f232819d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.854+0000 7f232cbaf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2328105320 0x7f232819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.854+0000 7f232cbaf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f232810a980 0x7f23281a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f232cbaf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2328114bf0 con 0x7f2328104980 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f232cbaf640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2328114a70 con 0x7f2328105320 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f232cbaf640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2328114d70 con 0x7f232810a980 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f23277fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 0x7f232819d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f23277fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 0x7f232819d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36010/0 (socket says 10.20.193.28:36010) 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f23277fe640 1 -- 10.20.193.28:0/3473666909 learned_addr learned my addr 10.20.193.28:0/3473666909 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f2327fff640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f232810a980 0x7f23281a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f2326ffd640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2328105320 0x7f232819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f23277fe640 1 -- 10.20.193.28:0/3473666909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f232810a980 msgr2=0x7f23281a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f23277fe640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f232810a980 0x7f23281a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f23277fe640 1 -- 10.20.193.28:0/3473666909 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2328105320 msgr2=0x7f232819d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f23277fe640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2328105320 0x7f232819d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f23277fe640 1 -- 10.20.193.28:0/3473666909 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23281a2120 con 0x7f2328104980 2026-02-20T03:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f23277fe640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 0x7f232819d0d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f231400ea30 tx=0x7f231400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f2324ff9640 1 -- 10.20.193.28:0/3473666909 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231400ce50 con 0x7f2328104980 2026-02-20T03:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f2324ff9640 1 -- 10.20.193.28:0/3473666909 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2314004570 con 0x7f2328104980 2026-02-20T03:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f2324ff9640 1 -- 10.20.193.28:0/3473666909 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314010690 con 0x7f2328104980 2026-02-20T03:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f232cbaf640 1 -- 10.20.193.28:0/3473666909 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23281a2410 con 0x7f2328104980 2026-02-20T03:27:18.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.855+0000 7f232cbaf640 1 -- 10.20.193.28:0/3473666909 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23281a9c50 con 0x7f2328104980 2026-02-20T03:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.858+0000 7f233033de00 1 Processor -- start 2026-02-20T03:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.858+0000 7f233033de00 1 -- start start 2026-02-20T03:27:18.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f2324ff9640 1 -- 10.20.193.28:0/3473666909 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f23140040d0 con 0x7f2328104980 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f233033de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f233033de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f233033de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 0x561d5ba762d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f233033de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561d5b9bca20 con 0x561d5ba6af60 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f233033de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561d5b96a2a0 con 0x561d5ba69dd0 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f233033de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561d5b9b8950 con 0x561d5ba6b8e0 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f23277fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f2327fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f23277fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36014/0 (socket says 10.20.193.28:36014) 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f23277fe640 1 -- 10.20.193.28:0/4252046286 learned_addr learned my addr 10.20.193.28:0/4252046286 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:18.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f2326ffd640 1 --2- 10.20.193.28:0/4252046286 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 0x561d5ba762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f23277fe640 1 -- 10.20.193.28:0/4252046286 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 msgr2=0x561d5ba762d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f23277fe640 1 --2- 10.20.193.28:0/4252046286 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 0x561d5ba762d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f23277fe640 1 -- 10.20.193.28:0/4252046286 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 msgr2=0x561d5ba6a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f23277fe640 1 --2- 10.20.193.28:0/4252046286 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f23277fe640 1 -- 10.20.193.28:0/4252046286 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5b94d0f0 con 0x561d5ba6af60 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f2327fff640 1 --2- 10.20.193.28:0/4252046286 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.859+0000 7f23277fe640 1 --2- 10.20.193.28:0/4252046286 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6b3a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f23140e4f90 tx=0x7f23140e91b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27029df21d952944 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f22ebfff640 1 -- 10.20.193.28:0/4252046286 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140f4070 con 0x561d5ba6af60 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f22ebfff640 1 -- 10.20.193.28:0/4252046286 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23140e9e00 con 0x561d5ba6af60 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f22ebfff640 1 -- 10.20.193.28:0/4252046286 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140ee800 con 0x561d5ba6af60 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f233033de00 1 -- 10.20.193.28:0/4252046286 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 msgr2=0x561d5ba6b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f233033de00 1 --2- 10.20.193.28:0/4252046286 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6b3a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f23140e4f90 tx=0x7f23140e91b0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f2324ff9640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22fc0b0e20 0x7f22fc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f233033de00 1 -- 10.20.193.28:0/4252046286 shutdown_connections 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f233033de00 1 --2- 10.20.193.28:0/4252046286 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 0x561d5ba762d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f233033de00 1 --2- 10.20.193.28:0/4252046286 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6b3a0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f233033de00 1 --2- 10.20.193.28:0/4252046286 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f233033de00 1 -- 10.20.193.28:0/4252046286 >> 10.20.193.28:0/4252046286 conn(0x561d5ba611b0 msgr2=0x561d5ba68030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f233033de00 1 -- 10.20.193.28:0/4252046286 shutdown_connections 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f2324ff9640 1 -- 10.20.193.28:0/3473666909 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f23140e0ef0 con 0x7f2328104980 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f233033de00 1 -- 10.20.193.28:0/4252046286 wait complete. 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.860+0000 7f2327fff640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22fc0b0e20 0x7f22fc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.861+0000 7f2327fff640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22fc0b0e20 0x7f22fc0b32e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f231c007550 tx=0x7f231c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.861+0000 7f233033de00 1 -- start start 2026-02-20T03:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f233033de00 1 Processor -- start 2026-02-20T03:27:18.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f233033de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba69dd0 0x561d5ba845f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f233033de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6af60 0x561d5ba84b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f233033de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5ba82aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f233033de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561d5b964080 con 0x561d5ba69dd0 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f233033de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561d5ba769d0 con 0x561d5ba6b8e0 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f233033de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561d5ba83030 con 0x561d5ba6af60 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f23277fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba69dd0 0x561d5ba845f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f2326ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6af60 0x561d5ba84b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f23277fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba69dd0 0x561d5ba845f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36020/0 (socket says 10.20.193.28:36020) 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f23277fe640 1 -- 10.20.193.28:0/3753130419 learned_addr learned my addr 10.20.193.28:0/3753130419 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:18.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f2327fff640 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5ba82aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f23277fe640 1 -- 10.20.193.28:0/3753130419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6af60 msgr2=0x561d5ba84b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f23277fe640 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6af60 0x561d5ba84b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f23277fe640 1 -- 10.20.193.28:0/3753130419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 msgr2=0x561d5ba82aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f23277fe640 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5ba82aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f23277fe640 1 -- 10.20.193.28:0/3753130419 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5ba7be90 con 0x561d5ba69dd0 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.862+0000 7f23277fe640 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba69dd0 0x561d5ba845f0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f23140a4a00 tx=0x7f2314009410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8fd31bba9cb5e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f22e97fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f22e97fa640 1 -- 10.20.193.28:0/3753130419 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140a4840 con 0x561d5ba69dd0 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f233033de00 1 -- 10.20.193.28:0/3753130419 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d5b78dda0 con 0x561d5ba69dd0 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f233033de00 10 client.18867 _ll_register_callbacks cb 0x561d5b967fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f233033de00 1 -- 10.20.193.28:0/3753130419 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561d5b9c4610 con 0x561d5ba69dd0 2026-02-20T03:27:18.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f22e97fa640 1 -- 10.20.193.28:0/3753130419 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23140a92d0 con 0x561d5ba69dd0 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f22e97fa640 1 -- 10.20.193.28:0/3753130419 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140a80f0 con 0x561d5ba69dd0 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f22e97fa640 1 -- 10.20.193.28:0/3753130419 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f23140a4c10 con 0x561d5ba69dd0 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f22e97fa640 1 -- 10.20.193.28:0/3753130419 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23140a82d0 con 0x561d5ba69dd0 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f233033de00 10 client.18867 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f233033de00 1 -- 10.20.193.28:0/3753130419 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561d5b97a020 con 0x561d5ba69dd0 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f22e97fa640 1 -- 10.20.193.28:0/3753130419 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f23140a8490 con 0x561d5ba69dd0 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f233033de00 10 client.18867 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.863+0000 7f233033de00 10 client.18867 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.864+0000 7f233033de00 20 client.18867 populate_metadata read hostname 'trial028' 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.864+0000 7f233033de00 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d5ba92720 0x561d5ba94b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.864+0000 7f233033de00 4 client.18867 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:18.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.864+0000 7f233033de00 1 -- 10.20.193.28:0/3753130419 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d5b93eb80 con 0x561d5ba92720 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.864+0000 7f2326ffd640 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d5ba92720 0x561d5ba94b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.864+0000 7f2326ffd640 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d5ba92720 0x561d5ba94b70 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f8a325ed5ba950f server_cookie=ec00f857b7605402 in_seq=0 out_seq=0 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.864+0000 7f22e97fa640 10 client.18867 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f22e97fa640 1 -- 10.20.193.28:0/3753130419 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561d5b93eb80 con 0x561d5ba92720 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f22e97fa640 10 client.18867 handle_command_reply: tid=0 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 client.18867 shutdown 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 -- 10.20.193.28:0/3753130419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba69dd0 msgr2=0x561d5ba845f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba69dd0 0x561d5ba845f0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f23140a4a00 tx=0x7f2314009410 comp rx=0 tx=0).stop 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 -- 10.20.193.28:0/3753130419 shutdown_connections 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d5ba92720 0x561d5ba94b70 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5ba82aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6af60 0x561d5ba84b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 --2- 10.20.193.28:0/3753130419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba69dd0 0x561d5ba845f0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 -- 10.20.193.28:0/3753130419 >> 10.20.193.28:0/3753130419 conn(0x561d5ba611b0 msgr2=0x561d5ba6e080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f22e97fa640 0 client.18867 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 -- 10.20.193.28:0/3753130419 shutdown_connections 2026-02-20T03:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 1 -- 10.20.193.28:0/3753130419 wait complete. 2026-02-20T03:27:18.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.865+0000 7f233033de00 20 client.18867 trim_cache size 0 max 16384 2026-02-20T03:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f233033de00 1 Processor -- start 2026-02-20T03:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f233033de00 1 -- start start 2026-02-20T03:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f233033de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f233033de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f233033de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 0x561d5ba9a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f233033de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0126f0 con 0x561d5ba6af60 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f233033de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00ffc0 con 0x561d5ba69dd0 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f233033de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00de10 con 0x561d5ba6b8e0 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f23277fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f2326ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f23277fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39622/0 (socket says 10.20.193.28:39622) 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f23277fe640 1 -- 10.20.193.28:0/4101694939 learned_addr learned my addr 10.20.193.28:0/4101694939 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f2327fff640 1 --2- 10.20.193.28:0/4101694939 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 0x561d5ba9a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f2326ffd640 1 -- 10.20.193.28:0/4101694939 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 msgr2=0x561d5ba9a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f2326ffd640 1 --2- 10.20.193.28:0/4101694939 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 0x561d5ba9a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f2326ffd640 1 -- 10.20.193.28:0/4101694939 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 msgr2=0x561d5ba6e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:18.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f2326ffd640 1 --2- 10.20.193.28:0/4101694939 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.874+0000 7f2326ffd640 1 -- 10.20.193.28:0/4101694939 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5ba7bcc0 con 0x561d5ba6af60 2026-02-20T03:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f2326ffd640 1 --2- 10.20.193.28:0/4101694939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6e5c0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2318002410 tx=0x7f2318002d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8433ca58b7e894 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f22eb7fe640 1 -- 10.20.193.28:0/4101694939 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180028e0 con 0x561d5ba6af60 2026-02-20T03:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f22eb7fe640 1 -- 10.20.193.28:0/4101694939 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2318033040 con 0x561d5ba6af60 2026-02-20T03:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f22eb7fe640 1 -- 10.20.193.28:0/4101694939 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180047c0 con 0x561d5ba6af60 2026-02-20T03:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f233033de00 1 -- 10.20.193.28:0/4101694939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 msgr2=0x561d5ba6e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f233033de00 1 --2- 10.20.193.28:0/4101694939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6e5c0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2318002410 tx=0x7f2318002d50 comp rx=0 tx=0).stop 2026-02-20T03:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f233033de00 1 -- 10.20.193.28:0/4101694939 shutdown_connections 2026-02-20T03:27:18.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f233033de00 1 --2- 10.20.193.28:0/4101694939 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba6b8e0 0x561d5ba9a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f233033de00 1 --2- 10.20.193.28:0/4101694939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba6e5c0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f233033de00 1 --2- 10.20.193.28:0/4101694939 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba69dd0 0x561d5ba6e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f233033de00 1 -- 10.20.193.28:0/4101694939 >> 10.20.193.28:0/4101694939 conn(0x561d5ba611b0 msgr2=0x561d5ba845f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f233033de00 1 -- 10.20.193.28:0/4101694939 shutdown_connections 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.875+0000 7f233033de00 1 -- 10.20.193.28:0/4101694939 wait complete. 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f233033de00 1 -- start start 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f233033de00 1 Processor -- start 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f233033de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba69dd0 0x561d5ba8e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f233033de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba8e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f233033de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5bafd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f233033de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00e480 con 0x561d5ba6af60 2026-02-20T03:27:18.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f233033de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00f8f0 con 0x561d5ba6b8e0 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f233033de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00eb50 con 0x561d5ba69dd0 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f23277fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba69dd0 0x561d5ba8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f2327fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5bafd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f2326ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba8e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f2327fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5bafd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39630/0 (socket says 10.20.193.28:39630) 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.876+0000 7f2327fff640 1 -- 10.20.193.28:0/3780009830 learned_addr learned my addr 10.20.193.28:0/3780009830 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f23277fe640 1 -- 10.20.193.28:0/3780009830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 msgr2=0x561d5bafd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f23277fe640 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5bafd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f23277fe640 1 -- 10.20.193.28:0/3780009830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 msgr2=0x561d5ba8e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f23277fe640 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba8e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f23277fe640 1 -- 10.20.193.28:0/3780009830 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5b69bad0 con 0x561d5ba69dd0 2026-02-20T03:27:18.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f2327fff640 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5bafd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f2326ffd640 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba8e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f23277fe640 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba69dd0 0x561d5ba8e090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2314009480 tx=0x7f23140e1170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ccc9383e2a18c20 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f22e97fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f22e97fa640 1 -- 10.20.193.28:0/3780009830 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140a89a0 con 0x561d5ba69dd0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f233033de00 1 -- 10.20.193.28:0/3780009830 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d5b943370 con 0x561d5ba69dd0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f233033de00 10 client.27784 _ll_register_callbacks cb 0x7f23140e4de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f233033de00 1 -- 10.20.193.28:0/3780009830 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23140e9e00 con 0x561d5ba69dd0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f22e97fa640 1 -- 10.20.193.28:0/3780009830 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x561d5b9c4610 con 0x561d5ba69dd0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.877+0000 7f22e97fa640 1 -- 10.20.193.28:0/3780009830 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23140acf80 con 0x561d5ba69dd0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f22e97fa640 1 -- 10.20.193.28:0/3780009830 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f23140a4f70 con 0x561d5ba69dd0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f22e97fa640 1 -- 10.20.193.28:0/3780009830 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f23140b1e30 con 0x561d5ba69dd0 2026-02-20T03:27:18.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f233033de00 10 client.27784 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f233033de00 1 -- 10.20.193.28:0/3780009830 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561d5ba7c9b0 con 0x561d5ba69dd0 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f22e97fa640 1 -- 10.20.193.28:0/3780009830 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f2314093070 con 0x561d5ba69dd0 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f233033de00 10 client.27784 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f233033de00 10 client.27784 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f233033de00 20 client.27784 populate_metadata read hostname 'trial028' 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f233033de00 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d5bafe9b0 0x561d5bb00e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f233033de00 4 client.27784 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "29b98b59", "release": true, "await": true}] 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f233033de00 1 -- 10.20.193.28:0/3780009830 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "29b98b59", "release": true, "await": true}) -- 0x561d5b72cbf0 con 0x561d5bafe9b0 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.878+0000 7f2326ffd640 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d5bafe9b0 0x561d5bb00e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.879+0000 7f2326ffd640 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d5bafe9b0 0x561d5bb00e40 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d6f52d87995291d server_cookie=d07f6529f59b227f in_seq=0 out_seq=0 2026-02-20T03:27:18.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.879+0000 7f22e97fa640 10 client.27784 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:18.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.881+0000 7f22e97fa640 1 -- 10.20.193.28:0/3780009830 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561d5b72cbf0 con 0x561d5bafe9b0 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.881+0000 7f22e97fa640 10 client.27784 handle_command_reply: tid=0 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.881+0000 7f233033de00 1 client.27784 shutdown 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.881+0000 7f233033de00 1 -- 10.20.193.28:0/3780009830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba69dd0 msgr2=0x561d5ba8e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.881+0000 7f233033de00 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba69dd0 0x561d5ba8e090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2314009480 tx=0x7f23140e1170 comp rx=0 tx=0).stop 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f233033de00 1 -- 10.20.193.28:0/3780009830 shutdown_connections 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f233033de00 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561d5bafe9b0 0x561d5bb00e40 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f233033de00 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561d5ba6b8e0 0x561d5bafd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f233033de00 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561d5ba6af60 0x561d5ba8e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f233033de00 1 --2- 10.20.193.28:0/3780009830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561d5ba69dd0 0x561d5ba8e090 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f233033de00 1 -- 10.20.193.28:0/3780009830 >> 10.20.193.28:0/3780009830 conn(0x561d5ba611b0 msgr2=0x561d5ba6e080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:18.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f22e97fa640 0 client.27784 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:18.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f233033de00 1 -- 10.20.193.28:0/3780009830 shutdown_connections 2026-02-20T03:27:18.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f233033de00 1 -- 10.20.193.28:0/3780009830 wait complete. 2026-02-20T03:27:18.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f233033de00 20 client.27784 trim_cache size 0 max 16384 2026-02-20T03:27:18.888 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:27:18.888 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 30, 2026-02-20T03:27:18.888 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 44, 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "29b98b59": { 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "version": 44, 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:27:18.889 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 150.0, 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:27:18.890 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f232cbaf640 1 -- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22fc0b0e20 msgr2=0x7f22fc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22fc0b0e20 0x7f22fc0b32e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f231c007550 tx=0x7f231c00b040 comp rx=0 tx=0).stop 2026-02-20T03:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f232cbaf640 1 -- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 msgr2=0x7f232819d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.882+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 0x7f232819d0d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f231400ea30 tx=0x7f231400ef00 comp rx=0 tx=0).stop 2026-02-20T03:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.883+0000 7f232cbaf640 1 -- 10.20.193.28:0/3473666909 shutdown_connections 2026-02-20T03:27:18.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.883+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22fc0b0e20 0x7f22fc0b32e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.883+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f232810a980 0x7f23281a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.883+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2328105320 0x7f232819d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.883+0000 7f232cbaf640 1 --2- 10.20.193.28:0/3473666909 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104980 0x7f232819d0d0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.883+0000 7f232cbaf640 1 -- 10.20.193.28:0/3473666909 >> 10.20.193.28:0/3473666909 conn(0x7f2328100680 msgr2=0x7f2328101050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.883+0000 7f232cbaf640 1 -- 10.20.193.28:0/3473666909 shutdown_connections 2026-02-20T03:27:18.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:18.883+0000 7f232cbaf640 1 -- 10.20.193.28:0/3473666909 wait complete. 2026-02-20T03:27:19.021 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '29b98b59', total seconds elapsed: 31.4 2026-02-20T03:27:19.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1034083 7.49 MB/sec execute 532 sec latency 28636.117 ms 2026-02-20T03:27:19.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:19 trial028 ceph-mon[38552]: pgmap v561: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2026-02-20T03:27:19.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:19 trial126 ceph-mon[38476]: pgmap v561: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2026-02-20T03:27:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:19 trial177 ceph-mon[43181]: pgmap v561: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2026-02-20T03:27:20.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1036759 7.50 MB/sec execute 533 sec latency 138.094 ms 2026-02-20T03:27:21.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1040086 7.52 MB/sec execute 534 sec latency 7.236 ms 2026-02-20T03:27:21.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:21 trial126 ceph-mon[38476]: pgmap v562: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 285 KiB/s rd, 107 KiB/s wr, 15 op/s 2026-02-20T03:27:21.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:21 trial028 ceph-mon[38552]: pgmap v562: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 285 KiB/s rd, 107 KiB/s wr, 15 op/s 2026-02-20T03:27:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:21 trial177 ceph-mon[43181]: pgmap v562: 129 pgs: 129 active+clean; 166 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 285 KiB/s rd, 107 KiB/s wr, 15 op/s 2026-02-20T03:27:22.527 INFO:tasks.workunit.client.0.trial028.stdout: 1 1043304 7.53 MB/sec execute 535 sec latency 7.414 ms 2026-02-20T03:27:23.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1046615 7.55 MB/sec execute 536 sec latency 8.231 ms 2026-02-20T03:27:23.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:23 trial126 ceph-mon[38476]: pgmap v563: 129 pgs: 129 active+clean; 167 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 644 KiB/s rd, 218 KiB/s wr, 29 op/s 2026-02-20T03:27:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:23 trial028 ceph-mon[38552]: pgmap v563: 129 pgs: 129 active+clean; 167 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 644 KiB/s rd, 218 KiB/s wr, 29 op/s 2026-02-20T03:27:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:23 trial177 ceph-mon[43181]: pgmap v563: 129 pgs: 129 active+clean; 167 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 644 KiB/s rd, 218 KiB/s wr, 29 op/s 2026-02-20T03:27:24.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1049740 7.57 MB/sec execute 537 sec latency 8.060 ms 2026-02-20T03:27:25.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1053038 7.59 MB/sec execute 538 sec latency 15.310 ms 2026-02-20T03:27:25.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:25 trial126 ceph-mon[38476]: pgmap v564: 129 pgs: 129 active+clean; 170 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 560 KiB/s wr, 96 op/s 2026-02-20T03:27:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:25 trial028 ceph-mon[38552]: pgmap v564: 129 pgs: 129 active+clean; 170 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 560 KiB/s wr, 96 op/s 2026-02-20T03:27:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:25 trial177 ceph-mon[43181]: pgmap v564: 129 pgs: 129 active+clean; 170 MiB data, 3.8 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 560 KiB/s wr, 96 op/s 2026-02-20T03:27:26.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1056490 7.61 MB/sec execute 539 sec latency 7.366 ms 2026-02-20T03:27:27.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1059668 7.63 MB/sec execute 540 sec latency 8.937 ms 2026-02-20T03:27:27.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:27 trial126 ceph-mon[38476]: pgmap v565: 129 pgs: 129 active+clean; 173 MiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 977 KiB/s wr, 166 op/s 2026-02-20T03:27:27.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:27 trial028 ceph-mon[38552]: pgmap v565: 129 pgs: 129 active+clean; 173 MiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 977 KiB/s wr, 166 op/s 2026-02-20T03:27:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:27 trial177 ceph-mon[43181]: pgmap v565: 129 pgs: 129 active+clean; 173 MiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 977 KiB/s wr, 166 op/s 2026-02-20T03:27:28.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1063034 7.65 MB/sec execute 541 sec latency 7.409 ms 2026-02-20T03:27:29.427 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:27:29.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1066562 7.67 MB/sec execute 542 sec latency 6.748 ms 2026-02-20T03:27:29.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:29 trial126 ceph-mon[38476]: pgmap v566: 129 pgs: 129 active+clean; 175 MiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 190 op/s 2026-02-20T03:27:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:29 trial028 ceph-mon[38552]: pgmap v566: 129 pgs: 129 active+clean; 175 MiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 190 op/s 2026-02-20T03:27:29.698 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:27:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:29 trial177 ceph-mon[43181]: pgmap v566: 129 pgs: 129 active+clean; 175 MiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 1.1 MiB/s wr, 190 op/s 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.884+0000 7f7d13fff640 1 -- 10.20.193.28:0/694799800 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141065d0 msgr2=0x7f7d14075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.884+0000 7f7d13fff640 1 --2- 10.20.193.28:0/694799800 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141065d0 0x7f7d14075410 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009a30 tx=0x7f7d0802f2d0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.884+0000 7f7d13fff640 1 -- 10.20.193.28:0/694799800 shutdown_connections 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.884+0000 7f7d13fff640 1 --2- 10.20.193.28:0/694799800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d141134d0 0x7f7d14115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.884+0000 7f7d13fff640 1 --2- 10.20.193.28:0/694799800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d14075950 0x7f7d14075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.884+0000 7f7d13fff640 1 --2- 10.20.193.28:0/694799800 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141065d0 0x7f7d14075410 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.884+0000 7f7d13fff640 1 -- 10.20.193.28:0/694799800 >> 10.20.193.28:0/694799800 conn(0x7f7d140fe440 msgr2=0x7f7d14100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.884+0000 7f7d13fff640 1 -- 10.20.193.28:0/694799800 shutdown_connections 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.885+0000 7f7d13fff640 1 -- 10.20.193.28:0/694799800 wait complete. 2026-02-20T03:27:29.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.885+0000 7f7d13fff640 1 Processor -- start 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.886+0000 7f7d13fff640 1 -- start start 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.886+0000 7f7d13fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d14075950 0x7f7d141a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.886+0000 7f7d13fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d141065d0 0x7f7d141a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.886+0000 7f7d13fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141134d0 0x7f7d141a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.886+0000 7f7d13fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7d14119120 con 0x7f7d14075950 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.886+0000 7f7d13fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7d14118fa0 con 0x7f7d141134d0 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.886+0000 7f7d13fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d141192a0 con 0x7f7d141065d0 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.887+0000 7f7d137fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141134d0 0x7f7d141a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.887+0000 7f7d137fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141134d0 0x7f7d141a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49648/0 (socket says 10.20.193.28:49648) 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.887+0000 7f7d137fe640 1 -- 10.20.193.28:0/2590751590 learned_addr learned my addr 10.20.193.28:0/2590751590 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:29.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.887+0000 7f7d137fe640 1 -- 10.20.193.28:0/2590751590 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d141065d0 msgr2=0x7f7d141a1b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:27:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.888+0000 7f7d137fe640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d141065d0 0x7f7d141a1b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.888+0000 7f7d137fe640 1 -- 10.20.193.28:0/2590751590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d14075950 msgr2=0x7f7d141a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.888+0000 7f7d137fe640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d14075950 0x7f7d141a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.888+0000 7f7d137fe640 1 -- 10.20.193.28:0/2590751590 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d141a6610 con 0x7f7d141134d0 2026-02-20T03:27:29.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.889+0000 7f7d137fe640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141134d0 0x7f7d141a5e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400b970 tx=0x7f7d0400be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.889+0000 7f7d1889d640 1 -- 10.20.193.28:0/2590751590 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400c790 con 0x7f7d141134d0 2026-02-20T03:27:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.890+0000 7f7d1889d640 1 -- 10.20.193.28:0/2590751590 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d04010070 con 0x7f7d141134d0 2026-02-20T03:27:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.890+0000 7f7d1889d640 1 -- 10.20.193.28:0/2590751590 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04015470 con 0x7f7d141134d0 2026-02-20T03:27:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.890+0000 7f7d13fff640 1 -- 10.20.193.28:0/2590751590 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d141a6900 con 0x7f7d141134d0 2026-02-20T03:27:29.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.890+0000 7f7d13fff640 1 -- 10.20.193.28:0/2590751590 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d141ae140 con 0x7f7d141134d0 2026-02-20T03:27:29.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.893+0000 7f7d1889d640 1 -- 10.20.193.28:0/2590751590 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7d0401d030 con 0x7f7d141134d0 2026-02-20T03:27:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1889d640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ce80b0e20 0x7f7ce80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1889d640 1 -- 10.20.193.28:0/2590751590 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7d040e1040 con 0x7f7d141134d0 2026-02-20T03:27:29.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1bda4e00 1 Processor -- start 2026-02-20T03:27:29.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1bda4e00 1 -- start start 2026-02-20T03:27:29.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102eb000 0x55e8102eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 0x55e8102e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5fb0 0x55e8102f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e810265e50 con 0x55e8102eb000 2026-02-20T03:27:29.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e8102389c0 con 0x55e8102e5630 2026-02-20T03:27:29.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.895+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e8101e6240 con 0x55e8102e5fb0 2026-02-20T03:27:29.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ce80b0e20 0x7f7ce80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d127fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 0x55e8102e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d12ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102eb000 0x55e8102eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d127fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 0x55e8102e5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49654/0 (socket says 10.20.193.28:49654) 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d127fc640 1 -- 10.20.193.28:0/3106911850 learned_addr learned my addr 10.20.193.28:0/3106911850 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d137fe640 1 --2- 10.20.193.28:0/3106911850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5fb0 0x55e8102f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ce80b0e20 0x7f7ce80b32e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7d08005d20 tx=0x7f7d08002da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d12ffd640 1 -- 10.20.193.28:0/3106911850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5fb0 msgr2=0x55e8102f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/3106911850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5fb0 0x55e8102f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d12ffd640 1 -- 10.20.193.28:0/3106911850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 msgr2=0x55e8102e5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/3106911850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 0x55e8102e5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.896+0000 7f7d12ffd640 1 -- 10.20.193.28:0/3106911850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8101f9420 con 0x55e8102eb000 2026-02-20T03:27:29.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.897+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/3106911850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102eb000 0x55e8102eb3e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009a00 tx=0x7f7d08044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5398f890f16b6943 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.897+0000 7f7cd7fff640 1 -- 10.20.193.28:0/3106911850 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08004130 con 0x55e8102eb000 2026-02-20T03:27:29.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.897+0000 7f7cd7fff640 1 -- 10.20.193.28:0/3106911850 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d08033040 con 0x55e8102eb000 2026-02-20T03:27:29.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.897+0000 7f7cd7fff640 1 -- 10.20.193.28:0/3106911850 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08004130 con 0x55e8102eb000 2026-02-20T03:27:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.898+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/3106911850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102eb000 msgr2=0x55e8102eb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.898+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/3106911850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102eb000 0x55e8102eb3e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7d08009a00 tx=0x7f7d08044000 comp rx=0 tx=0).stop 2026-02-20T03:27:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.898+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/3106911850 shutdown_connections 2026-02-20T03:27:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.898+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/3106911850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5fb0 0x55e8102f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.898+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/3106911850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 0x55e8102e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.898+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/3106911850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102eb000 0x55e8102eb3e0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.898+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/3106911850 >> 10.20.193.28:0/3106911850 conn(0x55e8102a8290 msgr2=0x55e8102e3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.898+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/3106911850 shutdown_connections 2026-02-20T03:27:29.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.898+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/3106911850 wait complete. 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.899+0000 7f7d1bda4e00 1 -- start start 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.899+0000 7f7d1bda4e00 1 Processor -- start 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.900+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 0x55e8102fe130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.900+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 0x55e8102fe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.900+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e810303bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.900+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e8102348f0 con 0x55e8102e5fb0 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.900+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e810026f50 con 0x55e8102e5630 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.900+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e810304130 con 0x55e8102eb000 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.901+0000 7f7d137fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e810303bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.901+0000 7f7d137fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e810303bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49476/0 (socket says 10.20.193.28:49476) 2026-02-20T03:27:29.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.901+0000 7f7d137fe640 1 -- 10.20.193.28:0/2494472965 learned_addr learned my addr 10.20.193.28:0/2494472965 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:29.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.901+0000 7f7d137fe640 1 -- 10.20.193.28:0/2494472965 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 msgr2=0x55e8102fe130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.901+0000 7f7d137fe640 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 0x55e8102fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.901+0000 7f7d137fe640 1 -- 10.20.193.28:0/2494472965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 msgr2=0x55e8102fe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.902+0000 7f7d127fc640 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 0x55e8102fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.902+0000 7f7d137fe640 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 0x55e8102fe670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.902+0000 7f7d137fe640 1 -- 10.20.193.28:0/2494472965 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8102f7ad0 con 0x55e8102eb000 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.902+0000 7f7d127fc640 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 0x55e8102fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.902+0000 7f7d137fe640 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e810303bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d040a5da0 tx=0x7f7d040a43c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de6390313b9b63f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.902+0000 7f7cd57fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.903+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2494472965 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040a9480 con 0x55e8102eb000 2026-02-20T03:27:29.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.903+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2494472965 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d040ad130 con 0x55e8102eb000 2026-02-20T03:27:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.903+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2494472965 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d040a7d90 con 0x55e8102eb000 2026-02-20T03:27:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.903+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2494472965 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e810009b40 con 0x55e8102eb000 2026-02-20T03:27:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.903+0000 7f7d1bda4e00 10 client.27793 _ll_register_callbacks cb 0x55e810271f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.903+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2494472965 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e8102461a0 con 0x55e8102eb000 2026-02-20T03:27:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.904+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2494472965 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7d040a7f50 con 0x55e8102eb000 2026-02-20T03:27:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.904+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2494472965 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7d040b1fe0 con 0x55e8102eb000 2026-02-20T03:27:29.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.904+0000 7f7d1bda4e00 10 client.27793 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.905+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2494472965 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55e8101f3230 con 0x55e8102eb000 2026-02-20T03:27:29.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.905+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2494472965 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7d040c30a0 con 0x55e8102eb000 2026-02-20T03:27:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.905+0000 7f7d1bda4e00 10 client.27793 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.905+0000 7f7d1bda4e00 10 client.27793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.905+0000 7f7d1bda4e00 20 client.27793 populate_metadata read hostname 'trial028' 2026-02-20T03:27:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.905+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e81030e1b0 0x55e810310600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.905+0000 7f7d1bda4e00 4 client.27793 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.905+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2494472965 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8102405b0 con 0x55e81030e1b0 2026-02-20T03:27:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.905+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e81030e1b0 0x55e810310600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.906+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e81030e1b0 0x55e810310600 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3ed289ade57d38e server_cookie=261c1469e2908d62 in_seq=0 out_seq=0 2026-02-20T03:27:29.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.906+0000 7f7cd57fa640 10 client.27793 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.907+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2494472965 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e8102405b0 con 0x55e81030e1b0 2026-02-20T03:27:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.907+0000 7f7cd57fa640 10 client.27793 handle_command_reply: tid=0 2026-02-20T03:27:29.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.907+0000 7f7d1bda4e00 1 client.27793 shutdown 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2494472965 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 msgr2=0x55e810303bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e810303bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7d040a5da0 tx=0x7f7d040a43c0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2494472965 shutdown_connections 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e81030e1b0 0x55e810310600 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e810303bf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 0x55e8102fe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2494472965 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5630 0x55e8102fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2494472965 >> 10.20.193.28:0/2494472965 conn(0x55e8102a8290 msgr2=0x55e8102e4440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7cd57fa640 0 client.27793 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2494472965 shutdown_connections 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2494472965 wait complete. 2026-02-20T03:27:29.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.908+0000 7f7d1bda4e00 20 client.27793 trim_cache size 0 max 16384 2026-02-20T03:27:29.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.918+0000 7f7d1bda4e00 1 Processor -- start 2026-02-20T03:27:29.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.918+0000 7f7d1bda4e00 1 -- start start 2026-02-20T03:27:29.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5630 0x55e81030e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5fb0 0x55e81030ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e8102fb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb80126e0 con 0x55e8102e5630 2026-02-20T03:27:29.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb800ffb0 con 0x55e8102e5fb0 2026-02-20T03:27:29.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb800de00 con 0x55e8102eb000 2026-02-20T03:27:29.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d127fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5fb0 0x55e81030ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d127fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5fb0 0x55e81030ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49680/0 (socket says 10.20.193.28:49680) 2026-02-20T03:27:29.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d127fc640 1 -- 10.20.193.28:0/292890126 learned_addr learned my addr 10.20.193.28:0/292890126 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:29.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d137fe640 1 --2- 10.20.193.28:0/292890126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e8102fb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d127fc640 1 -- 10.20.193.28:0/292890126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 msgr2=0x55e8102fb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:29.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d127fc640 1 --2- 10.20.193.28:0/292890126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e8102fb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d127fc640 1 -- 10.20.193.28:0/292890126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5630 msgr2=0x55e81030e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:29.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d127fc640 1 --2- 10.20.193.28:0/292890126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5630 0x55e81030e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.919+0000 7f7d127fc640 1 -- 10.20.193.28:0/292890126 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8102f7900 con 0x55e8102e5fb0 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.920+0000 7f7d137fe640 1 --2- 10.20.193.28:0/292890126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e8102fb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.920+0000 7f7d127fc640 1 --2- 10.20.193.28:0/292890126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5fb0 0x55e81030ee00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc004470 tx=0x7f7cfc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2ee5249cd02be2f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.920+0000 7f7cd77fe640 1 -- 10.20.193.28:0/292890126 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc002c40 con 0x55e8102e5fb0 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.920+0000 7f7cd77fe640 1 -- 10.20.193.28:0/292890126 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7cfc002de0 con 0x55e8102e5fb0 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.920+0000 7f7cd77fe640 1 -- 10.20.193.28:0/292890126 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0127d0 con 0x55e8102e5fb0 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.920+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/292890126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5fb0 msgr2=0x55e81030ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.920+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/292890126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5fb0 0x55e81030ee00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc004470 tx=0x7f7cfc009b90 comp rx=0 tx=0).stop 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.921+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/292890126 shutdown_connections 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.921+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/292890126 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102eb000 0x55e8102fb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.921+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/292890126 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102e5fb0 0x55e81030ee00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.921+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/292890126 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5630 0x55e81030e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.921+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/292890126 >> 10.20.193.28:0/292890126 conn(0x55e8102a8290 msgr2=0x55e81030e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:29.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.921+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/292890126 shutdown_connections 2026-02-20T03:27:29.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.921+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/292890126 wait complete. 2026-02-20T03:27:29.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.922+0000 7f7d1bda4e00 1 -- start start 2026-02-20T03:27:29.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.922+0000 7f7d1bda4e00 1 Processor -- start 2026-02-20T03:27:29.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.922+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5630 0x55e810307560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 0x55e810307aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d1bda4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102eb000 0x55e810307fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb800e470 con 0x55e8102e5fb0 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb800f8e0 con 0x55e8102eb000 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d1bda4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb800eb40 con 0x55e8102e5630 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d12ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5630 0x55e810307560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d12ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5630 0x55e810307560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49486/0 (socket says 10.20.193.28:49486) 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d12ffd640 1 -- 10.20.193.28:0/2579352691 learned_addr learned my addr 10.20.193.28:0/2579352691 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d127fc640 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 0x55e810307aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d137fe640 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102eb000 0x55e810307fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d12ffd640 1 -- 10.20.193.28:0/2579352691 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102eb000 msgr2=0x55e810307fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102eb000 0x55e810307fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d12ffd640 1 -- 10.20.193.28:0/2579352691 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 msgr2=0x55e810307aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 0x55e810307aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d12ffd640 1 -- 10.20.193.28:0/2579352691 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e80ff17870 con 0x55e8102e5630 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d137fe640 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102eb000 0x55e810307fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7d12ffd640 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5630 0x55e810307560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7d0802f7e0 tx=0x7f7d08045ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fea5c1c06e3535 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.923+0000 7f7cd57fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.924+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2579352691 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08041040 con 0x55e8102e5630 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.924+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2579352691 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d0805a030 con 0x55e8102e5630 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.924+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2579352691 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08005130 con 0x55e8102e5630 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.924+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2579352691 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8101d8440 con 0x55e8102e5630 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.924+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2579352691 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7d080052d0 con 0x55e8102e5630 2026-02-20T03:27:29.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.924+0000 7f7cd57fa640 10 client.27796 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.925+0000 7f7d1bda4e00 10 client.27796 _ll_register_callbacks cb 0x7f7d04009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.925+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2579352691 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d08033040 con 0x55e8102e5630 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.926+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2579352691 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7d080092e0 con 0x55e8102e5630 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.926+0000 7f7d1bda4e00 10 client.27796 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.926+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2579352691 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55e8102f85f0 con 0x55e8102e5630 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.927+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2579352691 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7d0804c070 con 0x55e8102e5630 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.927+0000 7f7d1bda4e00 10 client.27796 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.927+0000 7f7d1bda4e00 10 client.27796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.927+0000 7f7d1bda4e00 20 client.27796 populate_metadata read hostname 'trial028' 2026-02-20T03:27:29.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.927+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e81037a2a0 0x55e81037c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.927+0000 7f7d1bda4e00 4 client.27796 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.927+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2579352691 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e810209810 con 0x55e81037a2a0 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.927+0000 7f7d127fc640 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e81037a2a0 0x55e81037c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7cd57fa640 10 client.27796 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d127fc640 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e81037a2a0 0x55e81037c6f0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74b87837a2d8e683 server_cookie=61e3c56e59e00873 in_seq=0 out_seq=0 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7cd57fa640 1 -- 10.20.193.28:0/2579352691 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e810209810 con 0x55e81037a2a0 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7cd57fa640 10 client.27796 handle_command_reply: tid=0 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d1bda4e00 1 client.27796 shutdown 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2579352691 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5630 msgr2=0x55e810307560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:29.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5630 0x55e810307560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7d0802f7e0 tx=0x7f7d08045ee0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2579352691 shutdown_connections 2026-02-20T03:27:29.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e81037a2a0 0x55e81037c6f0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e8102eb000 0x55e810307fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e8102e5fb0 0x55e810307aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d1bda4e00 1 --2- 10.20.193.28:0/2579352691 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e8102e5630 0x55e810307560 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2579352691 >> 10.20.193.28:0/2579352691 conn(0x55e8102a8290 msgr2=0x55e81030e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:29.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.928+0000 7f7cd57fa640 0 client.27796 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:29.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.929+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2579352691 shutdown_connections 2026-02-20T03:27:29.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.929+0000 7f7d1bda4e00 1 -- 10.20.193.28:0/2579352691 wait complete. 2026-02-20T03:27:29.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.929+0000 7f7d1bda4e00 20 client.27796 trim_cache size 0 max 16384 2026-02-20T03:27:29.934 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:27:29.934 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:27:29.934 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:27:29.934 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.929+0000 7f7d13fff640 1 -- 10.20.193.28:0/2590751590 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ce80b0e20 msgr2=0x7f7ce80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.929+0000 7f7d13fff640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ce80b0e20 0x7f7ce80b32e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7d08005d20 tx=0x7f7d08002da0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.929+0000 7f7d13fff640 1 -- 10.20.193.28:0/2590751590 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141134d0 msgr2=0x7f7d141a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.929+0000 7f7d13fff640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141134d0 0x7f7d141a5e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400b970 tx=0x7f7d0400be40 comp rx=0 tx=0).stop 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.930+0000 7f7d13fff640 1 -- 10.20.193.28:0/2590751590 shutdown_connections 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.930+0000 7f7d13fff640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7ce80b0e20 0x7f7ce80b32e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.930+0000 7f7d13fff640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d141134d0 0x7f7d141a5e90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.930+0000 7f7d13fff640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d141065d0 0x7f7d141a1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.930+0000 7f7d13fff640 1 --2- 10.20.193.28:0/2590751590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d14075950 0x7f7d141a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:29.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.930+0000 7f7d13fff640 1 -- 10.20.193.28:0/2590751590 >> 10.20.193.28:0/2590751590 conn(0x7f7d140fe440 msgr2=0x7f7d14111560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:29.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.930+0000 7f7d13fff640 1 -- 10.20.193.28:0/2590751590 shutdown_connections 2026-02-20T03:27:29.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:29.930+0000 7f7d13fff640 1 -- 10.20.193.28:0/2590751590 wait complete. 2026-02-20T03:27:30.037 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:27:30.038 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:27:30.303 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:27:30.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 -- 10.20.193.28:0/2272117528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9c410c090 msgr2=0x7fb9c410ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 --2- 10.20.193.28:0/2272117528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9c410c090 0x7fb9c410ff50 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009990 tx=0x7fb9ac02f170 comp rx=0 tx=0).stop 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 -- 10.20.193.28:0/2272117528 shutdown_connections 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 --2- 10.20.193.28:0/2272117528 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb9c4110660 0x7fb9c4118200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 --2- 10.20.193.28:0/2272117528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9c410c090 0x7fb9c410ff50 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 --2- 10.20.193.28:0/2272117528 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb9c410b6e0 0x7fb9c410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 -- 10.20.193.28:0/2272117528 >> 10.20.193.28:0/2272117528 conn(0x7fb9c40721e0 msgr2=0x7fb9c4074600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 -- 10.20.193.28:0/2272117528 shutdown_connections 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 -- 10.20.193.28:0/2272117528 wait complete. 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.482+0000 7fb9c9111640 1 Processor -- start 2026-02-20T03:27:30.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c9111640 1 -- start start 2026-02-20T03:27:30.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c9111640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb9c410b6e0 0x7fb9c41ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:30.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c9111640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb9c410c090 0x7fb9c41abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:30.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c9111640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9c4110660 0x7fb9c41a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:30.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c9111640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c411b4b0 con 0x7fb9c4110660 2026-02-20T03:27:30.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c9111640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c411b330 con 0x7fb9c410b6e0 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c9111640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c411b630 con 0x7fb9c410c090 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c2d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb9c410b6e0 0x7fb9c41ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c2d76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb9c410b6e0 0x7fb9c41ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49714/0 (socket says 10.20.193.28:49714) 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c2d76640 1 -- 10.20.193.28:0/495956886 learned_addr learned my addr 10.20.193.28:0/495956886 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c3577640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9c4110660 0x7fb9c41a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c2575640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb9c410c090 0x7fb9c41abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c2d76640 1 -- 10.20.193.28:0/495956886 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb9c410c090 msgr2=0x7fb9c41abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c2d76640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb9c410c090 0x7fb9c41abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c2d76640 1 -- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9c4110660 msgr2=0x7fb9c41a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c2d76640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9c4110660 0x7fb9c41a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c2d76640 1 -- 10.20.193.28:0/495956886 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c41a6240 con 0x7fb9c410b6e0 2026-02-20T03:27:30.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.483+0000 7fb9c3577640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9c4110660 0x7fb9c41a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:30.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.484+0000 7fb9c2d76640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb9c410b6e0 0x7fb9c41ab8b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800ea30 tx=0x7fb9b800ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:30.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.484+0000 7fb9a3fff640 1 -- 10.20.193.28:0/495956886 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800ce50 con 0x7fb9c410b6e0 2026-02-20T03:27:30.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.484+0000 7fb9a3fff640 1 -- 10.20.193.28:0/495956886 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb9b8004570 con 0x7fb9c410b6e0 2026-02-20T03:27:30.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.484+0000 7fb9a3fff640 1 -- 10.20.193.28:0/495956886 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8010690 con 0x7fb9c410b6e0 2026-02-20T03:27:30.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.484+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c41a6530 con 0x7fb9c410b6e0 2026-02-20T03:27:30.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.484+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c41b2780 con 0x7fb9c410b6e0 2026-02-20T03:27:30.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.485+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c410bac0 con 0x7fb9c410b6e0 2026-02-20T03:27:30.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.487+0000 7fb9a3fff640 1 -- 10.20.193.28:0/495956886 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb9b8002920 con 0x7fb9c410b6e0 2026-02-20T03:27:30.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.489+0000 7fb9a3fff640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb9980b0da0 0x7fb9980b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:30.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.489+0000 7fb9a3fff640 1 -- 10.20.193.28:0/495956886 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fb9b80e0ff0 con 0x7fb9c410b6e0 2026-02-20T03:27:30.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.489+0000 7fb9a3fff640 1 -- 10.20.193.28:0/495956886 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb9b80e14b0 con 0x7fb9c410b6e0 2026-02-20T03:27:30.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.489+0000 7fb9c2575640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb9980b0da0 0x7fb9980b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:30.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.489+0000 7fb9c2575640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb9980b0da0 0x7fb9980b3260 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb9c41a7260 tx=0x7fb9ac0057f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:30.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1069949 7.69 MB/sec execute 543 sec latency 10.786 ms 2026-02-20T03:27:30.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.598+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9c41b2a60 con 0x7fb9c410b6e0 2026-02-20T03:27:30.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.599+0000 7fb9a3fff640 1 -- 10.20.193.28:0/495956886 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11921 (secure 0 0 0) 0x7fb9b80a94a0 con 0x7fb9c410b6e0 2026-02-20T03:27:30.603 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:27:30.603 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T03:25:19:519285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:25:19.519275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:27:30.604 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T03:27:30.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.600+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb9980b0da0 msgr2=0x7fb9980b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:30.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.600+0000 7fb9c9111640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb9980b0da0 0x7fb9980b3260 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb9c41a7260 tx=0x7fb9ac0057f0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.600+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb9c410b6e0 msgr2=0x7fb9c41ab8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.600+0000 7fb9c9111640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb9c410b6e0 0x7fb9c41ab8b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800ea30 tx=0x7fb9b800ef00 comp rx=0 tx=0).stop 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.601+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 shutdown_connections 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.601+0000 7fb9c9111640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb9980b0da0 0x7fb9980b3260 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.601+0000 7fb9c9111640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb9c4110660 0x7fb9c41a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.601+0000 7fb9c9111640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb9c410c090 0x7fb9c41abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.601+0000 7fb9c9111640 1 --2- 10.20.193.28:0/495956886 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb9c410b6e0 0x7fb9c41ab8b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.601+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 >> 10.20.193.28:0/495956886 conn(0x7fb9c40721e0 msgr2=0x7fb9c40725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.601+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 shutdown_connections 2026-02-20T03:27:30.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:30.601+0000 7fb9c9111640 1 -- 10.20.193.28:0/495956886 wait complete. 2026-02-20T03:27:30.704 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:27:30.987 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:27:30.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.992+0000 7f5f26f91640 1 -- 10.20.193.28:0/1244456132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f201064e0 msgr2=0x7f5f2010cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:30.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.992+0000 7f5f26f91640 1 --2- 10.20.193.28:0/1244456132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f201064e0 0x7f5f2010cd70 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c00b0a0 tx=0x7f5f1c02f450 comp rx=0 tx=0).stop 2026-02-20T03:27:30.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.992+0000 7f5f26f91640 1 -- 10.20.193.28:0/1244456132 shutdown_connections 2026-02-20T03:27:30.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.992+0000 7f5f26f91640 1 --2- 10.20.193.28:0/1244456132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f201064e0 0x7f5f2010cd70 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.992+0000 7f5f26f91640 1 --2- 10.20.193.28:0/1244456132 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5f20105b20 0x7f5f20105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.992+0000 7f5f26f91640 1 --2- 10.20.193.28:0/1244456132 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5f20104930 0x7f5f20104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.992+0000 7f5f26f91640 1 -- 10.20.193.28:0/1244456132 >> 10.20.193.28:0/1244456132 conn(0x7f5f20100090 msgr2=0x7f5f201024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:30.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.992+0000 7f5f26f91640 1 -- 10.20.193.28:0/1244456132 shutdown_connections 2026-02-20T03:27:30.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.992+0000 7f5f26f91640 1 -- 10.20.193.28:0/1244456132 wait complete. 2026-02-20T03:27:30.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.993+0000 7f5f26f91640 1 Processor -- start 2026-02-20T03:27:30.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.993+0000 7f5f26f91640 1 -- start start 2026-02-20T03:27:30.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.993+0000 7f5f26f91640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5f20104930 0x7f5f2019c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:30.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.993+0000 7f5f26f91640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f20105b20 0x7f5f2019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.993+0000 7f5f26f91640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5f201064e0 0x7f5f201a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f26f91640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20110400 con 0x7f5f20105b20 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f26f91640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20110280 con 0x7f5f20104930 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f26f91640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f20110580 con 0x7f5f201064e0 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f2578e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f20105b20 0x7f5f2019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f26790640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5f201064e0 0x7f5f201a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f2578e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f20105b20 0x7f5f2019cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54610/0 (socket says 10.20.193.28:54610) 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f2578e640 1 -- 10.20.193.28:0/3816071786 learned_addr learned my addr 10.20.193.28:0/3816071786 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5f20104930 0x7f5f2019c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f2578e640 1 -- 10.20.193.28:0/3816071786 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5f201064e0 msgr2=0x7f5f201a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f2578e640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5f201064e0 0x7f5f201a3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f2578e640 1 -- 10.20.193.28:0/3816071786 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5f20104930 msgr2=0x7f5f2019c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f2578e640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5f20104930 0x7f5f2019c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f2578e640 1 -- 10.20.193.28:0/3816071786 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f201a4610 con 0x7f5f20105b20 2026-02-20T03:27:30.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5f20104930 0x7f5f2019c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:27:30.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f2578e640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f20105b20 0x7f5f2019cea0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400ea10 tx=0x7f5f1400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:30.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f0effd640 1 -- 10.20.193.28:0/3816071786 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1400ce50 con 0x7f5f20105b20 2026-02-20T03:27:30.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f0effd640 1 -- 10.20.193.28:0/3816071786 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5f14004570 con 0x7f5f20105b20 2026-02-20T03:27:30.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f0effd640 1 -- 10.20.193.28:0/3816071786 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14010690 con 0x7f5f20105b20 2026-02-20T03:27:30.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f26f91640 1 -- 10.20.193.28:0/3816071786 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f201a4900 con 0x7f5f20105b20 2026-02-20T03:27:30.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.994+0000 7f5f26f91640 1 -- 10.20.193.28:0/3816071786 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f201a4e00 con 0x7f5f20105b20 2026-02-20T03:27:31.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.997+0000 7f5f0effd640 1 -- 10.20.193.28:0/3816071786 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5f14020030 con 0x7f5f20105b20 2026-02-20T03:27:31.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.998+0000 7f5f2b07be00 1 Processor -- start 2026-02-20T03:27:31.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.998+0000 7f5f0effd640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5efc0b0fc0 0x7f5efc0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f0effd640 1 -- 10.20.193.28:0/3816071786 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5f140e0be0 con 0x7f5f20105b20 2026-02-20T03:27:31.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f2b07be00 1 -- start start 2026-02-20T03:27:31.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f26790640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5efc0b0fc0 0x7f5efc0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef08ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef093950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef096400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f2b07be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5582eefd68f0 con 0x5582ef093f70 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f2b07be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5582eef842e0 con 0x5582ef08f1d0 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f2b07be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5582eefd2820 con 0x5582ef08e890 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f25f8f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef08ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f25f8f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef08ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49534/0 (socket says 10.20.193.28:49534) 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f25f8f640 1 -- 10.20.193.28:0/1622887679 learned_addr learned my addr 10.20.193.28:0/1622887679 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f2578e640 1 --2- 10.20.193.28:0/1622887679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef093950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f25f8f640 1 -- 10.20.193.28:0/1622887679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 msgr2=0x5582ef093950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/1622887679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef093950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f25f8f640 1 -- 10.20.193.28:0/1622887679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 msgr2=0x5582ef096400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/1622887679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef096400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:30.999+0000 7f5f25f8f640 1 -- 10.20.193.28:0/1622887679 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582eef765a0 con 0x5582ef08e890 2026-02-20T03:27:31.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f26790640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5efc0b0fc0 0x7f5efc0b3480 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c02f960 tx=0x7f5f1c0044b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/1622887679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef08ec90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000ad80 tx=0x7f5f1000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e97fc50be0cd3dc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5eee3ff640 1 -- 10.20.193.28:0/1622887679 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10014070 con 0x5582ef08e890 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5eee3ff640 1 -- 10.20.193.28:0/1622887679 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5f10004570 con 0x5582ef08e890 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5eee3ff640 1 -- 10.20.193.28:0/1622887679 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10010690 con 0x5582ef08e890 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1622887679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 msgr2=0x5582ef08ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1622887679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef08ec90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000ad80 tx=0x7f5f1000e720 comp rx=0 tx=0).stop 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1622887679 shutdown_connections 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1622887679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef096400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1622887679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef093950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1622887679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef08ec90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1622887679 >> 10.20.193.28:0/1622887679 conn(0x5582ef07d6f0 msgr2=0x5582ef084570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1622887679 shutdown_connections 2026-02-20T03:27:31.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.000+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1622887679 wait complete. 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.002+0000 7f5f2b07be00 1 -- start start 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.002+0000 7f5f2b07be00 1 Processor -- start 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.002+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.002+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.002+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.002+0000 7f5f2b07be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5582eef7e0c0 con 0x5582ef093f70 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.002+0000 7f5f2b07be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5582ef086120 con 0x5582ef08f1d0 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.002+0000 7f5f2b07be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5582ef0b77c0 con 0x5582ef08e890 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.002+0000 7f5f25f8f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f2578e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f26790640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f26790640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54628/0 (socket says 10.20.193.28:54628) 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f26790640 1 -- 10.20.193.28:0/2192777174 learned_addr learned my addr 10.20.193.28:0/2192777174 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f26790640 1 -- 10.20.193.28:0/2192777174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 msgr2=0x5582ef0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f26790640 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f26790640 1 -- 10.20.193.28:0/2192777174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 msgr2=0x5582ef0b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f26790640 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f26790640 1 -- 10.20.193.28:0/2192777174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ef0a94f0 con 0x5582ef093f70 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f26790640 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b7230 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0074f0 tx=0x7f5f1c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf0eeb067ca1254 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5edb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5edb7fe640 1 -- 10.20.193.28:0/2192777174 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0076a0 con 0x5582ef093f70 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5edb7fe640 1 -- 10.20.193.28:0/2192777174 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5f1c007ce0 con 0x5582ef093f70 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5edb7fe640 1 -- 10.20.193.28:0/2192777174 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c045dc0 con 0x5582ef093f70 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f2b07be00 1 -- 10.20.193.28:0/2192777174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582eef92820 con 0x5582ef093f70 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5edb7fe640 1 -- 10.20.193.28:0/2192777174 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5f1c038420 con 0x5582ef093f70 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f2b07be00 10 client.18894 _ll_register_callbacks cb 0x5582eef81ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.003+0000 7f5f2b07be00 1 -- 10.20.193.28:0/2192777174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5582eefde4e0 con 0x5582ef093f70 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5edb7fe640 1 -- 10.20.193.28:0/2192777174 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5f1c045430 con 0x5582ef093f70 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5f2b07be00 10 client.18894 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:31.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5f2b07be00 1 -- 10.20.193.28:0/2192777174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5582eef97380 con 0x5582ef093f70 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5edb7fe640 1 -- 10.20.193.28:0/2192777174 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5f1c044070 con 0x5582ef093f70 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5f2b07be00 10 client.18894 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5f2b07be00 10 client.18894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5f2b07be00 20 client.18894 populate_metadata read hostname 'trial028' 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5582ef0bbac0 0x5582ef0bdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5f2b07be00 4 client.18894 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5f2b07be00 1 -- 10.20.193.28:0/2192777174 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582eef58bd0 con 0x5582ef0bbac0 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.004+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5582ef0bbac0 0x5582ef0bdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.005+0000 7f5edb7fe640 10 client.18894 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:31.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.005+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5582ef0bbac0 0x5582ef0bdf50 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dd2fc85b63707fc server_cookie=a01cbe40fdacb191 in_seq=0 out_seq=0 2026-02-20T03:27:31.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5edb7fe640 1 -- 10.20.193.28:0/2192777174 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5582eef58bd0 con 0x5582ef0bbac0 2026-02-20T03:27:31.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5edb7fe640 10 client.18894 handle_command_reply: tid=0 2026-02-20T03:27:31.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 client.18894 shutdown 2026-02-20T03:27:31.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 -- 10.20.193.28:0/2192777174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 msgr2=0x5582ef0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b7230 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0074f0 tx=0x7f5f1c0099e0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 -- 10.20.193.28:0/2192777174 shutdown_connections 2026-02-20T03:27:31.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5582ef0bbac0 0x5582ef0bdf50 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b7230 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/2192777174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5edb7fe640 0 client.18894 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:31.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 -- 10.20.193.28:0/2192777174 >> 10.20.193.28:0/2192777174 conn(0x5582ef07d6f0 msgr2=0x5582ef095300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 -- 10.20.193.28:0/2192777174 shutdown_connections 2026-02-20T03:27:31.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 1 -- 10.20.193.28:0/2192777174 wait complete. 2026-02-20T03:27:31.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.006+0000 7f5f2b07be00 20 client.18894 trim_cache size 0 max 16384 2026-02-20T03:27:31.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.014+0000 7f5f2b07be00 1 Processor -- start 2026-02-20T03:27:31.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.014+0000 7f5f2b07be00 1 -- start start 2026-02-20T03:27:31.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08e890 0x5582ef0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef08f1d0 0x5582ef0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef093f70 0x5582ef08f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f2b07be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc0126f0 con 0x5582ef08f1d0 2026-02-20T03:27:31.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f2b07be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc00ffc0 con 0x5582ef08e890 2026-02-20T03:27:31.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f2b07be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc00de10 con 0x5582ef093f70 2026-02-20T03:27:31.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f26790640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef093f70 0x5582ef08f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f26790640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef093f70 0x5582ef08f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49552/0 (socket says 10.20.193.28:49552) 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f26790640 1 -- 10.20.193.28:0/1086908509 learned_addr learned my addr 10.20.193.28:0/1086908509 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f2578e640 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef08f1d0 0x5582ef0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08e890 0x5582ef0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f26790640 1 -- 10.20.193.28:0/1086908509 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08e890 msgr2=0x5582ef0adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f26790640 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08e890 0x5582ef0adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f26790640 1 -- 10.20.193.28:0/1086908509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef08f1d0 msgr2=0x5582ef0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f26790640 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef08f1d0 0x5582ef0b7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f26790640 1 -- 10.20.193.28:0/1086908509 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ef0a9320 con 0x5582ef093f70 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f2578e640 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef08f1d0 0x5582ef0b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.015+0000 7f5f26790640 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef093f70 0x5582ef08f7c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006030 tx=0x7f5f1c03b070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96fe9952ee10316b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5eedbfe640 1 -- 10.20.193.28:0/1086908509 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c004200 con 0x5582ef093f70 2026-02-20T03:27:31.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5eedbfe640 1 -- 10.20.193.28:0/1086908509 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5582eefde4e0 con 0x5582ef093f70 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5eedbfe640 1 -- 10.20.193.28:0/1086908509 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c06d630 con 0x5582ef093f70 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1086908509 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef093f70 msgr2=0x5582ef08f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef093f70 0x5582ef08f7c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c006030 tx=0x7f5f1c03b070 comp rx=0 tx=0).stop 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1086908509 shutdown_connections 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef093f70 0x5582ef08f7c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef08f1d0 0x5582ef0b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1086908509 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08e890 0x5582ef0adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1086908509 >> 10.20.193.28:0/1086908509 conn(0x5582ef07d6f0 msgr2=0x5582ef084570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1086908509 shutdown_connections 2026-02-20T03:27:31.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.016+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1086908509 wait complete. 2026-02-20T03:27:31.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2b07be00 1 -- start start 2026-02-20T03:27:31.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2b07be00 1 Processor -- start 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef0b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2b07be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2578e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f26790640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2578e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49770/0 (socket says 10.20.193.28:49770) 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f26790640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54646/0 (socket says 10.20.193.28:54646) 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2578e640 1 -- 10.20.193.28:0/1349172773 learned_addr learned my addr 10.20.193.28:0/1349172773 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc00e480 con 0x5582ef093f70 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc00f8f0 con 0x5582ef08f1d0 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc00eb50 con 0x5582ef08e890 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.017+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef0b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2578e640 1 -- 10.20.193.28:0/1349172773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 msgr2=0x5582ef0b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2578e640 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef0b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.023 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2578e640 1 -- 10.20.193.28:0/1349172773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 msgr2=0x5582ef0b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2578e640 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2578e640 1 -- 10.20.193.28:0/1349172773 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582eed36690 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2578e640 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b5d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5f140a58e0 tx=0x7f5f14002ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=528c718b3ab49019 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5edb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5edb7fe640 1 -- 10.20.193.28:0/1349172773 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f140a4c60 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582eef9bb70 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2b07be00 10 client.27818 _ll_register_callbacks cb 0x7f5f1c004990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f10004570 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5edb7fe640 1 -- 10.20.193.28:0/1349172773 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5f140a78d0 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5edb7fe640 1 -- 10.20.193.28:0/1349172773 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f140a7340 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5edb7fe640 1 -- 10.20.193.28:0/1349172773 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5f140a74e0 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5edb7fe640 1 -- 10.20.193.28:0/1349172773 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5f140bdb90 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2b07be00 10 client.27818 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.018+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5582ef0aa010 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5edb7fe640 1 -- 10.20.193.28:0/1349172773 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5f14004050 con 0x5582ef08f1d0 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5f2b07be00 10 client.27818 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:31.024 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5f2b07be00 10 client.27818 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:31.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5f2b07be00 20 client.27818 populate_metadata read hostname 'trial028' 2026-02-20T03:27:31.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5582ef127970 0x5582ef129e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5f2b07be00 4 client.27818 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:27:31.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5582eedaf520 con 0x5582ef127970 2026-02-20T03:27:31.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5582ef127970 0x5582ef129e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5f25f8f640 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5582ef127970 0x5582ef129e30 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1d2317bf61ca67 server_cookie=f4261e0b94685e65 in_seq=0 out_seq=0 2026-02-20T03:27:31.025 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.019+0000 7f5edb7fe640 10 client.27818 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:31.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5edb7fe640 1 -- 10.20.193.28:0/1349172773 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5582eedaf520 con 0x5582ef127970 2026-02-20T03:27:31.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5edb7fe640 10 client.27818 handle_command_reply: tid=0 2026-02-20T03:27:31.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 client.27818 shutdown 2026-02-20T03:27:31.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 msgr2=0x5582ef0b5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b5d80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5f140a58e0 tx=0x7f5f14002ac0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 shutdown_connections 2026-02-20T03:27:31.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5582ef127970 0x5582ef129e30 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5582ef093f70 0x5582ef0b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5582ef08f1d0 0x5582ef0b5d80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 --2- 10.20.193.28:0/1349172773 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5582ef08e890 0x5582ef0b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 >> 10.20.193.28:0/1349172773 conn(0x5582ef07d6f0 msgr2=0x5582ef0acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5edb7fe640 0 client.27818 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:31.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.133+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 shutdown_connections 2026-02-20T03:27:31.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.134+0000 7f5f2b07be00 1 -- 10.20.193.28:0/1349172773 wait complete. 2026-02-20T03:27:31.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.135+0000 7f5f2b07be00 20 client.27818 trim_cache size 0 max 16384 2026-02-20T03:27:31.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:27:31.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:27:31.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:27:31.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:27:31.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 -- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5efc0b0fc0 msgr2=0x7f5efc0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5efc0b0fc0 0x7f5efc0b3480 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c02f960 tx=0x7f5f1c0044b0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 -- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f20105b20 msgr2=0x7f5f2019cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f20105b20 0x7f5f2019cea0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400ea10 tx=0x7f5f1400eee0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 -- 10.20.193.28:0/3816071786 shutdown_connections 2026-02-20T03:27:31.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5efc0b0fc0 0x7f5efc0b3480 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5f201064e0 0x7f5f201a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5f20105b20 0x7f5f2019cea0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 --2- 10.20.193.28:0/3816071786 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5f20104930 0x7f5f2019c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 -- 10.20.193.28:0/3816071786 >> 10.20.193.28:0/3816071786 conn(0x7f5f20100090 msgr2=0x7f5f20108e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 -- 10.20.193.28:0/3816071786 shutdown_connections 2026-02-20T03:27:31.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:31.136+0000 7f5f26f91640 1 -- 10.20.193.28:0/3816071786 wait complete. 2026-02-20T03:27:31.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.193+0000 7f21b1ed1640 1 -- 10.20.193.28:0/1365002627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f21ac102700 msgr2=0x7f21ac102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.193+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/1365002627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f21ac102700 0x7f21ac102b60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2194009a30 tx=0x7f219402f220 comp rx=0 tx=0).stop 2026-02-20T03:27:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.193+0000 7f21b1ed1640 1 -- 10.20.193.28:0/1365002627 shutdown_connections 2026-02-20T03:27:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.193+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/1365002627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f21ac1030a0 0x7f21ac10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.193+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/1365002627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f21ac102700 0x7f21ac102b60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.193+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/1365002627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21ac108700 0x7f21ac108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.193+0000 7f21b1ed1640 1 -- 10.20.193.28:0/1365002627 >> 10.20.193.28:0/1365002627 conn(0x7f21ac0fe440 msgr2=0x7f21ac100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.193+0000 7f21b1ed1640 1 -- 10.20.193.28:0/1365002627 shutdown_connections 2026-02-20T03:27:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.193+0000 7f21b1ed1640 1 -- 10.20.193.28:0/1365002627 wait complete. 2026-02-20T03:27:31.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21b1ed1640 1 Processor -- start 2026-02-20T03:27:31.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21b1ed1640 1 -- start start 2026-02-20T03:27:31.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21b1ed1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f21ac102700 0x7f21ac19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21b1ed1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21ac1030a0 0x7f21ac19d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21b1ed1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f21ac108700 0x7f21ac1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21b1ed1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac112930 con 0x7f21ac1030a0 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21b1ed1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac1127b0 con 0x7f21ac102700 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21b1ed1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f21ac112ab0 con 0x7f21ac108700 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21a3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21ac1030a0 0x7f21ac19d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21a3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21ac1030a0 0x7f21ac19d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54652/0 (socket says 10.20.193.28:54652) 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21a3fff640 1 -- 10.20.193.28:0/686059381 learned_addr learned my addr 10.20.193.28:0/686059381 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.194+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f21ac102700 0x7f21ac19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21b16d0640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f21ac108700 0x7f21ac1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21a3fff640 1 -- 10.20.193.28:0/686059381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f21ac108700 msgr2=0x7f21ac1a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21a3fff640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f21ac108700 0x7f21ac1a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21a3fff640 1 -- 10.20.193.28:0/686059381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f21ac102700 msgr2=0x7f21ac19d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21a3fff640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f21ac102700 0x7f21ac19d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21b16d0640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f21ac108700 0x7f21ac1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:27:31.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21a3fff640 1 -- 10.20.193.28:0/686059381 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac1a2060 con 0x7f21ac1030a0 2026-02-20T03:27:31.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21a3fff640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21ac1030a0 0x7f21ac19d550 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f219402f730 tx=0x7f219402fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21a1ffb640 1 -- 10.20.193.28:0/686059381 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194004240 con 0x7f21ac1030a0 2026-02-20T03:27:31.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21b1ed1640 1 -- 10.20.193.28:0/686059381 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ac1a22f0 con 0x7f21ac1030a0 2026-02-20T03:27:31.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21a1ffb640 1 -- 10.20.193.28:0/686059381 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f21940043e0 con 0x7f21ac1030a0 2026-02-20T03:27:31.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21a1ffb640 1 -- 10.20.193.28:0/686059381 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194004240 con 0x7f21ac1030a0 2026-02-20T03:27:31.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.195+0000 7f21b1ed1640 1 -- 10.20.193.28:0/686059381 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ac109580 con 0x7f21ac1030a0 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.198+0000 7f21a1ffb640 1 -- 10.20.193.28:0/686059381 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2194038770 con 0x7f21ac1030a0 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.199+0000 7f21b565fe00 1 Processor -- start 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.199+0000 7f21b565fe00 1 -- start start 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.199+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 0x5654853c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.199+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 0x5654853bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.199+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.199+0000 7f21b565fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56548533fe00 con 0x5654853bf5e0 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.199+0000 7f21b565fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x565485312970 con 0x5654853c4fb0 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.199+0000 7f21b565fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5654852c01f0 con 0x5654853bff60 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.199+0000 7f21b16d0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 0x5654853c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21b0ecf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 0x5654853bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49584/0 (socket says 10.20.193.28:49584) 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a3fff640 1 -- 10.20.193.28:0/281901443 learned_addr learned my addr 10.20.193.28:0/281901443 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a1ffb640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21880b1020 0x7f21880b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a3fff640 1 -- 10.20.193.28:0/281901443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 msgr2=0x5654853c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a3fff640 1 --2- 10.20.193.28:0/281901443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 0x5654853c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a3fff640 1 -- 10.20.193.28:0/281901443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 msgr2=0x5654853bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a3fff640 1 --2- 10.20.193.28:0/281901443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 0x5654853bfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a3fff640 1 -- 10.20.193.28:0/281901443 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654852d33d0 con 0x5654853bff60 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a1ffb640 1 -- 10.20.193.28:0/686059381 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f2194104cf0 con 0x7f21ac1030a0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21b16d0640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21880b1020 0x7f21880b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21a3fff640 1 --2- 10.20.193.28:0/281901443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853cbde0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f21940c8800 tx=0x7f2194009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54ed82659662ff8d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21794e4640 1 -- 10.20.193.28:0/281901443 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21940c8640 con 0x5654853bff60 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21794e4640 1 -- 10.20.193.28:0/281901443 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f21940cd0d0 con 0x5654853bff60 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.200+0000 7f21794e4640 1 -- 10.20.193.28:0/281901443 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21940cbef0 con 0x5654853bff60 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b565fe00 1 -- 10.20.193.28:0/281901443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 msgr2=0x5654853cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b565fe00 1 --2- 10.20.193.28:0/281901443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853cbde0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f21940c8800 tx=0x7f2194009340 comp rx=0 tx=0).stop 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b16d0640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21880b1020 0x7f21880b34e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009a10 tx=0x7f21a8004040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b565fe00 1 -- 10.20.193.28:0/281901443 shutdown_connections 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b565fe00 1 --2- 10.20.193.28:0/281901443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853cbde0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b565fe00 1 --2- 10.20.193.28:0/281901443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 0x5654853bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b565fe00 1 --2- 10.20.193.28:0/281901443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 0x5654853c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b565fe00 1 -- 10.20.193.28:0/281901443 >> 10.20.193.28:0/281901443 conn(0x565485382240 msgr2=0x5654853bdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b565fe00 1 -- 10.20.193.28:0/281901443 shutdown_connections 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.201+0000 7f21b565fe00 1 -- 10.20.193.28:0/281901443 wait complete. 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.202+0000 7f21b565fe00 1 -- start start 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.202+0000 7f21b565fe00 1 Processor -- start 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bf5e0 0x5654853d8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bff60 0x5654853d8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 0x5654853d95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b565fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56548530e8a0 con 0x5654853c4fb0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b565fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x565485100f50 con 0x5654853bff60 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b565fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5654853d9c20 con 0x5654853bf5e0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b0ecf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bf5e0 0x5654853d8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b0ecf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bf5e0 0x5654853d8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49590/0 (socket says 10.20.193.28:49590) 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b0ecf640 1 -- 10.20.193.28:0/2333853627 learned_addr learned my addr 10.20.193.28:0/2333853627 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21a3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bff60 0x5654853d8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b16d0640 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 0x5654853d95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b0ecf640 1 -- 10.20.193.28:0/2333853627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bff60 msgr2=0x5654853d8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bff60 0x5654853d8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b0ecf640 1 -- 10.20.193.28:0/2333853627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 msgr2=0x5654853d95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 0x5654853d95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b0ecf640 1 -- 10.20.193.28:0/2333853627 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654853d1700 con 0x5654853bf5e0 2026-02-20T03:27:31.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bf5e0 0x5654853d8240 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f219c009dd0 tx=0x7f219c002ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70cff4530624d4f4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.203+0000 7f216a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f216a7fc640 1 -- 10.20.193.28:0/2333853627 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c0125a0 con 0x5654853bf5e0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f21b565fe00 1 -- 10.20.193.28:0/2333853627 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654850e3b40 con 0x5654853bf5e0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f21b565fe00 10 client.27829 _ll_register_callbacks cb 0x56548534beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f21b565fe00 1 -- 10.20.193.28:0/2333853627 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565485320150 con 0x5654853bf5e0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f216a7fc640 1 -- 10.20.193.28:0/2333853627 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f219c012be0 con 0x5654853bf5e0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f216a7fc640 1 -- 10.20.193.28:0/2333853627 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c010c90 con 0x5654853bf5e0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f216a7fc640 1 -- 10.20.193.28:0/2333853627 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f219c0253f0 con 0x5654853bf5e0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f216a7fc640 1 -- 10.20.193.28:0/2333853627 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f219c025710 con 0x5654853bf5e0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f21b565fe00 10 client.27829 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f21b565fe00 1 -- 10.20.193.28:0/2333853627 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5654852cd1e0 con 0x5654853bf5e0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f216a7fc640 1 -- 10.20.193.28:0/2333853627 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f219c010430 con 0x5654853bf5e0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f21b565fe00 10 client.27829 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.204+0000 7f21b565fe00 10 client.27829 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.205+0000 7f21b565fe00 20 client.27829 populate_metadata read hostname 'trial028' 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.205+0000 7f21b565fe00 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5654853e80b0 0x5654853ea540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.205+0000 7f21b565fe00 4 client.27829 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.205+0000 7f21b565fe00 1 -- 10.20.193.28:0/2333853627 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56548531a560 con 0x5654853e80b0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.205+0000 7f21a3fff640 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5654853e80b0 0x5654853ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.205+0000 7f21a3fff640 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5654853e80b0 0x5654853ea540 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9f84ad91017247 server_cookie=aea574d4a69f4342 in_seq=0 out_seq=0 2026-02-20T03:27:31.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.205+0000 7f216a7fc640 10 client.27829 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f216a7fc640 1 -- 10.20.193.28:0/2333853627 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56548531a560 con 0x5654853e80b0 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f216a7fc640 10 client.27829 handle_command_reply: tid=0 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 client.27829 shutdown 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 -- 10.20.193.28:0/2333853627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bf5e0 msgr2=0x5654853d8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bf5e0 0x5654853d8240 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f219c009dd0 tx=0x7f219c002ab0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 -- 10.20.193.28:0/2333853627 shutdown_connections 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5654853e80b0 0x5654853ea540 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 0x5654853d95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bff60 0x5654853d8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 --2- 10.20.193.28:0/2333853627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bf5e0 0x5654853d8240 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 -- 10.20.193.28:0/2333853627 >> 10.20.193.28:0/2333853627 conn(0x565485382240 msgr2=0x5654853be3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f216a7fc640 0 client.27829 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 -- 10.20.193.28:0/2333853627 shutdown_connections 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 1 -- 10.20.193.28:0/2333853627 wait complete. 2026-02-20T03:27:31.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.206+0000 7f21b565fe00 20 client.27829 trim_cache size 0 max 16384 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.213+0000 7f21b565fe00 1 Processor -- start 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.213+0000 7f21b565fe00 1 -- start start 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.213+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 0x5654853d5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.213+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853d5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.213+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 0x5654853efe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.213+0000 7f21b565fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f21500126f0 con 0x5654853bf5e0 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.213+0000 7f21b565fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f215000ffc0 con 0x5654853c4fb0 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.213+0000 7f21b565fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f215000de10 con 0x5654853bff60 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21a3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21a3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853d5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49594/0 (socket says 10.20.193.28:49594) 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21a3fff640 1 -- 10.20.193.28:0/1681178026 learned_addr learned my addr 10.20.193.28:0/1681178026 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 0x5654853d5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21b16d0640 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 0x5654853efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21b0ecf640 1 -- 10.20.193.28:0/1681178026 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 msgr2=0x5654853d5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853d5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21b0ecf640 1 -- 10.20.193.28:0/1681178026 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 msgr2=0x5654853efe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 0x5654853efe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21b0ecf640 1 -- 10.20.193.28:0/1681178026 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654853d1530 con 0x5654853bf5e0 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21a3fff640 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853d5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.214+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 0x5654853d5720 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f219c009dd0 tx=0x7f219c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fc8355fe34559b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f2178ce3640 1 -- 10.20.193.28:0/1681178026 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c029040 con 0x5654853bf5e0 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f2178ce3640 1 -- 10.20.193.28:0/1681178026 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x565485320150 con 0x5654853bf5e0 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f2178ce3640 1 -- 10.20.193.28:0/1681178026 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c025b10 con 0x5654853bf5e0 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f21b565fe00 1 -- 10.20.193.28:0/1681178026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 msgr2=0x5654853d5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 0x5654853d5720 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f219c009dd0 tx=0x7f219c020000 comp rx=0 tx=0).stop 2026-02-20T03:27:31.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f21b565fe00 1 -- 10.20.193.28:0/1681178026 shutdown_connections 2026-02-20T03:27:31.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853c4fb0 0x5654853efe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853d5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1681178026 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853bf5e0 0x5654853d5720 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f21b565fe00 1 -- 10.20.193.28:0/1681178026 >> 10.20.193.28:0/1681178026 conn(0x565485382240 msgr2=0x5654853d8240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f21b565fe00 1 -- 10.20.193.28:0/1681178026 shutdown_connections 2026-02-20T03:27:31.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.215+0000 7f21b565fe00 1 -- 10.20.193.28:0/1681178026 wait complete. 2026-02-20T03:27:31.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.216+0000 7f21b565fe00 1 -- start start 2026-02-20T03:27:31.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.216+0000 7f21b565fe00 1 Processor -- start 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.216+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bf5e0 0x5654853dfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.216+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853dc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.216+0000 7f21b565fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 0x5654853dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.216+0000 7f21b565fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f215000e480 con 0x5654853c4fb0 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.216+0000 7f21b565fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f215000f8f0 con 0x5654853bf5e0 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.216+0000 7f21b565fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f215000eb50 con 0x5654853bff60 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21a3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853dc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b0ecf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bf5e0 0x5654853dfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b0ecf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bf5e0 0x5654853dfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49806/0 (socket says 10.20.193.28:49806) 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b0ecf640 1 -- 10.20.193.28:0/1436366161 learned_addr learned my addr 10.20.193.28:0/1436366161 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b16d0640 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 0x5654853dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b0ecf640 1 -- 10.20.193.28:0/1436366161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 msgr2=0x5654853dc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853dc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b0ecf640 1 -- 10.20.193.28:0/1436366161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 msgr2=0x5654853dc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 0x5654853dc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b0ecf640 1 -- 10.20.193.28:0/1436366161 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565484ff1870 con 0x5654853bf5e0 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21a3fff640 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853dc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f21b0ecf640 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bf5e0 0x5654853dfea0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f219c002af0 tx=0x7f219c010cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b9348db76dd188a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f216a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.217+0000 7f216a7fc640 1 -- 10.20.193.28:0/1436366161 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c009210 con 0x5654853bf5e0 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f216a7fc640 1 -- 10.20.193.28:0/1436366161 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f219c034070 con 0x5654853bf5e0 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f216a7fc640 1 -- 10.20.193.28:0/1436366161 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219c004b70 con 0x5654853bf5e0 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f21b565fe00 1 -- 10.20.193.28:0/1436366161 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654852b23f0 con 0x5654853bf5e0 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f216a7fc640 1 -- 10.20.193.28:0/1436366161 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f219c004d10 con 0x5654853bf5e0 2026-02-20T03:27:31.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f216a7fc640 10 client.27836 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f21b565fe00 10 client.27836 _ll_register_callbacks cb 0x7f219c0041e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f21b565fe00 1 -- 10.20.193.28:0/1436366161 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5654852c4ab0 con 0x5654853bf5e0 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f216a7fc640 1 -- 10.20.193.28:0/1436366161 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f219c03e060 con 0x5654853bf5e0 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f21b565fe00 10 client.27836 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.218+0000 7f21b565fe00 1 -- 10.20.193.28:0/1436366161 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5654853d2220 con 0x5654853bf5e0 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.219+0000 7f216a7fc640 1 -- 10.20.193.28:0/1436366161 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f219c041050 con 0x5654853bf5e0 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.219+0000 7f21b565fe00 10 client.27836 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.219+0000 7f21b565fe00 10 client.27836 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.219+0000 7f21b565fe00 20 client.27836 populate_metadata read hostname 'trial028' 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.219+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x565485465290 0x565485467720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.219+0000 7f21b565fe00 4 client.27836 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.219+0000 7f21b565fe00 1 -- 10.20.193.28:0/1436366161 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f21940cd0d0 con 0x565485465290 2026-02-20T03:27:31.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.219+0000 7f21a3fff640 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x565485465290 0x565485467720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f216a7fc640 10 client.27836 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:27:31.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21a3fff640 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x565485465290 0x565485467720 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62ab73b641c74210 server_cookie=ef7bb58407a8cbf1 in_seq=0 out_seq=0 2026-02-20T03:27:31.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f216a7fc640 1 -- 10.20.193.28:0/1436366161 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f21940cd0d0 con 0x565485465290 2026-02-20T03:27:31.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f216a7fc640 10 client.27836 handle_command_reply: tid=0 2026-02-20T03:27:31.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21b565fe00 1 client.27836 shutdown 2026-02-20T03:27:31.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21b565fe00 1 -- 10.20.193.28:0/1436366161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bf5e0 msgr2=0x5654853dfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bf5e0 0x5654853dfea0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f219c002af0 tx=0x7f219c010cf0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21b565fe00 1 -- 10.20.193.28:0/1436366161 shutdown_connections 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x565485465290 0x565485467720 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5654853c4fb0 0x5654853dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5654853bff60 0x5654853dc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21b565fe00 1 --2- 10.20.193.28:0/1436366161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5654853bf5e0 0x5654853dfea0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f21b565fe00 1 -- 10.20.193.28:0/1436366161 >> 10.20.193.28:0/1436366161 conn(0x565485382240 msgr2=0x5654853d4710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.220+0000 7f216a7fc640 0 client.27836 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.221+0000 7f21b565fe00 1 -- 10.20.193.28:0/1436366161 shutdown_connections 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.221+0000 7f21b565fe00 1 -- 10.20.193.28:0/1436366161 wait complete. 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.221+0000 7f21b565fe00 20 client.27836 trim_cache size 0 max 16384 2026-02-20T03:27:31.223 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.221+0000 7f21b1ed1640 1 -- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21880b1020 msgr2=0x7f21880b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.221+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21880b1020 0x7f21880b34e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009a10 tx=0x7f21a8004040 comp rx=0 tx=0).stop 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.221+0000 7f21b1ed1640 1 -- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21ac1030a0 msgr2=0x7f21ac19d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.221+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21ac1030a0 0x7f21ac19d550 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f219402f730 tx=0x7f219402fcb0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.222+0000 7f21b1ed1640 1 -- 10.20.193.28:0/686059381 shutdown_connections 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.222+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21880b1020 0x7f21880b34e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.222+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f21ac108700 0x7f21ac1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.222+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f21ac1030a0 0x7f21ac19d550 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.222+0000 7f21b1ed1640 1 --2- 10.20.193.28:0/686059381 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f21ac102700 0x7f21ac19d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.222+0000 7f21b1ed1640 1 -- 10.20.193.28:0/686059381 >> 10.20.193.28:0/686059381 conn(0x7f21ac0fe440 msgr2=0x7f21ac10df70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.222+0000 7f21b1ed1640 1 -- 10.20.193.28:0/686059381 shutdown_connections 2026-02-20T03:27:31.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.222+0000 7f21b1ed1640 1 -- 10.20.193.28:0/686059381 wait complete. 2026-02-20T03:27:31.288 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:31 trial028 ceph-mon[38552]: pgmap v567: 129 pgs: 129 active+clean; 180 MiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 MiB/s rd, 1.8 MiB/s wr, 304 op/s 2026-02-20T03:27:31.288 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:31 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/495956886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:27:31.322 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:27:31.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1073220 7.71 MB/sec execute 544 sec latency 22.519 ms 2026-02-20T03:27:31.582 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:27:31.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:31 trial126 ceph-mon[38476]: pgmap v567: 129 pgs: 129 active+clean; 180 MiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 MiB/s rd, 1.8 MiB/s wr, 304 op/s 2026-02-20T03:27:31.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:31 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/495956886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:27:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:31 trial177 ceph-mon[43181]: pgmap v567: 129 pgs: 129 active+clean; 180 MiB data, 3.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.9 MiB/s rd, 1.8 MiB/s wr, 304 op/s 2026-02-20T03:27:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:31 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/495956886' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.773+0000 7fb19ebc6640 1 -- 10.20.193.28:0/2594497986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb19810eef0 msgr2=0x7fb19810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.773+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/2594497986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb19810eef0 0x7fb19810f2d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb188009a30 tx=0x7fb18802f220 comp rx=0 tx=0).stop 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.773+0000 7fb19ebc6640 1 -- 10.20.193.28:0/2594497986 shutdown_connections 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.773+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/2594497986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb198109ba0 0x7fb198115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.773+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/2594497986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb198109220 0x7fb198109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.773+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/2594497986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb19810eef0 0x7fb19810f2d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.773+0000 7fb19ebc6640 1 -- 10.20.193.28:0/2594497986 >> 10.20.193.28:0/2594497986 conn(0x7fb198078600 msgr2=0x7fb19807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.774+0000 7fb19ebc6640 1 -- 10.20.193.28:0/2594497986 shutdown_connections 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.774+0000 7fb19ebc6640 1 -- 10.20.193.28:0/2594497986 wait complete. 2026-02-20T03:27:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.774+0000 7fb19ebc6640 1 Processor -- start 2026-02-20T03:27:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.774+0000 7fb19ebc6640 1 -- start start 2026-02-20T03:27:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.774+0000 7fb19ebc6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb198109220 0x7fb1981a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19ebc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb198109ba0 0x7fb1981a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19ebc6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb19810eef0 0x7fb1981a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19ebc6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb198119030 con 0x7fb198109ba0 2026-02-20T03:27:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19ebc6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb198118eb0 con 0x7fb198109220 2026-02-20T03:27:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19ebc6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb1981191b0 con 0x7fb19810eef0 2026-02-20T03:27:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19dbc4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb198109220 0x7fb1981a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19dbc4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb198109220 0x7fb1981a14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49826/0 (socket says 10.20.193.28:49826) 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19dbc4640 1 -- 10.20.193.28:0/814065625 learned_addr learned my addr 10.20.193.28:0/814065625 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb198109ba0 0x7fb1981a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb19810eef0 0x7fb1981a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19d3c3640 1 -- 10.20.193.28:0/814065625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb19810eef0 msgr2=0x7fb1981a5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb19810eef0 0x7fb1981a5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19d3c3640 1 -- 10.20.193.28:0/814065625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb198109220 msgr2=0x7fb1981a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb198109220 0x7fb1981a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19d3c3640 1 -- 10.20.193.28:0/814065625 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1981a6540 con 0x7fb198109ba0 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb198109220 0x7fb1981a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb198109ba0 0x7fb1981a1a30 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e9f0 tx=0x7fb18c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb186ffd640 1 -- 10.20.193.28:0/814065625 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c00cd80 con 0x7fb198109ba0 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb186ffd640 1 -- 10.20.193.28:0/814065625 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb18c004570 con 0x7fb198109ba0 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb186ffd640 1 -- 10.20.193.28:0/814065625 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c010690 con 0x7fb198109ba0 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.775+0000 7fb19ebc6640 1 -- 10.20.193.28:0/814065625 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1981a6830 con 0x7fb198109ba0 2026-02-20T03:27:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.776+0000 7fb19ebc6640 1 -- 10.20.193.28:0/814065625 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1981ae070 con 0x7fb198109ba0 2026-02-20T03:27:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb1a2354e00 1 Processor -- start 2026-02-20T03:27:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb186ffd640 1 -- 10.20.193.28:0/814065625 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb18c002920 con 0x7fb198109ba0 2026-02-20T03:27:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb1a2354e00 1 -- start start 2026-02-20T03:27:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f1f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 0x561372f19a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f19f60 0x561372f25de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561372e99e00 con 0x561372f19f60 2026-02-20T03:27:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561372e6c970 con 0x561372f1efb0 2026-02-20T03:27:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561372e1a1f0 con 0x561372f195e0 2026-02-20T03:27:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb19e3c5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f1f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb19e3c5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f1f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49836/0 (socket says 10.20.193.28:49836) 2026-02-20T03:27:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb19e3c5640 1 -- 10.20.193.28:0/1685933679 learned_addr learned my addr 10.20.193.28:0/1685933679 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f19f60 0x561372f25de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.779+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 0x561372f19a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb19e3c5640 1 -- 10.20.193.28:0/1685933679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 msgr2=0x561372f19a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 0x561372f19a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb19e3c5640 1 -- 10.20.193.28:0/1685933679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f19f60 msgr2=0x561372f25de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f19f60 0x561372f25de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb19e3c5640 1 -- 10.20.193.28:0/1685933679 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561372e2d3d0 con 0x561372f1efb0 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f19f60 0x561372f25de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f1f390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb194002e50 tx=0x7fb194009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fdf7853912c26a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb1664e6640 1 -- 10.20.193.28:0/1685933679 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19401b070 con 0x561372f1efb0 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb1664e6640 1 -- 10.20.193.28:0/1685933679 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb1940079a0 con 0x561372f1efb0 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb1664e6640 1 -- 10.20.193.28:0/1685933679 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194012b90 con 0x561372f1efb0 2026-02-20T03:27:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb186ffd640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1740b0e20 0x7fb1740b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb186ffd640 1 -- 10.20.193.28:0/814065625 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fb18c0e0ed0 con 0x7fb198109ba0 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1685933679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 msgr2=0x561372f1f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.780+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f1f390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb194002e50 tx=0x7fb194009920 comp rx=0 tx=0).stop 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.781+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1685933679 shutdown_connections 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.781+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1740b0e20 0x7fb1740b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.781+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f19f60 0x561372f25de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.781+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 0x561372f19a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.781+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1685933679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f1f390 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.781+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1685933679 >> 10.20.193.28:0/1685933679 conn(0x561372edc240 msgr2=0x561372f17ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.781+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1685933679 shutdown_connections 2026-02-20T03:27:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.781+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1685933679 wait complete. 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.781+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1740b0e20 0x7fb1740b32e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb188009a00 tx=0x7fb188005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.782+0000 7fb1a2354e00 1 -- start start 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.782+0000 7fb1a2354e00 1 Processor -- start 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.782+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 0x561372f33de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.782+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f19f60 0x561372f34320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.782+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f1efb0 0x561372f32520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.782+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561372e688a0 con 0x561372f1efb0 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.782+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561372c5af50 con 0x561372f19f60 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.782+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561372f32ca0 con 0x561372f195e0 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19e3c5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f1efb0 0x561372f32520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19dbc4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 0x561372f33de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19e3c5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f1efb0 0x561372f32520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54734/0 (socket says 10.20.193.28:54734) 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19e3c5640 1 -- 10.20.193.28:0/3499230830 learned_addr learned my addr 10.20.193.28:0/3499230830 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f19f60 0x561372f34320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19e3c5640 1 -- 10.20.193.28:0/3499230830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 msgr2=0x561372f33de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 0x561372f33de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19e3c5640 1 -- 10.20.193.28:0/3499230830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f19f60 msgr2=0x561372f34320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f19f60 0x561372f34320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19e3c5640 1 -- 10.20.193.28:0/3499230830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561372f2ba80 con 0x561372f1efb0 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f1efb0 0x561372f32520 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb194005c30 tx=0x7fb194002b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72e097342284319 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb1537fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb1537fe640 1 -- 10.20.193.28:0/3499230830 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19401b040 con 0x561372f1efb0 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb1537fe640 1 -- 10.20.193.28:0/3499230830 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb194024070 con 0x561372f1efb0 2026-02-20T03:27:31.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb1537fe640 1 -- 10.20.193.28:0/3499230830 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194012d20 con 0x561372f1efb0 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.783+0000 7fb1a2354e00 1 -- 10.20.193.28:0/3499230830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561372c3db40 con 0x561372f1efb0 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 10 client.18930 _ll_register_callbacks cb 0x561372ea5eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 1 -- 10.20.193.28:0/3499230830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561372e7a150 con 0x561372f1efb0 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1537fe640 1 -- 10.20.193.28:0/3499230830 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fb1940126f0 con 0x561372f1efb0 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1537fe640 1 -- 10.20.193.28:0/3499230830 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb194012ec0 con 0x561372f1efb0 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 10 client.18930 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 1 -- 10.20.193.28:0/3499230830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561372e271e0 con 0x561372f1efb0 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1537fe640 1 -- 10.20.193.28:0/3499230830 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fb19401e070 con 0x561372f1efb0 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 10 client.18930 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 10 client.18930 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 20 client.18930 populate_metadata read hostname 'trial028' 2026-02-20T03:27:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561372f42430 0x561372f44820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 4 client.18930 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb1a2354e00 1 -- 10.20.193.28:0/3499230830 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561372e74560 con 0x561372f42430 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.784+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561372f42430 0x561372f44820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.785+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561372f42430 0x561372f44820 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98b0438e5587dadb server_cookie=3219738a817bfc39 in_seq=0 out_seq=0 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.785+0000 7fb1537fe640 10 client.18930 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.785+0000 7fb1537fe640 1 -- 10.20.193.28:0/3499230830 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561372e74560 con 0x561372f42430 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.785+0000 7fb1537fe640 10 client.18930 handle_command_reply: tid=0 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.785+0000 7fb1a2354e00 1 client.18930 shutdown 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 -- 10.20.193.28:0/3499230830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f1efb0 msgr2=0x561372f32520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f1efb0 0x561372f32520 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fb194005c30 tx=0x7fb194002b00 comp rx=0 tx=0).stop 2026-02-20T03:27:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 -- 10.20.193.28:0/3499230830 shutdown_connections 2026-02-20T03:27:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561372f42430 0x561372f44820 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f1efb0 0x561372f32520 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f19f60 0x561372f34320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/3499230830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f195e0 0x561372f33de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 -- 10.20.193.28:0/3499230830 >> 10.20.193.28:0/3499230830 conn(0x561372edc240 msgr2=0x561372f183f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1537fe640 0 client.18930 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:27:31.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 -- 10.20.193.28:0/3499230830 shutdown_connections 2026-02-20T03:27:31.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 1 -- 10.20.193.28:0/3499230830 wait complete. 2026-02-20T03:27:31.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.786+0000 7fb1a2354e00 20 client.18930 trim_cache size 0 max 16384 2026-02-20T03:27:31.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.793+0000 7fb1a2354e00 1 Processor -- start 2026-02-20T03:27:31.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.793+0000 7fb1a2354e00 1 -- start start 2026-02-20T03:27:31.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.793+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f2fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.793+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f30060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.793+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f49f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.793+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb144012660 con 0x561372f195e0 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.793+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb14400ff30 con 0x561372f1efb0 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.793+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb14400dd80 con 0x561372f19f60 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19dbc4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f2fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19d3c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f30060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19dbc4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f2fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54750/0 (socket says 10.20.193.28:54750) 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19dbc4640 1 -- 10.20.193.28:0/1009591288 learned_addr learned my addr 10.20.193.28:0/1009591288 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f49f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19d3c3640 1 -- 10.20.193.28:0/1009591288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 msgr2=0x561372f49f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f49f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19d3c3640 1 -- 10.20.193.28:0/1009591288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 msgr2=0x561372f2fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f2fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19d3c3640 1 -- 10.20.193.28:0/1009591288 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561372f32890 con 0x561372f19f60 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f49f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f2fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f30060 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0a88b0 tx=0x7fb18c002cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90d53ad1fabed6cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.794+0000 7fb165ce5640 1 -- 10.20.193.28:0/1009591288 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0a82b0 con 0x561372f19f60 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb165ce5640 1 -- 10.20.193.28:0/1009591288 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb18c0a92b0 con 0x561372f19f60 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb165ce5640 1 -- 10.20.193.28:0/1009591288 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0a80d0 con 0x561372f19f60 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1009591288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 msgr2=0x561372f30060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f30060 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0a88b0 tx=0x7fb18c002cc0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1009591288 shutdown_connections 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f49f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f30060 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1009591288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f2fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1009591288 >> 10.20.193.28:0/1009591288 conn(0x561372edc240 msgr2=0x561372f30d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1009591288 shutdown_connections 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1009591288 wait complete. 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.795+0000 7fb1a2354e00 1 -- start start 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb1a2354e00 1 Processor -- start 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f3a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f36c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb1a2354e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f37180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb14400e3f0 con 0x561372f195e0 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb14400f860 con 0x561372f1efb0 2026-02-20T03:27:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb1a2354e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb14400eac0 con 0x561372f19f60 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb19d3c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f36c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb19d3c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f36c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49648/0 (socket says 10.20.193.28:49648) 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb19d3c3640 1 -- 10.20.193.28:0/1404649057 learned_addr learned my addr 10.20.193.28:0/1404649057 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f37180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f3a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb19d3c3640 1 -- 10.20.193.28:0/1404649057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 msgr2=0x561372f37180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f37180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.796+0000 7fb19d3c3640 1 -- 10.20.193.28:0/1404649057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 msgr2=0x561372f3a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f3a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb19d3c3640 1 -- 10.20.193.28:0/1404649057 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561372f2b8b0 con 0x561372f19f60 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb19e3c5640 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f37180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb19d3c3640 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f36c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e9c0 tx=0x7fb18c0a7e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeefcd9f478dd5d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:31.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb1537fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb1537fe640 1 -- 10.20.193.28:0/1404649057 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0a80d0 con 0x561372f19f60 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb1537fe640 1 -- 10.20.193.28:0/1404649057 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb18c0acf60 con 0x561372f19f60 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1404649057 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561372b4b870 con 0x561372f19f60 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb1537fe640 1 -- 10.20.193.28:0/1404649057 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0a82b0 con 0x561372f19f60 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb1537fe640 1 -- 10.20.193.28:0/1404649057 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fb18c0af3c0 con 0x561372f19f60 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.797+0000 7fb1537fe640 10 client.27853 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 10 client.27853 _ll_register_callbacks cb 0x7fb194019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1404649057 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561372e1eab0 con 0x561372f19f60 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1537fe640 1 -- 10.20.193.28:0/1404649057 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb18c0b1e10 con 0x561372f19f60 2026-02-20T03:27:31.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 10 client.27853 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:31.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1404649057 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x561372e0c3f0 con 0x561372f19f60 2026-02-20T03:27:31.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1537fe640 1 -- 10.20.193.28:0/1404649057 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fb18c0c9ce0 con 0x561372f19f60 2026-02-20T03:27:31.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 10 client.27853 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:31.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 10 client.27853 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:27:31.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 20 client.27853 populate_metadata read hostname 'trial028' 2026-02-20T03:27:31.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561372fae1f0 0x561372fb06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:31.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 4 client.27853 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:27:31.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1404649057 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb1940079a0 con 0x561372fae1f0 2026-02-20T03:27:31.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.798+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561372fae1f0 0x561372fb06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:31.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.799+0000 7fb19dbc4640 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561372fae1f0 0x561372fb06b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69d8019aa1443af9 server_cookie=1fc825f19b463035 in_seq=0 out_seq=0 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.799+0000 7fb1537fe640 10 client.27853 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.799+0000 7fb1537fe640 1 -- 10.20.193.28:0/1404649057 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb1940079a0 con 0x561372fae1f0 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.799+0000 7fb1537fe640 10 client.27853 handle_command_reply: tid=0 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.799+0000 7fb1a2354e00 1 client.27853 shutdown 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.799+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1404649057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 msgr2=0x561372f36c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.799+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f36c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e9c0 tx=0x7fb18c0a7e70 comp rx=0 tx=0).stop 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1404649057 shutdown_connections 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561372fae1f0 0x561372fb06b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561372f1efb0 0x561372f37180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561372f19f60 0x561372f36c40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1a2354e00 1 --2- 10.20.193.28:0/1404649057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561372f195e0 0x561372f3a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1404649057 >> 10.20.193.28:0/1404649057 conn(0x561372edc240 msgr2=0x561372f315a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1537fe640 0 client.27853 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:27:31.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1404649057 shutdown_connections 2026-02-20T03:27:31.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1a2354e00 1 -- 10.20.193.28:0/1404649057 wait complete. 2026-02-20T03:27:31.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb1a2354e00 20 client.27853 trim_cache size 0 max 16384 2026-02-20T03:27:31.810 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:27:31.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 -- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1740b0e20 msgr2=0x7fb1740b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1740b0e20 0x7fb1740b32e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb188009a00 tx=0x7fb188005e50 comp rx=0 tx=0).stop 2026-02-20T03:27:31.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 -- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb198109ba0 msgr2=0x7fb1981a1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:31.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb198109ba0 0x7fb1981a1a30 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00e9f0 tx=0x7fb18c00eec0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 -- 10.20.193.28:0/814065625 shutdown_connections 2026-02-20T03:27:31.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb1740b0e20 0x7fb1740b32e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb19810eef0 0x7fb1981a5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb198109ba0 0x7fb1981a1a30 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 --2- 10.20.193.28:0/814065625 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb198109220 0x7fb1981a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:31.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 -- 10.20.193.28:0/814065625 >> 10.20.193.28:0/814065625 conn(0x7fb198078600 msgr2=0x7fb198079fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:31.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 -- 10.20.193.28:0/814065625 shutdown_connections 2026-02-20T03:27:31.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:31.800+0000 7fb19ebc6640 1 -- 10.20.193.28:0/814065625 wait complete. 2026-02-20T03:27:31.902 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:27:32.168 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:27:32.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.359+0000 7f7e04f2c640 1 -- 10.20.193.28:0/1739006962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 msgr2=0x7f7e0010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:32.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.359+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/1739006962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 0x7f7e0010f2d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009a30 tx=0x7f7dec02f220 comp rx=0 tx=0).stop 2026-02-20T03:27:32.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.359+0000 7f7e04f2c640 1 -- 10.20.193.28:0/1739006962 shutdown_connections 2026-02-20T03:27:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.359+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/1739006962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e00109ba0 0x7f7e00115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.359+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/1739006962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e00109220 0x7f7e00109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.359+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/1739006962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 0x7f7e0010f2d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.359+0000 7f7e04f2c640 1 -- 10.20.193.28:0/1739006962 >> 10.20.193.28:0/1739006962 conn(0x7f7e00078600 msgr2=0x7f7e0007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.359+0000 7f7e04f2c640 1 -- 10.20.193.28:0/1739006962 shutdown_connections 2026-02-20T03:27:32.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.359+0000 7f7e04f2c640 1 -- 10.20.193.28:0/1739006962 wait complete. 2026-02-20T03:27:32.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7e04f2c640 1 Processor -- start 2026-02-20T03:27:32.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7e04f2c640 1 -- start start 2026-02-20T03:27:32.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7e04f2c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e00109220 0x7f7e001a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7e04f2c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e00109ba0 0x7f7e001a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7e04f2c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 0x7f7e001a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7e04f2c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7e00119030 con 0x7f7e00109ba0 2026-02-20T03:27:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7e04f2c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7e00118eb0 con 0x7f7e00109220 2026-02-20T03:27:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7e04f2c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7e001191b0 con 0x7f7e0010eef0 2026-02-20T03:27:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7dfffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 0x7f7e001a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7dfeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e00109ba0 0x7f7e001a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7dff7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e00109220 0x7f7e001a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7dfffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 0x7f7e001a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49680/0 (socket says 10.20.193.28:49680) 2026-02-20T03:27:32.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.360+0000 7f7dfffff640 1 -- 10.20.193.28:0/3338477955 learned_addr learned my addr 10.20.193.28:0/3338477955 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:32.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfffff640 1 -- 10.20.193.28:0/3338477955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e00109220 msgr2=0x7f7e001a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:32.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfffff640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e00109220 0x7f7e001a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfffff640 1 -- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e00109ba0 msgr2=0x7f7e001a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:32.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfffff640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e00109ba0 0x7f7e001a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfffff640 1 -- 10.20.193.28:0/3338477955 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e001a6580 con 0x7f7e0010eef0 2026-02-20T03:27:32.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfeffd640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e00109ba0 0x7f7e001a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:32.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfffff640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 0x7f7e001a5e00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7df400e1c0 tx=0x7f7df400e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:32.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfcff9640 1 -- 10.20.193.28:0/3338477955 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4019070 con 0x7f7e0010eef0 2026-02-20T03:27:32.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfcff9640 1 -- 10.20.193.28:0/3338477955 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7df400ee50 con 0x7f7e0010eef0 2026-02-20T03:27:32.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7e04f2c640 1 -- 10.20.193.28:0/3338477955 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e001a6870 con 0x7f7e0010eef0 2026-02-20T03:27:32.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7e04f2c640 1 -- 10.20.193.28:0/3338477955 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e001ae0b0 con 0x7f7e0010eef0 2026-02-20T03:27:32.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.361+0000 7f7dfcff9640 1 -- 10.20.193.28:0/3338477955 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df40149a0 con 0x7f7e0010eef0 2026-02-20T03:27:32.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.364+0000 7f7e086bae00 1 Processor -- start 2026-02-20T03:27:32.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7dfcff9640 1 -- 10.20.193.28:0/3338477955 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7df4004720 con 0x7f7e0010eef0 2026-02-20T03:27:32.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7e086bae00 1 -- start start 2026-02-20T03:27:32.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a3176afb0 0x564a3176b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a317655e0 0x564a31765a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31771de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7e086bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564a316e5e00 con 0x564a3176afb0 2026-02-20T03:27:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7e086bae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564a316b8970 con 0x564a317655e0 2026-02-20T03:27:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7e086bae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564a316661f0 con 0x564a31765f60 2026-02-20T03:27:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7dfeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a3176afb0 0x564a3176b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7dfeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a3176afb0 0x564a3176b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54776/0 (socket says 10.20.193.28:54776) 2026-02-20T03:27:32.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7dfeffd640 1 -- 10.20.193.28:0/3756472978 learned_addr learned my addr 10.20.193.28:0/3756472978 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.365+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/3756472978 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a317655e0 0x564a31765a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dfeffd640 1 -- 10.20.193.28:0/3756472978 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 msgr2=0x564a31771de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:27:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dfeffd640 1 --2- 10.20.193.28:0/3756472978 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31771de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dfeffd640 1 -- 10.20.193.28:0/3756472978 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a317655e0 msgr2=0x564a31765a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dfeffd640 1 --2- 10.20.193.28:0/3756472978 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a317655e0 0x564a31765a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dfeffd640 1 -- 10.20.193.28:0/3756472978 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a316793d0 con 0x564a3176afb0 2026-02-20T03:27:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dfeffd640 1 --2- 10.20.193.28:0/3756472978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a3176afb0 0x564a3176b390 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f7df0004210 tx=0x7f7df00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f579771e9d14d83f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dc3fff640 1 -- 10.20.193.28:0/3756472978 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df001a640 con 0x564a3176afb0 2026-02-20T03:27:32.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dc3fff640 1 -- 10.20.193.28:0/3756472978 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7df00108d0 con 0x564a3176afb0 2026-02-20T03:27:32.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dfcff9640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7dd40b0da0 0x7f7dd40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7e086bae00 1 -- 10.20.193.28:0/3756472978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a3176afb0 msgr2=0x564a3176b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:32.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7e086bae00 1 --2- 10.20.193.28:0/3756472978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a3176afb0 0x564a3176b390 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f7df0004210 tx=0x7f7df00026e0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.366+0000 7f7dfcff9640 1 -- 10.20.193.28:0/3338477955 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7df40e06e0 con 0x7f7e0010eef0 2026-02-20T03:27:32.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.367+0000 7f7e086bae00 1 -- 10.20.193.28:0/3756472978 shutdown_connections 2026-02-20T03:27:32.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.367+0000 7f7e086bae00 1 --2- 10.20.193.28:0/3756472978 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31771de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.367+0000 7f7e086bae00 1 --2- 10.20.193.28:0/3756472978 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a317655e0 0x564a31765a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.367+0000 7f7e086bae00 1 --2- 10.20.193.28:0/3756472978 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a3176afb0 0x564a3176b390 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.367+0000 7f7e086bae00 1 -- 10.20.193.28:0/3756472978 >> 10.20.193.28:0/3756472978 conn(0x564a31728240 msgr2=0x564a31763ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.367+0000 7f7e086bae00 1 -- 10.20.193.28:0/3756472978 shutdown_connections 2026-02-20T03:27:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.367+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7dd40b0da0 0x7f7dd40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.367+0000 7f7e086bae00 1 -- 10.20.193.28:0/3756472978 wait complete. 2026-02-20T03:27:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.367+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7dd40b0da0 0x7f7dd40b3260 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7dec002410 tx=0x7f7dec005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.368+0000 7f7e086bae00 1 -- start start 2026-02-20T03:27:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.368+0000 7f7e086bae00 1 Processor -- start 2026-02-20T03:27:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a3177fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31780020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a3177e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7e086bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564a316b48a0 con 0x564a317655e0 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7e086bae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564a314a6f50 con 0x564a3176afb0 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7e086bae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564a3177e9a0 con 0x564a31765f60 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a3177fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dfeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31780020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a3177fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54780/0 (socket says 10.20.193.28:54780) 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dff7fe640 1 -- 10.20.193.28:0/2800796737 learned_addr learned my addr 10.20.193.28:0/2800796737 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dfffff640 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a3177e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dff7fe640 1 -- 10.20.193.28:0/2800796737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 msgr2=0x564a31780020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:32.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31780020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dff7fe640 1 -- 10.20.193.28:0/2800796737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 msgr2=0x564a3177e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a3177e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dff7fe640 1 -- 10.20.193.28:0/2800796737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a31777990 con 0x564a317655e0 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a3177fae0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f7dec037000 tx=0x7f7dec02f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bad7d83a769569 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.369+0000 7f7dc17fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7dc17fa640 1 -- 10.20.193.28:0/2800796737 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec053070 con 0x564a317655e0 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7dc17fa640 1 -- 10.20.193.28:0/2800796737 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7dec033040 con 0x564a317655e0 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7dc17fa640 1 -- 10.20.193.28:0/2800796737 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec04ead0 con 0x564a317655e0 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7e086bae00 1 -- 10.20.193.28:0/2800796737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a31489b40 con 0x564a317655e0 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7dc17fa640 1 -- 10.20.193.28:0/2800796737 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7dec043400 con 0x564a317655e0 2026-02-20T03:27:32.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7e086bae00 10 client.18948 _ll_register_callbacks cb 0x564a316f1eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7e086bae00 1 -- 10.20.193.28:0/2800796737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a316c6150 con 0x564a317655e0 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7dc17fa640 1 -- 10.20.193.28:0/2800796737 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7dec04e400 con 0x564a317655e0 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7e086bae00 10 client.18948 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7e086bae00 1 -- 10.20.193.28:0/2800796737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x564a316731e0 con 0x564a317655e0 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7dc17fa640 1 -- 10.20.193.28:0/2800796737 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7dec0028e0 con 0x564a317655e0 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7e086bae00 10 client.18948 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7e086bae00 10 client.18948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.370+0000 7f7e086bae00 20 client.18948 populate_metadata read hostname 'trial028' 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.371+0000 7f7e086bae00 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564a3178e250 0x564a317906a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.371+0000 7f7e086bae00 4 client.18948 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.371+0000 7f7e086bae00 1 -- 10.20.193.28:0/2800796737 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a316c0560 con 0x564a3178e250 2026-02-20T03:27:32.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.371+0000 7f7dfeffd640 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564a3178e250 0x564a317906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.371+0000 7f7dfeffd640 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564a3178e250 0x564a317906a0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f1736f4fdfe384 server_cookie=6724d7242abf4e73 in_seq=0 out_seq=0 2026-02-20T03:27:32.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.371+0000 7f7dc17fa640 10 client.18948 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:32.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7dc17fa640 1 -- 10.20.193.28:0/2800796737 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x564a316c0560 con 0x564a3178e250 2026-02-20T03:27:32.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7dc17fa640 10 client.18948 handle_command_reply: tid=0 2026-02-20T03:27:32.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 client.18948 shutdown 2026-02-20T03:27:32.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 -- 10.20.193.28:0/2800796737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 msgr2=0x564a3177fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:32.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a3177fae0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f7dec037000 tx=0x7f7dec02f220 comp rx=0 tx=0).stop 2026-02-20T03:27:32.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 -- 10.20.193.28:0/2800796737 shutdown_connections 2026-02-20T03:27:32.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564a3178e250 0x564a317906a0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a3177e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31780020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 --2- 10.20.193.28:0/2800796737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a3177fae0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7dc17fa640 0 client.18948 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 -- 10.20.193.28:0/2800796737 >> 10.20.193.28:0/2800796737 conn(0x564a31728240 msgr2=0x564a317643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 -- 10.20.193.28:0/2800796737 shutdown_connections 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 1 -- 10.20.193.28:0/2800796737 wait complete. 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.372+0000 7f7e086bae00 20 client.18948 trim_cache size 0 max 16384 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7e086bae00 1 Processor -- start 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7e086bae00 1 -- start start 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a317644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31764a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a31795fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7e086bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40126e0 con 0x564a317655e0 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7e086bae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7da400ffb0 con 0x564a3176afb0 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7e086bae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7da400de00 con 0x564a31765f60 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a317644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dfeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31764a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a317644d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54786/0 (socket says 10.20.193.28:54786) 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dff7fe640 1 -- 10.20.193.28:0/3429245299 learned_addr learned my addr 10.20.193.28:0/3429245299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dfffff640 1 --2- 10.20.193.28:0/3429245299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a31795fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dff7fe640 1 -- 10.20.193.28:0/3429245299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 msgr2=0x564a31764a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/3429245299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31764a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dff7fe640 1 -- 10.20.193.28:0/3429245299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 msgr2=0x564a31795fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/3429245299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a31795fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.379+0000 7f7dff7fe640 1 -- 10.20.193.28:0/3429245299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a317777c0 con 0x564a317655e0 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/3429245299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a317644d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009a30 tx=0x7f7dec056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7050c713cd71a5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7dc37fe640 1 -- 10.20.193.28:0/3429245299 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec053030 con 0x564a317655e0 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7dc37fe640 1 -- 10.20.193.28:0/3429245299 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7dec033040 con 0x564a317655e0 2026-02-20T03:27:32.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7dc37fe640 1 -- 10.20.193.28:0/3429245299 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0589b0 con 0x564a317655e0 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7e086bae00 1 -- 10.20.193.28:0/3429245299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 msgr2=0x564a317644d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7e086bae00 1 --2- 10.20.193.28:0/3429245299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a317644d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009a30 tx=0x7f7dec056000 comp rx=0 tx=0).stop 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7e086bae00 1 -- 10.20.193.28:0/3429245299 shutdown_connections 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7e086bae00 1 --2- 10.20.193.28:0/3429245299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a31795fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7e086bae00 1 --2- 10.20.193.28:0/3429245299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a31764a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7e086bae00 1 --2- 10.20.193.28:0/3429245299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a317644d0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7e086bae00 1 -- 10.20.193.28:0/3429245299 >> 10.20.193.28:0/3429245299 conn(0x564a31728240 msgr2=0x564a3177d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7e086bae00 1 -- 10.20.193.28:0/3429245299 shutdown_connections 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.380+0000 7f7e086bae00 1 -- 10.20.193.28:0/3429245299 wait complete. 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7e086bae00 1 -- start start 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7e086bae00 1 Processor -- start 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a31782c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a317831c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7e086bae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a317f9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7e086bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7da400e470 con 0x564a317655e0 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7e086bae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7da400f8e0 con 0x564a3176afb0 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7e086bae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7da400eb40 con 0x564a31765f60 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7dff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a31782c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7dff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a31782c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54802/0 (socket says 10.20.193.28:54802) 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.381+0000 7f7dff7fe640 1 -- 10.20.193.28:0/4181178368 learned_addr learned my addr 10.20.193.28:0/4181178368 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dfffff640 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a317f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dfeffd640 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a317831c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dfffff640 1 -- 10.20.193.28:0/4181178368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 msgr2=0x564a317831c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dfffff640 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a317831c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dfffff640 1 -- 10.20.193.28:0/4181178368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 msgr2=0x564a31782c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dfffff640 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a31782c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dfffff640 1 -- 10.20.193.28:0/4181178368 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a31397870 con 0x564a3176afb0 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dfeffd640 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a317831c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dfffff640 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a317f9190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7df40ddd50 tx=0x7f7df40e0590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1eaa923e264c209 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.382+0000 7f7dc17fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7dc17fa640 1 -- 10.20.193.28:0/4181178368 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df40cae60 con 0x564a3176afb0 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7dc17fa640 1 -- 10.20.193.28:0/4181178368 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7df40a4810 con 0x564a3176afb0 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7dc17fa640 1 -- 10.20.193.28:0/4181178368 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4094020 con 0x564a3176afb0 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7e086bae00 1 -- 10.20.193.28:0/4181178368 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a316583f0 con 0x564a3176afb0 2026-02-20T03:27:32.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7dc17fa640 1 -- 10.20.193.28:0/4181178368 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7df40a7150 con 0x564a3176afb0 2026-02-20T03:27:32.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7e086bae00 10 client.27872 _ll_register_callbacks cb 0x7f7df0005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:32.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7e086bae00 1 -- 10.20.193.28:0/4181178368 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dec033040 con 0x564a3176afb0 2026-02-20T03:27:32.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7dc17fa640 1 -- 10.20.193.28:0/4181178368 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7df40a3b90 con 0x564a3176afb0 2026-02-20T03:27:32.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7e086bae00 10 client.27872 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:32.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7e086bae00 1 -- 10.20.193.28:0/4181178368 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x564a317784b0 con 0x564a3176afb0 2026-02-20T03:27:32.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7dc17fa640 1 -- 10.20.193.28:0/4181178368 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7df4092c00 con 0x564a3176afb0 2026-02-20T03:27:32.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7e086bae00 10 client.27872 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:32.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.383+0000 7f7e086bae00 10 client.27872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:32.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.384+0000 7f7e086bae00 20 client.27872 populate_metadata read hostname 'trial028' 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.384+0000 7f7e086bae00 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564a317faa90 0x564a317fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.384+0000 7f7e086bae00 4 client.27872 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.384+0000 7f7e086bae00 1 -- 10.20.193.28:0/4181178368 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a316c0560 con 0x564a317faa90 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.384+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564a317faa90 0x564a317fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.384+0000 7f7dc17fa640 10 client.27872 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.384+0000 7f7dff7fe640 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564a317faa90 0x564a317fcf20 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6b2c44a4a226aa server_cookie=393d60f2745adb9c in_seq=0 out_seq=0 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7dc17fa640 1 -- 10.20.193.28:0/4181178368 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a316c0560 con 0x564a317faa90 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7dc17fa640 10 client.27872 handle_command_reply: tid=0 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 client.27872 shutdown 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 -- 10.20.193.28:0/4181178368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 msgr2=0x564a317f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a317f9190 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7df40ddd50 tx=0x7f7df40e0590 comp rx=0 tx=0).stop 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 -- 10.20.193.28:0/4181178368 shutdown_connections 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564a317faa90 0x564a317fcf20 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a3176afb0 0x564a317f9190 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a31765f60 0x564a317831c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 --2- 10.20.193.28:0/4181178368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a317655e0 0x564a31782c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 -- 10.20.193.28:0/4181178368 >> 10.20.193.28:0/4181178368 conn(0x564a31728240 msgr2=0x564a3178e630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7dc17fa640 0 client.27872 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 -- 10.20.193.28:0/4181178368 shutdown_connections 2026-02-20T03:27:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 1 -- 10.20.193.28:0/4181178368 wait complete. 2026-02-20T03:27:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.385+0000 7f7e086bae00 20 client.27872 trim_cache size 0 max 16384 2026-02-20T03:27:32.394 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:27:32.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 -- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7dd40b0da0 msgr2=0x7f7dd40b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7dd40b0da0 0x7f7dd40b3260 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7dec002410 tx=0x7f7dec005e50 comp rx=0 tx=0).stop 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 -- 10.20.193.28:0/3338477955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 msgr2=0x7f7e001a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 0x7f7e001a5e00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7df400e1c0 tx=0x7f7df400e690 comp rx=0 tx=0).stop 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 -- 10.20.193.28:0/3338477955 shutdown_connections 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7dd40b0da0 0x7f7dd40b3260 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e0010eef0 0x7f7e001a5e00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e00109ba0 0x7f7e001a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 --2- 10.20.193.28:0/3338477955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e00109220 0x7f7e001a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 -- 10.20.193.28:0/3338477955 >> 10.20.193.28:0/3338477955 conn(0x7f7e00078600 msgr2=0x7f7e0007a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 -- 10.20.193.28:0/3338477955 shutdown_connections 2026-02-20T03:27:32.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:32.386+0000 7f7e04f2c640 1 -- 10.20.193.28:0/3338477955 wait complete. 2026-02-20T03:27:32.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1076720 7.73 MB/sec execute 545 sec latency 8.146 ms 2026-02-20T03:27:33.528 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:27:33.528 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:27:33.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1080183 7.75 MB/sec execute 546 sec latency 7.916 ms 2026-02-20T03:27:33.580 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:33 trial028 ceph-mon[38552]: pgmap v568: 129 pgs: 129 active+clean; 182 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 340 op/s 2026-02-20T03:27:33.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:33 trial126 ceph-mon[38476]: pgmap v568: 129 pgs: 129 active+clean; 182 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 340 op/s 2026-02-20T03:27:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:33 trial177 ceph-mon[43181]: pgmap v568: 129 pgs: 129 active+clean; 182 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 340 op/s 2026-02-20T03:27:33.795 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:27:33.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.983+0000 7f5c08b3e640 1 -- 10.20.193.28:0/1773975079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c04104980 msgr2=0x7f5c04104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:33.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.983+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/1773975079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c04104980 0x7f5c04104de0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009a60 tx=0x7f5bf402f250 comp rx=0 tx=0).stop 2026-02-20T03:27:33.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.983+0000 7f5c08b3e640 1 -- 10.20.193.28:0/1773975079 shutdown_connections 2026-02-20T03:27:33.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.983+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/1773975079 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c04105320 0x7f5c04111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.983+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/1773975079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c04104980 0x7f5c04104de0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.983+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/1773975079 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c0410a980 0x7f5c0410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.983+0000 7f5c08b3e640 1 -- 10.20.193.28:0/1773975079 >> 10.20.193.28:0/1773975079 conn(0x7f5c04100680 msgr2=0x7f5c04102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:33.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.984+0000 7f5c08b3e640 1 -- 10.20.193.28:0/1773975079 shutdown_connections 2026-02-20T03:27:33.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.984+0000 7f5c08b3e640 1 -- 10.20.193.28:0/1773975079 wait complete. 2026-02-20T03:27:33.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.984+0000 7f5c08b3e640 1 Processor -- start 2026-02-20T03:27:33.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.984+0000 7f5c08b3e640 1 -- start start 2026-02-20T03:27:33.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c08b3e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c04104980 0x7f5c0419d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:33.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c08b3e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c04105320 0x7f5c0419d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:33.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c08b3e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c0410a980 0x7f5c041a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:33.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c08b3e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04114bb0 con 0x7f5c04105320 2026-02-20T03:27:33.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c08b3e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04114a30 con 0x7f5c0410a980 2026-02-20T03:27:33.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c08b3e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5c04114d30 con 0x7f5c04104980 2026-02-20T03:27:33.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c037fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c04104980 0x7f5c0419d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c037fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c04104980 0x7f5c0419d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49742/0 (socket says 10.20.193.28:49742) 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c037fe640 1 -- 10.20.193.28:0/3339938402 learned_addr learned my addr 10.20.193.28:0/3339938402 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c02ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c04105320 0x7f5c0419d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c03fff640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c0410a980 0x7f5c041a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c02ffd640 1 -- 10.20.193.28:0/3339938402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c04104980 msgr2=0x7f5c0419d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c02ffd640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c04104980 0x7f5c0419d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c02ffd640 1 -- 10.20.193.28:0/3339938402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c0410a980 msgr2=0x7f5c041a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c02ffd640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c0410a980 0x7f5c041a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.985+0000 7f5c02ffd640 1 -- 10.20.193.28:0/3339938402 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c041a1fe0 con 0x7f5c04105320 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.986+0000 7f5c02ffd640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c04105320 0x7f5c0419d570 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009a60 tx=0x7f5bf402fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:33.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.986+0000 7f5c00ff9640 1 -- 10.20.193.28:0/3339938402 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf402fe10 con 0x7f5c04105320 2026-02-20T03:27:33.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.986+0000 7f5c00ff9640 1 -- 10.20.193.28:0/3339938402 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5bf4038770 con 0x7f5c04105320 2026-02-20T03:27:33.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.986+0000 7f5c00ff9640 1 -- 10.20.193.28:0/3339938402 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4042850 con 0x7f5c04105320 2026-02-20T03:27:33.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.986+0000 7f5c08b3e640 1 -- 10.20.193.28:0/3339938402 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c041a2270 con 0x7f5c04105320 2026-02-20T03:27:33.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.986+0000 7f5c08b3e640 1 -- 10.20.193.28:0/3339938402 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c041a2700 con 0x7f5c04105320 2026-02-20T03:27:33.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.988+0000 7f5c00ff9640 1 -- 10.20.193.28:0/3339938402 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5bf4038920 con 0x7f5c04105320 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.989+0000 7f5c0c2cce00 1 Processor -- start 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.989+0000 7f5c0c2cce00 1 -- start start 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.989+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x5620521ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.989+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x5620521f2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.989+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 0x5620521f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.989+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562052140c00 con 0x5620521ee0c0 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.989+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5620520ee3c0 con 0x5620521eea70 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.989+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56205213cb30 con 0x5620521f2b60 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x5620521ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:33.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x5620521ee4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54822/0 (socket says 10.20.193.28:54822) 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c03fff640 1 -- 10.20.193.28:0/2961646907 learned_addr learned my addr 10.20.193.28:0/2961646907 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c037fe640 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x5620521f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c02ffd640 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 0x5620521f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c03fff640 1 -- 10.20.193.28:0/2961646907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 msgr2=0x5620521f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c03fff640 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 0x5620521f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c03fff640 1 -- 10.20.193.28:0/2961646907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 msgr2=0x5620521f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c03fff640 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x5620521f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c03fff640 1 -- 10.20.193.28:0/2961646907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620520e7840 con 0x5620521ee0c0 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c02ffd640 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 0x5620521f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c037fe640 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x5620521f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c00ff9640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bd80b0e20 0x7f5bd80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:33.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c00ff9640 1 -- 10.20.193.28:0/3339938402 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5bf41052f0 con 0x7f5c04105320 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5c03fff640 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x5620521ee4a0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800e190 tx=0x7f5bf800e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3350a6bd1aa3a191 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.990+0000 7f5bc7fff640 1 -- 10.20.193.28:0/2961646907 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8019070 con 0x5620521ee0c0 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c037fe640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bd80b0e20 0x7f5bd80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5bc7fff640 1 -- 10.20.193.28:0/2961646907 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5bf8002c70 con 0x5620521ee0c0 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5bc7fff640 1 -- 10.20.193.28:0/2961646907 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf80147b0 con 0x5620521ee0c0 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2961646907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 msgr2=0x5620521ee4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x5620521ee4a0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800e190 tx=0x7f5bf800e660 comp rx=0 tx=0).stop 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c037fe640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bd80b0e20 0x7f5bd80b32e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x5620521ef090 tx=0x7f5bf000a480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2961646907 shutdown_connections 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 0x5620521f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x5620521f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2961646907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x5620521ee4a0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:33.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2961646907 >> 10.20.193.28:0/2961646907 conn(0x5620521e6b60 msgr2=0x5620521ec5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:33.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2961646907 shutdown_connections 2026-02-20T03:27:33.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.991+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2961646907 wait complete. 2026-02-20T03:27:34.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.993+0000 7f5c0c2cce00 1 -- start start 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.993+0000 7f5c0c2cce00 1 Processor -- start 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.993+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x562052206e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.993+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521eea70 0x5620522073b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.993+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x562052212aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.993+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5620520e81a0 con 0x5620521f2b60 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.993+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5620521fad70 con 0x5620521ee0c0 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.993+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562052212fe0 con 0x5620521eea70 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x562052212aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x562052212aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54828/0 (socket says 10.20.193.28:54828) 2026-02-20T03:27:34.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c03fff640 1 -- 10.20.193.28:0/3893783205 learned_addr learned my addr 10.20.193.28:0/3893783205 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c037fe640 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x562052206e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c03fff640 1 -- 10.20.193.28:0/3893783205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521eea70 msgr2=0x5620522073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c03fff640 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521eea70 0x5620522073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c03fff640 1 -- 10.20.193.28:0/3893783205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 msgr2=0x562052206e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c03fff640 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x562052206e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c03fff640 1 -- 10.20.193.28:0/3893783205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620522005a0 con 0x5620521f2b60 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c03fff640 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x562052212aa0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8017040 tx=0x7f5bf8004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eae20d6f923e445 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5bc57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5bc57fa640 1 -- 10.20.193.28:0/3893783205 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8024020 con 0x5620521f2b60 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5bc57fa640 1 -- 10.20.193.28:0/3893783205 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5bf801a040 con 0x5620521f2b60 2026-02-20T03:27:34.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5bc57fa640 1 -- 10.20.193.28:0/3893783205 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8019050 con 0x5620521f2b60 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.994+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3893783205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562051f0fb60 con 0x5620521f2b60 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5bc57fa640 1 -- 10.20.193.28:0/3893783205 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5bf80042e0 con 0x5620521f2b60 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 10 client.18966 _ll_register_callbacks cb 0x5620520ec0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3893783205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5620521487f0 con 0x5620521f2b60 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5bc57fa640 1 -- 10.20.193.28:0/3893783205 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5bf80044e0 con 0x5620521f2b60 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 10 client.18966 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3893783205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56205210d430 con 0x5620521f2b60 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5bc57fa640 1 -- 10.20.193.28:0/3893783205 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5bf801d070 con 0x5620521f2b60 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 10 client.18966 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 10 client.18966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 20 client.18966 populate_metadata read hostname 'trial028' 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562052216dc0 0x5620522191b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 4 client.18966 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.995+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3893783205 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620520c2c00 con 0x562052216dc0 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.996+0000 7f5c037fe640 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562052216dc0 0x5620522191b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.996+0000 7f5bc57fa640 10 client.18966 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.996+0000 7f5c037fe640 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562052216dc0 0x5620522191b0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8148fa73b7706ee server_cookie=4b7b7427fe215f96 in_seq=0 out_seq=0 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5bc57fa640 1 -- 10.20.193.28:0/3893783205 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5620520c2c00 con 0x562052216dc0 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5bc57fa640 10 client.18966 handle_command_reply: tid=0 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 client.18966 shutdown 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3893783205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 msgr2=0x562052212aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x562052212aa0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8017040 tx=0x7f5bf8004a90 comp rx=0 tx=0).stop 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3893783205 shutdown_connections 2026-02-20T03:27:34.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562052216dc0 0x5620522191b0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x562052212aa0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521eea70 0x5620522073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3893783205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x562052206e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3893783205 >> 10.20.193.28:0/3893783205 conn(0x5620521e6b60 msgr2=0x5620521f1520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5bc57fa640 0 client.18966 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:34.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.997+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3893783205 shutdown_connections 2026-02-20T03:27:34.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.998+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3893783205 wait complete. 2026-02-20T03:27:34.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:33.998+0000 7f5c0c2cce00 20 client.18966 trim_cache size 0 max 16384 2026-02-20T03:27:34.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.006+0000 7f5c0c2cce00 1 Processor -- start 2026-02-20T03:27:34.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.006+0000 7f5c0c2cce00 1 -- start start 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.006+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x5620521f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.006+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521eea70 0x5620521f4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.006+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x56205221ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.006+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba80126e0 con 0x5620521f2b60 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.006+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba800ffb0 con 0x5620521ee0c0 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.006+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba800de00 con 0x5620521eea70 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x56205221ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c037fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x5620521f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c02ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521eea70 0x5620521f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c037fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x5620521f3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49966/0 (socket says 10.20.193.28:49966) 2026-02-20T03:27:34.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x56205221ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54842/0 (socket says 10.20.193.28:54842) 2026-02-20T03:27:34.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c037fe640 1 -- 10.20.193.28:0/3711085368 learned_addr learned my addr 10.20.193.28:0/3711085368 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:34.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c03fff640 1 -- 10.20.193.28:0/3711085368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521eea70 msgr2=0x5620521f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c03fff640 1 --2- 10.20.193.28:0/3711085368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521eea70 0x5620521f4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c03fff640 1 -- 10.20.193.28:0/3711085368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 msgr2=0x5620521f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c03fff640 1 --2- 10.20.193.28:0/3711085368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x5620521f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c03fff640 1 -- 10.20.193.28:0/3711085368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620522003d0 con 0x5620521f2b60 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c037fe640 1 --2- 10.20.193.28:0/3711085368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x5620521f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.007+0000 7f5c03fff640 1 --2- 10.20.193.28:0/3711085368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x56205221ea40 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8008fd0 tx=0x7f5bf8009070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc5e720607cde46 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5bc77fe640 1 -- 10.20.193.28:0/3711085368 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8019070 con 0x5620521f2b60 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5bc77fe640 1 -- 10.20.193.28:0/3711085368 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5620521487f0 con 0x5620521f2b60 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5bc77fe640 1 -- 10.20.193.28:0/3711085368 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8024040 con 0x5620521f2b60 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3711085368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 msgr2=0x56205221ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3711085368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x56205221ea40 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8008fd0 tx=0x7f5bf8009070 comp rx=0 tx=0).stop 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3711085368 shutdown_connections 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3711085368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521f2b60 0x56205221ea40 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3711085368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521eea70 0x5620521f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/3711085368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521ee0c0 0x5620521f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3711085368 >> 10.20.193.28:0/3711085368 conn(0x5620521e6b60 msgr2=0x5620521f3530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3711085368 shutdown_connections 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.008+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/3711085368 wait complete. 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c0c2cce00 1 -- start start 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c0c2cce00 1 Processor -- start 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x56205220d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x56205220d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c0c2cce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 0x56205227abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba800e470 con 0x5620521ee0c0 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba800f8e0 con 0x5620521eea70 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c0c2cce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba800eb40 con 0x5620521f2b60 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c02ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x56205220d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c02ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x56205220d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49980/0 (socket says 10.20.193.28:49980) 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c02ffd640 1 -- 10.20.193.28:0/2343394936 learned_addr learned my addr 10.20.193.28:0/2343394936 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.009+0000 7f5c03fff640 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 0x56205227abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c037fe640 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x56205220d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c02ffd640 1 -- 10.20.193.28:0/2343394936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 msgr2=0x56205227abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c02ffd640 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 0x56205227abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c02ffd640 1 -- 10.20.193.28:0/2343394936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 msgr2=0x56205220d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c02ffd640 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x56205220d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c02ffd640 1 -- 10.20.193.28:0/2343394936 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562051e1f900 con 0x5620521eea70 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c037fe640 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x56205220d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c02ffd640 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x56205220d860 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4038c40 tx=0x7f5bf40ccc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e8b0b947b30ec8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5bc57fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5bc57fa640 1 -- 10.20.193.28:0/2343394936 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40d1380 con 0x5620521eea70 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2343394936 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620520fb4d0 con 0x5620521eea70 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5bc57fa640 1 -- 10.20.193.28:0/2343394936 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5bf4033030 con 0x5620521eea70 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c0c2cce00 10 client.27887 _ll_register_callbacks cb 0x7f5bf8007e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2343394936 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bf8002c70 con 0x5620521eea70 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.010+0000 7f5bc57fa640 1 -- 10.20.193.28:0/2343394936 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40cbc50 con 0x5620521eea70 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5bc57fa640 1 -- 10.20.193.28:0/2343394936 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5bf40efa70 con 0x5620521eea70 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5bc57fa640 1 -- 10.20.193.28:0/2343394936 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5bf40efd90 con 0x5620521eea70 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5c0c2cce00 10 client.27887 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:34.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2343394936 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5620522010c0 con 0x5620521eea70 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5bc57fa640 1 -- 10.20.193.28:0/2343394936 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5bf40b5080 con 0x5620521eea70 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5c0c2cce00 10 client.27887 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5c0c2cce00 10 client.27887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5c0c2cce00 20 client.27887 populate_metadata read hostname 'trial028' 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562052283a80 0x562052285f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5c0c2cce00 4 client.27887 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2343394936 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562051ec12b0 con 0x562052283a80 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.011+0000 7f5c037fe640 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562052283a80 0x562052285f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.012+0000 7f5c037fe640 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562052283a80 0x562052285f40 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9abba3fe3f2b0d54 server_cookie=30c09726a50519ef in_seq=0 out_seq=0 2026-02-20T03:27:34.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.012+0000 7f5bc57fa640 10 client.27887 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:34.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5bc57fa640 1 -- 10.20.193.28:0/2343394936 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562051ec12b0 con 0x562052283a80 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5bc57fa640 10 client.27887 handle_command_reply: tid=0 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 client.27887 shutdown 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2343394936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 msgr2=0x56205220d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x56205220d860 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4038c40 tx=0x7f5bf40ccc10 comp rx=0 tx=0).stop 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2343394936 shutdown_connections 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562052283a80 0x562052285f40 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5620521f2b60 0x56205227abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5620521eea70 0x56205220d860 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 --2- 10.20.193.28:0/2343394936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5620521ee0c0 0x56205220d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2343394936 >> 10.20.193.28:0/2343394936 conn(0x5620521e6b60 msgr2=0x5620521f3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5bc57fa640 0 client.27887 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:34.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2343394936 shutdown_connections 2026-02-20T03:27:34.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 1 -- 10.20.193.28:0/2343394936 wait complete. 2026-02-20T03:27:34.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.013+0000 7f5c0c2cce00 20 client.27887 trim_cache size 0 max 16384 2026-02-20T03:27:34.022 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:27:34.022 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:27:34.022 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "fb748064-66ab-4361-8adb-a4adbbbd8a0b", 2026-02-20T03:27:34.022 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:27:34.023 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:27:34.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 -- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bd80b0e20 msgr2=0x7f5bd80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bd80b0e20 0x7f5bd80b32e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x5620521ef090 tx=0x7f5bf000a480 comp rx=0 tx=0).stop 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 -- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c04105320 msgr2=0x7f5c0419d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c04105320 0x7f5c0419d570 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009a60 tx=0x7f5bf402fca0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 -- 10.20.193.28:0/3339938402 shutdown_connections 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5bd80b0e20 0x7f5bd80b32e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5c0410a980 0x7f5c041a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5c04105320 0x7f5c0419d570 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 --2- 10.20.193.28:0/3339938402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5c04104980 0x7f5c0419d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 -- 10.20.193.28:0/3339938402 >> 10.20.193.28:0/3339938402 conn(0x7f5c04100680 msgr2=0x7f5c04100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 -- 10.20.193.28:0/3339938402 shutdown_connections 2026-02-20T03:27:34.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.014+0000 7f5c08b3e640 1 -- 10.20.193.28:0/3339938402 wait complete. 2026-02-20T03:27:34.115 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:27:34.384 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:27:34.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:34 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:27:34.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:34 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:34.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1083561 7.77 MB/sec execute 547 sec latency 10.100 ms 2026-02-20T03:27:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.573+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3635074176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb01810eef0 msgr2=0x7fb01810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.573+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3635074176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb01810eef0 0x7fb01810f2d0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fb010009a30 tx=0x7fb01002f220 comp rx=0 tx=0).stop 2026-02-20T03:27:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.574+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3635074176 shutdown_connections 2026-02-20T03:27:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.574+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3635074176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb018109ba0 0x7fb018115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.574+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3635074176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb018109220 0x7fb018109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.574+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3635074176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb01810eef0 0x7fb01810f2d0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.574+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3635074176 >> 10.20.193.28:0/3635074176 conn(0x7fb018078600 msgr2=0x7fb01807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.574+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3635074176 shutdown_connections 2026-02-20T03:27:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.574+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3635074176 wait complete. 2026-02-20T03:27:34.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.574+0000 7fb01f6e0640 1 Processor -- start 2026-02-20T03:27:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01f6e0640 1 -- start start 2026-02-20T03:27:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01f6e0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb018109220 0x7fb0181a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01f6e0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb018109ba0 0x7fb0181a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01f6e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb01810eef0 0x7fb0181a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01f6e0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb0181190b0 con 0x7fb01810eef0 2026-02-20T03:27:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01f6e0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb018118f30 con 0x7fb018109ba0 2026-02-20T03:27:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01f6e0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb018119230 con 0x7fb018109220 2026-02-20T03:27:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01e6de640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb018109220 0x7fb0181a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01e6de640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb018109220 0x7fb0181a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:49798/0 (socket says 10.20.193.28:49798) 2026-02-20T03:27:34.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01e6de640 1 -- 10.20.193.28:0/3013503029 learned_addr learned my addr 10.20.193.28:0/3013503029 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:34.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01eedf640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb01810eef0 0x7fb0181a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01dedd640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb018109ba0 0x7fb0181a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01eedf640 1 -- 10.20.193.28:0/3013503029 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb018109220 msgr2=0x7fb0181a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01eedf640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb018109220 0x7fb0181a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01eedf640 1 -- 10.20.193.28:0/3013503029 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb018109ba0 msgr2=0x7fb0181a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01eedf640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb018109ba0 0x7fb0181a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.575+0000 7fb01eedf640 1 -- 10.20.193.28:0/3013503029 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0181a65c0 con 0x7fb01810eef0 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.576+0000 7fb01eedf640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb01810eef0 0x7fb0181a5e40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fb00c004830 tx=0x7fb00c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.576+0000 7fb0037fe640 1 -- 10.20.193.28:0/3013503029 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00db60 con 0x7fb01810eef0 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.576+0000 7fb0037fe640 1 -- 10.20.193.28:0/3013503029 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb00c00dd00 con 0x7fb01810eef0 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.576+0000 7fb0037fe640 1 -- 10.20.193.28:0/3013503029 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00c013770 con 0x7fb01810eef0 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.576+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3013503029 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0181a6850 con 0x7fb01810eef0 2026-02-20T03:27:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.576+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3013503029 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0181ae0f0 con 0x7fb01810eef0 2026-02-20T03:27:34.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.579+0000 7fb0037fe640 1 -- 10.20.193.28:0/3013503029 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb00c012070 con 0x7fb01810eef0 2026-02-20T03:27:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.579+0000 7fb022e6ee00 1 Processor -- start 2026-02-20T03:27:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.579+0000 7fb022e6ee00 1 -- start start 2026-02-20T03:27:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a23f000 0x56218a23f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 0x56218a239a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a245e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56218a1b9e50 con 0x56218a239fb0 2026-02-20T03:27:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56218a18c9c0 con 0x56218a23f000 2026-02-20T03:27:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56218a13a240 con 0x56218a239630 2026-02-20T03:27:34.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01dedd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a23f000 0x56218a23f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01dedd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a23f000 0x56218a23f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:49998/0 (socket says 10.20.193.28:49998) 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01dedd640 1 -- 10.20.193.28:0/1566453373 learned_addr learned my addr 10.20.193.28:0/1566453373 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01dedd640 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a245e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01e6de640 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 0x56218a239a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb0037fe640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faff40b0e20 0x7faff40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01e6de640 1 -- 10.20.193.28:0/1566453373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a23f000 msgr2=0x56218a23f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01e6de640 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a23f000 0x56218a23f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01e6de640 1 -- 10.20.193.28:0/1566453373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 msgr2=0x56218a245e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb0037fe640 1 -- 10.20.193.28:0/3013503029 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fb00c0e01a0 con 0x7fb01810eef0 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01e6de640 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a245e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01e6de640 1 -- 10.20.193.28:0/1566453373 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218a14d420 con 0x56218a239630 2026-02-20T03:27:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.580+0000 7fb01dedd640 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a245e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb01e6de640 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 0x56218a239a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb010002410 tx=0x7fb010038520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b181992f20dc17da server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb01eedf640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faff40b0e20 0x7faff40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb000ff9640 1 -- 10.20.193.28:0/1566453373 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010047070 con 0x56218a239630 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb000ff9640 1 -- 10.20.193.28:0/1566453373 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb010033040 con 0x56218a239630 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1566453373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 msgr2=0x56218a239a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 0x56218a239a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb010002410 tx=0x7fb010038520 comp rx=0 tx=0).stop 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb000ff9640 1 -- 10.20.193.28:0/1566453373 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010038dc0 con 0x56218a239630 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb01eedf640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faff40b0e20 0x7faff40b32e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0a7ec0 tx=0x7fb00c002750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1566453373 shutdown_connections 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a245e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 0x56218a239a70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1566453373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a23f000 0x56218a23f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1566453373 >> 10.20.193.28:0/1566453373 conn(0x56218a1fc290 msgr2=0x56218a237d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1566453373 shutdown_connections 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.581+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1566453373 wait complete. 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb022e6ee00 1 -- start start 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb022e6ee00 1 Processor -- start 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 0x56218a2539d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a253f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a23f000 0x56218a252110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56218a1888f0 con 0x56218a23f000 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562189f7af50 con 0x56218a239fb0 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56218a252890 con 0x56218a239630 2026-02-20T03:27:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb01e6de640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a253f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb01dedd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 0x56218a2539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb01e6de640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a253f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50006/0 (socket says 10.20.193.28:50006) 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb01e6de640 1 -- 10.20.193.28:0/1736699367 learned_addr learned my addr 10.20.193.28:0/1736699367 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb01dedd640 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a23f000 0x56218a252110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb01e6de640 1 -- 10.20.193.28:0/1736699367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 msgr2=0x56218a2539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb01e6de640 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 0x56218a2539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.583+0000 7fb01e6de640 1 -- 10.20.193.28:0/1736699367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a23f000 msgr2=0x56218a252110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fb01e6de640 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a23f000 0x56218a252110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fb01e6de640 1 -- 10.20.193.28:0/1736699367 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218a24bad0 con 0x56218a239fb0 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fb01dedd640 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a23f000 0x56218a252110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fb01e6de640 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a253f10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb010032040 tx=0x7fb010038cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bc4f8d3d244c76b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fafcbfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fafcbfff640 1 -- 10.20.193.28:0/1736699367 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010047040 con 0x56218a239fb0 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fafcbfff640 1 -- 10.20.193.28:0/1736699367 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb010009620 con 0x56218a239fb0 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fafcbfff640 1 -- 10.20.193.28:0/1736699367 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010042450 con 0x56218a239fb0 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1736699367 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562189f5db40 con 0x56218a239fb0 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.584+0000 7fafcbfff640 1 -- 10.20.193.28:0/1736699367 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fb010042670 con 0x56218a239fb0 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fafcbfff640 10 client.27899 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 10 client.27899 _ll_register_callbacks cb 0x56218a1c5f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1736699367 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56218a19a1a0 con 0x56218a239fb0 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fafcbfff640 1 -- 10.20.193.28:0/1736699367 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb010002950 con 0x56218a239fb0 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 10 client.27899 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1736699367 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56218a147230 con 0x56218a239fb0 2026-02-20T03:27:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fafcbfff640 1 -- 10.20.193.28:0/1736699367 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fb01004a070 con 0x56218a239fb0 2026-02-20T03:27:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 10 client.27899 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 10 client.27899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 20 client.27899 populate_metadata read hostname 'trial028' 2026-02-20T03:27:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56218a261d90 0x56218a2641c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 4 client.27899 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1736699367 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56218a1945b0 con 0x56218a261d90 2026-02-20T03:27:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.585+0000 7fb01dedd640 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56218a261d90 0x56218a2641c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.586+0000 7fb01dedd640 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56218a261d90 0x56218a2641c0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9096a1a1e042feaf server_cookie=bae19101726a7bd1 in_seq=0 out_seq=0 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.586+0000 7fafcbfff640 10 client.27899 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.586+0000 7fafcbfff640 1 -- 10.20.193.28:0/1736699367 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56218a1945b0 con 0x56218a261d90 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.586+0000 7fafcbfff640 10 client.27899 handle_command_reply: tid=0 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.586+0000 7fb022e6ee00 1 client.27899 shutdown 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.586+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1736699367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 msgr2=0x56218a253f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.586+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a253f10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb010032040 tx=0x7fb010038cf0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1736699367 shutdown_connections 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56218a261d90 0x56218a2641c0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a23f000 0x56218a252110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a253f10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/1736699367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a239630 0x56218a2539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1736699367 >> 10.20.193.28:0/1736699367 conn(0x56218a1fc290 msgr2=0x56218a238440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fafcbfff640 0 client.27899 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1736699367 shutdown_connections 2026-02-20T03:27:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fb022e6ee00 1 -- 10.20.193.28:0/1736699367 wait complete. 2026-02-20T03:27:34.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.587+0000 7fb022e6ee00 20 client.27899 trim_cache size 0 max 16384 2026-02-20T03:27:34.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:34 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:27:34.597 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:34 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.596+0000 7fb022e6ee00 1 Processor -- start 2026-02-20T03:27:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.596+0000 7fb022e6ee00 1 -- start start 2026-02-20T03:27:34.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.596+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239630 0x56218a231d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.596+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a238520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.596+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a238a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.596+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafc00126f0 con 0x56218a239fb0 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.596+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fafc000ffc0 con 0x56218a239630 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.596+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafc000de10 con 0x56218a23f000 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239630 0x56218a231d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239630 0x56218a231d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50012/0 (socket says 10.20.193.28:50012) 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 -- 10.20.193.28:0/943359009 learned_addr learned my addr 10.20.193.28:0/943359009 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a238a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01e6de640 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a238520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 -- 10.20.193.28:0/943359009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239630 msgr2=0x56218a231d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239630 0x56218a231d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 -- 10.20.193.28:0/943359009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 msgr2=0x56218a238520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a238520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 -- 10.20.193.28:0/943359009 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218a24b900 con 0x56218a23f000 2026-02-20T03:27:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01e6de640 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a238520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:27:34.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fb01dedd640 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a238a60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb004005880 tx=0x7fb004007f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a6a18c30d58a6c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fafe64e6640 1 -- 10.20.193.28:0/943359009 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004021040 con 0x56218a23f000 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.597+0000 7fafe64e6640 1 -- 10.20.193.28:0/943359009 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb004002b80 con 0x56218a23f000 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fafe64e6640 1 -- 10.20.193.28:0/943359009 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004011a60 con 0x56218a23f000 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 -- 10.20.193.28:0/943359009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 msgr2=0x56218a238a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a238a60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb004005880 tx=0x7fb004007f30 comp rx=0 tx=0).stop 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 -- 10.20.193.28:0/943359009 shutdown_connections 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a238a60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239fb0 0x56218a238520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/943359009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239630 0x56218a231d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 -- 10.20.193.28:0/943359009 >> 10.20.193.28:0/943359009 conn(0x56218a1fc290 msgr2=0x56218a262990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 -- 10.20.193.28:0/943359009 shutdown_connections 2026-02-20T03:27:34.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 -- 10.20.193.28:0/943359009 wait complete. 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.598+0000 7fb022e6ee00 1 -- start start 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb022e6ee00 1 Processor -- start 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239630 0x56218a256fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a257510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb022e6ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a2c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafc000e480 con 0x56218a239630 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fafc000f8f0 con 0x56218a239fb0 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb022e6ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafc000eb50 con 0x56218a23f000 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb01e6de640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a257510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb01e6de640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a257510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50020/0 (socket says 10.20.193.28:50020) 2026-02-20T03:27:34.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb01e6de640 1 -- 10.20.193.28:0/2974219824 learned_addr learned my addr 10.20.193.28:0/2974219824 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:34.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.599+0000 7fb01dedd640 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239630 0x56218a256fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fb01dedd640 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a2c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fb01e6de640 1 -- 10.20.193.28:0/2974219824 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 msgr2=0x56218a2c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fb01e6de640 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a2c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fb01e6de640 1 -- 10.20.193.28:0/2974219824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239630 msgr2=0x56218a256fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:34.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fb01e6de640 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239630 0x56218a256fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fb01e6de640 1 -- 10.20.193.28:0/2974219824 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562189e6b870 con 0x56218a239fb0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fb01dedd640 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a2c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fb01e6de640 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a257510 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x56218a24a7f0 tx=0x7fb010005950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d6ee2475fdccb8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fafcbfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fafcbfff640 1 -- 10.20.193.28:0/2974219824 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010047040 con 0x56218a239fb0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fafcbfff640 1 -- 10.20.193.28:0/2974219824 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb010033040 con 0x56218a239fb0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.600+0000 7fb022e6ee00 1 -- 10.20.193.28:0/2974219824 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56218a12c440 con 0x56218a239fb0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fafcbfff640 1 -- 10.20.193.28:0/2974219824 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010042b50 con 0x56218a239fb0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 10 client.27905 _ll_register_callbacks cb 0x7fb010045070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 1 -- 10.20.193.28:0/2974219824 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56218a15d810 con 0x56218a239fb0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fafcbfff640 1 -- 10.20.193.28:0/2974219824 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fb010038cf0 con 0x56218a239fb0 2026-02-20T03:27:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fafcbfff640 1 -- 10.20.193.28:0/2974219824 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb010063060 con 0x56218a239fb0 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 10 client.27905 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 1 -- 10.20.193.28:0/2974219824 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56218a24c5f0 con 0x56218a239fb0 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fafcbfff640 1 -- 10.20.193.28:0/2974219824 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fb01005c070 con 0x56218a239fb0 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 10 client.27905 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 10 client.27905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 20 client.27905 populate_metadata read hostname 'trial028' 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56218a2ce400 0x56218a2d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 4 client.27905 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.601+0000 7fb022e6ee00 1 -- 10.20.193.28:0/2974219824 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56218a13eb00 con 0x56218a2ce400 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.602+0000 7fb01dedd640 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56218a2ce400 0x56218a2d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.602+0000 7fb01dedd640 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56218a2ce400 0x56218a2d08c0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e971910299511f server_cookie=40d47e9a7a36af9c in_seq=0 out_seq=0 2026-02-20T03:27:34.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.602+0000 7fafcbfff640 10 client.27905 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.602+0000 7fafcbfff640 1 -- 10.20.193.28:0/2974219824 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56218a13eb00 con 0x56218a2ce400 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.602+0000 7fafcbfff640 10 client.27905 handle_command_reply: tid=0 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.602+0000 7fb022e6ee00 1 client.27905 shutdown 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 -- 10.20.193.28:0/2974219824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 msgr2=0x56218a257510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a257510 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x56218a24a7f0 tx=0x7fb010005950 comp rx=0 tx=0).stop 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 -- 10.20.193.28:0/2974219824 shutdown_connections 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56218a2ce400 0x56218a2d08c0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56218a23f000 0x56218a2c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56218a239fb0 0x56218a257510 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 --2- 10.20.193.28:0/2974219824 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56218a239630 0x56218a256fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 -- 10.20.193.28:0/2974219824 >> 10.20.193.28:0/2974219824 conn(0x56218a1fc290 msgr2=0x56218a250860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fafcbfff640 0 client.27905 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:34.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 -- 10.20.193.28:0/2974219824 shutdown_connections 2026-02-20T03:27:34.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 1 -- 10.20.193.28:0/2974219824 wait complete. 2026-02-20T03:27:34.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb022e6ee00 20 client.27905 trim_cache size 0 max 16384 2026-02-20T03:27:34.611 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:27:34.611 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:27:34.611 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:27:34.611 INFO:teuthology.orchestra.run.trial028.stdout: "fb748064-66ab-4361-8adb-a4adbbbd8a0b": { 2026-02-20T03:27:34.611 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:27:34.612 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "fb748064-66ab-4361-8adb-a4adbbbd8a0b", 2026-02-20T03:27:34.612 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:27:34.612 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:27:34.612 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:27:34.612 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:27:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faff40b0e20 msgr2=0x7faff40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faff40b0e20 0x7faff40b32e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0a7ec0 tx=0x7fb00c002750 comp rx=0 tx=0).stop 2026-02-20T03:27:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb01810eef0 msgr2=0x7fb0181a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.603+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb01810eef0 0x7fb0181a5e40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fb00c004830 tx=0x7fb00c00d4a0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.604+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3013503029 shutdown_connections 2026-02-20T03:27:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.604+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faff40b0e20 0x7faff40b32e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.604+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb01810eef0 0x7fb0181a5e40 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.604+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb018109ba0 0x7fb0181a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.604+0000 7fb01f6e0640 1 --2- 10.20.193.28:0/3013503029 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb018109220 0x7fb0181a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.604+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3013503029 >> 10.20.193.28:0/3013503029 conn(0x7fb018078600 msgr2=0x7fb018079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.604+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3013503029 shutdown_connections 2026-02-20T03:27:34.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:27:34.604+0000 7fb01f6e0640 1 -- 10.20.193.28:0/3013503029 wait complete. 2026-02-20T03:27:34.707 INFO:tasks.cephfs.filesystem:scrub status for tag:fb748064-66ab-4361-8adb-a4adbbbd8a0b - {'path': '/', 'tag': 'fb748064-66ab-4361-8adb-a4adbbbd8a0b', 'options': 'recursive,force'} 2026-02-20T03:27:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:34 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:27:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:34 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1086721 7.78 MB/sec execute 548 sec latency 11.779 ms 2026-02-20T03:27:35.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:35 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:27:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:35 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:35 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:27:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:35 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:27:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:35 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:35 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:35 trial126 ceph-mon[38476]: pgmap v569: 129 pgs: 129 active+clean; 183 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 462 op/s 2026-02-20T03:27:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:35 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:27:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:35 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:35 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:27:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:35 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:27:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:35 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:35 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:35 trial028 ceph-mon[38552]: pgmap v569: 129 pgs: 129 active+clean; 183 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 462 op/s 2026-02-20T03:27:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:35 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:27:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:35 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:35 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:27:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:35 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:27:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:35 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:35 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:27:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:35 trial177 ceph-mon[43181]: pgmap v569: 129 pgs: 129 active+clean; 183 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.2 MiB/s wr, 462 op/s 2026-02-20T03:27:36.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1089858 7.80 MB/sec execute 549 sec latency 8.818 ms 2026-02-20T03:27:37.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1092928 7.81 MB/sec execute 550 sec latency 14.054 ms 2026-02-20T03:27:37.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:37 trial126 ceph-mon[38476]: pgmap v570: 129 pgs: 129 active+clean; 180 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.1 MiB/s wr, 451 op/s 2026-02-20T03:27:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:37 trial028 ceph-mon[38552]: pgmap v570: 129 pgs: 129 active+clean; 180 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.1 MiB/s wr, 451 op/s 2026-02-20T03:27:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:37 trial177 ceph-mon[43181]: pgmap v570: 129 pgs: 129 active+clean; 180 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.5 MiB/s rd, 2.1 MiB/s wr, 451 op/s 2026-02-20T03:27:38.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1095862 7.83 MB/sec execute 551 sec latency 8.140 ms 2026-02-20T03:27:39.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1099088 7.85 MB/sec execute 552 sec latency 9.592 ms 2026-02-20T03:27:39.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:39 trial126 ceph-mon[38476]: pgmap v571: 129 pgs: 129 active+clean; 182 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 1.9 MiB/s wr, 429 op/s 2026-02-20T03:27:39.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:39 trial028 ceph-mon[38552]: pgmap v571: 129 pgs: 129 active+clean; 182 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 1.9 MiB/s wr, 429 op/s 2026-02-20T03:27:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:39 trial177 ceph-mon[43181]: pgmap v571: 129 pgs: 129 active+clean; 182 MiB data, 4.0 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 1.9 MiB/s wr, 429 op/s 2026-02-20T03:27:40.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1102323 7.86 MB/sec execute 553 sec latency 13.998 ms 2026-02-20T03:27:41.528 INFO:tasks.workunit.client.0.trial028.stdout: 1 1105494 7.88 MB/sec execute 554 sec latency 8.368 ms 2026-02-20T03:27:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:41 trial126 ceph-mon[38476]: pgmap v572: 129 pgs: 129 active+clean; 186 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.2 MiB/s wr, 478 op/s 2026-02-20T03:27:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:41 trial028 ceph-mon[38552]: pgmap v572: 129 pgs: 129 active+clean; 186 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.2 MiB/s wr, 478 op/s 2026-02-20T03:27:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:41 trial177 ceph-mon[43181]: pgmap v572: 129 pgs: 129 active+clean; 186 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 MiB/s rd, 2.2 MiB/s wr, 478 op/s 2026-02-20T03:27:42.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1108792 7.90 MB/sec execute 555 sec latency 7.852 ms 2026-02-20T03:27:43.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1112169 7.92 MB/sec execute 556 sec latency 8.712 ms 2026-02-20T03:27:43.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:43 trial126 ceph-mon[38476]: pgmap v573: 129 pgs: 129 active+clean; 189 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 1.9 MiB/s wr, 434 op/s 2026-02-20T03:27:43.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:43 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:27:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:43 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:27:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:43 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:27:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:43 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:27:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:43 trial028 ceph-mon[38552]: pgmap v573: 129 pgs: 129 active+clean; 189 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 1.9 MiB/s wr, 434 op/s 2026-02-20T03:27:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:43 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:27:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:43 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:27:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:43 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:27:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:43 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:27:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:43 trial177 ceph-mon[43181]: pgmap v573: 129 pgs: 129 active+clean; 189 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 1.9 MiB/s wr, 434 op/s 2026-02-20T03:27:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:43 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:27:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:43 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:27:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:43 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:27:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:43 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:27:44.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.212+0000 7f58f4b82640 1 -- 10.20.193.28:0/1082693787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f0109490 msgr2=0x7f58f0109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:44.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.212+0000 7f58f4b82640 1 --2- 10.20.193.28:0/1082693787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f0109490 0x7f58f0109890 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009a30 tx=0x7f58dc02f220 comp rx=0 tx=0).stop 2026-02-20T03:27:44.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.212+0000 7f58f4b82640 1 -- 10.20.193.28:0/1082693787 shutdown_connections 2026-02-20T03:27:44.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.212+0000 7f58f4b82640 1 --2- 10.20.193.28:0/1082693787 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58f010a900 0x7f58f0111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.212+0000 7f58f4b82640 1 --2- 10.20.193.28:0/1082693787 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58f0109e60 0x7f58f010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.212+0000 7f58f4b82640 1 --2- 10.20.193.28:0/1082693787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f0109490 0x7f58f0109890 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.212+0000 7f58f4b82640 1 -- 10.20.193.28:0/1082693787 >> 10.20.193.28:0/1082693787 conn(0x7f58f0077fe0 msgr2=0x7f58f007a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.212+0000 7f58f4b82640 1 -- 10.20.193.28:0/1082693787 shutdown_connections 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.212+0000 7f58f4b82640 1 -- 10.20.193.28:0/1082693787 wait complete. 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58f4b82640 1 Processor -- start 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58f4b82640 1 -- start start 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58f4b82640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58f0109490 0x7f58f01a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58f4b82640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58f0109e60 0x7f58f01a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58f4b82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f010a900 0x7f58f01a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58f4b82640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f58f0114910 con 0x7f58f010a900 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58f4b82640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f58f0114790 con 0x7f58f0109e60 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58f4b82640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f58f0114a90 con 0x7f58f0109490 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58ef7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58f0109490 0x7f58f01a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f010a900 0x7f58f01a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58eeffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58f0109e60 0x7f58f01a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f010a900 0x7f58f01a8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59844/0 (socket says 10.20.193.28:59844) 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.213+0000 7f58effff640 1 -- 10.20.193.28:0/4218189988 learned_addr learned my addr 10.20.193.28:0/4218189988 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58effff640 1 -- 10.20.193.28:0/4218189988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58f0109490 msgr2=0x7f58f01a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58effff640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58f0109490 0x7f58f01a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58effff640 1 -- 10.20.193.28:0/4218189988 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58f0109e60 msgr2=0x7f58f01a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:44.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58effff640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58f0109e60 0x7f58f01a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58effff640 1 -- 10.20.193.28:0/4218189988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f01a8c60 con 0x7f58f010a900 2026-02-20T03:27:44.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58effff640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f010a900 0x7f58f01a8560 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f58e400ef30 tx=0x7f58e400c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:44.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58ecff9640 1 -- 10.20.193.28:0/4218189988 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4019070 con 0x7f58f010a900 2026-02-20T03:27:44.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58ecff9640 1 -- 10.20.193.28:0/4218189988 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58e40092d0 con 0x7f58f010a900 2026-02-20T03:27:44.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58ecff9640 1 -- 10.20.193.28:0/4218189988 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4007500 con 0x7f58f010a900 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58f4b82640 1 -- 10.20.193.28:0/4218189988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f01a8ef0 con 0x7f58f010a900 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.214+0000 7f58f4b82640 1 -- 10.20.193.28:0/4218189988 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f01a9360 con 0x7f58f010a900 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.217+0000 7f58ecff9640 1 -- 10.20.193.28:0/4218189988 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f58e4004b40 con 0x7f58f010a900 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.217+0000 7f58f8c6fe00 1 Processor -- start 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.217+0000 7f58f8c6fe00 1 -- start start 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a3c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a40f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a41560 0x557716a439f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55771698c8f0 con 0x557716a3be80 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55771693a2e0 con 0x557716a41560 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557716988820 con 0x557716a3c7c0 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a3c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a3c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59846/0 (socket says 10.20.193.28:59846) 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 -- 10.20.193.28:0/465016872 learned_addr learned my addr 10.20.193.28:0/465016872 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58ef7fe640 1 --2- 10.20.193.28:0/465016872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a40f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 --2- 10.20.193.28:0/465016872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a41560 0x557716a439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 -- 10.20.193.28:0/465016872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 msgr2=0x557716a40f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 --2- 10.20.193.28:0/465016872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a40f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 -- 10.20.193.28:0/465016872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a41560 msgr2=0x557716a439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 --2- 10.20.193.28:0/465016872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a41560 0x557716a439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 -- 10.20.193.28:0/465016872 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55771692c5a0 con 0x557716a3be80 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58eeffd640 1 --2- 10.20.193.28:0/465016872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a3c280 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f58e0012620 tx=0x7f58e00078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfc5c4cda2fcc45 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58bb7fe640 1 -- 10.20.193.28:0/465016872 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e00040d0 con 0x557716a3be80 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.218+0000 7f58ecff9640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58c40b0e20 0x7f58c40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58bb7fe640 1 -- 10.20.193.28:0/465016872 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58e00026e0 con 0x557716a3be80 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58bb7fe640 1 -- 10.20.193.28:0/465016872 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e000e770 con 0x557716a3be80 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58ecff9640 1 -- 10.20.193.28:0/4218189988 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f58e40e0270 con 0x7f58f010a900 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58ef7fe640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58c40b0e20 0x7f58c40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/465016872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 msgr2=0x557716a3c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/465016872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a3c280 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f58e0012620 tx=0x7f58e00078a0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/465016872 shutdown_connections 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/465016872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a41560 0x557716a439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/465016872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a40f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/465016872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a3c280 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/465016872 >> 10.20.193.28:0/465016872 conn(0x557716a336f0 msgr2=0x557716a3a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/465016872 shutdown_connections 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/465016872 wait complete. 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.219+0000 7f58ef7fe640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58c40b0e20 0x7f58c40b32e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f58dc002410 tx=0x7f58dc0057f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.220+0000 7f58f8c6fe00 1 -- start start 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58f8c6fe00 1 Processor -- start 2026-02-20T03:27:44.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a65cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 0x557716a66230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a41560 0x557716a6d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577169340c0 con 0x557716a3be80 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557716a559c0 con 0x557716a3c7c0 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557716a6d640 con 0x557716a41560 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a65cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58ef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a65cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59854/0 (socket says 10.20.193.28:59854) 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58ef7fe640 1 -- 10.20.193.28:0/1798803831 learned_addr learned my addr 10.20.193.28:0/1798803831 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58effff640 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a41560 0x557716a6d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.221+0000 7f58eeffd640 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 0x557716a66230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58ef7fe640 1 -- 10.20.193.28:0/1798803831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a41560 msgr2=0x557716a6d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58ef7fe640 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a41560 0x557716a6d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58ef7fe640 1 -- 10.20.193.28:0/1798803831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 msgr2=0x557716a66230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58ef7fe640 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 0x557716a66230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58ef7fe640 1 -- 10.20.193.28:0/1798803831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557716a5f410 con 0x557716a3be80 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58eeffd640 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 0x557716a66230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58ef7fe640 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a65cf0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f58f007b6a0 tx=0x7f58dc02f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53a2214a242251a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58b8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58b8ff9640 1 -- 10.20.193.28:0/1798803831 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc053070 con 0x557716a3be80 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1798803831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557716948820 con 0x557716a3be80 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58f8c6fe00 10 client.18996 _ll_register_callbacks cb 0x557716937ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1798803831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5577169944e0 con 0x557716a3be80 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58b8ff9640 1 -- 10.20.193.28:0/1798803831 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58dc033040 con 0x557716a3be80 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58b8ff9640 1 -- 10.20.193.28:0/1798803831 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc04ed00 con 0x557716a3be80 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58b8ff9640 1 -- 10.20.193.28:0/1798803831 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f58dc058440 con 0x557716a3be80 2026-02-20T03:27:44.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58b8ff9640 1 -- 10.20.193.28:0/1798803831 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f58dc058720 con 0x557716a3be80 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.222+0000 7f58f8c6fe00 10 client.18996 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.223+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1798803831 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55771694d380 con 0x557716a3be80 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.223+0000 7f58b8ff9640 1 -- 10.20.193.28:0/1798803831 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f58dc060020 con 0x557716a3be80 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.223+0000 7f58f8c6fe00 10 client.18996 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.223+0000 7f58f8c6fe00 10 client.18996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.223+0000 7f58f8c6fe00 20 client.18996 populate_metadata read hostname 'trial028' 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.223+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557716a71990 0x557716a73e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.223+0000 7f58f8c6fe00 4 client.18996 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.223+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1798803831 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55771690ebd0 con 0x557716a71990 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.223+0000 7f58eeffd640 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557716a71990 0x557716a73e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58eeffd640 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557716a71990 0x557716a73e20 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355c633c337d5f06 server_cookie=2bb0888876e60112 in_seq=0 out_seq=0 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58b8ff9640 10 client.18996 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58b8ff9640 1 -- 10.20.193.28:0/1798803831 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55771690ebd0 con 0x557716a71990 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58b8ff9640 10 client.18996 handle_command_reply: tid=0 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 client.18996 shutdown 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1798803831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 msgr2=0x557716a65cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a65cf0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f58f007b6a0 tx=0x7f58dc02f220 comp rx=0 tx=0).stop 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1798803831 shutdown_connections 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557716a71990 0x557716a73e20 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a41560 0x557716a6d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 0x557716a66230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1798803831 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a3be80 0x557716a65cf0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1798803831 >> 10.20.193.28:0/1798803831 conn(0x557716a336f0 msgr2=0x557716a42870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58b8ff9640 0 client.18996 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1798803831 shutdown_connections 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.224+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1798803831 wait complete. 2026-02-20T03:27:44.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.225+0000 7f58f8c6fe00 20 client.18996 trim_cache size 0 max 16384 2026-02-20T03:27:44.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58f8c6fe00 1 Processor -- start 2026-02-20T03:27:44.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58f8c6fe00 1 -- start start 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3be80 0x557716a39d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 0x557716a6d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a3a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5894012770 con 0x557716a41560 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5894010040 con 0x557716a3c7c0 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f589400de90 con 0x557716a3be80 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a3a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a3a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59856/0 (socket says 10.20.193.28:59856) 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58effff640 1 -- 10.20.193.28:0/1572735167 learned_addr learned my addr 10.20.193.28:0/1572735167 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58ef7fe640 1 --2- 10.20.193.28:0/1572735167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3be80 0x557716a39d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58eeffd640 1 --2- 10.20.193.28:0/1572735167 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 0x557716a6d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58effff640 1 -- 10.20.193.28:0/1572735167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3be80 msgr2=0x557716a39d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58effff640 1 --2- 10.20.193.28:0/1572735167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3be80 0x557716a39d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58effff640 1 -- 10.20.193.28:0/1572735167 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 msgr2=0x557716a6d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58effff640 1 --2- 10.20.193.28:0/1572735167 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 0x557716a6d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.232+0000 7f58effff640 1 -- 10.20.193.28:0/1572735167 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557716a5f240 con 0x557716a41560 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58effff640 1 --2- 10.20.193.28:0/1572735167 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a3a290 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f58e40a7d00 tx=0x7f58e40a7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af78e74f9756a22 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58baffd640 1 -- 10.20.193.28:0/1572735167 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40ac300 con 0x557716a41560 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58baffd640 1 -- 10.20.193.28:0/1572735167 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58e40b11b0 con 0x557716a41560 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58baffd640 1 -- 10.20.193.28:0/1572735167 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e40a3720 con 0x557716a41560 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1572735167 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 msgr2=0x557716a3a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1572735167 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a3a290 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f58e40a7d00 tx=0x7f58e40a7800 comp rx=0 tx=0).stop 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1572735167 shutdown_connections 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1572735167 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a3a290 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1572735167 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3c7c0 0x557716a6d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/1572735167 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3be80 0x557716a39d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1572735167 >> 10.20.193.28:0/1572735167 conn(0x557716a336f0 msgr2=0x557716a41940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1572735167 shutdown_connections 2026-02-20T03:27:44.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.233+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/1572735167 wait complete. 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58f8c6fe00 1 -- start start 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58f8c6fe00 1 Processor -- start 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3be80 0x557716a69280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58f8c6fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a6c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f589400e500 con 0x557716a41560 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f589400f970 con 0x557716a3be80 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58f8c6fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f589400ebd0 con 0x557716a3c7c0 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58ef7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3be80 0x557716a69280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58effff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a6c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58eeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58ef7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3be80 0x557716a69280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47838/0 (socket says 10.20.193.28:47838) 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58eeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:57062/0 (socket says 10.20.193.28:57062) 2026-02-20T03:27:44.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.234+0000 7f58ef7fe640 1 -- 10.20.193.28:0/21517531 learned_addr learned my addr 10.20.193.28:0/21517531 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58effff640 1 -- 10.20.193.28:0/21517531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 msgr2=0x557716a697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58effff640 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58effff640 1 -- 10.20.193.28:0/21517531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3be80 msgr2=0x557716a69280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58effff640 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3be80 0x557716a69280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58effff640 1 -- 10.20.193.28:0/21517531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557716a744a0 con 0x557716a41560 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58eeffd640 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58effff640 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a6c7d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009c10 tx=0x7f58e40943a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75ff3a15b6b7e98 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58b8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58b8ff9640 1 -- 10.20.193.28:0/21517531 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4090310 con 0x557716a41560 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58b8ff9640 1 -- 10.20.193.28:0/21517531 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58e40a6a80 con 0x557716a41560 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58b8ff9640 1 -- 10.20.193.28:0/21517531 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4002ca0 con 0x557716a41560 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/21517531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577166ec690 con 0x557716a41560 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58b8ff9640 1 -- 10.20.193.28:0/21517531 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f58e405a1c0 con 0x557716a41560 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58b8ff9640 10 client.19002 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:27:44.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58f8c6fe00 10 client.19002 _ll_register_callbacks cb 0x7f58dc005970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/21517531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58e00026e0 con 0x557716a41560 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58b8ff9640 1 -- 10.20.193.28:0/21517531 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f58e40a6c30 con 0x557716a41560 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58f8c6fe00 10 client.19002 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.235+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/21517531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x557716951b70 con 0x557716a41560 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58b8ff9640 1 -- 10.20.193.28:0/21517531 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f58e40ab070 con 0x557716a41560 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58f8c6fe00 10 client.19002 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58f8c6fe00 10 client.19002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58f8c6fe00 20 client.19002 populate_metadata read hostname 'trial028' 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557716add770 0x557716adfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58f8c6fe00 4 client.19002 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/21517531 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557716765520 con 0x557716add770 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58ef7fe640 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557716add770 0x557716adfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58ef7fe640 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557716add770 0x557716adfc30 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30c2a1a4b0fa9c5d server_cookie=afadb6522c856b18 in_seq=0 out_seq=0 2026-02-20T03:27:44.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.236+0000 7f58b8ff9640 10 client.19002 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.353+0000 7f58b8ff9640 1 -- 10.20.193.28:0/21517531 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557716765520 con 0x557716add770 2026-02-20T03:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.353+0000 7f58b8ff9640 10 client.19002 handle_command_reply: tid=0 2026-02-20T03:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.353+0000 7f58f8c6fe00 1 client.19002 shutdown 2026-02-20T03:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.353+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/21517531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 msgr2=0x557716a6c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:44.356 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.353+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a6c7d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009c10 tx=0x7f58e40943a0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/21517531 shutdown_connections 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557716add770 0x557716adfc30 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557716a41560 0x557716a6c7d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557716a3c7c0 0x557716a697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58f8c6fe00 1 --2- 10.20.193.28:0/21517531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557716a3be80 0x557716a69280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/21517531 >> 10.20.193.28:0/21517531 conn(0x557716a336f0 msgr2=0x557716a42160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58b8ff9640 0 client.19002 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/21517531 shutdown_connections 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58f8c6fe00 1 -- 10.20.193.28:0/21517531 wait complete. 2026-02-20T03:27:44.357 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.354+0000 7f58f8c6fe00 20 client.19002 trim_cache size 0 max 16384 2026-02-20T03:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 -- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58c40b0e20 msgr2=0x7f58c40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:44.358 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58c40b0e20 0x7f58c40b32e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f58dc002410 tx=0x7f58dc0057f0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 -- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f010a900 msgr2=0x7f58f01a8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f010a900 0x7f58f01a8560 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f58e400ef30 tx=0x7f58e400c560 comp rx=0 tx=0).stop 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 -- 10.20.193.28:0/4218189988 shutdown_connections 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58c40b0e20 0x7f58c40b32e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58f010a900 0x7f58f01a8560 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58f0109e60 0x7f58f01a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 --2- 10.20.193.28:0/4218189988 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58f0109490 0x7f58f01a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 -- 10.20.193.28:0/4218189988 >> 10.20.193.28:0/4218189988 conn(0x7f58f0077fe0 msgr2=0x7f58f010d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 -- 10.20.193.28:0/4218189988 shutdown_connections 2026-02-20T03:27:44.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:44.355+0000 7f58f4b82640 1 -- 10.20.193.28:0/4218189988 wait complete. 2026-02-20T03:27:44.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1115485 7.94 MB/sec execute 557 sec latency 29.356 ms 2026-02-20T03:27:44.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:27:44.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:27:44.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:27:44.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:27:44.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:27:44.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:27:44.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:27:44.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:27:44.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:27:45.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1118817 7.96 MB/sec execute 558 sec latency 7.809 ms 2026-02-20T03:27:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:45 trial177 ceph-mon[43181]: pgmap v574: 129 pgs: 129 active+clean; 194 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 466 op/s 2026-02-20T03:27:45.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:45 trial126 ceph-mon[38476]: pgmap v574: 129 pgs: 129 active+clean; 194 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 466 op/s 2026-02-20T03:27:45.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:45 trial028 ceph-mon[38552]: pgmap v574: 129 pgs: 129 active+clean; 194 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.3 MiB/s rd, 2.2 MiB/s wr, 466 op/s 2026-02-20T03:27:46.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1121873 7.97 MB/sec execute 559 sec latency 8.313 ms 2026-02-20T03:27:47.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1124858 7.98 MB/sec execute 560 sec latency 19.979 ms 2026-02-20T03:27:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:47 trial177 ceph-mon[43181]: pgmap v575: 129 pgs: 129 active+clean; 195 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 388 op/s 2026-02-20T03:27:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:47 trial126 ceph-mon[38476]: pgmap v575: 129 pgs: 129 active+clean; 195 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 388 op/s 2026-02-20T03:27:47.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:47 trial028 ceph-mon[38552]: pgmap v575: 129 pgs: 129 active+clean; 195 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.2 MiB/s rd, 1.8 MiB/s wr, 388 op/s 2026-02-20T03:27:48.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1128266 8.00 MB/sec execute 561 sec latency 7.873 ms 2026-02-20T03:27:49.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1131194 8.01 MB/sec execute 562 sec latency 8.709 ms 2026-02-20T03:27:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:49 trial177 ceph-mon[43181]: pgmap v576: 129 pgs: 129 active+clean; 193 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 1.9 MiB/s wr, 414 op/s 2026-02-20T03:27:49.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:49 trial126 ceph-mon[38476]: pgmap v576: 129 pgs: 129 active+clean; 193 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 1.9 MiB/s wr, 414 op/s 2026-02-20T03:27:49.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:49 trial028 ceph-mon[38552]: pgmap v576: 129 pgs: 129 active+clean; 193 MiB data, 4.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 1.9 MiB/s wr, 414 op/s 2026-02-20T03:27:50.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1133772 8.03 MB/sec execute 563 sec latency 171.266 ms 2026-02-20T03:27:51.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1135565 8.02 MB/sec execute 564 sec latency 682.572 ms 2026-02-20T03:27:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:51 trial177 ceph-mon[43181]: pgmap v577: 129 pgs: 129 active+clean; 195 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 MiB/s rd, 2.3 MiB/s wr, 513 op/s 2026-02-20T03:27:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:51 trial126 ceph-mon[38476]: pgmap v577: 129 pgs: 129 active+clean; 195 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 MiB/s rd, 2.3 MiB/s wr, 513 op/s 2026-02-20T03:27:51.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:51 trial028 ceph-mon[38552]: pgmap v577: 129 pgs: 129 active+clean; 195 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 5.0 MiB/s rd, 2.3 MiB/s wr, 513 op/s 2026-02-20T03:27:52.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1138461 8.04 MB/sec execute 565 sec latency 8.792 ms 2026-02-20T03:27:52.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:52 trial177 ceph-mon[43181]: pgmap v578: 129 pgs: 129 active+clean; 196 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 2.0 MiB/s wr, 450 op/s 2026-02-20T03:27:52.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:52 trial126 ceph-mon[38476]: pgmap v578: 129 pgs: 129 active+clean; 196 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 2.0 MiB/s wr, 450 op/s 2026-02-20T03:27:52.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:52 trial028 ceph-mon[38552]: pgmap v578: 129 pgs: 129 active+clean; 196 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.4 MiB/s rd, 2.0 MiB/s wr, 450 op/s 2026-02-20T03:27:53.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1141586 8.06 MB/sec execute 566 sec latency 10.610 ms 2026-02-20T03:27:54.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1144646 8.07 MB/sec execute 567 sec latency 8.132 ms 2026-02-20T03:27:55.488 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:55 trial028 ceph-mon[38552]: pgmap v579: 129 pgs: 129 active+clean; 198 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 MiB/s rd, 1.9 MiB/s wr, 417 op/s 2026-02-20T03:27:55.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1147708 8.09 MB/sec execute 568 sec latency 102.335 ms 2026-02-20T03:27:55.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:55 trial126 ceph-mon[38476]: pgmap v579: 129 pgs: 129 active+clean; 198 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 MiB/s rd, 1.9 MiB/s wr, 417 op/s 2026-02-20T03:27:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:55 trial177 ceph-mon[43181]: pgmap v579: 129 pgs: 129 active+clean; 198 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 MiB/s rd, 1.9 MiB/s wr, 417 op/s 2026-02-20T03:27:56.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1147709 8.08 MB/sec execute 569 sec latency 931.104 ms 2026-02-20T03:27:57.371 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:57 trial028 ceph-mon[38552]: pgmap v580: 129 pgs: 129 active+clean; 202 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 MiB/s rd, 2.2 MiB/s wr, 435 op/s 2026-02-20T03:27:57.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- 10.20.193.28:0/2744372903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10105b30 msgr2=0x7f5e10105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:57.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2744372903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10105b30 0x7f5e10105fb0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009a30 tx=0x7f5e0002f260 comp rx=0 tx=0).stop 2026-02-20T03:27:57.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- 10.20.193.28:0/2744372903 shutdown_connections 2026-02-20T03:27:57.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2744372903 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e101064f0 0x7f5e1010cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2744372903 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10105b30 0x7f5e10105fb0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2744372903 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e10104940 0x7f5e10104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- 10.20.193.28:0/2744372903 >> 10.20.193.28:0/2744372903 conn(0x7f5e101000c0 msgr2=0x7f5e101024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:57.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- 10.20.193.28:0/2744372903 shutdown_connections 2026-02-20T03:27:57.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- 10.20.193.28:0/2744372903 wait complete. 2026-02-20T03:27:57.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 Processor -- start 2026-02-20T03:27:57.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- start start 2026-02-20T03:27:57.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10104940 0x7f5e1019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e10105b30 0x7f5e1019d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e101064f0 0x7f5e101a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e10110550 con 0x7f5e10104940 2026-02-20T03:27:57.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e101103d0 con 0x7f5e10105b30 2026-02-20T03:27:57.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e101106d0 con 0x7f5e101064f0 2026-02-20T03:27:57.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10104940 0x7f5e1019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:57.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10104940 0x7f5e1019cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47060/0 (socket says 10.20.193.28:47060) 2026-02-20T03:27:57.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0f7fe640 1 -- 10.20.193.28:0/2230334531 learned_addr learned my addr 10.20.193.28:0/2230334531 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:57.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0f7fe640 1 -- 10.20.193.28:0/2230334531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e101064f0 msgr2=0x7f5e101a4140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:27:57.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0f7fe640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e101064f0 0x7f5e101a4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0f7fe640 1 -- 10.20.193.28:0/2230334531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e10105b30 msgr2=0x7f5e1019d0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0f7fe640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e10105b30 0x7f5e1019d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0f7fe640 1 -- 10.20.193.28:0/2230334531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e101a4840 con 0x7f5e10104940 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0f7fe640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10104940 0x7f5e1019cb90 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00b750 tx=0x7f5dfc00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2230334531 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc004480 con 0x7f5e10104940 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2230334531 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5dfc010070 con 0x7f5e10104940 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- 10.20.193.28:0/2230334531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e101a4b30 con 0x7f5e10104940 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2230334531 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00ca90 con 0x7f5e10104940 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e149cf640 1 -- 10.20.193.28:0/2230334531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e101a50d0 con 0x7f5e10104940 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2230334531 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5dfc01d030 con 0x7f5e10104940 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e18abce00 1 Processor -- start 2026-02-20T03:27:57.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e18abce00 1 -- start start 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb65070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 0x555b4bb69fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 0x555b4bb6ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e18abce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555b4bab58f0 con 0x555b4bb64c50 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e18abce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555b4ba632e0 con 0x555b4bb6a600 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.431+0000 7f5e18abce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555b4bab1820 con 0x555b4bb655b0 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb65070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb65070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47062/0 (socket says 10.20.193.28:47062) 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 -- 10.20.193.28:0/1029124701 learned_addr learned my addr 10.20.193.28:0/1029124701 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 -- 10.20.193.28:0/1029124701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 msgr2=0x555b4bb69fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:57.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/1029124701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 0x555b4bb69fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 -- 10.20.193.28:0/1029124701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 msgr2=0x555b4bb6ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/1029124701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 0x555b4bb6ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 -- 10.20.193.28:0/1029124701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4ba555a0 con 0x555b4bb64c50 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0cff9640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5de40b0e20 0x7f5de40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/1029124701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb65070 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009d20 tx=0x7f5e0400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7992bd513ec582 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0cff9640 1 -- 10.20.193.28:0/2230334531 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5dfc0df8e0 con 0x7f5e10104940 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5ddb7fe640 1 -- 10.20.193.28:0/1029124701 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04017070 con 0x555b4bb64c50 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0f7fe640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5de40b0e20 0x7f5de40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5ddb7fe640 1 -- 10.20.193.28:0/1029124701 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e0400bd50 con 0x555b4bb64c50 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5ddb7fe640 1 -- 10.20.193.28:0/1029124701 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04006e60 con 0x555b4bb64c50 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- 10.20.193.28:0/1029124701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 msgr2=0x555b4bb65070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:57.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 --2- 10.20.193.28:0/1029124701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb65070 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009d20 tx=0x7f5e0400b420 comp rx=0 tx=0).stop 2026-02-20T03:27:57.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0f7fe640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5de40b0e20 0x7f5de40b32e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc002410 tx=0x7f5dfc00bd60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:57.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- 10.20.193.28:0/1029124701 shutdown_connections 2026-02-20T03:27:57.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 --2- 10.20.193.28:0/1029124701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 0x555b4bb6ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 --2- 10.20.193.28:0/1029124701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 0x555b4bb69fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 --2- 10.20.193.28:0/1029124701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb65070 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- 10.20.193.28:0/1029124701 >> 10.20.193.28:0/1029124701 conn(0x555b4bb5c2d0 msgr2=0x555b4bb63150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:57.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- 10.20.193.28:0/1029124701 shutdown_connections 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- 10.20.193.28:0/1029124701 wait complete. 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- start start 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 Processor -- start 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb64c50 0x555b4bb7d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb655b0 0x555b4bb7df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb6a600 0x555b4bb84e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555b4ba5d0c0 con 0x555b4bb6a600 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555b4bb6d5f0 con 0x555b4bb655b0 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555b4bb85420 con 0x555b4bb64c50 2026-02-20T03:27:57.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb6a600 0x555b4bb84e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb6a600 0x555b4bb84e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47078/0 (socket says 10.20.193.28:47078) 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 -- 10.20.193.28:0/3224024838 learned_addr learned my addr 10.20.193.28:0/3224024838 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 -- 10.20.193.28:0/3224024838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb64c50 msgr2=0x555b4bb7d9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb64c50 0x555b4bb7d9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 -- 10.20.193.28:0/3224024838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb655b0 msgr2=0x555b4bb7df10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb655b0 0x555b4bb7df10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 -- 10.20.193.28:0/3224024838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4bb77110 con 0x555b4bb6a600 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb6a600 0x555b4bb84e90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5e04015040 tx=0x7f5e04012640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0948386ca3f8077 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5dd8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3224024838 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04017040 con 0x555b4bb6a600 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3224024838 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e04004950 con 0x555b4bb6a600 2026-02-20T03:27:57.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3224024838 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0401d470 con 0x555b4bb6a600 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- 10.20.193.28:0/3224024838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4ba71820 con 0x555b4bb6a600 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 10 client.19014 _ll_register_callbacks cb 0x555b4ba60ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3224024838 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5e040126b0 con 0x555b4bb6a600 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- 10.20.193.28:0/3224024838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555b4babd4e0 con 0x555b4bb6a600 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3224024838 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5e04006e60 con 0x555b4bb6a600 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 10 client.19014 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 1 -- 10.20.193.28:0/3224024838 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x555b4ba76380 con 0x555b4bb6a600 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3224024838 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5e04002b00 con 0x555b4bb6a600 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 10 client.19014 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.436+0000 7f5e18abce00 10 client.19014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.441+0000 7f5e18abce00 20 client.19014 populate_metadata read hostname 'trial028' 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.441+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555b4bb89430 0x555b4bb8b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.441+0000 7f5e18abce00 4 client.19014 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:27:57.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.441+0000 7f5e18abce00 1 -- 10.20.193.28:0/3224024838 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b4ba37bd0 con 0x555b4bb89430 2026-02-20T03:27:57.465 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.464+0000 7f5e0effd640 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555b4bb89430 0x555b4bb8b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:57.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.504+0000 7f5e0effd640 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555b4bb89430 0x555b4bb8b8f0 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41dcf9071d53725 server_cookie=bcf9b737e8f36d38 in_seq=0 out_seq=0 2026-02-20T03:27:57.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.504+0000 7f5dd8ff9640 10 client.19014 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:57.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3224024838 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555b4ba37bd0 con 0x555b4bb89430 2026-02-20T03:27:57.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5dd8ff9640 10 client.19014 handle_command_reply: tid=0 2026-02-20T03:27:57.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 client.19014 shutdown 2026-02-20T03:27:57.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 -- 10.20.193.28:0/3224024838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb6a600 msgr2=0x555b4bb84e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:57.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb6a600 0x555b4bb84e90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5e04015040 tx=0x7f5e04012640 comp rx=0 tx=0).stop 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 -- 10.20.193.28:0/3224024838 shutdown_connections 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555b4bb89430 0x555b4bb8b8f0 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb6a600 0x555b4bb84e90 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb655b0 0x555b4bb7df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3224024838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb64c50 0x555b4bb7d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 -- 10.20.193.28:0/3224024838 >> 10.20.193.28:0/3224024838 conn(0x555b4bb5c2d0 msgr2=0x555b4bb6b950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5dd8ff9640 0 client.19014 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 -- 10.20.193.28:0/3224024838 shutdown_connections 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 1 -- 10.20.193.28:0/3224024838 wait complete. 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.517+0000 7f5e18abce00 20 client.19014 trim_cache size 0 max 16384 2026-02-20T03:27:57.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 Processor -- start 2026-02-20T03:27:57.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- start start 2026-02-20T03:27:57.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb63400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 0x555b4bb66e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 0x555b4bb673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5db40125d0 con 0x555b4bb64c50 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5db400fea0 con 0x555b4bb6a600 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5db400dcf0 con 0x555b4bb655b0 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb63400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb63400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47086/0 (socket says 10.20.193.28:47086) 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 -- 10.20.193.28:0/413481982 learned_addr learned my addr 10.20.193.28:0/413481982 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 -- 10.20.193.28:0/413481982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 msgr2=0x555b4bb66e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/413481982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 0x555b4bb66e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 -- 10.20.193.28:0/413481982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 msgr2=0x555b4bb673c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/413481982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 0x555b4bb673c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 -- 10.20.193.28:0/413481982 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4bb76f40 con 0x555b4bb64c50 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/413481982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb63400 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5e040096f0 tx=0x7f5e04027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beffa59a07a6bf45 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5ddaffd640 1 -- 10.20.193.28:0/413481982 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04017070 con 0x555b4bb64c50 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5ddaffd640 1 -- 10.20.193.28:0/413481982 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e04038070 con 0x555b4bb64c50 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5ddaffd640 1 -- 10.20.193.28:0/413481982 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e040128b0 con 0x555b4bb64c50 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- 10.20.193.28:0/413481982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 msgr2=0x555b4bb63400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- 10.20.193.28:0/413481982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb63400 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f5e040096f0 tx=0x7f5e04027000 comp rx=0 tx=0).stop 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- 10.20.193.28:0/413481982 shutdown_connections 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- 10.20.193.28:0/413481982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 0x555b4bb673c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- 10.20.193.28:0/413481982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 0x555b4bb66e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- 10.20.193.28:0/413481982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb63400 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- 10.20.193.28:0/413481982 >> 10.20.193.28:0/413481982 conn(0x555b4bb5c2d0 msgr2=0x555b4bb66770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:57.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- 10.20.193.28:0/413481982 shutdown_connections 2026-02-20T03:27:57.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- 10.20.193.28:0/413481982 wait complete. 2026-02-20T03:27:57.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- start start 2026-02-20T03:27:57.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 Processor -- start 2026-02-20T03:27:57.533 INFO:tasks.workunit.client.0.trial028.stdout: 1 1147711 8.06 MB/sec execute 570 sec latency 1772.406 ms 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb82cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 0x555b4bb83200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 0x555b4bb841e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5db400e360 con 0x555b4bb64c50 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5db400f7d0 con 0x555b4bb6a600 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5db400ea30 con 0x555b4bb655b0 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb82cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb82cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47100/0 (socket says 10.20.193.28:47100) 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 -- 10.20.193.28:0/3644964796 learned_addr learned my addr 10.20.193.28:0/3644964796 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 -- 10.20.193.28:0/3644964796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 msgr2=0x555b4bb83200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 0x555b4bb83200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 -- 10.20.193.28:0/3644964796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 msgr2=0x555b4bb841e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 0x555b4bb841e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 -- 10.20.193.28:0/3644964796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4b815690 con 0x555b4bb64c50 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e0ffff640 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb82cc0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f5e04002a30 tx=0x7f5e040046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4b837a321ed14f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5dd8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3644964796 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04040020 con 0x555b4bb64c50 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3644964796 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x555b4babd4e0 con 0x555b4bb64c50 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3644964796 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04017070 con 0x555b4bb64c50 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5e18abce00 1 -- 10.20.193.28:0/3644964796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4ba7ab70 con 0x555b4bb64c50 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.523+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3644964796 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f5e04045410 con 0x555b4bb64c50 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5dd8ff9640 10 client.19020 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 10 client.19020 _ll_register_callbacks cb 0x7f5e040099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:27:57.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 1 -- 10.20.193.28:0/3644964796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555b4b88e520 con 0x555b4bb64c50 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3644964796 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5e040124d0 con 0x555b4bb64c50 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 10 client.19020 fetch_fsmap learned FSMap version 30 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 1 -- 10.20.193.28:0/3644964796 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x555b4bb77c30 con 0x555b4bb64c50 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3644964796 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f5e04012860 con 0x555b4bb64c50 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 10 client.19020 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 10 client.19020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 20 client.19020 populate_metadata read hostname 'trial028' 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555b4bbf48f0 0x555b4bbf6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 4 client.19020 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:27:57.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.528+0000 7f5e18abce00 1 -- 10.20.193.28:0/3644964796 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555b4bac3290 con 0x555b4bbf48f0 2026-02-20T03:27:57.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.544+0000 7f5e0effd640 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555b4bbf48f0 0x555b4bbf6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:27:57.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:57 trial126 ceph-mon[38476]: pgmap v580: 129 pgs: 129 active+clean; 202 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 MiB/s rd, 2.2 MiB/s wr, 435 op/s 2026-02-20T03:27:57.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.598+0000 7f5e0effd640 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555b4bbf48f0 0x555b4bbf6db0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7767e300ad6c96f server_cookie=dff5004e9bfdfa0d in_seq=0 out_seq=0 2026-02-20T03:27:57.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.598+0000 7f5dd8ff9640 10 client.19020 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:57 trial177 ceph-mon[43181]: pgmap v580: 129 pgs: 129 active+clean; 202 MiB data, 4.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.1 MiB/s rd, 2.2 MiB/s wr, 435 op/s 2026-02-20T03:27:57.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5dd8ff9640 1 -- 10.20.193.28:0/3644964796 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555b4bac3290 con 0x555b4bbf48f0 2026-02-20T03:27:57.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5dd8ff9640 10 client.19020 handle_command_reply: tid=0 2026-02-20T03:27:57.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 client.19020 shutdown 2026-02-20T03:27:57.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 -- 10.20.193.28:0/3644964796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 msgr2=0x555b4bb82cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb82cc0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f5e04002a30 tx=0x7f5e040046d0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 -- 10.20.193.28:0/3644964796 shutdown_connections 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555b4bbf48f0 0x555b4bbf6db0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b4bb6a600 0x555b4bb841e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b4bb655b0 0x555b4bb83200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 --2- 10.20.193.28:0/3644964796 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b4bb64c50 0x555b4bb82cc0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 -- 10.20.193.28:0/3644964796 >> 10.20.193.28:0/3644964796 conn(0x555b4bb5c2d0 msgr2=0x555b4bb66cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5dd8ff9640 0 client.19020 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 -- 10.20.193.28:0/3644964796 shutdown_connections 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 1 -- 10.20.193.28:0/3644964796 wait complete. 2026-02-20T03:27:57.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e18abce00 20 client.19020 trim_cache size 0 max 16384 2026-02-20T03:27:57.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:27:57.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 -- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5de40b0e20 msgr2=0x7f5de40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5de40b0e20 0x7f5de40b32e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc002410 tx=0x7f5dfc00bd60 comp rx=0 tx=0).stop 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 -- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10104940 msgr2=0x7f5e1019cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10104940 0x7f5e1019cb90 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00b750 tx=0x7f5dfc00bc20 comp rx=0 tx=0).stop 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 -- 10.20.193.28:0/2230334531 shutdown_connections 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5de40b0e20 0x7f5de40b32e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e101064f0 0x7f5e101a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e10105b30 0x7f5e1019d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 --2- 10.20.193.28:0/2230334531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e10104940 0x7f5e1019cb90 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 -- 10.20.193.28:0/2230334531 >> 10.20.193.28:0/2230334531 conn(0x7f5e101000c0 msgr2=0x7f5e10108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 -- 10.20.193.28:0/2230334531 shutdown_connections 2026-02-20T03:27:57.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:27:57.731+0000 7f5e149cf640 1 -- 10.20.193.28:0/2230334531 wait complete. 2026-02-20T03:27:58.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1147711 8.05 MB/sec execute 571 sec latency 1144.855 ms 2026-02-20T03:27:59.293 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:27:59 trial028 ceph-mon[38552]: pgmap v581: 129 pgs: 129 active+clean; 206 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.4 MiB/s wr, 400 op/s 2026-02-20T03:27:59.519 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:27:59 trial177 ceph-mon[43181]: pgmap v581: 129 pgs: 129 active+clean; 206 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.4 MiB/s wr, 400 op/s 2026-02-20T03:27:59.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1147715 8.03 MB/sec execute 572 sec latency 1854.517 ms 2026-02-20T03:27:59.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:27:59 trial126 ceph-mon[38476]: pgmap v581: 129 pgs: 129 active+clean; 206 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.8 MiB/s rd, 2.4 MiB/s wr, 400 op/s 2026-02-20T03:28:00.534 INFO:tasks.workunit.client.0.trial028.stdout: 1 1150478 8.04 MB/sec execute 573 sec latency 498.657 ms 2026-02-20T03:28:01.336 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:01 trial028 ceph-mon[38552]: pgmap v582: 129 pgs: 129 active+clean; 206 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 406 op/s 2026-02-20T03:28:01.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1150480 8.03 MB/sec execute 574 sec latency 980.845 ms 2026-02-20T03:28:01.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:01 trial126 ceph-mon[38476]: pgmap v582: 129 pgs: 129 active+clean; 206 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 406 op/s 2026-02-20T03:28:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:01 trial177 ceph-mon[43181]: pgmap v582: 129 pgs: 129 active+clean; 206 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 406 op/s 2026-02-20T03:28:02.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1150480 8.01 MB/sec execute 575 sec latency 1980.887 ms 2026-02-20T03:28:03.476 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:03 trial028 ceph-mon[38552]: pgmap v583: 129 pgs: 129 active+clean; 207 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 292 op/s 2026-02-20T03:28:03.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1150480 8.00 MB/sec execute 576 sec latency 2980.938 ms 2026-02-20T03:28:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:03 trial126 ceph-mon[38476]: pgmap v583: 129 pgs: 129 active+clean; 207 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 292 op/s 2026-02-20T03:28:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:03 trial177 ceph-mon[43181]: pgmap v583: 129 pgs: 129 active+clean; 207 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 292 op/s 2026-02-20T03:28:04.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1151771 8.00 MB/sec execute 577 sec latency 3370.297 ms 2026-02-20T03:28:04.708 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:28:04.979 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:05.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.163+0000 7f928f249640 1 -- 10.20.193.28:0/2212016183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288104980 msgr2=0x7f9288104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.163+0000 7f928f249640 1 --2- 10.20.193.28:0/2212016183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288104980 0x7f9288104de0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f927c009a60 tx=0x7f927c02f250 comp rx=0 tx=0).stop 2026-02-20T03:28:05.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.164+0000 7f928f249640 1 -- 10.20.193.28:0/2212016183 shutdown_connections 2026-02-20T03:28:05.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.164+0000 7f928f249640 1 --2- 10.20.193.28:0/2212016183 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288105320 0x7f9288111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.164+0000 7f928f249640 1 --2- 10.20.193.28:0/2212016183 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9288104980 0x7f9288104de0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.164+0000 7f928f249640 1 --2- 10.20.193.28:0/2212016183 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f928810a980 0x7f928810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.164+0000 7f928f249640 1 -- 10.20.193.28:0/2212016183 >> 10.20.193.28:0/2212016183 conn(0x7f9288100680 msgr2=0x7f9288102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.164+0000 7f928f249640 1 -- 10.20.193.28:0/2212016183 shutdown_connections 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.164+0000 7f928f249640 1 -- 10.20.193.28:0/2212016183 wait complete. 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.164+0000 7f928f249640 1 Processor -- start 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928f249640 1 -- start start 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928f249640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288104980 0x7f9288077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928f249640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9288105320 0x7f9288077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928f249640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f928810a980 0x7f9288078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928f249640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9288114bf0 con 0x7f928810a980 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928f249640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9288114a70 con 0x7f9288104980 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928f249640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9288114d70 con 0x7f9288105320 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928da46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9288105320 0x7f9288077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928e247640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288104980 0x7f9288077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928da46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9288105320 0x7f9288077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:53984/0 (socket says 10.20.193.28:53984) 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928da46640 1 -- 10.20.193.28:0/263519118 learned_addr learned my addr 10.20.193.28:0/263519118 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928e247640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288104980 0x7f9288077600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:34638/0 (socket says 10.20.193.28:34638) 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928ea48640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f928810a980 0x7f9288078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928da46640 1 -- 10.20.193.28:0/263519118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288104980 msgr2=0x7f9288077600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928da46640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288104980 0x7f9288077600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928da46640 1 -- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f928810a980 msgr2=0x7f9288078080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928da46640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f928810a980 0x7f9288078080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928da46640 1 -- 10.20.193.28:0/263519118 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928819ceb0 con 0x7f9288105320 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.165+0000 7f928ea48640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f928810a980 0x7f9288078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.166+0000 7f928da46640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9288105320 0x7f9288077b40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f927c02fcd0 tx=0x7f927c02fd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.166+0000 7f926f7fe640 1 -- 10.20.193.28:0/263519118 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c0384e0 con 0x7f9288105320 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.166+0000 7f928f249640 1 -- 10.20.193.28:0/263519118 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928819d140 con 0x7f9288105320 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.166+0000 7f928f249640 1 -- 10.20.193.28:0/263519118 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f928819d670 con 0x7f9288105320 2026-02-20T03:28:05.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.166+0000 7f926f7fe640 1 -- 10.20.193.28:0/263519118 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f927c038770 con 0x7f9288105320 2026-02-20T03:28:05.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.166+0000 7f926f7fe640 1 -- 10.20.193.28:0/263519118 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c041740 con 0x7f9288105320 2026-02-20T03:28:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.169+0000 7f92929d7e00 1 Processor -- start 2026-02-20T03:28:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.169+0000 7f92929d7e00 1 -- start start 2026-02-20T03:28:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.169+0000 7f926f7fe640 1 -- 10.20.193.28:0/263519118 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f927c038920 con 0x7f9288105320 2026-02-20T03:28:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.169+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed6103e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.169+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60a630 0x55d7ed60aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.169+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed616e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.169+0000 7f92929d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed58ae50 con 0x55d7ed60afb0 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.169+0000 7f92929d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed55d9c0 con 0x55d7ed610000 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.169+0000 7f92929d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed50b240 con 0x55d7ed60a630 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928e247640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60a630 0x55d7ed60aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928ea48640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed6103e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928ea48640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed6103e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:34654/0 (socket says 10.20.193.28:34654) 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928ea48640 1 -- 10.20.193.28:0/3100910538 learned_addr learned my addr 10.20.193.28:0/3100910538 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928da46640 1 --2- 10.20.193.28:0/3100910538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed616e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928ea48640 1 -- 10.20.193.28:0/3100910538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60a630 msgr2=0x55d7ed60aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928ea48640 1 --2- 10.20.193.28:0/3100910538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60a630 0x55d7ed60aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928ea48640 1 -- 10.20.193.28:0/3100910538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 msgr2=0x55d7ed616e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928ea48640 1 --2- 10.20.193.28:0/3100910538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed616e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928ea48640 1 -- 10.20.193.28:0/3100910538 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ed51e420 con 0x55d7ed610000 2026-02-20T03:28:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.170+0000 7f928da46640 1 --2- 10.20.193.28:0/3100910538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed616e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f928ea48640 1 --2- 10.20.193.28:0/3100910538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed6103e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9284002e60 tx=0x7f9284009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=312d8968047aa5ce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f926ca08640 1 -- 10.20.193.28:0/3100910538 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928401b070 con 0x55d7ed610000 2026-02-20T03:28:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f926ca08640 1 -- 10.20.193.28:0/3100910538 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f92840079a0 con 0x55d7ed610000 2026-02-20T03:28:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f926f7fe640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f92929d7e00 1 -- 10.20.193.28:0/3100910538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 msgr2=0x55d7ed6103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f92929d7e00 1 --2- 10.20.193.28:0/3100910538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed6103e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9284002e60 tx=0x7f9284009920 comp rx=0 tx=0).stop 2026-02-20T03:28:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f926f7fe640 1 -- 10.20.193.28:0/263519118 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f927c104f20 con 0x7f9288105320 2026-02-20T03:28:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f92929d7e00 1 -- 10.20.193.28:0/3100910538 shutdown_connections 2026-02-20T03:28:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f92929d7e00 1 --2- 10.20.193.28:0/3100910538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed616e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f92929d7e00 1 --2- 10.20.193.28:0/3100910538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60a630 0x55d7ed60aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f92929d7e00 1 --2- 10.20.193.28:0/3100910538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed6103e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f92929d7e00 1 -- 10.20.193.28:0/3100910538 >> 10.20.193.28:0/3100910538 conn(0x55d7ed5cd290 msgr2=0x55d7ed608d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f928e247640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.171+0000 7f92929d7e00 1 -- 10.20.193.28:0/3100910538 shutdown_connections 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.172+0000 7f92929d7e00 1 -- 10.20.193.28:0/3100910538 wait complete. 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.173+0000 7f928e247640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f92780046f0 tx=0x7f9278009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.173+0000 7f92929d7e00 1 -- start start 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.173+0000 7f92929d7e00 1 Processor -- start 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.173+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed624bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed625110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed610000 0x55d7ed623310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f92929d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed5598f0 con 0x55d7ed610000 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f92929d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed34bf50 con 0x55d7ed60a630 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f92929d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d7ed623a90 con 0x55d7ed60afb0 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928da46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed625110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928e247640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed624bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928e247640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed624bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:34666/0 (socket says 10.20.193.28:34666) 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928e247640 1 -- 10.20.193.28:0/1877387273 learned_addr learned my addr 10.20.193.28:0/1877387273 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928da46640 1 -- 10.20.193.28:0/1877387273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 msgr2=0x55d7ed624bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928da46640 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed624bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928da46640 1 -- 10.20.193.28:0/1877387273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed610000 msgr2=0x55d7ed623310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928da46640 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed610000 0x55d7ed623310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928da46640 1 -- 10.20.193.28:0/1877387273 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ed61cad0 con 0x55d7ed60afb0 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f928da46640 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed625110 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f927c102640 tx=0x7f927c02f250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de04b6e516f7c311 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.174+0000 7f923bfff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f923bfff640 1 -- 10.20.193.28:0/1877387273 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c0c88d0 con 0x55d7ed60afb0 2026-02-20T03:28:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f923bfff640 1 -- 10.20.193.28:0/1877387273 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f927c033020 con 0x55d7ed60afb0 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f923bfff640 1 -- 10.20.193.28:0/1877387273 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c0b5070 con 0x55d7ed60afb0 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f92929d7e00 1 -- 10.20.193.28:0/1877387273 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ed32eb40 con 0x55d7ed60afb0 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f923bfff640 1 -- 10.20.193.28:0/1877387273 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f927c0d3210 con 0x55d7ed60afb0 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f923bfff640 10 client.27922 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f92929d7e00 10 client.27922 _ll_register_callbacks cb 0x55d7ed596f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f92929d7e00 1 -- 10.20.193.28:0/1877387273 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d7ed56b1a0 con 0x55d7ed60afb0 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f923bfff640 1 -- 10.20.193.28:0/1877387273 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f927c0cc180 con 0x55d7ed60afb0 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f92929d7e00 10 client.27922 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.175+0000 7f92929d7e00 1 -- 10.20.193.28:0/1877387273 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d7ed518230 con 0x55d7ed60afb0 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.176+0000 7f923bfff640 1 -- 10.20.193.28:0/1877387273 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f927c0f31d0 con 0x55d7ed60afb0 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.176+0000 7f92929d7e00 10 client.27922 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.176+0000 7f92929d7e00 10 client.27922 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.176+0000 7f92929d7e00 20 client.27922 populate_metadata read hostname 'trial028' 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.176+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7ed633070 0x55d7ed635530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.176+0000 7f92929d7e00 4 client.27922 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.176+0000 7f92929d7e00 1 -- 10.20.193.28:0/1877387273 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7ed5655b0 con 0x55d7ed633070 2026-02-20T03:28:05.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.176+0000 7f928e247640 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7ed633070 0x55d7ed635530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.177+0000 7f928e247640 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7ed633070 0x55d7ed635530 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d2ac8931309656 server_cookie=b50b5bae25355131 in_seq=0 out_seq=0 2026-02-20T03:28:05.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.177+0000 7f923bfff640 10 client.27922 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.177+0000 7f923bfff640 1 -- 10.20.193.28:0/1877387273 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d7ed5655b0 con 0x55d7ed633070 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.177+0000 7f923bfff640 10 client.27922 handle_command_reply: tid=0 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.177+0000 7f92929d7e00 1 client.27922 shutdown 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 -- 10.20.193.28:0/1877387273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 msgr2=0x55d7ed625110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed625110 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f927c102640 tx=0x7f927c02f250 comp rx=0 tx=0).stop 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 -- 10.20.193.28:0/1877387273 shutdown_connections 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7ed633070 0x55d7ed635530 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed610000 0x55d7ed623310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed625110 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1877387273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed624bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 -- 10.20.193.28:0/1877387273 >> 10.20.193.28:0/1877387273 conn(0x55d7ed5cd290 msgr2=0x55d7ed609440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:05.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f923bfff640 0 client.27922 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:05.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 -- 10.20.193.28:0/1877387273 shutdown_connections 2026-02-20T03:28:05.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 1 -- 10.20.193.28:0/1877387273 wait complete. 2026-02-20T03:28:05.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.178+0000 7f92929d7e00 20 client.27922 trim_cache size 0 max 16384 2026-02-20T03:28:05.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f92929d7e00 1 Processor -- start 2026-02-20T03:28:05.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f92929d7e00 1 -- start start 2026-02-20T03:28:05.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60a630 0x55d7ed62fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed635080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed609520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f92929d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9230012650 con 0x55d7ed60a630 2026-02-20T03:28:05.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f92929d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f923000ff20 con 0x55d7ed610000 2026-02-20T03:28:05.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f92929d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f923000dd70 con 0x55d7ed60afb0 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f928da46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed635080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f928ea48640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed609520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f928da46640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed635080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54004/0 (socket says 10.20.193.28:54004) 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.189+0000 7f928da46640 1 -- 10.20.193.28:0/1597656077 learned_addr learned my addr 10.20.193.28:0/1597656077 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f928da46640 1 -- 10.20.193.28:0/1597656077 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 msgr2=0x55d7ed609520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f928da46640 1 --2- 10.20.193.28:0/1597656077 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed609520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f928da46640 1 -- 10.20.193.28:0/1597656077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60a630 msgr2=0x55d7ed62fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f928da46640 1 --2- 10.20.193.28:0/1597656077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60a630 0x55d7ed62fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f928da46640 1 -- 10.20.193.28:0/1597656077 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ed623680 con 0x55d7ed60afb0 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f928da46640 1 --2- 10.20.193.28:0/1597656077 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed635080 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f927c0ccbf0 tx=0x7f927c0ef070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=978e83e63cb37b22 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f92564e6640 1 -- 10.20.193.28:0/1597656077 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c0cc360 con 0x55d7ed60afb0 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f92564e6640 1 -- 10.20.193.28:0/1597656077 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f927c033070 con 0x55d7ed60afb0 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f92564e6640 1 -- 10.20.193.28:0/1597656077 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c0cca30 con 0x55d7ed60afb0 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f92929d7e00 1 -- 10.20.193.28:0/1597656077 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 msgr2=0x55d7ed635080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.190+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1597656077 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed635080 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f927c0ccbf0 tx=0x7f927c0ef070 comp rx=0 tx=0).stop 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.191+0000 7f92929d7e00 1 -- 10.20.193.28:0/1597656077 shutdown_connections 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.191+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1597656077 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed610000 0x55d7ed609520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.191+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1597656077 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed60afb0 0x55d7ed635080 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.191+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1597656077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60a630 0x55d7ed62fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.191+0000 7f92929d7e00 1 -- 10.20.193.28:0/1597656077 >> 10.20.193.28:0/1597656077 conn(0x55d7ed5cd290 msgr2=0x55d7ed6222c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.191+0000 7f92929d7e00 1 -- 10.20.193.28:0/1597656077 shutdown_connections 2026-02-20T03:28:05.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.191+0000 7f92929d7e00 1 -- 10.20.193.28:0/1597656077 wait complete. 2026-02-20T03:28:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.191+0000 7f92929d7e00 1 -- start start 2026-02-20T03:28:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.191+0000 7f92929d7e00 1 Processor -- start 2026-02-20T03:28:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed62fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed698340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f92929d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed610000 0x55d7ed698950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f92929d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f923000e3e0 con 0x55d7ed60afb0 2026-02-20T03:28:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f92929d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f923000f850 con 0x55d7ed60a630 2026-02-20T03:28:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f92929d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f923000eab0 con 0x55d7ed610000 2026-02-20T03:28:05.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928ea48640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed610000 0x55d7ed698950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928e247640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed62fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928ea48640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed610000 0x55d7ed698950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54018/0 (socket says 10.20.193.28:54018) 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928ea48640 1 -- 10.20.193.28:0/1136449553 learned_addr learned my addr 10.20.193.28:0/1136449553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928da46640 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed698340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928ea48640 1 -- 10.20.193.28:0/1136449553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 msgr2=0x55d7ed62fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928ea48640 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed62fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928ea48640 1 -- 10.20.193.28:0/1136449553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 msgr2=0x55d7ed698340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928ea48640 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed698340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.192+0000 7f928ea48640 1 -- 10.20.193.28:0/1136449553 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7ed518230 con 0x55d7ed610000 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f928da46640 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed698340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f928e247640 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed62fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f928ea48640 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed610000 0x55d7ed698950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9284002e30 tx=0x7f9284005b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37820b65176cb66e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f923bfff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f923bfff640 1 -- 10.20.193.28:0/1136449553 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928401b070 con 0x55d7ed610000 2026-02-20T03:28:05.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f923bfff640 1 -- 10.20.193.28:0/1136449553 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f928401c040 con 0x55d7ed610000 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f92929d7e00 1 -- 10.20.193.28:0/1136449553 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7ed32eb40 con 0x55d7ed610000 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f923bfff640 1 -- 10.20.193.28:0/1136449553 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284021650 con 0x55d7ed610000 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f923bfff640 1 -- 10.20.193.28:0/1136449553 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f9284015440 con 0x55d7ed610000 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f92929d7e00 10 client.27928 _ll_register_callbacks cb 0x7f927c005c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f92929d7e00 1 -- 10.20.193.28:0/1136449553 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d7ed50fb00 con 0x55d7ed610000 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f923bfff640 1 -- 10.20.193.28:0/1136449553 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9284015640 con 0x55d7ed610000 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f92929d7e00 10 client.27928 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.193+0000 7f92929d7e00 1 -- 10.20.193.28:0/1136449553 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d7ed61c900 con 0x55d7ed610000 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f923bfff640 1 -- 10.20.193.28:0/1136449553 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9284015860 con 0x55d7ed610000 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f92929d7e00 10 client.27928 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f92929d7e00 10 client.27928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f92929d7e00 20 client.27928 populate_metadata read hostname 'trial028' 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7ed6b0340 0x55d7ed6b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f92929d7e00 4 client.27928 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f92929d7e00 1 -- 10.20.193.28:0/1136449553 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f92840079a0 con 0x55d7ed6b0340 2026-02-20T03:28:05.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f928e247640 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7ed6b0340 0x55d7ed6b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f928e247640 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7ed6b0340 0x55d7ed6b2800 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf7ac1ef2af6224 server_cookie=ad46a15abafeb296 in_seq=0 out_seq=0 2026-02-20T03:28:05.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.194+0000 7f923bfff640 10 client.27928 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:05.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.195+0000 7f923bfff640 1 -- 10.20.193.28:0/1136449553 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f92840079a0 con 0x55d7ed6b0340 2026-02-20T03:28:05.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.195+0000 7f923bfff640 10 client.27928 handle_command_reply: tid=0 2026-02-20T03:28:05.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.195+0000 7f92929d7e00 1 client.27928 shutdown 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 -- 10.20.193.28:0/1136449553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed610000 msgr2=0x55d7ed698950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed610000 0x55d7ed698950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9284002e30 tx=0x7f9284005b30 comp rx=0 tx=0).stop 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 -- 10.20.193.28:0/1136449553 shutdown_connections 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7ed6b0340 0x55d7ed6b2800 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d7ed610000 0x55d7ed698950 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d7ed60afb0 0x55d7ed698340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 --2- 10.20.193.28:0/1136449553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d7ed60a630 0x55d7ed62fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 -- 10.20.193.28:0/1136449553 >> 10.20.193.28:0/1136449553 conn(0x55d7ed5cd290 msgr2=0x55d7ed60baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f923bfff640 0 client.27928 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 -- 10.20.193.28:0/1136449553 shutdown_connections 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 1 -- 10.20.193.28:0/1136449553 wait complete. 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.196+0000 7f92929d7e00 20 client.27928 trim_cache size 0 max 16384 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 -- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 msgr2=0x7f92640b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f92780046f0 tx=0x7f9278009290 comp rx=0 tx=0).stop 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 -- 10.20.193.28:0/263519118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9288105320 msgr2=0x7f9288077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9288105320 0x7f9288077b40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f927c02fcd0 tx=0x7f927c02fd00 comp rx=0 tx=0).stop 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 -- 10.20.193.28:0/263519118 shutdown_connections 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f92640b0e20 0x7f92640b32e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f928810a980 0x7f9288078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9288105320 0x7f9288077b40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 --2- 10.20.193.28:0/263519118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9288104980 0x7f9288077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 -- 10.20.193.28:0/263519118 >> 10.20.193.28:0/263519118 conn(0x7f9288100680 msgr2=0x7f9288101050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:05.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 -- 10.20.193.28:0/263519118 shutdown_connections 2026-02-20T03:28:05.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.197+0000 7f928f249640 1 -- 10.20.193.28:0/263519118 wait complete. 2026-02-20T03:28:05.300 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:28:05.300 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:28:05.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1155124 8.02 MB/sec execute 578 sec latency 14.971 ms 2026-02-20T03:28:05.567 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:05.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:05 trial126 ceph-mon[38476]: pgmap v584: 129 pgs: 129 active+clean; 204 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 318 op/s 2026-02-20T03:28:05.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:05 trial028 ceph-mon[38552]: pgmap v584: 129 pgs: 129 active+clean; 204 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 318 op/s 2026-02-20T03:28:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:05 trial177 ceph-mon[43181]: pgmap v584: 129 pgs: 129 active+clean; 204 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 318 op/s 2026-02-20T03:28:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.771+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/3159876704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4104980 msgr2=0x7fa2e4104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.771+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/3159876704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4104980 0x7fa2e4104de0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009a60 tx=0x7fa2d802f270 comp rx=0 tx=0).stop 2026-02-20T03:28:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.771+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/3159876704 shutdown_connections 2026-02-20T03:28:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.771+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/3159876704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2e4105320 0x7fa2e4111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.771+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/3159876704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4104980 0x7fa2e4104de0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.771+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/3159876704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2e410a980 0x7fa2e410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.771+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/3159876704 >> 10.20.193.28:0/3159876704 conn(0x7fa2e4100680 msgr2=0x7fa2e4102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.771+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/3159876704 shutdown_connections 2026-02-20T03:28:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.771+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/3159876704 wait complete. 2026-02-20T03:28:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2ea3aa640 1 Processor -- start 2026-02-20T03:28:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2ea3aa640 1 -- start start 2026-02-20T03:28:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2ea3aa640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2e4104980 0x7fa2e4077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2ea3aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4105320 0x7fa2e4077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2ea3aa640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2e410a980 0x7fa2e4078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2ea3aa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4114bf0 con 0x7fa2e4105320 2026-02-20T03:28:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2ea3aa640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4114a70 con 0x7fa2e410a980 2026-02-20T03:28:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2ea3aa640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4114d70 con 0x7fa2e4104980 2026-02-20T03:28:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2e8ba7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4105320 0x7fa2e4077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2e8ba7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4105320 0x7fa2e4077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47162/0 (socket says 10.20.193.28:47162) 2026-02-20T03:28:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.772+0000 7fa2e8ba7640 1 -- 10.20.193.28:0/1049835410 learned_addr learned my addr 10.20.193.28:0/1049835410 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:05.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2e8ba7640 1 -- 10.20.193.28:0/1049835410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2e4104980 msgr2=0x7fa2e4077600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:05.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2e8ba7640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2e4104980 0x7fa2e4077600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2e8ba7640 1 -- 10.20.193.28:0/1049835410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2e410a980 msgr2=0x7fa2e4078080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:05.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2e8ba7640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2e410a980 0x7fa2e4078080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2e8ba7640 1 -- 10.20.193.28:0/1049835410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e419ceb0 con 0x7fa2e4105320 2026-02-20T03:28:05.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2e8ba7640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4105320 0x7fa2e4077b40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa2d802fcf0 tx=0x7fa2d802fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:05.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2d27fc640 1 -- 10.20.193.28:0/1049835410 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8004240 con 0x7fa2e4105320 2026-02-20T03:28:05.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2d27fc640 1 -- 10.20.193.28:0/1049835410 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa2d80043e0 con 0x7fa2e4105320 2026-02-20T03:28:05.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2d27fc640 1 -- 10.20.193.28:0/1049835410 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8042750 con 0x7fa2e4105320 2026-02-20T03:28:05.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e419d140 con 0x7fa2e4105320 2026-02-20T03:28:05.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.773+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e419d5d0 con 0x7fa2e4105320 2026-02-20T03:28:05.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.774+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e41060c0 con 0x7fa2e4105320 2026-02-20T03:28:05.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.776+0000 7fa2d27fc640 1 -- 10.20.193.28:0/1049835410 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa2d804a070 con 0x7fa2e4105320 2026-02-20T03:28:05.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.777+0000 7fa2d27fc640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2c00b0e20 0x7fa2c00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:05.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.777+0000 7fa2d27fc640 1 -- 10.20.193.28:0/1049835410 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fa2d8105460 con 0x7fa2e4105320 2026-02-20T03:28:05.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.778+0000 7fa2d27fc640 1 -- 10.20.193.28:0/1049835410 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa2d8047060 con 0x7fa2e4105320 2026-02-20T03:28:05.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.785+0000 7fa2e93a8640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2c00b0e20 0x7fa2c00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:05.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.786+0000 7fa2e93a8640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2c00b0e20 0x7fa2c00b32e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4005fd0 tx=0x7fa2d400b3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:05.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.886+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2e410c9e0 con 0x7fa2e4105320 2026-02-20T03:28:05.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.886+0000 7fa2d27fc640 1 -- 10.20.193.28:0/1049835410 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11921 (secure 0 0 0) 0x7fa2d8040320 con 0x7fa2e4105320 2026-02-20T03:28:05.902 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:28:05.902 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":30,"btime":"2026-02-20T03:25:19:519285+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:25:19.519275+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:28:05.903 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 30 2026-02-20T03:28:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2c00b0e20 msgr2=0x7fa2c00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2c00b0e20 0x7fa2c00b32e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4005fd0 tx=0x7fa2d400b3f0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4105320 msgr2=0x7fa2e4077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4105320 0x7fa2e4077b40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fa2d802fcf0 tx=0x7fa2d802fd20 comp rx=0 tx=0).stop 2026-02-20T03:28:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 shutdown_connections 2026-02-20T03:28:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2c00b0e20 0x7fa2c00b32e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2e410a980 0x7fa2e4078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2e4105320 0x7fa2e4077b40 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 --2- 10.20.193.28:0/1049835410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2e4104980 0x7fa2e4077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 >> 10.20.193.28:0/1049835410 conn(0x7fa2e4100680 msgr2=0x7fa2e4100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 shutdown_connections 2026-02-20T03:28:05.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:05.888+0000 7fa2ea3aa640 1 -- 10.20.193.28:0/1049835410 wait complete. 2026-02-20T03:28:06.076 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:28:06.388 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:06.427 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1049835410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:28:06.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1155563 8.01 MB/sec execute 579 sec latency 702.923 ms 2026-02-20T03:28:06.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:06 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1049835410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:28:06.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- 10.20.193.28:0/594327246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594105320 msgr2=0x7f6594111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:06.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 --2- 10.20.193.28:0/594327246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594105320 0x7f6594111850 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f659000b0d0 tx=0x7f659002f490 comp rx=0 tx=0).stop 2026-02-20T03:28:06.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- 10.20.193.28:0/594327246 shutdown_connections 2026-02-20T03:28:06.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 --2- 10.20.193.28:0/594327246 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594105320 0x7f6594111850 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 --2- 10.20.193.28:0/594327246 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6594104980 0x7f6594104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 --2- 10.20.193.28:0/594327246 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f659410a980 0x7f659410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- 10.20.193.28:0/594327246 >> 10.20.193.28:0/594327246 conn(0x7f6594100680 msgr2=0x7f6594102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:06.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- 10.20.193.28:0/594327246 shutdown_connections 2026-02-20T03:28:06.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- 10.20.193.28:0/594327246 wait complete. 2026-02-20T03:28:06.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 Processor -- start 2026-02-20T03:28:06.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- start start 2026-02-20T03:28:06.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594104980 0x7f659419d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6594105320 0x7f659419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f659410a980 0x7f65941a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6594114cd0 con 0x7f6594104980 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6594114b50 con 0x7f6594105320 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6594114e50 con 0x7f659410a980 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659a2e8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594104980 0x7f659419d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659a2e8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594104980 0x7f659419d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59986/0 (socket says 10.20.193.28:59986) 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659a2e8640 1 -- 10.20.193.28:0/3488892706 learned_addr learned my addr 10.20.193.28:0/3488892706 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659a2e8640 1 -- 10.20.193.28:0/3488892706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f659410a980 msgr2=0x7f65941a1a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659a2e8640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f659410a980 0x7f65941a1a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659a2e8640 1 -- 10.20.193.28:0/3488892706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6594105320 msgr2=0x7f659419d6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:06.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659a2e8640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6594105320 0x7f659419d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659a2e8640 1 -- 10.20.193.28:0/3488892706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65941a2200 con 0x7f6594104980 2026-02-20T03:28:06.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659a2e8640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594104980 0x7f659419d1b0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f658400b570 tx=0x7f658400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:06.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f657b7fe640 1 -- 10.20.193.28:0/3488892706 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584013020 con 0x7f6594104980 2026-02-20T03:28:06.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f657b7fe640 1 -- 10.20.193.28:0/3488892706 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6584004480 con 0x7f6594104980 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f657b7fe640 1 -- 10.20.193.28:0/3488892706 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658400fb50 con 0x7f6594104980 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- 10.20.193.28:0/3488892706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65941a24f0 con 0x7f6594104980 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.629+0000 7f659b2ea640 1 -- 10.20.193.28:0/3488892706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65941a9d30 con 0x7f6594104980 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f657b7fe640 1 -- 10.20.193.28:0/3488892706 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6584002780 con 0x7f6594104980 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 Processor -- start 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- start start 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x55619212d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 0x556192127a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556192127f60 0x556192133de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561920a7e00 con 0x55619212cfb0 2026-02-20T03:28:06.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55619207a970 con 0x556192127f60 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5561920281f0 con 0x5561921275e0 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659aae9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x55619212d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659aae9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x55619212d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59994/0 (socket says 10.20.193.28:59994) 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659aae9640 1 -- 10.20.193.28:0/2667313573 learned_addr learned my addr 10.20.193.28:0/2667313573 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659aae9640 1 -- 10.20.193.28:0/2667313573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 msgr2=0x556192127a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659aae9640 1 --2- 10.20.193.28:0/2667313573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 0x556192127a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659aae9640 1 -- 10.20.193.28:0/2667313573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556192127f60 msgr2=0x556192133de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659aae9640 1 --2- 10.20.193.28:0/2667313573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556192127f60 0x556192133de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659aae9640 1 -- 10.20.193.28:0/2667313573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619203b3d0 con 0x55619212cfb0 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f657b7fe640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65700b0e20 0x7f65700b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f657b7fe640 1 -- 10.20.193.28:0/3488892706 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f65840e0550 con 0x7f6594104980 2026-02-20T03:28:06.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659aae9640 1 --2- 10.20.193.28:0/2667313573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x55619212d390 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f6590009d70 tx=0x7f6590009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b514daf2072ede server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:06.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659a2e8640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65700b0e20 0x7f65700b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:06.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f6578a08640 1 -- 10.20.193.28:0/2667313573 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590004b40 con 0x55619212cfb0 2026-02-20T03:28:06.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f6578a08640 1 -- 10.20.193.28:0/2667313573 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6590033030 con 0x55619212cfb0 2026-02-20T03:28:06.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f6578a08640 1 -- 10.20.193.28:0/2667313573 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590002a60 con 0x55619212cfb0 2026-02-20T03:28:06.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- 10.20.193.28:0/2667313573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 msgr2=0x55619212d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:06.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 --2- 10.20.193.28:0/2667313573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x55619212d390 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f6590009d70 tx=0x7f6590009da0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- 10.20.193.28:0/2667313573 shutdown_connections 2026-02-20T03:28:06.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 --2- 10.20.193.28:0/2667313573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556192127f60 0x556192133de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 --2- 10.20.193.28:0/2667313573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 0x556192127a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 --2- 10.20.193.28:0/2667313573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x55619212d390 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- 10.20.193.28:0/2667313573 >> 10.20.193.28:0/2667313573 conn(0x5561920ea240 msgr2=0x556192125ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- 10.20.193.28:0/2667313573 shutdown_connections 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- 10.20.193.28:0/2667313573 wait complete. 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659a2e8640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65700b0e20 0x7f65700b32e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f65840a81c0 tx=0x7f6584004850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 -- start start 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 Processor -- start 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.635+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 0x556192141ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.639+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556192127f60 0x556192142430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619212cfb0 0x5561921406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561920768a0 con 0x556192127f60 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556191e68f50 con 0x55619212cfb0 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556192140ce0 con 0x5561921275e0 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6599ae7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556192127f60 0x556192142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6599ae7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556192127f60 0x556192142430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60008/0 (socket says 10.20.193.28:60008) 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6599ae7640 1 -- 10.20.193.28:0/880880047 learned_addr learned my addr 10.20.193.28:0/880880047 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6599ae7640 1 -- 10.20.193.28:0/880880047 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 msgr2=0x556192141ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6599ae7640 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 0x556192141ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6599ae7640 1 -- 10.20.193.28:0/880880047 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619212cfb0 msgr2=0x5561921406a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6599ae7640 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619212cfb0 0x5561921406a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6599ae7640 1 -- 10.20.193.28:0/880880047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556192139ad0 con 0x556192127f60 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6599ae7640 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556192127f60 0x556192142430 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f658800b3e0 tx=0x7f658800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965e5f7ac225f057 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:06.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6543fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:06.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6543fff640 1 -- 10.20.193.28:0/880880047 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588016070 con 0x556192127f60 2026-02-20T03:28:06.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6543fff640 1 -- 10.20.193.28:0/880880047 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6588002780 con 0x556192127f60 2026-02-20T03:28:06.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6543fff640 1 -- 10.20.193.28:0/880880047 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588011860 con 0x556192127f60 2026-02-20T03:28:06.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 1 -- 10.20.193.28:0/880880047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556191e4bb40 con 0x556192127f60 2026-02-20T03:28:06.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6543fff640 1 -- 10.20.193.28:0/880880047 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f658801a3b0 con 0x556192127f60 2026-02-20T03:28:06.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 10 client.19050 _ll_register_callbacks cb 0x5561920b3eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:06.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 1 -- 10.20.193.28:0/880880047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556192088150 con 0x556192127f60 2026-02-20T03:28:06.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6543fff640 1 -- 10.20.193.28:0/880880047 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6588002ca0 con 0x556192127f60 2026-02-20T03:28:06.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 10 client.19050 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:06.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 1 -- 10.20.193.28:0/880880047 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5561920351e0 con 0x556192127f60 2026-02-20T03:28:06.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f6543fff640 1 -- 10.20.193.28:0/880880047 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f6588002930 con 0x556192127f60 2026-02-20T03:28:06.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 10 client.19050 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:06.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 10 client.19050 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:28:06.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 20 client.19050 populate_metadata read hostname 'trial028' 2026-02-20T03:28:06.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556192150770 0x556192152c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 4 client.19050 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:06.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.640+0000 7f659ea78e00 1 -- 10.20.193.28:0/880880047 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556192082560 con 0x556192150770 2026-02-20T03:28:06.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.666+0000 7f659aae9640 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556192150770 0x556192152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:06.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:06 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1049835410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:28:06.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.733+0000 7f659aae9640 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556192150770 0x556192152c30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=446890eb486371b2 server_cookie=e81431f06b684136 in_seq=0 out_seq=0 2026-02-20T03:28:06.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.733+0000 7f6543fff640 10 client.19050 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:28:06.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f6543fff640 1 -- 10.20.193.28:0/880880047 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556192082560 con 0x556192150770 2026-02-20T03:28:06.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f6543fff640 10 client.19050 handle_command_reply: tid=0 2026-02-20T03:28:06.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 client.19050 shutdown 2026-02-20T03:28:06.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 -- 10.20.193.28:0/880880047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556192127f60 msgr2=0x556192142430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:06.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556192127f60 0x556192142430 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f658800b3e0 tx=0x7f658800b8b0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 -- 10.20.193.28:0/880880047 shutdown_connections 2026-02-20T03:28:06.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619212cfb0 0x5561921406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x556192150770 0x556192152c30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556192127f60 0x556192142430 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 --2- 10.20.193.28:0/880880047 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 0x556192141ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 -- 10.20.193.28:0/880880047 >> 10.20.193.28:0/880880047 conn(0x5561920ea240 msgr2=0x5561921263f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:06.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f6543fff640 0 client.19050 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:28:06.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 -- 10.20.193.28:0/880880047 shutdown_connections 2026-02-20T03:28:06.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 1 -- 10.20.193.28:0/880880047 wait complete. 2026-02-20T03:28:06.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.760+0000 7f659ea78e00 20 client.19050 trim_cache size 0 max 16384 2026-02-20T03:28:06.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 Processor -- start 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- start start 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561921275e0 0x556192158550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556192127f60 0x556192158a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x556192147df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0126f0 con 0x55619212cfb0 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f653c00ffc0 con 0x5561921275e0 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f653c00de10 con 0x556192127f60 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x556192147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x556192147df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60014/0 (socket says 10.20.193.28:60014) 2026-02-20T03:28:06.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 -- 10.20.193.28:0/2289555391 learned_addr learned my addr 10.20.193.28:0/2289555391 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 -- 10.20.193.28:0/2289555391 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556192127f60 msgr2=0x556192158a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 --2- 10.20.193.28:0/2289555391 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556192127f60 0x556192158a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 -- 10.20.193.28:0/2289555391 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561921275e0 msgr2=0x556192158550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 --2- 10.20.193.28:0/2289555391 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561921275e0 0x556192158550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 -- 10.20.193.28:0/2289555391 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556192140a90 con 0x55619212cfb0 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 --2- 10.20.193.28:0/2289555391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x556192147df0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f6590004a90 tx=0x7f65900099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da394acc65ee7a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f65624e6640 1 -- 10.20.193.28:0/2289555391 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590007640 con 0x55619212cfb0 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f65624e6640 1 -- 10.20.193.28:0/2289555391 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f65900040e0 con 0x55619212cfb0 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f65624e6640 1 -- 10.20.193.28:0/2289555391 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590002e30 con 0x55619212cfb0 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- 10.20.193.28:0/2289555391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 msgr2=0x556192147df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- 10.20.193.28:0/2289555391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x556192147df0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f6590004a90 tx=0x7f65900099e0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- 10.20.193.28:0/2289555391 shutdown_connections 2026-02-20T03:28:06.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- 10.20.193.28:0/2289555391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x556192147df0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- 10.20.193.28:0/2289555391 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556192127f60 0x556192158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- 10.20.193.28:0/2289555391 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561921275e0 0x556192158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- 10.20.193.28:0/2289555391 >> 10.20.193.28:0/2289555391 conn(0x5561920ea240 msgr2=0x55619213f590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:06.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- 10.20.193.28:0/2289555391 shutdown_connections 2026-02-20T03:28:06.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- 10.20.193.28:0/2289555391 wait complete. 2026-02-20T03:28:06.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- start start 2026-02-20T03:28:06.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 Processor -- start 2026-02-20T03:28:06.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 0x556192148800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556192127f60 0x556192146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x5561921472d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f653c00e480 con 0x55619212cfb0 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f653c00f8f0 con 0x556192127f60 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659ea78e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f653c00eb50 con 0x5561921275e0 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x5561921472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x5561921472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60018/0 (socket says 10.20.193.28:60018) 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.766+0000 7f659aae9640 1 -- 10.20.193.28:0/738470359 learned_addr learned my addr 10.20.193.28:0/738470359 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659aae9640 1 -- 10.20.193.28:0/738470359 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 msgr2=0x556192148800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659aae9640 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 0x556192148800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659aae9640 1 -- 10.20.193.28:0/738470359 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556192127f60 msgr2=0x556192146b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:06.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659aae9640 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556192127f60 0x556192146b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659aae9640 1 -- 10.20.193.28:0/738470359 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556192139900 con 0x55619212cfb0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659aae9640 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x5561921472d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f659000b0d0 tx=0x7f6590009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81909d5c7455e109 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f6543fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f6543fff640 1 -- 10.20.193.28:0/738470359 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590004290 con 0x55619212cfb0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f6543fff640 1 -- 10.20.193.28:0/738470359 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6590033070 con 0x55619212cfb0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f6543fff640 1 -- 10.20.193.28:0/738470359 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590004810 con 0x55619212cfb0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 1 -- 10.20.193.28:0/738470359 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556191d59870 con 0x55619212cfb0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 10 client.19056 _ll_register_callbacks cb 0x7f6588009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 1 -- 10.20.193.28:0/738470359 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55619202cab0 con 0x55619212cfb0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f6543fff640 1 -- 10.20.193.28:0/738470359 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f65900078c0 con 0x55619212cfb0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f6543fff640 1 -- 10.20.193.28:0/738470359 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6590007ac0 con 0x55619212cfb0 2026-02-20T03:28:06.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 10 client.19056 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:06.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 1 -- 10.20.193.28:0/738470359 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55619201a3f0 con 0x55619212cfb0 2026-02-20T03:28:06.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f6543fff640 1 -- 10.20.193.28:0/738470359 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f6590052070 con 0x55619212cfb0 2026-02-20T03:28:06.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 10 client.19056 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:06.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 10 client.19056 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:28:06.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 20 client.19056 populate_metadata read hostname 'trial028' 2026-02-20T03:28:06.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5561921bc630 0x5561921bea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:06.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 4 client.19056 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:28:06.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.771+0000 7f659ea78e00 1 -- 10.20.193.28:0/738470359 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f65900040e0 con 0x5561921bc630 2026-02-20T03:28:06.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.787+0000 7f6599ae7640 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5561921bc630 0x5561921bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:06.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.853+0000 7f6599ae7640 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5561921bc630 0x5561921bea20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=333fdd407eb2038 server_cookie=70e5cd40ba771231 in_seq=0 out_seq=0 2026-02-20T03:28:06.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.853+0000 7f6543fff640 10 client.19056 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:28:06.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f6543fff640 1 -- 10.20.193.28:0/738470359 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f65900040e0 con 0x5561921bc630 2026-02-20T03:28:06.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f6543fff640 10 client.19056 handle_command_reply: tid=0 2026-02-20T03:28:06.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 client.19056 shutdown 2026-02-20T03:28:06.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 -- 10.20.193.28:0/738470359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 msgr2=0x5561921472d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:06.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x5561921472d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f659000b0d0 tx=0x7f6590009490 comp rx=0 tx=0).stop 2026-02-20T03:28:06.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 -- 10.20.193.28:0/738470359 shutdown_connections 2026-02-20T03:28:06.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5561921bc630 0x5561921bea20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619212cfb0 0x5561921472d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556192127f60 0x556192146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 --2- 10.20.193.28:0/738470359 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561921275e0 0x556192148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 -- 10.20.193.28:0/738470359 >> 10.20.193.28:0/738470359 conn(0x5561920ea240 msgr2=0x556192150b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:06.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f6543fff640 0 client.19056 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:28:06.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 -- 10.20.193.28:0/738470359 shutdown_connections 2026-02-20T03:28:06.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 1 -- 10.20.193.28:0/738470359 wait complete. 2026-02-20T03:28:06.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659ea78e00 20 client.19056 trim_cache size 0 max 16384 2026-02-20T03:28:06.871 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:28:06.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 -- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65700b0e20 msgr2=0x7f65700b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:06.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65700b0e20 0x7f65700b32e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f65840a81c0 tx=0x7f6584004850 comp rx=0 tx=0).stop 2026-02-20T03:28:06.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 -- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594104980 msgr2=0x7f659419d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:06.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594104980 0x7f659419d1b0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f658400b570 tx=0x7f658400ba40 comp rx=0 tx=0).stop 2026-02-20T03:28:06.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 -- 10.20.193.28:0/3488892706 shutdown_connections 2026-02-20T03:28:06.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65700b0e20 0x7f65700b32e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f659410a980 0x7f65941a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6594105320 0x7f659419d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 --2- 10.20.193.28:0/3488892706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6594104980 0x7f659419d1b0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:06.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 -- 10.20.193.28:0/3488892706 >> 10.20.193.28:0/3488892706 conn(0x7f6594100680 msgr2=0x7f6594100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:06.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 -- 10.20.193.28:0/3488892706 shutdown_connections 2026-02-20T03:28:06.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:06.867+0000 7f659b2ea640 1 -- 10.20.193.28:0/3488892706 wait complete. 2026-02-20T03:28:07.053 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:28:07.337 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:07.523 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:07 trial028 ceph-mon[38552]: pgmap v585: 129 pgs: 129 active+clean; 203 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 346 op/s 2026-02-20T03:28:07.536 INFO:tasks.workunit.client.0.trial028.stdout: 1 1155563 7.99 MB/sec execute 580 sec latency 1702.955 ms 2026-02-20T03:28:07.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 -- 10.20.193.28:0/248530905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea8109ba0 msgr2=0x7f8ea8115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:07.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 --2- 10.20.193.28:0/248530905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea8109ba0 0x7f8ea8115d10 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400b0a0 tx=0x7f8ea402f450 comp rx=0 tx=0).stop 2026-02-20T03:28:07.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 -- 10.20.193.28:0/248530905 shutdown_connections 2026-02-20T03:28:07.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 --2- 10.20.193.28:0/248530905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea8109ba0 0x7f8ea8115d10 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 --2- 10.20.193.28:0/248530905 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ea8109220 0x7f8ea8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 --2- 10.20.193.28:0/248530905 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ea810eef0 0x7f8ea810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 -- 10.20.193.28:0/248530905 >> 10.20.193.28:0/248530905 conn(0x7f8ea8078600 msgr2=0x7f8ea807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:07.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 -- 10.20.193.28:0/248530905 shutdown_connections 2026-02-20T03:28:07.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:07 trial126 ceph-mon[38476]: pgmap v585: 129 pgs: 129 active+clean; 203 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 346 op/s 2026-02-20T03:28:07.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 -- 10.20.193.28:0/248530905 wait complete. 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 Processor -- start 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 -- start start 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ea8109220 0x7f8ea81a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ea8109ba0 0x7f8ea81a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea810eef0 0x7f8ea81a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81191b0 con 0x7f8ea810eef0 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8119030 con 0x7f8ea8109ba0 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.590+0000 7f8eaf055640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea8119330 con 0x7f8ea8109220 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eae854640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea810eef0 0x7f8ea81a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eae854640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea810eef0 0x7f8ea81a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60030/0 (socket says 10.20.193.28:60030) 2026-02-20T03:28:07.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eae854640 1 -- 10.20.193.28:0/4277561883 learned_addr learned my addr 10.20.193.28:0/4277561883 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eae854640 1 -- 10.20.193.28:0/4277561883 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ea8109220 msgr2=0x7f8ea81a1630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eae854640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ea8109220 0x7f8ea81a1630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eae854640 1 -- 10.20.193.28:0/4277561883 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ea8109ba0 msgr2=0x7f8ea81a1b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eae854640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ea8109ba0 0x7f8ea81a1b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eae854640 1 -- 10.20.193.28:0/4277561883 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea81a6680 con 0x7f8ea810eef0 2026-02-20T03:28:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eae854640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea810eef0 0x7f8ea81a5f00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400b1d0 tx=0x7f8ea4009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8e8f7fe640 1 -- 10.20.193.28:0/4277561883 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4004590 con 0x7f8ea810eef0 2026-02-20T03:28:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8e8f7fe640 1 -- 10.20.193.28:0/4277561883 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ea4004730 con 0x7f8ea810eef0 2026-02-20T03:28:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8e8f7fe640 1 -- 10.20.193.28:0/4277561883 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4038680 con 0x7f8ea810eef0 2026-02-20T03:28:07.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eaf055640 1 -- 10.20.193.28:0/4277561883 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea81a6910 con 0x7f8ea810eef0 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eaf055640 1 -- 10.20.193.28:0/4277561883 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea81ae1b0 con 0x7f8ea810eef0 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8e8f7fe640 1 -- 10.20.193.28:0/4277561883 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8ea4002a60 con 0x7f8ea810eef0 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eb27e3e00 1 Processor -- start 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eb27e3e00 1 -- start start 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 0x55dfa89a6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a05e0 0x55dfa89a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89acde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dfa8920e00 con 0x55dfa89a0f60 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dfa88f3970 con 0x55dfa89a05e0 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dfa88a11f0 con 0x55dfa89a5fb0 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8ead852640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8ead852640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60038/0 (socket says 10.20.193.28:60038) 2026-02-20T03:28:07.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.595+0000 7f8ead852640 1 -- 10.20.193.28:0/3871380602 learned_addr learned my addr 10.20.193.28:0/3871380602 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8ead852640 1 -- 10.20.193.28:0/3871380602 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 msgr2=0x55dfa89a6390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8ead852640 1 --2- 10.20.193.28:0/3871380602 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 0x55dfa89a6390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8ead852640 1 -- 10.20.193.28:0/3871380602 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a05e0 msgr2=0x55dfa89a0a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8ead852640 1 --2- 10.20.193.28:0/3871380602 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a05e0 0x55dfa89a0a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8ead852640 1 -- 10.20.193.28:0/3871380602 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa88b43d0 con 0x55dfa89a0f60 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8e8f7fe640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e840b0e20 0x7f8e840b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8ead852640 1 --2- 10.20.193.28:0/3871380602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89acde0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0098a0 tx=0x7f8e9c009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8bfe30618aff97 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8e8ca08640 1 -- 10.20.193.28:0/3871380602 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c016070 con 0x55dfa89a0f60 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8e8f7fe640 1 -- 10.20.193.28:0/4277561883 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f8ea41058f0 con 0x7f8ea810eef0 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8e8ca08640 1 -- 10.20.193.28:0/3871380602 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8e9c002870 con 0x55dfa89a0f60 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8e8ca08640 1 -- 10.20.193.28:0/3871380602 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0046e0 con 0x55dfa89a0f60 2026-02-20T03:28:07.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e840b0e20 0x7f8e840b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3871380602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 msgr2=0x55dfa89acde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3871380602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89acde0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0098a0 tx=0x7f8e9c009d70 comp rx=0 tx=0).stop 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3871380602 shutdown_connections 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3871380602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89acde0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3871380602 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a05e0 0x55dfa89a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3871380602 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 0x55dfa89a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3871380602 >> 10.20.193.28:0/3871380602 conn(0x55dfa8963240 msgr2=0x55dfa899ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3871380602 shutdown_connections 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3871380602 wait complete. 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e840b0e20 0x7f8e840b32e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8e980096f0 tx=0x7f8e98006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 -- start start 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 Processor -- start 2026-02-20T03:28:07.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a0f60 0x55dfa89b9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a5fb0 0x55dfa89bdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dfa88ef8a0 con 0x55dfa89a05e0 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dfa86e1f50 con 0x55dfa89a5fb0 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dfa89be420 con 0x55dfa89a0f60 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89b96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60046/0 (socket says 10.20.193.28:60046) 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 -- 10.20.193.28:0/2247444353 learned_addr learned my addr 10.20.193.28:0/2247444353 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 -- 10.20.193.28:0/2247444353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a0f60 msgr2=0x55dfa89b9bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a0f60 0x55dfa89b9bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 -- 10.20.193.28:0/2247444353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a5fb0 msgr2=0x55dfa89bdee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a5fb0 0x55dfa89bdee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.600+0000 7f8eae053640 1 -- 10.20.193.28:0/2247444353 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa89b2b70 con 0x55dfa89a05e0 2026-02-20T03:28:07.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eae053640 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89b96b0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8e980046a0 tx=0x7f8e980047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d374ca45e3c769 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:07.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8e5bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:07.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8e5bfff640 1 -- 10.20.193.28:0/2247444353 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800b760 con 0x55dfa89a05e0 2026-02-20T03:28:07.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8e5bfff640 1 -- 10.20.193.28:0/2247444353 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8e9800bda0 con 0x55dfa89a05e0 2026-02-20T03:28:07.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8e5bfff640 1 -- 10.20.193.28:0/2247444353 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98011420 con 0x55dfa89a05e0 2026-02-20T03:28:07.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/2247444353 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfa86c4b40 con 0x55dfa89a05e0 2026-02-20T03:28:07.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8e5bfff640 1 -- 10.20.193.28:0/2247444353 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f8e980115c0 con 0x55dfa89a05e0 2026-02-20T03:28:07.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 10 client.19068 _ll_register_callbacks cb 0x55dfa892ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:07.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/2247444353 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dfa8901150 con 0x55dfa89a05e0 2026-02-20T03:28:07.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8e5bfff640 1 -- 10.20.193.28:0/2247444353 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8e98020430 con 0x55dfa89a05e0 2026-02-20T03:28:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 10 client.19068 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/2247444353 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55dfa88ae1e0 con 0x55dfa89a05e0 2026-02-20T03:28:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8e5bfff640 1 -- 10.20.193.28:0/2247444353 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f8e9800b900 con 0x55dfa89a05e0 2026-02-20T03:28:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 10 client.19068 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 10 client.19068 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:28:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 20 client.19068 populate_metadata read hostname 'trial028' 2026-02-20T03:28:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dfa89c9880 0x55dfa89cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 4 client.19068 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:07.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.603+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/2247444353 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfa88fb560 con 0x55dfa89c9880 2026-02-20T03:28:07.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.630+0000 7f8ead852640 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dfa89c9880 0x55dfa89cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:07.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.697+0000 7f8ead852640 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dfa89c9880 0x55dfa89cbcd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=45c372f2ae529fc1 server_cookie=d284500f0f3a39c3 in_seq=0 out_seq=0 2026-02-20T03:28:07.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.697+0000 7f8e5bfff640 10 client.19068 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:28:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:07 trial177 ceph-mon[43181]: pgmap v585: 129 pgs: 129 active+clean; 203 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 346 op/s 2026-02-20T03:28:07.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8e5bfff640 1 -- 10.20.193.28:0/2247444353 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55dfa88fb560 con 0x55dfa89c9880 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8e5bfff640 10 client.19068 handle_command_reply: tid=0 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 client.19068 shutdown 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/2247444353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 msgr2=0x55dfa89b96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89b96b0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8e980046a0 tx=0x7f8e980047e0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/2247444353 shutdown_connections 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dfa89c9880 0x55dfa89cbcd0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a5fb0 0x55dfa89bdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a0f60 0x55dfa89b9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/2247444353 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89b96b0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/2247444353 >> 10.20.193.28:0/2247444353 conn(0x55dfa8963240 msgr2=0x55dfa899f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:07.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8e5bfff640 0 client.19068 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:28:07.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/2247444353 shutdown_connections 2026-02-20T03:28:07.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/2247444353 wait complete. 2026-02-20T03:28:07.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.724+0000 7f8eb27e3e00 20 client.19068 trim_cache size 0 max 16384 2026-02-20T03:28:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 Processor -- start 2026-02-20T03:28:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- start start 2026-02-20T03:28:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a0f60 0x55dfa89bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 0x55dfa89d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8e500126f0 con 0x55dfa89a05e0 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5000ffc0 con 0x55dfa89a0f60 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5000de10 con 0x55dfa89a5fb0 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eae053640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eae053640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89a4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60052/0 (socket says 10.20.193.28:60052) 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eae053640 1 -- 10.20.193.28:0/4193525214 learned_addr learned my addr 10.20.193.28:0/4193525214 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eae053640 1 -- 10.20.193.28:0/4193525214 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 msgr2=0x55dfa89d15e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eae053640 1 --2- 10.20.193.28:0/4193525214 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 0x55dfa89d15e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eae053640 1 -- 10.20.193.28:0/4193525214 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a0f60 msgr2=0x55dfa89bb4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eae053640 1 --2- 10.20.193.28:0/4193525214 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a0f60 0x55dfa89bb4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eae053640 1 -- 10.20.193.28:0/4193525214 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa89b29a0 con 0x55dfa89a05e0 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eae053640 1 --2- 10.20.193.28:0/4193525214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89a4dd0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8e98006dd0 tx=0x7f8e98024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0a3b8cf5723580 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8e764e6640 1 -- 10.20.193.28:0/4193525214 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800b760 con 0x55dfa89a05e0 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8e764e6640 1 -- 10.20.193.28:0/4193525214 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55dfa8901150 con 0x55dfa89a05e0 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8e764e6640 1 -- 10.20.193.28:0/4193525214 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e98011710 con 0x55dfa89a05e0 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/4193525214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 msgr2=0x55dfa89a4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/4193525214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89a4dd0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8e98006dd0 tx=0x7f8e98024000 comp rx=0 tx=0).stop 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/4193525214 shutdown_connections 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/4193525214 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 0x55dfa89d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/4193525214 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a0f60 0x55dfa89bb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/4193525214 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a05e0 0x55dfa89a4dd0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/4193525214 >> 10.20.193.28:0/4193525214 conn(0x55dfa8963240 msgr2=0x55dfa89badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/4193525214 shutdown_connections 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/4193525214 wait complete. 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- start start 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 Processor -- start 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a05e0 0x55dfa89c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 0x55dfa8a337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5000e480 con 0x55dfa89a0f60 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5000f8f0 con 0x55dfa89a05e0 2026-02-20T03:28:07.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5000eb50 con 0x55dfa89a5fb0 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8ead852640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8ead852640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89c0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60066/0 (socket says 10.20.193.28:60066) 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8ead852640 1 -- 10.20.193.28:0/3033584992 learned_addr learned my addr 10.20.193.28:0/3033584992 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8ead852640 1 -- 10.20.193.28:0/3033584992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 msgr2=0x55dfa8a337b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8ead852640 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 0x55dfa8a337b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8ead852640 1 -- 10.20.193.28:0/3033584992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a05e0 msgr2=0x55dfa89c04c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8ead852640 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a05e0 0x55dfa89c04c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8ead852640 1 -- 10.20.193.28:0/3033584992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa85d2870 con 0x55dfa89a0f60 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8ead852640 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89c0a00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c002410 tx=0x7f8e9c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e094d6fb151754f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8e5bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8e5bfff640 1 -- 10.20.193.28:0/3033584992 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c016040 con 0x55dfa89a0f60 2026-02-20T03:28:07.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8e5bfff640 1 -- 10.20.193.28:0/3033584992 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8e9c0045e0 con 0x55dfa89a0f60 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8e5bfff640 1 -- 10.20.193.28:0/3033584992 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c024460 con 0x55dfa89a0f60 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3033584992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfa88933f0 con 0x55dfa89a0f60 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.730+0000 7f8e5bfff640 1 -- 10.20.193.28:0/3033584992 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f8e9c01d460 con 0x55dfa89a0f60 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 10 client.19074 _ll_register_callbacks cb 0x7f8e98009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3033584992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dfa88a5ab0 con 0x55dfa89a0f60 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8e5bfff640 1 -- 10.20.193.28:0/3033584992 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8e9c00b8d0 con 0x55dfa89a0f60 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 10 client.19074 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3033584992 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55dfa89b3690 con 0x55dfa89a0f60 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8e5bfff640 1 -- 10.20.193.28:0/3033584992 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f8e9c002a20 con 0x55dfa89a0f60 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 10 client.19074 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 10 client.19074 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 20 client.19074 populate_metadata read hostname 'trial028' 2026-02-20T03:28:07.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dfa8a35070 0x55dfa8a37500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:07.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 4 client.19074 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:28:07.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.735+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3033584992 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8e9c002870 con 0x55dfa8a35070 2026-02-20T03:28:07.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.750+0000 7f8eae053640 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dfa8a35070 0x55dfa8a37500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:07.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.816+0000 7f8eae053640 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dfa8a35070 0x55dfa8a37500 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=162212e45584bbe8 server_cookie=106b0528829389b3 in_seq=0 out_seq=0 2026-02-20T03:28:07.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.816+0000 7f8e5bfff640 10 client.19074 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:28:07.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8e5bfff640 1 -- 10.20.193.28:0/3033584992 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8e9c002870 con 0x55dfa8a35070 2026-02-20T03:28:07.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8e5bfff640 10 client.19074 handle_command_reply: tid=0 2026-02-20T03:28:07.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 client.19074 shutdown 2026-02-20T03:28:07.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3033584992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 msgr2=0x55dfa89c0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:07.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89c0a00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c002410 tx=0x7f8e9c0095f0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3033584992 shutdown_connections 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dfa8a35070 0x55dfa8a37500 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dfa89a5fb0 0x55dfa8a337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dfa89a0f60 0x55dfa89c0a00 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 --2- 10.20.193.28:0/3033584992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dfa89a05e0 0x55dfa89c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3033584992 >> 10.20.193.28:0/3033584992 conn(0x55dfa8963240 msgr2=0x55dfa89bb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8e5bfff640 0 client.19074 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3033584992 shutdown_connections 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 1 -- 10.20.193.28:0/3033584992 wait complete. 2026-02-20T03:28:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eb27e3e00 20 client.19074 trim_cache size 0 max 16384 2026-02-20T03:28:07.846 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 -- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e840b0e20 msgr2=0x7f8e840b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e840b0e20 0x7f8e840b32e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8e980096f0 tx=0x7f8e98006cd0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 -- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea810eef0 msgr2=0x7f8ea81a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea810eef0 0x7f8ea81a5f00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400b1d0 tx=0x7f8ea4009300 comp rx=0 tx=0).stop 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 -- 10.20.193.28:0/4277561883 shutdown_connections 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e840b0e20 0x7f8e840b32e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8ea810eef0 0x7f8ea81a5f00 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8ea8109ba0 0x7f8ea81a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 --2- 10.20.193.28:0/4277561883 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8ea8109220 0x7f8ea81a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:07.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 -- 10.20.193.28:0/4277561883 >> 10.20.193.28:0/4277561883 conn(0x7f8ea8078600 msgr2=0x7f8ea8079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:07.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 -- 10.20.193.28:0/4277561883 shutdown_connections 2026-02-20T03:28:07.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:07.830+0000 7f8eaf055640 1 -- 10.20.193.28:0/4277561883 wait complete. 2026-02-20T03:28:07.989 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:28:08.287 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:08.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1155563 7.98 MB/sec execute 581 sec latency 2702.987 ms 2026-02-20T03:28:08.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- 10.20.193.28:0/182343730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d4105330 msgr2=0x7fa9d4111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:08.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/182343730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d4105330 0x7fa9d4111860 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000b0d0 tx=0x7fa9d002f490 comp rx=0 tx=0).stop 2026-02-20T03:28:08.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- 10.20.193.28:0/182343730 shutdown_connections 2026-02-20T03:28:08.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/182343730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d4105330 0x7fa9d4111860 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/182343730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9d4104990 0x7fa9d4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/182343730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9d410a990 0x7fa9d410ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- 10.20.193.28:0/182343730 >> 10.20.193.28:0/182343730 conn(0x7fa9d4100690 msgr2=0x7fa9d4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- 10.20.193.28:0/182343730 shutdown_connections 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- 10.20.193.28:0/182343730 wait complete. 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 Processor -- start 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- start start 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9d4104990 0x7fa9d419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9d4105330 0x7fa9d419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d410a990 0x7fa9d41a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d4114ce0 con 0x7fa9d410a990 2026-02-20T03:28:08.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d4114b60 con 0x7fa9d4105330 2026-02-20T03:28:08.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d4114e60 con 0x7fa9d4104990 2026-02-20T03:28:08.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9d9ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d410a990 0x7fa9d41a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:08.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9d9ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d410a990 0x7fa9d41a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60076/0 (socket says 10.20.193.28:60076) 2026-02-20T03:28:08.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/2889833325 learned_addr learned my addr 10.20.193.28:0/2889833325 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:08.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/2889833325 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9d4104990 msgr2=0x7fa9d419d1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:08.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9d9ac2640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9d4104990 0x7fa9d419d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/2889833325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9d4105330 msgr2=0x7fa9d419d700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9d9ac2640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9d4105330 0x7fa9d419d700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/2889833325 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d41a2210 con 0x7fa9d410a990 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9d9ac2640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d410a990 0x7fa9d41a1a90 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fa9d00077f0 tx=0x7fa9d0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9c27fc640 1 -- 10.20.193.28:0/2889833325 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0004590 con 0x7fa9d410a990 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9c27fc640 1 -- 10.20.193.28:0/2889833325 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa9d0004730 con 0x7fa9d410a990 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- 10.20.193.28:0/2889833325 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d41a24a0 con 0x7fa9d410a990 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9da2c3640 1 -- 10.20.193.28:0/2889833325 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d41a9d40 con 0x7fa9d410a990 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.526+0000 7fa9c27fc640 1 -- 10.20.193.28:0/2889833325 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d00052b0 con 0x7fa9d410a990 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.531+0000 7fa9c27fc640 1 -- 10.20.193.28:0/2889833325 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa9d0002a60 con 0x7fa9d410a990 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.531+0000 7fa9dda51e00 1 Processor -- start 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.533+0000 7fa9dda51e00 1 -- start start 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea922fb0 0x564eea923390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 0x564eea91da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea929de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564eea89de00 con 0x564eea91df60 2026-02-20T03:28:08.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564eea870970 con 0x564eea922fb0 2026-02-20T03:28:08.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564eea81e1f0 con 0x564eea91d5e0 2026-02-20T03:28:08.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9d8ac0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea929de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:08.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9d8ac0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea929de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60088/0 (socket says 10.20.193.28:60088) 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9d8ac0640 1 -- 10.20.193.28:0/3376473637 learned_addr learned my addr 10.20.193.28:0/3376473637 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9d8ac0640 1 -- 10.20.193.28:0/3376473637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 msgr2=0x564eea91da20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9d8ac0640 1 --2- 10.20.193.28:0/3376473637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 0x564eea91da20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9d8ac0640 1 -- 10.20.193.28:0/3376473637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea922fb0 msgr2=0x564eea923390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9d8ac0640 1 --2- 10.20.193.28:0/3376473637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea922fb0 0x564eea923390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9d8ac0640 1 -- 10.20.193.28:0/3376473637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eea8313d0 con 0x564eea91df60 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.534+0000 7fa9d8ac0640 1 --2- 10.20.193.28:0/3376473637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea929de0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80098a0 tx=0x7fa9c8009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16124e1dbf4446f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9a1ce5640 1 -- 10.20.193.28:0/3376473637 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8016070 con 0x564eea91df60 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9a1ce5640 1 -- 10.20.193.28:0/3376473637 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa9c8002870 con 0x564eea91df60 2026-02-20T03:28:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9a1ce5640 1 -- 10.20.193.28:0/3376473637 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8011400 con 0x564eea91df60 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9c27fc640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9b00b0da0 0x7fa9b00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9c27fc640 1 -- 10.20.193.28:0/2889833325 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fa9d0105800 con 0x7fa9d410a990 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 -- 10.20.193.28:0/3376473637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 msgr2=0x564eea929de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/3376473637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea929de0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80098a0 tx=0x7fa9c8009d70 comp rx=0 tx=0).stop 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 -- 10.20.193.28:0/3376473637 shutdown_connections 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/3376473637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea929de0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/3376473637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 0x564eea91da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/3376473637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea922fb0 0x564eea923390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 -- 10.20.193.28:0/3376473637 >> 10.20.193.28:0/3376473637 conn(0x564eea8e0240 msgr2=0x564eea91bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9d92c1640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9b00b0da0 0x7fa9b00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 -- 10.20.193.28:0/3376473637 shutdown_connections 2026-02-20T03:28:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 -- 10.20.193.28:0/3376473637 wait complete. 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9d92c1640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9b00b0da0 0x7fa9b00b3260 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009630 tx=0x7fa9c4006c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.535+0000 7fa9dda51e00 1 -- start start 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 Processor -- start 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea91d5e0 0x564eea940a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91df60 0x564eea940f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea922fb0 0x564eea93f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564eea86c8a0 con 0x564eea922fb0 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564eea65ef50 con 0x564eea91d5e0 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9d9ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea922fb0 0x564eea93f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9d9ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea922fb0 0x564eea93f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60100/0 (socket says 10.20.193.28:60100) 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/170045076 learned_addr learned my addr 10.20.193.28:0/170045076 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:08.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564eea93f740 con 0x564eea91df60 2026-02-20T03:28:08.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/170045076 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91df60 msgr2=0x564eea940f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:08.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9d9ac2640 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91df60 0x564eea940f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/170045076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea91d5e0 msgr2=0x564eea940a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:08.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9d9ac2640 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea91d5e0 0x564eea940a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/170045076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eea938580 con 0x564eea922fb0 2026-02-20T03:28:08.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9d9ac2640 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea922fb0 0x564eea93f1b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa9d00cd1e0 tx=0x7fa9d00ccbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c513ccbc1c63cc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:08.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa98effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:08.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa98effd640 1 -- 10.20.193.28:0/170045076 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d00048e0 con 0x564eea922fb0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa98effd640 1 -- 10.20.193.28:0/170045076 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa9d0033050 con 0x564eea922fb0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa98effd640 1 -- 10.20.193.28:0/170045076 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d00d4de0 con 0x564eea922fb0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eea641b40 con 0x564eea922fb0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 10 client.19086 _ll_register_callbacks cb 0x564eea8a9eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564eea87e150 con 0x564eea922fb0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa98effd640 1 -- 10.20.193.28:0/170045076 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fa9d004a9d0 con 0x564eea922fb0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa98effd640 1 -- 10.20.193.28:0/170045076 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa9d00d6740 con 0x564eea922fb0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 10 client.19086 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x564eea82b1e0 con 0x564eea922fb0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa98effd640 1 -- 10.20.193.28:0/170045076 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa9d00b5bb0 con 0x564eea922fb0 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 10 client.19086 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 10 client.19086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 20 client.19086 populate_metadata read hostname 'trial028' 2026-02-20T03:28:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564eea94f1b0 0x564eea951670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 4 client.19086 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.537+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564eea878560 con 0x564eea94f1b0 2026-02-20T03:28:08.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.564+0000 7fa9d92c1640 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564eea94f1b0 0x564eea951670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:08.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.631+0000 7fa9d92c1640 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564eea94f1b0 0x564eea951670 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ca5af31f08d9644 server_cookie=22c565188fcb698c in_seq=0 out_seq=0 2026-02-20T03:28:08.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.631+0000 7fa98effd640 10 client.19086 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:08.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.657+0000 7fa98effd640 1 -- 10.20.193.28:0/170045076 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x564eea878560 con 0x564eea94f1b0 2026-02-20T03:28:08.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.657+0000 7fa98effd640 10 client.19086 handle_command_reply: tid=0 2026-02-20T03:28:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 client.19086 shutdown 2026-02-20T03:28:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea922fb0 msgr2=0x564eea93f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea922fb0 0x564eea93f1b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa9d00cd1e0 tx=0x7fa9d00ccbe0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 shutdown_connections 2026-02-20T03:28:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564eea94f1b0 0x564eea951670 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea922fb0 0x564eea93f1b0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91df60 0x564eea940f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/170045076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea91d5e0 0x564eea940a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 >> 10.20.193.28:0/170045076 conn(0x564eea8e0240 msgr2=0x564eea91c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa98effd640 0 client.19086 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 shutdown_connections 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 1 -- 10.20.193.28:0/170045076 wait complete. 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.658+0000 7fa9dda51e00 20 client.19086 trim_cache size 0 max 16384 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 Processor -- start 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- start start 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea8e0240 0x564eea94bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 0x564eea91c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea91df60 0x564eea91ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa980012650 con 0x564eea8e0240 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa98000ff20 con 0x564eea91df60 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa98000dd70 con 0x564eea91d5e0 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d92c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea8e0240 0x564eea94bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d92c1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea8e0240 0x564eea94bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60112/0 (socket says 10.20.193.28:60112) 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d92c1640 1 -- 10.20.193.28:0/1810962497 learned_addr learned my addr 10.20.193.28:0/1810962497 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d92c1640 1 -- 10.20.193.28:0/1810962497 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 msgr2=0x564eea91c4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d92c1640 1 --2- 10.20.193.28:0/1810962497 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 0x564eea91c4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d92c1640 1 -- 10.20.193.28:0/1810962497 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea91df60 msgr2=0x564eea91ca10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d92c1640 1 --2- 10.20.193.28:0/1810962497 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea91df60 0x564eea91ca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d92c1640 1 -- 10.20.193.28:0/1810962497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eea9383b0 con 0x564eea8e0240 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d92c1640 1 --2- 10.20.193.28:0/1810962497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea8e0240 0x564eea94bac0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4004380 tx=0x7fa9c4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb137435a84e677 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9a14e4640 1 -- 10.20.193.28:0/1810962497 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40116a0 con 0x564eea8e0240 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9a14e4640 1 -- 10.20.193.28:0/1810962497 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa9c4011ce0 con 0x564eea8e0240 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9a14e4640 1 -- 10.20.193.28:0/1810962497 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c40253a0 con 0x564eea8e0240 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1810962497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea8e0240 msgr2=0x564eea94bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1810962497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea8e0240 0x564eea94bac0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4004380 tx=0x7fa9c4010000 comp rx=0 tx=0).stop 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1810962497 shutdown_connections 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1810962497 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea91df60 0x564eea91ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1810962497 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 0x564eea91c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1810962497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea8e0240 0x564eea94bac0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1810962497 >> 10.20.193.28:0/1810962497 conn(0x564eea920d90 msgr2=0x564eea940a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:08.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1810962497 shutdown_connections 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1810962497 wait complete. 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- start start 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 Processor -- start 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea8e0240 0x564eea947110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 0x564eea9433e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea943920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa98000e3e0 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa98000f850 con 0x564eea8e0240 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa98000eab0 con 0x564eea91d5e0 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d9ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea943920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d9ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea943920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60118/0 (socket says 10.20.193.28:60118) 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/1491915010 learned_addr learned my addr 10.20.193.28:0/1491915010 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/1491915010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 msgr2=0x564eea9433e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d9ac2640 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 0x564eea9433e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/1491915010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea8e0240 msgr2=0x564eea947110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d9ac2640 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea8e0240 0x564eea947110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d9ac2640 1 -- 10.20.193.28:0/1491915010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eea54f870 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9d9ac2640 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea943920 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa9d002f9a0 tx=0x7fa9d0105730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7df8420073b5b0c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa98effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa98effd640 1 -- 10.20.193.28:0/1491915010 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d00cdbe0 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa98effd640 1 -- 10.20.193.28:0/1491915010 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa9d0033070 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1491915010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eea8103f0 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 10 client.19092 _ll_register_callbacks cb 0x7fa9d00c9150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa98effd640 1 -- 10.20.193.28:0/1491915010 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d004ac30 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1491915010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564eea822ab0 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa98effd640 1 -- 10.20.193.28:0/1491915010 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fa9d00c8c00 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa98effd640 1 -- 10.20.193.28:0/1491915010 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa9d00c8f20 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 10 client.19092 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1491915010 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x564eea9390a0 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.664+0000 7fa98effd640 1 -- 10.20.193.28:0/1491915010 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa9d00cc4f0 con 0x564eea91df60 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.669+0000 7fa9dda51e00 10 client.19092 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.669+0000 7fa9dda51e00 10 client.19092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.669+0000 7fa9dda51e00 20 client.19092 populate_metadata read hostname 'trial028' 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.669+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564eea922fb0 0x564eea9bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.669+0000 7fa9dda51e00 4 client.19092 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.669+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1491915010 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa9c8002870 con 0x564eea922fb0 2026-02-20T03:28:08.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.684+0000 7fa9d92c1640 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564eea922fb0 0x564eea9bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:08.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9d92c1640 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564eea922fb0 0x564eea9bceb0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2dab5aafe32bf43 server_cookie=48c04598eb32ba73 in_seq=0 out_seq=0 2026-02-20T03:28:08.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa98effd640 10 client.19092 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:08.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa98effd640 1 -- 10.20.193.28:0/1491915010 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa9c8002870 con 0x564eea922fb0 2026-02-20T03:28:08.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa98effd640 10 client.19092 handle_command_reply: tid=0 2026-02-20T03:28:08.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 client.19092 shutdown 2026-02-20T03:28:08.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1491915010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 msgr2=0x564eea943920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:08.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea943920 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fa9d002f9a0 tx=0x7fa9d0105730 comp rx=0 tx=0).stop 2026-02-20T03:28:08.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1491915010 shutdown_connections 2026-02-20T03:28:08.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564eea922fb0 0x564eea9bceb0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564eea91df60 0x564eea943920 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564eea91d5e0 0x564eea9433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 --2- 10.20.193.28:0/1491915010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564eea8e0240 0x564eea947110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1491915010 >> 10.20.193.28:0/1491915010 conn(0x564eea920d90 msgr2=0x564eea91b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:08.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa98effd640 0 client.19092 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:08.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1491915010 shutdown_connections 2026-02-20T03:28:08.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 1 -- 10.20.193.28:0/1491915010 wait complete. 2026-02-20T03:28:08.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9dda51e00 20 client.19092 trim_cache size 0 max 16384 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 -- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9b00b0da0 msgr2=0x7fa9b00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9b00b0da0 0x7fa9b00b3260 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009630 tx=0x7fa9c4006c70 comp rx=0 tx=0).stop 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 -- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d410a990 msgr2=0x7fa9d41a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d410a990 0x7fa9d41a1a90 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fa9d00077f0 tx=0x7fa9d0009300 comp rx=0 tx=0).stop 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 -- 10.20.193.28:0/2889833325 shutdown_connections 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9b00b0da0 0x7fa9b00b3260 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9d410a990 0x7fa9d41a1a90 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9d4105330 0x7fa9d419d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 --2- 10.20.193.28:0/2889833325 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9d4104990 0x7fa9d419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 -- 10.20.193.28:0/2889833325 >> 10.20.193.28:0/2889833325 conn(0x7fa9d4100690 msgr2=0x7fa9d4100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:08.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 -- 10.20.193.28:0/2889833325 shutdown_connections 2026-02-20T03:28:08.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:08.738+0000 7fa9da2c3640 1 -- 10.20.193.28:0/2889833325 wait complete. 2026-02-20T03:28:09.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:09 trial028 ceph-mon[38552]: pgmap v586: 129 pgs: 129 active+clean; 202 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 802 KiB/s rd, 3.3 MiB/s wr, 278 op/s 2026-02-20T03:28:09.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1155563 7.96 MB/sec execute 582 sec latency 3703.025 ms 2026-02-20T03:28:09.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:09 trial126 ceph-mon[38476]: pgmap v586: 129 pgs: 129 active+clean; 202 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 802 KiB/s rd, 3.3 MiB/s wr, 278 op/s 2026-02-20T03:28:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:09 trial177 ceph-mon[43181]: pgmap v586: 129 pgs: 129 active+clean; 202 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 802 KiB/s rd, 3.3 MiB/s wr, 278 op/s 2026-02-20T03:28:09.914 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:28:09.915 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:28:10.181 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:10.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.393+0000 7f323e048640 1 -- 10.20.193.28:0/2118447277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3238109220 msgr2=0x7f3238109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.393+0000 7f323e048640 1 --2- 10.20.193.28:0/2118447277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3238109220 0x7f3238109660 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f322c009960 tx=0x7f322c02f140 comp rx=0 tx=0).stop 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.394+0000 7f323e048640 1 -- 10.20.193.28:0/2118447277 shutdown_connections 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.394+0000 7f323e048640 1 --2- 10.20.193.28:0/2118447277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3238109ba0 0x7f3238115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.394+0000 7f323e048640 1 --2- 10.20.193.28:0/2118447277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3238109220 0x7f3238109660 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.394+0000 7f323e048640 1 --2- 10.20.193.28:0/2118447277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f323810eef0 0x7f323810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.394+0000 7f323e048640 1 -- 10.20.193.28:0/2118447277 >> 10.20.193.28:0/2118447277 conn(0x7f3238078600 msgr2=0x7f323807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.394+0000 7f323e048640 1 -- 10.20.193.28:0/2118447277 shutdown_connections 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.394+0000 7f323e048640 1 -- 10.20.193.28:0/2118447277 wait complete. 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.394+0000 7f323e048640 1 Processor -- start 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323e048640 1 -- start start 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323e048640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3238109220 0x7f32381a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323e048640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3238109ba0 0x7f32381a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323e048640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f323810eef0 0x7f32381a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323e048640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3238119090 con 0x7f323810eef0 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323e048640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3238118f10 con 0x7f3238109ba0 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323e048640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3238119210 con 0x7f3238109220 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d847640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f323810eef0 0x7f32381a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d046640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3238109220 0x7f32381a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323c845640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3238109ba0 0x7f32381a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d847640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f323810eef0 0x7f32381a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60134/0 (socket says 10.20.193.28:60134) 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d847640 1 -- 10.20.193.28:0/3725288382 learned_addr learned my addr 10.20.193.28:0/3725288382 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d046640 1 -- 10.20.193.28:0/3725288382 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3238109ba0 msgr2=0x7f32381a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d046640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3238109ba0 0x7f32381a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d046640 1 -- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f323810eef0 msgr2=0x7f32381a5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d046640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f323810eef0 0x7f32381a5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d046640 1 -- 10.20.193.28:0/3725288382 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32381a6560 con 0x7f3238109220 2026-02-20T03:28:10.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.395+0000 7f323d847640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f323810eef0 0x7f32381a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:10.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.396+0000 7f323d046640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3238109220 0x7f32381a1510 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f322800e9f0 tx=0x7f322800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.396+0000 7f32267fc640 1 -- 10.20.193.28:0/3725288382 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322800cd80 con 0x7f3238109220 2026-02-20T03:28:10.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.396+0000 7f32267fc640 1 -- 10.20.193.28:0/3725288382 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3228004570 con 0x7f3238109220 2026-02-20T03:28:10.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.396+0000 7f323e048640 1 -- 10.20.193.28:0/3725288382 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32381a6850 con 0x7f3238109220 2026-02-20T03:28:10.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.396+0000 7f323e048640 1 -- 10.20.193.28:0/3725288382 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32381ae090 con 0x7f3238109220 2026-02-20T03:28:10.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.396+0000 7f32267fc640 1 -- 10.20.193.28:0/3725288382 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228004aa0 con 0x7f3238109220 2026-02-20T03:28:10.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.399+0000 7f32267fc640 1 -- 10.20.193.28:0/3725288382 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3228020030 con 0x7f3238109220 2026-02-20T03:28:10.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.399+0000 7f32417d6e00 1 Processor -- start 2026-02-20T03:28:10.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.399+0000 7f32417d6e00 1 -- start start 2026-02-20T03:28:10.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de04540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de04fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f32417d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55619dd52c00 con 0x55619de04b60 2026-02-20T03:28:10.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f32417d6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55619dd003c0 con 0x55619de00a70 2026-02-20T03:28:10.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f32417d6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55619dd4eb30 con 0x55619de000c0 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323d046640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de04540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323d847640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323d046640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de04540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39470/0 (socket says 10.20.193.28:39470) 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323d046640 1 -- 10.20.193.28:0/5004700 learned_addr learned my addr 10.20.193.28:0/5004700 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323c845640 1 --2- 10.20.193.28:0/5004700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de04fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323d046640 1 -- 10.20.193.28:0/5004700 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 msgr2=0x55619de004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323d046640 1 --2- 10.20.193.28:0/5004700 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323d046640 1 -- 10.20.193.28:0/5004700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 msgr2=0x55619de04fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323d046640 1 --2- 10.20.193.28:0/5004700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de04fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323d046640 1 -- 10.20.193.28:0/5004700 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619dcf9840 con 0x55619de00a70 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.400+0000 7f323c845640 1 --2- 10.20.193.28:0/5004700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de04fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:10.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.401+0000 7f32267fc640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32140b0da0 0x7f32140b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.401+0000 7f323d046640 1 --2- 10.20.193.28:0/5004700 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de04540 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f32280e4b90 tx=0x7f32280e9520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16f94ba435c56445 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.401+0000 7f3205ce5640 1 -- 10.20.193.28:0/5004700 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280a4420 con 0x55619de00a70 2026-02-20T03:28:10.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.401+0000 7f32267fc640 1 -- 10.20.193.28:0/3725288382 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f32280e0ad0 con 0x7f3238109220 2026-02-20T03:28:10.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.401+0000 7f3205ce5640 1 -- 10.20.193.28:0/5004700 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f32280afe50 con 0x55619de00a70 2026-02-20T03:28:10.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.401+0000 7f3205ce5640 1 -- 10.20.193.28:0/5004700 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280a4420 con 0x55619de00a70 2026-02-20T03:28:10.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.401+0000 7f323d847640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32140b0da0 0x7f32140b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f32417d6e00 1 -- 10.20.193.28:0/5004700 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 msgr2=0x55619de04540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f32417d6e00 1 --2- 10.20.193.28:0/5004700 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de04540 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f32280e4b90 tx=0x7f32280e9520 comp rx=0 tx=0).stop 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f32417d6e00 1 -- 10.20.193.28:0/5004700 shutdown_connections 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f32417d6e00 1 --2- 10.20.193.28:0/5004700 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de04fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f32417d6e00 1 --2- 10.20.193.28:0/5004700 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de04540 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f32417d6e00 1 --2- 10.20.193.28:0/5004700 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f32417d6e00 1 -- 10.20.193.28:0/5004700 >> 10.20.193.28:0/5004700 conn(0x55619ddf8b60 msgr2=0x55619ddfe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f32417d6e00 1 -- 10.20.193.28:0/5004700 shutdown_connections 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f323d847640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32140b0da0 0x7f32140b3260 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3234009c10 tx=0x7f323400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.402+0000 7f32417d6e00 1 -- 10.20.193.28:0/5004700 wait complete. 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.403+0000 7f32417d6e00 1 -- start start 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.403+0000 7f32417d6e00 1 Processor -- start 2026-02-20T03:28:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.403+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de1a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.403+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de00a70 0x55619de1a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.403+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de04b60 0x55619de18b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.403+0000 7f32417d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55619dcfa1a0 con 0x55619de00a70 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.403+0000 7f32417d6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55619de0cd70 con 0x55619de04b60 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.403+0000 7f32417d6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55619de192d0 con 0x55619de000c0 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323c845640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de00a70 0x55619de1a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323d046640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de1a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323d046640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de1a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:44490/0 (socket says 10.20.193.28:44490) 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323d046640 1 -- 10.20.193.28:0/4005925261 learned_addr learned my addr 10.20.193.28:0/4005925261 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323d847640 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de04b60 0x55619de18b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323c845640 1 -- 10.20.193.28:0/4005925261 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 msgr2=0x55619de1a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323c845640 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de1a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323c845640 1 -- 10.20.193.28:0/4005925261 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de04b60 msgr2=0x55619de18b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323c845640 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de04b60 0x55619de18b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323c845640 1 -- 10.20.193.28:0/4005925261 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619de12550 con 0x55619de00a70 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323d046640 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de1a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f323c845640 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de00a70 0x55619de1a950 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f322c002410 tx=0x7f322c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27efd6b8c6352718 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.404+0000 7f31f2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4005925261 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c049070 con 0x55619de00a70 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4005925261 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f322c033040 con 0x55619de00a70 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4005925261 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f322c004d50 con 0x55619de00a70 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f32417d6e00 1 -- 10.20.193.28:0/4005925261 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619db21b60 con 0x55619de00a70 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f32417d6e00 10 client.19104 _ll_register_callbacks cb 0x55619dcfe0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f32417d6e00 1 -- 10.20.193.28:0/4005925261 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55619dd5a7f0 con 0x55619de00a70 2026-02-20T03:28:10.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4005925261 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f322c005030 con 0x55619de00a70 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4005925261 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f322c0052f0 con 0x55619de00a70 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f32417d6e00 10 client.19104 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f32417d6e00 1 -- 10.20.193.28:0/4005925261 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55619dd1f430 con 0x55619de00a70 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4005925261 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f322c005490 con 0x55619de00a70 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f32417d6e00 10 client.19104 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f32417d6e00 10 client.19104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.405+0000 7f32417d6e00 20 client.19104 populate_metadata read hostname 'trial028' 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.406+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55619de28b70 0x55619de2b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.406+0000 7f32417d6e00 4 client.19104 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.406+0000 7f32417d6e00 1 -- 10.20.193.28:0/4005925261 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55619dcd4c00 con 0x55619de28b70 2026-02-20T03:28:10.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.406+0000 7f323d046640 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55619de28b70 0x55619de2b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f323d046640 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55619de28b70 0x55619de2b000 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc72eb01477d8805 server_cookie=c8d28c91cace750a in_seq=0 out_seq=0 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f31f2ffd640 10 client.19104 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4005925261 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55619dcd4c00 con 0x55619de28b70 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f31f2ffd640 10 client.19104 handle_command_reply: tid=0 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f32417d6e00 1 client.19104 shutdown 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f32417d6e00 1 -- 10.20.193.28:0/4005925261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de00a70 msgr2=0x55619de1a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de00a70 0x55619de1a950 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f322c002410 tx=0x7f322c005e70 comp rx=0 tx=0).stop 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f32417d6e00 1 -- 10.20.193.28:0/4005925261 shutdown_connections 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55619de28b70 0x55619de2b000 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de04b60 0x55619de18b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de00a70 0x55619de1a950 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4005925261 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de1a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f32417d6e00 1 -- 10.20.193.28:0/4005925261 >> 10.20.193.28:0/4005925261 conn(0x55619ddf8b60 msgr2=0x55619de03520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.407+0000 7f31f2ffd640 0 client.19104 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:10.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.408+0000 7f32417d6e00 1 -- 10.20.193.28:0/4005925261 shutdown_connections 2026-02-20T03:28:10.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.408+0000 7f32417d6e00 1 -- 10.20.193.28:0/4005925261 wait complete. 2026-02-20T03:28:10.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.408+0000 7f32417d6e00 20 client.19104 trim_cache size 0 max 16384 2026-02-20T03:28:10.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f32417d6e00 1 Processor -- start 2026-02-20T03:28:10.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f32417d6e00 1 -- start start 2026-02-20T03:28:10.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de05c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de06160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f32417d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31e40126e0 con 0x55619de04b60 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f32417d6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f31e400ffb0 con 0x55619de00a70 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f32417d6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31e400de00 con 0x55619de000c0 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f323d046640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f323d046640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de042e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:44496/0 (socket says 10.20.193.28:44496) 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f323d046640 1 -- 10.20.193.28:0/987549794 learned_addr learned my addr 10.20.193.28:0/987549794 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f323c845640 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de05c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.417+0000 7f323d847640 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de06160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f323d046640 1 -- 10.20.193.28:0/987549794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 msgr2=0x55619de05c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f323d046640 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de05c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f323d046640 1 -- 10.20.193.28:0/987549794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 msgr2=0x55619de06160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f323d046640 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de06160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f323d046640 1 -- 10.20.193.28:0/987549794 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619de12380 con 0x55619de000c0 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f323c845640 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de05c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f323d847640 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de06160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f323d046640 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de042e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f32280e9a30 tx=0x7f32280e5040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ec5f28f505c59b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32054e4640 1 -- 10.20.193.28:0/987549794 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280a4420 con 0x55619de000c0 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32054e4640 1 -- 10.20.193.28:0/987549794 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f32280acb60 con 0x55619de000c0 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32054e4640 1 -- 10.20.193.28:0/987549794 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280a7cd0 con 0x55619de000c0 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32417d6e00 1 -- 10.20.193.28:0/987549794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 msgr2=0x55619de042e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32417d6e00 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de042e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f32280e9a30 tx=0x7f32280e5040 comp rx=0 tx=0).stop 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32417d6e00 1 -- 10.20.193.28:0/987549794 shutdown_connections 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32417d6e00 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de06160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32417d6e00 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de00a70 0x55619de05c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32417d6e00 1 --2- 10.20.193.28:0/987549794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de000c0 0x55619de042e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32417d6e00 1 -- 10.20.193.28:0/987549794 >> 10.20.193.28:0/987549794 conn(0x55619ddf8b60 msgr2=0x55619de05510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32417d6e00 1 -- 10.20.193.28:0/987549794 shutdown_connections 2026-02-20T03:28:10.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.418+0000 7f32417d6e00 1 -- 10.20.193.28:0/987549794 wait complete. 2026-02-20T03:28:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.419+0000 7f32417d6e00 1 -- start start 2026-02-20T03:28:10.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.419+0000 7f32417d6e00 1 Processor -- start 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de000c0 0x55619de1f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de00a70 0x55619de1ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f32417d6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de8db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f32417d6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31e400e470 con 0x55619de04b60 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f32417d6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f31e400f8e0 con 0x55619de000c0 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f32417d6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31e400eb40 con 0x55619de00a70 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d046640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de000c0 0x55619de1f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323c845640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de00a70 0x55619de1ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d046640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de000c0 0x55619de1f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:39490/0 (socket says 10.20.193.28:39490) 2026-02-20T03:28:10.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d046640 1 -- 10.20.193.28:0/4204848354 learned_addr learned my addr 10.20.193.28:0/4204848354 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d847640 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de8db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d847640 1 -- 10.20.193.28:0/4204848354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de00a70 msgr2=0x55619de1ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d847640 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de00a70 0x55619de1ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d847640 1 -- 10.20.193.28:0/4204848354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de000c0 msgr2=0x55619de1f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d847640 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de000c0 0x55619de1f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d847640 1 -- 10.20.193.28:0/4204848354 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619da31900 con 0x55619de04b60 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323c845640 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de00a70 0x55619de1ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f323d847640 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de8db40 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3234007ea0 tx=0x7f3234004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1becb5463357561 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.420+0000 7f31f2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4204848354 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234024950 con 0x55619de04b60 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4204848354 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3234025440 con 0x55619de04b60 2026-02-20T03:28:10.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4204848354 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323402d610 con 0x55619de04b60 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f32417d6e00 1 -- 10.20.193.28:0/4204848354 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619dd0d4d0 con 0x55619de04b60 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4204848354 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f323402d870 con 0x55619de04b60 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f31f2ffd640 10 client.19110 inactive, discarding osd_map(95..95 src has 1..95) 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f32417d6e00 10 client.19110 _ll_register_callbacks cb 0x7f322c02fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f32417d6e00 1 -- 10.20.193.28:0/4204848354 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32280acb60 con 0x55619de04b60 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4204848354 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3234025940 con 0x55619de04b60 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f32417d6e00 10 client.19110 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.421+0000 7f32417d6e00 1 -- 10.20.193.28:0/4204848354 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55619de13070 con 0x55619de04b60 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.422+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4204848354 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f32340255f0 con 0x55619de04b60 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.422+0000 7f32417d6e00 10 client.19110 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:10.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.422+0000 7f32417d6e00 10 client.19110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.422+0000 7f32417d6e00 20 client.19110 populate_metadata read hostname 'trial028' 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.422+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55619de95830 0x55619de97cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.422+0000 7f32417d6e00 4 client.19110 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.422+0000 7f32417d6e00 1 -- 10.20.193.28:0/4204848354 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55619dcd4c00 con 0x55619de95830 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.422+0000 7f323d046640 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55619de95830 0x55619de97cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.423+0000 7f323d046640 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55619de95830 0x55619de97cf0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b194097015ab0a server_cookie=3841df377844a98c in_seq=0 out_seq=0 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.423+0000 7f31f2ffd640 10 client.19110 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.423+0000 7f31f2ffd640 1 -- 10.20.193.28:0/4204848354 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55619dcd4c00 con 0x55619de95830 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.423+0000 7f31f2ffd640 10 client.19110 handle_command_reply: tid=0 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.423+0000 7f32417d6e00 1 client.19110 shutdown 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 -- 10.20.193.28:0/4204848354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 msgr2=0x55619de8db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de8db40 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3234007ea0 tx=0x7f3234004bb0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 -- 10.20.193.28:0/4204848354 shutdown_connections 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55619de95830 0x55619de97cf0 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55619de04b60 0x55619de8db40 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55619de00a70 0x55619de1ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 --2- 10.20.193.28:0/4204848354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55619de000c0 0x55619de1f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 -- 10.20.193.28:0/4204848354 >> 10.20.193.28:0/4204848354 conn(0x55619ddf8b60 msgr2=0x55619de05d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f31f2ffd640 0 client.19110 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 -- 10.20.193.28:0/4204848354 shutdown_connections 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 1 -- 10.20.193.28:0/4204848354 wait complete. 2026-02-20T03:28:10.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f32417d6e00 20 client.19110 trim_cache size 0 max 16384 2026-02-20T03:28:10.433 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:28:10.433 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:28:10.433 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "8d8bfb87-aa02-404e-b3a1-6c1677505277", 2026-02-20T03:28:10.433 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:28:10.433 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:28:10.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f323e048640 1 -- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32140b0da0 msgr2=0x7f32140b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f323e048640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32140b0da0 0x7f32140b3260 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3234009c10 tx=0x7f323400b040 comp rx=0 tx=0).stop 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f323e048640 1 -- 10.20.193.28:0/3725288382 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3238109220 msgr2=0x7f32381a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.424+0000 7f323e048640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3238109220 0x7f32381a1510 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f322800e9f0 tx=0x7f322800eec0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.425+0000 7f323e048640 1 -- 10.20.193.28:0/3725288382 shutdown_connections 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.425+0000 7f323e048640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f32140b0da0 0x7f32140b3260 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.425+0000 7f323e048640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f323810eef0 0x7f32381a5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.425+0000 7f323e048640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3238109ba0 0x7f32381a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.425+0000 7f323e048640 1 --2- 10.20.193.28:0/3725288382 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3238109220 0x7f32381a1510 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.425+0000 7f323e048640 1 -- 10.20.193.28:0/3725288382 >> 10.20.193.28:0/3725288382 conn(0x7f3238078600 msgr2=0x7f3238079e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.425+0000 7f323e048640 1 -- 10.20.193.28:0/3725288382 shutdown_connections 2026-02-20T03:28:10.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:10.425+0000 7f323e048640 1 -- 10.20.193.28:0/3725288382 wait complete. 2026-02-20T03:28:10.530 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:28:10.531 INFO:tasks.workunit.client.0.trial028.stdout: 1 1158289 7.98 MB/sec execute 583 sec latency 4034.357 ms 2026-02-20T03:28:10.835 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:10.848 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.845+0000 7f374bfff640 1 -- 10.20.193.28:0/3639181473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744099600 msgr2=0x7f374409fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.845+0000 7f374bfff640 1 --2- 10.20.193.28:0/3639181473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744099600 0x7f374409fe90 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3734009a30 tx=0x7f373402f260 comp rx=0 tx=0).stop 2026-02-20T03:28:10.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.845+0000 7f374bfff640 1 -- 10.20.193.28:0/3639181473 shutdown_connections 2026-02-20T03:28:10.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.845+0000 7f374bfff640 1 --2- 10.20.193.28:0/3639181473 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744099600 0x7f374409fe90 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.845+0000 7f374bfff640 1 --2- 10.20.193.28:0/3639181473 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3744098c40 0x7f37440990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.849 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.845+0000 7f374bfff640 1 --2- 10.20.193.28:0/3639181473 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3744097a50 0x7f3744097e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.845+0000 7f374bfff640 1 -- 10.20.193.28:0/3639181473 >> 10.20.193.28:0/3639181473 conn(0x7f37440931d0 msgr2=0x7f37440955f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.846+0000 7f374bfff640 1 -- 10.20.193.28:0/3639181473 shutdown_connections 2026-02-20T03:28:10.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.846+0000 7f374bfff640 1 -- 10.20.193.28:0/3639181473 wait complete. 2026-02-20T03:28:10.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.846+0000 7f374bfff640 1 Processor -- start 2026-02-20T03:28:10.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.847+0000 7f374bfff640 1 -- start start 2026-02-20T03:28:10.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.847+0000 7f374bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744097a50 0x7f37441340b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.847+0000 7f374bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3744098c40 0x7f37441345f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.847+0000 7f374bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3744099600 0x7f374413b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.847+0000 7f374bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3744009e20 con 0x7f3744097a50 2026-02-20T03:28:10.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.847+0000 7f374bfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3744009ca0 con 0x7f3744098c40 2026-02-20T03:28:10.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.847+0000 7f374bfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3744009fa0 con 0x7f3744099600 2026-02-20T03:28:10.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.847+0000 7f374affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744097a50 0x7f37441340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.848+0000 7f374affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744097a50 0x7f37441340b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60194/0 (socket says 10.20.193.28:60194) 2026-02-20T03:28:10.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.848+0000 7f374affd640 1 -- 10.20.193.28:0/3046316896 learned_addr learned my addr 10.20.193.28:0/3046316896 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.848+0000 7f374affd640 1 -- 10.20.193.28:0/3046316896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3744099600 msgr2=0x7f374413b660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:10.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.848+0000 7f374affd640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3744099600 0x7f374413b660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.848+0000 7f374affd640 1 -- 10.20.193.28:0/3046316896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3744098c40 msgr2=0x7f37441345f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:10.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.848+0000 7f374affd640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3744098c40 0x7f37441345f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.848+0000 7f374affd640 1 -- 10.20.193.28:0/3046316896 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374413bd60 con 0x7f3744097a50 2026-02-20T03:28:10.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.849+0000 7f374affd640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744097a50 0x7f37441340b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f373c00b9e0 tx=0x7f373c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.849+0000 7f372bfff640 1 -- 10.20.193.28:0/3046316896 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c00c7c0 con 0x7f3744097a50 2026-02-20T03:28:10.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.849+0000 7f372bfff640 1 -- 10.20.193.28:0/3046316896 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f373c010070 con 0x7f3744097a50 2026-02-20T03:28:10.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.849+0000 7f372bfff640 1 -- 10.20.193.28:0/3046316896 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c015470 con 0x7f3744097a50 2026-02-20T03:28:10.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.849+0000 7f374bfff640 1 -- 10.20.193.28:0/3046316896 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374413bff0 con 0x7f3744097a50 2026-02-20T03:28:10.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.849+0000 7f374bfff640 1 -- 10.20.193.28:0/3046316896 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374413c490 con 0x7f3744097a50 2026-02-20T03:28:10.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.854+0000 7f37541f5e00 1 Processor -- start 2026-02-20T03:28:10.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.854+0000 7f37541f5e00 1 -- start start 2026-02-20T03:28:10.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.854+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6d2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.854+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2a20 0x55d39b6d6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.854+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6d9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.855+0000 7f372bfff640 1 -- 10.20.193.28:0/3046316896 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f373c01d020 con 0x7f3744097a50 2026-02-20T03:28:10.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.855+0000 7f37541f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d39b6228f0 con 0x55d39b6d2050 2026-02-20T03:28:10.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.855+0000 7f37541f5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d39b5d02e0 con 0x55d39b6d7590 2026-02-20T03:28:10.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.855+0000 7f37541f5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d39b61e820 con 0x55d39b6d2a20 2026-02-20T03:28:10.858 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.855+0000 7f374b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6d2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.855+0000 7f374b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6d2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60208/0 (socket says 10.20.193.28:60208) 2026-02-20T03:28:10.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.855+0000 7f374b7fe640 1 -- 10.20.193.28:0/2613099127 learned_addr learned my addr 10.20.193.28:0/2613099127 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.856+0000 7f374a7fc640 1 --2- 10.20.193.28:0/2613099127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6d9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.856+0000 7f374affd640 1 --2- 10.20.193.28:0/2613099127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2a20 0x55d39b6d6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.856+0000 7f374a7fc640 1 -- 10.20.193.28:0/2613099127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2a20 msgr2=0x55d39b6d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.856+0000 7f374a7fc640 1 --2- 10.20.193.28:0/2613099127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2a20 0x55d39b6d6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.856+0000 7f374a7fc640 1 -- 10.20.193.28:0/2613099127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 msgr2=0x55d39b6d2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.856+0000 7f374a7fc640 1 --2- 10.20.193.28:0/2613099127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6d2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.860 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.857+0000 7f374a7fc640 1 -- 10.20.193.28:0/2613099127 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39b5c25a0 con 0x55d39b6d7590 2026-02-20T03:28:10.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.857+0000 7f374a7fc640 1 --2- 10.20.193.28:0/2613099127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6d9a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3740009780 tx=0x7f3740009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d36023ee4c30d7c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.856+0000 7f372bfff640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f371c0b0ef0 0x7f371c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.857+0000 7f37293fe640 1 -- 10.20.193.28:0/2613099127 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740016070 con 0x55d39b6d7590 2026-02-20T03:28:10.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.858+0000 7f372bfff640 1 -- 10.20.193.28:0/3046316896 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f373c0dffd0 con 0x7f3744097a50 2026-02-20T03:28:10.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.858+0000 7f374b7fe640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f371c0b0ef0 0x7f371c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.858+0000 7f37293fe640 1 -- 10.20.193.28:0/2613099127 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3740004480 con 0x55d39b6d7590 2026-02-20T03:28:10.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.858+0000 7f37541f5e00 1 -- 10.20.193.28:0/2613099127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 msgr2=0x55d39b6d9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.858+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2613099127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6d9a20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3740009780 tx=0x7f3740009c50 comp rx=0 tx=0).stop 2026-02-20T03:28:10.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.858+0000 7f374b7fe640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f371c0b0ef0 0x7f371c0b33b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3734002c90 tx=0x7f3734005830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.859+0000 7f37541f5e00 1 -- 10.20.193.28:0/2613099127 shutdown_connections 2026-02-20T03:28:10.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.859+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2613099127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6d9a20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.859+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2613099127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2a20 0x55d39b6d6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.859+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2613099127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6d2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.859+0000 7f37541f5e00 1 -- 10.20.193.28:0/2613099127 >> 10.20.193.28:0/2613099127 conn(0x55d39b6c98c0 msgr2=0x55d39b6d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.859+0000 7f37541f5e00 1 -- 10.20.193.28:0/2613099127 shutdown_connections 2026-02-20T03:28:10.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.859+0000 7f37541f5e00 1 -- 10.20.193.28:0/2613099127 wait complete. 2026-02-20T03:28:10.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.861+0000 7f37541f5e00 1 -- start start 2026-02-20T03:28:10.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.861+0000 7f37541f5e00 1 Processor -- start 2026-02-20T03:28:10.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.861+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 0x55d39b6ea960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.861+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.861+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.861+0000 7f37541f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d39b5ca0c0 con 0x55d39b6d2a20 2026-02-20T03:28:10.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.861+0000 7f37541f5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d39b6da6e0 con 0x55d39b6d7590 2026-02-20T03:28:10.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.861+0000 7f37541f5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d39b6f23b0 con 0x55d39b6d2050 2026-02-20T03:28:10.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.862+0000 7f374affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 0x55d39b6ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.862+0000 7f374b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.862+0000 7f374affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 0x55d39b6ea960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:44562/0 (socket says 10.20.193.28:44562) 2026-02-20T03:28:10.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.862+0000 7f374affd640 1 -- 10.20.193.28:0/1063343268 learned_addr learned my addr 10.20.193.28:0/1063343268 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.862+0000 7f374a7fc640 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f374a7fc640 1 -- 10.20.193.28:0/1063343268 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 msgr2=0x55d39b6ea960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f374a7fc640 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 0x55d39b6ea960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f374a7fc640 1 -- 10.20.193.28:0/1063343268 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 msgr2=0x55d39b6f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f374a7fc640 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6f1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f374a7fc640 1 -- 10.20.193.28:0/1063343268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39b6e4090 con 0x55d39b6d2a20 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f374a7fc640 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6eaea0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f3740009780 tx=0x7f3740002e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b6cae218aa0002 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f3720bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f3720bfc640 1 -- 10.20.193.28:0/1063343268 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374001e070 con 0x55d39b6d2a20 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f3720bfc640 1 -- 10.20.193.28:0/1063343268 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3740004630 con 0x55d39b6d2a20 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f3720bfc640 1 -- 10.20.193.28:0/1063343268 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740016040 con 0x55d39b6d2a20 2026-02-20T03:28:10.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.863+0000 7f37541f5e00 1 -- 10.20.193.28:0/1063343268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39b5de820 con 0x55d39b6d2a20 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f3720bfc640 1 -- 10.20.193.28:0/1063343268 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f374001ae00 con 0x55d39b6d2a20 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 10 client.19122 _ll_register_callbacks cb 0x55d39b5cdff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 1 -- 10.20.193.28:0/1063343268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d39b62a4e0 con 0x55d39b6d2a20 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f3720bfc640 1 -- 10.20.193.28:0/1063343268 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f37400092a0 con 0x55d39b6d2a20 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 10 client.19122 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 1 -- 10.20.193.28:0/1063343268 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d39b5e3380 con 0x55d39b6d2a20 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f3720bfc640 1 -- 10.20.193.28:0/1063343268 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f374001a400 con 0x55d39b6d2a20 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 10 client.19122 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 10 client.19122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 20 client.19122 populate_metadata read hostname 'trial028' 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d39b6f63c0 0x55d39b6f8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 4 client.19122 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:10.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.864+0000 7f37541f5e00 1 -- 10.20.193.28:0/1063343268 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d39b5a4bd0 con 0x55d39b6f63c0 2026-02-20T03:28:10.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.866+0000 7f374affd640 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d39b6f63c0 0x55d39b6f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.867+0000 7f374affd640 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d39b6f63c0 0x55d39b6f8850 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=252a225ecdc4f43c server_cookie=1db5ce731f332804 in_seq=0 out_seq=0 2026-02-20T03:28:10.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.867+0000 7f3720bfc640 10 client.19122 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:10.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.868+0000 7f3720bfc640 1 -- 10.20.193.28:0/1063343268 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d39b5a4bd0 con 0x55d39b6f63c0 2026-02-20T03:28:10.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.868+0000 7f3720bfc640 10 client.19122 handle_command_reply: tid=0 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.868+0000 7f37541f5e00 1 client.19122 shutdown 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.868+0000 7f37541f5e00 1 -- 10.20.193.28:0/1063343268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 msgr2=0x55d39b6eaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.868+0000 7f37541f5e00 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6eaea0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f3740009780 tx=0x7f3740002e50 comp rx=0 tx=0).stop 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.869+0000 7f37541f5e00 1 -- 10.20.193.28:0/1063343268 shutdown_connections 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.869+0000 7f37541f5e00 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d39b6f63c0 0x55d39b6f8850 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.869+0000 7f37541f5e00 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.869+0000 7f3720bfc640 0 client.19122 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.869+0000 7f37541f5e00 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6eaea0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.869+0000 7f37541f5e00 1 --2- 10.20.193.28:0/1063343268 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 0x55d39b6ea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.869+0000 7f37541f5e00 1 -- 10.20.193.28:0/1063343268 >> 10.20.193.28:0/1063343268 conn(0x55d39b6c98c0 msgr2=0x55d39b6d88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.869+0000 7f37541f5e00 1 -- 10.20.193.28:0/1063343268 shutdown_connections 2026-02-20T03:28:10.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.869+0000 7f37541f5e00 1 -- 10.20.193.28:0/1063343268 wait complete. 2026-02-20T03:28:10.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.870+0000 7f37541f5e00 20 client.19122 trim_cache size 0 max 16384 2026-02-20T03:28:10.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f37541f5e00 1 Processor -- start 2026-02-20T03:28:10.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f37541f5e00 1 -- start start 2026-02-20T03:28:10.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d2a20 0x55d39b6f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d7590 0x55d39b6d8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f37541f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f36f00126a0 con 0x55d39b6d2050 2026-02-20T03:28:10.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f37541f5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f36f000ff70 con 0x55d39b6d2a20 2026-02-20T03:28:10.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f37541f5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36f000ddc0 con 0x55d39b6d7590 2026-02-20T03:28:10.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f374affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f374affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60224/0 (socket says 10.20.193.28:60224) 2026-02-20T03:28:10.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.879+0000 7f374affd640 1 -- 10.20.193.28:0/2383382418 learned_addr learned my addr 10.20.193.28:0/2383382418 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.880+0000 7f374affd640 1 -- 10.20.193.28:0/2383382418 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d7590 msgr2=0x55d39b6d8980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:10.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.880+0000 7f374affd640 1 --2- 10.20.193.28:0/2383382418 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d7590 0x55d39b6d8980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.880+0000 7f374affd640 1 -- 10.20.193.28:0/2383382418 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d2a20 msgr2=0x55d39b6f1de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:10.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.880+0000 7f374affd640 1 --2- 10.20.193.28:0/2383382418 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d2a20 0x55d39b6f1de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.880+0000 7f374affd640 1 -- 10.20.193.28:0/2383382418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39b6e3ec0 con 0x55d39b6d2050 2026-02-20T03:28:10.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.880+0000 7f374affd640 1 --2- 10.20.193.28:0/2383382418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6ca760 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f373c0a3bc0 tx=0x7f373c0dd570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3290629f00349620 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f3728bfd640 1 -- 10.20.193.28:0/2383382418 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0a72b0 con 0x55d39b6d2050 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f3728bfd640 1 -- 10.20.193.28:0/2383382418 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f373c0a8490 con 0x55d39b6d2050 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f3728bfd640 1 -- 10.20.193.28:0/2383382418 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373c0e3e60 con 0x55d39b6d2050 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f37541f5e00 1 -- 10.20.193.28:0/2383382418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 msgr2=0x55d39b6ca760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2383382418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6ca760 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f373c0a3bc0 tx=0x7f373c0dd570 comp rx=0 tx=0).stop 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f37541f5e00 1 -- 10.20.193.28:0/2383382418 shutdown_connections 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2383382418 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d7590 0x55d39b6d8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2383382418 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d2a20 0x55d39b6f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2383382418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2050 0x55d39b6ca760 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.881+0000 7f37541f5e00 1 -- 10.20.193.28:0/2383382418 >> 10.20.193.28:0/2383382418 conn(0x55d39b6c98c0 msgr2=0x55d39b6ea020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.882+0000 7f37541f5e00 1 -- 10.20.193.28:0/2383382418 shutdown_connections 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.882+0000 7f37541f5e00 1 -- 10.20.193.28:0/2383382418 wait complete. 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.882+0000 7f37541f5e00 1 -- start start 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.882+0000 7f37541f5e00 1 Processor -- start 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.882+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 0x55d39b6f0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.882+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6f0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f37541f5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f37541f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f36f000e430 con 0x55d39b6d2a20 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f37541f5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f36f000f8a0 con 0x55d39b6d7590 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f37541f5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36f000eb00 con 0x55d39b6d2050 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f374a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f374a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6f0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60228/0 (socket says 10.20.193.28:60228) 2026-02-20T03:28:10.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f374a7fc640 1 -- 10.20.193.28:0/2814951938 learned_addr learned my addr 10.20.193.28:0/2814951938 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f374a7fc640 1 -- 10.20.193.28:0/2814951938 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 msgr2=0x55d39b6f0000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f374a7fc640 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 0x55d39b6f0000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f374a7fc640 1 -- 10.20.193.28:0/2814951938 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 msgr2=0x55d39b6f0a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f374a7fc640 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6f0a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f374a7fc640 1 -- 10.20.193.28:0/2814951938 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39b382690 con 0x55d39b6d2a20 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f374a7fc640 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6f0540 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f374000b000 tx=0x7f374000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9615bd2382143c41 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.883+0000 7f3720bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.884+0000 7f3720bfc640 1 -- 10.20.193.28:0/2814951938 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3740030020 con 0x55d39b6d2a20 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.884+0000 7f3720bfc640 1 -- 10.20.193.28:0/2814951938 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d39b62a4e0 con 0x55d39b6d2a20 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.884+0000 7f3720bfc640 1 -- 10.20.193.28:0/2814951938 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374001e040 con 0x55d39b6d2a20 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.884+0000 7f37541f5e00 1 -- 10.20.193.28:0/2814951938 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39b5e7b70 con 0x55d39b6d2a20 2026-02-20T03:28:10.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.884+0000 7f3720bfc640 1 -- 10.20.193.28:0/2814951938 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f3740023610 con 0x55d39b6d2a20 2026-02-20T03:28:10.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.884+0000 7f37541f5e00 10 client.19128 _ll_register_callbacks cb 0x7f3740009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:10.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.884+0000 7f37541f5e00 1 -- 10.20.193.28:0/2814951938 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3740004480 con 0x55d39b6d2a20 2026-02-20T03:28:10.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.888+0000 7f3720bfc640 1 -- 10.20.193.28:0/2814951938 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f374001ae20 con 0x55d39b6d2a20 2026-02-20T03:28:10.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.888+0000 7f37541f5e00 10 client.19128 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:10.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.888+0000 7f37541f5e00 1 -- 10.20.193.28:0/2814951938 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d39b6e4bb0 con 0x55d39b6d2a20 2026-02-20T03:28:10.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.890+0000 7f3720bfc640 1 -- 10.20.193.28:0/2814951938 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f374001a860 con 0x55d39b6d2a20 2026-02-20T03:28:10.899 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.890+0000 7f37541f5e00 10 client.19128 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:10.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.890+0000 7f37541f5e00 10 client.19128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:10.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.890+0000 7f37541f5e00 20 client.19128 populate_metadata read hostname 'trial028' 2026-02-20T03:28:10.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.890+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d39b6f63c0 0x55d39b763880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:10.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.890+0000 7f37541f5e00 4 client.19128 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:28:10.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.890+0000 7f37541f5e00 1 -- 10.20.193.28:0/2814951938 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d39b3fb520 con 0x55d39b6f63c0 2026-02-20T03:28:10.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.901+0000 7f374affd640 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d39b6f63c0 0x55d39b763880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:10.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.902+0000 7f374affd640 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d39b6f63c0 0x55d39b763880 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53bf24cb05176a2 server_cookie=130ed36e187b820 in_seq=0 out_seq=0 2026-02-20T03:28:10.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.902+0000 7f3720bfc640 10 client.19128 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:10.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f3720bfc640 1 -- 10.20.193.28:0/2814951938 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d39b3fb520 con 0x55d39b6f63c0 2026-02-20T03:28:10.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f3720bfc640 10 client.19128 handle_command_reply: tid=0 2026-02-20T03:28:10.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f37541f5e00 1 client.19128 shutdown 2026-02-20T03:28:10.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f37541f5e00 1 -- 10.20.193.28:0/2814951938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 msgr2=0x55d39b6f0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:10.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6f0540 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f374000b000 tx=0x7f374000b4b0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f37541f5e00 1 -- 10.20.193.28:0/2814951938 shutdown_connections 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d39b6f63c0 0x55d39b763880 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d39b6d7590 0x55d39b6f0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d39b6d2a20 0x55d39b6f0540 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.993+0000 7f37541f5e00 1 --2- 10.20.193.28:0/2814951938 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d39b6d2050 0x55d39b6f0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f37541f5e00 1 -- 10.20.193.28:0/2814951938 >> 10.20.193.28:0/2814951938 conn(0x55d39b6c98c0 msgr2=0x55d39b6ea840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f3720bfc640 0 client.19128 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f37541f5e00 1 -- 10.20.193.28:0/2814951938 shutdown_connections 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f37541f5e00 1 -- 10.20.193.28:0/2814951938 wait complete. 2026-02-20T03:28:10.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f37541f5e00 20 client.19128 trim_cache size 0 max 16384 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 -- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f371c0b0ef0 msgr2=0x7f371c0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f371c0b0ef0 0x7f371c0b33b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3734002c90 tx=0x7f3734005830 comp rx=0 tx=0).stop 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 -- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744097a50 msgr2=0x7f37441340b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744097a50 0x7f37441340b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f373c00b9e0 tx=0x7f373c00beb0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 -- 10.20.193.28:0/3046316896 shutdown_connections 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f371c0b0ef0 0x7f371c0b33b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3744099600 0x7f374413b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3744098c40 0x7f37441345f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 --2- 10.20.193.28:0/3046316896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3744097a50 0x7f37441340b0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.994+0000 7f374bfff640 1 -- 10.20.193.28:0/3046316896 >> 10.20.193.28:0/3046316896 conn(0x7f37440931d0 msgr2=0x7f374400c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.995+0000 7f374bfff640 1 -- 10.20.193.28:0/3046316896 shutdown_connections 2026-02-20T03:28:11.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:10.995+0000 7f374bfff640 1 -- 10.20.193.28:0/3046316896 wait complete. 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.105+0000 7fa2c710a640 1 -- 10.20.193.28:0/4240766261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c0108700 msgr2=0x7fa2c0108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.105+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4240766261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c0108700 0x7fa2c0108ae0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009a60 tx=0x7fa2b002f290 comp rx=0 tx=0).stop 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.105+0000 7fa2c710a640 1 -- 10.20.193.28:0/4240766261 shutdown_connections 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.105+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4240766261 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2c01030a0 0x7fa2c010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.105+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4240766261 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2c0102700 0x7fa2c0102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.105+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4240766261 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c0108700 0x7fa2c0108ae0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.105+0000 7fa2c710a640 1 -- 10.20.193.28:0/4240766261 >> 10.20.193.28:0/4240766261 conn(0x7fa2c00fe440 msgr2=0x7fa2c0100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.106+0000 7fa2c710a640 1 -- 10.20.193.28:0/4240766261 shutdown_connections 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.106+0000 7fa2c710a640 1 -- 10.20.193.28:0/4240766261 wait complete. 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.106+0000 7fa2c710a640 1 Processor -- start 2026-02-20T03:28:11.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.106+0000 7fa2c710a640 1 -- start start 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c710a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2c0102700 0x7fa2c0109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c710a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c01030a0 0x7fa2c0109b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c710a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2c0108700 0x7fa2c010a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c710a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c0112a00 con 0x7fa2c01030a0 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c710a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c0112880 con 0x7fa2c0102700 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c710a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c0112b80 con 0x7fa2c0108700 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c5907640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c01030a0 0x7fa2c0109b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c5907640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c01030a0 0x7fa2c0109b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60248/0 (socket says 10.20.193.28:60248) 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c5907640 1 -- 10.20.193.28:0/4095350568 learned_addr learned my addr 10.20.193.28:0/4095350568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c5907640 1 -- 10.20.193.28:0/4095350568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2c0108700 msgr2=0x7fa2c010a0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c5907640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2c0108700 0x7fa2c010a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c5907640 1 -- 10.20.193.28:0/4095350568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2c0102700 msgr2=0x7fa2c0109630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c5907640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2c0102700 0x7fa2c0109630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c5907640 1 -- 10.20.193.28:0/4095350568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c01ada40 con 0x7fa2c01030a0 2026-02-20T03:28:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.107+0000 7fa2c5907640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c01030a0 0x7fa2c0109b70 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400b5a0 tx=0x7fa2b400ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.108+0000 7fa2a77fe640 1 -- 10.20.193.28:0/4095350568 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b4012070 con 0x7fa2c01030a0 2026-02-20T03:28:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.108+0000 7fa2a77fe640 1 -- 10.20.193.28:0/4095350568 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa2b4004480 con 0x7fa2c01030a0 2026-02-20T03:28:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.108+0000 7fa2a77fe640 1 -- 10.20.193.28:0/4095350568 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b400dac0 con 0x7fa2c01030a0 2026-02-20T03:28:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.108+0000 7fa2c710a640 1 -- 10.20.193.28:0/4095350568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c01add30 con 0x7fa2c01030a0 2026-02-20T03:28:11.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.108+0000 7fa2c710a640 1 -- 10.20.193.28:0/4095350568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c01ae1c0 con 0x7fa2c01030a0 2026-02-20T03:28:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2a77fe640 1 -- 10.20.193.28:0/4095350568 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa2b400dc80 con 0x7fa2c01030a0 2026-02-20T03:28:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2ca898e00 1 Processor -- start 2026-02-20T03:28:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2ca898e00 1 -- start start 2026-02-20T03:28:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f483e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f42630 0x5564f8f42a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 0x5564f8f4ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5564f8ec2e50 con 0x5564f8f48000 2026-02-20T03:28:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5564f8e959c0 con 0x5564f8f42630 2026-02-20T03:28:11.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5564f8e43240 con 0x5564f8f42fb0 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.111+0000 7fa2c6909640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2c6909640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60264/0 (socket says 10.20.193.28:60264) 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2c6909640 1 -- 10.20.193.28:0/1706866568 learned_addr learned my addr 10.20.193.28:0/1706866568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2c6909640 1 -- 10.20.193.28:0/1706866568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 msgr2=0x5564f8f4ee30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2c6909640 1 --2- 10.20.193.28:0/1706866568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 0x5564f8f4ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2c6909640 1 -- 10.20.193.28:0/1706866568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f42630 msgr2=0x5564f8f42a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2c6909640 1 --2- 10.20.193.28:0/1706866568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f42630 0x5564f8f42a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2c6909640 1 -- 10.20.193.28:0/1706866568 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f8e56420 con 0x5564f8f48000 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2c6909640 1 --2- 10.20.193.28:0/1706866568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f483e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009d20 tx=0x7fa2bc00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389ff5d039077d27 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2a77fe640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa29c0b0ef0 0x7fa29c0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2a77fe640 1 -- 10.20.193.28:0/4095350568 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fa2b40dffe0 con 0x7fa2c01030a0 2026-02-20T03:28:11.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2a4a08640 1 -- 10.20.193.28:0/1706866568 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc017070 con 0x5564f8f48000 2026-02-20T03:28:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2a4a08640 1 -- 10.20.193.28:0/1706866568 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa2bc00bd50 con 0x5564f8f48000 2026-02-20T03:28:11.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.112+0000 7fa2a4a08640 1 -- 10.20.193.28:0/1706866568 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc006e60 con 0x5564f8f48000 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2ca898e00 1 -- 10.20.193.28:0/1706866568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 msgr2=0x5564f8f483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/1706866568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f483e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009d20 tx=0x7fa2bc00b420 comp rx=0 tx=0).stop 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2c6108640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa29c0b0ef0 0x7fa29c0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2ca898e00 1 -- 10.20.193.28:0/1706866568 shutdown_connections 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/1706866568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 0x5564f8f4ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/1706866568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f42630 0x5564f8f42a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/1706866568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f483e0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2ca898e00 1 -- 10.20.193.28:0/1706866568 >> 10.20.193.28:0/1706866568 conn(0x5564f8f05290 msgr2=0x5564f8f40d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2ca898e00 1 -- 10.20.193.28:0/1706866568 shutdown_connections 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2ca898e00 1 -- 10.20.193.28:0/1706866568 wait complete. 2026-02-20T03:28:11.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.113+0000 7fa2c6108640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa29c0b0ef0 0x7fa29c0b33b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009950 tx=0x7fa2b00023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.114+0000 7fa2ca898e00 1 -- start start 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.114+0000 7fa2ca898e00 1 Processor -- start 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.115+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f5d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.115+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 0x5564f8f5d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.115+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f48000 0x5564f8f5b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.115+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5564f8e918f0 con 0x5564f8f42630 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.115+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5564f8c83f50 con 0x5564f8f48000 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.115+0000 7fa2c6108640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f5d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.115+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5564f8f5bb20 con 0x5564f8f42fb0 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.115+0000 7fa2c6108640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f5d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60278/0 (socket says 10.20.193.28:60278) 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.115+0000 7fa2c6108640 1 -- 10.20.193.28:0/3320782705 learned_addr learned my addr 10.20.193.28:0/3320782705 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:11.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa2c6108640 1 -- 10.20.193.28:0/3320782705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 msgr2=0x5564f8f5d5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:11.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa2c6108640 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 0x5564f8f5d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa2c6108640 1 -- 10.20.193.28:0/3320782705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f48000 msgr2=0x5564f8f5b590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa2c6108640 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f48000 0x5564f8f5b590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa2c6108640 1 -- 10.20.193.28:0/3320782705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f8f54bc0 con 0x5564f8f42630 2026-02-20T03:28:11.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa2c6108640 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f5d090 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0002760 tx=0x7fa2b002f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cba8305bf35a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa273fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa273fff640 1 -- 10.20.193.28:0/3320782705 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0051070 con 0x5564f8f42630 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa273fff640 1 -- 10.20.193.28:0/3320782705 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa2b0033040 con 0x5564f8f42630 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa273fff640 1 -- 10.20.193.28:0/3320782705 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0042660 con 0x5564f8f42630 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.116+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3320782705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f8c66b40 con 0x5564f8f42630 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa273fff640 1 -- 10.20.193.28:0/3320782705 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fa2b0042800 con 0x5564f8f42630 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 10 client.19140 _ll_register_callbacks cb 0x5564f8ecef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3320782705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564f8ea31a0 con 0x5564f8f42630 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa273fff640 1 -- 10.20.193.28:0/3320782705 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa2b0042a00 con 0x5564f8f42630 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 10 client.19140 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3320782705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5564f8e50230 con 0x5564f8f42630 2026-02-20T03:28:11.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa273fff640 1 -- 10.20.193.28:0/3320782705 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa2b0042ba0 con 0x5564f8f42630 2026-02-20T03:28:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 10 client.19140 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 10 client.19140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 20 client.19140 populate_metadata read hostname 'trial028' 2026-02-20T03:28:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564f8f6b7d0 0x5564f8f6dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 4 client.19140 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:11.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.117+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3320782705 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564f8e9d5b0 con 0x5564f8f6b7d0 2026-02-20T03:28:11.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.141+0000 7fa2c5907640 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564f8f6b7d0 0x5564f8f6dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:11.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.208+0000 7fa2c5907640 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564f8f6b7d0 0x5564f8f6dc60 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51318f9dd4d2b78e server_cookie=d5116f1082e2f750 in_seq=0 out_seq=0 2026-02-20T03:28:11.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.208+0000 7fa273fff640 10 client.19140 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:11.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa273fff640 1 -- 10.20.193.28:0/3320782705 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5564f8e9d5b0 con 0x5564f8f6b7d0 2026-02-20T03:28:11.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa273fff640 10 client.19140 handle_command_reply: tid=0 2026-02-20T03:28:11.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 client.19140 shutdown 2026-02-20T03:28:11.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3320782705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 msgr2=0x5564f8f5d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:11.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f5d090 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0002760 tx=0x7fa2b002f290 comp rx=0 tx=0).stop 2026-02-20T03:28:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3320782705 shutdown_connections 2026-02-20T03:28:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564f8f6b7d0 0x5564f8f6dc60 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f48000 0x5564f8f5b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 0x5564f8f5d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3320782705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f5d090 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3320782705 >> 10.20.193.28:0/3320782705 conn(0x5564f8f05290 msgr2=0x5564f8f41440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:11.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa273fff640 0 client.19140 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:11.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3320782705 shutdown_connections 2026-02-20T03:28:11.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3320782705 wait complete. 2026-02-20T03:28:11.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.222+0000 7fa2ca898e00 20 client.19140 trim_cache size 0 max 16384 2026-02-20T03:28:11.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2ca898e00 1 Processor -- start 2026-02-20T03:28:11.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2ca898e00 1 -- start start 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42630 0x5564f8f3ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f42fb0 0x5564f8f5a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f73530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2680127c0 con 0x5564f8f48000 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa268010090 con 0x5564f8f42fb0 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa26800dee0 con 0x5564f8f42630 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2c6909640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f73530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2c6909640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f73530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60284/0 (socket says 10.20.193.28:60284) 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.231+0000 7fa2c6909640 1 -- 10.20.193.28:0/3139581851 learned_addr learned my addr 10.20.193.28:0/3139581851 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2c6909640 1 -- 10.20.193.28:0/3139581851 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42630 msgr2=0x5564f8f3ad50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:11.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2c6909640 1 --2- 10.20.193.28:0/3139581851 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42630 0x5564f8f3ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2c6909640 1 -- 10.20.193.28:0/3139581851 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f42fb0 msgr2=0x5564f8f5a4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2c6909640 1 --2- 10.20.193.28:0/3139581851 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f42fb0 0x5564f8f5a4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2c6909640 1 -- 10.20.193.28:0/3139581851 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f8f549f0 con 0x5564f8f48000 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2c6909640 1 --2- 10.20.193.28:0/3139581851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f73530 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009a70 tx=0x7fa2bc009aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9b78b33db8429a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa28e4e6640 1 -- 10.20.193.28:0/3139581851 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc017070 con 0x5564f8f48000 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa28e4e6640 1 -- 10.20.193.28:0/3139581851 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa2bc018040 con 0x5564f8f48000 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa28e4e6640 1 -- 10.20.193.28:0/3139581851 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc004a30 con 0x5564f8f48000 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3139581851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 msgr2=0x5564f8f73530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3139581851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f73530 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009a70 tx=0x7fa2bc009aa0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3139581851 shutdown_connections 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3139581851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f48000 0x5564f8f73530 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3139581851 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f42fb0 0x5564f8f5a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/3139581851 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42630 0x5564f8f3ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3139581851 >> 10.20.193.28:0/3139581851 conn(0x5564f8f05290 msgr2=0x5564f8f59d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3139581851 shutdown_connections 2026-02-20T03:28:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.232+0000 7fa2ca898e00 1 -- 10.20.193.28:0/3139581851 wait complete. 2026-02-20T03:28:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.233+0000 7fa2ca898e00 1 -- start start 2026-02-20T03:28:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.233+0000 7fa2ca898e00 1 Processor -- start 2026-02-20T03:28:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f63780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 0x5564f8f5faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2ca898e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f48000 0x5564f8f60030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa26800e550 con 0x5564f8f42630 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa26800f9c0 con 0x5564f8f48000 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2ca898e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa26800ec20 con 0x5564f8f42fb0 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2c6108640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f63780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2c6108640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f63780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60290/0 (socket says 10.20.193.28:60290) 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2c6108640 1 -- 10.20.193.28:0/2274147215 learned_addr learned my addr 10.20.193.28:0/2274147215 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2c6108640 1 -- 10.20.193.28:0/2274147215 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 msgr2=0x5564f8f5faf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2c6108640 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 0x5564f8f5faf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2c6108640 1 -- 10.20.193.28:0/2274147215 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f48000 msgr2=0x5564f8f60030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2c6108640 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f48000 0x5564f8f60030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2c6108640 1 -- 10.20.193.28:0/2274147215 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f8b74870 con 0x5564f8f42630 2026-02-20T03:28:11.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2c6108640 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f63780 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00387c0 tx=0x7fa2b00426d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627278c208e3db4e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa273fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa273fff640 1 -- 10.20.193.28:0/2274147215 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0051070 con 0x5564f8f42630 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa273fff640 1 -- 10.20.193.28:0/2274147215 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5564f8ea31a0 con 0x5564f8f42630 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa273fff640 1 -- 10.20.193.28:0/2274147215 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b005e9b0 con 0x5564f8f42630 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.234+0000 7fa2ca898e00 1 -- 10.20.193.28:0/2274147215 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f8e35440 con 0x5564f8f42630 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 10 client.19146 _ll_register_callbacks cb 0x7fa2b0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 1 -- 10.20.193.28:0/2274147215 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564f8e47b00 con 0x5564f8f42630 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa273fff640 1 -- 10.20.193.28:0/2274147215 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fa2b0004440 con 0x5564f8f42630 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa273fff640 1 -- 10.20.193.28:0/2274147215 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa2b0042840 con 0x5564f8f42630 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 10 client.19146 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 1 -- 10.20.193.28:0/2274147215 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x5564f8f556e0 con 0x5564f8f42630 2026-02-20T03:28:11.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa273fff640 1 -- 10.20.193.28:0/2274147215 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa2b005eb50 con 0x5564f8f42630 2026-02-20T03:28:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 10 client.19146 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 10 client.19146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 20 client.19146 populate_metadata read hostname 'trial028' 2026-02-20T03:28:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564f8fd77b0 0x5564f8fd9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 4 client.19146 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:28:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.235+0000 7fa2ca898e00 1 -- 10.20.193.28:0/2274147215 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa2bc018040 con 0x5564f8fd77b0 2026-02-20T03:28:11.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.262+0000 7fa2c5907640 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564f8fd77b0 0x5564f8fd9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:11.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.329+0000 7fa2c5907640 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564f8fd77b0 0x5564f8fd9c70 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83becd78b8506e4 server_cookie=6bc6ed2cf2e04cce in_seq=0 out_seq=0 2026-02-20T03:28:11.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.329+0000 7fa273fff640 10 client.19146 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:11.345 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:11 trial028 ceph-mon[38552]: pgmap v587: 129 pgs: 129 active+clean; 205 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 635 KiB/s rd, 3.8 MiB/s wr, 310 op/s 2026-02-20T03:28:11.345 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:11 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:28:11.345 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:11 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:11.345 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:11 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:28:11.346 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:11 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:11.346 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:11 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:28:11.346 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:11 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:28:11.346 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:11 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:11.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.342+0000 7fa273fff640 1 -- 10.20.193.28:0/2274147215 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fa2bc018040 con 0x5564f8fd77b0 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.342+0000 7fa273fff640 10 client.19146 handle_command_reply: tid=0 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.342+0000 7fa2ca898e00 1 client.19146 shutdown 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.342+0000 7fa2ca898e00 1 -- 10.20.193.28:0/2274147215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 msgr2=0x5564f8f63780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.342+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f63780 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00387c0 tx=0x7fa2b00426d0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa2ca898e00 1 -- 10.20.193.28:0/2274147215 shutdown_connections 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5564f8fd77b0 0x5564f8fd9c70 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564f8f48000 0x5564f8f60030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564f8f42fb0 0x5564f8f5faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa2ca898e00 1 --2- 10.20.193.28:0/2274147215 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564f8f42630 0x5564f8f63780 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa2ca898e00 1 -- 10.20.193.28:0/2274147215 >> 10.20.193.28:0/2274147215 conn(0x5564f8f05290 msgr2=0x5564f8f5a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:11.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa273fff640 0 client.19146 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:11.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa2ca898e00 1 -- 10.20.193.28:0/2274147215 shutdown_connections 2026-02-20T03:28:11.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa2ca898e00 1 -- 10.20.193.28:0/2274147215 wait complete. 2026-02-20T03:28:11.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.343+0000 7fa2ca898e00 20 client.19146 trim_cache size 0 max 16384 2026-02-20T03:28:11.358 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:28:11.359 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:28:11.359 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:28:11.359 INFO:teuthology.orchestra.run.trial028.stdout: "8d8bfb87-aa02-404e-b3a1-6c1677505277": { 2026-02-20T03:28:11.359 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:28:11.359 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "8d8bfb87-aa02-404e-b3a1-6c1677505277", 2026-02-20T03:28:11.359 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:28:11.359 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:28:11.359 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:28:11.359 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:28:11.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 -- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa29c0b0ef0 msgr2=0x7fa29c0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:11.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa29c0b0ef0 0x7fa29c0b33b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009950 tx=0x7fa2b00023d0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 -- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c01030a0 msgr2=0x7fa2c0109b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c01030a0 0x7fa2c0109b70 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fa2b400b5a0 tx=0x7fa2b400ba70 comp rx=0 tx=0).stop 2026-02-20T03:28:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 -- 10.20.193.28:0/4095350568 shutdown_connections 2026-02-20T03:28:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa29c0b0ef0 0x7fa29c0b33b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2c0108700 0x7fa2c010a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2c01030a0 0x7fa2c0109b70 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 --2- 10.20.193.28:0/4095350568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2c0102700 0x7fa2c0109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 -- 10.20.193.28:0/4095350568 >> 10.20.193.28:0/4095350568 conn(0x7fa2c00fe440 msgr2=0x7fa2c010deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 -- 10.20.193.28:0/4095350568 shutdown_connections 2026-02-20T03:28:11.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:11.344+0000 7fa2c710a640 1 -- 10.20.193.28:0/4095350568 wait complete. 2026-02-20T03:28:11.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1158716 7.97 MB/sec execute 584 sec latency 764.544 ms 2026-02-20T03:28:11.541 INFO:tasks.cephfs.filesystem:scrub status for tag:8d8bfb87-aa02-404e-b3a1-6c1677505277 - {'path': '/', 'tag': '8d8bfb87-aa02-404e-b3a1-6c1677505277', 'options': 'recursive,force'} 2026-02-20T03:28:11.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:11 trial126 ceph-mon[38476]: pgmap v587: 129 pgs: 129 active+clean; 205 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 635 KiB/s rd, 3.8 MiB/s wr, 310 op/s 2026-02-20T03:28:11.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:11 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:28:11.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:11 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:11.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:11 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:28:11.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:11 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:11.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:11 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:28:11.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:11 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:28:11.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:11 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:11 trial177 ceph-mon[43181]: pgmap v587: 129 pgs: 129 active+clean; 205 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 635 KiB/s rd, 3.8 MiB/s wr, 310 op/s 2026-02-20T03:28:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:11 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:28:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:11 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:11 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:28:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:11 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:11 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:28:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:11 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:28:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:11 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:12.394 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:12 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:12.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1158716 7.95 MB/sec execute 585 sec latency 1764.586 ms 2026-02-20T03:28:12.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:12 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:12.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:12 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:13.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:13 trial028 ceph-mon[38552]: pgmap v588: 129 pgs: 129 active+clean; 206 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 540 KiB/s rd, 3.1 MiB/s wr, 240 op/s 2026-02-20T03:28:13.529 INFO:tasks.workunit.client.0.trial028.stdout: 1 1158716 7.94 MB/sec execute 586 sec latency 2764.626 ms 2026-02-20T03:28:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:13 trial177 ceph-mon[43181]: pgmap v588: 129 pgs: 129 active+clean; 206 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 540 KiB/s rd, 3.1 MiB/s wr, 240 op/s 2026-02-20T03:28:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:13 trial126 ceph-mon[38476]: pgmap v588: 129 pgs: 129 active+clean; 206 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 540 KiB/s rd, 3.1 MiB/s wr, 240 op/s 2026-02-20T03:28:14.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1158968 7.93 MB/sec execute 587 sec latency 3292.646 ms 2026-02-20T03:28:15.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1162610 7.95 MB/sec execute 588 sec latency 7.892 ms 2026-02-20T03:28:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:15 trial177 ceph-mon[43181]: pgmap v589: 129 pgs: 129 active+clean; 202 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 610 KiB/s rd, 3.0 MiB/s wr, 255 op/s 2026-02-20T03:28:15.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:15 trial126 ceph-mon[38476]: pgmap v589: 129 pgs: 129 active+clean; 202 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 610 KiB/s rd, 3.0 MiB/s wr, 255 op/s 2026-02-20T03:28:15.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:15 trial028 ceph-mon[38552]: pgmap v589: 129 pgs: 129 active+clean; 202 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 610 KiB/s rd, 3.0 MiB/s wr, 255 op/s 2026-02-20T03:28:16.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1164193 7.95 MB/sec execute 589 sec latency 635.931 ms 2026-02-20T03:28:17.525 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:17 trial028 ceph-mon[38552]: pgmap v590: 129 pgs: 129 active+clean; 198 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 672 KiB/s rd, 3.2 MiB/s wr, 276 op/s 2026-02-20T03:28:17.538 INFO:tasks.workunit.client.0.trial028.stdout: 1 1164193 7.94 MB/sec execute 590 sec latency 1635.972 ms 2026-02-20T03:28:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:17 trial177 ceph-mon[43181]: pgmap v590: 129 pgs: 129 active+clean; 198 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 672 KiB/s rd, 3.2 MiB/s wr, 276 op/s 2026-02-20T03:28:17.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:17 trial126 ceph-mon[38476]: pgmap v590: 129 pgs: 129 active+clean; 198 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 672 KiB/s rd, 3.2 MiB/s wr, 276 op/s 2026-02-20T03:28:18.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1164193 7.92 MB/sec execute 591 sec latency 2636.015 ms 2026-02-20T03:28:18.609 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:28:18.609 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:28:18.609 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:28:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:28:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:28:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:28:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:28:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:28:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:28:19.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1164193 7.91 MB/sec execute 592 sec latency 3636.055 ms 2026-02-20T03:28:19.684 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:19 trial028 ceph-mon[38552]: pgmap v591: 129 pgs: 129 active+clean; 198 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 658 KiB/s rd, 3.0 MiB/s wr, 244 op/s 2026-02-20T03:28:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:19 trial177 ceph-mon[43181]: pgmap v591: 129 pgs: 129 active+clean; 198 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 658 KiB/s rd, 3.0 MiB/s wr, 244 op/s 2026-02-20T03:28:19.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:19 trial126 ceph-mon[38476]: pgmap v591: 129 pgs: 129 active+clean; 198 MiB data, 4.3 GiB used, 8.2 TiB / 8.2 TiB avail; 658 KiB/s rd, 3.0 MiB/s wr, 244 op/s 2026-02-20T03:28:20.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1165421 7.91 MB/sec execute 593 sec latency 4263.189 ms 2026-02-20T03:28:20.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:20 trial177 ceph-mon[43181]: pgmap v592: 129 pgs: 129 active+clean; 206 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 637 KiB/s rd, 3.5 MiB/s wr, 268 op/s 2026-02-20T03:28:20.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:20 trial126 ceph-mon[38476]: pgmap v592: 129 pgs: 129 active+clean; 206 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 637 KiB/s rd, 3.5 MiB/s wr, 268 op/s 2026-02-20T03:28:20.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:20 trial028 ceph-mon[38552]: pgmap v592: 129 pgs: 129 active+clean; 206 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 637 KiB/s rd, 3.5 MiB/s wr, 268 op/s 2026-02-20T03:28:21.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1166843 7.91 MB/sec execute 594 sec latency 525.244 ms 2026-02-20T03:28:22.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1166843 7.89 MB/sec execute 595 sec latency 1525.286 ms 2026-02-20T03:28:23.439 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:23 trial028 ceph-mon[38552]: pgmap v593: 129 pgs: 129 active+clean; 203 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 565 KiB/s rd, 2.8 MiB/s wr, 223 op/s 2026-02-20T03:28:23.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1166860 7.88 MB/sec execute 596 sec latency 2286.930 ms 2026-02-20T03:28:23.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:23 trial126 ceph-mon[38476]: pgmap v593: 129 pgs: 129 active+clean; 203 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 565 KiB/s rd, 2.8 MiB/s wr, 223 op/s 2026-02-20T03:28:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:23 trial177 ceph-mon[43181]: pgmap v593: 129 pgs: 129 active+clean; 203 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 565 KiB/s rd, 2.8 MiB/s wr, 223 op/s 2026-02-20T03:28:24.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- 10.20.193.28:0/2622778690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 msgr2=0x7f81b4103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:24.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 --2- 10.20.193.28:0/2622778690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 0x7f81b4103d20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009a30 tx=0x7f81a402f260 comp rx=0 tx=0).stop 2026-02-20T03:28:24.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- 10.20.193.28:0/2622778690 shutdown_connections 2026-02-20T03:28:24.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 --2- 10.20.193.28:0/2622778690 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81b4104260 0x7f81b410aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.074 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 --2- 10.20.193.28:0/2622778690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 0x7f81b4103d20 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 --2- 10.20.193.28:0/2622778690 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81b41026b0 0x7f81b4102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- 10.20.193.28:0/2622778690 >> 10.20.193.28:0/2622778690 conn(0x7f81b40fde10 msgr2=0x7f81b4100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:24.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- 10.20.193.28:0/2622778690 shutdown_connections 2026-02-20T03:28:24.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- 10.20.193.28:0/2622778690 wait complete. 2026-02-20T03:28:24.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 Processor -- start 2026-02-20T03:28:24.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- start start 2026-02-20T03:28:24.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81b41026b0 0x7f81b419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 0x7f81b419ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81b4104260 0x7f81b41a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f81b410e2c0 con 0x7f81b41038a0 2026-02-20T03:28:24.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f81b410e140 con 0x7f81b41026b0 2026-02-20T03:28:24.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f81b410e440 con 0x7f81b4104260 2026-02-20T03:28:24.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 0x7f81b419ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:24.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 0x7f81b419ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35772/0 (socket says 10.20.193.28:35772) 2026-02-20T03:28:24.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b2ffd640 1 -- 10.20.193.28:0/3323583035 learned_addr learned my addr 10.20.193.28:0/3323583035 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:24.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b2ffd640 1 -- 10.20.193.28:0/3323583035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81b4104260 msgr2=0x7f81b41a1ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:24.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81b4104260 0x7f81b41a1ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b2ffd640 1 -- 10.20.193.28:0/3323583035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81b41026b0 msgr2=0x7f81b419a910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:24.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81b41026b0 0x7f81b419a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b2ffd640 1 -- 10.20.193.28:0/3323583035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b41a25c0 con 0x7f81b41038a0 2026-02-20T03:28:24.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 0x7f81b419ae50 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009950 tx=0x7f81a402fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b0ff9640 1 -- 10.20.193.28:0/3323583035 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4004300 con 0x7f81b41038a0 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b0ff9640 1 -- 10.20.193.28:0/3323583035 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f81a40044a0 con 0x7f81b41038a0 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b0ff9640 1 -- 10.20.193.28:0/3323583035 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4042b00 con 0x7f81b41038a0 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- 10.20.193.28:0/3323583035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b41a2850 con 0x7f81b41038a0 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.070+0000 7f81b8b20640 1 -- 10.20.193.28:0/3323583035 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b41a2d70 con 0x7f81b41038a0 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b0ff9640 1 -- 10.20.193.28:0/3323583035 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f81a404a030 con 0x7f81b41038a0 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 Processor -- start 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- start start 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98390 0x55d9e5a98790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a98cd0 0x55d9e5a9d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a9ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d9e59e48f0 con 0x55d9e5a9da70 2026-02-20T03:28:24.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d9e59922e0 con 0x55d9e5a98390 2026-02-20T03:28:24.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9e59e0820 con 0x55d9e5a98cd0 2026-02-20T03:28:24.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a9ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:24.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a9ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35788/0 (socket says 10.20.193.28:35788) 2026-02-20T03:28:24.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b2ffd640 1 -- 10.20.193.28:0/569872254 learned_addr learned my addr 10.20.193.28:0/569872254 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:24.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b2ffd640 1 -- 10.20.193.28:0/569872254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a98cd0 msgr2=0x55d9e5a9d450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:24.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/569872254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a98cd0 0x55d9e5a9d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b2ffd640 1 -- 10.20.193.28:0/569872254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98390 msgr2=0x55d9e5a98790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:24.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/569872254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98390 0x55d9e5a98790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b2ffd640 1 -- 10.20.193.28:0/569872254 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e59845a0 con 0x55d9e5a9da70 2026-02-20T03:28:24.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/569872254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a9ff00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f81a410d4b0 tx=0x7f81a410d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a171a5b2d2a6efe3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:24.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b0ff9640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81880b0e20 0x7f81880b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f817f7fe640 1 -- 10.20.193.28:0/569872254 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40cc6a0 con 0x55d9e5a9da70 2026-02-20T03:28:24.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f817f7fe640 1 -- 10.20.193.28:0/569872254 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f81a4112030 con 0x55d9e5a9da70 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f817f7fe640 1 -- 10.20.193.28:0/569872254 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40cc8f0 con 0x55d9e5a9da70 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b0ff9640 1 -- 10.20.193.28:0/3323583035 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f81a41050d0 con 0x7f81b41038a0 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- 10.20.193.28:0/569872254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 msgr2=0x55d9e5a9ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/569872254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a9ff00 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f81a410d4b0 tx=0x7f81a410d980 comp rx=0 tx=0).stop 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b3fff640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81880b0e20 0x7f81880b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- 10.20.193.28:0/569872254 shutdown_connections 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/569872254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a9ff00 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/569872254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a98cd0 0x55d9e5a9d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/569872254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98390 0x55d9e5a98790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- 10.20.193.28:0/569872254 >> 10.20.193.28:0/569872254 conn(0x55d9e5a8b6f0 msgr2=0x55d9e5a96a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:24.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- 10.20.193.28:0/569872254 shutdown_connections 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- 10.20.193.28:0/569872254 wait complete. 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b3fff640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81880b0e20 0x7f81880b32e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f81a800aab0 tx=0x7f81a8009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- start start 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 Processor -- start 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5a93d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 0x55d9e5a94280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a9da70 0x55d9e5a908a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d9e598c0c0 con 0x55d9e5a98390 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d9e5aa0880 con 0x55d9e5a98cd0 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d9e5a90ee0 con 0x55d9e5a9da70 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5a93d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:24.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5a93d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35796/0 (socket says 10.20.193.28:35796) 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b37fe640 1 -- 10.20.193.28:0/3302027973 learned_addr learned my addr 10.20.193.28:0/3302027973 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b37fe640 1 -- 10.20.193.28:0/3302027973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a9da70 msgr2=0x55d9e5a908a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b37fe640 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a9da70 0x55d9e5a908a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b37fe640 1 -- 10.20.193.28:0/3302027973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 msgr2=0x55d9e5a94280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b37fe640 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 0x55d9e5a94280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b37fe640 1 -- 10.20.193.28:0/3302027973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e5aaa310 con 0x55d9e5a98390 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81b37fe640 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5a93d40 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009ea0 tx=0x7f81a000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e5799d2b943d5c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f817cff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f817cff9640 1 -- 10.20.193.28:0/3302027973 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0016070 con 0x55d9e5a98390 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f817cff9640 1 -- 10.20.193.28:0/3302027973 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f81a0002780 con 0x55d9e5a98390 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f817cff9640 1 -- 10.20.193.28:0/3302027973 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a00117e0 con 0x55d9e5a98390 2026-02-20T03:28:24.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.076+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3302027973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e59a0820 con 0x55d9e5a98390 2026-02-20T03:28:24.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f817cff9640 1 -- 10.20.193.28:0/3302027973 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f81a001a3b0 con 0x55d9e5a98390 2026-02-20T03:28:24.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 10 client.19158 _ll_register_callbacks cb 0x55d9e598fff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:24.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3302027973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9e59ec4e0 con 0x55d9e5a98390 2026-02-20T03:28:24.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f817cff9640 1 -- 10.20.193.28:0/3302027973 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f81a0004270 con 0x55d9e5a98390 2026-02-20T03:28:24.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 10 client.19158 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:24.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3302027973 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d9e59a5380 con 0x55d9e5a98390 2026-02-20T03:28:24.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f817cff9640 1 -- 10.20.193.28:0/3302027973 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f81a0004410 con 0x55d9e5a98390 2026-02-20T03:28:24.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 10 client.19158 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:24.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 10 client.19158 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:24.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 20 client.19158 populate_metadata read hostname 'trial028' 2026-02-20T03:28:24.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d9e5ac0f10 0x55d9e5ac33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 4 client.19158 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:24.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.081+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3302027973 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9e5966bd0 con 0x55d9e5ac0f10 2026-02-20T03:28:24.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.097+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d9e5ac0f10 0x55d9e5ac33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:24.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.125+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d9e5ac0f10 0x55d9e5ac33a0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=811d31284299fd8b server_cookie=715f51158c0d2d40 in_seq=0 out_seq=0 2026-02-20T03:28:24.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.125+0000 7f817cff9640 10 client.19158 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:24.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f817cff9640 1 -- 10.20.193.28:0/3302027973 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d9e5966bd0 con 0x55d9e5ac0f10 2026-02-20T03:28:24.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f817cff9640 10 client.19158 handle_command_reply: tid=0 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 client.19158 shutdown 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3302027973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 msgr2=0x55d9e5a93d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5a93d40 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009ea0 tx=0x7f81a000b4b0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3302027973 shutdown_connections 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d9e5ac0f10 0x55d9e5ac33a0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a9da70 0x55d9e5a908a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 0x55d9e5a94280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3302027973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5a93d40 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3302027973 >> 10.20.193.28:0/3302027973 conn(0x55d9e5a8b6f0 msgr2=0x55d9e5a96a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f817cff9640 0 client.19158 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:24.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3302027973 shutdown_connections 2026-02-20T03:28:24.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3302027973 wait complete. 2026-02-20T03:28:24.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.138+0000 7f81bcc0de00 20 client.19158 trim_cache size 0 max 16384 2026-02-20T03:28:24.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 Processor -- start 2026-02-20T03:28:24.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- start start 2026-02-20T03:28:24.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a98390 0x55d9e5aa46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 0x55d9e5a979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a93c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f81580126a0 con 0x55d9e5a9da70 2026-02-20T03:28:24.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f815800ff70 con 0x55d9e5a98cd0 2026-02-20T03:28:24.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f815800ddc0 con 0x55d9e5a98390 2026-02-20T03:28:24.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a93c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:24.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a93c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35804/0 (socket says 10.20.193.28:35804) 2026-02-20T03:28:24.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b3fff640 1 -- 10.20.193.28:0/3988313008 learned_addr learned my addr 10.20.193.28:0/3988313008 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:24.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b3fff640 1 -- 10.20.193.28:0/3988313008 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a98390 msgr2=0x55d9e5aa46f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b3fff640 1 --2- 10.20.193.28:0/3988313008 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a98390 0x55d9e5aa46f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b3fff640 1 -- 10.20.193.28:0/3988313008 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 msgr2=0x55d9e5a979e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b3fff640 1 --2- 10.20.193.28:0/3988313008 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 0x55d9e5a979e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b3fff640 1 -- 10.20.193.28:0/3988313008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e5aaa140 con 0x55d9e5a9da70 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b3fff640 1 --2- 10.20.193.28:0/3988313008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a93c60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f81a800cc40 tx=0x7f81a800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffa63d77f79dde6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f817effd640 1 -- 10.20.193.28:0/3988313008 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8006e60 con 0x55d9e5a9da70 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f817effd640 1 -- 10.20.193.28:0/3988313008 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f81a801f020 con 0x55d9e5a9da70 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f817effd640 1 -- 10.20.193.28:0/3988313008 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a800d660 con 0x55d9e5a9da70 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3988313008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 msgr2=0x55d9e5a93c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3988313008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a93c60 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f81a800cc40 tx=0x7f81a800f000 comp rx=0 tx=0).stop 2026-02-20T03:28:24.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3988313008 shutdown_connections 2026-02-20T03:28:24.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3988313008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a9da70 0x55d9e5a93c60 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3988313008 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 0x55d9e5a979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3988313008 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a98390 0x55d9e5aa46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3988313008 >> 10.20.193.28:0/3988313008 conn(0x55d9e5a8b6f0 msgr2=0x55d9e5a8fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3988313008 shutdown_connections 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3988313008 wait complete. 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- start start 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 Processor -- start 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5ad0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 0x55d9e5ad1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a9da70 0x55d9e5ad4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f815800e430 con 0x55d9e5a98390 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f815800f8a0 con 0x55d9e5a98cd0 2026-02-20T03:28:24.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81bcc0de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f815800eb00 con 0x55d9e5a9da70 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5ad0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5ad0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35814/0 (socket says 10.20.193.28:35814) 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b37fe640 1 -- 10.20.193.28:0/3168162059 learned_addr learned my addr 10.20.193.28:0/3168162059 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b37fe640 1 -- 10.20.193.28:0/3168162059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a9da70 msgr2=0x55d9e5ad4240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b37fe640 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a9da70 0x55d9e5ad4240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b37fe640 1 -- 10.20.193.28:0/3168162059 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 msgr2=0x55d9e5ad1320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b37fe640 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 0x55d9e5ad1320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.144+0000 7f81b37fe640 1 -- 10.20.193.28:0/3168162059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9e5744690 con 0x55d9e5a98390 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81b37fe640 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5ad0de0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f81a0002410 tx=0x7f81a000bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b113c0444b31b39 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f817cff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f817cff9640 1 -- 10.20.193.28:0/3168162059 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a002b070 con 0x55d9e5a98390 2026-02-20T03:28:24.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f817cff9640 1 -- 10.20.193.28:0/3168162059 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d9e59ec4e0 con 0x55d9e5a98390 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f817cff9640 1 -- 10.20.193.28:0/3168162059 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0016040 con 0x55d9e5a98390 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3168162059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9e59a9b70 con 0x55d9e5a98390 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f817cff9640 1 -- 10.20.193.28:0/3168162059 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f81a0011400 con 0x55d9e5a98390 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 10 client.19164 _ll_register_callbacks cb 0x7f81a0009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3168162059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d9e59f2290 con 0x55d9e5a98390 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f817cff9640 1 -- 10.20.193.28:0/3168162059 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f81a0002780 con 0x55d9e5a98390 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 10 client.19164 fetch_fsmap learned FSMap version 30 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3168162059 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d9e5aaae30 con 0x55d9e5a98390 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f817cff9640 1 -- 10.20.193.28:0/3168162059 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f81a001b440 con 0x55d9e5a98390 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 10 client.19164 fetch_fsmap finished waiting for FSMap version 30 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 10 client.19164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:24.159 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 20 client.19164 populate_metadata read hostname 'trial028' 2026-02-20T03:28:24.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d9e5b2c400 0x55d9e5b2e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:24.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 4 client.19164 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:28:24.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.149+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3168162059 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f81a4112030 con 0x55d9e5b2c400 2026-02-20T03:28:24.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.165+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d9e5b2c400 0x55d9e5b2e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:24.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.205+0000 7f81b2ffd640 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d9e5b2c400 0x55d9e5b2e8c0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=666f92d434649e99 server_cookie=f21a09814e67ce68 in_seq=0 out_seq=0 2026-02-20T03:28:24.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.205+0000 7f817cff9640 10 client.19164 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:24.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f817cff9640 1 -- 10.20.193.28:0/3168162059 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f81a4112030 con 0x55d9e5b2c400 2026-02-20T03:28:24.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f817cff9640 10 client.19164 handle_command_reply: tid=0 2026-02-20T03:28:24.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f81bcc0de00 1 client.19164 shutdown 2026-02-20T03:28:24.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3168162059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 msgr2=0x55d9e5ad0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:24.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5ad0de0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f81a0002410 tx=0x7f81a000bf20 comp rx=0 tx=0).stop 2026-02-20T03:28:24.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3168162059 shutdown_connections 2026-02-20T03:28:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d9e5b2c400 0x55d9e5b2e8c0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d9e5a9da70 0x55d9e5ad4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d9e5a98cd0 0x55d9e5ad1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f81bcc0de00 1 --2- 10.20.193.28:0/3168162059 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d9e5a98390 0x55d9e5ad0de0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3168162059 >> 10.20.193.28:0/3168162059 conn(0x55d9e5a8b6f0 msgr2=0x55d9e5a93c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.280+0000 7f817cff9640 0 client.19164 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3168162059 shutdown_connections 2026-02-20T03:28:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81bcc0de00 1 -- 10.20.193.28:0/3168162059 wait complete. 2026-02-20T03:28:24.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81bcc0de00 20 client.19164 trim_cache size 0 max 16384 2026-02-20T03:28:24.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:28:24.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:28:24.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:28:24.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:28:24.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 -- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81880b0e20 msgr2=0x7f81880b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:24.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81880b0e20 0x7f81880b32e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f81a800aab0 tx=0x7f81a8009250 comp rx=0 tx=0).stop 2026-02-20T03:28:24.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 -- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 msgr2=0x7f81b419ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:24.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 0x7f81b419ae50 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009950 tx=0x7f81a402fdc0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 -- 10.20.193.28:0/3323583035 shutdown_connections 2026-02-20T03:28:24.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81880b0e20 0x7f81880b32e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81b4104260 0x7f81b41a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81b41038a0 0x7f81b419ae50 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 --2- 10.20.193.28:0/3323583035 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81b41026b0 0x7f81b419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 -- 10.20.193.28:0/3323583035 >> 10.20.193.28:0/3323583035 conn(0x7f81b40fde10 msgr2=0x7f81b4106c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 -- 10.20.193.28:0/3323583035 shutdown_connections 2026-02-20T03:28:24.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:24.281+0000 7f81b8b20640 1 -- 10.20.193.28:0/3323583035 wait complete. 2026-02-20T03:28:24.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1168335 7.88 MB/sec execute 597 sec latency 990.520 ms 2026-02-20T03:28:25.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1171732 7.90 MB/sec execute 598 sec latency 9.935 ms 2026-02-20T03:28:25.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:25 trial126 ceph-mon[38476]: pgmap v594: 129 pgs: 129 active+clean; 202 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 607 KiB/s rd, 2.9 MiB/s wr, 233 op/s 2026-02-20T03:28:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:25 trial028 ceph-mon[38552]: pgmap v594: 129 pgs: 129 active+clean; 202 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 607 KiB/s rd, 2.9 MiB/s wr, 233 op/s 2026-02-20T03:28:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:25 trial177 ceph-mon[43181]: pgmap v594: 129 pgs: 129 active+clean; 202 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 607 KiB/s rd, 2.9 MiB/s wr, 233 op/s 2026-02-20T03:28:26.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 1173146 7.90 MB/sec execute 599 sec latency 225.723 ms 2026-02-20T03:28:27.511 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:27 trial028 ceph-mon[38552]: pgmap v595: 129 pgs: 129 active+clean; 198 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 632 KiB/s rd, 3.3 MiB/s wr, 248 op/s 2026-02-20T03:28:27.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 cleanup 600 sec 2026-02-20T03:28:27.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:27 trial126 ceph-mon[38476]: pgmap v595: 129 pgs: 129 active+clean; 198 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 632 KiB/s rd, 3.3 MiB/s wr, 248 op/s 2026-02-20T03:28:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:27 trial177 ceph-mon[43181]: pgmap v595: 129 pgs: 129 active+clean; 198 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 632 KiB/s rd, 3.3 MiB/s wr, 248 op/s 2026-02-20T03:28:28.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 cleanup 601 sec 2026-02-20T03:28:29.399 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:29 trial126 ceph-mon[38476]: pgmap v596: 129 pgs: 129 active+clean; 200 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 713 KiB/s rd, 3.1 MiB/s wr, 233 op/s 2026-02-20T03:28:29.400 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:29 trial028 ceph-mon[38552]: pgmap v596: 129 pgs: 129 active+clean; 200 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 713 KiB/s rd, 3.1 MiB/s wr, 233 op/s 2026-02-20T03:28:29.519 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:29 trial177 ceph-mon[43181]: pgmap v596: 129 pgs: 129 active+clean; 200 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 713 KiB/s rd, 3.1 MiB/s wr, 233 op/s 2026-02-20T03:28:29.530 INFO:tasks.workunit.client.0.trial028.stdout: 1 cleanup 602 sec 2026-02-20T03:28:29.581 INFO:tasks.workunit.client.0.trial028.stdout: 0 cleanup 602 sec 2026-02-20T03:28:29.581 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: Operation Count AvgLat MaxLat 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: ---------------------------------------- 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: NTCreateX 150705 2.116 28636.110 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: Close 110667 0.004 0.464 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: Rename 6377 7.310 20774.941 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: Unlink 30463 2.065 30467.922 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: Deltree 4 38.466 70.552 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: Mkdir 2 0.012 0.012 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: Qpathinfo 136536 0.829 4263.176 2026-02-20T03:28:29.582 INFO:tasks.workunit.client.0.trial028.stdout: Qfileinfo 23920 0.001 0.027 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout: Qfsinfo 25040 0.212 143.836 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout: Sfileinfo 12276 0.151 1444.872 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout: Find 52783 0.142 13.071 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout: WriteX 75155 0.173 10891.854 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout: ReadX 236008 0.021 132.529 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout: LockX 490 1.267 468.352 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout: UnlockX 490 3.825 1726.679 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout: Flush 10571 2.945 1484.771 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-20T03:28:29.583 INFO:tasks.workunit.client.0.trial028.stdout:Throughput 7.89746 MB/sec 1 clients 1 procs max_latency=30467.931 ms 2026-02-20T03:28:29.584 INFO:tasks.workunit.client.0.trial028.stderr:+ dbench 10 2026-02-20T03:28:29.585 INFO:tasks.workunit.client.0.trial028.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-20T03:28:29.585 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-20T03:28:29.585 INFO:tasks.workunit.client.0.trial028.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-20T03:28:29.586 INFO:tasks.workunit.client.0.trial028.stdout:8 of 10 processes prepared for launch 0 sec 2026-02-20T03:28:29.685 INFO:tasks.workunit.client.0.trial028.stdout:10 of 10 processes prepared for launch 0 sec 2026-02-20T03:28:29.685 INFO:tasks.workunit.client.0.trial028.stdout:releasing clients 2026-02-20T03:28:30.685 INFO:tasks.workunit.client.0.trial028.stdout: 10 1103 228.30 MB/sec warmup 1 sec latency 27.737 ms 2026-02-20T03:28:31.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:31 trial126 ceph-mon[38476]: pgmap v597: 129 pgs: 129 active+clean; 201 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 715 KiB/s rd, 3.5 MiB/s wr, 261 op/s 2026-02-20T03:28:31.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:31 trial028 ceph-mon[38552]: pgmap v597: 129 pgs: 129 active+clean; 201 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 715 KiB/s rd, 3.5 MiB/s wr, 261 op/s 2026-02-20T03:28:31.686 INFO:tasks.workunit.client.0.trial028.stdout: 10 2967 165.69 MB/sec warmup 2 sec latency 21.271 ms 2026-02-20T03:28:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:31 trial177 ceph-mon[43181]: pgmap v597: 129 pgs: 129 active+clean; 201 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 715 KiB/s rd, 3.5 MiB/s wr, 261 op/s 2026-02-20T03:28:32.686 INFO:tasks.workunit.client.0.trial028.stdout: 10 3619 128.26 MB/sec warmup 3 sec latency 584.325 ms 2026-02-20T03:28:33.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:33 trial126 ceph-mon[38476]: pgmap v598: 129 pgs: 129 active+clean; 199 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 586 KiB/s rd, 2.6 MiB/s wr, 221 op/s 2026-02-20T03:28:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:33 trial028 ceph-mon[38552]: pgmap v598: 129 pgs: 129 active+clean; 199 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 586 KiB/s rd, 2.6 MiB/s wr, 221 op/s 2026-02-20T03:28:33.686 INFO:tasks.workunit.client.0.trial028.stdout: 10 4198 100.52 MB/sec warmup 4 sec latency 29.542 ms 2026-02-20T03:28:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:33 trial177 ceph-mon[43181]: pgmap v598: 129 pgs: 129 active+clean; 199 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 586 KiB/s rd, 2.6 MiB/s wr, 221 op/s 2026-02-20T03:28:34.686 INFO:tasks.workunit.client.0.trial028.stdout: 10 5571 91.61 MB/sec warmup 5 sec latency 27.977 ms 2026-02-20T03:28:35.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:35 trial126 ceph-mon[38476]: pgmap v599: 129 pgs: 129 active+clean; 201 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 325 op/s 2026-02-20T03:28:35.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:35 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:28:35.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:35 trial028 ceph-mon[38552]: pgmap v599: 129 pgs: 129 active+clean; 201 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 325 op/s 2026-02-20T03:28:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:35 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:28:35.686 INFO:tasks.workunit.client.0.trial028.stdout: 10 7172 95.92 MB/sec warmup 6 sec latency 19.689 ms 2026-02-20T03:28:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:35 trial177 ceph-mon[43181]: pgmap v599: 129 pgs: 129 active+clean; 201 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 3.6 MiB/s wr, 325 op/s 2026-02-20T03:28:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:35 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:28:36.686 INFO:tasks.workunit.client.0.trial028.stdout: 10 7749 84.84 MB/sec warmup 7 sec latency 26.345 ms 2026-02-20T03:28:37.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3094957950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01026b0 msgr2=0x7f72e0102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:37.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3094957950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01026b0 0x7f72e0102ab0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009a30 tx=0x7f72d002f260 comp rx=0 tx=0).stop 2026-02-20T03:28:37.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3094957950 shutdown_connections 2026-02-20T03:28:37.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3094957950 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f72e0104260 0x7f72e010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3094957950 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72e01038a0 0x7f72e0103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3094957950 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01026b0 0x7f72e0102ab0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.370 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3094957950 >> 10.20.193.28:0/3094957950 conn(0x7f72e00fde10 msgr2=0x7f72e0100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:37.371 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3094957950 shutdown_connections 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3094957950 wait complete. 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 Processor -- start 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- start start 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72e01026b0 0x7f72e0076e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01038a0 0x7f72e0075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f72e0104260 0x7f72e00759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f72e010e2c0 con 0x7f72e01038a0 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f72e010e140 con 0x7f72e01026b0 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f72e010e440 con 0x7f72e0104260 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01038a0 0x7f72e0075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01038a0 0x7f72e0075460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35774/0 (socket says 10.20.193.28:35774) 2026-02-20T03:28:37.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d7fff640 1 -- 10.20.193.28:0/3555695428 learned_addr learned my addr 10.20.193.28:0/3555695428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:37.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d7fff640 1 -- 10.20.193.28:0/3555695428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f72e0104260 msgr2=0x7f72e00759a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:37.374 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d7fff640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f72e0104260 0x7f72e00759a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d7fff640 1 -- 10.20.193.28:0/3555695428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72e01026b0 msgr2=0x7f72e0076e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:37.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d7fff640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72e01026b0 0x7f72e0076e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d7fff640 1 -- 10.20.193.28:0/3555695428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e0075ee0 con 0x7f72e01038a0 2026-02-20T03:28:37.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d7fff640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01038a0 0x7f72e0075460 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f72c800b570 tx=0x7f72c800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:37.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d5ffb640 1 -- 10.20.193.28:0/3555695428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8013020 con 0x7f72e01038a0 2026-02-20T03:28:37.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d5ffb640 1 -- 10.20.193.28:0/3555695428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f72c8004480 con 0x7f72e01038a0 2026-02-20T03:28:37.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72d5ffb640 1 -- 10.20.193.28:0/3555695428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c800fb50 con 0x7f72e01038a0 2026-02-20T03:28:37.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3555695428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e00761d0 con 0x7f72e01038a0 2026-02-20T03:28:37.375 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.365+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3555695428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e01a9640 con 0x7f72e01038a0 2026-02-20T03:28:37.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.371+0000 7f72d5ffb640 1 -- 10.20.193.28:0/3555695428 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f72c8002780 con 0x7f72e01038a0 2026-02-20T03:28:37.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.371+0000 7f72e9e45e00 1 Processor -- start 2026-02-20T03:28:37.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72e9e45e00 1 -- start start 2026-02-20T03:28:37.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e977280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e9777c0 0x55871e97bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e97e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55871e8c78f0 con 0x55871e97c560 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55871e8752e0 con 0x55871e9777c0 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55871e8c3820 con 0x55871e976e80 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e97e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e97e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35780/0 (socket says 10.20.193.28:35780) 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72d7fff640 1 -- 10.20.193.28:0/2886491724 learned_addr learned my addr 10.20.193.28:0/2886491724 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72d7fff640 1 -- 10.20.193.28:0/2886491724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 msgr2=0x55871e977280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72d7fff640 1 --2- 10.20.193.28:0/2886491724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e977280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72d7fff640 1 -- 10.20.193.28:0/2886491724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e9777c0 msgr2=0x55871e97bf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72d7fff640 1 --2- 10.20.193.28:0/2886491724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e9777c0 0x55871e97bf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.373+0000 7f72d7fff640 1 -- 10.20.193.28:0/2886491724 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871e8675a0 con 0x55871e97c560 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.374+0000 7f72d7fff640 1 --2- 10.20.193.28:0/2886491724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e97e9f0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f72c80e6970 tx=0x7f72c80e6e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e646d8f6d1849918 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.374+0000 7f72d5ffb640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72bc0b0e20 0x7f72bc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.374+0000 7f72ad3fe640 1 -- 10.20.193.28:0/2886491724 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80f3070 con 0x55871e97c560 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.374+0000 7f72ad3fe640 1 -- 10.20.193.28:0/2886491724 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f72c80e8c00 con 0x55871e97c560 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.374+0000 7f72ad3fe640 1 -- 10.20.193.28:0/2886491724 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80e2540 con 0x55871e97c560 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.374+0000 7f72d5ffb640 1 -- 10.20.193.28:0/3555695428 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f72c80e04c0 con 0x7f72e01038a0 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.374+0000 7f72e9e45e00 1 -- 10.20.193.28:0/2886491724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 msgr2=0x55871e97e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.374+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/2886491724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e97e9f0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f72c80e6970 tx=0x7f72c80e6e40 comp rx=0 tx=0).stop 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.375+0000 7f72e5559640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72bc0b0e20 0x7f72bc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.375+0000 7f72e9e45e00 1 -- 10.20.193.28:0/2886491724 shutdown_connections 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.375+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/2886491724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e97e9f0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.375+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/2886491724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e9777c0 0x55871e97bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.375+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/2886491724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e977280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.375+0000 7f72e9e45e00 1 -- 10.20.193.28:0/2886491724 >> 10.20.193.28:0/2886491724 conn(0x55871e96e6f0 msgr2=0x55871e975570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:37.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.375+0000 7f72e9e45e00 1 -- 10.20.193.28:0/2886491724 shutdown_connections 2026-02-20T03:28:37.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72bc0b0e20 0x7f72bc0b32e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00aab0 tx=0x7f72dc009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:37.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 -- 10.20.193.28:0/2886491724 wait complete. 2026-02-20T03:28:37.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 -- start start 2026-02-20T03:28:37.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 Processor -- start 2026-02-20T03:28:37.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e98fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e9777c0 0x55871e98ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e996f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55871e86f0c0 con 0x55871e97c560 2026-02-20T03:28:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55871e97f610 con 0x55871e9777c0 2026-02-20T03:28:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55871e9974a0 con 0x55871e976e80 2026-02-20T03:28:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e996f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e996f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35784/0 (socket says 10.20.193.28:35784) 2026-02-20T03:28:37.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 -- 10.20.193.28:0/3323966274 learned_addr learned my addr 10.20.193.28:0/3323966274 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:37.390 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 -- 10.20.193.28:0/3323966274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 msgr2=0x55871e98fa50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e98fa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 -- 10.20.193.28:0/3323966274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e9777c0 msgr2=0x55871e98ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e9777c0 0x55871e98ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 -- 10.20.193.28:0/3323966274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871e989180 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e5559640 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e996f10 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f72dc004380 tx=0x7f72dc004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c06012d8c94fc9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f729e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f729e7fc640 1 -- 10.20.193.28:0/3323966274 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc006e60 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f729e7fc640 1 -- 10.20.193.28:0/3323966274 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f72dc01f020 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f729e7fc640 1 -- 10.20.193.28:0/3323966274 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc01ad60 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 -- 10.20.193.28:0/3323966274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871e883820 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f729e7fc640 1 -- 10.20.193.28:0/3323966274 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f72dc024410 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 10 client.19176 _ll_register_callbacks cb 0x55871e872ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 -- 10.20.193.28:0/3323966274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55871e8cf4e0 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f729e7fc640 1 -- 10.20.193.28:0/3323966274 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f72dc01e030 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 10 client.19176 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 -- 10.20.193.28:0/3323966274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55871e888380 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f729e7fc640 1 -- 10.20.193.28:0/3323966274 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f72dc01a430 con 0x55871e97c560 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 10 client.19176 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:37.391 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 10 client.19176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 20 client.19176 populate_metadata read hostname 'trial028' 2026-02-20T03:28:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55871e99b910 0x55871e99dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 4 client.19176 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.376+0000 7f72e9e45e00 1 -- 10.20.193.28:0/3323966274 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55871e849bd0 con 0x55871e99b910 2026-02-20T03:28:37.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.389+0000 7f72e4d58640 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55871e99b910 0x55871e99dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:37.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.418+0000 7f72e4d58640 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55871e99b910 0x55871e99dda0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c762acb120e8e1d server_cookie=5ce8b6b9f0c765aa in_seq=0 out_seq=0 2026-02-20T03:28:37.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.418+0000 7f729e7fc640 10 client.19176 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:37.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f729e7fc640 1 -- 10.20.193.28:0/3323966274 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55871e849bd0 con 0x55871e99b910 2026-02-20T03:28:37.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f729e7fc640 10 client.19176 handle_command_reply: tid=0 2026-02-20T03:28:37.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 client.19176 shutdown 2026-02-20T03:28:37.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 -- 10.20.193.28:0/3323966274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 msgr2=0x55871e996f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:37.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e996f10 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f72dc004380 tx=0x7f72dc004bd0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 -- 10.20.193.28:0/3323966274 shutdown_connections 2026-02-20T03:28:37.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55871e99b910 0x55871e99dda0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e97c560 0x55871e996f10 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e9777c0 0x55871e98ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/3323966274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e98fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f729e7fc640 0 client.19176 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:37.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 -- 10.20.193.28:0/3323966274 >> 10.20.193.28:0/3323966274 conn(0x55871e96e6f0 msgr2=0x55871e97d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:37.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 -- 10.20.193.28:0/3323966274 shutdown_connections 2026-02-20T03:28:37.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 1 -- 10.20.193.28:0/3323966274 wait complete. 2026-02-20T03:28:37.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.431+0000 7f72e9e45e00 20 client.19176 trim_cache size 0 max 16384 2026-02-20T03:28:37.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72e9e45e00 1 Processor -- start 2026-02-20T03:28:37.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72e9e45e00 1 -- start start 2026-02-20T03:28:37.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e97d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e996ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e97c560 0x55871e98d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f72840126f0 con 0x55871e9777c0 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f728400ffc0 con 0x55871e97c560 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f728400de10 con 0x55871e976e80 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e996ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e996ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35794/0 (socket says 10.20.193.28:35794) 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72d7fff640 1 -- 10.20.193.28:0/1136215527 learned_addr learned my addr 10.20.193.28:0/1136215527 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72d7fff640 1 -- 10.20.193.28:0/1136215527 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 msgr2=0x55871e97d950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72d7fff640 1 --2- 10.20.193.28:0/1136215527 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e97d950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72d7fff640 1 -- 10.20.193.28:0/1136215527 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e97c560 msgr2=0x55871e98d1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:37.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72d7fff640 1 --2- 10.20.193.28:0/1136215527 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e97c560 0x55871e98d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.437+0000 7f72d7fff640 1 -- 10.20.193.28:0/1136215527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871e988fb0 con 0x55871e9777c0 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 --2- 10.20.193.28:0/1136215527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e996ed0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f72c80a4030 tx=0x7f72c80e3ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1473f1413df89811 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72acbfd640 1 -- 10.20.193.28:0/1136215527 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80a3e70 con 0x55871e9777c0 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72acbfd640 1 -- 10.20.193.28:0/1136215527 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f72c80e3e50 con 0x55871e9777c0 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72acbfd640 1 -- 10.20.193.28:0/1136215527 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80a7720 con 0x55871e9777c0 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1136215527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 msgr2=0x55871e996ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1136215527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e996ed0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f72c80a4030 tx=0x7f72c80e3ab0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1136215527 shutdown_connections 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1136215527 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e97c560 0x55871e98d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1136215527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e996ed0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1136215527 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e97d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1136215527 >> 10.20.193.28:0/1136215527 conn(0x55871e96e6f0 msgr2=0x55871e98cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:37.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1136215527 shutdown_connections 2026-02-20T03:28:37.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1136215527 wait complete. 2026-02-20T03:28:37.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- start start 2026-02-20T03:28:37.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 Processor -- start 2026-02-20T03:28:37.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e993040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e9935e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e97c560 0x55871e996360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f728400e480 con 0x55871e9777c0 2026-02-20T03:28:37.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f728400f8f0 con 0x55871e97c560 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f728400eb50 con 0x55871e976e80 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e9935e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e9935e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35800/0 (socket says 10.20.193.28:35800) 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 -- 10.20.193.28:0/1826700768 learned_addr learned my addr 10.20.193.28:0/1826700768 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 -- 10.20.193.28:0/1826700768 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 msgr2=0x55871e993040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e993040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 -- 10.20.193.28:0/1826700768 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e97c560 msgr2=0x55871e996360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e97c560 0x55871e996360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 -- 10.20.193.28:0/1826700768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55871e97f370 con 0x55871e9777c0 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72d7fff640 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e9935e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f72c80e68c0 tx=0x7f72c80ac620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0d24ba419869c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:37.452 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f729e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f729e7fc640 1 -- 10.20.193.28:0/1826700768 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80a7900 con 0x55871e9777c0 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f729e7fc640 1 -- 10.20.193.28:0/1826700768 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f72c801f300 con 0x55871e9777c0 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f729e7fc640 1 -- 10.20.193.28:0/1826700768 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c80a7fd0 con 0x55871e9777c0 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.442+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1826700768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871e627690 con 0x55871e9777c0 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f729e7fc640 1 -- 10.20.193.28:0/1826700768 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f72c80ddc20 con 0x55871e9777c0 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 10 client.19182 _ll_register_callbacks cb 0x7f72dc00ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1826700768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72c80e8c00 con 0x55871e9777c0 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f729e7fc640 1 -- 10.20.193.28:0/1826700768 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f72c80a8900 con 0x55871e9777c0 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 10 client.19182 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:37.453 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1826700768 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55871e88cb70 con 0x55871e9777c0 2026-02-20T03:28:37.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f729e7fc640 1 -- 10.20.193.28:0/1826700768 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f72c80a4240 con 0x55871e9777c0 2026-02-20T03:28:37.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 10 client.19182 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:37.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 10 client.19182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:37.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 20 client.19182 populate_metadata read hostname 'trial028' 2026-02-20T03:28:37.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55871ea06dc0 0x55871ea091b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:37.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 4 client.19182 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:28:37.454 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.445+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1826700768 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55871e8986b0 con 0x55871ea06dc0 2026-02-20T03:28:37.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.459+0000 7f72e4d58640 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55871ea06dc0 0x55871ea091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:37.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.500+0000 7f72e4d58640 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55871ea06dc0 0x55871ea091b0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25ce025c58c26cab server_cookie=a448e6d04b31ddd4 in_seq=0 out_seq=0 2026-02-20T03:28:37.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:37.500+0000 7f729e7fc640 10 client.19182 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:37.571 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:37 trial028 ceph-mon[38552]: pgmap v600: 129 pgs: 129 active+clean; 201 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 350 op/s 2026-02-20T03:28:37.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:37 trial126 ceph-mon[38476]: pgmap v600: 129 pgs: 129 active+clean; 201 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 350 op/s 2026-02-20T03:28:37.689 INFO:tasks.workunit.client.0.trial028.stdout: 10 7876 74.52 MB/sec warmup 8 sec latency 806.026 ms 2026-02-20T03:28:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:37 trial177 ceph-mon[43181]: pgmap v600: 129 pgs: 129 active+clean; 201 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 350 op/s 2026-02-20T03:28:38.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.060+0000 7f729e7fc640 1 -- 10.20.193.28:0/1826700768 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55871e8986b0 con 0x55871ea06dc0 2026-02-20T03:28:38.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.060+0000 7f729e7fc640 10 client.19182 handle_command_reply: tid=0 2026-02-20T03:28:38.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.060+0000 7f72e9e45e00 1 client.19182 shutdown 2026-02-20T03:28:38.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.061+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1826700768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 msgr2=0x55871e9935e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:38.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.061+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e9935e0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f72c80e68c0 tx=0x7f72c80ac620 comp rx=0 tx=0).stop 2026-02-20T03:28:38.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.061+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1826700768 shutdown_connections 2026-02-20T03:28:38.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.061+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55871ea06dc0 0x55871ea091b0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:38.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.061+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55871e97c560 0x55871e996360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:38.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.061+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55871e9777c0 0x55871e9935e0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:38.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.061+0000 7f72e9e45e00 1 --2- 10.20.193.28:0/1826700768 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55871e976e80 0x55871e993040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:38.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.061+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1826700768 >> 10.20.193.28:0/1826700768 conn(0x55871e96e6f0 msgr2=0x55871e97d870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:38.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.061+0000 7f729e7fc640 0 client.19182 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:38.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1826700768 shutdown_connections 2026-02-20T03:28:38.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e9e45e00 1 -- 10.20.193.28:0/1826700768 wait complete. 2026-02-20T03:28:38.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e9e45e00 20 client.19182 trim_cache size 0 max 16384 2026-02-20T03:28:38.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:28:38.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:28:38.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:28:38.066 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:28:38.067 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72bc0b0e20 msgr2=0x7f72bc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:38.067 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72bc0b0e20 0x7f72bc0b32e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00aab0 tx=0x7f72dc009250 comp rx=0 tx=0).stop 2026-02-20T03:28:38.067 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01038a0 msgr2=0x7f72e0075460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:38.067 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01038a0 0x7f72e0075460 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f72c800b570 tx=0x7f72c800ba40 comp rx=0 tx=0).stop 2026-02-20T03:28:38.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3555695428 shutdown_connections 2026-02-20T03:28:38.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f72bc0b0e20 0x7f72bc0b32e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:38.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f72e0104260 0x7f72e00759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:38.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f72e01038a0 0x7f72e0075460 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:38.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 --2- 10.20.193.28:0/3555695428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72e01026b0 0x7f72e0076e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:38.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.062+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3555695428 >> 10.20.193.28:0/3555695428 conn(0x7f72e00fde10 msgr2=0x7f72e0106cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:38.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.063+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3555695428 shutdown_connections 2026-02-20T03:28:38.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:38.063+0000 7f72e5d5a640 1 -- 10.20.193.28:0/3555695428 wait complete. 2026-02-20T03:28:38.689 INFO:tasks.workunit.client.0.trial028.stdout: 10 8902 71.62 MB/sec warmup 9 sec latency 1005.706 ms 2026-02-20T03:28:39.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:39 trial126 ceph-mon[38476]: pgmap v601: 129 pgs: 129 active+clean; 204 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 346 op/s 2026-02-20T03:28:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:39 trial028 ceph-mon[38552]: pgmap v601: 129 pgs: 129 active+clean; 204 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 346 op/s 2026-02-20T03:28:39.689 INFO:tasks.workunit.client.0.trial028.stdout: 10 10573 75.42 MB/sec warmup 10 sec latency 22.620 ms 2026-02-20T03:28:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:39 trial177 ceph-mon[43181]: pgmap v601: 129 pgs: 129 active+clean; 204 MiB data, 4.4 GiB used, 8.2 TiB / 8.2 TiB avail; 1.4 MiB/s rd, 4.3 MiB/s wr, 346 op/s 2026-02-20T03:28:40.689 INFO:tasks.workunit.client.0.trial028.stdout: 10 11241 71.22 MB/sec warmup 11 sec latency 22.041 ms 2026-02-20T03:28:40.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:40 trial126 ceph-mon[38476]: pgmap v602: 129 pgs: 129 active+clean; 202 MiB data, 4.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 760 op/s 2026-02-20T03:28:40.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:40 trial028 ceph-mon[38552]: pgmap v602: 129 pgs: 129 active+clean; 202 MiB data, 4.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 760 op/s 2026-02-20T03:28:40.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:40 trial177 ceph-mon[43181]: pgmap v602: 129 pgs: 129 active+clean; 202 MiB data, 4.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 5.8 MiB/s wr, 760 op/s 2026-02-20T03:28:41.542 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:28:41.689 INFO:tasks.workunit.client.0.trial028.stdout: 10 12464 69.68 MB/sec warmup 12 sec latency 28.441 ms 2026-02-20T03:28:41.815 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.012+0000 7f00a50e1640 1 -- 10.20.193.28:0/3339288962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109220 msgr2=0x7f00a0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.012+0000 7f00a50e1640 1 --2- 10.20.193.28:0/3339288962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109220 0x7f00a0109660 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f008c009a30 tx=0x7f008c02f260 comp rx=0 tx=0).stop 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 -- 10.20.193.28:0/3339288962 shutdown_connections 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 --2- 10.20.193.28:0/3339288962 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00a0109ba0 0x7f00a0115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 --2- 10.20.193.28:0/3339288962 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109220 0x7f00a0109660 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 --2- 10.20.193.28:0/3339288962 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00a010eef0 0x7f00a010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 -- 10.20.193.28:0/3339288962 >> 10.20.193.28:0/3339288962 conn(0x7f00a0078600 msgr2=0x7f00a007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 -- 10.20.193.28:0/3339288962 shutdown_connections 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 -- 10.20.193.28:0/3339288962 wait complete. 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 Processor -- start 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 -- start start 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00a0109220 0x7f00a00746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109ba0 0x7f00a0074c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.013+0000 7f00a50e1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00a010eef0 0x7f00a006d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f00a50e1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f00a01191b0 con 0x7f00a0109ba0 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f00a50e1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0119030 con 0x7f00a0109220 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f00a50e1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f00a0119330 con 0x7f00a010eef0 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109ba0 0x7f00a0074c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109ba0 0x7f00a0074c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35808/0 (socket says 10.20.193.28:35808) 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009f7fe640 1 -- 10.20.193.28:0/1600070335 learned_addr learned my addr 10.20.193.28:0/1600070335 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:42.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009f7fe640 1 -- 10.20.193.28:0/1600070335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00a010eef0 msgr2=0x7f00a006d880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009f7fe640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00a010eef0 0x7f00a006d880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009f7fe640 1 -- 10.20.193.28:0/1600070335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00a0109220 msgr2=0x7f00a00746d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009f7fe640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00a0109220 0x7f00a00746d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009f7fe640 1 -- 10.20.193.28:0/1600070335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a006e140 con 0x7f00a0109ba0 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009f7fe640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109ba0 0x7f00a0074c10 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f008c009950 tx=0x7f008c002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009d7fa640 1 -- 10.20.193.28:0/1600070335 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c002a00 con 0x7f00a0109ba0 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f00a50e1640 1 -- 10.20.193.28:0/1600070335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a006e3d0 con 0x7f00a0109ba0 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f00a50e1640 1 -- 10.20.193.28:0/1600070335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a00723d0 con 0x7f00a0109ba0 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009d7fa640 1 -- 10.20.193.28:0/1600070335 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f008c005030 con 0x7f00a0109ba0 2026-02-20T03:28:42.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.015+0000 7f009d7fa640 1 -- 10.20.193.28:0/1600070335 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c004d80 con 0x7f00a0109ba0 2026-02-20T03:28:42.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009d7fa640 1 -- 10.20.193.28:0/1600070335 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f008c04b060 con 0x7f00a0109ba0 2026-02-20T03:28:42.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 Processor -- start 2026-02-20T03:28:42.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 -- start start 2026-02-20T03:28:42.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 0x5577a5f2c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f26a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26fb0 0x5577a5f32e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577a5ea6e50 con 0x5577a5f26630 2026-02-20T03:28:42.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5577a5e799c0 con 0x5577a5f2c000 2026-02-20T03:28:42.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5577a5e27240 con 0x5577a5f26fb0 2026-02-20T03:28:42.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009d7fa640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00740b0e20 0x7f00740b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009d7fa640 1 -- 10.20.193.28:0/1600070335 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f008c104d80 con 0x7f00a0109ba0 2026-02-20T03:28:42.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f26a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f26a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35822/0 (socket says 10.20.193.28:35822) 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009ffff640 1 -- 10.20.193.28:0/3875738105 learned_addr learned my addr 10.20.193.28:0/3875738105 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a48e0640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00740b0e20 0x7f00740b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009ffff640 1 -- 10.20.193.28:0/3875738105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26fb0 msgr2=0x5577a5f32e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009ffff640 1 --2- 10.20.193.28:0/3875738105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26fb0 0x5577a5f32e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009ffff640 1 -- 10.20.193.28:0/3875738105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 msgr2=0x5577a5f2c3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009ffff640 1 --2- 10.20.193.28:0/3875738105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 0x5577a5f2c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009ffff640 1 -- 10.20.193.28:0/3875738105 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a5e3a420 con 0x5577a5f26630 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f009ffff640 1 --2- 10.20.193.28:0/3875738105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f26a70 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0090009870 tx=0x7f0090009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ccefc18df01707 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a48e0640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00740b0e20 0x7f00740b32e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f009400ab10 tx=0x7f0094009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f0078ce3640 1 -- 10.20.193.28:0/3875738105 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090016070 con 0x5577a5f26630 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f0078ce3640 1 -- 10.20.193.28:0/3875738105 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0090004480 con 0x5577a5f26630 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f0078ce3640 1 -- 10.20.193.28:0/3875738105 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009000bd30 con 0x5577a5f26630 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 -- 10.20.193.28:0/3875738105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 msgr2=0x5577a5f26a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3875738105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f26a70 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f0090009870 tx=0x7f0090009d40 comp rx=0 tx=0).stop 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 -- 10.20.193.28:0/3875738105 shutdown_connections 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.018+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3875738105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26fb0 0x5577a5f32e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3875738105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f26a70 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3875738105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 0x5577a5f2c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 -- 10.20.193.28:0/3875738105 >> 10.20.193.28:0/3875738105 conn(0x5577a5ee9290 msgr2=0x5577a5f24d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 -- 10.20.193.28:0/3875738105 shutdown_connections 2026-02-20T03:28:42.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 -- 10.20.193.28:0/3875738105 wait complete. 2026-02-20T03:28:42.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 -- start start 2026-02-20T03:28:42.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 Processor -- start 2026-02-20T03:28:42.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26630 0x5577a5f408c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f26fb0 0x5577a5f40e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f2c000 0x5577a5f3f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577a5e758f0 con 0x5577a5f2c000 2026-02-20T03:28:42.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5577a5c67f50 con 0x5577a5f26fb0 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5577a5f3f780 con 0x5577a5f26630 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a48e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f2c000 0x5577a5f3f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a48e0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f2c000 0x5577a5f3f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35838/0 (socket says 10.20.193.28:35838) 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a48e0640 1 -- 10.20.193.28:0/511128367 learned_addr learned my addr 10.20.193.28:0/511128367 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a48e0640 1 -- 10.20.193.28:0/511128367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26630 msgr2=0x5577a5f408c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a48e0640 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26630 0x5577a5f408c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a48e0640 1 -- 10.20.193.28:0/511128367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f26fb0 msgr2=0x5577a5f40e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a48e0640 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f26fb0 0x5577a5f40e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a48e0640 1 -- 10.20.193.28:0/511128367 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a5f38ad0 con 0x5577a5f2c000 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a48e0640 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f2c000 0x5577a5f3f000 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f0094004740 tx=0x7f0094004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d07e11dcc908e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f0065ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:42.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f0065ffb640 1 -- 10.20.193.28:0/511128367 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009400dc60 con 0x5577a5f2c000 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f0065ffb640 1 -- 10.20.193.28:0/511128367 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f009401f020 con 0x5577a5f2c000 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f0065ffb640 1 -- 10.20.193.28:0/511128367 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009400dc60 con 0x5577a5f2c000 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 -- 10.20.193.28:0/511128367 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577a5c4ab40 con 0x5577a5f2c000 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 10 client.19194 _ll_register_callbacks cb 0x5577a5eb2f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f00a886fe00 1 -- 10.20.193.28:0/511128367 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5577a5e871a0 con 0x5577a5f2c000 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.024+0000 7f0065ffb640 1 -- 10.20.193.28:0/511128367 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f009400de00 con 0x5577a5f2c000 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f0065ffb640 1 -- 10.20.193.28:0/511128367 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f009401e020 con 0x5577a5f2c000 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f00a886fe00 10 client.19194 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f00a886fe00 1 -- 10.20.193.28:0/511128367 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5577a5e34230 con 0x5577a5f2c000 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f0065ffb640 1 -- 10.20.193.28:0/511128367 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f009401a430 con 0x5577a5f2c000 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f00a886fe00 10 client.19194 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:42.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f00a886fe00 10 client.19194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:42.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f00a886fe00 20 client.19194 populate_metadata read hostname 'trial028' 2026-02-20T03:28:42.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f00a886fe00 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577a5f4f160 0x5577a5f51600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f00a886fe00 4 client.19194 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:42.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.029+0000 7f00a886fe00 1 -- 10.20.193.28:0/511128367 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577a5e815b0 con 0x5577a5f4f160 2026-02-20T03:28:42.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.032+0000 7f009ffff640 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577a5f4f160 0x5577a5f51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.033+0000 7f009ffff640 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577a5f4f160 0x5577a5f51600 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be18b6aa18a0dcf8 server_cookie=a0214db3d46601d4 in_seq=0 out_seq=0 2026-02-20T03:28:42.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.033+0000 7f0065ffb640 10 client.19194 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:42.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.034+0000 7f0065ffb640 1 -- 10.20.193.28:0/511128367 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5577a5e815b0 con 0x5577a5f4f160 2026-02-20T03:28:42.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.034+0000 7f0065ffb640 10 client.19194 handle_command_reply: tid=0 2026-02-20T03:28:42.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.034+0000 7f00a886fe00 1 client.19194 shutdown 2026-02-20T03:28:42.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 -- 10.20.193.28:0/511128367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f2c000 msgr2=0x5577a5f3f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f2c000 0x5577a5f3f000 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f0094004740 tx=0x7f0094004cc0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 -- 10.20.193.28:0/511128367 shutdown_connections 2026-02-20T03:28:42.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577a5f4f160 0x5577a5f51600 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f2c000 0x5577a5f3f000 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f26fb0 0x5577a5f40e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 --2- 10.20.193.28:0/511128367 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26630 0x5577a5f408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 -- 10.20.193.28:0/511128367 >> 10.20.193.28:0/511128367 conn(0x5577a5ee9290 msgr2=0x5577a5f25440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:42.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f0065ffb640 0 client.19194 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 -- 10.20.193.28:0/511128367 shutdown_connections 2026-02-20T03:28:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 1 -- 10.20.193.28:0/511128367 wait complete. 2026-02-20T03:28:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.035+0000 7f00a886fe00 20 client.19194 trim_cache size 0 max 16384 2026-02-20T03:28:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 Processor -- start 2026-02-20T03:28:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- start start 2026-02-20T03:28:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f1ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26fb0 0x5577a5f3c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 0x5577a5f4fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0044012700 con 0x5577a5f26630 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f004400ffd0 con 0x5577a5f2c000 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f004400de20 con 0x5577a5f26fb0 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f1ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f1ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35844/0 (socket says 10.20.193.28:35844) 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009ffff640 1 -- 10.20.193.28:0/3451407808 learned_addr learned my addr 10.20.193.28:0/3451407808 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009ffff640 1 -- 10.20.193.28:0/3451407808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26fb0 msgr2=0x5577a5f3c8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009ffff640 1 --2- 10.20.193.28:0/3451407808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26fb0 0x5577a5f3c8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009ffff640 1 -- 10.20.193.28:0/3451407808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 msgr2=0x5577a5f4fc50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009ffff640 1 --2- 10.20.193.28:0/3451407808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 0x5577a5f4fc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009ffff640 1 -- 10.20.193.28:0/3451407808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a5f38900 con 0x5577a5f26630 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009ffff640 1 --2- 10.20.193.28:0/3451407808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f1ed50 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x5577a5f3e880 tx=0x7f0090006c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d695e7573cba1265 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f0067fff640 1 -- 10.20.193.28:0/3451407808 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090016040 con 0x5577a5f26630 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f0067fff640 1 -- 10.20.193.28:0/3451407808 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0090017040 con 0x5577a5f26630 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f0067fff640 1 -- 10.20.193.28:0/3451407808 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090002d80 con 0x5577a5f26630 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- 10.20.193.28:0/3451407808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 msgr2=0x5577a5f1ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3451407808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f1ed50 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x5577a5f3e880 tx=0x7f0090006c10 comp rx=0 tx=0).stop 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- 10.20.193.28:0/3451407808 shutdown_connections 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3451407808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 0x5577a5f4fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3451407808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26fb0 0x5577a5f3c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3451407808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26630 0x5577a5f1ed50 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- 10.20.193.28:0/3451407808 >> 10.20.193.28:0/3451407808 conn(0x5577a5ee9290 msgr2=0x5577a5f4f540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:42.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- 10.20.193.28:0/3451407808 shutdown_connections 2026-02-20T03:28:42.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- 10.20.193.28:0/3451407808 wait complete. 2026-02-20T03:28:42.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- start start 2026-02-20T03:28:42.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 Processor -- start 2026-02-20T03:28:42.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26630 0x5577a5f4aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26fb0 0x5577a5f4b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 0x5577a5f48240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f004400e490 con 0x5577a5f26fb0 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f004400f900 con 0x5577a5f2c000 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f00a886fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f004400eb60 con 0x5577a5f26630 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26fb0 0x5577a5f4b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26fb0 0x5577a5f4b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35846/0 (socket says 10.20.193.28:35846) 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.045+0000 7f009f7fe640 1 -- 10.20.193.28:0/3223493489 learned_addr learned my addr 10.20.193.28:0/3223493489 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f009f7fe640 1 -- 10.20.193.28:0/3223493489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26630 msgr2=0x5577a5f4aed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f009f7fe640 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26630 0x5577a5f4aed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f009f7fe640 1 -- 10.20.193.28:0/3223493489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 msgr2=0x5577a5f48240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:42.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f009f7fe640 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 0x5577a5f48240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f009f7fe640 1 -- 10.20.193.28:0/3223493489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a5b58870 con 0x5577a5f26fb0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f009f7fe640 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26fb0 0x5577a5f4b410 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f008c0047e0 tx=0x7f008c0054c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c98521f3633ab5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f0065ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f0065ffb640 1 -- 10.20.193.28:0/3223493489 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c048040 con 0x5577a5f26fb0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f0065ffb640 1 -- 10.20.193.28:0/3223493489 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f008c033030 con 0x5577a5f26fb0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 1 -- 10.20.193.28:0/3223493489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577a5e19440 con 0x5577a5f26fb0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 10 client.19200 _ll_register_callbacks cb 0x7f0094006f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f0065ffb640 1 -- 10.20.193.28:0/3223493489 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c0ccc00 con 0x5577a5f26fb0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 1 -- 10.20.193.28:0/3223493489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5577a5e2bb00 con 0x5577a5f26fb0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f0065ffb640 1 -- 10.20.193.28:0/3223493489 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f008c0c90b0 con 0x5577a5f26fb0 2026-02-20T03:28:42.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f0065ffb640 1 -- 10.20.193.28:0/3223493489 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f008c0c93f0 con 0x5577a5f26fb0 2026-02-20T03:28:42.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 10 client.19200 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:42.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 1 -- 10.20.193.28:0/3223493489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5577a5f395f0 con 0x5577a5f26fb0 2026-02-20T03:28:42.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f0065ffb640 1 -- 10.20.193.28:0/3223493489 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f008c0eeac0 con 0x5577a5f26fb0 2026-02-20T03:28:42.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 10 client.19200 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:42.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 10 client.19200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:42.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 20 client.19200 populate_metadata read hostname 'trial028' 2026-02-20T03:28:42.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577a5fbbec0 0x5577a5fbe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 4 client.19200 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:28:42.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.049+0000 7f00a886fe00 1 -- 10.20.193.28:0/3223493489 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5577a5e2bb00 con 0x5577a5fbbec0 2026-02-20T03:28:42.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.076+0000 7f009ffff640 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577a5fbbec0 0x5577a5fbe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.117+0000 7f009ffff640 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577a5fbbec0 0x5577a5fbe380 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11c71d04876804b0 server_cookie=739d6cabfa1f2c8e in_seq=0 out_seq=0 2026-02-20T03:28:42.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.117+0000 7f0065ffb640 10 client.19200 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.129+0000 7f0065ffb640 1 -- 10.20.193.28:0/3223493489 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5577a5e2bb00 con 0x5577a5fbbec0 2026-02-20T03:28:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.129+0000 7f0065ffb640 10 client.19200 handle_command_reply: tid=0 2026-02-20T03:28:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.129+0000 7f00a886fe00 1 client.19200 shutdown 2026-02-20T03:28:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 -- 10.20.193.28:0/3223493489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26fb0 msgr2=0x5577a5f4b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26fb0 0x5577a5f4b410 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f008c0047e0 tx=0x7f008c0054c0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 -- 10.20.193.28:0/3223493489 shutdown_connections 2026-02-20T03:28:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577a5fbbec0 0x5577a5fbe380 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577a5f2c000 0x5577a5f48240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577a5f26fb0 0x5577a5f4b410 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 --2- 10.20.193.28:0/3223493489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577a5f26630 0x5577a5f4aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f0065ffb640 0 client.19200 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:42.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 -- 10.20.193.28:0/3223493489 >> 10.20.193.28:0/3223493489 conn(0x5577a5ee9290 msgr2=0x5577a5f4fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:42.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 -- 10.20.193.28:0/3223493489 shutdown_connections 2026-02-20T03:28:42.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 1 -- 10.20.193.28:0/3223493489 wait complete. 2026-02-20T03:28:42.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a886fe00 20 client.19200 trim_cache size 0 max 16384 2026-02-20T03:28:42.134 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:28:42.135 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:28:42.135 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:28:42.135 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:28:42.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 -- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00740b0e20 msgr2=0x7f00740b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00740b0e20 0x7f00740b32e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f009400ab10 tx=0x7f0094009230 comp rx=0 tx=0).stop 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 -- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109ba0 msgr2=0x7f00a0074c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109ba0 0x7f00a0074c10 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f008c009950 tx=0x7f008c002910 comp rx=0 tx=0).stop 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 -- 10.20.193.28:0/1600070335 shutdown_connections 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00740b0e20 0x7f00740b32e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00a010eef0 0x7f00a006d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00a0109ba0 0x7f00a0074c10 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 --2- 10.20.193.28:0/1600070335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00a0109220 0x7f00a00746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 -- 10.20.193.28:0/1600070335 >> 10.20.193.28:0/1600070335 conn(0x7f00a0078600 msgr2=0x7f00a0079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 -- 10.20.193.28:0/1600070335 shutdown_connections 2026-02-20T03:28:42.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.130+0000 7f00a50e1640 1 -- 10.20.193.28:0/1600070335 wait complete. 2026-02-20T03:28:42.289 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:28:42.290 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:28:42.591 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:42.689 INFO:tasks.workunit.client.0.trial028.stdout: 10 13048 66.36 MB/sec warmup 13 sec latency 677.918 ms 2026-02-20T03:28:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.783+0000 7fef5c90e640 1 -- 10.20.193.28:0/3406287123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef58109ba0 msgr2=0x7fef58115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.783+0000 7fef5c90e640 1 --2- 10.20.193.28:0/3406287123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef58109ba0 0x7fef58115d10 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00b0a0 tx=0x7fef4c02f410 comp rx=0 tx=0).stop 2026-02-20T03:28:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.783+0000 7fef5c90e640 1 -- 10.20.193.28:0/3406287123 shutdown_connections 2026-02-20T03:28:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.783+0000 7fef5c90e640 1 --2- 10.20.193.28:0/3406287123 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef58109ba0 0x7fef58115d10 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.783+0000 7fef5c90e640 1 --2- 10.20.193.28:0/3406287123 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef58109220 0x7fef58109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.783+0000 7fef5c90e640 1 --2- 10.20.193.28:0/3406287123 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef5810eef0 0x7fef5810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.783+0000 7fef5c90e640 1 -- 10.20.193.28:0/3406287123 >> 10.20.193.28:0/3406287123 conn(0x7fef58078600 msgr2=0x7fef5807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.783+0000 7fef5c90e640 1 -- 10.20.193.28:0/3406287123 shutdown_connections 2026-02-20T03:28:42.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.784+0000 7fef5c90e640 1 -- 10.20.193.28:0/3406287123 wait complete. 2026-02-20T03:28:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.784+0000 7fef5c90e640 1 Processor -- start 2026-02-20T03:28:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.784+0000 7fef5c90e640 1 -- start start 2026-02-20T03:28:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef5c90e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef58109220 0x7fef581a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef5c90e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef58109ba0 0x7fef581a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef5c90e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef5810eef0 0x7fef581a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef5c90e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef581190a0 con 0x7fef58109220 2026-02-20T03:28:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef5c90e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fef58118f20 con 0x7fef5810eef0 2026-02-20T03:28:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef5c90e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef58119220 con 0x7fef58109ba0 2026-02-20T03:28:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef56ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef58109ba0 0x7fef581a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef58109220 0x7fef581a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef56ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef58109ba0 0x7fef581a19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38544/0 (socket says 10.20.193.28:38544) 2026-02-20T03:28:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef56ffd640 1 -- 10.20.193.28:0/1662089051 learned_addr learned my addr 10.20.193.28:0/1662089051 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:42.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef57fff640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef5810eef0 0x7fef581a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef577fe640 1 -- 10.20.193.28:0/1662089051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef58109ba0 msgr2=0x7fef581a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef577fe640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef58109ba0 0x7fef581a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef577fe640 1 -- 10.20.193.28:0/1662089051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef5810eef0 msgr2=0x7fef581a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef577fe640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef5810eef0 0x7fef581a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef577fe640 1 -- 10.20.193.28:0/1662089051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef581a64b0 con 0x7fef58109220 2026-02-20T03:28:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef577fe640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef58109220 0x7fef581a1460 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fef4400e9f0 tx=0x7fef4400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.785+0000 7fef54ff9640 1 -- 10.20.193.28:0/1662089051 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4400cd80 con 0x7fef58109220 2026-02-20T03:28:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.786+0000 7fef54ff9640 1 -- 10.20.193.28:0/1662089051 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef44004570 con 0x7fef58109220 2026-02-20T03:28:42.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.786+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef581a67a0 con 0x7fef58109220 2026-02-20T03:28:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.786+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef581adfe0 con 0x7fef58109220 2026-02-20T03:28:42.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.786+0000 7fef54ff9640 1 -- 10.20.193.28:0/1662089051 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44010690 con 0x7fef58109220 2026-02-20T03:28:42.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.786+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef5810a580 con 0x7fef58109220 2026-02-20T03:28:42.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.790+0000 7fef54ff9640 1 -- 10.20.193.28:0/1662089051 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fef44002890 con 0x7fef58109220 2026-02-20T03:28:42.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.791+0000 7fef54ff9640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef2c0b0f70 0x7fef2c0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:42.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.792+0000 7fef54ff9640 1 -- 10.20.193.28:0/1662089051 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fef440e0ea0 con 0x7fef58109220 2026-02-20T03:28:42.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.792+0000 7fef54ff9640 1 -- 10.20.193.28:0/1662089051 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fef440e12c0 con 0x7fef58109220 2026-02-20T03:28:42.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.792+0000 7fef56ffd640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef2c0b0f70 0x7fef2c0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:42.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.792+0000 7fef56ffd640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef2c0b0f70 0x7fef2c0b3430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fef5810e550 tx=0x7fef48009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:42.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.904+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef58109660 con 0x7fef58109220 2026-02-20T03:28:42.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.904+0000 7fef54ff9640 1 -- 10.20.193.28:0/1662089051 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11922 (secure 0 0 0) 0x7fef440a9300 con 0x7fef58109220 2026-02-20T03:28:42.909 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:28:42.909 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":31,"btime":"2026-02-20T03:28:34:277399+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:28:33.470867+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27367":{"gid":27367,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/3766107775","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":3766107775},{"type":"v1","addr":"10.20.193.177:6837","nonce":3766107775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:28:42.910 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 31 2026-02-20T03:28:42.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.906+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef2c0b0f70 msgr2=0x7fef2c0b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.906+0000 7fef5c90e640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef2c0b0f70 0x7fef2c0b3430 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fef5810e550 tx=0x7fef48009290 comp rx=0 tx=0).stop 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.906+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef58109220 msgr2=0x7fef581a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.906+0000 7fef5c90e640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef58109220 0x7fef581a1460 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fef4400e9f0 tx=0x7fef4400eec0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.906+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 shutdown_connections 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.906+0000 7fef5c90e640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef2c0b0f70 0x7fef2c0b3430 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.906+0000 7fef5c90e640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef5810eef0 0x7fef581a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.906+0000 7fef5c90e640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef58109ba0 0x7fef581a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.907+0000 7fef5c90e640 1 --2- 10.20.193.28:0/1662089051 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef58109220 0x7fef581a1460 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.907+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 >> 10.20.193.28:0/1662089051 conn(0x7fef58078600 msgr2=0x7fef58079d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.907+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 shutdown_connections 2026-02-20T03:28:42.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:42.907+0000 7fef5c90e640 1 -- 10.20.193.28:0/1662089051 wait complete. 2026-02-20T03:28:43.036 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:28:43.369 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:43.492 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:43 trial028 ceph-mon[38552]: pgmap v603: 129 pgs: 129 active+clean; 204 MiB data, 4.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 5.4 MiB/s wr, 815 op/s 2026-02-20T03:28:43.493 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:43 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1662089051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:28:43.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.567+0000 7f7e53fff640 1 -- 10.20.193.28:0/2938979940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e54102700 msgr2=0x7f7e54102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:43.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.567+0000 7f7e53fff640 1 --2- 10.20.193.28:0/2938979940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e54102700 0x7f7e54102b60 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009990 tx=0x7f7e3c02f170 comp rx=0 tx=0).stop 2026-02-20T03:28:43.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.567+0000 7f7e53fff640 1 -- 10.20.193.28:0/2938979940 shutdown_connections 2026-02-20T03:28:43.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.567+0000 7f7e53fff640 1 --2- 10.20.193.28:0/2938979940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e541030a0 0x7f7e5410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.567+0000 7f7e53fff640 1 --2- 10.20.193.28:0/2938979940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e54102700 0x7f7e54102b60 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.567+0000 7f7e53fff640 1 --2- 10.20.193.28:0/2938979940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e54108700 0x7f7e54108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.567+0000 7f7e53fff640 1 -- 10.20.193.28:0/2938979940 >> 10.20.193.28:0/2938979940 conn(0x7f7e540fe440 msgr2=0x7f7e54100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:43.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.567+0000 7f7e53fff640 1 -- 10.20.193.28:0/2938979940 shutdown_connections 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.567+0000 7f7e53fff640 1 -- 10.20.193.28:0/2938979940 wait complete. 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.568+0000 7f7e53fff640 1 Processor -- start 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.568+0000 7f7e53fff640 1 -- start start 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.568+0000 7f7e53fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e54102700 0x7f7e5419d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.568+0000 7f7e53fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e541030a0 0x7f7e5419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.568+0000 7f7e53fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e54108700 0x7f7e541a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e52ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e54102700 0x7f7e5419d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e52ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e54102700 0x7f7e5419d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55314/0 (socket says 10.20.193.28:55314) 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e52ffd640 1 -- 10.20.193.28:0/1252290573 learned_addr learned my addr 10.20.193.28:0/1252290573 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7e54112930 con 0x7f7e54108700 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7e541127b0 con 0x7f7e54102700 2026-02-20T03:28:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7e54112ab0 con 0x7f7e541030a0 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e537fe640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e54108700 0x7f7e541a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e527fc640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e541030a0 0x7f7e5419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e52ffd640 1 -- 10.20.193.28:0/1252290573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e541030a0 msgr2=0x7f7e5419d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e541030a0 0x7f7e5419d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e52ffd640 1 -- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e54108700 msgr2=0x7f7e541a1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e54108700 0x7f7e541a1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e52ffd640 1 -- 10.20.193.28:0/1252290573 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e541a2110 con 0x7f7e54102700 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.569+0000 7f7e537fe640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e54108700 0x7f7e541a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.570+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e54102700 0x7f7e5419d0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009610 tx=0x7f7e4800e860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.570+0000 7f7e58856640 1 -- 10.20.193.28:0/1252290573 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480040d0 con 0x7f7e54102700 2026-02-20T03:28:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.570+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e541a23a0 con 0x7f7e54102700 2026-02-20T03:28:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.570+0000 7f7e58856640 1 -- 10.20.193.28:0/1252290573 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e48018070 con 0x7f7e54102700 2026-02-20T03:28:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.570+0000 7f7e58856640 1 -- 10.20.193.28:0/1252290573 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480139b0 con 0x7f7e54102700 2026-02-20T03:28:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.570+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e541a9c40 con 0x7f7e54102700 2026-02-20T03:28:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.572+0000 7f7e58856640 1 -- 10.20.193.28:0/1252290573 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7e48004270 con 0x7f7e54102700 2026-02-20T03:28:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.573+0000 7f7e5bd5de00 1 Processor -- start 2026-02-20T03:28:43.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.574+0000 7f7e5bd5de00 1 -- start start 2026-02-20T03:28:43.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.574+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b497fb0 0x56290b498390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.574+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b4925e0 0x56290b492a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.574+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b49ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.574+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56290b412e00 con 0x56290b4925e0 2026-02-20T03:28:43.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.574+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56290b3e5970 con 0x56290b497fb0 2026-02-20T03:28:43.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.574+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56290b3931f0 con 0x56290b492f60 2026-02-20T03:28:43.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.575+0000 7f7e537fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b497fb0 0x56290b498390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.575+0000 7f7e537fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b497fb0 0x56290b498390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55320/0 (socket says 10.20.193.28:55320) 2026-02-20T03:28:43.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.575+0000 7f7e537fe640 1 -- 10.20.193.28:0/3022951108 learned_addr learned my addr 10.20.193.28:0/3022951108 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:43.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.575+0000 7f7e58856640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e280b0e20 0x7f7e280b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.575+0000 7f7e58856640 1 -- 10.20.193.28:0/1252290573 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7e480e0c30 con 0x7f7e54102700 2026-02-20T03:28:43.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.575+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b4925e0 0x56290b492a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.575+0000 7f7e527fc640 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b49ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.575+0000 7f7e537fe640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e280b0e20 0x7f7e280b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e537fe640 1 -- 10.20.193.28:0/3022951108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 msgr2=0x56290b49ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:43.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e537fe640 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b49ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e537fe640 1 -- 10.20.193.28:0/3022951108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b4925e0 msgr2=0x56290b492a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e537fe640 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b4925e0 0x56290b492a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e537fe640 1 -- 10.20.193.28:0/3022951108 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290b3a63d0 con 0x56290b497fb0 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e527fc640 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b49ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b4925e0 0x56290b492a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e537fe640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e280b0e20 0x7f7e280b32e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7e44014710 tx=0x7f7e4400e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e537fe640 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b497fb0 0x56290b498390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009ea0 tx=0x7f7e44002ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e45ffc0d21c73f7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e17fff640 1 -- 10.20.193.28:0/3022951108 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44009820 con 0x56290b497fb0 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.576+0000 7f7e17fff640 1 -- 10.20.193.28:0/3022951108 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e44023070 con 0x56290b497fb0 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.577+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3022951108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b497fb0 msgr2=0x56290b498390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.577+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b497fb0 0x56290b498390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009ea0 tx=0x7f7e44002ab0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.577+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3022951108 shutdown_connections 2026-02-20T03:28:43.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.577+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b49ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.577+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b4925e0 0x56290b492a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.577+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/3022951108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b497fb0 0x56290b498390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.577+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3022951108 >> 10.20.193.28:0/3022951108 conn(0x56290b455240 msgr2=0x56290b490ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:43.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.577+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3022951108 shutdown_connections 2026-02-20T03:28:43.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.577+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3022951108 wait complete. 2026-02-20T03:28:43.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.578+0000 7f7e5bd5de00 1 -- start start 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.578+0000 7f7e5bd5de00 1 Processor -- start 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.578+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 0x56290b4b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.578+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.578+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56290b3e18a0 con 0x56290b497fb0 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56290b1d3f50 con 0x56290b4925e0 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56290b4b58f0 con 0x56290b492f60 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35908/0 (socket says 10.20.193.28:35908) 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e537fe640 1 -- 10.20.193.28:0/1395236099 learned_addr learned my addr 10.20.193.28:0/1395236099 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:43.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 0x56290b4b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e527fc640 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e527fc640 1 -- 10.20.193.28:0/1395236099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 msgr2=0x56290b4b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e527fc640 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 0x56290b4b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e527fc640 1 -- 10.20.193.28:0/1395236099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 msgr2=0x56290b4b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e527fc640 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e527fc640 1 -- 10.20.193.28:0/1395236099 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290b4ad3f0 con 0x56290b492f60 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.579+0000 7f7e537fe640 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.580+0000 7f7e527fc640 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b4450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c02f680 tx=0x7f7e3c02ff40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=818bacb86bc4659c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.580+0000 7f7e157fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.580+0000 7f7e157fa640 1 -- 10.20.193.28:0/1395236099 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c049070 con 0x56290b492f60 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.580+0000 7f7e157fa640 1 -- 10.20.193.28:0/1395236099 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e3c033040 con 0x56290b492f60 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.580+0000 7f7e157fa640 1 -- 10.20.193.28:0/1395236099 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c004bc0 con 0x56290b492f60 2026-02-20T03:28:43.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.580+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/1395236099 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290b1b6b40 con 0x56290b492f60 2026-02-20T03:28:43.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.580+0000 7f7e5bd5de00 10 client.27973 _ll_register_callbacks cb 0x56290b41eeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:43.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.580+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/1395236099 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56290b3f3150 con 0x56290b492f60 2026-02-20T03:28:43.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.580+0000 7f7e157fa640 1 -- 10.20.193.28:0/1395236099 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7e3c004d60 con 0x56290b492f60 2026-02-20T03:28:43.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e157fa640 1 -- 10.20.193.28:0/1395236099 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7e3c038770 con 0x56290b492f60 2026-02-20T03:28:43.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e5bd5de00 10 client.27973 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:43.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/1395236099 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=31}) -- 0x56290b3a01e0 con 0x56290b492f60 2026-02-20T03:28:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e157fa640 1 -- 10.20.193.28:0/1395236099 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f7e3c056060 con 0x56290b492f60 2026-02-20T03:28:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e5bd5de00 10 client.27973 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e5bd5de00 10 client.27973 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:28:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e5bd5de00 20 client.27973 populate_metadata read hostname 'trial028' 2026-02-20T03:28:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56290b4c3d30 0x56290b4c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e5bd5de00 4 client.27973 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.581+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/1395236099 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56290b3ed560 con 0x56290b4c3d30 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.582+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56290b4c3d30 0x56290b4c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.583+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56290b4c3d30 0x56290b4c61d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=42409ad935eb1848 server_cookie=c8e75cb6f755d077 in_seq=0 out_seq=0 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.583+0000 7f7e157fa640 10 client.27973 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.583+0000 7f7e157fa640 1 -- 10.20.193.28:0/1395236099 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56290b3ed560 con 0x56290b4c3d30 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.583+0000 7f7e157fa640 10 client.27973 handle_command_reply: tid=0 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.583+0000 7f7e5bd5de00 1 client.27973 shutdown 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.583+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/1395236099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 msgr2=0x56290b4b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.583+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b4450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c02f680 tx=0x7f7e3c02ff40 comp rx=0 tx=0).stop 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.584+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/1395236099 shutdown_connections 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.584+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56290b4c3d30 0x56290b4c61d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.584+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.584+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b4450 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.584+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/1395236099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 0x56290b4b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.584+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/1395236099 >> 10.20.193.28:0/1395236099 conn(0x56290b455240 msgr2=0x56290b4913f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:43.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.585+0000 7f7e157fa640 0 client.27973 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:28:43.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.585+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/1395236099 shutdown_connections 2026-02-20T03:28:43.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.585+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/1395236099 wait complete. 2026-02-20T03:28:43.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.585+0000 7f7e5bd5de00 20 client.27973 trim_cache size 0 max 16384 2026-02-20T03:28:43.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e5bd5de00 1 Processor -- start 2026-02-20T03:28:43.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e5bd5de00 1 -- start start 2026-02-20T03:28:43.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 0x56290b48ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:43 trial126 ceph-mon[38476]: pgmap v603: 129 pgs: 129 active+clean; 204 MiB data, 4.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 5.4 MiB/s wr, 815 op/s 2026-02-20T03:28:43.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:43 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1662089051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:28:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7df8012660 con 0x56290b497fb0 2026-02-20T03:28:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7df800ff30 con 0x56290b4925e0 2026-02-20T03:28:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7df800dd80 con 0x56290b492f60 2026-02-20T03:28:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4914d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35916/0 (socket says 10.20.193.28:35916) 2026-02-20T03:28:43.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e537fe640 1 -- 10.20.193.28:0/3986202777 learned_addr learned my addr 10.20.193.28:0/3986202777 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.592+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 0x56290b48ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e527fc640 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e537fe640 1 -- 10.20.193.28:0/3986202777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 msgr2=0x56290b4b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e537fe640 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e537fe640 1 -- 10.20.193.28:0/3986202777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 msgr2=0x56290b48ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e537fe640 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 0x56290b48ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e537fe640 1 -- 10.20.193.28:0/3986202777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290b4ad220 con 0x56290b497fb0 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e527fc640 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 0x56290b48ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e537fe640 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4914d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7e440041c0 tx=0x7f7e44010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b9e57a202c13e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:43.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e177fe640 1 -- 10.20.193.28:0/3986202777 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44014e30 con 0x56290b497fb0 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e177fe640 1 -- 10.20.193.28:0/3986202777 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e44012df0 con 0x56290b497fb0 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.593+0000 7f7e177fe640 1 -- 10.20.193.28:0/3986202777 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44010a70 con 0x56290b497fb0 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3986202777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 msgr2=0x56290b4914d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4914d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f7e440041c0 tx=0x7f7e44010f70 comp rx=0 tx=0).stop 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3986202777 shutdown_connections 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b4914d0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b492f60 0x56290b4b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/3986202777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b4925e0 0x56290b48ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3986202777 >> 10.20.193.28:0/3986202777 conn(0x56290b455240 msgr2=0x56290b4b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3986202777 shutdown_connections 2026-02-20T03:28:43.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/3986202777 wait complete. 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 -- start start 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.594+0000 7f7e5bd5de00 1 Processor -- start 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.595+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b4925e0 0x56290b4bc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.595+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b492f60 0x56290b4bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.595+0000 7f7e5bd5de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b52dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.595+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7df800e3f0 con 0x56290b497fb0 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.595+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7df800f860 con 0x56290b492f60 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e5bd5de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7df800eac0 con 0x56290b4925e0 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b52dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b52dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35932/0 (socket says 10.20.193.28:35932) 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e537fe640 1 -- 10.20.193.28:0/2343794972 learned_addr learned my addr 10.20.193.28:0/2343794972 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e527fc640 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b492f60 0x56290b4bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b4925e0 0x56290b4bc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e537fe640 1 -- 10.20.193.28:0/2343794972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b4925e0 msgr2=0x56290b4bc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e537fe640 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b4925e0 0x56290b4bc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e537fe640 1 -- 10.20.193.28:0/2343794972 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b492f60 msgr2=0x56290b4bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e537fe640 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b492f60 0x56290b4bcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e537fe640 1 -- 10.20.193.28:0/2343794972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56290b0c4870 con 0x56290b497fb0 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e537fe640 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b52dcb0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009d40 tx=0x7f7e44011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7a2eab0b36308 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.596+0000 7f7e157fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:43.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e157fa640 1 -- 10.20.193.28:0/2343794972 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44011440 con 0x56290b497fb0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/2343794972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56290b3853f0 con 0x56290b497fb0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e5bd5de00 10 client.19224 _ll_register_callbacks cb 0x7f7e3c0097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/2343794972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56290b3b67c0 con 0x56290b497fb0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e157fa640 1 -- 10.20.193.28:0/2343794972 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7e44037030 con 0x56290b497fb0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e157fa640 1 -- 10.20.193.28:0/2343794972 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e44011440 con 0x56290b497fb0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e157fa640 1 -- 10.20.193.28:0/2343794972 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f7e44010810 con 0x56290b497fb0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e157fa640 1 -- 10.20.193.28:0/2343794972 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7e44041060 con 0x56290b497fb0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e5bd5de00 10 client.19224 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/2343794972 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x56290b4adf10 con 0x56290b497fb0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.597+0000 7f7e157fa640 1 -- 10.20.193.28:0/2343794972 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f7e4401d070 con 0x56290b497fb0 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.598+0000 7f7e5bd5de00 10 client.19224 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.598+0000 7f7e5bd5de00 10 client.19224 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:28:43.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.598+0000 7f7e5bd5de00 20 client.19224 populate_metadata read hostname 'trial028' 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.598+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56290b52f340 0x56290b531800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.598+0000 7f7e5bd5de00 4 client.19224 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.598+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/2343794972 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56290b397ab0 con 0x56290b52f340 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.598+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56290b52f340 0x56290b531800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.598+0000 7f7e52ffd640 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56290b52f340 0x56290b531800 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29fb273ba7ad780f server_cookie=e09dbaf52447225b in_seq=0 out_seq=0 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.598+0000 7f7e157fa640 10 client.19224 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e157fa640 1 -- 10.20.193.28:0/2343794972 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56290b397ab0 con 0x56290b52f340 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e157fa640 10 client.19224 handle_command_reply: tid=0 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 client.19224 shutdown 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/2343794972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 msgr2=0x56290b52dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:43.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b52dcb0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009d40 tx=0x7f7e44011df0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/2343794972 shutdown_connections 2026-02-20T03:28:43.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56290b52f340 0x56290b531800 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56290b497fb0 0x56290b52dcb0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56290b492f60 0x56290b4bcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 --2- 10.20.193.28:0/2343794972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56290b4925e0 0x56290b4bc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.607 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:28:43.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/2343794972 >> 10.20.193.28:0/2343794972 conn(0x56290b455240 msgr2=0x56290b4b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:43.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e157fa640 0 client.19224 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:28:43.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/2343794972 shutdown_connections 2026-02-20T03:28:43.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.599+0000 7f7e5bd5de00 1 -- 10.20.193.28:0/2343794972 wait complete. 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e5bd5de00 20 client.19224 trim_cache size 0 max 16384 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e280b0e20 msgr2=0x7f7e280b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e280b0e20 0x7f7e280b32e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7e44014710 tx=0x7f7e4400e000 comp rx=0 tx=0).stop 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e54102700 msgr2=0x7f7e5419d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e54102700 0x7f7e5419d0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7e48009610 tx=0x7f7e4800e860 comp rx=0 tx=0).stop 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 shutdown_connections 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7e280b0e20 0x7f7e280b32e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7e54108700 0x7f7e541a1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7e541030a0 0x7f7e5419d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 --2- 10.20.193.28:0/1252290573 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7e54102700 0x7f7e5419d0c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:43.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 >> 10.20.193.28:0/1252290573 conn(0x7f7e540fe440 msgr2=0x7f7e5410df10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:43.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 shutdown_connections 2026-02-20T03:28:43.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:43.600+0000 7f7e53fff640 1 -- 10.20.193.28:0/1252290573 wait complete. 2026-02-20T03:28:43.694 INFO:tasks.workunit.client.0.trial028.stdout: 10 14324 68.40 MB/sec warmup 14 sec latency 24.344 ms 2026-02-20T03:28:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:43 trial177 ceph-mon[43181]: pgmap v603: 129 pgs: 129 active+clean; 204 MiB data, 4.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.0 MiB/s rd, 5.4 MiB/s wr, 815 op/s 2026-02-20T03:28:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:43 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1662089051' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:28:43.747 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:28:44.017 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:44.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.264+0000 7f2bd0eae640 1 -- 10.20.193.28:0/2473551266 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bcc10a470 msgr2=0x7f2bcc1114d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.264+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/2473551266 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bcc10a470 0x7f2bcc1114d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009a30 tx=0x7f2bc002f260 comp rx=0 tx=0).stop 2026-02-20T03:28:44.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.265+0000 7f2bd0eae640 1 -- 10.20.193.28:0/2473551266 shutdown_connections 2026-02-20T03:28:44.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.265+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/2473551266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bcc11c780 0x7f2bcc11eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.265+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/2473551266 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bcc10a850 0x7f2bcc10acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.265+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/2473551266 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bcc10a470 0x7f2bcc1114d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.265+0000 7f2bd0eae640 1 -- 10.20.193.28:0/2473551266 >> 10.20.193.28:0/2473551266 conn(0x7f2bcc06ec00 msgr2=0x7f2bcc06f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.265+0000 7f2bd0eae640 1 -- 10.20.193.28:0/2473551266 shutdown_connections 2026-02-20T03:28:44.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.265+0000 7f2bd0eae640 1 -- 10.20.193.28:0/2473551266 wait complete. 2026-02-20T03:28:44.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.266+0000 7f2bd0eae640 1 Processor -- start 2026-02-20T03:28:44.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.266+0000 7f2bd0eae640 1 -- start start 2026-02-20T03:28:44.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.266+0000 7f2bd0eae640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bcc10a470 0x7f2bcc1aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bd0eae640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bcc10a850 0x7f2bcc1aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bca575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bcc10a470 0x7f2bcc1aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bd0eae640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bcc11c780 0x7f2bcc1aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bd0eae640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc121d10 con 0x7f2bcc10a470 2026-02-20T03:28:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bd0eae640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc121b90 con 0x7f2bcc10a850 2026-02-20T03:28:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bd0eae640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2bcc121e90 con 0x7f2bcc11c780 2026-02-20T03:28:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bca575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bcc10a470 0x7f2bcc1aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35948/0 (socket says 10.20.193.28:35948) 2026-02-20T03:28:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bc9d74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bcc10a850 0x7f2bcc1aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bcad76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bcc11c780 0x7f2bcc1aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bc9d74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bcc10a850 0x7f2bcc1aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55376/0 (socket says 10.20.193.28:55376) 2026-02-20T03:28:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bca575640 1 -- 10.20.193.28:0/48587000 learned_addr learned my addr 10.20.193.28:0/48587000 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.267+0000 7f2bcad76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bcc11c780 0x7f2bcc1aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38612/0 (socket says 10.20.193.28:38612) 2026-02-20T03:28:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.268+0000 7f2bc9d74640 1 -- 10.20.193.28:0/48587000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bcc11c780 msgr2=0x7f2bcc1aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.268+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bcc11c780 0x7f2bcc1aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.268+0000 7f2bc9d74640 1 -- 10.20.193.28:0/48587000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bcc10a470 msgr2=0x7f2bcc1aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.268+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bcc10a470 0x7f2bcc1aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.268+0000 7f2bc9d74640 1 -- 10.20.193.28:0/48587000 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bcc1af1a0 con 0x7f2bcc10a850 2026-02-20T03:28:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.269+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bcc10a850 0x7f2bcc1aa690 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400e9f0 tx=0x7f2bb400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.269+0000 7f2bb37fe640 1 -- 10.20.193.28:0/48587000 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb400cd80 con 0x7f2bcc10a850 2026-02-20T03:28:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.269+0000 7f2bd0eae640 1 -- 10.20.193.28:0/48587000 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bcc1af490 con 0x7f2bcc10a850 2026-02-20T03:28:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.269+0000 7f2bd0eae640 1 -- 10.20.193.28:0/48587000 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bcc1b6cd0 con 0x7f2bcc10a850 2026-02-20T03:28:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.269+0000 7f2bb37fe640 1 -- 10.20.193.28:0/48587000 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bb4004570 con 0x7f2bcc10a850 2026-02-20T03:28:44.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.269+0000 7f2bb37fe640 1 -- 10.20.193.28:0/48587000 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4010690 con 0x7f2bcc10a850 2026-02-20T03:28:44.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.272+0000 7f2bb37fe640 1 -- 10.20.193.28:0/48587000 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2bb4020030 con 0x7f2bcc10a850 2026-02-20T03:28:44.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.273+0000 7f2bb37fe640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2ba40b0e20 0x7f2ba40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.273+0000 7f2bb37fe640 1 -- 10.20.193.28:0/48587000 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f2bb40e1a60 con 0x7f2bcc10a850 2026-02-20T03:28:44.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.274+0000 7f2bca575640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2ba40b0e20 0x7f2ba40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.277+0000 7f2bca575640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2ba40b0e20 0x7f2ba40b32e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00097c0 tx=0x7f2bc0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.277+0000 7f2bd33b3e00 1 Processor -- start 2026-02-20T03:28:44.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.277+0000 7f2bd33b3e00 1 -- start start 2026-02-20T03:28:44.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.277+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.278+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b389a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.278+0000 7f2bca575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.278+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 0x55c5e0b40c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.278+0000 7f2bc9d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b389a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.278+0000 7f2bc9d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b389a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38624/0 (socket says 10.20.193.28:38624) 2026-02-20T03:28:44.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.278+0000 7f2bca575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55380/0 (socket says 10.20.193.28:55380) 2026-02-20T03:28:44.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.278+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5e0ab4e00 con 0x55c5e0b390d0 2026-02-20T03:28:44.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.278+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c5e0a87970 con 0x55c5e0b345e0 2026-02-20T03:28:44.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.278+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c5e0a351f0 con 0x55c5e0b34f90 2026-02-20T03:28:44.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.279+0000 7f2bc9d74640 1 -- 10.20.193.28:0/2298046382 learned_addr learned my addr 10.20.193.28:0/2298046382 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.279+0000 7f2bcad76640 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 0x55c5e0b40c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.279+0000 7f2bc9d74640 1 -- 10.20.193.28:0/2298046382 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 msgr2=0x55c5e0b349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.279+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.279+0000 7f2bc9d74640 1 -- 10.20.193.28:0/2298046382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 msgr2=0x55c5e0b40c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.279+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 0x55c5e0b40c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.279+0000 7f2bc9d74640 1 -- 10.20.193.28:0/2298046382 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e0a483d0 con 0x55c5e0b34f90 2026-02-20T03:28:44.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.279+0000 7f2bca575640 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:44.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.280+0000 7f2bcad76640 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 0x55c5e0b40c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:44.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.280+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b389a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40a9440 tx=0x7f2bb40a9e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77b80307c4bfbb5c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.280+0000 7f2bb0ff9640 1 -- 10.20.193.28:0/2298046382 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40026e0 con 0x55c5e0b34f90 2026-02-20T03:28:44.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.280+0000 7f2bb0ff9640 1 -- 10.20.193.28:0/2298046382 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bb40a5780 con 0x55c5e0b34f90 2026-02-20T03:28:44.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.280+0000 7f2bb0ff9640 1 -- 10.20.193.28:0/2298046382 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb40a4e60 con 0x55c5e0b34f90 2026-02-20T03:28:44.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.281+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/2298046382 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 msgr2=0x55c5e0b389a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.281+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b389a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40a9440 tx=0x7f2bb40a9e40 comp rx=0 tx=0).stop 2026-02-20T03:28:44.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.281+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/2298046382 shutdown_connections 2026-02-20T03:28:44.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.281+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 0x55c5e0b40c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.281+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b389a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.281+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/2298046382 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.281+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/2298046382 >> 10.20.193.28:0/2298046382 conn(0x55c5e0af7240 msgr2=0x55c5e0b32ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.282+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/2298046382 shutdown_connections 2026-02-20T03:28:44.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.282+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/2298046382 wait complete. 2026-02-20T03:28:44.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.283+0000 7f2bd33b3e00 1 -- start start 2026-02-20T03:28:44.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.283+0000 7f2bd33b3e00 1 Processor -- start 2026-02-20T03:28:44.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.284+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.284+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b34f90 0x55c5e0b4ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.284+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b390d0 0x55c5e0b4d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.284+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5e0a838a0 con 0x55c5e0b34f90 2026-02-20T03:28:44.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.284+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c5e0875f50 con 0x55c5e0b345e0 2026-02-20T03:28:44.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.284+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c5e0b4d880 con 0x55c5e0b390d0 2026-02-20T03:28:44.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.284+0000 7f2bca575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.285+0000 7f2bca575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55382/0 (socket says 10.20.193.28:55382) 2026-02-20T03:28:44.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.285+0000 7f2bca575640 1 -- 10.20.193.28:0/1242495097 learned_addr learned my addr 10.20.193.28:0/1242495097 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.285+0000 7f2bcad76640 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b390d0 0x55c5e0b4d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.285+0000 7f2bc9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b34f90 0x55c5e0b4ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.285+0000 7f2bca575640 1 -- 10.20.193.28:0/1242495097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b390d0 msgr2=0x55c5e0b4d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.285+0000 7f2bca575640 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b390d0 0x55c5e0b4d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.285+0000 7f2bca575640 1 -- 10.20.193.28:0/1242495097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b34f90 msgr2=0x55c5e0b4ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.285+0000 7f2bca575640 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b34f90 0x55c5e0b4ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.286+0000 7f2bca575640 1 -- 10.20.193.28:0/1242495097 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e0b468b0 con 0x55c5e0b345e0 2026-02-20T03:28:44.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.286+0000 7f2bca575640 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4e9c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0030d10 tx=0x7f2bc0009340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b25dfa9ba68093c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.286+0000 7f2b8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:28:44.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.286+0000 7f2b8bfff640 1 -- 10.20.193.28:0/1242495097 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0053020 con 0x55c5e0b345e0 2026-02-20T03:28:44.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.286+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/1242495097 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5e0858b40 con 0x55c5e0b345e0 2026-02-20T03:28:44.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.286+0000 7f2bd33b3e00 10 client.28004 _ll_register_callbacks cb 0x55c5e0ac0eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:44.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.286+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/1242495097 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c5e0a95150 con 0x55c5e0b345e0 2026-02-20T03:28:44.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.286+0000 7f2b8bfff640 1 -- 10.20.193.28:0/1242495097 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bc0033040 con 0x55c5e0b345e0 2026-02-20T03:28:44.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.286+0000 7f2b8bfff640 1 -- 10.20.193.28:0/1242495097 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0043b00 con 0x55c5e0b345e0 2026-02-20T03:28:44.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.287+0000 7f2b8bfff640 1 -- 10.20.193.28:0/1242495097 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f2bc00044f0 con 0x55c5e0b345e0 2026-02-20T03:28:44.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.287+0000 7f2b8bfff640 1 -- 10.20.193.28:0/1242495097 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2bc0002e30 con 0x55c5e0b345e0 2026-02-20T03:28:44.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.287+0000 7f2bd33b3e00 10 client.28004 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:44.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.287+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/1242495097 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55c5e0a421e0 con 0x55c5e0b345e0 2026-02-20T03:28:44.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.288+0000 7f2b8bfff640 1 -- 10.20.193.28:0/1242495097 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f2bc0043ca0 con 0x55c5e0b345e0 2026-02-20T03:28:44.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.288+0000 7f2bd33b3e00 10 client.28004 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:44.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.288+0000 7f2bd33b3e00 10 client.28004 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:28:44.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.288+0000 7f2bd33b3e00 20 client.28004 populate_metadata read hostname 'trial028' 2026-02-20T03:28:44.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.288+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c5e0b5d110 0x55c5e0b5f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.288+0000 7f2bd33b3e00 4 client.28004 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:44.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.288+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/1242495097 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5e0a8f560 con 0x55c5e0b5d110 2026-02-20T03:28:44.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.288+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c5e0b5d110 0x55c5e0b5f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.289+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c5e0b5d110 0x55c5e0b5f560 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d158bd7deca1a7a6 server_cookie=6ee5bec99f0bfcbe in_seq=0 out_seq=0 2026-02-20T03:28:44.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.289+0000 7f2b8bfff640 10 client.28004 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:28:44.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.290+0000 7f2b8bfff640 1 -- 10.20.193.28:0/1242495097 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c5e0a8f560 con 0x55c5e0b5d110 2026-02-20T03:28:44.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.290+0000 7f2b8bfff640 10 client.28004 handle_command_reply: tid=0 2026-02-20T03:28:44.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.290+0000 7f2bd33b3e00 1 client.28004 shutdown 2026-02-20T03:28:44.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.290+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/1242495097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 msgr2=0x55c5e0b4e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.290+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4e9c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0030d10 tx=0x7f2bc0009340 comp rx=0 tx=0).stop 2026-02-20T03:28:44.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/1242495097 shutdown_connections 2026-02-20T03:28:44.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c5e0b5d110 0x55c5e0b5f560 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b390d0 0x55c5e0b4d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b34f90 0x55c5e0b4ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/1242495097 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4e9c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/1242495097 >> 10.20.193.28:0/1242495097 conn(0x55c5e0af7240 msgr2=0x55c5e0b304b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2b8bfff640 0 client.28004 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:28:44.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/1242495097 shutdown_connections 2026-02-20T03:28:44.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/1242495097 wait complete. 2026-02-20T03:28:44.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.291+0000 7f2bd33b3e00 20 client.28004 trim_cache size 0 max 16384 2026-02-20T03:28:44.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.301+0000 7f2bd33b3e00 1 Processor -- start 2026-02-20T03:28:44.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.301+0000 7f2bd33b3e00 1 -- start start 2026-02-20T03:28:44.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.301+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.302+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b34f90 0x55c5e0b4ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.302+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b390d0 0x55c5e0b38030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.302+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70012770 con 0x55c5e0b34f90 2026-02-20T03:28:44.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.302+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b70010040 con 0x55c5e0b390d0 2026-02-20T03:28:44.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.302+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000de90 con 0x55c5e0b345e0 2026-02-20T03:28:44.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.302+0000 7f2bcad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b390d0 0x55c5e0b38030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.302+0000 7f2bca575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.302+0000 7f2bca575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38634/0 (socket says 10.20.193.28:38634) 2026-02-20T03:28:44.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.302+0000 7f2bca575640 1 -- 10.20.193.28:0/3303647709 learned_addr learned my addr 10.20.193.28:0/3303647709 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.303+0000 7f2bca575640 1 -- 10.20.193.28:0/3303647709 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b390d0 msgr2=0x55c5e0b38030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.303+0000 7f2bca575640 1 --2- 10.20.193.28:0/3303647709 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b390d0 0x55c5e0b38030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.303+0000 7f2bca575640 1 -- 10.20.193.28:0/3303647709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b34f90 msgr2=0x55c5e0b4ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.303+0000 7f2bca575640 1 --2- 10.20.193.28:0/3303647709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b34f90 0x55c5e0b4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.303+0000 7f2bca575640 1 -- 10.20.193.28:0/3303647709 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e0b466e0 con 0x55c5e0b345e0 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.303+0000 7f2bca575640 1 --2- 10.20.193.28:0/3303647709 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4a750 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0031020 tx=0x7f2bc0050000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=180c60de49263623 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2b964e6640 1 -- 10.20.193.28:0/3303647709 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0053070 con 0x55c5e0b345e0 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2b964e6640 1 -- 10.20.193.28:0/3303647709 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2bc0033040 con 0x55c5e0b345e0 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2b964e6640 1 -- 10.20.193.28:0/3303647709 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0043b20 con 0x55c5e0b345e0 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/3303647709 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b345e0 msgr2=0x55c5e0b4a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/3303647709 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4a750 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0031020 tx=0x7f2bc0050000 comp rx=0 tx=0).stop 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/3303647709 shutdown_connections 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/3303647709 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b390d0 0x55c5e0b38030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/3303647709 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b34f90 0x55c5e0b4ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/3303647709 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b345e0 0x55c5e0b4a750 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/3303647709 >> 10.20.193.28:0/3303647709 conn(0x55c5e0af7240 msgr2=0x55c5e0b5f120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.304+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/3303647709 shutdown_connections 2026-02-20T03:28:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.305+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/3303647709 wait complete. 2026-02-20T03:28:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.306+0000 7f2bd33b3e00 1 -- start start 2026-02-20T03:28:44.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.306+0000 7f2bd33b3e00 1 Processor -- start 2026-02-20T03:28:44.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.308+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b51a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.308+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b51f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.309+0000 7f2bca575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b51a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.309+0000 7f2bca575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b51a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55412/0 (socket says 10.20.193.28:55412) 2026-02-20T03:28:44.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.309+0000 7f2bc9d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b51f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.309+0000 7f2bc9d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b51f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38650/0 (socket says 10.20.193.28:38650) 2026-02-20T03:28:44.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.309+0000 7f2bd33b3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 0x55c5e0b524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.310+0000 7f2bd33b3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000e500 con 0x55c5e0b390d0 2026-02-20T03:28:44.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bc9d74640 1 -- 10.20.193.28:0/958920863 learned_addr learned my addr 10.20.193.28:0/958920863 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000f970 con 0x55c5e0b345e0 2026-02-20T03:28:44.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7000ebd0 con 0x55c5e0b34f90 2026-02-20T03:28:44.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bcad76640 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 0x55c5e0b524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:28:44.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:28:44.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:28:44.314 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:44 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:28:44.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bca575640 1 -- 10.20.193.28:0/958920863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 msgr2=0x55c5e0b51f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bca575640 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b51f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bca575640 1 -- 10.20.193.28:0/958920863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 msgr2=0x55c5e0b524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bca575640 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 0x55c5e0b524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bca575640 1 -- 10.20.193.28:0/958920863 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e0766870 con 0x55c5e0b345e0 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.311+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b51f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.312+0000 7f2bca575640 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b51a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005970 tx=0x7f2bc0009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82a7931384b5cfb3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.312+0000 7f2b8bfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.312+0000 7f2b8bfff640 1 -- 10.20.193.28:0/958920863 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0053040 con 0x55c5e0b345e0 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.312+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5e0a273f0 con 0x55c5e0b345e0 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.312+0000 7f2bd33b3e00 10 client.28010 _ll_register_callbacks cb 0x7f2bc0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.312+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c5e0a39ab0 con 0x55c5e0b345e0 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.312+0000 7f2b8bfff640 1 -- 10.20.193.28:0/958920863 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55c5e0a95150 con 0x55c5e0b345e0 2026-02-20T03:28:44.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.312+0000 7f2b8bfff640 1 -- 10.20.193.28:0/958920863 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0062990 con 0x55c5e0b345e0 2026-02-20T03:28:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.313+0000 7f2b8bfff640 1 -- 10.20.193.28:0/958920863 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f2bc0062b30 con 0x55c5e0b345e0 2026-02-20T03:28:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.313+0000 7f2b8bfff640 1 -- 10.20.193.28:0/958920863 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2bc0062e30 con 0x55c5e0b345e0 2026-02-20T03:28:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.313+0000 7f2bd33b3e00 10 client.28010 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.313+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55c5e0b473d0 con 0x55c5e0b345e0 2026-02-20T03:28:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.313+0000 7f2b8bfff640 1 -- 10.20.193.28:0/958920863 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f2bc0043860 con 0x55c5e0b345e0 2026-02-20T03:28:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.314+0000 7f2bd33b3e00 10 client.28010 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.314+0000 7f2bd33b3e00 10 client.28010 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:28:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.314+0000 7f2bd33b3e00 20 client.28010 populate_metadata read hostname 'trial028' 2026-02-20T03:28:44.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.314+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c5e0bc9270 0x55c5e0bcb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.314+0000 7f2bd33b3e00 4 client.28010 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:28:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.314+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f2bb40a5780 con 0x55c5e0bc9270 2026-02-20T03:28:44.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.314+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c5e0bc9270 0x55c5e0bcb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.315+0000 7f2b8bfff640 10 client.28010 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.315+0000 7f2bc9d74640 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c5e0bc9270 0x55c5e0bcb730 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=119e3bc79054b1e4 server_cookie=148f3c3c3d3ab5bb in_seq=0 out_seq=0 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.315+0000 7f2b8bfff640 1 -- 10.20.193.28:0/958920863 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f2bb40a5780 con 0x55c5e0bc9270 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.315+0000 7f2b8bfff640 10 client.28010 handle_command_reply: tid=0 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.315+0000 7f2bd33b3e00 1 client.28010 shutdown 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.315+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 msgr2=0x55c5e0b51a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.315+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b51a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0005970 tx=0x7f2bc0009300 comp rx=0 tx=0).stop 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 shutdown_connections 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55c5e0bc9270 0x55c5e0bcb730 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c5e0b390d0 0x55c5e0b524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c5e0b34f90 0x55c5e0b51f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2bd33b3e00 1 --2- 10.20.193.28:0/958920863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c5e0b345e0 0x55c5e0b51a30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 >> 10.20.193.28:0/958920863 conn(0x55c5e0af7240 msgr2=0x55c5e0b5f120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2b8bfff640 0 client.28010 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:28:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 shutdown_connections 2026-02-20T03:28:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2bd33b3e00 1 -- 10.20.193.28:0/958920863 wait complete. 2026-02-20T03:28:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.316+0000 7f2bd33b3e00 20 client.28010 trim_cache size 0 max 16384 2026-02-20T03:28:44.320 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:28:44.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.317+0000 7f2bd0eae640 1 -- 10.20.193.28:0/48587000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2ba40b0e20 msgr2=0x7f2ba40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.317+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2ba40b0e20 0x7f2ba40b32e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00097c0 tx=0x7f2bc0005e50 comp rx=0 tx=0).stop 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.317+0000 7f2bd0eae640 1 -- 10.20.193.28:0/48587000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bcc10a850 msgr2=0x7f2bcc1aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.317+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bcc10a850 0x7f2bcc1aa690 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2bb400e9f0 tx=0x7f2bb400eec0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.318+0000 7f2bd0eae640 1 -- 10.20.193.28:0/48587000 shutdown_connections 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.318+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2ba40b0e20 0x7f2ba40b32e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.318+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bcc11c780 0x7f2bcc1aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.318+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bcc10a850 0x7f2bcc1aa690 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.318+0000 7f2bd0eae640 1 --2- 10.20.193.28:0/48587000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bcc10a470 0x7f2bcc1aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.318+0000 7f2bd0eae640 1 -- 10.20.193.28:0/48587000 >> 10.20.193.28:0/48587000 conn(0x7f2bcc06ec00 msgr2=0x7f2bcc11d040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.318+0000 7f2bd0eae640 1 -- 10.20.193.28:0/48587000 shutdown_connections 2026-02-20T03:28:44.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.318+0000 7f2bd0eae640 1 -- 10.20.193.28:0/48587000 wait complete. 2026-02-20T03:28:44.445 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:28:44.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:28:44.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:28:44.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:28:44.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:44 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:28:44.694 INFO:tasks.workunit.client.0.trial028.stdout: 10 14925 65.10 MB/sec warmup 15 sec latency 58.951 ms 2026-02-20T03:28:44.717 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:44.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:28:44.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:28:44.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:28:44.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:44 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:28:44.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.921+0000 7fde31f11640 1 -- 10.20.193.28:0/1052363487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109bc0 msgr2=0x7fde2c115ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.921+0000 7fde31f11640 1 --2- 10.20.193.28:0/1052363487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109bc0 0x7fde2c115ea0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fde20009f90 tx=0x7fde2002f3d0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.921+0000 7fde31f11640 1 -- 10.20.193.28:0/1052363487 shutdown_connections 2026-02-20T03:28:44.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.921+0000 7fde31f11640 1 --2- 10.20.193.28:0/1052363487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109bc0 0x7fde2c115ea0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.922+0000 7fde31f11640 1 --2- 10.20.193.28:0/1052363487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde2c109220 0x7fde2c109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.922+0000 7fde31f11640 1 --2- 10.20.193.28:0/1052363487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fde2c10f1e0 0x7fde2c10f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.922+0000 7fde31f11640 1 -- 10.20.193.28:0/1052363487 >> 10.20.193.28:0/1052363487 conn(0x7fde2c078860 msgr2=0x7fde2c07ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.922+0000 7fde31f11640 1 -- 10.20.193.28:0/1052363487 shutdown_connections 2026-02-20T03:28:44.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.922+0000 7fde31f11640 1 -- 10.20.193.28:0/1052363487 wait complete. 2026-02-20T03:28:44.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.923+0000 7fde31f11640 1 Processor -- start 2026-02-20T03:28:44.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde31f11640 1 -- start start 2026-02-20T03:28:44.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde31f11640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109220 0x7fde2c1a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde31f11640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fde2c109bc0 0x7fde2c1a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde31f11640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde2c10f1e0 0x7fde2c1a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde31f11640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c1192a0 con 0x7fde2c109220 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde31f11640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c119120 con 0x7fde2c109bc0 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde31f11640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c119420 con 0x7fde2c10f1e0 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109220 0x7fde2c1a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109220 0x7fde2c1a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36008/0 (socket says 10.20.193.28:36008) 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde2b7fe640 1 -- 10.20.193.28:0/273356907 learned_addr learned my addr 10.20.193.28:0/273356907 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde2affd640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fde2c109bc0 0x7fde2c1a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.924+0000 7fde2bfff640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde2c10f1e0 0x7fde2c1a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.925+0000 7fde2b7fe640 1 -- 10.20.193.28:0/273356907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde2c10f1e0 msgr2=0x7fde2c1a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.925+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde2c10f1e0 0x7fde2c1a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.925+0000 7fde2b7fe640 1 -- 10.20.193.28:0/273356907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fde2c109bc0 msgr2=0x7fde2c1a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.925+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fde2c109bc0 0x7fde2c1a1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.925+0000 7fde2b7fe640 1 -- 10.20.193.28:0/273356907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c1a66b0 con 0x7fde2c109220 2026-02-20T03:28:44.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.925+0000 7fde2bfff640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde2c10f1e0 0x7fde2c1a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:44.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.925+0000 7fde2affd640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fde2c109bc0 0x7fde2c1a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:44.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.926+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109220 0x7fde2c1a1660 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fde1800ea10 tx=0x7fde1800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.926+0000 7fde28ff9640 1 -- 10.20.193.28:0/273356907 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1800ce50 con 0x7fde2c109220 2026-02-20T03:28:44.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.926+0000 7fde31f11640 1 -- 10.20.193.28:0/273356907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2c1a69a0 con 0x7fde2c109220 2026-02-20T03:28:44.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.927+0000 7fde31f11640 1 -- 10.20.193.28:0/273356907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2c1ae1e0 con 0x7fde2c109220 2026-02-20T03:28:44.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.927+0000 7fde28ff9640 1 -- 10.20.193.28:0/273356907 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fde18004570 con 0x7fde2c109220 2026-02-20T03:28:44.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.927+0000 7fde28ff9640 1 -- 10.20.193.28:0/273356907 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18010690 con 0x7fde2c109220 2026-02-20T03:28:44.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.930+0000 7fde28ff9640 1 -- 10.20.193.28:0/273356907 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fde180040d0 con 0x7fde2c109220 2026-02-20T03:28:44.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde34416e00 1 Processor -- start 2026-02-20T03:28:44.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde34416e00 1 -- start start 2026-02-20T03:28:44.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde28ff9640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fddfc0b1140 0x7fddfc0b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde34416e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde34416e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde34416e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde34416e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556691719e00 con 0x5566917af4e0 2026-02-20T03:28:44.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde34416e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5566916ec970 con 0x5566917aa9f0 2026-02-20T03:28:44.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde34416e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55669169a1f0 con 0x5566917ab3a0 2026-02-20T03:28:44.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde28ff9640 1 -- 10.20.193.28:0/273356907 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fde18010430 con 0x7fde2c109220 2026-02-20T03:28:44.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde2b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.931+0000 7fde2affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.932+0000 7fde2affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38686/0 (socket says 10.20.193.28:38686) 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.932+0000 7fde2b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55432/0 (socket says 10.20.193.28:55432) 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.932+0000 7fde2b7fe640 1 -- 10.20.193.28:0/3481264743 learned_addr learned my addr 10.20.193.28:0/3481264743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.932+0000 7fde2bfff640 1 --2- 10.20.193.28:0/3481264743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.932+0000 7fde2b7fe640 1 -- 10.20.193.28:0/3481264743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 msgr2=0x5566917aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.932+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/3481264743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.932+0000 7fde2b7fe640 1 -- 10.20.193.28:0/3481264743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 msgr2=0x5566917b7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.932+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/3481264743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.932+0000 7fde2b7fe640 1 -- 10.20.193.28:0/3481264743 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566916ad3d0 con 0x5566917aa9f0 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.933+0000 7fde2bfff640 1 --2- 10.20.193.28:0/3481264743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.933+0000 7fde2bfff640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fddfc0b1140 0x7fddfc0b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.933+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/3481264743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917aadd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c770 tx=0x7fde180b11e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=297e8059ba3f943b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.933+0000 7fddeffff640 1 -- 10.20.193.28:0/3481264743 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde180a5050 con 0x5566917aa9f0 2026-02-20T03:28:44.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.933+0000 7fddeffff640 1 -- 10.20.193.28:0/3481264743 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fde18005720 con 0x5566917aa9f0 2026-02-20T03:28:44.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.933+0000 7fddeffff640 1 -- 10.20.193.28:0/3481264743 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde180a51f0 con 0x5566917aa9f0 2026-02-20T03:28:44.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.933+0000 7fde34416e00 1 -- 10.20.193.28:0/3481264743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 msgr2=0x5566917aadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.933+0000 7fde34416e00 1 --2- 10.20.193.28:0/3481264743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917aadd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fde1800c770 tx=0x7fde180b11e0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.934+0000 7fde34416e00 1 -- 10.20.193.28:0/3481264743 shutdown_connections 2026-02-20T03:28:44.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.934+0000 7fde34416e00 1 --2- 10.20.193.28:0/3481264743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.934+0000 7fde34416e00 1 --2- 10.20.193.28:0/3481264743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.934+0000 7fde34416e00 1 --2- 10.20.193.28:0/3481264743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917aadd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.934+0000 7fde34416e00 1 -- 10.20.193.28:0/3481264743 >> 10.20.193.28:0/3481264743 conn(0x55669175c240 msgr2=0x556691797ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.934+0000 7fde34416e00 1 -- 10.20.193.28:0/3481264743 shutdown_connections 2026-02-20T03:28:44.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.935+0000 7fde34416e00 1 -- 10.20.193.28:0/3481264743 wait complete. 2026-02-20T03:28:44.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.935+0000 7fde2bfff640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fddfc0b1140 0x7fddfc0b3600 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fde20009790 tx=0x7fde2002f3d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.936+0000 7fde34416e00 1 -- start start 2026-02-20T03:28:44.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde34416e00 1 Processor -- start 2026-02-20T03:28:44.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde34416e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917aa9f0 0x5566917c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde34416e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917ab3a0 0x5566917c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde34416e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde34416e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5566916e88a0 con 0x5566917ab3a0 2026-02-20T03:28:44.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde34416e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5566914daf50 con 0x5566917af4e0 2026-02-20T03:28:44.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde34416e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5566917c9460 con 0x5566917aa9f0 2026-02-20T03:28:44.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde2b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917aa9f0 0x5566917c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde2b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917aa9f0 0x5566917c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38696/0 (socket says 10.20.193.28:38696) 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde2b7fe640 1 -- 10.20.193.28:0/3202944577 learned_addr learned my addr 10.20.193.28:0/3202944577 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde2bfff640 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.937+0000 7fde2affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917ab3a0 0x5566917c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.938+0000 7fde2b7fe640 1 -- 10.20.193.28:0/3202944577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 msgr2=0x5566917c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.938+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.938+0000 7fde2b7fe640 1 -- 10.20.193.28:0/3202944577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917ab3a0 msgr2=0x5566917c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.938+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917ab3a0 0x5566917c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.938+0000 7fde2b7fe640 1 -- 10.20.193.28:0/3202944577 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566917bcbf0 con 0x5566917aa9f0 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.938+0000 7fde2affd640 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917ab3a0 0x5566917c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.938+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917aa9f0 0x5566917c3480 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde18002410 tx=0x7fde180a43c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5563c9b4bf482c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.938+0000 7fdded7fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:28:44.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.938+0000 7fdded7fa640 1 -- 10.20.193.28:0/3202944577 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde180cf020 con 0x5566917aa9f0 2026-02-20T03:28:44.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.939+0000 7fdded7fa640 1 -- 10.20.193.28:0/3202944577 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fde18092030 con 0x5566917aa9f0 2026-02-20T03:28:44.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.939+0000 7fdded7fa640 1 -- 10.20.193.28:0/3202944577 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde180a53c0 con 0x5566917aa9f0 2026-02-20T03:28:44.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.939+0000 7fde34416e00 1 -- 10.20.193.28:0/3202944577 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566914bdb40 con 0x5566917aa9f0 2026-02-20T03:28:44.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.939+0000 7fde34416e00 10 client.28006 _ll_register_callbacks cb 0x556691725eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:44.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.939+0000 7fde34416e00 1 -- 10.20.193.28:0/3202944577 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566916fa150 con 0x5566917aa9f0 2026-02-20T03:28:44.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.939+0000 7fdded7fa640 1 -- 10.20.193.28:0/3202944577 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fde180a4e50 con 0x5566917aa9f0 2026-02-20T03:28:44.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.939+0000 7fdded7fa640 1 -- 10.20.193.28:0/3202944577 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fde180c2060 con 0x5566917aa9f0 2026-02-20T03:28:44.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.939+0000 7fde34416e00 10 client.28006 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:44.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.939+0000 7fde34416e00 1 -- 10.20.193.28:0/3202944577 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5566916a71e0 con 0x5566917aa9f0 2026-02-20T03:28:44.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.940+0000 7fdded7fa640 1 -- 10.20.193.28:0/3202944577 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fde180040d0 con 0x5566917aa9f0 2026-02-20T03:28:44.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.940+0000 7fde34416e00 10 client.28006 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:44.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.940+0000 7fde34416e00 10 client.28006 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:44.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.940+0000 7fde34416e00 20 client.28006 populate_metadata read hostname 'trial028' 2026-02-20T03:28:44.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.940+0000 7fde34416e00 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566917d3090 0x5566917d5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.940+0000 7fde34416e00 4 client.28006 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:44.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.940+0000 7fde34416e00 1 -- 10.20.193.28:0/3202944577 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566916f4560 con 0x5566917d3090 2026-02-20T03:28:44.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.941+0000 7fde2affd640 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566917d3090 0x5566917d5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.941+0000 7fde2affd640 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566917d3090 0x5566917d5480 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b487decc364bd2fc server_cookie=7d8fd69b6667647d in_seq=0 out_seq=0 2026-02-20T03:28:44.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.941+0000 7fdded7fa640 10 client.28006 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:44.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.945+0000 7fdded7fa640 1 -- 10.20.193.28:0/3202944577 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5566916f4560 con 0x5566917d3090 2026-02-20T03:28:44.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.945+0000 7fdded7fa640 10 client.28006 handle_command_reply: tid=0 2026-02-20T03:28:44.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.945+0000 7fde34416e00 1 client.28006 shutdown 2026-02-20T03:28:44.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fde34416e00 1 -- 10.20.193.28:0/3202944577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917aa9f0 msgr2=0x5566917c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fde34416e00 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917aa9f0 0x5566917c3480 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fde18002410 tx=0x7fde180a43c0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fde34416e00 1 -- 10.20.193.28:0/3202944577 shutdown_connections 2026-02-20T03:28:44.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fde34416e00 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566917d3090 0x5566917d5480 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fde34416e00 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fdded7fa640 0 client.28006 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:44.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fde34416e00 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917ab3a0 0x5566917c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fde34416e00 1 --2- 10.20.193.28:0/3202944577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917aa9f0 0x5566917c3480 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fde34416e00 1 -- 10.20.193.28:0/3202944577 >> 10.20.193.28:0/3202944577 conn(0x55669175c240 msgr2=0x5566917add00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.946+0000 7fde34416e00 1 -- 10.20.193.28:0/3202944577 shutdown_connections 2026-02-20T03:28:44.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.947+0000 7fde34416e00 1 -- 10.20.193.28:0/3202944577 wait complete. 2026-02-20T03:28:44.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.947+0000 7fde34416e00 20 client.28006 trim_cache size 0 max 16384 2026-02-20T03:28:44.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.954+0000 7fde34416e00 1 Processor -- start 2026-02-20T03:28:44.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.954+0000 7fde34416e00 1 -- start start 2026-02-20T03:28:44.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.954+0000 7fde34416e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.954+0000 7fde34416e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde34416e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde2affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde34416e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fddd00126f0 con 0x5566917af4e0 2026-02-20T03:28:44.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde34416e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fddd000ffc0 con 0x5566917aa9f0 2026-02-20T03:28:44.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde34416e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fddd000de10 con 0x5566917ab3a0 2026-02-20T03:28:44.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde2bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde2bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36028/0 (socket says 10.20.193.28:36028) 2026-02-20T03:28:44.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde2bfff640 1 -- 10.20.193.28:0/2120069423 learned_addr learned my addr 10.20.193.28:0/2120069423 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde2bfff640 1 -- 10.20.193.28:0/2120069423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 msgr2=0x5566917b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.955+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fde2bfff640 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fde2bfff640 1 -- 10.20.193.28:0/2120069423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 msgr2=0x5566917cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fde2bfff640 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fde2bfff640 1 -- 10.20.193.28:0/2120069423 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566917bca20 con 0x5566917af4e0 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fde2affd640 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fde2bfff640 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b0990 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fde20004190 tx=0x7fde20040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e1cf8c807ea20d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fddef7fe640 1 -- 10.20.193.28:0/2120069423 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde20038620 con 0x5566917af4e0 2026-02-20T03:28:44.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fddef7fe640 1 -- 10.20.193.28:0/2120069423 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fde20054070 con 0x5566917af4e0 2026-02-20T03:28:44.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.956+0000 7fddef7fe640 1 -- 10.20.193.28:0/2120069423 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2004fa20 con 0x5566917af4e0 2026-02-20T03:28:44.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.957+0000 7fde34416e00 1 -- 10.20.193.28:0/2120069423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 msgr2=0x5566917b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.957+0000 7fde34416e00 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b0990 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fde20004190 tx=0x7fde20040000 comp rx=0 tx=0).stop 2026-02-20T03:28:44.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.957+0000 7fde34416e00 1 -- 10.20.193.28:0/2120069423 shutdown_connections 2026-02-20T03:28:44.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.957+0000 7fde34416e00 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917af4e0 0x5566917b0990 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.957+0000 7fde34416e00 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.957+0000 7fde34416e00 1 --2- 10.20.193.28:0/2120069423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917aa9f0 0x5566917cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.957+0000 7fde34416e00 1 -- 10.20.193.28:0/2120069423 >> 10.20.193.28:0/2120069423 conn(0x55669175c240 msgr2=0x5566917afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.957+0000 7fde34416e00 1 -- 10.20.193.28:0/2120069423 shutdown_connections 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.957+0000 7fde34416e00 1 -- 10.20.193.28:0/2120069423 wait complete. 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.958+0000 7fde34416e00 1 -- start start 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.958+0000 7fde34416e00 1 Processor -- start 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.958+0000 7fde34416e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917aa9f0 0x5566917cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.958+0000 7fde34416e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.958+0000 7fde34416e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.958+0000 7fde34416e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fddd000e480 con 0x5566917aa9f0 2026-02-20T03:28:44.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.958+0000 7fde34416e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fddd000f8f0 con 0x5566917af4e0 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.958+0000 7fde34416e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fddd000eb50 con 0x5566917ab3a0 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917aa9f0 0x5566917cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:55456/0 (socket says 10.20.193.28:55456) 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:38724/0 (socket says 10.20.193.28:38724) 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2affd640 1 -- 10.20.193.28:0/4145808544 learned_addr learned my addr 10.20.193.28:0/4145808544 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2affd640 1 -- 10.20.193.28:0/4145808544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 msgr2=0x5566917cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2affd640 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2affd640 1 -- 10.20.193.28:0/4145808544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917aa9f0 msgr2=0x5566917cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2affd640 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917aa9f0 0x5566917cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2affd640 1 -- 10.20.193.28:0/4145808544 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566913cb870 con 0x5566917ab3a0 2026-02-20T03:28:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2bfff640 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fde2affd640 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917ccbc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5566917417b0 tx=0x7fde1c003ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d51920cf7511158e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.959+0000 7fdded7fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:28:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fdded7fa640 1 -- 10.20.193.28:0/4145808544 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c028070 con 0x5566917ab3a0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fdded7fa640 1 -- 10.20.193.28:0/4145808544 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fde1c023430 con 0x5566917ab3a0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fdded7fa640 1 -- 10.20.193.28:0/4145808544 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c01d580 con 0x5566917ab3a0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fde34416e00 1 -- 10.20.193.28:0/4145808544 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55669168c3f0 con 0x5566917ab3a0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fdded7fa640 1 -- 10.20.193.28:0/4145808544 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fde1c01d720 con 0x5566917ab3a0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fde34416e00 10 client.28009 _ll_register_callbacks cb 0x7fde180ac070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fde34416e00 1 -- 10.20.193.28:0/4145808544 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5566916bd7c0 con 0x5566917ab3a0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fdded7fa640 1 -- 10.20.193.28:0/4145808544 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fde1c011ab0 con 0x5566917ab3a0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fde34416e00 10 client.28009 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.960+0000 7fde34416e00 1 -- 10.20.193.28:0/4145808544 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5566917bd710 con 0x5566917ab3a0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.961+0000 7fdded7fa640 1 -- 10.20.193.28:0/4145808544 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fde1c011c50 con 0x5566917ab3a0 2026-02-20T03:28:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.961+0000 7fde34416e00 10 client.28009 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.961+0000 7fde34416e00 10 client.28009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.961+0000 7fde34416e00 20 client.28009 populate_metadata read hostname 'trial028' 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.961+0000 7fde34416e00 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566917d3090 0x5566918417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.961+0000 7fde34416e00 4 client.28009 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.961+0000 7fde34416e00 1 -- 10.20.193.28:0/4145808544 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55669169eab0 con 0x5566917d3090 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.961+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566917d3090 0x5566918417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.962+0000 7fde2b7fe640 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566917d3090 0x5566918417b0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3795450173aa81f server_cookie=9cf12213422640aa in_seq=0 out_seq=0 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.962+0000 7fdded7fa640 10 client.28009 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fdded7fa640 1 -- 10.20.193.28:0/4145808544 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55669169eab0 con 0x5566917d3090 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fdded7fa640 10 client.28009 handle_command_reply: tid=0 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fde34416e00 1 client.28009 shutdown 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fde34416e00 1 -- 10.20.193.28:0/4145808544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 msgr2=0x5566917ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fde34416e00 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917ccbc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5566917417b0 tx=0x7fde1c003ac0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fde34416e00 1 -- 10.20.193.28:0/4145808544 shutdown_connections 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fde34416e00 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5566917d3090 0x5566918417b0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fde34416e00 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5566917af4e0 0x5566917cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fde34416e00 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5566917ab3a0 0x5566917ccbc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fde34416e00 1 --2- 10.20.193.28:0/4145808544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5566917aa9f0 0x5566917cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.963+0000 7fde34416e00 1 -- 10.20.193.28:0/4145808544 >> 10.20.193.28:0/4145808544 conn(0x55669175c240 msgr2=0x556691795cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.964+0000 7fdded7fa640 0 client.28009 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.964+0000 7fde34416e00 1 -- 10.20.193.28:0/4145808544 shutdown_connections 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.964+0000 7fde34416e00 1 -- 10.20.193.28:0/4145808544 wait complete. 2026-02-20T03:28:44.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.964+0000 7fde34416e00 20 client.28009 trim_cache size 0 max 16384 2026-02-20T03:28:44.970 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:28:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 -- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fddfc0b1140 msgr2=0x7fddfc0b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fddfc0b1140 0x7fddfc0b3600 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fde20009790 tx=0x7fde2002f3d0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 -- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109220 msgr2=0x7fde2c1a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109220 0x7fde2c1a1660 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fde1800ea10 tx=0x7fde1800eee0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 -- 10.20.193.28:0/273356907 shutdown_connections 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fddfc0b1140 0x7fddfc0b3600 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fde2c10f1e0 0x7fde2c1a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fde2c109bc0 0x7fde2c1a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 --2- 10.20.193.28:0/273356907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fde2c109220 0x7fde2c1a1660 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.965+0000 7fde31f11640 1 -- 10.20.193.28:0/273356907 >> 10.20.193.28:0/273356907 conn(0x7fde2c078860 msgr2=0x7fde2c07a030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.966+0000 7fde31f11640 1 -- 10.20.193.28:0/273356907 shutdown_connections 2026-02-20T03:28:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:44.966+0000 7fde31f11640 1 -- 10.20.193.28:0/273356907 wait complete. 2026-02-20T03:28:45.351 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:45 trial028 ceph-mon[38552]: pgmap v604: 129 pgs: 129 active+clean; 210 MiB data, 4.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 964 op/s 2026-02-20T03:28:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:45 trial126 ceph-mon[38476]: pgmap v604: 129 pgs: 129 active+clean; 210 MiB data, 4.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 964 op/s 2026-02-20T03:28:45.694 INFO:tasks.workunit.client.0.trial028.stdout: 10 16343 65.21 MB/sec warmup 16 sec latency 32.641 ms 2026-02-20T03:28:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:45 trial177 ceph-mon[43181]: pgmap v604: 129 pgs: 129 active+clean; 210 MiB data, 4.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 964 op/s 2026-02-20T03:28:46.078 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:28:46.079 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:28:46.364 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:46.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.564+0000 7f3d0889c640 1 -- 10.20.193.28:0/1397782938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d04109ba0 msgr2=0x7f3d04115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:46.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.564+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1397782938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d04109ba0 0x7f3d04115d10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800b0a0 tx=0x7f3cf802f410 comp rx=0 tx=0).stop 2026-02-20T03:28:46.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.564+0000 7f3d0889c640 1 -- 10.20.193.28:0/1397782938 shutdown_connections 2026-02-20T03:28:46.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.564+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1397782938 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d04109ba0 0x7f3d04115d10 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.564+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1397782938 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d04109220 0x7f3d04109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.564+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1397782938 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d0410eef0 0x7f3d0410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.564+0000 7f3d0889c640 1 -- 10.20.193.28:0/1397782938 >> 10.20.193.28:0/1397782938 conn(0x7f3d04078600 msgr2=0x7f3d0407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.564+0000 7f3d0889c640 1 -- 10.20.193.28:0/1397782938 shutdown_connections 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.564+0000 7f3d0889c640 1 -- 10.20.193.28:0/1397782938 wait complete. 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d0889c640 1 Processor -- start 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d0889c640 1 -- start start 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d0889c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d04109220 0x7f3d04074650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d0889c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d04109ba0 0x7f3d04074bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d0889c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d0410eef0 0x7f3d0406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d0889c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d04119090 con 0x7f3d04109220 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d0889c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3d04118f10 con 0x7f3d04109ba0 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d0889c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d04119210 con 0x7f3d0410eef0 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d02ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d04109ba0 0x7f3d04074bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d02ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d04109ba0 0x7f3d04074bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50878/0 (socket says 10.20.193.28:50878) 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d02ffd640 1 -- 10.20.193.28:0/1915835288 learned_addr learned my addr 10.20.193.28:0/1915835288 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.565+0000 7f3d03fff640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d0410eef0 0x7f3d0406d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d02ffd640 1 -- 10.20.193.28:0/1915835288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d0410eef0 msgr2=0x7f3d0406d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d02ffd640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d0410eef0 0x7f3d0406d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d02ffd640 1 -- 10.20.193.28:0/1915835288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d04109220 msgr2=0x7f3d04074650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d02ffd640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d04109220 0x7f3d04074650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d02ffd640 1 -- 10.20.193.28:0/1915835288 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0406e130 con 0x7f3d04109ba0 2026-02-20T03:28:46.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d02ffd640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d04109ba0 0x7f3d04074bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40027e0 tx=0x7f3cf4002cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:46.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d00ff9640 1 -- 10.20.193.28:0/1915835288 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400ed40 con 0x7f3d04109ba0 2026-02-20T03:28:46.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d00ff9640 1 -- 10.20.193.28:0/1915835288 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3cf40108d0 con 0x7f3d04109ba0 2026-02-20T03:28:46.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d0889c640 1 -- 10.20.193.28:0/1915835288 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0406e420 con 0x7f3d04109ba0 2026-02-20T03:28:46.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d00ff9640 1 -- 10.20.193.28:0/1915835288 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400f7c0 con 0x7f3d04109ba0 2026-02-20T03:28:46.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.566+0000 7f3d0889c640 1 -- 10.20.193.28:0/1915835288 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d04072470 con 0x7f3d04109ba0 2026-02-20T03:28:46.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.569+0000 7f3d00ff9640 1 -- 10.20.193.28:0/1915835288 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3cf4010430 con 0x7f3d04109ba0 2026-02-20T03:28:46.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d0c02ae00 1 Processor -- start 2026-02-20T03:28:46.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d00ff9640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3cd80b0e20 0x7f3cd80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d00ff9640 1 -- 10.20.193.28:0/1915835288 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f3cf40e10b0 con 0x7f3d04109ba0 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d0c02ae00 1 -- start start 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e03880a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 0x55e03880afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e038758c00 con 0x55e0388060c0 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e0387063c0 con 0x55e038806a70 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e038754b30 con 0x55e03880ab60 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d037fe640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3cd80b0e20 0x7f3cd80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d02ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e03880a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d02ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e03880a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50882/0 (socket says 10.20.193.28:50882) 2026-02-20T03:28:46.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.571+0000 7f3d02ffd640 1 -- 10.20.193.28:0/164710874 learned_addr learned my addr 10.20.193.28:0/164710874 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:46.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d03fff640 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 0x55e03880afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d037fe640 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d02ffd640 1 -- 10.20.193.28:0/164710874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 msgr2=0x55e03880afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:46.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d02ffd640 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 0x55e03880afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d02ffd640 1 -- 10.20.193.28:0/164710874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 msgr2=0x55e0388064a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:46.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d02ffd640 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388064a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d02ffd640 1 -- 10.20.193.28:0/164710874 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0386ff840 con 0x55e038806a70 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d037fe640 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d02ffd640 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e03880a540 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400e720 tx=0x7f3cf40a8400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59a77cb21f3ac5a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d037fe640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3cd80b0e20 0x7f3cd80b32e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009f70 tx=0x7f3cf00098b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3cc7fff640 1 -- 10.20.193.28:0/164710874 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40ad0b0 con 0x55e038806a70 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3cc7fff640 1 -- 10.20.193.28:0/164710874 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3cf40b1ff0 con 0x55e038806a70 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/164710874 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 msgr2=0x55e03880a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.572+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e03880a540 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400e720 tx=0x7f3cf40a8400 comp rx=0 tx=0).stop 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.573+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/164710874 shutdown_connections 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.573+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 0x55e03880afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.573+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e03880a540 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.573+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/164710874 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.573+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/164710874 >> 10.20.193.28:0/164710874 conn(0x55e0387feb60 msgr2=0x55e0388045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:46.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.573+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/164710874 shutdown_connections 2026-02-20T03:28:46.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.573+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/164710874 wait complete. 2026-02-20T03:28:46.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.574+0000 7f3d0c02ae00 1 -- start start 2026-02-20T03:28:46.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.574+0000 7f3d0c02ae00 1 Processor -- start 2026-02-20T03:28:46.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0388060c0 0x55e03881ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e038806a70 0x55e03881f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e03882a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e0387001a0 con 0x55e038806a70 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e038812dc0 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e03881f870 con 0x55e0388060c0 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d03fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e03882a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d03fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e03882a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50898/0 (socket says 10.20.193.28:50898) 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d03fff640 1 -- 10.20.193.28:0/4262865682 learned_addr learned my addr 10.20.193.28:0/4262865682 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d037fe640 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0388060c0 0x55e03881ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d03fff640 1 -- 10.20.193.28:0/4262865682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0388060c0 msgr2=0x55e03881ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d03fff640 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0388060c0 0x55e03881ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d03fff640 1 -- 10.20.193.28:0/4262865682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e038806a70 msgr2=0x55e03881f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d03fff640 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e038806a70 0x55e03881f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.575+0000 7f3d03fff640 1 -- 10.20.193.28:0/4262865682 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e038818570 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3d03fff640 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e03882a820 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8036000 tx=0x7f3cf8009770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=740622692d636c9b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3cc57fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3cc57fa640 1 -- 10.20.193.28:0/4262865682 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8047020 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3cc57fa640 1 -- 10.20.193.28:0/4262865682 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3cf8033030 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/4262865682 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e038527b60 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3cc57fa640 1 -- 10.20.193.28:0/4262865682 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8007900 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3d0c02ae00 10 client.28037 _ll_register_callbacks cb 0x55e0387040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/4262865682 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0387607f0 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3cc57fa640 1 -- 10.20.193.28:0/4262865682 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f3cf80092d0 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3cc57fa640 1 -- 10.20.193.28:0/4262865682 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3cf8051050 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3d0c02ae00 10 client.28037 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.576+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/4262865682 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55e038725430 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.577+0000 7f3cc57fa640 1 -- 10.20.193.28:0/4262865682 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f3cf8054020 con 0x55e03880ab60 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.577+0000 7f3d0c02ae00 10 client.28037 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.577+0000 7f3d0c02ae00 10 client.28037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.577+0000 7f3d0c02ae00 20 client.28037 populate_metadata read hostname 'trial028' 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.577+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e03882ec20 0x55e0388310e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.577+0000 7f3d0c02ae00 4 client.28037 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.577+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/4262865682 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0386dac00 con 0x55e03882ec20 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.577+0000 7f3d037fe640 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e03882ec20 0x55e0388310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.579+0000 7f3d037fe640 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e03882ec20 0x55e0388310e0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63f3e7ef343206db server_cookie=805467b9c97c374c in_seq=0 out_seq=0 2026-02-20T03:28:46.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.579+0000 7f3cc57fa640 10 client.28037 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.579+0000 7f3cc57fa640 1 -- 10.20.193.28:0/4262865682 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e0386dac00 con 0x55e03882ec20 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.579+0000 7f3cc57fa640 10 client.28037 handle_command_reply: tid=0 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.579+0000 7f3d0c02ae00 1 client.28037 shutdown 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/4262865682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 msgr2=0x55e03882a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e03882a820 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8036000 tx=0x7f3cf8009770 comp rx=0 tx=0).stop 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/4262865682 shutdown_connections 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e03882ec20 0x55e0388310e0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e03882a820 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e038806a70 0x55e03881f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/4262865682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e0388060c0 0x55e03881ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/4262865682 >> 10.20.193.28:0/4262865682 conn(0x55e0387feb60 msgr2=0x55e038809520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3cc57fa640 0 client.28037 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/4262865682 shutdown_connections 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.580+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/4262865682 wait complete. 2026-02-20T03:28:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.581+0000 7f3d0c02ae00 20 client.28037 trim_cache size 0 max 16384 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.590+0000 7f3d0c02ae00 1 Processor -- start 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.590+0000 7f3d0c02ae00 1 -- start start 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e038835f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 0x55e038836460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca80126f0 con 0x55e0388060c0 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca800ffc0 con 0x55e038806a70 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca800de10 con 0x55e03880ab60 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d02ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e038835f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d02ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e038835f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:50908/0 (socket says 10.20.193.28:50908) 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d02ffd640 1 -- 10.20.193.28:0/2264513328 learned_addr learned my addr 10.20.193.28:0/2264513328 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d03fff640 1 --2- 10.20.193.28:0/2264513328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 0x55e038836460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d02ffd640 1 -- 10.20.193.28:0/2264513328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 msgr2=0x55e038836460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:46.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d02ffd640 1 --2- 10.20.193.28:0/2264513328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 0x55e038836460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d02ffd640 1 -- 10.20.193.28:0/2264513328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 msgr2=0x55e0388359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:46.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d02ffd640 1 --2- 10.20.193.28:0/2264513328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d02ffd640 1 -- 10.20.193.28:0/2264513328 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0388183a0 con 0x55e038806a70 2026-02-20T03:28:46.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.591+0000 7f3d02ffd640 1 --2- 10.20.193.28:0/2264513328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e038835f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40a4b30 tx=0x7f3cf4010750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28e79261d2d8e1f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:46.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3cc77fe640 1 -- 10.20.193.28:0/2264513328 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40debe0 con 0x55e038806a70 2026-02-20T03:28:46.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3cc77fe640 1 -- 10.20.193.28:0/2264513328 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3cf40ad0b0 con 0x55e038806a70 2026-02-20T03:28:46.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3cc77fe640 1 -- 10.20.193.28:0/2264513328 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40a4420 con 0x55e038806a70 2026-02-20T03:28:46.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/2264513328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 msgr2=0x55e038835f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:46.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/2264513328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e038835f20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40a4b30 tx=0x7f3cf4010750 comp rx=0 tx=0).stop 2026-02-20T03:28:46.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/2264513328 shutdown_connections 2026-02-20T03:28:46.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/2264513328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e03880ab60 0x55e038836460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/2264513328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e038806a70 0x55e038835f20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/2264513328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/2264513328 >> 10.20.193.28:0/2264513328 conn(0x55e0387feb60 msgr2=0x55e03880af40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:46.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/2264513328 shutdown_connections 2026-02-20T03:28:46.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.592+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/2264513328 wait complete. 2026-02-20T03:28:46.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.593+0000 7f3d0c02ae00 1 -- start start 2026-02-20T03:28:46.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.593+0000 7f3d0c02ae00 1 Processor -- start 2026-02-20T03:28:46.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388932b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e038806a70 0x55e0388937f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d0c02ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e0388252e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca800e480 con 0x55e0388060c0 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d0c02ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca800f8f0 con 0x55e03880ab60 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d02ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e038806a70 0x55e0388937f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d03fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e0388252e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d02ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e038806a70 0x55e0388937f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36942/0 (socket says 10.20.193.28:36942) 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d02ffd640 1 -- 10.20.193.28:0/1136340349 learned_addr learned my addr 10.20.193.28:0/1136340349 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca800eb50 con 0x55e038806a70 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.594+0000 7f3d037fe640 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388932b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d03fff640 1 -- 10.20.193.28:0/1136340349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e038806a70 msgr2=0x55e0388937f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d03fff640 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e038806a70 0x55e0388937f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d03fff640 1 -- 10.20.193.28:0/1136340349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 msgr2=0x55e0388932b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d03fff640 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388932b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d03fff640 1 -- 10.20.193.28:0/1136340349 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e038437900 con 0x55e03880ab60 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d037fe640 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388932b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d03fff640 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e0388252e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802f920 tx=0x7f3cf8009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c806fd16658b09ac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3cc57fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3cc57fa640 1 -- 10.20.193.28:0/1136340349 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf805b070 con 0x55e03880ab60 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3cc57fa640 1 -- 10.20.193.28:0/1136340349 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3cf8033040 con 0x55e03880ab60 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3cc57fa640 1 -- 10.20.193.28:0/1136340349 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8047040 con 0x55e03880ab60 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0387134d0 con 0x55e03880ab60 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d0c02ae00 10 client.28043 _ll_register_callbacks cb 0x7f3cf8009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.595+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cf40b1ff0 con 0x55e03880ab60 2026-02-20T03:28:46.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3cc57fa640 1 -- 10.20.193.28:0/1136340349 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7f3cf8002de0 con 0x55e03880ab60 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3cc57fa640 1 -- 10.20.193.28:0/1136340349 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3cf80076a0 con 0x55e03880ab60 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3d0c02ae00 10 client.28043 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55e038819090 con 0x55e03880ab60 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3cc57fa640 1 -- 10.20.193.28:0/1136340349 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f3cf8054030 con 0x55e03880ab60 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3d0c02ae00 10 client.28043 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3d0c02ae00 10 client.28043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3d0c02ae00 20 client.28043 populate_metadata read hostname 'trial028' 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e03889bac0 0x55e03889df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3d0c02ae00 4 client.28043 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e0384d92b0 con 0x55e03889bac0 2026-02-20T03:28:46.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.596+0000 7f3d037fe640 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e03889bac0 0x55e03889df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:46.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.597+0000 7f3d037fe640 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e03889bac0 0x55e03889df80 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b99c90a9c54b9ab9 server_cookie=26515ef9b71fcb39 in_seq=0 out_seq=0 2026-02-20T03:28:46.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.597+0000 7f3cc57fa640 10 client.28043 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3cc57fa640 1 -- 10.20.193.28:0/1136340349 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e0384d92b0 con 0x55e03889bac0 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3cc57fa640 10 client.28043 handle_command_reply: tid=0 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 client.28043 shutdown 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 msgr2=0x55e0388252e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e0388252e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802f920 tx=0x7f3cf8009300 comp rx=0 tx=0).stop 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 shutdown_connections 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e03889bac0 0x55e03889df80 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e03880ab60 0x55e0388252e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e038806a70 0x55e0388937f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 --2- 10.20.193.28:0/1136340349 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e0388060c0 0x55e0388932b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.605 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 >> 10.20.193.28:0/1136340349 conn(0x55e0387feb60 msgr2=0x55e03880b760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3cc57fa640 0 client.28043 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.602+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 shutdown_connections 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0c02ae00 1 -- 10.20.193.28:0/1136340349 wait complete. 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0c02ae00 20 client.28043 trim_cache size 0 max 16384 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "514274b0-309d-4089-9b67-8fe1f584f1ca", 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:28:46.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 -- 10.20.193.28:0/1915835288 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3cd80b0e20 msgr2=0x7f3cd80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3cd80b0e20 0x7f3cd80b32e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0009f70 tx=0x7f3cf00098b0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 -- 10.20.193.28:0/1915835288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d04109ba0 msgr2=0x7f3d04074bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d04109ba0 0x7f3d04074bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40027e0 tx=0x7f3cf4002cb0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 -- 10.20.193.28:0/1915835288 shutdown_connections 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3cd80b0e20 0x7f3cd80b32e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d0410eef0 0x7f3d0406d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d04109ba0 0x7f3d04074bb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 --2- 10.20.193.28:0/1915835288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d04109220 0x7f3d04074650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 -- 10.20.193.28:0/1915835288 >> 10.20.193.28:0/1915835288 conn(0x7f3d04078600 msgr2=0x7f3d04079d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 -- 10.20.193.28:0/1915835288 shutdown_connections 2026-02-20T03:28:46.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:46.603+0000 7f3d0889c640 1 -- 10.20.193.28:0/1915835288 wait complete. 2026-02-20T03:28:46.694 INFO:tasks.workunit.client.0.trial028.stdout: 10 17664 67.04 MB/sec warmup 17 sec latency 30.272 ms 2026-02-20T03:28:46.702 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:28:46.974 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.225+0000 7ffa1ca26640 1 -- 10.20.193.28:0/2754516648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa18104980 msgr2=0x7ffa18104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.225+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/2754516648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa18104980 0x7ffa18104de0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009a60 tx=0x7ffa0002f290 comp rx=0 tx=0).stop 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.225+0000 7ffa1ca26640 1 -- 10.20.193.28:0/2754516648 shutdown_connections 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.225+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/2754516648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa18105320 0x7ffa18111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.225+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/2754516648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa18104980 0x7ffa18104de0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.225+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/2754516648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa1810a980 0x7ffa1810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.225+0000 7ffa1ca26640 1 -- 10.20.193.28:0/2754516648 >> 10.20.193.28:0/2754516648 conn(0x7ffa18100680 msgr2=0x7ffa18102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.225+0000 7ffa1ca26640 1 -- 10.20.193.28:0/2754516648 shutdown_connections 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.225+0000 7ffa1ca26640 1 -- 10.20.193.28:0/2754516648 wait complete. 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.226+0000 7ffa1ca26640 1 Processor -- start 2026-02-20T03:28:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.226+0000 7ffa1ca26640 1 -- start start 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.226+0000 7ffa1ca26640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa18104980 0x7ffa181117b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.226+0000 7ffa1ca26640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa18105320 0x7ffa1810e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.226+0000 7ffa1ca26640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1810a980 0x7ffa1810ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.226+0000 7ffa1ca26640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffa18114c80 con 0x7ffa1810a980 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.226+0000 7ffa1ca26640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ffa18114b00 con 0x7ffa18104980 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.226+0000 7ffa1ca26640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffa18114e00 con 0x7ffa18105320 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1810a980 0x7ffa1810ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1810a980 0x7ffa1810ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40576/0 (socket says 10.20.193.28:40576) 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa17577640 1 -- 10.20.193.28:0/3752877375 learned_addr learned my addr 10.20.193.28:0/3752877375 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa17577640 1 -- 10.20.193.28:0/3752877375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa18105320 msgr2=0x7ffa1810e860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa17577640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa18105320 0x7ffa1810e860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa17577640 1 -- 10.20.193.28:0/3752877375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa18104980 msgr2=0x7ffa181117b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa17577640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa18104980 0x7ffa181117b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa17577640 1 -- 10.20.193.28:0/3752877375 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa181adb20 con 0x7ffa1810a980 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa17577640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1810a980 0x7ffa1810ef50 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800b990 tx=0x7ffa0800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ff9f7fff640 1 -- 10.20.193.28:0/3752877375 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08006e60 con 0x7ffa1810a980 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ff9f7fff640 1 -- 10.20.193.28:0/3752877375 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffa08010070 con 0x7ffa1810a980 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ff9f7fff640 1 -- 10.20.193.28:0/3752877375 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08004800 con 0x7ffa1810a980 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa1ca26640 1 -- 10.20.193.28:0/3752877375 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa181add50 con 0x7ffa1810a980 2026-02-20T03:28:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.227+0000 7ffa1ca26640 1 -- 10.20.193.28:0/3752877375 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa181ae180 con 0x7ffa1810a980 2026-02-20T03:28:47.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.231+0000 7ffa1f72ce00 1 Processor -- start 2026-02-20T03:28:47.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.231+0000 7ff9f7fff640 1 -- 10.20.193.28:0/3752877375 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ffa0801d030 con 0x7ffa1810a980 2026-02-20T03:28:47.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ff9f7fff640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9e80b0ea0 0x7ff9e80b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ff9f7fff640 1 -- 10.20.193.28:0/3752877375 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ffa080e0050 con 0x7ffa1810a980 2026-02-20T03:28:47.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ffa16575640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9e80b0ea0 0x7ff9e80b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:47.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ffa1f72ce00 1 -- start start 2026-02-20T03:28:47.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d17000 0x5561e7d173e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 0x5561e7d11a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d1de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561e7c91e50 con 0x5561e7d11fb0 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5561e7c649c0 con 0x5561e7d17000 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.232+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5561e7c12240 con 0x5561e7d11630 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d1de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa16575640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9e80b0ea0 0x7ff9e80b3360 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009950 tx=0x7ffa000023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d1de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40588/0 (socket says 10.20.193.28:40588) 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa17577640 1 -- 10.20.193.28:0/459588652 learned_addr learned my addr 10.20.193.28:0/459588652 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa17577640 1 -- 10.20.193.28:0/459588652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 msgr2=0x5561e7d11a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa17577640 1 --2- 10.20.193.28:0/459588652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 0x5561e7d11a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa17577640 1 -- 10.20.193.28:0/459588652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d17000 msgr2=0x5561e7d173e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:47.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa17577640 1 --2- 10.20.193.28:0/459588652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d17000 0x5561e7d173e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa17577640 1 -- 10.20.193.28:0/459588652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561e7c25420 con 0x5561e7d11fb0 2026-02-20T03:28:47.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ffa17577640 1 --2- 10.20.193.28:0/459588652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d1de30 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7ffa080a3b60 tx=0x7ffa08004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff73e338a4c9b1a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ff9df7fe640 1 -- 10.20.193.28:0/459588652 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa080c8e60 con 0x5561e7d11fb0 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ff9df7fe640 1 -- 10.20.193.28:0/459588652 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffa080a8430 con 0x5561e7d11fb0 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.233+0000 7ff9df7fe640 1 -- 10.20.193.28:0/459588652 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa080ddde0 con 0x5561e7d11fb0 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.234+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/459588652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 msgr2=0x5561e7d1de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.234+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/459588652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d1de30 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7ffa080a3b60 tx=0x7ffa08004ab0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.234+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/459588652 shutdown_connections 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.234+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/459588652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d1de30 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.234+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/459588652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 0x5561e7d11a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.234+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/459588652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d17000 0x5561e7d173e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.234+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/459588652 >> 10.20.193.28:0/459588652 conn(0x5561e7cd4290 msgr2=0x5561e7d0fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.234+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/459588652 shutdown_connections 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.234+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/459588652 wait complete. 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.235+0000 7ffa1f72ce00 1 -- start start 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.235+0000 7ffa1f72ce00 1 Processor -- start 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.235+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 0x5561e7d2bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.235+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11fb0 0x5561e7d2c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.235+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7d2a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.235+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5561e7c608f0 con 0x5561e7d17000 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.235+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5561e7a52f50 con 0x5561e7d11fb0 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.235+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5561e7d2ad30 con 0x5561e7d11630 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7d2a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:47.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7d2a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40594/0 (socket says 10.20.193.28:40594) 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa17577640 1 -- 10.20.193.28:0/2014359139 learned_addr learned my addr 10.20.193.28:0/2014359139 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa17577640 1 -- 10.20.193.28:0/2014359139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 msgr2=0x5561e7d2bf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa17577640 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 0x5561e7d2bf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa17577640 1 -- 10.20.193.28:0/2014359139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11fb0 msgr2=0x5561e7d2c480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa17577640 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11fb0 0x5561e7d2c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa17577640 1 -- 10.20.193.28:0/2014359139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561e7d23b20 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa17577640 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7d2a6f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800b960 tx=0x7ffa080098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4c2076189ec5e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ff9dcff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ff9dcff9640 1 -- 10.20.193.28:0/2014359139 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa080ce070 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ff9dcff9640 1 -- 10.20.193.28:0/2014359139 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffa080ce210 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ff9dcff9640 1 -- 10.20.193.28:0/2014359139 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa080c8e60 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2014359139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561e7a35b40 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa1f72ce00 10 client.19272 _ll_register_callbacks cb 0x5561e7c9df00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2014359139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561e7c721a0 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.236+0000 7ff9dcff9640 1 -- 10.20.193.28:0/2014359139 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ffa080ce3c0 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ff9dcff9640 1 -- 10.20.193.28:0/2014359139 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffa08094020 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ffa1f72ce00 10 client.19272 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2014359139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5561e7c1f230 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ff9dcff9640 1 -- 10.20.193.28:0/2014359139 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7ffa080c20f0 con 0x5561e7d17000 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ffa1f72ce00 10 client.19272 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ffa1f72ce00 10 client.19272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ffa1f72ce00 20 client.19272 populate_metadata read hostname 'trial028' 2026-02-20T03:28:47.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561e7d3a360 0x5561e7d3c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ffa1f72ce00 4 client.19272 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:47.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.237+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2014359139 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561e7c6c5b0 con 0x5561e7d3a360 2026-02-20T03:28:47.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.256+0000 7ffa16d76640 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561e7d3a360 0x5561e7d3c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:47.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.283+0000 7ffa16d76640 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561e7d3a360 0x5561e7d3c750 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2008311d7380ad89 server_cookie=58cf53a3c3bc7b1a in_seq=0 out_seq=0 2026-02-20T03:28:47.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.283+0000 7ff9dcff9640 10 client.19272 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:47.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ff9dcff9640 1 -- 10.20.193.28:0/2014359139 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5561e7c6c5b0 con 0x5561e7d3a360 2026-02-20T03:28:47.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ff9dcff9640 10 client.19272 handle_command_reply: tid=0 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 client.19272 shutdown 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2014359139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 msgr2=0x5561e7d2a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7d2a6f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800b960 tx=0x7ffa080098d0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2014359139 shutdown_connections 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561e7d3a360 0x5561e7d3c750 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7d2a6f0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11fb0 0x5561e7d2c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2014359139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 0x5561e7d2bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ff9dcff9640 0 client.19272 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:47.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2014359139 >> 10.20.193.28:0/2014359139 conn(0x5561e7cd4290 msgr2=0x5561e7d10440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:47.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2014359139 shutdown_connections 2026-02-20T03:28:47.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2014359139 wait complete. 2026-02-20T03:28:47.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.284+0000 7ffa1f72ce00 20 client.19272 trim_cache size 0 max 16384 2026-02-20T03:28:47.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.293+0000 7ffa1f72ce00 1 Processor -- start 2026-02-20T03:28:47.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.293+0000 7ffa1f72ce00 1 -- start start 2026-02-20T03:28:47.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.293+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11630 0x5561e7d3ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.298 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:47 trial028 ceph-mon[38552]: pgmap v605: 129 pgs: 129 active+clean; 217 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 6.2 MiB/s wr, 913 op/s 2026-02-20T03:28:47.298 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:47 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:28:47.298 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:47 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:47.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.293+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d3b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.293+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d17000 0x5561e7d10520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.293+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc0126a0 con 0x5561e7d11fb0 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.293+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc00ff70 con 0x5561e7d11630 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.293+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc00ddc0 con 0x5561e7d17000 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.293+0000 7ffa16575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d3b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ffa16575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d3b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40602/0 (socket says 10.20.193.28:40602) 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ffa16575640 1 -- 10.20.193.28:0/2239146986 learned_addr learned my addr 10.20.193.28:0/2239146986 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ffa16575640 1 -- 10.20.193.28:0/2239146986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d17000 msgr2=0x5561e7d10520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ffa16575640 1 --2- 10.20.193.28:0/2239146986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d17000 0x5561e7d10520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ffa16575640 1 -- 10.20.193.28:0/2239146986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11630 msgr2=0x5561e7d3ae50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:47.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ffa16575640 1 --2- 10.20.193.28:0/2239146986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11630 0x5561e7d3ae50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ffa16575640 1 -- 10.20.193.28:0/2239146986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561e7d23950 con 0x5561e7d11fb0 2026-02-20T03:28:47.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ffa16575640 1 --2- 10.20.193.28:0/2239146986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d3b390 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009a60 tx=0x7ffa0003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdeee882480d1f4d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:47.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ff9deffd640 1 -- 10.20.193.28:0/2239146986 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00002cd0 con 0x5561e7d11fb0 2026-02-20T03:28:47.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ff9deffd640 1 -- 10.20.193.28:0/2239146986 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffa00033040 con 0x5561e7d11fb0 2026-02-20T03:28:47.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.294+0000 7ff9deffd640 1 -- 10.20.193.28:0/2239146986 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa00038cb0 con 0x5561e7d11fb0 2026-02-20T03:28:47.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.295+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2239146986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 msgr2=0x5561e7d3b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:47.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.295+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2239146986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d3b390 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009a60 tx=0x7ffa0003d000 comp rx=0 tx=0).stop 2026-02-20T03:28:47.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.295+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2239146986 shutdown_connections 2026-02-20T03:28:47.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.295+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2239146986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d17000 0x5561e7d10520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.295+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2239146986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d11fb0 0x5561e7d3b390 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.295+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/2239146986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11630 0x5561e7d3ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.295+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2239146986 >> 10.20.193.28:0/2239146986 conn(0x5561e7cd4290 msgr2=0x5561e7d3a740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:47.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.295+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2239146986 shutdown_connections 2026-02-20T03:28:47.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.295+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/2239146986 wait complete. 2026-02-20T03:28:47.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa1f72ce00 1 -- start start 2026-02-20T03:28:47.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa1f72ce00 1 Processor -- start 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 0x5561e7d31220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11fb0 0x5561e7d31760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa1f72ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7da51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc00e430 con 0x5561e7d17000 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc00f8a0 con 0x5561e7d11fb0 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa1f72ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc00eb00 con 0x5561e7d11630 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7da51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7da51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40608/0 (socket says 10.20.193.28:40608) 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa17577640 1 -- 10.20.193.28:0/3289411498 learned_addr learned my addr 10.20.193.28:0/3289411498 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa17577640 1 -- 10.20.193.28:0/3289411498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 msgr2=0x5561e7d31220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:47.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa17577640 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 0x5561e7d31220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa17577640 1 -- 10.20.193.28:0/3289411498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11fb0 msgr2=0x5561e7d31760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:28:47.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa17577640 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11fb0 0x5561e7d31760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.296+0000 7ffa17577640 1 -- 10.20.193.28:0/3289411498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561e7943870 con 0x5561e7d17000 2026-02-20T03:28:47.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ffa17577640 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7da51d0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800cf50 tx=0x7ffa080c9f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e263a3f6701fb8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:47.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ff9dcff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:47.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ff9dcff9640 1 -- 10.20.193.28:0/3289411498 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa080ce040 con 0x5561e7d17000 2026-02-20T03:28:47.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ff9dcff9640 1 -- 10.20.193.28:0/3289411498 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5561e7c721a0 con 0x5561e7d17000 2026-02-20T03:28:47.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ff9dcff9640 1 -- 10.20.193.28:0/3289411498 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa080a3450 con 0x5561e7d17000 2026-02-20T03:28:47.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/3289411498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561e7c04440 con 0x5561e7d17000 2026-02-20T03:28:47.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ffa1f72ce00 10 client.19278 _ll_register_callbacks cb 0x7ffa080a7b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:47.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/3289411498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5561e7c35810 con 0x5561e7d17000 2026-02-20T03:28:47.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ff9dcff9640 1 -- 10.20.193.28:0/3289411498 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7ffa080a36b0 con 0x5561e7d17000 2026-02-20T03:28:47.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ff9dcff9640 1 -- 10.20.193.28:0/3289411498 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffa080ac0e0 con 0x5561e7d17000 2026-02-20T03:28:47.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ffa1f72ce00 10 client.19278 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:47.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/3289411498 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5561e7d24640 con 0x5561e7d17000 2026-02-20T03:28:47.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.297+0000 7ff9dcff9640 1 -- 10.20.193.28:0/3289411498 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7ffa080a6d40 con 0x5561e7d17000 2026-02-20T03:28:47.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.298+0000 7ffa1f72ce00 10 client.19278 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:47.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.298+0000 7ffa1f72ce00 10 client.19278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:47.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.298+0000 7ffa1f72ce00 20 client.19278 populate_metadata read hostname 'trial028' 2026-02-20T03:28:47.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.298+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561e7da6400 0x5561e7da88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:47.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.298+0000 7ffa1f72ce00 4 client.19278 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:28:47.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.298+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/3289411498 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5561e7c16b00 con 0x5561e7da6400 2026-02-20T03:28:47.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.298+0000 7ffa16d76640 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561e7da6400 0x5561e7da88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:47.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.312+0000 7ffa16d76640 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561e7da6400 0x5561e7da88c0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec65b933e330e9a7 server_cookie=e2b65ec2db38a668 in_seq=0 out_seq=0 2026-02-20T03:28:47.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.312+0000 7ff9dcff9640 10 client.19278 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:47.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.325+0000 7ff9dcff9640 1 -- 10.20.193.28:0/3289411498 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5561e7c16b00 con 0x5561e7da6400 2026-02-20T03:28:47.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.325+0000 7ff9dcff9640 10 client.19278 handle_command_reply: tid=0 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.325+0000 7ffa1f72ce00 1 client.19278 shutdown 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.325+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/3289411498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 msgr2=0x5561e7da51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.325+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7da51d0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800cf50 tx=0x7ffa080c9f60 comp rx=0 tx=0).stop 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/3289411498 shutdown_connections 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5561e7da6400 0x5561e7da88c0 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5561e7d17000 0x5561e7da51d0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5561e7d11fb0 0x5561e7d31760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1f72ce00 1 --2- 10.20.193.28:0/3289411498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5561e7d11630 0x5561e7d31220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/3289411498 >> 10.20.193.28:0/3289411498 conn(0x5561e7cd4290 msgr2=0x5561e7d3af60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:47.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ff9dcff9640 0 client.19278 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:47.330 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:28:47.330 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:28:47.330 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:28:47.330 INFO:teuthology.orchestra.run.trial028.stdout: "514274b0-309d-4089-9b67-8fe1f584f1ca": { 2026-02-20T03:28:47.331 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:28:47.331 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "514274b0-309d-4089-9b67-8fe1f584f1ca", 2026-02-20T03:28:47.331 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:28:47.331 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:28:47.331 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:28:47.331 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:28:47.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/3289411498 shutdown_connections 2026-02-20T03:28:47.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1f72ce00 1 -- 10.20.193.28:0/3289411498 wait complete. 2026-02-20T03:28:47.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1f72ce00 20 client.19278 trim_cache size 0 max 16384 2026-02-20T03:28:47.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 -- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9e80b0ea0 msgr2=0x7ff9e80b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:47.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9e80b0ea0 0x7ff9e80b3360 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffa00009950 tx=0x7ffa000023d0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 -- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1810a980 msgr2=0x7ffa1810ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:47.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1810a980 0x7ffa1810ef50 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800b990 tx=0x7ffa0800be60 comp rx=0 tx=0).stop 2026-02-20T03:28:47.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 -- 10.20.193.28:0/3752877375 shutdown_connections 2026-02-20T03:28:47.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9e80b0ea0 0x7ff9e80b3360 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffa1810a980 0x7ffa1810ef50 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffa18105320 0x7ffa1810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 --2- 10.20.193.28:0/3752877375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffa18104980 0x7ffa181117b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:47.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.326+0000 7ffa1ca26640 1 -- 10.20.193.28:0/3752877375 >> 10.20.193.28:0/3752877375 conn(0x7ffa18100680 msgr2=0x7ffa181010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:47.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.327+0000 7ffa1ca26640 1 -- 10.20.193.28:0/3752877375 shutdown_connections 2026-02-20T03:28:47.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:28:47.327+0000 7ffa1ca26640 1 -- 10.20.193.28:0/3752877375 wait complete. 2026-02-20T03:28:47.486 INFO:tasks.cephfs.filesystem:scrub status for tag:514274b0-309d-4089-9b67-8fe1f584f1ca - {'path': '/', 'tag': '514274b0-309d-4089-9b67-8fe1f584f1ca', 'options': 'recursive,force'} 2026-02-20T03:28:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:47 trial126 ceph-mon[38476]: pgmap v605: 129 pgs: 129 active+clean; 217 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 6.2 MiB/s wr, 913 op/s 2026-02-20T03:28:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:47 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:28:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:47 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:47.694 INFO:tasks.workunit.client.0.trial028.stdout: 10 17938 63.90 MB/sec warmup 18 sec latency 587.165 ms 2026-02-20T03:28:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:47 trial177 ceph-mon[43181]: pgmap v605: 129 pgs: 129 active+clean; 217 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 6.2 MiB/s wr, 913 op/s 2026-02-20T03:28:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:47 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:28:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:47 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:48 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:28:48.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:48 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:48 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:28:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:48 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:28:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:48 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:48 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:28:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:48 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:48 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:48 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:28:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:48 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:48 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:28:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:48 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:28:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:48 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:48 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:28:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:48 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:48 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 18206 60.84 MB/sec warmup 19 sec latency 1197.812 ms 2026-02-20T03:28:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:48 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:28:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:48 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:48 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:28:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:48 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:28:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:48 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:48 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:28:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:48 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:48 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:28:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:49 trial126 ceph-mon[38476]: pgmap v606: 129 pgs: 129 active+clean; 223 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 919 op/s 2026-02-20T03:28:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:49 trial028 ceph-mon[38552]: pgmap v606: 129 pgs: 129 active+clean; 223 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 919 op/s 2026-02-20T03:28:49.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 19366 60.56 MB/sec warmup 20 sec latency 35.217 ms 2026-02-20T03:28:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:49 trial177 ceph-mon[43181]: pgmap v606: 129 pgs: 129 active+clean; 223 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 6.1 MiB/s wr, 919 op/s 2026-02-20T03:28:50.694 INFO:tasks.workunit.client.0.trial028.stdout: 10 20867 61.95 MB/sec warmup 21 sec latency 20.446 ms 2026-02-20T03:28:51.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.199+0000 7fd3c54ef640 1 -- 10.20.193.28:0/936587184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109490 msgr2=0x7fd3c0109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:51.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.199+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/936587184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109490 0x7fd3c0109890 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009a30 tx=0x7fd3ac02f220 comp rx=0 tx=0).stop 2026-02-20T03:28:51.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.199+0000 7fd3c54ef640 1 -- 10.20.193.28:0/936587184 shutdown_connections 2026-02-20T03:28:51.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.199+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/936587184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3c010a930 0x7fd3c0111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.199+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/936587184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd3c0109e60 0x7fd3c010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.199+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/936587184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109490 0x7fd3c0109890 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.199+0000 7fd3c54ef640 1 -- 10.20.193.28:0/936587184 >> 10.20.193.28:0/936587184 conn(0x7fd3c0077e40 msgr2=0x7fd3c007a280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:51.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.199+0000 7fd3c54ef640 1 -- 10.20.193.28:0/936587184 shutdown_connections 2026-02-20T03:28:51.201 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.200+0000 7fd3c54ef640 1 -- 10.20.193.28:0/936587184 wait complete. 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.200+0000 7fd3c54ef640 1 Processor -- start 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.200+0000 7fd3c54ef640 1 -- start start 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3c54ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3c0109490 0x7fd3c01a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3c54ef640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109e60 0x7fd3c01a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3c54ef640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd3c010a930 0x7fd3c01a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3bf7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109e60 0x7fd3c01a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3c54ef640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01148c0 con 0x7fd3c0109490 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3c54ef640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c0114740 con 0x7fd3c010a930 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3c54ef640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c0114a40 con 0x7fd3c0109e60 2026-02-20T03:28:51.202 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3bf7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109e60 0x7fd3c01a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37014/0 (socket says 10.20.193.28:37014) 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3bf7fe640 1 -- 10.20.193.28:0/2950654664 learned_addr learned my addr 10.20.193.28:0/2950654664 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3bffff640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3c0109490 0x7fd3c01a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.201+0000 7fd3c4cee640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd3c010a930 0x7fd3c01a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3bf7fe640 1 -- 10.20.193.28:0/2950654664 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd3c010a930 msgr2=0x7fd3c01a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd3c010a930 0x7fd3c01a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3bf7fe640 1 -- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3c0109490 msgr2=0x7fd3c01a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3c0109490 0x7fd3c01a0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3bf7fe640 1 -- 10.20.193.28:0/2950654664 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c01a8bb0 con 0x7fd3c0109e60 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3bffff640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3c0109490 0x7fd3c01a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:51.203 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109e60 0x7fd3c01a1440 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400d950 tx=0x7fd3a400de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:51.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3bd7fa640 1 -- 10.20.193.28:0/2950654664 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4014070 con 0x7fd3c0109e60 2026-02-20T03:28:51.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3c54ef640 1 -- 10.20.193.28:0/2950654664 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c01a8ea0 con 0x7fd3c0109e60 2026-02-20T03:28:51.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.202+0000 7fd3c54ef640 1 -- 10.20.193.28:0/2950654664 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c01a93b0 con 0x7fd3c0109e60 2026-02-20T03:28:51.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.205+0000 7fd3bd7fa640 1 -- 10.20.193.28:0/2950654664 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd3a40044e0 con 0x7fd3c0109e60 2026-02-20T03:28:51.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.205+0000 7fd3bd7fa640 1 -- 10.20.193.28:0/2950654664 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4010460 con 0x7fd3c0109e60 2026-02-20T03:28:51.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.206+0000 7fd3c95d9e00 1 Processor -- start 2026-02-20T03:28:51.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.206+0000 7fd3c95d9e00 1 -- start start 2026-02-20T03:28:51.209 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe10f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c1fd5c8f0 con 0x555c1fe0be80 2026-02-20T03:28:51.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555c1fd0a2e0 con 0x555c1fe11560 2026-02-20T03:28:51.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555c1fd58820 con 0x555c1fe0c7c0 2026-02-20T03:28:51.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3bffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe10f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3c4cee640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3bffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe10f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37022/0 (socket says 10.20.193.28:37022) 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3bffff640 1 -- 10.20.193.28:0/3970137606 learned_addr learned my addr 10.20.193.28:0/3970137606 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3bffff640 1 -- 10.20.193.28:0/3970137606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 msgr2=0x555c1fe139f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3bffff640 1 --2- 10.20.193.28:0/3970137606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe139f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3bffff640 1 -- 10.20.193.28:0/3970137606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 msgr2=0x555c1fe0c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3bffff640 1 --2- 10.20.193.28:0/3970137606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3bffff640 1 -- 10.20.193.28:0/3970137606 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fcfc5a0 con 0x555c1fe0c7c0 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.207+0000 7fd3c4cee640 1 --2- 10.20.193.28:0/3970137606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.208+0000 7fd3bffff640 1 --2- 10.20.193.28:0/3970137606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe10f40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009a30 tx=0x7fd3ac005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9df10e718214aedc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.208+0000 7fd3a8bfe640 1 -- 10.20.193.28:0/3970137606 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0026e0 con 0x555c1fe0c7c0 2026-02-20T03:28:51.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.208+0000 7fd3a8bfe640 1 -- 10.20.193.28:0/3970137606 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd3ac033070 con 0x555c1fe0c7c0 2026-02-20T03:28:51.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.208+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/3970137606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 msgr2=0x555c1fe10f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:51.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.208+0000 7fd3a8bfe640 1 -- 10.20.193.28:0/3970137606 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac038a40 con 0x555c1fe0c7c0 2026-02-20T03:28:51.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.208+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/3970137606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe10f40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009a30 tx=0x7fd3ac005850 comp rx=0 tx=0).stop 2026-02-20T03:28:51.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.213+0000 7fd3bd7fa640 1 -- 10.20.193.28:0/2950654664 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd3a400b840 con 0x7fd3c0109e60 2026-02-20T03:28:51.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.214+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/3970137606 shutdown_connections 2026-02-20T03:28:51.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.214+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/3970137606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.214+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/3970137606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe10f40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.214+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/3970137606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.214+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/3970137606 >> 10.20.193.28:0/3970137606 conn(0x555c1fe036f0 msgr2=0x555c1fe0a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:51.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.214+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/3970137606 shutdown_connections 2026-02-20T03:28:51.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.214+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/3970137606 wait complete. 2026-02-20T03:28:51.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.216+0000 7fd3c95d9e00 1 -- start start 2026-02-20T03:28:51.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.216+0000 7fd3c95d9e00 1 Processor -- start 2026-02-20T03:28:51.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.216+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe0be80 0x555c1fe247b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.217+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe24cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.217+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe11560 0x555c1fe2bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.217+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555c1fd040c0 con 0x555c1fe0c7c0 2026-02-20T03:28:51.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.217+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555c1fe14650 con 0x555c1fe0be80 2026-02-20T03:28:51.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.217+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555c1fe2c200 con 0x555c1fe11560 2026-02-20T03:28:51.219 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.217+0000 7fd3bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe24cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.217+0000 7fd3bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe24cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40626/0 (socket says 10.20.193.28:40626) 2026-02-20T03:28:51.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.217+0000 7fd3bffff640 1 -- 10.20.193.28:0/1643710793 learned_addr learned my addr 10.20.193.28:0/1643710793 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:51.220 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.217+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe11560 0x555c1fe2bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.221 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3c4cee640 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe0be80 0x555c1fe247b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3bffff640 1 -- 10.20.193.28:0/1643710793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe11560 msgr2=0x555c1fe2bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3bffff640 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe11560 0x555c1fe2bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3bffff640 1 -- 10.20.193.28:0/1643710793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe0be80 msgr2=0x555c1fe247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3bffff640 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe0be80 0x555c1fe247b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3bffff640 1 -- 10.20.193.28:0/1643710793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fe1e0d0 con 0x555c1fe0c7c0 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3bd7fa640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3980b0c20 0x7fd3980b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3c4cee640 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe0be80 0x555c1fe247b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3bd7fa640 1 -- 10.20.193.28:0/2950654664 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd3a40e0b30 con 0x7fd3c0109e60 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3bffff640 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe24cf0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009950 tx=0x7fd3ac004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff61dcc4e680ae4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:51.222 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd381ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd381ffb640 1 -- 10.20.193.28:0/1643710793 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac050020 con 0x555c1fe0c7c0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/1643710793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c1fd18820 con 0x555c1fe0c7c0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3c95d9e00 10 client.19290 _ll_register_callbacks cb 0x555c1fd07ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.218+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/1643710793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c1fd644e0 con 0x555c1fe0c7c0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd381ffb640 1 -- 10.20.193.28:0/1643710793 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd3ac009620 con 0x555c1fe0c7c0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd381ffb640 1 -- 10.20.193.28:0/1643710793 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac048040 con 0x555c1fe0c7c0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd381ffb640 1 -- 10.20.193.28:0/1643710793 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd3ac055840 con 0x555c1fe0c7c0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd381ffb640 1 -- 10.20.193.28:0/1643710793 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd3ac05b050 con 0x555c1fe0c7c0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd3c95d9e00 10 client.19290 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/1643710793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=31}) -- 0x555c1fd1d380 con 0x555c1fe0c7c0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd381ffb640 1 -- 10.20.193.28:0/1643710793 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fd3ac04b070 con 0x555c1fe0c7c0 2026-02-20T03:28:51.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd3c95d9e00 10 client.19290 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:51.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd3c95d9e00 10 client.19290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:51.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd3c95d9e00 20 client.19290 populate_metadata read hostname 'trial028' 2026-02-20T03:28:51.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555c1fe2ff80 0x555c1fe32410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd3c95d9e00 4 client.19290 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:28:51.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.219+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/1643710793 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c1fcdebd0 con 0x555c1fe2ff80 2026-02-20T03:28:51.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.220+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555c1fe2ff80 0x555c1fe32410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.220+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555c1fe2ff80 0x555c1fe32410 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aaa6e090b9318aa server_cookie=608ad17d71553067 in_seq=0 out_seq=0 2026-02-20T03:28:51.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.220+0000 7fd381ffb640 10 client.19290 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:51.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.221+0000 7fd381ffb640 1 -- 10.20.193.28:0/1643710793 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555c1fcdebd0 con 0x555c1fe2ff80 2026-02-20T03:28:51.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.221+0000 7fd381ffb640 10 client.19290 handle_command_reply: tid=0 2026-02-20T03:28:51.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.221+0000 7fd3c95d9e00 1 client.19290 shutdown 2026-02-20T03:28:51.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/1643710793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 msgr2=0x555c1fe24cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe24cf0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009950 tx=0x7fd3ac004300 comp rx=0 tx=0).stop 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/1643710793 shutdown_connections 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555c1fe2ff80 0x555c1fe32410 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe11560 0x555c1fe2bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe24cf0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/1643710793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe0be80 0x555c1fe247b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/1643710793 >> 10.20.193.28:0/1643710793 conn(0x555c1fe036f0 msgr2=0x555c1fe128d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd381ffb640 0 client.19290 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/1643710793 shutdown_connections 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/1643710793 wait complete. 2026-02-20T03:28:51.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.222+0000 7fd3c95d9e00 20 client.19290 trim_cache size 0 max 16384 2026-02-20T03:28:51.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.223+0000 7fd3c4cee640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3980b0c20 0x7fd3980b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.227 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.224+0000 7fd3c4cee640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3980b0c20 0x7fd3980b30e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x555c1fe23e20 tx=0x7fd3b400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:51.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.231+0000 7fd3c95d9e00 1 Processor -- start 2026-02-20T03:28:51.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.231+0000 7fd3c95d9e00 1 -- start start 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.231+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.231+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe0b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.231+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe2bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.231+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd3640126f0 con 0x555c1fe0be80 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.231+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd36400ffc0 con 0x555c1fe11560 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.231+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd36400de10 con 0x555c1fe0c7c0 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bf7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe0b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bf7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe0b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37042/0 (socket says 10.20.193.28:37042) 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bf7fe640 1 -- 10.20.193.28:0/157630889 learned_addr learned my addr 10.20.193.28:0/157630889 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bffff640 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.235 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3c4cee640 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe2bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bf7fe640 1 -- 10.20.193.28:0/157630889 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 msgr2=0x555c1fe2bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:51.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe2bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bf7fe640 1 -- 10.20.193.28:0/157630889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 msgr2=0x555c1fe0ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:51.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bf7fe640 1 -- 10.20.193.28:0/157630889 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fe1df00 con 0x555c1fe0c7c0 2026-02-20T03:28:51.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bffff640 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:51.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3c4cee640 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe2bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:51.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.232+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe0b2a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40040a0 tx=0x7fd3a40023d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c6e0cc9285c4491 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:51.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd383fff640 1 -- 10.20.193.28:0/157630889 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40e9070 con 0x555c1fe0c7c0 2026-02-20T03:28:51.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd383fff640 1 -- 10.20.193.28:0/157630889 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd3a40ea040 con 0x555c1fe0c7c0 2026-02-20T03:28:51.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd383fff640 1 -- 10.20.193.28:0/157630889 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40e9070 con 0x555c1fe0c7c0 2026-02-20T03:28:51.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/157630889 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 msgr2=0x555c1fe0b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe0b2a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40040a0 tx=0x7fd3a40023d0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/157630889 shutdown_connections 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe2bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0c7c0 0x555c1fe0b2a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/157630889 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0be80 0x555c1fe0ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/157630889 >> 10.20.193.28:0/157630889 conn(0x555c1fe036f0 msgr2=0x555c1fe24920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/157630889 shutdown_connections 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.233+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/157630889 wait complete. 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.234+0000 7fd3c95d9e00 1 -- start start 2026-02-20T03:28:51.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.234+0000 7fd3c95d9e00 1 Processor -- start 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.234+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0be80 0x555c1fe2b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.234+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe2bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.234+0000 7fd3c95d9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe28410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd36400e480 con 0x555c1fe0c7c0 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd36400f8f0 con 0x555c1fe11560 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3c95d9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd36400eb50 con 0x555c1fe0be80 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0be80 0x555c1fe2b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0be80 0x555c1fe2b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37048/0 (socket says 10.20.193.28:37048) 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bffff640 1 -- 10.20.193.28:0/2441909222 learned_addr learned my addr 10.20.193.28:0/2441909222 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3c4cee640 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe28410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe2bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bffff640 1 -- 10.20.193.28:0/2441909222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 msgr2=0x555c1fe28410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bffff640 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe28410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bffff640 1 -- 10.20.193.28:0/2441909222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 msgr2=0x555c1fe2bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bffff640 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe2bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bffff640 1 -- 10.20.193.28:0/2441909222 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1fabc690 con 0x555c1fe0be80 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.235+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe2bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.236+0000 7fd3bffff640 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0be80 0x555c1fe2b7c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009380 tx=0x7fd3ac009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d22d0445ca3f2e6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.236+0000 7fd381ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.237+0000 7fd381ffb640 1 -- 10.20.193.28:0/2441909222 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac050070 con 0x555c1fe0be80 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.237+0000 7fd381ffb640 1 -- 10.20.193.28:0/2441909222 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x555c1fd644e0 con 0x555c1fe0be80 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.237+0000 7fd381ffb640 1 -- 10.20.193.28:0/2441909222 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac04c3f0 con 0x555c1fe0be80 2026-02-20T03:28:51.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.237+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/2441909222 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c1fd21b70 con 0x555c1fe0be80 2026-02-20T03:28:51.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.237+0000 7fd3c95d9e00 10 client.28045 _ll_register_callbacks cb 0x7fd3ac0029f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:28:51.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.237+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/2441909222 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3ac033070 con 0x555c1fe0be80 2026-02-20T03:28:51.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.237+0000 7fd381ffb640 1 -- 10.20.193.28:0/2441909222 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(95..95 src has 1..95) ==== 9297+0+0 (secure 0 0 0) 0x7fd3ac038bd0 con 0x555c1fe0be80 2026-02-20T03:28:51.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.238+0000 7fd381ffb640 1 -- 10.20.193.28:0/2441909222 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd3ac038e10 con 0x555c1fe0be80 2026-02-20T03:28:51.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.238+0000 7fd3c95d9e00 10 client.28045 fetch_fsmap learned FSMap version 31 2026-02-20T03:28:51.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.238+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/2441909222 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=31}) -- 0x555c1fe1ebf0 con 0x555c1fe0be80 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.239+0000 7fd381ffb640 1 -- 10.20.193.28:0/2441909222 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7fd3ac04b040 con 0x555c1fe0be80 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.239+0000 7fd3c95d9e00 10 client.28045 fetch_fsmap finished waiting for FSMap version 31 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.239+0000 7fd3c95d9e00 10 client.28045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.239+0000 7fd3c95d9e00 20 client.28045 populate_metadata read hostname 'trial028' 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.239+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555c1fe9bc00 0x555c1fe9e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.239+0000 7fd3c95d9e00 4 client.28045 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.239+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/2441909222 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555c1fb35520 con 0x555c1fe9bc00 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.239+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555c1fe9bc00 0x555c1fe9e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.240+0000 7fd3bf7fe640 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555c1fe9bc00 0x555c1fe9e090 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35c00c364fc425b0 server_cookie=2d1746167198778e in_seq=0 out_seq=0 2026-02-20T03:28:51.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.240+0000 7fd381ffb640 10 client.28045 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:51.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:51 trial126 ceph-mon[38476]: pgmap v607: 129 pgs: 129 active+clean; 239 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 1.06k op/s 2026-02-20T03:28:51.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:51 trial028 ceph-mon[38552]: pgmap v607: 129 pgs: 129 active+clean; 239 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 1.06k op/s 2026-02-20T03:28:51.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 21384 60.77 MB/sec warmup 22 sec latency 358.049 ms 2026-02-20T03:28:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:51 trial177 ceph-mon[43181]: pgmap v607: 129 pgs: 129 active+clean; 239 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 3.2 MiB/s rd, 7.1 MiB/s wr, 1.06k op/s 2026-02-20T03:28:51.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.874+0000 7fd381ffb640 1 -- 10.20.193.28:0/2441909222 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555c1fb35520 con 0x555c1fe9bc00 2026-02-20T03:28:51.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.874+0000 7fd381ffb640 10 client.28045 handle_command_reply: tid=0 2026-02-20T03:28:51.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.874+0000 7fd3c95d9e00 1 client.28045 shutdown 2026-02-20T03:28:51.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.874+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/2441909222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0be80 msgr2=0x555c1fe2b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:51.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.874+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0be80 0x555c1fe2b7c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009380 tx=0x7fd3ac009620 comp rx=0 tx=0).stop 2026-02-20T03:28:51.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.875+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/2441909222 shutdown_connections 2026-02-20T03:28:51.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.875+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555c1fe9bc00 0x555c1fe9e090 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.875+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555c1fe11560 0x555c1fe28410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.875+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555c1fe0c7c0 0x555c1fe2bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.875+0000 7fd3c95d9e00 1 --2- 10.20.193.28:0/2441909222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555c1fe0be80 0x555c1fe2b7c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.875+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/2441909222 >> 10.20.193.28:0/2441909222 conn(0x555c1fe036f0 msgr2=0x555c1fe121a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:51.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.875+0000 7fd381ffb640 0 client.28045 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:28:51.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.875+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/2441909222 shutdown_connections 2026-02-20T03:28:51.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.875+0000 7fd3c95d9e00 1 -- 10.20.193.28:0/2441909222 wait complete. 2026-02-20T03:28:51.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.877+0000 7fd3c95d9e00 20 client.28045 trim_cache size 0 max 16384 2026-02-20T03:28:51.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:28:51.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:28:51.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:28:51.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:28:51.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.877+0000 7fd3c54ef640 1 -- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3980b0c20 msgr2=0x7fd3980b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:51.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.877+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3980b0c20 0x7fd3980b30e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x555c1fe23e20 tx=0x7fd3b400b040 comp rx=0 tx=0).stop 2026-02-20T03:28:51.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.877+0000 7fd3c54ef640 1 -- 10.20.193.28:0/2950654664 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109e60 msgr2=0x7fd3c01a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:28:51.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.877+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109e60 0x7fd3c01a1440 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400d950 tx=0x7fd3a400de20 comp rx=0 tx=0).stop 2026-02-20T03:28:51.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.878+0000 7fd3c54ef640 1 -- 10.20.193.28:0/2950654664 shutdown_connections 2026-02-20T03:28:51.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.878+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd3980b0c20 0x7fd3980b30e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.878+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd3c010a930 0x7fd3c01a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.878+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd3c0109e60 0x7fd3c01a1440 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.878+0000 7fd3c54ef640 1 --2- 10.20.193.28:0/2950654664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd3c0109490 0x7fd3c01a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:28:51.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.878+0000 7fd3c54ef640 1 -- 10.20.193.28:0/2950654664 >> 10.20.193.28:0/2950654664 conn(0x7fd3c0077e40 msgr2=0x7fd3c010d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:28:51.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.878+0000 7fd3c54ef640 1 -- 10.20.193.28:0/2950654664 shutdown_connections 2026-02-20T03:28:51.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:28:51.878+0000 7fd3c54ef640 1 -- 10.20.193.28:0/2950654664 wait complete. 2026-02-20T03:28:52.285 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:28:51 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setuser ceph since I am not root 2026-02-20T03:28:52.285 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:28:51 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setgroup ceph since I am not root 2026-02-20T03:28:52.285 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:28:51 trial177 ceph-mds[71178]: -- 10.20.193.177:0/1911046628 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d4d484b40 con 0x564d4c6aa800 2026-02-20T03:28:52.285 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:28:51 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: starting mds.c at 2026-02-20T03:28:52.504 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:52 trial028 ceph-mon[38552]: daemon mds.c restarted 2026-02-20T03:28:52.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:52 trial126 ceph-mon[38476]: daemon mds.c restarted 2026-02-20T03:28:52.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 21683 58.52 MB/sec warmup 23 sec latency 442.291 ms 2026-02-20T03:28:52.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:52 trial177 ceph-mon[43181]: daemon mds.c restarted 2026-02-20T03:28:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:53 trial126 ceph-mon[38476]: pgmap v608: 129 pgs: 129 active+clean; 241 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 725 op/s 2026-02-20T03:28:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:53 trial126 ceph-mon[38476]: osdmap e96: 12 total, 12 up, 12 in 2026-02-20T03:28:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:53 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6836/1601146575,v1:10.20.193.177:6837/1601146575] up:boot 2026-02-20T03:28:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:53 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:28:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:28:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:53 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:28:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:53 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:28:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:53 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:28:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:53 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:28:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:53 trial028 ceph-mon[38552]: pgmap v608: 129 pgs: 129 active+clean; 241 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 725 op/s 2026-02-20T03:28:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:53 trial028 ceph-mon[38552]: osdmap e96: 12 total, 12 up, 12 in 2026-02-20T03:28:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:53 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6836/1601146575,v1:10.20.193.177:6837/1601146575] up:boot 2026-02-20T03:28:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:53 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:28:53.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:28:53.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:53 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:28:53.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:53 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:28:53.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:53 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:28:53.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:53 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:28:53.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 22814 57.98 MB/sec warmup 24 sec latency 464.761 ms 2026-02-20T03:28:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:53 trial177 ceph-mon[43181]: pgmap v608: 129 pgs: 129 active+clean; 241 MiB data, 4.6 GiB used, 8.2 TiB / 8.2 TiB avail; 2.3 MiB/s rd, 5.4 MiB/s wr, 725 op/s 2026-02-20T03:28:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:53 trial177 ceph-mon[43181]: osdmap e96: 12 total, 12 up, 12 in 2026-02-20T03:28:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:53 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6836/1601146575,v1:10.20.193.177:6837/1601146575] up:boot 2026-02-20T03:28:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:53 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:28:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:28:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:53 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:28:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:53 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:28:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:53 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:28:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:53 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:28:54.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 24387 59.69 MB/sec warmup 25 sec latency 22.608 ms 2026-02-20T03:28:55.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:55 trial126 ceph-mon[38476]: pgmap v610: 129 pgs: 129 active+clean; 231 MiB data, 4.7 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 887 op/s 2026-02-20T03:28:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:55 trial028 ceph-mon[38552]: pgmap v610: 129 pgs: 129 active+clean; 231 MiB data, 4.7 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 887 op/s 2026-02-20T03:28:55.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 25158 58.99 MB/sec warmup 26 sec latency 41.082 ms 2026-02-20T03:28:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:55 trial177 ceph-mon[43181]: pgmap v610: 129 pgs: 129 active+clean; 231 MiB data, 4.7 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 5.9 MiB/s wr, 887 op/s 2026-02-20T03:28:56.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 26171 58.19 MB/sec warmup 27 sec latency 90.039 ms 2026-02-20T03:28:57.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:57 trial028 ceph-mon[38552]: pgmap v611: 129 pgs: 129 active+clean; 218 MiB data, 4.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 1.18k op/s 2026-02-20T03:28:57.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:57 trial126 ceph-mon[38476]: pgmap v611: 129 pgs: 129 active+clean; 218 MiB data, 4.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 1.18k op/s 2026-02-20T03:28:57.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 27329 58.42 MB/sec warmup 28 sec latency 342.626 ms 2026-02-20T03:28:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:57 trial177 ceph-mon[43181]: pgmap v611: 129 pgs: 129 active+clean; 218 MiB data, 4.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.4 MiB/s rd, 5.6 MiB/s wr, 1.18k op/s 2026-02-20T03:28:58.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 27418 56.59 MB/sec warmup 29 sec latency 1253.888 ms 2026-02-20T03:28:59.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:59 trial126 ceph-mon[38476]: pgmap v612: 129 pgs: 129 active+clean; 223 MiB data, 4.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 1.21k op/s 2026-02-20T03:28:59.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:28:59 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:28:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:59 trial028 ceph-mon[38552]: pgmap v612: 129 pgs: 129 active+clean; 223 MiB data, 4.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 1.21k op/s 2026-02-20T03:28:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:28:59 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:28:59.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 28833 57.62 MB/sec warmup 30 sec latency 52.722 ms 2026-02-20T03:28:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:59 trial177 ceph-mon[43181]: pgmap v612: 129 pgs: 129 active+clean; 223 MiB data, 4.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.2 MiB/s rd, 5.5 MiB/s wr, 1.21k op/s 2026-02-20T03:28:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:28:59 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:29:00.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 30493 58.41 MB/sec warmup 31 sec latency 35.528 ms 2026-02-20T03:29:01.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:01 trial126 ceph-mon[38476]: pgmap v613: 129 pgs: 129 active+clean; 238 MiB data, 4.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 1.17k op/s 2026-02-20T03:29:01.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:01 trial028 ceph-mon[38552]: pgmap v613: 129 pgs: 129 active+clean; 238 MiB data, 4.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 1.17k op/s 2026-02-20T03:29:01.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 32528 60.42 MB/sec warmup 32 sec latency 14.356 ms 2026-02-20T03:29:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:01 trial177 ceph-mon[43181]: pgmap v613: 129 pgs: 129 active+clean; 238 MiB data, 4.9 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 MiB/s rd, 5.9 MiB/s wr, 1.17k op/s 2026-02-20T03:29:02.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33378 59.81 MB/sec warmup 33 sec latency 215.860 ms 2026-02-20T03:29:03.593 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:03 trial028 ceph-mon[38552]: pgmap v614: 129 pgs: 129 active+clean; 244 MiB data, 4.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 1.09k op/s 2026-02-20T03:29:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:03 trial126 ceph-mon[38476]: pgmap v614: 129 pgs: 129 active+clean; 244 MiB data, 4.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 1.09k op/s 2026-02-20T03:29:03.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33506 58.17 MB/sec warmup 34 sec latency 462.977 ms 2026-02-20T03:29:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:03 trial177 ceph-mon[43181]: pgmap v614: 129 pgs: 129 active+clean; 244 MiB data, 4.9 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 6.4 MiB/s wr, 1.09k op/s 2026-02-20T03:29:04.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:04 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:29:04.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:04 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:29:04.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33567 56.62 MB/sec warmup 35 sec latency 747.456 ms 2026-02-20T03:29:04.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:04 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:29:04.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- 10.20.193.28:0/2326157989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5268104260 msgr2=0x7f526810aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:04.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 --2- 10.20.193.28:0/2326157989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5268104260 0x7f526810aaf0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f525800b0a0 tx=0x7f525802f450 comp rx=0 tx=0).stop 2026-02-20T03:29:04.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- 10.20.193.28:0/2326157989 shutdown_connections 2026-02-20T03:29:04.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 --2- 10.20.193.28:0/2326157989 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5268104260 0x7f526810aaf0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 --2- 10.20.193.28:0/2326157989 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52681038a0 0x7f5268103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 --2- 10.20.193.28:0/2326157989 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f52681026b0 0x7f5268102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- 10.20.193.28:0/2326157989 >> 10.20.193.28:0/2326157989 conn(0x7f52680fde10 msgr2=0x7f5268100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:04.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- 10.20.193.28:0/2326157989 shutdown_connections 2026-02-20T03:29:04.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- 10.20.193.28:0/2326157989 wait complete. 2026-02-20T03:29:04.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 Processor -- start 2026-02-20T03:29:04.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- start start 2026-02-20T03:29:04.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52681026b0 0x7f5268076e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52681038a0 0x7f5268075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5268104260 0x7f52680759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f526810e270 con 0x7f52681026b0 2026-02-20T03:29:04.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f526810e0f0 con 0x7f52681038a0 2026-02-20T03:29:04.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f526810e3f0 con 0x7f5268104260 2026-02-20T03:29:04.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52681026b0 0x7f5268076e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:04.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52681026b0 0x7f5268076e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33964/0 (socket says 10.20.193.28:33964) 2026-02-20T03:29:04.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266575640 1 -- 10.20.193.28:0/523309376 learned_addr learned my addr 10.20.193.28:0/523309376 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:04.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266575640 1 -- 10.20.193.28:0/523309376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5268104260 msgr2=0x7f52680759a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:04.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266575640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5268104260 0x7f52680759a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266575640 1 -- 10.20.193.28:0/523309376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52681038a0 msgr2=0x7f5268075460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:04.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266575640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52681038a0 0x7f5268075460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266575640 1 -- 10.20.193.28:0/523309376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5268076240 con 0x7f52681026b0 2026-02-20T03:29:04.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266575640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52681026b0 0x7f5268076e20 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b750 tx=0x7f525c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:04.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f524f7fe640 1 -- 10.20.193.28:0/523309376 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c004480 con 0x7f52681026b0 2026-02-20T03:29:04.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f524f7fe640 1 -- 10.20.193.28:0/523309376 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f525c010070 con 0x7f52681026b0 2026-02-20T03:29:04.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f524f7fe640 1 -- 10.20.193.28:0/523309376 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c00ca90 con 0x7f52681026b0 2026-02-20T03:29:04.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- 10.20.193.28:0/523309376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52681a4aa0 con 0x7f52681026b0 2026-02-20T03:29:04.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5267577640 1 -- 10.20.193.28:0/523309376 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52681a4fa0 con 0x7f52681026b0 2026-02-20T03:29:04.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f524f7fe640 1 -- 10.20.193.28:0/523309376 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f525c01d030 con 0x7f52681026b0 2026-02-20T03:29:04.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f526fa54e00 1 Processor -- start 2026-02-20T03:29:04.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f526fa54e00 1 -- start start 2026-02-20T03:29:04.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x562712099280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 0x56271209df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 0x5627120a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f526fa54e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562711fe98f0 con 0x562712098e80 2026-02-20T03:29:04.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f526fa54e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562711f972e0 con 0x5627120997c0 2026-02-20T03:29:04.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f526fa54e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562711fe5820 con 0x56271209e560 2026-02-20T03:29:04.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x562712099280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:04.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x562712099280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33966/0 (socket says 10.20.193.28:33966) 2026-02-20T03:29:04.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266d76640 1 -- 10.20.193.28:0/1657041849 learned_addr learned my addr 10.20.193.28:0/1657041849 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:04.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266d76640 1 -- 10.20.193.28:0/1657041849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 msgr2=0x5627120a09f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:29:04.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266d76640 1 --2- 10.20.193.28:0/1657041849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 0x5627120a09f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.970 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266d76640 1 -- 10.20.193.28:0/1657041849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 msgr2=0x56271209df40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:04.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266d76640 1 --2- 10.20.193.28:0/1657041849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 0x56271209df40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266d76640 1 -- 10.20.193.28:0/1657041849 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562711f895a0 con 0x562712098e80 2026-02-20T03:29:04.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.958+0000 7f5266d76640 1 --2- 10.20.193.28:0/1657041849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x562712099280 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f5258009850 tx=0x7f5258009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0c1bfae1d4fbcf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:04.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f524cbfe640 1 -- 10.20.193.28:0/1657041849 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258004270 con 0x562712098e80 2026-02-20T03:29:04.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f524cbfe640 1 -- 10.20.193.28:0/1657041849 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5258033030 con 0x562712098e80 2026-02-20T03:29:04.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f524f7fe640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52400b0e20 0x7f52400b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f524f7fe640 1 -- 10.20.193.28:0/523309376 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f525c0df900 con 0x7f52681026b0 2026-02-20T03:29:04.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 -- 10.20.193.28:0/1657041849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 msgr2=0x562712099280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1657041849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x562712099280 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f5258009850 tx=0x7f5258009e00 comp rx=0 tx=0).stop 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f524cbfe640 1 -- 10.20.193.28:0/1657041849 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258002cc0 con 0x562712098e80 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 -- 10.20.193.28:0/1657041849 shutdown_connections 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1657041849 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 0x5627120a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1657041849 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 0x56271209df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1657041849 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x562712099280 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 -- 10.20.193.28:0/1657041849 >> 10.20.193.28:0/1657041849 conn(0x5627120906f0 msgr2=0x562712097570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 -- 10.20.193.28:0/1657041849 shutdown_connections 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 -- 10.20.193.28:0/1657041849 wait complete. 2026-02-20T03:29:04.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f5266575640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52400b0e20 0x7f52400b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:04.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f5266575640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52400b0e20 0x7f52400b32e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f525c0a72e0 tx=0x7f525c0046b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:04.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 -- start start 2026-02-20T03:29:04.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.964+0000 7f526fa54e00 1 Processor -- start 2026-02-20T03:29:04.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.966+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x5627120ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.966+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 0x5627120ba900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.966+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 0x5627120c1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.966+0000 7f526fa54e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562711f910c0 con 0x562712098e80 2026-02-20T03:29:04.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.966+0000 7f526fa54e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5627120a1600 con 0x5627120997c0 2026-02-20T03:29:04.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.966+0000 7f526fa54e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5627120c1d10 con 0x56271209e560 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.966+0000 7f5266d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x5627120ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.966+0000 7f5266d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x5627120ba3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33968/0 (socket says 10.20.193.28:33968) 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.966+0000 7f5266d76640 1 -- 10.20.193.28:0/1965079282 learned_addr learned my addr 10.20.193.28:0/1965079282 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5265d74640 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 0x5627120ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5266d76640 1 -- 10.20.193.28:0/1965079282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 msgr2=0x5627120c1780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5266d76640 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 0x5627120c1780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5266d76640 1 -- 10.20.193.28:0/1965079282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 msgr2=0x5627120ba900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5266d76640 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 0x5627120ba900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5266d76640 1 -- 10.20.193.28:0/1965079282 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627120ab0d0 con 0x562712098e80 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5266d76640 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x5627120ba3c0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f52580090d0 tx=0x7f5258009100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbd3dc98355b062 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:04.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5265d74640 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 0x5627120ba900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:29:04.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5217fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:04.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5217fff640 1 -- 10.20.193.28:0/1965079282 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258004d40 con 0x562712098e80 2026-02-20T03:29:04.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5217fff640 1 -- 10.20.193.28:0/1965079282 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5258049070 con 0x562712098e80 2026-02-20T03:29:04.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5217fff640 1 -- 10.20.193.28:0/1965079282 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258041440 con 0x562712098e80 2026-02-20T03:29:04.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 1 -- 10.20.193.28:0/1965079282 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562711fa5820 con 0x562712098e80 2026-02-20T03:29:04.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 10 client.19308 _ll_register_callbacks cb 0x562711f94ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:04.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 1 -- 10.20.193.28:0/1965079282 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562711ff14e0 con 0x562712098e80 2026-02-20T03:29:04.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5217fff640 1 -- 10.20.193.28:0/1965079282 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f52580078c0 con 0x562712098e80 2026-02-20T03:29:04.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5217fff640 1 -- 10.20.193.28:0/1965079282 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5258002a60 con 0x562712098e80 2026-02-20T03:29:04.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 10 client.19308 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:04.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 1 -- 10.20.193.28:0/1965079282 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x562711faa380 con 0x562712098e80 2026-02-20T03:29:04.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f5217fff640 1 -- 10.20.193.28:0/1965079282 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f525803f020 con 0x562712098e80 2026-02-20T03:29:04.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 10 client.19308 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:04.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 10 client.19308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:04.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 20 client.19308 populate_metadata read hostname 'trial028' 2026-02-20T03:29:04.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627120c5ab0 0x5627120c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:04.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 4 client.19308 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:04.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.967+0000 7f526fa54e00 1 -- 10.20.193.28:0/1965079282 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562711f6bbd0 con 0x5627120c5ab0 2026-02-20T03:29:04.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.981+0000 7f5265d74640 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627120c5ab0 0x5627120c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:04.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.995+0000 7f5265d74640 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627120c5ab0 0x5627120c7f70 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7a9891bb82e7436 server_cookie=68b0dca444096709 in_seq=0 out_seq=0 2026-02-20T03:29:05.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:04.995+0000 7f5217fff640 10 client.19308 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:05.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f5217fff640 1 -- 10.20.193.28:0/1965079282 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562711f6bbd0 con 0x5627120c5ab0 2026-02-20T03:29:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f5217fff640 10 client.19308 handle_command_reply: tid=0 2026-02-20T03:29:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 client.19308 shutdown 2026-02-20T03:29:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 -- 10.20.193.28:0/1965079282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 msgr2=0x5627120ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:05.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x5627120ba3c0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f52580090d0 tx=0x7f5258009100 comp rx=0 tx=0).stop 2026-02-20T03:29:05.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 -- 10.20.193.28:0/1965079282 shutdown_connections 2026-02-20T03:29:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5627120c5ab0 0x5627120c7f70 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 0x5627120c1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5627120997c0 0x5627120ba900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 --2- 10.20.193.28:0/1965079282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562712098e80 0x5627120ba3c0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 -- 10.20.193.28:0/1965079282 >> 10.20.193.28:0/1965079282 conn(0x5627120906f0 msgr2=0x56271209f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f5217fff640 0 client.19308 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 -- 10.20.193.28:0/1965079282 shutdown_connections 2026-02-20T03:29:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 1 -- 10.20.193.28:0/1965079282 wait complete. 2026-02-20T03:29:05.015 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.009+0000 7f526fa54e00 20 client.19308 trim_cache size 0 max 16384 2026-02-20T03:29:05.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 Processor -- start 2026-02-20T03:29:05.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- start start 2026-02-20T03:29:05.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562712098e80 0x5627120ba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:05.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:05.027 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 0x5627120b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f520c0128a0 con 0x5627120997c0 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f520c010110 con 0x562712098e80 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f520c00df60 con 0x56271209e560 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f5265d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f5265d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120c1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33978/0 (socket says 10.20.193.28:33978) 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f5265d74640 1 -- 10.20.193.28:0/2134820649 learned_addr learned my addr 10.20.193.28:0/2134820649 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f5265d74640 1 -- 10.20.193.28:0/2134820649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 msgr2=0x5627120b0680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f5265d74640 1 --2- 10.20.193.28:0/2134820649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 0x5627120b0680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f5265d74640 1 -- 10.20.193.28:0/2134820649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562712098e80 msgr2=0x5627120ba8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:05.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f5265d74640 1 --2- 10.20.193.28:0/2134820649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562712098e80 0x5627120ba8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f5265d74640 1 -- 10.20.193.28:0/2134820649 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627120aaf00 con 0x5627120997c0 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f5265d74640 1 --2- 10.20.193.28:0/2134820649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120c1740 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x5627120bb6e0 tx=0x7f5250008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b8b9adfc6b201b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f52323ff640 1 -- 10.20.193.28:0/2134820649 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525001f070 con 0x5627120997c0 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f52323ff640 1 -- 10.20.193.28:0/2134820649 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x562711f6bbd0 con 0x5627120997c0 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f52323ff640 1 -- 10.20.193.28:0/2134820649 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250014cb0 con 0x5627120997c0 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- 10.20.193.28:0/2134820649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 msgr2=0x5627120c1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- 10.20.193.28:0/2134820649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120c1740 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x5627120bb6e0 tx=0x7f5250008040 comp rx=0 tx=0).stop 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- 10.20.193.28:0/2134820649 shutdown_connections 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- 10.20.193.28:0/2134820649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56271209e560 0x5627120b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- 10.20.193.28:0/2134820649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120c1740 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.029 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- 10.20.193.28:0/2134820649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562712098e80 0x5627120ba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- 10.20.193.28:0/2134820649 >> 10.20.193.28:0/2134820649 conn(0x5627120906f0 msgr2=0x5627120aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- 10.20.193.28:0/2134820649 shutdown_connections 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- 10.20.193.28:0/2134820649 wait complete. 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- start start 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 Processor -- start 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562712098e80 0x5627120bef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120bf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56271209e560 0x5627120c0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f520c00e5d0 con 0x5627120997c0 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f520c00fa40 con 0x56271209e560 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.019+0000 7f526fa54e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f520c00eca0 con 0x562712098e80 2026-02-20T03:29:05.030 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.023+0000 7f5265d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120bf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:05.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.023+0000 7f5265d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120bf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33982/0 (socket says 10.20.193.28:33982) 2026-02-20T03:29:05.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.023+0000 7f5265d74640 1 -- 10.20.193.28:0/3780004414 learned_addr learned my addr 10.20.193.28:0/3780004414 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:05.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.023+0000 7f5265d74640 1 -- 10.20.193.28:0/3780004414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562712098e80 msgr2=0x5627120bef30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:05.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.023+0000 7f5265d74640 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562712098e80 0x5627120bef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.023+0000 7f5265d74640 1 -- 10.20.193.28:0/3780004414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56271209e560 msgr2=0x5627120c0320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:05.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.023+0000 7f5265d74640 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56271209e560 0x5627120c0320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.023+0000 7f5265d74640 1 -- 10.20.193.28:0/3780004414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562711d49690 con 0x5627120997c0 2026-02-20T03:29:05.031 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.024+0000 7f5265d74640 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120bf470 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f5250008010 tx=0x7f52500143b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbe881278b83061 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:05.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f5217fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:05.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f5217fff640 1 -- 10.20.193.28:0/3780004414 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250028030 con 0x5627120997c0 2026-02-20T03:29:05.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f5217fff640 1 -- 10.20.193.28:0/3780004414 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5250014520 con 0x5627120997c0 2026-02-20T03:29:05.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f5217fff640 1 -- 10.20.193.28:0/3780004414 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525001f040 con 0x5627120997c0 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 1 -- 10.20.193.28:0/3780004414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562711faeb70 con 0x5627120997c0 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f5217fff640 1 -- 10.20.193.28:0/3780004414 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f5250024670 con 0x5627120997c0 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f5217fff640 10 client.19314 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 10 client.19314 _ll_register_callbacks cb 0x7f52580096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 1 -- 10.20.193.28:0/3780004414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5258033030 con 0x5627120997c0 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f5217fff640 1 -- 10.20.193.28:0/3780004414 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f52500028a0 con 0x5627120997c0 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 10 client.19314 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 1 -- 10.20.193.28:0/3780004414 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x5627120abbf0 con 0x5627120997c0 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f5217fff640 1 -- 10.20.193.28:0/3780004414 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f5250038020 con 0x5627120997c0 2026-02-20T03:29:05.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 10 client.19314 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 10 client.19314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 20 client.19314 populate_metadata read hostname 'trial028' 2026-02-20T03:29:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562712130e60 0x562712133320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 4 client.19314 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:29:05.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.025+0000 7f526fa54e00 1 -- 10.20.193.28:0/3780004414 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562711dc2520 con 0x562712130e60 2026-02-20T03:29:05.041 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.039+0000 7f5266d76640 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562712130e60 0x562712133320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:05.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.067+0000 7f5266d76640 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562712130e60 0x562712133320 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d1acc274038b06e server_cookie=c4b46da13045747 in_seq=0 out_seq=0 2026-02-20T03:29:05.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.067+0000 7f5217fff640 10 client.19314 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:05.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:05 trial028 ceph-mon[38552]: pgmap v615: 129 pgs: 129 active+clean; 277 MiB data, 5.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 8.5 MiB/s wr, 1.00k op/s 2026-02-20T03:29:05.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f5217fff640 1 -- 10.20.193.28:0/3780004414 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562711dc2520 con 0x562712130e60 2026-02-20T03:29:05.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f5217fff640 10 client.19314 handle_command_reply: tid=0 2026-02-20T03:29:05.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f526fa54e00 1 client.19314 shutdown 2026-02-20T03:29:05.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f526fa54e00 1 -- 10.20.193.28:0/3780004414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 msgr2=0x5627120bf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:05.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f526fa54e00 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120bf470 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f5250008010 tx=0x7f52500143b0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f526fa54e00 1 -- 10.20.193.28:0/3780004414 shutdown_connections 2026-02-20T03:29:05.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f526fa54e00 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562712130e60 0x562712133320 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f526fa54e00 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56271209e560 0x5627120c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f526fa54e00 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5627120997c0 0x5627120bf470 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f526fa54e00 1 --2- 10.20.193.28:0/3780004414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562712098e80 0x5627120bef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f526fa54e00 1 -- 10.20.193.28:0/3780004414 >> 10.20.193.28:0/3780004414 conn(0x5627120906f0 msgr2=0x5627120ba790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:05.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.574+0000 7f5217fff640 0 client.19314 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:05.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.575+0000 7f526fa54e00 1 -- 10.20.193.28:0/3780004414 shutdown_connections 2026-02-20T03:29:05.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.575+0000 7f526fa54e00 1 -- 10.20.193.28:0/3780004414 wait complete. 2026-02-20T03:29:05.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.575+0000 7f526fa54e00 20 client.19314 trim_cache size 0 max 16384 2026-02-20T03:29:05.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:29:05.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 -- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52400b0e20 msgr2=0x7f52400b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52400b0e20 0x7f52400b32e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f525c0a72e0 tx=0x7f525c0046b0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 -- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52681026b0 msgr2=0x7f5268076e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52681026b0 0x7f5268076e20 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f525c00b750 tx=0x7f525c00bc20 comp rx=0 tx=0).stop 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 -- 10.20.193.28:0/523309376 shutdown_connections 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52400b0e20 0x7f52400b32e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5268104260 0x7f52680759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52681038a0 0x7f5268075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.579 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 --2- 10.20.193.28:0/523309376 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52681026b0 0x7f5268076e20 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:05.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.576+0000 7f5267577640 1 -- 10.20.193.28:0/523309376 >> 10.20.193.28:0/523309376 conn(0x7f52680fde10 msgr2=0x7f5268106cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:05.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.580+0000 7f5267577640 1 -- 10.20.193.28:0/523309376 shutdown_connections 2026-02-20T03:29:05.590 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:05.580+0000 7f5267577640 1 -- 10.20.193.28:0/523309376 wait complete. 2026-02-20T03:29:05.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:05 trial126 ceph-mon[38476]: pgmap v615: 129 pgs: 129 active+clean; 277 MiB data, 5.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 8.5 MiB/s wr, 1.00k op/s 2026-02-20T03:29:05.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33595 55.13 MB/sec warmup 36 sec latency 1747.499 ms 2026-02-20T03:29:05.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:05 trial177 ceph-mon[43181]: pgmap v615: 129 pgs: 129 active+clean; 277 MiB data, 5.0 GiB used, 8.2 TiB / 8.2 TiB avail; 2.9 MiB/s rd, 8.5 MiB/s wr, 1.00k op/s 2026-02-20T03:29:06.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33597 53.64 MB/sec warmup 37 sec latency 2721.472 ms 2026-02-20T03:29:07.444 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:07 trial028 ceph-mon[38552]: pgmap v616: 129 pgs: 129 active+clean; 410 MiB data, 5.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 866 op/s 2026-02-20T03:29:07.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33597 52.23 MB/sec warmup 38 sec latency 3721.506 ms 2026-02-20T03:29:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:07 trial177 ceph-mon[43181]: pgmap v616: 129 pgs: 129 active+clean; 410 MiB data, 5.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 866 op/s 2026-02-20T03:29:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:07 trial126 ceph-mon[38476]: pgmap v616: 129 pgs: 129 active+clean; 410 MiB data, 5.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 19 MiB/s wr, 866 op/s 2026-02-20T03:29:08.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33597 50.89 MB/sec warmup 39 sec latency 4721.542 ms 2026-02-20T03:29:09.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:09 trial028 ceph-mon[38552]: pgmap v617: 129 pgs: 129 active+clean; 465 MiB data, 5.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 23 MiB/s wr, 745 op/s 2026-02-20T03:29:09.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33597 49.62 MB/sec warmup 40 sec latency 5721.575 ms 2026-02-20T03:29:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:09 trial177 ceph-mon[43181]: pgmap v617: 129 pgs: 129 active+clean; 465 MiB data, 5.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 23 MiB/s wr, 745 op/s 2026-02-20T03:29:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:09 trial126 ceph-mon[38476]: pgmap v617: 129 pgs: 129 active+clean; 465 MiB data, 5.4 GiB used, 8.2 TiB / 8.2 TiB avail; 3.0 MiB/s rd, 23 MiB/s wr, 745 op/s 2026-02-20T03:29:10.450 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.5 2026-02-20T03:29:10.451 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:29:10.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33597 48.41 MB/sec warmup 41 sec latency 6721.614 ms 2026-02-20T03:29:10.756 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:11.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2226755793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24104da0 msgr2=0x7f0e24105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:11.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2226755793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24104da0 0x7f0e24105180 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009a30 tx=0x7f0e1002f260 comp rx=0 tx=0).stop 2026-02-20T03:29:11.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2226755793 shutdown_connections 2026-02-20T03:29:11.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2226755793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e24109ed0 0x7f0e24111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2226755793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e24105750 0x7f0e241097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2226755793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24104da0 0x7f0e24105180 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2226755793 >> 10.20.193.28:0/2226755793 conn(0x7f0e24100840 msgr2=0x7f0e24102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:11.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2226755793 shutdown_connections 2026-02-20T03:29:11.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2226755793 wait complete. 2026-02-20T03:29:11.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 Processor -- start 2026-02-20T03:29:11.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- start start 2026-02-20T03:29:11.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e24104da0 0x7f0e24077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24105750 0x7f0e24077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e24109ed0 0x7f0e24078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24114e80 con 0x7f0e24105750 2026-02-20T03:29:11.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24114d00 con 0x7f0e24109ed0 2026-02-20T03:29:11.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0e24115000 con 0x7f0e24104da0 2026-02-20T03:29:11.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24105750 0x7f0e24077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:11.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e22ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24105750 0x7f0e24077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58318/0 (socket says 10.20.193.28:58318) 2026-02-20T03:29:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e22ffd640 1 -- 10.20.193.28:0/2937144588 learned_addr learned my addr 10.20.193.28:0/2937144588 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e22ffd640 1 -- 10.20.193.28:0/2937144588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e24104da0 msgr2=0x7f0e24077600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e22ffd640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e24104da0 0x7f0e24077600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e22ffd640 1 -- 10.20.193.28:0/2937144588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e24109ed0 msgr2=0x7f0e24078080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e22ffd640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e24109ed0 0x7f0e24078080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e22ffd640 1 -- 10.20.193.28:0/2937144588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e241adb70 con 0x7f0e24105750 2026-02-20T03:29:11.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e22ffd640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24105750 0x7f0e24077b40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400b5a0 tx=0x7f0e1400ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:11.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e20ff9640 1 -- 10.20.193.28:0/2937144588 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e14012070 con 0x7f0e24105750 2026-02-20T03:29:11.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e20ff9640 1 -- 10.20.193.28:0/2937144588 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0e14004480 con 0x7f0e24105750 2026-02-20T03:29:11.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e20ff9640 1 -- 10.20.193.28:0/2937144588 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1400dac0 con 0x7f0e24105750 2026-02-20T03:29:11.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e241ade60 con 0x7f0e24105750 2026-02-20T03:29:11.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e241ae260 con 0x7f0e24105750 2026-02-20T03:29:11.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e24106280 con 0x7f0e24105750 2026-02-20T03:29:11.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.009+0000 7f0e20ff9640 1 -- 10.20.193.28:0/2937144588 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0e1400dc80 con 0x7f0e24105750 2026-02-20T03:29:11.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.015+0000 7f0e20ff9640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0e20 0x7f0df80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.015+0000 7f0e20ff9640 1 -- 10.20.193.28:0/2937144588 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f0e140e0410 con 0x7f0e24105750 2026-02-20T03:29:11.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.015+0000 7f0e237fe640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0e20 0x7f0df80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:11.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.015+0000 7f0e20ff9640 1 -- 10.20.193.28:0/2937144588 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0e140a87f0 con 0x7f0e24105750 2026-02-20T03:29:11.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.015+0000 7f0e237fe640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0e20 0x7f0df80b32e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009950 tx=0x7f0e100023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:11.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e24105180 con 0x7f0e24105750 2026-02-20T03:29:11.129 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:29:11.129 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":35,"btime":"2026-02-20T03:29:03:321410+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:29:02.385088+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28051":{"gid":28051,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1601146575","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1601146575},{"type":"v1","addr":"10.20.193.177:6837","nonce":1601146575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:29:11.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e20ff9640 1 -- 10.20.193.28:0/2937144588 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11925 (secure 0 0 0) 0x7f0e24105180 con 0x7f0e24105750 2026-02-20T03:29:11.130 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 35 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0e20 msgr2=0x7f0df80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0e20 0x7f0df80b32e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0e10009950 tx=0x7f0e100023d0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24105750 msgr2=0x7f0e24077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24105750 0x7f0e24077b40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400b5a0 tx=0x7f0e1400ba70 comp rx=0 tx=0).stop 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 shutdown_connections 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0df80b0e20 0x7f0df80b32e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e24109ed0 0x7f0e24078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e24105750 0x7f0e24077b40 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 --2- 10.20.193.28:0/2937144588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e24104da0 0x7f0e24077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 >> 10.20.193.28:0/2937144588 conn(0x7f0e24100840 msgr2=0x7f0e24101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 shutdown_connections 2026-02-20T03:29:11.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.124+0000 7f0e29fd5640 1 -- 10.20.193.28:0/2937144588 wait complete. 2026-02-20T03:29:11.285 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 141.5 --await-for 45.0' 2026-02-20T03:29:11.286 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 141.5 --await-for 45.0 2026-02-20T03:29:11.450 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:11 trial028 ceph-mon[38552]: pgmap v618: 129 pgs: 129 active+clean; 464 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 25 MiB/s wr, 958 op/s 2026-02-20T03:29:11.451 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:11 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2937144588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:11.563 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:11.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33599 47.26 MB/sec warmup 42 sec latency 7721.647 ms 2026-02-20T03:29:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:11 trial177 ceph-mon[43181]: pgmap v618: 129 pgs: 129 active+clean; 464 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 25 MiB/s wr, 958 op/s 2026-02-20T03:29:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:11 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2937144588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:11 trial126 ceph-mon[38476]: pgmap v618: 129 pgs: 129 active+clean; 464 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 2.8 MiB/s rd, 25 MiB/s wr, 958 op/s 2026-02-20T03:29:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:11 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2937144588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:11.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.962+0000 7f1b08853640 1 -- 10.20.193.28:0/1152982671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b04108700 msgr2=0x7f1b04108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:11.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.962+0000 7f1b08853640 1 --2- 10.20.193.28:0/1152982671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b04108700 0x7f1b04108ae0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009a60 tx=0x7f1af002f290 comp rx=0 tx=0).stop 2026-02-20T03:29:11.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.962+0000 7f1b08853640 1 -- 10.20.193.28:0/1152982671 shutdown_connections 2026-02-20T03:29:11.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.962+0000 7f1b08853640 1 --2- 10.20.193.28:0/1152982671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b041030a0 0x7f1b0410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.962+0000 7f1b08853640 1 --2- 10.20.193.28:0/1152982671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b04102700 0x7f1b04102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.962+0000 7f1b08853640 1 --2- 10.20.193.28:0/1152982671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b04108700 0x7f1b04108ae0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.962+0000 7f1b08853640 1 -- 10.20.193.28:0/1152982671 >> 10.20.193.28:0/1152982671 conn(0x7f1b040fe440 msgr2=0x7f1b04100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:11.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.962+0000 7f1b08853640 1 -- 10.20.193.28:0/1152982671 shutdown_connections 2026-02-20T03:29:11.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.962+0000 7f1b08853640 1 -- 10.20.193.28:0/1152982671 wait complete. 2026-02-20T03:29:11.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b08853640 1 Processor -- start 2026-02-20T03:29:11.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b08853640 1 -- start start 2026-02-20T03:29:11.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b08853640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b04102700 0x7f1b0410e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b08853640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b041030a0 0x7f1b0410eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b08853640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b04108700 0x7f1b041a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b08853640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04112a50 con 0x7f1b04108700 2026-02-20T03:29:11.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b08853640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b041128d0 con 0x7f1b041030a0 2026-02-20T03:29:11.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b08853640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b04112bd0 con 0x7f1b04102700 2026-02-20T03:29:11.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b04108700 0x7f1b041a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:11.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b04108700 0x7f1b041a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58334/0 (socket says 10.20.193.28:58334) 2026-02-20T03:29:11.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.963+0000 7f1b03fff640 1 -- 10.20.193.28:0/3974218438 learned_addr learned my addr 10.20.193.28:0/3974218438 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:11.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b03fff640 1 -- 10.20.193.28:0/3974218438 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b04102700 msgr2=0x7f1b0410e980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:11.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b03fff640 1 --2- 10.20.193.28:0/3974218438 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b04102700 0x7f1b0410e980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b03fff640 1 -- 10.20.193.28:0/3974218438 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b041030a0 msgr2=0x7f1b0410eec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:11.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b03fff640 1 --2- 10.20.193.28:0/3974218438 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b041030a0 0x7f1b0410eec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b03fff640 1 -- 10.20.193.28:0/3974218438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b041a67c0 con 0x7f1b04108700 2026-02-20T03:29:11.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b03fff640 1 --2- 10.20.193.28:0/3974218438 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b04108700 0x7f1b041a6040 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f1af800b990 tx=0x7f1af800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:11.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b00ff9640 1 -- 10.20.193.28:0/3974218438 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8006e60 con 0x7f1b04108700 2026-02-20T03:29:11.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b00ff9640 1 -- 10.20.193.28:0/3974218438 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1af8010070 con 0x7f1b04108700 2026-02-20T03:29:11.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b00ff9640 1 -- 10.20.193.28:0/3974218438 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af8004800 con 0x7f1b04108700 2026-02-20T03:29:11.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.964+0000 7f1b08853640 1 -- 10.20.193.28:0/3974218438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b041a6ab0 con 0x7f1b04108700 2026-02-20T03:29:11.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.965+0000 7f1b08853640 1 -- 10.20.193.28:0/3974218438 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b041ae2b0 con 0x7f1b04108700 2026-02-20T03:29:11.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.968+0000 7f1b0bfe1e00 1 Processor -- start 2026-02-20T03:29:11.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.969+0000 7f1b00ff9640 1 -- 10.20.193.28:0/3974218438 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1af801d030 con 0x7f1b04108700 2026-02-20T03:29:11.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b0bfe1e00 1 -- start start 2026-02-20T03:29:11.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b00ff9640 1 --2- 10.20.193.28:0/3974218438 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ad80b0e20 0x7f1ad80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b00ff9640 1 -- 10.20.193.28:0/3974218438 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f1af80dfff0 con 0x7f1b04108700 2026-02-20T03:29:11.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 0x55e2303a2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039c860 0x55e23039cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039d220 0x55e2303a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e2302ef410 con 0x55e23039c860 2026-02-20T03:29:11.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e23029c8b0 con 0x55e2303a2170 2026-02-20T03:29:11.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e2302eb340 con 0x55e23039d220 2026-02-20T03:29:11.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/3974218438 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ad80b0e20 0x7f1ad80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:11.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b02ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039c860 0x55e23039cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:11.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b02ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039c860 0x55e23039cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58344/0 (socket says 10.20.193.28:58344) 2026-02-20T03:29:11.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.971+0000 7f1b02ffd640 1 -- 10.20.193.28:0/586616865 learned_addr learned my addr 10.20.193.28:0/586616865 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b02ffd640 1 -- 10.20.193.28:0/586616865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039d220 msgr2=0x55e2303a8fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/586616865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039d220 0x55e2303a8fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b02ffd640 1 -- 10.20.193.28:0/586616865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 msgr2=0x55e2303a2550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/586616865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 0x55e2303a2550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b02ffd640 1 -- 10.20.193.28:0/586616865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e23028e8c0 con 0x55e23039c860 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/3974218438 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1ad80b0e20 0x7f1ad80b32e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1af400cfd0 tx=0x7f1af400c990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/586616865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039c860 0x55e23039cce0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009040 tx=0x7f1af4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3fe3279bb7efda server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1ac7fff640 1 -- 10.20.193.28:0/586616865 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af401f070 con 0x55e23039c860 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1ac7fff640 1 -- 10.20.193.28:0/586616865 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1af4004580 con 0x55e23039c860 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1ac7fff640 1 -- 10.20.193.28:0/586616865 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4006110 con 0x55e23039c860 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/586616865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039c860 msgr2=0x55e23039cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:11.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/586616865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039c860 0x55e23039cce0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009040 tx=0x7f1af4018000 comp rx=0 tx=0).stop 2026-02-20T03:29:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/586616865 shutdown_connections 2026-02-20T03:29:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/586616865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039d220 0x55e2303a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/586616865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039c860 0x55e23039cce0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/586616865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 0x55e2303a2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/586616865 >> 10.20.193.28:0/586616865 conn(0x55e2303953c0 msgr2=0x55e23039af60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:11.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/586616865 shutdown_connections 2026-02-20T03:29:11.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.972+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/586616865 wait complete. 2026-02-20T03:29:11.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b0bfe1e00 1 -- start start 2026-02-20T03:29:11.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b0bfe1e00 1 Processor -- start 2026-02-20T03:29:11.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039c860 0x55e2303b7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 0x55e2303b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e2302964a0 con 0x55e23039d220 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e2303a9660 con 0x55e2303a2170 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e2303b6300 con 0x55e23039c860 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b02ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b02ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58350/0 (socket says 10.20.193.28:58350) 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.974+0000 7f1b02ffd640 1 -- 10.20.193.28:0/2038575050 learned_addr learned my addr 10.20.193.28:0/2038575050 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b02ffd640 1 -- 10.20.193.28:0/2038575050 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039c860 msgr2=0x55e2303b7630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039c860 0x55e2303b7630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b02ffd640 1 -- 10.20.193.28:0/2038575050 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 msgr2=0x55e2303b5d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 0x55e2303b5d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b02ffd640 1 -- 10.20.193.28:0/2038575050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2303aeff0 con 0x55e23039d220 2026-02-20T03:29:11.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303b7b70 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1af4004b40 tx=0x7f1af400ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459d00d0f6ce7d6b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1ac57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1ac57fa640 1 -- 10.20.193.28:0/2038575050 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af401f040 con 0x55e23039d220 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1ac57fa640 1 -- 10.20.193.28:0/2038575050 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1af4004e40 con 0x55e23039d220 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1ac57fa640 1 -- 10.20.193.28:0/2038575050 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4006110 con 0x55e23039d220 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2038575050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2300538a0 con 0x55e23039d220 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1ac57fa640 1 -- 10.20.193.28:0/2038575050 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f1af40062d0 con 0x55e23039d220 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b0bfe1e00 10 client.19332 _ll_register_callbacks cb 0x55e23029a3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2038575050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e2302f7000 con 0x55e23039d220 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1ac57fa640 1 -- 10.20.193.28:0/2038575050 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1af4002780 con 0x55e23039d220 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b0bfe1e00 10 client.19332 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.975+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2038575050 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55e2300bf0e0 con 0x55e23039d220 2026-02-20T03:29:11.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.976+0000 7f1ac57fa640 1 -- 10.20.193.28:0/2038575050 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f1af40040b0 con 0x55e23039d220 2026-02-20T03:29:11.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.976+0000 7f1b0bfe1e00 10 client.19332 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:11.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.976+0000 7f1b0bfe1e00 10 client.19332 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:29:11.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.976+0000 7f1b0bfe1e00 20 client.19332 populate_metadata read hostname 'trial028' 2026-02-20T03:29:11.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.976+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e2303c5830 0x55e2303c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:11.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.976+0000 7f1b0bfe1e00 4 client.19332 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:11.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.976+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2038575050 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e230270f60 con 0x55e2303c5830 2026-02-20T03:29:11.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:11.981+0000 7f1b037fe640 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e2303c5830 0x55e2303c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:12.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.008+0000 7f1b037fe640 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e2303c5830 0x55e2303c7cc0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=798ae71736699836 server_cookie=1ee57692da01e0d6 in_seq=0 out_seq=0 2026-02-20T03:29:12.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.008+0000 7f1ac57fa640 10 client.19332 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:12.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.021+0000 7f1ac57fa640 1 -- 10.20.193.28:0/2038575050 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e230270f60 con 0x55e2303c5830 2026-02-20T03:29:12.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.021+0000 7f1ac57fa640 10 client.19332 handle_command_reply: tid=0 2026-02-20T03:29:12.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.021+0000 7f1b0bfe1e00 1 client.19332 shutdown 2026-02-20T03:29:12.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2038575050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 msgr2=0x55e2303b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303b7b70 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1af4004b40 tx=0x7f1af400ca00 comp rx=0 tx=0).stop 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2038575050 shutdown_connections 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e2303c5830 0x55e2303c7cc0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 0x55e2303b5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303b7b70 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2038575050 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039c860 0x55e2303b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2038575050 >> 10.20.193.28:0/2038575050 conn(0x55e2303953c0 msgr2=0x55e23039b670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1ac57fa640 0 client.19332 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2038575050 shutdown_connections 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2038575050 wait complete. 2026-02-20T03:29:12.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.022+0000 7f1b0bfe1e00 20 client.19332 trim_cache size 0 max 16384 2026-02-20T03:29:12.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b0bfe1e00 1 Processor -- start 2026-02-20T03:29:12.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b0bfe1e00 1 -- start start 2026-02-20T03:29:12.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e23039c860 0x55e2303c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:12.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039d220 0x55e2303b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:12.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2303a2170 0x55e2303b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:12.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa8012750 con 0x55e2303a2170 2026-02-20T03:29:12.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa800ffc0 con 0x55e23039c860 2026-02-20T03:29:12.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa800de10 con 0x55e23039d220 2026-02-20T03:29:12.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2303a2170 0x55e2303b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b03fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2303a2170 0x55e2303b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58356/0 (socket says 10.20.193.28:58356) 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b03fff640 1 -- 10.20.193.28:0/2496122102 learned_addr learned my addr 10.20.193.28:0/2496122102 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b03fff640 1 -- 10.20.193.28:0/2496122102 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039d220 msgr2=0x55e2303b30a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b03fff640 1 --2- 10.20.193.28:0/2496122102 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039d220 0x55e2303b30a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b03fff640 1 -- 10.20.193.28:0/2496122102 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e23039c860 msgr2=0x55e2303c2720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b03fff640 1 --2- 10.20.193.28:0/2496122102 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e23039c860 0x55e2303c2720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b03fff640 1 -- 10.20.193.28:0/2496122102 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2303aee20 con 0x55e2303a2170 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.032+0000 7f1b03fff640 1 --2- 10.20.193.28:0/2496122102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2303a2170 0x55e2303b35e0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1af80a7a30 tx=0x7f1af80a7bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf02beef9e964fd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1ac77fe640 1 -- 10.20.193.28:0/2496122102 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af80c8e60 con 0x55e2303a2170 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1ac77fe640 1 -- 10.20.193.28:0/2496122102 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1af801c2f0 con 0x55e2303a2170 2026-02-20T03:29:12.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1ac77fe640 1 -- 10.20.193.28:0/2496122102 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af80ddb80 con 0x55e2303a2170 2026-02-20T03:29:12.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2496122102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2303a2170 msgr2=0x55e2303b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:12.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2496122102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2303a2170 0x55e2303b35e0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1af80a7a30 tx=0x7f1af80a7bd0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2496122102 shutdown_connections 2026-02-20T03:29:12.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2496122102 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e2303a2170 0x55e2303b35e0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2496122102 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039d220 0x55e2303b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/2496122102 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e23039c860 0x55e2303c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2496122102 >> 10.20.193.28:0/2496122102 conn(0x55e2303953c0 msgr2=0x55e2303b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:12.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2496122102 shutdown_connections 2026-02-20T03:29:12.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.033+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/2496122102 wait complete. 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b0bfe1e00 1 -- start start 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b0bfe1e00 1 Processor -- start 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039c860 0x55e2303beca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303bf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b0bfe1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 0x55e2303bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa800e480 con 0x55e23039d220 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa800f8f0 con 0x55e2303a2170 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b0bfe1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa800eb50 con 0x55e23039c860 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b02ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303bf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b02ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303bf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58372/0 (socket says 10.20.193.28:58372) 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.034+0000 7f1b02ffd640 1 -- 10.20.193.28:0/1735585664 learned_addr learned my addr 10.20.193.28:0/1735585664 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:12.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1b02ffd640 1 -- 10.20.193.28:0/1735585664 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039c860 msgr2=0x55e2303beca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039c860 0x55e2303beca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1b02ffd640 1 -- 10.20.193.28:0/1735585664 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 msgr2=0x55e2303bf720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 0x55e2303bf720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1b02ffd640 1 -- 10.20.193.28:0/1735585664 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2303ae9e0 con 0x55e23039d220 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1b02ffd640 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303bf1e0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1af400ca70 tx=0x7f1af4004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8c6556a274a65d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1ac57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1ac57fa640 1 -- 10.20.193.28:0/1735585664 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af401f050 con 0x55e23039d220 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1ac57fa640 1 -- 10.20.193.28:0/1735585664 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e2302f7000 con 0x55e23039d220 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1ac57fa640 1 -- 10.20.193.28:0/1735585664 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af4004dd0 con 0x55e23039d220 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/1735585664 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2300707f0 con 0x55e23039d220 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1ac57fa640 1 -- 10.20.193.28:0/1735585664 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f1af402e450 con 0x55e23039d220 2026-02-20T03:29:12.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1b0bfe1e00 10 client.19338 _ll_register_callbacks cb 0x7f1af400cbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.035+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/1735585664 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1af4004580 con 0x55e23039d220 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1ac57fa640 1 -- 10.20.193.28:0/1735585664 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1af4006110 con 0x55e23039d220 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1b0bfe1e00 10 client.19338 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/1735585664 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55e2303afb10 con 0x55e23039d220 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1ac57fa640 1 -- 10.20.193.28:0/1735585664 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f1af4039070 con 0x55e23039d220 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1b0bfe1e00 10 client.19338 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1b0bfe1e00 10 client.19338 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1b0bfe1e00 20 client.19338 populate_metadata read hostname 'trial028' 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e230431b70 0x55e230434030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1b0bfe1e00 4 client.19338 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.5, "await_for": 45.0}] 2026-02-20T03:29:12.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.037+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/1735585664 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.5, "await_for": 45.0}) -- 0x55e2303a8be0 con 0x55e230431b70 2026-02-20T03:29:12.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.049+0000 7f1b037fe640 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e230431b70 0x55e230434030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:12.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.076+0000 7f1b037fe640 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e230431b70 0x55e230434030 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=296ff31443c02d95 server_cookie=c6f58bb8297ce7c2 in_seq=0 out_seq=0 2026-02-20T03:29:12.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:12.076+0000 7f1ac57fa640 10 client.19338 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:12.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 46.16 MB/sec warmup 43 sec latency 8721.700 ms 2026-02-20T03:29:13.661 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:13 trial028 ceph-mon[38552]: pgmap v619: 129 pgs: 129 active+clean; 477 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 24 MiB/s wr, 804 op/s 2026-02-20T03:29:13.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 45.11 MB/sec warmup 44 sec latency 9721.744 ms 2026-02-20T03:29:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:13 trial177 ceph-mon[43181]: pgmap v619: 129 pgs: 129 active+clean; 477 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 24 MiB/s wr, 804 op/s 2026-02-20T03:29:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:13 trial126 ceph-mon[38476]: pgmap v619: 129 pgs: 129 active+clean; 477 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 1.6 MiB/s rd, 24 MiB/s wr, 804 op/s 2026-02-20T03:29:14.491 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:14 trial028 ceph-mon[38552]: pgmap v620: 129 pgs: 129 active+clean; 487 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 25 MiB/s wr, 790 op/s 2026-02-20T03:29:14.695 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 44.11 MB/sec warmup 45 sec latency 10721.785 ms 2026-02-20T03:29:14.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:14 trial126 ceph-mon[38476]: pgmap v620: 129 pgs: 129 active+clean; 487 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 25 MiB/s wr, 790 op/s 2026-02-20T03:29:14.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:14 trial177 ceph-mon[43181]: pgmap v620: 129 pgs: 129 active+clean; 487 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.3 MiB/s rd, 25 MiB/s wr, 790 op/s 2026-02-20T03:29:15.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 43.15 MB/sec warmup 46 sec latency 11721.831 ms 2026-02-20T03:29:16.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 42.23 MB/sec warmup 47 sec latency 12721.872 ms 2026-02-20T03:29:17.315 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:17 trial028 ceph-mon[38552]: pgmap v621: 129 pgs: 129 active+clean; 480 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 23 MiB/s wr, 817 op/s 2026-02-20T03:29:17.487 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:29:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:17 trial126 ceph-mon[38476]: pgmap v621: 129 pgs: 129 active+clean; 480 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 23 MiB/s wr, 817 op/s 2026-02-20T03:29:17.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 41.35 MB/sec warmup 48 sec latency 13721.903 ms 2026-02-20T03:29:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:17 trial177 ceph-mon[43181]: pgmap v621: 129 pgs: 129 active+clean; 480 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 1.0 MiB/s rd, 23 MiB/s wr, 817 op/s 2026-02-20T03:29:17.772 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.062+0000 7fd96b577640 1 -- 10.20.193.28:0/2792574741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c10e0a0 msgr2=0x7fd96c111fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.062+0000 7fd96b577640 1 --2- 10.20.193.28:0/2792574741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c10e0a0 0x7fd96c111fd0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fd954009a30 tx=0x7fd95402f260 comp rx=0 tx=0).stop 2026-02-20T03:29:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.062+0000 7fd96b577640 1 -- 10.20.193.28:0/2792574741 shutdown_connections 2026-02-20T03:29:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.062+0000 7fd96b577640 1 --2- 10.20.193.28:0/2792574741 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96c112700 0x7fd96c11a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.062+0000 7fd96b577640 1 --2- 10.20.193.28:0/2792574741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c10e0a0 0x7fd96c111fd0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.062+0000 7fd96b577640 1 --2- 10.20.193.28:0/2792574741 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd96c10d6f0 0x7fd96c10dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.062+0000 7fd96b577640 1 -- 10.20.193.28:0/2792574741 >> 10.20.193.28:0/2792574741 conn(0x7fd96c06d500 msgr2=0x7fd96c06d910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.062+0000 7fd96b577640 1 -- 10.20.193.28:0/2792574741 shutdown_connections 2026-02-20T03:29:18.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.062+0000 7fd96b577640 1 -- 10.20.193.28:0/2792574741 wait complete. 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96b577640 1 Processor -- start 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96b577640 1 -- start start 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96b577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd96c10d6f0 0x7fd96c1ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96b577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96c10e0a0 0x7fd96c1abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c112700 0x7fd96c1a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c11d6b0 con 0x7fd96c112700 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96b577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c11d530 con 0x7fd96c10e0a0 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96b577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c11d830 con 0x7fd96c10d6f0 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c112700 0x7fd96c1a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c112700 0x7fd96c1a59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51560/0 (socket says 10.20.193.28:51560) 2026-02-20T03:29:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96ad76640 1 -- 10.20.193.28:0/2992270512 learned_addr learned my addr 10.20.193.28:0/2992270512 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96ad76640 1 -- 10.20.193.28:0/2992270512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd96c10d6f0 msgr2=0x7fd96c1ab7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96ad76640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd96c10d6f0 0x7fd96c1ab7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96ad76640 1 -- 10.20.193.28:0/2992270512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96c10e0a0 msgr2=0x7fd96c1abd20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96ad76640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96c10e0a0 0x7fd96c1abd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96ad76640 1 -- 10.20.193.28:0/2992270512 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c1a6170 con 0x7fd96c112700 2026-02-20T03:29:18.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96ad76640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c112700 0x7fd96c1a59a0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00b9e0 tx=0x7fd95c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd9537fe640 1 -- 10.20.193.28:0/2992270512 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c006e60 con 0x7fd96c112700 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd9537fe640 1 -- 10.20.193.28:0/2992270512 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd95c010070 con 0x7fd96c112700 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd9537fe640 1 -- 10.20.193.28:0/2992270512 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0047f0 con 0x7fd96c112700 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.067+0000 7fd96b577640 1 -- 10.20.193.28:0/2992270512 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96c1a6460 con 0x7fd96c112700 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96b577640 1 -- 10.20.193.28:0/2992270512 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96c1b26b0 con 0x7fd96c112700 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd9537fe640 1 -- 10.20.193.28:0/2992270512 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd95c01d030 con 0x7fd96c112700 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd973302e00 1 Processor -- start 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd973302e00 1 -- start start 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd973302e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b23fa0 0x564d35b24380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd973302e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b26460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd973302e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 0x564d35b27520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd973302e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564d35aa7e50 con 0x564d35b24950 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd973302e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564d35a7a9c0 con 0x564d35b26b90 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd973302e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564d35a28240 con 0x564d35b23fa0 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b26460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b26460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51568/0 (socket says 10.20.193.28:51568) 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96a575640 1 -- 10.20.193.28:0/2678649127 learned_addr learned my addr 10.20.193.28:0/2678649127 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96a575640 1 -- 10.20.193.28:0/2678649127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b23fa0 msgr2=0x564d35b24380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96a575640 1 --2- 10.20.193.28:0/2678649127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b23fa0 0x564d35b24380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96a575640 1 -- 10.20.193.28:0/2678649127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 msgr2=0x564d35b27520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96a575640 1 --2- 10.20.193.28:0/2678649127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 0x564d35b27520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96a575640 1 -- 10.20.193.28:0/2678649127 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d35a3b420 con 0x564d35b24950 2026-02-20T03:29:18.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd96a575640 1 --2- 10.20.193.28:0/2678649127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b26460 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fd96002d0d0 tx=0x7fd96002d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258cf5bb7c7ea484 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd9537fe640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9440b0e20 0x7fd9440b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd9537fe640 1 -- 10.20.193.28:0/2992270512 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7fd95c0dff00 con 0x7fd96c112700 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd950ff9640 1 -- 10.20.193.28:0/2678649127 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960004070 con 0x564d35b24950 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd950ff9640 1 -- 10.20.193.28:0/2678649127 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd96002b0d0 con 0x564d35b24950 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.069+0000 7fd950ff9640 1 -- 10.20.193.28:0/2678649127 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960029d50 con 0x564d35b24950 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.073+0000 7fd973302e00 1 -- 10.20.193.28:0/2678649127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 msgr2=0x564d35b26460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.073+0000 7fd973302e00 1 --2- 10.20.193.28:0/2678649127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b26460 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fd96002d0d0 tx=0x7fd96002d5a0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.073+0000 7fd969d74640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9440b0e20 0x7fd9440b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.074+0000 7fd973302e00 1 -- 10.20.193.28:0/2678649127 shutdown_connections 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.074+0000 7fd973302e00 1 --2- 10.20.193.28:0/2678649127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 0x564d35b27520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.074+0000 7fd973302e00 1 --2- 10.20.193.28:0/2678649127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b26460 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.074+0000 7fd973302e00 1 --2- 10.20.193.28:0/2678649127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b23fa0 0x564d35b24380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.074+0000 7fd973302e00 1 -- 10.20.193.28:0/2678649127 >> 10.20.193.28:0/2678649127 conn(0x564d35aea290 msgr2=0x564d35b2e740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.074+0000 7fd969d74640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9440b0e20 0x7fd9440b32e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd954009a00 tx=0x7fd9540023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.074+0000 7fd973302e00 1 -- 10.20.193.28:0/2678649127 shutdown_connections 2026-02-20T03:29:18.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.074+0000 7fd973302e00 1 -- 10.20.193.28:0/2678649127 wait complete. 2026-02-20T03:29:18.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd973302e00 1 -- start start 2026-02-20T03:29:18.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd973302e00 1 Processor -- start 2026-02-20T03:29:18.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd973302e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b23fa0 0x564d35b41bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd973302e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b420f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd973302e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 0x564d35b402f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd973302e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564d35a768f0 con 0x564d35b24950 2026-02-20T03:29:18.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd973302e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564d35868f50 con 0x564d35b26b90 2026-02-20T03:29:18.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd973302e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564d35b40a70 con 0x564d35b23fa0 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd969d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd969d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b420f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51584/0 (socket says 10.20.193.28:51584) 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd969d74640 1 -- 10.20.193.28:0/1465737362 learned_addr learned my addr 10.20.193.28:0/1465737362 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd969d74640 1 -- 10.20.193.28:0/1465737362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b23fa0 msgr2=0x564d35b41bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd969d74640 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b23fa0 0x564d35b41bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd969d74640 1 -- 10.20.193.28:0/1465737362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 msgr2=0x564d35b402f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd969d74640 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 0x564d35b402f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.075+0000 7fd969d74640 1 -- 10.20.193.28:0/1465737362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d35b39a10 con 0x564d35b24950 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd969d74640 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b420f0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fd954002fd0 tx=0x7fd95402f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f687adf6b153b28 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd91bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd91bfff640 1 -- 10.20.193.28:0/1465737362 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954004520 con 0x564d35b24950 2026-02-20T03:29:18.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd91bfff640 1 -- 10.20.193.28:0/1465737362 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd954033040 con 0x564d35b24950 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd91bfff640 1 -- 10.20.193.28:0/1465737362 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954045890 con 0x564d35b24950 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 1 -- 10.20.193.28:0/1465737362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d3584bb40 con 0x564d35b24950 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 10 client.19350 _ll_register_callbacks cb 0x564d35ab3f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd91bfff640 1 -- 10.20.193.28:0/1465737362 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7fd954038470 con 0x564d35b24950 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 1 -- 10.20.193.28:0/1465737362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d35a881a0 con 0x564d35b24950 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd91bfff640 1 -- 10.20.193.28:0/1465737362 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd954045a70 con 0x564d35b24950 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 10 client.19350 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 1 -- 10.20.193.28:0/1465737362 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x564d35a35230 con 0x564d35b24950 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd91bfff640 1 -- 10.20.193.28:0/1465737362 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fd95404d070 con 0x564d35b24950 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 10 client.19350 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 10 client.19350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 20 client.19350 populate_metadata read hostname 'trial028' 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d35b50440 0x564d35b52900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 4 client.19350 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:18.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.077+0000 7fd973302e00 1 -- 10.20.193.28:0/1465737362 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d35a825b0 con 0x564d35b50440 2026-02-20T03:29:18.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.102+0000 7fd96a575640 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d35b50440 0x564d35b52900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.169+0000 7fd96a575640 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d35b50440 0x564d35b52900 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fb60d5093711111 server_cookie=fa7717b557928e04 in_seq=0 out_seq=0 2026-02-20T03:29:18.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.169+0000 7fd91bfff640 10 client.19350 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:18.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd91bfff640 1 -- 10.20.193.28:0/1465737362 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x564d35a825b0 con 0x564d35b50440 2026-02-20T03:29:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd91bfff640 10 client.19350 handle_command_reply: tid=0 2026-02-20T03:29:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 client.19350 shutdown 2026-02-20T03:29:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 -- 10.20.193.28:0/1465737362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 msgr2=0x564d35b420f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b420f0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fd954002fd0 tx=0x7fd95402f260 comp rx=0 tx=0).stop 2026-02-20T03:29:18.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 -- 10.20.193.28:0/1465737362 shutdown_connections 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d35b50440 0x564d35b52900 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 0x564d35b402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b420f0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 --2- 10.20.193.28:0/1465737362 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b23fa0 0x564d35b41bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 -- 10.20.193.28:0/1465737362 >> 10.20.193.28:0/1465737362 conn(0x564d35aea290 msgr2=0x564d35b25c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd91bfff640 0 client.19350 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 -- 10.20.193.28:0/1465737362 shutdown_connections 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 1 -- 10.20.193.28:0/1465737362 wait complete. 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.196+0000 7fd973302e00 20 client.19350 trim_cache size 0 max 16384 2026-02-20T03:29:18.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd973302e00 1 Processor -- start 2026-02-20T03:29:18.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd973302e00 1 -- start start 2026-02-20T03:29:18.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd973302e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b23fa0 0x564d35b3d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd973302e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b24950 0x564d35b3dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd973302e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 0x564d35b2be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd973302e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd910012750 con 0x564d35b23fa0 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd973302e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd91000ffc0 con 0x564d35b26b90 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd973302e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd91000de10 con 0x564d35b24950 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd96a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b23fa0 0x564d35b3d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd96a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b23fa0 0x564d35b3d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51588/0 (socket says 10.20.193.28:51588) 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd96a575640 1 -- 10.20.193.28:0/811900858 learned_addr learned my addr 10.20.193.28:0/811900858 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd96a575640 1 -- 10.20.193.28:0/811900858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b24950 msgr2=0x564d35b3dd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd96a575640 1 --2- 10.20.193.28:0/811900858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b24950 0x564d35b3dd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd96a575640 1 -- 10.20.193.28:0/811900858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 msgr2=0x564d35b2be20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd96a575640 1 --2- 10.20.193.28:0/811900858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 0x564d35b2be20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.201+0000 7fd96a575640 1 -- 10.20.193.28:0/811900858 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d35b39840 con 0x564d35b23fa0 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd96a575640 1 --2- 10.20.193.28:0/811900858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b23fa0 0x564d35b3d850 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fd96002bc80 tx=0x7fd960006c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb36af4ef9c2137 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd9364e6640 1 -- 10.20.193.28:0/811900858 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96003a040 con 0x564d35b23fa0 2026-02-20T03:29:18.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd9364e6640 1 -- 10.20.193.28:0/811900858 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd960029910 con 0x564d35b23fa0 2026-02-20T03:29:18.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd9364e6640 1 -- 10.20.193.28:0/811900858 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600043a0 con 0x564d35b23fa0 2026-02-20T03:29:18.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- 10.20.193.28:0/811900858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b23fa0 msgr2=0x564d35b3d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 --2- 10.20.193.28:0/811900858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b23fa0 0x564d35b3d850 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fd96002bc80 tx=0x7fd960006c60 comp rx=0 tx=0).stop 2026-02-20T03:29:18.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- 10.20.193.28:0/811900858 shutdown_connections 2026-02-20T03:29:18.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 --2- 10.20.193.28:0/811900858 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b26b90 0x564d35b2be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 --2- 10.20.193.28:0/811900858 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b24950 0x564d35b3dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 --2- 10.20.193.28:0/811900858 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b23fa0 0x564d35b3d850 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- 10.20.193.28:0/811900858 >> 10.20.193.28:0/811900858 conn(0x564d35aea290 msgr2=0x564d35b41bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- 10.20.193.28:0/811900858 shutdown_connections 2026-02-20T03:29:18.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- 10.20.193.28:0/811900858 wait complete. 2026-02-20T03:29:18.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- start start 2026-02-20T03:29:18.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 Processor -- start 2026-02-20T03:29:18.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b23fa0 0x564d35b47eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b483f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b26b90 0x564d35b46440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd91000e480 con 0x564d35b24950 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd91000f8f0 con 0x564d35b23fa0 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd91000eb50 con 0x564d35b26b90 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd969d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd969d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b483f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51592/0 (socket says 10.20.193.28:51592) 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd969d74640 1 -- 10.20.193.28:0/1334633844 learned_addr learned my addr 10.20.193.28:0/1334633844 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd969d74640 1 -- 10.20.193.28:0/1334633844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b26b90 msgr2=0x564d35b46440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd969d74640 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b26b90 0x564d35b46440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd969d74640 1 -- 10.20.193.28:0/1334633844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b23fa0 msgr2=0x564d35b47eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd969d74640 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b23fa0 0x564d35b47eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd969d74640 1 -- 10.20.193.28:0/1334633844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d35759870 con 0x564d35b24950 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd969d74640 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b483f0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fd954009950 tx=0x7fd95402fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef022aa5328acc4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd91bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd91bfff640 1 -- 10.20.193.28:0/1334633844 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954004520 con 0x564d35b24950 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd91bfff640 1 -- 10.20.193.28:0/1334633844 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd954033040 con 0x564d35b24950 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd91bfff640 1 -- 10.20.193.28:0/1334633844 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95404fc10 con 0x564d35b24950 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- 10.20.193.28:0/1334633844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d35a1a440 con 0x564d35b24950 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd91bfff640 1 -- 10.20.193.28:0/1334633844 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7fd95404fdb0 con 0x564d35b24950 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 10 client.19356 _ll_register_callbacks cb 0x7fd954009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.206+0000 7fd973302e00 1 -- 10.20.193.28:0/1334633844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d35a2cb00 con 0x564d35b24950 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd91bfff640 1 -- 10.20.193.28:0/1334633844 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd95404f440 con 0x564d35b24950 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd973302e00 10 client.19356 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:18.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd973302e00 1 -- 10.20.193.28:0/1334633844 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x564d35b3a530 con 0x564d35b24950 2026-02-20T03:29:18.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd91bfff640 1 -- 10.20.193.28:0/1334633844 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7fd95404d040 con 0x564d35b24950 2026-02-20T03:29:18.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd973302e00 10 client.19356 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:18.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd973302e00 10 client.19356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:18.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd973302e00 20 client.19356 populate_metadata read hostname 'trial028' 2026-02-20T03:29:18.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd973302e00 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d35bbc160 0x564d35bbe620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd973302e00 4 client.19356 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:29:18.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.209+0000 7fd973302e00 1 -- 10.20.193.28:0/1334633844 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fd960029910 con 0x564d35bbc160 2026-02-20T03:29:18.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.236+0000 7fd96a575640 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d35bbc160 0x564d35bbe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.276+0000 7fd96a575640 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d35bbc160 0x564d35bbe620 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b7b8902a8d48ee6 server_cookie=e6d27bc5ee31d823 in_seq=0 out_seq=0 2026-02-20T03:29:18.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.276+0000 7fd91bfff640 10 client.19356 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:18.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd91bfff640 1 -- 10.20.193.28:0/1334633844 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fd960029910 con 0x564d35bbc160 2026-02-20T03:29:18.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd91bfff640 10 client.19356 handle_command_reply: tid=0 2026-02-20T03:29:18.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 client.19356 shutdown 2026-02-20T03:29:18.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 -- 10.20.193.28:0/1334633844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 msgr2=0x564d35b483f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b483f0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fd954009950 tx=0x7fd95402fee0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 -- 10.20.193.28:0/1334633844 shutdown_connections 2026-02-20T03:29:18.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564d35bbc160 0x564d35bbe620 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564d35b26b90 0x564d35b46440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564d35b24950 0x564d35b483f0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 --2- 10.20.193.28:0/1334633844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564d35b23fa0 0x564d35b47eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 -- 10.20.193.28:0/1334633844 >> 10.20.193.28:0/1334633844 conn(0x564d35aea290 msgr2=0x564d35b2be20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd91bfff640 0 client.19356 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:18.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 -- 10.20.193.28:0/1334633844 shutdown_connections 2026-02-20T03:29:18.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 1 -- 10.20.193.28:0/1334633844 wait complete. 2026-02-20T03:29:18.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd973302e00 20 client.19356 trim_cache size 0 max 16384 2026-02-20T03:29:18.294 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:29:18.294 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:29:18.294 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:29:18.294 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:29:18.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 -- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9440b0e20 msgr2=0x7fd9440b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9440b0e20 0x7fd9440b32e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd954009a00 tx=0x7fd9540023d0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 -- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c112700 msgr2=0x7fd96c1a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c112700 0x7fd96c1a59a0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fd95c00b9e0 tx=0x7fd95c00beb0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 -- 10.20.193.28:0/2992270512 shutdown_connections 2026-02-20T03:29:18.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd9440b0e20 0x7fd9440b32e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd96c112700 0x7fd96c1a59a0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd96c10e0a0 0x7fd96c1abd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 --2- 10.20.193.28:0/2992270512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd96c10d6f0 0x7fd96c1ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 -- 10.20.193.28:0/2992270512 >> 10.20.193.28:0/2992270512 conn(0x7fd96c06d500 msgr2=0x7fd96c10b770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 -- 10.20.193.28:0/2992270512 shutdown_connections 2026-02-20T03:29:18.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:18.289+0000 7fd96b577640 1 -- 10.20.193.28:0/2992270512 wait complete. 2026-02-20T03:29:18.410 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:29:18.410 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:29:18.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.655+0000 7f71d69cb640 1 -- 10.20.193.28:0/3880940256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d010a900 msgr2=0x7f71d0111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.655+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3880940256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d010a900 0x7f71d0111480 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00b0a0 tx=0x7f71cc02f450 comp rx=0 tx=0).stop 2026-02-20T03:29:18.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.655+0000 7f71d69cb640 1 -- 10.20.193.28:0/3880940256 shutdown_connections 2026-02-20T03:29:18.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.655+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3880940256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d010a900 0x7f71d0111480 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.655+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3880940256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71d0109e60 0x7f71d010a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.655+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3880940256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71d0109490 0x7f71d0109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.655+0000 7f71d69cb640 1 -- 10.20.193.28:0/3880940256 >> 10.20.193.28:0/3880940256 conn(0x7f71d0077fe0 msgr2=0x7f71d007a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 -- 10.20.193.28:0/3880940256 shutdown_connections 2026-02-20T03:29:18.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 -- 10.20.193.28:0/3880940256 wait complete. 2026-02-20T03:29:18.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 Processor -- start 2026-02-20T03:29:18.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 -- start start 2026-02-20T03:29:18.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71d0109490 0x7f71d01a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d0109e60 0x7f71d01a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71d010a900 0x7f71d01a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71d0114a50 con 0x7f71d0109e60 2026-02-20T03:29:18.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f71d01148d0 con 0x7f71d010a900 2026-02-20T03:29:18.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f71d0114bd0 con 0x7f71d0109490 2026-02-20T03:29:18.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d51c8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d0109e60 0x7f71d01a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d51c8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d0109e60 0x7f71d01a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51616/0 (socket says 10.20.193.28:51616) 2026-02-20T03:29:18.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d51c8640 1 -- 10.20.193.28:0/3196870640 learned_addr learned my addr 10.20.193.28:0/3196870640 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d51c8640 1 -- 10.20.193.28:0/3196870640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71d0109490 msgr2=0x7f71d01a1010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:18.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d51c8640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71d0109490 0x7f71d01a1010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d51c8640 1 -- 10.20.193.28:0/3196870640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71d010a900 msgr2=0x7f71d01a85c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:18.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d51c8640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71d010a900 0x7f71d01a85c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d51c8640 1 -- 10.20.193.28:0/3196870640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d01a8cc0 con 0x7f71d0109e60 2026-02-20T03:29:18.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d51c8640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d0109e60 0x7f71d01a1550 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f71c400b570 tx=0x7f71c400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71beffd640 1 -- 10.20.193.28:0/3196870640 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c4013020 con 0x7f71d0109e60 2026-02-20T03:29:18.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 -- 10.20.193.28:0/3196870640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d01a8fb0 con 0x7f71d0109e60 2026-02-20T03:29:18.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71beffd640 1 -- 10.20.193.28:0/3196870640 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71c4004480 con 0x7f71d0109e60 2026-02-20T03:29:18.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71beffd640 1 -- 10.20.193.28:0/3196870640 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c400fb00 con 0x7f71d0109e60 2026-02-20T03:29:18.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.660+0000 7f71d69cb640 1 -- 10.20.193.28:0/3196870640 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d01a94f0 con 0x7f71d0109e60 2026-02-20T03:29:18.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 Processor -- start 2026-02-20T03:29:18.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71beffd640 1 -- 10.20.193.28:0/3196870640 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f71c4002780 con 0x7f71d0109e60 2026-02-20T03:29:18.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 -- start start 2026-02-20T03:29:18.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d61ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d61ca640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d06c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51626/0 (socket says 10.20.193.28:51626) 2026-02-20T03:29:18.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d61ca640 1 -- 10.20.193.28:0/4243552820 learned_addr learned my addr 10.20.193.28:0/4243552820 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 --2- 10.20.193.28:0/4243552820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d06c7c0 0x55b54d070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 --2- 10.20.193.28:0/4243552820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d071560 0x55b54d0739f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 -- 10.20.193.28:0/4243552820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b54cfbc8f0 con 0x55b54d06be80 2026-02-20T03:29:18.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 -- 10.20.193.28:0/4243552820 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b54cf6a2e0 con 0x55b54d071560 2026-02-20T03:29:18.670 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 -- 10.20.193.28:0/4243552820 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b54cfb8820 con 0x55b54d06c7c0 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d61ca640 1 -- 10.20.193.28:0/4243552820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d06c7c0 msgr2=0x55b54d070f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d61ca640 1 --2- 10.20.193.28:0/4243552820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d06c7c0 0x55b54d070f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d61ca640 1 -- 10.20.193.28:0/4243552820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d071560 msgr2=0x55b54d0739f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d61ca640 1 --2- 10.20.193.28:0/4243552820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d071560 0x55b54d0739f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d61ca640 1 -- 10.20.193.28:0/4243552820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54cf5c5a0 con 0x55b54d06be80 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71beffd640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71ac0b0e20 0x7f71ac0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71beffd640 1 -- 10.20.193.28:0/3196870640 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f71c40e0570 con 0x7f71d0109e60 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d61ca640 1 --2- 10.20.193.28:0/4243552820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d06c280 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009850 tx=0x7f71cc009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5aed6bcdc74602 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d59c9640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71ac0b0e20 0x7f71ac0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.671 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f719dbfe640 1 -- 10.20.193.28:0/4243552820 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc004070 con 0x55b54d06be80 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f719dbfe640 1 -- 10.20.193.28:0/4243552820 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71cc033030 con 0x55b54d06be80 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f719dbfe640 1 -- 10.20.193.28:0/4243552820 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc002a60 con 0x55b54d06be80 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 -- 10.20.193.28:0/4243552820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 msgr2=0x55b54d06c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 --2- 10.20.193.28:0/4243552820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d06c280 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009850 tx=0x7f71cc009d70 comp rx=0 tx=0).stop 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71d59c9640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71ac0b0e20 0x7f71ac0b32e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55b54d06ceb0 tx=0x7f71c0006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 -- 10.20.193.28:0/4243552820 shutdown_connections 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 --2- 10.20.193.28:0/4243552820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d071560 0x55b54d0739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 --2- 10.20.193.28:0/4243552820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d06c7c0 0x55b54d070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 --2- 10.20.193.28:0/4243552820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d06c280 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.672 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 -- 10.20.193.28:0/4243552820 >> 10.20.193.28:0/4243552820 conn(0x55b54d0636f0 msgr2=0x55b54d06a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 -- 10.20.193.28:0/4243552820 shutdown_connections 2026-02-20T03:29:18.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.663+0000 7f71daaafe00 1 -- 10.20.193.28:0/4243552820 wait complete. 2026-02-20T03:29:18.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 -- start start 2026-02-20T03:29:18.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 Processor -- start 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d0848c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d06c7c0 0x55b54d084e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d071560 0x55b54d08bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b54cf640c0 con 0x55b54d06be80 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b54d0745b0 con 0x55b54d06c7c0 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b54d08c230 con 0x55b54d071560 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71d59c9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d0848c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71d59c9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d0848c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51632/0 (socket says 10.20.193.28:51632) 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71d59c9640 1 -- 10.20.193.28:0/3467374052 learned_addr learned my addr 10.20.193.28:0/3467374052 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71d59c9640 1 -- 10.20.193.28:0/3467374052 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d071560 msgr2=0x55b54d08bca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.681 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71d59c9640 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d071560 0x55b54d08bca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71d59c9640 1 -- 10.20.193.28:0/3467374052 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d06c7c0 msgr2=0x55b54d084e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71d59c9640 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d06c7c0 0x55b54d084e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71d59c9640 1 -- 10.20.193.28:0/3467374052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54d07e340 con 0x55b54d06be80 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71d59c9640 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d0848c0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f71c0004690 tx=0x7f71c00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3417e6bb4a7a4e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f718affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f718affd640 1 -- 10.20.193.28:0/3467374052 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c000b730 con 0x55b54d06be80 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f718affd640 1 -- 10.20.193.28:0/3467374052 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71c000bd70 con 0x55b54d06be80 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f718affd640 1 -- 10.20.193.28:0/3467374052 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0011dc0 con 0x55b54d06be80 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 -- 10.20.193.28:0/3467374052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b54cf78820 con 0x55b54d06be80 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f718affd640 1 -- 10.20.193.28:0/3467374052 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f71c0013410 con 0x55b54d06be80 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 10 client.19368 _ll_register_callbacks cb 0x55b54cf67ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 -- 10.20.193.28:0/3467374052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b54cfc44e0 con 0x55b54d06be80 2026-02-20T03:29:18.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f718affd640 1 -- 10.20.193.28:0/3467374052 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f71c000b8d0 con 0x55b54d06be80 2026-02-20T03:29:18.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 10 client.19368 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:18.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 -- 10.20.193.28:0/3467374052 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55b54cf7d380 con 0x55b54d06be80 2026-02-20T03:29:18.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f718affd640 1 -- 10.20.193.28:0/3467374052 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f71c0028030 con 0x55b54d06be80 2026-02-20T03:29:18.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 10 client.19368 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:18.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 10 client.19368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:18.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 20 client.19368 populate_metadata read hostname 'trial028' 2026-02-20T03:29:18.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b54d090650 0x55b54d092af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 4 client.19368 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:18.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.668+0000 7f71daaafe00 1 -- 10.20.193.28:0/3467374052 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b54cf3ebd0 con 0x55b54d090650 2026-02-20T03:29:18.691 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.690+0000 7f71d51c8640 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b54d090650 0x55b54d092af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.705 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 40.51 MB/sec warmup 49 sec latency 14721.938 ms 2026-02-20T03:29:18.733 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.756+0000 7f71d51c8640 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b54d090650 0x55b54d092af0 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ff453fa839b830d server_cookie=50793ef5ce456e41 in_seq=0 out_seq=0 2026-02-20T03:29:18.758 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.756+0000 7f718affd640 10 client.19368 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:18.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f718affd640 1 -- 10.20.193.28:0/3467374052 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b54cf3ebd0 con 0x55b54d090650 2026-02-20T03:29:18.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f718affd640 10 client.19368 handle_command_reply: tid=0 2026-02-20T03:29:18.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 client.19368 shutdown 2026-02-20T03:29:18.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 -- 10.20.193.28:0/3467374052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 msgr2=0x55b54d0848c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d0848c0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f71c0004690 tx=0x7f71c00047e0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 -- 10.20.193.28:0/3467374052 shutdown_connections 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b54d090650 0x55b54d092af0 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d071560 0x55b54d08bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d06c7c0 0x55b54d084e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 --2- 10.20.193.28:0/3467374052 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d0848c0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f718affd640 0 client.19368 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 -- 10.20.193.28:0/3467374052 >> 10.20.193.28:0/3467374052 conn(0x55b54d0636f0 msgr2=0x55b54d072910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 -- 10.20.193.28:0/3467374052 shutdown_connections 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 1 -- 10.20.193.28:0/3467374052 wait complete. 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.783+0000 7f71daaafe00 20 client.19368 trim_cache size 0 max 16384 2026-02-20T03:29:18.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 Processor -- start 2026-02-20T03:29:18.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 -- start start 2026-02-20T03:29:18.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d0636f0 0x55b54d069d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d08bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.796 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d06c7c0 0x55b54d06a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f717c012750 con 0x55b54d06be80 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f717c00ffc0 con 0x55b54d06c7c0 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f717c00de10 con 0x55b54d0636f0 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71d51c8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d08bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71d51c8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d08bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51638/0 (socket says 10.20.193.28:51638) 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71d51c8640 1 -- 10.20.193.28:0/1427849063 learned_addr learned my addr 10.20.193.28:0/1427849063 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71d51c8640 1 -- 10.20.193.28:0/1427849063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d0636f0 msgr2=0x55b54d069d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71d51c8640 1 --2- 10.20.193.28:0/1427849063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d0636f0 0x55b54d069d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71d51c8640 1 -- 10.20.193.28:0/1427849063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d06c7c0 msgr2=0x55b54d06a290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71d51c8640 1 --2- 10.20.193.28:0/1427849063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d06c7c0 0x55b54d06a290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71d51c8640 1 -- 10.20.193.28:0/1427849063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54d07e170 con 0x55b54d06be80 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71d51c8640 1 --2- 10.20.193.28:0/1427849063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d08bc60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f71c40a7f50 tx=0x7f71c40ddab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545cc990ddf8d40c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f719d3fd640 1 -- 10.20.193.28:0/1427849063 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c4002aa0 con 0x55b54d06be80 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f719d3fd640 1 -- 10.20.193.28:0/1427849063 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71c40ddcf0 con 0x55b54d06be80 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f719d3fd640 1 -- 10.20.193.28:0/1427849063 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c40ac1b0 con 0x55b54d06be80 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 -- 10.20.193.28:0/1427849063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 msgr2=0x55b54d08bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1427849063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d08bc60 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f71c40a7f50 tx=0x7f71c40ddab0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 -- 10.20.193.28:0/1427849063 shutdown_connections 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1427849063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d06c7c0 0x55b54d06a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1427849063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d08bc60 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1427849063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d0636f0 0x55b54d069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 -- 10.20.193.28:0/1427849063 >> 10.20.193.28:0/1427849063 conn(0x55b54d077060 msgr2=0x55b54d0836c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 -- 10.20.193.28:0/1427849063 shutdown_connections 2026-02-20T03:29:18.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.788+0000 7f71daaafe00 1 -- 10.20.193.28:0/1427849063 wait complete. 2026-02-20T03:29:18.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 -- start start 2026-02-20T03:29:18.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 Processor -- start 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d0636f0 0x55b54d08b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d089e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d06c7c0 0x55b54d08a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f717c00e480 con 0x55b54d06be80 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f717c00f8f0 con 0x55b54d0636f0 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f717c00eb50 con 0x55b54d06c7c0 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71d51c8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d089e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71d51c8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d089e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51650/0 (socket says 10.20.193.28:51650) 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71d51c8640 1 -- 10.20.193.28:0/1059876379 learned_addr learned my addr 10.20.193.28:0/1059876379 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71d51c8640 1 -- 10.20.193.28:0/1059876379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d06c7c0 msgr2=0x55b54d08a3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71d51c8640 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d06c7c0 0x55b54d08a3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71d51c8640 1 -- 10.20.193.28:0/1059876379 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d0636f0 msgr2=0x55b54d08b850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71d51c8640 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d0636f0 0x55b54d08b850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71d51c8640 1 -- 10.20.193.28:0/1059876379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54cd1c690 con 0x55b54d06be80 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71d51c8640 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d089e80 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f71c400b540 tx=0x7f71c400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ea76de929adeee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f718affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f718affd640 1 -- 10.20.193.28:0/1059876379 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c4094020 con 0x55b54d06be80 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f718affd640 1 -- 10.20.193.28:0/1059876379 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71c401f300 con 0x55b54d06be80 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f718affd640 1 -- 10.20.193.28:0/1059876379 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c40941c0 con 0x55b54d06be80 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 -- 10.20.193.28:0/1059876379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b54cf81b70 con 0x55b54d06be80 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f718affd640 1 -- 10.20.193.28:0/1059876379 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f71c4094360 con 0x55b54d06be80 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f718affd640 10 client.19374 inactive, discarding osd_map(96..96 src has 1..96) 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 10 client.19374 _ll_register_callbacks cb 0x7f71c0004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:18.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 -- 10.20.193.28:0/1059876379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71cc033030 con 0x55b54d06be80 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f718affd640 1 -- 10.20.193.28:0/1059876379 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f71c40c2060 con 0x55b54d06be80 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 10 client.19374 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 -- 10.20.193.28:0/1059876379 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55b54d07ee60 con 0x55b54d06be80 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f718affd640 1 -- 10.20.193.28:0/1059876379 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f71c40e01b0 con 0x55b54d06be80 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 10 client.19374 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 10 client.19374 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 20 client.19374 populate_metadata read hostname 'trial028' 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b54d071560 0x55b54d0fe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 4 client.19374 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:29:18.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.793+0000 7f71daaafe00 1 -- 10.20.193.28:0/1059876379 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b54cf8d6b0 con 0x55b54d071560 2026-02-20T03:29:18.805 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.796+0000 7f71d59c9640 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b54d071560 0x55b54d0fe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:18.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.850+0000 7f71d59c9640 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b54d071560 0x55b54d0fe860 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f080f8fe84b5fde6 server_cookie=ed2b696ec583cada in_seq=0 out_seq=0 2026-02-20T03:29:18.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.850+0000 7f718affd640 10 client.19374 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:18.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f718affd640 1 -- 10.20.193.28:0/1059876379 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b54cf8d6b0 con 0x55b54d071560 2026-02-20T03:29:18.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f718affd640 10 client.19374 handle_command_reply: tid=0 2026-02-20T03:29:18.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 client.19374 shutdown 2026-02-20T03:29:18.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 -- 10.20.193.28:0/1059876379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 msgr2=0x55b54d089e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d089e80 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f71c400b540 tx=0x7f71c400f510 comp rx=0 tx=0).stop 2026-02-20T03:29:18.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 -- 10.20.193.28:0/1059876379 shutdown_connections 2026-02-20T03:29:18.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b54d071560 0x55b54d0fe860 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b54d06c7c0 0x55b54d08a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b54d06be80 0x55b54d089e80 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 --2- 10.20.193.28:0/1059876379 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b54d0636f0 0x55b54d08b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 -- 10.20.193.28:0/1059876379 >> 10.20.193.28:0/1059876379 conn(0x55b54d077060 msgr2=0x55b54d081400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f718affd640 0 client.19374 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:18.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 -- 10.20.193.28:0/1059876379 shutdown_connections 2026-02-20T03:29:18.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 1 -- 10.20.193.28:0/1059876379 wait complete. 2026-02-20T03:29:18.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.920+0000 7f71daaafe00 20 client.19374 trim_cache size 0 max 16384 2026-02-20T03:29:18.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:29:18.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:29:18.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:29:18.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:29:18.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 -- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71ac0b0e20 msgr2=0x7f71ac0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71ac0b0e20 0x7f71ac0b32e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x55b54d06ceb0 tx=0x7f71c0006cd0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 -- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d0109e60 msgr2=0x7f71d01a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d0109e60 0x7f71d01a1550 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f71c400b570 tx=0x7f71c400ba40 comp rx=0 tx=0).stop 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 -- 10.20.193.28:0/3196870640 shutdown_connections 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71ac0b0e20 0x7f71ac0b32e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71d010a900 0x7f71d01a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71d0109e60 0x7f71d01a1550 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 --2- 10.20.193.28:0/3196870640 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71d0109490 0x7f71d01a1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 -- 10.20.193.28:0/3196870640 >> 10.20.193.28:0/3196870640 conn(0x7f71d0077fe0 msgr2=0x7f71d010d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 -- 10.20.193.28:0/3196870640 shutdown_connections 2026-02-20T03:29:18.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:18.921+0000 7f71d69cb640 1 -- 10.20.193.28:0/3196870640 wait complete. 2026-02-20T03:29:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- 10.20.193.28:0/365467118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd18410a980 msgr2=0x7fd18410ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 --2- 10.20.193.28:0/365467118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd18410a980 0x7fd18410ad60 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fd170009a60 tx=0x7fd17002f290 comp rx=0 tx=0).stop 2026-02-20T03:29:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- 10.20.193.28:0/365467118 shutdown_connections 2026-02-20T03:29:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 --2- 10.20.193.28:0/365467118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd184105320 0x7fd184111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 --2- 10.20.193.28:0/365467118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd184104980 0x7fd184104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 --2- 10.20.193.28:0/365467118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd18410a980 0x7fd18410ad60 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- 10.20.193.28:0/365467118 >> 10.20.193.28:0/365467118 conn(0x7fd184100680 msgr2=0x7fd184102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- 10.20.193.28:0/365467118 shutdown_connections 2026-02-20T03:29:19.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- 10.20.193.28:0/365467118 wait complete. 2026-02-20T03:29:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 Processor -- start 2026-02-20T03:29:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- start start 2026-02-20T03:29:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd184104980 0x7fd18419d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd184105320 0x7fd18419d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd18410a980 0x7fd1841a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd184114cd0 con 0x7fd184104980 2026-02-20T03:29:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd184114b50 con 0x7fd184105320 2026-02-20T03:29:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd184114e50 con 0x7fd18410a980 2026-02-20T03:29:19.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd183fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd184104980 0x7fd18419d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:19.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd183fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd184104980 0x7fd18419d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51668/0 (socket says 10.20.193.28:51668) 2026-02-20T03:29:19.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd183fff640 1 -- 10.20.193.28:0/3634562185 learned_addr learned my addr 10.20.193.28:0/3634562185 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:19.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd183fff640 1 -- 10.20.193.28:0/3634562185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd18410a980 msgr2=0x7fd1841a1bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:19.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd183fff640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd18410a980 0x7fd1841a1bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd183fff640 1 -- 10.20.193.28:0/3634562185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd184105320 msgr2=0x7fd18419d830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:19.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd183fff640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd184105320 0x7fd18419d830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd183fff640 1 -- 10.20.193.28:0/3634562185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1841a2340 con 0x7fd184104980 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd183fff640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd184104980 0x7fd18419d2f0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fd170009a30 tx=0x7fd17002fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd1817fa640 1 -- 10.20.193.28:0/3634562185 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17002fe50 con 0x7fd184104980 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd1817fa640 1 -- 10.20.193.28:0/3634562185 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd170005030 con 0x7fd184104980 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd1817fa640 1 -- 10.20.193.28:0/3634562185 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170004c00 con 0x7fd184104980 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.018+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1841a25d0 con 0x7fd184104980 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.022+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1841a9e70 con 0x7fd184104980 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.022+0000 7fd1817fa640 1 -- 10.20.193.28:0/3634562185 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd170004280 con 0x7fd184104980 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.022+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd184104e60 con 0x7fd184104980 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.022+0000 7fd1817fa640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd1580b0fc0 0x7fd1580b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.022+0000 7fd1817fa640 1 -- 10.20.193.28:0/3634562185 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7fd170105240 con 0x7fd184104980 2026-02-20T03:29:19.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.027+0000 7fd1837fe640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd1580b0fc0 0x7fd1580b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:19.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.027+0000 7fd1837fe640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd1580b0fc0 0x7fd1580b3480 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd18410a110 tx=0x7fd174006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:19.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.027+0000 7fd1817fa640 1 -- 10.20.193.28:0/3634562185 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd1700cd620 con 0x7fd184104980 2026-02-20T03:29:19.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.132+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd18410c8f0 con 0x7fd184104980 2026-02-20T03:29:19.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.135+0000 7fd1817fa640 1 -- 10.20.193.28:0/3634562185 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11925 (secure 0 0 0) 0x7fd1700d12d0 con 0x7fd184104980 2026-02-20T03:29:19.139 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:29:19.139 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":35,"btime":"2026-02-20T03:29:03:321410+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:29:02.385088+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28051":{"gid":28051,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1601146575","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1601146575},{"type":"v1","addr":"10.20.193.177:6837","nonce":1601146575}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:29:19.140 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 35 2026-02-20T03:29:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd1580b0fc0 msgr2=0x7fd1580b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd1580b0fc0 0x7fd1580b3480 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd18410a110 tx=0x7fd174006cd0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd184104980 msgr2=0x7fd18419d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd184104980 0x7fd18419d2f0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fd170009a30 tx=0x7fd17002fce0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 shutdown_connections 2026-02-20T03:29:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd1580b0fc0 0x7fd1580b3480 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd18410a980 0x7fd1841a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd184105320 0x7fd18419d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 --2- 10.20.193.28:0/3634562185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd184104980 0x7fd18419d2f0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.136+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 >> 10.20.193.28:0/3634562185 conn(0x7fd184100680 msgr2=0x7fd184101180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.137+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 shutdown_connections 2026-02-20T03:29:19.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.137+0000 7fd18930f640 1 -- 10.20.193.28:0/3634562185 wait complete. 2026-02-20T03:29:19.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:29:19.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:19 trial028 ceph-mon[38552]: pgmap v622: 129 pgs: 129 active+clean; 473 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 510 KiB/s rd, 14 MiB/s wr, 777 op/s 2026-02-20T03:29:19.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:19 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3634562185' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:19.568 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:19.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:19 trial126 ceph-mon[38476]: pgmap v622: 129 pgs: 129 active+clean; 473 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 510 KiB/s rd, 14 MiB/s wr, 777 op/s 2026-02-20T03:29:19.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:19 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3634562185' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:19.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 39.70 MB/sec warmup 50 sec latency 15721.974 ms 2026-02-20T03:29:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:19 trial177 ceph-mon[43181]: pgmap v622: 129 pgs: 129 active+clean; 473 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 510 KiB/s rd, 14 MiB/s wr, 777 op/s 2026-02-20T03:29:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:19 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3634562185' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:19.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- 10.20.193.28:0/2961804306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 msgr2=0x7f7d1010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:19.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 --2- 10.20.193.28:0/2961804306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 0x7f7d1010f2d0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009a30 tx=0x7f7d0002f260 comp rx=0 tx=0).stop 2026-02-20T03:29:19.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- 10.20.193.28:0/2961804306 shutdown_connections 2026-02-20T03:29:19.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 --2- 10.20.193.28:0/2961804306 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d10109ba0 0x7f7d10115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 --2- 10.20.193.28:0/2961804306 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d10109220 0x7f7d10109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 --2- 10.20.193.28:0/2961804306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 0x7f7d1010f2d0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- 10.20.193.28:0/2961804306 >> 10.20.193.28:0/2961804306 conn(0x7f7d10078600 msgr2=0x7f7d1007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:19.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- 10.20.193.28:0/2961804306 shutdown_connections 2026-02-20T03:29:19.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- 10.20.193.28:0/2961804306 wait complete. 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 Processor -- start 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- start start 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d10109220 0x7f7d101a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d10109ba0 0x7f7d101a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 0x7f7d101a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7d101191b0 con 0x7f7d1010eef0 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10119030 con 0x7f7d10109ba0 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10119330 con 0x7f7d10109220 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d15ba6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 0x7f7d101a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d15ba6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 0x7f7d101a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51682/0 (socket says 10.20.193.28:51682) 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d15ba6640 1 -- 10.20.193.28:0/3011966377 learned_addr learned my addr 10.20.193.28:0/3011966377 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:19.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d15ba6640 1 -- 10.20.193.28:0/3011966377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d10109220 msgr2=0x7f7d101a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:19.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d15ba6640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d10109220 0x7f7d101a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d15ba6640 1 -- 10.20.193.28:0/3011966377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d10109ba0 msgr2=0x7f7d101a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:19.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d15ba6640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d10109ba0 0x7f7d101a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d15ba6640 1 -- 10.20.193.28:0/3011966377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d101a66c0 con 0x7f7d1010eef0 2026-02-20T03:29:19.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d15ba6640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 0x7f7d101a5f40 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00b990 tx=0x7f7d0c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:19.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7cfe7fc640 1 -- 10.20.193.28:0/3011966377 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c006e60 con 0x7f7d1010eef0 2026-02-20T03:29:19.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7cfe7fc640 1 -- 10.20.193.28:0/3011966377 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d0c010070 con 0x7f7d1010eef0 2026-02-20T03:29:19.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7cfe7fc640 1 -- 10.20.193.28:0/3011966377 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c004800 con 0x7f7d1010eef0 2026-02-20T03:29:19.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- 10.20.193.28:0/3011966377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d101a69b0 con 0x7f7d1010eef0 2026-02-20T03:29:19.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d163a7640 1 -- 10.20.193.28:0/3011966377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d101ae1f0 con 0x7f7d1010eef0 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.930+0000 7f7d19b35e00 1 Processor -- start 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7cfe7fc640 1 -- 10.20.193.28:0/3011966377 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7d0c01d030 con 0x7f7d1010eef0 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d19b35e00 1 -- start start 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557099674fb0 0x557099675390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966f5e0 0x55709966fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55709966ff60 0x55709967bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5570995efe00 con 0x55709966f5e0 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5570995c2970 con 0x557099674fb0 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5570995701f0 con 0x55709966ff60 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d153a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966f5e0 0x55709966fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d153a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966f5e0 0x55709966fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51690/0 (socket says 10.20.193.28:51690) 2026-02-20T03:29:19.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d153a5640 1 -- 10.20.193.28:0/1157190139 learned_addr learned my addr 10.20.193.28:0/1157190139 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d153a5640 1 -- 10.20.193.28:0/1157190139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55709966ff60 msgr2=0x55709967bde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d153a5640 1 --2- 10.20.193.28:0/1157190139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55709966ff60 0x55709967bde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d153a5640 1 -- 10.20.193.28:0/1157190139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557099674fb0 msgr2=0x557099675390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d153a5640 1 --2- 10.20.193.28:0/1157190139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557099674fb0 0x557099675390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d153a5640 1 -- 10.20.193.28:0/1157190139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570995833d0 con 0x55709966f5e0 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.936+0000 7f7d153a5640 1 --2- 10.20.193.28:0/1157190139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966f5e0 0x55709966fa20 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7d00032040 tx=0x7f7d00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4b1bdd06f9dd3c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7cddce5640 1 -- 10.20.193.28:0/1157190139 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d000384f0 con 0x55709966f5e0 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7cddce5640 1 -- 10.20.193.28:0/1157190139 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d00033040 con 0x55709966f5e0 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7cddce5640 1 -- 10.20.193.28:0/1157190139 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d000043b0 con 0x55709966f5e0 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7cfe7fc640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cec0b0e20 0x7f7cec0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7cfe7fc640 1 -- 10.20.193.28:0/3011966377 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f7d0c0dfff0 con 0x7f7d1010eef0 2026-02-20T03:29:19.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1157190139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966f5e0 msgr2=0x55709966fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:19.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/1157190139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966f5e0 0x55709966fa20 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7d00032040 tx=0x7f7d00005880 comp rx=0 tx=0).stop 2026-02-20T03:29:19.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1157190139 shutdown_connections 2026-02-20T03:29:19.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/1157190139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55709966ff60 0x55709967bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/1157190139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966f5e0 0x55709966fa20 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/1157190139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557099674fb0 0x557099675390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1157190139 >> 10.20.193.28:0/1157190139 conn(0x557099632240 msgr2=0x55709966dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:19.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cec0b0e20 0x7f7cec0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:19.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1157190139 shutdown_connections 2026-02-20T03:29:19.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1157190139 wait complete. 2026-02-20T03:29:19.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cec0b0e20 0x7f7cec0b32e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7d04006fd0 tx=0x7f7d04006d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- start start 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 Processor -- start 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55709966f5e0 0x557099689da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557099674fb0 0x557099688550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5570995be8a0 con 0x55709966ff60 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5570993b0f50 con 0x55709966f5e0 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557099688b90 con 0x557099674fb0 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51704/0 (socket says 10.20.193.28:51704) 2026-02-20T03:29:19.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 -- 10.20.193.28:0/663142185 learned_addr learned my addr 10.20.193.28:0/663142185 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 -- 10.20.193.28:0/663142185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557099674fb0 msgr2=0x557099688550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557099674fb0 0x557099688550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 -- 10.20.193.28:0/663142185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55709966f5e0 msgr2=0x557099689da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55709966f5e0 0x557099689da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 -- 10.20.193.28:0/663142185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557099681b20 con 0x55709966ff60 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968a2e0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f7d04006f20 tx=0x7f7d04004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e54a96d374e8ea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7ccaffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7ccaffd640 1 -- 10.20.193.28:0/663142185 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400bdc0 con 0x55709966ff60 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- 10.20.193.28:0/663142185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557099393b40 con 0x55709966ff60 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 10 client.19392 _ll_register_callbacks cb 0x5570995fbeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- 10.20.193.28:0/663142185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570995d0150 con 0x55709966ff60 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7ccaffd640 1 -- 10.20.193.28:0/663142185 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d040118e0 con 0x55709966ff60 2026-02-20T03:29:19.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7ccaffd640 1 -- 10.20.193.28:0/663142185 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04020820 con 0x55709966ff60 2026-02-20T03:29:19.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7ccaffd640 1 -- 10.20.193.28:0/663142185 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f7d04013430 con 0x55709966ff60 2026-02-20T03:29:19.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7ccaffd640 1 -- 10.20.193.28:0/663142185 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7d04011440 con 0x55709966ff60 2026-02-20T03:29:19.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 10 client.19392 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:19.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- 10.20.193.28:0/663142185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55709957d1e0 con 0x55709966ff60 2026-02-20T03:29:19.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7ccaffd640 1 -- 10.20.193.28:0/663142185 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f7d04028030 con 0x55709966ff60 2026-02-20T03:29:19.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 10 client.19392 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:19.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 10 client.19392 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:29:19.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 20 client.19392 populate_metadata read hostname 'trial028' 2026-02-20T03:29:19.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5570996986a0 0x55709969ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:19.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 4 client.19392 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:19.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.939+0000 7f7d19b35e00 1 -- 10.20.193.28:0/663142185 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570995ca560 con 0x5570996986a0 2026-02-20T03:29:19.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:19.966+0000 7f7d153a5640 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5570996986a0 0x55709969ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:20.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.020+0000 7f7d153a5640 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5570996986a0 0x55709969ab30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e5741c80be30ea5 server_cookie=221de964ab148ad8 in_seq=0 out_seq=0 2026-02-20T03:29:20.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.020+0000 7f7ccaffd640 10 client.19392 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7ccaffd640 1 -- 10.20.193.28:0/663142185 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5570995ca560 con 0x5570996986a0 2026-02-20T03:29:20.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7ccaffd640 10 client.19392 handle_command_reply: tid=0 2026-02-20T03:29:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 client.19392 shutdown 2026-02-20T03:29:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 -- 10.20.193.28:0/663142185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 msgr2=0x55709968a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968a2e0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f7d04006f20 tx=0x7f7d04004890 comp rx=0 tx=0).stop 2026-02-20T03:29:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 -- 10.20.193.28:0/663142185 shutdown_connections 2026-02-20T03:29:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557099674fb0 0x557099688550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5570996986a0 0x55709969ab30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968a2e0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/663142185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55709966f5e0 0x557099689da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 -- 10.20.193.28:0/663142185 >> 10.20.193.28:0/663142185 conn(0x557099632240 msgr2=0x55709966e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:20.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7ccaffd640 0 client.19392 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 -- 10.20.193.28:0/663142185 shutdown_connections 2026-02-20T03:29:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 1 -- 10.20.193.28:0/663142185 wait complete. 2026-02-20T03:29:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.047+0000 7f7d19b35e00 20 client.19392 trim_cache size 0 max 16384 2026-02-20T03:29:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 Processor -- start 2026-02-20T03:29:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- start start 2026-02-20T03:29:20.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55709966f5e0 0x557099667ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x557099685ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557099674fb0 0x557099686020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc012800 con 0x55709966ff60 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc010070 con 0x557099674fb0 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc00de60 con 0x55709966f5e0 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x557099685ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x557099685ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51706/0 (socket says 10.20.193.28:51706) 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 -- 10.20.193.28:0/1770410009 learned_addr learned my addr 10.20.193.28:0/1770410009 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 -- 10.20.193.28:0/1770410009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55709966f5e0 msgr2=0x557099667ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/1770410009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55709966f5e0 0x557099667ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 -- 10.20.193.28:0/1770410009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557099674fb0 msgr2=0x557099686020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:20.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/1770410009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557099674fb0 0x557099686020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 -- 10.20.193.28:0/1770410009 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557099681950 con 0x55709966ff60 2026-02-20T03:29:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/1770410009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x557099685ae0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f7d04004940 tx=0x7f7d04029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a74dda7b336d06b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7cdd4e4640 1 -- 10.20.193.28:0/1770410009 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04011bb0 con 0x55709966ff60 2026-02-20T03:29:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7cdd4e4640 1 -- 10.20.193.28:0/1770410009 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7d0402e020 con 0x55709966ff60 2026-02-20T03:29:20.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7cdd4e4640 1 -- 10.20.193.28:0/1770410009 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04013630 con 0x55709966ff60 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1770410009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 msgr2=0x557099685ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/1770410009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x557099685ae0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f7d04004940 tx=0x7f7d04029000 comp rx=0 tx=0).stop 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1770410009 shutdown_connections 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/1770410009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557099674fb0 0x557099686020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/1770410009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x557099685ae0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/1770410009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55709966f5e0 0x557099667ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1770410009 >> 10.20.193.28:0/1770410009 conn(0x557099632240 msgr2=0x5570996874e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1770410009 shutdown_connections 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- 10.20.193.28:0/1770410009 wait complete. 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- start start 2026-02-20T03:29:20.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 Processor -- start 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55709966f5e0 0x55709968ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557099674fb0 0x557099703620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc00e530 con 0x55709966ff60 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc00f9a0 con 0x55709966f5e0 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7cbc00ec00 con 0x557099674fb0 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51720/0 (socket says 10.20.193.28:51720) 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 -- 10.20.193.28:0/2005055766 learned_addr learned my addr 10.20.193.28:0/2005055766 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 -- 10.20.193.28:0/2005055766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557099674fb0 msgr2=0x557099703620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557099674fb0 0x557099703620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 -- 10.20.193.28:0/2005055766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55709966f5e0 msgr2=0x55709968ce10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55709966f5e0 0x55709968ce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 -- 10.20.193.28:0/2005055766 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570992a1870 con 0x55709966ff60 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d14ba4640 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968d350 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f7d04011de0 tx=0x7f7d04004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2df7d7371cfd717 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7ccaffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7ccaffd640 1 -- 10.20.193.28:0/2005055766 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04037020 con 0x55709966ff60 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7ccaffd640 1 -- 10.20.193.28:0/2005055766 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5570995d0150 con 0x55709966ff60 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7ccaffd640 1 -- 10.20.193.28:0/2005055766 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04013dc0 con 0x55709966ff60 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- 10.20.193.28:0/2005055766 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570995623f0 con 0x55709966ff60 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 10 client.19398 _ll_register_callbacks cb 0x7f7d04009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- 10.20.193.28:0/2005055766 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557099574ab0 con 0x55709966ff60 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7ccaffd640 1 -- 10.20.193.28:0/2005055766 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f7d04013430 con 0x55709966ff60 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7ccaffd640 1 -- 10.20.193.28:0/2005055766 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7d04006070 con 0x55709966ff60 2026-02-20T03:29:20.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 10 client.19398 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- 10.20.193.28:0/2005055766 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x557099682640 con 0x55709966ff60 2026-02-20T03:29:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7ccaffd640 1 -- 10.20.193.28:0/2005055766 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f7d04028070 con 0x55709966ff60 2026-02-20T03:29:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 10 client.19398 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 10 client.19398 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:29:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 20 client.19398 populate_metadata read hostname 'trial028' 2026-02-20T03:29:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557099704d10 0x5570997071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 4 client.19398 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:29:20.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.054+0000 7f7d19b35e00 1 -- 10.20.193.28:0/2005055766 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7d00033040 con 0x557099704d10 2026-02-20T03:29:20.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.074+0000 7f7d153a5640 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557099704d10 0x5570997071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:20.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.115+0000 7f7d153a5640 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557099704d10 0x5570997071d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c7f71d8341a7a08 server_cookie=8580ece710810442 in_seq=0 out_seq=0 2026-02-20T03:29:20.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.115+0000 7f7ccaffd640 10 client.19398 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:20.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7ccaffd640 1 -- 10.20.193.28:0/2005055766 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7d00033040 con 0x557099704d10 2026-02-20T03:29:20.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7ccaffd640 10 client.19398 handle_command_reply: tid=0 2026-02-20T03:29:20.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 client.19398 shutdown 2026-02-20T03:29:20.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 -- 10.20.193.28:0/2005055766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 msgr2=0x55709968d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:20.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968d350 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f7d04011de0 tx=0x7f7d04004270 comp rx=0 tx=0).stop 2026-02-20T03:29:20.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 -- 10.20.193.28:0/2005055766 shutdown_connections 2026-02-20T03:29:20.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557099674fb0 0x557099703620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557099704d10 0x5570997071d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55709966ff60 0x55709968d350 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 --2- 10.20.193.28:0/2005055766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55709966f5e0 0x55709968ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 -- 10.20.193.28:0/2005055766 >> 10.20.193.28:0/2005055766 conn(0x557099632240 msgr2=0x557099698a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:20.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7ccaffd640 0 client.19398 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:20.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 -- 10.20.193.28:0/2005055766 shutdown_connections 2026-02-20T03:29:20.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 1 -- 10.20.193.28:0/2005055766 wait complete. 2026-02-20T03:29:20.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.128+0000 7f7d19b35e00 20 client.19398 trim_cache size 0 max 16384 2026-02-20T03:29:20.135 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:29:20.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 -- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cec0b0e20 msgr2=0x7f7cec0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:20.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cec0b0e20 0x7f7cec0b32e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7d04006fd0 tx=0x7f7d04006d60 comp rx=0 tx=0).stop 2026-02-20T03:29:20.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 -- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 msgr2=0x7f7d101a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:20.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 0x7f7d101a5f40 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00b990 tx=0x7f7d0c00be60 comp rx=0 tx=0).stop 2026-02-20T03:29:20.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 -- 10.20.193.28:0/3011966377 shutdown_connections 2026-02-20T03:29:20.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cec0b0e20 0x7f7cec0b32e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7d1010eef0 0x7f7d101a5f40 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7d10109ba0 0x7f7d101a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 --2- 10.20.193.28:0/3011966377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7d10109220 0x7f7d101a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:20.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 -- 10.20.193.28:0/3011966377 >> 10.20.193.28:0/3011966377 conn(0x7f7d10078600 msgr2=0x7f7d10079f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:20.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 -- 10.20.193.28:0/3011966377 shutdown_connections 2026-02-20T03:29:20.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:20.129+0000 7f7d163a7640 1 -- 10.20.193.28:0/3011966377 wait complete. 2026-02-20T03:29:20.343 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:29:20.651 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:20.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 38.92 MB/sec warmup 51 sec latency 16722.008 ms 2026-02-20T03:29:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 -- 10.20.193.28:0/2665998037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c10a980 msgr2=0x7f320c10ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 --2- 10.20.193.28:0/2665998037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c10a980 0x7f320c10ad60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009a60 tx=0x7f31f802f290 comp rx=0 tx=0).stop 2026-02-20T03:29:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 -- 10.20.193.28:0/2665998037 shutdown_connections 2026-02-20T03:29:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 --2- 10.20.193.28:0/2665998037 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f320c105320 0x7f320c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 --2- 10.20.193.28:0/2665998037 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f320c104980 0x7f320c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 --2- 10.20.193.28:0/2665998037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c10a980 0x7f320c10ad60 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 -- 10.20.193.28:0/2665998037 >> 10.20.193.28:0/2665998037 conn(0x7f320c100680 msgr2=0x7f320c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 -- 10.20.193.28:0/2665998037 shutdown_connections 2026-02-20T03:29:21.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 -- 10.20.193.28:0/2665998037 wait complete. 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 Processor -- start 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 -- start start 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.047+0000 7f32114ff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f320c104980 0x7f320c077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32114ff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c105320 0x7f320c077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f320b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c105320 0x7f320c077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f320b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c105320 0x7f320c077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51738/0 (socket says 10.20.193.28:51738) 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32114ff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f320c10a980 0x7f320c078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32114ff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f320c114cd0 con 0x7f320c105320 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32114ff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f320c114b50 con 0x7f320c104980 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32114ff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f320c114e50 con 0x7f320c10a980 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f320b7fe640 1 -- 10.20.193.28:0/397454530 learned_addr learned my addr 10.20.193.28:0/397454530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f320b7fe640 1 -- 10.20.193.28:0/397454530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f320c10a980 msgr2=0x7f320c078080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f320b7fe640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f320c10a980 0x7f320c078080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f320b7fe640 1 -- 10.20.193.28:0/397454530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f320c104980 msgr2=0x7f320c077600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:21.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f320b7fe640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f320c104980 0x7f320c077600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f320b7fe640 1 -- 10.20.193.28:0/397454530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c1adb30 con 0x7f320c105320 2026-02-20T03:29:21.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f320b7fe640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c105320 0x7f320c077b40 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00b5a0 tx=0x7f31fc00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32097fa640 1 -- 10.20.193.28:0/397454530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc012070 con 0x7f320c105320 2026-02-20T03:29:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32114ff640 1 -- 10.20.193.28:0/397454530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320c1ade20 con 0x7f320c105320 2026-02-20T03:29:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32114ff640 1 -- 10.20.193.28:0/397454530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320c1ae280 con 0x7f320c105320 2026-02-20T03:29:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32097fa640 1 -- 10.20.193.28:0/397454530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f31fc004480 con 0x7f320c105320 2026-02-20T03:29:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32097fa640 1 -- 10.20.193.28:0/397454530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00dac0 con 0x7f320c105320 2026-02-20T03:29:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f32097fa640 1 -- 10.20.193.28:0/397454530 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f31fc002780 con 0x7f320c105320 2026-02-20T03:29:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3214c8de00 1 Processor -- start 2026-02-20T03:29:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3214c8de00 1 -- start start 2026-02-20T03:29:21.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 0x55bd583caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583caf60 0x55bd583d6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3214c8de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd5834ae00 con 0x55bd583cffb0 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3214c8de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bd5831d970 con 0x55bd583caf60 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3214c8de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bd582cb1f0 con 0x55bd583ca5e0 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3210cfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3210cfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51746/0 (socket says 10.20.193.28:51746) 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3210cfe640 1 -- 10.20.193.28:0/775752563 learned_addr learned my addr 10.20.193.28:0/775752563 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3210cfe640 1 -- 10.20.193.28:0/775752563 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 msgr2=0x55bd583caa20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3210cfe640 1 --2- 10.20.193.28:0/775752563 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 0x55bd583caa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3210cfe640 1 -- 10.20.193.28:0/775752563 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583caf60 msgr2=0x55bd583d6de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:21.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3210cfe640 1 --2- 10.20.193.28:0/775752563 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583caf60 0x55bd583d6de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.052+0000 7f3210cfe640 1 -- 10.20.193.28:0/775752563 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd582de3d0 con 0x55bd583cffb0 2026-02-20T03:29:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3210cfe640 1 --2- 10.20.193.28:0/775752563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583d0390 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f3200009d20 tx=0x7f320000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c71dd091d06307d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f31dcce3640 1 -- 10.20.193.28:0/775752563 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200017070 con 0x55bd583cffb0 2026-02-20T03:29:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f31dcce3640 1 -- 10.20.193.28:0/775752563 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f320000bd50 con 0x55bd583cffb0 2026-02-20T03:29:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f31dcce3640 1 -- 10.20.193.28:0/775752563 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200006e60 con 0x55bd583cffb0 2026-02-20T03:29:21.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f32097fa640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31e00b0e20 0x7f31e00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f32097fa640 1 -- 10.20.193.28:0/397454530 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f31fc0e00f0 con 0x7f320c105320 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 -- 10.20.193.28:0/775752563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 msgr2=0x55bd583d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 --2- 10.20.193.28:0/775752563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583d0390 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f3200009d20 tx=0x7f320000b420 comp rx=0 tx=0).stop 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 -- 10.20.193.28:0/775752563 shutdown_connections 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 --2- 10.20.193.28:0/775752563 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583caf60 0x55bd583d6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 --2- 10.20.193.28:0/775752563 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 0x55bd583caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 --2- 10.20.193.28:0/775752563 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583d0390 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 -- 10.20.193.28:0/775752563 >> 10.20.193.28:0/775752563 conn(0x55bd5838d240 msgr2=0x55bd583c8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f320bfff640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31e00b0e20 0x7f31e00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 -- 10.20.193.28:0/775752563 shutdown_connections 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 -- 10.20.193.28:0/775752563 wait complete. 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f320bfff640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31e00b0e20 0x7f31e00b32e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f31f802f7a0 tx=0x7f31f80023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:21.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 -- start start 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.057+0000 7f3214c8de00 1 Processor -- start 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 0x55bd583e4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583caf60 0x55bd583e5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583cffb0 0x55bd583e3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55bd583198a0 con 0x55bd583caf60 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55bd5810bf50 con 0x55bd583cffb0 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55bd583e3cd0 con 0x55bd583ca5e0 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f320b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583caf60 0x55bd583e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f320b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583caf60 0x55bd583e5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51750/0 (socket says 10.20.193.28:51750) 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f320b7fe640 1 -- 10.20.193.28:0/3668581402 learned_addr learned my addr 10.20.193.28:0/3668581402 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f320b7fe640 1 -- 10.20.193.28:0/3668581402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 msgr2=0x55bd583e4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:29:21.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f320b7fe640 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 0x55bd583e4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f320b7fe640 1 -- 10.20.193.28:0/3668581402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583cffb0 msgr2=0x55bd583e3690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f320b7fe640 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583cffb0 0x55bd583e3690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f320b7fe640 1 -- 10.20.193.28:0/3668581402 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd583dcad0 con 0x55bd583caf60 2026-02-20T03:29:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f320b7fe640 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583caf60 0x55bd583e5420 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0a7ad0 tx=0x7f31fc0a73c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84eff29b3683c5b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f31cdffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f31cdffb640 1 -- 10.20.193.28:0/3668581402 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0b1030 con 0x55bd583caf60 2026-02-20T03:29:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f31cdffb640 1 -- 10.20.193.28:0/3668581402 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f31fc002d40 con 0x55bd583caf60 2026-02-20T03:29:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f31cdffb640 1 -- 10.20.193.28:0/3668581402 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0ae610 con 0x55bd583caf60 2026-02-20T03:29:21.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 -- 10.20.193.28:0/3668581402 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd580eeb40 con 0x55bd583caf60 2026-02-20T03:29:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f31cdffb640 1 -- 10.20.193.28:0/3668581402 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f31fc0a6de0 con 0x55bd583caf60 2026-02-20T03:29:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 10 client.19410 _ll_register_callbacks cb 0x55bd58356eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 -- 10.20.193.28:0/3668581402 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bd5832b150 con 0x55bd583caf60 2026-02-20T03:29:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f31cdffb640 1 -- 10.20.193.28:0/3668581402 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f31fc0b0ba0 con 0x55bd583caf60 2026-02-20T03:29:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 10 client.19410 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:21.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 -- 10.20.193.28:0/3668581402 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55bd582d81e0 con 0x55bd583caf60 2026-02-20T03:29:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f31cdffb640 1 -- 10.20.193.28:0/3668581402 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f31fc0ce200 con 0x55bd583caf60 2026-02-20T03:29:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 10 client.19410 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 10 client.19410 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:29:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 20 client.19410 populate_metadata read hostname 'trial028' 2026-02-20T03:29:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55bd583f3710 0x55bd583f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 4 client.19410 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:21.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.060+0000 7f3214c8de00 1 -- 10.20.193.28:0/3668581402 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd58325560 con 0x55bd583f3710 2026-02-20T03:29:21.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.087+0000 7f320bfff640 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55bd583f3710 0x55bd583f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:21.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.153+0000 7f320bfff640 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55bd583f3710 0x55bd583f5b60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ea7cdd372d4ed98f server_cookie=1b6d4648588dc83e in_seq=0 out_seq=0 2026-02-20T03:29:21.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.153+0000 7f31cdffb640 10 client.19410 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:29:21.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f31cdffb640 1 -- 10.20.193.28:0/3668581402 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55bd58325560 con 0x55bd583f3710 2026-02-20T03:29:21.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f31cdffb640 10 client.19410 handle_command_reply: tid=0 2026-02-20T03:29:21.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 client.19410 shutdown 2026-02-20T03:29:21.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 -- 10.20.193.28:0/3668581402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583caf60 msgr2=0x55bd583e5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:21.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583caf60 0x55bd583e5420 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f31fc0a7ad0 tx=0x7f31fc0a73c0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 -- 10.20.193.28:0/3668581402 shutdown_connections 2026-02-20T03:29:21.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55bd583f3710 0x55bd583f5b60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583cffb0 0x55bd583e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583caf60 0x55bd583e5420 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 --2- 10.20.193.28:0/3668581402 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 0x55bd583e4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 -- 10.20.193.28:0/3668581402 >> 10.20.193.28:0/3668581402 conn(0x55bd5838d240 msgr2=0x55bd583c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:21.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f31cdffb640 0 client.19410 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:29:21.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 -- 10.20.193.28:0/3668581402 shutdown_connections 2026-02-20T03:29:21.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 1 -- 10.20.193.28:0/3668581402 wait complete. 2026-02-20T03:29:21.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.180+0000 7f3214c8de00 20 client.19410 trim_cache size 0 max 16384 2026-02-20T03:29:21.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 Processor -- start 2026-02-20T03:29:21.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- start start 2026-02-20T03:29:21.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 0x55bd583c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583caf60 0x55bd583e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31b0012700 con 0x55bd583cffb0 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f31b000ff70 con 0x55bd583caf60 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31b000ddc0 con 0x55bd583ca5e0 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3210cfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3210cfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583e0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51762/0 (socket says 10.20.193.28:51762) 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3210cfe640 1 -- 10.20.193.28:0/2078075820 learned_addr learned my addr 10.20.193.28:0/2078075820 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3210cfe640 1 -- 10.20.193.28:0/2078075820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 msgr2=0x55bd583c2d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3210cfe640 1 --2- 10.20.193.28:0/2078075820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 0x55bd583c2d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3210cfe640 1 -- 10.20.193.28:0/2078075820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583caf60 msgr2=0x55bd583e24d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3210cfe640 1 --2- 10.20.193.28:0/2078075820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583caf60 0x55bd583e24d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3210cfe640 1 -- 10.20.193.28:0/2078075820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd583dc900 con 0x55bd583cffb0 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3210cfe640 1 --2- 10.20.193.28:0/2078075820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583e0af0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f3200009a80 tx=0x7f3200009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f267d767354abd4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f31cffff640 1 -- 10.20.193.28:0/2078075820 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200017070 con 0x55bd583cffb0 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f31cffff640 1 -- 10.20.193.28:0/2078075820 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3200018040 con 0x55bd583cffb0 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f31cffff640 1 -- 10.20.193.28:0/2078075820 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200012410 con 0x55bd583cffb0 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- 10.20.193.28:0/2078075820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 msgr2=0x55bd583e0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2078075820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583e0af0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f3200009a80 tx=0x7f3200009ab0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- 10.20.193.28:0/2078075820 shutdown_connections 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2078075820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583cffb0 0x55bd583e0af0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2078075820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583caf60 0x55bd583e24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2078075820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583ca5e0 0x55bd583c2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- 10.20.193.28:0/2078075820 >> 10.20.193.28:0/2078075820 conn(0x55bd5838d240 msgr2=0x55bd583e1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:21.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- 10.20.193.28:0/2078075820 shutdown_connections 2026-02-20T03:29:21.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- 10.20.193.28:0/2078075820 wait complete. 2026-02-20T03:29:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- start start 2026-02-20T03:29:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 Processor -- start 2026-02-20T03:29:21.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583ca5e0 0x55bd583e8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583caf60 0x55bd583e8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583cffb0 0x55bd583e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f31b000e430 con 0x55bd583ca5e0 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f31b000f8a0 con 0x55bd583cffb0 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f3214c8de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f31b000eb00 con 0x55bd583caf60 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f320bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583ca5e0 0x55bd583e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f320bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583ca5e0 0x55bd583e8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51768/0 (socket says 10.20.193.28:51768) 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f320bfff640 1 -- 10.20.193.28:0/2636187835 learned_addr learned my addr 10.20.193.28:0/2636187835 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f320bfff640 1 -- 10.20.193.28:0/2636187835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583caf60 msgr2=0x55bd583e8650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f320bfff640 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583caf60 0x55bd583e8650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f320bfff640 1 -- 10.20.193.28:0/2636187835 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583cffb0 msgr2=0x55bd583e8bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:21.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f320bfff640 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583cffb0 0x55bd583e8bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f320bfff640 1 -- 10.20.193.28:0/2636187835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd57ffc870 con 0x55bd583ca5e0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f320bfff640 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583ca5e0 0x55bd583e8110 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x55bd583e2e70 tx=0x7f31f802f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f89cd9e82359c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f31cdffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f31cdffb640 1 -- 10.20.193.28:0/2636187835 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8004070 con 0x55bd583ca5e0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f31cdffb640 1 -- 10.20.193.28:0/2636187835 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f31f8033040 con 0x55bd583ca5e0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.186+0000 7f31cdffb640 1 -- 10.20.193.28:0/2636187835 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f804e420 con 0x55bd583ca5e0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 1 -- 10.20.193.28:0/2636187835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd582bd3f0 con 0x55bd583ca5e0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 10 client.19416 _ll_register_callbacks cb 0x7f31fc0a3380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 1 -- 10.20.193.28:0/2636187835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bd582ee7c0 con 0x55bd583ca5e0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f31cdffb640 1 -- 10.20.193.28:0/2636187835 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f31f80387c0 con 0x55bd583ca5e0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f31cdffb640 1 -- 10.20.193.28:0/2636187835 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f31f8004210 con 0x55bd583ca5e0 2026-02-20T03:29:21.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 10 client.19416 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:21.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 1 -- 10.20.193.28:0/2636187835 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55bd583dd5f0 con 0x55bd583ca5e0 2026-02-20T03:29:21.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f31cdffb640 1 -- 10.20.193.28:0/2636187835 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f31f80043b0 con 0x55bd583ca5e0 2026-02-20T03:29:21.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 10 client.19416 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:21.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 10 client.19416 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:29:21.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 20 client.19416 populate_metadata read hostname 'trial028' 2026-02-20T03:29:21.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55bd5845ff40 0x55bd58462400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:21.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 4 client.19416 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:29:21.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.191+0000 7f3214c8de00 1 -- 10.20.193.28:0/2636187835 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bd582cfab0 con 0x55bd5845ff40 2026-02-20T03:29:21.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.207+0000 7f320b7fe640 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55bd5845ff40 0x55bd58462400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:21.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.274+0000 7f320b7fe640 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55bd5845ff40 0x55bd58462400 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a275edfd4ef803c server_cookie=ddc1efd4d7ccc687 in_seq=0 out_seq=0 2026-02-20T03:29:21.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.274+0000 7f31cdffb640 10 client.19416 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:29:21.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f31cdffb640 1 -- 10.20.193.28:0/2636187835 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bd582cfab0 con 0x55bd5845ff40 2026-02-20T03:29:21.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f31cdffb640 10 client.19416 handle_command_reply: tid=0 2026-02-20T03:29:21.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 client.19416 shutdown 2026-02-20T03:29:21.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 -- 10.20.193.28:0/2636187835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583ca5e0 msgr2=0x55bd583e8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:21.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583ca5e0 0x55bd583e8110 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x55bd583e2e70 tx=0x7f31f802f290 comp rx=0 tx=0).stop 2026-02-20T03:29:21.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 -- 10.20.193.28:0/2636187835 shutdown_connections 2026-02-20T03:29:21.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55bd5845ff40 0x55bd58462400 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55bd583cffb0 0x55bd583e8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55bd583caf60 0x55bd583e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 --2- 10.20.193.28:0/2636187835 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55bd583ca5e0 0x55bd583e8110 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 -- 10.20.193.28:0/2636187835 >> 10.20.193.28:0/2636187835 conn(0x55bd5838d240 msgr2=0x55bd583e25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:21.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f31cdffb640 0 client.19416 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:29:21.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 -- 10.20.193.28:0/2636187835 shutdown_connections 2026-02-20T03:29:21.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 1 -- 10.20.193.28:0/2636187835 wait complete. 2026-02-20T03:29:21.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.287+0000 7f3214c8de00 20 client.19416 trim_cache size 0 max 16384 2026-02-20T03:29:21.292 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:29:21.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 -- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31e00b0e20 msgr2=0x7f31e00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31e00b0e20 0x7f31e00b32e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f31f802f7a0 tx=0x7f31f80023d0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 -- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c105320 msgr2=0x7f320c077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c105320 0x7f320c077b40 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00b5a0 tx=0x7f31fc00ba70 comp rx=0 tx=0).stop 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 -- 10.20.193.28:0/397454530 shutdown_connections 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f31e00b0e20 0x7f31e00b32e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f320c10a980 0x7f320c078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f320c105320 0x7f320c077b40 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 --2- 10.20.193.28:0/397454530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f320c104980 0x7f320c077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 -- 10.20.193.28:0/397454530 >> 10.20.193.28:0/397454530 conn(0x7f320c100680 msgr2=0x7f320c101180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:21.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 -- 10.20.193.28:0/397454530 shutdown_connections 2026-02-20T03:29:21.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.288+0000 7f32114ff640 1 -- 10.20.193.28:0/397454530 wait complete. 2026-02-20T03:29:21.382 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:29:21.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:21 trial028 ceph-mon[38552]: pgmap v623: 129 pgs: 129 active+clean; 470 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 418 KiB/s rd, 11 MiB/s wr, 718 op/s 2026-02-20T03:29:21.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:21 trial126 ceph-mon[38476]: pgmap v623: 129 pgs: 129 active+clean; 470 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 418 KiB/s rd, 11 MiB/s wr, 718 op/s 2026-02-20T03:29:21.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 38.17 MB/sec warmup 52 sec latency 17722.521 ms 2026-02-20T03:29:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:21 trial177 ceph-mon[43181]: pgmap v623: 129 pgs: 129 active+clean; 470 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 418 KiB/s rd, 11 MiB/s wr, 718 op/s 2026-02-20T03:29:21.719 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:22.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- 10.20.193.28:0/76907453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a601134d0 msgr2=0x7f5a60115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:22.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/76907453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a601134d0 0x7f5a60115900 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000b0a0 tx=0x7f5a5002f4e0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- 10.20.193.28:0/76907453 shutdown_connections 2026-02-20T03:29:22.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/76907453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a601134d0 0x7f5a60115900 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/76907453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5a60075950 0x7f5a60075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/76907453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5a601065d0 0x7f5a60075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- 10.20.193.28:0/76907453 >> 10.20.193.28:0/76907453 conn(0x7f5a600fe440 msgr2=0x7f5a60100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:22.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- 10.20.193.28:0/76907453 shutdown_connections 2026-02-20T03:29:22.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- 10.20.193.28:0/76907453 wait complete. 2026-02-20T03:29:22.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 Processor -- start 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- start start 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a60075950 0x7f5a601a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5a601065d0 0x7f5a601a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5a601134d0 0x7f5a601a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601191d0 con 0x7f5a60075950 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60119050 con 0x7f5a601134d0 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60119350 con 0x7f5a601065d0 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a60075950 0x7f5a601a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a60075950 0x7f5a601a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51780/0 (socket says 10.20.193.28:51780) 2026-02-20T03:29:22.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5effd640 1 -- 10.20.193.28:0/4252866284 learned_addr learned my addr 10.20.193.28:0/4252866284 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:22.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5effd640 1 -- 10.20.193.28:0/4252866284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5a601065d0 msgr2=0x7f5a601a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5effd640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5a601065d0 0x7f5a601a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5effd640 1 -- 10.20.193.28:0/4252866284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5a601134d0 msgr2=0x7f5a601a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5effd640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5a601134d0 0x7f5a601a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5effd640 1 -- 10.20.193.28:0/4252866284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a601a66c0 con 0x7f5a60075950 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5effd640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a60075950 0x7f5a601a1670 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400b570 tx=0x7f5a5400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a3ffff640 1 -- 10.20.193.28:0/4252866284 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54013020 con 0x7f5a60075950 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a3ffff640 1 -- 10.20.193.28:0/4252866284 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5a54004480 con 0x7f5a60075950 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a3ffff640 1 -- 10.20.193.28:0/4252866284 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400fb50 con 0x7f5a60075950 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- 10.20.193.28:0/4252866284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a601a69b0 con 0x7f5a60075950 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a5ffff640 1 -- 10.20.193.28:0/4252866284 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a601ae1f0 con 0x7f5a60075950 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:21.999+0000 7f5a3ffff640 1 -- 10.20.193.28:0/4252866284 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5a54002780 con 0x7f5a60075950 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 Processor -- start 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 -- start start 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a29afb0 0x556b1a29b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a295a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a295f60 0x556b1a2a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556b1a215e00 con 0x556b1a2955e0 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556b1a1e8970 con 0x556b1a29afb0 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556b1a1961f0 con 0x556b1a295f60 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a3ffff640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5a300b0e20 0x7f5a300b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a3ffff640 1 -- 10.20.193.28:0/4252866284 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f5a540e05e0 con 0x7f5a60075950 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a295a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a295a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51788/0 (socket says 10.20.193.28:51788) 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5effd640 1 -- 10.20.193.28:0/2892201822 learned_addr learned my addr 10.20.193.28:0/2892201822 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5f7fe640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5a300b0e20 0x7f5a300b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5effd640 1 -- 10.20.193.28:0/2892201822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a295f60 msgr2=0x556b1a2a1de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5effd640 1 --2- 10.20.193.28:0/2892201822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a295f60 0x556b1a2a1de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5effd640 1 -- 10.20.193.28:0/2892201822 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a29afb0 msgr2=0x556b1a29b390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5effd640 1 --2- 10.20.193.28:0/2892201822 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a29afb0 0x556b1a29b390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5effd640 1 -- 10.20.193.28:0/2892201822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b1a1a93d0 con 0x556b1a2955e0 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5effd640 1 --2- 10.20.193.28:0/2892201822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a295a20 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5a540a7fc0 tx=0x7f5a540a78b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42344c4466262229 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a5f7fe640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5a300b0e20 0x7f5a300b32e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5a50007600 tx=0x7f5a50005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a277fe640 1 -- 10.20.193.28:0/2892201822 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a540ac670 con 0x556b1a2955e0 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a277fe640 1 -- 10.20.193.28:0/2892201822 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5a540b1520 con 0x556b1a2955e0 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a277fe640 1 -- 10.20.193.28:0/2892201822 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a540a72d0 con 0x556b1a2955e0 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 -- 10.20.193.28:0/2892201822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 msgr2=0x556b1a295a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 --2- 10.20.193.28:0/2892201822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a295a20 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5a540a7fc0 tx=0x7f5a540a78b0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 -- 10.20.193.28:0/2892201822 shutdown_connections 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 --2- 10.20.193.28:0/2892201822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a295f60 0x556b1a2a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 --2- 10.20.193.28:0/2892201822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a295a20 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 --2- 10.20.193.28:0/2892201822 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a29afb0 0x556b1a29b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 -- 10.20.193.28:0/2892201822 >> 10.20.193.28:0/2892201822 conn(0x556b1a258240 msgr2=0x556b1a293ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 -- 10.20.193.28:0/2892201822 shutdown_connections 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.005+0000 7f5a67893e00 1 -- 10.20.193.28:0/2892201822 wait complete. 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 -- start start 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 Processor -- start 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a2955e0 0x556b1a2afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a295f60 0x556b1a2b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556b1a1e48a0 con 0x556b1a29afb0 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556b19fd6f50 con 0x556b1a2955e0 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556b1a2aeb20 con 0x556b1a295f60 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a5f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a5f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51802/0 (socket says 10.20.193.28:51802) 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a5f7fe640 1 -- 10.20.193.28:0/68161583 learned_addr learned my addr 10.20.193.28:0/68161583 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a5f7fe640 1 -- 10.20.193.28:0/68161583 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a295f60 msgr2=0x556b1a2b01a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a5f7fe640 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a295f60 0x556b1a2b01a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a5f7fe640 1 -- 10.20.193.28:0/68161583 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a2955e0 msgr2=0x556b1a2afc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:22.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a5f7fe640 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a2955e0 0x556b1a2afc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a5f7fe640 1 -- 10.20.193.28:0/68161583 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b1a2a7af0 con 0x556b1a29afb0 2026-02-20T03:29:22.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a5f7fe640 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2ae3a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5a50036000 tx=0x7f5a5002f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8b064ef86aa0d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:22.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a24ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a24ff9640 1 -- 10.20.193.28:0/68161583 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50004280 con 0x556b1a29afb0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a24ff9640 1 -- 10.20.193.28:0/68161583 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5a50049030 con 0x556b1a29afb0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a24ff9640 1 -- 10.20.193.28:0/68161583 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a500052b0 con 0x556b1a29afb0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 -- 10.20.193.28:0/68161583 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b19fb9b40 con 0x556b1a29afb0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 10 client.19428 _ll_register_callbacks cb 0x556b1a221eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 -- 10.20.193.28:0/68161583 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b1a1f6150 con 0x556b1a29afb0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a24ff9640 1 -- 10.20.193.28:0/68161583 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f5a50005450 con 0x556b1a29afb0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a24ff9640 1 -- 10.20.193.28:0/68161583 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5a50053060 con 0x556b1a29afb0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 10 client.19428 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 -- 10.20.193.28:0/68161583 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x556b1a1a31e0 con 0x556b1a29afb0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a24ff9640 1 -- 10.20.193.28:0/68161583 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f5a50041030 con 0x556b1a29afb0 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 10 client.19428 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 10 client.19428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 20 client.19428 populate_metadata read hostname 'trial028' 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b1a2be540 0x556b1a2c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 4 client.19428 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:22.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.008+0000 7f5a67893e00 1 -- 10.20.193.28:0/68161583 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b1a1f0560 con 0x556b1a2be540 2026-02-20T03:29:22.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.035+0000 7f5a5effd640 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b1a2be540 0x556b1a2c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.102+0000 7f5a5effd640 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b1a2be540 0x556b1a2c0a00 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79a3e8b30976a1c2 server_cookie=89c736bd449ae280 in_seq=0 out_seq=0 2026-02-20T03:29:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.102+0000 7f5a24ff9640 10 client.19428 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a24ff9640 1 -- 10.20.193.28:0/68161583 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556b1a1f0560 con 0x556b1a2be540 2026-02-20T03:29:22.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a24ff9640 10 client.19428 handle_command_reply: tid=0 2026-02-20T03:29:22.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 client.19428 shutdown 2026-02-20T03:29:22.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 -- 10.20.193.28:0/68161583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 msgr2=0x556b1a2ae3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:22.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2ae3a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5a50036000 tx=0x7f5a5002f4e0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 -- 10.20.193.28:0/68161583 shutdown_connections 2026-02-20T03:29:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b1a2be540 0x556b1a2c0a00 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2ae3a0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a295f60 0x556b1a2b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 --2- 10.20.193.28:0/68161583 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a2955e0 0x556b1a2afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 -- 10.20.193.28:0/68161583 >> 10.20.193.28:0/68161583 conn(0x556b1a258240 msgr2=0x556b1a2943f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a24ff9640 0 client.19428 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 -- 10.20.193.28:0/68161583 shutdown_connections 2026-02-20T03:29:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 1 -- 10.20.193.28:0/68161583 wait complete. 2026-02-20T03:29:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.115+0000 7f5a67893e00 20 client.19428 trim_cache size 0 max 16384 2026-02-20T03:29:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 Processor -- start 2026-02-20T03:29:22.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- start start 2026-02-20T03:29:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a2955e0 0x556b1a28dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a295f60 0x556b1a2ab930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2abe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5a040127d0 con 0x556b1a29afb0 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5a04010040 con 0x556b1a295f60 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0400de90 con 0x556b1a2955e0 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2abe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51810/0 (socket says 10.20.193.28:51810) 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5f7fe640 1 -- 10.20.193.28:0/704343033 learned_addr learned my addr 10.20.193.28:0/704343033 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5f7fe640 1 -- 10.20.193.28:0/704343033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a2955e0 msgr2=0x556b1a28dad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5f7fe640 1 --2- 10.20.193.28:0/704343033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a2955e0 0x556b1a28dad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5f7fe640 1 -- 10.20.193.28:0/704343033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a295f60 msgr2=0x556b1a2ab930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5f7fe640 1 --2- 10.20.193.28:0/704343033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a295f60 0x556b1a2ab930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5f7fe640 1 -- 10.20.193.28:0/704343033 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b1a2a7920 con 0x556b1a29afb0 2026-02-20T03:29:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5f7fe640 1 --2- 10.20.193.28:0/704343033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2abe70 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009850 tx=0x7f5a50056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e89ad35476ed2f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a26ffd640 1 -- 10.20.193.28:0/704343033 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5005e070 con 0x556b1a29afb0 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a26ffd640 1 -- 10.20.193.28:0/704343033 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5a50049040 con 0x556b1a29afb0 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a26ffd640 1 -- 10.20.193.28:0/704343033 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50004280 con 0x556b1a29afb0 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- 10.20.193.28:0/704343033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 msgr2=0x556b1a2abe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- 10.20.193.28:0/704343033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2abe70 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009850 tx=0x7f5a50056000 comp rx=0 tx=0).stop 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- 10.20.193.28:0/704343033 shutdown_connections 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- 10.20.193.28:0/704343033 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a29afb0 0x556b1a2abe70 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- 10.20.193.28:0/704343033 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a295f60 0x556b1a2ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- 10.20.193.28:0/704343033 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a2955e0 0x556b1a28dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- 10.20.193.28:0/704343033 >> 10.20.193.28:0/704343033 conn(0x556b1a258240 msgr2=0x556b1a2ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:22.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- 10.20.193.28:0/704343033 shutdown_connections 2026-02-20T03:29:22.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- 10.20.193.28:0/704343033 wait complete. 2026-02-20T03:29:22.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- start start 2026-02-20T03:29:22.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 Processor -- start 2026-02-20T03:29:22.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a2b6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a295f60 0x556b1a2b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a29afb0 0x556b1a2b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0400e500 con 0x556b1a2955e0 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0400f970 con 0x556b1a295f60 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a67893e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0400ebd0 con 0x556b1a29afb0 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a2b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a2b6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51812/0 (socket says 10.20.193.28:51812) 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5effd640 1 -- 10.20.193.28:0/3356351016 learned_addr learned my addr 10.20.193.28:0/3356351016 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5effd640 1 -- 10.20.193.28:0/3356351016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a29afb0 msgr2=0x556b1a2b38b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:22.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5effd640 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a29afb0 0x556b1a2b38b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5effd640 1 -- 10.20.193.28:0/3356351016 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a295f60 msgr2=0x556b1a2b3370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5effd640 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a295f60 0x556b1a2b3370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.120+0000 7f5a5effd640 1 -- 10.20.193.28:0/3356351016 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b19ec7870 con 0x556b1a2955e0 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a5effd640 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a2b6090 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f5a540a8250 tx=0x7f5a54004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51bbb45aadc0d43 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a24ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a24ff9640 1 -- 10.20.193.28:0/3356351016 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a540ddcd0 con 0x556b1a2955e0 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a24ff9640 1 -- 10.20.193.28:0/3356351016 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5a540e0210 con 0x556b1a2955e0 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 1 -- 10.20.193.28:0/3356351016 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b1a1883f0 con 0x556b1a2955e0 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a24ff9640 1 -- 10.20.193.28:0/3356351016 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a540a3cd0 con 0x556b1a2955e0 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 10 client.19434 _ll_register_callbacks cb 0x7f5a50009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 1 -- 10.20.193.28:0/3356351016 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b1a19aab0 con 0x556b1a2955e0 2026-02-20T03:29:22.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a24ff9640 1 -- 10.20.193.28:0/3356351016 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f5a540a6d40 con 0x556b1a2955e0 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a24ff9640 1 -- 10.20.193.28:0/3356351016 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5a540a7000 con 0x556b1a2955e0 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 10 client.19434 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 1 -- 10.20.193.28:0/3356351016 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x556b1a2a8610 con 0x556b1a2955e0 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a24ff9640 1 -- 10.20.193.28:0/3356351016 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f5a540ac160 con 0x556b1a2955e0 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 10 client.19434 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 10 client.19434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 20 client.19434 populate_metadata read hostname 'trial028' 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b1a32b070 0x556b1a32d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 4 client.19434 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:29:22.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.125+0000 7f5a67893e00 1 -- 10.20.193.28:0/3356351016 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5a540b1520 con 0x556b1a32b070 2026-02-20T03:29:22.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.142+0000 7f5a5e7fc640 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b1a32b070 0x556b1a32d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.209+0000 7f5a5e7fc640 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b1a32b070 0x556b1a32d4e0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62595b1aa7749249 server_cookie=58d422163ac47e2 in_seq=0 out_seq=0 2026-02-20T03:29:22.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.209+0000 7f5a24ff9640 10 client.19434 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:22.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a24ff9640 1 -- 10.20.193.28:0/3356351016 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5a540b1520 con 0x556b1a32b070 2026-02-20T03:29:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a24ff9640 10 client.19434 handle_command_reply: tid=0 2026-02-20T03:29:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 client.19434 shutdown 2026-02-20T03:29:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 -- 10.20.193.28:0/3356351016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 msgr2=0x556b1a2b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:22.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a2b6090 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f5a540a8250 tx=0x7f5a54004700 comp rx=0 tx=0).stop 2026-02-20T03:29:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 -- 10.20.193.28:0/3356351016 shutdown_connections 2026-02-20T03:29:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b1a32b070 0x556b1a32d4e0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b1a29afb0 0x556b1a2b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b1a295f60 0x556b1a2b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 --2- 10.20.193.28:0/3356351016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b1a2955e0 0x556b1a2b6090 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 -- 10.20.193.28:0/3356351016 >> 10.20.193.28:0/3356351016 conn(0x556b1a258240 msgr2=0x556b1a2be920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a24ff9640 0 client.19434 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:22.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 -- 10.20.193.28:0/3356351016 shutdown_connections 2026-02-20T03:29:22.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 1 -- 10.20.193.28:0/3356351016 wait complete. 2026-02-20T03:29:22.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.222+0000 7f5a67893e00 20 client.19434 trim_cache size 0 max 16384 2026-02-20T03:29:22.227 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:29:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 -- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5a300b0e20 msgr2=0x7f5a300b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5a300b0e20 0x7f5a300b32e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5a50007600 tx=0x7f5a50005bd0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 -- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a60075950 msgr2=0x7f5a601a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a60075950 0x7f5a601a1670 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400b570 tx=0x7f5a5400ba40 comp rx=0 tx=0).stop 2026-02-20T03:29:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 -- 10.20.193.28:0/4252866284 shutdown_connections 2026-02-20T03:29:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5a300b0e20 0x7f5a300b32e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5a601134d0 0x7f5a601a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5a601065d0 0x7f5a601a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 --2- 10.20.193.28:0/4252866284 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5a60075950 0x7f5a601a1670 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:22.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 -- 10.20.193.28:0/4252866284 >> 10.20.193.28:0/4252866284 conn(0x7f5a600fe440 msgr2=0x7f5a60114cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:22.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 -- 10.20.193.28:0/4252866284 shutdown_connections 2026-02-20T03:29:22.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:22.223+0000 7f5a5ffff640 1 -- 10.20.193.28:0/4252866284 wait complete. 2026-02-20T03:29:22.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 37.45 MB/sec warmup 53 sec latency 18722.555 ms 2026-02-20T03:29:23.368 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:29:23.368 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:29:23.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:23 trial028 ceph-mon[38552]: pgmap v624: 129 pgs: 129 active+clean; 470 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 394 KiB/s rd, 8.5 MiB/s wr, 428 op/s 2026-02-20T03:29:23.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:23 trial126 ceph-mon[38476]: pgmap v624: 129 pgs: 129 active+clean; 470 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 394 KiB/s rd, 8.5 MiB/s wr, 428 op/s 2026-02-20T03:29:23.681 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:23.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 36.76 MB/sec warmup 54 sec latency 19722.591 ms 2026-02-20T03:29:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:23 trial177 ceph-mon[43181]: pgmap v624: 129 pgs: 129 active+clean; 470 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 394 KiB/s rd, 8.5 MiB/s wr, 428 op/s 2026-02-20T03:29:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 -- 10.20.193.28:0/1640462931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 msgr2=0x7f5fc4104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 --2- 10.20.193.28:0/1640462931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 0x7f5fc4104de0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009a60 tx=0x7f5fb802f290 comp rx=0 tx=0).stop 2026-02-20T03:29:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 -- 10.20.193.28:0/1640462931 shutdown_connections 2026-02-20T03:29:24.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 --2- 10.20.193.28:0/1640462931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5fc4105320 0x7f5fc4111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 --2- 10.20.193.28:0/1640462931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 0x7f5fc4104de0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 --2- 10.20.193.28:0/1640462931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5fc410a980 0x7f5fc410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 -- 10.20.193.28:0/1640462931 >> 10.20.193.28:0/1640462931 conn(0x7f5fc4100680 msgr2=0x7f5fc4102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 -- 10.20.193.28:0/1640462931 shutdown_connections 2026-02-20T03:29:24.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 -- 10.20.193.28:0/1640462931 wait complete. 2026-02-20T03:29:24.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.071+0000 7f5fca01e640 1 Processor -- start 2026-02-20T03:29:24.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fca01e640 1 -- start start 2026-02-20T03:29:24.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fca01e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 0x7f5fc419d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fca01e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5fc4105320 0x7f5fc419d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fca01e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5fc410a980 0x7f5fc41a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fca01e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4114c80 con 0x7f5fc4104980 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fca01e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4114b00 con 0x7f5fc4105320 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fca01e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4114e00 con 0x7f5fc410a980 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fc901c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 0x7f5fc419d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fc901c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 0x7f5fc419d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51832/0 (socket says 10.20.193.28:51832) 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fc901c640 1 -- 10.20.193.28:0/34473390 learned_addr learned my addr 10.20.193.28:0/34473390 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fc901c640 1 -- 10.20.193.28:0/34473390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5fc410a980 msgr2=0x7f5fc41a1ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fc901c640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5fc410a980 0x7f5fc41a1ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fc901c640 1 -- 10.20.193.28:0/34473390 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5fc4105320 msgr2=0x7f5fc419d740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:24.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fc901c640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5fc4105320 0x7f5fc419d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.072+0000 7f5fc901c640 1 -- 10.20.193.28:0/34473390 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc41a2250 con 0x7f5fc4104980 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.073+0000 7f5fc901c640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 0x7f5fc419d200 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400b570 tx=0x7f5fb400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.073+0000 7f5fb27fc640 1 -- 10.20.193.28:0/34473390 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4013020 con 0x7f5fc4104980 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.073+0000 7f5fb27fc640 1 -- 10.20.193.28:0/34473390 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5fb4004480 con 0x7f5fc4104980 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.073+0000 7f5fb27fc640 1 -- 10.20.193.28:0/34473390 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400fb50 con 0x7f5fc4104980 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.073+0000 7f5fca01e640 1 -- 10.20.193.28:0/34473390 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc41a2540 con 0x7f5fc4104980 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.073+0000 7f5fca01e640 1 -- 10.20.193.28:0/34473390 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc41a9d80 con 0x7f5fc4104980 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.075+0000 7f5fb27fc640 1 -- 10.20.193.28:0/34473390 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5fb4002780 con 0x7f5fc4104980 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fcd7ace00 1 Processor -- start 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fcd7ace00 1 -- start start 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff05494a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff0549a70 0x55eff054d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff054db60 0x55eff054dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eff049bc00 con 0x55eff05490c0 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55eff04493c0 con 0x55eff0549a70 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55eff0497b30 con 0x55eff054db60 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fc981d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff05494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fc981d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff05494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51840/0 (socket says 10.20.193.28:51840) 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.076+0000 7f5fc981d640 1 -- 10.20.193.28:0/3028554331 learned_addr learned my addr 10.20.193.28:0/3028554331 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fc981d640 1 -- 10.20.193.28:0/3028554331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff054db60 msgr2=0x55eff054dfd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fc981d640 1 --2- 10.20.193.28:0/3028554331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff054db60 0x55eff054dfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fc981d640 1 -- 10.20.193.28:0/3028554331 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff0549a70 msgr2=0x55eff054d540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fc981d640 1 --2- 10.20.193.28:0/3028554331 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff0549a70 0x55eff054d540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fc981d640 1 -- 10.20.193.28:0/3028554331 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff0442840 con 0x55eff05490c0 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fb27fc640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5fa00b0e20 0x7f5fa00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fb27fc640 1 -- 10.20.193.28:0/34473390 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f5fb40e0550 con 0x7f5fc4104980 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fc981d640 1 --2- 10.20.193.28:0/3028554331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff05494a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009d20 tx=0x7f5fc000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1465ee0c0ffafb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fc901c640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5fa00b0e20 0x7f5fa00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5f91ce5640 1 -- 10.20.193.28:0/3028554331 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0017070 con 0x55eff05490c0 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5f91ce5640 1 -- 10.20.193.28:0/3028554331 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5fc000bd50 con 0x55eff05490c0 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5f91ce5640 1 -- 10.20.193.28:0/3028554331 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0006e60 con 0x55eff05490c0 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3028554331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 msgr2=0x55eff05494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.077+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3028554331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff05494a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009d20 tx=0x7f5fc000b420 comp rx=0 tx=0).stop 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.078+0000 7f5fc901c640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5fa00b0e20 0x7f5fa00b32e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40a81c0 tx=0x7f5fb4009410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.078+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3028554331 shutdown_connections 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.078+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3028554331 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff054db60 0x55eff054dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.078+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3028554331 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff0549a70 0x55eff054d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.078+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3028554331 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff05494a0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.078+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3028554331 >> 10.20.193.28:0/3028554331 conn(0x55eff0541b60 msgr2=0x55eff05475e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.078+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3028554331 shutdown_connections 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.078+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3028554331 wait complete. 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.079+0000 7f5fcd7ace00 1 -- start start 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.079+0000 7f5fcd7ace00 1 Processor -- start 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.079+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff05490c0 0x55eff0563550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.079+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff0549a70 0x55eff0563a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.079+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff054db60 0x55eff0561c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.079+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55eff04431a0 con 0x55eff0549a70 2026-02-20T03:29:24.087 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.079+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55eff0555d70 con 0x55eff054db60 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.079+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55eff0562410 con 0x55eff05490c0 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.079+0000 7f5fc881b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff0549a70 0x55eff0563a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fc881b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff0549a70 0x55eff0563a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51846/0 (socket says 10.20.193.28:51846) 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fc881b640 1 -- 10.20.193.28:0/1559800001 learned_addr learned my addr 10.20.193.28:0/1559800001 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fc881b640 1 -- 10.20.193.28:0/1559800001 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff05490c0 msgr2=0x55eff0563550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fc881b640 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff05490c0 0x55eff0563550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fc881b640 1 -- 10.20.193.28:0/1559800001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff054db60 msgr2=0x55eff0561c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fc881b640 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff054db60 0x55eff0561c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fc881b640 1 -- 10.20.193.28:0/1559800001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff055b6e0 con 0x55eff0549a70 2026-02-20T03:29:24.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fc881b640 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff0549a70 0x55eff0563a90 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009950 tx=0x7f5fb8005860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c6fc07fe7e407c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5f7effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:24.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5f7effd640 1 -- 10.20.193.28:0/1559800001 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb80028f0 con 0x55eff0549a70 2026-02-20T03:29:24.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5f7effd640 1 -- 10.20.193.28:0/1559800001 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5fb8033040 con 0x55eff0549a70 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5f7effd640 1 -- 10.20.193.28:0/1559800001 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8038970 con 0x55eff0549a70 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/1559800001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff026ab60 con 0x55eff0549a70 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5f7effd640 1 -- 10.20.193.28:0/1559800001 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f5fb8038b50 con 0x55eff0549a70 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.080+0000 7f5fcd7ace00 10 client.19446 _ll_register_callbacks cb 0x55eff04470d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/1559800001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eff04a37f0 con 0x55eff0549a70 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5f7effd640 1 -- 10.20.193.28:0/1559800001 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5fb8038d50 con 0x55eff0549a70 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5fcd7ace00 10 client.19446 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/1559800001 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55eff0468430 con 0x55eff0549a70 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5f7effd640 1 -- 10.20.193.28:0/1559800001 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f5fb80040d0 con 0x55eff0549a70 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5fcd7ace00 10 client.19446 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:24.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5fcd7ace00 10 client.19446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:24.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5fcd7ace00 20 client.19446 populate_metadata read hostname 'trial028' 2026-02-20T03:29:24.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eff0571d40 0x55eff0574200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5fcd7ace00 4 client.19446 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:24.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.081+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/1559800001 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eff041dc00 con 0x55eff0571d40 2026-02-20T03:29:24.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.105+0000 7f5fc981d640 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eff0571d40 0x55eff0574200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.172+0000 7f5fc981d640 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eff0571d40 0x55eff0574200 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd712ad16ba308b1 server_cookie=b74ff96ce9c3a9bb in_seq=0 out_seq=0 2026-02-20T03:29:24.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.172+0000 7f5f7effd640 10 client.19446 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:24.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.199+0000 7f5f7effd640 1 -- 10.20.193.28:0/1559800001 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55eff041dc00 con 0x55eff0571d40 2026-02-20T03:29:24.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.199+0000 7f5f7effd640 10 client.19446 handle_command_reply: tid=0 2026-02-20T03:29:24.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.199+0000 7f5fcd7ace00 1 client.19446 shutdown 2026-02-20T03:29:24.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.199+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/1559800001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff0549a70 msgr2=0x55eff0563a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:24.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.199+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff0549a70 0x55eff0563a90 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009950 tx=0x7f5fb8005860 comp rx=0 tx=0).stop 2026-02-20T03:29:24.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.199+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/1559800001 shutdown_connections 2026-02-20T03:29:24.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.199+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eff0571d40 0x55eff0574200 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.200+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff054db60 0x55eff0561c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.200+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff0549a70 0x55eff0563a90 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.200+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/1559800001 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff05490c0 0x55eff0563550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.200+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/1559800001 >> 10.20.193.28:0/1559800001 conn(0x55eff0541b60 msgr2=0x55eff054c520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:24.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.200+0000 7f5f7effd640 0 client.19446 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:24.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.200+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/1559800001 shutdown_connections 2026-02-20T03:29:24.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.200+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/1559800001 wait complete. 2026-02-20T03:29:24.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.200+0000 7f5fcd7ace00 20 client.19446 trim_cache size 0 max 16384 2026-02-20T03:29:24.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.208+0000 7f5fcd7ace00 1 Processor -- start 2026-02-20T03:29:24.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.208+0000 7f5fcd7ace00 1 -- start start 2026-02-20T03:29:24.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0560c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff0549a70 0x55eff0579b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff054db60 0x55eff057a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5f70012740 con 0x55eff05490c0 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7000ffb0 con 0x55eff0549a70 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7000de00 con 0x55eff054db60 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fc981d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0560c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fc981d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0560c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51848/0 (socket says 10.20.193.28:51848) 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fc981d640 1 -- 10.20.193.28:0/3826356767 learned_addr learned my addr 10.20.193.28:0/3826356767 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fc981d640 1 -- 10.20.193.28:0/3826356767 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff054db60 msgr2=0x55eff057a050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fc981d640 1 --2- 10.20.193.28:0/3826356767 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff054db60 0x55eff057a050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fc981d640 1 -- 10.20.193.28:0/3826356767 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff0549a70 msgr2=0x55eff0579b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fc981d640 1 --2- 10.20.193.28:0/3826356767 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff0549a70 0x55eff0579b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fc981d640 1 -- 10.20.193.28:0/3826356767 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff055b510 con 0x55eff05490c0 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.209+0000 7f5fc981d640 1 --2- 10.20.193.28:0/3826356767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0560c00 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000b930 tx=0x7f5fc0004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fed1daf50c66a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5f914e4640 1 -- 10.20.193.28:0/3826356767 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0029070 con 0x55eff05490c0 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5f914e4640 1 -- 10.20.193.28:0/3826356767 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5fc0018040 con 0x55eff05490c0 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5f914e4640 1 -- 10.20.193.28:0/3826356767 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0017070 con 0x55eff05490c0 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3826356767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 msgr2=0x55eff0560c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3826356767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0560c00 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000b930 tx=0x7f5fc0004710 comp rx=0 tx=0).stop 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3826356767 shutdown_connections 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3826356767 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff054db60 0x55eff057a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3826356767 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff0549a70 0x55eff0579b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3826356767 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0560c00 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3826356767 >> 10.20.193.28:0/3826356767 conn(0x55eff0541b60 msgr2=0x55eff054df40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3826356767 shutdown_connections 2026-02-20T03:29:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.210+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3826356767 wait complete. 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fcd7ace00 1 -- start start 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fcd7ace00 1 Processor -- start 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0569360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff0549a70 0x55eff05698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fcd7ace00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff054db60 0x55eff05d62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7000e470 con 0x55eff05490c0 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7000f8e0 con 0x55eff054db60 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fcd7ace00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7000eb40 con 0x55eff0549a70 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fc981d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0569360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fc981d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0569360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51864/0 (socket says 10.20.193.28:51864) 2026-02-20T03:29:24.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.211+0000 7f5fc981d640 1 -- 10.20.193.28:0/3736104863 learned_addr learned my addr 10.20.193.28:0/3736104863 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fc981d640 1 -- 10.20.193.28:0/3736104863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff0549a70 msgr2=0x55eff05698a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fc981d640 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff0549a70 0x55eff05698a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fc981d640 1 -- 10.20.193.28:0/3736104863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff054db60 msgr2=0x55eff05d62d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fc981d640 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff054db60 0x55eff05d62d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fc981d640 1 -- 10.20.193.28:0/3736104863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eff017a900 con 0x55eff05490c0 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fc981d640 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0569360 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00047a0 tx=0x7f5fc00098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b32e102e60d7cd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5f7effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5f7effd640 1 -- 10.20.193.28:0/3736104863 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0029070 con 0x55eff05490c0 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5f7effd640 1 -- 10.20.193.28:0/3736104863 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5fc002b070 con 0x55eff05490c0 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5f7effd640 1 -- 10.20.193.28:0/3736104863 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0017040 con 0x55eff05490c0 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3736104863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eff04564d0 con 0x55eff05490c0 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5f7effd640 1 -- 10.20.193.28:0/3736104863 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f5fc0030470 con 0x55eff05490c0 2026-02-20T03:29:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fcd7ace00 10 client.19452 _ll_register_callbacks cb 0x7f5fb8009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3736104863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fc000bd50 con 0x55eff05490c0 2026-02-20T03:29:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5f7effd640 1 -- 10.20.193.28:0/3736104863 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5fc0024540 con 0x55eff05490c0 2026-02-20T03:29:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fcd7ace00 10 client.19452 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.212+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3736104863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55eff055c200 con 0x55eff05490c0 2026-02-20T03:29:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.213+0000 7f5f7effd640 1 -- 10.20.193.28:0/3736104863 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f5fc0023070 con 0x55eff05490c0 2026-02-20T03:29:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.213+0000 7f5fcd7ace00 10 client.19452 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.213+0000 7f5fcd7ace00 10 client.19452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.213+0000 7f5fcd7ace00 20 client.19452 populate_metadata read hostname 'trial028' 2026-02-20T03:29:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.213+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eff05ded70 0x55eff05e1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.213+0000 7f5fcd7ace00 4 client.19452 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:29:24.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.213+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3736104863 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55eff020ba20 con 0x55eff05ded70 2026-02-20T03:29:24.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.226+0000 7f5fc881b640 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eff05ded70 0x55eff05e1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.280+0000 7f5fc881b640 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eff05ded70 0x55eff05e1230 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6e1ba325f8a72e1 server_cookie=98ac63bad8dfed34 in_seq=0 out_seq=0 2026-02-20T03:29:24.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.280+0000 7f5f7effd640 10 client.19452 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:24.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.293+0000 7f5f7effd640 1 -- 10.20.193.28:0/3736104863 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55eff020ba20 con 0x55eff05ded70 2026-02-20T03:29:24.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.293+0000 7f5f7effd640 10 client.19452 handle_command_reply: tid=0 2026-02-20T03:29:24.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.293+0000 7f5fcd7ace00 1 client.19452 shutdown 2026-02-20T03:29:24.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.293+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3736104863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 msgr2=0x55eff0569360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:24.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.293+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0569360 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00047a0 tx=0x7f5fc00098b0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3736104863 shutdown_connections 2026-02-20T03:29:24.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55eff05ded70 0x55eff05e1230 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55eff054db60 0x55eff05d62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55eff0549a70 0x55eff05698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fcd7ace00 1 --2- 10.20.193.28:0/3736104863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55eff05490c0 0x55eff0569360 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3736104863 >> 10.20.193.28:0/3736104863 conn(0x55eff0541b60 msgr2=0x55eff054e760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:24.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5f7effd640 0 client.19452 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:24.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3736104863 shutdown_connections 2026-02-20T03:29:24.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fcd7ace00 1 -- 10.20.193.28:0/3736104863 wait complete. 2026-02-20T03:29:24.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fcd7ace00 20 client.19452 trim_cache size 0 max 16384 2026-02-20T03:29:24.298 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:29:24.298 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:29:24.298 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "0ca6ec02-646f-46b1-aef8-e0bf5ca144cd", 2026-02-20T03:29:24.299 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:29:24.299 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 -- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5fa00b0e20 msgr2=0x7f5fa00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5fa00b0e20 0x7f5fa00b32e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40a81c0 tx=0x7f5fb4009410 comp rx=0 tx=0).stop 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 -- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 msgr2=0x7f5fc419d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 0x7f5fc419d200 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400b570 tx=0x7f5fb400ba40 comp rx=0 tx=0).stop 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 -- 10.20.193.28:0/34473390 shutdown_connections 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5fa00b0e20 0x7f5fa00b32e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5fc410a980 0x7f5fc41a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5fc4105320 0x7f5fc419d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 --2- 10.20.193.28:0/34473390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5fc4104980 0x7f5fc419d200 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 -- 10.20.193.28:0/34473390 >> 10.20.193.28:0/34473390 conn(0x7f5fc4100680 msgr2=0x7f5fc4101120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:24.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.294+0000 7f5fca01e640 1 -- 10.20.193.28:0/34473390 shutdown_connections 2026-02-20T03:29:24.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.295+0000 7f5fca01e640 1 -- 10.20.193.28:0/34473390 wait complete. 2026-02-20T03:29:24.377 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:29:24.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 36.09 MB/sec warmup 55 sec latency 20722.626 ms 2026-02-20T03:29:24.727 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:24.845 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:29:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:29:24.360+0000 7ff740af4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000015 [...2,head] /volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL/ auth{1=1,2=1} v178266 ap=2 f(v4996 m2026-02-20T03:29:02.374825+0000 11=11+0) n(v68 rc2026-02-20T03:29:02.374825+0000 b2861056 12=11+1) (inest sync->mix g=1,2) caps={25141=pAsLsXsFs/pAsLsXsFsx@12202} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557551b7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000015:[<0x100000005e6/COREL v2262>,<0x100000005e5/~dmtmp v34>,<0x100000005e4/client0 v18>,<0x100000005e3/clients v8>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v28>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v37>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000015:[<0x100000005e6/COREL v178266>,<0x100000005e5/~dmtmp v60106>,<0x100000005e4/client0 v2099>,<0x100000005e3/clients v1258>,<0x100000005e2/tmp v1195>,<0x100000001fb/client.0 v1198>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v1208>,<0x10000000001/sv_1 v1209>,<0x10000000000/qa v1184>,<0x1/volumes v1125>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2026-02-20T03:29:01.622840+0000 15=15+0)","ondisk_value.rstat":"n(v0 rc2026-02-20T03:29:02.374825+0000 b2861056 12=11+1)","memory_value.dirstat":"f(v4996 m2026-02-20T03:29:02.374825+0000 11=11+0)","memory_value.rstat":"n(v68 rc2026-02-20T03:29:02.374825+0000 b2861056 12=11+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2026-02-20T03:29:24.845 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:29:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:29:24.361+0000 7ff740af4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000029 [...2,head] /volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX/ auth{1=1,2=1} v178263 ap=2 f(v7683 m2026-02-20T03:29:02.423824+0000 20=20+0) n(v67 rc2026-02-20T03:29:02.423824+0000 b5201920 21=20+1) (inest sync->mix g=1,2) caps={25141=pAsLsXsFs/pAsLsXsFsx@21743} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557551c2bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000029:[<0x100000005e6/PARADOX v2552>,<0x100000005e5/~dmtmp v34>,<0x100000005e4/client0 v18>,<0x100000005e3/clients v8>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v28>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v37>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000029:[<0x100000005e6/PARADOX v178263>,<0x100000005e5/~dmtmp v60106>,<0x100000005e4/client0 v2099>,<0x100000005e3/clients v1258>,<0x100000005e2/tmp v1195>,<0x100000001fb/client.0 v1198>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v1208>,<0x10000000001/sv_1 v1209>,<0x10000000000/qa v1184>,<0x1/volumes v1125>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2026-02-20T03:29:00.768858+0000 24=24+0)","ondisk_value.rstat":"n(v0 rc2026-02-20T03:29:02.423824+0000 b5201920 21=20+1)","memory_value.dirstat":"f(v7683 m2026-02-20T03:29:02.423824+0000 20=20+0)","memory_value.rstat":"n(v67 rc2026-02-20T03:29:02.423824+0000 b5201920 21=20+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2026-02-20T03:29:24.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 -- 10.20.193.28:0/2028506514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 msgr2=0x7f707c105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:24.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 --2- 10.20.193.28:0/2028506514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 0x7f707c105180 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f7074009a30 tx=0x7f707402f260 comp rx=0 tx=0).stop 2026-02-20T03:29:24.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 -- 10.20.193.28:0/2028506514 shutdown_connections 2026-02-20T03:29:24.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 --2- 10.20.193.28:0/2028506514 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f707c109ed0 0x7f707c111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 --2- 10.20.193.28:0/2028506514 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f707c105750 0x7f707c1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 --2- 10.20.193.28:0/2028506514 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 0x7f707c105180 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 -- 10.20.193.28:0/2028506514 >> 10.20.193.28:0/2028506514 conn(0x7f707c100840 msgr2=0x7f707c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:24.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 -- 10.20.193.28:0/2028506514 shutdown_connections 2026-02-20T03:29:24.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 -- 10.20.193.28:0/2028506514 wait complete. 2026-02-20T03:29:24.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.971+0000 7f7084946640 1 Processor -- start 2026-02-20T03:29:24.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f7084946640 1 -- start start 2026-02-20T03:29:24.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f7084946640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 0x7f707c19d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f7084946640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f707c105750 0x7f707c19d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f7084946640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f707c109ed0 0x7f707c1a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f7084946640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f707c114e80 con 0x7f707c104da0 2026-02-20T03:29:24.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f7084946640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f707c114d00 con 0x7f707c109ed0 2026-02-20T03:29:24.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f7084946640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f707c115000 con 0x7f707c105750 2026-02-20T03:29:24.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f70826bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 0x7f707c19d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f70826bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 0x7f707c19d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51878/0 (socket says 10.20.193.28:51878) 2026-02-20T03:29:24.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f70826bb640 1 -- 10.20.193.28:0/3880501038 learned_addr learned my addr 10.20.193.28:0/3880501038 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:24.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f70826bb640 1 -- 10.20.193.28:0/3880501038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f707c105750 msgr2=0x7f707c19d870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:24.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f70826bb640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f707c105750 0x7f707c19d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f70826bb640 1 -- 10.20.193.28:0/3880501038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f707c109ed0 msgr2=0x7f707c1a1c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:24.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f70826bb640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f707c109ed0 0x7f707c1a1c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f70826bb640 1 -- 10.20.193.28:0/3880501038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c1a2380 con 0x7f707c104da0 2026-02-20T03:29:24.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.972+0000 7f70826bb640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 0x7f707c19d330 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7074009950 tx=0x7f7074002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.973+0000 7f70677fe640 1 -- 10.20.193.28:0/3880501038 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074002a00 con 0x7f707c104da0 2026-02-20T03:29:24.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.973+0000 7f70677fe640 1 -- 10.20.193.28:0/3880501038 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7074005030 con 0x7f707c104da0 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.973+0000 7f70677fe640 1 -- 10.20.193.28:0/3880501038 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074004d80 con 0x7f707c104da0 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.973+0000 7f7084946640 1 -- 10.20.193.28:0/3880501038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707c1a2610 con 0x7f707c104da0 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.973+0000 7f7084946640 1 -- 10.20.193.28:0/3880501038 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707c1a9eb0 con 0x7f707c104da0 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.975+0000 7f70677fe640 1 -- 10.20.193.28:0/3880501038 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f70740051e0 con 0x7f707c104da0 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7086e4be00 1 Processor -- start 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7086e4be00 1 -- start start 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648dd2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2fe0 0x55a648dd69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 0x55a648ddeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7086e4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a648d52e50 con 0x55a648dd2630 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7086e4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a648d259c0 con 0x55a648dd7120 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7086e4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a648cd3240 con 0x55a648dd2fe0 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f70677fe640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70580b0e20 0x7f70580b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f70677fe640 1 -- 10.20.193.28:0/3880501038 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f70741053b0 con 0x7f707c104da0 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7082ebc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648dd2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7082ebc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648dd2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51882/0 (socket says 10.20.193.28:51882) 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7082ebc640 1 -- 10.20.193.28:0/4162926574 learned_addr learned my addr 10.20.193.28:0/4162926574 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.977+0000 7f7082ebc640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70580b0e20 0x7f70580b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7082ebc640 1 -- 10.20.193.28:0/4162926574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2fe0 msgr2=0x55a648dd69f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7082ebc640 1 --2- 10.20.193.28:0/4162926574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2fe0 0x55a648dd69f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7082ebc640 1 -- 10.20.193.28:0/4162926574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 msgr2=0x55a648ddeca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7082ebc640 1 --2- 10.20.193.28:0/4162926574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 0x55a648ddeca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7082ebc640 1 -- 10.20.193.28:0/4162926574 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a648ce6420 con 0x55a648dd2630 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7082ebc640 1 --2- 10.20.193.28:0/4162926574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648dd2a10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7070013a50 tx=0x7f7070013f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83efb7d4ce5f33cd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7082ebc640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70580b0e20 0x7f70580b32e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7070015760 tx=0x7f707000c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7064ff9640 1 -- 10.20.193.28:0/4162926574 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70700040f0 con 0x55a648dd2630 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7064ff9640 1 -- 10.20.193.28:0/4162926574 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7070004730 con 0x55a648dd2630 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7064ff9640 1 -- 10.20.193.28:0/4162926574 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070006510 con 0x55a648dd2630 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7086e4be00 1 -- 10.20.193.28:0/4162926574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 msgr2=0x55a648dd2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.978+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4162926574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648dd2a10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7070013a50 tx=0x7f7070013f20 comp rx=0 tx=0).stop 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.979+0000 7f7086e4be00 1 -- 10.20.193.28:0/4162926574 shutdown_connections 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.979+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4162926574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 0x55a648ddeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.979+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4162926574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2fe0 0x55a648dd69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.979+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4162926574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648dd2a10 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.979+0000 7f7086e4be00 1 -- 10.20.193.28:0/4162926574 >> 10.20.193.28:0/4162926574 conn(0x55a648d95290 msgr2=0x55a648dd0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.979+0000 7f7086e4be00 1 -- 10.20.193.28:0/4162926574 shutdown_connections 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.979+0000 7f7086e4be00 1 -- 10.20.193.28:0/4162926574 wait complete. 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.980+0000 7f7086e4be00 1 -- start start 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.980+0000 7f7086e4be00 1 Processor -- start 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648deca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2fe0 0x55a648decfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 0x55a648deb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f7086e4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a648d218f0 con 0x55a648dd2630 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f7086e4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a648b13f50 con 0x55a648dd7120 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f7086e4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a648deb950 con 0x55a648dd2fe0 2026-02-20T03:29:24.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f70826bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648deca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:24.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f70826bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648deca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51888/0 (socket says 10.20.193.28:51888) 2026-02-20T03:29:24.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f70826bb640 1 -- 10.20.193.28:0/4053280907 learned_addr learned my addr 10.20.193.28:0/4053280907 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:24.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f70826bb640 1 -- 10.20.193.28:0/4053280907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2fe0 msgr2=0x55a648decfd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f70826bb640 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2fe0 0x55a648decfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f70826bb640 1 -- 10.20.193.28:0/4053280907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 msgr2=0x55a648deb1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:24.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f70826bb640 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 0x55a648deb1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:24.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f70826bb640 1 -- 10.20.193.28:0/4053280907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a648de4940 con 0x55a648dd2630 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f70826bb640 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648deca90 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f7074005520 tx=0x7f707402fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f6a97eda0cbdd6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f702ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f702ffff640 1 -- 10.20.193.28:0/4053280907 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70740cd790 con 0x55a648dd2630 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f702ffff640 1 -- 10.20.193.28:0/4053280907 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7074033020 con 0x55a648dd2630 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f702ffff640 1 -- 10.20.193.28:0/4053280907 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70740cc0a0 con 0x55a648dd2630 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.981+0000 7f7086e4be00 1 -- 10.20.193.28:0/4053280907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a648af6b40 con 0x55a648dd2630 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f702ffff640 1 -- 10.20.193.28:0/4053280907 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f70740d1100 con 0x55a648dd2630 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 10 client.19464 _ll_register_callbacks cb 0x55a648d5ef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 1 -- 10.20.193.28:0/4053280907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a648d331a0 con 0x55a648dd2630 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f702ffff640 1 -- 10.20.193.28:0/4053280907 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f70740d62f0 con 0x55a648dd2630 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 10 client.19464 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:24.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 1 -- 10.20.193.28:0/4053280907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55a648ce0230 con 0x55a648dd2630 2026-02-20T03:29:24.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f702ffff640 1 -- 10.20.193.28:0/4053280907 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f70740cc240 con 0x55a648dd2630 2026-02-20T03:29:24.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 10 client.19464 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:24.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 10 client.19464 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:24.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 20 client.19464 populate_metadata read hostname 'trial028' 2026-02-20T03:29:24.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a648dfb2d0 0x55a648dfd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:24.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 4 client.19464 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:24.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:24.982+0000 7f7086e4be00 1 -- 10.20.193.28:0/4053280907 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a648d2d5b0 con 0x55a648dfb2d0 2026-02-20T03:29:25.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.006+0000 7f7081eba640 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a648dfb2d0 0x55a648dfd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.072+0000 7f7081eba640 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a648dfb2d0 0x55a648dfd790 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f790c7fea6351cca server_cookie=adae69e5f49e0dd4 in_seq=0 out_seq=0 2026-02-20T03:29:25.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.072+0000 7f702ffff640 10 client.19464 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:25.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f702ffff640 1 -- 10.20.193.28:0/4053280907 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a648d2d5b0 con 0x55a648dfb2d0 2026-02-20T03:29:25.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f702ffff640 10 client.19464 handle_command_reply: tid=0 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 client.19464 shutdown 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 -- 10.20.193.28:0/4053280907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 msgr2=0x55a648deca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648deca90 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f7074005520 tx=0x7f707402fee0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 -- 10.20.193.28:0/4053280907 shutdown_connections 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a648dfb2d0 0x55a648dfd790 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 0x55a648deb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2fe0 0x55a648decfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 --2- 10.20.193.28:0/4053280907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648deca90 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 -- 10.20.193.28:0/4053280907 >> 10.20.193.28:0/4053280907 conn(0x55a648d95290 msgr2=0x55a648dd5940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:25.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f702ffff640 0 client.19464 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:25.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 -- 10.20.193.28:0/4053280907 shutdown_connections 2026-02-20T03:29:25.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.099+0000 7f7086e4be00 1 -- 10.20.193.28:0/4053280907 wait complete. 2026-02-20T03:29:25.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.100+0000 7f7086e4be00 20 client.19464 trim_cache size 0 max 16384 2026-02-20T03:29:25.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.108+0000 7f7086e4be00 1 Processor -- start 2026-02-20T03:29:25.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.108+0000 7f7086e4be00 1 -- start start 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.108+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2630 0x55a648de8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.108+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2fe0 0x55a648de8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.108+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 0x55a648e030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.108+0000 7f7086e4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7024012660 con 0x55a648dd2fe0 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.108+0000 7f7086e4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f702400fed0 con 0x55a648dd7120 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.108+0000 7f7086e4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f702400dd20 con 0x55a648dd2630 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f7081eba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2fe0 0x55a648de8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f7081eba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2fe0 0x55a648de8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51898/0 (socket says 10.20.193.28:51898) 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f7081eba640 1 -- 10.20.193.28:0/219552289 learned_addr learned my addr 10.20.193.28:0/219552289 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f7081eba640 1 -- 10.20.193.28:0/219552289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2630 msgr2=0x55a648de8760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f7081eba640 1 --2- 10.20.193.28:0/219552289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2630 0x55a648de8760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f7081eba640 1 -- 10.20.193.28:0/219552289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 msgr2=0x55a648e030a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f7081eba640 1 --2- 10.20.193.28:0/219552289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 0x55a648e030a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f7081eba640 1 -- 10.20.193.28:0/219552289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a648de4770 con 0x55a648dd2fe0 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f7081eba640 1 --2- 10.20.193.28:0/219552289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2fe0 0x55a648de8ca0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7068009590 tx=0x7f70680047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db740f1b534ae20b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f704a4e6640 1 -- 10.20.193.28:0/219552289 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706801e070 con 0x55a648dd2fe0 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f704a4e6640 1 -- 10.20.193.28:0/219552289 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7068002e40 con 0x55a648dd2fe0 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.109+0000 7f704a4e6640 1 -- 10.20.193.28:0/219552289 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068015040 con 0x55a648dd2fe0 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 -- 10.20.193.28:0/219552289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2fe0 msgr2=0x55a648de8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 --2- 10.20.193.28:0/219552289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2fe0 0x55a648de8ca0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7068009590 tx=0x7f70680047e0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 -- 10.20.193.28:0/219552289 shutdown_connections 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 --2- 10.20.193.28:0/219552289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd7120 0x55a648e030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 --2- 10.20.193.28:0/219552289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2fe0 0x55a648de8ca0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 --2- 10.20.193.28:0/219552289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd2630 0x55a648de8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 -- 10.20.193.28:0/219552289 >> 10.20.193.28:0/219552289 conn(0x55a648d95290 msgr2=0x55a648dea230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:25.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 -- 10.20.193.28:0/219552289 shutdown_connections 2026-02-20T03:29:25.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 -- 10.20.193.28:0/219552289 wait complete. 2026-02-20T03:29:25.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 -- start start 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.110+0000 7f7086e4be00 1 Processor -- start 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648df5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd2fe0 0x55a648df3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f7086e4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd7120 0x55a648df3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f7086e4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f702400e390 con 0x55a648dd2630 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f7086e4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f702400f800 con 0x55a648dd2fe0 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f7086e4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f702400ea60 con 0x55a648dd7120 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f70826bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648df5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f70826bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648df5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51904/0 (socket says 10.20.193.28:51904) 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f70826bb640 1 -- 10.20.193.28:0/2771274907 learned_addr learned my addr 10.20.193.28:0/2771274907 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f70826bb640 1 -- 10.20.193.28:0/2771274907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd7120 msgr2=0x55a648df3850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:25.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f70826bb640 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd7120 0x55a648df3850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f70826bb640 1 -- 10.20.193.28:0/2771274907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd2fe0 msgr2=0x55a648df3310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f70826bb640 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd2fe0 0x55a648df3310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f70826bb640 1 -- 10.20.193.28:0/2771274907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a648a04870 con 0x55a648dd2630 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f70826bb640 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648df5ff0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f70740ccd40 tx=0x55a648d8efa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd559b9b89636371 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f702ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f702ffff640 1 -- 10.20.193.28:0/2771274907 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70740cd790 con 0x55a648dd2630 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f702ffff640 1 -- 10.20.193.28:0/2771274907 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7074033050 con 0x55a648dd2630 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.111+0000 7f702ffff640 1 -- 10.20.193.28:0/2771274907 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70740cc300 con 0x55a648dd2630 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 1 -- 10.20.193.28:0/2771274907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a648cc5440 con 0x55a648dd2630 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 10 client.19470 _ll_register_callbacks cb 0x7f7074005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 1 -- 10.20.193.28:0/2771274907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a648cd7b00 con 0x55a648dd2630 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f702ffff640 1 -- 10.20.193.28:0/2771274907 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f7074102aa0 con 0x55a648dd2630 2026-02-20T03:29:25.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f702ffff640 1 -- 10.20.193.28:0/2771274907 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f70740b9380 con 0x55a648dd2630 2026-02-20T03:29:25.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 10 client.19470 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:25.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 1 -- 10.20.193.28:0/2771274907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55a648de5460 con 0x55a648dd2630 2026-02-20T03:29:25.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f702ffff640 1 -- 10.20.193.28:0/2771274907 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f70740efb30 con 0x55a648dd2630 2026-02-20T03:29:25.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 10 client.19470 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:25.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 10 client.19470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:25.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 20 client.19470 populate_metadata read hostname 'trial028' 2026-02-20T03:29:25.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a648e707d0 0x55a648e72c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:25.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 4 client.19470 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:29:25.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.112+0000 7f7086e4be00 1 -- 10.20.193.28:0/2771274907 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a648dd1e50 con 0x55a648e707d0 2026-02-20T03:29:25.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.139+0000 7f7081eba640 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a648e707d0 0x55a648e72c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:25.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.179+0000 7f7081eba640 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a648e707d0 0x55a648e72c90 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5981c24b4628db1 server_cookie=218308adbd51f053 in_seq=0 out_seq=0 2026-02-20T03:29:25.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.179+0000 7f702ffff640 10 client.19470 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:25.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f702ffff640 1 -- 10.20.193.28:0/2771274907 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a648dd1e50 con 0x55a648e707d0 2026-02-20T03:29:25.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f702ffff640 10 client.19470 handle_command_reply: tid=0 2026-02-20T03:29:25.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 client.19470 shutdown 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 -- 10.20.193.28:0/2771274907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 msgr2=0x55a648df5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648df5ff0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f70740ccd40 tx=0x55a648d8efa0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 -- 10.20.193.28:0/2771274907 shutdown_connections 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a648e707d0 0x55a648e72c90 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a648dd7120 0x55a648df3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a648dd2fe0 0x55a648df3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 --2- 10.20.193.28:0/2771274907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a648dd2630 0x55a648df5ff0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f702ffff640 0 client.19470 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 -- 10.20.193.28:0/2771274907 >> 10.20.193.28:0/2771274907 conn(0x55a648d95290 msgr2=0x55a648def8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 -- 10.20.193.28:0/2771274907 shutdown_connections 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 1 -- 10.20.193.28:0/2771274907 wait complete. 2026-02-20T03:29:25.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.193+0000 7f7086e4be00 20 client.19470 trim_cache size 0 max 16384 2026-02-20T03:29:25.209 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:29:25.209 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:29:25.209 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:29:25.209 INFO:teuthology.orchestra.run.trial028.stdout: "0ca6ec02-646f-46b1-aef8-e0bf5ca144cd": { 2026-02-20T03:29:25.209 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:29:25.209 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "0ca6ec02-646f-46b1-aef8-e0bf5ca144cd", 2026-02-20T03:29:25.209 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:29:25.209 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:29:25.209 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:29:25.210 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:29:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 -- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70580b0e20 msgr2=0x7f70580b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70580b0e20 0x7f70580b32e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7070015760 tx=0x7f707000c000 comp rx=0 tx=0).stop 2026-02-20T03:29:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 -- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 msgr2=0x7f707c19d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 0x7f707c19d330 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7074009950 tx=0x7f7074002910 comp rx=0 tx=0).stop 2026-02-20T03:29:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 -- 10.20.193.28:0/3880501038 shutdown_connections 2026-02-20T03:29:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70580b0e20 0x7f70580b32e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f707c109ed0 0x7f707c1a1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f707c105750 0x7f707c19d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 --2- 10.20.193.28:0/3880501038 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f707c104da0 0x7f707c19d330 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 -- 10.20.193.28:0/3880501038 >> 10.20.193.28:0/3880501038 conn(0x7f707c100840 msgr2=0x7f707c101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 -- 10.20.193.28:0/3880501038 shutdown_connections 2026-02-20T03:29:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:25.194+0000 7f7084946640 1 -- 10.20.193.28:0/3880501038 wait complete. 2026-02-20T03:29:25.286 INFO:tasks.cephfs.filesystem:scrub status for tag:0ca6ec02-646f-46b1-aef8-e0bf5ca144cd - {'path': '/', 'tag': '0ca6ec02-646f-46b1-aef8-e0bf5ca144cd', 'options': 'recursive,force'} 2026-02-20T03:29:25.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: pgmap v625: 129 pgs: 129 active+clean; 474 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 390 KiB/s rd, 8.0 MiB/s wr, 435 op/s 2026-02-20T03:29:25.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:29:25.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:25.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:29:25.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:29:25.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:29:25.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: Scrub error on inode 0x10000000015 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2026-02-20T03:29:25.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:29:25.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:25.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:25 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:25.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: pgmap v625: 129 pgs: 129 active+clean; 474 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 390 KiB/s rd, 8.0 MiB/s wr, 435 op/s 2026-02-20T03:29:25.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:29:25.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:29:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:29:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:29:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: Scrub error on inode 0x10000000015 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2026-02-20T03:29:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:29:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:25.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:25 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:25.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 35.45 MB/sec warmup 56 sec latency 21722.660 ms 2026-02-20T03:29:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: pgmap v625: 129 pgs: 129 active+clean; 474 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 390 KiB/s rd, 8.0 MiB/s wr, 435 op/s 2026-02-20T03:29:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:29:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:29:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:29:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:29:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: Scrub error on inode 0x10000000015 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2026-02-20T03:29:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:29:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:25 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:26.369 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:26 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:26.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:26 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:26.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 34.82 MB/sec warmup 57 sec latency 22722.695 ms 2026-02-20T03:29:26.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:26 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:29:27.526 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:27 trial028 ceph-mon[38552]: pgmap v626: 129 pgs: 129 active+clean; 489 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 339 KiB/s rd, 7.8 MiB/s wr, 442 op/s 2026-02-20T03:29:27.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:27 trial126 ceph-mon[38476]: pgmap v626: 129 pgs: 129 active+clean; 489 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 339 KiB/s rd, 7.8 MiB/s wr, 442 op/s 2026-02-20T03:29:27.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 34.22 MB/sec warmup 58 sec latency 23722.738 ms 2026-02-20T03:29:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:27 trial177 ceph-mon[43181]: pgmap v626: 129 pgs: 129 active+clean; 489 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 339 KiB/s rd, 7.8 MiB/s wr, 442 op/s 2026-02-20T03:29:28.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 33.64 MB/sec warmup 59 sec latency 24722.774 ms 2026-02-20T03:29:29.398 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:29 trial028 ceph-mon[38552]: pgmap v627: 129 pgs: 129 active+clean; 501 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 313 KiB/s rd, 7.2 MiB/s wr, 369 op/s 2026-02-20T03:29:29.696 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 33.08 MB/sec warmup 60 sec latency 25722.812 ms 2026-02-20T03:29:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:29 trial177 ceph-mon[43181]: pgmap v627: 129 pgs: 129 active+clean; 501 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 313 KiB/s rd, 7.2 MiB/s wr, 369 op/s 2026-02-20T03:29:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:29 trial126 ceph-mon[38476]: pgmap v627: 129 pgs: 129 active+clean; 501 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 313 KiB/s rd, 7.2 MiB/s wr, 369 op/s 2026-02-20T03:29:30.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 32.54 MB/sec warmup 61 sec latency 26722.853 ms 2026-02-20T03:29:31.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:31 trial028 ceph-mon[38552]: pgmap v628: 129 pgs: 129 active+clean; 520 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 96 KiB/s rd, 7.1 MiB/s wr, 304 op/s 2026-02-20T03:29:31.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 32.02 MB/sec warmup 62 sec latency 27722.898 ms 2026-02-20T03:29:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:31 trial177 ceph-mon[43181]: pgmap v628: 129 pgs: 129 active+clean; 520 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 96 KiB/s rd, 7.1 MiB/s wr, 304 op/s 2026-02-20T03:29:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:31 trial126 ceph-mon[38476]: pgmap v628: 129 pgs: 129 active+clean; 520 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 96 KiB/s rd, 7.1 MiB/s wr, 304 op/s 2026-02-20T03:29:32.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- 10.20.193.28:0/339045629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334105b30 msgr2=0x7f3334105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:32.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 --2- 10.20.193.28:0/339045629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334105b30 0x7f3334105fb0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f331c009a30 tx=0x7f331c02f220 comp rx=0 tx=0).stop 2026-02-20T03:29:32.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- 10.20.193.28:0/339045629 shutdown_connections 2026-02-20T03:29:32.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 --2- 10.20.193.28:0/339045629 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f33341064f0 0x7f333410cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 --2- 10.20.193.28:0/339045629 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334105b30 0x7f3334105fb0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.003 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 --2- 10.20.193.28:0/339045629 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3334104940 0x7f3334104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- 10.20.193.28:0/339045629 >> 10.20.193.28:0/339045629 conn(0x7f33341000c0 msgr2=0x7f33341024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:32.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- 10.20.193.28:0/339045629 shutdown_connections 2026-02-20T03:29:32.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- 10.20.193.28:0/339045629 wait complete. 2026-02-20T03:29:32.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 Processor -- start 2026-02-20T03:29:32.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- start start 2026-02-20T03:29:32.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334104940 0x7f333419cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3334105b30 0x7f333419d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33341064f0 0x7f33341a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3334110530 con 0x7f3334104940 2026-02-20T03:29:32.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f33341103b0 con 0x7f33341064f0 2026-02-20T03:29:32.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f33341106b0 con 0x7f3334105b30 2026-02-20T03:29:32.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3338e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334104940 0x7f333419cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:32.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3338e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334104940 0x7f333419cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54334/0 (socket says 10.20.193.28:54334) 2026-02-20T03:29:32.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3338e42640 1 -- 10.20.193.28:0/977459529 learned_addr learned my addr 10.20.193.28:0/977459529 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:32.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3338e42640 1 -- 10.20.193.28:0/977459529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3334105b30 msgr2=0x7f333419d110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:32.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3338e42640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3334105b30 0x7f333419d110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3338e42640 1 -- 10.20.193.28:0/977459529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33341064f0 msgr2=0x7f33341a4180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3338e42640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33341064f0 0x7f33341a4180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3338e42640 1 -- 10.20.193.28:0/977459529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33341a4880 con 0x7f3334104940 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3338e42640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334104940 0x7f333419cbd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f332400b570 tx=0x7f332400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3329ffb640 1 -- 10.20.193.28:0/977459529 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324013020 con 0x7f3334104940 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3329ffb640 1 -- 10.20.193.28:0/977459529 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3324004480 con 0x7f3334104940 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- 10.20.193.28:0/977459529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33341a4b70 con 0x7f3334104940 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3329ffb640 1 -- 10.20.193.28:0/977459529 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332400fbb0 con 0x7f3334104940 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.000+0000 7f3339e44640 1 -- 10.20.193.28:0/977459529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33341a5110 con 0x7f3334104940 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3329ffb640 1 -- 10.20.193.28:0/977459529 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f33240026e0 con 0x7f3334104940 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f333e010e00 1 Processor -- start 2026-02-20T03:29:32.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f333e010e00 1 -- start start 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f333e010e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c5e80 0x55da7d0c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f333e010e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c67c0 0x55da7d0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f333e010e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0cb560 0x55da7d0cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f333e010e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55da7d0168f0 con 0x55da7d0c67c0 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f333e010e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55da7cfc42e0 con 0x55da7d0cb560 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f333e010e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55da7d012820 con 0x55da7d0c5e80 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3338e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c67c0 0x55da7d0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3338e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c67c0 0x55da7d0caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54350/0 (socket says 10.20.193.28:54350) 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3338e42640 1 -- 10.20.193.28:0/1303096650 learned_addr learned my addr 10.20.193.28:0/1303096650 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3338e42640 1 -- 10.20.193.28:0/1303096650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c5e80 msgr2=0x55da7d0c6280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:32.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3338e42640 1 --2- 10.20.193.28:0/1303096650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c5e80 0x55da7d0c6280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3338e42640 1 -- 10.20.193.28:0/1303096650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0cb560 msgr2=0x55da7d0cd9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:32.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3338e42640 1 --2- 10.20.193.28:0/1303096650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0cb560 0x55da7d0cd9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3338e42640 1 -- 10.20.193.28:0/1303096650 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da7cfb65a0 con 0x55da7d0c67c0 2026-02-20T03:29:32.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3338e42640 1 --2- 10.20.193.28:0/1303096650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c67c0 0x55da7d0caf40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f33240e6750 tx=0x7f33240e6c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eab194c8b692f60 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:32.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f33013fe640 1 -- 10.20.193.28:0/1303096650 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240f3070 con 0x55da7d0c67c0 2026-02-20T03:29:32.017 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f33013fe640 1 -- 10.20.193.28:0/1303096650 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f33240e0d70 con 0x55da7d0c67c0 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f33013fe640 1 -- 10.20.193.28:0/1303096650 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240e8c00 con 0x55da7d0c67c0 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.006+0000 7f3329ffb640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33100b0e20 0x7f33100b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 -- 10.20.193.28:0/1303096650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c67c0 msgr2=0x55da7d0caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 --2- 10.20.193.28:0/1303096650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c67c0 0x55da7d0caf40 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f33240e6750 tx=0x7f33240e6c20 comp rx=0 tx=0).stop 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3329ffb640 1 -- 10.20.193.28:0/977459529 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f33240e0570 con 0x7f3334104940 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3339643640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33100b0e20 0x7f33100b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 -- 10.20.193.28:0/1303096650 shutdown_connections 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 --2- 10.20.193.28:0/1303096650 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0cb560 0x55da7d0cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 --2- 10.20.193.28:0/1303096650 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c67c0 0x55da7d0caf40 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.018 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 --2- 10.20.193.28:0/1303096650 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c5e80 0x55da7d0c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 -- 10.20.193.28:0/1303096650 >> 10.20.193.28:0/1303096650 conn(0x55da7d0bd6f0 msgr2=0x55da7d0c4570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 -- 10.20.193.28:0/1303096650 shutdown_connections 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 -- 10.20.193.28:0/1303096650 wait complete. 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3339643640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33100b0e20 0x7f33100b32e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f333000aa90 tx=0x7f3330009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 -- start start 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 Processor -- start 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c67c0 0x55da7d0defc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0cb560 0x55da7d0e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55da7cfbe0c0 con 0x55da7d0c5e80 2026-02-20T03:29:32.019 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55da7d0ce610 con 0x55da7d0cb560 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f333e010e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55da7d0e64d0 con 0x55da7d0c67c0 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3338e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3338e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54354/0 (socket says 10.20.193.28:54354) 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3338e42640 1 -- 10.20.193.28:0/3882011523 learned_addr learned my addr 10.20.193.28:0/3882011523 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3338e42640 1 -- 10.20.193.28:0/3882011523 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c67c0 msgr2=0x55da7d0defc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3338e42640 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c67c0 0x55da7d0defc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3338e42640 1 -- 10.20.193.28:0/3882011523 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0cb560 msgr2=0x55da7d0e5f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3338e42640 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0cb560 0x55da7d0e5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3338e42640 1 -- 10.20.193.28:0/3882011523 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da7d0d81d0 con 0x55da7d0c5e80 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f3338e42640 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dea80 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f33240a81e0 tx=0x7f332400f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4e666b5714665a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.008+0000 7f32f27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:32.020 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f32f27fc640 1 -- 10.20.193.28:0/3882011523 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240a3ec0 con 0x55da7d0c5e80 2026-02-20T03:29:32.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f32f27fc640 1 -- 10.20.193.28:0/3882011523 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f332401f300 con 0x55da7d0c5e80 2026-02-20T03:29:32.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f32f27fc640 1 -- 10.20.193.28:0/3882011523 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240a7770 con 0x55da7d0c5e80 2026-02-20T03:29:32.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 1 -- 10.20.193.28:0/3882011523 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da7cfd2820 con 0x55da7d0c5e80 2026-02-20T03:29:32.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f32f27fc640 1 -- 10.20.193.28:0/3882011523 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f3324002a00 con 0x55da7d0c5e80 2026-02-20T03:29:32.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 10 client.19482 _ll_register_callbacks cb 0x55da7cfc1ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:32.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 1 -- 10.20.193.28:0/3882011523 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55da7d01e4e0 con 0x55da7d0c5e80 2026-02-20T03:29:32.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f32f27fc640 1 -- 10.20.193.28:0/3882011523 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f33240a7950 con 0x55da7d0c5e80 2026-02-20T03:29:32.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 10 client.19482 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:32.021 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 1 -- 10.20.193.28:0/3882011523 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55da7cfd7380 con 0x55da7d0c5e80 2026-02-20T03:29:32.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f32f27fc640 1 -- 10.20.193.28:0/3882011523 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f33240e0190 con 0x55da7d0c5e80 2026-02-20T03:29:32.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 10 client.19482 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:32.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 10 client.19482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:32.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 20 client.19482 populate_metadata read hostname 'trial028' 2026-02-20T03:29:32.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55da7d0ea2b0 0x55da7d0ec740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 4 client.19482 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:32.022 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.011+0000 7f333e010e00 1 -- 10.20.193.28:0/3882011523 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da7cf98bd0 con 0x55da7d0ea2b0 2026-02-20T03:29:32.028 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.026+0000 7f332bfff640 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55da7d0ea2b0 0x55da7d0ec740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:32.055 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.053+0000 7f332bfff640 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55da7d0ea2b0 0x55da7d0ec740 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd4a89cc9c132fbd server_cookie=eff776fd7f6fe60f in_seq=0 out_seq=0 2026-02-20T03:29:32.055 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.053+0000 7f32f27fc640 10 client.19482 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:32.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f32f27fc640 1 -- 10.20.193.28:0/3882011523 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55da7cf98bd0 con 0x55da7d0ea2b0 2026-02-20T03:29:32.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f32f27fc640 10 client.19482 handle_command_reply: tid=0 2026-02-20T03:29:32.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 client.19482 shutdown 2026-02-20T03:29:32.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 -- 10.20.193.28:0/3882011523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 msgr2=0x55da7d0dea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:32.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dea80 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f33240a81e0 tx=0x7f332400f5d0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 -- 10.20.193.28:0/3882011523 shutdown_connections 2026-02-20T03:29:32.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55da7d0ea2b0 0x55da7d0ec740 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0cb560 0x55da7d0e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c67c0 0x55da7d0defc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 --2- 10.20.193.28:0/3882011523 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dea80 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 -- 10.20.193.28:0/3882011523 >> 10.20.193.28:0/3882011523 conn(0x55da7d0bd6f0 msgr2=0x55da7d0cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f32f27fc640 0 client.19482 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 -- 10.20.193.28:0/3882011523 shutdown_connections 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 1 -- 10.20.193.28:0/3882011523 wait complete. 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.068+0000 7f333e010e00 20 client.19482 trim_cache size 0 max 16384 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 Processor -- start 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 -- start start 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0c67c0 0x55da7d0e5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0cb560 0x55da7d0de870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f32d80126b0 con 0x55da7d0c5e80 2026-02-20T03:29:32.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800ff20 con 0x55da7d0c67c0 2026-02-20T03:29:32.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800dd70 con 0x55da7d0cb560 2026-02-20T03:29:32.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3338e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:32.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3338e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54364/0 (socket says 10.20.193.28:54364) 2026-02-20T03:29:32.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3338e42640 1 -- 10.20.193.28:0/1146719282 learned_addr learned my addr 10.20.193.28:0/1146719282 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:32.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3338e42640 1 -- 10.20.193.28:0/1146719282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0cb560 msgr2=0x55da7d0de870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3338e42640 1 --2- 10.20.193.28:0/1146719282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0cb560 0x55da7d0de870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3338e42640 1 -- 10.20.193.28:0/1146719282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0c67c0 msgr2=0x55da7d0e5f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3338e42640 1 --2- 10.20.193.28:0/1146719282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0c67c0 0x55da7d0e5f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3338e42640 1 -- 10.20.193.28:0/1146719282 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da7d0d8000 con 0x55da7d0c5e80 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3338e42640 1 --2- 10.20.193.28:0/1146719282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dc2f0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f33240a45a0 tx=0x7f33240e8070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327d8e30d80ee441 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3300bfd640 1 -- 10.20.193.28:0/1146719282 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240a8020 con 0x55da7d0c5e80 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3300bfd640 1 -- 10.20.193.28:0/1146719282 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55da7d01e4e0 con 0x55da7d0c5e80 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f3300bfd640 1 -- 10.20.193.28:0/1146719282 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240ac600 con 0x55da7d0c5e80 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 -- 10.20.193.28:0/1146719282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 msgr2=0x55da7d0dc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 --2- 10.20.193.28:0/1146719282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dc2f0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f33240a45a0 tx=0x7f33240e8070 comp rx=0 tx=0).stop 2026-02-20T03:29:32.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 -- 10.20.193.28:0/1146719282 shutdown_connections 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 --2- 10.20.193.28:0/1146719282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0cb560 0x55da7d0de870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 --2- 10.20.193.28:0/1146719282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0c67c0 0x55da7d0e5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 --2- 10.20.193.28:0/1146719282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0c5e80 0x55da7d0dc2f0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 -- 10.20.193.28:0/1146719282 >> 10.20.193.28:0/1146719282 conn(0x55da7d0bd6f0 msgr2=0x55da7d0de160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 -- 10.20.193.28:0/1146719282 shutdown_connections 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.076+0000 7f333e010e00 1 -- 10.20.193.28:0/1146719282 wait complete. 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f333e010e00 1 -- start start 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f333e010e00 1 Processor -- start 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f333e010e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0c5e80 0x55da7d0e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f333e010e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c67c0 0x55da7d151200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.087 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f333e010e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0cb560 0x55da7d153750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f333e010e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800e3e0 con 0x55da7d0cb560 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f333e010e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800f850 con 0x55da7d0c5e80 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f333e010e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f32d800eab0 con 0x55da7d0c67c0 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f3339643640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0cb560 0x55da7d153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f3339643640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0cb560 0x55da7d153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54372/0 (socket says 10.20.193.28:54372) 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.079+0000 7f3339643640 1 -- 10.20.193.28:0/3789966240 learned_addr learned my addr 10.20.193.28:0/3789966240 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f3339643640 1 -- 10.20.193.28:0/3789966240 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c67c0 msgr2=0x55da7d151200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f3339643640 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c67c0 0x55da7d151200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f3339643640 1 -- 10.20.193.28:0/3789966240 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0c5e80 msgr2=0x55da7d0e3ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f3339643640 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0c5e80 0x55da7d0e3ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f3339643640 1 -- 10.20.193.28:0/3789966240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da7cd76690 con 0x55da7d0cb560 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f3339643640 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0cb560 0x55da7d153750 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f3330004350 tx=0x7f3330004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8ed0332bd3fe50 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:32.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f32f27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f32f27fc640 1 -- 10.20.193.28:0/3789966240 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333000d920 con 0x55da7d0cb560 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f32f27fc640 1 -- 10.20.193.28:0/3789966240 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f333001f020 con 0x55da7d0cb560 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f32f27fc640 1 -- 10.20.193.28:0/3789966240 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33300163f0 con 0x55da7d0cb560 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f333e010e00 1 -- 10.20.193.28:0/3789966240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da7cfdbb70 con 0x55da7d0cb560 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f32f27fc640 1 -- 10.20.193.28:0/3789966240 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(96..96 src has 1..96) ==== 9297+0+0 (secure 0 0 0) 0x7f3330016590 con 0x55da7d0cb560 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f333e010e00 10 client.19488 _ll_register_callbacks cb 0x7f332400f460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f333e010e00 1 -- 10.20.193.28:0/3789966240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33240e0d70 con 0x55da7d0cb560 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f32f27fc640 1 -- 10.20.193.28:0/3789966240 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f333001e030 con 0x55da7d0cb560 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f333e010e00 10 client.19488 fetch_fsmap learned FSMap version 35 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.080+0000 7f333e010e00 1 -- 10.20.193.28:0/3789966240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=35}) -- 0x55da7d0d8cf0 con 0x55da7d0cb560 2026-02-20T03:29:32.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.082+0000 7f32f27fc640 1 -- 10.20.193.28:0/3789966240 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 35) ==== 8366+0+0 (secure 0 0 0) 0x7f333001a5e0 con 0x55da7d0cb560 2026-02-20T03:29:32.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.082+0000 7f333e010e00 10 client.19488 fetch_fsmap finished waiting for FSMap version 35 2026-02-20T03:29:32.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.082+0000 7f333e010e00 10 client.19488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:32.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.082+0000 7f333e010e00 20 client.19488 populate_metadata read hostname 'trial028' 2026-02-20T03:29:32.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.082+0000 7f333e010e00 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55da7d155430 0x55da7d1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:32.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.082+0000 7f333e010e00 4 client.19488 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:29:32.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.082+0000 7f333e010e00 1 -- 10.20.193.28:0/3789966240 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55da7cfe76b0 con 0x55da7d155430 2026-02-20T03:29:32.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.082+0000 7f3338e42640 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55da7d155430 0x55da7d1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:32.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.123+0000 7f3338e42640 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55da7d155430 0x55da7d1578f0 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bee0435c6f4e9f38 server_cookie=1530d6a59df513ba in_seq=0 out_seq=0 2026-02-20T03:29:32.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.123+0000 7f32f27fc640 10 client.19488 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:32.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f32f27fc640 1 -- 10.20.193.28:0/3789966240 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55da7cfe76b0 con 0x55da7d155430 2026-02-20T03:29:32.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f32f27fc640 10 client.19488 handle_command_reply: tid=0 2026-02-20T03:29:32.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 client.19488 shutdown 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 -- 10.20.193.28:0/3789966240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0cb560 msgr2=0x55da7d153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0cb560 0x55da7d153750 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f3330004350 tx=0x7f3330004c50 comp rx=0 tx=0).stop 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 -- 10.20.193.28:0/3789966240 shutdown_connections 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55da7d155430 0x55da7d1578f0 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55da7d0cb560 0x55da7d153750 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55da7d0c67c0 0x55da7d151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 --2- 10.20.193.28:0/3789966240 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55da7d0c5e80 0x55da7d0e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 -- 10.20.193.28:0/3789966240 >> 10.20.193.28:0/3789966240 conn(0x55da7d0bd6f0 msgr2=0x55da7d0de8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f32f27fc640 0 client.19488 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 -- 10.20.193.28:0/3789966240 shutdown_connections 2026-02-20T03:29:32.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 1 -- 10.20.193.28:0/3789966240 wait complete. 2026-02-20T03:29:32.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.295+0000 7f333e010e00 20 client.19488 trim_cache size 0 max 16384 2026-02-20T03:29:32.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:29:32.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:29:32.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:29:32.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:29:32.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 -- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33100b0e20 msgr2=0x7f33100b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:32.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33100b0e20 0x7f33100b32e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f333000aa90 tx=0x7f3330009250 comp rx=0 tx=0).stop 2026-02-20T03:29:32.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 -- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334104940 msgr2=0x7f333419cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:32.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334104940 0x7f333419cbd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f332400b570 tx=0x7f332400ba40 comp rx=0 tx=0).stop 2026-02-20T03:29:32.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 -- 10.20.193.28:0/977459529 shutdown_connections 2026-02-20T03:29:32.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f33100b0e20 0x7f33100b32e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f33341064f0 0x7f33341a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3334105b30 0x7f333419d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 --2- 10.20.193.28:0/977459529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3334104940 0x7f333419cbd0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:32.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 -- 10.20.193.28:0/977459529 >> 10.20.193.28:0/977459529 conn(0x7f33341000c0 msgr2=0x7f3334108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:32.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 -- 10.20.193.28:0/977459529 shutdown_connections 2026-02-20T03:29:32.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:32.296+0000 7f3339e44640 1 -- 10.20.193.28:0/977459529 wait complete. 2026-02-20T03:29:32.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 31.51 MB/sec warmup 63 sec latency 28723.096 ms 2026-02-20T03:29:33.399 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:29:33 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setuser ceph since I am not root 2026-02-20T03:29:33.399 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:29:33 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setgroup ceph since I am not root 2026-02-20T03:29:33.399 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:29:33 trial177 ceph-mds[71178]: -- 10.20.193.177:0/36277006 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf1ff76b40 con 0x55bf1f19d400 2026-02-20T03:29:33.400 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:29:33 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: starting mds.c at 2026-02-20T03:29:33.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:33 trial028 ceph-mon[38552]: pgmap v629: 129 pgs: 129 active+clean; 526 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 77 KiB/s rd, 5.3 MiB/s wr, 195 op/s 2026-02-20T03:29:33.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:29:33.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:29:33.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:29:33.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:33 trial028 ceph-mon[38552]: daemon mds.c restarted 2026-02-20T03:29:33.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 31.02 MB/sec warmup 64 sec latency 29723.134 ms 2026-02-20T03:29:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:33 trial177 ceph-mon[43181]: pgmap v629: 129 pgs: 129 active+clean; 526 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 77 KiB/s rd, 5.3 MiB/s wr, 195 op/s 2026-02-20T03:29:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:29:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:29:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:29:33.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:33 trial177 ceph-mon[43181]: daemon mds.c restarted 2026-02-20T03:29:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:33 trial126 ceph-mon[38476]: pgmap v629: 129 pgs: 129 active+clean; 526 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 77 KiB/s rd, 5.3 MiB/s wr, 195 op/s 2026-02-20T03:29:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:29:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:29:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:29:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:33 trial126 ceph-mon[38476]: daemon mds.c restarted 2026-02-20T03:29:34.662 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:34 trial028 ceph-mon[38552]: osdmap e97: 12 total, 12 up, 12 in 2026-02-20T03:29:34.662 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:34 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6836/2019777772,v1:10.20.193.177:6837/2019777772] up:boot 2026-02-20T03:29:34.662 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:34 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:29:34.662 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:34 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:29:34.662 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:34 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:29:34.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 30.54 MB/sec warmup 65 sec latency 30723.177 ms 2026-02-20T03:29:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:34 trial177 ceph-mon[43181]: osdmap e97: 12 total, 12 up, 12 in 2026-02-20T03:29:34.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:34 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6836/2019777772,v1:10.20.193.177:6837/2019777772] up:boot 2026-02-20T03:29:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:34 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:29:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:34 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:29:34.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:34 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:29:34.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:34 trial126 ceph-mon[38476]: osdmap e97: 12 total, 12 up, 12 in 2026-02-20T03:29:34.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:34 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6836/2019777772,v1:10.20.193.177:6837/2019777772] up:boot 2026-02-20T03:29:34.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:34 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:29:34.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:34 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:29:34.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:34 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:29:35.499 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:35 trial028 ceph-mon[38552]: pgmap v631: 129 pgs: 129 active+clean; 519 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 111 KiB/s rd, 6.8 MiB/s wr, 294 op/s 2026-02-20T03:29:35.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 30.08 MB/sec warmup 66 sec latency 31723.214 ms 2026-02-20T03:29:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:35 trial177 ceph-mon[43181]: pgmap v631: 129 pgs: 129 active+clean; 519 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 111 KiB/s rd, 6.8 MiB/s wr, 294 op/s 2026-02-20T03:29:35.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:35 trial126 ceph-mon[38476]: pgmap v631: 129 pgs: 129 active+clean; 519 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 111 KiB/s rd, 6.8 MiB/s wr, 294 op/s 2026-02-20T03:29:36.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 29.63 MB/sec warmup 67 sec latency 32723.254 ms 2026-02-20T03:29:37.455 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:37 trial028 ceph-mon[38552]: pgmap v632: 129 pgs: 129 active+clean; 498 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 488 KiB/s rd, 8.5 MiB/s wr, 432 op/s 2026-02-20T03:29:37.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 29.19 MB/sec warmup 68 sec latency 33723.303 ms 2026-02-20T03:29:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:37 trial177 ceph-mon[43181]: pgmap v632: 129 pgs: 129 active+clean; 498 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 488 KiB/s rd, 8.5 MiB/s wr, 432 op/s 2026-02-20T03:29:37.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:37 trial126 ceph-mon[38476]: pgmap v632: 129 pgs: 129 active+clean; 498 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 488 KiB/s rd, 8.5 MiB/s wr, 432 op/s 2026-02-20T03:29:38.525 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:38 trial028 ceph-mon[38552]: pgmap v633: 129 pgs: 129 active+clean; 468 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 614 KiB/s rd, 9.0 MiB/s wr, 570 op/s 2026-02-20T03:29:38.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 28.77 MB/sec warmup 69 sec latency 34723.345 ms 2026-02-20T03:29:38.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:38 trial177 ceph-mon[43181]: pgmap v633: 129 pgs: 129 active+clean; 468 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 614 KiB/s rd, 9.0 MiB/s wr, 570 op/s 2026-02-20T03:29:38.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:38 trial126 ceph-mon[38476]: pgmap v633: 129 pgs: 129 active+clean; 468 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 614 KiB/s rd, 9.0 MiB/s wr, 570 op/s 2026-02-20T03:29:39.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 28.36 MB/sec warmup 70 sec latency 35723.385 ms 2026-02-20T03:29:40.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 27.96 MB/sec warmup 71 sec latency 36723.423 ms 2026-02-20T03:29:41.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:41 trial028 ceph-mon[38552]: pgmap v634: 129 pgs: 129 active+clean; 433 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 664 KiB/s rd, 6.9 MiB/s wr, 599 op/s 2026-02-20T03:29:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:41 trial126 ceph-mon[38476]: pgmap v634: 129 pgs: 129 active+clean; 433 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 664 KiB/s rd, 6.9 MiB/s wr, 599 op/s 2026-02-20T03:29:41.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 27.57 MB/sec warmup 72 sec latency 37723.452 ms 2026-02-20T03:29:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:41 trial177 ceph-mon[43181]: pgmap v634: 129 pgs: 129 active+clean; 433 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 664 KiB/s rd, 6.9 MiB/s wr, 599 op/s 2026-02-20T03:29:42.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 27.19 MB/sec warmup 73 sec latency 38723.475 ms 2026-02-20T03:29:43.342 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:43 trial028 ceph-mon[38552]: pgmap v635: 129 pgs: 129 active+clean; 433 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 663 KiB/s rd, 6.2 MiB/s wr, 575 op/s 2026-02-20T03:29:43.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:43 trial126 ceph-mon[38476]: pgmap v635: 129 pgs: 129 active+clean; 433 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 663 KiB/s rd, 6.2 MiB/s wr, 575 op/s 2026-02-20T03:29:43.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 26.83 MB/sec warmup 74 sec latency 39723.519 ms 2026-02-20T03:29:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:43 trial177 ceph-mon[43181]: pgmap v635: 129 pgs: 129 active+clean; 433 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 663 KiB/s rd, 6.2 MiB/s wr, 575 op/s 2026-02-20T03:29:44.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 26.47 MB/sec warmup 75 sec latency 40723.555 ms 2026-02-20T03:29:45.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.373+0000 7fef52834640 1 -- 10.20.193.28:0/3367136310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 msgr2=0x7fef4c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:45.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.373+0000 7fef52834640 1 --2- 10.20.193.28:0/3367136310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 0x7fef4c111480 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fef4800b0a0 tx=0x7fef4802f450 comp rx=0 tx=0).stop 2026-02-20T03:29:45.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 -- 10.20.193.28:0/3367136310 shutdown_connections 2026-02-20T03:29:45.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 --2- 10.20.193.28:0/3367136310 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 0x7fef4c111480 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 --2- 10.20.193.28:0/3367136310 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef4c109e60 0x7fef4c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.376 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 --2- 10.20.193.28:0/3367136310 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef4c109490 0x7fef4c109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 -- 10.20.193.28:0/3367136310 >> 10.20.193.28:0/3367136310 conn(0x7fef4c077fe0 msgr2=0x7fef4c07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 -- 10.20.193.28:0/3367136310 shutdown_connections 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 -- 10.20.193.28:0/3367136310 wait complete. 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 Processor -- start 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 -- start start 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef4c109490 0x7fef4c1a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef4c109e60 0x7fef4c1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.374+0000 7fef52834640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 0x7fef4c1a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52834640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c114a50 con 0x7fef4c10a900 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52834640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c1148d0 con 0x7fef4c109e60 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52834640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c114bd0 con 0x7fef4c109490 2026-02-20T03:29:45.378 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52033640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 0x7fef4c1a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:45.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52033640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 0x7fef4c1a8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60460/0 (socket says 10.20.193.28:60460) 2026-02-20T03:29:45.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52033640 1 -- 10.20.193.28:0/654289176 learned_addr learned my addr 10.20.193.28:0/654289176 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:45.382 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52033640 1 -- 10.20.193.28:0/654289176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef4c109490 msgr2=0x7fef4c1a1060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52033640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef4c109490 0x7fef4c1a1060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52033640 1 -- 10.20.193.28:0/654289176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef4c109e60 msgr2=0x7fef4c1a15a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52033640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef4c109e60 0x7fef4c1a15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52033640 1 -- 10.20.193.28:0/654289176 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c1a8d10 con 0x7fef4c10a900 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52033640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 0x7fef4c1a8610 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fef4800b1d0 tx=0x7fef48004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef3affd640 1 -- 10.20.193.28:0/654289176 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48004d40 con 0x7fef4c10a900 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef3affd640 1 -- 10.20.193.28:0/654289176 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef480078c0 con 0x7fef4c10a900 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef3affd640 1 -- 10.20.193.28:0/654289176 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48005380 con 0x7fef4c10a900 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52834640 1 -- 10.20.193.28:0/654289176 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c1a8fa0 con 0x7fef4c10a900 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52834640 1 -- 10.20.193.28:0/654289176 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c1a9430 con 0x7fef4c10a900 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef3affd640 1 -- 10.20.193.28:0/654289176 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fef48007a70 con 0x7fef4c10a900 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 Processor -- start 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 -- start start 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740134690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740134bd0 0x556740139370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740139990 0x55674013be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5567400738f0 con 0x556740134290 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5567400212e0 con 0x556740134bd0 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55674006f820 con 0x556740139990 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51031640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740134690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51031640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740134690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60462/0 (socket says 10.20.193.28:60462) 2026-02-20T03:29:45.383 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51031640 1 -- 10.20.193.28:0/3442645282 learned_addr learned my addr 10.20.193.28:0/3442645282 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51031640 1 -- 10.20.193.28:0/3442645282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740139990 msgr2=0x55674013be20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51031640 1 --2- 10.20.193.28:0/3442645282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740139990 0x55674013be20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51031640 1 -- 10.20.193.28:0/3442645282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740134bd0 msgr2=0x556740139370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51031640 1 --2- 10.20.193.28:0/3442645282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740134bd0 0x556740139370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51031640 1 -- 10.20.193.28:0/3442645282 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567400135a0 con 0x556740134290 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51031640 1 --2- 10.20.193.28:0/3442645282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740134690 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fef4002dd60 tx=0x7fef40009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12685cbeb9cd3df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52834640 1 -- 10.20.193.28:0/3442645282 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef400042d0 con 0x556740134290 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52834640 1 -- 10.20.193.28:0/3442645282 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef40004470 con 0x556740134290 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef52834640 1 -- 10.20.193.28:0/3442645282 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef400359d0 con 0x556740134290 2026-02-20T03:29:45.384 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef3affd640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef280b0e20 0x7fef280b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef3affd640 1 -- 10.20.193.28:0/654289176 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7fef48105d60 con 0x7fef4c10a900 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 -- 10.20.193.28:0/3442645282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 msgr2=0x556740134690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef569fae00 1 --2- 10.20.193.28:0/3442645282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740134690 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fef4002dd60 tx=0x7fef40009800 comp rx=0 tx=0).stop 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.375+0000 7fef51832640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef280b0e20 0x7fef280b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.380+0000 7fef51832640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef280b0e20 0x7fef280b32e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fef4c07b6a0 tx=0x7fef3c006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.380+0000 7fef569fae00 1 -- 10.20.193.28:0/3442645282 shutdown_connections 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.380+0000 7fef569fae00 1 --2- 10.20.193.28:0/3442645282 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740139990 0x55674013be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.380+0000 7fef569fae00 1 --2- 10.20.193.28:0/3442645282 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740134bd0 0x556740139370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.380+0000 7fef569fae00 1 --2- 10.20.193.28:0/3442645282 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740134690 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.380+0000 7fef569fae00 1 -- 10.20.193.28:0/3442645282 >> 10.20.193.28:0/3442645282 conn(0x55674011a6f0 msgr2=0x556740121570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.380+0000 7fef569fae00 1 -- 10.20.193.28:0/3442645282 shutdown_connections 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.380+0000 7fef569fae00 1 -- 10.20.193.28:0/3442645282 wait complete. 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef569fae00 1 -- start start 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef569fae00 1 Processor -- start 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef569fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134290 0x5567401339d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef569fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740134bd0 0x5567401407c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef569fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740139990 0x556740142d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef569fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55674001b0c0 con 0x556740139990 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef569fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556740122f30 con 0x556740134bd0 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef569fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556740143470 con 0x556740134290 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef52033640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740139990 0x556740142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef52033640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740139990 0x556740142d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60464/0 (socket says 10.20.193.28:60464) 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.382+0000 7fef52033640 1 -- 10.20.193.28:0/3047571076 learned_addr learned my addr 10.20.193.28:0/3047571076 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:45.385 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef52033640 1 -- 10.20.193.28:0/3047571076 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134290 msgr2=0x5567401339d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:45.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef52033640 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134290 0x5567401339d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef52033640 1 -- 10.20.193.28:0/3047571076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740134bd0 msgr2=0x5567401407c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:45.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef52033640 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740134bd0 0x5567401407c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef52033640 1 -- 10.20.193.28:0/3047571076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674012ca50 con 0x556740139990 2026-02-20T03:29:45.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef52033640 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740139990 0x556740142d10 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fef481033d0 tx=0x7fef480cd650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16204d7b6cfcf08c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:45.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef06ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:45.386 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef06ffd640 1 -- 10.20.193.28:0/3047571076 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48007de0 con 0x556740139990 2026-02-20T03:29:45.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef06ffd640 1 -- 10.20.193.28:0/3047571076 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef48033030 con 0x556740139990 2026-02-20T03:29:45.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef06ffd640 1 -- 10.20.193.28:0/3047571076 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4804ae70 con 0x556740139990 2026-02-20T03:29:45.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef569fae00 1 -- 10.20.193.28:0/3047571076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55674002f820 con 0x556740139990 2026-02-20T03:29:45.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef06ffd640 1 -- 10.20.193.28:0/3047571076 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7fef480eeb70 con 0x556740139990 2026-02-20T03:29:45.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef06ffd640 10 client.19500 inactive, discarding osd_map(97..97 src has 1..97) 2026-02-20T03:29:45.396 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef569fae00 10 client.19500 _ll_register_callbacks cb 0x55674001eff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef569fae00 1 -- 10.20.193.28:0/3047571076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55674007b4e0 con 0x556740139990 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef06ffd640 1 -- 10.20.193.28:0/3047571076 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fef480ce140 con 0x556740139990 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef569fae00 10 client.19500 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef569fae00 1 -- 10.20.193.28:0/3047571076 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x556740034380 con 0x556740139990 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.383+0000 7fef06ffd640 1 -- 10.20.193.28:0/3047571076 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7fef480cca50 con 0x556740139990 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.384+0000 7fef569fae00 10 client.19500 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.384+0000 7fef569fae00 10 client.19500 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.384+0000 7fef569fae00 20 client.19500 populate_metadata read hostname 'trial028' 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.384+0000 7fef569fae00 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5567401477f0 0x556740149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.384+0000 7fef569fae00 4 client.19500 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:45.397 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.384+0000 7fef569fae00 1 -- 10.20.193.28:0/3047571076 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55673fff5bd0 con 0x5567401477f0 2026-02-20T03:29:45.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.407+0000 7fef51832640 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5567401477f0 0x556740149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:45.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.474+0000 7fef51832640 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5567401477f0 0x556740149cb0 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5c30dbf9a6e639c server_cookie=474a8420bd28229e in_seq=0 out_seq=0 2026-02-20T03:29:45.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.474+0000 7fef06ffd640 10 client.19500 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:45.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef06ffd640 1 -- 10.20.193.28:0/3047571076 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55673fff5bd0 con 0x5567401477f0 2026-02-20T03:29:45.490 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef06ffd640 10 client.19500 handle_command_reply: tid=0 2026-02-20T03:29:45.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 client.19500 shutdown 2026-02-20T03:29:45.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 -- 10.20.193.28:0/3047571076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740139990 msgr2=0x556740142d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:45.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740139990 0x556740142d10 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fef481033d0 tx=0x7fef480cd650 comp rx=0 tx=0).stop 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 -- 10.20.193.28:0/3047571076 shutdown_connections 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5567401477f0 0x556740149cb0 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740139990 0x556740142d10 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740134bd0 0x5567401407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 --2- 10.20.193.28:0/3047571076 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134290 0x5567401339d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 -- 10.20.193.28:0/3047571076 >> 10.20.193.28:0/3047571076 conn(0x55674011a6f0 msgr2=0x55674013ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef06ffd640 0 client.19500 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 -- 10.20.193.28:0/3047571076 shutdown_connections 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 1 -- 10.20.193.28:0/3047571076 wait complete. 2026-02-20T03:29:45.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.488+0000 7fef569fae00 20 client.19500 trim_cache size 0 max 16384 2026-02-20T03:29:45.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 Processor -- start 2026-02-20T03:29:45.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- start start 2026-02-20T03:29:45.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740135310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.501 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134bd0 0x5567401427d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740139990 0x556740142d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feef80126b0 con 0x556740134290 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7feef800ff20 con 0x556740139990 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7feef800dd70 con 0x556740134bd0 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740135310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740135310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60466/0 (socket says 10.20.193.28:60466) 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 -- 10.20.193.28:0/2704996529 learned_addr learned my addr 10.20.193.28:0/2704996529 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 -- 10.20.193.28:0/2704996529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134bd0 msgr2=0x5567401427d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- 10.20.193.28:0/2704996529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134bd0 0x5567401427d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 -- 10.20.193.28:0/2704996529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740139990 msgr2=0x556740142d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- 10.20.193.28:0/2704996529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740139990 0x556740142d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 -- 10.20.193.28:0/2704996529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674012c880 con 0x556740134290 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- 10.20.193.28:0/2704996529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740135310 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x55674014a520 tx=0x7fef3c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198534098a224313 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef193fd640 1 -- 10.20.193.28:0/2704996529 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c002ae0 con 0x556740134290 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef193fd640 1 -- 10.20.193.28:0/2704996529 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef3c002c80 con 0x556740134290 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- 10.20.193.28:0/2704996529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 msgr2=0x556740135310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- 10.20.193.28:0/2704996529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740135310 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x55674014a520 tx=0x7fef3c010000 comp rx=0 tx=0).stop 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- 10.20.193.28:0/2704996529 shutdown_connections 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- 10.20.193.28:0/2704996529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740139990 0x556740142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- 10.20.193.28:0/2704996529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134bd0 0x5567401427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- 10.20.193.28:0/2704996529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740135310 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- 10.20.193.28:0/2704996529 >> 10.20.193.28:0/2704996529 conn(0x55674011a6f0 msgr2=0x556740131a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:45.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- 10.20.193.28:0/2704996529 shutdown_connections 2026-02-20T03:29:45.506 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- 10.20.193.28:0/2704996529 wait complete. 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- start start 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 Processor -- start 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740142740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134bd0 0x556740142c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740139990 0x556740140f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feef800e3e0 con 0x556740134290 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7feef800f850 con 0x556740139990 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7feef800eab0 con 0x556740134bd0 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:45.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740142740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60478/0 (socket says 10.20.193.28:60478) 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 -- 10.20.193.28:0/3788650092 learned_addr learned my addr 10.20.193.28:0/3788650092 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 -- 10.20.193.28:0/3788650092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134bd0 msgr2=0x556740142c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134bd0 0x556740142c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 -- 10.20.193.28:0/3788650092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740139990 msgr2=0x556740140f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740139990 0x556740140f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 -- 10.20.193.28:0/3788650092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55673fdd3690 con 0x556740134290 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef51832640 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740142740 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fef3c002410 tx=0x7fef3c009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7433ad0c087ee8e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef06ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef06ffd640 1 -- 10.20.193.28:0/3788650092 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c013b60 con 0x556740134290 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef06ffd640 1 -- 10.20.193.28:0/3788650092 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fef3c013d00 con 0x556740134290 2026-02-20T03:29:45.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef06ffd640 1 -- 10.20.193.28:0/3788650092 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c028830 con 0x556740134290 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- 10.20.193.28:0/3788650092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556740038b70 con 0x556740134290 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef06ffd640 1 -- 10.20.193.28:0/3788650092 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7fef3c0289f0 con 0x556740134290 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef06ffd640 10 client.19506 inactive, discarding osd_map(97..97 src has 1..97) 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 10 client.19506 _ll_register_callbacks cb 0x7fef480cd810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- 10.20.193.28:0/3788650092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef40004470 con 0x556740134290 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef06ffd640 1 -- 10.20.193.28:0/3788650092 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fef3c00b680 con 0x556740134290 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 10 client.19506 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- 10.20.193.28:0/3788650092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55674012d570 con 0x556740134290 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef06ffd640 1 -- 10.20.193.28:0/3788650092 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7fef3c00b920 con 0x556740134290 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 10 client.19506 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 10 client.19506 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:45.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 20 client.19506 populate_metadata read hostname 'trial028' 2026-02-20T03:29:45.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5567401b36b0 0x5567401b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:45.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 4 client.19506 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:29:45.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.496+0000 7fef569fae00 1 -- 10.20.193.28:0/3788650092 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55673fe4c520 con 0x5567401b36b0 2026-02-20T03:29:45.510 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:45 trial028 ceph-mon[38552]: pgmap v636: 129 pgs: 129 active+clean; 433 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 602 KiB/s rd, 5.1 MiB/s wr, 484 op/s 2026-02-20T03:29:45.510 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:45 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:29:45.510 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:45 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:29:45.510 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:45 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:29:45.510 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:45 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:29:45.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.515+0000 7fef51031640 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5567401b36b0 0x5567401b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:45.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.568+0000 7fef06ffd640 10 client.19506 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:45.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.568+0000 7fef51031640 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5567401b36b0 0x5567401b5b70 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f91a45f0f3665c51 server_cookie=9978df21b7214ecc in_seq=0 out_seq=0 2026-02-20T03:29:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:45 trial126 ceph-mon[38476]: pgmap v636: 129 pgs: 129 active+clean; 433 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 602 KiB/s rd, 5.1 MiB/s wr, 484 op/s 2026-02-20T03:29:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:45 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:29:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:45 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:29:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:45 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:29:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:45 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:29:45.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef06ffd640 1 -- 10.20.193.28:0/3788650092 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55673fe4c520 con 0x5567401b36b0 2026-02-20T03:29:45.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef06ffd640 10 client.19506 handle_command_reply: tid=0 2026-02-20T03:29:45.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 client.19506 shutdown 2026-02-20T03:29:45.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 -- 10.20.193.28:0/3788650092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 msgr2=0x556740142740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:45.666 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740142740 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fef3c002410 tx=0x7fef3c009eb0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 -- 10.20.193.28:0/3788650092 shutdown_connections 2026-02-20T03:29:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5567401b36b0 0x5567401b5b70 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556740139990 0x556740140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.667 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556740134bd0 0x556740142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 --2- 10.20.193.28:0/3788650092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556740134290 0x556740142740 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 -- 10.20.193.28:0/3788650092 >> 10.20.193.28:0/3788650092 conn(0x55674011a6f0 msgr2=0x556740120d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:45.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef06ffd640 0 client.19506 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:45.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 -- 10.20.193.28:0/3788650092 shutdown_connections 2026-02-20T03:29:45.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 1 -- 10.20.193.28:0/3788650092 wait complete. 2026-02-20T03:29:45.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.663+0000 7fef569fae00 20 client.19506 trim_cache size 0 max 16384 2026-02-20T03:29:45.668 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:29:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:29:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:29:45.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:29:45.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 -- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef280b0e20 msgr2=0x7fef280b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:45.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef280b0e20 0x7fef280b32e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fef4c07b6a0 tx=0x7fef3c006cd0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 -- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 msgr2=0x7fef4c1a8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:45.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 0x7fef4c1a8610 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fef4800b1d0 tx=0x7fef48004360 comp rx=0 tx=0).stop 2026-02-20T03:29:45.679 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 -- 10.20.193.28:0/654289176 shutdown_connections 2026-02-20T03:29:45.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fef280b0e20 0x7fef280b32e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fef4c10a900 0x7fef4c1a8610 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fef4c109e60 0x7fef4c1a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 --2- 10.20.193.28:0/654289176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fef4c109490 0x7fef4c1a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:45.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 -- 10.20.193.28:0/654289176 >> 10.20.193.28:0/654289176 conn(0x7fef4c077fe0 msgr2=0x7fef4c10d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:45.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 -- 10.20.193.28:0/654289176 shutdown_connections 2026-02-20T03:29:45.680 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:45.664+0000 7fef1a3ff640 1 -- 10.20.193.28:0/654289176 wait complete. 2026-02-20T03:29:45.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 26.12 MB/sec warmup 76 sec latency 41723.592 ms 2026-02-20T03:29:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:45 trial177 ceph-mon[43181]: pgmap v636: 129 pgs: 129 active+clean; 433 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 602 KiB/s rd, 5.1 MiB/s wr, 484 op/s 2026-02-20T03:29:45.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:45 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:29:45.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:45 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:29:45.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:45 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:29:45.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:45 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:29:46.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 25.78 MB/sec warmup 77 sec latency 42723.635 ms 2026-02-20T03:29:47.372 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:47 trial028 ceph-mon[38552]: pgmap v637: 129 pgs: 129 active+clean; 432 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 556 KiB/s rd, 4.1 MiB/s wr, 407 op/s 2026-02-20T03:29:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:47 trial126 ceph-mon[38476]: pgmap v637: 129 pgs: 129 active+clean; 432 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 556 KiB/s rd, 4.1 MiB/s wr, 407 op/s 2026-02-20T03:29:47.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33608 25.45 MB/sec warmup 78 sec latency 43723.668 ms 2026-02-20T03:29:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:47 trial177 ceph-mon[43181]: pgmap v637: 129 pgs: 129 active+clean; 432 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 556 KiB/s rd, 4.1 MiB/s wr, 407 op/s 2026-02-20T03:29:48.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 25.13 MB/sec warmup 79 sec latency 44723.701 ms 2026-02-20T03:29:49.508 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:49 trial028 ceph-mon[38552]: pgmap v638: 129 pgs: 129 active+clean; 431 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 1.4 MiB/s wr, 250 op/s 2026-02-20T03:29:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:49 trial126 ceph-mon[38476]: pgmap v638: 129 pgs: 129 active+clean; 431 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 1.4 MiB/s wr, 250 op/s 2026-02-20T03:29:49.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 24.81 MB/sec warmup 80 sec latency 45723.732 ms 2026-02-20T03:29:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:49 trial177 ceph-mon[43181]: pgmap v638: 129 pgs: 129 active+clean; 431 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 1.4 MiB/s wr, 250 op/s 2026-02-20T03:29:50.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 24.51 MB/sec warmup 81 sec latency 46723.769 ms 2026-02-20T03:29:51.375 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:51 trial028 ceph-mon[38552]: pgmap v639: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 94 KiB/s rd, 35 KiB/s wr, 110 op/s 2026-02-20T03:29:51.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 24.21 MB/sec warmup 82 sec latency 47723.796 ms 2026-02-20T03:29:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:51 trial177 ceph-mon[43181]: pgmap v639: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 94 KiB/s rd, 35 KiB/s wr, 110 op/s 2026-02-20T03:29:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:51 trial126 ceph-mon[38476]: pgmap v639: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 94 KiB/s rd, 35 KiB/s wr, 110 op/s 2026-02-20T03:29:52.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 23.92 MB/sec warmup 83 sec latency 48723.828 ms 2026-02-20T03:29:53.509 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:53 trial028 ceph-mon[38552]: pgmap v640: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 18 KiB/s wr, 25 op/s 2026-02-20T03:29:53.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 23.63 MB/sec warmup 84 sec latency 49723.856 ms 2026-02-20T03:29:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:53 trial177 ceph-mon[43181]: pgmap v640: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 18 KiB/s wr, 25 op/s 2026-02-20T03:29:53.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:53 trial126 ceph-mon[38476]: pgmap v640: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 30 KiB/s rd, 18 KiB/s wr, 25 op/s 2026-02-20T03:29:54.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 23.35 MB/sec warmup 85 sec latency 50723.881 ms 2026-02-20T03:29:55.287 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:29:55.592 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:55.658 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:55 trial028 ceph-mon[38552]: pgmap v641: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 14 KiB/s wr, 25 op/s 2026-02-20T03:29:55.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 23.08 MB/sec warmup 86 sec latency 51723.905 ms 2026-02-20T03:29:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:55 trial177 ceph-mon[43181]: pgmap v641: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 14 KiB/s wr, 25 op/s 2026-02-20T03:29:55.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:55 trial126 ceph-mon[38476]: pgmap v641: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 29 KiB/s rd, 14 KiB/s wr, 25 op/s 2026-02-20T03:29:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.021+0000 7f8463126640 1 -- 10.20.193.28:0/3928429440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 msgr2=0x7f845c113300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.021+0000 7f8463126640 1 --2- 10.20.193.28:0/3928429440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 0x7f845c113300 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f8450009a30 tx=0x7f845002f260 comp rx=0 tx=0).stop 2026-02-20T03:29:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.021+0000 7f8463126640 1 -- 10.20.193.28:0/3928429440 shutdown_connections 2026-02-20T03:29:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.021+0000 7f8463126640 1 --2- 10.20.193.28:0/3928429440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f845c113840 0x7f845c115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.021+0000 7f8463126640 1 --2- 10.20.193.28:0/3928429440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 0x7f845c113300 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.021+0000 7f8463126640 1 --2- 10.20.193.28:0/3928429440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f845c077620 0x7f845c077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.021+0000 7f8463126640 1 -- 10.20.193.28:0/3928429440 >> 10.20.193.28:0/3928429440 conn(0x7f845c1006c0 msgr2=0x7f845c102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.021+0000 7f8463126640 1 -- 10.20.193.28:0/3928429440 shutdown_connections 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.021+0000 7f8463126640 1 -- 10.20.193.28:0/3928429440 wait complete. 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.022+0000 7f8463126640 1 Processor -- start 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.022+0000 7f8463126640 1 -- start start 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.022+0000 7f8463126640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f845c077620 0x7f845c0746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.022+0000 7f8463126640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 0x7f845c074c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.022+0000 7f8463126640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f845c113840 0x7f845c06d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.022+0000 7f8463126640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f845c119200 con 0x7f845c077f40 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.022+0000 7f8463126640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f845c119080 con 0x7f845c077620 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.022+0000 7f8463126640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f845c119380 con 0x7f845c113840 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.022+0000 7f8461923640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 0x7f845c074c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8461923640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 0x7f845c074c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44804/0 (socket says 10.20.193.28:44804) 2026-02-20T03:29:56.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8461923640 1 -- 10.20.193.28:0/3792355744 learned_addr learned my addr 10.20.193.28:0/3792355744 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8461923640 1 -- 10.20.193.28:0/3792355744 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f845c113840 msgr2=0x7f845c06d880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8461923640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f845c113840 0x7f845c06d880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8461923640 1 -- 10.20.193.28:0/3792355744 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f845c077620 msgr2=0x7f845c0746d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8461923640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f845c077620 0x7f845c0746d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8461923640 1 -- 10.20.193.28:0/3792355744 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c06e140 con 0x7f845c077f40 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8461923640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 0x7f845c074c10 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f8450009950 tx=0x7f8450002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f84437fe640 1 -- 10.20.193.28:0/3792355744 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450002a00 con 0x7f845c077f40 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8463126640 1 -- 10.20.193.28:0/3792355744 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845c06e3d0 con 0x7f845c077f40 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f8463126640 1 -- 10.20.193.28:0/3792355744 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845c0723d0 con 0x7f845c077f40 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f84437fe640 1 -- 10.20.193.28:0/3792355744 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8450005030 con 0x7f845c077f40 2026-02-20T03:29:56.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.023+0000 7f84437fe640 1 -- 10.20.193.28:0/3792355744 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450004d80 con 0x7f845c077f40 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.026+0000 7f84668b4e00 1 Processor -- start 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.027+0000 7f84668b4e00 1 -- start start 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.027+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 0x56405ca683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.027+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 0x56405ca62a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.027+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca6ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.027+0000 7f84668b4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56405c9e2e50 con 0x56405ca62fb0 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.027+0000 7f84668b4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56405c9b59c0 con 0x56405ca62630 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.027+0000 7f84668b4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56405c963240 con 0x56405ca68000 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.027+0000 7f84437fe640 1 -- 10.20.193.28:0/3792355744 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f84500051e0 con 0x7f845c077f40 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8461923640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca6ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8461923640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca6ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44818/0 (socket says 10.20.193.28:44818) 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8461923640 1 -- 10.20.193.28:0/3343323500 learned_addr learned my addr 10.20.193.28:0/3343323500 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8461923640 1 -- 10.20.193.28:0/3343323500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 msgr2=0x56405ca683e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8461923640 1 --2- 10.20.193.28:0/3343323500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 0x56405ca683e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8461923640 1 -- 10.20.193.28:0/3343323500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 msgr2=0x56405ca62a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8461923640 1 --2- 10.20.193.28:0/3343323500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 0x56405ca62a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8461923640 1 -- 10.20.193.28:0/3343323500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56405c976420 con 0x56405ca62fb0 2026-02-20T03:29:56.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8461923640 1 --2- 10.20.193.28:0/3343323500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca6ee30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f845010d480 tx=0x7f845010d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c94e28f132fb8e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8440a08640 1 -- 10.20.193.28:0/3343323500 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450107480 con 0x56405ca62fb0 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8440a08640 1 -- 10.20.193.28:0/3343323500 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8450112070 con 0x56405ca62fb0 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f8440a08640 1 -- 10.20.193.28:0/3343323500 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450117b20 con 0x56405ca62fb0 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f84668b4e00 1 -- 10.20.193.28:0/3343323500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 msgr2=0x56405ca6ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.028+0000 7f84668b4e00 1 --2- 10.20.193.28:0/3343323500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca6ee30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f845010d480 tx=0x7f845010d950 comp rx=0 tx=0).stop 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f84668b4e00 1 -- 10.20.193.28:0/3343323500 shutdown_connections 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f84668b4e00 1 --2- 10.20.193.28:0/3343323500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca6ee30 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f84668b4e00 1 --2- 10.20.193.28:0/3343323500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 0x56405ca62a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f84668b4e00 1 --2- 10.20.193.28:0/3343323500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 0x56405ca683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f84668b4e00 1 -- 10.20.193.28:0/3343323500 >> 10.20.193.28:0/3343323500 conn(0x56405ca25290 msgr2=0x56405ca60d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f84668b4e00 1 -- 10.20.193.28:0/3343323500 shutdown_connections 2026-02-20T03:29:56.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f84668b4e00 1 -- 10.20.193.28:0/3343323500 wait complete. 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f84437fe640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84380b0d80 0x7f84380b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f84437fe640 1 -- 10.20.193.28:0/3792355744 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f8450105220 con 0x7f845c077f40 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.029+0000 7f8462124640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84380b0d80 0x7f84380b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.030+0000 7f84668b4e00 1 -- start start 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.030+0000 7f8462124640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84380b0d80 0x7f84380b3240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f844c009670 tx=0x7f844c006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.030+0000 7f84668b4e00 1 Processor -- start 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.030+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62630 0x56405ca7ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.030+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca62fb0 0x56405ca7d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.030+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca68000 0x56405ca7b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.030+0000 7f84668b4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56405c9b18f0 con 0x56405ca62630 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.030+0000 7f84668b4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56405c7a3f50 con 0x56405ca68000 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.030+0000 7f84668b4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56405ca7bb90 con 0x56405ca62fb0 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f8462124640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62630 0x56405ca7ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f8462124640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62630 0x56405ca7ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44828/0 (socket says 10.20.193.28:44828) 2026-02-20T03:29:56.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f8462124640 1 -- 10.20.193.28:0/183924113 learned_addr learned my addr 10.20.193.28:0/183924113 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:56.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f8462124640 1 -- 10.20.193.28:0/183924113 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca62fb0 msgr2=0x56405ca7d210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:56.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f8462124640 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca62fb0 0x56405ca7d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f8462124640 1 -- 10.20.193.28:0/183924113 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca68000 msgr2=0x56405ca7b410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:56.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f8462124640 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca68000 0x56405ca7b410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f8462124640 1 -- 10.20.193.28:0/183924113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56405ca748e0 con 0x56405ca62630 2026-02-20T03:29:56.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f8462124640 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62630 0x56405ca7ccd0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f844c002a00 tx=0x7f844c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b03e7d1eec22820 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:56.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f840ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:56.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f840ffff640 1 -- 10.20.193.28:0/183924113 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c011630 con 0x56405ca62630 2026-02-20T03:29:56.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f840ffff640 1 -- 10.20.193.28:0/183924113 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f844c011c70 con 0x56405ca62630 2026-02-20T03:29:56.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f84668b4e00 1 -- 10.20.193.28:0/183924113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56405c786b40 con 0x56405ca62630 2026-02-20T03:29:56.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f840ffff640 1 -- 10.20.193.28:0/183924113 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c020dc0 con 0x56405ca62630 2026-02-20T03:29:56.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f84668b4e00 10 client.19518 _ll_register_callbacks cb 0x56405c9eef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:56.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.031+0000 7f84668b4e00 1 -- 10.20.193.28:0/183924113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56405c9c31a0 con 0x56405ca62630 2026-02-20T03:29:56.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f840ffff640 1 -- 10.20.193.28:0/183924113 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f844c0117d0 con 0x56405ca62630 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f840ffff640 1 -- 10.20.193.28:0/183924113 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f844c011a90 con 0x56405ca62630 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f84668b4e00 10 client.19518 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f84668b4e00 1 -- 10.20.193.28:0/183924113 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x56405c970230 con 0x56405ca62630 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f840ffff640 1 -- 10.20.193.28:0/183924113 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f844c028030 con 0x56405ca62630 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f84668b4e00 10 client.19518 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f84668b4e00 10 client.19518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f84668b4e00 20 client.19518 populate_metadata read hostname 'trial028' 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f84668b4e00 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56405ca8b5b0 0x56405ca8da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f84668b4e00 4 client.19518 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:56.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.032+0000 7f84668b4e00 1 -- 10.20.193.28:0/183924113 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56405c9bd5b0 con 0x56405ca8b5b0 2026-02-20T03:29:56.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.056+0000 7f8461923640 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56405ca8b5b0 0x56405ca8da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:56.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.110+0000 7f8461923640 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56405ca8b5b0 0x56405ca8da00 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af51a00df2822f12 server_cookie=5527ba3171c484c1 in_seq=0 out_seq=0 2026-02-20T03:29:56.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.110+0000 7f840ffff640 10 client.19518 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f840ffff640 1 -- 10.20.193.28:0/183924113 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56405c9bd5b0 con 0x56405ca8b5b0 2026-02-20T03:29:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f840ffff640 10 client.19518 handle_command_reply: tid=0 2026-02-20T03:29:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f84668b4e00 1 client.19518 shutdown 2026-02-20T03:29:56.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f84668b4e00 1 -- 10.20.193.28:0/183924113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62630 msgr2=0x56405ca7ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:56.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f84668b4e00 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62630 0x56405ca7ccd0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f844c002a00 tx=0x7f844c0047e0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f84668b4e00 1 -- 10.20.193.28:0/183924113 shutdown_connections 2026-02-20T03:29:56.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f84668b4e00 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56405ca8b5b0 0x56405ca8da00 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f84668b4e00 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca68000 0x56405ca7b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f84668b4e00 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca62fb0 0x56405ca7d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f84668b4e00 1 --2- 10.20.193.28:0/183924113 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62630 0x56405ca7ccd0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f84668b4e00 1 -- 10.20.193.28:0/183924113 >> 10.20.193.28:0/183924113 conn(0x56405ca25290 msgr2=0x56405ca61440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:56.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.123+0000 7f840ffff640 0 client.19518 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:56.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.124+0000 7f84668b4e00 1 -- 10.20.193.28:0/183924113 shutdown_connections 2026-02-20T03:29:56.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.124+0000 7f84668b4e00 1 -- 10.20.193.28:0/183924113 wait complete. 2026-02-20T03:29:56.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.136+0000 7f84668b4e00 20 client.19518 trim_cache size 0 max 16384 2026-02-20T03:29:56.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.145+0000 7f84668b4e00 1 Processor -- start 2026-02-20T03:29:56.148 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.145+0000 7f84668b4e00 1 -- start start 2026-02-20T03:29:56.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.145+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 0x56405ca61520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.145+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca61a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.145+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 0x56405ca79c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.145+0000 7f84668b4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8404012780 con 0x56405ca62fb0 2026-02-20T03:29:56.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.145+0000 7f84668b4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f840400fff0 con 0x56405ca62630 2026-02-20T03:29:56.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.145+0000 7f84668b4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f840400de40 con 0x56405ca68000 2026-02-20T03:29:56.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f8461923640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca61a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:56.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f8461923640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca61a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44834/0 (socket says 10.20.193.28:44834) 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f8461923640 1 -- 10.20.193.28:0/4095670888 learned_addr learned my addr 10.20.193.28:0/4095670888 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f8461923640 1 -- 10.20.193.28:0/4095670888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 msgr2=0x56405ca79c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f8461923640 1 --2- 10.20.193.28:0/4095670888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 0x56405ca79c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f8461923640 1 -- 10.20.193.28:0/4095670888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 msgr2=0x56405ca61520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f8461923640 1 --2- 10.20.193.28:0/4095670888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 0x56405ca61520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f8461923640 1 -- 10.20.193.28:0/4095670888 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56405ca68750 con 0x56405ca62fb0 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f8461923640 1 --2- 10.20.193.28:0/4095670888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca61a60 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8450009a00 tx=0x7f845002f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e3a089acf674db server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f842a4e6640 1 -- 10.20.193.28:0/4095670888 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450048040 con 0x56405ca62fb0 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f842a4e6640 1 -- 10.20.193.28:0/4095670888 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8450033040 con 0x56405ca62fb0 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f842a4e6640 1 -- 10.20.193.28:0/4095670888 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84500d12b0 con 0x56405ca62fb0 2026-02-20T03:29:56.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f84668b4e00 1 -- 10.20.193.28:0/4095670888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 msgr2=0x56405ca61a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:56.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.146+0000 7f84668b4e00 1 --2- 10.20.193.28:0/4095670888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca61a60 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f8450009a00 tx=0x7f845002f260 comp rx=0 tx=0).stop 2026-02-20T03:29:56.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 -- 10.20.193.28:0/4095670888 shutdown_connections 2026-02-20T03:29:56.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 --2- 10.20.193.28:0/4095670888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 0x56405ca79c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 --2- 10.20.193.28:0/4095670888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca61a60 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 --2- 10.20.193.28:0/4095670888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 0x56405ca61520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 -- 10.20.193.28:0/4095670888 >> 10.20.193.28:0/4095670888 conn(0x56405ca25290 msgr2=0x56405ca7ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:56.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 -- 10.20.193.28:0/4095670888 shutdown_connections 2026-02-20T03:29:56.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 -- 10.20.193.28:0/4095670888 wait complete. 2026-02-20T03:29:56.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 -- start start 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 Processor -- start 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 0x56405ca82db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca832f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 0x56405ca7fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f840400e4b0 con 0x56405ca62fb0 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f840400f920 con 0x56405ca62630 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.147+0000 7f84668b4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f840400eb80 con 0x56405ca68000 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f8461923640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f8461923640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca832f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44846/0 (socket says 10.20.193.28:44846) 2026-02-20T03:29:56.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f8461923640 1 -- 10.20.193.28:0/1953429647 learned_addr learned my addr 10.20.193.28:0/1953429647 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f8461923640 1 -- 10.20.193.28:0/1953429647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 msgr2=0x56405ca7fb30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f8461923640 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 0x56405ca7fb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f8461923640 1 -- 10.20.193.28:0/1953429647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 msgr2=0x56405ca82db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f8461923640 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 0x56405ca82db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f8461923640 1 -- 10.20.193.28:0/1953429647 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56405ca74710 con 0x56405ca62fb0 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f8461923640 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca832f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f84500ccc00 tx=0x7f84500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f669e3896a14957 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f840ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f840ffff640 1 -- 10.20.193.28:0/1953429647 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450048040 con 0x56405ca62fb0 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f840ffff640 1 -- 10.20.193.28:0/1953429647 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84500d6160 con 0x56405ca62fb0 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f840ffff640 1 -- 10.20.193.28:0/1953429647 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8450102910 con 0x56405ca62fb0 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f84668b4e00 1 -- 10.20.193.28:0/1953429647 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56405c694870 con 0x56405ca62fb0 2026-02-20T03:29:56.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f840ffff640 1 -- 10.20.193.28:0/1953429647 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f84500c8f40 con 0x56405ca62fb0 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f840ffff640 10 client.19524 inactive, discarding osd_map(97..97 src has 1..97) 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f84668b4e00 10 client.19524 _ll_register_callbacks cb 0x7f844c004110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.148+0000 7f84668b4e00 1 -- 10.20.193.28:0/1953429647 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56405c967b00 con 0x56405ca62fb0 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f840ffff640 1 -- 10.20.193.28:0/1953429647 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f84500b50f0 con 0x56405ca62fb0 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f84668b4e00 10 client.19524 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f84668b4e00 1 -- 10.20.193.28:0/1953429647 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x56405c955440 con 0x56405ca62fb0 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f840ffff640 1 -- 10.20.193.28:0/1953429647 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f84500cc7c0 con 0x56405ca62fb0 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f84668b4e00 10 client.19524 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f84668b4e00 10 client.19524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f84668b4e00 20 client.19524 populate_metadata read hostname 'trial028' 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f84668b4e00 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56405caf69b0 0x56405caf8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:56.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f84668b4e00 4 client.19524 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:29:56.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.149+0000 7f84668b4e00 1 -- 10.20.193.28:0/1953429647 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f8450112070 con 0x56405caf69b0 2026-02-20T03:29:56.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.163+0000 7f8462124640 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56405caf69b0 0x56405caf8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:56.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.217+0000 7f8462124640 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56405caf69b0 0x56405caf8e70 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e66ed60553b5d02 server_cookie=4aefed15efae1dd3 in_seq=0 out_seq=0 2026-02-20T03:29:56.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.217+0000 7f840ffff640 10 client.19524 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:56.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f840ffff640 1 -- 10.20.193.28:0/1953429647 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f8450112070 con 0x56405caf69b0 2026-02-20T03:29:56.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f840ffff640 10 client.19524 handle_command_reply: tid=0 2026-02-20T03:29:56.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f84668b4e00 1 client.19524 shutdown 2026-02-20T03:29:56.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f84668b4e00 1 -- 10.20.193.28:0/1953429647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 msgr2=0x56405ca832f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:56.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f84668b4e00 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca832f0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f84500ccc00 tx=0x7f84500047c0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f84668b4e00 1 -- 10.20.193.28:0/1953429647 shutdown_connections 2026-02-20T03:29:56.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f84668b4e00 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56405caf69b0 0x56405caf8e70 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f84668b4e00 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56405ca68000 0x56405ca7fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f84668b4e00 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56405ca62fb0 0x56405ca832f0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f84668b4e00 1 --2- 10.20.193.28:0/1953429647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56405ca62630 0x56405ca82db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f840ffff640 0 client.19524 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:56.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.230+0000 7f84668b4e00 1 -- 10.20.193.28:0/1953429647 >> 10.20.193.28:0/1953429647 conn(0x56405ca25290 msgr2=0x56405ca79c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:56.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f84668b4e00 1 -- 10.20.193.28:0/1953429647 shutdown_connections 2026-02-20T03:29:56.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f84668b4e00 1 -- 10.20.193.28:0/1953429647 wait complete. 2026-02-20T03:29:56.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f84668b4e00 20 client.19524 trim_cache size 0 max 16384 2026-02-20T03:29:56.246 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:29:56.246 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:29:56.246 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:29:56.246 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:29:56.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 -- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84380b0d80 msgr2=0x7f84380b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:56.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84380b0d80 0x7f84380b3240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f844c009670 tx=0x7f844c006cd0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 -- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 msgr2=0x7f845c074c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:56.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 0x7f845c074c10 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f8450009950 tx=0x7f8450002910 comp rx=0 tx=0).stop 2026-02-20T03:29:56.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 -- 10.20.193.28:0/3792355744 shutdown_connections 2026-02-20T03:29:56.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84380b0d80 0x7f84380b3240 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f845c113840 0x7f845c06d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f845c077f40 0x7f845c074c10 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 --2- 10.20.193.28:0/3792355744 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f845c077620 0x7f845c0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:56.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 -- 10.20.193.28:0/3792355744 >> 10.20.193.28:0/3792355744 conn(0x7f845c1006c0 msgr2=0x7f845c102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:56.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.231+0000 7f8463126640 1 -- 10.20.193.28:0/3792355744 shutdown_connections 2026-02-20T03:29:56.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:56.232+0000 7f8463126640 1 -- 10.20.193.28:0/3792355744 wait complete. 2026-02-20T03:29:56.429 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:29:56.429 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:29:56.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 22.82 MB/sec warmup 87 sec latency 52723.938 ms 2026-02-20T03:29:56.753 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:57.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1ac57fa640 1 -- 10.20.193.28:0/1735585664 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: -115 ) ==== 8+0+595 (crc 0 0 0) 0x55e2303a8be0 con 0x55e230431b70 2026-02-20T03:29:57.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1ac57fa640 10 client.19338 handle_command_reply: tid=0 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 client.19338 shutdown 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/1735585664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 msgr2=0x55e2303bf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303bf1e0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f1af400ca70 tx=0x7f1af4004900 comp rx=0 tx=0).stop 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/1735585664 shutdown_connections 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e230431b70 0x55e230434030 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e2303a2170 0x55e2303bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e23039d220 0x55e2303bf1e0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 --2- 10.20.193.28:0/1735585664 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e23039c860 0x55e2303beca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/1735585664 >> 10.20.193.28:0/1735585664 conn(0x55e2303953c0 msgr2=0x55e23039dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1ac57fa640 0 client.19338 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/1735585664 shutdown_connections 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 1 -- 10.20.193.28:0/1735585664 wait complete. 2026-02-20T03:29:57.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.082+0000 7f1b0bfe1e00 20 client.19338 trim_cache size 0 max 16384 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 37, 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 45, 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "189aa5bc": { 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "version": 45, 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCING", 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "age": 45.0 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 141.5, 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:29:57.090 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCING", 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stdout: "age": 45.0 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stderr:Error EINPROGRESS: 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.085+0000 7f0d98a83640 1 -- 10.20.193.28:0/2243020551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 msgr2=0x7f0d94111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.085+0000 7f0d98a83640 1 --2- 10.20.193.28:0/2243020551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 0x7f0d94111860 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0d8800b0d0 tx=0x7f0d8802f490 comp rx=0 tx=0).stop 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.085+0000 7f0d98a83640 1 -- 10.20.193.28:0/2243020551 shutdown_connections 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.085+0000 7f0d98a83640 1 --2- 10.20.193.28:0/2243020551 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 0x7f0d94111860 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.085+0000 7f0d98a83640 1 --2- 10.20.193.28:0/2243020551 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d94104990 0x7f0d94104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.085+0000 7f0d98a83640 1 --2- 10.20.193.28:0/2243020551 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d9410a990 0x7f0d9410ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.085+0000 7f0d98a83640 1 -- 10.20.193.28:0/2243020551 >> 10.20.193.28:0/2243020551 conn(0x7f0d94100690 msgr2=0x7f0d94102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.086+0000 7f0d98a83640 1 -- 10.20.193.28:0/2243020551 shutdown_connections 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.086+0000 7f0d98a83640 1 -- 10.20.193.28:0/2243020551 wait complete. 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.086+0000 7f0d98a83640 1 Processor -- start 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d98a83640 1 -- start start 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d98a83640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d94104990 0x7f0d9419d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d98a83640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 0x7f0d9419d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d98a83640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d9410a990 0x7f0d941a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d98a83640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94114ce0 con 0x7f0d94105330 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d98a83640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94114b60 con 0x7f0d94104990 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d98a83640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d94114e60 con 0x7f0d9410a990 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d92ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 0x7f0d9419d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d92ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 0x7f0d9419d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44876/0 (socket says 10.20.193.28:44876) 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.087+0000 7f0d92ffd640 1 -- 10.20.193.28:0/1472359809 learned_addr learned my addr 10.20.193.28:0/1472359809 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d92ffd640 1 -- 10.20.193.28:0/1472359809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d9410a990 msgr2=0x7f0d941a1a90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d92ffd640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d9410a990 0x7f0d941a1a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d92ffd640 1 -- 10.20.193.28:0/1472359809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d94104990 msgr2=0x7f0d9419d1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d92ffd640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d94104990 0x7f0d9419d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d92ffd640 1 -- 10.20.193.28:0/1472359809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d941a2210 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d92ffd640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 0x7f0d9419d700 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400b570 tx=0x7f0d8400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d90ff9640 1 -- 10.20.193.28:0/1472359809 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d84013020 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d90ff9640 1 -- 10.20.193.28:0/1472359809 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d84004480 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d90ff9640 1 -- 10.20.193.28:0/1472359809 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400fb50 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d941a2500 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.088+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d941a9d40 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.089+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d941060d0 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.091+0000 7f0d90ff9640 1 -- 10.20.193.28:0/1472359809 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0d84002780 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.093+0000 7f0d90ff9640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d680b0e20 0x7f0d680b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.093+0000 7f0d90ff9640 1 -- 10.20.193.28:0/1472359809 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f0d840e09e0 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.093+0000 7f0d90ff9640 1 -- 10.20.193.28:0/1472359809 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0d8401d030 con 0x7f0d94105330 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.093+0000 7f0d937fe640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d680b0e20 0x7f0d680b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:57.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.094+0000 7f0d937fe640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d680b0e20 0x7f0d680b32e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009770 tx=0x7f0d80006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:57.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.202+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d94104e70 con 0x7f0d94105330 2026-02-20T03:29:57.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.203+0000 7f0d90ff9640 1 -- 10.20.193.28:0/1472359809 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11925 (secure 0 0 0) 0x7f0d94104e70 con 0x7f0d94105330 2026-02-20T03:29:57.206 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:29:57.206 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":37,"btime":"2026-02-20T03:29:33:388547+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:29:33.388504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28057":{"gid":28057,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/2019777772","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":2019777772},{"type":"v1","addr":"10.20.193.177:6837","nonce":2019777772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 37 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d680b0e20 msgr2=0x7f0d680b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d680b0e20 0x7f0d680b32e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009770 tx=0x7f0d80006cd0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 msgr2=0x7f0d9419d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 0x7f0d9419d700 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400b570 tx=0x7f0d8400ba40 comp rx=0 tx=0).stop 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 shutdown_connections 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d680b0e20 0x7f0d680b32e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d9410a990 0x7f0d941a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d94105330 0x7f0d9419d700 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 --2- 10.20.193.28:0/1472359809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d94104990 0x7f0d9419d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 >> 10.20.193.28:0/1472359809 conn(0x7f0d94100690 msgr2=0x7f0d94100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:57.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 shutdown_connections 2026-02-20T03:29:57.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.204+0000 7f0d98a83640 1 -- 10.20.193.28:0/1472359809 wait complete. 2026-02-20T03:29:57.266 DEBUG:teuthology.orchestra.run:got remote process result: 115 2026-02-20T03:29:57.268 WARNING:tasks.quiescer.fs.[cephfs]:Set '189aa5bc' hasn't quiesced after 46.8 seconds (timeout: 90). Dumping ops with locks from all ranks. 2026-02-20T03:29:57.268 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:29:57.427 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:29:57.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:57 trial028 ceph-mon[38552]: pgmap v642: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 10 KiB/s wr, 24 op/s 2026-02-20T03:29:57.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:57 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1472359809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:57.593 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:57.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 22.56 MB/sec warmup 88 sec latency 53723.973 ms 2026-02-20T03:29:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:57 trial177 ceph-mon[43181]: pgmap v642: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 10 KiB/s wr, 24 op/s 2026-02-20T03:29:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:57 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1472359809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:57.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:57 trial126 ceph-mon[38476]: pgmap v642: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 10 KiB/s wr, 24 op/s 2026-02-20T03:29:57.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:57 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1472359809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:57.979 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:57.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.993+0000 7f178f577640 1 -- 10.20.193.28:0/870927063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1790109220 msgr2=0x7f1790109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:57.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.993+0000 7f178f577640 1 --2- 10.20.193.28:0/870927063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1790109220 0x7f1790109660 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f1778009a30 tx=0x7f177802f260 comp rx=0 tx=0).stop 2026-02-20T03:29:57.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.993+0000 7f178f577640 1 -- 10.20.193.28:0/870927063 shutdown_connections 2026-02-20T03:29:57.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.993+0000 7f178f577640 1 --2- 10.20.193.28:0/870927063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1790109ba0 0x7f1790115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.993+0000 7f178f577640 1 --2- 10.20.193.28:0/870927063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1790109220 0x7f1790109660 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.993+0000 7f178f577640 1 --2- 10.20.193.28:0/870927063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f179010eef0 0x7f179010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:57.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.993+0000 7f178f577640 1 -- 10.20.193.28:0/870927063 >> 10.20.193.28:0/870927063 conn(0x7f1790078600 msgr2=0x7f179007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.994+0000 7f178f577640 1 -- 10.20.193.28:0/870927063 shutdown_connections 2026-02-20T03:29:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.994+0000 7f178f577640 1 -- 10.20.193.28:0/870927063 wait complete. 2026-02-20T03:29:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.995+0000 7f178f577640 1 Processor -- start 2026-02-20T03:29:57.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.995+0000 7f178f577640 1 -- start start 2026-02-20T03:29:58.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.995+0000 7f178f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1790109220 0x7f17901a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.995+0000 7f178f577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1790109ba0 0x7f17901a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.995+0000 7f178f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179010eef0 0x7f17901a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.995+0000 7f178f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f17901191b0 con 0x7f179010eef0 2026-02-20T03:29:58.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.995+0000 7f178f577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1790119030 con 0x7f1790109ba0 2026-02-20T03:29:58.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.995+0000 7f178f577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1790119330 con 0x7f1790109220 2026-02-20T03:29:58.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179010eef0 0x7f17901a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179010eef0 0x7f17901a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44896/0 (socket says 10.20.193.28:44896) 2026-02-20T03:29:58.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178ed76640 1 -- 10.20.193.28:0/1101352174 learned_addr learned my addr 10.20.193.28:0/1101352174 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178ed76640 1 -- 10.20.193.28:0/1101352174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1790109220 msgr2=0x7f17901a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178ed76640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1790109220 0x7f17901a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178ed76640 1 -- 10.20.193.28:0/1101352174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1790109ba0 msgr2=0x7f17901a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178ed76640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1790109ba0 0x7f17901a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178ed76640 1 -- 10.20.193.28:0/1101352174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17901a66c0 con 0x7f179010eef0 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178ed76640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179010eef0 0x7f17901a5f40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f178000b990 tx=0x7f178000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f17777fe640 1 -- 10.20.193.28:0/1101352174 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780006e60 con 0x7f179010eef0 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f17777fe640 1 -- 10.20.193.28:0/1101352174 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1780010070 con 0x7f179010eef0 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17901a69b0 con 0x7f179010eef0 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f17777fe640 1 -- 10.20.193.28:0/1101352174 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780004800 con 0x7f179010eef0 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.996+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17901ae1f0 con 0x7f179010eef0 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.997+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1790109660 con 0x7f179010eef0 2026-02-20T03:29:58.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:57.999+0000 7f17777fe640 1 -- 10.20.193.28:0/1101352174 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f178001d030 con 0x7f179010eef0 2026-02-20T03:29:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.001+0000 7f17777fe640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f17680b0da0 0x7f17680b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.001+0000 7f17777fe640 1 -- 10.20.193.28:0/1101352174 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f17800e0480 con 0x7f179010eef0 2026-02-20T03:29:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.001+0000 7f17777fe640 1 -- 10.20.193.28:0/1101352174 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f17800e09a0 con 0x7f179010eef0 2026-02-20T03:29:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.001+0000 7f178e575640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f17680b0da0 0x7f17680b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.002+0000 7f178e575640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f17680b0da0 0x7f17680b3260 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1784009770 tx=0x7f1784006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.110+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17901a29d0 con 0x7f179010eef0 2026-02-20T03:29:58.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.111+0000 7f17777fe640 1 -- 10.20.193.28:0/1101352174 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11925 (secure 0 0 0) 0x7f178001c2f0 con 0x7f179010eef0 2026-02-20T03:29:58.124 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:29:58.124 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":37,"btime":"2026-02-20T03:29:33:388547+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:29:33.388504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28057":{"gid":28057,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/2019777772","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":2019777772},{"type":"v1","addr":"10.20.193.177:6837","nonce":2019777772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:29:58.124 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 37 2026-02-20T03:29:58.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f17680b0da0 msgr2=0x7f17680b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f17680b0da0 0x7f17680b3260 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1784009770 tx=0x7f1784006cd0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179010eef0 msgr2=0x7f17901a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179010eef0 0x7f17901a5f40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f178000b990 tx=0x7f178000be60 comp rx=0 tx=0).stop 2026-02-20T03:29:58.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 shutdown_connections 2026-02-20T03:29:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f17680b0da0 0x7f17680b3260 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f179010eef0 0x7f17901a5f40 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1790109ba0 0x7f17901a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 --2- 10.20.193.28:0/1101352174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1790109220 0x7f17901a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 >> 10.20.193.28:0/1101352174 conn(0x7f1790078600 msgr2=0x7f1790079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 shutdown_connections 2026-02-20T03:29:58.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.112+0000 7f178f577640 1 -- 10.20.193.28:0/1101352174 wait complete. 2026-02-20T03:29:58.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.221+0000 7f1c7c89a640 1 -- 10.20.193.28:0/3974244711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78077620 msgr2=0x7f1c78077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.221+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/3974244711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78077620 0x7f1c78077a00 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009a30 tx=0x7f1c6402f260 comp rx=0 tx=0).stop 2026-02-20T03:29:58.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.221+0000 7f1c7c89a640 1 -- 10.20.193.28:0/3974244711 shutdown_connections 2026-02-20T03:29:58.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.221+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/3974244711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1c78113820 0x7f1c78115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.221+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/3974244711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c78077f40 0x7f1c781132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.221+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/3974244711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78077620 0x7f1c78077a00 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.221+0000 7f1c7c89a640 1 -- 10.20.193.28:0/3974244711 >> 10.20.193.28:0/3974244711 conn(0x7f1c78100680 msgr2=0x7f1c78102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.221+0000 7f1c7c89a640 1 -- 10.20.193.28:0/3974244711 shutdown_connections 2026-02-20T03:29:58.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.222+0000 7f1c7c89a640 1 -- 10.20.193.28:0/3974244711 wait complete. 2026-02-20T03:29:58.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.222+0000 7f1c7c89a640 1 Processor -- start 2026-02-20T03:29:58.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.222+0000 7f1c7c89a640 1 -- start start 2026-02-20T03:29:58.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c7c89a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1c78077620 0x7f1c781a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c7c89a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c78077f40 0x7f1c781a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c7c89a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78113820 0x7f1c781a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c7c89a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1c781191c0 con 0x7f1c78113820 2026-02-20T03:29:58.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c7c89a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78119040 con 0x7f1c78077620 2026-02-20T03:29:58.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c7c89a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78119340 con 0x7f1c78077f40 2026-02-20T03:29:58.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c77fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78113820 0x7f1c781a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c77fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78113820 0x7f1c781a5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44924/0 (socket says 10.20.193.28:44924) 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c77fff640 1 -- 10.20.193.28:0/2726870114 learned_addr learned my addr 10.20.193.28:0/2726870114 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c77fff640 1 -- 10.20.193.28:0/2726870114 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c78077f40 msgr2=0x7f1c781a1be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.223+0000 7f1c77fff640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c78077f40 0x7f1c781a1be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.224+0000 7f1c77fff640 1 -- 10.20.193.28:0/2726870114 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1c78077620 msgr2=0x7f1c781a16a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.224+0000 7f1c77fff640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1c78077620 0x7f1c781a16a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.224+0000 7f1c77fff640 1 -- 10.20.193.28:0/2726870114 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c781a66f0 con 0x7f1c78113820 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.224+0000 7f1c77fff640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78113820 0x7f1c781a5f70 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00b990 tx=0x7f1c6c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.224+0000 7f1c74ff9640 1 -- 10.20.193.28:0/2726870114 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c006e60 con 0x7f1c78113820 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.224+0000 7f1c7c89a640 1 -- 10.20.193.28:0/2726870114 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c781a69e0 con 0x7f1c78113820 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.224+0000 7f1c7c89a640 1 -- 10.20.193.28:0/2726870114 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c781ae220 con 0x7f1c78113820 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.224+0000 7f1c74ff9640 1 -- 10.20.193.28:0/2726870114 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1c6c010070 con 0x7f1c78113820 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.224+0000 7f1c74ff9640 1 -- 10.20.193.28:0/2726870114 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0047c0 con 0x7f1c78113820 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.227+0000 7f1c74ff9640 1 -- 10.20.193.28:0/2726870114 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1c6c00c790 con 0x7f1c78113820 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c80028e00 1 Processor -- start 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c80028e00 1 -- start start 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44f4fb0 0x55fae44f5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44ef5e0 0x55fae44efa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44eff60 0x55fae44fbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c80028e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fae446fe00 con 0x55fae44ef5e0 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c80028e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fae4442970 con 0x55fae44f4fb0 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c80028e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fae43f01f0 con 0x55fae44eff60 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44ef5e0 0x55fae44efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44ef5e0 0x55fae44efa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44934/0 (socket says 10.20.193.28:44934) 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.228+0000 7f1c777fe640 1 -- 10.20.193.28:0/3781823476 learned_addr learned my addr 10.20.193.28:0/3781823476 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c777fe640 1 -- 10.20.193.28:0/3781823476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44eff60 msgr2=0x55fae44fbde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c777fe640 1 --2- 10.20.193.28:0/3781823476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44eff60 0x55fae44fbde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c777fe640 1 -- 10.20.193.28:0/3781823476 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44f4fb0 msgr2=0x55fae44f5390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c777fe640 1 --2- 10.20.193.28:0/3781823476 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44f4fb0 0x55fae44f5390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c777fe640 1 -- 10.20.193.28:0/3781823476 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fae44033d0 con 0x55fae44ef5e0 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c777fe640 1 --2- 10.20.193.28:0/3781823476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44ef5e0 0x55fae44efa20 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1c64032040 tx=0x7f1c64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0b18f21efccf2f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c74ff9640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1c4c0b0e20 0x7f1c4c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c74ff9640 1 -- 10.20.193.28:0/2726870114 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f1c6c0e0380 con 0x7f1c78113820 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c3bfff640 1 -- 10.20.193.28:0/3781823476 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c640384f0 con 0x55fae44ef5e0 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c3bfff640 1 -- 10.20.193.28:0/3781823476 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1c64033040 con 0x55fae44ef5e0 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c3bfff640 1 -- 10.20.193.28:0/3781823476 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c640043b0 con 0x55fae44ef5e0 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c80028e00 1 -- 10.20.193.28:0/3781823476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44ef5e0 msgr2=0x55fae44efa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c80028e00 1 --2- 10.20.193.28:0/3781823476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44ef5e0 0x55fae44efa20 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1c64032040 tx=0x7f1c64005880 comp rx=0 tx=0).stop 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c80028e00 1 -- 10.20.193.28:0/3781823476 shutdown_connections 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c80028e00 1 --2- 10.20.193.28:0/3781823476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44eff60 0x55fae44fbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c80028e00 1 --2- 10.20.193.28:0/3781823476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44ef5e0 0x55fae44efa20 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c80028e00 1 --2- 10.20.193.28:0/3781823476 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44f4fb0 0x55fae44f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c76ffd640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1c4c0b0e20 0x7f1c4c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.229+0000 7f1c80028e00 1 -- 10.20.193.28:0/3781823476 >> 10.20.193.28:0/3781823476 conn(0x55fae44b2240 msgr2=0x55fae44edce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.230+0000 7f1c80028e00 1 -- 10.20.193.28:0/3781823476 shutdown_connections 2026-02-20T03:29:58.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.230+0000 7f1c80028e00 1 -- 10.20.193.28:0/3781823476 wait complete. 2026-02-20T03:29:58.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.231+0000 7f1c80028e00 1 -- start start 2026-02-20T03:29:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.231+0000 7f1c80028e00 1 Processor -- start 2026-02-20T03:29:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.231+0000 7f1c76ffd640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1c4c0b0e20 0x7f1c4c0b32e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1c68006fd0 tx=0x7f1c68006d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 0x55fae4509bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44eff60 0x55fae450a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44f4fb0 0x55fae4508300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c80028e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fae443e8a0 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c80028e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fae4230f50 con 0x55fae44ef5e0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c80028e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fae4508a80 con 0x55fae44eff60 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c77fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44f4fb0 0x55fae4508300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c77fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44f4fb0 0x55fae4508300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44940/0 (socket says 10.20.193.28:44940) 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c77fff640 1 -- 10.20.193.28:0/4247798579 learned_addr learned my addr 10.20.193.28:0/4247798579 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c77fff640 1 -- 10.20.193.28:0/4247798579 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44eff60 msgr2=0x55fae450a100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c77fff640 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44eff60 0x55fae450a100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c77fff640 1 -- 10.20.193.28:0/4247798579 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 msgr2=0x55fae4509bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c77fff640 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 0x55fae4509bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c77fff640 1 -- 10.20.193.28:0/4247798579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fae4501ad0 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c77fff640 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44f4fb0 0x55fae4508300 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0a3e90 tx=0x7f1c6c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc36c021ec28c4ac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c397fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.232+0000 7f1c397fa640 1 -- 10.20.193.28:0/4247798579 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0e0170 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c397fa640 1 -- 10.20.193.28:0/4247798579 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1c6c0a8760 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c397fa640 1 -- 10.20.193.28:0/4247798579 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0a39e0 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 1 -- 10.20.193.28:0/4247798579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fae4213b40 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c397fa640 1 -- 10.20.193.28:0/4247798579 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f1c6c0900d0 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 10 client.19548 _ll_register_callbacks cb 0x55fae447beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 1 -- 10.20.193.28:0/4247798579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fae4450150 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c397fa640 1 -- 10.20.193.28:0/4247798579 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f1c6c0ac410 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 10 client.19548 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 1 -- 10.20.193.28:0/4247798579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55fae43fd1e0 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c397fa640 1 -- 10.20.193.28:0/4247798579 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f1c6c0902d0 con 0x55fae44f4fb0 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 10 client.19548 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 10 client.19548 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 20 client.19548 populate_metadata read hostname 'trial028' 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fae4518430 0x55fae451a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 4 client.19548 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.233+0000 7f1c80028e00 1 -- 10.20.193.28:0/4247798579 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fae444a560 con 0x55fae4518430 2026-02-20T03:29:58.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.244+0000 7f1c777fe640 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fae4518430 0x55fae451a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.281+0000 7f1c777fe640 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fae4518430 0x55fae451a8f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce1a93b52d47b538 server_cookie=f9f82509bcb2a56f in_seq=0 out_seq=0 2026-02-20T03:29:58.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.281+0000 7f1c397fa640 10 client.19548 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:58.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.307+0000 7f1c397fa640 1 -- 10.20.193.28:0/4247798579 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fae444a560 con 0x55fae4518430 2026-02-20T03:29:58.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.307+0000 7f1c397fa640 10 client.19548 handle_command_reply: tid=0 2026-02-20T03:29:58.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.307+0000 7f1c80028e00 1 client.19548 shutdown 2026-02-20T03:29:58.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 -- 10.20.193.28:0/4247798579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44f4fb0 msgr2=0x55fae4508300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44f4fb0 0x55fae4508300 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0a3e90 tx=0x7f1c6c00cd30 comp rx=0 tx=0).stop 2026-02-20T03:29:58.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 -- 10.20.193.28:0/4247798579 shutdown_connections 2026-02-20T03:29:58.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fae4518430 0x55fae451a8f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44f4fb0 0x55fae4508300 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44eff60 0x55fae450a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4247798579 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 0x55fae4509bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 -- 10.20.193.28:0/4247798579 >> 10.20.193.28:0/4247798579 conn(0x55fae44b2240 msgr2=0x55fae44ee3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c397fa640 0 client.19548 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 -- 10.20.193.28:0/4247798579 shutdown_connections 2026-02-20T03:29:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 1 -- 10.20.193.28:0/4247798579 wait complete. 2026-02-20T03:29:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.308+0000 7f1c80028e00 20 client.19548 trim_cache size 0 max 16384 2026-02-20T03:29:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.315+0000 7f1c80028e00 1 Processor -- start 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.315+0000 7f1c80028e00 1 -- start start 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.315+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 0x55fae45058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.315+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4505df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.315+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44f4fb0 0x55fae4520200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.315+0000 7f1c80028e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c0126b0 con 0x55fae44eff60 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.315+0000 7f1c80028e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c00ff20 con 0x55fae44ef5e0 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.315+0000 7f1c80028e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c00dd70 con 0x55fae44f4fb0 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c76ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4505df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c76ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4505df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44956/0 (socket says 10.20.193.28:44956) 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c76ffd640 1 -- 10.20.193.28:0/3517757181 learned_addr learned my addr 10.20.193.28:0/3517757181 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c76ffd640 1 -- 10.20.193.28:0/3517757181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44f4fb0 msgr2=0x55fae4520200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c76ffd640 1 --2- 10.20.193.28:0/3517757181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44f4fb0 0x55fae4520200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c76ffd640 1 -- 10.20.193.28:0/3517757181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 msgr2=0x55fae45058b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c76ffd640 1 --2- 10.20.193.28:0/3517757181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 0x55fae45058b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c76ffd640 1 -- 10.20.193.28:0/3517757181 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fae4501900 con 0x55fae44eff60 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c76ffd640 1 --2- 10.20.193.28:0/3517757181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4505df0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009fd0 tx=0x7f1c6800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f21d5fe504a7f3f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c3b7fe640 1 -- 10.20.193.28:0/3517757181 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800b730 con 0x55fae44eff60 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c3b7fe640 1 -- 10.20.193.28:0/3517757181 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1c6800bd70 con 0x55fae44eff60 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.316+0000 7f1c3b7fe640 1 -- 10.20.193.28:0/3517757181 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68011d40 con 0x55fae44eff60 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 -- 10.20.193.28:0/3517757181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 msgr2=0x55fae4505df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 --2- 10.20.193.28:0/3517757181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4505df0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009fd0 tx=0x7f1c6800e000 comp rx=0 tx=0).stop 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 -- 10.20.193.28:0/3517757181 shutdown_connections 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 --2- 10.20.193.28:0/3517757181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44f4fb0 0x55fae4520200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 --2- 10.20.193.28:0/3517757181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4505df0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 --2- 10.20.193.28:0/3517757181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 0x55fae45058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 -- 10.20.193.28:0/3517757181 >> 10.20.193.28:0/3517757181 conn(0x55fae44b2240 msgr2=0x55fae4507380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 -- 10.20.193.28:0/3517757181 shutdown_connections 2026-02-20T03:29:58.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 -- 10.20.193.28:0/3517757181 wait complete. 2026-02-20T03:29:58.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.317+0000 7f1c80028e00 1 -- start start 2026-02-20T03:29:58.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c80028e00 1 Processor -- start 2026-02-20T03:29:58.323 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 2 (h) to a remote file /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.h.json 2026-02-20T03:29:58.324 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 ops --flags=locks --path=/var/run/ceph/ops-189aa5bc-1-mds.h.json 2026-02-20T03:29:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 0x55fae4510ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4511020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c80028e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44f4fb0 0x55fae4511560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c80028e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c00e3e0 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c80028e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c00f850 con 0x55fae44ef5e0 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c80028e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c00eab0 con 0x55fae44f4fb0 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c76ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4511020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c76ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4511020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44970/0 (socket says 10.20.193.28:44970) 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c76ffd640 1 -- 10.20.193.28:0/4051401530 learned_addr learned my addr 10.20.193.28:0/4051401530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c76ffd640 1 -- 10.20.193.28:0/4051401530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44f4fb0 msgr2=0x55fae4511560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c76ffd640 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44f4fb0 0x55fae4511560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c76ffd640 1 -- 10.20.193.28:0/4051401530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 msgr2=0x55fae4510ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c76ffd640 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 0x55fae4510ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.318+0000 7f1c76ffd640 1 -- 10.20.193.28:0/4051401530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fae4121870 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c76ffd640 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4511020 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1c6801d000 tx=0x7f1c68009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9831c64576dac50 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c397fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c397fa640 1 -- 10.20.193.28:0/4051401530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68011bd0 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c397fa640 1 -- 10.20.193.28:0/4051401530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1c68011d70 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c397fa640 1 -- 10.20.193.28:0/4051401530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68013c80 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c80028e00 1 -- 10.20.193.28:0/4051401530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fae43e23f0 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c397fa640 1 -- 10.20.193.28:0/4051401530 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f1c68029440 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c397fa640 10 client.19554 inactive, discarding osd_map(97..97 src has 1..97) 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c80028e00 10 client.19554 _ll_register_callbacks cb 0x7f1c6c0098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c80028e00 1 -- 10.20.193.28:0/4051401530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c64033040 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c397fa640 1 -- 10.20.193.28:0/4051401530 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f1c68013e20 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c80028e00 10 client.19554 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.319+0000 7f1c80028e00 1 -- 10.20.193.28:0/4051401530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55fae45025f0 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.320+0000 7f1c397fa640 1 -- 10.20.193.28:0/4051401530 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f1c68027070 con 0x55fae44eff60 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.320+0000 7f1c80028e00 10 client.19554 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.320+0000 7f1c80028e00 10 client.19554 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.320+0000 7f1c80028e00 20 client.19554 populate_metadata read hostname 'trial028' 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.320+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fae4584840 0x55fae4586d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.320+0000 7f1c80028e00 4 client.19554 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:29:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.320+0000 7f1c80028e00 1 -- 10.20.193.28:0/4051401530 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fae44137c0 con 0x55fae4584840 2026-02-20T03:29:58.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.334+0000 7f1c777fe640 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fae4584840 0x55fae4586d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.388+0000 7f1c777fe640 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fae4584840 0x55fae4586d00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=579dfc672bd8a26 server_cookie=a733223d7f5016f9 in_seq=0 out_seq=0 2026-02-20T03:29:58.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.388+0000 7f1c397fa640 10 client.19554 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c397fa640 1 -- 10.20.193.28:0/4051401530 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fae44137c0 con 0x55fae4584840 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c397fa640 10 client.19554 handle_command_reply: tid=0 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 client.19554 shutdown 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 -- 10.20.193.28:0/4051401530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 msgr2=0x55fae4511020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4511020 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f1c6801d000 tx=0x7f1c68009f30 comp rx=0 tx=0).stop 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 -- 10.20.193.28:0/4051401530 shutdown_connections 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fae44f4fb0 0x55fae4511560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55fae4584840 0x55fae4586d00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fae44eff60 0x55fae4511020 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 --2- 10.20.193.28:0/4051401530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fae44ef5e0 0x55fae4510ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 -- 10.20.193.28:0/4051401530 >> 10.20.193.28:0/4051401530 conn(0x55fae44b2240 msgr2=0x55fae4518810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c397fa640 0 client.19554 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 -- 10.20.193.28:0/4051401530 shutdown_connections 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 1 -- 10.20.193.28:0/4051401530 wait complete. 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.401+0000 7f1c80028e00 20 client.19554 trim_cache size 0 max 16384 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 -- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1c4c0b0e20 msgr2=0x7f1c4c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1c4c0b0e20 0x7f1c4c0b32e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1c68006fd0 tx=0x7f1c68006d60 comp rx=0 tx=0).stop 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 -- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78113820 msgr2=0x7f1c781a5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78113820 0x7f1c781a5f70 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00b990 tx=0x7f1c6c00be60 comp rx=0 tx=0).stop 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 -- 10.20.193.28:0/2726870114 shutdown_connections 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1c4c0b0e20 0x7f1c4c0b32e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1c78113820 0x7f1c781a5f70 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1c78077f40 0x7f1c781a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 --2- 10.20.193.28:0/2726870114 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1c78077620 0x7f1c781a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.402+0000 7f1c7c89a640 1 -- 10.20.193.28:0/2726870114 >> 10.20.193.28:0/2726870114 conn(0x7f1c78100680 msgr2=0x7f1c78113e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.403+0000 7f1c7c89a640 1 -- 10.20.193.28:0/2726870114 shutdown_connections 2026-02-20T03:29:58.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:58.403+0000 7f1c7c89a640 1 -- 10.20.193.28:0/2726870114 wait complete. 2026-02-20T03:29:58.496 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:29:58.539 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:58 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1101352174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:58.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 22.30 MB/sec warmup 89 sec latency 54724.015 ms 2026-02-20T03:29:58.711 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:58 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1101352174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:58.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.742+0000 7f2d56a74640 1 -- 10.20.193.28:0/1358361077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d48098c30 msgr2=0x7f2d480990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.742+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1358361077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d48098c30 0x7f2d480990b0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009a30 tx=0x7f2d4002f260 comp rx=0 tx=0).stop 2026-02-20T03:29:58.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 -- 10.20.193.28:0/1358361077 shutdown_connections 2026-02-20T03:29:58.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1358361077 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d480995f0 0x7f2d4809fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1358361077 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d48098c30 0x7f2d480990b0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1358361077 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d48097a40 0x7f2d48097e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 -- 10.20.193.28:0/1358361077 >> 10.20.193.28:0/1358361077 conn(0x7f2d480931a0 msgr2=0x7f2d480955e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 -- 10.20.193.28:0/1358361077 shutdown_connections 2026-02-20T03:29:58.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 -- 10.20.193.28:0/1358361077 wait complete. 2026-02-20T03:29:58.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 Processor -- start 2026-02-20T03:29:58.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 -- start start 2026-02-20T03:29:58.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.743+0000 7f2d56a74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d48097a40 0x7f2d481341a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d56a74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d48098c30 0x7f2d481346e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d56a74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d480995f0 0x7f2d4813b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d56a74640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48009f00 con 0x7f2d480995f0 2026-02-20T03:29:58.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d56a74640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48009d80 con 0x7f2d48098c30 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d56a74640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4800a080 con 0x7f2d48097a40 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d54fea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d480995f0 0x7f2d4813b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d54fea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d480995f0 0x7f2d4813b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44994/0 (socket says 10.20.193.28:44994) 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d54fea640 1 -- 10.20.193.28:0/1573174998 learned_addr learned my addr 10.20.193.28:0/1573174998 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d54fea640 1 -- 10.20.193.28:0/1573174998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d48097a40 msgr2=0x7f2d481341a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d54fea640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d48097a40 0x7f2d481341a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d54fea640 1 -- 10.20.193.28:0/1573174998 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d48098c30 msgr2=0x7f2d481346e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d54fea640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d48098c30 0x7f2d481346e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d54fea640 1 -- 10.20.193.28:0/1573174998 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d480a2510 con 0x7f2d480995f0 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d54fea640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d480995f0 0x7f2d4813b750 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400b990 tx=0x7f2d4400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d4d7fa640 1 -- 10.20.193.28:0/1573174998 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44006e60 con 0x7f2d480995f0 2026-02-20T03:29:58.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d4d7fa640 1 -- 10.20.193.28:0/1573174998 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d44010070 con 0x7f2d480995f0 2026-02-20T03:29:58.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d4d7fa640 1 -- 10.20.193.28:0/1573174998 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44004800 con 0x7f2d480995f0 2026-02-20T03:29:58.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.744+0000 7f2d56a74640 1 -- 10.20.193.28:0/1573174998 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d480a2800 con 0x7f2d480995f0 2026-02-20T03:29:58.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.745+0000 7f2d56a74640 1 -- 10.20.193.28:0/1573174998 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d480a2d80 con 0x7f2d480995f0 2026-02-20T03:29:58.751 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.747+0000 7f2d4d7fa640 1 -- 10.20.193.28:0/1573174998 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2d4401d030 con 0x7f2d480995f0 2026-02-20T03:29:58.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.748+0000 7f2d4d7fa640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d240b0e20 0x7f2d240b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.749+0000 7f2d4d7fa640 1 -- 10.20.193.28:0/1573174998 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f2d440dfff0 con 0x7f2d480995f0 2026-02-20T03:29:58.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.749+0000 7f2d4ffff640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d240b0e20 0x7f2d240b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.749+0000 7f2d598d7e00 1 Processor -- start 2026-02-20T03:29:58.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d598d7e00 1 -- start start 2026-02-20T03:29:58.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddbe80 0x55b13fddc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fde0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fde1560 0x55b13fde39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b13fd2c8f0 con 0x55b13fddc7c0 2026-02-20T03:29:58.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b13fcda2e0 con 0x55b13fde1560 2026-02-20T03:29:58.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b13fd28820 con 0x55b13fddbe80 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fde0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fde0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45008/0 (socket says 10.20.193.28:45008) 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4f7fe640 1 -- 10.20.193.28:0/135844197 learned_addr learned my addr 10.20.193.28:0/135844197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4ffff640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d240b0e20 0x7f2d240b32e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2d48098a90 tx=0x7f2d3c006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4f7fe640 1 -- 10.20.193.28:0/135844197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddbe80 msgr2=0x55b13fddc280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4f7fe640 1 --2- 10.20.193.28:0/135844197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddbe80 0x55b13fddc280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4f7fe640 1 -- 10.20.193.28:0/135844197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fde1560 msgr2=0x55b13fde39f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4f7fe640 1 --2- 10.20.193.28:0/135844197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fde1560 0x55b13fde39f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4f7fe640 1 -- 10.20.193.28:0/135844197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b13fccc5a0 con 0x55b13fddc7c0 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.750+0000 7f2d4f7fe640 1 --2- 10.20.193.28:0/135844197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fde0f40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f2d40002b60 tx=0x7f2d40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f273daa35e78b66 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d20bfe640 1 -- 10.20.193.28:0/135844197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40038470 con 0x55b13fddc7c0 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d20bfe640 1 -- 10.20.193.28:0/135844197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d40033040 con 0x55b13fddc7c0 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d20bfe640 1 -- 10.20.193.28:0/135844197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d400044d0 con 0x55b13fddc7c0 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d598d7e00 1 -- 10.20.193.28:0/135844197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 msgr2=0x55b13fde0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/135844197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fde0f40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f2d40002b60 tx=0x7f2d40005880 comp rx=0 tx=0).stop 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d598d7e00 1 -- 10.20.193.28:0/135844197 shutdown_connections 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/135844197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fde1560 0x55b13fde39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/135844197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fde0f40 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/135844197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddbe80 0x55b13fddc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d598d7e00 1 -- 10.20.193.28:0/135844197 >> 10.20.193.28:0/135844197 conn(0x55b13fdd36f0 msgr2=0x55b13fdda570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d598d7e00 1 -- 10.20.193.28:0/135844197 shutdown_connections 2026-02-20T03:29:58.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.751+0000 7f2d598d7e00 1 -- 10.20.193.28:0/135844197 wait complete. 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d598d7e00 1 -- start start 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d598d7e00 1 Processor -- start 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fddbe80 0x55b13fdf49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddc7c0 0x55b13fdf4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fde1560 0x55b13fdfbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b13fcd40c0 con 0x55b13fde1560 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b13fde45b0 con 0x55b13fddbe80 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b13fdfc440 con 0x55b13fddc7c0 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d54fea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fde1560 0x55b13fdfbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d54fea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fde1560 0x55b13fdfbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45010/0 (socket says 10.20.193.28:45010) 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.753+0000 7f2d54fea640 1 -- 10.20.193.28:0/3669788935 learned_addr learned my addr 10.20.193.28:0/3669788935 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d54fea640 1 -- 10.20.193.28:0/3669788935 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddc7c0 msgr2=0x55b13fdf4f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d54fea640 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddc7c0 0x55b13fdf4f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d54fea640 1 -- 10.20.193.28:0/3669788935 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fddbe80 msgr2=0x55b13fdf49f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d54fea640 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fddbe80 0x55b13fdf49f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d54fea640 1 -- 10.20.193.28:0/3669788935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b13fdee120 con 0x55b13fde1560 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d54fea640 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fde1560 0x55b13fdfbeb0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f2d440a4d50 tx=0x7f2d440a7430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b682e7a0be611ff1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d11ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:58.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d11ffb640 1 -- 10.20.193.28:0/3669788935 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d440c8e60 con 0x55b13fde1560 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d11ffb640 1 -- 10.20.193.28:0/3669788935 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d4401c2f0 con 0x55b13fde1560 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d11ffb640 1 -- 10.20.193.28:0/3669788935 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d440a3450 con 0x55b13fde1560 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d598d7e00 1 -- 10.20.193.28:0/3669788935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b13fce8820 con 0x55b13fde1560 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d11ffb640 1 -- 10.20.193.28:0/3669788935 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f2d440a35f0 con 0x55b13fde1560 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d598d7e00 10 client.19566 _ll_register_callbacks cb 0x55b13fcd7ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d598d7e00 1 -- 10.20.193.28:0/3669788935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b13fd344e0 con 0x55b13fde1560 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d11ffb640 1 -- 10.20.193.28:0/3669788935 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2d440ce1c0 con 0x55b13fde1560 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d598d7e00 10 client.19566 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.754+0000 7f2d598d7e00 1 -- 10.20.193.28:0/3669788935 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55b13fced380 con 0x55b13fde1560 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.755+0000 7f2d11ffb640 1 -- 10.20.193.28:0/3669788935 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f2d440ae310 con 0x55b13fde1560 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.755+0000 7f2d598d7e00 10 client.19566 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.755+0000 7f2d598d7e00 10 client.19566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.755+0000 7f2d598d7e00 20 client.19566 populate_metadata read hostname 'trial028' 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.755+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b13fe00780 0x55b13fe02c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.755+0000 7f2d598d7e00 4 client.19566 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:58.764 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.755+0000 7f2d598d7e00 1 -- 10.20.193.28:0/3669788935 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b13fcaebd0 con 0x55b13fe00780 2026-02-20T03:29:58.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.774+0000 7f2d4ffff640 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b13fe00780 0x55b13fe02c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.840+0000 7f2d4ffff640 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b13fe00780 0x55b13fe02c40 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20081a4167c77df1 server_cookie=ad73935bc7d32a0e in_seq=0 out_seq=0 2026-02-20T03:29:58.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.840+0000 7f2d11ffb640 10 client.19566 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:58.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:58 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1101352174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:29:58.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d11ffb640 1 -- 10.20.193.28:0/3669788935 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b13fcaebd0 con 0x55b13fe00780 2026-02-20T03:29:58.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d11ffb640 10 client.19566 handle_command_reply: tid=0 2026-02-20T03:29:58.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 client.19566 shutdown 2026-02-20T03:29:58.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 -- 10.20.193.28:0/3669788935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fde1560 msgr2=0x55b13fdfbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fde1560 0x55b13fdfbeb0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f2d440a4d50 tx=0x7f2d440a7430 comp rx=0 tx=0).stop 2026-02-20T03:29:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 -- 10.20.193.28:0/3669788935 shutdown_connections 2026-02-20T03:29:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b13fe00780 0x55b13fe02c40 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fde1560 0x55b13fdfbeb0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddc7c0 0x55b13fdf4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/3669788935 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fddbe80 0x55b13fdf49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 -- 10.20.193.28:0/3669788935 >> 10.20.193.28:0/3669788935 conn(0x55b13fdd36f0 msgr2=0x55b13fde2910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d11ffb640 0 client.19566 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 -- 10.20.193.28:0/3669788935 shutdown_connections 2026-02-20T03:29:58.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.867+0000 7f2d598d7e00 1 -- 10.20.193.28:0/3669788935 wait complete. 2026-02-20T03:29:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.868+0000 7f2d598d7e00 20 client.19566 trim_cache size 0 max 16384 2026-02-20T03:29:58.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d598d7e00 1 Processor -- start 2026-02-20T03:29:58.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d598d7e00 1 -- start start 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fddbe80 0x55b13fddd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fdfbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fde1560 0x55b13fdddb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf4012820 con 0x55b13fddc7c0 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf4010090 con 0x55b13fddbe80 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf400dee0 con 0x55b13fde1560 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fdfbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fdfbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45016/0 (socket says 10.20.193.28:45016) 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.875+0000 7f2d4f7fe640 1 -- 10.20.193.28:0/1135498516 learned_addr learned my addr 10.20.193.28:0/1135498516 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.876+0000 7f2d4f7fe640 1 -- 10.20.193.28:0/1135498516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fde1560 msgr2=0x55b13fdddb30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.876+0000 7f2d4f7fe640 1 --2- 10.20.193.28:0/1135498516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fde1560 0x55b13fdddb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.876+0000 7f2d4f7fe640 1 -- 10.20.193.28:0/1135498516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fddbe80 msgr2=0x55b13fddd5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.876+0000 7f2d4f7fe640 1 --2- 10.20.193.28:0/1135498516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fddbe80 0x55b13fddd5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.876+0000 7f2d4f7fe640 1 -- 10.20.193.28:0/1135498516 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b13fdedf50 con 0x55b13fddc7c0 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.876+0000 7f2d4f7fe640 1 --2- 10.20.193.28:0/1135498516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fdfbe70 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f2d4002f770 tx=0x7f2d40005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98e9d0ffd9b51bd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.876+0000 7f2d13fff640 1 -- 10.20.193.28:0/1135498516 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40038470 con 0x55b13fddc7c0 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.876+0000 7f2d13fff640 1 -- 10.20.193.28:0/1135498516 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d400026e0 con 0x55b13fddc7c0 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.876+0000 7f2d13fff640 1 -- 10.20.193.28:0/1135498516 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40038790 con 0x55b13fddc7c0 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 -- 10.20.193.28:0/1135498516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 msgr2=0x55b13fdfbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/1135498516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fdfbe70 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f2d4002f770 tx=0x7f2d40005a00 comp rx=0 tx=0).stop 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 -- 10.20.193.28:0/1135498516 shutdown_connections 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/1135498516 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fde1560 0x55b13fdddb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/1135498516 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddc7c0 0x55b13fdfbe70 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/1135498516 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fddbe80 0x55b13fddd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 -- 10.20.193.28:0/1135498516 >> 10.20.193.28:0/1135498516 conn(0x55b13fdd36f0 msgr2=0x55b13fddcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:58.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 -- 10.20.193.28:0/1135498516 shutdown_connections 2026-02-20T03:29:58.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 -- 10.20.193.28:0/1135498516 wait complete. 2026-02-20T03:29:58.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 -- start start 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.877+0000 7f2d598d7e00 1 Processor -- start 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddbe80 0x55b13fdf98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddc7c0 0x55b13fdf9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d598d7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fde1560 0x55b13fdfae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf400e550 con 0x55b13fddbe80 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf400f9c0 con 0x55b13fde1560 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d598d7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf400ec20 con 0x55b13fddc7c0 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddbe80 0x55b13fdf98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddbe80 0x55b13fdf98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45022/0 (socket says 10.20.193.28:45022) 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d4ffff640 1 -- 10.20.193.28:0/2559090317 learned_addr learned my addr 10.20.193.28:0/2559090317 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:58.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d4ffff640 1 -- 10.20.193.28:0/2559090317 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddc7c0 msgr2=0x55b13fdf9e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d4ffff640 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddc7c0 0x55b13fdf9e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d4ffff640 1 -- 10.20.193.28:0/2559090317 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fde1560 msgr2=0x55b13fdfae40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d4ffff640 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fde1560 0x55b13fdfae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d4ffff640 1 -- 10.20.193.28:0/2559090317 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b13fa8c690 con 0x55b13fddbe80 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d4ffff640 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddbe80 0x55b13fdf98d0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x55b13fdf4080 tx=0x7f2d3c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c940346907644046 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.878+0000 7f2d11ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d11ffb640 1 -- 10.20.193.28:0/2559090317 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c002c50 con 0x55b13fddbe80 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d11ffb640 1 -- 10.20.193.28:0/2559090317 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d3c022070 con 0x55b13fddbe80 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d11ffb640 1 -- 10.20.193.28:0/2559090317 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c013770 con 0x55b13fddbe80 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 1 -- 10.20.193.28:0/2559090317 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b13fcf1b70 con 0x55b13fddbe80 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d11ffb640 1 -- 10.20.193.28:0/2559090317 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f2d3c013910 con 0x55b13fddbe80 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d11ffb640 10 client.19572 inactive, discarding osd_map(97..97 src has 1..97) 2026-02-20T03:29:58.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 10 client.19572 _ll_register_callbacks cb 0x7f2d440a7b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 1 -- 10.20.193.28:0/2559090317 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d40033040 con 0x55b13fddbe80 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d11ffb640 1 -- 10.20.193.28:0/2559090317 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2d3c02d060 con 0x55b13fddbe80 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 10 client.19572 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 1 -- 10.20.193.28:0/2559090317 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55b13fdeec40 con 0x55b13fddbe80 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d11ffb640 1 -- 10.20.193.28:0/2559090317 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f2d3c013b10 con 0x55b13fddbe80 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 10 client.19572 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 10 client.19572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 20 client.19572 populate_metadata read hostname 'trial028' 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b13fe6c070 0x55b13fe6e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 4 client.19572 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:29:58.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.879+0000 7f2d598d7e00 1 -- 10.20.193.28:0/2559090317 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b13fcfd6b0 con 0x55b13fe6c070 2026-02-20T03:29:58.896 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.894+0000 7f2d4f7fe640 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b13fe6c070 0x55b13fe6e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:58.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.961+0000 7f2d4f7fe640 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b13fe6c070 0x55b13fe6e530 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d6da9cf7fae601 server_cookie=22ba6033691a8ea9 in_seq=0 out_seq=0 2026-02-20T03:29:58.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:58.961+0000 7f2d11ffb640 10 client.19572 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:59.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.041+0000 7f2d11ffb640 1 -- 10.20.193.28:0/2559090317 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b13fcfd6b0 con 0x55b13fe6c070 2026-02-20T03:29:59.044 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.041+0000 7f2d11ffb640 10 client.19572 handle_command_reply: tid=0 2026-02-20T03:29:59.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.041+0000 7f2d598d7e00 1 client.19572 shutdown 2026-02-20T03:29:59.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 -- 10.20.193.28:0/2559090317 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddbe80 msgr2=0x55b13fdf98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.045 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddbe80 0x55b13fdf98d0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x55b13fdf4080 tx=0x7f2d3c0047e0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 -- 10.20.193.28:0/2559090317 shutdown_connections 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b13fe6c070 0x55b13fe6e530 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b13fde1560 0x55b13fdfae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b13fddc7c0 0x55b13fdf9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 --2- 10.20.193.28:0/2559090317 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b13fddbe80 0x55b13fdf98d0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 -- 10.20.193.28:0/2559090317 >> 10.20.193.28:0/2559090317 conn(0x55b13fdd36f0 msgr2=0x55b13fddd700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d11ffb640 0 client.19572 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 -- 10.20.193.28:0/2559090317 shutdown_connections 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 1 -- 10.20.193.28:0/2559090317 wait complete. 2026-02-20T03:29:59.046 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.042+0000 7f2d598d7e00 20 client.19572 trim_cache size 0 max 16384 2026-02-20T03:29:59.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:29:59.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:29:59.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:29:59.047 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 -- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d240b0e20 msgr2=0x7f2d240b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d240b0e20 0x7f2d240b32e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2d48098a90 tx=0x7f2d3c006cd0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 -- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d480995f0 msgr2=0x7f2d4813b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d480995f0 0x7f2d4813b750 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400b990 tx=0x7f2d4400be60 comp rx=0 tx=0).stop 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 -- 10.20.193.28:0/1573174998 shutdown_connections 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d240b0e20 0x7f2d240b32e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d480995f0 0x7f2d4813b750 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d48098c30 0x7f2d481346e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 --2- 10.20.193.28:0/1573174998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d48097a40 0x7f2d481341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.058 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 -- 10.20.193.28:0/1573174998 >> 10.20.193.28:0/1573174998 conn(0x7f2d480931a0 msgr2=0x7f2d48099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 -- 10.20.193.28:0/1573174998 shutdown_connections 2026-02-20T03:29:59.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:29:59.043+0000 7f2d56a74640 1 -- 10.20.193.28:0/1573174998 wait complete. 2026-02-20T03:29:59.059 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:29:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.061+0000 7f501f577640 1 -- 10.20.193.28:0/1633715793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 msgr2=0x7f5020104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.061+0000 7f501f577640 1 --2- 10.20.193.28:0/1633715793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 0x7f5020104de0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f5008009a60 tx=0x7f500802f290 comp rx=0 tx=0).stop 2026-02-20T03:29:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.061+0000 7f501f577640 1 -- 10.20.193.28:0/1633715793 shutdown_connections 2026-02-20T03:29:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.061+0000 7f501f577640 1 --2- 10.20.193.28:0/1633715793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5020105320 0x7f5020111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.061+0000 7f501f577640 1 --2- 10.20.193.28:0/1633715793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 0x7f5020104de0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.061+0000 7f501f577640 1 --2- 10.20.193.28:0/1633715793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f502010a980 0x7f502010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.061+0000 7f501f577640 1 -- 10.20.193.28:0/1633715793 >> 10.20.193.28:0/1633715793 conn(0x7f5020100680 msgr2=0x7f5020102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.061+0000 7f501f577640 1 -- 10.20.193.28:0/1633715793 shutdown_connections 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.061+0000 7f501f577640 1 -- 10.20.193.28:0/1633715793 wait complete. 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.062+0000 7f501f577640 1 Processor -- start 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.062+0000 7f501f577640 1 -- start start 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.062+0000 7f501f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 0x7f502019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.062+0000 7f501f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5020105320 0x7f502019d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.062+0000 7f501f577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f502010a980 0x7f50201a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.062+0000 7f501f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5020114cd0 con 0x7f5020104980 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.062+0000 7f501f577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5020114b50 con 0x7f502010a980 2026-02-20T03:29:59.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.062+0000 7f501f577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5020114e50 con 0x7f5020105320 2026-02-20T03:29:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 0x7f502019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 0x7f502019d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45030/0 (socket says 10.20.193.28:45030) 2026-02-20T03:29:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501e575640 1 -- 10.20.193.28:0/1741178411 learned_addr learned my addr 10.20.193.28:0/1741178411 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501e575640 1 -- 10.20.193.28:0/1741178411 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5020105320 msgr2=0x7f502019d790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501e575640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5020105320 0x7f502019d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501e575640 1 -- 10.20.193.28:0/1741178411 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f502010a980 msgr2=0x7f50201a1b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:59.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501e575640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f502010a980 0x7f50201a1b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501e575640 1 -- 10.20.193.28:0/1741178411 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50201a22a0 con 0x7f5020104980 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501e575640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 0x7f502019d250 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f501400b570 tx=0x7f501400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f50077fe640 1 -- 10.20.193.28:0/1741178411 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014013020 con 0x7f5020104980 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f50077fe640 1 -- 10.20.193.28:0/1741178411 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5014004480 con 0x7f5020104980 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f50077fe640 1 -- 10.20.193.28:0/1741178411 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501400fb50 con 0x7f5020104980 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.063+0000 7f501f577640 1 -- 10.20.193.28:0/1741178411 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50201a2590 con 0x7f5020104980 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.064+0000 7f501f577640 1 -- 10.20.193.28:0/1741178411 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50201a9dd0 con 0x7f5020104980 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.066+0000 7f50077fe640 1 -- 10.20.193.28:0/1741178411 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5014018400 con 0x7f5020104980 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.067+0000 7f502749ae00 1 Processor -- start 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.067+0000 7f502749ae00 1 -- start start 2026-02-20T03:29:59.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.067+0000 7f502749ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faac70 0x561467fab050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.067+0000 7f502749ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467fab620 0x561467faef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.067+0000 7f502749ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467faf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.067+0000 7f502749ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561467ef4880 con 0x561467faf560 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.067+0000 7f502749ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561467ea2350 con 0x561467faac70 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.067+0000 7f502749ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561467ef07b0 con 0x561467fab620 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f501dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467faf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f501dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467faf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45042/0 (socket says 10.20.193.28:45042) 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f501dd74640 1 -- 10.20.193.28:0/920079646 learned_addr learned my addr 10.20.193.28:0/920079646 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f501dd74640 1 -- 10.20.193.28:0/920079646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467fab620 msgr2=0x561467faef40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f501dd74640 1 --2- 10.20.193.28:0/920079646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467fab620 0x561467faef40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f501dd74640 1 -- 10.20.193.28:0/920079646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faac70 msgr2=0x561467fab050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f501dd74640 1 --2- 10.20.193.28:0/920079646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faac70 0x561467fab050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f501dd74640 1 -- 10.20.193.28:0/920079646 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561467e9a9a0 con 0x561467faf560 2026-02-20T03:29:59.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f501dd74640 1 --2- 10.20.193.28:0/920079646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467faf9c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f50080097b0 tx=0x7f5008005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12b1e74a7102447 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f50077fe640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4ff80b0ef0 0x7f4ff80b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f5004ff9640 1 -- 10.20.193.28:0/920079646 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008002c00 con 0x561467faf560 2026-02-20T03:29:59.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f5004ff9640 1 -- 10.20.193.28:0/920079646 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5008033040 con 0x561467faf560 2026-02-20T03:29:59.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f5004ff9640 1 -- 10.20.193.28:0/920079646 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008004270 con 0x561467faf560 2026-02-20T03:29:59.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.068+0000 7f50077fe640 1 -- 10.20.193.28:0/1741178411 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f50140e0490 con 0x7f5020104980 2026-02-20T03:29:59.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.069+0000 7f502749ae00 1 -- 10.20.193.28:0/920079646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 msgr2=0x561467faf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.069+0000 7f502749ae00 1 --2- 10.20.193.28:0/920079646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467faf9c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f50080097b0 tx=0x7f5008005ce0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.069+0000 7f501ed76640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4ff80b0ef0 0x7f4ff80b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.069+0000 7f501ed76640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4ff80b0ef0 0x7f4ff80b33b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f501000aab0 tx=0x7f5010009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.069+0000 7f502749ae00 1 -- 10.20.193.28:0/920079646 shutdown_connections 2026-02-20T03:29:59.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.069+0000 7f502749ae00 1 --2- 10.20.193.28:0/920079646 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467faf9c0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.069+0000 7f502749ae00 1 --2- 10.20.193.28:0/920079646 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467fab620 0x561467faef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.069+0000 7f502749ae00 1 --2- 10.20.193.28:0/920079646 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faac70 0x561467fab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.069+0000 7f502749ae00 1 -- 10.20.193.28:0/920079646 >> 10.20.193.28:0/920079646 conn(0x561467f9e390 msgr2=0x561467fa0780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.070+0000 7f502749ae00 1 -- 10.20.193.28:0/920079646 shutdown_connections 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.070+0000 7f502749ae00 1 -- 10.20.193.28:0/920079646 wait complete. 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.071+0000 7f502749ae00 1 -- start start 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.071+0000 7f502749ae00 1 Processor -- start 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.071+0000 7f502749ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467faac70 0x561467fc4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.071+0000 7f502749ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467fab620 0x561467fc5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.071+0000 7f502749ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467fc3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f502749ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561467e9c130 con 0x561467faf560 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f502749ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561467fb76f0 con 0x561467fab620 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f502749ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561467fc3c90 con 0x561467faac70 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f501ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467fc3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f501ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467fc3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45056/0 (socket says 10.20.193.28:45056) 2026-02-20T03:29:59.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f501ed76640 1 -- 10.20.193.28:0/3972225137 learned_addr learned my addr 10.20.193.28:0/3972225137 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f501ed76640 1 -- 10.20.193.28:0/3972225137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467faac70 msgr2=0x561467fc4f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f501ed76640 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467faac70 0x561467fc4f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f501ed76640 1 -- 10.20.193.28:0/3972225137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467fab620 msgr2=0x561467fc5490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f501ed76640 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467fab620 0x561467fc5490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f501ed76640 1 -- 10.20.193.28:0/3972225137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561467fbcef0 con 0x561467faf560 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f501ed76640 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467fc3700 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5010004380 tx=0x7f5010004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b844cddc7944076 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f4fcffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f4fcffff640 1 -- 10.20.193.28:0/3972225137 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010006e60 con 0x561467faf560 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f502749ae00 1 -- 10.20.193.28:0/3972225137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561467cc3ec0 con 0x561467faf560 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f502749ae00 10 client.19584 _ll_register_callbacks cb 0x561467ea0060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f502749ae00 1 -- 10.20.193.28:0/3972225137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561467efc470 con 0x561467faf560 2026-02-20T03:29:59.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f4fcffff640 1 -- 10.20.193.28:0/3972225137 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f501001f020 con 0x561467faf560 2026-02-20T03:29:59.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f4fcffff640 1 -- 10.20.193.28:0/3972225137 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501001ae30 con 0x561467faf560 2026-02-20T03:29:59.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.072+0000 7f4fcffff640 1 -- 10.20.193.28:0/3972225137 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f5010024410 con 0x561467faf560 2026-02-20T03:29:59.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f4fcffff640 1 -- 10.20.193.28:0/3972225137 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f50100246b0 con 0x561467faf560 2026-02-20T03:29:59.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f502749ae00 10 client.19584 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:59.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f502749ae00 1 -- 10.20.193.28:0/3972225137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x561467e94680 con 0x561467faf560 2026-02-20T03:29:59.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f4fcffff640 1 -- 10.20.193.28:0/3972225137 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f501001a430 con 0x561467faf560 2026-02-20T03:29:59.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f502749ae00 10 client.19584 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:59.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f502749ae00 10 client.19584 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:29:59.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f502749ae00 20 client.19584 populate_metadata read hostname 'trial028' 2026-02-20T03:29:59.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f502749ae00 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561467fd3810 0x561467fd5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f502749ae00 4 client.19584 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:59.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.073+0000 7f502749ae00 1 -- 10.20.193.28:0/3972225137 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561467e76f90 con 0x561467fd3810 2026-02-20T03:29:59.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.095+0000 7f501e575640 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561467fd3810 0x561467fd5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.135+0000 7f4fcffff640 10 client.19584 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:59.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.135+0000 7f501e575640 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561467fd3810 0x561467fd5ca0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c89bc993b5321d66 server_cookie=6084d217dde86c8a in_seq=0 out_seq=0 2026-02-20T03:29:59.152 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f4fcffff640 1 -- 10.20.193.28:0/3972225137 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561467e76f90 con 0x561467fd3810 2026-02-20T03:29:59.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f4fcffff640 10 client.19584 handle_command_reply: tid=0 2026-02-20T03:29:59.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 client.19584 shutdown 2026-02-20T03:29:59.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 -- 10.20.193.28:0/3972225137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 msgr2=0x561467fc3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467fc3700 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f5010004380 tx=0x7f5010004bd0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 -- 10.20.193.28:0/3972225137 shutdown_connections 2026-02-20T03:29:59.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561467fd3810 0x561467fd5ca0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faf560 0x561467fc3700 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467fab620 0x561467fc5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 --2- 10.20.193.28:0/3972225137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467faac70 0x561467fc4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f4fcffff640 0 client.19584 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:59.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 -- 10.20.193.28:0/3972225137 >> 10.20.193.28:0/3972225137 conn(0x561467f9e390 msgr2=0x561467fb08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 -- 10.20.193.28:0/3972225137 shutdown_connections 2026-02-20T03:29:59.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 1 -- 10.20.193.28:0/3972225137 wait complete. 2026-02-20T03:29:59.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.150+0000 7f502749ae00 20 client.19584 trim_cache size 0 max 16384 2026-02-20T03:29:59.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.158+0000 7f502749ae00 1 Processor -- start 2026-02-20T03:29:59.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.158+0000 7f502749ae00 1 -- start start 2026-02-20T03:29:59.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f502749ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467faac70 0x561467faec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f502749ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467fab620 0x561467fc2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f502749ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faf560 0x561467fc0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f502749ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4012750 con 0x561467fab620 2026-02-20T03:29:59.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f502749ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc400ffc0 con 0x561467faf560 2026-02-20T03:29:59.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f502749ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc400de10 con 0x561467faac70 2026-02-20T03:29:59.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f501dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467fab620 0x561467fc2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f501dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467fab620 0x561467fc2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45058/0 (socket says 10.20.193.28:45058) 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f501dd74640 1 -- 10.20.193.28:0/445128340 learned_addr learned my addr 10.20.193.28:0/445128340 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f501dd74640 1 -- 10.20.193.28:0/445128340 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467faac70 msgr2=0x561467faec00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f501dd74640 1 --2- 10.20.193.28:0/445128340 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467faac70 0x561467faec00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f501dd74640 1 -- 10.20.193.28:0/445128340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faf560 msgr2=0x561467fc0f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f501dd74640 1 --2- 10.20.193.28:0/445128340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faf560 0x561467fc0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f501dd74640 1 -- 10.20.193.28:0/445128340 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561467fbcd20 con 0x561467fab620 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f501dd74640 1 --2- 10.20.193.28:0/445128340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467fab620 0x561467fc2540 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f5008005990 tx=0x7f500802f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d8683b23e6a5dd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.159+0000 7f4fea4e6640 1 -- 10.20.193.28:0/445128340 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500802fab0 con 0x561467fab620 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f4fea4e6640 1 -- 10.20.193.28:0/445128340 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f500804a070 con 0x561467fab620 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f4fea4e6640 1 -- 10.20.193.28:0/445128340 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008038990 con 0x561467fab620 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f502749ae00 1 -- 10.20.193.28:0/445128340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467fab620 msgr2=0x561467fc2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f502749ae00 1 --2- 10.20.193.28:0/445128340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467fab620 0x561467fc2540 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f5008005990 tx=0x7f500802f290 comp rx=0 tx=0).stop 2026-02-20T03:29:59.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f502749ae00 1 -- 10.20.193.28:0/445128340 shutdown_connections 2026-02-20T03:29:59.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f502749ae00 1 --2- 10.20.193.28:0/445128340 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faf560 0x561467fc0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f502749ae00 1 --2- 10.20.193.28:0/445128340 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467fab620 0x561467fc2540 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f502749ae00 1 --2- 10.20.193.28:0/445128340 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467faac70 0x561467faec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f502749ae00 1 -- 10.20.193.28:0/445128340 >> 10.20.193.28:0/445128340 conn(0x561467f9e390 msgr2=0x561467fc1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f502749ae00 1 -- 10.20.193.28:0/445128340 shutdown_connections 2026-02-20T03:29:59.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.160+0000 7f502749ae00 1 -- 10.20.193.28:0/445128340 wait complete. 2026-02-20T03:29:59.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.161+0000 7f502749ae00 1 -- start start 2026-02-20T03:29:59.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.161+0000 7f502749ae00 1 Processor -- start 2026-02-20T03:29:59.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.161+0000 7f502749ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faac70 0x561467fcfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.161+0000 7f502749ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467fab620 0x561467fcb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.161+0000 7f502749ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faf560 0x561467fcb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f502749ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc400e480 con 0x561467faac70 2026-02-20T03:29:59.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f502749ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc400f8f0 con 0x561467faf560 2026-02-20T03:29:59.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f502749ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc400eb50 con 0x561467fab620 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f501e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faac70 0x561467fcfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f501e575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faac70 0x561467fcfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45062/0 (socket says 10.20.193.28:45062) 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f501e575640 1 -- 10.20.193.28:0/542518048 learned_addr learned my addr 10.20.193.28:0/542518048 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f501e575640 1 -- 10.20.193.28:0/542518048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467fab620 msgr2=0x561467fcb220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f501e575640 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467fab620 0x561467fcb220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f501e575640 1 -- 10.20.193.28:0/542518048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faf560 msgr2=0x561467fcb760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f501e575640 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faf560 0x561467fcb760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f501e575640 1 -- 10.20.193.28:0/542518048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561467c586c0 con 0x561467faac70 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f501e575640 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faac70 0x561467fcfe50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f50140a8160 tx=0x7f50140a77c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0ab707eac5d708 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.162+0000 7f4fcffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.163+0000 7f4fcffff640 1 -- 10.20.193.28:0/542518048 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50140ce020 con 0x561467faac70 2026-02-20T03:29:59.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.163+0000 7f502749ae00 1 -- 10.20.193.28:0/542518048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561467e85140 con 0x561467faac70 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.163+0000 7f502749ae00 10 client.19590 _ll_register_callbacks cb 0x7f501000ce50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.163+0000 7f502749ae00 1 -- 10.20.193.28:0/542518048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5008033040 con 0x561467faac70 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f4fcffff640 1 -- 10.20.193.28:0/542518048 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5008033040 con 0x561467faac70 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f4fcffff640 1 -- 10.20.193.28:0/542518048 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50140ac170 con 0x561467faac70 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f4fcffff640 1 -- 10.20.193.28:0/542518048 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f50140951c0 con 0x561467faac70 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f4fcffff640 1 -- 10.20.193.28:0/542518048 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5014095440 con 0x561467faac70 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f502749ae00 10 client.19590 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f502749ae00 1 -- 10.20.193.28:0/542518048 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x561467fbda10 con 0x561467faac70 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f4fcffff640 1 -- 10.20.193.28:0/542518048 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f50140a38f0 con 0x561467faac70 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f502749ae00 10 client.19590 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f502749ae00 10 client.19590 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:29:59.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f502749ae00 20 client.19590 populate_metadata read hostname 'trial028' 2026-02-20T03:29:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f502749ae00 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561468040b00 0x561468042fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f502749ae00 4 client.19590 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-189aa5bc-1-mds.h.json"}] 2026-02-20T03:29:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.164+0000 7f502749ae00 1 -- 10.20.193.28:0/542518048 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-189aa5bc-1-mds.h.json"}) -- 0x561467fb6fb0 con 0x561468040b00 2026-02-20T03:29:59.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.189+0000 7f501dd74640 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561468040b00 0x561468042fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.256+0000 7f501dd74640 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561468040b00 0x561468042fc0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3d26ade9782d8405 server_cookie=743add83b86118a in_seq=0 out_seq=0 2026-02-20T03:29:59.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.256+0000 7f4fcffff640 10 client.19590 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:59.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.282+0000 7f4fcffff640 1 -- 10.20.193.28:0/542518048 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x561467fb6fb0 con 0x561468040b00 2026-02-20T03:29:59.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.282+0000 7f4fcffff640 10 client.19590 handle_command_reply: tid=0 2026-02-20T03:29:59.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 client.19590 shutdown 2026-02-20T03:29:59.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 -- 10.20.193.28:0/542518048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faac70 msgr2=0x561467fcfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faac70 0x561467fcfe50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f50140a8160 tx=0x7f50140a77c0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 -- 10.20.193.28:0/542518048 shutdown_connections 2026-02-20T03:29:59.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561467faf560 0x561467fcb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561467fab620 0x561467fcb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561468040b00 0x561468042fc0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 --2- 10.20.193.28:0/542518048 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561467faac70 0x561467fcfe50 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 -- 10.20.193.28:0/542518048 >> 10.20.193.28:0/542518048 conn(0x561467f9e390 msgr2=0x561467fc2650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f4fcffff640 0 client.19590 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:29:59.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 -- 10.20.193.28:0/542518048 shutdown_connections 2026-02-20T03:29:59.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 1 -- 10.20.193.28:0/542518048 wait complete. 2026-02-20T03:29:59.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.283+0000 7f502749ae00 20 client.19590 trim_cache size 0 max 16384 2026-02-20T03:29:59.298 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:29:59.299 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/var/run/ceph/ops-189aa5bc-1-mds.h.json" 2026-02-20T03:29:59.299 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:29:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 -- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4ff80b0ef0 msgr2=0x7f4ff80b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4ff80b0ef0 0x7f4ff80b33b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f501000aab0 tx=0x7f5010009250 comp rx=0 tx=0).stop 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 -- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 msgr2=0x7f502019d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 0x7f502019d250 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f501400b570 tx=0x7f501400ba40 comp rx=0 tx=0).stop 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 -- 10.20.193.28:0/1741178411 shutdown_connections 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4ff80b0ef0 0x7f4ff80b33b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f502010a980 0x7f50201a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5020105320 0x7f502019d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 --2- 10.20.193.28:0/1741178411 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5020104980 0x7f502019d250 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 -- 10.20.193.28:0/1741178411 >> 10.20.193.28:0/1741178411 conn(0x7f5020100680 msgr2=0x7f5020101130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 -- 10.20.193.28:0/1741178411 shutdown_connections 2026-02-20T03:29:59.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.284+0000 7f501f577640 1 -- 10.20.193.28:0/1741178411 wait complete. 2026-02-20T03:29:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.315+0000 7f7263577640 1 -- 10.20.193.28:0/245397517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7264075d60 msgr2=0x7f726410eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.315+0000 7f7263577640 1 --2- 10.20.193.28:0/245397517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7264075d60 0x7f726410eb60 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f724c009a30 tx=0x7f724c02f260 comp rx=0 tx=0).stop 2026-02-20T03:29:59.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.316+0000 7f7263577640 1 -- 10.20.193.28:0/245397517 shutdown_connections 2026-02-20T03:29:59.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.316+0000 7f7263577640 1 --2- 10.20.193.28:0/245397517 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f726410f0a0 0x7f7264111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.316+0000 7f7263577640 1 --2- 10.20.193.28:0/245397517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7264075d60 0x7f726410eb60 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.316+0000 7f7263577640 1 --2- 10.20.193.28:0/245397517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72640753b0 0x7f7264075790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.316+0000 7f7263577640 1 -- 10.20.193.28:0/245397517 >> 10.20.193.28:0/245397517 conn(0x7f72640fe3e0 msgr2=0x7f7264100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.316+0000 7f7263577640 1 -- 10.20.193.28:0/245397517 shutdown_connections 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.316+0000 7f7263577640 1 -- 10.20.193.28:0/245397517 wait complete. 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.316+0000 7f7263577640 1 Processor -- start 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.317+0000 7f7263577640 1 -- start start 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.317+0000 7f7263577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72640753b0 0x7f7264107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7263577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7264075d60 0x7f7264108490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7263577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f726410f0a0 0x7f72641030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7263577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7264114d60 con 0x7f726410f0a0 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7263577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7264114be0 con 0x7f72640753b0 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7263577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7264114ee0 con 0x7f7264075d60 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7262d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f726410f0a0 0x7f72641030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7262d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f726410f0a0 0x7f72641030f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45066/0 (socket says 10.20.193.28:45066) 2026-02-20T03:29:59.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7262d76640 1 -- 10.20.193.28:0/2310213426 learned_addr learned my addr 10.20.193.28:0/2310213426 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7262d76640 1 -- 10.20.193.28:0/2310213426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7264075d60 msgr2=0x7f7264108490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7262d76640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7264075d60 0x7f7264108490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.318+0000 7f7262d76640 1 -- 10.20.193.28:0/2310213426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72640753b0 msgr2=0x7f7264107f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.319+0000 7f7262d76640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72640753b0 0x7f7264107f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.319+0000 7f7262d76640 1 -- 10.20.193.28:0/2310213426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72641039b0 con 0x7f726410f0a0 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.319+0000 7f7262d76640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f726410f0a0 0x7f72641030f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f725400b930 tx=0x7f725400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.319+0000 7f724b7fe640 1 -- 10.20.193.28:0/2310213426 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254006e60 con 0x7f726410f0a0 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.319+0000 7f724b7fe640 1 -- 10.20.193.28:0/2310213426 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7254010070 con 0x7f726410f0a0 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.319+0000 7f724b7fe640 1 -- 10.20.193.28:0/2310213426 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254004870 con 0x7f726410f0a0 2026-02-20T03:29:59.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.319+0000 7f7263577640 1 -- 10.20.193.28:0/2310213426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7264103ca0 con 0x7f726410f0a0 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.319+0000 7f7263577640 1 -- 10.20.193.28:0/2310213426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726410de40 con 0x7f726410f0a0 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.322+0000 7f724b7fe640 1 -- 10.20.193.28:0/2310213426 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f725401d030 con 0x7f726410f0a0 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.323+0000 7f726af10e00 1 Processor -- start 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.323+0000 7f726af10e00 1 -- start start 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.323+0000 7f726af10e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1269fb0 0x562bf126a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.323+0000 7f726af10e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf12645e0 0x562bf1264a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.323+0000 7f726af10e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf1264f60 0x562bf1270de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.323+0000 7f726af10e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562bf11e4e00 con 0x562bf12645e0 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.323+0000 7f726af10e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562bf11b7970 con 0x562bf1269fb0 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.323+0000 7f726af10e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562bf11651f0 con 0x562bf1264f60 2026-02-20T03:29:59.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf12645e0 0x562bf1264a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf12645e0 0x562bf1264a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45072/0 (socket says 10.20.193.28:45072) 2026-02-20T03:29:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262575640 1 -- 10.20.193.28:0/890831699 learned_addr learned my addr 10.20.193.28:0/890831699 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f724b7fe640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f723c0b0e20 0x7f723c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f724b7fe640 1 -- 10.20.193.28:0/2310213426 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f72540dff50 con 0x7f726410f0a0 2026-02-20T03:29:59.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262575640 1 -- 10.20.193.28:0/890831699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf1264f60 msgr2=0x562bf1270de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262575640 1 --2- 10.20.193.28:0/890831699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf1264f60 0x562bf1270de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262575640 1 -- 10.20.193.28:0/890831699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1269fb0 msgr2=0x562bf126a390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262575640 1 --2- 10.20.193.28:0/890831699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1269fb0 0x562bf126a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262575640 1 -- 10.20.193.28:0/890831699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf11783d0 con 0x562bf12645e0 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262575640 1 --2- 10.20.193.28:0/890831699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf12645e0 0x562bf1264a20 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f7258009870 tx=0x7f7258009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b97af76f8a3f189 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.324+0000 7f7262d76640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f723c0b0e20 0x7f723c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.325+0000 7f7248cf3640 1 -- 10.20.193.28:0/890831699 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258016070 con 0x562bf12645e0 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.325+0000 7f7248cf3640 1 -- 10.20.193.28:0/890831699 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7258004480 con 0x562bf12645e0 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.325+0000 7f7248cf3640 1 -- 10.20.193.28:0/890831699 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725800bd30 con 0x562bf12645e0 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.325+0000 7f7262d76640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f723c0b0e20 0x7f723c0b32e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f725400b900 tx=0x7f7254004290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.325+0000 7f726af10e00 1 -- 10.20.193.28:0/890831699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf12645e0 msgr2=0x562bf1264a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.325+0000 7f726af10e00 1 --2- 10.20.193.28:0/890831699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf12645e0 0x562bf1264a20 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f7258009870 tx=0x7f7258009d40 comp rx=0 tx=0).stop 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.326+0000 7f726af10e00 1 -- 10.20.193.28:0/890831699 shutdown_connections 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.326+0000 7f726af10e00 1 --2- 10.20.193.28:0/890831699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf1264f60 0x562bf1270de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.326+0000 7f726af10e00 1 --2- 10.20.193.28:0/890831699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf12645e0 0x562bf1264a20 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.326+0000 7f726af10e00 1 --2- 10.20.193.28:0/890831699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1269fb0 0x562bf126a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.326+0000 7f726af10e00 1 -- 10.20.193.28:0/890831699 >> 10.20.193.28:0/890831699 conn(0x562bf1227240 msgr2=0x562bf1262ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.326+0000 7f726af10e00 1 -- 10.20.193.28:0/890831699 shutdown_connections 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.326+0000 7f726af10e00 1 -- 10.20.193.28:0/890831699 wait complete. 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.327+0000 7f726af10e00 1 -- start start 2026-02-20T03:29:59.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.327+0000 7f726af10e00 1 Processor -- start 2026-02-20T03:29:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.328+0000 7f726af10e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf12645e0 0x562bf127ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.328+0000 7f726af10e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1264f60 0x562bf127f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.328+0000 7f726af10e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1269fb0 0x562bf127d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.328+0000 7f726af10e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562bf11b38a0 con 0x562bf1269fb0 2026-02-20T03:29:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.328+0000 7f726af10e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562bf0fa5f50 con 0x562bf1264f60 2026-02-20T03:29:59.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.328+0000 7f726af10e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562bf127d990 con 0x562bf12645e0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.328+0000 7f7261d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1269fb0 0x562bf127d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.328+0000 7f7261d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1269fb0 0x562bf127d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45082/0 (socket says 10.20.193.28:45082) 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.328+0000 7f7261d74640 1 -- 10.20.193.28:0/3506379778 learned_addr learned my addr 10.20.193.28:0/3506379778 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7261d74640 1 -- 10.20.193.28:0/3506379778 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf12645e0 msgr2=0x562bf127ef50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7261d74640 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf12645e0 0x562bf127ef50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7261d74640 1 -- 10.20.193.28:0/3506379778 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1264f60 msgr2=0x562bf127f490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7261d74640 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1264f60 0x562bf127f490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7261d74640 1 -- 10.20.193.28:0/3506379778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf1276a80 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7261d74640 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1269fb0 0x562bf127d400 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f724c02f770 tx=0x7f724c0099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14e7d70aae43b34 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7213fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7213fff640 1 -- 10.20.193.28:0/3506379778 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c0026e0 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7213fff640 1 -- 10.20.193.28:0/3506379778 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f724c033040 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.329+0000 7f7213fff640 1 -- 10.20.193.28:0/3506379778 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c004be0 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.330+0000 7f726af10e00 1 -- 10.20.193.28:0/3506379778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf0f88b40 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.330+0000 7f726af10e00 10 client.19602 _ll_register_callbacks cb 0x562bf11f0eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.330+0000 7f7213fff640 1 -- 10.20.193.28:0/3506379778 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f724c004d80 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.330+0000 7f726af10e00 1 -- 10.20.193.28:0/3506379778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562bf11c5150 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.330+0000 7f7213fff640 1 -- 10.20.193.28:0/3506379778 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f724c002880 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.330+0000 7f726af10e00 10 client.19602 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.330+0000 7f726af10e00 1 -- 10.20.193.28:0/3506379778 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x562bf11721e0 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.331+0000 7f7213fff640 1 -- 10.20.193.28:0/3506379778 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f724c038790 con 0x562bf1269fb0 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.331+0000 7f726af10e00 10 client.19602 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.331+0000 7f726af10e00 10 client.19602 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.331+0000 7f726af10e00 20 client.19602 populate_metadata read hostname 'trial028' 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.331+0000 7f726af10e00 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562bf128d6c0 0x562bf128fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.331+0000 7f726af10e00 4 client.19602 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:29:59.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.331+0000 7f726af10e00 1 -- 10.20.193.28:0/3506379778 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bf11bf560 con 0x562bf128d6c0 2026-02-20T03:29:59.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.344+0000 7f7262575640 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562bf128d6c0 0x562bf128fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.415+0000 7f7262575640 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562bf128d6c0 0x562bf128fb60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4616461aa85121a6 server_cookie=e2f07261240c6df5 in_seq=0 out_seq=0 2026-02-20T03:29:59.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.415+0000 7f7213fff640 10 client.19602 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:29:59.432 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 1 (i) to a remote file /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.i.json 2026-02-20T03:29:59.432 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 ops --flags=locks --path=/var/run/ceph/ops-189aa5bc-1-mds.i.json 2026-02-20T03:29:59.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f7213fff640 1 -- 10.20.193.28:0/3506379778 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562bf11bf560 con 0x562bf128d6c0 2026-02-20T03:29:59.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f7213fff640 10 client.19602 handle_command_reply: tid=0 2026-02-20T03:29:59.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 client.19602 shutdown 2026-02-20T03:29:59.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 -- 10.20.193.28:0/3506379778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1269fb0 msgr2=0x562bf127d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1269fb0 0x562bf127d400 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f724c02f770 tx=0x7f724c0099a0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 -- 10.20.193.28:0/3506379778 shutdown_connections 2026-02-20T03:29:59.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562bf128d6c0 0x562bf128fb60 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1269fb0 0x562bf127d400 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1264f60 0x562bf127f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 --2- 10.20.193.28:0/3506379778 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf12645e0 0x562bf127ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 -- 10.20.193.28:0/3506379778 >> 10.20.193.28:0/3506379778 conn(0x562bf1227240 msgr2=0x562bf12633f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f7213fff640 0 client.19602 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:29:59.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 -- 10.20.193.28:0/3506379778 shutdown_connections 2026-02-20T03:29:59.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 1 -- 10.20.193.28:0/3506379778 wait complete. 2026-02-20T03:29:59.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.429+0000 7f726af10e00 20 client.19602 trim_cache size 0 max 16384 2026-02-20T03:29:59.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.437+0000 7f726af10e00 1 Processor -- start 2026-02-20T03:29:59.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.437+0000 7f726af10e00 1 -- start start 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.437+0000 7f726af10e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf12645e0 0x562bf127bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.437+0000 7f726af10e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf127c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.437+0000 7f726af10e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1269fb0 0x562bf127a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.437+0000 7f726af10e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7208012700 con 0x562bf1264f60 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.437+0000 7f726af10e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f720800ff70 con 0x562bf1269fb0 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.437+0000 7f726af10e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f720800ddc0 con 0x562bf12645e0 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f7262575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf127c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f7262575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf127c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45084/0 (socket says 10.20.193.28:45084) 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f7262575640 1 -- 10.20.193.28:0/1202073836 learned_addr learned my addr 10.20.193.28:0/1202073836 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f7262575640 1 -- 10.20.193.28:0/1202073836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf12645e0 msgr2=0x562bf127bc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f7262575640 1 --2- 10.20.193.28:0/1202073836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf12645e0 0x562bf127bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f7262575640 1 -- 10.20.193.28:0/1202073836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1269fb0 msgr2=0x562bf127a710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f7262575640 1 --2- 10.20.193.28:0/1202073836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1269fb0 0x562bf127a710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f7262575640 1 -- 10.20.193.28:0/1202073836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf12768b0 con 0x562bf1264f60 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f7262575640 1 --2- 10.20.193.28:0/1202073836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf127c1a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f7258002410 tx=0x7f7258006c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca371344a2ca3a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f722e4e6640 1 -- 10.20.193.28:0/1202073836 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258016040 con 0x562bf1264f60 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f722e4e6640 1 -- 10.20.193.28:0/1202073836 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7258017040 con 0x562bf1264f60 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.438+0000 7f722e4e6640 1 -- 10.20.193.28:0/1202073836 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258002c80 con 0x562bf1264f60 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.439+0000 7f726af10e00 1 -- 10.20.193.28:0/1202073836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 msgr2=0x562bf127c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.439+0000 7f726af10e00 1 --2- 10.20.193.28:0/1202073836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf127c1a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f7258002410 tx=0x7f7258006c10 comp rx=0 tx=0).stop 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.439+0000 7f726af10e00 1 -- 10.20.193.28:0/1202073836 shutdown_connections 2026-02-20T03:29:59.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.439+0000 7f726af10e00 1 --2- 10.20.193.28:0/1202073836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf1269fb0 0x562bf127a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.439+0000 7f726af10e00 1 --2- 10.20.193.28:0/1202073836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf127c1a0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.439+0000 7f726af10e00 1 --2- 10.20.193.28:0/1202073836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf12645e0 0x562bf127bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.439+0000 7f726af10e00 1 -- 10.20.193.28:0/1202073836 >> 10.20.193.28:0/1202073836 conn(0x562bf1227240 msgr2=0x562bf127ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.439+0000 7f726af10e00 1 -- 10.20.193.28:0/1202073836 shutdown_connections 2026-02-20T03:29:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.439+0000 7f726af10e00 1 -- 10.20.193.28:0/1202073836 wait complete. 2026-02-20T03:29:59.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f726af10e00 1 -- start start 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f726af10e00 1 Processor -- start 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f726af10e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf12645e0 0x562bf1285520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f726af10e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf1281e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f726af10e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf1269fb0 0x562bf1282360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f726af10e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f720800e430 con 0x562bf1264f60 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f726af10e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f720800f8a0 con 0x562bf12645e0 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f726af10e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f720800eb00 con 0x562bf1269fb0 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f7262575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf1281e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f7262575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf1281e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45094/0 (socket says 10.20.193.28:45094) 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.440+0000 7f7262575640 1 -- 10.20.193.28:0/1266917320 learned_addr learned my addr 10.20.193.28:0/1266917320 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7262575640 1 -- 10.20.193.28:0/1266917320 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf1269fb0 msgr2=0x562bf1282360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7262575640 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf1269fb0 0x562bf1282360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7262575640 1 -- 10.20.193.28:0/1266917320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf12645e0 msgr2=0x562bf1285520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7262575640 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf12645e0 0x562bf1285520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7262575640 1 -- 10.20.193.28:0/1266917320 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf0e96870 con 0x562bf1264f60 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7262575640 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf1281e20 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f7258002960 tx=0x7f72580090c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61694053048620f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7213fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7213fff640 1 -- 10.20.193.28:0/1266917320 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7258009440 con 0x562bf1264f60 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7213fff640 1 -- 10.20.193.28:0/1266917320 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7258029070 con 0x562bf1264f60 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f726af10e00 1 -- 10.20.193.28:0/1266917320 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf11573f0 con 0x562bf1264f60 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f726af10e00 10 client.19608 _ll_register_callbacks cb 0x7f724c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7213fff640 1 -- 10.20.193.28:0/1266917320 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725801db60 con 0x562bf1264f60 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f726af10e00 1 -- 10.20.193.28:0/1266917320 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7258004480 con 0x562bf1264f60 2026-02-20T03:29:59.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7213fff640 1 -- 10.20.193.28:0/1266917320 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f725801dd00 con 0x562bf1264f60 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f7213fff640 1 -- 10.20.193.28:0/1266917320 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f7258024440 con 0x562bf1264f60 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f726af10e00 10 client.19608 fetch_fsmap learned FSMap version 37 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.441+0000 7f726af10e00 1 -- 10.20.193.28:0/1266917320 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x562bf12775a0 con 0x562bf1264f60 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.442+0000 7f7213fff640 1 -- 10.20.193.28:0/1266917320 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f7258035030 con 0x562bf1264f60 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.442+0000 7f726af10e00 10 client.19608 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.442+0000 7f726af10e00 10 client.19608 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.442+0000 7f726af10e00 20 client.19608 populate_metadata read hostname 'trial028' 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.442+0000 7f726af10e00 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562bf12f9260 0x562bf12fb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.442+0000 7f726af10e00 4 client.19608 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:29:59.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.442+0000 7f726af10e00 1 -- 10.20.193.28:0/1266917320 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562bf11887c0 con 0x562bf12f9260 2026-02-20T03:29:59.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.455+0000 7f7261d74640 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562bf12f9260 0x562bf12fb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:29:59.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.522+0000 7f7261d74640 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562bf12f9260 0x562bf12fb6f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c4f901885bc663d8 server_cookie=d6d52e75306bcd8 in_seq=0 out_seq=0 2026-02-20T03:29:59.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.522+0000 7f7213fff640 10 client.19608 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:29:59.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f7213fff640 1 -- 10.20.193.28:0/1266917320 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562bf11887c0 con 0x562bf12f9260 2026-02-20T03:29:59.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f7213fff640 10 client.19608 handle_command_reply: tid=0 2026-02-20T03:29:59.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 client.19608 shutdown 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 -- 10.20.193.28:0/1266917320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 msgr2=0x562bf1281e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf1281e20 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f7258002960 tx=0x7f72580090c0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 -- 10.20.193.28:0/1266917320 shutdown_connections 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562bf12f9260 0x562bf12fb6f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562bf1269fb0 0x562bf1282360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562bf1264f60 0x562bf1281e20 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 --2- 10.20.193.28:0/1266917320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562bf12645e0 0x562bf1285520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 -- 10.20.193.28:0/1266917320 >> 10.20.193.28:0/1266917320 conn(0x562bf1227240 msgr2=0x562bf127b860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f7213fff640 0 client.19608 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 -- 10.20.193.28:0/1266917320 shutdown_connections 2026-02-20T03:29:59.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.536+0000 7f726af10e00 1 -- 10.20.193.28:0/1266917320 wait complete. 2026-02-20T03:29:59.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f726af10e00 20 client.19608 trim_cache size 0 max 16384 2026-02-20T03:29:59.552 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:29:59.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 -- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f723c0b0e20 msgr2=0x7f723c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f723c0b0e20 0x7f723c0b32e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f725400b900 tx=0x7f7254004290 comp rx=0 tx=0).stop 2026-02-20T03:29:59.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 -- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f726410f0a0 msgr2=0x7f72641030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:29:59.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f726410f0a0 0x7f72641030f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f725400b930 tx=0x7f725400be00 comp rx=0 tx=0).stop 2026-02-20T03:29:59.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 -- 10.20.193.28:0/2310213426 shutdown_connections 2026-02-20T03:29:59.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f723c0b0e20 0x7f723c0b32e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f726410f0a0 0x7f72641030f0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7264075d60 0x7f7264108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 --2- 10.20.193.28:0/2310213426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f72640753b0 0x7f7264107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:29:59.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 -- 10.20.193.28:0/2310213426 >> 10.20.193.28:0/2310213426 conn(0x7f72640fe3e0 msgr2=0x7f72640ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:29:59.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 -- 10.20.193.28:0/2310213426 shutdown_connections 2026-02-20T03:29:59.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:29:59.537+0000 7f7263577640 1 -- 10.20.193.28:0/2310213426 wait complete. 2026-02-20T03:29:59.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:29:59 trial028 ceph-mon[38552]: pgmap v643: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 22 op/s 2026-02-20T03:29:59.696 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:29:59.697 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 22.06 MB/sec warmup 90 sec latency 55724.053 ms 2026-02-20T03:29:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:29:59 trial177 ceph-mon[43181]: pgmap v643: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 22 op/s 2026-02-20T03:29:59.746 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:29:59 trial126 ceph-mon[38476]: pgmap v643: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 22 op/s 2026-02-20T03:29:59.769 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:00.018 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.034+0000 7f8bbb52e640 1 -- 10.20.193.28:0/3339555547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb4102710 msgr2=0x7f8bb4102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.034+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/3339555547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb4102710 0x7f8bb4102b70 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009a60 tx=0x7f8ba802f290 comp rx=0 tx=0).stop 2026-02-20T03:30:00.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.034+0000 7f8bbb52e640 1 -- 10.20.193.28:0/3339555547 shutdown_connections 2026-02-20T03:30:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.034+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/3339555547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8bb41030b0 0x7f8bb410f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.034+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/3339555547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb4102710 0x7f8bb4102b70 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.034+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/3339555547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8bb4108710 0x7f8bb4108af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.034+0000 7f8bbb52e640 1 -- 10.20.193.28:0/3339555547 >> 10.20.193.28:0/3339555547 conn(0x7f8bb40fe410 msgr2=0x7f8bb4100830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.034+0000 7f8bbb52e640 1 -- 10.20.193.28:0/3339555547 shutdown_connections 2026-02-20T03:30:00.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.034+0000 7f8bbb52e640 1 -- 10.20.193.28:0/3339555547 wait complete. 2026-02-20T03:30:00.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.035+0000 7f8bbb52e640 1 Processor -- start 2026-02-20T03:30:00.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.035+0000 7f8bbb52e640 1 -- start start 2026-02-20T03:30:00.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.035+0000 7f8bbb52e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8bb4102710 0x7f8bb40726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.035+0000 7f8bbb52e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb41030b0 0x7f8bb4072c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.035+0000 7f8bbb52e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8bb4108710 0x7f8bb406d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.035+0000 7f8bbb52e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb4112a60 con 0x7f8bb41030b0 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.035+0000 7f8bbb52e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb41128e0 con 0x7f8bb4102710 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.035+0000 7f8bbb52e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb4112be0 con 0x7f8bb4108710 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bb9d2b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb41030b0 0x7f8bb4072c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bb9d2b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb41030b0 0x7f8bb4072c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45118/0 (socket says 10.20.193.28:45118) 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bb9d2b640 1 -- 10.20.193.28:0/1648165547 learned_addr learned my addr 10.20.193.28:0/1648165547 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bb9d2b640 1 -- 10.20.193.28:0/1648165547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8bb4108710 msgr2=0x7f8bb406d870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bb9d2b640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8bb4108710 0x7f8bb406d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bb9d2b640 1 -- 10.20.193.28:0/1648165547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8bb4102710 msgr2=0x7f8bb40726d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bb9d2b640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8bb4102710 0x7f8bb40726d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bb9d2b640 1 -- 10.20.193.28:0/1648165547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb406e130 con 0x7f8bb41030b0 2026-02-20T03:30:00.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bb9d2b640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb41030b0 0x7f8bb4072c10 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8ba802f7a0 tx=0x7f8ba802fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8b9b7fe640 1 -- 10.20.193.28:0/1648165547 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba802fe50 con 0x7f8bb41030b0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8b9b7fe640 1 -- 10.20.193.28:0/1648165547 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ba8005030 con 0x7f8bb41030b0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8b9b7fe640 1 -- 10.20.193.28:0/1648165547 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8004cf0 con 0x7f8bb41030b0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.036+0000 7f8bbb52e640 1 -- 10.20.193.28:0/1648165547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb406e3c0 con 0x7f8bb41030b0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.037+0000 7f8bbb52e640 1 -- 10.20.193.28:0/1648165547 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb40765b0 con 0x7f8bb41030b0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.039+0000 7f8b9b7fe640 1 -- 10.20.193.28:0/1648165547 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8ba80051e0 con 0x7f8bb41030b0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bbecbce00 1 Processor -- start 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bbecbce00 1 -- start start 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7260 0x56216a1e7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a1eb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1ebb50 0x56216a1ebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56216a139880 con 0x56216a1e7c10 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56216a0e7350 con 0x56216a1ebb50 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56216a1357b0 con 0x56216a1e7260 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bba52c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a1eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bba52c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a1eb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45124/0 (socket says 10.20.193.28:45124) 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.040+0000 7f8bba52c640 1 -- 10.20.193.28:0/2407485737 learned_addr learned my addr 10.20.193.28:0/2407485737 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.041+0000 7f8bba52c640 1 -- 10.20.193.28:0/2407485737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7260 msgr2=0x56216a1e7640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.041+0000 7f8bba52c640 1 --2- 10.20.193.28:0/2407485737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7260 0x56216a1e7640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.041+0000 7f8bba52c640 1 -- 10.20.193.28:0/2407485737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1ebb50 msgr2=0x56216a1ebfb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.041+0000 7f8bba52c640 1 --2- 10.20.193.28:0/2407485737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1ebb50 0x56216a1ebfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.041+0000 7f8bba52c640 1 -- 10.20.193.28:0/2407485737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216a0df9a0 con 0x56216a1e7c10 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.041+0000 7f8b9b7fe640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b900b0f40 0x7f8b900b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.041+0000 7f8bba52c640 1 --2- 10.20.193.28:0/2407485737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a1eb530 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009870 tx=0x7f8ba4009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4389ba4c80264b7d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.041+0000 7f8b9b7fe640 1 -- 10.20.193.28:0/1648165547 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f8ba8105290 con 0x7f8bb41030b0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbad2d640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b900b0f40 0x7f8b900b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8b98cf3640 1 -- 10.20.193.28:0/2407485737 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4016070 con 0x56216a1e7c10 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8b98cf3640 1 -- 10.20.193.28:0/2407485737 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ba4004480 con 0x56216a1e7c10 2026-02-20T03:30:00.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8b98cf3640 1 -- 10.20.193.28:0/2407485737 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400bda0 con 0x56216a1e7c10 2026-02-20T03:30:00.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2407485737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 msgr2=0x56216a1eb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/2407485737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a1eb530 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009870 tx=0x7f8ba4009d40 comp rx=0 tx=0).stop 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbad2d640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b900b0f40 0x7f8b900b3400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000aab0 tx=0x7f8bb0009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2407485737 shutdown_connections 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/2407485737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1ebb50 0x56216a1ebfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/2407485737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a1eb530 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/2407485737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7260 0x56216a1e7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2407485737 >> 10.20.193.28:0/2407485737 conn(0x56216a1e3390 msgr2=0x56216a1e5780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2407485737 shutdown_connections 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.042+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2407485737 wait complete. 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.044+0000 7f8bbecbce00 1 -- start start 2026-02-20T03:30:00.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.044+0000 7f8bbecbce00 1 Processor -- start 2026-02-20T03:30:00.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1e7260 0x56216a2016d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a201c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1ebb50 0x56216a1ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56216a0e1130 con 0x56216a1e7c10 2026-02-20T03:30:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56216a1f3d40 con 0x56216a1e7260 2026-02-20T03:30:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56216a2003a0 con 0x56216a1ebb50 2026-02-20T03:30:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bb9d2b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a201c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bb9d2b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a201c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45130/0 (socket says 10.20.193.28:45130) 2026-02-20T03:30:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bb9d2b640 1 -- 10.20.193.28:0/3022277253 learned_addr learned my addr 10.20.193.28:0/3022277253 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bb9d2b640 1 -- 10.20.193.28:0/3022277253 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1ebb50 msgr2=0x56216a1ffe10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bb9d2b640 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1ebb50 0x56216a1ffe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bb9d2b640 1 -- 10.20.193.28:0/3022277253 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1e7260 msgr2=0x56216a2016d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bb9d2b640 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1e7260 0x56216a2016d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bb9d2b640 1 -- 10.20.193.28:0/3022277253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216a1f9630 con 0x56216a1e7c10 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8bb9d2b640 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a201c10 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80c9ff0 tx=0x7f8ba80c9290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281ebbf7d312a87e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.045+0000 7f8b67fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8b67fff640 1 -- 10.20.193.28:0/3022277253 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80402d0 con 0x56216a1e7c10 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3022277253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562169f08ec0 con 0x56216a1e7c10 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 10 client.19620 _ll_register_callbacks cb 0x56216a0e5060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3022277253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56216a141470 con 0x56216a1e7c10 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8b67fff640 1 -- 10.20.193.28:0/3022277253 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ba8033020 con 0x56216a1e7c10 2026-02-20T03:30:00.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8b67fff640 1 -- 10.20.193.28:0/3022277253 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba80402d0 con 0x56216a1e7c10 2026-02-20T03:30:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8b67fff640 1 -- 10.20.193.28:0/3022277253 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f8ba80cbfe0 con 0x56216a1e7c10 2026-02-20T03:30:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8b67fff640 1 -- 10.20.193.28:0/3022277253 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8ba80cc300 con 0x56216a1e7c10 2026-02-20T03:30:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 10 client.19620 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3022277253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x56216a0d9680 con 0x56216a1e7c10 2026-02-20T03:30:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8b67fff640 1 -- 10.20.193.28:0/3022277253 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f8ba8004280 con 0x56216a1e7c10 2026-02-20T03:30:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 10 client.19620 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 10 client.19620 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:30:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 20 client.19620 populate_metadata read hostname 'trial028' 2026-02-20T03:30:00.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56216a20fdd0 0x56216a212290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 4 client.19620 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:00.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.046+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3022277253 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56216a0bbf90 con 0x56216a20fdd0 2026-02-20T03:30:00.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.068+0000 7f8bba52c640 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56216a20fdd0 0x56216a212290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.108+0000 7f8bba52c640 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56216a20fdd0 0x56216a212290 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e7209fdc813fca74 server_cookie=3d573cf35f68fb1b in_seq=0 out_seq=0 2026-02-20T03:30:00.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.108+0000 7f8b67fff640 10 client.19620 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:30:00.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.122+0000 7f8b67fff640 1 -- 10.20.193.28:0/3022277253 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56216a0bbf90 con 0x56216a20fdd0 2026-02-20T03:30:00.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.122+0000 7f8b67fff640 10 client.19620 handle_command_reply: tid=0 2026-02-20T03:30:00.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.122+0000 7f8bbecbce00 1 client.19620 shutdown 2026-02-20T03:30:00.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3022277253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 msgr2=0x56216a201c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a201c10 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80c9ff0 tx=0x7f8ba80c9290 comp rx=0 tx=0).stop 2026-02-20T03:30:00.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3022277253 shutdown_connections 2026-02-20T03:30:00.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56216a20fdd0 0x56216a212290 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1ebb50 0x56216a1ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7c10 0x56216a201c10 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3022277253 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1e7260 0x56216a2016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3022277253 >> 10.20.193.28:0/3022277253 conn(0x56216a1e3390 msgr2=0x56216a1eced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8b67fff640 0 client.19620 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:30:00.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3022277253 shutdown_connections 2026-02-20T03:30:00.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3022277253 wait complete. 2026-02-20T03:30:00.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.123+0000 7f8bbecbce00 20 client.19620 trim_cache size 0 max 16384 2026-02-20T03:30:00.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bbecbce00 1 Processor -- start 2026-02-20T03:30:00.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bbecbce00 1 -- start start 2026-02-20T03:30:00.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7260 0x56216a1fd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7c10 0x56216a1fec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1ebb50 0x56216a1e4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c012790 con 0x56216a1e7260 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c010000 con 0x56216a1ebb50 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c00de50 con 0x56216a1e7c10 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bba52c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7260 0x56216a1fd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bba52c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7260 0x56216a1fd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45132/0 (socket says 10.20.193.28:45132) 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.131+0000 7f8bba52c640 1 -- 10.20.193.28:0/2157306904 learned_addr learned my addr 10.20.193.28:0/2157306904 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bba52c640 1 -- 10.20.193.28:0/2157306904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7c10 msgr2=0x56216a1fec50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bba52c640 1 --2- 10.20.193.28:0/2157306904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7c10 0x56216a1fec50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bba52c640 1 -- 10.20.193.28:0/2157306904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1ebb50 msgr2=0x56216a1e4780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bba52c640 1 --2- 10.20.193.28:0/2157306904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1ebb50 0x56216a1e4780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bba52c640 1 -- 10.20.193.28:0/2157306904 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216a1f9460 con 0x56216a1e7260 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bba52c640 1 --2- 10.20.193.28:0/2157306904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7260 0x56216a1fd660 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400b4b0 tx=0x7f8ba400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438ae01b96d42654 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8b824e6640 1 -- 10.20.193.28:0/2157306904 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4016040 con 0x56216a1e7260 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8b824e6640 1 -- 10.20.193.28:0/2157306904 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8ba4017040 con 0x56216a1e7260 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8b824e6640 1 -- 10.20.193.28:0/2157306904 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4002e00 con 0x56216a1e7260 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2157306904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7260 msgr2=0x56216a1fd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/2157306904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7260 0x56216a1fd660 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400b4b0 tx=0x7f8ba400b900 comp rx=0 tx=0).stop 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2157306904 shutdown_connections 2026-02-20T03:30:00.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/2157306904 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1ebb50 0x56216a1e4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/2157306904 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7c10 0x56216a1fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/2157306904 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1e7260 0x56216a1fd660 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.132+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2157306904 >> 10.20.193.28:0/2157306904 conn(0x56216a1e3390 msgr2=0x56216a1fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.133+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2157306904 shutdown_connections 2026-02-20T03:30:00.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.133+0000 7f8bbecbce00 1 -- 10.20.193.28:0/2157306904 wait complete. 2026-02-20T03:30:00.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.133+0000 7f8bbecbce00 1 -- start start 2026-02-20T03:30:00.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.133+0000 7f8bbecbce00 1 Processor -- start 2026-02-20T03:30:00.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7260 0x56216a208970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1e7c10 0x56216a208eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbecbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1ebb50 0x56216a27bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c00e4c0 con 0x56216a1ebb50 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c00f930 con 0x56216a1e7c10 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbecbce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c00eb90 con 0x56216a1e7260 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbad2d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1ebb50 0x56216a27bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbad2d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1ebb50 0x56216a27bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45142/0 (socket says 10.20.193.28:45142) 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbad2d640 1 -- 10.20.193.28:0/3729873482 learned_addr learned my addr 10.20.193.28:0/3729873482 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbad2d640 1 -- 10.20.193.28:0/3729873482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7260 msgr2=0x56216a208970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbad2d640 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7260 0x56216a208970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbad2d640 1 -- 10.20.193.28:0/3729873482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1e7c10 msgr2=0x56216a208eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbad2d640 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1e7c10 0x56216a208eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbad2d640 1 -- 10.20.193.28:0/3729873482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562169e9d6c0 con 0x56216a1ebb50 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8bbad2d640 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1ebb50 0x56216a27bd80 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0004350 tx=0x7f8bb0004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cab3f570b15dbe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.134+0000 7f8b67fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8b67fff640 1 -- 10.20.193.28:0/3729873482 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0006e60 con 0x56216a1ebb50 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8b67fff640 1 -- 10.20.193.28:0/3729873482 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8bb001f020 con 0x56216a1ebb50 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8b67fff640 1 -- 10.20.193.28:0/3729873482 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb001acb0 con 0x56216a1ebb50 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3729873482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56216a0ca140 con 0x56216a1ebb50 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8bbecbce00 10 client.19626 _ll_register_callbacks cb 0x7f8ba80c8d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3729873482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ba4004480 con 0x56216a1ebb50 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8b67fff640 1 -- 10.20.193.28:0/3729873482 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f8bb001a430 con 0x56216a1ebb50 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8b67fff640 1 -- 10.20.193.28:0/3729873482 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8bb001e030 con 0x56216a1ebb50 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8bbecbce00 10 client.19626 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.135+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3729873482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x56216a1fa150 con 0x56216a1ebb50 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.136+0000 7f8b67fff640 1 -- 10.20.193.28:0/3729873482 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f8bb000d920 con 0x56216a1ebb50 2026-02-20T03:30:00.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.136+0000 7f8bbecbce00 10 client.19626 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:00.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.136+0000 7f8bbecbce00 10 client.19626 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:30:00.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.136+0000 7f8bbecbce00 20 client.19626 populate_metadata read hostname 'trial028' 2026-02-20T03:30:00.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.136+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56216a27d830 0x56216a27fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.136+0000 7f8bbecbce00 4 client.19626 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-189aa5bc-1-mds.i.json"}] 2026-02-20T03:30:00.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.136+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3729873482 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-189aa5bc-1-mds.i.json"}) -- 0x562169eba610 con 0x56216a27d830 2026-02-20T03:30:00.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.136+0000 7f8bba52c640 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56216a27d830 0x56216a27fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.190+0000 7f8bba52c640 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56216a27d830 0x56216a27fcf0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76b5ed91692befd server_cookie=d07e485ce38efc1 in_seq=0 out_seq=0 2026-02-20T03:30:00.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.190+0000 7f8b67fff640 10 client.19626 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:30:00.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.217+0000 7f8b67fff640 1 -- 10.20.193.28:0/3729873482 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x562169eba610 con 0x56216a27d830 2026-02-20T03:30:00.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.217+0000 7f8b67fff640 10 client.19626 handle_command_reply: tid=0 2026-02-20T03:30:00.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.217+0000 7f8bbecbce00 1 client.19626 shutdown 2026-02-20T03:30:00.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.217+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3729873482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1ebb50 msgr2=0x56216a27bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.217+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1ebb50 0x56216a27bd80 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0004350 tx=0x7f8bb0004bd0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.218+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3729873482 shutdown_connections 2026-02-20T03:30:00.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.218+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56216a27d830 0x56216a27fcf0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.218+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56216a1ebb50 0x56216a27bd80 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.218+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56216a1e7c10 0x56216a208eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.218+0000 7f8bbecbce00 1 --2- 10.20.193.28:0/3729873482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56216a1e7260 0x56216a208970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.218+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3729873482 >> 10.20.193.28:0/3729873482 conn(0x56216a1e3390 msgr2=0x56216a205de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.218+0000 7f8b67fff640 0 client.19626 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:30:00.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.218+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3729873482 shutdown_connections 2026-02-20T03:30:00.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.218+0000 7f8bbecbce00 1 -- 10.20.193.28:0/3729873482 wait complete. 2026-02-20T03:30:00.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.230+0000 7f8bbecbce00 20 client.19626 trim_cache size 0 max 16384 2026-02-20T03:30:00.234 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:30:00.235 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/var/run/ceph/ops-189aa5bc-1-mds.i.json" 2026-02-20T03:30:00.235 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:30:00.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.230+0000 7f8bbb52e640 1 -- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b900b0f40 msgr2=0x7f8b900b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.230+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b900b0f40 0x7f8b900b3400 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000aab0 tx=0x7f8bb0009250 comp rx=0 tx=0).stop 2026-02-20T03:30:00.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.230+0000 7f8bbb52e640 1 -- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb41030b0 msgr2=0x7f8bb4072c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.230+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb41030b0 0x7f8bb4072c10 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8ba802f7a0 tx=0x7f8ba802fce0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.231+0000 7f8bbb52e640 1 -- 10.20.193.28:0/1648165547 shutdown_connections 2026-02-20T03:30:00.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.231+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8b900b0f40 0x7f8b900b3400 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.231+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8bb4108710 0x7f8bb406d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.231+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8bb41030b0 0x7f8bb4072c10 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.231+0000 7f8bbb52e640 1 --2- 10.20.193.28:0/1648165547 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8bb4102710 0x7f8bb40726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.231+0000 7f8bbb52e640 1 -- 10.20.193.28:0/1648165547 >> 10.20.193.28:0/1648165547 conn(0x7f8bb40fe410 msgr2=0x7f8bb40fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.231+0000 7f8bbb52e640 1 -- 10.20.193.28:0/1648165547 shutdown_connections 2026-02-20T03:30:00.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.231+0000 7f8bbb52e640 1 -- 10.20.193.28:0/1648165547 wait complete. 2026-02-20T03:30:00.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.317+0000 7f03c683c640 1 -- 10.20.193.28:0/2461599505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 msgr2=0x7f03c0115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.317+0000 7f03c683c640 1 --2- 10.20.193.28:0/2461599505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 0x7f03c0115d10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00b0a0 tx=0x7f03bc02f450 comp rx=0 tx=0).stop 2026-02-20T03:30:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.317+0000 7f03c683c640 1 -- 10.20.193.28:0/2461599505 shutdown_connections 2026-02-20T03:30:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.317+0000 7f03c683c640 1 --2- 10.20.193.28:0/2461599505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 0x7f03c0115d10 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.317+0000 7f03c683c640 1 --2- 10.20.193.28:0/2461599505 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03c0109220 0x7f03c0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.317+0000 7f03c683c640 1 --2- 10.20.193.28:0/2461599505 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03c010eef0 0x7f03c010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.317+0000 7f03c683c640 1 -- 10.20.193.28:0/2461599505 >> 10.20.193.28:0/2461599505 conn(0x7f03c0078600 msgr2=0x7f03c007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.317+0000 7f03c683c640 1 -- 10.20.193.28:0/2461599505 shutdown_connections 2026-02-20T03:30:00.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.317+0000 7f03c683c640 1 -- 10.20.193.28:0/2461599505 wait complete. 2026-02-20T03:30:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c683c640 1 Processor -- start 2026-02-20T03:30:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c683c640 1 -- start start 2026-02-20T03:30:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c683c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03c0109220 0x7f03c01a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c683c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 0x7f03c01a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c683c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03c010eef0 0x7f03c01a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c683c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f03c01191b0 con 0x7f03c0109ba0 2026-02-20T03:30:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c683c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f03c0119030 con 0x7f03c0109220 2026-02-20T03:30:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c683c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f03c0119330 con 0x7f03c010eef0 2026-02-20T03:30:00.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c5039640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 0x7f03c01a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c5039640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 0x7f03c01a1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45152/0 (socket says 10.20.193.28:45152) 2026-02-20T03:30:00.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.318+0000 7f03c5039640 1 -- 10.20.193.28:0/1672891397 learned_addr learned my addr 10.20.193.28:0/1672891397 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03c5039640 1 -- 10.20.193.28:0/1672891397 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03c010eef0 msgr2=0x7f03c01a5f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:00.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03c5039640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03c010eef0 0x7f03c01a5f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03c5039640 1 -- 10.20.193.28:0/1672891397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03c0109220 msgr2=0x7f03c01a1630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03c5039640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03c0109220 0x7f03c01a1630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03c5039640 1 -- 10.20.193.28:0/1672891397 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c01a6680 con 0x7f03c0109ba0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03c5039640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 0x7f03c01a1b70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f03b400b7d0 tx=0x7f03b400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03aeffd640 1 -- 10.20.193.28:0/1672891397 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b4004270 con 0x7f03c0109ba0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03aeffd640 1 -- 10.20.193.28:0/1672891397 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03b4010070 con 0x7f03c0109ba0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03c683c640 1 -- 10.20.193.28:0/1672891397 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c01a6970 con 0x7f03c0109ba0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03aeffd640 1 -- 10.20.193.28:0/1672891397 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b400cc20 con 0x7f03c0109ba0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.319+0000 7f03c683c640 1 -- 10.20.193.28:0/1672891397 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c01ae1b0 con 0x7f03c0109ba0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.322+0000 7f03c9fcae00 1 Processor -- start 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.322+0000 7f03c9fcae00 1 -- start start 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03aeffd640 1 -- 10.20.193.28:0/1672891397 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f03b401d030 con 0x7f03c0109ba0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd02390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fcfca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd08de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc3fc7ce00 con 0x55dc3fcfcf60 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dc3fc4f970 con 0x55dc3fd01fb0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc3fbfd1f0 con 0x55dc3fcfc5e0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c5039640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd08de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c5039640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd08de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45156/0 (socket says 10.20.193.28:45156) 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c5039640 1 -- 10.20.193.28:0/2746474311 learned_addr learned my addr 10.20.193.28:0/2746474311 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c5039640 1 -- 10.20.193.28:0/2746474311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfc5e0 msgr2=0x55dc3fcfca20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c5039640 1 --2- 10.20.193.28:0/2746474311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fcfca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c5039640 1 -- 10.20.193.28:0/2746474311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fd01fb0 msgr2=0x55dc3fd02390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c5039640 1 --2- 10.20.193.28:0/2746474311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd02390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c5039640 1 -- 10.20.193.28:0/2746474311 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3fc103d0 con 0x55dc3fcfcf60 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.323+0000 7f03c5039640 1 --2- 10.20.193.28:0/2746474311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd08de0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f03b40e5d00 tx=0x7f03b40e7750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adf0c6867d47384 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.324+0000 7f038e4e6640 1 -- 10.20.193.28:0/2746474311 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40f9a10 con 0x55dc3fcfcf60 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.324+0000 7f038e4e6640 1 -- 10.20.193.28:0/2746474311 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03b40fd070 con 0x55dc3fcfcf60 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.324+0000 7f038e4e6640 1 -- 10.20.193.28:0/2746474311 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40e1070 con 0x55dc3fcfcf60 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.324+0000 7f03aeffd640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f039c0b0ea0 0x7f039c0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.324+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2746474311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfcf60 msgr2=0x55dc3fd08de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.324+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/2746474311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd08de0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f03b40e5d00 tx=0x7f03b40e7750 comp rx=0 tx=0).stop 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.324+0000 7f03aeffd640 1 -- 10.20.193.28:0/1672891397 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f03b40df8c0 con 0x7f03c0109ba0 2026-02-20T03:30:00.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.325+0000 7f03c603b640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f039c0b0ea0 0x7f039c0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.325+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2746474311 shutdown_connections 2026-02-20T03:30:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.325+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/2746474311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd08de0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.325+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/2746474311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fcfca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.325+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/2746474311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd02390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.325+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2746474311 >> 10.20.193.28:0/2746474311 conn(0x55dc3fcbf240 msgr2=0x55dc3fcface0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.325+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2746474311 shutdown_connections 2026-02-20T03:30:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.325+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2746474311 wait complete. 2026-02-20T03:30:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.325+0000 7f03c603b640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f039c0b0ea0 0x7f039c0b3360 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00b0a0 tx=0x7f03bc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.326+0000 7f03c9fcae00 1 -- start start 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.326+0000 7f03c9fcae00 1 Processor -- start 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.327+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd16f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.327+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd174b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.327+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd15460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.327+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc3fc4b8a0 con 0x55dc3fd01fb0 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.327+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dc3fa3df50 con 0x55dc3fcfc5e0 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.327+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc3fd159f0 con 0x55dc3fcfcf60 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.327+0000 7f03c603b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd15460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.327+0000 7f03c603b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd15460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45158/0 (socket says 10.20.193.28:45158) 2026-02-20T03:30:00.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.327+0000 7f03c603b640 1 -- 10.20.193.28:0/707503649 learned_addr learned my addr 10.20.193.28:0/707503649 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f03c603b640 1 -- 10.20.193.28:0/707503649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfcf60 msgr2=0x55dc3fd174b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f03c603b640 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd174b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f03c603b640 1 -- 10.20.193.28:0/707503649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfc5e0 msgr2=0x55dc3fd16f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f03c603b640 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd16f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f03c603b640 1 -- 10.20.193.28:0/707503649 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3fd0ea80 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f03c603b640 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd15460 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009370 tx=0x7f03bc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fb91d5c4590d58 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f037b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f037b7fe640 1 -- 10.20.193.28:0/707503649 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0078c0 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f037b7fe640 1 -- 10.20.193.28:0/707503649 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03bc047030 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f03c9fcae00 1 -- 10.20.193.28:0/707503649 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc3fa20b40 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f03c9fcae00 10 client.19638 _ll_register_callbacks cb 0x55dc3fc88eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f03c9fcae00 1 -- 10.20.193.28:0/707503649 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc3fc5d150 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.328+0000 7f037b7fe640 1 -- 10.20.193.28:0/707503649 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc042cf0 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f037b7fe640 1 -- 10.20.193.28:0/707503649 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f03bc038420 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f037b7fe640 1 -- 10.20.193.28:0/707503649 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f03bc051060 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f03c9fcae00 10 client.19638 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f03c9fcae00 1 -- 10.20.193.28:0/707503649 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55dc3fc0a1e0 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f037b7fe640 1 -- 10.20.193.28:0/707503649 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f03bc03f030 con 0x55dc3fd01fb0 2026-02-20T03:30:00.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f03c9fcae00 10 client.19638 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f03c9fcae00 10 client.19638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f03c9fcae00 20 client.19638 populate_metadata read hostname 'trial028' 2026-02-20T03:30:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc3fd25790 0x55dc3fd27c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f03c9fcae00 4 client.19638 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:00.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.329+0000 7f03c9fcae00 1 -- 10.20.193.28:0/707503649 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc3fc57560 con 0x55dc3fd25790 2026-02-20T03:30:00.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.347+0000 7f03c583a640 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc3fd25790 0x55dc3fd27c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.403 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 0 (b) to a remote file /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.b.json 2026-02-20T03:30:00.403 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 ops --flags=locks --path=/var/run/ceph/ops-189aa5bc-1-mds.b.json 2026-02-20T03:30:00.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.403+0000 7f03c583a640 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc3fd25790 0x55dc3fd27c20 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ab96ee27d5b13d server_cookie=88081991776f2fa3 in_seq=0 out_seq=0 2026-02-20T03:30:00.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.403+0000 7f037b7fe640 10 client.19638 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:00.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.429+0000 7f037b7fe640 1 -- 10.20.193.28:0/707503649 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55dc3fc57560 con 0x55dc3fd25790 2026-02-20T03:30:00.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.429+0000 7f037b7fe640 10 client.19638 handle_command_reply: tid=0 2026-02-20T03:30:00.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 client.19638 shutdown 2026-02-20T03:30:00.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 -- 10.20.193.28:0/707503649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 msgr2=0x55dc3fd15460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd15460 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009370 tx=0x7f03bc0099e0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 -- 10.20.193.28:0/707503649 shutdown_connections 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc3fd25790 0x55dc3fd27c20 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd15460 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd174b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/707503649 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd16f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 -- 10.20.193.28:0/707503649 >> 10.20.193.28:0/707503649 conn(0x55dc3fcbf240 msgr2=0x55dc3fcfb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f037b7fe640 0 client.19638 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.430+0000 7f03c9fcae00 1 -- 10.20.193.28:0/707503649 shutdown_connections 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.431+0000 7f03c9fcae00 1 -- 10.20.193.28:0/707503649 wait complete. 2026-02-20T03:30:00.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.431+0000 7f03c9fcae00 20 client.19638 trim_cache size 0 max 16384 2026-02-20T03:30:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c9fcae00 1 Processor -- start 2026-02-20T03:30:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c9fcae00 1 -- start start 2026-02-20T03:30:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd14390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd12910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd12e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f036c012750 con 0x55dc3fcfc5e0 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f036c00ffc0 con 0x55dc3fcfcf60 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f036c00de10 con 0x55dc3fd01fb0 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c583a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd14390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c583a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd14390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45168/0 (socket says 10.20.193.28:45168) 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c583a640 1 -- 10.20.193.28:0/2877962273 learned_addr learned my addr 10.20.193.28:0/2877962273 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c583a640 1 -- 10.20.193.28:0/2877962273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fd01fb0 msgr2=0x55dc3fd12e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c583a640 1 --2- 10.20.193.28:0/2877962273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd12e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c583a640 1 -- 10.20.193.28:0/2877962273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfcf60 msgr2=0x55dc3fd12910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c583a640 1 --2- 10.20.193.28:0/2877962273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd12910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.438+0000 7f03c583a640 1 -- 10.20.193.28:0/2877962273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3fd0e8b0 con 0x55dc3fcfc5e0 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c583a640 1 --2- 10.20.193.28:0/2877962273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd14390 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009590 tx=0x7f03b00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2531cc5dbbf994fa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f038dce5640 1 -- 10.20.193.28:0/2877962273 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0015040 con 0x55dc3fcfc5e0 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f038dce5640 1 -- 10.20.193.28:0/2877962273 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03b0009dc0 con 0x55dc3fcfc5e0 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f038dce5640 1 -- 10.20.193.28:0/2877962273 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b00183c0 con 0x55dc3fcfc5e0 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2877962273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfc5e0 msgr2=0x55dc3fd14390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/2877962273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd14390 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009590 tx=0x7f03b00047e0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2877962273 shutdown_connections 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/2877962273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd12e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/2877962273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd12910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/2877962273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd14390 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2877962273 >> 10.20.193.28:0/2877962273 conn(0x55dc3fcbf240 msgr2=0x55dc3fd13c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2877962273 shutdown_connections 2026-02-20T03:30:00.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.439+0000 7f03c9fcae00 1 -- 10.20.193.28:0/2877962273 wait complete. 2026-02-20T03:30:00.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.440+0000 7f03c9fcae00 1 -- start start 2026-02-20T03:30:00.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.440+0000 7f03c9fcae00 1 Processor -- start 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.440+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd1a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.440+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd1ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.440+0000 7f03c9fcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd90710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.440+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f036c00e480 con 0x55dc3fd01fb0 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.440+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f036c00f8f0 con 0x55dc3fcfcf60 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.440+0000 7f03c9fcae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f036c00eb50 con 0x55dc3fcfc5e0 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c603b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd90710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c603b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd90710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45180/0 (socket says 10.20.193.28:45180) 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c603b640 1 -- 10.20.193.28:0/619547341 learned_addr learned my addr 10.20.193.28:0/619547341 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c603b640 1 -- 10.20.193.28:0/619547341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfc5e0 msgr2=0x55dc3fd1a5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c603b640 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd1a5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c603b640 1 -- 10.20.193.28:0/619547341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfcf60 msgr2=0x55dc3fd1ab20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c603b640 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd1ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c603b640 1 -- 10.20.193.28:0/619547341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3f92e870 con 0x55dc3fd01fb0 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c603b640 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd90710 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f03bc043010 tx=0x7f03bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fa64a465e1f055 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f037b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f037b7fe640 1 -- 10.20.193.28:0/619547341 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc007ac0 con 0x55dc3fd01fb0 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f037b7fe640 1 -- 10.20.193.28:0/619547341 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03bc047040 con 0x55dc3fd01fb0 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f037b7fe640 1 -- 10.20.193.28:0/619547341 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03bc042420 con 0x55dc3fd01fb0 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c9fcae00 1 -- 10.20.193.28:0/619547341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc3fbef3f0 con 0x55dc3fd01fb0 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f037b7fe640 1 -- 10.20.193.28:0/619547341 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f03bc0425c0 con 0x55dc3fd01fb0 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.441+0000 7f03c9fcae00 10 client.19644 _ll_register_callbacks cb 0x7f03bc009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:00.449 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f03c9fcae00 1 -- 10.20.193.28:0/619547341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc3fc207c0 con 0x55dc3fd01fb0 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f037b7fe640 1 -- 10.20.193.28:0/619547341 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f03bc007c60 con 0x55dc3fd01fb0 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f03c9fcae00 10 client.19644 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f03c9fcae00 1 -- 10.20.193.28:0/619547341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55dc3fd0f5a0 con 0x55dc3fd01fb0 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f037b7fe640 1 -- 10.20.193.28:0/619547341 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f03bc05e070 con 0x55dc3fd01fb0 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f03c9fcae00 10 client.19644 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f03c9fcae00 10 client.19644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f03c9fcae00 20 client.19644 populate_metadata read hostname 'trial028' 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc3fd920d0 0x55dc3fd94590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f03c9fcae00 4 client.19644 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:30:00.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.442+0000 7f03c9fcae00 1 -- 10.20.193.28:0/619547341 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc3fc01ab0 con 0x55dc3fd920d0 2026-02-20T03:30:00.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.456+0000 7f03c583a640 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc3fd920d0 0x55dc3fd94590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:00.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.523+0000 7f03c583a640 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc3fd920d0 0x55dc3fd94590 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=602df2cad08778ef server_cookie=d05a11bcd1203dd7 in_seq=0 out_seq=0 2026-02-20T03:30:00.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.523+0000 7f037b7fe640 10 client.19644 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:00.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.536+0000 7f037b7fe640 1 -- 10.20.193.28:0/619547341 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc3fc01ab0 con 0x55dc3fd920d0 2026-02-20T03:30:00.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.536+0000 7f037b7fe640 10 client.19644 handle_command_reply: tid=0 2026-02-20T03:30:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.536+0000 7f03c9fcae00 1 client.19644 shutdown 2026-02-20T03:30:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.536+0000 7f03c9fcae00 1 -- 10.20.193.28:0/619547341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 msgr2=0x55dc3fd90710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.536+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd90710 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f03bc043010 tx=0x7f03bc009250 comp rx=0 tx=0).stop 2026-02-20T03:30:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f03c9fcae00 1 -- 10.20.193.28:0/619547341 shutdown_connections 2026-02-20T03:30:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc3fd920d0 0x55dc3fd94590 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc3fd01fb0 0x55dc3fd90710 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc3fcfcf60 0x55dc3fd1ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f03c9fcae00 1 --2- 10.20.193.28:0/619547341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc3fcfc5e0 0x55dc3fd1a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f03c9fcae00 1 -- 10.20.193.28:0/619547341 >> 10.20.193.28:0/619547341 conn(0x55dc3fcbf240 msgr2=0x55dc3fd144a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f037b7fe640 0 client.19644 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f03c9fcae00 1 -- 10.20.193.28:0/619547341 shutdown_connections 2026-02-20T03:30:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f03c9fcae00 1 -- 10.20.193.28:0/619547341 wait complete. 2026-02-20T03:30:00.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.537+0000 7f03c9fcae00 20 client.19644 trim_cache size 0 max 16384 2026-02-20T03:30:00.542 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:30:00.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 -- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f039c0b0ea0 msgr2=0x7f039c0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f039c0b0ea0 0x7f039c0b3360 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00b0a0 tx=0x7f03bc005b50 comp rx=0 tx=0).stop 2026-02-20T03:30:00.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 -- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 msgr2=0x7f03c01a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:00.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 0x7f03c01a1b70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f03b400b7d0 tx=0x7f03b400bca0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 -- 10.20.193.28:0/1672891397 shutdown_connections 2026-02-20T03:30:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f039c0b0ea0 0x7f039c0b3360 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03c010eef0 0x7f03c01a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03c0109ba0 0x7f03c01a1b70 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 --2- 10.20.193.28:0/1672891397 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03c0109220 0x7f03c01a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 -- 10.20.193.28:0/1672891397 >> 10.20.193.28:0/1672891397 conn(0x7f03c0078600 msgr2=0x7f03c0079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 -- 10.20.193.28:0/1672891397 shutdown_connections 2026-02-20T03:30:00.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:00.538+0000 7f03c683c640 1 -- 10.20.193.28:0/1672891397 wait complete. 2026-02-20T03:30:00.685 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:00 trial028 ceph-mon[38552]: overall HEALTH_OK 2026-02-20T03:30:00.685 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:00 trial028 ceph-mon[38552]: pgmap v644: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 6.4 KiB/s wr, 17 op/s 2026-02-20T03:30:00.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 21.81 MB/sec warmup 91 sec latency 56724.089 ms 2026-02-20T03:30:00.752 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:00.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:00 trial177 ceph-mon[43181]: overall HEALTH_OK 2026-02-20T03:30:00.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:00 trial177 ceph-mon[43181]: pgmap v644: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 6.4 KiB/s wr, 17 op/s 2026-02-20T03:30:01.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:00 trial126 ceph-mon[38476]: overall HEALTH_OK 2026-02-20T03:30:01.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:00 trial126 ceph-mon[38476]: pgmap v644: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 6.4 KiB/s wr, 17 op/s 2026-02-20T03:30:01.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 -- 10.20.193.28:0/198715704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 msgr2=0x7f8580104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:01.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 --2- 10.20.193.28:0/198715704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 0x7f8580104e10 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f8570009a60 tx=0x7f857002f290 comp rx=0 tx=0).stop 2026-02-20T03:30:01.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 -- 10.20.193.28:0/198715704 shutdown_connections 2026-02-20T03:30:01.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 --2- 10.20.193.28:0/198715704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8580105350 0x7f8580111990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 --2- 10.20.193.28:0/198715704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 0x7f8580104e10 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 --2- 10.20.193.28:0/198715704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f858010aac0 0x7f858010aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 -- 10.20.193.28:0/198715704 >> 10.20.193.28:0/198715704 conn(0x7f8580100690 msgr2=0x7f8580102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:01.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 -- 10.20.193.28:0/198715704 shutdown_connections 2026-02-20T03:30:01.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 -- 10.20.193.28:0/198715704 wait complete. 2026-02-20T03:30:01.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 Processor -- start 2026-02-20T03:30:01.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.194+0000 7f8584c7f640 1 -- start start 2026-02-20T03:30:01.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f8584c7f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 0x7f858019d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f8584c7f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8580105350 0x7f858019d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f8584c7f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f858010aac0 0x7f85801a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f8584c7f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8580114e10 con 0x7f85801049b0 2026-02-20T03:30:01.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f8584c7f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8580114c90 con 0x7f8580105350 2026-02-20T03:30:01.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f8584c7f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8580114f90 con 0x7f858010aac0 2026-02-20T03:30:01.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f857f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 0x7f858019d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:01.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f857f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 0x7f858019d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45192/0 (socket says 10.20.193.28:45192) 2026-02-20T03:30:01.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f857f7fe640 1 -- 10.20.193.28:0/4266315922 learned_addr learned my addr 10.20.193.28:0/4266315922 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:01.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f857f7fe640 1 -- 10.20.193.28:0/4266315922 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f858010aac0 msgr2=0x7f85801a1c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:01.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f857f7fe640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f858010aac0 0x7f85801a1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f857f7fe640 1 -- 10.20.193.28:0/4266315922 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8580105350 msgr2=0x7f858019d8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:01.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f857f7fe640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8580105350 0x7f858019d8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.195+0000 7f857f7fe640 1 -- 10.20.193.28:0/4266315922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85801a23c0 con 0x7f85801049b0 2026-02-20T03:30:01.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.196+0000 7f857f7fe640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 0x7f858019d370 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f856c00b570 tx=0x7f856c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:01.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.196+0000 7f857cff9640 1 -- 10.20.193.28:0/4266315922 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c013020 con 0x7f85801049b0 2026-02-20T03:30:01.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.196+0000 7f857cff9640 1 -- 10.20.193.28:0/4266315922 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f856c004480 con 0x7f85801049b0 2026-02-20T03:30:01.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.196+0000 7f857cff9640 1 -- 10.20.193.28:0/4266315922 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c00fb50 con 0x7f85801049b0 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.196+0000 7f8584c7f640 1 -- 10.20.193.28:0/4266315922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85801a26b0 con 0x7f85801049b0 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.196+0000 7f8584c7f640 1 -- 10.20.193.28:0/4266315922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85801a9ef0 con 0x7f85801049b0 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.198+0000 7f857cff9640 1 -- 10.20.193.28:0/4266315922 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f856c002780 con 0x7f85801049b0 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.199+0000 7f858840de00 1 Processor -- start 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f858840de00 1 -- start start 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f858840de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924260 0x565011924640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f858840de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924c10 0x565011928530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f858840de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x565011928fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f858840de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x565011876880 con 0x565011928b50 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f858840de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x565011824350 con 0x565011924c10 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f858840de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5650118727b0 con 0x565011924260 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f857cff9640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85540b0e20 0x7f85540b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f857cff9640 1 -- 10.20.193.28:0/4266315922 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f856c0e0580 con 0x7f85801049b0 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f857effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x565011928fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f857effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x565011928fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45196/0 (socket says 10.20.193.28:45196) 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f857effd640 1 -- 10.20.193.28:0/46347699 learned_addr learned my addr 10.20.193.28:0/46347699 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.200+0000 7f857ffff640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85540b0e20 0x7f85540b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f857effd640 1 -- 10.20.193.28:0/46347699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924260 msgr2=0x565011924640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f857effd640 1 --2- 10.20.193.28:0/46347699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924260 0x565011924640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f857effd640 1 -- 10.20.193.28:0/46347699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924c10 msgr2=0x565011928530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f857effd640 1 --2- 10.20.193.28:0/46347699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924c10 0x565011928530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f857effd640 1 -- 10.20.193.28:0/46347699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56501181c9a0 con 0x565011928b50 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f857ffff640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85540b0e20 0x7f85540b32e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f857400ab10 tx=0x7f8574009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f857effd640 1 --2- 10.20.193.28:0/46347699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x565011928fb0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f85700097b0 tx=0x7f8570005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b5f780cc425361 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f8543fff640 1 -- 10.20.193.28:0/46347699 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570002c00 con 0x565011928b50 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f8543fff640 1 -- 10.20.193.28:0/46347699 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8570033040 con 0x565011928b50 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f8543fff640 1 -- 10.20.193.28:0/46347699 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570004290 con 0x565011928b50 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f858840de00 1 -- 10.20.193.28:0/46347699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 msgr2=0x565011928fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.201+0000 7f858840de00 1 --2- 10.20.193.28:0/46347699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x565011928fb0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f85700097b0 tx=0x7f8570005ce0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.202+0000 7f858840de00 1 -- 10.20.193.28:0/46347699 shutdown_connections 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.202+0000 7f858840de00 1 --2- 10.20.193.28:0/46347699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x565011928fb0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.202+0000 7f858840de00 1 --2- 10.20.193.28:0/46347699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924c10 0x565011928530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.202+0000 7f858840de00 1 --2- 10.20.193.28:0/46347699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924260 0x565011924640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.202+0000 7f858840de00 1 -- 10.20.193.28:0/46347699 >> 10.20.193.28:0/46347699 conn(0x565011920390 msgr2=0x565011922780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.202+0000 7f858840de00 1 -- 10.20.193.28:0/46347699 shutdown_connections 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.202+0000 7f858840de00 1 -- 10.20.193.28:0/46347699 wait complete. 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.203+0000 7f858840de00 1 -- start start 2026-02-20T03:30:01.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.203+0000 7f858840de00 1 Processor -- start 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.203+0000 7f858840de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924260 0x565011946eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f858840de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924c10 0x5650119473f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f858840de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x5650119455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f858840de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56501181e130 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f858840de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x565011930ce0 con 0x565011924c10 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f858840de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x565011945d70 con 0x565011924260 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f857ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x5650119455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f857ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x5650119455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45200/0 (socket says 10.20.193.28:45200) 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f857ffff640 1 -- 10.20.193.28:0/4011172343 learned_addr learned my addr 10.20.193.28:0/4011172343 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f857ffff640 1 -- 10.20.193.28:0/4011172343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924260 msgr2=0x565011946eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f857ffff640 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924260 0x565011946eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f857ffff640 1 -- 10.20.193.28:0/4011172343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924c10 msgr2=0x5650119473f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f857ffff640 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924c10 0x5650119473f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f857ffff640 1 -- 10.20.193.28:0/4011172343 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56501193eea0 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f857ffff640 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x5650119455f0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8574004740 tx=0x7f8574004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712be6cb2dcc5402 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f8541ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f8541ffb640 1 -- 10.20.193.28:0/4011172343 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857400dc60 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.204+0000 7f8541ffb640 1 -- 10.20.193.28:0/4011172343 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f857401f020 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f8541ffb640 1 -- 10.20.193.28:0/4011172343 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574016650 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 1 -- 10.20.193.28:0/4011172343 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565011645ec0 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 10 client.19656 _ll_register_callbacks cb 0x565011822060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 1 -- 10.20.193.28:0/4011172343 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56501187e470 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f8541ffb640 1 -- 10.20.193.28:0/4011172343 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f857400de00 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f8541ffb640 1 -- 10.20.193.28:0/4011172343 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f857401e020 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 10 client.19656 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 1 -- 10.20.193.28:0/4011172343 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x565011816680 con 0x565011928b50 2026-02-20T03:30:01.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f8541ffb640 1 -- 10.20.193.28:0/4011172343 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f857401a430 con 0x565011928b50 2026-02-20T03:30:01.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 10 client.19656 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:01.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 10 client.19656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:01.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 20 client.19656 populate_metadata read hostname 'trial028' 2026-02-20T03:30:01.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565011955840 0x565011957d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 4 client.19656 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:01.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.205+0000 7f858840de00 1 -- 10.20.193.28:0/4011172343 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650117f8f90 con 0x565011955840 2026-02-20T03:30:01.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.216+0000 7f857f7fe640 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565011955840 0x565011957d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:01.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.269+0000 7f857f7fe640 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565011955840 0x565011957d00 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad3bd55b317bfc30 server_cookie=af63ecded51b568f in_seq=0 out_seq=0 2026-02-20T03:30:01.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.269+0000 7f8541ffb640 10 client.19656 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:01.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f8541ffb640 1 -- 10.20.193.28:0/4011172343 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5650117f8f90 con 0x565011955840 2026-02-20T03:30:01.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f8541ffb640 10 client.19656 handle_command_reply: tid=0 2026-02-20T03:30:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 client.19656 shutdown 2026-02-20T03:30:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 -- 10.20.193.28:0/4011172343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 msgr2=0x5650119455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:01.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x5650119455f0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f8574004740 tx=0x7f8574004cc0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 -- 10.20.193.28:0/4011172343 shutdown_connections 2026-02-20T03:30:01.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565011955840 0x565011957d00 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011928b50 0x5650119455f0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924c10 0x5650119473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 --2- 10.20.193.28:0/4011172343 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924260 0x565011946eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 -- 10.20.193.28:0/4011172343 >> 10.20.193.28:0/4011172343 conn(0x565011920390 msgr2=0x565011929ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f8541ffb640 0 client.19656 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 -- 10.20.193.28:0/4011172343 shutdown_connections 2026-02-20T03:30:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 1 -- 10.20.193.28:0/4011172343 wait complete. 2026-02-20T03:30:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.283+0000 7f858840de00 20 client.19656 trim_cache size 0 max 16384 2026-02-20T03:30:01.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.291+0000 7f858840de00 1 Processor -- start 2026-02-20T03:30:01.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.291+0000 7f858840de00 1 -- start start 2026-02-20T03:30:01.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f858840de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011920390 0x565011957850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f858840de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924260 0x565011942ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f858840de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924c10 0x56501194a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f858840de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8520012750 con 0x565011920390 2026-02-20T03:30:01.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f858840de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f852000ffc0 con 0x565011924260 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f858840de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f852000de10 con 0x565011924c10 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f857f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011920390 0x565011957850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f857f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011920390 0x565011957850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45212/0 (socket says 10.20.193.28:45212) 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f857f7fe640 1 -- 10.20.193.28:0/693817787 learned_addr learned my addr 10.20.193.28:0/693817787 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f857f7fe640 1 -- 10.20.193.28:0/693817787 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924c10 msgr2=0x56501194a420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f857f7fe640 1 --2- 10.20.193.28:0/693817787 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924c10 0x56501194a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f857f7fe640 1 -- 10.20.193.28:0/693817787 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924260 msgr2=0x565011942ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f857f7fe640 1 --2- 10.20.193.28:0/693817787 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924260 0x565011942ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f857f7fe640 1 -- 10.20.193.28:0/693817787 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565011944530 con 0x565011920390 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f857f7fe640 1 --2- 10.20.193.28:0/693817787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011920390 0x565011957850 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f856c0e0870 tx=0x7f856c0ddac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d499f5c4bd484483 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:01.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f85437fe640 1 -- 10.20.193.28:0/693817787 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c0b14c0 con 0x565011920390 2026-02-20T03:30:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f85437fe640 1 -- 10.20.193.28:0/693817787 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f856c002aa0 con 0x565011920390 2026-02-20T03:30:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.292+0000 7f85437fe640 1 -- 10.20.193.28:0/693817787 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c0ac160 con 0x565011920390 2026-02-20T03:30:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.293+0000 7f858840de00 1 -- 10.20.193.28:0/693817787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011920390 msgr2=0x565011957850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.293+0000 7f858840de00 1 --2- 10.20.193.28:0/693817787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011920390 0x565011957850 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f856c0e0870 tx=0x7f856c0ddac0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.293+0000 7f858840de00 1 -- 10.20.193.28:0/693817787 shutdown_connections 2026-02-20T03:30:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.293+0000 7f858840de00 1 --2- 10.20.193.28:0/693817787 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924c10 0x56501194a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.293+0000 7f858840de00 1 --2- 10.20.193.28:0/693817787 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011924260 0x565011942ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.293+0000 7f858840de00 1 --2- 10.20.193.28:0/693817787 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011920390 0x565011957850 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.293+0000 7f858840de00 1 -- 10.20.193.28:0/693817787 >> 10.20.193.28:0/693817787 conn(0x5650119526b0 msgr2=0x565011949d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.293+0000 7f858840de00 1 -- 10.20.193.28:0/693817787 shutdown_connections 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.293+0000 7f858840de00 1 -- 10.20.193.28:0/693817787 wait complete. 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f858840de00 1 -- start start 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f858840de00 1 Processor -- start 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f858840de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011920390 0x56501194d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f858840de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011924260 0x56501194d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f858840de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924c10 0x56501194dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f858840de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f852000e480 con 0x565011924260 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f858840de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f852000f8f0 con 0x565011920390 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f858840de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f852000eb50 con 0x565011924c10 2026-02-20T03:30:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f857effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011924260 0x56501194d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f857effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011924260 0x56501194d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45214/0 (socket says 10.20.193.28:45214) 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f857effd640 1 -- 10.20.193.28:0/4106644637 learned_addr learned my addr 10.20.193.28:0/4106644637 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f857effd640 1 -- 10.20.193.28:0/4106644637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924c10 msgr2=0x56501194dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f857effd640 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924c10 0x56501194dbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f857effd640 1 -- 10.20.193.28:0/4106644637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011920390 msgr2=0x56501194d150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.294+0000 7f857effd640 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011920390 0x56501194d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f857effd640 1 -- 10.20.193.28:0/4106644637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56501193ecd0 con 0x565011924260 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f857effd640 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011924260 0x56501194d690 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x565011946a70 tx=0x7f8570030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5080bf50a71ed7f1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f85417fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f85417fa640 1 -- 10.20.193.28:0/4106644637 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85700384f0 con 0x565011924260 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f85417fa640 1 -- 10.20.193.28:0/4106644637 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8570046070 con 0x565011924260 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f85417fa640 1 -- 10.20.193.28:0/4106644637 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570030e60 con 0x565011924260 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f858840de00 1 -- 10.20.193.28:0/4106644637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650115da6c0 con 0x565011924260 2026-02-20T03:30:01.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f85417fa640 1 -- 10.20.193.28:0/4106644637 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f8570042410 con 0x565011924260 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f858840de00 10 client.19662 _ll_register_callbacks cb 0x7f8574004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f858840de00 1 -- 10.20.193.28:0/4106644637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8570033040 con 0x565011924260 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f85417fa640 1 -- 10.20.193.28:0/4106644637 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8570038730 con 0x565011924260 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f858840de00 10 client.19662 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.295+0000 7f858840de00 1 -- 10.20.193.28:0/4106644637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x565011807140 con 0x565011924260 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.296+0000 7f85417fa640 1 -- 10.20.193.28:0/4106644637 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f85700042d0 con 0x565011924260 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.296+0000 7f858840de00 10 client.19662 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.296+0000 7f858840de00 10 client.19662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.296+0000 7f858840de00 20 client.19662 populate_metadata read hostname 'trial028' 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.296+0000 7f858840de00 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565011928b50 0x5650119c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.296+0000 7f858840de00 4 client.19662 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-189aa5bc-1-mds.b.json"}] 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.296+0000 7f858840de00 1 -- 10.20.193.28:0/4106644637 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-189aa5bc-1-mds.b.json"}) -- 0x5650115e6d80 con 0x565011928b50 2026-02-20T03:30:01.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.296+0000 7f857f7fe640 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565011928b50 0x5650119c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:01.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.324+0000 7f857f7fe640 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565011928b50 0x5650119c4d30 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29d094e3527be0ce server_cookie=49a7efc83a3ff9f6 in_seq=0 out_seq=0 2026-02-20T03:30:01.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.324+0000 7f85417fa640 10 client.19662 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f85417fa640 1 -- 10.20.193.28:0/4106644637 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x5650115e6d80 con 0x565011928b50 2026-02-20T03:30:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f85417fa640 10 client.19662 handle_command_reply: tid=0 2026-02-20T03:30:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 client.19662 shutdown 2026-02-20T03:30:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 -- 10.20.193.28:0/4106644637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011924260 msgr2=0x56501194d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011924260 0x56501194d690 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x565011946a70 tx=0x7f8570030cf0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 -- 10.20.193.28:0/4106644637 shutdown_connections 2026-02-20T03:30:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x565011928b50 0x5650119c4d30 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565011924c10 0x56501194dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565011924260 0x56501194d690 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 --2- 10.20.193.28:0/4106644637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565011920390 0x56501194d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f85417fa640 0 client.19662 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 -- 10.20.193.28:0/4106644637 >> 10.20.193.28:0/4106644637 conn(0x5650119526b0 msgr2=0x56501194a530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 -- 10.20.193.28:0/4106644637 shutdown_connections 2026-02-20T03:30:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.338+0000 7f858840de00 1 -- 10.20.193.28:0/4106644637 wait complete. 2026-02-20T03:30:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f858840de00 20 client.19662 trim_cache size 0 max 16384 2026-02-20T03:30:01.354 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:30:01.354 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/var/run/ceph/ops-189aa5bc-1-mds.b.json" 2026-02-20T03:30:01.354 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:30:01.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 -- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85540b0e20 msgr2=0x7f85540b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:01.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85540b0e20 0x7f85540b32e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f857400ab10 tx=0x7f8574009230 comp rx=0 tx=0).stop 2026-02-20T03:30:01.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 -- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 msgr2=0x7f858019d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:01.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 0x7f858019d370 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f856c00b570 tx=0x7f856c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:30:01.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 -- 10.20.193.28:0/4266315922 shutdown_connections 2026-02-20T03:30:01.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f85540b0e20 0x7f85540b32e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f858010aac0 0x7f85801a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8580105350 0x7f858019d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 --2- 10.20.193.28:0/4266315922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f85801049b0 0x7f858019d370 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:01.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 -- 10.20.193.28:0/4266315922 >> 10.20.193.28:0/4266315922 conn(0x7f8580100690 msgr2=0x7f8580101070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:01.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 -- 10.20.193.28:0/4266315922 shutdown_connections 2026-02-20T03:30:01.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:01.339+0000 7f8584c7f640 1 -- 10.20.193.28:0/4266315922 wait complete. 2026-02-20T03:30:01.513 DEBUG:teuthology.orchestra.run.trial126:> mktemp 2026-02-20T03:30:01.530 INFO:teuthology.orchestra.run.trial126.stdout:/tmp/tmp.ordjFSQren 2026-02-20T03:30:01.531 DEBUG:teuthology.orchestra.run.trial126:> sudo cp /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.h.json /tmp/tmp.ordjFSQren 2026-02-20T03:30:01.600 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod 0666 /tmp/tmp.ordjFSQren 2026-02-20T03:30:01.683 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:30:01.683 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:30:01.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 21.58 MB/sec warmup 92 sec latency 57724.125 ms 2026-02-20T03:30:01.724 DEBUG:teuthology.orchestra.remote:trial126:/tmp/tmp.ordjFSQren is 865KB 2026-02-20T03:30:01.826 DEBUG:teuthology.orchestra.run.trial126:> rm -fr /tmp/tmp.ordjFSQren 2026-02-20T03:30:01.845 DEBUG:tasks.quiescer.fs.[cephfs]:read 885757B of ops from '/var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.h.json' on mds.2 (h) 2026-02-20T03:30:01.926 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for 189aa5bc-1: 'client_request(client.25141:336499 create owner_uid=1000, owner_gid=1002 #0x100000048d2/FSA4230.TMP 2026-02-20T03:29:12.493620+0000 caller_uid=1000, caller_gid=1002{6,36,1000,1002,})' 2026-02-20T03:30:01.943 INFO:tasks.quiescer.fs.[cephfs]:Pulled 318 ops from rank 2 (h) into home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/ops-189aa5bc-1-mds.h.json 2026-02-20T03:30:01.944 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -- /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.h.json 2026-02-20T03:30:01.968 DEBUG:teuthology.orchestra.run.trial177:> mktemp 2026-02-20T03:30:01.968 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:01.987 INFO:teuthology.orchestra.run.trial177.stdout:/tmp/tmp.cZR2t8GZrw 2026-02-20T03:30:01.987 DEBUG:teuthology.orchestra.run.trial177:> sudo cp /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.i.json /tmp/tmp.cZR2t8GZrw 2026-02-20T03:30:02.055 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod 0666 /tmp/tmp.cZR2t8GZrw 2026-02-20T03:30:02.178 DEBUG:teuthology.orchestra.remote:trial177:/tmp/tmp.cZR2t8GZrw is 1013KB 2026-02-20T03:30:02.281 DEBUG:teuthology.orchestra.run.trial177:> rm -fr /tmp/tmp.cZR2t8GZrw 2026-02-20T03:30:02.298 DEBUG:tasks.quiescer.fs.[cephfs]:read 1037356B of ops from '/var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.i.json' on mds.1 (i) 2026-02-20T03:30:02.351 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for 189aa5bc-1: 'client_request(client.25141:336507 create owner_uid=1000, owner_gid=1002 #0x100000049fc/PMD391.TMP 2026-02-20T03:29:17.300522+0000 caller_uid=1000, caller_gid=1002{6,36,1000,1002,})' 2026-02-20T03:30:02.357 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for 189aa5bc-1: 'client_request(client.25141:336517 readdir #0x100000049d2 2026-02-20T03:29:47.890896+0000 caller_uid=1000, caller_gid=1002{6,36,1000,1002,})' 2026-02-20T03:30:02.382 INFO:tasks.quiescer.fs.[cephfs]:Pulled 370 ops from rank 1 (i) into home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/ops-189aa5bc-1-mds.i.json 2026-02-20T03:30:02.382 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -- /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.i.json 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 -- 10.20.193.28:0/1151492643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc10eef0 msgr2=0x7ff9bc10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1151492643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc10eef0 0x7ff9bc10f2d0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009a30 tx=0x7ff9ac02f260 comp rx=0 tx=0).stop 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 -- 10.20.193.28:0/1151492643 shutdown_connections 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1151492643 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff9bc109ba0 0x7ff9bc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1151492643 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9bc109220 0x7ff9bc109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1151492643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc10eef0 0x7ff9bc10f2d0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 -- 10.20.193.28:0/1151492643 >> 10.20.193.28:0/1151492643 conn(0x7ff9bc078600 msgr2=0x7ff9bc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 -- 10.20.193.28:0/1151492643 shutdown_connections 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 -- 10.20.193.28:0/1151492643 wait complete. 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.342+0000 7ff9c2665640 1 Processor -- start 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c2665640 1 -- start start 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c2665640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9bc109220 0x7ff9bc1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c2665640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc109ba0 0x7ff9bc1a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c2665640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff9bc10eef0 0x7ff9bc1a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c2665640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc1191b0 con 0x7ff9bc109ba0 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c2665640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc119030 con 0x7ff9bc109220 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c2665640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff9bc119330 con 0x7ff9bc10eef0 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c0e62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc109ba0 0x7ff9bc1a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c0e62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc109ba0 0x7ff9bc1a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45232/0 (socket says 10.20.193.28:45232) 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c0e62640 1 -- 10.20.193.28:0/1639861577 learned_addr learned my addr 10.20.193.28:0/1639861577 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c0e62640 1 -- 10.20.193.28:0/1639861577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff9bc10eef0 msgr2=0x7ff9bc1a5fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c0e62640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff9bc10eef0 0x7ff9bc1a5fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c0e62640 1 -- 10.20.193.28:0/1639861577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9bc109220 msgr2=0x7ff9bc1a16d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c0e62640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9bc109220 0x7ff9bc1a16d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.343+0000 7ff9c0e62640 1 -- 10.20.193.28:0/1639861577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9bc1a6720 con 0x7ff9bc109ba0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.344+0000 7ff9c0e62640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc109ba0 0x7ff9bc1a1c10 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000b570 tx=0x7ff9b000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.344+0000 7ff9aa7fc640 1 -- 10.20.193.28:0/1639861577 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0013020 con 0x7ff9bc109ba0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.344+0000 7ff9c2665640 1 -- 10.20.193.28:0/1639861577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9bc1a6a10 con 0x7ff9bc109ba0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.344+0000 7ff9c2665640 1 -- 10.20.193.28:0/1639861577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9bc1ae250 con 0x7ff9bc109ba0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.344+0000 7ff9aa7fc640 1 -- 10.20.193.28:0/1639861577 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff9b0004480 con 0x7ff9bc109ba0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.344+0000 7ff9aa7fc640 1 -- 10.20.193.28:0/1639861577 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b000fb00 con 0x7ff9bc109ba0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.347+0000 7ff9aa7fc640 1 -- 10.20.193.28:0/1639861577 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff9b0002780 con 0x7ff9bc109ba0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.347+0000 7ff9c5df3e00 1 Processor -- start 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.347+0000 7ff9c5df3e00 1 -- start start 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e90c0 0x5596591e94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x5596591ed540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 0x5596591edfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55965913bc00 con 0x5596591e9a70 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5596590e93c0 con 0x5596591edb60 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559659137b30 con 0x5596591e90c0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c1663640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x5596591ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c1663640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x5596591ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45240/0 (socket says 10.20.193.28:45240) 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c1663640 1 -- 10.20.193.28:0/2209652613 learned_addr learned my addr 10.20.193.28:0/2209652613 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c1663640 1 -- 10.20.193.28:0/2209652613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e90c0 msgr2=0x5596591e94a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c1663640 1 --2- 10.20.193.28:0/2209652613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e90c0 0x5596591e94a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c1663640 1 -- 10.20.193.28:0/2209652613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 msgr2=0x5596591edfd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c1663640 1 --2- 10.20.193.28:0/2209652613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 0x5596591edfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c1663640 1 -- 10.20.193.28:0/2209652613 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596590e2840 con 0x5596591e9a70 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9c1663640 1 --2- 10.20.193.28:0/2209652613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x5596591ed540 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac032040 tx=0x7ff9ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e7a520f476ebd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.348+0000 7ff9aa7fc640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9980b0e20 0x7ff9980b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.349+0000 7ff9aa7fc640 1 -- 10.20.193.28:0/1639861577 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7ff9b00e0570 con 0x7ff9bc109ba0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.349+0000 7ff989ce5640 1 -- 10.20.193.28:0/2209652613 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0384f0 con 0x5596591e9a70 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.349+0000 7ff989ce5640 1 -- 10.20.193.28:0/2209652613 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff9ac033040 con 0x5596591e9a70 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.349+0000 7ff989ce5640 1 -- 10.20.193.28:0/2209652613 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0043b0 con 0x5596591e9a70 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.349+0000 7ff9c1e64640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9980b0e20 0x7ff9980b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.349+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2209652613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 msgr2=0x5596591ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.349+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2209652613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x5596591ed540 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac032040 tx=0x7ff9ac005880 comp rx=0 tx=0).stop 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.350+0000 7ff9c1e64640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9980b0e20 0x7ff9980b32e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800ab00 tx=0x7ff9b8009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.350+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2209652613 shutdown_connections 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.350+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2209652613 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 0x5596591edfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.350+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2209652613 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x5596591ed540 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.350+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2209652613 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e90c0 0x5596591e94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.350+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2209652613 >> 10.20.193.28:0/2209652613 conn(0x5596591e1b60 msgr2=0x5596591e75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.350+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2209652613 shutdown_connections 2026-02-20T03:30:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.350+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2209652613 wait complete. 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.351+0000 7ff9c5df3e00 1 -- start start 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.351+0000 7ff9c5df3e00 1 Processor -- start 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.351+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596592034e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.351+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591e9a70 0x559659203a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.351+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591edb60 0x559659201c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.351+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5596590e31a0 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.351+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5596591f5d10 con 0x5596591e9a70 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.351+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5596592023a0 con 0x5596591edb60 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c1663640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596592034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c1663640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596592034e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45246/0 (socket says 10.20.193.28:45246) 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c1663640 1 -- 10.20.193.28:0/2734398494 learned_addr learned my addr 10.20.193.28:0/2734398494 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c1663640 1 -- 10.20.193.28:0/2734398494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591edb60 msgr2=0x559659201c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c1663640 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591edb60 0x559659201c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c1663640 1 -- 10.20.193.28:0/2734398494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591e9a70 msgr2=0x559659203a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c1663640 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591e9a70 0x559659203a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c1663640 1 -- 10.20.193.28:0/2734398494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596591fb630 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c1663640 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596592034e0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac02f770 tx=0x7ff9ac0028f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99812e14f9ee7a12 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff976ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff976ffd640 1 -- 10.20.193.28:0/2734398494 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac02fcd0 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2734398494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559658f0ab60 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c5df3e00 10 client.19674 _ll_register_callbacks cb 0x5596590e70d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff976ffd640 1 -- 10.20.193.28:0/2734398494 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff9ac046070 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.352+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2734398494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5596591437f0 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff976ffd640 1 -- 10.20.193.28:0/2734398494 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac038e10 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff976ffd640 1 -- 10.20.193.28:0/2734398494 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7ff9ac04b470 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff976ffd640 1 -- 10.20.193.28:0/2734398494 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff9ac004130 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff9c5df3e00 10 client.19674 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2734398494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x559659108430 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff976ffd640 1 -- 10.20.193.28:0/2734398494 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7ff9ac053030 con 0x5596591e90c0 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff9c5df3e00 10 client.19674 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff9c5df3e00 10 client.19674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff9c5df3e00 20 client.19674 populate_metadata read hostname 'trial028' 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559659211960 0x559659213d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff9c5df3e00 4 client.19674 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.353+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2734398494 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596590bdc00 con 0x559659211960 2026-02-20T03:30:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.377+0000 7ff9c0e62640 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559659211960 0x559659213d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:02.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.404+0000 7ff9c0e62640 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559659211960 0x559659213d50 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed1b7bcc1a4ef251 server_cookie=a898fdd5062018b3 in_seq=0 out_seq=0 2026-02-20T03:30:02.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.404+0000 7ff976ffd640 10 client.19674 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:02.411 DEBUG:teuthology.orchestra.run.trial126:> mktemp 2026-02-20T03:30:02.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff976ffd640 1 -- 10.20.193.28:0/2734398494 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5596590bdc00 con 0x559659211960 2026-02-20T03:30:02.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff976ffd640 10 client.19674 handle_command_reply: tid=0 2026-02-20T03:30:02.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 client.19674 shutdown 2026-02-20T03:30:02.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2734398494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 msgr2=0x5596592034e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:02.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596592034e0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac02f770 tx=0x7ff9ac0028f0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.426 INFO:teuthology.orchestra.run.trial126.stdout:/tmp/tmp.TCbifSLF5F 2026-02-20T03:30:02.426 DEBUG:teuthology.orchestra.run.trial126:> sudo cp /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.b.json /tmp/tmp.TCbifSLF5F 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2734398494 shutdown_connections 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559659211960 0x559659213d50 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591edb60 0x559659201c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591e9a70 0x559659203a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/2734398494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596592034e0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2734398494 >> 10.20.193.28:0/2734398494 conn(0x5596591e1b60 msgr2=0x5596591ec520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff976ffd640 0 client.19674 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2734398494 shutdown_connections 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/2734398494 wait complete. 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.418+0000 7ff9c5df3e00 20 client.19674 trim_cache size 0 max 16384 2026-02-20T03:30:02.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.427+0000 7ff9c5df3e00 1 Processor -- start 2026-02-20T03:30:02.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.427+0000 7ff9c5df3e00 1 -- start start 2026-02-20T03:30:02.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596591ed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e9a70 0x5596591eec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 0x559659218500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff9680126c0 con 0x5596591e90c0 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff96800ff30 con 0x5596591edb60 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff96800dd80 con 0x5596591e9a70 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c1663640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596591ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c1663640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596591ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45250/0 (socket says 10.20.193.28:45250) 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c1663640 1 -- 10.20.193.28:0/3869051853 learned_addr learned my addr 10.20.193.28:0/3869051853 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c1663640 1 -- 10.20.193.28:0/3869051853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e9a70 msgr2=0x5596591eec20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c1663640 1 --2- 10.20.193.28:0/3869051853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e9a70 0x5596591eec20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c1663640 1 -- 10.20.193.28:0/3869051853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 msgr2=0x559659218500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c1663640 1 --2- 10.20.193.28:0/3869051853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 0x559659218500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c1663640 1 -- 10.20.193.28:0/3869051853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596591fb460 con 0x5596591e90c0 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9c1663640 1 --2- 10.20.193.28:0/3869051853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596591ed220 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac004100 tx=0x7ff9ac054000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25c5aa11115fdce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.428+0000 7ff9894e4640 1 -- 10.20.193.28:0/3869051853 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac02fcd0 con 0x5596591e90c0 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9894e4640 1 -- 10.20.193.28:0/3869051853 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff9ac046040 con 0x5596591e90c0 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9894e4640 1 -- 10.20.193.28:0/3869051853 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac04b6d0 con 0x5596591e90c0 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3869051853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 msgr2=0x5596591ed220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3869051853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596591ed220 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac004100 tx=0x7ff9ac054000 comp rx=0 tx=0).stop 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3869051853 shutdown_connections 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3869051853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 0x559659218500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3869051853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e9a70 0x5596591eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3869051853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e90c0 0x5596591ed220 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3869051853 >> 10.20.193.28:0/3869051853 conn(0x5596591e1b60 msgr2=0x5596591ee510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3869051853 shutdown_connections 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.429+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3869051853 wait complete. 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c5df3e00 1 -- start start 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c5df3e00 1 Processor -- start 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e90c0 0x559659209ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x559659208640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c5df3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 0x559659208b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff96800e3f0 con 0x5596591e9a70 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff96800f860 con 0x5596591edb60 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c5df3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff96800eac0 con 0x5596591e90c0 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c0e62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x559659208640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c0e62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x559659208640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45266/0 (socket says 10.20.193.28:45266) 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.430+0000 7ff9c0e62640 1 -- 10.20.193.28:0/3620911018 learned_addr learned my addr 10.20.193.28:0/3620911018 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c0e62640 1 -- 10.20.193.28:0/3620911018 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e90c0 msgr2=0x559659209ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c0e62640 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e90c0 0x559659209ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c0e62640 1 -- 10.20.193.28:0/3620911018 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 msgr2=0x559659208b80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c0e62640 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 0x559659208b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c0e62640 1 -- 10.20.193.28:0/3620911018 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559658e1a900 con 0x5596591e9a70 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c0e62640 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x559659208640 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00a81e0 tx=0x7ff9b00a3fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9bcd84c33482544 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff976ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff976ffd640 1 -- 10.20.193.28:0/3620911018 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00b14b0 con 0x5596591e9a70 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff976ffd640 1 -- 10.20.193.28:0/3620911018 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff9b0002d40 con 0x5596591e9a70 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff976ffd640 1 -- 10.20.193.28:0/3620911018 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b00a3c60 con 0x5596591e9a70 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3620911018 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596590f64d0 con 0x5596591e9a70 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff976ffd640 1 -- 10.20.193.28:0/3620911018 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7ff9b00a6cd0 con 0x5596591e9a70 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff976ffd640 10 client.19680 inactive, discarding osd_map(97..97 src has 1..97) 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c5df3e00 10 client.19680 _ll_register_callbacks cb 0x7ff9ac009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:02.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3620911018 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9ac033040 con 0x5596591e9a70 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff976ffd640 1 -- 10.20.193.28:0/3620911018 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff9b00e0350 con 0x5596591e9a70 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c5df3e00 10 client.19680 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.431+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3620911018 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x5596591fc150 con 0x5596591e9a70 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.432+0000 7ff976ffd640 1 -- 10.20.193.28:0/3620911018 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7ff9ac002c30 con 0x5596591e9a70 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.432+0000 7ff9c5df3e00 10 client.19680 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.432+0000 7ff9c5df3e00 10 client.19680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.432+0000 7ff9c5df3e00 20 client.19680 populate_metadata read hostname 'trial028' 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.432+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55965927ea20 0x559659280ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.432+0000 7ff9c5df3e00 4 client.19680 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:30:02.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.432+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3620911018 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559658eaba20 con 0x55965927ea20 2026-02-20T03:30:02.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.445+0000 7ff9c1663640 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55965927ea20 0x559659280ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.485+0000 7ff9c1663640 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55965927ea20 0x559659280ee0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f98b775e00696d47 server_cookie=f82ca5469580b7d in_seq=0 out_seq=0 2026-02-20T03:30:02.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.485+0000 7ff976ffd640 10 client.19680 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:02.490 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod 0666 /tmp/tmp.TCbifSLF5F 2026-02-20T03:30:02.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.498+0000 7ff976ffd640 1 -- 10.20.193.28:0/3620911018 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559658eaba20 con 0x55965927ea20 2026-02-20T03:30:02.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.498+0000 7ff976ffd640 10 client.19680 handle_command_reply: tid=0 2026-02-20T03:30:02.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.498+0000 7ff9c5df3e00 1 client.19680 shutdown 2026-02-20T03:30:02.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3620911018 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 msgr2=0x559659208640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:02.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x559659208640 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00a81e0 tx=0x7ff9b00a3fe0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3620911018 shutdown_connections 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55965927ea20 0x559659280ee0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5596591edb60 0x559659208b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5596591e9a70 0x559659208640 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 --2- 10.20.193.28:0/3620911018 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5596591e90c0 0x559659209ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3620911018 >> 10.20.193.28:0/3620911018 conn(0x5596591e1b60 msgr2=0x5596591eed30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff976ffd640 0 client.19680 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3620911018 shutdown_connections 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 1 -- 10.20.193.28:0/3620911018 wait complete. 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c5df3e00 20 client.19680 trim_cache size 0 max 16384 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "54be83ee-3527-4db6-9056-c7b70ac63257", 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:30:02.502 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:30:02.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c2665640 1 -- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9980b0e20 msgr2=0x7ff9980b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:02.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9980b0e20 0x7ff9980b32e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800ab00 tx=0x7ff9b8009250 comp rx=0 tx=0).stop 2026-02-20T03:30:02.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c2665640 1 -- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc109ba0 msgr2=0x7ff9bc1a1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:02.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.499+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc109ba0 0x7ff9bc1a1c10 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000b570 tx=0x7ff9b000ba40 comp rx=0 tx=0).stop 2026-02-20T03:30:02.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.500+0000 7ff9c2665640 1 -- 10.20.193.28:0/1639861577 shutdown_connections 2026-02-20T03:30:02.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.500+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9980b0e20 0x7ff9980b32e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.500+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff9bc10eef0 0x7ff9bc1a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.500+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff9bc109ba0 0x7ff9bc1a1c10 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.500+0000 7ff9c2665640 1 --2- 10.20.193.28:0/1639861577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff9bc109220 0x7ff9bc1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:02.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.500+0000 7ff9c2665640 1 -- 10.20.193.28:0/1639861577 >> 10.20.193.28:0/1639861577 conn(0x7ff9bc078600 msgr2=0x7ff9bc07a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:02.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.500+0000 7ff9c2665640 1 -- 10.20.193.28:0/1639861577 shutdown_connections 2026-02-20T03:30:02.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:02.500+0000 7ff9c2665640 1 -- 10.20.193.28:0/1639861577 wait complete. 2026-02-20T03:30:02.611 DEBUG:teuthology.orchestra.remote:trial126:/tmp/tmp.TCbifSLF5F is 38KB 2026-02-20T03:30:02.620 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:30:02.628 DEBUG:teuthology.orchestra.run.trial126:> rm -fr /tmp/tmp.TCbifSLF5F 2026-02-20T03:30:02.644 DEBUG:tasks.quiescer.fs.[cephfs]:read 38466B of ops from '/var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.b.json' on mds.0 (b) 2026-02-20T03:30:02.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 189aa5bc-1: 'internal op quiesce_path:mds.0:742 fp=#0x1' 2026-02-20T03:30:02.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 189aa5bc-1: 'internal op quiesce_inode:mds.0:743 fp=#0x1' 2026-02-20T03:30:02.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 189aa5bc-1: 'internal op quiesce_inode:mds.0:767 fp=#0x100000005e4' 2026-02-20T03:30:02.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 189aa5bc-1: 'internal op quiesce_inode:mds.0:744 fp=#0x10000000000' 2026-02-20T03:30:02.647 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 189aa5bc-1: 'internal op quiesce_inode:mds.0:745 fp=#0x10000000001' 2026-02-20T03:30:02.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 189aa5bc-1: 'internal op quiesce_inode:mds.0:746 fp=#0x100000001fa' 2026-02-20T03:30:02.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 189aa5bc-1: 'internal op quiesce_inode:mds.0:748 fp=#0x100000001fb' 2026-02-20T03:30:02.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 189aa5bc-1: 'internal op quiesce_inode:mds.0:749 fp=#0x100000005e2' 2026-02-20T03:30:02.648 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for 189aa5bc-1: 'internal op quiesce_inode:mds.0:750 fp=#0x100000005e3' 2026-02-20T03:30:02.649 INFO:tasks.quiescer.fs.[cephfs]:Pulled 15 ops from rank 0 (b) into home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/ops-189aa5bc-1-mds.b.json 2026-02-20T03:30:02.649 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -- /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-189aa5bc-1-mds.b.json 2026-02-20T03:30:02.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 21.35 MB/sec warmup 93 sec latency 58724.161 ms 2026-02-20T03:30:02.709 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:30:02.845 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:30:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:30:02.553+0000 7ff740af4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000015 [...2,head] /volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL/ auth{1=1,2=1} v178266 ap=2 f(v4996 m2026-02-20T03:29:02.374825+0000 11=11+0) n(v68 rc2026-02-20T03:29:02.374825+0000 b2861056 12=11+1) (inest sync->mix g=1,2) caps={25141=pAsLsXsFs/pAsLsXsFsx@12202} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557551b7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000015:[<0x100000005e6/COREL v2262>,<0x100000005e5/~dmtmp v34>,<0x100000005e4/client0 v18>,<0x100000005e3/clients v8>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v28>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v37>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000015:[<0x100000005e6/COREL v178266>,<0x100000005e5/~dmtmp v60106>,<0x100000005e4/client0 v2111>,<0x100000005e3/clients v1268>,<0x100000005e2/tmp v1209>,<0x100000001fb/client.0 v1215>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v1228>,<0x10000000001/sv_1 v1229>,<0x10000000000/qa v1206>,<0x1/volumes v1139>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2026-02-20T03:29:01.622840+0000 15=15+0)","ondisk_value.rstat":"n(v0 rc2026-02-20T03:29:02.374825+0000 b2861056 12=11+1)","memory_value.dirstat":"f(v4996 m2026-02-20T03:29:02.374825+0000 11=11+0)","memory_value.rstat":"n(v68 rc2026-02-20T03:29:02.374825+0000 b2861056 12=11+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2026-02-20T03:30:02.845 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:30:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:30:02.555+0000 7ff740af4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000029 [...2,head] /volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX/ auth{1=1,2=1} v178263 ap=2 f(v7683 m2026-02-20T03:29:02.423824+0000 20=20+0) n(v67 rc2026-02-20T03:29:02.423824+0000 b5201920 21=20+1) (inest sync->mix g=1,2) caps={25141=pAsLsXsFs/pAsLsXsFsx@21743} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557551c2bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000029:[<0x100000005e6/PARADOX v2552>,<0x100000005e5/~dmtmp v34>,<0x100000005e4/client0 v18>,<0x100000005e3/clients v8>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v28>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v37>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000029:[<0x100000005e6/PARADOX v178263>,<0x100000005e5/~dmtmp v60106>,<0x100000005e4/client0 v2111>,<0x100000005e3/clients v1268>,<0x100000005e2/tmp v1209>,<0x100000001fb/client.0 v1215>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v1228>,<0x10000000001/sv_1 v1229>,<0x10000000000/qa v1206>,<0x1/volumes v1139>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2026-02-20T03:29:00.768858+0000 24=24+0)","ondisk_value.rstat":"n(v0 rc2026-02-20T03:29:02.423824+0000 b5201920 21=20+1)","memory_value.dirstat":"f(v7683 m2026-02-20T03:29:02.423824+0000 20=20+0)","memory_value.rstat":"n(v67 rc2026-02-20T03:29:02.423824+0000 b5201920 21=20+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2026-02-20T03:30:02.946 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:03.012 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:03.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.252+0000 7fb05578d640 1 -- 10.20.193.28:0/57544684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0501030a0 msgr2=0x7fb05010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.252+0000 7fb05578d640 1 --2- 10.20.193.28:0/57544684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0501030a0 0x7fb05010f5d0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb04400b0d0 tx=0x7fb04402f490 comp rx=0 tx=0).stop 2026-02-20T03:30:03.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.252+0000 7fb05578d640 1 -- 10.20.193.28:0/57544684 shutdown_connections 2026-02-20T03:30:03.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.252+0000 7fb05578d640 1 --2- 10.20.193.28:0/57544684 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb0501030a0 0x7fb05010f5d0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.252+0000 7fb05578d640 1 --2- 10.20.193.28:0/57544684 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb050102700 0x7fb050102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.252+0000 7fb05578d640 1 --2- 10.20.193.28:0/57544684 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb050108700 0x7fb050108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.252+0000 7fb05578d640 1 -- 10.20.193.28:0/57544684 >> 10.20.193.28:0/57544684 conn(0x7fb0500fe3e0 msgr2=0x7fb050100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:03.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.252+0000 7fb05578d640 1 -- 10.20.193.28:0/57544684 shutdown_connections 2026-02-20T03:30:03.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.252+0000 7fb05578d640 1 -- 10.20.193.28:0/57544684 wait complete. 2026-02-20T03:30:03.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.253+0000 7fb05578d640 1 Processor -- start 2026-02-20T03:30:03.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.253+0000 7fb05578d640 1 -- start start 2026-02-20T03:30:03.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb05578d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 0x7fb05019d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb05578d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0501030a0 0x7fb05019d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb05578d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb050108700 0x7fb0501a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb05578d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb050112a50 con 0x7fb050102700 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb05578d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501128d0 con 0x7fb050108700 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb05578d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb050112bd0 con 0x7fb0501030a0 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb04ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 0x7fb05019d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb04ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 0x7fb05019d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45284/0 (socket says 10.20.193.28:45284) 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb04ffff640 1 -- 10.20.193.28:0/3685951166 learned_addr learned my addr 10.20.193.28:0/3685951166 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb04ffff640 1 -- 10.20.193.28:0/3685951166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0501030a0 msgr2=0x7fb05019d780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb04ffff640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0501030a0 0x7fb05019d780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb04ffff640 1 -- 10.20.193.28:0/3685951166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb050108700 msgr2=0x7fb0501a1b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:03.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb04ffff640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb050108700 0x7fb0501a1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.254+0000 7fb04ffff640 1 -- 10.20.193.28:0/3685951166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0501a2290 con 0x7fb050102700 2026-02-20T03:30:03.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.255+0000 7fb04ffff640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 0x7fb05019d240 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00b570 tx=0x7fb03c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.255+0000 7fb04d7fa640 1 -- 10.20.193.28:0/3685951166 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c004480 con 0x7fb050102700 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.255+0000 7fb04d7fa640 1 -- 10.20.193.28:0/3685951166 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb03c015070 con 0x7fb050102700 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.255+0000 7fb04d7fa640 1 -- 10.20.193.28:0/3685951166 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c010b20 con 0x7fb050102700 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.255+0000 7fb05578d640 1 -- 10.20.193.28:0/3685951166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0501a2580 con 0x7fb050102700 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.255+0000 7fb05578d640 1 -- 10.20.193.28:0/3685951166 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0501a9dc0 con 0x7fb050102700 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.258+0000 7fb04d7fa640 1 -- 10.20.193.28:0/3685951166 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb03c002780 con 0x7fb050102700 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.258+0000 7fb058f1be00 1 Processor -- start 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.258+0000 7fb058f1be00 1 -- start start 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d4e0e0 0x563737d4e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4ea90 0x563737d525c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d52cd0 0x563737d5a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb058f1be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563737cc5e50 con 0x563737d52cd0 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb058f1be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563737c989c0 con 0x563737d4e0e0 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb058f1be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563737c46240 con 0x563737d4ea90 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d52cd0 0x563737d5a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d52cd0 0x563737d5a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45286/0 (socket says 10.20.193.28:45286) 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04f7fe640 1 -- 10.20.193.28:0/2868228063 learned_addr learned my addr 10.20.193.28:0/2868228063 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04f7fe640 1 -- 10.20.193.28:0/2868228063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4ea90 msgr2=0x563737d525c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/2868228063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4ea90 0x563737d525c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04f7fe640 1 -- 10.20.193.28:0/2868228063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d4e0e0 msgr2=0x563737d4e4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/2868228063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d4e0e0 0x563737d4e4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04f7fe640 1 -- 10.20.193.28:0/2868228063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563737c59420 con 0x563737d52cd0 2026-02-20T03:30:03.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04d7fa640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0e20 0x7fb0240b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.259+0000 7fb04d7fa640 1 -- 10.20.193.28:0/3685951166 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7fb03c0e0320 con 0x7fb050102700 2026-02-20T03:30:03.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.260+0000 7fb054f8c640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0e20 0x7fb0240b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.260+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/2868228063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d52cd0 0x563737d5a870 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fb040009840 tx=0x7fb040009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7094069a4a5a595 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:03.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.260+0000 7fb020ce3640 1 -- 10.20.193.28:0/2868228063 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040016070 con 0x563737d52cd0 2026-02-20T03:30:03.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.260+0000 7fb020ce3640 1 -- 10.20.193.28:0/2868228063 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb040004480 con 0x563737d52cd0 2026-02-20T03:30:03.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.260+0000 7fb058f1be00 1 -- 10.20.193.28:0/2868228063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d52cd0 msgr2=0x563737d5a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.260+0000 7fb020ce3640 1 -- 10.20.193.28:0/2868228063 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040016070 con 0x563737d52cd0 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.260+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2868228063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d52cd0 0x563737d5a870 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fb040009840 tx=0x7fb040009d10 comp rx=0 tx=0).stop 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.260+0000 7fb054f8c640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0e20 0x7fb0240b32e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb0440062a0 tx=0x7fb044006230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.261+0000 7fb058f1be00 1 -- 10.20.193.28:0/2868228063 shutdown_connections 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.261+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2868228063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d52cd0 0x563737d5a870 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.261+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2868228063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4ea90 0x563737d525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.261+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2868228063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d4e0e0 0x563737d4e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.261+0000 7fb058f1be00 1 -- 10.20.193.28:0/2868228063 >> 10.20.193.28:0/2868228063 conn(0x563737d08290 msgr2=0x563737d4c740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.261+0000 7fb058f1be00 1 -- 10.20.193.28:0/2868228063 shutdown_connections 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.261+0000 7fb058f1be00 1 -- 10.20.193.28:0/2868228063 wait complete. 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.262+0000 7fb058f1be00 1 -- start start 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.262+0000 7fb058f1be00 1 Processor -- start 2026-02-20T03:30:03.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.262+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4e0e0 0x563737d68370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d52cd0 0x563737d66b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb058f1be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563737c948f0 con 0x563737d4ea90 2026-02-20T03:30:03.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb058f1be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563737a86f50 con 0x563737d52cd0 2026-02-20T03:30:03.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb058f1be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563737d67160 con 0x563737d4e0e0 2026-02-20T03:30:03.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d688b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45288/0 (socket says 10.20.193.28:45288) 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb04f7fe640 1 -- 10.20.193.28:0/2969355302 learned_addr learned my addr 10.20.193.28:0/2969355302 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb04f7fe640 1 -- 10.20.193.28:0/2969355302 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4e0e0 msgr2=0x563737d68370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4e0e0 0x563737d68370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb04f7fe640 1 -- 10.20.193.28:0/2969355302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d52cd0 msgr2=0x563737d66b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d52cd0 0x563737d66b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb04f7fe640 1 -- 10.20.193.28:0/2969355302 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563737d604d0 con 0x563737d4ea90 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d688b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fb04000a010 tx=0x7fb040002e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c119873fe199ed6a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.263+0000 7fb011ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb011ffb640 1 -- 10.20.193.28:0/2969355302 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04001e070 con 0x563737d4ea90 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb011ffb640 1 -- 10.20.193.28:0/2969355302 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb04001a400 con 0x563737d4ea90 2026-02-20T03:30:03.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb011ffb640 1 -- 10.20.193.28:0/2969355302 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040016040 con 0x563737d4ea90 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 1 -- 10.20.193.28:0/2969355302 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563737a69b40 con 0x563737d4ea90 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb011ffb640 1 -- 10.20.193.28:0/2969355302 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7fb040011700 con 0x563737d4ea90 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 10 client.19692 _ll_register_callbacks cb 0x563737cd1f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 1 -- 10.20.193.28:0/2969355302 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563737ca61a0 con 0x563737d4ea90 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb011ffb640 1 -- 10.20.193.28:0/2969355302 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb040028060 con 0x563737d4ea90 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 10 client.19692 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 1 -- 10.20.193.28:0/2969355302 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x563737c53230 con 0x563737d4ea90 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb011ffb640 1 -- 10.20.193.28:0/2969355302 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7fb04001a5b0 con 0x563737d4ea90 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 10 client.19692 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 10 client.19692 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 20 client.19692 populate_metadata read hostname 'trial028' 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563737d76a70 0x563737d78e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 4 client.19692 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:03.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.264+0000 7fb058f1be00 1 -- 10.20.193.28:0/2969355302 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563737ca05b0 con 0x563737d76a70 2026-02-20T03:30:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.278+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/4210002500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78117da0 msgr2=0x7f1a7811a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.278+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/4210002500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78117da0 0x7f1a7811a190 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400b0a0 tx=0x7f1a7402f450 comp rx=0 tx=0).stop 2026-02-20T03:30:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.278+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/4210002500 shutdown_connections 2026-02-20T03:30:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.278+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/4210002500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a78117da0 0x7f1a7811a190 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.278+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/4210002500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a78074660 0x7f1a78074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.278+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/4210002500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a7810d070 0x7f1a78074120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.278+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/4210002500 >> 10.20.193.28:0/4210002500 conn(0x7f1a7806efb0 msgr2=0x7f1a7806f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:03.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.279+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/4210002500 shutdown_connections 2026-02-20T03:30:03.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.279+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/4210002500 wait complete. 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.280+0000 7f1a7f1b6640 1 Processor -- start 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.280+0000 7f1a7f1b6640 1 -- start start 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7f1b6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a78074660 0x7f1a781ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7f1b6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a7810d070 0x7f1a781abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7f1b6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a78117da0 0x7f1a781a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7f1b6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7811d780 con 0x7f1a7810d070 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7f1b6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7811d600 con 0x7f1a78074660 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7f1b6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7811d900 con 0x7f1a78117da0 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7d9b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a7810d070 0x7f1a781abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7d9b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a7810d070 0x7f1a781abc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45310/0 (socket says 10.20.193.28:45310) 2026-02-20T03:30:03.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7d9b3640 1 -- 10.20.193.28:0/3356272862 learned_addr learned my addr 10.20.193.28:0/3356272862 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:03.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7d9b3640 1 -- 10.20.193.28:0/3356272862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a78117da0 msgr2=0x7f1a781a58f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:03.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7d9b3640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a78117da0 0x7f1a781a58f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7d9b3640 1 -- 10.20.193.28:0/3356272862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a78074660 msgr2=0x7f1a781ab730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:03.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7d9b3640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a78074660 0x7f1a781ab730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7d9b3640 1 -- 10.20.193.28:0/3356272862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a781a60c0 con 0x7f1a7810d070 2026-02-20T03:30:03.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.281+0000 7f1a7d9b3640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a7810d070 0x7f1a781abc70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00b570 tx=0x7f1a6c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.282+0000 7f1a5f7fe640 1 -- 10.20.193.28:0/3356272862 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c013020 con 0x7f1a7810d070 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.282+0000 7f1a5f7fe640 1 -- 10.20.193.28:0/3356272862 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1a6c004480 con 0x7f1a7810d070 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.282+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a781a63b0 con 0x7f1a7810d070 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.282+0000 7f1a5f7fe640 1 -- 10.20.193.28:0/3356272862 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00fb50 con 0x7f1a7810d070 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.282+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a781b2680 con 0x7f1a7810d070 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.283+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a78074aa0 con 0x7f1a7810d070 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.284+0000 7f1a5f7fe640 1 -- 10.20.193.28:0/3356272862 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1a6c002780 con 0x7f1a7810d070 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.286+0000 7f1a5f7fe640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a540b0e20 0x7f1a540b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.286+0000 7f1a5f7fe640 1 -- 10.20.193.28:0/3356272862 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f1a6c0e0570 con 0x7f1a7810d070 2026-02-20T03:30:03.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.286+0000 7f1a7e1b4640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a540b0e20 0x7f1a540b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.287+0000 7fb04ffff640 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563737d76a70 0x563737d78e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.287+0000 7f1a7e1b4640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a540b0e20 0x7f1a540b32e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1a781a6a30 tx=0x7f1a68006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:03.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.287+0000 7f1a5f7fe640 1 -- 10.20.193.28:0/3356272862 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1a6c01d020 con 0x7f1a7810d070 2026-02-20T03:30:03.303 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:03 trial028 ceph-mon[38552]: pgmap v645: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2026-02-20T03:30:03.303 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:03 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:30:03.303 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:03 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:30:03.303 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:03 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:03.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.327+0000 7fb04ffff640 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563737d76a70 0x563737d78e60 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f49d0bd09274e8d1 server_cookie=d449f7b53726e536 in_seq=0 out_seq=0 2026-02-20T03:30:03.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.327+0000 7fb011ffb640 10 client.19692 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:03.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb011ffb640 1 -- 10.20.193.28:0/2969355302 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563737ca05b0 con 0x563737d76a70 2026-02-20T03:30:03.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb011ffb640 10 client.19692 handle_command_reply: tid=0 2026-02-20T03:30:03.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 client.19692 shutdown 2026-02-20T03:30:03.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 -- 10.20.193.28:0/2969355302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 msgr2=0x563737d688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d688b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fb04000a010 tx=0x7fb040002e20 comp rx=0 tx=0).stop 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 -- 10.20.193.28:0/2969355302 shutdown_connections 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563737d76a70 0x563737d78e60 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d52cd0 0x563737d66b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d688b0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 --2- 10.20.193.28:0/2969355302 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4e0e0 0x563737d68370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 -- 10.20.193.28:0/2969355302 >> 10.20.193.28:0/2969355302 conn(0x563737d08290 msgr2=0x563737d53f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb011ffb640 0 client.19692 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 -- 10.20.193.28:0/2969355302 shutdown_connections 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.354+0000 7fb058f1be00 1 -- 10.20.193.28:0/2969355302 wait complete. 2026-02-20T03:30:03.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.355+0000 7fb058f1be00 20 client.19692 trim_cache size 0 max 16384 2026-02-20T03:30:03.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.363+0000 7fb058f1be00 1 Processor -- start 2026-02-20T03:30:03.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.363+0000 7fb058f1be00 1 -- start start 2026-02-20T03:30:03.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d4e0e0 0x563737d3dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d52460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d52cd0 0x563737d4b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb058f1be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faff4012750 con 0x563737d4ea90 2026-02-20T03:30:03.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb058f1be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faff400ffc0 con 0x563737d4e0e0 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb058f1be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faff400de10 con 0x563737d52cd0 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d52460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb04f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d52460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45326/0 (socket says 10.20.193.28:45326) 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb04f7fe640 1 -- 10.20.193.28:0/741226238 learned_addr learned my addr 10.20.193.28:0/741226238 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb04f7fe640 1 -- 10.20.193.28:0/741226238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d52cd0 msgr2=0x563737d4b740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/741226238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d52cd0 0x563737d4b740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb04f7fe640 1 -- 10.20.193.28:0/741226238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d4e0e0 msgr2=0x563737d3dd50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/741226238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d4e0e0 0x563737d3dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb04f7fe640 1 -- 10.20.193.28:0/741226238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563737d60300 con 0x563737d4ea90 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.364+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/741226238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d52460 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fb04001a940 tx=0x7fb040026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d04ef5989e8add9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb013fff640 1 -- 10.20.193.28:0/741226238 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04001e050 con 0x563737d4ea90 2026-02-20T03:30:03.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb013fff640 1 -- 10.20.193.28:0/741226238 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x563737ca61a0 con 0x563737d4ea90 2026-02-20T03:30:03.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb013fff640 1 -- 10.20.193.28:0/741226238 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040016040 con 0x563737d4ea90 2026-02-20T03:30:03.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb058f1be00 1 -- 10.20.193.28:0/741226238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 msgr2=0x563737d52460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb058f1be00 1 --2- 10.20.193.28:0/741226238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d52460 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fb04001a940 tx=0x7fb040026000 comp rx=0 tx=0).stop 2026-02-20T03:30:03.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb058f1be00 1 -- 10.20.193.28:0/741226238 shutdown_connections 2026-02-20T03:30:03.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb058f1be00 1 --2- 10.20.193.28:0/741226238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d52cd0 0x563737d4b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb058f1be00 1 --2- 10.20.193.28:0/741226238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4ea90 0x563737d52460 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb058f1be00 1 --2- 10.20.193.28:0/741226238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d4e0e0 0x563737d3dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb058f1be00 1 -- 10.20.193.28:0/741226238 >> 10.20.193.28:0/741226238 conn(0x563737d08290 msgr2=0x563737d653c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:03.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb058f1be00 1 -- 10.20.193.28:0/741226238 shutdown_connections 2026-02-20T03:30:03.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.365+0000 7fb058f1be00 1 -- 10.20.193.28:0/741226238 wait complete. 2026-02-20T03:30:03.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.366+0000 7fb058f1be00 1 -- start start 2026-02-20T03:30:03.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.366+0000 7fb058f1be00 1 Processor -- start 2026-02-20T03:30:03.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.366+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4e0e0 0x563737d6eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.366+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4ea90 0x563737d6b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.366+0000 7fb058f1be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d52cd0 0x563737d6b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.366+0000 7fb058f1be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faff400e480 con 0x563737d4e0e0 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.366+0000 7fb058f1be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faff400f8f0 con 0x563737d52cd0 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.366+0000 7fb058f1be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faff400eb50 con 0x563737d4ea90 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.366+0000 7fb04ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4e0e0 0x563737d6eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb04ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4e0e0 0x563737d6eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45338/0 (socket says 10.20.193.28:45338) 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb04ffff640 1 -- 10.20.193.28:0/1203735875 learned_addr learned my addr 10.20.193.28:0/1203735875 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb04ffff640 1 -- 10.20.193.28:0/1203735875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4ea90 msgr2=0x563737d6b240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb04ffff640 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4ea90 0x563737d6b240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb04ffff640 1 -- 10.20.193.28:0/1203735875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d52cd0 msgr2=0x563737d6b780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb04ffff640 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d52cd0 0x563737d6b780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb04ffff640 1 -- 10.20.193.28:0/1203735875 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563737977870 con 0x563737d4e0e0 2026-02-20T03:30:03.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb04ffff640 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4e0e0 0x563737d6eac0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00bf50 tx=0x7fb03c0dd8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b58ef39aa219b89 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:03.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb011ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:03.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb011ffb640 1 -- 10.20.193.28:0/1203735875 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0ac410 con 0x563737d4e0e0 2026-02-20T03:30:03.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb011ffb640 1 -- 10.20.193.28:0/1203735875 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb03c0b12c0 con 0x563737d4e0e0 2026-02-20T03:30:03.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.367+0000 7fb011ffb640 1 -- 10.20.193.28:0/1203735875 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0caca0 con 0x563737d4e0e0 2026-02-20T03:30:03.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 1 -- 10.20.193.28:0/1203735875 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563737c38440 con 0x563737d4e0e0 2026-02-20T03:30:03.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 10 client.19704 _ll_register_callbacks cb 0x7fb040014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:03.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 1 -- 10.20.193.28:0/1203735875 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563737c4ab00 con 0x563737d4e0e0 2026-02-20T03:30:03.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb011ffb640 1 -- 10.20.193.28:0/1203735875 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7fb03c0a40a0 con 0x563737d4e0e0 2026-02-20T03:30:03.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb011ffb640 1 -- 10.20.193.28:0/1203735875 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb03c0ac080 con 0x563737d4e0e0 2026-02-20T03:30:03.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 10 client.19704 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:03.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 1 -- 10.20.193.28:0/1203735875 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x563737d60ff0 con 0x563737d4e0e0 2026-02-20T03:30:03.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb011ffb640 1 -- 10.20.193.28:0/1203735875 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7fb03c094190 con 0x563737d4e0e0 2026-02-20T03:30:03.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 10 client.19704 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:03.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 10 client.19704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:03.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 20 client.19704 populate_metadata read hostname 'trial028' 2026-02-20T03:30:03.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563737de2b80 0x563737de5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:03.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 4 client.19704 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:30:03.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.368+0000 7fb058f1be00 1 -- 10.20.193.28:0/1203735875 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563737ca61a0 con 0x563737de2b80 2026-02-20T03:30:03.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.394+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563737de2b80 0x563737de5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:03.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.397+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a781b2aa0 con 0x7f1a7810d070 2026-02-20T03:30:03.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.397+0000 7f1a5f7fe640 1 -- 10.20.193.28:0/3356272862 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11925 (secure 0 0 0) 0x7f1a6c0a8950 con 0x7f1a7810d070 2026-02-20T03:30:03.401 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:30:03.401 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":37,"btime":"2026-02-20T03:29:33:388547+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:29:33.388504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28057":{"gid":28057,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/2019777772","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":2019777772},{"type":"v1","addr":"10.20.193.177:6837","nonce":2019777772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:30:03.410 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 37 2026-02-20T03:30:03.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a540b0e20 msgr2=0x7f1a540b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a540b0e20 0x7f1a540b32e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1a781a6a30 tx=0x7f1a68006cd0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a7810d070 msgr2=0x7f1a781abc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a7810d070 0x7f1a781abc70 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00b570 tx=0x7f1a6c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 shutdown_connections 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1a540b0e20 0x7f1a540b32e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a78117da0 0x7f1a781a58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a7810d070 0x7f1a781abc70 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 --2- 10.20.193.28:0/3356272862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a78074660 0x7f1a781ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 >> 10.20.193.28:0/3356272862 conn(0x7f1a7806efb0 msgr2=0x7f1a78118180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 shutdown_connections 2026-02-20T03:30:03.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.399+0000 7f1a7f1b6640 1 -- 10.20.193.28:0/3356272862 wait complete. 2026-02-20T03:30:03.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.448+0000 7fb04f7fe640 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563737de2b80 0x563737de5040 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25b57f12c67ddcd3 server_cookie=53725e78a5685486 in_seq=0 out_seq=0 2026-02-20T03:30:03.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.448+0000 7fb011ffb640 10 client.19704 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:03.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb011ffb640 1 -- 10.20.193.28:0/1203735875 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563737ca61a0 con 0x563737de2b80 2026-02-20T03:30:03.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb011ffb640 10 client.19704 handle_command_reply: tid=0 2026-02-20T03:30:03.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb058f1be00 1 client.19704 shutdown 2026-02-20T03:30:03.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb058f1be00 1 -- 10.20.193.28:0/1203735875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4e0e0 msgr2=0x563737d6eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb058f1be00 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4e0e0 0x563737d6eac0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00bf50 tx=0x7fb03c0dd8c0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb058f1be00 1 -- 10.20.193.28:0/1203735875 shutdown_connections 2026-02-20T03:30:03.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb058f1be00 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563737de2b80 0x563737de5040 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb058f1be00 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563737d52cd0 0x563737d6b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb058f1be00 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563737d4ea90 0x563737d6b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb058f1be00 1 --2- 10.20.193.28:0/1203735875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563737d4e0e0 0x563737d6eac0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.461+0000 7fb058f1be00 1 -- 10.20.193.28:0/1203735875 >> 10.20.193.28:0/1203735875 conn(0x563737d08290 msgr2=0x563737d65820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:03.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.462+0000 7fb011ffb640 0 client.19704 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:03.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.462+0000 7fb058f1be00 1 -- 10.20.193.28:0/1203735875 shutdown_connections 2026-02-20T03:30:03.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.462+0000 7fb058f1be00 1 -- 10.20.193.28:0/1203735875 wait complete. 2026-02-20T03:30:03.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.462+0000 7fb058f1be00 20 client.19704 trim_cache size 0 max 16384 2026-02-20T03:30:03.477 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:30:03.477 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:30:03.477 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:30:03.477 INFO:teuthology.orchestra.run.trial028.stdout: "54be83ee-3527-4db6-9056-c7b70ac63257": { 2026-02-20T03:30:03.477 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:30:03.477 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "54be83ee-3527-4db6-9056-c7b70ac63257", 2026-02-20T03:30:03.478 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:30:03.478 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:03.478 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:03.478 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:30:03.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.462+0000 7fb05578d640 1 -- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0e20 msgr2=0x7fb0240b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.462+0000 7fb05578d640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0e20 0x7fb0240b32e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fb0440062a0 tx=0x7fb044006230 comp rx=0 tx=0).stop 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.462+0000 7fb05578d640 1 -- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 msgr2=0x7fb05019d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.462+0000 7fb05578d640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 0x7fb05019d240 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00b570 tx=0x7fb03c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.463+0000 7fb05578d640 1 -- 10.20.193.28:0/3685951166 shutdown_connections 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.463+0000 7fb05578d640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb0240b0e20 0x7fb0240b32e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.463+0000 7fb05578d640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb050108700 0x7fb0501a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.463+0000 7fb05578d640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb0501030a0 0x7fb05019d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.463+0000 7fb05578d640 1 --2- 10.20.193.28:0/3685951166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb050102700 0x7fb05019d240 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.463+0000 7fb05578d640 1 -- 10.20.193.28:0/3685951166 >> 10.20.193.28:0/3685951166 conn(0x7fb0500fe3e0 msgr2=0x7fb05010da90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.463+0000 7fb05578d640 1 -- 10.20.193.28:0/3685951166 shutdown_connections 2026-02-20T03:30:03.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:03.463+0000 7fb05578d640 1 -- 10.20.193.28:0/3685951166 wait complete. 2026-02-20T03:30:03.481 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 189aa5bc --await-for 45.0' 2026-02-20T03:30:03.481 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 189aa5bc --await-for 45.0 2026-02-20T03:30:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:03 trial126 ceph-mon[38476]: pgmap v645: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2026-02-20T03:30:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:03 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:30:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:03 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:30:03.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:03 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:03.660 INFO:tasks.cephfs.filesystem:scrub status for tag:54be83ee-3527-4db6-9056-c7b70ac63257 - {'path': '/', 'tag': '54be83ee-3527-4db6-9056-c7b70ac63257', 'options': 'recursive,force'} 2026-02-20T03:30:03.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 21.12 MB/sec warmup 94 sec latency 59724.197 ms 2026-02-20T03:30:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:03 trial177 ceph-mon[43181]: pgmap v645: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2026-02-20T03:30:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:03 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:30:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:03 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:30:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:03 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:03.797 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:04.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.095+0000 7fb80683f640 1 -- 10.20.193.28:0/2958577814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 msgr2=0x7fb800109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:04.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.095+0000 7fb80683f640 1 --2- 10.20.193.28:0/2958577814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 0x7fb800109660 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009a30 tx=0x7fb7f402f260 comp rx=0 tx=0).stop 2026-02-20T03:30:04.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.095+0000 7fb80683f640 1 -- 10.20.193.28:0/2958577814 shutdown_connections 2026-02-20T03:30:04.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.095+0000 7fb80683f640 1 --2- 10.20.193.28:0/2958577814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb800109ba0 0x7fb800115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.095+0000 7fb80683f640 1 --2- 10.20.193.28:0/2958577814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 0x7fb800109660 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.095+0000 7fb80683f640 1 --2- 10.20.193.28:0/2958577814 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb80010eef0 0x7fb80010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.095+0000 7fb80683f640 1 -- 10.20.193.28:0/2958577814 >> 10.20.193.28:0/2958577814 conn(0x7fb800078600 msgr2=0x7fb80007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:04.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.095+0000 7fb80683f640 1 -- 10.20.193.28:0/2958577814 shutdown_connections 2026-02-20T03:30:04.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.095+0000 7fb80683f640 1 -- 10.20.193.28:0/2958577814 wait complete. 2026-02-20T03:30:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80683f640 1 Processor -- start 2026-02-20T03:30:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80683f640 1 -- start start 2026-02-20T03:30:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80683f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 0x7fb8001a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80683f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb800109ba0 0x7fb8001a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80683f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb80010eef0 0x7fb8001a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80683f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb8001191b0 con 0x7fb800109220 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80683f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb800119030 con 0x7fb80010eef0 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80683f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb800119330 con 0x7fb800109ba0 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80583d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 0x7fb8001a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80583d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 0x7fb8001a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45352/0 (socket says 10.20.193.28:45352) 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.096+0000 7fb80583d640 1 -- 10.20.193.28:0/733804848 learned_addr learned my addr 10.20.193.28:0/733804848 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb80583d640 1 -- 10.20.193.28:0/733804848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb800109ba0 msgr2=0x7fb8001a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb80583d640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb800109ba0 0x7fb8001a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb80583d640 1 -- 10.20.193.28:0/733804848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb80010eef0 msgr2=0x7fb8001a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:04.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb80583d640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb80010eef0 0x7fb8001a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb80583d640 1 -- 10.20.193.28:0/733804848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8001a66c0 con 0x7fb800109220 2026-02-20T03:30:04.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb80583d640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 0x7fb8001a1670 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000b570 tx=0x7fb7f000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:04.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb7eeffd640 1 -- 10.20.193.28:0/733804848 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0013020 con 0x7fb800109220 2026-02-20T03:30:04.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb7eeffd640 1 -- 10.20.193.28:0/733804848 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb7f0004480 con 0x7fb800109220 2026-02-20T03:30:04.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb7eeffd640 1 -- 10.20.193.28:0/733804848 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000fb50 con 0x7fb800109220 2026-02-20T03:30:04.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb80683f640 1 -- 10.20.193.28:0/733804848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8001a69b0 con 0x7fb800109220 2026-02-20T03:30:04.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.097+0000 7fb80683f640 1 -- 10.20.193.28:0/733804848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8001ae1f0 con 0x7fb800109220 2026-02-20T03:30:04.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.100+0000 7fb7eeffd640 1 -- 10.20.193.28:0/733804848 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb7f0002780 con 0x7fb800109220 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.101+0000 7fb809fcde00 1 Processor -- start 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.101+0000 7fb809fcde00 1 -- start start 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb7eeffd640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7dc0b0e20 0x7fb7dc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cbd80 0x560b206cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cc6a0 0x560b206c6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb809fcde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560b20646890 con 0x560b206c6b40 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb809fcde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560b20619620 con 0x560b206cbd80 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb809fcde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560b205c72a0 con 0x560b206cc6a0 2026-02-20T03:30:04.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb7eeffd640 1 -- 10.20.193.28:0/733804848 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7fb7f00e04f0 con 0x7fb800109220 2026-02-20T03:30:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb80603e640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7dc0b0e20 0x7fb7dc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb80603e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb80603e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206d2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45368/0 (socket says 10.20.193.28:45368) 2026-02-20T03:30:04.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.102+0000 7fb80603e640 1 -- 10.20.193.28:0/3295462100 learned_addr learned my addr 10.20.193.28:0/3295462100 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:04.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb80603e640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7dc0b0e20 0x7fb7dc0b32e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0133e0 tx=0x7fb7fc009a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:04.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb80603e640 1 -- 10.20.193.28:0/3295462100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cc6a0 msgr2=0x560b206c6410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:04.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb80603e640 1 --2- 10.20.193.28:0/3295462100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cc6a0 0x560b206c6410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb80603e640 1 -- 10.20.193.28:0/3295462100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cbd80 msgr2=0x560b206cc160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:04.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb80603e640 1 --2- 10.20.193.28:0/3295462100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cbd80 0x560b206cc160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb80603e640 1 -- 10.20.193.28:0/3295462100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b205b94a0 con 0x560b206c6b40 2026-02-20T03:30:04.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb80603e640 1 --2- 10.20.193.28:0/3295462100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206d2bb0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc013d50 tx=0x7fb7fc004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5f933e1bfaf0eb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:04.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb7ce4e6640 1 -- 10.20.193.28:0/3295462100 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc006310 con 0x560b206c6b40 2026-02-20T03:30:04.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb7ce4e6640 1 -- 10.20.193.28:0/3295462100 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb7fc006950 con 0x560b206c6b40 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb7ce4e6640 1 -- 10.20.193.28:0/3295462100 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc017bb0 con 0x560b206c6b40 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb809fcde00 1 -- 10.20.193.28:0/3295462100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 msgr2=0x560b206d2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3295462100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206d2bb0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc013d50 tx=0x7fb7fc004000 comp rx=0 tx=0).stop 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb809fcde00 1 -- 10.20.193.28:0/3295462100 shutdown_connections 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3295462100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206d2bb0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3295462100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cc6a0 0x560b206c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3295462100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cbd80 0x560b206cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.103+0000 7fb809fcde00 1 -- 10.20.193.28:0/3295462100 >> 10.20.193.28:0/3295462100 conn(0x560b206c2540 msgr2=0x560b206c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.104+0000 7fb809fcde00 1 -- 10.20.193.28:0/3295462100 shutdown_connections 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.104+0000 7fb809fcde00 1 -- 10.20.193.28:0/3295462100 wait complete. 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.105+0000 7fb809fcde00 1 -- start start 2026-02-20T03:30:04.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.105+0000 7fb809fcde00 1 Processor -- start 2026-02-20T03:30:04.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.105+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206e0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.105+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cbd80 0x560b206e1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.105+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cc6a0 0x560b206df400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.105+0000 7fb809fcde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560b20615550 con 0x560b206c6b40 2026-02-20T03:30:04.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.105+0000 7fb809fcde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560b2047bf60 con 0x560b206cc6a0 2026-02-20T03:30:04.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.105+0000 7fb809fcde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560b206dfb80 con 0x560b206cbd80 2026-02-20T03:30:04.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb80583d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206e0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:04.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb80583d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206e0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45382/0 (socket says 10.20.193.28:45382) 2026-02-20T03:30:04.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb80583d640 1 -- 10.20.193.28:0/3356052127 learned_addr learned my addr 10.20.193.28:0/3356052127 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:04.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb80583d640 1 -- 10.20.193.28:0/3356052127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cbd80 msgr2=0x560b206e1200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:04.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb80583d640 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cbd80 0x560b206e1200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb80583d640 1 -- 10.20.193.28:0/3356052127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cc6a0 msgr2=0x560b206df400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:04.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb80583d640 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cc6a0 0x560b206df400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb80583d640 1 -- 10.20.193.28:0/3356052127 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b206d87d0 con 0x560b206c6b40 2026-02-20T03:30:04.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb80583d640 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206e0cc0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00a5250 tx=0x7fb7f00a7840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499d31e537f9ed4d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:04.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb7bb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:04.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/3356052127 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00e0130 con 0x560b206c6b40 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.106+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/3356052127 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb7f00e02d0 con 0x560b206c6b40 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 1 -- 10.20.193.28:0/3356052127 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b205e6100 con 0x560b206c6b40 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/3356052127 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0005a70 con 0x560b206c6b40 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/3356052127 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7fb7f0005c10 con 0x560b206c6b40 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 10 client.19716 _ll_register_callbacks cb 0x560b20652940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 1 -- 10.20.193.28:0/3356052127 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b20621210 con 0x560b206c6b40 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/3356052127 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb7f0005e10 con 0x560b206c6b40 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 10 client.19716 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 1 -- 10.20.193.28:0/3356052127 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x560b205da480 con 0x560b206c6b40 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/3356052127 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7fb7f00ac100 con 0x560b206c6b40 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 10 client.19716 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 10 client.19716 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:30:04.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 20 client.19716 populate_metadata read hostname 'trial028' 2026-02-20T03:30:04.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b206ef470 0x560b206f1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 4 client.19716 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:04.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.107+0000 7fb809fcde00 1 -- 10.20.193.28:0/3356052127 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b2059bca0 con 0x560b206ef470 2026-02-20T03:30:04.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.113+0000 7fb80503c640 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b206ef470 0x560b206f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.180+0000 7fb80503c640 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b206ef470 0x560b206f1930 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb623a77ee531c16 server_cookie=8c0b68e051f98d97 in_seq=0 out_seq=0 2026-02-20T03:30:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.180+0000 7fb7bb7fe640 10 client.19716 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:04.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.193+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/3356052127 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560b2059bca0 con 0x560b206ef470 2026-02-20T03:30:04.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.193+0000 7fb7bb7fe640 10 client.19716 handle_command_reply: tid=0 2026-02-20T03:30:04.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 client.19716 shutdown 2026-02-20T03:30:04.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 -- 10.20.193.28:0/3356052127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 msgr2=0x560b206e0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:04.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206e0cc0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00a5250 tx=0x7fb7f00a7840 comp rx=0 tx=0).stop 2026-02-20T03:30:04.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 -- 10.20.193.28:0/3356052127 shutdown_connections 2026-02-20T03:30:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b206ef470 0x560b206f1930 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cc6a0 0x560b206df400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cbd80 0x560b206e1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 --2- 10.20.193.28:0/3356052127 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206c6b40 0x560b206e0cc0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 -- 10.20.193.28:0/3356052127 >> 10.20.193.28:0/3356052127 conn(0x560b206c2540 msgr2=0x560b206c5150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb7bb7fe640 0 client.19716 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 -- 10.20.193.28:0/3356052127 shutdown_connections 2026-02-20T03:30:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 1 -- 10.20.193.28:0/3356052127 wait complete. 2026-02-20T03:30:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.194+0000 7fb809fcde00 20 client.19716 trim_cache size 0 max 16384 2026-02-20T03:30:04.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb809fcde00 1 Processor -- start 2026-02-20T03:30:04.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb809fcde00 1 -- start start 2026-02-20T03:30:04.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206c6b40 0x560b206ec1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206f7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cc6a0 0x560b206f7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb809fcde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac0125d0 con 0x560b206cbd80 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb809fcde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac00fe40 con 0x560b206cc6a0 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb809fcde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac00dc90 con 0x560b206c6b40 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb80503c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb80503c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206f7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45386/0 (socket says 10.20.193.28:45386) 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb80503c640 1 -- 10.20.193.28:0/984289704 learned_addr learned my addr 10.20.193.28:0/984289704 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb80503c640 1 -- 10.20.193.28:0/984289704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206c6b40 msgr2=0x560b206ec1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb80503c640 1 --2- 10.20.193.28:0/984289704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206c6b40 0x560b206ec1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb80503c640 1 -- 10.20.193.28:0/984289704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cc6a0 msgr2=0x560b206f7780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb80503c640 1 --2- 10.20.193.28:0/984289704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cc6a0 0x560b206f7780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb80503c640 1 -- 10.20.193.28:0/984289704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b206cc4d0 con 0x560b206cbd80 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.203+0000 7fb80503c640 1 --2- 10.20.193.28:0/984289704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206f7240 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009a00 tx=0x7fb7f4005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27ace894f328274 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb7cdce5640 1 -- 10.20.193.28:0/984289704 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4002e30 con 0x560b206cbd80 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb7cdce5640 1 -- 10.20.193.28:0/984289704 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb7f4033040 con 0x560b206cbd80 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb7cdce5640 1 -- 10.20.193.28:0/984289704 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4004490 con 0x560b206cbd80 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb809fcde00 1 -- 10.20.193.28:0/984289704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 msgr2=0x560b206f7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb809fcde00 1 --2- 10.20.193.28:0/984289704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206f7240 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009a00 tx=0x7fb7f4005e50 comp rx=0 tx=0).stop 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb809fcde00 1 -- 10.20.193.28:0/984289704 shutdown_connections 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb809fcde00 1 --2- 10.20.193.28:0/984289704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206cc6a0 0x560b206f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb809fcde00 1 --2- 10.20.193.28:0/984289704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206f7240 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb809fcde00 1 --2- 10.20.193.28:0/984289704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206c6b40 0x560b206ec1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb809fcde00 1 -- 10.20.193.28:0/984289704 >> 10.20.193.28:0/984289704 conn(0x560b206c2540 msgr2=0x560b206ebae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:04.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb809fcde00 1 -- 10.20.193.28:0/984289704 shutdown_connections 2026-02-20T03:30:04.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.204+0000 7fb809fcde00 1 -- 10.20.193.28:0/984289704 wait complete. 2026-02-20T03:30:04.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb809fcde00 1 -- start start 2026-02-20T03:30:04.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb809fcde00 1 Processor -- start 2026-02-20T03:30:04.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206c6b40 0x560b206e3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206e42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb809fcde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cc6a0 0x560b2075a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb809fcde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac00e300 con 0x560b206cbd80 2026-02-20T03:30:04.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb809fcde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac00f770 con 0x560b206c6b40 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb809fcde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac00e9d0 con 0x560b206cc6a0 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb80503c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206e42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb80503c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206e42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45388/0 (socket says 10.20.193.28:45388) 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb80503c640 1 -- 10.20.193.28:0/742383759 learned_addr learned my addr 10.20.193.28:0/742383759 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb80503c640 1 -- 10.20.193.28:0/742383759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cc6a0 msgr2=0x560b2075a420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb80503c640 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cc6a0 0x560b2075a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb80503c640 1 -- 10.20.193.28:0/742383759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206c6b40 msgr2=0x560b206e3d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb80503c640 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206c6b40 0x560b206e3d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.205+0000 7fb80503c640 1 -- 10.20.193.28:0/742383759 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b206d8600 con 0x560b206cbd80 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb80503c640 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206e42a0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009950 tx=0x7fb7f4038660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab700ca7e509656 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb7bb7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:04.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/742383759 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f404f070 con 0x560b206cbd80 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/742383759 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb7f40028e0 con 0x560b206cbd80 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/742383759 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4038a80 con 0x560b206cbd80 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb809fcde00 1 -- 10.20.193.28:0/742383759 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b203a8d90 con 0x560b206cbd80 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb809fcde00 10 client.19722 _ll_register_callbacks cb 0x7fb7f000f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb809fcde00 1 -- 10.20.193.28:0/742383759 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b203eb230 con 0x560b206cbd80 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/742383759 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7fb7f4038c20 con 0x560b206cbd80 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/742383759 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fb7f4004210 con 0x560b206cbd80 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb809fcde00 10 client.19722 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.206+0000 7fb809fcde00 1 -- 10.20.193.28:0/742383759 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x560b205c0720 con 0x560b206cbd80 2026-02-20T03:30:04.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.207+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/742383759 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7fb7f405e060 con 0x560b206cbd80 2026-02-20T03:30:04.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.207+0000 7fb809fcde00 10 client.19722 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:04.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.207+0000 7fb809fcde00 10 client.19722 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:30:04.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.207+0000 7fb809fcde00 20 client.19722 populate_metadata read hostname 'trial028' 2026-02-20T03:30:04.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.207+0000 7fb809fcde00 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b2075bd70 0x560b2075e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:04.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.207+0000 7fb809fcde00 4 client.19722 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "189aa5bc", "await_for": 45.0}] 2026-02-20T03:30:04.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.207+0000 7fb809fcde00 1 -- 10.20.193.28:0/742383759 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "189aa5bc", "await_for": 45.0}) -- 0x560b20626e00 con 0x560b2075bd70 2026-02-20T03:30:04.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.220+0000 7fb80583d640 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b2075bd70 0x560b2075e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:04.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.287+0000 7fb80583d640 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b2075bd70 0x560b2075e230 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8787085dc6529a16 server_cookie=c4f29d5614a7d75e in_seq=0 out_seq=0 2026-02-20T03:30:04.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:04.287+0000 7fb7bb7fe640 10 client.19722 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:04.428 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:04 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:30:04.429 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:04 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:04.429 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:04 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:30:04.429 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:04 trial028 ceph-mon[38552]: Scrub error on inode 0x10000000015 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2026-02-20T03:30:04.429 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:04 trial028 ceph-mon[38552]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:30:04.429 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:04 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:04.429 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:04 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:04.429 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3356272862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:04.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:04 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:30:04.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:04 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:04.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:04 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:30:04.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:04 trial126 ceph-mon[38476]: Scrub error on inode 0x10000000015 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2026-02-20T03:30:04.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:04 trial126 ceph-mon[38476]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:30:04.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:04 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:04.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:04 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:04.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3356272862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:04.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 20.90 MB/sec warmup 95 sec latency 60724.237 ms 2026-02-20T03:30:04.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:04 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:30:04.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:04 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:04.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:04 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:30:04.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:04 trial177 ceph-mon[43181]: Scrub error on inode 0x10000000015 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2026-02-20T03:30:04.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:04 trial177 ceph-mon[43181]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:30:04.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:04 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:04.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:04 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:04.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3356272862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:05.495 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:05 trial028 ceph-mon[38552]: pgmap v646: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 3.7 KiB/s wr, 18 op/s 2026-02-20T03:30:05.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:05 trial126 ceph-mon[38476]: pgmap v646: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 3.7 KiB/s wr, 18 op/s 2026-02-20T03:30:05.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 20.68 MB/sec warmup 96 sec latency 61724.276 ms 2026-02-20T03:30:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:05 trial177 ceph-mon[43181]: pgmap v646: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 19 KiB/s rd, 3.7 KiB/s wr, 18 op/s 2026-02-20T03:30:06.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 20.47 MB/sec warmup 97 sec latency 62724.310 ms 2026-02-20T03:30:07.363 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:07 trial028 ceph-mon[38552]: pgmap v647: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 3.8 KiB/s wr, 46 op/s 2026-02-20T03:30:07.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:07 trial126 ceph-mon[38476]: pgmap v647: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 3.8 KiB/s wr, 46 op/s 2026-02-20T03:30:07.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 20.26 MB/sec warmup 98 sec latency 63724.339 ms 2026-02-20T03:30:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:07 trial177 ceph-mon[43181]: pgmap v647: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 46 KiB/s rd, 3.8 KiB/s wr, 46 op/s 2026-02-20T03:30:08.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 20.05 MB/sec warmup 99 sec latency 64724.372 ms 2026-02-20T03:30:09.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:09 trial028 ceph-mon[38552]: pgmap v648: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 4.4 KiB/s wr, 63 op/s 2026-02-20T03:30:09.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 19.85 MB/sec warmup 100 sec latency 65724.425 ms 2026-02-20T03:30:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:09 trial177 ceph-mon[43181]: pgmap v648: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 4.4 KiB/s wr, 63 op/s 2026-02-20T03:30:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:09 trial126 ceph-mon[38476]: pgmap v648: 129 pgs: 129 active+clean; 430 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 60 KiB/s rd, 4.4 KiB/s wr, 63 op/s 2026-02-20T03:30:10.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 19.65 MB/sec warmup 101 sec latency 66724.469 ms 2026-02-20T03:30:11.450 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:11 trial028 ceph-mon[38552]: pgmap v649: 129 pgs: 129 active+clean; 407 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 9.7 KiB/s wr, 111 op/s 2026-02-20T03:30:11.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33609 19.46 MB/sec warmup 102 sec latency 67724.506 ms 2026-02-20T03:30:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:11 trial177 ceph-mon[43181]: pgmap v649: 129 pgs: 129 active+clean; 407 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 9.7 KiB/s wr, 111 op/s 2026-02-20T03:30:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:11 trial126 ceph-mon[38476]: pgmap v649: 129 pgs: 129 active+clean; 407 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 9.7 KiB/s wr, 111 op/s 2026-02-20T03:30:12.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.121+0000 7f635ffff640 1 -- 10.20.193.28:0/3854203967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 msgr2=0x7f6360111aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.121+0000 7f635ffff640 1 --2- 10.20.193.28:0/3854203967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 0x7f6360111aa0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f635000b0a0 tx=0x7f635002f410 comp rx=0 tx=0).stop 2026-02-20T03:30:12.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.121+0000 7f635ffff640 1 -- 10.20.193.28:0/3854203967 shutdown_connections 2026-02-20T03:30:12.124 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.121+0000 7f635ffff640 1 --2- 10.20.193.28:0/3854203967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 0x7f6360111aa0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.121+0000 7f635ffff640 1 --2- 10.20.193.28:0/3854203967 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f636010a9b0 0x7f636010ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.121+0000 7f635ffff640 1 --2- 10.20.193.28:0/3854203967 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f636006b3b0 0x7f636010a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.121+0000 7f635ffff640 1 -- 10.20.193.28:0/3854203967 >> 10.20.193.28:0/3854203967 conn(0x7f636006f7e0 msgr2=0x7f6360071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.121+0000 7f635ffff640 1 -- 10.20.193.28:0/3854203967 shutdown_connections 2026-02-20T03:30:12.125 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.121+0000 7f635ffff640 1 -- 10.20.193.28:0/3854203967 wait complete. 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635ffff640 1 Processor -- start 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635ffff640 1 -- start start 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f636006b3b0 0x7f63601a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f636010a9b0 0x7f63601a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 0x7f63601ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63601148d0 con 0x7f636010f6b0 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6360114750 con 0x7f636006b3b0 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6360114a50 con 0x7f636010a9b0 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 0x7f63601ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 0x7f63601ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37914/0 (socket says 10.20.193.28:37914) 2026-02-20T03:30:12.127 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.122+0000 7f635f7fe640 1 -- 10.20.193.28:0/2626686783 learned_addr learned my addr 10.20.193.28:0/2626686783 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635e7fc640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f636010a9b0 0x7f63601a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635effd640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f636006b3b0 0x7f63601a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635f7fe640 1 -- 10.20.193.28:0/2626686783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f636010a9b0 msgr2=0x7f63601a5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635f7fe640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f636010a9b0 0x7f63601a5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635f7fe640 1 -- 10.20.193.28:0/2626686783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f636006b3b0 msgr2=0x7f63601a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635f7fe640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f636006b3b0 0x7f63601a5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635f7fe640 1 -- 10.20.193.28:0/2626686783 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63601acff0 con 0x7f636010f6b0 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635f7fe640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 0x7f63601ac8f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f635000b070 tx=0x7f6350004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f633ffff640 1 -- 10.20.193.28:0/2626686783 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6350046070 con 0x7f636010f6b0 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f633ffff640 1 -- 10.20.193.28:0/2626686783 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f63500076a0 con 0x7f636010f6b0 2026-02-20T03:30:12.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f633ffff640 1 -- 10.20.193.28:0/2626686783 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63500416e0 con 0x7f636010f6b0 2026-02-20T03:30:12.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635ffff640 1 -- 10.20.193.28:0/2626686783 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63601ad280 con 0x7f636010f6b0 2026-02-20T03:30:12.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.123+0000 7f635ffff640 1 -- 10.20.193.28:0/2626686783 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63601ad720 con 0x7f636010f6b0 2026-02-20T03:30:12.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.126+0000 7f633ffff640 1 -- 10.20.193.28:0/2626686783 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6350007b80 con 0x7f636010f6b0 2026-02-20T03:30:12.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.126+0000 7f6368461e00 1 Processor -- start 2026-02-20T03:30:12.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.126+0000 7f6368461e00 1 -- start start 2026-02-20T03:30:12.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f6368461e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 0x563a4397cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f6368461e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397d1d0 0x563a43981950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f6368461e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 0x563a43984400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f6368461e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563a438c48f0 con 0x563a4397d1d0 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f6368461e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563a438722e0 con 0x563a43981f70 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f6368461e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563a438c0820 con 0x563a4397c890 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f635effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397d1d0 0x563a43981950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f635effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397d1d0 0x563a43981950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37924/0 (socket says 10.20.193.28:37924) 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f635effd640 1 -- 10.20.193.28:0/296597619 learned_addr learned my addr 10.20.193.28:0/296597619 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f635e7fc640 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 0x563a4397cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f633ffff640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63300b0e20 0x7f63300b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f635e7fc640 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 0x563a43984400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f635e7fc640 1 -- 10.20.193.28:0/296597619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 msgr2=0x563a43984400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:12.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f635e7fc640 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 0x563a43984400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f635e7fc640 1 -- 10.20.193.28:0/296597619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397d1d0 msgr2=0x563a43981950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:12.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.127+0000 7f633ffff640 1 -- 10.20.193.28:0/2626686783 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f6350105570 con 0x7f636010f6b0 2026-02-20T03:30:12.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f635e7fc640 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397d1d0 0x563a43981950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f635f7fe640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63300b0e20 0x7f63300b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f635e7fc640 1 -- 10.20.193.28:0/296597619 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a438645a0 con 0x563a4397c890 2026-02-20T03:30:12.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f635effd640 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397d1d0 0x563a43981950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:30:12.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f635e7fc640 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 0x563a4397cc90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f63601a6850 tx=0x7f634800b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9da8abdee2e1057 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:12.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f635f7fe640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63300b0e20 0x7f63300b32e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f63500c9080 tx=0x7f635002f410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:12.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f63277fe640 1 -- 10.20.193.28:0/296597619 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63480040d0 con 0x563a4397c890 2026-02-20T03:30:12.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f63277fe640 1 -- 10.20.193.28:0/296597619 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f634800e930 con 0x563a4397c890 2026-02-20T03:30:12.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f63277fe640 1 -- 10.20.193.28:0/296597619 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348002960 con 0x563a4397c890 2026-02-20T03:30:12.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f6368461e00 1 -- 10.20.193.28:0/296597619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 msgr2=0x563a4397cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.128+0000 7f6368461e00 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 0x563a4397cc90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f63601a6850 tx=0x7f634800b460 comp rx=0 tx=0).stop 2026-02-20T03:30:12.134 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.129+0000 7f6368461e00 1 -- 10.20.193.28:0/296597619 shutdown_connections 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.129+0000 7f6368461e00 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 0x563a43984400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.129+0000 7f6368461e00 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397d1d0 0x563a43981950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.129+0000 7f6368461e00 1 --2- 10.20.193.28:0/296597619 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 0x563a4397cc90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.129+0000 7f6368461e00 1 -- 10.20.193.28:0/296597619 >> 10.20.193.28:0/296597619 conn(0x563a4396b6f0 msgr2=0x563a4397af80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.129+0000 7f6368461e00 1 -- 10.20.193.28:0/296597619 shutdown_connections 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.129+0000 7f6368461e00 1 -- 10.20.193.28:0/296597619 wait complete. 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f6368461e00 1 -- start start 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f6368461e00 1 Processor -- start 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f6368461e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397c890 0x563a439953a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f6368461e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397d1d0 0x563a439958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f6368461e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 0x563a4399c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f6368461e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563a4386c0c0 con 0x563a4397c890 2026-02-20T03:30:12.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f6368461e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563a43984fc0 con 0x563a43981f70 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f6368461e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563a4399cdf0 con 0x563a4397d1d0 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f635e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397c890 0x563a439953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f635e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397c890 0x563a439953a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37932/0 (socket says 10.20.193.28:37932) 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f635e7fc640 1 -- 10.20.193.28:0/1955759515 learned_addr learned my addr 10.20.193.28:0/1955759515 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.130+0000 7f635effd640 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397d1d0 0x563a439958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.131+0000 7f635e7fc640 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 0x563a4399c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.131+0000 7f635e7fc640 1 -- 10.20.193.28:0/1955759515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397d1d0 msgr2=0x563a439958e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.131+0000 7f635e7fc640 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397d1d0 0x563a439958e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.131+0000 7f635e7fc640 1 -- 10.20.193.28:0/1955759515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 msgr2=0x563a4399c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.131+0000 7f635e7fc640 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 0x563a4399c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.131+0000 7f635e7fc640 1 -- 10.20.193.28:0/1955759515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a4398eae0 con 0x563a4397c890 2026-02-20T03:30:12.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.131+0000 7f635e7fc640 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397c890 0x563a439953a0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f634800b400 tx=0x7f6348005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa282737bbe92b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:12.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.131+0000 7f6324ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:12.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.132+0000 7f6324ff9640 1 -- 10.20.193.28:0/1955759515 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63480042e0 con 0x563a4397c890 2026-02-20T03:30:12.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.132+0000 7f6324ff9640 1 -- 10.20.193.28:0/1955759515 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6348004480 con 0x563a4397c890 2026-02-20T03:30:12.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.132+0000 7f6324ff9640 1 -- 10.20.193.28:0/1955759515 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348021840 con 0x563a4397c890 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.132+0000 7f6368461e00 1 -- 10.20.193.28:0/1955759515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a43880820 con 0x563a4397c890 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.132+0000 7f6368461e00 10 client.19734 _ll_register_callbacks cb 0x563a4386fff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.132+0000 7f6368461e00 1 -- 10.20.193.28:0/1955759515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563a438cc4e0 con 0x563a4397c890 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.132+0000 7f6324ff9640 1 -- 10.20.193.28:0/1955759515 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f63480219e0 con 0x563a4397c890 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6324ff9640 1 -- 10.20.193.28:0/1955759515 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6348021c20 con 0x563a4397c890 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6368461e00 10 client.19734 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6368461e00 1 -- 10.20.193.28:0/1955759515 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x563a43885380 con 0x563a4397c890 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6324ff9640 1 -- 10.20.193.28:0/1955759515 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f6348005020 con 0x563a4397c890 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6368461e00 10 client.19734 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6368461e00 10 client.19734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6368461e00 20 client.19734 populate_metadata read hostname 'trial028' 2026-02-20T03:30:12.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6368461e00 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a439a0e20 0x563a439a32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6368461e00 4 client.19734 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f6368461e00 1 -- 10.20.193.28:0/1955759515 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a43846bd0 con 0x563a439a0e20 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.133+0000 7f635effd640 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a439a0e20 0x563a439a32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.134+0000 7f635effd640 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a439a0e20 0x563a439a32e0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2f26ede68d2fea0 server_cookie=e5085802f976b6ef in_seq=0 out_seq=0 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.134+0000 7f6324ff9640 10 client.19734 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.135+0000 7f6324ff9640 1 -- 10.20.193.28:0/1955759515 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563a43846bd0 con 0x563a439a0e20 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.135+0000 7f6324ff9640 10 client.19734 handle_command_reply: tid=0 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.135+0000 7f6368461e00 1 client.19734 shutdown 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.135+0000 7f6368461e00 1 -- 10.20.193.28:0/1955759515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397c890 msgr2=0x563a439953a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.135+0000 7f6368461e00 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397c890 0x563a439953a0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f634800b400 tx=0x7f6348005de0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.135+0000 7f6368461e00 1 -- 10.20.193.28:0/1955759515 shutdown_connections 2026-02-20T03:30:12.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.135+0000 7f6368461e00 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a439a0e20 0x563a439a32e0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.135+0000 7f6368461e00 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a43981f70 0x563a4399c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.135+0000 7f6368461e00 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397d1d0 0x563a439958e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.136+0000 7f6368461e00 1 --2- 10.20.193.28:0/1955759515 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a4397c890 0x563a439953a0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.136+0000 7f6324ff9640 0 client.19734 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:12.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.136+0000 7f6368461e00 1 -- 10.20.193.28:0/1955759515 >> 10.20.193.28:0/1955759515 conn(0x563a4396b6f0 msgr2=0x563a4397af80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.136+0000 7f6368461e00 1 -- 10.20.193.28:0/1955759515 shutdown_connections 2026-02-20T03:30:12.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.136+0000 7f6368461e00 1 -- 10.20.193.28:0/1955759515 wait complete. 2026-02-20T03:30:12.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.136+0000 7f6368461e00 20 client.19734 trim_cache size 0 max 16384 2026-02-20T03:30:12.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.143+0000 7f6368461e00 1 Processor -- start 2026-02-20T03:30:12.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.143+0000 7f6368461e00 1 -- start start 2026-02-20T03:30:12.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.143+0000 7f6368461e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 0x563a4397af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.143+0000 7f6368461e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a4397d1d0 0x563a4397b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.143+0000 7f6368461e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.143+0000 7f6368461e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f63040127d0 con 0x563a43981f70 2026-02-20T03:30:12.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.143+0000 7f6368461e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6304010040 con 0x563a4397d1d0 2026-02-20T03:30:12.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.143+0000 7f6368461e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f630400de90 con 0x563a4397c890 2026-02-20T03:30:12.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f635e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f635e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37944/0 (socket says 10.20.193.28:37944) 2026-02-20T03:30:12.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f635e7fc640 1 -- 10.20.193.28:0/2434166472 learned_addr learned my addr 10.20.193.28:0/2434166472 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:12.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f635e7fc640 1 -- 10.20.193.28:0/2434166472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 msgr2=0x563a4397af80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f635e7fc640 1 --2- 10.20.193.28:0/2434166472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 0x563a4397af80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f635e7fc640 1 -- 10.20.193.28:0/2434166472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a4397d1d0 msgr2=0x563a4397b4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f635e7fc640 1 --2- 10.20.193.28:0/2434166472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a4397d1d0 0x563a4397b4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f635e7fc640 1 -- 10.20.193.28:0/2434166472 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a4398e910 con 0x563a43981f70 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f635e7fc640 1 --2- 10.20.193.28:0/2434166472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399c820 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6348005940 tx=0x7f6348015030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f59bdc53c0dafdf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f6326ffd640 1 -- 10.20.193.28:0/2434166472 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63480130e0 con 0x563a43981f70 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f6326ffd640 1 -- 10.20.193.28:0/2434166472 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6348039070 con 0x563a43981f70 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.144+0000 7f6326ffd640 1 -- 10.20.193.28:0/2434166472 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348004540 con 0x563a43981f70 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 -- 10.20.193.28:0/2434166472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 msgr2=0x563a4399c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 --2- 10.20.193.28:0/2434166472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399c820 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f6348005940 tx=0x7f6348015030 comp rx=0 tx=0).stop 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 -- 10.20.193.28:0/2434166472 shutdown_connections 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 --2- 10.20.193.28:0/2434166472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399c820 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 --2- 10.20.193.28:0/2434166472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a4397d1d0 0x563a4397b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 --2- 10.20.193.28:0/2434166472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397c890 0x563a4397af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 -- 10.20.193.28:0/2434166472 >> 10.20.193.28:0/2434166472 conn(0x563a4396b6f0 msgr2=0x563a43994180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 -- 10.20.193.28:0/2434166472 shutdown_connections 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 -- 10.20.193.28:0/2434166472 wait complete. 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 -- start start 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.145+0000 7f6368461e00 1 Processor -- start 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f6368461e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a4397c890 0x563a43998300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f6368461e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397d1d0 0x563a43998840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f6368461e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f6368461e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f630400e500 con 0x563a43981f70 2026-02-20T03:30:12.152 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f6368461e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f630400f970 con 0x563a4397c890 2026-02-20T03:30:12.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f6368461e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f630400ebd0 con 0x563a4397d1d0 2026-02-20T03:30:12.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f635e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f635e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37946/0 (socket says 10.20.193.28:37946) 2026-02-20T03:30:12.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f635e7fc640 1 -- 10.20.193.28:0/1660934326 learned_addr learned my addr 10.20.193.28:0/1660934326 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f635e7fc640 1 -- 10.20.193.28:0/1660934326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397d1d0 msgr2=0x563a43998840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f635e7fc640 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397d1d0 0x563a43998840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f635e7fc640 1 -- 10.20.193.28:0/1660934326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a4397c890 msgr2=0x563a43998300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f635e7fc640 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a4397c890 0x563a43998300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f635e7fc640 1 -- 10.20.193.28:0/1660934326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a43984fc0 con 0x563a43981f70 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f635e7fc640 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399b880 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6348005e90 tx=0x7f63480133f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203d521332ba16dc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.146+0000 7f6324ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6324ff9640 1 -- 10.20.193.28:0/1660934326 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63480044e0 con 0x563a43981f70 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6324ff9640 1 -- 10.20.193.28:0/1660934326 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x563a438cc4e0 con 0x563a43981f70 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 1 -- 10.20.193.28:0/1660934326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a439936d0 con 0x563a43981f70 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 10 client.19740 _ll_register_callbacks cb 0x7f6348013830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:12.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 1 -- 10.20.193.28:0/1660934326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f634800e930 con 0x563a43981f70 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6324ff9640 1 -- 10.20.193.28:0/1660934326 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348020440 con 0x563a43981f70 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6324ff9640 1 -- 10.20.193.28:0/1660934326 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f63480205e0 con 0x563a43981f70 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6324ff9640 1 -- 10.20.193.28:0/1660934326 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f63480208a0 con 0x563a43981f70 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 10 client.19740 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 1 -- 10.20.193.28:0/1660934326 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x563a43624690 con 0x563a43981f70 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6324ff9640 1 -- 10.20.193.28:0/1660934326 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f634804e030 con 0x563a43981f70 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 10 client.19740 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 10 client.19740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 20 client.19740 populate_metadata read hostname 'trial028' 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a43a0c160 0x563a43a0e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.147+0000 7f6368461e00 4 client.19740 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:30:12.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.148+0000 7f6368461e00 1 -- 10.20.193.28:0/1660934326 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a4369d520 con 0x563a43a0c160 2026-02-20T03:30:12.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.154+0000 7f635effd640 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a43a0c160 0x563a43a0e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.154+0000 7f635effd640 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a43a0c160 0x563a43a0e5f0 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d993136a27768bf4 server_cookie=1ad0ac22086784fc in_seq=0 out_seq=0 2026-02-20T03:30:12.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.154+0000 7f6324ff9640 10 client.19740 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:12.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb7bb7fe640 1 -- 10.20.193.28:0/742383759 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560b20626e00 con 0x560b2075bd70 2026-02-20T03:30:12.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb7bb7fe640 10 client.19722 handle_command_reply: tid=0 2026-02-20T03:30:12.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 client.19722 shutdown 2026-02-20T03:30:12.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 -- 10.20.193.28:0/742383759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 msgr2=0x560b206e42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206e42a0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009950 tx=0x7fb7f4038660 comp rx=0 tx=0).stop 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 -- 10.20.193.28:0/742383759 shutdown_connections 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560b2075bd70 0x560b2075e230 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560b206cc6a0 0x560b2075a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560b206cbd80 0x560b206e42a0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 --2- 10.20.193.28:0/742383759 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560b206c6b40 0x560b206e3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb7bb7fe640 0 client.19722 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 -- 10.20.193.28:0/742383759 >> 10.20.193.28:0/742383759 conn(0x560b206c2540 msgr2=0x560b206ddb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.157+0000 7fb809fcde00 1 -- 10.20.193.28:0/742383759 shutdown_connections 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.158+0000 7fb809fcde00 1 -- 10.20.193.28:0/742383759 wait complete. 2026-02-20T03:30:12.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.158+0000 7fb809fcde00 20 client.19722 trim_cache size 0 max 16384 2026-02-20T03:30:12.162 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:30:12.162 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 37, 2026-02-20T03:30:12.162 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:30:12.162 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 46, 2026-02-20T03:30:12.162 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:30:12.162 INFO:teuthology.orchestra.run.trial028.stdout: "189aa5bc": { 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "version": 46, 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 141.5, 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:30:12.163 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:30:12.164 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:30:12.164 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCED", 2026-02-20T03:30:12.164 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:30:12.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:12.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:12.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:12.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:12.164 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:12.164 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 -- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7dc0b0e20 msgr2=0x7fb7dc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7dc0b0e20 0x7fb7dc0b32e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0133e0 tx=0x7fb7fc009a80 comp rx=0 tx=0).stop 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 -- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 msgr2=0x7fb8001a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 0x7fb8001a1670 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000b570 tx=0x7fb7f000ba40 comp rx=0 tx=0).stop 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 -- 10.20.193.28:0/733804848 shutdown_connections 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7dc0b0e20 0x7fb7dc0b32e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb80010eef0 0x7fb8001a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb800109ba0 0x7fb8001a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 --2- 10.20.193.28:0/733804848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb800109220 0x7fb8001a1670 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.159+0000 7fb80683f640 1 -- 10.20.193.28:0/733804848 >> 10.20.193.28:0/733804848 conn(0x7fb800078600 msgr2=0x7fb800079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.160+0000 7fb80683f640 1 -- 10.20.193.28:0/733804848 shutdown_connections 2026-02-20T03:30:12.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.160+0000 7fb80683f640 1 -- 10.20.193.28:0/733804848 wait complete. 2026-02-20T03:30:12.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.186+0000 7f6324ff9640 1 -- 10.20.193.28:0/1660934326 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a4369d520 con 0x563a43a0c160 2026-02-20T03:30:12.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.186+0000 7f6324ff9640 10 client.19740 handle_command_reply: tid=0 2026-02-20T03:30:12.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.186+0000 7f6368461e00 1 client.19740 shutdown 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.186+0000 7f6368461e00 1 -- 10.20.193.28:0/1660934326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 msgr2=0x563a4399b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.186+0000 7f6368461e00 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399b880 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f6348005e90 tx=0x7f63480133f0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.187+0000 7f6368461e00 1 -- 10.20.193.28:0/1660934326 shutdown_connections 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.187+0000 7f6368461e00 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a43a0c160 0x563a43a0e5f0 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.187+0000 7f6368461e00 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a43981f70 0x563a4399b880 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.187+0000 7f6368461e00 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a4397d1d0 0x563a43998840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.187+0000 7f6368461e00 1 --2- 10.20.193.28:0/1660934326 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a4397c890 0x563a43998300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.187+0000 7f6324ff9640 0 client.19740 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.187+0000 7f6368461e00 1 -- 10.20.193.28:0/1660934326 >> 10.20.193.28:0/1660934326 conn(0x563a4396b6f0 msgr2=0x563a4397beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.187+0000 7f6368461e00 1 -- 10.20.193.28:0/1660934326 shutdown_connections 2026-02-20T03:30:12.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.187+0000 7f6368461e00 1 -- 10.20.193.28:0/1660934326 wait complete. 2026-02-20T03:30:12.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.188+0000 7f6368461e00 20 client.19740 trim_cache size 0 max 16384 2026-02-20T03:30:12.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:30:12.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:30:12.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:30:12.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:30:12.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 -- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63300b0e20 msgr2=0x7f63300b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63300b0e20 0x7f63300b32e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f63500c9080 tx=0x7f635002f410 comp rx=0 tx=0).stop 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 -- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 msgr2=0x7f63601ac8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 0x7f63601ac8f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f635000b070 tx=0x7f6350004310 comp rx=0 tx=0).stop 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 -- 10.20.193.28:0/2626686783 shutdown_connections 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f63300b0e20 0x7f63300b32e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f636010f6b0 0x7f63601ac8f0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f636010a9b0 0x7f63601a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 --2- 10.20.193.28:0/2626686783 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f636006b3b0 0x7f63601a5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.189+0000 7f635ffff640 1 -- 10.20.193.28:0/2626686783 >> 10.20.193.28:0/2626686783 conn(0x7f636006f7e0 msgr2=0x7f636010b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.190+0000 7f635ffff640 1 -- 10.20.193.28:0/2626686783 shutdown_connections 2026-02-20T03:30:12.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:12.190+0000 7f635ffff640 1 -- 10.20.193.28:0/2626686783 wait complete. 2026-02-20T03:30:12.272 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '189aa5bc', quiesce took 61.8 seconds. Will release after: -40.3 2026-02-20T03:30:12.272 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:30:12.579 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:12.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33617 19.27 MB/sec warmup 103 sec latency 68724.550 ms 2026-02-20T03:30:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.762+0000 7f329c894640 1 -- 10.20.193.28:0/3565378990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298104980 msgr2=0x7f3298104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.762+0000 7f329c894640 1 --2- 10.20.193.28:0/3565378990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298104980 0x7f3298104de0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f3288009a60 tx=0x7f328802f250 comp rx=0 tx=0).stop 2026-02-20T03:30:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.762+0000 7f329c894640 1 -- 10.20.193.28:0/3565378990 shutdown_connections 2026-02-20T03:30:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.762+0000 7f329c894640 1 --2- 10.20.193.28:0/3565378990 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3298105320 0x7f3298111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.762+0000 7f329c894640 1 --2- 10.20.193.28:0/3565378990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298104980 0x7f3298104de0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.762+0000 7f329c894640 1 --2- 10.20.193.28:0/3565378990 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f329810a980 0x7f329810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.762+0000 7f329c894640 1 -- 10.20.193.28:0/3565378990 >> 10.20.193.28:0/3565378990 conn(0x7f3298100680 msgr2=0x7f3298102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.762+0000 7f329c894640 1 -- 10.20.193.28:0/3565378990 shutdown_connections 2026-02-20T03:30:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.762+0000 7f329c894640 1 -- 10.20.193.28:0/3565378990 wait complete. 2026-02-20T03:30:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f329c894640 1 Processor -- start 2026-02-20T03:30:12.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f329c894640 1 -- start start 2026-02-20T03:30:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f329c894640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3298104980 0x7f329819d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f329c894640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298105320 0x7f329819d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f329c894640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f329810a980 0x7f32981a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f329c894640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3298114bb0 con 0x7f3298105320 2026-02-20T03:30:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f329c894640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3298114a30 con 0x7f329810a980 2026-02-20T03:30:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f329c894640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3298114d30 con 0x7f3298104980 2026-02-20T03:30:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f3296ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298105320 0x7f329819d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f32977fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3298104980 0x7f329819d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f32977fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3298104980 0x7f329819d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56034/0 (socket says 10.20.193.28:56034) 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f3296ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298105320 0x7f329819d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37964/0 (socket says 10.20.193.28:37964) 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f32977fe640 1 -- 10.20.193.28:0/3047468891 learned_addr learned my addr 10.20.193.28:0/3047468891 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.763+0000 7f3297fff640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f329810a980 0x7f32981a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f3296ffd640 1 -- 10.20.193.28:0/3047468891 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3298104980 msgr2=0x7f329819d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f3296ffd640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3298104980 0x7f329819d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f3296ffd640 1 -- 10.20.193.28:0/3047468891 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f329810a980 msgr2=0x7f32981a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f3296ffd640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f329810a980 0x7f32981a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f3296ffd640 1 -- 10.20.193.28:0/3047468891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32981a2100 con 0x7f3298105320 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f3296ffd640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298105320 0x7f329819d5f0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f3288009a60 tx=0x7f328802fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:12.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f3294ff9640 1 -- 10.20.193.28:0/3047468891 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328802fe10 con 0x7f3298105320 2026-02-20T03:30:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f3294ff9640 1 -- 10.20.193.28:0/3047468891 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3288038770 con 0x7f3298105320 2026-02-20T03:30:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f3294ff9640 1 -- 10.20.193.28:0/3047468891 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288042710 con 0x7f3298105320 2026-02-20T03:30:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32981a2390 con 0x7f3298105320 2026-02-20T03:30:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.764+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32981a9c30 con 0x7f3298105320 2026-02-20T03:30:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.765+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3298104de0 con 0x7f3298105320 2026-02-20T03:30:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.767+0000 7f3294ff9640 1 -- 10.20.193.28:0/3047468891 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3288004240 con 0x7f3298105320 2026-02-20T03:30:12.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.769+0000 7f3294ff9640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f326c0b0e20 0x7f326c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:12.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.769+0000 7f3294ff9640 1 -- 10.20.193.28:0/3047468891 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f3288105200 con 0x7f3298105320 2026-02-20T03:30:12.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.769+0000 7f32977fe640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f326c0b0e20 0x7f326c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:12.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.769+0000 7f3294ff9640 1 -- 10.20.193.28:0/3047468891 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f3288047060 con 0x7f3298105320 2026-02-20T03:30:12.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.769+0000 7f32977fe640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f326c0b0e20 0x7f326c0b32e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3284005fd0 tx=0x7f32840074e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:12.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.877+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f329810ca10 con 0x7f3298105320 2026-02-20T03:30:12.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.877+0000 7f3294ff9640 1 -- 10.20.193.28:0/3047468891 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11925 (secure 0 0 0) 0x7f32880e5eb0 con 0x7f3298105320 2026-02-20T03:30:12.881 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:30:12.882 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 37 2026-02-20T03:30:12.882 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":37,"btime":"2026-02-20T03:29:33:388547+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":37,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:29:33.388504+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28057":{"gid":28057,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/2019777772","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":2019777772},{"type":"v1","addr":"10.20.193.177:6837","nonce":2019777772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:30:12.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.878+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f326c0b0e20 msgr2=0x7f326c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.878+0000 7f329c894640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f326c0b0e20 0x7f326c0b32e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3284005fd0 tx=0x7f32840074e0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.878+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298105320 msgr2=0x7f329819d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:12.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.878+0000 7f329c894640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298105320 0x7f329819d5f0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f3288009a60 tx=0x7f328802fca0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.879+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 shutdown_connections 2026-02-20T03:30:12.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.879+0000 7f329c894640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f326c0b0e20 0x7f326c0b32e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.879+0000 7f329c894640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f329810a980 0x7f32981a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.879+0000 7f329c894640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3298105320 0x7f329819d5f0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.879+0000 7f329c894640 1 --2- 10.20.193.28:0/3047468891 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3298104980 0x7f329819d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:12.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.879+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 >> 10.20.193.28:0/3047468891 conn(0x7f3298100680 msgr2=0x7f3298100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:12.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.879+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 shutdown_connections 2026-02-20T03:30:12.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:12.879+0000 7f329c894640 1 -- 10.20.193.28:0/3047468891 wait complete. 2026-02-20T03:30:12.980 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id 189aa5bc --release --await' 2026-02-20T03:30:12.981 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id 189aa5bc --release --await 2026-02-20T03:30:13.247 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:13.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.427+0000 7f0977fff640 1 -- 10.20.193.28:0/176764945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0978104980 msgr2=0x7f0978104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:13.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.427+0000 7f0977fff640 1 --2- 10.20.193.28:0/176764945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0978104980 0x7f0978104de0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f0960009990 tx=0x7f096002f170 comp rx=0 tx=0).stop 2026-02-20T03:30:13.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.427+0000 7f0977fff640 1 -- 10.20.193.28:0/176764945 shutdown_connections 2026-02-20T03:30:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.427+0000 7f0977fff640 1 --2- 10.20.193.28:0/176764945 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0978105320 0x7f0978111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.427+0000 7f0977fff640 1 --2- 10.20.193.28:0/176764945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0978104980 0x7f0978104de0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.427+0000 7f0977fff640 1 --2- 10.20.193.28:0/176764945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f097810a980 0x7f097810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.427+0000 7f0977fff640 1 -- 10.20.193.28:0/176764945 >> 10.20.193.28:0/176764945 conn(0x7f0978100680 msgr2=0x7f0978102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.427+0000 7f0977fff640 1 -- 10.20.193.28:0/176764945 shutdown_connections 2026-02-20T03:30:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.427+0000 7f0977fff640 1 -- 10.20.193.28:0/176764945 wait complete. 2026-02-20T03:30:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0977fff640 1 Processor -- start 2026-02-20T03:30:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0977fff640 1 -- start start 2026-02-20T03:30:13.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0977fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0978104980 0x7f097819d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0977fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0978105320 0x7f097819d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0977fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f097810a980 0x7f09781a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0977fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0978114bb0 con 0x7f097810a980 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0977fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0978114a30 con 0x7f0978104980 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0977fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0978114d30 con 0x7f0978105320 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0976ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0978104980 0x7f097819d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f09767fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0978105320 0x7f097819d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f09767fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0978105320 0x7f097819d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56042/0 (socket says 10.20.193.28:56042) 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f0976ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0978104980 0x7f097819d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:40186/0 (socket says 10.20.193.28:40186) 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f09767fc640 1 -- 10.20.193.28:0/1424767593 learned_addr learned my addr 10.20.193.28:0/1424767593 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f09777fe640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f097810a980 0x7f09781a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f09767fc640 1 -- 10.20.193.28:0/1424767593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0978104980 msgr2=0x7f097819d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f09767fc640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0978104980 0x7f097819d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.428+0000 7f09767fc640 1 -- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f097810a980 msgr2=0x7f09781a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f09767fc640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f097810a980 0x7f09781a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f09767fc640 1 -- 10.20.193.28:0/1424767593 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09781a2100 con 0x7f0978105320 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f0976ffd640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0978104980 0x7f097819d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f09777fe640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f097810a980 0x7f09781a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:30:13.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f09767fc640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0978105320 0x7f097819d5f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f09600386a0 tx=0x7f0960004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:13.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f0957fff640 1 -- 10.20.193.28:0/1424767593 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600047c0 con 0x7f0978105320 2026-02-20T03:30:13.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f0957fff640 1 -- 10.20.193.28:0/1424767593 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0960004e00 con 0x7f0978105320 2026-02-20T03:30:13.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f0977fff640 1 -- 10.20.193.28:0/1424767593 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09781a2390 con 0x7f0978105320 2026-02-20T03:30:13.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f0957fff640 1 -- 10.20.193.28:0/1424767593 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960005320 con 0x7f0978105320 2026-02-20T03:30:13.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.429+0000 7f0977fff640 1 -- 10.20.193.28:0/1424767593 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09781a9c30 con 0x7f0978105320 2026-02-20T03:30:13.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.432+0000 7f0957fff640 1 -- 10.20.193.28:0/1424767593 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0960038a70 con 0x7f0978105320 2026-02-20T03:30:13.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.432+0000 7f097fb21e00 1 Processor -- start 2026-02-20T03:30:13.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.432+0000 7f097fb21e00 1 -- start start 2026-02-20T03:30:13.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3cbb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3cbc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cc72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f097fb21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5650d3c0da20 con 0x5650d3cbc8e0 2026-02-20T03:30:13.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f097fb21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5650d3bbb2a0 con 0x5650d3cbbf60 2026-02-20T03:30:13.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f097fb21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5650d3c09950 con 0x5650d3cbadd0 2026-02-20T03:30:13.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09767fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cc72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09777fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3cbb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f0976ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3cbc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09767fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cc72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37982/0 (socket says 10.20.193.28:37982) 2026-02-20T03:30:13.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09767fc640 1 -- 10.20.193.28:0/1514689510 learned_addr learned my addr 10.20.193.28:0/1514689510 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:13.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09767fc640 1 -- 10.20.193.28:0/1514689510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 msgr2=0x5650d3cbb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:13.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09767fc640 1 --2- 10.20.193.28:0/1514689510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3cbb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09767fc640 1 -- 10.20.193.28:0/1514689510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 msgr2=0x5650d3cbc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:13.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09767fc640 1 --2- 10.20.193.28:0/1514689510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3cbc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09767fc640 1 -- 10.20.193.28:0/1514689510 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650d3b9e0f0 con 0x5650d3cbc8e0 2026-02-20T03:30:13.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.433+0000 7f09777fe640 1 --2- 10.20.193.28:0/1514689510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3cbb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:30:13.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f09767fc640 1 --2- 10.20.193.28:0/1514689510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cc72d0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f096010b470 tx=0x7f096010b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1ba74650982fdc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f0957fff640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f094c0b0da0 0x7f094c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f09437fe640 1 -- 10.20.193.28:0/1514689510 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600c95d0 con 0x5650d3cbc8e0 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f09437fe640 1 -- 10.20.193.28:0/1514689510 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0960112070 con 0x5650d3cbc8e0 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f09437fe640 1 -- 10.20.193.28:0/1514689510 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600ccac0 con 0x5650d3cbc8e0 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f0957fff640 1 -- 10.20.193.28:0/1424767593 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f0960105490 con 0x7f0978105320 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f097fb21e00 1 -- 10.20.193.28:0/1514689510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 msgr2=0x5650d3cc72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1514689510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cc72d0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f096010b470 tx=0x7f096010b940 comp rx=0 tx=0).stop 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f09777fe640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f094c0b0da0 0x7f094c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f097fb21e00 1 -- 10.20.193.28:0/1514689510 shutdown_connections 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1514689510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cc72d0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1514689510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3cbc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1514689510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3cbb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f097fb21e00 1 -- 10.20.193.28:0/1514689510 >> 10.20.193.28:0/1514689510 conn(0x5650d3cb21b0 msgr2=0x5650d3cb9030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.434+0000 7f097fb21e00 1 -- 10.20.193.28:0/1514689510 shutdown_connections 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.435+0000 7f097fb21e00 1 -- 10.20.193.28:0/1514689510 wait complete. 2026-02-20T03:30:13.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.435+0000 7f09777fe640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f094c0b0da0 0x7f094c0b3260 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0968009230 tx=0x7f096800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:13.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f097fb21e00 1 -- start start 2026-02-20T03:30:13.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f097fb21e00 1 Processor -- start 2026-02-20T03:30:13.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3cd4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3cd51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cd33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f097fb21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5650d3bb5080 con 0x5650d3cbc8e0 2026-02-20T03:30:13.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f097fb21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5650d3cc7810 con 0x5650d3cbbf60 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f097fb21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5650d3cd3930 con 0x5650d3cbadd0 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f09777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cd33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f09777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cd33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37990/0 (socket says 10.20.193.28:37990) 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.436+0000 7f09777fe640 1 -- 10.20.193.28:0/3544448599 learned_addr learned my addr 10.20.193.28:0/3544448599 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f09767fc640 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3cd51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f09777fe640 1 -- 10.20.193.28:0/3544448599 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 msgr2=0x5650d3cd4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f0976ffd640 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3cd4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f09777fe640 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3cd4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f09777fe640 1 -- 10.20.193.28:0/3544448599 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 msgr2=0x5650d3cd51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f09777fe640 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3cd51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f09777fe640 1 -- 10.20.193.28:0/3544448599 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650d3cccbe0 con 0x5650d3cbc8e0 2026-02-20T03:30:13.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f09777fe640 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cd33a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f0968016e50 tx=0x7f0968004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345866175dcc4249 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:13.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f0940ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:13.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f0940ff9640 1 -- 10.20.193.28:0/3544448599 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0968025020 con 0x5650d3cbc8e0 2026-02-20T03:30:13.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f0940ff9640 1 -- 10.20.193.28:0/3544448599 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f096801a030 con 0x5650d3cbc8e0 2026-02-20T03:30:13.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f0940ff9640 1 -- 10.20.193.28:0/3544448599 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09680207c0 con 0x5650d3cbc8e0 2026-02-20T03:30:13.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f097fb21e00 1 -- 10.20.193.28:0/3544448599 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650d39deda0 con 0x5650d3cbc8e0 2026-02-20T03:30:13.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f0940ff9640 1 -- 10.20.193.28:0/3544448599 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f0968021440 con 0x5650d3cbc8e0 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f097fb21e00 10 client.19755 _ll_register_callbacks cb 0x5650d3bb8fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.437+0000 7f097fb21e00 1 -- 10.20.193.28:0/3544448599 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5650d3c15610 con 0x5650d3cbc8e0 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f0940ff9640 1 -- 10.20.193.28:0/3544448599 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0968020960 con 0x5650d3cbc8e0 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f097fb21e00 10 client.19755 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f097fb21e00 1 -- 10.20.193.28:0/3544448599 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x5650d3bcb020 con 0x5650d3cbc8e0 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f0940ff9640 1 -- 10.20.193.28:0/3544448599 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f0968020b00 con 0x5650d3cbc8e0 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f097fb21e00 10 client.19755 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f097fb21e00 10 client.19755 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f097fb21e00 20 client.19755 populate_metadata read hostname 'trial028' 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5650d3ce33d0 0x5650d3ce5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f097fb21e00 4 client.19755 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f097fb21e00 1 -- 10.20.193.28:0/3544448599 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650d3b8fb80 con 0x5650d3ce33d0 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.438+0000 7f0976ffd640 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5650d3ce33d0 0x5650d3ce5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f0976ffd640 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5650d3ce33d0 0x5650d3ce5890 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e337b98c321201ac server_cookie=7f7592e102276306 in_seq=0 out_seq=0 2026-02-20T03:30:13.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f0940ff9640 10 client.19755 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:13.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f0940ff9640 1 -- 10.20.193.28:0/3544448599 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5650d3b8fb80 con 0x5650d3ce33d0 2026-02-20T03:30:13.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f0940ff9640 10 client.19755 handle_command_reply: tid=0 2026-02-20T03:30:13.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f097fb21e00 1 client.19755 shutdown 2026-02-20T03:30:13.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f097fb21e00 1 -- 10.20.193.28:0/3544448599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 msgr2=0x5650d3cd33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:13.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cd33a0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f0968016e50 tx=0x7f0968004bb0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f097fb21e00 1 -- 10.20.193.28:0/3544448599 shutdown_connections 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5650d3ce33d0 0x5650d3ce5890 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbc8e0 0x5650d3cd33a0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3cd51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.439+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3544448599 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3cd4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.440+0000 7f097fb21e00 1 -- 10.20.193.28:0/3544448599 >> 10.20.193.28:0/3544448599 conn(0x5650d3cb21b0 msgr2=0x5650d3cbf080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.440+0000 7f0940ff9640 0 client.19755 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.440+0000 7f097fb21e00 1 -- 10.20.193.28:0/3544448599 shutdown_connections 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.440+0000 7f097fb21e00 1 -- 10.20.193.28:0/3544448599 wait complete. 2026-02-20T03:30:13.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.440+0000 7f097fb21e00 20 client.19755 trim_cache size 0 max 16384 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.449+0000 7f097fb21e00 1 Processor -- start 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.449+0000 7f097fb21e00 1 -- start start 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.449+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3ceb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.449+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbbf60 0x5650d3ceb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.449+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbc8e0 0x5650d3cdaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.449+0000 7f097fb21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f091c012750 con 0x5650d3cbbf60 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.449+0000 7f097fb21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f091c00ffc0 con 0x5650d3cbc8e0 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.449+0000 7f097fb21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f091c00de10 con 0x5650d3cbadd0 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f0976ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3ceb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f09767fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbbf60 0x5650d3ceb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f09777fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbc8e0 0x5650d3cdaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f0976ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3ceb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56066/0 (socket says 10.20.193.28:56066) 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f0976ffd640 1 -- 10.20.193.28:0/3401324754 learned_addr learned my addr 10.20.193.28:0/3401324754 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f09767fc640 1 -- 10.20.193.28:0/3401324754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 msgr2=0x5650d3ceb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f09767fc640 1 --2- 10.20.193.28:0/3401324754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3ceb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f09767fc640 1 -- 10.20.193.28:0/3401324754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbc8e0 msgr2=0x5650d3cdaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f09767fc640 1 --2- 10.20.193.28:0/3401324754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbc8e0 0x5650d3cdaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f09767fc640 1 -- 10.20.193.28:0/3401324754 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650d3cd5340 con 0x5650d3cbbf60 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f09777fe640 1 --2- 10.20.193.28:0/3401324754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbc8e0 0x5650d3cdaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f09767fc640 1 --2- 10.20.193.28:0/3401324754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbbf60 0x5650d3ceb6e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f096010b470 tx=0x7f0960038e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51be52b6058ec29 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f0942ffd640 1 -- 10.20.193.28:0/3401324754 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600ccd10 con 0x5650d3cbbf60 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f0942ffd640 1 -- 10.20.193.28:0/3401324754 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0960033030 con 0x5650d3cbbf60 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f0942ffd640 1 -- 10.20.193.28:0/3401324754 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09600ccfa0 con 0x5650d3cbbf60 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f097fb21e00 1 -- 10.20.193.28:0/3401324754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbbf60 msgr2=0x5650d3ceb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.450+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3401324754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbbf60 0x5650d3ceb6e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f096010b470 tx=0x7f0960038e10 comp rx=0 tx=0).stop 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.451+0000 7f097fb21e00 1 -- 10.20.193.28:0/3401324754 shutdown_connections 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.451+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3401324754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbc8e0 0x5650d3cdaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.451+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3401324754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbbf60 0x5650d3ceb6e0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.451+0000 7f097fb21e00 1 --2- 10.20.193.28:0/3401324754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbadd0 0x5650d3ceb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.451+0000 7f097fb21e00 1 -- 10.20.193.28:0/3401324754 >> 10.20.193.28:0/3401324754 conn(0x5650d3cb21b0 msgr2=0x5650d3ce53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.451+0000 7f097fb21e00 1 -- 10.20.193.28:0/3401324754 shutdown_connections 2026-02-20T03:30:13.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.451+0000 7f097fb21e00 1 -- 10.20.193.28:0/3401324754 wait complete. 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.451+0000 7f097fb21e00 1 -- start start 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.451+0000 7f097fb21e00 1 Processor -- start 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbadd0 0x5650d3d47900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3d47e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f097fb21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbc8e0 0x5650d3cda490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f097fb21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f091c00e480 con 0x5650d3cbadd0 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f097fb21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f091c00f8f0 con 0x5650d3cbbf60 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f097fb21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f091c00eb50 con 0x5650d3cbc8e0 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0976ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbadd0 0x5650d3d47900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0976ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbadd0 0x5650d3d47900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38010/0 (socket says 10.20.193.28:38010) 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0976ffd640 1 -- 10.20.193.28:0/1269741704 learned_addr learned my addr 10.20.193.28:0/1269741704 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f09777fe640 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbc8e0 0x5650d3cda490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f09767fc640 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3d47e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0976ffd640 1 -- 10.20.193.28:0/1269741704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbc8e0 msgr2=0x5650d3cda490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:13.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0976ffd640 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbc8e0 0x5650d3cda490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0976ffd640 1 -- 10.20.193.28:0/1269741704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 msgr2=0x5650d3d47e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0976ffd640 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3d47e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0976ffd640 1 -- 10.20.193.28:0/1269741704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650d3ccca10 con 0x5650d3cbadd0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0976ffd640 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbadd0 0x5650d3d47900 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f096c009a70 tx=0x7f096c009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931ce7ee510c78e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0940ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0940ff9640 1 -- 10.20.193.28:0/1269741704 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c012860 con 0x5650d3cbadd0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0940ff9640 1 -- 10.20.193.28:0/1269741704 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f096c003ea0 con 0x5650d3cbadd0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.452+0000 7f0940ff9640 1 -- 10.20.193.28:0/1269741704 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c011e60 con 0x5650d3cbadd0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 1 -- 10.20.193.28:0/1269741704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650d38ecad0 con 0x5650d3cbadd0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f0940ff9640 1 -- 10.20.193.28:0/1269741704 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f096c00f430 con 0x5650d3cbadd0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 10 client.19761 _ll_register_callbacks cb 0x7f0968016b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 1 -- 10.20.193.28:0/1269741704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0960112070 con 0x5650d3cbadd0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f0940ff9640 1 -- 10.20.193.28:0/1269741704 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f096c011560 con 0x5650d3cbadd0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 10 client.19761 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 1 -- 10.20.193.28:0/1269741704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x5650d3b94370 con 0x5650d3cbadd0 2026-02-20T03:30:13.455 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f0940ff9640 1 -- 10.20.193.28:0/1269741704 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f096c023070 con 0x5650d3cbadd0 2026-02-20T03:30:13.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 10 client.19761 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:13.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 10 client.19761 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:30:13.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 20 client.19761 populate_metadata read hostname 'trial028' 2026-02-20T03:30:13.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5650d3d504b0 0x5650d3d52970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:13.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 4 client.19761 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "189aa5bc", "release": true, "await": true}] 2026-02-20T03:30:13.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f097fb21e00 1 -- 10.20.193.28:0/1269741704 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "189aa5bc", "release": true, "await": true}) -- 0x5650d398e480 con 0x5650d3d504b0 2026-02-20T03:30:13.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.453+0000 7f09767fc640 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5650d3d504b0 0x5650d3d52970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:13.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.454+0000 7f0940ff9640 10 client.19761 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:13.456 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.454+0000 7f09767fc640 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5650d3d504b0 0x5650d3d52970 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95415a439648c68 server_cookie=1528afcd6fb95142 in_seq=0 out_seq=0 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.478+0000 7f0940ff9640 1 -- 10.20.193.28:0/1269741704 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5650d398e480 con 0x5650d3d504b0 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.478+0000 7f0940ff9640 10 client.19761 handle_command_reply: tid=0 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.478+0000 7f097fb21e00 1 client.19761 shutdown 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.478+0000 7f097fb21e00 1 -- 10.20.193.28:0/1269741704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbadd0 msgr2=0x5650d3d47900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.478+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbadd0 0x5650d3d47900 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f096c009a70 tx=0x7f096c009f40 comp rx=0 tx=0).stop 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f097fb21e00 1 -- 10.20.193.28:0/1269741704 shutdown_connections 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5650d3d504b0 0x5650d3d52970 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5650d3cbc8e0 0x5650d3cda490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5650d3cbbf60 0x5650d3d47e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f097fb21e00 1 --2- 10.20.193.28:0/1269741704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5650d3cbadd0 0x5650d3d47900 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f097fb21e00 1 -- 10.20.193.28:0/1269741704 >> 10.20.193.28:0/1269741704 conn(0x5650d3cb21b0 msgr2=0x5650d3cc0040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f0940ff9640 0 client.19761 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f097fb21e00 1 -- 10.20.193.28:0/1269741704 shutdown_connections 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f097fb21e00 1 -- 10.20.193.28:0/1269741704 wait complete. 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.479+0000 7f097fb21e00 20 client.19761 trim_cache size 0 max 16384 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 37, 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 48, 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "189aa5bc": { 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "version": 48, 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 141.5, 2026-02-20T03:30:13.482 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RELEASED", 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 -- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f094c0b0da0 msgr2=0x7f094c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f094c0b0da0 0x7f094c0b3260 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0968009230 tx=0x7f096800b040 comp rx=0 tx=0).stop 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 -- 10.20.193.28:0/1424767593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0978105320 msgr2=0x7f097819d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0978105320 0x7f097819d5f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f09600386a0 tx=0x7f0960004270 comp rx=0 tx=0).stop 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 -- 10.20.193.28:0/1424767593 shutdown_connections 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f094c0b0da0 0x7f094c0b3260 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f097810a980 0x7f09781a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0978105320 0x7f097819d5f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 --2- 10.20.193.28:0/1424767593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0978104980 0x7f097819d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 -- 10.20.193.28:0/1424767593 >> 10.20.193.28:0/1424767593 conn(0x7f0978100680 msgr2=0x7f0978100fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 -- 10.20.193.28:0/1424767593 shutdown_connections 2026-02-20T03:30:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:13.480+0000 7f0977fff640 1 -- 10.20.193.28:0/1424767593 wait complete. 2026-02-20T03:30:13.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:13 trial028 ceph-mon[38552]: pgmap v650: 129 pgs: 129 active+clean; 397 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 9.2 KiB/s wr, 131 op/s 2026-02-20T03:30:13.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:13 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:30:13.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:13 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:30:13.548 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:13 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:30:13.549 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:13 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3047468891' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:13.591 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '189aa5bc', total seconds elapsed: 63.1 2026-02-20T03:30:13.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 33877 19.20 MB/sec warmup 104 sec latency 69508.721 ms 2026-02-20T03:30:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:13 trial177 ceph-mon[43181]: pgmap v650: 129 pgs: 129 active+clean; 397 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 9.2 KiB/s wr, 131 op/s 2026-02-20T03:30:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:13 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:30:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:13 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:30:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:13 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:30:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:13 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3047468891' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:13 trial126 ceph-mon[38476]: pgmap v650: 129 pgs: 129 active+clean; 397 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 9.2 KiB/s wr, 131 op/s 2026-02-20T03:30:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:13 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:30:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:13 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:30:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:13 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:30:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:13 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3047468891' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:14.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 36150 20.32 MB/sec warmup 105 sec latency 27.320 ms 2026-02-20T03:30:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:15 trial028 ceph-mon[38552]: pgmap v651: 129 pgs: 129 active+clean; 392 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 680 KiB/s rd, 276 KiB/s wr, 189 op/s 2026-02-20T03:30:15.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 37384 20.63 MB/sec warmup 106 sec latency 31.621 ms 2026-02-20T03:30:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:15 trial177 ceph-mon[43181]: pgmap v651: 129 pgs: 129 active+clean; 392 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 680 KiB/s rd, 276 KiB/s wr, 189 op/s 2026-02-20T03:30:15.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:15 trial126 ceph-mon[38476]: pgmap v651: 129 pgs: 129 active+clean; 392 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 680 KiB/s rd, 276 KiB/s wr, 189 op/s 2026-02-20T03:30:16.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 39546 21.63 MB/sec warmup 107 sec latency 32.319 ms 2026-02-20T03:30:17.565 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:17 trial028 ceph-mon[38552]: pgmap v652: 129 pgs: 129 active+clean; 390 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 594 KiB/s wr, 231 op/s 2026-02-20T03:30:17.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 40817 21.94 MB/sec warmup 108 sec latency 31.197 ms 2026-02-20T03:30:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:17 trial177 ceph-mon[43181]: pgmap v652: 129 pgs: 129 active+clean; 390 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 594 KiB/s wr, 231 op/s 2026-02-20T03:30:17.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:17 trial126 ceph-mon[38476]: pgmap v652: 129 pgs: 129 active+clean; 390 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 MiB/s rd, 594 KiB/s wr, 231 op/s 2026-02-20T03:30:18.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 42657 22.74 MB/sec warmup 109 sec latency 37.432 ms 2026-02-20T03:30:19.515 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:19 trial028 ceph-mon[38552]: pgmap v653: 129 pgs: 129 active+clean; 403 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 2.0 MiB/s wr, 393 op/s 2026-02-20T03:30:19.698 INFO:tasks.workunit.client.0.trial028.stdout: 10 44159 23.20 MB/sec warmup 110 sec latency 36.079 ms 2026-02-20T03:30:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:19 trial177 ceph-mon[43181]: pgmap v653: 129 pgs: 129 active+clean; 403 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 2.0 MiB/s wr, 393 op/s 2026-02-20T03:30:19.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:19 trial126 ceph-mon[38476]: pgmap v653: 129 pgs: 129 active+clean; 403 MiB data, 5.5 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 2.0 MiB/s wr, 393 op/s 2026-02-20T03:30:20.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 46394 24.14 MB/sec warmup 111 sec latency 24.754 ms 2026-02-20T03:30:21.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 47754 24.55 MB/sec warmup 112 sec latency 48.117 ms 2026-02-20T03:30:21.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:21 trial177 ceph-mon[43181]: pgmap v654: 129 pgs: 129 active+clean; 426 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 4.8 MiB/s wr, 667 op/s 2026-02-20T03:30:21.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:21 trial126 ceph-mon[38476]: pgmap v654: 129 pgs: 129 active+clean; 426 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 4.8 MiB/s wr, 667 op/s 2026-02-20T03:30:21.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:21 trial028 ceph-mon[38552]: pgmap v654: 129 pgs: 129 active+clean; 426 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 4.8 MiB/s wr, 667 op/s 2026-02-20T03:30:22.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 49608 25.22 MB/sec warmup 113 sec latency 33.766 ms 2026-02-20T03:30:23.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 51427 25.85 MB/sec warmup 114 sec latency 34.022 ms 2026-02-20T03:30:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:23 trial177 ceph-mon[43181]: pgmap v655: 129 pgs: 129 active+clean; 429 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 5.3 MiB/s wr, 661 op/s 2026-02-20T03:30:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:23 trial126 ceph-mon[38476]: pgmap v655: 129 pgs: 129 active+clean; 429 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 5.3 MiB/s wr, 661 op/s 2026-02-20T03:30:23.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:23 trial028 ceph-mon[38552]: pgmap v655: 129 pgs: 129 active+clean; 429 MiB data, 5.6 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 5.3 MiB/s wr, 661 op/s 2026-02-20T03:30:24.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 53038 26.41 MB/sec warmup 115 sec latency 29.599 ms 2026-02-20T03:30:25.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.284+0000 7f74fce61640 1 -- 10.20.193.28:0/1589385490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109490 msgr2=0x7f74f8109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:25.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.284+0000 7f74fce61640 1 --2- 10.20.193.28:0/1589385490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109490 0x7f74f8109890 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f74e400b0a0 tx=0x7f74e402f430 comp rx=0 tx=0).stop 2026-02-20T03:30:25.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.284+0000 7f74fce61640 1 -- 10.20.193.28:0/1589385490 shutdown_connections 2026-02-20T03:30:25.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.284+0000 7f74fce61640 1 --2- 10.20.193.28:0/1589385490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74f810a900 0x7f74f8111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.284+0000 7f74fce61640 1 --2- 10.20.193.28:0/1589385490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74f8109e60 0x7f74f810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.284+0000 7f74fce61640 1 --2- 10.20.193.28:0/1589385490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109490 0x7f74f8109890 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.284+0000 7f74fce61640 1 -- 10.20.193.28:0/1589385490 >> 10.20.193.28:0/1589385490 conn(0x7f74f8077fe0 msgr2=0x7f74f807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:25.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.284+0000 7f74fce61640 1 -- 10.20.193.28:0/1589385490 shutdown_connections 2026-02-20T03:30:25.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.285+0000 7f74fce61640 1 -- 10.20.193.28:0/1589385490 wait complete. 2026-02-20T03:30:25.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.285+0000 7f74fce61640 1 Processor -- start 2026-02-20T03:30:25.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.285+0000 7f74fce61640 1 -- start start 2026-02-20T03:30:25.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74fce61640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74f8109490 0x7f74f81a0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74fce61640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109e60 0x7f74f81a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74fce61640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74f810a900 0x7f74f81a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74fce61640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8114940 con 0x7f74f810a900 2026-02-20T03:30:25.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74fce61640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f74f81147c0 con 0x7f74f8109e60 2026-02-20T03:30:25.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74fce61640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f74f8114ac0 con 0x7f74f8109490 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109e60 0x7f74f81a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109e60 0x7f74f81a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59366/0 (socket says 10.20.193.28:59366) 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f6ffd640 1 -- 10.20.193.28:0/3618695182 learned_addr learned my addr 10.20.193.28:0/3618695182 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f77fe640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74f8109490 0x7f74f81a0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f7fff640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74f810a900 0x7f74f81a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f77fe640 1 -- 10.20.193.28:0/3618695182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109e60 msgr2=0x7f74f81a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f77fe640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109e60 0x7f74f81a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f77fe640 1 -- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74f810a900 msgr2=0x7f74f81a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f77fe640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74f810a900 0x7f74f81a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f77fe640 1 -- 10.20.193.28:0/3618695182 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f81a8bf0 con 0x7f74f8109490 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.286+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109e60 0x7f74f81a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:30:25.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.287+0000 7f74f77fe640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74f8109490 0x7f74f81a0f40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74e4032040 tx=0x7f74e4006260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:25.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.287+0000 7f74f4ff9640 1 -- 10.20.193.28:0/3618695182 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4002c60 con 0x7f74f8109490 2026-02-20T03:30:25.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.287+0000 7f74f4ff9640 1 -- 10.20.193.28:0/3618695182 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74e4002e00 con 0x7f74f8109490 2026-02-20T03:30:25.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.287+0000 7f74fce61640 1 -- 10.20.193.28:0/3618695182 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f81a8e80 con 0x7f74f8109490 2026-02-20T03:30:25.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.287+0000 7f74f4ff9640 1 -- 10.20.193.28:0/3618695182 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e40388a0 con 0x7f74f8109490 2026-02-20T03:30:25.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.287+0000 7f74fce61640 1 -- 10.20.193.28:0/3618695182 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f81a9280 con 0x7f74f8109490 2026-02-20T03:30:25.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.290+0000 7f74f4ff9640 1 -- 10.20.193.28:0/3618695182 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f74e4038a40 con 0x7f74f8109490 2026-02-20T03:30:25.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f7501022e00 1 Processor -- start 2026-02-20T03:30:25.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f7501022e00 1 -- start start 2026-02-20T03:30:25.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f7501022e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f7501022e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0c7c0 0x55c541a10f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f7501022e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 0x55c541a139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f7501022e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c54195c8f0 con 0x55c541a0c7c0 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f7501022e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c54190a2e0 con 0x55c541a11560 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f7501022e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c541958820 con 0x55c541a0be80 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f74f7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f74f7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56208/0 (socket says 10.20.193.28:56208) 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f74f7fff640 1 -- 10.20.193.28:0/3433158088 learned_addr learned my addr 10.20.193.28:0/3433158088 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 0x55c541a139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f74f7fff640 1 -- 10.20.193.28:0/3433158088 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 msgr2=0x55c541a139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:25.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f74f7fff640 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 0x55c541a139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.291+0000 7f74f7fff640 1 -- 10.20.193.28:0/3433158088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0c7c0 msgr2=0x55c541a10f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:25.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.292+0000 7f74f77fe640 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0c7c0 0x55c541a10f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.292+0000 7f74f7fff640 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0c7c0 0x55c541a10f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.292+0000 7f74f7fff640 1 -- 10.20.193.28:0/3433158088 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5418fc5a0 con 0x55c541a0be80 2026-02-20T03:30:25.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.292+0000 7f74f77fe640 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0c7c0 0x55c541a10f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:30:25.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.292+0000 7f74f7fff640 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0c280 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f74ec002760 tx=0x7f74ec002c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a689c13121b0a32e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:25.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.292+0000 7f74bbfff640 1 -- 10.20.193.28:0/3433158088 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec016020 con 0x55c541a0be80 2026-02-20T03:30:25.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.292+0000 7f74f4ff9640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74cc0b0e20 0x7f74cc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.293+0000 7f74bbfff640 1 -- 10.20.193.28:0/3433158088 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74ec009bb0 con 0x55c541a0be80 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.293+0000 7f74bbfff640 1 -- 10.20.193.28:0/3433158088 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0115b0 con 0x55c541a0be80 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.293+0000 7f74f4ff9640 1 -- 10.20.193.28:0/3618695182 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f74e41054d0 con 0x7f74f8109490 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.293+0000 7f74f77fe640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74cc0b0e20 0x7f74cc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.293+0000 7f7501022e00 1 -- 10.20.193.28:0/3433158088 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 msgr2=0x55c541a0c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.293+0000 7f7501022e00 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0c280 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f74ec002760 tx=0x7f74ec002c30 comp rx=0 tx=0).stop 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.294+0000 7f74f77fe640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74cc0b0e20 0x7f74cc0b32e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f74e40cd140 tx=0x7f74e40099e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.294+0000 7f7501022e00 1 -- 10.20.193.28:0/3433158088 shutdown_connections 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.294+0000 7f7501022e00 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 0x55c541a139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.294+0000 7f7501022e00 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0c7c0 0x55c541a10f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.294+0000 7f7501022e00 1 --2- 10.20.193.28:0/3433158088 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0c280 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.294+0000 7f7501022e00 1 -- 10.20.193.28:0/3433158088 >> 10.20.193.28:0/3433158088 conn(0x55c541a036f0 msgr2=0x55c541a0a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:25.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.294+0000 7f7501022e00 1 -- 10.20.193.28:0/3433158088 shutdown_connections 2026-02-20T03:30:25.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.294+0000 7f7501022e00 1 -- 10.20.193.28:0/3433158088 wait complete. 2026-02-20T03:30:25.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.296+0000 7f7501022e00 1 -- start start 2026-02-20T03:30:25.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.296+0000 7f7501022e00 1 Processor -- start 2026-02-20T03:30:25.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.296+0000 7f7501022e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0be80 0x55c541a24960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.296+0000 7f7501022e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a24ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.296+0000 7f7501022e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 0x55c541a2bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.296+0000 7f7501022e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c5419040c0 con 0x55c541a0be80 2026-02-20T03:30:25.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.296+0000 7f7501022e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c541a14610 con 0x55c541a11560 2026-02-20T03:30:25.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.296+0000 7f7501022e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c541a2c2b0 con 0x55c541a0c7c0 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a24ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0be80 0x55c541a24960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a24ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:56214/0 (socket says 10.20.193.28:56214) 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f6ffd640 1 -- 10.20.193.28:0/4167164064 learned_addr learned my addr 10.20.193.28:0/4167164064 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f7fff640 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 0x55c541a2bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f7fff640 1 -- 10.20.193.28:0/4167164064 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 msgr2=0x55c541a24ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f7fff640 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a24ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f7fff640 1 -- 10.20.193.28:0/4167164064 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 msgr2=0x55c541a2bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f7fff640 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 0x55c541a2bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f7fff640 1 -- 10.20.193.28:0/4167164064 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c541a1e090 con 0x55c541a0be80 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74f7fff640 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0be80 0x55c541a24960 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f74ec002760 tx=0x7f74ec0048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1db20c0eb1db2f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:25.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.297+0000 7f74b97fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:25.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.298+0000 7f74b97fa640 1 -- 10.20.193.28:0/4167164064 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec016040 con 0x55c541a0be80 2026-02-20T03:30:25.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.298+0000 7f7501022e00 1 -- 10.20.193.28:0/4167164064 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c541918820 con 0x55c541a0be80 2026-02-20T03:30:25.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.298+0000 7f7501022e00 10 client.19767 _ll_register_callbacks cb 0x55c541907ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:25.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.298+0000 7f7501022e00 1 -- 10.20.193.28:0/4167164064 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c5419644e0 con 0x55c541a0be80 2026-02-20T03:30:25.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.298+0000 7f74b97fa640 1 -- 10.20.193.28:0/4167164064 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74ec01dcf0 con 0x55c541a0be80 2026-02-20T03:30:25.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.298+0000 7f74b97fa640 1 -- 10.20.193.28:0/4167164064 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec01bb00 con 0x55c541a0be80 2026-02-20T03:30:25.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.298+0000 7f74b97fa640 1 -- 10.20.193.28:0/4167164064 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f74ec01b450 con 0x55c541a0be80 2026-02-20T03:30:25.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.298+0000 7f74b97fa640 1 -- 10.20.193.28:0/4167164064 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f74ec01d850 con 0x55c541a0be80 2026-02-20T03:30:25.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.299+0000 7f7501022e00 10 client.19767 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:25.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.299+0000 7f7501022e00 1 -- 10.20.193.28:0/4167164064 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55c54191d380 con 0x55c541a0be80 2026-02-20T03:30:25.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.299+0000 7f74b97fa640 1 -- 10.20.193.28:0/4167164064 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f74ec02d400 con 0x55c541a0be80 2026-02-20T03:30:25.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.299+0000 7f7501022e00 10 client.19767 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:25.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.299+0000 7f7501022e00 10 client.19767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.299+0000 7f7501022e00 20 client.19767 populate_metadata read hostname 'trial028' 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.299+0000 7f7501022e00 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c541a302b0 0x55c541a326a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.299+0000 7f7501022e00 4 client.19767 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.299+0000 7f7501022e00 1 -- 10.20.193.28:0/4167164064 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5418debd0 con 0x55c541a302b0 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.300+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c541a302b0 0x55c541a326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.300+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c541a302b0 0x55c541a326a0 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2debe33f7b79e142 server_cookie=be095de4b9c42351 in_seq=0 out_seq=0 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.300+0000 7f74b97fa640 10 client.19767 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f74b97fa640 1 -- 10.20.193.28:0/4167164064 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c5418debd0 con 0x55c541a302b0 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f74b97fa640 10 client.19767 handle_command_reply: tid=0 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 client.19767 shutdown 2026-02-20T03:30:25.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 -- 10.20.193.28:0/4167164064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0be80 msgr2=0x55c541a24960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0be80 0x55c541a24960 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f74ec002760 tx=0x7f74ec0048d0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 -- 10.20.193.28:0/4167164064 shutdown_connections 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c541a302b0 0x55c541a326a0 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a11560 0x55c541a2bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a24ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 --2- 10.20.193.28:0/4167164064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a0be80 0x55c541a24960 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f74b97fa640 0 client.19767 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 -- 10.20.193.28:0/4167164064 >> 10.20.193.28:0/4167164064 conn(0x55c541a036f0 msgr2=0x55c541a12910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 -- 10.20.193.28:0/4167164064 shutdown_connections 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.301+0000 7f7501022e00 1 -- 10.20.193.28:0/4167164064 wait complete. 2026-02-20T03:30:25.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.302+0000 7f7501022e00 20 client.19767 trim_cache size 0 max 16384 2026-02-20T03:30:25.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.310+0000 7f7501022e00 1 Processor -- start 2026-02-20T03:30:25.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.310+0000 7f7501022e00 1 -- start start 2026-02-20T03:30:25.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.310+0000 7f7501022e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.310+0000 7f7501022e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0c7c0 0x55c541a2bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.310+0000 7f7501022e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 0x55c541a0cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.310+0000 7f7501022e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f749c012750 con 0x55c541a11560 2026-02-20T03:30:25.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.310+0000 7f7501022e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f749c00ffc0 con 0x55c541a0c7c0 2026-02-20T03:30:25.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.310+0000 7f7501022e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f749c00de10 con 0x55c541a0be80 2026-02-20T03:30:25.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.310+0000 7f74f7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 0x55c541a0cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0c7c0 0x55c541a2bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f6ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0c7c0 0x55c541a2bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59386/0 (socket says 10.20.193.28:59386) 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f6ffd640 1 -- 10.20.193.28:0/4190745830 learned_addr learned my addr 10.20.193.28:0/4190745830 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f7fff640 1 --2- 10.20.193.28:0/4190745830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f6ffd640 1 -- 10.20.193.28:0/4190745830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 msgr2=0x55c541a0a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/4190745830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f6ffd640 1 -- 10.20.193.28:0/4190745830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 msgr2=0x55c541a0cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/4190745830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 0x55c541a0cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f6ffd640 1 -- 10.20.193.28:0/4190745830 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c541a1dec0 con 0x55c541a0c7c0 2026-02-20T03:30:25.314 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.311+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/4190745830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0c7c0 0x55c541a2bce0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009fd0 tx=0x7f74e80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5f869eeb840a88 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:25.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.314+0000 7f74bb7fe640 1 -- 10.20.193.28:0/4190745830 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8004aa0 con 0x55c541a0c7c0 2026-02-20T03:30:25.316 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.314+0000 7f74bb7fe640 1 -- 10.20.193.28:0/4190745830 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74e8004c40 con 0x55c541a0c7c0 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.314+0000 7f74bb7fe640 1 -- 10.20.193.28:0/4190745830 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8011c80 con 0x55c541a0c7c0 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.314+0000 7f7501022e00 1 -- 10.20.193.28:0/4190745830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0c7c0 msgr2=0x55c541a2bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.314+0000 7f7501022e00 1 --2- 10.20.193.28:0/4190745830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0c7c0 0x55c541a2bce0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f74e8009fd0 tx=0x7f74e80047c0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.314+0000 7f7501022e00 1 -- 10.20.193.28:0/4190745830 shutdown_connections 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.314+0000 7f7501022e00 1 --2- 10.20.193.28:0/4190745830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 0x55c541a0cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.314+0000 7f7501022e00 1 --2- 10.20.193.28:0/4190745830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0c7c0 0x55c541a2bce0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.314+0000 7f7501022e00 1 --2- 10.20.193.28:0/4190745830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0be80 0x55c541a0a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.315+0000 7f7501022e00 1 -- 10.20.193.28:0/4190745830 >> 10.20.193.28:0/4190745830 conn(0x55c541a036f0 msgr2=0x55c541a21e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.315+0000 7f7501022e00 1 -- 10.20.193.28:0/4190745830 shutdown_connections 2026-02-20T03:30:25.317 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.315+0000 7f7501022e00 1 -- 10.20.193.28:0/4190745830 wait complete. 2026-02-20T03:30:25.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.315+0000 7f7501022e00 1 -- start start 2026-02-20T03:30:25.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.315+0000 7f7501022e00 1 Processor -- start 2026-02-20T03:30:25.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.316+0000 7f7501022e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0be80 0x55c541a29770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.316+0000 7f7501022e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a29cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.316+0000 7f74f7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0be80 0x55c541a29770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.316+0000 7f74f7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0be80 0x55c541a29770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59390/0 (socket says 10.20.193.28:59390) 2026-02-20T03:30:25.320 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.316+0000 7f74f7fff640 1 -- 10.20.193.28:0/2345526006 learned_addr learned my addr 10.20.193.28:0/2345526006 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.317+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a29cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.317+0000 7f7501022e00 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 0x55c541a2ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.317+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f749c00e480 con 0x55c541a11560 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.317+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f749c00f8f0 con 0x55c541a0be80 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.317+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f749c00eb50 con 0x55c541a0c7c0 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.317+0000 7f74f6ffd640 1 -- 10.20.193.28:0/2345526006 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0be80 msgr2=0x55c541a29770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.317+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0be80 0x55c541a29770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.317+0000 7f74f6ffd640 1 -- 10.20.193.28:0/2345526006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 msgr2=0x55c541a2ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.318+0000 7f74f7fff640 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 0x55c541a2ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.318+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 0x55c541a2ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.318+0000 7f74f6ffd640 1 -- 10.20.193.28:0/2345526006 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c541a38a80 con 0x55c541a0c7c0 2026-02-20T03:30:25.322 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.318+0000 7f74f7fff640 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 0x55c541a2ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:30:25.322 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.318+0000 7f74f6ffd640 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a29cb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55c541a1cf00 tx=0x7f74e80040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14adc5c0666d0202 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:25.322 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.318+0000 7f74b97fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:30:25.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.319+0000 7f74b97fa640 1 -- 10.20.193.28:0/2345526006 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e80048a0 con 0x55c541a0c7c0 2026-02-20T03:30:25.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.319+0000 7f74b97fa640 1 -- 10.20.193.28:0/2345526006 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f74e8004a40 con 0x55c541a0c7c0 2026-02-20T03:30:25.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.319+0000 7f74b97fa640 1 -- 10.20.193.28:0/2345526006 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8024440 con 0x55c541a0c7c0 2026-02-20T03:30:25.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.319+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5416bc690 con 0x55c541a0c7c0 2026-02-20T03:30:25.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.319+0000 7f7501022e00 10 client.28108 _ll_register_callbacks cb 0x7f74ec0127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:25.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.319+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74ec009bb0 con 0x55c541a0c7c0 2026-02-20T03:30:25.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.320+0000 7f74b97fa640 1 -- 10.20.193.28:0/2345526006 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(97..97 src has 1..97) ==== 9297+0+0 (secure 0 0 0) 0x7f74e8005000 con 0x55c541a0c7c0 2026-02-20T03:30:25.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.320+0000 7f74b97fa640 1 -- 10.20.193.28:0/2345526006 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f74e8011a00 con 0x55c541a0c7c0 2026-02-20T03:30:25.324 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.320+0000 7f7501022e00 10 client.28108 fetch_fsmap learned FSMap version 37 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.320+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=37}) -- 0x55c541921b70 con 0x55c541a0c7c0 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.320+0000 7f74b97fa640 1 -- 10.20.193.28:0/2345526006 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 37) ==== 8366+0+0 (secure 0 0 0) 0x7f74e8011ba0 con 0x55c541a0c7c0 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.320+0000 7f7501022e00 10 client.28108 fetch_fsmap finished waiting for FSMap version 37 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.320+0000 7f7501022e00 10 client.28108 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.320+0000 7f7501022e00 20 client.28108 populate_metadata read hostname 'trial028' 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.321+0000 7f7501022e00 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c541a9b630 0x55c541a9daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.321+0000 7f7501022e00 4 client.28108 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.321+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c541735520 con 0x55c541a9b630 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.321+0000 7f74f7fff640 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c541a9b630 0x55c541a9daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.321+0000 7f74f7fff640 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c541a9b630 0x55c541a9daf0 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b8fd5a191ee7b3 server_cookie=f22fdeec80ed406c in_seq=0 out_seq=0 2026-02-20T03:30:25.325 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.321+0000 7f74b97fa640 10 client.28108 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:25.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 54193 26.68 MB/sec warmup 116 sec latency 274.344 ms 2026-02-20T03:30:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:25 trial177 ceph-mon[43181]: pgmap v656: 129 pgs: 129 active+clean; 452 MiB data, 5.8 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 7.6 MiB/s wr, 904 op/s 2026-02-20T03:30:25.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:25 trial028 ceph-mon[38552]: pgmap v656: 129 pgs: 129 active+clean; 452 MiB data, 5.8 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 7.6 MiB/s wr, 904 op/s 2026-02-20T03:30:25.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f74b97fa640 1 -- 10.20.193.28:0/2345526006 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c541735520 con 0x55c541a9b630 2026-02-20T03:30:25.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f74b97fa640 10 client.28108 handle_command_reply: tid=0 2026-02-20T03:30:25.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f7501022e00 1 client.28108 shutdown 2026-02-20T03:30:25.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 msgr2=0x55c541a29cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:25.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f7501022e00 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a29cb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55c541a1cf00 tx=0x7f74e80040e0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 shutdown_connections 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f7501022e00 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c541a9b630 0x55c541a9daf0 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f7501022e00 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c541a11560 0x55c541a2ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f7501022e00 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c541a0c7c0 0x55c541a29cb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f7501022e00 1 --2- 10.20.193.28:0/2345526006 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c541a0be80 0x55c541a29770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 >> 10.20.193.28:0/2345526006 conn(0x55c541a036f0 msgr2=0x55c541a24020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.783+0000 7f74b97fa640 0 client.28108 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.784+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 shutdown_connections 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.784+0000 7f7501022e00 1 -- 10.20.193.28:0/2345526006 wait complete. 2026-02-20T03:30:25.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.784+0000 7f7501022e00 20 client.28108 trim_cache size 0 max 16384 2026-02-20T03:30:25.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:30:25.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:30:25.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:30:25.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.784+0000 7f74fce61640 1 -- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74cc0b0e20 msgr2=0x7f74cc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.784+0000 7f74fce61640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74cc0b0e20 0x7f74cc0b32e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f74e40cd140 tx=0x7f74e40099e0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.784+0000 7f74fce61640 1 -- 10.20.193.28:0/3618695182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74f8109490 msgr2=0x7f74f81a0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.784+0000 7f74fce61640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74f8109490 0x7f74f81a0f40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74e4032040 tx=0x7f74e4006260 comp rx=0 tx=0).stop 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.785+0000 7f74fce61640 1 -- 10.20.193.28:0/3618695182 shutdown_connections 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.785+0000 7f74fce61640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f74cc0b0e20 0x7f74cc0b32e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.785+0000 7f74fce61640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f74f810a900 0x7f74f81a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.785+0000 7f74fce61640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f74f8109e60 0x7f74f81a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.785+0000 7f74fce61640 1 --2- 10.20.193.28:0/3618695182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f74f8109490 0x7f74f81a0f40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.785+0000 7f74fce61640 1 -- 10.20.193.28:0/3618695182 >> 10.20.193.28:0/3618695182 conn(0x7f74f8077fe0 msgr2=0x7f74f810d600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.786+0000 7f74fce61640 1 -- 10.20.193.28:0/3618695182 shutdown_connections 2026-02-20T03:30:25.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:25.786+0000 7f74fce61640 1 -- 10.20.193.28:0/3618695182 wait complete. 2026-02-20T03:30:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:25 trial126 ceph-mon[38476]: pgmap v656: 129 pgs: 129 active+clean; 452 MiB data, 5.8 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 7.6 MiB/s wr, 904 op/s 2026-02-20T03:30:26.217 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:30:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setuser ceph since I am not root 2026-02-20T03:30:26.217 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:30:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setgroup ceph since I am not root 2026-02-20T03:30:26.218 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:30:25 trial177 ceph-mds[71178]: -- 10.20.193.177:0/427190987 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640d5e66b40 con 0x5640d508c800 2026-02-20T03:30:26.218 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:30:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: starting mds.c at 2026-02-20T03:30:26.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 55991 27.29 MB/sec warmup 117 sec latency 32.527 ms 2026-02-20T03:30:26.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:26 trial177 ceph-mon[43181]: daemon mds.c restarted 2026-02-20T03:30:26.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:26 trial177 ceph-mon[43181]: pgmap v657: 129 pgs: 129 active+clean; 465 MiB data, 5.8 GiB used, 8.2 TiB / 8.2 TiB avail; 31 MiB/s rd, 9.0 MiB/s wr, 1.00k op/s 2026-02-20T03:30:26.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:26 trial028 ceph-mon[38552]: daemon mds.c restarted 2026-02-20T03:30:26.728 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:26 trial028 ceph-mon[38552]: pgmap v657: 129 pgs: 129 active+clean; 465 MiB data, 5.8 GiB used, 8.2 TiB / 8.2 TiB avail; 31 MiB/s rd, 9.0 MiB/s wr, 1.00k op/s 2026-02-20T03:30:26.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:26 trial126 ceph-mon[38476]: daemon mds.c restarted 2026-02-20T03:30:26.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:26 trial126 ceph-mon[38476]: pgmap v657: 129 pgs: 129 active+clean; 465 MiB data, 5.8 GiB used, 8.2 TiB / 8.2 TiB avail; 31 MiB/s rd, 9.0 MiB/s wr, 1.00k op/s 2026-02-20T03:30:27.686 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:27 trial028 ceph-mon[38552]: osdmap e98: 12 total, 12 up, 12 in 2026-02-20T03:30:27.686 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:27 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6836/1701826560,v1:10.20.193.177:6837/1701826560] up:boot 2026-02-20T03:30:27.686 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:27 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:30:27.686 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:27 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:30:27.686 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:27 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:30:27.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 57520 27.75 MB/sec warmup 118 sec latency 37.433 ms 2026-02-20T03:30:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:27 trial177 ceph-mon[43181]: osdmap e98: 12 total, 12 up, 12 in 2026-02-20T03:30:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:27 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6836/1701826560,v1:10.20.193.177:6837/1701826560] up:boot 2026-02-20T03:30:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:27 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:30:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:27 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:30:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:27 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:30:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:27 trial126 ceph-mon[38476]: osdmap e98: 12 total, 12 up, 12 in 2026-02-20T03:30:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:27 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6836/1701826560,v1:10.20.193.177:6837/1701826560] up:boot 2026-02-20T03:30:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:27 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:30:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:27 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:30:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:27 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:30:28.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:28 trial028 ceph-mon[38552]: pgmap v659: 129 pgs: 129 active+clean; 471 MiB data, 6.0 GiB used, 8.2 TiB / 8.2 TiB avail; 29 MiB/s rd, 11 MiB/s wr, 1.28k op/s 2026-02-20T03:30:28.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 59146 28.20 MB/sec warmup 119 sec latency 46.392 ms 2026-02-20T03:30:28.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:28 trial177 ceph-mon[43181]: pgmap v659: 129 pgs: 129 active+clean; 471 MiB data, 6.0 GiB used, 8.2 TiB / 8.2 TiB avail; 29 MiB/s rd, 11 MiB/s wr, 1.28k op/s 2026-02-20T03:30:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:28 trial126 ceph-mon[38476]: pgmap v659: 129 pgs: 129 active+clean; 471 MiB data, 6.0 GiB used, 8.2 TiB / 8.2 TiB avail; 29 MiB/s rd, 11 MiB/s wr, 1.28k op/s 2026-02-20T03:30:30.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 62514 79.75 MB/sec execute 1 sec latency 34.300 ms 2026-02-20T03:30:31.548 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:31 trial126 ceph-mon[38476]: pgmap v660: 129 pgs: 129 active+clean; 475 MiB data, 6.0 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 10 MiB/s wr, 1.41k op/s 2026-02-20T03:30:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:31 trial028 ceph-mon[38552]: pgmap v660: 129 pgs: 129 active+clean; 475 MiB data, 6.0 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 10 MiB/s wr, 1.41k op/s 2026-02-20T03:30:31.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 64572 94.63 MB/sec execute 2 sec latency 21.660 ms 2026-02-20T03:30:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:31 trial177 ceph-mon[43181]: pgmap v660: 129 pgs: 129 active+clean; 475 MiB data, 6.0 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 10 MiB/s wr, 1.41k op/s 2026-02-20T03:30:32.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 66150 90.81 MB/sec execute 3 sec latency 27.687 ms 2026-02-20T03:30:33.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:33 trial126 ceph-mon[38476]: pgmap v661: 129 pgs: 129 active+clean; 485 MiB data, 6.1 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 11 MiB/s wr, 1.51k op/s 2026-02-20T03:30:33.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:33 trial028 ceph-mon[38552]: pgmap v661: 129 pgs: 129 active+clean; 485 MiB data, 6.1 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 11 MiB/s wr, 1.51k op/s 2026-02-20T03:30:33.662 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:30:33.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 67933 93.64 MB/sec execute 4 sec latency 33.299 ms 2026-02-20T03:30:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:33 trial177 ceph-mon[43181]: pgmap v661: 129 pgs: 129 active+clean; 485 MiB data, 6.1 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 11 MiB/s wr, 1.51k op/s 2026-02-20T03:30:33.969 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:34.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.193+0000 7fec50770640 1 -- 10.20.193.28:0/278753332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fec481139e0 msgr2=0x7fec48115dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.193+0000 7fec50770640 1 --2- 10.20.193.28:0/278753332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fec481139e0 0x7fec48115dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fec4400b0a0 tx=0x7fec4402f450 comp rx=0 tx=0).stop 2026-02-20T03:30:34.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.193+0000 7fec50770640 1 -- 10.20.193.28:0/278753332 shutdown_connections 2026-02-20T03:30:34.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.193+0000 7fec50770640 1 --2- 10.20.193.28:0/278753332 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fec481139e0 0x7fec48115dd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.193+0000 7fec50770640 1 --2- 10.20.193.28:0/278753332 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec48077f40 0x7fec481134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.193+0000 7fec50770640 1 --2- 10.20.193.28:0/278753332 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec48077620 0x7fec48077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.193+0000 7fec50770640 1 -- 10.20.193.28:0/278753332 >> 10.20.193.28:0/278753332 conn(0x7fec48100840 msgr2=0x7fec48102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:34.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.195+0000 7fec50770640 1 -- 10.20.193.28:0/278753332 shutdown_connections 2026-02-20T03:30:34.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.195+0000 7fec50770640 1 -- 10.20.193.28:0/278753332 wait complete. 2026-02-20T03:30:34.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.196+0000 7fec50770640 1 Processor -- start 2026-02-20T03:30:34.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.196+0000 7fec50770640 1 -- start start 2026-02-20T03:30:34.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.197+0000 7fec50770640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec48077620 0x7fec481a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.197+0000 7fec50770640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec48077f40 0x7fec481a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.197+0000 7fec50770640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fec481139e0 0x7fec481a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.197+0000 7fec50770640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fec481192e0 con 0x7fec48077620 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.197+0000 7fec50770640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fec48119160 con 0x7fec48077f40 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.197+0000 7fec50770640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fec48119460 con 0x7fec481139e0 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4e4e5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec48077620 0x7fec481a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4dce4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec48077f40 0x7fec481a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4e4e5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec48077620 0x7fec481a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41626/0 (socket says 10.20.193.28:41626) 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4e4e5640 1 -- 10.20.193.28:0/1562484248 learned_addr learned my addr 10.20.193.28:0/1562484248 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:34.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4ece6640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fec481139e0 0x7fec481a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4e4e5640 1 -- 10.20.193.28:0/1562484248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fec481139e0 msgr2=0x7fec481a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fec481139e0 0x7fec481a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4e4e5640 1 -- 10.20.193.28:0/1562484248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec48077f40 msgr2=0x7fec481a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec48077f40 0x7fec481a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4e4e5640 1 -- 10.20.193.28:0/1562484248 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec481a6660 con 0x7fec48077620 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.198+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec48077620 0x7fec481a1610 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00d980 tx=0x7fec3c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.199+0000 7fec377fe640 1 -- 10.20.193.28:0/1562484248 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c014070 con 0x7fec48077620 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.199+0000 7fec50770640 1 -- 10.20.193.28:0/1562484248 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec481a6950 con 0x7fec48077620 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.199+0000 7fec50770640 1 -- 10.20.193.28:0/1562484248 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec481ae190 con 0x7fec48077620 2026-02-20T03:30:34.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.199+0000 7fec377fe640 1 -- 10.20.193.28:0/1562484248 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fec3c0044e0 con 0x7fec48077620 2026-02-20T03:30:34.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.199+0000 7fec377fe640 1 -- 10.20.193.28:0/1562484248 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c01d060 con 0x7fec48077620 2026-02-20T03:30:34.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.203+0000 7fec377fe640 1 -- 10.20.193.28:0/1562484248 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fec3c0047c0 con 0x7fec48077620 2026-02-20T03:30:34.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.206+0000 7fec52c75e00 1 Processor -- start 2026-02-20T03:30:34.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.207+0000 7fec52c75e00 1 -- start start 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.207+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d5670a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.207+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 0x5605d56749f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.207+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5675120 0x5605d567cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.207+0000 7fec52c75e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5605d55f0e50 con 0x5605d5670630 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.207+0000 7fec52c75e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5605d55c39c0 con 0x5605d5675120 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.207+0000 7fec52c75e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5605d5571240 con 0x5605d5670fe0 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.207+0000 7fec4ece6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d5670a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec4ece6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d5670a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41628/0 (socket says 10.20.193.28:41628) 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec4ece6640 1 -- 10.20.193.28:0/923596946 learned_addr learned my addr 10.20.193.28:0/923596946 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:34.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/923596946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 0x5605d56749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec377fe640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fec1c0b1020 0x7fec1c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec4dce4640 1 --2- 10.20.193.28:0/923596946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5675120 0x5605d567cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec4ece6640 1 -- 10.20.193.28:0/923596946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 msgr2=0x5605d56749f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec4ece6640 1 --2- 10.20.193.28:0/923596946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 0x5605d56749f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec4ece6640 1 -- 10.20.193.28:0/923596946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5675120 msgr2=0x5605d567cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec377fe640 1 -- 10.20.193.28:0/1562484248 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fec3c0e04b0 con 0x7fec48077620 2026-02-20T03:30:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec4ece6640 1 --2- 10.20.193.28:0/923596946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5675120 0x5605d567cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.208+0000 7fec4ece6640 1 -- 10.20.193.28:0/923596946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d5584420 con 0x5605d5670630 2026-02-20T03:30:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.209+0000 7fec4ece6640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fec1c0b1020 0x7fec1c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.209+0000 7fec4ece6640 1 --2- 10.20.193.28:0/923596946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d5670a10 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fec44036000 tx=0x7fec4400afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e144568f16ffc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.210+0000 7fec34cf3640 1 -- 10.20.193.28:0/923596946 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec440074c0 con 0x5605d5670630 2026-02-20T03:30:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.210+0000 7fec34cf3640 1 -- 10.20.193.28:0/923596946 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fec44033050 con 0x5605d5670630 2026-02-20T03:30:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.210+0000 7fec34cf3640 1 -- 10.20.193.28:0/923596946 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec440426b0 con 0x5605d5670630 2026-02-20T03:30:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.210+0000 7fec4ece6640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fec1c0b1020 0x7fec1c0b34e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fec44049000 tx=0x7fec4404c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.210+0000 7fec52c75e00 1 -- 10.20.193.28:0/923596946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 msgr2=0x5605d5670a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.210+0000 7fec52c75e00 1 --2- 10.20.193.28:0/923596946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d5670a10 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fec44036000 tx=0x7fec4400afe0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.211+0000 7fec52c75e00 1 -- 10.20.193.28:0/923596946 shutdown_connections 2026-02-20T03:30:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.211+0000 7fec52c75e00 1 --2- 10.20.193.28:0/923596946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5675120 0x5605d567cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.211+0000 7fec52c75e00 1 --2- 10.20.193.28:0/923596946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 0x5605d56749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.211+0000 7fec52c75e00 1 --2- 10.20.193.28:0/923596946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d5670a10 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.211+0000 7fec52c75e00 1 -- 10.20.193.28:0/923596946 >> 10.20.193.28:0/923596946 conn(0x5605d5633290 msgr2=0x5605d566ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:34.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.211+0000 7fec52c75e00 1 -- 10.20.193.28:0/923596946 shutdown_connections 2026-02-20T03:30:34.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.211+0000 7fec52c75e00 1 -- 10.20.193.28:0/923596946 wait complete. 2026-02-20T03:30:34.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.212+0000 7fec52c75e00 1 -- start start 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.212+0000 7fec52c75e00 1 Processor -- start 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.213+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d568aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.213+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670fe0 0x5605d568afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.213+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5675120 0x5605d56891b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.213+0000 7fec52c75e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5605d55bf8f0 con 0x5605d5670630 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.213+0000 7fec52c75e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5605d53b1f50 con 0x5605d5670fe0 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.213+0000 7fec52c75e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5605d5689930 con 0x5605d5675120 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.213+0000 7fec4e4e5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d568aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.213+0000 7fec4e4e5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d568aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41640/0 (socket says 10.20.193.28:41640) 2026-02-20T03:30:34.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.213+0000 7fec4e4e5640 1 -- 10.20.193.28:0/2491576691 learned_addr learned my addr 10.20.193.28:0/2491576691 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7fec4e4e5640 1 -- 10.20.193.28:0/2491576691 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5675120 msgr2=0x5605d56891b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5675120 0x5605d56891b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7fec4e4e5640 1 -- 10.20.193.28:0/2491576691 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670fe0 msgr2=0x5605d568afb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670fe0 0x5605d568afb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7fec4e4e5640 1 -- 10.20.193.28:0/2491576691 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d56828f0 con 0x5605d5670630 2026-02-20T03:30:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d568aa70 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0a4070 tx=0x7fec3c0a3fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0bda0201fdc0a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7febf7fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:34.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7febf7fff640 1 -- 10.20.193.28:0/2491576691 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c014070 con 0x5605d5670630 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7fec52c75e00 1 -- 10.20.193.28:0/2491576691 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605d5394b40 con 0x5605d5670630 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7febf7fff640 1 -- 10.20.193.28:0/2491576691 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fec3c0ac540 con 0x5605d5670630 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7fec52c75e00 10 client.19782 _ll_register_callbacks cb 0x5605d55fcf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7febf7fff640 1 -- 10.20.193.28:0/2491576691 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0e3b80 con 0x5605d5670630 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7fec52c75e00 1 -- 10.20.193.28:0/2491576691 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605d55d11a0 con 0x5605d5670630 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.214+0000 7febf7fff640 1 -- 10.20.193.28:0/2491576691 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fec3c0e3d20 con 0x5605d5670630 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.215+0000 7febf7fff640 1 -- 10.20.193.28:0/2491576691 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fec3c094510 con 0x5605d5670630 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.215+0000 7fec52c75e00 10 client.19782 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.215+0000 7fec52c75e00 1 -- 10.20.193.28:0/2491576691 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=39}) -- 0x5605d557e230 con 0x5605d5670630 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.215+0000 7febf7fff640 1 -- 10.20.193.28:0/2491576691 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7fec3c0ac160 con 0x5605d5670630 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.215+0000 7fec52c75e00 10 client.19782 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.215+0000 7fec52c75e00 10 client.19782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.215+0000 7fec52c75e00 20 client.19782 populate_metadata read hostname 'trial028' 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.215+0000 7fec52c75e00 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5605d5699320 0x5605d569b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.216+0000 7fec52c75e00 4 client.19782 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:34.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.216+0000 7fec52c75e00 1 -- 10.20.193.28:0/2491576691 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605d55cb5b0 con 0x5605d5699320 2026-02-20T03:30:34.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.224+0000 7fec4dce4640 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5605d5699320 0x5605d569b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.228+0000 7fec4dce4640 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5605d5699320 0x5605d569b7c0 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c950d8ee1063ddc9 server_cookie=aa07b4da17c8909d in_seq=0 out_seq=0 2026-02-20T03:30:34.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.228+0000 7febf7fff640 10 client.19782 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.230+0000 7febf7fff640 1 -- 10.20.193.28:0/2491576691 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5605d55cb5b0 con 0x5605d5699320 2026-02-20T03:30:34.233 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.230+0000 7febf7fff640 10 client.19782 handle_command_reply: tid=0 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.230+0000 7fec52c75e00 1 client.19782 shutdown 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7fec52c75e00 1 -- 10.20.193.28:0/2491576691 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 msgr2=0x5605d568aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7fec52c75e00 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d568aa70 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0a4070 tx=0x7fec3c0a3fb0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7fec52c75e00 1 -- 10.20.193.28:0/2491576691 shutdown_connections 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7fec52c75e00 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5605d5699320 0x5605d569b7c0 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7fec52c75e00 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5675120 0x5605d56891b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7fec52c75e00 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670fe0 0x5605d568afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7fec52c75e00 1 --2- 10.20.193.28:0/2491576691 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5670630 0x5605d568aa70 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7fec52c75e00 1 -- 10.20.193.28:0/2491576691 >> 10.20.193.28:0/2491576691 conn(0x5605d5633290 msgr2=0x5605d566c500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:34.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7febf7fff640 0 client.19782 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.231+0000 7fec52c75e00 1 -- 10.20.193.28:0/2491576691 shutdown_connections 2026-02-20T03:30:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.232+0000 7fec52c75e00 1 -- 10.20.193.28:0/2491576691 wait complete. 2026-02-20T03:30:34.235 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.232+0000 7fec52c75e00 20 client.19782 trim_cache size 0 max 16384 2026-02-20T03:30:34.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.247+0000 7fec52c75e00 1 Processor -- start 2026-02-20T03:30:34.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.247+0000 7fec52c75e00 1 -- start start 2026-02-20T03:30:34.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.247+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670630 0x5605d56747c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.247+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670fe0 0x5605d569b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.247+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 0x5605d56a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec52c75e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7febf0012700 con 0x5605d5675120 2026-02-20T03:30:34.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec52c75e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7febf000ff70 con 0x5605d5670fe0 2026-02-20T03:30:34.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec52c75e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7febf000ddc0 con 0x5605d5670630 2026-02-20T03:30:34.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4e4e5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670630 0x5605d56747c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4e4e5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670630 0x5605d56747c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60880/0 (socket says 10.20.193.28:60880) 2026-02-20T03:30:34.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4e4e5640 1 -- 10.20.193.28:0/1762303524 learned_addr learned my addr 10.20.193.28:0/1762303524 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:34.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4ece6640 1 --2- 10.20.193.28:0/1762303524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 0x5605d56a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4dce4640 1 --2- 10.20.193.28:0/1762303524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670fe0 0x5605d569b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4e4e5640 1 -- 10.20.193.28:0/1762303524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670fe0 msgr2=0x5605d569b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:34.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/1762303524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670fe0 0x5605d569b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4e4e5640 1 -- 10.20.193.28:0/1762303524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 msgr2=0x5605d56a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:34.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/1762303524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 0x5605d56a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4e4e5640 1 -- 10.20.193.28:0/1762303524 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d5682720 con 0x5605d5670630 2026-02-20T03:30:34.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.248+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/1762303524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670630 0x5605d56747c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00d950 tx=0x7fec3c019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=321e7b0095c1865a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:34.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.249+0000 7fec1a4e6640 1 -- 10.20.193.28:0/1762303524 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c094020 con 0x5605d5670630 2026-02-20T03:30:34.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.249+0000 7fec1a4e6640 1 -- 10.20.193.28:0/1762303524 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5605d55d11a0 con 0x5605d5670630 2026-02-20T03:30:34.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.249+0000 7fec1a4e6640 1 -- 10.20.193.28:0/1762303524 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c014040 con 0x5605d5670630 2026-02-20T03:30:34.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.250+0000 7fec52c75e00 1 -- 10.20.193.28:0/1762303524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670630 msgr2=0x5605d56747c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.250+0000 7fec52c75e00 1 --2- 10.20.193.28:0/1762303524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670630 0x5605d56747c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00d950 tx=0x7fec3c019000 comp rx=0 tx=0).stop 2026-02-20T03:30:34.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.250+0000 7fec52c75e00 1 -- 10.20.193.28:0/1762303524 shutdown_connections 2026-02-20T03:30:34.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.250+0000 7fec52c75e00 1 --2- 10.20.193.28:0/1762303524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 0x5605d56a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.250+0000 7fec52c75e00 1 --2- 10.20.193.28:0/1762303524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670fe0 0x5605d569b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.250+0000 7fec52c75e00 1 --2- 10.20.193.28:0/1762303524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670630 0x5605d56747c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.250+0000 7fec52c75e00 1 -- 10.20.193.28:0/1762303524 >> 10.20.193.28:0/1762303524 conn(0x5605d5633290 msgr2=0x5605d56880e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:34.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.250+0000 7fec52c75e00 1 -- 10.20.193.28:0/1762303524 shutdown_connections 2026-02-20T03:30:34.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.250+0000 7fec52c75e00 1 -- 10.20.193.28:0/1762303524 wait complete. 2026-02-20T03:30:34.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.251+0000 7fec52c75e00 1 -- start start 2026-02-20T03:30:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.251+0000 7fec52c75e00 1 Processor -- start 2026-02-20T03:30:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.252+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670630 0x5605d568d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.252+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 0x5605d568dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.252+0000 7fec52c75e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 0x5605d568e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.252+0000 7fec52c75e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7febf000e430 con 0x5605d5675120 2026-02-20T03:30:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.252+0000 7fec52c75e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7febf000f8a0 con 0x5605d5670630 2026-02-20T03:30:34.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.252+0000 7fec52c75e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7febf000eb00 con 0x5605d5670fe0 2026-02-20T03:30:34.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.253+0000 7fec4e4e5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670630 0x5605d568d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.253+0000 7fec4dce4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 0x5605d568dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.253+0000 7fec4e4e5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670630 0x5605d568d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53550/0 (socket says 10.20.193.28:53550) 2026-02-20T03:30:34.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.253+0000 7fec4e4e5640 1 -- 10.20.193.28:0/3749085388 learned_addr learned my addr 10.20.193.28:0/3749085388 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:34.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.253+0000 7fec4ece6640 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 0x5605d568e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.254+0000 7fec4e4e5640 1 -- 10.20.193.28:0/3749085388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 msgr2=0x5605d568dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.254+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 0x5605d568dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.254+0000 7fec4e4e5640 1 -- 10.20.193.28:0/3749085388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 msgr2=0x5605d568e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.254+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 0x5605d568e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.254+0000 7fec4e4e5640 1 -- 10.20.193.28:0/3749085388 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605d52a2870 con 0x5605d5670630 2026-02-20T03:30:34.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.255+0000 7fec4e4e5640 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670630 0x5605d568d850 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0a38a0 tx=0x7fec3c0a79c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3391ba2afa6489a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:34.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.255+0000 7febf7fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:30:34.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.255+0000 7febf7fff640 1 -- 10.20.193.28:0/3749085388 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c094030 con 0x5605d5670630 2026-02-20T03:30:34.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.255+0000 7febf7fff640 1 -- 10.20.193.28:0/3749085388 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fec3c0e0160 con 0x5605d5670630 2026-02-20T03:30:34.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.255+0000 7fec52c75e00 1 -- 10.20.193.28:0/3749085388 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605d5563440 con 0x5605d5670630 2026-02-20T03:30:34.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.255+0000 7fec52c75e00 10 client.28127 _ll_register_callbacks cb 0x7fec3c0a3790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:34.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.255+0000 7fec52c75e00 1 -- 10.20.193.28:0/3749085388 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605d55d11a0 con 0x5605d5670630 2026-02-20T03:30:34.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7febf7fff640 1 -- 10.20.193.28:0/3749085388 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec3c014070 con 0x5605d5670630 2026-02-20T03:30:34.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7febf7fff640 1 -- 10.20.193.28:0/3749085388 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fec3c0942f0 con 0x5605d5670630 2026-02-20T03:30:34.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7febf7fff640 1 -- 10.20.193.28:0/3749085388 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fec3c0a7450 con 0x5605d5670630 2026-02-20T03:30:34.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7fec52c75e00 10 client.28127 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:34.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7fec52c75e00 1 -- 10.20.193.28:0/3749085388 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=39}) -- 0x5605d5683410 con 0x5605d5670630 2026-02-20T03:30:34.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7febf7fff640 1 -- 10.20.193.28:0/3749085388 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7fec3c05a100 con 0x5605d5670630 2026-02-20T03:30:34.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7fec52c75e00 10 client.28127 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:34.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7fec52c75e00 10 client.28127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:34.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7fec52c75e00 20 client.28127 populate_metadata read hostname 'trial028' 2026-02-20T03:30:34.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7fec52c75e00 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5605d5705160 0x5605d5707600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7fec52c75e00 4 client.28127 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:30:34.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.256+0000 7fec52c75e00 1 -- 10.20.193.28:0/3749085388 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5605d55cb5b0 con 0x5605d5705160 2026-02-20T03:30:34.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.257+0000 7fec4dce4640 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5605d5705160 0x5605d5707600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.258+0000 7fec4dce4640 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5605d5705160 0x5605d5707600 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd08107104c206e0 server_cookie=41297dd49163665d in_seq=0 out_seq=0 2026-02-20T03:30:34.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.258+0000 7febf7fff640 10 client.28127 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.259+0000 7febf7fff640 1 -- 10.20.193.28:0/3749085388 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5605d55cb5b0 con 0x5605d5705160 2026-02-20T03:30:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.259+0000 7febf7fff640 10 client.28127 handle_command_reply: tid=0 2026-02-20T03:30:34.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.259+0000 7fec52c75e00 1 client.28127 shutdown 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 -- 10.20.193.28:0/3749085388 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670630 msgr2=0x5605d568d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670630 0x5605d568d850 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0a38a0 tx=0x7fec3c0a79c0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 -- 10.20.193.28:0/3749085388 shutdown_connections 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5605d5705160 0x5605d5707600 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5605d5675120 0x5605d568e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5605d5670fe0 0x5605d568dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 --2- 10.20.193.28:0/3749085388 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5605d5670630 0x5605d568d850 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 -- 10.20.193.28:0/3749085388 >> 10.20.193.28:0/3749085388 conn(0x5605d5633290 msgr2=0x5605d569b330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7febf7fff640 0 client.28127 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 -- 10.20.193.28:0/3749085388 shutdown_connections 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 1 -- 10.20.193.28:0/3749085388 wait complete. 2026-02-20T03:30:34.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.260+0000 7fec52c75e00 20 client.28127 trim_cache size 0 max 16384 2026-02-20T03:30:34.264 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:30:34.264 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:30:34.264 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:30:34.264 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:30:34.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 -- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fec1c0b1020 msgr2=0x7fec1c0b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fec1c0b1020 0x7fec1c0b34e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fec44049000 tx=0x7fec4404c000 comp rx=0 tx=0).stop 2026-02-20T03:30:34.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 -- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec48077620 msgr2=0x7fec481a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec48077620 0x7fec481a1610 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00d980 tx=0x7fec3c00de50 comp rx=0 tx=0).stop 2026-02-20T03:30:34.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 -- 10.20.193.28:0/1562484248 shutdown_connections 2026-02-20T03:30:34.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fec1c0b1020 0x7fec1c0b34e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fec481139e0 0x7fec481a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fec48077f40 0x7fec481a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 --2- 10.20.193.28:0/1562484248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fec48077620 0x7fec481a1610 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 -- 10.20.193.28:0/1562484248 >> 10.20.193.28:0/1562484248 conn(0x7fec48100840 msgr2=0x7fec48102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 -- 10.20.193.28:0/1562484248 shutdown_connections 2026-02-20T03:30:34.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.261+0000 7fec50770640 1 -- 10.20.193.28:0/1562484248 wait complete. 2026-02-20T03:30:34.384 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:30:34.385 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:30:34.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 69333 89.98 MB/sec execute 5 sec latency 36.716 ms 2026-02-20T03:30:34.722 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 -- 10.20.193.28:0/3103718822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 msgr2=0x7f425010dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 --2- 10.20.193.28:0/3103718822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 0x7f425010dab0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4248009a30 tx=0x7f424802f260 comp rx=0 tx=0).stop 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 -- 10.20.193.28:0/3103718822 shutdown_connections 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 --2- 10.20.193.28:0/3103718822 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f425010e1e0 0x7f425007b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 --2- 10.20.193.28:0/3103718822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 0x7f425010dab0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 --2- 10.20.193.28:0/3103718822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4250074380 0x7f4250074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 -- 10.20.193.28:0/3103718822 >> 10.20.193.28:0/3103718822 conn(0x7f425006ead0 msgr2=0x7f425006eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 -- 10.20.193.28:0/3103718822 shutdown_connections 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 -- 10.20.193.28:0/3103718822 wait complete. 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 Processor -- start 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 -- start start 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4250074380 0x7f4250085ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 0x7f4250084270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.950+0000 7f42576ed640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f425010e1e0 0x7f42500847b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f42576ed640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f425007f8c0 con 0x7f4250074d30 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f42576ed640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f425007f740 con 0x7f425010e1e0 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f42576ed640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f425007fa40 con 0x7f4250074380 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f4255eea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 0x7f4250084270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f4255eea640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 0x7f4250084270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41672/0 (socket says 10.20.193.28:41672) 2026-02-20T03:30:34.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f4255eea640 1 -- 10.20.193.28:0/2600305764 learned_addr learned my addr 10.20.193.28:0/2600305764 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f4255eea640 1 -- 10.20.193.28:0/2600305764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4250074380 msgr2=0x7f4250085ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f4255eea640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4250074380 0x7f4250085ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f4255eea640 1 -- 10.20.193.28:0/2600305764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f425010e1e0 msgr2=0x7f42500847b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f4255eea640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f425010e1e0 0x7f42500847b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f4255eea640 1 -- 10.20.193.28:0/2600305764 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4250084ee0 con 0x7f4250074d30 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.952+0000 7f4255eea640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 0x7f4250084270 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4248009a00 tx=0x7f4248004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.953+0000 7f423b7fe640 1 -- 10.20.193.28:0/2600305764 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480047c0 con 0x7f4250074d30 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.953+0000 7f423b7fe640 1 -- 10.20.193.28:0/2600305764 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4248004e00 con 0x7f4250074d30 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.953+0000 7f423b7fe640 1 -- 10.20.193.28:0/2600305764 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480053b0 con 0x7f4250074d30 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.953+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42501c7bb0 con 0x7f4250074d30 2026-02-20T03:30:34.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.953+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42501c7f50 con 0x7f4250074d30 2026-02-20T03:30:34.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.953+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f425010a680 con 0x7f4250074d30 2026-02-20T03:30:34.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.968+0000 7f423b7fe640 1 -- 10.20.193.28:0/2600305764 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4248038a40 con 0x7f4250074d30 2026-02-20T03:30:34.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.969+0000 7f423b7fe640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42300b0e20 0x7f42300b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:34.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.970+0000 7f423b7fe640 1 -- 10.20.193.28:0/2600305764 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f4248105870 con 0x7f4250074d30 2026-02-20T03:30:34.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.970+0000 7f42566eb640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42300b0e20 0x7f42300b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:34.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.970+0000 7f423b7fe640 1 -- 10.20.193.28:0/2600305764 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4248047020 con 0x7f4250074d30 2026-02-20T03:30:34.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:34.971+0000 7f42566eb640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42300b0e20 0x7f42300b32e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4244009770 tx=0x7f4244006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:35.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.099+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4250074760 con 0x7f4250074d30 2026-02-20T03:30:35.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.100+0000 7f423b7fe640 1 -- 10.20.193.28:0/2600305764 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11925 (secure 0 0 0) 0x7f42480cdcb0 con 0x7f4250074d30 2026-02-20T03:30:35.109 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:30:35.109 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":39,"btime":"2026-02-20T03:30:26:439464+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:30:26.439459+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28114":{"gid":28114,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1701826560","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1701826560},{"type":"v1","addr":"10.20.193.177:6837","nonce":1701826560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:30:35.110 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 39 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42300b0e20 msgr2=0x7f42300b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42300b0e20 0x7f42300b32e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4244009770 tx=0x7f4244006cd0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 msgr2=0x7f4250084270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 0x7f4250084270 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4248009a00 tx=0x7f4248004290 comp rx=0 tx=0).stop 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 shutdown_connections 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42300b0e20 0x7f42300b32e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f425010e1e0 0x7f42500847b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4250074d30 0x7f4250084270 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 --2- 10.20.193.28:0/2600305764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4250074380 0x7f4250085ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 >> 10.20.193.28:0/2600305764 conn(0x7f425006ead0 msgr2=0x7f4250073340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:35.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 shutdown_connections 2026-02-20T03:30:35.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.102+0000 7f42576ed640 1 -- 10.20.193.28:0/2600305764 wait complete. 2026-02-20T03:30:35.226 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:30:35.555 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:35.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:35 trial126 ceph-mon[38476]: pgmap v662: 129 pgs: 129 active+clean; 510 MiB data, 6.1 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 11 MiB/s wr, 1.54k op/s 2026-02-20T03:30:35.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:35 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2600305764' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:35 trial028 ceph-mon[38552]: pgmap v662: 129 pgs: 129 active+clean; 510 MiB data, 6.1 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 11 MiB/s wr, 1.54k op/s 2026-02-20T03:30:35.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:35 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2600305764' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:35.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 70612 85.30 MB/sec execute 6 sec latency 51.882 ms 2026-02-20T03:30:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:35 trial177 ceph-mon[43181]: pgmap v662: 129 pgs: 129 active+clean; 510 MiB data, 6.1 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 11 MiB/s wr, 1.54k op/s 2026-02-20T03:30:35.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:35 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2600305764' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:35.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.764+0000 7fe45d5f9640 1 -- 10.20.193.28:0/206081014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe45810d6f0 msgr2=0x7fe45810dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.764+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/206081014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe45810d6f0 0x7fe45810dad0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe444009a30 tx=0x7fe44402f220 comp rx=0 tx=0).stop 2026-02-20T03:30:35.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.764+0000 7fe45d5f9640 1 -- 10.20.193.28:0/206081014 shutdown_connections 2026-02-20T03:30:35.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.764+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/206081014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe458112700 0x7fe45811a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.764+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/206081014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe45810e0a0 0x7fe458111fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.764+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/206081014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe45810d6f0 0x7fe45810dad0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.764+0000 7fe45d5f9640 1 -- 10.20.193.28:0/206081014 >> 10.20.193.28:0/206081014 conn(0x7fe45806d500 msgr2=0x7fe45806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:35.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.766+0000 7fe45d5f9640 1 -- 10.20.193.28:0/206081014 shutdown_connections 2026-02-20T03:30:35.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.766+0000 7fe45d5f9640 1 -- 10.20.193.28:0/206081014 wait complete. 2026-02-20T03:30:35.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.767+0000 7fe45d5f9640 1 Processor -- start 2026-02-20T03:30:35.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.767+0000 7fe45d5f9640 1 -- start start 2026-02-20T03:30:35.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe45d5f9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe45810d6f0 0x7fe458119e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe45d5f9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe45810e0a0 0x7fe458116ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe45d5f9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe458112700 0x7fe458117430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe45d5f9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe45811d5f0 con 0x7fe458112700 2026-02-20T03:30:35.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe45d5f9640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe45811d470 con 0x7fe45810d6f0 2026-02-20T03:30:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe45d5f9640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe45811d770 con 0x7fe45810e0a0 2026-02-20T03:30:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe457fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe45810d6f0 0x7fe458119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe457fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe45810d6f0 0x7fe458119e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53582/0 (socket says 10.20.193.28:53582) 2026-02-20T03:30:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe457fff640 1 -- 10.20.193.28:0/485640189 learned_addr learned my addr 10.20.193.28:0/485640189 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe4577fe640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe45810e0a0 0x7fe458116ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.768+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe458112700 0x7fe458117430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.769+0000 7fe457fff640 1 -- 10.20.193.28:0/485640189 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe45810e0a0 msgr2=0x7fe458116ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.769+0000 7fe457fff640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe45810e0a0 0x7fe458116ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.769+0000 7fe457fff640 1 -- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe458112700 msgr2=0x7fe458117430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.769+0000 7fe457fff640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe458112700 0x7fe458117430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.769+0000 7fe457fff640 1 -- 10.20.193.28:0/485640189 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe458117b60 con 0x7fe45810d6f0 2026-02-20T03:30:35.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.769+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe458112700 0x7fe458117430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:30:35.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.769+0000 7fe457fff640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe45810d6f0 0x7fe458119e40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe4440386a0 tx=0x7fe444004600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:35.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.770+0000 7fe4557fa640 1 -- 10.20.193.28:0/485640189 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe444038a00 con 0x7fe45810d6f0 2026-02-20T03:30:35.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.770+0000 7fe4557fa640 1 -- 10.20.193.28:0/485640189 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe444038ba0 con 0x7fe45810d6f0 2026-02-20T03:30:35.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.770+0000 7fe4557fa640 1 -- 10.20.193.28:0/485640189 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4440419a0 con 0x7fe45810d6f0 2026-02-20T03:30:35.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.770+0000 7fe45d5f9640 1 -- 10.20.193.28:0/485640189 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4581aba70 con 0x7fe45810d6f0 2026-02-20T03:30:35.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.771+0000 7fe45d5f9640 1 -- 10.20.193.28:0/485640189 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4581abf00 con 0x7fe45810d6f0 2026-02-20T03:30:35.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.774+0000 7fe4557fa640 1 -- 10.20.193.28:0/485640189 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe444041b40 con 0x7fe45810d6f0 2026-02-20T03:30:35.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.774+0000 7fe460d87e00 1 Processor -- start 2026-02-20T03:30:35.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.775+0000 7fe460d87e00 1 -- start start 2026-02-20T03:30:35.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.775+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707c6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.775+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.775+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c0f60 0x5616707ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.775+0000 7fe45cdf8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.775+0000 7fe457fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.775+0000 7fe45cdf8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53594/0 (socket says 10.20.193.28:53594) 2026-02-20T03:30:35.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.775+0000 7fe457fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707c0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60934/0 (socket says 10.20.193.28:60934) 2026-02-20T03:30:35.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe4557fa640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4240b0e20 0x7fe4240b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe45cdf8640 1 -- 10.20.193.28:0/3003777306 learned_addr learned my addr 10.20.193.28:0/3003777306 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:35.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe4557fa640 1 -- 10.20.193.28:0/485640189 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe444105360 con 0x7fe45810d6f0 2026-02-20T03:30:35.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe460d87e00 1 -- 10.20.193.28:0/3003777306 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561670740e00 con 0x5616707c0f60 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe460d87e00 1 -- 10.20.193.28:0/3003777306 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561670713970 con 0x5616707c5fb0 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe460d87e00 1 -- 10.20.193.28:0/3003777306 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5616706c11f0 con 0x5616707c05e0 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe4577fe640 1 --2- 10.20.193.28:0/3003777306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c0f60 0x5616707ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4240b0e20 0x7fe4240b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe4577fe640 1 -- 10.20.193.28:0/3003777306 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 msgr2=0x5616707c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe4577fe640 1 --2- 10.20.193.28:0/3003777306 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707c0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe4577fe640 1 -- 10.20.193.28:0/3003777306 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 msgr2=0x5616707c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe4577fe640 1 --2- 10.20.193.28:0/3003777306 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707c6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.776+0000 7fe4577fe640 1 -- 10.20.193.28:0/3003777306 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616706d43d0 con 0x5616707c0f60 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.777+0000 7fe4577fe640 1 --2- 10.20.193.28:0/3003777306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c0f60 0x5616707ccde0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe458118740 tx=0x7fe4480107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e7e262fbe2d410 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.777+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4240b0e20 0x7fe4240b32e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009fd0 tx=0x7fe44c004bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.777+0000 7fe430ce3640 1 -- 10.20.193.28:0/3003777306 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4480040d0 con 0x5616707c0f60 2026-02-20T03:30:35.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.777+0000 7fe430ce3640 1 -- 10.20.193.28:0/3003777306 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe448015030 con 0x5616707c0f60 2026-02-20T03:30:35.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.777+0000 7fe430ce3640 1 -- 10.20.193.28:0/3003777306 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4480116a0 con 0x5616707c0f60 2026-02-20T03:30:35.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.777+0000 7fe460d87e00 1 -- 10.20.193.28:0/3003777306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c0f60 msgr2=0x5616707ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.777+0000 7fe460d87e00 1 --2- 10.20.193.28:0/3003777306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c0f60 0x5616707ccde0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe458118740 tx=0x7fe4480107a0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.778+0000 7fe460d87e00 1 -- 10.20.193.28:0/3003777306 shutdown_connections 2026-02-20T03:30:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.778+0000 7fe460d87e00 1 --2- 10.20.193.28:0/3003777306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c0f60 0x5616707ccde0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.778+0000 7fe460d87e00 1 --2- 10.20.193.28:0/3003777306 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707c0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.778+0000 7fe460d87e00 1 --2- 10.20.193.28:0/3003777306 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.778+0000 7fe460d87e00 1 -- 10.20.193.28:0/3003777306 >> 10.20.193.28:0/3003777306 conn(0x561670783240 msgr2=0x5616707bece0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.778+0000 7fe460d87e00 1 -- 10.20.193.28:0/3003777306 shutdown_connections 2026-02-20T03:30:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.778+0000 7fe460d87e00 1 -- 10.20.193.28:0/3003777306 wait complete. 2026-02-20T03:30:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.779+0000 7fe460d87e00 1 -- start start 2026-02-20T03:30:35.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.780+0000 7fe460d87e00 1 Processor -- start 2026-02-20T03:30:35.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c05e0 0x5616707daf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 0x5616707db4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe460d87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56167070f8a0 con 0x5616707c5fb0 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe460d87e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561670501f50 con 0x5616707c05e0 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe460d87e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5616707d9980 con 0x5616707c0f60 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe45cdf8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe45cdf8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:41708/0 (socket says 10.20.193.28:41708) 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe45cdf8640 1 -- 10.20.193.28:0/1794100070 learned_addr learned my addr 10.20.193.28:0/1794100070 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe457fff640 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c05e0 0x5616707daf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe4577fe640 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 0x5616707db4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe45cdf8640 1 -- 10.20.193.28:0/1794100070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 msgr2=0x5616707db4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 0x5616707db4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe45cdf8640 1 -- 10.20.193.28:0/1794100070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c05e0 msgr2=0x5616707daf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c05e0 0x5616707daf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe45cdf8640 1 -- 10.20.193.28:0/1794100070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616707d29e0 con 0x5616707c5fb0 2026-02-20T03:30:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.781+0000 7fe457fff640 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c05e0 0x5616707daf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:30:35.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.782+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d9440 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0093f0 tx=0x7fe44c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42973b83232c87c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.783+0000 7fe41a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:35.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.783+0000 7fe41a7fc640 1 -- 10.20.193.28:0/1794100070 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c02a070 con 0x5616707c5fb0 2026-02-20T03:30:35.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.785+0000 7fe41a7fc640 1 -- 10.20.193.28:0/1794100070 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe44c0258a0 con 0x5616707c5fb0 2026-02-20T03:30:35.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.785+0000 7fe41a7fc640 1 -- 10.20.193.28:0/1794100070 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c019890 con 0x5616707c5fb0 2026-02-20T03:30:35.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.785+0000 7fe460d87e00 1 -- 10.20.193.28:0/1794100070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616704e4b40 con 0x5616707c5fb0 2026-02-20T03:30:35.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.785+0000 7fe460d87e00 10 client.19806 _ll_register_callbacks cb 0x56167074ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:35.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.785+0000 7fe460d87e00 1 -- 10.20.193.28:0/1794100070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561670721150 con 0x5616707c5fb0 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe41a7fc640 1 -- 10.20.193.28:0/1794100070 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe44c019a30 con 0x5616707c5fb0 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe41a7fc640 1 -- 10.20.193.28:0/1794100070 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe44c034050 con 0x5616707c5fb0 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe460d87e00 10 client.19806 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe460d87e00 1 -- 10.20.193.28:0/1794100070 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=39}) -- 0x5616706ce1e0 con 0x5616707c5fb0 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe41a7fc640 1 -- 10.20.193.28:0/1794100070 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7fe44c037020 con 0x5616707c5fb0 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe460d87e00 10 client.19806 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe460d87e00 10 client.19806 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe460d87e00 20 client.19806 populate_metadata read hostname 'trial028' 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5616707e96b0 0x5616707ebb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe460d87e00 4 client.19806 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:35.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.786+0000 7fe460d87e00 1 -- 10.20.193.28:0/1794100070 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56167071b560 con 0x5616707e96b0 2026-02-20T03:30:35.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.787+0000 7fe457fff640 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5616707e96b0 0x5616707ebb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.787+0000 7fe457fff640 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5616707e96b0 0x5616707ebb00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8086cdce227486f server_cookie=1c6c8177bd9e337f in_seq=0 out_seq=0 2026-02-20T03:30:35.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.787+0000 7fe41a7fc640 10 client.19806 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:30:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.788+0000 7fe41a7fc640 1 -- 10.20.193.28:0/1794100070 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56167071b560 con 0x5616707e96b0 2026-02-20T03:30:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.788+0000 7fe41a7fc640 10 client.19806 handle_command_reply: tid=0 2026-02-20T03:30:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.788+0000 7fe460d87e00 1 client.19806 shutdown 2026-02-20T03:30:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.788+0000 7fe460d87e00 1 -- 10.20.193.28:0/1794100070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 msgr2=0x5616707d9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.788+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d9440 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0093f0 tx=0x7fe44c004b40 comp rx=0 tx=0).stop 2026-02-20T03:30:35.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.788+0000 7fe460d87e00 1 -- 10.20.193.28:0/1794100070 shutdown_connections 2026-02-20T03:30:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.788+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5616707e96b0 0x5616707ebb00 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.789+0000 7fe41a7fc640 0 client.19806 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:30:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.789+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d9440 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.789+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 0x5616707db4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.789+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1794100070 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c05e0 0x5616707daf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.789+0000 7fe460d87e00 1 -- 10.20.193.28:0/1794100070 >> 10.20.193.28:0/1794100070 conn(0x561670783240 msgr2=0x5616707bf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.789+0000 7fe460d87e00 1 -- 10.20.193.28:0/1794100070 shutdown_connections 2026-02-20T03:30:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.789+0000 7fe460d87e00 1 -- 10.20.193.28:0/1794100070 wait complete. 2026-02-20T03:30:35.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.789+0000 7fe460d87e00 20 client.19806 trim_cache size 0 max 16384 2026-02-20T03:30:35.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.801+0000 7fe460d87e00 1 Processor -- start 2026-02-20T03:30:35.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.801+0000 7fe460d87e00 1 -- start start 2026-02-20T03:30:35.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.801+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707d7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.801+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c0f60 0x5616707d81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.801+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.801+0000 7fe460d87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f80128a0 con 0x5616707c5fb0 2026-02-20T03:30:35.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.801+0000 7fe460d87e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8010110 con 0x5616707c0f60 2026-02-20T03:30:35.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.801+0000 7fe460d87e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f800df60 con 0x5616707c05e0 2026-02-20T03:30:35.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe457fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707d7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe4577fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c0f60 0x5616707d81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe45cdf8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe457fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707d7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60942/0 (socket says 10.20.193.28:60942) 2026-02-20T03:30:35.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe457fff640 1 -- 10.20.193.28:0/2524722871 learned_addr learned my addr 10.20.193.28:0/2524722871 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe4577fe640 1 -- 10.20.193.28:0/2524722871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 msgr2=0x5616707d7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe4577fe640 1 --2- 10.20.193.28:0/2524722871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707d7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe4577fe640 1 -- 10.20.193.28:0/2524722871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 msgr2=0x5616707d6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe4577fe640 1 --2- 10.20.193.28:0/2524722871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe4577fe640 1 -- 10.20.193.28:0/2524722871 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616707d2810 con 0x5616707c0f60 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.802+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/2524722871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.803+0000 7fe4577fe640 1 --2- 10.20.193.28:0/2524722871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c0f60 0x5616707d81c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe448007710 tx=0x7fe448007a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=635a5b8cf4f94bea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.803+0000 7fe41bfff640 1 -- 10.20.193.28:0/2524722871 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4480026e0 con 0x5616707c0f60 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.803+0000 7fe41bfff640 1 -- 10.20.193.28:0/2524722871 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe448005610 con 0x5616707c0f60 2026-02-20T03:30:35.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.803+0000 7fe41bfff640 1 -- 10.20.193.28:0/2524722871 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4480118b0 con 0x5616707c0f60 2026-02-20T03:30:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.803+0000 7fe460d87e00 1 -- 10.20.193.28:0/2524722871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c0f60 msgr2=0x5616707d81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.803+0000 7fe460d87e00 1 --2- 10.20.193.28:0/2524722871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c0f60 0x5616707d81c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe448007710 tx=0x7fe448007a40 comp rx=0 tx=0).stop 2026-02-20T03:30:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.804+0000 7fe460d87e00 1 -- 10.20.193.28:0/2524722871 shutdown_connections 2026-02-20T03:30:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.804+0000 7fe460d87e00 1 --2- 10.20.193.28:0/2524722871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c5fb0 0x5616707d6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.804+0000 7fe460d87e00 1 --2- 10.20.193.28:0/2524722871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c0f60 0x5616707d81c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.804+0000 7fe460d87e00 1 --2- 10.20.193.28:0/2524722871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c05e0 0x5616707d7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.804+0000 7fe460d87e00 1 -- 10.20.193.28:0/2524722871 >> 10.20.193.28:0/2524722871 conn(0x561670783240 msgr2=0x5616707daf90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.804+0000 7fe460d87e00 1 -- 10.20.193.28:0/2524722871 shutdown_connections 2026-02-20T03:30:35.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.804+0000 7fe460d87e00 1 -- 10.20.193.28:0/2524722871 wait complete. 2026-02-20T03:30:35.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.805+0000 7fe460d87e00 1 -- start start 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.805+0000 7fe460d87e00 1 Processor -- start 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.805+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c05e0 0x5616707e16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.805+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 0x5616707dde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.805+0000 7fe460d87e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.805+0000 7fe460d87e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f800e5d0 con 0x5616707c05e0 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.805+0000 7fe460d87e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f800fa40 con 0x5616707c5fb0 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.805+0000 7fe460d87e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f800eca0 con 0x5616707c0f60 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe4577fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 0x5616707dde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe4577fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 0x5616707dde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60946/0 (socket says 10.20.193.28:60946) 2026-02-20T03:30:35.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe45cdf8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe45cdf8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707de3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:53622/0 (socket says 10.20.193.28:53622) 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe45cdf8640 1 -- 10.20.193.28:0/1850040809 learned_addr learned my addr 10.20.193.28:0/1850040809 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe45cdf8640 1 -- 10.20.193.28:0/1850040809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 msgr2=0x5616707dde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 0x5616707dde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe45cdf8640 1 -- 10.20.193.28:0/1850040809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c05e0 msgr2=0x5616707e16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c05e0 0x5616707e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe45cdf8640 1 -- 10.20.193.28:0/1850040809 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616703f2870 con 0x5616707c5fb0 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe45cdf8640 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707de3a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0093f0 tx=0x7fe44c019b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4119f51f99f142fb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.806+0000 7fe419ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.807+0000 7fe419ffb640 1 -- 10.20.193.28:0/1850040809 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c02a070 con 0x5616707c5fb0 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.807+0000 7fe460d87e00 1 -- 10.20.193.28:0/1850040809 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616706b33f0 con 0x5616707c5fb0 2026-02-20T03:30:35.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.807+0000 7fe460d87e00 10 client.28145 _ll_register_callbacks cb 0x7fe44c004220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:35.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.807+0000 7fe460d87e00 1 -- 10.20.193.28:0/1850040809 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe448015030 con 0x5616707c5fb0 2026-02-20T03:30:35.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.807+0000 7fe419ffb640 1 -- 10.20.193.28:0/1850040809 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x561670721150 con 0x5616707c5fb0 2026-02-20T03:30:35.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.807+0000 7fe419ffb640 1 -- 10.20.193.28:0/1850040809 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c02f6a0 con 0x5616707c5fb0 2026-02-20T03:30:35.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.807+0000 7fe419ffb640 1 -- 10.20.193.28:0/1850040809 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe44c02f900 con 0x5616707c5fb0 2026-02-20T03:30:35.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.808+0000 7fe419ffb640 1 -- 10.20.193.28:0/1850040809 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe44c03e060 con 0x5616707c5fb0 2026-02-20T03:30:35.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.808+0000 7fe460d87e00 10 client.28145 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.808+0000 7fe460d87e00 1 -- 10.20.193.28:0/1850040809 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=39}) -- 0x5616707d3500 con 0x5616707c5fb0 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe419ffb640 1 -- 10.20.193.28:0/1850040809 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7fe44c037040 con 0x5616707c5fb0 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe460d87e00 10 client.28145 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe460d87e00 10 client.28145 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe460d87e00 20 client.28145 populate_metadata read hostname 'trial028' 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5616707e96b0 0x5616708579b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe460d87e00 4 client.28145 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe460d87e00 1 -- 10.20.193.28:0/1850040809 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5616706e47c0 con 0x5616707e96b0 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe457fff640 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5616707e96b0 0x5616708579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:35.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe457fff640 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5616707e96b0 0x5616708579b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=415d81313e24b4cf server_cookie=91945fbd81e40626 in_seq=0 out_seq=0 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.809+0000 7fe419ffb640 10 client.28145 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe419ffb640 1 -- 10.20.193.28:0/1850040809 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5616706e47c0 con 0x5616707e96b0 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe419ffb640 10 client.28145 handle_command_reply: tid=0 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 client.28145 shutdown 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 -- 10.20.193.28:0/1850040809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 msgr2=0x5616707de3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707de3a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0093f0 tx=0x7fe44c019b50 comp rx=0 tx=0).stop 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 -- 10.20.193.28:0/1850040809 shutdown_connections 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5616707c5fb0 0x5616707de3a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5616707c0f60 0x5616707dde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5616707e96b0 0x5616708579b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 --2- 10.20.193.28:0/1850040809 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5616707c05e0 0x5616707e16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 -- 10.20.193.28:0/1850040809 >> 10.20.193.28:0/1850040809 conn(0x561670783240 msgr2=0x5616707d7880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:35.817 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:30:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe419ffb640 0 client.28145 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:30:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 -- 10.20.193.28:0/1850040809 shutdown_connections 2026-02-20T03:30:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.810+0000 7fe460d87e00 1 -- 10.20.193.28:0/1850040809 wait complete. 2026-02-20T03:30:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe460d87e00 20 client.28145 trim_cache size 0 max 16384 2026-02-20T03:30:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 -- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4240b0e20 msgr2=0x7fe4240b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4240b0e20 0x7fe4240b32e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009fd0 tx=0x7fe44c004bb0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 -- 10.20.193.28:0/485640189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe45810d6f0 msgr2=0x7fe458119e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:35.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe45810d6f0 0x7fe458119e40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe4440386a0 tx=0x7fe444004600 comp rx=0 tx=0).stop 2026-02-20T03:30:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 -- 10.20.193.28:0/485640189 shutdown_connections 2026-02-20T03:30:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4240b0e20 0x7fe4240b32e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe458112700 0x7fe458117430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe45810e0a0 0x7fe458116ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 --2- 10.20.193.28:0/485640189 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe45810d6f0 0x7fe458119e40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.811+0000 7fe45d5f9640 1 -- 10.20.193.28:0/485640189 >> 10.20.193.28:0/485640189 conn(0x7fe45806d500 msgr2=0x7fe45810b360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.812+0000 7fe45d5f9640 1 -- 10.20.193.28:0/485640189 shutdown_connections 2026-02-20T03:30:35.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:35.812+0000 7fe45d5f9640 1 -- 10.20.193.28:0/485640189 wait complete. 2026-02-20T03:30:35.989 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:30:36.338 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:36.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.547+0000 7fea8d41f640 1 -- 10.20.193.28:0/1848338146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea88108700 msgr2=0x7fea88108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:36.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.548+0000 7fea8d41f640 1 --2- 10.20.193.28:0/1848338146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea88108700 0x7fea88108ae0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fea74009a60 tx=0x7fea7402f270 comp rx=0 tx=0).stop 2026-02-20T03:30:36.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.548+0000 7fea8d41f640 1 -- 10.20.193.28:0/1848338146 shutdown_connections 2026-02-20T03:30:36.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.548+0000 7fea8d41f640 1 --2- 10.20.193.28:0/1848338146 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fea881030a0 0x7fea8810f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.548+0000 7fea8d41f640 1 --2- 10.20.193.28:0/1848338146 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea88102700 0x7fea88102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.548+0000 7fea8d41f640 1 --2- 10.20.193.28:0/1848338146 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea88108700 0x7fea88108ae0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.548+0000 7fea8d41f640 1 -- 10.20.193.28:0/1848338146 >> 10.20.193.28:0/1848338146 conn(0x7fea880fe440 msgr2=0x7fea88100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:36.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.549+0000 7fea8d41f640 1 -- 10.20.193.28:0/1848338146 shutdown_connections 2026-02-20T03:30:36.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.549+0000 7fea8d41f640 1 -- 10.20.193.28:0/1848338146 wait complete. 2026-02-20T03:30:36.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.549+0000 7fea8d41f640 1 Processor -- start 2026-02-20T03:30:36.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea8d41f640 1 -- start start 2026-02-20T03:30:36.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea8d41f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea88102700 0x7fea880746f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea8d41f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fea881030a0 0x7fea88074c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea8d41f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea88108700 0x7fea8806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea8d41f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fea88076fa0 con 0x7fea88108700 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea8d41f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fea88076e20 con 0x7fea881030a0 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea8d41f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fea88077120 con 0x7fea88102700 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea877fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fea881030a0 0x7fea88074c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea87fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea88102700 0x7fea880746f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea877fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fea881030a0 0x7fea88074c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37470/0 (socket says 10.20.193.28:37470) 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea877fe640 1 -- 10.20.193.28:0/3913766876 learned_addr learned my addr 10.20.193.28:0/3913766876 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.550+0000 7fea8cc1e640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea88108700 0x7fea8806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.551+0000 7fea87fff640 1 -- 10.20.193.28:0/3913766876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fea881030a0 msgr2=0x7fea88074c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.551+0000 7fea87fff640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fea881030a0 0x7fea88074c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.551+0000 7fea87fff640 1 -- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea88108700 msgr2=0x7fea8806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.551+0000 7fea87fff640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea88108700 0x7fea8806d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.551+0000 7fea87fff640 1 -- 10.20.193.28:0/3913766876 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8806e1f0 con 0x7fea88102700 2026-02-20T03:30:36.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.551+0000 7fea8cc1e640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea88108700 0x7fea8806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:30:36.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.551+0000 7fea87fff640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea88102700 0x7fea880746f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fea74009a60 tx=0x7fea74002e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:36.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.551+0000 7fea857fa640 1 -- 10.20.193.28:0/3913766876 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74046070 con 0x7fea88102700 2026-02-20T03:30:36.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.552+0000 7fea857fa640 1 -- 10.20.193.28:0/3913766876 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fea740044f0 con 0x7fea88102700 2026-02-20T03:30:36.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.552+0000 7fea857fa640 1 -- 10.20.193.28:0/3913766876 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74041410 con 0x7fea88102700 2026-02-20T03:30:36.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.552+0000 7fea8d41f640 1 -- 10.20.193.28:0/3913766876 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8806e480 con 0x7fea88102700 2026-02-20T03:30:36.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.552+0000 7fea8d41f640 1 -- 10.20.193.28:0/3913766876 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea880723f0 con 0x7fea88102700 2026-02-20T03:30:36.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.555+0000 7fea857fa640 1 -- 10.20.193.28:0/3913766876 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fea7402fca0 con 0x7fea88102700 2026-02-20T03:30:36.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.557+0000 7fea857fa640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fea5c0b0e20 0x7fea5c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.557+0000 7fea857fa640 1 -- 10.20.193.28:0/3913766876 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fea74104bf0 con 0x7fea88102700 2026-02-20T03:30:36.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.557+0000 7fea877fe640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fea5c0b0e20 0x7fea5c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.558+0000 7fea90bade00 1 Processor -- start 2026-02-20T03:30:36.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.558+0000 7fea90bade00 1 -- start start 2026-02-20T03:30:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea877fe640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fea5c0b0e20 0x7fea5c0b32e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fea8806ef40 tx=0x7fea78009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea90bade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b035fb0 0x55e24b036390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea90bade00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b030a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea90bade00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b030f60 0x55e24b03cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea90bade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e24afb0e00 con 0x55e24b035fb0 2026-02-20T03:30:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea90bade00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e24af83970 con 0x55e24b0305e0 2026-02-20T03:30:36.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea90bade00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e24af311f0 con 0x55e24b030f60 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b035fb0 0x55e24b036390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b035fb0 0x55e24b036390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49852/0 (socket says 10.20.193.28:49852) 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea87fff640 1 -- 10.20.193.28:0/546416430 learned_addr learned my addr 10.20.193.28:0/546416430 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.559+0000 7fea8cc1e640 1 --2- 10.20.193.28:0/546416430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b030f60 0x55e24b03cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.560+0000 7fea87fff640 1 -- 10.20.193.28:0/546416430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b030f60 msgr2=0x55e24b03cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.560+0000 7fea87fff640 1 --2- 10.20.193.28:0/546416430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b030f60 0x55e24b03cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.560+0000 7fea87fff640 1 -- 10.20.193.28:0/546416430 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 msgr2=0x55e24b030a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.560+0000 7fea87fff640 1 --2- 10.20.193.28:0/546416430 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b030a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.560+0000 7fea87fff640 1 -- 10.20.193.28:0/546416430 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24af443d0 con 0x55e24b035fb0 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.560+0000 7fea8cc1e640 1 --2- 10.20.193.28:0/546416430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b030f60 0x55e24b03cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:30:36.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.560+0000 7fea87fff640 1 --2- 10.20.193.28:0/546416430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b035fb0 0x55e24b036390 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fea740c87b0 tx=0x7fea74038ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf94d627eac828a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:36.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.560+0000 7fea58ce3640 1 -- 10.20.193.28:0/546416430 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea740d30d0 con 0x55e24b035fb0 2026-02-20T03:30:36.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.560+0000 7fea58ce3640 1 -- 10.20.193.28:0/546416430 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fea74033030 con 0x55e24b035fb0 2026-02-20T03:30:36.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.561+0000 7fea90bade00 1 -- 10.20.193.28:0/546416430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b035fb0 msgr2=0x55e24b036390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:36.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.561+0000 7fea90bade00 1 --2- 10.20.193.28:0/546416430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b035fb0 0x55e24b036390 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fea740c87b0 tx=0x7fea74038ac0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.561+0000 7fea90bade00 1 -- 10.20.193.28:0/546416430 shutdown_connections 2026-02-20T03:30:36.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.561+0000 7fea90bade00 1 --2- 10.20.193.28:0/546416430 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b030f60 0x55e24b03cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.561+0000 7fea90bade00 1 --2- 10.20.193.28:0/546416430 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b030a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.561+0000 7fea90bade00 1 --2- 10.20.193.28:0/546416430 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b035fb0 0x55e24b036390 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.561+0000 7fea90bade00 1 -- 10.20.193.28:0/546416430 >> 10.20.193.28:0/546416430 conn(0x55e24aff3240 msgr2=0x55e24b02ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:36.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.561+0000 7fea90bade00 1 -- 10.20.193.28:0/546416430 shutdown_connections 2026-02-20T03:30:36.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.562+0000 7fea90bade00 1 -- 10.20.193.28:0/546416430 wait complete. 2026-02-20T03:30:36.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.563+0000 7fea90bade00 1 -- start start 2026-02-20T03:30:36.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 Processor -- start 2026-02-20T03:30:36.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b04aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b049280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e24af7f8a0 con 0x55e24b030f60 2026-02-20T03:30:36.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e24ad71f50 con 0x55e24b0305e0 2026-02-20T03:30:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e24b0498c0 con 0x55e24b035fb0 2026-02-20T03:30:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49858/0 (socket says 10.20.193.28:49858) 2026-02-20T03:30:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea877fe640 1 -- 10.20.193.28:0/1765629851 learned_addr learned my addr 10.20.193.28:0/1765629851 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea877fe640 1 -- 10.20.193.28:0/1765629851 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 msgr2=0x55e24b049280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea877fe640 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b049280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea877fe640 1 -- 10.20.193.28:0/1765629851 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 msgr2=0x55e24b04aad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea877fe640 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b04aad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea877fe640 1 -- 10.20.193.28:0/1765629851 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24b0426c0 con 0x55e24b030f60 2026-02-20T03:30:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea877fe640 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04b010 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fea78011790 tx=0x7fea78004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf11215eff1e144 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea49ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea49ffb640 1 -- 10.20.193.28:0/1765629851 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7801c900 con 0x55e24b030f60 2026-02-20T03:30:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea49ffb640 1 -- 10.20.193.28:0/1765629851 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fea7801a460 con 0x55e24b030f60 2026-02-20T03:30:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea49ffb640 1 -- 10.20.193.28:0/1765629851 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78024660 con 0x55e24b030f60 2026-02-20T03:30:36.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 -- 10.20.193.28:0/1765629851 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e24ad54b40 con 0x55e24b030f60 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea49ffb640 1 -- 10.20.193.28:0/1765629851 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fea78024800 con 0x55e24b030f60 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea49ffb640 10 client.19821 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 10 client.19821 _ll_register_callbacks cb 0x55e24afbceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 -- 10.20.193.28:0/1765629851 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e24af91150 con 0x55e24b030f60 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea49ffb640 1 -- 10.20.193.28:0/1765629851 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fea7801caa0 con 0x55e24b030f60 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 10 client.19821 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 -- 10.20.193.28:0/1765629851 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=39}) -- 0x55e24af3e1e0 con 0x55e24b030f60 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea49ffb640 1 -- 10.20.193.28:0/1765629851 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7fea78018040 con 0x55e24b030f60 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 10 client.19821 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 10 client.19821 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 20 client.19821 populate_metadata read hostname 'trial028' 2026-02-20T03:30:36.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e24b059310 0x55e24b05b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 4 client.19821 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:36.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.564+0000 7fea90bade00 1 -- 10.20.193.28:0/1765629851 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e24af8b560 con 0x55e24b059310 2026-02-20T03:30:36.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.578+0000 7fea87fff640 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e24b059310 0x55e24b05b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea87fff640 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e24b059310 0x55e24b05b7a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b2c94b38afb06c69 server_cookie=2f3932476b43d2e8 in_seq=0 out_seq=0 2026-02-20T03:30:36.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea49ffb640 10 client.19821 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:30:36.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea49ffb640 1 -- 10.20.193.28:0/1765629851 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e24af8b560 con 0x55e24b059310 2026-02-20T03:30:36.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea49ffb640 10 client.19821 handle_command_reply: tid=0 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea90bade00 1 client.19821 shutdown 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea90bade00 1 -- 10.20.193.28:0/1765629851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 msgr2=0x55e24b04b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea90bade00 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04b010 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fea78011790 tx=0x7fea78004830 comp rx=0 tx=0).stop 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea90bade00 1 -- 10.20.193.28:0/1765629851 shutdown_connections 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea90bade00 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e24b059310 0x55e24b05b7a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea90bade00 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b049280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea90bade00 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04b010 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea90bade00 1 --2- 10.20.193.28:0/1765629851 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b04aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea90bade00 1 -- 10.20.193.28:0/1765629851 >> 10.20.193.28:0/1765629851 conn(0x55e24aff3240 msgr2=0x55e24b02f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:36.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.579+0000 7fea49ffb640 0 client.19821 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:30:36.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.580+0000 7fea90bade00 1 -- 10.20.193.28:0/1765629851 shutdown_connections 2026-02-20T03:30:36.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.580+0000 7fea90bade00 1 -- 10.20.193.28:0/1765629851 wait complete. 2026-02-20T03:30:36.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.580+0000 7fea90bade00 20 client.19821 trim_cache size 0 max 16384 2026-02-20T03:30:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.587+0000 7fea90bade00 1 Processor -- start 2026-02-20T03:30:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.587+0000 7fea90bade00 1 -- start start 2026-02-20T03:30:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea90bade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b0305e0 0x55e24b048080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea90bade00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b030f60 0x55e24b0464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea90bade00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b046a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea90bade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c012740 con 0x55e24b0305e0 2026-02-20T03:30:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea90bade00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c00ffb0 con 0x55e24b030f60 2026-02-20T03:30:36.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea90bade00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c00de00 con 0x55e24b035fb0 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea8cc1e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b046a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea8cc1e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b046a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45508/0 (socket says 10.20.193.28:45508) 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b0305e0 0x55e24b048080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea877fe640 1 --2- 10.20.193.28:0/1474071844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b030f60 0x55e24b0464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea8cc1e640 1 -- 10.20.193.28:0/1474071844 learned_addr learned my addr 10.20.193.28:0/1474071844 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea877fe640 1 -- 10.20.193.28:0/1474071844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 msgr2=0x55e24b046a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea877fe640 1 --2- 10.20.193.28:0/1474071844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b046a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea877fe640 1 -- 10.20.193.28:0/1474071844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b0305e0 msgr2=0x55e24b048080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea877fe640 1 --2- 10.20.193.28:0/1474071844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b0305e0 0x55e24b048080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea877fe640 1 -- 10.20.193.28:0/1474071844 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24b0424f0 con 0x55e24b030f60 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.588+0000 7fea87fff640 1 --2- 10.20.193.28:0/1474071844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b0305e0 0x55e24b048080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea877fe640 1 --2- 10.20.193.28:0/1474071844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b030f60 0x55e24b0464e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fea78016040 tx=0x7fea7802a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e703b26fab6d19e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea4bfff640 1 -- 10.20.193.28:0/1474071844 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78011440 con 0x55e24b030f60 2026-02-20T03:30:36.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea4bfff640 1 -- 10.20.193.28:0/1474071844 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fea7803b070 con 0x55e24b030f60 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea4bfff640 1 -- 10.20.193.28:0/1474071844 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea780366c0 con 0x55e24b030f60 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea90bade00 1 -- 10.20.193.28:0/1474071844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b030f60 msgr2=0x55e24b0464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea90bade00 1 --2- 10.20.193.28:0/1474071844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b030f60 0x55e24b0464e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fea78016040 tx=0x7fea7802a000 comp rx=0 tx=0).stop 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea90bade00 1 -- 10.20.193.28:0/1474071844 shutdown_connections 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea90bade00 1 --2- 10.20.193.28:0/1474071844 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b046a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea90bade00 1 --2- 10.20.193.28:0/1474071844 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b030f60 0x55e24b0464e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea90bade00 1 --2- 10.20.193.28:0/1474071844 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b0305e0 0x55e24b048080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea90bade00 1 -- 10.20.193.28:0/1474071844 >> 10.20.193.28:0/1474071844 conn(0x55e24aff3240 msgr2=0x55e24b047970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea90bade00 1 -- 10.20.193.28:0/1474071844 shutdown_connections 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.589+0000 7fea90bade00 1 -- 10.20.193.28:0/1474071844 wait complete. 2026-02-20T03:30:36.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.590+0000 7fea90bade00 1 -- start start 2026-02-20T03:30:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.590+0000 7fea90bade00 1 Processor -- start 2026-02-20T03:30:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.590+0000 7fea90bade00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b050ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.590+0000 7fea90bade00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea90bade00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b04dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea90bade00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c00e470 con 0x55e24b030f60 2026-02-20T03:30:36.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea90bade00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c00f8e0 con 0x55e24b0305e0 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea90bade00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fea2c00eb40 con 0x55e24b035fb0 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea87fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b050ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49876/0 (socket says 10.20.193.28:49876) 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea877fe640 1 -- 10.20.193.28:0/218800267 learned_addr learned my addr 10.20.193.28:0/218800267 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea87fff640 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b050ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37526/0 (socket says 10.20.193.28:37526) 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea8cc1e640 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b04dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea877fe640 1 -- 10.20.193.28:0/218800267 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 msgr2=0x55e24b04dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea877fe640 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b04dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea877fe640 1 -- 10.20.193.28:0/218800267 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 msgr2=0x55e24b050ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea877fe640 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b050ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea877fe640 1 -- 10.20.193.28:0/218800267 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24ac62870 con 0x55e24b030f60 2026-02-20T03:30:36.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea877fe640 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04d9a0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fea78038040 tx=0x7fea7801aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aaa2c2ae9cb747e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea49ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea49ffb640 1 -- 10.20.193.28:0/218800267 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78011440 con 0x55e24b030f60 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.591+0000 7fea90bade00 1 -- 10.20.193.28:0/218800267 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e24af233f0 con 0x55e24b030f60 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 10 client.19827 _ll_register_callbacks cb 0x7fea78004160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 1 -- 10.20.193.28:0/218800267 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e24af547c0 con 0x55e24b030f60 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea49ffb640 1 -- 10.20.193.28:0/218800267 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e24af91150 con 0x55e24b030f60 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea49ffb640 1 -- 10.20.193.28:0/218800267 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea78005420 con 0x55e24b030f60 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea49ffb640 1 -- 10.20.193.28:0/218800267 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fea780055c0 con 0x55e24b030f60 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea49ffb640 1 -- 10.20.193.28:0/218800267 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fea78050050 con 0x55e24b030f60 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 10 client.19827 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 1 -- 10.20.193.28:0/218800267 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=39}) -- 0x55e24b0431e0 con 0x55e24b030f60 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea49ffb640 1 -- 10.20.193.28:0/218800267 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7fea78018040 con 0x55e24b030f60 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 10 client.19827 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 10 client.19827 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 20 client.19827 populate_metadata read hostname 'trial028' 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e24b0c4f70 0x55e24b0c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:36.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 4 client.19827 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea90bade00 1 -- 10.20.193.28:0/218800267 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e24af35ab0 con 0x55e24b0c4f70 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.592+0000 7fea87fff640 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e24b0c4f70 0x55e24b0c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea87fff640 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e24b0c4f70 0x55e24b0c7400 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=765f3707f0b0c1fa server_cookie=3ac67eb49037bd43 in_seq=0 out_seq=0 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea49ffb640 10 client.19827 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea49ffb640 1 -- 10.20.193.28:0/218800267 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e24af35ab0 con 0x55e24b0c4f70 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea49ffb640 10 client.19827 handle_command_reply: tid=0 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea90bade00 1 client.19827 shutdown 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea90bade00 1 -- 10.20.193.28:0/218800267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 msgr2=0x55e24b04d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea90bade00 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04d9a0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fea78038040 tx=0x7fea7801aaa0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea90bade00 1 -- 10.20.193.28:0/218800267 shutdown_connections 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea90bade00 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e24b0c4f70 0x55e24b0c7400 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea90bade00 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e24b035fb0 0x55e24b04dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea90bade00 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e24b030f60 0x55e24b04d9a0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea90bade00 1 --2- 10.20.193.28:0/218800267 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e24b0305e0 0x55e24b050ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea90bade00 1 -- 10.20.193.28:0/218800267 >> 10.20.193.28:0/218800267 conn(0x55e24aff3240 msgr2=0x55e24b048190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.593+0000 7fea49ffb640 0 client.19827 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea90bade00 1 -- 10.20.193.28:0/218800267 shutdown_connections 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea90bade00 1 -- 10.20.193.28:0/218800267 wait complete. 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea90bade00 20 client.19827 trim_cache size 0 max 16384 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 -- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fea5c0b0e20 msgr2=0x7fea5c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fea5c0b0e20 0x7fea5c0b32e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fea8806ef40 tx=0x7fea78009290 comp rx=0 tx=0).stop 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 -- 10.20.193.28:0/3913766876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea88102700 msgr2=0x7fea880746f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea88102700 0x7fea880746f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fea74009a60 tx=0x7fea74002e40 comp rx=0 tx=0).stop 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 -- 10.20.193.28:0/3913766876 shutdown_connections 2026-02-20T03:30:36.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fea5c0b0e20 0x7fea5c0b32e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fea88108700 0x7fea8806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fea881030a0 0x7fea88074c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 --2- 10.20.193.28:0/3913766876 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fea88102700 0x7fea880746f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 -- 10.20.193.28:0/3913766876 >> 10.20.193.28:0/3913766876 conn(0x7fea880fe440 msgr2=0x7fea880fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 -- 10.20.193.28:0/3913766876 shutdown_connections 2026-02-20T03:30:36.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:36.594+0000 7fea8d41f640 1 -- 10.20.193.28:0/3913766876 wait complete. 2026-02-20T03:30:36.695 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:30:36.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 72297 88.17 MB/sec execute 7 sec latency 44.550 ms 2026-02-20T03:30:36.986 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:37.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.235+0000 7f6872e97640 1 -- 10.20.193.28:0/1542575174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f686c109ba0 msgr2=0x7f686c115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:37.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.235+0000 7f6872e97640 1 --2- 10.20.193.28:0/1542575174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f686c109ba0 0x7f686c115d10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f686800b0a0 tx=0x7f686802f450 comp rx=0 tx=0).stop 2026-02-20T03:30:37.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.235+0000 7f6872e97640 1 -- 10.20.193.28:0/1542575174 shutdown_connections 2026-02-20T03:30:37.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.235+0000 7f6872e97640 1 --2- 10.20.193.28:0/1542575174 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f686c109ba0 0x7f686c115d10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.235+0000 7f6872e97640 1 --2- 10.20.193.28:0/1542575174 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f686c109220 0x7f686c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.235+0000 7f6872e97640 1 --2- 10.20.193.28:0/1542575174 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f686c10eef0 0x7f686c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.235+0000 7f6872e97640 1 -- 10.20.193.28:0/1542575174 >> 10.20.193.28:0/1542575174 conn(0x7f686c078600 msgr2=0x7f686c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:37.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.235+0000 7f6872e97640 1 -- 10.20.193.28:0/1542575174 shutdown_connections 2026-02-20T03:30:37.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.235+0000 7f6872e97640 1 -- 10.20.193.28:0/1542575174 wait complete. 2026-02-20T03:30:37.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.236+0000 7f6872e97640 1 Processor -- start 2026-02-20T03:30:37.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.236+0000 7f6872e97640 1 -- start start 2026-02-20T03:30:37.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.237+0000 7f6872e97640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f686c109220 0x7f686c1a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.237+0000 7f6872e97640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f686c109ba0 0x7f686c1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.237+0000 7f6872e97640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f686c10eef0 0x7f686c1a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.238+0000 7f6872e97640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f686c119050 con 0x7f686c109ba0 2026-02-20T03:30:37.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.238+0000 7f6872e97640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f686c118ed0 con 0x7f686c109220 2026-02-20T03:30:37.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.238+0000 7f6872e97640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f686c1191d0 con 0x7f686c10eef0 2026-02-20T03:30:37.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.238+0000 7f6872696640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f686c10eef0 0x7f686c1a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.238+0000 7f6871e95640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f686c109220 0x7f686c1a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.238+0000 7f6872696640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f686c10eef0 0x7f686c1a5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45530/0 (socket says 10.20.193.28:45530) 2026-02-20T03:30:37.240 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.238+0000 7f6872696640 1 -- 10.20.193.28:0/3349820112 learned_addr learned my addr 10.20.193.28:0/3349820112 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:37.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.238+0000 7f6872696640 1 -- 10.20.193.28:0/3349820112 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f686c109220 msgr2=0x7f686c1a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:37.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.239+0000 7f6872696640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f686c109220 0x7f686c1a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.239+0000 7f6872696640 1 -- 10.20.193.28:0/3349820112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f686c109ba0 msgr2=0x7f686c1a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:37.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.239+0000 7f6872696640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f686c109ba0 0x7f686c1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.239+0000 7f6872696640 1 -- 10.20.193.28:0/3349820112 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c1a6370 con 0x7f686c10eef0 2026-02-20T03:30:37.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.239+0000 7f6872696640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f686c10eef0 0x7f686c1a5c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f686800c090 tx=0x7f6868004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:37.241 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.239+0000 7f685affd640 1 -- 10.20.193.28:0/3349820112 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68680092d0 con 0x7f686c10eef0 2026-02-20T03:30:37.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.239+0000 7f6872e97640 1 -- 10.20.193.28:0/3349820112 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c1a6600 con 0x7f686c10eef0 2026-02-20T03:30:37.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.239+0000 7f6872e97640 1 -- 10.20.193.28:0/3349820112 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c1adf40 con 0x7f686c10eef0 2026-02-20T03:30:37.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.240+0000 7f685affd640 1 -- 10.20.193.28:0/3349820112 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6868004280 con 0x7f686c10eef0 2026-02-20T03:30:37.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.240+0000 7f685affd640 1 -- 10.20.193.28:0/3349820112 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68680092d0 con 0x7f686c10eef0 2026-02-20T03:30:37.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.246+0000 7f685affd640 1 -- 10.20.193.28:0/3349820112 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6868038550 con 0x7f686c10eef0 2026-02-20T03:30:37.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.253+0000 7f6876625e00 1 Processor -- start 2026-02-20T03:30:37.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.253+0000 7f6876625e00 1 -- start start 2026-02-20T03:30:37.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.254+0000 7f6876625e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f436efb0 0x5601f436f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.254+0000 7f6876625e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f43695e0 0x5601f4369a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.254+0000 7f6876625e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f4369f60 0x5601f4375de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.254+0000 7f6876625e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5601f42e9e00 con 0x5601f4369f60 2026-02-20T03:30:37.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.254+0000 7f6876625e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5601f42bc970 con 0x5601f436efb0 2026-02-20T03:30:37.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.254+0000 7f6876625e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5601f426a1f0 con 0x5601f43695e0 2026-02-20T03:30:37.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.255+0000 7f685affd640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68480b1020 0x7f68480b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.255+0000 7f685affd640 1 -- 10.20.193.28:0/3349820112 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f6868105cf0 con 0x7f686c10eef0 2026-02-20T03:30:37.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871e95640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f43695e0 0x5601f4369a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871e95640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f43695e0 0x5601f4369a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45536/0 (socket says 10.20.193.28:45536) 2026-02-20T03:30:37.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871e95640 1 -- 10.20.193.28:0/1606666378 learned_addr learned my addr 10.20.193.28:0/1606666378 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871694640 1 --2- 10.20.193.28:0/1606666378 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f436efb0 0x5601f436f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6872696640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68480b1020 0x7f68480b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871e95640 1 -- 10.20.193.28:0/1606666378 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f436efb0 msgr2=0x5601f436f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871e95640 1 --2- 10.20.193.28:0/1606666378 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f436efb0 0x5601f436f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871e95640 1 -- 10.20.193.28:0/1606666378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f4369f60 msgr2=0x5601f4375de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871e95640 1 --2- 10.20.193.28:0/1606666378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f4369f60 0x5601f4375de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871e95640 1 -- 10.20.193.28:0/1606666378 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f427d3d0 con 0x5601f43695e0 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.256+0000 7f6871e95640 1 --2- 10.20.193.28:0/1606666378 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f43695e0 0x5601f4369a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f685c0045f0 tx=0x7f685c009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f4238952c199fe7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.257+0000 7f683a4e6640 1 -- 10.20.193.28:0/1606666378 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c010630 con 0x5601f43695e0 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.257+0000 7f6872696640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68480b1020 0x7f68480b34e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f68680ca9f0 tx=0x7f6868009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.257+0000 7f683a4e6640 1 -- 10.20.193.28:0/1606666378 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f685c009e50 con 0x5601f43695e0 2026-02-20T03:30:37.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.257+0000 7f683a4e6640 1 -- 10.20.193.28:0/1606666378 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c00ec40 con 0x5601f43695e0 2026-02-20T03:30:37.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.257+0000 7f6876625e00 1 -- 10.20.193.28:0/1606666378 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f43695e0 msgr2=0x5601f4369a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:37.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.257+0000 7f6876625e00 1 --2- 10.20.193.28:0/1606666378 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f43695e0 0x5601f4369a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f685c0045f0 tx=0x7f685c009c50 comp rx=0 tx=0).stop 2026-02-20T03:30:37.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.258+0000 7f6876625e00 1 -- 10.20.193.28:0/1606666378 shutdown_connections 2026-02-20T03:30:37.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.258+0000 7f6876625e00 1 --2- 10.20.193.28:0/1606666378 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f4369f60 0x5601f4375de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.258+0000 7f6876625e00 1 --2- 10.20.193.28:0/1606666378 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f43695e0 0x5601f4369a20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.258+0000 7f6876625e00 1 --2- 10.20.193.28:0/1606666378 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f436efb0 0x5601f436f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.258+0000 7f6876625e00 1 -- 10.20.193.28:0/1606666378 >> 10.20.193.28:0/1606666378 conn(0x5601f432c240 msgr2=0x5601f4367ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:37.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.258+0000 7f6876625e00 1 -- 10.20.193.28:0/1606666378 shutdown_connections 2026-02-20T03:30:37.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.258+0000 7f6876625e00 1 -- 10.20.193.28:0/1606666378 wait complete. 2026-02-20T03:30:37.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.260+0000 7f6876625e00 1 -- start start 2026-02-20T03:30:37.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.260+0000 7f6876625e00 1 Processor -- start 2026-02-20T03:30:37.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.260+0000 7f6876625e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f43695e0 0x5601f4383b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.260+0000 7f6876625e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 0x5601f4384090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.260+0000 7f6876625e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f436efb0 0x5601f4382290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.260+0000 7f6876625e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5601f42b88a0 con 0x5601f436efb0 2026-02-20T03:30:37.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.260+0000 7f6876625e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5601f40aaf50 con 0x5601f43695e0 2026-02-20T03:30:37.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.260+0000 7f6876625e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5601f4382a10 con 0x5601f4369f60 2026-02-20T03:30:37.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871694640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f43695e0 0x5601f4383b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871e95640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 0x5601f4384090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871e95640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 0x5601f4384090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45552/0 (socket says 10.20.193.28:45552) 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871e95640 1 -- 10.20.193.28:0/1414262847 learned_addr learned my addr 10.20.193.28:0/1414262847 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871694640 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f436efb0 0x5601f4382290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871e95640 1 -- 10.20.193.28:0/1414262847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f43695e0 msgr2=0x5601f4383b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871e95640 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f43695e0 0x5601f4383b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871e95640 1 -- 10.20.193.28:0/1414262847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f436efb0 msgr2=0x5601f4382290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871e95640 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f436efb0 0x5601f4382290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.261+0000 7f6871e95640 1 -- 10.20.193.28:0/1414262847 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f437ba30 con 0x5601f4369f60 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.262+0000 7f6871e95640 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 0x5601f4384090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f685c00ec30 tx=0x7f685c00ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e74d3e27e3262ef5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.262+0000 7f68277fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:30:37.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.262+0000 7f68277fe640 1 -- 10.20.193.28:0/1414262847 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c0047c0 con 0x5601f4369f60 2026-02-20T03:30:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.262+0000 7f68277fe640 1 -- 10.20.193.28:0/1414262847 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f685c004e00 con 0x5601f4369f60 2026-02-20T03:30:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.262+0000 7f68277fe640 1 -- 10.20.193.28:0/1414262847 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c028690 con 0x5601f4369f60 2026-02-20T03:30:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.262+0000 7f6876625e00 1 -- 10.20.193.28:0/1414262847 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f408db40 con 0x5601f4369f60 2026-02-20T03:30:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.262+0000 7f68277fe640 1 -- 10.20.193.28:0/1414262847 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f685c010430 con 0x5601f4369f60 2026-02-20T03:30:37.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.262+0000 7f68277fe640 10 client.28168 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:30:37.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 10 client.28168 _ll_register_callbacks cb 0x5601f42f5eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:37.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 1 -- 10.20.193.28:0/1414262847 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5601f42ca150 con 0x5601f4369f60 2026-02-20T03:30:37.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f68277fe640 1 -- 10.20.193.28:0/1414262847 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f685c004960 con 0x5601f4369f60 2026-02-20T03:30:37.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 10 client.28168 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 1 -- 10.20.193.28:0/1414262847 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=39}) -- 0x5601f42771e0 con 0x5601f4369f60 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f68277fe640 1 -- 10.20.193.28:0/1414262847 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7f685c005050 con 0x5601f4369f60 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 10 client.28168 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 10 client.28168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 20 client.28168 populate_metadata read hostname 'trial028' 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5601f4392210 0x5601f4394600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 4 client.28168 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.263+0000 7f6876625e00 1 -- 10.20.193.28:0/1414262847 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601f42c4560 con 0x5601f4392210 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.264+0000 7f6871694640 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5601f4392210 0x5601f4394600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.265+0000 7f6871694640 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5601f4392210 0x5601f4394600 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e3f55dd0746eaa server_cookie=b249e87e5b58b423 in_seq=0 out_seq=0 2026-02-20T03:30:37.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.265+0000 7f68277fe640 10 client.28168 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:37.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f68277fe640 1 -- 10.20.193.28:0/1414262847 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5601f42c4560 con 0x5601f4392210 2026-02-20T03:30:37.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f68277fe640 10 client.28168 handle_command_reply: tid=0 2026-02-20T03:30:37.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f6876625e00 1 client.28168 shutdown 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f6876625e00 1 -- 10.20.193.28:0/1414262847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 msgr2=0x5601f4384090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f6876625e00 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 0x5601f4384090 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f685c00ec30 tx=0x7f685c00ec60 comp rx=0 tx=0).stop 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f6876625e00 1 -- 10.20.193.28:0/1414262847 shutdown_connections 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f6876625e00 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5601f4392210 0x5601f4394600 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f6876625e00 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f436efb0 0x5601f4382290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f6876625e00 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 0x5601f4384090 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f6876625e00 1 --2- 10.20.193.28:0/1414262847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f43695e0 0x5601f4383b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f6876625e00 1 -- 10.20.193.28:0/1414262847 >> 10.20.193.28:0/1414262847 conn(0x5601f432c240 msgr2=0x5601f43683f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.266+0000 7f68277fe640 0 client.28168 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.267+0000 7f6876625e00 1 -- 10.20.193.28:0/1414262847 shutdown_connections 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.267+0000 7f6876625e00 1 -- 10.20.193.28:0/1414262847 wait complete. 2026-02-20T03:30:37.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.267+0000 7f6876625e00 20 client.28168 trim_cache size 0 max 16384 2026-02-20T03:30:37.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.274+0000 7f6876625e00 1 Processor -- start 2026-02-20T03:30:37.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.274+0000 7f6876625e00 1 -- start start 2026-02-20T03:30:37.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6876625e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4361d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6876625e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f4369f60 0x5601f4399ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6876625e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f436efb0 0x5601f439a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6876625e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f68180126d0 con 0x5601f43695e0 2026-02-20T03:30:37.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6876625e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f681800ff40 con 0x5601f4369f60 2026-02-20T03:30:37.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6876625e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f681800dd90 con 0x5601f436efb0 2026-02-20T03:30:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6871e95640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f4369f60 0x5601f4399ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6871e95640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f4369f60 0x5601f4399ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37582/0 (socket says 10.20.193.28:37582) 2026-02-20T03:30:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6871e95640 1 -- 10.20.193.28:0/3478594437 learned_addr learned my addr 10.20.193.28:0/3478594437 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6871694640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f436efb0 0x5601f439a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.275+0000 7f6871694640 1 --2- 10.20.193.28:0/3478594437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4361d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.276+0000 7f6871e95640 1 -- 10.20.193.28:0/3478594437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f436efb0 msgr2=0x5601f439a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.276+0000 7f6871e95640 1 --2- 10.20.193.28:0/3478594437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f436efb0 0x5601f439a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.276+0000 7f6871e95640 1 -- 10.20.193.28:0/3478594437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 msgr2=0x5601f4361d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:37.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.276+0000 7f6871e95640 1 --2- 10.20.193.28:0/3478594437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4361d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.276+0000 7f6871e95640 1 -- 10.20.193.28:0/3478594437 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f437b860 con 0x5601f4369f60 2026-02-20T03:30:37.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.276+0000 7f6871694640 1 --2- 10.20.193.28:0/3478594437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4361d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:30:37.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.276+0000 7f6871e95640 1 --2- 10.20.193.28:0/3478594437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f4369f60 0x5601f4399ea0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f685c005a90 tx=0x7f685c02c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d019b1934d74e77 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:37.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.276+0000 7f6839ce5640 1 -- 10.20.193.28:0/3478594437 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c036020 con 0x5601f4369f60 2026-02-20T03:30:37.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.276+0000 7f6839ce5640 1 -- 10.20.193.28:0/3478594437 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f685c01f040 con 0x5601f4369f60 2026-02-20T03:30:37.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6839ce5640 1 -- 10.20.193.28:0/3478594437 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685c005000 con 0x5601f4369f60 2026-02-20T03:30:37.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6876625e00 1 -- 10.20.193.28:0/3478594437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f4369f60 msgr2=0x5601f4399ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:37.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6876625e00 1 --2- 10.20.193.28:0/3478594437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f4369f60 0x5601f4399ea0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f685c005a90 tx=0x7f685c02c000 comp rx=0 tx=0).stop 2026-02-20T03:30:37.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6876625e00 1 -- 10.20.193.28:0/3478594437 shutdown_connections 2026-02-20T03:30:37.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6876625e00 1 --2- 10.20.193.28:0/3478594437 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f436efb0 0x5601f439a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6876625e00 1 --2- 10.20.193.28:0/3478594437 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f4369f60 0x5601f4399ea0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6876625e00 1 --2- 10.20.193.28:0/3478594437 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4361d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6876625e00 1 -- 10.20.193.28:0/3478594437 >> 10.20.193.28:0/3478594437 conn(0x5601f432c240 msgr2=0x5601f437ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:37.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6876625e00 1 -- 10.20.193.28:0/3478594437 shutdown_connections 2026-02-20T03:30:37.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.277+0000 7f6876625e00 1 -- 10.20.193.28:0/3478594437 wait complete. 2026-02-20T03:30:37.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.278+0000 7f6876625e00 1 -- start start 2026-02-20T03:30:37.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.278+0000 7f6876625e00 1 Processor -- start 2026-02-20T03:30:37.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.279+0000 7f6876625e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4385f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.279+0000 7f6876625e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 0x5601f4386490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.279+0000 7f6876625e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f436efb0 0x5601f43fc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.279+0000 7f6876625e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f681800e400 con 0x5601f43695e0 2026-02-20T03:30:37.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.279+0000 7f6876625e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f681800f870 con 0x5601f436efb0 2026-02-20T03:30:37.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.279+0000 7f6876625e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f681800ead0 con 0x5601f4369f60 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.279+0000 7f6871694640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4385f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.279+0000 7f6871694640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4385f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49940/0 (socket says 10.20.193.28:49940) 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.279+0000 7f6871694640 1 -- 10.20.193.28:0/2241063845 learned_addr learned my addr 10.20.193.28:0/2241063845 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.280+0000 7f6871694640 1 -- 10.20.193.28:0/2241063845 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 msgr2=0x5601f4386490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.280+0000 7f6871694640 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 0x5601f4386490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.280+0000 7f6871694640 1 -- 10.20.193.28:0/2241063845 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f436efb0 msgr2=0x5601f43fc070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.280+0000 7f6871694640 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f436efb0 0x5601f43fc070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.280+0000 7f6871694640 1 -- 10.20.193.28:0/2241063845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f3f9b870 con 0x5601f43695e0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.280+0000 7f6871694640 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4385f50 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x5601f4394e40 tx=0x7f686000dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbce932b7f09a180 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.280+0000 7f68277fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.280+0000 7f68277fe640 1 -- 10.20.193.28:0/2241063845 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600048a0 con 0x5601f43695e0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f68277fe640 1 -- 10.20.193.28:0/2241063845 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6860005050 con 0x5601f43695e0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f68277fe640 1 -- 10.20.193.28:0/2241063845 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860012690 con 0x5601f43695e0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f6876625e00 1 -- 10.20.193.28:0/2241063845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f425c3f0 con 0x5601f43695e0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f68277fe640 1 -- 10.20.193.28:0/2241063845 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f6860012830 con 0x5601f43695e0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f68277fe640 10 client.19833 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f6876625e00 10 client.19833 _ll_register_callbacks cb 0x7f685c004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:37.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f6876625e00 1 -- 10.20.193.28:0/2241063845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f685c009e50 con 0x5601f43695e0 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f68277fe640 1 -- 10.20.193.28:0/2241063845 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f686002b060 con 0x5601f43695e0 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f6876625e00 10 client.19833 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.281+0000 7f6876625e00 1 -- 10.20.193.28:0/2241063845 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=39}) -- 0x5601f437c550 con 0x5601f43695e0 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.282+0000 7f68277fe640 1 -- 10.20.193.28:0/2241063845 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7f6860004a40 con 0x5601f43695e0 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.283+0000 7f6876625e00 10 client.19833 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.283+0000 7f6876625e00 10 client.19833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.283+0000 7f6876625e00 20 client.19833 populate_metadata read hostname 'trial028' 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.283+0000 7f6876625e00 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5601f43fdca0 0x5601f4400160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.283+0000 7f6876625e00 4 client.19833 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:30:37.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.283+0000 7f6876625e00 1 -- 10.20.193.28:0/2241063845 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601f428d7c0 con 0x5601f43fdca0 2026-02-20T03:30:37.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.292+0000 7f6871e95640 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5601f43fdca0 0x5601f4400160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:37.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.293+0000 7f6871e95640 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5601f43fdca0 0x5601f4400160 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98e555d28d37eeb9 server_cookie=f4de896628a6b6cb in_seq=0 out_seq=0 2026-02-20T03:30:37.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.293+0000 7f68277fe640 10 client.19833 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:37.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.293+0000 7f68277fe640 1 -- 10.20.193.28:0/2241063845 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601f428d7c0 con 0x5601f43fdca0 2026-02-20T03:30:37.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.293+0000 7f68277fe640 10 client.19833 handle_command_reply: tid=0 2026-02-20T03:30:37.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.293+0000 7f6876625e00 1 client.19833 shutdown 2026-02-20T03:30:37.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 -- 10.20.193.28:0/2241063845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 msgr2=0x5601f4385f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:37.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4385f50 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x5601f4394e40 tx=0x7f686000dfa0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 -- 10.20.193.28:0/2241063845 shutdown_connections 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5601f43fdca0 0x5601f4400160 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5601f436efb0 0x5601f43fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601f4369f60 0x5601f4386490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 --2- 10.20.193.28:0/2241063845 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601f43695e0 0x5601f4385f50 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 -- 10.20.193.28:0/2241063845 >> 10.20.193.28:0/2241063845 conn(0x5601f432c240 msgr2=0x5601f437f240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f68277fe640 0 client.19833 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 -- 10.20.193.28:0/2241063845 shutdown_connections 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.294+0000 7f6876625e00 1 -- 10.20.193.28:0/2241063845 wait complete. 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.295+0000 7f6876625e00 20 client.19833 trim_cache size 0 max 16384 2026-02-20T03:30:37.297 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.295+0000 7f6872e97640 1 -- 10.20.193.28:0/3349820112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68480b1020 msgr2=0x7f68480b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.295+0000 7f6872e97640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68480b1020 0x7f68480b34e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f68680ca9f0 tx=0x7f6868009570 comp rx=0 tx=0).stop 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.295+0000 7f6872e97640 1 -- 10.20.193.28:0/3349820112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f686c10eef0 msgr2=0x7f686c1a5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.295+0000 7f6872e97640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f686c10eef0 0x7f686c1a5c90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f686800c090 tx=0x7f6868004a60 comp rx=0 tx=0).stop 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.296+0000 7f6872e97640 1 -- 10.20.193.28:0/3349820112 shutdown_connections 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.296+0000 7f6872e97640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f68480b1020 0x7f68480b34e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.296+0000 7f6872e97640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f686c10eef0 0x7f686c1a5c90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.296+0000 7f6872e97640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f686c109ba0 0x7f686c1a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.296+0000 7f6872e97640 1 --2- 10.20.193.28:0/3349820112 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f686c109220 0x7f686c1a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.296+0000 7f6872e97640 1 -- 10.20.193.28:0/3349820112 >> 10.20.193.28:0/3349820112 conn(0x7f686c078600 msgr2=0x7f686c079d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.296+0000 7f6872e97640 1 -- 10.20.193.28:0/3349820112 shutdown_connections 2026-02-20T03:30:37.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:37.296+0000 7f6872e97640 1 -- 10.20.193.28:0/3349820112 wait complete. 2026-02-20T03:30:37.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:37 trial126 ceph-mon[38476]: pgmap v663: 129 pgs: 129 active+clean; 520 MiB data, 6.2 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 11 MiB/s wr, 1.50k op/s 2026-02-20T03:30:37.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:37 trial028 ceph-mon[38552]: pgmap v663: 129 pgs: 129 active+clean; 520 MiB data, 6.2 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 11 MiB/s wr, 1.50k op/s 2026-02-20T03:30:37.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 73808 85.35 MB/sec execute 8 sec latency 48.969 ms 2026-02-20T03:30:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:37 trial177 ceph-mon[43181]: pgmap v663: 129 pgs: 129 active+clean; 520 MiB data, 6.2 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 11 MiB/s wr, 1.50k op/s 2026-02-20T03:30:38.471 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:30:38.471 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:30:38.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 75581 88.41 MB/sec execute 9 sec latency 32.289 ms 2026-02-20T03:30:38.741 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:38.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.888+0000 7fe4cbfff640 1 -- 10.20.193.28:0/3574396931 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc02fbc0 con 0x7fe4d40a5fb0 2026-02-20T03:30:38.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.888+0000 7fe4e277c640 1 -- 10.20.193.28:0/3574396931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a5fb0 msgr2=0x7fe4d40a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:38.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.888+0000 7fe4e277c640 1 --2- 10.20.193.28:0/3574396931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a5fb0 0x7fe4d40a6430 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009960 tx=0x7fe4cc02f160 comp rx=0 tx=0).stop 2026-02-20T03:30:38.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.890+0000 7fe4e277c640 1 -- 10.20.193.28:0/3574396931 shutdown_connections 2026-02-20T03:30:38.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.890+0000 7fe4e277c640 1 --2- 10.20.193.28:0/3574396931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe4d40a6970 0x7fe4d40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.890+0000 7fe4e277c640 1 --2- 10.20.193.28:0/3574396931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a5fb0 0x7fe4d40a6430 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.890+0000 7fe4e277c640 1 --2- 10.20.193.28:0/3574396931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4d40a4dc0 0x7fe4d40a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.890+0000 7fe4e277c640 1 -- 10.20.193.28:0/3574396931 >> 10.20.193.28:0/3574396931 conn(0x7fe4d40a0500 msgr2=0x7fe4d40a2960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:38.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.890+0000 7fe4e277c640 1 -- 10.20.193.28:0/3574396931 shutdown_connections 2026-02-20T03:30:38.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.890+0000 7fe4e277c640 1 -- 10.20.193.28:0/3574396931 wait complete. 2026-02-20T03:30:38.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.891+0000 7fe4e277c640 1 Processor -- start 2026-02-20T03:30:38.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.891+0000 7fe4e277c640 1 -- start start 2026-02-20T03:30:38.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.891+0000 7fe4e277c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a4dc0 0x7fe4d413b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.891+0000 7fe4e277c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe4d40a5fb0 0x7fe4d413b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.891+0000 7fe4e277c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4d40a6970 0x7fe4d4137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.891+0000 7fe4e277c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d40b03e0 con 0x7fe4d40a4dc0 2026-02-20T03:30:38.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.891+0000 7fe4e277c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d40b0260 con 0x7fe4d40a5fb0 2026-02-20T03:30:38.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.891+0000 7fe4e277c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d40b0560 con 0x7fe4d40a6970 2026-02-20T03:30:38.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.892+0000 7fe4e177a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a4dc0 0x7fe4d413b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.895 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.892+0000 7fe4e177a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a4dc0 0x7fe4d413b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49964/0 (socket says 10.20.193.28:49964) 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.892+0000 7fe4e177a640 1 -- 10.20.193.28:0/1759068821 learned_addr learned my addr 10.20.193.28:0/1759068821 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.892+0000 7fe4e177a640 1 -- 10.20.193.28:0/1759068821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4d40a6970 msgr2=0x7fe4d4137ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.892+0000 7fe4e177a640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4d40a6970 0x7fe4d4137ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.892+0000 7fe4e177a640 1 -- 10.20.193.28:0/1759068821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe4d40a5fb0 msgr2=0x7fe4d413b8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.892+0000 7fe4e177a640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe4d40a5fb0 0x7fe4d413b8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.892+0000 7fe4e177a640 1 -- 10.20.193.28:0/1759068821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d4138760 con 0x7fe4d40a4dc0 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e177a640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a4dc0 0x7fe4d413b390 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8007eb0 tx=0x7fe4d800d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4ca7fc640 1 -- 10.20.193.28:0/1759068821 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8019070 con 0x7fe4d40a4dc0 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4ca7fc640 1 -- 10.20.193.28:0/1759068821 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe4d8002c60 con 0x7fe4d40a4dc0 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4ca7fc640 1 -- 10.20.193.28:0/1759068821 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80147b0 con 0x7fe4d40a4dc0 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e277c640 1 -- 10.20.193.28:0/1759068821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d414d590 con 0x7fe4d40a4dc0 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e277c640 1 -- 10.20.193.28:0/1759068821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d414d940 con 0x7fe4d40a4dc0 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 Processor -- start 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 -- start start 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94f050 0x55e99c94f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 0x55e99c953f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c956a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e99c89f8f0 con 0x55e99c954590 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e99c84d2e0 con 0x55e99c94fa20 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e99c89b820 con 0x55e99c94f050 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e0f79640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c956a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e0f79640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c956a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49974/0 (socket says 10.20.193.28:49974) 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e0f79640 1 -- 10.20.193.28:0/252650702 learned_addr learned my addr 10.20.193.28:0/252650702 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e0f79640 1 -- 10.20.193.28:0/252650702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94f050 msgr2=0x55e99c94f450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/252650702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94f050 0x55e99c94f450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e0f79640 1 -- 10.20.193.28:0/252650702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 msgr2=0x55e99c953f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/252650702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 0x55e99c953f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e0f79640 1 -- 10.20.193.28:0/252650702 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e99c83f5a0 con 0x55e99c954590 2026-02-20T03:30:38.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/252650702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c956a20 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc032040 tx=0x7fe4cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96a3764d310321c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4a9bfe640 1 -- 10.20.193.28:0/252650702 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc002d40 con 0x55e99c954590 2026-02-20T03:30:38.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4a9bfe640 1 -- 10.20.193.28:0/252650702 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe4cc03e070 con 0x55e99c954590 2026-02-20T03:30:38.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 -- 10.20.193.28:0/252650702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 msgr2=0x55e99c956a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:38.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4a9bfe640 1 -- 10.20.193.28:0/252650702 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc002d40 con 0x55e99c954590 2026-02-20T03:30:38.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/252650702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c956a20 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc032040 tx=0x7fe4cc005880 comp rx=0 tx=0).stop 2026-02-20T03:30:38.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4ca7fc640 1 -- 10.20.193.28:0/1759068821 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe4d801d3b0 con 0x7fe4d40a4dc0 2026-02-20T03:30:38.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 -- 10.20.193.28:0/252650702 shutdown_connections 2026-02-20T03:30:38.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/252650702 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c956a20 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/252650702 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 0x55e99c953f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/252650702 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94f050 0x55e99c94f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.893+0000 7fe4e6868e00 1 -- 10.20.193.28:0/252650702 >> 10.20.193.28:0/252650702 conn(0x55e99c9468c0 msgr2=0x55e99c94d740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:38.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.901+0000 7fe4e6868e00 1 -- 10.20.193.28:0/252650702 shutdown_connections 2026-02-20T03:30:38.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.901+0000 7fe4e6868e00 1 -- 10.20.193.28:0/252650702 wait complete. 2026-02-20T03:30:38.906 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.903+0000 7fe4e6868e00 1 -- start start 2026-02-20T03:30:38.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.904+0000 7fe4ca7fc640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4b80b0d30 0x7fe4b80b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.904+0000 7fe4ca7fc640 1 -- 10.20.193.28:0/1759068821 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe4d80e0840 con 0x7fe4d40a4dc0 2026-02-20T03:30:38.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.904+0000 7fe4e6868e00 1 Processor -- start 2026-02-20T03:30:38.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c94f050 0x55e99c967820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 0x55e99c967d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c954590 0x55e99c96ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e0f79640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 0x55e99c967d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e0f79640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 0x55e99c967d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37626/0 (socket says 10.20.193.28:37626) 2026-02-20T03:30:38.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e1f7b640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4b80b0d30 0x7fe4b80b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e99c8470c0 con 0x55e99c94f050 2026-02-20T03:30:38.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e99c957630 con 0x55e99c94fa20 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e99c96f1d0 con 0x55e99c954590 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.905+0000 7fe4e0f79640 1 -- 10.20.193.28:0/1189446948 learned_addr learned my addr 10.20.193.28:0/1189446948 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.906+0000 7fe4e1f7b640 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c954590 0x55e99c96ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.906+0000 7fe4e0f79640 1 -- 10.20.193.28:0/1189446948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c954590 msgr2=0x55e99c96ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.906+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c954590 0x55e99c96ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.906+0000 7fe4e0f79640 1 -- 10.20.193.28:0/1189446948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c94f050 msgr2=0x55e99c967820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.906+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c94f050 0x55e99c967820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.906+0000 7fe4e0f79640 1 -- 10.20.193.28:0/1189446948 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e99c9610b0 con 0x55e99c94fa20 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.906+0000 7fe4e1f7b640 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c954590 0x55e99c96ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.907+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 0x55e99c967d60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc004000 tx=0x7fe4cc004030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde42a4f259ec00c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.907+0000 7fe496ffd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:30:38.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.907+0000 7fe496ffd640 1 -- 10.20.193.28:0/1189446948 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc04e020 con 0x55e99c94fa20 2026-02-20T03:30:38.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.907+0000 7fe496ffd640 1 -- 10.20.193.28:0/1189446948 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe4cc033040 con 0x55e99c94fa20 2026-02-20T03:30:38.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.907+0000 7fe496ffd640 1 -- 10.20.193.28:0/1189446948 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc042410 con 0x55e99c94fa20 2026-02-20T03:30:38.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.907+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e99c85b820 con 0x55e99c94fa20 2026-02-20T03:30:38.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.907+0000 7fe4e6868e00 10 client.28175 _ll_register_callbacks cb 0x55e99c84aff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:38.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.907+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e99c8a74e0 con 0x55e99c94fa20 2026-02-20T03:30:38.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.907+0000 7fe4e1f7b640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4b80b0d30 0x7fe4b80b31f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0005e00 tx=0x7fe4d0009440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.908+0000 7fe496ffd640 1 -- 10.20.193.28:0/1189446948 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe4cc0425b0 con 0x55e99c94fa20 2026-02-20T03:30:38.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.908+0000 7fe496ffd640 1 -- 10.20.193.28:0/1189446948 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe4cc042850 con 0x55e99c94fa20 2026-02-20T03:30:38.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.908+0000 7fe4e6868e00 10 client.28175 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.908+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=39}) -- 0x55e99c860380 con 0x55e99c94fa20 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.908+0000 7fe496ffd640 1 -- 10.20.193.28:0/1189446948 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7fe4cc0429f0 con 0x55e99c94fa20 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.908+0000 7fe4e6868e00 10 client.28175 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.908+0000 7fe4e6868e00 10 client.28175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.908+0000 7fe4e6868e00 20 client.28175 populate_metadata read hostname 'trial028' 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.909+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e99c972fa0 0x55e99c975430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.909+0000 7fe4e6868e00 4 client.28175 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.909+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e99c821bd0 con 0x55e99c972fa0 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.909+0000 7fe4e177a640 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e99c972fa0 0x55e99c975430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.909+0000 7fe4e177a640 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e99c972fa0 0x55e99c975430 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1492539b53151434 server_cookie=d9d57dfd373293b6 in_seq=0 out_seq=0 2026-02-20T03:30:38.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.909+0000 7fe496ffd640 10 client.28175 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.910+0000 7fe496ffd640 1 -- 10.20.193.28:0/1189446948 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e99c821bd0 con 0x55e99c972fa0 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.910+0000 7fe496ffd640 10 client.28175 handle_command_reply: tid=0 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.910+0000 7fe4e6868e00 1 client.28175 shutdown 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.910+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 msgr2=0x55e99c967d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.910+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 0x55e99c967d60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc004000 tx=0x7fe4cc004030 comp rx=0 tx=0).stop 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 shutdown_connections 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e99c972fa0 0x55e99c975430 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c954590 0x55e99c96ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94fa20 0x55e99c967d60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/1189446948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c94f050 0x55e99c967820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 >> 10.20.193.28:0/1189446948 conn(0x55e99c9468c0 msgr2=0x55e99c9558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:38.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe496ffd640 0 client.28175 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:38.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 shutdown_connections 2026-02-20T03:30:38.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe4e6868e00 1 -- 10.20.193.28:0/1189446948 wait complete. 2026-02-20T03:30:38.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.911+0000 7fe4e6868e00 20 client.28175 trim_cache size 0 max 16384 2026-02-20T03:30:38.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.926+0000 7fe4e6868e00 1 Processor -- start 2026-02-20T03:30:38.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.926+0000 7fe4e6868e00 1 -- start start 2026-02-20T03:30:38.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.926+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c94f050 0x55e99c966b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c96ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c954590 0x55e99c9670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e6868e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe4880127d0 con 0x55e99c94f050 2026-02-20T03:30:38.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e0f79640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c96ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e0f79640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c96ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45614/0 (socket says 10.20.193.28:45614) 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e6868e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe488010040 con 0x55e99c954590 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3911396032 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe48800de90 con 0x55e99c94fa20 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e0f79640 1 -- 10.20.193.28:0/3911396032 learned_addr learned my addr 10.20.193.28:0/3911396032 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e1f7b640 1 --2- 10.20.193.28:0/3911396032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c954590 0x55e99c9670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e177a640 1 --2- 10.20.193.28:0/3911396032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c94f050 0x55e99c966b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e0f79640 1 -- 10.20.193.28:0/3911396032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c954590 msgr2=0x55e99c9670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/3911396032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c954590 0x55e99c9670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e0f79640 1 -- 10.20.193.28:0/3911396032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c94f050 msgr2=0x55e99c966b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/3911396032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c94f050 0x55e99c966b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.927+0000 7fe4e0f79640 1 -- 10.20.193.28:0/3911396032 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e99c960ee0 con 0x55e99c94fa20 2026-02-20T03:30:38.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.928+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/3911396032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c96ec00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc02f670 tx=0x7fe4cc055000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=864397c9e6385202 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.928+0000 7fe4a93fd640 1 -- 10.20.193.28:0/3911396032 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc04e070 con 0x55e99c94fa20 2026-02-20T03:30:38.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.928+0000 7fe4a93fd640 1 -- 10.20.193.28:0/3911396032 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe4cc033070 con 0x55e99c94fa20 2026-02-20T03:30:38.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.928+0000 7fe4a93fd640 1 -- 10.20.193.28:0/3911396032 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc04e070 con 0x55e99c94fa20 2026-02-20T03:30:38.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.928+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3911396032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 msgr2=0x55e99c96ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:38.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.928+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3911396032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c96ec00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc02f670 tx=0x7fe4cc055000 comp rx=0 tx=0).stop 2026-02-20T03:30:38.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.929+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3911396032 shutdown_connections 2026-02-20T03:30:38.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.929+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3911396032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c954590 0x55e99c9670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.929+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3911396032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c96ec00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.929+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3911396032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c94f050 0x55e99c966b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.929+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3911396032 >> 10.20.193.28:0/3911396032 conn(0x55e99c9468c0 msgr2=0x55e99c954970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:38.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.929+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3911396032 shutdown_connections 2026-02-20T03:30:38.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.929+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3911396032 wait complete. 2026-02-20T03:30:38.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.929+0000 7fe4e6868e00 1 -- start start 2026-02-20T03:30:38.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e6868e00 1 Processor -- start 2026-02-20T03:30:38.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94f050 0x55e99c96cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c9eb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e6868e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c9ed850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e6868e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe48800e500 con 0x55e99c954590 2026-02-20T03:30:38.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e6868e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe48800f970 con 0x55e99c94f050 2026-02-20T03:30:38.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e6868e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe48800ebd0 con 0x55e99c94fa20 2026-02-20T03:30:38.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e0f79640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c9eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e0f79640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c9eb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45630/0 (socket says 10.20.193.28:45630) 2026-02-20T03:30:38.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e0f79640 1 -- 10.20.193.28:0/3704234335 learned_addr learned my addr 10.20.193.28:0/3704234335 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e177a640 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94f050 0x55e99c96cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.930+0000 7fe4e1f7b640 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c9ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe4e0f79640 1 -- 10.20.193.28:0/3704234335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94f050 msgr2=0x55e99c96cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94f050 0x55e99c96cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe4e0f79640 1 -- 10.20.193.28:0/3704234335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 msgr2=0x55e99c9ed850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c9ed850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe4e0f79640 1 -- 10.20.193.28:0/3704234335 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e99c951740 con 0x55e99c94fa20 2026-02-20T03:30:38.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe4e177a640 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94f050 0x55e99c96cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:30:38.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe4e0f79640 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c9eb300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0046b0 tx=0x7fe4cc004030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b886bee24aa3df71 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe496ffd640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:30:38.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe496ffd640 1 -- 10.20.193.28:0/3704234335 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc04e070 con 0x55e99c94fa20 2026-02-20T03:30:38.940 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe496ffd640 1 -- 10.20.193.28:0/3704234335 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe4cc03e030 con 0x55e99c94fa20 2026-02-20T03:30:38.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.931+0000 7fe496ffd640 1 -- 10.20.193.28:0/3704234335 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc04e070 con 0x55e99c94fa20 2026-02-20T03:30:38.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3704234335 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e99c5ff690 con 0x55e99c94fa20 2026-02-20T03:30:38.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 10 client.28183 _ll_register_callbacks cb 0x7fe4cc0027c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:38.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3704234335 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e99c678520 con 0x55e99c94fa20 2026-02-20T03:30:38.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe496ffd640 1 -- 10.20.193.28:0/3704234335 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe4cc038680 con 0x55e99c94fa20 2026-02-20T03:30:38.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe496ffd640 1 -- 10.20.193.28:0/3704234335 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe4cc038960 con 0x55e99c94fa20 2026-02-20T03:30:38.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 10 client.28183 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:38.941 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3704234335 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=39}) -- 0x55e99c864b70 con 0x55e99c94fa20 2026-02-20T03:30:38.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe496ffd640 1 -- 10.20.193.28:0/3704234335 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7fe4cc05d6a0 con 0x55e99c94fa20 2026-02-20T03:30:38.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 10 client.28183 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:38.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 10 client.28183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:38.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 20 client.28183 populate_metadata read hostname 'trial028' 2026-02-20T03:30:38.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e99c9ef2c0 0x55e99c9f1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 4 client.28183 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:30:38.942 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.932+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3704234335 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e99c678520 con 0x55e99c9ef2c0 2026-02-20T03:30:38.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.933+0000 7fe4e177a640 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e99c9ef2c0 0x55e99c9f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.933+0000 7fe4e177a640 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e99c9ef2c0 0x55e99c9f1780 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52b2eb61762c4a1c server_cookie=3f03b2021b298029 in_seq=0 out_seq=0 2026-02-20T03:30:38.943 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:38.933+0000 7fe496ffd640 10 client.28183 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:38.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.941+0000 7f6582ffd640 1 -- 10.20.193.28:0/2114014354 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657402fc80 con 0x7f657c09d5d0 2026-02-20T03:30:38.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.942+0000 7f658963c640 1 -- 10.20.193.28:0/2114014354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f657c09d5d0 msgr2=0x7f657c0a0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:38.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.942+0000 7f658963c640 1 --2- 10.20.193.28:0/2114014354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f657c09d5d0 0x7f657c0a0b80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6574009a30 tx=0x7f657402f220 comp rx=0 tx=0).stop 2026-02-20T03:30:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 -- 10.20.193.28:0/2114014354 shutdown_connections 2026-02-20T03:30:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 --2- 10.20.193.28:0/2114014354 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f657c0a12b0 0x7f657c0a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 --2- 10.20.193.28:0/2114014354 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f657c09d5d0 0x7f657c0a0b80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 --2- 10.20.193.28:0/2114014354 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f657c09cc20 0x7f657c09d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 -- 10.20.193.28:0/2114014354 >> 10.20.193.28:0/2114014354 conn(0x7f657c00b7c0 msgr2=0x7f657c00dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:38.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 -- 10.20.193.28:0/2114014354 shutdown_connections 2026-02-20T03:30:38.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 -- 10.20.193.28:0/2114014354 wait complete. 2026-02-20T03:30:38.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 Processor -- start 2026-02-20T03:30:38.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 -- start start 2026-02-20T03:30:38.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f657c09cc20 0x7f657c134500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f657c09d5d0 0x7f657c134a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f657c0a12b0 0x7f657c138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f657c0ac0f0 con 0x7f657c09d5d0 2026-02-20T03:30:38.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f657c0abf70 con 0x7f657c0a12b0 2026-02-20T03:30:38.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f658963c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f657c0ac270 con 0x7f657c09cc20 2026-02-20T03:30:38.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f65837fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f657c09d5d0 0x7f657c134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f65837fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f657c09d5d0 0x7f657c134a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50034/0 (socket says 10.20.193.28:50034) 2026-02-20T03:30:38.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f65837fe640 1 -- 10.20.193.28:0/1744356016 learned_addr learned my addr 10.20.193.28:0/1744356016 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f65837fe640 1 -- 10.20.193.28:0/1744356016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f657c09cc20 msgr2=0x7f657c134500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:38.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f65837fe640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f657c09cc20 0x7f657c134500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f65837fe640 1 -- 10.20.193.28:0/1744356016 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f657c0a12b0 msgr2=0x7f657c138dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:38.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f65837fe640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f657c0a12b0 0x7f657c138dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.943+0000 7f65837fe640 1 -- 10.20.193.28:0/1744356016 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c139550 con 0x7f657c09d5d0 2026-02-20T03:30:38.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f65837fe640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f657c09d5d0 0x7f657c134a40 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f6574009950 tx=0x7f657402fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f65817fa640 1 -- 10.20.193.28:0/1744356016 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574047070 con 0x7f657c09d5d0 2026-02-20T03:30:38.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f65817fa640 1 -- 10.20.193.28:0/1744356016 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f657403e070 con 0x7f657c09d5d0 2026-02-20T03:30:38.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f65817fa640 1 -- 10.20.193.28:0/1744356016 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740426c0 con 0x7f657c09d5d0 2026-02-20T03:30:38.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f658963c640 1 -- 10.20.193.28:0/1744356016 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657c1397e0 con 0x7f657c09d5d0 2026-02-20T03:30:38.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f658963c640 1 -- 10.20.193.28:0/1744356016 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657c141080 con 0x7f657c09d5d0 2026-02-20T03:30:38.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f65817fa640 1 -- 10.20.193.28:0/1744356016 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6574042860 con 0x7f657c09d5d0 2026-02-20T03:30:38.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f658cdcae00 1 Processor -- start 2026-02-20T03:30:38.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f658cdcae00 1 -- start start 2026-02-20T03:30:38.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.946+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d25b8b0 0x55890d25bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f65817fa640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65580b0e20 0x7f65580b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f65817fa640 1 -- 10.20.193.28:0/1744356016 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f6574104e50 con 0x7f657c09d5d0 2026-02-20T03:30:38.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25c260 0x55890d2560c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d256b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f658cdcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55890d1a8c00 con 0x55890d2566e0 2026-02-20T03:30:38.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6583fff640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65580b0e20 0x7f65580b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f658cdcae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55890d1563c0 con 0x55890d25b8b0 2026-02-20T03:30:38.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6588e3b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d256b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6588e3b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d256b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50050/0 (socket says 10.20.193.28:50050) 2026-02-20T03:30:38.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6588e3b640 1 -- 10.20.193.28:0/1100299334 learned_addr learned my addr 10.20.193.28:0/1100299334 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f658cdcae00 1 -- 10.20.193.28:0/1100299334 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55890d1a4b30 con 0x55890d25c260 2026-02-20T03:30:38.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6583fff640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65580b0e20 0x7f65580b32e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6570009b60 tx=0x7f6570009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6588e3b640 1 -- 10.20.193.28:0/1100299334 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25c260 msgr2=0x55890d2560c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:38.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6588e3b640 1 --2- 10.20.193.28:0/1100299334 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25c260 0x55890d2560c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6588e3b640 1 -- 10.20.193.28:0/1100299334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d25b8b0 msgr2=0x55890d25bc90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6588e3b640 1 --2- 10.20.193.28:0/1100299334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d25b8b0 0x55890d25bc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6588e3b640 1 -- 10.20.193.28:0/1100299334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890d14f840 con 0x55890d2566e0 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f6588e3b640 1 --2- 10.20.193.28:0/1100299334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d256b60 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f6578009b60 tx=0x7f6578004420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e0d63b4ea17463 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.951+0000 7f655cce3640 1 -- 10.20.193.28:0/1100299334 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578018070 con 0x55890d2566e0 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f655cce3640 1 -- 10.20.193.28:0/1100299334 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f65780092d0 con 0x55890d2566e0 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f655cce3640 1 -- 10.20.193.28:0/1100299334 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578013820 con 0x55890d2566e0 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 -- 10.20.193.28:0/1100299334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 msgr2=0x55890d256b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 --2- 10.20.193.28:0/1100299334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d256b60 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f6578009b60 tx=0x7f6578004420 comp rx=0 tx=0).stop 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 -- 10.20.193.28:0/1100299334 shutdown_connections 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 --2- 10.20.193.28:0/1100299334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d256b60 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 --2- 10.20.193.28:0/1100299334 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25c260 0x55890d2560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 --2- 10.20.193.28:0/1100299334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d25b8b0 0x55890d25bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 -- 10.20.193.28:0/1100299334 >> 10.20.193.28:0/1100299334 conn(0x55890d24ebf0 msgr2=0x55890d2545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 -- 10.20.193.28:0/1100299334 shutdown_connections 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 -- 10.20.193.28:0/1100299334 wait complete. 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 -- start start 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 Processor -- start 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d2706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d25b8b0 0x55890d270c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25c260 0x55890d26ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55890d1501a0 con 0x55890d2566e0 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55890d262d30 con 0x55890d25b8b0 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f658cdcae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55890d26f3c0 con 0x55890d25c260 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f6583fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d2706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f6583fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d2706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50052/0 (socket says 10.20.193.28:50052) 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.953+0000 7f6583fff640 1 -- 10.20.193.28:0/4246869204 learned_addr learned my addr 10.20.193.28:0/4246869204 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.956+0000 7f6583fff640 1 -- 10.20.193.28:0/4246869204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25c260 msgr2=0x55890d26ee30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.956+0000 7f6583fff640 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25c260 0x55890d26ee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.956+0000 7f6583fff640 1 -- 10.20.193.28:0/4246869204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d25b8b0 msgr2=0x55890d270c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.956+0000 7f6583fff640 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d25b8b0 0x55890d270c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.956+0000 7f6583fff640 1 -- 10.20.193.28:0/4246869204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890d268740 con 0x55890d2566e0 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.956+0000 7f6583fff640 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d2706f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f6570010690 tx=0x7f6570004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1d4dcdd54a4b9b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.957+0000 7f6549ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.957+0000 7f6549ffb640 1 -- 10.20.193.28:0/4246869204 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570020070 con 0x55890d2566e0 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.957+0000 7f658cdcae00 1 -- 10.20.193.28:0/4246869204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55890cf77b60 con 0x55890d2566e0 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.957+0000 7f6549ffb640 1 -- 10.20.193.28:0/4246869204 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f65700044e0 con 0x55890d2566e0 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.957+0000 7f658cdcae00 10 client.19860 _ll_register_callbacks cb 0x55890d1540d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:38.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.957+0000 7f658cdcae00 1 -- 10.20.193.28:0/4246869204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55890d1b07f0 con 0x55890d2566e0 2026-02-20T03:30:38.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.961+0000 7f6549ffb640 1 -- 10.20.193.28:0/4246869204 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570020070 con 0x55890d2566e0 2026-02-20T03:30:38.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.961+0000 7f6549ffb640 1 -- 10.20.193.28:0/4246869204 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f657000f950 con 0x55890d2566e0 2026-02-20T03:30:38.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.961+0000 7f6549ffb640 1 -- 10.20.193.28:0/4246869204 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f657002a060 con 0x55890d2566e0 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.961+0000 7f658cdcae00 10 client.19860 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.961+0000 7f658cdcae00 1 -- 10.20.193.28:0/4246869204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=39}) -- 0x55890d175430 con 0x55890d2566e0 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.962+0000 7f6549ffb640 1 -- 10.20.193.28:0/4246869204 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7f657000fbf0 con 0x55890d2566e0 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.962+0000 7f658cdcae00 10 client.19860 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.962+0000 7f658cdcae00 10 client.19860 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.962+0000 7f658cdcae00 20 client.19860 populate_metadata read hostname 'trial028' 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.962+0000 7f658cdcae00 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55890d27ee20 0x55890d2812e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.962+0000 7f658cdcae00 4 client.19860 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.962+0000 7f658cdcae00 1 -- 10.20.193.28:0/4246869204 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55890d12ac00 con 0x55890d27ee20 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.963+0000 7f65837fe640 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55890d27ee20 0x55890d2812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.963+0000 7f65837fe640 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55890d27ee20 0x55890d2812e0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbe133a08c87e265 server_cookie=65ed69a5f3b1eb3 in_seq=0 out_seq=0 2026-02-20T03:30:38.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.963+0000 7f6549ffb640 10 client.19860 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.975+0000 7f6549ffb640 1 -- 10.20.193.28:0/4246869204 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55890d12ac00 con 0x55890d27ee20 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.975+0000 7f6549ffb640 10 client.19860 handle_command_reply: tid=0 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.975+0000 7f658cdcae00 1 client.19860 shutdown 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.975+0000 7f658cdcae00 1 -- 10.20.193.28:0/4246869204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 msgr2=0x55890d2706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.975+0000 7f658cdcae00 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d2706f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f6570010690 tx=0x7f6570004830 comp rx=0 tx=0).stop 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.975+0000 7f658cdcae00 1 -- 10.20.193.28:0/4246869204 shutdown_connections 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.975+0000 7f658cdcae00 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55890d27ee20 0x55890d2812e0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.976+0000 7f658cdcae00 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25c260 0x55890d26ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.976+0000 7f658cdcae00 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d25b8b0 0x55890d270c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.976+0000 7f658cdcae00 1 --2- 10.20.193.28:0/4246869204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d2566e0 0x55890d2706f0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.976+0000 7f658cdcae00 1 -- 10.20.193.28:0/4246869204 >> 10.20.193.28:0/4246869204 conn(0x55890d24ebf0 msgr2=0x55890d254cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:38.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.976+0000 7f6549ffb640 0 client.19860 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:38.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.977+0000 7f658cdcae00 1 -- 10.20.193.28:0/4246869204 shutdown_connections 2026-02-20T03:30:38.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.977+0000 7f658cdcae00 1 -- 10.20.193.28:0/4246869204 wait complete. 2026-02-20T03:30:38.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.977+0000 7f658cdcae00 20 client.19860 trim_cache size 0 max 16384 2026-02-20T03:30:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.986+0000 7f658cdcae00 1 Processor -- start 2026-02-20T03:30:38.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.986+0000 7f658cdcae00 1 -- start start 2026-02-20T03:30:38.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.986+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 0x55890d273c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.986+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d254dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 0x55890d255310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f658cdcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f65280127b0 con 0x55890d25c260 2026-02-20T03:30:38.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f658cdcae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6528010020 con 0x55890d2566e0 2026-02-20T03:30:38.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f658cdcae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f652800de70 con 0x55890d25b8b0 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f6583fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 0x55890d273c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f65837fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d254dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f6588e3b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 0x55890d255310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f65837fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d254dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45672/0 (socket says 10.20.193.28:45672) 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f6583fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 0x55890d273c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37688/0 (socket says 10.20.193.28:37688) 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f65837fe640 1 -- 10.20.193.28:0/1974282738 learned_addr learned my addr 10.20.193.28:0/1974282738 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f65837fe640 1 -- 10.20.193.28:0/1974282738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 msgr2=0x55890d273c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f65837fe640 1 --2- 10.20.193.28:0/1974282738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 0x55890d273c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.987+0000 7f65837fe640 1 -- 10.20.193.28:0/1974282738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 msgr2=0x55890d255310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.988+0000 7f65837fe640 1 --2- 10.20.193.28:0/1974282738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 0x55890d255310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.988+0000 7f65837fe640 1 -- 10.20.193.28:0/1974282738 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890d25c000 con 0x55890d25b8b0 2026-02-20T03:30:38.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.988+0000 7f65837fe640 1 --2- 10.20.193.28:0/1974282738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d254dd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f65740cc8c0 tx=0x7f6574102420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2f6760b39a87487 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.988+0000 7f654bfff640 1 -- 10.20.193.28:0/1974282738 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740d0f70 con 0x55890d25b8b0 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.989+0000 7f654bfff640 1 -- 10.20.193.28:0/1974282738 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6574033030 con 0x55890d25b8b0 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.989+0000 7f654bfff640 1 -- 10.20.193.28:0/1974282738 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574042b80 con 0x55890d25b8b0 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.989+0000 7f658cdcae00 1 -- 10.20.193.28:0/1974282738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 msgr2=0x55890d254dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.989+0000 7f658cdcae00 1 --2- 10.20.193.28:0/1974282738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d254dd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f65740cc8c0 tx=0x7f6574102420 comp rx=0 tx=0).stop 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.989+0000 7f658cdcae00 1 -- 10.20.193.28:0/1974282738 shutdown_connections 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.989+0000 7f658cdcae00 1 --2- 10.20.193.28:0/1974282738 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 0x55890d255310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.989+0000 7f658cdcae00 1 --2- 10.20.193.28:0/1974282738 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d254dd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.989+0000 7f658cdcae00 1 --2- 10.20.193.28:0/1974282738 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 0x55890d273c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.990+0000 7f658cdcae00 1 -- 10.20.193.28:0/1974282738 >> 10.20.193.28:0/1974282738 conn(0x55890d24ebf0 msgr2=0x55890d273550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:38.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.990+0000 7f658cdcae00 1 -- 10.20.193.28:0/1974282738 shutdown_connections 2026-02-20T03:30:38.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.990+0000 7f658cdcae00 1 -- 10.20.193.28:0/1974282738 wait complete. 2026-02-20T03:30:38.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.991+0000 7f658cdcae00 1 -- start start 2026-02-20T03:30:38.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.991+0000 7f658cdcae00 1 Processor -- start 2026-02-20T03:30:38.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.991+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 0x55890d279fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.991+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d277290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.992+0000 7f658cdcae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 0x55890d277810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:38.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.992+0000 7f658cdcae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f652800e4e0 con 0x55890d25c260 2026-02-20T03:30:38.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.992+0000 7f658cdcae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f652800f950 con 0x55890d2566e0 2026-02-20T03:30:38.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.992+0000 7f658cdcae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f652800ebb0 con 0x55890d25b8b0 2026-02-20T03:30:38.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.992+0000 7f65837fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d277290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.992+0000 7f65837fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d277290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45674/0 (socket says 10.20.193.28:45674) 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.992+0000 7f65837fe640 1 -- 10.20.193.28:0/2143596838 learned_addr learned my addr 10.20.193.28:0/2143596838 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.993+0000 7f6588e3b640 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 0x55890d277810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.993+0000 7f6583fff640 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 0x55890d279fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.993+0000 7f65837fe640 1 -- 10.20.193.28:0/2143596838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 msgr2=0x55890d279fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.993+0000 7f65837fe640 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 0x55890d279fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.993+0000 7f65837fe640 1 -- 10.20.193.28:0/2143596838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 msgr2=0x55890d277810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.993+0000 7f65837fe640 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 0x55890d277810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.993+0000 7f65837fe640 1 -- 10.20.193.28:0/2143596838 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55890d268570 con 0x55890d25b8b0 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.994+0000 7f65837fe640 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d277290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f65740c89f0 tx=0x7f6574005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8169f769223e8fa4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:38.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.994+0000 7f6549ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:30:38.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.994+0000 7f6549ffb640 1 -- 10.20.193.28:0/2143596838 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740e7070 con 0x55890d25b8b0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.994+0000 7f658cdcae00 1 -- 10.20.193.28:0/2143596838 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55890ce87900 con 0x55890d25b8b0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.994+0000 7f658cdcae00 10 client.28192 _ll_register_callbacks cb 0x7f657000ef20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.994+0000 7f658cdcae00 1 -- 10.20.193.28:0/2143596838 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65780092d0 con 0x55890d25b8b0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.994+0000 7f6549ffb640 1 -- 10.20.193.28:0/2143596838 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f65740d0f70 con 0x55890d25b8b0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.994+0000 7f6549ffb640 1 -- 10.20.193.28:0/2143596838 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574042e50 con 0x55890d25b8b0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.994+0000 7f6549ffb640 1 -- 10.20.193.28:0/2143596838 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f65740ef040 con 0x55890d25b8b0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f6549ffb640 1 -- 10.20.193.28:0/2143596838 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f65740ef300 con 0x55890d25b8b0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f658cdcae00 10 client.28192 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f658cdcae00 1 -- 10.20.193.28:0/2143596838 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=39}) -- 0x55890d1634d0 con 0x55890d25b8b0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f6549ffb640 1 -- 10.20.193.28:0/2143596838 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7f65740cbbd0 con 0x55890d25b8b0 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f658cdcae00 10 client.28192 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f658cdcae00 10 client.28192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:38.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f658cdcae00 20 client.28192 populate_metadata read hostname 'trial028' 2026-02-20T03:30:39.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f658cdcae00 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55890d2ebe30 0x55890d2ee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f658cdcae00 4 client.28192 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:30:39.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.995+0000 7f658cdcae00 1 -- 10.20.193.28:0/2143596838 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55890cf292b0 con 0x55890d2ebe30 2026-02-20T03:30:39.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.996+0000 7f6583fff640 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55890d2ebe30 0x55890d2ee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.998+0000 7f6583fff640 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55890d2ebe30 0x55890d2ee2f0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49fb349eee8be572 server_cookie=3bd57c1a0a37ee30 in_seq=0 out_seq=0 2026-02-20T03:30:39.000 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:38.998+0000 7f6549ffb640 10 client.28192 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:39.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.021+0000 7f6549ffb640 1 -- 10.20.193.28:0/2143596838 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55890cf292b0 con 0x55890d2ebe30 2026-02-20T03:30:39.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.021+0000 7f6549ffb640 10 client.28192 handle_command_reply: tid=0 2026-02-20T03:30:39.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.021+0000 7f658cdcae00 1 client.28192 shutdown 2026-02-20T03:30:39.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.022+0000 7f658cdcae00 1 -- 10.20.193.28:0/2143596838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 msgr2=0x55890d277290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.022+0000 7f658cdcae00 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d277290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f65740c89f0 tx=0x7f6574005970 comp rx=0 tx=0).stop 2026-02-20T03:30:39.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.022+0000 7f658cdcae00 1 -- 10.20.193.28:0/2143596838 shutdown_connections 2026-02-20T03:30:39.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.022+0000 7f658cdcae00 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55890d2ebe30 0x55890d2ee2f0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.022+0000 7f658cdcae00 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55890d25c260 0x55890d277810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.022+0000 7f658cdcae00 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55890d25b8b0 0x55890d277290 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.022+0000 7f658cdcae00 1 --2- 10.20.193.28:0/2143596838 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55890d2566e0 0x55890d279fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.022+0000 7f658cdcae00 1 -- 10.20.193.28:0/2143596838 >> 10.20.193.28:0/2143596838 conn(0x55890d24ebf0 msgr2=0x55890d273d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.022+0000 7f6549ffb640 0 client.28192 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:39.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.023+0000 7f658cdcae00 1 -- 10.20.193.28:0/2143596838 shutdown_connections 2026-02-20T03:30:39.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.023+0000 7f658cdcae00 1 -- 10.20.193.28:0/2143596838 wait complete. 2026-02-20T03:30:39.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.023+0000 7f658cdcae00 20 client.28192 trim_cache size 0 max 16384 2026-02-20T03:30:39.027 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:30:39.027 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:30:39.027 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "4057c168-cd23-4589-8efb-1a56d3278c70", 2026-02-20T03:30:39.027 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:30:39.027 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:30:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.024+0000 7f658963c640 1 -- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65580b0e20 msgr2=0x7f65580b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.024+0000 7f658963c640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65580b0e20 0x7f65580b32e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6570009b60 tx=0x7f6570009290 comp rx=0 tx=0).stop 2026-02-20T03:30:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.024+0000 7f658963c640 1 -- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f657c09d5d0 msgr2=0x7f657c134a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.024+0000 7f658963c640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f657c09d5d0 0x7f657c134a40 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f6574009950 tx=0x7f657402fdd0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.024+0000 7f658963c640 1 -- 10.20.193.28:0/1744356016 shutdown_connections 2026-02-20T03:30:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.024+0000 7f658963c640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65580b0e20 0x7f65580b32e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.025+0000 7f658963c640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f657c0a12b0 0x7f657c138dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.025+0000 7f658963c640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f657c09d5d0 0x7f657c134a40 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.025+0000 7f658963c640 1 --2- 10.20.193.28:0/1744356016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f657c09cc20 0x7f657c134500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.025+0000 7f658963c640 1 -- 10.20.193.28:0/1744356016 >> 10.20.193.28:0/1744356016 conn(0x7f657c00b7c0 msgr2=0x7f657c00be20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.025+0000 7f658963c640 1 -- 10.20.193.28:0/1744356016 shutdown_connections 2026-02-20T03:30:39.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.025+0000 7f658963c640 1 -- 10.20.193.28:0/1744356016 wait complete. 2026-02-20T03:30:39.190 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:30:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:39 trial028 ceph-mon[38552]: pgmap v664: 129 pgs: 129 active+clean; 528 MiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 10 MiB/s wr, 1.39k op/s 2026-02-20T03:30:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:39 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:30:39.637 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:39.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 76228 82.00 MB/sec execute 10 sec latency 402.413 ms 2026-02-20T03:30:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:39 trial177 ceph-mon[43181]: pgmap v664: 129 pgs: 129 active+clean; 528 MiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 10 MiB/s wr, 1.39k op/s 2026-02-20T03:30:39.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:39 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:30:39.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.738+0000 7fe496ffd640 1 -- 10.20.193.28:0/3704234335 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e99c678520 con 0x55e99c9ef2c0 2026-02-20T03:30:39.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.738+0000 7fe496ffd640 10 client.28183 handle_command_reply: tid=0 2026-02-20T03:30:39.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.738+0000 7fe4e6868e00 1 client.28183 shutdown 2026-02-20T03:30:39.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3704234335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 msgr2=0x55e99c9eb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c9eb300 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0046b0 tx=0x7fe4cc004030 comp rx=0 tx=0).stop 2026-02-20T03:30:39.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3704234335 shutdown_connections 2026-02-20T03:30:39.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e99c9ef2c0 0x55e99c9f1780 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe496ffd640 0 client.28183 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:39.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e99c954590 0x55e99c9ed850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e99c94fa20 0x55e99c9eb300 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe4e6868e00 1 --2- 10.20.193.28:0/3704234335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e99c94f050 0x55e99c96cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3704234335 >> 10.20.193.28:0/3704234335 conn(0x55e99c9468c0 msgr2=0x55e99c954970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.739+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3704234335 shutdown_connections 2026-02-20T03:30:39.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.740+0000 7fe4e6868e00 1 -- 10.20.193.28:0/3704234335 wait complete. 2026-02-20T03:30:39.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.740+0000 7fe4e6868e00 20 client.28183 trim_cache size 0 max 16384 2026-02-20T03:30:39.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:30:39.744 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:30:39.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:30:39.745 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:30:39.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 -- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4b80b0d30 msgr2=0x7fe4b80b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4b80b0d30 0x7fe4b80b31f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0005e00 tx=0x7fe4d0009440 comp rx=0 tx=0).stop 2026-02-20T03:30:39.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 -- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a4dc0 msgr2=0x7fe4d413b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a4dc0 0x7fe4d413b390 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8007eb0 tx=0x7fe4d800d490 comp rx=0 tx=0).stop 2026-02-20T03:30:39.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 -- 10.20.193.28:0/1759068821 shutdown_connections 2026-02-20T03:30:39.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe4b80b0d30 0x7fe4b80b31f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe4d40a6970 0x7fe4d4137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe4d40a5fb0 0x7fe4d413b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 --2- 10.20.193.28:0/1759068821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe4d40a4dc0 0x7fe4d413b390 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 -- 10.20.193.28:0/1759068821 >> 10.20.193.28:0/1759068821 conn(0x7fe4d40a0500 msgr2=0x7fe4d40a9600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 -- 10.20.193.28:0/1759068821 shutdown_connections 2026-02-20T03:30:39.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:39.744+0000 7fe4e277c640 1 -- 10.20.193.28:0/1759068821 wait complete. 2026-02-20T03:30:39.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:39 trial126 ceph-mon[38476]: pgmap v664: 129 pgs: 129 active+clean; 528 MiB data, 6.3 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 10 MiB/s wr, 1.39k op/s 2026-02-20T03:30:39.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:39 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:30:39.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.870+0000 7f7cef577640 1 -- 10.20.193.28:0/3891451477 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 msgr2=0x7f7cf01161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.870+0000 7f7cef577640 1 --2- 10.20.193.28:0/3891451477 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 0x7f7cf01161e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009a30 tx=0x7f7cd802f260 comp rx=0 tx=0).stop 2026-02-20T03:30:39.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.870+0000 7f7cef577640 1 -- 10.20.193.28:0/3891451477 shutdown_connections 2026-02-20T03:30:39.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.870+0000 7f7cef577640 1 --2- 10.20.193.28:0/3891451477 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 0x7f7cf01161e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.870+0000 7f7cef577640 1 --2- 10.20.193.28:0/3891451477 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cf0074d30 0x7f7cf010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.870+0000 7f7cef577640 1 --2- 10.20.193.28:0/3891451477 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7cf0074380 0x7f7cf0074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.870+0000 7f7cef577640 1 -- 10.20.193.28:0/3891451477 >> 10.20.193.28:0/3891451477 conn(0x7f7cf006ead0 msgr2=0x7f7cf006eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.870+0000 7f7cef577640 1 -- 10.20.193.28:0/3891451477 shutdown_connections 2026-02-20T03:30:39.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.870+0000 7f7cef577640 1 -- 10.20.193.28:0/3891451477 wait complete. 2026-02-20T03:30:39.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.871+0000 7f7cef577640 1 Processor -- start 2026-02-20T03:30:39.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.871+0000 7f7cef577640 1 -- start start 2026-02-20T03:30:39.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cef577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 0x7f7cf01afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cef577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7cf0074380 0x7f7cf01b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cef577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cf0074d30 0x7f7cf0115360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cef577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf011b3b0 con 0x7f7cf0074d30 2026-02-20T03:30:39.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cef577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf011b230 con 0x7f7cf006f9f0 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cef577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf011b530 con 0x7f7cf0074380 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cee575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 0x7f7cf01afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cedd74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7cf0074380 0x7f7cf01b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cee575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 0x7f7cf01afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37718/0 (socket says 10.20.193.28:37718) 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.872+0000 7f7cee575640 1 -- 10.20.193.28:0/2185406216 learned_addr learned my addr 10.20.193.28:0/2185406216 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.873+0000 7f7cee575640 1 -- 10.20.193.28:0/2185406216 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7cf0074380 msgr2=0x7f7cf01b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.873+0000 7f7cee575640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7cf0074380 0x7f7cf01b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.873+0000 7f7cee575640 1 -- 10.20.193.28:0/2185406216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cf0074d30 msgr2=0x7f7cf0115360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.873+0000 7f7cee575640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cf0074d30 0x7f7cf0115360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.873+0000 7f7cee575640 1 -- 10.20.193.28:0/2185406216 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0115c20 con 0x7f7cf006f9f0 2026-02-20T03:30:39.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.873+0000 7f7cee575640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 0x7f7cf01afc60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000e170 tx=0x7f7ce000e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:39.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.874+0000 7f7cd77fe640 1 -- 10.20.193.28:0/2185406216 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0019070 con 0x7f7cf006f9f0 2026-02-20T03:30:39.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.874+0000 7f7cd77fe640 1 -- 10.20.193.28:0/2185406216 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7ce000ee80 con 0x7f7cf006f9f0 2026-02-20T03:30:39.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.874+0000 7f7cd77fe640 1 -- 10.20.193.28:0/2185406216 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0014a30 con 0x7f7cf006f9f0 2026-02-20T03:30:39.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.874+0000 7f7cef577640 1 -- 10.20.193.28:0/2185406216 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf0115f10 con 0x7f7cf006f9f0 2026-02-20T03:30:39.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.874+0000 7f7cef577640 1 -- 10.20.193.28:0/2185406216 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf01b6c90 con 0x7f7cf006f9f0 2026-02-20T03:30:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.884+0000 7f7cd77fe640 1 -- 10.20.193.28:0/2185406216 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f7ce0014bd0 con 0x7f7cf006f9f0 2026-02-20T03:30:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.885+0000 7f7cd77fe640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cc00b0f70 0x7f7cc00b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.885+0000 7f7cd77fe640 1 -- 10.20.193.28:0/2185406216 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f7ce00e0830 con 0x7f7cf006f9f0 2026-02-20T03:30:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.885+0000 7f7cedd74640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cc00b0f70 0x7f7cc00b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.886+0000 7f7cf71e2e00 1 Processor -- start 2026-02-20T03:30:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.886+0000 7f7cf71e2e00 1 -- start start 2026-02-20T03:30:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.887+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.887+0000 7f7cee575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.887+0000 7f7cee575640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325633e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37728/0 (socket says 10.20.193.28:37728) 2026-02-20T03:30:39.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.887+0000 7f7cedd74640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cc00b0f70 0x7f7cc00b3430 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7cf01ab570 tx=0x7f7ce4009210 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:39.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.888+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b3255da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.888+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32569e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cf71e2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b324dde50 con 0x562b3255dfb0 2026-02-20T03:30:39.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cf71e2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562b324b09c0 con 0x562b32563000 2026-02-20T03:30:39.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cf71e2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562b3245e240 con 0x562b3255d630 2026-02-20T03:30:39.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cee575640 1 -- 10.20.193.28:0/693696627 learned_addr learned my addr 10.20.193.28:0/693696627 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:39.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cedd74640 1 --2- 10.20.193.28:0/693696627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b3255da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7ceed76640 1 --2- 10.20.193.28:0/693696627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32569e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cee575640 1 -- 10.20.193.28:0/693696627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 msgr2=0x562b3255da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:39.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cee575640 1 --2- 10.20.193.28:0/693696627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b3255da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cee575640 1 -- 10.20.193.28:0/693696627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 msgr2=0x562b32569e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:39.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cee575640 1 --2- 10.20.193.28:0/693696627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32569e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cee575640 1 -- 10.20.193.28:0/693696627 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b32471420 con 0x562b32563000 2026-02-20T03:30:39.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.889+0000 7f7cee575640 1 --2- 10.20.193.28:0/693696627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325633e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0014510 tx=0x7f7ce00a4270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9885a864fbd0c430 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:39.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.890+0000 7f7cd4ff9640 1 -- 10.20.193.28:0/693696627 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0094020 con 0x562b32563000 2026-02-20T03:30:39.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cd4ff9640 1 -- 10.20.193.28:0/693696627 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7ce00a8c10 con 0x562b32563000 2026-02-20T03:30:39.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cd4ff9640 1 -- 10.20.193.28:0/693696627 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00a46b0 con 0x562b32563000 2026-02-20T03:30:39.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/693696627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 msgr2=0x562b325633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/693696627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325633e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0014510 tx=0x7f7ce00a4270 comp rx=0 tx=0).stop 2026-02-20T03:30:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/693696627 shutdown_connections 2026-02-20T03:30:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/693696627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32569e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/693696627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b3255da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/693696627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325633e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/693696627 >> 10.20.193.28:0/693696627 conn(0x562b32520290 msgr2=0x562b3255bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.891+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/693696627 shutdown_connections 2026-02-20T03:30:39.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.892+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/693696627 wait complete. 2026-02-20T03:30:39.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.894+0000 7f7cf71e2e00 1 -- start start 2026-02-20T03:30:39.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.895+0000 7f7cf71e2e00 1 Processor -- start 2026-02-20T03:30:39.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.895+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32577e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.895+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32578370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.895+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b32576570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.895+0000 7f7cf71e2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b324ac8f0 con 0x562b3255dfb0 2026-02-20T03:30:39.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.895+0000 7f7cf71e2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562b3229ef50 con 0x562b32563000 2026-02-20T03:30:39.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.895+0000 7f7cf71e2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562b32576b00 con 0x562b3255d630 2026-02-20T03:30:39.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.895+0000 7f7cee575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32577e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cee575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32577e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45704/0 (socket says 10.20.193.28:45704) 2026-02-20T03:30:39.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cee575640 1 -- 10.20.193.28:0/3948647219 learned_addr learned my addr 10.20.193.28:0/3948647219 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:39.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cedd74640 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32578370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7ceed76640 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b32576570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cee575640 1 -- 10.20.193.28:0/3948647219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 msgr2=0x562b32576570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cee575640 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b32576570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cee575640 1 -- 10.20.193.28:0/3948647219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 msgr2=0x562b32578370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cee575640 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32578370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cee575640 1 -- 10.20.193.28:0/3948647219 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3256fc30 con 0x562b3255d630 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cee575640 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32577e30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00a4860 tx=0x7f7ce0004970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bacf66d421b0b42 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7c9ffff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3948647219 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00ce070 con 0x562b3255d630 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3948647219 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7ce0090be0 con 0x562b3255d630 2026-02-20T03:30:39.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3948647219 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0094040 con 0x562b3255d630 2026-02-20T03:30:39.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.896+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3948647219 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b32281b40 con 0x562b3255d630 2026-02-20T03:30:39.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.897+0000 7f7cf71e2e00 10 client.28204 _ll_register_callbacks cb 0x562b324e9f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:39.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.897+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3948647219 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b324be1a0 con 0x562b3255d630 2026-02-20T03:30:39.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.897+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3948647219 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f7ce0090d90 con 0x562b3255d630 2026-02-20T03:30:39.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.897+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3948647219 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7ce00a7520 con 0x562b3255d630 2026-02-20T03:30:39.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.897+0000 7f7cf71e2e00 10 client.28204 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:39.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.897+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3948647219 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=39}) -- 0x562b3246b230 con 0x562b3255d630 2026-02-20T03:30:39.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.898+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3948647219 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7f7ce0004b40 con 0x562b3255d630 2026-02-20T03:30:39.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.898+0000 7f7cf71e2e00 10 client.28204 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:39.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.898+0000 7f7cf71e2e00 10 client.28204 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.898+0000 7f7cf71e2e00 20 client.28204 populate_metadata read hostname 'trial028' 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.898+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b32586660 0x562b32588b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.898+0000 7f7cf71e2e00 4 client.28204 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.898+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3948647219 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b324b85b0 con 0x562b32586660 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.899+0000 7f7cedd74640 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b32586660 0x562b32588b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.900+0000 7f7c9ffff640 10 client.28204 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.900+0000 7f7cedd74640 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b32586660 0x562b32588b20 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bef9649ad29536e3 server_cookie=ebdb4ff3e752bc99 in_seq=0 out_seq=0 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3948647219 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562b324b85b0 con 0x562b32586660 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7c9ffff640 10 client.28204 handle_command_reply: tid=0 2026-02-20T03:30:39.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 client.28204 shutdown 2026-02-20T03:30:39.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3948647219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 msgr2=0x562b32577e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32577e30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00a4860 tx=0x7f7ce0004970 comp rx=0 tx=0).stop 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3948647219 shutdown_connections 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b32586660 0x562b32588b20 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b32576570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32578370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3948647219 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32577e30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3948647219 >> 10.20.193.28:0/3948647219 conn(0x562b32520290 msgr2=0x562b3255c440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7c9ffff640 0 client.28204 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3948647219 shutdown_connections 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3948647219 wait complete. 2026-02-20T03:30:39.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.901+0000 7f7cf71e2e00 20 client.28204 trim_cache size 0 max 16384 2026-02-20T03:30:39.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.913+0000 7f7cf71e2e00 1 Processor -- start 2026-02-20T03:30:39.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cf71e2e00 1 -- start start 2026-02-20T03:30:39.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32555d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32575500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b32573a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cf71e2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7c940127d0 con 0x562b3255dfb0 2026-02-20T03:30:39.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cf71e2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7c94010040 con 0x562b32563000 2026-02-20T03:30:39.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cf71e2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9400de90 con 0x562b3255d630 2026-02-20T03:30:39.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cee575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32555d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cee575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32555d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45716/0 (socket says 10.20.193.28:45716) 2026-02-20T03:30:39.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.914+0000 7f7cee575640 1 -- 10.20.193.28:0/1220935549 learned_addr learned my addr 10.20.193.28:0/1220935549 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:39.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.915+0000 7f7ceed76640 1 --2- 10.20.193.28:0/1220935549 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b32573a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.915+0000 7f7cedd74640 1 --2- 10.20.193.28:0/1220935549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32575500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.915+0000 7f7cee575640 1 -- 10.20.193.28:0/1220935549 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 msgr2=0x562b32573a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:39.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.915+0000 7f7cee575640 1 --2- 10.20.193.28:0/1220935549 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b32573a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.915+0000 7f7cee575640 1 -- 10.20.193.28:0/1220935549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 msgr2=0x562b32575500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.915+0000 7f7cee575640 1 --2- 10.20.193.28:0/1220935549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32575500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.915+0000 7f7cee575640 1 -- 10.20.193.28:0/1220935549 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3256fa60 con 0x562b3255d630 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.915+0000 7f7cee575640 1 --2- 10.20.193.28:0/1220935549 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32555d50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000eb50 tx=0x7f7ce00aa000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab05ce356859e11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.915+0000 7f7cb64e6640 1 -- 10.20.193.28:0/1220935549 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00ce070 con 0x562b3255d630 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.916+0000 7f7cb64e6640 1 -- 10.20.193.28:0/1220935549 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x562b324be1a0 con 0x562b3255d630 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.916+0000 7f7cb64e6640 1 -- 10.20.193.28:0/1220935549 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0094040 con 0x562b3255d630 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.916+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/1220935549 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 msgr2=0x562b32555d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.916+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/1220935549 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32555d50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000eb50 tx=0x7f7ce00aa000 comp rx=0 tx=0).stop 2026-02-20T03:30:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.916+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/1220935549 shutdown_connections 2026-02-20T03:30:39.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.916+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/1220935549 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b32573a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.917+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/1220935549 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255dfb0 0x562b32575500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.917+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/1220935549 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255d630 0x562b32555d50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.917+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/1220935549 >> 10.20.193.28:0/1220935549 conn(0x562b32520290 msgr2=0x562b32574df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.917+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/1220935549 shutdown_connections 2026-02-20T03:30:39.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.917+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/1220935549 wait complete. 2026-02-20T03:30:39.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.918+0000 7f7cf71e2e00 1 -- start start 2026-02-20T03:30:39.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.918+0000 7f7cf71e2e00 1 Processor -- start 2026-02-20T03:30:39.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.919+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255d630 0x562b32581f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.919+0000 7f7cf71e2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255dfb0 0x562b32582460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.919+0000 7f7cee575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255d630 0x562b32581f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.919+0000 7f7cee575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255d630 0x562b32581f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50128/0 (socket says 10.20.193.28:50128) 2026-02-20T03:30:39.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.919+0000 7f7cee575640 1 -- 10.20.193.28:0/3941070543 learned_addr learned my addr 10.20.193.28:0/3941070543 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:39.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.920+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325829a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.920+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9400e500 con 0x562b3255d630 2026-02-20T03:30:39.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.920+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9400f970 con 0x562b32563000 2026-02-20T03:30:39.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.920+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9400ebd0 con 0x562b3255dfb0 2026-02-20T03:30:39.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.920+0000 7f7cedd74640 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255dfb0 0x562b32582460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.920+0000 7f7ceed76640 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325829a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7cee575640 1 -- 10.20.193.28:0/3941070543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255dfb0 msgr2=0x562b32582460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:39.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7cee575640 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255dfb0 0x562b32582460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7cee575640 1 -- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 msgr2=0x562b325829a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:39.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7cee575640 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325829a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7cee575640 1 -- 10.20.193.28:0/3941070543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3218f870 con 0x562b3255d630 2026-02-20T03:30:39.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7ceed76640 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325829a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:30:39.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7cee575640 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255d630 0x562b32581f20 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0004a70 tx=0x7f7ce0056c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ad4c15500a6d76 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:39.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7c9ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:39.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3941070543 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00c7070 con 0x562b3255d630 2026-02-20T03:30:39.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b32450440 con 0x562b3255d630 2026-02-20T03:30:39.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7cf71e2e00 10 client.19878 _ll_register_callbacks cb 0x7f7cf0069370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:39.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b32481810 con 0x562b3255d630 2026-02-20T03:30:39.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3941070543 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7ce00a8c10 con 0x562b3255d630 2026-02-20T03:30:39.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3941070543 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0094070 con 0x562b3255d630 2026-02-20T03:30:39.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3941070543 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f7ce00c92c0 con 0x562b3255d630 2026-02-20T03:30:39.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.921+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3941070543 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7ce00ce040 con 0x562b3255d630 2026-02-20T03:30:39.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.922+0000 7f7cf71e2e00 10 client.19878 fetch_fsmap learned FSMap version 39 2026-02-20T03:30:39.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.922+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=39}) -- 0x562b32570750 con 0x562b3255d630 2026-02-20T03:30:39.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.922+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3941070543 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 39) ==== 8366+0+0 (secure 0 0 0) 0x7f7ce00a76c0 con 0x562b3255d630 2026-02-20T03:30:39.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.922+0000 7f7cf71e2e00 10 client.19878 fetch_fsmap finished waiting for FSMap version 39 2026-02-20T03:30:39.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.922+0000 7f7cf71e2e00 10 client.19878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:39.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.922+0000 7f7cf71e2e00 20 client.19878 populate_metadata read hostname 'trial028' 2026-02-20T03:30:39.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.922+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b325f1750 0x562b325f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.922+0000 7f7cf71e2e00 4 client.19878 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.922+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b32462b00 con 0x562b325f1750 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.923+0000 7f7cedd74640 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b325f1750 0x562b325f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.923+0000 7f7cedd74640 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b325f1750 0x562b325f3bf0 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc10ca517464fe28 server_cookie=3433da839fcf2d5b in_seq=0 out_seq=0 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.923+0000 7f7c9ffff640 10 client.19878 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.923+0000 7f7c9ffff640 1 -- 10.20.193.28:0/3941070543 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562b32462b00 con 0x562b325f1750 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7c9ffff640 10 client.19878 handle_command_reply: tid=0 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 client.19878 shutdown 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255d630 msgr2=0x562b32581f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255d630 0x562b32581f20 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0004a70 tx=0x7f7ce0056c00 comp rx=0 tx=0).stop 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 shutdown_connections 2026-02-20T03:30:39.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b325f1750 0x562b325f3bf0 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b32563000 0x562b325829a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b3255dfb0 0x562b32582460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 --2- 10.20.193.28:0/3941070543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b3255d630 0x562b32581f20 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 >> 10.20.193.28:0/3941070543 conn(0x562b32520290 msgr2=0x562b32575610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7c9ffff640 0 client.19878 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:39.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 shutdown_connections 2026-02-20T03:30:39.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.924+0000 7f7cf71e2e00 1 -- 10.20.193.28:0/3941070543 wait complete. 2026-02-20T03:30:39.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.925+0000 7f7cf71e2e00 20 client.19878 trim_cache size 0 max 16384 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout: "4057c168-cd23-4589-8efb-1a56d3278c70": { 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "4057c168-cd23-4589-8efb-1a56d3278c70", 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:30:39.931 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:30:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.925+0000 7f7cef577640 1 -- 10.20.193.28:0/2185406216 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cc00b0f70 msgr2=0x7f7cc00b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.925+0000 7f7cef577640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cc00b0f70 0x7f7cc00b3430 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7cf01ab570 tx=0x7f7ce4009210 comp rx=0 tx=0).stop 2026-02-20T03:30:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.925+0000 7f7cef577640 1 -- 10.20.193.28:0/2185406216 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 msgr2=0x7f7cf01afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.925+0000 7f7cef577640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 0x7f7cf01afc60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000e170 tx=0x7f7ce000e640 comp rx=0 tx=0).stop 2026-02-20T03:30:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.927+0000 7f7cef577640 1 -- 10.20.193.28:0/2185406216 shutdown_connections 2026-02-20T03:30:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.927+0000 7f7cef577640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f7cc00b0f70 0x7f7cc00b3430 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.927+0000 7f7cef577640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f7cf0074d30 0x7f7cf0115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.927+0000 7f7cef577640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f7cf0074380 0x7f7cf01b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.927+0000 7f7cef577640 1 --2- 10.20.193.28:0/2185406216 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f7cf006f9f0 0x7f7cf01afc60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:39.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.927+0000 7f7cef577640 1 -- 10.20.193.28:0/2185406216 >> 10.20.193.28:0/2185406216 conn(0x7f7cf006ead0 msgr2=0x7f7cf00721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:39.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.927+0000 7f7cef577640 1 -- 10.20.193.28:0/2185406216 shutdown_connections 2026-02-20T03:30:39.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:39.927+0000 7f7cef577640 1 -- 10.20.193.28:0/2185406216 wait complete. 2026-02-20T03:30:40.091 INFO:tasks.cephfs.filesystem:scrub status for tag:4057c168-cd23-4589-8efb-1a56d3278c70 - {'path': '/', 'tag': '4057c168-cd23-4589-8efb-1a56d3278c70', 'options': 'recursive,force'} 2026-02-20T03:30:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:40 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:30:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:40 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:40 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:30:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:40 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:30:40.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:40 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:40.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 78083 83.79 MB/sec execute 11 sec latency 54.470 ms 2026-02-20T03:30:40.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:40 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:30:40.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:40 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:40.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:40 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:30:40.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:40 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:30:40.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:40 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:40.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:40 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:30:40.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:40 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:40.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:40 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:30:40.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:40 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:30:40.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:40 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:41.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 79749 84.09 MB/sec execute 12 sec latency 66.969 ms 2026-02-20T03:30:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:41 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:41 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:41 trial177 ceph-mon[43181]: pgmap v665: 129 pgs: 129 active+clean; 553 MiB data, 6.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 MiB/s rd, 11 MiB/s wr, 1.56k op/s 2026-02-20T03:30:41.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:41 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:41.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:41 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:41.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:41 trial126 ceph-mon[38476]: pgmap v665: 129 pgs: 129 active+clean; 553 MiB data, 6.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 MiB/s rd, 11 MiB/s wr, 1.56k op/s 2026-02-20T03:30:41.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:41 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:41.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:41 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:30:41.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:41 trial028 ceph-mon[38552]: pgmap v665: 129 pgs: 129 active+clean; 553 MiB data, 6.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 MiB/s rd, 11 MiB/s wr, 1.56k op/s 2026-02-20T03:30:42.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 81311 84.06 MB/sec execute 13 sec latency 33.643 ms 2026-02-20T03:30:43.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 82774 83.76 MB/sec execute 14 sec latency 51.696 ms 2026-02-20T03:30:43.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:43 trial028 ceph-mon[38552]: pgmap v666: 129 pgs: 129 active+clean; 551 MiB data, 6.5 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 9.5 MiB/s wr, 1.33k op/s 2026-02-20T03:30:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:43 trial177 ceph-mon[43181]: pgmap v666: 129 pgs: 129 active+clean; 551 MiB data, 6.5 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 9.5 MiB/s wr, 1.33k op/s 2026-02-20T03:30:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:43 trial126 ceph-mon[38476]: pgmap v666: 129 pgs: 129 active+clean; 551 MiB data, 6.5 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 9.5 MiB/s wr, 1.33k op/s 2026-02-20T03:30:44.675 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:44 trial028 ceph-mon[38552]: pgmap v667: 129 pgs: 129 active+clean; 551 MiB data, 6.5 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 9.7 MiB/s wr, 1.47k op/s 2026-02-20T03:30:44.699 INFO:tasks.workunit.client.0.trial028.stdout: 10 83818 81.96 MB/sec execute 15 sec latency 334.145 ms 2026-02-20T03:30:44.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:44 trial126 ceph-mon[38476]: pgmap v667: 129 pgs: 129 active+clean; 551 MiB data, 6.5 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 9.7 MiB/s wr, 1.47k op/s 2026-02-20T03:30:44.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:44 trial177 ceph-mon[43181]: pgmap v667: 129 pgs: 129 active+clean; 551 MiB data, 6.5 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 9.7 MiB/s wr, 1.47k op/s 2026-02-20T03:30:45.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83819 76.84 MB/sec execute 16 sec latency 1334.176 ms 2026-02-20T03:30:45.773 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:45 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:30:45.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:45 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:30:45.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:45 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:30:46.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:30:46.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:30:46.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:30:46.564 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:46 trial028 ceph-mon[38552]: pgmap v668: 129 pgs: 129 active+clean; 565 MiB data, 6.6 GiB used, 8.2 TiB / 8.2 TiB avail; 27 MiB/s rd, 10 MiB/s wr, 1.40k op/s 2026-02-20T03:30:46.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83822 72.37 MB/sec execute 17 sec latency 2334.214 ms 2026-02-20T03:30:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:30:46.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:30:46.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:30:46.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:46 trial126 ceph-mon[38476]: pgmap v668: 129 pgs: 129 active+clean; 565 MiB data, 6.6 GiB used, 8.2 TiB / 8.2 TiB avail; 27 MiB/s rd, 10 MiB/s wr, 1.40k op/s 2026-02-20T03:30:46.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:30:46.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:30:46.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:30:46.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:46 trial177 ceph-mon[43181]: pgmap v668: 129 pgs: 129 active+clean; 565 MiB data, 6.6 GiB used, 8.2 TiB / 8.2 TiB avail; 27 MiB/s rd, 10 MiB/s wr, 1.40k op/s 2026-02-20T03:30:47.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83825 68.36 MB/sec execute 18 sec latency 3292.155 ms 2026-02-20T03:30:47.893 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:47 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:30:47.893 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:47 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:30:48.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:47 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:30:48.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:47 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:30:48.271 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:47 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:30:48.271 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:47 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:30:48.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83825 64.76 MB/sec execute 19 sec latency 4292.196 ms 2026-02-20T03:30:48.990 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:48 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:30:48.991 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:48 trial028 ceph-mon[38552]: pgmap v669: 129 pgs: 129 active+clean; 565 MiB data, 6.6 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 9.7 MiB/s wr, 1.33k op/s 2026-02-20T03:30:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:48 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:30:49.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:48 trial177 ceph-mon[43181]: pgmap v669: 129 pgs: 129 active+clean; 565 MiB data, 6.6 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 9.7 MiB/s wr, 1.33k op/s 2026-02-20T03:30:49.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:48 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:30:49.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:48 trial126 ceph-mon[38476]: pgmap v669: 129 pgs: 129 active+clean; 565 MiB data, 6.6 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 9.7 MiB/s wr, 1.33k op/s 2026-02-20T03:30:49.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83968 61.86 MB/sec execute 20 sec latency 4997.278 ms 2026-02-20T03:30:50.118 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:49 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:30:50.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:49 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:30:50.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:49 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:30:50.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83969 58.92 MB/sec execute 21 sec latency 1226.861 ms 2026-02-20T03:30:50.964 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:50 trial028 ceph-mon[38552]: pgmap v670: 129 pgs: 129 active+clean; 579 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 11 MiB/s wr, 1.31k op/s 2026-02-20T03:30:51.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:50 trial177 ceph-mon[43181]: pgmap v670: 129 pgs: 129 active+clean; 579 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 11 MiB/s wr, 1.31k op/s 2026-02-20T03:30:51.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:50 trial126 ceph-mon[38476]: pgmap v670: 129 pgs: 129 active+clean; 579 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 11 MiB/s wr, 1.31k op/s 2026-02-20T03:30:51.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83969 56.24 MB/sec execute 22 sec latency 2226.910 ms 2026-02-20T03:30:52.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83969 53.79 MB/sec execute 23 sec latency 3226.953 ms 2026-02-20T03:30:52.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.827+0000 7f466e34a640 1 -- 10.20.193.28:0/2448682298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46681064f0 msgr2=0x7f466810cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:52.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.827+0000 7f466e34a640 1 --2- 10.20.193.28:0/2448682298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46681064f0 0x7f466810cd80 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f466400b0a0 tx=0x7f466402f450 comp rx=0 tx=0).stop 2026-02-20T03:30:52.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- 10.20.193.28:0/2448682298 shutdown_connections 2026-02-20T03:30:52.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 --2- 10.20.193.28:0/2448682298 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f46681064f0 0x7f466810cd80 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 --2- 10.20.193.28:0/2448682298 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4668105b30 0x7f4668105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 --2- 10.20.193.28:0/2448682298 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4668104940 0x7f4668104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- 10.20.193.28:0/2448682298 >> 10.20.193.28:0/2448682298 conn(0x7f46681000c0 msgr2=0x7f46681024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:52.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- 10.20.193.28:0/2448682298 shutdown_connections 2026-02-20T03:30:52.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- 10.20.193.28:0/2448682298 wait complete. 2026-02-20T03:30:52.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 Processor -- start 2026-02-20T03:30:52.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- start start 2026-02-20T03:30:52.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4668104940 0x7f466819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4668105b30 0x7f466819d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46681064f0 0x7f46681a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4668110550 con 0x7f4668104940 2026-02-20T03:30:52.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f46681103d0 con 0x7f46681064f0 2026-02-20T03:30:52.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f46681106d0 con 0x7f4668105b30 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466d348640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4668104940 0x7f466819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466d348640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4668104940 0x7f466819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53324/0 (socket says 10.20.193.28:53324) 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466d348640 1 -- 10.20.193.28:0/1009681940 learned_addr learned my addr 10.20.193.28:0/1009681940 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466d348640 1 -- 10.20.193.28:0/1009681940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4668105b30 msgr2=0x7f466819d0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466d348640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4668105b30 0x7f466819d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466d348640 1 -- 10.20.193.28:0/1009681940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46681064f0 msgr2=0x7f46681a4140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466d348640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46681064f0 0x7f46681a4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466d348640 1 -- 10.20.193.28:0/1009681940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46681a4840 con 0x7f4668104940 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466d348640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4668104940 0x7f466819cb90 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f465800b750 tx=0x7f465800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f46567fc640 1 -- 10.20.193.28:0/1009681940 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658004480 con 0x7f4668104940 2026-02-20T03:30:52.837 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f46567fc640 1 -- 10.20.193.28:0/1009681940 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4658010070 con 0x7f4668104940 2026-02-20T03:30:52.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f46567fc640 1 -- 10.20.193.28:0/1009681940 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465800ca90 con 0x7f4668104940 2026-02-20T03:30:52.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- 10.20.193.28:0/1009681940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46681a4b30 con 0x7f4668104940 2026-02-20T03:30:52.838 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.830+0000 7f466e34a640 1 -- 10.20.193.28:0/1009681940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46681a5030 con 0x7f4668104940 2026-02-20T03:30:52.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f46567fc640 1 -- 10.20.193.28:0/1009681940 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f465801d030 con 0x7f4668104940 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 Processor -- start 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 -- start start 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 0x560deaaae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaaae7c0 0x560deaab2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaab3560 0x560deaab59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560dea9fe8f0 con 0x560deaab3560 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560dea9ac2e0 con 0x560deaaade80 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560dea9fa820 con 0x560deaaae7c0 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466cb47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaab3560 0x560deaab59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466cb47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaab3560 0x560deaab59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53338/0 (socket says 10.20.193.28:53338) 2026-02-20T03:30:52.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466cb47640 1 -- 10.20.193.28:0/3542361449 learned_addr learned my addr 10.20.193.28:0/3542361449 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f46567fc640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46440b0e20 0x7f46440b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466cb47640 1 -- 10.20.193.28:0/3542361449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaaae7c0 msgr2=0x560deaab2f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466cb47640 1 --2- 10.20.193.28:0/3542361449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaaae7c0 0x560deaab2f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466cb47640 1 -- 10.20.193.28:0/3542361449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 msgr2=0x560deaaae280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466cb47640 1 --2- 10.20.193.28:0/3542361449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 0x560deaaae280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466cb47640 1 -- 10.20.193.28:0/3542361449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dea99e5a0 con 0x560deaab3560 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f46567fc640 1 -- 10.20.193.28:0/1009681940 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f46580df900 con 0x7f4668104940 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466cb47640 1 --2- 10.20.193.28:0/3542361449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaab3560 0x560deaab59f0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f465c009840 tx=0x7f465c009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2791596950c53f3c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466db49640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46440b0e20 0x7f46440b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f46357fe640 1 -- 10.20.193.28:0/3542361449 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c016070 con 0x560deaab3560 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f46357fe640 1 -- 10.20.193.28:0/3542361449 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f465c004480 con 0x560deaab3560 2026-02-20T03:30:52.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f46357fe640 1 -- 10.20.193.28:0/3542361449 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c00bca0 con 0x560deaab3560 2026-02-20T03:30:52.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 -- 10.20.193.28:0/3542361449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaab3560 msgr2=0x560deaab59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:52.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 --2- 10.20.193.28:0/3542361449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaab3560 0x560deaab59f0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f465c009840 tx=0x7f465c009d10 comp rx=0 tx=0).stop 2026-02-20T03:30:52.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f466db49640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46440b0e20 0x7f46440b32e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f466400b070 tx=0x7f4664031040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:52.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 -- 10.20.193.28:0/3542361449 shutdown_connections 2026-02-20T03:30:52.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 --2- 10.20.193.28:0/3542361449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaab3560 0x560deaab59f0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 --2- 10.20.193.28:0/3542361449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaaae7c0 0x560deaab2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 --2- 10.20.193.28:0/3542361449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 0x560deaaae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 -- 10.20.193.28:0/3542361449 >> 10.20.193.28:0/3542361449 conn(0x560deaaa56f0 msgr2=0x560deaaac570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:52.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 -- 10.20.193.28:0/3542361449 shutdown_connections 2026-02-20T03:30:52.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.833+0000 7f467243ee00 1 -- 10.20.193.28:0/3542361449 wait complete. 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 -- start start 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 Processor -- start 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaade80 0x560deaac67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaae7c0 0x560deaac6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 0x560deaacdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560dea9a60c0 con 0x560deaaade80 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560deaab6610 con 0x560deaaae7c0 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560deaace160 con 0x560deaab3560 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f466d348640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaade80 0x560deaac67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f466d348640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaade80 0x560deaac67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53344/0 (socket says 10.20.193.28:53344) 2026-02-20T03:30:52.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f466d348640 1 -- 10.20.193.28:0/3583784987 learned_addr learned my addr 10.20.193.28:0/3583784987 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f466d348640 1 -- 10.20.193.28:0/3583784987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 msgr2=0x560deaacdbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f466d348640 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 0x560deaacdbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f466d348640 1 -- 10.20.193.28:0/3583784987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaae7c0 msgr2=0x560deaac6d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f466d348640 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaae7c0 0x560deaac6d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f466d348640 1 -- 10.20.193.28:0/3583784987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560deaac02b0 con 0x560deaaade80 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f466d348640 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaade80 0x560deaac67f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f46580a7570 tx=0x7f465800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae473b3d53ea583c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f462a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f462a7fc640 1 -- 10.20.193.28:0/3583784987 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4658012de0 con 0x560deaaade80 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 -- 10.20.193.28:0/3583784987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dea9ba820 con 0x560deaaade80 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 10 client.19890 _ll_register_callbacks cb 0x560dea9a9ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 -- 10.20.193.28:0/3583784987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560deaa064e0 con 0x560deaaade80 2026-02-20T03:30:52.852 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f462a7fc640 1 -- 10.20.193.28:0/3583784987 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f46580cd070 con 0x560deaaade80 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f462a7fc640 1 -- 10.20.193.28:0/3583784987 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580a2f60 con 0x560deaaade80 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f462a7fc640 1 -- 10.20.193.28:0/3583784987 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f46580a6060 con 0x560deaaade80 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f462a7fc640 1 -- 10.20.193.28:0/3583784987 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f46580a63a0 con 0x560deaaade80 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 10 client.19890 fetch_fsmap learned FSMap version 40 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 -- 10.20.193.28:0/3583784987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x560dea9bf380 con 0x560deaaade80 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f462a7fc640 1 -- 10.20.193.28:0/3583784987 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f46580c82e0 con 0x560deaaade80 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 10 client.19890 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 10 client.19890 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 20 client.19890 populate_metadata read hostname 'trial028' 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560deaad2450 0x560deaad4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 4 client.19890 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:52.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.838+0000 7f467243ee00 1 -- 10.20.193.28:0/3583784987 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560dea980bd0 con 0x560deaad2450 2026-02-20T03:30:52.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.860+0000 7f466cb47640 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560deaad2450 0x560deaad4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:52.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.927+0000 7f466cb47640 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560deaad2450 0x560deaad4910 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7af3cd224c73b9d6 server_cookie=a2ee8ccfab0596cc in_seq=0 out_seq=0 2026-02-20T03:30:52.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.927+0000 7f462a7fc640 10 client.19890 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:52.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f462a7fc640 1 -- 10.20.193.28:0/3583784987 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560dea980bd0 con 0x560deaad2450 2026-02-20T03:30:52.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f462a7fc640 10 client.19890 handle_command_reply: tid=0 2026-02-20T03:30:52.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 client.19890 shutdown 2026-02-20T03:30:52.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 -- 10.20.193.28:0/3583784987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaade80 msgr2=0x560deaac67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:52.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaade80 0x560deaac67f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f46580a7570 tx=0x7f465800cf90 comp rx=0 tx=0).stop 2026-02-20T03:30:52.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 -- 10.20.193.28:0/3583784987 shutdown_connections 2026-02-20T03:30:52.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560deaad2450 0x560deaad4910 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 0x560deaacdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaae7c0 0x560deaac6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 --2- 10.20.193.28:0/3583784987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaade80 0x560deaac67f0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f462a7fc640 0 client.19890 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:52.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 -- 10.20.193.28:0/3583784987 >> 10.20.193.28:0/3583784987 conn(0x560deaaa56f0 msgr2=0x560deaab4870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:52.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 -- 10.20.193.28:0/3583784987 shutdown_connections 2026-02-20T03:30:52.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 1 -- 10.20.193.28:0/3583784987 wait complete. 2026-02-20T03:30:52.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.953+0000 7f467243ee00 20 client.19890 trim_cache size 0 max 16384 2026-02-20T03:30:52.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 Processor -- start 2026-02-20T03:30:52.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- start start 2026-02-20T03:30:52.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 0x560deaac4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaacdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 0x560deaac65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4614012750 con 0x560deaaae7c0 2026-02-20T03:30:52.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f461400ffc0 con 0x560deaaade80 2026-02-20T03:30:52.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f461400de10 con 0x560deaab3560 2026-02-20T03:30:52.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f466cb47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaacdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:52.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f466cb47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaacdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53354/0 (socket says 10.20.193.28:53354) 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f466cb47640 1 -- 10.20.193.28:0/2724399390 learned_addr learned my addr 10.20.193.28:0/2724399390 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f466cb47640 1 -- 10.20.193.28:0/2724399390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 msgr2=0x560deaac65a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f466cb47640 1 --2- 10.20.193.28:0/2724399390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 0x560deaac65a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f466cb47640 1 -- 10.20.193.28:0/2724399390 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 msgr2=0x560deaac4360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f466cb47640 1 --2- 10.20.193.28:0/2724399390 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 0x560deaac4360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f466cb47640 1 -- 10.20.193.28:0/2724399390 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560deaac00e0 con 0x560deaaae7c0 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f466cb47640 1 --2- 10.20.193.28:0/2724399390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaacdb90 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f465c0090e0 tx=0x7f465c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f3b15a3a33fdb5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f4634ffd640 1 -- 10.20.193.28:0/2724399390 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c016040 con 0x560deaaae7c0 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f4634ffd640 1 -- 10.20.193.28:0/2724399390 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f465c00b7d0 con 0x560deaaae7c0 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f4634ffd640 1 -- 10.20.193.28:0/2724399390 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c01e690 con 0x560deaaae7c0 2026-02-20T03:30:52.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- 10.20.193.28:0/2724399390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 msgr2=0x560deaacdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:52.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 --2- 10.20.193.28:0/2724399390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaacdb90 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f465c0090e0 tx=0x7f465c00b760 comp rx=0 tx=0).stop 2026-02-20T03:30:52.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- 10.20.193.28:0/2724399390 shutdown_connections 2026-02-20T03:30:52.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 --2- 10.20.193.28:0/2724399390 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 0x560deaac65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 --2- 10.20.193.28:0/2724399390 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaacdb90 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 --2- 10.20.193.28:0/2724399390 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 0x560deaac4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- 10.20.193.28:0/2724399390 >> 10.20.193.28:0/2724399390 conn(0x560deaaa56f0 msgr2=0x560deaac5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- 10.20.193.28:0/2724399390 shutdown_connections 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- 10.20.193.28:0/2724399390 wait complete. 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 -- start start 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.959+0000 7f467243ee00 1 Processor -- start 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 0x560deaacd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaaca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 0x560deaaca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f461400e480 con 0x560deaaae7c0 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f461400f8f0 con 0x560deaaade80 2026-02-20T03:30:52.972 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f461400eb50 con 0x560deaab3560 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f466cb47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaaca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f466cb47640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaaca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53366/0 (socket says 10.20.193.28:53366) 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f466cb47640 1 -- 10.20.193.28:0/2273982221 learned_addr learned my addr 10.20.193.28:0/2273982221 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f466cb47640 1 -- 10.20.193.28:0/2273982221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 msgr2=0x560deaaca890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f466cb47640 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 0x560deaaca890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f466cb47640 1 -- 10.20.193.28:0/2273982221 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 msgr2=0x560deaacd880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f466cb47640 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 0x560deaacd880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f466cb47640 1 -- 10.20.193.28:0/2273982221 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560deaac75a0 con 0x560deaaae7c0 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f466cb47640 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaaca350 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f465c009810 tx=0x7f465c009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded0d52c4576d968 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f462a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:52.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f462a7fc640 1 -- 10.20.193.28:0/2273982221 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c016040 con 0x560deaaae7c0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f462a7fc640 1 -- 10.20.193.28:0/2273982221 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f465c00be20 con 0x560deaaae7c0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f462a7fc640 1 -- 10.20.193.28:0/2273982221 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465c01ead0 con 0x560deaaae7c0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 -- 10.20.193.28:0/2273982221 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dea75e690 con 0x560deaaae7c0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f462a7fc640 1 -- 10.20.193.28:0/2273982221 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f465c01ec90 con 0x560deaaae7c0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 10 client.19896 _ll_register_callbacks cb 0x7f46580a6b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 -- 10.20.193.28:0/2273982221 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f465c004480 con 0x560deaaae7c0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f462a7fc640 1 -- 10.20.193.28:0/2273982221 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f465c030060 con 0x560deaaae7c0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 10 client.19896 fetch_fsmap learned FSMap version 40 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 -- 10.20.193.28:0/2273982221 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x560dea9c3b70 con 0x560deaaae7c0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f462a7fc640 1 -- 10.20.193.28:0/2273982221 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f465c02a030 con 0x560deaaae7c0 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 10 client.19896 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:30:52.974 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 10 client.19896 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:30:52.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 20 client.19896 populate_metadata read hostname 'trial028' 2026-02-20T03:30:52.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560deab3e470 0x560deab40930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:52.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 4 client.19896 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:30:52.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.964+0000 7f467243ee00 1 -- 10.20.193.28:0/2273982221 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560dea9cf6b0 con 0x560deab3e470 2026-02-20T03:30:52.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:52.980+0000 7f466d348640 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560deab3e470 0x560deab40930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:53.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.046+0000 7f466d348640 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560deab3e470 0x560deab40930 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b33e1f5e9d2d3d server_cookie=fd1837988d7732fa in_seq=0 out_seq=0 2026-02-20T03:30:53.049 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.046+0000 7f462a7fc640 10 client.19896 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f462a7fc640 1 -- 10.20.193.28:0/2273982221 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560dea9cf6b0 con 0x560deab3e470 2026-02-20T03:30:53.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f462a7fc640 10 client.19896 handle_command_reply: tid=0 2026-02-20T03:30:53.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f467243ee00 1 client.19896 shutdown 2026-02-20T03:30:53.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f467243ee00 1 -- 10.20.193.28:0/2273982221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 msgr2=0x560deaaca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:53.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f467243ee00 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaaca350 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f465c009810 tx=0x7f465c009370 comp rx=0 tx=0).stop 2026-02-20T03:30:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f467243ee00 1 -- 10.20.193.28:0/2273982221 shutdown_connections 2026-02-20T03:30:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f467243ee00 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560deab3e470 0x560deab40930 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f467243ee00 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560deaab3560 0x560deaaca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:53.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f467243ee00 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560deaaae7c0 0x560deaaca350 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f467243ee00 1 --2- 10.20.193.28:0/2273982221 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560deaaade80 0x560deaacd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f467243ee00 1 -- 10.20.193.28:0/2273982221 >> 10.20.193.28:0/2273982221 conn(0x560deaaa56f0 msgr2=0x560deaac66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.335+0000 7f462a7fc640 0 client.19896 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.336+0000 7f467243ee00 1 -- 10.20.193.28:0/2273982221 shutdown_connections 2026-02-20T03:30:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.336+0000 7f467243ee00 1 -- 10.20.193.28:0/2273982221 wait complete. 2026-02-20T03:30:53.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.336+0000 7f467243ee00 20 client.19896 trim_cache size 0 max 16384 2026-02-20T03:30:53.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:30:53.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:30:53.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:30:53.352 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:30:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 -- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46440b0e20 msgr2=0x7f46440b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46440b0e20 0x7f46440b32e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f466400b070 tx=0x7f4664031040 comp rx=0 tx=0).stop 2026-02-20T03:30:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 -- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4668104940 msgr2=0x7f466819cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4668104940 0x7f466819cb90 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f465800b750 tx=0x7f465800bc20 comp rx=0 tx=0).stop 2026-02-20T03:30:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 -- 10.20.193.28:0/1009681940 shutdown_connections 2026-02-20T03:30:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f46440b0e20 0x7f46440b32e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:53.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f46681064f0 0x7f46681a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:53.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4668105b30 0x7f466819d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:53.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 --2- 10.20.193.28:0/1009681940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4668104940 0x7f466819cb90 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:53.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 -- 10.20.193.28:0/1009681940 >> 10.20.193.28:0/1009681940 conn(0x7f46681000c0 msgr2=0x7f4668108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:53.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 -- 10.20.193.28:0/1009681940 shutdown_connections 2026-02-20T03:30:53.354 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:30:53.338+0000 7f466e34a640 1 -- 10.20.193.28:0/1009681940 wait complete. 2026-02-20T03:30:53.434 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:53 trial028 ceph-mon[38552]: pgmap v671: 129 pgs: 129 active+clean; 590 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 14 MiB/s rd, 9.6 MiB/s wr, 852 op/s 2026-02-20T03:30:53.521 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.4 2026-02-20T03:30:53.521 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:30:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:53 trial126 ceph-mon[38476]: pgmap v671: 129 pgs: 129 active+clean; 590 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 14 MiB/s rd, 9.6 MiB/s wr, 852 op/s 2026-02-20T03:30:53.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83969 51.55 MB/sec execute 24 sec latency 4226.988 ms 2026-02-20T03:30:53.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:53 trial177 ceph-mon[43181]: pgmap v671: 129 pgs: 129 active+clean; 590 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 14 MiB/s rd, 9.6 MiB/s wr, 852 op/s 2026-02-20T03:30:53.810 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:54.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 -- 10.20.193.28:0/982226990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 msgr2=0x7fd4e4102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:54.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/982226990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 0x7fd4e4102b60 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009a60 tx=0x7fd4cc02f290 comp rx=0 tx=0).stop 2026-02-20T03:30:54.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 -- 10.20.193.28:0/982226990 shutdown_connections 2026-02-20T03:30:54.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/982226990 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4e41030a0 0x7fd4e410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/982226990 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 0x7fd4e4102b60 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/982226990 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4e4108700 0x7fd4e4108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 -- 10.20.193.28:0/982226990 >> 10.20.193.28:0/982226990 conn(0x7fd4e40fe3e0 msgr2=0x7fd4e4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:54.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 -- 10.20.193.28:0/982226990 shutdown_connections 2026-02-20T03:30:54.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 -- 10.20.193.28:0/982226990 wait complete. 2026-02-20T03:30:54.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 Processor -- start 2026-02-20T03:30:54.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 -- start start 2026-02-20T03:30:54.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 0x7fd4e4075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4e41030a0 0x7fd4e40758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4e4108700 0x7fd4e4075df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4112a50 con 0x7fd4e4102700 2026-02-20T03:30:54.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e41128d0 con 0x7fd4e41030a0 2026-02-20T03:30:54.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e3fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4112bd0 con 0x7fd4e4108700 2026-02-20T03:30:54.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 0x7fd4e4075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 0x7fd4e4075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53392/0 (socket says 10.20.193.28:53392) 2026-02-20T03:30:54.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e2ffd640 1 -- 10.20.193.28:0/1669382794 learned_addr learned my addr 10.20.193.28:0/1669382794 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:54.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e2ffd640 1 -- 10.20.193.28:0/1669382794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4e4108700 msgr2=0x7fd4e4075df0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:54.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e2ffd640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4e4108700 0x7fd4e4075df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e2ffd640 1 -- 10.20.193.28:0/1669382794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4e41030a0 msgr2=0x7fd4e40758b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:30:54.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e2ffd640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4e41030a0 0x7fd4e40758b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.061+0000 7fd4e2ffd640 1 -- 10.20.193.28:0/1669382794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e41a95e0 con 0x7fd4e4102700 2026-02-20T03:30:54.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4e2ffd640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 0x7fd4e4075370 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800b570 tx=0x7fd4d800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:54.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4c3fff640 1 -- 10.20.193.28:0/1669382794 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8013020 con 0x7fd4e4102700 2026-02-20T03:30:54.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4c3fff640 1 -- 10.20.193.28:0/1669382794 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd4d8004480 con 0x7fd4e4102700 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e41a98d0 con 0x7fd4e4102700 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4c3fff640 1 -- 10.20.193.28:0/1669382794 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800fb50 con 0x7fd4e4102700 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e41a9e60 con 0x7fd4e4102700 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e4102be0 con 0x7fd4e4102700 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4c3fff640 1 -- 10.20.193.28:0/1669382794 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd4d8002780 con 0x7fd4e4102700 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4c3fff640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4b40b0e20 0x7fd4b40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4c3fff640 1 -- 10.20.193.28:0/1669382794 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fd4d80e0c30 con 0x7fd4e4102700 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.066+0000 7fd4c3fff640 1 -- 10.20.193.28:0/1669382794 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd4d801d020 con 0x7fd4e4102700 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.071+0000 7fd4e27fc640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4b40b0e20 0x7fd4b40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.071+0000 7fd4e27fc640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4b40b0e20 0x7fd4b40b32e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009950 tx=0x7fd4cc0023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:54.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.179+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4e40768a0 con 0x7fd4e4102700 2026-02-20T03:30:54.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.180+0000 7fd4c3fff640 1 -- 10.20.193.28:0/1669382794 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11924 (secure 0 0 0) 0x7fd4e40768a0 con 0x7fd4e4102700 2026-02-20T03:30:54.183 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:30:54.186 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":40,"btime":"2026-02-20T03:30:48:852343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:30:48.476361+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28114":{"gid":28114,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1701826560","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1701826560},{"type":"v1","addr":"10.20.193.177:6837","nonce":1701826560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:30:54.186 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 40 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4b40b0e20 msgr2=0x7fd4b40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4b40b0e20 0x7fd4b40b32e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009950 tx=0x7fd4cc0023d0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 msgr2=0x7fd4e4075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 0x7fd4e4075370 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800b570 tx=0x7fd4d800ba40 comp rx=0 tx=0).stop 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 shutdown_connections 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4b40b0e20 0x7fd4b40b32e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd4e4108700 0x7fd4e4075df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd4e41030a0 0x7fd4e40758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 --2- 10.20.193.28:0/1669382794 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd4e4102700 0x7fd4e4075370 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 >> 10.20.193.28:0/1669382794 conn(0x7fd4e40fe3e0 msgr2=0x7fd4e40fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:54.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 shutdown_connections 2026-02-20T03:30:54.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.182+0000 7fd4e3fff640 1 -- 10.20.193.28:0/1669382794 wait complete. 2026-02-20T03:30:54.340 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db / --timeout 90 --expiration 144.4 --await-for 45.0' 2026-02-20T03:30:54.341 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db / --timeout 90 --expiration 144.4 --await-for 45.0 2026-02-20T03:30:54.475 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:54 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1669382794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:54.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:54 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1669382794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:54.664 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:30:54.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 49.49 MB/sec execute 25 sec latency 5227.024 ms 2026-02-20T03:30:54.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:54 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1669382794' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:30:54.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 -- 10.20.193.28:0/3141094999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd22c10f1e0 msgr2=0x7fd22c10f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 --2- 10.20.193.28:0/3141094999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd22c10f1e0 0x7fd22c10f5c0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009a30 tx=0x7fd21c02f260 comp rx=0 tx=0).stop 2026-02-20T03:30:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 -- 10.20.193.28:0/3141094999 shutdown_connections 2026-02-20T03:30:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 --2- 10.20.193.28:0/3141094999 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd22c109bc0 0x7fd22c115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 --2- 10.20.193.28:0/3141094999 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd22c109220 0x7fd22c109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 --2- 10.20.193.28:0/3141094999 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd22c10f1e0 0x7fd22c10f5c0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 -- 10.20.193.28:0/3141094999 >> 10.20.193.28:0/3141094999 conn(0x7fd22c078860 msgr2=0x7fd22c07ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 -- 10.20.193.28:0/3141094999 shutdown_connections 2026-02-20T03:30:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 -- 10.20.193.28:0/3141094999 wait complete. 2026-02-20T03:30:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 Processor -- start 2026-02-20T03:30:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.918+0000 7fd2346fa640 1 -- start start 2026-02-20T03:30:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.919+0000 7fd2346fa640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd22c109220 0x7fd22c083870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.919+0000 7fd2346fa640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd22c109bc0 0x7fd22c083db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.919+0000 7fd2346fa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd22c10f1e0 0x7fd22c07ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.920+0000 7fd23246f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd22c109220 0x7fd22c083870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.920+0000 7fd231c6e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd22c109bc0 0x7fd22c083db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.920+0000 7fd2346fa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c119430 con 0x7fd22c10f1e0 2026-02-20T03:30:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.920+0000 7fd2346fa640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c1192b0 con 0x7fd22c109220 2026-02-20T03:30:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.920+0000 7fd2346fa640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd22c1195b0 con 0x7fd22c109bc0 2026-02-20T03:30:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.920+0000 7fd23246f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd22c109220 0x7fd22c083870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:41084/0 (socket says 10.20.193.28:41084) 2026-02-20T03:30:54.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.920+0000 7fd23246f640 1 -- 10.20.193.28:0/2149364780 learned_addr learned my addr 10.20.193.28:0/2149364780 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.920+0000 7fd232c70640 1 --2- 10.20.193.28:0/2149364780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd22c10f1e0 0x7fd22c07ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd232c70640 1 -- 10.20.193.28:0/2149364780 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd22c109bc0 msgr2=0x7fd22c083db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd232c70640 1 --2- 10.20.193.28:0/2149364780 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd22c109bc0 0x7fd22c083db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd232c70640 1 -- 10.20.193.28:0/2149364780 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd22c109220 msgr2=0x7fd22c083870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd232c70640 1 --2- 10.20.193.28:0/2149364780 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd22c109220 0x7fd22c083870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd232c70640 1 -- 10.20.193.28:0/2149364780 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22c07d2e0 con 0x7fd22c10f1e0 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd232c70640 1 --2- 10.20.193.28:0/2149364780 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd22c10f1e0 0x7fd22c07ca20 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fd22800b9b0 tx=0x7fd22800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd2137fe640 1 -- 10.20.193.28:0/2149364780 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22800ca80 con 0x7fd22c10f1e0 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd2346fa640 1 -- 10.20.193.28:0/2149364780 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22c07d5d0 con 0x7fd22c10f1e0 2026-02-20T03:30:54.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd2137fe640 1 -- 10.20.193.28:0/2149364780 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd228010070 con 0x7fd22c10f1e0 2026-02-20T03:30:54.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd2137fe640 1 -- 10.20.193.28:0/2149364780 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2280156d0 con 0x7fd22c10f1e0 2026-02-20T03:30:54.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd2346fa640 1 -- 10.20.193.28:0/2149364780 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd22c081620 con 0x7fd22c10f1e0 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.922+0000 7fd2137fe640 1 -- 10.20.193.28:0/2149364780 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd2280040a0 con 0x7fd22c10f1e0 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd2137fe640 1 --2- 10.20.193.28:0/2149364780 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2080b0e20 0x7fd2080b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd2137fe640 1 -- 10.20.193.28:0/2149364780 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fd2280e05c0 con 0x7fd22c10f1e0 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd23246f640 1 --2- 10.20.193.28:0/2149364780 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2080b0e20 0x7fd2080b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd23246f640 1 --2- 10.20.193.28:0/2149364780 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd2080b0e20 0x7fd2080b32e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0097c0 tx=0x7fd21c03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd236bffe00 1 Processor -- start 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd236bffe00 1 -- start start 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc12070 0x56505fc12450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0c860 0x56505fc0ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0d200 0x56505fc18dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd236bffe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56505fb5f410 con 0x56505fc0d200 2026-02-20T03:30:54.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd236bffe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56505fb0c8b0 con 0x56505fc12070 2026-02-20T03:30:54.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.928+0000 7fd236bffe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56505fb5b340 con 0x56505fc0c860 2026-02-20T03:30:54.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.933+0000 7fd232c70640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0d200 0x56505fc18dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.933+0000 7fd232c70640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0d200 0x56505fc18dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53414/0 (socket says 10.20.193.28:53414) 2026-02-20T03:30:54.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd232c70640 1 -- 10.20.193.28:0/412482791 learned_addr learned my addr 10.20.193.28:0/412482791 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:54.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd231c6e640 1 --2- 10.20.193.28:0/412482791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0c860 0x56505fc0ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd23246f640 1 --2- 10.20.193.28:0/412482791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc12070 0x56505fc12450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd232c70640 1 -- 10.20.193.28:0/412482791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0c860 msgr2=0x56505fc0ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:54.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd232c70640 1 --2- 10.20.193.28:0/412482791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0c860 0x56505fc0ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd232c70640 1 -- 10.20.193.28:0/412482791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc12070 msgr2=0x56505fc12450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:30:54.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd232c70640 1 --2- 10.20.193.28:0/412482791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc12070 0x56505fc12450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd232c70640 1 -- 10.20.193.28:0/412482791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505fafe8c0 con 0x56505fc0d200 2026-02-20T03:30:54.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd232c70640 1 --2- 10.20.193.28:0/412482791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0d200 0x56505fc18dc0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fd2280a5290 tx=0x7fd228009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e217b4017bfa86fc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:54.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd210cf3640 1 -- 10.20.193.28:0/412482791 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2280b1560 con 0x56505fc0d200 2026-02-20T03:30:54.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd210cf3640 1 -- 10.20.193.28:0/412482791 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd2280a42b0 con 0x56505fc0d200 2026-02-20T03:30:54.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd210cf3640 1 -- 10.20.193.28:0/412482791 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2280ac3d0 con 0x56505fc0d200 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd236bffe00 1 -- 10.20.193.28:0/412482791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0d200 msgr2=0x56505fc18dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd236bffe00 1 --2- 10.20.193.28:0/412482791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0d200 0x56505fc18dc0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fd2280a5290 tx=0x7fd228009710 comp rx=0 tx=0).stop 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd236bffe00 1 -- 10.20.193.28:0/412482791 shutdown_connections 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd236bffe00 1 --2- 10.20.193.28:0/412482791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0d200 0x56505fc18dc0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd236bffe00 1 --2- 10.20.193.28:0/412482791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0c860 0x56505fc0ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd236bffe00 1 --2- 10.20.193.28:0/412482791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc12070 0x56505fc12450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd236bffe00 1 -- 10.20.193.28:0/412482791 >> 10.20.193.28:0/412482791 conn(0x56505fc053c0 msgr2=0x56505fc0af60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd236bffe00 1 -- 10.20.193.28:0/412482791 shutdown_connections 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.934+0000 7fd236bffe00 1 -- 10.20.193.28:0/412482791 wait complete. 2026-02-20T03:30:54.946 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 -- start start 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 Processor -- start 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc0c860 0x56505fc27220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0d200 0x56505fc27760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc12070 0x56505fc259d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56505fb064a0 con 0x56505fc12070 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56505fc19460 con 0x56505fc0c860 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56505fc26010 con 0x56505fc0d200 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd232c70640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc12070 0x56505fc259d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd232c70640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc12070 0x56505fc259d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53416/0 (socket says 10.20.193.28:53416) 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd232c70640 1 -- 10.20.193.28:0/3612606328 learned_addr learned my addr 10.20.193.28:0/3612606328 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd232c70640 1 -- 10.20.193.28:0/3612606328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0d200 msgr2=0x56505fc27760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:54.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd232c70640 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0d200 0x56505fc27760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd232c70640 1 -- 10.20.193.28:0/3612606328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc0c860 msgr2=0x56505fc27220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd232c70640 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc0c860 0x56505fc27220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:54.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd232c70640 1 -- 10.20.193.28:0/3612606328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505fc1ecf0 con 0x56505fc12070 2026-02-20T03:30:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd232c70640 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc12070 0x56505fc259d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fd2280a7f20 tx=0x7fd2280b1300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7de666474bd18e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd1dffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd1dffff640 1 -- 10.20.193.28:0/3612606328 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2280c1020 con 0x56505fc12070 2026-02-20T03:30:54.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd1dffff640 1 -- 10.20.193.28:0/3612606328 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd2280b1560 con 0x56505fc12070 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd1dffff640 1 -- 10.20.193.28:0/3612606328 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2280a6fe0 con 0x56505fc12070 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 -- 10.20.193.28:0/3612606328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505f8c38a0 con 0x56505fc12070 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 10 client.19914 _ll_register_callbacks cb 0x56505fb0a3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 -- 10.20.193.28:0/3612606328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56505fb67000 con 0x56505fc12070 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd1dffff640 1 -- 10.20.193.28:0/3612606328 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fd2280ad7b0 con 0x56505fc12070 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd1dffff640 1 -- 10.20.193.28:0/3612606328 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd2280ada70 con 0x56505fc12070 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 10 client.19914 fetch_fsmap learned FSMap version 40 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 -- 10.20.193.28:0/3612606328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x56505f92f0e0 con 0x56505fc12070 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd1dffff640 1 -- 10.20.193.28:0/3612606328 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fd2280a7280 con 0x56505fc12070 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 10 client.19914 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 10 client.19914 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:30:54.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 20 client.19914 populate_metadata read hostname 'trial028' 2026-02-20T03:30:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56505fc35130 0x56505fc375f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 4 client.19914 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:30:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.940+0000 7fd236bffe00 1 -- 10.20.193.28:0/3612606328 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56505fae0f60 con 0x56505fc35130 2026-02-20T03:30:54.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.948+0000 7fd23246f640 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56505fc35130 0x56505fc375f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:54.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.991+0000 7fd23246f640 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56505fc35130 0x56505fc375f0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89f9812f8f3cff4d server_cookie=707b77afb21925 in_seq=0 out_seq=0 2026-02-20T03:30:54.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:54.991+0000 7fd1dffff640 10 client.19914 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:55.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd1dffff640 1 -- 10.20.193.28:0/3612606328 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56505fae0f60 con 0x56505fc35130 2026-02-20T03:30:55.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd1dffff640 10 client.19914 handle_command_reply: tid=0 2026-02-20T03:30:55.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 client.19914 shutdown 2026-02-20T03:30:55.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 -- 10.20.193.28:0/3612606328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc12070 msgr2=0x56505fc259d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:55.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc12070 0x56505fc259d0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fd2280a7f20 tx=0x7fd2280b1300 comp rx=0 tx=0).stop 2026-02-20T03:30:55.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 -- 10.20.193.28:0/3612606328 shutdown_connections 2026-02-20T03:30:55.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56505fc35130 0x56505fc375f0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc12070 0x56505fc259d0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0d200 0x56505fc27760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 --2- 10.20.193.28:0/3612606328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc0c860 0x56505fc27220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd1dffff640 0 client.19914 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:55.009 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 -- 10.20.193.28:0/3612606328 >> 10.20.193.28:0/3612606328 conn(0x56505fc053c0 msgr2=0x56505fc0b670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.005+0000 7fd236bffe00 1 -- 10.20.193.28:0/3612606328 shutdown_connections 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.006+0000 7fd236bffe00 1 -- 10.20.193.28:0/3612606328 wait complete. 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.006+0000 7fd236bffe00 20 client.19914 trim_cache size 0 max 16384 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.014+0000 7fd236bffe00 1 Processor -- start 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd236bffe00 1 -- start start 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc0b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0d200 0x56505fc0bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc12070 0x56505fc3cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd236bffe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d4012750 con 0x56505fc0c860 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd236bffe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d400ffc0 con 0x56505fc12070 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd236bffe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d400de10 con 0x56505fc0d200 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd23246f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc0b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd23246f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc0b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53420/0 (socket says 10.20.193.28:53420) 2026-02-20T03:30:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.015+0000 7fd23246f640 1 -- 10.20.193.28:0/1833481545 learned_addr learned my addr 10.20.193.28:0/1833481545 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd23246f640 1 -- 10.20.193.28:0/1833481545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0d200 msgr2=0x56505fc0bbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd23246f640 1 --2- 10.20.193.28:0/1833481545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0d200 0x56505fc0bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd23246f640 1 -- 10.20.193.28:0/1833481545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc12070 msgr2=0x56505fc3cec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd23246f640 1 --2- 10.20.193.28:0/1833481545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc12070 0x56505fc3cec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd23246f640 1 -- 10.20.193.28:0/1833481545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505fc1eb20 con 0x56505fc0c860 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd23246f640 1 --2- 10.20.193.28:0/1833481545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc0b670 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009a00 tx=0x7fd21c004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d62818ba6c5df54 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd1fa4e6640 1 -- 10.20.193.28:0/1833481545 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c05b070 con 0x56505fc0c860 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd1fa4e6640 1 -- 10.20.193.28:0/1833481545 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd21c033040 con 0x56505fc0c860 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd1fa4e6640 1 -- 10.20.193.28:0/1833481545 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0389f0 con 0x56505fc0c860 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 -- 10.20.193.28:0/1833481545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 msgr2=0x56505fc0b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 --2- 10.20.193.28:0/1833481545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc0b670 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009a00 tx=0x7fd21c004000 comp rx=0 tx=0).stop 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 -- 10.20.193.28:0/1833481545 shutdown_connections 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 --2- 10.20.193.28:0/1833481545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc12070 0x56505fc3cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 --2- 10.20.193.28:0/1833481545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc0d200 0x56505fc0bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 --2- 10.20.193.28:0/1833481545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc0b670 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 -- 10.20.193.28:0/1833481545 >> 10.20.193.28:0/1833481545 conn(0x56505fc053c0 msgr2=0x56505fc0af60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 -- 10.20.193.28:0/1833481545 shutdown_connections 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 -- 10.20.193.28:0/1833481545 wait complete. 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 -- start start 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 Processor -- start 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc2c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc0d200 0x56505fc2cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc12070 0x56505fca00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d400e480 con 0x56505fc0c860 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d400f8f0 con 0x56505fc0d200 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.016+0000 7fd236bffe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d400eb50 con 0x56505fc12070 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd23246f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc2c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd23246f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc2c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53426/0 (socket says 10.20.193.28:53426) 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd23246f640 1 -- 10.20.193.28:0/79804088 learned_addr learned my addr 10.20.193.28:0/79804088 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd23246f640 1 -- 10.20.193.28:0/79804088 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc12070 msgr2=0x56505fca00b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd23246f640 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc12070 0x56505fca00b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd23246f640 1 -- 10.20.193.28:0/79804088 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc0d200 msgr2=0x56505fc2cd80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:30:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd23246f640 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc0d200 0x56505fc2cd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:30:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd23246f640 1 -- 10.20.193.28:0/79804088 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56505fc1e6e0 con 0x56505fc0c860 2026-02-20T03:30:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd23246f640 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc2c840 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009380 tx=0x7fd21c0048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e198f14e7b8c7f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:30:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd1dffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:30:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd1dffff640 1 -- 10.20.193.28:0/79804088 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c05b070 con 0x56505fc0c860 2026-02-20T03:30:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd1dffff640 1 -- 10.20.193.28:0/79804088 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd21c05c040 con 0x56505fc0c860 2026-02-20T03:30:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd1dffff640 1 -- 10.20.193.28:0/79804088 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c005340 con 0x56505fc0c860 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd236bffe00 1 -- 10.20.193.28:0/79804088 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56505f8e07f0 con 0x56505fc0c860 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd236bffe00 10 client.19920 _ll_register_callbacks cb 0x7fd2280a4460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.019+0000 7fd236bffe00 1 -- 10.20.193.28:0/79804088 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2280a42b0 con 0x56505fc0c860 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.020+0000 7fd1dffff640 1 -- 10.20.193.28:0/79804088 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fd21c004500 con 0x56505fc0c860 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.020+0000 7fd1dffff640 1 -- 10.20.193.28:0/79804088 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fd21c0054e0 con 0x56505fc0c860 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.020+0000 7fd236bffe00 10 client.19920 fetch_fsmap learned FSMap version 40 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.020+0000 7fd236bffe00 1 -- 10.20.193.28:0/79804088 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x56505fc1f810 con 0x56505fc0c860 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.020+0000 7fd1dffff640 1 -- 10.20.193.28:0/79804088 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fd21c038790 con 0x56505fc0c860 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.020+0000 7fd236bffe00 10 client.19920 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.020+0000 7fd236bffe00 10 client.19920 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.020+0000 7fd236bffe00 20 client.19920 populate_metadata read hostname 'trial028' 2026-02-20T03:30:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.021+0000 7fd236bffe00 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56505fca1b60 0x56505fca4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:30:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.021+0000 7fd236bffe00 4 client.19920 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.4, "await_for": 45.0}] 2026-02-20T03:30:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.021+0000 7fd236bffe00 1 -- 10.20.193.28:0/79804088 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.4, "await_for": 45.0}) -- 0x56505f8cff60 con 0x56505fca1b60 2026-02-20T03:30:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.033+0000 7fd231c6e640 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56505fca1b60 0x56505fca4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:30:55.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.075+0000 7fd1dffff640 10 client.19920 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:30:55.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:30:55.075+0000 7fd231c6e640 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56505fca1b60 0x56505fca4020 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e8e28eeb45b1a server_cookie=b56a46b4d2e9d699 in_seq=0 out_seq=0 2026-02-20T03:30:55.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:55 trial028 ceph-mon[38552]: pgmap v672: 129 pgs: 129 active+clean; 604 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 764 op/s 2026-02-20T03:30:55.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:55 trial126 ceph-mon[38476]: pgmap v672: 129 pgs: 129 active+clean; 604 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 764 op/s 2026-02-20T03:30:55.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 47.59 MB/sec execute 26 sec latency 6227.185 ms 2026-02-20T03:30:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:55 trial177 ceph-mon[43181]: pgmap v672: 129 pgs: 129 active+clean; 604 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 764 op/s 2026-02-20T03:30:56.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 45.82 MB/sec execute 27 sec latency 7227.227 ms 2026-02-20T03:30:57.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:57 trial028 ceph-mon[38552]: pgmap v673: 129 pgs: 129 active+clean; 605 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 MiB/s rd, 12 MiB/s wr, 624 op/s 2026-02-20T03:30:57.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:57 trial126 ceph-mon[38476]: pgmap v673: 129 pgs: 129 active+clean; 605 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 MiB/s rd, 12 MiB/s wr, 624 op/s 2026-02-20T03:30:57.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 44.19 MB/sec execute 28 sec latency 8201.207 ms 2026-02-20T03:30:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:57 trial177 ceph-mon[43181]: pgmap v673: 129 pgs: 129 active+clean; 605 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 MiB/s rd, 12 MiB/s wr, 624 op/s 2026-02-20T03:30:58.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 42.66 MB/sec execute 29 sec latency 9201.245 ms 2026-02-20T03:30:59.496 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:30:59 trial028 ceph-mon[38552]: pgmap v674: 129 pgs: 129 active+clean; 607 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 502 op/s 2026-02-20T03:30:59.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 41.24 MB/sec execute 30 sec latency 10201.286 ms 2026-02-20T03:30:59.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:30:59 trial177 ceph-mon[43181]: pgmap v674: 129 pgs: 129 active+clean; 607 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 502 op/s 2026-02-20T03:30:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:30:59 trial126 ceph-mon[38476]: pgmap v674: 129 pgs: 129 active+clean; 607 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 2.6 MiB/s rd, 11 MiB/s wr, 502 op/s 2026-02-20T03:31:00.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 39.91 MB/sec execute 31 sec latency 11201.324 ms 2026-02-20T03:31:01.619 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:01 trial028 ceph-mon[38552]: pgmap v675: 129 pgs: 129 active+clean; 617 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 979 KiB/s rd, 14 MiB/s wr, 587 op/s 2026-02-20T03:31:01.647 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:01 trial126 ceph-mon[38476]: pgmap v675: 129 pgs: 129 active+clean; 617 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 979 KiB/s rd, 14 MiB/s wr, 587 op/s 2026-02-20T03:31:01.700 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 38.66 MB/sec execute 32 sec latency 12201.356 ms 2026-02-20T03:31:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:01 trial177 ceph-mon[43181]: pgmap v675: 129 pgs: 129 active+clean; 617 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 979 KiB/s rd, 14 MiB/s wr, 587 op/s 2026-02-20T03:31:02.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 37.49 MB/sec execute 33 sec latency 13201.388 ms 2026-02-20T03:31:03.637 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:03 trial028 ceph-mon[38552]: pgmap v676: 129 pgs: 129 active+clean; 616 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 403 KiB/s rd, 12 MiB/s wr, 511 op/s 2026-02-20T03:31:03.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 36.39 MB/sec execute 34 sec latency 14201.433 ms 2026-02-20T03:31:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:03 trial177 ceph-mon[43181]: pgmap v676: 129 pgs: 129 active+clean; 616 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 403 KiB/s rd, 12 MiB/s wr, 511 op/s 2026-02-20T03:31:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:03 trial126 ceph-mon[38476]: pgmap v676: 129 pgs: 129 active+clean; 616 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 403 KiB/s rd, 12 MiB/s wr, 511 op/s 2026-02-20T03:31:04.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 35.35 MB/sec execute 35 sec latency 15201.471 ms 2026-02-20T03:31:05.508 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:05 trial028 ceph-mon[38552]: pgmap v677: 129 pgs: 129 active+clean; 630 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 444 KiB/s rd, 12 MiB/s wr, 517 op/s 2026-02-20T03:31:05.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 34.37 MB/sec execute 36 sec latency 16201.507 ms 2026-02-20T03:31:05.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:05 trial177 ceph-mon[43181]: pgmap v677: 129 pgs: 129 active+clean; 630 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 444 KiB/s rd, 12 MiB/s wr, 517 op/s 2026-02-20T03:31:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:05 trial126 ceph-mon[38476]: pgmap v677: 129 pgs: 129 active+clean; 630 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 444 KiB/s rd, 12 MiB/s wr, 517 op/s 2026-02-20T03:31:06.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- 10.20.193.28:0/442215060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c104940 msgr2=0x7f833c104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:06.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 --2- 10.20.193.28:0/442215060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c104940 0x7f833c104d40 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f8330009a30 tx=0x7f833002f260 comp rx=0 tx=0).stop 2026-02-20T03:31:06.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- 10.20.193.28:0/442215060 shutdown_connections 2026-02-20T03:31:06.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 --2- 10.20.193.28:0/442215060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f833c1064f0 0x7f833c10cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 --2- 10.20.193.28:0/442215060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f833c105b30 0x7f833c105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 --2- 10.20.193.28:0/442215060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c104940 0x7f833c104d40 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- 10.20.193.28:0/442215060 >> 10.20.193.28:0/442215060 conn(0x7f833c1000c0 msgr2=0x7f833c1024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:06.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- 10.20.193.28:0/442215060 shutdown_connections 2026-02-20T03:31:06.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- 10.20.193.28:0/442215060 wait complete. 2026-02-20T03:31:06.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 Processor -- start 2026-02-20T03:31:06.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- start start 2026-02-20T03:31:06.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f833c104940 0x7f833c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c105b30 0x7f833c19d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f833c1064f0 0x7f833c1a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f833c110550 con 0x7f833c105b30 2026-02-20T03:31:06.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f833c1103d0 con 0x7f833c104940 2026-02-20T03:31:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f833c1106d0 con 0x7f833c1064f0 2026-02-20T03:31:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f8339d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c105b30 0x7f833c19d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f8339d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c105b30 0x7f833c19d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58062/0 (socket says 10.20.193.28:58062) 2026-02-20T03:31:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f8339d74640 1 -- 10.20.193.28:0/718854545 learned_addr learned my addr 10.20.193.28:0/718854545 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f8339d74640 1 -- 10.20.193.28:0/718854545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f833c1064f0 msgr2=0x7f833c1a4170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f8339d74640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f833c1064f0 0x7f833c1a4170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f8339d74640 1 -- 10.20.193.28:0/718854545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f833c104940 msgr2=0x7f833c19cbc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f8339d74640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f833c104940 0x7f833c19cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f8339d74640 1 -- 10.20.193.28:0/718854545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c1a4870 con 0x7f833c105b30 2026-02-20T03:31:06.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f8339d74640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c105b30 0x7f833c19d100 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f832400b570 tx=0x7f832400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:06.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f83237fe640 1 -- 10.20.193.28:0/718854545 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324013020 con 0x7f833c105b30 2026-02-20T03:31:06.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f83237fe640 1 -- 10.20.193.28:0/718854545 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8324004480 con 0x7f833c105b30 2026-02-20T03:31:06.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- 10.20.193.28:0/718854545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833c1a4b60 con 0x7f833c105b30 2026-02-20T03:31:06.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f83237fe640 1 -- 10.20.193.28:0/718854545 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832400fb50 con 0x7f833c105b30 2026-02-20T03:31:06.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.416+0000 7f833b577640 1 -- 10.20.193.28:0/718854545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833c1a5060 con 0x7f833c105b30 2026-02-20T03:31:06.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f83237fe640 1 -- 10.20.193.28:0/718854545 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8324002780 con 0x7f833c105b30 2026-02-20T03:31:06.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 Processor -- start 2026-02-20T03:31:06.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- start start 2026-02-20T03:31:06.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915de80 0x557df915e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915e7c0 0x557df9162f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df91659f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557df90ae8f0 con 0x557df9163560 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557df905c2e0 con 0x557df915de80 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557df90aa820 con 0x557df915e7c0 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8339d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df91659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8339d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df91659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58070/0 (socket says 10.20.193.28:58070) 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8339d74640 1 -- 10.20.193.28:0/1292190025 learned_addr learned my addr 10.20.193.28:0/1292190025 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8339d74640 1 -- 10.20.193.28:0/1292190025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915e7c0 msgr2=0x557df9162f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8339d74640 1 --2- 10.20.193.28:0/1292190025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915e7c0 0x557df9162f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8339d74640 1 -- 10.20.193.28:0/1292190025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915de80 msgr2=0x557df915e280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8339d74640 1 --2- 10.20.193.28:0/1292190025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915de80 0x557df915e280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8339d74640 1 -- 10.20.193.28:0/1292190025 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df904e5a0 con 0x557df9163560 2026-02-20T03:31:06.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f83237fe640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83140b0da0 0x7f83140b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8339d74640 1 --2- 10.20.193.28:0/1292190025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df91659f0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f83240e67f0 tx=0x7f83240e6cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ad50c93c71e9be server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8320ff9640 1 -- 10.20.193.28:0/1292190025 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240a3f60 con 0x557df9163560 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8320ff9640 1 -- 10.20.193.28:0/1292190025 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f83240a89f0 con 0x557df9163560 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8320ff9640 1 -- 10.20.193.28:0/1292190025 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240a7810 con 0x557df9163560 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f83237fe640 1 -- 10.20.193.28:0/718854545 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f83240e0610 con 0x7f833c105b30 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- 10.20.193.28:0/1292190025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 msgr2=0x557df91659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1292190025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df91659f0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f83240e67f0 tx=0x7f83240e6cc0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f833ad76640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83140b0da0 0x7f83140b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- 10.20.193.28:0/1292190025 shutdown_connections 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1292190025 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df91659f0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1292190025 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915e7c0 0x557df9162f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1292190025 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915de80 0x557df915e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- 10.20.193.28:0/1292190025 >> 10.20.193.28:0/1292190025 conn(0x557df91556f0 msgr2=0x557df915c570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- 10.20.193.28:0/1292190025 shutdown_connections 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- 10.20.193.28:0/1292190025 wait complete. 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f833ad76640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83140b0da0 0x7f83140b3260 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f832c00aab0 tx=0x7f832c009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.419+0000 7f8343c90e00 1 -- start start 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 Processor -- start 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915de80 0x557df9187c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df9188160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df9163560 0x557df918f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557df90560c0 con 0x557df915e7c0 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557df9177a20 con 0x557df9163560 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557df918f590 con 0x557df915de80 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8339d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df9188160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8339d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df9188160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58080/0 (socket says 10.20.193.28:58080) 2026-02-20T03:31:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8339d74640 1 -- 10.20.193.28:0/4054654830 learned_addr learned my addr 10.20.193.28:0/4054654830 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:06.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8339d74640 1 -- 10.20.193.28:0/4054654830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915de80 msgr2=0x557df9187c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:06.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8339d74640 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915de80 0x557df9187c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8339d74640 1 -- 10.20.193.28:0/4054654830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df9163560 msgr2=0x557df918f000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:06.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8339d74640 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df9163560 0x557df918f000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8339d74640 1 -- 10.20.193.28:0/4054654830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df91816c0 con 0x557df915e7c0 2026-02-20T03:31:06.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8339d74640 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df9188160 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f832400b540 tx=0x7f83240b1600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241cfc67c58a94c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:06.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f82ebfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:06.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f82ebfff640 1 -- 10.20.193.28:0/4054654830 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240a79f0 con 0x557df915e7c0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f82ebfff640 1 -- 10.20.193.28:0/4054654830 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f83240ac6a0 con 0x557df915e7c0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f82ebfff640 1 -- 10.20.193.28:0/4054654830 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240a80c0 con 0x557df915e7c0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 -- 10.20.193.28:0/4054654830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557df906a820 con 0x557df915e7c0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f82ebfff640 1 -- 10.20.193.28:0/4054654830 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f83240e0240 con 0x557df915e7c0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f82ebfff640 10 client.19932 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 10 client.19932 _ll_register_callbacks cb 0x557df9059ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 -- 10.20.193.28:0/4054654830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557df90b64e0 con 0x557df915e7c0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f82ebfff640 1 -- 10.20.193.28:0/4054654830 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f83240c1020 con 0x557df915e7c0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 10 client.19932 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 -- 10.20.193.28:0/4054654830 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x557df906f380 con 0x557df915e7c0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f82ebfff640 1 -- 10.20.193.28:0/4054654830 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f83240b10c0 con 0x557df915e7c0 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 10 client.19932 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:06.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 10 client.19932 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:06.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 20 client.19932 populate_metadata read hostname 'trial028' 2026-02-20T03:31:06.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557df9193410 0x557df91958d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 4 client.19932 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:06.438 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.424+0000 7f8343c90e00 1 -- 10.20.193.28:0/4054654830 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557df9030bd0 con 0x557df9193410 2026-02-20T03:31:06.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.446+0000 7f833a575640 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557df9193410 0x557df91958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:06.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.513+0000 7f82ebfff640 10 client.19932 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:06.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.513+0000 7f833a575640 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557df9193410 0x557df91958d0 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f1bd08b19c3c784 server_cookie=a5ed46c361cef4c1 in_seq=0 out_seq=0 2026-02-20T03:31:06.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f82ebfff640 1 -- 10.20.193.28:0/4054654830 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557df9030bd0 con 0x557df9193410 2026-02-20T03:31:06.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f82ebfff640 10 client.19932 handle_command_reply: tid=0 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 client.19932 shutdown 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 -- 10.20.193.28:0/4054654830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 msgr2=0x557df9188160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df9188160 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f832400b540 tx=0x7f83240b1600 comp rx=0 tx=0).stop 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 -- 10.20.193.28:0/4054654830 shutdown_connections 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557df9193410 0x557df91958d0 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df9163560 0x557df918f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df9188160 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 --2- 10.20.193.28:0/4054654830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915de80 0x557df9187c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 -- 10.20.193.28:0/4054654830 >> 10.20.193.28:0/4054654830 conn(0x557df91556f0 msgr2=0x557df91648b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f82ebfff640 0 client.19932 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:06.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 -- 10.20.193.28:0/4054654830 shutdown_connections 2026-02-20T03:31:06.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 1 -- 10.20.193.28:0/4054654830 wait complete. 2026-02-20T03:31:06.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.540+0000 7f8343c90e00 20 client.19932 trim_cache size 0 max 16384 2026-02-20T03:31:06.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 Processor -- start 2026-02-20T03:31:06.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- start start 2026-02-20T03:31:06.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915de80 0x557df91881f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915e7c0 0x557df918efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df9185790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82e00126b0 con 0x557df9163560 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f82e000ff20 con 0x557df915e7c0 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f82e000dd70 con 0x557df915de80 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f833ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df9185790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f833ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df9185790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58092/0 (socket says 10.20.193.28:58092) 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f833ad76640 1 -- 10.20.193.28:0/1981183424 learned_addr learned my addr 10.20.193.28:0/1981183424 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f833ad76640 1 -- 10.20.193.28:0/1981183424 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915de80 msgr2=0x557df91881f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f833ad76640 1 --2- 10.20.193.28:0/1981183424 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915de80 0x557df91881f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f833ad76640 1 -- 10.20.193.28:0/1981183424 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915e7c0 msgr2=0x557df918efc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:06.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f833ad76640 1 --2- 10.20.193.28:0/1981183424 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915e7c0 0x557df918efc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f833ad76640 1 -- 10.20.193.28:0/1981183424 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df917bfb0 con 0x557df9163560 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f833ad76640 1 --2- 10.20.193.28:0/1981183424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df9185790 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f832c00cc10 tx=0x7f832c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca4287e88304559 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f83063ff640 1 -- 10.20.193.28:0/1981183424 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c006e60 con 0x557df9163560 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f83063ff640 1 -- 10.20.193.28:0/1981183424 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f832c01f020 con 0x557df9163560 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f83063ff640 1 -- 10.20.193.28:0/1981183424 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c00d660 con 0x557df9163560 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- 10.20.193.28:0/1981183424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 msgr2=0x557df9185790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1981183424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df9185790 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f832c00cc10 tx=0x7f832c00f000 comp rx=0 tx=0).stop 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- 10.20.193.28:0/1981183424 shutdown_connections 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1981183424 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df9163560 0x557df9185790 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1981183424 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915e7c0 0x557df918efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1981183424 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df915de80 0x557df91881f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.554 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- 10.20.193.28:0/1981183424 >> 10.20.193.28:0/1981183424 conn(0x557df91556f0 msgr2=0x557df9187ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:06.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- 10.20.193.28:0/1981183424 shutdown_connections 2026-02-20T03:31:06.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- 10.20.193.28:0/1981183424 wait complete. 2026-02-20T03:31:06.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- start start 2026-02-20T03:31:06.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 Processor -- start 2026-02-20T03:31:06.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915de80 0x557df918b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df918b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df9163560 0x557df918e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82e000e3e0 con 0x557df915e7c0 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f82e000f850 con 0x557df915de80 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8343c90e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f82e000eab0 con 0x557df9163560 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8339d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df918b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8339d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df918b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58104/0 (socket says 10.20.193.28:58104) 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.545+0000 7f8339d74640 1 -- 10.20.193.28:0/1901268627 learned_addr learned my addr 10.20.193.28:0/1901268627 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8339d74640 1 -- 10.20.193.28:0/1901268627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df9163560 msgr2=0x557df918e6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8339d74640 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df9163560 0x557df918e6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8339d74640 1 -- 10.20.193.28:0/1901268627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915de80 msgr2=0x557df918b1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8339d74640 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915de80 0x557df918b1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8339d74640 1 -- 10.20.193.28:0/1901268627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df91814f0 con 0x557df915e7c0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8339d74640 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df918b710 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f832400f5b0 tx=0x7f83240e6190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a0b46bc6cad7dd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f82ebfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f82ebfff640 1 -- 10.20.193.28:0/1901268627 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240a3830 con 0x557df915e7c0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f82ebfff640 1 -- 10.20.193.28:0/1901268627 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x557df90b64e0 con 0x557df915e7c0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 1 -- 10.20.193.28:0/1901268627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557df8e0e690 con 0x557df915e7c0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f82ebfff640 1 -- 10.20.193.28:0/1901268627 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240ac6a0 con 0x557df915e7c0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 10 client.19938 _ll_register_callbacks cb 0x7f83240a7e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 1 -- 10.20.193.28:0/1901268627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83240a89f0 con 0x557df915e7c0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f82ebfff640 1 -- 10.20.193.28:0/1901268627 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f83240ddd00 con 0x557df915e7c0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f82ebfff640 1 -- 10.20.193.28:0/1901268627 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f83240e0240 con 0x557df915e7c0 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 10 client.19938 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:06.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 1 -- 10.20.193.28:0/1901268627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x557df9073b70 con 0x557df915e7c0 2026-02-20T03:31:06.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f82ebfff640 1 -- 10.20.193.28:0/1901268627 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f83240a7300 con 0x557df915e7c0 2026-02-20T03:31:06.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 10 client.19938 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:06.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 10 client.19938 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:06.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 20 client.19938 populate_metadata read hostname 'trial028' 2026-02-20T03:31:06.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557df91fee00 0x557df92012c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:06.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 4 client.19938 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:31:06.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.550+0000 7f8343c90e00 1 -- 10.20.193.28:0/1901268627 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557df907f6b0 con 0x557df91fee00 2026-02-20T03:31:06.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.567+0000 7f833a575640 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557df91fee00 0x557df92012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:06.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.633+0000 7f833a575640 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557df91fee00 0x557df92012c0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70b33e36cca7dcbf server_cookie=c74fc109ecd947d3 in_seq=0 out_seq=0 2026-02-20T03:31:06.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.633+0000 7f82ebfff640 10 client.19938 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:06.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 33.44 MB/sec execute 37 sec latency 17201.546 ms 2026-02-20T03:31:06.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f82ebfff640 1 -- 10.20.193.28:0/1901268627 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557df907f6b0 con 0x557df91fee00 2026-02-20T03:31:06.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f82ebfff640 10 client.19938 handle_command_reply: tid=0 2026-02-20T03:31:06.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 client.19938 shutdown 2026-02-20T03:31:06.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 -- 10.20.193.28:0/1901268627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 msgr2=0x557df918b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:06.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df918b710 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f832400f5b0 tx=0x7f83240e6190 comp rx=0 tx=0).stop 2026-02-20T03:31:06.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 -- 10.20.193.28:0/1901268627 shutdown_connections 2026-02-20T03:31:06.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557df91fee00 0x557df92012c0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557df9163560 0x557df918e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557df915e7c0 0x557df918b710 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.706 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 --2- 10.20.193.28:0/1901268627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557df915de80 0x557df918b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 -- 10.20.193.28:0/1901268627 >> 10.20.193.28:0/1901268627 conn(0x557df91556f0 msgr2=0x557df9184780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:06.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f82ebfff640 0 client.19938 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:06.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 -- 10.20.193.28:0/1901268627 shutdown_connections 2026-02-20T03:31:06.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 1 -- 10.20.193.28:0/1901268627 wait complete. 2026-02-20T03:31:06.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f8343c90e00 20 client.19938 trim_cache size 0 max 16384 2026-02-20T03:31:06.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:31:06.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:31:06.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:31:06.708 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:31:06.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 -- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83140b0da0 msgr2=0x7f83140b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:06.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83140b0da0 0x7f83140b3260 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f832c00aab0 tx=0x7f832c009250 comp rx=0 tx=0).stop 2026-02-20T03:31:06.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 -- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c105b30 msgr2=0x7f833c19d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:06.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c105b30 0x7f833c19d100 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f832400b570 tx=0x7f832400ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:06.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 -- 10.20.193.28:0/718854545 shutdown_connections 2026-02-20T03:31:06.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83140b0da0 0x7f83140b3260 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f833c1064f0 0x7f833c1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f833c105b30 0x7f833c19d100 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 --2- 10.20.193.28:0/718854545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f833c104940 0x7f833c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:06.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 -- 10.20.193.28:0/718854545 >> 10.20.193.28:0/718854545 conn(0x7f833c1000c0 msgr2=0x7f833c108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:06.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 -- 10.20.193.28:0/718854545 shutdown_connections 2026-02-20T03:31:06.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:06.702+0000 7f833b577640 1 -- 10.20.193.28:0/718854545 wait complete. 2026-02-20T03:31:07.657 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:07 trial028 ceph-mon[38552]: pgmap v678: 129 pgs: 129 active+clean; 674 MiB data, 7.0 GiB used, 8.2 TiB / 8.2 TiB avail; 400 KiB/s rd, 14 MiB/s wr, 498 op/s 2026-02-20T03:31:07.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 32.56 MB/sec execute 38 sec latency 18201.587 ms 2026-02-20T03:31:07.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:07 trial177 ceph-mon[43181]: pgmap v678: 129 pgs: 129 active+clean; 674 MiB data, 7.0 GiB used, 8.2 TiB / 8.2 TiB avail; 400 KiB/s rd, 14 MiB/s wr, 498 op/s 2026-02-20T03:31:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:07 trial126 ceph-mon[38476]: pgmap v678: 129 pgs: 129 active+clean; 674 MiB data, 7.0 GiB used, 8.2 TiB / 8.2 TiB avail; 400 KiB/s rd, 14 MiB/s wr, 498 op/s 2026-02-20T03:31:08.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 31.73 MB/sec execute 39 sec latency 19201.624 ms 2026-02-20T03:31:09.654 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:09 trial028 ceph-mon[38552]: pgmap v679: 129 pgs: 129 active+clean; 690 MiB data, 7.0 GiB used, 8.2 TiB / 8.2 TiB avail; 151 KiB/s rd, 13 MiB/s wr, 413 op/s 2026-02-20T03:31:09.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 30.93 MB/sec execute 40 sec latency 20201.665 ms 2026-02-20T03:31:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:09 trial177 ceph-mon[43181]: pgmap v679: 129 pgs: 129 active+clean; 690 MiB data, 7.0 GiB used, 8.2 TiB / 8.2 TiB avail; 151 KiB/s rd, 13 MiB/s wr, 413 op/s 2026-02-20T03:31:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:09 trial126 ceph-mon[38476]: pgmap v679: 129 pgs: 129 active+clean; 690 MiB data, 7.0 GiB used, 8.2 TiB / 8.2 TiB avail; 151 KiB/s rd, 13 MiB/s wr, 413 op/s 2026-02-20T03:31:10.091 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:31:10.416 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:10.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 30.18 MB/sec execute 41 sec latency 21201.721 ms 2026-02-20T03:31:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- 10.20.193.28:0/813010672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b0109220 msgr2=0x7f75b0109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 --2- 10.20.193.28:0/813010672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b0109220 0x7f75b0109660 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7598009a30 tx=0x7f759802f260 comp rx=0 tx=0).stop 2026-02-20T03:31:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- 10.20.193.28:0/813010672 shutdown_connections 2026-02-20T03:31:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 --2- 10.20.193.28:0/813010672 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75b0109ba0 0x7f75b0115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 --2- 10.20.193.28:0/813010672 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b0109220 0x7f75b0109660 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 --2- 10.20.193.28:0/813010672 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f75b010eef0 0x7f75b010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- 10.20.193.28:0/813010672 >> 10.20.193.28:0/813010672 conn(0x7f75b0078600 msgr2=0x7f75b007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- 10.20.193.28:0/813010672 shutdown_connections 2026-02-20T03:31:10.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- 10.20.193.28:0/813010672 wait complete. 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 Processor -- start 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- start start 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f75b0109220 0x7f75b01a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75b0109ba0 0x7f75b01a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b010eef0 0x7f75b01a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f75b01191b0 con 0x7f75b010eef0 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f75b0119030 con 0x7f75b0109220 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f75b0119330 con 0x7f75b0109ba0 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75af7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b010eef0 0x7f75b01a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75af7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b010eef0 0x7f75b01a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58126/0 (socket says 10.20.193.28:58126) 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75af7fe640 1 -- 10.20.193.28:0/1068898210 learned_addr learned my addr 10.20.193.28:0/1068898210 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75af7fe640 1 -- 10.20.193.28:0/1068898210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75b0109ba0 msgr2=0x7f75b01a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75af7fe640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75b0109ba0 0x7f75b01a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75af7fe640 1 -- 10.20.193.28:0/1068898210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f75b0109220 msgr2=0x7f75b01a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:10.749 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75af7fe640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f75b0109220 0x7f75b01a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75af7fe640 1 -- 10.20.193.28:0/1068898210 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b01a66c0 con 0x7f75b010eef0 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75af7fe640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b010eef0 0x7f75b01a5f40 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f75a000b990 tx=0x7f75a000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75b498e640 1 -- 10.20.193.28:0/1068898210 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0006e60 con 0x7f75b010eef0 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75b498e640 1 -- 10.20.193.28:0/1068898210 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f75a0010070 con 0x7f75b010eef0 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75b498e640 1 -- 10.20.193.28:0/1068898210 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0004800 con 0x7f75b010eef0 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- 10.20.193.28:0/1068898210 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b01a69b0 con 0x7f75b010eef0 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.734+0000 7f75affff640 1 -- 10.20.193.28:0/1068898210 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b01ae1f0 con 0x7f75b010eef0 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b498e640 1 -- 10.20.193.28:0/1068898210 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f75a000c790 con 0x7f75b010eef0 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 Processor -- start 2026-02-20T03:31:10.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 -- start start 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d9000 0x55ff8f8d93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d3630 0x55ff8f8d3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff8f853e50 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ff8f8269c0 con 0x55ff8f8d9000 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ff8f7d4240 con 0x55ff8f8d3630 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75ae7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75ae7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8dfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58138/0 (socket says 10.20.193.28:58138) 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75ae7fc640 1 -- 10.20.193.28:0/4247768475 learned_addr learned my addr 10.20.193.28:0/4247768475 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75ae7fc640 1 -- 10.20.193.28:0/4247768475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d3630 msgr2=0x55ff8f8d3a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75ae7fc640 1 --2- 10.20.193.28:0/4247768475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d3630 0x55ff8f8d3a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.751 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75ae7fc640 1 -- 10.20.193.28:0/4247768475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d9000 msgr2=0x55ff8f8d93e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75ae7fc640 1 --2- 10.20.193.28:0/4247768475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d9000 0x55ff8f8d93e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75ae7fc640 1 -- 10.20.193.28:0/4247768475 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff8f7e7420 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75ae7fc640 1 --2- 10.20.193.28:0/4247768475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8dfe30 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f7598009950 tx=0x7f75980057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334c809379e95d0e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f7573fff640 1 -- 10.20.193.28:0/4247768475 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598002d90 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f7573fff640 1 -- 10.20.193.28:0/4247768475 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7598033040 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f7573fff640 1 -- 10.20.193.28:0/4247768475 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598004340 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 -- 10.20.193.28:0/4247768475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 msgr2=0x55ff8f8dfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/4247768475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8dfe30 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f7598009950 tx=0x7f75980057d0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b498e640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75840b0e20 0x7f75840b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b498e640 1 -- 10.20.193.28:0/1068898210 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f75a00e0440 con 0x7f75b010eef0 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 -- 10.20.193.28:0/4247768475 shutdown_connections 2026-02-20T03:31:10.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/4247768475 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8dfe30 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/4247768475 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d3630 0x55ff8f8d3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/4247768475 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d9000 0x55ff8f8d93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 -- 10.20.193.28:0/4247768475 >> 10.20.193.28:0/4247768475 conn(0x55ff8f896290 msgr2=0x55ff8f8d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75aeffd640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75840b0e20 0x7f75840b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 -- 10.20.193.28:0/4247768475 shutdown_connections 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75b7e95e00 1 -- 10.20.193.28:0/4247768475 wait complete. 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.740+0000 7f75aeffd640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75840b0e20 0x7f75840b32e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f75a40096f0 tx=0x7f75a4006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75b7e95e00 1 -- start start 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75b7e95e00 1 Processor -- start 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d3630 0x55ff8f8edf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d9000 0x55ff8f8ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ff8f8228f0 con 0x55ff8f8d9000 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ff8f614f50 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ff8f8ece40 con 0x55ff8f8d3630 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75af7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d9000 0x55ff8f8ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75af7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d9000 0x55ff8f8ec6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58152/0 (socket says 10.20.193.28:58152) 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.745+0000 7f75af7fe640 1 -- 10.20.193.28:0/1290088853 learned_addr learned my addr 10.20.193.28:0/1290088853 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75af7fe640 1 -- 10.20.193.28:0/1290088853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d3630 msgr2=0x55ff8f8edf80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75af7fe640 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d3630 0x55ff8f8edf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75af7fe640 1 -- 10.20.193.28:0/1290088853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3fb0 msgr2=0x55ff8f8ee4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:10.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75af7fe640 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8ee4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75af7fe640 1 -- 10.20.193.28:0/1290088853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff8f8e5b20 con 0x55ff8f8d9000 2026-02-20T03:31:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75af7fe640 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d9000 0x55ff8f8ec6c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f75a00a3f50 tx=0x7f75a000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53bfb2ff4e2e28e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75717fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75717fa640 1 -- 10.20.193.28:0/1290088853 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a00a8820 con 0x55ff8f8d9000 2026-02-20T03:31:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75717fa640 1 -- 10.20.193.28:0/1290088853 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f75a00ac4d0 con 0x55ff8f8d9000 2026-02-20T03:31:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75717fa640 1 -- 10.20.193.28:0/1290088853 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a00a3aa0 con 0x55ff8f8d9000 2026-02-20T03:31:10.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1290088853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff8f5f7b40 con 0x55ff8f8d9000 2026-02-20T03:31:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75717fa640 1 -- 10.20.193.28:0/1290088853 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f75a00cabc0 con 0x55ff8f8d9000 2026-02-20T03:31:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 10 client.19950 _ll_register_callbacks cb 0x55ff8f85ff00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1290088853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff8f8341a0 con 0x55ff8f8d9000 2026-02-20T03:31:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75717fa640 1 -- 10.20.193.28:0/1290088853 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f75a00b1380 con 0x55ff8f8d9000 2026-02-20T03:31:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 10 client.19950 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1290088853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55ff8f7e1230 con 0x55ff8f8d9000 2026-02-20T03:31:10.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75717fa640 1 -- 10.20.193.28:0/1290088853 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f75a00ac120 con 0x55ff8f8d9000 2026-02-20T03:31:10.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 10 client.19950 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:10.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 10 client.19950 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:10.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 20 client.19950 populate_metadata read hostname 'trial028' 2026-02-20T03:31:10.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff8f8fc810 0x55ff8f8fecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 4 client.19950 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:10.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.746+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1290088853 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff8f82e5b0 con 0x55ff8f8fc810 2026-02-20T03:31:10.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.773+0000 7f75aeffd640 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff8f8fc810 0x55ff8f8fecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:10.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.839+0000 7f75aeffd640 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff8f8fc810 0x55ff8f8fecd0 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efb776a32cc17c24 server_cookie=80a38baa5fc0aca2 in_seq=0 out_seq=0 2026-02-20T03:31:10.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.839+0000 7f75717fa640 10 client.19950 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:10.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.866+0000 7f75717fa640 1 -- 10.20.193.28:0/1290088853 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ff8f82e5b0 con 0x55ff8f8fc810 2026-02-20T03:31:10.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.866+0000 7f75717fa640 10 client.19950 handle_command_reply: tid=0 2026-02-20T03:31:10.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.866+0000 7f75b7e95e00 1 client.19950 shutdown 2026-02-20T03:31:10.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.866+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1290088853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d9000 msgr2=0x55ff8f8ec6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:10.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.866+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d9000 0x55ff8f8ec6c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f75a00a3f50 tx=0x7f75a000cd30 comp rx=0 tx=0).stop 2026-02-20T03:31:10.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1290088853 shutdown_connections 2026-02-20T03:31:10.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff8f8fc810 0x55ff8f8fecd0 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d9000 0x55ff8f8ec6c0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8ee4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1290088853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d3630 0x55ff8f8edf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1290088853 >> 10.20.193.28:0/1290088853 conn(0x55ff8f896290 msgr2=0x55ff8f8d2440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:10.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75717fa640 0 client.19950 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:10.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1290088853 shutdown_connections 2026-02-20T03:31:10.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1290088853 wait complete. 2026-02-20T03:31:10.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.867+0000 7f75b7e95e00 20 client.19950 trim_cache size 0 max 16384 2026-02-20T03:31:10.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75b7e95e00 1 Processor -- start 2026-02-20T03:31:10.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75b7e95e00 1 -- start start 2026-02-20T03:31:10.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3630 0x55ff8f8eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8d7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d9000 0x55ff8f8fd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f7554012700 con 0x55ff8f8d3630 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f755400ff70 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f755400ddc0 con 0x55ff8f8d9000 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75aeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3630 0x55ff8f8eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75aeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3630 0x55ff8f8eb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58166/0 (socket says 10.20.193.28:58166) 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75aeffd640 1 -- 10.20.193.28:0/1975846490 learned_addr learned my addr 10.20.193.28:0/1975846490 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75aeffd640 1 -- 10.20.193.28:0/1975846490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d9000 msgr2=0x55ff8f8fd330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75aeffd640 1 --2- 10.20.193.28:0/1975846490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d9000 0x55ff8f8fd330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75aeffd640 1 -- 10.20.193.28:0/1975846490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3fb0 msgr2=0x55ff8f8d7e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75aeffd640 1 --2- 10.20.193.28:0/1975846490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8d7e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75aeffd640 1 -- 10.20.193.28:0/1975846490 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff8f8e5950 con 0x55ff8f8d3630 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75aeffd640 1 --2- 10.20.193.28:0/1975846490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3630 0x55ff8f8eb8b0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f75a400b4b0 tx=0x7f75a4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd028ea791d8b25 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75737fe640 1 -- 10.20.193.28:0/1975846490 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4002b60 con 0x55ff8f8d3630 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75737fe640 1 -- 10.20.193.28:0/1975846490 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f75a4002d00 con 0x55ff8f8d3630 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.872+0000 7f75737fe640 1 -- 10.20.193.28:0/1975846490 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4013ae0 con 0x55ff8f8d3630 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1975846490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3630 msgr2=0x55ff8f8eb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1975846490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3630 0x55ff8f8eb8b0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f75a400b4b0 tx=0x7f75a4010000 comp rx=0 tx=0).stop 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1975846490 shutdown_connections 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1975846490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d9000 0x55ff8f8fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1975846490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8d7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/1975846490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3630 0x55ff8f8eb8b0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1975846490 >> 10.20.193.28:0/1975846490 conn(0x55ff8f896290 msgr2=0x55ff8f8fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1975846490 shutdown_connections 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- 10.20.193.28:0/1975846490 wait complete. 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- start start 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 Processor -- start 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3630 0x55ff8f8f4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8f4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d9000 0x55ff8f8f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f755400e430 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f755400f8a0 con 0x55ff8f8d3630 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f755400eb00 con 0x55ff8f8d9000 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75ae7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:10.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75ae7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8f4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58168/0 (socket says 10.20.193.28:58168) 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75ae7fc640 1 -- 10.20.193.28:0/2374904291 learned_addr learned my addr 10.20.193.28:0/2374904291 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75ae7fc640 1 -- 10.20.193.28:0/2374904291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d9000 msgr2=0x55ff8f8f0de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75ae7fc640 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d9000 0x55ff8f8f0de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75ae7fc640 1 -- 10.20.193.28:0/2374904291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3630 msgr2=0x55ff8f8f4110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75ae7fc640 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3630 0x55ff8f8f4110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75ae7fc640 1 -- 10.20.193.28:0/2374904291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff8f505870 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75ae7fc640 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8f4650 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f7598002410 tx=0x7f75980096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f96462d878c788 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75717fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75717fa640 1 -- 10.20.193.28:0/2374904291 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75980026e0 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75717fa640 1 -- 10.20.193.28:0/2374904291 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f75980044d0 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75717fa640 1 -- 10.20.193.28:0/2374904291 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598038c60 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- 10.20.193.28:0/2374904291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff8f7c6440 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75717fa640 1 -- 10.20.193.28:0/2374904291 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f7598038e00 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 10 client.19956 _ll_register_callbacks cb 0x7f75a00098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- 10.20.193.28:0/2374904291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ff8f7d8b00 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75717fa640 1 -- 10.20.193.28:0/2374904291 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7598002880 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 10 client.19956 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- 10.20.193.28:0/2374904291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55ff8f8e6640 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75717fa640 1 -- 10.20.193.28:0/2374904291 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f7598052030 con 0x55ff8f8d3fb0 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 10 client.19956 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 10 client.19956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 20 client.19956 populate_metadata read hostname 'trial028' 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff8f967fd0 0x55ff8f96a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 4 client.19956 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:31:10.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.877+0000 7f75b7e95e00 1 -- 10.20.193.28:0/2374904291 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f7598033040 con 0x55ff8f967fd0 2026-02-20T03:31:10.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.893+0000 7f75aeffd640 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff8f967fd0 0x55ff8f96a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:10.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.960+0000 7f75aeffd640 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff8f967fd0 0x55ff8f96a470 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb95301bb0c15bc3 server_cookie=76b3b858474a5516 in_seq=0 out_seq=0 2026-02-20T03:31:10.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.960+0000 7f75717fa640 10 client.19956 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:10.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75717fa640 1 -- 10.20.193.28:0/2374904291 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f7598033040 con 0x55ff8f967fd0 2026-02-20T03:31:10.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75717fa640 10 client.19956 handle_command_reply: tid=0 2026-02-20T03:31:10.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 client.19956 shutdown 2026-02-20T03:31:10.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 -- 10.20.193.28:0/2374904291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 msgr2=0x55ff8f8f4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:10.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8f4650 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f7598002410 tx=0x7f75980096d0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 -- 10.20.193.28:0/2374904291 shutdown_connections 2026-02-20T03:31:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ff8f967fd0 0x55ff8f96a470 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ff8f8d9000 0x55ff8f8f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ff8f8d3fb0 0x55ff8f8f4650 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 --2- 10.20.193.28:0/2374904291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ff8f8d3630 0x55ff8f8f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 -- 10.20.193.28:0/2374904291 >> 10.20.193.28:0/2374904291 conn(0x55ff8f896290 msgr2=0x55ff8f8fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:10.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75717fa640 0 client.19956 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:10.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 -- 10.20.193.28:0/2374904291 shutdown_connections 2026-02-20T03:31:10.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 1 -- 10.20.193.28:0/2374904291 wait complete. 2026-02-20T03:31:10.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75b7e95e00 20 client.19956 trim_cache size 0 max 16384 2026-02-20T03:31:10.977 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:10.977 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:31:10.977 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:31:10.978 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:10.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 -- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75840b0e20 msgr2=0x7f75840b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:10.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75840b0e20 0x7f75840b32e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f75a40096f0 tx=0x7f75a4006cd0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 -- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b010eef0 msgr2=0x7f75b01a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b010eef0 0x7f75b01a5f40 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f75a000b990 tx=0x7f75a000be60 comp rx=0 tx=0).stop 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 -- 10.20.193.28:0/1068898210 shutdown_connections 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f75840b0e20 0x7f75840b32e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f75b010eef0 0x7f75b01a5f40 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f75b0109ba0 0x7f75b01a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 --2- 10.20.193.28:0/1068898210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f75b0109220 0x7f75b01a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 -- 10.20.193.28:0/1068898210 >> 10.20.193.28:0/1068898210 conn(0x7f75b0078600 msgr2=0x7f75b0079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 -- 10.20.193.28:0/1068898210 shutdown_connections 2026-02-20T03:31:10.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:10.973+0000 7f75affff640 1 -- 10.20.193.28:0/1068898210 wait complete. 2026-02-20T03:31:11.118 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:31:11.119 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:31:11.422 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:11.581 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:11 trial028 ceph-mon[38552]: pgmap v680: 129 pgs: 129 active+clean; 695 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 353 KiB/s rd, 15 MiB/s wr, 444 op/s 2026-02-20T03:31:11.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1200025552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 msgr2=0x7f0e50111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:11.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1200025552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 0x7f0e50111850 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000b0d0 tx=0x7f0e4002f490 comp rx=0 tx=0).stop 2026-02-20T03:31:11.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1200025552 shutdown_connections 2026-02-20T03:31:11.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1200025552 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 0x7f0e50111850 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1200025552 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e50104980 0x7f0e50104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1200025552 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e5010a980 0x7f0e5010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1200025552 >> 10.20.193.28:0/1200025552 conn(0x7f0e50100680 msgr2=0x7f0e50102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:11.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1200025552 shutdown_connections 2026-02-20T03:31:11.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1200025552 wait complete. 2026-02-20T03:31:11.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 Processor -- start 2026-02-20T03:31:11.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- start start 2026-02-20T03:31:11.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e50104980 0x7f0e5019d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:11.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 0x7f0e5019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:11.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e5010a980 0x7f0e501a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:11.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0e50114cd0 con 0x7f0e50105320 2026-02-20T03:31:11.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0e50114b50 con 0x7f0e5010a980 2026-02-20T03:31:11.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0e50114e50 con 0x7f0e50104980 2026-02-20T03:31:11.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 0x7f0e5019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:11.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 0x7f0e5019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58180/0 (socket says 10.20.193.28:58180) 2026-02-20T03:31:11.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4e7fc640 1 -- 10.20.193.28:0/1512498724 learned_addr learned my addr 10.20.193.28:0/1512498724 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:11.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4e7fc640 1 -- 10.20.193.28:0/1512498724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e50104980 msgr2=0x7f0e5019d190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:11.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4e7fc640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e50104980 0x7f0e5019d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4e7fc640 1 -- 10.20.193.28:0/1512498724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e5010a980 msgr2=0x7f0e501a1a60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4e7fc640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e5010a980 0x7f0e501a1a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4e7fc640 1 -- 10.20.193.28:0/1512498724 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e501a21e0 con 0x7f0e50105320 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4e7fc640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 0x7f0e5019d6d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b570 tx=0x7f0e3800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e2ffff640 1 -- 10.20.193.28:0/1512498724 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e38013020 con 0x7f0e50105320 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e2ffff640 1 -- 10.20.193.28:0/1512498724 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0e38004480 con 0x7f0e50105320 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e2ffff640 1 -- 10.20.193.28:0/1512498724 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800fb50 con 0x7f0e50105320 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e501a24d0 con 0x7f0e50105320 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e501a9d10 con 0x7f0e50105320 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.674+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e50104e60 con 0x7f0e50105320 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.680+0000 7f0e2ffff640 1 -- 10.20.193.28:0/1512498724 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0e38002780 con 0x7f0e50105320 2026-02-20T03:31:11.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.680+0000 7f0e2ffff640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e200b0e20 0x7f0e200b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:11.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.680+0000 7f0e2ffff640 1 -- 10.20.193.28:0/1512498724 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f0e380a4cb0 con 0x7f0e50105320 2026-02-20T03:31:11.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.680+0000 7f0e4effd640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e200b0e20 0x7f0e200b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:11.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.680+0000 7f0e2ffff640 1 -- 10.20.193.28:0/1512498724 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f0e3801d020 con 0x7f0e50105320 2026-02-20T03:31:11.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.680+0000 7f0e4effd640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e200b0e20 0x7f0e200b32e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009770 tx=0x7f0e44006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:11.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 29.46 MB/sec execute 42 sec latency 22201.760 ms 2026-02-20T03:31:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:11 trial177 ceph-mon[43181]: pgmap v680: 129 pgs: 129 active+clean; 695 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 353 KiB/s rd, 15 MiB/s wr, 444 op/s 2026-02-20T03:31:11.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.790+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e5010ca50 con 0x7f0e50105320 2026-02-20T03:31:11.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.791+0000 7f0e2ffff640 1 -- 10.20.193.28:0/1512498724 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11924 (secure 0 0 0) 0x7f0e380accc0 con 0x7f0e50105320 2026-02-20T03:31:11.794 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:31:11.794 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":40,"btime":"2026-02-20T03:30:48:852343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:30:48.476361+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28114":{"gid":28114,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1701826560","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1701826560},{"type":"v1","addr":"10.20.193.177:6837","nonce":1701826560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:31:11.795 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 40 2026-02-20T03:31:11.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e200b0e20 msgr2=0x7f0e200b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:11.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e200b0e20 0x7f0e200b32e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009770 tx=0x7f0e44006cd0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 msgr2=0x7f0e5019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 0x7f0e5019d6d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f0e3800b570 tx=0x7f0e3800ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 shutdown_connections 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0e200b0e20 0x7f0e200b32e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0e5010a980 0x7f0e501a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0e50105320 0x7f0e5019d6d0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 --2- 10.20.193.28:0/1512498724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0e50104980 0x7f0e5019d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 >> 10.20.193.28:0/1512498724 conn(0x7f0e50100680 msgr2=0x7f0e50100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 shutdown_connections 2026-02-20T03:31:11.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:11.792+0000 7f0e4ffff640 1 -- 10.20.193.28:0/1512498724 wait complete. 2026-02-20T03:31:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:11 trial126 ceph-mon[38476]: pgmap v680: 129 pgs: 129 active+clean; 695 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 353 KiB/s rd, 15 MiB/s wr, 444 op/s 2026-02-20T03:31:12.016 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:31:12.345 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:12.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.591+0000 7efebe03d640 1 -- 10.20.193.28:0/4174999476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 msgr2=0x7efeb810ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:12.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.591+0000 7efebe03d640 1 --2- 10.20.193.28:0/4174999476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb810ad60 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7efea0009a60 tx=0x7efea002f290 comp rx=0 tx=0).stop 2026-02-20T03:31:12.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.591+0000 7efebe03d640 1 -- 10.20.193.28:0/4174999476 shutdown_connections 2026-02-20T03:31:12.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.591+0000 7efebe03d640 1 --2- 10.20.193.28:0/4174999476 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb8105320 0x7efeb8111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.591+0000 7efebe03d640 1 --2- 10.20.193.28:0/4174999476 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8104980 0x7efeb8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.591+0000 7efebe03d640 1 --2- 10.20.193.28:0/4174999476 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb810ad60 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.591+0000 7efebe03d640 1 -- 10.20.193.28:0/4174999476 >> 10.20.193.28:0/4174999476 conn(0x7efeb8100680 msgr2=0x7efeb8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:12.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.591+0000 7efebe03d640 1 -- 10.20.193.28:0/4174999476 shutdown_connections 2026-02-20T03:31:12.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.591+0000 7efebe03d640 1 -- 10.20.193.28:0/4174999476 wait complete. 2026-02-20T03:31:12.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 Processor -- start 2026-02-20T03:31:12.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 -- start start 2026-02-20T03:31:12.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb8104980 0x7efeb819d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8105320 0x7efeb819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8114cd0 con 0x7efeb810a980 2026-02-20T03:31:12.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8114b50 con 0x7efeb8104980 2026-02-20T03:31:12.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efeb8114e50 con 0x7efeb8105320 2026-02-20T03:31:12.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebd83c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:12.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebd83c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58208/0 (socket says 10.20.193.28:58208) 2026-02-20T03:31:12.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebd83c640 1 -- 10.20.193.28:0/2062140352 learned_addr learned my addr 10.20.193.28:0/2062140352 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:12.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebd83c640 1 -- 10.20.193.28:0/2062140352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8105320 msgr2=0x7efeb819d750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:12.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebd83c640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8105320 0x7efeb819d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebd83c640 1 -- 10.20.193.28:0/2062140352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb8104980 msgr2=0x7efeb819d210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:12.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebd83c640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb8104980 0x7efeb819d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebd83c640 1 -- 10.20.193.28:0/2062140352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb81a2260 con 0x7efeb810a980 2026-02-20T03:31:12.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebd83c640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1ae0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7efeb400b990 tx=0x7efeb400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:12.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efeae7fc640 1 -- 10.20.193.28:0/2062140352 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4006e60 con 0x7efeb810a980 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 -- 10.20.193.28:0/2062140352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb81a2550 con 0x7efeb810a980 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efebe03d640 1 -- 10.20.193.28:0/2062140352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb81a9d90 con 0x7efeb810a980 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efeae7fc640 1 -- 10.20.193.28:0/2062140352 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efeb4010070 con 0x7efeb810a980 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.592+0000 7efeae7fc640 1 -- 10.20.193.28:0/2062140352 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb4004800 con 0x7efeb810a980 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efeae7fc640 1 -- 10.20.193.28:0/2062140352 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efeb400c790 con 0x7efeb810a980 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 Processor -- start 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efeae7fc640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe880b0e20 0x7efe880b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efeae7fc640 1 -- 10.20.193.28:0/2062140352 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7efeb40e0420 con 0x7efeb810a980 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 -- start start 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e9fb0 0x558fa13ea390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 0x558fa13e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e4f60 0x558fa13f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558fa1364e00 con 0x558fa13e9fb0 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558fa1337970 con 0x558fa13e45e0 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558fa12e51f0 con 0x558fa13e4f60 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebd03b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e9fb0 0x558fa13ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebd03b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e9fb0 0x558fa13ea390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58224/0 (socket says 10.20.193.28:58224) 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebd03b640 1 -- 10.20.193.28:0/3783502588 learned_addr learned my addr 10.20.193.28:0/3783502588 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebc83a640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe880b0e20 0x7efe880b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebd03b640 1 -- 10.20.193.28:0/3783502588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e4f60 msgr2=0x558fa13f0de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebd03b640 1 --2- 10.20.193.28:0/3783502588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e4f60 0x558fa13f0de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebd03b640 1 -- 10.20.193.28:0/3783502588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 msgr2=0x558fa13e4a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:12.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebd03b640 1 --2- 10.20.193.28:0/3783502588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 0x558fa13e4a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebd03b640 1 -- 10.20.193.28:0/3783502588 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fa12f83d0 con 0x558fa13e9fb0 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebd03b640 1 --2- 10.20.193.28:0/3783502588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e9fb0 0x558fa13ea390 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7efea0005880 tx=0x7efea0038470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9072ffa49a1172c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efebc83a640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe880b0e20 0x7efe880b32e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efea8006fd0 tx=0x7efea8006da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efe85ce5640 1 -- 10.20.193.28:0/3783502588 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0002c00 con 0x558fa13e9fb0 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efe85ce5640 1 -- 10.20.193.28:0/3783502588 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efea0033040 con 0x558fa13e9fb0 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efe85ce5640 1 -- 10.20.193.28:0/3783502588 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0004320 con 0x558fa13e9fb0 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 -- 10.20.193.28:0/3783502588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e9fb0 msgr2=0x558fa13ea390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3783502588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e9fb0 0x558fa13ea390 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7efea0005880 tx=0x7efea0038470 comp rx=0 tx=0).stop 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 -- 10.20.193.28:0/3783502588 shutdown_connections 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3783502588 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e4f60 0x558fa13f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3783502588 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 0x558fa13e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3783502588 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e9fb0 0x558fa13ea390 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 -- 10.20.193.28:0/3783502588 >> 10.20.193.28:0/3783502588 conn(0x558fa13a7240 msgr2=0x558fa13e2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:12.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.597+0000 7efec17cbe00 1 -- 10.20.193.28:0/3783502588 shutdown_connections 2026-02-20T03:31:12.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.601+0000 7efec17cbe00 1 -- 10.20.193.28:0/3783502588 wait complete. 2026-02-20T03:31:12.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efec17cbe00 1 -- start start 2026-02-20T03:31:12.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efec17cbe00 1 Processor -- start 2026-02-20T03:31:12.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 0x558fa1407640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1407b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 0x558fa1405d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efec17cbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558fa13338a0 con 0x558fa13e4f60 2026-02-20T03:31:12.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efec17cbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558fa1125f50 con 0x558fa13e45e0 2026-02-20T03:31:12.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efec17cbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558fa1406500 con 0x558fa13e9fb0 2026-02-20T03:31:12.612 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:12 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1512498724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:12.613 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efebc83a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1407b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efebc83a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1407b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58228/0 (socket says 10.20.193.28:58228) 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.602+0000 7efebc83a640 1 -- 10.20.193.28:0/3910958589 learned_addr learned my addr 10.20.193.28:0/3910958589 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efebc83a640 1 -- 10.20.193.28:0/3910958589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 msgr2=0x558fa1405d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efebc83a640 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 0x558fa1405d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efebc83a640 1 -- 10.20.193.28:0/3910958589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 msgr2=0x558fa1407640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efebc83a640 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 0x558fa1407640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efebc83a640 1 -- 10.20.193.28:0/3910958589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fa13f6b20 con 0x558fa13e4f60 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efebc83a640 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1407b80 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7efea80027d0 tx=0x7efea80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc1f8016ffce459 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efe72ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:12.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efe72ffd640 1 -- 10.20.193.28:0/3910958589 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea800bcb0 con 0x558fa13e4f60 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 1 -- 10.20.193.28:0/3910958589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fa1108b40 con 0x558fa13e4f60 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 10 client.19974 _ll_register_callbacks cb 0x558fa1370eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 1 -- 10.20.193.28:0/3910958589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558fa1345150 con 0x558fa13e4f60 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efe72ffd640 1 -- 10.20.193.28:0/3910958589 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x558fa1345150 con 0x558fa13e4f60 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efe72ffd640 1 -- 10.20.193.28:0/3910958589 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8025660 con 0x558fa13e4f60 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efe72ffd640 1 -- 10.20.193.28:0/3910958589 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7efea8025800 con 0x558fa13e4f60 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efe72ffd640 1 -- 10.20.193.28:0/3910958589 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efea8025b20 con 0x558fa13e4f60 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 10 client.19974 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 1 -- 10.20.193.28:0/3910958589 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x558fa12f21e0 con 0x558fa13e4f60 2026-02-20T03:31:12.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efe72ffd640 1 -- 10.20.193.28:0/3910958589 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7efea801c410 con 0x558fa13e4f60 2026-02-20T03:31:12.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 10 client.19974 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:12.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 10 client.19974 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:31:12.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 20 client.19974 populate_metadata read hostname 'trial028' 2026-02-20T03:31:12.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558fa14009e0 0x558fa1402ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 4 client.19974 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:12.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.607+0000 7efec17cbe00 1 -- 10.20.193.28:0/3910958589 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fa133f560 con 0x558fa14009e0 2026-02-20T03:31:12.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.616+0000 7efebd03b640 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558fa14009e0 0x558fa1402ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:12.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.657+0000 7efe72ffd640 10 client.19974 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:12.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.657+0000 7efebd03b640 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558fa14009e0 0x558fa1402ea0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=637d1c9cc7d00908 server_cookie=5812051eadd5b8e6 in_seq=0 out_seq=0 2026-02-20T03:31:12.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.671+0000 7efe72ffd640 1 -- 10.20.193.28:0/3910958589 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x558fa133f560 con 0x558fa14009e0 2026-02-20T03:31:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.671+0000 7efe72ffd640 10 client.19974 handle_command_reply: tid=0 2026-02-20T03:31:12.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.671+0000 7efec17cbe00 1 client.19974 shutdown 2026-02-20T03:31:12.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.672+0000 7efec17cbe00 1 -- 10.20.193.28:0/3910958589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 msgr2=0x558fa1407b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:12.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.672+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1407b80 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7efea80027d0 tx=0x7efea80047e0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.672+0000 7efec17cbe00 1 -- 10.20.193.28:0/3910958589 shutdown_connections 2026-02-20T03:31:12.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.672+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 0x558fa1405d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.672+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558fa14009e0 0x558fa1402ea0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.672+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1407b80 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.672+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3910958589 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 0x558fa1407640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.672+0000 7efec17cbe00 1 -- 10.20.193.28:0/3910958589 >> 10.20.193.28:0/3910958589 conn(0x558fa13a7240 msgr2=0x558fa13e33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:12.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.672+0000 7efe72ffd640 0 client.19974 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:12.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.673+0000 7efec17cbe00 1 -- 10.20.193.28:0/3910958589 shutdown_connections 2026-02-20T03:31:12.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.673+0000 7efec17cbe00 1 -- 10.20.193.28:0/3910958589 wait complete. 2026-02-20T03:31:12.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.673+0000 7efec17cbe00 20 client.19974 trim_cache size 0 max 16384 2026-02-20T03:31:12.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 Processor -- start 2026-02-20T03:31:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- start start 2026-02-20T03:31:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e45e0 0x558fa13fc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e4f60 0x558fa13fa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 0x558fa13fae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe640126d0 con 0x558fa13e45e0 2026-02-20T03:31:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efe6400ff40 con 0x558fa13e4f60 2026-02-20T03:31:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe6400dd90 con 0x558fa13e9fb0 2026-02-20T03:31:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebd03b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e45e0 0x558fa13fc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:12.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebd03b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e45e0 0x558fa13fc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58244/0 (socket says 10.20.193.28:58244) 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebd03b640 1 -- 10.20.193.28:0/3051829803 learned_addr learned my addr 10.20.193.28:0/3051829803 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebd03b640 1 -- 10.20.193.28:0/3051829803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 msgr2=0x558fa13fae40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebd03b640 1 --2- 10.20.193.28:0/3051829803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 0x558fa13fae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebd03b640 1 -- 10.20.193.28:0/3051829803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e4f60 msgr2=0x558fa13fa900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebd03b640 1 --2- 10.20.193.28:0/3051829803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e4f60 0x558fa13fa900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebd03b640 1 -- 10.20.193.28:0/3051829803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fa13f6950 con 0x558fa13e45e0 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebd03b640 1 --2- 10.20.193.28:0/3051829803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e45e0 0x558fa13fc190 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x558fa13fcb30 tx=0x7efea00023d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a0745fa3f13d4a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efe854e4640 1 -- 10.20.193.28:0/3051829803 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0002920 con 0x558fa13e45e0 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efe854e4640 1 -- 10.20.193.28:0/3051829803 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efea0046070 con 0x558fa13e45e0 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efe854e4640 1 -- 10.20.193.28:0/3051829803 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0038990 con 0x558fa13e45e0 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- 10.20.193.28:0/3051829803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e45e0 msgr2=0x558fa13fc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:12.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3051829803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e45e0 0x558fa13fc190 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x558fa13fcb30 tx=0x7efea00023d0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- 10.20.193.28:0/3051829803 shutdown_connections 2026-02-20T03:31:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3051829803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 0x558fa13fae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3051829803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e4f60 0x558fa13fa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3051829803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e45e0 0x558fa13fc190 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- 10.20.193.28:0/3051829803 >> 10.20.193.28:0/3051829803 conn(0x558fa13a7240 msgr2=0x558fa13fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- 10.20.193.28:0/3051829803 shutdown_connections 2026-02-20T03:31:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- 10.20.193.28:0/3051829803 wait complete. 2026-02-20T03:31:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- start start 2026-02-20T03:31:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 Processor -- start 2026-02-20T03:31:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 0x558fa1411a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1411f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 0x558fa140e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efe6400e400 con 0x558fa13e4f60 2026-02-20T03:31:12.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efe6400f870 con 0x558fa13e45e0 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efec17cbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efe6400ead0 con 0x558fa13e9fb0 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebc83a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1411f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebc83a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1411f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58254/0 (socket says 10.20.193.28:58254) 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebc83a640 1 -- 10.20.193.28:0/3747941 learned_addr learned my addr 10.20.193.28:0/3747941 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebc83a640 1 -- 10.20.193.28:0/3747941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 msgr2=0x558fa140e6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebc83a640 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 0x558fa140e6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebc83a640 1 -- 10.20.193.28:0/3747941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 msgr2=0x558fa1411a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebc83a640 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 0x558fa1411a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebc83a640 1 -- 10.20.193.28:0/3747941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fa1016870 con 0x558fa13e4f60 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efebc83a640 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1411f90 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7efea800b5a0 tx=0x7efea801c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd7024952561a35 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.679+0000 7efe72ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:12.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efe72ffd640 1 -- 10.20.193.28:0/3747941 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8034070 con 0x558fa13e4f60 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efe72ffd640 1 -- 10.20.193.28:0/3747941 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efea8017050 con 0x558fa13e4f60 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efec17cbe00 1 -- 10.20.193.28:0/3747941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fa12d73f0 con 0x558fa13e4f60 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efe72ffd640 1 -- 10.20.193.28:0/3747941 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea80306b0 con 0x558fa13e4f60 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efec17cbe00 10 client.19980 _ll_register_callbacks cb 0x7efea8013040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efe72ffd640 1 -- 10.20.193.28:0/3747941 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7efea8030850 con 0x558fa13e4f60 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efec17cbe00 1 -- 10.20.193.28:0/3747941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558fa13087c0 con 0x558fa13e4f60 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efe72ffd640 1 -- 10.20.193.28:0/3747941 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efea803e060 con 0x558fa13e4f60 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efec17cbe00 10 client.19980 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.684+0000 7efec17cbe00 1 -- 10.20.193.28:0/3747941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x558fa13f7640 con 0x558fa13e4f60 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.685+0000 7efe72ffd640 1 -- 10.20.193.28:0/3747941 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7efea8025640 con 0x558fa13e4f60 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.685+0000 7efec17cbe00 10 client.19980 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:12.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.685+0000 7efec17cbe00 10 client.19980 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:31:12.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.685+0000 7efec17cbe00 20 client.19980 populate_metadata read hostname 'trial028' 2026-02-20T03:31:12.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.685+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558fa148aa50 0x558fa148cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:12.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.685+0000 7efec17cbe00 4 client.19980 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:31:12.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.685+0000 7efec17cbe00 1 -- 10.20.193.28:0/3747941 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558fa12e9ab0 con 0x558fa148aa50 2026-02-20T03:31:12.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 28.77 MB/sec execute 43 sec latency 23201.820 ms 2026-02-20T03:31:12.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.698+0000 7efebd03b640 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558fa148aa50 0x558fa148cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:12.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:12 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1512498724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:12.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.740+0000 7efebd03b640 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558fa148aa50 0x558fa148cf10 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a81c2140fd4bfcf server_cookie=8fdb697e5c6a992c in_seq=0 out_seq=0 2026-02-20T03:31:12.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.740+0000 7efe72ffd640 10 client.19980 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:12.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.753+0000 7efe72ffd640 1 -- 10.20.193.28:0/3747941 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558fa12e9ab0 con 0x558fa148aa50 2026-02-20T03:31:12.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.753+0000 7efe72ffd640 10 client.19980 handle_command_reply: tid=0 2026-02-20T03:31:12.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.753+0000 7efec17cbe00 1 client.19980 shutdown 2026-02-20T03:31:12.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 -- 10.20.193.28:0/3747941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 msgr2=0x558fa1411f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:12.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1411f90 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7efea800b5a0 tx=0x7efea801c640 comp rx=0 tx=0).stop 2026-02-20T03:31:12.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 -- 10.20.193.28:0/3747941 shutdown_connections 2026-02-20T03:31:12.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558fa13e9fb0 0x558fa140e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x558fa148aa50 0x558fa148cf10 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558fa13e4f60 0x558fa1411f90 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 --2- 10.20.193.28:0/3747941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558fa13e45e0 0x558fa1411a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 -- 10.20.193.28:0/3747941 >> 10.20.193.28:0/3747941 conn(0x558fa13a7240 msgr2=0x558fa13e24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:12.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efe72ffd640 0 client.19980 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:12.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 -- 10.20.193.28:0/3747941 shutdown_connections 2026-02-20T03:31:12.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.754+0000 7efec17cbe00 1 -- 10.20.193.28:0/3747941 wait complete. 2026-02-20T03:31:12.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.755+0000 7efec17cbe00 20 client.19980 trim_cache size 0 max 16384 2026-02-20T03:31:12.759 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:31:12.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.755+0000 7efebe03d640 1 -- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe880b0e20 msgr2=0x7efe880b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:12.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.755+0000 7efebe03d640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe880b0e20 0x7efe880b32e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efea8006fd0 tx=0x7efea8006da0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.755+0000 7efebe03d640 1 -- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 msgr2=0x7efeb81a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:12.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.755+0000 7efebe03d640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1ae0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7efeb400b990 tx=0x7efeb400be60 comp rx=0 tx=0).stop 2026-02-20T03:31:12.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.756+0000 7efebe03d640 1 -- 10.20.193.28:0/2062140352 shutdown_connections 2026-02-20T03:31:12.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.756+0000 7efebe03d640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe880b0e20 0x7efe880b32e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.756+0000 7efebe03d640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efeb810a980 0x7efeb81a1ae0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.756+0000 7efebe03d640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efeb8105320 0x7efeb819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.756+0000 7efebe03d640 1 --2- 10.20.193.28:0/2062140352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efeb8104980 0x7efeb819d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:12.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.756+0000 7efebe03d640 1 -- 10.20.193.28:0/2062140352 >> 10.20.193.28:0/2062140352 conn(0x7efeb8100680 msgr2=0x7efeb8101150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.756+0000 7efebe03d640 1 -- 10.20.193.28:0/2062140352 shutdown_connections 2026-02-20T03:31:12.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:12.756+0000 7efebe03d640 1 -- 10.20.193.28:0/2062140352 wait complete. 2026-02-20T03:31:12.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:12 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1512498724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:12.931 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:31:13.223 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:13.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- 10.20.193.28:0/125356922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010fc60 msgr2=0x7f86c0116640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:13.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 --2- 10.20.193.28:0/125356922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010fc60 0x7f86c0116640 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f86b000ab80 tx=0x7f86b0030650 comp rx=0 tx=0).stop 2026-02-20T03:31:13.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- 10.20.193.28:0/125356922 shutdown_connections 2026-02-20T03:31:13.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 --2- 10.20.193.28:0/125356922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010fc60 0x7f86c0116640 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 --2- 10.20.193.28:0/125356922 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86c010b080 0x7f86c010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 --2- 10.20.193.28:0/125356922 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c010a6d0 0x7f86c010aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- 10.20.193.28:0/125356922 >> 10.20.193.28:0/125356922 conn(0x7f86c006efb0 msgr2=0x7f86c006f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:13.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- 10.20.193.28:0/125356922 shutdown_connections 2026-02-20T03:31:13.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- 10.20.193.28:0/125356922 wait complete. 2026-02-20T03:31:13.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 Processor -- start 2026-02-20T03:31:13.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- start start 2026-02-20T03:31:13.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c010a6d0 0x7f86c010d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010b080 0x7f86c010b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86c010fc60 0x7f86c010bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f86c01191c0 con 0x7f86c010b080 2026-02-20T03:31:13.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f86c0119040 con 0x7f86c010fc60 2026-02-20T03:31:13.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f86c0119340 con 0x7f86c010a6d0 2026-02-20T03:31:13.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bdd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010b080 0x7f86c010b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:13.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bdd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010b080 0x7f86c010b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58262/0 (socket says 10.20.193.28:58262) 2026-02-20T03:31:13.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bdd74640 1 -- 10.20.193.28:0/774375299 learned_addr learned my addr 10.20.193.28:0/774375299 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:13.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bdd74640 1 -- 10.20.193.28:0/774375299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c010a6d0 msgr2=0x7f86c010d030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:13.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bdd74640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c010a6d0 0x7f86c010d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bdd74640 1 -- 10.20.193.28:0/774375299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86c010fc60 msgr2=0x7f86c010bb40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bdd74640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86c010fc60 0x7f86c010bb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bdd74640 1 -- 10.20.193.28:0/774375299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c010c400 con 0x7f86c010b080 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bdd74640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010b080 0x7f86c010b5c0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f86a400b570 tx=0x7f86a400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86b77fe640 1 -- 10.20.193.28:0/774375299 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4013020 con 0x7f86c010b080 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86b77fe640 1 -- 10.20.193.28:0/774375299 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f86a4004480 con 0x7f86c010b080 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86b77fe640 1 -- 10.20.193.28:0/774375299 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a400fb50 con 0x7f86c010b080 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- 10.20.193.28:0/774375299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c01b66a0 con 0x7f86c010b080 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.470+0000 7f86bf577640 1 -- 10.20.193.28:0/774375299 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c01b6b90 con 0x7f86c010b080 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86b77fe640 1 -- 10.20.193.28:0/774375299 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f86a4002780 con 0x7f86c010b080 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86c7219e00 1 Processor -- start 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86c7219e00 1 -- start start 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c547efb0 0x5564c547f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c54795e0 0x5564c5479a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c5479f60 0x5564c5485de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86c7219e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5564c53f9e00 con 0x5564c547efb0 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86c7219e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5564c53cc970 con 0x5564c54795e0 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86c7219e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5564c537a1f0 con 0x5564c5479f60 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c547efb0 0x5564c547f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c547efb0 0x5564c547f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58272/0 (socket says 10.20.193.28:58272) 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 -- 10.20.193.28:0/1340633993 learned_addr learned my addr 10.20.193.28:0/1340633993 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86b77fe640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86980b0e20 0x7f86980b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86b77fe640 1 -- 10.20.193.28:0/774375299 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f86a40e0570 con 0x7f86c010b080 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 -- 10.20.193.28:0/1340633993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c5479f60 msgr2=0x5564c5485de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 --2- 10.20.193.28:0/1340633993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c5479f60 0x5564c5485de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 -- 10.20.193.28:0/1340633993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c54795e0 msgr2=0x5564c5479a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 --2- 10.20.193.28:0/1340633993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c54795e0 0x5564c5479a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 -- 10.20.193.28:0/1340633993 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c538d3d0 con 0x5564c547efb0 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86980b0e20 0x7f86980b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86bed76640 1 --2- 10.20.193.28:0/1340633993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c547efb0 0x5564c547f390 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f86b000ab50 tx=0x7f86b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aea6b86bd05cab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.476+0000 7f86b4ff9640 1 -- 10.20.193.28:0/1340633993 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0049040 con 0x5564c547efb0 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.478+0000 7f86bed76640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86980b0e20 0x7f86980b32e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f86b004f000 tx=0x7f86b0050000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.478+0000 7f86b4ff9640 1 -- 10.20.193.28:0/1340633993 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f86b0002b80 con 0x5564c547efb0 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- 10.20.193.28:0/1340633993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c547efb0 msgr2=0x5564c547f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 --2- 10.20.193.28:0/1340633993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c547efb0 0x5564c547f390 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f86b000ab50 tx=0x7f86b0005880 comp rx=0 tx=0).stop 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- 10.20.193.28:0/1340633993 shutdown_connections 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 --2- 10.20.193.28:0/1340633993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c5479f60 0x5564c5485de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 --2- 10.20.193.28:0/1340633993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c54795e0 0x5564c5479a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 --2- 10.20.193.28:0/1340633993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c547efb0 0x5564c547f390 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- 10.20.193.28:0/1340633993 >> 10.20.193.28:0/1340633993 conn(0x5564c543c240 msgr2=0x5564c5477ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- 10.20.193.28:0/1340633993 shutdown_connections 2026-02-20T03:31:13.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- 10.20.193.28:0/1340633993 wait complete. 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- start start 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 Processor -- start 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c54795e0 0x5564c5493f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c5494450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c547efb0 0x5564c54926c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5564c53c88a0 con 0x5564c5479f60 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5564c51baf50 con 0x5564c54795e0 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5564c5492d00 con 0x5564c547efb0 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86bdd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c5494450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86bdd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c5494450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58280/0 (socket says 10.20.193.28:58280) 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86bdd74640 1 -- 10.20.193.28:0/4208129410 learned_addr learned my addr 10.20.193.28:0/4208129410 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86bdd74640 1 -- 10.20.193.28:0/4208129410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c547efb0 msgr2=0x5564c54926c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86bdd74640 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c547efb0 0x5564c54926c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86bdd74640 1 -- 10.20.193.28:0/4208129410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c54795e0 msgr2=0x5564c5493f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:13.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86bdd74640 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c54795e0 0x5564c5493f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86bdd74640 1 -- 10.20.193.28:0/4208129410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c548bb20 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86bdd74640 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c5494450 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f86a40a7f50 tx=0x7f86a40a7860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e80d1df3ca26a0c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f866ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f866ffff640 1 -- 10.20.193.28:0/4208129410 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a40e01e0 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- 10.20.193.28:0/4208129410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564c519db40 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f866ffff640 1 -- 10.20.193.28:0/4208129410 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f86a40a4290 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f866ffff640 1 -- 10.20.193.28:0/4208129410 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a40a3bd0 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f866ffff640 1 -- 10.20.193.28:0/4208129410 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f86a40a6cd0 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 10 client.19992 _ll_register_callbacks cb 0x5564c5405eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- 10.20.193.28:0/4208129410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564c53da150 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f866ffff640 1 -- 10.20.193.28:0/4208129410 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f86a40ac130 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 10 client.19992 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- 10.20.193.28:0/4208129410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x5564c53871e0 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f866ffff640 1 -- 10.20.193.28:0/4208129410 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f86a40a6ed0 con 0x5564c5479f60 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 10 client.19992 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 10 client.19992 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:31:13.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 20 client.19992 populate_metadata read hostname 'trial028' 2026-02-20T03:31:13.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5564c54a26d0 0x5564c54a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 4 client.19992 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:13.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.479+0000 7f86c7219e00 1 -- 10.20.193.28:0/4208129410 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564c53d4560 con 0x5564c54a26d0 2026-02-20T03:31:13.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.506+0000 7f86be575640 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5564c54a26d0 0x5564c54a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:13.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.533+0000 7f86be575640 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5564c54a26d0 0x5564c54a4b60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ffb40a790b87416 server_cookie=7f8b100587677ecf in_seq=0 out_seq=0 2026-02-20T03:31:13.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.533+0000 7f866ffff640 10 client.19992 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:13.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f866ffff640 1 -- 10.20.193.28:0/4208129410 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5564c53d4560 con 0x5564c54a26d0 2026-02-20T03:31:13.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f866ffff640 10 client.19992 handle_command_reply: tid=0 2026-02-20T03:31:13.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 client.19992 shutdown 2026-02-20T03:31:13.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 -- 10.20.193.28:0/4208129410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 msgr2=0x5564c5494450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:13.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c5494450 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f86a40a7f50 tx=0x7f86a40a7860 comp rx=0 tx=0).stop 2026-02-20T03:31:13.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 -- 10.20.193.28:0/4208129410 shutdown_connections 2026-02-20T03:31:13.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5564c54a26d0 0x5564c54a4b60 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c547efb0 0x5564c54926c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c5494450 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4208129410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c54795e0 0x5564c5493f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 -- 10.20.193.28:0/4208129410 >> 10.20.193.28:0/4208129410 conn(0x5564c543c240 msgr2=0x5564c54783f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:13.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f866ffff640 0 client.19992 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:13.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 -- 10.20.193.28:0/4208129410 shutdown_connections 2026-02-20T03:31:13.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 1 -- 10.20.193.28:0/4208129410 wait complete. 2026-02-20T03:31:13.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.547+0000 7f86c7219e00 20 client.19992 trim_cache size 0 max 16384 2026-02-20T03:31:13.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 Processor -- start 2026-02-20T03:31:13.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- start start 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c54795e0 0x5564c5491650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c54aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c547efb0 0x5564c54aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f86640126b0 con 0x5564c5479f60 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f866400ff20 con 0x5564c547efb0 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f866400dd70 con 0x5564c54795e0 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86bdd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c54aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86bdd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c54aa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58294/0 (socket says 10.20.193.28:58294) 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86bdd74640 1 -- 10.20.193.28:0/3466427774 learned_addr learned my addr 10.20.193.28:0/3466427774 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:13.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86bdd74640 1 -- 10.20.193.28:0/3466427774 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c54795e0 msgr2=0x5564c5491650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86bdd74640 1 --2- 10.20.193.28:0/3466427774 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c54795e0 0x5564c5491650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86bdd74640 1 -- 10.20.193.28:0/3466427774 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c547efb0 msgr2=0x5564c54aaa00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86bdd74640 1 --2- 10.20.193.28:0/3466427774 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c547efb0 0x5564c54aaa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86bdd74640 1 -- 10.20.193.28:0/3466427774 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c548b950 con 0x5564c5479f60 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86bdd74640 1 --2- 10.20.193.28:0/3466427774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c54aa4c0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f86a40e0860 tx=0x7f86a4092000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794a871232ab4782 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f868a4e6640 1 -- 10.20.193.28:0/3466427774 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a40ddc60 con 0x5564c5479f60 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f868a4e6640 1 -- 10.20.193.28:0/3466427774 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5564c53da150 con 0x5564c5479f60 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f868a4e6640 1 -- 10.20.193.28:0/3466427774 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a40a3cf0 con 0x5564c5479f60 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- 10.20.193.28:0/3466427774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 msgr2=0x5564c54aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- 10.20.193.28:0/3466427774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c54aa4c0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f86a40e0860 tx=0x7f86a4092000 comp rx=0 tx=0).stop 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- 10.20.193.28:0/3466427774 shutdown_connections 2026-02-20T03:31:13.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- 10.20.193.28:0/3466427774 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c547efb0 0x5564c54aaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- 10.20.193.28:0/3466427774 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c5479f60 0x5564c54aa4c0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- 10.20.193.28:0/3466427774 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c54795e0 0x5564c5491650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- 10.20.193.28:0/3466427774 >> 10.20.193.28:0/3466427774 conn(0x5564c543c240 msgr2=0x5564c5490f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:13.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- 10.20.193.28:0/3466427774 shutdown_connections 2026-02-20T03:31:13.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- 10.20.193.28:0/3466427774 wait complete. 2026-02-20T03:31:13.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- start start 2026-02-20T03:31:13.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 Processor -- start 2026-02-20T03:31:13.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c54795e0 0x5564c5498db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c5479f60 0x5564c54992f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c547efb0 0x5564c5499830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f866400e3e0 con 0x5564c54795e0 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f866400f850 con 0x5564c547efb0 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86c7219e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f866400eab0 con 0x5564c5479f60 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86be575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c54795e0 0x5564c5498db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86be575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c54795e0 0x5564c5498db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58308/0 (socket says 10.20.193.28:58308) 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86be575640 1 -- 10.20.193.28:0/4186297482 learned_addr learned my addr 10.20.193.28:0/4186297482 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86be575640 1 -- 10.20.193.28:0/4186297482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c5479f60 msgr2=0x5564c54992f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86be575640 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c5479f60 0x5564c54992f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86be575640 1 -- 10.20.193.28:0/4186297482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c547efb0 msgr2=0x5564c5499830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86be575640 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c547efb0 0x5564c5499830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.557+0000 7f86be575640 1 -- 10.20.193.28:0/4186297482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564c50ab870 con 0x5564c54795e0 2026-02-20T03:31:13.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86be575640 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c54795e0 0x5564c5498db0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00a9d0 tx=0x7f86ac003b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376086dee6ebd590 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:13.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f866ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:13.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f866ffff640 1 -- 10.20.193.28:0/4186297482 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac008020 con 0x5564c54795e0 2026-02-20T03:31:13.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f866ffff640 1 -- 10.20.193.28:0/4186297482 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f86ac004760 con 0x5564c54795e0 2026-02-20T03:31:13.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f866ffff640 1 -- 10.20.193.28:0/4186297482 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac01a070 con 0x5564c54795e0 2026-02-20T03:31:13.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 1 -- 10.20.193.28:0/4186297482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564c536c3f0 con 0x5564c54795e0 2026-02-20T03:31:13.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 10 client.19998 _ll_register_callbacks cb 0x7f86a400f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:13.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 1 -- 10.20.193.28:0/4186297482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5564c537eab0 con 0x5564c54795e0 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f866ffff640 1 -- 10.20.193.28:0/4186297482 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f86ac004910 con 0x5564c54795e0 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f866ffff640 1 -- 10.20.193.28:0/4186297482 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f86ac023060 con 0x5564c54795e0 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 10 client.19998 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 1 -- 10.20.193.28:0/4186297482 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x5564c548c640 con 0x5564c54795e0 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f866ffff640 1 -- 10.20.193.28:0/4186297482 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f86ac026050 con 0x5564c54795e0 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 10 client.19998 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 10 client.19998 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 20 client.19998 populate_metadata read hostname 'trial028' 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5564c550ed50 0x5564c5511210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 4 client.19998 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.561+0000 7f86c7219e00 1 -- 10.20.193.28:0/4186297482 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564c537eab0 con 0x5564c550ed50 2026-02-20T03:31:13.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.575+0000 7f86bdd74640 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5564c550ed50 0x5564c5511210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:13.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.616+0000 7f866ffff640 10 client.19998 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:13.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.616+0000 7f86bdd74640 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5564c550ed50 0x5564c5511210 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae978e6f05b4b95d server_cookie=52191e4515c169c1 in_seq=0 out_seq=0 2026-02-20T03:31:13.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f866ffff640 1 -- 10.20.193.28:0/4186297482 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564c537eab0 con 0x5564c550ed50 2026-02-20T03:31:13.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f866ffff640 10 client.19998 handle_command_reply: tid=0 2026-02-20T03:31:13.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 client.19998 shutdown 2026-02-20T03:31:13.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 -- 10.20.193.28:0/4186297482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c54795e0 msgr2=0x5564c5498db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:13.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c54795e0 0x5564c5498db0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00a9d0 tx=0x7f86ac003b10 comp rx=0 tx=0).stop 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 -- 10.20.193.28:0/4186297482 shutdown_connections 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5564c550ed50 0x5564c5511210 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5564c547efb0 0x5564c5499830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5564c5479f60 0x5564c54992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 --2- 10.20.193.28:0/4186297482 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5564c54795e0 0x5564c5498db0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f866ffff640 0 client.19998 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 -- 10.20.193.28:0/4186297482 >> 10.20.193.28:0/4186297482 conn(0x5564c543c240 msgr2=0x5564c5491760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 -- 10.20.193.28:0/4186297482 shutdown_connections 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 1 -- 10.20.193.28:0/4186297482 wait complete. 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86c7219e00 20 client.19998 trim_cache size 0 max 16384 2026-02-20T03:31:13.634 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:31:13.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 -- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86980b0e20 msgr2=0x7f86980b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:13.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86980b0e20 0x7f86980b32e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f86b004f000 tx=0x7f86b0050000 comp rx=0 tx=0).stop 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 -- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010b080 msgr2=0x7f86c010b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010b080 0x7f86c010b5c0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f86a400b570 tx=0x7f86a400ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 -- 10.20.193.28:0/774375299 shutdown_connections 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86980b0e20 0x7f86980b32e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f86c010fc60 0x7f86c010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f86c010b080 0x7f86c010b5c0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 --2- 10.20.193.28:0/774375299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f86c010a6d0 0x7f86c010d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 -- 10.20.193.28:0/774375299 >> 10.20.193.28:0/774375299 conn(0x7f86c006efb0 msgr2=0x7f86c010dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 -- 10.20.193.28:0/774375299 shutdown_connections 2026-02-20T03:31:13.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:13.630+0000 7f86bf577640 1 -- 10.20.193.28:0/774375299 wait complete. 2026-02-20T03:31:13.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83971 28.12 MB/sec execute 44 sec latency 24186.369 ms 2026-02-20T03:31:13.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:13 trial028 ceph-mon[38552]: pgmap v681: 129 pgs: 129 active+clean; 702 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 312 KiB/s rd, 13 MiB/s wr, 355 op/s 2026-02-20T03:31:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:13 trial177 ceph-mon[43181]: pgmap v681: 129 pgs: 129 active+clean; 702 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 312 KiB/s rd, 13 MiB/s wr, 355 op/s 2026-02-20T03:31:13.809 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:31:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:13 trial126 ceph-mon[38476]: pgmap v681: 129 pgs: 129 active+clean; 702 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 312 KiB/s rd, 13 MiB/s wr, 355 op/s 2026-02-20T03:31:14.142 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:14.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 -- 10.20.193.28:0/3251455607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594077620 msgr2=0x7fb594077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:14.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 --2- 10.20.193.28:0/3251455607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594077620 0x7fb594077a00 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb584009a30 tx=0x7fb58402f260 comp rx=0 tx=0).stop 2026-02-20T03:31:14.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 -- 10.20.193.28:0/3251455607 shutdown_connections 2026-02-20T03:31:14.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 --2- 10.20.193.28:0/3251455607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb594113840 0x7fb594115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 --2- 10.20.193.28:0/3251455607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb594077f40 0x7fb594113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 --2- 10.20.193.28:0/3251455607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594077620 0x7fb594077a00 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 -- 10.20.193.28:0/3251455607 >> 10.20.193.28:0/3251455607 conn(0x7fb5941006c0 msgr2=0x7fb594102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:14.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 -- 10.20.193.28:0/3251455607 shutdown_connections 2026-02-20T03:31:14.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 -- 10.20.193.28:0/3251455607 wait complete. 2026-02-20T03:31:14.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 Processor -- start 2026-02-20T03:31:14.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.408+0000 7fb59b143640 1 -- start start 2026-02-20T03:31:14.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.411+0000 7fb59b143640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb594077620 0x7fb5941a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.411+0000 7fb59b143640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb594077f40 0x7fb5941a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59b143640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594113840 0x7fb5941a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59b143640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb594119200 con 0x7fb594113840 2026-02-20T03:31:14.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59b143640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb594119080 con 0x7fb594077620 2026-02-20T03:31:14.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59b143640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb594119380 con 0x7fb594077f40 2026-02-20T03:31:14.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59a942640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594113840 0x7fb5941a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:14.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59a942640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594113840 0x7fb5941a5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58322/0 (socket says 10.20.193.28:58322) 2026-02-20T03:31:14.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59a942640 1 -- 10.20.193.28:0/40526659 learned_addr learned my addr 10.20.193.28:0/40526659 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:14.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59a942640 1 -- 10.20.193.28:0/40526659 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb594077f40 msgr2=0x7fb5941a1bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:14.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59a942640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb594077f40 0x7fb5941a1bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59a942640 1 -- 10.20.193.28:0/40526659 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb594077620 msgr2=0x7fb5941a1680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:14.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59a942640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb594077620 0x7fb5941a1680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59a942640 1 -- 10.20.193.28:0/40526659 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5941a66d0 con 0x7fb594113840 2026-02-20T03:31:14.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.412+0000 7fb59a942640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594113840 0x7fb5941a5f50 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb59000b9e0 tx=0x7fb59000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.413+0000 7fb57b7fe640 1 -- 10.20.193.28:0/40526659 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590006e60 con 0x7fb594113840 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.413+0000 7fb59b143640 1 -- 10.20.193.28:0/40526659 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5941a69c0 con 0x7fb594113840 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.413+0000 7fb57b7fe640 1 -- 10.20.193.28:0/40526659 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb590010070 con 0x7fb594113840 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.413+0000 7fb57b7fe640 1 -- 10.20.193.28:0/40526659 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5900047f0 con 0x7fb594113840 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.413+0000 7fb59b143640 1 -- 10.20.193.28:0/40526659 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5941ae200 con 0x7fb594113840 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb57b7fe640 1 -- 10.20.193.28:0/40526659 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb59001d030 con 0x7fb594113840 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb59e8d1e00 1 Processor -- start 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb59e8d1e00 1 -- start start 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd6fb0 0x55fcd4dd7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd15e0 0x55fcd4dd1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd1f60 0x55fcd4dddde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb59e8d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fcd4d51e00 con 0x55fcd4dd1f60 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb59e8d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fcd4d24970 con 0x55fcd4dd6fb0 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb59e8d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fcd4cd21f0 con 0x55fcd4dd15e0 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb599940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd1f60 0x55fcd4dddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb599940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd1f60 0x55fcd4dddde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58338/0 (socket says 10.20.193.28:58338) 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb599940640 1 -- 10.20.193.28:0/2232476324 learned_addr learned my addr 10.20.193.28:0/2232476324 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb57b7fe640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb56c0b0e20 0x7fb56c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb599940640 1 -- 10.20.193.28:0/2232476324 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd15e0 msgr2=0x55fcd4dd1a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb599940640 1 --2- 10.20.193.28:0/2232476324 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd15e0 0x55fcd4dd1a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb599940640 1 -- 10.20.193.28:0/2232476324 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd6fb0 msgr2=0x55fcd4dd7390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb599940640 1 --2- 10.20.193.28:0/2232476324 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd6fb0 0x55fcd4dd7390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.415+0000 7fb599940640 1 -- 10.20.193.28:0/2232476324 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd4ce53d0 con 0x55fcd4dd1f60 2026-02-20T03:31:14.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.418+0000 7fb57b7fe640 1 -- 10.20.193.28:0/40526659 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fb5900dfff0 con 0x7fb594113840 2026-02-20T03:31:14.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.418+0000 7fb599940640 1 --2- 10.20.193.28:0/2232476324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd1f60 0x55fcd4dddde0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fb5880098a0 tx=0x7fb588009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9809fa550e35658 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:14.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.418+0000 7fb59a942640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb56c0b0e20 0x7fb56c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:14.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.418+0000 7fb578a08640 1 -- 10.20.193.28:0/2232476324 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588016070 con 0x55fcd4dd1f60 2026-02-20T03:31:14.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.418+0000 7fb59a942640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb56c0b0e20 0x7fb56c0b32e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb5900a7cc0 tx=0x7fb590002f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:14.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.418+0000 7fb578a08640 1 -- 10.20.193.28:0/2232476324 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb588002870 con 0x55fcd4dd1f60 2026-02-20T03:31:14.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.418+0000 7fb578a08640 1 -- 10.20.193.28:0/2232476324 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588016070 con 0x55fcd4dd1f60 2026-02-20T03:31:14.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.419+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2232476324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd1f60 msgr2=0x55fcd4dddde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:14.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.419+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2232476324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd1f60 0x55fcd4dddde0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fb5880098a0 tx=0x7fb588009d70 comp rx=0 tx=0).stop 2026-02-20T03:31:14.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.420+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2232476324 shutdown_connections 2026-02-20T03:31:14.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.420+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2232476324 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd1f60 0x55fcd4dddde0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.420+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2232476324 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd15e0 0x55fcd4dd1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.420+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2232476324 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd6fb0 0x55fcd4dd7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.420+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2232476324 >> 10.20.193.28:0/2232476324 conn(0x55fcd4d94240 msgr2=0x55fcd4dcfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:14.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2232476324 shutdown_connections 2026-02-20T03:31:14.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2232476324 wait complete. 2026-02-20T03:31:14.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 -- start start 2026-02-20T03:31:14.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 Processor -- start 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4debfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd1f60 0x55fcd4dec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb599940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4debfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb599940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4debfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58344/0 (socket says 10.20.193.28:58344) 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb599940640 1 -- 10.20.193.28:0/1144072289 learned_addr learned my addr 10.20.193.28:0/1144072289 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd6fb0 0x55fcd4dea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fcd4d208a0 con 0x55fcd4dd15e0 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fcd4b12f50 con 0x55fcd4dd6fb0 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fcd4deace0 con 0x55fcd4dd1f60 2026-02-20T03:31:14.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb599940640 1 -- 10.20.193.28:0/1144072289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd1f60 msgr2=0x55fcd4dec4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb599940640 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd1f60 0x55fcd4dec4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb599940640 1 -- 10.20.193.28:0/1144072289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd6fb0 msgr2=0x55fcd4dea750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb599940640 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd6fb0 0x55fcd4dea750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb599940640 1 -- 10.20.193.28:0/1144072289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd4de3b20 con 0x55fcd4dd15e0 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb599940640 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4debfa0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb588009270 tx=0x7fb588004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c442749abcea873 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb543fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb543fff640 1 -- 10.20.193.28:0/1144072289 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588020070 con 0x55fcd4dd15e0 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcd4af5b40 con 0x55fcd4dd15e0 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 10 client.20010 _ll_register_callbacks cb 0x55fcd4d5deb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb543fff640 1 -- 10.20.193.28:0/1144072289 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb588017040 con 0x55fcd4dd15e0 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb543fff640 1 -- 10.20.193.28:0/1144072289 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588016070 con 0x55fcd4dd15e0 2026-02-20T03:31:14.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fcd4d32150 con 0x55fcd4dd15e0 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb543fff640 1 -- 10.20.193.28:0/1144072289 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fb588025440 con 0x55fcd4dd15e0 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb543fff640 1 -- 10.20.193.28:0/1144072289 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fb588025700 con 0x55fcd4dd15e0 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 10 client.20010 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55fcd4cdf1e0 con 0x55fcd4dd15e0 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.426+0000 7fb543fff640 1 -- 10.20.193.28:0/1144072289 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fb58801b440 con 0x55fcd4dd15e0 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.431+0000 7fb59e8d1e00 10 client.20010 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.431+0000 7fb59e8d1e00 10 client.20010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.431+0000 7fb59e8d1e00 20 client.20010 populate_metadata read hostname 'trial028' 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.431+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fcd4dfa660 0x55fcd4dfca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.431+0000 7fb59e8d1e00 4 client.20010 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:14.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.431+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcd4d2c560 con 0x55fcd4dfa660 2026-02-20T03:31:14.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.434+0000 7fb59a141640 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fcd4dfa660 0x55fcd4dfca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:14.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.448+0000 7fb59a141640 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fcd4dfa660 0x55fcd4dfca50 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f22575d7aa25214f server_cookie=60f288a122078d3a in_seq=0 out_seq=0 2026-02-20T03:31:14.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.448+0000 7fb543fff640 10 client.20010 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.462+0000 7fb543fff640 1 -- 10.20.193.28:0/1144072289 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fcd4d2c560 con 0x55fcd4dfa660 2026-02-20T03:31:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.462+0000 7fb543fff640 10 client.20010 handle_command_reply: tid=0 2026-02-20T03:31:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.462+0000 7fb59e8d1e00 1 client.20010 shutdown 2026-02-20T03:31:14.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 msgr2=0x55fcd4debfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4debfa0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb588009270 tx=0x7fb588004480 comp rx=0 tx=0).stop 2026-02-20T03:31:14.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 shutdown_connections 2026-02-20T03:31:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fcd4dfa660 0x55fcd4dfca50 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd6fb0 0x55fcd4dea750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd1f60 0x55fcd4dec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/1144072289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4debfa0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 >> 10.20.193.28:0/1144072289 conn(0x55fcd4d94240 msgr2=0x55fcd4dd03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb543fff640 0 client.20010 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 shutdown_connections 2026-02-20T03:31:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/1144072289 wait complete. 2026-02-20T03:31:14.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.463+0000 7fb59e8d1e00 20 client.20010 trim_cache size 0 max 16384 2026-02-20T03:31:14.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.469+0000 7fb59e8d1e00 1 Processor -- start 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- start start 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4d94240 0x55fcd4dc9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd15e0 0x55fcd4de9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd1f60 0x55fcd4de7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c0127d0 con 0x55fcd4d94240 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c010040 con 0x55fcd4dd15e0 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c00de90 con 0x55fcd4dd1f60 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb599940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4d94240 0x55fcd4dc9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb599940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4d94240 0x55fcd4dc9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58348/0 (socket says 10.20.193.28:58348) 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb599940640 1 -- 10.20.193.28:0/3905925542 learned_addr learned my addr 10.20.193.28:0/3905925542 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:14.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb599940640 1 -- 10.20.193.28:0/3905925542 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd1f60 msgr2=0x55fcd4de7b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb599940640 1 --2- 10.20.193.28:0/3905925542 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd1f60 0x55fcd4de7b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb599940640 1 -- 10.20.193.28:0/3905925542 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd15e0 msgr2=0x55fcd4de9590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb599940640 1 --2- 10.20.193.28:0/3905925542 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd15e0 0x55fcd4de9590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb599940640 1 -- 10.20.193.28:0/3905925542 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd4de3950 con 0x55fcd4d94240 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb599940640 1 --2- 10.20.193.28:0/3905925542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4d94240 0x55fcd4dc9d00 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb58800b530 tx=0x7fb58800b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a246aa3f11a84f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb56a4e6640 1 -- 10.20.193.28:0/3905925542 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588020070 con 0x55fcd4d94240 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb56a4e6640 1 -- 10.20.193.28:0/3905925542 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55fcd4d32150 con 0x55fcd4d94240 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/3905925542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4d94240 msgr2=0x55fcd4dc9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/3905925542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4d94240 0x55fcd4dc9d00 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb58800b530 tx=0x7fb58800b020 comp rx=0 tx=0).stop 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/3905925542 shutdown_connections 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/3905925542 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4dd1f60 0x55fcd4de7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/3905925542 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd15e0 0x55fcd4de9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/3905925542 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4d94240 0x55fcd4dc9d00 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/3905925542 >> 10.20.193.28:0/3905925542 conn(0x55fcd4dfcd50 msgr2=0x55fcd4de8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:14.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/3905925542 shutdown_connections 2026-02-20T03:31:14.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/3905925542 wait complete. 2026-02-20T03:31:14.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- start start 2026-02-20T03:31:14.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 Processor -- start 2026-02-20T03:31:14.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4d94240 0x55fcd4df2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4df2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd1f60 0x55fcd4deee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c00e500 con 0x55fcd4dd15e0 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c00f970 con 0x55fcd4dd1f60 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c00ebd0 con 0x55fcd4d94240 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59a141640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4df2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59a141640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4df2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58354/0 (socket says 10.20.193.28:58354) 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59a141640 1 -- 10.20.193.28:0/2933256129 learned_addr learned my addr 10.20.193.28:0/2933256129 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59a141640 1 -- 10.20.193.28:0/2933256129 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4d94240 msgr2=0x55fcd4df2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59a141640 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4d94240 0x55fcd4df2210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59a141640 1 -- 10.20.193.28:0/2933256129 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd1f60 msgr2=0x55fcd4deee90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:14.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59a141640 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd1f60 0x55fcd4deee90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59a141640 1 -- 10.20.193.28:0/2933256129 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd4a03870 con 0x55fcd4dd15e0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59a141640 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4df2750 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb584009950 tx=0x7fb584009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d57012dc0cdb10 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb543fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb543fff640 1 -- 10.20.193.28:0/2933256129 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58403d040 con 0x55fcd4dd15e0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2933256129 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcd4cc43f0 con 0x55fcd4dd15e0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 10 client.20016 _ll_register_callbacks cb 0x7fb588014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb543fff640 1 -- 10.20.193.28:0/2933256129 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb584033040 con 0x55fcd4dd15e0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2933256129 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fcd4cf57c0 con 0x55fcd4dd15e0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb543fff640 1 -- 10.20.193.28:0/2933256129 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584042f80 con 0x55fcd4dd15e0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb543fff640 1 -- 10.20.193.28:0/2933256129 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fb5840028e0 con 0x55fcd4dd15e0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb543fff640 1 -- 10.20.193.28:0/2933256129 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fb58402fac0 con 0x55fcd4dd15e0 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 10 client.20016 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:14.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.471+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2933256129 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55fcd4de4640 con 0x55fcd4dd15e0 2026-02-20T03:31:14.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.476+0000 7fb543fff640 1 -- 10.20.193.28:0/2933256129 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fb58402fc60 con 0x55fcd4dd15e0 2026-02-20T03:31:14.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.476+0000 7fb59e8d1e00 10 client.20016 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:14.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.476+0000 7fb59e8d1e00 10 client.20016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:14.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.476+0000 7fb59e8d1e00 20 client.20016 populate_metadata read hostname 'trial028' 2026-02-20T03:31:14.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.476+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fcd4dd6fb0 0x55fcd4e68330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:14.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.476+0000 7fb59e8d1e00 4 client.20016 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:31:14.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.476+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2933256129 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fcd4cd6ab0 con 0x55fcd4dd6fb0 2026-02-20T03:31:14.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.476+0000 7fb599940640 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fcd4dd6fb0 0x55fcd4e68330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:14.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:14 trial028 ceph-mon[38552]: pgmap v682: 129 pgs: 129 active+clean; 700 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 604 KiB/s rd, 14 MiB/s wr, 389 op/s 2026-02-20T03:31:14.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.504+0000 7fb599940640 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fcd4dd6fb0 0x55fcd4e68330 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89d65a1c0814b906 server_cookie=63c843f0d2a9639d in_seq=0 out_seq=0 2026-02-20T03:31:14.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.504+0000 7fb543fff640 10 client.20016 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:14.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb543fff640 1 -- 10.20.193.28:0/2933256129 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fcd4cd6ab0 con 0x55fcd4dd6fb0 2026-02-20T03:31:14.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb543fff640 10 client.20016 handle_command_reply: tid=0 2026-02-20T03:31:14.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 client.20016 shutdown 2026-02-20T03:31:14.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2933256129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 msgr2=0x55fcd4df2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:14.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4df2750 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fb584009950 tx=0x7fb584009710 comp rx=0 tx=0).stop 2026-02-20T03:31:14.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2933256129 shutdown_connections 2026-02-20T03:31:14.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fcd4dd6fb0 0x55fcd4e68330 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fcd4dd1f60 0x55fcd4deee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fcd4dd15e0 0x55fcd4df2750 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 --2- 10.20.193.28:0/2933256129 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fcd4d94240 0x55fcd4df2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2933256129 >> 10.20.193.28:0/2933256129 conn(0x55fcd4dfcd50 msgr2=0x55fcd4de96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:14.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb543fff640 0 client.20016 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:14.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2933256129 shutdown_connections 2026-02-20T03:31:14.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 1 -- 10.20.193.28:0/2933256129 wait complete. 2026-02-20T03:31:14.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59e8d1e00 20 client.20016 trim_cache size 0 max 16384 2026-02-20T03:31:14.524 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:31:14.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 -- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb56c0b0e20 msgr2=0x7fb56c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:14.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb56c0b0e20 0x7fb56c0b32e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb5900a7cc0 tx=0x7fb590002f10 comp rx=0 tx=0).stop 2026-02-20T03:31:14.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 -- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594113840 msgr2=0x7fb5941a5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:14.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594113840 0x7fb5941a5f50 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb59000b9e0 tx=0x7fb59000beb0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 -- 10.20.193.28:0/40526659 shutdown_connections 2026-02-20T03:31:14.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb56c0b0e20 0x7fb56c0b32e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb594113840 0x7fb5941a5f50 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb594077f40 0x7fb5941a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 --2- 10.20.193.28:0/40526659 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb594077620 0x7fb5941a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:14.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 -- 10.20.193.28:0/40526659 >> 10.20.193.28:0/40526659 conn(0x7fb5941006c0 msgr2=0x7fb594102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:14.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 -- 10.20.193.28:0/40526659 shutdown_connections 2026-02-20T03:31:14.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:14.518+0000 7fb59b143640 1 -- 10.20.193.28:0/40526659 wait complete. 2026-02-20T03:31:14.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 27.50 MB/sec execute 45 sec latency 25186.415 ms 2026-02-20T03:31:14.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:14 trial126 ceph-mon[38476]: pgmap v682: 129 pgs: 129 active+clean; 700 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 604 KiB/s rd, 14 MiB/s wr, 389 op/s 2026-02-20T03:31:14.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:14 trial177 ceph-mon[43181]: pgmap v682: 129 pgs: 129 active+clean; 700 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 604 KiB/s rd, 14 MiB/s wr, 389 op/s 2026-02-20T03:31:15.686 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:31:15.687 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:31:15.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 26.90 MB/sec execute 46 sec latency 26186.461 ms 2026-02-20T03:31:16.013 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:16.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.281+0000 7fc06d022640 1 -- 10.20.193.28:0/530138111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068077f40 msgr2=0x7fc0681132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:16.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.281+0000 7fc06d022640 1 --2- 10.20.193.28:0/530138111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068077f40 0x7fc0681132e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fc054009a30 tx=0x7fc05402f260 comp rx=0 tx=0).stop 2026-02-20T03:31:16.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.281+0000 7fc06d022640 1 -- 10.20.193.28:0/530138111 shutdown_connections 2026-02-20T03:31:16.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.281+0000 7fc06d022640 1 --2- 10.20.193.28:0/530138111 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc068113820 0x7fc068115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.281+0000 7fc06d022640 1 --2- 10.20.193.28:0/530138111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068077f40 0x7fc0681132e0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.281+0000 7fc06d022640 1 --2- 10.20.193.28:0/530138111 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc068077620 0x7fc068077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.281+0000 7fc06d022640 1 -- 10.20.193.28:0/530138111 >> 10.20.193.28:0/530138111 conn(0x7fc068100680 msgr2=0x7fc068102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:16.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.281+0000 7fc06d022640 1 -- 10.20.193.28:0/530138111 shutdown_connections 2026-02-20T03:31:16.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.281+0000 7fc06d022640 1 -- 10.20.193.28:0/530138111 wait complete. 2026-02-20T03:31:16.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06d022640 1 Processor -- start 2026-02-20T03:31:16.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06d022640 1 -- start start 2026-02-20T03:31:16.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06d022640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc068077620 0x7fc0681a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06d022640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc068077f40 0x7fc0681a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06d022640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068113820 0x7fc0681a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06d022640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc068119170 con 0x7fc068113820 2026-02-20T03:31:16.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06d022640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc068118ff0 con 0x7fc068077620 2026-02-20T03:31:16.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06d022640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc0681192f0 con 0x7fc068077f40 2026-02-20T03:31:16.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06c821640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068113820 0x7fc0681a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:16.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06c821640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068113820 0x7fc0681a5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49508/0 (socket says 10.20.193.28:49508) 2026-02-20T03:31:16.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06c821640 1 -- 10.20.193.28:0/2892987109 learned_addr learned my addr 10.20.193.28:0/2892987109 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:16.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06c821640 1 -- 10.20.193.28:0/2892987109 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc068077f40 msgr2=0x7fc0681a1b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:16.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06c821640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc068077f40 0x7fc0681a1b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06c821640 1 -- 10.20.193.28:0/2892987109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc068077620 msgr2=0x7fc0681a1650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:16.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06c821640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc068077620 0x7fc0681a1650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.286+0000 7fc06c821640 1 -- 10.20.193.28:0/2892987109 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0681a66a0 con 0x7fc068113820 2026-02-20T03:31:16.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.287+0000 7fc06c821640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068113820 0x7fc0681a5f20 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fc05800b750 tx=0x7fc05800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:16.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.288+0000 7fc0657fa640 1 -- 10.20.193.28:0/2892987109 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058004270 con 0x7fc068113820 2026-02-20T03:31:16.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.288+0000 7fc06d022640 1 -- 10.20.193.28:0/2892987109 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0681a6990 con 0x7fc068113820 2026-02-20T03:31:16.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.288+0000 7fc0657fa640 1 -- 10.20.193.28:0/2892987109 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc058010070 con 0x7fc068113820 2026-02-20T03:31:16.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.288+0000 7fc0657fa640 1 -- 10.20.193.28:0/2892987109 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058004270 con 0x7fc068113820 2026-02-20T03:31:16.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.288+0000 7fc06d022640 1 -- 10.20.193.28:0/2892987109 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0681ae1d0 con 0x7fc068113820 2026-02-20T03:31:16.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0657fa640 1 -- 10.20.193.28:0/2892987109 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc05801c020 con 0x7fc068113820 2026-02-20T03:31:16.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 Processor -- start 2026-02-20T03:31:16.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- start start 2026-02-20T03:31:16.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe66c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 0x555dbe670540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe670b60 0x555dbe670fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555dbe5bec00 con 0x555dbe66c0c0 2026-02-20T03:31:16.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555dbe56c3c0 con 0x555dbe670b60 2026-02-20T03:31:16.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555dbe5bab30 con 0x555dbe66ca70 2026-02-20T03:31:16.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe66c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:16.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe66c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49520/0 (socket says 10.20.193.28:49520) 2026-02-20T03:31:16.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0677fe640 1 -- 10.20.193.28:0/2244264445 learned_addr learned my addr 10.20.193.28:0/2244264445 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:16.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0657fa640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0400b0fa0 0x7fc0400b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0657fa640 1 -- 10.20.193.28:0/2892987109 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fc0580df1d0 con 0x7fc068113820 2026-02-20T03:31:16.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc06c821640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0400b0fa0 0x7fc0400b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:16.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0677fe640 1 -- 10.20.193.28:0/2244264445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 msgr2=0x555dbe670540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0677fe640 1 --2- 10.20.193.28:0/2244264445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 0x555dbe670540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0677fe640 1 -- 10.20.193.28:0/2244264445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe670b60 msgr2=0x555dbe670fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0677fe640 1 --2- 10.20.193.28:0/2244264445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe670b60 0x555dbe670fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0677fe640 1 -- 10.20.193.28:0/2244264445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbe565840 con 0x555dbe66c0c0 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0677fe640 1 --2- 10.20.193.28:0/2244264445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe66c4a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fc054009950 tx=0x7fc054038470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e6881f8e4d254c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc06c821640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0400b0fa0 0x7fc0400b3460 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc0580a6f50 tx=0x7fc058006a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc03cce3640 1 -- 10.20.193.28:0/2244264445 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054002c30 con 0x555dbe66c0c0 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc03cce3640 1 -- 10.20.193.28:0/2244264445 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc054033040 con 0x555dbe66c0c0 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc03cce3640 1 -- 10.20.193.28:0/2244264445 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054004320 con 0x555dbe66c0c0 2026-02-20T03:31:16.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2244264445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 msgr2=0x555dbe66c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:16.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2244264445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe66c4a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fc054009950 tx=0x7fc054038470 comp rx=0 tx=0).stop 2026-02-20T03:31:16.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2244264445 shutdown_connections 2026-02-20T03:31:16.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2244264445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe670b60 0x555dbe670fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2244264445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 0x555dbe670540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2244264445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe66c4a0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2244264445 >> 10.20.193.28:0/2244264445 conn(0x555dbe664b60 msgr2=0x555dbe66a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:16.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2244264445 shutdown_connections 2026-02-20T03:31:16.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2244264445 wait complete. 2026-02-20T03:31:16.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 -- start start 2026-02-20T03:31:16.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 Processor -- start 2026-02-20T03:31:16.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.293+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe6978d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe66ca70 0x555dbe697e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe670b60 0x555dbe696010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555dbe5661a0 con 0x555dbe66c0c0 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555dbe68a120 con 0x555dbe66ca70 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555dbe696790 con 0x555dbe670b60 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe6978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe6978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49522/0 (socket says 10.20.193.28:49522) 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0677fe640 1 -- 10.20.193.28:0/2833541802 learned_addr learned my addr 10.20.193.28:0/2833541802 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0677fe640 1 -- 10.20.193.28:0/2833541802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe670b60 msgr2=0x555dbe696010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:16.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0677fe640 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe670b60 0x555dbe696010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0677fe640 1 -- 10.20.193.28:0/2833541802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe66ca70 msgr2=0x555dbe697e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0677fe640 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe66ca70 0x555dbe697e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0677fe640 1 -- 10.20.193.28:0/2833541802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbe68f9f0 con 0x555dbe66c0c0 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0677fe640 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe6978d0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fc054002e60 tx=0x7fc054002e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527b082e4cc18425 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc029ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc029ffb640 1 -- 10.20.193.28:0/2833541802 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054050070 con 0x555dbe66c0c0 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc029ffb640 1 -- 10.20.193.28:0/2833541802 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc054004560 con 0x555dbe66c0c0 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc029ffb640 1 -- 10.20.193.28:0/2833541802 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054038d10 con 0x555dbe66c0c0 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2833541802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbe38db60 con 0x555dbe66c0c0 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 10 client.20028 _ll_register_callbacks cb 0x555dbe56a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:16.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2833541802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555dbe5c67f0 con 0x555dbe66c0c0 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc029ffb640 1 -- 10.20.193.28:0/2833541802 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fc05402fcd0 con 0x555dbe66c0c0 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc029ffb640 1 -- 10.20.193.28:0/2833541802 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc054038790 con 0x555dbe66c0c0 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 10 client.20028 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2833541802 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x555dbe58b430 con 0x555dbe66c0c0 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc029ffb640 1 -- 10.20.193.28:0/2833541802 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fc0540040c0 con 0x555dbe66c0c0 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 10 client.20028 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 10 client.20028 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 20 client.20028 populate_metadata read hostname 'trial028' 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555dbe6a5d60 0x555dbe6a8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 4 client.20028 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:16.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.298+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2833541802 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dbe540c00 con 0x555dbe6a5d60 2026-02-20T03:31:16.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.302+0000 7fc067fff640 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555dbe6a5d60 0x555dbe6a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:16.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.344+0000 7fc067fff640 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555dbe6a5d60 0x555dbe6a8150 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a781e659e58c87 server_cookie=60833efe0f2ddaaa in_seq=0 out_seq=0 2026-02-20T03:31:16.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.344+0000 7fc029ffb640 10 client.20028 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:16.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc029ffb640 1 -- 10.20.193.28:0/2833541802 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555dbe540c00 con 0x555dbe6a5d60 2026-02-20T03:31:16.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc029ffb640 10 client.20028 handle_command_reply: tid=0 2026-02-20T03:31:16.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 client.20028 shutdown 2026-02-20T03:31:16.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2833541802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 msgr2=0x555dbe6978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:16.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe6978d0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fc054002e60 tx=0x7fc054002e90 comp rx=0 tx=0).stop 2026-02-20T03:31:16.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2833541802 shutdown_connections 2026-02-20T03:31:16.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555dbe6a5d60 0x555dbe6a8150 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe670b60 0x555dbe696010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe66ca70 0x555dbe697e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/2833541802 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe6978d0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2833541802 >> 10.20.193.28:0/2833541802 conn(0x555dbe664b60 msgr2=0x555dbe66f520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:16.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc029ffb640 0 client.20028 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:16.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2833541802 shutdown_connections 2026-02-20T03:31:16.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 1 -- 10.20.193.28:0/2833541802 wait complete. 2026-02-20T03:31:16.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.358+0000 7fc0707b0e00 20 client.20028 trim_cache size 0 max 16384 2026-02-20T03:31:16.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0707b0e00 1 Processor -- start 2026-02-20T03:31:16.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0707b0e00 1 -- start start 2026-02-20T03:31:16.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe66c0c0 0x555dbe693a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 0x555dbe6ada10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe670b60 0x555dbe6adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c0126f0 con 0x555dbe670b60 2026-02-20T03:31:16.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00ff60 con 0x555dbe66c0c0 2026-02-20T03:31:16.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00ddb0 con 0x555dbe66ca70 2026-02-20T03:31:16.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe670b60 0x555dbe6adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:16.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe670b60 0x555dbe6adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49524/0 (socket says 10.20.193.28:49524) 2026-02-20T03:31:16.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.369+0000 7fc0677fe640 1 -- 10.20.193.28:0/3596671202 learned_addr learned my addr 10.20.193.28:0/3596671202 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:16.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc0677fe640 1 -- 10.20.193.28:0/3596671202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 msgr2=0x555dbe6ada10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc0677fe640 1 --2- 10.20.193.28:0/3596671202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 0x555dbe6ada10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc0677fe640 1 -- 10.20.193.28:0/3596671202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe66c0c0 msgr2=0x555dbe693a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc0677fe640 1 --2- 10.20.193.28:0/3596671202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe66c0c0 0x555dbe693a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc0677fe640 1 -- 10.20.193.28:0/3596671202 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbe68f820 con 0x555dbe670b60 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc0677fe640 1 --2- 10.20.193.28:0/3596671202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe670b60 0x555dbe6adf50 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fc054005810 tx=0x7fc05403a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbc94a76c9780c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc02bfff640 1 -- 10.20.193.28:0/3596671202 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054050040 con 0x555dbe670b60 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc02bfff640 1 -- 10.20.193.28:0/3596671202 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x555dbe5c67f0 con 0x555dbe670b60 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc02bfff640 1 -- 10.20.193.28:0/3596671202 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05402fda0 con 0x555dbe670b60 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3596671202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe670b60 msgr2=0x555dbe6adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:16.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.370+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3596671202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe670b60 0x555dbe6adf50 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fc054005810 tx=0x7fc05403a030 comp rx=0 tx=0).stop 2026-02-20T03:31:16.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.371+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3596671202 shutdown_connections 2026-02-20T03:31:16.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.371+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3596671202 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe670b60 0x555dbe6adf50 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.371+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3596671202 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 0x555dbe6ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.371+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3596671202 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe66c0c0 0x555dbe693a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.371+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3596671202 >> 10.20.193.28:0/3596671202 conn(0x555dbe664b60 msgr2=0x555dbe671d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:16.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.371+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3596671202 shutdown_connections 2026-02-20T03:31:16.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.371+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3596671202 wait complete. 2026-02-20T03:31:16.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.371+0000 7fc0707b0e00 1 -- start start 2026-02-20T03:31:16.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.371+0000 7fc0707b0e00 1 Processor -- start 2026-02-20T03:31:16.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe70a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 0x555dbe70a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe670b60 0x555dbe69d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00e420 con 0x555dbe66c0c0 2026-02-20T03:31:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00f890 con 0x555dbe670b60 2026-02-20T03:31:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc00c00eaf0 con 0x555dbe66ca70 2026-02-20T03:31:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe70a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe70a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49540/0 (socket says 10.20.193.28:49540) 2026-02-20T03:31:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0677fe640 1 -- 10.20.193.28:0/3532976205 learned_addr learned my addr 10.20.193.28:0/3532976205 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:16.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0677fe640 1 -- 10.20.193.28:0/3532976205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 msgr2=0x555dbe70a850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0677fe640 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 0x555dbe70a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0677fe640 1 -- 10.20.193.28:0/3532976205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe670b60 msgr2=0x555dbe69d3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0677fe640 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe670b60 0x555dbe69d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0677fe640 1 -- 10.20.193.28:0/3532976205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbe29d900 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc029ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0677fe640 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe70a310 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fc05402ff00 tx=0x7fc054005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49eeb60f062b9fc5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc029ffb640 1 -- 10.20.193.28:0/3532976205 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054050040 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3532976205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbe5794d0 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 10 client.20034 _ll_register_callbacks cb 0x7fc0540385d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3532976205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc054033040 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc029ffb640 1 -- 10.20.193.28:0/3532976205 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc054038dd0 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc029ffb640 1 -- 10.20.193.28:0/3532976205 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054050040 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc029ffb640 1 -- 10.20.193.28:0/3532976205 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fc05404bc10 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc029ffb640 1 -- 10.20.193.28:0/3532976205 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc054066050 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 10 client.20034 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.372+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3532976205 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x555dbe690510 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.378+0000 7fc029ffb640 1 -- 10.20.193.28:0/3532976205 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fc05405c070 con 0x555dbe66c0c0 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.378+0000 7fc0707b0e00 10 client.20034 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.378+0000 7fc0707b0e00 10 client.20034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.378+0000 7fc0707b0e00 20 client.20034 populate_metadata read hostname 'trial028' 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.378+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555dbe7126e0 0x555dbe714ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:16.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.378+0000 7fc0707b0e00 4 client.20034 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:31:16.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.378+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3532976205 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555dbe32ea20 con 0x555dbe7126e0 2026-02-20T03:31:16.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.386+0000 7fc067fff640 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555dbe7126e0 0x555dbe714ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:16.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.428+0000 7fc067fff640 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555dbe7126e0 0x555dbe714ba0 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7be929a021eee5d server_cookie=7fdd2aa1a2c1043b in_seq=0 out_seq=0 2026-02-20T03:31:16.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.428+0000 7fc029ffb640 10 client.20034 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:16.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc029ffb640 1 -- 10.20.193.28:0/3532976205 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555dbe32ea20 con 0x555dbe7126e0 2026-02-20T03:31:16.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc029ffb640 10 client.20034 handle_command_reply: tid=0 2026-02-20T03:31:16.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 client.20034 shutdown 2026-02-20T03:31:16.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3532976205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 msgr2=0x555dbe70a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:16.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe70a310 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fc05402ff00 tx=0x7fc054005fb0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3532976205 shutdown_connections 2026-02-20T03:31:16.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555dbe7126e0 0x555dbe714ba0 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555dbe670b60 0x555dbe69d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555dbe66ca70 0x555dbe70a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 --2- 10.20.193.28:0/3532976205 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555dbe66c0c0 0x555dbe70a310 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc029ffb640 0 client.20034 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:16.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3532976205 >> 10.20.193.28:0/3532976205 conn(0x555dbe664b60 msgr2=0x555dbe66f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:16.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3532976205 shutdown_connections 2026-02-20T03:31:16.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 1 -- 10.20.193.28:0/3532976205 wait complete. 2026-02-20T03:31:16.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc0707b0e00 20 client.20034 trim_cache size 0 max 16384 2026-02-20T03:31:16.447 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:16.448 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:31:16.448 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "dd166da8-efb7-49ea-bf50-78b2bb1d1f46", 2026-02-20T03:31:16.448 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:31:16.448 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:16.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 -- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0400b0fa0 msgr2=0x7fc0400b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:16.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0400b0fa0 0x7fc0400b3460 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fc0580a6f50 tx=0x7fc058006a80 comp rx=0 tx=0).stop 2026-02-20T03:31:16.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 -- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068113820 msgr2=0x7fc0681a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:16.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068113820 0x7fc0681a5f20 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fc05800b750 tx=0x7fc05800bc20 comp rx=0 tx=0).stop 2026-02-20T03:31:16.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 -- 10.20.193.28:0/2892987109 shutdown_connections 2026-02-20T03:31:16.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0400b0fa0 0x7fc0400b3460 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc068113820 0x7fc0681a5f20 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc068077f40 0x7fc0681a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 --2- 10.20.193.28:0/2892987109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc068077620 0x7fc0681a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:16.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 -- 10.20.193.28:0/2892987109 >> 10.20.193.28:0/2892987109 conn(0x7fc068100680 msgr2=0x7fc068114ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:16.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 -- 10.20.193.28:0/2892987109 shutdown_connections 2026-02-20T03:31:16.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:16.442+0000 7fc06d022640 1 -- 10.20.193.28:0/2892987109 wait complete. 2026-02-20T03:31:16.605 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:31:16.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 26.33 MB/sec execute 47 sec latency 27186.504 ms 2026-02-20T03:31:16.952 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:17.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- 10.20.193.28:0/3740684144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0208108700 msgr2=0x7f0208108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:17.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 --2- 10.20.193.28:0/3740684144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0208108700 0x7f0208108ae0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f01f8009a60 tx=0x7f01f802f290 comp rx=0 tx=0).stop 2026-02-20T03:31:17.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- 10.20.193.28:0/3740684144 shutdown_connections 2026-02-20T03:31:17.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 --2- 10.20.193.28:0/3740684144 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f02081030a0 0x7f020810f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 --2- 10.20.193.28:0/3740684144 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0208102700 0x7f0208102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 --2- 10.20.193.28:0/3740684144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0208108700 0x7f0208108ae0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- 10.20.193.28:0/3740684144 >> 10.20.193.28:0/3740684144 conn(0x7f02080fe440 msgr2=0x7f0208100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:17.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- 10.20.193.28:0/3740684144 shutdown_connections 2026-02-20T03:31:17.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- 10.20.193.28:0/3740684144 wait complete. 2026-02-20T03:31:17.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 Processor -- start 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- start start 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0208102700 0x7f020819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02081030a0 0x7f020819d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0208108700 0x7f02081a1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0208112a50 con 0x7f02081030a0 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f02081128d0 con 0x7f0208102700 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0208112bd0 con 0x7f0208108700 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02081030a0 0x7f020819d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02081030a0 0x7f020819d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49562/0 (socket says 10.20.193.28:49562) 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fffff640 1 -- 10.20.193.28:0/1647736104 learned_addr learned my addr 10.20.193.28:0/1647736104 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:17.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fffff640 1 -- 10.20.193.28:0/1647736104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0208108700 msgr2=0x7f02081a1ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:17.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fffff640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0208108700 0x7f02081a1ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fffff640 1 -- 10.20.193.28:0/1647736104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0208102700 msgr2=0x7f020819d1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:17.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fffff640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0208102700 0x7f020819d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fffff640 1 -- 10.20.193.28:0/1647736104 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02081a2240 con 0x7f02081030a0 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fffff640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02081030a0 0x7f020819d730 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b570 tx=0x7f01f000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fdffb640 1 -- 10.20.193.28:0/1647736104 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0013020 con 0x7f02081030a0 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fdffb640 1 -- 10.20.193.28:0/1647736104 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f01f0004480 con 0x7f02081030a0 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- 10.20.193.28:0/1647736104 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02081a2530 con 0x7f02081030a0 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f020db64640 1 -- 10.20.193.28:0/1647736104 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02081a9d70 con 0x7f02081030a0 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.200+0000 7f01fdffb640 1 -- 10.20.193.28:0/1647736104 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f000fb30 con 0x7f02081030a0 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f01fdffb640 1 -- 10.20.193.28:0/1647736104 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f01f0002780 con 0x7f02081030a0 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f02112f2e00 1 Processor -- start 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f02112f2e00 1 -- start start 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b5a10 0x55e3160b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b0040 0x55e3160b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f01fdffb640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01e40b0e20 0x7f01e40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b09c0 0x55e3160bc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f02112f2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e316027e50 con 0x55e3160b0040 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f02112f2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e315ffa9c0 con 0x55e3160b09c0 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f02112f2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e315fa8240 con 0x55e3160b5a10 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f01fdffb640 1 -- 10.20.193.28:0/1647736104 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f01f00e0590 con 0x7f02081030a0 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f01fffff640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01e40b0e20 0x7f01e40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f020cb62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b0040 0x55e3160b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f020cb62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b0040 0x55e3160b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49572/0 (socket says 10.20.193.28:49572) 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f020cb62640 1 -- 10.20.193.28:0/1382580226 learned_addr learned my addr 10.20.193.28:0/1382580226 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f020cb62640 1 -- 10.20.193.28:0/1382580226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b5a10 msgr2=0x55e3160b5df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:17.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f020cb62640 1 --2- 10.20.193.28:0/1382580226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b5a10 0x55e3160b5df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f020cb62640 1 -- 10.20.193.28:0/1382580226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b09c0 msgr2=0x55e3160bc840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f020cb62640 1 --2- 10.20.193.28:0/1382580226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b09c0 0x55e3160bc840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f020cb62640 1 -- 10.20.193.28:0/1382580226 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e315fbb420 con 0x55e3160b0040 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f01fffff640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01e40b0e20 0x7f01e40b32e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f01f00a7f70 tx=0x7f01f00047e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f020cb62640 1 --2- 10.20.193.28:0/1382580226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b0040 0x55e3160b0480 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f01f8005880 tx=0x7f01f8038470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e974a47eabe809ab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f01d54e4640 1 -- 10.20.193.28:0/1382580226 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8002c00 con 0x55e3160b0040 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f01d54e4640 1 -- 10.20.193.28:0/1382580226 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f01f8033040 con 0x55e3160b0040 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.205+0000 7f01d54e4640 1 -- 10.20.193.28:0/1382580226 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8004320 con 0x55e3160b0040 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.208+0000 7f02112f2e00 1 -- 10.20.193.28:0/1382580226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b0040 msgr2=0x55e3160b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.208+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1382580226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b0040 0x55e3160b0480 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f01f8005880 tx=0x7f01f8038470 comp rx=0 tx=0).stop 2026-02-20T03:31:17.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.208+0000 7f02112f2e00 1 -- 10.20.193.28:0/1382580226 shutdown_connections 2026-02-20T03:31:17.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.208+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1382580226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b09c0 0x55e3160bc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.208+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1382580226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b0040 0x55e3160b0480 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.208+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1382580226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b5a10 0x55e3160b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.208+0000 7f02112f2e00 1 -- 10.20.193.28:0/1382580226 >> 10.20.193.28:0/1382580226 conn(0x55e31606a290 msgr2=0x55e3160a5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.208+0000 7f02112f2e00 1 -- 10.20.193.28:0/1382580226 shutdown_connections 2026-02-20T03:31:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 -- 10.20.193.28:0/1382580226 wait complete. 2026-02-20T03:31:17.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 -- start start 2026-02-20T03:31:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 Processor -- start 2026-02-20T03:31:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b0040 0x55e3160ca270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b5a10 0x55e3160c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e315ff68f0 con 0x55e3160b09c0 2026-02-20T03:31:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e315de8f50 con 0x55e3160b5a10 2026-02-20T03:31:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e3160c9060 con 0x55e3160b0040 2026-02-20T03:31:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f020cb62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:17.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f020cb62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49574/0 (socket says 10.20.193.28:49574) 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f020cb62640 1 -- 10.20.193.28:0/1178404485 learned_addr learned my addr 10.20.193.28:0/1178404485 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f020cb62640 1 -- 10.20.193.28:0/1178404485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b0040 msgr2=0x55e3160ca270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f020cb62640 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b0040 0x55e3160ca270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f020cb62640 1 -- 10.20.193.28:0/1178404485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b5a10 msgr2=0x55e3160c8a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f020cb62640 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b5a10 0x55e3160c8a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f020cb62640 1 -- 10.20.193.28:0/1178404485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3160c24e0 con 0x55e3160b09c0 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f020cb62640 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160ca7b0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f01f80097c0 tx=0x7f01f8009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c13fa68d6ea7bce server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f01c67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f01c67fc640 1 -- 10.20.193.28:0/1178404485 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f80042d0 con 0x55e3160b09c0 2026-02-20T03:31:17.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f01c67fc640 1 -- 10.20.193.28:0/1178404485 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f01f8046070 con 0x55e3160b09c0 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f01c67fc640 1 -- 10.20.193.28:0/1178404485 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f804b6b0 con 0x55e3160b09c0 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 -- 10.20.193.28:0/1178404485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e315dcbb40 con 0x55e3160b09c0 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 10 client.20046 _ll_register_callbacks cb 0x55e316033f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 -- 10.20.193.28:0/1178404485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e3160081a0 con 0x55e3160b09c0 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f01c67fc640 1 -- 10.20.193.28:0/1178404485 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f01f804b850 con 0x55e3160b09c0 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f01c67fc640 1 -- 10.20.193.28:0/1178404485 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f01f804baf0 con 0x55e3160b09c0 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 10 client.20046 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 -- 10.20.193.28:0/1178404485 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55e315fb5230 con 0x55e3160b09c0 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f01c67fc640 1 -- 10.20.193.28:0/1178404485 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f01f8053030 con 0x55e3160b09c0 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 10 client.20046 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 10 client.20046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 20 client.20046 populate_metadata read hostname 'trial028' 2026-02-20T03:31:17.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e3160d8710 0x55e3160dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 4 client.20046 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:17.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.209+0000 7f02112f2e00 1 -- 10.20.193.28:0/1178404485 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3160025b0 con 0x55e3160d8710 2026-02-20T03:31:17.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.236+0000 7f020d363640 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e3160d8710 0x55e3160dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:17.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.264+0000 7f020d363640 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e3160d8710 0x55e3160dab00 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59fab5004d18f68a server_cookie=467da51e2bd16393 in_seq=0 out_seq=0 2026-02-20T03:31:17.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.264+0000 7f01c67fc640 10 client.20046 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:17.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f01c67fc640 1 -- 10.20.193.28:0/1178404485 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e3160025b0 con 0x55e3160d8710 2026-02-20T03:31:17.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f01c67fc640 10 client.20046 handle_command_reply: tid=0 2026-02-20T03:31:17.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 client.20046 shutdown 2026-02-20T03:31:17.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 -- 10.20.193.28:0/1178404485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 msgr2=0x55e3160ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:17.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160ca7b0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f01f80097c0 tx=0x7f01f8009340 comp rx=0 tx=0).stop 2026-02-20T03:31:17.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 -- 10.20.193.28:0/1178404485 shutdown_connections 2026-02-20T03:31:17.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e3160d8710 0x55e3160dab00 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b5a10 0x55e3160c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160ca7b0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 --2- 10.20.193.28:0/1178404485 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b0040 0x55e3160ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 -- 10.20.193.28:0/1178404485 >> 10.20.193.28:0/1178404485 conn(0x55e31606a290 msgr2=0x55e3160a6440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f01c67fc640 0 client.20046 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 -- 10.20.193.28:0/1178404485 shutdown_connections 2026-02-20T03:31:17.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 1 -- 10.20.193.28:0/1178404485 wait complete. 2026-02-20T03:31:17.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.278+0000 7f02112f2e00 20 client.20046 trim_cache size 0 max 16384 2026-02-20T03:31:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 Processor -- start 2026-02-20T03:31:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- start start 2026-02-20T03:31:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b0040 0x55e31609fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b09c0 0x55e3160a6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b5a10 0x55e3160a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac0127d0 con 0x55e3160b5a10 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac010040 con 0x55e3160b0040 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac00de90 con 0x55e3160b09c0 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020d363640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b5a10 0x55e3160a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020d363640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b5a10 0x55e3160a6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49586/0 (socket says 10.20.193.28:49586) 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020d363640 1 -- 10.20.193.28:0/542966887 learned_addr learned my addr 10.20.193.28:0/542966887 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020d363640 1 -- 10.20.193.28:0/542966887 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b09c0 msgr2=0x55e3160a6520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020d363640 1 --2- 10.20.193.28:0/542966887 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b09c0 0x55e3160a6520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020d363640 1 -- 10.20.193.28:0/542966887 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b0040 msgr2=0x55e31609fd50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:17.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020d363640 1 --2- 10.20.193.28:0/542966887 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b0040 0x55e31609fd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020d363640 1 -- 10.20.193.28:0/542966887 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3160c2310 con 0x55e3160b5a10 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020d363640 1 --2- 10.20.193.28:0/542966887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b5a10 0x55e3160a6a60 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f020400ace0 tx=0x7f0204004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c43411a95fbb46 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f01d4ce3640 1 -- 10.20.193.28:0/542966887 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0204019030 con 0x55e3160b5a10 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f01d4ce3640 1 -- 10.20.193.28:0/542966887 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f020400ade0 con 0x55e3160b5a10 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f01d4ce3640 1 -- 10.20.193.28:0/542966887 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020401d740 con 0x55e3160b5a10 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- 10.20.193.28:0/542966887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b5a10 msgr2=0x55e3160a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- 10.20.193.28:0/542966887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b5a10 0x55e3160a6a60 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f020400ace0 tx=0x7f0204004c80 comp rx=0 tx=0).stop 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- 10.20.193.28:0/542966887 shutdown_connections 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- 10.20.193.28:0/542966887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b5a10 0x55e3160a6a60 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- 10.20.193.28:0/542966887 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b09c0 0x55e3160a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- 10.20.193.28:0/542966887 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b0040 0x55e31609fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- 10.20.193.28:0/542966887 >> 10.20.193.28:0/542966887 conn(0x55e31606a290 msgr2=0x55e3160c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:17.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- 10.20.193.28:0/542966887 shutdown_connections 2026-02-20T03:31:17.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- 10.20.193.28:0/542966887 wait complete. 2026-02-20T03:31:17.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- start start 2026-02-20T03:31:17.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 Processor -- start 2026-02-20T03:31:17.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b0040 0x55e3160cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b5a10 0x55e31613d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac00e500 con 0x55e3160b09c0 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac00f970 con 0x55e3160b0040 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f02112f2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01ac00ebd0 con 0x55e3160b5a10 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020cb62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020cb62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49590/0 (socket says 10.20.193.28:49590) 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020cb62640 1 -- 10.20.193.28:0/3849195435 learned_addr learned my addr 10.20.193.28:0/3849195435 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020cb62640 1 -- 10.20.193.28:0/3849195435 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b5a10 msgr2=0x55e31613d530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020cb62640 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b5a10 0x55e31613d530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020cb62640 1 -- 10.20.193.28:0/3849195435 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b0040 msgr2=0x55e3160cd8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:17.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020cb62640 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b0040 0x55e3160cd8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020cb62640 1 -- 10.20.193.28:0/3849195435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e315cd9870 con 0x55e3160b09c0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f020cb62640 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160cde00 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f01f8042440 tx=0x7f01f80044e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6178591dc2658740 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.287+0000 7f01c67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.291+0000 7f01c67fc640 1 -- 10.20.193.28:0/3849195435 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f802fdc0 con 0x55e3160b09c0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.291+0000 7f01c67fc640 1 -- 10.20.193.28:0/3849195435 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f01f8046040 con 0x55e3160b09c0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.291+0000 7f01c67fc640 1 -- 10.20.193.28:0/3849195435 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f802f7f0 con 0x55e3160b09c0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.291+0000 7f02112f2e00 1 -- 10.20.193.28:0/3849195435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e315f9a440 con 0x55e3160b09c0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.291+0000 7f02112f2e00 10 client.20052 _ll_register_callbacks cb 0x7f01f80057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.291+0000 7f02112f2e00 1 -- 10.20.193.28:0/3849195435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e315fcb810 con 0x55e3160b09c0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.291+0000 7f01c67fc640 1 -- 10.20.193.28:0/3849195435 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f01f8053390 con 0x55e3160b09c0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f01c67fc640 1 -- 10.20.193.28:0/3849195435 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f01f8053590 con 0x55e3160b09c0 2026-02-20T03:31:17.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f02112f2e00 10 client.20052 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:17.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f02112f2e00 1 -- 10.20.193.28:0/3849195435 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55e3160c3000 con 0x55e3160b09c0 2026-02-20T03:31:17.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f01c67fc640 1 -- 10.20.193.28:0/3849195435 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f01f8053070 con 0x55e3160b09c0 2026-02-20T03:31:17.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f02112f2e00 10 client.20052 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:17.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f02112f2e00 10 client.20052 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:17.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f02112f2e00 20 client.20052 populate_metadata read hostname 'trial028' 2026-02-20T03:31:17.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f02112f2e00 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e316144e70 0x55e316147330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:17.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f02112f2e00 4 client.20052 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:31:17.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.292+0000 7f02112f2e00 1 -- 10.20.193.28:0/3849195435 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e315facb00 con 0x55e316144e70 2026-02-20T03:31:17.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.305+0000 7f020d363640 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e316144e70 0x55e316147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:17.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.347+0000 7f020d363640 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e316144e70 0x55e316147330 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7957b9eef782d0cc server_cookie=aa95dac57e4709c2 in_seq=0 out_seq=0 2026-02-20T03:31:17.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.347+0000 7f01c67fc640 10 client.20052 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.360+0000 7f01c67fc640 1 -- 10.20.193.28:0/3849195435 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e315facb00 con 0x55e316144e70 2026-02-20T03:31:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.360+0000 7f01c67fc640 10 client.20052 handle_command_reply: tid=0 2026-02-20T03:31:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 client.20052 shutdown 2026-02-20T03:31:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 -- 10.20.193.28:0/3849195435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 msgr2=0x55e3160cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160cde00 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f01f8042440 tx=0x7f01f80044e0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 -- 10.20.193.28:0/3849195435 shutdown_connections 2026-02-20T03:31:17.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e316144e70 0x55e316147330 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e3160b5a10 0x55e31613d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e3160b09c0 0x55e3160cde00 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 --2- 10.20.193.28:0/3849195435 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e3160b0040 0x55e3160cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 -- 10.20.193.28:0/3849195435 >> 10.20.193.28:0/3849195435 conn(0x55e31606a290 msgr2=0x55e3160b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:17.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f01c67fc640 0 client.20052 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:17.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 -- 10.20.193.28:0/3849195435 shutdown_connections 2026-02-20T03:31:17.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 1 -- 10.20.193.28:0/3849195435 wait complete. 2026-02-20T03:31:17.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f02112f2e00 20 client.20052 trim_cache size 0 max 16384 2026-02-20T03:31:17.377 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:17.377 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:31:17.377 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:31:17.377 INFO:teuthology.orchestra.run.trial028.stdout: "dd166da8-efb7-49ea-bf50-78b2bb1d1f46": { 2026-02-20T03:31:17.377 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:31:17.377 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "dd166da8-efb7-49ea-bf50-78b2bb1d1f46", 2026-02-20T03:31:17.377 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:31:17.377 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:31:17.377 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:31:17.378 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:17.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 -- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01e40b0e20 msgr2=0x7f01e40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:17.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01e40b0e20 0x7f01e40b32e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f01f00a7f70 tx=0x7f01f00047e0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 -- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02081030a0 msgr2=0x7f020819d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:17.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02081030a0 0x7f020819d730 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b570 tx=0x7f01f000ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:17.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 -- 10.20.193.28:0/1647736104 shutdown_connections 2026-02-20T03:31:17.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01e40b0e20 0x7f01e40b32e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0208108700 0x7f02081a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f02081030a0 0x7f020819d730 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 --2- 10.20.193.28:0/1647736104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0208102700 0x7f020819d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:17.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 -- 10.20.193.28:0/1647736104 >> 10.20.193.28:0/1647736104 conn(0x7f02080fe440 msgr2=0x7f020810df10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:17.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 -- 10.20.193.28:0/1647736104 shutdown_connections 2026-02-20T03:31:17.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:17.361+0000 7f020db64640 1 -- 10.20.193.28:0/1647736104 wait complete. 2026-02-20T03:31:17.480 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:17 trial028 ceph-mon[38552]: pgmap v683: 129 pgs: 129 active+clean; 675 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 556 KiB/s rd, 13 MiB/s wr, 431 op/s 2026-02-20T03:31:17.481 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:17 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:31:17.481 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:17 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:17.481 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:17 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:31:17.481 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:17 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:31:17.481 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:17 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:31:17.481 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:17 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:17.512 INFO:tasks.cephfs.filesystem:scrub status for tag:dd166da8-efb7-49ea-bf50-78b2bb1d1f46 - {'path': '/', 'tag': 'dd166da8-efb7-49ea-bf50-78b2bb1d1f46', 'options': 'recursive,force'} 2026-02-20T03:31:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:17 trial126 ceph-mon[38476]: pgmap v683: 129 pgs: 129 active+clean; 675 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 556 KiB/s rd, 13 MiB/s wr, 431 op/s 2026-02-20T03:31:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:17 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:31:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:17 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:17 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:31:17.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:17 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:31:17.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:17 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:31:17.596 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:17 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:17.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 25.78 MB/sec execute 48 sec latency 28187.110 ms 2026-02-20T03:31:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:17 trial177 ceph-mon[43181]: pgmap v683: 129 pgs: 129 active+clean; 675 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 556 KiB/s rd, 13 MiB/s wr, 431 op/s 2026-02-20T03:31:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:17 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:31:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:17 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:17 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:31:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:17 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:31:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:17 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:31:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:17 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:18.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:18 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:18.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:18 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:18.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:18 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:18.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:18 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:18.701 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 25.25 MB/sec execute 49 sec latency 29187.150 ms 2026-02-20T03:31:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:18 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:18 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:19.400 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:19 trial028 ceph-mon[38552]: pgmap v684: 129 pgs: 129 active+clean; 653 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 649 KiB/s rd, 11 MiB/s wr, 512 op/s 2026-02-20T03:31:19.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:19 trial126 ceph-mon[38476]: pgmap v684: 129 pgs: 129 active+clean; 653 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 649 KiB/s rd, 11 MiB/s wr, 512 op/s 2026-02-20T03:31:19.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 24.75 MB/sec execute 50 sec latency 30187.205 ms 2026-02-20T03:31:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:19 trial177 ceph-mon[43181]: pgmap v684: 129 pgs: 129 active+clean; 653 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 649 KiB/s rd, 11 MiB/s wr, 512 op/s 2026-02-20T03:31:19.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- 10.20.193.28:0/3974650605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 msgr2=0x7fade010aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:19.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 --2- 10.20.193.28:0/3974650605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 0x7fade010aaf0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fadd400b0a0 tx=0x7fadd402f450 comp rx=0 tx=0).stop 2026-02-20T03:31:19.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- 10.20.193.28:0/3974650605 shutdown_connections 2026-02-20T03:31:19.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 --2- 10.20.193.28:0/3974650605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 0x7fade010aaf0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 --2- 10.20.193.28:0/3974650605 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fade01038a0 0x7fade0103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 --2- 10.20.193.28:0/3974650605 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fade01026b0 0x7fade0102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- 10.20.193.28:0/3974650605 >> 10.20.193.28:0/3974650605 conn(0x7fade00fde10 msgr2=0x7fade0100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:19.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- 10.20.193.28:0/3974650605 shutdown_connections 2026-02-20T03:31:19.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- 10.20.193.28:0/3974650605 wait complete. 2026-02-20T03:31:19.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 Processor -- start 2026-02-20T03:31:19.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- start start 2026-02-20T03:31:19.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fade01026b0 0x7fade019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fade01038a0 0x7fade019add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 0x7fade01a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fade010e270 con 0x7fade0104260 2026-02-20T03:31:19.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fade010e0f0 con 0x7fade01038a0 2026-02-20T03:31:19.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fade010e3f0 con 0x7fade01026b0 2026-02-20T03:31:19.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade6ea2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 0x7fade01a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:19.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade6ea2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 0x7fade01a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49604/0 (socket says 10.20.193.28:49604) 2026-02-20T03:31:19.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade6ea2640 1 -- 10.20.193.28:0/3729948841 learned_addr learned my addr 10.20.193.28:0/3729948841 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade6ea2640 1 -- 10.20.193.28:0/3729948841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fade01026b0 msgr2=0x7fade019a890 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade6ea2640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fade01026b0 0x7fade019a890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade6ea2640 1 -- 10.20.193.28:0/3729948841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fade01038a0 msgr2=0x7fade019add0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade6ea2640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fade01038a0 0x7fade019add0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade6ea2640 1 -- 10.20.193.28:0/3729948841 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade01a2540 con 0x7fade0104260 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade6ea2640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 0x7fade01a1e40 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fadd400b1d0 tx=0x7fadd40043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fadcb7fe640 1 -- 10.20.193.28:0/3729948841 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4004d40 con 0x7fade0104260 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fadcb7fe640 1 -- 10.20.193.28:0/3729948841 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fadd40078c0 con 0x7fade0104260 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fadcb7fe640 1 -- 10.20.193.28:0/3729948841 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd40387a0 con 0x7fade0104260 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- 10.20.193.28:0/3729948841 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade01a27d0 con 0x7fade0104260 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.776+0000 7fade76a3640 1 -- 10.20.193.28:0/3729948841 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade01a2cf0 con 0x7fade0104260 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fadcb7fe640 1 -- 10.20.193.28:0/3729948841 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fadd4007a70 con 0x7fade0104260 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fadeb862e00 1 Processor -- start 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fadeb862e00 1 -- start start 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713b8a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 0x55c713b8f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713b91f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fadeb862e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c713ad68f0 con 0x55c713b8a390 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fadeb862e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c713a842e0 con 0x55c713b8acd0 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fadeb862e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c713ad2820 con 0x55c713b8fa70 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fade5ea0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713b8a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fade5ea0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713b8a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49620/0 (socket says 10.20.193.28:49620) 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.782+0000 7fade5ea0640 1 -- 10.20.193.28:0/1791780970 learned_addr learned my addr 10.20.193.28:0/1791780970 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 -- 10.20.193.28:0/1791780970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 msgr2=0x55c713b91f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:19.790 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 --2- 10.20.193.28:0/1791780970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713b91f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 -- 10.20.193.28:0/1791780970 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 msgr2=0x55c713b8f450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 --2- 10.20.193.28:0/1791780970 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 0x55c713b8f450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 -- 10.20.193.28:0/1791780970 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c713a765a0 con 0x55c713b8a390 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 --2- 10.20.193.28:0/1791780970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713b8a790 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0098a0 tx=0x7fadcc009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b55c9608cfdc1b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadc8bfe640 1 -- 10.20.193.28:0/1791780970 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc016070 con 0x55c713b8a390 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadc8bfe640 1 -- 10.20.193.28:0/1791780970 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fadcc00b8d0 con 0x55c713b8a390 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadc8bfe640 1 -- 10.20.193.28:0/1791780970 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc002e30 con 0x55c713b8a390 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadcb7fe640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fadbc0b0e20 0x7fadbc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadcb7fe640 1 -- 10.20.193.28:0/3729948841 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fadd4105830 con 0x7fade0104260 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- 10.20.193.28:0/1791780970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 msgr2=0x55c713b8a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 --2- 10.20.193.28:0/1791780970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713b8a790 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0098a0 tx=0x7fadcc009d70 comp rx=0 tx=0).stop 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade66a1640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fadbc0b0e20 0x7fadbc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- 10.20.193.28:0/1791780970 shutdown_connections 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 --2- 10.20.193.28:0/1791780970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713b91f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 --2- 10.20.193.28:0/1791780970 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 0x55c713b8f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 --2- 10.20.193.28:0/1791780970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713b8a790 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- 10.20.193.28:0/1791780970 >> 10.20.193.28:0/1791780970 conn(0x55c713b7d6f0 msgr2=0x55c713b88a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- 10.20.193.28:0/1791780970 shutdown_connections 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- 10.20.193.28:0/1791780970 wait complete. 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- start start 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade66a1640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fadbc0b0e20 0x7fadbc0b32e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55c713b8b3c0 tx=0x7fadd8006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 Processor -- start 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8a390 0x55c713ba2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8acd0 0x55c713ba3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713baa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c713a7e0c0 con 0x55c713b8acd0 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c713b92b20 con 0x55c713b8a390 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c713baaa20 con 0x55c713b8fa70 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8acd0 0x55c713ba3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8acd0 0x55c713ba3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49632/0 (socket says 10.20.193.28:49632) 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 -- 10.20.193.28:0/3974008504 learned_addr learned my addr 10.20.193.28:0/3974008504 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 -- 10.20.193.28:0/3974008504 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 msgr2=0x55c713baa490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713baa490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 -- 10.20.193.28:0/3974008504 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8a390 msgr2=0x55c713ba2fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8a390 0x55c713ba2fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.791 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 -- 10.20.193.28:0/3974008504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c713b9c720 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fade5ea0640 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8acd0 0x55c713ba3510 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009630 tx=0x7fadcc009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49daffa06a1e5840 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fad93fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fad93fff640 1 -- 10.20.193.28:0/3974008504 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc016050 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fad93fff640 1 -- 10.20.193.28:0/3974008504 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fadcc017040 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fad93fff640 1 -- 10.20.193.28:0/3974008504 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadcc01be00 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- 10.20.193.28:0/3974008504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c713a92820 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fad93fff640 1 -- 10.20.193.28:0/3974008504 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fadcc024400 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fad93fff640 10 client.20064 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 10 client.20064 _ll_register_callbacks cb 0x55c713a81ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- 10.20.193.28:0/3974008504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c713ade4e0 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fad93fff640 1 -- 10.20.193.28:0/3974008504 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fadcc01b440 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 10 client.20064 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- 10.20.193.28:0/3974008504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55c713a97380 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fad93fff640 1 -- 10.20.193.28:0/3974008504 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fadcc0042d0 con 0x55c713b8acd0 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 10 client.20064 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 10 client.20064 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 20 client.20064 populate_metadata read hostname 'trial028' 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c713baeae0 0x55c713bb0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 4 client.20064 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:19.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.784+0000 7fadeb862e00 1 -- 10.20.193.28:0/3974008504 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c713a58bd0 con 0x55c713baeae0 2026-02-20T03:31:19.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.811+0000 7fade66a1640 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c713baeae0 0x55c713bb0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:19.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.878+0000 7fade66a1640 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c713baeae0 0x55c713bb0f80 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96d4fc8796ccbbed server_cookie=bef583795541feb0 in_seq=0 out_seq=0 2026-02-20T03:31:19.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.878+0000 7fad93fff640 10 client.20064 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:19.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.904+0000 7fad93fff640 1 -- 10.20.193.28:0/3974008504 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c713a58bd0 con 0x55c713baeae0 2026-02-20T03:31:19.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.904+0000 7fad93fff640 10 client.20064 handle_command_reply: tid=0 2026-02-20T03:31:19.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.904+0000 7fadeb862e00 1 client.20064 shutdown 2026-02-20T03:31:19.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.904+0000 7fadeb862e00 1 -- 10.20.193.28:0/3974008504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8acd0 msgr2=0x55c713ba3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:19.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.904+0000 7fadeb862e00 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8acd0 0x55c713ba3510 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009630 tx=0x7fadcc009660 comp rx=0 tx=0).stop 2026-02-20T03:31:19.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fadeb862e00 1 -- 10.20.193.28:0/3974008504 shutdown_connections 2026-02-20T03:31:19.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fadeb862e00 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c713baeae0 0x55c713bb0f80 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fadeb862e00 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713baa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fadeb862e00 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8acd0 0x55c713ba3510 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fadeb862e00 1 --2- 10.20.193.28:0/3974008504 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8a390 0x55c713ba2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fad93fff640 0 client.20064 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:19.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fadeb862e00 1 -- 10.20.193.28:0/3974008504 >> 10.20.193.28:0/3974008504 conn(0x55c713b7d6f0 msgr2=0x55c713b88a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:19.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fadeb862e00 1 -- 10.20.193.28:0/3974008504 shutdown_connections 2026-02-20T03:31:19.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fadeb862e00 1 -- 10.20.193.28:0/3974008504 wait complete. 2026-02-20T03:31:19.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.905+0000 7fadeb862e00 20 client.20064 trim_cache size 0 max 16384 2026-02-20T03:31:19.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fadeb862e00 1 Processor -- start 2026-02-20T03:31:19.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fadeb862e00 1 -- start start 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713ba3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 0x55c713ba3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713baa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fadeb862e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad88012750 con 0x55c713b8a390 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fadeb862e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fad8800ffc0 con 0x55c713b8acd0 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fadeb862e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad8800de10 con 0x55c713b8fa70 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fade66a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713ba3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fade66a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713ba3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49638/0 (socket says 10.20.193.28:49638) 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.912+0000 7fade66a1640 1 -- 10.20.193.28:0/2572932178 learned_addr learned my addr 10.20.193.28:0/2572932178 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fade66a1640 1 -- 10.20.193.28:0/2572932178 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 msgr2=0x55c713baa450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:19.918 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fade66a1640 1 --2- 10.20.193.28:0/2572932178 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713baa450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fade66a1640 1 -- 10.20.193.28:0/2572932178 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 msgr2=0x55c713ba3590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fade66a1640 1 --2- 10.20.193.28:0/2572932178 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 0x55c713ba3590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fade66a1640 1 -- 10.20.193.28:0/2572932178 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c713b9c550 con 0x55c713b8a390 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fade66a1640 1 --2- 10.20.193.28:0/2572932178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713ba3050 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x55c713bb1800 tx=0x7fadd8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bc559968421912 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadae3ff640 1 -- 10.20.193.28:0/2572932178 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8002c50 con 0x55c713b8a390 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadae3ff640 1 -- 10.20.193.28:0/2572932178 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fadd8002df0 con 0x55c713b8a390 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadae3ff640 1 -- 10.20.193.28:0/2572932178 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8013900 con 0x55c713b8a390 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadeb862e00 1 -- 10.20.193.28:0/2572932178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 msgr2=0x55c713ba3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadeb862e00 1 --2- 10.20.193.28:0/2572932178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713ba3050 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x55c713bb1800 tx=0x7fadd8010000 comp rx=0 tx=0).stop 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadeb862e00 1 -- 10.20.193.28:0/2572932178 shutdown_connections 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadeb862e00 1 --2- 10.20.193.28:0/2572932178 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713baa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadeb862e00 1 --2- 10.20.193.28:0/2572932178 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 0x55c713ba3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadeb862e00 1 --2- 10.20.193.28:0/2572932178 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713ba3050 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadeb862e00 1 -- 10.20.193.28:0/2572932178 >> 10.20.193.28:0/2572932178 conn(0x55c713b7d6f0 msgr2=0x55c713ba2630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:19.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.913+0000 7fadeb862e00 1 -- 10.20.193.28:0/2572932178 shutdown_connections 2026-02-20T03:31:19.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fadeb862e00 1 -- 10.20.193.28:0/2572932178 wait complete. 2026-02-20T03:31:19.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fadeb862e00 1 -- start start 2026-02-20T03:31:19.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fadeb862e00 1 Processor -- start 2026-02-20T03:31:19.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713baa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 0x55c713ba6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fadeb862e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713ba7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fadeb862e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad8800e480 con 0x55c713b8a390 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fadeb862e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fad8800f8f0 con 0x55c713b8acd0 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fadeb862e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad8800eb50 con 0x55c713b8fa70 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fade66a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713baa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fade66a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713baa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49640/0 (socket says 10.20.193.28:49640) 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fade66a1640 1 -- 10.20.193.28:0/165018265 learned_addr learned my addr 10.20.193.28:0/165018265 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fade66a1640 1 -- 10.20.193.28:0/165018265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 msgr2=0x55c713ba7350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fade66a1640 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713ba7350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fade66a1640 1 -- 10.20.193.28:0/165018265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 msgr2=0x55c713ba6e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.914+0000 7fade66a1640 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 0x55c713ba6e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fade66a1640 1 -- 10.20.193.28:0/165018265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c713836690 con 0x55c713b8a390 2026-02-20T03:31:19.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fade66a1640 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713baa390 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fadd8006e60 tx=0x7fadd8004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7794a5c821cf485d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fad93fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fad93fff640 1 -- 10.20.193.28:0/165018265 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8002c50 con 0x55c713b8a390 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fad93fff640 1 -- 10.20.193.28:0/165018265 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fadd800be40 con 0x55c713b8a390 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fad93fff640 1 -- 10.20.193.28:0/165018265 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8028660 con 0x55c713b8a390 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fadeb862e00 1 -- 10.20.193.28:0/165018265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c713a9bb70 con 0x55c713b8a390 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fad93fff640 1 -- 10.20.193.28:0/165018265 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fadd8028800 con 0x55c713b8a390 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fad93fff640 10 client.20070 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fadeb862e00 10 client.20070 _ll_register_callbacks cb 0x7fadcc002f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.915+0000 7fadeb862e00 1 -- 10.20.193.28:0/165018265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c713aa76b0 con 0x55c713b8a390 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fad93fff640 1 -- 10.20.193.28:0/165018265 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fadd8013600 con 0x55c713b8a390 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fadeb862e00 10 client.20070 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fadeb862e00 1 -- 10.20.193.28:0/165018265 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55c713b9d240 con 0x55c713b8a390 2026-02-20T03:31:19.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fad93fff640 1 -- 10.20.193.28:0/165018265 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fadd800b940 con 0x55c713b8a390 2026-02-20T03:31:19.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fadeb862e00 10 client.20070 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:19.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fadeb862e00 10 client.20070 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:19.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fadeb862e00 20 client.20070 populate_metadata read hostname 'trial028' 2026-02-20T03:31:19.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fadeb862e00 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c713c1aef0 0x55c713c1d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:19.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fadeb862e00 4 client.20070 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:31:19.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.916+0000 7fadeb862e00 1 -- 10.20.193.28:0/165018265 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c713ae4290 con 0x55c713c1aef0 2026-02-20T03:31:19.934 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.931+0000 7fade5ea0640 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c713c1aef0 0x55c713c1d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:20.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.998+0000 7fade5ea0640 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c713c1aef0 0x55c713c1d3b0 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=235b994c97ed1d2e server_cookie=31756edee3aedf7e in_seq=0 out_seq=0 2026-02-20T03:31:20.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:19.998+0000 7fad93fff640 10 client.20070 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:20.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.080+0000 7fad93fff640 1 -- 10.20.193.28:0/165018265 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c713ae4290 con 0x55c713c1aef0 2026-02-20T03:31:20.084 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.080+0000 7fad93fff640 10 client.20070 handle_command_reply: tid=0 2026-02-20T03:31:20.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.080+0000 7fadeb862e00 1 client.20070 shutdown 2026-02-20T03:31:20.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 -- 10.20.193.28:0/165018265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 msgr2=0x55c713baa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:20.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713baa390 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fadd8006e60 tx=0x7fadd8004660 comp rx=0 tx=0).stop 2026-02-20T03:31:20.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 -- 10.20.193.28:0/165018265 shutdown_connections 2026-02-20T03:31:20.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c713c1aef0 0x55c713c1d3b0 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c713b8fa70 0x55c713ba7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c713b8acd0 0x55c713ba6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 --2- 10.20.193.28:0/165018265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c713b8a390 0x55c713baa390 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.085 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 -- 10.20.193.28:0/165018265 >> 10.20.193.28:0/165018265 conn(0x55c713b7d6f0 msgr2=0x55c713b88a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:20.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fad93fff640 0 client.20070 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:20.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 -- 10.20.193.28:0/165018265 shutdown_connections 2026-02-20T03:31:20.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 1 -- 10.20.193.28:0/165018265 wait complete. 2026-02-20T03:31:20.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fadeb862e00 20 client.20070 trim_cache size 0 max 16384 2026-02-20T03:31:20.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:31:20.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:31:20.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:31:20.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 -- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fadbc0b0e20 msgr2=0x7fadbc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fadbc0b0e20 0x7fadbc0b32e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x55c713b8b3c0 tx=0x7fadd8006cd0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 -- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 msgr2=0x7fade01a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 0x7fade01a1e40 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fadd400b1d0 tx=0x7fadd40043e0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 -- 10.20.193.28:0/3729948841 shutdown_connections 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fadbc0b0e20 0x7fadbc0b32e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fade0104260 0x7fade01a1e40 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fade01038a0 0x7fade019add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 --2- 10.20.193.28:0/3729948841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fade01026b0 0x7fade019a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 -- 10.20.193.28:0/3729948841 >> 10.20.193.28:0/3729948841 conn(0x7fade00fde10 msgr2=0x7fade0106d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 -- 10.20.193.28:0/3729948841 shutdown_connections 2026-02-20T03:31:20.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:20.081+0000 7fade76a3640 1 -- 10.20.193.28:0/3729948841 wait complete. 2026-02-20T03:31:20.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 24.26 MB/sec execute 51 sec latency 31187.245 ms 2026-02-20T03:31:21.553 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:21 trial028 ceph-mon[38552]: pgmap v685: 129 pgs: 129 active+clean; 592 MiB data, 7.0 GiB used, 8.2 TiB / 8.2 TiB avail; 961 KiB/s rd, 12 MiB/s wr, 713 op/s 2026-02-20T03:31:21.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 23.80 MB/sec execute 52 sec latency 32187.292 ms 2026-02-20T03:31:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:21 trial177 ceph-mon[43181]: pgmap v685: 129 pgs: 129 active+clean; 592 MiB data, 7.0 GiB used, 8.2 TiB / 8.2 TiB avail; 961 KiB/s rd, 12 MiB/s wr, 713 op/s 2026-02-20T03:31:21.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:21 trial126 ceph-mon[38476]: pgmap v685: 129 pgs: 129 active+clean; 592 MiB data, 7.0 GiB used, 8.2 TiB / 8.2 TiB avail; 961 KiB/s rd, 12 MiB/s wr, 713 op/s 2026-02-20T03:31:22.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 23.35 MB/sec execute 53 sec latency 33187.328 ms 2026-02-20T03:31:23.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:23 trial028 ceph-mon[38552]: pgmap v686: 129 pgs: 129 active+clean; 579 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 751 KiB/s rd, 8.6 MiB/s wr, 611 op/s 2026-02-20T03:31:23.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:31:23.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:31:23.409 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:23 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:31:23.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 22.91 MB/sec execute 54 sec latency 34187.369 ms 2026-02-20T03:31:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:23 trial177 ceph-mon[43181]: pgmap v686: 129 pgs: 129 active+clean; 579 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 751 KiB/s rd, 8.6 MiB/s wr, 611 op/s 2026-02-20T03:31:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:31:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:31:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:23 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:31:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:23 trial126 ceph-mon[38476]: pgmap v686: 129 pgs: 129 active+clean; 579 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 751 KiB/s rd, 8.6 MiB/s wr, 611 op/s 2026-02-20T03:31:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:31:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:31:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:23 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:31:24.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 22.50 MB/sec execute 55 sec latency 35187.402 ms 2026-02-20T03:31:25.571 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:25 trial028 ceph-mon[38552]: pgmap v687: 129 pgs: 129 active+clean; 572 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 752 KiB/s rd, 6.8 MiB/s wr, 577 op/s 2026-02-20T03:31:25.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 22.10 MB/sec execute 56 sec latency 36187.435 ms 2026-02-20T03:31:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:25 trial177 ceph-mon[43181]: pgmap v687: 129 pgs: 129 active+clean; 572 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 752 KiB/s rd, 6.8 MiB/s wr, 577 op/s 2026-02-20T03:31:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:25 trial126 ceph-mon[38476]: pgmap v687: 129 pgs: 129 active+clean; 572 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 752 KiB/s rd, 6.8 MiB/s wr, 577 op/s 2026-02-20T03:31:26.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 21.71 MB/sec execute 57 sec latency 37187.472 ms 2026-02-20T03:31:27.453 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:27 trial028 ceph-mon[38552]: pgmap v688: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 461 KiB/s rd, 5.5 MiB/s wr, 531 op/s 2026-02-20T03:31:27.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 21.33 MB/sec execute 58 sec latency 38187.506 ms 2026-02-20T03:31:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:27 trial177 ceph-mon[43181]: pgmap v688: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 461 KiB/s rd, 5.5 MiB/s wr, 531 op/s 2026-02-20T03:31:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:27 trial126 ceph-mon[38476]: pgmap v688: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 461 KiB/s rd, 5.5 MiB/s wr, 531 op/s 2026-02-20T03:31:28.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 20.97 MB/sec execute 59 sec latency 39187.540 ms 2026-02-20T03:31:29.617 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:29 trial028 ceph-mon[38552]: pgmap v689: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 426 KiB/s rd, 4.5 MiB/s wr, 443 op/s 2026-02-20T03:31:29.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 20.62 MB/sec execute 60 sec latency 40187.573 ms 2026-02-20T03:31:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:29 trial177 ceph-mon[43181]: pgmap v689: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 426 KiB/s rd, 4.5 MiB/s wr, 443 op/s 2026-02-20T03:31:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:29 trial126 ceph-mon[38476]: pgmap v689: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 426 KiB/s rd, 4.5 MiB/s wr, 443 op/s 2026-02-20T03:31:30.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 20.29 MB/sec execute 61 sec latency 41187.599 ms 2026-02-20T03:31:31.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:31 trial028 ceph-mon[38552]: pgmap v690: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 333 KiB/s rd, 2.7 MiB/s wr, 297 op/s 2026-02-20T03:31:31.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 19.96 MB/sec execute 62 sec latency 42187.637 ms 2026-02-20T03:31:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:31 trial177 ceph-mon[43181]: pgmap v690: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 333 KiB/s rd, 2.7 MiB/s wr, 297 op/s 2026-02-20T03:31:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:31 trial126 ceph-mon[38476]: pgmap v690: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 333 KiB/s rd, 2.7 MiB/s wr, 297 op/s 2026-02-20T03:31:32.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 19.64 MB/sec execute 63 sec latency 43187.674 ms 2026-02-20T03:31:33.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- 10.20.193.28:0/857416987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b001061c0 msgr2=0x7f8b00106670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:33.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 --2- 10.20.193.28:0/857416987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b001061c0 0x7f8b00106670 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f8af400b0a0 tx=0x7f8af402f450 comp rx=0 tx=0).stop 2026-02-20T03:31:33.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- 10.20.193.28:0/857416987 shutdown_connections 2026-02-20T03:31:33.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 --2- 10.20.193.28:0/857416987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b001061c0 0x7f8b00106670 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 --2- 10.20.193.28:0/857416987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b00103810 0x7f8b00105c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.160 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 --2- 10.20.193.28:0/857416987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b00100ec0 0x7f8b001032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- 10.20.193.28:0/857416987 >> 10.20.193.28:0/857416987 conn(0x7f8b000fccd0 msgr2=0x7f8b000ff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:33.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- 10.20.193.28:0/857416987 shutdown_connections 2026-02-20T03:31:33.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- 10.20.193.28:0/857416987 wait complete. 2026-02-20T03:31:33.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 Processor -- start 2026-02-20T03:31:33.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- start start 2026-02-20T03:31:33.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b00100ec0 0x7f8b001a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b00103810 0x7f8b001a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b001061c0 0x7f8b001a8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8b00114a10 con 0x7f8b00103810 2026-02-20T03:31:33.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8b00114890 con 0x7f8b001061c0 2026-02-20T03:31:33.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8b00114b90 con 0x7f8b00100ec0 2026-02-20T03:31:33.163 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8aff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b00103810 0x7f8b001a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:33.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8aff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b00103810 0x7f8b001a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34960/0 (socket says 10.20.193.28:34960) 2026-02-20T03:31:33.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8aff7fe640 1 -- 10.20.193.28:0/395132024 learned_addr learned my addr 10.20.193.28:0/395132024 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:33.166 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8aff7fe640 1 -- 10.20.193.28:0/395132024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b00100ec0 msgr2=0x7f8b001a1050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8aff7fe640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b00100ec0 0x7f8b001a1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8aff7fe640 1 -- 10.20.193.28:0/395132024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b001061c0 msgr2=0x7f8b001a8600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8aff7fe640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b001061c0 0x7f8b001a8600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8aff7fe640 1 -- 10.20.193.28:0/395132024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b001a8d00 con 0x7f8b00103810 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8aff7fe640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b00103810 0x7f8b001a1590 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f8af000b570 tx=0x7f8af000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8afd7fa640 1 -- 10.20.193.28:0/395132024 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0013020 con 0x7f8b00103810 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8afd7fa640 1 -- 10.20.193.28:0/395132024 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8af0004480 con 0x7f8b00103810 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8afd7fa640 1 -- 10.20.193.28:0/395132024 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af000fb50 con 0x7f8b00103810 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- 10.20.193.28:0/395132024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b001a8ff0 con 0x7f8b00103810 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.155+0000 7f8b057e4640 1 -- 10.20.193.28:0/395132024 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b001a9480 con 0x7f8b00103810 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.160+0000 7f8b098cee00 1 Processor -- start 2026-02-20T03:31:33.167 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.160+0000 7f8afd7fa640 1 -- 10.20.193.28:0/395132024 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8af0002780 con 0x7f8b00103810 2026-02-20T03:31:33.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- start start 2026-02-20T03:31:33.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d388280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d3887c0 0x55cf6d38cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d38d560 0x55cf6d38f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cf6d2d88f0 con 0x55cf6d387e80 2026-02-20T03:31:33.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cf6d2862e0 con 0x55cf6d38d560 2026-02-20T03:31:33.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cf6d2d4820 con 0x55cf6d3887c0 2026-02-20T03:31:33.168 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b04fe3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d388280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:33.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b04fe3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d388280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34976/0 (socket says 10.20.193.28:34976) 2026-02-20T03:31:33.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b04fe3640 1 -- 10.20.193.28:0/1058394840 learned_addr learned my addr 10.20.193.28:0/1058394840 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:33.169 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b04fe3640 1 -- 10.20.193.28:0/1058394840 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d3887c0 msgr2=0x55cf6d38cf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b04fe3640 1 --2- 10.20.193.28:0/1058394840 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d3887c0 0x55cf6d38cf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b04fe3640 1 -- 10.20.193.28:0/1058394840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d38d560 msgr2=0x55cf6d38f9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b04fe3640 1 --2- 10.20.193.28:0/1058394840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d38d560 0x55cf6d38f9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b04fe3640 1 -- 10.20.193.28:0/1058394840 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf6d2785a0 con 0x55cf6d387e80 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b04fe3640 1 --2- 10.20.193.28:0/1058394840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d388280 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8af40045f0 tx=0x7f8af4009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320b4dd6c01a3bc8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afd7fa640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ad40b0ea0 0x7f8ad40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afd7fa640 1 -- 10.20.193.28:0/395132024 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f8af00e0500 con 0x7f8b00103810 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8ad0bfe640 1 -- 10.20.193.28:0/1058394840 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4004070 con 0x55cf6d387e80 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8ad0bfe640 1 -- 10.20.193.28:0/1058394840 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8af4033070 con 0x55cf6d387e80 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8ad0bfe640 1 -- 10.20.193.28:0/1058394840 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4002cc0 con 0x55cf6d387e80 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- 10.20.193.28:0/1058394840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 msgr2=0x55cf6d388280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:33.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1058394840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d388280 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8af40045f0 tx=0x7f8af4009d70 comp rx=0 tx=0).stop 2026-02-20T03:31:33.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ad40b0ea0 0x7f8ad40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:33.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ad40b0ea0 0x7f8ad40b3360 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x55cf6d388eb0 tx=0x7f8aec006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:33.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- 10.20.193.28:0/1058394840 shutdown_connections 2026-02-20T03:31:33.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1058394840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d38d560 0x55cf6d38f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1058394840 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d3887c0 0x55cf6d38cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1058394840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d388280 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- 10.20.193.28:0/1058394840 >> 10.20.193.28:0/1058394840 conn(0x55cf6d37f6f0 msgr2=0x55cf6d386570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- 10.20.193.28:0/1058394840 shutdown_connections 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- 10.20.193.28:0/1058394840 wait complete. 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- start start 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 Processor -- start 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d3a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d38d560 0x55cf6d3a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cf6d2800c0 con 0x55cf6d387e80 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cf6d3905b0 con 0x55cf6d38d560 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8b098cee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cf6d3a81f0 con 0x55cf6d3887c0 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d3a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d3a07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34992/0 (socket says 10.20.193.28:34992) 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 -- 10.20.193.28:0/1714815928 learned_addr learned my addr 10.20.193.28:0/1714815928 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 -- 10.20.193.28:0/1714815928 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d3887c0 msgr2=0x55cf6d3a0ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a0ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 -- 10.20.193.28:0/1714815928 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d38d560 msgr2=0x55cf6d3a7c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d38d560 0x55cf6d3a7c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.163+0000 7f8afffff640 1 -- 10.20.193.28:0/1714815928 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf6d39a200 con 0x55cf6d387e80 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8afffff640 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d3a07a0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8aec004690 tx=0x7f8aec0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ba884965ac5e15 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:33.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8ac1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/1714815928 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec00b760 con 0x55cf6d387e80 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 1 -- 10.20.193.28:0/1714815928 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf6d294820 con 0x55cf6d387e80 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/1714815928 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8aec00bda0 con 0x55cf6d387e80 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/1714815928 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec011e00 con 0x55cf6d387e80 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/1714815928 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f8aec013430 con 0x55cf6d387e80 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 10 client.20082 _ll_register_callbacks cb 0x55cf6d283ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 1 -- 10.20.193.28:0/1714815928 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cf6d2e04e0 con 0x55cf6d387e80 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/1714815928 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f8aec00b900 con 0x55cf6d387e80 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 10 client.20082 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 1 -- 10.20.193.28:0/1714815928 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55cf6d299380 con 0x55cf6d387e80 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/1714815928 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f8aec028030 con 0x55cf6d387e80 2026-02-20T03:31:33.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 10 client.20082 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:33.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 10 client.20082 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:33.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 20 client.20082 populate_metadata read hostname 'trial028' 2026-02-20T03:31:33.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cf6d3ac640 0x55cf6d3aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 4 client.20082 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:33.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.168+0000 7f8b098cee00 1 -- 10.20.193.28:0/1714815928 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf6d25abd0 con 0x55cf6d3ac640 2026-02-20T03:31:33.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.190+0000 7f8aff7fe640 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cf6d3ac640 0x55cf6d3aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:33.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.257+0000 7f8aff7fe640 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cf6d3ac640 0x55cf6d3aeb00 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80eec103f1cae54e server_cookie=ba8887b0c8e998b1 in_seq=0 out_seq=0 2026-02-20T03:31:33.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.257+0000 7f8ac1ffb640 10 client.20082 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/1714815928 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55cf6d25abd0 con 0x55cf6d3ac640 2026-02-20T03:31:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8ac1ffb640 10 client.20082 handle_command_reply: tid=0 2026-02-20T03:31:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 client.20082 shutdown 2026-02-20T03:31:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 -- 10.20.193.28:0/1714815928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 msgr2=0x55cf6d3a07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:33.286 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d3a07a0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8aec004690 tx=0x7f8aec0047e0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.287 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 -- 10.20.193.28:0/1714815928 shutdown_connections 2026-02-20T03:31:33.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cf6d3ac640 0x55cf6d3aeb00 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d38d560 0x55cf6d3a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 --2- 10.20.193.28:0/1714815928 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d3a07a0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8ac1ffb640 0 client.20082 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:33.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 -- 10.20.193.28:0/1714815928 >> 10.20.193.28:0/1714815928 conn(0x55cf6d37f6f0 msgr2=0x55cf6d38e910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:33.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 -- 10.20.193.28:0/1714815928 shutdown_connections 2026-02-20T03:31:33.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 1 -- 10.20.193.28:0/1714815928 wait complete. 2026-02-20T03:31:33.288 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.284+0000 7f8b098cee00 20 client.20082 trim_cache size 0 max 16384 2026-02-20T03:31:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8b098cee00 1 Processor -- start 2026-02-20T03:31:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8b098cee00 1 -- start start 2026-02-20T03:31:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d39f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d38d560 0x55cf6d39fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8b098cee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4012750 con 0x55cf6d387e80 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8b098cee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa400ffc0 con 0x55cf6d3887c0 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8b098cee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa400de10 con 0x55cf6d38d560 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8afffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d39f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8afffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d39f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:34998/0 (socket says 10.20.193.28:34998) 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.291+0000 7f8afffff640 1 -- 10.20.193.28:0/3108557896 learned_addr learned my addr 10.20.193.28:0/3108557896 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8afffff640 1 -- 10.20.193.28:0/3108557896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d38d560 msgr2=0x55cf6d39fe60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8afffff640 1 --2- 10.20.193.28:0/3108557896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d38d560 0x55cf6d39fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8afffff640 1 -- 10.20.193.28:0/3108557896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d3887c0 msgr2=0x55cf6d3a7c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8afffff640 1 --2- 10.20.193.28:0/3108557896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a7c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8afffff640 1 -- 10.20.193.28:0/3108557896 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf6d39a030 con 0x55cf6d387e80 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8afffff640 1 --2- 10.20.193.28:0/3108557896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d39f850 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8aec002ca0 tx=0x7f8aec024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d27c88ba921b728 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac3fff640 1 -- 10.20.193.28:0/3108557896 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec004470 con 0x55cf6d387e80 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac3fff640 1 -- 10.20.193.28:0/3108557896 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8aec017070 con 0x55cf6d387e80 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac3fff640 1 -- 10.20.193.28:0/3108557896 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec020430 con 0x55cf6d387e80 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- 10.20.193.28:0/3108557896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 msgr2=0x55cf6d39f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 --2- 10.20.193.28:0/3108557896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d39f850 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f8aec002ca0 tx=0x7f8aec024000 comp rx=0 tx=0).stop 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- 10.20.193.28:0/3108557896 shutdown_connections 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 --2- 10.20.193.28:0/3108557896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d38d560 0x55cf6d39fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 --2- 10.20.193.28:0/3108557896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 --2- 10.20.193.28:0/3108557896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d387e80 0x55cf6d39f850 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- 10.20.193.28:0/3108557896 >> 10.20.193.28:0/3108557896 conn(0x55cf6d37f6f0 msgr2=0x55cf6d386570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- 10.20.193.28:0/3108557896 shutdown_connections 2026-02-20T03:31:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- 10.20.193.28:0/3108557896 wait complete. 2026-02-20T03:31:33.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- start start 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 Processor -- start 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d387e80 0x55cf6d3a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d38d560 0x55cf6d3a6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa400e480 con 0x55cf6d3887c0 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa400f8f0 con 0x55cf6d387e80 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa400eb50 con 0x55cf6d38d560 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8aff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8aff7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35014/0 (socket says 10.20.193.28:35014) 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8aff7fe640 1 -- 10.20.193.28:0/2175275039 learned_addr learned my addr 10.20.193.28:0/2175275039 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:33.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8aff7fe640 1 -- 10.20.193.28:0/2175275039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d38d560 msgr2=0x55cf6d3a6510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8aff7fe640 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d38d560 0x55cf6d3a6510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8aff7fe640 1 -- 10.20.193.28:0/2175275039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d387e80 msgr2=0x55cf6d3a78c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8aff7fe640 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d387e80 0x55cf6d3a78c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8aff7fe640 1 -- 10.20.193.28:0/2175275039 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf6d390310 con 0x55cf6d3887c0 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8aff7fe640 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a5fd0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f8af000b540 tx=0x7f8af00a7700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee76e2d24472cd71 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/2175275039 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af00ce070 con 0x55cf6d3887c0 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/2175275039 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8af00a88e0 con 0x55cf6d3887c0 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- 10.20.193.28:0/2175275039 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf6d038690 con 0x55cf6d3887c0 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/2175275039 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af00ac170 con 0x55cf6d3887c0 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 10 client.20088 _ll_register_callbacks cb 0x7f8aec004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:33.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- 10.20.193.28:0/2175275039 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8af4033070 con 0x55cf6d3887c0 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/2175275039 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f8af00ac310 con 0x55cf6d3887c0 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/2175275039 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f8af00c2060 con 0x55cf6d3887c0 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 10 client.20088 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- 10.20.193.28:0/2175275039 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55cf6d29db70 con 0x55cf6d3887c0 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/2175275039 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7f8af00a71f0 con 0x55cf6d3887c0 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 10 client.20088 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 10 client.20088 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 20 client.20088 populate_metadata read hostname 'trial028' 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cf6d4188a0 0x55cf6d41ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 4 client.20088 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:31:33.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.292+0000 7f8b098cee00 1 -- 10.20.193.28:0/2175275039 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf6d2a96b0 con 0x55cf6d4188a0 2026-02-20T03:31:33.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.311+0000 7f8afffff640 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cf6d4188a0 0x55cf6d41ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:33.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.351+0000 7f8ac1ffb640 10 client.20088 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:33.353 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.351+0000 7f8afffff640 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cf6d4188a0 0x55cf6d41ad60 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a5a791e4a22af89 server_cookie=883db546f59c12d1 in_seq=0 out_seq=0 2026-02-20T03:31:33.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8ac1ffb640 1 -- 10.20.193.28:0/2175275039 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf6d2a96b0 con 0x55cf6d4188a0 2026-02-20T03:31:33.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8ac1ffb640 10 client.20088 handle_command_reply: tid=0 2026-02-20T03:31:33.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 client.20088 shutdown 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 -- 10.20.193.28:0/2175275039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d3887c0 msgr2=0x55cf6d3a5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a5fd0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f8af000b540 tx=0x7f8af00a7700 comp rx=0 tx=0).stop 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 -- 10.20.193.28:0/2175275039 shutdown_connections 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cf6d4188a0 0x55cf6d41ad60 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cf6d38d560 0x55cf6d3a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cf6d3887c0 0x55cf6d3a5fd0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 --2- 10.20.193.28:0/2175275039 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cf6d387e80 0x55cf6d3a78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 -- 10.20.193.28:0/2175275039 >> 10.20.193.28:0/2175275039 conn(0x55cf6d37f6f0 msgr2=0x55cf6d39d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8ac1ffb640 0 client.20088 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 -- 10.20.193.28:0/2175275039 shutdown_connections 2026-02-20T03:31:33.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 1 -- 10.20.193.28:0/2175275039 wait complete. 2026-02-20T03:31:33.424 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.419+0000 7f8b098cee00 20 client.20088 trim_cache size 0 max 16384 2026-02-20T03:31:33.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:31:33.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:31:33.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:31:33.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:31:33.435 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 -- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ad40b0ea0 msgr2=0x7f8ad40b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ad40b0ea0 0x7f8ad40b3360 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x55cf6d388eb0 tx=0x7f8aec006cd0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 -- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b00103810 msgr2=0x7f8b001a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b00103810 0x7f8b001a1590 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f8af000b570 tx=0x7f8af000ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 -- 10.20.193.28:0/395132024 shutdown_connections 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8ad40b0ea0 0x7f8ad40b3360 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8b001061c0 0x7f8b001a8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8b00103810 0x7f8b001a1590 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 --2- 10.20.193.28:0/395132024 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8b00100ec0 0x7f8b001a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 -- 10.20.193.28:0/395132024 >> 10.20.193.28:0/395132024 conn(0x7f8b000fccd0 msgr2=0x7f8b00101860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 -- 10.20.193.28:0/395132024 shutdown_connections 2026-02-20T03:31:33.436 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:33.420+0000 7f8b057e4640 1 -- 10.20.193.28:0/395132024 wait complete. 2026-02-20T03:31:33.608 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:33 trial028 ceph-mon[38552]: pgmap v691: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 270 KiB/s wr, 57 op/s 2026-02-20T03:31:33.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 19.33 MB/sec execute 64 sec latency 44187.714 ms 2026-02-20T03:31:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:33 trial177 ceph-mon[43181]: pgmap v691: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 270 KiB/s wr, 57 op/s 2026-02-20T03:31:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:33 trial126 ceph-mon[38476]: pgmap v691: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 18 KiB/s rd, 270 KiB/s wr, 57 op/s 2026-02-20T03:31:34.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 19.04 MB/sec execute 65 sec latency 45187.766 ms 2026-02-20T03:31:34.703 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:34 trial028 ceph-mon[38552]: pgmap v692: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 211 KiB/s wr, 27 op/s 2026-02-20T03:31:34.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:34 trial126 ceph-mon[38476]: pgmap v692: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 211 KiB/s wr, 27 op/s 2026-02-20T03:31:34.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:34 trial177 ceph-mon[43181]: pgmap v692: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 211 KiB/s wr, 27 op/s 2026-02-20T03:31:35.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 18.75 MB/sec execute 66 sec latency 46187.809 ms 2026-02-20T03:31:36.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 18.47 MB/sec execute 67 sec latency 47187.852 ms 2026-02-20T03:31:37.426 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:37 trial028 ceph-mon[38552]: pgmap v693: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 151 KiB/s wr, 15 op/s 2026-02-20T03:31:37.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:37 trial126 ceph-mon[38476]: pgmap v693: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 151 KiB/s wr, 15 op/s 2026-02-20T03:31:37.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 18.20 MB/sec execute 68 sec latency 48187.893 ms 2026-02-20T03:31:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:37 trial177 ceph-mon[43181]: pgmap v693: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 151 KiB/s wr, 15 op/s 2026-02-20T03:31:38.702 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 17.93 MB/sec execute 69 sec latency 49187.924 ms 2026-02-20T03:31:39.561 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:39 trial028 ceph-mon[38552]: pgmap v694: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2026-02-20T03:31:39.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:39 trial126 ceph-mon[38476]: pgmap v694: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2026-02-20T03:31:39.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 17.68 MB/sec execute 70 sec latency 50187.957 ms 2026-02-20T03:31:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:39 trial177 ceph-mon[43181]: pgmap v694: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2026-02-20T03:31:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd1dffff640 1 -- 10.20.193.28:0/79804088 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: -115 ) ==== 8+0+595 (crc 0 0 0) 0x56505f8cff60 con 0x56505fca1b60 2026-02-20T03:31:40.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd1dffff640 10 client.19920 handle_command_reply: tid=0 2026-02-20T03:31:40.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 client.19920 shutdown 2026-02-20T03:31:40.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 -- 10.20.193.28:0/79804088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 msgr2=0x56505fc2c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:40.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc2c840 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009380 tx=0x7fd21c0048d0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 -- 10.20.193.28:0/79804088 shutdown_connections 2026-02-20T03:31:40.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56505fca1b60 0x56505fca4020 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56505fc12070 0x56505fca00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56505fc0d200 0x56505fc2cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 --2- 10.20.193.28:0/79804088 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56505fc0c860 0x56505fc2c840 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd1dffff640 0 client.19920 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:40.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 -- 10.20.193.28:0/79804088 >> 10.20.193.28:0/79804088 conn(0x56505fc053c0 msgr2=0x56505fc0b670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:40.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 -- 10.20.193.28:0/79804088 shutdown_connections 2026-02-20T03:31:40.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 1 -- 10.20.193.28:0/79804088 wait complete. 2026-02-20T03:31:40.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.079+0000 7fd236bffe00 20 client.19920 trim_cache size 0 max 16384 2026-02-20T03:31:40.095 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:40.095 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 40, 2026-02-20T03:31:40.095 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:31:40.095 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 49, 2026-02-20T03:31:40.095 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:31:40.095 INFO:teuthology.orchestra.run.trial028.stdout: "f621fbc0": { 2026-02-20T03:31:40.095 INFO:teuthology.orchestra.run.trial028.stdout: "version": 49, 2026-02-20T03:31:40.095 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCING", 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "age": 45.0 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 144.4, 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:31:40.096 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCING", 2026-02-20T03:31:40.097 INFO:teuthology.orchestra.run.trial028.stdout: "age": 45.0 2026-02-20T03:31:40.097 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:31:40.097 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:31:40.097 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:31:40.097 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:31:40.097 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:31:40.097 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:40.097 INFO:teuthology.orchestra.run.trial028.stderr:Error EINPROGRESS: 2026-02-20T03:31:40.225 DEBUG:teuthology.orchestra.run:got remote process result: 115 2026-02-20T03:31:40.225 WARNING:tasks.quiescer.fs.[cephfs]:Set 'f621fbc0' hasn't quiesced after 46.7 seconds (timeout: 90). Dumping ops with locks from all ranks. 2026-02-20T03:31:40.226 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:31:40.535 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:40.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 17.43 MB/sec execute 71 sec latency 51187.988 ms 2026-02-20T03:31:40.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 -- 10.20.193.28:0/4140383241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb36010a980 msgr2=0x7fb36010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:40.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 --2- 10.20.193.28:0/4140383241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb36010a980 0x7fb36010ad60 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fb354009a60 tx=0x7fb35402f290 comp rx=0 tx=0).stop 2026-02-20T03:31:40.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 -- 10.20.193.28:0/4140383241 shutdown_connections 2026-02-20T03:31:40.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 --2- 10.20.193.28:0/4140383241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360105320 0x7fb360111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 --2- 10.20.193.28:0/4140383241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb360104980 0x7fb360104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 --2- 10.20.193.28:0/4140383241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb36010a980 0x7fb36010ad60 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 -- 10.20.193.28:0/4140383241 >> 10.20.193.28:0/4140383241 conn(0x7fb360100680 msgr2=0x7fb360102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:40.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 -- 10.20.193.28:0/4140383241 shutdown_connections 2026-02-20T03:31:40.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 -- 10.20.193.28:0/4140383241 wait complete. 2026-02-20T03:31:40.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 Processor -- start 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 -- start start 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360104980 0x7fb36019d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb360105320 0x7fb36019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb36010a980 0x7fb3601a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb360114c80 con 0x7fb360105320 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb360114b00 con 0x7fb360104980 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35f577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb360114e00 con 0x7fb36010a980 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb360105320 0x7fb36019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb360105320 0x7fb36019d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33244/0 (socket says 10.20.193.28:33244) 2026-02-20T03:31:40.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35dd74640 1 -- 10.20.193.28:0/1106088008 learned_addr learned my addr 10.20.193.28:0/1106088008 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:40.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35dd74640 1 -- 10.20.193.28:0/1106088008 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb36010a980 msgr2=0x7fb3601a1ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:40.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35dd74640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb36010a980 0x7fb3601a1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35dd74640 1 -- 10.20.193.28:0/1106088008 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360104980 msgr2=0x7fb36019d1e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:40.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35dd74640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360104980 0x7fb36019d1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35dd74640 1 -- 10.20.193.28:0/1106088008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3601a2230 con 0x7fb360105320 2026-02-20T03:31:40.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb35dd74640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb360105320 0x7fb36019d720 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb34800b570 tx=0x7fb34800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:40.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb3477fe640 1 -- 10.20.193.28:0/1106088008 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348013020 con 0x7fb360105320 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb3477fe640 1 -- 10.20.193.28:0/1106088008 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb348004480 con 0x7fb360105320 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.771+0000 7fb3477fe640 1 -- 10.20.193.28:0/1106088008 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34800fb50 con 0x7fb360105320 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.777+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3601a2520 con 0x7fb360105320 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.777+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3601a9d60 con 0x7fb360105320 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.777+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb360104e60 con 0x7fb360105320 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.777+0000 7fb3477fe640 1 -- 10.20.193.28:0/1106088008 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb348002780 con 0x7fb360105320 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.777+0000 7fb3477fe640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb3380b0e20 0x7fb3380b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.777+0000 7fb3477fe640 1 -- 10.20.193.28:0/1106088008 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fb3480e09c0 con 0x7fb360105320 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.777+0000 7fb3477fe640 1 -- 10.20.193.28:0/1106088008 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fb34801d020 con 0x7fb360105320 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.777+0000 7fb35e575640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb3380b0e20 0x7fb3380b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:40.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.777+0000 7fb35e575640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb3380b0e20 0x7fb3380b32e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb354009950 tx=0x7fb3540023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:40.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.888+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb36019e540 con 0x7fb360105320 2026-02-20T03:31:40.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb3477fe640 1 -- 10.20.193.28:0/1106088008 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11924 (secure 0 0 0) 0x7fb36019e540 con 0x7fb360105320 2026-02-20T03:31:40.893 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:31:40.894 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":40,"btime":"2026-02-20T03:30:48:852343+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:30:48.476361+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28114":{"gid":28114,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1701826560","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1701826560},{"type":"v1","addr":"10.20.193.177:6837","nonce":1701826560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:31:40.895 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 40 2026-02-20T03:31:40.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb3380b0e20 msgr2=0x7fb3380b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:40.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb3380b0e20 0x7fb3380b32e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb354009950 tx=0x7fb3540023d0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb360105320 msgr2=0x7fb36019d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:40.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb360105320 0x7fb36019d720 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb34800b570 tx=0x7fb34800ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:40.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 shutdown_connections 2026-02-20T03:31:40.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb3380b0e20 0x7fb3380b32e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb36010a980 0x7fb3601a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb360105320 0x7fb36019d720 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 --2- 10.20.193.28:0/1106088008 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb360104980 0x7fb36019d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:40.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 >> 10.20.193.28:0/1106088008 conn(0x7fb360100680 msgr2=0x7fb360101160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:40.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 shutdown_connections 2026-02-20T03:31:40.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:40.890+0000 7fb35f577640 1 -- 10.20.193.28:0/1106088008 wait complete. 2026-02-20T03:31:41.062 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 2 (h) to a remote file /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.h.json 2026-02-20T03:31:41.063 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 ops --flags=locks --path=/var/run/ceph/ops-f621fbc0-1-mds.h.json 2026-02-20T03:31:41.361 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:41.427 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:41 trial028 ceph-mon[38552]: pgmap v695: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2026-02-20T03:31:41.427 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:41 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1106088008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:41 trial126 ceph-mon[38476]: pgmap v695: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2026-02-20T03:31:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:41 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1106088008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:41.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- 10.20.193.28:0/1984344842 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 msgr2=0x7fb7541097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:41.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 --2- 10.20.193.28:0/1984344842 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 0x7fb7541097a0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb744009a30 tx=0x7fb74402f260 comp rx=0 tx=0).stop 2026-02-20T03:31:41.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- 10.20.193.28:0/1984344842 shutdown_connections 2026-02-20T03:31:41.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 --2- 10.20.193.28:0/1984344842 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb754109ed0 0x7fb754111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 --2- 10.20.193.28:0/1984344842 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 0x7fb7541097a0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 --2- 10.20.193.28:0/1984344842 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb754104da0 0x7fb754105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- 10.20.193.28:0/1984344842 >> 10.20.193.28:0/1984344842 conn(0x7fb754100840 msgr2=0x7fb754102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:41.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- 10.20.193.28:0/1984344842 shutdown_connections 2026-02-20T03:31:41.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- 10.20.193.28:0/1984344842 wait complete. 2026-02-20T03:31:41.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 Processor -- start 2026-02-20T03:31:41.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- start start 2026-02-20T03:31:41.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb754104da0 0x7fb75419d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 0x7fb75419d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb754109ed0 0x7fb7541a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb754114e30 con 0x7fb754105750 2026-02-20T03:31:41.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb754114cb0 con 0x7fb754104da0 2026-02-20T03:31:41.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb754114fb0 con 0x7fb754109ed0 2026-02-20T03:31:41.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 0x7fb75419d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:41.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 0x7fb75419d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33264/0 (socket says 10.20.193.28:33264) 2026-02-20T03:31:41.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7537fe640 1 -- 10.20.193.28:0/2998370472 learned_addr learned my addr 10.20.193.28:0/2998370472 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:41.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7537fe640 1 -- 10.20.193.28:0/2998370472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb754109ed0 msgr2=0x7fb7541a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:41.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7537fe640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb754109ed0 0x7fb7541a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7537fe640 1 -- 10.20.193.28:0/2998370472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb754104da0 msgr2=0x7fb75419d2e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7537fe640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb754104da0 0x7fb75419d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7537fe640 1 -- 10.20.193.28:0/2998370472 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7541a2330 con 0x7fb754105750 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7537fe640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 0x7fb75419d820 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb744009a00 tx=0x7fb744002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7517fa640 1 -- 10.20.193.28:0/2998370472 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744004260 con 0x7fb754105750 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7517fa640 1 -- 10.20.193.28:0/2998370472 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb744004400 con 0x7fb754105750 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb7517fa640 1 -- 10.20.193.28:0/2998370472 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744041950 con 0x7fb754105750 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- 10.20.193.28:0/2998370472 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7541a25c0 con 0x7fb754105750 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.614+0000 7fb75a426640 1 -- 10.20.193.28:0/2998370472 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7541a9e60 con 0x7fb754105750 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb7517fa640 1 -- 10.20.193.28:0/2998370472 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb744038790 con 0x7fb754105750 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 Processor -- start 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 -- start start 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa5650 0x561126fa5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa0e80 0x561126fa1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa1840 0x561126fad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561126ef3880 con 0x561126fa5650 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561126ea1350 con 0x561126fa1840 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561126eef7b0 con 0x561126fa0e80 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa5650 0x561126fa5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa5650 0x561126fa5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33274/0 (socket says 10.20.193.28:33274) 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 -- 10.20.193.28:0/2734707092 learned_addr learned my addr 10.20.193.28:0/2734707092 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 -- 10.20.193.28:0/2734707092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa0e80 msgr2=0x561126fa1300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 --2- 10.20.193.28:0/2734707092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa0e80 0x561126fa1300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb7517fa640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7280b0e20 0x7fb7280b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 -- 10.20.193.28:0/2734707092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa1840 msgr2=0x561126fad5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 --2- 10.20.193.28:0/2734707092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa1840 0x561126fad5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 -- 10.20.193.28:0/2734707092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561126e999a0 con 0x561126fa5650 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb7517fa640 1 -- 10.20.193.28:0/2998370472 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fb744105750 con 0x7fb754105750 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7280b0e20 0x7fb7280b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 --2- 10.20.193.28:0/2734707092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa5650 0x561126fa5a30 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb748009d20 tx=0x7fb74800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6737b27fd6728979 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb724ce3640 1 -- 10.20.193.28:0/2734707092 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748006e60 con 0x561126fa5650 2026-02-20T03:31:41.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb724ce3640 1 -- 10.20.193.28:0/2734707092 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb748004960 con 0x561126fa5650 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb724ce3640 1 -- 10.20.193.28:0/2734707092 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb748012640 con 0x561126fa5650 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 -- 10.20.193.28:0/2734707092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa5650 msgr2=0x561126fa5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2734707092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa5650 0x561126fa5a30 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fb748009d20 tx=0x7fb74800b420 comp rx=0 tx=0).stop 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75899c640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7280b0e20 0x7fb7280b32e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb74801a000 tx=0x7fb74801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 -- 10.20.193.28:0/2734707092 shutdown_connections 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2734707092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa1840 0x561126fad5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2734707092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa0e80 0x561126fa1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2734707092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa5650 0x561126fa5a30 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 -- 10.20.193.28:0/2734707092 >> 10.20.193.28:0/2734707092 conn(0x561126f99a60 msgr2=0x561126f9f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 -- 10.20.193.28:0/2734707092 shutdown_connections 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.619+0000 7fb75c92be00 1 -- 10.20.193.28:0/2734707092 wait complete. 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 -- start start 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 Processor -- start 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa1840 0x561126fc4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa5650 0x561126fc26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561126e9b130 con 0x561126fa0e80 2026-02-20T03:31:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561126fb6690 con 0x561126fa1840 2026-02-20T03:31:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561126fc2ce0 con 0x561126fa5650 2026-02-20T03:31:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb753fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb753fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33280/0 (socket says 10.20.193.28:33280) 2026-02-20T03:31:41.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb753fff640 1 -- 10.20.193.28:0/2727341210 learned_addr learned my addr 10.20.193.28:0/2727341210 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb753fff640 1 -- 10.20.193.28:0/2727341210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa5650 msgr2=0x561126fc26a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb753fff640 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa5650 0x561126fc26a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb753fff640 1 -- 10.20.193.28:0/2727341210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa1840 msgr2=0x561126fc4430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:41.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb753fff640 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa1840 0x561126fc4430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb753fff640 1 -- 10.20.193.28:0/2727341210 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561126fbbf70 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb753fff640 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc3ef0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb740009f00 tx=0x7fb74000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab235f5a12075ac0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb715ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb715ffb640 1 -- 10.20.193.28:0/2727341210 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740016070 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb715ffb640 1 -- 10.20.193.28:0/2727341210 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb740002780 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb715ffb640 1 -- 10.20.193.28:0/2727341210 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7400117f0 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 -- 10.20.193.28:0/2727341210 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561126cc2ec0 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb715ffb640 1 -- 10.20.193.28:0/2727341210 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fb74001a3b0 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 10 client.20106 _ll_register_callbacks cb 0x561126e9f060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 -- 10.20.193.28:0/2727341210 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561126e75f90 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb715ffb640 1 -- 10.20.193.28:0/2727341210 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fb740004270 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 10 client.20106 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 -- 10.20.193.28:0/2727341210 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x561126e93680 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb715ffb640 1 -- 10.20.193.28:0/2727341210 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fb740004410 con 0x561126fa0e80 2026-02-20T03:31:41.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 10 client.20106 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:41.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 10 client.20106 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:31:41.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 20 client.20106 populate_metadata read hostname 'trial028' 2026-02-20T03:31:41.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561126fb1280 0x561126fb3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 4 client.20106 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:41.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.624+0000 7fb75c92be00 1 -- 10.20.193.28:0/2727341210 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561126ec47d0 con 0x561126fb1280 2026-02-20T03:31:41.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.651+0000 7fb7537fe640 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561126fb1280 0x561126fb3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.692+0000 7fb7537fe640 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561126fb1280 0x561126fb3740 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=21464d6a17f04412 server_cookie=3480c44691a98908 in_seq=0 out_seq=0 2026-02-20T03:31:41.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.692+0000 7fb715ffb640 10 client.20106 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:41.707 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 17.19 MB/sec execute 72 sec latency 52188.026 ms 2026-02-20T03:31:41.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb715ffb640 1 -- 10.20.193.28:0/2727341210 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561126ec47d0 con 0x561126fb1280 2026-02-20T03:31:41.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb715ffb640 10 client.20106 handle_command_reply: tid=0 2026-02-20T03:31:41.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 client.20106 shutdown 2026-02-20T03:31:41.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 -- 10.20.193.28:0/2727341210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 msgr2=0x561126fc3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:41.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc3ef0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb740009f00 tx=0x7fb74000b4b0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 -- 10.20.193.28:0/2727341210 shutdown_connections 2026-02-20T03:31:41.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa5650 0x561126fc26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa1840 0x561126fc4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561126fb1280 0x561126fb3740 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 --2- 10.20.193.28:0/2727341210 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc3ef0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 -- 10.20.193.28:0/2727341210 >> 10.20.193.28:0/2727341210 conn(0x561126f99a60 msgr2=0x561126fa4310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:41.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb715ffb640 0 client.20106 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:41.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 -- 10.20.193.28:0/2727341210 shutdown_connections 2026-02-20T03:31:41.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 1 -- 10.20.193.28:0/2727341210 wait complete. 2026-02-20T03:31:41.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.705+0000 7fb75c92be00 20 client.20106 trim_cache size 0 max 16384 2026-02-20T03:31:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:41 trial177 ceph-mon[43181]: pgmap v695: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 11 op/s 2026-02-20T03:31:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:41 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1106088008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:41.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 Processor -- start 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 -- start start 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa0e80 0x561126fc14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa1840 0x561126fe54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa5650 0x561126fe59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f8012740 con 0x561126fa1840 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f800ffb0 con 0x561126fa5650 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f800de00 con 0x561126fa0e80 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb7537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa1840 0x561126fe54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb7537fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa1840 0x561126fe54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33282/0 (socket says 10.20.193.28:33282) 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb7537fe640 1 -- 10.20.193.28:0/443736986 learned_addr learned my addr 10.20.193.28:0/443736986 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:41.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb7537fe640 1 -- 10.20.193.28:0/443736986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa0e80 msgr2=0x561126fc14e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb7537fe640 1 --2- 10.20.193.28:0/443736986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa0e80 0x561126fc14e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb7537fe640 1 -- 10.20.193.28:0/443736986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa5650 msgr2=0x561126fe59e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb7537fe640 1 --2- 10.20.193.28:0/443736986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa5650 0x561126fe59e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb7537fe640 1 -- 10.20.193.28:0/443736986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561126fbbda0 con 0x561126fa1840 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb7537fe640 1 --2- 10.20.193.28:0/443736986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa1840 0x561126fe54a0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fb744002fa0 tx=0x7fb744041450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c7598b2e73515a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb717fff640 1 -- 10.20.193.28:0/443736986 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7440d17e0 con 0x561126fa1840 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb717fff640 1 -- 10.20.193.28:0/443736986 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb744033030 con 0x561126fa1840 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb717fff640 1 -- 10.20.193.28:0/443736986 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb744105360 con 0x561126fa1840 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 -- 10.20.193.28:0/443736986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa1840 msgr2=0x561126fe54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 --2- 10.20.193.28:0/443736986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa1840 0x561126fe54a0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fb744002fa0 tx=0x7fb744041450 comp rx=0 tx=0).stop 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 -- 10.20.193.28:0/443736986 shutdown_connections 2026-02-20T03:31:41.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 --2- 10.20.193.28:0/443736986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa5650 0x561126fe59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 --2- 10.20.193.28:0/443736986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa1840 0x561126fe54a0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 --2- 10.20.193.28:0/443736986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa0e80 0x561126fc14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 -- 10.20.193.28:0/443736986 >> 10.20.193.28:0/443736986 conn(0x561126f99a60 msgr2=0x561126fc0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:41.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 -- 10.20.193.28:0/443736986 shutdown_connections 2026-02-20T03:31:41.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.711+0000 7fb75c92be00 1 -- 10.20.193.28:0/443736986 wait complete. 2026-02-20T03:31:41.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 -- start start 2026-02-20T03:31:41.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 Processor -- start 2026-02-20T03:31:41.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa1840 0x561126fca490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa5650 0x561126fca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f800e470 con 0x561126fa0e80 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f800f8e0 con 0x561126fa5650 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f800eb40 con 0x561126fa1840 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb753fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb753fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33296/0 (socket says 10.20.193.28:33296) 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb753fff640 1 -- 10.20.193.28:0/3742529309 learned_addr learned my addr 10.20.193.28:0/3742529309 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb753fff640 1 -- 10.20.193.28:0/3742529309 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa1840 msgr2=0x561126fca490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb753fff640 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa1840 0x561126fca490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb753fff640 1 -- 10.20.193.28:0/3742529309 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa5650 msgr2=0x561126fca9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb753fff640 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa5650 0x561126fca9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb753fff640 1 -- 10.20.193.28:0/3742529309 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561126c576c0 con 0x561126fa0e80 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb753fff640 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc9f50 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fb740009830 tx=0x7fb740009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c857477492d926c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb715ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb715ffb640 1 -- 10.20.193.28:0/3742529309 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740016040 con 0x561126fa0e80 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb715ffb640 1 -- 10.20.193.28:0/3742529309 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x561126e75f90 con 0x561126fa0e80 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb715ffb640 1 -- 10.20.193.28:0/3742529309 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740027470 con 0x561126fa0e80 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 -- 10.20.193.28:0/3742529309 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561126e84140 con 0x561126fa0e80 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 10 client.20112 _ll_register_callbacks cb 0x7fb740009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb715ffb640 1 -- 10.20.193.28:0/3742529309 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fb740011400 con 0x561126fa0e80 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 -- 10.20.193.28:0/3742529309 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561126efb470 con 0x561126fa0e80 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb715ffb640 1 -- 10.20.193.28:0/3742529309 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fb740002980 con 0x561126fa0e80 2026-02-20T03:31:41.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 10 client.20112 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:41.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 -- 10.20.193.28:0/3742529309 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x561126fbca90 con 0x561126fa0e80 2026-02-20T03:31:41.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb715ffb640 1 -- 10.20.193.28:0/3742529309 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7fb74002f030 con 0x561126fa0e80 2026-02-20T03:31:41.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 10 client.20112 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:41.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 10 client.20112 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:31:41.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 20 client.20112 populate_metadata read hostname 'trial028' 2026-02-20T03:31:41.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561127048ba0 0x56112704b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:41.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 4 client.20112 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-f621fbc0-1-mds.h.json"}] 2026-02-20T03:31:41.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.716+0000 7fb75c92be00 1 -- 10.20.193.28:0/3742529309 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-f621fbc0-1-mds.h.json"}) -- 0x7fb744033030 con 0x561127048ba0 2026-02-20T03:31:41.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.732+0000 7fb7537fe640 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561127048ba0 0x56112704b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.799+0000 7fb7537fe640 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561127048ba0 0x56112704b060 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6eaa48e8208984d2 server_cookie=cbced4c9c0b0004a in_seq=0 out_seq=0 2026-02-20T03:31:41.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.799+0000 7fb715ffb640 10 client.20112 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:41.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb715ffb640 1 -- 10.20.193.28:0/3742529309 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x7fb744033030 con 0x561127048ba0 2026-02-20T03:31:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb715ffb640 10 client.20112 handle_command_reply: tid=0 2026-02-20T03:31:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 client.20112 shutdown 2026-02-20T03:31:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 -- 10.20.193.28:0/3742529309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 msgr2=0x561126fc9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:41.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc9f50 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fb740009830 tx=0x7fb740009b40 comp rx=0 tx=0).stop 2026-02-20T03:31:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 -- 10.20.193.28:0/3742529309 shutdown_connections 2026-02-20T03:31:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561126fa5650 0x561126fca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561126fa1840 0x561126fca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x561127048ba0 0x56112704b060 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 --2- 10.20.193.28:0/3742529309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561126fa0e80 0x561126fc9f50 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 -- 10.20.193.28:0/3742529309 >> 10.20.193.28:0/3742529309 conn(0x561126f99a60 msgr2=0x561126fc15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb715ffb640 0 client.20112 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 -- 10.20.193.28:0/3742529309 shutdown_connections 2026-02-20T03:31:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 1 -- 10.20.193.28:0/3742529309 wait complete. 2026-02-20T03:31:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75c92be00 20 client.20112 trim_cache size 0 max 16384 2026-02-20T03:31:41.817 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:41.817 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/var/run/ceph/ops-f621fbc0-1-mds.h.json" 2026-02-20T03:31:41.817 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:41.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 -- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7280b0e20 msgr2=0x7fb7280b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:41.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7280b0e20 0x7fb7280b32e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb74801a000 tx=0x7fb74801d000 comp rx=0 tx=0).stop 2026-02-20T03:31:41.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 -- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 msgr2=0x7fb75419d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:41.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 0x7fb75419d820 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb744009a00 tx=0x7fb744002910 comp rx=0 tx=0).stop 2026-02-20T03:31:41.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 -- 10.20.193.28:0/2998370472 shutdown_connections 2026-02-20T03:31:41.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb7280b0e20 0x7fb7280b32e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb754109ed0 0x7fb7541a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb754105750 0x7fb75419d820 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 --2- 10.20.193.28:0/2998370472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb754104da0 0x7fb75419d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:41.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 -- 10.20.193.28:0/2998370472 >> 10.20.193.28:0/2998370472 conn(0x7fb754100840 msgr2=0x7fb754101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:41.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 -- 10.20.193.28:0/2998370472 shutdown_connections 2026-02-20T03:31:41.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:41.812+0000 7fb75a426640 1 -- 10.20.193.28:0/2998370472 wait complete. 2026-02-20T03:31:41.988 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 1 (i) to a remote file /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.i.json 2026-02-20T03:31:41.988 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 ops --flags=locks --path=/var/run/ceph/ops-f621fbc0-1-mds.i.json 2026-02-20T03:31:42.322 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:42.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.565+0000 7febc493a640 1 -- 10.20.193.28:0/367841285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc010a980 msgr2=0x7febc010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:42.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.565+0000 7febc493a640 1 --2- 10.20.193.28:0/367841285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc010a980 0x7febc010ad60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7febac009a60 tx=0x7febac02f290 comp rx=0 tx=0).stop 2026-02-20T03:31:42.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- 10.20.193.28:0/367841285 shutdown_connections 2026-02-20T03:31:42.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 --2- 10.20.193.28:0/367841285 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7febc0105320 0x7febc0111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 --2- 10.20.193.28:0/367841285 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc0104980 0x7febc0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 --2- 10.20.193.28:0/367841285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc010a980 0x7febc010ad60 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- 10.20.193.28:0/367841285 >> 10.20.193.28:0/367841285 conn(0x7febc0100680 msgr2=0x7febc0102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:42.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- 10.20.193.28:0/367841285 shutdown_connections 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- 10.20.193.28:0/367841285 wait complete. 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 Processor -- start 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- start start 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc0104980 0x7febc0077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc0105320 0x7febc0077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7febc010a980 0x7febc0078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7febc0114cd0 con 0x7febc0105320 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7febc0114b50 con 0x7febc010a980 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7febc0114e50 con 0x7febc0104980 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc0105320 0x7febc0077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc0105320 0x7febc0077b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33312/0 (socket says 10.20.193.28:33312) 2026-02-20T03:31:42.571 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbeffd640 1 -- 10.20.193.28:0/767513877 learned_addr learned my addr 10.20.193.28:0/767513877 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbeffd640 1 -- 10.20.193.28:0/767513877 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc0104980 msgr2=0x7febc0077600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbeffd640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc0104980 0x7febc0077600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbeffd640 1 -- 10.20.193.28:0/767513877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7febc010a980 msgr2=0x7febc0078080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbeffd640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7febc010a980 0x7febc0078080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbeffd640 1 -- 10.20.193.28:0/767513877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc01adb30 con 0x7febc0105320 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbeffd640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc0105320 0x7febc0077b40 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7febb000b5a0 tx=0x7febb000ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbcff9640 1 -- 10.20.193.28:0/767513877 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0012070 con 0x7febc0105320 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbcff9640 1 -- 10.20.193.28:0/767513877 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7febb0004480 con 0x7febc0105320 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbcff9640 1 -- 10.20.193.28:0/767513877 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb000dac0 con 0x7febc0105320 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- 10.20.193.28:0/767513877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc01ade20 con 0x7febc0105320 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febc493a640 1 -- 10.20.193.28:0/767513877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc01ae270 con 0x7febc0105320 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.567+0000 7febbcff9640 1 -- 10.20.193.28:0/767513877 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7febb000dce0 con 0x7febc0105320 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febc80c8e00 1 Processor -- start 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febc80c8e00 1 -- start start 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 0x55e01ddcd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 0x55e01ddd1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febc80c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e01dd1f880 con 0x55e01ddd1b50 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febc80c8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e01dccd350 con 0x55e01ddcd260 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febc80c8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e01dd1b7b0 con 0x55e01ddcdc10 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33314/0 (socket says 10.20.193.28:33314) 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.572+0000 7febbeffd640 1 -- 10.20.193.28:0/3102992779 learned_addr learned my addr 10.20.193.28:0/3102992779 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbeffd640 1 -- 10.20.193.28:0/3102992779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 msgr2=0x55e01ddd1530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbeffd640 1 --2- 10.20.193.28:0/3102992779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 0x55e01ddd1530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbeffd640 1 -- 10.20.193.28:0/3102992779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 msgr2=0x55e01ddcd640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:42.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbeffd640 1 --2- 10.20.193.28:0/3102992779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 0x55e01ddcd640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbeffd640 1 -- 10.20.193.28:0/3102992779 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e01dcc59a0 con 0x55e01ddd1b50 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbeffd640 1 --2- 10.20.193.28:0/3102992779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd1fb0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7febb00e84b0 tx=0x7febb00e85b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de01b9b00e8872bc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbcff9640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feb940b0da0 0x7feb940b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb83fff640 1 -- 10.20.193.28:0/3102992779 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00f3070 con 0x55e01ddd1b50 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbcff9640 1 -- 10.20.193.28:0/767513877 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7febb00e0170 con 0x7febc0105320 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb83fff640 1 -- 10.20.193.28:0/3102992779 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7febb000a610 con 0x55e01ddd1b50 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb83fff640 1 -- 10.20.193.28:0/3102992779 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00a7c20 con 0x55e01ddd1b50 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbffff640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feb940b0da0 0x7feb940b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- 10.20.193.28:0/3102992779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 msgr2=0x55e01ddd1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:42.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 --2- 10.20.193.28:0/3102992779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd1fb0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7febb00e84b0 tx=0x7febb00e85b0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- 10.20.193.28:0/3102992779 shutdown_connections 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 --2- 10.20.193.28:0/3102992779 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd1fb0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 --2- 10.20.193.28:0/3102992779 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 0x55e01ddd1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 --2- 10.20.193.28:0/3102992779 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 0x55e01ddcd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- 10.20.193.28:0/3102992779 >> 10.20.193.28:0/3102992779 conn(0x55e01ddc9390 msgr2=0x55e01ddcb780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- 10.20.193.28:0/3102992779 shutdown_connections 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- 10.20.193.28:0/3102992779 wait complete. 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbffff640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feb940b0da0 0x7feb940b3260 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7febb400aab0 tx=0x7febb4009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- start start 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 Processor -- start 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcd260 0x55e01dde75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 0x55e01dde7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddd1b50 0x55e01dde5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e01dcc7130 con 0x55e01ddcd260 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e01ddd9d40 con 0x55e01ddd1b50 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e01dde6330 con 0x55e01ddcdc10 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcd260 0x55e01dde75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcd260 0x55e01dde75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33328/0 (socket says 10.20.193.28:33328) 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbf7fe640 1 -- 10.20.193.28:0/501433128 learned_addr learned my addr 10.20.193.28:0/501433128 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbf7fe640 1 -- 10.20.193.28:0/501433128 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 msgr2=0x55e01dde7b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbf7fe640 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 0x55e01dde7b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbf7fe640 1 -- 10.20.193.28:0/501433128 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddd1b50 msgr2=0x55e01dde5da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbf7fe640 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddd1b50 0x55e01dde5da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbf7fe640 1 -- 10.20.193.28:0/501433128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e01dddf550 con 0x55e01ddcd260 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febbf7fe640 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcd260 0x55e01dde75f0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7febac005d10 tx=0x7febac002f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b42f53c84db3361 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb817fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb817fa640 1 -- 10.20.193.28:0/501433128 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac0028f0 con 0x55e01ddcd260 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- 10.20.193.28:0/501433128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e01daeeec0 con 0x55e01ddcd260 2026-02-20T03:31:42.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 10 client.20124 _ll_register_callbacks cb 0x55e01dccb060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- 10.20.193.28:0/501433128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e01dd27470 con 0x55e01ddcd260 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb817fa640 1 -- 10.20.193.28:0/501433128 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7febac033040 con 0x55e01ddcd260 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb817fa640 1 -- 10.20.193.28:0/501433128 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac0028f0 con 0x55e01ddcd260 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb817fa640 1 -- 10.20.193.28:0/501433128 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7febac038880 con 0x55e01ddcd260 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb817fa640 1 -- 10.20.193.28:0/501433128 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7febac02fab0 con 0x55e01ddcd260 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 10 client.20124 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- 10.20.193.28:0/501433128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55e01dcbf680 con 0x55e01ddcd260 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7feb817fa640 1 -- 10.20.193.28:0/501433128 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7febac02fc50 con 0x55e01ddcd260 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 10 client.20124 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 10 client.20124 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 20 client.20124 populate_metadata read hostname 'trial028' 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e01ddf5d80 0x55e01ddf8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 4 client.20124 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:42.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.573+0000 7febc80c8e00 1 -- 10.20.193.28:0/501433128 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e01dca1f90 con 0x55e01ddf5d80 2026-02-20T03:31:42.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.600+0000 7febbeffd640 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e01ddf5d80 0x55e01ddf8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:42.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.641+0000 7febbeffd640 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e01ddf5d80 0x55e01ddf8220 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=50baba62635ba161 server_cookie=3a6c03a929198ab9 in_seq=0 out_seq=0 2026-02-20T03:31:42.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.641+0000 7feb817fa640 10 client.20124 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:42.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7feb817fa640 1 -- 10.20.193.28:0/501433128 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e01dca1f90 con 0x55e01ddf5d80 2026-02-20T03:31:42.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7feb817fa640 10 client.20124 handle_command_reply: tid=0 2026-02-20T03:31:42.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 client.20124 shutdown 2026-02-20T03:31:42.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 -- 10.20.193.28:0/501433128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcd260 msgr2=0x55e01dde75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:42.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcd260 0x55e01dde75f0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7febac005d10 tx=0x7febac002f80 comp rx=0 tx=0).stop 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 -- 10.20.193.28:0/501433128 shutdown_connections 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e01ddf5d80 0x55e01ddf8220 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddd1b50 0x55e01dde5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 0x55e01dde7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 --2- 10.20.193.28:0/501433128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcd260 0x55e01dde75f0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 -- 10.20.193.28:0/501433128 >> 10.20.193.28:0/501433128 conn(0x55e01ddc9390 msgr2=0x55e01ddd2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7feb817fa640 0 client.20124 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 -- 10.20.193.28:0/501433128 shutdown_connections 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 1 -- 10.20.193.28:0/501433128 wait complete. 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.667+0000 7febc80c8e00 20 client.20124 trim_cache size 0 max 16384 2026-02-20T03:31:42.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febc80c8e00 1 Processor -- start 2026-02-20T03:31:42.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febc80c8e00 1 -- start start 2026-02-20T03:31:42.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 0x55e01ddd2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 0x55e01dde3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febc80c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feb64012850 con 0x55e01ddd1b50 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febc80c8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7feb640100c0 con 0x55e01ddcd260 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febc80c8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7feb6400deb0 con 0x55e01ddcdc10 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33336/0 (socket says 10.20.193.28:33336) 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febbffff640 1 -- 10.20.193.28:0/2378682212 learned_addr learned my addr 10.20.193.28:0/2378682212 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febbffff640 1 -- 10.20.193.28:0/2378682212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 msgr2=0x55e01dde3580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febbffff640 1 --2- 10.20.193.28:0/2378682212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 0x55e01dde3580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febbffff640 1 -- 10.20.193.28:0/2378682212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 msgr2=0x55e01ddd2f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febbffff640 1 --2- 10.20.193.28:0/2378682212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 0x55e01ddd2f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febbffff640 1 -- 10.20.193.28:0/2378682212 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e01dddf380 con 0x55e01ddd1b50 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7febbffff640 1 --2- 10.20.193.28:0/2378682212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd0b80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7febb400cc10 tx=0x7febb400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7a48348e4cbfa8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7feb837fe640 1 -- 10.20.193.28:0/2378682212 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4006e60 con 0x55e01ddd1b50 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7feb837fe640 1 -- 10.20.193.28:0/2378682212 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7febb401f020 con 0x55e01ddd1b50 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.672+0000 7feb837fe640 1 -- 10.20.193.28:0/2378682212 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb400d660 con 0x55e01ddd1b50 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- 10.20.193.28:0/2378682212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 msgr2=0x55e01ddd0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 --2- 10.20.193.28:0/2378682212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd0b80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7febb400cc10 tx=0x7febb400f000 comp rx=0 tx=0).stop 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- 10.20.193.28:0/2378682212 shutdown_connections 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 --2- 10.20.193.28:0/2378682212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddd1b50 0x55e01ddd0b80 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 --2- 10.20.193.28:0/2378682212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddcdc10 0x55e01dde3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 --2- 10.20.193.28:0/2378682212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 0x55e01ddd2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- 10.20.193.28:0/2378682212 >> 10.20.193.28:0/2378682212 conn(0x55e01ddc9390 msgr2=0x55e01ddd0470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:42.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- 10.20.193.28:0/2378682212 shutdown_connections 2026-02-20T03:31:42.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- 10.20.193.28:0/2378682212 wait complete. 2026-02-20T03:31:42.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- start start 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 Processor -- start 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 0x55e01ddee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcdc10 0x55e01ddee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddd1b50 0x55e01de61d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7feb6400e580 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7feb6400f9f0 con 0x55e01ddcd260 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7feb6400ec50 con 0x55e01ddd1b50 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcdc10 0x55e01ddee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcdc10 0x55e01ddee640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33340/0 (socket says 10.20.193.28:33340) 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febbeffd640 1 -- 10.20.193.28:0/4098723964 learned_addr learned my addr 10.20.193.28:0/4098723964 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febbeffd640 1 -- 10.20.193.28:0/4098723964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddd1b50 msgr2=0x55e01de61d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febbeffd640 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddd1b50 0x55e01de61d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febbeffd640 1 -- 10.20.193.28:0/4098723964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 msgr2=0x55e01ddee100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febbeffd640 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 0x55e01ddee100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febbeffd640 1 -- 10.20.193.28:0/4098723964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e01da836c0 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febbeffd640 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcdc10 0x55e01ddee640 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7febb00a7de0 tx=0x7febb00e83d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a35f06dcda0fbc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7feb817fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7feb817fa640 1 -- 10.20.193.28:0/4098723964 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb004e520 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7feb817fa640 1 -- 10.20.193.28:0/4098723964 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7febb00a8550 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7feb817fa640 1 -- 10.20.193.28:0/4098723964 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb004e6f0 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- 10.20.193.28:0/4098723964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e01dcb0140 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7feb817fa640 1 -- 10.20.193.28:0/4098723964 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7febb0090110 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7feb817fa640 10 client.20130 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 10 client.20130 _ll_register_callbacks cb 0x7febac009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- 10.20.193.28:0/4098723964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e01ddd95d0 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7feb817fa640 1 -- 10.20.193.28:0/4098723964 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7febb001c060 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 10 client.20130 fetch_fsmap learned FSMap version 40 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- 10.20.193.28:0/4098723964 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=40}) -- 0x55e01dde0070 con 0x55e01ddcdc10 2026-02-20T03:31:42.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7feb817fa640 1 -- 10.20.193.28:0/4098723964 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 40) ==== 8362+0+0 (secure 0 0 0) 0x7febb00dd860 con 0x55e01ddcdc10 2026-02-20T03:31:42.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 10 client.20130 fetch_fsmap finished waiting for FSMap version 40 2026-02-20T03:31:42.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 10 client.20130 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:31:42.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 20 client.20130 populate_metadata read hostname 'trial028' 2026-02-20T03:31:42.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e01de63390 0x55e01de65830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:42.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 4 client.20130 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-f621fbc0-1-mds.i.json"}] 2026-02-20T03:31:42.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.677+0000 7febc80c8e00 1 -- 10.20.193.28:0/4098723964 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-f621fbc0-1-mds.i.json"}) -- 0x55e01dd2d220 con 0x55e01de63390 2026-02-20T03:31:42.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.694+0000 7febbf7fe640 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e01de63390 0x55e01de65830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:42.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 16.95 MB/sec execute 73 sec latency 53188.066 ms 2026-02-20T03:31:42.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.761+0000 7febbf7fe640 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e01de63390 0x55e01de65830 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8282f0f53b29573c server_cookie=c93fc46c4df56a23 in_seq=0 out_seq=0 2026-02-20T03:31:42.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.761+0000 7feb817fa640 10 client.20130 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:42.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7feb817fa640 1 -- 10.20.193.28:0/4098723964 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x55e01dd2d220 con 0x55e01de63390 2026-02-20T03:31:42.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7feb817fa640 10 client.20130 handle_command_reply: tid=0 2026-02-20T03:31:42.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 client.20130 shutdown 2026-02-20T03:31:42.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 -- 10.20.193.28:0/4098723964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcdc10 msgr2=0x55e01ddee640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcdc10 0x55e01ddee640 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7febb00a7de0 tx=0x7febb00e83d0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 -- 10.20.193.28:0/4098723964 shutdown_connections 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e01de63390 0x55e01de65830 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e01ddd1b50 0x55e01de61d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e01ddcdc10 0x55e01ddee640 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 --2- 10.20.193.28:0/4098723964 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e01ddcd260 0x55e01ddee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7feb817fa640 0 client.20130 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 -- 10.20.193.28:0/4098723964 >> 10.20.193.28:0/4098723964 conn(0x55e01ddc9390 msgr2=0x55e01ddd0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 -- 10.20.193.28:0/4098723964 shutdown_connections 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 1 -- 10.20.193.28:0/4098723964 wait complete. 2026-02-20T03:31:42.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc80c8e00 20 client.20130 trim_cache size 0 max 16384 2026-02-20T03:31:42.789 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/var/run/ceph/ops-f621fbc0-1-mds.i.json" 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 -- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feb940b0da0 msgr2=0x7feb940b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feb940b0da0 0x7feb940b3260 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7febb400aab0 tx=0x7febb4009250 comp rx=0 tx=0).stop 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 -- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc0105320 msgr2=0x7febc0077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc0105320 0x7febc0077b40 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7febb000b5a0 tx=0x7febb000ba70 comp rx=0 tx=0).stop 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 -- 10.20.193.28:0/767513877 shutdown_connections 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7feb940b0da0 0x7feb940b3260 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7febc010a980 0x7febc0078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7febc0105320 0x7febc0077b40 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 --2- 10.20.193.28:0/767513877 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7febc0104980 0x7febc0077600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 -- 10.20.193.28:0/767513877 >> 10.20.193.28:0/767513877 conn(0x7febc0100680 msgr2=0x7febc0101180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 -- 10.20.193.28:0/767513877 shutdown_connections 2026-02-20T03:31:42.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:42.774+0000 7febc493a640 1 -- 10.20.193.28:0/767513877 wait complete. 2026-02-20T03:31:43.013 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 0 (b) to a remote file /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.b.json 2026-02-20T03:31:43.013 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 ops --flags=locks --path=/var/run/ceph/ops-f621fbc0-1-mds.b.json 2026-02-20T03:31:43.310 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:43.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/3358681939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d1810f1e0 msgr2=0x7f2d1810f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:43.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/3358681939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d1810f1e0 0x7f2d1810f5c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009a30 tx=0x7f2d0802f260 comp rx=0 tx=0).stop 2026-02-20T03:31:43.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/3358681939 shutdown_connections 2026-02-20T03:31:43.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/3358681939 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d18109bc0 0x7f2d18115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/3358681939 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d18109220 0x7f2d18109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/3358681939 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d1810f1e0 0x7f2d1810f5c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/3358681939 >> 10.20.193.28:0/3358681939 conn(0x7f2d18078860 msgr2=0x7f2d1807ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/3358681939 shutdown_connections 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/3358681939 wait complete. 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.564+0000 7f2d1ee0c640 1 Processor -- start 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d1ee0c640 1 -- start start 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d1ee0c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d18109220 0x7f2d181a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d1ee0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d18109bc0 0x7f2d181a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d1ee0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d1810f1e0 0x7f2d181a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d1ee0c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2d18119430 con 0x7f2d18109bc0 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d1ee0c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181192b0 con 0x7f2d18109220 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d1ee0c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181195b0 con 0x7f2d1810f1e0 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d18109bc0 0x7f2d181a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d0ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d18109bc0 0x7f2d181a7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33366/0 (socket says 10.20.193.28:33366) 2026-02-20T03:31:43.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.565+0000 7f2d0ffff640 1 -- 10.20.193.28:0/2962446577 learned_addr learned my addr 10.20.193.28:0/2962446577 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0ffff640 1 -- 10.20.193.28:0/2962446577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d1810f1e0 msgr2=0x7f2d181a16b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0ffff640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d1810f1e0 0x7f2d181a16b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0ffff640 1 -- 10.20.193.28:0/2962446577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d18109220 msgr2=0x7f2d181a75e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0ffff640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d18109220 0x7f2d181a75e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0ffff640 1 -- 10.20.193.28:0/2962446577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d181a1f40 con 0x7f2d18109bc0 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0ffff640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d18109bc0 0x7f2d181a7b20 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000b570 tx=0x7f2d0000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0dffb640 1 -- 10.20.193.28:0/2962446577 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d00013020 con 0x7f2d18109bc0 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0dffb640 1 -- 10.20.193.28:0/2962446577 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d00004480 con 0x7f2d18109bc0 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/2962446577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d181a2230 con 0x7f2d18109bc0 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0dffb640 1 -- 10.20.193.28:0/2962446577 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000fb50 con 0x7f2d18109bc0 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/2962446577 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d181ae560 con 0x7f2d18109bc0 2026-02-20T03:31:43.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.566+0000 7f2d0dffb640 1 -- 10.20.193.28:0/2962446577 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2d00002780 con 0x7f2d18109bc0 2026-02-20T03:31:43.574 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:43 trial028 ceph-mon[38552]: pgmap v696: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 5.5 KiB/s wr, 9 op/s 2026-02-20T03:31:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.570+0000 7f2d21311e00 1 Processor -- start 2026-02-20T03:31:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 -- start start 2026-02-20T03:31:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x55951659da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516598e80 0x559516599300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516599840 0x5595165a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5595164eb880 con 0x55951659d650 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559516499350 con 0x559516599840 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5595164e77b0 con 0x559516598e80 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1d382640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x55951659da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1d382640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x55951659da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33382/0 (socket says 10.20.193.28:33382) 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1d382640 1 -- 10.20.193.28:0/1224203445 learned_addr learned my addr 10.20.193.28:0/1224203445 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1d382640 1 -- 10.20.193.28:0/1224203445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516598e80 msgr2=0x559516599300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1d382640 1 --2- 10.20.193.28:0/1224203445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516598e80 0x559516599300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1d382640 1 -- 10.20.193.28:0/1224203445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516599840 msgr2=0x5595165a55e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1d382640 1 --2- 10.20.193.28:0/1224203445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516599840 0x5595165a55e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1d382640 1 -- 10.20.193.28:0/1224203445 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595164919a0 con 0x55951659d650 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1d382640 1 --2- 10.20.193.28:0/1224203445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x55951659da30 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009bd0 tx=0x7f2d1400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7041f395b2b7a51b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d0dffb640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2cf40b0e20 0x7f2cf40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2ce54e4640 1 -- 10.20.193.28:0/1224203445 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14017070 con 0x55951659d650 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2ce54e4640 1 -- 10.20.193.28:0/1224203445 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d14012410 con 0x55951659d650 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2ce54e4640 1 -- 10.20.193.28:0/1224203445 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140042d0 con 0x55951659d650 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d0dffb640 1 -- 10.20.193.28:0/2962446577 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f2d000e04a0 con 0x7f2d18109bc0 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1cb81640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2cf40b0e20 0x7f2cf40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 -- 10.20.193.28:0/1224203445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 msgr2=0x55951659da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 --2- 10.20.193.28:0/1224203445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x55951659da30 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009bd0 tx=0x7f2d1400b420 comp rx=0 tx=0).stop 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d1cb81640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2cf40b0e20 0x7f2cf40b32e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009950 tx=0x7f2d080023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 -- 10.20.193.28:0/1224203445 shutdown_connections 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 --2- 10.20.193.28:0/1224203445 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516599840 0x5595165a55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 --2- 10.20.193.28:0/1224203445 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516598e80 0x559516599300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 --2- 10.20.193.28:0/1224203445 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x55951659da30 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 -- 10.20.193.28:0/1224203445 >> 10.20.193.28:0/1224203445 conn(0x559516591a60 msgr2=0x5595165973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 -- 10.20.193.28:0/1224203445 shutdown_connections 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.571+0000 7f2d21311e00 1 -- 10.20.193.28:0/1224203445 wait complete. 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 -- start start 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 Processor -- start 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516598e80 0x5595165c4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516599840 0x5595165c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165c3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559516493130 con 0x55951659d650 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5595165b6fd0 con 0x559516598e80 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5595165c35c0 con 0x559516599840 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d1d382640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d1d382640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165c3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33398/0 (socket says 10.20.193.28:33398) 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d1d382640 1 -- 10.20.193.28:0/3679644580 learned_addr learned my addr 10.20.193.28:0/3679644580 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d1d382640 1 -- 10.20.193.28:0/3679644580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516599840 msgr2=0x5595165c4dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d1d382640 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516599840 0x5595165c4dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d1d382640 1 -- 10.20.193.28:0/3679644580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516598e80 msgr2=0x5595165c4880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d1d382640 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516598e80 0x5595165c4880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d1d382640 1 -- 10.20.193.28:0/3679644580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595165bc7f0 con 0x55951659d650 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d1d382640 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165c3030 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f2d14015040 tx=0x7f2d14009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1a2efc1b9ee312 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:43.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2cd67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3679644580 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14017050 con 0x55951659d650 2026-02-20T03:31:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3679644580 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d14023070 con 0x55951659d650 2026-02-20T03:31:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3679644580 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140040c0 con 0x55951659d650 2026-02-20T03:31:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 -- 10.20.193.28:0/3679644580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595162baec0 con 0x55951659d650 2026-02-20T03:31:43.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 10 client.20142 _ll_register_callbacks cb 0x559516497060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 -- 10.20.193.28:0/3679644580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5595164f3470 con 0x55951659d650 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3679644580 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f2d14012850 con 0x55951659d650 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3679644580 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2d1401e450 con 0x55951659d650 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 10 client.20142 fetch_fsmap learned FSMap version 41 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 -- 10.20.193.28:0/3679644580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=41}) -- 0x55951648b680 con 0x55951659d650 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3679644580 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 41) ==== 8358+0+0 (secure 0 0 0) 0x7f2d1401e5f0 con 0x55951659d650 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 10 client.20142 fetch_fsmap finished waiting for FSMap version 41 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 10 client.20142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 20 client.20142 populate_metadata read hostname 'trial028' 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595165d2fa0 0x5595165d5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 4 client.20142 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:43.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.573+0000 7f2d21311e00 1 -- 10.20.193.28:0/3679644580 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55951646df90 con 0x5595165d2fa0 2026-02-20T03:31:43.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.600+0000 7f2d1cb81640 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595165d2fa0 0x5595165d5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:43.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.667+0000 7f2d1cb81640 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595165d2fa0 0x5595165d5390 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=782c93960c6a2edf server_cookie=215002511250c3e2 in_seq=0 out_seq=0 2026-02-20T03:31:43.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.667+0000 7f2cd67fc640 10 client.20142 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.680+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3679644580 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55951646df90 con 0x5595165d2fa0 2026-02-20T03:31:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.680+0000 7f2cd67fc640 10 client.20142 handle_command_reply: tid=0 2026-02-20T03:31:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.680+0000 7f2d21311e00 1 client.20142 shutdown 2026-02-20T03:31:43.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.680+0000 7f2d21311e00 1 -- 10.20.193.28:0/3679644580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 msgr2=0x5595165c3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:43.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.680+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165c3030 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f2d14015040 tx=0x7f2d14009a10 comp rx=0 tx=0).stop 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2d21311e00 1 -- 10.20.193.28:0/3679644580 shutdown_connections 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595165d2fa0 0x5595165d5390 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165c3030 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516599840 0x5595165c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3679644580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516598e80 0x5595165c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2d21311e00 1 -- 10.20.193.28:0/3679644580 >> 10.20.193.28:0/3679644580 conn(0x559516591a60 msgr2=0x55951659c310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2cd67fc640 0 client.20142 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2d21311e00 1 -- 10.20.193.28:0/3679644580 shutdown_connections 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2d21311e00 1 -- 10.20.193.28:0/3679644580 wait complete. 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.683+0000 7f2d21311e00 20 client.20142 trim_cache size 0 max 16384 2026-02-20T03:31:43.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 Processor -- start 2026-02-20T03:31:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 -- start start 2026-02-20T03:31:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516598e80 0x5595165c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516599840 0x5595165dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165db040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc012790 con 0x55951659d650 2026-02-20T03:31:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc010030 con 0x559516599840 2026-02-20T03:31:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc00de80 con 0x559516598e80 2026-02-20T03:31:43.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d1d382640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165db040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d1d382640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165db040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33412/0 (socket says 10.20.193.28:33412) 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d1d382640 1 -- 10.20.193.28:0/262957598 learned_addr learned my addr 10.20.193.28:0/262957598 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d1d382640 1 -- 10.20.193.28:0/262957598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516598e80 msgr2=0x5595165c8220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d1d382640 1 --2- 10.20.193.28:0/262957598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516598e80 0x5595165c8220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d1d382640 1 -- 10.20.193.28:0/262957598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516599840 msgr2=0x5595165dab00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d1d382640 1 --2- 10.20.193.28:0/262957598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516599840 0x5595165dab00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d1d382640 1 -- 10.20.193.28:0/262957598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595165bc620 con 0x55951659d650 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d1d382640 1 --2- 10.20.193.28:0/262957598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165db040 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009600 tx=0x7f2d14007060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9d9c45d688b6eb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2ce4ce3640 1 -- 10.20.193.28:0/262957598 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14017070 con 0x55951659d650 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2ce4ce3640 1 -- 10.20.193.28:0/262957598 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d14023040 con 0x55951659d650 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2ce4ce3640 1 -- 10.20.193.28:0/262957598 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140286c0 con 0x55951659d650 2026-02-20T03:31:43.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 -- 10.20.193.28:0/262957598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 msgr2=0x5595165db040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 --2- 10.20.193.28:0/262957598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165db040 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009600 tx=0x7f2d14007060 comp rx=0 tx=0).stop 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 -- 10.20.193.28:0/262957598 shutdown_connections 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 --2- 10.20.193.28:0/262957598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55951659d650 0x5595165db040 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 --2- 10.20.193.28:0/262957598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559516599840 0x5595165dab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 --2- 10.20.193.28:0/262957598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516598e80 0x5595165c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 -- 10.20.193.28:0/262957598 >> 10.20.193.28:0/262957598 conn(0x559516591a60 msgr2=0x55951659ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 -- 10.20.193.28:0/262957598 shutdown_connections 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.689+0000 7f2d21311e00 1 -- 10.20.193.28:0/262957598 wait complete. 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 -- start start 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 Processor -- start 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559516598e80 0x5595165cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516599840 0x5595165cc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55951659d650 0x5595165ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc00e4f0 con 0x559516598e80 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc00f960 con 0x55951659d650 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc00ebc0 con 0x559516599840 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d1cb81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559516598e80 0x5595165cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d1cb81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559516598e80 0x5595165cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33426/0 (socket says 10.20.193.28:33426) 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d1cb81640 1 -- 10.20.193.28:0/3875814370 learned_addr learned my addr 10.20.193.28:0/3875814370 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d1cb81640 1 -- 10.20.193.28:0/3875814370 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516599840 msgr2=0x5595165cc710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d1cb81640 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516599840 0x5595165cc710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d1cb81640 1 -- 10.20.193.28:0/3875814370 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55951659d650 msgr2=0x5595165ccc50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d1cb81640 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55951659d650 0x5595165ccc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d1cb81640 1 -- 10.20.193.28:0/3875814370 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55951624f6c0 con 0x559516598e80 2026-02-20T03:31:43.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d1cb81640 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559516598e80 0x5595165cf310 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f2d08002fd0 tx=0x7f2d08009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16a4a168ca5a0c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:43.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2cd67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:43.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3875814370 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08052030 con 0x559516598e80 2026-02-20T03:31:43.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3875814370 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d08033040 con 0x559516598e80 2026-02-20T03:31:43.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3875814370 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08038790 con 0x559516598e80 2026-02-20T03:31:43.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 -- 10.20.193.28:0/3875814370 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55951647c140 con 0x559516598e80 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3875814370 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f2d080389b0 con 0x559516598e80 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 10 client.20148 _ll_register_callbacks cb 0x7f2d1400be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 -- 10.20.193.28:0/3875814370 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55951626c610 con 0x559516598e80 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3875814370 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2d0805c060 con 0x559516598e80 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 10 client.20148 fetch_fsmap learned FSMap version 41 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 -- 10.20.193.28:0/3875814370 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=41}) -- 0x5595165bd310 con 0x559516598e80 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3875814370 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 41) ==== 8358+0+0 (secure 0 0 0) 0x7f2d08038bb0 con 0x559516598e80 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 10 client.20148 fetch_fsmap finished waiting for FSMap version 41 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 10 client.20148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 20 client.20148 populate_metadata read hostname 'trial028' 2026-02-20T03:31:43.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55951663faf0 0x559516641fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:43.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 4 client.20148 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-f621fbc0-1-mds.b.json"}] 2026-02-20T03:31:43.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.694+0000 7f2d21311e00 1 -- 10.20.193.28:0/3875814370 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-f621fbc0-1-mds.b.json"}) -- 0x5595164f9220 con 0x55951663faf0 2026-02-20T03:31:43.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 16.72 MB/sec execute 74 sec latency 54188.101 ms 2026-02-20T03:31:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:43 trial177 ceph-mon[43181]: pgmap v696: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 5.5 KiB/s wr, 9 op/s 2026-02-20T03:31:43.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.721+0000 7f2d0ffff640 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55951663faf0 0x559516641fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:43.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.788+0000 7f2d0ffff640 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55951663faf0 0x559516641fb0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=416687a65f0e71aa server_cookie=402ade9cfc4fb727 in_seq=0 out_seq=0 2026-02-20T03:31:43.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.788+0000 7f2cd67fc640 10 client.20148 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:43.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2cd67fc640 1 -- 10.20.193.28:0/3875814370 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x5595164f9220 con 0x55951663faf0 2026-02-20T03:31:43.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2cd67fc640 10 client.20148 handle_command_reply: tid=0 2026-02-20T03:31:43.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 client.20148 shutdown 2026-02-20T03:31:43.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 -- 10.20.193.28:0/3875814370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559516598e80 msgr2=0x5595165cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:43.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559516598e80 0x5595165cf310 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f2d08002fd0 tx=0x7f2d08009340 comp rx=0 tx=0).stop 2026-02-20T03:31:43.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 -- 10.20.193.28:0/3875814370 shutdown_connections 2026-02-20T03:31:43.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55951663faf0 0x559516641fb0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55951659d650 0x5595165ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559516599840 0x5595165cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 --2- 10.20.193.28:0/3875814370 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559516598e80 0x5595165cf310 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 -- 10.20.193.28:0/3875814370 >> 10.20.193.28:0/3875814370 conn(0x559516591a60 msgr2=0x55951659bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:43.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2cd67fc640 0 client.20148 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:43.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 -- 10.20.193.28:0/3875814370 shutdown_connections 2026-02-20T03:31:43.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 1 -- 10.20.193.28:0/3875814370 wait complete. 2026-02-20T03:31:43.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d21311e00 20 client.20148 trim_cache size 0 max 16384 2026-02-20T03:31:43.817 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:43.818 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/var/run/ceph/ops-f621fbc0-1-mds.b.json" 2026-02-20T03:31:43.818 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:43.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2cf40b0e20 msgr2=0x7f2cf40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:43.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2cf40b0e20 0x7f2cf40b32e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009950 tx=0x7f2d080023d0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d18109bc0 msgr2=0x7f2d181a7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d18109bc0 0x7f2d181a7b20 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000b570 tx=0x7f2d0000ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/2962446577 shutdown_connections 2026-02-20T03:31:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2cf40b0e20 0x7f2cf40b32e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d1810f1e0 0x7f2d181a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d18109bc0 0x7f2d181a7b20 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 --2- 10.20.193.28:0/2962446577 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d18109220 0x7f2d181a75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/2962446577 >> 10.20.193.28:0/2962446577 conn(0x7f2d18078860 msgr2=0x7f2d1807a270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/2962446577 shutdown_connections 2026-02-20T03:31:43.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:43.801+0000 7f2d1ee0c640 1 -- 10.20.193.28:0/2962446577 wait complete. 2026-02-20T03:31:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:43 trial126 ceph-mon[38476]: pgmap v696: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 5.5 KiB/s wr, 9 op/s 2026-02-20T03:31:43.991 DEBUG:teuthology.orchestra.run.trial126:> mktemp 2026-02-20T03:31:44.011 INFO:teuthology.orchestra.run.trial126.stdout:/tmp/tmp.7qcQY3yOQy 2026-02-20T03:31:44.012 DEBUG:teuthology.orchestra.run.trial126:> sudo cp /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.h.json /tmp/tmp.7qcQY3yOQy 2026-02-20T03:31:44.079 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod 0666 /tmp/tmp.7qcQY3yOQy 2026-02-20T03:31:44.202 DEBUG:teuthology.orchestra.remote:trial126:/tmp/tmp.7qcQY3yOQy is 357KB 2026-02-20T03:31:44.291 DEBUG:teuthology.orchestra.run.trial126:> rm -fr /tmp/tmp.7qcQY3yOQy 2026-02-20T03:31:44.309 DEBUG:tasks.quiescer.fs.[cephfs]:read 365775B of ops from '/var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.h.json' on mds.2 (h) 2026-02-20T03:31:44.318 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:779 fp=#0x100000001fa' 2026-02-20T03:31:44.320 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:904 fp=#0x100000048f3' 2026-02-20T03:31:44.321 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:780 fp=#0x100000001fb' 2026-02-20T03:31:44.322 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:905 fp=#0x100000048d2' 2026-02-20T03:31:44.323 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:781 fp=#0x100000005e2' 2026-02-20T03:31:44.324 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:906 fp=#0x10000004ad5' 2026-02-20T03:31:44.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:782 fp=#0x100000005e3' 2026-02-20T03:31:44.325 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:846 fp=#0x100000048b1' 2026-02-20T03:31:44.326 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:907 fp=#0x100000049c0' 2026-02-20T03:31:44.327 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:783 fp=#0x100000005e4' 2026-02-20T03:31:44.329 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:908 fp=#0x10000004a05' 2026-02-20T03:31:44.330 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:784 fp=#0x1000000489c' 2026-02-20T03:31:44.332 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:909 fp=#0x100000049e0' 2026-02-20T03:31:44.333 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:910 fp=#0x1000000490e' 2026-02-20T03:31:44.336 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:911 fp=#0x10000004ac7' 2026-02-20T03:31:44.340 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:789 fp=#0x100000048ad' 2026-02-20T03:31:44.341 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:790 fp=#0x100000048af' 2026-02-20T03:31:44.346 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:794 fp=#0x1000000489f' 2026-02-20T03:31:44.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_path:mds.2:775 fp=#0x1' 2026-02-20T03:31:44.360 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:776 fp=#0x1' 2026-02-20T03:31:44.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:840 fp=#0x100000048ae' 2026-02-20T03:31:44.361 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'client_request(client.25141:443859 create owner_uid=1000, owner_gid=1002 #0x10000000015/GRAPH1.CDR 2026-02-20T03:30:56.727349+0000 caller_uid=1000, caller_gid=1002{6,36,1000,1002,})' 2026-02-20T03:31:44.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:777 fp=#0x10000000000' 2026-02-20T03:31:44.362 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:778 fp=#0x10000000001' 2026-02-20T03:31:44.363 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 2 (h) for f621fbc0-1: 'internal op quiesce_inode:mds.2:903 fp=#0x10000004951' 2026-02-20T03:31:44.364 INFO:tasks.quiescer.fs.[cephfs]:Pulled 138 ops from rank 2 (h) into home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/ops-f621fbc0-1-mds.h.json 2026-02-20T03:31:44.364 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -- /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.h.json 2026-02-20T03:31:44.388 DEBUG:teuthology.orchestra.run.trial177:> mktemp 2026-02-20T03:31:44.407 INFO:teuthology.orchestra.run.trial177.stdout:/tmp/tmp.hVyFjFjXkb 2026-02-20T03:31:44.407 DEBUG:teuthology.orchestra.run.trial177:> sudo cp /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.i.json /tmp/tmp.hVyFjFjXkb 2026-02-20T03:31:44.475 DEBUG:teuthology.orchestra.run.trial177:> sudo chmod 0666 /tmp/tmp.hVyFjFjXkb 2026-02-20T03:31:44.598 DEBUG:teuthology.orchestra.remote:trial177:/tmp/tmp.hVyFjFjXkb is 421KB 2026-02-20T03:31:44.630 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:44 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:31:44.693 DEBUG:teuthology.orchestra.run.trial177:> rm -fr /tmp/tmp.hVyFjFjXkb 2026-02-20T03:31:44.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 16.50 MB/sec execute 75 sec latency 55188.143 ms 2026-02-20T03:31:44.711 DEBUG:tasks.quiescer.fs.[cephfs]:read 431173B of ops from '/var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.i.json' on mds.1 (i) 2026-02-20T03:31:44.723 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_path:mds.1:840 fp=#0x1' 2026-02-20T03:31:44.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:996 fp=#0x100000049fb' 2026-02-20T03:31:44.724 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:841 fp=#0x1' 2026-02-20T03:31:44.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:997 fp=#0x10000004930' 2026-02-20T03:31:44.725 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:842 fp=#0x10000000000' 2026-02-20T03:31:44.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:998 fp=#0x10000004add' 2026-02-20T03:31:44.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:843 fp=#0x10000000001' 2026-02-20T03:31:44.726 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:844 fp=#0x100000001fa' 2026-02-20T03:31:44.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:846 fp=#0x100000001fb' 2026-02-20T03:31:44.728 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:847 fp=#0x100000005e2' 2026-02-20T03:31:44.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:848 fp=#0x100000005e3' 2026-02-20T03:31:44.729 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:880 fp=#0x10000004898' 2026-02-20T03:31:44.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:972 fp=#0x10000004965' 2026-02-20T03:31:44.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:849 fp=#0x100000005e4' 2026-02-20T03:31:44.730 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:973 fp=#0x10000004917' 2026-02-20T03:31:44.731 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:974 fp=#0x100000048f0' 2026-02-20T03:31:44.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:975 fp=#0x10000004af1' 2026-02-20T03:31:44.732 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:852 fp=#0x10000004897' 2026-02-20T03:31:44.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:976 fp=#0x100000049d6' 2026-02-20T03:31:44.733 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:977 fp=#0x10000004a20' 2026-02-20T03:31:44.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:854 fp=#0x100000048a8' 2026-02-20T03:31:44.734 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:978 fp=#0x100000049fc' 2026-02-20T03:31:44.735 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:979 fp=#0x1000000492f' 2026-02-20T03:31:44.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:980 fp=#0x10000004ae5' 2026-02-20T03:31:44.736 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:981 fp=#0x1000000492e' 2026-02-20T03:31:44.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:982 fp=#0x100000048d4' 2026-02-20T03:31:44.737 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:859 fp=#0x100000048ab' 2026-02-20T03:31:44.738 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:983 fp=#0x100000048ba' 2026-02-20T03:31:44.739 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:984 fp=#0x10000004aa7' 2026-02-20T03:31:44.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:985 fp=#0x1000000499c' 2026-02-20T03:31:44.740 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:986 fp=#0x100000049d2' 2026-02-20T03:31:44.741 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:987 fp=#0x100000049ba' 2026-02-20T03:31:44.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:896 fp=#0x100000048aa' 2026-02-20T03:31:44.742 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:988 fp=#0x100000048e5' 2026-02-20T03:31:44.744 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:989 fp=#0x10000004a9c' 2026-02-20T03:31:44.745 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:990 fp=#0x10000004966' 2026-02-20T03:31:44.746 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:991 fp=#0x10000004918' 2026-02-20T03:31:44.747 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:992 fp=#0x100000048f1' 2026-02-20T03:31:44.748 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:993 fp=#0x10000004aed' 2026-02-20T03:31:44.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:966 fp=#0x100000048ac' 2026-02-20T03:31:44.749 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:994 fp=#0x100000049d3' 2026-02-20T03:31:44.750 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 1 (i) for f621fbc0-1: 'internal op quiesce_inode:mds.1:995 fp=#0x10000004a1f' 2026-02-20T03:31:44.751 INFO:tasks.quiescer.fs.[cephfs]:Pulled 159 ops from rank 1 (i) into home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/ops-f621fbc0-1-mds.i.json 2026-02-20T03:31:44.751 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -- /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.i.json 2026-02-20T03:31:44.751 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:44 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:31:44.775 DEBUG:teuthology.orchestra.run.trial126:> mktemp 2026-02-20T03:31:44.793 INFO:teuthology.orchestra.run.trial126.stdout:/tmp/tmp.tN0epSwoKp 2026-02-20T03:31:44.793 DEBUG:teuthology.orchestra.run.trial126:> sudo cp /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.b.json /tmp/tmp.tN0epSwoKp 2026-02-20T03:31:44.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:44 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:31:44.859 DEBUG:teuthology.orchestra.run.trial126:> sudo chmod 0666 /tmp/tmp.tN0epSwoKp 2026-02-20T03:31:44.981 DEBUG:teuthology.orchestra.remote:trial126:/tmp/tmp.tN0epSwoKp is 38KB 2026-02-20T03:31:45.030 DEBUG:teuthology.orchestra.run.trial126:> rm -fr /tmp/tmp.tN0epSwoKp 2026-02-20T03:31:45.046 DEBUG:tasks.quiescer.fs.[cephfs]:read 38640B of ops from '/var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.b.json' on mds.0 (b) 2026-02-20T03:31:45.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for f621fbc0-1: 'internal op quiesce_path:mds.0:1066 fp=#0x1' 2026-02-20T03:31:45.050 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for f621fbc0-1: 'internal op quiesce_inode:mds.0:1067 fp=#0x1' 2026-02-20T03:31:45.051 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for f621fbc0-1: 'internal op quiesce_inode:mds.0:1068 fp=#0x10000000000' 2026-02-20T03:31:45.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for f621fbc0-1: 'internal op quiesce_inode:mds.0:1070 fp=#0x10000000001' 2026-02-20T03:31:45.052 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for f621fbc0-1: 'internal op quiesce_inode:mds.0:1072 fp=#0x100000001fa' 2026-02-20T03:31:45.053 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for f621fbc0-1: 'internal op quiesce_inode:mds.0:1074 fp=#0x100000001fb' 2026-02-20T03:31:45.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for f621fbc0-1: 'internal op quiesce_inode:mds.0:1078 fp=#0x100000005e2' 2026-02-20T03:31:45.055 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for f621fbc0-1: 'internal op quiesce_inode:mds.0:1079 fp=#0x100000005e3' 2026-02-20T03:31:45.056 DEBUG:tasks.quiescer.fs.[cephfs]:Outstanding op at rank 0 (b) for f621fbc0-1: 'internal op quiesce_inode:mds.0:1080 fp=#0x100000005e4' 2026-02-20T03:31:45.056 INFO:tasks.quiescer.fs.[cephfs]:Pulled 15 ops from rank 0 (b) into home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/ops-f621fbc0-1-mds.b.json 2026-02-20T03:31:45.056 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -- /var/run/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ops-f621fbc0-1-mds.b.json 2026-02-20T03:31:45.110 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:31:45.419 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:45 trial028 ceph-mon[38552]: pgmap v697: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2026-02-20T03:31:45.432 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:45.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- 10.20.193.28:0/2840797525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890105320 msgr2=0x7fe890111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:45.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 --2- 10.20.193.28:0/2840797525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890105320 0x7fe890111850 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fe88000b0d0 tx=0x7fe88002f490 comp rx=0 tx=0).stop 2026-02-20T03:31:45.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- 10.20.193.28:0/2840797525 shutdown_connections 2026-02-20T03:31:45.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 --2- 10.20.193.28:0/2840797525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890105320 0x7fe890111850 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 --2- 10.20.193.28:0/2840797525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe890104980 0x7fe890104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 --2- 10.20.193.28:0/2840797525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe89010a980 0x7fe89010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- 10.20.193.28:0/2840797525 >> 10.20.193.28:0/2840797525 conn(0x7fe890100680 msgr2=0x7fe890102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:45.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- 10.20.193.28:0/2840797525 shutdown_connections 2026-02-20T03:31:45.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- 10.20.193.28:0/2840797525 wait complete. 2026-02-20T03:31:45.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 Processor -- start 2026-02-20T03:31:45.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- start start 2026-02-20T03:31:45.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890104980 0x7fe89019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe890105320 0x7fe89019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe89010a980 0x7fe8901a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe890114cd0 con 0x7fe890104980 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe890114b50 con 0x7fe890105320 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe890114e50 con 0x7fe89010a980 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890104980 0x7fe89019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890104980 0x7fe89019d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33432/0 (socket says 10.20.193.28:33432) 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88effd640 1 -- 10.20.193.28:0/1411470813 learned_addr learned my addr 10.20.193.28:0/1411470813 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88effd640 1 -- 10.20.193.28:0/1411470813 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe89010a980 msgr2=0x7fe8901a1a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88effd640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe89010a980 0x7fe8901a1a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88effd640 1 -- 10.20.193.28:0/1411470813 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe890105320 msgr2=0x7fe89019d6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:45.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88effd640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe890105320 0x7fe89019d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88effd640 1 -- 10.20.193.28:0/1411470813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8901a2200 con 0x7fe890104980 2026-02-20T03:31:45.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88effd640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890104980 0x7fe89019d1b0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fe88400b570 tx=0x7fe88400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:45.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe86ffff640 1 -- 10.20.193.28:0/1411470813 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884013020 con 0x7fe890104980 2026-02-20T03:31:45.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe86ffff640 1 -- 10.20.193.28:0/1411470813 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe884004480 con 0x7fe890104980 2026-02-20T03:31:45.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8901a24f0 con 0x7fe890104980 2026-02-20T03:31:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe86ffff640 1 -- 10.20.193.28:0/1411470813 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88400fb00 con 0x7fe890104980 2026-02-20T03:31:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8901a9d30 con 0x7fe890104980 2026-02-20T03:31:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.674+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe890104e60 con 0x7fe890104980 2026-02-20T03:31:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.679+0000 7fe86ffff640 1 -- 10.20.193.28:0/1411470813 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe884002780 con 0x7fe890104980 2026-02-20T03:31:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.679+0000 7fe86ffff640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe8640b0e20 0x7fe8640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.679+0000 7fe86ffff640 1 -- 10.20.193.28:0/1411470813 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe8840e0a10 con 0x7fe890104980 2026-02-20T03:31:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.679+0000 7fe86ffff640 1 -- 10.20.193.28:0/1411470813 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe88401d030 con 0x7fe890104980 2026-02-20T03:31:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.679+0000 7fe88e7fc640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe8640b0e20 0x7fe8640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:45.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.679+0000 7fe88e7fc640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe8640b0e20 0x7fe8640b32e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe890102c90 tx=0x7fe878006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:45.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 16.28 MB/sec execute 76 sec latency 56188.181 ms 2026-02-20T03:31:45.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:45 trial177 ceph-mon[43181]: pgmap v697: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2026-02-20T03:31:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.790+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe89019e510 con 0x7fe890104980 2026-02-20T03:31:45.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.790+0000 7fe86ffff640 1 -- 10.20.193.28:0/1411470813 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11922 (secure 0 0 0) 0x7fe8840a8df0 con 0x7fe890104980 2026-02-20T03:31:45.794 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:31:45.806 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":41,"btime":"2026-02-20T03:31:43:333961+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":41,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:31:42.400246+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28114":{"gid":28114,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1701826560","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1701826560},{"type":"v1","addr":"10.20.193.177:6837","nonce":1701826560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 41 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe8640b0e20 msgr2=0x7fe8640b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe8640b0e20 0x7fe8640b32e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe890102c90 tx=0x7fe878006cd0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890104980 msgr2=0x7fe89019d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890104980 0x7fe89019d1b0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fe88400b570 tx=0x7fe88400ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 shutdown_connections 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe8640b0e20 0x7fe8640b32e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe89010a980 0x7fe8901a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe890105320 0x7fe89019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 --2- 10.20.193.28:0/1411470813 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe890104980 0x7fe89019d1b0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:45.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 >> 10.20.193.28:0/1411470813 conn(0x7fe890100680 msgr2=0x7fe890100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:45.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 shutdown_connections 2026-02-20T03:31:45.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:45.792+0000 7fe88ffff640 1 -- 10.20.193.28:0/1411470813 wait complete. 2026-02-20T03:31:45.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:45 trial126 ceph-mon[38476]: pgmap v697: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2026-02-20T03:31:45.950 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --set-id f621fbc0 --await-for 45.0' 2026-02-20T03:31:45.951 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --set-id f621fbc0 --await-for 45.0 2026-02-20T03:31:46.261 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:46.461 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:46 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1411470813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:46.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:31:46.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.462 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:46 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- 10.20.193.28:0/64031100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 msgr2=0x7f703c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 --2- 10.20.193.28:0/64031100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 0x7f703c111480 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f702c00b0a0 tx=0x7f702c02f450 comp rx=0 tx=0).stop 2026-02-20T03:31:46.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- 10.20.193.28:0/64031100 shutdown_connections 2026-02-20T03:31:46.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 --2- 10.20.193.28:0/64031100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 0x7f703c111480 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 --2- 10.20.193.28:0/64031100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f703c109e60 0x7f703c10a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 --2- 10.20.193.28:0/64031100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f703c109490 0x7f703c109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- 10.20.193.28:0/64031100 >> 10.20.193.28:0/64031100 conn(0x7f703c077fe0 msgr2=0x7f703c07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.502 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- 10.20.193.28:0/64031100 shutdown_connections 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- 10.20.193.28:0/64031100 wait complete. 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 Processor -- start 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- start start 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f703c109490 0x7f703c1a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f703c109e60 0x7f703c1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 0x7f703c1a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f703c114a50 con 0x7f703c10a900 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f703c1148d0 con 0x7f703c109e60 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f703c114bd0 con 0x7f703c109490 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 0x7f703c1a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 0x7f703c1a8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42896/0 (socket says 10.20.193.28:42896) 2026-02-20T03:31:46.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703b7fe640 1 -- 10.20.193.28:0/360725253 learned_addr learned my addr 10.20.193.28:0/360725253 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703b7fe640 1 -- 10.20.193.28:0/360725253 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f703c109490 msgr2=0x7f703c1a1060 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703b7fe640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f703c109490 0x7f703c1a1060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703b7fe640 1 -- 10.20.193.28:0/360725253 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f703c109e60 msgr2=0x7f703c1a15a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703b7fe640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f703c109e60 0x7f703c1a15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703b7fe640 1 -- 10.20.193.28:0/360725253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c1a8d10 con 0x7f703c10a900 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703b7fe640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 0x7f703c1a8610 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f702c00b1d0 tx=0x7f702c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f7040a5f640 1 -- 10.20.193.28:0/360725253 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c004d40 con 0x7f703c10a900 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f7040a5f640 1 -- 10.20.193.28:0/360725253 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f702c0078c0 con 0x7f703c10a900 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f7040a5f640 1 -- 10.20.193.28:0/360725253 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c005380 con 0x7f703c10a900 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- 10.20.193.28:0/360725253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703c1a8fa0 con 0x7f703c10a900 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.499+0000 7f703bfff640 1 -- 10.20.193.28:0/360725253 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f703c1a9480 con 0x7f703c10a900 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f7040a5f640 1 -- 10.20.193.28:0/360725253 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f702c007a70 con 0x7f703c10a900 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 Processor -- start 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 -- start start 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e1e80 0x556b734e2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e27c0 0x556b734e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b734e99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f7040a5f640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70100b0ef0 0x7f70100b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556b734328f0 con 0x556b734e7560 2026-02-20T03:31:46.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556b733e02e0 con 0x556b734e1e80 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556b7342e820 con 0x556b734e27c0 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b734e99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b734e99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42908/0 (socket says 10.20.193.28:42908) 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703a7fc640 1 -- 10.20.193.28:0/4050660064 learned_addr learned my addr 10.20.193.28:0/4050660064 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f7040a5f640 1 -- 10.20.193.28:0/360725253 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f702c105890 con 0x7f703c10a900 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703a7fc640 1 -- 10.20.193.28:0/4050660064 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e27c0 msgr2=0x556b734e6f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703a7fc640 1 --2- 10.20.193.28:0/4050660064 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e27c0 0x556b734e6f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703a7fc640 1 -- 10.20.193.28:0/4050660064 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e1e80 msgr2=0x556b734e2280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703a7fc640 1 --2- 10.20.193.28:0/4050660064 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e1e80 0x556b734e2280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703a7fc640 1 -- 10.20.193.28:0/4050660064 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b733d25a0 con 0x556b734e7560 2026-02-20T03:31:46.510 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703b7fe640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70100b0ef0 0x7f70100b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703a7fc640 1 --2- 10.20.193.28:0/4050660064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b734e99f0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f70240098a0 tx=0x7f7024009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d49122dfb6d7d0c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f703b7fe640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70100b0ef0 0x7f70100b33b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f702c009d00 tx=0x7f702c0d6040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70077fe640 1 -- 10.20.193.28:0/4050660064 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024016070 con 0x556b734e7560 2026-02-20T03:31:46.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70077fe640 1 -- 10.20.193.28:0/4050660064 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7024002870 con 0x556b734e7560 2026-02-20T03:31:46.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70077fe640 1 -- 10.20.193.28:0/4050660064 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024011400 con 0x556b734e7560 2026-02-20T03:31:46.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 -- 10.20.193.28:0/4050660064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 msgr2=0x556b734e99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 --2- 10.20.193.28:0/4050660064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b734e99f0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f70240098a0 tx=0x7f7024009d70 comp rx=0 tx=0).stop 2026-02-20T03:31:46.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 -- 10.20.193.28:0/4050660064 shutdown_connections 2026-02-20T03:31:46.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 --2- 10.20.193.28:0/4050660064 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b734e99f0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 --2- 10.20.193.28:0/4050660064 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e27c0 0x556b734e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 --2- 10.20.193.28:0/4050660064 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e1e80 0x556b734e2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 -- 10.20.193.28:0/4050660064 >> 10.20.193.28:0/4050660064 conn(0x556b734d96f0 msgr2=0x556b734e0570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.504+0000 7fe6c24a1640 1 -- 10.20.193.28:0/1296493306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe6bc109ba0 msgr2=0x7fe6bc115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.504+0000 7fe6c24a1640 1 --2- 10.20.193.28:0/1296493306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe6bc109ba0 0x7fe6bc115d10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800b3e0 tx=0x7fe6b802f6c0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 -- 10.20.193.28:0/4050660064 shutdown_connections 2026-02-20T03:31:46.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.504+0000 7f70448c2e00 1 -- 10.20.193.28:0/4050660064 wait complete. 2026-02-20T03:31:46.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.504+0000 7fe6c24a1640 1 -- 10.20.193.28:0/1296493306 shutdown_connections 2026-02-20T03:31:46.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.504+0000 7fe6c24a1640 1 --2- 10.20.193.28:0/1296493306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe6bc109ba0 0x7fe6bc115d10 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.504+0000 7fe6c24a1640 1 --2- 10.20.193.28:0/1296493306 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe6bc109220 0x7fe6bc109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.504+0000 7fe6c24a1640 1 --2- 10.20.193.28:0/1296493306 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe6bc10eef0 0x7fe6bc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.504+0000 7fe6c24a1640 1 -- 10.20.193.28:0/1296493306 >> 10.20.193.28:0/1296493306 conn(0x7fe6bc078600 msgr2=0x7fe6bc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 -- start start 2026-02-20T03:31:46.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 -- 10.20.193.28:0/1296493306 shutdown_connections 2026-02-20T03:31:46.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 -- 10.20.193.28:0/1296493306 wait complete. 2026-02-20T03:31:46.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 Processor -- start 2026-02-20T03:31:46.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 Processor -- start 2026-02-20T03:31:46.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 -- start start 2026-02-20T03:31:46.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e1e80 0x556b734faa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e27c0 0x556b734faf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b73501de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556b733da0c0 con 0x556b734e7560 2026-02-20T03:31:46.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556b734ea610 con 0x556b734e27c0 2026-02-20T03:31:46.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556b73502370 con 0x556b734e1e80 2026-02-20T03:31:46.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe6bc109220 0x7fe6bc083880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe6bc109ba0 0x7fe6bc083dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f703a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b73501de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f703a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b73501de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42934/0 (socket says 10.20.193.28:42934) 2026-02-20T03:31:46.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f703a7fc640 1 -- 10.20.193.28:0/1490375228 learned_addr learned my addr 10.20.193.28:0/1490375228 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe6bc10eef0 0x7fe6bc07ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1191b0 con 0x7fe6bc109220 2026-02-20T03:31:46.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc119030 con 0x7fe6bc109ba0 2026-02-20T03:31:46.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc119330 con 0x7fe6bc10eef0 2026-02-20T03:31:46.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f703a7fc640 1 -- 10.20.193.28:0/1490375228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e1e80 msgr2=0x556b734faa00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f703a7fc640 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e1e80 0x556b734faa00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f703a7fc640 1 -- 10.20.193.28:0/1490375228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e27c0 msgr2=0x556b734faf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f703a7fc640 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e27c0 0x556b734faf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c149f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe6bc109220 0x7fe6bc083880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f703a7fc640 1 -- 10.20.193.28:0/1490375228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b734f44a0 con 0x556b734e7560 2026-02-20T03:31:46.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c149f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe6bc109220 0x7fe6bc083880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42922/0 (socket says 10.20.193.28:42922) 2026-02-20T03:31:46.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c149f640 1 -- 10.20.193.28:0/3634880562 learned_addr learned my addr 10.20.193.28:0/3634880562 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f703a7fc640 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b73501de0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f7024006da0 tx=0x7f7024003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3596a38513390db6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f7004ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f7004ff9640 1 -- 10.20.193.28:0/1490375228 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024016040 con 0x556b734e7560 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f7004ff9640 1 -- 10.20.193.28:0/1490375228 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f70240094f0 con 0x556b734e7560 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f7004ff9640 1 -- 10.20.193.28:0/1490375228 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702401bbd0 con 0x556b734e7560 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 -- 10.20.193.28:0/1490375228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b733ee820 con 0x556b734e7560 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f7004ff9640 1 -- 10.20.193.28:0/1490375228 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f702401bd70 con 0x556b734e7560 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 10 client.20169 _ll_register_callbacks cb 0x556b733ddff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 -- 10.20.193.28:0/1490375228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556b7343a4e0 con 0x556b734e7560 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f7004ff9640 1 -- 10.20.193.28:0/1490375228 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f7024028060 con 0x556b734e7560 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 10 client.20169 fetch_fsmap learned FSMap version 41 2026-02-20T03:31:46.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 -- 10.20.193.28:0/1490375228 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=41}) -- 0x556b733f3380 con 0x556b734e7560 2026-02-20T03:31:46.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c149f640 1 -- 10.20.193.28:0/3634880562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe6bc10eef0 msgr2=0x7fe6bc07ca30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:46.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f7004ff9640 1 -- 10.20.193.28:0/1490375228 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 41) ==== 8358+0+0 (secure 0 0 0) 0x7f702401b410 con 0x556b734e7560 2026-02-20T03:31:46.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 10 client.20169 fetch_fsmap finished waiting for FSMap version 41 2026-02-20T03:31:46.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 10 client.20169 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:46.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 20 client.20169 populate_metadata read hostname 'trial028' 2026-02-20T03:31:46.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b735062f0 0x556b73508760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 4 client.20169 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:46.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.509+0000 7f70448c2e00 1 -- 10.20.193.28:0/1490375228 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b733b4bd0 con 0x556b735062f0 2026-02-20T03:31:46.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c149f640 1 --2- 10.20.193.28:0/3634880562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe6bc10eef0 0x7fe6bc07ca30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c149f640 1 -- 10.20.193.28:0/3634880562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe6bc109ba0 msgr2=0x7fe6bc083dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:46.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c149f640 1 --2- 10.20.193.28:0/3634880562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe6bc109ba0 0x7fe6bc083dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c149f640 1 -- 10.20.193.28:0/3634880562 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc07d2f0 con 0x7fe6bc109220 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c149f640 1 --2- 10.20.193.28:0/3634880562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe6bc109220 0x7fe6bc083880 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00b570 tx=0x7fe6ac00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6aa7fc640 1 -- 10.20.193.28:0/3634880562 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac013020 con 0x7fe6bc109220 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6aa7fc640 1 -- 10.20.193.28:0/3634880562 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe6ac004480 con 0x7fe6bc109220 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 -- 10.20.193.28:0/3634880562 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc07d5e0 con 0x7fe6bc109220 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6aa7fc640 1 -- 10.20.193.28:0/3634880562 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac00fb50 con 0x7fe6bc109220 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.509+0000 7fe6c24a1640 1 -- 10.20.193.28:0/3634880562 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc0815d0 con 0x7fe6bc109220 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 Processor -- start 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 -- start start 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6aa7fc640 1 -- 10.20.193.28:0/3634880562 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe6ac002780 con 0x7fe6bc109220 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401d6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 0x5608401d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d0b40 0x5608401dcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560840150890 con 0x5608401d5d80 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560840123620 con 0x5608401d0b40 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5608400d12a0 con 0x5608401d66a0 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c1ca0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401d6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c1ca0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401d6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42938/0 (socket says 10.20.193.28:42938) 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c1ca0640 1 -- 10.20.193.28:0/2504612204 learned_addr learned my addr 10.20.193.28:0/2504612204 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c1ca0640 1 -- 10.20.193.28:0/2504612204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 msgr2=0x5608401d0410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/2504612204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 0x5608401d0410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c1ca0640 1 -- 10.20.193.28:0/2504612204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d0b40 msgr2=0x5608401dcbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/2504612204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d0b40 0x5608401dcbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c1ca0640 1 -- 10.20.193.28:0/2504612204 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608400c34a0 con 0x5608401d5d80 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/2504612204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401d6160 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009e00 tx=0x7fe6b802fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b6f7df75bb57e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe689ce5640 1 -- 10.20.193.28:0/2504612204 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80090d0 con 0x5608401d5d80 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe689ce5640 1 -- 10.20.193.28:0/2504612204 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe6b8009270 con 0x5608401d5d80 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe689ce5640 1 -- 10.20.193.28:0/2504612204 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8002cc0 con 0x5608401d5d80 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6aa7fc640 1 --2- 10.20.193.28:0/3634880562 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe6980b0e20 0x7fe6980b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6aa7fc640 1 -- 10.20.193.28:0/3634880562 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe6ac0e0500 con 0x7fe6bc109220 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/2504612204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 msgr2=0x5608401d6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/2504612204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401d6160 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009e00 tx=0x7fe6b802fde0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c149f640 1 --2- 10.20.193.28:0/3634880562 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe6980b0e20 0x7fe6980b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/2504612204 shutdown_connections 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/2504612204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d0b40 0x5608401dcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/2504612204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 0x5608401d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/2504612204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401d6160 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/2504612204 >> 10.20.193.28:0/2504612204 conn(0x5608401cc540 msgr2=0x5608401ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/2504612204 shutdown_connections 2026-02-20T03:31:46.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/2504612204 wait complete. 2026-02-20T03:31:46.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.512+0000 7fe6c149f640 1 --2- 10.20.193.28:0/3634880562 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe6980b0e20 0x7fe6980b32e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x5608401d6aa0 tx=0x7fe6ac004850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 -- start start 2026-02-20T03:31:46.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 Processor -- start 2026-02-20T03:31:46.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d0b40 0x5608401eac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401eb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 0x5608401e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56084011f550 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56083ff85f60 con 0x5608401d0b40 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5608401e9b40 con 0x5608401d66a0 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c0c9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401eb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c0c9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401eb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42950/0 (socket says 10.20.193.28:42950) 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c0c9e640 1 -- 10.20.193.28:0/713371975 learned_addr learned my addr 10.20.193.28:0/713371975 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c0c9e640 1 -- 10.20.193.28:0/713371975 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 msgr2=0x5608401e93c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c0c9e640 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 0x5608401e93c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c0c9e640 1 -- 10.20.193.28:0/713371975 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d0b40 msgr2=0x5608401eac80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c0c9e640 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d0b40 0x5608401eac80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c0c9e640 1 -- 10.20.193.28:0/713371975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608401e2780 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c0c9e640 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401eb1c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009ea0 tx=0x7fe6b000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9da4f0a6f910af5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe676ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe676ffd640 1 -- 10.20.193.28:0/713371975 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0016070 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/713371975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608400f0100 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 10 client.20178 _ll_register_callbacks cb 0x56084015c940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/713371975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56084012b210 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe676ffd640 1 -- 10.20.193.28:0/713371975 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe6b0002780 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe676ffd640 1 -- 10.20.193.28:0/713371975 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00117e0 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe676ffd640 1 -- 10.20.193.28:0/713371975 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe6b001b440 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe676ffd640 1 -- 10.20.193.28:0/713371975 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe6b0004270 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 10 client.20178 fetch_fsmap learned FSMap version 41 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/713371975 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=41}) -- 0x5608400e4480 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe676ffd640 1 -- 10.20.193.28:0/713371975 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 41) ==== 8358+0+0 (secure 0 0 0) 0x7fe6b0023060 con 0x5608401d5d80 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 10 client.20178 fetch_fsmap finished waiting for FSMap version 41 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 10 client.20178 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 20 client.20178 populate_metadata read hostname 'trial028' 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608401f9460 0x5608401fb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 4 client.20178 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:46.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.518+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/713371975 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608400a5ca0 con 0x5608401f9460 2026-02-20T03:31:46.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.526+0000 7f703affd640 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b735062f0 0x556b73508760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.540+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608401f9460 0x5608401fb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.593+0000 7f703affd640 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b735062f0 0x556b73508760 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa4f1b99d6019b68 server_cookie=f5b2ed3b15219237 in_seq=0 out_seq=0 2026-02-20T03:31:46.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.593+0000 7f7004ff9640 10 client.20169 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:46.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.606+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608401f9460 0x5608401fb8f0 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d763d2e9d7cc2311 server_cookie=7ed4b53302374415 in_seq=0 out_seq=0 2026-02-20T03:31:46.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.606+0000 7fe676ffd640 10 client.20178 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:46.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f7004ff9640 1 -- 10.20.193.28:0/1490375228 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556b733b4bd0 con 0x556b735062f0 2026-02-20T03:31:46.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f7004ff9640 10 client.20169 handle_command_reply: tid=0 2026-02-20T03:31:46.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 client.20169 shutdown 2026-02-20T03:31:46.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 -- 10.20.193.28:0/1490375228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 msgr2=0x556b73501de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b73501de0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f7024006da0 tx=0x7f7024003c60 comp rx=0 tx=0).stop 2026-02-20T03:31:46.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe676ffd640 1 -- 10.20.193.28:0/713371975 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5608400a5ca0 con 0x5608401f9460 2026-02-20T03:31:46.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe676ffd640 10 client.20178 handle_command_reply: tid=0 2026-02-20T03:31:46.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 client.20178 shutdown 2026-02-20T03:31:46.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/713371975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 msgr2=0x5608401eb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401eb1c0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009ea0 tx=0x7fe6b000b4b0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 -- 10.20.193.28:0/1490375228 shutdown_connections 2026-02-20T03:31:46.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b735062f0 0x556b73508760 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b73501de0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e27c0 0x556b734faf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1490375228 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e1e80 0x556b734faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 -- 10.20.193.28:0/1490375228 >> 10.20.193.28:0/1490375228 conn(0x556b734d96f0 msgr2=0x556b734e88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/713371975 shutdown_connections 2026-02-20T03:31:46.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608401f9460 0x5608401fb8f0 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 0x5608401e93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x5608401eb1c0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/713371975 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d0b40 0x5608401eac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/713371975 >> 10.20.193.28:0/713371975 conn(0x5608401cc540 msgr2=0x5608401cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe676ffd640 0 client.20178 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:46.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/713371975 shutdown_connections 2026-02-20T03:31:46.632 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f7004ff9640 0 client.20169 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:46.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/713371975 wait complete. 2026-02-20T03:31:46.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.619+0000 7fe6c5c2fe00 20 client.20178 trim_cache size 0 max 16384 2026-02-20T03:31:46.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 -- 10.20.193.28:0/1490375228 shutdown_connections 2026-02-20T03:31:46.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 1 -- 10.20.193.28:0/1490375228 wait complete. 2026-02-20T03:31:46.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.619+0000 7f70448c2e00 20 client.20169 trim_cache size 0 max 16384 2026-02-20T03:31:46.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f70448c2e00 1 Processor -- start 2026-02-20T03:31:46.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f70448c2e00 1 -- start start 2026-02-20T03:31:46.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e1e80 0x556b734f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.634 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e27c0 0x556b73501da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e7560 0x556b734dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f70448c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4012600 con 0x556b734e1e80 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f70448c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe400fea0 con 0x556b734e7560 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f70448c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe400dcf0 con 0x556b734e27c0 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f703a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e1e80 0x556b734f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f703a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e1e80 0x556b734f83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42956/0 (socket says 10.20.193.28:42956) 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f703a7fc640 1 -- 10.20.193.28:0/2314171634 learned_addr learned my addr 10.20.193.28:0/2314171634 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f703a7fc640 1 -- 10.20.193.28:0/2314171634 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e27c0 msgr2=0x556b73501da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f703a7fc640 1 --2- 10.20.193.28:0/2314171634 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e27c0 0x556b73501da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f703a7fc640 1 -- 10.20.193.28:0/2314171634 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e7560 msgr2=0x556b734dfd50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f703a7fc640 1 --2- 10.20.193.28:0/2314171634 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e7560 0x556b734dfd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.624+0000 7f703a7fc640 1 -- 10.20.193.28:0/2314171634 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b73508ad0 con 0x556b734e1e80 2026-02-20T03:31:46.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.624+0000 7fe6c5c2fe00 1 Processor -- start 2026-02-20T03:31:46.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 --2- 10.20.193.28:0/2314171634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e1e80 0x556b734f83d0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f702400ba60 tx=0x7f7024012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcfaf1604a4a46e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f7006ffd640 1 -- 10.20.193.28:0/2314171634 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024016070 con 0x556b734e1e80 2026-02-20T03:31:46.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f7006ffd640 1 -- 10.20.193.28:0/2314171634 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x556b7343a4e0 con 0x556b734e1e80 2026-02-20T03:31:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- start start 2026-02-20T03:31:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d0b40 0x5608401c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d5d80 0x560840201200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 0x560840201740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe6680127c0 con 0x5608401d0b40 2026-02-20T03:31:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe668010060 con 0x5608401d5d80 2026-02-20T03:31:46.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe66800de50 con 0x5608401d66a0 2026-02-20T03:31:46.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f7006ffd640 1 -- 10.20.193.28:0/2314171634 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702401c440 con 0x556b734e1e80 2026-02-20T03:31:46.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c1ca0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d0b40 0x5608401c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c1ca0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d0b40 0x5608401c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42970/0 (socket says 10.20.193.28:42970) 2026-02-20T03:31:46.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c1ca0640 1 -- 10.20.193.28:0/3228895311 learned_addr learned my addr 10.20.193.28:0/3228895311 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c1ca0640 1 -- 10.20.193.28:0/3228895311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 msgr2=0x560840201740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/3228895311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 0x560840201740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c1ca0640 1 -- 10.20.193.28:0/3228895311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d5d80 msgr2=0x560840201200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/3228895311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d5d80 0x560840201200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c1ca0640 1 -- 10.20.193.28:0/3228895311 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608401e25b0 con 0x5608401d0b40 2026-02-20T03:31:46.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 -- 10.20.193.28:0/2314171634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e1e80 msgr2=0x556b734f83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 --2- 10.20.193.28:0/2314171634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e1e80 0x556b734f83d0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f702400ba60 tx=0x7f7024012000 comp rx=0 tx=0).stop 2026-02-20T03:31:46.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 -- 10.20.193.28:0/2314171634 shutdown_connections 2026-02-20T03:31:46.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 --2- 10.20.193.28:0/2314171634 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e7560 0x556b734dfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 --2- 10.20.193.28:0/2314171634 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e27c0 0x556b73501da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 --2- 10.20.193.28:0/2314171634 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e1e80 0x556b734f83d0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 -- 10.20.193.28:0/2314171634 >> 10.20.193.28:0/2314171634 conn(0x556b734d96f0 msgr2=0x556b734f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/3228895311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d0b40 0x5608401c8340 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004370 tx=0x7fe6b8004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fafb08a9068dd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 -- 10.20.193.28:0/2314171634 shutdown_connections 2026-02-20T03:31:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6894e4640 1 -- 10.20.193.28:0/3228895311 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8048040 con 0x5608401d0b40 2026-02-20T03:31:46.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6894e4640 1 -- 10.20.193.28:0/3228895311 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe6b8002a60 con 0x5608401d0b40 2026-02-20T03:31:46.642 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 -- 10.20.193.28:0/2314171634 wait complete. 2026-02-20T03:31:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6894e4640 1 -- 10.20.193.28:0/3228895311 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b80040c0 con 0x5608401d0b40 2026-02-20T03:31:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/3228895311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d0b40 msgr2=0x5608401c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/3228895311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d0b40 0x5608401c8340 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004370 tx=0x7fe6b8004300 comp rx=0 tx=0).stop 2026-02-20T03:31:46.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 -- start start 2026-02-20T03:31:46.643 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 Processor -- start 2026-02-20T03:31:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/3228895311 shutdown_connections 2026-02-20T03:31:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/3228895311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d66a0 0x560840201740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/3228895311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d5d80 0x560840201200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/3228895311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d0b40 0x5608401c8340 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/3228895311 >> 10.20.193.28:0/3228895311 conn(0x5608401cc540 msgr2=0x5608401d3950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/3228895311 shutdown_connections 2026-02-20T03:31:46.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/3228895311 wait complete. 2026-02-20T03:31:46.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e1e80 0x556b734fdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e27c0 0x556b734fe4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b735011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe400e360 con 0x556b734e7560 2026-02-20T03:31:46.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe400f7d0 con 0x556b734e27c0 2026-02-20T03:31:46.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f70448c2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe400ea30 con 0x556b734e1e80 2026-02-20T03:31:46.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b735011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b735011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42986/0 (socket says 10.20.193.28:42986) 2026-02-20T03:31:46.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 -- 10.20.193.28:0/1266037345 learned_addr learned my addr 10.20.193.28:0/1266037345 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- start start 2026-02-20T03:31:46.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 -- 10.20.193.28:0/1266037345 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e1e80 msgr2=0x556b734fdfb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e1e80 0x556b734fdfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 -- 10.20.193.28:0/1266037345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e27c0 msgr2=0x556b734fe4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e27c0 0x556b734fe4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 -- 10.20.193.28:0/1266037345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b734f42d0 con 0x556b734e7560 2026-02-20T03:31:46.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f703a7fc640 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b735011c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f702400bfe0 tx=0x7f70240090c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361562fe93d793d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f7004ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:46.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f7004ff9640 1 -- 10.20.193.28:0/1266037345 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024016070 con 0x556b734e7560 2026-02-20T03:31:46.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f7004ff9640 1 -- 10.20.193.28:0/1266037345 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f7024002a20 con 0x556b734e7560 2026-02-20T03:31:46.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.629+0000 7f7004ff9640 1 -- 10.20.193.28:0/1266037345 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702401c680 con 0x556b734e7560 2026-02-20T03:31:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 Processor -- start 2026-02-20T03:31:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d0b40 0x5608401f1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x56084025ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d66a0 0x56084025f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe66800e520 con 0x5608401d5d80 2026-02-20T03:31:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe66800f990 con 0x5608401d66a0 2026-02-20T03:31:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c5c2fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe66800ebf0 con 0x5608401d0b40 2026-02-20T03:31:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c0c9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x56084025ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c0c9e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x56084025ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42994/0 (socket says 10.20.193.28:42994) 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c0c9e640 1 -- 10.20.193.28:0/1626384797 learned_addr learned my addr 10.20.193.28:0/1626384797 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c0c9e640 1 -- 10.20.193.28:0/1626384797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d0b40 msgr2=0x5608401f1040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c0c9e640 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d0b40 0x5608401f1040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c0c9e640 1 -- 10.20.193.28:0/1626384797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d66a0 msgr2=0x56084025f0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c0c9e640 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d66a0 0x56084025f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c0c9e640 1 -- 10.20.193.28:0/1626384797 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56083feb2d90 con 0x5608401d5d80 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe6c0c9e640 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x56084025ebb0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0002410 tx=0x7fe6b000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af68712926338cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.629+0000 7fe676ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe676ffd640 1 -- 10.20.193.28:0/1626384797 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0027020 con 0x5608401d5d80 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe676ffd640 1 -- 10.20.193.28:0/1626384797 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56084012b210 con 0x5608401d5d80 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe676ffd640 1 -- 10.20.193.28:0/1626384797 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0016070 con 0x5608401d5d80 2026-02-20T03:31:46.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/1626384797 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608400ca720 con 0x5608401d5d80 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe676ffd640 1 -- 10.20.193.28:0/1626384797 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe6b0004410 con 0x5608401d5d80 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe676ffd640 10 client.20190 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 10 client.20190 _ll_register_callbacks cb 0x7fe6b0006f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/1626384797 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6b8002a60 con 0x5608401d5d80 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe676ffd640 1 -- 10.20.193.28:0/1626384797 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe6b0004610 con 0x5608401d5d80 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 10 client.20190 fetch_fsmap learned FSMap version 41 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/1626384797 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=41}) -- 0x5608401e32a0 con 0x5608401d5d80 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe676ffd640 1 -- 10.20.193.28:0/1626384797 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 41) ==== 8358+0+0 (secure 0 0 0) 0x7fe6b0023030 con 0x5608401d5d80 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 10 client.20190 fetch_fsmap finished waiting for FSMap version 41 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 10 client.20190 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 20 client.20190 populate_metadata read hostname 'trial028' 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608402777f0 0x560840279be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 4 client.20190 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f621fbc0", "await_for": 45.0}] 2026-02-20T03:31:46.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.633+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/1626384797 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f621fbc0", "await_for": 45.0}) -- 0x5608400a5ca0 con 0x5608402777f0 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 1 -- 10.20.193.28:0/1266037345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b73192690 con 0x556b734e7560 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 10 client.20187 _ll_register_callbacks cb 0x7f7024004110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 1 -- 10.20.193.28:0/1266037345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7024002870 con 0x556b734e7560 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f7004ff9640 1 -- 10.20.193.28:0/1266037345 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f702401c8e0 con 0x556b734e7560 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f7004ff9640 1 -- 10.20.193.28:0/1266037345 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f702401cc00 con 0x556b734e7560 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 10 client.20187 fetch_fsmap learned FSMap version 41 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 1 -- 10.20.193.28:0/1266037345 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=41}) -- 0x556b733f7b70 con 0x556b734e7560 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f7004ff9640 1 -- 10.20.193.28:0/1266037345 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 41) ==== 8358+0+0 (secure 0 0 0) 0x7f7024005b60 con 0x556b734e7560 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 10 client.20187 fetch_fsmap finished waiting for FSMap version 41 2026-02-20T03:31:46.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 10 client.20187 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:46.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 20 client.20187 populate_metadata read hostname 'trial028' 2026-02-20T03:31:46.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b735717a0 0x556b73573c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:46.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 4 client.20187 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:31:46.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.633+0000 7f70448c2e00 1 -- 10.20.193.28:0/1266037345 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556b734036b0 con 0x556b735717a0 2026-02-20T03:31:46.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.660+0000 7f703affd640 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b735717a0 0x556b73573c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.660+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608402777f0 0x560840279be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:46.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 16.07 MB/sec execute 77 sec latency 57188.218 ms 2026-02-20T03:31:46.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:46 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1411470813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:31:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:46 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.727+0000 7f703affd640 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b735717a0 0x556b73573c60 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc49807c8a06c8d server_cookie=d0ff8c752ec1dfb0 in_seq=0 out_seq=0 2026-02-20T03:31:46.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.727+0000 7f7004ff9640 10 client.20187 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:46.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.727+0000 7fe6c1ca0640 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608402777f0 0x560840279be0 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8075e5017647d03 server_cookie=64219c5824b9e864 in_seq=0 out_seq=0 2026-02-20T03:31:46.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:46.727+0000 7fe676ffd640 10 client.20190 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:46.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f7004ff9640 1 -- 10.20.193.28:0/1266037345 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556b734036b0 con 0x556b735717a0 2026-02-20T03:31:46.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f7004ff9640 10 client.20187 handle_command_reply: tid=0 2026-02-20T03:31:46.797 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 client.20187 shutdown 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 -- 10.20.193.28:0/1266037345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 msgr2=0x556b735011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b735011c0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f702400bfe0 tx=0x7f70240090c0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 -- 10.20.193.28:0/1266037345 shutdown_connections 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556b735717a0 0x556b73573c60 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556b734e7560 0x556b735011c0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556b734e27c0 0x556b734fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 --2- 10.20.193.28:0/1266037345 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556b734e1e80 0x556b734fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 -- 10.20.193.28:0/1266037345 >> 10.20.193.28:0/1266037345 conn(0x556b734d96f0 msgr2=0x556b734f82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f7004ff9640 0 client.20187 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 -- 10.20.193.28:0/1266037345 shutdown_connections 2026-02-20T03:31:46.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 1 -- 10.20.193.28:0/1266037345 wait complete. 2026-02-20T03:31:46.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f70448c2e00 20 client.20187 trim_cache size 0 max 16384 2026-02-20T03:31:46.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:31:46.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:31:46.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:31:46.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:31:46.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 -- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70100b0ef0 msgr2=0x7f70100b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70100b0ef0 0x7f70100b33b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f702c009d00 tx=0x7f702c0d6040 comp rx=0 tx=0).stop 2026-02-20T03:31:46.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 -- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 msgr2=0x7f703c1a8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:46.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 0x7f703c1a8610 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f702c00b1d0 tx=0x7f702c004360 comp rx=0 tx=0).stop 2026-02-20T03:31:46.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 -- 10.20.193.28:0/360725253 shutdown_connections 2026-02-20T03:31:46.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70100b0ef0 0x7f70100b33b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f703c10a900 0x7f703c1a8610 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f703c109e60 0x7f703c1a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.811 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 --2- 10.20.193.28:0/360725253 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f703c109490 0x7f703c1a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:46.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 -- 10.20.193.28:0/360725253 >> 10.20.193.28:0/360725253 conn(0x7f703c077fe0 msgr2=0x7f703c10d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:46.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 -- 10.20.193.28:0/360725253 shutdown_connections 2026-02-20T03:31:46.812 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:46.794+0000 7f703bfff640 1 -- 10.20.193.28:0/360725253 wait complete. 2026-02-20T03:31:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:46 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1411470813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:31:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:46.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:46 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:47.513 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:31:47.518 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:47 trial028 ceph-mon[38552]: pgmap v698: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2026-02-20T03:31:47.519 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:31:47.519 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:31:47.519 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:47.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 15.86 MB/sec execute 78 sec latency 58188.261 ms 2026-02-20T03:31:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:47 trial177 ceph-mon[43181]: pgmap v698: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2026-02-20T03:31:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:31:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:31:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:47.826 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:47 trial126 ceph-mon[38476]: pgmap v698: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2026-02-20T03:31:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:31:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:31:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:31:48.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- 10.20.193.28:0/697493356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 msgr2=0x7f247c105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:48.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 --2- 10.20.193.28:0/697493356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 0x7f247c105180 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f246c009a30 tx=0x7f246c02f260 comp rx=0 tx=0).stop 2026-02-20T03:31:48.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- 10.20.193.28:0/697493356 shutdown_connections 2026-02-20T03:31:48.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 --2- 10.20.193.28:0/697493356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f247c109ed0 0x7f247c111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 --2- 10.20.193.28:0/697493356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f247c105750 0x7f247c1097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 --2- 10.20.193.28:0/697493356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 0x7f247c105180 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- 10.20.193.28:0/697493356 >> 10.20.193.28:0/697493356 conn(0x7f247c100840 msgr2=0x7f247c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:48.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- 10.20.193.28:0/697493356 shutdown_connections 2026-02-20T03:31:48.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- 10.20.193.28:0/697493356 wait complete. 2026-02-20T03:31:48.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 Processor -- start 2026-02-20T03:31:48.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- start start 2026-02-20T03:31:48.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 0x7f247c074680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f247c105750 0x7f247c074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f247c109ed0 0x7f247c06d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f247c114e80 con 0x7f247c104da0 2026-02-20T03:31:48.084 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f247c114d00 con 0x7f247c109ed0 2026-02-20T03:31:48.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f247c115000 con 0x7f247c105750 2026-02-20T03:31:48.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2481b4b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 0x7f247c074680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:48.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2481b4b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 0x7f247c074680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43016/0 (socket says 10.20.193.28:43016) 2026-02-20T03:31:48.085 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2481b4b640 1 -- 10.20.193.28:0/930336719 learned_addr learned my addr 10.20.193.28:0/930336719 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:48.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2481b4b640 1 -- 10.20.193.28:0/930336719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f247c105750 msgr2=0x7f247c074bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2481b4b640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f247c105750 0x7f247c074bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2481b4b640 1 -- 10.20.193.28:0/930336719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f247c109ed0 msgr2=0x7f247c06d830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2481b4b640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f247c109ed0 0x7f247c06d830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2481b4b640 1 -- 10.20.193.28:0/930336719 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c06e0f0 con 0x7f247c104da0 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2481b4b640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 0x7f247c074680 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f246c002fa0 tx=0x7f246c002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f246affd640 1 -- 10.20.193.28:0/930336719 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c004280 con 0x7f247c104da0 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f246affd640 1 -- 10.20.193.28:0/930336719 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f246c004420 con 0x7f247c104da0 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- 10.20.193.28:0/930336719 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247c06e380 con 0x7f247c104da0 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f2483dd6640 1 -- 10.20.193.28:0/930336719 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247c072380 con 0x7f247c104da0 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.078+0000 7f246affd640 1 -- 10.20.193.28:0/930336719 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c038d20 con 0x7f247c104da0 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f246affd640 1 -- 10.20.193.28:0/930336719 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f246c0047c0 con 0x7f247c104da0 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 Processor -- start 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 -- start start 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af98040 0x55b02af98420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af989f0 0x55b02af9c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afa46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b02af0fe50 con 0x55b02af9cb30 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b02aee29c0 con 0x55b02af98040 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b02ae90240 con 0x55b02af989f0 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f246affd640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24580b0da0 0x7f24580b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f246affd640 1 -- 10.20.193.28:0/930336719 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f246c1053e0 con 0x7f247c104da0 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248134a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afa46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248134a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afa46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43026/0 (socket says 10.20.193.28:43026) 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248134a640 1 -- 10.20.193.28:0/278806644 learned_addr learned my addr 10.20.193.28:0/278806644 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248234c640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24580b0da0 0x7f24580b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248134a640 1 -- 10.20.193.28:0/278806644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af989f0 msgr2=0x55b02af9c400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:48.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248134a640 1 --2- 10.20.193.28:0/278806644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af989f0 0x55b02af9c400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248134a640 1 -- 10.20.193.28:0/278806644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af98040 msgr2=0x55b02af98420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248134a640 1 --2- 10.20.193.28:0/278806644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af98040 0x55b02af98420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248134a640 1 -- 10.20.193.28:0/278806644 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02aea3420 con 0x55b02af9cb30 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248134a640 1 --2- 10.20.193.28:0/278806644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afa46b0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f2470009810 tx=0x7f2470009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3f2441c3d1b483 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f244a4e6640 1 -- 10.20.193.28:0/278806644 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2470016070 con 0x55b02af9cb30 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f244a4e6640 1 -- 10.20.193.28:0/278806644 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2470004480 con 0x55b02af9cb30 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f244a4e6640 1 -- 10.20.193.28:0/278806644 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247000bda0 con 0x55b02af9cb30 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 -- 10.20.193.28:0/278806644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 msgr2=0x55b02afa46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 --2- 10.20.193.28:0/278806644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afa46b0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f2470009810 tx=0x7f2470009ce0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f248234c640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24580b0da0 0x7f24580b3260 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f247800aae0 tx=0x7f2478009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:48.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 -- 10.20.193.28:0/278806644 shutdown_connections 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 --2- 10.20.193.28:0/278806644 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afa46b0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 --2- 10.20.193.28:0/278806644 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af989f0 0x55b02af9c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 --2- 10.20.193.28:0/278806644 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af98040 0x55b02af98420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 -- 10.20.193.28:0/278806644 >> 10.20.193.28:0/278806644 conn(0x55b02af52290 msgr2=0x55b02af8dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 -- 10.20.193.28:0/278806644 shutdown_connections 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.084+0000 7f24862dbe00 1 -- 10.20.193.28:0/278806644 wait complete. 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 -- start start 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 Processor -- start 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af989f0 0x55b02afb2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af9cb30 0x55b02afb0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b02aede8f0 con 0x55b02af98040 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b02acd0f50 con 0x55b02af9cb30 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b02afb1340 con 0x55b02af989f0 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f2481b4b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f2481b4b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43042/0 (socket says 10.20.193.28:43042) 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f2481b4b640 1 -- 10.20.193.28:0/1676108142 learned_addr learned my addr 10.20.193.28:0/1676108142 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f2481b4b640 1 -- 10.20.193.28:0/1676108142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af989f0 msgr2=0x55b02afb2b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f2481b4b640 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af989f0 0x55b02afb2b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f2481b4b640 1 -- 10.20.193.28:0/1676108142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af9cb30 msgr2=0x55b02afb0db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f2481b4b640 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af9cb30 0x55b02afb0db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f2481b4b640 1 -- 10.20.193.28:0/1676108142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02afaa490 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f2481b4b640 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb2600 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f246c0c8ef0 tx=0x7f246c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf9059299d8f489 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24377fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24377fe640 1 -- 10.20.193.28:0/1676108142 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c1051b0 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 -- 10.20.193.28:0/1676108142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02acb3b40 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 10 client.20202 _ll_register_callbacks cb 0x55b02af1bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 -- 10.20.193.28:0/1676108142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b02aef01a0 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24377fe640 1 -- 10.20.193.28:0/1676108142 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f246c033020 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24377fe640 1 -- 10.20.193.28:0/1676108142 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c04ae40 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24377fe640 1 -- 10.20.193.28:0/1676108142 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f246c0c87e0 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24377fe640 1 -- 10.20.193.28:0/1676108142 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f246c0c8a40 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 10 client.20202 fetch_fsmap learned FSMap version 41 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 -- 10.20.193.28:0/1676108142 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=41}) -- 0x55b02ae9d230 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24377fe640 1 -- 10.20.193.28:0/1676108142 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 41) ==== 8358+0+0 (secure 0 0 0) 0x7f246c0b91c0 con 0x55b02af98040 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 10 client.20202 fetch_fsmap finished waiting for FSMap version 41 2026-02-20T03:31:48.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 10 client.20202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:48.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 20 client.20202 populate_metadata read hostname 'trial028' 2026-02-20T03:31:48.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b02afc0d70 0x55b02afc3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 4 client.20202 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:48.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.089+0000 7f24862dbe00 1 -- 10.20.193.28:0/1676108142 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b02aeea5b0 con 0x55b02afc0d70 2026-02-20T03:31:48.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.116+0000 7f248134a640 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b02afc0d70 0x55b02afc3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:48.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.183+0000 7f248134a640 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b02afc0d70 0x55b02afc3230 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8075a7ad56d24e51 server_cookie=35e4bb3e1fef9480 in_seq=0 out_seq=0 2026-02-20T03:31:48.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.183+0000 7f24377fe640 10 client.20202 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:48.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24377fe640 1 -- 10.20.193.28:0/1676108142 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b02aeea5b0 con 0x55b02afc0d70 2026-02-20T03:31:48.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24377fe640 10 client.20202 handle_command_reply: tid=0 2026-02-20T03:31:48.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 client.20202 shutdown 2026-02-20T03:31:48.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 -- 10.20.193.28:0/1676108142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 msgr2=0x55b02afb2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:48.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb2600 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f246c0c8ef0 tx=0x7f246c009340 comp rx=0 tx=0).stop 2026-02-20T03:31:48.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 -- 10.20.193.28:0/1676108142 shutdown_connections 2026-02-20T03:31:48.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b02afc0d70 0x55b02afc3230 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af9cb30 0x55b02afb0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af989f0 0x55b02afb2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 --2- 10.20.193.28:0/1676108142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb2600 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24377fe640 0 client.20202 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:48.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 -- 10.20.193.28:0/1676108142 >> 10.20.193.28:0/1676108142 conn(0x55b02af52290 msgr2=0x55b02af9b350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:48.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 -- 10.20.193.28:0/1676108142 shutdown_connections 2026-02-20T03:31:48.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 1 -- 10.20.193.28:0/1676108142 wait complete. 2026-02-20T03:31:48.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.210+0000 7f24862dbe00 20 client.20202 trim_cache size 0 max 16384 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 Processor -- start 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- start start 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af98040 0x55b02afae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af989f0 0x55b02afae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afc8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2428012720 con 0x55b02af9cb30 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f242800ffc0 con 0x55b02af989f0 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f242800de10 con 0x55b02af98040 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f248234c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afc8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f248234c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afc8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43056/0 (socket says 10.20.193.28:43056) 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f248234c640 1 -- 10.20.193.28:0/2964367648 learned_addr learned my addr 10.20.193.28:0/2964367648 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f248234c640 1 -- 10.20.193.28:0/2964367648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af98040 msgr2=0x55b02afae270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f248234c640 1 --2- 10.20.193.28:0/2964367648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af98040 0x55b02afae270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f248234c640 1 -- 10.20.193.28:0/2964367648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af989f0 msgr2=0x55b02afae7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f248234c640 1 --2- 10.20.193.28:0/2964367648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af989f0 0x55b02afae7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f248234c640 1 -- 10.20.193.28:0/2964367648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02afaa2c0 con 0x55b02af9cb30 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f248234c640 1 --2- 10.20.193.28:0/2964367648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afc8b40 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f247800cea0 tx=0x7f247800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f30062537086ffd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f2449ce5640 1 -- 10.20.193.28:0/2964367648 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247801a430 con 0x55b02af9cb30 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f2449ce5640 1 -- 10.20.193.28:0/2964367648 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f247801f020 con 0x55b02af9cb30 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f2449ce5640 1 -- 10.20.193.28:0/2964367648 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247800da70 con 0x55b02af9cb30 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- 10.20.193.28:0/2964367648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 msgr2=0x55b02afc8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 --2- 10.20.193.28:0/2964367648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afc8b40 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f247800cea0 tx=0x7f247800f000 comp rx=0 tx=0).stop 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- 10.20.193.28:0/2964367648 shutdown_connections 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 --2- 10.20.193.28:0/2964367648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af9cb30 0x55b02afc8b40 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 --2- 10.20.193.28:0/2964367648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af989f0 0x55b02afae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 --2- 10.20.193.28:0/2964367648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af98040 0x55b02afae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- 10.20.193.28:0/2964367648 >> 10.20.193.28:0/2964367648 conn(0x55b02af52290 msgr2=0x55b02afafd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- 10.20.193.28:0/2964367648 shutdown_connections 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- 10.20.193.28:0/2964367648 wait complete. 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 -- start start 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.216+0000 7f24862dbe00 1 Processor -- start 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af989f0 0x55b02afb60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af9cb30 0x55b02b02bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f242800e480 con 0x55b02af98040 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f242800f8f0 con 0x55b02af989f0 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f242800eb50 con 0x55b02af9cb30 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f2481b4b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:48.225 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f2481b4b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43070/0 (socket says 10.20.193.28:43070) 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f2481b4b640 1 -- 10.20.193.28:0/3086992743 learned_addr learned my addr 10.20.193.28:0/3086992743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f2481b4b640 1 -- 10.20.193.28:0/3086992743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af9cb30 msgr2=0x55b02b02bd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f2481b4b640 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af9cb30 0x55b02b02bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f2481b4b640 1 -- 10.20.193.28:0/3086992743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af989f0 msgr2=0x55b02afb60d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f2481b4b640 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af989f0 0x55b02afb60d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f2481b4b640 1 -- 10.20.193.28:0/3086992743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b02abc1870 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f2481b4b640 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb5b90 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f246c002bd0 tx=0x7f246c009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5395e0ed5b6de97d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24377fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24377fe640 1 -- 10.20.193.28:0/3086992743 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c0cd7c0 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24377fe640 1 -- 10.20.193.28:0/3086992743 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f246c033070 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24377fe640 1 -- 10.20.193.28:0/3086992743 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c0b91f0 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 1 -- 10.20.193.28:0/3086992743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b02ae82440 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24377fe640 1 -- 10.20.193.28:0/3086992743 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f246c0cbb40 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 10 client.20208 _ll_register_callbacks cb 0x7f246c0045d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 1 -- 10.20.193.28:0/3086992743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b02aeb3810 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24377fe640 1 -- 10.20.193.28:0/3086992743 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f246c0d1470 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 10 client.20208 fetch_fsmap learned FSMap version 41 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.221+0000 7f24862dbe00 1 -- 10.20.193.28:0/3086992743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=41}) -- 0x55b02afaafb0 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.223+0000 7f24377fe640 1 -- 10.20.193.28:0/3086992743 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 41) ==== 8358+0+0 (secure 0 0 0) 0x7f246c08f060 con 0x55b02af98040 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.223+0000 7f24862dbe00 10 client.20208 fetch_fsmap finished waiting for FSMap version 41 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.223+0000 7f24862dbe00 10 client.20208 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.223+0000 7f24862dbe00 20 client.20208 populate_metadata read hostname 'trial028' 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.223+0000 7f24862dbe00 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b02b02d2d0 0x55b02b02f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.223+0000 7f24862dbe00 4 client.20208 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:31:48.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.223+0000 7f24862dbe00 1 -- 10.20.193.28:0/3086992743 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b02ae94b00 con 0x55b02b02d2d0 2026-02-20T03:31:48.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.237+0000 7f248134a640 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b02b02d2d0 0x55b02b02f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:48.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.277+0000 7f248134a640 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b02b02d2d0 0x55b02b02f790 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0a1ce0a3b375ed9 server_cookie=3f72ee9f27555cfd in_seq=0 out_seq=0 2026-02-20T03:31:48.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.277+0000 7f24377fe640 10 client.20208 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:48.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24377fe640 1 -- 10.20.193.28:0/3086992743 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b02ae94b00 con 0x55b02b02d2d0 2026-02-20T03:31:48.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24377fe640 10 client.20208 handle_command_reply: tid=0 2026-02-20T03:31:48.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 client.20208 shutdown 2026-02-20T03:31:48.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 -- 10.20.193.28:0/3086992743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 msgr2=0x55b02afb5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:48.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb5b90 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f246c002bd0 tx=0x7f246c009660 comp rx=0 tx=0).stop 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 -- 10.20.193.28:0/3086992743 shutdown_connections 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b02b02d2d0 0x55b02b02f790 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b02af9cb30 0x55b02b02bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b02af989f0 0x55b02afb60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 --2- 10.20.193.28:0/3086992743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b02af98040 0x55b02afb5b90 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 -- 10.20.193.28:0/3086992743 >> 10.20.193.28:0/3086992743 conn(0x55b02af52290 msgr2=0x55b02af8b500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24377fe640 0 client.20208 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 -- 10.20.193.28:0/3086992743 shutdown_connections 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 1 -- 10.20.193.28:0/3086992743 wait complete. 2026-02-20T03:31:48.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f24862dbe00 20 client.20208 trim_cache size 0 max 16384 2026-02-20T03:31:48.305 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:48.305 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:31:48.305 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:31:48.305 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 -- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24580b0da0 msgr2=0x7f24580b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24580b0da0 0x7f24580b3260 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f247800aae0 tx=0x7f2478009230 comp rx=0 tx=0).stop 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 -- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 msgr2=0x7f247c074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 0x7f247c074680 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f246c002fa0 tx=0x7f246c002910 comp rx=0 tx=0).stop 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 -- 10.20.193.28:0/930336719 shutdown_connections 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f24580b0da0 0x7f24580b3260 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f247c109ed0 0x7f247c06d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f247c105750 0x7f247c074bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 --2- 10.20.193.28:0/930336719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f247c104da0 0x7f247c074680 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 -- 10.20.193.28:0/930336719 >> 10.20.193.28:0/930336719 conn(0x7f247c100840 msgr2=0x7f247c101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 -- 10.20.193.28:0/930336719 shutdown_connections 2026-02-20T03:31:48.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:48.290+0000 7f2483dd6640 1 -- 10.20.193.28:0/930336719 wait complete. 2026-02-20T03:31:48.475 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:31:48.475 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:31:48.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 15.66 MB/sec execute 79 sec latency 59188.293 ms 2026-02-20T03:31:48.800 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 -- 10.20.193.28:0/392421265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0109ee0 msgr2=0x7efec0111a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 --2- 10.20.193.28:0/392421265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0109ee0 0x7efec0111a60 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7efeb000b0a0 tx=0x7efeb002f450 comp rx=0 tx=0).stop 2026-02-20T03:31:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 -- 10.20.193.28:0/392421265 shutdown_connections 2026-02-20T03:31:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 --2- 10.20.193.28:0/392421265 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0109ee0 0x7efec0111a60 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 --2- 10.20.193.28:0/392421265 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efec0105760 0x7efec01097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 --2- 10.20.193.28:0/392421265 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efec0104db0 0x7efec0105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 -- 10.20.193.28:0/392421265 >> 10.20.193.28:0/392421265 conn(0x7efec0100870 msgr2=0x7efec0102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 -- 10.20.193.28:0/392421265 shutdown_connections 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 -- 10.20.193.28:0/392421265 wait complete. 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.037+0000 7efec52e1640 1 Processor -- start 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 -- start start 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efec0104db0 0x7efec019d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0105760 0x7efec019d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efec0109ee0 0x7efec01a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efec0114e90 con 0x7efec0105760 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efec0114d10 con 0x7efec0109ee0 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efec0115010 con 0x7efec0104db0 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efebe7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0105760 0x7efec019d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:49.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efebe7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0105760 0x7efec019d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43100/0 (socket says 10.20.193.28:43100) 2026-02-20T03:31:49.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efebe7fc640 1 -- 10.20.193.28:0/3432711614 learned_addr learned my addr 10.20.193.28:0/3432711614 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:49.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efebe7fc640 1 -- 10.20.193.28:0/3432711614 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efec0104db0 msgr2=0x7efec019d2e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:49.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efebe7fc640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efec0104db0 0x7efec019d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efebe7fc640 1 -- 10.20.193.28:0/3432711614 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efec0109ee0 msgr2=0x7efec01a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efebe7fc640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efec0109ee0 0x7efec01a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efebe7fc640 1 -- 10.20.193.28:0/3432711614 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec01a2330 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efebe7fc640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0105760 0x7efec019d820 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7efea800b570 tx=0x7efea800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efe9ffff640 1 -- 10.20.193.28:0/3432711614 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8013020 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efe9ffff640 1 -- 10.20.193.28:0/3432711614 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efea8004480 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efe9ffff640 1 -- 10.20.193.28:0/3432711614 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea800fb50 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec01a2620 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec01a9e60 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec0105210 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.042+0000 7efe9ffff640 1 -- 10.20.193.28:0/3432711614 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efea8002780 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.047+0000 7efe9ffff640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.047+0000 7efe9ffff640 1 -- 10.20.193.28:0/3432711614 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7efea80e0ba0 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.047+0000 7efe9ffff640 1 -- 10.20.193.28:0/3432711614 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7efea801d020 con 0x7efec0105760 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.047+0000 7efebeffd640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:49.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.047+0000 7efebeffd640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009770 tx=0x7efeb4006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:49.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.155+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efec019e640 con 0x7efec0105760 2026-02-20T03:31:49.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.155+0000 7efe9ffff640 1 -- 10.20.193.28:0/3432711614 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11921 (secure 0 0 0) 0x7efea80ade20 con 0x7efec0105760 2026-02-20T03:31:49.159 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:31:49.159 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":42,"btime":"2026-02-20T03:31:48:222781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:31:47.396179+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28114":{"gid":28114,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1701826560","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1701826560},{"type":"v1","addr":"10.20.193.177:6837","nonce":1701826560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:31:49.159 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 42 2026-02-20T03:31:49.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 msgr2=0x7efe900b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:49.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efeb4009770 tx=0x7efeb4006cd0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0105760 msgr2=0x7efec019d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:49.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0105760 0x7efec019d820 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7efea800b570 tx=0x7efea800ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:49.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 shutdown_connections 2026-02-20T03:31:49.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efe900b0e20 0x7efe900b32e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efec0109ee0 0x7efec01a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efec0105760 0x7efec019d820 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 --2- 10.20.193.28:0/3432711614 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efec0104db0 0x7efec019d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 >> 10.20.193.28:0/3432711614 conn(0x7efec0100870 msgr2=0x7efec0101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:49.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 shutdown_connections 2026-02-20T03:31:49.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.157+0000 7efec52e1640 1 -- 10.20.193.28:0/3432711614 wait complete. 2026-02-20T03:31:49.316 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:31:49.413 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:49 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:31:49.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:49 trial028 ceph-mon[38552]: pgmap v699: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2026-02-20T03:31:49.414 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:49 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3432711614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:49 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:31:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:49 trial126 ceph-mon[38476]: pgmap v699: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2026-02-20T03:31:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:49 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3432711614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:49.614 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:49.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 15.47 MB/sec execute 80 sec latency 60188.327 ms 2026-02-20T03:31:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:49 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:31:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:49 trial177 ceph-mon[43181]: pgmap v699: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 4.3 KiB/s wr, 9 op/s 2026-02-20T03:31:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:49 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3432711614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:31:49.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- 10.20.193.28:0/694817230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe468105320 msgr2=0x7fe468111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:49.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/694817230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe468105320 0x7fe468111850 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00b0d0 tx=0x7fe45c02f490 comp rx=0 tx=0).stop 2026-02-20T03:31:49.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- 10.20.193.28:0/694817230 shutdown_connections 2026-02-20T03:31:49.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/694817230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe468105320 0x7fe468111850 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/694817230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe468104980 0x7fe468104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/694817230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe46810a980 0x7fe46810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- 10.20.193.28:0/694817230 >> 10.20.193.28:0/694817230 conn(0x7fe468100680 msgr2=0x7fe468102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:49.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- 10.20.193.28:0/694817230 shutdown_connections 2026-02-20T03:31:49.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- 10.20.193.28:0/694817230 wait complete. 2026-02-20T03:31:49.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 Processor -- start 2026-02-20T03:31:49.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- start start 2026-02-20T03:31:49.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe468104980 0x7fe46819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe468105320 0x7fe46819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe46810a980 0x7fe4681a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe468114cd0 con 0x7fe46810a980 2026-02-20T03:31:49.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe468114b50 con 0x7fe468104980 2026-02-20T03:31:49.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe468114e50 con 0x7fe468105320 2026-02-20T03:31:49.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46c9ec640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe46810a980 0x7fe4681a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:49.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46c9ec640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe46810a980 0x7fe4681a1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43120/0 (socket says 10.20.193.28:43120) 2026-02-20T03:31:49.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46c9ec640 1 -- 10.20.193.28:0/874409333 learned_addr learned my addr 10.20.193.28:0/874409333 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:49.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46c9ec640 1 -- 10.20.193.28:0/874409333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe468105320 msgr2=0x7fe46819d6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:49.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46c9ec640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe468105320 0x7fe46819d6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46c9ec640 1 -- 10.20.193.28:0/874409333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe468104980 msgr2=0x7fe46819d1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:49.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46c9ec640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe468104980 0x7fe46819d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46c9ec640 1 -- 10.20.193.28:0/874409333 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4681a2200 con 0x7fe46810a980 2026-02-20T03:31:49.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46c9ec640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe46810a980 0x7fe4681a1a80 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0077f0 tx=0x7fe45c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:49.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe4657fa640 1 -- 10.20.193.28:0/874409333 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c004590 con 0x7fe46810a980 2026-02-20T03:31:49.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- 10.20.193.28:0/874409333 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4681a2490 con 0x7fe46810a980 2026-02-20T03:31:49.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe4657fa640 1 -- 10.20.193.28:0/874409333 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe45c004730 con 0x7fe46810a980 2026-02-20T03:31:49.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe4657fa640 1 -- 10.20.193.28:0/874409333 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45c0052b0 con 0x7fe46810a980 2026-02-20T03:31:49.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe46d1ed640 1 -- 10.20.193.28:0/874409333 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4681a9d30 con 0x7fe46810a980 2026-02-20T03:31:49.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.870+0000 7fe4657fa640 1 -- 10.20.193.28:0/874409333 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe45c002a60 con 0x7fe46810a980 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 Processor -- start 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 -- start start 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920ef50 0x562ad920f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920f900 0x562ad9211410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad9211b40 0x562ad92124d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562ad9192e00 con 0x562ad920ef50 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562ad9165970 con 0x562ad920f900 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562ad91131f0 con 0x562ad9211b40 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920ef50 0x562ad920f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920ef50 0x562ad920f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43124/0 (socket says 10.20.193.28:43124) 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4677fe640 1 -- 10.20.193.28:0/4189267947 learned_addr learned my addr 10.20.193.28:0/4189267947 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:49.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4657fa640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe43c0b0e20 0x7fe43c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4677fe640 1 -- 10.20.193.28:0/4189267947 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad9211b40 msgr2=0x562ad92124d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4677fe640 1 --2- 10.20.193.28:0/4189267947 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad9211b40 0x562ad92124d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4677fe640 1 -- 10.20.193.28:0/4189267947 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920f900 msgr2=0x562ad9211410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4677fe640 1 --2- 10.20.193.28:0/4189267947 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920f900 0x562ad9211410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4657fa640 1 -- 10.20.193.28:0/874409333 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe45c1057c0 con 0x7fe46810a980 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4677fe640 1 -- 10.20.193.28:0/4189267947 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad91263d0 con 0x562ad920ef50 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe46c9ec640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe43c0b0e20 0x7fe43c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe4677fe640 1 --2- 10.20.193.28:0/4189267947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920ef50 0x562ad920f330 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe45802d210 tx=0x7fe45802d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c4c910ebc7dfe5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe438ce3640 1 -- 10.20.193.28:0/4189267947 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45802de20 con 0x562ad920ef50 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe438ce3640 1 -- 10.20.193.28:0/4189267947 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe458029850 con 0x562ad920ef50 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe438ce3640 1 -- 10.20.193.28:0/4189267947 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458002780 con 0x562ad920ef50 2026-02-20T03:31:49.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 -- 10.20.193.28:0/4189267947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920ef50 msgr2=0x562ad920f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 --2- 10.20.193.28:0/4189267947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920ef50 0x562ad920f330 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe45802d210 tx=0x7fe45802d6e0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe46c9ec640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe43c0b0e20 0x7fe43c0b32e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0c92d0 tx=0x7fe45c009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 -- 10.20.193.28:0/4189267947 shutdown_connections 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 --2- 10.20.193.28:0/4189267947 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad9211b40 0x562ad92124d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 --2- 10.20.193.28:0/4189267947 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920f900 0x562ad9211410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 --2- 10.20.193.28:0/4189267947 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920ef50 0x562ad920f330 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 -- 10.20.193.28:0/4189267947 >> 10.20.193.28:0/4189267947 conn(0x562ad91d5240 msgr2=0x562ad92196f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 -- 10.20.193.28:0/4189267947 shutdown_connections 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.875+0000 7fe47097be00 1 -- 10.20.193.28:0/4189267947 wait complete. 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 -- start start 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 Processor -- start 2026-02-20T03:31:49.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad920ef50 0x562ad922cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad922d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad9211b40 0x562ad922b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562ad91618a0 con 0x562ad920f900 2026-02-20T03:31:49.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562ad8f53f50 con 0x562ad9211b40 2026-02-20T03:31:49.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562ad922ba00 con 0x562ad920ef50 2026-02-20T03:31:49.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe467fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad922d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:49.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe467fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad922d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43138/0 (socket says 10.20.193.28:43138) 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe467fff640 1 -- 10.20.193.28:0/3789396449 learned_addr learned my addr 10.20.193.28:0/3789396449 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe467fff640 1 -- 10.20.193.28:0/3789396449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad920ef50 msgr2=0x562ad922cc10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe467fff640 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad920ef50 0x562ad922cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe467fff640 1 -- 10.20.193.28:0/3789396449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad9211b40 msgr2=0x562ad922b3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe467fff640 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad9211b40 0x562ad922b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe467fff640 1 -- 10.20.193.28:0/3789396449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad9224ae0 con 0x562ad920f900 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe467fff640 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad922d150 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe454009ed0 tx=0x7fe45400b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d59afa940db567 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe429ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe429ffb640 1 -- 10.20.193.28:0/3789396449 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454016070 con 0x562ad920f900 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 -- 10.20.193.28:0/3789396449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad8f36b40 con 0x562ad920f900 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe429ffb640 1 -- 10.20.193.28:0/3789396449 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe454002780 con 0x562ad920f900 2026-02-20T03:31:49.888 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 10 client.20226 _ll_register_callbacks cb 0x562ad919eeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe429ffb640 1 -- 10.20.193.28:0/3789396449 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4540117e0 con 0x562ad920f900 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe429ffb640 1 -- 10.20.193.28:0/3789396449 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe45401a3b0 con 0x562ad920f900 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 -- 10.20.193.28:0/3789396449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562ad9173150 con 0x562ad920f900 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe429ffb640 1 -- 10.20.193.28:0/3789396449 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe454011ac0 con 0x562ad920f900 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 10 client.20226 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 -- 10.20.193.28:0/3789396449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x562ad91201e0 con 0x562ad920f900 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe429ffb640 1 -- 10.20.193.28:0/3789396449 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7fe454011c60 con 0x562ad920f900 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 10 client.20226 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 10 client.20226 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 20 client.20226 populate_metadata read hostname 'trial028' 2026-02-20T03:31:49.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562ad923b4f0 0x562ad923d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 4 client.20226 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:49.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.878+0000 7fe47097be00 1 -- 10.20.193.28:0/3789396449 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ad916d560 con 0x562ad923b4f0 2026-02-20T03:31:49.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.905+0000 7fe4677fe640 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562ad923b4f0 0x562ad923d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:49.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.945+0000 7fe4677fe640 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562ad923b4f0 0x562ad923d900 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2119f6eb5adc462e server_cookie=a2ea358d711d560e in_seq=0 out_seq=0 2026-02-20T03:31:49.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.945+0000 7fe429ffb640 10 client.20226 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:49.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe429ffb640 1 -- 10.20.193.28:0/3789396449 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562ad916d560 con 0x562ad923b4f0 2026-02-20T03:31:49.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe429ffb640 10 client.20226 handle_command_reply: tid=0 2026-02-20T03:31:49.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 client.20226 shutdown 2026-02-20T03:31:49.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 -- 10.20.193.28:0/3789396449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 msgr2=0x562ad922d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:49.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad922d150 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe454009ed0 tx=0x7fe45400b4b0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 -- 10.20.193.28:0/3789396449 shutdown_connections 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad9211b40 0x562ad922b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562ad923b4f0 0x562ad923d900 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad922d150 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 --2- 10.20.193.28:0/3789396449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad920ef50 0x562ad922cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 -- 10.20.193.28:0/3789396449 >> 10.20.193.28:0/3789396449 conn(0x562ad91d5240 msgr2=0x562ad9210c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe429ffb640 0 client.20226 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 -- 10.20.193.28:0/3789396449 shutdown_connections 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 1 -- 10.20.193.28:0/3789396449 wait complete. 2026-02-20T03:31:49.961 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.958+0000 7fe47097be00 20 client.20226 trim_cache size 0 max 16384 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 Processor -- start 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- start start 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad920ef50 0x562ad9216e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920f900 0x562ad9217360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad9211b40 0x562ad9228920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c0126f0 con 0x562ad9211b40 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c00ffc0 con 0x562ad920f900 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c00de10 con 0x562ad920ef50 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe4677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad9211b40 0x562ad9228920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe4677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad9211b40 0x562ad9228920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43148/0 (socket says 10.20.193.28:43148) 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe4677fe640 1 -- 10.20.193.28:0/3182833931 learned_addr learned my addr 10.20.193.28:0/3182833931 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe4677fe640 1 -- 10.20.193.28:0/3182833931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad920ef50 msgr2=0x562ad9216e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe4677fe640 1 --2- 10.20.193.28:0/3182833931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad920ef50 0x562ad9216e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe4677fe640 1 -- 10.20.193.28:0/3182833931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920f900 msgr2=0x562ad9217360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe4677fe640 1 --2- 10.20.193.28:0/3182833931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920f900 0x562ad9217360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe4677fe640 1 -- 10.20.193.28:0/3182833931 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad9224910 con 0x562ad9211b40 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe4677fe640 1 --2- 10.20.193.28:0/3182833931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad9211b40 0x562ad9228920 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fe45802b2f0 tx=0x7fe45802b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c105f711d92ab60a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe42bfff640 1 -- 10.20.193.28:0/3182833931 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45803a040 con 0x562ad9211b40 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe42bfff640 1 -- 10.20.193.28:0/3182833931 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe458004360 con 0x562ad9211b40 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe42bfff640 1 -- 10.20.193.28:0/3182833931 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4580029e0 con 0x562ad9211b40 2026-02-20T03:31:49.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- 10.20.193.28:0/3182833931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad9211b40 msgr2=0x562ad9228920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:49.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- 10.20.193.28:0/3182833931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad9211b40 0x562ad9228920 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fe45802b2f0 tx=0x7fe45802b320 comp rx=0 tx=0).stop 2026-02-20T03:31:49.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- 10.20.193.28:0/3182833931 shutdown_connections 2026-02-20T03:31:49.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- 10.20.193.28:0/3182833931 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad9211b40 0x562ad9228920 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- 10.20.193.28:0/3182833931 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920f900 0x562ad9217360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- 10.20.193.28:0/3182833931 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad920ef50 0x562ad9216e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- 10.20.193.28:0/3182833931 >> 10.20.193.28:0/3182833931 conn(0x562ad91d5240 msgr2=0x562ad922cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- 10.20.193.28:0/3182833931 shutdown_connections 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- 10.20.193.28:0/3182833931 wait complete. 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- start start 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 Processor -- start 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920ef50 0x562ad9231ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad9231ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad9211b40 0x562ad9232530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c00e480 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c00f8f0 con 0x562ad920ef50 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c00eb50 con 0x562ad9211b40 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe467fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad9231ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe467fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad9231ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43152/0 (socket says 10.20.193.28:43152) 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe467fff640 1 -- 10.20.193.28:0/1320446063 learned_addr learned my addr 10.20.193.28:0/1320446063 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe467fff640 1 -- 10.20.193.28:0/1320446063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad9211b40 msgr2=0x562ad9232530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe467fff640 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad9211b40 0x562ad9232530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe467fff640 1 -- 10.20.193.28:0/1320446063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920ef50 msgr2=0x562ad9231ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe467fff640 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920ef50 0x562ad9231ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe467fff640 1 -- 10.20.193.28:0/1320446063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad8e44870 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe467fff640 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad9231ff0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a010 tx=0x7fe45400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c51cdb00be8f0c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe429ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe429ffb640 1 -- 10.20.193.28:0/1320446063 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454016040 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe429ffb640 1 -- 10.20.193.28:0/1320446063 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x562ad9173150 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe429ffb640 1 -- 10.20.193.28:0/1320446063 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe454002d00 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- 10.20.193.28:0/1320446063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad91053f0 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe429ffb640 1 -- 10.20.193.28:0/1320446063 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe4540114e0 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 10 client.20232 _ll_register_callbacks cb 0x7fe454009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.964+0000 7fe47097be00 1 -- 10.20.193.28:0/1320446063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe458004360 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe429ffb640 1 -- 10.20.193.28:0/1320446063 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe4540116e0 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe47097be00 10 client.20232 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe47097be00 1 -- 10.20.193.28:0/1320446063 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x562ad9225600 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe429ffb640 1 -- 10.20.193.28:0/1320446063 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7fe45402f030 con 0x562ad920f900 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe47097be00 10 client.20232 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe47097be00 10 client.20232 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:31:49.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe47097be00 20 client.20232 populate_metadata read hostname 'trial028' 2026-02-20T03:31:49.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe47097be00 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562ad92a7a60 0x562ad92a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:49.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe47097be00 4 client.20232 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:31:49.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.969+0000 7fe47097be00 1 -- 10.20.193.28:0/1320446063 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ad916d560 con 0x562ad92a7a60 2026-02-20T03:31:49.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:49.985+0000 7fe4677fe640 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562ad92a7a60 0x562ad92a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:50.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.039+0000 7fe4677fe640 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562ad92a7a60 0x562ad92a9f20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8300848ea1fd8e9c server_cookie=9a4542e989453dc8 in_seq=0 out_seq=0 2026-02-20T03:31:50.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.039+0000 7fe429ffb640 10 client.20232 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe429ffb640 1 -- 10.20.193.28:0/1320446063 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ad916d560 con 0x562ad92a7a60 2026-02-20T03:31:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe429ffb640 10 client.20232 handle_command_reply: tid=0 2026-02-20T03:31:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 client.20232 shutdown 2026-02-20T03:31:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 -- 10.20.193.28:0/1320446063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 msgr2=0x562ad9231ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:50.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad9231ff0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fe45400a010 tx=0x7fe45400bfd0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 -- 10.20.193.28:0/1320446063 shutdown_connections 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562ad9211b40 0x562ad9232530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562ad92a7a60 0x562ad92a9f20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562ad920f900 0x562ad9231ff0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 --2- 10.20.193.28:0/1320446063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562ad920ef50 0x562ad9231ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 -- 10.20.193.28:0/1320446063 >> 10.20.193.28:0/1320446063 conn(0x562ad91d5240 msgr2=0x562ad9216e20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe429ffb640 0 client.20232 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 -- 10.20.193.28:0/1320446063 shutdown_connections 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 1 -- 10.20.193.28:0/1320446063 wait complete. 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe47097be00 20 client.20232 trim_cache size 0 max 16384 2026-02-20T03:31:50.055 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:31:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 -- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe43c0b0e20 msgr2=0x7fe43c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe43c0b0e20 0x7fe43c0b32e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0c92d0 tx=0x7fe45c009040 comp rx=0 tx=0).stop 2026-02-20T03:31:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 -- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe46810a980 msgr2=0x7fe4681a1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe46810a980 0x7fe4681a1a80 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fe45c0077f0 tx=0x7fe45c009300 comp rx=0 tx=0).stop 2026-02-20T03:31:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 -- 10.20.193.28:0/874409333 shutdown_connections 2026-02-20T03:31:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe43c0b0e20 0x7fe43c0b32e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe46810a980 0x7fe4681a1a80 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe468105320 0x7fe46819d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 --2- 10.20.193.28:0/874409333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe468104980 0x7fe46819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 -- 10.20.193.28:0/874409333 >> 10.20.193.28:0/874409333 conn(0x7fe468100680 msgr2=0x7fe468100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:50.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 -- 10.20.193.28:0/874409333 shutdown_connections 2026-02-20T03:31:50.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.052+0000 7fe46d1ed640 1 -- 10.20.193.28:0/874409333 wait complete. 2026-02-20T03:31:50.197 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:31:50.509 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:50.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 15.28 MB/sec execute 81 sec latency 61188.363 ms 2026-02-20T03:31:50.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- 10.20.193.28:0/4245293880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 msgr2=0x7f2790108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:50.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 --2- 10.20.193.28:0/4245293880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 0x7f2790108ae0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f2780009a60 tx=0x7f278002f290 comp rx=0 tx=0).stop 2026-02-20T03:31:50.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- 10.20.193.28:0/4245293880 shutdown_connections 2026-02-20T03:31:50.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 --2- 10.20.193.28:0/4245293880 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27901030a0 0x7f279010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 --2- 10.20.193.28:0/4245293880 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2790102700 0x7f2790102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 --2- 10.20.193.28:0/4245293880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 0x7f2790108ae0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- 10.20.193.28:0/4245293880 >> 10.20.193.28:0/4245293880 conn(0x7f27900fe440 msgr2=0x7f2790100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:50.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- 10.20.193.28:0/4245293880 shutdown_connections 2026-02-20T03:31:50.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- 10.20.193.28:0/4245293880 wait complete. 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 Processor -- start 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- start start 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2790102700 0x7f2790075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27901030a0 0x7f27900758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 0x7f2790075df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2790112a50 con 0x7f2790108700 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f27901128d0 con 0x7f2790102700 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2790112bd0 con 0x7f27901030a0 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2796c94640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 0x7f2790075df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:50.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2796c94640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 0x7f2790075df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43170/0 (socket says 10.20.193.28:43170) 2026-02-20T03:31:50.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2796c94640 1 -- 10.20.193.28:0/1547832075 learned_addr learned my addr 10.20.193.28:0/1547832075 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:50.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2796c94640 1 -- 10.20.193.28:0/1547832075 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27901030a0 msgr2=0x7f27900758b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:50.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2796c94640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27901030a0 0x7f27900758b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2796c94640 1 -- 10.20.193.28:0/1547832075 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2790102700 msgr2=0x7f2790075370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:50.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2796c94640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2790102700 0x7f2790075370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2796c94640 1 -- 10.20.193.28:0/1547832075 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27901a95c0 con 0x7f2790108700 2026-02-20T03:31:50.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2796c94640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 0x7f2790075df0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f278c00b990 tx=0x7f278c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:50.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f27777fe640 1 -- 10.20.193.28:0/1547832075 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c006e60 con 0x7f2790108700 2026-02-20T03:31:50.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f27777fe640 1 -- 10.20.193.28:0/1547832075 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f278c010070 con 0x7f2790108700 2026-02-20T03:31:50.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- 10.20.193.28:0/1547832075 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27901a98b0 con 0x7f2790108700 2026-02-20T03:31:50.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f27777fe640 1 -- 10.20.193.28:0/1547832075 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c004800 con 0x7f2790108700 2026-02-20T03:31:50.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.760+0000 7f2797495640 1 -- 10.20.193.28:0/1547832075 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27901a9df0 con 0x7f2790108700 2026-02-20T03:31:50.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f27777fe640 1 -- 10.20.193.28:0/1547832075 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f278c01d030 con 0x7f2790108700 2026-02-20T03:31:50.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f279ac23e00 1 Processor -- start 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f279ac23e00 1 -- start start 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a746a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a74645e0 0x55e9a7464a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 0x55e9a7470de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f279ac23e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9a73e4e00 con 0x55e9a7469fb0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f279ac23e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e9a73b7970 con 0x55e9a7464f60 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f279ac23e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e9a73651f0 con 0x55e9a74645e0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2795c92640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a746a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2795c92640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a746a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43186/0 (socket says 10.20.193.28:43186) 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2795c92640 1 -- 10.20.193.28:0/1617649014 learned_addr learned my addr 10.20.193.28:0/1617649014 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2795c92640 1 -- 10.20.193.28:0/1617649014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a74645e0 msgr2=0x55e9a7464a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2795c92640 1 --2- 10.20.193.28:0/1617649014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a74645e0 0x55e9a7464a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2795c92640 1 -- 10.20.193.28:0/1617649014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 msgr2=0x55e9a7470de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2795c92640 1 --2- 10.20.193.28:0/1617649014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 0x55e9a7470de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2795c92640 1 -- 10.20.193.28:0/1617649014 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a73783d0 con 0x55e9a7469fb0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2795c92640 1 --2- 10.20.193.28:0/1617649014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a746a390 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f27840098a0 tx=0x7f2784009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fcc51721ee0d80 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f27777fe640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f276c0b0da0 0x7f276c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f27777fe640 1 -- 10.20.193.28:0/1547832075 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f278c0e00b0 con 0x7f2790108700 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2774cf3640 1 -- 10.20.193.28:0/1617649014 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784016070 con 0x55e9a7469fb0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2774cf3640 1 -- 10.20.193.28:0/1617649014 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f278400b8d0 con 0x55e9a7469fb0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2774cf3640 1 -- 10.20.193.28:0/1617649014 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784002e60 con 0x55e9a7469fb0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.765+0000 7f2796493640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f276c0b0da0 0x7f276c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f279ac23e00 1 -- 10.20.193.28:0/1617649014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 msgr2=0x55e9a746a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1617649014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a746a390 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f27840098a0 tx=0x7f2784009d70 comp rx=0 tx=0).stop 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f2796493640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f276c0b0da0 0x7f276c0b3260 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2780009950 tx=0x7f27800023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f279ac23e00 1 -- 10.20.193.28:0/1617649014 shutdown_connections 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1617649014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 0x55e9a7470de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1617649014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a74645e0 0x55e9a7464a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1617649014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a746a390 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f279ac23e00 1 -- 10.20.193.28:0/1617649014 >> 10.20.193.28:0/1617649014 conn(0x55e9a7427240 msgr2=0x55e9a7462ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f279ac23e00 1 -- 10.20.193.28:0/1617649014 shutdown_connections 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.770+0000 7f279ac23e00 1 -- 10.20.193.28:0/1617649014 wait complete. 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 -- start start 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 Processor -- start 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a747ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a7464f60 0x55e9a747f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7469fb0 0x55e9a747d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9a73b38a0 con 0x55e9a74645e0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e9a71a5f50 con 0x55e9a7469fb0 2026-02-20T03:31:50.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e9a747dcd0 con 0x55e9a7464f60 2026-02-20T03:31:50.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f2796493640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a747ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:50.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f2796493640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a747ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43192/0 (socket says 10.20.193.28:43192) 2026-02-20T03:31:50.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f2796493640 1 -- 10.20.193.28:0/1955793192 learned_addr learned my addr 10.20.193.28:0/1955793192 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:50.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f2796493640 1 -- 10.20.193.28:0/1955793192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a7464f60 msgr2=0x55e9a747f350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:50.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f2796493640 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a7464f60 0x55e9a747f350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f2796493640 1 -- 10.20.193.28:0/1955793192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7469fb0 msgr2=0x55e9a747d550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:50.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f2796493640 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7469fb0 0x55e9a747d550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f2796493640 1 -- 10.20.193.28:0/1955793192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a7476b20 con 0x55e9a74645e0 2026-02-20T03:31:50.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f2796493640 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a747ee10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f2780002990 tx=0x7f278002f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd81a1d55d86b22 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:50.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f273ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:50.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f273ffff640 1 -- 10.20.193.28:0/1955793192 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780051070 con 0x55e9a74645e0 2026-02-20T03:31:50.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f273ffff640 1 -- 10.20.193.28:0/1955793192 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2780033040 con 0x55e9a74645e0 2026-02-20T03:31:50.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f273ffff640 1 -- 10.20.193.28:0/1955793192 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27800426d0 con 0x55e9a74645e0 2026-02-20T03:31:50.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 -- 10.20.193.28:0/1955793192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9a7188b40 con 0x55e9a74645e0 2026-02-20T03:31:50.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f273ffff640 1 -- 10.20.193.28:0/1955793192 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f2780042870 con 0x55e9a74645e0 2026-02-20T03:31:50.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 10 client.20244 _ll_register_callbacks cb 0x55e9a73f0eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:50.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 -- 10.20.193.28:0/1955793192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9a73c5150 con 0x55e9a74645e0 2026-02-20T03:31:50.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f273ffff640 1 -- 10.20.193.28:0/1955793192 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2780042a70 con 0x55e9a74645e0 2026-02-20T03:31:50.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 10 client.20244 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:50.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 -- 10.20.193.28:0/1955793192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55e9a73721e0 con 0x55e9a74645e0 2026-02-20T03:31:50.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f273ffff640 1 -- 10.20.193.28:0/1955793192 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f2780042c10 con 0x55e9a74645e0 2026-02-20T03:31:50.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 10 client.20244 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:50.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 10 client.20244 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:31:50.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 20 client.20244 populate_metadata read hostname 'trial028' 2026-02-20T03:31:50.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9a748d670 0x55e9a748fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 4 client.20244 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:50.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.772+0000 7f279ac23e00 1 -- 10.20.193.28:0/1955793192 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9a73bf560 con 0x55e9a748d670 2026-02-20T03:31:50.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.799+0000 7f2795c92640 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9a748d670 0x55e9a748fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:50.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.852+0000 7f2795c92640 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9a748d670 0x55e9a748fb10 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2190cd42cd1eb56 server_cookie=13e10c0be837f583 in_seq=0 out_seq=0 2026-02-20T03:31:50.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.852+0000 7f273ffff640 10 client.20244 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f273ffff640 1 -- 10.20.193.28:0/1955793192 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e9a73bf560 con 0x55e9a748d670 2026-02-20T03:31:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f273ffff640 10 client.20244 handle_command_reply: tid=0 2026-02-20T03:31:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 client.20244 shutdown 2026-02-20T03:31:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 -- 10.20.193.28:0/1955793192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 msgr2=0x55e9a747ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a747ee10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f2780002990 tx=0x7f278002f290 comp rx=0 tx=0).stop 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 -- 10.20.193.28:0/1955793192 shutdown_connections 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9a748d670 0x55e9a748fb10 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7469fb0 0x55e9a747d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a7464f60 0x55e9a747f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 --2- 10.20.193.28:0/1955793192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a747ee10 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 -- 10.20.193.28:0/1955793192 >> 10.20.193.28:0/1955793192 conn(0x55e9a7427240 msgr2=0x55e9a74633f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f273ffff640 0 client.20244 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 -- 10.20.193.28:0/1955793192 shutdown_connections 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 1 -- 10.20.193.28:0/1955793192 wait complete. 2026-02-20T03:31:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.879+0000 7f279ac23e00 20 client.20244 trim_cache size 0 max 16384 2026-02-20T03:31:50.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 Processor -- start 2026-02-20T03:31:50.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- start start 2026-02-20T03:31:50.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a74645e0 0x55e9a748a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 0x55e9a74634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a7463a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f27380126f0 con 0x55e9a7469fb0 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f273800ffc0 con 0x55e9a7464f60 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f273800de10 con 0x55e9a74645e0 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f2796c94640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a7463a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f2796c94640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a7463a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43208/0 (socket says 10.20.193.28:43208) 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f2796c94640 1 -- 10.20.193.28:0/3075109104 learned_addr learned my addr 10.20.193.28:0/3075109104 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f2796c94640 1 -- 10.20.193.28:0/3075109104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a74645e0 msgr2=0x55e9a748a340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f2796c94640 1 --2- 10.20.193.28:0/3075109104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a74645e0 0x55e9a748a340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f2796c94640 1 -- 10.20.193.28:0/3075109104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 msgr2=0x55e9a74634d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f2796c94640 1 --2- 10.20.193.28:0/3075109104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 0x55e9a74634d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f2796c94640 1 -- 10.20.193.28:0/3075109104 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a7476950 con 0x55e9a7469fb0 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f2796c94640 1 --2- 10.20.193.28:0/3075109104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a7463a10 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f278c0a4db0 tx=0x7f278c0a7560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43143012b870a840 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:50.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f275e4e6640 1 -- 10.20.193.28:0/3075109104 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c0ac140 con 0x55e9a7469fb0 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f275e4e6640 1 -- 10.20.193.28:0/3075109104 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f278c0b0ff0 con 0x55e9a7469fb0 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f275e4e6640 1 -- 10.20.193.28:0/3075109104 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c0a6da0 con 0x55e9a7469fb0 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- 10.20.193.28:0/3075109104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 msgr2=0x55e9a7463a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3075109104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a7463a10 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f278c0a4db0 tx=0x7f278c0a7560 comp rx=0 tx=0).stop 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- 10.20.193.28:0/3075109104 shutdown_connections 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3075109104 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a7469fb0 0x55e9a7463a10 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3075109104 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 0x55e9a74634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3075109104 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a74645e0 0x55e9a748a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- 10.20.193.28:0/3075109104 >> 10.20.193.28:0/3075109104 conn(0x55e9a7427240 msgr2=0x55e9a7489c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:50.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- 10.20.193.28:0/3075109104 shutdown_connections 2026-02-20T03:31:50.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- 10.20.193.28:0/3075109104 wait complete. 2026-02-20T03:31:50.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- start start 2026-02-20T03:31:50.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 Processor -- start 2026-02-20T03:31:50.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a74852c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 0x55e9a7481c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a7469fb0 0x55e9a74821b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f273800e480 con 0x55e9a74645e0 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f273800f8f0 con 0x55e9a7464f60 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.884+0000 7f279ac23e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f273800eb50 con 0x55e9a7469fb0 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f2796493640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a74852c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f2796493640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a74852c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43216/0 (socket says 10.20.193.28:43216) 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f2796493640 1 -- 10.20.193.28:0/3772584857 learned_addr learned my addr 10.20.193.28:0/3772584857 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f2796493640 1 -- 10.20.193.28:0/3772584857 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a7469fb0 msgr2=0x55e9a74821b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f2796493640 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a7469fb0 0x55e9a74821b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f2796493640 1 -- 10.20.193.28:0/3772584857 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 msgr2=0x55e9a7481c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f2796493640 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 0x55e9a7481c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f2796493640 1 -- 10.20.193.28:0/3772584857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9a7096870 con 0x55e9a74645e0 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f2796493640 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a74852c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f2780042fd0 tx=0x7f278002f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfc3bb56978ea63 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:50.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f273ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f273ffff640 1 -- 10.20.193.28:0/3772584857 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2780051070 con 0x55e9a74645e0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f273ffff640 1 -- 10.20.193.28:0/3772584857 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e9a73c5150 con 0x55e9a74645e0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f273ffff640 1 -- 10.20.193.28:0/3772584857 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27800616c0 con 0x55e9a74645e0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 1 -- 10.20.193.28:0/3772584857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9a73573f0 con 0x55e9a74645e0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 10 client.20250 _ll_register_callbacks cb 0x7f2780009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 1 -- 10.20.193.28:0/3772584857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9a73887c0 con 0x55e9a74645e0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f273ffff640 1 -- 10.20.193.28:0/3772584857 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f2780038800 con 0x55e9a74645e0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f273ffff640 1 -- 10.20.193.28:0/3772584857 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2780038e20 con 0x55e9a74645e0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 10 client.20250 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 1 -- 10.20.193.28:0/3772584857 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55e9a7477640 con 0x55e9a74645e0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f273ffff640 1 -- 10.20.193.28:0/3772584857 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f2780042440 con 0x55e9a74645e0 2026-02-20T03:31:50.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 10 client.20250 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:50.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 10 client.20250 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:31:50.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 20 client.20250 populate_metadata read hostname 'trial028' 2026-02-20T03:31:50.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9a74f96f0 0x55e9a74fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:50.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 4 client.20250 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:31:50.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.889+0000 7f279ac23e00 1 -- 10.20.193.28:0/3772584857 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9a7369ab0 con 0x55e9a74f96f0 2026-02-20T03:31:50.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.906+0000 7f2795c92640 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9a74f96f0 0x55e9a74fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:50.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.973+0000 7f2795c92640 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9a74f96f0 0x55e9a74fbbb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2cfea1824e4128ad server_cookie=69d06c363da09e64 in_seq=0 out_seq=0 2026-02-20T03:31:50.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.973+0000 7f273ffff640 10 client.20250 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:50.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f273ffff640 1 -- 10.20.193.28:0/3772584857 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9a7369ab0 con 0x55e9a74f96f0 2026-02-20T03:31:50.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f273ffff640 10 client.20250 handle_command_reply: tid=0 2026-02-20T03:31:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 client.20250 shutdown 2026-02-20T03:31:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 -- 10.20.193.28:0/3772584857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 msgr2=0x55e9a74852c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a74852c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f2780042fd0 tx=0x7f278002f900 comp rx=0 tx=0).stop 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 -- 10.20.193.28:0/3772584857 shutdown_connections 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9a74f96f0 0x55e9a74fbbb0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9a7469fb0 0x55e9a74821b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9a7464f60 0x55e9a7481c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 --2- 10.20.193.28:0/3772584857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9a74645e0 0x55e9a74852c0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 -- 10.20.193.28:0/3772584857 >> 10.20.193.28:0/3772584857 conn(0x55e9a7427240 msgr2=0x55e9a747bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f273ffff640 0 client.20250 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 -- 10.20.193.28:0/3772584857 shutdown_connections 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 1 -- 10.20.193.28:0/3772584857 wait complete. 2026-02-20T03:31:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f279ac23e00 20 client.20250 trim_cache size 0 max 16384 2026-02-20T03:31:50.991 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:31:51.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 -- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f276c0b0da0 msgr2=0x7f276c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:51.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f276c0b0da0 0x7f276c0b3260 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2780009950 tx=0x7f27800023d0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 -- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 msgr2=0x7f2790075df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:51.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 0x7f2790075df0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f278c00b990 tx=0x7f278c00be60 comp rx=0 tx=0).stop 2026-02-20T03:31:51.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 -- 10.20.193.28:0/1547832075 shutdown_connections 2026-02-20T03:31:51.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f276c0b0da0 0x7f276c0b3260 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2790108700 0x7f2790075df0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27901030a0 0x7f27900758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 --2- 10.20.193.28:0/1547832075 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2790102700 0x7f2790075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 -- 10.20.193.28:0/1547832075 >> 10.20.193.28:0/1547832075 conn(0x7f27900fe440 msgr2=0x7f27900fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:51.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 -- 10.20.193.28:0/1547832075 shutdown_connections 2026-02-20T03:31:51.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:50.986+0000 7f2797495640 1 -- 10.20.193.28:0/1547832075 wait complete. 2026-02-20T03:31:51.131 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:31:51.429 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:51.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:51 trial028 ceph-mon[38552]: pgmap v700: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2026-02-20T03:31:51.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:51 trial126 ceph-mon[38476]: pgmap v700: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2026-02-20T03:31:51.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- 10.20.193.28:0/549658535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 msgr2=0x7fe394111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:51.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 --2- 10.20.193.28:0/549658535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 0x7fe394111850 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe39000b0d0 tx=0x7fe39002f490 comp rx=0 tx=0).stop 2026-02-20T03:31:51.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- 10.20.193.28:0/549658535 shutdown_connections 2026-02-20T03:31:51.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 --2- 10.20.193.28:0/549658535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 0x7fe394111850 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 --2- 10.20.193.28:0/549658535 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe394104980 0x7fe394104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 --2- 10.20.193.28:0/549658535 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe39410a980 0x7fe39410ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- 10.20.193.28:0/549658535 >> 10.20.193.28:0/549658535 conn(0x7fe394100680 msgr2=0x7fe394102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:51.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- 10.20.193.28:0/549658535 shutdown_connections 2026-02-20T03:31:51.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- 10.20.193.28:0/549658535 wait complete. 2026-02-20T03:31:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 Processor -- start 2026-02-20T03:31:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- start start 2026-02-20T03:31:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe394104980 0x7fe39419d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 0x7fe39419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe39410a980 0x7fe3941a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe394114c80 con 0x7fe394105320 2026-02-20T03:31:51.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe394114b00 con 0x7fe394104980 2026-02-20T03:31:51.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe394114e00 con 0x7fe39410a980 2026-02-20T03:31:51.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe398e0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 0x7fe39419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:51.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe398e0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 0x7fe39419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43244/0 (socket says 10.20.193.28:43244) 2026-02-20T03:31:51.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe398e0a640 1 -- 10.20.193.28:0/32999740 learned_addr learned my addr 10.20.193.28:0/32999740 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:51.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe398e0a640 1 -- 10.20.193.28:0/32999740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe39410a980 msgr2=0x7fe3941a1a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:51.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe398e0a640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe39410a980 0x7fe3941a1a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe398e0a640 1 -- 10.20.193.28:0/32999740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe394104980 msgr2=0x7fe39419d160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:51.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe398e0a640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe394104980 0x7fe39419d160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe398e0a640 1 -- 10.20.193.28:0/32999740 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3941a21b0 con 0x7fe394105320 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe398e0a640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 0x7fe39419d6a0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe38800b570 tx=0x7fe38800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe3827fc640 1 -- 10.20.193.28:0/32999740 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388013020 con 0x7fe394105320 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe3827fc640 1 -- 10.20.193.28:0/32999740 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe388004480 con 0x7fe394105320 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe3827fc640 1 -- 10.20.193.28:0/32999740 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38800fb50 con 0x7fe394105320 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- 10.20.193.28:0/32999740 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3941a24a0 con 0x7fe394105320 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.682+0000 7fe39a60d640 1 -- 10.20.193.28:0/32999740 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3941a9ce0 con 0x7fe394105320 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe3827fc640 1 -- 10.20.193.28:0/32999740 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe388002780 con 0x7fe394105320 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 Processor -- start 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 -- start start 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd254390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24e5e0 0x559ddd24ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24ef60 0x559ddd25ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ddd1cee00 con 0x559ddd253fb0 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559ddd1a1970 con 0x559ddd24ef60 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559ddd14f1f0 con 0x559ddd24e5e0 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe399e0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd254390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe399e0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd254390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43256/0 (socket says 10.20.193.28:43256) 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe399e0c640 1 -- 10.20.193.28:0/827578053 learned_addr learned my addr 10.20.193.28:0/827578053 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe399e0c640 1 -- 10.20.193.28:0/827578053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24e5e0 msgr2=0x559ddd24ea20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe399e0c640 1 --2- 10.20.193.28:0/827578053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24e5e0 0x559ddd24ea20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe399e0c640 1 -- 10.20.193.28:0/827578053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24ef60 msgr2=0x559ddd25ade0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe399e0c640 1 --2- 10.20.193.28:0/827578053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24ef60 0x559ddd25ade0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe399e0c640 1 -- 10.20.193.28:0/827578053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ddd1623d0 con 0x559ddd253fb0 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe399e0c640 1 --2- 10.20.193.28:0/827578053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd254390 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe390009e30 tx=0x7fe3900074c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cdc4908d1420b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe361ce5640 1 -- 10.20.193.28:0/827578053 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390004d40 con 0x559ddd253fb0 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe361ce5640 1 -- 10.20.193.28:0/827578053 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe390033030 con 0x559ddd253fb0 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe361ce5640 1 -- 10.20.193.28:0/827578053 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390002cc0 con 0x559ddd253fb0 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 -- 10.20.193.28:0/827578053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 msgr2=0x559ddd254390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/827578053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd254390 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe390009e30 tx=0x7fe3900074c0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe3827fc640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3700b0e20 0x7fe3700b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe3827fc640 1 -- 10.20.193.28:0/32999740 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe3880e04b0 con 0x7fe394105320 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39960b640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3700b0e20 0x7fe3700b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 -- 10.20.193.28:0/827578053 shutdown_connections 2026-02-20T03:31:51.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/827578053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24ef60 0x559ddd25ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/827578053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24e5e0 0x559ddd24ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/827578053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd254390 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 -- 10.20.193.28:0/827578053 >> 10.20.193.28:0/827578053 conn(0x559ddd211240 msgr2=0x559ddd24cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:51.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 -- 10.20.193.28:0/827578053 shutdown_connections 2026-02-20T03:31:51.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39dd9be00 1 -- 10.20.193.28:0/827578053 wait complete. 2026-02-20T03:31:51.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.687+0000 7fe39960b640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3700b0e20 0x7fe3700b32e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe384009790 tx=0x7fe384006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:51.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe39dd9be00 1 -- start start 2026-02-20T03:31:51.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe39dd9be00 1 Processor -- start 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24e5e0 0x559ddd27a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd24ef60 0x559ddd27a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd253fb0 0x559ddd2787f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559ddd19d8a0 con 0x559ddd24ef60 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559ddcf8ff50 con 0x559ddd253fb0 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559ddd278d80 con 0x559ddd24e5e0 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe398e0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd24ef60 0x559ddd27a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe398e0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd24ef60 0x559ddd27a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43264/0 (socket says 10.20.193.28:43264) 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe398e0a640 1 -- 10.20.193.28:0/1289728591 learned_addr learned my addr 10.20.193.28:0/1289728591 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe398e0a640 1 -- 10.20.193.28:0/1289728591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24e5e0 msgr2=0x559ddd27a0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe398e0a640 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24e5e0 0x559ddd27a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe398e0a640 1 -- 10.20.193.28:0/1289728591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd253fb0 msgr2=0x559ddd2787f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:51.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe398e0a640 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd253fb0 0x559ddd2787f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe398e0a640 1 -- 10.20.193.28:0/1289728591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ddd271eb0 con 0x559ddd24ef60 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe398e0a640 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd24ef60 0x559ddd27a5f0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fe3880a7ef0 tx=0x7fe38801e2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6c2720b94c5418 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe34effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe34effd640 1 -- 10.20.193.28:0/1289728591 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3880ac5a0 con 0x559ddd24ef60 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe34effd640 1 -- 10.20.193.28:0/1289728591 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe3880b1450 con 0x559ddd24ef60 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe34effd640 1 -- 10.20.193.28:0/1289728591 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3880a6c70 con 0x559ddd24ef60 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.691+0000 7fe39dd9be00 1 -- 10.20.193.28:0/1289728591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ddcf72b40 con 0x559ddd24ef60 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe34effd640 1 -- 10.20.193.28:0/1289728591 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe3880a6e10 con 0x559ddd24ef60 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe34effd640 10 client.20262 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 10 client.20262 _ll_register_callbacks cb 0x559ddd1daeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 1 -- 10.20.193.28:0/1289728591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ddd1af150 con 0x559ddd24ef60 2026-02-20T03:31:51.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe34effd640 1 -- 10.20.193.28:0/1289728591 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe3880a7010 con 0x559ddd24ef60 2026-02-20T03:31:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 10 client.20262 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 1 -- 10.20.193.28:0/1289728591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x559ddd15c1e0 con 0x559ddd24ef60 2026-02-20T03:31:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe34effd640 1 -- 10.20.193.28:0/1289728591 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7fe3880e0180 con 0x559ddd24ef60 2026-02-20T03:31:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 10 client.20262 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 10 client.20262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 20 client.20262 populate_metadata read hostname 'trial028' 2026-02-20T03:31:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ddd2887a0 0x559ddd28ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 4 client.20262 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:51.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.693+0000 7fe39dd9be00 1 -- 10.20.193.28:0/1289728591 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ddd1a9560 con 0x559ddd2887a0 2026-02-20T03:31:51.708 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 15.09 MB/sec execute 82 sec latency 62188.402 ms 2026-02-20T03:31:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:51 trial177 ceph-mon[43181]: pgmap v700: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2026-02-20T03:31:51.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.720+0000 7fe39960b640 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ddd2887a0 0x559ddd28ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:51.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.787+0000 7fe39960b640 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ddd2887a0 0x559ddd28ac60 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f5a5bd02d1c58b6 server_cookie=756cdb01258a91fb in_seq=0 out_seq=0 2026-02-20T03:31:51.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.787+0000 7fe34effd640 10 client.20262 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:51.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe34effd640 1 -- 10.20.193.28:0/1289728591 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559ddd1a9560 con 0x559ddd2887a0 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe34effd640 10 client.20262 handle_command_reply: tid=0 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 client.20262 shutdown 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 -- 10.20.193.28:0/1289728591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd24ef60 msgr2=0x559ddd27a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd24ef60 0x559ddd27a5f0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fe3880a7ef0 tx=0x7fe38801e2b0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 -- 10.20.193.28:0/1289728591 shutdown_connections 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ddd2887a0 0x559ddd28ac60 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd253fb0 0x559ddd2787f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd24ef60 0x559ddd27a5f0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/1289728591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24e5e0 0x559ddd27a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 -- 10.20.193.28:0/1289728591 >> 10.20.193.28:0/1289728591 conn(0x559ddd211240 msgr2=0x559ddd24d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe34effd640 0 client.20262 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 -- 10.20.193.28:0/1289728591 shutdown_connections 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 1 -- 10.20.193.28:0/1289728591 wait complete. 2026-02-20T03:31:51.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.814+0000 7fe39dd9be00 20 client.20262 trim_cache size 0 max 16384 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 Processor -- start 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- start start 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24e5e0 0x559ddd250120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24ef60 0x559ddd250660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd24d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe340012650 con 0x559ddd253fb0 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe34000ff20 con 0x559ddd24e5e0 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe34000dd70 con 0x559ddd24ef60 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd24d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd24d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43272/0 (socket says 10.20.193.28:43272) 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 -- 10.20.193.28:0/2175549766 learned_addr learned my addr 10.20.193.28:0/2175549766 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 -- 10.20.193.28:0/2175549766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24ef60 msgr2=0x559ddd250660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- 10.20.193.28:0/2175549766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24ef60 0x559ddd250660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 -- 10.20.193.28:0/2175549766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24e5e0 msgr2=0x559ddd250120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- 10.20.193.28:0/2175549766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24e5e0 0x559ddd250120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 -- 10.20.193.28:0/2175549766 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ddd271ce0 con 0x559ddd253fb0 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- 10.20.193.28:0/2175549766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd24d4d0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe390002790 tx=0x7fe390007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947193a0876231b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe3614e4640 1 -- 10.20.193.28:0/2175549766 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390049070 con 0x559ddd253fb0 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe3614e4640 1 -- 10.20.193.28:0/2175549766 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe390004e40 con 0x559ddd253fb0 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe3614e4640 1 -- 10.20.193.28:0/2175549766 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390002cc0 con 0x559ddd253fb0 2026-02-20T03:31:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- 10.20.193.28:0/2175549766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 msgr2=0x559ddd24d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/2175549766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd24d4d0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe390002790 tx=0x7fe390007760 comp rx=0 tx=0).stop 2026-02-20T03:31:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- 10.20.193.28:0/2175549766 shutdown_connections 2026-02-20T03:31:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/2175549766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd24d4d0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/2175549766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24ef60 0x559ddd250660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/2175549766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24e5e0 0x559ddd250120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- 10.20.193.28:0/2175549766 >> 10.20.193.28:0/2175549766 conn(0x559ddd211240 msgr2=0x559ddd24fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- 10.20.193.28:0/2175549766 shutdown_connections 2026-02-20T03:31:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- 10.20.193.28:0/2175549766 wait complete. 2026-02-20T03:31:51.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- start start 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 Processor -- start 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24e5e0 0x559ddd281cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24ef60 0x559ddd2821f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd2fc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe34000e3e0 con 0x559ddd253fb0 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe34000f850 con 0x559ddd24e5e0 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe34000eab0 con 0x559ddd24ef60 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd2fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd2fc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43284/0 (socket says 10.20.193.28:43284) 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 -- 10.20.193.28:0/3340795890 learned_addr learned my addr 10.20.193.28:0/3340795890 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:51.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 -- 10.20.193.28:0/3340795890 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24ef60 msgr2=0x559ddd2821f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24ef60 0x559ddd2821f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 -- 10.20.193.28:0/3340795890 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24e5e0 msgr2=0x559ddd281cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24e5e0 0x559ddd281cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 -- 10.20.193.28:0/3340795890 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ddce80870 con 0x559ddd253fb0 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe399e0c640 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd2fc160 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe3900077f0 tx=0x7fe3900048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80db198fdd6c21b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe34effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe34effd640 1 -- 10.20.193.28:0/3340795890 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390049030 con 0x559ddd253fb0 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe34effd640 1 -- 10.20.193.28:0/3340795890 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe3900096a0 con 0x559ddd253fb0 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe34effd640 1 -- 10.20.193.28:0/3340795890 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390007df0 con 0x559ddd253fb0 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.819+0000 7fe39dd9be00 1 -- 10.20.193.28:0/3340795890 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ddd1413f0 con 0x559ddd253fb0 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe34effd640 1 -- 10.20.193.28:0/3340795890 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fe39004e460 con 0x559ddd253fb0 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 10 client.20268 _ll_register_callbacks cb 0x7fe38800f4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:51.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 1 -- 10.20.193.28:0/3340795890 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559ddd1727c0 con 0x559ddd253fb0 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe34effd640 1 -- 10.20.193.28:0/3340795890 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe3900040d0 con 0x559ddd253fb0 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 10 client.20268 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 1 -- 10.20.193.28:0/3340795890 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x559ddd2729d0 con 0x559ddd253fb0 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe34effd640 1 -- 10.20.193.28:0/3340795890 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7fe39003f020 con 0x559ddd253fb0 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 10 client.20268 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 10 client.20268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 20 client.20268 populate_metadata read hostname 'trial028' 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ddd2fd510 0x559ddd2ff900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 4 client.20268 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:31:51.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.824+0000 7fe39dd9be00 1 -- 10.20.193.28:0/3340795890 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559ddd123a30 con 0x559ddd2fd510 2026-02-20T03:31:51.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.840+0000 7fe39960b640 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ddd2fd510 0x559ddd2ff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:51.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.907+0000 7fe39960b640 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ddd2fd510 0x559ddd2ff900 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b16200c66cbc9005 server_cookie=64a6a46a5e4f7420 in_seq=0 out_seq=0 2026-02-20T03:31:51.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.907+0000 7fe34effd640 10 client.20268 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:51.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe34effd640 1 -- 10.20.193.28:0/3340795890 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559ddd123a30 con 0x559ddd2fd510 2026-02-20T03:31:51.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe34effd640 10 client.20268 handle_command_reply: tid=0 2026-02-20T03:31:51.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 client.20268 shutdown 2026-02-20T03:31:51.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 -- 10.20.193.28:0/3340795890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 msgr2=0x559ddd2fc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:51.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd2fc160 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe3900077f0 tx=0x7fe3900048b0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 -- 10.20.193.28:0/3340795890 shutdown_connections 2026-02-20T03:31:51.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559ddd2fd510 0x559ddd2ff900 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559ddd253fb0 0x559ddd2fc160 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559ddd24ef60 0x559ddd2821f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 --2- 10.20.193.28:0/3340795890 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559ddd24e5e0 0x559ddd281cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 -- 10.20.193.28:0/3340795890 >> 10.20.193.28:0/3340795890 conn(0x559ddd211240 msgr2=0x559ddd250230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:51.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe34effd640 0 client.20268 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:51.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 -- 10.20.193.28:0/3340795890 shutdown_connections 2026-02-20T03:31:51.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 1 -- 10.20.193.28:0/3340795890 wait complete. 2026-02-20T03:31:51.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39dd9be00 20 client.20268 trim_cache size 0 max 16384 2026-02-20T03:31:51.935 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:31:51.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 -- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3700b0e20 msgr2=0x7fe3700b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:51.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3700b0e20 0x7fe3700b32e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe384009790 tx=0x7fe384006cd0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 -- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 msgr2=0x7fe39419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 0x7fe39419d6a0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe38800b570 tx=0x7fe38800ba40 comp rx=0 tx=0).stop 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 -- 10.20.193.28:0/32999740 shutdown_connections 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3700b0e20 0x7fe3700b32e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe39410a980 0x7fe3941a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe394105320 0x7fe39419d6a0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 --2- 10.20.193.28:0/32999740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe394104980 0x7fe39419d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 -- 10.20.193.28:0/32999740 >> 10.20.193.28:0/32999740 conn(0x7fe394100680 msgr2=0x7fe394100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 -- 10.20.193.28:0/32999740 shutdown_connections 2026-02-20T03:31:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:51.920+0000 7fe39a60d640 1 -- 10.20.193.28:0/32999740 wait complete. 2026-02-20T03:31:52.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 14.91 MB/sec execute 83 sec latency 63188.443 ms 2026-02-20T03:31:53.122 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:31:53.122 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:31:53.430 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:53 trial028 ceph-mon[38552]: pgmap v701: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2026-02-20T03:31:53.443 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:53.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:53 trial126 ceph-mon[38476]: pgmap v701: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2026-02-20T03:31:53.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.674+0000 7f84ed4a5640 1 -- 10.20.193.28:0/1943726111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e81030a0 msgr2=0x7f84e810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:53.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.674+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/1943726111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e81030a0 0x7f84e810f5d0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00b0d0 tx=0x7f84dc02f490 comp rx=0 tx=0).stop 2026-02-20T03:31:53.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.674+0000 7f84ed4a5640 1 -- 10.20.193.28:0/1943726111 shutdown_connections 2026-02-20T03:31:53.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.674+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/1943726111 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e81030a0 0x7f84e810f5d0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.674+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/1943726111 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e8102700 0x7f84e8102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.674+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/1943726111 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e8108700 0x7f84e8108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.674+0000 7f84ed4a5640 1 -- 10.20.193.28:0/1943726111 >> 10.20.193.28:0/1943726111 conn(0x7f84e80fe440 msgr2=0x7f84e8100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:53.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.674+0000 7f84ed4a5640 1 -- 10.20.193.28:0/1943726111 shutdown_connections 2026-02-20T03:31:53.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.674+0000 7f84ed4a5640 1 -- 10.20.193.28:0/1943726111 wait complete. 2026-02-20T03:31:53.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 Processor -- start 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 -- start start 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e8102700 0x7f84e819d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e81030a0 0x7f84e819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e8108700 0x7f84e81a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8112a00 con 0x7f84e8108700 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8112880 con 0x7f84e81030a0 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8112b80 con 0x7f84e8102700 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ecca4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e8108700 0x7f84e81a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ecca4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e8108700 0x7f84e81a1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43296/0 (socket says 10.20.193.28:43296) 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ecca4640 1 -- 10.20.193.28:0/3108749951 learned_addr learned my addr 10.20.193.28:0/3108749951 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:53.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ecca4640 1 -- 10.20.193.28:0/3108749951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e8102700 msgr2=0x7f84e819d0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:53.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ecca4640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e8102700 0x7f84e819d0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ecca4640 1 -- 10.20.193.28:0/3108749951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e81030a0 msgr2=0x7f84e819d600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:53.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ecca4640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e81030a0 0x7f84e819d600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ecca4640 1 -- 10.20.193.28:0/3108749951 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e81a2110 con 0x7f84e8108700 2026-02-20T03:31:53.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ecca4640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e8108700 0x7f84e81a1990 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0077f0 tx=0x7f84dc009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:53.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84e57fa640 1 -- 10.20.193.28:0/3108749951 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc004590 con 0x7f84e8108700 2026-02-20T03:31:53.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84e57fa640 1 -- 10.20.193.28:0/3108749951 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84dc004730 con 0x7f84e8108700 2026-02-20T03:31:53.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 -- 10.20.193.28:0/3108749951 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e81a23a0 con 0x7f84e8108700 2026-02-20T03:31:53.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84e57fa640 1 -- 10.20.193.28:0/3108749951 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc038680 con 0x7f84e8108700 2026-02-20T03:31:53.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84ed4a5640 1 -- 10.20.193.28:0/3108749951 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e81a9c40 con 0x7f84e8108700 2026-02-20T03:31:53.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84e57fa640 1 -- 10.20.193.28:0/3108749951 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f84dc0078c0 con 0x7f84e8108700 2026-02-20T03:31:53.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84f0c33e00 1 Processor -- start 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84f0c33e00 1 -- start start 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c780c0 0x557eb1c784a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c78a70 0x557eb1c7c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 0x557eb1c7cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557eb1bcac00 con 0x557eb1c780c0 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557eb1b783c0 con 0x557eb1c7cb60 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557eb1bc6b30 con 0x557eb1c78a70 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c780c0 0x557eb1c784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c780c0 0x557eb1c784a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43298/0 (socket says 10.20.193.28:43298) 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.675+0000 7f84e77fe640 1 -- 10.20.193.28:0/3406695936 learned_addr learned my addr 10.20.193.28:0/3406695936 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e77fe640 1 -- 10.20.193.28:0/3406695936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c78a70 msgr2=0x557eb1c7c540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:53.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e77fe640 1 --2- 10.20.193.28:0/3406695936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c78a70 0x557eb1c7c540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e77fe640 1 -- 10.20.193.28:0/3406695936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 msgr2=0x557eb1c7cfd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e77fe640 1 --2- 10.20.193.28:0/3406695936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 0x557eb1c7cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e77fe640 1 -- 10.20.193.28:0/3406695936 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb1b71840 con 0x557eb1c780c0 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e77fe640 1 --2- 10.20.193.28:0/3406695936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c780c0 0x557eb1c784a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f84d80098a0 tx=0x7f84d8009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dc8e6e04a732b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e57fa640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84bc0b0da0 0x7f84bc0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84b8ce3640 1 -- 10.20.193.28:0/3406695936 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8016070 con 0x557eb1c780c0 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e57fa640 1 -- 10.20.193.28:0/3108749951 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f84dc105980 con 0x7f84e8108700 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84b8ce3640 1 -- 10.20.193.28:0/3406695936 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84d800b8d0 con 0x557eb1c780c0 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84b8ce3640 1 -- 10.20.193.28:0/3406695936 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8016070 con 0x557eb1c780c0 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e7fff640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84bc0b0da0 0x7f84bc0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- 10.20.193.28:0/3406695936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c780c0 msgr2=0x557eb1c784a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/3406695936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c780c0 0x557eb1c784a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f84d80098a0 tx=0x7f84d8009d70 comp rx=0 tx=0).stop 2026-02-20T03:31:53.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- 10.20.193.28:0/3406695936 shutdown_connections 2026-02-20T03:31:53.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/3406695936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 0x557eb1c7cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/3406695936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c78a70 0x557eb1c7c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/3406695936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c780c0 0x557eb1c784a0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- 10.20.193.28:0/3406695936 >> 10.20.193.28:0/3406695936 conn(0x557eb1c70b60 msgr2=0x557eb1c765e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:53.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- 10.20.193.28:0/3406695936 shutdown_connections 2026-02-20T03:31:53.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- 10.20.193.28:0/3406695936 wait complete. 2026-02-20T03:31:53.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84e7fff640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84bc0b0da0 0x7f84bc0b3260 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x557eb1c79090 tx=0x7f84d4006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:53.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- start start 2026-02-20T03:31:53.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 Processor -- start 2026-02-20T03:31:53.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c780c0 0x557eb1c9ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c78a70 0x557eb1c9b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c7cb60 0x557eb1c99340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557eb1b721a0 con 0x557eb1c7cb60 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557eb1c8d7d0 con 0x557eb1c780c0 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557eb1c99980 con 0x557eb1c78a70 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84ecca4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c7cb60 0x557eb1c99340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84ecca4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c7cb60 0x557eb1c99340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43304/0 (socket says 10.20.193.28:43304) 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84ecca4640 1 -- 10.20.193.28:0/2308489801 learned_addr learned my addr 10.20.193.28:0/2308489801 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84ecca4640 1 -- 10.20.193.28:0/2308489801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c78a70 msgr2=0x557eb1c9b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84ecca4640 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c78a70 0x557eb1c9b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84ecca4640 1 -- 10.20.193.28:0/2308489801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c780c0 msgr2=0x557eb1c9ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:53.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84ecca4640 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c780c0 0x557eb1c9ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84ecca4640 1 -- 10.20.193.28:0/2308489801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb1c93050 con 0x557eb1c7cb60 2026-02-20T03:31:53.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84ecca4640 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c7cb60 0x557eb1c99340 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0cd360 tx=0x7f84dc0c9340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7554c4694b048398 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84a9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84a9ffb640 1 -- 10.20.193.28:0/2308489801 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0ccb80 con 0x557eb1c7cb60 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- 10.20.193.28:0/2308489801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb1999b60 con 0x557eb1c7cb60 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 10 client.20280 _ll_register_callbacks cb 0x557eb1b760d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- 10.20.193.28:0/2308489801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557eb1bd27f0 con 0x557eb1c7cb60 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84a9ffb640 1 -- 10.20.193.28:0/2308489801 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84dc033030 con 0x557eb1c7cb60 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84a9ffb640 1 -- 10.20.193.28:0/2308489801 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc049e50 con 0x557eb1c7cb60 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84a9ffb640 1 -- 10.20.193.28:0/2308489801 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f84dc0cc670 con 0x557eb1c7cb60 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84a9ffb640 1 -- 10.20.193.28:0/2308489801 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f84dc0e7050 con 0x557eb1c7cb60 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 10 client.20280 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:53.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.681+0000 7f84f0c33e00 1 -- 10.20.193.28:0/2308489801 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x557eb1b97430 con 0x557eb1c7cb60 2026-02-20T03:31:53.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.686+0000 7f84a9ffb640 1 -- 10.20.193.28:0/2308489801 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f84dc0c8d80 con 0x557eb1c7cb60 2026-02-20T03:31:53.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.686+0000 7f84f0c33e00 10 client.20280 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:53.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.686+0000 7f84f0c33e00 10 client.20280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:53.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.686+0000 7f84f0c33e00 20 client.20280 populate_metadata read hostname 'trial028' 2026-02-20T03:31:53.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.686+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557eb1ca9310 0x557eb1cab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.686+0000 7f84f0c33e00 4 client.20280 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:53.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.686+0000 7f84f0c33e00 1 -- 10.20.193.28:0/2308489801 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557eb1b4cc00 con 0x557eb1ca9310 2026-02-20T03:31:53.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 14.73 MB/sec execute 84 sec latency 64188.484 ms 2026-02-20T03:31:53.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.708+0000 7f84e7fff640 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557eb1ca9310 0x557eb1cab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:53 trial177 ceph-mon[43181]: pgmap v701: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 9 op/s 2026-02-20T03:31:53.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.775+0000 7f84e7fff640 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557eb1ca9310 0x557eb1cab7d0 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b318ee33871bfa49 server_cookie=d572f73787c2139 in_seq=0 out_seq=0 2026-02-20T03:31:53.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.775+0000 7f84a9ffb640 10 client.20280 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:53.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84a9ffb640 1 -- 10.20.193.28:0/2308489801 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557eb1b4cc00 con 0x557eb1ca9310 2026-02-20T03:31:53.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84a9ffb640 10 client.20280 handle_command_reply: tid=0 2026-02-20T03:31:53.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 client.20280 shutdown 2026-02-20T03:31:53.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 -- 10.20.193.28:0/2308489801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c7cb60 msgr2=0x557eb1c99340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:53.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c7cb60 0x557eb1c99340 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0cd360 tx=0x7f84dc0c9340 comp rx=0 tx=0).stop 2026-02-20T03:31:53.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 -- 10.20.193.28:0/2308489801 shutdown_connections 2026-02-20T03:31:53.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557eb1ca9310 0x557eb1cab7d0 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c7cb60 0x557eb1c99340 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c78a70 0x557eb1c9b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/2308489801 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c780c0 0x557eb1c9ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 -- 10.20.193.28:0/2308489801 >> 10.20.193.28:0/2308489801 conn(0x557eb1c70b60 msgr2=0x557eb1c7b520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:53.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84a9ffb640 0 client.20280 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:53.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 -- 10.20.193.28:0/2308489801 shutdown_connections 2026-02-20T03:31:53.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 1 -- 10.20.193.28:0/2308489801 wait complete. 2026-02-20T03:31:53.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.802+0000 7f84f0c33e00 20 client.20280 trim_cache size 0 max 16384 2026-02-20T03:31:53.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84f0c33e00 1 Processor -- start 2026-02-20T03:31:53.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84f0c33e00 1 -- start start 2026-02-20T03:31:53.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c780c0 0x557eb1c70600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1cb10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 0x557eb1cb1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f848c012710 con 0x557eb1c78a70 2026-02-20T03:31:53.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f848c00ffe0 con 0x557eb1c7cb60 2026-02-20T03:31:53.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f848c00de30 con 0x557eb1c780c0 2026-02-20T03:31:53.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1cb10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:53.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1cb10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43320/0 (socket says 10.20.193.28:43320) 2026-02-20T03:31:53.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84e77fe640 1 -- 10.20.193.28:0/1195922044 learned_addr learned my addr 10.20.193.28:0/1195922044 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:53.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84e77fe640 1 -- 10.20.193.28:0/1195922044 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c780c0 msgr2=0x557eb1c70600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84e77fe640 1 --2- 10.20.193.28:0/1195922044 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c780c0 0x557eb1c70600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84e77fe640 1 -- 10.20.193.28:0/1195922044 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 msgr2=0x557eb1cb1620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84e77fe640 1 --2- 10.20.193.28:0/1195922044 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 0x557eb1cb1620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84e77fe640 1 -- 10.20.193.28:0/1195922044 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb1c92e80 con 0x557eb1c78a70 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84e77fe640 1 --2- 10.20.193.28:0/1195922044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1cb10e0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f84d8004770 tx=0x7f84d80090b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486f25e750877aab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84abfff640 1 -- 10.20.193.28:0/1195922044 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8021070 con 0x557eb1c78a70 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84abfff640 1 -- 10.20.193.28:0/1195922044 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84d8006d60 con 0x557eb1c78a70 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.808+0000 7f84abfff640 1 -- 10.20.193.28:0/1195922044 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8016070 con 0x557eb1c78a70 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- 10.20.193.28:0/1195922044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 msgr2=0x557eb1cb10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:53.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/1195922044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1cb10e0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f84d8004770 tx=0x7f84d80090b0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- 10.20.193.28:0/1195922044 shutdown_connections 2026-02-20T03:31:53.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/1195922044 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 0x557eb1cb1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/1195922044 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1cb10e0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/1195922044 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c780c0 0x557eb1c70600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- 10.20.193.28:0/1195922044 >> 10.20.193.28:0/1195922044 conn(0x557eb1c70b60 msgr2=0x557eb1c98420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:53.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- 10.20.193.28:0/1195922044 shutdown_connections 2026-02-20T03:31:53.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- 10.20.193.28:0/1195922044 wait complete. 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- start start 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 Processor -- start 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c780c0 0x557eb1ca1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1c9e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 0x557eb1c9ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f848c00e4a0 con 0x557eb1c78a70 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f848c00f910 con 0x557eb1c7cb60 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f848c00eb70 con 0x557eb1c780c0 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1c9e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1c9e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43324/0 (socket says 10.20.193.28:43324) 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84e77fe640 1 -- 10.20.193.28:0/139810128 learned_addr learned my addr 10.20.193.28:0/139810128 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:53.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84e77fe640 1 -- 10.20.193.28:0/139810128 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c780c0 msgr2=0x557eb1ca1270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84e77fe640 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c780c0 0x557eb1ca1270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84e77fe640 1 -- 10.20.193.28:0/139810128 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 msgr2=0x557eb1c9ea90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84e77fe640 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 0x557eb1c9ea90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84e77fe640 1 -- 10.20.193.28:0/139810128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb18a9900 con 0x557eb1c78a70 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84e77fe640 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1c9e550 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f84d8002410 tx=0x7f84d800bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c70395645c845bd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84a9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84a9ffb640 1 -- 10.20.193.28:0/139810128 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8021070 con 0x557eb1c78a70 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84a9ffb640 1 -- 10.20.193.28:0/139810128 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f84d801c440 con 0x557eb1c78a70 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- 10.20.193.28:0/139810128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb1b854d0 con 0x557eb1c78a70 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 10 client.20286 _ll_register_callbacks cb 0x7f84dc0c8bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- 10.20.193.28:0/139810128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557eb193aa20 con 0x557eb1c78a70 2026-02-20T03:31:53.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84a9ffb640 1 -- 10.20.193.28:0/139810128 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8016040 con 0x557eb1c78a70 2026-02-20T03:31:53.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84a9ffb640 1 -- 10.20.193.28:0/139810128 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f84d801a750 con 0x557eb1c78a70 2026-02-20T03:31:53.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84a9ffb640 1 -- 10.20.193.28:0/139810128 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f84d801aa70 con 0x557eb1c78a70 2026-02-20T03:31:53.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 10 client.20286 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:53.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.813+0000 7f84f0c33e00 1 -- 10.20.193.28:0/139810128 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x557eb1c93b70 con 0x557eb1c78a70 2026-02-20T03:31:53.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.815+0000 7f84a9ffb640 1 -- 10.20.193.28:0/139810128 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f84d8019070 con 0x557eb1c78a70 2026-02-20T03:31:53.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.815+0000 7f84f0c33e00 10 client.20286 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:53.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.815+0000 7f84f0c33e00 10 client.20286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:53.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.815+0000 7f84f0c33e00 20 client.20286 populate_metadata read hostname 'trial028' 2026-02-20T03:31:53.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.815+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557eb1d16060 0x557eb1d184f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:53.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.815+0000 7f84f0c33e00 4 client.20286 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:31:53.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.815+0000 7f84f0c33e00 1 -- 10.20.193.28:0/139810128 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557eb1bd85a0 con 0x557eb1d16060 2026-02-20T03:31:53.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.842+0000 7f84e7fff640 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557eb1d16060 0x557eb1d184f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:53.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.896+0000 7f84e7fff640 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557eb1d16060 0x557eb1d184f0 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f12f692c7a89f5e5 server_cookie=85818499de4d355b in_seq=0 out_seq=0 2026-02-20T03:31:53.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.896+0000 7f84a9ffb640 10 client.20286 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:53.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.909+0000 7f84a9ffb640 1 -- 10.20.193.28:0/139810128 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557eb1bd85a0 con 0x557eb1d16060 2026-02-20T03:31:53.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.909+0000 7f84a9ffb640 10 client.20286 handle_command_reply: tid=0 2026-02-20T03:31:53.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.909+0000 7f84f0c33e00 1 client.20286 shutdown 2026-02-20T03:31:53.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 -- 10.20.193.28:0/139810128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 msgr2=0x557eb1c9e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:53.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1c9e550 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f84d8002410 tx=0x7f84d800bfb0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 -- 10.20.193.28:0/139810128 shutdown_connections 2026-02-20T03:31:53.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x557eb1d16060 0x557eb1d184f0 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557eb1c7cb60 0x557eb1c9ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557eb1c78a70 0x557eb1c9e550 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 --2- 10.20.193.28:0/139810128 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557eb1c780c0 0x557eb1ca1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 -- 10.20.193.28:0/139810128 >> 10.20.193.28:0/139810128 conn(0x557eb1c70b60 msgr2=0x557eb1c7d510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:53.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84a9ffb640 0 client.20286 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:53.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 -- 10.20.193.28:0/139810128 shutdown_connections 2026-02-20T03:31:53.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 1 -- 10.20.193.28:0/139810128 wait complete. 2026-02-20T03:31:53.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84f0c33e00 20 client.20286 trim_cache size 0 max 16384 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "d1c733e2-bbab-42ab-88cc-05199a3c580b", 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84ed4a5640 1 -- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84bc0b0da0 msgr2=0x7f84bc0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84bc0b0da0 0x7f84bc0b3260 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x557eb1c79090 tx=0x7f84d4006cd0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84ed4a5640 1 -- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e8108700 msgr2=0x7f84e81a1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e8108700 0x7f84e81a1990 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0077f0 tx=0x7f84dc009380 comp rx=0 tx=0).stop 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.910+0000 7f84ed4a5640 1 -- 10.20.193.28:0/3108749951 shutdown_connections 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.911+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f84bc0b0da0 0x7f84bc0b3260 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.911+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f84e8108700 0x7f84e81a1990 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.911+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f84e81030a0 0x7f84e819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.911+0000 7f84ed4a5640 1 --2- 10.20.193.28:0/3108749951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f84e8102700 0x7f84e819d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.911+0000 7f84ed4a5640 1 -- 10.20.193.28:0/3108749951 >> 10.20.193.28:0/3108749951 conn(0x7f84e80fe440 msgr2=0x7f84e810ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.911+0000 7f84ed4a5640 1 -- 10.20.193.28:0/3108749951 shutdown_connections 2026-02-20T03:31:53.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:53.911+0000 7f84ed4a5640 1 -- 10.20.193.28:0/3108749951 wait complete. 2026-02-20T03:31:54.096 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:31:54.340 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:31:53 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:31:53.977+0000 7ff740af4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000029 [...2,head] /volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX/ auth{1=1,2=1} v184595 ap=2 f(v7968 m2026-02-20T03:30:43.672642+0000 24=24+0) n(v73 rc2026-02-20T03:30:43.672642+0000 b5230239 25=24+1) (inest sync->mix g=1,2) caps={25141=pAsLsXsFs/pAsLsXsFsx@22315} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557551c2bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000029:[<0x100000005e6/PARADOX v2552>,<0x100000005e5/~dmtmp v34>,<0x100000005e4/client0 v18>,<0x100000005e3/clients v8>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v28>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v37>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000029:[<0x100000005e6/PARADOX v184595>,<0x100000005e5/~dmtmp v61426>,<0x100000005e4/client0 v2571>,<0x100000005e3/clients v1435>,<0x100000005e2/tmp v1321>,<0x100000001fb/client.0 v1327>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v1338>,<0x10000000001/sv_1 v1339>,<0x10000000000/qa v1320>,<0x1/volumes v1244>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2026-02-20T03:30:43.639643+0000 25=25+0)","ondisk_value.rstat":"n(v0 rc2026-02-20T03:30:43.672642+0000 b5230239 25=24+1)","memory_value.dirstat":"f(v7968 m2026-02-20T03:30:43.672642+0000 24=24+0)","memory_value.rstat":"n(v73 rc2026-02-20T03:30:43.672642+0000 b5230239 25=24+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2026-02-20T03:31:54.421 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:31:54.514 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:54 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:31:54.514 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:54 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:54.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:54 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:31:54.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:54 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:54.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 -- 10.20.193.28:0/3544128848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 msgr2=0x7f42cc101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:54.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 --2- 10.20.193.28:0/3544128848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 0x7f42cc101130 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009a30 tx=0x7f42c002f220 comp rx=0 tx=0).stop 2026-02-20T03:31:54.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 -- 10.20.193.28:0/3544128848 shutdown_connections 2026-02-20T03:31:54.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 --2- 10.20.193.28:0/3544128848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42cc1069e0 0x7f42cc107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 --2- 10.20.193.28:0/3544128848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f42cc101700 0x7f42cc1062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 --2- 10.20.193.28:0/3544128848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 0x7f42cc101130 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 -- 10.20.193.28:0/3544128848 >> 10.20.193.28:0/3544128848 conn(0x7f42cc0fca60 msgr2=0x7f42cc0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:54.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 -- 10.20.193.28:0/3544128848 shutdown_connections 2026-02-20T03:31:54.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 -- 10.20.193.28:0/3544128848 wait complete. 2026-02-20T03:31:54.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.664+0000 7f42cb577640 1 Processor -- start 2026-02-20T03:31:54.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42cb577640 1 -- start start 2026-02-20T03:31:54.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42cb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 0x7f42cc1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42cb577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42cc101700 0x7f42cc1a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42cb577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f42cc1069e0 0x7f42cc1a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42cb577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc119180 con 0x7f42cc100d50 2026-02-20T03:31:54.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42cb577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc119000 con 0x7f42cc101700 2026-02-20T03:31:54.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42cb577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc119300 con 0x7f42cc1069e0 2026-02-20T03:31:54.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42ca575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 0x7f42cc1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:54.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42ca575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 0x7f42cc1a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43342/0 (socket says 10.20.193.28:43342) 2026-02-20T03:31:54.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42ca575640 1 -- 10.20.193.28:0/1775831501 learned_addr learned my addr 10.20.193.28:0/1775831501 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:54.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42ca575640 1 -- 10.20.193.28:0/1775831501 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f42cc1069e0 msgr2=0x7f42cc1a5ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:54.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42ca575640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f42cc1069e0 0x7f42cc1a5ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42ca575640 1 -- 10.20.193.28:0/1775831501 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42cc101700 msgr2=0x7f42cc1a1c60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42ca575640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42cc101700 0x7f42cc1a1c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42ca575640 1 -- 10.20.193.28:0/1775831501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc1a6770 con 0x7f42cc100d50 2026-02-20T03:31:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42ca575640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 0x7f42cc1a1720 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f42c002f730 tx=0x7f42c0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:54.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42b37fe640 1 -- 10.20.193.28:0/1775831501 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0004a90 con 0x7f42cc100d50 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42b37fe640 1 -- 10.20.193.28:0/1775831501 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f42c0004c30 con 0x7f42cc100d50 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42cb577640 1 -- 10.20.193.28:0/1775831501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc1a6a00 con 0x7f42cc100d50 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42b37fe640 1 -- 10.20.193.28:0/1775831501 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00056b0 con 0x7f42cc100d50 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42cb577640 1 -- 10.20.193.28:0/1775831501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc1ae2a0 con 0x7f42cc100d50 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42b37fe640 1 -- 10.20.193.28:0/1775831501 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f42c0038770 con 0x7f42cc100d50 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 Processor -- start 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 -- start start 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559deebb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 0x5559deeb5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deec1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5559dee35e50 con 0x5559deeb5fb0 2026-02-20T03:31:54.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5559dee089c0 con 0x5559deebb000 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5559dedb6240 con 0x5559deeb5630 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42c9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deec1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42c9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deec1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43358/0 (socket says 10.20.193.28:43358) 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42c9d74640 1 -- 10.20.193.28:0/2241960091 learned_addr learned my addr 10.20.193.28:0/2241960091 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42c9d74640 1 -- 10.20.193.28:0/2241960091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 msgr2=0x5559deeb5a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42c9d74640 1 --2- 10.20.193.28:0/2241960091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 0x5559deeb5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42c9d74640 1 -- 10.20.193.28:0/2241960091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 msgr2=0x5559deebb3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42c9d74640 1 --2- 10.20.193.28:0/2241960091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559deebb3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42c9d74640 1 -- 10.20.193.28:0/2241960091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559dedc9420 con 0x5559deeb5fb0 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42c9d74640 1 --2- 10.20.193.28:0/2241960091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deec1e30 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009870 tx=0x7f42b4009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f91c9dbba704fa1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42b0ff9640 1 -- 10.20.193.28:0/2241960091 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4016070 con 0x5559deeb5fb0 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42b0ff9640 1 -- 10.20.193.28:0/2241960091 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f42b4004480 con 0x5559deeb5fb0 2026-02-20T03:31:54.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42b0ff9640 1 -- 10.20.193.28:0/2241960091 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b400bdd0 con 0x5559deeb5fb0 2026-02-20T03:31:54.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 -- 10.20.193.28:0/2241960091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 msgr2=0x5559deec1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:54.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42d3333e00 1 --2- 10.20.193.28:0/2241960091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deec1e30 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009870 tx=0x7f42b4009d40 comp rx=0 tx=0).stop 2026-02-20T03:31:54.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.665+0000 7f42b37fe640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42a40b0e20 0x7f42a40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42b37fe640 1 -- 10.20.193.28:0/1775831501 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f42c0104c70 con 0x7f42cc100d50 2026-02-20T03:31:54.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 -- 10.20.193.28:0/2241960091 shutdown_connections 2026-02-20T03:31:54.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 --2- 10.20.193.28:0/2241960091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deec1e30 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 --2- 10.20.193.28:0/2241960091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 0x5559deeb5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 --2- 10.20.193.28:0/2241960091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559deebb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 -- 10.20.193.28:0/2241960091 >> 10.20.193.28:0/2241960091 conn(0x5559dee78290 msgr2=0x5559deeb3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 -- 10.20.193.28:0/2241960091 shutdown_connections 2026-02-20T03:31:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42cad76640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42a40b0e20 0x7f42a40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 -- 10.20.193.28:0/2241960091 wait complete. 2026-02-20T03:31:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42cad76640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42a40b0e20 0x7f42a40b32e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00aa90 tx=0x7f42bc009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 -- start start 2026-02-20T03:31:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 Processor -- start 2026-02-20T03:31:54.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5630 0x5559deece740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5fb0 0x5559deecec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559deed2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5559dee048f0 con 0x5559deeb5630 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5559debf6f50 con 0x5559deebb000 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42d3333e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5559deed34b0 con 0x5559deeb5fb0 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42ca575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5630 0x5559deece740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42ca575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5630 0x5559deece740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43370/0 (socket says 10.20.193.28:43370) 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.671+0000 7f42ca575640 1 -- 10.20.193.28:0/1281623546 learned_addr learned my addr 10.20.193.28:0/1281623546 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42ca575640 1 -- 10.20.193.28:0/1281623546 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5fb0 msgr2=0x5559deecec80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42ca575640 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5fb0 0x5559deecec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42ca575640 1 -- 10.20.193.28:0/1281623546 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 msgr2=0x5559deed2f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:54.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42ca575640 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559deed2f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42ca575640 1 -- 10.20.193.28:0/1281623546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559deec7bc0 con 0x5559deeb5630 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42ca575640 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5630 0x5559deece740 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f42c00c9970 tx=0x7f42c00cc050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c279f9b5220d254b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f427bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f427bfff640 1 -- 10.20.193.28:0/1281623546 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00d0d00 con 0x5559deeb5630 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f427bfff640 1 -- 10.20.193.28:0/1281623546 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f42c0033030 con 0x5559deeb5630 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f427bfff640 1 -- 10.20.193.28:0/1281623546 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00c82d0 con 0x5559deeb5630 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 1 -- 10.20.193.28:0/1281623546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559debd9b40 con 0x5559deeb5630 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 10 client.20298 _ll_register_callbacks cb 0x5559dee41f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 1 -- 10.20.193.28:0/1281623546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5559dee161a0 con 0x5559deeb5630 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f427bfff640 1 -- 10.20.193.28:0/1281623546 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f42c00cb960 con 0x5559deeb5630 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f427bfff640 1 -- 10.20.193.28:0/1281623546 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f42c00d5bb0 con 0x5559deeb5630 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 10 client.20298 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:54.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 1 -- 10.20.193.28:0/1281623546 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x5559dedc3230 con 0x5559deeb5630 2026-02-20T03:31:54.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f427bfff640 1 -- 10.20.193.28:0/1281623546 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f42c00cb5e0 con 0x5559deeb5630 2026-02-20T03:31:54.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 10 client.20298 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:54.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 10 client.20298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:54.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 20 client.20298 populate_metadata read hostname 'trial028' 2026-02-20T03:31:54.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5559deede6a0 0x5559deee0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 4 client.20298 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:54.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.673+0000 7f42d3333e00 1 -- 10.20.193.28:0/1281623546 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559dee105b0 con 0x5559deede6a0 2026-02-20T03:31:54.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.689+0000 7f42c9d74640 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5559deede6a0 0x5559deee0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:54.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 14.56 MB/sec execute 85 sec latency 65188.518 ms 2026-02-20T03:31:54.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:54 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:31:54.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:54 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:54.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.756+0000 7f42c9d74640 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5559deede6a0 0x5559deee0b60 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae665dd4cbbc22 server_cookie=fe9bff136cd762 in_seq=0 out_seq=0 2026-02-20T03:31:54.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.756+0000 7f427bfff640 10 client.20298 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:54.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.783+0000 7f427bfff640 1 -- 10.20.193.28:0/1281623546 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5559dee105b0 con 0x5559deede6a0 2026-02-20T03:31:54.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.783+0000 7f427bfff640 10 client.20298 handle_command_reply: tid=0 2026-02-20T03:31:54.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.783+0000 7f42d3333e00 1 client.20298 shutdown 2026-02-20T03:31:54.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.783+0000 7f42d3333e00 1 -- 10.20.193.28:0/1281623546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5630 msgr2=0x5559deece740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:54.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.783+0000 7f42d3333e00 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5630 0x5559deece740 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f42c00c9970 tx=0x7f42c00cc050 comp rx=0 tx=0).stop 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f42d3333e00 1 -- 10.20.193.28:0/1281623546 shutdown_connections 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f42d3333e00 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5559deede6a0 0x5559deee0b60 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f42d3333e00 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559deed2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f42d3333e00 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5fb0 0x5559deecec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f42d3333e00 1 --2- 10.20.193.28:0/1281623546 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5630 0x5559deece740 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f42d3333e00 1 -- 10.20.193.28:0/1281623546 >> 10.20.193.28:0/1281623546 conn(0x5559dee78290 msgr2=0x5559deeb4440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f427bfff640 0 client.20298 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f42d3333e00 1 -- 10.20.193.28:0/1281623546 shutdown_connections 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f42d3333e00 1 -- 10.20.193.28:0/1281623546 wait complete. 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.784+0000 7f42d3333e00 20 client.20298 trim_cache size 0 max 16384 2026-02-20T03:31:54.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 Processor -- start 2026-02-20T03:31:54.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 -- start start 2026-02-20T03:31:54.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 0x5559deee6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deee69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559deecba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f42700125b0 con 0x5559deeb5fb0 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f427000fe80 con 0x5559deebb000 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f427000dcd0 con 0x5559deeb5630 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42c9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deee69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42c9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deee69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43372/0 (socket says 10.20.193.28:43372) 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42c9d74640 1 -- 10.20.193.28:0/4073476580 learned_addr learned my addr 10.20.193.28:0/4073476580 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42c9d74640 1 -- 10.20.193.28:0/4073476580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 msgr2=0x5559deee6470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42c9d74640 1 --2- 10.20.193.28:0/4073476580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 0x5559deee6470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42c9d74640 1 -- 10.20.193.28:0/4073476580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 msgr2=0x5559deecba30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42c9d74640 1 --2- 10.20.193.28:0/4073476580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559deecba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42c9d74640 1 -- 10.20.193.28:0/4073476580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559deec79f0 con 0x5559deeb5fb0 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42c9d74640 1 --2- 10.20.193.28:0/4073476580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deee69b0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f42b4014040 tx=0x7f42b400b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf6be3cb8af54b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42964e6640 1 -- 10.20.193.28:0/4073476580 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4016040 con 0x5559deeb5fb0 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42964e6640 1 -- 10.20.193.28:0/4073476580 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f42b4017040 con 0x5559deeb5fb0 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42964e6640 1 -- 10.20.193.28:0/4073476580 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4002de0 con 0x5559deeb5fb0 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 -- 10.20.193.28:0/4073476580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 msgr2=0x5559deee69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 --2- 10.20.193.28:0/4073476580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deee69b0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f42b4014040 tx=0x7f42b400b970 comp rx=0 tx=0).stop 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 -- 10.20.193.28:0/4073476580 shutdown_connections 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 --2- 10.20.193.28:0/4073476580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559deecba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 --2- 10.20.193.28:0/4073476580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deee69b0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 --2- 10.20.193.28:0/4073476580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 0x5559deee6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 -- 10.20.193.28:0/4073476580 >> 10.20.193.28:0/4073476580 conn(0x5559dee78290 msgr2=0x5559deece740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:54.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 -- 10.20.193.28:0/4073476580 shutdown_connections 2026-02-20T03:31:54.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.790+0000 7f42d3333e00 1 -- 10.20.193.28:0/4073476580 wait complete. 2026-02-20T03:31:54.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 -- start start 2026-02-20T03:31:54.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 Processor -- start 2026-02-20T03:31:54.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 0x5559deed5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deed6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559def49650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f427000e340 con 0x5559deeb5fb0 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f427000f7b0 con 0x5559deebb000 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f427000ea10 con 0x5559deeb5630 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42c9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deed6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42c9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deed6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43382/0 (socket says 10.20.193.28:43382) 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42c9d74640 1 -- 10.20.193.28:0/801362513 learned_addr learned my addr 10.20.193.28:0/801362513 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42c9d74640 1 -- 10.20.193.28:0/801362513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 msgr2=0x5559deed5cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42c9d74640 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 0x5559deed5cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42c9d74640 1 -- 10.20.193.28:0/801362513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 msgr2=0x5559def49650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42c9d74640 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559def49650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42c9d74640 1 -- 10.20.193.28:0/801362513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559deae7870 con 0x5559deeb5fb0 2026-02-20T03:31:54.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42c9d74640 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deed6230 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009790 tx=0x7f42b40048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fa4ff473485104 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f427bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f427bfff640 1 -- 10.20.193.28:0/801362513 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4032070 con 0x5559deeb5fb0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f427bfff640 1 -- 10.20.193.28:0/801362513 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f42b400bbf0 con 0x5559deeb5fb0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f427bfff640 1 -- 10.20.193.28:0/801362513 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b401db30 con 0x5559deeb5fb0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 -- 10.20.193.28:0/801362513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559deda8440 con 0x5559deeb5fb0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f427bfff640 1 -- 10.20.193.28:0/801362513 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f42b401dcd0 con 0x5559deeb5fb0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 10 client.20304 _ll_register_callbacks cb 0x7f42c002f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 -- 10.20.193.28:0/801362513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42b4004480 con 0x5559deeb5fb0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f427bfff640 1 -- 10.20.193.28:0/801362513 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f42b401d430 con 0x5559deeb5fb0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 10 client.20304 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.795+0000 7f42d3333e00 1 -- 10.20.193.28:0/801362513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x5559deec86e0 con 0x5559deeb5fb0 2026-02-20T03:31:54.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.797+0000 7f427bfff640 1 -- 10.20.193.28:0/801362513 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f42b402c070 con 0x5559deeb5fb0 2026-02-20T03:31:54.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.797+0000 7f42d3333e00 10 client.20304 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:54.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.797+0000 7f42d3333e00 10 client.20304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:54.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.797+0000 7f42d3333e00 20 client.20304 populate_metadata read hostname 'trial028' 2026-02-20T03:31:54.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.797+0000 7f42d3333e00 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5559def4ab50 0x5559def4cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:54.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.797+0000 7f42d3333e00 4 client.20304 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:31:54.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.797+0000 7f42d3333e00 1 -- 10.20.193.28:0/801362513 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5559dedd9810 con 0x5559def4ab50 2026-02-20T03:31:54.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.824+0000 7f42ca575640 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5559def4ab50 0x5559def4cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:54.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.890+0000 7f42ca575640 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5559def4ab50 0x5559def4cfe0 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e41632f04a7f4578 server_cookie=3d3e0201eef45cb2 in_seq=0 out_seq=0 2026-02-20T03:31:54.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.890+0000 7f427bfff640 10 client.20304 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f427bfff640 1 -- 10.20.193.28:0/801362513 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5559dedd9810 con 0x5559def4ab50 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f427bfff640 10 client.20304 handle_command_reply: tid=0 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 client.20304 shutdown 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 -- 10.20.193.28:0/801362513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 msgr2=0x5559deed6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deed6230 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009790 tx=0x7f42b40048d0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 -- 10.20.193.28:0/801362513 shutdown_connections 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5559def4ab50 0x5559def4cfe0 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5559deebb000 0x5559def49650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5559deeb5fb0 0x5559deed6230 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 --2- 10.20.193.28:0/801362513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5559deeb5630 0x5559deed5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 -- 10.20.193.28:0/801362513 >> 10.20.193.28:0/801362513 conn(0x5559dee78290 msgr2=0x5559deeccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:54.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f427bfff640 0 client.20304 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:54.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 -- 10.20.193.28:0/801362513 shutdown_connections 2026-02-20T03:31:54.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 1 -- 10.20.193.28:0/801362513 wait complete. 2026-02-20T03:31:54.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42d3333e00 20 client.20304 trim_cache size 0 max 16384 2026-02-20T03:31:54.919 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:31:54.919 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:31:54.919 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:31:54.919 INFO:teuthology.orchestra.run.trial028.stdout: "d1c733e2-bbab-42ab-88cc-05199a3c580b": { 2026-02-20T03:31:54.919 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:31:54.919 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "d1c733e2-bbab-42ab-88cc-05199a3c580b", 2026-02-20T03:31:54.919 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:31:54.919 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:31:54.920 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:31:54.920 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:31:54.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 -- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42a40b0e20 msgr2=0x7f42a40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:54.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42a40b0e20 0x7f42a40b32e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00aa90 tx=0x7f42bc009250 comp rx=0 tx=0).stop 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 -- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 msgr2=0x7f42cc1a1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 0x7f42cc1a1720 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f42c002f730 tx=0x7f42c0004600 comp rx=0 tx=0).stop 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 -- 10.20.193.28:0/1775831501 shutdown_connections 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f42a40b0e20 0x7f42a40b32e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f42cc1069e0 0x7f42cc1a5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f42cc101700 0x7f42cc1a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 --2- 10.20.193.28:0/1775831501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f42cc100d50 0x7f42cc1a1720 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 -- 10.20.193.28:0/1775831501 >> 10.20.193.28:0/1775831501 conn(0x7f42cc0fca60 msgr2=0x7f42cc110df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 -- 10.20.193.28:0/1775831501 shutdown_connections 2026-02-20T03:31:54.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:31:54.904+0000 7f42cb577640 1 -- 10.20.193.28:0/1775831501 wait complete. 2026-02-20T03:31:55.074 INFO:tasks.cephfs.filesystem:scrub status for tag:d1c733e2-bbab-42ab-88cc-05199a3c580b - {'path': '/', 'tag': 'd1c733e2-bbab-42ab-88cc-05199a3c580b', 'options': 'recursive,force'} 2026-02-20T03:31:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:55 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:31:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:55 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:55 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:31:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:55 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:31:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:55 trial028 ceph-mon[38552]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:31:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:55 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:55 trial028 ceph-mon[38552]: pgmap v702: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2026-02-20T03:31:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:55 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:55.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 14.39 MB/sec execute 86 sec latency 66188.559 ms 2026-02-20T03:31:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:55 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:31:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:55 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:55 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:31:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:55 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:31:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:55 trial177 ceph-mon[43181]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:31:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:55 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:55.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:55 trial177 ceph-mon[43181]: pgmap v702: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2026-02-20T03:31:55.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:55 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:55.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:55 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:31:55.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:55 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:55.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:55 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:31:55.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:55 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:31:55.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:55 trial126 ceph-mon[38476]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:31:55.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:55 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:55.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:55 trial126 ceph-mon[38476]: pgmap v702: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 9.8 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2026-02-20T03:31:55.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:55 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:31:56.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 14.22 MB/sec execute 87 sec latency 67188.593 ms 2026-02-20T03:31:57.482 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:57 trial028 ceph-mon[38552]: pgmap v703: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 3.8 KiB/s wr, 43 op/s 2026-02-20T03:31:57.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 14.06 MB/sec execute 88 sec latency 68188.638 ms 2026-02-20T03:31:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:57 trial177 ceph-mon[43181]: pgmap v703: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 3.8 KiB/s wr, 43 op/s 2026-02-20T03:31:57.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:57 trial126 ceph-mon[38476]: pgmap v703: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 3.8 KiB/s wr, 43 op/s 2026-02-20T03:31:58.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 13.90 MB/sec execute 89 sec latency 69188.676 ms 2026-02-20T03:31:59.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:31:59 trial028 ceph-mon[38552]: pgmap v704: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 4.5 KiB/s wr, 61 op/s 2026-02-20T03:31:59.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 13.75 MB/sec execute 90 sec latency 70188.715 ms 2026-02-20T03:31:59.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:31:59 trial177 ceph-mon[43181]: pgmap v704: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 4.5 KiB/s wr, 61 op/s 2026-02-20T03:31:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:31:59 trial126 ceph-mon[38476]: pgmap v704: 129 pgs: 129 active+clean; 574 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 57 KiB/s rd, 4.5 KiB/s wr, 61 op/s 2026-02-20T03:31:59.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- 10.20.193.28:0/52871917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 msgr2=0x7f95c0104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:59.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 --2- 10.20.193.28:0/52871917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 0x7f95c0104d40 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009a30 tx=0x7f95b402f260 comp rx=0 tx=0).stop 2026-02-20T03:31:59.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- 10.20.193.28:0/52871917 shutdown_connections 2026-02-20T03:31:59.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 --2- 10.20.193.28:0/52871917 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f95c01064f0 0x7f95c010cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 --2- 10.20.193.28:0/52871917 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f95c0105b30 0x7f95c0105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 --2- 10.20.193.28:0/52871917 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 0x7f95c0104d40 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- 10.20.193.28:0/52871917 >> 10.20.193.28:0/52871917 conn(0x7f95c01000c0 msgr2=0x7f95c01024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:59.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- 10.20.193.28:0/52871917 shutdown_connections 2026-02-20T03:31:59.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- 10.20.193.28:0/52871917 wait complete. 2026-02-20T03:31:59.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 Processor -- start 2026-02-20T03:31:59.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- start start 2026-02-20T03:31:59.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 0x7f95c019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f95c0105b30 0x7f95c019d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f95c01064f0 0x7f95c01a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0110550 con 0x7f95c0104940 2026-02-20T03:31:59.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01103d0 con 0x7f95c0105b30 2026-02-20T03:31:59.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f95c01106d0 con 0x7f95c01064f0 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95beffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 0x7f95c019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95beffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 0x7f95c019cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37400/0 (socket says 10.20.193.28:37400) 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95beffd640 1 -- 10.20.193.28:0/2366156428 learned_addr learned my addr 10.20.193.28:0/2366156428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95beffd640 1 -- 10.20.193.28:0/2366156428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f95c01064f0 msgr2=0x7f95c01a4170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95beffd640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f95c01064f0 0x7f95c01a4170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95beffd640 1 -- 10.20.193.28:0/2366156428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f95c0105b30 msgr2=0x7f95c019d100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95beffd640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f95c0105b30 0x7f95c019d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95beffd640 1 -- 10.20.193.28:0/2366156428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c01a4870 con 0x7f95c0104940 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95beffd640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 0x7f95c019cbc0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009950 tx=0x7f95b402fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f959ffff640 1 -- 10.20.193.28:0/2366156428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4004240 con 0x7f95c0104940 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f959ffff640 1 -- 10.20.193.28:0/2366156428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f95b40043e0 con 0x7f95c0104940 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f959ffff640 1 -- 10.20.193.28:0/2366156428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4042b30 con 0x7f95c0104940 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- 10.20.193.28:0/2366156428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c01a4b00 con 0x7f95c0104940 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.871+0000 7f95bffff640 1 -- 10.20.193.28:0/2366156428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c01a5020 con 0x7f95c0104940 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f959ffff640 1 -- 10.20.193.28:0/2366156428 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f95b4038790 con 0x7f95c0104940 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 Processor -- start 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 -- start start 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7bcc50 0x556eed7bd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556eed70d8f0 con 0x556eed7c2600 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556eed6bb2e0 con 0x556eed7bcc50 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556eed709820 con 0x556eed7bd5b0 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95be7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95be7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37410/0 (socket says 10.20.193.28:37410) 2026-02-20T03:31:59.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95be7fc640 1 -- 10.20.193.28:0/2808732259 learned_addr learned my addr 10.20.193.28:0/2808732259 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:59.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f959ffff640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f95900b0e20 0x7f95900b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95be7fc640 1 -- 10.20.193.28:0/2808732259 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 msgr2=0x556eed7c1fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:59.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95be7fc640 1 --2- 10.20.193.28:0/2808732259 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7c1fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95be7fc640 1 -- 10.20.193.28:0/2808732259 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7bcc50 msgr2=0x556eed7bd070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95be7fc640 1 --2- 10.20.193.28:0/2808732259 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7bcc50 0x556eed7bd070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95be7fc640 1 -- 10.20.193.28:0/2808732259 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eed6ad5a0 con 0x556eed7c2600 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f959ffff640 1 -- 10.20.193.28:0/2366156428 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f95b4105480 con 0x7f95c0104940 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95bf7fe640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f95900b0e20 0x7f95900b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95be7fc640 1 --2- 10.20.193.28:0/2808732259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7c4a30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009840 tx=0x7f95a8009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb5395c92c10243 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95877fe640 1 -- 10.20.193.28:0/2808732259 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8016070 con 0x556eed7c2600 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95877fe640 1 -- 10.20.193.28:0/2808732259 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f95a8004480 con 0x556eed7c2600 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95877fe640 1 -- 10.20.193.28:0/2808732259 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a800bd00 con 0x556eed7c2600 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 -- 10.20.193.28:0/2808732259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 msgr2=0x556eed7c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2808732259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7c4a30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009840 tx=0x7f95a8009d10 comp rx=0 tx=0).stop 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95bf7fe640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f95900b0e20 0x7f95900b32e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x556eed7bdf50 tx=0x7f95b00091d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 -- 10.20.193.28:0/2808732259 shutdown_connections 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2808732259 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7c4a30 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2808732259 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2808732259 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7bcc50 0x556eed7bd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 -- 10.20.193.28:0/2808732259 >> 10.20.193.28:0/2808732259 conn(0x556eed7b42d0 msgr2=0x556eed7bb150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 -- 10.20.193.28:0/2808732259 shutdown_connections 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.877+0000 7f95c8617e00 1 -- 10.20.193.28:0/2808732259 wait complete. 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 -- start start 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 Processor -- start 2026-02-20T03:31:59.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7d5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7c2600 0x556eed7dcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556eed6b50c0 con 0x556eed7bcc50 2026-02-20T03:31:59.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556eed7c55f0 con 0x556eed7c2600 2026-02-20T03:31:59.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556eed7dd430 con 0x556eed7bd5b0 2026-02-20T03:31:59.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95beffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95beffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37414/0 (socket says 10.20.193.28:37414) 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95beffd640 1 -- 10.20.193.28:0/2597639116 learned_addr learned my addr 10.20.193.28:0/2597639116 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95beffd640 1 -- 10.20.193.28:0/2597639116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 msgr2=0x556eed7d5f20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95beffd640 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7d5f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95beffd640 1 -- 10.20.193.28:0/2597639116 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7c2600 msgr2=0x556eed7dcea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95beffd640 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7c2600 0x556eed7dcea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95beffd640 1 -- 10.20.193.28:0/2597639116 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eed7cf110 con 0x556eed7bcc50 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95beffd640 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d59e0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f95b40ccec0 tx=0x7f95b40cc990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f135318df1d3859 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f9584ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f9584ff9640 1 -- 10.20.193.28:0/2597639116 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4035320 con 0x556eed7bcc50 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f9584ff9640 1 -- 10.20.193.28:0/2597639116 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f95b4033020 con 0x556eed7bcc50 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f9584ff9640 1 -- 10.20.193.28:0/2597639116 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40d1120 con 0x556eed7bcc50 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 -- 10.20.193.28:0/2597639116 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eed6c9820 con 0x556eed7bcc50 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f9584ff9640 1 -- 10.20.193.28:0/2597639116 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f95b40d12c0 con 0x556eed7bcc50 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f9584ff9640 10 client.20316 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 10 client.20316 _ll_register_callbacks cb 0x556eed6b8ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 -- 10.20.193.28:0/2597639116 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556eed7154e0 con 0x556eed7bcc50 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f9584ff9640 1 -- 10.20.193.28:0/2597639116 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f95b40d1570 con 0x556eed7bcc50 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 10 client.20316 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:59.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 -- 10.20.193.28:0/2597639116 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x556eed6ce380 con 0x556eed7bcc50 2026-02-20T03:31:59.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f9584ff9640 1 -- 10.20.193.28:0/2597639116 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f95b40ef070 con 0x556eed7bcc50 2026-02-20T03:31:59.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 10 client.20316 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:59.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 10 client.20316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:59.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 20 client.20316 populate_metadata read hostname 'trial028' 2026-02-20T03:31:59.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556eed7e1520 0x556eed7e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 4 client.20316 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:31:59.898 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.882+0000 7f95c8617e00 1 -- 10.20.193.28:0/2597639116 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556eed68fbd0 con 0x556eed7e1520 2026-02-20T03:31:59.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.909+0000 7f95be7fc640 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556eed7e1520 0x556eed7e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:59.952 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.949+0000 7f9584ff9640 10 client.20316 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:59.952 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.949+0000 7f95be7fc640 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556eed7e1520 0x556eed7e39e0 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6494d3553b5cc33 server_cookie=91551b630f9ff43c in_seq=0 out_seq=0 2026-02-20T03:31:59.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f9584ff9640 1 -- 10.20.193.28:0/2597639116 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556eed68fbd0 con 0x556eed7e1520 2026-02-20T03:31:59.966 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f9584ff9640 10 client.20316 handle_command_reply: tid=0 2026-02-20T03:31:59.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 client.20316 shutdown 2026-02-20T03:31:59.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 -- 10.20.193.28:0/2597639116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 msgr2=0x556eed7d59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:59.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d59e0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f95b40ccec0 tx=0x7f95b40cc990 comp rx=0 tx=0).stop 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 -- 10.20.193.28:0/2597639116 shutdown_connections 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556eed7e1520 0x556eed7e39e0 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7c2600 0x556eed7dcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7d5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2597639116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d59e0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f9584ff9640 0 client.20316 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 -- 10.20.193.28:0/2597639116 >> 10.20.193.28:0/2597639116 conn(0x556eed7b42d0 msgr2=0x556eed7c3910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 -- 10.20.193.28:0/2597639116 shutdown_connections 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 1 -- 10.20.193.28:0/2597639116 wait complete. 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.963+0000 7f95c8617e00 20 client.20316 trim_cache size 0 max 16384 2026-02-20T03:31:59.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.969+0000 7f95c8617e00 1 Processor -- start 2026-02-20T03:31:59.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.969+0000 7f95c8617e00 1 -- start start 2026-02-20T03:31:59.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.969+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7bcc50 0x556eed7c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.969+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7dce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.969+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7bdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.969+0000 7f95c8617e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f95640125b0 con 0x556eed7c2600 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.969+0000 7f95c8617e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f956400fe80 con 0x556eed7bcc50 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.969+0000 7f95c8617e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f956400dcd0 con 0x556eed7bd5b0 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7bdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7bdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37420/0 (socket says 10.20.193.28:37420) 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95bf7fe640 1 -- 10.20.193.28:0/638741115 learned_addr learned my addr 10.20.193.28:0/638741115 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95bf7fe640 1 -- 10.20.193.28:0/638741115 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 msgr2=0x556eed7dce60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95bf7fe640 1 --2- 10.20.193.28:0/638741115 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7dce60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95bf7fe640 1 -- 10.20.193.28:0/638741115 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7bcc50 msgr2=0x556eed7c39f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95bf7fe640 1 --2- 10.20.193.28:0/638741115 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7bcc50 0x556eed7c39f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95bf7fe640 1 -- 10.20.193.28:0/638741115 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eed7cef40 con 0x556eed7c2600 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95bf7fe640 1 --2- 10.20.193.28:0/638741115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7bdf80 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f95b000afd0 tx=0x7f95b000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9588a05fa3919f08 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f9586ffd640 1 -- 10.20.193.28:0/638741115 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b00047e0 con 0x556eed7c2600 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f9586ffd640 1 -- 10.20.193.28:0/638741115 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f95b0020070 con 0x556eed7c2600 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f9586ffd640 1 -- 10.20.193.28:0/638741115 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b000e670 con 0x556eed7c2600 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95c8617e00 1 -- 10.20.193.28:0/638741115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 msgr2=0x556eed7bdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95c8617e00 1 --2- 10.20.193.28:0/638741115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7bdf80 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f95b000afd0 tx=0x7f95b000f000 comp rx=0 tx=0).stop 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95c8617e00 1 -- 10.20.193.28:0/638741115 shutdown_connections 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95c8617e00 1 --2- 10.20.193.28:0/638741115 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7c2600 0x556eed7bdf80 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95c8617e00 1 --2- 10.20.193.28:0/638741115 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7dce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95c8617e00 1 --2- 10.20.193.28:0/638741115 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7bcc50 0x556eed7c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95c8617e00 1 -- 10.20.193.28:0/638741115 >> 10.20.193.28:0/638741115 conn(0x556eed7b42d0 msgr2=0x556eed7d58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95c8617e00 1 -- 10.20.193.28:0/638741115 shutdown_connections 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.975+0000 7f95c8617e00 1 -- 10.20.193.28:0/638741115 wait complete. 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.976+0000 7f95c8617e00 1 -- start start 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.976+0000 7f95c8617e00 1 Processor -- start 2026-02-20T03:31:59.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.977+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.977+0000 7f95beffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:31:59.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.977+0000 7f95beffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37428/0 (socket says 10.20.193.28:37428) 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7d95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7c2600 0x556eed7dc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f956400e340 con 0x556eed7bcc50 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f956400f7b0 con 0x556eed7c2600 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f956400ea10 con 0x556eed7bd5b0 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95beffd640 1 -- 10.20.193.28:0/2621568937 learned_addr learned my addr 10.20.193.28:0/2621568937 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95beffd640 1 -- 10.20.193.28:0/2621568937 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 msgr2=0x556eed7d95b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95beffd640 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7d95b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95beffd640 1 -- 10.20.193.28:0/2621568937 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7c2600 msgr2=0x556eed7dc2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95beffd640 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7c2600 0x556eed7dc2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95beffd640 1 -- 10.20.193.28:0/2621568937 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eed46d690 con 0x556eed7bcc50 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95beffd640 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d9070 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f95b40ca1e0 tx=0x7f95b40cd8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7513caa0f89505e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f9584ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f9584ff9640 1 -- 10.20.193.28:0/2621568937 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40c8e30 con 0x556eed7bcc50 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 -- 10.20.193.28:0/2621568937 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eed6d2b70 con 0x556eed7bcc50 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 10 client.20322 _ll_register_callbacks cb 0x7f95b40ccf90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:31:59.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 -- 10.20.193.28:0/2621568937 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556eed4e6520 con 0x556eed7bcc50 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f9584ff9640 1 -- 10.20.193.28:0/2621568937 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x556eed4e6520 con 0x556eed7bcc50 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f9584ff9640 1 -- 10.20.193.28:0/2621568937 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b40c8e30 con 0x556eed7bcc50 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f9584ff9640 1 -- 10.20.193.28:0/2621568937 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f95b40cc1d0 con 0x556eed7bcc50 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f9584ff9640 1 -- 10.20.193.28:0/2621568937 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f95b40d61f0 con 0x556eed7bcc50 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 10 client.20322 fetch_fsmap learned FSMap version 42 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 -- 10.20.193.28:0/2621568937 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x556eed7cfc30 con 0x556eed7bcc50 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f9584ff9640 1 -- 10.20.193.28:0/2621568937 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f95b40ef070 con 0x556eed7bcc50 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 10 client.20322 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 10 client.20322 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 20 client.20322 populate_metadata read hostname 'trial028' 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556eed84cc60 0x556eed84f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 4 client.20322 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.979+0000 7f95c8617e00 1 -- 10.20.193.28:0/2621568937 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556eed71b290 con 0x556eed84cc60 2026-02-20T03:31:59.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:31:59.991+0000 7f95be7fc640 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556eed84cc60 0x556eed84f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:00.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.032+0000 7f9584ff9640 10 client.20322 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:00.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.032+0000 7f95be7fc640 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556eed84cc60 0x556eed84f0f0 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e4ef0a2a7f65f74 server_cookie=e9da5904d4aecacf in_seq=0 out_seq=0 2026-02-20T03:32:00.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.101+0000 7f9584ff9640 1 -- 10.20.193.28:0/2621568937 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556eed71b290 con 0x556eed84cc60 2026-02-20T03:32:00.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.101+0000 7f9584ff9640 10 client.20322 handle_command_reply: tid=0 2026-02-20T03:32:00.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.101+0000 7f95c8617e00 1 client.20322 shutdown 2026-02-20T03:32:00.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.102+0000 7f95c8617e00 1 -- 10.20.193.28:0/2621568937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 msgr2=0x556eed7d9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:00.105 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.102+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d9070 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f95b40ca1e0 tx=0x7f95b40cd8c0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95c8617e00 1 -- 10.20.193.28:0/2621568937 shutdown_connections 2026-02-20T03:32:00.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556eed84cc60 0x556eed84f0f0 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.106 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556eed7c2600 0x556eed7dc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556eed7bd5b0 0x556eed7d95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95c8617e00 1 --2- 10.20.193.28:0/2621568937 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556eed7bcc50 0x556eed7d9070 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95c8617e00 1 -- 10.20.193.28:0/2621568937 >> 10.20.193.28:0/2621568937 conn(0x556eed7b42d0 msgr2=0x556eed7c29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:00.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f9584ff9640 0 client.20322 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:00.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95c8617e00 1 -- 10.20.193.28:0/2621568937 shutdown_connections 2026-02-20T03:32:00.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95c8617e00 1 -- 10.20.193.28:0/2621568937 wait complete. 2026-02-20T03:32:00.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95c8617e00 20 client.20322 trim_cache size 0 max 16384 2026-02-20T03:32:00.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:32:00.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:32:00.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:32:00.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:32:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95bffff640 1 -- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f95900b0e20 msgr2=0x7f95900b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.103+0000 7f95bffff640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f95900b0e20 0x7f95900b32e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x556eed7bdf50 tx=0x7f95b00091d0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 -- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 msgr2=0x7f95c019cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 0x7f95c019cbc0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009950 tx=0x7f95b402fd60 comp rx=0 tx=0).stop 2026-02-20T03:32:00.131 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 -- 10.20.193.28:0/2366156428 shutdown_connections 2026-02-20T03:32:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f95900b0e20 0x7f95900b32e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f95c01064f0 0x7f95c01a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f95c0105b30 0x7f95c019d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 --2- 10.20.193.28:0/2366156428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f95c0104940 0x7f95c019cbc0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 -- 10.20.193.28:0/2366156428 >> 10.20.193.28:0/2366156428 conn(0x7f95c01000c0 msgr2=0x7f95c0108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 -- 10.20.193.28:0/2366156428 shutdown_connections 2026-02-20T03:32:00.132 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:00.104+0000 7f95bffff640 1 -- 10.20.193.28:0/2366156428 wait complete. 2026-02-20T03:32:00.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 13.60 MB/sec execute 91 sec latency 71188.773 ms 2026-02-20T03:32:01.505 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:01 trial028 ceph-mon[38552]: pgmap v705: 129 pgs: 129 active+clean; 573 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 4.0 KiB/s wr, 70 op/s 2026-02-20T03:32:01.647 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:01 trial126 ceph-mon[38476]: pgmap v705: 129 pgs: 129 active+clean; 573 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 4.0 KiB/s wr, 70 op/s 2026-02-20T03:32:01.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 13.45 MB/sec execute 92 sec latency 72188.823 ms 2026-02-20T03:32:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:01 trial177 ceph-mon[43181]: pgmap v705: 129 pgs: 129 active+clean; 573 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 4.0 KiB/s wr, 70 op/s 2026-02-20T03:32:02.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 13.31 MB/sec execute 93 sec latency 73188.870 ms 2026-02-20T03:32:03.673 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:03 trial028 ceph-mon[38552]: pgmap v706: 129 pgs: 129 active+clean; 568 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 5.3 KiB/s wr, 72 op/s 2026-02-20T03:32:03.673 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:03 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:32:03.673 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:03 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:32:03.673 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:03 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:32:03.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 13.16 MB/sec execute 94 sec latency 74188.911 ms 2026-02-20T03:32:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:03 trial177 ceph-mon[43181]: pgmap v706: 129 pgs: 129 active+clean; 568 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 5.3 KiB/s wr, 72 op/s 2026-02-20T03:32:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:03 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:32:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:03 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:32:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:03 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:32:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:03 trial126 ceph-mon[38476]: pgmap v706: 129 pgs: 129 active+clean; 568 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 5.3 KiB/s wr, 72 op/s 2026-02-20T03:32:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:03 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:32:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:03 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:32:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:03 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:32:04.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 13.03 MB/sec execute 95 sec latency 75188.954 ms 2026-02-20T03:32:05.591 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:05 trial028 ceph-mon[38552]: pgmap v707: 129 pgs: 129 active+clean; 566 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 236 KiB/s rd, 176 KiB/s wr, 80 op/s 2026-02-20T03:32:05.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 12.89 MB/sec execute 96 sec latency 76189.006 ms 2026-02-20T03:32:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:05 trial177 ceph-mon[43181]: pgmap v707: 129 pgs: 129 active+clean; 566 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 236 KiB/s rd, 176 KiB/s wr, 80 op/s 2026-02-20T03:32:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:05 trial126 ceph-mon[38476]: pgmap v707: 129 pgs: 129 active+clean; 566 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 236 KiB/s rd, 176 KiB/s wr, 80 op/s 2026-02-20T03:32:06.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 12.76 MB/sec execute 97 sec latency 77189.052 ms 2026-02-20T03:32:07.473 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:07 trial028 ceph-mon[38552]: pgmap v708: 129 pgs: 129 active+clean; 545 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 232 KiB/s rd, 176 KiB/s wr, 107 op/s 2026-02-20T03:32:07.703 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 12.63 MB/sec execute 98 sec latency 78189.091 ms 2026-02-20T03:32:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:07 trial177 ceph-mon[43181]: pgmap v708: 129 pgs: 129 active+clean; 545 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 232 KiB/s rd, 176 KiB/s wr, 107 op/s 2026-02-20T03:32:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:07 trial126 ceph-mon[38476]: pgmap v708: 129 pgs: 129 active+clean; 545 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 232 KiB/s rd, 176 KiB/s wr, 107 op/s 2026-02-20T03:32:08.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83972 12.50 MB/sec execute 99 sec latency 79189.125 ms 2026-02-20T03:32:09.632 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:09 trial028 ceph-mon[38552]: pgmap v709: 129 pgs: 129 active+clean; 534 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 234 KiB/s rd, 207 KiB/s wr, 94 op/s 2026-02-20T03:32:09.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 12.37 MB/sec execute 100 sec latency 80189.157 ms 2026-02-20T03:32:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:09 trial177 ceph-mon[43181]: pgmap v709: 129 pgs: 129 active+clean; 534 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 234 KiB/s rd, 207 KiB/s wr, 94 op/s 2026-02-20T03:32:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:09 trial126 ceph-mon[38476]: pgmap v709: 129 pgs: 129 active+clean; 534 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 234 KiB/s rd, 207 KiB/s wr, 94 op/s 2026-02-20T03:32:10.699 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:10 trial028 ceph-mon[38552]: pgmap v710: 129 pgs: 129 active+clean; 528 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 216 KiB/s rd, 207 KiB/s wr, 85 op/s 2026-02-20T03:32:10.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 12.25 MB/sec execute 101 sec latency 81189.193 ms 2026-02-20T03:32:10.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:10 trial126 ceph-mon[38476]: pgmap v710: 129 pgs: 129 active+clean; 528 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 216 KiB/s rd, 207 KiB/s wr, 85 op/s 2026-02-20T03:32:10.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:10 trial177 ceph-mon[43181]: pgmap v710: 129 pgs: 129 active+clean; 528 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 216 KiB/s rd, 207 KiB/s wr, 85 op/s 2026-02-20T03:32:11.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 12.13 MB/sec execute 102 sec latency 82189.233 ms 2026-02-20T03:32:12.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 12.01 MB/sec execute 103 sec latency 83189.274 ms 2026-02-20T03:32:13.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 -- 10.20.193.28:0/3439361520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01026b0 msgr2=0x7fabb0102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:13.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 --2- 10.20.193.28:0/3439361520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01026b0 0x7fabb0102ab0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7faba4009a30 tx=0x7faba402f260 comp rx=0 tx=0).stop 2026-02-20T03:32:13.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 -- 10.20.193.28:0/3439361520 shutdown_connections 2026-02-20T03:32:13.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 --2- 10.20.193.28:0/3439361520 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fabb0104260 0x7fabb010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.185 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 --2- 10.20.193.28:0/3439361520 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fabb01038a0 0x7fabb0103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 --2- 10.20.193.28:0/3439361520 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01026b0 0x7fabb0102ab0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 -- 10.20.193.28:0/3439361520 >> 10.20.193.28:0/3439361520 conn(0x7fabb00fde10 msgr2=0x7fabb0100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 -- 10.20.193.28:0/3439361520 shutdown_connections 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 -- 10.20.193.28:0/3439361520 wait complete. 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 Processor -- start 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 -- start start 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fabb01026b0 0x7fabb0076e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01038a0 0x7fabb0075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fabb0104260 0x7fabb00759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010e270 con 0x7fabb01038a0 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010e0f0 con 0x7fabb0104260 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabaf577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010e3f0 con 0x7fabb01026b0 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabadd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01038a0 0x7fabb0075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabadd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01038a0 0x7fabb0075460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36986/0 (socket says 10.20.193.28:36986) 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabadd74640 1 -- 10.20.193.28:0/3001184321 learned_addr learned my addr 10.20.193.28:0/3001184321 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabadd74640 1 -- 10.20.193.28:0/3001184321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fabb01026b0 msgr2=0x7fabb0076e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabadd74640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fabb01026b0 0x7fabb0076e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabadd74640 1 -- 10.20.193.28:0/3001184321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fabb0104260 msgr2=0x7fabb00759a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabadd74640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fabb0104260 0x7fabb00759a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.180+0000 7fabadd74640 1 -- 10.20.193.28:0/3001184321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb0076240 con 0x7fabb01038a0 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabadd74640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01038a0 0x7fabb0075460 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fab9800b570 tx=0x7fab9800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:13.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fab977fe640 1 -- 10.20.193.28:0/3001184321 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab98013020 con 0x7fabb01038a0 2026-02-20T03:32:13.189 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabaf577640 1 -- 10.20.193.28:0/3001184321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb01a4b00 con 0x7fabb01038a0 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabaf577640 1 -- 10.20.193.28:0/3001184321 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01a50a0 con 0x7fabb01038a0 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fab977fe640 1 -- 10.20.193.28:0/3001184321 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fab98004480 con 0x7fabb01038a0 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fab977fe640 1 -- 10.20.193.28:0/3001184321 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9800fb50 con 0x7fabb01038a0 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fab977fe640 1 -- 10.20.193.28:0/3001184321 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fab98002780 con 0x7fabb01038a0 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 Processor -- start 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 -- start start 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 0x55d5c7052070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7056fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 0x55d5c7059a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6fa28f0 con 0x55d5c70525b0 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6f502e0 con 0x55d5c7051c50 2026-02-20T03:32:13.190 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6f9e820 con 0x55d5c7057600 2026-02-20T03:32:13.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabae575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7056fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:13.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabae575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7056fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36994/0 (socket says 10.20.193.28:36994) 2026-02-20T03:32:13.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabae575640 1 -- 10.20.193.28:0/369927419 learned_addr learned my addr 10.20.193.28:0/369927419 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:13.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabae575640 1 -- 10.20.193.28:0/369927419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 msgr2=0x55d5c7059a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:13.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabae575640 1 --2- 10.20.193.28:0/369927419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 0x55d5c7059a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabae575640 1 -- 10.20.193.28:0/369927419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 msgr2=0x55d5c7052070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:13.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabae575640 1 --2- 10.20.193.28:0/369927419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 0x55d5c7052070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabae575640 1 -- 10.20.193.28:0/369927419 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5c6f425a0 con 0x55d5c70525b0 2026-02-20T03:32:13.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabae575640 1 --2- 10.20.193.28:0/369927419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7056fe0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7faba402f770 tx=0x7faba4005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c64f5dcff0c6a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fab94ff9640 1 -- 10.20.193.28:0/369927419 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4002d30 con 0x55d5c70525b0 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fab94ff9640 1 -- 10.20.193.28:0/369927419 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faba4033040 con 0x55d5c70525b0 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fab94ff9640 1 -- 10.20.193.28:0/369927419 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4004510 con 0x55d5c70525b0 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 -- 10.20.193.28:0/369927419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 msgr2=0x55d5c7056fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 --2- 10.20.193.28:0/369927419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7056fe0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7faba402f770 tx=0x7faba4005ce0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fab977fe640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fab880b0e20 0x7fab880b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 -- 10.20.193.28:0/369927419 shutdown_connections 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 --2- 10.20.193.28:0/369927419 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 0x55d5c7059a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 --2- 10.20.193.28:0/369927419 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7056fe0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 --2- 10.20.193.28:0/369927419 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 0x55d5c7052070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 -- 10.20.193.28:0/369927419 >> 10.20.193.28:0/369927419 conn(0x55d5c70492d0 msgr2=0x55d5c7050150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fab977fe640 1 -- 10.20.193.28:0/3001184321 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fab980e04d0 con 0x7fabb01038a0 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 -- 10.20.193.28:0/369927419 shutdown_connections 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.183+0000 7fabb7caee00 1 -- 10.20.193.28:0/369927419 wait complete. 2026-02-20T03:32:13.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fab880b0e20 0x7fab880b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fab880b0e20 0x7fab880b32e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x55d5c7052f50 tx=0x7faba0009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 -- start start 2026-02-20T03:32:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 Processor -- start 2026-02-20T03:32:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 0x55d5c706a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c70525b0 0x55d5c706ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7057600 0x55d5c7071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d5c6f4a0c0 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d5c705a590 con 0x55d5c7051c50 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d5c7072220 con 0x55d5c70525b0 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7057600 0x55d5c7071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7057600 0x55d5c7071c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36998/0 (socket says 10.20.193.28:36998) 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 -- 10.20.193.28:0/1764853944 learned_addr learned my addr 10.20.193.28:0/1764853944 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 -- 10.20.193.28:0/1764853944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c70525b0 msgr2=0x55d5c706ae10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c70525b0 0x55d5c706ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 -- 10.20.193.28:0/1764853944 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 msgr2=0x55d5c706a8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 0x55d5c706a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 -- 10.20.193.28:0/1764853944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5c7064010 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabaed76640 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7057600 0x55d5c7071c90 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7faba0004380 tx=0x7faba0004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93fc123b44341b0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fab5ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fab5ffff640 1 -- 10.20.193.28:0/1764853944 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0006e60 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fab5ffff640 1 -- 10.20.193.28:0/1764853944 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faba001f020 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fab5ffff640 1 -- 10.20.193.28:0/1764853944 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba001adb0 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 -- 10.20.193.28:0/1764853944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5c6f5e820 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fab5ffff640 1 -- 10.20.193.28:0/1764853944 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7faba0024410 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fab5ffff640 10 client.20334 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 10 client.20334 _ll_register_callbacks cb 0x55d5c6f4dff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 -- 10.20.193.28:0/1764853944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d5c6faa4e0 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fab5ffff640 1 -- 10.20.193.28:0/1764853944 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7faba001e030 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 10 client.20334 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 -- 10.20.193.28:0/1764853944 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55d5c6f63380 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fab5ffff640 1 -- 10.20.193.28:0/1764853944 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7faba000d9a0 con 0x55d5c7057600 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 10 client.20334 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 10 client.20334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 20 client.20334 populate_metadata read hostname 'trial028' 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5c70765f0 0x55d5c7078a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 4 client.20334 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:13.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.189+0000 7fabb7caee00 1 -- 10.20.193.28:0/1764853944 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5c6f24bd0 con 0x55d5c70765f0 2026-02-20T03:32:13.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.210+0000 7fabae575640 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5c70765f0 0x55d5c7078a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:13.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.264+0000 7fab5ffff640 10 client.20334 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:13.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.264+0000 7fabae575640 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5c70765f0 0x55d5c7078a80 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71b97087c431dc36 server_cookie=4c18637e79f7912 in_seq=0 out_seq=0 2026-02-20T03:32:13.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fab5ffff640 1 -- 10.20.193.28:0/1764853944 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d5c6f24bd0 con 0x55d5c70765f0 2026-02-20T03:32:13.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fab5ffff640 10 client.20334 handle_command_reply: tid=0 2026-02-20T03:32:13.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 client.20334 shutdown 2026-02-20T03:32:13.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 -- 10.20.193.28:0/1764853944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7057600 msgr2=0x55d5c7071c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:13.294 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7057600 0x55d5c7071c90 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7faba0004380 tx=0x7faba0004bd0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 -- 10.20.193.28:0/1764853944 shutdown_connections 2026-02-20T03:32:13.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5c70765f0 0x55d5c7078a80 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7057600 0x55d5c7071c90 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c70525b0 0x55d5c706ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 --2- 10.20.193.28:0/1764853944 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 0x55d5c706a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 -- 10.20.193.28:0/1764853944 >> 10.20.193.28:0/1764853944 conn(0x55d5c70492d0 msgr2=0x55d5c7058950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:13.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fab5ffff640 0 client.20334 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:13.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 -- 10.20.193.28:0/1764853944 shutdown_connections 2026-02-20T03:32:13.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 1 -- 10.20.193.28:0/1764853944 wait complete. 2026-02-20T03:32:13.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.291+0000 7fabb7caee00 20 client.20334 trim_cache size 0 max 16384 2026-02-20T03:32:13.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.298+0000 7fabb7caee00 1 Processor -- start 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- start start 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 0x55d5c7069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 0x55d5c7052f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fab54012650 con 0x55d5c70525b0 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fab5400ff20 con 0x55d5c7051c50 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fab5400dd70 con 0x55d5c7057600 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabadd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabadd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7071c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37000/0 (socket says 10.20.193.28:37000) 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabadd74640 1 -- 10.20.193.28:0/3637961587 learned_addr learned my addr 10.20.193.28:0/3637961587 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabadd74640 1 -- 10.20.193.28:0/3637961587 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 msgr2=0x55d5c7052f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabadd74640 1 --2- 10.20.193.28:0/3637961587 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 0x55d5c7052f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabadd74640 1 -- 10.20.193.28:0/3637961587 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 msgr2=0x55d5c7069f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabadd74640 1 --2- 10.20.193.28:0/3637961587 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 0x55d5c7069f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabadd74640 1 -- 10.20.193.28:0/3637961587 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5c7063e40 con 0x55d5c70525b0 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabadd74640 1 --2- 10.20.193.28:0/3637961587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7071c50 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fab9800bf50 tx=0x7fab980a7910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbccd294b8f9791 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:13.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab7a3ff640 1 -- 10.20.193.28:0/3637961587 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab980a8910 con 0x55d5c70525b0 2026-02-20T03:32:13.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab7a3ff640 1 -- 10.20.193.28:0/3637961587 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fab980ac5c0 con 0x55d5c70525b0 2026-02-20T03:32:13.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab7a3ff640 1 -- 10.20.193.28:0/3637961587 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab980ac170 con 0x55d5c70525b0 2026-02-20T03:32:13.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- 10.20.193.28:0/3637961587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 msgr2=0x55d5c7071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:13.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- 10.20.193.28:0/3637961587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7071c50 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fab9800bf50 tx=0x7fab980a7910 comp rx=0 tx=0).stop 2026-02-20T03:32:13.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- 10.20.193.28:0/3637961587 shutdown_connections 2026-02-20T03:32:13.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- 10.20.193.28:0/3637961587 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 0x55d5c7052f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- 10.20.193.28:0/3637961587 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c70525b0 0x55d5c7071c50 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- 10.20.193.28:0/3637961587 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c7051c50 0x55d5c7069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- 10.20.193.28:0/3637961587 >> 10.20.193.28:0/3637961587 conn(0x55d5c70492d0 msgr2=0x55d5c70696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:13.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- 10.20.193.28:0/3637961587 shutdown_connections 2026-02-20T03:32:13.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- 10.20.193.28:0/3637961587 wait complete. 2026-02-20T03:32:13.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- start start 2026-02-20T03:32:13.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 Processor -- start 2026-02-20T03:32:13.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7051c50 0x55d5c7070510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c70525b0 0x55d5c7070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 0x55d5c7070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fab5400e3e0 con 0x55d5c7051c50 2026-02-20T03:32:13.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fab5400f850 con 0x55d5c70525b0 2026-02-20T03:32:13.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fab5400eab0 con 0x55d5c7057600 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabae575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7051c50 0x55d5c7070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabae575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7051c50 0x55d5c7070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37016/0 (socket says 10.20.193.28:37016) 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabae575640 1 -- 10.20.193.28:0/548559699 learned_addr learned my addr 10.20.193.28:0/548559699 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabae575640 1 -- 10.20.193.28:0/548559699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 msgr2=0x55d5c7070f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabae575640 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 0x55d5c7070f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabae575640 1 -- 10.20.193.28:0/548559699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c70525b0 msgr2=0x55d5c7070a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabae575640 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c70525b0 0x55d5c7070a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabae575640 1 -- 10.20.193.28:0/548559699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5c7068c00 con 0x55d5c7051c50 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabae575640 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7051c50 0x55d5c7070510 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x55d5c7069f40 tx=0x7faba402f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4db84dffc75bf0b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:13.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab5ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab5ffff640 1 -- 10.20.193.28:0/548559699 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba40028f0 con 0x55d5c7051c50 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab5ffff640 1 -- 10.20.193.28:0/548559699 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faba4033040 con 0x55d5c7051c50 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab5ffff640 1 -- 10.20.193.28:0/548559699 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4038880 con 0x55d5c7051c50 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- 10.20.193.28:0/548559699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5c6d02690 con 0x55d5c7051c50 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab5ffff640 1 -- 10.20.193.28:0/548559699 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7faba4038a20 con 0x55d5c7051c50 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab5ffff640 10 client.20340 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 10 client.20340 _ll_register_callbacks cb 0x7faba000cde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- 10.20.193.28:0/548559699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d5c6d7b520 con 0x55d5c7051c50 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab5ffff640 1 -- 10.20.193.28:0/548559699 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7faba4004000 con 0x55d5c7051c50 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 10 client.20340 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:13.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- 10.20.193.28:0/548559699 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55d5c6f67b70 con 0x55d5c7051c50 2026-02-20T03:32:13.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fab5ffff640 1 -- 10.20.193.28:0/548559699 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7faba405e020 con 0x55d5c7051c50 2026-02-20T03:32:13.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 10 client.20340 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:13.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 10 client.20340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:13.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 20 client.20340 populate_metadata read hostname 'trial028' 2026-02-20T03:32:13.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5c70e2a10 0x55d5c70e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:13.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 4 client.20340 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:32:13.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.299+0000 7fabb7caee00 1 -- 10.20.193.28:0/548559699 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d5c6fb0290 con 0x55d5c70e2a10 2026-02-20T03:32:13.313 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.304+0000 7fabadd74640 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5c70e2a10 0x55d5c70e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:13.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.332+0000 7fabadd74640 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5c70e2a10 0x55d5c70e4ea0 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a82c2b2836dcab41 server_cookie=3d85d3bd440ab4b in_seq=0 out_seq=0 2026-02-20T03:32:13.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.332+0000 7fab5ffff640 10 client.20340 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:13.377 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:13 trial028 ceph-mon[38552]: pgmap v711: 129 pgs: 129 active+clean; 528 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 209 KiB/s rd, 208 KiB/s wr, 76 op/s 2026-02-20T03:32:13.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.445+0000 7fab5ffff640 1 -- 10.20.193.28:0/548559699 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d5c6fb0290 con 0x55d5c70e2a10 2026-02-20T03:32:13.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.445+0000 7fab5ffff640 10 client.20340 handle_command_reply: tid=0 2026-02-20T03:32:13.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.446+0000 7fabb7caee00 1 client.20340 shutdown 2026-02-20T03:32:13.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.446+0000 7fabb7caee00 1 -- 10.20.193.28:0/548559699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7051c50 msgr2=0x55d5c7070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:13.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.446+0000 7fabb7caee00 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7051c50 0x55d5c7070510 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x55d5c7069f40 tx=0x7faba402f260 comp rx=0 tx=0).stop 2026-02-20T03:32:13.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabb7caee00 1 -- 10.20.193.28:0/548559699 shutdown_connections 2026-02-20T03:32:13.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabb7caee00 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5c70e2a10 0x55d5c70e4ea0 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fab5ffff640 0 client.20340 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:13.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabb7caee00 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d5c7057600 0x55d5c7070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabb7caee00 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5c70525b0 0x55d5c7070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabb7caee00 1 --2- 10.20.193.28:0/548559699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5c7051c50 0x55d5c7070510 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabb7caee00 1 -- 10.20.193.28:0/548559699 >> 10.20.193.28:0/548559699 conn(0x55d5c70492d0 msgr2=0x55d5c704f930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:13.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabb7caee00 1 -- 10.20.193.28:0/548559699 shutdown_connections 2026-02-20T03:32:13.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabb7caee00 1 -- 10.20.193.28:0/548559699 wait complete. 2026-02-20T03:32:13.451 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabb7caee00 20 client.20340 trim_cache size 0 max 16384 2026-02-20T03:32:13.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 -- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fab880b0e20 msgr2=0x7fab880b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fab880b0e20 0x7fab880b32e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x55d5c7052f50 tx=0x7faba0009250 comp rx=0 tx=0).stop 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 -- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01038a0 msgr2=0x7fabb0075460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01038a0 0x7fabb0075460 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fab9800b570 tx=0x7fab9800ba40 comp rx=0 tx=0).stop 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 -- 10.20.193.28:0/3001184321 shutdown_connections 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fab880b0e20 0x7fab880b32e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fabb0104260 0x7fabb00759a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fabb01038a0 0x7fabb0075460 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 --2- 10.20.193.28:0/3001184321 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fabb01026b0 0x7fabb0076e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 -- 10.20.193.28:0/3001184321 >> 10.20.193.28:0/3001184321 conn(0x7fabb00fde10 msgr2=0x7fabb0106d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 -- 10.20.193.28:0/3001184321 shutdown_connections 2026-02-20T03:32:13.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:13.447+0000 7fabaf577640 1 -- 10.20.193.28:0/3001184321 wait complete. 2026-02-20T03:32:13.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:13 trial126 ceph-mon[38476]: pgmap v711: 129 pgs: 129 active+clean; 528 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 209 KiB/s rd, 208 KiB/s wr, 76 op/s 2026-02-20T03:32:13.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 11.90 MB/sec execute 104 sec latency 84189.322 ms 2026-02-20T03:32:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:13 trial177 ceph-mon[43181]: pgmap v711: 129 pgs: 129 active+clean; 528 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 209 KiB/s rd, 208 KiB/s wr, 76 op/s 2026-02-20T03:32:14.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 11.79 MB/sec execute 105 sec latency 85189.365 ms 2026-02-20T03:32:15.539 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:15 trial028 ceph-mon[38552]: pgmap v712: 129 pgs: 129 active+clean; 527 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 211 KiB/s rd, 212 KiB/s wr, 82 op/s 2026-02-20T03:32:15.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:15 trial126 ceph-mon[38476]: pgmap v712: 129 pgs: 129 active+clean; 527 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 211 KiB/s rd, 212 KiB/s wr, 82 op/s 2026-02-20T03:32:15.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 11.67 MB/sec execute 106 sec latency 86189.406 ms 2026-02-20T03:32:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:15 trial177 ceph-mon[43181]: pgmap v712: 129 pgs: 129 active+clean; 527 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 211 KiB/s rd, 212 KiB/s wr, 82 op/s 2026-02-20T03:32:16.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 11.57 MB/sec execute 107 sec latency 87189.453 ms 2026-02-20T03:32:17.425 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:17 trial028 ceph-mon[38552]: pgmap v713: 129 pgs: 129 active+clean; 517 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 73 KiB/s rd, 76 KiB/s wr, 109 op/s 2026-02-20T03:32:17.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 11.46 MB/sec execute 108 sec latency 88189.551 ms 2026-02-20T03:32:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:17 trial177 ceph-mon[43181]: pgmap v713: 129 pgs: 129 active+clean; 517 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 73 KiB/s rd, 76 KiB/s wr, 109 op/s 2026-02-20T03:32:17.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:17 trial126 ceph-mon[38476]: pgmap v713: 129 pgs: 129 active+clean; 517 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 73 KiB/s rd, 76 KiB/s wr, 109 op/s 2026-02-20T03:32:18.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 11.35 MB/sec execute 109 sec latency 89189.591 ms 2026-02-20T03:32:19.568 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:19 trial028 ceph-mon[38552]: pgmap v714: 129 pgs: 129 active+clean; 503 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 173 KiB/s rd, 181 KiB/s wr, 113 op/s 2026-02-20T03:32:19.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 11.25 MB/sec execute 110 sec latency 90189.631 ms 2026-02-20T03:32:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:19 trial177 ceph-mon[43181]: pgmap v714: 129 pgs: 129 active+clean; 503 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 173 KiB/s rd, 181 KiB/s wr, 113 op/s 2026-02-20T03:32:19.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:19 trial126 ceph-mon[38476]: pgmap v714: 129 pgs: 129 active+clean; 503 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 173 KiB/s rd, 181 KiB/s wr, 113 op/s 2026-02-20T03:32:20.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 11.15 MB/sec execute 111 sec latency 91189.669 ms 2026-02-20T03:32:21.436 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:21 trial028 ceph-mon[38552]: pgmap v715: 129 pgs: 129 active+clean; 491 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 224 KiB/s wr, 119 op/s 2026-02-20T03:32:21.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83973 11.05 MB/sec execute 112 sec latency 92189.704 ms 2026-02-20T03:32:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:21 trial177 ceph-mon[43181]: pgmap v715: 129 pgs: 129 active+clean; 491 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 224 KiB/s wr, 119 op/s 2026-02-20T03:32:21.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:21 trial126 ceph-mon[38476]: pgmap v715: 129 pgs: 129 active+clean; 491 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 224 KiB/s wr, 119 op/s 2026-02-20T03:32:22.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83975 10.95 MB/sec execute 113 sec latency 93189.760 ms 2026-02-20T03:32:23.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:23 trial028 ceph-mon[38552]: pgmap v716: 129 pgs: 129 active+clean; 490 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 226 KiB/s wr, 111 op/s 2026-02-20T03:32:23.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83975 10.86 MB/sec execute 114 sec latency 94189.807 ms 2026-02-20T03:32:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:23 trial177 ceph-mon[43181]: pgmap v716: 129 pgs: 129 active+clean; 490 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 226 KiB/s wr, 111 op/s 2026-02-20T03:32:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:23 trial126 ceph-mon[38476]: pgmap v716: 129 pgs: 129 active+clean; 490 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 217 KiB/s rd, 226 KiB/s wr, 111 op/s 2026-02-20T03:32:24.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83977 10.76 MB/sec execute 115 sec latency 95189.853 ms 2026-02-20T03:32:25.075 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 42, 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 50, 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "sets": { 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "f621fbc0": { 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "version": 50, 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "age_ref": 0.0, 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "name": "TIMEDOUT", 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "age": 0.0 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "timeout": 90.0, 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "expiration": 144.4, 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "members": { 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "file:/": { 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "excluded": false, 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "state": { 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "name": "QUIESCING", 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: "age": 90.0 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:32:25.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe676ffd640 1 -- 10.20.193.28:0/1626384797 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: -110 ) ==== 8+0+593 (crc 0 0 0) 0x5608400a5ca0 con 0x5608402777f0 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe676ffd640 10 client.20190 handle_command_reply: tid=0 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 client.20190 shutdown 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/1626384797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 msgr2=0x56084025ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x56084025ebb0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0002410 tx=0x7fe6b000bea0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/1626384797 shutdown_connections 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5608402777f0 0x560840279be0 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5608401d66a0 0x56084025f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5608401d5d80 0x56084025ebb0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 --2- 10.20.193.28:0/1626384797 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5608401d0b40 0x5608401f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/1626384797 >> 10.20.193.28:0/1626384797 conn(0x5608401cc540 msgr2=0x5608401e8330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe676ffd640 0 client.20190 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/1626384797 shutdown_connections 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 1 -- 10.20.193.28:0/1626384797 wait complete. 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.088+0000 7fe6c5c2fe00 20 client.20190 trim_cache size 0 max 16384 2026-02-20T03:32:25.094 INFO:teuthology.orchestra.run.trial028.stderr:Error ETIMEDOUT: 2026-02-20T03:32:25.239 DEBUG:teuthology.orchestra.run:got remote process result: 110 2026-02-20T03:32:25.240 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't quiesce root with rc: 110 (ETIMEDOUT), stdout: { "epoch": 42, "leader": 24560, "set_version": 50, "sets": { "f621fbc0": { "version": 50, "age_ref": 0.0, "state": { "name": "TIMEDOUT", "age": 0.0 }, "timeout": 90.0, "expiration": 144.4, "members": { "file:/": { "excluded": false, "state": { "name": "QUIESCING", "age": 90.0 } } } } } } 2026-02-20T03:32:25.240 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa/tasks/quiescer.py", line 357, in _run self.do_quiesce(d) File "/home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa/tasks/quiescer.py", line 313, in do_quiesce raise RuntimeError(f"Error quiescing set '{set_id}': {rcinfo(rc)}") RuntimeError: Error quiescing set 'f621fbc0': 110 (ETIMEDOUT) 2026-02-20T03:32:25.370 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:32:25.492 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:25 trial028 ceph-mon[38552]: pgmap v717: 129 pgs: 129 active+clean; 489 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 216 KiB/s rd, 224 KiB/s wr, 112 op/s 2026-02-20T03:32:25.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- 10.20.193.28:0/2913624873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d0102700 msgr2=0x7f57d0102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:25.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 --2- 10.20.193.28:0/2913624873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d0102700 0x7f57d0102b60 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009a60 tx=0x7f57c402f290 comp rx=0 tx=0).stop 2026-02-20T03:32:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- 10.20.193.28:0/2913624873 shutdown_connections 2026-02-20T03:32:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 --2- 10.20.193.28:0/2913624873 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57d01030a0 0x7f57d010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 --2- 10.20.193.28:0/2913624873 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d0102700 0x7f57d0102b60 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 --2- 10.20.193.28:0/2913624873 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57d0108700 0x7f57d0108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- 10.20.193.28:0/2913624873 >> 10.20.193.28:0/2913624873 conn(0x7f57d00fe3e0 msgr2=0x7f57d0100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- 10.20.193.28:0/2913624873 shutdown_connections 2026-02-20T03:32:25.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- 10.20.193.28:0/2913624873 wait complete. 2026-02-20T03:32:25.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 Processor -- start 2026-02-20T03:32:25.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- start start 2026-02-20T03:32:25.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57d0102700 0x7f57d010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d01030a0 0x7f57d010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57d0108700 0x7f57d01a6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57d0112a50 con 0x7f57d01030a0 2026-02-20T03:32:25.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f57d01128d0 con 0x7f57d0108700 2026-02-20T03:32:25.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f57d0112bd0 con 0x7f57d0102700 2026-02-20T03:32:25.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57ce7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d01030a0 0x7f57d010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:25.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57ce7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d01030a0 0x7f57d010dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56050/0 (socket says 10.20.193.28:56050) 2026-02-20T03:32:25.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57ce7fc640 1 -- 10.20.193.28:0/1255307138 learned_addr learned my addr 10.20.193.28:0/1255307138 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:25.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57ce7fc640 1 -- 10.20.193.28:0/1255307138 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57d0102700 msgr2=0x7f57d010d960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:32:25.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57ce7fc640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57d0102700 0x7f57d010d960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57ce7fc640 1 -- 10.20.193.28:0/1255307138 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57d0108700 msgr2=0x7f57d01a6090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:32:25.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57ce7fc640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57d0108700 0x7f57d01a6090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57ce7fc640 1 -- 10.20.193.28:0/1255307138 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d01a6810 con 0x7f57d01030a0 2026-02-20T03:32:25.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57ce7fc640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d01030a0 0x7f57d010dea0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f57c402f7a0 tx=0x7f57c402fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:25.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57d48e0640 1 -- 10.20.193.28:0/1255307138 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c402fe50 con 0x7f57d01030a0 2026-02-20T03:32:25.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57d48e0640 1 -- 10.20.193.28:0/1255307138 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f57c4005030 con 0x7f57d01030a0 2026-02-20T03:32:25.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57d48e0640 1 -- 10.20.193.28:0/1255307138 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c4004cf0 con 0x7f57d01030a0 2026-02-20T03:32:25.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- 10.20.193.28:0/1255307138 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d01a6aa0 con 0x7f57d01030a0 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57cffff640 1 -- 10.20.193.28:0/1255307138 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d006c890 con 0x7f57d01030a0 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57d48e0640 1 -- 10.20.193.28:0/1255307138 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f57c40051e0 con 0x7f57d01030a0 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.628+0000 7f57d7de7e00 1 Processor -- start 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- start start 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554af000 0x562e554af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 0x562e554a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562e55429e50 con 0x562e554a9fb0 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562e553fc9c0 con 0x562e554af000 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562e553aa240 con 0x562e554a9630 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57ce7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57ce7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56058/0 (socket says 10.20.193.28:56058) 2026-02-20T03:32:25.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57ce7fc640 1 -- 10.20.193.28:0/3324051386 learned_addr learned my addr 10.20.193.28:0/3324051386 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57ce7fc640 1 -- 10.20.193.28:0/3324051386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 msgr2=0x562e554a9a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57ce7fc640 1 --2- 10.20.193.28:0/3324051386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 0x562e554a9a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57ce7fc640 1 -- 10.20.193.28:0/3324051386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554af000 msgr2=0x562e554af3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57ce7fc640 1 --2- 10.20.193.28:0/3324051386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554af000 0x562e554af3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57ce7fc640 1 -- 10.20.193.28:0/3324051386 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e553bd420 con 0x562e554a9fb0 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57ce7fc640 1 --2- 10.20.193.28:0/3324051386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554b5e30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f57c410d450 tx=0x7f57c410d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d867b9cba232d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d48e0640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57a40b0fc0 0x7f57a40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d48e0640 1 -- 10.20.193.28:0/1255307138 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f57c4104dd0 con 0x7f57d01030a0 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f5793fff640 1 -- 10.20.193.28:0/3324051386 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c40c8720 con 0x562e554a9fb0 2026-02-20T03:32:25.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f5793fff640 1 -- 10.20.193.28:0/3324051386 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f57c4041330 con 0x562e554a9fb0 2026-02-20T03:32:25.644 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f5793fff640 1 -- 10.20.193.28:0/3324051386 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c40cbfd0 con 0x562e554a9fb0 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57cf7fe640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57a40b0fc0 0x7f57a40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3324051386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 msgr2=0x562e554b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3324051386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554b5e30 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f57c410d450 tx=0x7f57c410d920 comp rx=0 tx=0).stop 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3324051386 shutdown_connections 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3324051386 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554b5e30 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3324051386 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 0x562e554a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3324051386 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554af000 0x562e554af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3324051386 >> 10.20.193.28:0/3324051386 conn(0x562e5546c290 msgr2=0x562e554a7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57cf7fe640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57a40b0fc0 0x7f57a40b3480 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f57c000aab0 tx=0x7f57c0009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3324051386 shutdown_connections 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3324051386 wait complete. 2026-02-20T03:32:25.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- start start 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 Processor -- start 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554a9630 0x562e554c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9fb0 0x562e554c4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554c2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562e553f88f0 con 0x562e554af000 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562e551eaf50 con 0x562e554a9630 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562e554c2790 con 0x562e554a9fb0 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57cf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57cf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56070/0 (socket says 10.20.193.28:56070) 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.634+0000 7f57cf7fe640 1 -- 10.20.193.28:0/3053059486 learned_addr learned my addr 10.20.193.28:0/3053059486 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57cf7fe640 1 -- 10.20.193.28:0/3053059486 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9fb0 msgr2=0x562e554c4300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57cf7fe640 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9fb0 0x562e554c4300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57cf7fe640 1 -- 10.20.193.28:0/3053059486 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554a9630 msgr2=0x562e554c3dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:25.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57cf7fe640 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554a9630 0x562e554c3dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57cf7fe640 1 -- 10.20.193.28:0/3053059486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e554bb7f0 con 0x562e554af000 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57cf7fe640 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554c2250 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f57c0004380 tx=0x7f57c0004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9864be0b9aa571 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57917fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57917fa640 1 -- 10.20.193.28:0/3053059486 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0006e60 con 0x562e554af000 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57917fa640 1 -- 10.20.193.28:0/3053059486 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f57c001f020 con 0x562e554af000 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57917fa640 1 -- 10.20.193.28:0/3053059486 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c001ae30 con 0x562e554af000 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3053059486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e551cdb40 con 0x562e554af000 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 10 client.20352 _ll_register_callbacks cb 0x562e55435f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3053059486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e5540a1a0 con 0x562e554af000 2026-02-20T03:32:25.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57917fa640 1 -- 10.20.193.28:0/3053059486 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f57c001a430 con 0x562e554af000 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57917fa640 1 -- 10.20.193.28:0/3053059486 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f57c001e020 con 0x562e554af000 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 10 client.20352 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3053059486 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x562e553b7230 con 0x562e554af000 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57917fa640 1 -- 10.20.193.28:0/3053059486 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f57c001a630 con 0x562e554af000 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 10 client.20352 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 10 client.20352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 20 client.20352 populate_metadata read hostname 'trial028' 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562e554d24b0 0x562e554d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 4 client.20352 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:25.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.639+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3053059486 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e554045b0 con 0x562e554d24b0 2026-02-20T03:32:25.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.667+0000 7f57ceffd640 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562e554d24b0 0x562e554d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:25.704 INFO:tasks.workunit.client.0.trial028.stdout: 10 83985 10.67 MB/sec execute 116 sec latency 96189.890 ms 2026-02-20T03:32:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:25 trial177 ceph-mon[43181]: pgmap v717: 129 pgs: 129 active+clean; 489 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 216 KiB/s rd, 224 KiB/s wr, 112 op/s 2026-02-20T03:32:25.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57ceffd640 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562e554d24b0 0x562e554d4940 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=139f8e4351ebffcb server_cookie=49d7224ceebea399 in_seq=0 out_seq=0 2026-02-20T03:32:25.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57917fa640 10 client.20352 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:25.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57917fa640 1 -- 10.20.193.28:0/3053059486 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562e554045b0 con 0x562e554d24b0 2026-02-20T03:32:25.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57917fa640 10 client.20352 handle_command_reply: tid=0 2026-02-20T03:32:25.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 client.20352 shutdown 2026-02-20T03:32:25.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3053059486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 msgr2=0x562e554c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:25.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554c2250 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f57c0004380 tx=0x7f57c0004bd0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3053059486 shutdown_connections 2026-02-20T03:32:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562e554d24b0 0x562e554d4940 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554c2250 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9fb0 0x562e554c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3053059486 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554a9630 0x562e554c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3053059486 >> 10.20.193.28:0/3053059486 conn(0x562e5546c290 msgr2=0x562e554a8440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57917fa640 0 client.20352 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3053059486 shutdown_connections 2026-02-20T03:32:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3053059486 wait complete. 2026-02-20T03:32:25.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.721+0000 7f57d7de7e00 20 client.20352 trim_cache size 0 max 16384 2026-02-20T03:32:25.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 Processor -- start 2026-02-20T03:32:25.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- start start 2026-02-20T03:32:25.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 0x562e554bf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554af000 0x562e554da2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f57740126f0 con 0x562e554a9fb0 2026-02-20T03:32:25.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f577400ffc0 con 0x562e554af000 2026-02-20T03:32:25.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f577400de10 con 0x562e554a9630 2026-02-20T03:32:25.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57ce7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:25.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57ce7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554bfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56086/0 (socket says 10.20.193.28:56086) 2026-02-20T03:32:25.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57ce7fc640 1 -- 10.20.193.28:0/2765903089 learned_addr learned my addr 10.20.193.28:0/2765903089 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:25.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57ce7fc640 1 -- 10.20.193.28:0/2765903089 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 msgr2=0x562e554bf680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:25.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57ce7fc640 1 --2- 10.20.193.28:0/2765903089 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 0x562e554bf680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57ce7fc640 1 -- 10.20.193.28:0/2765903089 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554af000 msgr2=0x562e554da2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:25.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57ce7fc640 1 --2- 10.20.193.28:0/2765903089 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554af000 0x562e554da2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57ce7fc640 1 -- 10.20.193.28:0/2765903089 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e554bb620 con 0x562e554a9fb0 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57ce7fc640 1 --2- 10.20.193.28:0/2765903089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554bfbc0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f57c40c9ad0 tx=0x7f57c4002ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbfae11cf7e469e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57937fe640 1 -- 10.20.193.28:0/2765903089 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c40cc1b0 con 0x562e554a9fb0 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57937fe640 1 -- 10.20.193.28:0/2765903089 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f57c4033070 con 0x562e554a9fb0 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57937fe640 1 -- 10.20.193.28:0/2765903089 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c40cc880 con 0x562e554a9fb0 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- 10.20.193.28:0/2765903089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 msgr2=0x562e554bfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/2765903089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554bfbc0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f57c40c9ad0 tx=0x7f57c4002ae0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- 10.20.193.28:0/2765903089 shutdown_connections 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/2765903089 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554af000 0x562e554da2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/2765903089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554a9fb0 0x562e554bfbc0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/2765903089 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 0x562e554bf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- 10.20.193.28:0/2765903089 >> 10.20.193.28:0/2765903089 conn(0x562e5546c290 msgr2=0x562e554c0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:25.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- 10.20.193.28:0/2765903089 shutdown_connections 2026-02-20T03:32:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- 10.20.193.28:0/2765903089 wait complete. 2026-02-20T03:32:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- start start 2026-02-20T03:32:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 Processor -- start 2026-02-20T03:32:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 0x562e554cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554a9fb0 0x562e554cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f577400e480 con 0x562e554af000 2026-02-20T03:32:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f577400f8f0 con 0x562e554a9fb0 2026-02-20T03:32:25.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f577400eb50 con 0x562e554a9630 2026-02-20T03:32:25.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57cf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:25.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57cf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56094/0 (socket says 10.20.193.28:56094) 2026-02-20T03:32:25.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57cf7fe640 1 -- 10.20.193.28:0/3129456409 learned_addr learned my addr 10.20.193.28:0/3129456409 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:25.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57cf7fe640 1 -- 10.20.193.28:0/3129456409 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 msgr2=0x562e554cb120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57cf7fe640 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 0x562e554cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57cf7fe640 1 -- 10.20.193.28:0/3129456409 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554a9fb0 msgr2=0x562e554cb660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57cf7fe640 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554a9fb0 0x562e554cb660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57cf7fe640 1 -- 10.20.193.28:0/3129456409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e550db870 con 0x562e554af000 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57cf7fe640 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554cbba0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d9a0 tx=0x7f57c000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35880a4c16cb5ea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57917fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57917fa640 1 -- 10.20.193.28:0/3129456409 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0037070 con 0x562e554af000 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57917fa640 1 -- 10.20.193.28:0/3129456409 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x562e5540a1a0 con 0x562e554af000 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3129456409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e5539c440 con 0x562e554af000 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57917fa640 1 -- 10.20.193.28:0/3129456409 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0024b40 con 0x562e554af000 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 10 client.20358 _ll_register_callbacks cb 0x7f57c0002b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3129456409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562e553aeb00 con 0x562e554af000 2026-02-20T03:32:25.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57917fa640 1 -- 10.20.193.28:0/3129456409 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f57c0024ce0 con 0x562e554af000 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57917fa640 1 -- 10.20.193.28:0/3129456409 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f57c0041060 con 0x562e554af000 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 10 client.20358 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3129456409 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x562e554bc310 con 0x562e554af000 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57917fa640 1 -- 10.20.193.28:0/3129456409 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f57c001a9a0 con 0x562e554af000 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 10 client.20358 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 10 client.20358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 20 client.20358 populate_metadata read hostname 'trial028' 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562e5553eac0 0x562e55540f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 4 client.20358 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.731+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3129456409 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f57c4041330 con 0x562e5553eac0 2026-02-20T03:32:25.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.744+0000 7f57ceffd640 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562e5553eac0 0x562e55540f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:25.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.797+0000 7f57ceffd640 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562e5553eac0 0x562e55540f80 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57451af196c4be6c server_cookie=c0ad77f5f68aa397 in_seq=0 out_seq=0 2026-02-20T03:32:25.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.797+0000 7f57917fa640 10 client.20358 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57917fa640 1 -- 10.20.193.28:0/3129456409 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f57c4041330 con 0x562e5553eac0 2026-02-20T03:32:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57917fa640 10 client.20358 handle_command_reply: tid=0 2026-02-20T03:32:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 client.20358 shutdown 2026-02-20T03:32:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3129456409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 msgr2=0x562e554cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:25.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554cbba0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d9a0 tx=0x7f57c000d9d0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3129456409 shutdown_connections 2026-02-20T03:32:25.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562e5553eac0 0x562e55540f80 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562e554af000 0x562e554cbba0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562e554a9fb0 0x562e554cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 --2- 10.20.193.28:0/3129456409 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562e554a9630 0x562e554cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3129456409 >> 10.20.193.28:0/3129456409 conn(0x562e5546c290 msgr2=0x562e554d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:25.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57917fa640 0 client.20358 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:25.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3129456409 shutdown_connections 2026-02-20T03:32:25.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 1 -- 10.20.193.28:0/3129456409 wait complete. 2026-02-20T03:32:25.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57d7de7e00 20 client.20358 trim_cache size 0 max 16384 2026-02-20T03:32:25.826 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:32:25.826 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:32:25.826 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:32:25.826 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:32:25.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 -- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57a40b0fc0 msgr2=0x7f57a40b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:25.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57a40b0fc0 0x7f57a40b3480 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f57c000aab0 tx=0x7f57c0009250 comp rx=0 tx=0).stop 2026-02-20T03:32:25.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 -- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d01030a0 msgr2=0x7f57d010dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:25.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d01030a0 0x7f57d010dea0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f57c402f7a0 tx=0x7f57c402fce0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 -- 10.20.193.28:0/1255307138 shutdown_connections 2026-02-20T03:32:25.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f57a40b0fc0 0x7f57a40b3480 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f57d0108700 0x7f57d01a6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f57d01030a0 0x7f57d010dea0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 --2- 10.20.193.28:0/1255307138 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f57d0102700 0x7f57d010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:25.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 -- 10.20.193.28:0/1255307138 >> 10.20.193.28:0/1255307138 conn(0x7f57d00fe3e0 msgr2=0x7f57d00756e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:25.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 -- 10.20.193.28:0/1255307138 shutdown_connections 2026-02-20T03:32:25.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:25.811+0000 7f57cffff640 1 -- 10.20.193.28:0/1255307138 wait complete. 2026-02-20T03:32:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:25 trial126 ceph-mon[38476]: pgmap v717: 129 pgs: 129 active+clean; 489 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 216 KiB/s rd, 224 KiB/s wr, 112 op/s 2026-02-20T03:32:25.974 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:32:25.975 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:32:26.294 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:32:26.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.505+0000 7f70fbfff640 1 -- 10.20.193.28:0/3767105336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f70fc077f40 msgr2=0x7f70fc113300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.505+0000 7f70fbfff640 1 --2- 10.20.193.28:0/3767105336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f70fc077f40 0x7f70fc113300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009a30 tx=0x7f70e402f220 comp rx=0 tx=0).stop 2026-02-20T03:32:26.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.506+0000 7f70fbfff640 1 -- 10.20.193.28:0/3767105336 shutdown_connections 2026-02-20T03:32:26.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.506+0000 7f70fbfff640 1 --2- 10.20.193.28:0/3767105336 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70fc113840 0x7f70fc115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.506+0000 7f70fbfff640 1 --2- 10.20.193.28:0/3767105336 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f70fc077f40 0x7f70fc113300 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.506+0000 7f70fbfff640 1 --2- 10.20.193.28:0/3767105336 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f70fc077620 0x7f70fc077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.506+0000 7f70fbfff640 1 -- 10.20.193.28:0/3767105336 >> 10.20.193.28:0/3767105336 conn(0x7f70fc1006c0 msgr2=0x7f70fc102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:26.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.506+0000 7f70fbfff640 1 -- 10.20.193.28:0/3767105336 shutdown_connections 2026-02-20T03:32:26.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.506+0000 7f70fbfff640 1 -- 10.20.193.28:0/3767105336 wait complete. 2026-02-20T03:32:26.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.507+0000 7f70fbfff640 1 Processor -- start 2026-02-20T03:32:26.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.507+0000 7f70fbfff640 1 -- start start 2026-02-20T03:32:26.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.507+0000 7f70fbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70fc077620 0x7f70fc074620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.507+0000 7f70fbfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f70fc077f40 0x7f70fc074b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fbfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f70fc113840 0x7f70fc06d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1190a0 con 0x7f70fc077620 2026-02-20T03:32:26.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fbfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc118f20 con 0x7f70fc077f40 2026-02-20T03:32:26.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fbfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc119220 con 0x7f70fc113840 2026-02-20T03:32:26.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fa7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f70fc077f40 0x7f70fc074b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fa7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f70fc077f40 0x7f70fc074b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36934/0 (socket says 10.20.193.28:36934) 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fa7fc640 1 -- 10.20.193.28:0/1898575132 learned_addr learned my addr 10.20.193.28:0/1898575132 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fa7fc640 1 -- 10.20.193.28:0/1898575132 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f70fc113840 msgr2=0x7f70fc06d730 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fa7fc640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f70fc113840 0x7f70fc06d730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fa7fc640 1 -- 10.20.193.28:0/1898575132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70fc077620 msgr2=0x7f70fc074620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fa7fc640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70fc077620 0x7f70fc074620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fa7fc640 1 -- 10.20.193.28:0/1898575132 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70fc06dff0 con 0x7f70fc077f40 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f70fa7fc640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f70fc077f40 0x7f70fc074b60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009b60 tx=0x7f70e4004600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f710096a640 1 -- 10.20.193.28:0/1898575132 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4046070 con 0x7f70fc077f40 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.508+0000 7f710096a640 1 -- 10.20.193.28:0/1898575132 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f70e403e070 con 0x7f70fc077f40 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.509+0000 7f710096a640 1 -- 10.20.193.28:0/1898575132 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e402fc80 con 0x7f70fc077f40 2026-02-20T03:32:26.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.509+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70fc06e280 con 0x7f70fc077f40 2026-02-20T03:32:26.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.509+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70fc072320 con 0x7f70fc077f40 2026-02-20T03:32:26.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.509+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70fc078d60 con 0x7f70fc077f40 2026-02-20T03:32:26.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.512+0000 7f710096a640 1 -- 10.20.193.28:0/1898575132 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f70e4041870 con 0x7f70fc077f40 2026-02-20T03:32:26.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.514+0000 7f710096a640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70d00b0e20 0x7f70d00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.514+0000 7f710096a640 1 -- 10.20.193.28:0/1898575132 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f70e4105240 con 0x7f70fc077f40 2026-02-20T03:32:26.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.514+0000 7f710096a640 1 -- 10.20.193.28:0/1898575132 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f70e402fe20 con 0x7f70fc077f40 2026-02-20T03:32:26.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.514+0000 7f70faffd640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70d00b0e20 0x7f70d00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.515+0000 7f70faffd640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70d00b0e20 0x7f70d00b32e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f70f00059c0 tx=0x7f70f0005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:26.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.531+0000 7fdda1ca3640 1 -- 10.20.193.28:0/1340333072 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd9c073ed0 msgr2=0x7fdd9c10c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.531+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/1340333072 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd9c073ed0 0x7fdd9c10c720 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009a30 tx=0x7fdd8402f220 comp rx=0 tx=0).stop 2026-02-20T03:32:26.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.532+0000 7fdda1ca3640 1 -- 10.20.193.28:0/1340333072 shutdown_connections 2026-02-20T03:32:26.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.532+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/1340333072 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd9c10cc60 0x7fdd9c10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.532+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/1340333072 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd9c073ed0 0x7fdd9c10c720 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.532+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/1340333072 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd9c073590 0x7fdd9c073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.532+0000 7fdda1ca3640 1 -- 10.20.193.28:0/1340333072 >> 10.20.193.28:0/1340333072 conn(0x7fdd9c06f610 msgr2=0x7fdd9c071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:26.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.532+0000 7fdda1ca3640 1 -- 10.20.193.28:0/1340333072 shutdown_connections 2026-02-20T03:32:26.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.532+0000 7fdda1ca3640 1 -- 10.20.193.28:0/1340333072 wait complete. 2026-02-20T03:32:26.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.532+0000 7fdda1ca3640 1 Processor -- start 2026-02-20T03:32:26.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda1ca3640 1 -- start start 2026-02-20T03:32:26.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda1ca3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd9c073590 0x7fdd9c11a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda1ca3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd9c073ed0 0x7fdd9c11a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda1ca3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd9c10cc60 0x7fdd9c11f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda1ca3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c10ed50 con 0x7fdd9c073590 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda1ca3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c10ebd0 con 0x7fdd9c073ed0 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda1ca3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9c10eed0 con 0x7fdd9c10cc60 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda14a2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd9c10cc60 0x7fdd9c11f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda14a2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd9c10cc60 0x7fdd9c11f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50324/0 (socket says 10.20.193.28:50324) 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda14a2640 1 -- 10.20.193.28:0/4114732501 learned_addr learned my addr 10.20.193.28:0/4114732501 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.533+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd9c073590 0x7fdd9c11a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdda0ca1640 1 -- 10.20.193.28:0/4114732501 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd9c10cc60 msgr2=0x7fdd9c11f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd9c10cc60 0x7fdd9c11f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdda0ca1640 1 -- 10.20.193.28:0/4114732501 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd9c073ed0 msgr2=0x7fdd9c11a7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-20T03:32:26.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd9c073ed0 0x7fdd9c11a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdda0ca1640 1 -- 10.20.193.28:0/4114732501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9c11ff20 con 0x7fdd9c073590 2026-02-20T03:32:26.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd9c073590 0x7fdd9c11a280 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e9f0 tx=0x7fdd8c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:26.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdd91ffb640 1 -- 10.20.193.28:0/4114732501 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00cd80 con 0x7fdd9c073590 2026-02-20T03:32:26.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdd91ffb640 1 -- 10.20.193.28:0/4114732501 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdd8c004570 con 0x7fdd9c073590 2026-02-20T03:32:26.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdd91ffb640 1 -- 10.20.193.28:0/4114732501 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c010690 con 0x7fdd9c073590 2026-02-20T03:32:26.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdda1ca3640 1 -- 10.20.193.28:0/4114732501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd9c1ba370 con 0x7fdd9c073590 2026-02-20T03:32:26.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.534+0000 7fdda1ca3640 1 -- 10.20.193.28:0/4114732501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd9c1ba780 con 0x7fdd9c073590 2026-02-20T03:32:26.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.540+0000 7fdd91ffb640 1 -- 10.20.193.28:0/4114732501 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fdd8c020030 con 0x7fdd9c073590 2026-02-20T03:32:26.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.542+0000 7fdd91ffb640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd700b0e20 0x7fdd700b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.542+0000 7fdd91ffb640 1 -- 10.20.193.28:0/4114732501 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fdd8c0e0b50 con 0x7fdd9c073590 2026-02-20T03:32:26.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.542+0000 7fdd93fff640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd700b0e20 0x7fdd700b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.544+0000 7fdda5e61e00 1 Processor -- start 2026-02-20T03:32:26.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.545+0000 7fdda5e61e00 1 -- start start 2026-02-20T03:32:26.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.545+0000 7fdd93fff640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd700b0e20 0x7fdd700b32e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdd84002e20 tx=0x7fdd84002d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:26.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.545+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780faff070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.545+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780faff5b0 0x55780fb03fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.545+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb06a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.545+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55780fa4f8f0 con 0x55780fafec50 2026-02-20T03:32:26.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.545+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55780f9fd2e0 con 0x55780fb04600 2026-02-20T03:32:26.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.545+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55780fa4b820 con 0x55780faff5b0 2026-02-20T03:32:26.549 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.546+0000 7fdda14a2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb06a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.546+0000 7fdda14a2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb06a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36952/0 (socket says 10.20.193.28:36952) 2026-02-20T03:32:26.551 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.546+0000 7fdda14a2640 1 -- 10.20.193.28:0/1169471422 learned_addr learned my addr 10.20.193.28:0/1169471422 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.546+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780faff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.546+0000 7fdd93fff640 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780faff5b0 0x55780fb03fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdd93fff640 1 -- 10.20.193.28:0/1169471422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 msgr2=0x55780fb06a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdd93fff640 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb06a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdd93fff640 1 -- 10.20.193.28:0/1169471422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 msgr2=0x55780faff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdd93fff640 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780faff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdd93fff640 1 -- 10.20.193.28:0/1169471422 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780f9ef5a0 con 0x55780faff5b0 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdda14a2640 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb06a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780faff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdd93fff640 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780faff5b0 0x55780fb03fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd84002bf0 tx=0x7fdd8403e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f595da06ac23b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:26.552 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdd68ffe640 1 -- 10.20.193.28:0/1169471422 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8402fc80 con 0x55780faff5b0 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdd68ffe640 1 -- 10.20.193.28:0/1169471422 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdd8403e070 con 0x55780faff5b0 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.547+0000 7fdd68ffe640 1 -- 10.20.193.28:0/1169471422 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84042960 con 0x55780faff5b0 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.548+0000 7fdda5e61e00 1 -- 10.20.193.28:0/1169471422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780faff5b0 msgr2=0x55780fb03fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.548+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780faff5b0 0x55780fb03fe0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdd84002bf0 tx=0x7fdd8403e000 comp rx=0 tx=0).stop 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.548+0000 7fdda5e61e00 1 -- 10.20.193.28:0/1169471422 shutdown_connections 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.548+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb06a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.548+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780faff5b0 0x55780fb03fe0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.548+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/1169471422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780faff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.548+0000 7fdda5e61e00 1 -- 10.20.193.28:0/1169471422 >> 10.20.193.28:0/1169471422 conn(0x55780faf62d0 msgr2=0x55780fafd150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.548+0000 7fdda5e61e00 1 -- 10.20.193.28:0/1169471422 shutdown_connections 2026-02-20T03:32:26.553 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.548+0000 7fdda5e61e00 1 -- 10.20.193.28:0/1169471422 wait complete. 2026-02-20T03:32:26.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.549+0000 7fdda5e61e00 1 -- start start 2026-02-20T03:32:26.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdda5e61e00 1 Processor -- start 2026-02-20T03:32:26.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb17830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780faff5b0 0x55780fb17d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb1ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55780f9f70c0 con 0x55780faff5b0 2026-02-20T03:32:26.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55780fb07590 con 0x55780fb04600 2026-02-20T03:32:26.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55780fb1f280 con 0x55780fafec50 2026-02-20T03:32:26.556 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdd93fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780faff5b0 0x55780fb17d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdda0ca1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb17830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdd93fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780faff5b0 0x55780fb17d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52390/0 (socket says 10.20.193.28:52390) 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdd93fff640 1 -- 10.20.193.28:0/3577464375 learned_addr learned my addr 10.20.193.28:0/3577464375 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.550+0000 7fdda14a2640 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb1ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdda0ca1640 1 -- 10.20.193.28:0/3577464375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 msgr2=0x55780fb1ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb1ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdda0ca1640 1 -- 10.20.193.28:0/3577464375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780faff5b0 msgr2=0x55780fb17d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780faff5b0 0x55780fb17d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdda0ca1640 1 -- 10.20.193.28:0/3577464375 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780fb10f60 con 0x55780fafec50 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb17830 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c6a0 tx=0x7fdd8c0acd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=263963f56abe2ff9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:26.557 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdd61ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdd61ffb640 1 -- 10.20.193.28:0/3577464375 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0a9b60 con 0x55780fafec50 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdd61ffb640 1 -- 10.20.193.28:0/3577464375 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdd8c0a7840 con 0x55780fafec50 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdd61ffb640 1 -- 10.20.193.28:0/3577464375 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0a7510 con 0x55780fafec50 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3577464375 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55780fa0b820 con 0x55780fafec50 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdd61ffb640 1 -- 10.20.193.28:0/3577464375 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fdd8c0b0fd0 con 0x55780fafec50 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.551+0000 7fdd61ffb640 10 client.28228 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 10 client.28228 _ll_register_callbacks cb 0x55780f9faff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3577464375 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55780fa574e0 con 0x55780fafec50 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdd61ffb640 1 -- 10.20.193.28:0/3577464375 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fdd8c0a79f0 con 0x55780fafec50 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 10 client.28228 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3577464375 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55780fa10380 con 0x55780fafec50 2026-02-20T03:32:26.558 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdd61ffb640 1 -- 10.20.193.28:0/3577464375 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7fdd8c0b11d0 con 0x55780fafec50 2026-02-20T03:32:26.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 10 client.28228 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:26.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 10 client.28228 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:26.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 20 client.28228 populate_metadata read hostname 'trial028' 2026-02-20T03:32:26.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55780fb23500 0x55780fb25990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 4 client.28228 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:26.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.552+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3577464375 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55780f9d1bd0 con 0x55780fb23500 2026-02-20T03:32:26.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.553+0000 7fdd93fff640 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55780fb23500 0x55780fb25990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.553+0000 7fdd93fff640 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55780fb23500 0x55780fb25990 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b3e050c9c837a5b server_cookie=c0747d103daeac86 in_seq=0 out_seq=0 2026-02-20T03:32:26.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.553+0000 7fdd61ffb640 10 client.28228 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:26.560 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdd61ffb640 1 -- 10.20.193.28:0/3577464375 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55780f9d1bd0 con 0x55780fb23500 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdd61ffb640 10 client.28228 handle_command_reply: tid=0 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 client.28228 shutdown 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3577464375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 msgr2=0x55780fb17830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb17830 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c6a0 tx=0x7fdd8c0acd30 comp rx=0 tx=0).stop 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3577464375 shutdown_connections 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55780fb23500 0x55780fb25990 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780fb04600 0x55780fb1ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780faff5b0 0x55780fb17d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdd61ffb640 0 client.28228 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3577464375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb17830 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3577464375 >> 10.20.193.28:0/3577464375 conn(0x55780faf62d0 msgr2=0x55780fb05950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:26.561 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3577464375 shutdown_connections 2026-02-20T03:32:26.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3577464375 wait complete. 2026-02-20T03:32:26.562 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.555+0000 7fdda5e61e00 20 client.28228 trim_cache size 0 max 16384 2026-02-20T03:32:26.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.565+0000 7fdda5e61e00 1 Processor -- start 2026-02-20T03:32:26.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.565+0000 7fdda5e61e00 1 -- start start 2026-02-20T03:32:26.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.565+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780fafff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.565+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.565+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fb04600 0x55780fb00490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.565+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400126f0 con 0x55780fafec50 2026-02-20T03:32:26.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.565+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4000ffc0 con 0x55780faff5b0 2026-02-20T03:32:26.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.565+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4000de10 con 0x55780fb04600 2026-02-20T03:32:26.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdda0ca1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780fafff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdda14a2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fb04600 0x55780fb00490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.570 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdda14a2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fb04600 0x55780fb00490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50366/0 (socket says 10.20.193.28:50366) 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdda14a2640 1 -- 10.20.193.28:0/3057782474 learned_addr learned my addr 10.20.193.28:0/3057782474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdd93fff640 1 --2- 10.20.193.28:0/3057782474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdda0ca1640 1 -- 10.20.193.28:0/3057782474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fb04600 msgr2=0x55780fb00490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/3057782474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fb04600 0x55780fb00490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdda0ca1640 1 -- 10.20.193.28:0/3057782474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 msgr2=0x55780fb1ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/3057782474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdda0ca1640 1 -- 10.20.193.28:0/3057782474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780fb10d90 con 0x55780fafec50 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.566+0000 7fdd93fff640 1 --2- 10.20.193.28:0/3057782474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/3057782474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780fafff50 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0a5850 tx=0x7fdd8c0cc000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e84de31502faec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdd63fff640 1 -- 10.20.193.28:0/3057782474 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0a7840 con 0x55780fafec50 2026-02-20T03:32:26.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdd63fff640 1 -- 10.20.193.28:0/3057782474 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55780fa574e0 con 0x55780fafec50 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdd63fff640 1 -- 10.20.193.28:0/3057782474 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0b1300 con 0x55780fafec50 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3057782474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 msgr2=0x55780fafff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3057782474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780fafff50 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0a5850 tx=0x7fdd8c0cc000 comp rx=0 tx=0).stop 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3057782474 shutdown_connections 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3057782474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fb04600 0x55780fb00490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3057782474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/3057782474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fafec50 0x55780fafff50 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3057782474 >> 10.20.193.28:0/3057782474 conn(0x55780faf62d0 msgr2=0x55780fafd150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3057782474 shutdown_connections 2026-02-20T03:32:26.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.567+0000 7fdda5e61e00 1 -- 10.20.193.28:0/3057782474 wait complete. 2026-02-20T03:32:26.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.568+0000 7fdda5e61e00 1 -- start start 2026-02-20T03:32:26.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.568+0000 7fdda5e61e00 1 Processor -- start 2026-02-20T03:32:26.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb1cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda5e61e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fb04600 0x55780fb1e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4000e480 con 0x55780fb04600 2026-02-20T03:32:26.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4000f8f0 con 0x55780faff5b0 2026-02-20T03:32:26.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda5e61e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4000eb50 con 0x55780fafec50 2026-02-20T03:32:26.575 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdd93fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdd93fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36968/0 (socket says 10.20.193.28:36968) 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdd93fff640 1 -- 10.20.193.28:0/620235368 learned_addr learned my addr 10.20.193.28:0/620235368 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda14a2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fb04600 0x55780fb1e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb1cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda14a2640 1 -- 10.20.193.28:0/620235368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 msgr2=0x55780fb1cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda14a2640 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb1cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda14a2640 1 -- 10.20.193.28:0/620235368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 msgr2=0x55780fb1d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda14a2640 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.569+0000 7fdda14a2640 1 -- 10.20.193.28:0/620235368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55780f7af690 con 0x55780fb04600 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb1cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdda14a2640 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fb04600 0x55780fb1e1d0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fdd98007db0 tx=0x7fdd980146f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f01b301d558008 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:26.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdd61ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdd61ffb640 1 -- 10.20.193.28:0/620235368 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9801a070 con 0x55780fb04600 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdd61ffb640 1 -- 10.20.193.28:0/620235368 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdd98002c60 con 0x55780fb04600 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdd61ffb640 1 -- 10.20.193.28:0/620235368 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98016900 con 0x55780fb04600 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdda5e61e00 1 -- 10.20.193.28:0/620235368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55780fa14b70 con 0x55780fb04600 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdd61ffb640 1 -- 10.20.193.28:0/620235368 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fdd98004690 con 0x55780fb04600 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdda5e61e00 10 client.20376 _ll_register_callbacks cb 0x7fdd8c0a8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdda5e61e00 1 -- 10.20.193.28:0/620235368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd8403e070 con 0x55780fb04600 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdd61ffb640 1 -- 10.20.193.28:0/620235368 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fdd98024060 con 0x55780fb04600 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdda5e61e00 10 client.20376 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.570+0000 7fdda5e61e00 1 -- 10.20.193.28:0/620235368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55780fb11a80 con 0x55780fb04600 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.571+0000 7fdd61ffb640 1 -- 10.20.193.28:0/620235368 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7fdd98016aa0 con 0x55780fb04600 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.571+0000 7fdda5e61e00 10 client.20376 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:26.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.571+0000 7fdda5e61e00 10 client.20376 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:26.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.571+0000 7fdda5e61e00 20 client.20376 populate_metadata read hostname 'trial028' 2026-02-20T03:32:26.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.571+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55780fb8f120 0x55780fb915e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:26.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.571+0000 7fdda5e61e00 4 client.20376 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:32:26.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.571+0000 7fdda5e61e00 1 -- 10.20.193.28:0/620235368 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55780f828520 con 0x55780fb8f120 2026-02-20T03:32:26.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.571+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55780fb8f120 0x55780fb915e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:26.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.572+0000 7fdda0ca1640 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55780fb8f120 0x55780fb915e0 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9c56e087a6397d3 server_cookie=236ab0b1d54561a in_seq=0 out_seq=0 2026-02-20T03:32:26.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.572+0000 7fdd61ffb640 10 client.20376 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:26.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.627+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70fc072e00 con 0x7f70fc077f40 2026-02-20T03:32:26.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.633+0000 7f710096a640 1 -- 10.20.193.28:0/1898575132 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11921 (secure 0 0 0) 0x7f70e40cd6b0 con 0x7f70fc077f40 2026-02-20T03:32:26.636 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:32:26.636 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":42,"btime":"2026-02-20T03:31:48:222781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":42,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:31:47.396179+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28114":{"gid":28114,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/1701826560","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":1701826560},{"type":"v1","addr":"10.20.193.177:6837","nonce":1701826560}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:32:26.636 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 42 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70d00b0e20 msgr2=0x7f70d00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70d00b0e20 0x7f70d00b32e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f70f00059c0 tx=0x7f70f0005950 comp rx=0 tx=0).stop 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f70fc077f40 msgr2=0x7f70fc074b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f70fc077f40 0x7f70fc074b60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009b60 tx=0x7f70e4004600 comp rx=0 tx=0).stop 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 shutdown_connections 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f70d00b0e20 0x7f70d00b32e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f70fc113840 0x7f70fc06d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f70fc077f40 0x7f70fc074b60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 --2- 10.20.193.28:0/1898575132 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f70fc077620 0x7f70fc074620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 >> 10.20.193.28:0/1898575132 conn(0x7f70fc1006c0 msgr2=0x7f70fc102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 shutdown_connections 2026-02-20T03:32:26.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:26.635+0000 7f70fbfff640 1 -- 10.20.193.28:0/1898575132 wait complete. 2026-02-20T03:32:26.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdd61ffb640 1 -- 10.20.193.28:0/620235368 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55780f828520 con 0x55780fb8f120 2026-02-20T03:32:26.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdd61ffb640 10 client.20376 handle_command_reply: tid=0 2026-02-20T03:32:26.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdda5e61e00 1 client.20376 shutdown 2026-02-20T03:32:26.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdda5e61e00 1 -- 10.20.193.28:0/620235368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fb04600 msgr2=0x55780fb1e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fb04600 0x55780fb1e1d0 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fdd98007db0 tx=0x7fdd980146f0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdda5e61e00 1 -- 10.20.193.28:0/620235368 shutdown_connections 2026-02-20T03:32:26.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55780fb8f120 0x55780fb915e0 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55780fb04600 0x55780fb1e1d0 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55780faff5b0 0x55780fb1d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.679+0000 7fdda5e61e00 1 --2- 10.20.193.28:0/620235368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55780fafec50 0x55780fb1cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.680+0000 7fdda5e61e00 1 -- 10.20.193.28:0/620235368 >> 10.20.193.28:0/620235368 conn(0x55780faf62d0 msgr2=0x55780fb16ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.680+0000 7fdd61ffb640 0 client.20376 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.680+0000 7fdda5e61e00 1 -- 10.20.193.28:0/620235368 shutdown_connections 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.680+0000 7fdda5e61e00 1 -- 10.20.193.28:0/620235368 wait complete. 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda5e61e00 20 client.20376 trim_cache size 0 max 16384 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:32:26.683 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 -- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd700b0e20 msgr2=0x7fdd700b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd700b0e20 0x7fdd700b32e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdd84002e20 tx=0x7fdd84002d90 comp rx=0 tx=0).stop 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 -- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd9c073590 msgr2=0x7fdd9c11a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd9c073590 0x7fdd9c11a280 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e9f0 tx=0x7fdd8c00eec0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 -- 10.20.193.28:0/4114732501 shutdown_connections 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdd700b0e20 0x7fdd700b32e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdd9c10cc60 0x7fdd9c11f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdd9c073ed0 0x7fdd9c11a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 --2- 10.20.193.28:0/4114732501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdd9c073590 0x7fdd9c11a280 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:26.684 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.681+0000 7fdda1ca3640 1 -- 10.20.193.28:0/4114732501 >> 10.20.193.28:0/4114732501 conn(0x7fdd9c06f610 msgr2=0x7fdd9c10f740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:26.694 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.692+0000 7fdda1ca3640 1 -- 10.20.193.28:0/4114732501 shutdown_connections 2026-02-20T03:32:26.695 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:26.692+0000 7fdda1ca3640 1 -- 10.20.193.28:0/4114732501 wait complete. 2026-02-20T03:32:26.707 INFO:tasks.workunit.client.0.trial028.stdout: 10 84545 10.83 MB/sec execute 117 sec latency 96767.157 ms 2026-02-20T03:32:26.751 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:32:27.066 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:32:27.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.294+0000 7f4dc7677640 1 -- 10.20.193.28:0/3938384834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dc0077f40 msgr2=0x7f4dc01134a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:27.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.294+0000 7f4dc7677640 1 --2- 10.20.193.28:0/3938384834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dc0077f40 0x7f4dc01134a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009a30 tx=0x7f4db402f260 comp rx=0 tx=0).stop 2026-02-20T03:32:27.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.294+0000 7f4dc7677640 1 -- 10.20.193.28:0/3938384834 shutdown_connections 2026-02-20T03:32:27.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.294+0000 7f4dc7677640 1 --2- 10.20.193.28:0/3938384834 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4dc01139e0 0x7f4dc0115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.294+0000 7f4dc7677640 1 --2- 10.20.193.28:0/3938384834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dc0077f40 0x7f4dc01134a0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.294+0000 7f4dc7677640 1 --2- 10.20.193.28:0/3938384834 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4dc0077620 0x7f4dc0077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.294+0000 7f4dc7677640 1 -- 10.20.193.28:0/3938384834 >> 10.20.193.28:0/3938384834 conn(0x7f4dc0100840 msgr2=0x7f4dc0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:27.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.295+0000 7f4dc7677640 1 -- 10.20.193.28:0/3938384834 shutdown_connections 2026-02-20T03:32:27.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.295+0000 7f4dc7677640 1 -- 10.20.193.28:0/3938384834 wait complete. 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc7677640 1 Processor -- start 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc7677640 1 -- start start 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc7677640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dc0077620 0x7f4dc01a75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc7677640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4dc0077f40 0x7f4dc01a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc7677640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4dc01139e0 0x7f4dc01a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc7677640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc0119350 con 0x7f4dc0077620 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc7677640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc01191d0 con 0x7f4dc0077f40 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc7677640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc01194d0 con 0x7f4dc01139e0 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc5bed640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4dc01139e0 0x7f4dc01a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc5bed640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4dc01139e0 0x7f4dc01a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50402/0 (socket says 10.20.193.28:50402) 2026-02-20T03:32:27.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.300+0000 7f4dc5bed640 1 -- 10.20.193.28:0/238250238 learned_addr learned my addr 10.20.193.28:0/238250238 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:27.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.301+0000 7f4dc4beb640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4dc0077f40 0x7f4dc01a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dc5bed640 1 -- 10.20.193.28:0/238250238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4dc0077f40 msgr2=0x7f4dc01a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:27.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4dc0077f40 0x7f4dc01a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dc5bed640 1 -- 10.20.193.28:0/238250238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dc0077620 msgr2=0x7f4dc01a75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:27.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dc0077620 0x7f4dc01a75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dc5bed640 1 -- 10.20.193.28:0/238250238 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc01a1ee0 con 0x7f4dc01139e0 2026-02-20T03:32:27.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4dc01139e0 0x7f4dc01a1680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00b9e0 tx=0x7f4dbc00beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:27.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dae7fc640 1 -- 10.20.193.28:0/238250238 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc006e60 con 0x7f4dc01139e0 2026-02-20T03:32:27.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dae7fc640 1 -- 10.20.193.28:0/238250238 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4dbc010070 con 0x7f4dc01139e0 2026-02-20T03:32:27.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dae7fc640 1 -- 10.20.193.28:0/238250238 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0048a0 con 0x7f4dc01139e0 2026-02-20T03:32:27.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dc7677640 1 -- 10.20.193.28:0/238250238 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc01a21d0 con 0x7f4dc01139e0 2026-02-20T03:32:27.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.302+0000 7f4dc7677640 1 -- 10.20.193.28:0/238250238 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc006c890 con 0x7f4dc01139e0 2026-02-20T03:32:27.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.307+0000 7f4dae7fc640 1 -- 10.20.193.28:0/238250238 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4dbc01d030 con 0x7f4dc01139e0 2026-02-20T03:32:27.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.309+0000 7f4dae7fc640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d9c0b0da0 0x7f4d9c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.309+0000 7f4dae7fc640 1 -- 10.20.193.28:0/238250238 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f4dbc0dfff0 con 0x7f4dc01139e0 2026-02-20T03:32:27.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.309+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d9c0b0da0 0x7f4d9c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.310+0000 7f4dc9b7ce00 1 Processor -- start 2026-02-20T03:32:27.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.310+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d9c0b0da0 0x7f4d9c0b3260 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4db0006fd0 tx=0x7f4db0006d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:27.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.310+0000 7f4dc9b7ce00 1 -- start start 2026-02-20T03:32:27.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.310+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 0x555b240709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24078c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc53ec640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555b23fece00 con 0x555b240710d0 2026-02-20T03:32:27.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555b23fbf970 con 0x555b2406c5e0 2026-02-20T03:32:27.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555b23f6d1f0 con 0x555b2406cf90 2026-02-20T03:32:27.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc4beb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 0x555b240709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc53ec640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2406c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36978/0 (socket says 10.20.193.28:36978) 2026-02-20T03:32:27.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc53ec640 1 -- 10.20.193.28:0/1958403270 learned_addr learned my addr 10.20.193.28:0/1958403270 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:27.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/1958403270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24078c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc53ec640 1 -- 10.20.193.28:0/1958403270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 msgr2=0x555b240709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/1958403270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 0x555b240709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.311+0000 7f4dc53ec640 1 -- 10.20.193.28:0/1958403270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 msgr2=0x555b24078c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.312+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/1958403270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24078c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.312+0000 7f4dc53ec640 1 -- 10.20.193.28:0/1958403270 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b23f803d0 con 0x555b2406c5e0 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.312+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/1958403270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24078c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.312+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/1958403270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2406c9c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4db00094e0 tx=0x7f4db000e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a209960dbeaae25 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.312+0000 7f4d95ce5640 1 -- 10.20.193.28:0/1958403270 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0022070 con 0x555b2406c5e0 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.312+0000 7f4d95ce5640 1 -- 10.20.193.28:0/1958403270 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4db0002b90 con 0x555b2406c5e0 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.312+0000 7f4d95ce5640 1 -- 10.20.193.28:0/1958403270 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db001d660 con 0x555b2406c5e0 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.313+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1958403270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 msgr2=0x555b2406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:27.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.313+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1958403270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2406c9c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4db00094e0 tx=0x7f4db000e000 comp rx=0 tx=0).stop 2026-02-20T03:32:27.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.313+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1958403270 shutdown_connections 2026-02-20T03:32:27.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.313+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1958403270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24078c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.313+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1958403270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 0x555b240709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.313+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1958403270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2406c9c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.313+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1958403270 >> 10.20.193.28:0/1958403270 conn(0x555b2402f240 msgr2=0x555b2406ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:27.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.314+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1958403270 shutdown_connections 2026-02-20T03:32:27.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.314+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1958403270 wait complete. 2026-02-20T03:32:27.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.315+0000 7f4dc9b7ce00 1 -- start start 2026-02-20T03:32:27.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.316+0000 7f4dc9b7ce00 1 Processor -- start 2026-02-20T03:32:27.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.316+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 0x555b24086b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.316+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b2406cf90 0x555b240870d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.316+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b240710d0 0x555b240852d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.316+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555b23fbb8a0 con 0x555b2406cf90 2026-02-20T03:32:27.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.316+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555b23dadf50 con 0x555b240710d0 2026-02-20T03:32:27.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.316+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555b24085a50 con 0x555b2406c5e0 2026-02-20T03:32:27.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.317+0000 7f4dc4beb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b2406cf90 0x555b240870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.317+0000 7f4dc5bed640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b240710d0 0x555b240852d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.317+0000 7f4dc5bed640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b240710d0 0x555b240852d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36994/0 (socket says 10.20.193.28:36994) 2026-02-20T03:32:27.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.317+0000 7f4dc5bed640 1 -- 10.20.193.28:0/3279034444 learned_addr learned my addr 10.20.193.28:0/3279034444 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:27.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.317+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 0x555b24086b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.317+0000 7f4dc4beb640 1 -- 10.20.193.28:0/3279034444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 msgr2=0x555b24086b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:27.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.317+0000 7f4dc4beb640 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 0x555b24086b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.318+0000 7f4dc4beb640 1 -- 10.20.193.28:0/3279034444 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b240710d0 msgr2=0x555b240852d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:27.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.318+0000 7f4dc4beb640 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b240710d0 0x555b240852d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.318+0000 7f4dc4beb640 1 -- 10.20.193.28:0/3279034444 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b2407e890 con 0x555b2406cf90 2026-02-20T03:32:27.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.318+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 0x555b24086b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:27.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.318+0000 7f4dc4beb640 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b2406cf90 0x555b240870d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009950 tx=0x7f4db402fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c5f0e48d7d357e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:27.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.318+0000 7f4d76ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:27.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.319+0000 7f4d76ffd640 1 -- 10.20.193.28:0/3279034444 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4004050 con 0x555b2406cf90 2026-02-20T03:32:27.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.319+0000 7f4d76ffd640 1 -- 10.20.193.28:0/3279034444 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4db4033040 con 0x555b2406cf90 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.319+0000 7f4d76ffd640 1 -- 10.20.193.28:0/3279034444 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db4042420 con 0x555b2406cf90 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.319+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/3279034444 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b23d90b40 con 0x555b2406cf90 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.319+0000 7f4dc9b7ce00 10 client.20385 _ll_register_callbacks cb 0x555b23ff8eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.319+0000 7f4d76ffd640 1 -- 10.20.193.28:0/3279034444 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f4db40041f0 con 0x555b2406cf90 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.319+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/3279034444 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555b23fcd150 con 0x555b2406cf90 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4d76ffd640 1 -- 10.20.193.28:0/3279034444 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4db4038790 con 0x555b2406cf90 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4dc9b7ce00 10 client.20385 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/3279034444 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x555b23f7a1e0 con 0x555b2406cf90 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4d76ffd640 1 -- 10.20.193.28:0/3279034444 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f4db40425c0 con 0x555b2406cf90 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4dc9b7ce00 10 client.20385 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:27.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4dc9b7ce00 10 client.20385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:32:27.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4dc9b7ce00 20 client.20385 populate_metadata read hostname 'trial028' 2026-02-20T03:32:27.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x555b24095250 0x555b240976a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4dc9b7ce00 4 client.20385 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:27.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.320+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/3279034444 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b23fc7560 con 0x555b24095250 2026-02-20T03:32:27.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.321+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x555b24095250 0x555b240976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.321+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x555b24095250 0x555b240976a0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55a3fcdb2bccc865 server_cookie=39a9486e4b0039e3 in_seq=0 out_seq=0 2026-02-20T03:32:27.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.321+0000 7f4d76ffd640 10 client.20385 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:32:27.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.322+0000 7f4d76ffd640 1 -- 10.20.193.28:0/3279034444 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555b23fc7560 con 0x555b24095250 2026-02-20T03:32:27.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.322+0000 7f4d76ffd640 10 client.20385 handle_command_reply: tid=0 2026-02-20T03:32:27.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.322+0000 7f4dc9b7ce00 1 client.20385 shutdown 2026-02-20T03:32:27.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.323+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/3279034444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b2406cf90 msgr2=0x555b240870d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:27.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.323+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b2406cf90 0x555b240870d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009950 tx=0x7f4db402fcf0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/3279034444 shutdown_connections 2026-02-20T03:32:27.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b240710d0 0x555b240852d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x555b24095250 0x555b240976a0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b2406cf90 0x555b240870d0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/3279034444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 0x555b24086b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4d76ffd640 0 client.20385 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:32:27.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/3279034444 >> 10.20.193.28:0/3279034444 conn(0x555b2402f240 msgr2=0x555b2406f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:27.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/3279034444 shutdown_connections 2026-02-20T03:32:27.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/3279034444 wait complete. 2026-02-20T03:32:27.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.324+0000 7f4dc9b7ce00 20 client.20385 trim_cache size 0 max 16384 2026-02-20T03:32:27.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc9b7ce00 1 Processor -- start 2026-02-20T03:32:27.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc9b7ce00 1 -- start start 2026-02-20T03:32:27.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 0x555b2406b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406cf90 0x555b24082850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24082d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4d600126f0 con 0x555b240710d0 2026-02-20T03:32:27.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6000ffc0 con 0x555b2406cf90 2026-02-20T03:32:27.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6000de10 con 0x555b2406c5e0 2026-02-20T03:32:27.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc4beb640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406cf90 0x555b24082850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc4beb640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406cf90 0x555b24082850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36998/0 (socket says 10.20.193.28:36998) 2026-02-20T03:32:27.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.332+0000 7f4dc4beb640 1 -- 10.20.193.28:0/4227873743 learned_addr learned my addr 10.20.193.28:0/4227873743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:27.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/4227873743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24082d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4dc5bed640 1 -- 10.20.193.28:0/4227873743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 msgr2=0x555b2406b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:27.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/4227873743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 0x555b2406b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4dc5bed640 1 -- 10.20.193.28:0/4227873743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406cf90 msgr2=0x555b24082850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:27.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/4227873743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406cf90 0x555b24082850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4dc5bed640 1 -- 10.20.193.28:0/4227873743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b2407e6c0 con 0x555b240710d0 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/4227873743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24082d90 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0dd660 tx=0x7f4dbc090040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1f6df5c05c73b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4d954e4640 1 -- 10.20.193.28:0/4227873743 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0a4070 con 0x555b240710d0 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4d954e4640 1 -- 10.20.193.28:0/4227873743 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4dbc0dd770 con 0x555b240710d0 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.333+0000 7f4d954e4640 1 -- 10.20.193.28:0/4227873743 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0a4070 con 0x555b240710d0 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.334+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/4227873743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 msgr2=0x555b24082d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.334+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/4227873743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24082d90 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0dd660 tx=0x7f4dbc090040 comp rx=0 tx=0).stop 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.334+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/4227873743 shutdown_connections 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.334+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/4227873743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24082d90 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.334+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/4227873743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406cf90 0x555b24082850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.334+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/4227873743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406c5e0 0x555b2406b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.334+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/4227873743 >> 10.20.193.28:0/4227873743 conn(0x555b2402f240 msgr2=0x555b24084220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.334+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/4227873743 shutdown_connections 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.334+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/4227873743 wait complete. 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.335+0000 7f4dc9b7ce00 1 -- start start 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.335+0000 7f4dc9b7ce00 1 Processor -- start 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.335+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2408d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.335+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 0x555b240899f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.335+0000 7f4dc9b7ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24089f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.335+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6000e480 con 0x555b240710d0 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.335+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6000f8f0 con 0x555b2406c5e0 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.335+0000 7f4dc9b7ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6000eb50 con 0x555b2406cf90 2026-02-20T03:32:27.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.336+0000 7f4dc5bed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24089f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.336+0000 7f4dc5bed640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24089f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52476/0 (socket says 10.20.193.28:52476) 2026-02-20T03:32:27.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.336+0000 7f4dc5bed640 1 -- 10.20.193.28:0/1577527595 learned_addr learned my addr 10.20.193.28:0/1577527595 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:27.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.336+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2408d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.336+0000 7f4dc4beb640 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 0x555b240899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.337+0000 7f4dc5bed640 1 -- 10.20.193.28:0/1577527595 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 msgr2=0x555b240899f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.337+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 0x555b240899f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.337+0000 7f4dc5bed640 1 -- 10.20.193.28:0/1577527595 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 msgr2=0x555b2408d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.337+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2408d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.337+0000 7f4dc5bed640 1 -- 10.20.193.28:0/1577527595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b23c9e870 con 0x555b240710d0 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.337+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2408d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.337+0000 7f4dc4beb640 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 0x555b240899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.338+0000 7f4dc5bed640 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24089f30 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00b9b0 tx=0x7f4dbc002f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=616c1a857ad3a744 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.338+0000 7f4d76ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.339+0000 7f4d76ffd640 1 -- 10.20.193.28:0/1577527595 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0a4070 con 0x555b240710d0 2026-02-20T03:32:27.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.339+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1577527595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b23f5f3f0 con 0x555b240710d0 2026-02-20T03:32:27.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.339+0000 7f4dc9b7ce00 10 client.20391 _ll_register_callbacks cb 0x7f4db4038470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:27.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.339+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1577527595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555b23f71ab0 con 0x555b240710d0 2026-02-20T03:32:27.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.339+0000 7f4d76ffd640 1 -- 10.20.193.28:0/1577527595 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4dbc0ddb20 con 0x555b240710d0 2026-02-20T03:32:27.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.339+0000 7f4d76ffd640 1 -- 10.20.193.28:0/1577527595 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0a6750 con 0x555b240710d0 2026-02-20T03:32:27.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.340+0000 7f4d76ffd640 1 -- 10.20.193.28:0/1577527595 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f4dbc0c2120 con 0x555b240710d0 2026-02-20T03:32:27.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.340+0000 7f4d76ffd640 1 -- 10.20.193.28:0/1577527595 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4dbc0a68f0 con 0x555b240710d0 2026-02-20T03:32:27.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.340+0000 7f4dc9b7ce00 10 client.20391 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:27.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.340+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1577527595 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x555b2407f3b0 con 0x555b240710d0 2026-02-20T03:32:27.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.340+0000 7f4d76ffd640 1 -- 10.20.193.28:0/1577527595 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f4dbc0a6ce0 con 0x555b240710d0 2026-02-20T03:32:27.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.341+0000 7f4dc9b7ce00 10 client.20391 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:27.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.341+0000 7f4dc9b7ce00 10 client.20391 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:32:27.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.341+0000 7f4dc9b7ce00 20 client.20391 populate_metadata read hostname 'trial028' 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.341+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x555b24112470 0x555b24114930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.341+0000 7f4dc9b7ce00 4 client.20391 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.341+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1577527595 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4db0002b90 con 0x555b24112470 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.341+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x555b24112470 0x555b24114930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.342+0000 7f4dc53ec640 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x555b24112470 0x555b24114930 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8763a1691e67b9c5 server_cookie=e06f84b37127ad17 in_seq=0 out_seq=0 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.342+0000 7f4d76ffd640 10 client.20391 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.342+0000 7f4d76ffd640 1 -- 10.20.193.28:0/1577527595 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4db0002b90 con 0x555b24112470 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.342+0000 7f4d76ffd640 10 client.20391 handle_command_reply: tid=0 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.342+0000 7f4dc9b7ce00 1 client.20391 shutdown 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.342+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1577527595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 msgr2=0x555b24089f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:27.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.342+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24089f30 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00b9b0 tx=0x7f4dbc002f10 comp rx=0 tx=0).stop 2026-02-20T03:32:27.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1577527595 shutdown_connections 2026-02-20T03:32:27.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x555b24112470 0x555b24114930 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555b240710d0 0x555b24089f30 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555b2406cf90 0x555b240899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4dc9b7ce00 1 --2- 10.20.193.28:0/1577527595 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555b2406c5e0 0x555b2408d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1577527595 >> 10.20.193.28:0/1577527595 conn(0x555b2402f240 msgr2=0x555b24071930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:27.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4d76ffd640 0 client.20391 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:32:27.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1577527595 shutdown_connections 2026-02-20T03:32:27.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4dc9b7ce00 1 -- 10.20.193.28:0/1577527595 wait complete. 2026-02-20T03:32:27.348 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:32:27.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.343+0000 7f4dc9b7ce00 20 client.20391 trim_cache size 0 max 16384 2026-02-20T03:32:27.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 -- 10.20.193.28:0/238250238 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d9c0b0da0 msgr2=0x7f4d9c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:27.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d9c0b0da0 0x7f4d9c0b3260 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4db0006fd0 tx=0x7f4db0006d40 comp rx=0 tx=0).stop 2026-02-20T03:32:27.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 -- 10.20.193.28:0/238250238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4dc01139e0 msgr2=0x7f4dc01a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:27.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4dc01139e0 0x7f4dc01a1680 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00b9e0 tx=0x7f4dbc00beb0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 -- 10.20.193.28:0/238250238 shutdown_connections 2026-02-20T03:32:27.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4d9c0b0da0 0x7f4d9c0b3260 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4dc01139e0 0x7f4dc01a1680 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4dc0077f40 0x7f4dc01a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 --2- 10.20.193.28:0/238250238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4dc0077620 0x7f4dc01a75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:27.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 -- 10.20.193.28:0/238250238 >> 10.20.193.28:0/238250238 conn(0x7f4dc0100840 msgr2=0x7f4dc01157a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:27.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 -- 10.20.193.28:0/238250238 shutdown_connections 2026-02-20T03:32:27.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:27.345+0000 7f4dc7677640 1 -- 10.20.193.28:0/238250238 wait complete. 2026-02-20T03:32:27.403 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:27 trial028 ceph-mon[38552]: pgmap v718: 129 pgs: 129 active+clean; 489 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 257 KiB/s rd, 247 KiB/s wr, 109 op/s 2026-02-20T03:32:27.404 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:27 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1898575132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:32:27.506 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:32:27.708 INFO:tasks.workunit.client.0.trial028.stdout: 10 85890 11.37 MB/sec execute 118 sec latency 39.801 ms 2026-02-20T03:32:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:27 trial177 ceph-mon[43181]: pgmap v718: 129 pgs: 129 active+clean; 489 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 257 KiB/s rd, 247 KiB/s wr, 109 op/s 2026-02-20T03:32:27.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:27 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1898575132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:32:27.820 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:32:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:27 trial126 ceph-mon[38476]: pgmap v718: 129 pgs: 129 active+clean; 489 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 257 KiB/s rd, 247 KiB/s wr, 109 op/s 2026-02-20T03:32:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:27 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1898575132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:32:28.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.028+0000 7fa1a1493640 1 -- 10.20.193.28:0/2310885823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa19c113820 msgr2=0x7fa19c115c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.028+0000 7fa1a1493640 1 --2- 10.20.193.28:0/2310885823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa19c113820 0x7fa19c115c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa188009960 tx=0x7fa18802f160 comp rx=0 tx=0).stop 2026-02-20T03:32:28.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.029+0000 7fa1a1493640 1 -- 10.20.193.28:0/2310885823 shutdown_connections 2026-02-20T03:32:28.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.029+0000 7fa1a1493640 1 --2- 10.20.193.28:0/2310885823 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa19c113820 0x7fa19c115c10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.029+0000 7fa1a1493640 1 --2- 10.20.193.28:0/2310885823 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa19c077f40 0x7fa19c1132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.029+0000 7fa1a1493640 1 --2- 10.20.193.28:0/2310885823 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa19c077620 0x7fa19c077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.029+0000 7fa1a1493640 1 -- 10.20.193.28:0/2310885823 >> 10.20.193.28:0/2310885823 conn(0x7fa19c100660 msgr2=0x7fa19c102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.029+0000 7fa1a1493640 1 -- 10.20.193.28:0/2310885823 shutdown_connections 2026-02-20T03:32:28.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.029+0000 7fa1a1493640 1 -- 10.20.193.28:0/2310885823 wait complete. 2026-02-20T03:32:28.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.030+0000 7fa1a1493640 1 Processor -- start 2026-02-20T03:32:28.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.031+0000 7fa1a1493640 1 -- start start 2026-02-20T03:32:28.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.031+0000 7fa1a1493640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa19c077620 0x7fa19c1a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa1a1493640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa19c077f40 0x7fa19c1a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa19bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa19c077620 0x7fa19c1a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa1a1493640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa19c113820 0x7fa19c1a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa19bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa19c077620 0x7fa19c1a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50446/0 (socket says 10.20.193.28:50446) 2026-02-20T03:32:28.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa1a1493640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c119070 con 0x7fa19c113820 2026-02-20T03:32:28.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa1a1493640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c118ef0 con 0x7fa19c077f40 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa1a1493640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa19c1191f0 con 0x7fa19c077620 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa19bfff640 1 -- 10.20.193.28:0/3365073997 learned_addr learned my addr 10.20.193.28:0/3365073997 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa19c077f40 0x7fa19c1a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa1a0c92640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa19c113820 0x7fa19c1a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa19bfff640 1 -- 10.20.193.28:0/3365073997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa19c077f40 msgr2=0x7fa19c1a1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa19bfff640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa19c077f40 0x7fa19c1a1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa19bfff640 1 -- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa19c113820 msgr2=0x7fa19c1a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa19bfff640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa19c113820 0x7fa19c1a5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.032+0000 7fa19bfff640 1 -- 10.20.193.28:0/3365073997 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19c1a6560 con 0x7fa19c077620 2026-02-20T03:32:28.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.033+0000 7fa19bfff640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa19c077620 0x7fa19c1a15b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa19000c0c0 tx=0x7fa19000c590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.033+0000 7fa1997fa640 1 -- 10.20.193.28:0/3365073997 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190019070 con 0x7fa19c077620 2026-02-20T03:32:28.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.033+0000 7fa1997fa640 1 -- 10.20.193.28:0/3365073997 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa1900092d0 con 0x7fa19c077620 2026-02-20T03:32:28.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.033+0000 7fa1997fa640 1 -- 10.20.193.28:0/3365073997 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900075c0 con 0x7fa19c077620 2026-02-20T03:32:28.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.033+0000 7fa1a1493640 1 -- 10.20.193.28:0/3365073997 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19c1a67f0 con 0x7fa19c077620 2026-02-20T03:32:28.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.033+0000 7fa1a1493640 1 -- 10.20.193.28:0/3365073997 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19c1ae130 con 0x7fa19c077620 2026-02-20T03:32:28.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.037+0000 7fa1997fa640 1 -- 10.20.193.28:0/3365073997 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa190004160 con 0x7fa19c077620 2026-02-20T03:32:28.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a4c21e00 1 Processor -- start 2026-02-20T03:32:28.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a4c21e00 1 -- start start 2026-02-20T03:32:28.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c1afb0 0x55d219c1b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c15a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c15f60 0x55d219c21de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d219b95e00 con 0x55d219c155e0 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d219b68970 con 0x55d219c15f60 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d219b161f0 con 0x55d219c1afb0 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a0c92640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c1afb0 0x55d219c1b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa19b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c15f60 0x55d219c21de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa19b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c15f60 0x55d219c21de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37028/0 (socket says 10.20.193.28:37028) 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa19b7fe640 1 -- 10.20.193.28:0/630936760 learned_addr learned my addr 10.20.193.28:0/630936760 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.038+0000 7fa1a0c92640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c1afb0 0x55d219c1b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50454/0 (socket says 10.20.193.28:50454) 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa19bfff640 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c15a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa19b7fe640 1 -- 10.20.193.28:0/630936760 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c1afb0 msgr2=0x55d219c1b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c1afb0 0x55d219c1b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa19b7fe640 1 -- 10.20.193.28:0/630936760 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 msgr2=0x55d219c15a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c15a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa19b7fe640 1 -- 10.20.193.28:0/630936760 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d219b293d0 con 0x55d219c15f60 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa19bfff640 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c15a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa1a0c92640 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c1afb0 0x55d219c1b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa1997fa640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa16c0b0e20 0x7fa16c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa1997fa640 1 -- 10.20.193.28:0/3365073997 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fa1900e0960 con 0x7fa19c077620 2026-02-20T03:32:28.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa1a0c92640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa16c0b0e20 0x7fa16c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.039+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c15f60 0x55d219c21de0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa184004650 tx=0x7fa18400abc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=805fc45f9d2df154 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.040+0000 7fa18cce3640 1 -- 10.20.193.28:0/630936760 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184019470 con 0x55d219c15f60 2026-02-20T03:32:28.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.040+0000 7fa18cce3640 1 -- 10.20.193.28:0/630936760 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa184014070 con 0x55d219c15f60 2026-02-20T03:32:28.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.040+0000 7fa18cce3640 1 -- 10.20.193.28:0/630936760 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184010920 con 0x55d219c15f60 2026-02-20T03:32:28.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.041+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/630936760 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c15f60 msgr2=0x55d219c21de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.041+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c15f60 0x55d219c21de0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa184004650 tx=0x7fa18400abc0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.041+0000 7fa1a0c92640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa16c0b0e20 0x7fa16c0b32e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa18802f670 tx=0x7fa18803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.041+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/630936760 shutdown_connections 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.041+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c15f60 0x55d219c21de0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.041+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c15a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.041+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/630936760 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c1afb0 0x55d219c1b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.041+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/630936760 >> 10.20.193.28:0/630936760 conn(0x55d219bd8240 msgr2=0x55d219c13ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.042+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/630936760 shutdown_connections 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.042+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/630936760 wait complete. 2026-02-20T03:32:28.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.044+0000 7fa1a4c21e00 1 -- start start 2026-02-20T03:32:28.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.044+0000 7fa1a4c21e00 1 Processor -- start 2026-02-20T03:32:28.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.044+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c155e0 0x55d219c2e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.044+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c2ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.044+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c1afb0 0x55d219c2f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.044+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d219b648a0 con 0x55d219c1afb0 2026-02-20T03:32:28.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.044+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d219956f50 con 0x55d219c155e0 2026-02-20T03:32:28.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.044+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d219c2fea0 con 0x55d219c15f60 2026-02-20T03:32:28.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c2ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c2ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50458/0 (socket says 10.20.193.28:50458) 2026-02-20T03:32:28.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19b7fe640 1 -- 10.20.193.28:0/672763060 learned_addr learned my addr 10.20.193.28:0/672763060 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c155e0 0x55d219c2e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa1a0c92640 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c1afb0 0x55d219c2f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19b7fe640 1 -- 10.20.193.28:0/672763060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c155e0 msgr2=0x55d219c2e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c155e0 0x55d219c2e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19b7fe640 1 -- 10.20.193.28:0/672763060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c1afb0 msgr2=0x55d219c2f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c1afb0 0x55d219c2f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19b7fe640 1 -- 10.20.193.28:0/672763060 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d219c279e0 con 0x55d219c15f60 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa19bfff640 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c155e0 0x55d219c2e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.045+0000 7fa1a0c92640 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c1afb0 0x55d219c2f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.046+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c2ea00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa184005a10 tx=0x7fa184010770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a16283d812160c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.046+0000 7fa161ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.046+0000 7fa161ffb640 1 -- 10.20.193.28:0/672763060 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184029070 con 0x55d219c15f60 2026-02-20T03:32:28.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.046+0000 7fa161ffb640 1 -- 10.20.193.28:0/672763060 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa184010ba0 con 0x55d219c15f60 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.046+0000 7fa161ffb640 1 -- 10.20.193.28:0/672763060 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184024410 con 0x55d219c15f60 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.046+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/672763060 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d219939b40 con 0x55d219c15f60 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.046+0000 7fa161ffb640 1 -- 10.20.193.28:0/672763060 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fa18400f430 con 0x55d219c15f60 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.046+0000 7fa161ffb640 10 client.28252 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.047+0000 7fa1a4c21e00 10 client.28252 _ll_register_callbacks cb 0x55d219ba1eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.047+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/672763060 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d219b76150 con 0x55d219c15f60 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.047+0000 7fa161ffb640 1 -- 10.20.193.28:0/672763060 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa184010d50 con 0x55d219c15f60 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.047+0000 7fa1a4c21e00 10 client.28252 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.047+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/672763060 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55d219b231e0 con 0x55d219c15f60 2026-02-20T03:32:28.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.047+0000 7fa161ffb640 1 -- 10.20.193.28:0/672763060 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7fa184035020 con 0x55d219c15f60 2026-02-20T03:32:28.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.048+0000 7fa1a4c21e00 10 client.28252 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:28.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.048+0000 7fa1a4c21e00 10 client.28252 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:32:28.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.048+0000 7fa1a4c21e00 20 client.28252 populate_metadata read hostname 'trial028' 2026-02-20T03:32:28.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.048+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55d219c3e1d0 0x55d219c405c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.048+0000 7fa1a4c21e00 4 client.28252 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:28.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.048+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/672763060 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d219b70560 con 0x55d219c3e1d0 2026-02-20T03:32:28.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.048+0000 7fa19bfff640 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55d219c3e1d0 0x55d219c405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.049+0000 7fa19bfff640 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55d219c3e1d0 0x55d219c405c0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b244af9d2dbade6e server_cookie=96b959e8ea989e80 in_seq=0 out_seq=0 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.049+0000 7fa161ffb640 10 client.28252 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa161ffb640 1 -- 10.20.193.28:0/672763060 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d219b70560 con 0x55d219c3e1d0 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa161ffb640 10 client.28252 handle_command_reply: tid=0 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 client.28252 shutdown 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/672763060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 msgr2=0x55d219c2ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c2ea00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa184005a10 tx=0x7fa184010770 comp rx=0 tx=0).stop 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/672763060 shutdown_connections 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55d219c3e1d0 0x55d219c405c0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c1afb0 0x55d219c2f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c2ea00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa161ffb640 0 client.28252 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:32:28.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/672763060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c155e0 0x55d219c2e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/672763060 >> 10.20.193.28:0/672763060 conn(0x55d219bd8240 msgr2=0x55d219c143f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.051+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/672763060 shutdown_connections 2026-02-20T03:32:28.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.052+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/672763060 wait complete. 2026-02-20T03:32:28.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.052+0000 7fa1a4c21e00 20 client.28252 trim_cache size 0 max 16384 2026-02-20T03:32:28.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.060+0000 7fa1a4c21e00 1 Processor -- start 2026-02-20T03:32:28.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.060+0000 7fa1a4c21e00 1 -- start start 2026-02-20T03:32:28.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.060+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c19cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.060+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c3abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.060+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 0x55d219c144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.060+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa1400126a0 con 0x55d219c155e0 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.060+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa14000ff70 con 0x55d219c1afb0 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.060+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa14000ddc0 con 0x55d219c15f60 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa19b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c3abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa19b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c3abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50468/0 (socket says 10.20.193.28:50468) 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa19b7fe640 1 -- 10.20.193.28:0/2482841673 learned_addr learned my addr 10.20.193.28:0/2482841673 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa1a0c92640 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 0x55d219c144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa19b7fe640 1 -- 10.20.193.28:0/2482841673 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 msgr2=0x55d219c144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 0x55d219c144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa19b7fe640 1 -- 10.20.193.28:0/2482841673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 msgr2=0x55d219c19cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa19bfff640 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c19cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c19cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa19b7fe640 1 -- 10.20.193.28:0/2482841673 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d219c27810 con 0x55d219c15f60 2026-02-20T03:32:28.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.061+0000 7fa1a0c92640 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 0x55d219c144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:32:28.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.062+0000 7fa19bfff640 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c19cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:32:28.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.062+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c3abe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa184002ab0 tx=0x7fa18402f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc03bd6043391d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.062+0000 7fa163fff640 1 -- 10.20.193.28:0/2482841673 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184029030 con 0x55d219c15f60 2026-02-20T03:32:28.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.062+0000 7fa163fff640 1 -- 10.20.193.28:0/2482841673 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d219b76150 con 0x55d219c15f60 2026-02-20T03:32:28.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.062+0000 7fa163fff640 1 -- 10.20.193.28:0/2482841673 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa184004a50 con 0x55d219c15f60 2026-02-20T03:32:28.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.063+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2482841673 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 msgr2=0x55d219c3abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.063+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c3abe0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa184002ab0 tx=0x7fa18402f000 comp rx=0 tx=0).stop 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.063+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2482841673 shutdown_connections 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.063+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 0x55d219c144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.063+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c3abe0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.063+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2482841673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c19cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.063+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2482841673 >> 10.20.193.28:0/2482841673 conn(0x55d219bd8240 msgr2=0x55d219c2d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.063+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2482841673 shutdown_connections 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.063+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2482841673 wait complete. 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.064+0000 7fa1a4c21e00 1 -- start start 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.064+0000 7fa1a4c21e00 1 Processor -- start 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.064+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c36c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.064+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c37190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.064+0000 7fa1a4c21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 0x55d219ca1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.065+0000 7fa19bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c36c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.065+0000 7fa19bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c36c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52520/0 (socket says 10.20.193.28:52520) 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.065+0000 7fa19b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c37190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.065+0000 7fa19b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c37190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50482/0 (socket says 10.20.193.28:50482) 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.065+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa14000e430 con 0x55d219c155e0 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.065+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa14000f8a0 con 0x55d219c1afb0 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.065+0000 7fa1a4c21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa14000eb00 con 0x55d219c15f60 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.065+0000 7fa19bfff640 1 -- 10.20.193.28:0/2189583707 learned_addr learned my addr 10.20.193.28:0/2189583707 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.065+0000 7fa1a0c92640 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 0x55d219ca1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.066+0000 7fa19bfff640 1 -- 10.20.193.28:0/2189583707 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 msgr2=0x55d219c37190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.066+0000 7fa19bfff640 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c37190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.066+0000 7fa19bfff640 1 -- 10.20.193.28:0/2189583707 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 msgr2=0x55d219ca1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.066+0000 7fa19bfff640 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 0x55d219ca1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.066+0000 7fa19bfff640 1 -- 10.20.193.28:0/2189583707 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d219847870 con 0x55d219c155e0 2026-02-20T03:32:28.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.066+0000 7fa19bfff640 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c36c50 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fa1900ddfd0 tx=0x7fa1900a7c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a406e21a6fb35ef4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.066+0000 7fa161ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.067+0000 7fa161ffb640 1 -- 10.20.193.28:0/2189583707 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900adb80 con 0x55d219c155e0 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.067+0000 7fa161ffb640 1 -- 10.20.193.28:0/2189583707 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa1900add20 con 0x55d219c155e0 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.067+0000 7fa161ffb640 1 -- 10.20.193.28:0/2189583707 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900a4190 con 0x55d219c155e0 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.067+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2189583707 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d219b083f0 con 0x55d219c155e0 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.067+0000 7fa161ffb640 1 -- 10.20.193.28:0/2189583707 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7fa1900a7170 con 0x55d219c155e0 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.067+0000 7fa161ffb640 10 client.20397 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 10 client.20397 _ll_register_callbacks cb 0x7fa190009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2189583707 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d219c0e1b0 con 0x55d219c155e0 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa161ffb640 1 -- 10.20.193.28:0/2189583707 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa1900a7700 con 0x55d219c155e0 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 10 client.20397 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:28.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2189583707 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55d219c28500 con 0x55d219c155e0 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa161ffb640 1 -- 10.20.193.28:0/2189583707 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7fa1900a7370 con 0x55d219c155e0 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 10 client.20397 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 10 client.20397 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 20 client.20397 populate_metadata read hostname 'trial028' 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55d219c3e1d0 0x55d219cabc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 4 client.20397 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.068+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2189583707 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d219b1aab0 con 0x55d219c3e1d0 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.069+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55d219c3e1d0 0x55d219cabc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.069+0000 7fa19b7fe640 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55d219c3e1d0 0x55d219cabc10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bdeb5b8555e09517 server_cookie=f57aeb6a5c035a39 in_seq=0 out_seq=0 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.069+0000 7fa161ffb640 10 client.20397 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa161ffb640 1 -- 10.20.193.28:0/2189583707 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d219b1aab0 con 0x55d219c3e1d0 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa161ffb640 10 client.20397 handle_command_reply: tid=0 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 client.20397 shutdown 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2189583707 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 msgr2=0x55d219c36c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.075 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c36c50 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fa1900ddfd0 tx=0x7fa1900a7c10 comp rx=0 tx=0).stop 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2189583707 shutdown_connections 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55d219c3e1d0 0x55d219cabc10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d219c1afb0 0x55d219ca1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d219c15f60 0x55d219c37190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 --2- 10.20.193.28:0/2189583707 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d219c155e0 0x55d219c36c50 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2189583707 >> 10.20.193.28:0/2189583707 conn(0x55d219bd8240 msgr2=0x55d219c16a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa161ffb640 0 client.20397 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.070+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2189583707 shutdown_connections 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.071+0000 7fa1a4c21e00 1 -- 10.20.193.28:0/2189583707 wait complete. 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.071+0000 7fa1a4c21e00 20 client.20397 trim_cache size 0 max 16384 2026-02-20T03:32:28.076 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:32:28.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.071+0000 7fa1a1493640 1 -- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa16c0b0e20 msgr2=0x7fa16c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.071+0000 7fa1a1493640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa16c0b0e20 0x7fa16c0b32e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa18802f670 tx=0x7fa18803a040 comp rx=0 tx=0).stop 2026-02-20T03:32:28.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 -- 10.20.193.28:0/3365073997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa19c077620 msgr2=0x7fa19c1a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa19c077620 0x7fa19c1a15b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa19000c0c0 tx=0x7fa19000c590 comp rx=0 tx=0).stop 2026-02-20T03:32:28.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 -- 10.20.193.28:0/3365073997 shutdown_connections 2026-02-20T03:32:28.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa16c0b0e20 0x7fa16c0b32e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa19c113820 0x7fa19c1a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa19c077f40 0x7fa19c1a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 --2- 10.20.193.28:0/3365073997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa19c077620 0x7fa19c1a15b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 -- 10.20.193.28:0/3365073997 >> 10.20.193.28:0/3365073997 conn(0x7fa19c100660 msgr2=0x7fa19c102a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 -- 10.20.193.28:0/3365073997 shutdown_connections 2026-02-20T03:32:28.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.072+0000 7fa1a1493640 1 -- 10.20.193.28:0/3365073997 wait complete. 2026-02-20T03:32:28.182 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:32:28.547 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:32:28.708 INFO:tasks.workunit.client.0.trial028.stdout: 10 86899 11.73 MB/sec execute 119 sec latency 157.209 ms 2026-02-20T03:32:28.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.761+0000 7f00b3273640 1 -- 10.20.193.28:0/3181452880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00ac1008d0 msgr2=0x7f00ac100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.761+0000 7f00b3273640 1 --2- 10.20.193.28:0/3181452880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00ac1008d0 0x7f00ac100d30 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f0094009a30 tx=0x7f009402f220 comp rx=0 tx=0).stop 2026-02-20T03:32:28.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.761+0000 7f00b3273640 1 -- 10.20.193.28:0/3181452880 shutdown_connections 2026-02-20T03:32:28.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.761+0000 7f00b3273640 1 --2- 10.20.193.28:0/3181452880 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00ac101270 0x7f00ac10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.761+0000 7f00b3273640 1 --2- 10.20.193.28:0/3181452880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00ac1008d0 0x7f00ac100d30 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.761+0000 7f00b3273640 1 --2- 10.20.193.28:0/3181452880 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00ac1068d0 0x7f00ac106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.761+0000 7f00b3273640 1 -- 10.20.193.28:0/3181452880 >> 10.20.193.28:0/3181452880 conn(0x7f00ac0fc5f0 msgr2=0x7f00ac0fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.762+0000 7f00b3273640 1 -- 10.20.193.28:0/3181452880 shutdown_connections 2026-02-20T03:32:28.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.762+0000 7f00b3273640 1 -- 10.20.193.28:0/3181452880 wait complete. 2026-02-20T03:32:28.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.762+0000 7f00b3273640 1 Processor -- start 2026-02-20T03:32:28.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.762+0000 7f00b3273640 1 -- start start 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b3273640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00ac1008d0 0x7f00ac10f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b3273640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00ac101270 0x7f00ac10fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b3273640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00ac1068d0 0x7f00ac110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b3273640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac112980 con 0x7f00ac1008d0 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b3273640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac112800 con 0x7f00ac101270 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b3273640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac112b00 con 0x7f00ac1068d0 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b2271640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00ac1008d0 0x7f00ac10f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b1a70640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00ac101270 0x7f00ac10fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b1a70640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00ac101270 0x7f00ac10fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37066/0 (socket says 10.20.193.28:37066) 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b1a70640 1 -- 10.20.193.28:0/801983185 learned_addr learned my addr 10.20.193.28:0/801983185 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.763+0000 7f00b2a72640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00ac1068d0 0x7f00ac110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.764+0000 7f00b2271640 1 -- 10.20.193.28:0/801983185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00ac1068d0 msgr2=0x7f00ac110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.764+0000 7f00b2271640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00ac1068d0 0x7f00ac110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.764+0000 7f00b2271640 1 -- 10.20.193.28:0/801983185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00ac101270 msgr2=0x7f00ac10fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.764+0000 7f00b2271640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00ac101270 0x7f00ac10fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.764+0000 7f00b2271640 1 -- 10.20.193.28:0/801983185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac073990 con 0x7f00ac1008d0 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.764+0000 7f00b2271640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00ac1008d0 0x7f00ac10f7d0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f00a8007ec0 tx=0x7f00a800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.764+0000 7f00a37fe640 1 -- 10.20.193.28:0/801983185 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8002a60 con 0x7f00ac1008d0 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.765+0000 7f00b3273640 1 -- 10.20.193.28:0/801983185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ac073c20 con 0x7f00ac1008d0 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.765+0000 7f00b3273640 1 -- 10.20.193.28:0/801983185 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ac074160 con 0x7f00ac1008d0 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.765+0000 7f00a37fe640 1 -- 10.20.193.28:0/801983185 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f00a8002c00 con 0x7f00ac1008d0 2026-02-20T03:32:28.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.765+0000 7f00a37fe640 1 -- 10.20.193.28:0/801983185 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8013810 con 0x7f00ac1008d0 2026-02-20T03:32:28.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.768+0000 7f00a37fe640 1 -- 10.20.193.28:0/801983185 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f00a8012070 con 0x7f00ac1008d0 2026-02-20T03:32:28.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00b6a01e00 1 Processor -- start 2026-02-20T03:32:28.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00a37fe640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00880b0ef0 0x7f00880b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00b6a01e00 1 -- start start 2026-02-20T03:32:28.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00a37fe640 1 -- 10.20.193.28:0/801983185 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f00a80e0350 con 0x7f00ac1008d0 2026-02-20T03:32:28.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b74405e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744058a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744064de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b743fd8e00 con 0x55b744058f60 2026-02-20T03:32:28.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b743fab970 con 0x55b74405dfb0 2026-02-20T03:32:28.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.770+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b743f591f0 con 0x55b7440585e0 2026-02-20T03:32:28.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2a72640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00880b0ef0 0x7f00880b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2a72640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744064de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2a72640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744064de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52554/0 (socket says 10.20.193.28:52554) 2026-02-20T03:32:28.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2a72640 1 -- 10.20.193.28:0/2586291142 learned_addr learned my addr 10.20.193.28:0/2586291142 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2271640 1 --2- 10.20.193.28:0/2586291142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b74405e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b1a70640 1 --2- 10.20.193.28:0/2586291142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744058a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2271640 1 -- 10.20.193.28:0/2586291142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 msgr2=0x55b744058a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2271640 1 --2- 10.20.193.28:0/2586291142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744058a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2271640 1 -- 10.20.193.28:0/2586291142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 msgr2=0x55b744064de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2271640 1 --2- 10.20.193.28:0/2586291142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744064de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.771+0000 7f00b2271640 1 -- 10.20.193.28:0/2586291142 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b743f6c3d0 con 0x55b74405dfb0 2026-02-20T03:32:28.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.772+0000 7f00b2271640 1 --2- 10.20.193.28:0/2586291142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b74405e390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f00a80dda70 tx=0x7f00a80a7680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cb8aca44dbb7ac2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.772+0000 7f00a0a08640 1 -- 10.20.193.28:0/2586291142 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80b12f0 con 0x55b74405dfb0 2026-02-20T03:32:28.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.772+0000 7f00a0a08640 1 -- 10.20.193.28:0/2586291142 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f00a8002db0 con 0x55b74405dfb0 2026-02-20T03:32:28.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.772+0000 7f00a0a08640 1 -- 10.20.193.28:0/2586291142 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80b10c0 con 0x55b74405dfb0 2026-02-20T03:32:28.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2586291142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 msgr2=0x55b74405e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b2a72640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00880b0ef0 0x7f00880b33b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f009c004750 tx=0x7f009c007580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2586291142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b74405e390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f00a80dda70 tx=0x7f00a80a7680 comp rx=0 tx=0).stop 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2586291142 shutdown_connections 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2586291142 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744064de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2586291142 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744058a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2586291142 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b74405e390 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2586291142 >> 10.20.193.28:0/2586291142 conn(0x55b74401b240 msgr2=0x55b744056ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2586291142 shutdown_connections 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.773+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2586291142 wait complete. 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.774+0000 7f00b6a01e00 1 -- start start 2026-02-20T03:32:28.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.775+0000 7f00b6a01e00 1 Processor -- start 2026-02-20T03:32:28.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.775+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744072ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.775+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744073410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.775+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b744071610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.775+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b743fa78a0 con 0x55b744058f60 2026-02-20T03:32:28.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.775+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b743d99f50 con 0x55b74405dfb0 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.775+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b744071d90 con 0x55b7440585e0 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.776+0000 7f00b2271640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744072ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.776+0000 7f00b2a72640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b744071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.776+0000 7f00b2a72640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b744071610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37084/0 (socket says 10.20.193.28:37084) 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.776+0000 7f00b2a72640 1 -- 10.20.193.28:0/2951188998 learned_addr learned my addr 10.20.193.28:0/2951188998 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.776+0000 7f00b2271640 1 -- 10.20.193.28:0/2951188998 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 msgr2=0x55b744071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.776+0000 7f00b2271640 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b744071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.776+0000 7f00b2271640 1 -- 10.20.193.28:0/2951188998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 msgr2=0x55b744073410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f00b1a70640 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744073410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f00b2271640 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744073410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f00b2271640 1 -- 10.20.193.28:0/2951188998 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74406aa70 con 0x55b7440585e0 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f00b1a70640 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f00b2271640 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744072ed0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f00a8002fd0 tx=0x7f00a80a4300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498107f9c6624c9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f005ffff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f005ffff640 1 -- 10.20.193.28:0/2951188998 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80ce030 con 0x55b7440585e0 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f005ffff640 1 -- 10.20.193.28:0/2951188998 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f00a80b0e60 con 0x55b7440585e0 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2951188998 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b743d7cb40 con 0x55b7440585e0 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.777+0000 7f005ffff640 1 -- 10.20.193.28:0/2951188998 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80a3a10 con 0x55b7440585e0 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.778+0000 7f005ffff640 1 -- 10.20.193.28:0/2951188998 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f00a80c2520 con 0x55b7440585e0 2026-02-20T03:32:28.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.778+0000 7f005ffff640 10 client.28270 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.778+0000 7f00b6a01e00 10 client.28270 _ll_register_callbacks cb 0x55b743fe4eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.778+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2951188998 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b743fb9150 con 0x55b7440585e0 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.778+0000 7f005ffff640 1 -- 10.20.193.28:0/2951188998 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f00a80b1010 con 0x55b7440585e0 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.778+0000 7f00b6a01e00 10 client.28270 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.778+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2951188998 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55b743f661e0 con 0x55b7440585e0 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.778+0000 7f005ffff640 1 -- 10.20.193.28:0/2951188998 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f00a805a1b0 con 0x55b7440585e0 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.779+0000 7f00b6a01e00 10 client.28270 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.779+0000 7f00b6a01e00 10 client.28270 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.779+0000 7f00b6a01e00 20 client.28270 populate_metadata read hostname 'trial028' 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.779+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b7440811e0 0x55b7440835d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.779+0000 7f00b6a01e00 4 client.28270 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:28.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.779+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2951188998 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b743fb3560 con 0x55b7440811e0 2026-02-20T03:32:28.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.779+0000 7f00b1a70640 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b7440811e0 0x55b7440835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.780+0000 7f005ffff640 10 client.28270 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:28.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.780+0000 7f00b1a70640 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b7440811e0 0x55b7440835d0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1841f538438d265e server_cookie=f2276426a7a67127 in_seq=0 out_seq=0 2026-02-20T03:32:28.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.781+0000 7f005ffff640 1 -- 10.20.193.28:0/2951188998 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b743fb3560 con 0x55b7440811e0 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.781+0000 7f005ffff640 10 client.28270 handle_command_reply: tid=0 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.781+0000 7f00b6a01e00 1 client.28270 shutdown 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2951188998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 msgr2=0x55b744072ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744072ed0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f00a8002fd0 tx=0x7f00a80a4300 comp rx=0 tx=0).stop 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2951188998 shutdown_connections 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b7440811e0 0x55b7440835d0 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b74405dfb0 0x55b744071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b744058f60 0x55b744073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2951188998 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744072ed0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2951188998 >> 10.20.193.28:0/2951188998 conn(0x55b74401b240 msgr2=0x55b7440573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f005ffff640 0 client.28270 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:28.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.782+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2951188998 shutdown_connections 2026-02-20T03:32:28.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.783+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2951188998 wait complete. 2026-02-20T03:32:28.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.783+0000 7f00b6a01e00 20 client.28270 trim_cache size 0 max 16384 2026-02-20T03:32:28.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.790+0000 7f00b6a01e00 1 Processor -- start 2026-02-20T03:32:28.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.790+0000 7f00b6a01e00 1 -- start start 2026-02-20T03:32:28.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744050ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b744058f60 0x55b744070430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b7440574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f00540125c0 con 0x55b74405dfb0 2026-02-20T03:32:28.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f005400fe90 con 0x55b744058f60 2026-02-20T03:32:28.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f005400dce0 con 0x55b7440585e0 2026-02-20T03:32:28.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b2a72640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b7440574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b2271640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744050ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b2a72640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b7440574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52560/0 (socket says 10.20.193.28:52560) 2026-02-20T03:32:28.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b2a72640 1 -- 10.20.193.28:0/3012898120 learned_addr learned my addr 10.20.193.28:0/3012898120 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b1a70640 1 --2- 10.20.193.28:0/3012898120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b744058f60 0x55b744070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b2a72640 1 -- 10.20.193.28:0/3012898120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 msgr2=0x55b744050ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b2a72640 1 --2- 10.20.193.28:0/3012898120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744050ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b2a72640 1 -- 10.20.193.28:0/3012898120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b744058f60 msgr2=0x55b744070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b2a72640 1 --2- 10.20.193.28:0/3012898120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b744058f60 0x55b744070430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.791+0000 7f00b2a72640 1 -- 10.20.193.28:0/3012898120 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b744071980 con 0x55b74405dfb0 2026-02-20T03:32:28.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f00b2a72640 1 --2- 10.20.193.28:0/3012898120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b7440574d0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f009c007fc0 tx=0x7f009c007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822f5a04dcc2a3e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f007a4e6640 1 -- 10.20.193.28:0/3012898120 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c018070 con 0x55b74405dfb0 2026-02-20T03:32:28.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f007a4e6640 1 -- 10.20.193.28:0/3012898120 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f009c005020 con 0x55b74405dfb0 2026-02-20T03:32:28.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f007a4e6640 1 -- 10.20.193.28:0/3012898120 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c01f760 con 0x55b74405dfb0 2026-02-20T03:32:28.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f00b6a01e00 1 -- 10.20.193.28:0/3012898120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 msgr2=0x55b7440574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/3012898120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b7440574d0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f009c007fc0 tx=0x7f009c007320 comp rx=0 tx=0).stop 2026-02-20T03:32:28.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f00b6a01e00 1 -- 10.20.193.28:0/3012898120 shutdown_connections 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/3012898120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b7440574d0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/3012898120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b744058f60 0x55b744070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/3012898120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b7440585e0 0x55b744050ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.792+0000 7f00b6a01e00 1 -- 10.20.193.28:0/3012898120 >> 10.20.193.28:0/3012898120 conn(0x55b74401b240 msgr2=0x55b74406fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.793+0000 7f00b6a01e00 1 -- 10.20.193.28:0/3012898120 shutdown_connections 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.793+0000 7f00b6a01e00 1 -- 10.20.193.28:0/3012898120 wait complete. 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.793+0000 7f00b6a01e00 1 -- start start 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.793+0000 7f00b6a01e00 1 Processor -- start 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b7440585e0 0x55b7440793c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b744058f60 0x55b744075d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b6a01e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b744076270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f005400e350 con 0x55b74405dfb0 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f005400f7c0 con 0x55b7440585e0 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b6a01e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f005400ea20 con 0x55b744058f60 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b2271640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b7440585e0 0x55b7440793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b1a70640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b744058f60 0x55b744075d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b2271640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b7440585e0 0x55b7440793c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37100/0 (socket says 10.20.193.28:37100) 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.794+0000 7f00b2271640 1 -- 10.20.193.28:0/2512079022 learned_addr learned my addr 10.20.193.28:0/2512079022 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.795+0000 7f00b2271640 1 -- 10.20.193.28:0/2512079022 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b744058f60 msgr2=0x55b744075d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.795+0000 7f00b2271640 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b744058f60 0x55b744075d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.795+0000 7f00b2271640 1 -- 10.20.193.28:0/2512079022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 msgr2=0x55b744076270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:28.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.795+0000 7f00b2a72640 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b744076270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.795+0000 7f00b2271640 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b744076270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.795+0000 7f00b2271640 1 -- 10.20.193.28:0/2512079022 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b74406a8a0 con 0x55b7440585e0 2026-02-20T03:32:28.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.795+0000 7f00b2a72640 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b744076270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:32:28.801 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.795+0000 7f00b2271640 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b7440585e0 0x55b7440793c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f00a800d9b0 tx=0x55b744072910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fe51ac794ee8898 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:28.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.795+0000 7f005ffff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:32:28.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.796+0000 7f005ffff640 1 -- 10.20.193.28:0/2512079022 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80ce040 con 0x55b7440585e0 2026-02-20T03:32:28.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.796+0000 7f005ffff640 1 -- 10.20.193.28:0/2512079022 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55b743fb9150 con 0x55b7440585e0 2026-02-20T03:32:28.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.796+0000 7f005ffff640 1 -- 10.20.193.28:0/2512079022 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80ce040 con 0x55b7440585e0 2026-02-20T03:32:28.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.796+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2512079022 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b743c8a870 con 0x55b7440585e0 2026-02-20T03:32:28.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.796+0000 7f005ffff640 1 -- 10.20.193.28:0/2512079022 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f00a80a6b10 con 0x55b7440585e0 2026-02-20T03:32:28.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.796+0000 7f005ffff640 10 client.28283 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:32:28.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.798+0000 7f00b6a01e00 10 client.28283 _ll_register_callbacks cb 0x7f0094005810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:28.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.798+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2512079022 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b743f5dab0 con 0x55b7440585e0 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.798+0000 7f005ffff640 1 -- 10.20.193.28:0/2512079022 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f00a80b0e60 con 0x55b7440585e0 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.798+0000 7f00b6a01e00 10 client.28283 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.798+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2512079022 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55b743f4b3f0 con 0x55b7440585e0 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.799+0000 7f005ffff640 1 -- 10.20.193.28:0/2512079022 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f00a80a6d10 con 0x55b7440585e0 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.799+0000 7f00b6a01e00 10 client.28283 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.799+0000 7f00b6a01e00 10 client.28283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.799+0000 7f00b6a01e00 20 client.28283 populate_metadata read hostname 'trial028' 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.799+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b7440fdc30 0x55b7441000c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.799+0000 7f00b6a01e00 4 client.28283 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.799+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2512079022 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f00a8002db0 con 0x55b7440fdc30 2026-02-20T03:32:28.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.799+0000 7f00b1a70640 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b7440fdc30 0x55b7441000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b1a70640 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b7440fdc30 0x55b7441000c0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5effd8b761dbf396 server_cookie=d1e7fbe662fb7ad in_seq=0 out_seq=0 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f005ffff640 10 client.28283 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f005ffff640 1 -- 10.20.193.28:0/2512079022 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f00a8002db0 con 0x55b7440fdc30 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f005ffff640 10 client.28283 handle_command_reply: tid=0 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b6a01e00 1 client.28283 shutdown 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2512079022 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b7440585e0 msgr2=0x55b7440793c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b7440585e0 0x55b7440793c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f00a800d9b0 tx=0x55b744072910 comp rx=0 tx=0).stop 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2512079022 shutdown_connections 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b7440fdc30 0x55b7441000c0 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b74405dfb0 0x55b744076270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b744058f60 0x55b744075d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b6a01e00 1 --2- 10.20.193.28:0/2512079022 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b7440585e0 0x55b7440793c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2512079022 >> 10.20.193.28:0/2512079022 conn(0x55b74401b240 msgr2=0x55b744070540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.800+0000 7f005ffff640 0 client.28283 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:28.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.801+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2512079022 shutdown_connections 2026-02-20T03:32:28.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.801+0000 7f00b6a01e00 1 -- 10.20.193.28:0/2512079022 wait complete. 2026-02-20T03:32:28.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.801+0000 7f00b6a01e00 20 client.28283 trim_cache size 0 max 16384 2026-02-20T03:32:28.808 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:32:28.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 -- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00880b0ef0 msgr2=0x7f00880b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00880b0ef0 0x7f00880b33b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f009c004750 tx=0x7f009c007580 comp rx=0 tx=0).stop 2026-02-20T03:32:28.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 -- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00ac1008d0 msgr2=0x7f00ac10f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:28.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00ac1008d0 0x7f00ac10f7d0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f00a8007ec0 tx=0x7f00a800d4a0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 -- 10.20.193.28:0/801983185 shutdown_connections 2026-02-20T03:32:28.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f00880b0ef0 0x7f00880b33b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f00ac1068d0 0x7f00ac110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f00ac101270 0x7f00ac10fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 --2- 10.20.193.28:0/801983185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f00ac1008d0 0x7f00ac10f7d0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:28.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.802+0000 7f00b3273640 1 -- 10.20.193.28:0/801983185 >> 10.20.193.28:0/801983185 conn(0x7f00ac0fc5f0 msgr2=0x7f00ac0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:28.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.803+0000 7f00b3273640 1 -- 10.20.193.28:0/801983185 shutdown_connections 2026-02-20T03:32:28.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:28.803+0000 7f00b3273640 1 -- 10.20.193.28:0/801983185 wait complete. 2026-02-20T03:32:29.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:29 trial028 ceph-mon[38552]: pgmap v719: 129 pgs: 129 active+clean; 492 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 453 KiB/s wr, 110 op/s 2026-02-20T03:32:29.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 88516 12.35 MB/sec execute 120 sec latency 59.488 ms 2026-02-20T03:32:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:29 trial177 ceph-mon[43181]: pgmap v719: 129 pgs: 129 active+clean; 492 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 453 KiB/s wr, 110 op/s 2026-02-20T03:32:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:29 trial126 ceph-mon[38476]: pgmap v719: 129 pgs: 129 active+clean; 492 MiB data, 6.7 GiB used, 8.2 TiB / 8.2 TiB avail; 1.5 MiB/s rd, 453 KiB/s wr, 110 op/s 2026-02-20T03:32:29.988 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:32:29.989 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:32:30.334 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:32:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.550+0000 7f65a7f82640 1 -- 10.20.193.28:0/2013427204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65a0074e40 msgr2=0x7f65a010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:30.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.550+0000 7f65a7f82640 1 --2- 10.20.193.28:0/2013427204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65a0074e40 0x7f65a010a470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6590009960 tx=0x7f659002f1f0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.550+0000 7f65a7f82640 1 -- 10.20.193.28:0/2013427204 shutdown_connections 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.550+0000 7f65a7f82640 1 --2- 10.20.193.28:0/2013427204 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65a0115940 0x7f65a0117d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.550+0000 7f65a7f82640 1 --2- 10.20.193.28:0/2013427204 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65a010a9b0 0x7f65a010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.550+0000 7f65a7f82640 1 --2- 10.20.193.28:0/2013427204 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65a0074e40 0x7f65a010a470 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.550+0000 7f65a7f82640 1 -- 10.20.193.28:0/2013427204 >> 10.20.193.28:0/2013427204 conn(0x7f65a006ec00 msgr2=0x7f65a006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.550+0000 7f65a7f82640 1 -- 10.20.193.28:0/2013427204 shutdown_connections 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.550+0000 7f65a7f82640 1 -- 10.20.193.28:0/2013427204 wait complete. 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.551+0000 7f65a7f82640 1 Processor -- start 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.551+0000 7f65a7f82640 1 -- start start 2026-02-20T03:32:30.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a7f82640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65a0074e40 0x7f65a011f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a7f82640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65a010a9b0 0x7f65a011fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a7f82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65a0115940 0x7f65a01254e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a7f82640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0119280 con 0x7f65a0115940 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a7f82640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0119100 con 0x7f65a010a9b0 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a7f82640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0119400 con 0x7f65a0074e40 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a54f6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65a010a9b0 0x7f65a011fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a64f8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65a0115940 0x7f65a01254e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a64f8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65a0115940 0x7f65a01254e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52598/0 (socket says 10.20.193.28:52598) 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a64f8640 1 -- 10.20.193.28:0/4140024060 learned_addr learned my addr 10.20.193.28:0/4140024060 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.552+0000 7f65a5cf7640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65a0074e40 0x7f65a011f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.553+0000 7f65a64f8640 1 -- 10.20.193.28:0/4140024060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65a0074e40 msgr2=0x7f65a011f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.553+0000 7f65a64f8640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65a0074e40 0x7f65a011f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.553+0000 7f65a64f8640 1 -- 10.20.193.28:0/4140024060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65a010a9b0 msgr2=0x7f65a011fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:30.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.553+0000 7f65a64f8640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65a010a9b0 0x7f65a011fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.553+0000 7f65a64f8640 1 -- 10.20.193.28:0/4140024060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a011aa90 con 0x7f65a0115940 2026-02-20T03:32:30.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.554+0000 7f65a64f8640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65a0115940 0x7f65a01254e0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f659c00e3c0 tx=0x7f659c00e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:30.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.554+0000 7f658effd640 1 -- 10.20.193.28:0/4140024060 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c0040d0 con 0x7f65a0115940 2026-02-20T03:32:30.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.554+0000 7f658effd640 1 -- 10.20.193.28:0/4140024060 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f659c018070 con 0x7f65a0115940 2026-02-20T03:32:30.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.554+0000 7f658effd640 1 -- 10.20.193.28:0/4140024060 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c013940 con 0x7f65a0115940 2026-02-20T03:32:30.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.554+0000 7f65a7f82640 1 -- 10.20.193.28:0/4140024060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a011ad20 con 0x7f65a0115940 2026-02-20T03:32:30.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.554+0000 7f65a7f82640 1 -- 10.20.193.28:0/4140024060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a011b1e0 con 0x7f65a0115940 2026-02-20T03:32:30.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.558+0000 7f65aa487e00 1 Processor -- start 2026-02-20T03:32:30.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.559+0000 7f658effd640 1 -- 10.20.193.28:0/4140024060 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f659c004b40 con 0x7f65a0115940 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65aa487e00 1 -- start start 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f658effd640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f657c0b0e20 0x7f657c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af8f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af8f2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af8fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f658effd640 1 -- 10.20.193.28:0/4140024060 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f659c0e0610 con 0x7f65a0115940 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65aa487e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5583af844c00 con 0x5583af8f6630 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65aa487e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5583af7f23c0 con 0x5583af8f1ee0 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65aa487e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5583af840b30 con 0x5583af8f28a0 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65a54f6640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f657c0b0e20 0x7f657c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65a5cf7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af8f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65a64f8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af8fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65a64f8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af8fe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50574/0 (socket says 10.20.193.28:50574) 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.561+0000 7f65a64f8640 1 -- 10.20.193.28:0/2164769233 learned_addr learned my addr 10.20.193.28:0/2164769233 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f65a5cf7640 1 -- 10.20.193.28:0/2164769233 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 msgr2=0x5583af8fe5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f65a5cf7640 1 --2- 10.20.193.28:0/2164769233 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af8fe5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f65a5cf7640 1 -- 10.20.193.28:0/2164769233 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 msgr2=0x5583af8f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f65a5cf7640 1 --2- 10.20.193.28:0/2164769233 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af8f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f65a5cf7640 1 -- 10.20.193.28:0/2164769233 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583af7eb840 con 0x5583af8f6630 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f65a64f8640 1 --2- 10.20.193.28:0/2164769233 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af8fe5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:30.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f65a54f6640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f657c0b0e20 0x7f657c0b32e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6594005f10 tx=0x7f659400b320 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:30.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f65a5cf7640 1 --2- 10.20.193.28:0/2164769233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af8f6a10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f6590005a40 tx=0x7f659002fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a062ec90fbbb3a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:30.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f656e4e6640 1 -- 10.20.193.28:0/2164769233 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590048070 con 0x5583af8f6630 2026-02-20T03:32:30.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f656e4e6640 1 -- 10.20.193.28:0/2164769233 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6590033040 con 0x5583af8f6630 2026-02-20T03:32:30.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.562+0000 7f656e4e6640 1 -- 10.20.193.28:0/2164769233 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590004a20 con 0x5583af8f6630 2026-02-20T03:32:30.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.563+0000 7f65aa487e00 1 -- 10.20.193.28:0/2164769233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 msgr2=0x5583af8f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:30.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.563+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2164769233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af8f6a10 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f6590005a40 tx=0x7f659002fb00 comp rx=0 tx=0).stop 2026-02-20T03:32:30.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.563+0000 7f65aa487e00 1 -- 10.20.193.28:0/2164769233 shutdown_connections 2026-02-20T03:32:30.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.563+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2164769233 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af8fe5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.563+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2164769233 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af8f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.563+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2164769233 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af8f6a10 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.563+0000 7f65aa487e00 1 -- 10.20.193.28:0/2164769233 >> 10.20.193.28:0/2164769233 conn(0x5583af8eaaa0 msgr2=0x5583af8f05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:30.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.563+0000 7f65aa487e00 1 -- 10.20.193.28:0/2164769233 shutdown_connections 2026-02-20T03:32:30.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.564+0000 7f65aa487e00 1 -- 10.20.193.28:0/2164769233 wait complete. 2026-02-20T03:32:30.567 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.565+0000 7f65aa487e00 1 -- start start 2026-02-20T03:32:30.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.565+0000 7f65aa487e00 1 Processor -- start 2026-02-20T03:32:30.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af90c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af90c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 0x5583af90a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65a5cf7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af90c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65aa487e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5583af7ec1a0 con 0x5583af8f28a0 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65a54f6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af90c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65a5cf7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af90c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37124/0 (socket says 10.20.193.28:37124) 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65a5cf7640 1 -- 10.20.193.28:0/574772529 learned_addr learned my addr 10.20.193.28:0/574772529 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5583af8fec60 con 0x5583af8f1ee0 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5583af90b160 con 0x5583af8f6630 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.566+0000 7f65a64f8640 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 0x5583af90a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.567+0000 7f65a54f6640 1 -- 10.20.193.28:0/574772529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 msgr2=0x5583af90a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.567+0000 7f65a54f6640 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 0x5583af90a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.567+0000 7f65a54f6640 1 -- 10.20.193.28:0/574772529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 msgr2=0x5583af90c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.567+0000 7f65a54f6640 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af90c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.567+0000 7f65a54f6640 1 -- 10.20.193.28:0/574772529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583af904420 con 0x5583af8f28a0 2026-02-20T03:32:30.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.567+0000 7f65a54f6640 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af90c7e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f65a011c0a0 tx=0x7f65940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b79dd96adb572d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:30.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.567+0000 7f655b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:30.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.568+0000 7f655b7fe640 1 -- 10.20.193.28:0/574772529 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594004110 con 0x5583af8f28a0 2026-02-20T03:32:30.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.568+0000 7f655b7fe640 1 -- 10.20.193.28:0/574772529 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f65940042b0 con 0x5583af8f28a0 2026-02-20T03:32:30.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.568+0000 7f655b7fe640 1 -- 10.20.193.28:0/574772529 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659401b650 con 0x5583af8f28a0 2026-02-20T03:32:30.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.568+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583af613b60 con 0x5583af8f28a0 2026-02-20T03:32:30.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.568+0000 7f65aa487e00 10 client.20418 _ll_register_callbacks cb 0x5583af7f00d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:30.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.568+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5583af84c7f0 con 0x5583af8f28a0 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.569+0000 7f655b7fe640 1 -- 10.20.193.28:0/574772529 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f6594004460 con 0x5583af8f28a0 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.569+0000 7f655b7fe640 1 -- 10.20.193.28:0/574772529 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f65940026e0 con 0x5583af8f28a0 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.570+0000 7f65aa487e00 10 client.20418 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.570+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x5583af811430 con 0x5583af8f28a0 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.571+0000 7f655b7fe640 1 -- 10.20.193.28:0/574772529 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f659402d050 con 0x5583af8f28a0 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.571+0000 7f65aa487e00 10 client.20418 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.571+0000 7f65aa487e00 10 client.20418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.571+0000 7f65aa487e00 20 client.20418 populate_metadata read hostname 'trial028' 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.571+0000 7f65aa487e00 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583af91aa80 0x5583af91cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.571+0000 7f65aa487e00 4 client.20418 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:30.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.571+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583af7c6c00 con 0x5583af91aa80 2026-02-20T03:32:30.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.571+0000 7f65a5cf7640 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583af91aa80 0x5583af91cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.572+0000 7f65a5cf7640 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583af91aa80 0x5583af91cf10 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35a4bda34eaa3616 server_cookie=ed5ab4500680d4ba in_seq=0 out_seq=0 2026-02-20T03:32:30.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.572+0000 7f655b7fe640 10 client.20418 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:30.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.573+0000 7f655b7fe640 1 -- 10.20.193.28:0/574772529 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5583af7c6c00 con 0x5583af91aa80 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.573+0000 7f655b7fe640 10 client.20418 handle_command_reply: tid=0 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.573+0000 7f65aa487e00 1 client.20418 shutdown 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.573+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 msgr2=0x5583af90c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.573+0000 7f65aa487e00 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af90c7e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f65a011c0a0 tx=0x7f65940047c0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 shutdown_connections 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f65aa487e00 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583af91aa80 0x5583af91cf10 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f65aa487e00 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 0x5583af90a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f65aa487e00 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af90c7e0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f65aa487e00 1 --2- 10.20.193.28:0/574772529 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af90c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 >> 10.20.193.28:0/574772529 conn(0x5583af8eaaa0 msgr2=0x5583af8eddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f655b7fe640 0 client.20418 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 shutdown_connections 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f65aa487e00 1 -- 10.20.193.28:0/574772529 wait complete. 2026-02-20T03:32:30.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.574+0000 7f65aa487e00 20 client.20418 trim_cache size 0 max 16384 2026-02-20T03:32:30.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65aa487e00 1 Processor -- start 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65aa487e00 1 -- start start 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af8f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af909c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af908450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65aa487e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f654c012840 con 0x5583af8f6630 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65aa487e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f654c010110 con 0x5583af8f1ee0 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65aa487e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f654c00df60 con 0x5583af8f28a0 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65a64f8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af908450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.583+0000 7f65a5cf7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af8f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f65a5cf7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af8f0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37136/0 (socket says 10.20.193.28:37136) 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f65a5cf7640 1 -- 10.20.193.28:0/875842320 learned_addr learned my addr 10.20.193.28:0/875842320 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:30.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f65a54f6640 1 --2- 10.20.193.28:0/875842320 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af909c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f65a64f8640 1 -- 10.20.193.28:0/875842320 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 msgr2=0x5583af909c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f65a64f8640 1 --2- 10.20.193.28:0/875842320 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af909c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f65a64f8640 1 -- 10.20.193.28:0/875842320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 msgr2=0x5583af8f0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f65a64f8640 1 --2- 10.20.193.28:0/875842320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af8f0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f65a64f8640 1 -- 10.20.193.28:0/875842320 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583af904250 con 0x5583af8f6630 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f65a64f8640 1 --2- 10.20.193.28:0/875842320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af908450 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f659c0a8080 tx=0x7f659c002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e4f3f1c706c6df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f656dce5640 1 -- 10.20.193.28:0/875842320 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c0b1150 con 0x5583af8f6630 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f656dce5640 1 -- 10.20.193.28:0/875842320 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f659c0b12f0 con 0x5583af8f6630 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.584+0000 7f656dce5640 1 -- 10.20.193.28:0/875842320 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c0a3d90 con 0x5583af8f6630 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 -- 10.20.193.28:0/875842320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 msgr2=0x5583af908450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 --2- 10.20.193.28:0/875842320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af908450 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f659c0a8080 tx=0x7f659c002f90 comp rx=0 tx=0).stop 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 -- 10.20.193.28:0/875842320 shutdown_connections 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 --2- 10.20.193.28:0/875842320 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f6630 0x5583af908450 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 --2- 10.20.193.28:0/875842320 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f28a0 0x5583af909c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 --2- 10.20.193.28:0/875842320 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af8f0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 -- 10.20.193.28:0/875842320 >> 10.20.193.28:0/875842320 conn(0x5583af8eaaa0 msgr2=0x5583af91b680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 -- 10.20.193.28:0/875842320 shutdown_connections 2026-02-20T03:32:30.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 -- 10.20.193.28:0/875842320 wait complete. 2026-02-20T03:32:30.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.585+0000 7f65aa487e00 1 -- start start 2026-02-20T03:32:30.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65aa487e00 1 Processor -- start 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af9169c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af913cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65aa487e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 0x5583af914230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65a5cf7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af9169c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65a54f6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af913cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65a5cf7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af9169c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37142/0 (socket says 10.20.193.28:37142) 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65a54f6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af913cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52636/0 (socket says 10.20.193.28:52636) 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65a5cf7640 1 -- 10.20.193.28:0/2327844045 learned_addr learned my addr 10.20.193.28:0/2327844045 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f654c00e5d0 con 0x5583af8f28a0 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f654c00fa40 con 0x5583af8f1ee0 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.586+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f654c00eca0 con 0x5583af8f6630 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65a64f8640 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 0x5583af914230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65a54f6640 1 -- 10.20.193.28:0/2327844045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 msgr2=0x5583af914230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65a54f6640 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 0x5583af914230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65a54f6640 1 -- 10.20.193.28:0/2327844045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 msgr2=0x5583af9169c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65a54f6640 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af9169c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65a54f6640 1 -- 10.20.193.28:0/2327844045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583af523900 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65a54f6640 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af913cf0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f659400bb90 tx=0x7f65940045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763296ec0ddc25b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f655b7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f655b7fe640 1 -- 10.20.193.28:0/2327844045 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659403e070 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583af7ff4d0 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65aa487e00 10 client.20424 _ll_register_callbacks cb 0x7f65940118b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5583af5b4a20 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.587+0000 7f655b7fe640 1 -- 10.20.193.28:0/2327844045 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5583af84c7f0 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f655b7fe640 1 -- 10.20.193.28:0/2327844045 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6594025430 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f655b7fe640 1 -- 10.20.193.28:0/2327844045 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f6594025650 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f655b7fe640 1 -- 10.20.193.28:0/2327844045 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6594025930 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f65aa487e00 10 client.20424 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x5583af904f40 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f655b7fe640 1 -- 10.20.193.28:0/2327844045 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f659404a060 con 0x5583af8f28a0 2026-02-20T03:32:30.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f65aa487e00 10 client.20424 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:30.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f65aa487e00 10 client.20424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:30.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f65aa487e00 20 client.20424 populate_metadata read hostname 'trial028' 2026-02-20T03:32:30.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583af987770 0x5583af989c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:30.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f65aa487e00 4 client.20424 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:32:30.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5583af8525a0 con 0x5583af987770 2026-02-20T03:32:30.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.588+0000 7f65a5cf7640 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583af987770 0x5583af989c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:30.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.589+0000 7f65a5cf7640 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583af987770 0x5583af989c00 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adcc266434ab045e server_cookie=8d3d47dcaf7ef7a8 in_seq=0 out_seq=0 2026-02-20T03:32:30.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.589+0000 7f655b7fe640 10 client.20424 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:30.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f655b7fe640 1 -- 10.20.193.28:0/2327844045 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5583af8525a0 con 0x5583af987770 2026-02-20T03:32:30.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f655b7fe640 10 client.20424 handle_command_reply: tid=0 2026-02-20T03:32:30.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 client.20424 shutdown 2026-02-20T03:32:30.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 msgr2=0x5583af913cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:30.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af913cf0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f659400bb90 tx=0x7f65940045d0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 shutdown_connections 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583af987770 0x5583af989c00 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583af8f6630 0x5583af914230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583af8f28a0 0x5583af913cf0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 --2- 10.20.193.28:0/2327844045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583af8f1ee0 0x5583af9169c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 >> 10.20.193.28:0/2327844045 conn(0x5583af8eaaa0 msgr2=0x5583af8efdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f655b7fe640 0 client.20424 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 shutdown_connections 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 1 -- 10.20.193.28:0/2327844045 wait complete. 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.592+0000 7f65aa487e00 20 client.20424 trim_cache size 0 max 16384 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "21eaf496-1452-4252-bae9-fac39f2f8102", 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 -- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f657c0b0e20 msgr2=0x7f657c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f657c0b0e20 0x7f657c0b32e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6594005f10 tx=0x7f659400b320 comp rx=0 tx=0).stop 2026-02-20T03:32:30.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 -- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65a0115940 msgr2=0x7f65a01254e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:30.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65a0115940 0x7f65a01254e0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f659c00e3c0 tx=0x7f659c00e890 comp rx=0 tx=0).stop 2026-02-20T03:32:30.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 -- 10.20.193.28:0/4140024060 shutdown_connections 2026-02-20T03:32:30.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f657c0b0e20 0x7f657c0b32e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f65a0115940 0x7f65a01254e0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f65a010a9b0 0x7f65a011fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 --2- 10.20.193.28:0/4140024060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f65a0074e40 0x7f65a011f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:30.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 -- 10.20.193.28:0/4140024060 >> 10.20.193.28:0/4140024060 conn(0x7f65a006ec00 msgr2=0x7f65a010d850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:30.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 -- 10.20.193.28:0/4140024060 shutdown_connections 2026-02-20T03:32:30.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:30.593+0000 7f65a7f82640 1 -- 10.20.193.28:0/4140024060 wait complete. 2026-02-20T03:32:30.708 INFO:tasks.workunit.client.0.trial028.stdout: 10 89935 12.88 MB/sec execute 121 sec latency 46.154 ms 2026-02-20T03:32:30.714 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:32:31.024 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:32:31.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.248+0000 7f0a17fff640 1 -- 10.20.193.28:0/3640196486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a18105320 msgr2=0x7f0a18111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:31.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.248+0000 7f0a17fff640 1 --2- 10.20.193.28:0/3640196486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a18105320 0x7f0a18111850 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800b0d0 tx=0x7f0a0802f490 comp rx=0 tx=0).stop 2026-02-20T03:32:31.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.248+0000 7f0a17fff640 1 -- 10.20.193.28:0/3640196486 shutdown_connections 2026-02-20T03:32:31.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.248+0000 7f0a17fff640 1 --2- 10.20.193.28:0/3640196486 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a18105320 0x7f0a18111850 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.248+0000 7f0a17fff640 1 --2- 10.20.193.28:0/3640196486 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a18104980 0x7f0a18104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.248+0000 7f0a17fff640 1 --2- 10.20.193.28:0/3640196486 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a1810a980 0x7f0a1810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.248+0000 7f0a17fff640 1 -- 10.20.193.28:0/3640196486 >> 10.20.193.28:0/3640196486 conn(0x7f0a18100680 msgr2=0x7f0a18102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:31.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.254+0000 7f0a17fff640 1 -- 10.20.193.28:0/3640196486 shutdown_connections 2026-02-20T03:32:31.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.254+0000 7f0a17fff640 1 -- 10.20.193.28:0/3640196486 wait complete. 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.255+0000 7f0a17fff640 1 Processor -- start 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.255+0000 7f0a17fff640 1 -- start start 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.255+0000 7f0a17fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a18104980 0x7f0a181116a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.255+0000 7f0a17fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a18105320 0x7f0a1810e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.255+0000 7f0a17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a1810a980 0x7f0a1810ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.255+0000 7f0a17fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18114cd0 con 0x7f0a1810a980 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.255+0000 7f0a17fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18114b50 con 0x7f0a18105320 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.255+0000 7f0a17fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18114e50 con 0x7f0a18104980 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a16ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a18104980 0x7f0a181116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a1810a980 0x7f0a1810ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a16ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a18104980 0x7f0a181116a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50630/0 (socket says 10.20.193.28:50630) 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a16ffd640 1 -- 10.20.193.28:0/838467368 learned_addr learned my addr 10.20.193.28:0/838467368 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a167fc640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a18105320 0x7f0a1810e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a177fe640 1 -- 10.20.193.28:0/838467368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a18104980 msgr2=0x7f0a181116a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a177fe640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a18104980 0x7f0a181116a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a177fe640 1 -- 10.20.193.28:0/838467368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a18105320 msgr2=0x7f0a1810e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a177fe640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a18105320 0x7f0a1810e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a177fe640 1 -- 10.20.193.28:0/838467368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1810f590 con 0x7f0a1810a980 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a177fe640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a1810a980 0x7f0a1810ecd0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800c090 tx=0x7f0a08009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a1ca1f640 1 -- 10.20.193.28:0/838467368 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a08002a60 con 0x7f0a1810a980 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a1ca1f640 1 -- 10.20.193.28:0/838467368 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a08007d60 con 0x7f0a1810a980 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.256+0000 7f0a1ca1f640 1 -- 10.20.193.28:0/838467368 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a08038c70 con 0x7f0a1810a980 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.257+0000 7f0a17fff640 1 -- 10.20.193.28:0/838467368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a181a3210 con 0x7f0a1810a980 2026-02-20T03:32:31.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.257+0000 7f0a17fff640 1 -- 10.20.193.28:0/838467368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a181a3700 con 0x7f0a1810a980 2026-02-20T03:32:31.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.260+0000 7f0a1ca1f640 1 -- 10.20.193.28:0/838467368 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0a08038420 con 0x7f0a1810a980 2026-02-20T03:32:31.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.260+0000 7f0a1ff26e00 1 Processor -- start 2026-02-20T03:32:31.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.261+0000 7f0a1ff26e00 1 -- start start 2026-02-20T03:32:31.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.261+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adc5000 0x55611adc53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.261+0000 7f0a1ca1f640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09ec0b0e20 0x7f09ec0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.261+0000 7f0a1ca1f640 1 -- 10.20.193.28:0/838467368 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f0a08105a80 con 0x7f0a1810a980 2026-02-20T03:32:31.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09ec0b0e20 0x7f09ec0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611adbfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611adcbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55611ad3fe50 con 0x55611adbf630 2026-02-20T03:32:31.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55611ad129c0 con 0x55611adbffb0 2026-02-20T03:32:31.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55611acc0240 con 0x55611adc5000 2026-02-20T03:32:31.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a177fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611adcbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09ec0b0e20 0x7f09ec0b32e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c004660 tx=0x7f0a0c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:31.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a177fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611adcbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37170/0 (socket says 10.20.193.28:37170) 2026-02-20T03:32:31.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.262+0000 7f0a177fe640 1 -- 10.20.193.28:0/3853536120 learned_addr learned my addr 10.20.193.28:0/3853536120 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.263+0000 7f0a177fe640 1 -- 10.20.193.28:0/3853536120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adc5000 msgr2=0x55611adc53e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.263+0000 7f0a177fe640 1 --2- 10.20.193.28:0/3853536120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adc5000 0x55611adc53e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.263+0000 7f0a177fe640 1 -- 10.20.193.28:0/3853536120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 msgr2=0x55611adbfa70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.263+0000 7f0a177fe640 1 --2- 10.20.193.28:0/3853536120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611adbfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.263+0000 7f0a177fe640 1 -- 10.20.193.28:0/3853536120 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55611acd3420 con 0x55611adbffb0 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.263+0000 7f0a177fe640 1 --2- 10.20.193.28:0/3853536120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611adcbe30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0a080cd3d0 tx=0x7f0a08004a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87dae3e947e8733f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.263+0000 7f09dbfff640 1 -- 10.20.193.28:0/3853536120 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a080d1a80 con 0x55611adbffb0 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.263+0000 7f09dbfff640 1 -- 10.20.193.28:0/3853536120 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a08033050 con 0x55611adbffb0 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.263+0000 7f09dbfff640 1 -- 10.20.193.28:0/3853536120 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a080d1a80 con 0x55611adbffb0 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.264+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3853536120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 msgr2=0x55611adcbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.264+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3853536120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611adcbe30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0a080cd3d0 tx=0x7f0a08004a30 comp rx=0 tx=0).stop 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.264+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3853536120 shutdown_connections 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.264+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3853536120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611adcbe30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.264+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3853536120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611adbfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.264+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3853536120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adc5000 0x55611adc53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.264+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3853536120 >> 10.20.193.28:0/3853536120 conn(0x55611ad82290 msgr2=0x55611adbdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:31.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.264+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3853536120 shutdown_connections 2026-02-20T03:32:31.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.265+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3853536120 wait complete. 2026-02-20T03:32:31.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.266+0000 7f0a1ff26e00 1 -- start start 2026-02-20T03:32:31.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.266+0000 7f0a1ff26e00 1 Processor -- start 2026-02-20T03:32:31.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adda120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 0x55611add8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52676/0 (socket says 10.20.193.28:52676) 2026-02-20T03:32:31.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a167fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a167fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adda120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50652/0 (socket says 10.20.193.28:50652) 2026-02-20T03:32:31.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55611ad0e8f0 con 0x55611adbf630 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55611ab00f50 con 0x55611adc5000 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55611add88b0 con 0x55611adbffb0 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a16ffd640 1 -- 10.20.193.28:0/128784182 learned_addr learned my addr 10.20.193.28:0/128784182 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.267+0000 7f0a177fe640 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 0x55611add8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.268+0000 7f0a167fc640 1 -- 10.20.193.28:0/128784182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 msgr2=0x55611add8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.268+0000 7f0a167fc640 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 0x55611add8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.268+0000 7f0a167fc640 1 -- 10.20.193.28:0/128784182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 msgr2=0x55611add9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.268+0000 7f0a167fc640 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.268+0000 7f0a167fc640 1 -- 10.20.193.28:0/128784182 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55611add1780 con 0x55611adbffb0 2026-02-20T03:32:31.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.268+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.268+0000 7f0a167fc640 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adda120 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0a1810ffa0 tx=0x7f0a0000d600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5696a1d59c5c67a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.268+0000 7f09d97fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.269+0000 7f09d97fa640 1 -- 10.20.193.28:0/128784182 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00018070 con 0x55611adbffb0 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.269+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/128784182 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55611aae3b40 con 0x55611adbffb0 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.269+0000 7f0a1ff26e00 10 client.28300 _ll_register_callbacks cb 0x55611ad4bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.269+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/128784182 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55611ad201a0 con 0x55611adbffb0 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.269+0000 7f09d97fa640 1 -- 10.20.193.28:0/128784182 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a00004570 con 0x55611adbffb0 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.269+0000 7f09d97fa640 1 -- 10.20.193.28:0/128784182 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a000136c0 con 0x55611adbffb0 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.269+0000 7f09d97fa640 1 -- 10.20.193.28:0/128784182 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f0a00002780 con 0x55611adbffb0 2026-02-20T03:32:31.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.270+0000 7f09d97fa640 1 -- 10.20.193.28:0/128784182 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f0a00002a40 con 0x55611adbffb0 2026-02-20T03:32:31.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.271+0000 7f0a1ff26e00 10 client.28300 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:31.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.271+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/128784182 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55611accd230 con 0x55611adbffb0 2026-02-20T03:32:31.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.271+0000 7f09d97fa640 1 -- 10.20.193.28:0/128784182 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f0a00004080 con 0x55611adbffb0 2026-02-20T03:32:31.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.272+0000 7f0a1ff26e00 10 client.28300 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:31.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.272+0000 7f0a1ff26e00 10 client.28300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:31.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.272+0000 7f0a1ff26e00 20 client.28300 populate_metadata read hostname 'trial028' 2026-02-20T03:32:31.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.272+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55611ade82b0 0x55611adea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.272+0000 7f0a1ff26e00 4 client.28300 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:31.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.272+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/128784182 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55611ad1a5b0 con 0x55611ade82b0 2026-02-20T03:32:31.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.272+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55611ade82b0 0x55611adea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.272+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55611ade82b0 0x55611adea6a0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5acafbe91d96b1ba server_cookie=31150f1df6d36e51 in_seq=0 out_seq=0 2026-02-20T03:32:31.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.272+0000 7f09d97fa640 10 client.28300 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:31.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.273+0000 7f09d97fa640 1 -- 10.20.193.28:0/128784182 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55611ad1a5b0 con 0x55611ade82b0 2026-02-20T03:32:31.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.273+0000 7f09d97fa640 10 client.28300 handle_command_reply: tid=0 2026-02-20T03:32:31.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.273+0000 7f0a1ff26e00 1 client.28300 shutdown 2026-02-20T03:32:31.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.273+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/128784182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 msgr2=0x55611adda120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:31.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.273+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adda120 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0a1810ffa0 tx=0x7f0a0000d600 comp rx=0 tx=0).stop 2026-02-20T03:32:31.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.274+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/128784182 shutdown_connections 2026-02-20T03:32:31.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.274+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55611ade82b0 0x55611adea6a0 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.274+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 0x55611add8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.274+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adda120 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.274+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/128784182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.274+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/128784182 >> 10.20.193.28:0/128784182 conn(0x55611ad82290 msgr2=0x55611adbe440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:31.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.274+0000 7f09d97fa640 0 client.28300 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:31.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.274+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/128784182 shutdown_connections 2026-02-20T03:32:31.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.275+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/128784182 wait complete. 2026-02-20T03:32:31.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.275+0000 7f0a1ff26e00 20 client.28300 trim_cache size 0 max 16384 2026-02-20T03:32:31.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.285+0000 7f0a1ff26e00 1 Processor -- start 2026-02-20T03:32:31.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.285+0000 7f0a1ff26e00 1 -- start start 2026-02-20T03:32:31.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.285+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.285+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adeff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.285+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 0x55611adf0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.285+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc012770 con 0x55611adbf630 2026-02-20T03:32:31.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.285+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc010040 con 0x55611adc5000 2026-02-20T03:32:31.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.285+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc00de90 con 0x55611adbffb0 2026-02-20T03:32:31.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.286+0000 7f0a167fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adeff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.286+0000 7f0a16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.286+0000 7f0a177fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 0x55611adf0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.286+0000 7f0a177fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 0x55611adf0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:37186/0 (socket says 10.20.193.28:37186) 2026-02-20T03:32:31.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.286+0000 7f0a177fe640 1 -- 10.20.193.28:0/1241521463 learned_addr learned my addr 10.20.193.28:0/1241521463 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:31.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.287+0000 7f0a16ffd640 1 -- 10.20.193.28:0/1241521463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 msgr2=0x55611adeff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:31.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.287+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/1241521463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adeff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.287+0000 7f0a16ffd640 1 -- 10.20.193.28:0/1241521463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 msgr2=0x55611adf0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:31.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.287+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/1241521463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 0x55611adf0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.287+0000 7f0a16ffd640 1 -- 10.20.193.28:0/1241521463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55611add15b0 con 0x55611adbf630 2026-02-20T03:32:31.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.288+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/1241521463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add5be0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x55611adeaee0 tx=0x7f0a0c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6819ec4b5b9ce68 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:31.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.288+0000 7f09db7fe640 1 -- 10.20.193.28:0/1241521463 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0098d0 con 0x55611adbf630 2026-02-20T03:32:31.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.288+0000 7f09db7fe640 1 -- 10.20.193.28:0/1241521463 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a0c02c070 con 0x55611adbf630 2026-02-20T03:32:31.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.288+0000 7f09db7fe640 1 -- 10.20.193.28:0/1241521463 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c012650 con 0x55611adbf630 2026-02-20T03:32:31.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.289+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/1241521463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 msgr2=0x55611add5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:31.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.289+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/1241521463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add5be0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x55611adeaee0 tx=0x7f0a0c011000 comp rx=0 tx=0).stop 2026-02-20T03:32:31.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.289+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/1241521463 shutdown_connections 2026-02-20T03:32:31.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.289+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/1241521463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adc5000 0x55611adf0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.289+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/1241521463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbffb0 0x55611adeff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.289+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/1241521463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adbf630 0x55611add5be0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.289+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/1241521463 >> 10.20.193.28:0/1241521463 conn(0x55611ad82290 msgr2=0x55611adea220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:31.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.290+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/1241521463 shutdown_connections 2026-02-20T03:32:31.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.290+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/1241521463 wait complete. 2026-02-20T03:32:31.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.290+0000 7f0a1ff26e00 1 -- start start 2026-02-20T03:32:31.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.290+0000 7f0a1ff26e00 1 Processor -- start 2026-02-20T03:32:31.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.291+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbf630 0x55611ade0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.291+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611ade0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.291+0000 7f0a1ff26e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adc5000 0x55611ae52110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.291+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc00e500 con 0x55611adc5000 2026-02-20T03:32:31.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.291+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc00f970 con 0x55611adbffb0 2026-02-20T03:32:31.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.291+0000 7f0a1ff26e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f09bc00ebd0 con 0x55611adbf630 2026-02-20T03:32:31.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.291+0000 7f0a177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adc5000 0x55611ae52110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.291+0000 7f0a16ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbf630 0x55611ade0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.292+0000 7f0a16ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbf630 0x55611ade0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50670/0 (socket says 10.20.193.28:50670) 2026-02-20T03:32:31.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.292+0000 7f0a16ffd640 1 -- 10.20.193.28:0/3186198974 learned_addr learned my addr 10.20.193.28:0/3186198974 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:31.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.292+0000 7f0a167fc640 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611ade0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.292+0000 7f0a177fe640 1 -- 10.20.193.28:0/3186198974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbf630 msgr2=0x55611ade0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.292+0000 7f0a177fe640 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbf630 0x55611ade0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.292+0000 7f0a177fe640 1 -- 10.20.193.28:0/3186198974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 msgr2=0x55611ade0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.292+0000 7f0a177fe640 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611ade0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.292+0000 7f0a177fe640 1 -- 10.20.193.28:0/3186198974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55611a9f1870 con 0x55611adc5000 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.292+0000 7f0a177fe640 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adc5000 0x55611ae52110 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f0a08004030 tx=0x7f0a0802f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e8bf385924ad2d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.293+0000 7f09d97fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.293+0000 7f09d97fa640 1 -- 10.20.193.28:0/3186198974 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a080ec070 con 0x55611adc5000 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.293+0000 7f09d97fa640 1 -- 10.20.193.28:0/3186198974 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0a080d69c0 con 0x55611adc5000 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.293+0000 7f09d97fa640 1 -- 10.20.193.28:0/3186198974 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a080cc940 con 0x55611adc5000 2026-02-20T03:32:31.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.293+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3186198974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55611acb2440 con 0x55611adc5000 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.294+0000 7f09d97fa640 1 -- 10.20.193.28:0/3186198974 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f0a080c8df0 con 0x55611adc5000 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.294+0000 7f09d97fa640 10 client.20439 inactive, discarding osd_map(98..98 src has 1..98) 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.294+0000 7f0a1ff26e00 10 client.20439 _ll_register_callbacks cb 0x7f0a00007140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.294+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3186198974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a08033050 con 0x55611adc5000 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.294+0000 7f09d97fa640 1 -- 10.20.193.28:0/3186198974 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f0a080d1a80 con 0x55611adc5000 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.294+0000 7f0a1ff26e00 10 client.20439 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.294+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3186198974 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x55611add22a0 con 0x55611adc5000 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.295+0000 7f09d97fa640 1 -- 10.20.193.28:0/3186198974 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f0a080f3070 con 0x55611adc5000 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.295+0000 7f0a1ff26e00 10 client.20439 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:31.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.295+0000 7f0a1ff26e00 10 client.20439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:31.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.295+0000 7f0a1ff26e00 20 client.20439 populate_metadata read hostname 'trial028' 2026-02-20T03:32:31.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.295+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55611ae53960 0x55611ae55df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:31.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.295+0000 7f0a1ff26e00 4 client.20439 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:32:31.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.295+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3186198974 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55611ace3810 con 0x55611ae53960 2026-02-20T03:32:31.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.295+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55611ae53960 0x55611ae55df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:31.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.296+0000 7f0a16ffd640 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55611ae53960 0x55611ae55df0 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24aba085ecc16000 server_cookie=5541defeda2850c3 in_seq=0 out_seq=0 2026-02-20T03:32:31.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.296+0000 7f09d97fa640 10 client.20439 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:31.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f09d97fa640 1 -- 10.20.193.28:0/3186198974 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55611ace3810 con 0x55611ae53960 2026-02-20T03:32:31.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f09d97fa640 10 client.20439 handle_command_reply: tid=0 2026-02-20T03:32:31.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 client.20439 shutdown 2026-02-20T03:32:31.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3186198974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adc5000 msgr2=0x55611ae52110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adc5000 0x55611ae52110 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f0a08004030 tx=0x7f0a0802f490 comp rx=0 tx=0).stop 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3186198974 shutdown_connections 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55611ae53960 0x55611ae55df0 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55611adc5000 0x55611ae52110 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55611adbffb0 0x55611ade0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 --2- 10.20.193.28:0/3186198974 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55611adbf630 0x55611ade0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3186198974 >> 10.20.193.28:0/3186198974 conn(0x55611ad82290 msgr2=0x55611adea220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f09d97fa640 0 client.20439 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3186198974 shutdown_connections 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 1 -- 10.20.193.28:0/3186198974 wait complete. 2026-02-20T03:32:31.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.297+0000 7f0a1ff26e00 20 client.20439 trim_cache size 0 max 16384 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout: "21eaf496-1452-4252-bae9-fac39f2f8102": { 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "21eaf496-1452-4252-bae9-fac39f2f8102", 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:32:31.303 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:32:31.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 -- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09ec0b0e20 msgr2=0x7f09ec0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:31.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09ec0b0e20 0x7f09ec0b32e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c004660 tx=0x7f0a0c009290 comp rx=0 tx=0).stop 2026-02-20T03:32:31.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 -- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a1810a980 msgr2=0x7f0a1810ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:31.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a1810a980 0x7f0a1810ecd0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800c090 tx=0x7f0a08009300 comp rx=0 tx=0).stop 2026-02-20T03:32:31.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 -- 10.20.193.28:0/838467368 shutdown_connections 2026-02-20T03:32:31.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f09ec0b0e20 0x7f09ec0b32e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0a1810a980 0x7f0a1810ecd0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0a18105320 0x7f0a1810e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 --2- 10.20.193.28:0/838467368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0a18104980 0x7f0a181116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:31.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 -- 10.20.193.28:0/838467368 >> 10.20.193.28:0/838467368 conn(0x7f0a18100680 msgr2=0x7f0a18100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:31.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 -- 10.20.193.28:0/838467368 shutdown_connections 2026-02-20T03:32:31.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:32:31.298+0000 7f0a17fff640 1 -- 10.20.193.28:0/838467368 wait complete. 2026-02-20T03:32:31.446 INFO:tasks.cephfs.filesystem:scrub status for tag:21eaf496-1452-4252-bae9-fac39f2f8102 - {'path': '/', 'tag': '21eaf496-1452-4252-bae9-fac39f2f8102', 'options': 'recursive,force'} 2026-02-20T03:32:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:31 trial028 ceph-mon[38552]: pgmap v720: 129 pgs: 129 active+clean; 500 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 9.6 MiB/s rd, 1.9 MiB/s wr, 301 op/s 2026-02-20T03:32:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:31 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:32:31.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:31 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:31.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 91434 13.43 MB/sec execute 122 sec latency 45.437 ms 2026-02-20T03:32:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:31 trial177 ceph-mon[43181]: pgmap v720: 129 pgs: 129 active+clean; 500 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 9.6 MiB/s rd, 1.9 MiB/s wr, 301 op/s 2026-02-20T03:32:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:31 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:32:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:31 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:31 trial126 ceph-mon[38476]: pgmap v720: 129 pgs: 129 active+clean; 500 MiB data, 6.8 GiB used, 8.2 TiB / 8.2 TiB avail; 9.6 MiB/s rd, 1.9 MiB/s wr, 301 op/s 2026-02-20T03:32:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:31 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:32:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:31 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 92992 14.07 MB/sec execute 123 sec latency 51.938 ms 2026-02-20T03:32:32.712 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:32 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:32:32.712 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:32 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.712 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:32 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:32:32.712 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:32 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:32:32.712 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:32 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.712 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:32 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:32:32.712 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:32 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.712 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:32 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:32 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:32:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:32 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:32 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:32:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:32 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:32:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:32 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:32 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:32:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:32 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:32 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:32 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:32:32.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:32 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:32 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:32:32.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:32 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:32:32.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:32 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:32 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:32:32.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:32 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:32.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:32 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:32:33.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 94152 14.42 MB/sec execute 124 sec latency 73.853 ms 2026-02-20T03:32:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:33 trial177 ceph-mon[43181]: pgmap v721: 129 pgs: 129 active+clean; 502 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 2.2 MiB/s wr, 338 op/s 2026-02-20T03:32:33.816 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:33 trial028 ceph-mon[38552]: pgmap v721: 129 pgs: 129 active+clean; 502 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 2.2 MiB/s wr, 338 op/s 2026-02-20T03:32:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:33 trial126 ceph-mon[38476]: pgmap v721: 129 pgs: 129 active+clean; 502 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 2.2 MiB/s wr, 338 op/s 2026-02-20T03:32:34.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 95900 15.06 MB/sec execute 125 sec latency 33.460 ms 2026-02-20T03:32:34.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:34 trial126 ceph-mon[38476]: pgmap v722: 129 pgs: 129 active+clean; 518 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 14 MiB/s rd, 4.0 MiB/s wr, 562 op/s 2026-02-20T03:32:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:34 trial028 ceph-mon[38552]: pgmap v722: 129 pgs: 129 active+clean; 518 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 14 MiB/s rd, 4.0 MiB/s wr, 562 op/s 2026-02-20T03:32:34.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:34 trial177 ceph-mon[43181]: pgmap v722: 129 pgs: 129 active+clean; 518 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 14 MiB/s rd, 4.0 MiB/s wr, 562 op/s 2026-02-20T03:32:35.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 97544 15.62 MB/sec execute 126 sec latency 33.263 ms 2026-02-20T03:32:36.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 98997 16.13 MB/sec execute 127 sec latency 48.908 ms 2026-02-20T03:32:37.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:37 trial028 ceph-mon[38552]: pgmap v723: 129 pgs: 129 active+clean; 532 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 5.6 MiB/s wr, 750 op/s 2026-02-20T03:32:37.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:37 trial126 ceph-mon[38476]: pgmap v723: 129 pgs: 129 active+clean; 532 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 5.6 MiB/s wr, 750 op/s 2026-02-20T03:32:37.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 100727 16.71 MB/sec execute 128 sec latency 51.017 ms 2026-02-20T03:32:37.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:37 trial177 ceph-mon[43181]: pgmap v723: 129 pgs: 129 active+clean; 532 MiB data, 6.9 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 5.6 MiB/s wr, 750 op/s 2026-02-20T03:32:38.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:38 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:32:38.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:38 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:32:38.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:38 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:32:38.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:38 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:32:38.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:38 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:32:38.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:38 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:32:38.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 102381 17.31 MB/sec execute 129 sec latency 28.870 ms 2026-02-20T03:32:38.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:38 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:32:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:38 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:32:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:38 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:32:39.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:39 trial126 ceph-mon[38476]: pgmap v724: 129 pgs: 129 active+clean; 536 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 6.1 MiB/s wr, 782 op/s 2026-02-20T03:32:39.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:39 trial028 ceph-mon[38552]: pgmap v724: 129 pgs: 129 active+clean; 536 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 6.1 MiB/s wr, 782 op/s 2026-02-20T03:32:39.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 104080 17.87 MB/sec execute 130 sec latency 70.512 ms 2026-02-20T03:32:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:39 trial177 ceph-mon[43181]: pgmap v724: 129 pgs: 129 active+clean; 536 MiB data, 7.1 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 6.1 MiB/s wr, 782 op/s 2026-02-20T03:32:39.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.781+0000 7f813e22e640 1 -- 10.20.193.28:0/1847652677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8138109e60 msgr2=0x7f813810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:39.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.781+0000 7f813e22e640 1 --2- 10.20.193.28:0/1847652677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8138109e60 0x7f813810a2e0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f812c009a30 tx=0x7f812c02f220 comp rx=0 tx=0).stop 2026-02-20T03:32:39.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.782+0000 7f813e22e640 1 -- 10.20.193.28:0/1847652677 shutdown_connections 2026-02-20T03:32:39.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.782+0000 7f813e22e640 1 --2- 10.20.193.28:0/1847652677 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f813810a900 0x7f8138111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.782+0000 7f813e22e640 1 --2- 10.20.193.28:0/1847652677 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8138109e60 0x7f813810a2e0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.782+0000 7f813e22e640 1 --2- 10.20.193.28:0/1847652677 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8138109490 0x7f8138109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.782+0000 7f813e22e640 1 -- 10.20.193.28:0/1847652677 >> 10.20.193.28:0/1847652677 conn(0x7f8138077fe0 msgr2=0x7f813807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:39.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.782+0000 7f813e22e640 1 -- 10.20.193.28:0/1847652677 shutdown_connections 2026-02-20T03:32:39.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.782+0000 7f813e22e640 1 -- 10.20.193.28:0/1847652677 wait complete. 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.782+0000 7f813e22e640 1 Processor -- start 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.782+0000 7f813e22e640 1 -- start start 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813e22e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8138109490 0x7f81381a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813e22e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8138109e60 0x7f81381a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813e22e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f813810a900 0x7f81381a8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813e22e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8138114910 con 0x7f8138109490 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813e22e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8138114790 con 0x7f8138109e60 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813e22e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8138114a90 con 0x7f813810a900 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813d22c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8138109490 0x7f81381a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813d22c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8138109490 0x7f81381a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50990/0 (socket says 10.20.193.28:50990) 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813d22c640 1 -- 10.20.193.28:0/1092323488 learned_addr learned my addr 10.20.193.28:0/1092323488 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:39.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813da2d640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f813810a900 0x7f81381a8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813ca2b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8138109e60 0x7f81381a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813da2d640 1 -- 10.20.193.28:0/1092323488 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8138109e60 msgr2=0x7f81381a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813da2d640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8138109e60 0x7f81381a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813da2d640 1 -- 10.20.193.28:0/1092323488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8138109490 msgr2=0x7f81381a0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813da2d640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8138109490 0x7f81381a0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.783+0000 7f813da2d640 1 -- 10.20.193.28:0/1092323488 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81381a8c30 con 0x7f813810a900 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.784+0000 7f813da2d640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f813810a900 0x7f81381a8530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f813400efc0 tx=0x7f813400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.784+0000 7f81267fc640 1 -- 10.20.193.28:0/1092323488 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134019070 con 0x7f813810a900 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.784+0000 7f813e22e640 1 -- 10.20.193.28:0/1092323488 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81381a8ec0 con 0x7f813810a900 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.784+0000 7f813e22e640 1 -- 10.20.193.28:0/1092323488 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381a9380 con 0x7f813810a900 2026-02-20T03:32:39.788 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.784+0000 7f81267fc640 1 -- 10.20.193.28:0/1092323488 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f81340092d0 con 0x7f813810a900 2026-02-20T03:32:39.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.784+0000 7f81267fc640 1 -- 10.20.193.28:0/1092323488 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134007500 con 0x7f813810a900 2026-02-20T03:32:39.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.787+0000 7f81267fc640 1 -- 10.20.193.28:0/1092323488 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f81340076a0 con 0x7f813810a900 2026-02-20T03:32:39.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.788+0000 7f81267fc640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81140b0e20 0x7f81140b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.788+0000 7f81267fc640 1 -- 10.20.193.28:0/1092323488 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f81340e08d0 con 0x7f813810a900 2026-02-20T03:32:39.792 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.788+0000 7f81423f5e00 1 Processor -- start 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f81423f5e00 1 -- start start 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81140b0e20 0x7f81140b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb4e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4e7c0 0x560abdb52f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb53560 0x560abdb559f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f81423f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560abda9e8f0 con 0x560abdb4e7c0 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f81423f5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560abda4c2e0 con 0x560abdb53560 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f81423f5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560abda9a820 con 0x560abdb4de80 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb4e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.793 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81140b0e20 0x7f81140b32e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f81280059c0 tx=0x7f8128009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb4e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60900/0 (socket says 10.20.193.28:60900) 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 -- 10.20.193.28:0/1397131847 learned_addr learned my addr 10.20.193.28:0/1397131847 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813da2d640 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb53560 0x560abdb559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813ca2b640 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4e7c0 0x560abdb52f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 -- 10.20.193.28:0/1397131847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb53560 msgr2=0x560abdb559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb53560 0x560abdb559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 -- 10.20.193.28:0/1397131847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4e7c0 msgr2=0x560abdb52f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4e7c0 0x560abdb52f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813d22c640 1 -- 10.20.193.28:0/1397131847 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560abda3e5a0 con 0x560abdb4de80 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.789+0000 7f813ca2b640 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4e7c0 0x560abdb52f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:39.794 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f813d22c640 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb4e280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8128004670 tx=0x7f8128014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1d5f315633f0852 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81057fe640 1 -- 10.20.193.28:0/1397131847 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128012bd0 con 0x560abdb4de80 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81057fe640 1 -- 10.20.193.28:0/1397131847 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8128012d70 con 0x560abdb4de80 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81057fe640 1 -- 10.20.193.28:0/1397131847 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128025630 con 0x560abdb4de80 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81423f5e00 1 -- 10.20.193.28:0/1397131847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 msgr2=0x560abdb4e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb4e280 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8128004670 tx=0x7f8128014000 comp rx=0 tx=0).stop 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81423f5e00 1 -- 10.20.193.28:0/1397131847 shutdown_connections 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb53560 0x560abdb559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4e7c0 0x560abdb52f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1397131847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb4e280 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81423f5e00 1 -- 10.20.193.28:0/1397131847 >> 10.20.193.28:0/1397131847 conn(0x560abdb456f0 msgr2=0x560abdb4c570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81423f5e00 1 -- 10.20.193.28:0/1397131847 shutdown_connections 2026-02-20T03:32:39.795 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.790+0000 7f81423f5e00 1 -- 10.20.193.28:0/1397131847 wait complete. 2026-02-20T03:32:39.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.792+0000 7f81423f5e00 1 -- start start 2026-02-20T03:32:39.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.792+0000 7f81423f5e00 1 Processor -- start 2026-02-20T03:32:39.798 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.792+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4de80 0x560abdb669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4e7c0 0x560abdb66f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 0x560abdb6dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f81423f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560abda460c0 con 0x560abdb53560 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f81423f5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560abdb56610 con 0x560abdb4de80 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f81423f5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560abdb6e430 con 0x560abdb4e7c0 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813d22c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4de80 0x560abdb669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813d22c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4de80 0x560abdb669e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59992/0 (socket says 10.20.193.28:59992) 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813d22c640 1 -- 10.20.193.28:0/1863468062 learned_addr learned my addr 10.20.193.28:0/1863468062 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813ca2b640 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4e7c0 0x560abdb66f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813da2d640 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 0x560abdb6dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.799 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813da2d640 1 -- 10.20.193.28:0/1863468062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4e7c0 msgr2=0x560abdb66f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813da2d640 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4e7c0 0x560abdb66f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813da2d640 1 -- 10.20.193.28:0/1863468062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4de80 msgr2=0x560abdb669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813da2d640 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4de80 0x560abdb669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813da2d640 1 -- 10.20.193.28:0/1863468062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560abdb60100 con 0x560abdb53560 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.793+0000 7f813d22c640 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4de80 0x560abdb669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f813da2d640 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 0x560abdb6dea0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f81340a5680 tx=0x7f81340a7b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6c45791cdaba83 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f80f27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f80f27fc640 1 -- 10.20.193.28:0/1863468062 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134004d50 con 0x560abdb53560 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f81423f5e00 1 -- 10.20.193.28:0/1863468062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560abda5a820 con 0x560abdb53560 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f81423f5e00 10 client.20451 _ll_register_callbacks cb 0x560abda49ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f81423f5e00 1 -- 10.20.193.28:0/1863468062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560abdaa64e0 con 0x560abdb53560 2026-02-20T03:32:39.800 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f80f27fc640 1 -- 10.20.193.28:0/1863468062 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x560abdaa64e0 con 0x560abdb53560 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f80f27fc640 1 -- 10.20.193.28:0/1863468062 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134002a60 con 0x560abdb53560 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f80f27fc640 1 -- 10.20.193.28:0/1863468062 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f8134002c00 con 0x560abdb53560 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.794+0000 7f80f27fc640 1 -- 10.20.193.28:0/1863468062 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f81340b0d50 con 0x560abdb53560 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.795+0000 7f81423f5e00 10 client.20451 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.795+0000 7f81423f5e00 1 -- 10.20.193.28:0/1863468062 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=42}) -- 0x560abda5f380 con 0x560abdb53560 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.795+0000 7f80f27fc640 1 -- 10.20.193.28:0/1863468062 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f81340b0ef0 con 0x560abdb53560 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.795+0000 7f81423f5e00 10 client.20451 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.795+0000 7f81423f5e00 10 client.20451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.795+0000 7f81423f5e00 20 client.20451 populate_metadata read hostname 'trial028' 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.795+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560abdb726f0 0x560abdb74b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.795+0000 7f81423f5e00 4 client.20451 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:39.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.795+0000 7f81423f5e00 1 -- 10.20.193.28:0/1863468062 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560abda20bd0 con 0x560abdb726f0 2026-02-20T03:32:39.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.796+0000 7f813d22c640 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560abdb726f0 0x560abdb74b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.796+0000 7f813d22c640 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560abdb726f0 0x560abdb74b40 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b2f61125a92d24 server_cookie=827a1168ae33d316 in_seq=0 out_seq=0 2026-02-20T03:32:39.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.796+0000 7f80f27fc640 10 client.20451 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:39.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f80f27fc640 1 -- 10.20.193.28:0/1863468062 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560abda20bd0 con 0x560abdb726f0 2026-02-20T03:32:39.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f80f27fc640 10 client.20451 handle_command_reply: tid=0 2026-02-20T03:32:39.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 client.20451 shutdown 2026-02-20T03:32:39.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 -- 10.20.193.28:0/1863468062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 msgr2=0x560abdb6dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:39.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 0x560abdb6dea0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f81340a5680 tx=0x7f81340a7b80 comp rx=0 tx=0).stop 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 -- 10.20.193.28:0/1863468062 shutdown_connections 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560abdb726f0 0x560abdb74b40 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 0x560abdb6dea0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4e7c0 0x560abdb66f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 --2- 10.20.193.28:0/1863468062 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4de80 0x560abdb669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 -- 10.20.193.28:0/1863468062 >> 10.20.193.28:0/1863468062 conn(0x560abdb456f0 msgr2=0x560abdb54910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f80f27fc640 0 client.20451 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.797+0000 7f81423f5e00 1 -- 10.20.193.28:0/1863468062 shutdown_connections 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.798+0000 7f81423f5e00 1 -- 10.20.193.28:0/1863468062 wait complete. 2026-02-20T03:32:39.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.798+0000 7f81423f5e00 20 client.20451 trim_cache size 0 max 16384 2026-02-20T03:32:39.807 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f81423f5e00 1 Processor -- start 2026-02-20T03:32:39.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f81423f5e00 1 -- start start 2026-02-20T03:32:39.808 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb64680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 0x560abdb64f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f81423f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0012770 con 0x560abdb53560 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f81423f5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0010040 con 0x560abdb4e7c0 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f81423f5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f80e000de90 con 0x560abdb4de80 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f813d22c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb64680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f813d22c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb64680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:60918/0 (socket says 10.20.193.28:60918) 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f813d22c640 1 -- 10.20.193.28:0/211370156 learned_addr learned my addr 10.20.193.28:0/211370156 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f813da2d640 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 0x560abdb64f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.809 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f813ca2b640 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.806+0000 7f813d22c640 1 -- 10.20.193.28:0/211370156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 msgr2=0x560abdb6de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:39.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f813d22c640 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f813d22c640 1 -- 10.20.193.28:0/211370156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 msgr2=0x560abdb64f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:39.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f813d22c640 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 0x560abdb64f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f813d22c640 1 -- 10.20.193.28:0/211370156 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560abdb5ff30 con 0x560abdb4de80 2026-02-20T03:32:39.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f813ca2b640 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:32:39.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f813d22c640 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb64680 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8128009c70 tx=0x7f8128016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7faf8142b7e27196 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:39.810 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f8104ffd640 1 -- 10.20.193.28:0/211370156 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280129d0 con 0x560abdb4de80 2026-02-20T03:32:39.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f8104ffd640 1 -- 10.20.193.28:0/211370156 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x560abda20bd0 con 0x560abdb4de80 2026-02-20T03:32:39.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f8104ffd640 1 -- 10.20.193.28:0/211370156 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128004d60 con 0x560abdb4de80 2026-02-20T03:32:39.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f81423f5e00 1 -- 10.20.193.28:0/211370156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 msgr2=0x560abdb64680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:39.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.807+0000 7f81423f5e00 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb64680 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8128009c70 tx=0x7f8128016000 comp rx=0 tx=0).stop 2026-02-20T03:32:39.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 -- 10.20.193.28:0/211370156 shutdown_connections 2026-02-20T03:32:39.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb53560 0x560abdb64f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 --2- 10.20.193.28:0/211370156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb4de80 0x560abdb64680 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.813 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 -- 10.20.193.28:0/211370156 >> 10.20.193.28:0/211370156 conn(0x560abdb456f0 msgr2=0x560abdb4c570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 -- 10.20.193.28:0/211370156 shutdown_connections 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 -- 10.20.193.28:0/211370156 wait complete. 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 -- start start 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 Processor -- start 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4de80 0x560abdb6b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.808+0000 7f81423f5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb53560 0x560abdb6cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f81423f5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f80e000e500 con 0x560abdb4de80 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f81423f5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f80e000f970 con 0x560abdb4e7c0 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f81423f5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f80e000ebd0 con 0x560abdb53560 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f813ca2b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.814 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f813d22c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4de80 0x560abdb6b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f813ca2b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60012/0 (socket says 10.20.193.28:60012) 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f813ca2b640 1 -- 10.20.193.28:0/3330171632 learned_addr learned my addr 10.20.193.28:0/3330171632 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f813da2d640 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb53560 0x560abdb6cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f813ca2b640 1 -- 10.20.193.28:0/3330171632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb53560 msgr2=0x560abdb6cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f813ca2b640 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb53560 0x560abdb6cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.809+0000 7f813ca2b640 1 -- 10.20.193.28:0/3330171632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4de80 msgr2=0x560abdb6b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f813ca2b640 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4de80 0x560abdb6b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f813ca2b640 1 -- 10.20.193.28:0/3330171632 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560abd7fe690 con 0x560abdb4e7c0 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f813d22c640 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4de80 0x560abdb6b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f813ca2b640 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6bdb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f812c009950 tx=0x7f812c002980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac4db8c99431878 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f80f27fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f80f27fc640 1 -- 10.20.193.28:0/3330171632 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c02fc90 con 0x560abdb4e7c0 2026-02-20T03:32:39.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f81423f5e00 1 -- 10.20.193.28:0/3330171632 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560abda63b70 con 0x560abdb4e7c0 2026-02-20T03:32:39.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f80f27fc640 1 -- 10.20.193.28:0/3330171632 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f812c033040 con 0x560abdb4e7c0 2026-02-20T03:32:39.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f80f27fc640 1 -- 10.20.193.28:0/3330171632 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c04f620 con 0x560abdb4e7c0 2026-02-20T03:32:39.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f81423f5e00 10 client.28328 _ll_register_callbacks cb 0x7f81340a7d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:39.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.810+0000 7f81423f5e00 1 -- 10.20.193.28:0/3330171632 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560abdaac290 con 0x560abdb4e7c0 2026-02-20T03:32:39.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f80f27fc640 1 -- 10.20.193.28:0/3330171632 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(98..98 src has 1..98) ==== 9297+0+0 (secure 0 0 0) 0x7f812c04f7c0 con 0x560abdb4e7c0 2026-02-20T03:32:39.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f80f27fc640 1 -- 10.20.193.28:0/3330171632 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f812c04faa0 con 0x560abdb4e7c0 2026-02-20T03:32:39.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f81423f5e00 10 client.28328 fetch_fsmap learned FSMap version 42 2026-02-20T03:32:39.816 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f81423f5e00 1 -- 10.20.193.28:0/3330171632 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=42}) -- 0x560abdb60c20 con 0x560abdb4e7c0 2026-02-20T03:32:39.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f80f27fc640 1 -- 10.20.193.28:0/3330171632 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 42) ==== 8354+0+0 (secure 0 0 0) 0x7f812c061030 con 0x560abdb4e7c0 2026-02-20T03:32:39.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f81423f5e00 10 client.28328 fetch_fsmap finished waiting for FSMap version 42 2026-02-20T03:32:39.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f81423f5e00 10 client.28328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:39.817 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f81423f5e00 20 client.28328 populate_metadata read hostname 'trial028' 2026-02-20T03:32:39.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f81423f5e00 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560abdbddbe0 0x560abdbe00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:39.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f81423f5e00 4 client.28328 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:32:39.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.811+0000 7f81423f5e00 1 -- 10.20.193.28:0/3330171632 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560abda20bd0 con 0x560abdbddbe0 2026-02-20T03:32:39.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.812+0000 7f813d22c640 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560abdbddbe0 0x560abdbe00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:39.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.813+0000 7f813d22c640 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560abdbddbe0 0x560abdbe00a0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32c8680a3b2c29ed server_cookie=b3f81c4e7c371ffc in_seq=0 out_seq=0 2026-02-20T03:32:39.818 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:39.813+0000 7f80f27fc640 10 client.28328 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:40.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f80f27fc640 1 -- 10.20.193.28:0/3330171632 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560abda20bd0 con 0x560abdbddbe0 2026-02-20T03:32:40.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f80f27fc640 10 client.28328 handle_command_reply: tid=0 2026-02-20T03:32:40.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f81423f5e00 1 client.28328 shutdown 2026-02-20T03:32:40.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f81423f5e00 1 -- 10.20.193.28:0/3330171632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 msgr2=0x560abdb6bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:40.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f81423f5e00 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6bdb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f812c009950 tx=0x7f812c002980 comp rx=0 tx=0).stop 2026-02-20T03:32:40.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f81423f5e00 1 -- 10.20.193.28:0/3330171632 shutdown_connections 2026-02-20T03:32:40.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f81423f5e00 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560abdbddbe0 0x560abdbe00a0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:40.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f81423f5e00 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560abdb53560 0x560abdb6cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:40.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f81423f5e00 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560abdb4e7c0 0x560abdb6bdb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:40.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f81423f5e00 1 --2- 10.20.193.28:0/3330171632 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560abdb4de80 0x560abdb6b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:40.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f81423f5e00 1 -- 10.20.193.28:0/3330171632 >> 10.20.193.28:0/3330171632 conn(0x560abdb456f0 msgr2=0x560abdb63670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:40.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.402+0000 7f80f27fc640 0 client.28328 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:40.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.403+0000 7f81423f5e00 1 -- 10.20.193.28:0/3330171632 shutdown_connections 2026-02-20T03:32:40.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.403+0000 7f81423f5e00 1 -- 10.20.193.28:0/3330171632 wait complete. 2026-02-20T03:32:40.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.403+0000 7f81423f5e00 20 client.28328 trim_cache size 0 max 16384 2026-02-20T03:32:40.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:32:40.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:32:40.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:32:40.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:32:40.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.403+0000 7f813e22e640 1 -- 10.20.193.28:0/1092323488 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81140b0e20 msgr2=0x7f81140b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:40.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81140b0e20 0x7f81140b32e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f81280059c0 tx=0x7f8128009290 comp rx=0 tx=0).stop 2026-02-20T03:32:40.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 -- 10.20.193.28:0/1092323488 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f813810a900 msgr2=0x7f81381a8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:40.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f813810a900 0x7f81381a8530 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f813400efc0 tx=0x7f813400c490 comp rx=0 tx=0).stop 2026-02-20T03:32:40.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 -- 10.20.193.28:0/1092323488 shutdown_connections 2026-02-20T03:32:40.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81140b0e20 0x7f81140b32e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:40.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f813810a900 0x7f81381a8530 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:40.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8138109e60 0x7f81381a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:40.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 --2- 10.20.193.28:0/1092323488 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8138109490 0x7f81381a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:40.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 -- 10.20.193.28:0/1092323488 >> 10.20.193.28:0/1092323488 conn(0x7f8138077fe0 msgr2=0x7f813810d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:40.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 -- 10.20.193.28:0/1092323488 shutdown_connections 2026-02-20T03:32:40.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:40.404+0000 7f813e22e640 1 -- 10.20.193.28:0/1092323488 wait complete. 2026-02-20T03:32:40.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 105215 18.22 MB/sec execute 131 sec latency 216.665 ms 2026-02-20T03:32:41.218 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:32:40 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setuser ceph since I am not root 2026-02-20T03:32:41.218 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:32:40 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setgroup ceph since I am not root 2026-02-20T03:32:41.218 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:32:40 trial177 ceph-mds[71178]: -- 10.20.193.177:0/1192015031 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5610f8288b40 con 0x5610f74af400 2026-02-20T03:32:41.218 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:32:40 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: starting mds.c at 2026-02-20T03:32:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:41 trial126 ceph-mon[38476]: pgmap v725: 129 pgs: 129 active+clean; 555 MiB data, 7.2 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 8.8 MiB/s wr, 1.12k op/s 2026-02-20T03:32:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:41 trial126 ceph-mon[38476]: daemon mds.c restarted 2026-02-20T03:32:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:41 trial028 ceph-mon[38552]: pgmap v725: 129 pgs: 129 active+clean; 555 MiB data, 7.2 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 8.8 MiB/s wr, 1.12k op/s 2026-02-20T03:32:41.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:41 trial028 ceph-mon[38552]: daemon mds.c restarted 2026-02-20T03:32:41.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 106717 18.68 MB/sec execute 132 sec latency 34.593 ms 2026-02-20T03:32:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:41 trial177 ceph-mon[43181]: pgmap v725: 129 pgs: 129 active+clean; 555 MiB data, 7.2 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 8.8 MiB/s wr, 1.12k op/s 2026-02-20T03:32:41.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:41 trial177 ceph-mon[43181]: daemon mds.c restarted 2026-02-20T03:32:42.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:42 trial126 ceph-mon[38476]: osdmap e99: 12 total, 12 up, 12 in 2026-02-20T03:32:42.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:42 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6836/201170198,v1:10.20.193.177:6837/201170198] up:boot 2026-02-20T03:32:42.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:42 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:32:42.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:42 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:32:42.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:42 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:32:42.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:42 trial028 ceph-mon[38552]: osdmap e99: 12 total, 12 up, 12 in 2026-02-20T03:32:42.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:42 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6836/201170198,v1:10.20.193.177:6837/201170198] up:boot 2026-02-20T03:32:42.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:42 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:32:42.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:42 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:32:42.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:42 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:32:42.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 108231 19.14 MB/sec execute 133 sec latency 61.175 ms 2026-02-20T03:32:42.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:42 trial177 ceph-mon[43181]: osdmap e99: 12 total, 12 up, 12 in 2026-02-20T03:32:42.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:42 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6836/201170198,v1:10.20.193.177:6837/201170198] up:boot 2026-02-20T03:32:42.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:42 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2026-02-20T03:32:42.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:42 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:32:42.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:42 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:32:43.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:43 trial126 ceph-mon[38476]: pgmap v727: 129 pgs: 129 active+clean; 560 MiB data, 7.2 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 9.2 MiB/s wr, 1.19k op/s 2026-02-20T03:32:43.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:43 trial028 ceph-mon[38552]: pgmap v727: 129 pgs: 129 active+clean; 560 MiB data, 7.2 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 9.2 MiB/s wr, 1.19k op/s 2026-02-20T03:32:43.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 109746 19.63 MB/sec execute 134 sec latency 34.053 ms 2026-02-20T03:32:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:43 trial177 ceph-mon[43181]: pgmap v727: 129 pgs: 129 active+clean; 560 MiB data, 7.2 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 9.2 MiB/s wr, 1.19k op/s 2026-02-20T03:32:44.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 111491 20.17 MB/sec execute 135 sec latency 34.707 ms 2026-02-20T03:32:45.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:45 trial126 ceph-mon[38476]: pgmap v728: 129 pgs: 129 active+clean; 546 MiB data, 7.2 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 8.1 MiB/s wr, 1.13k op/s 2026-02-20T03:32:45.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:45 trial028 ceph-mon[38552]: pgmap v728: 129 pgs: 129 active+clean; 546 MiB data, 7.2 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 8.1 MiB/s wr, 1.13k op/s 2026-02-20T03:32:45.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 112990 20.58 MB/sec execute 136 sec latency 36.981 ms 2026-02-20T03:32:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:45 trial177 ceph-mon[43181]: pgmap v728: 129 pgs: 129 active+clean; 546 MiB data, 7.2 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 8.1 MiB/s wr, 1.13k op/s 2026-02-20T03:32:46.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 114936 21.24 MB/sec execute 137 sec latency 31.538 ms 2026-02-20T03:32:47.509 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:47 trial028 ceph-mon[38552]: pgmap v729: 129 pgs: 129 active+clean; 558 MiB data, 7.3 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 8.8 MiB/s wr, 1.25k op/s 2026-02-20T03:32:47.509 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:47 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:32:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:47 trial126 ceph-mon[38476]: pgmap v729: 129 pgs: 129 active+clean; 558 MiB data, 7.3 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 8.8 MiB/s wr, 1.25k op/s 2026-02-20T03:32:47.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:47 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:32:47.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 116167 21.56 MB/sec execute 138 sec latency 56.660 ms 2026-02-20T03:32:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:47 trial177 ceph-mon[43181]: pgmap v729: 129 pgs: 129 active+clean; 558 MiB data, 7.3 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 8.8 MiB/s wr, 1.25k op/s 2026-02-20T03:32:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:47 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:32:48.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:32:48.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:32:48.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:32:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:32:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:32:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:32:48.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 117660 21.96 MB/sec execute 139 sec latency 63.605 ms 2026-02-20T03:32:48.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:32:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:32:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:32:49.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:49 trial126 ceph-mon[38476]: pgmap v730: 129 pgs: 129 active+clean; 572 MiB data, 7.4 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 9.9 MiB/s wr, 1.40k op/s 2026-02-20T03:32:49.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:49 trial028 ceph-mon[38552]: pgmap v730: 129 pgs: 129 active+clean; 572 MiB data, 7.4 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 9.9 MiB/s wr, 1.40k op/s 2026-02-20T03:32:49.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 119434 22.57 MB/sec execute 140 sec latency 29.068 ms 2026-02-20T03:32:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:49 trial177 ceph-mon[43181]: pgmap v730: 129 pgs: 129 active+clean; 572 MiB data, 7.4 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 9.9 MiB/s wr, 1.40k op/s 2026-02-20T03:32:50.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 121083 22.98 MB/sec execute 141 sec latency 49.549 ms 2026-02-20T03:32:51.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:51 trial028 ceph-mon[38552]: pgmap v731: 129 pgs: 129 active+clean; 596 MiB data, 7.5 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 9.5 MiB/s wr, 1.28k op/s 2026-02-20T03:32:51.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:51 trial126 ceph-mon[38476]: pgmap v731: 129 pgs: 129 active+clean; 596 MiB data, 7.5 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 9.5 MiB/s wr, 1.28k op/s 2026-02-20T03:32:51.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 122789 23.47 MB/sec execute 142 sec latency 39.489 ms 2026-02-20T03:32:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:51 trial177 ceph-mon[43181]: pgmap v731: 129 pgs: 129 active+clean; 596 MiB data, 7.5 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 9.5 MiB/s wr, 1.28k op/s 2026-02-20T03:32:52.709 INFO:tasks.workunit.client.0.trial028.stdout: 10 124397 23.89 MB/sec execute 143 sec latency 37.326 ms 2026-02-20T03:32:53.391 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:53 trial028 ceph-mon[38552]: pgmap v732: 129 pgs: 129 active+clean; 606 MiB data, 7.6 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 9.7 MiB/s wr, 1.28k op/s 2026-02-20T03:32:53.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3ed9573640 1 -- 10.20.193.28:0/2520061741 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0038470 con 0x7f3ed4009280 2026-02-20T03:32:53.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3edb577640 1 -- 10.20.193.28:0/2520061741 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ed4009280 msgr2=0x7f3ed4009680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:53.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3edb577640 1 --2- 10.20.193.28:0/2520061741 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ed4009280 0x7f3ed4009680 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009960 tx=0x7f3ed002f140 comp rx=0 tx=0).stop 2026-02-20T03:32:53.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3edb577640 1 -- 10.20.193.28:0/2520061741 shutdown_connections 2026-02-20T03:32:53.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3edb577640 1 --2- 10.20.193.28:0/2520061741 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ed400ae60 0x7f3ed400b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3edb577640 1 --2- 10.20.193.28:0/2520061741 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ed400a4c0 0x7f3ed400a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3edb577640 1 --2- 10.20.193.28:0/2520061741 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ed4009280 0x7f3ed4009680 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3edb577640 1 -- 10.20.193.28:0/2520061741 >> 10.20.193.28:0/2520061741 conn(0x7f3ed40931d0 msgr2=0x7f3ed40955f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:53.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3edb577640 1 -- 10.20.193.28:0/2520061741 shutdown_connections 2026-02-20T03:32:53.505 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.501+0000 7f3edb577640 1 -- 10.20.193.28:0/2520061741 wait complete. 2026-02-20T03:32:53.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.502+0000 7f3edb577640 1 Processor -- start 2026-02-20T03:32:53.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.502+0000 7f3edb577640 1 -- start start 2026-02-20T03:32:53.507 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.502+0000 7f3edb577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ed4009280 0x7f3ed41340a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.502+0000 7f3edb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ed400a4c0 0x7f3ed41345e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.502+0000 7f3edb577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ed400ae60 0x7f3ed413b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3edb577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed40a7a50 con 0x7f3ed400a4c0 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3edb577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed40a78d0 con 0x7f3ed400ae60 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3edb577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed40a7bd0 con 0x7f3ed4009280 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3ed9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ed400a4c0 0x7f3ed41345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3ed9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ed400a4c0 0x7f3ed41345e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53306/0 (socket says 10.20.193.28:53306) 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3ed9d74640 1 -- 10.20.193.28:0/2681070495 learned_addr learned my addr 10.20.193.28:0/2681070495 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3eda575640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ed4009280 0x7f3ed41340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3edad76640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ed400ae60 0x7f3ed413b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.508 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3ed9d74640 1 -- 10.20.193.28:0/2681070495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ed4009280 msgr2=0x7f3ed41340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ed4009280 0x7f3ed41340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3ed9d74640 1 -- 10.20.193.28:0/2681070495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ed400ae60 msgr2=0x7f3ed413b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ed400ae60 0x7f3ed413b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3ed9d74640 1 -- 10.20.193.28:0/2681070495 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed413bd50 con 0x7f3ed400a4c0 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.503+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ed400a4c0 0x7f3ed41345e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400b780 tx=0x7f3ec400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.504+0000 7f3ec37fe640 1 -- 10.20.193.28:0/2681070495 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec4004480 con 0x7f3ed400a4c0 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.504+0000 7f3ec37fe640 1 -- 10.20.193.28:0/2681070495 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3ec4010070 con 0x7f3ed400a4c0 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.504+0000 7f3ec37fe640 1 -- 10.20.193.28:0/2681070495 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec400cae0 con 0x7f3ed400a4c0 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.504+0000 7f3edb577640 1 -- 10.20.193.28:0/2681070495 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed413bfe0 con 0x7f3ed400a4c0 2026-02-20T03:32:53.509 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.504+0000 7f3edb577640 1 -- 10.20.193.28:0/2681070495 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed413c530 con 0x7f3ed400a4c0 2026-02-20T03:32:53.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.509+0000 7f3ee3c62e00 1 Processor -- start 2026-02-20T03:32:53.512 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.509+0000 7f3ec37fe640 1 -- 10.20.193.28:0/2681070495 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3ec400cce0 con 0x7f3ed400a4c0 2026-02-20T03:32:53.513 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ee3c62e00 1 -- start start 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2050 0x560c68cc2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 0x560c68cc6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68cc9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560c68c128f0 con 0x560c68cc7590 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560c68bc02e0 con 0x560c68cc2050 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560c68c0e820 con 0x560c68cc2a20 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3edad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2050 0x560c68cc2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ed9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68cc9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ed9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68cc9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53314/0 (socket says 10.20.193.28:53314) 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3ed9d74640 1 -- 10.20.193.28:0/2321008494 learned_addr learned my addr 10.20.193.28:0/2321008494 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:53.514 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.510+0000 7f3eda575640 1 --2- 10.20.193.28:0/2321008494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 0x560c68cc6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.511+0000 7f3ed9d74640 1 -- 10.20.193.28:0/2321008494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 msgr2=0x560c68cc6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:53.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.511+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/2321008494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 0x560c68cc6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.511+0000 7f3ed9d74640 1 -- 10.20.193.28:0/2321008494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2050 msgr2=0x560c68cc2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:53.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.511+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/2321008494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2050 0x560c68cc2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.511+0000 7f3ed9d74640 1 -- 10.20.193.28:0/2321008494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c68bb25a0 con 0x560c68cc7590 2026-02-20T03:32:53.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.511+0000 7f3ec37fe640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3eb00b0da0 0x7f3eb00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.512+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/2321008494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68cc9a20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40e3d40 tx=0x7f3ec40e3e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da96d1da5cff2b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.512+0000 7f3ec37fe640 1 -- 10.20.193.28:0/2681070495 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3ec40dfc10 con 0x7f3ed400a4c0 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.512+0000 7f3ec0bfe640 1 -- 10.20.193.28:0/2321008494 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40a3560 con 0x560c68cc7590 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.512+0000 7f3ec0bfe640 1 -- 10.20.193.28:0/2321008494 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3ec40e4040 con 0x560c68cc7590 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.512+0000 7f3ec0bfe640 1 -- 10.20.193.28:0/2321008494 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40a6e10 con 0x560c68cc7590 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.513+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/2321008494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 msgr2=0x560c68cc9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.513+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/2321008494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68cc9a20 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40e3d40 tx=0x7f3ec40e3e40 comp rx=0 tx=0).stop 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.513+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/2321008494 shutdown_connections 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.513+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/2321008494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68cc9a20 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.513+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/2321008494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 0x560c68cc6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.513+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/2321008494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2050 0x560c68cc2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.513+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/2321008494 >> 10.20.193.28:0/2321008494 conn(0x560c68cb98c0 msgr2=0x560c68cc0740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:53.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.513+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/2321008494 shutdown_connections 2026-02-20T03:32:53.518 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.513+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/2321008494 wait complete. 2026-02-20T03:32:53.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.514+0000 7f3ee3c62e00 1 -- start start 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.514+0000 7f3ee3c62e00 1 Processor -- start 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2050 0x560c68cda9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 0x560c68cdaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68ce1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560c68bba0c0 con 0x560c68cc7590 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560c68cca640 con 0x560c68cc2a20 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560c68ce2410 con 0x560c68cc2050 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3eda575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2050 0x560c68cda9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3eda575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2050 0x560c68cda9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43056/0 (socket says 10.20.193.28:43056) 2026-02-20T03:32:53.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3eda575640 1 -- 10.20.193.28:0/1069703972 learned_addr learned my addr 10.20.193.28:0/1069703972 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.515+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 0x560c68cdaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.516+0000 7f3edad76640 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68ce1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.516+0000 7f3eda575640 1 -- 10.20.193.28:0/1069703972 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 msgr2=0x560c68cdaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.516+0000 7f3eda575640 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 0x560c68cdaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.516+0000 7f3eda575640 1 -- 10.20.193.28:0/1069703972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 msgr2=0x560c68ce1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.516+0000 7f3eda575640 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68ce1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.516+0000 7f3eda575640 1 -- 10.20.193.28:0/1069703972 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c68cd40e0 con 0x560c68cc2050 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.516+0000 7f3eda575640 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2050 0x560c68cda9c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009960 tx=0x7f3ed00026e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aaa4c703a59c227 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.516+0000 7f3e87fff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.517+0000 7f3edad76640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3eb00b0da0 0x7f3eb00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.517+0000 7f3e87fff640 1 -- 10.20.193.28:0/1069703972 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed002fbb0 con 0x560c68cc2050 2026-02-20T03:32:53.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.517+0000 7f3e87fff640 1 -- 10.20.193.28:0/1069703972 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3ed0033040 con 0x560c68cc2050 2026-02-20T03:32:53.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.517+0000 7f3e87fff640 1 -- 10.20.193.28:0/1069703972 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed00047c0 con 0x560c68cc2050 2026-02-20T03:32:53.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.517+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/1069703972 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c68bce820 con 0x560c68cc2050 2026-02-20T03:32:53.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.517+0000 7f3e87fff640 1 -- 10.20.193.28:0/1069703972 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3ed0004960 con 0x560c68cc2050 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.517+0000 7f3e87fff640 10 client.28342 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.517+0000 7f3ee3c62e00 10 client.28342 _ll_register_callbacks cb 0x560c68bbdff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.517+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/1069703972 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c68c1a4e0 con 0x560c68cc2050 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3e87fff640 1 -- 10.20.193.28:0/1069703972 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3ed0004070 con 0x560c68cc2050 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3ee3c62e00 10 client.28342 fetch_fsmap learned FSMap version 44 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/1069703972 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=44}) -- 0x560c68bd3380 con 0x560c68cc2050 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3e87fff640 1 -- 10.20.193.28:0/1069703972 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f3ed0004b60 con 0x560c68cc2050 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3ee3c62e00 10 client.28342 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3ee3c62e00 10 client.28342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3ee3c62e00 20 client.28342 populate_metadata read hostname 'trial028' 2026-02-20T03:32:53.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c68ce65f0 0x560c68ce8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3ee3c62e00 4 client.28342 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.518+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/1069703972 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c68b94bd0 con 0x560c68ce65f0 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.519+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c68ce65f0 0x560c68ce8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.519+0000 7f3edad76640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3eb00b0da0 0x7f3eb00b3260 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009140 tx=0x7f3ecc004b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.519+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c68ce65f0 0x560c68ce8a90 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccfa9692fb80223d server_cookie=774d44e9069ae8f8 in_seq=0 out_seq=0 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.519+0000 7f3e87fff640 10 client.28342 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3e87fff640 1 -- 10.20.193.28:0/1069703972 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560c68b94bd0 con 0x560c68ce65f0 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3e87fff640 10 client.28342 handle_command_reply: tid=0 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 client.28342 shutdown 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/1069703972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2050 msgr2=0x560c68cda9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2050 0x560c68cda9c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009960 tx=0x7f3ed00026e0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/1069703972 shutdown_connections 2026-02-20T03:32:53.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c68ce65f0 0x560c68ce8a90 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3e87fff640 0 client.28342 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:53.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc7590 0x560c68ce1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 0x560c68cdaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/1069703972 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2050 0x560c68cda9c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/1069703972 >> 10.20.193.28:0/1069703972 conn(0x560c68cb98c0 msgr2=0x560c68cc88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:53.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/1069703972 shutdown_connections 2026-02-20T03:32:53.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/1069703972 wait complete. 2026-02-20T03:32:53.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.520+0000 7f3ee3c62e00 20 client.28342 trim_cache size 0 max 16384 2026-02-20T03:32:53.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.533+0000 7f3ee3c62e00 1 Processor -- start 2026-02-20T03:32:53.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.533+0000 7f3ee3c62e00 1 -- start start 2026-02-20T03:32:53.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cd85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 0x560c68ce1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc7590 0x560c68cc8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e80012770 con 0x560c68cc2050 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e80010040 con 0x560c68cc7590 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8000de90 con 0x560c68cc2a20 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3edad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc7590 0x560c68cc8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3ed9d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 0x560c68ce1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3edad76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc7590 0x560c68cc8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42156/0 (socket says 10.20.193.28:42156) 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3ed9d74640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 0x560c68ce1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43060/0 (socket says 10.20.193.28:43060) 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.534+0000 7f3edad76640 1 -- 10.20.193.28:0/3566458125 learned_addr learned my addr 10.20.193.28:0/3566458125 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:53.539 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.535+0000 7f3eda575640 1 --2- 10.20.193.28:0/3566458125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cd85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.535+0000 7f3edad76640 1 -- 10.20.193.28:0/3566458125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 msgr2=0x560c68ce1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:53.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.535+0000 7f3edad76640 1 --2- 10.20.193.28:0/3566458125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 0x560c68ce1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.535+0000 7f3edad76640 1 -- 10.20.193.28:0/3566458125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 msgr2=0x560c68cd85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:53.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.535+0000 7f3edad76640 1 --2- 10.20.193.28:0/3566458125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cd85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.535+0000 7f3edad76640 1 -- 10.20.193.28:0/3566458125 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c68cd3f10 con 0x560c68cc7590 2026-02-20T03:32:53.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.535+0000 7f3edad76640 1 --2- 10.20.193.28:0/3566458125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc7590 0x560c68cc8980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc007f60 tx=0x7f3ecc018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e721c067153a11fe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:53.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.535+0000 7f3eb63ff640 1 -- 10.20.193.28:0/3566458125 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc027070 con 0x560c68cc7590 2026-02-20T03:32:53.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.535+0000 7f3eb63ff640 1 -- 10.20.193.28:0/3566458125 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3ecc023ab0 con 0x560c68cc7590 2026-02-20T03:32:53.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3566458125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc7590 msgr2=0x560c68cc8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:53.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3eb63ff640 1 -- 10.20.193.28:0/3566458125 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc027070 con 0x560c68cc7590 2026-02-20T03:32:53.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3566458125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc7590 0x560c68cc8980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc007f60 tx=0x7f3ecc018000 comp rx=0 tx=0).stop 2026-02-20T03:32:53.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3566458125 shutdown_connections 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3566458125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc7590 0x560c68cc8980 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3566458125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc2a20 0x560c68ce1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3566458125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cd85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3566458125 >> 10.20.193.28:0/3566458125 conn(0x560c68cb98c0 msgr2=0x560c68cd7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3566458125 shutdown_connections 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.536+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3566458125 wait complete. 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3ee3c62e00 1 -- start start 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3ee3c62e00 1 Processor -- start 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 0x560c68cde4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3eda575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3ee3c62e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc7590 0x560c68ce13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8000e500 con 0x560c68cc2050 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8000f970 con 0x560c68cc2a20 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3ee3c62e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8000ebd0 con 0x560c68cc7590 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3eda575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cddfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53352/0 (socket says 10.20.193.28:53352) 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3eda575640 1 -- 10.20.193.28:0/3019000091 learned_addr learned my addr 10.20.193.28:0/3019000091 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.537+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 0x560c68cde4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.538+0000 7f3edad76640 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc7590 0x560c68ce13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.538+0000 7f3eda575640 1 -- 10.20.193.28:0/3019000091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc7590 msgr2=0x560c68ce13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.538+0000 7f3eda575640 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc7590 0x560c68ce13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.538+0000 7f3eda575640 1 -- 10.20.193.28:0/3019000091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 msgr2=0x560c68cde4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.538+0000 7f3eda575640 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 0x560c68cde4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:53.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.538+0000 7f3eda575640 1 -- 10.20.193.28:0/3019000091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c68972690 con 0x560c68cc2050 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.538+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 0x560c68cde4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.539+0000 7f3eda575640 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cddfb0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00057c0 tx=0x7f3ed00027d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2537c2f2cae11b12 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.539+0000 7f3e87fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.539+0000 7f3e87fff640 1 -- 10.20.193.28:0/3019000091 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0004420 con 0x560c68cc2050 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.539+0000 7f3e87fff640 1 -- 10.20.193.28:0/3019000091 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3ed0033070 con 0x560c68cc2050 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.539+0000 7f3e87fff640 1 -- 10.20.193.28:0/3019000091 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0038770 con 0x560c68cc2050 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.539+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3019000091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c68bd7b70 con 0x560c68cc2050 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.539+0000 7f3e87fff640 1 -- 10.20.193.28:0/3019000091 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3ed0038910 con 0x560c68cc2050 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3e87fff640 10 client.20475 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3ee3c62e00 10 client.20475 _ll_register_callbacks cb 0x7f3ed0005d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3019000091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c68c20290 con 0x560c68cc2050 2026-02-20T03:32:53.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3e87fff640 1 -- 10.20.193.28:0/3019000091 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3ed00047c0 con 0x560c68cc2050 2026-02-20T03:32:53.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3ee3c62e00 10 client.20475 fetch_fsmap learned FSMap version 44 2026-02-20T03:32:53.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3019000091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x560c68cd4c00 con 0x560c68cc2050 2026-02-20T03:32:53.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3e87fff640 1 -- 10.20.193.28:0/3019000091 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f3ed0038b10 con 0x560c68cc2050 2026-02-20T03:32:53.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3ee3c62e00 10 client.20475 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:32:53.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3ee3c62e00 10 client.20475 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:32:53.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3ee3c62e00 20 client.20475 populate_metadata read hostname 'trial028' 2026-02-20T03:32:53.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.540+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c68ce65f0 0x560c68d541f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:32:53.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.541+0000 7f3ee3c62e00 4 client.20475 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:32:53.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.541+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3019000091 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f3ecc023ab0 con 0x560c68ce65f0 2026-02-20T03:32:53.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.541+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c68ce65f0 0x560c68d541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:32:53.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.541+0000 7f3ed9d74640 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c68ce65f0 0x560c68d541f0 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c8a8cdcc6223e39 server_cookie=c2755928c28ed729 in_seq=0 out_seq=0 2026-02-20T03:32:53.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:53.541+0000 7f3e87fff640 10 client.20475 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:53.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 125609 24.17 MB/sec execute 144 sec latency 116.898 ms 2026-02-20T03:32:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:53 trial177 ceph-mon[43181]: pgmap v732: 129 pgs: 129 active+clean; 606 MiB data, 7.6 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 9.7 MiB/s wr, 1.28k op/s 2026-02-20T03:32:53.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:53 trial126 ceph-mon[38476]: pgmap v732: 129 pgs: 129 active+clean; 606 MiB data, 7.6 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 9.7 MiB/s wr, 1.28k op/s 2026-02-20T03:32:54.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.150+0000 7f3e87fff640 1 -- 10.20.193.28:0/3019000091 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f3ecc023ab0 con 0x560c68ce65f0 2026-02-20T03:32:54.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.150+0000 7f3e87fff640 10 client.20475 handle_command_reply: tid=0 2026-02-20T03:32:54.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.150+0000 7f3ee3c62e00 1 client.20475 shutdown 2026-02-20T03:32:54.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3019000091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 msgr2=0x560c68cddfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:54.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cddfb0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00057c0 tx=0x7f3ed00027d0 comp rx=0 tx=0).stop 2026-02-20T03:32:54.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3019000091 shutdown_connections 2026-02-20T03:32:54.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c68ce65f0 0x560c68d541f0 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:54.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3e87fff640 0 client.20475 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:32:54.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c68cc7590 0x560c68ce13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:54.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c68cc2a20 0x560c68cde4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:54.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 --2- 10.20.193.28:0/3019000091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c68cc2050 0x560c68cddfb0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:54.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3019000091 >> 10.20.193.28:0/3019000091 conn(0x560c68cb98c0 msgr2=0x560c68cc88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:54.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3019000091 shutdown_connections 2026-02-20T03:32:54.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 1 -- 10.20.193.28:0/3019000091 wait complete. 2026-02-20T03:32:54.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.151+0000 7f3ee3c62e00 20 client.20475 trim_cache size 0 max 16384 2026-02-20T03:32:54.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:32:54.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:32:54.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:32:54.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:32:54.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 -- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3eb00b0da0 msgr2=0x7f3eb00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:54.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3eb00b0da0 0x7f3eb00b3260 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc009140 tx=0x7f3ecc004b40 comp rx=0 tx=0).stop 2026-02-20T03:32:54.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 -- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ed400a4c0 msgr2=0x7f3ed41345e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:32:54.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ed400a4c0 0x7f3ed41345e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f3ec400b780 tx=0x7f3ec400bc50 comp rx=0 tx=0).stop 2026-02-20T03:32:54.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 -- 10.20.193.28:0/2681070495 shutdown_connections 2026-02-20T03:32:54.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3eb00b0da0 0x7f3eb00b3260 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:54.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3ed400ae60 0x7f3ed413b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:54.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3ed400a4c0 0x7f3ed41345e0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:54.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 --2- 10.20.193.28:0/2681070495 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3ed4009280 0x7f3ed41340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:32:54.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 -- 10.20.193.28:0/2681070495 >> 10.20.193.28:0/2681070495 conn(0x7f3ed40931d0 msgr2=0x7f3ed4094c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:32:54.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 -- 10.20.193.28:0/2681070495 shutdown_connections 2026-02-20T03:32:54.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:32:54.152+0000 7f3edb577640 1 -- 10.20.193.28:0/2681070495 wait complete. 2026-02-20T03:32:54.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 126611 24.41 MB/sec execute 145 sec latency 432.677 ms 2026-02-20T03:32:55.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:55 trial028 ceph-mon[38552]: pgmap v733: 129 pgs: 129 active+clean; 616 MiB data, 7.7 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 9.1 MiB/s wr, 1.16k op/s 2026-02-20T03:32:55.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 128364 24.91 MB/sec execute 146 sec latency 26.902 ms 2026-02-20T03:32:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:55 trial177 ceph-mon[43181]: pgmap v733: 129 pgs: 129 active+clean; 616 MiB data, 7.7 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 9.1 MiB/s wr, 1.16k op/s 2026-02-20T03:32:55.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:55 trial126 ceph-mon[38476]: pgmap v733: 129 pgs: 129 active+clean; 616 MiB data, 7.7 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 9.1 MiB/s wr, 1.16k op/s 2026-02-20T03:32:56.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 129929 25.29 MB/sec execute 147 sec latency 59.986 ms 2026-02-20T03:32:57.626 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:57 trial028 ceph-mon[38552]: pgmap v734: 129 pgs: 129 active+clean; 624 MiB data, 7.7 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 10 MiB/s wr, 1.31k op/s 2026-02-20T03:32:57.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 131650 25.71 MB/sec execute 148 sec latency 35.342 ms 2026-02-20T03:32:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:57 trial177 ceph-mon[43181]: pgmap v734: 129 pgs: 129 active+clean; 624 MiB data, 7.7 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 10 MiB/s wr, 1.31k op/s 2026-02-20T03:32:57.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:57 trial126 ceph-mon[38476]: pgmap v734: 129 pgs: 129 active+clean; 624 MiB data, 7.7 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 10 MiB/s wr, 1.31k op/s 2026-02-20T03:32:58.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 133097 26.12 MB/sec execute 149 sec latency 46.995 ms 2026-02-20T03:32:59.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 134457 26.41 MB/sec execute 150 sec latency 41.264 ms 2026-02-20T03:32:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:32:59 trial177 ceph-mon[43181]: pgmap v735: 129 pgs: 129 active+clean; 628 MiB data, 7.8 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 9.2 MiB/s wr, 1.27k op/s 2026-02-20T03:32:59.771 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:32:59 trial028 ceph-mon[38552]: pgmap v735: 129 pgs: 129 active+clean; 628 MiB data, 7.8 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 9.2 MiB/s wr, 1.27k op/s 2026-02-20T03:32:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:32:59 trial126 ceph-mon[38476]: pgmap v735: 129 pgs: 129 active+clean; 628 MiB data, 7.8 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 9.2 MiB/s wr, 1.27k op/s 2026-02-20T03:33:00.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 136238 26.87 MB/sec execute 151 sec latency 26.519 ms 2026-02-20T03:33:01.447 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:33:01.635 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:01 trial028 ceph-mon[38552]: pgmap v736: 129 pgs: 129 active+clean; 649 MiB data, 7.9 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 11 MiB/s wr, 1.42k op/s 2026-02-20T03:33:01.647 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:01 trial126 ceph-mon[38476]: pgmap v736: 129 pgs: 129 active+clean; 649 MiB data, 7.9 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 11 MiB/s wr, 1.42k op/s 2026-02-20T03:33:01.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 136924 26.96 MB/sec execute 152 sec latency 608.371 ms 2026-02-20T03:33:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:01 trial177 ceph-mon[43181]: pgmap v736: 129 pgs: 129 active+clean; 649 MiB data, 7.9 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 11 MiB/s wr, 1.42k op/s 2026-02-20T03:33:01.772 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- 10.20.193.28:0/775735089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc102700 msgr2=0x7f82bc102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 --2- 10.20.193.28:0/775735089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc102700 0x7f82bc102b60 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009a60 tx=0x7f82b002f290 comp rx=0 tx=0).stop 2026-02-20T03:33:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- 10.20.193.28:0/775735089 shutdown_connections 2026-02-20T03:33:02.024 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 --2- 10.20.193.28:0/775735089 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82bc1030a0 0x7f82bc10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 --2- 10.20.193.28:0/775735089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc102700 0x7f82bc102b60 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 --2- 10.20.193.28:0/775735089 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82bc108700 0x7f82bc108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- 10.20.193.28:0/775735089 >> 10.20.193.28:0/775735089 conn(0x7f82bc0fe440 msgr2=0x7f82bc100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- 10.20.193.28:0/775735089 shutdown_connections 2026-02-20T03:33:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- 10.20.193.28:0/775735089 wait complete. 2026-02-20T03:33:02.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 Processor -- start 2026-02-20T03:33:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- start start 2026-02-20T03:33:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82bc102700 0x7f82bc19d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82bc1030a0 0x7f82bc19d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc108700 0x7f82bc1a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc112a50 con 0x7f82bc108700 2026-02-20T03:33:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc1128d0 con 0x7f82bc1030a0 2026-02-20T03:33:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc112bd0 con 0x7f82bc102700 2026-02-20T03:33:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c2957640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc108700 0x7f82bc1a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c2957640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc108700 0x7f82bc1a1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39568/0 (socket says 10.20.193.28:39568) 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c2957640 1 -- 10.20.193.28:0/2900449689 learned_addr learned my addr 10.20.193.28:0/2900449689 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c2957640 1 -- 10.20.193.28:0/2900449689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82bc102700 msgr2=0x7f82bc19d2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c2957640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82bc102700 0x7f82bc19d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c2957640 1 -- 10.20.193.28:0/2900449689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82bc1030a0 msgr2=0x7f82bc19d7f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c2957640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82bc1030a0 0x7f82bc19d7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c2957640 1 -- 10.20.193.28:0/2900449689 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc1a2300 con 0x7f82bc108700 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c2957640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc108700 0x7f82bc1a1b80 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f82b800b990 tx=0x7f82b800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82a37fe640 1 -- 10.20.193.28:0/2900449689 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8006e60 con 0x7f82bc108700 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82a37fe640 1 -- 10.20.193.28:0/2900449689 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f82b8010070 con 0x7f82bc108700 2026-02-20T03:33:02.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82a37fe640 1 -- 10.20.193.28:0/2900449689 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8004800 con 0x7f82bc108700 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- 10.20.193.28:0/2900449689 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc1a25f0 con 0x7f82bc108700 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.020+0000 7f82c3158640 1 -- 10.20.193.28:0/2900449689 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc1a9e30 con 0x7f82bc108700 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82a37fe640 1 -- 10.20.193.28:0/2900449689 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f82b801d030 con 0x7f82bc108700 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c68e6e00 1 Processor -- start 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c68e6e00 1 -- start start 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab14a10 0x555deab14df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab0f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f9c0 0x555deab1b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555deaa86e50 con 0x555deab0f040 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555deaa599c0 con 0x555deab0f9c0 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555deaa07240 con 0x555deab14a10 2026-02-20T03:33:02.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c2156640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab0f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c2156640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab0f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39578/0 (socket says 10.20.193.28:39578) 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82c2156640 1 -- 10.20.193.28:0/2207409656 learned_addr learned my addr 10.20.193.28:0/2207409656 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82a37fe640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82980b0e20 0x7f82980b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.026+0000 7f82a37fe640 1 -- 10.20.193.28:0/2900449689 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f82b80dfff0 con 0x7f82bc108700 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c2156640 1 -- 10.20.193.28:0/2207409656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab14a10 msgr2=0x555deab14df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c2156640 1 --2- 10.20.193.28:0/2207409656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab14a10 0x555deab14df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c2156640 1 -- 10.20.193.28:0/2207409656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f9c0 msgr2=0x555deab1b840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c2156640 1 --2- 10.20.193.28:0/2207409656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f9c0 0x555deab1b840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c2156640 1 -- 10.20.193.28:0/2207409656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555deaa1a420 con 0x555deab0f040 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c2957640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82980b0e20 0x7f82980b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c2156640 1 --2- 10.20.193.28:0/2207409656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab0f480 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009870 tx=0x7f82ac009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953b48af795735d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82a0a08640 1 -- 10.20.193.28:0/2207409656 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac016070 con 0x555deab0f040 2026-02-20T03:33:02.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82a0a08640 1 -- 10.20.193.28:0/2207409656 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f82ac004480 con 0x555deab0f040 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82a0a08640 1 -- 10.20.193.28:0/2207409656 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00bd30 con 0x555deab0f040 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c68e6e00 1 -- 10.20.193.28:0/2207409656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 msgr2=0x555deab0f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/2207409656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab0f480 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009870 tx=0x7f82ac009d40 comp rx=0 tx=0).stop 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c2957640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82980b0e20 0x7f82980b32e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f82b80a4d50 tx=0x7f82b8004220 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c68e6e00 1 -- 10.20.193.28:0/2207409656 shutdown_connections 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/2207409656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f9c0 0x555deab1b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/2207409656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab0f480 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/2207409656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab14a10 0x555deab14df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c68e6e00 1 -- 10.20.193.28:0/2207409656 >> 10.20.193.28:0/2207409656 conn(0x555deaac9290 msgr2=0x555deab04d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:02.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c68e6e00 1 -- 10.20.193.28:0/2207409656 shutdown_connections 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.028+0000 7f82c68e6e00 1 -- 10.20.193.28:0/2207409656 wait complete. 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 -- start start 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 Processor -- start 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f040 0x555deab27d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f9c0 0x555deab282a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab14a10 0x555deab2d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555deaa558f0 con 0x555deab0f9c0 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555dea847f50 con 0x555deab0f040 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555deab2dd50 con 0x555deab14a10 2026-02-20T03:33:02.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c2156640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f9c0 0x555deab282a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c2156640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f9c0 0x555deab282a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39594/0 (socket says 10.20.193.28:39594) 2026-02-20T03:33:02.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c2156640 1 -- 10.20.193.28:0/3577203271 learned_addr learned my addr 10.20.193.28:0/3577203271 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c2156640 1 -- 10.20.193.28:0/3577203271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab14a10 msgr2=0x555deab2d810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c2156640 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab14a10 0x555deab2d810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c2156640 1 -- 10.20.193.28:0/3577203271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f040 msgr2=0x555deab27d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c2156640 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f040 0x555deab27d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c2156640 1 -- 10.20.193.28:0/3577203271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555deab214e0 con 0x555deab0f9c0 2026-02-20T03:33:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c2156640 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f9c0 0x555deab282a0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0091e0 tx=0x7f82ac00bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323413aaa91ea594 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f826ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f826ffff640 1 -- 10.20.193.28:0/3577203271 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac020070 con 0x555deab0f9c0 2026-02-20T03:33:02.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f826ffff640 1 -- 10.20.193.28:0/3577203271 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f82ac017040 con 0x555deab0f9c0 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 -- 10.20.193.28:0/3577203271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dea82ab40 con 0x555deab0f9c0 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f826ffff640 1 -- 10.20.193.28:0/3577203271 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac016070 con 0x555deab0f9c0 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 10 client.20487 _ll_register_callbacks cb 0x555deaa92f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 -- 10.20.193.28:0/3577203271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555deaa671a0 con 0x555deab0f9c0 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f826ffff640 1 -- 10.20.193.28:0/3577203271 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f82ac025440 con 0x555deab0f9c0 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f826ffff640 1 -- 10.20.193.28:0/3577203271 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f82ac025720 con 0x555deab0f9c0 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 10 client.20487 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 -- 10.20.193.28:0/3577203271 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x555deaa14230 con 0x555deab0f9c0 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f826ffff640 1 -- 10.20.193.28:0/3577203271 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f82ac01b400 con 0x555deab0f9c0 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 10 client.20487 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 10 client.20487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:02.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 20 client.20487 populate_metadata read hostname 'trial028' 2026-02-20T03:33:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555deab37d50 0x555deab3a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 4 client.20487 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:02.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.029+0000 7f82c68e6e00 1 -- 10.20.193.28:0/3577203271 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555deaa615b0 con 0x555deab37d50 2026-02-20T03:33:02.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.043+0000 7f82c1955640 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555deab37d50 0x555deab3a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.085+0000 7f82c1955640 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555deab37d50 0x555deab3a140 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1291b10cebb72975 server_cookie=8fd8b6ccfa321d5a in_seq=0 out_seq=0 2026-02-20T03:33:02.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.085+0000 7f826ffff640 10 client.20487 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:02.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f826ffff640 1 -- 10.20.193.28:0/3577203271 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555deaa615b0 con 0x555deab37d50 2026-02-20T03:33:02.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f826ffff640 10 client.20487 handle_command_reply: tid=0 2026-02-20T03:33:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 client.20487 shutdown 2026-02-20T03:33:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 -- 10.20.193.28:0/3577203271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f9c0 msgr2=0x555deab282a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:02.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f9c0 0x555deab282a0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0091e0 tx=0x7f82ac00bfa0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 -- 10.20.193.28:0/3577203271 shutdown_connections 2026-02-20T03:33:02.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555deab37d50 0x555deab3a140 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab14a10 0x555deab2d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f9c0 0x555deab282a0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/3577203271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f040 0x555deab27d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f826ffff640 0 client.20487 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:02.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 -- 10.20.193.28:0/3577203271 >> 10.20.193.28:0/3577203271 conn(0x555deaac9290 msgr2=0x555deab05440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:02.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 -- 10.20.193.28:0/3577203271 shutdown_connections 2026-02-20T03:33:02.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 1 -- 10.20.193.28:0/3577203271 wait complete. 2026-02-20T03:33:02.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.099+0000 7f82c68e6e00 20 client.20487 trim_cache size 0 max 16384 2026-02-20T03:33:02.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.109+0000 7f82c68e6e00 1 Processor -- start 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- start start 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab0f040 0x555deab38840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f9c0 0x555deab38d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab14a10 0x555deab05520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8264012770 con 0x555deab14a10 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8264010040 con 0x555deab0f9c0 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f826400de90 con 0x555deab0f040 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c1955640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab14a10 0x555deab05520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c1955640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab14a10 0x555deab05520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39606/0 (socket says 10.20.193.28:39606) 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c1955640 1 -- 10.20.193.28:0/206672084 learned_addr learned my addr 10.20.193.28:0/206672084 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:02.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c1955640 1 -- 10.20.193.28:0/206672084 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab0f040 msgr2=0x555deab38840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c1955640 1 --2- 10.20.193.28:0/206672084 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab0f040 0x555deab38840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c1955640 1 -- 10.20.193.28:0/206672084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f9c0 msgr2=0x555deab38d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c1955640 1 --2- 10.20.193.28:0/206672084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f9c0 0x555deab38d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c1955640 1 -- 10.20.193.28:0/206672084 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555deab21310 con 0x555deab14a10 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c1955640 1 --2- 10.20.193.28:0/206672084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab14a10 0x555deab05520 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f82b0037000 tx=0x7f82b00023d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f9aed4a8a54adb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f828a4e6640 1 -- 10.20.193.28:0/206672084 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b00028e0 con 0x555deab14a10 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f828a4e6640 1 -- 10.20.193.28:0/206672084 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f82b0033040 con 0x555deab14a10 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f828a4e6640 1 -- 10.20.193.28:0/206672084 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b00423c0 con 0x555deab14a10 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- 10.20.193.28:0/206672084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab14a10 msgr2=0x555deab05520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/206672084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab14a10 0x555deab05520 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f82b0037000 tx=0x7f82b00023d0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- 10.20.193.28:0/206672084 shutdown_connections 2026-02-20T03:33:02.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/206672084 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab14a10 0x555deab05520 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/206672084 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab0f9c0 0x555deab38d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/206672084 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab0f040 0x555deab38840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- 10.20.193.28:0/206672084 >> 10.20.193.28:0/206672084 conn(0x555deaac9290 msgr2=0x555deab38130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- 10.20.193.28:0/206672084 shutdown_connections 2026-02-20T03:33:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- 10.20.193.28:0/206672084 wait complete. 2026-02-20T03:33:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 -- start start 2026-02-20T03:33:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.110+0000 7f82c68e6e00 1 Processor -- start 2026-02-20T03:33:02.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab31210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab0f9c0 0x555deab31750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c68e6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab14a10 0x555deaba2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f826400e500 con 0x555deab0f040 2026-02-20T03:33:02.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f826400f970 con 0x555deab14a10 2026-02-20T03:33:02.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c68e6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f826400ebd0 con 0x555deab0f9c0 2026-02-20T03:33:02.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c1955640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab31210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c1955640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab31210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39610/0 (socket says 10.20.193.28:39610) 2026-02-20T03:33:02.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c1955640 1 -- 10.20.193.28:0/1710835337 learned_addr learned my addr 10.20.193.28:0/1710835337 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:02.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c1955640 1 -- 10.20.193.28:0/1710835337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab0f9c0 msgr2=0x555deab31750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c1955640 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab0f9c0 0x555deab31750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c1955640 1 -- 10.20.193.28:0/1710835337 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab14a10 msgr2=0x555deaba2b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c1955640 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab14a10 0x555deaba2b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c1955640 1 -- 10.20.193.28:0/1710835337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dea738870 con 0x555deab0f040 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c1955640 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab31210 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f82b0039d80 tx=0x7f82b0039db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970e18a5e0b27879 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f826ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f826ffff640 1 -- 10.20.193.28:0/1710835337 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0052070 con 0x555deab0f040 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f826ffff640 1 -- 10.20.193.28:0/1710835337 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f82b002fab0 con 0x555deab0f040 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f826ffff640 1 -- 10.20.193.28:0/1710835337 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0052070 con 0x555deab0f040 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c68e6e00 1 -- 10.20.193.28:0/1710835337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dea9f9440 con 0x555deab0f040 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c68e6e00 10 client.20493 _ll_register_callbacks cb 0x7f82ac014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f82c68e6e00 1 -- 10.20.193.28:0/1710835337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555deaa2a810 con 0x555deab0f040 2026-02-20T03:33:02.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.113+0000 7f826ffff640 1 -- 10.20.193.28:0/1710835337 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f82b0004400 con 0x555deab0f040 2026-02-20T03:33:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f826ffff640 1 -- 10.20.193.28:0/1710835337 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f82b002fc60 con 0x555deab0f040 2026-02-20T03:33:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f82c68e6e00 10 client.20493 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:02.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f82c68e6e00 1 -- 10.20.193.28:0/1710835337 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x555deab22000 con 0x555deab0f040 2026-02-20T03:33:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f826ffff640 1 -- 10.20.193.28:0/1710835337 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f82b0049070 con 0x555deab0f040 2026-02-20T03:33:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f82c68e6e00 10 client.20493 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f82c68e6e00 10 client.20493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f82c68e6e00 20 client.20493 populate_metadata read hostname 'trial028' 2026-02-20T03:33:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555deaba4480 0x555deaba6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f82c68e6e00 4 client.20493 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:33:02.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.119+0000 7f82c68e6e00 1 -- 10.20.193.28:0/1710835337 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555deaa0bb00 con 0x555deaba4480 2026-02-20T03:33:02.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.140+0000 7f82c2156640 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555deaba4480 0x555deaba6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.168+0000 7f82c2156640 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555deaba4480 0x555deaba6940 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25143ff21493fb49 server_cookie=d5437fe72ff9daaa in_seq=0 out_seq=0 2026-02-20T03:33:02.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.168+0000 7f826ffff640 10 client.20493 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:02.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.181+0000 7f826ffff640 1 -- 10.20.193.28:0/1710835337 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555deaa0bb00 con 0x555deaba4480 2026-02-20T03:33:02.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.181+0000 7f826ffff640 10 client.20493 handle_command_reply: tid=0 2026-02-20T03:33:02.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.182+0000 7f82c68e6e00 1 client.20493 shutdown 2026-02-20T03:33:02.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.183+0000 7f82c68e6e00 1 -- 10.20.193.28:0/1710835337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 msgr2=0x555deab31210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:02.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.183+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab31210 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f82b0039d80 tx=0x7f82b0039db0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f82c68e6e00 1 -- 10.20.193.28:0/1710835337 shutdown_connections 2026-02-20T03:33:02.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555deaba4480 0x555deaba6940 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555deab14a10 0x555deaba2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555deab0f9c0 0x555deab31750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f82c68e6e00 1 --2- 10.20.193.28:0/1710835337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555deab0f040 0x555deab31210 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f82c68e6e00 1 -- 10.20.193.28:0/1710835337 >> 10.20.193.28:0/1710835337 conn(0x555deaac9290 msgr2=0x555deab38950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:02.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f826ffff640 0 client.20493 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:02.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f82c68e6e00 1 -- 10.20.193.28:0/1710835337 shutdown_connections 2026-02-20T03:33:02.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f82c68e6e00 1 -- 10.20.193.28:0/1710835337 wait complete. 2026-02-20T03:33:02.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.184+0000 7f82c68e6e00 20 client.20493 trim_cache size 0 max 16384 2026-02-20T03:33:02.198 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:33:02.198 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:33:02.198 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:33:02.199 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:33:02.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 -- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82980b0e20 msgr2=0x7f82980b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:02.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82980b0e20 0x7f82980b32e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f82b80a4d50 tx=0x7f82b8004220 comp rx=0 tx=0).stop 2026-02-20T03:33:02.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 -- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc108700 msgr2=0x7f82bc1a1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:02.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc108700 0x7f82bc1a1b80 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f82b800b990 tx=0x7f82b800be60 comp rx=0 tx=0).stop 2026-02-20T03:33:02.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 -- 10.20.193.28:0/2900449689 shutdown_connections 2026-02-20T03:33:02.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82980b0e20 0x7f82980b32e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f82bc108700 0x7f82bc1a1b80 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f82bc1030a0 0x7f82bc19d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 --2- 10.20.193.28:0/2900449689 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f82bc102700 0x7f82bc19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 -- 10.20.193.28:0/2900449689 >> 10.20.193.28:0/2900449689 conn(0x7f82bc0fe440 msgr2=0x7f82bc10df10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:02.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 -- 10.20.193.28:0/2900449689 shutdown_connections 2026-02-20T03:33:02.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.185+0000 7f82c3158640 1 -- 10.20.193.28:0/2900449689 wait complete. 2026-02-20T03:33:02.345 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:33:02.345 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:33:02.646 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:02.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 136925 26.78 MB/sec execute 153 sec latency 1608.409 ms 2026-02-20T03:33:02.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- 10.20.193.28:0/674049969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 msgr2=0x7f89cc10f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:02.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 --2- 10.20.193.28:0/674049969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 0x7f89cc10f2d0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009a30 tx=0x7f89b802f260 comp rx=0 tx=0).stop 2026-02-20T03:33:02.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- 10.20.193.28:0/674049969 shutdown_connections 2026-02-20T03:33:02.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 --2- 10.20.193.28:0/674049969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f89cc109ba0 0x7f89cc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 --2- 10.20.193.28:0/674049969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f89cc109220 0x7f89cc109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 --2- 10.20.193.28:0/674049969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 0x7f89cc10f2d0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- 10.20.193.28:0/674049969 >> 10.20.193.28:0/674049969 conn(0x7f89cc078600 msgr2=0x7f89cc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:02.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- 10.20.193.28:0/674049969 shutdown_connections 2026-02-20T03:33:02.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- 10.20.193.28:0/674049969 wait complete. 2026-02-20T03:33:02.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 Processor -- start 2026-02-20T03:33:02.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- start start 2026-02-20T03:33:02.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f89cc109220 0x7f89cc1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f89cc109ba0 0x7f89cc1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 0x7f89cc1a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc1191b0 con 0x7f89cc10eef0 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc119030 con 0x7f89cc109220 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f89cc119330 con 0x7f89cc109ba0 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d0b93640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 0x7f89cc1a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d0b93640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 0x7f89cc1a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39628/0 (socket says 10.20.193.28:39628) 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d0b93640 1 -- 10.20.193.28:0/3104711474 learned_addr learned my addr 10.20.193.28:0/3104711474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d0b93640 1 -- 10.20.193.28:0/3104711474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f89cc109ba0 msgr2=0x7f89cc1a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d0b93640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f89cc109ba0 0x7f89cc1a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d0b93640 1 -- 10.20.193.28:0/3104711474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f89cc109220 msgr2=0x7f89cc1a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:02.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d0b93640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f89cc109220 0x7f89cc1a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:02.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d0b93640 1 -- 10.20.193.28:0/3104711474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc1a66c0 con 0x7f89cc10eef0 2026-02-20T03:33:02.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d0b93640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 0x7f89cc1a5f40 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f89c000b990 tx=0x7f89c000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:02.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89c97fa640 1 -- 10.20.193.28:0/3104711474 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0006e60 con 0x7f89cc10eef0 2026-02-20T03:33:02.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89c97fa640 1 -- 10.20.193.28:0/3104711474 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f89c0010070 con 0x7f89cc10eef0 2026-02-20T03:33:02.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89c97fa640 1 -- 10.20.193.28:0/3104711474 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0004800 con 0x7f89cc10eef0 2026-02-20T03:33:02.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc1a69b0 con 0x7f89cc10eef0 2026-02-20T03:33:02.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.884+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89cc1ae1f0 con 0x7f89cc10eef0 2026-02-20T03:33:02.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.889+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89cc109660 con 0x7f89cc10eef0 2026-02-20T03:33:02.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.889+0000 7f89c97fa640 1 -- 10.20.193.28:0/3104711474 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f89c001d030 con 0x7f89cc10eef0 2026-02-20T03:33:02.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.889+0000 7f89c97fa640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f89a00b0e20 0x7f89a00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:02.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.889+0000 7f89c97fa640 1 -- 10.20.193.28:0/3104711474 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f89c00e0440 con 0x7f89cc10eef0 2026-02-20T03:33:02.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.893+0000 7f89cbfff640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f89a00b0e20 0x7f89a00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:02.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.893+0000 7f89c97fa640 1 -- 10.20.193.28:0/3104711474 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f89c001c2f0 con 0x7f89cc10eef0 2026-02-20T03:33:02.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:02.893+0000 7f89cbfff640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f89a00b0e20 0x7f89a00b32e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009950 tx=0x7f89b80023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:03.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.000+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89cc1a29d0 con 0x7f89cc10eef0 2026-02-20T03:33:03.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.000+0000 7f89c97fa640 1 -- 10.20.193.28:0/3104711474 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11918 (secure 0 0 0) 0x7f89c00a8820 con 0x7f89cc10eef0 2026-02-20T03:33:03.004 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:33:03.005 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":44,"btime":"2026-02-20T03:32:41:319918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:32:41.319912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:33:03.006 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 44 2026-02-20T03:33:03.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.001+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f89a00b0e20 msgr2=0x7f89a00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:03.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.001+0000 7f89d1394640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f89a00b0e20 0x7f89a00b32e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f89b8009950 tx=0x7f89b80023d0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.001+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 msgr2=0x7f89cc1a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:03.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.001+0000 7f89d1394640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 0x7f89cc1a5f40 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f89c000b990 tx=0x7f89c000be60 comp rx=0 tx=0).stop 2026-02-20T03:33:03.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.002+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 shutdown_connections 2026-02-20T03:33:03.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.002+0000 7f89d1394640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f89a00b0e20 0x7f89a00b32e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.002+0000 7f89d1394640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f89cc10eef0 0x7f89cc1a5f40 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.002+0000 7f89d1394640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f89cc109ba0 0x7f89cc1a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.002+0000 7f89d1394640 1 --2- 10.20.193.28:0/3104711474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f89cc109220 0x7f89cc1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.002+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 >> 10.20.193.28:0/3104711474 conn(0x7f89cc078600 msgr2=0x7f89cc079f90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:03.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.002+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 shutdown_connections 2026-02-20T03:33:03.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.002+0000 7f89d1394640 1 -- 10.20.193.28:0/3104711474 wait complete. 2026-02-20T03:33:03.162 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:33:03.492 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:03.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:03 trial028 ceph-mon[38552]: pgmap v737: 129 pgs: 129 active+clean; 662 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 9.2 MiB/s wr, 1.21k op/s 2026-02-20T03:33:03.535 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:03 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3104711474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:33:03.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 136926 26.61 MB/sec execute 154 sec latency 2608.574 ms 2026-02-20T03:33:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:03 trial177 ceph-mon[43181]: pgmap v737: 129 pgs: 129 active+clean; 662 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 9.2 MiB/s wr, 1.21k op/s 2026-02-20T03:33:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:03 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3104711474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:33:03.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.747+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/2810518805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 msgr2=0x7fc9e4109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:03.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.747+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/2810518805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 0x7fc9e4109680 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009a30 tx=0x7fc9d402f260 comp rx=0 tx=0).stop 2026-02-20T03:33:03.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.747+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/2810518805 shutdown_connections 2026-02-20T03:33:03.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.747+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/2810518805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9e4109bc0 0x7fc9e4115ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.747+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/2810518805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 0x7fc9e4109680 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.747+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/2810518805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9e410f1e0 0x7fc9e410f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.747+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/2810518805 >> 10.20.193.28:0/2810518805 conn(0x7fc9e4078860 msgr2=0x7fc9e407ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:03.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.747+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/2810518805 shutdown_connections 2026-02-20T03:33:03.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.747+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/2810518805 wait complete. 2026-02-20T03:33:03.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 Processor -- start 2026-02-20T03:33:03.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 -- start start 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 0x7fc9e41a7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9e4109bc0 0x7fc9e41a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9e410f1e0 0x7fc9e41a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e4119430 con 0x7fc9e4109220 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e41192b0 con 0x7fc9e410f1e0 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e41195b0 con 0x7fc9e4109bc0 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 0x7fc9e41a7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 0x7fc9e41a7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39654/0 (socket says 10.20.193.28:39654) 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e37fe640 1 -- 10.20.193.28:0/1403579927 learned_addr learned my addr 10.20.193.28:0/1403579927 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e37fe640 1 -- 10.20.193.28:0/1403579927 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9e4109bc0 msgr2=0x7fc9e41a7bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:03.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e37fe640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9e4109bc0 0x7fc9e41a7bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e37fe640 1 -- 10.20.193.28:0/1403579927 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9e410f1e0 msgr2=0x7fc9e41a1760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:03.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e37fe640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9e410f1e0 0x7fc9e41a1760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e37fe640 1 -- 10.20.193.28:0/1403579927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e41a1ff0 con 0x7fc9e4109220 2026-02-20T03:33:03.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e37fe640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 0x7fc9e41a7690 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000b570 tx=0x7fc9d000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:03.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e0ff9640 1 -- 10.20.193.28:0/1403579927 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0013020 con 0x7fc9e4109220 2026-02-20T03:33:03.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/1403579927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e41a22e0 con 0x7fc9e4109220 2026-02-20T03:33:03.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/1403579927 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e41ae610 con 0x7fc9e4109220 2026-02-20T03:33:03.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e0ff9640 1 -- 10.20.193.28:0/1403579927 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc9d0004480 con 0x7fc9e4109220 2026-02-20T03:33:03.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e0ff9640 1 -- 10.20.193.28:0/1403579927 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d000fb00 con 0x7fc9e4109220 2026-02-20T03:33:03.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9e0ff9640 1 -- 10.20.193.28:0/1403579927 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc9d0002780 con 0x7fc9e4109220 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9ec4aae00 1 Processor -- start 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.753+0000 7fc9ec4aae00 1 -- start start 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.758+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad450955e0 0x55ad450959c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.758+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad45095f90 0x55ad450999a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.758+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.758+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad45015e00 con 0x55ad4509a0d0 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.758+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ad44fe8970 con 0x55ad45095f90 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.758+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad44f961f0 con 0x55ad450955e0 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.758+0000 7fc9e0ff9640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9b80b0e20 0x7fc9b80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.758+0000 7fc9e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:03.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39658/0 (socket says 10.20.193.28:39658) 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e2ffd640 1 -- 10.20.193.28:0/1055432012 learned_addr learned my addr 10.20.193.28:0/1055432012 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e3fff640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9b80b0e20 0x7fc9b80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e0ff9640 1 -- 10.20.193.28:0/1403579927 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc9d00e0540 con 0x7fc9e4109220 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e2ffd640 1 -- 10.20.193.28:0/1055432012 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad450955e0 msgr2=0x55ad450959c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e2ffd640 1 --2- 10.20.193.28:0/1055432012 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad450955e0 0x55ad450959c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e2ffd640 1 -- 10.20.193.28:0/1055432012 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad45095f90 msgr2=0x55ad450999a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e2ffd640 1 --2- 10.20.193.28:0/1055432012 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad45095f90 0x55ad450999a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e2ffd640 1 -- 10.20.193.28:0/1055432012 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad44fa93d0 con 0x55ad4509a0d0 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e2ffd640 1 --2- 10.20.193.28:0/1055432012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450a1c50 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fc9d402f770 tx=0x7fc9d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0023774a307fa9e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9e3fff640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9b80b0e20 0x7fc9b80b32e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8007c40 tx=0x7fc9d8007260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9a7fff640 1 -- 10.20.193.28:0/1055432012 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40384f0 con 0x55ad4509a0d0 2026-02-20T03:33:03.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9a7fff640 1 -- 10.20.193.28:0/1055432012 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc9d4033040 con 0x55ad4509a0d0 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.759+0000 7fc9a7fff640 1 -- 10.20.193.28:0/1055432012 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4004320 con 0x55ad4509a0d0 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/1055432012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 msgr2=0x55ad450a1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/1055432012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450a1c50 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fc9d402f770 tx=0x7fc9d4005880 comp rx=0 tx=0).stop 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/1055432012 shutdown_connections 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/1055432012 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450a1c50 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/1055432012 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad45095f90 0x55ad450999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/1055432012 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad450955e0 0x55ad450959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/1055432012 >> 10.20.193.28:0/1055432012 conn(0x55ad45058240 msgr2=0x55ad45093ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/1055432012 shutdown_connections 2026-02-20T03:33:03.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/1055432012 wait complete. 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- start start 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 Processor -- start 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad450955e0 0x55ad450afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad45095f90 0x55ad450b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad4509a0d0 0x55ad450ae260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad44fe48a0 con 0x55ad45095f90 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ad44dd6f50 con 0x55ad450955e0 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad450ae7f0 con 0x55ad4509a0d0 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad45095f90 0x55ad450b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:03.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad45095f90 0x55ad450b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39662/0 (socket says 10.20.193.28:39662) 2026-02-20T03:33:03.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9e2ffd640 1 -- 10.20.193.28:0/414410487 learned_addr learned my addr 10.20.193.28:0/414410487 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:03.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9e2ffd640 1 -- 10.20.193.28:0/414410487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad4509a0d0 msgr2=0x55ad450ae260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:03.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9e2ffd640 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad4509a0d0 0x55ad450ae260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9e2ffd640 1 -- 10.20.193.28:0/414410487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad450955e0 msgr2=0x55ad450afb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:03.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9e2ffd640 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad450955e0 0x55ad450afb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9e2ffd640 1 -- 10.20.193.28:0/414410487 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad450a7940 con 0x55ad45095f90 2026-02-20T03:33:03.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9e2ffd640 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad45095f90 0x55ad450b0060 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4005c80 tx=0x7fc9d402fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dc925450a5ff9a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9a57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9a57fa640 1 -- 10.20.193.28:0/414410487 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40028f0 con 0x55ad45095f90 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/414410487 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad44db9b40 con 0x55ad45095f90 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 10 client.20511 _ll_register_callbacks cb 0x55ad45021eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/414410487 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ad44ff6150 con 0x55ad45095f90 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9a57fa640 1 -- 10.20.193.28:0/414410487 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc9d4047030 con 0x55ad45095f90 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9a57fa640 1 -- 10.20.193.28:0/414410487 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4042420 con 0x55ad45095f90 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9a57fa640 1 -- 10.20.193.28:0/414410487 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc9d40425c0 con 0x55ad45095f90 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9a57fa640 1 -- 10.20.193.28:0/414410487 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc9d4051060 con 0x55ad45095f90 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 10 client.20511 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.760+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/414410487 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55ad44fa31e0 con 0x55ad45095f90 2026-02-20T03:33:03.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.766+0000 7fc9a57fa640 1 -- 10.20.193.28:0/414410487 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fc9d4004090 con 0x55ad45095f90 2026-02-20T03:33:03.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.766+0000 7fc9ec4aae00 10 client.20511 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:03.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.766+0000 7fc9ec4aae00 10 client.20511 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:33:03.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.766+0000 7fc9ec4aae00 20 client.20511 populate_metadata read hostname 'trial028' 2026-02-20T03:33:03.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.766+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ad450bdea0 0x55ad450c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.766+0000 7fc9ec4aae00 4 client.20511 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:03.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.766+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/414410487 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad44ff0560 con 0x55ad450bdea0 2026-02-20T03:33:03.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.774+0000 7fc9e37fe640 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ad450bdea0 0x55ad450c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:03.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.816+0000 7fc9e37fe640 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ad450bdea0 0x55ad450c0290 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a1f8ccb522c48c7 server_cookie=a52ca86d191b2d20 in_seq=0 out_seq=0 2026-02-20T03:33:03.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.816+0000 7fc9a57fa640 10 client.20511 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:33:03.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9a57fa640 1 -- 10.20.193.28:0/414410487 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ad44ff0560 con 0x55ad450bdea0 2026-02-20T03:33:03.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9a57fa640 10 client.20511 handle_command_reply: tid=0 2026-02-20T03:33:03.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 client.20511 shutdown 2026-02-20T03:33:03.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/414410487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad45095f90 msgr2=0x55ad450b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:03.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad45095f90 0x55ad450b0060 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4005c80 tx=0x7fc9d402fcd0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/414410487 shutdown_connections 2026-02-20T03:33:03.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad4509a0d0 0x55ad450ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ad450bdea0 0x55ad450c0290 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad45095f90 0x55ad450b0060 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/414410487 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad450955e0 0x55ad450afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/414410487 >> 10.20.193.28:0/414410487 conn(0x55ad45058240 msgr2=0x55ad450988f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:03.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9a57fa640 0 client.20511 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:33:03.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/414410487 shutdown_connections 2026-02-20T03:33:03.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/414410487 wait complete. 2026-02-20T03:33:03.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.829+0000 7fc9ec4aae00 20 client.20511 trim_cache size 0 max 16384 2026-02-20T03:33:03.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9ec4aae00 1 Processor -- start 2026-02-20T03:33:03.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9ec4aae00 1 -- start start 2026-02-20T03:33:03.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad450955e0 0x55ad450ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad45095f90 0x55ad450abca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c0126f0 con 0x55ad4509a0d0 2026-02-20T03:33:03.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c00ffc0 con 0x55ad45095f90 2026-02-20T03:33:03.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c00de10 con 0x55ad450955e0 2026-02-20T03:33:03.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9e3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9e3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39676/0 (socket says 10.20.193.28:39676) 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9e3fff640 1 -- 10.20.193.28:0/2680246837 learned_addr learned my addr 10.20.193.28:0/2680246837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9e3fff640 1 -- 10.20.193.28:0/2680246837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad450955e0 msgr2=0x55ad450ab760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9e3fff640 1 --2- 10.20.193.28:0/2680246837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad450955e0 0x55ad450ab760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9e3fff640 1 -- 10.20.193.28:0/2680246837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad45095f90 msgr2=0x55ad450abca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9e3fff640 1 --2- 10.20.193.28:0/2680246837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad45095f90 0x55ad450abca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9e3fff640 1 -- 10.20.193.28:0/2680246837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad450a7770 con 0x55ad4509a0d0 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9e3fff640 1 --2- 10.20.193.28:0/2680246837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450c5ac0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8007b20 tx=0x7fc9d800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1d72d5a84a8794 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9a77fe640 1 -- 10.20.193.28:0/2680246837 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8013e20 con 0x55ad4509a0d0 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9a77fe640 1 -- 10.20.193.28:0/2680246837 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc9d8011900 con 0x55ad4509a0d0 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.835+0000 7fc9a77fe640 1 -- 10.20.193.28:0/2680246837 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d801f840 con 0x55ad4509a0d0 2026-02-20T03:33:03.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/2680246837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 msgr2=0x55ad450c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:03.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/2680246837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450c5ac0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8007b20 tx=0x7fc9d800f000 comp rx=0 tx=0).stop 2026-02-20T03:33:03.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/2680246837 shutdown_connections 2026-02-20T03:33:03.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/2680246837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad450c5ac0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/2680246837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad45095f90 0x55ad450abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/2680246837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad450955e0 0x55ad450ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/2680246837 >> 10.20.193.28:0/2680246837 conn(0x55ad45058240 msgr2=0x55ad450afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:03.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:03 trial126 ceph-mon[38476]: pgmap v737: 129 pgs: 129 active+clean; 662 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 9.2 MiB/s wr, 1.21k op/s 2026-02-20T03:33:03.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:03 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3104711474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:33:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/2680246837 shutdown_connections 2026-02-20T03:33:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/2680246837 wait complete. 2026-02-20T03:33:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- start start 2026-02-20T03:33:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 Processor -- start 2026-02-20T03:33:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad450955e0 0x55ad45123000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad45095f90 0x55ad45123540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad45123a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c00e480 con 0x55ad4509a0d0 2026-02-20T03:33:03.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c00f8f0 con 0x55ad450955e0 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c00eb50 con 0x55ad45095f90 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9e3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad45123a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9e3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad45123a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39684/0 (socket says 10.20.193.28:39684) 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9e3fff640 1 -- 10.20.193.28:0/3364651053 learned_addr learned my addr 10.20.193.28:0/3364651053 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9e3fff640 1 -- 10.20.193.28:0/3364651053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad45095f90 msgr2=0x55ad45123540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9e3fff640 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad45095f90 0x55ad45123540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9e3fff640 1 -- 10.20.193.28:0/3364651053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad450955e0 msgr2=0x55ad45123000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9e3fff640 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad450955e0 0x55ad45123000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9e3fff640 1 -- 10.20.193.28:0/3364651053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad44cc7870 con 0x55ad4509a0d0 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9e3fff640 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad45123a80 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800ca10 tx=0x7fc9d80078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf18a2f178abd2c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9a57fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:03.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9a57fa640 1 -- 10.20.193.28:0/3364651053 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8013e20 con 0x55ad4509a0d0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9a57fa640 1 -- 10.20.193.28:0/3364651053 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc9d801fa60 con 0x55ad4509a0d0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/3364651053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad44f883f0 con 0x55ad4509a0d0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9a57fa640 1 -- 10.20.193.28:0/3364651053 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d802bab0 con 0x55ad4509a0d0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 10 client.20517 _ll_register_callbacks cb 0x7fc9d40057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/3364651053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ad44fb97c0 con 0x55ad4509a0d0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9a57fa640 1 -- 10.20.193.28:0/3364651053 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc9d802bc50 con 0x55ad4509a0d0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9a57fa640 1 -- 10.20.193.28:0/3364651053 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc9d801f5c0 con 0x55ad4509a0d0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 10 client.20517 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.840+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/3364651053 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55ad450a8460 con 0x55ad4509a0d0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.843+0000 7fc9a57fa640 1 -- 10.20.193.28:0/3364651053 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fc9d8033030 con 0x55ad4509a0d0 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.843+0000 7fc9ec4aae00 10 client.20517 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:03.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.843+0000 7fc9ec4aae00 10 client.20517 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:33:03.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.843+0000 7fc9ec4aae00 20 client.20517 populate_metadata read hostname 'trial028' 2026-02-20T03:33:03.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.843+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ad4513b650 0x55ad4513db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:03.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.843+0000 7fc9ec4aae00 4 client.20517 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:33:03.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.843+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/3364651053 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad44f9aab0 con 0x55ad4513b650 2026-02-20T03:33:03.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.857+0000 7fc9e37fe640 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ad4513b650 0x55ad4513db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:03.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9e37fe640 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ad4513b650 0x55ad4513db10 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee6ede2ea7c1cba6 server_cookie=499c3701374ebb64 in_seq=0 out_seq=0 2026-02-20T03:33:03.900 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9a57fa640 10 client.20517 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:33:03.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9a57fa640 1 -- 10.20.193.28:0/3364651053 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad44f9aab0 con 0x55ad4513b650 2026-02-20T03:33:03.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9a57fa640 10 client.20517 handle_command_reply: tid=0 2026-02-20T03:33:03.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 client.20517 shutdown 2026-02-20T03:33:03.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/3364651053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 msgr2=0x55ad45123a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:03.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad45123a80 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fc9d800ca10 tx=0x7fc9d80078e0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/3364651053 shutdown_connections 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55ad4513b650 0x55ad4513db10 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad4509a0d0 0x55ad45123a80 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad45095f90 0x55ad45123540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 --2- 10.20.193.28:0/3364651053 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad450955e0 0x55ad45123000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/3364651053 >> 10.20.193.28:0/3364651053 conn(0x55ad45058240 msgr2=0x55ad450914b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9a57fa640 0 client.20517 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/3364651053 shutdown_connections 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 1 -- 10.20.193.28:0/3364651053 wait complete. 2026-02-20T03:33:03.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9ec4aae00 20 client.20517 trim_cache size 0 max 16384 2026-02-20T03:33:03.913 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:33:03.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9b80b0e20 msgr2=0x7fc9b80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:03.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9b80b0e20 0x7fc9b80b32e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8007c40 tx=0x7fc9d8007260 comp rx=0 tx=0).stop 2026-02-20T03:33:03.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 msgr2=0x7fc9e41a7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:03.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.898+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 0x7fc9e41a7690 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000b570 tx=0x7fc9d000ba40 comp rx=0 tx=0).stop 2026-02-20T03:33:03.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.901+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/1403579927 shutdown_connections 2026-02-20T03:33:03.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.901+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc9b80b0e20 0x7fc9b80b32e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.901+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc9e410f1e0 0x7fc9e41a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.901+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc9e4109bc0 0x7fc9e41a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.901+0000 7fc9e9fa5640 1 --2- 10.20.193.28:0/1403579927 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc9e4109220 0x7fc9e41a7690 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:03.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.901+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/1403579927 >> 10.20.193.28:0/1403579927 conn(0x7fc9e4078860 msgr2=0x7fc9e407a290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:03.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.901+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/1403579927 shutdown_connections 2026-02-20T03:33:03.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:03.901+0000 7fc9e9fa5640 1 -- 10.20.193.28:0/1403579927 wait complete. 2026-02-20T03:33:04.098 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:33:04.417 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:04.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.662+0000 7f01a3fff640 1 -- 10.20.193.28:0/3041765288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a4074d00 msgr2=0x7f01a410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:04.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.662+0000 7f01a3fff640 1 --2- 10.20.193.28:0/3041765288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a4074d00 0x7f01a410a470 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f0198009a30 tx=0x7f019802f260 comp rx=0 tx=0).stop 2026-02-20T03:33:04.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.662+0000 7f01a3fff640 1 -- 10.20.193.28:0/3041765288 shutdown_connections 2026-02-20T03:33:04.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.662+0000 7f01a3fff640 1 --2- 10.20.193.28:0/3041765288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01a41158b0 0x7f01a4117ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.662+0000 7f01a3fff640 1 --2- 10.20.193.28:0/3041765288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f01a410a9b0 0x7f01a410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.662+0000 7f01a3fff640 1 --2- 10.20.193.28:0/3041765288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a4074d00 0x7f01a410a470 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.662+0000 7f01a3fff640 1 -- 10.20.193.28:0/3041765288 >> 10.20.193.28:0/3041765288 conn(0x7f01a406ead0 msgr2=0x7f01a406eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:04.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.662+0000 7f01a3fff640 1 -- 10.20.193.28:0/3041765288 shutdown_connections 2026-02-20T03:33:04.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.662+0000 7f01a3fff640 1 -- 10.20.193.28:0/3041765288 wait complete. 2026-02-20T03:33:04.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.664+0000 7f01a3fff640 1 Processor -- start 2026-02-20T03:33:04.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.664+0000 7f01a3fff640 1 -- start start 2026-02-20T03:33:04.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.664+0000 7f01a3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01a4074d00 0x7f01a41ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.664+0000 7f01a3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f01a410a9b0 0x7f01a41abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.664+0000 7f01a3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a41158b0 0x7f01a41a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.664+0000 7f01a3fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f01a411b4c0 con 0x7f01a41158b0 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.664+0000 7f01a3fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f01a411b340 con 0x7f01a410a9b0 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.664+0000 7f01a3fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f01a411b640 con 0x7f01a4074d00 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a41158b0 0x7f01a41a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a41158b0 0x7f01a41a5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39706/0 (socket says 10.20.193.28:39706) 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a37fe640 1 -- 10.20.193.28:0/936443453 learned_addr learned my addr 10.20.193.28:0/936443453 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a37fe640 1 -- 10.20.193.28:0/936443453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01a4074d00 msgr2=0x7f01a41ab850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a37fe640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01a4074d00 0x7f01a41ab850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a37fe640 1 -- 10.20.193.28:0/936443453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f01a410a9b0 msgr2=0x7f01a41abd90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a37fe640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f01a410a9b0 0x7f01a41abd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a37fe640 1 -- 10.20.193.28:0/936443453 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a41a61e0 con 0x7f01a41158b0 2026-02-20T03:33:04.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a37fe640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a41158b0 0x7f01a41a5a10 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f019400b9e0 tx=0x7f019400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f0183fff640 1 -- 10.20.193.28:0/936443453 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194006e60 con 0x7f01a41158b0 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a3fff640 1 -- 10.20.193.28:0/936443453 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a41a64d0 con 0x7f01a41158b0 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f0183fff640 1 -- 10.20.193.28:0/936443453 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0194010070 con 0x7f01a41158b0 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f0183fff640 1 -- 10.20.193.28:0/936443453 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0194006e60 con 0x7f01a41158b0 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01a3fff640 1 -- 10.20.193.28:0/936443453 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a41b28f0 con 0x7f01a41158b0 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f0183fff640 1 -- 10.20.193.28:0/936443453 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f019400c690 con 0x7f01a41158b0 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.665+0000 7f01abbe4e00 1 Processor -- start 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01abbe4e00 1 -- start start 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f0183fff640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01740b1220 0x7f01740b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f0183fff640 1 -- 10.20.193.28:0/936443453 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0194002d10 con 0x7f01a41158b0 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983090 0x557d0e983470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e987570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e98f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557d0e8fae00 con 0x557d0e983a40 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557d0e8cd970 con 0x557d0e987c80 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557d0e87b1f0 con 0x557d0e983090 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01a27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e987570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01a27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e987570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39712/0 (socket says 10.20.193.28:39712) 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01a27fc640 1 -- 10.20.193.28:0/3118369752 learned_addr learned my addr 10.20.193.28:0/3118369752 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01a27fc640 1 -- 10.20.193.28:0/3118369752 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983090 msgr2=0x557d0e983470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01a27fc640 1 --2- 10.20.193.28:0/3118369752 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983090 0x557d0e983470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01a27fc640 1 -- 10.20.193.28:0/3118369752 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 msgr2=0x557d0e98f820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01a27fc640 1 --2- 10.20.193.28:0/3118369752 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e98f820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.670+0000 7f01a27fc640 1 -- 10.20.193.28:0/3118369752 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0e88e3d0 con 0x557d0e983a40 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01a27fc640 1 --2- 10.20.193.28:0/3118369752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e987570 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f018c00bf80 tx=0x7f018c00d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1d9a0a3c63ad11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01a27fc640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01740b1220 0x7f01740b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f016b7fe640 1 -- 10.20.193.28:0/3118369752 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c004ae0 con 0x557d0e983a40 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f016b7fe640 1 -- 10.20.193.28:0/3118369752 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f018c004d00 con 0x557d0e983a40 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f016b7fe640 1 -- 10.20.193.28:0/3118369752 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c016c20 con 0x557d0e983a40 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01abbe4e00 1 -- 10.20.193.28:0/3118369752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 msgr2=0x557d0e987570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/3118369752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e987570 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f018c00bf80 tx=0x7f018c00d4f0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01a27fc640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01740b1220 0x7f01740b36e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f018c00dfd0 tx=0x7f018c014830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01abbe4e00 1 -- 10.20.193.28:0/3118369752 shutdown_connections 2026-02-20T03:33:04.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/3118369752 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e98f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/3118369752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e987570 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/3118369752 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983090 0x557d0e983470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01abbe4e00 1 -- 10.20.193.28:0/3118369752 >> 10.20.193.28:0/3118369752 conn(0x557d0e93d240 msgr2=0x557d0e9816f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01abbe4e00 1 -- 10.20.193.28:0/3118369752 shutdown_connections 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.671+0000 7f01abbe4e00 1 -- 10.20.193.28:0/3118369752 wait complete. 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01abbe4e00 1 -- start start 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01abbe4e00 1 Processor -- start 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e99d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983a40 0x557d0e99db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e99bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.682 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557d0e8c98a0 con 0x557d0e983090 2026-02-20T03:33:04.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557d0e6bbf50 con 0x557d0e987c80 2026-02-20T03:33:04.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557d0e99c500 con 0x557d0e983a40 2026-02-20T03:33:04.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01a2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e99d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:04.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01a2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e99d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39726/0 (socket says 10.20.193.28:39726) 2026-02-20T03:33:04.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01a2ffd640 1 -- 10.20.193.28:0/1027432318 learned_addr learned my addr 10.20.193.28:0/1027432318 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:04.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01a2ffd640 1 -- 10.20.193.28:0/1027432318 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983a40 msgr2=0x557d0e99db80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:04.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.673+0000 7f01a2ffd640 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983a40 0x557d0e99db80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.678+0000 7f01a2ffd640 1 -- 10.20.193.28:0/1027432318 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 msgr2=0x557d0e99bd80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:04.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.678+0000 7f01a2ffd640 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e99bd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.678+0000 7f01a2ffd640 1 -- 10.20.193.28:0/1027432318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0e995520 con 0x557d0e983090 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.678+0000 7f01a2ffd640 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e99d640 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f019802f770 tx=0x7f0198005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4cd04a7ccab3b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.678+0000 7f0168ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f0168ff9640 1 -- 10.20.193.28:0/1027432318 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019802fcd0 con 0x557d0e983090 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f0168ff9640 1 -- 10.20.193.28:0/1027432318 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0198033040 con 0x557d0e983090 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f0168ff9640 1 -- 10.20.193.28:0/1027432318 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01980389d0 con 0x557d0e983090 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1027432318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0e69eb40 con 0x557d0e983090 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f0168ff9640 1 -- 10.20.193.28:0/1027432318 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0198038c30 con 0x557d0e983090 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f0168ff9640 10 client.20529 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 10 client.20529 _ll_register_callbacks cb 0x557d0e906eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:04.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1027432318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d0e8db150 con 0x557d0e983090 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f0168ff9640 1 -- 10.20.193.28:0/1027432318 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0198038e30 con 0x557d0e983090 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 10 client.20529 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1027432318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x557d0e8881e0 con 0x557d0e983090 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f0168ff9640 1 -- 10.20.193.28:0/1027432318 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f0198004030 con 0x557d0e983090 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 10 client.20529 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 10 client.20529 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 20 client.20529 populate_metadata read hostname 'trial028' 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x557d0e9abdf0 0x557d0e9ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 4 client.20529 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:04.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.683+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1027432318 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d0e8d5560 con 0x557d0e9abdf0 2026-02-20T03:33:04.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.700+0000 7f01a27fc640 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x557d0e9abdf0 0x557d0e9ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:04.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 136926 26.44 MB/sec execute 155 sec latency 3608.617 ms 2026-02-20T03:33:04.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.727+0000 7f01a27fc640 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x557d0e9abdf0 0x557d0e9ae280 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1bea2f2167d02278 server_cookie=b1ed43b9d8408577 in_seq=0 out_seq=0 2026-02-20T03:33:04.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.727+0000 7f0168ff9640 10 client.20529 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:33:04.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f0168ff9640 1 -- 10.20.193.28:0/1027432318 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557d0e8d5560 con 0x557d0e9abdf0 2026-02-20T03:33:04.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f0168ff9640 10 client.20529 handle_command_reply: tid=0 2026-02-20T03:33:04.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 client.20529 shutdown 2026-02-20T03:33:04.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1027432318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 msgr2=0x557d0e99d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:04.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e99d640 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f019802f770 tx=0x7f0198005cd0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1027432318 shutdown_connections 2026-02-20T03:33:04.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x557d0e9abdf0 0x557d0e9ae280 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e99bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983a40 0x557d0e99db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1027432318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e99d640 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1027432318 >> 10.20.193.28:0/1027432318 conn(0x557d0e93d240 msgr2=0x557d0e988ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:04.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f0168ff9640 0 client.20529 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:33:04.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1027432318 shutdown_connections 2026-02-20T03:33:04.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1027432318 wait complete. 2026-02-20T03:33:04.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.741+0000 7f01abbe4e00 20 client.20529 trim_cache size 0 max 16384 2026-02-20T03:33:04.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 Processor -- start 2026-02-20T03:33:04.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 -- start start 2026-02-20T03:33:04.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e972d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983a40 0x557d0e99ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e9806f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0148012770 con 0x557d0e983090 2026-02-20T03:33:04.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0148010040 con 0x557d0e987c80 2026-02-20T03:33:04.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f014800de90 con 0x557d0e983a40 2026-02-20T03:33:04.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01a2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e972d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01a2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e972d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39740/0 (socket says 10.20.193.28:39740) 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01a2ffd640 1 -- 10.20.193.28:0/1976489226 learned_addr learned my addr 10.20.193.28:0/1976489226 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01a2ffd640 1 -- 10.20.193.28:0/1976489226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983a40 msgr2=0x557d0e99ad30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01a2ffd640 1 --2- 10.20.193.28:0/1976489226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983a40 0x557d0e99ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01a2ffd640 1 -- 10.20.193.28:0/1976489226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 msgr2=0x557d0e9806f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01a2ffd640 1 --2- 10.20.193.28:0/1976489226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e9806f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01a2ffd640 1 -- 10.20.193.28:0/1976489226 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0e995350 con 0x557d0e983090 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01a2ffd640 1 --2- 10.20.193.28:0/1976489226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e972d00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f0198038c70 tx=0x7f0198046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a156ea1c1ceeb2c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f016affd640 1 -- 10.20.193.28:0/1976489226 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0198052070 con 0x557d0e983090 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f016affd640 1 -- 10.20.193.28:0/1976489226 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x557d0e8db150 con 0x557d0e983090 2026-02-20T03:33:04.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f016affd640 1 -- 10.20.193.28:0/1976489226 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01980054e0 con 0x557d0e983090 2026-02-20T03:33:04.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1976489226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 msgr2=0x557d0e972d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:04.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1976489226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e972d00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f0198038c70 tx=0x7f0198046000 comp rx=0 tx=0).stop 2026-02-20T03:33:04.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1976489226 shutdown_connections 2026-02-20T03:33:04.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1976489226 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e9806f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1976489226 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983a40 0x557d0e99ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/1976489226 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983090 0x557d0e972d00 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1976489226 >> 10.20.193.28:0/1976489226 conn(0x557d0e93d240 msgr2=0x557d0e99a620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:04.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1976489226 shutdown_connections 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.747+0000 7f01abbe4e00 1 -- 10.20.193.28:0/1976489226 wait complete. 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 -- start start 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 Processor -- start 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983090 0x557d0e9a0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e9a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e9a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f014800e500 con 0x557d0e983a40 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f014800f970 con 0x557d0e987c80 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f014800ebd0 con 0x557d0e983090 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01a27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e9a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:04.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01a27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e9a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39754/0 (socket says 10.20.193.28:39754) 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01a27fc640 1 -- 10.20.193.28:0/2442772506 learned_addr learned my addr 10.20.193.28:0/2442772506 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01a27fc640 1 -- 10.20.193.28:0/2442772506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983090 msgr2=0x557d0e9a0500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01a27fc640 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983090 0x557d0e9a0500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01a27fc640 1 -- 10.20.193.28:0/2442772506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 msgr2=0x557d0e9a0f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01a27fc640 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e9a0f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01a27fc640 1 -- 10.20.193.28:0/2442772506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0e5ac870 con 0x557d0e983a40 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01a27fc640 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e9a0a40 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f018c00da00 tx=0x7f018c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4007f89896ba432 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f0168ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f0168ff9640 1 -- 10.20.193.28:0/2442772506 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c014e70 con 0x557d0e983a40 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f0168ff9640 1 -- 10.20.193.28:0/2442772506 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f018c016c10 con 0x557d0e983a40 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f0168ff9640 1 -- 10.20.193.28:0/2442772506 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c0042d0 con 0x557d0e983a40 2026-02-20T03:33:04.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 -- 10.20.193.28:0/2442772506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0e86d3f0 con 0x557d0e983a40 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f0168ff9640 1 -- 10.20.193.28:0/2442772506 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f018c004470 con 0x557d0e983a40 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 10 client.20535 _ll_register_callbacks cb 0x7f0198009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 -- 10.20.193.28:0/2442772506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557d0e89e7c0 con 0x557d0e983a40 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f0168ff9640 1 -- 10.20.193.28:0/2442772506 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f018c004670 con 0x557d0e983a40 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 10 client.20535 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.752+0000 7f01abbe4e00 1 -- 10.20.193.28:0/2442772506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x557d0e996040 con 0x557d0e983a40 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.754+0000 7f0168ff9640 1 -- 10.20.193.28:0/2442772506 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f018c03b030 con 0x557d0e983a40 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.754+0000 7f01abbe4e00 10 client.20535 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.754+0000 7f01abbe4e00 10 client.20535 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.754+0000 7f01abbe4e00 20 client.20535 populate_metadata read hostname 'trial028' 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.754+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x557d0ea18130 0x557d0ea1a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.754+0000 7f01abbe4e00 4 client.20535 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:33:04.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.754+0000 7f01abbe4e00 1 -- 10.20.193.28:0/2442772506 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d0e87fab0 con 0x557d0ea18130 2026-02-20T03:33:04.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.768+0000 7f01a2ffd640 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x557d0ea18130 0x557d0ea1a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:04.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.835+0000 7f01a2ffd640 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x557d0ea18130 0x557d0ea1a5f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bec2a8d440ac5bca server_cookie=aee558536a81033a in_seq=0 out_seq=0 2026-02-20T03:33:04.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.835+0000 7f0168ff9640 10 client.20535 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:33:04.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f0168ff9640 1 -- 10.20.193.28:0/2442772506 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d0e87fab0 con 0x557d0ea18130 2026-02-20T03:33:04.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f0168ff9640 10 client.20535 handle_command_reply: tid=0 2026-02-20T03:33:04.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 client.20535 shutdown 2026-02-20T03:33:04.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 -- 10.20.193.28:0/2442772506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 msgr2=0x557d0e9a0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e9a0a40 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f018c00da00 tx=0x7f018c012000 comp rx=0 tx=0).stop 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 -- 10.20.193.28:0/2442772506 shutdown_connections 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x557d0ea18130 0x557d0ea1a5f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557d0e987c80 0x557d0e9a0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557d0e983a40 0x557d0e9a0a40 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 --2- 10.20.193.28:0/2442772506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557d0e983090 0x557d0e9a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 -- 10.20.193.28:0/2442772506 >> 10.20.193.28:0/2442772506 conn(0x557d0e93d240 msgr2=0x557d0e99ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f0168ff9640 0 client.20535 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 -- 10.20.193.28:0/2442772506 shutdown_connections 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 1 -- 10.20.193.28:0/2442772506 wait complete. 2026-02-20T03:33:04.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01abbe4e00 20 client.20535 trim_cache size 0 max 16384 2026-02-20T03:33:04.864 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:33:04.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01a3fff640 1 -- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01740b1220 msgr2=0x7f01740b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:04.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01a3fff640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01740b1220 0x7f01740b36e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f018c00dfd0 tx=0x7f018c014830 comp rx=0 tx=0).stop 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01a3fff640 1 -- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a41158b0 msgr2=0x7f01a41a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.848+0000 7f01a3fff640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a41158b0 0x7f01a41a5a10 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f019400b9e0 tx=0x7f019400beb0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.849+0000 7f01a3fff640 1 -- 10.20.193.28:0/936443453 shutdown_connections 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.849+0000 7f01a3fff640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f01740b1220 0x7f01740b36e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.849+0000 7f01a3fff640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f01a41158b0 0x7f01a41a5a10 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.849+0000 7f01a3fff640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f01a410a9b0 0x7f01a41abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.849+0000 7f01a3fff640 1 --2- 10.20.193.28:0/936443453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f01a4074d00 0x7f01a41ab850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.849+0000 7f01a3fff640 1 -- 10.20.193.28:0/936443453 >> 10.20.193.28:0/936443453 conn(0x7f01a406ead0 msgr2=0x7f01a4073910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.849+0000 7f01a3fff640 1 -- 10.20.193.28:0/936443453 shutdown_connections 2026-02-20T03:33:04.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:04.849+0000 7f01a3fff640 1 -- 10.20.193.28:0/936443453 wait complete. 2026-02-20T03:33:05.071 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:33:05.360 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:05.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.612+0000 7faacdb54640 1 -- 10.20.193.28:0/728001385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac81069e0 msgr2=0x7faac8107350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:05.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.612+0000 7faacdb54640 1 --2- 10.20.193.28:0/728001385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac81069e0 0x7faac8107350 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7faac400b0a0 tx=0x7faac402f450 comp rx=0 tx=0).stop 2026-02-20T03:33:05.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.612+0000 7faacdb54640 1 -- 10.20.193.28:0/728001385 shutdown_connections 2026-02-20T03:33:05.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.612+0000 7faacdb54640 1 --2- 10.20.193.28:0/728001385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac81069e0 0x7faac8107350 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.612+0000 7faacdb54640 1 --2- 10.20.193.28:0/728001385 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faac8101700 0x7faac81062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.612+0000 7faacdb54640 1 --2- 10.20.193.28:0/728001385 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faac8100d50 0x7faac8101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.612+0000 7faacdb54640 1 -- 10.20.193.28:0/728001385 >> 10.20.193.28:0/728001385 conn(0x7faac80fca60 msgr2=0x7faac80fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:05.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.612+0000 7faacdb54640 1 -- 10.20.193.28:0/728001385 shutdown_connections 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.612+0000 7faacdb54640 1 -- 10.20.193.28:0/728001385 wait complete. 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.613+0000 7faacdb54640 1 Processor -- start 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.613+0000 7faacdb54640 1 -- start start 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faacdb54640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac8100d50 0x7faac81a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faacdb54640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faac8101700 0x7faac81a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faacdb54640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faac81069e0 0x7faac81a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faacdb54640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faac81191c0 con 0x7faac8100d50 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faacdb54640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faac8119040 con 0x7faac81069e0 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faacdb54640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faac8119340 con 0x7faac8101700 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faaccb52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac8100d50 0x7faac81a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faaccb52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac8100d50 0x7faac81a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39772/0 (socket says 10.20.193.28:39772) 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faaccb52640 1 -- 10.20.193.28:0/629918848 learned_addr learned my addr 10.20.193.28:0/629918848 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faaccb52640 1 -- 10.20.193.28:0/629918848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faac8101700 msgr2=0x7faac81a1af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faaccb52640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faac8101700 0x7faac81a1af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faaccb52640 1 -- 10.20.193.28:0/629918848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faac81069e0 msgr2=0x7faac81a5e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faaccb52640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faac81069e0 0x7faac81a5e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.617 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faaccb52640 1 -- 10.20.193.28:0/629918848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac81a6600 con 0x7faac8100d50 2026-02-20T03:33:05.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faaccb52640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac8100d50 0x7faac81a15b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7faab800b570 tx=0x7faab800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:05.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faabdffb640 1 -- 10.20.193.28:0/629918848 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8013020 con 0x7faac8100d50 2026-02-20T03:33:05.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faabdffb640 1 -- 10.20.193.28:0/629918848 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faab8004480 con 0x7faac8100d50 2026-02-20T03:33:05.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faabdffb640 1 -- 10.20.193.28:0/629918848 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab800fb50 con 0x7faac8100d50 2026-02-20T03:33:05.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faacdb54640 1 -- 10.20.193.28:0/629918848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac81a68f0 con 0x7faac8100d50 2026-02-20T03:33:05.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faacdb54640 1 -- 10.20.193.28:0/629918848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac81ae130 con 0x7faac8100d50 2026-02-20T03:33:05.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faabdffb640 1 -- 10.20.193.28:0/629918848 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7faab8002780 con 0x7faac8100d50 2026-02-20T03:33:05.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faad12e2e00 1 Processor -- start 2026-02-20T03:33:05.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faad12e2e00 1 -- start start 2026-02-20T03:33:05.625 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:05 trial028 ceph-mon[38552]: pgmap v738: 129 pgs: 129 active+clean; 681 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2026-02-20T03:33:05.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897af4fb0 0x562897af5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897aef5e0 0x562897aefa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897afbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faad12e2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562897a6fe00 con 0x562897aeff60 2026-02-20T03:33:05.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faad12e2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562897a42970 con 0x562897af4fb0 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faad12e2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5628979f01f0 con 0x562897aef5e0 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faabdffb640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa9c0b0e20 0x7faa9c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.614+0000 7faabdffb640 1 -- 10.20.193.28:0/629918848 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7faab80e04d0 con 0x7faac8100d50 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faacd353640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa9c0b0e20 0x7faa9c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faabffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897afbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faabffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897afbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39776/0 (socket says 10.20.193.28:39776) 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faabffff640 1 -- 10.20.193.28:0/2924443107 learned_addr learned my addr 10.20.193.28:0/2924443107 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faacd353640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa9c0b0e20 0x7faa9c0b32e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faac402f960 tx=0x7faac4031040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faabffff640 1 -- 10.20.193.28:0/2924443107 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897aef5e0 msgr2=0x562897aefa20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faabffff640 1 --2- 10.20.193.28:0/2924443107 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897aef5e0 0x562897aefa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faabffff640 1 -- 10.20.193.28:0/2924443107 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897af4fb0 msgr2=0x562897af5390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faabffff640 1 --2- 10.20.193.28:0/2924443107 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897af4fb0 0x562897af5390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faabffff640 1 -- 10.20.193.28:0/2924443107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897a033d0 con 0x562897aeff60 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faabffff640 1 --2- 10.20.193.28:0/2924443107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897afbde0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7faab0009840 tx=0x7faab0009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213f027dda7d962d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faa994e4640 1 -- 10.20.193.28:0/2924443107 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0016070 con 0x562897aeff60 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faa994e4640 1 -- 10.20.193.28:0/2924443107 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faab0004480 con 0x562897aeff60 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faa994e4640 1 -- 10.20.193.28:0/2924443107 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab000bd00 con 0x562897aeff60 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faad12e2e00 1 -- 10.20.193.28:0/2924443107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 msgr2=0x562897afbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faad12e2e00 1 --2- 10.20.193.28:0/2924443107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897afbde0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7faab0009840 tx=0x7faab0009d10 comp rx=0 tx=0).stop 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faad12e2e00 1 -- 10.20.193.28:0/2924443107 shutdown_connections 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faad12e2e00 1 --2- 10.20.193.28:0/2924443107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897afbde0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faad12e2e00 1 --2- 10.20.193.28:0/2924443107 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897aef5e0 0x562897aefa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faad12e2e00 1 --2- 10.20.193.28:0/2924443107 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897af4fb0 0x562897af5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faad12e2e00 1 -- 10.20.193.28:0/2924443107 >> 10.20.193.28:0/2924443107 conn(0x562897ab2240 msgr2=0x562897aedce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faad12e2e00 1 -- 10.20.193.28:0/2924443107 shutdown_connections 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.620+0000 7faad12e2e00 1 -- 10.20.193.28:0/2924443107 wait complete. 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 -- start start 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 Processor -- start 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b086f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897aeff60 0x562897b08c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897af4fb0 0x562897b0cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562897a3e8a0 con 0x562897aef5e0 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562897830f50 con 0x562897af4fb0 2026-02-20T03:33:05.629 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562897b0d460 con 0x562897aeff60 2026-02-20T03:33:05.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faaccb52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b086f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:05.630 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faaccb52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b086f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39784/0 (socket says 10.20.193.28:39784) 2026-02-20T03:33:05.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faaccb52640 1 -- 10.20.193.28:0/3634066207 learned_addr learned my addr 10.20.193.28:0/3634066207 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:05.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faaccb52640 1 -- 10.20.193.28:0/3634066207 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897aeff60 msgr2=0x562897b08c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:05.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faaccb52640 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897aeff60 0x562897b08c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faaccb52640 1 -- 10.20.193.28:0/3634066207 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897af4fb0 msgr2=0x562897b0cf20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:05.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faaccb52640 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897af4fb0 0x562897b0cf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faaccb52640 1 -- 10.20.193.28:0/3634066207 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897b01b70 con 0x562897aef5e0 2026-02-20T03:33:05.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faaccb52640 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b086f0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7faab800b540 tx=0x7faab80a8910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf49f0c74198d3a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:05.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faa867fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:05.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faa867fc640 1 -- 10.20.193.28:0/3634066207 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8002aa0 con 0x562897aef5e0 2026-02-20T03:33:05.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faa867fc640 1 -- 10.20.193.28:0/3634066207 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faab80e00d0 con 0x562897aef5e0 2026-02-20T03:33:05.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faa867fc640 1 -- 10.20.193.28:0/3634066207 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80a3c60 con 0x562897aef5e0 2026-02-20T03:33:05.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 -- 10.20.193.28:0/3634066207 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562897813b40 con 0x562897aef5e0 2026-02-20T03:33:05.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faa867fc640 1 -- 10.20.193.28:0/3634066207 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7faab80a6c90 con 0x562897aef5e0 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faa867fc640 10 client.20547 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 10 client.20547 _ll_register_callbacks cb 0x562897a7beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 -- 10.20.193.28:0/3634066207 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562897a50150 con 0x562897aef5e0 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faa867fc640 1 -- 10.20.193.28:0/3634066207 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7faab80e0280 con 0x562897aef5e0 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 10 client.20547 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 -- 10.20.193.28:0/3634066207 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x5628979fd1e0 con 0x562897aef5e0 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faa867fc640 1 -- 10.20.193.28:0/3634066207 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7faab80a6e90 con 0x562897aef5e0 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 10 client.20547 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 10 client.20547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 20 client.20547 populate_metadata read hostname 'trial028' 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562897b18840 0x562897b1ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.653 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 4 client.20547 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:05.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.623+0000 7faad12e2e00 1 -- 10.20.193.28:0/3634066207 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562897a4a560 con 0x562897b18840 2026-02-20T03:33:05.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.663+0000 7faabffff640 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562897b18840 0x562897b1ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:05.710 INFO:tasks.workunit.client.0.trial028.stdout: 10 136926 26.27 MB/sec execute 156 sec latency 4608.660 ms 2026-02-20T03:33:05.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:05 trial177 ceph-mon[43181]: pgmap v738: 129 pgs: 129 active+clean; 681 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2026-02-20T03:33:05.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.730+0000 7faabffff640 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562897b18840 0x562897b1ace0 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55a2921171be8bff server_cookie=a35e7be312b7ad62 in_seq=0 out_seq=0 2026-02-20T03:33:05.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.730+0000 7faa867fc640 10 client.20547 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:05.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.756+0000 7faa867fc640 1 -- 10.20.193.28:0/3634066207 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562897a4a560 con 0x562897b18840 2026-02-20T03:33:05.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.756+0000 7faa867fc640 10 client.20547 handle_command_reply: tid=0 2026-02-20T03:33:05.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.756+0000 7faad12e2e00 1 client.20547 shutdown 2026-02-20T03:33:05.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.756+0000 7faad12e2e00 1 -- 10.20.193.28:0/3634066207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 msgr2=0x562897b086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:05.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.756+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b086f0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7faab800b540 tx=0x7faab80a8910 comp rx=0 tx=0).stop 2026-02-20T03:33:05.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faad12e2e00 1 -- 10.20.193.28:0/3634066207 shutdown_connections 2026-02-20T03:33:05.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562897b18840 0x562897b1ace0 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897af4fb0 0x562897b0cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897aeff60 0x562897b08c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3634066207 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b086f0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faad12e2e00 1 -- 10.20.193.28:0/3634066207 >> 10.20.193.28:0/3634066207 conn(0x562897ab2240 msgr2=0x562897aee3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:05.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faa867fc640 0 client.20547 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:05.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faad12e2e00 1 -- 10.20.193.28:0/3634066207 shutdown_connections 2026-02-20T03:33:05.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faad12e2e00 1 -- 10.20.193.28:0/3634066207 wait complete. 2026-02-20T03:33:05.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.757+0000 7faad12e2e00 20 client.20547 trim_cache size 0 max 16384 2026-02-20T03:33:05.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 Processor -- start 2026-02-20T03:33:05.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- start start 2026-02-20T03:33:05.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897aef5e0 0x562897b14e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897b15340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897af4fb0 0x562897b059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c0126a0 con 0x562897aeff60 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c00ff70 con 0x562897aef5e0 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c00ddc0 con 0x562897af4fb0 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faabffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897b15340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faabffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897b15340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39800/0 (socket says 10.20.193.28:39800) 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faabffff640 1 -- 10.20.193.28:0/3617834309 learned_addr learned my addr 10.20.193.28:0/3617834309 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faabffff640 1 -- 10.20.193.28:0/3617834309 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897af4fb0 msgr2=0x562897b059e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:05.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faabffff640 1 --2- 10.20.193.28:0/3617834309 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897af4fb0 0x562897b059e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faabffff640 1 -- 10.20.193.28:0/3617834309 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897aef5e0 msgr2=0x562897b14e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faabffff640 1 --2- 10.20.193.28:0/3617834309 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897aef5e0 0x562897b14e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faabffff640 1 -- 10.20.193.28:0/3617834309 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897b019a0 con 0x562897aeff60 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faabffff640 1 --2- 10.20.193.28:0/3617834309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897b15340 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7faab000b4b0 tx=0x7faab0009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389be02c20c64fbb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faa98ce3640 1 -- 10.20.193.28:0/3617834309 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0016040 con 0x562897aeff60 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faa98ce3640 1 -- 10.20.193.28:0/3617834309 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faab000bd70 con 0x562897aeff60 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faa98ce3640 1 -- 10.20.193.28:0/3617834309 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab001d6b0 con 0x562897aeff60 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- 10.20.193.28:0/3617834309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 msgr2=0x562897b15340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3617834309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897b15340 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7faab000b4b0 tx=0x7faab0009540 comp rx=0 tx=0).stop 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- 10.20.193.28:0/3617834309 shutdown_connections 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3617834309 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897af4fb0 0x562897b059e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3617834309 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aeff60 0x562897b15340 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3617834309 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897aef5e0 0x562897b14e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- 10.20.193.28:0/3617834309 >> 10.20.193.28:0/3617834309 conn(0x562897ab2240 msgr2=0x562897b086f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- 10.20.193.28:0/3617834309 shutdown_connections 2026-02-20T03:33:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- 10.20.193.28:0/3617834309 wait complete. 2026-02-20T03:33:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- start start 2026-02-20T03:33:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 Processor -- start 2026-02-20T03:33:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b15150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897aeff60 0x562897b11470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897af4fb0 0x562897b119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c00e430 con 0x562897aef5e0 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c00f8a0 con 0x562897aeff60 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c00eb00 con 0x562897af4fb0 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faaccb52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b15150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faaccb52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b15150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:39814/0 (socket says 10.20.193.28:39814) 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faaccb52640 1 -- 10.20.193.28:0/3078148157 learned_addr learned my addr 10.20.193.28:0/3078148157 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faaccb52640 1 -- 10.20.193.28:0/3078148157 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897af4fb0 msgr2=0x562897b119b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faaccb52640 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897af4fb0 0x562897b119b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faaccb52640 1 -- 10.20.193.28:0/3078148157 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897aeff60 msgr2=0x562897b11470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faaccb52640 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897aeff60 0x562897b11470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faaccb52640 1 -- 10.20.193.28:0/3078148157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562897721870 con 0x562897aef5e0 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faaccb52640 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b15150 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7faab80ac780 tx=0x7faab8002b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afd1dcfb36d1fff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:05.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faa867fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faa867fc640 1 -- 10.20.193.28:0/3078148157 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80e00d0 con 0x562897aef5e0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faa867fc640 1 -- 10.20.193.28:0/3078148157 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x562897a50150 con 0x562897aef5e0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faa867fc640 1 -- 10.20.193.28:0/3078148157 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80b0c10 con 0x562897aef5e0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.763+0000 7faad12e2e00 1 -- 10.20.193.28:0/3078148157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628979e23f0 con 0x562897aef5e0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faa867fc640 1 -- 10.20.193.28:0/3078148157 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7faab80940d0 con 0x562897aef5e0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faa867fc640 10 client.20553 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 10 client.20553 _ll_register_callbacks cb 0x7faab800f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 1 -- 10.20.193.28:0/3078148157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5628979f4ab0 con 0x562897aef5e0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faa867fc640 1 -- 10.20.193.28:0/3078148157 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7faab80b0db0 con 0x562897aef5e0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 10 client.20553 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 1 -- 10.20.193.28:0/3078148157 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x562897b02690 con 0x562897aef5e0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faa867fc640 1 -- 10.20.193.28:0/3078148157 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7faab80942d0 con 0x562897aef5e0 2026-02-20T03:33:05.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 10 client.20553 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 10 client.20553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 20 client.20553 populate_metadata read hostname 'trial028' 2026-02-20T03:33:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562897b84240 0x562897b866d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 4 client.20553 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:33:05.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.768+0000 7faad12e2e00 1 -- 10.20.193.28:0/3078148157 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7faab0004480 con 0x562897b84240 2026-02-20T03:33:05.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.784+0000 7faabffff640 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562897b84240 0x562897b866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:05 trial126 ceph-mon[38476]: pgmap v738: 129 pgs: 129 active+clean; 681 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 11 MiB/s wr, 1.20k op/s 2026-02-20T03:33:05.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.850+0000 7faabffff640 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562897b84240 0x562897b866d0 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b20c3bfa3a3d49bc server_cookie=23e8856d5d7e00a3 in_seq=0 out_seq=0 2026-02-20T03:33:05.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.850+0000 7faa867fc640 10 client.20553 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:05.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faa867fc640 1 -- 10.20.193.28:0/3078148157 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7faab0004480 con 0x562897b84240 2026-02-20T03:33:05.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faa867fc640 10 client.20553 handle_command_reply: tid=0 2026-02-20T03:33:05.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 client.20553 shutdown 2026-02-20T03:33:05.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 -- 10.20.193.28:0/3078148157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 msgr2=0x562897b15150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:05.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b15150 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7faab80ac780 tx=0x7faab8002b20 comp rx=0 tx=0).stop 2026-02-20T03:33:05.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 -- 10.20.193.28:0/3078148157 shutdown_connections 2026-02-20T03:33:05.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562897b84240 0x562897b866d0 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562897af4fb0 0x562897b119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562897aeff60 0x562897b11470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 --2- 10.20.193.28:0/3078148157 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562897aef5e0 0x562897b15150 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 -- 10.20.193.28:0/3078148157 >> 10.20.193.28:0/3078148157 conn(0x562897ab2240 msgr2=0x562897b06d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:05.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faa867fc640 0 client.20553 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:05.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 -- 10.20.193.28:0/3078148157 shutdown_connections 2026-02-20T03:33:05.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 1 -- 10.20.193.28:0/3078148157 wait complete. 2026-02-20T03:33:05.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faad12e2e00 20 client.20553 trim_cache size 0 max 16384 2026-02-20T03:33:05.869 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:33:05.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faacdb54640 1 -- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa9c0b0e20 msgr2=0x7faa9c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:05.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faacdb54640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa9c0b0e20 0x7faa9c0b32e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faac402f960 tx=0x7faac4031040 comp rx=0 tx=0).stop 2026-02-20T03:33:05.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faacdb54640 1 -- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac8100d50 msgr2=0x7faac81a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:05.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.863+0000 7faacdb54640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac8100d50 0x7faac81a15b0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7faab800b570 tx=0x7faab800ba40 comp rx=0 tx=0).stop 2026-02-20T03:33:05.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.865+0000 7faacdb54640 1 -- 10.20.193.28:0/629918848 shutdown_connections 2026-02-20T03:33:05.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.865+0000 7faacdb54640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa9c0b0e20 0x7faa9c0b32e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.865+0000 7faacdb54640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faac81069e0 0x7faac81a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.865+0000 7faacdb54640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faac8101700 0x7faac81a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.865+0000 7faacdb54640 1 --2- 10.20.193.28:0/629918848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faac8100d50 0x7faac81a15b0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:05.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.865+0000 7faacdb54640 1 -- 10.20.193.28:0/629918848 >> 10.20.193.28:0/629918848 conn(0x7faac80fca60 msgr2=0x7faac8110df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:05.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.865+0000 7faacdb54640 1 -- 10.20.193.28:0/629918848 shutdown_connections 2026-02-20T03:33:05.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:05.865+0000 7faacdb54640 1 -- 10.20.193.28:0/629918848 wait complete. 2026-02-20T03:33:06.668 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:06 trial028 ceph-mon[38552]: pgmap v739: 129 pgs: 129 active+clean; 698 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2026-02-20T03:33:06.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136928 26.10 MB/sec execute 157 sec latency 5608.707 ms 2026-02-20T03:33:06.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:06 trial126 ceph-mon[38476]: pgmap v739: 129 pgs: 129 active+clean; 698 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2026-02-20T03:33:06.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:06 trial177 ceph-mon[43181]: pgmap v739: 129 pgs: 129 active+clean; 698 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2026-02-20T03:33:07.010 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:33:07.011 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:33:07.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.279+0000 7fe1e3fff640 1 -- 10.20.193.28:0/1104058106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073ed0 msgr2=0x7fe1e410e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.279+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/1104058106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073ed0 0x7fe1e410e730 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00b0a0 tx=0x7fe1dc02f450 comp rx=0 tx=0).stop 2026-02-20T03:33:07.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.279+0000 7fe1e3fff640 1 -- 10.20.193.28:0/1104058106 shutdown_connections 2026-02-20T03:33:07.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.279+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/1104058106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1e410ec70 0x7fe1e4111130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.279+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/1104058106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073ed0 0x7fe1e410e730 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.279+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/1104058106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1e4073590 0x7fe1e4073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.279+0000 7fe1e3fff640 1 -- 10.20.193.28:0/1104058106 >> 10.20.193.28:0/1104058106 conn(0x7fe1e406f610 msgr2=0x7fe1e4071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.279+0000 7fe1e3fff640 1 -- 10.20.193.28:0/1104058106 shutdown_connections 2026-02-20T03:33:07.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.279+0000 7fe1e3fff640 1 -- 10.20.193.28:0/1104058106 wait complete. 2026-02-20T03:33:07.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 Processor -- start 2026-02-20T03:33:07.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 -- start start 2026-02-20T03:33:07.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073590 0x7fe1e41a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1e4073ed0 0x7fe1e41aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1e410ec70 0x7fe1e41b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e411d410 con 0x7fe1e4073590 2026-02-20T03:33:07.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e411d290 con 0x7fe1e410ec70 2026-02-20T03:33:07.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e411d590 con 0x7fe1e4073ed0 2026-02-20T03:33:07.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073590 0x7fe1e41a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073590 0x7fe1e41a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53924/0 (socket says 10.20.193.28:53924) 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/2947499086 learned_addr learned my addr 10.20.193.28:0/2947499086 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/2947499086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1e4073ed0 msgr2=0x7fe1e41aa040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1e4073ed0 0x7fe1e41aa040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/2947499086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1e410ec70 msgr2=0x7fe1e41b10b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1e410ec70 0x7fe1e41b10b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/2947499086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e41b17b0 con 0x7fe1e4073590 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073590 0x7fe1e41a9b00 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400b570 tx=0x7fe1d400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1c3fff640 1 -- 10.20.193.28:0/2947499086 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4013020 con 0x7fe1e4073590 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1c3fff640 1 -- 10.20.193.28:0/2947499086 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1d4004480 con 0x7fe1e4073590 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1c3fff640 1 -- 10.20.193.28:0/2947499086 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d400fb70 con 0x7fe1e4073590 2026-02-20T03:33:07.297 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 -- 10.20.193.28:0/2947499086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e41b1aa0 con 0x7fe1e4073590 2026-02-20T03:33:07.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.281+0000 7fe1e3fff640 1 -- 10.20.193.28:0/2947499086 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e41b1fa0 con 0x7fe1e4073590 2026-02-20T03:33:07.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.287+0000 7fe1ec43ce00 1 Processor -- start 2026-02-20T03:33:07.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.287+0000 7fe1ec43ce00 1 -- start start 2026-02-20T03:33:07.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.287+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351bde80 0x55b5351be280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.287+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 0x55b5351c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.287+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351c3560 0x55b5351c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.287+0000 7fe1ec43ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b53510e8f0 con 0x55b5351be7c0 2026-02-20T03:33:07.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.287+0000 7fe1ec43ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b5350bc2e0 con 0x55b5351c3560 2026-02-20T03:33:07.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.287+0000 7fe1ec43ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b53510a820 con 0x55b5351bde80 2026-02-20T03:33:07.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.293+0000 7fe1e37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351bde80 0x55b5351be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.293+0000 7fe1c3fff640 1 -- 10.20.193.28:0/2947499086 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe1d40027a0 con 0x7fe1e4073590 2026-02-20T03:33:07.304 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.293+0000 7fe1e37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351bde80 0x55b5351be280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40766/0 (socket says 10.20.193.28:40766) 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.293+0000 7fe1e37fe640 1 -- 10.20.193.28:0/4078381450 learned_addr learned my addr 10.20.193.28:0/4078381450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.294+0000 7fe1e27fc640 1 --2- 10.20.193.28:0/4078381450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351c3560 0x55b5351c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.295+0000 7fe1c3fff640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1b80b0e20 0x7fe1b80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.295+0000 7fe1c3fff640 1 -- 10.20.193.28:0/2947499086 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe1d401e070 con 0x7fe1e4073590 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.295+0000 7fe1e37fe640 1 -- 10.20.193.28:0/4078381450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351c3560 msgr2=0x55b5351c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.295+0000 7fe1e37fe640 1 --2- 10.20.193.28:0/4078381450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351c3560 0x55b5351c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.295+0000 7fe1e37fe640 1 -- 10.20.193.28:0/4078381450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 msgr2=0x55b5351c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.295+0000 7fe1e37fe640 1 --2- 10.20.193.28:0/4078381450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 0x55b5351c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.295+0000 7fe1e37fe640 1 -- 10.20.193.28:0/4078381450 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5350ae5a0 con 0x55b5351bde80 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.297+0000 7fe1e37fe640 1 --2- 10.20.193.28:0/4078381450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351bde80 0x55b5351be280 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0097f0 tx=0x7fe1cc009cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5301422d233b83bf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.298+0000 7fe1af7fe640 1 -- 10.20.193.28:0/4078381450 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc004500 con 0x55b5351bde80 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.298+0000 7fe1af7fe640 1 -- 10.20.193.28:0/4078381450 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1cc00bb60 con 0x55b5351bde80 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.298+0000 7fe1af7fe640 1 -- 10.20.193.28:0/4078381450 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc004500 con 0x55b5351bde80 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.299+0000 7fe1e37fe640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1b80b0e20 0x7fe1b80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.299+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4078381450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351bde80 msgr2=0x55b5351be280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.299+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/4078381450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351bde80 0x55b5351be280 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0097f0 tx=0x7fe1cc009cc0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.299+0000 7fe1e37fe640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1b80b0e20 0x7fe1b80b32e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc026000 tx=0x7fe1cc01dcb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.302+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4078381450 shutdown_connections 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.302+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/4078381450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351c3560 0x55b5351c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.302+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/4078381450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 0x55b5351c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.302+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/4078381450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351bde80 0x55b5351be280 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.302+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4078381450 >> 10.20.193.28:0/4078381450 conn(0x55b5351b56f0 msgr2=0x55b5351bc570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.302+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4078381450 shutdown_connections 2026-02-20T03:33:07.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.302+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4078381450 wait complete. 2026-02-20T03:33:07.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.303+0000 7fe1ec43ce00 1 -- start start 2026-02-20T03:33:07.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.305+0000 7fe1ec43ce00 1 Processor -- start 2026-02-20T03:33:07.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351bde80 0x55b5351d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 0x55b5351d6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351c3560 0x55b5351dded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1ec43ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b5350b60c0 con 0x55b5351c3560 2026-02-20T03:33:07.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1ec43ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b5351c6610 con 0x55b5351bde80 2026-02-20T03:33:07.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1ec43ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b5351de460 con 0x55b5351be7c0 2026-02-20T03:33:07.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351c3560 0x55b5351dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1e37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351c3560 0x55b5351dded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53942/0 (socket says 10.20.193.28:53942) 2026-02-20T03:33:07.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1e37fe640 1 -- 10.20.193.28:0/1157655837 learned_addr learned my addr 10.20.193.28:0/1157655837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.306+0000 7fe1e27fc640 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 0x55b5351d6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.307+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351bde80 0x55b5351d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.307+0000 7fe1e27fc640 1 -- 10.20.193.28:0/1157655837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351bde80 msgr2=0x55b5351d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:33:07.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.307+0000 7fe1e27fc640 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351bde80 0x55b5351d6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.307+0000 7fe1e27fc640 1 -- 10.20.193.28:0/1157655837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351c3560 msgr2=0x55b5351dded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:33:07.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.307+0000 7fe1e27fc640 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351c3560 0x55b5351dded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.307+0000 7fe1e27fc640 1 -- 10.20.193.28:0/1157655837 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5351d0130 con 0x55b5351be7c0 2026-02-20T03:33:07.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.307+0000 7fe1e37fe640 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351c3560 0x55b5351dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:33:07.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.310+0000 7fe1e27fc640 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 0x55b5351d6f50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc02f960 tx=0x7fe1dc009790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df4614cb6702ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.310+0000 7fe1acff9640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:33:07.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.310+0000 7fe1acff9640 1 -- 10.20.193.28:0/1157655837 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc004920 con 0x55b5351be7c0 2026-02-20T03:33:07.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.310+0000 7fe1acff9640 1 -- 10.20.193.28:0/1157655837 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1dc045070 con 0x55b5351be7c0 2026-02-20T03:33:07.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.310+0000 7fe1acff9640 1 -- 10.20.193.28:0/1157655837 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc038680 con 0x55b5351be7c0 2026-02-20T03:33:07.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.320+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1157655837 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5350ca820 con 0x55b5351be7c0 2026-02-20T03:33:07.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.320+0000 7fe1ec43ce00 10 client.28354 _ll_register_callbacks cb 0x55b5350b9ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:07.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.320+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1157655837 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5351164e0 con 0x55b5351be7c0 2026-02-20T03:33:07.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.334+0000 7fe1acff9640 1 -- 10.20.193.28:0/1157655837 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe1dc004240 con 0x55b5351be7c0 2026-02-20T03:33:07.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.334+0000 7fe1acff9640 1 -- 10.20.193.28:0/1157655837 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe1dc0078c0 con 0x55b5351be7c0 2026-02-20T03:33:07.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.335+0000 7fe1ec43ce00 10 client.28354 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:07.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.335+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1157655837 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55b5350cf380 con 0x55b5351be7c0 2026-02-20T03:33:07.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.336+0000 7fe1acff9640 1 -- 10.20.193.28:0/1157655837 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fe1dc038820 con 0x55b5351be7c0 2026-02-20T03:33:07.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.336+0000 7fe1ec43ce00 10 client.28354 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:07.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.336+0000 7fe1ec43ce00 10 client.28354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:07.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.336+0000 7fe1ec43ce00 20 client.28354 populate_metadata read hostname 'trial028' 2026-02-20T03:33:07.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.336+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b5351e2740 0x55b5351e4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.336+0000 7fe1ec43ce00 4 client.28354 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:07.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.336+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1157655837 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b535090bd0 con 0x55b5351e2740 2026-02-20T03:33:07.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.337+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b5351e2740 0x55b5351e4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.339+0000 7fe1acff9640 10 client.28354 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:07.341 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.339+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b5351e2740 0x55b5351e4be0 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c13c59b13d5ad6dd server_cookie=e682ed35a13eb08c in_seq=0 out_seq=0 2026-02-20T03:33:07.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.339+0000 7fe1acff9640 1 -- 10.20.193.28:0/1157655837 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b535090bd0 con 0x55b5351e2740 2026-02-20T03:33:07.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.339+0000 7fe1acff9640 10 client.28354 handle_command_reply: tid=0 2026-02-20T03:33:07.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.339+0000 7fe1ec43ce00 1 client.28354 shutdown 2026-02-20T03:33:07.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1157655837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 msgr2=0x55b5351d6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 0x55b5351d6f50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc02f960 tx=0x7fe1dc009790 comp rx=0 tx=0).stop 2026-02-20T03:33:07.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1157655837 shutdown_connections 2026-02-20T03:33:07.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b5351e2740 0x55b5351e4be0 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351c3560 0x55b5351dded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 0x55b5351d6f50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1acff9640 0 client.28354 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:07.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1157655837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351bde80 0x55b5351d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1157655837 >> 10.20.193.28:0/1157655837 conn(0x55b5351b56f0 msgr2=0x55b5351c4910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1157655837 shutdown_connections 2026-02-20T03:33:07.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1157655837 wait complete. 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.340+0000 7fe1ec43ce00 20 client.28354 trim_cache size 0 max 16384 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1ec43ce00 1 Processor -- start 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1ec43ce00 1 -- start start 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351bde80 0x55b5351bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 0x55b5351c0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351c3560 0x55b5351dde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1ec43ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1880127a0 con 0x55b5351bde80 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1ec43ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe188010070 con 0x55b5351c3560 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1ec43ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe18800de60 con 0x55b5351be7c0 2026-02-20T03:33:07.361 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351bde80 0x55b5351bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351bde80 0x55b5351bfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53958/0 (socket says 10.20.193.28:53958) 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/4191330913 learned_addr learned my addr 10.20.193.28:0/4191330913 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/4191330913 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 msgr2=0x55b5351c0430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/4191330913 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 0x55b5351c0430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/4191330913 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351c3560 msgr2=0x55b5351dde90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/4191330913 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351c3560 0x55b5351dde90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/4191330913 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5351cff60 con 0x55b5351bde80 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/4191330913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351bde80 0x55b5351bfef0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40a7c90 tx=0x7fe1d40e0350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81e9ee6842d3fe4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1aeffd640 1 -- 10.20.193.28:0/4191330913 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d401d040 con 0x55b5351bde80 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.346+0000 7fe1aeffd640 1 -- 10.20.193.28:0/4191330913 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1d40a3fd0 con 0x55b5351bde80 2026-02-20T03:33:07.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4191330913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351bde80 msgr2=0x55b5351bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/4191330913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351bde80 0x55b5351bfef0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40a7c90 tx=0x7fe1d40e0350 comp rx=0 tx=0).stop 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4191330913 shutdown_connections 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/4191330913 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351c3560 0x55b5351dde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/4191330913 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351be7c0 0x55b5351c0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/4191330913 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351bde80 0x55b5351bfef0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4191330913 >> 10.20.193.28:0/4191330913 conn(0x55b5351b56f0 msgr2=0x55b5351bc570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4191330913 shutdown_connections 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/4191330913 wait complete. 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 -- start start 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 Processor -- start 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 0x55b5351dbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 0x55b5351dbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 0x55b5351dbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53970/0 (socket says 10.20.193.28:53970) 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/1929568182 learned_addr learned my addr 10.20.193.28:0/1929568182 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.351+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351c3560 0x55b5351dc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351e2740 0x55b5351dd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe18800e530 con 0x55b5351be7c0 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe18800f9a0 con 0x55b5351e2740 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe18800ec00 con 0x55b5351c3560 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/1929568182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351c3560 msgr2=0x55b5351dc110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351c3560 0x55b5351dc110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/1929568182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351e2740 msgr2=0x55b5351dd0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351e2740 0x55b5351dd0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1e2ffd640 1 -- 10.20.193.28:0/1929568182 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5351c5950 con 0x55b5351be7c0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1e2ffd640 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 0x55b5351dbbd0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4090510 tx=0x7fe1d4004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2971d35b3a43a77 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1acff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1acff9640 1 -- 10.20.193.28:0/1929568182 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d401d040 con 0x55b5351be7c0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.354+0000 7fe1acff9640 1 -- 10.20.193.28:0/1929568182 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1d40a3fd0 con 0x55b5351be7c0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.355+0000 7fe1acff9640 1 -- 10.20.193.28:0/1929568182 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40a6d00 con 0x55b5351be7c0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.355+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b534e6e690 con 0x55b5351be7c0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.355+0000 7fe1acff9640 1 -- 10.20.193.28:0/1929568182 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe1d40b0730 con 0x55b5351be7c0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.355+0000 7fe1acff9640 10 client.20568 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.355+0000 7fe1ec43ce00 10 client.20568 _ll_register_callbacks cb 0x7fe1dc009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.355+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b534ee7520 con 0x55b5351be7c0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.355+0000 7fe1acff9640 1 -- 10.20.193.28:0/1929568182 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe1d40a36b0 con 0x55b5351be7c0 2026-02-20T03:33:07.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.355+0000 7fe1ec43ce00 10 client.20568 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:07.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.355+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55b5350d3b70 con 0x55b5351be7c0 2026-02-20T03:33:07.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.356+0000 7fe1acff9640 1 -- 10.20.193.28:0/1929568182 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fe1d40b0930 con 0x55b5351be7c0 2026-02-20T03:33:07.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.356+0000 7fe1ec43ce00 10 client.20568 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:07.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.356+0000 7fe1ec43ce00 10 client.20568 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:07.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.356+0000 7fe1ec43ce00 20 client.20568 populate_metadata read hostname 'trial028' 2026-02-20T03:33:07.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.356+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b53524e190 0x55b535250650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.356+0000 7fe1ec43ce00 4 client.20568 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:33:07.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.356+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5350df6b0 con 0x55b53524e190 2026-02-20T03:33:07.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.358+0000 7fe1e27fc640 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b53524e190 0x55b535250650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.359+0000 7fe1e27fc640 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b53524e190 0x55b535250650 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d7ef10a5c0b62a0 server_cookie=3fb8b364ef314edb in_seq=0 out_seq=0 2026-02-20T03:33:07.367 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:07.359+0000 7fe1acff9640 10 client.20568 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:07.391 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:07.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.632+0000 7f87c52c3640 1 -- 10.20.193.28:0/2477601695 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0077620 msgr2=0x7f87c0077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.632+0000 7f87c52c3640 1 --2- 10.20.193.28:0/2477601695 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0077620 0x7f87c0077a00 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009a30 tx=0x7f87ac02f260 comp rx=0 tx=0).stop 2026-02-20T03:33:07.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.632+0000 7f87c52c3640 1 -- 10.20.193.28:0/2477601695 shutdown_connections 2026-02-20T03:33:07.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 --2- 10.20.193.28:0/2477601695 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f87c0113820 0x7f87c0115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 --2- 10.20.193.28:0/2477601695 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f87c0077f40 0x7f87c01132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 --2- 10.20.193.28:0/2477601695 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0077620 0x7f87c0077a00 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 -- 10.20.193.28:0/2477601695 >> 10.20.193.28:0/2477601695 conn(0x7f87c0100680 msgr2=0x7f87c0102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 -- 10.20.193.28:0/2477601695 shutdown_connections 2026-02-20T03:33:07.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 -- 10.20.193.28:0/2477601695 wait complete. 2026-02-20T03:33:07.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 Processor -- start 2026-02-20T03:33:07.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 -- start start 2026-02-20T03:33:07.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f87c0077620 0x7f87c0074750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f87c0077f40 0x7f87c0074c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0113820 0x7f87c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f87c0119170 con 0x7f87c0113820 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f87c0118ff0 con 0x7f87c0077f40 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01192f0 con 0x7f87c0077620 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c4ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0113820 0x7f87c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c4ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0113820 0x7f87c006d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:53990/0 (socket says 10.20.193.28:53990) 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c4ac2640 1 -- 10.20.193.28:0/1476084946 learned_addr learned my addr 10.20.193.28:0/1476084946 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c4ac2640 1 -- 10.20.193.28:0/1476084946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f87c0077620 msgr2=0x7f87c0074750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:07.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c4ac2640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f87c0077620 0x7f87c0074750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c4ac2640 1 -- 10.20.193.28:0/1476084946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f87c0077f40 msgr2=0x7f87c0074c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:07.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c4ac2640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f87c0077f40 0x7f87c0074c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c4ac2640 1 -- 10.20.193.28:0/1476084946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c006e250 con 0x7f87c0113820 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c4ac2640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0113820 0x7f87c006d990 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f87b400b990 tx=0x7f87b400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87bd7fa640 1 -- 10.20.193.28:0/1476084946 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4006e60 con 0x7f87c0113820 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87bd7fa640 1 -- 10.20.193.28:0/1476084946 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f87b4010070 con 0x7f87c0113820 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87bd7fa640 1 -- 10.20.193.28:0/1476084946 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4004800 con 0x7f87c0113820 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 -- 10.20.193.28:0/1476084946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c006e540 con 0x7f87c0113820 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.635+0000 7f87c52c3640 1 -- 10.20.193.28:0/1476084946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c0072510 con 0x7f87c0113820 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.646+0000 7f87bd7fa640 1 -- 10.20.193.28:0/1476084946 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f87b401d070 con 0x7f87c0113820 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.646+0000 7f87c8a51e00 1 Processor -- start 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.646+0000 7f87c8a51e00 1 -- start start 2026-02-20T03:33:07.651 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.646+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab309c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.646+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 0x55f9ab3040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.646+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab304b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.646+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9ab256c00 con 0x55f9ab3098b0 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.646+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f9ab2043c0 con 0x55f9ab3046e0 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.646+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f9ab252b30 con 0x55f9ab30a260 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 0x55f9ab3040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 0x55f9ab3040c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40804/0 (socket says 10.20.193.28:40804) 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bf7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab304b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bf7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab304b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60028/0 (socket says 10.20.193.28:60028) 2026-02-20T03:33:07.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bf7fe640 1 -- 10.20.193.28:0/3721279697 learned_addr learned my addr 10.20.193.28:0/3721279697 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bf7fe640 1 -- 10.20.193.28:0/3721279697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 msgr2=0x55f9ab3040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:33:07.654 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/3721279697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 0x55f9ab3040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bf7fe640 1 -- 10.20.193.28:0/3721279697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 msgr2=0x55f9ab309c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/3721279697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab309c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bf7fe640 1 -- 10.20.193.28:0/3721279697 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ab1fd840 con 0x55f9ab3046e0 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.647+0000 7f87bd7fa640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f87940b0ef0 0x7f87940b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.648+0000 7f87bd7fa640 1 -- 10.20.193.28:0/1476084946 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f87b40e0450 con 0x7f87c0113820 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.648+0000 7f87bffff640 1 --2- 10.20.193.28:0/3721279697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 0x55f9ab3040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.649+0000 7f87bffff640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f87940b0ef0 0x7f87940b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.649+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/3721279697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab304b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f87b000bcf0 tx=0x7f87b000d810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8962cbf3452befb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.649+0000 7f8798ce3640 1 -- 10.20.193.28:0/3721279697 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b00044f0 con 0x55f9ab3046e0 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.649+0000 7f8798ce3640 1 -- 10.20.193.28:0/3721279697 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f87b0011030 con 0x55f9ab3046e0 2026-02-20T03:33:07.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.649+0000 7f8798ce3640 1 -- 10.20.193.28:0/3721279697 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0002e30 con 0x55f9ab3046e0 2026-02-20T03:33:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.650+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3721279697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 msgr2=0x55f9ab304b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.650+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3721279697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab304b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f87b000bcf0 tx=0x7f87b000d810 comp rx=0 tx=0).stop 2026-02-20T03:33:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.650+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3721279697 shutdown_connections 2026-02-20T03:33:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.650+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3721279697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab304b60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.650+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3721279697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 0x55f9ab3040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.650+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3721279697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab309c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.650+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3721279697 >> 10.20.193.28:0/3721279697 conn(0x55f9ab2fcbf0 msgr2=0x55f9ab3025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.650+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3721279697 shutdown_connections 2026-02-20T03:33:07.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.650+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3721279697 wait complete. 2026-02-20T03:33:07.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.652+0000 7f87c8a51e00 1 -- start start 2026-02-20T03:33:07.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.652+0000 7f87c8a51e00 1 Processor -- start 2026-02-20T03:33:07.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.652+0000 7f87bffff640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f87940b0ef0 0x7f87940b33b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55f9ab30a640 tx=0x7f87ac002f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.653+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab31e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.653+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab31e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.653+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 0x55f9ab31cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.653+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f9ab1fe1a0 con 0x55f9ab3098b0 2026-02-20T03:33:07.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f9ab310d30 con 0x55f9ab3046e0 2026-02-20T03:33:07.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f9ab31d330 con 0x55f9ab30a260 2026-02-20T03:33:07.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.653+0000 7f87bffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab31e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87bffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab31e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:60034/0 (socket says 10.20.193.28:60034) 2026-02-20T03:33:07.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87bffff640 1 -- 10.20.193.28:0/3957408432 learned_addr learned my addr 10.20.193.28:0/3957408432 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab31e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87bf7fe640 1 -- 10.20.193.28:0/3957408432 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 msgr2=0x55f9ab31cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 0x55f9ab31cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87bf7fe640 1 -- 10.20.193.28:0/3957408432 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 msgr2=0x55f9ab31e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab31e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87bf7fe640 1 -- 10.20.193.28:0/3957408432 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ab316620 con 0x55f9ab3098b0 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab31e9b0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f87b000b440 tx=0x7f87b000b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267ee5a090302cae server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f8781ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f8781ffb640 1 -- 10.20.193.28:0/3957408432 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0002db0 con 0x55f9ab3098b0 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3957408432 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9ab025b60 con 0x55f9ab3098b0 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87c8a51e00 10 client.20577 _ll_register_callbacks cb 0x55f9ab2020d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:07.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3957408432 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f9ab25e7f0 con 0x55f9ab3098b0 2026-02-20T03:33:07.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f8781ffb640 1 -- 10.20.193.28:0/3957408432 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55f9ab25e7f0 con 0x55f9ab3098b0 2026-02-20T03:33:07.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f8781ffb640 1 -- 10.20.193.28:0/3957408432 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b00062d0 con 0x55f9ab3098b0 2026-02-20T03:33:07.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f8781ffb640 1 -- 10.20.193.28:0/3957408432 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f87b0006490 con 0x55f9ab3098b0 2026-02-20T03:33:07.662 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f8781ffb640 1 -- 10.20.193.28:0/3957408432 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f87b001f440 con 0x55f9ab3098b0 2026-02-20T03:33:07.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87c8a51e00 10 client.20577 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:07.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.654+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3957408432 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f9ab223430 con 0x55f9ab3098b0 2026-02-20T03:33:07.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.665+0000 7f8781ffb640 1 -- 10.20.193.28:0/3957408432 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f87b0027030 con 0x55f9ab3098b0 2026-02-20T03:33:07.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.665+0000 7f87c8a51e00 10 client.20577 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:07.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.665+0000 7f87c8a51e00 10 client.20577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:07.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.665+0000 7f87c8a51e00 20 client.20577 populate_metadata read hostname 'trial028' 2026-02-20T03:33:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.665+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f9ab32cb60 0x55f9ab32ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.665+0000 7f87c8a51e00 4 client.20577 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:07.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.665+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3957408432 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9ab1d8c00 con 0x55f9ab32cb60 2026-02-20T03:33:07.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.668+0000 7f87bffff640 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f9ab32cb60 0x55f9ab32ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.668+0000 7f87bffff640 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f9ab32cb60 0x55f9ab32ef50 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c8bc66546eeaf5e server_cookie=f481e322a4ca1c69 in_seq=0 out_seq=0 2026-02-20T03:33:07.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.668+0000 7f8781ffb640 10 client.20577 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:07.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.669+0000 7f8781ffb640 1 -- 10.20.193.28:0/3957408432 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f9ab1d8c00 con 0x55f9ab32cb60 2026-02-20T03:33:07.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.669+0000 7f8781ffb640 10 client.20577 handle_command_reply: tid=0 2026-02-20T03:33:07.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.669+0000 7f87c8a51e00 1 client.20577 shutdown 2026-02-20T03:33:07.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.669+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3957408432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 msgr2=0x55f9ab31e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.669+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab31e9b0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f87b000b440 tx=0x7f87b000b9c0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.669+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3957408432 shutdown_connections 2026-02-20T03:33:07.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.670+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f9ab32cb60 0x55f9ab32ef50 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.670+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab30a260 0x55f9ab31cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.670+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab31e9b0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.670+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/3957408432 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab31e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.670+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3957408432 >> 10.20.193.28:0/3957408432 conn(0x55f9ab2fcbf0 msgr2=0x55f9ab302cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.670+0000 7f8781ffb640 0 client.20577 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:07.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.670+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3957408432 shutdown_connections 2026-02-20T03:33:07.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.670+0000 7f87c8a51e00 1 -- 10.20.193.28:0/3957408432 wait complete. 2026-02-20T03:33:07.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.670+0000 7f87c8a51e00 20 client.20577 trim_cache size 0 max 16384 2026-02-20T03:33:07.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87c8a51e00 1 Processor -- start 2026-02-20T03:33:07.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87c8a51e00 1 -- start start 2026-02-20T03:33:07.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab3046e0 0x55f9ab302dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab303310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab30a260 0x55f9ab3347e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8764012760 con 0x55f9ab3098b0 2026-02-20T03:33:07.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8764010030 con 0x55f9ab30a260 2026-02-20T03:33:07.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f876400de80 con 0x55f9ab3046e0 2026-02-20T03:33:07.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab303310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab303310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54022/0 (socket says 10.20.193.28:54022) 2026-02-20T03:33:07.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87bf7fe640 1 -- 10.20.193.28:0/64344247 learned_addr learned my addr 10.20.193.28:0/64344247 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87bf7fe640 1 -- 10.20.193.28:0/64344247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab3046e0 msgr2=0x55f9ab302dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:07.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/64344247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab3046e0 0x55f9ab302dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87bf7fe640 1 -- 10.20.193.28:0/64344247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab30a260 msgr2=0x55f9ab3347e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:07.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/64344247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab30a260 0x55f9ab3347e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87bf7fe640 1 -- 10.20.193.28:0/64344247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ab316450 con 0x55f9ab3098b0 2026-02-20T03:33:07.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f87bf7fe640 1 --2- 10.20.193.28:0/64344247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab303310 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f87b00046a0 tx=0x7f87b00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e5bf1eef39eb5a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f8783fff640 1 -- 10.20.193.28:0/64344247 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0002d20 con 0x55f9ab3098b0 2026-02-20T03:33:07.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f8783fff640 1 -- 10.20.193.28:0/64344247 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f87b0004830 con 0x55f9ab3098b0 2026-02-20T03:33:07.690 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.678+0000 7f8783fff640 1 -- 10.20.193.28:0/64344247 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b001f820 con 0x55f9ab3098b0 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 -- 10.20.193.28:0/64344247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 msgr2=0x55f9ab303310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/64344247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab303310 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f87b00046a0 tx=0x7f87b00046d0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 -- 10.20.193.28:0/64344247 shutdown_connections 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/64344247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab30a260 0x55f9ab3347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/64344247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab3098b0 0x55f9ab303310 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/64344247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab3046e0 0x55f9ab302dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 -- 10.20.193.28:0/64344247 >> 10.20.193.28:0/64344247 conn(0x55f9ab2fcbf0 msgr2=0x55f9ab31b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 -- 10.20.193.28:0/64344247 shutdown_connections 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 -- 10.20.193.28:0/64344247 wait complete. 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 -- start start 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 Processor -- start 2026-02-20T03:33:07.691 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab3215f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab3098b0 0x55f9ab321b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab30a260 0x55f9ab3979c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f876400e4f0 con 0x55f9ab30a260 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f876400f960 con 0x55f9ab3046e0 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c8a51e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f876400ebc0 con 0x55f9ab3098b0 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c4ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab30a260 0x55f9ab3979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c4ac2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab30a260 0x55f9ab3979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54024/0 (socket says 10.20.193.28:54024) 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.683+0000 7f87c4ac2640 1 -- 10.20.193.28:0/1981378203 learned_addr learned my addr 10.20.193.28:0/1981378203 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.685+0000 7f87c4ac2640 1 -- 10.20.193.28:0/1981378203 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab3098b0 msgr2=0x55f9ab321b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.685+0000 7f87c4ac2640 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab3098b0 0x55f9ab321b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.685+0000 7f87c4ac2640 1 -- 10.20.193.28:0/1981378203 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 msgr2=0x55f9ab3215f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:07.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.685+0000 7f87c4ac2640 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab3215f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.685+0000 7f87c4ac2640 1 -- 10.20.193.28:0/1981378203 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9aaf35900 con 0x55f9ab30a260 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.686+0000 7f87c4ac2640 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab30a260 0x55f9ab3979c0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f87b40a80c0 tx=0x7f87b40a7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258f85454caf7ec5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.686+0000 7f8781ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.686+0000 7f8781ffb640 1 -- 10.20.193.28:0/1981378203 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b400cdc0 con 0x55f9ab30a260 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.686+0000 7f87c8a51e00 1 -- 10.20.193.28:0/1981378203 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9ab2114d0 con 0x55f9ab30a260 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.686+0000 7f87c8a51e00 10 client.20583 _ll_register_callbacks cb 0x7f87b000beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.686+0000 7f8781ffb640 1 -- 10.20.193.28:0/1981378203 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f87b40a8830 con 0x55f9ab30a260 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.686+0000 7f8781ffb640 1 -- 10.20.193.28:0/1981378203 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40b08d0 con 0x55f9ab30a260 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.687+0000 7f8781ffb640 1 -- 10.20.193.28:0/1981378203 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f87b40b0a70 con 0x55f9ab30a260 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.687+0000 7f87c8a51e00 1 -- 10.20.193.28:0/1981378203 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f9aafc6a20 con 0x55f9ab30a260 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.687+0000 7f8781ffb640 1 -- 10.20.193.28:0/1981378203 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f87b40ac4e0 con 0x55f9ab30a260 2026-02-20T03:33:07.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.687+0000 7f87c8a51e00 10 client.20583 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:07.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.687+0000 7f87c8a51e00 1 -- 10.20.193.28:0/1981378203 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f9ab317140 con 0x55f9ab30a260 2026-02-20T03:33:07.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.688+0000 7f8781ffb640 1 -- 10.20.193.28:0/1981378203 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f87b40941c0 con 0x55f9ab30a260 2026-02-20T03:33:07.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.688+0000 7f87c8a51e00 10 client.20583 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:07.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.688+0000 7f87c8a51e00 10 client.20583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:07.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.688+0000 7f87c8a51e00 20 client.20583 populate_metadata read hostname 'trial028' 2026-02-20T03:33:07.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.688+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f9ab3992c0 0x55f9ab39b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:07.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.688+0000 7f87c8a51e00 4 client.20583 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:33:07.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.688+0000 7f87c8a51e00 1 -- 10.20.193.28:0/1981378203 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f9ab2645a0 con 0x55f9ab3992c0 2026-02-20T03:33:07.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.688+0000 7f87bffff640 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f9ab3992c0 0x55f9ab39b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:07.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.703+0000 7f8781ffb640 10 client.20583 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:07.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.703+0000 7f87bffff640 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f9ab3992c0 0x55f9ab39b780 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b2d951aaeae156 server_cookie=a110b3221a80e03b in_seq=0 out_seq=0 2026-02-20T03:33:07.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.704+0000 7f8781ffb640 1 -- 10.20.193.28:0/1981378203 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f9ab2645a0 con 0x55f9ab3992c0 2026-02-20T03:33:07.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.704+0000 7f8781ffb640 10 client.20583 handle_command_reply: tid=0 2026-02-20T03:33:07.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.704+0000 7f87c8a51e00 1 client.20583 shutdown 2026-02-20T03:33:07.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 -- 10.20.193.28:0/1981378203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab30a260 msgr2=0x55f9ab3979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab30a260 0x55f9ab3979c0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f87b40a80c0 tx=0x7f87b40a7f90 comp rx=0 tx=0).stop 2026-02-20T03:33:07.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 -- 10.20.193.28:0/1981378203 shutdown_connections 2026-02-20T03:33:07.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f9ab3992c0 0x55f9ab39b780 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f9ab30a260 0x55f9ab3979c0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f9ab3098b0 0x55f9ab321b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 --2- 10.20.193.28:0/1981378203 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f9ab3046e0 0x55f9ab3215f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 -- 10.20.193.28:0/1981378203 >> 10.20.193.28:0/1981378203 conn(0x55f9ab2fcbf0 msgr2=0x55f9ab32cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f8781ffb640 0 client.20583 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:07.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 -- 10.20.193.28:0/1981378203 shutdown_connections 2026-02-20T03:33:07.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 1 -- 10.20.193.28:0/1981378203 wait complete. 2026-02-20T03:33:07.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.705+0000 7f87c8a51e00 20 client.20583 trim_cache size 0 max 16384 2026-02-20T03:33:07.709 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:33:07.710 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:33:07.710 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "a9f7a206-9da9-46ba-aaa5-b73614b91878", 2026-02-20T03:33:07.710 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:33:07.710 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:33:07.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 -- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f87940b0ef0 msgr2=0x7f87940b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f87940b0ef0 0x7f87940b33b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x55f9ab30a640 tx=0x7f87ac002f10 comp rx=0 tx=0).stop 2026-02-20T03:33:07.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 -- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0113820 msgr2=0x7f87c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:07.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0113820 0x7f87c006d990 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f87b400b990 tx=0x7f87b400be60 comp rx=0 tx=0).stop 2026-02-20T03:33:07.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 -- 10.20.193.28:0/1476084946 shutdown_connections 2026-02-20T03:33:07.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f87940b0ef0 0x7f87940b33b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f87c0113820 0x7f87c006d990 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f87c0077f40 0x7f87c0074c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 --2- 10.20.193.28:0/1476084946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f87c0077620 0x7f87c0074750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:07.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.706+0000 7f87c52c3640 1 -- 10.20.193.28:0/1476084946 >> 10.20.193.28:0/1476084946 conn(0x7f87c0100680 msgr2=0x7f87c0114f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:07.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.707+0000 7f87c52c3640 1 -- 10.20.193.28:0/1476084946 shutdown_connections 2026-02-20T03:33:07.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:07.707+0000 7f87c52c3640 1 -- 10.20.193.28:0/1476084946 wait complete. 2026-02-20T03:33:07.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136928 25.94 MB/sec execute 158 sec latency 6609.060 ms 2026-02-20T03:33:07.939 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:33:08.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.004+0000 7fe1acff9640 1 -- 10.20.193.28:0/1929568182 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5350df6b0 con 0x55b53524e190 2026-02-20T03:33:08.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.004+0000 7fe1acff9640 10 client.20568 handle_command_reply: tid=0 2026-02-20T03:33:08.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.004+0000 7fe1ec43ce00 1 client.20568 shutdown 2026-02-20T03:33:08.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.006+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 msgr2=0x55b5351dbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.006+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 0x55b5351dbbd0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4090510 tx=0x7fe1d4004870 comp rx=0 tx=0).stop 2026-02-20T03:33:08.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.006+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 shutdown_connections 2026-02-20T03:33:08.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.006+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b53524e190 0x55b535250650 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.006+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b5351e2740 0x55b5351dd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.006+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b5351c3560 0x55b5351dc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.006+0000 7fe1ec43ce00 1 --2- 10.20.193.28:0/1929568182 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b5351be7c0 0x55b5351dbbd0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.006+0000 7fe1acff9640 0 client.20568 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:08.010 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.006+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 >> 10.20.193.28:0/1929568182 conn(0x55b5351b56f0 msgr2=0x55b5351becc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:08.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.008+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 shutdown_connections 2026-02-20T03:33:08.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.008+0000 7fe1ec43ce00 1 -- 10.20.193.28:0/1929568182 wait complete. 2026-02-20T03:33:08.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.008+0000 7fe1ec43ce00 20 client.20568 trim_cache size 0 max 16384 2026-02-20T03:33:08.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:33:08.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:33:08.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:33:08.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:33:08.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.009+0000 7fe1e3fff640 1 -- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1b80b0e20 msgr2=0x7fe1b80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.009+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1b80b0e20 0x7fe1b80b32e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc026000 tx=0x7fe1cc01dcb0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.009+0000 7fe1e3fff640 1 -- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073590 msgr2=0x7fe1e41a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.009+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073590 0x7fe1e41a9b00 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400b570 tx=0x7fe1d400ba40 comp rx=0 tx=0).stop 2026-02-20T03:33:08.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.010+0000 7fe1e3fff640 1 -- 10.20.193.28:0/2947499086 shutdown_connections 2026-02-20T03:33:08.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.010+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1b80b0e20 0x7fe1b80b32e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.010+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1e410ec70 0x7fe1e41b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.010+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1e4073ed0 0x7fe1e41aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.010+0000 7fe1e3fff640 1 --2- 10.20.193.28:0/2947499086 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1e4073590 0x7fe1e41a9b00 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.010+0000 7fe1e3fff640 1 -- 10.20.193.28:0/2947499086 >> 10.20.193.28:0/2947499086 conn(0x7fe1e406f610 msgr2=0x7fe1e4070120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:08.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.010+0000 7fe1e3fff640 1 -- 10.20.193.28:0/2947499086 shutdown_connections 2026-02-20T03:33:08.014 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:08.010+0000 7fe1e3fff640 1 -- 10.20.193.28:0/2947499086 wait complete. 2026-02-20T03:33:08.218 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:08.348 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:08 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:33:08.348 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:08 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:08.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.461+0000 7fc23fde2640 1 -- 10.20.193.28:0/1244677040 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 msgr2=0x7fc238108cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.461+0000 7fc23fde2640 1 --2- 10.20.193.28:0/1244677040 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 0x7fc238108cb0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009a60 tx=0x7fc22c02f290 comp rx=0 tx=0).stop 2026-02-20T03:33:08.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.461+0000 7fc23fde2640 1 -- 10.20.193.28:0/1244677040 shutdown_connections 2026-02-20T03:33:08.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.461+0000 7fc23fde2640 1 --2- 10.20.193.28:0/1244677040 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc238103270 0x7fc23810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.461+0000 7fc23fde2640 1 --2- 10.20.193.28:0/1244677040 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2381028d0 0x7fc238102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.461+0000 7fc23fde2640 1 --2- 10.20.193.28:0/1244677040 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 0x7fc238108cb0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.461+0000 7fc23fde2640 1 -- 10.20.193.28:0/1244677040 >> 10.20.193.28:0/1244677040 conn(0x7fc2380fe5d0 msgr2=0x7fc2381009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.461+0000 7fc23fde2640 1 -- 10.20.193.28:0/1244677040 shutdown_connections 2026-02-20T03:33:08.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.461+0000 7fc23fde2640 1 -- 10.20.193.28:0/1244677040 wait complete. 2026-02-20T03:33:08.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23fde2640 1 Processor -- start 2026-02-20T03:33:08.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23fde2640 1 -- start start 2026-02-20T03:33:08.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23fde2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2381028d0 0x7fc2381a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23fde2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc238103270 0x7fc2381a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.467 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23fde2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 0x7fc23810e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23fde2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc238112c70 con 0x7fc2381088d0 2026-02-20T03:33:08.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23fde2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc238112af0 con 0x7fc238103270 2026-02-20T03:33:08.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23fde2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc238112df0 con 0x7fc2381028d0 2026-02-20T03:33:08.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23e358640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 0x7fc23810e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:08.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23e358640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 0x7fc23810e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54048/0 (socket says 10.20.193.28:54048) 2026-02-20T03:33:08.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23e358640 1 -- 10.20.193.28:0/176855892 learned_addr learned my addr 10.20.193.28:0/176855892 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:08.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23e358640 1 -- 10.20.193.28:0/176855892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2381028d0 msgr2=0x7fc2381a7660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:08.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.463+0000 7fc23e358640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2381028d0 0x7fc2381a7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc23e358640 1 -- 10.20.193.28:0/176855892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc238103270 msgr2=0x7fc2381a7ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:08.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc23e358640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc238103270 0x7fc2381a7ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc23e358640 1 -- 10.20.193.28:0/176855892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23810f1f0 con 0x7fc2381088d0 2026-02-20T03:33:08.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc23e358640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 0x7fc23810e960 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fc23400b990 tx=0x7fc23400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:08.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc226ffd640 1 -- 10.20.193.28:0/176855892 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234006e60 con 0x7fc2381088d0 2026-02-20T03:33:08.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc226ffd640 1 -- 10.20.193.28:0/176855892 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc234010070 con 0x7fc2381088d0 2026-02-20T03:33:08.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc226ffd640 1 -- 10.20.193.28:0/176855892 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234004800 con 0x7fc2381088d0 2026-02-20T03:33:08.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc23fde2640 1 -- 10.20.193.28:0/176855892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23810f4e0 con 0x7fc2381088d0 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc23fde2640 1 -- 10.20.193.28:0/176855892 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2381ae5e0 con 0x7fc2381088d0 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc226ffd640 1 -- 10.20.193.28:0/176855892 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc23401d030 con 0x7fc2381088d0 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc2422e7e00 1 Processor -- start 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.464+0000 7fc2422e7e00 1 -- start start 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.469+0000 7fc226ffd640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2140b0e20 0x7fc2140b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.469+0000 7fc226ffd640 1 -- 10.20.193.28:0/176855892 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc2340dfff0 con 0x7fc2381088d0 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.469+0000 7fc23d356640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2140b0e20 0x7fc2140b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.469+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af200a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.469+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af200fe0 0x55f8af2049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23db57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af200a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:08.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af205120 0x55f8af20cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8af180e50 con 0x55f8af200630 2026-02-20T03:33:08.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f8af1539c0 con 0x55f8af205120 2026-02-20T03:33:08.475 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f8af101240 con 0x55f8af200fe0 2026-02-20T03:33:08.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23d356640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2140b0e20 0x7fc2140b32e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc2381a2f80 tx=0x7fc228006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:08.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23db57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af200a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54050/0 (socket says 10.20.193.28:54050) 2026-02-20T03:33:08.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23db57640 1 -- 10.20.193.28:0/356130002 learned_addr learned my addr 10.20.193.28:0/356130002 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:08.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23db57640 1 -- 10.20.193.28:0/356130002 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af200fe0 msgr2=0x55f8af2049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:33:08.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23db57640 1 --2- 10.20.193.28:0/356130002 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af200fe0 0x55f8af2049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23db57640 1 -- 10.20.193.28:0/356130002 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af205120 msgr2=0x55f8af20cca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23db57640 1 --2- 10.20.193.28:0/356130002 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af205120 0x55f8af20cca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23db57640 1 -- 10.20.193.28:0/356130002 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8af114420 con 0x55f8af200630 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.470+0000 7fc23db57640 1 --2- 10.20.193.28:0/356130002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af200a10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009a30 tx=0x7fc22c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24bccfc93d1deb0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.472+0000 7fc2064e6640 1 -- 10.20.193.28:0/356130002 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c002c00 con 0x55f8af200630 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.472+0000 7fc2064e6640 1 -- 10.20.193.28:0/356130002 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc22c033040 con 0x55f8af200630 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.472+0000 7fc2064e6640 1 -- 10.20.193.28:0/356130002 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c002c00 con 0x55f8af200630 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.472+0000 7fc2422e7e00 1 -- 10.20.193.28:0/356130002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 msgr2=0x55f8af200a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.472+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/356130002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af200a10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009a30 tx=0x7fc22c005880 comp rx=0 tx=0).stop 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- 10.20.193.28:0/356130002 shutdown_connections 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/356130002 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af205120 0x55f8af20cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/356130002 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af200fe0 0x55f8af2049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/356130002 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af200a10 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- 10.20.193.28:0/356130002 >> 10.20.193.28:0/356130002 conn(0x55f8af1c3290 msgr2=0x55f8af1fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- 10.20.193.28:0/356130002 shutdown_connections 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- 10.20.193.28:0/356130002 wait complete. 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- start start 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 Processor -- start 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af21a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af200fe0 0x55f8af21ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af205120 0x55f8af218e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8af14f8f0 con 0x55f8af200630 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f8aef41f50 con 0x55f8af200fe0 2026-02-20T03:33:08.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f8af219580 con 0x55f8af205120 2026-02-20T03:33:08.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc23db57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af21a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:08.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc23db57640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af21a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54052/0 (socket says 10.20.193.28:54052) 2026-02-20T03:33:08.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc23db57640 1 -- 10.20.193.28:0/2419142948 learned_addr learned my addr 10.20.193.28:0/2419142948 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:08.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc23db57640 1 -- 10.20.193.28:0/2419142948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af205120 msgr2=0x55f8af218e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:08.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc23db57640 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af205120 0x55f8af218e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc23db57640 1 -- 10.20.193.28:0/2419142948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af200fe0 msgr2=0x55f8af21ac00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:08.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc23db57640 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af200fe0 0x55f8af21ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc23db57640 1 -- 10.20.193.28:0/2419142948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8af2128a0 con 0x55f8af200630 2026-02-20T03:33:08.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc23db57640 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af21a6c0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fc22c02f2d0 tx=0x7fc22c003fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742c9dbf69a05744 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc1f37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc1f37fe640 1 -- 10.20.193.28:0/2419142948 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c002c00 con 0x55f8af200630 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc1f37fe640 1 -- 10.20.193.28:0/2419142948 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc22c002970 con 0x55f8af200630 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc1f37fe640 1 -- 10.20.193.28:0/2419142948 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c038e00 con 0x55f8af200630 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- 10.20.193.28:0/2419142948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8aef24b40 con 0x55f8af200630 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 10 client.20595 _ll_register_callbacks cb 0x55f8af18cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc1f37fe640 1 -- 10.20.193.28:0/2419142948 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc22c042410 con 0x55f8af200630 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- 10.20.193.28:0/2419142948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f8af1611a0 con 0x55f8af200630 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc1f37fe640 1 -- 10.20.193.28:0/2419142948 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc22c038730 con 0x55f8af200630 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 10 client.20595 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- 10.20.193.28:0/2419142948 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f8af10e230 con 0x55f8af200630 2026-02-20T03:33:08.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc1f37fe640 1 -- 10.20.193.28:0/2419142948 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fc22c02fab0 con 0x55f8af200630 2026-02-20T03:33:08.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 10 client.20595 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:08.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 10 client.20595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:08.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 20 client.20595 populate_metadata read hostname 'trial028' 2026-02-20T03:33:08.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8af228b90 0x55f8af22af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 4 client.20595 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:08.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.473+0000 7fc2422e7e00 1 -- 10.20.193.28:0/2419142948 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8af15b5b0 con 0x55f8af228b90 2026-02-20T03:33:08.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.483+0000 7fc23d356640 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8af228b90 0x55f8af22af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:08.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.525+0000 7fc23d356640 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8af228b90 0x55f8af22af80 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b25389a04bae0aa server_cookie=896308ee6434f8e9 in_seq=0 out_seq=0 2026-02-20T03:33:08.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.525+0000 7fc1f37fe640 10 client.20595 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:08.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc1f37fe640 1 -- 10.20.193.28:0/2419142948 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f8af15b5b0 con 0x55f8af228b90 2026-02-20T03:33:08.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc1f37fe640 10 client.20595 handle_command_reply: tid=0 2026-02-20T03:33:08.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 client.20595 shutdown 2026-02-20T03:33:08.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 -- 10.20.193.28:0/2419142948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 msgr2=0x55f8af21a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af21a6c0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fc22c02f2d0 tx=0x7fc22c003fe0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 -- 10.20.193.28:0/2419142948 shutdown_connections 2026-02-20T03:33:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8af228b90 0x55f8af22af80 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af205120 0x55f8af218e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af200fe0 0x55f8af21ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/2419142948 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200630 0x55f8af21a6c0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 -- 10.20.193.28:0/2419142948 >> 10.20.193.28:0/2419142948 conn(0x55f8af1c3290 msgr2=0x55f8af1fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc1f37fe640 0 client.20595 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 -- 10.20.193.28:0/2419142948 shutdown_connections 2026-02-20T03:33:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 1 -- 10.20.193.28:0/2419142948 wait complete. 2026-02-20T03:33:08.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.539+0000 7fc2422e7e00 20 client.20595 trim_cache size 0 max 16384 2026-02-20T03:33:08.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 Processor -- start 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 -- start start 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af200630 0x55f8af204700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af1fed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af205120 0x55f8af1ff270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e40126f0 con 0x55f8af200fe0 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e400ffc0 con 0x55f8af200630 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e400de10 con 0x55f8af205120 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc23d356640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af1fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc23d356640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af1fed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54064/0 (socket says 10.20.193.28:54064) 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc23d356640 1 -- 10.20.193.28:0/3396718433 learned_addr learned my addr 10.20.193.28:0/3396718433 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:08.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc23d356640 1 -- 10.20.193.28:0/3396718433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af205120 msgr2=0x55f8af1ff270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc23d356640 1 --2- 10.20.193.28:0/3396718433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af205120 0x55f8af1ff270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc23d356640 1 -- 10.20.193.28:0/3396718433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af200630 msgr2=0x55f8af204700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc23d356640 1 --2- 10.20.193.28:0/3396718433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af200630 0x55f8af204700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc23d356640 1 -- 10.20.193.28:0/3396718433 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8af2126d0 con 0x55f8af200fe0 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc23d356640 1 --2- 10.20.193.28:0/3396718433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af1fed30 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fc228002410 tx=0x7fc228004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c915a9b0b61bbd45 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc205ce5640 1 -- 10.20.193.28:0/3396718433 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc228002c50 con 0x55f8af200fe0 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc205ce5640 1 -- 10.20.193.28:0/3396718433 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc228002df0 con 0x55f8af200fe0 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc205ce5640 1 -- 10.20.193.28:0/3396718433 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22801f960 con 0x55f8af200fe0 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3396718433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 msgr2=0x55f8af1fed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3396718433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af1fed30 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fc228002410 tx=0x7fc228004850 comp rx=0 tx=0).stop 2026-02-20T03:33:08.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3396718433 shutdown_connections 2026-02-20T03:33:08.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3396718433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af205120 0x55f8af1ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3396718433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af1fed30 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3396718433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af200630 0x55f8af204700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3396718433 >> 10.20.193.28:0/3396718433 conn(0x55f8af1c3290 msgr2=0x55f8af229a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:08.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3396718433 shutdown_connections 2026-02-20T03:33:08.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.546+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3396718433 wait complete. 2026-02-20T03:33:08.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 -- start start 2026-02-20T03:33:08.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 Processor -- start 2026-02-20T03:33:08.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af200630 0x55f8af220ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af21e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af205120 0x55f8af21e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e400e480 con 0x55f8af200fe0 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e400f8f0 con 0x55f8af205120 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e400eb50 con 0x55f8af200630 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc23d356640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af21e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc23d356640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af21e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54070/0 (socket says 10.20.193.28:54070) 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc23d356640 1 -- 10.20.193.28:0/3663515666 learned_addr learned my addr 10.20.193.28:0/3663515666 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc23d356640 1 -- 10.20.193.28:0/3663515666 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af200630 msgr2=0x55f8af220ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc23d356640 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af200630 0x55f8af220ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc23d356640 1 -- 10.20.193.28:0/3663515666 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af205120 msgr2=0x55f8af21e770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc23d356640 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af205120 0x55f8af21e770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc23d356640 1 -- 10.20.193.28:0/3663515666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8aee32870 con 0x55f8af200fe0 2026-02-20T03:33:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc1f37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc23d356640 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af21e180 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fc228004820 tx=0x7fc22801f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1753a20f8a1b208f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc1f37fe640 1 -- 10.20.193.28:0/3663515666 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22800b760 con 0x55f8af200fe0 2026-02-20T03:33:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3663515666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8af0f3440 con 0x55f8af200fe0 2026-02-20T03:33:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 10 client.20601 _ll_register_callbacks cb 0x7fc22c0057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3663515666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc228002df0 con 0x55f8af200fe0 2026-02-20T03:33:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc1f37fe640 1 -- 10.20.193.28:0/3663515666 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc228018070 con 0x55f8af200fe0 2026-02-20T03:33:08.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc1f37fe640 1 -- 10.20.193.28:0/3663515666 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22801fd50 con 0x55f8af200fe0 2026-02-20T03:33:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc1f37fe640 1 -- 10.20.193.28:0/3663515666 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc22803b430 con 0x55f8af200fe0 2026-02-20T03:33:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc1f37fe640 1 -- 10.20.193.28:0/3663515666 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc22803b6d0 con 0x55f8af200fe0 2026-02-20T03:33:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 10 client.20601 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3663515666 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f8af2133c0 con 0x55f8af200fe0 2026-02-20T03:33:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc1f37fe640 1 -- 10.20.193.28:0/3663515666 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fc22800b900 con 0x55f8af200fe0 2026-02-20T03:33:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 10 client.20601 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 10 client.20601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:08.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 20 client.20601 populate_metadata read hostname 'trial028' 2026-02-20T03:33:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8af295cb0 0x55f8af298170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 4 client.20601 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:33:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.552+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3663515666 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f8af15b5b0 con 0x55f8af295cb0 2026-02-20T03:33:08.570 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.566+0000 7fc23db57640 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8af295cb0 0x55f8af298170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:08.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:08 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:33:08.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:08 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:08.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.607+0000 7fc1f37fe640 10 client.20601 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:08.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.607+0000 7fc23db57640 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8af295cb0 0x55f8af298170 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11463c6def3a152b server_cookie=cbc298ee7a85a1f0 in_seq=0 out_seq=0 2026-02-20T03:33:08.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc1f37fe640 1 -- 10.20.193.28:0/3663515666 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f8af15b5b0 con 0x55f8af295cb0 2026-02-20T03:33:08.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc1f37fe640 10 client.20601 handle_command_reply: tid=0 2026-02-20T03:33:08.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 client.20601 shutdown 2026-02-20T03:33:08.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3663515666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 msgr2=0x55f8af21e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af21e180 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fc228004820 tx=0x7fc22801f3d0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3663515666 shutdown_connections 2026-02-20T03:33:08.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8af295cb0 0x55f8af298170 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8af205120 0x55f8af21e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8af200fe0 0x55f8af21e180 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 --2- 10.20.193.28:0/3663515666 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8af200630 0x55f8af220ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc1f37fe640 0 client.20601 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:08.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3663515666 >> 10.20.193.28:0/3663515666 conn(0x55f8af1c3290 msgr2=0x55f8af1fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:08.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3663515666 shutdown_connections 2026-02-20T03:33:08.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 1 -- 10.20.193.28:0/3663515666 wait complete. 2026-02-20T03:33:08.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc2422e7e00 20 client.20601 trim_cache size 0 max 16384 2026-02-20T03:33:08.637 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:33:08.637 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:33:08.637 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:33:08.637 INFO:teuthology.orchestra.run.trial028.stdout: "a9f7a206-9da9-46ba-aaa5-b73614b91878": { 2026-02-20T03:33:08.638 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:33:08.638 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "a9f7a206-9da9-46ba-aaa5-b73614b91878", 2026-02-20T03:33:08.638 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:33:08.638 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:33:08.638 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:33:08.638 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:33:08.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc23fde2640 1 -- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2140b0e20 msgr2=0x7fc2140b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc23fde2640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2140b0e20 0x7fc2140b32e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc2381a2f80 tx=0x7fc228006cd0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc23fde2640 1 -- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 msgr2=0x7fc23810e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:08.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.620+0000 7fc23fde2640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 0x7fc23810e960 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fc23400b990 tx=0x7fc23400be60 comp rx=0 tx=0).stop 2026-02-20T03:33:08.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.624+0000 7fc23fde2640 1 -- 10.20.193.28:0/176855892 shutdown_connections 2026-02-20T03:33:08.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.624+0000 7fc23fde2640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc2140b0e20 0x7fc2140b32e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.624+0000 7fc23fde2640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc2381088d0 0x7fc23810e960 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.624+0000 7fc23fde2640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc238103270 0x7fc2381a7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.624+0000 7fc23fde2640 1 --2- 10.20.193.28:0/176855892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc2381028d0 0x7fc2381a7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:08.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.624+0000 7fc23fde2640 1 -- 10.20.193.28:0/176855892 >> 10.20.193.28:0/176855892 conn(0x7fc2380fe5d0 msgr2=0x7fc2380fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:08.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.624+0000 7fc23fde2640 1 -- 10.20.193.28:0/176855892 shutdown_connections 2026-02-20T03:33:08.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:08.624+0000 7fc23fde2640 1 -- 10.20.193.28:0/176855892 wait complete. 2026-02-20T03:33:08.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136928 25.77 MB/sec execute 159 sec latency 7609.101 ms 2026-02-20T03:33:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:08 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:33:08.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:08 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:08.812 INFO:tasks.cephfs.filesystem:scrub status for tag:a9f7a206-9da9-46ba-aaa5-b73614b91878 - {'path': '/', 'tag': 'a9f7a206-9da9-46ba-aaa5-b73614b91878', 'options': 'recursive,force'} 2026-02-20T03:33:09.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:09 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:33:09.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:09 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:09.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:09 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:33:09.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:09 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:33:09.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:09 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:09.405 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:09 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:09.406 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:09 trial028 ceph-mon[38552]: pgmap v740: 129 pgs: 129 active+clean; 689 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 13 MiB/s rd, 11 MiB/s wr, 892 op/s 2026-02-20T03:33:09.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136928 25.61 MB/sec execute 160 sec latency 8609.151 ms 2026-02-20T03:33:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:09 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:33:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:09 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:09 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:33:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:09 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:33:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:09 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:09 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:09 trial177 ceph-mon[43181]: pgmap v740: 129 pgs: 129 active+clean; 689 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 13 MiB/s rd, 11 MiB/s wr, 892 op/s 2026-02-20T03:33:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:09 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:33:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:09 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:09 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:33:09.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:09 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:33:09.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:09 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:09.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:09 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:09.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:09 trial126 ceph-mon[38476]: pgmap v740: 129 pgs: 129 active+clean; 689 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 13 MiB/s rd, 11 MiB/s wr, 892 op/s 2026-02-20T03:33:10.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136929 25.45 MB/sec execute 161 sec latency 9609.207 ms 2026-02-20T03:33:11.558 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:11 trial028 ceph-mon[38552]: pgmap v741: 129 pgs: 129 active+clean; 716 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 918 op/s 2026-02-20T03:33:11.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:11 trial126 ceph-mon[38476]: pgmap v741: 129 pgs: 129 active+clean; 716 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 918 op/s 2026-02-20T03:33:11.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136929 25.30 MB/sec execute 162 sec latency 10609.255 ms 2026-02-20T03:33:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:11 trial177 ceph-mon[43181]: pgmap v741: 129 pgs: 129 active+clean; 716 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 918 op/s 2026-02-20T03:33:12.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136929 25.14 MB/sec execute 163 sec latency 11609.313 ms 2026-02-20T03:33:13.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:13 trial028 ceph-mon[38552]: pgmap v742: 129 pgs: 129 active+clean; 732 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 685 op/s 2026-02-20T03:33:13.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136930 24.99 MB/sec execute 164 sec latency 12609.363 ms 2026-02-20T03:33:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:13 trial177 ceph-mon[43181]: pgmap v742: 129 pgs: 129 active+clean; 732 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 685 op/s 2026-02-20T03:33:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:13 trial126 ceph-mon[38476]: pgmap v742: 129 pgs: 129 active+clean; 732 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 685 op/s 2026-02-20T03:33:14.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136930 24.84 MB/sec execute 165 sec latency 13609.403 ms 2026-02-20T03:33:15.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:15 trial028 ceph-mon[38552]: pgmap v743: 129 pgs: 129 active+clean; 726 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 677 op/s 2026-02-20T03:33:15.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136930 24.69 MB/sec execute 166 sec latency 14609.444 ms 2026-02-20T03:33:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:15 trial177 ceph-mon[43181]: pgmap v743: 129 pgs: 129 active+clean; 726 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 677 op/s 2026-02-20T03:33:15.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:15 trial126 ceph-mon[38476]: pgmap v743: 129 pgs: 129 active+clean; 726 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 677 op/s 2026-02-20T03:33:16.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136930 24.54 MB/sec execute 167 sec latency 15609.484 ms 2026-02-20T03:33:17.424 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:17 trial028 ceph-mon[38552]: pgmap v744: 129 pgs: 129 active+clean; 736 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 655 op/s 2026-02-20T03:33:17.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136931 24.39 MB/sec execute 168 sec latency 16563.278 ms 2026-02-20T03:33:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:17 trial177 ceph-mon[43181]: pgmap v744: 129 pgs: 129 active+clean; 736 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 655 op/s 2026-02-20T03:33:17.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:17 trial126 ceph-mon[38476]: pgmap v744: 129 pgs: 129 active+clean; 736 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 1.9 MiB/s rd, 13 MiB/s wr, 655 op/s 2026-02-20T03:33:18.542 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:33:18.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:33:18.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:33:18.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136931 24.25 MB/sec execute 169 sec latency 17509.919 ms 2026-02-20T03:33:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:33:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:33:18.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:33:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:33:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:33:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:33:19.670 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:19 trial028 ceph-mon[38552]: pgmap v745: 129 pgs: 129 active+clean; 738 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 537 KiB/s rd, 12 MiB/s wr, 592 op/s 2026-02-20T03:33:19.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136931 24.11 MB/sec execute 170 sec latency 18509.960 ms 2026-02-20T03:33:19.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:19 trial177 ceph-mon[43181]: pgmap v745: 129 pgs: 129 active+clean; 738 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 537 KiB/s rd, 12 MiB/s wr, 592 op/s 2026-02-20T03:33:19.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:19 trial126 ceph-mon[38476]: pgmap v745: 129 pgs: 129 active+clean; 738 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 537 KiB/s rd, 12 MiB/s wr, 592 op/s 2026-02-20T03:33:20.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 23.96 MB/sec execute 171 sec latency 19271.800 ms 2026-02-20T03:33:21.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- 10.20.193.28:0/224013396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c1026b0 msgr2=0x7f547c102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:21.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 --2- 10.20.193.28:0/224013396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c1026b0 0x7f547c102ab0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f546c009a30 tx=0x7f546c02f260 comp rx=0 tx=0).stop 2026-02-20T03:33:21.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- 10.20.193.28:0/224013396 shutdown_connections 2026-02-20T03:33:21.089 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 --2- 10.20.193.28:0/224013396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f547c104260 0x7f547c10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 --2- 10.20.193.28:0/224013396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f547c1038a0 0x7f547c103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 --2- 10.20.193.28:0/224013396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c1026b0 0x7f547c102ab0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- 10.20.193.28:0/224013396 >> 10.20.193.28:0/224013396 conn(0x7f547c0fde10 msgr2=0x7f547c100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:21.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- 10.20.193.28:0/224013396 shutdown_connections 2026-02-20T03:33:21.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- 10.20.193.28:0/224013396 wait complete. 2026-02-20T03:33:21.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 Processor -- start 2026-02-20T03:33:21.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- start start 2026-02-20T03:33:21.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f547c1026b0 0x7f547c076e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f547c1038a0 0x7f547c075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.092 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c104260 0x7f547c0759a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f547c10e2c0 con 0x7f547c104260 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f547c10e140 con 0x7f547c1026b0 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f547c10e440 con 0x7f547c1038a0 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f54815d7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c104260 0x7f547c0759a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f54815d7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c104260 0x7f547c0759a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54362/0 (socket says 10.20.193.28:54362) 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f54815d7640 1 -- 10.20.193.28:0/1512967410 learned_addr learned my addr 10.20.193.28:0/1512967410 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f54815d7640 1 -- 10.20.193.28:0/1512967410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f547c1038a0 msgr2=0x7f547c075460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f54815d7640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f547c1038a0 0x7f547c075460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f54815d7640 1 -- 10.20.193.28:0/1512967410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f547c1026b0 msgr2=0x7f547c076e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f54815d7640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f547c1026b0 0x7f547c076e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.093 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f54815d7640 1 -- 10.20.193.28:0/1512967410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547c076240 con 0x7f547c104260 2026-02-20T03:33:21.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f54815d7640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c104260 0x7f547c0759a0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f547800b990 tx=0x7f547800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:21.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5471ffb640 1 -- 10.20.193.28:0/1512967410 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478006e60 con 0x7f547c104260 2026-02-20T03:33:21.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5471ffb640 1 -- 10.20.193.28:0/1512967410 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5478010070 con 0x7f547c104260 2026-02-20T03:33:21.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5471ffb640 1 -- 10.20.193.28:0/1512967410 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478004800 con 0x7f547c104260 2026-02-20T03:33:21.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- 10.20.193.28:0/1512967410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547c1a4b50 con 0x7f547c104260 2026-02-20T03:33:21.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.087+0000 7f5481dd8640 1 -- 10.20.193.28:0/1512967410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f547c1a50d0 con 0x7f547c104260 2026-02-20T03:33:21.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5471ffb640 1 -- 10.20.193.28:0/1512967410 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f547800c790 con 0x7f547c104260 2026-02-20T03:33:21.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 Processor -- start 2026-02-20T03:33:21.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- start start 2026-02-20T03:33:21.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee2e80 0x55f57aee3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.095 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 0x55f57aee7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee8560 0x55f57aeea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f57ae338f0 con 0x55f57aee8560 2026-02-20T03:33:21.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f57ade12e0 con 0x55f57aee37c0 2026-02-20T03:33:21.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f57ae2f820 con 0x55f57aee2e80 2026-02-20T03:33:21.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5473fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee8560 0x55f57aeea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:21.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5473fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee8560 0x55f57aeea9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54374/0 (socket says 10.20.193.28:54374) 2026-02-20T03:33:21.096 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5473fff640 1 -- 10.20.193.28:0/2024470957 learned_addr learned my addr 10.20.193.28:0/2024470957 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:21.097 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5473fff640 1 -- 10.20.193.28:0/2024470957 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee2e80 msgr2=0x55f57aee3280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5473fff640 1 --2- 10.20.193.28:0/2024470957 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee2e80 0x55f57aee3280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5473fff640 1 -- 10.20.193.28:0/2024470957 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 msgr2=0x55f57aee7f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5473fff640 1 --2- 10.20.193.28:0/2024470957 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 0x55f57aee7f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5473fff640 1 -- 10.20.193.28:0/2024470957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57add35a0 con 0x55f57aee8560 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5471ffb640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f54580b0e20 0x7f54580b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5473fff640 1 --2- 10.20.193.28:0/2024470957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee8560 0x55f57aeea9f0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f54640098a0 tx=0x7f5464009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ea963436adb6ca server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5471ffb640 1 -- 10.20.193.28:0/1512967410 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f54780e0400 con 0x7f547c104260 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5480dd6640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f54580b0e20 0x7f54580b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f54493fe640 1 -- 10.20.193.28:0/2024470957 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464016070 con 0x55f57aee8560 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f54493fe640 1 -- 10.20.193.28:0/2024470957 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5464002870 con 0x55f57aee8560 2026-02-20T03:33:21.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f54493fe640 1 -- 10.20.193.28:0/2024470957 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54640046e0 con 0x55f57aee8560 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- 10.20.193.28:0/2024470957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee8560 msgr2=0x55f57aeea9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/2024470957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee8560 0x55f57aeea9f0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f54640098a0 tx=0x7f5464009d70 comp rx=0 tx=0).stop 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5480dd6640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f54580b0e20 0x7f54580b32e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f546c02f770 tx=0x7f546c0023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- 10.20.193.28:0/2024470957 shutdown_connections 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/2024470957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee8560 0x55f57aeea9f0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/2024470957 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 0x55f57aee7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/2024470957 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee2e80 0x55f57aee3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- 10.20.193.28:0/2024470957 >> 10.20.193.28:0/2024470957 conn(0x55f57aeda6f0 msgr2=0x55f57aee1570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- 10.20.193.28:0/2024470957 shutdown_connections 2026-02-20T03:33:21.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- 10.20.193.28:0/2024470957 wait complete. 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 -- start start 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.090+0000 7f5485ec3e00 1 Processor -- start 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af04230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee37c0 0x55f57af04770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee8560 0x55f57af0b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f57addb0c0 con 0x55f57aee2e80 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f57aeeb610 con 0x55f57aee8560 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f57aeebb00 con 0x55f57aee37c0 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5480dd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af04230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:21.107 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5480dd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af04230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54388/0 (socket says 10.20.193.28:54388) 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5480dd6640 1 -- 10.20.193.28:0/964724833 learned_addr learned my addr 10.20.193.28:0/964724833 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5480dd6640 1 -- 10.20.193.28:0/964724833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee37c0 msgr2=0x55f57af04770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5480dd6640 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee37c0 0x55f57af04770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5480dd6640 1 -- 10.20.193.28:0/964724833 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee8560 msgr2=0x55f57af0b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5480dd6640 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee8560 0x55f57af0b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5480dd6640 1 -- 10.20.193.28:0/964724833 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57aefdc70 con 0x55f57aee2e80 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5480dd6640 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af04230 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f546c037000 tx=0x7f546c02f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd04b5c02c612c49 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f543a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f543a7fc640 1 -- 10.20.193.28:0/964724833 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c038540 con 0x55f57aee2e80 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f543a7fc640 1 -- 10.20.193.28:0/964724833 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f546c038540 con 0x55f57aee2e80 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f543a7fc640 1 -- 10.20.193.28:0/964724833 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c045670 con 0x55f57aee2e80 2026-02-20T03:33:21.108 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 -- 10.20.193.28:0/964724833 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f57adef820 con 0x55f57aee2e80 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 10 client.20613 _ll_register_callbacks cb 0x55f57addeff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 -- 10.20.193.28:0/964724833 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f57ae3b4e0 con 0x55f57aee2e80 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f543a7fc640 1 -- 10.20.193.28:0/964724833 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f546c002d30 con 0x55f57aee2e80 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f543a7fc640 1 -- 10.20.193.28:0/964724833 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f546c0389a0 con 0x55f57aee2e80 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 10 client.20613 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 -- 10.20.193.28:0/964724833 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f57adf4380 con 0x55f57aee2e80 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f543a7fc640 1 -- 10.20.193.28:0/964724833 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f546c04d070 con 0x55f57aee2e80 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 10 client.20613 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 10 client.20613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 20 client.20613 populate_metadata read hostname 'trial028' 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f57aeeff40 0x55f57aef23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 4 client.20613 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:21.109 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.096+0000 7f5485ec3e00 1 -- 10.20.193.28:0/964724833 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f57adb5bd0 con 0x55f57aeeff40 2026-02-20T03:33:21.118 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.117+0000 7f5473fff640 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f57aeeff40 0x55f57aef23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:21.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.170+0000 7f543a7fc640 10 client.20613 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:21.172 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.170+0000 7f5473fff640 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f57aeeff40 0x55f57aef23e0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4fc327e7ec0ae9d server_cookie=76be167998746daa in_seq=0 out_seq=0 2026-02-20T03:33:21.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f543a7fc640 1 -- 10.20.193.28:0/964724833 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f57adb5bd0 con 0x55f57aeeff40 2026-02-20T03:33:21.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f543a7fc640 10 client.20613 handle_command_reply: tid=0 2026-02-20T03:33:21.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 client.20613 shutdown 2026-02-20T03:33:21.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 -- 10.20.193.28:0/964724833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 msgr2=0x55f57af04230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:21.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af04230 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f546c037000 tx=0x7f546c02f260 comp rx=0 tx=0).stop 2026-02-20T03:33:21.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 -- 10.20.193.28:0/964724833 shutdown_connections 2026-02-20T03:33:21.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f57aeeff40 0x55f57aef23e0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee8560 0x55f57af0b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee37c0 0x55f57af04770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/964724833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af04230 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f543a7fc640 0 client.20613 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:21.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 -- 10.20.193.28:0/964724833 >> 10.20.193.28:0/964724833 conn(0x55f57aeda6f0 msgr2=0x55f57aee98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:21.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 -- 10.20.193.28:0/964724833 shutdown_connections 2026-02-20T03:33:21.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.197+0000 7f5485ec3e00 1 -- 10.20.193.28:0/964724833 wait complete. 2026-02-20T03:33:21.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.198+0000 7f5485ec3e00 20 client.20613 trim_cache size 0 max 16384 2026-02-20T03:33:21.208 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5485ec3e00 1 Processor -- start 2026-02-20T03:33:21.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5485ec3e00 1 -- start start 2026-02-20T03:33:21.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57aef2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 0x55f57af0b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee8560 0x55f57aef31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f54200126d0 con 0x55f57aee2e80 2026-02-20T03:33:21.210 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f542000ffa0 con 0x55f57aee37c0 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f542000ddf0 con 0x55f57aee8560 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5480dd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57aef2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5480dd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57aef2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54392/0 (socket says 10.20.193.28:54392) 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.200+0000 7f5480dd6640 1 -- 10.20.193.28:0/4202316446 learned_addr learned my addr 10.20.193.28:0/4202316446 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 -- 10.20.193.28:0/4202316446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee8560 msgr2=0x55f57aef31c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 --2- 10.20.193.28:0/4202316446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee8560 0x55f57aef31c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 -- 10.20.193.28:0/4202316446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 msgr2=0x55f57af0b6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 --2- 10.20.193.28:0/4202316446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 0x55f57af0b6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 -- 10.20.193.28:0/4202316446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57aef8560 con 0x55f57aee2e80 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 --2- 10.20.193.28:0/4202316446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57aef2c80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f546c005d20 tx=0x7f546c054000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f9c64ef2ae6e31 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:21.211 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5448bfd640 1 -- 10.20.193.28:0/4202316446 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c00b0c0 con 0x55f57aee2e80 2026-02-20T03:33:21.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5448bfd640 1 -- 10.20.193.28:0/4202316446 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55f57ae3b4e0 con 0x55f57aee2e80 2026-02-20T03:33:21.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5448bfd640 1 -- 10.20.193.28:0/4202316446 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c058430 con 0x55f57aee2e80 2026-02-20T03:33:21.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- 10.20.193.28:0/4202316446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 msgr2=0x55f57aef2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:21.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/4202316446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57aef2c80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f546c005d20 tx=0x7f546c054000 comp rx=0 tx=0).stop 2026-02-20T03:33:21.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- 10.20.193.28:0/4202316446 shutdown_connections 2026-02-20T03:33:21.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/4202316446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee8560 0x55f57aef31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/4202316446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 0x55f57af0b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/4202316446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57aef2c80 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.212 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- 10.20.193.28:0/4202316446 >> 10.20.193.28:0/4202316446 conn(0x55f57aeda6f0 msgr2=0x55f57af00da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- 10.20.193.28:0/4202316446 shutdown_connections 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- 10.20.193.28:0/4202316446 wait complete. 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- start start 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 Processor -- start 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af22900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 0x55f57af0b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee8560 0x55f57af83280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f542000e460 con 0x55f57aee2e80 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f542000f8d0 con 0x55f57aee37c0 2026-02-20T03:33:21.215 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f542000eb30 con 0x55f57aee8560 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af22900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af22900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54396/0 (socket says 10.20.193.28:54396) 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 -- 10.20.193.28:0/119468372 learned_addr learned my addr 10.20.193.28:0/119468372 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 -- 10.20.193.28:0/119468372 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee8560 msgr2=0x55f57af83280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee8560 0x55f57af83280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 -- 10.20.193.28:0/119468372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 msgr2=0x55f57af0b6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 0x55f57af0b6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 -- 10.20.193.28:0/119468372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f57aefdaa0 con 0x55f57aee2e80 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5480dd6640 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af22900 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f546c009a30 tx=0x7f546c0044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed13f14ebc42b182 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f543a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:21.216 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f543a7fc640 1 -- 10.20.193.28:0/119468372 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c065020 con 0x55f57aee2e80 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f543a7fc640 1 -- 10.20.193.28:0/119468372 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f546c033040 con 0x55f57aee2e80 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- 10.20.193.28:0/119468372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f57ab93690 con 0x55f57aee2e80 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f543a7fc640 1 -- 10.20.193.28:0/119468372 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c045680 con 0x55f57aee2e80 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 10 client.20619 _ll_register_callbacks cb 0x7f546c005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- 10.20.193.28:0/119468372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5464002870 con 0x55f57aee2e80 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f543a7fc640 1 -- 10.20.193.28:0/119468372 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f546c045820 con 0x55f57aee2e80 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f543a7fc640 1 -- 10.20.193.28:0/119468372 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f546c045ae0 con 0x55f57aee2e80 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 10 client.20619 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- 10.20.193.28:0/119468372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f57adf8b70 con 0x55f57aee2e80 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f543a7fc640 1 -- 10.20.193.28:0/119468372 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f546c04d040 con 0x55f57aee2e80 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 10 client.20619 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:21.217 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 10 client.20619 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:21.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 20 client.20619 populate_metadata read hostname 'trial028' 2026-02-20T03:33:21.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f57af84e20 0x55f57af872e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:21.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 4 client.20619 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:33:21.218 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.206+0000 7f5485ec3e00 1 -- 10.20.193.28:0/119468372 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f57ae046b0 con 0x55f57af84e20 2026-02-20T03:33:21.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.224+0000 7f5473fff640 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f57af84e20 0x55f57af872e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:21.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.277+0000 7f5473fff640 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f57af84e20 0x55f57af872e0 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac8f7be6cde3c3f8 server_cookie=6b9929e7fab98bad in_seq=0 out_seq=0 2026-02-20T03:33:21.279 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:21.277+0000 7f543a7fc640 10 client.20619 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:21.568 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:21 trial028 ceph-mon[38552]: pgmap v746: 129 pgs: 129 active+clean; 745 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 406 KiB/s rd, 15 MiB/s wr, 653 op/s 2026-02-20T03:33:21.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 23.82 MB/sec execute 172 sec latency 20167.845 ms 2026-02-20T03:33:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:21 trial177 ceph-mon[43181]: pgmap v746: 129 pgs: 129 active+clean; 745 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 406 KiB/s rd, 15 MiB/s wr, 653 op/s 2026-02-20T03:33:21.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:21 trial126 ceph-mon[38476]: pgmap v746: 129 pgs: 129 active+clean; 745 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 406 KiB/s rd, 15 MiB/s wr, 653 op/s 2026-02-20T03:33:22.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:33:22.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:33:22.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:33:22.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:33:22.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.515+0000 7f543a7fc640 1 -- 10.20.193.28:0/119468372 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f57ae046b0 con 0x55f57af84e20 2026-02-20T03:33:22.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.515+0000 7f543a7fc640 10 client.20619 handle_command_reply: tid=0 2026-02-20T03:33:22.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.515+0000 7f5485ec3e00 1 client.20619 shutdown 2026-02-20T03:33:22.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 -- 10.20.193.28:0/119468372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 msgr2=0x55f57af22900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af22900 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f546c009a30 tx=0x7f546c0044b0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 -- 10.20.193.28:0/119468372 shutdown_connections 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f57af84e20 0x55f57af872e0 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f57aee8560 0x55f57af83280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f57aee37c0 0x55f57af0b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 --2- 10.20.193.28:0/119468372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f57aee2e80 0x55f57af22900 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 -- 10.20.193.28:0/119468372 >> 10.20.193.28:0/119468372 conn(0x55f57aeda6f0 msgr2=0x55f57af015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f543a7fc640 0 client.20619 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 -- 10.20.193.28:0/119468372 shutdown_connections 2026-02-20T03:33:22.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 1 -- 10.20.193.28:0/119468372 wait complete. 2026-02-20T03:33:22.522 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5485ec3e00 20 client.20619 trim_cache size 0 max 16384 2026-02-20T03:33:22.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5481dd8640 1 -- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f54580b0e20 msgr2=0x7f54580b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:22.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5481dd8640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f54580b0e20 0x7f54580b32e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f546c02f770 tx=0x7f546c0023d0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5481dd8640 1 -- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c104260 msgr2=0x7f547c0759a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:22.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.516+0000 7f5481dd8640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c104260 0x7f547c0759a0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f547800b990 tx=0x7f547800be60 comp rx=0 tx=0).stop 2026-02-20T03:33:22.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.518+0000 7f5481dd8640 1 -- 10.20.193.28:0/1512967410 shutdown_connections 2026-02-20T03:33:22.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.518+0000 7f5481dd8640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f54580b0e20 0x7f54580b32e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.518+0000 7f5481dd8640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f547c104260 0x7f547c0759a0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.518+0000 7f5481dd8640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f547c1038a0 0x7f547c075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.518+0000 7f5481dd8640 1 --2- 10.20.193.28:0/1512967410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f547c1026b0 0x7f547c076e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:22.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.518+0000 7f5481dd8640 1 -- 10.20.193.28:0/1512967410 >> 10.20.193.28:0/1512967410 conn(0x7f547c0fde10 msgr2=0x7f547c106cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:22.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.518+0000 7f5481dd8640 1 -- 10.20.193.28:0/1512967410 shutdown_connections 2026-02-20T03:33:22.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:22.518+0000 7f5481dd8640 1 -- 10.20.193.28:0/1512967410 wait complete. 2026-02-20T03:33:22.711 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 23.69 MB/sec execute 173 sec latency 21167.883 ms 2026-02-20T03:33:23.493 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:23 trial028 ceph-mon[38552]: pgmap v747: 129 pgs: 129 active+clean; 763 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 383 KiB/s rd, 12 MiB/s wr, 411 op/s 2026-02-20T03:33:23.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 23.55 MB/sec execute 174 sec latency 22167.925 ms 2026-02-20T03:33:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:23 trial177 ceph-mon[43181]: pgmap v747: 129 pgs: 129 active+clean; 763 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 383 KiB/s rd, 12 MiB/s wr, 411 op/s 2026-02-20T03:33:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:23 trial126 ceph-mon[38476]: pgmap v747: 129 pgs: 129 active+clean; 763 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 383 KiB/s rd, 12 MiB/s wr, 411 op/s 2026-02-20T03:33:24.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 23.42 MB/sec execute 175 sec latency 23167.989 ms 2026-02-20T03:33:25.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 23.28 MB/sec execute 176 sec latency 24168.056 ms 2026-02-20T03:33:25.712 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:25 trial028 ceph-mon[38552]: pgmap v748: 129 pgs: 129 active+clean; 773 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 384 KiB/s rd, 13 MiB/s wr, 398 op/s 2026-02-20T03:33:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:25 trial126 ceph-mon[38476]: pgmap v748: 129 pgs: 129 active+clean; 773 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 384 KiB/s rd, 13 MiB/s wr, 398 op/s 2026-02-20T03:33:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:25 trial177 ceph-mon[43181]: pgmap v748: 129 pgs: 129 active+clean; 773 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 384 KiB/s rd, 13 MiB/s wr, 398 op/s 2026-02-20T03:33:26.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 23.15 MB/sec execute 177 sec latency 25168.099 ms 2026-02-20T03:33:27.609 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:27 trial028 ceph-mon[38552]: pgmap v749: 129 pgs: 129 active+clean; 753 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 344 KiB/s rd, 13 MiB/s wr, 455 op/s 2026-02-20T03:33:27.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 23.02 MB/sec execute 178 sec latency 26168.147 ms 2026-02-20T03:33:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:27 trial126 ceph-mon[38476]: pgmap v749: 129 pgs: 129 active+clean; 753 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 344 KiB/s rd, 13 MiB/s wr, 455 op/s 2026-02-20T03:33:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:27 trial177 ceph-mon[43181]: pgmap v749: 129 pgs: 129 active+clean; 753 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 344 KiB/s rd, 13 MiB/s wr, 455 op/s 2026-02-20T03:33:28.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 22.89 MB/sec execute 179 sec latency 27168.181 ms 2026-02-20T03:33:29.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 22.77 MB/sec execute 180 sec latency 28168.215 ms 2026-02-20T03:33:29.745 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:29 trial028 ceph-mon[38552]: pgmap v750: 129 pgs: 129 active+clean; 740 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 495 KiB/s rd, 12 MiB/s wr, 502 op/s 2026-02-20T03:33:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:29 trial126 ceph-mon[38476]: pgmap v750: 129 pgs: 129 active+clean; 740 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 495 KiB/s rd, 12 MiB/s wr, 502 op/s 2026-02-20T03:33:29.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:29 trial177 ceph-mon[43181]: pgmap v750: 129 pgs: 129 active+clean; 740 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 495 KiB/s rd, 12 MiB/s wr, 502 op/s 2026-02-20T03:33:30.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 22.64 MB/sec execute 181 sec latency 29168.251 ms 2026-02-20T03:33:31.710 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:31 trial028 ceph-mon[38552]: pgmap v751: 129 pgs: 129 active+clean; 747 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 368 KiB/s rd, 12 MiB/s wr, 526 op/s 2026-02-20T03:33:31.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 22.52 MB/sec execute 182 sec latency 30168.290 ms 2026-02-20T03:33:31.770 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:31 trial177 ceph-mon[43181]: pgmap v751: 129 pgs: 129 active+clean; 747 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 368 KiB/s rd, 12 MiB/s wr, 526 op/s 2026-02-20T03:33:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:31 trial126 ceph-mon[38476]: pgmap v751: 129 pgs: 129 active+clean; 747 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 368 KiB/s rd, 12 MiB/s wr, 526 op/s 2026-02-20T03:33:32.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 22.39 MB/sec execute 183 sec latency 31168.321 ms 2026-02-20T03:33:33.579 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:33 trial028 ceph-mon[38552]: pgmap v752: 129 pgs: 129 active+clean; 760 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 355 KiB/s rd, 10 MiB/s wr, 445 op/s 2026-02-20T03:33:33.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 22.27 MB/sec execute 184 sec latency 32168.347 ms 2026-02-20T03:33:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:33 trial126 ceph-mon[38476]: pgmap v752: 129 pgs: 129 active+clean; 760 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 355 KiB/s rd, 10 MiB/s wr, 445 op/s 2026-02-20T03:33:33.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:33 trial177 ceph-mon[43181]: pgmap v752: 129 pgs: 129 active+clean; 760 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 355 KiB/s rd, 10 MiB/s wr, 445 op/s 2026-02-20T03:33:34.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 22.15 MB/sec execute 185 sec latency 33168.376 ms 2026-02-20T03:33:35.515 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:35 trial028 ceph-mon[38552]: pgmap v753: 129 pgs: 129 active+clean; 782 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 327 KiB/s rd, 10 MiB/s wr, 448 op/s 2026-02-20T03:33:35.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.593+0000 7f5e37fff640 1 -- 10.20.193.28:0/1514999383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e38109e60 msgr2=0x7f5e3810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:35.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.593+0000 7f5e37fff640 1 --2- 10.20.193.28:0/1514999383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e38109e60 0x7f5e3810a2e0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009a30 tx=0x7f5e2002f260 comp rx=0 tx=0).stop 2026-02-20T03:33:35.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- 10.20.193.28:0/1514999383 shutdown_connections 2026-02-20T03:33:35.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 --2- 10.20.193.28:0/1514999383 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e3810a900 0x7f5e38111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 --2- 10.20.193.28:0/1514999383 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e38109e60 0x7f5e3810a2e0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 --2- 10.20.193.28:0/1514999383 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e38109490 0x7f5e38109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- 10.20.193.28:0/1514999383 >> 10.20.193.28:0/1514999383 conn(0x7f5e38077fe0 msgr2=0x7f5e3807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:35.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- 10.20.193.28:0/1514999383 shutdown_connections 2026-02-20T03:33:35.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- 10.20.193.28:0/1514999383 wait complete. 2026-02-20T03:33:35.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 Processor -- start 2026-02-20T03:33:35.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- start start 2026-02-20T03:33:35.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e38109490 0x7f5e381a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e38109e60 0x7f5e381a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3810a900 0x7f5e381a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e38114a50 con 0x7f5e3810a900 2026-02-20T03:33:35.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e381148d0 con 0x7f5e38109490 2026-02-20T03:33:35.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e38114bd0 con 0x7f5e38109e60 2026-02-20T03:33:35.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e377fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3810a900 0x7f5e381a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:35.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e377fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3810a900 0x7f5e381a8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58148/0 (socket says 10.20.193.28:58148) 2026-02-20T03:33:35.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e377fe640 1 -- 10.20.193.28:0/2874443449 learned_addr learned my addr 10.20.193.28:0/2874443449 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:35.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e377fe640 1 -- 10.20.193.28:0/2874443449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e38109e60 msgr2=0x7f5e381a15d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:35.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e377fe640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e38109e60 0x7f5e381a15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e377fe640 1 -- 10.20.193.28:0/2874443449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e38109490 msgr2=0x7f5e381a1090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:35.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e377fe640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e38109490 0x7f5e381a1090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.604 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e377fe640 1 -- 10.20.193.28:0/2874443449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e381a8d40 con 0x7f5e3810a900 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e377fe640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3810a900 0x7f5e381a8640 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800b990 tx=0x7f5e2800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e17fff640 1 -- 10.20.193.28:0/2874443449 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28006e60 con 0x7f5e3810a900 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e17fff640 1 -- 10.20.193.28:0/2874443449 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e28010070 con 0x7f5e3810a900 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e17fff640 1 -- 10.20.193.28:0/2874443449 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28004800 con 0x7f5e3810a900 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- 10.20.193.28:0/2874443449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e381a8fd0 con 0x7f5e3810a900 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e37fff640 1 -- 10.20.193.28:0/2874443449 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e381a9510 con 0x7f5e3810a900 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e17fff640 1 -- 10.20.193.28:0/2874443449 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5e2801d030 con 0x7f5e3810a900 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e401fee00 1 Processor -- start 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e401fee00 1 -- start start 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fba9e80 0x55f71fbaa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 0x55f71fbaef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.605 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbb19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e401fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f71fafa8f0 con 0x55f71fbaf560 2026-02-20T03:33:35.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e401fee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f71faa82e0 con 0x55f71fba9e80 2026-02-20T03:33:35.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.595+0000 7f5e401fee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f71faf6820 con 0x55f71fbaa7c0 2026-02-20T03:33:35.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e367fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbb19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:35.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e367fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbb19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58150/0 (socket says 10.20.193.28:58150) 2026-02-20T03:33:35.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e367fc640 1 -- 10.20.193.28:0/1511803099 learned_addr learned my addr 10.20.193.28:0/1511803099 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:35.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e367fc640 1 -- 10.20.193.28:0/1511803099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 msgr2=0x55f71fbaef40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:35.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e367fc640 1 --2- 10.20.193.28:0/1511803099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 0x55f71fbaef40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e367fc640 1 -- 10.20.193.28:0/1511803099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fba9e80 msgr2=0x55f71fbaa280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:35.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e367fc640 1 --2- 10.20.193.28:0/1511803099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fba9e80 0x55f71fbaa280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e367fc640 1 -- 10.20.193.28:0/1511803099 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71fa9a5a0 con 0x55f71fbaf560 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e367fc640 1 --2- 10.20.193.28:0/1511803099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbb19f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009a00 tx=0x7f5e20005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657b86e68bbea278 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e153fe640 1 -- 10.20.193.28:0/1511803099 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20002d90 con 0x55f71fbaf560 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e153fe640 1 -- 10.20.193.28:0/1511803099 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e20033040 con 0x55f71fbaf560 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e153fe640 1 -- 10.20.193.28:0/1511803099 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20004440 con 0x55f71fbaf560 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- 10.20.193.28:0/1511803099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 msgr2=0x55f71fbb19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 --2- 10.20.193.28:0/1511803099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbb19f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009a00 tx=0x7f5e20005ce0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- 10.20.193.28:0/1511803099 shutdown_connections 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 --2- 10.20.193.28:0/1511803099 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbb19f0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 --2- 10.20.193.28:0/1511803099 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 0x55f71fbaef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 --2- 10.20.193.28:0/1511803099 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fba9e80 0x55f71fbaa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- 10.20.193.28:0/1511803099 >> 10.20.193.28:0/1511803099 conn(0x55f71fba16f0 msgr2=0x55f71fba8570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- 10.20.193.28:0/1511803099 shutdown_connections 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e17fff640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c0b0d00 0x7f5e0c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- 10.20.193.28:0/1511803099 wait complete. 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e17fff640 1 -- 10.20.193.28:0/2874443449 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5e280e0070 con 0x7f5e3810a900 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c0b0d00 0x7f5e0c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c0b0d00 0x7f5e0c0b31c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55f71fbaaeb0 tx=0x7f5e2c006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- start start 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 Processor -- start 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 0x55f71fbd4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fbaf560 0x55f71fbdb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f71faa20c0 con 0x55f71fba9e80 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f71fbc39c0 con 0x55f71fbaf560 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f71fbdb7a0 con 0x55f71fbaa7c0 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58162/0 (socket says 10.20.193.28:58162) 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 -- 10.20.193.28:0/2489559531 learned_addr learned my addr 10.20.193.28:0/2489559531 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 -- 10.20.193.28:0/2489559531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 msgr2=0x55f71fbd4290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 0x55f71fbd4290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 -- 10.20.193.28:0/2489559531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fbaf560 msgr2=0x55f71fbdb210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fbaf560 0x55f71fbdb210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 -- 10.20.193.28:0/2489559531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71fbcd490 con 0x55f71fba9e80 2026-02-20T03:33:35.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e36ffd640 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd3d50 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c002a00 tx=0x7f5e2c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed46d4dcd56a6468 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e00bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e00bfc640 1 -- 10.20.193.28:0/2489559531 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c011630 con 0x55f71fba9e80 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e00bfc640 1 -- 10.20.193.28:0/2489559531 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e2c011c70 con 0x55f71fba9e80 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e00bfc640 1 -- 10.20.193.28:0/2489559531 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c013de0 con 0x55f71fba9e80 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- 10.20.193.28:0/2489559531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f71fab6820 con 0x55f71fba9e80 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e00bfc640 1 -- 10.20.193.28:0/2489559531 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5e2c010380 con 0x55f71fba9e80 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e00bfc640 10 client.20631 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 10 client.20631 _ll_register_callbacks cb 0x55f71faa5ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- 10.20.193.28:0/2489559531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f71fb024e0 con 0x55f71fba9e80 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e00bfc640 1 -- 10.20.193.28:0/2489559531 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5e2c011e20 con 0x55f71fba9e80 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 10 client.20631 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:35.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- 10.20.193.28:0/2489559531 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f71fabb380 con 0x55f71fba9e80 2026-02-20T03:33:35.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e00bfc640 1 -- 10.20.193.28:0/2489559531 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f5e2c0117d0 con 0x55f71fba9e80 2026-02-20T03:33:35.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 10 client.20631 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:35.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 10 client.20631 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:35.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 20 client.20631 populate_metadata read hostname 'trial028' 2026-02-20T03:33:35.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f71fbdfbf0 0x55f71fbe2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 4 client.20631 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:35.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.600+0000 7f5e401fee00 1 -- 10.20.193.28:0/2489559531 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f71fa7cbd0 con 0x55f71fbdfbf0 2026-02-20T03:33:35.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.619+0000 7f5e367fc640 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f71fbdfbf0 0x55f71fbe2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:35.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.686+0000 7f5e00bfc640 10 client.20631 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:35.689 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.686+0000 7f5e367fc640 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f71fbdfbf0 0x55f71fbe2040 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1972c4e11627215 server_cookie=29f393bd450319f6 in_seq=0 out_seq=0 2026-02-20T03:33:35.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e00bfc640 1 -- 10.20.193.28:0/2489559531 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f71fa7cbd0 con 0x55f71fbdfbf0 2026-02-20T03:33:35.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e00bfc640 10 client.20631 handle_command_reply: tid=0 2026-02-20T03:33:35.703 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 client.20631 shutdown 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 -- 10.20.193.28:0/2489559531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 msgr2=0x55f71fbd3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd3d50 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c002a00 tx=0x7f5e2c0047e0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 -- 10.20.193.28:0/2489559531 shutdown_connections 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f71fbdfbf0 0x55f71fbe2040 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fbaf560 0x55f71fbdb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 0x55f71fbd4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 --2- 10.20.193.28:0/2489559531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd3d50 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e00bfc640 0 client.20631 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 -- 10.20.193.28:0/2489559531 >> 10.20.193.28:0/2489559531 conn(0x55f71fba16f0 msgr2=0x55f71fbb08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 -- 10.20.193.28:0/2489559531 shutdown_connections 2026-02-20T03:33:35.704 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 1 -- 10.20.193.28:0/2489559531 wait complete. 2026-02-20T03:33:35.705 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.700+0000 7f5e401fee00 20 client.20631 trim_cache size 0 max 16384 2026-02-20T03:33:35.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 Processor -- start 2026-02-20T03:33:35.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- start start 2026-02-20T03:33:35.713 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fba9e80 0x55f71fbb0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 0x55f71fbdb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbd2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc0126f0 con 0x55f71fbaf560 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc00ffc0 con 0x55f71fba9e80 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc00de10 con 0x55f71fbaa7c0 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e377fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbd2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e377fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbd2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58168/0 (socket says 10.20.193.28:58168) 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e377fe640 1 -- 10.20.193.28:0/4240496375 learned_addr learned my addr 10.20.193.28:0/4240496375 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e377fe640 1 -- 10.20.193.28:0/4240496375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 msgr2=0x55f71fbdb1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e377fe640 1 --2- 10.20.193.28:0/4240496375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 0x55f71fbdb1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.714 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e377fe640 1 -- 10.20.193.28:0/4240496375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fba9e80 msgr2=0x55f71fbb0950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e377fe640 1 --2- 10.20.193.28:0/4240496375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fba9e80 0x55f71fbb0950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e377fe640 1 -- 10.20.193.28:0/4240496375 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71fbcd2c0 con 0x55f71fbaf560 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e377fe640 1 --2- 10.20.193.28:0/4240496375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbd2a20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f5e280a3b80 tx=0x7f5e280a7520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bdc5ca131584c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e14bfd640 1 -- 10.20.193.28:0/4240496375 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e280a8450 con 0x55f71fbaf560 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e14bfd640 1 -- 10.20.193.28:0/4240496375 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e280ac100 con 0x55f71fbaf560 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e14bfd640 1 -- 10.20.193.28:0/4240496375 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e280b02a0 con 0x55f71fbaf560 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- 10.20.193.28:0/4240496375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 msgr2=0x55f71fbd2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- 10.20.193.28:0/4240496375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbd2a20 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f5e280a3b80 tx=0x7f5e280a7520 comp rx=0 tx=0).stop 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- 10.20.193.28:0/4240496375 shutdown_connections 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- 10.20.193.28:0/4240496375 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fbaf560 0x55f71fbd2a20 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- 10.20.193.28:0/4240496375 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaa7c0 0x55f71fbdb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.715 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- 10.20.193.28:0/4240496375 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fba9e80 0x55f71fbb0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.716 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- 10.20.193.28:0/4240496375 >> 10.20.193.28:0/4240496375 conn(0x55f71fba16f0 msgr2=0x55f71fbd2310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:35.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 22.03 MB/sec execute 186 sec latency 34168.408 ms 2026-02-20T03:33:35.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- 10.20.193.28:0/4240496375 shutdown_connections 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- 10.20.193.28:0/4240496375 wait complete. 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- start start 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 Processor -- start 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fbaa7c0 0x55f71fbd7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaf560 0x55f71fbda7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc00e480 con 0x55f71fba9e80 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc00f8f0 con 0x55f71fbaa7c0 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e401fee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc00eb50 con 0x55f71fbaf560 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e36ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:35.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e36ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:58174/0 (socket says 10.20.193.28:58174) 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e36ffd640 1 -- 10.20.193.28:0/831262800 learned_addr learned my addr 10.20.193.28:0/831262800 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e36ffd640 1 -- 10.20.193.28:0/831262800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaf560 msgr2=0x55f71fbda7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e36ffd640 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaf560 0x55f71fbda7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e36ffd640 1 -- 10.20.193.28:0/831262800 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fbaa7c0 msgr2=0x55f71fbd7920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e36ffd640 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fbaa7c0 0x55f71fbd7920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.706+0000 7f5e36ffd640 1 -- 10.20.193.28:0/831262800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71f85a690 con 0x55f71fba9e80 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e36ffd640 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd73e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009450 tx=0x7f5e2c011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e26565e1552db2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e00bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e00bfc640 1 -- 10.20.193.28:0/831262800 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c013bf0 con 0x55f71fba9e80 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e00bfc640 1 -- 10.20.193.28:0/831262800 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e2c017070 con 0x55f71fba9e80 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e00bfc640 1 -- 10.20.193.28:0/831262800 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c02ac70 con 0x55f71fba9e80 2026-02-20T03:33:35.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 1 -- 10.20.193.28:0/831262800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f71fabfb70 con 0x55f71fba9e80 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e00bfc640 1 -- 10.20.193.28:0/831262800 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5e2c020430 con 0x55f71fba9e80 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 10 client.20637 _ll_register_callbacks cb 0x7f5e2c0045c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 1 -- 10.20.193.28:0/831262800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e20033040 con 0x55f71fba9e80 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e00bfc640 1 -- 10.20.193.28:0/831262800 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5e2c02a470 con 0x55f71fba9e80 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 10 client.20637 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 1 -- 10.20.193.28:0/831262800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f71fbcdfb0 con 0x55f71fba9e80 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e00bfc640 1 -- 10.20.193.28:0/831262800 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f5e2c011630 con 0x55f71fba9e80 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 10 client.20637 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 10 client.20637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 20 client.20637 populate_metadata read hostname 'trial028' 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f71fc4b920 0x55f71fc4dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 4 client.20637 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:33:35.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.711+0000 7f5e401fee00 1 -- 10.20.193.28:0/831262800 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f71f8d3520 con 0x55f71fc4b920 2026-02-20T03:33:35.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.727+0000 7f5e367fc640 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f71fc4b920 0x55f71fc4dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:35.769 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.767+0000 7f5e367fc640 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f71fc4b920 0x55f71fc4dde0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=351244c8b07b76d7 server_cookie=7340c5bcf5ea9e19 in_seq=0 out_seq=0 2026-02-20T03:33:35.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.767+0000 7f5e00bfc640 10 client.20637 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:35.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.797+0000 7f5e00bfc640 1 -- 10.20.193.28:0/831262800 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f71f8d3520 con 0x55f71fc4b920 2026-02-20T03:33:35.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.797+0000 7f5e00bfc640 10 client.20637 handle_command_reply: tid=0 2026-02-20T03:33:35.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.797+0000 7f5e401fee00 1 client.20637 shutdown 2026-02-20T03:33:35.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 -- 10.20.193.28:0/831262800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 msgr2=0x55f71fbd73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:35.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd73e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009450 tx=0x7f5e2c011d20 comp rx=0 tx=0).stop 2026-02-20T03:33:35.801 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 -- 10.20.193.28:0/831262800 shutdown_connections 2026-02-20T03:33:35.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f71fc4b920 0x55f71fc4dde0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f71fbaf560 0x55f71fbda7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f71fbaa7c0 0x55f71fbd7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 --2- 10.20.193.28:0/831262800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f71fba9e80 0x55f71fbd73e0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e00bfc640 0 client.20637 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:35.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 -- 10.20.193.28:0/831262800 >> 10.20.193.28:0/831262800 conn(0x55f71fba16f0 msgr2=0x55f71fbd2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:35.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 -- 10.20.193.28:0/831262800 shutdown_connections 2026-02-20T03:33:35.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 1 -- 10.20.193.28:0/831262800 wait complete. 2026-02-20T03:33:35.802 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e401fee00 20 client.20637 trim_cache size 0 max 16384 2026-02-20T03:33:35.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:33:35.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:33:35.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:33:35.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:33:35.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 -- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c0b0d00 msgr2=0x7f5e0c0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:35.803 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c0b0d00 0x7f5e0c0b31c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x55f71fbaaeb0 tx=0x7f5e2c006cd0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 -- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3810a900 msgr2=0x7f5e381a8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:35.804 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3810a900 0x7f5e381a8640 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5e2800b990 tx=0x7f5e2800be60 comp rx=0 tx=0).stop 2026-02-20T03:33:35.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 -- 10.20.193.28:0/2874443449 shutdown_connections 2026-02-20T03:33:35.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5e0c0b0d00 0x7f5e0c0b31c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e3810a900 0x7f5e381a8640 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e38109e60 0x7f5e381a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 --2- 10.20.193.28:0/2874443449 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e38109490 0x7f5e381a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:35.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 -- 10.20.193.28:0/2874443449 >> 10.20.193.28:0/2874443449 conn(0x7f5e38077fe0 msgr2=0x7f5e3810d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:35.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 -- 10.20.193.28:0/2874443449 shutdown_connections 2026-02-20T03:33:35.815 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:35.798+0000 7f5e37fff640 1 -- 10.20.193.28:0/2874443449 wait complete. 2026-02-20T03:33:35.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:35 trial126 ceph-mon[38476]: pgmap v753: 129 pgs: 129 active+clean; 782 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 327 KiB/s rd, 10 MiB/s wr, 448 op/s 2026-02-20T03:33:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:35 trial177 ceph-mon[43181]: pgmap v753: 129 pgs: 129 active+clean; 782 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 327 KiB/s rd, 10 MiB/s wr, 448 op/s 2026-02-20T03:33:36.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 21.91 MB/sec execute 187 sec latency 35168.438 ms 2026-02-20T03:33:37.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 21.80 MB/sec execute 188 sec latency 36168.474 ms 2026-02-20T03:33:37.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:37 trial028 ceph-mon[38552]: pgmap v754: 129 pgs: 129 active+clean; 814 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 315 KiB/s rd, 11 MiB/s wr, 434 op/s 2026-02-20T03:33:37.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:37 trial126 ceph-mon[38476]: pgmap v754: 129 pgs: 129 active+clean; 814 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 315 KiB/s rd, 11 MiB/s wr, 434 op/s 2026-02-20T03:33:37.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:37 trial177 ceph-mon[43181]: pgmap v754: 129 pgs: 129 active+clean; 814 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 315 KiB/s rd, 11 MiB/s wr, 434 op/s 2026-02-20T03:33:38.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 21.68 MB/sec execute 189 sec latency 37168.511 ms 2026-02-20T03:33:38.808 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:38 trial028 ceph-mon[38552]: pgmap v755: 129 pgs: 129 active+clean; 816 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 306 KiB/s rd, 10 MiB/s wr, 333 op/s 2026-02-20T03:33:38.813 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:33:38.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:38 trial126 ceph-mon[38476]: pgmap v755: 129 pgs: 129 active+clean; 816 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 306 KiB/s rd, 10 MiB/s wr, 333 op/s 2026-02-20T03:33:38.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:38 trial177 ceph-mon[43181]: pgmap v755: 129 pgs: 129 active+clean; 816 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 306 KiB/s rd, 10 MiB/s wr, 333 op/s 2026-02-20T03:33:39.115 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:39.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 -- 10.20.193.28:0/3398950856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 msgr2=0x7faa54100d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:39.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 --2- 10.20.193.28:0/3398950856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 0x7faa54100d80 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7faa44009a30 tx=0x7faa4402f260 comp rx=0 tx=0).stop 2026-02-20T03:33:39.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 -- 10.20.193.28:0/3398950856 shutdown_connections 2026-02-20T03:33:39.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 --2- 10.20.193.28:0/3398950856 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa5410ef90 0x7faa54111410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 --2- 10.20.193.28:0/3398950856 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa54101350 0x7faa5410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 --2- 10.20.193.28:0/3398950856 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 0x7faa54100d80 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 -- 10.20.193.28:0/3398950856 >> 10.20.193.28:0/3398950856 conn(0x7faa540fc5f0 msgr2=0x7faa540fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:39.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 -- 10.20.193.28:0/3398950856 shutdown_connections 2026-02-20T03:33:39.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 -- 10.20.193.28:0/3398950856 wait complete. 2026-02-20T03:33:39.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 Processor -- start 2026-02-20T03:33:39.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 -- start start 2026-02-20T03:33:39.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 0x7faa5410e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa54101350 0x7faa5410b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa5410ef90 0x7faa5410bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa54114ce0 con 0x7faa541009a0 2026-02-20T03:33:39.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faa54114b60 con 0x7faa54101350 2026-02-20T03:33:39.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa5aff3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa54114e60 con 0x7faa5410ef90 2026-02-20T03:33:39.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.366+0000 7faa59ff1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 0x7faa5410e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:39.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa59ff1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 0x7faa5410e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50256/0 (socket says 10.20.193.28:50256) 2026-02-20T03:33:39.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa59ff1640 1 -- 10.20.193.28:0/2560029169 learned_addr learned my addr 10.20.193.28:0/2560029169 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:39.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa59ff1640 1 -- 10.20.193.28:0/2560029169 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa5410ef90 msgr2=0x7faa5410bf50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:39.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa59ff1640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa5410ef90 0x7faa5410bf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa59ff1640 1 -- 10.20.193.28:0/2560029169 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa54101350 msgr2=0x7faa5410b860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:39.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa59ff1640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa54101350 0x7faa5410b860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa59ff1640 1 -- 10.20.193.28:0/2560029169 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa541adb80 con 0x7faa541009a0 2026-02-20T03:33:39.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa59ff1640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 0x7faa5410e7b0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7faa44002fa0 tx=0x7faa44002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:39.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa42ffd640 1 -- 10.20.193.28:0/2560029169 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44004280 con 0x7faa541009a0 2026-02-20T03:33:39.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa42ffd640 1 -- 10.20.193.28:0/2560029169 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faa44004420 con 0x7faa541009a0 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa42ffd640 1 -- 10.20.193.28:0/2560029169 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44038cf0 con 0x7faa541009a0 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5aff3640 1 -- 10.20.193.28:0/2560029169 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa541add50 con 0x7faa541009a0 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5aff3640 1 -- 10.20.193.28:0/2560029169 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa541ae150 con 0x7faa541009a0 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa42ffd640 1 -- 10.20.193.28:0/2560029169 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7faa440047c0 con 0x7faa541009a0 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5e781e00 1 Processor -- start 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5e781e00 1 -- start start 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfc5000 0x56492cfc53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfbf630 0x56492cfbfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfcbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5e781e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56492cf3fe50 con 0x56492cfbffb0 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5e781e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56492cf129c0 con 0x56492cfc5000 2026-02-20T03:33:39.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa5e781e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56492cec0240 con 0x56492cfbf630 2026-02-20T03:33:39.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa597f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfcbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:39.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa597f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfcbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50260/0 (socket says 10.20.193.28:50260) 2026-02-20T03:33:39.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa597f0640 1 -- 10.20.193.28:0/2443486834 learned_addr learned my addr 10.20.193.28:0/2443486834 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:39.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa597f0640 1 -- 10.20.193.28:0/2443486834 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfbf630 msgr2=0x56492cfbfa70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:39.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.371+0000 7faa597f0640 1 --2- 10.20.193.28:0/2443486834 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfbf630 0x56492cfbfa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 -- 10.20.193.28:0/2443486834 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfc5000 msgr2=0x56492cfc53e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:39.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 --2- 10.20.193.28:0/2443486834 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfc5000 0x56492cfc53e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 -- 10.20.193.28:0/2443486834 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492ced3420 con 0x56492cfbffb0 2026-02-20T03:33:39.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa42ffd640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa300b0e20 0x7faa300b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 --2- 10.20.193.28:0/2443486834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfcbe30 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7faa480097b0 tx=0x7faa48009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c6e5c25d1357ed server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:39.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa42ffd640 1 -- 10.20.193.28:0/2560029169 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7faa44104990 con 0x7faa541009a0 2026-02-20T03:33:39.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5a7f2640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa300b0e20 0x7faa300b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:39.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa224e6640 1 -- 10.20.193.28:0/2443486834 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48016070 con 0x56492cfbffb0 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa224e6640 1 -- 10.20.193.28:0/2443486834 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faa48004480 con 0x56492cfbffb0 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa224e6640 1 -- 10.20.193.28:0/2443486834 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4800bc70 con 0x56492cfbffb0 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 -- 10.20.193.28:0/2443486834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 msgr2=0x56492cfcbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 --2- 10.20.193.28:0/2443486834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfcbe30 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7faa480097b0 tx=0x7faa48009c80 comp rx=0 tx=0).stop 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 -- 10.20.193.28:0/2443486834 shutdown_connections 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 --2- 10.20.193.28:0/2443486834 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfcbe30 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 --2- 10.20.193.28:0/2443486834 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfbf630 0x56492cfbfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 --2- 10.20.193.28:0/2443486834 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfc5000 0x56492cfc53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 -- 10.20.193.28:0/2443486834 >> 10.20.193.28:0/2443486834 conn(0x56492cf82290 msgr2=0x56492cfbdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5a7f2640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa300b0e20 0x7faa300b32e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7faa5000aab0 tx=0x7faa50009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 -- 10.20.193.28:0/2443486834 shutdown_connections 2026-02-20T03:33:39.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 -- 10.20.193.28:0/2443486834 wait complete. 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 -- start start 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 Processor -- start 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbf630 0x56492cfda1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfda6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfc5000 0x56492cfd88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56492cf0e8f0 con 0x56492cfbffb0 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56492cd00f50 con 0x56492cfbf630 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa5e781e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56492cfd8e70 con 0x56492cfc5000 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfda6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfda6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50276/0 (socket says 10.20.193.28:50276) 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 -- 10.20.193.28:0/1298982817 learned_addr learned my addr 10.20.193.28:0/1298982817 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:39.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 -- 10.20.193.28:0/1298982817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfc5000 msgr2=0x56492cfd88e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfc5000 0x56492cfd88e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 -- 10.20.193.28:0/1298982817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbf630 msgr2=0x56492cfda1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbf630 0x56492cfda1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.376+0000 7faa597f0640 1 -- 10.20.193.28:0/1298982817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492cfd1c10 con 0x56492cfbffb0 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.379+0000 7faa597f0640 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfda6e0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7faa48009370 tx=0x7faa48002ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b5b3f80ba053d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.379+0000 7faa0f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.379+0000 7faa0f7fe640 1 -- 10.20.193.28:0/1298982817 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4801e070 con 0x56492cfbffb0 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.379+0000 7faa0f7fe640 1 -- 10.20.193.28:0/1298982817 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faa4800bc70 con 0x56492cfbffb0 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.379+0000 7faa0f7fe640 1 -- 10.20.193.28:0/1298982817 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48016040 con 0x56492cfbffb0 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.379+0000 7faa5e781e00 1 -- 10.20.193.28:0/1298982817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56492cce3b40 con 0x56492cfbffb0 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.379+0000 7faa5e781e00 10 client.20649 _ll_register_callbacks cb 0x56492cf4bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:39.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.379+0000 7faa5e781e00 1 -- 10.20.193.28:0/1298982817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56492cf201a0 con 0x56492cfbffb0 2026-02-20T03:33:39.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa0f7fe640 1 -- 10.20.193.28:0/1298982817 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7faa4800be20 con 0x56492cfbffb0 2026-02-20T03:33:39.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa0f7fe640 1 -- 10.20.193.28:0/1298982817 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7faa48029050 con 0x56492cfbffb0 2026-02-20T03:33:39.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa5e781e00 10 client.20649 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:39.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa5e781e00 1 -- 10.20.193.28:0/1298982817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x56492cecd230 con 0x56492cfbffb0 2026-02-20T03:33:39.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa0f7fe640 1 -- 10.20.193.28:0/1298982817 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7faa4801a400 con 0x56492cfbffb0 2026-02-20T03:33:39.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa5e781e00 10 client.20649 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:39.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa5e781e00 10 client.20649 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:39.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa5e781e00 20 client.20649 populate_metadata read hostname 'trial028' 2026-02-20T03:33:39.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56492cfe8860 0x56492cfeac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa5e781e00 4 client.20649 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:39.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.382+0000 7faa5e781e00 1 -- 10.20.193.28:0/1298982817 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56492cf1a5b0 con 0x56492cfe8860 2026-02-20T03:33:39.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.393+0000 7faa59ff1640 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56492cfe8860 0x56492cfeac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:39.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.421+0000 7faa59ff1640 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56492cfe8860 0x56492cfeac50 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf882e7f0d2b8103 server_cookie=39bebfdf4d5393a3 in_seq=0 out_seq=0 2026-02-20T03:33:39.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.421+0000 7faa0f7fe640 10 client.20649 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:39.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa0f7fe640 1 -- 10.20.193.28:0/1298982817 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56492cf1a5b0 con 0x56492cfe8860 2026-02-20T03:33:39.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa0f7fe640 10 client.20649 handle_command_reply: tid=0 2026-02-20T03:33:39.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 client.20649 shutdown 2026-02-20T03:33:39.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 -- 10.20.193.28:0/1298982817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 msgr2=0x56492cfda6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:39.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfda6e0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7faa48009370 tx=0x7faa48002ca0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 -- 10.20.193.28:0/1298982817 shutdown_connections 2026-02-20T03:33:39.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56492cfe8860 0x56492cfeac50 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfc5000 0x56492cfd88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cfda6e0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1298982817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbf630 0x56492cfda1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 -- 10.20.193.28:0/1298982817 >> 10.20.193.28:0/1298982817 conn(0x56492cf82290 msgr2=0x56492cfbe440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:39.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa0f7fe640 0 client.20649 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:39.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 -- 10.20.193.28:0/1298982817 shutdown_connections 2026-02-20T03:33:39.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 1 -- 10.20.193.28:0/1298982817 wait complete. 2026-02-20T03:33:39.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.422+0000 7faa5e781e00 20 client.20649 trim_cache size 0 max 16384 2026-02-20T03:33:39.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa5e781e00 1 Processor -- start 2026-02-20T03:33:39.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa5e781e00 1 -- start start 2026-02-20T03:33:39.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbf630 0x56492cff03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cff0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfc5000 0x56492cfe4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa5e781e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa00012840 con 0x56492cfbffb0 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa5e781e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faa00010110 con 0x56492cfbf630 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa5e781e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa0000df60 con 0x56492cfc5000 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa597f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cff0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa597f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cff0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50284/0 (socket says 10.20.193.28:50284) 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.433+0000 7faa597f0640 1 -- 10.20.193.28:0/1499546862 learned_addr learned my addr 10.20.193.28:0/1499546862 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.434+0000 7faa597f0640 1 -- 10.20.193.28:0/1499546862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfc5000 msgr2=0x56492cfe4290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.434+0000 7faa597f0640 1 --2- 10.20.193.28:0/1499546862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfc5000 0x56492cfe4290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.434+0000 7faa597f0640 1 -- 10.20.193.28:0/1499546862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbf630 msgr2=0x56492cff03c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.434+0000 7faa597f0640 1 --2- 10.20.193.28:0/1499546862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbf630 0x56492cff03c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.434+0000 7faa597f0640 1 -- 10.20.193.28:0/1499546862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492cfc3290 con 0x56492cfbffb0 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.434+0000 7faa597f0640 1 --2- 10.20.193.28:0/1499546862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cff0900 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7faa48009ca0 tx=0x7faa4801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee5acc9d5d1ae83 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.434+0000 7faa21ce5640 1 -- 10.20.193.28:0/1499546862 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa48032070 con 0x56492cfbffb0 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.434+0000 7faa21ce5640 1 -- 10.20.193.28:0/1499546862 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56492cf201a0 con 0x56492cfbffb0 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.434+0000 7faa21ce5640 1 -- 10.20.193.28:0/1499546862 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4801e040 con 0x56492cfbffb0 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 -- 10.20.193.28:0/1499546862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 msgr2=0x56492cff0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1499546862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cff0900 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7faa48009ca0 tx=0x7faa4801b000 comp rx=0 tx=0).stop 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 -- 10.20.193.28:0/1499546862 shutdown_connections 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1499546862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfc5000 0x56492cfe4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1499546862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfbffb0 0x56492cff0900 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 --2- 10.20.193.28:0/1499546862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbf630 0x56492cff03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 -- 10.20.193.28:0/1499546862 >> 10.20.193.28:0/1499546862 conn(0x56492cf82290 msgr2=0x56492cfd70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:39.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 -- 10.20.193.28:0/1499546862 shutdown_connections 2026-02-20T03:33:39.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 -- 10.20.193.28:0/1499546862 wait complete. 2026-02-20T03:33:39.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 -- start start 2026-02-20T03:33:39.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 Processor -- start 2026-02-20T03:33:39.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfbf630 0x56492cfe4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbffb0 0x56492cfe4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfc5000 0x56492cfe2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faa0000e5d0 con 0x56492cfc5000 2026-02-20T03:33:39.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faa0000fa40 con 0x56492cfbffb0 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5e781e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faa0000eca0 con 0x56492cfbf630 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5a7f2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfc5000 0x56492cfe2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5a7f2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfc5000 0x56492cfe2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50288/0 (socket says 10.20.193.28:50288) 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5a7f2640 1 -- 10.20.193.28:0/16349082 learned_addr learned my addr 10.20.193.28:0/16349082 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5a7f2640 1 -- 10.20.193.28:0/16349082 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfbf630 msgr2=0x56492cfe4970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5a7f2640 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfbf630 0x56492cfe4970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.435+0000 7faa5a7f2640 1 -- 10.20.193.28:0/16349082 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbffb0 msgr2=0x56492cfe4eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5a7f2640 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbffb0 0x56492cfe4eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5a7f2640 1 -- 10.20.193.28:0/16349082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492cfd1a40 con 0x56492cfc5000 2026-02-20T03:33:39.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5a7f2640 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfc5000 0x56492cfe2e10 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7faa50004350 tx=0x7faa50004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ac74e74dada0ec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:39.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa0f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa0f7fe640 1 -- 10.20.193.28:0/16349082 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa50006e60 con 0x56492cfc5000 2026-02-20T03:33:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa0f7fe640 1 -- 10.20.193.28:0/16349082 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7faa5001f020 con 0x56492cfc5000 2026-02-20T03:33:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa0f7fe640 1 -- 10.20.193.28:0/16349082 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5001acb0 con 0x56492cfc5000 2026-02-20T03:33:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 1 -- 10.20.193.28:0/16349082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56492cbf1870 con 0x56492cfc5000 2026-02-20T03:33:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 10 client.20655 _ll_register_callbacks cb 0x7faa48014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 1 -- 10.20.193.28:0/16349082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56492cec4b00 con 0x56492cfc5000 2026-02-20T03:33:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa0f7fe640 1 -- 10.20.193.28:0/16349082 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7faa50024410 con 0x56492cfc5000 2026-02-20T03:33:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa0f7fe640 1 -- 10.20.193.28:0/16349082 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7faa5001e030 con 0x56492cfc5000 2026-02-20T03:33:39.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 10 client.20655 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:39.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 1 -- 10.20.193.28:0/16349082 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x56492ceb2440 con 0x56492cfc5000 2026-02-20T03:33:39.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa0f7fe640 1 -- 10.20.193.28:0/16349082 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7faa5001a430 con 0x56492cfc5000 2026-02-20T03:33:39.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 10 client.20655 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:39.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 10 client.20655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:39.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 20 client.20655 populate_metadata read hostname 'trial028' 2026-02-20T03:33:39.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56492d054320 0x56492d0567e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:39.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 4 client.20655 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:33:39.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.440+0000 7faa5e781e00 1 -- 10.20.193.28:0/16349082 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7faa48004480 con 0x56492d054320 2026-02-20T03:33:39.466 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.462+0000 7faa59ff1640 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56492d054320 0x56492d0567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:39.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.490+0000 7faa59ff1640 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56492d054320 0x56492d0567e0 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba6941abbf0acc1f server_cookie=20b8e7e4941d9a6a in_seq=0 out_seq=0 2026-02-20T03:33:39.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.490+0000 7faa0f7fe640 10 client.20655 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:39.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa0f7fe640 1 -- 10.20.193.28:0/16349082 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7faa48004480 con 0x56492d054320 2026-02-20T03:33:39.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa0f7fe640 10 client.20655 handle_command_reply: tid=0 2026-02-20T03:33:39.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa5e781e00 1 client.20655 shutdown 2026-02-20T03:33:39.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa5e781e00 1 -- 10.20.193.28:0/16349082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfc5000 msgr2=0x56492cfe2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:39.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa5e781e00 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfc5000 0x56492cfe2e10 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7faa50004350 tx=0x7faa50004bd0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa5e781e00 1 -- 10.20.193.28:0/16349082 shutdown_connections 2026-02-20T03:33:39.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa5e781e00 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56492d054320 0x56492d0567e0 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa5e781e00 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56492cfc5000 0x56492cfe2e10 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa5e781e00 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56492cfbffb0 0x56492cfe4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa5e781e00 1 --2- 10.20.193.28:0/16349082 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56492cfbf630 0x56492cfe4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa5e781e00 1 -- 10.20.193.28:0/16349082 >> 10.20.193.28:0/16349082 conn(0x56492cf82290 msgr2=0x56492cfda360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:39.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.504+0000 7faa0f7fe640 0 client.20655 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:39.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5e781e00 1 -- 10.20.193.28:0/16349082 shutdown_connections 2026-02-20T03:33:39.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5e781e00 1 -- 10.20.193.28:0/16349082 wait complete. 2026-02-20T03:33:39.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5e781e00 20 client.20655 trim_cache size 0 max 16384 2026-02-20T03:33:39.521 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:33:39.521 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:33:39.522 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:33:39.522 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:33:39.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 -- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa300b0e20 msgr2=0x7faa300b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:39.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa300b0e20 0x7faa300b32e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7faa5000aab0 tx=0x7faa50009250 comp rx=0 tx=0).stop 2026-02-20T03:33:39.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 -- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 msgr2=0x7faa5410e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:39.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 0x7faa5410e7b0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7faa44002fa0 tx=0x7faa44002910 comp rx=0 tx=0).stop 2026-02-20T03:33:39.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 -- 10.20.193.28:0/2560029169 shutdown_connections 2026-02-20T03:33:39.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faa300b0e20 0x7faa300b32e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7faa5410ef90 0x7faa5410bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7faa54101350 0x7faa5410b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 --2- 10.20.193.28:0/2560029169 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7faa541009a0 0x7faa5410e7b0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:39.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 -- 10.20.193.28:0/2560029169 >> 10.20.193.28:0/2560029169 conn(0x7faa540fc5f0 msgr2=0x7faa540fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:39.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 -- 10.20.193.28:0/2560029169 shutdown_connections 2026-02-20T03:33:39.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:39.505+0000 7faa5aff3640 1 -- 10.20.193.28:0/2560029169 wait complete. 2026-02-20T03:33:39.685 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:33:39.686 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:33:39.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 21.57 MB/sec execute 190 sec latency 38168.550 ms 2026-02-20T03:33:40.009 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:40.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- 10.20.193.28:0/3905095344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8144075950 msgr2=0x7f8144075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:40.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 --2- 10.20.193.28:0/3905095344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8144075950 0x7f8144075d90 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8134009a30 tx=0x7f813402f2f0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- 10.20.193.28:0/3905095344 shutdown_connections 2026-02-20T03:33:40.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 --2- 10.20.193.28:0/3905095344 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f81441134d0 0x7f8144115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 --2- 10.20.193.28:0/3905095344 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8144075950 0x7f8144075d90 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 --2- 10.20.193.28:0/3905095344 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81441065d0 0x7f8144075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- 10.20.193.28:0/3905095344 >> 10.20.193.28:0/3905095344 conn(0x7f81440fe440 msgr2=0x7f8144100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:40.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- 10.20.193.28:0/3905095344 shutdown_connections 2026-02-20T03:33:40.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- 10.20.193.28:0/3905095344 wait complete. 2026-02-20T03:33:40.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 Processor -- start 2026-02-20T03:33:40.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- start start 2026-02-20T03:33:40.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8144075950 0x7f81441a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:40.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81441065d0 0x7f81441a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:40.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81441134d0 0x7f81441a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f81441191d0 con 0x7f81441134d0 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8144119050 con 0x7f81441065d0 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8144119350 con 0x7f8144075950 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8143fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81441134d0 0x7f81441a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8143fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81441134d0 0x7f81441a5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50314/0 (socket says 10.20.193.28:50314) 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8143fff640 1 -- 10.20.193.28:0/2730234013 learned_addr learned my addr 10.20.193.28:0/2730234013 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8143fff640 1 -- 10.20.193.28:0/2730234013 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8144075950 msgr2=0x7f81441a16f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8143fff640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8144075950 0x7f81441a16f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8143fff640 1 -- 10.20.193.28:0/2730234013 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81441065d0 msgr2=0x7f81441a1c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8143fff640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81441065d0 0x7f81441a1c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8143fff640 1 -- 10.20.193.28:0/2730234013 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81441a6740 con 0x7f81441134d0 2026-02-20T03:33:40.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8143fff640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81441134d0 0x7f81441a5fc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f813800b990 tx=0x7f813800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:40.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8140ff9640 1 -- 10.20.193.28:0/2730234013 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138006e60 con 0x7f81441134d0 2026-02-20T03:33:40.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8140ff9640 1 -- 10.20.193.28:0/2730234013 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8138010070 con 0x7f81441134d0 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8140ff9640 1 -- 10.20.193.28:0/2730234013 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138004800 con 0x7f81441134d0 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81441a6a30 con 0x7f81441134d0 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81441ae270 con 0x7f81441134d0 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.265+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8144075e10 con 0x7f81441134d0 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.271+0000 7f8140ff9640 1 -- 10.20.193.28:0/2730234013 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f813800c790 con 0x7f81441134d0 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.272+0000 7f8140ff9640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81180b0e20 0x7f81180b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.272+0000 7f8140ff9640 1 -- 10.20.193.28:0/2730234013 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f81380e0410 con 0x7f81441134d0 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.273+0000 7f81437fe640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81180b0e20 0x7f81180b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.273+0000 7f81437fe640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81180b0e20 0x7f81180b32e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8130009770 tx=0x7f8130006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:40.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.273+0000 7f8140ff9640 1 -- 10.20.193.28:0/2730234013 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f81380a87f0 con 0x7f81441134d0 2026-02-20T03:33:40.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.389+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81441ae500 con 0x7f81441134d0 2026-02-20T03:33:40.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.390+0000 7f8140ff9640 1 -- 10.20.193.28:0/2730234013 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11918 (secure 0 0 0) 0x7f81380ac4a0 con 0x7f81441134d0 2026-02-20T03:33:40.402 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:33:40.402 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":44,"btime":"2026-02-20T03:32:41:319918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:32:41.319912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:33:40.402 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 44 2026-02-20T03:33:40.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81180b0e20 msgr2=0x7f81180b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:40.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81180b0e20 0x7f81180b32e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f8130009770 tx=0x7f8130006cd0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81441134d0 msgr2=0x7f81441a5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:40.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81441134d0 0x7f81441a5fc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f813800b990 tx=0x7f813800be60 comp rx=0 tx=0).stop 2026-02-20T03:33:40.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 shutdown_connections 2026-02-20T03:33:40.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81180b0e20 0x7f81180b32e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f81441134d0 0x7f81441a5fc0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f81441065d0 0x7f81441a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 --2- 10.20.193.28:0/2730234013 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8144075950 0x7f81441a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:40.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 >> 10.20.193.28:0/2730234013 conn(0x7f81440fe440 msgr2=0x7f8144114ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:40.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 shutdown_connections 2026-02-20T03:33:40.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:40.392+0000 7f8148f4f640 1 -- 10.20.193.28:0/2730234013 wait complete. 2026-02-20T03:33:40.561 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:33:40.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 21.45 MB/sec execute 191 sec latency 39168.591 ms 2026-02-20T03:33:40.895 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:41.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- 10.20.193.28:0/3799507148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41134d0 msgr2=0x7f5ad4115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:41.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/3799507148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41134d0 0x7f5ad4115900 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800b0a0 tx=0x7f5ac802f4e0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- 10.20.193.28:0/3799507148 shutdown_connections 2026-02-20T03:33:41.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/3799507148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41134d0 0x7f5ad4115900 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/3799507148 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ad4075950 0x7f5ad4075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/3799507148 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ad41065d0 0x7f5ad4075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- 10.20.193.28:0/3799507148 >> 10.20.193.28:0/3799507148 conn(0x7f5ad40fe440 msgr2=0x7f5ad4100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:41.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- 10.20.193.28:0/3799507148 shutdown_connections 2026-02-20T03:33:41.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- 10.20.193.28:0/3799507148 wait complete. 2026-02-20T03:33:41.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 Processor -- start 2026-02-20T03:33:41.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- start start 2026-02-20T03:33:41.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ad4075950 0x7f5ad41a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41065d0 0x7f5ad41a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ad41134d0 0x7f5ad41a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad41191d0 con 0x7f5ad41065d0 2026-02-20T03:33:41.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad4119050 con 0x7f5ad4075950 2026-02-20T03:33:41.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad4119350 con 0x7f5ad41134d0 2026-02-20T03:33:41.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5ad9dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41065d0 0x7f5ad41a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:41.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5ad9dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41065d0 0x7f5ad41a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50332/0 (socket says 10.20.193.28:50332) 2026-02-20T03:33:41.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/2588791125 learned_addr learned my addr 10.20.193.28:0/2588791125 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:41.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/2588791125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ad41134d0 msgr2=0x7f5ad41a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:41.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ad41134d0 0x7f5ad41a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/2588791125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ad4075950 msgr2=0x7f5ad41a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:41.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ad4075950 0x7f5ad41a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/2588791125 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad41a66c0 con 0x7f5ad41065d0 2026-02-20T03:33:41.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41065d0 0x7f5ad41a1bb0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00b570 tx=0x7f5acc00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:41.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5abf7fe640 1 -- 10.20.193.28:0/2588791125 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc013020 con 0x7f5ad41065d0 2026-02-20T03:33:41.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- 10.20.193.28:0/2588791125 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad41a69b0 con 0x7f5ad41065d0 2026-02-20T03:33:41.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5adb5d3640 1 -- 10.20.193.28:0/2588791125 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad41ae1f0 con 0x7f5ad41065d0 2026-02-20T03:33:41.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5abf7fe640 1 -- 10.20.193.28:0/2588791125 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5acc004480 con 0x7f5ad41065d0 2026-02-20T03:33:41.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.161+0000 7f5abf7fe640 1 -- 10.20.193.28:0/2588791125 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00fae0 con 0x7f5ad41065d0 2026-02-20T03:33:41.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.167+0000 7f5abf7fe640 1 -- 10.20.193.28:0/2588791125 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5acc002780 con 0x7f5ad41065d0 2026-02-20T03:33:41.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.167+0000 7f5abf7fe640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ab00b0e20 0x7f5ab00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.167+0000 7f5abf7fe640 1 -- 10.20.193.28:0/2588791125 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5acc0e0520 con 0x7f5ad41065d0 2026-02-20T03:33:41.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.167+0000 7f5ada5d1640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ab00b0e20 0x7f5ab00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:41.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5aded61e00 1 Processor -- start 2026-02-20T03:33:41.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5ada5d1640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ab00b0e20 0x7f5ab00b32e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009770 tx=0x7f5ac0006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:41.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5aded61e00 1 -- start start 2026-02-20T03:33:41.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b56fb0 0x55d562b57390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b515e0 0x55d562b51a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b5dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5aded61e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d562ad1e00 con 0x55d562b51f60 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5aded61e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d562aa4970 con 0x55d562b515e0 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5aded61e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d562a521f0 con 0x55d562b56fb0 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5adadd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b5dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5adadd2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b5dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50344/0 (socket says 10.20.193.28:50344) 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5adadd2640 1 -- 10.20.193.28:0/269063335 learned_addr learned my addr 10.20.193.28:0/269063335 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5adadd2640 1 -- 10.20.193.28:0/269063335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b56fb0 msgr2=0x55d562b57390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5adadd2640 1 --2- 10.20.193.28:0/269063335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b56fb0 0x55d562b57390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5adadd2640 1 -- 10.20.193.28:0/269063335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b515e0 msgr2=0x55d562b51a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5adadd2640 1 --2- 10.20.193.28:0/269063335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b515e0 0x55d562b51a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5adadd2640 1 -- 10.20.193.28:0/269063335 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d562a653d0 con 0x55d562b51f60 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5adadd2640 1 --2- 10.20.193.28:0/269063335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b5dde0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c090 tx=0x7f5ac8009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9af5369c4b53a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5abccf3640 1 -- 10.20.193.28:0/269063335 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80093a0 con 0x55d562b51f60 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5abccf3640 1 -- 10.20.193.28:0/269063335 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5ac8004070 con 0x55d562b51f60 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.172+0000 7f5abccf3640 1 -- 10.20.193.28:0/269063335 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8007700 con 0x55d562b51f60 2026-02-20T03:33:41.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- 10.20.193.28:0/269063335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 msgr2=0x55d562b5dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:41.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 --2- 10.20.193.28:0/269063335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b5dde0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c090 tx=0x7f5ac8009d70 comp rx=0 tx=0).stop 2026-02-20T03:33:41.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- 10.20.193.28:0/269063335 shutdown_connections 2026-02-20T03:33:41.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 --2- 10.20.193.28:0/269063335 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b5dde0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 --2- 10.20.193.28:0/269063335 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b515e0 0x55d562b51a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 --2- 10.20.193.28:0/269063335 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b56fb0 0x55d562b57390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- 10.20.193.28:0/269063335 >> 10.20.193.28:0/269063335 conn(0x55d562b14240 msgr2=0x55d562b4fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:41.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- 10.20.193.28:0/269063335 shutdown_connections 2026-02-20T03:33:41.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- 10.20.193.28:0/269063335 wait complete. 2026-02-20T03:33:41.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- start start 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 Processor -- start 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b515e0 0x55d562b6bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b6c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b56fb0 0x55d562b6a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d562aa08a0 con 0x55d562b51f60 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d562892f50 con 0x55d562b515e0 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d562b6ab20 con 0x55d562b56fb0 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5ad9dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b6c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5ad9dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b6c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50346/0 (socket says 10.20.193.28:50346) 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/285824192 learned_addr learned my addr 10.20.193.28:0/285824192 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/285824192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b56fb0 msgr2=0x55d562b6a3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b56fb0 0x55d562b6a3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/285824192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b515e0 msgr2=0x55d562b6bc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b515e0 0x55d562b6bc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/285824192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d562b63ad0 con 0x55d562b51f60 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b6c1a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0a81f0 tx=0x7f5acc0a79d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b97e1e51280cf55 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5a87fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5a87fff640 1 -- 10.20.193.28:0/285824192 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0a8960 con 0x55d562b51f60 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5a87fff640 1 -- 10.20.193.28:0/285824192 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5acc0ac610 con 0x55d562b51f60 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5aded61e00 1 -- 10.20.193.28:0/285824192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d562875b40 con 0x55d562b51f60 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.177+0000 7f5a87fff640 1 -- 10.20.193.28:0/285824192 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0a6f40 con 0x55d562b51f60 2026-02-20T03:33:41.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5a87fff640 1 -- 10.20.193.28:0/285824192 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5acc094520 con 0x55d562b51f60 2026-02-20T03:33:41.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5a87fff640 10 client.20673 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:33:41.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 10 client.20673 _ll_register_callbacks cb 0x55d562addeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:41.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 1 -- 10.20.193.28:0/285824192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d562ab2150 con 0x55d562b51f60 2026-02-20T03:33:41.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5a87fff640 1 -- 10.20.193.28:0/285824192 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5acc0ac400 con 0x55d562b51f60 2026-02-20T03:33:41.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 10 client.20673 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:41.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 1 -- 10.20.193.28:0/285824192 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55d562a5f1e0 con 0x55d562b51f60 2026-02-20T03:33:41.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5a87fff640 1 -- 10.20.193.28:0/285824192 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f5acc094130 con 0x55d562b51f60 2026-02-20T03:33:41.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 10 client.20673 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:41.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 10 client.20673 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:33:41.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 20 client.20673 populate_metadata read hostname 'trial028' 2026-02-20T03:33:41.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d562b7a400 0x55d562b7c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 4 client.20673 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:41.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.181+0000 7f5aded61e00 1 -- 10.20.193.28:0/285824192 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d562aac560 con 0x55d562b7a400 2026-02-20T03:33:41.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.195+0000 7f5ada5d1640 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d562b7a400 0x55d562b7c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:41.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.223+0000 7f5ada5d1640 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d562b7a400 0x55d562b7c810 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a6a86f0cdd863740 server_cookie=c5246f84a19c6482 in_seq=0 out_seq=0 2026-02-20T03:33:41.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.223+0000 7f5a87fff640 10 client.20673 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:33:41.239 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5a87fff640 1 -- 10.20.193.28:0/285824192 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d562aac560 con 0x55d562b7a400 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5a87fff640 10 client.20673 handle_command_reply: tid=0 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 client.20673 shutdown 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 -- 10.20.193.28:0/285824192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 msgr2=0x55d562b6c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b6c1a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0a81f0 tx=0x7f5acc0a79d0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 -- 10.20.193.28:0/285824192 shutdown_connections 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b56fb0 0x55d562b6a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d562b7a400 0x55d562b7c810 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b6c1a0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 --2- 10.20.193.28:0/285824192 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b515e0 0x55d562b6bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 -- 10.20.193.28:0/285824192 >> 10.20.193.28:0/285824192 conn(0x55d562b14240 msgr2=0x55d562b503f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:41.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5a87fff640 0 client.20673 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:33:41.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 -- 10.20.193.28:0/285824192 shutdown_connections 2026-02-20T03:33:41.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 1 -- 10.20.193.28:0/285824192 wait complete. 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.237+0000 7f5aded61e00 20 client.20673 trim_cache size 0 max 16384 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.247+0000 7f5aded61e00 1 Processor -- start 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5aded61e00 1 -- start start 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b515e0 0x55d562b54a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b678f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b56fb0 0x55d562b67e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5aded61e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c012650 con 0x55d562b51f60 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5aded61e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c00ff20 con 0x55d562b56fb0 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5aded61e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c00dd70 con 0x55d562b515e0 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5ad9dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5ad9dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b678f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50350/0 (socket says 10.20.193.28:50350) 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/2000788444 learned_addr learned my addr 10.20.193.28:0/2000788444 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/2000788444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b515e0 msgr2=0x55d562b54a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/2000788444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b515e0 0x55d562b54a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/2000788444 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b56fb0 msgr2=0x55d562b67e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/2000788444 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b56fb0 0x55d562b67e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.248+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/2000788444 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d562b6a710 con 0x55d562b51f60 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.249+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/2000788444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b678f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0a4090 tx=0x7f5acc090070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8979194eb521e9b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.249+0000 7f5aa24e6640 1 -- 10.20.193.28:0/2000788444 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0a8960 con 0x55d562b51f60 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.249+0000 7f5aa24e6640 1 -- 10.20.193.28:0/2000788444 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d562ab2150 con 0x55d562b51f60 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.249+0000 7f5aded61e00 1 -- 10.20.193.28:0/2000788444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 msgr2=0x55d562b678f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.249+0000 7f5aded61e00 1 --2- 10.20.193.28:0/2000788444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b678f0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0a4090 tx=0x7f5acc090070 comp rx=0 tx=0).stop 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.250+0000 7f5aded61e00 1 -- 10.20.193.28:0/2000788444 shutdown_connections 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.250+0000 7f5aded61e00 1 --2- 10.20.193.28:0/2000788444 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b56fb0 0x55d562b67e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.250+0000 7f5aded61e00 1 --2- 10.20.193.28:0/2000788444 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b678f0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.250+0000 7f5aded61e00 1 --2- 10.20.193.28:0/2000788444 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b515e0 0x55d562b54a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.250+0000 7f5aded61e00 1 -- 10.20.193.28:0/2000788444 >> 10.20.193.28:0/2000788444 conn(0x55d562b14240 msgr2=0x55d562b69420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:41.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.250+0000 7f5aded61e00 1 -- 10.20.193.28:0/2000788444 shutdown_connections 2026-02-20T03:33:41.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.250+0000 7f5aded61e00 1 -- 10.20.193.28:0/2000788444 wait complete. 2026-02-20T03:33:41.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.250+0000 7f5aded61e00 1 -- start start 2026-02-20T03:33:41.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5aded61e00 1 Processor -- start 2026-02-20T03:33:41.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b515e0 0x55d562b73780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b73cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5aded61e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b56fb0 0x55d562b75cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5aded61e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c00e3e0 con 0x55d562b51f60 2026-02-20T03:33:41.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5aded61e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c00f850 con 0x55d562b56fb0 2026-02-20T03:33:41.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5aded61e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c00eab0 con 0x55d562b515e0 2026-02-20T03:33:41.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5ad9dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b73cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:41.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5ad9dd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b73cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50364/0 (socket says 10.20.193.28:50364) 2026-02-20T03:33:41.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/631885663 learned_addr learned my addr 10.20.193.28:0/631885663 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:41.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/631885663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b515e0 msgr2=0x55d562b73780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b515e0 0x55d562b73780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/631885663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b56fb0 msgr2=0x55d562b75cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b56fb0 0x55d562b75cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5ad9dd0640 1 -- 10.20.193.28:0/631885663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d562b63900 con 0x55d562b51f60 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5a87fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.251+0000 7f5ad9dd0640 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b73cc0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0b14e0 tx=0x7f5acc0e04b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1badfa3487538eb8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.256+0000 7f5a87fff640 1 -- 10.20.193.28:0/631885663 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0b6070 con 0x55d562b51f60 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.256+0000 7f5aded61e00 1 -- 10.20.193.28:0/631885663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d562783870 con 0x55d562b51f60 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.256+0000 7f5aded61e00 10 client.20679 _ll_register_callbacks cb 0x7f5acc004630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.256+0000 7f5aded61e00 1 -- 10.20.193.28:0/631885663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d562a56ab0 con 0x55d562b51f60 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.256+0000 7f5a87fff640 1 -- 10.20.193.28:0/631885663 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d562a56ab0 con 0x55d562b51f60 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.256+0000 7f5a87fff640 1 -- 10.20.193.28:0/631885663 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0ac120 con 0x55d562b51f60 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5a87fff640 1 -- 10.20.193.28:0/631885663 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5acc0ac2c0 con 0x55d562b51f60 2026-02-20T03:33:41.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5a87fff640 1 -- 10.20.193.28:0/631885663 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f5acc005a70 con 0x55d562b51f60 2026-02-20T03:33:41.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5aded61e00 10 client.20679 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:41.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5aded61e00 1 -- 10.20.193.28:0/631885663 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55d562a443f0 con 0x55d562b51f60 2026-02-20T03:33:41.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5a87fff640 1 -- 10.20.193.28:0/631885663 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f5acc005c10 con 0x55d562b51f60 2026-02-20T03:33:41.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5aded61e00 10 client.20679 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:41.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5aded61e00 10 client.20679 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:33:41.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5aded61e00 20 client.20679 populate_metadata read hostname 'trial028' 2026-02-20T03:33:41.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5aded61e00 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d562be6990 0x55d562be8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:41.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5aded61e00 4 client.20679 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:33:41.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.257+0000 7f5aded61e00 1 -- 10.20.193.28:0/631885663 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d562ab2150 con 0x55d562be6990 2026-02-20T03:33:41.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.265+0000 7f5ada5d1640 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d562be6990 0x55d562be8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:41.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.293+0000 7f5ada5d1640 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d562be6990 0x55d562be8e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=21e3425116a4585 server_cookie=3713a582f9609ca9 in_seq=0 out_seq=0 2026-02-20T03:33:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.293+0000 7f5a87fff640 10 client.20679 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:33:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.307+0000 7f5a87fff640 1 -- 10.20.193.28:0/631885663 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d562ab2150 con 0x55d562be6990 2026-02-20T03:33:41.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.307+0000 7f5a87fff640 10 client.20679 handle_command_reply: tid=0 2026-02-20T03:33:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.307+0000 7f5aded61e00 1 client.20679 shutdown 2026-02-20T03:33:41.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.307+0000 7f5aded61e00 1 -- 10.20.193.28:0/631885663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 msgr2=0x55d562b73cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.307+0000 7f5aded61e00 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b73cc0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0b14e0 tx=0x7f5acc0e04b0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5aded61e00 1 -- 10.20.193.28:0/631885663 shutdown_connections 2026-02-20T03:33:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5aded61e00 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d562b56fb0 0x55d562b75cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5aded61e00 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55d562be6990 0x55d562be8e20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5aded61e00 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d562b51f60 0x55d562b73cc0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5aded61e00 1 --2- 10.20.193.28:0/631885663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d562b515e0 0x55d562b73780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5aded61e00 1 -- 10.20.193.28:0/631885663 >> 10.20.193.28:0/631885663 conn(0x55d562b14240 msgr2=0x55d562b7a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:41.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5a87fff640 0 client.20679 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5aded61e00 1 -- 10.20.193.28:0/631885663 shutdown_connections 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5aded61e00 1 -- 10.20.193.28:0/631885663 wait complete. 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5aded61e00 20 client.20679 trim_cache size 0 max 16384 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 -- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ab00b0e20 msgr2=0x7f5ab00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ab00b0e20 0x7f5ab00b32e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009770 tx=0x7f5ac0006cd0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 -- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41065d0 msgr2=0x7f5ad41a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41065d0 0x7f5ad41a1bb0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00b570 tx=0x7f5acc00ba40 comp rx=0 tx=0).stop 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 -- 10.20.193.28:0/2588791125 shutdown_connections 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5ab00b0e20 0x7f5ab00b32e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5ad41134d0 0x7f5ad41a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5ad41065d0 0x7f5ad41a1bb0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 --2- 10.20.193.28:0/2588791125 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5ad4075950 0x7f5ad41a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 -- 10.20.193.28:0/2588791125 >> 10.20.193.28:0/2588791125 conn(0x7f5ad40fe440 msgr2=0x7f5ad4114cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 -- 10.20.193.28:0/2588791125 shutdown_connections 2026-02-20T03:33:41.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:41.308+0000 7f5adb5d3640 1 -- 10.20.193.28:0/2588791125 wait complete. 2026-02-20T03:33:41.466 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:33:41.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:41 trial028 ceph-mon[38552]: pgmap v756: 129 pgs: 129 active+clean; 814 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 8.7 MiB/s wr, 231 op/s 2026-02-20T03:33:41.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:41 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2730234013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:33:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:41 trial126 ceph-mon[38476]: pgmap v756: 129 pgs: 129 active+clean; 814 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 8.7 MiB/s wr, 231 op/s 2026-02-20T03:33:41.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:41 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2730234013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:33:41.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 21.34 MB/sec execute 192 sec latency 40168.628 ms 2026-02-20T03:33:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:41 trial177 ceph-mon[43181]: pgmap v756: 129 pgs: 129 active+clean; 814 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 8.7 MiB/s wr, 231 op/s 2026-02-20T03:33:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:41 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2730234013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:33:41.828 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:42.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- 10.20.193.28:0/4223039027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 msgr2=0x7fc5a810e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:42.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/4223039027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 0x7fc5a810e910 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fc598009a30 tx=0x7fc59802f260 comp rx=0 tx=0).stop 2026-02-20T03:33:42.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- 10.20.193.28:0/4223039027 shutdown_connections 2026-02-20T03:33:42.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/4223039027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 0x7fc5a810e910 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/4223039027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5a8074ca0 0x7fc5a810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/4223039027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5a8074380 0x7fc5a8074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- 10.20.193.28:0/4223039027 >> 10.20.193.28:0/4223039027 conn(0x7fc5a806efb0 msgr2=0x7fc5a806f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:42.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- 10.20.193.28:0/4223039027 shutdown_connections 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- 10.20.193.28:0/4223039027 wait complete. 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 Processor -- start 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- start start 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5a8074380 0x7fc5a811d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5a8074ca0 0x7fc5a811a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 0x7fc5a811af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a8116ed0 con 0x7fc5a810e480 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a8116d50 con 0x7fc5a8074380 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a8117050 con 0x7fc5a8074ca0 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 0x7fc5a811af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:42.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 0x7fc5a811af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50384/0 (socket says 10.20.193.28:50384) 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a77fe640 1 -- 10.20.193.28:0/1890003181 learned_addr learned my addr 10.20.193.28:0/1890003181 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a77fe640 1 -- 10.20.193.28:0/1890003181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5a8074ca0 msgr2=0x7fc5a811a880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a77fe640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5a8074ca0 0x7fc5a811a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a77fe640 1 -- 10.20.193.28:0/1890003181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5a8074380 msgr2=0x7fc5a811d780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a77fe640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5a8074380 0x7fc5a811d780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a77fe640 1 -- 10.20.193.28:0/1890003181 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a81b64a0 con 0x7fc5a810e480 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a77fe640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 0x7fc5a811af40 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fc598009a00 tx=0x7fc598002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc587fff640 1 -- 10.20.193.28:0/1890003181 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598002a00 con 0x7fc5a810e480 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc587fff640 1 -- 10.20.193.28:0/1890003181 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc5980047c0 con 0x7fc5a810e480 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc587fff640 1 -- 10.20.193.28:0/1890003181 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598038d30 con 0x7fc5a810e480 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- 10.20.193.28:0/1890003181 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a81b6670 con 0x7fc5a810e480 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.108+0000 7fc5a7fff640 1 -- 10.20.193.28:0/1890003181 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a81b6b30 con 0x7fc5a810e480 2026-02-20T03:33:42.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.114+0000 7fc587fff640 1 -- 10.20.193.28:0/1890003181 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc598004280 con 0x7fc5a810e480 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 Processor -- start 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc587fff640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc57c0b0e20 0x7fc57c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc587fff640 1 -- 10.20.193.28:0/1890003181 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc598105150 con 0x7fc5a810e480 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 -- start start 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a131c3c0 0x55f1a131c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1316e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 0x55f1a13231f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f1a1285e00 con 0x55f1a13169f0 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f1a1258970 con 0x55f1a1317370 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f1a12061f0 con 0x55f1a131c3c0 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc57c0b0e20 0x7fc57c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:42.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1316e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:42.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1316e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50398/0 (socket says 10.20.193.28:50398) 2026-02-20T03:33:42.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 -- 10.20.193.28:0/414827786 learned_addr learned my addr 10.20.193.28:0/414827786 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc57c0b0e20 0x7fc57c0b32e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc590006e50 tx=0x7fc590009dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 -- 10.20.193.28:0/414827786 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a131c3c0 msgr2=0x55f1a131c7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 --2- 10.20.193.28:0/414827786 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a131c3c0 0x55f1a131c7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 -- 10.20.193.28:0/414827786 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 msgr2=0x55f1a13231f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 --2- 10.20.193.28:0/414827786 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 0x55f1a13231f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 -- 10.20.193.28:0/414827786 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a12193d0 con 0x55f1a13169f0 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5a67fc640 1 --2- 10.20.193.28:0/414827786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1316e30 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fc590034fd0 tx=0x7fc590004000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bea99201e62a0b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5737fe640 1 -- 10.20.193.28:0/414827786 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590032c00 con 0x55f1a13169f0 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5737fe640 1 -- 10.20.193.28:0/414827786 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc590041070 con 0x55f1a13169f0 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5737fe640 1 -- 10.20.193.28:0/414827786 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590034390 con 0x55f1a13169f0 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/414827786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 msgr2=0x55f1a1316e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/414827786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1316e30 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fc590034fd0 tx=0x7fc590004000 comp rx=0 tx=0).stop 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/414827786 shutdown_connections 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/414827786 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 0x55f1a13231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/414827786 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1316e30 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/414827786 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a131c3c0 0x55f1a131c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/414827786 >> 10.20.193.28:0/414827786 conn(0x55f1a12c8240 msgr2=0x55f1a1303ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/414827786 shutdown_connections 2026-02-20T03:33:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.116+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/414827786 wait complete. 2026-02-20T03:33:42.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.121+0000 7fc5af9e5e00 1 -- start start 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.121+0000 7fc5af9e5e00 1 Processor -- start 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.121+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a13169f0 0x55f1a131fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.121+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 0x55f1a1320430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.121+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a131e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.121+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f1a12548a0 con 0x55f1a131c3c0 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.121+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f1a1046f50 con 0x55f1a1317370 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.121+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f1a131edb0 con 0x55f1a13169f0 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a131e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a131e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50400/0 (socket says 10.20.193.28:50400) 2026-02-20T03:33:42.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5a77fe640 1 -- 10.20.193.28:0/2448940906 learned_addr learned my addr 10.20.193.28:0/2448940906 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5a77fe640 1 -- 10.20.193.28:0/2448940906 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a13169f0 msgr2=0x55f1a131fef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5a77fe640 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a13169f0 0x55f1a131fef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5a77fe640 1 -- 10.20.193.28:0/2448940906 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 msgr2=0x55f1a1320430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5a77fe640 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 0x55f1a1320430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5a77fe640 1 -- 10.20.193.28:0/2448940906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a1311300 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5a77fe640 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a131e630 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fc5980ccb90 tx=0x7fc5980ccd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb86f438e41094e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc570ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc570ff9640 1 -- 10.20.193.28:0/2448940906 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598048070 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc570ff9640 1 -- 10.20.193.28:0/2448940906 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc598033070 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc570ff9640 1 -- 10.20.193.28:0/2448940906 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5980dd4e0 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2448940906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a1029b40 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 10 client.20691 _ll_register_callbacks cb 0x55f1a1291eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc570ff9640 1 -- 10.20.193.28:0/2448940906 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc5980dd680 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2448940906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f1a1266150 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc570ff9640 1 -- 10.20.193.28:0/2448940906 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc5980d60f0 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 10 client.20691 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2448940906 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f1a12131e0 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc570ff9640 1 -- 10.20.193.28:0/2448940906 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fc598102ce0 con 0x55f1a131c3c0 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 10 client.20691 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 10 client.20691 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 20 client.20691 populate_metadata read hostname 'trial028' 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55f1a132e410 0x55f1a13308d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 4 client.20691 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.123+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2448940906 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1a1260560 con 0x55f1a132e410 2026-02-20T03:33:42.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.130+0000 7fc5a6ffd640 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55f1a132e410 0x55f1a13308d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:42.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.158+0000 7fc570ff9640 10 client.20691 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:33:42.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.157+0000 7fc5a6ffd640 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55f1a132e410 0x55f1a13308d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4198d8a22d0aceb6 server_cookie=1276267e4bda30a8 in_seq=0 out_seq=0 2026-02-20T03:33:42.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc570ff9640 1 -- 10.20.193.28:0/2448940906 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f1a1260560 con 0x55f1a132e410 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc570ff9640 10 client.20691 handle_command_reply: tid=0 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 client.20691 shutdown 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2448940906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 msgr2=0x55f1a131e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a131e630 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fc5980ccb90 tx=0x7fc5980ccd70 comp rx=0 tx=0).stop 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2448940906 shutdown_connections 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55f1a132e410 0x55f1a13308d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a131e630 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 0x55f1a1320430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2448940906 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a13169f0 0x55f1a131fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc570ff9640 0 client.20691 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:33:42.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2448940906 >> 10.20.193.28:0/2448940906 conn(0x55f1a12c8240 msgr2=0x55f1a13043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:42.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2448940906 shutdown_connections 2026-02-20T03:33:42.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2448940906 wait complete. 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.172+0000 7fc5af9e5e00 20 client.20691 trim_cache size 0 max 16384 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.181+0000 7fc5af9e5e00 1 Processor -- start 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- start start 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a13169f0 0x55f1a1315320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 0x55f1a1315860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a1318680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c012660 con 0x55f1a131c3c0 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00ff30 con 0x55f1a1317370 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00dd80 con 0x55f1a13169f0 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a1318680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5a77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a1318680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50404/0 (socket says 10.20.193.28:50404) 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5a77fe640 1 -- 10.20.193.28:0/2727055139 learned_addr learned my addr 10.20.193.28:0/2727055139 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5a77fe640 1 -- 10.20.193.28:0/2727055139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a13169f0 msgr2=0x55f1a1315320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5a77fe640 1 --2- 10.20.193.28:0/2727055139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a13169f0 0x55f1a1315320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5a77fe640 1 -- 10.20.193.28:0/2727055139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 msgr2=0x55f1a1315860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5a77fe640 1 --2- 10.20.193.28:0/2727055139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 0x55f1a1315860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5a77fe640 1 -- 10.20.193.28:0/2727055139 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a1311130 con 0x55f1a131c3c0 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5a77fe640 1 --2- 10.20.193.28:0/2727055139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a1318680 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fc598038040 tx=0x7fc598031020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1288b26f4eff12f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc572ffd640 1 -- 10.20.193.28:0/2727055139 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598048020 con 0x55f1a131c3c0 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc572ffd640 1 -- 10.20.193.28:0/2727055139 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc598033070 con 0x55f1a131c3c0 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2727055139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 msgr2=0x55f1a1318680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:42.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2727055139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a1318680 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fc598038040 tx=0x7fc598031020 comp rx=0 tx=0).stop 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2727055139 shutdown_connections 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2727055139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a131c3c0 0x55f1a1318680 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2727055139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a1317370 0x55f1a1315860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2727055139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a13169f0 0x55f1a1315320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2727055139 >> 10.20.193.28:0/2727055139 conn(0x55f1a12c8240 msgr2=0x55f1a1317f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2727055139 shutdown_connections 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2727055139 wait complete. 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- start start 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 Processor -- start 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1327240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a1317370 0x55f1a1327780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a131c3c0 0x55f1a1327cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00e3f0 con 0x55f1a13169f0 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00f860 con 0x55f1a131c3c0 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.182+0000 7fc5af9e5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c00eac0 con 0x55f1a1317370 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.185+0000 7fc5a6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1327240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.185+0000 7fc5a6ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1327240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50416/0 (socket says 10.20.193.28:50416) 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.185+0000 7fc5a6ffd640 1 -- 10.20.193.28:0/2988573325 learned_addr learned my addr 10.20.193.28:0/2988573325 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.185+0000 7fc5a6ffd640 1 -- 10.20.193.28:0/2988573325 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a1317370 msgr2=0x55f1a1327780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.185+0000 7fc5a6ffd640 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a1317370 0x55f1a1327780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.185+0000 7fc5a6ffd640 1 -- 10.20.193.28:0/2988573325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a131c3c0 msgr2=0x55f1a1327cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.185+0000 7fc5a6ffd640 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a131c3c0 0x55f1a1327cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.185+0000 7fc5a6ffd640 1 -- 10.20.193.28:0/2988573325 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a0f37870 con 0x55f1a13169f0 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc5a6ffd640 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1327240 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00aee0 tx=0x7fc59c003b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bbe0c19a54ae7f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:42.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc570ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:42.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc570ff9640 1 -- 10.20.193.28:0/2988573325 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c01a070 con 0x55f1a13169f0 2026-02-20T03:33:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc570ff9640 1 -- 10.20.193.28:0/2988573325 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc59c004730 con 0x55f1a13169f0 2026-02-20T03:33:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc570ff9640 1 -- 10.20.193.28:0/2988573325 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc59c006e60 con 0x55f1a13169f0 2026-02-20T03:33:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2988573325 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a11f83f0 con 0x55f1a13169f0 2026-02-20T03:33:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc570ff9640 1 -- 10.20.193.28:0/2988573325 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc59c00c670 con 0x55f1a13169f0 2026-02-20T03:33:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc570ff9640 10 client.20697 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:33:42.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc5af9e5e00 10 client.20697 _ll_register_callbacks cb 0x7fc5980093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.186+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2988573325 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc590041070 con 0x55f1a13169f0 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc570ff9640 1 -- 10.20.193.28:0/2988573325 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fc59c024060 con 0x55f1a13169f0 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc5af9e5e00 10 client.20697 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2988573325 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f1a1311e20 con 0x55f1a13169f0 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc570ff9640 1 -- 10.20.193.28:0/2988573325 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fc59c00d420 con 0x55f1a13169f0 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc5af9e5e00 10 client.20697 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc5af9e5e00 10 client.20697 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc5af9e5e00 20 client.20697 populate_metadata read hostname 'trial028' 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55f1a139ab60 0x55f1a139d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc5af9e5e00 4 client.20697 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:33:42.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.191+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2988573325 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1a12297c0 con 0x55f1a139ab60 2026-02-20T03:33:42.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.200+0000 7fc5a67fc640 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55f1a139ab60 0x55f1a139d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:42.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.228+0000 7fc570ff9640 10 client.20697 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:33:42.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.228+0000 7fc5a67fc640 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55f1a139ab60 0x55f1a139d020 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e3f5ece8bd5530ac server_cookie=3ac0105dc3e594bc in_seq=0 out_seq=0 2026-02-20T03:33:42.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.241+0000 7fc570ff9640 1 -- 10.20.193.28:0/2988573325 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1a12297c0 con 0x55f1a139ab60 2026-02-20T03:33:42.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.241+0000 7fc570ff9640 10 client.20697 handle_command_reply: tid=0 2026-02-20T03:33:42.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.241+0000 7fc5af9e5e00 1 client.20697 shutdown 2026-02-20T03:33:42.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2988573325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 msgr2=0x55f1a1327240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:42.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1327240 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fc59c00aee0 tx=0x7fc59c003b10 comp rx=0 tx=0).stop 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2988573325 shutdown_connections 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55f1a139ab60 0x55f1a139d020 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f1a131c3c0 0x55f1a1327cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f1a1317370 0x55f1a1327780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 --2- 10.20.193.28:0/2988573325 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f1a13169f0 0x55f1a1327240 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2988573325 >> 10.20.193.28:0/2988573325 conn(0x55f1a12c8240 msgr2=0x55f1a1318720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc570ff9640 0 client.20697 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2988573325 shutdown_connections 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 1 -- 10.20.193.28:0/2988573325 wait complete. 2026-02-20T03:33:42.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5af9e5e00 20 client.20697 trim_cache size 0 max 16384 2026-02-20T03:33:42.257 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 -- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc57c0b0e20 msgr2=0x7fc57c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc57c0b0e20 0x7fc57c0b32e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc590006e50 tx=0x7fc590009dc0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 -- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 msgr2=0x7fc5a811af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 0x7fc5a811af40 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fc598009a00 tx=0x7fc598002910 comp rx=0 tx=0).stop 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 -- 10.20.193.28:0/1890003181 shutdown_connections 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc57c0b0e20 0x7fc57c0b32e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc5a810e480 0x7fc5a811af40 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc5a8074ca0 0x7fc5a811a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 --2- 10.20.193.28:0/1890003181 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc5a8074380 0x7fc5a811d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 -- 10.20.193.28:0/1890003181 >> 10.20.193.28:0/1890003181 conn(0x7fc5a806efb0 msgr2=0x7fc5a8118430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 -- 10.20.193.28:0/1890003181 shutdown_connections 2026-02-20T03:33:42.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:42.242+0000 7fc5a7fff640 1 -- 10.20.193.28:0/1890003181 wait complete. 2026-02-20T03:33:42.423 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:33:42.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 21.23 MB/sec execute 193 sec latency 41168.665 ms 2026-02-20T03:33:42.746 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:43.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 -- 10.20.193.28:0/1892114083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f50074d30 msgr2=0x7f8f5010bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/1892114083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f50074d30 0x7f8f5010bbf0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009a30 tx=0x7f8f4402f260 comp rx=0 tx=0).stop 2026-02-20T03:33:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 -- 10.20.193.28:0/1892114083 shutdown_connections 2026-02-20T03:33:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/1892114083 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f5010c300 0x7f8f5010ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/1892114083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f50074d30 0x7f8f5010bbf0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/1892114083 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f50074380 0x7f8f50074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 -- 10.20.193.28:0/1892114083 >> 10.20.193.28:0/1892114083 conn(0x7f8f5006ead0 msgr2=0x7f8f5006eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:43.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 -- 10.20.193.28:0/1892114083 shutdown_connections 2026-02-20T03:33:43.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 -- 10.20.193.28:0/1892114083 wait complete. 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 Processor -- start 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 -- start start 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f50074380 0x7f8f501a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.018+0000 7f8f4ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f50074d30 0x7f8f501aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f5010c300 0x7f8f501ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4ffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50121d30 con 0x7f8f5010c300 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4ffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50121bb0 con 0x7f8f50074d30 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4ffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50121eb0 con 0x7f8f50074380 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f5010c300 0x7f8f501ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:43.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f5010c300 0x7f8f501ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50436/0 (socket says 10.20.193.28:50436) 2026-02-20T03:33:43.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4f7fe640 1 -- 10.20.193.28:0/2106455997 learned_addr learned my addr 10.20.193.28:0/2106455997 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:43.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4f7fe640 1 -- 10.20.193.28:0/2106455997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f50074380 msgr2=0x7f8f501a9fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:43.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4f7fe640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f50074380 0x7f8f501a9fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4f7fe640 1 -- 10.20.193.28:0/2106455997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f50074d30 msgr2=0x7f8f501aa510 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4f7fe640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f50074d30 0x7f8f501aa510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4f7fe640 1 -- 10.20.193.28:0/2106455997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f501af020 con 0x7f8f5010c300 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4f7fe640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f5010c300 0x7f8f501ae8a0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800b480 tx=0x7f8f3800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f549f9640 1 -- 10.20.193.28:0/2106455997 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38004280 con 0x7f8f5010c300 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f549f9640 1 -- 10.20.193.28:0/2106455997 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f38015070 con 0x7f8f5010c300 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f549f9640 1 -- 10.20.193.28:0/2106455997 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f38010920 con 0x7f8f5010c300 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4ffff640 1 -- 10.20.193.28:0/2106455997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f501af310 con 0x7f8f5010c300 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4ffff640 1 -- 10.20.193.28:0/2106455997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f501b6b50 con 0x7f8f5010c300 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f549f9640 1 -- 10.20.193.28:0/2106455997 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8f38002780 con 0x7f8f5010c300 2026-02-20T03:33:43.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f57f00e00 1 Processor -- start 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f57f00e00 1 -- start start 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d8cfb0 0x561fd4d8d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 0x561fd4d87a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d93de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561fd4d07e00 con 0x561fd4d87f60 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561fd4cda970 con 0x561fd4d875e0 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561fd4c881f0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d93de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d93de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50438/0 (socket says 10.20.193.28:50438) 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/3232801836 learned_addr learned my addr 10.20.193.28:0/3232801836 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.024+0000 7f8f549f9640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f1c0b0e20 0x7f8f1c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/3232801836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d8cfb0 msgr2=0x561fd4d8d390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:43.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f4e7fc640 1 --2- 10.20.193.28:0/3232801836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d8cfb0 0x561fd4d8d390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/3232801836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 msgr2=0x561fd4d87a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:43.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f549f9640 1 -- 10.20.193.28:0/2106455997 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8f380dfea0 con 0x7f8f5010c300 2026-02-20T03:33:43.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f4e7fc640 1 --2- 10.20.193.28:0/3232801836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 0x561fd4d87a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/3232801836 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd4c9b3d0 con 0x561fd4d87f60 2026-02-20T03:33:43.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f4f7fe640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f1c0b0e20 0x7f8f1c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:43.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f4e7fc640 1 --2- 10.20.193.28:0/3232801836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d93de0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009950 tx=0x7f8f440057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d8c57f67bcb1d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:43.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f4f7fe640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f1c0b0e20 0x7f8f1c0b32e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8f38002410 tx=0x7f8f38002f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:43.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f13fff640 1 -- 10.20.193.28:0/3232801836 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400b0c0 con 0x561fd4d87f60 2026-02-20T03:33:43.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f13fff640 1 -- 10.20.193.28:0/3232801836 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f44033040 con 0x561fd4d87f60 2026-02-20T03:33:43.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f13fff640 1 -- 10.20.193.28:0/3232801836 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44004460 con 0x561fd4d87f60 2026-02-20T03:33:43.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3232801836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 msgr2=0x561fd4d93de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3232801836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d93de0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009950 tx=0x7f8f440057d0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3232801836 shutdown_connections 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3232801836 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d93de0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3232801836 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 0x561fd4d87a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3232801836 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d8cfb0 0x561fd4d8d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3232801836 >> 10.20.193.28:0/3232801836 conn(0x561fd4d4a240 msgr2=0x561fd4d85ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3232801836 shutdown_connections 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3232801836 wait complete. 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 -- start start 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 Processor -- start 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d875e0 0x561fd4da1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d87f60 0x561fd4da23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561fd4cd68a0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561fd4ac8f50 con 0x561fd4d87f60 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561fd4da0c70 con 0x561fd4d875e0 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.029+0000 7f8f4e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f4e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50454/0 (socket says 10.20.193.28:50454) 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/3423599425 learned_addr learned my addr 10.20.193.28:0/3423599425 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/3423599425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d875e0 msgr2=0x561fd4da1e80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f4e7fc640 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d875e0 0x561fd4da1e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/3423599425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d87f60 msgr2=0x561fd4da23c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f4e7fc640 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d87f60 0x561fd4da23c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/3423599425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd4d99ad0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f4e7fc640 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da0630 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f8f44038470 tx=0x7f8f4402f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3235be98060dda server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f117fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f117fa640 1 -- 10.20.193.28:0/3423599425 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440028f0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f117fa640 1 -- 10.20.193.28:0/3423599425 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f44004070 con 0x561fd4d8cfb0 2026-02-20T03:33:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f117fa640 1 -- 10.20.193.28:0/3423599425 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44038dd0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3423599425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd4aabb40 con 0x561fd4d8cfb0 2026-02-20T03:33:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 10 client.20709 _ll_register_callbacks cb 0x561fd4d13eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3423599425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561fd4ce8150 con 0x561fd4d8cfb0 2026-02-20T03:33:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f117fa640 1 -- 10.20.193.28:0/3423599425 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8f44004220 con 0x561fd4d8cfb0 2026-02-20T03:33:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f117fa640 1 -- 10.20.193.28:0/3423599425 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8f4402fac0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 10 client.20709 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3423599425 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x561fd4c951e0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f117fa640 1 -- 10.20.193.28:0/3423599425 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f8f4402fc60 con 0x561fd4d8cfb0 2026-02-20T03:33:43.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 10 client.20709 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 10 client.20709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 20 client.20709 populate_metadata read hostname 'trial028' 2026-02-20T03:33:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561fd4db02e0 0x561fd4db26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 4 client.20709 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.032+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3423599425 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fd4ce2560 con 0x561fd4db02e0 2026-02-20T03:33:43.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.046+0000 7f8f4effd640 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561fd4db02e0 0x561fd4db26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:43.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.088+0000 7f8f117fa640 10 client.20709 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:43.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.088+0000 7f8f4effd640 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561fd4db02e0 0x561fd4db26d0 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d27f603e07188b7 server_cookie=e652e5f9ffa926a8 in_seq=0 out_seq=0 2026-02-20T03:33:43.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f117fa640 1 -- 10.20.193.28:0/3423599425 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561fd4ce2560 con 0x561fd4db02e0 2026-02-20T03:33:43.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f117fa640 10 client.20709 handle_command_reply: tid=0 2026-02-20T03:33:43.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 client.20709 shutdown 2026-02-20T03:33:43.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3423599425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 msgr2=0x561fd4da0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:43.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da0630 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f8f44038470 tx=0x7f8f4402f260 comp rx=0 tx=0).stop 2026-02-20T03:33:43.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3423599425 shutdown_connections 2026-02-20T03:33:43.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561fd4db02e0 0x561fd4db26d0 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da0630 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d87f60 0x561fd4da23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/3423599425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d875e0 0x561fd4da1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3423599425 >> 10.20.193.28:0/3423599425 conn(0x561fd4d4a240 msgr2=0x561fd4d863f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:43.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f117fa640 0 client.20709 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:43.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.102+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3423599425 shutdown_connections 2026-02-20T03:33:43.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.105+0000 7f8f57f00e00 1 -- 10.20.193.28:0/3423599425 wait complete. 2026-02-20T03:33:43.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.106+0000 7f8f57f00e00 20 client.20709 trim_cache size 0 max 16384 2026-02-20T03:33:43.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 Processor -- start 2026-02-20T03:33:43.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 -- start start 2026-02-20T03:33:43.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 0x561fd4d7fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d9def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d8cfb0 0x561fd4db7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0012840 con 0x561fd4d87f60 2026-02-20T03:33:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef0010110 con 0x561fd4d875e0 2026-02-20T03:33:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef000df60 con 0x561fd4d8cfb0 2026-02-20T03:33:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f4effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d9def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f4effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d9def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50466/0 (socket says 10.20.193.28:50466) 2026-02-20T03:33:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f4effd640 1 -- 10.20.193.28:0/2228663412 learned_addr learned my addr 10.20.193.28:0/2228663412 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f4effd640 1 -- 10.20.193.28:0/2228663412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d8cfb0 msgr2=0x561fd4db7e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f4effd640 1 --2- 10.20.193.28:0/2228663412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d8cfb0 0x561fd4db7e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f4effd640 1 -- 10.20.193.28:0/2228663412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 msgr2=0x561fd4d7fd00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f4effd640 1 --2- 10.20.193.28:0/2228663412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 0x561fd4d7fd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f4effd640 1 -- 10.20.193.28:0/2228663412 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd4d99900 con 0x561fd4d87f60 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f4effd640 1 --2- 10.20.193.28:0/2228663412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d9def0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000ad70 tx=0x7f8f40004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1dc5ff30f0d127 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f137fe640 1 -- 10.20.193.28:0/2228663412 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40008020 con 0x561fd4d87f60 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f137fe640 1 -- 10.20.193.28:0/2228663412 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f40004870 con 0x561fd4d87f60 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f137fe640 1 -- 10.20.193.28:0/2228663412 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4001a070 con 0x561fd4d87f60 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 -- 10.20.193.28:0/2228663412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 msgr2=0x561fd4d9def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/2228663412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d9def0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f8f4000ad70 tx=0x7f8f40004b60 comp rx=0 tx=0).stop 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 -- 10.20.193.28:0/2228663412 shutdown_connections 2026-02-20T03:33:43.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/2228663412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d8cfb0 0x561fd4db7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/2228663412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d87f60 0x561fd4d9def0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/2228663412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 0x561fd4d7fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 -- 10.20.193.28:0/2228663412 >> 10.20.193.28:0/2228663412 conn(0x561fd4d4a240 msgr2=0x561fd4d8aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:43.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 -- 10.20.193.28:0/2228663412 shutdown_connections 2026-02-20T03:33:43.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.113+0000 7f8f57f00e00 1 -- 10.20.193.28:0/2228663412 wait complete. 2026-02-20T03:33:43.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.115+0000 7f8f57f00e00 1 -- start start 2026-02-20T03:33:43.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 Processor -- start 2026-02-20T03:33:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 0x561fd4da46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d87f60 0x561fd4da4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef000e5d0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef000fa40 con 0x561fd4d875e0 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef000eca0 con 0x561fd4d87f60 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f4e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f4e7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50472/0 (socket says 10.20.193.28:50472) 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/476153208 learned_addr learned my addr 10.20.193.28:0/476153208 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/476153208 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d87f60 msgr2=0x561fd4da4c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f4e7fc640 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d87f60 0x561fd4da4c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/476153208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 msgr2=0x561fd4da46f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f4e7fc640 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 0x561fd4da46f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f4e7fc640 1 -- 10.20.193.28:0/476153208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fd49b9870 con 0x561fd4d8cfb0 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f4e7fc640 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da7cc0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f8f44002410 tx=0x7f8f44004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bb688a3cae3c7c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f117fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f117fa640 1 -- 10.20.193.28:0/476153208 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44009880 con 0x561fd4d8cfb0 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 -- 10.20.193.28:0/476153208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fd4c7a3f0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 10 client.20715 _ll_register_callbacks cb 0x7f8f44002c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 -- 10.20.193.28:0/476153208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561fd4c8cab0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f117fa640 1 -- 10.20.193.28:0/476153208 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f44033020 con 0x561fd4d8cfb0 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f117fa640 1 -- 10.20.193.28:0/476153208 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44055bd0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f117fa640 1 -- 10.20.193.28:0/476153208 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8f44055d70 con 0x561fd4d8cfb0 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f117fa640 1 -- 10.20.193.28:0/476153208 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8f4405a070 con 0x561fd4d8cfb0 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 10 client.20715 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 -- 10.20.193.28:0/476153208 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x561fd4d9a5f0 con 0x561fd4d8cfb0 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f117fa640 1 -- 10.20.193.28:0/476153208 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f8f4405d020 con 0x561fd4d8cfb0 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 10 client.20715 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 10 client.20715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 20 client.20715 populate_metadata read hostname 'trial028' 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561fd4e1baf0 0x561fd4e1df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 4 client.20715 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:33:43.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.116+0000 7f8f57f00e00 1 -- 10.20.193.28:0/476153208 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8f40004870 con 0x561fd4e1baf0 2026-02-20T03:33:43.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.129+0000 7f8f4effd640 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561fd4e1baf0 0x561fd4e1df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:43.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.171+0000 7f8f4effd640 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561fd4e1baf0 0x561fd4e1df80 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5de3073850887c0 server_cookie=571f705d4597b37e in_seq=0 out_seq=0 2026-02-20T03:33:43.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.171+0000 7f8f117fa640 10 client.20715 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:43.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f117fa640 1 -- 10.20.193.28:0/476153208 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8f40004870 con 0x561fd4e1baf0 2026-02-20T03:33:43.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f117fa640 10 client.20715 handle_command_reply: tid=0 2026-02-20T03:33:43.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 client.20715 shutdown 2026-02-20T03:33:43.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 -- 10.20.193.28:0/476153208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 msgr2=0x561fd4da7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:43.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da7cc0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f8f44002410 tx=0x7f8f44004700 comp rx=0 tx=0).stop 2026-02-20T03:33:43.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 -- 10.20.193.28:0/476153208 shutdown_connections 2026-02-20T03:33:43.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561fd4e1baf0 0x561fd4e1df80 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561fd4d8cfb0 0x561fd4da7cc0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561fd4d87f60 0x561fd4da4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 --2- 10.20.193.28:0/476153208 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561fd4d875e0 0x561fd4da46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f117fa640 0 client.20715 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:43.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 -- 10.20.193.28:0/476153208 >> 10.20.193.28:0/476153208 conn(0x561fd4d4a240 msgr2=0x561fd4d8aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:43.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 -- 10.20.193.28:0/476153208 shutdown_connections 2026-02-20T03:33:43.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 1 -- 10.20.193.28:0/476153208 wait complete. 2026-02-20T03:33:43.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f57f00e00 20 client.20715 trim_cache size 0 max 16384 2026-02-20T03:33:43.201 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:33:43.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 -- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f1c0b0e20 msgr2=0x7f8f1c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f1c0b0e20 0x7f8f1c0b32e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8f38002410 tx=0x7f8f38002f10 comp rx=0 tx=0).stop 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 -- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f5010c300 msgr2=0x7f8f501ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f5010c300 0x7f8f501ae8a0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800b480 tx=0x7f8f3800b950 comp rx=0 tx=0).stop 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 -- 10.20.193.28:0/2106455997 shutdown_connections 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f1c0b0e20 0x7f8f1c0b32e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f5010c300 0x7f8f501ae8a0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f50074d30 0x7f8f501aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 --2- 10.20.193.28:0/2106455997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f50074380 0x7f8f501a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.185+0000 7f8f4ffff640 1 -- 10.20.193.28:0/2106455997 >> 10.20.193.28:0/2106455997 conn(0x7f8f5006ead0 msgr2=0x7f8f500730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:43.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.187+0000 7f8f4ffff640 1 -- 10.20.193.28:0/2106455997 shutdown_connections 2026-02-20T03:33:43.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:43.187+0000 7f8f4ffff640 1 -- 10.20.193.28:0/2106455997 wait complete. 2026-02-20T03:33:43.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:43 trial028 ceph-mon[38552]: pgmap v757: 129 pgs: 129 active+clean; 804 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 449 KiB/s rd, 6.7 MiB/s wr, 170 op/s 2026-02-20T03:33:43.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 21.12 MB/sec execute 194 sec latency 42168.714 ms 2026-02-20T03:33:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:43 trial177 ceph-mon[43181]: pgmap v757: 129 pgs: 129 active+clean; 804 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 449 KiB/s rd, 6.7 MiB/s wr, 170 op/s 2026-02-20T03:33:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:43 trial126 ceph-mon[38476]: pgmap v757: 129 pgs: 129 active+clean; 804 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 449 KiB/s rd, 6.7 MiB/s wr, 170 op/s 2026-02-20T03:33:44.362 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:33:44.362 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:33:44.690 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:44.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 21.01 MB/sec execute 195 sec latency 43168.752 ms 2026-02-20T03:33:44.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- 10.20.193.28:0/2415669356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 msgr2=0x7fdfe0074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:44.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/2415669356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 0x7fdfe0074760 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00b630 tx=0x7fdfcc02fb00 comp rx=0 tx=0).stop 2026-02-20T03:33:44.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- 10.20.193.28:0/2415669356 shutdown_connections 2026-02-20T03:33:44.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/2415669356 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfe010e670 0x7fdfe01161f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/2415669356 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdfe0074d30 0x7fdfe010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/2415669356 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 0x7fdfe0074760 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- 10.20.193.28:0/2415669356 >> 10.20.193.28:0/2415669356 conn(0x7fdfe006efb0 msgr2=0x7fdfe006f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:44.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- 10.20.193.28:0/2415669356 shutdown_connections 2026-02-20T03:33:44.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- 10.20.193.28:0/2415669356 wait complete. 2026-02-20T03:33:44.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 Processor -- start 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- start start 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 0x7fdfe01ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfe0074d30 0x7fdfe01abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdfe010e670 0x7fdfe01a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe011b450 con 0x7fdfe0074380 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe011b2d0 con 0x7fdfe010e670 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe011b5d0 con 0x7fdfe0074d30 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe65a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 0x7fdfe01ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe65a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 0x7fdfe01ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50500/0 (socket says 10.20.193.28:50500) 2026-02-20T03:33:44.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe65a8640 1 -- 10.20.193.28:0/3796345584 learned_addr learned my addr 10.20.193.28:0/3796345584 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:44.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe65a8640 1 -- 10.20.193.28:0/3796345584 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfe0074d30 msgr2=0x7fdfe01abd60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:44.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfe0074d30 0x7fdfe01abd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe65a8640 1 -- 10.20.193.28:0/3796345584 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdfe010e670 msgr2=0x7fdfe01a59e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:44.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdfe010e670 0x7fdfe01a59e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe65a8640 1 -- 10.20.193.28:0/3796345584 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe01a61b0 con 0x7fdfe0074380 2026-02-20T03:33:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 0x7fdfe01ab820 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc004290 tx=0x7fdfcc0334c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfc37fe640 1 -- 10.20.193.28:0/3796345584 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc037030 con 0x7fdfe0074380 2026-02-20T03:33:44.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfc37fe640 1 -- 10.20.193.28:0/3796345584 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdfcc004c60 con 0x7fdfe0074380 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfc37fe640 1 -- 10.20.193.28:0/3796345584 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc002dc0 con 0x7fdfe0074380 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- 10.20.193.28:0/3796345584 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe01a6440 con 0x7fdfe0074380 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.949+0000 7fdfe75aa640 1 -- 10.20.193.28:0/3796345584 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe01b26f0 con 0x7fdfe0074380 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 Processor -- start 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 -- start start 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12aad0 0x55b49a12aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a12ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12f570 0x55b49a12f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b49a074c00 con 0x55b49a12b480 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b49a0223c0 con 0x55b49a12aad0 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b49a070b30 con 0x55b49a12f570 2026-02-20T03:33:44.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfc37fe640 1 -- 10.20.193.28:0/3796345584 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fdfcc0047c0 con 0x7fdfe0074380 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfe65a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a12ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfe65a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a12ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50510/0 (socket says 10.20.193.28:50510) 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfe65a8640 1 -- 10.20.193.28:0/1434277069 learned_addr learned my addr 10.20.193.28:0/1434277069 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfe65a8640 1 -- 10.20.193.28:0/1434277069 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12f570 msgr2=0x55b49a12f9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/1434277069 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12f570 0x55b49a12f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfe65a8640 1 -- 10.20.193.28:0/1434277069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12aad0 msgr2=0x55b49a12aeb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/1434277069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12aad0 0x55b49a12aeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfe65a8640 1 -- 10.20.193.28:0/1434277069 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b49a01b840 con 0x55b49a12b480 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/1434277069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a12ef50 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc10d580 tx=0x7fdfcc10d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d79f6d18e904599 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfc0cf3640 1 -- 10.20.193.28:0/1434277069 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc107520 con 0x55b49a12b480 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfc0cf3640 1 -- 10.20.193.28:0/1434277069 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdfcc105cb0 con 0x55b49a12b480 2026-02-20T03:33:44.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfc0cf3640 1 -- 10.20.193.28:0/1434277069 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc116bd0 con 0x55b49a12b480 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 -- 10.20.193.28:0/1434277069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 msgr2=0x55b49a12ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 --2- 10.20.193.28:0/1434277069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a12ef50 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc10d580 tx=0x7fdfcc10d680 comp rx=0 tx=0).stop 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfc37fe640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfb40b0e20 0x7fdfb40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 -- 10.20.193.28:0/1434277069 shutdown_connections 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 --2- 10.20.193.28:0/1434277069 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12f570 0x55b49a12f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 --2- 10.20.193.28:0/1434277069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a12ef50 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 --2- 10.20.193.28:0/1434277069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12aad0 0x55b49a12aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 -- 10.20.193.28:0/1434277069 >> 10.20.193.28:0/1434277069 conn(0x55b49a11ab60 msgr2=0x55b49a1205e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfc37fe640 1 -- 10.20.193.28:0/3796345584 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fdfcc105420 con 0x7fdfe0074380 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.955+0000 7fdfead38e00 1 -- 10.20.193.28:0/1434277069 shutdown_connections 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.959+0000 7fdfead38e00 1 -- 10.20.193.28:0/1434277069 wait complete. 2026-02-20T03:33:44.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.959+0000 7fdfe6da9640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfb40b0e20 0x7fdfb40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.959+0000 7fdfe6da9640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfb40b0e20 0x7fdfb40b32e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009710 tx=0x7fdfd4006d70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.959+0000 7fdfead38e00 1 -- start start 2026-02-20T03:33:44.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.959+0000 7fdfead38e00 1 Processor -- start 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12aad0 0x55b49a1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12b480 0x55b49a144c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12f570 0x55b49a142e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfead38e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b49a01c1a0 con 0x55b49a12f570 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfead38e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b49a074c00 con 0x55b49a12b480 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfead38e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b49a1434d0 con 0x55b49a12aad0 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfe6da9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12f570 0x55b49a142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfe6da9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12f570 0x55b49a142e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50518/0 (socket says 10.20.193.28:50518) 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfe6da9640 1 -- 10.20.193.28:0/606964095 learned_addr learned my addr 10.20.193.28:0/606964095 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:44.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfe6da9640 1 -- 10.20.193.28:0/606964095 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12aad0 msgr2=0x55b49a1446e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfe6da9640 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12aad0 0x55b49a1446e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfe6da9640 1 -- 10.20.193.28:0/606964095 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12b480 msgr2=0x55b49a144c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfe6da9640 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12b480 0x55b49a144c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfe6da9640 1 -- 10.20.193.28:0/606964095 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b49a13cbf0 con 0x55b49a12f570 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfe6da9640 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12f570 0x55b49a142e90 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40028c0 tx=0x7fdfd40048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815d195d08e63c1f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdf93fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdf93fff640 1 -- 10.20.193.28:0/606964095 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4002e60 con 0x55b49a12f570 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdf93fff640 1 -- 10.20.193.28:0/606964095 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdfd400be70 con 0x55b49a12f570 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdf93fff640 1 -- 10.20.193.28:0/606964095 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4020890 con 0x55b49a12f570 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfead38e00 1 -- 10.20.193.28:0/606964095 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b499e43b60 con 0x55b49a12f570 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfead38e00 10 client.20727 _ll_register_callbacks cb 0x55b49a0200d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:44.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdfead38e00 1 -- 10.20.193.28:0/606964095 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b49a07c7f0 con 0x55b49a12f570 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.960+0000 7fdf93fff640 1 -- 10.20.193.28:0/606964095 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fdfd4011440 con 0x55b49a12f570 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdf93fff640 1 -- 10.20.193.28:0/606964095 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fdfd4011700 con 0x55b49a12f570 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdfead38e00 10 client.20727 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdfead38e00 1 -- 10.20.193.28:0/606964095 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55b49a041430 con 0x55b49a12f570 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdf93fff640 1 -- 10.20.193.28:0/606964095 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fdfd40118a0 con 0x55b49a12f570 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdfead38e00 10 client.20727 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdfead38e00 10 client.20727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdfead38e00 20 client.20727 populate_metadata read hostname 'trial028' 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdfead38e00 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b49a152f70 0x55b49a155360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdfead38e00 4 client.20727 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:44.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.965+0000 7fdfead38e00 1 -- 10.20.193.28:0/606964095 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b499ff6c00 con 0x55b49a152f70 2026-02-20T03:33:44.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:44.973+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b49a152f70 0x55b49a155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.014+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b49a152f70 0x55b49a155360 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427d3b05cd682ae3 server_cookie=5f3f83d108d1b75c in_seq=0 out_seq=0 2026-02-20T03:33:45.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.014+0000 7fdf93fff640 10 client.20727 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:45.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdf93fff640 1 -- 10.20.193.28:0/606964095 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b499ff6c00 con 0x55b49a152f70 2026-02-20T03:33:45.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdf93fff640 10 client.20727 handle_command_reply: tid=0 2026-02-20T03:33:45.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 client.20727 shutdown 2026-02-20T03:33:45.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 -- 10.20.193.28:0/606964095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12f570 msgr2=0x55b49a142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12f570 0x55b49a142e90 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fdfd40028c0 tx=0x7fdfd40048a0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 -- 10.20.193.28:0/606964095 shutdown_connections 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b49a152f70 0x55b49a155360 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12f570 0x55b49a142e90 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12b480 0x55b49a144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 --2- 10.20.193.28:0/606964095 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12aad0 0x55b49a1446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 -- 10.20.193.28:0/606964095 >> 10.20.193.28:0/606964095 conn(0x55b49a11ab60 msgr2=0x55b49a12df30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdf93fff640 0 client.20727 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 -- 10.20.193.28:0/606964095 shutdown_connections 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 1 -- 10.20.193.28:0/606964095 wait complete. 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.028+0000 7fdfead38e00 20 client.20727 trim_cache size 0 max 16384 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.033+0000 7fdfead38e00 1 Processor -- start 2026-02-20T03:33:45.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.033+0000 7fdfead38e00 1 -- start start 2026-02-20T03:33:45.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.033+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12aad0 0x55b49a14f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.033+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a130960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.033+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12f570 0x55b49a147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.033+0000 7fdfead38e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c012770 con 0x55b49a12b480 2026-02-20T03:33:45.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c010040 con 0x55b49a12f570 2026-02-20T03:33:45.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c00de90 con 0x55b49a12aad0 2026-02-20T03:33:45.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe5da7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a130960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe5da7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a130960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50532/0 (socket says 10.20.193.28:50532) 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe5da7640 1 -- 10.20.193.28:0/3881977060 learned_addr learned my addr 10.20.193.28:0/3881977060 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe5da7640 1 -- 10.20.193.28:0/3881977060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12aad0 msgr2=0x55b49a14f700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe5da7640 1 --2- 10.20.193.28:0/3881977060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12aad0 0x55b49a14f700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe5da7640 1 -- 10.20.193.28:0/3881977060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12f570 msgr2=0x55b49a147cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe5da7640 1 --2- 10.20.193.28:0/3881977060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12f570 0x55b49a147cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe5da7640 1 -- 10.20.193.28:0/3881977060 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b49a13ca20 con 0x55b49a12b480 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe5da7640 1 --2- 10.20.193.28:0/3881977060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a130960 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009b90 tx=0x7fdfd800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc756aaf4f8c17db server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfaa4e6640 1 -- 10.20.193.28:0/3881977060 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8006e60 con 0x55b49a12b480 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfaa4e6640 1 -- 10.20.193.28:0/3881977060 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdfd8002d00 con 0x55b49a12b480 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfaa4e6640 1 -- 10.20.193.28:0/3881977060 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd80137a0 con 0x55b49a12b480 2026-02-20T03:33:45.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- 10.20.193.28:0/3881977060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 msgr2=0x55b49a130960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3881977060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a130960 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8009b90 tx=0x7fdfd800b7e0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- 10.20.193.28:0/3881977060 shutdown_connections 2026-02-20T03:33:45.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3881977060 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12f570 0x55b49a147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3881977060 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12b480 0x55b49a130960 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3881977060 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12aad0 0x55b49a14f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- 10.20.193.28:0/3881977060 >> 10.20.193.28:0/3881977060 conn(0x55b49a11ab60 msgr2=0x55b49a1475b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- 10.20.193.28:0/3881977060 shutdown_connections 2026-02-20T03:33:45.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- 10.20.193.28:0/3881977060 wait complete. 2026-02-20T03:33:45.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- start start 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 Processor -- start 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12aad0 0x55b49a14ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12b480 0x55b49a14cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12f570 0x55b49a14d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c00e500 con 0x55b49a12aad0 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c00f970 con 0x55b49a12f570 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfead38e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8c00ebd0 con 0x55b49a12b480 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe65a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12aad0 0x55b49a14ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe65a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12aad0 0x55b49a14ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50548/0 (socket says 10.20.193.28:50548) 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe65a8640 1 -- 10.20.193.28:0/3609904878 learned_addr learned my addr 10.20.193.28:0/3609904878 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe65a8640 1 -- 10.20.193.28:0/3609904878 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12b480 msgr2=0x55b49a14cf90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12b480 0x55b49a14cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe65a8640 1 -- 10.20.193.28:0/3609904878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12f570 msgr2=0x55b49a14d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12f570 0x55b49a14d4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe65a8640 1 -- 10.20.193.28:0/3609904878 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b499d53900 con 0x55b49a12aad0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdfe65a8640 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12aad0 0x55b49a14ca50 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0ca120 tx=0x7fdfcc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2c71cfc119cb89 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.038+0000 7fdf93fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdf93fff640 1 -- 10.20.193.28:0/3609904878 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc105e60 con 0x55b49a12aad0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 1 -- 10.20.193.28:0/3609904878 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b49a02f4d0 con 0x55b49a12aad0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 10 client.20733 _ll_register_callbacks cb 0x7fdfd4004750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 1 -- 10.20.193.28:0/3609904878 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfcc105cb0 con 0x55b49a12aad0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdf93fff640 1 -- 10.20.193.28:0/3609904878 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdfcc0042f0 con 0x55b49a12aad0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdf93fff640 1 -- 10.20.193.28:0/3609904878 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc105e60 con 0x55b49a12aad0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdf93fff640 1 -- 10.20.193.28:0/3609904878 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fdfcc10d150 con 0x55b49a12aad0 2026-02-20T03:33:45.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdf93fff640 1 -- 10.20.193.28:0/3609904878 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fdfcc0b3e60 con 0x55b49a12aad0 2026-02-20T03:33:45.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 10 client.20733 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:45.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 1 -- 10.20.193.28:0/3609904878 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55b49a13d710 con 0x55b49a12aad0 2026-02-20T03:33:45.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdf93fff640 1 -- 10.20.193.28:0/3609904878 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fdfcc102b10 con 0x55b49a12aad0 2026-02-20T03:33:45.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 10 client.20733 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:45.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 10 client.20733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:45.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 20 client.20733 populate_metadata read hostname 'trial028' 2026-02-20T03:33:45.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b49a1c01a0 0x55b49a1c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 4 client.20733 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:33:45.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.042+0000 7fdfead38e00 1 -- 10.20.193.28:0/3609904878 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b499de4a20 con 0x55b49a1c01a0 2026-02-20T03:33:45.072 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.069+0000 7fdfe5da7640 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b49a1c01a0 0x55b49a1c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.097+0000 7fdfe5da7640 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b49a1c01a0 0x55b49a1c2630 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6e7b8d4f2943bf8 server_cookie=3d91a892555e744d in_seq=0 out_seq=0 2026-02-20T03:33:45.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.097+0000 7fdf93fff640 10 client.20733 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdf93fff640 1 -- 10.20.193.28:0/3609904878 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b499de4a20 con 0x55b49a1c01a0 2026-02-20T03:33:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdf93fff640 10 client.20733 handle_command_reply: tid=0 2026-02-20T03:33:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 client.20733 shutdown 2026-02-20T03:33:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 -- 10.20.193.28:0/3609904878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12aad0 msgr2=0x55b49a14ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12aad0 0x55b49a14ca50 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0ca120 tx=0x7fdfcc0046d0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 -- 10.20.193.28:0/3609904878 shutdown_connections 2026-02-20T03:33:45.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b49a1c01a0 0x55b49a1c2630 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b49a12f570 0x55b49a14d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b49a12b480 0x55b49a14cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 --2- 10.20.193.28:0/3609904878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b49a12aad0 0x55b49a14ca50 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdf93fff640 0 client.20733 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:45.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 -- 10.20.193.28:0/3609904878 >> 10.20.193.28:0/3609904878 conn(0x55b49a11ab60 msgr2=0x55b49a147dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.110+0000 7fdfead38e00 1 -- 10.20.193.28:0/3609904878 shutdown_connections 2026-02-20T03:33:45.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfead38e00 1 -- 10.20.193.28:0/3609904878 wait complete. 2026-02-20T03:33:45.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfead38e00 20 client.20733 trim_cache size 0 max 16384 2026-02-20T03:33:45.127 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:33:45.127 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:33:45.128 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "00490591-c217-4014-812b-79c74b3f6ef8", 2026-02-20T03:33:45.128 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:33:45.128 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:33:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 -- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfb40b0e20 msgr2=0x7fdfb40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfb40b0e20 0x7fdfb40b32e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009710 tx=0x7fdfd4006d70 comp rx=0 tx=0).stop 2026-02-20T03:33:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 -- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 msgr2=0x7fdfe01ab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 0x7fdfe01ab820 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc004290 tx=0x7fdfcc0334c0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 -- 10.20.193.28:0/3796345584 shutdown_connections 2026-02-20T03:33:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdfb40b0e20 0x7fdfb40b32e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdfe010e670 0x7fdfe01a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdfe0074d30 0x7fdfe01abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 --2- 10.20.193.28:0/3796345584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdfe0074380 0x7fdfe01ab820 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 -- 10.20.193.28:0/3796345584 >> 10.20.193.28:0/3796345584 conn(0x7fdfe006efb0 msgr2=0x7fdfe0072230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 -- 10.20.193.28:0/3796345584 shutdown_connections 2026-02-20T03:33:45.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.113+0000 7fdfe75aa640 1 -- 10.20.193.28:0/3796345584 wait complete. 2026-02-20T03:33:45.260 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:33:45.586 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:33:45.595 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:45 trial028 ceph-mon[38552]: pgmap v758: 129 pgs: 129 active+clean; 779 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 487 KiB/s rd, 5.4 MiB/s wr, 176 op/s 2026-02-20T03:33:45.595 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:45 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:33:45.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 20.91 MB/sec execute 196 sec latency 44168.790 ms 2026-02-20T03:33:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:45 trial177 ceph-mon[43181]: pgmap v758: 129 pgs: 129 active+clean; 779 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 487 KiB/s rd, 5.4 MiB/s wr, 176 op/s 2026-02-20T03:33:45.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:45 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:33:45.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:45 trial126 ceph-mon[38476]: pgmap v758: 129 pgs: 129 active+clean; 779 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 487 KiB/s rd, 5.4 MiB/s wr, 176 op/s 2026-02-20T03:33:45.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:45 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:33:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.844+0000 7f3d6eff1640 1 -- 10.20.193.28:0/3769845690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 msgr2=0x7f3d681132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.844+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/3769845690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 0x7f3d681132a0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009a30 tx=0x7f3d5002f260 comp rx=0 tx=0).stop 2026-02-20T03:33:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.844+0000 7f3d6eff1640 1 -- 10.20.193.28:0/3769845690 shutdown_connections 2026-02-20T03:33:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.844+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/3769845690 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d681137e0 0x7f3d68115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.844+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/3769845690 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 0x7f3d681132a0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.844+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/3769845690 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d6810a230 0x7f3d6810a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.844+0000 7f3d6eff1640 1 -- 10.20.193.28:0/3769845690 >> 10.20.193.28:0/3769845690 conn(0x7f3d68078920 msgr2=0x7f3d6807ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.844+0000 7f3d6eff1640 1 -- 10.20.193.28:0/3769845690 shutdown_connections 2026-02-20T03:33:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.844+0000 7f3d6eff1640 1 -- 10.20.193.28:0/3769845690 wait complete. 2026-02-20T03:33:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 Processor -- start 2026-02-20T03:33:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 -- start start 2026-02-20T03:33:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d6810a230 0x7f3d681a7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 0x7f3d681a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d681137e0 0x7f3d681a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d68119390 con 0x7f3d6810ab50 2026-02-20T03:33:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3d68119210 con 0x7f3d681137e0 2026-02-20T03:33:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d68119510 con 0x7f3d6810a230 2026-02-20T03:33:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 0x7f3d681a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 0x7f3d681a7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50564/0 (socket says 10.20.193.28:50564) 2026-02-20T03:33:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5ffff640 1 -- 10.20.193.28:0/420017877 learned_addr learned my addr 10.20.193.28:0/420017877 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5ffff640 1 -- 10.20.193.28:0/420017877 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d6810a230 msgr2=0x7f3d681a7570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5ffff640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d6810a230 0x7f3d681a7570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5ffff640 1 -- 10.20.193.28:0/420017877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d681137e0 msgr2=0x7f3d681a1640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5ffff640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d681137e0 0x7f3d681a1640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5ffff640 1 -- 10.20.193.28:0/420017877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d681a1ed0 con 0x7f3d6810ab50 2026-02-20T03:33:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5ffff640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 0x7f3d681a7ab0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009950 tx=0x7f3d50002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5dffb640 1 -- 10.20.193.28:0/420017877 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50002a00 con 0x7f3d6810ab50 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 -- 10.20.193.28:0/420017877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d681a2160 con 0x7f3d6810ab50 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5dffb640 1 -- 10.20.193.28:0/420017877 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d50005030 con 0x7f3d6810ab50 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5dffb640 1 -- 10.20.193.28:0/420017877 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50002a00 con 0x7f3d6810ab50 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6eff1640 1 -- 10.20.193.28:0/420017877 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d681ae3a0 con 0x7f3d6810ab50 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d5dffb640 1 -- 10.20.193.28:0/420017877 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3d50004280 con 0x7f3d6810ab50 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d714f6e00 1 Processor -- start 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d714f6e00 1 -- start start 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5663a40 0x55cad5663e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5667e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad5668530 0x55cad56700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cad55d2e50 con 0x55cad56643f0 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cad55a59c0 con 0x55cad5663a40 2026-02-20T03:33:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cad5553240 con 0x55cad5668530 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6cd66640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5667e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6cd66640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5667e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50574/0 (socket says 10.20.193.28:50574) 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6cd66640 1 -- 10.20.193.28:0/1962215590 learned_addr learned my addr 10.20.193.28:0/1962215590 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6cd66640 1 -- 10.20.193.28:0/1962215590 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad5668530 msgr2=0x55cad56700b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/1962215590 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad5668530 0x55cad56700b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6cd66640 1 -- 10.20.193.28:0/1962215590 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5663a40 msgr2=0x55cad5663e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/1962215590 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5663a40 0x55cad5663e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.845+0000 7f3d6cd66640 1 -- 10.20.193.28:0/1962215590 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad5566420 con 0x55cad56643f0 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d5dffb640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d440b11a0 0x7f3d440b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d5dffb640 1 -- 10.20.193.28:0/420017877 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3d5003e070 con 0x7f3d6810ab50 2026-02-20T03:33:45.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/1962215590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5667e00 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f3d5802d180 tx=0x7f3d5802d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86044e7771682a0e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d6d567640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d440b11a0 0x7f3d440b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d354e4640 1 -- 10.20.193.28:0/1962215590 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5802de30 con 0x55cad56643f0 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d354e4640 1 -- 10.20.193.28:0/1962215590 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d5802b0d0 con 0x55cad56643f0 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d354e4640 1 -- 10.20.193.28:0/1962215590 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58029da0 con 0x55cad56643f0 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d714f6e00 1 -- 10.20.193.28:0/1962215590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 msgr2=0x55cad5667e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/1962215590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5667e00 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f3d5802d180 tx=0x7f3d5802d650 comp rx=0 tx=0).stop 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d6d567640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d440b11a0 0x7f3d440b3660 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3d68076c20 tx=0x7f3d64009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d714f6e00 1 -- 10.20.193.28:0/1962215590 shutdown_connections 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/1962215590 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad5668530 0x55cad56700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/1962215590 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5667e00 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/1962215590 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5663a40 0x55cad5663e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d714f6e00 1 -- 10.20.193.28:0/1962215590 >> 10.20.193.28:0/1962215590 conn(0x55cad5615290 msgr2=0x55cad5650d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.851+0000 7f3d714f6e00 1 -- 10.20.193.28:0/1962215590 shutdown_connections 2026-02-20T03:33:45.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 -- 10.20.193.28:0/1962215590 wait complete. 2026-02-20T03:33:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 -- start start 2026-02-20T03:33:45.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 Processor -- start 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad566caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad56643f0 0x55cad566d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5668530 0x55cad566b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cad55a18f0 con 0x55cad5663a40 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cad5393f50 con 0x55cad5668530 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cad566b830 con 0x55cad56643f0 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d6cd66640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad566caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d6cd66640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad566caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50588/0 (socket says 10.20.193.28:50588) 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d6cd66640 1 -- 10.20.193.28:0/3884432781 learned_addr learned my addr 10.20.193.28:0/3884432781 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d6cd66640 1 -- 10.20.193.28:0/3884432781 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad56643f0 msgr2=0x55cad566d030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad56643f0 0x55cad566d030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d6cd66640 1 -- 10.20.193.28:0/3884432781 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5668530 msgr2=0x55cad566b2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5668530 0x55cad566b2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d6cd66640 1 -- 10.20.193.28:0/3884432781 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad565e1e0 con 0x55cad5663a40 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad566caf0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f3d58035000 tx=0x7f3d5802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866c2c83360e3c4b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d267fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d267fc640 1 -- 10.20.193.28:0/3884432781 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5802b610 con 0x55cad5663a40 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d267fc640 1 -- 10.20.193.28:0/3884432781 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d58044070 con 0x55cad5663a40 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d267fc640 1 -- 10.20.193.28:0/3884432781 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5803f430 con 0x55cad5663a40 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3884432781 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad5376b40 con 0x55cad5663a40 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 10 client.20745 _ll_register_callbacks cb 0x55cad55def00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3884432781 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cad55b31a0 con 0x55cad5663a40 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d267fc640 1 -- 10.20.193.28:0/3884432781 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3d58029a00 con 0x55cad5663a40 2026-02-20T03:33:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d267fc640 1 -- 10.20.193.28:0/3884432781 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3d58029cc0 con 0x55cad5663a40 2026-02-20T03:33:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 10 client.20745 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3884432781 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55cad5560230 con 0x55cad5663a40 2026-02-20T03:33:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d267fc640 1 -- 10.20.193.28:0/3884432781 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f3d5803e070 con 0x55cad5663a40 2026-02-20T03:33:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 10 client.20745 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:45.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 10 client.20745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 20 client.20745 populate_metadata read hostname 'trial028' 2026-02-20T03:33:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cad567b200 0x55cad567d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 4 client.20745 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:45.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.852+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3884432781 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cad55ad5b0 con 0x55cad567b200 2026-02-20T03:33:45.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.880+0000 7f3d5ffff640 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cad567b200 0x55cad567d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.907+0000 7f3d5ffff640 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cad567b200 0x55cad567d5f0 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1beb52037cfdddcd server_cookie=8db116d513e1f574 in_seq=0 out_seq=0 2026-02-20T03:33:45.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.907+0000 7f3d267fc640 10 client.20745 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:45.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d267fc640 1 -- 10.20.193.28:0/3884432781 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55cad55ad5b0 con 0x55cad567b200 2026-02-20T03:33:45.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d267fc640 10 client.20745 handle_command_reply: tid=0 2026-02-20T03:33:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 client.20745 shutdown 2026-02-20T03:33:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3884432781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 msgr2=0x55cad566caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad566caf0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f3d58035000 tx=0x7f3d5802be50 comp rx=0 tx=0).stop 2026-02-20T03:33:45.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3884432781 shutdown_connections 2026-02-20T03:33:45.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cad567b200 0x55cad567d5f0 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5668530 0x55cad566b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad56643f0 0x55cad566d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3884432781 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad566caf0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3884432781 >> 10.20.193.28:0/3884432781 conn(0x55cad5615290 msgr2=0x55cad5666d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d267fc640 0 client.20745 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.921+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3884432781 shutdown_connections 2026-02-20T03:33:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.922+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3884432781 wait complete. 2026-02-20T03:33:45.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.922+0000 7f3d714f6e00 20 client.20745 trim_cache size 0 max 16384 2026-02-20T03:33:45.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 Processor -- start 2026-02-20T03:33:45.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 -- start start 2026-02-20T03:33:45.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad5669da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad56643f0 0x55cad5661fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5668530 0x55cad566caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c0126f0 con 0x55cad5663a40 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c00ffc0 con 0x55cad5668530 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c00de10 con 0x55cad56643f0 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d6cd66640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad5669da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d6cd66640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad5669da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50604/0 (socket says 10.20.193.28:50604) 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d6cd66640 1 -- 10.20.193.28:0/403508753 learned_addr learned my addr 10.20.193.28:0/403508753 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d6cd66640 1 -- 10.20.193.28:0/403508753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad56643f0 msgr2=0x55cad5661fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/403508753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad56643f0 0x55cad5661fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d6cd66640 1 -- 10.20.193.28:0/403508753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5668530 msgr2=0x55cad566caf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/403508753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5668530 0x55cad566caf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d6cd66640 1 -- 10.20.193.28:0/403508753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad565e010 con 0x55cad5663a40 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/403508753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad5669da0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f3d5802bb40 tx=0x7f3d5802de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81032ea1ebca6f0f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d34ce3640 1 -- 10.20.193.28:0/403508753 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5802bc00 con 0x55cad5663a40 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d34ce3640 1 -- 10.20.193.28:0/403508753 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d58044070 con 0x55cad5663a40 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d34ce3640 1 -- 10.20.193.28:0/403508753 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d58049860 con 0x55cad5663a40 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 -- 10.20.193.28:0/403508753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 msgr2=0x55cad5669da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/403508753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad5669da0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f3d5802bb40 tx=0x7f3d5802de30 comp rx=0 tx=0).stop 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 -- 10.20.193.28:0/403508753 shutdown_connections 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/403508753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5668530 0x55cad566caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/403508753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad56643f0 0x55cad5661fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/403508753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad5663a40 0x55cad5669da0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 -- 10.20.193.28:0/403508753 >> 10.20.193.28:0/403508753 conn(0x55cad5615290 msgr2=0x55cad567d210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 -- 10.20.193.28:0/403508753 shutdown_connections 2026-02-20T03:33:45.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.928+0000 7f3d714f6e00 1 -- 10.20.193.28:0/403508753 wait complete. 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d714f6e00 1 -- start start 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d714f6e00 1 Processor -- start 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5663a40 0x55cad56729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5672f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d714f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad5668530 0x55cad566f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c00e480 con 0x55cad56643f0 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c00f8f0 con 0x55cad5663a40 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d714f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0c00eb50 con 0x55cad5668530 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d5ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5672f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d5ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5672f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:50618/0 (socket says 10.20.193.28:50618) 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d5ffff640 1 -- 10.20.193.28:0/3357538637 learned_addr learned my addr 10.20.193.28:0/3357538637 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d5ffff640 1 -- 10.20.193.28:0/3357538637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad5668530 msgr2=0x55cad566f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d5ffff640 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad5668530 0x55cad566f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d5ffff640 1 -- 10.20.193.28:0/3357538637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5663a40 msgr2=0x55cad56729f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d5ffff640 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5663a40 0x55cad56729f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.933+0000 7f3d5ffff640 1 -- 10.20.193.28:0/3357538637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cad5284870 con 0x55cad56643f0 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.934+0000 7f3d5ffff640 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5672f30 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f3d500c9990 tx=0x7f3d50009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e59441073a6163 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.934+0000 7f3d267fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.934+0000 7f3d267fc640 1 -- 10.20.193.28:0/3357538637 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50048040 con 0x55cad56643f0 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.934+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3357538637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cad5545440 con 0x55cad56643f0 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.934+0000 7f3d714f6e00 10 client.20751 _ll_register_callbacks cb 0x7f3d5802d050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.934+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3357538637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cad5576810 con 0x55cad56643f0 2026-02-20T03:33:45.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d267fc640 1 -- 10.20.193.28:0/3357538637 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3d50033040 con 0x55cad56643f0 2026-02-20T03:33:45.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d267fc640 1 -- 10.20.193.28:0/3357538637 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d500c89b0 con 0x55cad56643f0 2026-02-20T03:33:45.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d267fc640 1 -- 10.20.193.28:0/3357538637 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3d500d30b0 con 0x55cad56643f0 2026-02-20T03:33:45.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d267fc640 1 -- 10.20.193.28:0/3357538637 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f3d500c8b50 con 0x55cad56643f0 2026-02-20T03:33:45.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d714f6e00 10 client.20751 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:45.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3357538637 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55cad565ed00 con 0x55cad56643f0 2026-02-20T03:33:45.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d267fc640 1 -- 10.20.193.28:0/3357538637 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f3d500cb980 con 0x55cad56643f0 2026-02-20T03:33:45.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d714f6e00 10 client.20751 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:45.950 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d714f6e00 10 client.20751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.935+0000 7f3d714f6e00 20 client.20751 populate_metadata read hostname 'trial028' 2026-02-20T03:33:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.936+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cad56e6790 0x55cad56e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.936+0000 7f3d714f6e00 4 client.20751 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:33:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.936+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3357538637 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cad5557b00 con 0x55cad56e6790 2026-02-20T03:33:45.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.948+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cad56e6790 0x55cad56e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d6cd66640 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cad56e6790 0x55cad56e8c50 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1877e99c6f34f77d server_cookie=382ffa80cb0f2939 in_seq=0 out_seq=0 2026-02-20T03:33:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d267fc640 10 client.20751 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:45.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d267fc640 1 -- 10.20.193.28:0/3357538637 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55cad5557b00 con 0x55cad56e6790 2026-02-20T03:33:45.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d267fc640 10 client.20751 handle_command_reply: tid=0 2026-02-20T03:33:45.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 client.20751 shutdown 2026-02-20T03:33:45.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3357538637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 msgr2=0x55cad5672f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5672f30 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f3d500c9990 tx=0x7f3d50009340 comp rx=0 tx=0).stop 2026-02-20T03:33:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3357538637 shutdown_connections 2026-02-20T03:33:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cad56e6790 0x55cad56e8c50 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cad5668530 0x55cad566f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cad56643f0 0x55cad5672f30 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 --2- 10.20.193.28:0/3357538637 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cad5663a40 0x55cad56729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d267fc640 0 client.20751 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3357538637 >> 10.20.193.28:0/3357538637 conn(0x55cad5615290 msgr2=0x55cad566caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3357538637 shutdown_connections 2026-02-20T03:33:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 1 -- 10.20.193.28:0/3357538637 wait complete. 2026-02-20T03:33:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d714f6e00 20 client.20751 trim_cache size 0 max 16384 2026-02-20T03:33:45.982 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:33:45.983 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:33:45.983 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:33:45.983 INFO:teuthology.orchestra.run.trial028.stdout: "00490591-c217-4014-812b-79c74b3f6ef8": { 2026-02-20T03:33:45.983 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:33:45.983 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "00490591-c217-4014-812b-79c74b3f6ef8", 2026-02-20T03:33:45.983 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:33:45.983 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:33:45.983 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:33:45.983 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:33:45.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d6eff1640 1 -- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d440b11a0 msgr2=0x7f3d440b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d440b11a0 0x7f3d440b3660 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3d68076c20 tx=0x7f3d64009250 comp rx=0 tx=0).stop 2026-02-20T03:33:45.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d6eff1640 1 -- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 msgr2=0x7f3d681a7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:45.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.975+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 0x7f3d681a7ab0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009950 tx=0x7f3d50002910 comp rx=0 tx=0).stop 2026-02-20T03:33:45.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.979+0000 7f3d6eff1640 1 -- 10.20.193.28:0/420017877 shutdown_connections 2026-02-20T03:33:45.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.979+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3d440b11a0 0x7f3d440b3660 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.979+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3d681137e0 0x7f3d681a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.979+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3d6810ab50 0x7f3d681a7ab0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.979+0000 7f3d6eff1640 1 --2- 10.20.193.28:0/420017877 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3d6810a230 0x7f3d681a7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:45.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.979+0000 7f3d6eff1640 1 -- 10.20.193.28:0/420017877 >> 10.20.193.28:0/420017877 conn(0x7f3d68078920 msgr2=0x7f3d680790d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:45.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.979+0000 7f3d6eff1640 1 -- 10.20.193.28:0/420017877 shutdown_connections 2026-02-20T03:33:45.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:33:45.979+0000 7f3d6eff1640 1 -- 10.20.193.28:0/420017877 wait complete. 2026-02-20T03:33:46.137 INFO:tasks.cephfs.filesystem:scrub status for tag:00490591-c217-4014-812b-79c74b3f6ef8 - {'path': '/', 'tag': '00490591-c217-4014-812b-79c74b3f6ef8', 'options': 'recursive,force'} 2026-02-20T03:33:46.662 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:46 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:33:46.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:46 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:46.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:46 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:33:46.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:46 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:33:46.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:46 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:46.663 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:46 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:46.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 20.80 MB/sec execute 197 sec latency 45169.084 ms 2026-02-20T03:33:46.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:46 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:33:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:46 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:46 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:33:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:46 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:33:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:46 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:46.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:46 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:46 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:33:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:46 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:46 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:33:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:46 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:33:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:46 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:46.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:46 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:47.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:47 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:47.497 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:47 trial028 ceph-mon[38552]: pgmap v759: 129 pgs: 129 active+clean; 724 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 724 KiB/s rd, 3.8 MiB/s wr, 230 op/s 2026-02-20T03:33:47.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 20.70 MB/sec execute 198 sec latency 46169.138 ms 2026-02-20T03:33:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:47 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:47 trial177 ceph-mon[43181]: pgmap v759: 129 pgs: 129 active+clean; 724 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 724 KiB/s rd, 3.8 MiB/s wr, 230 op/s 2026-02-20T03:33:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:47 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:33:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:47 trial126 ceph-mon[38476]: pgmap v759: 129 pgs: 129 active+clean; 724 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 724 KiB/s rd, 3.8 MiB/s wr, 230 op/s 2026-02-20T03:33:48.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:48 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:33:48.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 20.59 MB/sec execute 199 sec latency 47169.183 ms 2026-02-20T03:33:48.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:48 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:33:48.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:48 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:33:48.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- 10.20.193.28:0/472790408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12341064e0 msgr2=0x7f123410cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:48.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 --2- 10.20.193.28:0/472790408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12341064e0 0x7f123410cd70 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f123000b0a0 tx=0x7f123002f450 comp rx=0 tx=0).stop 2026-02-20T03:33:48.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- 10.20.193.28:0/472790408 shutdown_connections 2026-02-20T03:33:48.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 --2- 10.20.193.28:0/472790408 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f12341064e0 0x7f123410cd70 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 --2- 10.20.193.28:0/472790408 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1234105b20 0x7f1234105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 --2- 10.20.193.28:0/472790408 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1234104930 0x7f1234104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- 10.20.193.28:0/472790408 >> 10.20.193.28:0/472790408 conn(0x7f12341000b0 msgr2=0x7f12341024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- 10.20.193.28:0/472790408 shutdown_connections 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- 10.20.193.28:0/472790408 wait complete. 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 Processor -- start 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- start start 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1234104930 0x7f123419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1234105b20 0x7f123419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12341064e0 0x7f12341a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1234110540 con 0x7f1234105b20 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f12341103c0 con 0x7f12341064e0 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12341106c0 con 0x7f1234104930 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1239083640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1234105b20 0x7f123419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1239083640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1234105b20 0x7f123419d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55612/0 (socket says 10.20.193.28:55612) 2026-02-20T03:33:48.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1239083640 1 -- 10.20.193.28:0/72862591 learned_addr learned my addr 10.20.193.28:0/72862591 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:48.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1239083640 1 -- 10.20.193.28:0/72862591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1234104930 msgr2=0x7f123419cb50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:48.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1239083640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1234104930 0x7f123419cb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1239083640 1 -- 10.20.193.28:0/72862591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12341064e0 msgr2=0x7f12341a4100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:33:48.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1239083640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12341064e0 0x7f12341a4100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1239083640 1 -- 10.20.193.28:0/72862591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12341a4800 con 0x7f1234105b20 2026-02-20T03:33:48.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1239083640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1234105b20 0x7f123419d090 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f122800b570 tx=0x7f122800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:48.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1222ffd640 1 -- 10.20.193.28:0/72862591 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1228013020 con 0x7f1234105b20 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1222ffd640 1 -- 10.20.193.28:0/72862591 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1228004480 con 0x7f1234105b20 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- 10.20.193.28:0/72862591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12341a4af0 con 0x7f1234105b20 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f1222ffd640 1 -- 10.20.193.28:0/72862591 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122800fb50 con 0x7f1234105b20 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.872+0000 7f123a886640 1 -- 10.20.193.28:0/72862591 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12341a5040 con 0x7f1234105b20 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f1222ffd640 1 -- 10.20.193.28:0/72862591 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1228002780 con 0x7f1234105b20 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123ea4ae00 1 Processor -- start 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123ea4ae00 1 -- start start 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93df280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93df7c0 0x560df93e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93e4560 0x560df93e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560df932f8f0 con 0x560df93dee80 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560df92dd2e0 con 0x560df93df7c0 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560df932b820 con 0x560df93e4560 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123a085640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93df280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123a085640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93df280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55624/0 (socket says 10.20.193.28:55624) 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123a085640 1 -- 10.20.193.28:0/1838495194 learned_addr learned my addr 10.20.193.28:0/1838495194 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123a085640 1 -- 10.20.193.28:0/1838495194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93e4560 msgr2=0x560df93e69f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123a085640 1 --2- 10.20.193.28:0/1838495194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93e4560 0x560df93e69f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123a085640 1 -- 10.20.193.28:0/1838495194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93df7c0 msgr2=0x560df93e3f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123a085640 1 --2- 10.20.193.28:0/1838495194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93df7c0 0x560df93e3f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.883 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123a085640 1 -- 10.20.193.28:0/1838495194 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df92cf5a0 con 0x560df93dee80 2026-02-20T03:33:48.888 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f1222ffd640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12100b0e20 0x7f12100b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f123a085640 1 --2- 10.20.193.28:0/1838495194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93df280 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f12300045f0 tx=0x7f1230009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cf73c46a36548f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.877+0000 7f1222ffd640 1 -- 10.20.193.28:0/72862591 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f12280e0570 con 0x7f1234105b20 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1201bfe640 1 -- 10.20.193.28:0/1838495194 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230004070 con 0x560df93dee80 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1201bfe640 1 -- 10.20.193.28:0/1838495194 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1230033070 con 0x560df93dee80 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1201bfe640 1 -- 10.20.193.28:0/1838495194 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230002cc0 con 0x560df93dee80 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12100b0e20 0x7f12100b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- 10.20.193.28:0/1838495194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 msgr2=0x560df93df280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/1838495194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93df280 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f12300045f0 tx=0x7f1230009d70 comp rx=0 tx=0).stop 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12100b0e20 0x7f12100b32e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x560df93dfeb0 tx=0x7f1224006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- 10.20.193.28:0/1838495194 shutdown_connections 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/1838495194 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93e4560 0x560df93e69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/1838495194 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93df7c0 0x560df93e3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/1838495194 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93df280 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- 10.20.193.28:0/1838495194 >> 10.20.193.28:0/1838495194 conn(0x560df93d66f0 msgr2=0x560df93dd570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- 10.20.193.28:0/1838495194 shutdown_connections 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- 10.20.193.28:0/1838495194 wait complete. 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- start start 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 Processor -- start 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93df7c0 0x560df93f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93e4560 0x560df93fef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560df92d70c0 con 0x560df93dee80 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560df93e75b0 con 0x560df93e4560 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560df93ff4b0 con 0x560df93df7c0 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93f7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55628/0 (socket says 10.20.193.28:55628) 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 -- 10.20.193.28:0/3518358853 learned_addr learned my addr 10.20.193.28:0/3518358853 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 -- 10.20.193.28:0/3518358853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93df7c0 msgr2=0x560df93f7fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93df7c0 0x560df93f7fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 -- 10.20.193.28:0/3518358853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93e4560 msgr2=0x560df93fef20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93e4560 0x560df93fef20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 -- 10.20.193.28:0/3518358853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df93f1170 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f1239884640 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93f7a60 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1224004690 tx=0x7f12240047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd696ee0f43aa3a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f11eeffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f11eeffd640 1 -- 10.20.193.28:0/3518358853 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122400b730 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f11eeffd640 1 -- 10.20.193.28:0/3518358853 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f122400bd70 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f11eeffd640 1 -- 10.20.193.28:0/3518358853 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224011dc0 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3518358853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df92eb820 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 10 client.20763 _ll_register_callbacks cb 0x560df92daff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3518358853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560df93374e0 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f11eeffd640 1 -- 10.20.193.28:0/3518358853 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f1224013410 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f11eeffd640 1 -- 10.20.193.28:0/3518358853 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f12240136b0 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 10 client.20763 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3518358853 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x560df92f0380 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f11eeffd640 1 -- 10.20.193.28:0/3518358853 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f1224028030 con 0x560df93dee80 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 10 client.20763 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 10 client.20763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 20 client.20763 populate_metadata read hostname 'trial028' 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560df9403920 0x560df9405dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 4 client.20763 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:33:48.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.880+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3518358853 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560df92b1bd0 con 0x560df9403920 2026-02-20T03:33:48.901 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.899+0000 7f1239083640 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560df9403920 0x560df9405dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:48.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.966+0000 7f11eeffd640 10 client.20763 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:48.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.966+0000 7f1239083640 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560df9403920 0x560df9405dc0 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0da5f363ddad9cb server_cookie=5a5d4c88dd239de4 in_seq=0 out_seq=0 2026-02-20T03:33:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f11eeffd640 1 -- 10.20.193.28:0/3518358853 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560df92b1bd0 con 0x560df9403920 2026-02-20T03:33:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f11eeffd640 10 client.20763 handle_command_reply: tid=0 2026-02-20T03:33:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 client.20763 shutdown 2026-02-20T03:33:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3518358853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 msgr2=0x560df93f7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93f7a60 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f1224004690 tx=0x7f12240047e0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3518358853 shutdown_connections 2026-02-20T03:33:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560df9403920 0x560df9405dc0 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93e4560 0x560df93fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93df7c0 0x560df93f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3518358853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93f7a60 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3518358853 >> 10.20.193.28:0/3518358853 conn(0x560df93d66f0 msgr2=0x560df93e5910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f11eeffd640 0 client.20763 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3518358853 shutdown_connections 2026-02-20T03:33:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3518358853 wait complete. 2026-02-20T03:33:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.979+0000 7f123ea4ae00 20 client.20763 trim_cache size 0 max 16384 2026-02-20T03:33:48.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 Processor -- start 2026-02-20T03:33:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 -- start start 2026-02-20T03:33:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93dee80 0x560df93f7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93df7c0 0x560df93feee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93e4560 0x560df93f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11e00126f0 con 0x560df93df7c0 2026-02-20T03:33:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11e000ffc0 con 0x560df93e4560 2026-02-20T03:33:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11e000de10 con 0x560df93dee80 2026-02-20T03:33:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f1239083640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93df7c0 0x560df93feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f1239083640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93df7c0 0x560df93feee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55644/0 (socket says 10.20.193.28:55644) 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f1239083640 1 -- 10.20.193.28:0/3546673789 learned_addr learned my addr 10.20.193.28:0/3546673789 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f1239083640 1 -- 10.20.193.28:0/3546673789 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93dee80 msgr2=0x560df93f7120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f1239083640 1 --2- 10.20.193.28:0/3546673789 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93dee80 0x560df93f7120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f1239083640 1 -- 10.20.193.28:0/3546673789 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93e4560 msgr2=0x560df93f7660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f1239083640 1 --2- 10.20.193.28:0/3546673789 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93e4560 0x560df93f7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f1239083640 1 -- 10.20.193.28:0/3546673789 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df93f0fa0 con 0x560df93df7c0 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f1239083640 1 --2- 10.20.193.28:0/3546673789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93df7c0 0x560df93feee0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f12280e0810 tx=0x7f12280047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1810c203898531 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f12013fd640 1 -- 10.20.193.28:0/3546673789 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280ac600 con 0x560df93df7c0 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f12013fd640 1 -- 10.20.193.28:0/3546673789 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f12280b14b0 con 0x560df93df7c0 2026-02-20T03:33:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f12013fd640 1 -- 10.20.193.28:0/3546673789 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280e0180 con 0x560df93df7c0 2026-02-20T03:33:48.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3546673789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93df7c0 msgr2=0x560df93feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:48.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3546673789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93df7c0 0x560df93feee0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f12280e0810 tx=0x7f12280047e0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3546673789 shutdown_connections 2026-02-20T03:33:48.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3546673789 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93e4560 0x560df93f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3546673789 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93df7c0 0x560df93feee0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/3546673789 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93dee80 0x560df93f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:48.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3546673789 >> 10.20.193.28:0/3546673789 conn(0x560df93d66f0 msgr2=0x560df93f6990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:48.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3546673789 shutdown_connections 2026-02-20T03:33:48.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.984+0000 7f123ea4ae00 1 -- 10.20.193.28:0/3546673789 wait complete. 2026-02-20T03:33:48.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 -- start start 2026-02-20T03:33:48.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 Processor -- start 2026-02-20T03:33:48.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93fce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93df7c0 0x560df93fd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:48.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93e4560 0x560df93fe390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f11e000e480 con 0x560df93dee80 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f11e000f8f0 con 0x560df93df7c0 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f11e000eb50 con 0x560df93e4560 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f1239884640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93fce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f1239884640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93fce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55646/0 (socket says 10.20.193.28:55646) 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f1239884640 1 -- 10.20.193.28:0/76456879 learned_addr learned my addr 10.20.193.28:0/76456879 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f1239884640 1 -- 10.20.193.28:0/76456879 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93e4560 msgr2=0x560df93fe390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f1239884640 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93e4560 0x560df93fe390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f1239884640 1 -- 10.20.193.28:0/76456879 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93df7c0 msgr2=0x560df93fd360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:33:49.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f1239884640 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93df7c0 0x560df93fd360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f1239884640 1 -- 10.20.193.28:0/76456879 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df93f8a70 con 0x560df93dee80 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f1239884640 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93fce20 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f1224013680 tx=0x7f1224006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ad6b51f80dbba1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f11eeffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f11eeffd640 1 -- 10.20.193.28:0/76456879 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224013410 con 0x560df93dee80 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f11eeffd640 1 -- 10.20.193.28:0/76456879 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x560df93374e0 con 0x560df93dee80 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f11eeffd640 1 -- 10.20.193.28:0/76456879 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1224013850 con 0x560df93dee80 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 -- 10.20.193.28:0/76456879 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df908f690 con 0x560df93dee80 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f11eeffd640 1 -- 10.20.193.28:0/76456879 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f12240139f0 con 0x560df93dee80 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 10 client.20769 _ll_register_callbacks cb 0x7f1224004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:33:49.001 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 -- 10.20.193.28:0/76456879 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1230033070 con 0x560df93dee80 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f11eeffd640 1 -- 10.20.193.28:0/76456879 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f1224011d70 con 0x560df93dee80 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 10 client.20769 fetch_fsmap learned FSMap version 44 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 -- 10.20.193.28:0/76456879 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x560df92f4b70 con 0x560df93dee80 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f11eeffd640 1 -- 10.20.193.28:0/76456879 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f1224028070 con 0x560df93dee80 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 10 client.20769 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 10 client.20769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 20 client.20769 populate_metadata read hostname 'trial028' 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560df946f430 0x560df94718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 4 client.20769 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:33:49.002 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:48.989+0000 7f123ea4ae00 1 -- 10.20.193.28:0/76456879 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560df93006b0 con 0x560df946f430 2026-02-20T03:33:49.009 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.006+0000 7f1239083640 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560df946f430 0x560df94718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:33:49.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.073+0000 7f1239083640 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560df946f430 0x560df94718f0 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70def82c3973fcbd server_cookie=e427ea9ee09ca97b in_seq=0 out_seq=0 2026-02-20T03:33:49.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.073+0000 7f11eeffd640 10 client.20769 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:49.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f11eeffd640 1 -- 10.20.193.28:0/76456879 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560df93006b0 con 0x560df946f430 2026-02-20T03:33:49.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f11eeffd640 10 client.20769 handle_command_reply: tid=0 2026-02-20T03:33:49.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 client.20769 shutdown 2026-02-20T03:33:49.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 -- 10.20.193.28:0/76456879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 msgr2=0x560df93fce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:49.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93fce20 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f1224013680 tx=0x7f1224006e20 comp rx=0 tx=0).stop 2026-02-20T03:33:49.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 -- 10.20.193.28:0/76456879 shutdown_connections 2026-02-20T03:33:49.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560df946f430 0x560df94718f0 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560df93e4560 0x560df93fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560df93df7c0 0x560df93fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 --2- 10.20.193.28:0/76456879 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560df93dee80 0x560df93fce20 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 -- 10.20.193.28:0/76456879 >> 10.20.193.28:0/76456879 conn(0x560df93d66f0 msgr2=0x560df93dfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:49.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f11eeffd640 0 client.20769 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:33:49.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 -- 10.20.193.28:0/76456879 shutdown_connections 2026-02-20T03:33:49.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 1 -- 10.20.193.28:0/76456879 wait complete. 2026-02-20T03:33:49.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123ea4ae00 20 client.20769 trim_cache size 0 max 16384 2026-02-20T03:33:49.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:33:49.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:33:49.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:33:49.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:33:49.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 -- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12100b0e20 msgr2=0x7f12100b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:49.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12100b0e20 0x7f12100b32e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x560df93dfeb0 tx=0x7f1224006cd0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 -- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1234105b20 msgr2=0x7f123419d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:33:49.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1234105b20 0x7f123419d090 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f122800b570 tx=0x7f122800ba40 comp rx=0 tx=0).stop 2026-02-20T03:33:49.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 -- 10.20.193.28:0/72862591 shutdown_connections 2026-02-20T03:33:49.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f12100b0e20 0x7f12100b32e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f12341064e0 0x7f12341a4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1234105b20 0x7f123419d090 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 --2- 10.20.193.28:0/72862591 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1234104930 0x7f123419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:33:49.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.141+0000 7f123a886640 1 -- 10.20.193.28:0/72862591 >> 10.20.193.28:0/72862591 conn(0x7f12341000b0 msgr2=0x7f1234108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:33:49.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.142+0000 7f123a886640 1 -- 10.20.193.28:0/72862591 shutdown_connections 2026-02-20T03:33:49.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:33:49.142+0000 7f123a886640 1 -- 10.20.193.28:0/72862591 wait complete. 2026-02-20T03:33:49.668 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:49 trial028 ceph-mon[38552]: pgmap v760: 129 pgs: 129 active+clean; 689 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 746 KiB/s rd, 1.1 MiB/s wr, 243 op/s 2026-02-20T03:33:49.669 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:33:49.669 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:33:49.669 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:33:49.712 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 20.49 MB/sec execute 200 sec latency 48169.226 ms 2026-02-20T03:33:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:49 trial177 ceph-mon[43181]: pgmap v760: 129 pgs: 129 active+clean; 689 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 746 KiB/s rd, 1.1 MiB/s wr, 243 op/s 2026-02-20T03:33:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:33:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:33:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:33:49.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:49 trial126 ceph-mon[38476]: pgmap v760: 129 pgs: 129 active+clean; 689 MiB data, 8.2 GiB used, 8.2 TiB / 8.2 TiB avail; 746 KiB/s rd, 1.1 MiB/s wr, 243 op/s 2026-02-20T03:33:49.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:33:49.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:33:49.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:33:50.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 20.39 MB/sec execute 201 sec latency 49169.268 ms 2026-02-20T03:33:51.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:51 trial028 ceph-mon[38552]: pgmap v761: 129 pgs: 129 active+clean; 646 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 840 KiB/s rd, 929 KiB/s wr, 334 op/s 2026-02-20T03:33:51.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 20.29 MB/sec execute 202 sec latency 50169.300 ms 2026-02-20T03:33:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:51 trial126 ceph-mon[38476]: pgmap v761: 129 pgs: 129 active+clean; 646 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 840 KiB/s rd, 929 KiB/s wr, 334 op/s 2026-02-20T03:33:51.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:51 trial177 ceph-mon[43181]: pgmap v761: 129 pgs: 129 active+clean; 646 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 840 KiB/s rd, 929 KiB/s wr, 334 op/s 2026-02-20T03:33:52.633 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:52 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:33:52.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 20.19 MB/sec execute 203 sec latency 51169.324 ms 2026-02-20T03:33:52.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:52 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:33:52.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:52 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:33:53.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 20.09 MB/sec execute 204 sec latency 52169.352 ms 2026-02-20T03:33:53.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:53 trial028 ceph-mon[38552]: pgmap v762: 129 pgs: 129 active+clean; 632 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 828 KiB/s rd, 775 KiB/s wr, 340 op/s 2026-02-20T03:33:53.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:53 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:33:53.716 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:53 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:33:53.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:53 trial126 ceph-mon[38476]: pgmap v762: 129 pgs: 129 active+clean; 632 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 828 KiB/s rd, 775 KiB/s wr, 340 op/s 2026-02-20T03:33:53.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:53 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:33:53.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:53 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:33:53.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:53 trial177 ceph-mon[43181]: pgmap v762: 129 pgs: 129 active+clean; 632 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 828 KiB/s rd, 775 KiB/s wr, 340 op/s 2026-02-20T03:33:53.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:53 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:33:53.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:53 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:33:54.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136932 19.99 MB/sec execute 205 sec latency 53169.389 ms 2026-02-20T03:33:55.570 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:55 trial028 ceph-mon[38552]: pgmap v763: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 417 KiB/s rd, 360 KiB/s wr, 318 op/s 2026-02-20T03:33:55.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.89 MB/sec execute 206 sec latency 54169.413 ms 2026-02-20T03:33:55.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:55 trial126 ceph-mon[38476]: pgmap v763: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 417 KiB/s rd, 360 KiB/s wr, 318 op/s 2026-02-20T03:33:55.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:55 trial177 ceph-mon[43181]: pgmap v763: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 417 KiB/s rd, 360 KiB/s wr, 318 op/s 2026-02-20T03:33:56.650 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:56 trial028 ceph-mon[38552]: pgmap v764: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 363 KiB/s rd, 305 KiB/s wr, 283 op/s 2026-02-20T03:33:56.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.80 MB/sec execute 207 sec latency 55169.436 ms 2026-02-20T03:33:56.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:56 trial126 ceph-mon[38476]: pgmap v764: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 363 KiB/s rd, 305 KiB/s wr, 283 op/s 2026-02-20T03:33:56.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:56 trial177 ceph-mon[43181]: pgmap v764: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 363 KiB/s rd, 305 KiB/s wr, 283 op/s 2026-02-20T03:33:57.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.70 MB/sec execute 208 sec latency 56169.459 ms 2026-02-20T03:33:58.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.61 MB/sec execute 209 sec latency 57169.483 ms 2026-02-20T03:33:59.373 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:33:59 trial028 ceph-mon[38552]: pgmap v765: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 125 KiB/s rd, 75 KiB/s wr, 199 op/s 2026-02-20T03:33:59.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.51 MB/sec execute 210 sec latency 58169.509 ms 2026-02-20T03:33:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:33:59 trial177 ceph-mon[43181]: pgmap v765: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 125 KiB/s rd, 75 KiB/s wr, 199 op/s 2026-02-20T03:33:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:33:59 trial126 ceph-mon[38476]: pgmap v765: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 125 KiB/s rd, 75 KiB/s wr, 199 op/s 2026-02-20T03:34:00.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.42 MB/sec execute 211 sec latency 59169.535 ms 2026-02-20T03:34:01.507 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:01 trial028 ceph-mon[38552]: pgmap v766: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 104 KiB/s rd, 70 KiB/s wr, 136 op/s 2026-02-20T03:34:01.647 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:01 trial126 ceph-mon[38476]: pgmap v766: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 104 KiB/s rd, 70 KiB/s wr, 136 op/s 2026-02-20T03:34:01.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.33 MB/sec execute 212 sec latency 60169.561 ms 2026-02-20T03:34:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:01 trial177 ceph-mon[43181]: pgmap v766: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 104 KiB/s rd, 70 KiB/s wr, 136 op/s 2026-02-20T03:34:02.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/293799467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 msgr2=0x7f9a1810cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:02.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/293799467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 0x7f9a1810cd80 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800b0a0 tx=0x7f9a0802f410 comp rx=0 tx=0).stop 2026-02-20T03:34:02.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/293799467 shutdown_connections 2026-02-20T03:34:02.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/293799467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 0x7f9a1810cd80 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/293799467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a18105b30 0x7f9a18105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/293799467 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a18104940 0x7f9a18104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/293799467 >> 10.20.193.28:0/293799467 conn(0x7f9a181000c0 msgr2=0x7f9a181024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/293799467 shutdown_connections 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/293799467 wait complete. 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 Processor -- start 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- start start 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a18104940 0x7f9a1819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a18105b30 0x7f9a1819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 0x7f9a181a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a18110430 con 0x7f9a181064f0 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181102b0 con 0x7f9a18105b30 2026-02-20T03:34:02.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181105b0 con 0x7f9a18104940 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 0x7f9a181a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a16d76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a18104940 0x7f9a1819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a16d76640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a18104940 0x7f9a1819c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:50280/0 (socket says 10.20.193.28:50280) 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a17577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 0x7f9a181a3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44136/0 (socket says 10.20.193.28:44136) 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a16d76640 1 -- 10.20.193.28:0/3699945946 learned_addr learned my addr 10.20.193.28:0/3699945946 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a16575640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a18105b30 0x7f9a1819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a17577640 1 -- 10.20.193.28:0/3699945946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a18104940 msgr2=0x7f9a1819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a17577640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a18104940 0x7f9a1819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a17577640 1 -- 10.20.193.28:0/3699945946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a18105b30 msgr2=0x7f9a1819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a17577640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a18105b30 0x7f9a1819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a17577640 1 -- 10.20.193.28:0/3699945946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a181a4660 con 0x7f9a181064f0 2026-02-20T03:34:02.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a17577640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 0x7f9a181a3f60 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f9a080062a0 tx=0x7f9a08004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:02.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f99f7fff640 1 -- 10.20.193.28:0/3699945946 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08002a60 con 0x7f9a181064f0 2026-02-20T03:34:02.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f99f7fff640 1 -- 10.20.193.28:0/3699945946 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9a08002c00 con 0x7f9a181064f0 2026-02-20T03:34:02.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f99f7fff640 1 -- 10.20.193.28:0/3699945946 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08038710 con 0x7f9a181064f0 2026-02-20T03:34:02.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/3699945946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a181a48f0 con 0x7f9a181064f0 2026-02-20T03:34:02.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.217+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/3699945946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a181a4d30 con 0x7f9a181064f0 2026-02-20T03:34:02.228 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 Processor -- start 2026-02-20T03:34:02.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f99f7fff640 1 -- 10.20.193.28:0/3699945946 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9a080076a0 con 0x7f9a181064f0 2026-02-20T03:34:02.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- start start 2026-02-20T03:34:02.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 0x563336321280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 0x563336325f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336326560 0x5633363289f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5633362718f0 con 0x563336326560 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56333621f2e0 con 0x5633363217c0 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56333626d820 con 0x563336320e80 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336326560 0x5633363289f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336326560 0x5633363289f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44150/0 (socket says 10.20.193.28:44150) 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 -- 10.20.193.28:0/147325641 learned_addr learned my addr 10.20.193.28:0/147325641 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 --2- 10.20.193.28:0/147325641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 0x563336321280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16d76640 1 --2- 10.20.193.28:0/147325641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 0x563336325f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 -- 10.20.193.28:0/147325641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 msgr2=0x563336321280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:02.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 --2- 10.20.193.28:0/147325641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 0x563336321280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 -- 10.20.193.28:0/147325641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 msgr2=0x563336325f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 --2- 10.20.193.28:0/147325641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 0x563336325f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 -- 10.20.193.28:0/147325641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633362115a0 con 0x563336326560 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16575640 1 --2- 10.20.193.28:0/147325641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336326560 0x5633363289f0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009ed0 tx=0x7f9a000097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa22c371f81290a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f99f53fe640 1 -- 10.20.193.28:0/147325641 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a000040d0 con 0x563336326560 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f99f53fe640 1 -- 10.20.193.28:0/147325641 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9a00010d40 con 0x563336326560 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f99f53fe640 1 -- 10.20.193.28:0/147325641 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00002c10 con 0x563336326560 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- 10.20.193.28:0/147325641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336326560 msgr2=0x5633363289f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 --2- 10.20.193.28:0/147325641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336326560 0x5633363289f0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009ed0 tx=0x7f9a000097e0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- 10.20.193.28:0/147325641 shutdown_connections 2026-02-20T03:34:02.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 --2- 10.20.193.28:0/147325641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336326560 0x5633363289f0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 --2- 10.20.193.28:0/147325641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 0x563336325f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 --2- 10.20.193.28:0/147325641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 0x563336321280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- 10.20.193.28:0/147325641 >> 10.20.193.28:0/147325641 conn(0x5633363186f0 msgr2=0x56333631f570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:02.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- 10.20.193.28:0/147325641 shutdown_connections 2026-02-20T03:34:02.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f99f7fff640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99ec0b0dd0 0x7f99ec0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f99f7fff640 1 -- 10.20.193.28:0/3699945946 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9a08105440 con 0x7f9a181064f0 2026-02-20T03:34:02.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- 10.20.193.28:0/147325641 wait complete. 2026-02-20T03:34:02.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16d76640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99ec0b0dd0 0x7f99ec0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a16d76640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99ec0b0dd0 0x7f99ec0b3290 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x563336321eb0 tx=0x7f9a0c007450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 -- start start 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.222+0000 7f9a20039e00 1 Processor -- start 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x5633363399c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 0x563336339f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336326560 0x563336340e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5633362190c0 con 0x563336320e80 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563336329610 con 0x5633363217c0 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563336341410 con 0x563336326560 2026-02-20T03:34:02.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x5633363399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x5633363399c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44154/0 (socket says 10.20.193.28:44154) 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16d76640 1 -- 10.20.193.28:0/3928977945 learned_addr learned my addr 10.20.193.28:0/3928977945 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a17577640 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336326560 0x563336340e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16575640 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 0x563336339f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16d76640 1 -- 10.20.193.28:0/3928977945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336326560 msgr2=0x563336340e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16d76640 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336326560 0x563336340e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16d76640 1 -- 10.20.193.28:0/3928977945 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 msgr2=0x563336339f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16d76640 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 0x563336339f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16d76640 1 -- 10.20.193.28:0/3928977945 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633363330e0 con 0x563336320e80 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16d76640 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x5633363399c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c002f60 tx=0x7f9a0c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561ff71940b0d8d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 1 -- 10.20.193.28:0/3928977945 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c012e40 con 0x563336320e80 2026-02-20T03:34:02.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 1 -- 10.20.193.28:0/3928977945 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9a0c024020 con 0x563336320e80 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 1 -- 10.20.193.28:0/3928977945 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c01f9a0 con 0x563336320e80 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- 10.20.193.28:0/3928977945 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56333622d820 con 0x563336320e80 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 1 -- 10.20.193.28:0/3928977945 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9a0c01fb80 con 0x563336320e80 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 10 client.20781 _ll_register_callbacks cb 0x56333621cff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- 10.20.193.28:0/3928977945 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5633362794e0 con 0x563336320e80 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 1 -- 10.20.193.28:0/3928977945 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9a0c023030 con 0x563336320e80 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 10 client.20781 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- 10.20.193.28:0/3928977945 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x563336232380 con 0x563336320e80 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 1 -- 10.20.193.28:0/3928977945 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f9a0c010670 con 0x563336320e80 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 10 client.20781 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 10 client.20781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:02.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 20 client.20781 populate_metadata read hostname 'trial028' 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563336345860 0x563336347d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 4 client.20781 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- 10.20.193.28:0/3928977945 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633361f3bd0 con 0x563336345860 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16575640 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563336345860 0x563336347d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a16575640 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563336345860 0x563336347d00 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cb32d0d5bdb4a45 server_cookie=5f1d6a270bd44e15 in_seq=0 out_seq=0 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 10 client.20781 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 1 -- 10.20.193.28:0/3928977945 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5633361f3bd0 con 0x563336345860 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 10 client.20781 handle_command_reply: tid=0 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 client.20781 shutdown 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- 10.20.193.28:0/3928977945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 msgr2=0x5633363399c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:02.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x5633363399c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c002f60 tx=0x7f9a0c0047c0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- 10.20.193.28:0/3928977945 shutdown_connections 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563336345860 0x563336347d00 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336326560 0x563336340e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5633363217c0 0x563336339f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3928977945 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x5633363399c0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- 10.20.193.28:0/3928977945 >> 10.20.193.28:0/3928977945 conn(0x5633363186f0 msgr2=0x5633363278b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f99e0bfc640 0 client.20781 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- 10.20.193.28:0/3928977945 shutdown_connections 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 1 -- 10.20.193.28:0/3928977945 wait complete. 2026-02-20T03:34:02.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.227+0000 7f9a20039e00 20 client.20781 trim_cache size 0 max 16384 2026-02-20T03:34:02.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 Processor -- start 2026-02-20T03:34:02.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- start start 2026-02-20T03:34:02.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 0x563336337f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5633363217c0 0x563336340e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 0x5633363375a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc0126f0 con 0x5633363217c0 2026-02-20T03:34:02.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc00ffc0 con 0x563336326560 2026-02-20T03:34:02.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc00de10 con 0x563336320e80 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5633363217c0 0x563336340e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5633363217c0 0x563336340e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44160/0 (socket says 10.20.193.28:44160) 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 -- 10.20.193.28:0/3735907057 learned_addr learned my addr 10.20.193.28:0/3735907057 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a17577640 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 0x5633363375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 0x563336337f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 -- 10.20.193.28:0/3735907057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 msgr2=0x563336337f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 0x563336337f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 -- 10.20.193.28:0/3735907057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 msgr2=0x5633363375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 0x5633363375a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 -- 10.20.193.28:0/3735907057 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563336332f10 con 0x5633363217c0 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 0x563336337f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:02.247 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5633363217c0 0x563336340e40 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f9a0001c000 tx=0x7f9a00010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1575a9f96d62f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f99f4bfd640 1 -- 10.20.193.28:0/3735907057 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00010aa0 con 0x5633363217c0 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f99f4bfd640 1 -- 10.20.193.28:0/3735907057 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9a00005140 con 0x5633363217c0 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f99f4bfd640 1 -- 10.20.193.28:0/3735907057 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00002ad0 con 0x5633363217c0 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- 10.20.193.28:0/3735907057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5633363217c0 msgr2=0x563336340e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5633363217c0 0x563336340e40 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f9a0001c000 tx=0x7f9a00010ef0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- 10.20.193.28:0/3735907057 shutdown_connections 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 0x5633363375a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5633363217c0 0x563336340e40 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- 10.20.193.28:0/3735907057 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563336320e80 0x563336337f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- 10.20.193.28:0/3735907057 >> 10.20.193.28:0/3735907057 conn(0x5633363186f0 msgr2=0x563336336e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- 10.20.193.28:0/3735907057 shutdown_connections 2026-02-20T03:34:02.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- 10.20.193.28:0/3735907057 wait complete. 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- start start 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 Processor -- start 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x56333633cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5633363217c0 0x56333633d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 0x5633363402c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc00e480 con 0x563336320e80 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc00f8f0 con 0x563336326560 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f99bc00eb50 con 0x5633363217c0 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x56333633cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x56333633cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44170/0 (socket says 10.20.193.28:44170) 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 -- 10.20.193.28:0/870800785 learned_addr learned my addr 10.20.193.28:0/870800785 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:02.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5633363217c0 0x56333633d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a17577640 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 0x5633363402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 -- 10.20.193.28:0/870800785 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5633363217c0 msgr2=0x56333633d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5633363217c0 0x56333633d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 -- 10.20.193.28:0/870800785 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 msgr2=0x5633363402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 0x5633363402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 -- 10.20.193.28:0/870800785 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633363441a0 con 0x563336320e80 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16575640 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5633363217c0 0x56333633d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a16d76640 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x56333633cfb0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c002fb0 tx=0x7f9a0c013dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e71339c1a4ad5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f99e0bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f99e0bfc640 1 -- 10.20.193.28:0/870800785 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c03d030 con 0x563336320e80 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f99e0bfc640 1 -- 10.20.193.28:0/870800785 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5633362794e0 con 0x563336320e80 2026-02-20T03:34:02.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- 10.20.193.28:0/870800785 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563335fd1690 con 0x563336320e80 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f99e0bfc640 1 -- 10.20.193.28:0/870800785 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c004b60 con 0x563336320e80 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 10 client.20787 _ll_register_callbacks cb 0x7f9a0c007e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.237+0000 7f9a20039e00 1 -- 10.20.193.28:0/870800785 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a00010d40 con 0x563336320e80 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f99e0bfc640 1 -- 10.20.193.28:0/870800785 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9a0c004d00 con 0x563336320e80 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f99e0bfc640 1 -- 10.20.193.28:0/870800785 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9a0c005020 con 0x563336320e80 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a20039e00 10 client.20787 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a20039e00 1 -- 10.20.193.28:0/870800785 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x563336236b70 con 0x563336320e80 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f99e0bfc640 1 -- 10.20.193.28:0/870800785 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f9a0c04a050 con 0x563336320e80 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a20039e00 10 client.20787 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a20039e00 10 client.20787 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a20039e00 20 client.20787 populate_metadata read hostname 'trial028' 2026-02-20T03:34:02.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a20039e00 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5633363b9fb0 0x5633363bc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:02.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a20039e00 4 client.20787 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:34:02.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a20039e00 1 -- 10.20.193.28:0/870800785 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56333604a520 con 0x5633363b9fb0 2026-02-20T03:34:02.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a16575640 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5633363b9fb0 0x5633363bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:02.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f9a16575640 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5633363b9fb0 0x5633363bc470 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c39047da5c7cac1a server_cookie=5ecbeb48c059c5f0 in_seq=0 out_seq=0 2026-02-20T03:34:02.252 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.242+0000 7f99e0bfc640 10 client.20787 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:02.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f99e0bfc640 1 -- 10.20.193.28:0/870800785 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56333604a520 con 0x5633363b9fb0 2026-02-20T03:34:02.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f99e0bfc640 10 client.20787 handle_command_reply: tid=0 2026-02-20T03:34:02.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 client.20787 shutdown 2026-02-20T03:34:02.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 -- 10.20.193.28:0/870800785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 msgr2=0x56333633cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:02.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x56333633cfb0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c002fb0 tx=0x7f9a0c013dd0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 -- 10.20.193.28:0/870800785 shutdown_connections 2026-02-20T03:34:02.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5633363b9fb0 0x5633363bc470 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563336326560 0x5633363402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5633363217c0 0x56333633d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 --2- 10.20.193.28:0/870800785 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563336320e80 0x56333633cfb0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f99e0bfc640 0 client.20787 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:02.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 -- 10.20.193.28:0/870800785 >> 10.20.193.28:0/870800785 conn(0x5633363186f0 msgr2=0x563336327870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:02.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 -- 10.20.193.28:0/870800785 shutdown_connections 2026-02-20T03:34:02.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 1 -- 10.20.193.28:0/870800785 wait complete. 2026-02-20T03:34:02.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a20039e00 20 client.20787 trim_cache size 0 max 16384 2026-02-20T03:34:02.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:34:02.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:34:02.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:34:02.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:34:02.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99ec0b0dd0 msgr2=0x7f99ec0b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99ec0b0dd0 0x7f99ec0b3290 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x563336321eb0 tx=0x7f9a0c007450 comp rx=0 tx=0).stop 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 msgr2=0x7f9a181a3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 0x7f9a181a3f60 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f9a080062a0 tx=0x7f9a08004290 comp rx=0 tx=0).stop 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/3699945946 shutdown_connections 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f99ec0b0dd0 0x7f99ec0b3290 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9a181064f0 0x7f9a181a3f60 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9a18105b30 0x7f9a1819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 --2- 10.20.193.28:0/3699945946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9a18104940 0x7f9a1819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/3699945946 >> 10.20.193.28:0/3699945946 conn(0x7f9a181000c0 msgr2=0x7f9a18108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/3699945946 shutdown_connections 2026-02-20T03:34:02.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:02.260+0000 7f9a1c8f9640 1 -- 10.20.193.28:0/3699945946 wait complete. 2026-02-20T03:34:02.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.24 MB/sec execute 213 sec latency 61169.594 ms 2026-02-20T03:34:03.385 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:03 trial028 ceph-mon[38552]: pgmap v767: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 6.8 KiB/s wr, 36 op/s 2026-02-20T03:34:03.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.15 MB/sec execute 214 sec latency 62169.633 ms 2026-02-20T03:34:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:03 trial177 ceph-mon[43181]: pgmap v767: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 6.8 KiB/s wr, 36 op/s 2026-02-20T03:34:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:03 trial126 ceph-mon[38476]: pgmap v767: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 6.8 KiB/s wr, 36 op/s 2026-02-20T03:34:04.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 19.06 MB/sec execute 215 sec latency 63169.663 ms 2026-02-20T03:34:05.515 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:05 trial028 ceph-mon[38552]: pgmap v768: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2026-02-20T03:34:05.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.97 MB/sec execute 216 sec latency 64169.691 ms 2026-02-20T03:34:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:05 trial177 ceph-mon[43181]: pgmap v768: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2026-02-20T03:34:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:05 trial126 ceph-mon[38476]: pgmap v768: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 3.5 KiB/s wr, 12 op/s 2026-02-20T03:34:06.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.88 MB/sec execute 217 sec latency 65169.723 ms 2026-02-20T03:34:07.392 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:07 trial028 ceph-mon[38552]: pgmap v769: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2026-02-20T03:34:07.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.80 MB/sec execute 218 sec latency 66169.750 ms 2026-02-20T03:34:07.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:07 trial177 ceph-mon[43181]: pgmap v769: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2026-02-20T03:34:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:07 trial126 ceph-mon[38476]: pgmap v769: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 4.2 KiB/s wr, 11 op/s 2026-02-20T03:34:08.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.71 MB/sec execute 219 sec latency 67169.784 ms 2026-02-20T03:34:09.523 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:09 trial028 ceph-mon[38552]: pgmap v770: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2026-02-20T03:34:09.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.63 MB/sec execute 220 sec latency 68169.811 ms 2026-02-20T03:34:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:09 trial177 ceph-mon[43181]: pgmap v770: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2026-02-20T03:34:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:09 trial126 ceph-mon[38476]: pgmap v770: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.1 KiB/s rd, 6.3 KiB/s wr, 10 op/s 2026-02-20T03:34:10.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.54 MB/sec execute 221 sec latency 69169.854 ms 2026-02-20T03:34:11.386 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:11 trial028 ceph-mon[38552]: pgmap v771: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 6.3 KiB/s wr, 11 op/s 2026-02-20T03:34:11.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.46 MB/sec execute 222 sec latency 70169.884 ms 2026-02-20T03:34:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:11 trial177 ceph-mon[43181]: pgmap v771: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 6.3 KiB/s wr, 11 op/s 2026-02-20T03:34:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:11 trial126 ceph-mon[38476]: pgmap v771: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 8.3 KiB/s rd, 6.3 KiB/s wr, 11 op/s 2026-02-20T03:34:12.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.38 MB/sec execute 223 sec latency 71169.909 ms 2026-02-20T03:34:13.543 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:13 trial028 ceph-mon[38552]: pgmap v772: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 7.1 KiB/s wr, 10 op/s 2026-02-20T03:34:13.713 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.29 MB/sec execute 224 sec latency 72169.958 ms 2026-02-20T03:34:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:13 trial177 ceph-mon[43181]: pgmap v772: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 7.1 KiB/s wr, 10 op/s 2026-02-20T03:34:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:13 trial126 ceph-mon[38476]: pgmap v772: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.7 KiB/s rd, 7.1 KiB/s wr, 10 op/s 2026-02-20T03:34:14.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.21 MB/sec execute 225 sec latency 73169.984 ms 2026-02-20T03:34:15.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/4030107936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c980759e0 msgr2=0x7f4c98075e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:15.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/4030107936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c980759e0 0x7f4c98075e40 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009a30 tx=0x7f4c8802f220 comp rx=0 tx=0).stop 2026-02-20T03:34:15.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/4030107936 shutdown_connections 2026-02-20T03:34:15.339 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/4030107936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4c9810a5f0 0x7f4c9810ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/4030107936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c980759e0 0x7f4c98075e40 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/4030107936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4c98077050 0x7f4c980754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/4030107936 >> 10.20.193.28:0/4030107936 conn(0x7f4c980fde10 msgr2=0x7f4c98100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:15.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/4030107936 shutdown_connections 2026-02-20T03:34:15.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/4030107936 wait complete. 2026-02-20T03:34:15.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 Processor -- start 2026-02-20T03:34:15.340 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- start start 2026-02-20T03:34:15.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4c980759e0 0x7f4c9819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4c98077050 0x7f4c9819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c9810a5f0 0x7f4c981a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98110410 con 0x7f4c9810a5f0 2026-02-20T03:34:15.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98110290 con 0x7f4c980759e0 2026-02-20T03:34:15.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4c98110590 con 0x7f4c98077050 2026-02-20T03:34:15.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c97fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4c980759e0 0x7f4c9819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c97fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4c980759e0 0x7f4c9819ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59022/0 (socket says 10.20.193.28:59022) 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c977fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4c98077050 0x7f4c9819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c97fff640 1 -- 10.20.193.28:0/3878803474 learned_addr learned my addr 10.20.193.28:0/3878803474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9cbd7640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c9810a5f0 0x7f4c981a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9cbd7640 1 -- 10.20.193.28:0/3878803474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4c98077050 msgr2=0x7f4c9819cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9cbd7640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4c98077050 0x7f4c9819cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9cbd7640 1 -- 10.20.193.28:0/3878803474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4c980759e0 msgr2=0x7f4c9819ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9cbd7640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4c980759e0 0x7f4c9819ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9cbd7640 1 -- 10.20.193.28:0/3878803474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c981a4700 con 0x7f4c9810a5f0 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c97fff640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4c980759e0 0x7f4c9819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9cbd7640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c9810a5f0 0x7f4c981a4000 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00efc0 tx=0x7f4c8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c957fa640 1 -- 10.20.193.28:0/3878803474 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c019070 con 0x7f4c9810a5f0 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c957fa640 1 -- 10.20.193.28:0/3878803474 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4c8c0092d0 con 0x7f4c9810a5f0 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c957fa640 1 -- 10.20.193.28:0/3878803474 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c007500 con 0x7f4c9810a5f0 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/3878803474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c981a4990 con 0x7f4c9810a5f0 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.334+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/3878803474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c981a4eb0 con 0x7f4c9810a5f0 2026-02-20T03:34:15.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c957fa640 1 -- 10.20.193.28:0/3878803474 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4c8c0076a0 con 0x7f4c9810a5f0 2026-02-20T03:34:15.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 Processor -- start 2026-02-20T03:34:15.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- start start 2026-02-20T03:34:15.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a81280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 0x5614a8a85f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8a889f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5614a89d18f0 con 0x5614a8a86560 2026-02-20T03:34:15.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5614a897f2e0 con 0x5614a8a80e80 2026-02-20T03:34:15.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5614a89cd820 con 0x5614a8a817c0 2026-02-20T03:34:15.344 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8a889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8a889f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49738/0 (socket says 10.20.193.28:49738) 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 -- 10.20.193.28:0/2079889105 learned_addr learned my addr 10.20.193.28:0/2079889105 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c97fff640 1 --2- 10.20.193.28:0/2079889105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 0x5614a8a85f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 --2- 10.20.193.28:0/2079889105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a81280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 -- 10.20.193.28:0/2079889105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 msgr2=0x5614a8a85f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 --2- 10.20.193.28:0/2079889105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 0x5614a8a85f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 -- 10.20.193.28:0/2079889105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 msgr2=0x5614a8a81280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 --2- 10.20.193.28:0/2079889105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a81280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 -- 10.20.193.28:0/2079889105 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a89715a0 con 0x5614a8a86560 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c957fa640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4c6c0b0e20 0x7f4c6c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c957fa640 1 -- 10.20.193.28:0/3878803474 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4c8c0e08d0 con 0x7f4c9810a5f0 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 --2- 10.20.193.28:0/2079889105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8a889f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009a30 tx=0x7f4c88031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b86ae72e034aab9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c97fff640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4c6c0b0e20 0x7f4c6c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c5bfff640 1 -- 10.20.193.28:0/2079889105 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88002e10 con 0x5614a8a86560 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c5bfff640 1 -- 10.20.193.28:0/2079889105 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4c88033070 con 0x5614a8a86560 2026-02-20T03:34:15.345 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c5bfff640 1 -- 10.20.193.28:0/2079889105 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88005050 con 0x5614a8a86560 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2079889105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 msgr2=0x5614a8a889f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/2079889105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8a889f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009a30 tx=0x7f4c88031040 comp rx=0 tx=0).stop 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2079889105 shutdown_connections 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/2079889105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8a889f0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/2079889105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 0x5614a8a85f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/2079889105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a81280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2079889105 >> 10.20.193.28:0/2079889105 conn(0x5614a8a786f0 msgr2=0x5614a8a7f570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2079889105 shutdown_connections 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2079889105 wait complete. 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c97fff640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4c6c0b0e20 0x7f4c6c0b32e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009fd0 tx=0x7f4c84009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- start start 2026-02-20T03:34:15.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 Processor -- start 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a99930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a817c0 0x5614a8a99e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 0x5614a8aa0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5614a89790c0 con 0x5614a8a817c0 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5614a8a895b0 con 0x5614a8a80e80 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5614a8aa1380 con 0x5614a8a86560 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a817c0 0x5614a8a99e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a817c0 0x5614a8a99e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49746/0 (socket says 10.20.193.28:49746) 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.340+0000 7f4c977fe640 1 -- 10.20.193.28:0/3822160894 learned_addr learned my addr 10.20.193.28:0/3822160894 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c9cbd7640 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 0x5614a8aa0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.347 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c97fff640 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a99930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c977fe640 1 -- 10.20.193.28:0/3822160894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 msgr2=0x5614a8aa0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c977fe640 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 0x5614a8aa0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c977fe640 1 -- 10.20.193.28:0/3822160894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 msgr2=0x5614a8a99930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c977fe640 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a99930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c977fe640 1 -- 10.20.193.28:0/3822160894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a8a93080 con 0x5614a8a817c0 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c977fe640 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a817c0 0x5614a8a99e70 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f4c880028f0 tx=0x7f4c88002920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8904a4b0fbd9b5e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 1 -- 10.20.193.28:0/3822160894 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8802fc80 con 0x5614a8a817c0 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 1 -- 10.20.193.28:0/3822160894 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4c88052070 con 0x5614a8a817c0 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 1 -- 10.20.193.28:0/3822160894 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88049450 con 0x5614a8a817c0 2026-02-20T03:34:15.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3822160894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614a898d820 con 0x5614a8a817c0 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 1 -- 10.20.193.28:0/3822160894 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4c880495f0 con 0x5614a8a817c0 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 10 client.20799 _ll_register_callbacks cb 0x5614a897cff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3822160894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5614a89d94e0 con 0x5614a8a817c0 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 1 -- 10.20.193.28:0/3822160894 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f4c88005950 con 0x5614a8a817c0 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 10 client.20799 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3822160894 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x5614a8992380 con 0x5614a8a817c0 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 1 -- 10.20.193.28:0/3822160894 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f4c88047040 con 0x5614a8a817c0 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 10 client.20799 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 10 client.20799 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 20 client.20799 populate_metadata read hostname 'trial028' 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5614a8aa5080 0x5614a8aa7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 4 client.20799 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3822160894 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614a8953bd0 con 0x5614a8aa5080 2026-02-20T03:34:15.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c97fff640 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5614a8aa5080 0x5614a8aa7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c97fff640 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5614a8aa5080 0x5614a8aa7520 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dff29bd3e1f704b server_cookie=b72ece93673ffa3a in_seq=0 out_seq=0 2026-02-20T03:34:15.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 10 client.20799 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:15.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 1 -- 10.20.193.28:0/3822160894 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5614a8953bd0 con 0x5614a8aa5080 2026-02-20T03:34:15.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 10 client.20799 handle_command_reply: tid=0 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 client.20799 shutdown 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3822160894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a817c0 msgr2=0x5614a8a99e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a817c0 0x5614a8a99e70 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f4c880028f0 tx=0x7f4c88002920 comp rx=0 tx=0).stop 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3822160894 shutdown_connections 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5614a8aa5080 0x5614a8aa7520 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 0x5614a8aa0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a817c0 0x5614a8a99e70 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3822160894 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a99930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4c597fa640 0 client.20799 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3822160894 >> 10.20.193.28:0/3822160894 conn(0x5614a8a786f0 msgr2=0x5614a8a878b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3822160894 shutdown_connections 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3822160894 wait complete. 2026-02-20T03:34:15.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.345+0000 7f4ca14c7e00 20 client.20799 trim_cache size 0 max 16384 2026-02-20T03:34:15.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4ca14c7e00 1 Processor -- start 2026-02-20T03:34:15.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4ca14c7e00 1 -- start start 2026-02-20T03:34:15.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a80e80 0x5614a8a81ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a817c0 0x5614a8aa0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 0x5614a8a82420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.359 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c012650 con 0x5614a8a80e80 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c00ff20 con 0x5614a8a817c0 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c00dd70 con 0x5614a8a86560 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c97fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a80e80 0x5614a8a81ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c97fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a80e80 0x5614a8a81ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49748/0 (socket says 10.20.193.28:49748) 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c97fff640 1 -- 10.20.193.28:0/2813499952 learned_addr learned my addr 10.20.193.28:0/2813499952 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c977fe640 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a817c0 0x5614a8aa0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c9cbd7640 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 0x5614a8a82420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c97fff640 1 -- 10.20.193.28:0/2813499952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 msgr2=0x5614a8a82420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c97fff640 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 0x5614a8a82420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c97fff640 1 -- 10.20.193.28:0/2813499952 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a817c0 msgr2=0x5614a8aa0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c97fff640 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a817c0 0x5614a8aa0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c97fff640 1 -- 10.20.193.28:0/2813499952 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a8a92eb0 con 0x5614a8a80e80 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c977fe640 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a817c0 0x5614a8aa0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:15.360 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.353+0000 7f4c97fff640 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a80e80 0x5614a8a81ee0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x5614a8a81eb0 tx=0x7f4c8400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc168b9487f4b842 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c5b7fe640 1 -- 10.20.193.28:0/2813499952 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8401d950 con 0x5614a8a80e80 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c5b7fe640 1 -- 10.20.193.28:0/2813499952 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4c8402a410 con 0x5614a8a80e80 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c5b7fe640 1 -- 10.20.193.28:0/2813499952 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c840303d0 con 0x5614a8a80e80 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2813499952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a80e80 msgr2=0x5614a8a81ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a80e80 0x5614a8a81ee0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x5614a8a81eb0 tx=0x7f4c8400e000 comp rx=0 tx=0).stop 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2813499952 shutdown_connections 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a86560 0x5614a8a82420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a817c0 0x5614a8aa0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/2813499952 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a80e80 0x5614a8a81ee0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2813499952 >> 10.20.193.28:0/2813499952 conn(0x5614a8a786f0 msgr2=0x5614a8a86940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:15.362 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2813499952 shutdown_connections 2026-02-20T03:34:15.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/2813499952 wait complete. 2026-02-20T03:34:15.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- start start 2026-02-20T03:34:15.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 Processor -- start 2026-02-20T03:34:15.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a9d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 0x5614a8a9d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8aa0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c00e3e0 con 0x5614a8a86560 2026-02-20T03:34:15.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c00f850 con 0x5614a8a80e80 2026-02-20T03:34:15.363 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c00eab0 con 0x5614a8a817c0 2026-02-20T03:34:15.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c97fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a9d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c977fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 0x5614a8a9d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c97fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a9d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59050/0 (socket says 10.20.193.28:59050) 2026-02-20T03:34:15.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c97fff640 1 -- 10.20.193.28:0/3038715085 learned_addr learned my addr 10.20.193.28:0/3038715085 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:15.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c9cbd7640 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8aa0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c97fff640 1 -- 10.20.193.28:0/3038715085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 msgr2=0x5614a8a9d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:15.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c97fff640 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 0x5614a8a9d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.364 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c97fff640 1 -- 10.20.193.28:0/3038715085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 msgr2=0x5614a8aa0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c97fff640 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8aa0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c97fff640 1 -- 10.20.193.28:0/3038715085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614a8731690 con 0x5614a8a80e80 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c977fe640 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 0x5614a8a9d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c9cbd7640 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8aa0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c97fff640 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a9d030 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4c840115d0 tx=0x7f4c84011600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0c6a3529f02260c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c597fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c597fa640 1 -- 10.20.193.28:0/3038715085 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8401db60 con 0x5614a8a80e80 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3038715085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614a8996b70 con 0x5614a8a80e80 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 10 client.28397 _ll_register_callbacks cb 0x7f4c88002d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3038715085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5614a87aa520 con 0x5614a8a80e80 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c597fa640 1 -- 10.20.193.28:0/3038715085 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5614a87aa520 con 0x5614a8a80e80 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c597fa640 1 -- 10.20.193.28:0/3038715085 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84031830 con 0x5614a8a80e80 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c597fa640 1 -- 10.20.193.28:0/3038715085 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4c840319d0 con 0x5614a8a80e80 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c597fa640 1 -- 10.20.193.28:0/3038715085 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f4c84031cd0 con 0x5614a8a80e80 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 10 client.28397 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3038715085 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=44}) -- 0x5614a8a93ba0 con 0x5614a8a80e80 2026-02-20T03:34:15.365 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c597fa640 1 -- 10.20.193.28:0/3038715085 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f4c8402a5c0 con 0x5614a8a80e80 2026-02-20T03:34:15.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 10 client.28397 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:15.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 10 client.28397 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:15.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 20 client.28397 populate_metadata read hostname 'trial028' 2026-02-20T03:34:15.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5614a8b19870 0x5614a8b1bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:15.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 4 client.28397 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:34:15.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3038715085 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5614a89df290 con 0x5614a8b19870 2026-02-20T03:34:15.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c977fe640 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5614a8b19870 0x5614a8b1bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:15.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c977fe640 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5614a8b19870 0x5614a8b1bd30 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=666736486a9e7bbe server_cookie=42315fa4e6381d8b in_seq=0 out_seq=0 2026-02-20T03:34:15.366 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.359+0000 7f4c597fa640 10 client.28397 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:15.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4c597fa640 1 -- 10.20.193.28:0/3038715085 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5614a89df290 con 0x5614a8b19870 2026-02-20T03:34:15.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4c597fa640 10 client.28397 handle_command_reply: tid=0 2026-02-20T03:34:15.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 client.28397 shutdown 2026-02-20T03:34:15.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3038715085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 msgr2=0x5614a8a9d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:15.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a9d030 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4c840115d0 tx=0x7f4c84011600 comp rx=0 tx=0).stop 2026-02-20T03:34:15.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3038715085 shutdown_connections 2026-02-20T03:34:15.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5614a8b19870 0x5614a8b1bd30 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5614a8a86560 0x5614a8aa0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.379 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5614a8a817c0 0x5614a8a9d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 --2- 10.20.193.28:0/3038715085 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5614a8a80e80 0x5614a8a9d030 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3038715085 >> 10.20.193.28:0/3038715085 conn(0x5614a8a786f0 msgr2=0x5614a8a87160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4c597fa640 0 client.28397 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.372+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3038715085 shutdown_connections 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4ca14c7e00 1 -- 10.20.193.28:0/3038715085 wait complete. 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4ca14c7e00 20 client.28397 trim_cache size 0 max 16384 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4c6c0b0e20 msgr2=0x7f4c6c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4c6c0b0e20 0x7f4c6c0b32e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009fd0 tx=0x7f4c84009290 comp rx=0 tx=0).stop 2026-02-20T03:34:15.380 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c9810a5f0 msgr2=0x7f4c981a4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:15.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c9810a5f0 0x7f4c981a4000 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00efc0 tx=0x7f4c8c00c490 comp rx=0 tx=0).stop 2026-02-20T03:34:15.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/3878803474 shutdown_connections 2026-02-20T03:34:15.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4c6c0b0e20 0x7f4c6c0b32e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4c9810a5f0 0x7f4c981a4000 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4c98077050 0x7f4c9819cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 --2- 10.20.193.28:0/3878803474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4c980759e0 0x7f4c9819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:15.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/3878803474 >> 10.20.193.28:0/3878803474 conn(0x7f4c980fde10 msgr2=0x7f4c981065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:15.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/3878803474 shutdown_connections 2026-02-20T03:34:15.381 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:15.377+0000 7f4c9d3d8640 1 -- 10.20.193.28:0/3878803474 wait complete. 2026-02-20T03:34:15.477 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:15 trial028 ceph-mon[38552]: pgmap v773: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2026-02-20T03:34:15.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.13 MB/sec execute 226 sec latency 74170.033 ms 2026-02-20T03:34:15.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:15 trial177 ceph-mon[43181]: pgmap v773: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2026-02-20T03:34:15.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:15 trial126 ceph-mon[38476]: pgmap v773: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2026-02-20T03:34:16.139 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:34:16.436 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:16.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.690+0000 7f66257a7640 1 -- 10.20.193.28:0/4169985040 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6620109220 msgr2=0x7f6620109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:16.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.690+0000 7f66257a7640 1 --2- 10.20.193.28:0/4169985040 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6620109220 0x7f6620109660 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6610009a30 tx=0x7f661002f220 comp rx=0 tx=0).stop 2026-02-20T03:34:16.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.690+0000 7f66257a7640 1 -- 10.20.193.28:0/4169985040 shutdown_connections 2026-02-20T03:34:16.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.690+0000 7f66257a7640 1 --2- 10.20.193.28:0/4169985040 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6620109ba0 0x7f6620115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.690+0000 7f66257a7640 1 --2- 10.20.193.28:0/4169985040 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6620109220 0x7f6620109660 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.690+0000 7f66257a7640 1 --2- 10.20.193.28:0/4169985040 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f662010eef0 0x7f662010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.690+0000 7f66257a7640 1 -- 10.20.193.28:0/4169985040 >> 10.20.193.28:0/4169985040 conn(0x7f6620078600 msgr2=0x7f662007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.690+0000 7f66257a7640 1 -- 10.20.193.28:0/4169985040 shutdown_connections 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.690+0000 7f66257a7640 1 -- 10.20.193.28:0/4169985040 wait complete. 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f66257a7640 1 Processor -- start 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f66257a7640 1 -- start start 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f66257a7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6620109220 0x7f66201a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f66257a7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6620109ba0 0x7f66201a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f66257a7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f662010eef0 0x7f66201a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.696 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f66257a7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f66201190a0 con 0x7f6620109ba0 2026-02-20T03:34:16.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f66257a7640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6620118f20 con 0x7f6620109220 2026-02-20T03:34:16.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f66257a7640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6620119220 con 0x7f662010eef0 2026-02-20T03:34:16.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f6624fa6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f662010eef0 0x7f66201a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f661ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6620109220 0x7f66201a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f661f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6620109ba0 0x7f66201a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f6624fa6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f662010eef0 0x7f66201a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:32990/0 (socket says 10.20.193.28:32990) 2026-02-20T03:34:16.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.691+0000 7f6624fa6640 1 -- 10.20.193.28:0/3072732462 learned_addr learned my addr 10.20.193.28:0/3072732462 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:16.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661f7fe640 1 -- 10.20.193.28:0/3072732462 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f662010eef0 msgr2=0x7f66201a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:16.697 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661f7fe640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f662010eef0 0x7f66201a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661f7fe640 1 -- 10.20.193.28:0/3072732462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6620109220 msgr2=0x7f66201a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:16.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661f7fe640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6620109220 0x7f66201a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661f7fe640 1 -- 10.20.193.28:0/3072732462 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66201a6570 con 0x7f6620109ba0 2026-02-20T03:34:16.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661ffff640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6620109220 0x7f66201a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:16.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f6624fa6640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f662010eef0 0x7f66201a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:16.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661f7fe640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6620109ba0 0x7f66201a1a60 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f6610009950 tx=0x7f6610004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:16.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661d7fa640 1 -- 10.20.193.28:0/3072732462 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610038770 con 0x7f6620109ba0 2026-02-20T03:34:16.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661d7fa640 1 -- 10.20.193.28:0/3072732462 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6610038db0 con 0x7f6620109ba0 2026-02-20T03:34:16.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f661d7fa640 1 -- 10.20.193.28:0/3072732462 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610041620 con 0x7f6620109ba0 2026-02-20T03:34:16.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f66257a7640 1 -- 10.20.193.28:0/3072732462 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66201a6800 con 0x7f6620109ba0 2026-02-20T03:34:16.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.692+0000 7f66257a7640 1 -- 10.20.193.28:0/3072732462 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66201ae0a0 con 0x7f6620109ba0 2026-02-20T03:34:16.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.696+0000 7f6628f35e00 1 Processor -- start 2026-02-20T03:34:16.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.696+0000 7f6628f35e00 1 -- start start 2026-02-20T03:34:16.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.696+0000 7f661d7fa640 1 -- 10.20.193.28:0/3072732462 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6610002920 con 0x7f6620109ba0 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.696+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.696+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277d7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.696+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.696+0000 7f6628f35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d27757e50 con 0x559d277d7fb0 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.696+0000 7f6628f35e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559d2772a9c0 con 0x559d277dd000 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.696+0000 7f6628f35e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559d276d8240 con 0x559d277d7630 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f6624fa6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277e3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47748/0 (socket says 10.20.193.28:47748) 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661f7fe640 1 -- 10.20.193.28:0/173207447 learned_addr learned my addr 10.20.193.28:0/173207447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:16.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661ffff640 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277d7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661f7fe640 1 -- 10.20.193.28:0/173207447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 msgr2=0x559d277d7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661f7fe640 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277d7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661f7fe640 1 -- 10.20.193.28:0/173207447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 msgr2=0x559d277dd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661f7fe640 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277dd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661f7fe640 1 -- 10.20.193.28:0/173207447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d276eb420 con 0x559d277d7fb0 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f661ffff640 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277d7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.697+0000 7f6624fa6640 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661f7fe640 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277e3e30 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f661010aa90 tx=0x7f661010ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece2957dec02758b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661d7fa640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65f40b0ea0 0x7f65f40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65f0ce3640 1 -- 10.20.193.28:0/173207447 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6610113070 con 0x559d277d7fb0 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65f0ce3640 1 -- 10.20.193.28:0/173207447 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6610033030 con 0x559d277d7fb0 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65f0ce3640 1 -- 10.20.193.28:0/173207447 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66100cb070 con 0x559d277d7fb0 2026-02-20T03:34:16.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6624fa6640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65f40b0ea0 0x7f65f40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- 10.20.193.28:0/173207447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 msgr2=0x559d277e3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277e3e30 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f661010aa90 tx=0x7f661010ae90 comp rx=0 tx=0).stop 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661d7fa640 1 -- 10.20.193.28:0/3072732462 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6610104ad0 con 0x7f6620109ba0 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- 10.20.193.28:0/173207447 shutdown_connections 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277e3e30 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277d7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 --2- 10.20.193.28:0/173207447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- 10.20.193.28:0/173207447 >> 10.20.193.28:0/173207447 conn(0x559d2779a290 msgr2=0x559d277d5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- 10.20.193.28:0/173207447 shutdown_connections 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6624fa6640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65f40b0ea0 0x7f65f40b3360 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6614009fd0 tx=0x7f661400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:16.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- 10.20.193.28:0/173207447 wait complete. 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- start start 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 Processor -- start 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x559d277268f0 con 0x559d277d7fb0 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x559d27518f50 con 0x559d277dd000 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x559d277f0700 con 0x559d277d7630 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277f1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33008/0 (socket says 10.20.193.28:33008) 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661ffff640 1 -- 10.20.193.28:0/802232316 learned_addr learned my addr 10.20.193.28:0/802232316 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:16.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6624fa6640 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661f7fe640 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6624fa6640 1 -- 10.20.193.28:0/802232316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 msgr2=0x559d277f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6624fa6640 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6624fa6640 1 -- 10.20.193.28:0/802232316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 msgr2=0x559d277f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6624fa6640 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277f23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6624fa6640 1 -- 10.20.193.28:0/802232316 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d277e97a0 con 0x559d277dd000 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661f7fe640 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6624fa6640 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f01c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6614003010 tx=0x7f6614004bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49764bf2c5105d8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 1 -- 10.20.193.28:0/802232316 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614023640 con 0x559d277dd000 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 1 -- 10.20.193.28:0/802232316 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6614028070 con 0x559d277dd000 2026-02-20T03:34:16.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- 10.20.193.28:0/802232316 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d274fbb40 con 0x559d277dd000 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 1 -- 10.20.193.28:0/802232316 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614016a10 con 0x559d277dd000 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 10 client.28409 _ll_register_callbacks cb 0x559d27763f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- 10.20.193.28:0/802232316 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559d277381a0 con 0x559d277dd000 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 1 -- 10.20.193.28:0/802232316 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6614016bb0 con 0x559d277dd000 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 1 -- 10.20.193.28:0/802232316 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f6614016430 con 0x559d277dd000 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 10 client.28409 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- 10.20.193.28:0/802232316 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=44}) -- 0x559d276e5230 con 0x559d277dd000 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 1 -- 10.20.193.28:0/802232316 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f661402f520 con 0x559d277dd000 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 10 client.28409 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 10 client.28409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 20 client.28409 populate_metadata read hostname 'trial028' 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d278002f0 0x559d278027b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 4 client.28409 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 -- 10.20.193.28:0/802232316 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d277325b0 con 0x559d278002f0 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661ffff640 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d278002f0 0x559d278027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f661ffff640 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d278002f0 0x559d278027b0 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=139f8681cdf1bd5c server_cookie=8a2775d4a0b6262e in_seq=0 out_seq=0 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 10 client.28409 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 1 -- 10.20.193.28:0/802232316 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559d277325b0 con 0x559d278002f0 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f65e1ffb640 10 client.28409 handle_command_reply: tid=0 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.698+0000 7f6628f35e00 1 client.28409 shutdown 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 -- 10.20.193.28:0/802232316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 msgr2=0x559d277f01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f01c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6614003010 tx=0x7f6614004bb0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 -- 10.20.193.28:0/802232316 shutdown_connections 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d278002f0 0x559d278027b0 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f01c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 --2- 10.20.193.28:0/802232316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 -- 10.20.193.28:0/802232316 >> 10.20.193.28:0/802232316 conn(0x559d2779a290 msgr2=0x559d277d6440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:16.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f65e1ffb640 0 client.28409 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:16.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 -- 10.20.193.28:0/802232316 shutdown_connections 2026-02-20T03:34:16.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 1 -- 10.20.193.28:0/802232316 wait complete. 2026-02-20T03:34:16.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.704+0000 7f6628f35e00 20 client.28409 trim_cache size 0 max 16384 2026-02-20T03:34:16.718 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 18.05 MB/sec execute 227 sec latency 75170.066 ms 2026-02-20T03:34:16.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 Processor -- start 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- start start 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277d7630 0x559d277cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7fb0 0x559d277eea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277dd000 0x559d277eef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4012660 con 0x559d277dd000 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f65c400ff30 con 0x559d277d7630 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f65c400dd80 con 0x559d277d7fb0 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277d7630 0x559d277cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277dd000 0x559d277eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277d7630 0x559d277cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42650/0 (socket says 10.20.193.28:42650) 2026-02-20T03:34:16.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 -- 10.20.193.28:0/2303854352 learned_addr learned my addr 10.20.193.28:0/2303854352 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661f7fe640 1 --2- 10.20.193.28:0/2303854352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7fb0 0x559d277eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 -- 10.20.193.28:0/2303854352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7fb0 msgr2=0x559d277eea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 --2- 10.20.193.28:0/2303854352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7fb0 0x559d277eea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 -- 10.20.193.28:0/2303854352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277dd000 msgr2=0x559d277eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 --2- 10.20.193.28:0/2303854352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277dd000 0x559d277eef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 -- 10.20.193.28:0/2303854352 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d277e95d0 con 0x559d277d7630 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 --2- 10.20.193.28:0/2303854352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277d7630 0x559d277cfd50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f660c009240 tx=0x7f660c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde58c725b3d072b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f65e3fff640 1 -- 10.20.193.28:0/2303854352 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c004aa0 con 0x559d277d7630 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f65e3fff640 1 -- 10.20.193.28:0/2303854352 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x559d277325b0 con 0x559d277d7630 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f65e3fff640 1 -- 10.20.193.28:0/2303854352 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c011980 con 0x559d277d7630 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- 10.20.193.28:0/2303854352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277d7630 msgr2=0x559d277cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:16.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- 10.20.193.28:0/2303854352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277d7630 0x559d277cfd50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f660c009240 tx=0x7f660c0047c0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- 10.20.193.28:0/2303854352 shutdown_connections 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- 10.20.193.28:0/2303854352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277dd000 0x559d277eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- 10.20.193.28:0/2303854352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7fb0 0x559d277eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- 10.20.193.28:0/2303854352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277d7630 0x559d277cfd50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- 10.20.193.28:0/2303854352 >> 10.20.193.28:0/2303854352 conn(0x559d2779a290 msgr2=0x559d277f1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- 10.20.193.28:0/2303854352 shutdown_connections 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- 10.20.193.28:0/2303854352 wait complete. 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- start start 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 Processor -- start 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277f8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f65c400e3f0 con 0x559d277d7fb0 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f65c400f860 con 0x559d277dd000 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f65c400eac0 con 0x559d277d7630 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f661f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42656/0 (socket says 10.20.193.28:42656) 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 -- 10.20.193.28:0/4275140620 learned_addr learned my addr 10.20.193.28:0/4275140620 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 -- 10.20.193.28:0/4275140620 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 msgr2=0x559d277f7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277f7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 -- 10.20.193.28:0/4275140620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 msgr2=0x559d277f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277f8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 -- 10.20.193.28:0/4275140620 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d27409870 con 0x559d277dd000 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6624fa6640 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f4bb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f661400b010 tx=0x7f661402fa70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fe451370d904981 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f65e1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f65e1ffb640 1 -- 10.20.193.28:0/4275140620 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661402f520 con 0x559d277dd000 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f65e1ffb640 1 -- 10.20.193.28:0/4275140620 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6614028040 con 0x559d277dd000 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- 10.20.193.28:0/4275140620 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d276ca440 con 0x559d277dd000 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f65e1ffb640 1 -- 10.20.193.28:0/4275140620 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661402d860 con 0x559d277dd000 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f65e1ffb640 1 -- 10.20.193.28:0/4275140620 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f661402da00 con 0x559d277dd000 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f65e1ffb640 10 client.28415 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 10 client.28415 _ll_register_callbacks cb 0x7f6614009290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.711+0000 7f6628f35e00 1 -- 10.20.193.28:0/4275140620 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6610033030 con 0x559d277dd000 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f65e1ffb640 1 -- 10.20.193.28:0/4275140620 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f6614045060 con 0x559d277dd000 2026-02-20T03:34:16.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 10 client.28415 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 -- 10.20.193.28:0/4275140620 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=44}) -- 0x559d277ea2c0 con 0x559d277dd000 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f65e1ffb640 1 -- 10.20.193.28:0/4275140620 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f66140165d0 con 0x559d277dd000 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 10 client.28415 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 10 client.28415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 20 client.28415 populate_metadata read hostname 'trial028' 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d2786be20 0x559d2786e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 4 client.28415 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 -- 10.20.193.28:0/4275140620 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559d276fb810 con 0x559d2786be20 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f661ffff640 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d2786be20 0x559d2786e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f661ffff640 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d2786be20 0x559d2786e2e0 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=775bbd317256c77c server_cookie=446bdb71f87a11bc in_seq=0 out_seq=0 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f65e1ffb640 10 client.28415 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f65e1ffb640 1 -- 10.20.193.28:0/4275140620 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559d276fb810 con 0x559d2786be20 2026-02-20T03:34:16.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f65e1ffb640 10 client.28415 handle_command_reply: tid=0 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 client.28415 shutdown 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 -- 10.20.193.28:0/4275140620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 msgr2=0x559d277f4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f4bb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f661400b010 tx=0x7f661402fa70 comp rx=0 tx=0).stop 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 -- 10.20.193.28:0/4275140620 shutdown_connections 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x559d2786be20 0x559d2786e2e0 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x559d277dd000 0x559d277f4bb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x559d277d7fb0 0x559d277f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 --2- 10.20.193.28:0/4275140620 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x559d277d7630 0x559d277f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 -- 10.20.193.28:0/4275140620 >> 10.20.193.28:0/4275140620 conn(0x559d2779a290 msgr2=0x559d277ee990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f65e1ffb640 0 client.28415 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 -- 10.20.193.28:0/4275140620 shutdown_connections 2026-02-20T03:34:16.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 1 -- 10.20.193.28:0/4275140620 wait complete. 2026-02-20T03:34:16.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f6628f35e00 20 client.28415 trim_cache size 0 max 16384 2026-02-20T03:34:16.729 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:34:16.729 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:34:16.729 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:34:16.729 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:34:16.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 -- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65f40b0ea0 msgr2=0x7f65f40b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:16.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65f40b0ea0 0x7f65f40b3360 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6614009fd0 tx=0x7f661400b040 comp rx=0 tx=0).stop 2026-02-20T03:34:16.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 -- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6620109ba0 msgr2=0x7f66201a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:16.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6620109ba0 0x7f66201a1a60 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f6610009950 tx=0x7f6610004300 comp rx=0 tx=0).stop 2026-02-20T03:34:16.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 -- 10.20.193.28:0/3072732462 shutdown_connections 2026-02-20T03:34:16.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f65f40b0ea0 0x7f65f40b3360 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f662010eef0 0x7f66201a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6620109ba0 0x7f66201a1a60 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 --2- 10.20.193.28:0/3072732462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6620109220 0x7f66201a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:16.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 -- 10.20.193.28:0/3072732462 >> 10.20.193.28:0/3072732462 conn(0x7f6620078600 msgr2=0x7f6620079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:16.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 -- 10.20.193.28:0/3072732462 shutdown_connections 2026-02-20T03:34:16.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:16.717+0000 7f66257a7640 1 -- 10.20.193.28:0/3072732462 wait complete. 2026-02-20T03:34:16.805 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:34:16.806 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:34:17.100 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:17.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- 10.20.193.28:0/3981752166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3488105320 msgr2=0x7f3488111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 --2- 10.20.193.28:0/3981752166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3488105320 0x7f3488111850 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f347c00b0a0 tx=0x7f347c02f410 comp rx=0 tx=0).stop 2026-02-20T03:34:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- 10.20.193.28:0/3981752166 shutdown_connections 2026-02-20T03:34:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 --2- 10.20.193.28:0/3981752166 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3488105320 0x7f3488111850 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 --2- 10.20.193.28:0/3981752166 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3488104980 0x7f3488104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 --2- 10.20.193.28:0/3981752166 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f348810a980 0x7f348810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- 10.20.193.28:0/3981752166 >> 10.20.193.28:0/3981752166 conn(0x7f3488100680 msgr2=0x7f3488102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- 10.20.193.28:0/3981752166 shutdown_connections 2026-02-20T03:34:17.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- 10.20.193.28:0/3981752166 wait complete. 2026-02-20T03:34:17.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 Processor -- start 2026-02-20T03:34:17.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- start start 2026-02-20T03:34:17.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3488104980 0x7f348819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:17.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3488105320 0x7f348819d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:17.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f348810a980 0x7f34881a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:17.359 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3488114bf0 con 0x7f348810a980 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3488114a70 con 0x7f3488104980 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3488114d70 con 0x7f3488105320 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f34877fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3488105320 0x7f348819d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f3487fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3488104980 0x7f348819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348c9ef640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f348810a980 0x7f34881a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f34877fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3488105320 0x7f348819d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33052/0 (socket says 10.20.193.28:33052) 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f34877fe640 1 -- 10.20.193.28:0/480902263 learned_addr learned my addr 10.20.193.28:0/480902263 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348c9ef640 1 -- 10.20.193.28:0/480902263 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3488105320 msgr2=0x7f348819d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348c9ef640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3488105320 0x7f348819d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348c9ef640 1 -- 10.20.193.28:0/480902263 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3488104980 msgr2=0x7f348819cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:17.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348c9ef640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3488104980 0x7f348819cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348c9ef640 1 -- 10.20.193.28:0/480902263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34881a1fe0 con 0x7f348810a980 2026-02-20T03:34:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348c9ef640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f348810a980 0x7f34881a1860 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c090 tx=0x7f347c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f34857fa640 1 -- 10.20.193.28:0/480902263 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c0044e0 con 0x7f348810a980 2026-02-20T03:34:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f34857fa640 1 -- 10.20.193.28:0/480902263 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f347c004680 con 0x7f348810a980 2026-02-20T03:34:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34881a2270 con 0x7f348810a980 2026-02-20T03:34:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f34857fa640 1 -- 10.20.193.28:0/480902263 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c038710 con 0x7f348810a980 2026-02-20T03:34:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34881a26a0 con 0x7f348810a980 2026-02-20T03:34:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.351+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3488104de0 con 0x7f348810a980 2026-02-20T03:34:17.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.357+0000 7f34857fa640 1 -- 10.20.193.28:0/480902263 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f347c0388b0 con 0x7f348810a980 2026-02-20T03:34:17.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.357+0000 7f34857fa640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f345c0b0da0 0x7f345c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:17.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.357+0000 7f34857fa640 1 -- 10.20.193.28:0/480902263 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f347c104b80 con 0x7f348810a980 2026-02-20T03:34:17.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.357+0000 7f3487fff640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f345c0b0da0 0x7f345c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:17.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.357+0000 7f3487fff640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f345c0b0da0 0x7f345c0b3260 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3474005fd0 tx=0x7f3474007450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:17.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.357+0000 7f34857fa640 1 -- 10.20.193.28:0/480902263 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f347c0ccf60 con 0x7f348810a980 2026-02-20T03:34:17.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.468+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34881a9d70 con 0x7f348810a980 2026-02-20T03:34:17.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.468+0000 7f34857fa640 1 -- 10.20.193.28:0/480902263 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11918 (secure 0 0 0) 0x7f347c0d0c10 con 0x7f348810a980 2026-02-20T03:34:17.472 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:34:17.472 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":44,"btime":"2026-02-20T03:32:41:319918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:32:41.319912+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:34:17.473 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 44 2026-02-20T03:34:17.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f345c0b0da0 msgr2=0x7f345c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f345c0b0da0 0x7f345c0b3260 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3474005fd0 tx=0x7f3474007450 comp rx=0 tx=0).stop 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f348810a980 msgr2=0x7f34881a1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f348810a980 0x7f34881a1860 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f347c00c090 tx=0x7f347c009300 comp rx=0 tx=0).stop 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 shutdown_connections 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f345c0b0da0 0x7f345c0b3260 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f348810a980 0x7f34881a1860 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3488105320 0x7f348819d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 --2- 10.20.193.28:0/480902263 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3488104980 0x7f348819cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 >> 10.20.193.28:0/480902263 conn(0x7f3488100680 msgr2=0x7f3488100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 shutdown_connections 2026-02-20T03:34:17.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:17.470+0000 7f348d1f0640 1 -- 10.20.193.28:0/480902263 wait complete. 2026-02-20T03:34:17.617 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:17 trial028 ceph-mon[38552]: pgmap v774: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2026-02-20T03:34:17.628 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:34:17.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.97 MB/sec execute 228 sec latency 76170.098 ms 2026-02-20T03:34:17.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:17 trial177 ceph-mon[43181]: pgmap v774: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2026-02-20T03:34:17.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:17 trial126 ceph-mon[38476]: pgmap v774: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 6.6 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2026-02-20T03:34:17.898 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:18.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.153+0000 7f230616e640 1 -- 10.20.193.28:0/3400886847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2300104980 msgr2=0x7f2300104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:18.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.153+0000 7f230616e640 1 --2- 10.20.193.28:0/3400886847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2300104980 0x7f2300104de0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009990 tx=0x7f22f402f170 comp rx=0 tx=0).stop 2026-02-20T03:34:18.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 -- 10.20.193.28:0/3400886847 shutdown_connections 2026-02-20T03:34:18.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 --2- 10.20.193.28:0/3400886847 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2300105320 0x7f2300111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 --2- 10.20.193.28:0/3400886847 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2300104980 0x7f2300104de0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 --2- 10.20.193.28:0/3400886847 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f230010a980 0x7f230010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 -- 10.20.193.28:0/3400886847 >> 10.20.193.28:0/3400886847 conn(0x7f2300100680 msgr2=0x7f2300102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:18.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 -- 10.20.193.28:0/3400886847 shutdown_connections 2026-02-20T03:34:18.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 -- 10.20.193.28:0/3400886847 wait complete. 2026-02-20T03:34:18.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 Processor -- start 2026-02-20T03:34:18.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 -- start start 2026-02-20T03:34:18.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2300104980 0x7f230019d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2300105320 0x7f230019d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f230010a980 0x7f23001a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2300114bf0 con 0x7f2300104980 2026-02-20T03:34:18.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2300114a70 con 0x7f230010a980 2026-02-20T03:34:18.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230616e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2300114d70 con 0x7f2300105320 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230516c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2300104980 0x7f230019d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230496b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2300105320 0x7f230019d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230516c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2300104980 0x7f230019d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47816/0 (socket says 10.20.193.28:47816) 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230516c640 1 -- 10.20.193.28:0/569244287 learned_addr learned my addr 10.20.193.28:0/569244287 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230596d640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f230010a980 0x7f23001a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230516c640 1 -- 10.20.193.28:0/569244287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2300105320 msgr2=0x7f230019d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230516c640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2300105320 0x7f230019d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230516c640 1 -- 10.20.193.28:0/569244287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f230010a980 msgr2=0x7f23001a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230516c640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f230010a980 0x7f23001a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.155+0000 7f230516c640 1 -- 10.20.193.28:0/569244287 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23001a2100 con 0x7f2300104980 2026-02-20T03:34:18.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230516c640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2300104980 0x7f230019d0b0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f22f000ea10 tx=0x7f22f000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:18.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f22ee7fc640 1 -- 10.20.193.28:0/569244287 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f000ce50 con 0x7f2300104980 2026-02-20T03:34:18.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230616e640 1 -- 10.20.193.28:0/569244287 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23001a23f0 con 0x7f2300104980 2026-02-20T03:34:18.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230616e640 1 -- 10.20.193.28:0/569244287 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23001a9c30 con 0x7f2300104980 2026-02-20T03:34:18.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f22ee7fc640 1 -- 10.20.193.28:0/569244287 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22f000ce50 con 0x7f2300104980 2026-02-20T03:34:18.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f22ee7fc640 1 -- 10.20.193.28:0/569244287 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0010430 con 0x7f2300104980 2026-02-20T03:34:18.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f22ee7fc640 1 -- 10.20.193.28:0/569244287 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f22f00105d0 con 0x7f2300104980 2026-02-20T03:34:18.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f23098fce00 1 Processor -- start 2026-02-20T03:34:18.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f23098fce00 1 -- start start 2026-02-20T03:34:18.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f23098fce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x565107496390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f23098fce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 0x565107490a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f23098fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x56510749cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230596d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x565107496390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f23098fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x565107410e00 con 0x565107490f60 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230596d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x565107496390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42698/0 (socket says 10.20.193.28:42698) 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230596d640 1 -- 10.20.193.28:0/1336503365 learned_addr learned my addr 10.20.193.28:0/1336503365 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f23098fce00 1 -- 10.20.193.28:0/1336503365 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5651073e3970 con 0x565107495fb0 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f23098fce00 1 -- 10.20.193.28:0/1336503365 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5651073911f0 con 0x5651074905e0 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f22ee7fc640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d40b11a0 0x7f22d40b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230496b640 1 --2- 10.20.193.28:0/1336503365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x56510749cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f22ee7fc640 1 -- 10.20.193.28:0/569244287 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f22f000cc50 con 0x7f2300104980 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230496b640 1 -- 10.20.193.28:0/1336503365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 msgr2=0x565107490a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230496b640 1 --2- 10.20.193.28:0/1336503365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 0x565107490a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230496b640 1 -- 10.20.193.28:0/1336503365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 msgr2=0x565107496390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230496b640 1 --2- 10.20.193.28:0/1336503365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x565107496390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230496b640 1 -- 10.20.193.28:0/1336503365 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651073a43d0 con 0x565107490f60 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230596d640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d40b11a0 0x7f22d40b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f230496b640 1 --2- 10.20.193.28:0/1336503365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x56510749cde0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f22f4002410 tx=0x7f22f4005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3baada412d135bf0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.157+0000 7f22cdce5640 1 -- 10.20.193.28:0/1336503365 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4046070 con 0x565107490f60 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f22cdce5640 1 -- 10.20.193.28:0/1336503365 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22f4033040 con 0x565107490f60 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f23098fce00 1 -- 10.20.193.28:0/1336503365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 msgr2=0x56510749cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:18.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f23098fce00 1 --2- 10.20.193.28:0/1336503365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x56510749cde0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f22f4002410 tx=0x7f22f4005e20 comp rx=0 tx=0).stop 2026-02-20T03:34:18.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f230596d640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d40b11a0 0x7f22d40b3660 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009290 tx=0x7f22fc009040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:18.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f23098fce00 1 -- 10.20.193.28:0/1336503365 shutdown_connections 2026-02-20T03:34:18.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f23098fce00 1 --2- 10.20.193.28:0/1336503365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x56510749cde0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f23098fce00 1 --2- 10.20.193.28:0/1336503365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 0x565107490a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f23098fce00 1 --2- 10.20.193.28:0/1336503365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x565107496390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f23098fce00 1 -- 10.20.193.28:0/1336503365 >> 10.20.193.28:0/1336503365 conn(0x565107453240 msgr2=0x56510748ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:18.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f23098fce00 1 -- 10.20.193.28:0/1336503365 shutdown_connections 2026-02-20T03:34:18.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.163+0000 7f23098fce00 1 -- 10.20.193.28:0/1336503365 wait complete. 2026-02-20T03:34:18.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- start start 2026-02-20T03:34:18.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 Processor -- start 2026-02-20T03:34:18.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5651074905e0 0x5651074aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x5651074aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107495fb0 0x5651074a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5651073df8a0 con 0x565107490f60 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5651071d1f50 con 0x5651074905e0 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5651074a9970 con 0x565107495fb0 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230516c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5651074905e0 0x5651074aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230516c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5651074905e0 0x5651074aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42714/0 (socket says 10.20.193.28:42714) 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230516c640 1 -- 10.20.193.28:0/888870447 learned_addr learned my addr 10.20.193.28:0/888870447 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230496b640 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x5651074aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230596d640 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107495fb0 0x5651074a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230496b640 1 -- 10.20.193.28:0/888870447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107495fb0 msgr2=0x5651074a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:18.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230496b640 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107495fb0 0x5651074a91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230496b640 1 -- 10.20.193.28:0/888870447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5651074905e0 msgr2=0x5651074aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230496b640 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5651074905e0 0x5651074aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230496b640 1 -- 10.20.193.28:0/888870447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651074a2960 con 0x565107490f60 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230516c640 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5651074905e0 0x5651074aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230496b640 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x5651074aaff0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009960 tx=0x7f22f4041620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22ef36b88262a21 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 1 -- 10.20.193.28:0/888870447 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4046040 con 0x565107490f60 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 1 -- 10.20.193.28:0/888870447 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22f4009550 con 0x565107490f60 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 1 -- 10.20.193.28:0/888870447 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4002940 con 0x565107490f60 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- 10.20.193.28:0/888870447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651071b4b40 con 0x565107490f60 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 10 client.20841 _ll_register_callbacks cb 0x56510741ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- 10.20.193.28:0/888870447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5651073f1150 con 0x565107490f60 2026-02-20T03:34:18.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 1 -- 10.20.193.28:0/888870447 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f22f4002ae0 con 0x565107490f60 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 1 -- 10.20.193.28:0/888870447 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f22f4002ce0 con 0x565107490f60 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 10 client.20841 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- 10.20.193.28:0/888870447 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x56510739e1e0 con 0x565107490f60 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 1 -- 10.20.193.28:0/888870447 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f22f4049070 con 0x565107490f60 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 10 client.20841 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 10 client.20841 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 20 client.20841 populate_metadata read hostname 'trial028' 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5651074b8e20 0x5651074bb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 4 client.20841 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- 10.20.193.28:0/888870447 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651073eb560 con 0x5651074b8e20 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230516c640 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5651074b8e20 0x5651074bb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f230516c640 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5651074b8e20 0x5651074bb210 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f3a0020f4d6b749 server_cookie=ddd5c17701cd456f in_seq=0 out_seq=0 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 10 client.20841 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 1 -- 10.20.193.28:0/888870447 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5651073eb560 con 0x5651074b8e20 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 10 client.20841 handle_command_reply: tid=0 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 client.20841 shutdown 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- 10.20.193.28:0/888870447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 msgr2=0x5651074aaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x5651074aaff0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009960 tx=0x7f22f4041620 comp rx=0 tx=0).stop 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- 10.20.193.28:0/888870447 shutdown_connections 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107495fb0 0x5651074a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5651074b8e20 0x5651074bb210 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107490f60 0x5651074aaff0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 --2- 10.20.193.28:0/888870447 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5651074905e0 0x5651074aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- 10.20.193.28:0/888870447 >> 10.20.193.28:0/888870447 conn(0x565107453240 msgr2=0x56510748f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f22baffd640 0 client.20841 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:34:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- 10.20.193.28:0/888870447 shutdown_connections 2026-02-20T03:34:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 1 -- 10.20.193.28:0/888870447 wait complete. 2026-02-20T03:34:18.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.164+0000 7f23098fce00 20 client.20841 trim_cache size 0 max 16384 2026-02-20T03:34:18.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 Processor -- start 2026-02-20T03:34:18.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 -- start start 2026-02-20T03:34:18.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 0x5651074a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107490f60 0x5651074a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107495fb0 0x5651074c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac0126f0 con 0x565107495fb0 2026-02-20T03:34:18.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac00ffc0 con 0x565107490f60 2026-02-20T03:34:18.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac00de10 con 0x5651074905e0 2026-02-20T03:34:18.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230516c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 0x5651074a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230516c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 0x5651074a67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33104/0 (socket says 10.20.193.28:33104) 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230516c640 1 -- 10.20.193.28:0/4115875105 learned_addr learned my addr 10.20.193.28:0/4115875105 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230596d640 1 --2- 10.20.193.28:0/4115875105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107495fb0 0x5651074c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230516c640 1 -- 10.20.193.28:0/4115875105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107490f60 msgr2=0x5651074a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230516c640 1 --2- 10.20.193.28:0/4115875105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107490f60 0x5651074a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230516c640 1 -- 10.20.193.28:0/4115875105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107495fb0 msgr2=0x5651074c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230516c640 1 --2- 10.20.193.28:0/4115875105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107495fb0 0x5651074c0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230516c640 1 -- 10.20.193.28:0/4115875105 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651074a2790 con 0x5651074905e0 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f230516c640 1 --2- 10.20.193.28:0/4115875105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 0x5651074a67a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f22f00a46f0 tx=0x7f22f00cb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81ed6f120e7bea5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f22cd4e4640 1 -- 10.20.193.28:0/4115875105 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f00a4cd0 con 0x5651074905e0 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f22cd4e4640 1 -- 10.20.193.28:0/4115875105 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22f00de1d0 con 0x5651074905e0 2026-02-20T03:34:18.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f22cd4e4640 1 -- 10.20.193.28:0/4115875105 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f00a4e70 con 0x5651074905e0 2026-02-20T03:34:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 -- 10.20.193.28:0/4115875105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 msgr2=0x5651074a67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 --2- 10.20.193.28:0/4115875105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 0x5651074a67a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f22f00a46f0 tx=0x7f22f00cb040 comp rx=0 tx=0).stop 2026-02-20T03:34:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 -- 10.20.193.28:0/4115875105 shutdown_connections 2026-02-20T03:34:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 --2- 10.20.193.28:0/4115875105 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565107495fb0 0x5651074c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 --2- 10.20.193.28:0/4115875105 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107490f60 0x5651074a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 --2- 10.20.193.28:0/4115875105 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5651074905e0 0x5651074a67a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 -- 10.20.193.28:0/4115875105 >> 10.20.193.28:0/4115875105 conn(0x565107453240 msgr2=0x5651074aaab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 -- 10.20.193.28:0/4115875105 shutdown_connections 2026-02-20T03:34:18.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.175+0000 7f23098fce00 1 -- 10.20.193.28:0/4115875105 wait complete. 2026-02-20T03:34:18.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- start start 2026-02-20T03:34:18.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 Processor -- start 2026-02-20T03:34:18.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5651074905e0 0x5651074ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107490f60 0x5651074ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x5651074ae390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac00e480 con 0x5651074905e0 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac00f8f0 con 0x565107495fb0 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac00eb50 con 0x565107490f60 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230596d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x5651074ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230516c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5651074905e0 0x5651074ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230496b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107490f60 0x5651074ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230596d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x5651074ae390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42730/0 (socket says 10.20.193.28:42730) 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230596d640 1 -- 10.20.193.28:0/3781240568 learned_addr learned my addr 10.20.193.28:0/3781240568 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230596d640 1 -- 10.20.193.28:0/3781240568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107490f60 msgr2=0x5651074ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:18.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230596d640 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107490f60 0x5651074ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230596d640 1 -- 10.20.193.28:0/3781240568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5651074905e0 msgr2=0x5651074ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230596d640 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5651074905e0 0x5651074ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230596d640 1 -- 10.20.193.28:0/3781240568 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651070c2870 con 0x565107495fb0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230596d640 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x5651074ae390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f22fc022b50 tx=0x7f22fc00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad05ddfa044bd6ef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 1 -- 10.20.193.28:0/3781240568 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc020a80 con 0x565107495fb0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- 10.20.193.28:0/3781240568 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651073833f0 con 0x565107495fb0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 10 client.28436 _ll_register_callbacks cb 0x7f22f4044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- 10.20.193.28:0/3781240568 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22f00de1d0 con 0x565107495fb0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 1 -- 10.20.193.28:0/3781240568 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f22fc034070 con 0x565107495fb0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 1 -- 10.20.193.28:0/3781240568 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc02e360 con 0x565107495fb0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 1 -- 10.20.193.28:0/3781240568 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f22fc02f400 con 0x565107495fb0 2026-02-20T03:34:18.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 1 -- 10.20.193.28:0/3781240568 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f22fc02f6c0 con 0x565107495fb0 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 10 client.28436 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- 10.20.193.28:0/3781240568 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=44}) -- 0x5651074a3480 con 0x565107495fb0 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 1 -- 10.20.193.28:0/3781240568 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f22fc02e500 con 0x565107495fb0 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 10 client.28436 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 10 client.28436 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 20 client.28436 populate_metadata read hostname 'trial028' 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x565107524f50 0x565107527410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 4 client.28436 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- 10.20.193.28:0/3781240568 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5651073eb560 con 0x565107524f50 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230516c640 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x565107524f50 0x565107527410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230516c640 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x565107524f50 0x565107527410 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=50b28153abc87602 server_cookie=9f72f65f6b508534 in_seq=0 out_seq=0 2026-02-20T03:34:18.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 10 client.28436 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 1 -- 10.20.193.28:0/3781240568 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5651073eb560 con 0x565107524f50 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 10 client.28436 handle_command_reply: tid=0 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 client.28436 shutdown 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- 10.20.193.28:0/3781240568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 msgr2=0x5651074ae390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x5651074ae390 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f22fc022b50 tx=0x7f22fc00b040 comp rx=0 tx=0).stop 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- 10.20.193.28:0/3781240568 shutdown_connections 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565107495fb0 0x5651074ae390 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x565107490f60 0x5651074ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x565107524f50 0x565107527410 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 --2- 10.20.193.28:0/3781240568 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5651074905e0 0x5651074ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- 10.20.193.28:0/3781240568 >> 10.20.193.28:0/3781240568 conn(0x565107453240 msgr2=0x565107491ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:18.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f22baffd640 0 client.28436 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:34:18.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- 10.20.193.28:0/3781240568 shutdown_connections 2026-02-20T03:34:18.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 1 -- 10.20.193.28:0/3781240568 wait complete. 2026-02-20T03:34:18.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f23098fce00 20 client.28436 trim_cache size 0 max 16384 2026-02-20T03:34:18.190 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:34:18.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 -- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d40b11a0 msgr2=0x7f22d40b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:18.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d40b11a0 0x7f22d40b3660 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009290 tx=0x7f22fc009040 comp rx=0 tx=0).stop 2026-02-20T03:34:18.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 -- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2300104980 msgr2=0x7f230019d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:18.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2300104980 0x7f230019d0b0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f22f000ea10 tx=0x7f22f000eee0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 -- 10.20.193.28:0/569244287 shutdown_connections 2026-02-20T03:34:18.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f22d40b11a0 0x7f22d40b3660 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f230010a980 0x7f23001a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2300105320 0x7f230019d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 --2- 10.20.193.28:0/569244287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2300104980 0x7f230019d0b0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:18.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 -- 10.20.193.28:0/569244287 >> 10.20.193.28:0/569244287 conn(0x7f2300100680 msgr2=0x7f2300100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:18.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 -- 10.20.193.28:0/569244287 shutdown_connections 2026-02-20T03:34:18.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:18.177+0000 7f230616e640 1 -- 10.20.193.28:0/569244287 wait complete. 2026-02-20T03:34:18.271 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:34:18.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:18 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/480902263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:34:18.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.89 MB/sec execute 229 sec latency 77170.136 ms 2026-02-20T03:34:18.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:18 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/480902263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:34:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:18 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/480902263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:34:18.859 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3590157118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b7810d6f0 msgr2=0x7f1b7810dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3590157118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b7810d6f0 0x7f1b7810dad0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009a30 tx=0x7f1b6402f260 comp rx=0 tx=0).stop 2026-02-20T03:34:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3590157118 shutdown_connections 2026-02-20T03:34:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3590157118 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b78112700 0x7f1b7811a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3590157118 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b7810e0a0 0x7f1b78111fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3590157118 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b7810d6f0 0x7f1b7810dad0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3590157118 >> 10.20.193.28:0/3590157118 conn(0x7f1b7806d500 msgr2=0x7f1b7806d910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3590157118 shutdown_connections 2026-02-20T03:34:19.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3590157118 wait complete. 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 Processor -- start 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- start start 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b7810d6f0 0x7f1b781ab650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b7810e0a0 0x7f1b781abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b78112700 0x7f1b781a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7811d640 con 0x7f1b78112700 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7811d4c0 con 0x7f1b7810d6f0 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7811d7c0 con 0x7f1b7810e0a0 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b777fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b7810d6f0 0x7f1b781ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b777fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b7810d6f0 0x7f1b781ab650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42746/0 (socket says 10.20.193.28:42746) 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b777fe640 1 -- 10.20.193.28:0/3458234571 learned_addr learned my addr 10.20.193.28:0/3458234571 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b77fff640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b78112700 0x7f1b781a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b777fe640 1 -- 10.20.193.28:0/3458234571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b7810e0a0 msgr2=0x7f1b781abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b777fe640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b7810e0a0 0x7f1b781abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b777fe640 1 -- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b78112700 msgr2=0x7f1b781a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b777fe640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b78112700 0x7f1b781a57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b777fe640 1 -- 10.20.193.28:0/3458234571 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b781a6000 con 0x7f1b7810d6f0 2026-02-20T03:34:19.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b777fe640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b7810d6f0 0x7f1b781ab650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1b6402f770 tx=0x7f1b64004660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b74ff9640 1 -- 10.20.193.28:0/3458234571 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64002b30 con 0x7f1b7810d6f0 2026-02-20T03:34:19.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3458234571 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b781a6290 con 0x7f1b7810d6f0 2026-02-20T03:34:19.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b74ff9640 1 -- 10.20.193.28:0/3458234571 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b64038b70 con 0x7f1b7810d6f0 2026-02-20T03:34:19.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3458234571 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b781b24b0 con 0x7f1b7810d6f0 2026-02-20T03:34:19.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.115+0000 7f1b74ff9640 1 -- 10.20.193.28:0/3458234571 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64041b00 con 0x7f1b7810d6f0 2026-02-20T03:34:19.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b74ff9640 1 -- 10.20.193.28:0/3458234571 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1b64041ca0 con 0x7f1b7810d6f0 2026-02-20T03:34:19.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b74ff9640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b4c0b0da0 0x7f1b4c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.126 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b74ff9640 1 -- 10.20.193.28:0/3458234571 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f1b64105610 con 0x7f1b7810d6f0 2026-02-20T03:34:19.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b76ffd640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b4c0b0da0 0x7f1b4c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b76ffd640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b4c0b0da0 0x7f1b4c0b3260 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1b7810cee0 tx=0x7f1b68006d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b8078ae00 1 Processor -- start 2026-02-20T03:34:19.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b8078ae00 1 -- start start 2026-02-20T03:34:19.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d944470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 0x56536d948570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.129 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 0x56536d950820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56536d8bbe00 con 0x56536d944090 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56536d88e970 con 0x56536d948c80 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.121+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56536d83c1f0 con 0x56536d944a40 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d944470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b76ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 0x56536d948570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d944470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47884/0 (socket says 10.20.193.28:47884) 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 -- 10.20.193.28:0/3651790524 learned_addr learned my addr 10.20.193.28:0/3651790524 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b77fff640 1 --2- 10.20.193.28:0/3651790524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 0x56536d950820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 -- 10.20.193.28:0/3651790524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 msgr2=0x56536d948570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 --2- 10.20.193.28:0/3651790524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 0x56536d948570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 -- 10.20.193.28:0/3651790524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 msgr2=0x56536d950820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 --2- 10.20.193.28:0/3651790524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 0x56536d950820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 -- 10.20.193.28:0/3651790524 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d84f3d0 con 0x56536d944090 2026-02-20T03:34:19.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b77fff640 1 --2- 10.20.193.28:0/3651790524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 0x56536d950820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:19.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 --2- 10.20.193.28:0/3651790524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d944470 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f1b640ccff0 tx=0x7f1b6402f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb21308e138e2ba server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b3bfff640 1 -- 10.20.193.28:0/3651790524 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b640cd9f0 con 0x56536d944090 2026-02-20T03:34:19.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b3bfff640 1 -- 10.20.193.28:0/3651790524 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b64033020 con 0x56536d944090 2026-02-20T03:34:19.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b3bfff640 1 -- 10.20.193.28:0/3651790524 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64038d20 con 0x56536d944090 2026-02-20T03:34:19.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 -- 10.20.193.28:0/3651790524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 msgr2=0x56536d944470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/3651790524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d944470 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f1b640ccff0 tx=0x7f1b6402f260 comp rx=0 tx=0).stop 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 -- 10.20.193.28:0/3651790524 shutdown_connections 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/3651790524 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 0x56536d950820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/3651790524 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 0x56536d948570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/3651790524 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d944470 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 -- 10.20.193.28:0/3651790524 >> 10.20.193.28:0/3651790524 conn(0x56536d8fe240 msgr2=0x56536d9426f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 -- 10.20.193.28:0/3651790524 shutdown_connections 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 -- 10.20.193.28:0/3651790524 wait complete. 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 -- start start 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 Processor -- start 2026-02-20T03:34:19.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d95c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d95cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d948c80 0x56536d962440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56536d88a8a0 con 0x56536d944090 2026-02-20T03:34:19.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56536d67cf50 con 0x56536d944a40 2026-02-20T03:34:19.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56536d962980 con 0x56536d948c80 2026-02-20T03:34:19.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d95c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b77fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d948c80 0x56536d962440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b77fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d948c80 0x56536d962440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33162/0 (socket says 10.20.193.28:33162) 2026-02-20T03:34:19.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b77fff640 1 -- 10.20.193.28:0/973600222 learned_addr learned my addr 10.20.193.28:0/973600222 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.126+0000 7f1b76ffd640 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d95cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b77fff640 1 -- 10.20.193.28:0/973600222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 msgr2=0x56536d95cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b77fff640 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d95cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b77fff640 1 -- 10.20.193.28:0/973600222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 msgr2=0x56536d95c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b77fff640 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d95c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b77fff640 1 -- 10.20.193.28:0/973600222 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d956110 con 0x56536d948c80 2026-02-20T03:34:19.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b76ffd640 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d95cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b777fe640 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d95c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b77fff640 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d948c80 0x56536d962440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c002fd0 tx=0x7f1b6c004540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d4154b8633f53ae server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b397fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:34:19.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b397fa640 1 -- 10.20.193.28:0/973600222 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c01a030 con 0x56536d948c80 2026-02-20T03:34:19.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b397fa640 1 -- 10.20.193.28:0/973600222 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b6c016460 con 0x56536d948c80 2026-02-20T03:34:19.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b397fa640 1 -- 10.20.193.28:0/973600222 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c015620 con 0x56536d948c80 2026-02-20T03:34:19.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b8078ae00 1 -- 10.20.193.28:0/973600222 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536d65fb40 con 0x56536d948c80 2026-02-20T03:34:19.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b8078ae00 10 client.28438 _ll_register_callbacks cb 0x56536d8c7eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:19.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.131+0000 7f1b8078ae00 1 -- 10.20.193.28:0/973600222 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56536d89c150 con 0x56536d948c80 2026-02-20T03:34:19.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b397fa640 1 -- 10.20.193.28:0/973600222 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f1b6c004b40 con 0x56536d948c80 2026-02-20T03:34:19.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b397fa640 1 -- 10.20.193.28:0/973600222 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f1b6c004e00 con 0x56536d948c80 2026-02-20T03:34:19.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b8078ae00 10 client.28438 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:19.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b8078ae00 1 -- 10.20.193.28:0/973600222 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=44}) -- 0x56536d8491e0 con 0x56536d948c80 2026-02-20T03:34:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b397fa640 1 -- 10.20.193.28:0/973600222 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f1b6c007a10 con 0x56536d948c80 2026-02-20T03:34:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b8078ae00 10 client.28438 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b8078ae00 10 client.28438 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:34:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b8078ae00 20 client.28438 populate_metadata read hostname 'trial028' 2026-02-20T03:34:19.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56536d96caf0 0x56536d96efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b8078ae00 4 client.28438 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b8078ae00 1 -- 10.20.193.28:0/973600222 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56536d896560 con 0x56536d96caf0 2026-02-20T03:34:19.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b777fe640 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56536d96caf0 0x56536d96efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b397fa640 10 client.28438 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:34:19.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.134+0000 7f1b777fe640 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56536d96caf0 0x56536d96efb0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d12509f068ce580a server_cookie=5eb813ae134963b3 in_seq=0 out_seq=0 2026-02-20T03:34:19.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b397fa640 1 -- 10.20.193.28:0/973600222 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56536d896560 con 0x56536d96caf0 2026-02-20T03:34:19.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b397fa640 10 client.28438 handle_command_reply: tid=0 2026-02-20T03:34:19.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 client.28438 shutdown 2026-02-20T03:34:19.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 -- 10.20.193.28:0/973600222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d948c80 msgr2=0x56536d962440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d948c80 0x56536d962440 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c002fd0 tx=0x7f1b6c004540 comp rx=0 tx=0).stop 2026-02-20T03:34:19.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 -- 10.20.193.28:0/973600222 shutdown_connections 2026-02-20T03:34:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56536d96caf0 0x56536d96efb0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d948c80 0x56536d962440 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d95cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/973600222 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d95c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 -- 10.20.193.28:0/973600222 >> 10.20.193.28:0/973600222 conn(0x56536d8fe240 msgr2=0x56536d949ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b397fa640 0 client.28438 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:34:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 -- 10.20.193.28:0/973600222 shutdown_connections 2026-02-20T03:34:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 1 -- 10.20.193.28:0/973600222 wait complete. 2026-02-20T03:34:19.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.140+0000 7f1b8078ae00 20 client.28438 trim_cache size 0 max 16384 2026-02-20T03:34:19.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 Processor -- start 2026-02-20T03:34:19.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 -- start start 2026-02-20T03:34:19.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d949d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 0x56536d959c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 0x56536d95a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c012770 con 0x56536d944090 2026-02-20T03:34:19.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c010040 con 0x56536d948c80 2026-02-20T03:34:19.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c00de90 con 0x56536d944a40 2026-02-20T03:34:19.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b76ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 0x56536d959c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b76ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 0x56536d959c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33168/0 (socket says 10.20.193.28:33168) 2026-02-20T03:34:19.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b76ffd640 1 -- 10.20.193.28:0/4079862334 learned_addr learned my addr 10.20.193.28:0/4079862334 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b77fff640 1 --2- 10.20.193.28:0/4079862334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 0x56536d95a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b777fe640 1 --2- 10.20.193.28:0/4079862334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d949d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b777fe640 1 -- 10.20.193.28:0/4079862334 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 msgr2=0x56536d959c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b777fe640 1 --2- 10.20.193.28:0/4079862334 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 0x56536d959c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b777fe640 1 -- 10.20.193.28:0/4079862334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 msgr2=0x56536d95a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b777fe640 1 --2- 10.20.193.28:0/4079862334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 0x56536d95a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b777fe640 1 -- 10.20.193.28:0/4079862334 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d955f40 con 0x56536d944090 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b777fe640 1 --2- 10.20.193.28:0/4079862334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d949d70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x56536d95dee0 tx=0x7f1b64038570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8e42952b328435 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b3b7fe640 1 -- 10.20.193.28:0/4079862334 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b640b9070 con 0x56536d944090 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b3b7fe640 1 -- 10.20.193.28:0/4079862334 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b640d16a0 con 0x56536d944090 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b3b7fe640 1 -- 10.20.193.28:0/4079862334 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64105280 con 0x56536d944090 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 -- 10.20.193.28:0/4079862334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 msgr2=0x56536d949d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.147+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/4079862334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d949d70 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x56536d95dee0 tx=0x7f1b64038570 comp rx=0 tx=0).stop 2026-02-20T03:34:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- 10.20.193.28:0/4079862334 shutdown_connections 2026-02-20T03:34:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/4079862334 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d948c80 0x56536d95a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/4079862334 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944a40 0x56536d959c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/4079862334 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d944090 0x56536d949d70 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- 10.20.193.28:0/4079862334 >> 10.20.193.28:0/4079862334 conn(0x56536d8fe240 msgr2=0x56536d949660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- 10.20.193.28:0/4079862334 shutdown_connections 2026-02-20T03:34:19.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- 10.20.193.28:0/4079862334 wait complete. 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- start start 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 Processor -- start 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944090 0x56536d965b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d966070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d948c80 0x56536d9d7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c00e500 con 0x56536d948c80 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b777fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944090 0x56536d965b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c00f970 con 0x56536d944a40 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1c00ebd0 con 0x56536d944090 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b76ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d966070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b76ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d966070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42774/0 (socket says 10.20.193.28:42774) 2026-02-20T03:34:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b76ffd640 1 -- 10.20.193.28:0/2371279392 learned_addr learned my addr 10.20.193.28:0/2371279392 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b76ffd640 1 -- 10.20.193.28:0/2371279392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944090 msgr2=0x56536d965b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b76ffd640 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944090 0x56536d965b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b76ffd640 1 -- 10.20.193.28:0/2371279392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d948c80 msgr2=0x56536d9d7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b76ffd640 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d948c80 0x56536d9d7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b76ffd640 1 -- 10.20.193.28:0/2371279392 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d56d870 con 0x56536d944a40 2026-02-20T03:34:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b397fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b76ffd640 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d966070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800ba40 tx=0x7f1b68004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=368fe56367fcc02 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b397fa640 1 -- 10.20.193.28:0/2371279392 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68025020 con 0x56536d944a40 2026-02-20T03:34:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b397fa640 1 -- 10.20.193.28:0/2371279392 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1b68011920 con 0x56536d944a40 2026-02-20T03:34:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- 10.20.193.28:0/2371279392 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536d82e3f0 con 0x56536d944a40 2026-02-20T03:34:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 10 client.28451 _ll_register_callbacks cb 0x7f1b6c002a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- 10.20.193.28:0/2371279392 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56536d85f7c0 con 0x56536d944a40 2026-02-20T03:34:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b397fa640 1 -- 10.20.193.28:0/2371279392 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b68021a40 con 0x56536d944a40 2026-02-20T03:34:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b397fa640 1 -- 10.20.193.28:0/2371279392 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f1b68021be0 con 0x56536d944a40 2026-02-20T03:34:19.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b397fa640 1 -- 10.20.193.28:0/2371279392 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f1b68021e60 con 0x56536d944a40 2026-02-20T03:34:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 10 client.28451 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- 10.20.193.28:0/2371279392 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=44}) -- 0x56536d956c30 con 0x56536d944a40 2026-02-20T03:34:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b397fa640 1 -- 10.20.193.28:0/2371279392 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f1b68011480 con 0x56536d944a40 2026-02-20T03:34:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 10 client.28451 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 10 client.28451 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:34:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 20 client.28451 populate_metadata read hostname 'trial028' 2026-02-20T03:34:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56536d9d9520 0x56536d9db9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 4 client.28451 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:34:19.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.153+0000 7f1b8078ae00 1 -- 10.20.193.28:0/2371279392 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56536d840ab0 con 0x56536d9d9520 2026-02-20T03:34:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b777fe640 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56536d9d9520 0x56536d9db9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b777fe640 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56536d9d9520 0x56536d9db9e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edeef4b28e4dd94b server_cookie=c200c06f76b3c492 in_seq=0 out_seq=0 2026-02-20T03:34:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b397fa640 10 client.28451 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:34:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b397fa640 1 -- 10.20.193.28:0/2371279392 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56536d840ab0 con 0x56536d9d9520 2026-02-20T03:34:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b397fa640 10 client.28451 handle_command_reply: tid=0 2026-02-20T03:34:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 client.28451 shutdown 2026-02-20T03:34:19.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 -- 10.20.193.28:0/2371279392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 msgr2=0x56536d966070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d966070 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800ba40 tx=0x7f1b68004940 comp rx=0 tx=0).stop 2026-02-20T03:34:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 -- 10.20.193.28:0/2371279392 shutdown_connections 2026-02-20T03:34:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56536d9d9520 0x56536d9db9e0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56536d948c80 0x56536d9d7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56536d944a40 0x56536d966070 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 --2- 10.20.193.28:0/2371279392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56536d944090 0x56536d965b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 -- 10.20.193.28:0/2371279392 >> 10.20.193.28:0/2371279392 conn(0x56536d8fe240 msgr2=0x56536d949e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b397fa640 0 client.28451 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:34:19.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 -- 10.20.193.28:0/2371279392 shutdown_connections 2026-02-20T03:34:19.166 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:34:19.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.158+0000 7f1b8078ae00 1 -- 10.20.193.28:0/2371279392 wait complete. 2026-02-20T03:34:19.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b8078ae00 20 client.28451 trim_cache size 0 max 16384 2026-02-20T03:34:19.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b4c0b0da0 msgr2=0x7f1b4c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b4c0b0da0 0x7f1b4c0b3260 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1b7810cee0 tx=0x7f1b68006d90 comp rx=0 tx=0).stop 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3458234571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b7810d6f0 msgr2=0x7f1b781ab650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b7810d6f0 0x7f1b781ab650 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1b6402f770 tx=0x7f1b64004660 comp rx=0 tx=0).stop 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3458234571 shutdown_connections 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1b4c0b0da0 0x7f1b4c0b3260 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1b78112700 0x7f1b781a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1b7810e0a0 0x7f1b781abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 --2- 10.20.193.28:0/3458234571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1b7810d6f0 0x7f1b781ab650 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3458234571 >> 10.20.193.28:0/3458234571 conn(0x7f1b7806d500 msgr2=0x7f1b7810b530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3458234571 shutdown_connections 2026-02-20T03:34:19.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.161+0000 7f1b7cffc640 1 -- 10.20.193.28:0/3458234571 wait complete. 2026-02-20T03:34:19.252 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:34:19.562 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:19.575 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:19 trial028 ceph-mon[38552]: pgmap v775: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 6.5 KiB/s wr, 8 op/s 2026-02-20T03:34:19.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.82 MB/sec execute 230 sec latency 78170.174 ms 2026-02-20T03:34:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:19 trial177 ceph-mon[43181]: pgmap v775: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 6.5 KiB/s wr, 8 op/s 2026-02-20T03:34:19.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- 10.20.193.28:0/1455184656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcce4109ba0 msgr2=0x7fcce4115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 --2- 10.20.193.28:0/1455184656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcce4109ba0 0x7fcce4115d10 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fcce000b0a0 tx=0x7fcce002f410 comp rx=0 tx=0).stop 2026-02-20T03:34:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- 10.20.193.28:0/1455184656 shutdown_connections 2026-02-20T03:34:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 --2- 10.20.193.28:0/1455184656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcce4109ba0 0x7fcce4115d10 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 --2- 10.20.193.28:0/1455184656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcce4109220 0x7fcce4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 --2- 10.20.193.28:0/1455184656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcce410eef0 0x7fcce410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- 10.20.193.28:0/1455184656 >> 10.20.193.28:0/1455184656 conn(0x7fcce4078600 msgr2=0x7fcce407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- 10.20.193.28:0/1455184656 shutdown_connections 2026-02-20T03:34:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- 10.20.193.28:0/1455184656 wait complete. 2026-02-20T03:34:19.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 Processor -- start 2026-02-20T03:34:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- start start 2026-02-20T03:34:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcce4109220 0x7fcce41a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcce4109ba0 0x7fcce41a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcce410eef0 0x7fcce41a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcce4119090 con 0x7fcce410eef0 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcce4118f10 con 0x7fcce4109ba0 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcce4119210 con 0x7fcce4109220 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce8873640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcce4109220 0x7fcce41a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce8873640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcce4109220 0x7fcce41a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33194/0 (socket says 10.20.193.28:33194) 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce8873640 1 -- 10.20.193.28:0/1081034875 learned_addr learned my addr 10.20.193.28:0/1081034875 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccdbfff640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcce4109ba0 0x7fcce41a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9074640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcce410eef0 0x7fcce41a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccdbfff640 1 -- 10.20.193.28:0/1081034875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcce4109220 msgr2=0x7fcce41a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccdbfff640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcce4109220 0x7fcce41a1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccdbfff640 1 -- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcce410eef0 msgr2=0x7fcce41a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccdbfff640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcce410eef0 0x7fcce41a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccdbfff640 1 -- 10.20.193.28:0/1081034875 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce41a6460 con 0x7fcce4109ba0 2026-02-20T03:34:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce8873640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcce4109220 0x7fcce41a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccdbfff640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcce4109ba0 0x7fcce41a1950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00e9f0 tx=0x7fcccc00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccd9ffb640 1 -- 10.20.193.28:0/1081034875 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00cd80 con 0x7fcce4109ba0 2026-02-20T03:34:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- 10.20.193.28:0/1081034875 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce41a6750 con 0x7fcce4109ba0 2026-02-20T03:34:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccd9ffb640 1 -- 10.20.193.28:0/1081034875 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcccc004570 con 0x7fcce4109ba0 2026-02-20T03:34:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fccd9ffb640 1 -- 10.20.193.28:0/1081034875 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc010690 con 0x7fcce4109ba0 2026-02-20T03:34:19.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.802+0000 7fcce9875640 1 -- 10.20.193.28:0/1081034875 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce41adf90 con 0x7fcce4109ba0 2026-02-20T03:34:19.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fccd9ffb640 1 -- 10.20.193.28:0/1081034875 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fcccc020030 con 0x7fcce4109ba0 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 Processor -- start 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 -- start start 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c42f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 0x560c8c429a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c429f60 0x560c8c435de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560c8c3a9e00 con 0x560c8c42efb0 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560c8c37c970 con 0x560c8c429f60 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560c8c32a1f0 con 0x560c8c4295e0 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce9074640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c42f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce9074640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c42f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47932/0 (socket says 10.20.193.28:47932) 2026-02-20T03:34:19.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce9074640 1 -- 10.20.193.28:0/3308703777 learned_addr learned my addr 10.20.193.28:0/3308703777 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce8873640 1 --2- 10.20.193.28:0/3308703777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 0x560c8c429a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fccdbfff640 1 --2- 10.20.193.28:0/3308703777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c429f60 0x560c8c435de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce9074640 1 -- 10.20.193.28:0/3308703777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 msgr2=0x560c8c429a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce9074640 1 --2- 10.20.193.28:0/3308703777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 0x560c8c429a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce9074640 1 -- 10.20.193.28:0/3308703777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c429f60 msgr2=0x560c8c435de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce9074640 1 --2- 10.20.193.28:0/3308703777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c429f60 0x560c8c435de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce9074640 1 -- 10.20.193.28:0/3308703777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8c33d3d0 con 0x560c8c42efb0 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fccd9ffb640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fccc00b0e20 0x7fccc00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fccd9ffb640 1 -- 10.20.193.28:0/1081034875 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fcccc0e0ad0 con 0x7fcce4109ba0 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce8873640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fccc00b0e20 0x7fccc00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce9074640 1 --2- 10.20.193.28:0/3308703777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c42f390 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fcce0007550 tx=0x7fcce000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3552620c9236237 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fccb14e4640 1 -- 10.20.193.28:0/3308703777 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce00042c0 con 0x560c8c42efb0 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fccb14e4640 1 -- 10.20.193.28:0/3308703777 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcce0033050 con 0x560c8c42efb0 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fccb14e4640 1 -- 10.20.193.28:0/3308703777 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce00076a0 con 0x560c8c42efb0 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 -- 10.20.193.28:0/3308703777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 msgr2=0x560c8c42f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 --2- 10.20.193.28:0/3308703777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c42f390 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fcce0007550 tx=0x7fcce000c000 comp rx=0 tx=0).stop 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcce8873640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fccc00b0e20 0x7fccc00b32e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fccd40042c0 tx=0x7fccd4009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 -- 10.20.193.28:0/3308703777 shutdown_connections 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 --2- 10.20.193.28:0/3308703777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c429f60 0x560c8c435de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 --2- 10.20.193.28:0/3308703777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 0x560c8c429a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 --2- 10.20.193.28:0/3308703777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c42f390 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 -- 10.20.193.28:0/3308703777 >> 10.20.193.28:0/3308703777 conn(0x560c8c3ec240 msgr2=0x560c8c427ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 -- 10.20.193.28:0/3308703777 shutdown_connections 2026-02-20T03:34:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.805+0000 7fcced003e00 1 -- 10.20.193.28:0/3308703777 wait complete. 2026-02-20T03:34:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- start start 2026-02-20T03:34:19.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 Processor -- start 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 0x560c8c443810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c443d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c42efb0 0x560c8c441f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x560c8c3788a0 con 0x560c8c429f60 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x560c8c16af50 con 0x560c8c4295e0 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x560c8c4426d0 con 0x560c8c42efb0 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcce8873640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 0x560c8c443810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcce9074640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c42efb0 0x560c8c441f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fccdbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c443d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcce9074640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c42efb0 0x560c8c441f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33210/0 (socket says 10.20.193.28:33210) 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcce9074640 1 -- 10.20.193.28:0/2531391694 learned_addr learned my addr 10.20.193.28:0/2531391694 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fccdbfff640 1 -- 10.20.193.28:0/2531391694 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c42efb0 msgr2=0x560c8c441f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fccdbfff640 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c42efb0 0x560c8c441f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fccdbfff640 1 -- 10.20.193.28:0/2531391694 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 msgr2=0x560c8c443810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fccdbfff640 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 0x560c8c443810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fccdbfff640 1 -- 10.20.193.28:0/2531391694 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8c43ba20 con 0x560c8c429f60 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fccdbfff640 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c443d50 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c6a0 tx=0x7fcccc0a4420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5eb7917f5147d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:19.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 1 -- 10.20.193.28:0/2531391694 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0a7cd0 con 0x560c8c429f60 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- 10.20.193.28:0/2531391694 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8c14db40 con 0x560c8c429f60 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 10 client.20868 _ll_register_callbacks cb 0x560c8c3b5eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- 10.20.193.28:0/2531391694 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c8c38a150 con 0x560c8c429f60 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 1 -- 10.20.193.28:0/2531391694 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x560c8c38a150 con 0x560c8c429f60 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 1 -- 10.20.193.28:0/2531391694 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0a77c0 con 0x560c8c429f60 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 1 -- 10.20.193.28:0/2531391694 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fcccc0a7960 con 0x560c8c429f60 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 1 -- 10.20.193.28:0/2531391694 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fcccc0a3ed0 con 0x560c8c429f60 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 10 client.20868 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- 10.20.193.28:0/2531391694 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x560c8c3371e0 con 0x560c8c429f60 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 1 -- 10.20.193.28:0/2531391694 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fcccc0cd050 con 0x560c8c429f60 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 10 client.20868 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 10 client.20868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 20 client.20868 populate_metadata read hostname 'trial028' 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c8c452000 0x560c8c4544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 4 client.20868 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- 10.20.193.28:0/2531391694 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c8c384560 con 0x560c8c452000 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcce8873640 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c8c452000 0x560c8c4544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcce8873640 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c8c452000 0x560c8c4544c0 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78bce93691f41158 server_cookie=4a7e088186ca0cf1 in_seq=0 out_seq=0 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 10 client.20868 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 1 -- 10.20.193.28:0/2531391694 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x560c8c384560 con 0x560c8c452000 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 10 client.20868 handle_command_reply: tid=0 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 client.20868 shutdown 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- 10.20.193.28:0/2531391694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 msgr2=0x560c8c443d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c443d50 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c6a0 tx=0x7fcccc0a4420 comp rx=0 tx=0).stop 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- 10.20.193.28:0/2531391694 shutdown_connections 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c8c452000 0x560c8c4544c0 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c42efb0 0x560c8c441f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c443d50 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 --2- 10.20.193.28:0/2531391694 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 0x560c8c443810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- 10.20.193.28:0/2531391694 >> 10.20.193.28:0/2531391694 conn(0x560c8c3ec240 msgr2=0x560c8c4283f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcca27fc640 0 client.20868 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- 10.20.193.28:0/2531391694 shutdown_connections 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 1 -- 10.20.193.28:0/2531391694 wait complete. 2026-02-20T03:34:19.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.811+0000 7fcced003e00 20 client.20868 trim_cache size 0 max 16384 2026-02-20T03:34:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.817+0000 7fcced003e00 1 Processor -- start 2026-02-20T03:34:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.817+0000 7fcced003e00 1 -- start start 2026-02-20T03:34:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.817+0000 7fcced003e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 0x560c8c421d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c43f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c42efb0 0x560c8c4284d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88012770 con 0x560c8c429f60 2026-02-20T03:34:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88010040 con 0x560c8c42efb0 2026-02-20T03:34:19.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8800de90 con 0x560c8c4295e0 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccdbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c43f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccdbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c43f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47958/0 (socket says 10.20.193.28:47958) 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccdbfff640 1 -- 10.20.193.28:0/601048446 learned_addr learned my addr 10.20.193.28:0/601048446 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcce8873640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 0x560c8c421d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcce9074640 1 --2- 10.20.193.28:0/601048446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c42efb0 0x560c8c4284d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccdbfff640 1 -- 10.20.193.28:0/601048446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 msgr2=0x560c8c421d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccdbfff640 1 --2- 10.20.193.28:0/601048446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 0x560c8c421d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccdbfff640 1 -- 10.20.193.28:0/601048446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c42efb0 msgr2=0x560c8c4284d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccdbfff640 1 --2- 10.20.193.28:0/601048446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c42efb0 0x560c8c4284d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccdbfff640 1 -- 10.20.193.28:0/601048446 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8c43b850 con 0x560c8c429f60 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcce9074640 1 --2- 10.20.193.28:0/601048446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c42efb0 0x560c8c4284d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:19.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccdbfff640 1 --2- 10.20.193.28:0/601048446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c43f760 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ab040 tx=0x7fcccc0a7bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43693aa5556eae70 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccb0ce3640 1 -- 10.20.193.28:0/601048446 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0a8eb0 con 0x560c8c429f60 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccb0ce3640 1 -- 10.20.193.28:0/601048446 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcccc0afe50 con 0x560c8c429f60 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fccb0ce3640 1 -- 10.20.193.28:0/601048446 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0a77c0 con 0x560c8c429f60 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 -- 10.20.193.28:0/601048446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 msgr2=0x560c8c43f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 --2- 10.20.193.28:0/601048446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c43f760 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ab040 tx=0x7fcccc0a7bb0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 -- 10.20.193.28:0/601048446 shutdown_connections 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 --2- 10.20.193.28:0/601048446 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c42efb0 0x560c8c4284d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 --2- 10.20.193.28:0/601048446 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c429f60 0x560c8c43f760 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 --2- 10.20.193.28:0/601048446 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c4295e0 0x560c8c421d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 -- 10.20.193.28:0/601048446 >> 10.20.193.28:0/601048446 conn(0x560c8c3ec240 msgr2=0x560c8c43f050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 -- 10.20.193.28:0/601048446 shutdown_connections 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 -- 10.20.193.28:0/601048446 wait complete. 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.822+0000 7fcced003e00 1 -- start start 2026-02-20T03:34:19.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 Processor -- start 2026-02-20T03:34:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 0x560c8c44b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c429f60 0x560c8c44bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c4b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9074640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c4b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce8873640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 0x560c8c44b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fccdbfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c429f60 0x560c8c44bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce8873640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 0x560c8c44b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42812/0 (socket says 10.20.193.28:42812) 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce8873640 1 -- 10.20.193.28:0/4164075399 learned_addr learned my addr 10.20.193.28:0/4164075399 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8800e500 con 0x560c8c42efb0 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9074640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c4b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47968/0 (socket says 10.20.193.28:47968) 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8800f970 con 0x560c8c4295e0 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8800ebd0 con 0x560c8c429f60 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9074640 1 -- 10.20.193.28:0/4164075399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c429f60 msgr2=0x560c8c44bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9074640 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c429f60 0x560c8c44bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9074640 1 -- 10.20.193.28:0/4164075399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 msgr2=0x560c8c44b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9074640 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 0x560c8c44b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9074640 1 -- 10.20.193.28:0/4164075399 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c8c05b870 con 0x560c8c42efb0 2026-02-20T03:34:19.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9074640 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c4b5f70 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fcce000b0a0 tx=0x7fcce0006210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c91329f0eec29c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 1 -- 10.20.193.28:0/4164075399 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce00047c0 con 0x560c8c42efb0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 1 -- 10.20.193.28:0/4164075399 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fcce0009420 con 0x560c8c42efb0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 1 -- 10.20.193.28:0/4164075399 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce004b420 con 0x560c8c42efb0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8c31c3f0 con 0x560c8c42efb0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 10 client.20874 _ll_register_callbacks cb 0x7fcccc00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c8c34d7c0 con 0x560c8c42efb0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 1 -- 10.20.193.28:0/4164075399 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fcce0002a60 con 0x560c8c42efb0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 1 -- 10.20.193.28:0/4164075399 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fcce004f030 con 0x560c8c42efb0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 10 client.20874 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x560c8c43c540 con 0x560c8c42efb0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 1 -- 10.20.193.28:0/4164075399 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fcce0055060 con 0x560c8c42efb0 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 10 client.20874 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 10 client.20874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 20 client.20874 populate_metadata read hostname 'trial028' 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c8c4be870 0x560c8c4c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 4 client.20874 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c8c32eab0 con 0x560c8c4be870 2026-02-20T03:34:19.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce8873640 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c8c4be870 0x560c8c4c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce8873640 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c8c4be870 0x560c8c4c0d00 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bff688c02540db3e server_cookie=70d77c9ee3111ef4 in_seq=0 out_seq=0 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 10 client.20874 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 1 -- 10.20.193.28:0/4164075399 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c8c32eab0 con 0x560c8c4be870 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 10 client.20874 handle_command_reply: tid=0 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 client.20874 shutdown 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 msgr2=0x560c8c4b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c4b5f70 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fcce000b0a0 tx=0x7fcce0006210 comp rx=0 tx=0).stop 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 shutdown_connections 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560c8c4be870 0x560c8c4c0d00 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560c8c42efb0 0x560c8c4b5f70 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560c8c429f60 0x560c8c44bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 --2- 10.20.193.28:0/4164075399 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x560c8c4295e0 0x560c8c44b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 >> 10.20.193.28:0/4164075399 conn(0x560c8c3ec240 msgr2=0x560c8c43f760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcca27fc640 0 client.20874 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 shutdown_connections 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 1 -- 10.20.193.28:0/4164075399 wait complete. 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcced003e00 20 client.20874 trim_cache size 0 max 16384 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 -- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fccc00b0e20 msgr2=0x7fccc00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fccc00b0e20 0x7fccc00b32e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fccd40042c0 tx=0x7fccd4009290 comp rx=0 tx=0).stop 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 -- 10.20.193.28:0/1081034875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcce4109ba0 msgr2=0x7fcce41a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcce4109ba0 0x7fcce41a1950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00e9f0 tx=0x7fcccc00eec0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 -- 10.20.193.28:0/1081034875 shutdown_connections 2026-02-20T03:34:19.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fccc00b0e20 0x7fccc00b32e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fcce410eef0 0x7fcce41a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fcce4109ba0 0x7fcce41a1950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 --2- 10.20.193.28:0/1081034875 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fcce4109220 0x7fcce41a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:19.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 -- 10.20.193.28:0/1081034875 >> 10.20.193.28:0/1081034875 conn(0x7fcce4078600 msgr2=0x7fcce4079cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:19.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 -- 10.20.193.28:0/1081034875 shutdown_connections 2026-02-20T03:34:19.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:19.824+0000 7fcce9875640 1 -- 10.20.193.28:0/1081034875 wait complete. 2026-02-20T03:34:19.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:19 trial126 ceph-mon[38476]: pgmap v775: 129 pgs: 129 active+clean; 629 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 7.8 KiB/s rd, 6.5 KiB/s wr, 8 op/s 2026-02-20T03:34:20.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.74 MB/sec execute 231 sec latency 79170.212 ms 2026-02-20T03:34:20.917 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:34:20.917 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:34:21.184 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- 10.20.193.28:0/1746600688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810eef0 msgr2=0x7fe76810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 --2- 10.20.193.28:0/1746600688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810eef0 0x7fe76810f2d0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fe754009a30 tx=0x7fe75402f220 comp rx=0 tx=0).stop 2026-02-20T03:34:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- 10.20.193.28:0/1746600688 shutdown_connections 2026-02-20T03:34:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 --2- 10.20.193.28:0/1746600688 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe768109ba0 0x7fe768115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 --2- 10.20.193.28:0/1746600688 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe768109220 0x7fe768109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 --2- 10.20.193.28:0/1746600688 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe76810eef0 0x7fe76810f2d0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- 10.20.193.28:0/1746600688 >> 10.20.193.28:0/1746600688 conn(0x7fe768078600 msgr2=0x7fe76807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:21.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- 10.20.193.28:0/1746600688 shutdown_connections 2026-02-20T03:34:21.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- 10.20.193.28:0/1746600688 wait complete. 2026-02-20T03:34:21.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 Processor -- start 2026-02-20T03:34:21.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- start start 2026-02-20T03:34:21.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe768109220 0x7fe7681a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe768109ba0 0x7fe7681a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe76810eef0 0x7fe7681a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe768119050 con 0x7fe768109ba0 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe768118ed0 con 0x7fe768109220 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe7681191d0 con 0x7fe76810eef0 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe7677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe768109220 0x7fe7681a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe7677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe768109220 0x7fe7681a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42834/0 (socket says 10.20.193.28:42834) 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe7677fe640 1 -- 10.20.193.28:0/2038418918 learned_addr learned my addr 10.20.193.28:0/2038418918 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe767fff640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe76810eef0 0x7fe7681a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe7677fe640 1 -- 10.20.193.28:0/2038418918 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe76810eef0 msgr2=0x7fe7681a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:21.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe7677fe640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe76810eef0 0x7fe7681a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe7677fe640 1 -- 10.20.193.28:0/2038418918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe768109ba0 msgr2=0x7fe7681a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe7677fe640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe768109ba0 0x7fe7681a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe7677fe640 1 -- 10.20.193.28:0/2038418918 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7681a6580 con 0x7fe768109220 2026-02-20T03:34:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe7677fe640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe768109220 0x7fe7681a1530 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe754005ec0 tx=0x7fe754004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe764ff9640 1 -- 10.20.193.28:0/2038418918 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754005020 con 0x7fe768109220 2026-02-20T03:34:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe764ff9640 1 -- 10.20.193.28:0/2038418918 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe754005660 con 0x7fe768109220 2026-02-20T03:34:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe764ff9640 1 -- 10.20.193.28:0/2038418918 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754038b90 con 0x7fe768109220 2026-02-20T03:34:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- 10.20.193.28:0/2038418918 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7681a6810 con 0x7fe768109220 2026-02-20T03:34:21.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.425+0000 7fe76c82e640 1 -- 10.20.193.28:0/2038418918 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7681a6c40 con 0x7fe768109220 2026-02-20T03:34:21.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe764ff9640 1 -- 10.20.193.28:0/2038418918 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe754048030 con 0x7fe768109220 2026-02-20T03:34:21.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe76ffbce00 1 Processor -- start 2026-02-20T03:34:21.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe76ffbce00 1 -- start start 2026-02-20T03:34:21.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1e0c0 0x55f20dd1e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 0x55f20dd22540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd22fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f20dc70c00 con 0x55f20dd1ea70 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f20dc1e3c0 con 0x55f20dd22b60 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f20dc6cb30 con 0x55f20dd1e0c0 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe767fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1e0c0 0x55f20dd1e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe767fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1e0c0 0x55f20dd1e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33250/0 (socket says 10.20.193.28:33250) 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe767fff640 1 -- 10.20.193.28:0/548681832 learned_addr learned my addr 10.20.193.28:0/548681832 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe7677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 0x55f20dd22540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe766ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd22fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe766ffd640 1 -- 10.20.193.28:0/548681832 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1e0c0 msgr2=0x55f20dd1e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe766ffd640 1 --2- 10.20.193.28:0/548681832 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1e0c0 0x55f20dd1e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe766ffd640 1 -- 10.20.193.28:0/548681832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 msgr2=0x55f20dd22540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe766ffd640 1 --2- 10.20.193.28:0/548681832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 0x55f20dd22540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.430+0000 7fe766ffd640 1 -- 10.20.193.28:0/548681832 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20dc17840 con 0x55f20dd22b60 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe767fff640 1 --2- 10.20.193.28:0/548681832 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1e0c0 0x55f20dd1e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 --2- 10.20.193.28:0/548681832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 0x55f20dd22540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe764ff9640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe73c0b0da0 0x7fe73c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe766ffd640 1 --2- 10.20.193.28:0/548681832 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd22fd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe758009c10 tx=0x7fe75800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2b57b27067d52c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe764ff9640 1 -- 10.20.193.28:0/2038418918 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe754104840 con 0x7fe768109220 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe72bfff640 1 -- 10.20.193.28:0/548681832 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758004020 con 0x55f20dd22b60 2026-02-20T03:34:21.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe72bfff640 1 -- 10.20.193.28:0/548681832 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe7580048a0 con 0x55f20dd22b60 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe72bfff640 1 -- 10.20.193.28:0/548681832 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7580053a0 con 0x55f20dd22b60 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe767fff640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe73c0b0da0 0x7fe73c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/548681832 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 msgr2=0x55f20dd22fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/548681832 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd22fd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe758009c10 tx=0x7fe75800e720 comp rx=0 tx=0).stop 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/548681832 shutdown_connections 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/548681832 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd22fd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/548681832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 0x55f20dd22540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/548681832 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1e0c0 0x55f20dd1e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/548681832 >> 10.20.193.28:0/548681832 conn(0x55f20dd16b60 msgr2=0x55f20dd1c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/548681832 shutdown_connections 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe767fff640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe73c0b0da0 0x7fe73c0b3260 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009da0 tx=0x7fe75c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:21.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/548681832 wait complete. 2026-02-20T03:34:21.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- start start 2026-02-20T03:34:21.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 Processor -- start 2026-02-20T03:34:21.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd36d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1ea70 0x55f20dd372d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd42a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f20dc181a0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f20dd2ad70 con 0x55f20dd22b60 2026-02-20T03:34:21.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f20dd42f40 con 0x55f20dd1ea70 2026-02-20T03:34:21.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd36d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe767fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd42a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe766ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1ea70 0x55f20dd372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd36d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48008/0 (socket says 10.20.193.28:48008) 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 -- 10.20.193.28:0/3496214855 learned_addr learned my addr 10.20.193.28:0/3496214855 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe767fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd42a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42850/0 (socket says 10.20.193.28:42850) 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 -- 10.20.193.28:0/3496214855 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1ea70 msgr2=0x55f20dd372d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1ea70 0x55f20dd372d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 -- 10.20.193.28:0/3496214855 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 msgr2=0x55f20dd42a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd42a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 -- 10.20.193.28:0/3496214855 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20dd30500 con 0x55f20dd1e0c0 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7677fe640 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd36d90 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fe7540cc220 tx=0x7fe754108080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ebe3ca23c37d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:21.445 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 1 -- 10.20.193.28:0/3496214855 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540cc2f0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3496214855 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20da3fb60 con 0x55f20dd1e0c0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 1 -- 10.20.193.28:0/3496214855 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe754033030 con 0x55f20dd1e0c0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 1 -- 10.20.193.28:0/3496214855 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540cba40 con 0x55f20dd1e0c0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 10 client.20883 _ll_register_callbacks cb 0x55f20dc1c0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3496214855 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f20dc787f0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 1 -- 10.20.193.28:0/3496214855 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe7540d3bc0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 1 -- 10.20.193.28:0/3496214855 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe7540cbc20 con 0x55f20dd1e0c0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 10 client.20883 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3496214855 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f20dc3d430 con 0x55f20dd1e0c0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 1 -- 10.20.193.28:0/3496214855 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fe7540051c0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 10 client.20883 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 10 client.20883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 20 client.20883 populate_metadata read hostname 'trial028' 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f20dd46f40 0x55f20dd49400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 4 client.20883 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3496214855 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f20dbf2c00 con 0x55f20dd46f40 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe766ffd640 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f20dd46f40 0x55f20dd49400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe766ffd640 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f20dd46f40 0x55f20dd49400 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d5bd89a7c651285 server_cookie=ab1b30cedfd8c58a in_seq=0 out_seq=0 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 10 client.20883 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 1 -- 10.20.193.28:0/3496214855 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f20dbf2c00 con 0x55f20dd46f40 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 10 client.20883 handle_command_reply: tid=0 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 client.20883 shutdown 2026-02-20T03:34:21.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3496214855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 msgr2=0x55f20dd36d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd36d90 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fe7540cc220 tx=0x7fe754108080 comp rx=0 tx=0).stop 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3496214855 shutdown_connections 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f20dd46f40 0x55f20dd49400 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd22b60 0x55f20dd42a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd1ea70 0x55f20dd372d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3496214855 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd36d90 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3496214855 >> 10.20.193.28:0/3496214855 conn(0x55f20dd16b60 msgr2=0x55f20dd21520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe7297fa640 0 client.20883 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3496214855 shutdown_connections 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3496214855 wait complete. 2026-02-20T03:34:21.448 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.433+0000 7fe76ffbce00 20 client.20883 trim_cache size 0 max 16384 2026-02-20T03:34:21.449 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:21 trial028 ceph-mon[38552]: pgmap v776: 129 pgs: 129 active+clean; 605 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 70 op/s 2026-02-20T03:34:21.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 Processor -- start 2026-02-20T03:34:21.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- start start 2026-02-20T03:34:21.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd23650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1ea70 0x55f20dd23b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20dd4ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c0126e0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c00ffb0 con 0x55f20dd1ea70 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c00de00 con 0x55f20dd22b60 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20dd4ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20dd4ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33272/0 (socket says 10.20.193.28:33272) 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 -- 10.20.193.28:0/3524571594 learned_addr learned my addr 10.20.193.28:0/3524571594 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe766ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1ea70 0x55f20dd23b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 --2- 10.20.193.28:0/3524571594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd23650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 -- 10.20.193.28:0/3524571594 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1ea70 msgr2=0x55f20dd23b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 --2- 10.20.193.28:0/3524571594 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1ea70 0x55f20dd23b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 -- 10.20.193.28:0/3524571594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 msgr2=0x55f20dd23650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:21.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 --2- 10.20.193.28:0/3524571594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd23650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 -- 10.20.193.28:0/3524571594 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20dd30330 con 0x55f20dd22b60 2026-02-20T03:34:21.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 --2- 10.20.193.28:0/3524571594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd23650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:21.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 --2- 10.20.193.28:0/3524571594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20dd4ed10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0076b0 tx=0x7fe75c004a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbb02425836d04c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:21.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe72b7fe640 1 -- 10.20.193.28:0/3524571594 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c027070 con 0x55f20dd22b60 2026-02-20T03:34:21.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe72b7fe640 1 -- 10.20.193.28:0/3524571594 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe75c01b040 con 0x55f20dd22b60 2026-02-20T03:34:21.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe72b7fe640 1 -- 10.20.193.28:0/3524571594 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c01a040 con 0x55f20dd22b60 2026-02-20T03:34:21.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3524571594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 msgr2=0x55f20dd4ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:21.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3524571594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20dd4ed10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe75c0076b0 tx=0x7fe75c004a10 comp rx=0 tx=0).stop 2026-02-20T03:34:21.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3524571594 shutdown_connections 2026-02-20T03:34:21.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3524571594 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20dd4ed10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3524571594 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1ea70 0x55f20dd23b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/3524571594 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1e0c0 0x55f20dd23650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3524571594 >> 10.20.193.28:0/3524571594 conn(0x55f20dd16b60 msgr2=0x55f20dd22f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:21.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3524571594 shutdown_connections 2026-02-20T03:34:21.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- 10.20.193.28:0/3524571594 wait complete. 2026-02-20T03:34:21.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- start start 2026-02-20T03:34:21.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 Processor -- start 2026-02-20T03:34:21.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1e0c0 0x55f20dd3cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 0x55f20dd3d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20ddb1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c00e470 con 0x55f20dd1ea70 2026-02-20T03:34:21.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c00f8e0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c00eb40 con 0x55f20dd22b60 2026-02-20T03:34:21.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1e0c0 0x55f20dd3cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1e0c0 0x55f20dd3cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:42866/0 (socket says 10.20.193.28:42866) 2026-02-20T03:34:21.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 -- 10.20.193.28:0/1276882151 learned_addr learned my addr 10.20.193.28:0/1276882151 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe767fff640 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20ddb1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe766ffd640 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 0x55f20dd3d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 -- 10.20.193.28:0/1276882151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 msgr2=0x55f20ddb1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20ddb1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 -- 10.20.193.28:0/1276882151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 msgr2=0x55f20dd3d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 0x55f20dd3d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 -- 10.20.193.28:0/1276882151 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20d94f900 con 0x55f20dd1e0c0 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7677fe640 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1e0c0 0x55f20dd3cf20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe7540cc1d0 tx=0x7fe75410a5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e02292ac7c9a48 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7297fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7297fa640 1 -- 10.20.193.28:0/1276882151 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540cc2f0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7297fa640 1 -- 10.20.193.28:0/1276882151 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe754033030 con 0x55f20dd1e0c0 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- 10.20.193.28:0/1276882151 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20dc2b4d0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 10 client.28484 _ll_register_callbacks cb 0x7fe754005c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- 10.20.193.28:0/1276882151 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7580048a0 con 0x55f20dd1e0c0 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7297fa640 1 -- 10.20.193.28:0/1276882151 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540d3e20 con 0x55f20dd1e0c0 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7297fa640 1 -- 10.20.193.28:0/1276882151 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe7540c7c40 con 0x55f20dd1e0c0 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7297fa640 1 -- 10.20.193.28:0/1276882151 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fe7540c7e60 con 0x55f20dd1e0c0 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 10 client.28484 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- 10.20.193.28:0/1276882151 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55f20dd31020 con 0x55f20dd1e0c0 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe7297fa640 1 -- 10.20.193.28:0/1276882151 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7fe7540cb530 con 0x55f20dd1e0c0 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 10 client.28484 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 10 client.28484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 20 client.28484 populate_metadata read hostname 'trial028' 2026-02-20T03:34:21.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f20ddb32e0 0x55f20ddb5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 4 client.28484 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.446+0000 7fe76ffbce00 1 -- 10.20.193.28:0/1276882151 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f20d9f12b0 con 0x55f20ddb32e0 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe766ffd640 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f20ddb32e0 0x55f20ddb5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe766ffd640 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f20ddb32e0 0x55f20ddb5770 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c52968592e683da server_cookie=56f9136618ee2d4b in_seq=0 out_seq=0 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe7297fa640 10 client.28484 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe7297fa640 1 -- 10.20.193.28:0/1276882151 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f20d9f12b0 con 0x55f20ddb32e0 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe7297fa640 10 client.28484 handle_command_reply: tid=0 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 client.28484 shutdown 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 -- 10.20.193.28:0/1276882151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1e0c0 msgr2=0x55f20dd3cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1e0c0 0x55f20dd3cf20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe7540cc1d0 tx=0x7fe75410a5a0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 -- 10.20.193.28:0/1276882151 shutdown_connections 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f20ddb32e0 0x55f20ddb5770 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f20dd22b60 0x55f20ddb1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f20dd1ea70 0x55f20dd3d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 --2- 10.20.193.28:0/1276882151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f20dd1e0c0 0x55f20dd3cf20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 -- 10.20.193.28:0/1276882151 >> 10.20.193.28:0/1276882151 conn(0x55f20dd16b60 msgr2=0x55f20dd23760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:21.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe7297fa640 0 client.28484 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:21.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 -- 10.20.193.28:0/1276882151 shutdown_connections 2026-02-20T03:34:21.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 1 -- 10.20.193.28:0/1276882151 wait complete. 2026-02-20T03:34:21.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76ffbce00 20 client.28484 trim_cache size 0 max 16384 2026-02-20T03:34:21.461 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:34:21.461 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:34:21.462 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "4e8e6b1c-fe18-41e9-9fc9-aebd93e586bb", 2026-02-20T03:34:21.462 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:34:21.462 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 -- 10.20.193.28:0/2038418918 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe73c0b0da0 msgr2=0x7fe73c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe73c0b0da0 0x7fe73c0b3260 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009da0 tx=0x7fe75c00b040 comp rx=0 tx=0).stop 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 -- 10.20.193.28:0/2038418918 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe768109220 msgr2=0x7fe7681a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe768109220 0x7fe7681a1530 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe754005ec0 tx=0x7fe754004300 comp rx=0 tx=0).stop 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 -- 10.20.193.28:0/2038418918 shutdown_connections 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe73c0b0da0 0x7fe73c0b3260 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe76810eef0 0x7fe7681a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe768109ba0 0x7fe7681a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 --2- 10.20.193.28:0/2038418918 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe768109220 0x7fe7681a1530 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 -- 10.20.193.28:0/2038418918 >> 10.20.193.28:0/2038418918 conn(0x7fe768078600 msgr2=0x7fe76807a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:21.463 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 -- 10.20.193.28:0/2038418918 shutdown_connections 2026-02-20T03:34:21.464 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:21.452+0000 7fe76c82e640 1 -- 10.20.193.28:0/2038418918 wait complete. 2026-02-20T03:34:21.559 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:34:21.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.66 MB/sec execute 232 sec latency 80170.248 ms 2026-02-20T03:34:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:21 trial177 ceph-mon[43181]: pgmap v776: 129 pgs: 129 active+clean; 605 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 70 op/s 2026-02-20T03:34:21.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:21 trial126 ceph-mon[38476]: pgmap v776: 129 pgs: 129 active+clean; 605 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 70 op/s 2026-02-20T03:34:21.846 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:34:21 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:34:21.473+0000 7ff740af4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000015 [...2,head] /volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL/ auth{1=1,2=1} v191645 ap=2 f(v5348 m2026-02-20T03:32:59.329593+0000 11=11+0) n(v80 rc2026-02-20T03:32:59.329593+0000 b2861056 12=11+1) (inest sync->mix g=1,2) caps={25141=pAsLsXsFs/pAsLsXsFsx@12910} mcw={2=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557551b7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000015:[<0x100000005e6/COREL v2262>,<0x100000005e5/~dmtmp v34>,<0x100000005e4/client0 v18>,<0x100000005e3/clients v8>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v28>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v37>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000015:[<0x100000005e6/COREL v191645>,<0x100000005e5/~dmtmp v62909>,<0x100000005e4/client0 v3124>,<0x100000005e3/clients v1683>,<0x100000005e2/tmp v1459>,<0x100000001fb/client.0 v1471>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v1483>,<0x10000000001/sv_1 v1479>,<0x10000000000/qa v1460>,<0x1/volumes v1369>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2026-02-20T03:32:58.695607+0000 15=15+0)","ondisk_value.rstat":"n(v0 rc2026-02-20T03:32:59.329593+0000 b2861056 12=11+1)","memory_value.dirstat":"f(v5348 m2026-02-20T03:32:59.329593+0000 11=11+0)","memory_value.rstat":"n(v80 rc2026-02-20T03:32:59.329593+0000 b2861056 12=11+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2026-02-20T03:34:21.846 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:34:21 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:34:21.474+0000 7ff740af4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000029 [...2,head] /volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX/ auth{1=1,2=1} v191649 ap=2 f(v8280 m2026-02-20T03:33:00.601565+0000 24=24+0) n(v81 rc2026-02-20T03:33:00.601565+0000 b5230239 25=24+1) (inest sync->mix g=1,2) caps={25141=pAsLsXsFs/pAsLsXsFsx@22942} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557551c2bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000029:[<0x100000005e6/PARADOX v2552>,<0x100000005e5/~dmtmp v34>,<0x100000005e4/client0 v18>,<0x100000005e3/clients v8>,<0x100000005e2/tmp v8>,<0x100000001fb/client.0 v10>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v28>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v37>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x10000000029:[<0x100000005e6/PARADOX v191649>,<0x100000005e5/~dmtmp v62909>,<0x100000005e4/client0 v3124>,<0x100000005e3/clients v1683>,<0x100000005e2/tmp v1459>,<0x100000001fb/client.0 v1471>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v1483>,<0x10000000001/sv_1 v1479>,<0x10000000000/qa v1460>,<0x1/volumes v1369>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2026-02-20T03:33:00.577565+0000 25=25+0)","ondisk_value.rstat":"n(v0 rc2026-02-20T03:33:00.601565+0000 b5230239 25=24+1)","memory_value.dirstat":"f(v8280 m2026-02-20T03:33:00.601565+0000 24=24+0)","memory_value.rstat":"n(v81 rc2026-02-20T03:33:00.601565+0000 b5230239 25=24+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2026-02-20T03:34:21.848 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:22.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- 10.20.193.28:0/4151671071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab0105320 msgr2=0x7f0ab0111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:22.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4151671071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab0105320 0x7f0ab0111850 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009fc0 tx=0x7f0aa002f390 comp rx=0 tx=0).stop 2026-02-20T03:34:22.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- 10.20.193.28:0/4151671071 shutdown_connections 2026-02-20T03:34:22.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4151671071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab0105320 0x7f0ab0111850 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4151671071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ab0104980 0x7f0ab0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4151671071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0ab010a980 0x7f0ab010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- 10.20.193.28:0/4151671071 >> 10.20.193.28:0/4151671071 conn(0x7f0ab0100680 msgr2=0x7f0ab0102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:22.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- 10.20.193.28:0/4151671071 shutdown_connections 2026-02-20T03:34:22.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- 10.20.193.28:0/4151671071 wait complete. 2026-02-20T03:34:22.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 Processor -- start 2026-02-20T03:34:22.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- start start 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ab0104980 0x7f0ab019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0ab0105320 0x7f0ab019d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab010a980 0x7f0ab01a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0114bf0 con 0x7f0ab010a980 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0114a70 con 0x7f0ab0105320 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0114d70 con 0x7f0ab0104980 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ab0104980 0x7f0ab019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaeffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ab0104980 0x7f0ab019d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33290/0 (socket says 10.20.193.28:33290) 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaeffd640 1 -- 10.20.193.28:0/4116025735 learned_addr learned my addr 10.20.193.28:0/4116025735 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:22.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab010a980 0x7f0ab01a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aae7fc640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0ab0105320 0x7f0ab019d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaeffd640 1 -- 10.20.193.28:0/4116025735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0ab0105320 msgr2=0x7f0ab019d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0ab0105320 0x7f0ab019d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaeffd640 1 -- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab010a980 msgr2=0x7f0ab01a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab010a980 0x7f0ab01a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaeffd640 1 -- 10.20.193.28:0/4116025735 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab01a2060 con 0x7f0ab0104980 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aae7fc640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0ab0105320 0x7f0ab019d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab010a980 0x7f0ab01a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ab0104980 0x7f0ab019d010 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400d950 tx=0x7f0aa400de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0a8ffff640 1 -- 10.20.193.28:0/4116025735 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4014070 con 0x7f0ab0104980 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0a8ffff640 1 -- 10.20.193.28:0/4116025735 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0aa40044e0 con 0x7f0ab0104980 2026-02-20T03:34:22.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0a8ffff640 1 -- 10.20.193.28:0/4116025735 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4005020 con 0x7f0ab0104980 2026-02-20T03:34:22.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- 10.20.193.28:0/4116025735 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab01a2350 con 0x7f0ab0104980 2026-02-20T03:34:22.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.086+0000 7f0aaffff640 1 -- 10.20.193.28:0/4116025735 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab01a9b90 con 0x7f0ab0104980 2026-02-20T03:34:22.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0a8ffff640 1 -- 10.20.193.28:0/4116025735 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0aa400b900 con 0x7f0ab0104980 2026-02-20T03:34:22.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 Processor -- start 2026-02-20T03:34:22.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 -- start start 2026-02-20T03:34:22.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 0x55c26f60b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f605a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f611e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c26f585e50 con 0x55c26f605630 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c26f5589c0 con 0x55c26f60b000 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c26f506240 con 0x55c26f605fb0 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f605a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f605a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48046/0 (socket says 10.20.193.28:48046) 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaeffd640 1 -- 10.20.193.28:0/487922987 learned_addr learned my addr 10.20.193.28:0/487922987 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/487922987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 0x55c26f60b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaeffd640 1 -- 10.20.193.28:0/487922987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 msgr2=0x55c26f611e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/487922987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f611e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaeffd640 1 -- 10.20.193.28:0/487922987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 msgr2=0x55c26f60b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/487922987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 0x55c26f60b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaeffd640 1 -- 10.20.193.28:0/487922987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26f519420 con 0x55c26f605630 2026-02-20T03:34:22.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/487922987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f605a70 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40e6590 tx=0x7f0aa40e6a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711b8ab8c9f480be server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0a8ffff640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0a800b0da0 0x7f0a800b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0a8ffff640 1 -- 10.20.193.28:0/4116025735 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0aa40e0620 con 0x7f0ab0104980 2026-02-20T03:34:22.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0a777fe640 1 -- 10.20.193.28:0/487922987 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40f3070 con 0x55c26f605630 2026-02-20T03:34:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0a777fe640 1 -- 10.20.193.28:0/487922987 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0aa40e0e20 con 0x55c26f605630 2026-02-20T03:34:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0a777fe640 1 -- 10.20.193.28:0/487922987 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40a7820 con 0x55c26f605630 2026-02-20T03:34:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0a800b0da0 0x7f0a800b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/487922987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 msgr2=0x55c26f605a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/487922987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f605a70 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40e6590 tx=0x7f0aa40e6a60 comp rx=0 tx=0).stop 2026-02-20T03:34:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/487922987 shutdown_connections 2026-02-20T03:34:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/487922987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f611e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/487922987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f605a70 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/487922987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 0x55c26f60b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/487922987 >> 10.20.193.28:0/487922987 conn(0x55c26f5c8290 msgr2=0x55c26f603d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/487922987 shutdown_connections 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.092+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/487922987 wait complete. 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 -- start start 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0a800b0da0 0x7f0a800b3260 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0030fd0 tx=0x7f0aa0009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 Processor -- start 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f628680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605fb0 0x55c26f628bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f60b000 0x55c26f626dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c26f5548f0 con 0x55c26f605630 2026-02-20T03:34:22.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c26f346f50 con 0x55c26f605fb0 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c26f627350 con 0x55c26f60b000 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f628680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f628680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48050/0 (socket says 10.20.193.28:48050) 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaeffd640 1 -- 10.20.193.28:0/92111352 learned_addr learned my addr 10.20.193.28:0/92111352 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aae7fc640 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605fb0 0x55c26f628bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f60b000 0x55c26f626dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaeffd640 1 -- 10.20.193.28:0/92111352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f60b000 msgr2=0x55c26f626dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f60b000 0x55c26f626dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaeffd640 1 -- 10.20.193.28:0/92111352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605fb0 msgr2=0x55c26f628bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605fb0 0x55c26f628bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaeffd640 1 -- 10.20.193.28:0/92111352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26f6204e0 con 0x55c26f605630 2026-02-20T03:34:22.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aae7fc640 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605fb0 0x55c26f628bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f628680 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4004ac0 tx=0x7f0aa400dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b6a2d77220b649 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 1 -- 10.20.193.28:0/92111352 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40a7820 con 0x55c26f605630 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/92111352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26f329b40 con 0x55c26f605630 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 10 client.20901 _ll_register_callbacks cb 0x55c26f591f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/92111352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c26f5661a0 con 0x55c26f605630 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 1 -- 10.20.193.28:0/92111352 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0aa40a8a00 con 0x55c26f605630 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 1 -- 10.20.193.28:0/92111352 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40a7a00 con 0x55c26f605630 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 1 -- 10.20.193.28:0/92111352 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0aa4094510 con 0x55c26f605630 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 1 -- 10.20.193.28:0/92111352 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0aa40a80d0 con 0x55c26f605630 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 10 client.20901 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:22.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/92111352 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55c26f513230 con 0x55c26f605630 2026-02-20T03:34:22.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 1 -- 10.20.193.28:0/92111352 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f0aa4094160 con 0x55c26f605630 2026-02-20T03:34:22.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 10 client.20901 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:22.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 10 client.20901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:22.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 20 client.20901 populate_metadata read hostname 'trial028' 2026-02-20T03:34:22.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c26f6368b0 0x55c26f638ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 4 client.20901 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:22.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/92111352 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c26f5605b0 con 0x55c26f6368b0 2026-02-20T03:34:22.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aae7fc640 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c26f6368b0 0x55c26f638ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0aae7fc640 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c26f6368b0 0x55c26f638ca0 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bc819808ce4d0da server_cookie=733aef3ef77823a7 in_seq=0 out_seq=0 2026-02-20T03:34:22.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 10 client.20901 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 1 -- 10.20.193.28:0/92111352 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c26f5605b0 con 0x55c26f6368b0 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0a74ff9640 10 client.20901 handle_command_reply: tid=0 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 client.20901 shutdown 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/92111352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 msgr2=0x55c26f628680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.097+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f628680 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4004ac0 tx=0x7f0aa400dfd0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/92111352 shutdown_connections 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c26f6368b0 0x55c26f638ca0 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f60b000 0x55c26f626dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605fb0 0x55c26f628bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/92111352 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f628680 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/92111352 >> 10.20.193.28:0/92111352 conn(0x55c26f5c8290 msgr2=0x55c26f604440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:22.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0a74ff9640 0 client.20901 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:22.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/92111352 shutdown_connections 2026-02-20T03:34:22.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/92111352 wait complete. 2026-02-20T03:34:22.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.102+0000 7f0ab7c0ce00 20 client.20901 trim_cache size 0 max 16384 2026-02-20T03:34:22.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0ab7c0ce00 1 Processor -- start 2026-02-20T03:34:22.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0ab7c0ce00 1 -- start start 2026-02-20T03:34:22.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605630 0x55c26f6373a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f6378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f60b000 0x55c26f604520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a540126f0 con 0x55c26f60b000 2026-02-20T03:34:22.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5400ffc0 con 0x55c26f605630 2026-02-20T03:34:22.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5400de10 con 0x55c26f605fb0 2026-02-20T03:34:22.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aaf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f60b000 0x55c26f604520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aaf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f60b000 0x55c26f604520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48058/0 (socket says 10.20.193.28:48058) 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aaf7fe640 1 -- 10.20.193.28:0/2158934506 learned_addr learned my addr 10.20.193.28:0/2158934506 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/2158934506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605630 0x55c26f6373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aae7fc640 1 --2- 10.20.193.28:0/2158934506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f6378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aaf7fe640 1 -- 10.20.193.28:0/2158934506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 msgr2=0x55c26f6378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/2158934506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f6378e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aaf7fe640 1 -- 10.20.193.28:0/2158934506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605630 msgr2=0x55c26f6373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/2158934506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605630 0x55c26f6373a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.110+0000 7f0aaf7fe640 1 -- 10.20.193.28:0/2158934506 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26f60b750 con 0x55c26f60b000 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/2158934506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f60b000 0x55c26f604520 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0004400 tx=0x7f0aa0040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0ed7c34ab6883 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a76ffd640 1 -- 10.20.193.28:0/2158934506 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0055070 con 0x55c26f60b000 2026-02-20T03:34:22.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a76ffd640 1 -- 10.20.193.28:0/2158934506 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0aa0033040 con 0x55c26f60b000 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a76ffd640 1 -- 10.20.193.28:0/2158934506 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0038680 con 0x55c26f60b000 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/2158934506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f60b000 msgr2=0x55c26f604520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/2158934506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f60b000 0x55c26f604520 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0004400 tx=0x7f0aa0040000 comp rx=0 tx=0).stop 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/2158934506 shutdown_connections 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/2158934506 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f60b000 0x55c26f604520 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/2158934506 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f6378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/2158934506 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f605630 0x55c26f6373a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/2158934506 >> 10.20.193.28:0/2158934506 conn(0x55c26f5c8290 msgr2=0x55c26f636c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/2158934506 shutdown_connections 2026-02-20T03:34:22.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/2158934506 wait complete. 2026-02-20T03:34:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- start start 2026-02-20T03:34:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 Processor -- start 2026-02-20T03:34:22.120 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f62ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f6304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 0x55c26f6a1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5400e480 con 0x55c26f605630 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5400f8f0 con 0x55c26f60b000 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5400eb50 con 0x55c26f605fb0 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f62ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aae7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f6304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f62ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48070/0 (socket says 10.20.193.28:48070) 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaeffd640 1 -- 10.20.193.28:0/3682650227 learned_addr learned my addr 10.20.193.28:0/3682650227 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaf7fe640 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 0x55c26f6a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaeffd640 1 -- 10.20.193.28:0/3682650227 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 msgr2=0x55c26f6304f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f6304f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaeffd640 1 -- 10.20.193.28:0/3682650227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 msgr2=0x55c26f6a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 0x55c26f6a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaeffd640 1 -- 10.20.193.28:0/3682650227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c26f620310 con 0x55c26f605630 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aaeffd640 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f62ffb0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4005fd0 tx=0x7f0aa4094700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b2b4d0da32a007 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 1 -- 10.20.193.28:0/3682650227 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40a3f70 con 0x55c26f605630 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 1 -- 10.20.193.28:0/3682650227 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55c26f5661a0 con 0x55c26f605630 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 1 -- 10.20.193.28:0/3682650227 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40a7bc0 con 0x55c26f605630 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/3682650227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26f237870 con 0x55c26f605630 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 1 -- 10.20.193.28:0/3682650227 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0aa40a7d60 con 0x55c26f605630 2026-02-20T03:34:22.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 10 client.20907 _ll_register_callbacks cb 0x7f0aa40f1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 10 client.20907 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/3682650227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aa40e0e20 con 0x55c26f605630 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 1 -- 10.20.193.28:0/3682650227 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f0aa40a7820 con 0x55c26f605630 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 10 client.20907 fetch_fsmap learned FSMap version 44 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/3682650227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=44}) -- 0x55c26f4f8440 con 0x55c26f605630 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 1 -- 10.20.193.28:0/3682650227 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f0aa40b10d0 con 0x55c26f605630 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 10 client.20907 fetch_fsmap finished waiting for FSMap version 44 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 10 client.20907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 20 client.20907 populate_metadata read hostname 'trial028' 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c26f6a2980 0x55c26f6a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 4 client.20907 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/3682650227 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c26f529810 con 0x55c26f6a2980 2026-02-20T03:34:22.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aae7fc640 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c26f6a2980 0x55c26f6a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0aae7fc640 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c26f6a2980 0x55c26f6a4e40 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3df7d381badf6c71 server_cookie=93e2e29c598df9fa in_seq=0 out_seq=0 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 10 client.20907 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 1 -- 10.20.193.28:0/3682650227 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c26f529810 con 0x55c26f6a2980 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0a74ff9640 10 client.20907 handle_command_reply: tid=0 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 client.20907 shutdown 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/3682650227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 msgr2=0x55c26f62ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.111+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f62ffb0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4005fd0 tx=0x7f0aa4094700 comp rx=0 tx=0).stop 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/3682650227 shutdown_connections 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c26f6a2980 0x55c26f6a4e40 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c26f60b000 0x55c26f6a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0a74ff9640 0 client.20907 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c26f605fb0 0x55c26f6304f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0ab7c0ce00 1 --2- 10.20.193.28:0/3682650227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c26f605630 0x55c26f62ffb0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/3682650227 >> 10.20.193.28:0/3682650227 conn(0x55c26f5c8290 msgr2=0x55c26f6374b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/3682650227 shutdown_connections 2026-02-20T03:34:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0ab7c0ce00 1 -- 10.20.193.28:0/3682650227 wait complete. 2026-02-20T03:34:22.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0ab7c0ce00 20 client.20907 trim_cache size 0 max 16384 2026-02-20T03:34:22.125 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:34:22.126 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:34:22.126 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:34:22.126 INFO:teuthology.orchestra.run.trial028.stdout: "4e8e6b1c-fe18-41e9-9fc9-aebd93e586bb": { 2026-02-20T03:34:22.126 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:34:22.126 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "4e8e6b1c-fe18-41e9-9fc9-aebd93e586bb", 2026-02-20T03:34:22.126 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:34:22.126 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:34:22.126 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:34:22.126 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:34:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 -- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0a800b0da0 msgr2=0x7f0a800b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0a800b0da0 0x7f0a800b3260 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0030fd0 tx=0x7f0aa0009f10 comp rx=0 tx=0).stop 2026-02-20T03:34:22.127 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 -- 10.20.193.28:0/4116025735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ab0104980 msgr2=0x7f0ab019d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ab0104980 0x7f0ab019d010 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400d950 tx=0x7f0aa400de20 comp rx=0 tx=0).stop 2026-02-20T03:34:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 -- 10.20.193.28:0/4116025735 shutdown_connections 2026-02-20T03:34:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0a800b0da0 0x7f0a800b3260 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0ab010a980 0x7f0ab01a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0ab0105320 0x7f0ab019d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 --2- 10.20.193.28:0/4116025735 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0ab0104980 0x7f0ab019d010 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 -- 10.20.193.28:0/4116025735 >> 10.20.193.28:0/4116025735 conn(0x7f0ab0100680 msgr2=0x7f0ab0100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 -- 10.20.193.28:0/4116025735 shutdown_connections 2026-02-20T03:34:22.128 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:22.117+0000 7f0aaffff640 1 -- 10.20.193.28:0/4116025735 wait complete. 2026-02-20T03:34:22.205 INFO:tasks.cephfs.filesystem:scrub status for tag:4e8e6b1c-fe18-41e9-9fc9-aebd93e586bb - {'path': '/', 'tag': '4e8e6b1c-fe18-41e9-9fc9-aebd93e586bb', 'options': 'recursive,force'} 2026-02-20T03:34:22.498 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:22 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:34:22.499 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:22 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:34:22.499 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:22 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:22.499 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:22 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:22.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.59 MB/sec execute 233 sec latency 81170.293 ms 2026-02-20T03:34:22.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:22 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:34:22.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:22 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:34:22.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:22 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:22.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:22 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:22.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:22 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:34:22.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:22 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:34:22.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:22 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:22.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:22 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:23.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:23 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:34:23.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:23 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:23.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:23 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:34:23.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:23 trial028 ceph-mon[38552]: Scrub error on inode 0x10000000015 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2026-02-20T03:34:23.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:23 trial028 ceph-mon[38552]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:34:23.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:23 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:23.578 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:23 trial028 ceph-mon[38552]: pgmap v777: 129 pgs: 129 active+clean; 589 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 183 KiB/s rd, 170 KiB/s wr, 124 op/s 2026-02-20T03:34:23.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.51 MB/sec execute 234 sec latency 82170.337 ms 2026-02-20T03:34:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:23 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:34:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:23 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:23 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:34:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:23 trial177 ceph-mon[43181]: Scrub error on inode 0x10000000015 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2026-02-20T03:34:23.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:23 trial177 ceph-mon[43181]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:34:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:23 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:23 trial177 ceph-mon[43181]: pgmap v777: 129 pgs: 129 active+clean; 589 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 183 KiB/s rd, 170 KiB/s wr, 124 op/s 2026-02-20T03:34:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:23 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:34:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:23 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:23 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:34:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:23 trial126 ceph-mon[38476]: Scrub error on inode 0x10000000015 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/COREL) see mds.b log and `damage ls` output for details 2026-02-20T03:34:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:23 trial126 ceph-mon[38476]: Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:34:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:23 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:23 trial126 ceph-mon[38476]: pgmap v777: 129 pgs: 129 active+clean; 589 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 183 KiB/s rd, 170 KiB/s wr, 124 op/s 2026-02-20T03:34:24.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.44 MB/sec execute 235 sec latency 83170.380 ms 2026-02-20T03:34:25.454 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:25 trial028 ceph-mon[38552]: pgmap v778: 129 pgs: 129 active+clean; 577 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 251 KiB/s rd, 220 KiB/s wr, 175 op/s 2026-02-20T03:34:25.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.36 MB/sec execute 236 sec latency 84170.420 ms 2026-02-20T03:34:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:25 trial177 ceph-mon[43181]: pgmap v778: 129 pgs: 129 active+clean; 577 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 251 KiB/s rd, 220 KiB/s wr, 175 op/s 2026-02-20T03:34:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:25 trial126 ceph-mon[38476]: pgmap v778: 129 pgs: 129 active+clean; 577 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 251 KiB/s rd, 220 KiB/s wr, 175 op/s 2026-02-20T03:34:26.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.29 MB/sec execute 237 sec latency 85170.449 ms 2026-02-20T03:34:27.625 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:27 trial028 ceph-mon[38552]: pgmap v779: 129 pgs: 129 active+clean; 576 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 280 KiB/s rd, 220 KiB/s wr, 206 op/s 2026-02-20T03:34:27.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.22 MB/sec execute 238 sec latency 86170.480 ms 2026-02-20T03:34:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:27 trial177 ceph-mon[43181]: pgmap v779: 129 pgs: 129 active+clean; 576 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 280 KiB/s rd, 220 KiB/s wr, 206 op/s 2026-02-20T03:34:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:27 trial126 ceph-mon[38476]: pgmap v779: 129 pgs: 129 active+clean; 576 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 280 KiB/s rd, 220 KiB/s wr, 206 op/s 2026-02-20T03:34:28.421 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:28 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:34:28.421 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:28 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:34:28.422 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:28 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:34:28.422 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:28 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:34:28.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1477898271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94dc109e60 msgr2=0x7f94dc10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:28.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1477898271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94dc109e60 0x7f94dc10a2e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009a30 tx=0x7f94c402f220 comp rx=0 tx=0).stop 2026-02-20T03:34:28.456 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1477898271 shutdown_connections 2026-02-20T03:34:28.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1477898271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94dc10a900 0x7f94dc111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1477898271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94dc109e60 0x7f94dc10a2e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1477898271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94dc109490 0x7f94dc109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1477898271 >> 10.20.193.28:0/1477898271 conn(0x7f94dc077fe0 msgr2=0x7f94dc07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:28.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1477898271 shutdown_connections 2026-02-20T03:34:28.457 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1477898271 wait complete. 2026-02-20T03:34:28.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 Processor -- start 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- start start 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94dc109490 0x7f94dc1a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94dc109e60 0x7f94dc1a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94dc10a900 0x7f94dc1a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc1148e0 con 0x7f94dc109490 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc114760 con 0x7f94dc109e60 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc114a60 con 0x7f94dc10a900 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e0e1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94dc109490 0x7f94dc1a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e0e1b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94dc109490 0x7f94dc1a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38690/0 (socket says 10.20.193.28:38690) 2026-02-20T03:34:28.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94d3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94dc109e60 0x7f94dc1a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e0e1b640 1 -- 10.20.193.28:0/1448229283 learned_addr learned my addr 10.20.193.28:0/1448229283 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e161c640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94dc10a900 0x7f94dc1a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e0e1b640 1 -- 10.20.193.28:0/1448229283 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94dc10a900 msgr2=0x7f94dc1a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e0e1b640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94dc10a900 0x7f94dc1a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e0e1b640 1 -- 10.20.193.28:0/1448229283 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94dc109e60 msgr2=0x7f94dc1a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e0e1b640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94dc109e60 0x7f94dc1a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e0e1b640 1 -- 10.20.193.28:0/1448229283 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc1a8bd0 con 0x7f94dc109490 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94d3fff640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94dc109e60 0x7f94dc1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e161c640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94dc10a900 0x7f94dc1a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:28.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e0e1b640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94dc109490 0x7f94dc1a0f20 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00e9e0 tx=0x7f94cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:28.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94d1ffb640 1 -- 10.20.193.28:0/1448229283 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00cde0 con 0x7f94dc109490 2026-02-20T03:34:28.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94d1ffb640 1 -- 10.20.193.28:0/1448229283 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f94cc004570 con 0x7f94dc109490 2026-02-20T03:34:28.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94d1ffb640 1 -- 10.20.193.28:0/1448229283 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc010690 con 0x7f94dc109490 2026-02-20T03:34:28.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1448229283 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94dc1a8ec0 con 0x7f94dc109490 2026-02-20T03:34:28.462 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1448229283 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94dc1a9320 con 0x7f94dc109490 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.453+0000 7f94d1ffb640 1 -- 10.20.193.28:0/1448229283 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f94cc0040d0 con 0x7f94dc109490 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 Processor -- start 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 -- start start 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414ba7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414babf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414bae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556414af78f0 con 0x556414ba77c0 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556414aa52e0 con 0x556414ba6e80 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556414af3820 con 0x556414bac560 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e161c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414ba7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.466 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e161c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414ba7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:46412/0 (socket says 10.20.193.28:46412) 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e161c640 1 -- 10.20.193.28:0/3744197256 learned_addr learned my addr 10.20.193.28:0/3744197256 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94d3fff640 1 --2- 10.20.193.28:0/3744197256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414bae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e0e1b640 1 --2- 10.20.193.28:0/3744197256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414babf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e161c640 1 -- 10.20.193.28:0/3744197256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 msgr2=0x556414bae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e161c640 1 --2- 10.20.193.28:0/3744197256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414bae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e161c640 1 -- 10.20.193.28:0/3744197256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 msgr2=0x556414babf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e161c640 1 --2- 10.20.193.28:0/3744197256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414babf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e161c640 1 -- 10.20.193.28:0/3744197256 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556414a975a0 con 0x556414ba6e80 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e161c640 1 --2- 10.20.193.28:0/3744197256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414ba7280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009400 tx=0x7f94d8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3650cfd98db91c62 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94a93fe640 1 -- 10.20.193.28:0/3744197256 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8004110 con 0x556414ba6e80 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94a93fe640 1 -- 10.20.193.28:0/3744197256 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f94d8004750 con 0x556414ba6e80 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94a93fe640 1 -- 10.20.193.28:0/3744197256 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8016d60 con 0x556414ba6e80 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94d1ffb640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94b80b0da0 0x7f94b80b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94d1ffb640 1 -- 10.20.193.28:0/1448229283 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f94cc0e0ff0 con 0x7f94dc109490 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/3744197256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 msgr2=0x556414ba7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/3744197256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414ba7280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009400 tx=0x7f94d8009920 comp rx=0 tx=0).stop 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e0e1b640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94b80b0da0 0x7f94b80b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/3744197256 shutdown_connections 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/3744197256 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414bae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.467 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/3744197256 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414babf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/3744197256 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414ba7280 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/3744197256 >> 10.20.193.28:0/3744197256 conn(0x556414b9e6f0 msgr2=0x556414ba5570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/3744197256 shutdown_connections 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/3744197256 wait complete. 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.458+0000 7f94e0e1b640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94b80b0da0 0x7f94b80b3260 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0dea30 tx=0x7f94cc002c40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- start start 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 Processor -- start 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414ba6e80 0x556414bbf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bbfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.468 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414bac560 0x556414bc6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x556414a9f0c0 con 0x556414ba77c0 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x556414baf610 con 0x556414bac560 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x556414bc73e0 con 0x556414ba6e80 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414ba6e80 0x556414bbf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414ba6e80 0x556414bbf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:39594/0 (socket says 10.20.193.28:39594) 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 -- 10.20.193.28:0/1486922091 learned_addr learned my addr 10.20.193.28:0/1486922091 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94d3fff640 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bbfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414bac560 0x556414bc6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 -- 10.20.193.28:0/1486922091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414bac560 msgr2=0x556414bc6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414bac560 0x556414bc6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 -- 10.20.193.28:0/1486922091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 msgr2=0x556414bbfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:28.469 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bbfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 -- 10.20.193.28:0/1486922091 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556414bb90e0 con 0x556414ba6e80 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e161c640 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414ba6e80 0x556414bbf990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009bd0 tx=0x7f94d8009b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f80abf0332e8975 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 1 -- 10.20.193.28:0/1486922091 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8016cf0 con 0x556414ba6e80 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 1 -- 10.20.193.28:0/1486922091 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f94d8025440 con 0x556414ba6e80 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 1 -- 10.20.193.28:0/1486922091 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d80045b0 con 0x556414ba6e80 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/1486922091 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556414ab3820 con 0x556414ba6e80 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 1 -- 10.20.193.28:0/1486922091 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f94d80156a0 con 0x556414ba6e80 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 10 client.28498 _ll_register_callbacks cb 0x556414aa2ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/1486922091 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556414aff4e0 con 0x556414ba6e80 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 1 -- 10.20.193.28:0/1486922091 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f94d8004110 con 0x556414ba6e80 2026-02-20T03:34:28.470 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 10 client.28498 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:28.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/1486922091 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=45}) -- 0x556414ab8380 con 0x556414ba6e80 2026-02-20T03:34:28.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 1 -- 10.20.193.28:0/1486922091 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f94d80255f0 con 0x556414ba6e80 2026-02-20T03:34:28.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 10 client.28498 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:28.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 10 client.28498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:28.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 20 client.28498 populate_metadata read hostname 'trial028' 2026-02-20T03:34:28.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556414bcb310 0x556414bcd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 4 client.28498 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:28.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/1486922091 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556414a79bd0 con 0x556414bcb310 2026-02-20T03:34:28.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94d3fff640 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556414bcb310 0x556414bcd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94d3fff640 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556414bcb310 0x556414bcd780 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41bed4f42823b491 server_cookie=bbb3f9a6dac96d00 in_seq=0 out_seq=0 2026-02-20T03:34:28.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 10 client.28498 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:28.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 1 -- 10.20.193.28:0/1486922091 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556414a79bd0 con 0x556414bcb310 2026-02-20T03:34:28.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 10 client.28498 handle_command_reply: tid=0 2026-02-20T03:34:28.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 client.28498 shutdown 2026-02-20T03:34:28.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/1486922091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414ba6e80 msgr2=0x556414bbf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:28.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414ba6e80 0x556414bbf990 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009bd0 tx=0x7f94d8009b40 comp rx=0 tx=0).stop 2026-02-20T03:34:28.473 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/1486922091 shutdown_connections 2026-02-20T03:34:28.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556414bcb310 0x556414bcd780 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414bac560 0x556414bc6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bbfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/1486922091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414ba6e80 0x556414bbf990 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/1486922091 >> 10.20.193.28:0/1486922091 conn(0x556414b9e6f0 msgr2=0x556414bad910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:28.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f949a7fc640 0 client.28498 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:28.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/1486922091 shutdown_connections 2026-02-20T03:34:28.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/1486922091 wait complete. 2026-02-20T03:34:28.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.461+0000 7f94e5fe0e00 20 client.28498 trim_cache size 0 max 16384 2026-02-20T03:34:28.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 Processor -- start 2026-02-20T03:34:28.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 -- start start 2026-02-20T03:34:28.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bbd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.476 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414ba7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9480012750 con 0x556414ba77c0 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f948000ffc0 con 0x556414ba6e80 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f948000de10 con 0x556414bac560 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bbd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bbd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:46438/0 (socket says 10.20.193.28:46438) 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 -- 10.20.193.28:0/2347015585 learned_addr learned my addr 10.20.193.28:0/2347015585 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 --2- 10.20.193.28:0/2347015585 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414ba7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94d3fff640 1 --2- 10.20.193.28:0/2347015585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 -- 10.20.193.28:0/2347015585 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 msgr2=0x556414ba7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 --2- 10.20.193.28:0/2347015585 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414ba7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 -- 10.20.193.28:0/2347015585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 msgr2=0x556414bc6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:28.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 --2- 10.20.193.28:0/2347015585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 -- 10.20.193.28:0/2347015585 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556414bb8f10 con 0x556414ba6e80 2026-02-20T03:34:28.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e161c640 1 --2- 10.20.193.28:0/2347015585 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bbd6e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009e80 tx=0x7f94d8026f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=809defef7f713934 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:28.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94a8bfd640 1 -- 10.20.193.28:0/2347015585 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8016870 con 0x556414ba6e80 2026-02-20T03:34:28.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94a8bfd640 1 -- 10.20.193.28:0/2347015585 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x556414aff4e0 con 0x556414ba6e80 2026-02-20T03:34:28.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94a8bfd640 1 -- 10.20.193.28:0/2347015585 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d80256a0 con 0x556414ba6e80 2026-02-20T03:34:28.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2347015585 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 msgr2=0x556414bbd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:28.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2347015585 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bbd6e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009e80 tx=0x7f94d8026f90 comp rx=0 tx=0).stop 2026-02-20T03:34:28.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2347015585 shutdown_connections 2026-02-20T03:34:28.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2347015585 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414ba7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2347015585 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2347015585 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bbd6e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2347015585 >> 10.20.193.28:0/2347015585 conn(0x556414b9e6f0 msgr2=0x556414ba5570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2347015585 shutdown_connections 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.472+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2347015585 wait complete. 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 -- start start 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 Processor -- start 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bc4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414bc6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f948000e480 con 0x556414ba77c0 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f948000f8f0 con 0x556414ba6e80 2026-02-20T03:34:28.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f948000eb50 con 0x556414bac560 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94d3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94d3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38730/0 (socket says 10.20.193.28:38730) 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94d3fff640 1 -- 10.20.193.28:0/2123927586 learned_addr learned my addr 10.20.193.28:0/2123927586 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e161c640 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bc4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e161c640 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414bc6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94d3fff640 1 -- 10.20.193.28:0/2123927586 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 msgr2=0x556414bc6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94d3fff640 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414bc6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94d3fff640 1 -- 10.20.193.28:0/2123927586 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 msgr2=0x556414bc4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94d3fff640 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bc4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94d3fff640 1 -- 10.20.193.28:0/2123927586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556414baf370 con 0x556414ba77c0 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e161c640 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bc4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:28.483 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94d3fff640 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc5290 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009950 tx=0x7f94c4002e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34360604bcb3054d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f949a7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f949a7fc640 1 -- 10.20.193.28:0/2123927586 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4004050 con 0x556414ba77c0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f949a7fc640 1 -- 10.20.193.28:0/2123927586 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f94c404e070 con 0x556414ba77c0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f949a7fc640 1 -- 10.20.193.28:0/2123927586 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c4038e20 con 0x556414ba77c0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2123927586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556414857690 con 0x556414ba77c0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 10 client.20925 _ll_register_callbacks cb 0x7f94d80165d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2123927586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94d8004750 con 0x556414ba77c0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f949a7fc640 1 -- 10.20.193.28:0/2123927586 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f94c4044450 con 0x556414ba77c0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f949a7fc640 1 -- 10.20.193.28:0/2123927586 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f94c4058060 con 0x556414ba77c0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 10 client.20925 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2123927586 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=45}) -- 0x556414abcb70 con 0x556414ba77c0 2026-02-20T03:34:28.484 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f949a7fc640 1 -- 10.20.193.28:0/2123927586 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f94c40041f0 con 0x556414ba77c0 2026-02-20T03:34:28.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 10 client.20925 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:28.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 10 client.20925 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:28.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 20 client.20925 populate_metadata read hostname 'trial028' 2026-02-20T03:34:28.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556414c36c30 0x556414c390f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:28.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 4 client.20925 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:34:28.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2123927586 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564148d0520 con 0x556414c36c30 2026-02-20T03:34:28.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e161c640 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556414c36c30 0x556414c390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:28.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f94e161c640 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556414c36c30 0x556414c390f0 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d2dfeb2b8a449b server_cookie=52998a76723e0514 in_seq=0 out_seq=0 2026-02-20T03:34:28.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.474+0000 7f949a7fc640 10 client.20925 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:28.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f949a7fc640 1 -- 10.20.193.28:0/2123927586 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564148d0520 con 0x556414c36c30 2026-02-20T03:34:28.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f949a7fc640 10 client.20925 handle_command_reply: tid=0 2026-02-20T03:34:28.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 client.20925 shutdown 2026-02-20T03:34:28.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2123927586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 msgr2=0x556414bc5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:28.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc5290 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009950 tx=0x7f94c4002e10 comp rx=0 tx=0).stop 2026-02-20T03:34:28.524 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2123927586 shutdown_connections 2026-02-20T03:34:28.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x556414c36c30 0x556414c390f0 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556414bac560 0x556414bc6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x556414ba77c0 0x556414bc5290 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 --2- 10.20.193.28:0/2123927586 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556414ba6e80 0x556414bc4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2123927586 >> 10.20.193.28:0/2123927586 conn(0x556414b9e6f0 msgr2=0x556414bbc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:28.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f949a7fc640 0 client.20925 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:28.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2123927586 shutdown_connections 2026-02-20T03:34:28.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 1 -- 10.20.193.28:0/2123927586 wait complete. 2026-02-20T03:34:28.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e5fe0e00 20 client.20925 trim_cache size 0 max 16384 2026-02-20T03:34:28.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:34:28.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:34:28.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:34:28.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:34:28.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94b80b0da0 msgr2=0x7f94b80b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94b80b0da0 0x7f94b80b3260 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0dea30 tx=0x7f94cc002c40 comp rx=0 tx=0).stop 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94dc109490 msgr2=0x7f94dc1a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94dc109490 0x7f94dc1a0f20 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00e9e0 tx=0x7f94cc00eeb0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1448229283 shutdown_connections 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94b80b0da0 0x7f94b80b3260 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f94dc10a900 0x7f94dc1a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f94dc109e60 0x7f94dc1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 --2- 10.20.193.28:0/1448229283 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f94dc109490 0x7f94dc1a0f20 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1448229283 >> 10.20.193.28:0/1448229283 conn(0x7f94dc077fe0 msgr2=0x7f94dc10d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:28.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1448229283 shutdown_connections 2026-02-20T03:34:28.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:28.519+0000 7f94e1e1d640 1 -- 10.20.193.28:0/1448229283 wait complete. 2026-02-20T03:34:28.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.15 MB/sec execute 239 sec latency 87170.516 ms 2026-02-20T03:34:28.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:28 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:34:28.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:28 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:34:28.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:28 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:34:28.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:28 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:34:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:28 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:34:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:28 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:34:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:28 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:34:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:28 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:34:29.489 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:29 trial028 ceph-mon[38552]: pgmap v780: 129 pgs: 129 active+clean; 576 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 279 KiB/s rd, 220 KiB/s wr, 204 op/s 2026-02-20T03:34:29.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.07 MB/sec execute 240 sec latency 88170.575 ms 2026-02-20T03:34:29.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:29 trial177 ceph-mon[43181]: pgmap v780: 129 pgs: 129 active+clean; 576 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 279 KiB/s rd, 220 KiB/s wr, 204 op/s 2026-02-20T03:34:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:29 trial126 ceph-mon[38476]: pgmap v780: 129 pgs: 129 active+clean; 576 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 279 KiB/s rd, 220 KiB/s wr, 204 op/s 2026-02-20T03:34:30.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 17.00 MB/sec execute 241 sec latency 89170.604 ms 2026-02-20T03:34:31.605 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:31 trial028 ceph-mon[38552]: pgmap v781: 129 pgs: 129 active+clean; 577 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 280 KiB/s rd, 225 KiB/s wr, 218 op/s 2026-02-20T03:34:31.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 16.93 MB/sec execute 242 sec latency 90170.639 ms 2026-02-20T03:34:31.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:31 trial177 ceph-mon[43181]: pgmap v781: 129 pgs: 129 active+clean; 577 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 280 KiB/s rd, 225 KiB/s wr, 218 op/s 2026-02-20T03:34:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:31 trial126 ceph-mon[38476]: pgmap v781: 129 pgs: 129 active+clean; 577 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 280 KiB/s rd, 225 KiB/s wr, 218 op/s 2026-02-20T03:34:32.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 16.86 MB/sec execute 243 sec latency 91170.680 ms 2026-02-20T03:34:33.470 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:33 trial028 ceph-mon[38552]: pgmap v782: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 138 KiB/s rd, 89 KiB/s wr, 162 op/s 2026-02-20T03:34:33.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 16.79 MB/sec execute 244 sec latency 92170.714 ms 2026-02-20T03:34:33.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:33 trial177 ceph-mon[43181]: pgmap v782: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 138 KiB/s rd, 89 KiB/s wr, 162 op/s 2026-02-20T03:34:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:33 trial126 ceph-mon[38476]: pgmap v782: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 138 KiB/s rd, 89 KiB/s wr, 162 op/s 2026-02-20T03:34:34.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 16.73 MB/sec execute 245 sec latency 93170.745 ms 2026-02-20T03:34:35.585 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:35 trial028 ceph-mon[38552]: pgmap v783: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 103 KiB/s rd, 66 KiB/s wr, 116 op/s 2026-02-20T03:34:35.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 16.66 MB/sec execute 246 sec latency 94170.775 ms 2026-02-20T03:34:35.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:35 trial177 ceph-mon[43181]: pgmap v783: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 103 KiB/s rd, 66 KiB/s wr, 116 op/s 2026-02-20T03:34:35.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:35 trial126 ceph-mon[38476]: pgmap v783: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 103 KiB/s rd, 66 KiB/s wr, 116 op/s 2026-02-20T03:34:36.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 16.59 MB/sec execute 247 sec latency 95170.806 ms 2026-02-20T03:34:37.437 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:37 trial028 ceph-mon[38552]: pgmap v784: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 15 KiB/s wr, 65 op/s 2026-02-20T03:34:37.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 16.52 MB/sec execute 248 sec latency 96170.844 ms 2026-02-20T03:34:37.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:37 trial177 ceph-mon[43181]: pgmap v784: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 15 KiB/s wr, 65 op/s 2026-02-20T03:34:37.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:37 trial126 ceph-mon[38476]: pgmap v784: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 15 KiB/s wr, 65 op/s 2026-02-20T03:34:38.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 16.46 MB/sec execute 249 sec latency 97170.877 ms 2026-02-20T03:34:39.582 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:39 trial028 ceph-mon[38552]: pgmap v785: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 6.4 KiB/s rd, 15 KiB/s wr, 34 op/s 2026-02-20T03:34:39.715 INFO:tasks.workunit.client.0.trial028.stdout: 10 136933 16.39 MB/sec execute 250 sec latency 98170.914 ms 2026-02-20T03:34:39.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:39 trial177 ceph-mon[43181]: pgmap v785: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 6.4 KiB/s rd, 15 KiB/s wr, 34 op/s 2026-02-20T03:34:39.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:39 trial126 ceph-mon[38476]: pgmap v785: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 6.4 KiB/s rd, 15 KiB/s wr, 34 op/s 2026-02-20T03:34:40.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136938 16.33 MB/sec execute 251 sec latency 99170.951 ms 2026-02-20T03:34:41.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:41 trial028 ceph-mon[38552]: pgmap v786: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 16 KiB/s wr, 37 op/s 2026-02-20T03:34:41.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.596+0000 7f8d5d182640 1 -- 10.20.193.28:0/74752526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d58102b80 msgr2=0x7f8d58102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.596+0000 7f8d5d182640 1 --2- 10.20.193.28:0/74752526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d58102b80 0x7f8d58102f80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009a30 tx=0x7f8d4402f220 comp rx=0 tx=0).stop 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.596+0000 7f8d5d182640 1 -- 10.20.193.28:0/74752526 shutdown_connections 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.596+0000 7f8d5d182640 1 --2- 10.20.193.28:0/74752526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d581021e0 0x7f8d58109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.596+0000 7f8d5d182640 1 --2- 10.20.193.28:0/74752526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d58101820 0x7f8d58101ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.596+0000 7f8d5d182640 1 --2- 10.20.193.28:0/74752526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d58102b80 0x7f8d58102f80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.596+0000 7f8d5d182640 1 -- 10.20.193.28:0/74752526 >> 10.20.193.28:0/74752526 conn(0x7f8d580fc440 msgr2=0x7f8d580fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 -- 10.20.193.28:0/74752526 shutdown_connections 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 -- 10.20.193.28:0/74752526 wait complete. 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 Processor -- start 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 -- start start 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d58101820 0x7f8d5819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d581021e0 0x7f8d5819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d58102b80 0x7f8d581a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5810e200 con 0x7f8d58102b80 2026-02-20T03:34:41.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5810e080 con 0x7f8d581021e0 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5810e380 con 0x7f8d58101820 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d58101820 0x7f8d5819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d58101820 0x7f8d5819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34438/0 (socket says 10.20.193.28:34438) 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 -- 10.20.193.28:0/2108639870 learned_addr learned my addr 10.20.193.28:0/2108639870 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d577fe640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d581021e0 0x7f8d5819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5c981640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d58102b80 0x7f8d581a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 -- 10.20.193.28:0/2108639870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d581021e0 msgr2=0x7f8d5819ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d581021e0 0x7f8d5819ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 -- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d58102b80 msgr2=0x7f8d581a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d58102b80 0x7f8d581a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 -- 10.20.193.28:0/2108639870 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d581a24b0 con 0x7f8d58101820 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d577fe640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d581021e0 0x7f8d5819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d58101820 0x7f8d5819a800 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d440386a0 tx=0x7f8d4402fcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d557fa640 1 -- 10.20.193.28:0/2108639870 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d44002e10 con 0x7f8d58101820 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d557fa640 1 -- 10.20.193.28:0/2108639870 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8d44038770 con 0x7f8d58101820 2026-02-20T03:34:41.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 -- 10.20.193.28:0/2108639870 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d581a2740 con 0x7f8d58101820 2026-02-20T03:34:41.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d557fa640 1 -- 10.20.193.28:0/2108639870 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d440428e0 con 0x7f8d58101820 2026-02-20T03:34:41.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d5d182640 1 -- 10.20.193.28:0/2108639870 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d581a2c30 con 0x7f8d58101820 2026-02-20T03:34:41.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d557fa640 1 -- 10.20.193.28:0/2108639870 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8d44004240 con 0x7f8d58101820 2026-02-20T03:34:41.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d6126fe00 1 Processor -- start 2026-02-20T03:34:41.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d6126fe00 1 -- start start 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615f96790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615f9b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 0x55c615f9df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c615ee28f0 con 0x55c615f9ba70 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c615e902e0 con 0x55c615f96390 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c615ede820 con 0x55c615f96cd0 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615f9b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615f9b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34444/0 (socket says 10.20.193.28:34444) 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d57fff640 1 -- 10.20.193.28:0/1282790307 learned_addr learned my addr 10.20.193.28:0/1282790307 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.598+0000 7f8d577fe640 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 0x55c615f9df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d5c981640 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615f96790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 -- 10.20.193.28:0/1282790307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 msgr2=0x55c615f96790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615f96790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 -- 10.20.193.28:0/1282790307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 msgr2=0x55c615f9df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 0x55c615f9df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 -- 10.20.193.28:0/1282790307 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c615e825a0 con 0x55c615f96cd0 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d5c981640 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615f96790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615f9b450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d44108fd0 tx=0x7f8d4410d1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bbcfa7db8d14db7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d1bfff640 1 -- 10.20.193.28:0/1282790307 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4410de00 con 0x55c615f96cd0 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d1bfff640 1 -- 10.20.193.28:0/1282790307 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8d44112070 con 0x55c615f96cd0 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d1bfff640 1 -- 10.20.193.28:0/1282790307 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d441157f0 con 0x55c615f96cd0 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d557fa640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d2c0b0e20 0x7f8d2c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d557fa640 1 -- 10.20.193.28:0/2108639870 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8d44104f30 con 0x7f8d58101820 2026-02-20T03:34:41.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- 10.20.193.28:0/1282790307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 msgr2=0x55c615f9b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:41.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615f9b450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d44108fd0 tx=0x7f8d4410d1b0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- 10.20.193.28:0/1282790307 shutdown_connections 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 0x55c615f9df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615f9b450 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/1282790307 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615f96790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- 10.20.193.28:0/1282790307 >> 10.20.193.28:0/1282790307 conn(0x55c615f896f0 msgr2=0x55c615f94a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d5c981640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d2c0b0e20 0x7f8d2c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- 10.20.193.28:0/1282790307 shutdown_connections 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- 10.20.193.28:0/1282790307 wait complete. 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d5c981640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d2c0b0e20 0x7f8d2c0b32e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009520 tx=0x7f8d4c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- start start 2026-02-20T03:34:41.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 Processor -- start 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615faec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615faf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 0x55c615fb6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c615e8a0c0 con 0x55c615f9ba70 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c615f9e880 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c615fb6690 con 0x55c615f96cd0 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615faec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d5c981640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 0x55c615fb6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615faec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59686/0 (socket says 10.20.193.28:59686) 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 -- 10.20.193.28:0/3068652540 learned_addr learned my addr 10.20.193.28:0/3068652540 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d577fe640 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615faf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 -- 10.20.193.28:0/3068652540 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 msgr2=0x55c615faf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615faf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 -- 10.20.193.28:0/3068652540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 msgr2=0x55c615fb6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 0x55c615fb6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 -- 10.20.193.28:0/3068652540 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c615fa8360 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d5c981640 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 0x55c615fb6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d57fff640 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615faec40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8d440ccba0 tx=0x7f8d44038c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4418aa034e21fa50 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d197fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d197fa640 1 -- 10.20.193.28:0/3068652540 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d440c8880 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d197fa640 1 -- 10.20.193.28:0/3068652540 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8d44033030 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- 10.20.193.28:0/3068652540 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c615e9e820 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d197fa640 1 -- 10.20.193.28:0/3068652540 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d440cc130 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d197fa640 1 -- 10.20.193.28:0/3068652540 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8d440cc4d0 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 10 client.28532 _ll_register_callbacks cb 0x55c615e8dff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- 10.20.193.28:0/3068652540 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c615eea4e0 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d197fa640 1 -- 10.20.193.28:0/3068652540 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8d440cc310 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 10 client.28532 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- 10.20.193.28:0/3068652540 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55c615ea3380 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d197fa640 1 -- 10.20.193.28:0/3068652540 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f8d440d59e0 con 0x55c615f96390 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 10 client.28532 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 10 client.28532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 20 client.28532 populate_metadata read hostname 'trial028' 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c615fba590 0x55c615fbca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 4 client.28532 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d6126fe00 1 -- 10.20.193.28:0/3068652540 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c615e64bd0 con 0x55c615fba590 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.603+0000 7f8d577fe640 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c615fba590 0x55c615fbca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d577fe640 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c615fba590 0x55c615fbca50 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ffe87b73f06e67c server_cookie=97bc8508d49476ca in_seq=0 out_seq=0 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d197fa640 10 client.28532 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d197fa640 1 -- 10.20.193.28:0/3068652540 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c615e64bd0 con 0x55c615fba590 2026-02-20T03:34:41.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d197fa640 10 client.28532 handle_command_reply: tid=0 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 client.28532 shutdown 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 -- 10.20.193.28:0/3068652540 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 msgr2=0x55c615faec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615faec40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8d440ccba0 tx=0x7f8d44038c00 comp rx=0 tx=0).stop 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 -- 10.20.193.28:0/3068652540 shutdown_connections 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c615fba590 0x55c615fbca50 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f9ba70 0x55c615fb6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615faf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d197fa640 0 client.28532 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/3068652540 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96390 0x55c615faec40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 -- 10.20.193.28:0/3068652540 >> 10.20.193.28:0/3068652540 conn(0x55c615f896f0 msgr2=0x55c615f94a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 -- 10.20.193.28:0/3068652540 shutdown_connections 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 1 -- 10.20.193.28:0/3068652540 wait complete. 2026-02-20T03:34:41.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.608+0000 7f8d6126fe00 20 client.28532 trim_cache size 0 max 16384 2026-02-20T03:34:41.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 Processor -- start 2026-02-20T03:34:41.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- start start 2026-02-20T03:34:41.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96cd0 0x55c615fb60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f9ba70 0x55c615fad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc012630 con 0x55c615f96390 2026-02-20T03:34:41.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc00fea0 con 0x55c615f96cd0 2026-02-20T03:34:41.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc00dcf0 con 0x55c615f9ba70 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d5c981640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f9ba70 0x55c615fad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38850/0 (socket says 10.20.193.28:38850) 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d5c981640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f9ba70 0x55c615fad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34458/0 (socket says 10.20.193.28:34458) 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 -- 10.20.193.28:0/4036514526 learned_addr learned my addr 10.20.193.28:0/4036514526 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d577fe640 1 --2- 10.20.193.28:0/4036514526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96cd0 0x55c615fb60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 -- 10.20.193.28:0/4036514526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f9ba70 msgr2=0x55c615fad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- 10.20.193.28:0/4036514526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f9ba70 0x55c615fad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 -- 10.20.193.28:0/4036514526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96cd0 msgr2=0x55c615fb60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- 10.20.193.28:0/4036514526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96cd0 0x55c615fb60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 -- 10.20.193.28:0/4036514526 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c615fa8190 con 0x55c615f96390 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- 10.20.193.28:0/4036514526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fac8e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f8d4402f730 tx=0x7f8d44031050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6126499facbf9280 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d1b7fe640 1 -- 10.20.193.28:0/4036514526 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d440cc9e0 con 0x55c615f96390 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d1b7fe640 1 -- 10.20.193.28:0/4036514526 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8d44033070 con 0x55c615f96390 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d1b7fe640 1 -- 10.20.193.28:0/4036514526 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d44038920 con 0x55c615f96390 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4036514526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 msgr2=0x55c615fac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4036514526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fac8e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f8d4402f730 tx=0x7f8d44031050 comp rx=0 tx=0).stop 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4036514526 shutdown_connections 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4036514526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f9ba70 0x55c615fad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4036514526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f96cd0 0x55c615fb60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4036514526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fac8e0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4036514526 >> 10.20.193.28:0/4036514526 conn(0x55c615f896f0 msgr2=0x55c615facf90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4036514526 shutdown_connections 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4036514526 wait complete. 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- start start 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 Processor -- start 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fb3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615fb4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f9ba70 0x55c615fb5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc00e360 con 0x55c615f96390 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc00f7d0 con 0x55c615f9ba70 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc00ea30 con 0x55c615f96cd0 2026-02-20T03:34:41.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fb3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fb3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38866/0 (socket says 10.20.193.28:38866) 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 -- 10.20.193.28:0/4023260519 learned_addr learned my addr 10.20.193.28:0/4023260519 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d5c981640 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f9ba70 0x55c615fb5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d577fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615fb4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 -- 10.20.193.28:0/4023260519 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 msgr2=0x55c615fb4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615fb4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 -- 10.20.193.28:0/4023260519 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f9ba70 msgr2=0x55c615fb5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f9ba70 0x55c615fb5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 -- 10.20.193.28:0/4023260519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c615c42690 con 0x55c615f96390 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d577fe640 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615fb4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d57fff640 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fb3d20 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f8d44002a90 tx=0x7f8d44038c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af0e83cd07c60b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d197fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d197fa640 1 -- 10.20.193.28:0/4023260519 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d440cc9e0 con 0x55c615f96390 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d197fa640 1 -- 10.20.193.28:0/4023260519 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55c615eea4e0 con 0x55c615f96390 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d197fa640 1 -- 10.20.193.28:0/4023260519 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d440c8880 con 0x55c615f96390 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4023260519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c615ea7b70 con 0x55c615f96390 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d197fa640 1 -- 10.20.193.28:0/4023260519 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8d440cc4d0 con 0x55c615f96390 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d197fa640 10 client.20943 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:34:41.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 10 client.20943 _ll_register_callbacks cb 0x7f8d44009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4023260519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d44112070 con 0x55c615f96390 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d197fa640 1 -- 10.20.193.28:0/4023260519 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8d440e6060 con 0x55c615f96390 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 10 client.20943 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4023260519 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55c615fa8e80 con 0x55c615f96390 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d197fa640 1 -- 10.20.193.28:0/4023260519 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f8d440f3180 con 0x55c615f96390 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 10 client.20943 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 10 client.20943 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 20 client.20943 populate_metadata read hostname 'trial028' 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c616025790 0x55c616027c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 4 client.20943 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4023260519 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c615cbb520 con 0x55c616025790 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d577fe640 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c616025790 0x55c616027c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d197fa640 10 client.20943 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:41.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.617+0000 7f8d577fe640 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c616025790 0x55c616027c20 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e72f3b787f19999b server_cookie=86c7cdcb3412b379 in_seq=0 out_seq=0 2026-02-20T03:34:41.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d197fa640 1 -- 10.20.193.28:0/4023260519 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c615cbb520 con 0x55c616025790 2026-02-20T03:34:41.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d197fa640 10 client.20943 handle_command_reply: tid=0 2026-02-20T03:34:41.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 client.20943 shutdown 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4023260519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 msgr2=0x55c615fb3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fb3d20 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f8d44002a90 tx=0x7f8d44038c00 comp rx=0 tx=0).stop 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4023260519 shutdown_connections 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c616025790 0x55c616027c20 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c615f9ba70 0x55c615fb5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c615f96cd0 0x55c615fb4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 --2- 10.20.193.28:0/4023260519 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c615f96390 0x55c615fb3d20 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4023260519 >> 10.20.193.28:0/4023260519 conn(0x55c615f896f0 msgr2=0x55c615fad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d197fa640 0 client.20943 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4023260519 shutdown_connections 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 1 -- 10.20.193.28:0/4023260519 wait complete. 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d6126fe00 20 client.20943 trim_cache size 0 max 16384 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:34:41.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 -- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d2c0b0e20 msgr2=0x7f8d2c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d2c0b0e20 0x7f8d2c0b32e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009520 tx=0x7f8d4c00b040 comp rx=0 tx=0).stop 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 -- 10.20.193.28:0/2108639870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d58101820 msgr2=0x7f8d5819a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d58101820 0x7f8d5819a800 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d440386a0 tx=0x7f8d4402fcb0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 -- 10.20.193.28:0/2108639870 shutdown_connections 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8d2c0b0e20 0x7f8d2c0b32e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8d58102b80 0x7f8d581a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8d581021e0 0x7f8d5819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 --2- 10.20.193.28:0/2108639870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8d58101820 0x7f8d5819a800 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 -- 10.20.193.28:0/2108639870 >> 10.20.193.28:0/2108639870 conn(0x7f8d580fc440 msgr2=0x7f8d58105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 -- 10.20.193.28:0/2108639870 shutdown_connections 2026-02-20T03:34:41.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:41.636+0000 7f8d5d182640 1 -- 10.20.193.28:0/2108639870 wait complete. 2026-02-20T03:34:41.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136938 16.26 MB/sec execute 252 sec latency 100170.991 ms 2026-02-20T03:34:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:41 trial177 ceph-mon[43181]: pgmap v786: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 16 KiB/s wr, 37 op/s 2026-02-20T03:34:41.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:41 trial126 ceph-mon[38476]: pgmap v786: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 8.5 KiB/s rd, 16 KiB/s wr, 37 op/s 2026-02-20T03:34:42.715 INFO:tasks.workunit.client.0.trial028.stdout: 10 136938 16.20 MB/sec execute 253 sec latency 101171.027 ms 2026-02-20T03:34:43.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:43 trial028 ceph-mon[38552]: pgmap v787: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2026-02-20T03:34:43.715 INFO:tasks.workunit.client.0.trial028.stdout: 10 136938 16.13 MB/sec execute 254 sec latency 102171.056 ms 2026-02-20T03:34:43.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:43 trial177 ceph-mon[43181]: pgmap v787: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2026-02-20T03:34:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:43 trial126 ceph-mon[38476]: pgmap v787: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2026-02-20T03:34:44.714 INFO:tasks.workunit.client.0.trial028.stdout: 10 136953 16.07 MB/sec execute 255 sec latency 102403.198 ms 2026-02-20T03:34:45.438 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:45 trial028 ceph-mon[38552]: pgmap v788: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 18 op/s 2026-02-20T03:34:45.715 INFO:tasks.workunit.client.0.trial028.stdout: 10 136953 16.01 MB/sec execute 256 sec latency 92569.001 ms 2026-02-20T03:34:45.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:45 trial177 ceph-mon[43181]: pgmap v788: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 18 op/s 2026-02-20T03:34:45.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:45 trial126 ceph-mon[38476]: pgmap v788: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 18 op/s 2026-02-20T03:34:46.715 INFO:tasks.workunit.client.0.trial028.stdout: 10 137796 16.11 MB/sec execute 257 sec latency 92690.281 ms 2026-02-20T03:34:47.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:47 trial028 ceph-mon[38552]: pgmap v789: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 12 op/s 2026-02-20T03:34:47.715 INFO:tasks.workunit.client.0.trial028.stdout: 10 139039 16.29 MB/sec execute 258 sec latency 45.126 ms 2026-02-20T03:34:47.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:47 trial177 ceph-mon[43181]: pgmap v789: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 12 op/s 2026-02-20T03:34:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:47 trial126 ceph-mon[38476]: pgmap v789: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 12 op/s 2026-02-20T03:34:48.715 INFO:tasks.workunit.client.0.trial028.stdout: 10 140343 16.53 MB/sec execute 259 sec latency 43.831 ms 2026-02-20T03:34:49.715 INFO:tasks.workunit.client.0.trial028.stdout: 10 141448 16.69 MB/sec execute 260 sec latency 50.947 ms 2026-02-20T03:34:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:49 trial177 ceph-mon[43181]: pgmap v790: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 671 KiB/s rd, 136 KiB/s wr, 21 op/s 2026-02-20T03:34:49.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:49 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:34:49.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:49 trial126 ceph-mon[38476]: pgmap v790: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 671 KiB/s rd, 136 KiB/s wr, 21 op/s 2026-02-20T03:34:49.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:49 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:34:49.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:49 trial028 ceph-mon[38552]: pgmap v790: 129 pgs: 129 active+clean; 573 MiB data, 8.0 GiB used, 8.2 TiB / 8.2 TiB avail; 671 KiB/s rd, 136 KiB/s wr, 21 op/s 2026-02-20T03:34:49.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:49 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:34:50.715 INFO:tasks.workunit.client.0.trial028.stdout: 10 142957 16.93 MB/sec execute 261 sec latency 25.396 ms 2026-02-20T03:34:50.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:34:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:34:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:34:50.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:34:50.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:34:50.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:34:50.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:34:50.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:34:50.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:34:51.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 144375 17.13 MB/sec execute 262 sec latency 28.963 ms 2026-02-20T03:34:51.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:51 trial177 ceph-mon[43181]: pgmap v791: 129 pgs: 129 active+clean; 578 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 1.5 MiB/s wr, 200 op/s 2026-02-20T03:34:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:51 trial126 ceph-mon[38476]: pgmap v791: 129 pgs: 129 active+clean; 578 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 1.5 MiB/s wr, 200 op/s 2026-02-20T03:34:51.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:51 trial028 ceph-mon[38552]: pgmap v791: 129 pgs: 129 active+clean; 578 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 4.9 MiB/s rd, 1.5 MiB/s wr, 200 op/s 2026-02-20T03:34:52.206 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:34:52.549 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:52.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 145680 17.36 MB/sec execute 263 sec latency 44.401 ms 2026-02-20T03:34:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.772+0000 7f5415247640 1 -- 10.20.193.28:0/2516821412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 msgr2=0x7f5410075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.772+0000 7f540effd640 1 -- 10.20.193.28:0/2516821412 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540002fd10 con 0x7f5410075950 2026-02-20T03:34:52.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.772+0000 7f5415247640 1 --2- 10.20.193.28:0/2516821412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 0x7f5410075d90 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f5400009a30 tx=0x7f540002f2f0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.772+0000 7f5415247640 1 -- 10.20.193.28:0/2516821412 shutdown_connections 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.772+0000 7f5415247640 1 --2- 10.20.193.28:0/2516821412 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f54101134d0 0x7f5410115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.772+0000 7f5415247640 1 --2- 10.20.193.28:0/2516821412 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 0x7f5410075d90 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.772+0000 7f5415247640 1 --2- 10.20.193.28:0/2516821412 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f54101065d0 0x7f5410075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.772+0000 7f5415247640 1 -- 10.20.193.28:0/2516821412 >> 10.20.193.28:0/2516821412 conn(0x7f54100fe440 msgr2=0x7f5410100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.773+0000 7f5415247640 1 -- 10.20.193.28:0/2516821412 shutdown_connections 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.773+0000 7f5415247640 1 -- 10.20.193.28:0/2516821412 wait complete. 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.773+0000 7f5415247640 1 Processor -- start 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.773+0000 7f5415247640 1 -- start start 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f5415247640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 0x7f54101a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f5415247640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f54101065d0 0x7f54101a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f5415247640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f54101134d0 0x7f54101a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f5415247640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5410119110 con 0x7f5410075950 2026-02-20T03:34:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f5415247640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5410118f90 con 0x7f54101134d0 2026-02-20T03:34:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f5415247640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5410119290 con 0x7f54101065d0 2026-02-20T03:34:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f540ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 0x7f54101a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f540ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 0x7f54101a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47928/0 (socket says 10.20.193.28:47928) 2026-02-20T03:34:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f540ffff640 1 -- 10.20.193.28:0/3505511968 learned_addr learned my addr 10.20.193.28:0/3505511968 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:52.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f5414a46640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f54101134d0 0x7f54101a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.774+0000 7f540f7fe640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f54101065d0 0x7f54101a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f540ffff640 1 -- 10.20.193.28:0/3505511968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f54101065d0 msgr2=0x7f54101a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f540ffff640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f54101065d0 0x7f54101a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f540ffff640 1 -- 10.20.193.28:0/3505511968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f54101134d0 msgr2=0x7f54101a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f540ffff640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f54101134d0 0x7f54101a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f540ffff640 1 -- 10.20.193.28:0/3505511968 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54101a6360 con 0x7f5410075950 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f540ffff640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 0x7f54101a1310 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00d950 tx=0x7f53fc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f540d7fa640 1 -- 10.20.193.28:0/3505511968 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc014070 con 0x7f5410075950 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f5415247640 1 -- 10.20.193.28:0/3505511968 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54101a6650 con 0x7f5410075950 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f5415247640 1 -- 10.20.193.28:0/3505511968 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54101ade90 con 0x7f5410075950 2026-02-20T03:34:52.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.775+0000 7f540d7fa640 1 -- 10.20.193.28:0/3505511968 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f53fc0044e0 con 0x7f5410075950 2026-02-20T03:34:52.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.776+0000 7f540d7fa640 1 -- 10.20.193.28:0/3505511968 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc01d060 con 0x7f5410075950 2026-02-20T03:34:52.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f54189d5e00 1 Processor -- start 2026-02-20T03:34:52.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f54189d5e00 1 -- start start 2026-02-20T03:34:52.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 0x561a8c9a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8c9b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f54189d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561a8c926e50 con 0x561a8c9a6630 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f54189d5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561a8c8f99c0 con 0x561a8c9ac000 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f54189d5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561a8c8a7240 con 0x561a8c9a6fb0 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f5414a46640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f5414a46640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47688/0 (socket says 10.20.193.28:47688) 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f5414a46640 1 -- 10.20.193.28:0/3972279462 learned_addr learned my addr 10.20.193.28:0/3972279462 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.779+0000 7f540f7fe640 1 --2- 10.20.193.28:0/3972279462 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8c9b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.780+0000 7f5414a46640 1 -- 10.20.193.28:0/3972279462 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 msgr2=0x561a8c9b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.780+0000 7f5414a46640 1 --2- 10.20.193.28:0/3972279462 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8c9b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.780+0000 7f5414a46640 1 -- 10.20.193.28:0/3972279462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 msgr2=0x561a8c9a6a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.780+0000 7f5414a46640 1 --2- 10.20.193.28:0/3972279462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 0x561a8c9a6a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.780+0000 7f5414a46640 1 -- 10.20.193.28:0/3972279462 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8c8ba420 con 0x561a8c9ac000 2026-02-20T03:34:52.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.780+0000 7f5414a46640 1 --2- 10.20.193.28:0/3972279462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9ac3e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5404009d90 tx=0x7f5404002c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=310c92ed1cd2751e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:52.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.780+0000 7f53e8ce3640 1 -- 10.20.193.28:0/3972279462 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404007500 con 0x561a8c9ac000 2026-02-20T03:34:52.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.780+0000 7f53e8ce3640 1 -- 10.20.193.28:0/3972279462 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5404007b40 con 0x561a8c9ac000 2026-02-20T03:34:52.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.780+0000 7f53e8ce3640 1 -- 10.20.193.28:0/3972279462 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5404015ce0 con 0x561a8c9ac000 2026-02-20T03:34:52.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.781+0000 7f54189d5e00 1 -- 10.20.193.28:0/3972279462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 msgr2=0x561a8c9ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:52.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.781+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3972279462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9ac3e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5404009d90 tx=0x7f5404002c60 comp rx=0 tx=0).stop 2026-02-20T03:34:52.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.781+0000 7f540d7fa640 1 -- 10.20.193.28:0/3505511968 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f53fc005020 con 0x7f5410075950 2026-02-20T03:34:52.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.781+0000 7f54189d5e00 1 -- 10.20.193.28:0/3972279462 shutdown_connections 2026-02-20T03:34:52.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.781+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3972279462 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8c9b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.781+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3972279462 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 0x561a8c9a6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.781+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3972279462 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9ac3e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.781+0000 7f54189d5e00 1 -- 10.20.193.28:0/3972279462 >> 10.20.193.28:0/3972279462 conn(0x561a8c969290 msgr2=0x561a8c9a4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:52.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.782+0000 7f54189d5e00 1 -- 10.20.193.28:0/3972279462 shutdown_connections 2026-02-20T03:34:52.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.782+0000 7f54189d5e00 1 -- 10.20.193.28:0/3972279462 wait complete. 2026-02-20T03:34:52.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.783+0000 7f540d7fa640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53f00b0d10 0x7f53f00b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.783+0000 7f54189d5e00 1 -- start start 2026-02-20T03:34:52.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.783+0000 7f54189d5e00 1 Processor -- start 2026-02-20T03:34:52.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.783+0000 7f5414a46640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53f00b0d10 0x7f53f00b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.783+0000 7f540d7fa640 1 -- 10.20.193.28:0/3505511968 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f53fc0e0a00 con 0x7f5410075950 2026-02-20T03:34:52.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.784+0000 7f5414a46640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53f00b0d10 0x7f53f00b31d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5404009b50 tx=0x7f5404009480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:52.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.785+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 0x561a8c9c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8c9c1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9bf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f54189d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561a8c8f58f0 con 0x561a8c9a6630 2026-02-20T03:34:52.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f54189d5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561a8c6e7f50 con 0x561a8c9ac000 2026-02-20T03:34:52.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f54189d5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561a8c9bfad0 con 0x561a8c9a6fb0 2026-02-20T03:34:52.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f540ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 0x561a8c9c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f540ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 0x561a8c9c0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47940/0 (socket says 10.20.193.28:47940) 2026-02-20T03:34:52.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f540ffff640 1 -- 10.20.193.28:0/3052786954 learned_addr learned my addr 10.20.193.28:0/3052786954 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:52.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f5414a46640 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f540f7fe640 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8c9c1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f540ffff640 1 -- 10.20.193.28:0/3052786954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 msgr2=0x561a8c9c1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:52.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.786+0000 7f540ffff640 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8c9c1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.787+0000 7f540ffff640 1 -- 10.20.193.28:0/3052786954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 msgr2=0x561a8c9bf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:52.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.787+0000 7f540ffff640 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9bf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.787+0000 7f540ffff640 1 -- 10.20.193.28:0/3052786954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8c9b8ad0 con 0x561a8c9a6630 2026-02-20T03:34:52.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.787+0000 7f5414a46640 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9bf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:52.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.787+0000 7f540ffff640 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 0x561a8c9c0c10 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b630 tx=0x7f53fc0a3d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e5acbae9cb05d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:52.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.787+0000 7f53d1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:52.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.787+0000 7f53d1ffb640 1 -- 10.20.193.28:0/3052786954 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0a7c60 con 0x561a8c9a6630 2026-02-20T03:34:52.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.788+0000 7f53d1ffb640 1 -- 10.20.193.28:0/3052786954 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f53fc0047c0 con 0x561a8c9a6630 2026-02-20T03:34:52.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.788+0000 7f53d1ffb640 1 -- 10.20.193.28:0/3052786954 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0a40c0 con 0x561a8c9a6630 2026-02-20T03:34:52.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.788+0000 7f54189d5e00 1 -- 10.20.193.28:0/3052786954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a8c6cab40 con 0x561a8c9a6630 2026-02-20T03:34:52.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.788+0000 7f54189d5e00 10 client.20952 _ll_register_callbacks cb 0x561a8c932f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:52.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.788+0000 7f54189d5e00 1 -- 10.20.193.28:0/3052786954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a8c9071a0 con 0x561a8c9a6630 2026-02-20T03:34:52.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f53d1ffb640 1 -- 10.20.193.28:0/3052786954 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f53fc05b510 con 0x561a8c9a6630 2026-02-20T03:34:52.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f53d1ffb640 1 -- 10.20.193.28:0/3052786954 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f53fc094070 con 0x561a8c9a6630 2026-02-20T03:34:52.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f54189d5e00 10 client.20952 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:52.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f54189d5e00 1 -- 10.20.193.28:0/3052786954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=45}) -- 0x561a8c8b4230 con 0x561a8c9a6630 2026-02-20T03:34:52.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f53d1ffb640 1 -- 10.20.193.28:0/3052786954 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f53fc00b900 con 0x561a8c9a6630 2026-02-20T03:34:52.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f54189d5e00 10 client.20952 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:52.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f54189d5e00 10 client.20952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:52.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f54189d5e00 20 client.20952 populate_metadata read hostname 'trial028' 2026-02-20T03:34:52.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561a8c9cf300 0x561a8c9d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f54189d5e00 4 client.20952 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:52.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f54189d5e00 1 -- 10.20.193.28:0/3052786954 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a8c9015b0 con 0x561a8c9cf300 2026-02-20T03:34:52.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.789+0000 7f540f7fe640 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561a8c9cf300 0x561a8c9d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.790+0000 7f540f7fe640 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561a8c9cf300 0x561a8c9d17c0 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7c7d62a425f2606 server_cookie=f218f407c01a6cc8 in_seq=0 out_seq=0 2026-02-20T03:34:52.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.790+0000 7f53d1ffb640 10 client.20952 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:52.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.791+0000 7f53d1ffb640 1 -- 10.20.193.28:0/3052786954 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561a8c9015b0 con 0x561a8c9cf300 2026-02-20T03:34:52.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.791+0000 7f53d1ffb640 10 client.20952 handle_command_reply: tid=0 2026-02-20T03:34:52.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.792+0000 7f54189d5e00 1 client.20952 shutdown 2026-02-20T03:34:52.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.792+0000 7f54189d5e00 1 -- 10.20.193.28:0/3052786954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 msgr2=0x561a8c9c0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:52.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.792+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 0x561a8c9c0c10 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b630 tx=0x7f53fc0a3d80 comp rx=0 tx=0).stop 2026-02-20T03:34:52.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.792+0000 7f54189d5e00 1 -- 10.20.193.28:0/3052786954 shutdown_connections 2026-02-20T03:34:52.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.792+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561a8c9cf300 0x561a8c9d17c0 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.792+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9ac000 0x561a8c9bf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.792+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8c9c1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.792+0000 7f54189d5e00 1 --2- 10.20.193.28:0/3052786954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6630 0x561a8c9c0c10 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.792+0000 7f54189d5e00 1 -- 10.20.193.28:0/3052786954 >> 10.20.193.28:0/3052786954 conn(0x561a8c969290 msgr2=0x561a8c9a5440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:52.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.793+0000 7f53d1ffb640 0 client.20952 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:52.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.793+0000 7f54189d5e00 1 -- 10.20.193.28:0/3052786954 shutdown_connections 2026-02-20T03:34:52.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.793+0000 7f54189d5e00 1 -- 10.20.193.28:0/3052786954 wait complete. 2026-02-20T03:34:52.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.793+0000 7f54189d5e00 20 client.20952 trim_cache size 0 max 16384 2026-02-20T03:34:52.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.802+0000 7f54189d5e00 1 Processor -- start 2026-02-20T03:34:52.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.802+0000 7f54189d5e00 1 -- start start 2026-02-20T03:34:52.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.802+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8c9bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.802+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6fb0 0x561a8c9a5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.802+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9ac000 0x561a8c9a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.802+0000 7f54189d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53b40127d0 con 0x561a8c9a6fb0 2026-02-20T03:34:52.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.802+0000 7f54189d5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f53b4010040 con 0x561a8c9a6630 2026-02-20T03:34:52.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.802+0000 7f54189d5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53b400de90 con 0x561a8c9ac000 2026-02-20T03:34:52.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6fb0 0x561a8c9a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6fb0 0x561a8c9a5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47946/0 (socket says 10.20.193.28:47946) 2026-02-20T03:34:52.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540f7fe640 1 -- 10.20.193.28:0/985165510 learned_addr learned my addr 10.20.193.28:0/985165510 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:52.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540ffff640 1 --2- 10.20.193.28:0/985165510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8c9bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f5414a46640 1 --2- 10.20.193.28:0/985165510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9ac000 0x561a8c9a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540f7fe640 1 -- 10.20.193.28:0/985165510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9ac000 msgr2=0x561a8c9a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:52.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540f7fe640 1 --2- 10.20.193.28:0/985165510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9ac000 0x561a8c9a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540f7fe640 1 -- 10.20.193.28:0/985165510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 msgr2=0x561a8c9bcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:52.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540f7fe640 1 --2- 10.20.193.28:0/985165510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8c9bcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540f7fe640 1 -- 10.20.193.28:0/985165510 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8c9b8900 con 0x561a8c9a6fb0 2026-02-20T03:34:52.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.803+0000 7f540f7fe640 1 --2- 10.20.193.28:0/985165510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6fb0 0x561a8c9a5520 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f54000097c0 tx=0x7f540002f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa60e879d6fc5d39 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:52.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f53d3fff640 1 -- 10.20.193.28:0/985165510 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400002960 con 0x561a8c9a6fb0 2026-02-20T03:34:52.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f53d3fff640 1 -- 10.20.193.28:0/985165510 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f540003e040 con 0x561a8c9a6fb0 2026-02-20T03:34:52.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f53d3fff640 1 -- 10.20.193.28:0/985165510 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5400004c60 con 0x561a8c9a6fb0 2026-02-20T03:34:52.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f54189d5e00 1 -- 10.20.193.28:0/985165510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6fb0 msgr2=0x561a8c9a5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:52.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f54189d5e00 1 --2- 10.20.193.28:0/985165510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6fb0 0x561a8c9a5520 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f54000097c0 tx=0x7f540002f8d0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f54189d5e00 1 -- 10.20.193.28:0/985165510 shutdown_connections 2026-02-20T03:34:52.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f54189d5e00 1 --2- 10.20.193.28:0/985165510 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9ac000 0x561a8c9a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f54189d5e00 1 --2- 10.20.193.28:0/985165510 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9a6fb0 0x561a8c9a5520 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f54189d5e00 1 --2- 10.20.193.28:0/985165510 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8c9bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f54189d5e00 1 -- 10.20.193.28:0/985165510 >> 10.20.193.28:0/985165510 conn(0x561a8c969290 msgr2=0x561a8c9c0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:52.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.804+0000 7f54189d5e00 1 -- 10.20.193.28:0/985165510 shutdown_connections 2026-02-20T03:34:52.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.805+0000 7f54189d5e00 1 -- 10.20.193.28:0/985165510 wait complete. 2026-02-20T03:34:52.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.805+0000 7f54189d5e00 1 -- start start 2026-02-20T03:34:52.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.805+0000 7f54189d5e00 1 Processor -- start 2026-02-20T03:34:52.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.805+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8ca35c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8ca34270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f54189d5e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9ac000 0x561a8ca347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f54189d5e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f53b400e500 con 0x561a8c9ac000 2026-02-20T03:34:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f54189d5e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f53b400f970 con 0x561a8c9a6630 2026-02-20T03:34:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f54189d5e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f53b400ebd0 con 0x561a8c9a6fb0 2026-02-20T03:34:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f5414a46640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9ac000 0x561a8ca347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f540ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8ca35c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f540ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8ca35c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47722/0 (socket says 10.20.193.28:47722) 2026-02-20T03:34:52.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f540ffff640 1 -- 10.20.193.28:0/2239677296 learned_addr learned my addr 10.20.193.28:0/2239677296 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f540f7fe640 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8ca34270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f540ffff640 1 -- 10.20.193.28:0/2239677296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 msgr2=0x561a8ca34270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f540ffff640 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8ca34270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f540ffff640 1 -- 10.20.193.28:0/2239677296 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9ac000 msgr2=0x561a8ca347d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f540ffff640 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9ac000 0x561a8ca347d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.806+0000 7f540ffff640 1 -- 10.20.193.28:0/2239677296 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a8c5d8870 con 0x561a8c9a6630 2026-02-20T03:34:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f540ffff640 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8ca35c60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f53fc005fd0 tx=0x7f53fc0a4430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c8441c48be447db server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f53d1ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f53d1ffb640 1 -- 10.20.193.28:0/2239677296 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0047c0 con 0x561a8c9a6630 2026-02-20T03:34:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f53d1ffb640 1 -- 10.20.193.28:0/2239677296 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x561a8c9071a0 con 0x561a8c9a6630 2026-02-20T03:34:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f53d1ffb640 1 -- 10.20.193.28:0/2239677296 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0a7420 con 0x561a8c9a6630 2026-02-20T03:34:52.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f54189d5e00 1 -- 10.20.193.28:0/2239677296 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a8c899440 con 0x561a8c9a6630 2026-02-20T03:34:52.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f54189d5e00 10 client.28556 _ll_register_callbacks cb 0x7f53fc00df60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:52.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f54189d5e00 1 -- 10.20.193.28:0/2239677296 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561a8c8abb00 con 0x561a8c9a6630 2026-02-20T03:34:52.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f53d1ffb640 1 -- 10.20.193.28:0/2239677296 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f53fc0a9a70 con 0x561a8c9a6630 2026-02-20T03:34:52.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f53d1ffb640 1 -- 10.20.193.28:0/2239677296 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f53fc0a9d50 con 0x561a8c9a6630 2026-02-20T03:34:52.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f54189d5e00 10 client.28556 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:52.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.807+0000 7f54189d5e00 1 -- 10.20.193.28:0/2239677296 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x561a8c9b95f0 con 0x561a8c9a6630 2026-02-20T03:34:52.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.808+0000 7f53d1ffb640 1 -- 10.20.193.28:0/2239677296 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f53fc057b60 con 0x561a8c9a6630 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.808+0000 7f54189d5e00 10 client.28556 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.808+0000 7f54189d5e00 10 client.28556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.808+0000 7f54189d5e00 20 client.28556 populate_metadata read hostname 'trial028' 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.808+0000 7f54189d5e00 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561a8c9c6a80 0x561a8c9c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.808+0000 7f54189d5e00 4 client.28556 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.808+0000 7f54189d5e00 1 -- 10.20.193.28:0/2239677296 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561a8c8abb00 con 0x561a8c9c6a80 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.808+0000 7f540f7fe640 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561a8c9c6a80 0x561a8c9c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.809+0000 7f540f7fe640 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561a8c9c6a80 0x561a8c9c6f00 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb28e5c5876a4f5a server_cookie=37b48f147f6995dd in_seq=0 out_seq=0 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.809+0000 7f53d1ffb640 10 client.28556 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.809+0000 7f53d1ffb640 1 -- 10.20.193.28:0/2239677296 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561a8c8abb00 con 0x561a8c9c6a80 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.809+0000 7f53d1ffb640 10 client.28556 handle_command_reply: tid=0 2026-02-20T03:34:52.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.809+0000 7f54189d5e00 1 client.28556 shutdown 2026-02-20T03:34:52.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 -- 10.20.193.28:0/2239677296 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 msgr2=0x561a8ca35c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:52.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8ca35c60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f53fc005fd0 tx=0x7f53fc0a4430 comp rx=0 tx=0).stop 2026-02-20T03:34:52.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 -- 10.20.193.28:0/2239677296 shutdown_connections 2026-02-20T03:34:52.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561a8c9c6a80 0x561a8c9c6f00 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561a8c9ac000 0x561a8ca347d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561a8c9a6fb0 0x561a8ca34270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 --2- 10.20.193.28:0/2239677296 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561a8c9a6630 0x561a8ca35c60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.823 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:34:52.824 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:34:52.824 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:34:52.824 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:34:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 -- 10.20.193.28:0/2239677296 >> 10.20.193.28:0/2239677296 conn(0x561a8c969290 msgr2=0x561a8c9bdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f53d1ffb640 0 client.28556 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 -- 10.20.193.28:0/2239677296 shutdown_connections 2026-02-20T03:34:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 1 -- 10.20.193.28:0/2239677296 wait complete. 2026-02-20T03:34:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.810+0000 7f54189d5e00 20 client.28556 trim_cache size 0 max 16384 2026-02-20T03:34:52.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 -- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53f00b0d10 msgr2=0x7f53f00b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53f00b0d10 0x7f53f00b31d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5404009b50 tx=0x7f5404009480 comp rx=0 tx=0).stop 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 -- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 msgr2=0x7f54101a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 0x7f54101a1310 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00d950 tx=0x7f53fc00de20 comp rx=0 tx=0).stop 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 -- 10.20.193.28:0/3505511968 shutdown_connections 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f53f00b0d10 0x7f53f00b31d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f54101134d0 0x7f54101a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f54101065d0 0x7f54101a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 --2- 10.20.193.28:0/3505511968 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5410075950 0x7f54101a1310 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 -- 10.20.193.28:0/3505511968 >> 10.20.193.28:0/3505511968 conn(0x7f54100fe440 msgr2=0x7f5410114970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 -- 10.20.193.28:0/3505511968 shutdown_connections 2026-02-20T03:34:52.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:52.812+0000 7f5415247640 1 -- 10.20.193.28:0/3505511968 wait complete. 2026-02-20T03:34:52.926 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:34:52.927 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:34:53.255 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:53.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.482+0000 7fd457f05640 1 -- 10.20.193.28:0/2095889793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd45010a6d0 msgr2=0x7fd45010aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:53.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.482+0000 7fd457f05640 1 --2- 10.20.193.28:0/2095889793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd45010a6d0 0x7fd45010aab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd440009a30 tx=0x7fd44002f220 comp rx=0 tx=0).stop 2026-02-20T03:34:53.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.482+0000 7fd457f05640 1 -- 10.20.193.28:0/2095889793 shutdown_connections 2026-02-20T03:34:53.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.482+0000 7fd457f05640 1 --2- 10.20.193.28:0/2095889793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd450113ab0 0x7fd450115f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.482+0000 7fd457f05640 1 --2- 10.20.193.28:0/2095889793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd45010aff0 0x7fd4501134e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.482+0000 7fd457f05640 1 --2- 10.20.193.28:0/2095889793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd45010a6d0 0x7fd45010aab0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.482+0000 7fd457f05640 1 -- 10.20.193.28:0/2095889793 >> 10.20.193.28:0/2095889793 conn(0x7fd45006ed80 msgr2=0x7fd45006f190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:53.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.482+0000 7fd457f05640 1 -- 10.20.193.28:0/2095889793 shutdown_connections 2026-02-20T03:34:53.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.482+0000 7fd457f05640 1 -- 10.20.193.28:0/2095889793 wait complete. 2026-02-20T03:34:53.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.483+0000 7fd457f05640 1 Processor -- start 2026-02-20T03:34:53.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.484+0000 7fd457f05640 1 -- start start 2026-02-20T03:34:53.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.484+0000 7fd457f05640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd45010a6d0 0x7fd4501a8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:53.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.484+0000 7fd457f05640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd45010aff0 0x7fd4501a8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:53.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.485+0000 7fd457f05640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd450113ab0 0x7fd4501a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:53.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.485+0000 7fd455479640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd45010aff0 0x7fd4501a8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:53.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.485+0000 7fd455c7a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd45010a6d0 0x7fd4501a8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:53.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.485+0000 7fd455479640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd45010aff0 0x7fd4501a8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37548/0 (socket says 10.20.193.28:37548) 2026-02-20T03:34:53.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.485+0000 7fd455479640 1 -- 10.20.193.28:0/727291504 learned_addr learned my addr 10.20.193.28:0/727291504 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:53.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.485+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd4501192c0 con 0x7fd450113ab0 2026-02-20T03:34:53.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.485+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd450119140 con 0x7fd45010a6d0 2026-02-20T03:34:53.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.485+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd450119440 con 0x7fd45010aff0 2026-02-20T03:34:53.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd45647b640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd450113ab0 0x7fd4501a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:53.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd455479640 1 -- 10.20.193.28:0/727291504 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd45010a6d0 msgr2=0x7fd4501a8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:53.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd455479640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd45010a6d0 0x7fd4501a8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd455479640 1 -- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd450113ab0 msgr2=0x7fd4501a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd455479640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd450113ab0 0x7fd4501a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd455479640 1 -- 10.20.193.28:0/727291504 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4501a21c0 con 0x7fd45010aff0 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd45647b640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd450113ab0 0x7fd4501a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd455c7a640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd45010a6d0 0x7fd4501a8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd455479640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd45010aff0 0x7fd4501a8b40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd4440027e0 tx=0x7fd444002cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd43effd640 1 -- 10.20.193.28:0/727291504 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44400ed40 con 0x7fd45010aff0 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4501a24b0 con 0x7fd45010aff0 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.486+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4501a6490 con 0x7fd45010aff0 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.487+0000 7fd43effd640 1 -- 10.20.193.28:0/727291504 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd444009570 con 0x7fd45010aff0 2026-02-20T03:34:53.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.487+0000 7fd43effd640 1 -- 10.20.193.28:0/727291504 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44400ed40 con 0x7fd45010aff0 2026-02-20T03:34:53.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.488+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd418005390 con 0x7fd45010aff0 2026-02-20T03:34:53.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.489+0000 7fd43effd640 1 -- 10.20.193.28:0/727291504 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd444010430 con 0x7fd45010aff0 2026-02-20T03:34:53.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.490+0000 7fd43effd640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd42c0b1020 0x7fd42c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:53.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.490+0000 7fd43effd640 1 -- 10.20.193.28:0/727291504 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd4440e0d30 con 0x7fd45010aff0 2026-02-20T03:34:53.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.493+0000 7fd43effd640 1 -- 10.20.193.28:0/727291504 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fd444014030 con 0x7fd45010aff0 2026-02-20T03:34:53.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.494+0000 7fd455c7a640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd42c0b1020 0x7fd42c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:53.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.494+0000 7fd455c7a640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd42c0b1020 0x7fd42c0b34e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd4400097c0 tx=0x7fd440005810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:53.618 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.616+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd418005680 con 0x7fd45010aff0 2026-02-20T03:34:53.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.617+0000 7fd43effd640 1 -- 10.20.193.28:0/727291504 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11921 (secure 0 0 0) 0x7fd4440a9170 con 0x7fd45010aff0 2026-02-20T03:34:53.620 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:34:53.620 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":45,"btime":"2026-02-20T03:34:27:412349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":45,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:34:27.401755+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:34:53.621 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 45 2026-02-20T03:34:53.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.619+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd42c0b1020 msgr2=0x7fd42c0b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:53.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.619+0000 7fd457f05640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd42c0b1020 0x7fd42c0b34e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd4400097c0 tx=0x7fd440005810 comp rx=0 tx=0).stop 2026-02-20T03:34:53.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.619+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd45010aff0 msgr2=0x7fd4501a8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:53.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.619+0000 7fd457f05640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd45010aff0 0x7fd4501a8b40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd4440027e0 tx=0x7fd444002cb0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.620+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 shutdown_connections 2026-02-20T03:34:53.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.620+0000 7fd457f05640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd42c0b1020 0x7fd42c0b34e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.620+0000 7fd457f05640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd450113ab0 0x7fd4501a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.620+0000 7fd457f05640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd45010aff0 0x7fd4501a8b40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.620+0000 7fd457f05640 1 --2- 10.20.193.28:0/727291504 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd45010a6d0 0x7fd4501a8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:53.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.620+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 >> 10.20.193.28:0/727291504 conn(0x7fd45006ed80 msgr2=0x7fd450072920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:53.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.620+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 shutdown_connections 2026-02-20T03:34:53.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:53.620+0000 7fd457f05640 1 -- 10.20.193.28:0/727291504 wait complete. 2026-02-20T03:34:53.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 146748 17.51 MB/sec execute 264 sec latency 53.210 ms 2026-02-20T03:34:53.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:53 trial028 ceph-mon[38552]: pgmap v792: 129 pgs: 129 active+clean; 580 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 8.5 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2026-02-20T03:34:53.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:53 trial177 ceph-mon[43181]: pgmap v792: 129 pgs: 129 active+clean; 580 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 8.5 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2026-02-20T03:34:53.744 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:34:53.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:53 trial126 ceph-mon[38476]: pgmap v792: 129 pgs: 129 active+clean; 580 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 8.5 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2026-02-20T03:34:54.047 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:54.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.284+0000 7fd6df453640 1 -- 10.20.193.28:0/795729675 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd6d810eef0 msgr2=0x7fd6d810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.284+0000 7fd6df453640 1 --2- 10.20.193.28:0/795729675 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd6d810eef0 0x7fd6d810f2d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009960 tx=0x7fd6c802f160 comp rx=0 tx=0).stop 2026-02-20T03:34:54.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.284+0000 7fd6df453640 1 -- 10.20.193.28:0/795729675 shutdown_connections 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.284+0000 7fd6df453640 1 --2- 10.20.193.28:0/795729675 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd6d8109ba0 0x7fd6d8115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.284+0000 7fd6df453640 1 --2- 10.20.193.28:0/795729675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d8109220 0x7fd6d8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.284+0000 7fd6df453640 1 --2- 10.20.193.28:0/795729675 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd6d810eef0 0x7fd6d810f2d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.284+0000 7fd6df453640 1 -- 10.20.193.28:0/795729675 >> 10.20.193.28:0/795729675 conn(0x7fd6d8078600 msgr2=0x7fd6d807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.285+0000 7fd6df453640 1 -- 10.20.193.28:0/795729675 shutdown_connections 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.285+0000 7fd6df453640 1 -- 10.20.193.28:0/795729675 wait complete. 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.285+0000 7fd6df453640 1 Processor -- start 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.285+0000 7fd6df453640 1 -- start start 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6df453640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d8109220 0x7fd6d81a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6df453640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd6d8109ba0 0x7fd6d81a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6df453640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd6d810eef0 0x7fd6d81a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6df453640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d8119080 con 0x7fd6d8109220 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6df453640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d8118f00 con 0x7fd6d8109ba0 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6df453640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d8119200 con 0x7fd6d810eef0 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6de451640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d8109220 0x7fd6d81a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6de451640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d8109220 0x7fd6d81a1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47982/0 (socket says 10.20.193.28:47982) 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6de451640 1 -- 10.20.193.28:0/467919365 learned_addr learned my addr 10.20.193.28:0/467919365 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd6d8109ba0 0x7fd6d81a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.286+0000 7fd6dec52640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd6d810eef0 0x7fd6d81a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.287+0000 7fd6ddc50640 1 -- 10.20.193.28:0/467919365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd6d810eef0 msgr2=0x7fd6d81a5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.287+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd6d810eef0 0x7fd6d81a5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.287+0000 7fd6ddc50640 1 -- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d8109220 msgr2=0x7fd6d81a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.287+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d8109220 0x7fd6d81a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.287+0000 7fd6ddc50640 1 -- 10.20.193.28:0/467919365 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d81a6380 con 0x7fd6d8109ba0 2026-02-20T03:34:54.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.287+0000 7fd6de451640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d8109220 0x7fd6d81a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:54.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.287+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd6d8109ba0 0x7fd6d81a1870 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00e9f0 tx=0x7fd6cc00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.302+0000 7fd6c77fe640 1 -- 10.20.193.28:0/467919365 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00cd80 con 0x7fd6d8109ba0 2026-02-20T03:34:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.302+0000 7fd6c77fe640 1 -- 10.20.193.28:0/467919365 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd6cc004570 con 0x7fd6d8109ba0 2026-02-20T03:34:54.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.302+0000 7fd6c77fe640 1 -- 10.20.193.28:0/467919365 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc010690 con 0x7fd6d8109ba0 2026-02-20T03:34:54.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.302+0000 7fd6df453640 1 -- 10.20.193.28:0/467919365 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d81a6670 con 0x7fd6d8109ba0 2026-02-20T03:34:54.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.302+0000 7fd6df453640 1 -- 10.20.193.28:0/467919365 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d81adeb0 con 0x7fd6d8109ba0 2026-02-20T03:34:54.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.305+0000 7fd6c77fe640 1 -- 10.20.193.28:0/467919365 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd6cc020060 con 0x7fd6d8109ba0 2026-02-20T03:34:54.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.306+0000 7fd6e2be1e00 1 Processor -- start 2026-02-20T03:34:54.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.306+0000 7fd6c77fe640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6ac0b0ef0 0x7fd6ac0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.306+0000 7fd6e2be1e00 1 -- start start 2026-02-20T03:34:54.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.306+0000 7fd6c77fe640 1 -- 10.20.193.28:0/467919365 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd6cc0e05c0 con 0x7fd6d8109ba0 2026-02-20T03:34:54.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.307+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22ffb0 0x564a9a230390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.307+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22a5e0 0x564a9a22aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.307+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22af60 0x564a9a236de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.307+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564a9a1aae00 con 0x564a9a22af60 2026-02-20T03:34:54.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.307+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564a9a17d970 con 0x564a9a22ffb0 2026-02-20T03:34:54.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.307+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564a9a12b1f0 con 0x564a9a22a5e0 2026-02-20T03:34:54.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.307+0000 7fd6ddc50640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22a5e0 0x564a9a22aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.307+0000 7fd6ddc50640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22a5e0 0x564a9a22aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37582/0 (socket says 10.20.193.28:37582) 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6ddc50640 1 -- 10.20.193.28:0/3944803631 learned_addr learned my addr 10.20.193.28:0/3944803631 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6de451640 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22ffb0 0x564a9a230390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6ddc50640 1 -- 10.20.193.28:0/3944803631 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22ffb0 msgr2=0x564a9a230390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6dec52640 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22af60 0x564a9a236de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22ffb0 0x564a9a230390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6ddc50640 1 -- 10.20.193.28:0/3944803631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22af60 msgr2=0x564a9a236de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22af60 0x564a9a236de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6ddc50640 1 -- 10.20.193.28:0/3944803631 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a9a13e3d0 con 0x564a9a22a5e0 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6dec52640 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22af60 0x564a9a236de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.308+0000 7fd6dec52640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6ac0b0ef0 0x7fd6ac0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.309+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22a5e0 0x564a9a22aa20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0a8290 tx=0x7fd6cc0a8a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba28475fec2d8de4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.309+0000 7fd6dec52640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6ac0b0ef0 0x7fd6ac0b33b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4002fc0 tx=0x7fd6d4004bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.310+0000 7fd6c4cf3640 1 -- 10.20.193.28:0/3944803631 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0b1560 con 0x564a9a22a5e0 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.310+0000 7fd6c4cf3640 1 -- 10.20.193.28:0/3944803631 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd6cc0026e0 con 0x564a9a22a5e0 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.310+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/3944803631 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22a5e0 msgr2=0x564a9a22aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.310+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22a5e0 0x564a9a22aa20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0a8290 tx=0x7fd6cc0a8a00 comp rx=0 tx=0).stop 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.310+0000 7fd6c4cf3640 1 -- 10.20.193.28:0/3944803631 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0b1560 con 0x564a9a22a5e0 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.311+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/3944803631 shutdown_connections 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.311+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22af60 0x564a9a236de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.311+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22a5e0 0x564a9a22aa20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.311+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/3944803631 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22ffb0 0x564a9a230390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.311+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/3944803631 >> 10.20.193.28:0/3944803631 conn(0x564a9a1ed240 msgr2=0x564a9a228ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.311+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/3944803631 shutdown_connections 2026-02-20T03:34:54.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.311+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/3944803631 wait complete. 2026-02-20T03:34:54.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.312+0000 7fd6e2be1e00 1 -- start start 2026-02-20T03:34:54.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.313+0000 7fd6e2be1e00 1 Processor -- start 2026-02-20T03:34:54.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a244b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a2450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22ffb0 0x564a9a243020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564a9a1798a0 con 0x564a9a22ffb0 2026-02-20T03:34:54.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564a99f6bf50 con 0x564a9a22a5e0 2026-02-20T03:34:54.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564a9a2435b0 con 0x564a9a22af60 2026-02-20T03:34:54.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6ddc50640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a2450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6ddc50640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a2450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37584/0 (socket says 10.20.193.28:37584) 2026-02-20T03:34:54.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6ddc50640 1 -- 10.20.193.28:0/1634073092 learned_addr learned my addr 10.20.193.28:0/1634073092 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6de451640 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a244b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.315+0000 7fd6dec52640 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22ffb0 0x564a9a243020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.316+0000 7fd6de451640 1 -- 10.20.193.28:0/1634073092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 msgr2=0x564a9a2450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.316+0000 7fd6de451640 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a2450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.316+0000 7fd6de451640 1 -- 10.20.193.28:0/1634073092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22ffb0 msgr2=0x564a9a243020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.316+0000 7fd6de451640 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22ffb0 0x564a9a243020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.316+0000 7fd6de451640 1 -- 10.20.193.28:0/1634073092 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a9a23c8b0 con 0x564a9a22a5e0 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.316+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a2450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.316+0000 7fd6de451640 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a244b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009880 tx=0x7fd6c8004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95e468a735965c37 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.317+0000 7fd68bfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.317+0000 7fd68bfff640 1 -- 10.20.193.28:0/1634073092 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8047070 con 0x564a9a22a5e0 2026-02-20T03:34:54.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.317+0000 7fd68bfff640 1 -- 10.20.193.28:0/1634073092 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd6c8033040 con 0x564a9a22a5e0 2026-02-20T03:34:54.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.317+0000 7fd68bfff640 1 -- 10.20.193.28:0/1634073092 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8043440 con 0x564a9a22a5e0 2026-02-20T03:34:54.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.317+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1634073092 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a99f4eb40 con 0x564a9a22a5e0 2026-02-20T03:34:54.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.317+0000 7fd6e2be1e00 10 client.28571 _ll_register_callbacks cb 0x564a9a1b6eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:54.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.317+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1634073092 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a9a18b150 con 0x564a9a22a5e0 2026-02-20T03:34:54.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.318+0000 7fd68bfff640 1 -- 10.20.193.28:0/1634073092 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd6c80026e0 con 0x564a9a22a5e0 2026-02-20T03:34:54.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.318+0000 7fd68bfff640 1 -- 10.20.193.28:0/1634073092 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fd6c8038970 con 0x564a9a22a5e0 2026-02-20T03:34:54.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.318+0000 7fd6e2be1e00 10 client.28571 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:54.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.318+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1634073092 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x564a9a1381e0 con 0x564a9a22a5e0 2026-02-20T03:34:54.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.319+0000 7fd68bfff640 1 -- 10.20.193.28:0/1634073092 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7fd6c8038b10 con 0x564a9a22a5e0 2026-02-20T03:34:54.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.319+0000 7fd6e2be1e00 10 client.28571 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:54.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.320+0000 7fd6e2be1e00 10 client.28571 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:34:54.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.320+0000 7fd6e2be1e00 20 client.28571 populate_metadata read hostname 'trial028' 2026-02-20T03:34:54.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.320+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564a9a2531b0 0x564a9a255670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.320+0000 7fd6e2be1e00 4 client.28571 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:54.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.320+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1634073092 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a9a185560 con 0x564a9a2531b0 2026-02-20T03:34:54.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.320+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564a9a2531b0 0x564a9a255670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.321+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564a9a2531b0 0x564a9a255670 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c15db5cad92082de server_cookie=9f3d645e721dcdb3 in_seq=0 out_seq=0 2026-02-20T03:34:54.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.321+0000 7fd68bfff640 10 client.28571 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:34:54.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.323+0000 7fd68bfff640 1 -- 10.20.193.28:0/1634073092 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x564a9a185560 con 0x564a9a2531b0 2026-02-20T03:34:54.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.323+0000 7fd68bfff640 10 client.28571 handle_command_reply: tid=0 2026-02-20T03:34:54.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.323+0000 7fd6e2be1e00 1 client.28571 shutdown 2026-02-20T03:34:54.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.323+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1634073092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 msgr2=0x564a9a244b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.323+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a244b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009880 tx=0x7fd6c8004610 comp rx=0 tx=0).stop 2026-02-20T03:34:54.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.324+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1634073092 shutdown_connections 2026-02-20T03:34:54.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.324+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564a9a2531b0 0x564a9a255670 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.324+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22ffb0 0x564a9a243020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.324+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a2450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.324+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1634073092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a244b70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.324+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1634073092 >> 10.20.193.28:0/1634073092 conn(0x564a9a1ed240 msgr2=0x564a9a2293f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.324+0000 7fd68bfff640 0 client.28571 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:34:54.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.324+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1634073092 shutdown_connections 2026-02-20T03:34:54.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.325+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1634073092 wait complete. 2026-02-20T03:34:54.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.325+0000 7fd6e2be1e00 20 client.28571 trim_cache size 0 max 16384 2026-02-20T03:34:54.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.332+0000 7fd6e2be1e00 1 Processor -- start 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.332+0000 7fd6e2be1e00 1 -- start start 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.332+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22a5e0 0x564a9a241880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22af60 0x564a9a241dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22ffb0 0x564a9a240330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd680012750 con 0x564a9a22a5e0 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd68000ffc0 con 0x564a9a22af60 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd68000de10 con 0x564a9a22ffb0 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6dec52640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22ffb0 0x564a9a240330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6dec52640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22ffb0 0x564a9a240330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37590/0 (socket says 10.20.193.28:37590) 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6dec52640 1 -- 10.20.193.28:0/1272211538 learned_addr learned my addr 10.20.193.28:0/1272211538 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.336 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6de451640 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22a5e0 0x564a9a241880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22af60 0x564a9a241dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6de451640 1 -- 10.20.193.28:0/1272211538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22ffb0 msgr2=0x564a9a240330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6de451640 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22ffb0 0x564a9a240330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6de451640 1 -- 10.20.193.28:0/1272211538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22af60 msgr2=0x564a9a241dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6de451640 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22af60 0x564a9a241dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6de451640 1 -- 10.20.193.28:0/1272211538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a9a23c6e0 con 0x564a9a22a5e0 2026-02-20T03:34:54.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6dec52640 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22ffb0 0x564a9a240330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:54.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.333+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22af60 0x564a9a241dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:54.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.334+0000 7fd6de451640 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22a5e0 0x564a9a241880 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8038040 tx=0x7fd6c804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e467615eecb93d3c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.336+0000 7fd6a24e6640 1 -- 10.20.193.28:0/1272211538 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c805f070 con 0x564a9a22a5e0 2026-02-20T03:34:54.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.336+0000 7fd6a24e6640 1 -- 10.20.193.28:0/1272211538 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd6c8033040 con 0x564a9a22a5e0 2026-02-20T03:34:54.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.336+0000 7fd6a24e6640 1 -- 10.20.193.28:0/1272211538 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8047070 con 0x564a9a22a5e0 2026-02-20T03:34:54.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.337+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1272211538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22a5e0 msgr2=0x564a9a241880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.337+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22a5e0 0x564a9a241880 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8038040 tx=0x7fd6c804e000 comp rx=0 tx=0).stop 2026-02-20T03:34:54.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.337+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1272211538 shutdown_connections 2026-02-20T03:34:54.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.337+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22ffb0 0x564a9a240330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.337+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22af60 0x564a9a241dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.337+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1272211538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22a5e0 0x564a9a241880 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.337+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1272211538 >> 10.20.193.28:0/1272211538 conn(0x564a9a1ed240 msgr2=0x564a9a244b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.337+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1272211538 shutdown_connections 2026-02-20T03:34:54.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.337+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1272211538 wait complete. 2026-02-20T03:34:54.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.338+0000 7fd6e2be1e00 1 -- start start 2026-02-20T03:34:54.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.338+0000 7fd6e2be1e00 1 Processor -- start 2026-02-20T03:34:54.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.338+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a24ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a24b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6e2be1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22ffb0 0x564a9a247a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd68000e480 con 0x564a9a22ffb0 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd68000f8f0 con 0x564a9a22a5e0 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6de451640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a24ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6e2be1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd68000eb50 con 0x564a9a22af60 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6de451640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a24ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47798/0 (socket says 10.20.193.28:47798) 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6de451640 1 -- 10.20.193.28:0/1201556006 learned_addr learned my addr 10.20.193.28:0/1201556006 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a24b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6de451640 1 -- 10.20.193.28:0/1201556006 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 msgr2=0x564a9a24b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6de451640 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a24b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6de451640 1 -- 10.20.193.28:0/1201556006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22ffb0 msgr2=0x564a9a247a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6de451640 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22ffb0 0x564a9a247a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6de451640 1 -- 10.20.193.28:0/1201556006 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a99e5c870 con 0x564a9a22a5e0 2026-02-20T03:34:54.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd6de451640 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a24ac50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd6c803b010 tx=0x7fd6c8004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c62aa3bb9a1fa275 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.339+0000 7fd68bfff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:54.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.340+0000 7fd68bfff640 1 -- 10.20.193.28:0/1201556006 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c805f070 con 0x564a9a22a5e0 2026-02-20T03:34:54.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.340+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1201556006 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a9a11d3f0 con 0x564a9a22a5e0 2026-02-20T03:34:54.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.340+0000 7fd6e2be1e00 10 client.28577 _ll_register_callbacks cb 0x7fd6c80097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.340+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1201556006 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a9a12fab0 con 0x564a9a22a5e0 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.340+0000 7fd68bfff640 1 -- 10.20.193.28:0/1201556006 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x564a9a18b150 con 0x564a9a22a5e0 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.340+0000 7fd68bfff640 1 -- 10.20.193.28:0/1201556006 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8047070 con 0x564a9a22a5e0 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.340+0000 7fd68bfff640 1 -- 10.20.193.28:0/1201556006 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd6c8002af0 con 0x564a9a22a5e0 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.340+0000 7fd68bfff640 1 -- 10.20.193.28:0/1201556006 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fd6c8051030 con 0x564a9a22a5e0 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.340+0000 7fd6e2be1e00 10 client.28577 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.341+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1201556006 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x564a9a23d3d0 con 0x564a9a22a5e0 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.341+0000 7fd68bfff640 1 -- 10.20.193.28:0/1201556006 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7fd6c80047c0 con 0x564a9a22a5e0 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.341+0000 7fd6e2be1e00 10 client.28577 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.341+0000 7fd6e2be1e00 10 client.28577 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.341+0000 7fd6e2be1e00 20 client.28577 populate_metadata read hostname 'trial028' 2026-02-20T03:34:54.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.341+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564a9a2be670 0x564a9a2c0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.341+0000 7fd6e2be1e00 4 client.28577 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:34:54.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.341+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1201556006 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd6c8033040 con 0x564a9a2be670 2026-02-20T03:34:54.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.342+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564a9a2be670 0x564a9a2c0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.343+0000 7fd6ddc50640 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564a9a2be670 0x564a9a2c0b30 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c388342938198f8 server_cookie=f4dc7b231ac24e6b in_seq=0 out_seq=0 2026-02-20T03:34:54.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.343+0000 7fd68bfff640 10 client.28577 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:34:54.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.344+0000 7fd68bfff640 1 -- 10.20.193.28:0/1201556006 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd6c8033040 con 0x564a9a2be670 2026-02-20T03:34:54.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.344+0000 7fd68bfff640 10 client.28577 handle_command_reply: tid=0 2026-02-20T03:34:54.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.344+0000 7fd6e2be1e00 1 client.28577 shutdown 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.344+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1201556006 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 msgr2=0x564a9a24ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.344+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a24ac50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd6c803b010 tx=0x7fd6c8004610 comp rx=0 tx=0).stop 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.345+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1201556006 shutdown_connections 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.345+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564a9a2be670 0x564a9a2c0b30 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.345+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564a9a22ffb0 0x564a9a247a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.345+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564a9a22af60 0x564a9a24b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.345+0000 7fd6e2be1e00 1 --2- 10.20.193.28:0/1201556006 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564a9a22a5e0 0x564a9a24ac50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.345+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1201556006 >> 10.20.193.28:0/1201556006 conn(0x564a9a1ed240 msgr2=0x564a9a2417a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.345+0000 7fd68bfff640 0 client.28577 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:34:54.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.345+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1201556006 shutdown_connections 2026-02-20T03:34:54.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.346+0000 7fd6e2be1e00 1 -- 10.20.193.28:0/1201556006 wait complete. 2026-02-20T03:34:54.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.346+0000 7fd6e2be1e00 20 client.28577 trim_cache size 0 max 16384 2026-02-20T03:34:54.349 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:34:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 -- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6ac0b0ef0 msgr2=0x7fd6ac0b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6ac0b0ef0 0x7fd6ac0b33b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4002fc0 tx=0x7fd6d4004bb0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 -- 10.20.193.28:0/467919365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd6d8109ba0 msgr2=0x7fd6d81a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd6d8109ba0 0x7fd6d81a1870 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc00e9f0 tx=0x7fd6cc00eec0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 -- 10.20.193.28:0/467919365 shutdown_connections 2026-02-20T03:34:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd6ac0b0ef0 0x7fd6ac0b33b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd6d810eef0 0x7fd6d81a5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd6d8109ba0 0x7fd6d81a1870 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 --2- 10.20.193.28:0/467919365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd6d8109220 0x7fd6d81a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 -- 10.20.193.28:0/467919365 >> 10.20.193.28:0/467919365 conn(0x7fd6d8078600 msgr2=0x7fd6d8079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 -- 10.20.193.28:0/467919365 shutdown_connections 2026-02-20T03:34:54.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:54.347+0000 7fd6df453640 1 -- 10.20.193.28:0/467919365 wait complete. 2026-02-20T03:34:54.474 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:34:54.684 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:54 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/727291504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:34:54.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 147933 17.68 MB/sec execute 265 sec latency 69.688 ms 2026-02-20T03:34:54.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.714+0000 7fbe7560d640 1 -- 10.20.193.28:0/2806157660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe70105b20 msgr2=0x7fbe70105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.714+0000 7fbe7560d640 1 --2- 10.20.193.28:0/2806157660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe70105b20 0x7fbe70105fa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009a30 tx=0x7fbe6002f260 comp rx=0 tx=0).stop 2026-02-20T03:34:54.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.714+0000 7fbe7560d640 1 -- 10.20.193.28:0/2806157660 shutdown_connections 2026-02-20T03:34:54.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.714+0000 7fbe7560d640 1 --2- 10.20.193.28:0/2806157660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe701064e0 0x7fbe7010cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.717 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.714+0000 7fbe7560d640 1 --2- 10.20.193.28:0/2806157660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe70105b20 0x7fbe70105fa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.714+0000 7fbe7560d640 1 --2- 10.20.193.28:0/2806157660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe70104930 0x7fbe70104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.714+0000 7fbe7560d640 1 -- 10.20.193.28:0/2806157660 >> 10.20.193.28:0/2806157660 conn(0x7fbe701000b0 msgr2=0x7fbe701024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.715+0000 7fbe7560d640 1 -- 10.20.193.28:0/2806157660 shutdown_connections 2026-02-20T03:34:54.718 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.715+0000 7fbe7560d640 1 -- 10.20.193.28:0/2806157660 wait complete. 2026-02-20T03:34:54.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:54 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/727291504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:34:54.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.716+0000 7fbe7560d640 1 Processor -- start 2026-02-20T03:34:54.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe7560d640 1 -- start start 2026-02-20T03:34:54.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe7560d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe70104930 0x7fbe70198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe7560d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe70105b20 0x7fbe70198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.720 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe7560d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe701064e0 0x7fbe7019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe7560d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe70110470 con 0x7fbe70104930 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe7560d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbe701102f0 con 0x7fbe70105b20 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe7560d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe701105f0 con 0x7fbe701064e0 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe74e0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe701064e0 0x7fbe7019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe74e0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe701064e0 0x7fbe7019fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37610/0 (socket says 10.20.193.28:37610) 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe74e0c640 1 -- 10.20.193.28:0/3106058508 learned_addr learned my addr 10.20.193.28:0/3106058508 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe70105b20 0x7fbe70198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe74e0c640 1 -- 10.20.193.28:0/3106058508 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe70105b20 msgr2=0x7fbe70198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe74e0c640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe70105b20 0x7fbe70198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe74e0c640 1 -- 10.20.193.28:0/3106058508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe70104930 msgr2=0x7fbe70198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe74e0c640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe70104930 0x7fbe70198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.717+0000 7fbe74e0c640 1 -- 10.20.193.28:0/3106058508 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe701a0230 con 0x7fbe701064e0 2026-02-20T03:34:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.718+0000 7fbe74e0c640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe701064e0 0x7fbe7019fb30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400ef30 tx=0x7fbe6400c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.719+0000 7fbe6d7fa640 1 -- 10.20.193.28:0/3106058508 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64019070 con 0x7fbe701064e0 2026-02-20T03:34:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.719+0000 7fbe6d7fa640 1 -- 10.20.193.28:0/3106058508 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbe640092d0 con 0x7fbe701064e0 2026-02-20T03:34:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.719+0000 7fbe6d7fa640 1 -- 10.20.193.28:0/3106058508 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64007500 con 0x7fbe701064e0 2026-02-20T03:34:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.719+0000 7fbe7560d640 1 -- 10.20.193.28:0/3106058508 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7006c890 con 0x7fbe701064e0 2026-02-20T03:34:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.719+0000 7fbe7560d640 1 -- 10.20.193.28:0/3106058508 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe7006cd90 con 0x7fbe701064e0 2026-02-20T03:34:54.724 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.722+0000 7fbe797d8e00 1 Processor -- start 2026-02-20T03:34:54.726 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.724+0000 7fbe797d8e00 1 -- start start 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.724+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf09280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.724+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf0df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.724+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 0x55575cf109f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.724+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55575ce598f0 con 0x55575cf097c0 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.724+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55575ce072e0 con 0x55575cf08e80 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.724+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55575ce55820 con 0x55575cf0e560 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.724+0000 7fbe6ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf0df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf0df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48048/0 (socket says 10.20.193.28:48048) 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6ffff640 1 -- 10.20.193.28:0/150674373 learned_addr learned my addr 10.20.193.28:0/150674373 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/150674373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf09280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/150674373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 0x55575cf109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6ffff640 1 -- 10.20.193.28:0/150674373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 msgr2=0x55575cf109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/150674373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 0x55575cf109f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6ffff640 1 -- 10.20.193.28:0/150674373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 msgr2=0x55575cf09280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/150674373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf09280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6ffff640 1 -- 10.20.193.28:0/150674373 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575cdf95a0 con 0x55575cf097c0 2026-02-20T03:34:54.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.725+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/150674373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf0df40 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c005cc0 tx=0x7fbe5c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eea9b6fdd5c95ec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe6d7fa640 1 -- 10.20.193.28:0/3106058508 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbe640076a0 con 0x7fbe701064e0 2026-02-20T03:34:54.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe40bfe640 1 -- 10.20.193.28:0/150674373 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c002cc0 con 0x55575cf097c0 2026-02-20T03:34:54.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe40bfe640 1 -- 10.20.193.28:0/150674373 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbe5c0108d0 con 0x55575cf097c0 2026-02-20T03:34:54.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe40bfe640 1 -- 10.20.193.28:0/150674373 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c0187c0 con 0x55575cf097c0 2026-02-20T03:34:54.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe797d8e00 1 -- 10.20.193.28:0/150674373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 msgr2=0x55575cf0df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/150674373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf0df40 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c005cc0 tx=0x7fbe5c009b90 comp rx=0 tx=0).stop 2026-02-20T03:34:54.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe797d8e00 1 -- 10.20.193.28:0/150674373 shutdown_connections 2026-02-20T03:34:54.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/150674373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 0x55575cf109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/150674373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf0df40 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/150674373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf09280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.727+0000 7fbe797d8e00 1 -- 10.20.193.28:0/150674373 >> 10.20.193.28:0/150674373 conn(0x55575cf006f0 msgr2=0x55575cf07570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.728+0000 7fbe797d8e00 1 -- 10.20.193.28:0/150674373 shutdown_connections 2026-02-20T03:34:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.728+0000 7fbe797d8e00 1 -- 10.20.193.28:0/150674373 wait complete. 2026-02-20T03:34:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.728+0000 7fbe6d7fa640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbe440b0ed0 0x7fbe440b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.728+0000 7fbe6d7fa640 1 -- 10.20.193.28:0/3106058508 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbe640e09b0 con 0x7fbe701064e0 2026-02-20T03:34:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.728+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbe440b0ed0 0x7fbe440b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.729+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbe440b0ed0 0x7fbe440b3390 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009950 tx=0x7fbe60005b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.731+0000 7fbe797d8e00 1 -- start start 2026-02-20T03:34:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.731+0000 7fbe797d8e00 1 Processor -- start 2026-02-20T03:34:54.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf21a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf21f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55575ce010c0 con 0x55575cf097c0 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55575cf11610 con 0x55575cf0e560 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55575cf29480 con 0x55575cf08e80 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe6ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf21a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe74e0c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe74e0c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47842/0 (socket says 10.20.193.28:47842) 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe74e0c640 1 -- 10.20.193.28:0/1242802699 learned_addr learned my addr 10.20.193.28:0/1242802699 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf21f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe74e0c640 1 -- 10.20.193.28:0/1242802699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 msgr2=0x55575cf21a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe74e0c640 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf21a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe74e0c640 1 -- 10.20.193.28:0/1242802699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 msgr2=0x55575cf21f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe74e0c640 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf21f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe74e0c640 1 -- 10.20.193.28:0/1242802699 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575cf1b130 con 0x55575cf0e560 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.732+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf21f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe74e0c640 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28ef0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbe640a44c0 tx=0x7fbe640a7d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7efab0ddfcfa84aa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe31ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1242802699 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe640a8d90 con 0x55575cf0e560 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1242802699 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbe640aca40 con 0x55575cf0e560 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1242802699 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe640a7110 con 0x55575cf0e560 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1242802699 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55575ce15820 con 0x55575cf0e560 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1242802699 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbe640a72b0 con 0x55575cf0e560 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe797d8e00 10 client.28586 _ll_register_callbacks cb 0x55575ce04ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1242802699 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55575ce614e0 con 0x55575cf0e560 2026-02-20T03:34:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.733+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1242802699 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fbe640a74b0 con 0x55575cf0e560 2026-02-20T03:34:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.734+0000 7fbe797d8e00 10 client.28586 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.734+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1242802699 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55575ce1a380 con 0x55575cf0e560 2026-02-20T03:34:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.734+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1242802699 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7fbe640a76a0 con 0x55575cf0e560 2026-02-20T03:34:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.734+0000 7fbe797d8e00 10 client.28586 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.734+0000 7fbe797d8e00 10 client.28586 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.734+0000 7fbe797d8e00 20 client.28586 populate_metadata read hostname 'trial028' 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.734+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55575cf2d790 0x55575cf2fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.734+0000 7fbe797d8e00 4 client.28586 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.734+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1242802699 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55575cddbbd0 con 0x55575cf2d790 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.735+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55575cf2d790 0x55575cf2fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55575cf2d790 0x55575cf2fc30 crc :-1 s=READY pgs=515 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daca1369265c09e9 server_cookie=4aa595e54f92d65c in_seq=0 out_seq=0 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe31ffb640 10 client.28586 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1242802699 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55575cddbbd0 con 0x55575cf2d790 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe31ffb640 10 client.28586 handle_command_reply: tid=0 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 client.28586 shutdown 2026-02-20T03:34:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1242802699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 msgr2=0x55575cf28ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28ef0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbe640a44c0 tx=0x7fbe640a7d90 comp rx=0 tx=0).stop 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1242802699 shutdown_connections 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55575cf2d790 0x55575cf2fc30 crc :-1 s=READY pgs=515 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28ef0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf21f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1242802699 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf21a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1242802699 >> 10.20.193.28:0/1242802699 conn(0x55575cf006f0 msgr2=0x55575cf0f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe31ffb640 0 client.28586 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.736+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1242802699 shutdown_connections 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.737+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1242802699 wait complete. 2026-02-20T03:34:54.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.737+0000 7fbe797d8e00 20 client.28586 trim_cache size 0 max 16384 2026-02-20T03:34:54.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.743+0000 7fbe797d8e00 1 Processor -- start 2026-02-20T03:34:54.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.743+0000 7fbe797d8e00 1 -- start start 2026-02-20T03:34:54.746 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf1ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf28e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 0x55575cf1e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe14012660 con 0x55575cf097c0 2026-02-20T03:34:54.747 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1400fed0 con 0x55575cf08e80 2026-02-20T03:34:54.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1400dd20 con 0x55575cf0e560 2026-02-20T03:34:54.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe6ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf1ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe6ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf1ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47852/0 (socket says 10.20.193.28:47852) 2026-02-20T03:34:54.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe6ffff640 1 -- 10.20.193.28:0/101246512 learned_addr learned my addr 10.20.193.28:0/101246512 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf28e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.744+0000 7fbe74e0c640 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 0x55575cf1e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.745+0000 7fbe6ffff640 1 -- 10.20.193.28:0/101246512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 msgr2=0x55575cf1e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.745+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 0x55575cf1e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.745+0000 7fbe6ffff640 1 -- 10.20.193.28:0/101246512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 msgr2=0x55575cf28e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.745+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf28e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.745+0000 7fbe6ffff640 1 -- 10.20.193.28:0/101246512 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575cf1af60 con 0x55575cf08e80 2026-02-20T03:34:54.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.745+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf28e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:54.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.745+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf1ffd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c005cc0 tx=0x7fbe5c009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cea32fff3cd8660 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.745+0000 7fbe33fff640 1 -- 10.20.193.28:0/101246512 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c031070 con 0x55575cf08e80 2026-02-20T03:34:54.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.746+0000 7fbe33fff640 1 -- 10.20.193.28:0/101246512 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbe5c010a80 con 0x55575cf08e80 2026-02-20T03:34:54.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.746+0000 7fbe33fff640 1 -- 10.20.193.28:0/101246512 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c02c7f0 con 0x55575cf08e80 2026-02-20T03:34:54.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.746+0000 7fbe797d8e00 1 -- 10.20.193.28:0/101246512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 msgr2=0x55575cf1ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.750 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.746+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf1ffd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c005cc0 tx=0x7fbe5c009290 comp rx=0 tx=0).stop 2026-02-20T03:34:54.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.746+0000 7fbe797d8e00 1 -- 10.20.193.28:0/101246512 shutdown_connections 2026-02-20T03:34:54.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.746+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf0e560 0x55575cf1e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.752 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.746+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf28e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.746+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/101246512 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf08e80 0x55575cf1ffd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.747+0000 7fbe797d8e00 1 -- 10.20.193.28:0/101246512 >> 10.20.193.28:0/101246512 conn(0x55575cf006f0 msgr2=0x55575cf0a700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.747+0000 7fbe797d8e00 1 -- 10.20.193.28:0/101246512 shutdown_connections 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.747+0000 7fbe797d8e00 1 -- 10.20.193.28:0/101246512 wait complete. 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.747+0000 7fbe797d8e00 1 -- start start 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.747+0000 7fbe797d8e00 1 Processor -- start 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.748+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf26de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.748+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf27320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.748+0000 7fbe797d8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.748+0000 7fbe6ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf26de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.748+0000 7fbe6ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf26de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37652/0 (socket says 10.20.193.28:37652) 2026-02-20T03:34:54.753 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.748+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1400e390 con 0x55575cf097c0 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.748+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1400f800 con 0x55575cf0e560 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.748+0000 7fbe797d8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1400ea60 con 0x55575cf08e80 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.748+0000 7fbe6ffff640 1 -- 10.20.193.28:0/1117626513 learned_addr learned my addr 10.20.193.28:0/1117626513 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf27320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe74e0c640 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe6ffff640 1 -- 10.20.193.28:0/1117626513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 msgr2=0x55575cf28350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe6ffff640 1 -- 10.20.193.28:0/1117626513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 msgr2=0x55575cf27320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf27320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe6ffff640 1 -- 10.20.193.28:0/1117626513 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55575cbb9690 con 0x55575cf08e80 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe6ffff640 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf26de0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c004720 tx=0x7fbe5c005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19d0e6985c630db7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe31ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1117626513 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c031040 con 0x55575cf08e80 2026-02-20T03:34:54.754 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1117626513 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55575ce1eb70 con 0x55575cf08e80 2026-02-20T03:34:54.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe797d8e00 10 client.28582 _ll_register_callbacks cb 0x7fbe640a8460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:54.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1117626513 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe5c0108d0 con 0x55575cf08e80 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1117626513 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbe5c02c530 con 0x55575cf08e80 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.749+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1117626513 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c026650 con 0x55575cf08e80 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.750+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1117626513 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbe5c0267f0 con 0x55575cf08e80 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.750+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1117626513 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fbe5c010430 con 0x55575cf08e80 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.752+0000 7fbe797d8e00 10 client.28582 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.752+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1117626513 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55575cf1bc50 con 0x55575cf08e80 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.752+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1117626513 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7fbe5c023040 con 0x55575cf08e80 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.752+0000 7fbe797d8e00 10 client.28582 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.752+0000 7fbe797d8e00 10 client.28582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:54.756 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.752+0000 7fbe797d8e00 20 client.28582 populate_metadata read hostname 'trial028' 2026-02-20T03:34:54.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.752+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55575cf99000 0x55575cf9b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:54.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.752+0000 7fbe797d8e00 4 client.28582 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:34:54.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.752+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1117626513 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55575cc32520 con 0x55575cf99000 2026-02-20T03:34:54.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.753+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55575cf99000 0x55575cf9b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:54.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.754+0000 7fbe6f7fe640 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55575cf99000 0x55575cf9b4c0 crc :-1 s=READY pgs=516 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cb3159aefd4fc15 server_cookie=479b92c3cf13c70f in_seq=0 out_seq=0 2026-02-20T03:34:54.757 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.754+0000 7fbe31ffb640 10 client.28582 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:54.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.773+0000 7fbe31ffb640 1 -- 10.20.193.28:0/1117626513 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55575cc32520 con 0x55575cf99000 2026-02-20T03:34:54.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.773+0000 7fbe31ffb640 10 client.28582 handle_command_reply: tid=0 2026-02-20T03:34:54.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.773+0000 7fbe797d8e00 1 client.28582 shutdown 2026-02-20T03:34:54.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1117626513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 msgr2=0x55575cf26de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf26de0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c004720 tx=0x7fbe5c005970 comp rx=0 tx=0).stop 2026-02-20T03:34:54.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1117626513 shutdown_connections 2026-02-20T03:34:54.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55575cf99000 0x55575cf9b4c0 crc :-1 s=READY pgs=516 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55575cf0e560 0x55575cf28350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55575cf097c0 0x55575cf27320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 --2- 10.20.193.28:0/1117626513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55575cf08e80 0x55575cf26de0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1117626513 >> 10.20.193.28:0/1117626513 conn(0x55575cf006f0 msgr2=0x55575cf21080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.777 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe31ffb640 0 client.28582 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:54.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1117626513 shutdown_connections 2026-02-20T03:34:54.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.774+0000 7fbe797d8e00 1 -- 10.20.193.28:0/1117626513 wait complete. 2026-02-20T03:34:54.778 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe797d8e00 20 client.28582 trim_cache size 0 max 16384 2026-02-20T03:34:54.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:34:54.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:34:54.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:34:54.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:34:54.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 -- 10.20.193.28:0/3106058508 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbe440b0ed0 msgr2=0x7fbe440b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbe440b0ed0 0x7fbe440b3390 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009950 tx=0x7fbe60005b00 comp rx=0 tx=0).stop 2026-02-20T03:34:54.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 -- 10.20.193.28:0/3106058508 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe701064e0 msgr2=0x7fbe7019fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:54.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe701064e0 0x7fbe7019fb30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400ef30 tx=0x7fbe6400c560 comp rx=0 tx=0).stop 2026-02-20T03:34:54.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 -- 10.20.193.28:0/3106058508 shutdown_connections 2026-02-20T03:34:54.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbe440b0ed0 0x7fbe440b3390 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbe701064e0 0x7fbe7019fb30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbe70105b20 0x7fbe70198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 --2- 10.20.193.28:0/3106058508 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbe70104930 0x7fbe70198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:54.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.775+0000 7fbe7560d640 1 -- 10.20.193.28:0/3106058508 >> 10.20.193.28:0/3106058508 conn(0x7fbe701000b0 msgr2=0x7fbe70079540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:54.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.776+0000 7fbe7560d640 1 -- 10.20.193.28:0/3106058508 shutdown_connections 2026-02-20T03:34:54.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:34:54.776+0000 7fbe7560d640 1 -- 10.20.193.28:0/3106058508 wait complete. 2026-02-20T03:34:54.804 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:54.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:54 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/727291504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:34:55.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.014+0000 7fc3f5fab640 1 -- 10.20.193.28:0/655771498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc3f010eef0 msgr2=0x7fc3f010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.014+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/655771498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc3f010eef0 0x7fc3f010f2d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400b0a0 tx=0x7fc3e402f450 comp rx=0 tx=0).stop 2026-02-20T03:34:55.018 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.014+0000 7fc3f5fab640 1 -- 10.20.193.28:0/655771498 shutdown_connections 2026-02-20T03:34:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.014+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/655771498 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3f0109ba0 0x7fc3f0115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.014+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/655771498 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc3f0109220 0x7fc3f0109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.014+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/655771498 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc3f010eef0 0x7fc3f010f2d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.014+0000 7fc3f5fab640 1 -- 10.20.193.28:0/655771498 >> 10.20.193.28:0/655771498 conn(0x7fc3f0078600 msgr2=0x7fc3f007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.014+0000 7fc3f5fab640 1 -- 10.20.193.28:0/655771498 shutdown_connections 2026-02-20T03:34:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.014+0000 7fc3f5fab640 1 -- 10.20.193.28:0/655771498 wait complete. 2026-02-20T03:34:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.015+0000 7fc3f5fab640 1 Processor -- start 2026-02-20T03:34:55.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.015+0000 7fc3f5fab640 1 -- start start 2026-02-20T03:34:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f5fab640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc3f0109220 0x7fc3f01a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f5fab640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3f0109ba0 0x7fc3f01a19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f5fab640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc3f010eef0 0x7fc3f01a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f5fab640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f01190d0 con 0x7fc3f0109ba0 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f5fab640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f0118f50 con 0x7fc3f010eef0 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f5fab640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f0119250 con 0x7fc3f0109220 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f4fa9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc3f0109220 0x7fc3f01a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f4fa9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc3f0109220 0x7fc3f01a1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37662/0 (socket says 10.20.193.28:37662) 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f4fa9640 1 -- 10.20.193.28:0/3930609377 learned_addr learned my addr 10.20.193.28:0/3930609377 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3f57aa640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc3f010eef0 0x7fc3f01a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.016+0000 7fc3effff640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3f0109ba0 0x7fc3f01a19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.017+0000 7fc3f57aa640 1 -- 10.20.193.28:0/3930609377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc3f0109220 msgr2=0x7fc3f01a1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.017+0000 7fc3f57aa640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc3f0109220 0x7fc3f01a1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.017+0000 7fc3f57aa640 1 -- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3f0109ba0 msgr2=0x7fc3f01a19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.017+0000 7fc3f57aa640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3f0109ba0 0x7fc3f01a19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.017+0000 7fc3f57aa640 1 -- 10.20.193.28:0/3930609377 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f01a64c0 con 0x7fc3f010eef0 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.017+0000 7fc3effff640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3f0109ba0 0x7fc3f01a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.018+0000 7fc3f57aa640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc3f010eef0 0x7fc3f01a5d40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009f60 tx=0x7fc3e0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.018+0000 7fc3edffb640 1 -- 10.20.193.28:0/3930609377 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000eb30 con 0x7fc3f010eef0 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.018+0000 7fc3edffb640 1 -- 10.20.193.28:0/3930609377 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc3e000ecd0 con 0x7fc3f010eef0 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.018+0000 7fc3f5fab640 1 -- 10.20.193.28:0/3930609377 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f01a67b0 con 0x7fc3f010eef0 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.018+0000 7fc3f5fab640 1 -- 10.20.193.28:0/3930609377 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f01adff0 con 0x7fc3f010eef0 2026-02-20T03:34:55.023 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.018+0000 7fc3edffb640 1 -- 10.20.193.28:0/3930609377 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000f600 con 0x7fc3f010eef0 2026-02-20T03:34:55.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.022+0000 7fc3edffb640 1 -- 10.20.193.28:0/3930609377 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc3e0010430 con 0x7fc3f010eef0 2026-02-20T03:34:55.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.023+0000 7fc3f9739e00 1 Processor -- start 2026-02-20T03:34:55.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.023+0000 7fc3f9739e00 1 -- start start 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.023+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf667a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.023+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf60e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf6d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5631bcecfe00 con 0x5631bcf61370 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5631bcea2970 con 0x5631bcf609f0 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5631bce501f0 con 0x5631bcf663c0 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3effff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3effff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf667a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37670/0 (socket says 10.20.193.28:37670) 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3effff640 1 -- 10.20.193.28:0/884208682 learned_addr learned my addr 10.20.193.28:0/884208682 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3effff640 1 --2- 10.20.193.28:0/884208682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf6d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/884208682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf60e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3effff640 1 -- 10.20.193.28:0/884208682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 msgr2=0x5631bcf667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3effff640 1 --2- 10.20.193.28:0/884208682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf667a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3effff640 1 -- 10.20.193.28:0/884208682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 msgr2=0x5631bcf60e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3effff640 1 --2- 10.20.193.28:0/884208682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf60e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.024+0000 7fc3effff640 1 -- 10.20.193.28:0/884208682 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631bce633d0 con 0x5631bcf61370 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.025+0000 7fc3effff640 1 --2- 10.20.193.28:0/884208682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf6d1f0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009660 tx=0x7fc3dc009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a05ef24ef186239 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.025+0000 7fc3edffb640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc3d00b0da0 0x7fc3d00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.025+0000 7fc3c94e4640 1 -- 10.20.193.28:0/884208682 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0042f0 con 0x5631bcf61370 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.025+0000 7fc3c94e4640 1 -- 10.20.193.28:0/884208682 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc3dc004490 con 0x5631bcf61370 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.025+0000 7fc3c94e4640 1 -- 10.20.193.28:0/884208682 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0042f0 con 0x5631bcf61370 2026-02-20T03:34:55.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.025+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc3d00b0da0 0x7fc3d00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.026+0000 7fc3edffb640 1 -- 10.20.193.28:0/3930609377 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc3e00e1160 con 0x7fc3f010eef0 2026-02-20T03:34:55.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.026+0000 7fc3f9739e00 1 -- 10.20.193.28:0/884208682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 msgr2=0x5631bcf6d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.026+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/884208682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf6d1f0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009660 tx=0x7fc3dc009290 comp rx=0 tx=0).stop 2026-02-20T03:34:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.027+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc3d00b0da0 0x7fc3d00b3260 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4032040 tx=0x7fc3e403a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.027+0000 7fc3f9739e00 1 -- 10.20.193.28:0/884208682 shutdown_connections 2026-02-20T03:34:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.027+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/884208682 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf6d1f0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.027+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/884208682 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf60e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.027+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/884208682 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf667a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.027+0000 7fc3f9739e00 1 -- 10.20.193.28:0/884208682 >> 10.20.193.28:0/884208682 conn(0x5631bcf12240 msgr2=0x5631bcf4dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.028+0000 7fc3f9739e00 1 -- 10.20.193.28:0/884208682 shutdown_connections 2026-02-20T03:34:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.028+0000 7fc3f9739e00 1 -- 10.20.193.28:0/884208682 wait complete. 2026-02-20T03:34:55.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.029+0000 7fc3f9739e00 1 -- start start 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.029+0000 7fc3f9739e00 1 Processor -- start 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf61370 0x5631bcf7b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf797b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5631bce9e8a0 con 0x5631bcf609f0 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5631bcc90f50 con 0x5631bcf61370 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5631bcf79cf0 con 0x5631bcf663c0 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f4fa9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f4fa9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48124/0 (socket says 10.20.193.28:48124) 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f4fa9640 1 -- 10.20.193.28:0/1061291704 learned_addr learned my addr 10.20.193.28:0/1061291704 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f4fa9640 1 -- 10.20.193.28:0/1061291704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 msgr2=0x5631bcf797b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf797b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f4fa9640 1 -- 10.20.193.28:0/1061291704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf61370 msgr2=0x5631bcf7b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf61370 0x5631bcf7b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.030+0000 7fc3f4fa9640 1 -- 10.20.193.28:0/1061291704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631bcf72d90 con 0x5631bcf609f0 2026-02-20T03:34:55.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.031+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009730 tx=0x7fc3e402f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3a4dca9eace07b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.031+0000 7fc3b27fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:55.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.031+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1061291704 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4002c70 con 0x5631bcf609f0 2026-02-20T03:34:55.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.031+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1061291704 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc3e4002e10 con 0x5631bcf609f0 2026-02-20T03:34:55.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.031+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1061291704 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4038980 con 0x5631bcf609f0 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.031+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1061291704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631bcc73b40 con 0x5631bcf609f0 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.031+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1061291704 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc3e40074c0 con 0x5631bcf609f0 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.031+0000 7fc3f9739e00 10 client.21003 _ll_register_callbacks cb 0x5631bcedbeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.031+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1061291704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5631bceb0150 con 0x5631bcf609f0 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1061291704 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fc3e4007bf0 con 0x5631bcf609f0 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3f9739e00 10 client.21003 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1061291704 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=45}) -- 0x5631bce5d1e0 con 0x5631bcf609f0 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1061291704 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7fc3e4038b20 con 0x5631bcf609f0 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3f9739e00 10 client.21003 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3f9739e00 10 client.21003 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3f9739e00 20 client.21003 populate_metadata read hostname 'trial028' 2026-02-20T03:34:55.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5631bcf89a90 0x5631bcf8bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3f9739e00 4 client.21003 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:55.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.032+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1061291704 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631bceaa560 con 0x5631bcf89a90 2026-02-20T03:34:55.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.033+0000 7fc3effff640 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5631bcf89a90 0x5631bcf8bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.034+0000 7fc3effff640 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5631bcf89a90 0x5631bcf8bf20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c88597d7d35488f7 server_cookie=197405b83a776c98 in_seq=0 out_seq=0 2026-02-20T03:34:55.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.034+0000 7fc3b27fc640 10 client.21003 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:34:55.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.034+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1061291704 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5631bceaa560 con 0x5631bcf89a90 2026-02-20T03:34:55.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.034+0000 7fc3b27fc640 10 client.21003 handle_command_reply: tid=0 2026-02-20T03:34:55.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.034+0000 7fc3f9739e00 1 client.21003 shutdown 2026-02-20T03:34:55.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.035+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1061291704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 msgr2=0x5631bcf7b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.035+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009730 tx=0x7fc3e402f450 comp rx=0 tx=0).stop 2026-02-20T03:34:55.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.035+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1061291704 shutdown_connections 2026-02-20T03:34:55.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.035+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5631bcf89a90 0x5631bcf8bf20 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.035+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf797b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.035+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf61370 0x5631bcf7b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.035+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1061291704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.035+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1061291704 >> 10.20.193.28:0/1061291704 conn(0x5631bcf12240 msgr2=0x5631bcf4e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.036+0000 7fc3b27fc640 0 client.21003 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:34:55.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.036+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1061291704 shutdown_connections 2026-02-20T03:34:55.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.036+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1061291704 wait complete. 2026-02-20T03:34:55.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.036+0000 7fc3f9739e00 20 client.21003 trim_cache size 0 max 16384 2026-02-20T03:34:55.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.043+0000 7fc3f9739e00 1 Processor -- start 2026-02-20T03:34:55.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.043+0000 7fc3f9739e00 1 -- start start 2026-02-20T03:34:55.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf61370 0x5631bcf7b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf663c0 0x5631bcf76c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c012750 con 0x5631bcf609f0 2026-02-20T03:34:55.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c00ffc0 con 0x5631bcf663c0 2026-02-20T03:34:55.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c00de10 con 0x5631bcf61370 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3effff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf61370 0x5631bcf7b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3effff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf61370 0x5631bcf7b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37676/0 (socket says 10.20.193.28:37676) 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3effff640 1 -- 10.20.193.28:0/2932091120 learned_addr learned my addr 10.20.193.28:0/2932091120 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.044+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/2932091120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3effff640 1 -- 10.20.193.28:0/2932091120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf663c0 msgr2=0x5631bcf76c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3effff640 1 --2- 10.20.193.28:0/2932091120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf663c0 0x5631bcf76c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3effff640 1 -- 10.20.193.28:0/2932091120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 msgr2=0x5631bcf7b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3effff640 1 --2- 10.20.193.28:0/2932091120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3effff640 1 -- 10.20.193.28:0/2932091120 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631bcf72bc0 con 0x5631bcf61370 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/2932091120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:55.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3effff640 1 --2- 10.20.193.28:0/2932091120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf61370 0x5631bcf7b9a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc012910 tx=0x7fc3dc00d910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84c35f785a565469 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3c8ce3640 1 -- 10.20.193.28:0/2932091120 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0042f0 con 0x5631bcf61370 2026-02-20T03:34:55.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3c8ce3640 1 -- 10.20.193.28:0/2932091120 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc3dc00d980 con 0x5631bcf61370 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.045+0000 7fc3c8ce3640 1 -- 10.20.193.28:0/2932091120 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc005230 con 0x5631bcf61370 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.046+0000 7fc3f9739e00 1 -- 10.20.193.28:0/2932091120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf61370 msgr2=0x5631bcf7b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.046+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/2932091120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf61370 0x5631bcf7b9a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc012910 tx=0x7fc3dc00d910 comp rx=0 tx=0).stop 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.046+0000 7fc3f9739e00 1 -- 10.20.193.28:0/2932091120 shutdown_connections 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.046+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/2932091120 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf663c0 0x5631bcf76c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.046+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/2932091120 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf61370 0x5631bcf7b9a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.046+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/2932091120 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf609f0 0x5631bcf7b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.046+0000 7fc3f9739e00 1 -- 10.20.193.28:0/2932091120 >> 10.20.193.28:0/2932091120 conn(0x5631bcf12240 msgr2=0x5631bcf63d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.046+0000 7fc3f9739e00 1 -- 10.20.193.28:0/2932091120 shutdown_connections 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.046+0000 7fc3f9739e00 1 -- 10.20.193.28:0/2932091120 wait complete. 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f9739e00 1 -- start start 2026-02-20T03:34:55.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f9739e00 1 Processor -- start 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf811d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf81710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f9739e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf7e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c00e480 con 0x5631bcf61370 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c00f8f0 con 0x5631bcf609f0 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f9739e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc39c00eb50 con 0x5631bcf663c0 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f4fa9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf811d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f4fa9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf811d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47920/0 (socket says 10.20.193.28:47920) 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f4fa9640 1 -- 10.20.193.28:0/1930939775 learned_addr learned my addr 10.20.193.28:0/1930939775 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.047+0000 7fc3f57aa640 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf7e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.048+0000 7fc3f4fa9640 1 -- 10.20.193.28:0/1930939775 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 msgr2=0x5631bcf7e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.048+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf7e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.048+0000 7fc3f4fa9640 1 -- 10.20.193.28:0/1930939775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 msgr2=0x5631bcf81710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.048+0000 7fc3effff640 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf81710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.048+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf81710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.048+0000 7fc3f4fa9640 1 -- 10.20.193.28:0/1930939775 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631bcb81870 con 0x5631bcf609f0 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.048+0000 7fc3effff640 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf81710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.048+0000 7fc3f4fa9640 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf811d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4004240 tx=0x7fc3e4007860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a695204476ac204 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.048+0000 7fc3b27fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1930939775 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4007a50 con 0x5631bcf609f0 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1930939775 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631bce423f0 con 0x5631bcf609f0 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3f9739e00 10 client.28604 _ll_register_callbacks cb 0x7fc3dc005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:55.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1930939775 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5631bce737c0 con 0x5631bcf609f0 2026-02-20T03:34:55.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1930939775 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5631bceb0150 con 0x5631bcf609f0 2026-02-20T03:34:55.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1930939775 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4061bf0 con 0x5631bcf609f0 2026-02-20T03:34:55.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1930939775 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc3e4038630 con 0x5631bcf609f0 2026-02-20T03:34:55.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1930939775 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fc3e40388f0 con 0x5631bcf609f0 2026-02-20T03:34:55.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3f9739e00 10 client.28604 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:55.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.049+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1930939775 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x5631bcf738b0 con 0x5631bcf609f0 2026-02-20T03:34:55.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.050+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1930939775 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7fc3e4069030 con 0x5631bcf609f0 2026-02-20T03:34:55.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.050+0000 7fc3f9739e00 10 client.28604 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:55.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.050+0000 7fc3f9739e00 10 client.28604 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:34:55.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.050+0000 7fc3f9739e00 20 client.28604 populate_metadata read hostname 'trial028' 2026-02-20T03:34:55.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.050+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5631bcff5070 0x5631bcff7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.050+0000 7fc3f9739e00 4 client.28604 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:34:55.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.050+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1930939775 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631bce54ab0 con 0x5631bcff5070 2026-02-20T03:34:55.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.052+0000 7fc3effff640 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5631bcff5070 0x5631bcff7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.053+0000 7fc3effff640 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5631bcff5070 0x5631bcff7530 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=835c73e2c808b942 server_cookie=91abb05676df9d78 in_seq=0 out_seq=0 2026-02-20T03:34:55.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.053+0000 7fc3b27fc640 10 client.28604 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:34:55.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.054+0000 7fc3b27fc640 1 -- 10.20.193.28:0/1930939775 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631bce54ab0 con 0x5631bcff5070 2026-02-20T03:34:55.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.054+0000 7fc3b27fc640 10 client.28604 handle_command_reply: tid=0 2026-02-20T03:34:55.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.054+0000 7fc3f9739e00 1 client.28604 shutdown 2026-02-20T03:34:55.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.054+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1930939775 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 msgr2=0x5631bcf811d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.054+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf811d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4004240 tx=0x7fc3e4007860 comp rx=0 tx=0).stop 2026-02-20T03:34:55.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1930939775 shutdown_connections 2026-02-20T03:34:55.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5631bcff5070 0x5631bcff7530 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5631bcf663c0 0x5631bcf7e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3b27fc640 0 client.28604 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:34:55.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5631bcf61370 0x5631bcf81710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3f9739e00 1 --2- 10.20.193.28:0/1930939775 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5631bcf609f0 0x5631bcf811d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1930939775 >> 10.20.193.28:0/1930939775 conn(0x5631bcf12240 msgr2=0x5631bcf7b460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1930939775 shutdown_connections 2026-02-20T03:34:55.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3f9739e00 1 -- 10.20.193.28:0/1930939775 wait complete. 2026-02-20T03:34:55.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.055+0000 7fc3f9739e00 20 client.28604 trim_cache size 0 max 16384 2026-02-20T03:34:55.060 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:34:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 -- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc3d00b0da0 msgr2=0x7fc3d00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc3d00b0da0 0x7fc3d00b3260 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4032040 tx=0x7fc3e403a040 comp rx=0 tx=0).stop 2026-02-20T03:34:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 -- 10.20.193.28:0/3930609377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc3f010eef0 msgr2=0x7fc3f01a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc3f010eef0 0x7fc3f01a5d40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009f60 tx=0x7fc3e0009f90 comp rx=0 tx=0).stop 2026-02-20T03:34:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 -- 10.20.193.28:0/3930609377 shutdown_connections 2026-02-20T03:34:55.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc3d00b0da0 0x7fc3d00b3260 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc3f010eef0 0x7fc3f01a5d40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc3f0109ba0 0x7fc3f01a19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 --2- 10.20.193.28:0/3930609377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc3f0109220 0x7fc3f01a1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 -- 10.20.193.28:0/3930609377 >> 10.20.193.28:0/3930609377 conn(0x7fc3f0078600 msgr2=0x7fc3f0079dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.056+0000 7fc3f5fab640 1 -- 10.20.193.28:0/3930609377 shutdown_connections 2026-02-20T03:34:55.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.057+0000 7fc3f5fab640 1 -- 10.20.193.28:0/3930609377 wait complete. 2026-02-20T03:34:55.176 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:34:55.458 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:55 trial028 ceph-mon[38552]: pgmap v793: 129 pgs: 129 active+clean; 590 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 3.4 MiB/s wr, 420 op/s 2026-02-20T03:34:55.584 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:55.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 149202 17.87 MB/sec execute 266 sec latency 77.098 ms 2026-02-20T03:34:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:55 trial177 ceph-mon[43181]: pgmap v793: 129 pgs: 129 active+clean; 590 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 3.4 MiB/s wr, 420 op/s 2026-02-20T03:34:55.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.798+0000 7f375d7c2640 1 -- 10.20.193.28:0/1118958225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3758100d50 msgr2=0x7f3758101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.798+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1118958225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3758100d50 0x7f3758101130 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3744009a30 tx=0x7f374402f220 comp rx=0 tx=0).stop 2026-02-20T03:34:55.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.798+0000 7f375d7c2640 1 -- 10.20.193.28:0/1118958225 shutdown_connections 2026-02-20T03:34:55.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.798+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1118958225 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f37581069e0 0x7f3758107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.798+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1118958225 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3758101700 0x7f37581062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.798+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1118958225 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3758100d50 0x7f3758101130 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.798+0000 7f375d7c2640 1 -- 10.20.193.28:0/1118958225 >> 10.20.193.28:0/1118958225 conn(0x7f37580fca60 msgr2=0x7f37580fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.799+0000 7f375d7c2640 1 -- 10.20.193.28:0/1118958225 shutdown_connections 2026-02-20T03:34:55.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.800+0000 7f375d7c2640 1 -- 10.20.193.28:0/1118958225 wait complete. 2026-02-20T03:34:55.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f375d7c2640 1 Processor -- start 2026-02-20T03:34:55.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f375d7c2640 1 -- start start 2026-02-20T03:34:55.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f375d7c2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3758100d50 0x7f37581a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f375d7c2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3758101700 0x7f37581a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f375d7c2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37581069e0 0x7f37581a5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f375d7c2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f37581190b0 con 0x7f37581069e0 2026-02-20T03:34:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f375d7c2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3758118f30 con 0x7f3758101700 2026-02-20T03:34:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f375d7c2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3758119230 con 0x7f3758100d50 2026-02-20T03:34:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f3757fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3758100d50 0x7f37581a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f375cfc1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37581069e0 0x7f37581a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f3757fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3758100d50 0x7f37581a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:37692/0 (socket says 10.20.193.28:37692) 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.801+0000 7f3757fff640 1 -- 10.20.193.28:0/1171308400 learned_addr learned my addr 10.20.193.28:0/1171308400 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f37577fe640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3758101700 0x7f37581a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f375cfc1640 1 -- 10.20.193.28:0/1171308400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3758100d50 msgr2=0x7f37581a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f375cfc1640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3758100d50 0x7f37581a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f375cfc1640 1 -- 10.20.193.28:0/1171308400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3758101700 msgr2=0x7f37581a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f375cfc1640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3758101700 0x7f37581a1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f375cfc1640 1 -- 10.20.193.28:0/1171308400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37581a65a0 con 0x7f37581069e0 2026-02-20T03:34:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f375cfc1640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37581069e0 0x7f37581a5e20 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f374c00c370 tx=0x7f374c00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f37557fa640 1 -- 10.20.193.28:0/1171308400 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c019070 con 0x7f37581069e0 2026-02-20T03:34:55.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f37557fa640 1 -- 10.20.193.28:0/1171308400 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f374c0092d0 con 0x7f37581069e0 2026-02-20T03:34:55.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f37557fa640 1 -- 10.20.193.28:0/1171308400 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c007500 con 0x7f37581069e0 2026-02-20T03:34:55.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f375d7c2640 1 -- 10.20.193.28:0/1171308400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37581a6830 con 0x7f37581069e0 2026-02-20T03:34:55.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.802+0000 7f375d7c2640 1 -- 10.20.193.28:0/1171308400 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37581ae0d0 con 0x7f37581069e0 2026-02-20T03:34:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.806+0000 7f37557fa640 1 -- 10.20.193.28:0/1171308400 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f374c0040d0 con 0x7f37581069e0 2026-02-20T03:34:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.806+0000 7f3760f50e00 1 Processor -- start 2026-02-20T03:34:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.807+0000 7f3760f50e00 1 -- start start 2026-02-20T03:34:55.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.807+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe178bfb0 0x55afe178c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.807+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe17865e0 0x55afe1786a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.807+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe1786f60 0x55afe1792de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.807+0000 7f3760f50e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55afe1706e00 con 0x55afe1786f60 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.807+0000 7f3760f50e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55afe16d9970 con 0x55afe17865e0 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.807+0000 7f3760f50e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55afe16871f0 con 0x55afe178bfb0 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.807+0000 7f37557fa640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f372c0b0f70 0x7f372c0b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37557fa640 1 -- 10.20.193.28:0/1171308400 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f374c0e07e0 con 0x7f37581069e0 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f3757fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe17865e0 0x55afe1786a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe1786f60 0x55afe1792de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f3757fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe17865e0 0x55afe1786a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47952/0 (socket says 10.20.193.28:47952) 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe1786f60 0x55afe1792de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48172/0 (socket says 10.20.193.28:48172) 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37577fe640 1 -- 10.20.193.28:0/2632967643 learned_addr learned my addr 10.20.193.28:0/2632967643 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f375cfc1640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f372c0b0f70 0x7f372c0b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37577fe640 1 -- 10.20.193.28:0/2632967643 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe178bfb0 msgr2=0x55afe178c390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:34:55.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37577fe640 1 --2- 10.20.193.28:0/2632967643 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe178bfb0 0x55afe178c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37577fe640 1 -- 10.20.193.28:0/2632967643 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe17865e0 msgr2=0x55afe1786a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37577fe640 1 --2- 10.20.193.28:0/2632967643 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe17865e0 0x55afe1786a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37577fe640 1 -- 10.20.193.28:0/2632967643 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afe169a3d0 con 0x55afe1786f60 2026-02-20T03:34:55.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f375cfc1640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f372c0b0f70 0x7f372c0b3430 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f374c0a8450 tx=0x7f374c004470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.808+0000 7f37577fe640 1 --2- 10.20.193.28:0/2632967643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe1786f60 0x55afe1792de0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f3748004500 tx=0x7f3748009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a364b2e1c2c4c8c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.809+0000 7f3728ce3640 1 -- 10.20.193.28:0/2632967643 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748016070 con 0x55afe1786f60 2026-02-20T03:34:55.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.809+0000 7f3728ce3640 1 -- 10.20.193.28:0/2632967643 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3748002cc0 con 0x55afe1786f60 2026-02-20T03:34:55.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.809+0000 7f3728ce3640 1 -- 10.20.193.28:0/2632967643 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748010640 con 0x55afe1786f60 2026-02-20T03:34:55.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.809+0000 7f3760f50e00 1 -- 10.20.193.28:0/2632967643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe1786f60 msgr2=0x55afe1792de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.809+0000 7f3760f50e00 1 --2- 10.20.193.28:0/2632967643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe1786f60 0x55afe1792de0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f3748004500 tx=0x7f3748009b90 comp rx=0 tx=0).stop 2026-02-20T03:34:55.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.810+0000 7f3760f50e00 1 -- 10.20.193.28:0/2632967643 shutdown_connections 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.810+0000 7f3760f50e00 1 --2- 10.20.193.28:0/2632967643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe1786f60 0x55afe1792de0 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.810+0000 7f3760f50e00 1 --2- 10.20.193.28:0/2632967643 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe17865e0 0x55afe1786a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.810+0000 7f3760f50e00 1 --2- 10.20.193.28:0/2632967643 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe178bfb0 0x55afe178c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.810+0000 7f3760f50e00 1 -- 10.20.193.28:0/2632967643 >> 10.20.193.28:0/2632967643 conn(0x55afe1749240 msgr2=0x55afe1784ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.810+0000 7f3760f50e00 1 -- 10.20.193.28:0/2632967643 shutdown_connections 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.810+0000 7f3760f50e00 1 -- 10.20.193.28:0/2632967643 wait complete. 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.811+0000 7f3760f50e00 1 -- start start 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.811+0000 7f3760f50e00 1 Processor -- start 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe17a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 0x55afe17a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f3760f50e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55afe16d58a0 con 0x55afe17865e0 2026-02-20T03:34:55.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f3760f50e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55afe14c7f50 con 0x55afe178bfb0 2026-02-20T03:34:55.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f3760f50e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55afe179fb70 con 0x55afe1786f60 2026-02-20T03:34:55.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f37577fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f37577fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47966/0 (socket says 10.20.193.28:47966) 2026-02-20T03:34:55.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f37577fe640 1 -- 10.20.193.28:0/3569244540 learned_addr learned my addr 10.20.193.28:0/3569244540 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f3757fff640 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 0x55afe17a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f37577fe640 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe17a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f37577fe640 1 -- 10.20.193.28:0/3569244540 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 msgr2=0x55afe17a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f37577fe640 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 0x55afe17a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f37577fe640 1 -- 10.20.193.28:0/3569244540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 msgr2=0x55afe17a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f37577fe640 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe17a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.812+0000 7f37577fe640 1 -- 10.20.193.28:0/3569244540 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afe1798b20 con 0x55afe178bfb0 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f37577fe640 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179f3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3748002fd0 tx=0x7f3748012d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=305ae4287d07621b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3719ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3719ffb640 1 -- 10.20.193.28:0/3569244540 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748016070 con 0x55afe178bfb0 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3760f50e00 1 -- 10.20.193.28:0/3569244540 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afe14aab40 con 0x55afe178bfb0 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3760f50e00 10 client.28613 _ll_register_callbacks cb 0x55afe1712eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3760f50e00 1 -- 10.20.193.28:0/3569244540 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55afe16e7150 con 0x55afe178bfb0 2026-02-20T03:34:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3719ffb640 1 -- 10.20.193.28:0/3569244540 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3748009cd0 con 0x55afe178bfb0 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3719ffb640 1 -- 10.20.193.28:0/3569244540 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748010e70 con 0x55afe178bfb0 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3719ffb640 1 -- 10.20.193.28:0/3569244540 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f374802b450 con 0x55afe178bfb0 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3719ffb640 1 -- 10.20.193.28:0/3569244540 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f374802b710 con 0x55afe178bfb0 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3760f50e00 10 client.28613 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.813+0000 7f3760f50e00 1 -- 10.20.193.28:0/3569244540 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55afe16941e0 con 0x55afe178bfb0 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.814+0000 7f3719ffb640 1 -- 10.20.193.28:0/3569244540 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f374800f040 con 0x55afe178bfb0 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.814+0000 7f3760f50e00 10 client.28613 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.814+0000 7f3760f50e00 10 client.28613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.814+0000 7f3760f50e00 20 client.28613 populate_metadata read hostname 'trial028' 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.814+0000 7f3760f50e00 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55afe17af3b0 0x55afe17b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.814+0000 7f3760f50e00 4 client.28613 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:55.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.814+0000 7f3760f50e00 1 -- 10.20.193.28:0/3569244540 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afe16e1560 con 0x55afe17af3b0 2026-02-20T03:34:55.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.814+0000 7f3757fff640 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55afe17af3b0 0x55afe17b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.815+0000 7f3757fff640 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55afe17af3b0 0x55afe17b1870 crc :-1 s=READY pgs=517 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a46677a474da78e0 server_cookie=c6dfacf4f22cba4e in_seq=0 out_seq=0 2026-02-20T03:34:55.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.815+0000 7f3719ffb640 10 client.28613 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:55.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.815+0000 7f3719ffb640 1 -- 10.20.193.28:0/3569244540 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55afe16e1560 con 0x55afe17af3b0 2026-02-20T03:34:55.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.815+0000 7f3719ffb640 10 client.28613 handle_command_reply: tid=0 2026-02-20T03:34:55.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.815+0000 7f3760f50e00 1 client.28613 shutdown 2026-02-20T03:34:55.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 -- 10.20.193.28:0/3569244540 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 msgr2=0x55afe179f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179f3f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3748002fd0 tx=0x7f3748012d60 comp rx=0 tx=0).stop 2026-02-20T03:34:55.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 -- 10.20.193.28:0/3569244540 shutdown_connections 2026-02-20T03:34:55.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55afe17af3b0 0x55afe17b1870 crc :-1 s=READY pgs=517 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179f3f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 0x55afe17a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 --2- 10.20.193.28:0/3569244540 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe17a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 -- 10.20.193.28:0/3569244540 >> 10.20.193.28:0/3569244540 conn(0x55afe1749240 msgr2=0x55afe17853f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3719ffb640 0 client.28613 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:55.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 -- 10.20.193.28:0/3569244540 shutdown_connections 2026-02-20T03:34:55.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 1 -- 10.20.193.28:0/3569244540 wait complete. 2026-02-20T03:34:55.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.816+0000 7f3760f50e00 20 client.28613 trim_cache size 0 max 16384 2026-02-20T03:34:55.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f3760f50e00 1 Processor -- start 2026-02-20T03:34:55.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f3760f50e00 1 -- start start 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe177ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 0x55afe179e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f3760f50e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc012750 con 0x55afe17865e0 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f3760f50e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc00ffc0 con 0x55afe178bfb0 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f3760f50e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc00de10 con 0x55afe1786f60 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f37577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe177ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f37577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe177ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48188/0 (socket says 10.20.193.28:48188) 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f37577fe640 1 -- 10.20.193.28:0/1180854032 learned_addr learned my addr 10.20.193.28:0/1180854032 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f3757fff640 1 --2- 10.20.193.28:0/1180854032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 0x55afe179e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.824+0000 7f37577fe640 1 --2- 10.20.193.28:0/1180854032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f37577fe640 1 -- 10.20.193.28:0/1180854032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 msgr2=0x55afe179e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f37577fe640 1 --2- 10.20.193.28:0/1180854032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 0x55afe179e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f37577fe640 1 -- 10.20.193.28:0/1180854032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 msgr2=0x55afe179c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f37577fe640 1 --2- 10.20.193.28:0/1180854032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f37577fe640 1 -- 10.20.193.28:0/1180854032 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afe1798950 con 0x55afe17865e0 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f37577fe640 1 --2- 10.20.193.28:0/1180854032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe177ead0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f37480096f0 tx=0x7f374802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0c713e238ccb8d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f371bfff640 1 -- 10.20.193.28:0/1180854032 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748016070 con 0x55afe17865e0 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f371bfff640 1 -- 10.20.193.28:0/1180854032 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55afe16e7150 con 0x55afe17865e0 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f371bfff640 1 -- 10.20.193.28:0/1180854032 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3748012b40 con 0x55afe17865e0 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f3760f50e00 1 -- 10.20.193.28:0/1180854032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 msgr2=0x55afe177ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1180854032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe177ead0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f37480096f0 tx=0x7f374802d000 comp rx=0 tx=0).stop 2026-02-20T03:34:55.830 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f3760f50e00 1 -- 10.20.193.28:0/1180854032 shutdown_connections 2026-02-20T03:34:55.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1180854032 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe178bfb0 0x55afe179c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1180854032 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe1786f60 0x55afe179e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1180854032 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe177ead0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.825+0000 7f3760f50e00 1 -- 10.20.193.28:0/1180854032 >> 10.20.193.28:0/1180854032 conn(0x55afe1749240 msgr2=0x55afe179dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.826+0000 7f3760f50e00 1 -- 10.20.193.28:0/1180854032 shutdown_connections 2026-02-20T03:34:55.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.826+0000 7f3760f50e00 1 -- 10.20.193.28:0/1180854032 wait complete. 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.826+0000 7f3760f50e00 1 -- start start 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.826+0000 7f3760f50e00 1 Processor -- start 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe17a7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe1786f60 0x55afe17a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3760f50e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe178bfb0 0x55afe17a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3760f50e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc00e480 con 0x55afe17865e0 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3760f50e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc00f8f0 con 0x55afe1786f60 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3760f50e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc00eb50 con 0x55afe178bfb0 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3757fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe1786f60 0x55afe17a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f37577fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe17a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3757fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe1786f60 0x55afe17a3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47986/0 (socket says 10.20.193.28:47986) 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3757fff640 1 -- 10.20.193.28:0/1677253771 learned_addr learned my addr 10.20.193.28:0/1677253771 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3757fff640 1 -- 10.20.193.28:0/1677253771 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe178bfb0 msgr2=0x55afe17a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3757fff640 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe178bfb0 0x55afe17a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3757fff640 1 -- 10.20.193.28:0/1677253771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 msgr2=0x55afe17a7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3757fff640 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe17a7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3757fff640 1 -- 10.20.193.28:0/1677253771 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afe13b8870 con 0x55afe1786f60 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3757fff640 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe1786f60 0x55afe17a3b10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3744009a00 tx=0x7f374402fa80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbea576ebc7de108 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3719ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3719ffb640 1 -- 10.20.193.28:0/1677253771 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374404f020 con 0x55afe1786f60 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3719ffb640 1 -- 10.20.193.28:0/1677253771 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3744033040 con 0x55afe1786f60 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.827+0000 7f3760f50e00 1 -- 10.20.193.28:0/1677253771 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afe16793f0 con 0x55afe1786f60 2026-02-20T03:34:55.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3719ffb640 1 -- 10.20.193.28:0/1677253771 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744002940 con 0x55afe1786f60 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3719ffb640 1 -- 10.20.193.28:0/1677253771 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3744002ae0 con 0x55afe1786f60 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 10 client.28619 _ll_register_callbacks cb 0x7f3748005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 1 -- 10.20.193.28:0/1677253771 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55afe168bab0 con 0x55afe1786f60 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3719ffb640 1 -- 10.20.193.28:0/1677253771 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f3744002ce0 con 0x55afe1786f60 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 10 client.28619 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 1 -- 10.20.193.28:0/1677253771 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55afe1799640 con 0x55afe1786f60 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3719ffb640 1 -- 10.20.193.28:0/1677253771 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f37440042c0 con 0x55afe1786f60 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 10 client.28619 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 10 client.28619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 20 client.28619 populate_metadata read hostname 'trial028' 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55afe181b250 0x55afe181d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:55.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 4 client.28619 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f3760f50e00 1 -- 10.20.193.28:0/1677253771 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3748002cc0 con 0x55afe181b250 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.828+0000 7f37577fe640 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55afe181b250 0x55afe181d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f37577fe640 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55afe181b250 0x55afe181d710 crc :-1 s=READY pgs=518 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8287d308bc42ab64 server_cookie=d00a9f9112bcb8cd in_seq=0 out_seq=0 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3719ffb640 10 client.28619 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3719ffb640 1 -- 10.20.193.28:0/1677253771 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3748002cc0 con 0x55afe181b250 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3719ffb640 10 client.28619 handle_command_reply: tid=0 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 client.28619 shutdown 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 -- 10.20.193.28:0/1677253771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe1786f60 msgr2=0x55afe17a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe1786f60 0x55afe17a3b10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3744009a00 tx=0x7f374402fa80 comp rx=0 tx=0).stop 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 -- 10.20.193.28:0/1677253771 shutdown_connections 2026-02-20T03:34:55.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55afe181b250 0x55afe181d710 crc :-1 s=READY pgs=518 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55afe178bfb0 0x55afe17a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55afe1786f60 0x55afe17a3b10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 --2- 10.20.193.28:0/1677253771 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55afe17865e0 0x55afe17a7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3719ffb640 0 client.28619 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:55.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 -- 10.20.193.28:0/1677253771 >> 10.20.193.28:0/1677253771 conn(0x55afe1749240 msgr2=0x55afe179e300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.829+0000 7f3760f50e00 1 -- 10.20.193.28:0/1677253771 shutdown_connections 2026-02-20T03:34:55.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f3760f50e00 1 -- 10.20.193.28:0/1677253771 wait complete. 2026-02-20T03:34:55.838 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f3760f50e00 20 client.28619 trim_cache size 0 max 16384 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 -- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f372c0b0f70 msgr2=0x7f372c0b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f372c0b0f70 0x7f372c0b3430 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f374c0a8450 tx=0x7f374c004470 comp rx=0 tx=0).stop 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 -- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37581069e0 msgr2=0x7f37581a5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37581069e0 0x7f37581a5e20 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f374c00c370 tx=0x7f374c00c770 comp rx=0 tx=0).stop 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 -- 10.20.193.28:0/1171308400 shutdown_connections 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f372c0b0f70 0x7f372c0b3430 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f37581069e0 0x7f37581a5e20 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3758101700 0x7f37581a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 --2- 10.20.193.28:0/1171308400 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3758100d50 0x7f37581a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:55.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.830+0000 7f375d7c2640 1 -- 10.20.193.28:0/1171308400 >> 10.20.193.28:0/1171308400 conn(0x7f37580fca60 msgr2=0x7f3758104280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:55.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.831+0000 7f375d7c2640 1 -- 10.20.193.28:0/1171308400 shutdown_connections 2026-02-20T03:34:55.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:55.831+0000 7f375d7c2640 1 -- 10.20.193.28:0/1171308400 wait complete. 2026-02-20T03:34:55.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:55 trial126 ceph-mon[38476]: pgmap v793: 129 pgs: 129 active+clean; 590 MiB data, 8.1 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 3.4 MiB/s wr, 420 op/s 2026-02-20T03:34:56.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 150845 18.14 MB/sec execute 267 sec latency 48.717 ms 2026-02-20T03:34:56.935 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:34:56.936 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:34:57.262 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:57.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.510+0000 7f5261ffb640 1 -- 10.20.193.28:0/2308575271 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258038470 con 0x7f52641088d0 2026-02-20T03:34:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.511+0000 7f52698c3640 1 -- 10.20.193.28:0/2308575271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641088d0 msgr2=0x7f5264108cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.511+0000 7f52698c3640 1 --2- 10.20.193.28:0/2308575271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641088d0 0x7f5264108cb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5258009a30 tx=0x7f525802f220 comp rx=0 tx=0).stop 2026-02-20T03:34:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.511+0000 7f52698c3640 1 -- 10.20.193.28:0/2308575271 shutdown_connections 2026-02-20T03:34:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.511+0000 7f52698c3640 1 --2- 10.20.193.28:0/2308575271 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5264103270 0x7f526410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.511+0000 7f52698c3640 1 --2- 10.20.193.28:0/2308575271 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52641028d0 0x7f5264102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.511+0000 7f52698c3640 1 --2- 10.20.193.28:0/2308575271 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641088d0 0x7f5264108cb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.511+0000 7f52698c3640 1 -- 10.20.193.28:0/2308575271 >> 10.20.193.28:0/2308575271 conn(0x7f52640fe5d0 msgr2=0x7f52641009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:57.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.512+0000 7f52698c3640 1 -- 10.20.193.28:0/2308575271 shutdown_connections 2026-02-20T03:34:57.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.513+0000 7f52698c3640 1 -- 10.20.193.28:0/2308575271 wait complete. 2026-02-20T03:34:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.514+0000 7f52698c3640 1 Processor -- start 2026-02-20T03:34:57.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.514+0000 7f52698c3640 1 -- start start 2026-02-20T03:34:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.514+0000 7f52698c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641028d0 0x7f52641a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f52698c3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5264103270 0x7f52641a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f52698c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52641088d0 0x7f52641a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f52698c3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5264119310 con 0x7f52641088d0 2026-02-20T03:34:57.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f5262ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641028d0 0x7f52641a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f52698c3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5264119190 con 0x7f52641028d0 2026-02-20T03:34:57.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f52698c3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5264119490 con 0x7f5264103270 2026-02-20T03:34:57.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f5262ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641028d0 0x7f52641a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59862/0 (socket says 10.20.193.28:59862) 2026-02-20T03:34:57.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f5262ffd640 1 -- 10.20.193.28:0/2504403799 learned_addr learned my addr 10.20.193.28:0/2504403799 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:57.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f52627fc640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5264103270 0x7f52641a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.515+0000 7f52637fe640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52641088d0 0x7f52641a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.516+0000 7f5262ffd640 1 -- 10.20.193.28:0/2504403799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5264103270 msgr2=0x7f52641a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.516+0000 7f5262ffd640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5264103270 0x7f52641a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.516+0000 7f5262ffd640 1 -- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52641088d0 msgr2=0x7f52641a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.516+0000 7f5262ffd640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52641088d0 0x7f52641a5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.516+0000 7f5262ffd640 1 -- 10.20.193.28:0/2504403799 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52641a6720 con 0x7f52641028d0 2026-02-20T03:34:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.516+0000 7f52627fc640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5264103270 0x7f52641a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.516+0000 7f5262ffd640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641028d0 0x7f52641a16d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f525802f730 tx=0x7f525802fcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.517+0000 7f52688c1640 1 -- 10.20.193.28:0/2504403799 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258004240 con 0x7f52641028d0 2026-02-20T03:34:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.517+0000 7f52688c1640 1 -- 10.20.193.28:0/2504403799 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f52580043e0 con 0x7f52641028d0 2026-02-20T03:34:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.517+0000 7f52688c1640 1 -- 10.20.193.28:0/2504403799 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258042820 con 0x7f52641028d0 2026-02-20T03:34:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.517+0000 7f52698c3640 1 -- 10.20.193.28:0/2504403799 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52641a69b0 con 0x7f52641028d0 2026-02-20T03:34:57.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.517+0000 7f52698c3640 1 -- 10.20.193.28:0/2504403799 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52641ae250 con 0x7f52641028d0 2026-02-20T03:34:57.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.523+0000 7f52688c1640 1 -- 10.20.193.28:0/2504403799 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5258038770 con 0x7f52641028d0 2026-02-20T03:34:57.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.525+0000 7f526bdc8e00 1 Processor -- start 2026-02-20T03:34:57.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.525+0000 7f526bdc8e00 1 -- start start 2026-02-20T03:34:57.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.525+0000 7f52688c1640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52380b0ea0 0x7f52380b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.526+0000 7f52688c1640 1 -- 10.20.193.28:0/2504403799 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5258104f80 con 0x7f52641028d0 2026-02-20T03:34:57.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.526+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa33a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.526+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa2f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.527+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa3b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.527+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e08f981c00 con 0x55e08fa33630 2026-02-20T03:34:57.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.527+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e08f92f3c0 con 0x55e08fa2eee0 2026-02-20T03:34:57.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.527+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e08f97db30 con 0x55e08fa2f8a0 2026-02-20T03:34:57.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.527+0000 7f52627fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa2f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.527+0000 7f52637fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa3b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.527+0000 7f52637fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa3b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54922/0 (socket says 10.20.193.28:54922) 2026-02-20T03:34:57.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.527+0000 7f52637fe640 1 -- 10.20.193.28:0/820195754 learned_addr learned my addr 10.20.193.28:0/820195754 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:57.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.527+0000 7f5262ffd640 1 --2- 10.20.193.28:0/820195754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa33a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.528+0000 7f52637fe640 1 -- 10.20.193.28:0/820195754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 msgr2=0x55e08fa2f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:57.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.528+0000 7f52637fe640 1 --2- 10.20.193.28:0/820195754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa2f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.529+0000 7f52637fe640 1 -- 10.20.193.28:0/820195754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 msgr2=0x55e08fa33a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:57.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.529+0000 7f52637fe640 1 --2- 10.20.193.28:0/820195754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa33a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.529+0000 7f52637fe640 1 -- 10.20.193.28:0/820195754 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e08f928840 con 0x55e08fa2f8a0 2026-02-20T03:34:57.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.529+0000 7f5262ffd640 1 --2- 10.20.193.28:0/820195754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa33a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:57.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.529+0000 7f52637fe640 1 --2- 10.20.193.28:0/820195754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa3b5c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5254003ed0 tx=0x7f5254009d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfce7dc41c0eba3d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:57.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.529+0000 7f5227fff640 1 -- 10.20.193.28:0/820195754 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525401d070 con 0x55e08fa2f8a0 2026-02-20T03:34:57.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.530+0000 7f5227fff640 1 -- 10.20.193.28:0/820195754 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5254007500 con 0x55e08fa2f8a0 2026-02-20T03:34:57.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.530+0000 7f5227fff640 1 -- 10.20.193.28:0/820195754 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540155c0 con 0x55e08fa2f8a0 2026-02-20T03:34:57.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.530+0000 7f526bdc8e00 1 -- 10.20.193.28:0/820195754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 msgr2=0x55e08fa3b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:57.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.530+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/820195754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa3b5c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5254003ed0 tx=0x7f5254009d10 comp rx=0 tx=0).stop 2026-02-20T03:34:57.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.530+0000 7f52637fe640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52380b0ea0 0x7f52380b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.531+0000 7f526bdc8e00 1 -- 10.20.193.28:0/820195754 shutdown_connections 2026-02-20T03:34:57.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.531+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/820195754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa3b5c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.531+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/820195754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa2f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.531+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/820195754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa33a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.531+0000 7f526bdc8e00 1 -- 10.20.193.28:0/820195754 >> 10.20.193.28:0/820195754 conn(0x55e08fa27aa0 msgr2=0x55e08fa2d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:57.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.531+0000 7f526bdc8e00 1 -- 10.20.193.28:0/820195754 shutdown_connections 2026-02-20T03:34:57.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.531+0000 7f526bdc8e00 1 -- 10.20.193.28:0/820195754 wait complete. 2026-02-20T03:34:57.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.532+0000 7f52637fe640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52380b0ea0 0x7f52380b3360 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5254007dc0 tx=0x7f5254019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:57.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.532+0000 7f526bdc8e00 1 -- start start 2026-02-20T03:34:57.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.532+0000 7f526bdc8e00 1 Processor -- start 2026-02-20T03:34:57.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa492e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa49820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa47a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e08f9291a0 con 0x55e08fa33630 2026-02-20T03:34:57.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e08fa3bcc0 con 0x55e08fa2eee0 2026-02-20T03:34:57.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e08fa481a0 con 0x55e08fa2f8a0 2026-02-20T03:34:57.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f5262ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f5262ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59890/0 (socket says 10.20.193.28:59890) 2026-02-20T03:34:57.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f5262ffd640 1 -- 10.20.193.28:0/876420275 learned_addr learned my addr 10.20.193.28:0/876420275 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:57.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f52627fc640 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa49820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.533+0000 7f52637fe640 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa47a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.534+0000 7f5262ffd640 1 -- 10.20.193.28:0/876420275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 msgr2=0x55e08fa49820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:57.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.534+0000 7f5262ffd640 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa49820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.534+0000 7f5262ffd640 1 -- 10.20.193.28:0/876420275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 msgr2=0x55e08fa47a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:57.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.534+0000 7f5262ffd640 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa47a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.534+0000 7f5262ffd640 1 -- 10.20.193.28:0/876420275 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e08fa41430 con 0x55e08fa2eee0 2026-02-20T03:34:57.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.534+0000 7f52637fe640 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa47a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:57.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.534+0000 7f52627fc640 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa49820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:57.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.535+0000 7f5262ffd640 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa492e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52581025f0 tx=0x7f52580cc8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7dcdf3bcc175732 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:57.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.535+0000 7f52257fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:57.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.535+0000 7f52257fa640 1 -- 10.20.193.28:0/876420275 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52580cca30 con 0x55e08fa2eee0 2026-02-20T03:34:57.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.535+0000 7f52257fa640 1 -- 10.20.193.28:0/876420275 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5258033070 con 0x55e08fa2eee0 2026-02-20T03:34:57.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.535+0000 7f52257fa640 1 -- 10.20.193.28:0/876420275 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52580cc180 con 0x55e08fa2eee0 2026-02-20T03:34:57.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.535+0000 7f526bdc8e00 1 -- 10.20.193.28:0/876420275 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e08f750b60 con 0x55e08fa2eee0 2026-02-20T03:34:57.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.535+0000 7f52257fa640 1 -- 10.20.193.28:0/876420275 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f52580f31c0 con 0x55e08fa2eee0 2026-02-20T03:34:57.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.535+0000 7f52257fa640 10 client.28631 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:34:57.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.535+0000 7f526bdc8e00 10 client.28631 _ll_register_callbacks cb 0x55e08f92d0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:57.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f526bdc8e00 1 -- 10.20.193.28:0/876420275 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e08f9897f0 con 0x55e08fa2eee0 2026-02-20T03:34:57.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f52257fa640 1 -- 10.20.193.28:0/876420275 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f52580cc360 con 0x55e08fa2eee0 2026-02-20T03:34:57.538 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f526bdc8e00 10 client.28631 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:57.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f526bdc8e00 1 -- 10.20.193.28:0/876420275 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55e08f94e430 con 0x55e08fa2eee0 2026-02-20T03:34:57.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f52257fa640 1 -- 10.20.193.28:0/876420275 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f52580d3210 con 0x55e08fa2eee0 2026-02-20T03:34:57.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f526bdc8e00 10 client.28631 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:57.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f526bdc8e00 10 client.28631 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:57.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f526bdc8e00 20 client.28631 populate_metadata read hostname 'trial028' 2026-02-20T03:34:57.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e08fa68d20 0x55e08fa6b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f526bdc8e00 4 client.28631 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:57.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.536+0000 7f526bdc8e00 1 -- 10.20.193.28:0/876420275 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e08f903c00 con 0x55e08fa68d20 2026-02-20T03:34:57.539 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.537+0000 7f52627fc640 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e08fa68d20 0x55e08fa6b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.537+0000 7f52627fc640 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e08fa68d20 0x55e08fa6b1e0 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f953eaef037e07f8 server_cookie=ada68df16cca5b9f in_seq=0 out_seq=0 2026-02-20T03:34:57.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.537+0000 7f52257fa640 10 client.28631 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:57.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f52257fa640 1 -- 10.20.193.28:0/876420275 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e08f903c00 con 0x55e08fa68d20 2026-02-20T03:34:57.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f52257fa640 10 client.28631 handle_command_reply: tid=0 2026-02-20T03:34:57.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 client.28631 shutdown 2026-02-20T03:34:57.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 -- 10.20.193.28:0/876420275 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 msgr2=0x55e08fa492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:57.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa492e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f52581025f0 tx=0x7f52580cc8a0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.541 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 -- 10.20.193.28:0/876420275 shutdown_connections 2026-02-20T03:34:57.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e08fa68d20 0x55e08fa6b1e0 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08fa47a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa49820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.542 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/876420275 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa492e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 -- 10.20.193.28:0/876420275 >> 10.20.193.28:0/876420275 conn(0x55e08fa27aa0 msgr2=0x55e08fa32310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:57.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f52257fa640 0 client.28631 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:57.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 -- 10.20.193.28:0/876420275 shutdown_connections 2026-02-20T03:34:57.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.538+0000 7f526bdc8e00 1 -- 10.20.193.28:0/876420275 wait complete. 2026-02-20T03:34:57.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.539+0000 7f526bdc8e00 20 client.28631 trim_cache size 0 max 16384 2026-02-20T03:34:57.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f526bdc8e00 1 Processor -- start 2026-02-20T03:34:57.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f526bdc8e00 1 -- start start 2026-02-20T03:34:57.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2eee0 0x55e08fa462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa2f8a0 0x55e08fa46800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa33630 0x55e08fa70af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f5262ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2eee0 0x55e08fa462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f52627fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa2f8a0 0x55e08fa46800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f52040126a0 con 0x55e08fa2f8a0 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f5262ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2eee0 0x55e08fa462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54944/0 (socket says 10.20.193.28:54944) 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f5262ffd640 1 -- 10.20.193.28:0/424561152 learned_addr learned my addr 10.20.193.28:0/424561152 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f526bdc8e00 1 -- 10.20.193.28:0/424561152 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f520400ff10 con 0x55e08fa33630 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.548+0000 7f526bdc8e00 1 -- 10.20.193.28:0/424561152 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f520400dd60 con 0x55e08fa2eee0 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52637fe640 1 --2- 10.20.193.28:0/424561152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa33630 0x55e08fa70af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52627fc640 1 -- 10.20.193.28:0/424561152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2eee0 msgr2=0x55e08fa462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52627fc640 1 --2- 10.20.193.28:0/424561152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2eee0 0x55e08fa462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52627fc640 1 -- 10.20.193.28:0/424561152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa33630 msgr2=0x55e08fa70af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52627fc640 1 --2- 10.20.193.28:0/424561152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa33630 0x55e08fa70af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52627fc640 1 -- 10.20.193.28:0/424561152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e08fa41260 con 0x55e08fa2f8a0 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52637fe640 1 --2- 10.20.193.28:0/424561152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa33630 0x55e08fa70af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:34:57.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52627fc640 1 --2- 10.20.193.28:0/424561152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa2f8a0 0x55e08fa46800 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x55e08fa6ba90 tx=0x7f524c011040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f6797fb96c59a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52277fe640 1 -- 10.20.193.28:0/424561152 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0029a0 con 0x55e08fa2f8a0 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.549+0000 7f52277fe640 1 -- 10.20.193.28:0/424561152 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e08f903c00 con 0x55e08fa2f8a0 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f52277fe640 1 -- 10.20.193.28:0/424561152 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c01c400 con 0x55e08fa2f8a0 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f526bdc8e00 1 -- 10.20.193.28:0/424561152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa2f8a0 msgr2=0x55e08fa46800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/424561152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa2f8a0 0x55e08fa46800 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x55e08fa6ba90 tx=0x7f524c011040 comp rx=0 tx=0).stop 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f526bdc8e00 1 -- 10.20.193.28:0/424561152 shutdown_connections 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/424561152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa33630 0x55e08fa70af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/424561152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa2f8a0 0x55e08fa46800 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/424561152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2eee0 0x55e08fa462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f526bdc8e00 1 -- 10.20.193.28:0/424561152 >> 10.20.193.28:0/424561152 conn(0x55e08fa27aa0 msgr2=0x55e08fa2cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f526bdc8e00 1 -- 10.20.193.28:0/424561152 shutdown_connections 2026-02-20T03:34:57.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.550+0000 7f526bdc8e00 1 -- 10.20.193.28:0/424561152 wait complete. 2026-02-20T03:34:57.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.551+0000 7f526bdc8e00 1 -- start start 2026-02-20T03:34:57.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.551+0000 7f526bdc8e00 1 Processor -- start 2026-02-20T03:34:57.554 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.551+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa4c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.552+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa4cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.552+0000 7f526bdc8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08facdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.553+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f520400e3d0 con 0x55e08fa33630 2026-02-20T03:34:57.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.553+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f520400f840 con 0x55e08fa2eee0 2026-02-20T03:34:57.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.553+0000 7f526bdc8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f520400eaa0 con 0x55e08fa2f8a0 2026-02-20T03:34:57.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.553+0000 7f5262ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa4c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.553+0000 7f52627fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa4cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.553+0000 7f5262ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa4c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59910/0 (socket says 10.20.193.28:59910) 2026-02-20T03:34:57.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.553+0000 7f52627fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa4cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54946/0 (socket says 10.20.193.28:54946) 2026-02-20T03:34:57.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.553+0000 7f5262ffd640 1 -- 10.20.193.28:0/2776372417 learned_addr learned my addr 10.20.193.28:0/2776372417 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:57.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.553+0000 7f52637fe640 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08facdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.554+0000 7f5262ffd640 1 -- 10.20.193.28:0/2776372417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 msgr2=0x55e08fa4cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.554+0000 7f5262ffd640 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa4cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.554+0000 7f5262ffd640 1 -- 10.20.193.28:0/2776372417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 msgr2=0x55e08facdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.554+0000 7f5262ffd640 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08facdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.554+0000 7f5262ffd640 1 -- 10.20.193.28:0/2776372417 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e08f660900 con 0x55e08fa2eee0 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.554+0000 7f52637fe640 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08facdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.555+0000 7f52627fc640 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa4cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.555+0000 7f5262ffd640 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa4c870 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5258002b70 tx=0x7f52580cdf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b52c5fa793c923f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.555+0000 7f52257fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.555+0000 7f52257fa640 1 -- 10.20.193.28:0/2776372417 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52580cc180 con 0x55e08fa2eee0 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.555+0000 7f52257fa640 1 -- 10.20.193.28:0/2776372417 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5258033040 con 0x55e08fa2eee0 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.555+0000 7f52257fa640 1 -- 10.20.193.28:0/2776372417 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52580cca30 con 0x55e08fa2eee0 2026-02-20T03:34:57.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.555+0000 7f526bdc8e00 1 -- 10.20.193.28:0/2776372417 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e08f93c4d0 con 0x55e08fa2eee0 2026-02-20T03:34:57.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.555+0000 7f52257fa640 1 -- 10.20.193.28:0/2776372417 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f52580ef0b0 con 0x55e08fa2eee0 2026-02-20T03:34:57.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.555+0000 7f52257fa640 10 client.28634 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:34:57.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.556+0000 7f526bdc8e00 10 client.28634 _ll_register_callbacks cb 0x7f5258009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:57.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.556+0000 7f526bdc8e00 1 -- 10.20.193.28:0/2776372417 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5254007500 con 0x55e08fa2eee0 2026-02-20T03:34:57.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.556+0000 7f52257fa640 1 -- 10.20.193.28:0/2776372417 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f52580cd360 con 0x55e08fa2eee0 2026-02-20T03:34:57.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f526bdc8e00 10 client.28634 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:57.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f526bdc8e00 1 -- 10.20.193.28:0/2776372417 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x55e08fa41f50 con 0x55e08fa2eee0 2026-02-20T03:34:57.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f52257fa640 1 -- 10.20.193.28:0/2776372417 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f52580ef2b0 con 0x55e08fa2eee0 2026-02-20T03:34:57.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f526bdc8e00 10 client.28634 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:57.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f526bdc8e00 10 client.28634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:57.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f526bdc8e00 20 client.28634 populate_metadata read hostname 'trial028' 2026-02-20T03:34:57.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e08fad5360 0x55e08fad77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:57.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f526bdc8e00 4 client.28634 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:34:57.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f526bdc8e00 1 -- 10.20.193.28:0/2776372417 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e08f6f1a20 con 0x55e08fad5360 2026-02-20T03:34:57.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.557+0000 7f52627fc640 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e08fad5360 0x55e08fad77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:57.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.558+0000 7f52627fc640 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e08fad5360 0x55e08fad77f0 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfd93fc5e0723756 server_cookie=6743e02c95574488 in_seq=0 out_seq=0 2026-02-20T03:34:57.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.558+0000 7f52257fa640 10 client.28634 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:57.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f52257fa640 1 -- 10.20.193.28:0/2776372417 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e08f6f1a20 con 0x55e08fad5360 2026-02-20T03:34:57.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f52257fa640 10 client.28634 handle_command_reply: tid=0 2026-02-20T03:34:57.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 client.28634 shutdown 2026-02-20T03:34:57.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 -- 10.20.193.28:0/2776372417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 msgr2=0x55e08fa4c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:57.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa4c870 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5258002b70 tx=0x7f52580cdf90 comp rx=0 tx=0).stop 2026-02-20T03:34:57.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 -- 10.20.193.28:0/2776372417 shutdown_connections 2026-02-20T03:34:57.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e08fad5360 0x55e08fad77f0 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e08fa33630 0x55e08facdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e08fa2f8a0 0x55e08fa4cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 --2- 10.20.193.28:0/2776372417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e08fa2eee0 0x55e08fa4c870 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 -- 10.20.193.28:0/2776372417 >> 10.20.193.28:0/2776372417 conn(0x55e08fa27aa0 msgr2=0x55e08fa46720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:57.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f52257fa640 0 client.28634 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:57.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.559+0000 7f526bdc8e00 1 -- 10.20.193.28:0/2776372417 shutdown_connections 2026-02-20T03:34:57.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f526bdc8e00 1 -- 10.20.193.28:0/2776372417 wait complete. 2026-02-20T03:34:57.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f526bdc8e00 20 client.28634 trim_cache size 0 max 16384 2026-02-20T03:34:57.563 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:34:57.563 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:34:57.563 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "b248d6fb-bf43-4991-b8d8-4f89710384ff", 2026-02-20T03:34:57.563 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:34:57.563 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 -- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52380b0ea0 msgr2=0x7f52380b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52380b0ea0 0x7f52380b3360 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5254007dc0 tx=0x7f5254019040 comp rx=0 tx=0).stop 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 -- 10.20.193.28:0/2504403799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641028d0 msgr2=0x7f52641a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641028d0 0x7f52641a16d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f525802f730 tx=0x7f525802fcb0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 -- 10.20.193.28:0/2504403799 shutdown_connections 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f52380b0ea0 0x7f52380b3360 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f52641088d0 0x7f52641a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5264103270 0x7f52641a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 --2- 10.20.193.28:0/2504403799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f52641028d0 0x7f52641a16d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.560+0000 7f52698c3640 1 -- 10.20.193.28:0/2504403799 >> 10.20.193.28:0/2504403799 conn(0x7f52640fe5d0 msgr2=0x7f5264100010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.561+0000 7f52698c3640 1 -- 10.20.193.28:0/2504403799 shutdown_connections 2026-02-20T03:34:57.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:57.561+0000 7f52698c3640 1 -- 10.20.193.28:0/2504403799 wait complete. 2026-02-20T03:34:57.576 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:57 trial028 ceph-mon[38552]: pgmap v794: 129 pgs: 129 active+clean; 608 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 5.3 MiB/s wr, 638 op/s 2026-02-20T03:34:57.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 151979 18.30 MB/sec execute 268 sec latency 86.894 ms 2026-02-20T03:34:57.751 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:34:57.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:57 trial126 ceph-mon[38476]: pgmap v794: 129 pgs: 129 active+clean; 608 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 5.3 MiB/s wr, 638 op/s 2026-02-20T03:34:57.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:57 trial177 ceph-mon[43181]: pgmap v794: 129 pgs: 129 active+clean; 608 MiB data, 8.3 GiB used, 8.2 TiB / 8.2 TiB avail; 17 MiB/s rd, 5.3 MiB/s wr, 638 op/s 2026-02-20T03:34:58.053 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:34:58.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.274+0000 7f8fdb3de640 1 -- 10.20.193.28:0/546449453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8fd4074380 msgr2=0x7f8fd4074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:58.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.274+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/546449453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8fd4074380 0x7f8fd4074760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009a30 tx=0x7f8fc402f220 comp rx=0 tx=0).stop 2026-02-20T03:34:58.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.274+0000 7f8fdb3de640 1 -- 10.20.193.28:0/546449453 shutdown_connections 2026-02-20T03:34:58.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.274+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/546449453 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd410c300 0x7f8fd410ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.274+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/546449453 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8fd4074d30 0x7f8fd410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.274+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/546449453 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8fd4074380 0x7f8fd4074760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.274+0000 7f8fdb3de640 1 -- 10.20.193.28:0/546449453 >> 10.20.193.28:0/546449453 conn(0x7f8fd406ead0 msgr2=0x7f8fd406eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:58.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.274+0000 7f8fdb3de640 1 -- 10.20.193.28:0/546449453 shutdown_connections 2026-02-20T03:34:58.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.274+0000 7f8fdb3de640 1 -- 10.20.193.28:0/546449453 wait complete. 2026-02-20T03:34:58.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.275+0000 7f8fdb3de640 1 Processor -- start 2026-02-20T03:34:58.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.275+0000 7f8fdb3de640 1 -- start start 2026-02-20T03:34:58.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.275+0000 7f8fdb3de640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8fd4074380 0x7f8fd41aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.275+0000 7f8fdb3de640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd4074d30 0x7f8fd41aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.275+0000 7f8fdb3de640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8fd410c300 0x7f8fd41ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.275+0000 7f8fdb3de640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd4121bf0 con 0x7f8fd4074d30 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.275+0000 7f8fdb3de640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd4121a70 con 0x7f8fd410c300 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.275+0000 7f8fdb3de640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd4121d70 con 0x7f8fd4074380 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.276+0000 7f8fda3dc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8fd4074380 0x7f8fd41aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.276+0000 7f8fdabdd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8fd410c300 0x7f8fd41ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.276+0000 7f8fda3dc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8fd4074380 0x7f8fd41aa010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54966/0 (socket says 10.20.193.28:54966) 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.276+0000 7f8fda3dc640 1 -- 10.20.193.28:0/2570359190 learned_addr learned my addr 10.20.193.28:0/2570359190 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.276+0000 7f8fd9bdb640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd4074d30 0x7f8fd41aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.276+0000 7f8fda3dc640 1 -- 10.20.193.28:0/2570359190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8fd410c300 msgr2=0x7f8fd41ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.276+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8fd410c300 0x7f8fd41ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.276+0000 7f8fda3dc640 1 -- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd4074d30 msgr2=0x7f8fd41aa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:58.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.277+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd4074d30 0x7f8fd41aa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.277+0000 7f8fda3dc640 1 -- 10.20.193.28:0/2570359190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd41af060 con 0x7f8fd4074380 2026-02-20T03:34:58.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.277+0000 7f8fd9bdb640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd4074d30 0x7f8fd41aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:58.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.277+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8fd4074380 0x7f8fd41aa010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4005ec0 tx=0x7f8fc4004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:58.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.278+0000 7f8fc37fe640 1 -- 10.20.193.28:0/2570359190 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4005020 con 0x7f8fd4074380 2026-02-20T03:34:58.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.278+0000 7f8fc37fe640 1 -- 10.20.193.28:0/2570359190 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8fc4005660 con 0x7f8fd4074380 2026-02-20T03:34:58.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.278+0000 7f8fc37fe640 1 -- 10.20.193.28:0/2570359190 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4038aa0 con 0x7f8fd4074380 2026-02-20T03:34:58.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.278+0000 7f8fdb3de640 1 -- 10.20.193.28:0/2570359190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd41af2f0 con 0x7f8fd4074380 2026-02-20T03:34:58.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.278+0000 7f8fdb3de640 1 -- 10.20.193.28:0/2570359190 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd41b6b90 con 0x7f8fd4074380 2026-02-20T03:34:58.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.283+0000 7f8fdeb6ce00 1 Processor -- start 2026-02-20T03:34:58.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.283+0000 7f8fdeb6ce00 1 -- start start 2026-02-20T03:34:58.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.283+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.283+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bb630 0x5583625bba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.283+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bbfb0 0x5583625c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.283+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55836253be50 con 0x5583625bbfb0 2026-02-20T03:34:58.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.283+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55836250e9c0 con 0x5583625c1000 2026-02-20T03:34:58.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.283+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5583624bc240 con 0x5583625bb630 2026-02-20T03:34:58.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.284+0000 7f8fdabdd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.284+0000 7f8fdabdd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59942/0 (socket says 10.20.193.28:59942) 2026-02-20T03:34:58.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.284+0000 7f8fdabdd640 1 -- 10.20.193.28:0/1178913680 learned_addr learned my addr 10.20.193.28:0/1178913680 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:58.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.284+0000 7f8fdabdd640 1 -- 10.20.193.28:0/1178913680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bb630 msgr2=0x5583625bba70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:34:58.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.284+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/1178913680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bb630 0x5583625bba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.284+0000 7f8fdabdd640 1 -- 10.20.193.28:0/1178913680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bbfb0 msgr2=0x5583625c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:58.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.284+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/1178913680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bbfb0 0x5583625c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.284+0000 7f8fdabdd640 1 -- 10.20.193.28:0/1178913680 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583624cf420 con 0x5583625c1000 2026-02-20T03:34:58.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.285+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/1178913680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625c13e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009500 tx=0x7f8fd0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6ae19ffe5ec1b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:58.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.285+0000 7f8fc0cf3640 1 -- 10.20.193.28:0/1178913680 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0004110 con 0x5583625c1000 2026-02-20T03:34:58.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.285+0000 7f8fc0cf3640 1 -- 10.20.193.28:0/1178913680 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8fd0004750 con 0x5583625c1000 2026-02-20T03:34:58.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.285+0000 7f8fc0cf3640 1 -- 10.20.193.28:0/1178913680 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0015c70 con 0x5583625c1000 2026-02-20T03:34:58.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.285+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1178913680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 msgr2=0x5583625c13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:58.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.285+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/1178913680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625c13e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009500 tx=0x7f8fd0009920 comp rx=0 tx=0).stop 2026-02-20T03:34:58.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.287+0000 7f8fc37fe640 1 -- 10.20.193.28:0/2570359190 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8fc4004a70 con 0x7f8fd4074380 2026-02-20T03:34:58.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.288+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1178913680 shutdown_connections 2026-02-20T03:34:58.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.288+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/1178913680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bbfb0 0x5583625c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.288+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/1178913680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bb630 0x5583625bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.288+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/1178913680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625c13e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.288+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1178913680 >> 10.20.193.28:0/1178913680 conn(0x55836257e290 msgr2=0x5583625b9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:58.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.289+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1178913680 shutdown_connections 2026-02-20T03:34:58.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.289+0000 7f8fc37fe640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8fa80b0ed0 0x7f8fa80b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.289+0000 7f8fc37fe640 1 -- 10.20.193.28:0/2570359190 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8fc4104dd0 con 0x7f8fd4074380 2026-02-20T03:34:58.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.289+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1178913680 wait complete. 2026-02-20T03:34:58.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.290+0000 7f8fd9bdb640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8fa80b0ed0 0x7f8fa80b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.290+0000 7f8fdeb6ce00 1 -- start start 2026-02-20T03:34:58.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.290+0000 7f8fdeb6ce00 1 Processor -- start 2026-02-20T03:34:58.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 0x5583625d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625c1000 0x5583625d4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55836250a8f0 con 0x5583625c1000 2026-02-20T03:34:58.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5583622fcf50 con 0x5583625bb630 2026-02-20T03:34:58.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5583625d4980 con 0x5583625bbfb0 2026-02-20T03:34:58.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fdabdd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625c1000 0x5583625d4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fda3dc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fdabdd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625c1000 0x5583625d4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:49108/0 (socket says 10.20.193.28:49108) 2026-02-20T03:34:58.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fdabdd640 1 -- 10.20.193.28:0/2611521368 learned_addr learned my addr 10.20.193.28:0/2611521368 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:58.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.293+0000 7f8fd9bdb640 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 0x5583625d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.294+0000 7f8fdabdd640 1 -- 10.20.193.28:0/2611521368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 msgr2=0x5583625d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:58.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.294+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 0x5583625d6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.294+0000 7f8fdabdd640 1 -- 10.20.193.28:0/2611521368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 msgr2=0x5583625d5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:58.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.294+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.294+0000 7f8fdabdd640 1 -- 10.20.193.28:0/2611521368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583625cdb20 con 0x5583625c1000 2026-02-20T03:34:58.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.295+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625c1000 0x5583625d4310 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00159c0 tx=0x7f8fd0016cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b820339fb3e07d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:58.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.295+0000 7f8f87fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:34:58.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.295+0000 7f8f87fff640 1 -- 10.20.193.28:0/2611521368 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0023070 con 0x5583625c1000 2026-02-20T03:34:58.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.295+0000 7f8f87fff640 1 -- 10.20.193.28:0/2611521368 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8fd0028460 con 0x5583625c1000 2026-02-20T03:34:58.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.295+0000 7f8f87fff640 1 -- 10.20.193.28:0/2611521368 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00045b0 con 0x5583625c1000 2026-02-20T03:34:58.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.295+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/2611521368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583622dfb40 con 0x5583625c1000 2026-02-20T03:34:58.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.295+0000 7f8fdeb6ce00 10 client.21045 _ll_register_callbacks cb 0x558362547f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:58.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.295+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/2611521368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55836251c1a0 con 0x5583625c1000 2026-02-20T03:34:58.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.295+0000 7f8f87fff640 1 -- 10.20.193.28:0/2611521368 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8fd0004110 con 0x5583625c1000 2026-02-20T03:34:58.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.297+0000 7f8f87fff640 1 -- 10.20.193.28:0/2611521368 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8fd00043b0 con 0x5583625c1000 2026-02-20T03:34:58.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.297+0000 7f8fdeb6ce00 10 client.21045 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:58.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.297+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/2611521368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=45}) -- 0x5583624c9230 con 0x5583625c1000 2026-02-20T03:34:58.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.297+0000 7f8fd9bdb640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8fa80b0ed0 0x7f8fa80b3390 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8fd410cff0 tx=0x7f8fc80047c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:58.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.299+0000 7f8f87fff640 1 -- 10.20.193.28:0/2611521368 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f8fd0028610 con 0x5583625c1000 2026-02-20T03:34:58.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.299+0000 7f8fdeb6ce00 10 client.21045 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:58.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.299+0000 7f8fdeb6ce00 10 client.21045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:58.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.299+0000 7f8fdeb6ce00 20 client.21045 populate_metadata read hostname 'trial028' 2026-02-20T03:34:58.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.299+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583625e4310 0x5583625e6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.299+0000 7f8fdeb6ce00 4 client.21045 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:34:58.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.299+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/2611521368 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583625165b0 con 0x5583625e4310 2026-02-20T03:34:58.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.299+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583625e4310 0x5583625e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.300+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583625e4310 0x5583625e6700 crc :-1 s=READY pgs=521 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a0030d09d0a7255 server_cookie=d9af18e3065cca65 in_seq=0 out_seq=0 2026-02-20T03:34:58.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.300+0000 7f8f87fff640 10 client.21045 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.301+0000 7f8f87fff640 1 -- 10.20.193.28:0/2611521368 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5583625165b0 con 0x5583625e4310 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.301+0000 7f8f87fff640 10 client.21045 handle_command_reply: tid=0 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.301+0000 7f8fdeb6ce00 1 client.21045 shutdown 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.301+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/2611521368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625c1000 msgr2=0x5583625d4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.301+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625c1000 0x5583625d4310 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00159c0 tx=0x7f8fd0016cd0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/2611521368 shutdown_connections 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5583625e4310 0x5583625e6700 crc :-1 s=READY pgs=521 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8f87fff640 0 client.21045 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625c1000 0x5583625d4310 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 0x5583625d6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/2611521368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/2611521368 >> 10.20.193.28:0/2611521368 conn(0x55836257e290 msgr2=0x5583625ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:58.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/2611521368 shutdown_connections 2026-02-20T03:34:58.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/2611521368 wait complete. 2026-02-20T03:34:58.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.302+0000 7f8fdeb6ce00 20 client.21045 trim_cache size 0 max 16384 2026-02-20T03:34:58.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.314+0000 7f8fdeb6ce00 1 Processor -- start 2026-02-20T03:34:58.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.315+0000 7f8fdeb6ce00 1 -- start start 2026-02-20T03:34:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.315+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bb630 0x5583625beb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.315+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 0x5583625d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.315+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.315+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78012820 con 0x5583625bb630 2026-02-20T03:34:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.315+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f78010090 con 0x5583625c1000 2026-02-20T03:34:58.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.315+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7800dee0 con 0x5583625bbfb0 2026-02-20T03:34:58.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.315+0000 7f8fd9bdb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 0x5583625d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.315+0000 7f8fdabdd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fdabdd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59966/0 (socket says 10.20.193.28:59966) 2026-02-20T03:34:58.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fdabdd640 1 -- 10.20.193.28:0/1021355080 learned_addr learned my addr 10.20.193.28:0/1021355080 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:58.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/1021355080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bb630 0x5583625beb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fd9bdb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 0x5583625d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:54980/0 (socket says 10.20.193.28:54980) 2026-02-20T03:34:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fdabdd640 1 -- 10.20.193.28:0/1021355080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 msgr2=0x5583625d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:58.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/1021355080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 0x5583625d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fdabdd640 1 -- 10.20.193.28:0/1021355080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bb630 msgr2=0x5583625beb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:58.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/1021355080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bb630 0x5583625beb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fdabdd640 1 -- 10.20.193.28:0/1021355080 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583625cd950 con 0x5583625c1000 2026-02-20T03:34:58.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.316+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/1021355080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bb630 0x5583625beb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:34:58.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.317+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/1021355080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625d1e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009310 tx=0x7f8fd002b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95b17d6c187eea4f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:58.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.317+0000 7f8f9e4e6640 1 -- 10.20.193.28:0/1021355080 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0023040 con 0x5583625c1000 2026-02-20T03:34:58.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.317+0000 7f8f9e4e6640 1 -- 10.20.193.28:0/1021355080 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55836251c1a0 con 0x5583625c1000 2026-02-20T03:34:58.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.317+0000 7f8f9e4e6640 1 -- 10.20.193.28:0/1021355080 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00159f0 con 0x5583625c1000 2026-02-20T03:34:58.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.318+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1021355080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 msgr2=0x5583625d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:58.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.318+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/1021355080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625d1e40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009310 tx=0x7f8fd002b000 comp rx=0 tx=0).stop 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.318+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1021355080 shutdown_connections 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.318+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/1021355080 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625c1000 0x5583625d1e40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.318+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/1021355080 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625bbfb0 0x5583625d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.318+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/1021355080 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bb630 0x5583625beb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.318+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1021355080 >> 10.20.193.28:0/1021355080 conn(0x55836257e290 msgr2=0x5583625d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.318+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1021355080 shutdown_connections 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.318+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/1021355080 wait complete. 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fdeb6ce00 1 -- start start 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fdeb6ce00 1 Processor -- start 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.324 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bbfb0 0x5583625d8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fdeb6ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625c1000 0x5583625d9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7800e550 con 0x5583625bbfb0 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7800f9c0 con 0x5583625bb630 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fdeb6ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f7800ec20 con 0x5583625c1000 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fda3dc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fda3dc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:59968/0 (socket says 10.20.193.28:59968) 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.319+0000 7f8fda3dc640 1 -- 10.20.193.28:0/20823472 learned_addr learned my addr 10.20.193.28:0/20823472 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fdabdd640 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625c1000 0x5583625d9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fda3dc640 1 -- 10.20.193.28:0/20823472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625c1000 msgr2=0x5583625d9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625c1000 0x5583625d9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fda3dc640 1 -- 10.20.193.28:0/20823472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bbfb0 msgr2=0x5583625d8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:34:58.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bbfb0 0x5583625d8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fda3dc640 1 -- 10.20.193.28:0/20823472 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583621ed870 con 0x5583625bb630 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fda3dc640 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d8ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40c88e0 tx=0x7f8fc402f220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e6fa29a4c7c6dcf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8f87fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8f87fff640 1 -- 10.20.193.28:0/20823472 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40ef0b0 con 0x5583625bb630 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/20823472 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583624ae440 con 0x5583625bb630 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fdeb6ce00 10 client.28652 _ll_register_callbacks cb 0x7f8fd0009240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/20823472 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5583624c0b00 con 0x5583625bb630 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8f87fff640 1 -- 10.20.193.28:0/20823472 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8fc40b6030 con 0x5583625bb630 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8f87fff640 1 -- 10.20.193.28:0/20823472 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40cc370 con 0x5583625bb630 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8f87fff640 1 -- 10.20.193.28:0/20823472 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8fc40cc510 con 0x5583625bb630 2026-02-20T03:34:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8f87fff640 1 -- 10.20.193.28:0/20823472 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f8fc40d5880 con 0x5583625bb630 2026-02-20T03:34:58.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fdeb6ce00 10 client.28652 fetch_fsmap learned FSMap version 45 2026-02-20T03:34:58.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.320+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/20823472 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=45}) -- 0x5583625ce640 con 0x5583625bb630 2026-02-20T03:34:58.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.321+0000 7f8f87fff640 1 -- 10.20.193.28:0/20823472 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 45) ==== 8362+0+0 (secure 0 0 0) 0x7f8fc40051c0 con 0x5583625bb630 2026-02-20T03:34:58.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.321+0000 7f8fdeb6ce00 10 client.28652 fetch_fsmap finished waiting for FSMap version 45 2026-02-20T03:34:58.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.321+0000 7f8fdeb6ce00 10 client.28652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:34:58.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.321+0000 7f8fdeb6ce00 20 client.28652 populate_metadata read hostname 'trial028' 2026-02-20T03:34:58.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.321+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558362650870 0x558362652d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:34:58.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.321+0000 7f8fdeb6ce00 4 client.28652 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:34:58.328 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.321+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/20823472 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55836251c1a0 con 0x558362650870 2026-02-20T03:34:58.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.321+0000 7f8fd9bdb640 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558362650870 0x558362652d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:34:58.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.324+0000 7f8f87fff640 10 client.28652 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:58.329 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.324+0000 7f8fd9bdb640 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558362650870 0x558362652d30 crc :-1 s=READY pgs=522 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25c51af147c3c6b4 server_cookie=1c7bada08599b0c3 in_seq=0 out_seq=0 2026-02-20T03:34:58.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8f87fff640 1 -- 10.20.193.28:0/20823472 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55836251c1a0 con 0x558362650870 2026-02-20T03:34:58.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8f87fff640 10 client.28652 handle_command_reply: tid=0 2026-02-20T03:34:58.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 client.28652 shutdown 2026-02-20T03:34:58.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/20823472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 msgr2=0x5583625d8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:58.330 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d8ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40c88e0 tx=0x7f8fc402f220 comp rx=0 tx=0).stop 2026-02-20T03:34:58.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/20823472 shutdown_connections 2026-02-20T03:34:58.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558362650870 0x558362652d30 crc :-1 s=READY pgs=522 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.331 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:34:58.331 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:34:58.331 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:34:58.331 INFO:teuthology.orchestra.run.trial028.stdout: "b248d6fb-bf43-4991-b8d8-4f89710384ff": { 2026-02-20T03:34:58.332 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:34:58.332 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "b248d6fb-bf43-4991-b8d8-4f89710384ff", 2026-02-20T03:34:58.332 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:34:58.332 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:34:58.332 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:34:58.332 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:34:58.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5583625c1000 0x5583625d9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5583625bbfb0 0x5583625d8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 --2- 10.20.193.28:0/20823472 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5583625bb630 0x5583625d8ab0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/20823472 >> 10.20.193.28:0/20823472 conn(0x55836257e290 msgr2=0x5583625e46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:58.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8f87fff640 0 client.28652 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:34:58.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/20823472 shutdown_connections 2026-02-20T03:34:58.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 1 -- 10.20.193.28:0/20823472 wait complete. 2026-02-20T03:34:58.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.327+0000 7f8fdeb6ce00 20 client.28652 trim_cache size 0 max 16384 2026-02-20T03:34:58.333 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 -- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8fa80b0ed0 msgr2=0x7f8fa80b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8fa80b0ed0 0x7f8fa80b3390 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8fd410cff0 tx=0x7f8fc80047c0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 -- 10.20.193.28:0/2570359190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8fd4074380 msgr2=0x7f8fd41aa010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8fd4074380 0x7f8fd41aa010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4005ec0 tx=0x7f8fc4004290 comp rx=0 tx=0).stop 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 -- 10.20.193.28:0/2570359190 shutdown_connections 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8fa80b0ed0 0x7f8fa80b3390 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8fd410c300 0x7f8fd41ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8fd4074d30 0x7f8fd41aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 --2- 10.20.193.28:0/2570359190 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8fd4074380 0x7f8fd41aa010 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 -- 10.20.193.28:0/2570359190 >> 10.20.193.28:0/2570359190 conn(0x7f8fd406ead0 msgr2=0x7f8fd40730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 -- 10.20.193.28:0/2570359190 shutdown_connections 2026-02-20T03:34:58.334 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:34:58.328+0000 7f8fdb3de640 1 -- 10.20.193.28:0/2570359190 wait complete. 2026-02-20T03:34:58.474 INFO:tasks.cephfs.filesystem:scrub status for tag:b248d6fb-bf43-4991-b8d8-4f89710384ff - {'path': '/', 'tag': 'b248d6fb-bf43-4991-b8d8-4f89710384ff', 'options': 'recursive,force'} 2026-02-20T03:34:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:58 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:34:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:58 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:34:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:58 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:58 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:34:58.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:58 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:58.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:58 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:58.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 153176 18.49 MB/sec execute 269 sec latency 55.934 ms 2026-02-20T03:34:58.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:58 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:34:58.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:58 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:34:58.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:58 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:58.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:58 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:34:58.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:58 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:58.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:58 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:58.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:58 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:34:58.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:58 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:34:58.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:58 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:58.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:58 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:34:58.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:58 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:58.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:58 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:59.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 154435 18.66 MB/sec execute 270 sec latency 51.338 ms 2026-02-20T03:34:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:59 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:34:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:59 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:34:59 trial126 ceph-mon[38476]: pgmap v795: 129 pgs: 129 active+clean; 615 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 6.4 MiB/s wr, 751 op/s 2026-02-20T03:34:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:59 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:34:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:59 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:34:59 trial028 ceph-mon[38552]: pgmap v795: 129 pgs: 129 active+clean; 615 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 6.4 MiB/s wr, 751 op/s 2026-02-20T03:34:59.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:59 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:34:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:59 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:34:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:34:59 trial177 ceph-mon[43181]: pgmap v795: 129 pgs: 129 active+clean; 615 MiB data, 8.4 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 6.4 MiB/s wr, 751 op/s 2026-02-20T03:35:00.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 155884 18.88 MB/sec execute 271 sec latency 38.805 ms 2026-02-20T03:35:01.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 157188 19.05 MB/sec execute 272 sec latency 44.033 ms 2026-02-20T03:35:01.769 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:01 trial177 ceph-mon[43181]: pgmap v796: 129 pgs: 129 active+clean; 621 MiB data, 8.5 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 7.9 MiB/s wr, 964 op/s 2026-02-20T03:35:01.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:01 trial126 ceph-mon[38476]: pgmap v796: 129 pgs: 129 active+clean; 621 MiB data, 8.5 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 7.9 MiB/s wr, 964 op/s 2026-02-20T03:35:01.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:01 trial028 ceph-mon[38552]: pgmap v796: 129 pgs: 129 active+clean; 621 MiB data, 8.5 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 7.9 MiB/s wr, 964 op/s 2026-02-20T03:35:02.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 158809 19.33 MB/sec execute 273 sec latency 24.712 ms 2026-02-20T03:35:03.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 159964 19.48 MB/sec execute 274 sec latency 37.509 ms 2026-02-20T03:35:03.768 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:03 trial028 ceph-mon[38552]: pgmap v797: 129 pgs: 129 active+clean; 628 MiB data, 8.5 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 7.7 MiB/s wr, 922 op/s 2026-02-20T03:35:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:03 trial126 ceph-mon[38476]: pgmap v797: 129 pgs: 129 active+clean; 628 MiB data, 8.5 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 7.7 MiB/s wr, 922 op/s 2026-02-20T03:35:03.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:03 trial177 ceph-mon[43181]: pgmap v797: 129 pgs: 129 active+clean; 628 MiB data, 8.5 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 7.7 MiB/s wr, 922 op/s 2026-02-20T03:35:04.556 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:04 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:35:04.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 161308 19.66 MB/sec execute 275 sec latency 40.947 ms 2026-02-20T03:35:04.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:04 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:35:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:04 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:35:05.716 INFO:tasks.workunit.client.0.trial028.stdout: 10 162795 19.89 MB/sec execute 276 sec latency 36.771 ms 2026-02-20T03:35:05.781 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:05 trial028 ceph-mon[38552]: pgmap v798: 129 pgs: 129 active+clean; 639 MiB data, 8.5 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 8.1 MiB/s wr, 969 op/s 2026-02-20T03:35:05.781 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:05 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:35:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:05 trial126 ceph-mon[38476]: pgmap v798: 129 pgs: 129 active+clean; 639 MiB data, 8.5 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 8.1 MiB/s wr, 969 op/s 2026-02-20T03:35:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:05 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:35:05.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:05 trial177 ceph-mon[43181]: pgmap v798: 129 pgs: 129 active+clean; 639 MiB data, 8.5 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 8.1 MiB/s wr, 969 op/s 2026-02-20T03:35:05.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:05 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:35:06.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 164263 20.12 MB/sec execute 277 sec latency 52.097 ms 2026-02-20T03:35:06.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:06 trial126 ceph-mon[38476]: pgmap v799: 129 pgs: 129 active+clean; 651 MiB data, 8.6 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.3 MiB/s wr, 986 op/s 2026-02-20T03:35:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:06 trial028 ceph-mon[38552]: pgmap v799: 129 pgs: 129 active+clean; 651 MiB data, 8.6 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.3 MiB/s wr, 986 op/s 2026-02-20T03:35:06.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:06 trial177 ceph-mon[43181]: pgmap v799: 129 pgs: 129 active+clean; 651 MiB data, 8.6 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.3 MiB/s wr, 986 op/s 2026-02-20T03:35:07.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 165738 20.30 MB/sec execute 278 sec latency 58.864 ms 2026-02-20T03:35:07.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.856+0000 7f0f1ea58640 1 -- 10.20.193.28:0/3404762697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f1810a5d0 msgr2=0x7f0f1810a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:07.859 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.856+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/3404762697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f1810a5d0 0x7f0f1810a9d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009a30 tx=0x7f0f0402f220 comp rx=0 tx=0).stop 2026-02-20T03:35:07.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.857+0000 7f0f1ea58640 1 -- 10.20.193.28:0/3404762697 shutdown_connections 2026-02-20T03:35:07.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.857+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/3404762697 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f18109bc0 0x7f0f18111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.857+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/3404762697 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f18109220 0x7f0f18109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.857+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/3404762697 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f1810a5d0 0x7f0f1810a9d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.857+0000 7f0f1ea58640 1 -- 10.20.193.28:0/3404762697 >> 10.20.193.28:0/3404762697 conn(0x7f0f1806c170 msgr2=0x7f0f1807a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:07.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.857+0000 7f0f1ea58640 1 -- 10.20.193.28:0/3404762697 shutdown_connections 2026-02-20T03:35:07.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.857+0000 7f0f1ea58640 1 -- 10.20.193.28:0/3404762697 wait complete. 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.857+0000 7f0f1ea58640 1 Processor -- start 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.857+0000 7f0f1ea58640 1 -- start start 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f1ea58640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f18109220 0x7f0f181a1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f1ea58640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f18109bc0 0x7f0f181a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f1ea58640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f1810a5d0 0x7f0f181a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f1ea58640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18114b70 con 0x7f0f18109bc0 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f1ea58640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0f181149f0 con 0x7f0f1810a5d0 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f1ea58640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18114cf0 con 0x7f0f18109220 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f17fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f18109220 0x7f0f181a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f17fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f18109220 0x7f0f181a1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47198/0 (socket says 10.20.193.28:47198) 2026-02-20T03:35:07.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f17fff640 1 -- 10.20.193.28:0/2904808254 learned_addr learned my addr 10.20.193.28:0/2904808254 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:07.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f1cfce640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f1810a5d0 0x7f0f181a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f177fe640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f18109bc0 0x7f0f181a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f17fff640 1 -- 10.20.193.28:0/2904808254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f1810a5d0 msgr2=0x7f0f181a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:07.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f17fff640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f1810a5d0 0x7f0f181a85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f17fff640 1 -- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f18109bc0 msgr2=0x7f0f181a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:07.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f17fff640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f18109bc0 0x7f0f181a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.858+0000 7f0f17fff640 1 -- 10.20.193.28:0/2904808254 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f181a8c60 con 0x7f0f18109220 2026-02-20T03:35:07.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.859+0000 7f0f17fff640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f18109220 0x7f0f181a1040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009b60 tx=0x7f0f0402fdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:07.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.859+0000 7f0f157fa640 1 -- 10.20.193.28:0/2904808254 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04004340 con 0x7f0f18109220 2026-02-20T03:35:07.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.859+0000 7f0f157fa640 1 -- 10.20.193.28:0/2904808254 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0f040044e0 con 0x7f0f18109220 2026-02-20T03:35:07.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.859+0000 7f0f157fa640 1 -- 10.20.193.28:0/2904808254 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04038e50 con 0x7f0f18109220 2026-02-20T03:35:07.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.859+0000 7f0f1ea58640 1 -- 10.20.193.28:0/2904808254 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f181a8ef0 con 0x7f0f18109220 2026-02-20T03:35:07.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.860+0000 7f0f1ea58640 1 -- 10.20.193.28:0/2904808254 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f181a92a0 con 0x7f0f18109220 2026-02-20T03:35:07.866 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.863+0000 7f0f157fa640 1 -- 10.20.193.28:0/2904808254 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0f040047c0 con 0x7f0f18109220 2026-02-20T03:35:07.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.864+0000 7f0f157fa640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0eec0b0f40 0x7f0eec0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.865+0000 7f0f157fa640 1 -- 10.20.193.28:0/2904808254 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0f04104840 con 0x7f0f18109220 2026-02-20T03:35:07.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.865+0000 7f0f177fe640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0eec0b0f40 0x7f0eec0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.865+0000 7f0f218bde00 1 Processor -- start 2026-02-20T03:35:07.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.865+0000 7f0f177fe640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0eec0b0f40 0x7f0eec0b3400 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0f181a2550 tx=0x7f0f0800a400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:07.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.865+0000 7f0f218bde00 1 -- start start 2026-02-20T03:35:07.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d15280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d19d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 0x55dc34d1c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f218bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc34c658f0 con 0x55dc34d14e80 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f218bde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dc34c132e0 con 0x55dc34d157c0 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f218bde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc34c61820 con 0x55dc34d1a370 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f177fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d19d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f177fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d19d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48760/0 (socket says 10.20.193.28:48760) 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f177fe640 1 -- 10.20.193.28:0/2038859467 learned_addr learned my addr 10.20.193.28:0/2038859467 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f17fff640 1 --2- 10.20.193.28:0/2038859467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d15280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f1cfce640 1 --2- 10.20.193.28:0/2038859467 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 0x55dc34d1c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f17fff640 1 -- 10.20.193.28:0/2038859467 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 msgr2=0x55dc34d1c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f17fff640 1 --2- 10.20.193.28:0/2038859467 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 0x55dc34d1c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f17fff640 1 -- 10.20.193.28:0/2038859467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 msgr2=0x55dc34d19d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:07.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f17fff640 1 --2- 10.20.193.28:0/2038859467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d19d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f17fff640 1 -- 10.20.193.28:0/2038859467 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc34c055a0 con 0x55dc34d14e80 2026-02-20T03:35:07.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.866+0000 7f0f17fff640 1 --2- 10.20.193.28:0/2038859467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d15280 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f0f0402f730 tx=0x7f0f04038950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a7abeb8f74a038 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.867+0000 7f0ee8bfe640 1 -- 10.20.193.28:0/2038859467 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040d08d0 con 0x55dc34d14e80 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.867+0000 7f0ee8bfe640 1 -- 10.20.193.28:0/2038859467 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0f04033040 con 0x55dc34d14e80 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.867+0000 7f0ee8bfe640 1 -- 10.20.193.28:0/2038859467 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040c7cf0 con 0x55dc34d14e80 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.867+0000 7f0f218bde00 1 -- 10.20.193.28:0/2038859467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 msgr2=0x55dc34d15280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.867+0000 7f0f218bde00 1 --2- 10.20.193.28:0/2038859467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d15280 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f0f0402f730 tx=0x7f0f04038950 comp rx=0 tx=0).stop 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.867+0000 7f0f218bde00 1 -- 10.20.193.28:0/2038859467 shutdown_connections 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.867+0000 7f0f218bde00 1 --2- 10.20.193.28:0/2038859467 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 0x55dc34d1c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.867+0000 7f0f218bde00 1 --2- 10.20.193.28:0/2038859467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d19d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.868+0000 7f0f218bde00 1 --2- 10.20.193.28:0/2038859467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d15280 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.868+0000 7f0f218bde00 1 -- 10.20.193.28:0/2038859467 >> 10.20.193.28:0/2038859467 conn(0x55dc34d0c6f0 msgr2=0x55dc34d13570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.868+0000 7f0f218bde00 1 -- 10.20.193.28:0/2038859467 shutdown_connections 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.868+0000 7f0f218bde00 1 -- 10.20.193.28:0/2038859467 wait complete. 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.869+0000 7f0f218bde00 1 -- start start 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.869+0000 7f0f218bde00 1 Processor -- start 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.869+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d3e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.869+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d3eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.869+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 0x55dc34d45e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.869+0000 7f0f218bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dc34c0d0c0 con 0x55dc34d14e80 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.869+0000 7f0f218bde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dc34d2e5c0 con 0x55dc34d157c0 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.869+0000 7f0f218bde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dc34d463f0 con 0x55dc34d1a370 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d3e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f1cfce640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 0x55dc34d45e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d3e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:57454/0 (socket says 10.20.193.28:57454) 2026-02-20T03:35:07.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f17fff640 1 -- 10.20.193.28:0/4212757494 learned_addr learned my addr 10.20.193.28:0/4212757494 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:07.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f177fe640 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d3eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f17fff640 1 -- 10.20.193.28:0/4212757494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 msgr2=0x55dc34d45e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:07.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f17fff640 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 0x55dc34d45e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f17fff640 1 -- 10.20.193.28:0/4212757494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 msgr2=0x55dc34d3eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:07.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f17fff640 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d3eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.875 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f17fff640 1 -- 10.20.193.28:0/4212757494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc34d380c0 con 0x55dc34d14e80 2026-02-20T03:35:07.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f17fff640 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d3e9a0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f0f040cc2d0 tx=0x7f0f040cb9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b95834a5b68672a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:07.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0ed9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:07.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/4212757494 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040d5780 con 0x55dc34d14e80 2026-02-20T03:35:07.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f218bde00 1 -- 10.20.193.28:0/4212757494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc34c21820 con 0x55dc34d14e80 2026-02-20T03:35:07.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f218bde00 10 client.21057 _ll_register_callbacks cb 0x55dc34c10ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:07.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0f218bde00 1 -- 10.20.193.28:0/4212757494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc34c6d4e0 con 0x55dc34d14e80 2026-02-20T03:35:07.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/4212757494 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0f040d08d0 con 0x55dc34d14e80 2026-02-20T03:35:07.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.870+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/4212757494 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040d1a60 con 0x55dc34d14e80 2026-02-20T03:35:07.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/4212757494 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0f040c8610 con 0x55dc34d14e80 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/4212757494 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f0f040cb050 con 0x55dc34d14e80 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0f218bde00 10 client.21057 fetch_fsmap learned FSMap version 47 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0f218bde00 1 -- 10.20.193.28:0/4212757494 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=47}) -- 0x55dc34c26380 con 0x55dc34d14e80 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/4212757494 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 47) ==== 8370+0+0 (secure 0 0 0) 0x7f0f040c7cf0 con 0x55dc34d14e80 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0f218bde00 10 client.21057 fetch_fsmap finished waiting for FSMap version 47 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0f218bde00 10 client.21057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0f218bde00 20 client.21057 populate_metadata read hostname 'trial028' 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0f218bde00 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc34d4a310 0x55dc34d4c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0f218bde00 4 client.21057 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0f218bde00 1 -- 10.20.193.28:0/4212757494 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc34be7bd0 con 0x55dc34d4a310 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.871+0000 7f0f177fe640 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc34d4a310 0x55dc34d4c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.872+0000 7f0ed9ffb640 10 client.21057 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.872+0000 7f0f177fe640 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc34d4a310 0x55dc34d4c7d0 crc :-1 s=READY pgs=523 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffaab079bfa949a7 server_cookie=511afaf7c03acd7b in_seq=0 out_seq=0 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/4212757494 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55dc34be7bd0 con 0x55dc34d4a310 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0ed9ffb640 10 client.21057 handle_command_reply: tid=0 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 client.21057 shutdown 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 -- 10.20.193.28:0/4212757494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 msgr2=0x55dc34d3e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d3e9a0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f0f040cc2d0 tx=0x7f0f040cb9f0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 -- 10.20.193.28:0/4212757494 shutdown_connections 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc34d4a310 0x55dc34d4c7d0 crc :-1 s=READY pgs=523 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d1a370 0x55dc34d45e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d3eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 --2- 10.20.193.28:0/4212757494 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d14e80 0x55dc34d3e9a0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0ed9ffb640 0 client.21057 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:07.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 -- 10.20.193.28:0/4212757494 >> 10.20.193.28:0/4212757494 conn(0x55dc34d0c6f0 msgr2=0x55dc34d1b750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:07.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 -- 10.20.193.28:0/4212757494 shutdown_connections 2026-02-20T03:35:07.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 1 -- 10.20.193.28:0/4212757494 wait complete. 2026-02-20T03:35:07.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.873+0000 7f0f218bde00 20 client.21057 trim_cache size 0 max 16384 2026-02-20T03:35:07.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.881+0000 7f0f218bde00 1 Processor -- start 2026-02-20T03:35:07.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.881+0000 7f0f218bde00 1 -- start start 2026-02-20T03:35:07.884 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.881+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d14e80 0x55dc34d3eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.881+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d45d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.881+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d3c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.881+0000 7f0f218bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc012710 con 0x55dc34d1a370 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.881+0000 7f0f218bde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc00ff50 con 0x55dc34d157c0 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.881+0000 7f0f218bde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc00dda0 con 0x55dc34d14e80 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f17fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d14e80 0x55dc34d3eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f17fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d14e80 0x55dc34d3eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47228/0 (socket says 10.20.193.28:47228) 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f17fff640 1 -- 10.20.193.28:0/1060267659 learned_addr learned my addr 10.20.193.28:0/1060267659 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f1cfce640 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d3c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f177fe640 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d45d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f17fff640 1 -- 10.20.193.28:0/1060267659 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 msgr2=0x55dc34d45d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:07.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f17fff640 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d45d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f17fff640 1 -- 10.20.193.28:0/1060267659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 msgr2=0x55dc34d3c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:07.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f17fff640 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d3c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f17fff640 1 -- 10.20.193.28:0/1060267659 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc34d37ef0 con 0x55dc34d14e80 2026-02-20T03:35:07.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f1cfce640 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d3c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:35:07.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0f17fff640 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d14e80 0x55dc34d3eed0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0f040c8400 tx=0x7f0f040e5000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0f579aaa43a1d14 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:07.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.882+0000 7f0edbfff640 1 -- 10.20.193.28:0/1060267659 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040d1a60 con 0x55dc34d14e80 2026-02-20T03:35:07.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0edbfff640 1 -- 10.20.193.28:0/1060267659 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55dc34c6d4e0 con 0x55dc34d14e80 2026-02-20T03:35:07.887 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0edbfff640 1 -- 10.20.193.28:0/1060267659 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04004ae0 con 0x55dc34d14e80 2026-02-20T03:35:07.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0f218bde00 1 -- 10.20.193.28:0/1060267659 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d14e80 msgr2=0x55dc34d3eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:07.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0f218bde00 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d14e80 0x55dc34d3eed0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0f040c8400 tx=0x7f0f040e5000 comp rx=0 tx=0).stop 2026-02-20T03:35:07.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0f218bde00 1 -- 10.20.193.28:0/1060267659 shutdown_connections 2026-02-20T03:35:07.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0f218bde00 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d3c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0f218bde00 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d157c0 0x55dc34d45d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.889 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0f218bde00 1 --2- 10.20.193.28:0/1060267659 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d14e80 0x55dc34d3eed0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0f218bde00 1 -- 10.20.193.28:0/1060267659 >> 10.20.193.28:0/1060267659 conn(0x55dc34d0c6f0 msgr2=0x55dc34d15ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0f218bde00 1 -- 10.20.193.28:0/1060267659 shutdown_connections 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.883+0000 7f0f218bde00 1 -- 10.20.193.28:0/1060267659 wait complete. 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f218bde00 1 -- start start 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f218bde00 1 Processor -- start 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d14e80 0x55dc34d43b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d157c0 0x55dc34d44050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f218bde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d45030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f218bde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc00e410 con 0x55dc34d1a370 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f218bde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc00f880 con 0x55dc34d14e80 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f218bde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ebc00eae0 con 0x55dc34d157c0 2026-02-20T03:35:07.890 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f17fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d14e80 0x55dc34d43b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f1cfce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d45030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f17fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d14e80 0x55dc34d43b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48786/0 (socket says 10.20.193.28:48786) 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.884+0000 7f0f17fff640 1 -- 10.20.193.28:0/3394007676 learned_addr learned my addr 10.20.193.28:0/3394007676 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.885+0000 7f0f1cfce640 1 -- 10.20.193.28:0/3394007676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d157c0 msgr2=0x55dc34d44050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.885+0000 7f0f1cfce640 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d157c0 0x55dc34d44050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.885+0000 7f0f1cfce640 1 -- 10.20.193.28:0/3394007676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d14e80 msgr2=0x55dc34d43b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.885+0000 7f0f1cfce640 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d14e80 0x55dc34d43b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.885+0000 7f0f1cfce640 1 -- 10.20.193.28:0/3394007676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc349c5690 con 0x55dc34d1a370 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.885+0000 7f0f1cfce640 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d45030 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c007cf0 tx=0x7f0f0c0047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fcd74d6b434864 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.885+0000 7f0ed9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:07.891 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.886+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/3394007676 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c009d40 con 0x55dc34d1a370 2026-02-20T03:35:07.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.886+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/3394007676 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0f0c01c070 con 0x55dc34d1a370 2026-02-20T03:35:07.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.886+0000 7f0f218bde00 1 -- 10.20.193.28:0/3394007676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc34c2ab70 con 0x55dc34d1a370 2026-02-20T03:35:07.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.886+0000 7f0f218bde00 10 client.21063 _ll_register_callbacks cb 0x7f0f040cc3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:07.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.886+0000 7f0f218bde00 1 -- 10.20.193.28:0/3394007676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f04033040 con 0x55dc34d1a370 2026-02-20T03:35:07.892 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.886+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/3394007676 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c018700 con 0x55dc34d1a370 2026-02-20T03:35:07.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.887+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/3394007676 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0f0c0188a0 con 0x55dc34d1a370 2026-02-20T03:35:07.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.887+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/3394007676 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f0f0c018b60 con 0x55dc34d1a370 2026-02-20T03:35:07.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.887+0000 7f0f218bde00 10 client.21063 fetch_fsmap learned FSMap version 47 2026-02-20T03:35:07.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.887+0000 7f0f218bde00 1 -- 10.20.193.28:0/3394007676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=47}) -- 0x55dc34d38be0 con 0x55dc34d1a370 2026-02-20T03:35:07.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.887+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/3394007676 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 47) ==== 8370+0+0 (secure 0 0 0) 0x7f0f0c0209e0 con 0x55dc34d1a370 2026-02-20T03:35:07.893 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.888+0000 7f0f218bde00 10 client.21063 fetch_fsmap finished waiting for FSMap version 47 2026-02-20T03:35:07.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.888+0000 7f0f218bde00 10 client.21063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:07.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.888+0000 7f0f218bde00 20 client.21063 populate_metadata read hostname 'trial028' 2026-02-20T03:35:07.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.888+0000 7f0f218bde00 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc34db5bb0 0x55dc34db8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:07.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.888+0000 7f0f218bde00 4 client.21063 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:35:07.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.888+0000 7f0f218bde00 1 -- 10.20.193.28:0/3394007676 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc34c366b0 con 0x55dc34db5bb0 2026-02-20T03:35:07.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.888+0000 7f0f17fff640 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc34db5bb0 0x55dc34db8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:07.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.888+0000 7f0f17fff640 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc34db5bb0 0x55dc34db8070 crc :-1 s=READY pgs=524 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcbafa8afc450015 server_cookie=c67d543802565c47 in_seq=0 out_seq=0 2026-02-20T03:35:07.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:07.888+0000 7f0ed9ffb640 10 client.21063 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:08.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.192+0000 7f0ed9ffb640 1 -- 10.20.193.28:0/3394007676 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc34c366b0 con 0x55dc34db5bb0 2026-02-20T03:35:08.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.192+0000 7f0ed9ffb640 10 client.21063 handle_command_reply: tid=0 2026-02-20T03:35:08.195 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.192+0000 7f0f218bde00 1 client.21063 shutdown 2026-02-20T03:35:08.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.192+0000 7f0f218bde00 1 -- 10.20.193.28:0/3394007676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 msgr2=0x55dc34d45030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:08.196 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.192+0000 7f0f218bde00 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d45030 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c007cf0 tx=0x7f0f0c0047a0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f218bde00 1 -- 10.20.193.28:0/3394007676 shutdown_connections 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f218bde00 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dc34db5bb0 0x55dc34db8070 crc :-1 s=READY pgs=524 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f218bde00 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dc34d1a370 0x55dc34d45030 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f218bde00 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dc34d157c0 0x55dc34d44050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f218bde00 1 --2- 10.20.193.28:0/3394007676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dc34d14e80 0x55dc34d43b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f218bde00 1 -- 10.20.193.28:0/3394007676 >> 10.20.193.28:0/3394007676 conn(0x55dc34d0c6f0 msgr2=0x55dc34d15ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0ed9ffb640 0 client.21063 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f218bde00 1 -- 10.20.193.28:0/3394007676 shutdown_connections 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f218bde00 1 -- 10.20.193.28:0/3394007676 wait complete. 2026-02-20T03:35:08.197 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f218bde00 20 client.21063 trim_cache size 0 max 16384 2026-02-20T03:35:08.198 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:35:08.198 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:35:08.198 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:35:08.198 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:35:08.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f1ea58640 1 -- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0eec0b0f40 msgr2=0x7f0eec0b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:08.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0eec0b0f40 0x7f0eec0b3400 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0f181a2550 tx=0x7f0f0800a400 comp rx=0 tx=0).stop 2026-02-20T03:35:08.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f1ea58640 1 -- 10.20.193.28:0/2904808254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f18109220 msgr2=0x7f0f181a1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:08.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.193+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f18109220 0x7f0f181a1040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009b60 tx=0x7f0f0402fdf0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.194+0000 7f0f1ea58640 1 -- 10.20.193.28:0/2904808254 shutdown_connections 2026-02-20T03:35:08.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.194+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0eec0b0f40 0x7f0eec0b3400 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.194+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0f1810a5d0 0x7f0f181a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.199 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.194+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0f18109bc0 0x7f0f181a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.194+0000 7f0f1ea58640 1 --2- 10.20.193.28:0/2904808254 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0f18109220 0x7f0f181a1040 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:08.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.194+0000 7f0f1ea58640 1 -- 10.20.193.28:0/2904808254 >> 10.20.193.28:0/2904808254 conn(0x7f0f1806c170 msgr2=0x7f0f1810d580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:08.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.194+0000 7f0f1ea58640 1 -- 10.20.193.28:0/2904808254 shutdown_connections 2026-02-20T03:35:08.200 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:08.194+0000 7f0f1ea58640 1 -- 10.20.193.28:0/2904808254 wait complete. 2026-02-20T03:35:08.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 166884 20.45 MB/sec execute 279 sec latency 171.312 ms 2026-02-20T03:35:09.711 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:09 trial028 ceph-mon[38552]: pgmap v800: 129 pgs: 129 active+clean; 661 MiB data, 8.8 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 7.4 MiB/s wr, 874 op/s 2026-02-20T03:35:09.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 168106 20.63 MB/sec execute 280 sec latency 54.569 ms 2026-02-20T03:35:09.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:09 trial177 ceph-mon[43181]: pgmap v800: 129 pgs: 129 active+clean; 661 MiB data, 8.8 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 7.4 MiB/s wr, 874 op/s 2026-02-20T03:35:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:09 trial126 ceph-mon[38476]: pgmap v800: 129 pgs: 129 active+clean; 661 MiB data, 8.8 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 7.4 MiB/s wr, 874 op/s 2026-02-20T03:35:10.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:10 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:35:10.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 169431 20.80 MB/sec execute 281 sec latency 44.032 ms 2026-02-20T03:35:10.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:10 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:35:10.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:10 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:35:11.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 171050 21.07 MB/sec execute 282 sec latency 40.743 ms 2026-02-20T03:35:11.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:11 trial177 ceph-mon[43181]: pgmap v801: 129 pgs: 129 active+clean; 671 MiB data, 8.9 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.2 MiB/s wr, 1.05k op/s 2026-02-20T03:35:11.810 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:11 trial028 ceph-mon[38552]: pgmap v801: 129 pgs: 129 active+clean; 671 MiB data, 8.9 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.2 MiB/s wr, 1.05k op/s 2026-02-20T03:35:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:11 trial126 ceph-mon[38476]: pgmap v801: 129 pgs: 129 active+clean; 671 MiB data, 8.9 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.2 MiB/s wr, 1.05k op/s 2026-02-20T03:35:12.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 172285 21.19 MB/sec execute 283 sec latency 42.418 ms 2026-02-20T03:35:13.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 174028 21.50 MB/sec execute 284 sec latency 55.094 ms 2026-02-20T03:35:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:13 trial177 ceph-mon[43181]: pgmap v802: 129 pgs: 129 active+clean; 678 MiB data, 8.9 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.4 MiB/s wr, 954 op/s 2026-02-20T03:35:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:13 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:35:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:13 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:35:13.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:13 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:35:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:13 trial126 ceph-mon[38476]: pgmap v802: 129 pgs: 129 active+clean; 678 MiB data, 8.9 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.4 MiB/s wr, 954 op/s 2026-02-20T03:35:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:13 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:35:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:13 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:35:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:13 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:35:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:13 trial028 ceph-mon[38552]: pgmap v802: 129 pgs: 129 active+clean; 678 MiB data, 8.9 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.4 MiB/s wr, 954 op/s 2026-02-20T03:35:13.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:13 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:35:13.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:13 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:35:13.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:13 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:35:14.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 175234 21.60 MB/sec execute 285 sec latency 42.228 ms 2026-02-20T03:35:15.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 177276 21.94 MB/sec execute 286 sec latency 41.503 ms 2026-02-20T03:35:15.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:15 trial177 ceph-mon[43181]: pgmap v803: 129 pgs: 129 active+clean; 692 MiB data, 8.9 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.7 MiB/s wr, 993 op/s 2026-02-20T03:35:15.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:15 trial126 ceph-mon[38476]: pgmap v803: 129 pgs: 129 active+clean; 692 MiB data, 8.9 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.7 MiB/s wr, 993 op/s 2026-02-20T03:35:15.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:15 trial028 ceph-mon[38552]: pgmap v803: 129 pgs: 129 active+clean; 692 MiB data, 8.9 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.7 MiB/s wr, 993 op/s 2026-02-20T03:35:16.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 178026 22.01 MB/sec execute 287 sec latency 448.713 ms 2026-02-20T03:35:17.524 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:17 trial028 ceph-mon[38552]: pgmap v804: 129 pgs: 129 active+clean; 708 MiB data, 9.0 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 8.2 MiB/s wr, 1.05k op/s 2026-02-20T03:35:17.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 179019 22.09 MB/sec execute 288 sec latency 475.011 ms 2026-02-20T03:35:17.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:17 trial177 ceph-mon[43181]: pgmap v804: 129 pgs: 129 active+clean; 708 MiB data, 9.0 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 8.2 MiB/s wr, 1.05k op/s 2026-02-20T03:35:17.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:17 trial126 ceph-mon[38476]: pgmap v804: 129 pgs: 129 active+clean; 708 MiB data, 9.0 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 8.2 MiB/s wr, 1.05k op/s 2026-02-20T03:35:18.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 181169 22.46 MB/sec execute 289 sec latency 34.216 ms 2026-02-20T03:35:19.717 INFO:tasks.workunit.client.0.trial028.stdout: 10 182090 22.50 MB/sec execute 290 sec latency 57.753 ms 2026-02-20T03:35:19.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:19 trial177 ceph-mon[43181]: pgmap v805: 129 pgs: 129 active+clean; 712 MiB data, 9.0 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 8.2 MiB/s wr, 1.04k op/s 2026-02-20T03:35:19.833 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:19 trial028 ceph-mon[38552]: pgmap v805: 129 pgs: 129 active+clean; 712 MiB data, 9.0 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 8.2 MiB/s wr, 1.04k op/s 2026-02-20T03:35:19.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:19 trial126 ceph-mon[38476]: pgmap v805: 129 pgs: 129 active+clean; 712 MiB data, 9.0 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 8.2 MiB/s wr, 1.04k op/s 2026-02-20T03:35:20.718 INFO:tasks.workunit.client.0.trial028.stdout: 10 183781 22.71 MB/sec execute 291 sec latency 42.675 ms 2026-02-20T03:35:21.277 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.274+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1418203288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf18109490 msgr2=0x7fbf18109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:21.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.274+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1418203288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf18109490 0x7fbf18109890 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbf08009a30 tx=0x7fbf0802f220 comp rx=0 tx=0).stop 2026-02-20T03:35:21.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.274+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1418203288 shutdown_connections 2026-02-20T03:35:21.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.274+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1418203288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf1810a900 0x7fbf18111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.274+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1418203288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf18109e60 0x7fbf1810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.274+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1418203288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf18109490 0x7fbf18109890 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.274+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1418203288 >> 10.20.193.28:0/1418203288 conn(0x7fbf18077fe0 msgr2=0x7fbf1807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:21.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.274+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1418203288 shutdown_connections 2026-02-20T03:35:21.278 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.274+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1418203288 wait complete. 2026-02-20T03:35:21.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1dba9640 1 Processor -- start 2026-02-20T03:35:21.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1dba9640 1 -- start start 2026-02-20T03:35:21.280 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1dba9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf18109490 0x7fbf181a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1dba9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf18109e60 0x7fbf181a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1dba9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf1810a900 0x7fbf181a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1dba9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181149b0 con 0x7fbf1810a900 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1dba9640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18114830 con 0x7fbf18109e60 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1dba9640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf18114b30 con 0x7fbf18109490 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1cba7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf18109490 0x7fbf181a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1cba7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf18109490 0x7fbf181a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47870/0 (socket says 10.20.193.28:47870) 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf1cba7640 1 -- 10.20.193.28:0/1790278888 learned_addr learned my addr 10.20.193.28:0/1790278888 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.275+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf18109e60 0x7fbf181a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf1810a900 0x7fbf181a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf1cba7640 1 -- 10.20.193.28:0/1790278888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf18109e60 msgr2=0x7fbf181a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:21.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf1cba7640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf18109e60 0x7fbf181a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf1cba7640 1 -- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf1810a900 msgr2=0x7fbf181a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:21.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf1cba7640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf1810a900 0x7fbf181a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf1cba7640 1 -- 10.20.193.28:0/1790278888 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf181a8ca0 con 0x7fbf18109490 2026-02-20T03:35:21.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf1cba7640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf18109490 0x7fbf181a0ff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbf08002fd0 tx=0x7fbf0802fc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:21.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf0dffb640 1 -- 10.20.193.28:0/1790278888 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0802fe30 con 0x7fbf18109490 2026-02-20T03:35:21.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf0dffb640 1 -- 10.20.193.28:0/1790278888 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbf08038770 con 0x7fbf18109490 2026-02-20T03:35:21.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf0dffb640 1 -- 10.20.193.28:0/1790278888 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08042950 con 0x7fbf18109490 2026-02-20T03:35:21.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1790278888 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf181a8f30 con 0x7fbf18109490 2026-02-20T03:35:21.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.276+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1790278888 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf181a93c0 con 0x7fbf18109490 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.279+0000 7fbf0dffb640 1 -- 10.20.193.28:0/1790278888 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbf08004240 con 0x7fbf18109490 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf21c9be00 1 Processor -- start 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf21c9be00 1 -- start start 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b44280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b48f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 0x5577c9b4b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577c9a948f0 con 0x5577c9b447c0 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5577c9a422e0 con 0x5577c9b43e80 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5577c9a90820 con 0x5577c9b49560 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf1d3a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b44280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.284 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf1d3a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b44280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:51068/0 (socket says 10.20.193.28:51068) 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf1d3a8640 1 -- 10.20.193.28:0/1455152415 learned_addr learned my addr 10.20.193.28:0/1455152415 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf0ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 0x5577c9b4b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.280+0000 7fbf1cba7640 1 --2- 10.20.193.28:0/1455152415 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b48f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf1d3a8640 1 -- 10.20.193.28:0/1455152415 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 msgr2=0x5577c9b4b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/1455152415 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 0x5577c9b4b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf1d3a8640 1 -- 10.20.193.28:0/1455152415 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 msgr2=0x5577c9b48f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/1455152415 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b48f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf1d3a8640 1 -- 10.20.193.28:0/1455152415 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c9a345a0 con 0x5577c9b43e80 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf1cba7640 1 --2- 10.20.193.28:0/1455152415 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b48f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:35:21.285 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/1455152415 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b44280 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbf140045f0 tx=0x7fbf1400b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43be50bc78551813 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:21.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbeecffe640 1 -- 10.20.193.28:0/1455152415 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14019070 con 0x5577c9b43e80 2026-02-20T03:35:21.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf0dffb640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbee00b0e20 0x7fbee00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbeecffe640 1 -- 10.20.193.28:0/1455152415 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbf140148b0 con 0x5577c9b43e80 2026-02-20T03:35:21.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbeecffe640 1 -- 10.20.193.28:0/1455152415 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140139b0 con 0x5577c9b43e80 2026-02-20T03:35:21.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf0dffb640 1 -- 10.20.193.28:0/1790278888 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbf08105290 con 0x7fbf18109490 2026-02-20T03:35:21.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1455152415 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 msgr2=0x5577c9b44280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:21.289 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.281+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1455152415 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b44280 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbf140045f0 tx=0x7fbf1400b7e0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.282+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1455152415 shutdown_connections 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.282+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1455152415 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 0x5577c9b4b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.282+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1455152415 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b48f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.282+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1455152415 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b44280 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.282+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1455152415 >> 10.20.193.28:0/1455152415 conn(0x5577c9b3b6f0 msgr2=0x5577c9b42570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.282+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1455152415 shutdown_connections 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.282+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1455152415 wait complete. 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.283+0000 7fbf1cba7640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbee00b0e20 0x7fbee00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.283+0000 7fbf21c9be00 1 -- start start 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.283+0000 7fbf21c9be00 1 Processor -- start 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.283+0000 7fbf1cba7640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbee00b0e20 0x7fbee00b32e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbf080c9f90 tx=0x7fbf08108cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:21.290 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.283+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b43e80 0x5577c9b5ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b447c0 0x5577c9b5cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b49560 0x5577c9b63ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5577c9a3c0c0 con 0x5577c9b43e80 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5577c9b4c610 con 0x5577c9b49560 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5577c9b64480 con 0x5577c9b447c0 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf0ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b447c0 0x5577c9b5cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf1d3a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b43e80 0x5577c9b5ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf0ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b447c0 0x5577c9b5cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:47892/0 (socket says 10.20.193.28:47892) 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf0ffff640 1 -- 10.20.193.28:0/2340152553 learned_addr learned my addr 10.20.193.28:0/2340152553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf0ffff640 1 -- 10.20.193.28:0/2340152553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b49560 msgr2=0x5577c9b63ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b49560 0x5577c9b63ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf0ffff640 1 -- 10.20.193.28:0/2340152553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b43e80 msgr2=0x5577c9b5ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b43e80 0x5577c9b5ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf0ffff640 1 -- 10.20.193.28:0/2340152553 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c9b56180 con 0x5577c9b447c0 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b43e80 0x5577c9b5ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b447c0 0x5577c9b5cf70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009db0 tx=0x7fbf00002ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f309be843d66289 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.284+0000 7fbeddffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbeddffb640 1 -- 10.20.193.28:0/2340152553 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00012510 con 0x5577c9b447c0 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbeddffb640 1 -- 10.20.193.28:0/2340152553 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbf00012b50 con 0x5577c9b447c0 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbeddffb640 1 -- 10.20.193.28:0/2340152553 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00010cb0 con 0x5577c9b447c0 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbf21c9be00 1 -- 10.20.193.28:0/2340152553 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c9a50820 con 0x5577c9b447c0 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbeddffb640 1 -- 10.20.193.28:0/2340152553 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbf0001c420 con 0x5577c9b447c0 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbeddffb640 10 client.28666 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:35:21.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbf21c9be00 10 client.28666 _ll_register_callbacks cb 0x5577c9a3fff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbf21c9be00 1 -- 10.20.193.28:0/2340152553 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5577c9a9c4e0 con 0x5577c9b447c0 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbeddffb640 1 -- 10.20.193.28:0/2340152553 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbf00010550 con 0x5577c9b447c0 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbf21c9be00 10 client.28666 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.285+0000 7fbf21c9be00 1 -- 10.20.193.28:0/2340152553 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5577c9a55380 con 0x5577c9b447c0 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbeddffb640 1 -- 10.20.193.28:0/2340152553 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fbf00024050 con 0x5577c9b447c0 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbf21c9be00 10 client.28666 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbf21c9be00 10 client.28666 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbf21c9be00 20 client.28666 populate_metadata read hostname 'trial028' 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c9b68930 0x5577c9b6add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbf21c9be00 4 client.28666 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbf21c9be00 1 -- 10.20.193.28:0/2340152553 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577c9a16bd0 con 0x5577c9b68930 2026-02-20T03:35:21.293 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c9b68930 0x5577c9b6add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c9b68930 0x5577c9b6add0 crc :-1 s=READY pgs=525 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86bd902ef3961057 server_cookie=626b36184fad9822 in_seq=0 out_seq=0 2026-02-20T03:35:21.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.286+0000 7fbeddffb640 10 client.28666 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:21.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.287+0000 7fbeddffb640 1 -- 10.20.193.28:0/2340152553 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5577c9a16bd0 con 0x5577c9b68930 2026-02-20T03:35:21.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.287+0000 7fbeddffb640 10 client.28666 handle_command_reply: tid=0 2026-02-20T03:35:21.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.287+0000 7fbf21c9be00 1 client.28666 shutdown 2026-02-20T03:35:21.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.287+0000 7fbf21c9be00 1 -- 10.20.193.28:0/2340152553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b447c0 msgr2=0x5577c9b5cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:21.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.287+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b447c0 0x5577c9b5cf70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009db0 tx=0x7fbf00002ab0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbf21c9be00 1 -- 10.20.193.28:0/2340152553 shutdown_connections 2026-02-20T03:35:21.295 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c9b68930 0x5577c9b6add0 crc :-1 s=READY pgs=525 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b49560 0x5577c9b63ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b447c0 0x5577c9b5cf70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/2340152553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b43e80 0x5577c9b5ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbeddffb640 0 client.28666 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:21.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbf21c9be00 1 -- 10.20.193.28:0/2340152553 >> 10.20.193.28:0/2340152553 conn(0x5577c9b3b6f0 msgr2=0x5577c9b4a910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:21.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbf21c9be00 1 -- 10.20.193.28:0/2340152553 shutdown_connections 2026-02-20T03:35:21.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbf21c9be00 1 -- 10.20.193.28:0/2340152553 wait complete. 2026-02-20T03:35:21.296 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.288+0000 7fbf21c9be00 20 client.28666 trim_cache size 0 max 16384 2026-02-20T03:35:21.298 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.295+0000 7fbf21c9be00 1 Processor -- start 2026-02-20T03:35:21.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf21c9be00 1 -- start start 2026-02-20T03:35:21.299 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b5c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b63eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 0x5577c9b5c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbec40127b0 con 0x5577c9b447c0 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbec400ffc0 con 0x5577c9b43e80 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbec400de10 con 0x5577c9b49560 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf1d3a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b5c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf1d3a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b5c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:51076/0 (socket says 10.20.193.28:51076) 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf1d3a8640 1 -- 10.20.193.28:0/513337396 learned_addr learned my addr 10.20.193.28:0/513337396 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/513337396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 0x5577c9b5c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/513337396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b63eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf0ffff640 1 -- 10.20.193.28:0/513337396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 msgr2=0x5577c9b5c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:21.300 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/513337396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 0x5577c9b5c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf0ffff640 1 -- 10.20.193.28:0/513337396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 msgr2=0x5577c9b5c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:21.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/513337396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b5c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.296+0000 7fbf0ffff640 1 -- 10.20.193.28:0/513337396 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c9b55fb0 con 0x5577c9b447c0 2026-02-20T03:35:21.301 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.297+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/513337396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b63eb0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x5577c9b5d920 tx=0x7fbf00020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21955ff02546311f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:21.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.297+0000 7fbedffff640 1 -- 10.20.193.28:0/513337396 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00012510 con 0x5577c9b447c0 2026-02-20T03:35:21.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.297+0000 7fbedffff640 1 -- 10.20.193.28:0/513337396 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5577c9a9c4e0 con 0x5577c9b447c0 2026-02-20T03:35:21.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.297+0000 7fbedffff640 1 -- 10.20.193.28:0/513337396 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00004ae0 con 0x5577c9b447c0 2026-02-20T03:35:21.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.297+0000 7fbf21c9be00 1 -- 10.20.193.28:0/513337396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 msgr2=0x5577c9b63eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:21.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.297+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/513337396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b63eb0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x5577c9b5d920 tx=0x7fbf00020000 comp rx=0 tx=0).stop 2026-02-20T03:35:21.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.299+0000 7fbf21c9be00 1 -- 10.20.193.28:0/513337396 shutdown_connections 2026-02-20T03:35:21.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.299+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/513337396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b49560 0x5577c9b5c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.299+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/513337396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b447c0 0x5577c9b63eb0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.299+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/513337396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b43e80 0x5577c9b5c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.299+0000 7fbf21c9be00 1 -- 10.20.193.28:0/513337396 >> 10.20.193.28:0/513337396 conn(0x5577c9b3b6f0 msgr2=0x5577c9b5b980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:21.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.299+0000 7fbf21c9be00 1 -- 10.20.193.28:0/513337396 shutdown_connections 2026-02-20T03:35:21.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.299+0000 7fbf21c9be00 1 -- 10.20.193.28:0/513337396 wait complete. 2026-02-20T03:35:21.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.299+0000 7fbf21c9be00 1 -- start start 2026-02-20T03:35:21.303 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.299+0000 7fbf21c9be00 1 Processor -- start 2026-02-20T03:35:21.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b43e80 0x5577c9b5fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b447c0 0x5577c9b5ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf21c9be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b49560 0x5577c9b62fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbec400e480 con 0x5577c9b49560 2026-02-20T03:35:21.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbec400f8f0 con 0x5577c9b447c0 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf21c9be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbec400eb50 con 0x5577c9b43e80 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf0ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b447c0 0x5577c9b5ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf1d3a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b49560 0x5577c9b62fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf1d3a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b49560 0x5577c9b62fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:36130/0 (socket says 10.20.193.28:36130) 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.300+0000 7fbf1d3a8640 1 -- 10.20.193.28:0/1500857994 learned_addr learned my addr 10.20.193.28:0/1500857994 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.301+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b43e80 0x5577c9b5fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.301+0000 7fbf1d3a8640 1 -- 10.20.193.28:0/1500857994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b43e80 msgr2=0x5577c9b5fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.301+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b43e80 0x5577c9b5fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.301+0000 7fbf1d3a8640 1 -- 10.20.193.28:0/1500857994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b447c0 msgr2=0x5577c9b5ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.301+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b447c0 0x5577c9b5ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.301+0000 7fbf1d3a8640 1 -- 10.20.193.28:0/1500857994 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577c97f4690 con 0x5577c9b49560 2026-02-20T03:35:21.306 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbf1d3a8640 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b49560 0x5577c9b62fb0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fbf14004c90 tx=0x7fbf1400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd96c4fa34b5df server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:21.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbeddffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:21.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbeddffb640 1 -- 10.20.193.28:0/1500857994 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14019040 con 0x5577c9b49560 2026-02-20T03:35:21.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbeddffb640 1 -- 10.20.193.28:0/1500857994 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbf140139b0 con 0x5577c9b49560 2026-02-20T03:35:21.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbeddffb640 1 -- 10.20.193.28:0/1500857994 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf140289e0 con 0x5577c9b49560 2026-02-20T03:35:21.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1500857994 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577c9a59b70 con 0x5577c9b49560 2026-02-20T03:35:21.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbeddffb640 1 -- 10.20.193.28:0/1500857994 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbf14028b80 con 0x5577c9b49560 2026-02-20T03:35:21.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbeddffb640 10 client.21078 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:35:21.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbf21c9be00 10 client.21078 _ll_register_callbacks cb 0x7fbf00009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:21.307 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1500857994 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf140148b0 con 0x5577c9b49560 2026-02-20T03:35:21.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.302+0000 7fbeddffb640 1 -- 10.20.193.28:0/1500857994 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbf14013b60 con 0x5577c9b49560 2026-02-20T03:35:21.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbf21c9be00 10 client.21078 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:21.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1500857994 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5577c9b56ca0 con 0x5577c9b49560 2026-02-20T03:35:21.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbeddffb640 1 -- 10.20.193.28:0/1500857994 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fbf14013510 con 0x5577c9b49560 2026-02-20T03:35:21.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbf21c9be00 10 client.21078 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:21.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbf21c9be00 10 client.21078 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:21.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbf21c9be00 20 client.21078 populate_metadata read hostname 'trial028' 2026-02-20T03:35:21.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c9be52e0 0x5577c9be77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:21.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbf21c9be00 4 client.21078 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:35:21.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1500857994 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5577c9a656b0 con 0x5577c9be52e0 2026-02-20T03:35:21.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.303+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c9be52e0 0x5577c9be77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:21.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.304+0000 7fbf0ffff640 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c9be52e0 0x5577c9be77a0 crc :-1 s=READY pgs=526 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c3587306ba83a4a server_cookie=9c89cd3443d99aca in_seq=0 out_seq=0 2026-02-20T03:35:21.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:21.304+0000 7fbeddffb640 10 client.21078 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:21.689 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:21 trial028 ceph-mon[38552]: pgmap v806: 129 pgs: 129 active+clean; 725 MiB data, 9.1 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 9.6 MiB/s wr, 1.19k op/s 2026-02-20T03:35:21.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:21 trial177 ceph-mon[43181]: pgmap v806: 129 pgs: 129 active+clean; 725 MiB data, 9.1 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 9.6 MiB/s wr, 1.19k op/s 2026-02-20T03:35:21.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184780 22.90 MB/sec execute 292 sec latency 399.547 ms 2026-02-20T03:35:21.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:21 trial126 ceph-mon[38476]: pgmap v806: 129 pgs: 129 active+clean; 725 MiB data, 9.1 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 9.6 MiB/s wr, 1.19k op/s 2026-02-20T03:35:22.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.475+0000 7fbeddffb640 1 -- 10.20.193.28:0/1500857994 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5577c9a656b0 con 0x5577c9be52e0 2026-02-20T03:35:22.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.475+0000 7fbeddffb640 10 client.21078 handle_command_reply: tid=0 2026-02-20T03:35:22.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.475+0000 7fbf21c9be00 1 client.21078 shutdown 2026-02-20T03:35:22.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.475+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1500857994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b49560 msgr2=0x5577c9b62fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:22.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.475+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b49560 0x5577c9b62fb0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fbf14004c90 tx=0x7fbf1400b7e0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.476+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1500857994 shutdown_connections 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.476+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5577c9be52e0 0x5577c9be77a0 crc :-1 s=READY pgs=526 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.476+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5577c9b49560 0x5577c9b62fb0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.476+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5577c9b447c0 0x5577c9b5ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.476+0000 7fbf21c9be00 1 --2- 10.20.193.28:0/1500857994 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5577c9b43e80 0x5577c9b5fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.476+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1500857994 >> 10.20.193.28:0/1500857994 conn(0x5577c9b3b6f0 msgr2=0x5577c9b59290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.476+0000 7fbeddffb640 0 client.21078 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.476+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1500857994 shutdown_connections 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.476+0000 7fbf21c9be00 1 -- 10.20.193.28:0/1500857994 wait complete. 2026-02-20T03:35:22.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.477+0000 7fbf21c9be00 20 client.21078 trim_cache size 0 max 16384 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.477+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbee00b0e20 msgr2=0x7fbee00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.477+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbee00b0e20 0x7fbee00b32e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbf080c9f90 tx=0x7fbf08108cd0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.477+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1790278888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf18109490 msgr2=0x7fbf181a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.477+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf18109490 0x7fbf181a0ff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbf08002fd0 tx=0x7fbf0802fc90 comp rx=0 tx=0).stop 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.478+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1790278888 shutdown_connections 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.478+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbee00b0e20 0x7fbee00b32e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.478+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf1810a900 0x7fbf181a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.478+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf18109e60 0x7fbf181a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.485 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.478+0000 7fbf1dba9640 1 --2- 10.20.193.28:0/1790278888 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf18109490 0x7fbf181a0ff0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:22.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.478+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1790278888 >> 10.20.193.28:0/1790278888 conn(0x7fbf18077fe0 msgr2=0x7fbf1810d600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:22.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.478+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1790278888 shutdown_connections 2026-02-20T03:35:22.486 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:22.478+0000 7fbf1dba9640 1 -- 10.20.193.28:0/1790278888 wait complete. 2026-02-20T03:35:22.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184805 22.82 MB/sec execute 293 sec latency 1394.623 ms 2026-02-20T03:35:23.667 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:23 trial028 ceph-mon[38552]: pgmap v807: 129 pgs: 129 active+clean; 731 MiB data, 9.2 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 8.7 MiB/s wr, 1.01k op/s 2026-02-20T03:35:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:23 trial177 ceph-mon[43181]: pgmap v807: 129 pgs: 129 active+clean; 731 MiB data, 9.2 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 8.7 MiB/s wr, 1.01k op/s 2026-02-20T03:35:23.718 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.75 MB/sec execute 294 sec latency 2394.688 ms 2026-02-20T03:35:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:23 trial126 ceph-mon[38476]: pgmap v807: 129 pgs: 129 active+clean; 731 MiB data, 9.2 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 8.7 MiB/s wr, 1.01k op/s 2026-02-20T03:35:24.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.67 MB/sec execute 295 sec latency 3394.731 ms 2026-02-20T03:35:25.611 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:25 trial028 ceph-mon[38552]: pgmap v808: 129 pgs: 129 active+clean; 720 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 9.5 MiB/s wr, 1.06k op/s 2026-02-20T03:35:25.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:25 trial177 ceph-mon[43181]: pgmap v808: 129 pgs: 129 active+clean; 720 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 9.5 MiB/s wr, 1.06k op/s 2026-02-20T03:35:25.718 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.59 MB/sec execute 296 sec latency 4394.772 ms 2026-02-20T03:35:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:25 trial126 ceph-mon[38476]: pgmap v808: 129 pgs: 129 active+clean; 720 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 9.5 MiB/s wr, 1.06k op/s 2026-02-20T03:35:26.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.52 MB/sec execute 297 sec latency 5394.816 ms 2026-02-20T03:35:27.514 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:27 trial028 ceph-mon[38552]: pgmap v809: 129 pgs: 129 active+clean; 730 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2026-02-20T03:35:27.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.44 MB/sec execute 298 sec latency 6394.849 ms 2026-02-20T03:35:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:27 trial126 ceph-mon[38476]: pgmap v809: 129 pgs: 129 active+clean; 730 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2026-02-20T03:35:27.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:27 trial177 ceph-mon[43181]: pgmap v809: 129 pgs: 129 active+clean; 730 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2026-02-20T03:35:28.475 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:35:28.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.37 MB/sec execute 299 sec latency 7394.890 ms 2026-02-20T03:35:28.787 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:35:29.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 -- 10.20.193.28:0/563993752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb28075950 msgr2=0x7fbb28075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:29.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/563993752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb28075950 0x7fbb28075d90 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009a30 tx=0x7fbb1002f2f0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 -- 10.20.193.28:0/563993752 shutdown_connections 2026-02-20T03:35:29.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/563993752 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb281134d0 0x7fbb28115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/563993752 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb28075950 0x7fbb28075d90 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/563993752 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb281065d0 0x7fbb28075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 -- 10.20.193.28:0/563993752 >> 10.20.193.28:0/563993752 conn(0x7fbb280fe440 msgr2=0x7fbb28100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:29.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 -- 10.20.193.28:0/563993752 shutdown_connections 2026-02-20T03:35:29.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 -- 10.20.193.28:0/563993752 wait complete. 2026-02-20T03:35:29.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.024+0000 7fbb2dae4640 1 Processor -- start 2026-02-20T03:35:29.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2dae4640 1 -- start start 2026-02-20T03:35:29.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2dae4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb28075950 0x7fbb281a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2dae4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb281065d0 0x7fbb281a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2dae4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb281134d0 0x7fbb281a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2dae4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbb281191d0 con 0x7fbb281134d0 2026-02-20T03:35:29.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2dae4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28119050 con 0x7fbb28075950 2026-02-20T03:35:29.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2dae4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28119350 con 0x7fbb281065d0 2026-02-20T03:35:29.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2d2e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb281134d0 0x7fbb281a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2d2e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb281134d0 0x7fbb281a5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35154/0 (socket says 10.20.193.28:35154) 2026-02-20T03:35:29.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.029+0000 7fbb2d2e3640 1 -- 10.20.193.28:0/1529057247 learned_addr learned my addr 10.20.193.28:0/1529057247 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:29.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb2d2e3640 1 -- 10.20.193.28:0/1529057247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb281065d0 msgr2=0x7fbb281a1c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:29.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb2d2e3640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb281065d0 0x7fbb281a1c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb2d2e3640 1 -- 10.20.193.28:0/1529057247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb28075950 msgr2=0x7fbb281a16f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:29.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb2d2e3640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb28075950 0x7fbb281a16f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb2d2e3640 1 -- 10.20.193.28:0/1529057247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb281a6740 con 0x7fbb281134d0 2026-02-20T03:35:29.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb2d2e3640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb281134d0 0x7fbb281a5fc0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400b990 tx=0x7fbb2400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:29.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb1dffb640 1 -- 10.20.193.28:0/1529057247 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24006e60 con 0x7fbb281134d0 2026-02-20T03:35:29.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb1dffb640 1 -- 10.20.193.28:0/1529057247 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb24010070 con 0x7fbb281134d0 2026-02-20T03:35:29.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb1dffb640 1 -- 10.20.193.28:0/1529057247 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24004800 con 0x7fbb281134d0 2026-02-20T03:35:29.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb2dae4640 1 -- 10.20.193.28:0/1529057247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb281a6a30 con 0x7fbb281134d0 2026-02-20T03:35:29.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.030+0000 7fbb2dae4640 1 -- 10.20.193.28:0/1529057247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb281ae270 con 0x7fbb281134d0 2026-02-20T03:35:29.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.033+0000 7fbb1dffb640 1 -- 10.20.193.28:0/1529057247 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbb2401d030 con 0x7fbb281134d0 2026-02-20T03:35:29.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.033+0000 7fbb31272e00 1 Processor -- start 2026-02-20T03:35:29.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- start start 2026-02-20T03:35:29.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 0x55d25b59d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597630 0x55d25b597a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597fb0 0x55d25b5a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d25b517e50 con 0x55d25b597630 2026-02-20T03:35:29.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d25b4ea9c0 con 0x55d25b59d000 2026-02-20T03:35:29.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d25b498240 con 0x55d25b597fb0 2026-02-20T03:35:29.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb2cae2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597630 0x55d25b597a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb2cae2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597630 0x55d25b597a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35162/0 (socket says 10.20.193.28:35162) 2026-02-20T03:35:29.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb2cae2640 1 -- 10.20.193.28:0/2135681987 learned_addr learned my addr 10.20.193.28:0/2135681987 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:29.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb2cae2640 1 -- 10.20.193.28:0/2135681987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597fb0 msgr2=0x55d25b5a3e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:29.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb2cae2640 1 --2- 10.20.193.28:0/2135681987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597fb0 0x55d25b5a3e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb2cae2640 1 -- 10.20.193.28:0/2135681987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 msgr2=0x55d25b59d3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:29.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb2cae2640 1 --2- 10.20.193.28:0/2135681987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 0x55d25b59d3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb2cae2640 1 -- 10.20.193.28:0/2135681987 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25b4ab420 con 0x55d25b597630 2026-02-20T03:35:29.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1dffb640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb040b0e20 0x7fbb040b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb2cae2640 1 --2- 10.20.193.28:0/2135681987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597630 0x55d25b597a70 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009870 tx=0x7fbb18009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa209227d839808 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:29.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbaf54e4640 1 -- 10.20.193.28:0/2135681987 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb18016070 con 0x55d25b597630 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1dffb640 1 -- 10.20.193.28:0/1529057247 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbb240dfff0 con 0x7fbb281134d0 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbaf54e4640 1 -- 10.20.193.28:0/2135681987 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb18004480 con 0x55d25b597630 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbaf54e4640 1 -- 10.20.193.28:0/2135681987 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1800bd30 con 0x55d25b597630 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- 10.20.193.28:0/2135681987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597630 msgr2=0x55d25b597a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- 10.20.193.28:0/2135681987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597630 0x55d25b597a70 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009870 tx=0x7fbb18009d40 comp rx=0 tx=0).stop 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb040b0e20 0x7fbb040b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- 10.20.193.28:0/2135681987 shutdown_connections 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- 10.20.193.28:0/2135681987 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597fb0 0x55d25b5a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- 10.20.193.28:0/2135681987 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597630 0x55d25b597a70 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- 10.20.193.28:0/2135681987 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 0x55d25b59d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- 10.20.193.28:0/2135681987 >> 10.20.193.28:0/2135681987 conn(0x55d25b55a290 msgr2=0x55d25b595d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- 10.20.193.28:0/2135681987 shutdown_connections 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- 10.20.193.28:0/2135681987 wait complete. 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb040b0e20 0x7fbb040b32e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbb1002f800 tx=0x7fbb100023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- start start 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 Processor -- start 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 0x55d25b5b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 0x55d25b5b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d25b4e68f0 con 0x55d25b597fb0 2026-02-20T03:35:29.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d25b2d8f50 con 0x55d25b59d000 2026-02-20T03:35:29.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d25b5b09e0 con 0x55d25b597630 2026-02-20T03:35:29.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35174/0 (socket says 10.20.193.28:35174) 2026-02-20T03:35:29.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 -- 10.20.193.28:0/820452837 learned_addr learned my addr 10.20.193.28:0/820452837 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:29.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 -- 10.20.193.28:0/820452837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 msgr2=0x55d25b5b1fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:29.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 0x55d25b5b1fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 -- 10.20.193.28:0/820452837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 msgr2=0x55d25b5b0450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 0x55d25b5b0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 -- 10.20.193.28:0/820452837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25b5a9ad0 con 0x55d25b597fb0 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb1ffff640 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b24e0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fbb10005d20 tx=0x7fbb1002f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86774e996bb79a58 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbae67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbae67fc640 1 -- 10.20.193.28:0/820452837 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb100045d0 con 0x55d25b597fb0 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbae67fc640 1 -- 10.20.193.28:0/820452837 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb10033040 con 0x55d25b597fb0 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbae67fc640 1 -- 10.20.193.28:0/820452837 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10045820 con 0x55d25b597fb0 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- 10.20.193.28:0/820452837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25b2bbb40 con 0x55d25b597fb0 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbae67fc640 1 -- 10.20.193.28:0/820452837 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbb100459c0 con 0x55d25b597fb0 2026-02-20T03:35:29.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 10 client.21090 _ll_register_callbacks cb 0x55d25b523f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- 10.20.193.28:0/820452837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d25b4f81a0 con 0x55d25b597fb0 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbae67fc640 1 -- 10.20.193.28:0/820452837 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbb10038ca0 con 0x55d25b597fb0 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 10 client.21090 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- 10.20.193.28:0/820452837 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55d25b4a5230 con 0x55d25b597fb0 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbae67fc640 1 -- 10.20.193.28:0/820452837 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fbb1004d070 con 0x55d25b597fb0 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 10 client.21090 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 10 client.21090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 20 client.21090 populate_metadata read hostname 'trial028' 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d25b5c0760 0x55d25b5c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 4 client.21090 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:29.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.034+0000 7fbb31272e00 1 -- 10.20.193.28:0/820452837 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d25b4f25b0 con 0x55d25b5c0760 2026-02-20T03:35:29.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.062+0000 7fbb2cae2640 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d25b5c0760 0x55d25b5c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.128+0000 7fbb2cae2640 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d25b5c0760 0x55d25b5c2c20 crc :-1 s=READY pgs=527 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=518b0b87b91905e8 server_cookie=5a837c19f28490f5 in_seq=0 out_seq=0 2026-02-20T03:35:29.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.128+0000 7fbae67fc640 10 client.21090 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:29.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbae67fc640 1 -- 10.20.193.28:0/820452837 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d25b4f25b0 con 0x55d25b5c0760 2026-02-20T03:35:29.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbae67fc640 10 client.21090 handle_command_reply: tid=0 2026-02-20T03:35:29.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 client.21090 shutdown 2026-02-20T03:35:29.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 -- 10.20.193.28:0/820452837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 msgr2=0x55d25b5b24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:29.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b24e0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fbb10005d20 tx=0x7fbb1002f2f0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 -- 10.20.193.28:0/820452837 shutdown_connections 2026-02-20T03:35:29.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d25b5c0760 0x55d25b5c2c20 crc :-1 s=READY pgs=527 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 0x55d25b5b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b24e0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 --2- 10.20.193.28:0/820452837 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 0x55d25b5b1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbae67fc640 0 client.21090 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 -- 10.20.193.28:0/820452837 >> 10.20.193.28:0/820452837 conn(0x55d25b55a290 msgr2=0x55d25b596440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 -- 10.20.193.28:0/820452837 shutdown_connections 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 1 -- 10.20.193.28:0/820452837 wait complete. 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.142+0000 7fbb31272e00 20 client.21090 trim_cache size 0 max 16384 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 Processor -- start 2026-02-20T03:35:29.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 -- start start 2026-02-20T03:35:29.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 0x55d25b58fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b597fb0 0x55d25b5ad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b59d000 0x55d25b5adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc0127b0 con 0x55d25b59d000 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc00ffc0 con 0x55d25b597fb0 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc00de10 con 0x55d25b597630 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb2d2e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b59d000 0x55d25b5adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb2d2e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b59d000 0x55d25b5adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35188/0 (socket says 10.20.193.28:35188) 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb2d2e3640 1 -- 10.20.193.28:0/1484256651 learned_addr learned my addr 10.20.193.28:0/1484256651 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb2d2e3640 1 -- 10.20.193.28:0/1484256651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 msgr2=0x55d25b58fd50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb2d2e3640 1 --2- 10.20.193.28:0/1484256651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 0x55d25b58fd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb2d2e3640 1 -- 10.20.193.28:0/1484256651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b597fb0 msgr2=0x55d25b5ad760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb2d2e3640 1 --2- 10.20.193.28:0/1484256651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b597fb0 0x55d25b5ad760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb2d2e3640 1 -- 10.20.193.28:0/1484256651 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25b5a9900 con 0x55d25b59d000 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb2d2e3640 1 --2- 10.20.193.28:0/1484256651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b59d000 0x55d25b5adca0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fbb240a3b40 tx=0x7fbb240a3350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746970731b0719e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbaf4ce3640 1 -- 10.20.193.28:0/1484256651 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb240a8410 con 0x55d25b59d000 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbaf4ce3640 1 -- 10.20.193.28:0/1484256651 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb240ac0c0 con 0x55d25b59d000 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbaf4ce3640 1 -- 10.20.193.28:0/1484256651 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb240ae530 con 0x55d25b59d000 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 -- 10.20.193.28:0/1484256651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b59d000 msgr2=0x55d25b5adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.148+0000 7fbb31272e00 1 --2- 10.20.193.28:0/1484256651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b59d000 0x55d25b5adca0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fbb240a3b40 tx=0x7fbb240a3350 comp rx=0 tx=0).stop 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 -- 10.20.193.28:0/1484256651 shutdown_connections 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 --2- 10.20.193.28:0/1484256651 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b59d000 0x55d25b5adca0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 --2- 10.20.193.28:0/1484256651 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b597fb0 0x55d25b5ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 --2- 10.20.193.28:0/1484256651 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 0x55d25b58fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 -- 10.20.193.28:0/1484256651 >> 10.20.193.28:0/1484256651 conn(0x55d25b55a290 msgr2=0x55d25b5bce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 -- 10.20.193.28:0/1484256651 shutdown_connections 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 -- 10.20.193.28:0/1484256651 wait complete. 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 -- start start 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 Processor -- start 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 0x55d25b5b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 0x55d25b5b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc00e480 con 0x55d25b597fb0 2026-02-20T03:35:29.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc00f8f0 con 0x55d25b59d000 2026-02-20T03:35:29.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb31272e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc00eb50 con 0x55d25b597630 2026-02-20T03:35:29.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb1ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35200/0 (socket says 10.20.193.28:35200) 2026-02-20T03:35:29.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb1ffff640 1 -- 10.20.193.28:0/903020045 learned_addr learned my addr 10.20.193.28:0/903020045 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:29.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb1ffff640 1 -- 10.20.193.28:0/903020045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 msgr2=0x55d25b5b4e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:29.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb1ffff640 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 0x55d25b5b4e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb1ffff640 1 -- 10.20.193.28:0/903020045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 msgr2=0x55d25b5b58f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:29.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb1ffff640 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 0x55d25b5b58f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb1ffff640 1 -- 10.20.193.28:0/903020045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25b1c9870 con 0x55d25b597fb0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbb1ffff640 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b53b0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fbb1003f040 tx=0x7fbb10038950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87dd49858298e7ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.153+0000 7fbae67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbae67fc640 1 -- 10.20.193.28:0/903020045 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb10047e60 con 0x55d25b597fb0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbae67fc640 1 -- 10.20.193.28:0/903020045 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbb10045e50 con 0x55d25b597fb0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbae67fc640 1 -- 10.20.193.28:0/903020045 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1004f910 con 0x55d25b597fb0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 1 -- 10.20.193.28:0/903020045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25b48a440 con 0x55d25b597fb0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 10 client.21096 _ll_register_callbacks cb 0x7fbb10009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 1 -- 10.20.193.28:0/903020045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d25b4bb810 con 0x55d25b597fb0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbae67fc640 1 -- 10.20.193.28:0/903020045 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbb10045a30 con 0x55d25b597fb0 2026-02-20T03:35:29.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbae67fc640 1 -- 10.20.193.28:0/903020045 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbb1004fab0 con 0x55d25b597fb0 2026-02-20T03:35:29.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 10 client.21096 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:29.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 1 -- 10.20.193.28:0/903020045 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55d25b5aa5f0 con 0x55d25b597fb0 2026-02-20T03:35:29.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbae67fc640 1 -- 10.20.193.28:0/903020045 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fbb1004d040 con 0x55d25b597fb0 2026-02-20T03:35:29.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 10 client.21096 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:29.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 10 client.21096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:29.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 20 client.21096 populate_metadata read hostname 'trial028' 2026-02-20T03:35:29.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d25b62cb10 0x55d25b62efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 4 client.21096 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:35:29.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.155+0000 7fbb31272e00 1 -- 10.20.193.28:0/903020045 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d25b49cb00 con 0x55d25b62cb10 2026-02-20T03:35:29.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.183+0000 7fbb2cae2640 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d25b62cb10 0x55d25b62efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb2cae2640 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d25b62cb10 0x55d25b62efd0 crc :-1 s=READY pgs=528 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1784f51bd5dc87df server_cookie=d3f83065468829f in_seq=0 out_seq=0 2026-02-20T03:35:29.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbae67fc640 10 client.21096 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:29.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbae67fc640 1 -- 10.20.193.28:0/903020045 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d25b49cb00 con 0x55d25b62cb10 2026-02-20T03:35:29.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbae67fc640 10 client.21096 handle_command_reply: tid=0 2026-02-20T03:35:29.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb31272e00 1 client.21096 shutdown 2026-02-20T03:35:29.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb31272e00 1 -- 10.20.193.28:0/903020045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 msgr2=0x55d25b5b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:29.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb31272e00 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b53b0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fbb1003f040 tx=0x7fbb10038950 comp rx=0 tx=0).stop 2026-02-20T03:35:29.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb31272e00 1 -- 10.20.193.28:0/903020045 shutdown_connections 2026-02-20T03:35:29.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb31272e00 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d25b62cb10 0x55d25b62efd0 crc :-1 s=READY pgs=528 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb31272e00 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d25b59d000 0x55d25b5b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb31272e00 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d25b597fb0 0x55d25b5b53b0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb31272e00 1 --2- 10.20.193.28:0/903020045 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d25b597630 0x55d25b5b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbb31272e00 1 -- 10.20.193.28:0/903020045 >> 10.20.193.28:0/903020045 conn(0x55d25b55a290 msgr2=0x55d25b5c0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:29.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.210+0000 7fbae67fc640 0 client.21096 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:29.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.214+0000 7fbb31272e00 1 -- 10.20.193.28:0/903020045 shutdown_connections 2026-02-20T03:35:29.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.214+0000 7fbb31272e00 1 -- 10.20.193.28:0/903020045 wait complete. 2026-02-20T03:35:29.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.214+0000 7fbb31272e00 20 client.21096 trim_cache size 0 max 16384 2026-02-20T03:35:29.227 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:35:29.227 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:35:29.227 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:35:29.227 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:35:29.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.214+0000 7fbb2dae4640 1 -- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb040b0e20 msgr2=0x7fbb040b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:29.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb040b0e20 0x7fbb040b32e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbb1002f800 tx=0x7fbb100023d0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 -- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb281134d0 msgr2=0x7fbb281a5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:29.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb281134d0 0x7fbb281a5fc0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400b990 tx=0x7fbb2400be60 comp rx=0 tx=0).stop 2026-02-20T03:35:29.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 -- 10.20.193.28:0/1529057247 shutdown_connections 2026-02-20T03:35:29.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbb040b0e20 0x7fbb040b32e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbb281134d0 0x7fbb281a5fc0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbb281065d0 0x7fbb281a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 --2- 10.20.193.28:0/1529057247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbb28075950 0x7fbb281a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 -- 10.20.193.28:0/1529057247 >> 10.20.193.28:0/1529057247 conn(0x7fbb280fe440 msgr2=0x7fbb28114ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:29.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 -- 10.20.193.28:0/1529057247 shutdown_connections 2026-02-20T03:35:29.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.216+0000 7fbb2dae4640 1 -- 10.20.193.28:0/1529057247 wait complete. 2026-02-20T03:35:29.389 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:35:29.389 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:35:29.673 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:29 trial028 ceph-mon[38552]: pgmap v810: 129 pgs: 129 active+clean; 717 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 11 MiB/s wr, 1.05k op/s 2026-02-20T03:35:29.715 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:35:29.727 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.29 MB/sec execute 300 sec latency 8394.928 ms 2026-02-20T03:35:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:29 trial126 ceph-mon[38476]: pgmap v810: 129 pgs: 129 active+clean; 717 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 11 MiB/s wr, 1.05k op/s 2026-02-20T03:35:29.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.959+0000 7f820f577640 1 -- 10.20.193.28:0/2979205231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 msgr2=0x7f8210111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:29.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.959+0000 7f820f577640 1 --2- 10.20.193.28:0/2979205231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 0x7f8210111850 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f820000b0d0 tx=0x7f820002f490 comp rx=0 tx=0).stop 2026-02-20T03:35:29.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- 10.20.193.28:0/2979205231 shutdown_connections 2026-02-20T03:35:29.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 --2- 10.20.193.28:0/2979205231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 0x7f8210111850 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 --2- 10.20.193.28:0/2979205231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8210104980 0x7f8210104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 --2- 10.20.193.28:0/2979205231 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f821010a980 0x7f821010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- 10.20.193.28:0/2979205231 >> 10.20.193.28:0/2979205231 conn(0x7f8210100680 msgr2=0x7f8210102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:29.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- 10.20.193.28:0/2979205231 shutdown_connections 2026-02-20T03:35:29.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- 10.20.193.28:0/2979205231 wait complete. 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 Processor -- start 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- start start 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8210104980 0x7f821019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 0x7f821019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f821010a980 0x7f82101a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8210114cd0 con 0x7f8210105320 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8210114b50 con 0x7f821010a980 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8210114e50 con 0x7f8210104980 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 0x7f821019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 0x7f821019d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35226/0 (socket says 10.20.193.28:35226) 2026-02-20T03:35:29.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820dd74640 1 -- 10.20.193.28:0/4077706748 learned_addr learned my addr 10.20.193.28:0/4077706748 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:29.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820dd74640 1 -- 10.20.193.28:0/4077706748 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8210104980 msgr2=0x7f821019d1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:29.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820dd74640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8210104980 0x7f821019d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820dd74640 1 -- 10.20.193.28:0/4077706748 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f821010a980 msgr2=0x7f82101a1a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:29.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:29 trial177 ceph-mon[43181]: pgmap v810: 129 pgs: 129 active+clean; 717 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 11 MiB/s wr, 1.05k op/s 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820dd74640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f821010a980 0x7f82101a1a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820dd74640 1 -- 10.20.193.28:0/4077706748 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82101a2200 con 0x7f8210105320 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820dd74640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 0x7f821019d6f0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f81f800b570 tx=0x7f81f800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f81f77fe640 1 -- 10.20.193.28:0/4077706748 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8013020 con 0x7f8210105320 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f81f77fe640 1 -- 10.20.193.28:0/4077706748 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f81f8004480 con 0x7f8210105320 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82101a24f0 con 0x7f8210105320 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f81f77fe640 1 -- 10.20.193.28:0/4077706748 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f800fb50 con 0x7f8210105320 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82101a9d30 con 0x7f8210105320 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8210104e60 con 0x7f8210105320 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.961+0000 7f81f77fe640 1 -- 10.20.193.28:0/4077706748 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f81f8002780 con 0x7f8210105320 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.966+0000 7f81f77fe640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81e80b0e20 0x7f81e80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.966+0000 7f81f77fe640 1 -- 10.20.193.28:0/4077706748 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f81f80e0580 con 0x7f8210105320 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.966+0000 7f820e575640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81e80b0e20 0x7f81e80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.966+0000 7f820e575640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81e80b0e20 0x7f81e80b32e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8204009770 tx=0x7f8204006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:29.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:29.966+0000 7f81f77fe640 1 -- 10.20.193.28:0/4077706748 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f81f801d020 con 0x7f8210105320 2026-02-20T03:35:30.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.076+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f821010ca50 con 0x7f8210105320 2026-02-20T03:35:30.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.076+0000 7f81f77fe640 1 -- 10.20.193.28:0/4077706748 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11927 (secure 0 0 0) 0x7f81f80a8960 con 0x7f8210105320 2026-02-20T03:35:30.080 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:35:30.081 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":48,"btime":"2026-02-20T03:35:09:352789+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:35:09.177379+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:35:30.081 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 48 2026-02-20T03:35:30.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81e80b0e20 msgr2=0x7f81e80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:30.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81e80b0e20 0x7f81e80b32e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8204009770 tx=0x7f8204006cd0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 msgr2=0x7f821019d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:30.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 0x7f821019d6f0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f81f800b570 tx=0x7f81f800ba40 comp rx=0 tx=0).stop 2026-02-20T03:35:30.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 shutdown_connections 2026-02-20T03:35:30.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f81e80b0e20 0x7f81e80b32e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f821010a980 0x7f82101a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8210105320 0x7f821019d6f0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.093 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 --2- 10.20.193.28:0/4077706748 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8210104980 0x7f821019d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 >> 10.20.193.28:0/4077706748 conn(0x7f8210100680 msgr2=0x7f8210100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:30.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 shutdown_connections 2026-02-20T03:35:30.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.077+0000 7f820f577640 1 -- 10.20.193.28:0/4077706748 wait complete. 2026-02-20T03:35:30.222 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:35:30.558 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:35:30.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.22 MB/sec execute 301 sec latency 9394.959 ms 2026-02-20T03:35:30.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:30 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/4077706748' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:35:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.793+0000 7f658d778640 1 -- 10.20.193.28:0/1944909906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588077f40 msgr2=0x7f6588113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.793+0000 7f658d778640 1 --2- 10.20.193.28:0/1944909906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588077f40 0x7f6588113310 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f6578009a30 tx=0x7f657802f260 comp rx=0 tx=0).stop 2026-02-20T03:35:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.793+0000 7f658d778640 1 -- 10.20.193.28:0/1944909906 shutdown_connections 2026-02-20T03:35:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.793+0000 7f658d778640 1 --2- 10.20.193.28:0/1944909906 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6588113850 0x7f6588115c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.793+0000 7f658d778640 1 --2- 10.20.193.28:0/1944909906 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588077f40 0x7f6588113310 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.793+0000 7f658d778640 1 --2- 10.20.193.28:0/1944909906 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6588077620 0x7f6588077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.793+0000 7f658d778640 1 -- 10.20.193.28:0/1944909906 >> 10.20.193.28:0/1944909906 conn(0x7f6588100690 msgr2=0x7f6588102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:30.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.793+0000 7f658d778640 1 -- 10.20.193.28:0/1944909906 shutdown_connections 2026-02-20T03:35:30.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.793+0000 7f658d778640 1 -- 10.20.193.28:0/1944909906 wait complete. 2026-02-20T03:35:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 Processor -- start 2026-02-20T03:35:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 -- start start 2026-02-20T03:35:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6588077620 0x7f65881a7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6588077f40 0x7f65881a7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588113850 0x7f65881a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6588119320 con 0x7f6588113850 2026-02-20T03:35:30.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f65881191a0 con 0x7f6588077620 2026-02-20T03:35:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f65881194a0 con 0x7f6588077f40 2026-02-20T03:35:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658cf77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588113850 0x7f65881a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658cf77640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588113850 0x7f65881a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35242/0 (socket says 10.20.193.28:35242) 2026-02-20T03:35:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658cf77640 1 -- 10.20.193.28:0/3928524893 learned_addr learned my addr 10.20.193.28:0/3928524893 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658cf77640 1 -- 10.20.193.28:0/3928524893 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6588077f40 msgr2=0x7f65881a7940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:30.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658cf77640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6588077f40 0x7f65881a7940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658cf77640 1 -- 10.20.193.28:0/3928524893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6588077620 msgr2=0x7f65881a7400 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:30.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658cf77640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6588077620 0x7f65881a7400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658cf77640 1 -- 10.20.193.28:0/3928524893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65881a1d90 con 0x7f6588113850 2026-02-20T03:35:30.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658cf77640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588113850 0x7f65881a15c0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f657c00b9e0 tx=0x7f657c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:30.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65857fa640 1 -- 10.20.193.28:0/3928524893 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c006e60 con 0x7f6588113850 2026-02-20T03:35:30.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65857fa640 1 -- 10.20.193.28:0/3928524893 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f657c010070 con 0x7f6588113850 2026-02-20T03:35:30.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65857fa640 1 -- 10.20.193.28:0/3928524893 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c0047f0 con 0x7f6588113850 2026-02-20T03:35:30.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 -- 10.20.193.28:0/3928524893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65881a2080 con 0x7f6588113850 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f658d778640 1 -- 10.20.193.28:0/3928524893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65881ae2d0 con 0x7f6588113850 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65857fa640 1 -- 10.20.193.28:0/3928524893 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f657c00c790 con 0x7f6588113850 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f6590f06e00 1 Processor -- start 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f6590f06e00 1 -- start start 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 0x5603f6b7d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b775e0 0x5603f6b77a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b83de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f6590f06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5603f6af7e00 con 0x5603f6b77f60 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f6590f06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5603f6aca970 con 0x5603f6b775e0 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f6590f06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5603f6a781f0 con 0x5603f6b7cfb0 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b83de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:30.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b83de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35246/0 (socket says 10.20.193.28:35246) 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65877fe640 1 -- 10.20.193.28:0/2757823535 learned_addr learned my addr 10.20.193.28:0/2757823535 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65877fe640 1 -- 10.20.193.28:0/2757823535 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 msgr2=0x5603f6b7d390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65877fe640 1 --2- 10.20.193.28:0/2757823535 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 0x5603f6b7d390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65877fe640 1 -- 10.20.193.28:0/2757823535 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b775e0 msgr2=0x5603f6b77a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65877fe640 1 --2- 10.20.193.28:0/2757823535 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b775e0 0x5603f6b77a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65877fe640 1 -- 10.20.193.28:0/2757823535 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f6a8b3d0 con 0x5603f6b77f60 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65877fe640 1 --2- 10.20.193.28:0/2757823535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b83de0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f6578009950 tx=0x7f65780057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58864e285107c7e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.794+0000 7f65857fa640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f655c0b0e20 0x7f655c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6558ce3640 1 -- 10.20.193.28:0/2757823535 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578002d90 con 0x5603f6b77f60 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6558ce3640 1 -- 10.20.193.28:0/2757823535 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6578033040 con 0x5603f6b77f60 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6558ce3640 1 -- 10.20.193.28:0/2757823535 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780043d0 con 0x5603f6b77f60 2026-02-20T03:35:30.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f65857fa640 1 -- 10.20.193.28:0/3928524893 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f657c0e03a0 con 0x7f6588113850 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6587fff640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f655c0b0e20 0x7f655c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6590f06e00 1 -- 10.20.193.28:0/2757823535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 msgr2=0x5603f6b83de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2757823535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b83de0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f6578009950 tx=0x7f65780057d0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6590f06e00 1 -- 10.20.193.28:0/2757823535 shutdown_connections 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2757823535 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b83de0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2757823535 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b775e0 0x5603f6b77a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2757823535 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 0x5603f6b7d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6590f06e00 1 -- 10.20.193.28:0/2757823535 >> 10.20.193.28:0/2757823535 conn(0x5603f6b3a240 msgr2=0x5603f6b75ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6590f06e00 1 -- 10.20.193.28:0/2757823535 shutdown_connections 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6590f06e00 1 -- 10.20.193.28:0/2757823535 wait complete. 2026-02-20T03:35:30.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.800+0000 7f6587fff640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f655c0b0e20 0x7f655c0b32e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f65740096f0 tx=0x7f6574006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:30.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 -- start start 2026-02-20T03:35:30.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 Processor -- start 2026-02-20T03:35:30.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b91860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b77f60 0x5603f6b91da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 0x5603f6b8ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5603f6ac68a0 con 0x5603f6b775e0 2026-02-20T03:35:30.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5603f68b8f50 con 0x5603f6b77f60 2026-02-20T03:35:30.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5603f6b90720 con 0x5603f6b7cfb0 2026-02-20T03:35:30.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6587fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b91860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:30.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6587fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b91860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35256/0 (socket says 10.20.193.28:35256) 2026-02-20T03:35:30.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6587fff640 1 -- 10.20.193.28:0/2977788156 learned_addr learned my addr 10.20.193.28:0/2977788156 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:30.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6587fff640 1 -- 10.20.193.28:0/2977788156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 msgr2=0x5603f6b8ffa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:30.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6587fff640 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 0x5603f6b8ffa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6587fff640 1 -- 10.20.193.28:0/2977788156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b77f60 msgr2=0x5603f6b91da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:30.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6587fff640 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b77f60 0x5603f6b91da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6587fff640 1 -- 10.20.193.28:0/2977788156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f6b89a30 con 0x5603f6b775e0 2026-02-20T03:35:30.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6587fff640 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b91860 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f65740046a0 tx=0x7f65740047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c5bd09e4e73980 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:30.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6549ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:30.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6549ffb640 1 -- 10.20.193.28:0/2977788156 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657400b760 con 0x5603f6b775e0 2026-02-20T03:35:30.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6549ffb640 1 -- 10.20.193.28:0/2977788156 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f657400bda0 con 0x5603f6b775e0 2026-02-20T03:35:30.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6549ffb640 1 -- 10.20.193.28:0/2977788156 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574011420 con 0x5603f6b775e0 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 -- 10.20.193.28:0/2977788156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603f689bb40 con 0x5603f6b775e0 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6549ffb640 1 -- 10.20.193.28:0/2977788156 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6574020430 con 0x5603f6b775e0 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 10 client.21114 _ll_register_callbacks cb 0x5603f6b03eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 -- 10.20.193.28:0/2977788156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603f6ad8150 con 0x5603f6b775e0 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6549ffb640 1 -- 10.20.193.28:0/2977788156 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6574020630 con 0x5603f6b775e0 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 10 client.21114 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 -- 10.20.193.28:0/2977788156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5603f6a851e0 con 0x5603f6b775e0 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6549ffb640 1 -- 10.20.193.28:0/2977788156 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f657400b900 con 0x5603f6b775e0 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 10 client.21114 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 10 client.21114 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 20 client.21114 populate_metadata read hostname 'trial028' 2026-02-20T03:35:30.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5603f6ba0150 0x5603f6ba25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 4 client.21114 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:30.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.801+0000 7f6590f06e00 1 -- 10.20.193.28:0/2977788156 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603f6ad2560 con 0x5603f6ba0150 2026-02-20T03:35:30.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.828+0000 7f65877fe640 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5603f6ba0150 0x5603f6ba25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:30.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:30 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/4077706748' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:35:30.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.856+0000 7f6549ffb640 10 client.21114 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:35:30.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.856+0000 7f65877fe640 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5603f6ba0150 0x5603f6ba25f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b73e473e56785cb8 server_cookie=649bd590d3565cb6 in_seq=0 out_seq=0 2026-02-20T03:35:30.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6549ffb640 1 -- 10.20.193.28:0/2977788156 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5603f6ad2560 con 0x5603f6ba0150 2026-02-20T03:35:30.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6549ffb640 10 client.21114 handle_command_reply: tid=0 2026-02-20T03:35:30.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 client.21114 shutdown 2026-02-20T03:35:30.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 -- 10.20.193.28:0/2977788156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 msgr2=0x5603f6b91860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:30.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b91860 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f65740046a0 tx=0x7f65740047e0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 -- 10.20.193.28:0/2977788156 shutdown_connections 2026-02-20T03:35:30.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 0x5603f6b8ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b77f60 0x5603f6b91da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5603f6ba0150 0x5603f6ba25f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2977788156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b91860 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 -- 10.20.193.28:0/2977788156 >> 10.20.193.28:0/2977788156 conn(0x5603f6b3a240 msgr2=0x5603f6b763f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:30.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6549ffb640 0 client.21114 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:35:30.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.870+0000 7f6590f06e00 1 -- 10.20.193.28:0/2977788156 shutdown_connections 2026-02-20T03:35:30.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.872+0000 7f6590f06e00 1 -- 10.20.193.28:0/2977788156 wait complete. 2026-02-20T03:35:30.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.872+0000 7f6590f06e00 20 client.21114 trim_cache size 0 max 16384 2026-02-20T03:35:30.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 Processor -- start 2026-02-20T03:35:30.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- start start 2026-02-20T03:35:30.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b775e0 0x5603f6ba2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b764d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b7cfb0 0x5603f6b76a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6528012880 con 0x5603f6b77f60 2026-02-20T03:35:30.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6528010090 con 0x5603f6b7cfb0 2026-02-20T03:35:30.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f652800dee0 con 0x5603f6b775e0 2026-02-20T03:35:30.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f65877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:30.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f65877fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b764d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35262/0 (socket says 10.20.193.28:35262) 2026-02-20T03:35:30.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f65877fe640 1 -- 10.20.193.28:0/4242719027 learned_addr learned my addr 10.20.193.28:0/4242719027 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:30.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f65877fe640 1 -- 10.20.193.28:0/4242719027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b775e0 msgr2=0x5603f6ba2160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:30.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f65877fe640 1 --2- 10.20.193.28:0/4242719027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b775e0 0x5603f6ba2160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f65877fe640 1 -- 10.20.193.28:0/4242719027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b7cfb0 msgr2=0x5603f6b76a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:30.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f65877fe640 1 --2- 10.20.193.28:0/4242719027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b7cfb0 0x5603f6b76a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f65877fe640 1 -- 10.20.193.28:0/4242719027 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f6b89860 con 0x5603f6b77f60 2026-02-20T03:35:30.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f65877fe640 1 --2- 10.20.193.28:0/4242719027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b764d0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f657802f900 tx=0x7f6578002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04bcaa1be9d418 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:30.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f654bfff640 1 -- 10.20.193.28:0/4242719027 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657802fac0 con 0x5603f6b77f60 2026-02-20T03:35:30.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f654bfff640 1 -- 10.20.193.28:0/4242719027 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f657802fc60 con 0x5603f6b77f60 2026-02-20T03:35:30.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- 10.20.193.28:0/4242719027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 msgr2=0x5603f6b764d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:30.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- 10.20.193.28:0/4242719027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b764d0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f657802f900 tx=0x7f6578002b90 comp rx=0 tx=0).stop 2026-02-20T03:35:30.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- 10.20.193.28:0/4242719027 shutdown_connections 2026-02-20T03:35:30.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- 10.20.193.28:0/4242719027 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b7cfb0 0x5603f6b76a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- 10.20.193.28:0/4242719027 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b77f60 0x5603f6b764d0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- 10.20.193.28:0/4242719027 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b775e0 0x5603f6ba2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- 10.20.193.28:0/4242719027 >> 10.20.193.28:0/4242719027 conn(0x5603f6b3a240 msgr2=0x5603f6b8f040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:30.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- 10.20.193.28:0/4242719027 shutdown_connections 2026-02-20T03:35:30.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- 10.20.193.28:0/4242719027 wait complete. 2026-02-20T03:35:30.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- start start 2026-02-20T03:35:30.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 Processor -- start 2026-02-20T03:35:30.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b97810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b77f60 0x5603f6b97d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 0x5603f6b94d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f652800e550 con 0x5603f6b775e0 2026-02-20T03:35:30.890 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f652800f9c0 con 0x5603f6b77f60 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6590f06e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f652800ec20 con 0x5603f6b7cfb0 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6587fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b97810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6587fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b97810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35266/0 (socket says 10.20.193.28:35266) 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.877+0000 7f6587fff640 1 -- 10.20.193.28:0/2292813179 learned_addr learned my addr 10.20.193.28:0/2292813179 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6587fff640 1 -- 10.20.193.28:0/2292813179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 msgr2=0x5603f6b94d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6587fff640 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 0x5603f6b94d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6587fff640 1 -- 10.20.193.28:0/2292813179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b77f60 msgr2=0x5603f6b97d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6587fff640 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b77f60 0x5603f6b97d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6587fff640 1 -- 10.20.193.28:0/2292813179 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f67a9870 con 0x5603f6b775e0 2026-02-20T03:35:30.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6587fff640 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b97810 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f65740093d0 tx=0x7f657400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4e6131f6688157 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6549ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6549ffb640 1 -- 10.20.193.28:0/2292813179 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574035070 con 0x5603f6b775e0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6549ffb640 1 -- 10.20.193.28:0/2292813179 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6574017040 con 0x5603f6b775e0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6549ffb640 1 -- 10.20.193.28:0/2292813179 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65740116f0 con 0x5603f6b775e0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6590f06e00 1 -- 10.20.193.28:0/2292813179 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603f6a6a3f0 con 0x5603f6b775e0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6590f06e00 10 client.21120 _ll_register_callbacks cb 0x7f6574009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6549ffb640 1 -- 10.20.193.28:0/2292813179 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f657400b760 con 0x5603f6b775e0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6590f06e00 1 -- 10.20.193.28:0/2292813179 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603f6a7cab0 con 0x5603f6b775e0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6549ffb640 1 -- 10.20.193.28:0/2292813179 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f657400b960 con 0x5603f6b775e0 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6590f06e00 10 client.21120 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:30.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.882+0000 7f6590f06e00 1 -- 10.20.193.28:0/2292813179 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5603f6b8a550 con 0x5603f6b775e0 2026-02-20T03:35:30.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.883+0000 7f6549ffb640 1 -- 10.20.193.28:0/2292813179 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f65740208c0 con 0x5603f6b775e0 2026-02-20T03:35:30.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.883+0000 7f6590f06e00 10 client.21120 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:30.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.883+0000 7f6590f06e00 10 client.21120 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:35:30.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.883+0000 7f6590f06e00 20 client.21120 populate_metadata read hostname 'trial028' 2026-02-20T03:35:30.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.883+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5603f6c0cf10 0x5603f6c0f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:30.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.883+0000 7f6590f06e00 4 client.21120 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:35:30.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.883+0000 7f6590f06e00 1 -- 10.20.193.28:0/2292813179 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f657802fc60 con 0x5603f6c0cf10 2026-02-20T03:35:30.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.911+0000 7f65877fe640 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5603f6c0cf10 0x5603f6c0f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:30.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.925+0000 7f65877fe640 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5603f6c0cf10 0x5603f6c0f3d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bfb57aa3484fbbc server_cookie=13b10c704a8b7fdf in_seq=0 out_seq=0 2026-02-20T03:35:30.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.925+0000 7f6549ffb640 10 client.21120 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:35:30.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6549ffb640 1 -- 10.20.193.28:0/2292813179 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f657802fc60 con 0x5603f6c0cf10 2026-02-20T03:35:30.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6549ffb640 10 client.21120 handle_command_reply: tid=0 2026-02-20T03:35:30.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6590f06e00 1 client.21120 shutdown 2026-02-20T03:35:30.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6590f06e00 1 -- 10.20.193.28:0/2292813179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 msgr2=0x5603f6b97810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:30.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b97810 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f65740093d0 tx=0x7f657400bd60 comp rx=0 tx=0).stop 2026-02-20T03:35:30.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6590f06e00 1 -- 10.20.193.28:0/2292813179 shutdown_connections 2026-02-20T03:35:30.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f6b7cfb0 0x5603f6b94d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f6b77f60 0x5603f6b97d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5603f6c0cf10 0x5603f6c0f3d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6590f06e00 1 --2- 10.20.193.28:0/2292813179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f6b775e0 0x5603f6b97810 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.938+0000 7f6590f06e00 1 -- 10.20.193.28:0/2292813179 >> 10.20.193.28:0/2292813179 conn(0x5603f6b3a240 msgr2=0x5603f6b78a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:30.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f6549ffb640 0 client.21120 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:35:30.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f6590f06e00 1 -- 10.20.193.28:0/2292813179 shutdown_connections 2026-02-20T03:35:30.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f6590f06e00 1 -- 10.20.193.28:0/2292813179 wait complete. 2026-02-20T03:35:30.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f6590f06e00 20 client.21120 trim_cache size 0 max 16384 2026-02-20T03:35:30.954 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:35:30.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 -- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f655c0b0e20 msgr2=0x7f655c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:30.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f655c0b0e20 0x7f655c0b32e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f65740096f0 tx=0x7f6574006cd0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 -- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588113850 msgr2=0x7f65881a15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:30.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588113850 0x7f65881a15c0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f657c00b9e0 tx=0x7f657c00beb0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 -- 10.20.193.28:0/3928524893 shutdown_connections 2026-02-20T03:35:30.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f655c0b0e20 0x7f655c0b32e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6588113850 0x7f65881a15c0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6588077f40 0x7f65881a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 --2- 10.20.193.28:0/3928524893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6588077620 0x7f65881a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:30.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 -- 10.20.193.28:0/3928524893 >> 10.20.193.28:0/3928524893 conn(0x7f6588100690 msgr2=0x7f6588102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:30.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 -- 10.20.193.28:0/3928524893 shutdown_connections 2026-02-20T03:35:30.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:30.939+0000 7f658d778640 1 -- 10.20.193.28:0/3928524893 wait complete. 2026-02-20T03:35:30.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:30 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/4077706748' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:35:31.113 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:35:31.437 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:35:31.616 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:31 trial028 ceph-mon[38552]: pgmap v811: 129 pgs: 129 active+clean; 738 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 13 MiB/s wr, 994 op/s 2026-02-20T03:35:31.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- 10.20.193.28:0/3456724724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d460 msgr2=0x7f9068074660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:31.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3456724724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d460 0x7f9068074660 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f9058009a60 tx=0x7f905802f290 comp rx=0 tx=0).stop 2026-02-20T03:35:31.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- 10.20.193.28:0/3456724724 shutdown_connections 2026-02-20T03:35:31.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3456724724 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9068117da0 0x7f906811a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3456724724 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d460 0x7f9068074660 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3456724724 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f906810d080 0x7f9068074120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- 10.20.193.28:0/3456724724 >> 10.20.193.28:0/3456724724 conn(0x7f906806ead0 msgr2=0x7f906806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:31.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- 10.20.193.28:0/3456724724 shutdown_connections 2026-02-20T03:35:31.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- 10.20.193.28:0/3456724724 wait complete. 2026-02-20T03:35:31.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 Processor -- start 2026-02-20T03:35:31.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- start start 2026-02-20T03:35:31.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d080 0x7f90681ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9068117da0 0x7f90681abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90681a5ad0 0x7f90681a5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f906811d760 con 0x7f906810d080 2026-02-20T03:35:31.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f906811d5e0 con 0x7f9068117da0 2026-02-20T03:35:31.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f906811d8e0 con 0x7f90681a5ad0 2026-02-20T03:35:31.706 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d080 0x7f90681ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:31.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d080 0x7f90681ab910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35284/0 (socket says 10.20.193.28:35284) 2026-02-20T03:35:31.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905ffff640 1 -- 10.20.193.28:0/3185743618 learned_addr learned my addr 10.20.193.28:0/3185743618 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:31.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905ffff640 1 -- 10.20.193.28:0/3185743618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90681a5ad0 msgr2=0x7f90681a5f80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:31.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905ffff640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90681a5ad0 0x7f90681a5f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905ffff640 1 -- 10.20.193.28:0/3185743618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9068117da0 msgr2=0x7f90681abe50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:31.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905ffff640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9068117da0 0x7f90681abe50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905ffff640 1 -- 10.20.193.28:0/3185743618 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90681a66b0 con 0x7f906810d080 2026-02-20T03:35:31.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905ffff640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d080 0x7f90681ab910 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f905000b570 tx=0x7f905000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:31.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905d7fa640 1 -- 10.20.193.28:0/3185743618 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9050013020 con 0x7f906810d080 2026-02-20T03:35:31.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905d7fa640 1 -- 10.20.193.28:0/3185743618 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9050004480 con 0x7f906810d080 2026-02-20T03:35:31.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- 10.20.193.28:0/3185743618 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90681b27e0 con 0x7f906810d080 2026-02-20T03:35:31.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f905d7fa640 1 -- 10.20.193.28:0/3185743618 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905000fb50 con 0x7f906810d080 2026-02-20T03:35:31.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.697+0000 7f906d7d2640 1 -- 10.20.193.28:0/3185743618 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90681b2c30 con 0x7f906810d080 2026-02-20T03:35:31.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.702+0000 7f905d7fa640 1 -- 10.20.193.28:0/3185743618 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9050002780 con 0x7f906810d080 2026-02-20T03:35:31.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.702+0000 7f9070f60e00 1 Processor -- start 2026-02-20T03:35:31.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.702+0000 7f9070f60e00 1 -- start start 2026-02-20T03:35:31.712 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905d7fa640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90440b0e20 0x7f90440b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905d7fa640 1 -- 10.20.193.28:0/3185743618 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f90500e0580 con 0x7f906810d080 2026-02-20T03:35:31.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd94fb0 0x561c2cd95390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd8fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8ff60 0x561c2cd9bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c2cd0fe00 con 0x561c2cd8f5e0 2026-02-20T03:35:31.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561c2cce2970 con 0x561c2cd8ff60 2026-02-20T03:35:31.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561c2cc901f0 con 0x561c2cd94fb0 2026-02-20T03:35:31.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f906cfd1640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90440b0e20 0x7f90440b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:31.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd8fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:31.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd8fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35300/0 (socket says 10.20.193.28:35300) 2026-02-20T03:35:31.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905f7fe640 1 -- 10.20.193.28:0/2049772543 learned_addr learned my addr 10.20.193.28:0/2049772543 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:31.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905f7fe640 1 -- 10.20.193.28:0/2049772543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd94fb0 msgr2=0x561c2cd95390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:31.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905f7fe640 1 --2- 10.20.193.28:0/2049772543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd94fb0 0x561c2cd95390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905f7fe640 1 -- 10.20.193.28:0/2049772543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8ff60 msgr2=0x561c2cd9bde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:31.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905f7fe640 1 --2- 10.20.193.28:0/2049772543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8ff60 0x561c2cd9bde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.717 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905f7fe640 1 -- 10.20.193.28:0/2049772543 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c2cca33d0 con 0x561c2cd8f5e0 2026-02-20T03:35:31.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f906cfd1640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90440b0e20 0x7f90440b32e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f906400ab00 tx=0x7f90640092c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:31.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f905f7fe640 1 --2- 10.20.193.28:0/2049772543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd8fa20 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f9058009a60 tx=0x7f9058005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ddc93af0181362 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:31.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f903cce3640 1 -- 10.20.193.28:0/2049772543 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90580384f0 con 0x561c2cd8f5e0 2026-02-20T03:35:31.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f903cce3640 1 -- 10.20.193.28:0/2049772543 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9058033040 con 0x561c2cd8f5e0 2026-02-20T03:35:31.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f903cce3640 1 -- 10.20.193.28:0/2049772543 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058004290 con 0x561c2cd8f5e0 2026-02-20T03:35:31.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 -- 10.20.193.28:0/2049772543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 msgr2=0x561c2cd8fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:31.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 --2- 10.20.193.28:0/2049772543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd8fa20 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f9058009a60 tx=0x7f9058005ce0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 -- 10.20.193.28:0/2049772543 shutdown_connections 2026-02-20T03:35:31.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 --2- 10.20.193.28:0/2049772543 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8ff60 0x561c2cd9bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 --2- 10.20.193.28:0/2049772543 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd8fa20 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 --2- 10.20.193.28:0/2049772543 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd94fb0 0x561c2cd95390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 -- 10.20.193.28:0/2049772543 >> 10.20.193.28:0/2049772543 conn(0x561c2cd52240 msgr2=0x561c2cd8dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:31.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 -- 10.20.193.28:0/2049772543 shutdown_connections 2026-02-20T03:35:31.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.705+0000 7f9070f60e00 1 -- 10.20.193.28:0/2049772543 wait complete. 2026-02-20T03:35:31.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 -- start start 2026-02-20T03:35:31.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 Processor -- start 2026-02-20T03:35:31.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8f5e0 0x561c2cda9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd8ff60 0x561c2cdaa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd94fb0 0x561c2cda8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561c2ccde8a0 con 0x561c2cd94fb0 2026-02-20T03:35:31.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561c2cad0f50 con 0x561c2cd8f5e0 2026-02-20T03:35:31.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561c2cda8ca0 con 0x561c2cd8ff60 2026-02-20T03:35:31.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f906cfd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd94fb0 0x561c2cda8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f906cfd1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd94fb0 0x561c2cda8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35308/0 (socket says 10.20.193.28:35308) 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f906cfd1640 1 -- 10.20.193.28:0/957708489 learned_addr learned my addr 10.20.193.28:0/957708489 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f906cfd1640 1 -- 10.20.193.28:0/957708489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd8ff60 msgr2=0x561c2cdaa3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f906cfd1640 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd8ff60 0x561c2cdaa3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f906cfd1640 1 -- 10.20.193.28:0/957708489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8f5e0 msgr2=0x561c2cda9eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f906cfd1640 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8f5e0 0x561c2cda9eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f906cfd1640 1 -- 10.20.193.28:0/957708489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c2cda1ad0 con 0x561c2cd94fb0 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f906cfd1640 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd94fb0 0x561c2cda8660 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f9064002f60 tx=0x7f9064004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99bb9a59706ca0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9029ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9029ffb640 1 -- 10.20.193.28:0/957708489 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064018830 con 0x561c2cd94fb0 2026-02-20T03:35:31.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9029ffb640 1 -- 10.20.193.28:0/957708489 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f906401c030 con 0x561c2cd94fb0 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9029ffb640 1 -- 10.20.193.28:0/957708489 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9064015d50 con 0x561c2cd94fb0 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 -- 10.20.193.28:0/957708489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c2cab3b40 con 0x561c2cd94fb0 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9029ffb640 1 -- 10.20.193.28:0/957708489 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9064017420 con 0x561c2cd94fb0 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9029ffb640 10 client.21132 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 10 client.21132 _ll_register_callbacks cb 0x561c2cd1beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 -- 10.20.193.28:0/957708489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c2ccf0150 con 0x561c2cd94fb0 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9029ffb640 1 -- 10.20.193.28:0/957708489 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f9064026060 con 0x561c2cd94fb0 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 10 client.21132 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 -- 10.20.193.28:0/957708489 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x561c2cc9d1e0 con 0x561c2cd94fb0 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9029ffb640 1 -- 10.20.193.28:0/957708489 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f9064029050 con 0x561c2cd94fb0 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 10 client.21132 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:31.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 10 client.21132 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:35:31.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 20 client.21132 populate_metadata read hostname 'trial028' 2026-02-20T03:35:31.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561c2cdb87a0 0x561c2cdbac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 4 client.21132 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:31.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.711+0000 7f9070f60e00 1 -- 10.20.193.28:0/957708489 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c2ccea560 con 0x561c2cdb87a0 2026-02-20T03:35:31.727 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.14 MB/sec execute 302 sec latency 10394.994 ms 2026-02-20T03:35:31.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.733+0000 7f905ffff640 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561c2cdb87a0 0x561c2cdbac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:31.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.761+0000 7f905ffff640 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561c2cdb87a0 0x561c2cdbac60 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3673798d5495468e server_cookie=d36cc0b3440ef7bf in_seq=0 out_seq=0 2026-02-20T03:35:31.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.761+0000 7f9029ffb640 10 client.21132 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:35:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9029ffb640 1 -- 10.20.193.28:0/957708489 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561c2ccea560 con 0x561c2cdb87a0 2026-02-20T03:35:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9029ffb640 10 client.21132 handle_command_reply: tid=0 2026-02-20T03:35:31.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 client.21132 shutdown 2026-02-20T03:35:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 -- 10.20.193.28:0/957708489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd94fb0 msgr2=0x561c2cda8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd94fb0 0x561c2cda8660 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f9064002f60 tx=0x7f9064004c90 comp rx=0 tx=0).stop 2026-02-20T03:35:31.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 -- 10.20.193.28:0/957708489 shutdown_connections 2026-02-20T03:35:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561c2cdb87a0 0x561c2cdbac60 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd94fb0 0x561c2cda8660 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd8ff60 0x561c2cdaa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 --2- 10.20.193.28:0/957708489 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8f5e0 0x561c2cda9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9029ffb640 0 client.21132 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:35:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 -- 10.20.193.28:0/957708489 >> 10.20.193.28:0/957708489 conn(0x561c2cd52240 msgr2=0x561c2cd8e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.774+0000 7f9070f60e00 1 -- 10.20.193.28:0/957708489 shutdown_connections 2026-02-20T03:35:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.776+0000 7f9070f60e00 1 -- 10.20.193.28:0/957708489 wait complete. 2026-02-20T03:35:31.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.776+0000 7f9070f60e00 20 client.21132 trim_cache size 0 max 16384 2026-02-20T03:35:31.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 Processor -- start 2026-02-20T03:35:31.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- start start 2026-02-20T03:35:31.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd87ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd8ff60 0x561c2cdc0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd94fb0 0x561c2cdc0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f900c012760 con 0x561c2cd8f5e0 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f900c00ff70 con 0x561c2cd94fb0 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f900c00ddc0 con 0x561c2cd8ff60 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd87ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd87ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35310/0 (socket says 10.20.193.28:35310) 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 -- 10.20.193.28:0/1908152598 learned_addr learned my addr 10.20.193.28:0/1908152598 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 -- 10.20.193.28:0/1908152598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd8ff60 msgr2=0x561c2cdc0570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 --2- 10.20.193.28:0/1908152598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd8ff60 0x561c2cdc0570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 -- 10.20.193.28:0/1908152598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd94fb0 msgr2=0x561c2cdc0ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 --2- 10.20.193.28:0/1908152598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd94fb0 0x561c2cdc0ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 -- 10.20.193.28:0/1908152598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c2cda1900 con 0x561c2cd8f5e0 2026-02-20T03:35:31.789 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 --2- 10.20.193.28:0/1908152598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd87ad0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f90500a7f60 tx=0x7f9050004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be50eaa1eb77893c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f902bfff640 1 -- 10.20.193.28:0/1908152598 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500ce070 con 0x561c2cd8f5e0 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f902bfff640 1 -- 10.20.193.28:0/1908152598 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f90500ddd00 con 0x561c2cd8f5e0 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f902bfff640 1 -- 10.20.193.28:0/1908152598 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500a4430 con 0x561c2cd8f5e0 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- 10.20.193.28:0/1908152598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 msgr2=0x561c2cd87ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- 10.20.193.28:0/1908152598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd87ad0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f90500a7f60 tx=0x7f9050004630 comp rx=0 tx=0).stop 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- 10.20.193.28:0/1908152598 shutdown_connections 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- 10.20.193.28:0/1908152598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd94fb0 0x561c2cdc0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- 10.20.193.28:0/1908152598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd8ff60 0x561c2cdc0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- 10.20.193.28:0/1908152598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cd87ad0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- 10.20.193.28:0/1908152598 >> 10.20.193.28:0/1908152598 conn(0x561c2cd52240 msgr2=0x561c2cda76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:31.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- 10.20.193.28:0/1908152598 shutdown_connections 2026-02-20T03:35:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- 10.20.193.28:0/1908152598 wait complete. 2026-02-20T03:35:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- start start 2026-02-20T03:35:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 Processor -- start 2026-02-20T03:35:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cdaed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8ff60 0x561c2cdaf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd94fb0 0x561c2cdaf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f900c00e430 con 0x561c2cd8f5e0 2026-02-20T03:35:31.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f900c00f8a0 con 0x561c2cd8ff60 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f9070f60e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f900c00eb00 con 0x561c2cd94fb0 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cdaed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cdaed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35322/0 (socket says 10.20.193.28:35322) 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 -- 10.20.193.28:0/113873528 learned_addr learned my addr 10.20.193.28:0/113873528 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 -- 10.20.193.28:0/113873528 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd94fb0 msgr2=0x561c2cdaf7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd94fb0 0x561c2cdaf7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 -- 10.20.193.28:0/113873528 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8ff60 msgr2=0x561c2cdaf2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8ff60 0x561c2cdaf2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.781+0000 7f905ffff640 1 -- 10.20.193.28:0/113873528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c2c9c1870 con 0x561c2cd8f5e0 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f905ffff640 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cdaed70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f90500a81f0 tx=0x7f90500a4330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8989215ceddf4d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:31.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9029ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9029ffb640 1 -- 10.20.193.28:0/113873528 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500ce040 con 0x561c2cd8f5e0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9029ffb640 1 -- 10.20.193.28:0/113873528 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9050002d40 con 0x561c2cd8f5e0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9029ffb640 1 -- 10.20.193.28:0/113873528 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90500a3be0 con 0x561c2cd8f5e0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 1 -- 10.20.193.28:0/113873528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c2cc823f0 con 0x561c2cd8f5e0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9029ffb640 1 -- 10.20.193.28:0/113873528 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f90500a6ce0 con 0x561c2cd8f5e0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 10 client.21138 _ll_register_callbacks cb 0x7f9068069370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 1 -- 10.20.193.28:0/113873528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561c2cc94ab0 con 0x561c2cd8f5e0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9029ffb640 1 -- 10.20.193.28:0/113873528 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f90500e02b0 con 0x561c2cd8f5e0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 10 client.21138 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 1 -- 10.20.193.28:0/113873528 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x561c2cda25f0 con 0x561c2cd8f5e0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9029ffb640 1 -- 10.20.193.28:0/113873528 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f90500a6ee0 con 0x561c2cd8f5e0 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 10 client.21138 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:31.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 10 client.21138 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:35:31.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 20 client.21138 populate_metadata read hostname 'trial028' 2026-02-20T03:35:31.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561c2ce2d5f0 0x561c2ce2fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:31.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 4 client.21138 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:35:31.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.786+0000 7f9070f60e00 1 -- 10.20.193.28:0/113873528 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9058033040 con 0x561c2ce2d5f0 2026-02-20T03:35:31.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.802+0000 7f905f7fe640 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561c2ce2d5f0 0x561c2ce2fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:31.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.829+0000 7f905f7fe640 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561c2ce2d5f0 0x561c2ce2fab0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=959344639893143b server_cookie=dc4fc5e581571750 in_seq=0 out_seq=0 2026-02-20T03:35:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:31 trial126 ceph-mon[38476]: pgmap v811: 129 pgs: 129 active+clean; 738 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 13 MiB/s wr, 994 op/s 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.829+0000 7f9029ffb640 10 client.21138 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9029ffb640 1 -- 10.20.193.28:0/113873528 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9058033040 con 0x561c2ce2d5f0 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9029ffb640 10 client.21138 handle_command_reply: tid=0 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 client.21138 shutdown 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 -- 10.20.193.28:0/113873528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 msgr2=0x561c2cdaed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cdaed70 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f90500a81f0 tx=0x7f90500a4330 comp rx=0 tx=0).stop 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 -- 10.20.193.28:0/113873528 shutdown_connections 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x561c2ce2d5f0 0x561c2ce2fab0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561c2cd94fb0 0x561c2cdaf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561c2cd8ff60 0x561c2cdaf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 --2- 10.20.193.28:0/113873528 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561c2cd8f5e0 0x561c2cdaed70 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9029ffb640 0 client.21138 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:35:31.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 -- 10.20.193.28:0/113873528 >> 10.20.193.28:0/113873528 conn(0x561c2cd52240 msgr2=0x561c2cdb8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:31.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 -- 10.20.193.28:0/113873528 shutdown_connections 2026-02-20T03:35:31.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 1 -- 10.20.193.28:0/113873528 wait complete. 2026-02-20T03:35:31.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f9070f60e00 20 client.21138 trim_cache size 0 max 16384 2026-02-20T03:35:31.862 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:35:31.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 -- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90440b0e20 msgr2=0x7f90440b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:31.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90440b0e20 0x7f90440b32e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f906400ab00 tx=0x7f90640092c0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 -- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d080 msgr2=0x7f90681ab910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:31.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d080 0x7f90681ab910 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f905000b570 tx=0x7f905000ba40 comp rx=0 tx=0).stop 2026-02-20T03:35:31.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 -- 10.20.193.28:0/3185743618 shutdown_connections 2026-02-20T03:35:31.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f90440b0e20 0x7f90440b32e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f90681a5ad0 0x7f90681a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9068117da0 0x7f90681abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 --2- 10.20.193.28:0/3185743618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f906810d080 0x7f90681ab910 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:31.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 -- 10.20.193.28:0/3185743618 >> 10.20.193.28:0/3185743618 conn(0x7f906806ead0 msgr2=0x7f90680730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:31.869 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:31 trial177 ceph-mon[43181]: pgmap v811: 129 pgs: 129 active+clean; 738 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 13 MiB/s wr, 994 op/s 2026-02-20T03:35:31.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 -- 10.20.193.28:0/3185743618 shutdown_connections 2026-02-20T03:35:31.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:31.856+0000 7f906d7d2640 1 -- 10.20.193.28:0/3185743618 wait complete. 2026-02-20T03:35:32.022 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:35:32.330 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:35:32.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 -- 10.20.193.28:0/1294773299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010a980 msgr2=0x7f497010ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:32.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 --2- 10.20.193.28:0/1294773299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010a980 0x7f497010ad60 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f4968009a60 tx=0x7f496802f290 comp rx=0 tx=0).stop 2026-02-20T03:35:32.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 -- 10.20.193.28:0/1294773299 shutdown_connections 2026-02-20T03:35:32.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 --2- 10.20.193.28:0/1294773299 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4970105320 0x7f4970111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 --2- 10.20.193.28:0/1294773299 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4970104980 0x7f4970104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 --2- 10.20.193.28:0/1294773299 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f497010a980 0x7f497010ad60 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 -- 10.20.193.28:0/1294773299 >> 10.20.193.28:0/1294773299 conn(0x7f4970100680 msgr2=0x7f4970102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:32.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 -- 10.20.193.28:0/1294773299 shutdown_connections 2026-02-20T03:35:32.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 -- 10.20.193.28:0/1294773299 wait complete. 2026-02-20T03:35:32.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.568+0000 7f49776f2640 1 Processor -- start 2026-02-20T03:35:32.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49776f2640 1 -- start start 2026-02-20T03:35:32.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49776f2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4970104980 0x7f4970077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49776f2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4970105320 0x7f4970077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49776f2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f497010a980 0x7f4970078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49776f2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4970114cd0 con 0x7f4970104980 2026-02-20T03:35:32.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49776f2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4970114b50 con 0x7f4970105320 2026-02-20T03:35:32.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49776f2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4970114e50 con 0x7f497010a980 2026-02-20T03:35:32.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49766f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4970104980 0x7f4970077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:32.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49766f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4970104980 0x7f4970077600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35330/0 (socket says 10.20.193.28:35330) 2026-02-20T03:35:32.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49766f0640 1 -- 10.20.193.28:0/2682659021 learned_addr learned my addr 10.20.193.28:0/2682659021 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:32.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49766f0640 1 -- 10.20.193.28:0/2682659021 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f497010a980 msgr2=0x7f4970078080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:32.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49766f0640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f497010a980 0x7f4970078080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49766f0640 1 -- 10.20.193.28:0/2682659021 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4970105320 msgr2=0x7f4970077b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49766f0640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4970105320 0x7f4970077b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49766f0640 1 -- 10.20.193.28:0/2682659021 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49701ada90 con 0x7f4970104980 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49766f0640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4970104980 0x7f4970077600 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f4968009a30 tx=0x7f496802fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f495b7fe640 1 -- 10.20.193.28:0/2682659021 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968004480 con 0x7f4970104980 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f495b7fe640 1 -- 10.20.193.28:0/2682659021 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f49680054d0 con 0x7f4970104980 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f495b7fe640 1 -- 10.20.193.28:0/2682659021 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968038990 con 0x7f4970104980 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.571+0000 7f49776f2640 1 -- 10.20.193.28:0/2682659021 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49701add20 con 0x7f4970104980 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.573+0000 7f49776f2640 1 -- 10.20.193.28:0/2682659021 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49701ae1b0 con 0x7f4970104980 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.573+0000 7f497ae80e00 1 Processor -- start 2026-02-20T03:35:32.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 -- start start 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab97fb0 0x55811ab98390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811ab92a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 0x55811ab9ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55811ab12e00 con 0x55811ab925e0 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f495b7fe640 1 -- 10.20.193.28:0/2682659021 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f49680047c0 con 0x7f4970104980 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55811aae5970 con 0x55811ab92f60 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55811aa931f0 con 0x55811ab97fb0 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f49766f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811ab92a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f49766f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811ab92a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35332/0 (socket says 10.20.193.28:35332) 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f49766f0640 1 -- 10.20.193.28:0/3017896248 learned_addr learned my addr 10.20.193.28:0/3017896248 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:32.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f49766f0640 1 -- 10.20.193.28:0/3017896248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab97fb0 msgr2=0x55811ab98390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f49766f0640 1 --2- 10.20.193.28:0/3017896248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab97fb0 0x55811ab98390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f49766f0640 1 -- 10.20.193.28:0/3017896248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 msgr2=0x55811ab9ede0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f49766f0640 1 --2- 10.20.193.28:0/3017896248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 0x55811ab9ede0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f49766f0640 1 -- 10.20.193.28:0/3017896248 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811aaa63d0 con 0x55811ab925e0 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f49766f0640 1 --2- 10.20.193.28:0/3017896248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811ab92a20 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f496810ad00 tx=0x7f496810c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e10e68f56e081a9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f4958ff9640 1 -- 10.20.193.28:0/3017896248 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496810ae00 con 0x55811ab925e0 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f4958ff9640 1 -- 10.20.193.28:0/3017896248 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4968111070 con 0x55811ab925e0 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f4958ff9640 1 -- 10.20.193.28:0/3017896248 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496810d850 con 0x55811ab925e0 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f495b7fe640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f494c0b0e20 0x7f494c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f495b7fe640 1 -- 10.20.193.28:0/2682659021 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f496803e020 con 0x7f4970104980 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f4976ef1640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f494c0b0e20 0x7f494c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:32.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 -- 10.20.193.28:0/3017896248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 msgr2=0x55811ab92a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3017896248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811ab92a20 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f496810ad00 tx=0x7f496810c750 comp rx=0 tx=0).stop 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 -- 10.20.193.28:0/3017896248 shutdown_connections 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3017896248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 0x55811ab9ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3017896248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811ab92a20 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3017896248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab97fb0 0x55811ab98390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 -- 10.20.193.28:0/3017896248 >> 10.20.193.28:0/3017896248 conn(0x55811ab55240 msgr2=0x55811ab90ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 -- 10.20.193.28:0/3017896248 shutdown_connections 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f497ae80e00 1 -- 10.20.193.28:0/3017896248 wait complete. 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.576+0000 7f4976ef1640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f494c0b0e20 0x7f494c0b32e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f496400aab0 tx=0x7f4964009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.580+0000 7f497ae80e00 1 -- start start 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 Processor -- start 2026-02-20T03:35:32.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811abac410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 0x55811abac950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab97fb0 0x55811abaabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55811aae18a0 con 0x55811ab925e0 2026-02-20T03:35:32.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55811a8d3f50 con 0x55811ab92f60 2026-02-20T03:35:32.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55811abab200 con 0x55811ab97fb0 2026-02-20T03:35:32.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f49766f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811abac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:32.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f49766f0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811abac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35338/0 (socket says 10.20.193.28:35338) 2026-02-20T03:35:32.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f49766f0640 1 -- 10.20.193.28:0/3289911979 learned_addr learned my addr 10.20.193.28:0/3289911979 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:32.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f49766f0640 1 -- 10.20.193.28:0/3289911979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab97fb0 msgr2=0x55811abaabc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:32.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f49766f0640 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab97fb0 0x55811abaabc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f49766f0640 1 -- 10.20.193.28:0/3289911979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 msgr2=0x55811abac950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:32.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f49766f0640 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 0x55811abac950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f49766f0640 1 -- 10.20.193.28:0/3289911979 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811aba4690 con 0x55811ab925e0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f49766f0640 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811abac410 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f4968002410 tx=0x7f4968116ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9b7a39727f92da server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f4923fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f4923fff640 1 -- 10.20.193.28:0/3289911979 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49680c83e0 con 0x55811ab925e0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f4923fff640 1 -- 10.20.193.28:0/3289911979 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4968033030 con 0x55811ab925e0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 -- 10.20.193.28:0/3289911979 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55811a8b6b40 con 0x55811ab925e0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f4923fff640 1 -- 10.20.193.28:0/3289911979 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49680cbc90 con 0x55811ab925e0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f4923fff640 1 -- 10.20.193.28:0/3289911979 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4968107e00 con 0x55811ab925e0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 10 client.21150 _ll_register_callbacks cb 0x55811ab1eeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 -- 10.20.193.28:0/3289911979 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55811aaf3150 con 0x55811ab925e0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f4923fff640 1 -- 10.20.193.28:0/3289911979 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f49680cbe70 con 0x55811ab925e0 2026-02-20T03:35:32.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 10 client.21150 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:32.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 -- 10.20.193.28:0/3289911979 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55811aaa01e0 con 0x55811ab925e0 2026-02-20T03:35:32.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f4923fff640 1 -- 10.20.193.28:0/3289911979 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f49680cc030 con 0x55811ab925e0 2026-02-20T03:35:32.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 10 client.21150 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:32.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 10 client.21150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:32.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 20 client.21150 populate_metadata read hostname 'trial028' 2026-02-20T03:35:32.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55811abba930 0x55811abbcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 4 client.21150 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:32.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.581+0000 7f497ae80e00 1 -- 10.20.193.28:0/3289911979 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55811aaed560 con 0x55811abba930 2026-02-20T03:35:32.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.607+0000 7f4975eef640 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55811abba930 0x55811abbcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:32.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.674+0000 7f4975eef640 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55811abba930 0x55811abbcdf0 crc :-1 s=READY pgs=529 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=908f6f0daf4c623a server_cookie=7ae269e1e1a3079f in_seq=0 out_seq=0 2026-02-20T03:35:32.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.674+0000 7f4923fff640 10 client.21150 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:32.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f4923fff640 1 -- 10.20.193.28:0/3289911979 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55811aaed560 con 0x55811abba930 2026-02-20T03:35:32.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f4923fff640 10 client.21150 handle_command_reply: tid=0 2026-02-20T03:35:32.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 client.21150 shutdown 2026-02-20T03:35:32.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 -- 10.20.193.28:0/3289911979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 msgr2=0x55811abac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:32.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811abac410 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f4968002410 tx=0x7f4968116ce0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 -- 10.20.193.28:0/3289911979 shutdown_connections 2026-02-20T03:35:32.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55811abba930 0x55811abbcdf0 crc :-1 s=READY pgs=529 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab97fb0 0x55811abaabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 0x55811abac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3289911979 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab925e0 0x55811abac410 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 -- 10.20.193.28:0/3289911979 >> 10.20.193.28:0/3289911979 conn(0x55811ab55240 msgr2=0x55811ab913f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:32.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f4923fff640 0 client.21150 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:32.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 -- 10.20.193.28:0/3289911979 shutdown_connections 2026-02-20T03:35:32.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 1 -- 10.20.193.28:0/3289911979 wait complete. 2026-02-20T03:35:32.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.701+0000 7f497ae80e00 20 client.21150 trim_cache size 0 max 16384 2026-02-20T03:35:32.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 Processor -- start 2026-02-20T03:35:32.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- start start 2026-02-20T03:35:32.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab925e0 0x55811ab914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 0x55811ab91a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811abc2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4918012760 con 0x55811ab97fb0 2026-02-20T03:35:32.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f491800ff70 con 0x55811ab92f60 2026-02-20T03:35:32.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f491800ddc0 con 0x55811ab925e0 2026-02-20T03:35:32.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811abc2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:32.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811abc2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35348/0 (socket says 10.20.193.28:35348) 2026-02-20T03:35:32.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 -- 10.20.193.28:0/2903317274 learned_addr learned my addr 10.20.193.28:0/2903317274 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:32.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 -- 10.20.193.28:0/2903317274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab925e0 msgr2=0x55811ab914d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:32.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 --2- 10.20.193.28:0/2903317274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab925e0 0x55811ab914d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 -- 10.20.193.28:0/2903317274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 msgr2=0x55811ab91a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 --2- 10.20.193.28:0/2903317274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 0x55811ab91a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 -- 10.20.193.28:0/2903317274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811aba44c0 con 0x55811ab97fb0 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 --2- 10.20.193.28:0/2903317274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811abc2700 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f496400cc10 tx=0x7f496400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9478c9a43a1bdae4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f493e4e6640 1 -- 10.20.193.28:0/2903317274 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964006e60 con 0x55811ab97fb0 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f493e4e6640 1 -- 10.20.193.28:0/2903317274 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f496401f020 con 0x55811ab97fb0 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f493e4e6640 1 -- 10.20.193.28:0/2903317274 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496400d680 con 0x55811ab97fb0 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- 10.20.193.28:0/2903317274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 msgr2=0x55811abc2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- 10.20.193.28:0/2903317274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811abc2700 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f496400cc10 tx=0x7f496400f000 comp rx=0 tx=0).stop 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- 10.20.193.28:0/2903317274 shutdown_connections 2026-02-20T03:35:32.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- 10.20.193.28:0/2903317274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811abc2700 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- 10.20.193.28:0/2903317274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab92f60 0x55811ab91a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- 10.20.193.28:0/2903317274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab925e0 0x55811ab914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- 10.20.193.28:0/2903317274 >> 10.20.193.28:0/2903317274 conn(0x55811ab55240 msgr2=0x55811abac410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:32.718 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- 10.20.193.28:0/2903317274 shutdown_connections 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- 10.20.193.28:0/2903317274 wait complete. 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- start start 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 Processor -- start 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab925e0 0x55811abafc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab92f60 0x55811abb01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811ac1e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f491800e430 con 0x55811ab97fb0 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f491800f8a0 con 0x55811ab925e0 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f497ae80e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f491800eb00 con 0x55811ab92f60 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811ac1e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:32.719 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811ac1e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35360/0 (socket says 10.20.193.28:35360) 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 -- 10.20.193.28:0/3648837450 learned_addr learned my addr 10.20.193.28:0/3648837450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 -- 10.20.193.28:0/3648837450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab92f60 msgr2=0x55811abb01a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab92f60 0x55811abb01a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 -- 10.20.193.28:0/3648837450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab925e0 msgr2=0x55811abafc60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab925e0 0x55811abafc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.706+0000 7f4976ef1640 1 -- 10.20.193.28:0/3648837450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811a7c4870 con 0x55811ab97fb0 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f4976ef1640 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811ac1e8a0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f4964021040 tx=0x7f496401abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1488facb87eef80a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f4923fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f4923fff640 1 -- 10.20.193.28:0/3648837450 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496401e030 con 0x55811ab97fb0 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f4923fff640 1 -- 10.20.193.28:0/3648837450 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4964011070 con 0x55811ab97fb0 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 1 -- 10.20.193.28:0/3648837450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55811aa853f0 con 0x55811ab97fb0 2026-02-20T03:35:32.720 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f4923fff640 1 -- 10.20.193.28:0/3648837450 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496400d830 con 0x55811ab97fb0 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 10 client.21156 _ll_register_callbacks cb 0x7f496810ab50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 1 -- 10.20.193.28:0/3648837450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4968111070 con 0x55811ab97fb0 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f4923fff640 1 -- 10.20.193.28:0/3648837450 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f496400d9d0 con 0x55811ab97fb0 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f4923fff640 1 -- 10.20.193.28:0/3648837450 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f496400dcb0 con 0x55811ab97fb0 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 10 client.21156 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 1 -- 10.20.193.28:0/3648837450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55811aba51b0 con 0x55811ab97fb0 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f4923fff640 1 -- 10.20.193.28:0/3648837450 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f496402c070 con 0x55811ab97fb0 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 10 client.21156 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 10 client.21156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 20 client.21156 populate_metadata read hostname 'trial028' 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55811ac38c40 0x55811ac3b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:32.721 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 4 client.21156 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:35:32.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.711+0000 7f497ae80e00 1 -- 10.20.193.28:0/3648837450 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55811aab67c0 con 0x55811ac38c40 2026-02-20T03:35:32.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.07 MB/sec execute 303 sec latency 11395.033 ms 2026-02-20T03:35:32.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.728+0000 7f49766f0640 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55811ac38c40 0x55811ac3b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:32.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.794+0000 7f49766f0640 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55811ac38c40 0x55811ac3b0d0 crc :-1 s=READY pgs=530 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3308edd65280da5 server_cookie=4842edbe230243a4 in_seq=0 out_seq=0 2026-02-20T03:35:32.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.794+0000 7f4923fff640 10 client.21156 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:32.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f4923fff640 1 -- 10.20.193.28:0/3648837450 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55811aab67c0 con 0x55811ac38c40 2026-02-20T03:35:32.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f4923fff640 10 client.21156 handle_command_reply: tid=0 2026-02-20T03:35:32.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 client.21156 shutdown 2026-02-20T03:35:32.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 -- 10.20.193.28:0/3648837450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 msgr2=0x55811ac1e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:32.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811ac1e8a0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f4964021040 tx=0x7f496401abd0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 -- 10.20.193.28:0/3648837450 shutdown_connections 2026-02-20T03:35:32.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55811ac38c40 0x55811ac3b0d0 crc :-1 s=READY pgs=530 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55811ab97fb0 0x55811ac1e8a0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55811ab92f60 0x55811abb01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 --2- 10.20.193.28:0/3648837450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55811ab925e0 0x55811abafc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f4923fff640 0 client.21156 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:32.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 -- 10.20.193.28:0/3648837450 >> 10.20.193.28:0/3648837450 conn(0x55811ab55240 msgr2=0x55811abbad10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:32.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 -- 10.20.193.28:0/3648837450 shutdown_connections 2026-02-20T03:35:32.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 1 -- 10.20.193.28:0/3648837450 wait complete. 2026-02-20T03:35:32.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f497ae80e00 20 client.21156 trim_cache size 0 max 16384 2026-02-20T03:35:32.823 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:35:32.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 -- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f494c0b0e20 msgr2=0x7f494c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:32.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f494c0b0e20 0x7f494c0b32e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f496400aab0 tx=0x7f4964009250 comp rx=0 tx=0).stop 2026-02-20T03:35:32.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 -- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4970104980 msgr2=0x7f4970077600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:32.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4970104980 0x7f4970077600 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f4968009a30 tx=0x7f496802fce0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 -- 10.20.193.28:0/2682659021 shutdown_connections 2026-02-20T03:35:32.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f494c0b0e20 0x7f494c0b32e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f497010a980 0x7f4970078080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4970105320 0x7f4970077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 --2- 10.20.193.28:0/2682659021 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4970104980 0x7f4970077600 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:32.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 -- 10.20.193.28:0/2682659021 >> 10.20.193.28:0/2682659021 conn(0x7f4970100680 msgr2=0x7f4970101140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:32.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 -- 10.20.193.28:0/2682659021 shutdown_connections 2026-02-20T03:35:32.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:32.807+0000 7f49776f2640 1 -- 10.20.193.28:0/2682659021 wait complete. 2026-02-20T03:35:33.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 22.00 MB/sec execute 304 sec latency 12395.076 ms 2026-02-20T03:35:33.792 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:33 trial028 ceph-mon[38552]: pgmap v812: 129 pgs: 129 active+clean; 747 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 MiB/s rd, 12 MiB/s wr, 782 op/s 2026-02-20T03:35:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:33 trial126 ceph-mon[38476]: pgmap v812: 129 pgs: 129 active+clean; 747 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 MiB/s rd, 12 MiB/s wr, 782 op/s 2026-02-20T03:35:33.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:33 trial177 ceph-mon[43181]: pgmap v812: 129 pgs: 129 active+clean; 747 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 MiB/s rd, 12 MiB/s wr, 782 op/s 2026-02-20T03:35:34.017 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:35:34.018 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:35:34.330 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:35:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.569+0000 7f88bd04d640 1 -- 10.20.193.28:0/538825155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 msgr2=0x7f88b8104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.569+0000 7f88bd04d640 1 --2- 10.20.193.28:0/538825155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 0x7f88b8104de0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009a60 tx=0x7f88a802f290 comp rx=0 tx=0).stop 2026-02-20T03:35:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.569+0000 7f88bd04d640 1 -- 10.20.193.28:0/538825155 shutdown_connections 2026-02-20T03:35:34.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.569+0000 7f88bd04d640 1 --2- 10.20.193.28:0/538825155 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88b8105320 0x7f88b8111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.569+0000 7f88bd04d640 1 --2- 10.20.193.28:0/538825155 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 0x7f88b8104de0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.569+0000 7f88bd04d640 1 --2- 10.20.193.28:0/538825155 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88b810a980 0x7f88b810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.569+0000 7f88bd04d640 1 -- 10.20.193.28:0/538825155 >> 10.20.193.28:0/538825155 conn(0x7f88b8100680 msgr2=0x7f88b8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.569+0000 7f88bd04d640 1 -- 10.20.193.28:0/538825155 shutdown_connections 2026-02-20T03:35:34.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.569+0000 7f88bd04d640 1 -- 10.20.193.28:0/538825155 wait complete. 2026-02-20T03:35:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.573+0000 7f88bd04d640 1 Processor -- start 2026-02-20T03:35:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.573+0000 7f88bd04d640 1 -- start start 2026-02-20T03:35:34.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88bd04d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 0x7f88b819d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88bd04d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88b8105320 0x7f88b819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88bd04d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88b810a980 0x7f88b81a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88bd04d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f88b8114cd0 con 0x7f88b8104980 2026-02-20T03:35:34.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88bd04d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f88b8114b50 con 0x7f88b8105320 2026-02-20T03:35:34.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88bd04d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f88b8114e50 con 0x7f88b810a980 2026-02-20T03:35:34.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 0x7f88b819d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 0x7f88b819d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35382/0 (socket says 10.20.193.28:35382) 2026-02-20T03:35:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b7fff640 1 -- 10.20.193.28:0/1253588757 learned_addr learned my addr 10.20.193.28:0/1253588757 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b7fff640 1 -- 10.20.193.28:0/1253588757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88b810a980 msgr2=0x7f88b81a1ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b7fff640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88b810a980 0x7f88b81a1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b7fff640 1 -- 10.20.193.28:0/1253588757 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88b8105320 msgr2=0x7f88b819d720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b7fff640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88b8105320 0x7f88b819d720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b7fff640 1 -- 10.20.193.28:0/1253588757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b81a2230 con 0x7f88b8104980 2026-02-20T03:35:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b7fff640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 0x7f88b819d1e0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f88a400b570 tx=0x7f88a400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b57fa640 1 -- 10.20.193.28:0/1253588757 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4013020 con 0x7f88b8104980 2026-02-20T03:35:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b57fa640 1 -- 10.20.193.28:0/1253588757 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f88a4004480 con 0x7f88b8104980 2026-02-20T03:35:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88b57fa640 1 -- 10.20.193.28:0/1253588757 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a400fb50 con 0x7f88b8104980 2026-02-20T03:35:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88bd04d640 1 -- 10.20.193.28:0/1253588757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b81a2520 con 0x7f88b8104980 2026-02-20T03:35:34.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.574+0000 7f88bd04d640 1 -- 10.20.193.28:0/1253588757 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b81a9d60 con 0x7f88b8104980 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88b57fa640 1 -- 10.20.193.28:0/1253588757 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f88a4002780 con 0x7f88b8104980 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 Processor -- start 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 -- start start 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c2a70 0x55e7960c6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c6b60 0x55e7960c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e796014c00 con 0x55e7960c20c0 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e795fc23c0 con 0x55e7960c2a70 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e796010b30 con 0x55e7960c6b60 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88bc84c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:34.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88bc84c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35398/0 (socket says 10.20.193.28:35398) 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88bc84c640 1 -- 10.20.193.28:0/3473537081 learned_addr learned my addr 10.20.193.28:0/3473537081 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88bc84c640 1 -- 10.20.193.28:0/3473537081 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c6b60 msgr2=0x55e7960c6fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88bc84c640 1 --2- 10.20.193.28:0/3473537081 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c6b60 0x55e7960c6fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88bc84c640 1 -- 10.20.193.28:0/3473537081 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c2a70 msgr2=0x55e7960c6540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88bc84c640 1 --2- 10.20.193.28:0/3473537081 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c2a70 0x55e7960c6540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88bc84c640 1 -- 10.20.193.28:0/3473537081 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e795fbb840 con 0x55e7960c20c0 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88bc84c640 1 --2- 10.20.193.28:0/3473537081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960c24a0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009d20 tx=0x7f88ac00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b84ce698a0456ef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f8888ce3640 1 -- 10.20.193.28:0/3473537081 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac017070 con 0x55e7960c20c0 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88b57fa640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f888c0b0e20 0x7f888c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f8888ce3640 1 -- 10.20.193.28:0/3473537081 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f88ac00bd50 con 0x55e7960c20c0 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f8888ce3640 1 -- 10.20.193.28:0/3473537081 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac006e60 con 0x55e7960c20c0 2026-02-20T03:35:34.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 -- 10.20.193.28:0/3473537081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 msgr2=0x55e7960c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/3473537081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960c24a0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009d20 tx=0x7f88ac00b420 comp rx=0 tx=0).stop 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88b57fa640 1 -- 10.20.193.28:0/1253588757 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f88a40e0560 con 0x7f88b8104980 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88b7fff640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f888c0b0e20 0x7f888c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 -- 10.20.193.28:0/3473537081 shutdown_connections 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/3473537081 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c6b60 0x55e7960c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/3473537081 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c2a70 0x55e7960c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/3473537081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960c24a0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 -- 10.20.193.28:0/3473537081 >> 10.20.193.28:0/3473537081 conn(0x55e7960bab60 msgr2=0x55e7960c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88c07dbe00 1 -- 10.20.193.28:0/3473537081 shutdown_connections 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.576+0000 7f88b7fff640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f888c0b0e20 0x7f888c0b32e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f88a40a4070 tx=0x7f88a4004850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:34.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 -- 10.20.193.28:0/3473537081 wait complete. 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 -- start start 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 Processor -- start 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960dc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 0x55e7960dc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c6b60 0x55e7960dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e795fbc1a0 con 0x55e7960c20c0 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e7960ced70 con 0x55e7960c6b60 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e7960db330 con 0x55e7960c2a70 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88bc84c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960dc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88bc84c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960dc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35404/0 (socket says 10.20.193.28:35404) 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88bc84c640 1 -- 10.20.193.28:0/2626327281 learned_addr learned my addr 10.20.193.28:0/2626327281 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:34.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88bc84c640 1 -- 10.20.193.28:0/2626327281 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 msgr2=0x55e7960dc9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88bc84c640 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 0x55e7960dc9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88bc84c640 1 -- 10.20.193.28:0/2626327281 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c6b60 msgr2=0x55e7960dabb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88bc84c640 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c6b60 0x55e7960dabb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88bc84c640 1 -- 10.20.193.28:0/2626327281 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7960d45a0 con 0x55e7960c20c0 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88bc84c640 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960dc470 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f88ac015040 tx=0x7f88ac004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8e55f061225cc5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f8879ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f8879ffb640 1 -- 10.20.193.28:0/2626327281 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac017050 con 0x55e7960c20c0 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f8879ffb640 1 -- 10.20.193.28:0/2626327281 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f88ac023070 con 0x55e7960c20c0 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f8879ffb640 1 -- 10.20.193.28:0/2626327281 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac012410 con 0x55e7960c20c0 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 -- 10.20.193.28:0/2626327281 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e795de3b60 con 0x55e7960c20c0 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 10 client.21168 _ll_register_callbacks cb 0x55e795fc00d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:34.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 -- 10.20.193.28:0/2626327281 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e79601c7f0 con 0x55e7960c20c0 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f8879ffb640 1 -- 10.20.193.28:0/2626327281 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f88ac002d10 con 0x55e7960c20c0 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f8879ffb640 1 -- 10.20.193.28:0/2626327281 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f88ac01e450 con 0x55e7960c20c0 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 10 client.21168 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 -- 10.20.193.28:0/2626327281 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55e795fe1430 con 0x55e7960c20c0 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f8879ffb640 1 -- 10.20.193.28:0/2626327281 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f88ac01e5f0 con 0x55e7960c20c0 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 10 client.21168 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 10 client.21168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 20 client.21168 populate_metadata read hostname 'trial028' 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e7960eab40 0x55e7960ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 4 client.21168 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:34.595 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.580+0000 7f88c07dbe00 1 -- 10.20.193.28:0/2626327281 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e795f96c00 con 0x55e7960eab40 2026-02-20T03:35:34.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.607+0000 7f88b77fe640 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e7960eab40 0x55e7960ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:34.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.674+0000 7f88b77fe640 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e7960eab40 0x55e7960ecf30 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=879a52942adff16b server_cookie=407f6064532651a9 in_seq=0 out_seq=0 2026-02-20T03:35:34.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.674+0000 7f8879ffb640 10 client.21168 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:34.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.674+0000 7f8879ffb640 1 -- 10.20.193.28:0/2626327281 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e795f96c00 con 0x55e7960eab40 2026-02-20T03:35:34.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.674+0000 7f8879ffb640 10 client.21168 handle_command_reply: tid=0 2026-02-20T03:35:34.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 client.21168 shutdown 2026-02-20T03:35:34.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 -- 10.20.193.28:0/2626327281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 msgr2=0x55e7960dc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:34.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960dc470 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f88ac015040 tx=0x7f88ac004290 comp rx=0 tx=0).stop 2026-02-20T03:35:34.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 -- 10.20.193.28:0/2626327281 shutdown_connections 2026-02-20T03:35:34.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e7960eab40 0x55e7960ecf30 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c6b60 0x55e7960dabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 0x55e7960dc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/2626327281 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960dc470 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 -- 10.20.193.28:0/2626327281 >> 10.20.193.28:0/2626327281 conn(0x55e7960bab60 msgr2=0x55e7960c5520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:34.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f8879ffb640 0 client.21168 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:34.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 -- 10.20.193.28:0/2626327281 shutdown_connections 2026-02-20T03:35:34.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 1 -- 10.20.193.28:0/2626327281 wait complete. 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.675+0000 7f88c07dbe00 20 client.21168 trim_cache size 0 max 16384 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.680+0000 7f88c07dbe00 1 Processor -- start 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88c07dbe00 1 -- start start 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 0x55e7960f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c6b60 0x55e7960e2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f885c012820 con 0x55e7960c20c0 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f885c010030 con 0x55e7960c6b60 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f885c00de80 con 0x55e7960c2a70 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88bc84c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88bc84c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35408/0 (socket says 10.20.193.28:35408) 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.684+0000 7f88bc84c640 1 -- 10.20.193.28:0/129650705 learned_addr learned my addr 10.20.193.28:0/129650705 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.685+0000 7f88bc84c640 1 -- 10.20.193.28:0/129650705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 msgr2=0x55e7960f2be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:34.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.685+0000 7f88bc84c640 1 --2- 10.20.193.28:0/129650705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 0x55e7960f2be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.685+0000 7f88bc84c640 1 -- 10.20.193.28:0/129650705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c6b60 msgr2=0x55e7960e2300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:34.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.685+0000 7f88bc84c640 1 --2- 10.20.193.28:0/129650705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c6b60 0x55e7960e2300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.685+0000 7f88bc84c640 1 -- 10.20.193.28:0/129650705 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7960d43d0 con 0x55e7960c20c0 2026-02-20T03:35:34.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.685+0000 7f88bc84c640 1 --2- 10.20.193.28:0/129650705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960f26a0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f88ac01ebe0 tx=0x7f88ac027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aaa36f1cf542225 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:34.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.685+0000 7f887bfff640 1 -- 10.20.193.28:0/129650705 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac017040 con 0x55e7960c20c0 2026-02-20T03:35:34.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.685+0000 7f887bfff640 1 -- 10.20.193.28:0/129650705 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f88ac023030 con 0x55e7960c20c0 2026-02-20T03:35:34.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.685+0000 7f887bfff640 1 -- 10.20.193.28:0/129650705 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac012de0 con 0x55e7960c20c0 2026-02-20T03:35:34.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- 10.20.193.28:0/129650705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 msgr2=0x55e7960f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:34.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/129650705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960f26a0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f88ac01ebe0 tx=0x7f88ac027000 comp rx=0 tx=0).stop 2026-02-20T03:35:34.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- 10.20.193.28:0/129650705 shutdown_connections 2026-02-20T03:35:34.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/129650705 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c6b60 0x55e7960e2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/129650705 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 0x55e7960f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/129650705 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c20c0 0x55e7960f26a0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- 10.20.193.28:0/129650705 >> 10.20.193.28:0/129650705 conn(0x55e7960bab60 msgr2=0x55e7960c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:34.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- 10.20.193.28:0/129650705 shutdown_connections 2026-02-20T03:35:34.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- 10.20.193.28:0/129650705 wait complete. 2026-02-20T03:35:34.692 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- start start 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 Processor -- start 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c20c0 0x55e796150300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 0x55e796150840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c6b60 0x55e7960e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f885c00e4f0 con 0x55e7960c6b60 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f885c00f960 con 0x55e7960c20c0 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f885c00ebc0 con 0x55e7960c2a70 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88bc84c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c6b60 0x55e7960e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88bc84c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c6b60 0x55e7960e2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35412/0 (socket says 10.20.193.28:35412) 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88bc84c640 1 -- 10.20.193.28:0/4179672329 learned_addr learned my addr 10.20.193.28:0/4179672329 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88bc84c640 1 -- 10.20.193.28:0/4179672329 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 msgr2=0x55e796150840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:34.693 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88bc84c640 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 0x55e796150840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88bc84c640 1 -- 10.20.193.28:0/4179672329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c20c0 msgr2=0x55e796150300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88bc84c640 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c20c0 0x55e796150300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88bc84c640 1 -- 10.20.193.28:0/4179672329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e795cf3900 con 0x55e7960c6b60 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88bc84c640 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c6b60 0x55e7960e2110 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f88ac012a00 tx=0x7f88ac00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66832754bf6f51 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f8879ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f8879ffb640 1 -- 10.20.193.28:0/4179672329 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac012b60 con 0x55e7960c6b60 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f8879ffb640 1 -- 10.20.193.28:0/4179672329 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e79601c7f0 con 0x55e7960c6b60 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f8879ffb640 1 -- 10.20.193.28:0/4179672329 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac031b00 con 0x55e7960c6b60 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.686+0000 7f88c07dbe00 1 -- 10.20.193.28:0/4179672329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e795fcf4d0 con 0x55e7960c6b60 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 10 client.21174 _ll_register_callbacks cb 0x7f88ac006ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 1 -- 10.20.193.28:0/4179672329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7960225a0 con 0x55e7960c6b60 2026-02-20T03:35:34.694 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f8879ffb640 1 -- 10.20.193.28:0/4179672329 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f88ac031ca0 con 0x55e7960c6b60 2026-02-20T03:35:34.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f8879ffb640 1 -- 10.20.193.28:0/4179672329 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f88ac031420 con 0x55e7960c6b60 2026-02-20T03:35:34.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 10 client.21174 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:34.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 1 -- 10.20.193.28:0/4179672329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55e7960d50c0 con 0x55e7960c6b60 2026-02-20T03:35:34.695 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f8879ffb640 1 -- 10.20.193.28:0/4179672329 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f88ac043070 con 0x55e7960c6b60 2026-02-20T03:35:34.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 10 client.21174 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:34.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 10 client.21174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:34.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 20 client.21174 populate_metadata read hostname 'trial028' 2026-02-20T03:35:34.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e7961579f0 0x55e796159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:34.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 4 client.21174 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:35:34.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.688+0000 7f88c07dbe00 1 -- 10.20.193.28:0/4179672329 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f88ac023030 con 0x55e7961579f0 2026-02-20T03:35:34.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.702+0000 7f88b77fe640 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e7961579f0 0x55e796159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:34.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184810 21.93 MB/sec execute 305 sec latency 13395.116 ms 2026-02-20T03:35:34.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.770+0000 7f88b77fe640 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e7961579f0 0x55e796159eb0 crc :-1 s=READY pgs=532 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a664c5e9ad89bd server_cookie=5a6353f474adc57d in_seq=0 out_seq=0 2026-02-20T03:35:34.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.770+0000 7f8879ffb640 10 client.21174 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:34.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.783+0000 7f8879ffb640 1 -- 10.20.193.28:0/4179672329 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f88ac023030 con 0x55e7961579f0 2026-02-20T03:35:34.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.783+0000 7f8879ffb640 10 client.21174 handle_command_reply: tid=0 2026-02-20T03:35:34.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.783+0000 7f88c07dbe00 1 client.21174 shutdown 2026-02-20T03:35:34.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.783+0000 7f88c07dbe00 1 -- 10.20.193.28:0/4179672329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c6b60 msgr2=0x55e7960e2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:34.786 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c6b60 0x55e7960e2110 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f88ac012a00 tx=0x7f88ac00be70 comp rx=0 tx=0).stop 2026-02-20T03:35:34.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 1 -- 10.20.193.28:0/4179672329 shutdown_connections 2026-02-20T03:35:34.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55e7961579f0 0x55e796159eb0 crc :-1 s=READY pgs=532 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e7960c6b60 0x55e7960e2110 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e7960c2a70 0x55e796150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.787 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 1 --2- 10.20.193.28:0/4179672329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e7960c20c0 0x55e796150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f8879ffb640 0 client.21174 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:34.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 1 -- 10.20.193.28:0/4179672329 >> 10.20.193.28:0/4179672329 conn(0x55e7960bab60 msgr2=0x55e7960c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:34.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 1 -- 10.20.193.28:0/4179672329 shutdown_connections 2026-02-20T03:35:34.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 1 -- 10.20.193.28:0/4179672329 wait complete. 2026-02-20T03:35:34.788 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88c07dbe00 20 client.21174 trim_cache size 0 max 16384 2026-02-20T03:35:34.788 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:35:34.788 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:35:34.788 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "df0d578b-142b-48a8-8748-49b2259df5e9", 2026-02-20T03:35:34.789 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:35:34.789 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:35:34.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 -- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f888c0b0e20 msgr2=0x7f888c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:34.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f888c0b0e20 0x7f888c0b32e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f88a40a4070 tx=0x7f88a4004850 comp rx=0 tx=0).stop 2026-02-20T03:35:34.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 -- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 msgr2=0x7f88b819d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:34.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 0x7f88b819d1e0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f88a400b570 tx=0x7f88a400ba40 comp rx=0 tx=0).stop 2026-02-20T03:35:34.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 -- 10.20.193.28:0/1253588757 shutdown_connections 2026-02-20T03:35:34.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f888c0b0e20 0x7f888c0b32e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f88b810a980 0x7f88b81a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f88b8105320 0x7f88b819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 --2- 10.20.193.28:0/1253588757 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f88b8104980 0x7f88b819d1e0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 -- 10.20.193.28:0/1253588757 >> 10.20.193.28:0/1253588757 conn(0x7f88b8100680 msgr2=0x7f88b8101000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 -- 10.20.193.28:0/1253588757 shutdown_connections 2026-02-20T03:35:34.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:34.784+0000 7f88bd04d640 1 -- 10.20.193.28:0/1253588757 wait complete. 2026-02-20T03:35:34.982 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:35:35.283 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:35:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.523+0000 7fa284fd6640 1 -- 10.20.193.28:0/3345472358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 msgr2=0x7fa280108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.523+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3345472358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 0x7fa280108ae0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009a60 tx=0x7fa26c02f290 comp rx=0 tx=0).stop 2026-02-20T03:35:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.523+0000 7fa284fd6640 1 -- 10.20.193.28:0/3345472358 shutdown_connections 2026-02-20T03:35:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.523+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3345472358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2801030a0 0x7fa28010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.523+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3345472358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa280102700 0x7fa280102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.523+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3345472358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 0x7fa280108ae0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.523+0000 7fa284fd6640 1 -- 10.20.193.28:0/3345472358 >> 10.20.193.28:0/3345472358 conn(0x7fa2800fe440 msgr2=0x7fa280100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.523+0000 7fa284fd6640 1 -- 10.20.193.28:0/3345472358 shutdown_connections 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.523+0000 7fa284fd6640 1 -- 10.20.193.28:0/3345472358 wait complete. 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 Processor -- start 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 -- start start 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa280102700 0x7fa280075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2801030a0 0x7fa2800758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 0x7fa280075df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa280112a50 con 0x7fa280108700 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa2801128d0 con 0x7fa280102700 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa280112bd0 con 0x7fa2801030a0 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 0x7fa280075df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 0x7fa280075df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35426/0 (socket says 10.20.193.28:35426) 2026-02-20T03:35:35.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27ffff640 1 -- 10.20.193.28:0/3494144273 learned_addr learned my addr 10.20.193.28:0/3494144273 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27ffff640 1 -- 10.20.193.28:0/3494144273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2801030a0 msgr2=0x7fa2800758b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27ffff640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2801030a0 0x7fa2800758b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27ffff640 1 -- 10.20.193.28:0/3494144273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa280102700 msgr2=0x7fa280075370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27ffff640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa280102700 0x7fa280075370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27ffff640 1 -- 10.20.193.28:0/3494144273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2801a95a0 con 0x7fa280108700 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27ffff640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 0x7fa280075df0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fa27400b990 tx=0x7fa27400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27cff9640 1 -- 10.20.193.28:0/3494144273 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274006e60 con 0x7fa280108700 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27cff9640 1 -- 10.20.193.28:0/3494144273 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa274010070 con 0x7fa280108700 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27cff9640 1 -- 10.20.193.28:0/3494144273 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274004800 con 0x7fa280108700 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 -- 10.20.193.28:0/3494144273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2801a9890 con 0x7fa280108700 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa284fd6640 1 -- 10.20.193.28:0/3494144273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2801a9dd0 con 0x7fa280108700 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.527+0000 7fa27cff9640 1 -- 10.20.193.28:0/3494144273 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa27400c790 con 0x7fa280108700 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 Processor -- start 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 -- start start 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 0x55f074e553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4f630 0x55f074e4fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4ffb0 0x55f074e5be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f074dcfe50 con 0x55f074e4f630 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f074da29c0 con 0x55f074e4ffb0 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f074d50240 con 0x55f074e55000 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4f630 0x55f074e4fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4f630 0x55f074e4fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35428/0 (socket says 10.20.193.28:35428) 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27f7fe640 1 -- 10.20.193.28:0/3195043413 learned_addr learned my addr 10.20.193.28:0/3195043413 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27cff9640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2540b0e20 0x7fa2540b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27f7fe640 1 -- 10.20.193.28:0/3195043413 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 msgr2=0x55f074e553e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/3195043413 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 0x55f074e553e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27f7fe640 1 -- 10.20.193.28:0/3195043413 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4ffb0 msgr2=0x55f074e5be30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/3195043413 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4ffb0 0x55f074e5be30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27f7fe640 1 -- 10.20.193.28:0/3195043413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f074d63420 con 0x55f074e4f630 2026-02-20T03:35:35.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27cff9640 1 -- 10.20.193.28:0/3494144273 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa2740e0400 con 0x7fa280108700 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27ffff640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2540b0e20 0x7fa2540b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/3195043413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4f630 0x55f074e4fa70 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fa26c005880 tx=0x7fa26c038470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b2b143a06086c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa27ffff640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2540b0e20 0x7fa2540b32e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa2740a7de0 tx=0x7fa274002f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa243fff640 1 -- 10.20.193.28:0/3195043413 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c002c00 con 0x55f074e4f630 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa243fff640 1 -- 10.20.193.28:0/3195043413 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa26c033040 con 0x55f074e4f630 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa243fff640 1 -- 10.20.193.28:0/3195043413 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c004320 con 0x55f074e4f630 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 -- 10.20.193.28:0/3195043413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4f630 msgr2=0x55f074e4fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 --2- 10.20.193.28:0/3195043413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4f630 0x55f074e4fa70 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fa26c005880 tx=0x7fa26c038470 comp rx=0 tx=0).stop 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 -- 10.20.193.28:0/3195043413 shutdown_connections 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 --2- 10.20.193.28:0/3195043413 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4ffb0 0x55f074e5be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 --2- 10.20.193.28:0/3195043413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4f630 0x55f074e4fa70 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 --2- 10.20.193.28:0/3195043413 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 0x55f074e553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 -- 10.20.193.28:0/3195043413 >> 10.20.193.28:0/3195043413 conn(0x55f074e12290 msgr2=0x55f074e4dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 -- 10.20.193.28:0/3195043413 shutdown_connections 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.532+0000 7fa288764e00 1 -- 10.20.193.28:0/3195043413 wait complete. 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.535+0000 7fa288764e00 1 -- start start 2026-02-20T03:35:35.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.535+0000 7fa288764e00 1 Processor -- start 2026-02-20T03:35:35.540 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.535+0000 7fa288764e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 0x55f074e72270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 0x55f074e70a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f074d9e8f0 con 0x55f074e4ffb0 2026-02-20T03:35:35.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f074b90f50 con 0x55f074e4f630 2026-02-20T03:35:35.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f074e71060 con 0x55f074e55000 2026-02-20T03:35:35.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa27f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa27f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35436/0 (socket says 10.20.193.28:35436) 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa27f7fe640 1 -- 10.20.193.28:0/2615090395 learned_addr learned my addr 10.20.193.28:0/2615090395 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa27f7fe640 1 -- 10.20.193.28:0/2615090395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 msgr2=0x55f074e70a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 0x55f074e70a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa27f7fe640 1 -- 10.20.193.28:0/2615090395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 msgr2=0x55f074e72270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 0x55f074e72270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa27f7fe640 1 -- 10.20.193.28:0/2615090395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f074e6a4e0 con 0x55f074e4ffb0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e727b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0097c0 tx=0x7fa26c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccc1c7a05967eb5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa2417fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa2417fa640 1 -- 10.20.193.28:0/2615090395 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0042d0 con 0x55f074e4ffb0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 -- 10.20.193.28:0/2615090395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f074b73b40 con 0x55f074e4ffb0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 10 client.21186 _ll_register_callbacks cb 0x55f074ddbf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 -- 10.20.193.28:0/2615090395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f074db01a0 con 0x55f074e4ffb0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa2417fa640 1 -- 10.20.193.28:0/2615090395 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa26c046070 con 0x55f074e4ffb0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa2417fa640 1 -- 10.20.193.28:0/2615090395 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c04b6b0 con 0x55f074e4ffb0 2026-02-20T03:35:35.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa2417fa640 1 -- 10.20.193.28:0/2615090395 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa26c004470 con 0x55f074e4ffb0 2026-02-20T03:35:35.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa2417fa640 1 -- 10.20.193.28:0/2615090395 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa26c038730 con 0x55f074e4ffb0 2026-02-20T03:35:35.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 10 client.21186 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:35.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 -- 10.20.193.28:0/2615090395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55f074d5d230 con 0x55f074e4ffb0 2026-02-20T03:35:35.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa2417fa640 1 -- 10.20.193.28:0/2615090395 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fa26c053030 con 0x55f074e4ffb0 2026-02-20T03:35:35.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 10 client.21186 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:35.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 10 client.21186 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:35.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 20 client.21186 populate_metadata read hostname 'trial028' 2026-02-20T03:35:35.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f074e806e0 0x55f074e82ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 4 client.21186 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:35.563 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.541+0000 7fa288764e00 1 -- 10.20.193.28:0/2615090395 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f074daa5b0 con 0x55f074e806e0 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 -- 10.20.193.28:0/2703306139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314105b30 msgr2=0x7fa314105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 --2- 10.20.193.28:0/2703306139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314105b30 0x7fa314105fb0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fa308009a30 tx=0x7fa30802f260 comp rx=0 tx=0).stop 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 -- 10.20.193.28:0/2703306139 shutdown_connections 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 --2- 10.20.193.28:0/2703306139 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa3141064f0 0x7fa31410cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 --2- 10.20.193.28:0/2703306139 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314105b30 0x7fa314105fb0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 --2- 10.20.193.28:0/2703306139 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa314104940 0x7fa314104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 -- 10.20.193.28:0/2703306139 >> 10.20.193.28:0/2703306139 conn(0x7fa3141000c0 msgr2=0x7fa3141024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 -- 10.20.193.28:0/2703306139 shutdown_connections 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 -- 10.20.193.28:0/2703306139 wait complete. 2026-02-20T03:35:35.564 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 Processor -- start 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 -- start start 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314104940 0x7fa31419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa314105b30 0x7fa31419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.554+0000 7fa31aab7640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa3141064f0 0x7fa3141a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314104940 0x7fa31419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314104940 0x7fa31419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35458/0 (socket says 10.20.193.28:35458) 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa31aab7640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa314110550 con 0x7fa314104940 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa31aab7640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141103d0 con 0x7fa3141064f0 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa31aab7640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141106d0 con 0x7fa314105b30 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa319ab5640 1 -- 10.20.193.28:0/1771710242 learned_addr learned my addr 10.20.193.28:0/1771710242 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa319ab5640 1 -- 10.20.193.28:0/1771710242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa314105b30 msgr2=0x7fa31419d0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa314105b30 0x7fa31419d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa319ab5640 1 -- 10.20.193.28:0/1771710242 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa3141064f0 msgr2=0x7fa3141a4140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa3141064f0 0x7fa3141a4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa319ab5640 1 -- 10.20.193.28:0/1771710242 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3141a4840 con 0x7fa314104940 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314104940 0x7fa31419cb90 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa30400b750 tx=0x7fa30400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa302ffd640 1 -- 10.20.193.28:0/1771710242 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304004480 con 0x7fa314104940 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa302ffd640 1 -- 10.20.193.28:0/1771710242 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa304010070 con 0x7fa314104940 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa31aab7640 1 -- 10.20.193.28:0/1771710242 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3141a4b30 con 0x7fa314104940 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa302ffd640 1 -- 10.20.193.28:0/1771710242 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30400ca90 con 0x7fa314104940 2026-02-20T03:35:35.565 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.559+0000 7fa31aab7640 1 -- 10.20.193.28:0/1771710242 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3141a50d0 con 0x7fa314104940 2026-02-20T03:35:35.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.563+0000 7fa27effd640 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f074e806e0 0x55f074e82ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.563+0000 7fa31ec7fe00 1 Processor -- start 2026-02-20T03:35:35.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.563+0000 7fa31ec7fe00 1 -- start start 2026-02-20T03:35:35.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.563+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43dfce80 0x562b43dfd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.563+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfd7c0 0x562b43e01f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.563+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43e02560 0x562b43e049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.563+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b43d4d8f0 con 0x562b43dfd7c0 2026-02-20T03:35:35.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.563+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562b43cfb2e0 con 0x562b43dfce80 2026-02-20T03:35:35.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.563+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562b43d49820 con 0x562b43e02560 2026-02-20T03:35:35.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa302ffd640 1 -- 10.20.193.28:0/1771710242 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa30401d030 con 0x7fa314104940 2026-02-20T03:35:35.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfd7c0 0x562b43e01f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.571 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfd7c0 0x562b43e01f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35472/0 (socket says 10.20.193.28:35472) 2026-02-20T03:35:35.572 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa319ab5640 1 -- 10.20.193.28:0/1108584371 learned_addr learned my addr 10.20.193.28:0/1108584371 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa319ab5640 1 -- 10.20.193.28:0/1108584371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43e02560 msgr2=0x562b43e049f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1108584371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43e02560 0x562b43e049f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.576 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa319ab5640 1 -- 10.20.193.28:0/1108584371 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43dfce80 msgr2=0x562b43dfd280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1108584371 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43dfce80 0x562b43dfd280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa319ab5640 1 -- 10.20.193.28:0/1108584371 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b43ced5a0 con 0x562b43dfd7c0 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1108584371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfd7c0 0x562b43e01f40 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fa3040e5b70 tx=0x7fa3040e7750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76ee74f6671b42 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa2e1bfe640 1 -- 10.20.193.28:0/1108584371 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040f1670 con 0x562b43dfd7c0 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa2e1bfe640 1 -- 10.20.193.28:0/1108584371 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa3040ec070 con 0x562b43dfd7c0 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa2e1bfe640 1 -- 10.20.193.28:0/1108584371 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040e8ad0 con 0x562b43dfd7c0 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa302ffd640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2f00b0e20 0x7fa2f00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1108584371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfd7c0 msgr2=0x562b43e01f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1108584371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfd7c0 0x562b43e01f40 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fa3040e5b70 tx=0x7fa3040e7750 comp rx=0 tx=0).stop 2026-02-20T03:35:35.577 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa302ffd640 1 -- 10.20.193.28:0/1771710242 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa3040df900 con 0x7fa314104940 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31a2b6640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2f00b0e20 0x7fa2f00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1108584371 shutdown_connections 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1108584371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43e02560 0x562b43e049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1108584371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfd7c0 0x562b43e01f40 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1108584371 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43dfce80 0x562b43dfd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1108584371 >> 10.20.193.28:0/1108584371 conn(0x562b43df46f0 msgr2=0x562b43dfb570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1108584371 shutdown_connections 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.568+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1108584371 wait complete. 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31a2b6640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2f00b0e20 0x7fa2f00b32e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa31000aab0 tx=0x7fa310009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 -- start start 2026-02-20T03:35:35.578 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 Processor -- start 2026-02-20T03:35:35.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e15aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 0x562b43e15fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 0x562b43e1cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562b43cf50c0 con 0x562b43dfce80 2026-02-20T03:35:35.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562b43e05610 con 0x562b43e02560 2026-02-20T03:35:35.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562b43e1d4f0 con 0x562b43dfd7c0 2026-02-20T03:35:35.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e15aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e15aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35488/0 (socket says 10.20.193.28:35488) 2026-02-20T03:35:35.581 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa319ab5640 1 -- 10.20.193.28:0/3391679544 learned_addr learned my addr 10.20.193.28:0/3391679544 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa319ab5640 1 -- 10.20.193.28:0/3391679544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 msgr2=0x562b43e15fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa319ab5640 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 0x562b43e15fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa319ab5640 1 -- 10.20.193.28:0/3391679544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 msgr2=0x562b43e1cf60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa319ab5640 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 0x562b43e1cf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa319ab5640 1 -- 10.20.193.28:0/3391679544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b43e0f1d0 con 0x562b43dfce80 2026-02-20T03:35:35.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa319ab5640 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e15aa0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fa3040a3410 tx=0x7fa3040dd290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf47004f3fe6394 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa2d2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:35.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/3391679544 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040a3250 con 0x562b43dfce80 2026-02-20T03:35:35.582 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/3391679544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b43d09820 con 0x562b43dfce80 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/3391679544 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa3040e5e80 con 0x562b43dfce80 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/3391679544 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040a6b00 con 0x562b43dfce80 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 10 client.21198 _ll_register_callbacks cb 0x562b43cf8ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/3391679544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b43d554e0 con 0x562b43dfce80 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/3391679544 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa30400cc30 con 0x562b43dfce80 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/3391679544 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa3040a6ce0 con 0x562b43dfce80 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 10 client.21198 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/3391679544 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x562b43d0e380 con 0x562b43dfce80 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/3391679544 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fa3040a6ea0 con 0x562b43dfce80 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 10 client.21198 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 10 client.21198 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:35.583 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 20 client.21198 populate_metadata read hostname 'trial028' 2026-02-20T03:35:35.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b43e21410 0x562b43e23880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 4 client.21198 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:35.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.573+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/3391679544 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b43ccfbd0 con 0x562b43e21410 2026-02-20T03:35:35.584 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.577+0000 7fa3192b4640 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b43e21410 0x562b43e23880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.590+0000 7fa27effd640 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f074e806e0 0x55f074e82ad0 crc :-1 s=READY pgs=533 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=938e3e6af1112ed4 server_cookie=a3cc38df5a2542aa in_seq=0 out_seq=0 2026-02-20T03:35:35.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.590+0000 7fa2417fa640 10 client.21186 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:35.606 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa2417fa640 1 -- 10.20.193.28:0/2615090395 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f074daa5b0 con 0x55f074e806e0 2026-02-20T03:35:35.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa2417fa640 10 client.21186 handle_command_reply: tid=0 2026-02-20T03:35:35.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 client.21186 shutdown 2026-02-20T03:35:35.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 -- 10.20.193.28:0/2615090395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 msgr2=0x55f074e727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e727b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0097c0 tx=0x7fa26c009340 comp rx=0 tx=0).stop 2026-02-20T03:35:35.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 -- 10.20.193.28:0/2615090395 shutdown_connections 2026-02-20T03:35:35.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f074e806e0 0x55f074e82ad0 crc :-1 s=READY pgs=533 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 0x55f074e70a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e727b0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.608 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 --2- 10.20.193.28:0/2615090395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 0x55f074e72270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 -- 10.20.193.28:0/2615090395 >> 10.20.193.28:0/2615090395 conn(0x55f074e12290 msgr2=0x55f074e4e440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa2417fa640 0 client.21186 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:35.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 -- 10.20.193.28:0/2615090395 shutdown_connections 2026-02-20T03:35:35.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 1 -- 10.20.193.28:0/2615090395 wait complete. 2026-02-20T03:35:35.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.604+0000 7fa288764e00 20 client.21186 trim_cache size 0 max 16384 2026-02-20T03:35:35.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.610+0000 7fa288764e00 1 Processor -- start 2026-02-20T03:35:35.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.610+0000 7fa288764e00 1 -- start start 2026-02-20T03:35:35.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.610+0000 7fa288764e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 0x55f074e47d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.610+0000 7fa288764e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e4e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.610+0000 7fa288764e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 0x55f074e4ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.610+0000 7fa288764e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240127b0 con 0x55f074e4ffb0 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.610+0000 7fa288764e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa22400ffc0 con 0x55f074e4f630 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.610+0000 7fa288764e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa22400de10 con 0x55f074e55000 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa27f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e4e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa27f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e4e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35496/0 (socket says 10.20.193.28:35496) 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa27f7fe640 1 -- 10.20.193.28:0/3136808795 learned_addr learned my addr 10.20.193.28:0/3136808795 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa27f7fe640 1 -- 10.20.193.28:0/3136808795 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 msgr2=0x55f074e4ea60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/3136808795 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 0x55f074e4ea60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa27f7fe640 1 -- 10.20.193.28:0/3136808795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 msgr2=0x55f074e47d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/3136808795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 0x55f074e47d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa27f7fe640 1 -- 10.20.193.28:0/3136808795 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f074e6a310 con 0x55f074e4ffb0 2026-02-20T03:35:35.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/3136808795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e4e520 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0388f0 tx=0x7fa26c004020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a412067b2689860a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa2437fe640 1 -- 10.20.193.28:0/3136808795 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0042d0 con 0x55f074e4ffb0 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa2437fe640 1 -- 10.20.193.28:0/3136808795 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa26c046040 con 0x55f074e4ffb0 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa2437fe640 1 -- 10.20.193.28:0/3136808795 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c04b940 con 0x55f074e4ffb0 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 -- 10.20.193.28:0/3136808795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 msgr2=0x55f074e4e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 --2- 10.20.193.28:0/3136808795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e4e520 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0388f0 tx=0x7fa26c004020 comp rx=0 tx=0).stop 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 -- 10.20.193.28:0/3136808795 shutdown_connections 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 --2- 10.20.193.28:0/3136808795 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e55000 0x55f074e4ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 --2- 10.20.193.28:0/3136808795 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e4ffb0 0x55f074e4e520 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 --2- 10.20.193.28:0/3136808795 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 0x55f074e47d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 -- 10.20.193.28:0/3136808795 >> 10.20.193.28:0/3136808795 conn(0x55f074e12290 msgr2=0x55f074e6f340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 -- 10.20.193.28:0/3136808795 shutdown_connections 2026-02-20T03:35:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 -- 10.20.193.28:0/3136808795 wait complete. 2026-02-20T03:35:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 -- start start 2026-02-20T03:35:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 Processor -- start 2026-02-20T03:35:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 0x55f074e75520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e4ffb0 0x55f074e75a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e55000 0x55f074eeb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa22400e480 con 0x55f074e55000 2026-02-20T03:35:35.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa22400f8f0 con 0x55f074e4f630 2026-02-20T03:35:35.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.615+0000 7fa288764e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa22400eb50 con 0x55f074e4ffb0 2026-02-20T03:35:35.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa27effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e55000 0x55f074eeb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa27effd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e55000 0x55f074eeb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35510/0 (socket says 10.20.193.28:35510) 2026-02-20T03:35:35.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa27effd640 1 -- 10.20.193.28:0/2550711598 learned_addr learned my addr 10.20.193.28:0/2550711598 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa3192b4640 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b43e21410 0x562b43e23880 crc :-1 s=READY pgs=534 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8eb320d6e9cbefc server_cookie=145df23ef61e99c1 in_seq=0 out_seq=0 2026-02-20T03:35:35.624 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa2d2ffd640 10 client.21198 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:35.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa27effd640 1 -- 10.20.193.28:0/2550711598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e4ffb0 msgr2=0x55f074e75a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:35.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa27effd640 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e4ffb0 0x55f074e75a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa27effd640 1 -- 10.20.193.28:0/2550711598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 msgr2=0x55f074e75520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:35:35.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa27effd640 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 0x55f074e75520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa27effd640 1 -- 10.20.193.28:0/2550711598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f074a81870 con 0x55f074e55000 2026-02-20T03:35:35.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa27effd640 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e55000 0x55f074eeb490 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x55f074e83250 tx=0x7fa270004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d27d185911c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa2417fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:35.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa2417fa640 1 -- 10.20.193.28:0/2550711598 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa270015070 con 0x55f074e55000 2026-02-20T03:35:35.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa2417fa640 1 -- 10.20.193.28:0/2550711598 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa270009bc0 con 0x55f074e55000 2026-02-20T03:35:35.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa2417fa640 1 -- 10.20.193.28:0/2550711598 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2700133d0 con 0x55f074e55000 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 1 -- 10.20.193.28:0/2550711598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f074d42440 con 0x55f074e55000 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 10 client.21204 _ll_register_callbacks cb 0x7fa26c0057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 1 -- 10.20.193.28:0/2550711598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f074d54b00 con 0x55f074e55000 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa2417fa640 1 -- 10.20.193.28:0/2550711598 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa270009d70 con 0x55f074e55000 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa2417fa640 1 -- 10.20.193.28:0/2550711598 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa27001a460 con 0x55f074e55000 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 10 client.21204 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 1 -- 10.20.193.28:0/2550711598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55f074e6b000 con 0x55f074e55000 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa2417fa640 1 -- 10.20.193.28:0/2550711598 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fa270022070 con 0x55f074e55000 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 10 client.21204 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 10 client.21204 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:35.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 20 client.21204 populate_metadata read hostname 'trial028' 2026-02-20T03:35:35.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f074eece80 0x55f074eef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 4 client.21204 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:35:35.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.618+0000 7fa288764e00 1 -- 10.20.193.28:0/2550711598 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa26c046040 con 0x55f074eece80 2026-02-20T03:35:35.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/3391679544 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562b43ccfbd0 con 0x562b43e21410 2026-02-20T03:35:35.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa2d2ffd640 10 client.21198 handle_command_reply: tid=0 2026-02-20T03:35:35.636 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 client.21198 shutdown 2026-02-20T03:35:35.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f074eece80 0x55f074eef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/3391679544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 msgr2=0x562b43e15aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e15aa0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fa3040a3410 tx=0x7fa3040dd290 comp rx=0 tx=0).stop 2026-02-20T03:35:35.637 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/3391679544 shutdown_connections 2026-02-20T03:35:35.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b43e21410 0x562b43e23880 crc :-1 s=READY pgs=534 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 0x562b43e1cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 0x562b43e15fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/3391679544 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e15aa0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa2d2ffd640 0 client.21198 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:35.638 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/3391679544 >> 10.20.193.28:0/3391679544 conn(0x562b43df46f0 msgr2=0x562b43e03910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.644 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/3391679544 shutdown_connections 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/3391679544 wait complete. 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.632+0000 7fa31ec7fe00 20 client.21198 trim_cache size 0 max 16384 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 Processor -- start 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 -- start start 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e122e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 0x562b43e1cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 0x562b43e12820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c00127e0 con 0x562b43dfce80 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c000fff0 con 0x562b43e02560 2026-02-20T03:35:35.645 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c000de40 con 0x562b43dfd7c0 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35526/0 (socket says 10.20.193.28:35526) 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa319ab5640 1 -- 10.20.193.28:0/1109333078 learned_addr learned my addr 10.20.193.28:0/1109333078 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa319ab5640 1 -- 10.20.193.28:0/1109333078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 msgr2=0x562b43e1cf20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1109333078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 0x562b43e1cf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa319ab5640 1 -- 10.20.193.28:0/1109333078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 msgr2=0x562b43e12820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1109333078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 0x562b43e12820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa319ab5640 1 -- 10.20.193.28:0/1109333078 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b43e0f000 con 0x562b43dfce80 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1109333078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e122e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fa3040b01c0 tx=0x7fa3040e3080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2343bc8ddb1255e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa2e13fd640 1 -- 10.20.193.28:0/1109333078 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040a73b0 con 0x562b43dfce80 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa2e13fd640 1 -- 10.20.193.28:0/1109333078 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x562b43d554e0 con 0x562b43dfce80 2026-02-20T03:35:35.646 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa2e13fd640 1 -- 10.20.193.28:0/1109333078 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040b0840 con 0x562b43dfce80 2026-02-20T03:35:35.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1109333078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 msgr2=0x562b43e122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1109333078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e122e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fa3040b01c0 tx=0x7fa3040e3080 comp rx=0 tx=0).stop 2026-02-20T03:35:35.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1109333078 shutdown_connections 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1109333078 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 0x562b43e12820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1109333078 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 0x562b43e1cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1109333078 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e122e0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1109333078 >> 10.20.193.28:0/1109333078 conn(0x562b43df46f0 msgr2=0x562b43dfb570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1109333078 shutdown_connections 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.637+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1109333078 wait complete. 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 -- start start 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 Processor -- start 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e1b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 0x562b43e1b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 0x562b43e1c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c000e4b0 con 0x562b43dfce80 2026-02-20T03:35:35.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c000f920 con 0x562b43e02560 2026-02-20T03:35:35.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c000eb80 con 0x562b43dfd7c0 2026-02-20T03:35:35.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e1b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa319ab5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e1b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:35530/0 (socket says 10.20.193.28:35530) 2026-02-20T03:35:35.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa319ab5640 1 -- 10.20.193.28:0/1196109652 learned_addr learned my addr 10.20.193.28:0/1196109652 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:35.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa319ab5640 1 -- 10.20.193.28:0/1196109652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 msgr2=0x562b43e1b6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 0x562b43e1b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa319ab5640 1 -- 10.20.193.28:0/1196109652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 msgr2=0x562b43e1c590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 0x562b43e1c590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa319ab5640 1 -- 10.20.193.28:0/1196109652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b43aad690 con 0x562b43dfce80 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa319ab5640 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e1b180 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fa30400cf50 tx=0x7fa3040dfc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e96a5290e14c80 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa2d2ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/1196109652 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040a73b0 con 0x562b43dfce80 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/1196109652 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa3040ab990 con 0x562b43dfce80 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/1196109652 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3040a3250 con 0x562b43dfce80 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1196109652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b43d12b70 con 0x562b43dfce80 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 10 client.21210 _ll_register_callbacks cb 0x7fa3040e5880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1196109652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3040ec070 con 0x562b43dfce80 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/1196109652 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa3040a6ea0 con 0x562b43dfce80 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/1196109652 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa3040afd80 con 0x562b43dfce80 2026-02-20T03:35:35.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 10 client.21210 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:35.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1196109652 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x562b43e0fcf0 con 0x562b43dfce80 2026-02-20T03:35:35.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/1196109652 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fa3040a65f0 con 0x562b43dfce80 2026-02-20T03:35:35.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 10 client.21210 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:35.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 10 client.21210 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:35.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 20 client.21210 populate_metadata read hostname 'trial028' 2026-02-20T03:35:35.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b43e8c7b0 0x562b43e8ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:35.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 4 client.21210 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:35:35.653 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.642+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1196109652 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b43d1e6b0 con 0x562b43e8c7b0 2026-02-20T03:35:35.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.659+0000 7fa3192b4640 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b43e8c7b0 0x562b43e8ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:35.674 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:35 trial028 ceph-mon[38552]: pgmap v813: 129 pgs: 129 active+clean; 751 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 MiB/s rd, 12 MiB/s wr, 704 op/s 2026-02-20T03:35:35.674 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:35 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:35:35.674 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:35 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:35.675 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:35 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:35:35.675 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:35 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:35:35.675 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:35 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:35.675 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:35 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:35.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.686+0000 7fa27f7fe640 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f074eece80 0x55f074eef340 crc :-1 s=READY pgs=535 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c584630ad6f65ba0 server_cookie=ed2d314d2f4e6cad in_seq=0 out_seq=0 2026-02-20T03:35:35.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.686+0000 7fa2417fa640 10 client.21204 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:35.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa2417fa640 1 -- 10.20.193.28:0/2550711598 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fa26c046040 con 0x55f074eece80 2026-02-20T03:35:35.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa2417fa640 10 client.21204 handle_command_reply: tid=0 2026-02-20T03:35:35.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 client.21204 shutdown 2026-02-20T03:35:35.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 -- 10.20.193.28:0/2550711598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e55000 msgr2=0x55f074eeb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e55000 0x55f074eeb490 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x55f074e83250 tx=0x7fa270004480 comp rx=0 tx=0).stop 2026-02-20T03:35:35.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 -- 10.20.193.28:0/2550711598 shutdown_connections 2026-02-20T03:35:35.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f074eece80 0x55f074eef340 crc :-1 s=READY pgs=535 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f074e55000 0x55f074eeb490 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f074e4ffb0 0x55f074e75a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 --2- 10.20.193.28:0/2550711598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f074e4f630 0x55f074e75520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 -- 10.20.193.28:0/2550711598 >> 10.20.193.28:0/2550711598 conn(0x55f074e12290 msgr2=0x55f074e50af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa2417fa640 0 client.21204 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:35.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 -- 10.20.193.28:0/2550711598 shutdown_connections 2026-02-20T03:35:35.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 1 -- 10.20.193.28:0/2550711598 wait complete. 2026-02-20T03:35:35.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa288764e00 20 client.21204 trim_cache size 0 max 16384 2026-02-20T03:35:35.704 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:35:35.704 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:35:35.704 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:35:35.704 INFO:teuthology.orchestra.run.trial028.stdout: "df0d578b-142b-48a8-8748-49b2259df5e9": { 2026-02-20T03:35:35.704 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:35:35.704 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "df0d578b-142b-48a8-8748-49b2259df5e9", 2026-02-20T03:35:35.704 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:35:35.704 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:35:35.704 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:35:35.705 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:35:35.714 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 -- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2540b0e20 msgr2=0x7fa2540b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2540b0e20 0x7fa2540b32e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa2740a7de0 tx=0x7fa274002f10 comp rx=0 tx=0).stop 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 -- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 msgr2=0x7fa280075df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 0x7fa280075df0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fa27400b990 tx=0x7fa27400be60 comp rx=0 tx=0).stop 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 -- 10.20.193.28:0/3494144273 shutdown_connections 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2540b0e20 0x7fa2540b32e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa280108700 0x7fa280075df0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2801030a0 0x7fa2800758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 --2- 10.20.193.28:0/3494144273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa280102700 0x7fa280075370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 -- 10.20.193.28:0/3494144273 >> 10.20.193.28:0/3494144273 conn(0x7fa2800fe440 msgr2=0x7fa2800fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.715 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 -- 10.20.193.28:0/3494144273 shutdown_connections 2026-02-20T03:35:35.716 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:35:35.699+0000 7fa284fd6640 1 -- 10.20.193.28:0/3494144273 wait complete. 2026-02-20T03:35:35.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184811 21.85 MB/sec execute 306 sec latency 14395.157 ms 2026-02-20T03:35:35.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.726+0000 7fa2d2ffd640 10 client.21210 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:35.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.726+0000 7fa3192b4640 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b43e8c7b0 0x562b43e8ec70 crc :-1 s=READY pgs=536 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=280c14cec2245b91 server_cookie=da1f8d05324ed68 in_seq=0 out_seq=0 2026-02-20T03:35:35.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:35 trial126 ceph-mon[38476]: pgmap v813: 129 pgs: 129 active+clean; 751 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 MiB/s rd, 12 MiB/s wr, 704 op/s 2026-02-20T03:35:35.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:35 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:35:35.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:35 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:35.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:35 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:35:35.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:35 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:35:35.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:35 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:35.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:35 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:35.902 INFO:tasks.cephfs.filesystem:scrub status for tag:df0d578b-142b-48a8-8748-49b2259df5e9 - {'path': '/', 'tag': 'df0d578b-142b-48a8-8748-49b2259df5e9', 'options': 'recursive,force'} 2026-02-20T03:35:35.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa2d2ffd640 1 -- 10.20.193.28:0/1196109652 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b43d1e6b0 con 0x562b43e8c7b0 2026-02-20T03:35:35.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa2d2ffd640 10 client.21210 handle_command_reply: tid=0 2026-02-20T03:35:35.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 client.21210 shutdown 2026-02-20T03:35:35.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1196109652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 msgr2=0x562b43e1b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e1b180 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7fa30400cf50 tx=0x7fa3040dfc80 comp rx=0 tx=0).stop 2026-02-20T03:35:35.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1196109652 shutdown_connections 2026-02-20T03:35:35.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562b43e8c7b0 0x562b43e8ec70 crc :-1 s=READY pgs=536 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562b43e02560 0x562b43e1c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562b43dfd7c0 0x562b43e1b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 --2- 10.20.193.28:0/1196109652 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562b43dfce80 0x562b43e1b180 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa2d2ffd640 0 client.21210 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:35.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1196109652 >> 10.20.193.28:0/1196109652 conn(0x562b43df46f0 msgr2=0x562b43e15130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1196109652 shutdown_connections 2026-02-20T03:35:35.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 1 -- 10.20.193.28:0/1196109652 wait complete. 2026-02-20T03:35:35.905 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31ec7fe00 20 client.21210 trim_cache size 0 max 16384 2026-02-20T03:35:35.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:35:35.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:35:35.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:35:35.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:35:35.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 -- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2f00b0e20 msgr2=0x7fa2f00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2f00b0e20 0x7fa2f00b32e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa31000aab0 tx=0x7fa310009250 comp rx=0 tx=0).stop 2026-02-20T03:35:35.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 -- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314104940 msgr2=0x7fa31419cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:35.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314104940 0x7fa31419cb90 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa30400b750 tx=0x7fa30400bc20 comp rx=0 tx=0).stop 2026-02-20T03:35:35.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 -- 10.20.193.28:0/1771710242 shutdown_connections 2026-02-20T03:35:35.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa2f00b0e20 0x7fa2f00b32e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa3141064f0 0x7fa3141a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa314105b30 0x7fa31419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 --2- 10.20.193.28:0/1771710242 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa314104940 0x7fa31419cb90 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:35.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 -- 10.20.193.28:0/1771710242 >> 10.20.193.28:0/1771710242 conn(0x7fa3141000c0 msgr2=0x7fa314108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:35.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 -- 10.20.193.28:0/1771710242 shutdown_connections 2026-02-20T03:35:35.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:35.899+0000 7fa31aab7640 1 -- 10.20.193.28:0/1771710242 wait complete. 2026-02-20T03:35:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:35 trial177 ceph-mon[43181]: pgmap v813: 129 pgs: 129 active+clean; 751 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 3.3 MiB/s rd, 12 MiB/s wr, 704 op/s 2026-02-20T03:35:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:35 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:35:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:35 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:35 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:35:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:35 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:35:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:35 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:35 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:36.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184811 21.78 MB/sec execute 307 sec latency 15395.197 ms 2026-02-20T03:35:36.743 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:36 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:35:36.743 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:36 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:36.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:36 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:35:36.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:36 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:36 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:35:36.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:36 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:35:37.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184811 21.71 MB/sec execute 308 sec latency 16395.233 ms 2026-02-20T03:35:37.811 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:37 trial028 ceph-mon[38552]: pgmap v814: 129 pgs: 129 active+clean; 764 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 616 op/s 2026-02-20T03:35:37.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:37 trial126 ceph-mon[38476]: pgmap v814: 129 pgs: 129 active+clean; 764 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 616 op/s 2026-02-20T03:35:37.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:37 trial177 ceph-mon[43181]: pgmap v814: 129 pgs: 129 active+clean; 764 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 616 op/s 2026-02-20T03:35:38.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.64 MB/sec execute 309 sec latency 16867.698 ms 2026-02-20T03:35:39.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.57 MB/sec execute 310 sec latency 17867.736 ms 2026-02-20T03:35:39.774 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:39 trial028 ceph-mon[38552]: pgmap v815: 129 pgs: 129 active+clean; 782 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 369 KiB/s rd, 11 MiB/s wr, 392 op/s 2026-02-20T03:35:39.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:39 trial126 ceph-mon[38476]: pgmap v815: 129 pgs: 129 active+clean; 782 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 369 KiB/s rd, 11 MiB/s wr, 392 op/s 2026-02-20T03:35:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:39 trial177 ceph-mon[43181]: pgmap v815: 129 pgs: 129 active+clean; 782 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 369 KiB/s rd, 11 MiB/s wr, 392 op/s 2026-02-20T03:35:40.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.50 MB/sec execute 311 sec latency 18867.779 ms 2026-02-20T03:35:40.923 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:40 trial028 ceph-mon[38552]: pgmap v816: 129 pgs: 129 active+clean; 806 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 482 KiB/s rd, 13 MiB/s wr, 396 op/s 2026-02-20T03:35:40.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:40 trial177 ceph-mon[43181]: pgmap v816: 129 pgs: 129 active+clean; 806 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 482 KiB/s rd, 13 MiB/s wr, 396 op/s 2026-02-20T03:35:41.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:40 trial126 ceph-mon[38476]: pgmap v816: 129 pgs: 129 active+clean; 806 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 482 KiB/s rd, 13 MiB/s wr, 396 op/s 2026-02-20T03:35:41.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.43 MB/sec execute 312 sec latency 19867.830 ms 2026-02-20T03:35:42.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.37 MB/sec execute 313 sec latency 20867.871 ms 2026-02-20T03:35:43.420 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:43 trial028 ceph-mon[38552]: pgmap v817: 129 pgs: 129 active+clean; 813 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 469 KiB/s rd, 11 MiB/s wr, 373 op/s 2026-02-20T03:35:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:43 trial177 ceph-mon[43181]: pgmap v817: 129 pgs: 129 active+clean; 813 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 469 KiB/s rd, 11 MiB/s wr, 373 op/s 2026-02-20T03:35:43.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.30 MB/sec execute 314 sec latency 21867.924 ms 2026-02-20T03:35:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:43 trial126 ceph-mon[38476]: pgmap v817: 129 pgs: 129 active+clean; 813 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 469 KiB/s rd, 11 MiB/s wr, 373 op/s 2026-02-20T03:35:44.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.23 MB/sec execute 315 sec latency 22867.978 ms 2026-02-20T03:35:45.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:45 trial028 ceph-mon[38552]: pgmap v818: 129 pgs: 129 active+clean; 804 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 327 KiB/s rd, 11 MiB/s wr, 375 op/s 2026-02-20T03:35:45.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:45 trial177 ceph-mon[43181]: pgmap v818: 129 pgs: 129 active+clean; 804 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 327 KiB/s rd, 11 MiB/s wr, 375 op/s 2026-02-20T03:35:45.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.16 MB/sec execute 316 sec latency 23868.025 ms 2026-02-20T03:35:45.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:45 trial126 ceph-mon[38476]: pgmap v818: 129 pgs: 129 active+clean; 804 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 327 KiB/s rd, 11 MiB/s wr, 375 op/s 2026-02-20T03:35:46.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.10 MB/sec execute 317 sec latency 24868.069 ms 2026-02-20T03:35:47.559 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:47 trial028 ceph-mon[38552]: pgmap v819: 129 pgs: 129 active+clean; 781 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 380 KiB/s rd, 11 MiB/s wr, 407 op/s 2026-02-20T03:35:47.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:47 trial177 ceph-mon[43181]: pgmap v819: 129 pgs: 129 active+clean; 781 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 380 KiB/s rd, 11 MiB/s wr, 407 op/s 2026-02-20T03:35:47.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 21.03 MB/sec execute 318 sec latency 25868.109 ms 2026-02-20T03:35:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:47 trial126 ceph-mon[38476]: pgmap v819: 129 pgs: 129 active+clean; 781 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 380 KiB/s rd, 11 MiB/s wr, 407 op/s 2026-02-20T03:35:48.682 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:48 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:35:48.682 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:48 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:35:48.682 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:48 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:35:48.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:48 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:35:48.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:48 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:35:48.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:48 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:35:48.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 20.96 MB/sec execute 319 sec latency 26868.151 ms 2026-02-20T03:35:48.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:48 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:35:48.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:48 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:35:48.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:48 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:35:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 -- 10.20.193.28:0/253072676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45840759c0 msgr2=0x7f4584075e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 --2- 10.20.193.28:0/253072676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45840759c0 0x7f4584075e20 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f4578009a30 tx=0x7f457802f260 comp rx=0 tx=0).stop 2026-02-20T03:35:48.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 -- 10.20.193.28:0/253072676 shutdown_connections 2026-02-20T03:35:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 --2- 10.20.193.28:0/253072676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f458410a5f0 0x7f458410ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 --2- 10.20.193.28:0/253072676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45840759c0 0x7f4584075e20 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:48.984 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 --2- 10.20.193.28:0/253072676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4584077030 0x7f4584075480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:48.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 -- 10.20.193.28:0/253072676 >> 10.20.193.28:0/253072676 conn(0x7f45840fddf0 msgr2=0x7f4584100230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:48.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 -- 10.20.193.28:0/253072676 shutdown_connections 2026-02-20T03:35:48.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 -- 10.20.193.28:0/253072676 wait complete. 2026-02-20T03:35:48.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 Processor -- start 2026-02-20T03:35:48.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.979+0000 7f458a2a3640 1 -- start start 2026-02-20T03:35:48.987 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f458a2a3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45840759c0 0x7f458419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:48.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f458a2a3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4584077030 0x7f458419d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:48.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f458a2a3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f458410a5f0 0x7f45841a4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:48.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f458a2a3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4584110510 con 0x7f45840759c0 2026-02-20T03:35:48.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f458a2a3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4584110390 con 0x7f458410a5f0 2026-02-20T03:35:48.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f458a2a3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4584110690 con 0x7f4584077030 2026-02-20T03:35:48.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f45892a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45840759c0 0x7f458419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:48.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f4588aa0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4584077030 0x7f458419d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:48.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f4588aa0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4584077030 0x7f458419d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:55908/0 (socket says 10.20.193.28:55908) 2026-02-20T03:35:48.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f4588aa0640 1 -- 10.20.193.28:0/2811624638 learned_addr learned my addr 10.20.193.28:0/2811624638 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:48.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f4589aa2640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f458410a5f0 0x7f45841a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:48.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f45892a1640 1 -- 10.20.193.28:0/2811624638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4584077030 msgr2=0x7f458419d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:48.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f45892a1640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4584077030 0x7f458419d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:48.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.981+0000 7f45892a1640 1 -- 10.20.193.28:0/2811624638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f458410a5f0 msgr2=0x7f45841a4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f45892a1640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f458410a5f0 0x7f45841a4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f45892a1640 1 -- 10.20.193.28:0/2811624638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45841a4830 con 0x7f45840759c0 2026-02-20T03:35:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f45892a1640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45840759c0 0x7f458419cb80 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f457400b550 tx=0x7f457400ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f45727fc640 1 -- 10.20.193.28:0/2811624638 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574016070 con 0x7f45840759c0 2026-02-20T03:35:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f458a2a3640 1 -- 10.20.193.28:0/2811624638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45841a4b20 con 0x7f45840759c0 2026-02-20T03:35:48.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f45727fc640 1 -- 10.20.193.28:0/2811624638 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45740044e0 con 0x7f45840759c0 2026-02-20T03:35:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f458a2a3640 1 -- 10.20.193.28:0/2811624638 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45841a5070 con 0x7f45840759c0 2026-02-20T03:35:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f45727fc640 1 -- 10.20.193.28:0/2811624638 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574016070 con 0x7f45840759c0 2026-02-20T03:35:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f45727fc640 1 -- 10.20.193.28:0/2811624638 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f457400fa10 con 0x7f45840759c0 2026-02-20T03:35:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f458e463e00 1 Processor -- start 2026-02-20T03:35:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.983+0000 7f458e463e00 1 -- start start 2026-02-20T03:35:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eae80 0x55f8770eb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eb7c0 0x55f8770eff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770f0560 0x55f8770f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:48.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f87703b8f0 con 0x55f8770eb7c0 2026-02-20T03:35:48.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f876fe92e0 con 0x55f8770eae80 2026-02-20T03:35:48.995 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f877037820 con 0x55f8770f0560 2026-02-20T03:35:49.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45727fc640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45600b0fa0 0x7f45600b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eb7c0 0x55f8770eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:49.004 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eb7c0 0x55f8770eff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43882/0 (socket says 10.20.193.28:43882) 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 -- 10.20.193.28:0/3401908820 learned_addr learned my addr 10.20.193.28:0/3401908820 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f4589aa2640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45600b0fa0 0x7f45600b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45727fc640 1 -- 10.20.193.28:0/2811624638 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f45740e0800 con 0x7f45840759c0 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 -- 10.20.193.28:0/3401908820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770f0560 msgr2=0x55f8770f29f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- 10.20.193.28:0/3401908820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770f0560 0x55f8770f29f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 -- 10.20.193.28:0/3401908820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eae80 msgr2=0x55f8770eb280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- 10.20.193.28:0/3401908820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eae80 0x55f8770eb280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 -- 10.20.193.28:0/3401908820 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f876fdb5a0 con 0x55f8770eb7c0 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- 10.20.193.28:0/3401908820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eb7c0 0x55f8770eff40 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f45740a8560 tx=0x7f45740a8470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf50bfc93f7eb03e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f4589aa2640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45600b0fa0 0x7f45600b3460 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4580004650 tx=0x7f4580002b00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:49.005 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45517fe640 1 -- 10.20.193.28:0/3401908820 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45740a8cd0 con 0x55f8770eb7c0 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45517fe640 1 -- 10.20.193.28:0/3401908820 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45740ac980 con 0x55f8770eb7c0 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45517fe640 1 -- 10.20.193.28:0/3401908820 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574056df0 con 0x55f8770eb7c0 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- 10.20.193.28:0/3401908820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eb7c0 msgr2=0x55f8770eff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- 10.20.193.28:0/3401908820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eb7c0 0x55f8770eff40 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f45740a8560 tx=0x7f45740a8470 comp rx=0 tx=0).stop 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- 10.20.193.28:0/3401908820 shutdown_connections 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- 10.20.193.28:0/3401908820 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770f0560 0x55f8770f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- 10.20.193.28:0/3401908820 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eb7c0 0x55f8770eff40 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- 10.20.193.28:0/3401908820 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eae80 0x55f8770eb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- 10.20.193.28:0/3401908820 >> 10.20.193.28:0/3401908820 conn(0x55f8770e26f0 msgr2=0x55f8770e9570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- 10.20.193.28:0/3401908820 shutdown_connections 2026-02-20T03:35:49.006 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- 10.20.193.28:0/3401908820 wait complete. 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- start start 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 Processor -- start 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eae80 0x55f8771039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eb7c0 0x55f877103f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770f0560 0x55f87710aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f876fe30c0 con 0x55f8770eae80 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f8770f35b0 con 0x55f8770f0560 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f87711c850 con 0x55f8770eb7c0 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eae80 0x55f8771039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eae80 0x55f8771039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43888/0 (socket says 10.20.193.28:43888) 2026-02-20T03:35:49.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 -- 10.20.193.28:0/1080215745 learned_addr learned my addr 10.20.193.28:0/1080215745 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:49.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 -- 10.20.193.28:0/1080215745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eb7c0 msgr2=0x55f877103f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:49.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eb7c0 0x55f877103f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 -- 10.20.193.28:0/1080215745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770f0560 msgr2=0x55f87710aeb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:49.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770f0560 0x55f87710aeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 -- 10.20.193.28:0/1080215745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8770fd120 con 0x55f8770eae80 2026-02-20T03:35:49.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45892a1640 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eae80 0x55f8771039f0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f457400bf30 tx=0x7f45740b1830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea409026c09a28d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:49.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45427fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:49.008 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45427fc640 1 -- 10.20.193.28:0/1080215745 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45740a75e0 con 0x55f8770eae80 2026-02-20T03:35:49.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45427fc640 1 -- 10.20.193.28:0/1080215745 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45740a7780 con 0x55f8770eae80 2026-02-20T03:35:49.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45427fc640 1 -- 10.20.193.28:0/1080215745 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45740a3cf0 con 0x55f8770eae80 2026-02-20T03:35:49.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- 10.20.193.28:0/1080215745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f876ff7820 con 0x55f8770eae80 2026-02-20T03:35:49.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f45427fc640 1 -- 10.20.193.28:0/1080215745 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f45740a3e90 con 0x55f8770eae80 2026-02-20T03:35:49.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 10 client.21222 _ll_register_callbacks cb 0x55f876fe6ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:49.011 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.989+0000 7f458e463e00 1 -- 10.20.193.28:0/1080215745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f8770434e0 con 0x55f8770eae80 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f45427fc640 1 -- 10.20.193.28:0/1080215745 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f45740ce070 con 0x55f8770eae80 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f458e463e00 10 client.21222 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f458e463e00 1 -- 10.20.193.28:0/1080215745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55f876ffc380 con 0x55f8770eae80 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f45427fc640 1 -- 10.20.193.28:0/1080215745 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f45740adb10 con 0x55f8770eae80 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f458e463e00 10 client.21222 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f458e463e00 10 client.21222 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f458e463e00 20 client.21222 populate_metadata read hostname 'trial028' 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f458e463e00 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f877120820 0x55f877122c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f458e463e00 4 client.21222 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:35:49.012 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.994+0000 7f458e463e00 1 -- 10.20.193.28:0/1080215745 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f876fbdbd0 con 0x55f877120820 2026-02-20T03:35:49.013 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:48.996+0000 7f4588aa0640 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f877120820 0x55f877122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:49.054 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.050+0000 7f45427fc640 10 client.21222 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:49.055 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.050+0000 7f4588aa0640 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f877120820 0x55f877122c30 crc :-1 s=READY pgs=537 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1d3f11cdba84cfb server_cookie=692c5fbd1bd317c2 in_seq=0 out_seq=0 2026-02-20T03:35:49.067 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f45427fc640 1 -- 10.20.193.28:0/1080215745 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f876fbdbd0 con 0x55f877120820 2026-02-20T03:35:49.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f45427fc640 10 client.21222 handle_command_reply: tid=0 2026-02-20T03:35:49.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 client.21222 shutdown 2026-02-20T03:35:49.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 -- 10.20.193.28:0/1080215745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eae80 msgr2=0x55f8771039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:49.068 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eae80 0x55f8771039f0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f457400bf30 tx=0x7f45740b1830 comp rx=0 tx=0).stop 2026-02-20T03:35:49.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 -- 10.20.193.28:0/1080215745 shutdown_connections 2026-02-20T03:35:49.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f877120820 0x55f877122c30 crc :-1 s=READY pgs=537 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f45427fc640 0 client.21222 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:49.069 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770f0560 0x55f87710aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eb7c0 0x55f877103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 --2- 10.20.193.28:0/1080215745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770eae80 0x55f8771039f0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 -- 10.20.193.28:0/1080215745 >> 10.20.193.28:0/1080215745 conn(0x55f8770e26f0 msgr2=0x55f8770f1910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:49.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.064+0000 7f458e463e00 1 -- 10.20.193.28:0/1080215745 shutdown_connections 2026-02-20T03:35:49.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.066+0000 7f458e463e00 1 -- 10.20.193.28:0/1080215745 wait complete. 2026-02-20T03:35:49.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.066+0000 7f458e463e00 20 client.21222 trim_cache size 0 max 16384 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f458e463e00 1 Processor -- start 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f458e463e00 1 -- start start 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f458e463e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eae80 0x55f877101fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f458e463e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eb7c0 0x55f87710ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f458e463e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877100230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f458e463e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4528012760 con 0x55f8770f0560 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f458e463e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f452800ff70 con 0x55f8770eb7c0 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f458e463e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f452800ddc0 con 0x55f8770eae80 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f4589aa2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f4589aa2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877100230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43894/0 (socket says 10.20.193.28:43894) 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f4589aa2640 1 -- 10.20.193.28:0/3761608805 learned_addr learned my addr 10.20.193.28:0/3761608805 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f4589aa2640 1 -- 10.20.193.28:0/3761608805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eae80 msgr2=0x55f877101fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f4589aa2640 1 --2- 10.20.193.28:0/3761608805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eae80 0x55f877101fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f4589aa2640 1 -- 10.20.193.28:0/3761608805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eb7c0 msgr2=0x55f87710ae70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f4589aa2640 1 --2- 10.20.193.28:0/3761608805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eb7c0 0x55f87710ae70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.073+0000 7f4589aa2640 1 -- 10.20.193.28:0/3761608805 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8770fcf50 con 0x55f8770f0560 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.074+0000 7f4589aa2640 1 --2- 10.20.193.28:0/3761608805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877100230 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f4580009ec0 tx=0x7f4580010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959e6061cb1c6758 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.074+0000 7f4550ffd640 1 -- 10.20.193.28:0/3761608805 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580006e60 con 0x55f8770f0560 2026-02-20T03:35:49.079 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.074+0000 7f4550ffd640 1 -- 10.20.193.28:0/3761608805 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f45800170d0 con 0x55f8770f0560 2026-02-20T03:35:49.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.074+0000 7f4550ffd640 1 -- 10.20.193.28:0/3761608805 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580014430 con 0x55f8770f0560 2026-02-20T03:35:49.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.074+0000 7f458e463e00 1 -- 10.20.193.28:0/3761608805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 msgr2=0x55f877100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:49.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.074+0000 7f458e463e00 1 --2- 10.20.193.28:0/3761608805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877100230 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f4580009ec0 tx=0x7f4580010000 comp rx=0 tx=0).stop 2026-02-20T03:35:49.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 -- 10.20.193.28:0/3761608805 shutdown_connections 2026-02-20T03:35:49.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 --2- 10.20.193.28:0/3761608805 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877100230 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 --2- 10.20.193.28:0/3761608805 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eb7c0 0x55f87710ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 --2- 10.20.193.28:0/3761608805 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eae80 0x55f877101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.080 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 -- 10.20.193.28:0/3761608805 >> 10.20.193.28:0/3761608805 conn(0x55f8770e26f0 msgr2=0x55f8770e9570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:49.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 -- 10.20.193.28:0/3761608805 shutdown_connections 2026-02-20T03:35:49.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 -- 10.20.193.28:0/3761608805 wait complete. 2026-02-20T03:35:49.081 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 -- start start 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 Processor -- start 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eae80 0x55f87710adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eb7c0 0x55f8771094d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877109a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f452800e430 con 0x55f8770f0560 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f452800f8a0 con 0x55f8770eb7c0 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f458e463e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f452800eb00 con 0x55f8770eae80 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f4589aa2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877109a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f4589aa2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877109a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43896/0 (socket says 10.20.193.28:43896) 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f4589aa2640 1 -- 10.20.193.28:0/110117865 learned_addr learned my addr 10.20.193.28:0/110117865 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f4589aa2640 1 -- 10.20.193.28:0/110117865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eae80 msgr2=0x55f87710adc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f4589aa2640 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eae80 0x55f87710adc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f4589aa2640 1 -- 10.20.193.28:0/110117865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eb7c0 msgr2=0x55f8771094d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f4589aa2640 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eb7c0 0x55f8771094d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.075+0000 7f4589aa2640 1 -- 10.20.193.28:0/110117865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f876d9b690 con 0x55f8770f0560 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f4589aa2640 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877109a30 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f4580015bf0 tx=0x7f4580015c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde4d7fafeaeaf87 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f45427fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f45427fc640 1 -- 10.20.193.28:0/110117865 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580017280 con 0x55f8770f0560 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f45427fc640 1 -- 10.20.193.28:0/110117865 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f458002a8d0 con 0x55f8770f0560 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f45427fc640 1 -- 10.20.193.28:0/110117865 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580021550 con 0x55f8770f0560 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f458e463e00 1 -- 10.20.193.28:0/110117865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f877000b70 con 0x55f8770f0560 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f458e463e00 10 client.21228 _ll_register_callbacks cb 0x7f45740047e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:35:49.082 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f458e463e00 1 -- 10.20.193.28:0/110117865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45740ac980 con 0x55f8770f0560 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f45427fc640 1 -- 10.20.193.28:0/110117865 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f45800216f0 con 0x55f8770f0560 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f45427fc640 1 -- 10.20.193.28:0/110117865 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f4580038050 con 0x55f8770f0560 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f458e463e00 10 client.21228 fetch_fsmap learned FSMap version 48 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f458e463e00 1 -- 10.20.193.28:0/110117865 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55f8770fdc40 con 0x55f8770f0560 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f45427fc640 1 -- 10.20.193.28:0/110117865 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f458002aa80 con 0x55f8770f0560 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f458e463e00 10 client.21228 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f458e463e00 10 client.21228 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f458e463e00 20 client.21228 populate_metadata read hostname 'trial028' 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.077+0000 7f458e463e00 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f87718cbe0 0x55f87718f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.078+0000 7f458e463e00 4 client.21228 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:35:49.083 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.078+0000 7f458e463e00 1 -- 10.20.193.28:0/110117865 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f87700c6b0 con 0x55f87718cbe0 2026-02-20T03:35:49.094 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.092+0000 7f45892a1640 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f87718cbe0 0x55f87718f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:35:49.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.120+0000 7f45892a1640 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f87718cbe0 0x55f87718f0a0 crc :-1 s=READY pgs=538 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b7259c6932acf0 server_cookie=884e8696159400b8 in_seq=0 out_seq=0 2026-02-20T03:35:49.123 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.120+0000 7f45427fc640 10 client.21228 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:49.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f45427fc640 1 -- 10.20.193.28:0/110117865 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f87700c6b0 con 0x55f87718cbe0 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f45427fc640 10 client.21228 handle_command_reply: tid=0 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 client.21228 shutdown 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 -- 10.20.193.28:0/110117865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 msgr2=0x55f877109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877109a30 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f4580015bf0 tx=0x7f4580015c20 comp rx=0 tx=0).stop 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 -- 10.20.193.28:0/110117865 shutdown_connections 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f87718cbe0 0x55f87718f0a0 crc :-1 s=READY pgs=538 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f45427fc640 0 client.21228 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8770f0560 0x55f877109a30 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8770eb7c0 0x55f8771094d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 --2- 10.20.193.28:0/110117865 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f8770eae80 0x55f87710adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 -- 10.20.193.28:0/110117865 >> 10.20.193.28:0/110117865 conn(0x55f8770e26f0 msgr2=0x55f8771030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 -- 10.20.193.28:0/110117865 shutdown_connections 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 1 -- 10.20.193.28:0/110117865 wait complete. 2026-02-20T03:35:49.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.247+0000 7f458e463e00 20 client.21228 trim_cache size 0 max 16384 2026-02-20T03:35:49.263 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:35:49.263 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:35:49.263 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:35:49.263 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:35:49.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 -- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45600b0fa0 msgr2=0x7f45600b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:49.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45600b0fa0 0x7f45600b3460 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4580004650 tx=0x7f4580002b00 comp rx=0 tx=0).stop 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 -- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45840759c0 msgr2=0x7f458419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45840759c0 0x7f458419cb80 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f457400b550 tx=0x7f457400ba20 comp rx=0 tx=0).stop 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 -- 10.20.193.28:0/2811624638 shutdown_connections 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f45600b0fa0 0x7f45600b3460 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f458410a5f0 0x7f45841a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4584077030 0x7f458419d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 --2- 10.20.193.28:0/2811624638 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f45840759c0 0x7f458419cb80 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 -- 10.20.193.28:0/2811624638 >> 10.20.193.28:0/2811624638 conn(0x7f45840fddf0 msgr2=0x7f45841065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 -- 10.20.193.28:0/2811624638 shutdown_connections 2026-02-20T03:35:49.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:35:49.249+0000 7f458a2a3640 1 -- 10.20.193.28:0/2811624638 wait complete. 2026-02-20T03:35:49.511 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:49 trial028 ceph-mon[38552]: pgmap v820: 129 pgs: 129 active+clean; 788 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 373 KiB/s rd, 10 MiB/s wr, 373 op/s 2026-02-20T03:35:49.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:49 trial177 ceph-mon[43181]: pgmap v820: 129 pgs: 129 active+clean; 788 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 373 KiB/s rd, 10 MiB/s wr, 373 op/s 2026-02-20T03:35:49.719 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 20.90 MB/sec execute 320 sec latency 27868.299 ms 2026-02-20T03:35:49.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:49 trial126 ceph-mon[38476]: pgmap v820: 129 pgs: 129 active+clean; 788 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 373 KiB/s rd, 10 MiB/s wr, 373 op/s 2026-02-20T03:35:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:35:50.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:35:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:35:50.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:50 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:35:50.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 20.83 MB/sec execute 321 sec latency 28868.341 ms 2026-02-20T03:35:50.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:35:50.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:35:50.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:35:50.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:50 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:35:50.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:35:50.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:35:50.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:35:50.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:50 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:35:51.717 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:51 trial028 ceph-mon[38552]: pgmap v821: 129 pgs: 129 active+clean; 803 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 379 KiB/s rd, 12 MiB/s wr, 435 op/s 2026-02-20T03:35:51.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 20.77 MB/sec execute 322 sec latency 29868.378 ms 2026-02-20T03:35:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:51 trial126 ceph-mon[38476]: pgmap v821: 129 pgs: 129 active+clean; 803 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 379 KiB/s rd, 12 MiB/s wr, 435 op/s 2026-02-20T03:35:51.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:51 trial177 ceph-mon[43181]: pgmap v821: 129 pgs: 129 active+clean; 803 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 379 KiB/s rd, 12 MiB/s wr, 435 op/s 2026-02-20T03:35:52.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 20.70 MB/sec execute 323 sec latency 30868.422 ms 2026-02-20T03:35:53.577 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:53 trial028 ceph-mon[38552]: pgmap v822: 129 pgs: 129 active+clean; 799 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 225 KiB/s rd, 10 MiB/s wr, 415 op/s 2026-02-20T03:35:53.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 20.64 MB/sec execute 324 sec latency 31868.467 ms 2026-02-20T03:35:53.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:53 trial126 ceph-mon[38476]: pgmap v822: 129 pgs: 129 active+clean; 799 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 225 KiB/s rd, 10 MiB/s wr, 415 op/s 2026-02-20T03:35:53.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:53 trial177 ceph-mon[43181]: pgmap v822: 129 pgs: 129 active+clean; 799 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 225 KiB/s rd, 10 MiB/s wr, 415 op/s 2026-02-20T03:35:54.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 20.58 MB/sec execute 325 sec latency 32868.493 ms 2026-02-20T03:35:55.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184815 20.51 MB/sec execute 326 sec latency 33868.526 ms 2026-02-20T03:35:55.724 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:55 trial028 ceph-mon[38552]: pgmap v823: 129 pgs: 129 active+clean; 809 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 268 KiB/s rd, 10 MiB/s wr, 426 op/s 2026-02-20T03:35:55.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:55 trial126 ceph-mon[38476]: pgmap v823: 129 pgs: 129 active+clean; 809 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 268 KiB/s rd, 10 MiB/s wr, 426 op/s 2026-02-20T03:35:55.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:55 trial177 ceph-mon[43181]: pgmap v823: 129 pgs: 129 active+clean; 809 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 268 KiB/s rd, 10 MiB/s wr, 426 op/s 2026-02-20T03:35:56.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 20.45 MB/sec execute 327 sec latency 34259.257 ms 2026-02-20T03:35:57.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:57 trial028 ceph-mon[38552]: pgmap v824: 129 pgs: 129 active+clean; 835 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 268 KiB/s rd, 12 MiB/s wr, 421 op/s 2026-02-20T03:35:57.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 20.39 MB/sec execute 328 sec latency 22720.061 ms 2026-02-20T03:35:57.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:57 trial126 ceph-mon[38476]: pgmap v824: 129 pgs: 129 active+clean; 835 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 268 KiB/s rd, 12 MiB/s wr, 421 op/s 2026-02-20T03:35:57.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:57 trial177 ceph-mon[43181]: pgmap v824: 129 pgs: 129 active+clean; 835 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 268 KiB/s rd, 12 MiB/s wr, 421 op/s 2026-02-20T03:35:58.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 20.33 MB/sec execute 329 sec latency 23720.089 ms 2026-02-20T03:35:59.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 20.27 MB/sec execute 330 sec latency 24720.115 ms 2026-02-20T03:35:59.801 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:35:59 trial028 ceph-mon[38552]: pgmap v825: 129 pgs: 129 active+clean; 837 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 208 KiB/s rd, 11 MiB/s wr, 357 op/s 2026-02-20T03:35:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:35:59 trial126 ceph-mon[38476]: pgmap v825: 129 pgs: 129 active+clean; 837 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 208 KiB/s rd, 11 MiB/s wr, 357 op/s 2026-02-20T03:35:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:35:59 trial177 ceph-mon[43181]: pgmap v825: 129 pgs: 129 active+clean; 837 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 208 KiB/s rd, 11 MiB/s wr, 357 op/s 2026-02-20T03:36:00.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 20.20 MB/sec execute 331 sec latency 25720.148 ms 2026-02-20T03:36:01.718 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:01 trial028 ceph-mon[38552]: pgmap v826: 129 pgs: 129 active+clean; 837 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 169 KiB/s rd, 8.7 MiB/s wr, 303 op/s 2026-02-20T03:36:01.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 20.14 MB/sec execute 332 sec latency 26720.190 ms 2026-02-20T03:36:01.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:01 trial177 ceph-mon[43181]: pgmap v826: 129 pgs: 129 active+clean; 837 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 169 KiB/s rd, 8.7 MiB/s wr, 303 op/s 2026-02-20T03:36:02.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:01 trial126 ceph-mon[38476]: pgmap v826: 129 pgs: 129 active+clean; 837 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 169 KiB/s rd, 8.7 MiB/s wr, 303 op/s 2026-02-20T03:36:02.329 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 -- 10.20.193.28:0/400438853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18078cf0 msgr2=0x7ffb18079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:02.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 --2- 10.20.193.28:0/400438853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18078cf0 0x7ffb18079150 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009a30 tx=0x7ffb0002f260 comp rx=0 tx=0).stop 2026-02-20T03:36:02.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 -- 10.20.193.28:0/400438853 shutdown_connections 2026-02-20T03:36:02.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 --2- 10.20.193.28:0/400438853 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffb18079690 0x7ffb18079f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 --2- 10.20.193.28:0/400438853 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18078cf0 0x7ffb18079150 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 --2- 10.20.193.28:0/400438853 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffb18077ab0 0x7ffb18077eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.330 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 -- 10.20.193.28:0/400438853 >> 10.20.193.28:0/400438853 conn(0x7ffb18100080 msgr2=0x7ffb181024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 -- 10.20.193.28:0/400438853 shutdown_connections 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 -- 10.20.193.28:0/400438853 wait complete. 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 Processor -- start 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 -- start start 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18077ab0 0x7ffb181a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffb18078cf0 0x7ffb181a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffb18079690 0x7ffb181a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181149d0 con 0x7ffb18077ab0 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18114850 con 0x7ffb18078cf0 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb17fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18114b50 con 0x7ffb18079690 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18077ab0 0x7ffb181a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:02.332 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18077ab0 0x7ffb181a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43842/0 (socket says 10.20.193.28:43842) 2026-02-20T03:36:02.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb16ffd640 1 -- 10.20.193.28:0/2724521753 learned_addr learned my addr 10.20.193.28:0/2724521753 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:02.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb16ffd640 1 -- 10.20.193.28:0/2724521753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffb18079690 msgr2=0x7ffb181a8630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:02.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb16ffd640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffb18079690 0x7ffb181a8630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb16ffd640 1 -- 10.20.193.28:0/2724521753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffb18078cf0 msgr2=0x7ffb181a15c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:02.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb16ffd640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffb18078cf0 0x7ffb181a15c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb16ffd640 1 -- 10.20.193.28:0/2724521753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb181a8d30 con 0x7ffb18077ab0 2026-02-20T03:36:02.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.325+0000 7ffb16ffd640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18077ab0 0x7ffb181a1080 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b570 tx=0x7ffb0c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:02.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.329+0000 7ffaf7fff640 1 -- 10.20.193.28:0/2724521753 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c013020 con 0x7ffb18077ab0 2026-02-20T03:36:02.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.329+0000 7ffaf7fff640 1 -- 10.20.193.28:0/2724521753 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffb0c004480 con 0x7ffb18077ab0 2026-02-20T03:36:02.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.329+0000 7ffaf7fff640 1 -- 10.20.193.28:0/2724521753 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c00fb50 con 0x7ffb18077ab0 2026-02-20T03:36:02.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.329+0000 7ffb17fff640 1 -- 10.20.193.28:0/2724521753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb181a8fc0 con 0x7ffb18077ab0 2026-02-20T03:36:02.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.329+0000 7ffb17fff640 1 -- 10.20.193.28:0/2724521753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb181a9580 con 0x7ffb18077ab0 2026-02-20T03:36:02.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffaf7fff640 1 -- 10.20.193.28:0/2724521753 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ffb0c002780 con 0x7ffb18077ab0 2026-02-20T03:36:02.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffaf7fff640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffae80b0ea0 0x7ffae80b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffaf7fff640 1 -- 10.20.193.28:0/2724521753 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ffb0c0e04e0 con 0x7ffb18077ab0 2026-02-20T03:36:02.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb20215e00 1 Processor -- start 2026-02-20T03:36:02.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffae80b0ea0 0x7ffae80b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:02.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb20215e00 1 -- start start 2026-02-20T03:36:02.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffae80b0ea0 0x7ffae80b3360 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffb0002f770 tx=0x7ffb000023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:02.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4ef9e80 0x55b9e4efa280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4efa7c0 0x55b9e4efef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 0x55b9e4f019f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb20215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b9e4e4a8f0 con 0x55b9e4efa7c0 2026-02-20T03:36:02.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb20215e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b9e4df82e0 con 0x55b9e4ef9e80 2026-02-20T03:36:02.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb20215e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b9e4e46820 con 0x55b9e4eff560 2026-02-20T03:36:02.338 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4efa7c0 0x55b9e4efef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4efa7c0 0x55b9e4efef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43848/0 (socket says 10.20.193.28:43848) 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 -- 10.20.193.28:0/40473407 learned_addr learned my addr 10.20.193.28:0/40473407 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 -- 10.20.193.28:0/40473407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 msgr2=0x55b9e4f019f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 --2- 10.20.193.28:0/40473407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 0x55b9e4f019f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 -- 10.20.193.28:0/40473407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4ef9e80 msgr2=0x55b9e4efa280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 --2- 10.20.193.28:0/40473407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4ef9e80 0x55b9e4efa280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 -- 10.20.193.28:0/40473407 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e4dea5a0 con 0x55b9e4efa7c0 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.330+0000 7ffb167fc640 1 --2- 10.20.193.28:0/40473407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4efa7c0 0x55b9e4efef40 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ffb00002fd0 tx=0x7ffb0003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef5b800703242b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffaf53fe640 1 -- 10.20.193.28:0/40473407 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00004050 con 0x55b9e4efa7c0 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffaf53fe640 1 -- 10.20.193.28:0/40473407 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffb00033040 con 0x55b9e4efa7c0 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffaf53fe640 1 -- 10.20.193.28:0/40473407 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0004f6e0 con 0x55b9e4efa7c0 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- 10.20.193.28:0/40473407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4efa7c0 msgr2=0x55b9e4efef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 --2- 10.20.193.28:0/40473407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4efa7c0 0x55b9e4efef40 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ffb00002fd0 tx=0x7ffb0003d000 comp rx=0 tx=0).stop 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- 10.20.193.28:0/40473407 shutdown_connections 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 --2- 10.20.193.28:0/40473407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 0x55b9e4f019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 --2- 10.20.193.28:0/40473407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4efa7c0 0x55b9e4efef40 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 --2- 10.20.193.28:0/40473407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4ef9e80 0x55b9e4efa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- 10.20.193.28:0/40473407 >> 10.20.193.28:0/40473407 conn(0x55b9e4ef16f0 msgr2=0x55b9e4ef8570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- 10.20.193.28:0/40473407 shutdown_connections 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- 10.20.193.28:0/40473407 wait complete. 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- start start 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 Processor -- start 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f12a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.342 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4efa7c0 0x55b9e4f12f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 0x55b9e4f19ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b9e4df20c0 con 0x55b9e4ef9e80 2026-02-20T03:36:02.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b9e4f025b0 con 0x55b9e4efa7c0 2026-02-20T03:36:02.343 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b9e4f1a460 con 0x55b9e4eff560 2026-02-20T03:36:02.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f12a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:02.348 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f12a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43862/0 (socket says 10.20.193.28:43862) 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb16ffd640 1 -- 10.20.193.28:0/2010297706 learned_addr learned my addr 10.20.193.28:0/2010297706 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb16ffd640 1 -- 10.20.193.28:0/2010297706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 msgr2=0x55b9e4f19ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb16ffd640 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 0x55b9e4f19ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb16ffd640 1 -- 10.20.193.28:0/2010297706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4efa7c0 msgr2=0x55b9e4f12f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb16ffd640 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4efa7c0 0x55b9e4f12f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb16ffd640 1 -- 10.20.193.28:0/2010297706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e4f0c120 con 0x55b9e4ef9e80 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb16ffd640 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f12a10 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00bf50 tx=0x7ffb0c0a77d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f9e6ff1174ffb8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffadcbfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffadcbfc640 1 -- 10.20.193.28:0/2010297706 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0b1420 con 0x55b9e4ef9e80 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffadcbfc640 1 -- 10.20.193.28:0/2010297706 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffb0c0e0110 con 0x55b9e4ef9e80 2026-02-20T03:36:02.349 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffadcbfc640 1 -- 10.20.193.28:0/2010297706 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0a6c40 con 0x55b9e4ef9e80 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- 10.20.193.28:0/2010297706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e4e06820 con 0x55b9e4ef9e80 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffadcbfc640 1 -- 10.20.193.28:0/2010297706 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ffb0c0a6de0 con 0x55b9e4ef9e80 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffadcbfc640 10 client.21240 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 10 client.21240 _ll_register_callbacks cb 0x55b9e4df5ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- 10.20.193.28:0/2010297706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9e4e524e0 con 0x55b9e4ef9e80 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffadcbfc640 1 -- 10.20.193.28:0/2010297706 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ffb0c0a3e30 con 0x55b9e4ef9e80 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 10 client.21240 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- 10.20.193.28:0/2010297706 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55b9e4e0b380 con 0x55b9e4ef9e80 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffadcbfc640 1 -- 10.20.193.28:0/2010297706 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7ffb0c0ca040 con 0x55b9e4ef9e80 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 10 client.21240 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 10 client.21240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 20 client.21240 populate_metadata read hostname 'trial028' 2026-02-20T03:36:02.350 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b9e4f1e810 0x55b9e4f20cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 4 client.21240 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:02.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.336+0000 7ffb20215e00 1 -- 10.20.193.28:0/2010297706 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9e4dccbd0 con 0x55b9e4f1e810 2026-02-20T03:36:02.351 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.344+0000 7ffb167fc640 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b9e4f1e810 0x55b9e4f20cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:02.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.385+0000 7ffadcbfc640 10 client.21240 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:02.388 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.385+0000 7ffb167fc640 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b9e4f1e810 0x55b9e4f20cd0 crc :-1 s=READY pgs=539 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816dd0fb9bb16b81 server_cookie=3bb83765079972c0 in_seq=0 out_seq=0 2026-02-20T03:36:02.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffadcbfc640 1 -- 10.20.193.28:0/2010297706 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b9e4dccbd0 con 0x55b9e4f1e810 2026-02-20T03:36:02.402 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffadcbfc640 10 client.21240 handle_command_reply: tid=0 2026-02-20T03:36:02.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 client.21240 shutdown 2026-02-20T03:36:02.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 -- 10.20.193.28:0/2010297706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 msgr2=0x55b9e4f12a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:02.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f12a10 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00bf50 tx=0x7ffb0c0a77d0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 -- 10.20.193.28:0/2010297706 shutdown_connections 2026-02-20T03:36:02.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b9e4f1e810 0x55b9e4f20cd0 crc :-1 s=READY pgs=539 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 0x55b9e4f19ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4efa7c0 0x55b9e4f12f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2010297706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f12a10 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 -- 10.20.193.28:0/2010297706 >> 10.20.193.28:0/2010297706 conn(0x55b9e4ef16f0 msgr2=0x55b9e4f00910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:02.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffadcbfc640 0 client.21240 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:02.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 -- 10.20.193.28:0/2010297706 shutdown_connections 2026-02-20T03:36:02.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 1 -- 10.20.193.28:0/2010297706 wait complete. 2026-02-20T03:36:02.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.399+0000 7ffb20215e00 20 client.21240 trim_cache size 0 max 16384 2026-02-20T03:36:02.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.405+0000 7ffb20215e00 1 Processor -- start 2026-02-20T03:36:02.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.405+0000 7ffb20215e00 1 -- start start 2026-02-20T03:36:02.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.405+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f12a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.405+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4efa7c0 0x55b9e4f19e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.405+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4eff560 0x55b9e4f0f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.405+0000 7ffb20215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc012710 con 0x55b9e4eff560 2026-02-20T03:36:02.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.405+0000 7ffb20215e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc00ff20 con 0x55b9e4ef9e80 2026-02-20T03:36:02.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.405+0000 7ffb20215e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc00dd70 con 0x55b9e4efa7c0 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4eff560 0x55b9e4f0f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb177fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4eff560 0x55b9e4f0f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43870/0 (socket says 10.20.193.28:43870) 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb177fe640 1 -- 10.20.193.28:0/2778871680 learned_addr learned my addr 10.20.193.28:0/2778871680 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb177fe640 1 -- 10.20.193.28:0/2778871680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4efa7c0 msgr2=0x55b9e4f19e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb177fe640 1 --2- 10.20.193.28:0/2778871680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4efa7c0 0x55b9e4f19e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb177fe640 1 -- 10.20.193.28:0/2778871680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4ef9e80 msgr2=0x55b9e4f12a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb177fe640 1 --2- 10.20.193.28:0/2778871680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f12a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb177fe640 1 -- 10.20.193.28:0/2778871680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e4f0bf50 con 0x55b9e4eff560 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb177fe640 1 --2- 10.20.193.28:0/2778871680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4eff560 0x55b9e4f0f250 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009c20 tx=0x7ffb0800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d318081e5269f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:02.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffaf4bfd640 1 -- 10.20.193.28:0/2778871680 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08017070 con 0x55b9e4eff560 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffaf4bfd640 1 -- 10.20.193.28:0/2778871680 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ffb08009e40 con 0x55b9e4eff560 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffaf4bfd640 1 -- 10.20.193.28:0/2778871680 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08006e60 con 0x55b9e4eff560 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 -- 10.20.193.28:0/2778871680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4eff560 msgr2=0x55b9e4f0f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2778871680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4eff560 0x55b9e4f0f250 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009c20 tx=0x7ffb0800b420 comp rx=0 tx=0).stop 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 -- 10.20.193.28:0/2778871680 shutdown_connections 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2778871680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4eff560 0x55b9e4f0f250 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2778871680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4efa7c0 0x55b9e4f19e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 --2- 10.20.193.28:0/2778871680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f12a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 -- 10.20.193.28:0/2778871680 >> 10.20.193.28:0/2778871680 conn(0x55b9e4ef16f0 msgr2=0x55b9e4f11940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 -- 10.20.193.28:0/2778871680 shutdown_connections 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 -- 10.20.193.28:0/2778871680 wait complete. 2026-02-20T03:36:02.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.410+0000 7ffb20215e00 1 -- start start 2026-02-20T03:36:02.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.412+0000 7ffb20215e00 1 Processor -- start 2026-02-20T03:36:02.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.412+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f18850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.412+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4efa7c0 0x55b9e4f18d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.412+0000 7ffb20215e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 0x55b9e4f192d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.412+0000 7ffb20215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc00e3e0 con 0x55b9e4ef9e80 2026-02-20T03:36:02.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.412+0000 7ffb20215e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc00f850 con 0x55b9e4efa7c0 2026-02-20T03:36:02.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.412+0000 7ffb20215e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ffabc00eab0 con 0x55b9e4eff560 2026-02-20T03:36:02.421 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f18850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb16ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f18850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:43880/0 (socket says 10.20.193.28:43880) 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb16ffd640 1 -- 10.20.193.28:0/3851285862 learned_addr learned my addr 10.20.193.28:0/3851285862 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb16ffd640 1 -- 10.20.193.28:0/3851285862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 msgr2=0x55b9e4f192d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb16ffd640 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 0x55b9e4f192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb16ffd640 1 -- 10.20.193.28:0/3851285862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4efa7c0 msgr2=0x55b9e4f18d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb16ffd640 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4efa7c0 0x55b9e4f18d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb16ffd640 1 -- 10.20.193.28:0/3851285862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9e4f1a7a0 con 0x55b9e4ef9e80 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb16ffd640 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f18850 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0ddba0 tx=0x7ffb0c0a8020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c343e2142e62d4d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffadcbfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:02.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffadcbfc640 1 -- 10.20.193.28:0/3851285862 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0b1420 con 0x55b9e4ef9e80 2026-02-20T03:36:02.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffadcbfc640 1 -- 10.20.193.28:0/3851285862 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55b9e4e524e0 con 0x55b9e4ef9e80 2026-02-20T03:36:02.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffadcbfc640 1 -- 10.20.193.28:0/3851285862 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0a83e0 con 0x55b9e4ef9e80 2026-02-20T03:36:02.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 1 -- 10.20.193.28:0/3851285862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9e4baa690 con 0x55b9e4ef9e80 2026-02-20T03:36:02.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 10 client.21246 _ll_register_callbacks cb 0x7ffb0c0a7930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:02.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 1 -- 10.20.193.28:0/3851285862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9e4e1b6b0 con 0x55b9e4ef9e80 2026-02-20T03:36:02.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffadcbfc640 1 -- 10.20.193.28:0/3851285862 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ffb0c094130 con 0x55b9e4ef9e80 2026-02-20T03:36:02.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffadcbfc640 1 -- 10.20.193.28:0/3851285862 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ffb0c0ac350 con 0x55b9e4ef9e80 2026-02-20T03:36:02.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 10 client.21246 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:02.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 1 -- 10.20.193.28:0/3851285862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55b9e4e0fb70 con 0x55b9e4ef9e80 2026-02-20T03:36:02.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffadcbfc640 1 -- 10.20.193.28:0/3851285862 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7ffb0c0ca040 con 0x55b9e4ef9e80 2026-02-20T03:36:02.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 10 client.21246 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:02.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 10 client.21246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:02.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 20 client.21246 populate_metadata read hostname 'trial028' 2026-02-20T03:36:02.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b9e4f8aaf0 0x55b9e4f8cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:02.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 4 client.21246 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:36:02.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.413+0000 7ffb20215e00 1 -- 10.20.193.28:0/3851285862 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9e4dccbd0 con 0x55b9e4f8aaf0 2026-02-20T03:36:02.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.440+0000 7ffb167fc640 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b9e4f8aaf0 0x55b9e4f8cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:02.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.467+0000 7ffadcbfc640 10 client.21246 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:02.471 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.467+0000 7ffb167fc640 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b9e4f8aaf0 0x55b9e4f8cfb0 crc :-1 s=READY pgs=540 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e69692a7b495d994 server_cookie=eb6958ff75023bf7 in_seq=0 out_seq=0 2026-02-20T03:36:02.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.564+0000 7ffadcbfc640 1 -- 10.20.193.28:0/3851285862 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9e4dccbd0 con 0x55b9e4f8aaf0 2026-02-20T03:36:02.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.564+0000 7ffadcbfc640 10 client.21246 handle_command_reply: tid=0 2026-02-20T03:36:02.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.564+0000 7ffb20215e00 1 client.21246 shutdown 2026-02-20T03:36:02.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 -- 10.20.193.28:0/3851285862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 msgr2=0x55b9e4f18850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:02.567 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f18850 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c0ddba0 tx=0x7ffb0c0a8020 comp rx=0 tx=0).stop 2026-02-20T03:36:02.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 -- 10.20.193.28:0/3851285862 shutdown_connections 2026-02-20T03:36:02.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b9e4f8aaf0 0x55b9e4f8cfb0 crc :-1 s=READY pgs=540 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b9e4eff560 0x55b9e4f192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b9e4efa7c0 0x55b9e4f18d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 --2- 10.20.193.28:0/3851285862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b9e4ef9e80 0x55b9e4f18850 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.568 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffadcbfc640 0 client.21246 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:02.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 -- 10.20.193.28:0/3851285862 >> 10.20.193.28:0/3851285862 conn(0x55b9e4ef16f0 msgr2=0x55b9e4ef7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:02.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 -- 10.20.193.28:0/3851285862 shutdown_connections 2026-02-20T03:36:02.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 1 -- 10.20.193.28:0/3851285862 wait complete. 2026-02-20T03:36:02.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.565+0000 7ffb20215e00 20 client.21246 trim_cache size 0 max 16384 2026-02-20T03:36:02.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:36:02.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:36:02.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:36:02.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 -- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffae80b0ea0 msgr2=0x7ffae80b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffae80b0ea0 0x7ffae80b3360 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffb0002f770 tx=0x7ffb000023d0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 -- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18077ab0 msgr2=0x7ffb181a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18077ab0 0x7ffb181a1080 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b570 tx=0x7ffb0c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 -- 10.20.193.28:0/2724521753 shutdown_connections 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ffae80b0ea0 0x7ffae80b3360 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ffb18079690 0x7ffb181a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ffb18078cf0 0x7ffb181a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 --2- 10.20.193.28:0/2724521753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ffb18077ab0 0x7ffb181a1080 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 -- 10.20.193.28:0/2724521753 >> 10.20.193.28:0/2724521753 conn(0x7ffb18100080 msgr2=0x7ffb181017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 -- 10.20.193.28:0/2724521753 shutdown_connections 2026-02-20T03:36:02.580 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:02.566+0000 7ffb17fff640 1 -- 10.20.193.28:0/2724521753 wait complete. 2026-02-20T03:36:02.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 20.08 MB/sec execute 333 sec latency 27720.278 ms 2026-02-20T03:36:02.841 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:02 trial028 ceph-mon[38552]: pgmap v827: 129 pgs: 129 active+clean; 834 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 419 KiB/s rd, 5.7 MiB/s wr, 186 op/s 2026-02-20T03:36:02.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:02 trial177 ceph-mon[43181]: pgmap v827: 129 pgs: 129 active+clean; 834 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 419 KiB/s rd, 5.7 MiB/s wr, 186 op/s 2026-02-20T03:36:03.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:02 trial126 ceph-mon[38476]: pgmap v827: 129 pgs: 129 active+clean; 834 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 419 KiB/s rd, 5.7 MiB/s wr, 186 op/s 2026-02-20T03:36:03.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 20.02 MB/sec execute 334 sec latency 28720.318 ms 2026-02-20T03:36:04.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.96 MB/sec execute 335 sec latency 29720.400 ms 2026-02-20T03:36:05.620 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:05 trial028 ceph-mon[38552]: pgmap v828: 129 pgs: 129 active+clean; 821 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 354 KiB/s rd, 4.6 MiB/s wr, 150 op/s 2026-02-20T03:36:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:05 trial177 ceph-mon[43181]: pgmap v828: 129 pgs: 129 active+clean; 821 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 354 KiB/s rd, 4.6 MiB/s wr, 150 op/s 2026-02-20T03:36:05.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.90 MB/sec execute 336 sec latency 30720.438 ms 2026-02-20T03:36:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:05 trial126 ceph-mon[38476]: pgmap v828: 129 pgs: 129 active+clean; 821 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 354 KiB/s rd, 4.6 MiB/s wr, 150 op/s 2026-02-20T03:36:05.903 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:36:06.208 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:06.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.444+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3010564681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad04100f30 msgr2=0x7fad04101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:06.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.444+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3010564681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad04100f30 0x7fad04101310 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7facf4009a30 tx=0x7facf402f2f0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.444+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3010564681 shutdown_connections 2026-02-20T03:36:06.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.444+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3010564681 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad041069d0 0x7fad041073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.444+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3010564681 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad04101850 0x7fad041062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.444+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3010564681 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad04100f30 0x7fad04101310 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.452 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.444+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3010564681 >> 10.20.193.28:0/3010564681 conn(0x7fad04078230 msgr2=0x7fad04078640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:06.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.444+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3010564681 shutdown_connections 2026-02-20T03:36:06.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.444+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3010564681 wait complete. 2026-02-20T03:36:06.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad0a2bb640 1 Processor -- start 2026-02-20T03:36:06.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad0a2bb640 1 -- start start 2026-02-20T03:36:06.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad0a2bb640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad04100f30 0x7fad041a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad0a2bb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad04101850 0x7fad041a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad0a2bb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad041069d0 0x7fad041a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad0a2bb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fad041191e0 con 0x7fad041069d0 2026-02-20T03:36:06.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad0a2bb640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fad04119060 con 0x7fad04100f30 2026-02-20T03:36:06.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad0a2bb640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fad04119360 con 0x7fad04101850 2026-02-20T03:36:06.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad09aba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad041069d0 0x7fad041a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:06.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad09aba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad041069d0 0x7fad041a5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40184/0 (socket says 10.20.193.28:40184) 2026-02-20T03:36:06.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad09aba640 1 -- 10.20.193.28:0/3096483727 learned_addr learned my addr 10.20.193.28:0/3096483727 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad09aba640 1 -- 10.20.193.28:0/3096483727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad04101850 msgr2=0x7fad041a1c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad09aba640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad04101850 0x7fad041a1c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad09aba640 1 -- 10.20.193.28:0/3096483727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad04100f30 msgr2=0x7fad041a1710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad09aba640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad04100f30 0x7fad041a1710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.449+0000 7fad09aba640 1 -- 10.20.193.28:0/3096483727 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad041a6760 con 0x7fad041069d0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.450+0000 7fad09aba640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad041069d0 0x7fad041a5fe0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fad0000b990 tx=0x7fad0000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.450+0000 7facf27fc640 1 -- 10.20.193.28:0/3096483727 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00006e60 con 0x7fad041069d0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.450+0000 7facf27fc640 1 -- 10.20.193.28:0/3096483727 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad00010070 con 0x7fad041069d0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.450+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3096483727 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad041a6a50 con 0x7fad041069d0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.450+0000 7facf27fc640 1 -- 10.20.193.28:0/3096483727 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00004800 con 0x7fad041069d0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.450+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3096483727 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad041ae290 con 0x7fad041069d0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7facf27fc640 1 -- 10.20.193.28:0/3096483727 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fad0000c790 con 0x7fad041069d0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7fad0da49e00 1 Processor -- start 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7fad0da49e00 1 -- start start 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 0x5613a770a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704630 0x5613a7704a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704fb0 0x5613a7710e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7fad0da49e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5613a7684e50 con 0x5613a7704630 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7fad0da49e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5613a76579c0 con 0x5613a7704fb0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7fad0da49e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5613a7605240 con 0x5613a770a000 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.453+0000 7fad092b9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704630 0x5613a7704a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7fad092b9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704630 0x5613a7704a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40192/0 (socket says 10.20.193.28:40192) 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7fad092b9640 1 -- 10.20.193.28:0/1324500107 learned_addr learned my addr 10.20.193.28:0/1324500107 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7fad092b9640 1 -- 10.20.193.28:0/1324500107 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 msgr2=0x5613a770a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7fad092b9640 1 --2- 10.20.193.28:0/1324500107 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 0x5613a770a3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7fad092b9640 1 -- 10.20.193.28:0/1324500107 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704fb0 msgr2=0x5613a7710e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7fad092b9640 1 --2- 10.20.193.28:0/1324500107 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704fb0 0x5613a7710e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7fad092b9640 1 -- 10.20.193.28:0/1324500107 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613a7618420 con 0x5613a7704630 2026-02-20T03:36:06.458 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7fad092b9640 1 --2- 10.20.193.28:0/1324500107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704630 0x5613a7704a70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7facf4009b60 tx=0x7facf402fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e358cbd627fd2932 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7face1ce5640 1 -- 10.20.193.28:0/1324500107 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf402fc40 con 0x5613a7704630 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7face1ce5640 1 -- 10.20.193.28:0/1324500107 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7facf4033040 con 0x5613a7704630 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7face1ce5640 1 -- 10.20.193.28:0/1324500107 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4002e30 con 0x5613a7704630 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7facf27fc640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facd40b0e20 0x7facd40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.454+0000 7facf27fc640 1 -- 10.20.193.28:0/3096483727 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fad000e0400 con 0x7fad041069d0 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 -- 10.20.193.28:0/1324500107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704630 msgr2=0x5613a7704a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 --2- 10.20.193.28:0/1324500107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704630 0x5613a7704a70 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7facf4009b60 tx=0x7facf402fb50 comp rx=0 tx=0).stop 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad08ab8640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facd40b0e20 0x7facd40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 -- 10.20.193.28:0/1324500107 shutdown_connections 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 --2- 10.20.193.28:0/1324500107 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704fb0 0x5613a7710e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.459 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 --2- 10.20.193.28:0/1324500107 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704630 0x5613a7704a70 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 --2- 10.20.193.28:0/1324500107 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 0x5613a770a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 -- 10.20.193.28:0/1324500107 >> 10.20.193.28:0/1324500107 conn(0x5613a76c7290 msgr2=0x5613a7702d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 -- 10.20.193.28:0/1324500107 shutdown_connections 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 -- 10.20.193.28:0/1324500107 wait complete. 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad08ab8640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facd40b0e20 0x7facd40b32e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7facf8006fd0 tx=0x7facf8006d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.455+0000 7fad0da49e00 1 -- start start 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 Processor -- start 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 0x5613a771edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a771f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 0x5613a771d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5613a76538f0 con 0x5613a7704fb0 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5613a7445f50 con 0x5613a7704630 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5613a771dbe0 con 0x5613a770a000 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad08ab8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a771f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad08ab8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a771f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40196/0 (socket says 10.20.193.28:40196) 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad08ab8640 1 -- 10.20.193.28:0/69875793 learned_addr learned my addr 10.20.193.28:0/69875793 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad08ab8640 1 -- 10.20.193.28:0/69875793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 msgr2=0x5613a771d5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad08ab8640 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 0x5613a771d5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad08ab8640 1 -- 10.20.193.28:0/69875793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 msgr2=0x5613a771edf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad08ab8640 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 0x5613a771edf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad08ab8640 1 -- 10.20.193.28:0/69875793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613a7716b70 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad08ab8640 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a771f330 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7facf8006f20 tx=0x7facf8004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b759c5e370396786 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7facbaffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7facbaffd640 1 -- 10.20.193.28:0/69875793 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf800bdc0 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7facbaffd640 1 -- 10.20.193.28:0/69875793 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7facf80118e0 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7facbaffd640 1 -- 10.20.193.28:0/69875793 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8020820 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 -- 10.20.193.28:0/69875793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613a7428b40 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7facbaffd640 1 -- 10.20.193.28:0/69875793 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7facf8013430 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 10 client.21258 _ll_register_callbacks cb 0x5613a7690f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 -- 10.20.193.28:0/69875793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5613a76651a0 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7facbaffd640 1 -- 10.20.193.28:0/69875793 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7facf8011440 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 10 client.21258 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 -- 10.20.193.28:0/69875793 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5613a7612230 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7facbaffd640 1 -- 10.20.193.28:0/69875793 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7facf8028030 con 0x5613a7704fb0 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 10 client.21258 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 10 client.21258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 20 client.21258 populate_metadata read hostname 'trial028' 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5613a772d6d0 0x5613a772fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 4 client.21258 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:06.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.457+0000 7fad0da49e00 1 -- 10.20.193.28:0/69875793 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613a765f5b0 con 0x5613a772d6d0 2026-02-20T03:36:06.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.484+0000 7fad092b9640 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5613a772d6d0 0x5613a772fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.551+0000 7facbaffd640 10 client.21258 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:06.553 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.551+0000 7fad092b9640 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5613a772d6d0 0x5613a772fb90 crc :-1 s=READY pgs=541 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94ed9be52377a380 server_cookie=488fa28179ae8ef6 in_seq=0 out_seq=0 2026-02-20T03:36:06.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7facbaffd640 1 -- 10.20.193.28:0/69875793 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5613a765f5b0 con 0x5613a772d6d0 2026-02-20T03:36:06.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7facbaffd640 10 client.21258 handle_command_reply: tid=0 2026-02-20T03:36:06.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 client.21258 shutdown 2026-02-20T03:36:06.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 -- 10.20.193.28:0/69875793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 msgr2=0x5613a771f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:06.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a771f330 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7facf8006f20 tx=0x7facf8004890 comp rx=0 tx=0).stop 2026-02-20T03:36:06.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 -- 10.20.193.28:0/69875793 shutdown_connections 2026-02-20T03:36:06.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5613a772d6d0 0x5613a772fb90 crc :-1 s=READY pgs=541 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 0x5613a771d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a771f330 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 --2- 10.20.193.28:0/69875793 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 0x5613a771edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 -- 10.20.193.28:0/69875793 >> 10.20.193.28:0/69875793 conn(0x5613a76c7290 msgr2=0x5613a7703440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:06.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7facbaffd640 0 client.21258 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:06.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 -- 10.20.193.28:0/69875793 shutdown_connections 2026-02-20T03:36:06.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.577+0000 7fad0da49e00 1 -- 10.20.193.28:0/69875793 wait complete. 2026-02-20T03:36:06.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.578+0000 7fad0da49e00 20 client.21258 trim_cache size 0 max 16384 2026-02-20T03:36:06.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad0da49e00 1 Processor -- start 2026-02-20T03:36:06.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad0da49e00 1 -- start start 2026-02-20T03:36:06.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 0x5613a76fcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a7704fb0 0x5613a7703520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a770a000 0x5613a7703a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad0da49e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7facb00127b0 con 0x5613a770a000 2026-02-20T03:36:06.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad0da49e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7facb000ffc0 con 0x5613a7704630 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad0da49e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7facb000de10 con 0x5613a7704fb0 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad09aba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a770a000 0x5613a7703a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad09aba640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a770a000 0x5613a7703a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40198/0 (socket says 10.20.193.28:40198) 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.584+0000 7fad09aba640 1 -- 10.20.193.28:0/2803264686 learned_addr learned my addr 10.20.193.28:0/2803264686 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad09aba640 1 -- 10.20.193.28:0/2803264686 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a7704fb0 msgr2=0x5613a7703520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad09aba640 1 --2- 10.20.193.28:0/2803264686 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a7704fb0 0x5613a7703520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad09aba640 1 -- 10.20.193.28:0/2803264686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 msgr2=0x5613a76fcb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad09aba640 1 --2- 10.20.193.28:0/2803264686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 0x5613a76fcb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad09aba640 1 -- 10.20.193.28:0/2803264686 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613a77169a0 con 0x5613a770a000 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad09aba640 1 --2- 10.20.193.28:0/2803264686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a770a000 0x5613a7703a60 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fad000a5100 tx=0x7fad0000cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cd02acc3a4b3ad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7face14e4640 1 -- 10.20.193.28:0/2803264686 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad000ac490 con 0x5613a770a000 2026-02-20T03:36:06.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7face14e4640 1 -- 10.20.193.28:0/2803264686 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fad000b1340 con 0x5613a770a000 2026-02-20T03:36:06.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7face14e4640 1 -- 10.20.193.28:0/2803264686 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad000b0eb0 con 0x5613a770a000 2026-02-20T03:36:06.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad0da49e00 1 -- 10.20.193.28:0/2803264686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a770a000 msgr2=0x5613a7703a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:06.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad0da49e00 1 --2- 10.20.193.28:0/2803264686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a770a000 0x5613a7703a60 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fad000a5100 tx=0x7fad0000cdc0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad0da49e00 1 -- 10.20.193.28:0/2803264686 shutdown_connections 2026-02-20T03:36:06.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad0da49e00 1 --2- 10.20.193.28:0/2803264686 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a770a000 0x5613a7703a60 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad0da49e00 1 --2- 10.20.193.28:0/2803264686 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a7704fb0 0x5613a7703520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad0da49e00 1 --2- 10.20.193.28:0/2803264686 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 0x5613a76fcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.594 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad0da49e00 1 -- 10.20.193.28:0/2803264686 >> 10.20.193.28:0/2803264686 conn(0x5613a76c7290 msgr2=0x5613a771edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:06.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad0da49e00 1 -- 10.20.193.28:0/2803264686 shutdown_connections 2026-02-20T03:36:06.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.588+0000 7fad0da49e00 1 -- 10.20.193.28:0/2803264686 wait complete. 2026-02-20T03:36:06.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 -- start start 2026-02-20T03:36:06.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 Processor -- start 2026-02-20T03:36:06.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 0x5613a7724ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a7725410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 0x5613a7721cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7facb000e480 con 0x5613a7704fb0 2026-02-20T03:36:06.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7facb000f8f0 con 0x5613a7704630 2026-02-20T03:36:06.597 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7facb000eb50 con 0x5613a770a000 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad08ab8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a7725410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad08ab8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a7725410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40208/0 (socket says 10.20.193.28:40208) 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad08ab8640 1 -- 10.20.193.28:0/3617466579 learned_addr learned my addr 10.20.193.28:0/3617466579 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad08ab8640 1 -- 10.20.193.28:0/3617466579 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 msgr2=0x5613a7721cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad08ab8640 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 0x5613a7721cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad08ab8640 1 -- 10.20.193.28:0/3617466579 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 msgr2=0x5613a7724ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad08ab8640 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 0x5613a7724ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad08ab8640 1 -- 10.20.193.28:0/3617466579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613a7336870 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad08ab8640 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a7725410 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7facf800c010 tx=0x7facf800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c34beec654c77 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7facbaffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7facbaffd640 1 -- 10.20.193.28:0/3617466579 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf80117f0 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7facbaffd640 1 -- 10.20.193.28:0/3617466579 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5613a76651a0 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7facbaffd640 1 -- 10.20.193.28:0/3617466579 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8020430 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 -- 10.20.193.28:0/3617466579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613a75f7440 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 10 client.21264 _ll_register_callbacks cb 0x7facf8009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 -- 10.20.193.28:0/3617466579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5613a76fd200 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7facbaffd640 1 -- 10.20.193.28:0/3617466579 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7facf80205d0 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7facbaffd640 1 -- 10.20.193.28:0/3617466579 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7facf8037060 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 10 client.21264 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.589+0000 7fad0da49e00 1 -- 10.20.193.28:0/3617466579 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5613a7717690 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.591+0000 7facbaffd640 1 -- 10.20.193.28:0/3617466579 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7facf8028040 con 0x5613a7704fb0 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.591+0000 7fad0da49e00 10 client.21264 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.591+0000 7fad0da49e00 10 client.21264 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.591+0000 7fad0da49e00 20 client.21264 populate_metadata read hostname 'trial028' 2026-02-20T03:36:06.598 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.591+0000 7fad0da49e00 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5613a77992b0 0x5613a779b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:06.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.591+0000 7fad0da49e00 4 client.21264 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:36:06.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.591+0000 7fad0da49e00 1 -- 10.20.193.28:0/3617466579 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5613a7609b00 con 0x5613a77992b0 2026-02-20T03:36:06.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.618+0000 7fad092b9640 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5613a77992b0 0x5613a779b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad092b9640 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5613a77992b0 0x5613a779b770 crc :-1 s=READY pgs=542 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa829dee4096858a server_cookie=2a517226e8f5a2fb in_seq=0 out_seq=0 2026-02-20T03:36:06.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7facbaffd640 10 client.21264 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7facbaffd640 1 -- 10.20.193.28:0/3617466579 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5613a7609b00 con 0x5613a77992b0 2026-02-20T03:36:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7facbaffd640 10 client.21264 handle_command_reply: tid=0 2026-02-20T03:36:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 client.21264 shutdown 2026-02-20T03:36:06.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 -- 10.20.193.28:0/3617466579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 msgr2=0x5613a7725410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a7725410 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7facf800c010 tx=0x7facf800beb0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 -- 10.20.193.28:0/3617466579 shutdown_connections 2026-02-20T03:36:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5613a77992b0 0x5613a779b770 crc :-1 s=READY pgs=542 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5613a770a000 0x5613a7721cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5613a7704fb0 0x5613a7725410 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7facbaffd640 0 client.21264 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 --2- 10.20.193.28:0/3617466579 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5613a7704630 0x5613a7724ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 -- 10.20.193.28:0/3617466579 >> 10.20.193.28:0/3617466579 conn(0x5613a76c7290 msgr2=0x5613a771bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:06.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 -- 10.20.193.28:0/3617466579 shutdown_connections 2026-02-20T03:36:06.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 1 -- 10.20.193.28:0/3617466579 wait complete. 2026-02-20T03:36:06.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0da49e00 20 client.21264 trim_cache size 0 max 16384 2026-02-20T03:36:06.701 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:36:06.701 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:36:06.701 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:36:06.701 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:36:06.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facd40b0e20 msgr2=0x7facd40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:06.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facd40b0e20 0x7facd40b32e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7facf8006fd0 tx=0x7facf8006d60 comp rx=0 tx=0).stop 2026-02-20T03:36:06.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad041069d0 msgr2=0x7fad041a5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:06.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad041069d0 0x7fad041a5fe0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fad0000b990 tx=0x7fad0000be60 comp rx=0 tx=0).stop 2026-02-20T03:36:06.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3096483727 shutdown_connections 2026-02-20T03:36:06.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7facd40b0e20 0x7facd40b32e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fad041069d0 0x7fad041a5fe0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fad04101850 0x7fad041a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 --2- 10.20.193.28:0/3096483727 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fad04100f30 0x7fad041a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:06.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3096483727 >> 10.20.193.28:0/3096483727 conn(0x7fad04078230 msgr2=0x7fad04110fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:06.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3096483727 shutdown_connections 2026-02-20T03:36:06.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:06.685+0000 7fad0a2bb640 1 -- 10.20.193.28:0/3096483727 wait complete. 2026-02-20T03:36:06.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.84 MB/sec execute 337 sec latency 31720.469 ms 2026-02-20T03:36:06.909 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:36:06.910 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:36:07.208 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:07.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.446+0000 7eff7a759640 1 -- 10.20.193.28:0/1555181602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 msgr2=0x7eff74109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:07.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.446+0000 7eff7a759640 1 --2- 10.20.193.28:0/1555181602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 0x7eff74109660 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7eff68009a30 tx=0x7eff6802f260 comp rx=0 tx=0).stop 2026-02-20T03:36:07.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.446+0000 7eff7a759640 1 -- 10.20.193.28:0/1555181602 shutdown_connections 2026-02-20T03:36:07.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.446+0000 7eff7a759640 1 --2- 10.20.193.28:0/1555181602 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff74109ba0 0x7eff74115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.446+0000 7eff7a759640 1 --2- 10.20.193.28:0/1555181602 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 0x7eff74109660 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.446+0000 7eff7a759640 1 --2- 10.20.193.28:0/1555181602 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff7410eef0 0x7eff7410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.446+0000 7eff7a759640 1 -- 10.20.193.28:0/1555181602 >> 10.20.193.28:0/1555181602 conn(0x7eff74078600 msgr2=0x7eff7407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.446+0000 7eff7a759640 1 -- 10.20.193.28:0/1555181602 shutdown_connections 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.446+0000 7eff7a759640 1 -- 10.20.193.28:0/1555181602 wait complete. 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff7a759640 1 Processor -- start 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff7a759640 1 -- start start 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff7a759640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 0x7eff741a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff7a759640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff74109ba0 0x7eff741a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff7a759640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff7410eef0 0x7eff741a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff7a759640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7eff741191b0 con 0x7eff74109220 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff7a759640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7eff74119030 con 0x7eff74109ba0 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff7a759640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7eff74119330 con 0x7eff7410eef0 2026-02-20T03:36:07.453 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff79757640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 0x7eff741a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:07.454 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff79757640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 0x7eff741a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40218/0 (socket says 10.20.193.28:40218) 2026-02-20T03:36:07.460 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff79757640 1 -- 10.20.193.28:0/1873729791 learned_addr learned my addr 10.20.193.28:0/1873729791 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff79757640 1 -- 10.20.193.28:0/1873729791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff7410eef0 msgr2=0x7eff741a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff79757640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff7410eef0 0x7eff741a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff79757640 1 -- 10.20.193.28:0/1873729791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff74109ba0 msgr2=0x7eff741a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff79757640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff74109ba0 0x7eff741a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff79757640 1 -- 10.20.193.28:0/1873729791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff741a66c0 con 0x7eff74109220 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff79757640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 0x7eff741a1670 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7eff6400b570 tx=0x7eff6400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff627fc640 1 -- 10.20.193.28:0/1873729791 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64013020 con 0x7eff74109220 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff627fc640 1 -- 10.20.193.28:0/1873729791 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7eff64004480 con 0x7eff74109220 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.449+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff741a69b0 con 0x7eff74109220 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.451+0000 7eff627fc640 1 -- 10.20.193.28:0/1873729791 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6400fb50 con 0x7eff74109220 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.451+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff741ae1f0 con 0x7eff74109220 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.451+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff7410a580 con 0x7eff74109220 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.452+0000 7eff627fc640 1 -- 10.20.193.28:0/1873729791 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7eff64002780 con 0x7eff74109220 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.452+0000 7eff627fc640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7eff500b0e20 0x7eff500b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.452+0000 7eff627fc640 1 -- 10.20.193.28:0/1873729791 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7eff640e0c30 con 0x7eff74109220 2026-02-20T03:36:07.461 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.452+0000 7eff78f56640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7eff500b0e20 0x7eff500b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:07.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.452+0000 7eff627fc640 1 -- 10.20.193.28:0/1873729791 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7eff6401d020 con 0x7eff74109220 2026-02-20T03:36:07.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.455+0000 7eff78f56640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7eff500b0e20 0x7eff500b32e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7eff68009950 tx=0x7eff680023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:07.501 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:07 trial028 ceph-mon[38552]: pgmap v829: 129 pgs: 129 active+clean; 778 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 340 KiB/s rd, 3.0 MiB/s wr, 149 op/s 2026-02-20T03:36:07.565 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.561+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff74109660 con 0x7eff74109220 2026-02-20T03:36:07.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff627fc640 1 -- 10.20.193.28:0/1873729791 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11927 (secure 0 0 0) 0x7eff74109660 con 0x7eff74109220 2026-02-20T03:36:07.567 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:36:07.567 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":48,"btime":"2026-02-20T03:35:09:352789+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:35:09.177379+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:36:07.568 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 48 2026-02-20T03:36:07.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7eff500b0e20 msgr2=0x7eff500b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:07.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7eff500b0e20 0x7eff500b32e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7eff68009950 tx=0x7eff680023d0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.568 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 msgr2=0x7eff741a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 0x7eff741a1670 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7eff6400b570 tx=0x7eff6400ba40 comp rx=0 tx=0).stop 2026-02-20T03:36:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 shutdown_connections 2026-02-20T03:36:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7eff500b0e20 0x7eff500b32e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7eff7410eef0 0x7eff741a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7eff74109ba0 0x7eff741a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 --2- 10.20.193.28:0/1873729791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7eff74109220 0x7eff741a1670 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.563+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 >> 10.20.193.28:0/1873729791 conn(0x7eff74078600 msgr2=0x7eff74079f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:07.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.564+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 shutdown_connections 2026-02-20T03:36:07.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:07.564+0000 7eff7a759640 1 -- 10.20.193.28:0/1873729791 wait complete. 2026-02-20T03:36:07.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:07 trial177 ceph-mon[43181]: pgmap v829: 129 pgs: 129 active+clean; 778 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 340 KiB/s rd, 3.0 MiB/s wr, 149 op/s 2026-02-20T03:36:07.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.79 MB/sec execute 338 sec latency 32720.514 ms 2026-02-20T03:36:07.723 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:36:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:07 trial126 ceph-mon[38476]: pgmap v829: 129 pgs: 129 active+clean; 778 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 340 KiB/s rd, 3.0 MiB/s wr, 149 op/s 2026-02-20T03:36:08.034 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:08.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 -- 10.20.193.28:0/103401744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc1179f0 msgr2=0x7f47bc119e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 --2- 10.20.193.28:0/103401744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc1179f0 0x7f47bc119e00 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00b0a0 tx=0x7f47ac02f450 comp rx=0 tx=0).stop 2026-02-20T03:36:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 -- 10.20.193.28:0/103401744 shutdown_connections 2026-02-20T03:36:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 --2- 10.20.193.28:0/103401744 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc1179f0 0x7f47bc119e00 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 --2- 10.20.193.28:0/103401744 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f47bc071880 0x7f47bc071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 --2- 10.20.193.28:0/103401744 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f47bc073180 0x7f47bc071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 -- 10.20.193.28:0/103401744 >> 10.20.193.28:0/103401744 conn(0x7f47bc06e1a0 msgr2=0x7f47bc0705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 -- 10.20.193.28:0/103401744 shutdown_connections 2026-02-20T03:36:08.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 -- 10.20.193.28:0/103401744 wait complete. 2026-02-20T03:36:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.273+0000 7f47c0a27640 1 Processor -- start 2026-02-20T03:36:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47c0a27640 1 -- start start 2026-02-20T03:36:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47c0a27640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc071880 0x7f47bc1ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47c0a27640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f47bc073180 0x7f47bc1abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47c0a27640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f47bc1179f0 0x7f47bc1a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47c0a27640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc11d6d0 con 0x7f47bc071880 2026-02-20T03:36:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47c0a27640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc11d550 con 0x7f47bc073180 2026-02-20T03:36:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47c0a27640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc11d850 con 0x7f47bc1179f0 2026-02-20T03:36:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47bad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc071880 0x7f47bc1ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47bad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc071880 0x7f47bc1ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40232/0 (socket says 10.20.193.28:40232) 2026-02-20T03:36:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47bad76640 1 -- 10.20.193.28:0/1244332986 learned_addr learned my addr 10.20.193.28:0/1244332986 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47bad76640 1 -- 10.20.193.28:0/1244332986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f47bc1179f0 msgr2=0x7f47bc1a59c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47bad76640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f47bc1179f0 0x7f47bc1a59c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47bad76640 1 -- 10.20.193.28:0/1244332986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f47bc073180 msgr2=0x7f47bc1abd40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:08.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47bad76640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f47bc073180 0x7f47bc1abd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47bad76640 1 -- 10.20.193.28:0/1244332986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc1a6190 con 0x7f47bc071880 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f47bad76640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc071880 0x7f47bc1ab800 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f47b000b570 tx=0x7f47b000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.275+0000 7f479bfff640 1 -- 10.20.193.28:0/1244332986 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0013020 con 0x7f47bc071880 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.276+0000 7f479bfff640 1 -- 10.20.193.28:0/1244332986 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f47b0004480 con 0x7f47bc071880 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.276+0000 7f479bfff640 1 -- 10.20.193.28:0/1244332986 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b000fb50 con 0x7f47bc071880 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.276+0000 7f47c0a27640 1 -- 10.20.193.28:0/1244332986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc1a6480 con 0x7f47bc071880 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.276+0000 7f47c0a27640 1 -- 10.20.193.28:0/1244332986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc1b26d0 con 0x7f47bc071880 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.276+0000 7f479bfff640 1 -- 10.20.193.28:0/1244332986 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f47b0002780 con 0x7f47bc071880 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47c372de00 1 Processor -- start 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47c372de00 1 -- start start 2026-02-20T03:36:08.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47c372de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92022390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47c372de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d9201c5e0 0x562d9201ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47c372de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d92028de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47c372de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562d91f9ce00 con 0x562d92021fb0 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47c372de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562d91f6f970 con 0x562d9201c5e0 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47c372de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562d91f1d1f0 con 0x562d9201cf60 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47bb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92022390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47bb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92022390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40248/0 (socket says 10.20.193.28:40248) 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47bb577640 1 -- 10.20.193.28:0/1246258037 learned_addr learned my addr 10.20.193.28:0/1246258037 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47bb577640 1 -- 10.20.193.28:0/1246258037 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 msgr2=0x562d92028de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47bb577640 1 --2- 10.20.193.28:0/1246258037 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d92028de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47bb577640 1 -- 10.20.193.28:0/1246258037 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d9201c5e0 msgr2=0x562d9201ca20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47bb577640 1 --2- 10.20.193.28:0/1246258037 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d9201c5e0 0x562d9201ca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.279+0000 7f47bb577640 1 -- 10.20.193.28:0/1246258037 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d91f303d0 con 0x562d92021fb0 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.280+0000 7f479bfff640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f478c0b0e20 0x7f478c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.280+0000 7f479bfff640 1 -- 10.20.193.28:0/1244332986 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f47b00e0550 con 0x7f47bc071880 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.280+0000 7f47bad76640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f478c0b0e20 0x7f478c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.280+0000 7f47bb577640 1 --2- 10.20.193.28:0/1246258037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92022390 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f47ac006030 tx=0x7f47ac009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b12c76ccf7c850f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:08.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.280+0000 7f47bad76640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f478c0b0e20 0x7f478c0b32e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f47b00a81c0 tx=0x7f47b0004850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47837fe640 1 -- 10.20.193.28:0/1246258037 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac004590 con 0x562d92021fb0 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47837fe640 1 -- 10.20.193.28:0/1246258037 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f47ac033030 con 0x562d92021fb0 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47837fe640 1 -- 10.20.193.28:0/1246258037 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0078c0 con 0x562d92021fb0 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 -- 10.20.193.28:0/1246258037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 msgr2=0x562d92022390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 --2- 10.20.193.28:0/1246258037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92022390 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f47ac006030 tx=0x7f47ac009cc0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 -- 10.20.193.28:0/1246258037 shutdown_connections 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 --2- 10.20.193.28:0/1246258037 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d92028de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 --2- 10.20.193.28:0/1246258037 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d9201c5e0 0x562d9201ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 --2- 10.20.193.28:0/1246258037 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92022390 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 -- 10.20.193.28:0/1246258037 >> 10.20.193.28:0/1246258037 conn(0x562d91fdf240 msgr2=0x562d9201ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 -- 10.20.193.28:0/1246258037 shutdown_connections 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 -- 10.20.193.28:0/1246258037 wait complete. 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 -- start start 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 Processor -- start 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d920352f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d92035830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d92021fb0 0x562d92043830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562d91f6b8a0 con 0x562d9201c5e0 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.281+0000 7f47c372de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562d91d5df50 con 0x562d92021fb0 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562d92043d70 con 0x562d9201cf60 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47bb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d920352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47bb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d920352f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40258/0 (socket says 10.20.193.28:40258) 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47bb577640 1 -- 10.20.193.28:0/588144441 learned_addr learned my addr 10.20.193.28:0/588144441 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47bb577640 1 -- 10.20.193.28:0/588144441 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 msgr2=0x562d92035830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47bb577640 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d92035830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47bb577640 1 -- 10.20.193.28:0/588144441 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d92021fb0 msgr2=0x562d92043830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47bb577640 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d92021fb0 0x562d92043830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47bb577640 1 -- 10.20.193.28:0/588144441 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d9202ea80 con 0x562d9201c5e0 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47bb577640 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d920352f0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f47ac032040 tx=0x7f47ac007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3e49919fa80c56 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f4780ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f4780ff9640 1 -- 10.20.193.28:0/588144441 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0040e0 con 0x562d9201c5e0 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f4780ff9640 1 -- 10.20.193.28:0/588144441 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f47ac002a60 con 0x562d9201c5e0 2026-02-20T03:36:08.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f4780ff9640 1 -- 10.20.193.28:0/588144441 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac007cb0 con 0x562d9201c5e0 2026-02-20T03:36:08.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 1 -- 10.20.193.28:0/588144441 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d91d40b40 con 0x562d9201c5e0 2026-02-20T03:36:08.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 10 client.21282 _ll_register_callbacks cb 0x562d91fa8eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:08.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 1 -- 10.20.193.28:0/588144441 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d91f7d150 con 0x562d9201c5e0 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f4780ff9640 1 -- 10.20.193.28:0/588144441 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f47ac005050 con 0x562d9201c5e0 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f4780ff9640 1 -- 10.20.193.28:0/588144441 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f47ac007e50 con 0x562d9201c5e0 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 10 client.21282 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 1 -- 10.20.193.28:0/588144441 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x562d91f2a1e0 con 0x562d9201c5e0 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f4780ff9640 1 -- 10.20.193.28:0/588144441 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f47ac03f020 con 0x562d9201c5e0 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 10 client.21282 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 10 client.21282 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 20 client.21282 populate_metadata read hostname 'trial028' 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562d92039d60 0x562d9203c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 4 client.21282 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:08.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.284+0000 7f47c372de00 1 -- 10.20.193.28:0/588144441 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d91f77560 con 0x562d92039d60 2026-02-20T03:36:08.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.311+0000 7f47ba575640 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562d92039d60 0x562d9203c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:08.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.377+0000 7f47ba575640 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562d92039d60 0x562d9203c220 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d9885ed7aa19bf0 server_cookie=b91782cf88bec987 in_seq=0 out_seq=0 2026-02-20T03:36:08.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.377+0000 7f4780ff9640 10 client.21282 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:36:08.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.404+0000 7f4780ff9640 1 -- 10.20.193.28:0/588144441 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562d91f77560 con 0x562d92039d60 2026-02-20T03:36:08.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.404+0000 7f4780ff9640 10 client.21282 handle_command_reply: tid=0 2026-02-20T03:36:08.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.404+0000 7f47c372de00 1 client.21282 shutdown 2026-02-20T03:36:08.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.404+0000 7f47c372de00 1 -- 10.20.193.28:0/588144441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 msgr2=0x562d920352f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:08.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.404+0000 7f47c372de00 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d920352f0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f47ac032040 tx=0x7f47ac007750 comp rx=0 tx=0).stop 2026-02-20T03:36:08.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.404+0000 7f47c372de00 1 -- 10.20.193.28:0/588144441 shutdown_connections 2026-02-20T03:36:08.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.404+0000 7f47c372de00 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d92021fb0 0x562d92043830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.404+0000 7f47c372de00 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d92035830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.404+0000 7f47c372de00 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562d92039d60 0x562d9203c220 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.405+0000 7f47c372de00 1 --2- 10.20.193.28:0/588144441 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d920352f0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.405+0000 7f47c372de00 1 -- 10.20.193.28:0/588144441 >> 10.20.193.28:0/588144441 conn(0x562d91fdf240 msgr2=0x562d9201b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:08.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.405+0000 7f4780ff9640 0 client.21282 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:36:08.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.405+0000 7f47c372de00 1 -- 10.20.193.28:0/588144441 shutdown_connections 2026-02-20T03:36:08.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.405+0000 7f47c372de00 1 -- 10.20.193.28:0/588144441 wait complete. 2026-02-20T03:36:08.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.405+0000 7f47c372de00 20 client.21282 trim_cache size 0 max 16384 2026-02-20T03:36:08.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.411+0000 7f47c372de00 1 Processor -- start 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- start start 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d9201c5e0 0x562d9201b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d9201ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92060d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f47600127b0 con 0x562d92021fb0 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f476000ffc0 con 0x562d9201c5e0 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f476000de10 con 0x562d9201cf60 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92060d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92060d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40260/0 (socket says 10.20.193.28:40260) 2026-02-20T03:36:08.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 -- 10.20.193.28:0/2851454701 learned_addr learned my addr 10.20.193.28:0/2851454701 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 -- 10.20.193.28:0/2851454701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 msgr2=0x562d9201ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- 10.20.193.28:0/2851454701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d9201ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 -- 10.20.193.28:0/2851454701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d9201c5e0 msgr2=0x562d9201b4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- 10.20.193.28:0/2851454701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d9201c5e0 0x562d9201b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 -- 10.20.193.28:0/2851454701 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d9202e8b0 con 0x562d92021fb0 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- 10.20.193.28:0/2851454701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92060d20 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c090 tx=0x7f47ac043070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9692c90ca3894d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4782ffd640 1 -- 10.20.193.28:0/2851454701 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac059070 con 0x562d92021fb0 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4782ffd640 1 -- 10.20.193.28:0/2851454701 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f47ac007e50 con 0x562d92021fb0 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4782ffd640 1 -- 10.20.193.28:0/2851454701 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac002b90 con 0x562d92021fb0 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- 10.20.193.28:0/2851454701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 msgr2=0x562d92060d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- 10.20.193.28:0/2851454701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92060d20 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00c090 tx=0x7f47ac043070 comp rx=0 tx=0).stop 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- 10.20.193.28:0/2851454701 shutdown_connections 2026-02-20T03:36:08.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- 10.20.193.28:0/2851454701 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d92021fb0 0x562d92060d20 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- 10.20.193.28:0/2851454701 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d9201ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- 10.20.193.28:0/2851454701 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d9201c5e0 0x562d9201b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- 10.20.193.28:0/2851454701 >> 10.20.193.28:0/2851454701 conn(0x562d91fdf240 msgr2=0x562d920341d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:08.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- 10.20.193.28:0/2851454701 shutdown_connections 2026-02-20T03:36:08.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- 10.20.193.28:0/2851454701 wait complete. 2026-02-20T03:36:08.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- start start 2026-02-20T03:36:08.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 Processor -- start 2026-02-20T03:36:08.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d92049be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d9204a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d92021fb0 0x562d92045f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f476000e480 con 0x562d9201c5e0 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f476000f8f0 con 0x562d92021fb0 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f476000eb50 con 0x562d9201cf60 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d92049be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d92049be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40272/0 (socket says 10.20.193.28:40272) 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 -- 10.20.193.28:0/3880140398 learned_addr learned my addr 10.20.193.28:0/3880140398 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 -- 10.20.193.28:0/3880140398 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 msgr2=0x562d9204a120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d9204a120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 -- 10.20.193.28:0/3880140398 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d92021fb0 msgr2=0x562d92045f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:08.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d92021fb0 0x562d92045f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 -- 10.20.193.28:0/3880140398 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d91c4e870 con 0x562d9201c5e0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47bb577640 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d92049be0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009760 tx=0x7f47ac0029f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c212d0a7bb7b34 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4780ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4780ff9640 1 -- 10.20.193.28:0/3880140398 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac059040 con 0x562d9201c5e0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4780ff9640 1 -- 10.20.193.28:0/3880140398 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f47ac033070 con 0x562d9201c5e0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4780ff9640 1 -- 10.20.193.28:0/3880140398 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac055a40 con 0x562d9201c5e0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- 10.20.193.28:0/3880140398 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d91f0f3f0 con 0x562d9201c5e0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4780ff9640 1 -- 10.20.193.28:0/3880140398 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f47ac055be0 con 0x562d9201c5e0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 10 client.21288 _ll_register_callbacks cb 0x7f47ac009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- 10.20.193.28:0/3880140398 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562d91f407c0 con 0x562d9201c5e0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4780ff9640 1 -- 10.20.193.28:0/3880140398 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f47ac002b60 con 0x562d9201c5e0 2026-02-20T03:36:08.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 10 client.21288 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:08.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- 10.20.193.28:0/3880140398 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x562d9202f5a0 con 0x562d9201c5e0 2026-02-20T03:36:08.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f4780ff9640 1 -- 10.20.193.28:0/3880140398 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f47ac03f040 con 0x562d9201c5e0 2026-02-20T03:36:08.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 10 client.21288 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:08.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 10 client.21288 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:36:08.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 20 client.21288 populate_metadata read hostname 'trial028' 2026-02-20T03:36:08.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562d920c2750 0x562d920c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:08.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 4 client.21288 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:36:08.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.413+0000 7f47c372de00 1 -- 10.20.193.28:0/3880140398 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562d91f21ab0 con 0x562d920c2750 2026-02-20T03:36:08.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.418+0000 7f47ba575640 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562d920c2750 0x562d920c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:08.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.497+0000 7f47ba575640 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562d920c2750 0x562d920c4be0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1c451e6b8ac59d8 server_cookie=3baa04b9bf914c44 in_seq=0 out_seq=0 2026-02-20T03:36:08.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.497+0000 7f4780ff9640 10 client.21288 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:36:08.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f4780ff9640 1 -- 10.20.193.28:0/3880140398 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562d91f21ab0 con 0x562d920c2750 2026-02-20T03:36:08.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f4780ff9640 10 client.21288 handle_command_reply: tid=0 2026-02-20T03:36:08.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 client.21288 shutdown 2026-02-20T03:36:08.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 -- 10.20.193.28:0/3880140398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 msgr2=0x562d92049be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:08.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d92049be0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009760 tx=0x7f47ac0029f0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 -- 10.20.193.28:0/3880140398 shutdown_connections 2026-02-20T03:36:08.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562d92021fb0 0x562d92045f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562d9201cf60 0x562d9204a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x562d920c2750 0x562d920c4be0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 --2- 10.20.193.28:0/3880140398 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562d9201c5e0 0x562d92049be0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 -- 10.20.193.28:0/3880140398 >> 10.20.193.28:0/3880140398 conn(0x562d91fdf240 msgr2=0x562d9201a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:08.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f4780ff9640 0 client.21288 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:36:08.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 -- 10.20.193.28:0/3880140398 shutdown_connections 2026-02-20T03:36:08.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 1 -- 10.20.193.28:0/3880140398 wait complete. 2026-02-20T03:36:08.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c372de00 20 client.21288 trim_cache size 0 max 16384 2026-02-20T03:36:08.527 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:36:08.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 -- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f478c0b0e20 msgr2=0x7f478c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:08.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f478c0b0e20 0x7f478c0b32e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f47b00a81c0 tx=0x7f47b0004850 comp rx=0 tx=0).stop 2026-02-20T03:36:08.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 -- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc071880 msgr2=0x7f47bc1ab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:08.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc071880 0x7f47bc1ab800 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f47b000b570 tx=0x7f47b000ba40 comp rx=0 tx=0).stop 2026-02-20T03:36:08.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 -- 10.20.193.28:0/1244332986 shutdown_connections 2026-02-20T03:36:08.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f478c0b0e20 0x7f478c0b32e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f47bc1179f0 0x7f47bc1a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f47bc073180 0x7f47bc1abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 --2- 10.20.193.28:0/1244332986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f47bc071880 0x7f47bc1ab800 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:08.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 -- 10.20.193.28:0/1244332986 >> 10.20.193.28:0/1244332986 conn(0x7f47bc06e1a0 msgr2=0x7f47bc06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:08.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 -- 10.20.193.28:0/1244332986 shutdown_connections 2026-02-20T03:36:08.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:08.511+0000 7f47c0a27640 1 -- 10.20.193.28:0/1244332986 wait complete. 2026-02-20T03:36:08.541 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:08 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1873729791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:36:08.682 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:36:08.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:08 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1873729791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:36:08.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.73 MB/sec execute 339 sec latency 33720.549 ms 2026-02-20T03:36:08.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:08 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1873729791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:36:08.994 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:09.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 -- 10.20.193.28:0/1145699740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed01030a0 msgr2=0x7fbed010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:09.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 --2- 10.20.193.28:0/1145699740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed01030a0 0x7fbed010f5d0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fbec000b0d0 tx=0x7fbec002f490 comp rx=0 tx=0).stop 2026-02-20T03:36:09.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 -- 10.20.193.28:0/1145699740 shutdown_connections 2026-02-20T03:36:09.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 --2- 10.20.193.28:0/1145699740 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed01030a0 0x7fbed010f5d0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 --2- 10.20.193.28:0/1145699740 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbed0102700 0x7fbed0102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 --2- 10.20.193.28:0/1145699740 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbed0108700 0x7fbed0108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 -- 10.20.193.28:0/1145699740 >> 10.20.193.28:0/1145699740 conn(0x7fbed00fe440 msgr2=0x7fbed0100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:09.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 -- 10.20.193.28:0/1145699740 shutdown_connections 2026-02-20T03:36:09.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 -- 10.20.193.28:0/1145699740 wait complete. 2026-02-20T03:36:09.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.248+0000 7fbecffff640 1 Processor -- start 2026-02-20T03:36:09.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecffff640 1 -- start start 2026-02-20T03:36:09.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbed0102700 0x7fbed019d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbed01030a0 0x7fbed019d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed0108700 0x7fbed01a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0112a50 con 0x7fbed0108700 2026-02-20T03:36:09.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01128d0 con 0x7fbed01030a0 2026-02-20T03:36:09.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0112bd0 con 0x7fbed0102700 2026-02-20T03:36:09.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed0108700 0x7fbed01a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:09.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed0108700 0x7fbed01a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40298/0 (socket says 10.20.193.28:40298) 2026-02-20T03:36:09.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecf7fe640 1 -- 10.20.193.28:0/1439361991 learned_addr learned my addr 10.20.193.28:0/1439361991 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:09.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecf7fe640 1 -- 10.20.193.28:0/1439361991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbed0102700 msgr2=0x7fbed019d220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:09.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecf7fe640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbed0102700 0x7fbed019d220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecf7fe640 1 -- 10.20.193.28:0/1439361991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbed01030a0 msgr2=0x7fbed019d760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:09.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecf7fe640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbed01030a0 0x7fbed019d760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.249+0000 7fbecf7fe640 1 -- 10.20.193.28:0/1439361991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed01a2270 con 0x7fbed0108700 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.251+0000 7fbecf7fe640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed0108700 0x7fbed01a1af0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fbec00077f0 tx=0x7fbec0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.251+0000 7fbed4a4c640 1 -- 10.20.193.28:0/1439361991 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0004590 con 0x7fbed0108700 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.251+0000 7fbed4a4c640 1 -- 10.20.193.28:0/1439361991 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbec0004730 con 0x7fbed0108700 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.251+0000 7fbed4a4c640 1 -- 10.20.193.28:0/1439361991 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec00052b0 con 0x7fbed0108700 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.251+0000 7fbecffff640 1 -- 10.20.193.28:0/1439361991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed01a2500 con 0x7fbed0108700 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.251+0000 7fbecffff640 1 -- 10.20.193.28:0/1439361991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed01a9da0 con 0x7fbed0108700 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbed4a4c640 1 -- 10.20.193.28:0/1439361991 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbec0002a60 con 0x7fbed0108700 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbed7f53e00 1 Processor -- start 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbed7f53e00 1 -- start start 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55581303bfb0 0x55581303c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5558130365e0 0x555813036a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x555813042de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555812fb6e00 con 0x555813036f60 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555812f89970 con 0x5558130365e0 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555812f371f0 con 0x55581303bfb0 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbece7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x555813042de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbece7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x555813042de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40300/0 (socket says 10.20.193.28:40300) 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbece7fc640 1 -- 10.20.193.28:0/3217396007 learned_addr learned my addr 10.20.193.28:0/3217396007 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbece7fc640 1 -- 10.20.193.28:0/3217396007 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55581303bfb0 msgr2=0x55581303c390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbece7fc640 1 --2- 10.20.193.28:0/3217396007 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55581303bfb0 0x55581303c390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbece7fc640 1 -- 10.20.193.28:0/3217396007 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5558130365e0 msgr2=0x555813036a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbece7fc640 1 --2- 10.20.193.28:0/3217396007 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5558130365e0 0x555813036a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.254+0000 7fbece7fc640 1 -- 10.20.193.28:0/3217396007 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555812f4a3d0 con 0x555813036f60 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbece7fc640 1 --2- 10.20.193.28:0/3217396007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x555813042de0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80098a0 tx=0x7fbeb8009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8fddeb96285555 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbed4a4c640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbea40b0ef0 0x7fbea40b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbe93fff640 1 -- 10.20.193.28:0/3217396007 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8016070 con 0x555813036f60 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbe93fff640 1 -- 10.20.193.28:0/3217396007 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbeb8002870 con 0x555813036f60 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbe93fff640 1 -- 10.20.193.28:0/3217396007 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb80046e0 con 0x555813036f60 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbed4a4c640 1 -- 10.20.193.28:0/1439361991 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbec0105780 con 0x7fbed0108700 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbeceffd640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbea40b0ef0 0x7fbea40b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbed7f53e00 1 -- 10.20.193.28:0/3217396007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 msgr2=0x555813042de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/3217396007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x555813042de0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80098a0 tx=0x7fbeb8009d70 comp rx=0 tx=0).stop 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbed7f53e00 1 -- 10.20.193.28:0/3217396007 shutdown_connections 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/3217396007 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x555813042de0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/3217396007 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5558130365e0 0x555813036a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/3217396007 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55581303bfb0 0x55581303c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.255+0000 7fbed7f53e00 1 -- 10.20.193.28:0/3217396007 >> 10.20.193.28:0/3217396007 conn(0x555812ff9240 msgr2=0x555813034ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.256+0000 7fbeceffd640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbea40b0ef0 0x7fbea40b33b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbec40096f0 tx=0x7fbec4006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.256+0000 7fbed7f53e00 1 -- 10.20.193.28:0/3217396007 shutdown_connections 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.256+0000 7fbed7f53e00 1 -- 10.20.193.28:0/3217396007 wait complete. 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 -- start start 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 Processor -- start 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5558130365e0 0x555813059ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x55581305a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 0x555813058270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555812f858a0 con 0x555813036f60 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555812d77f50 con 0x55581303bfb0 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555813058800 con 0x5558130365e0 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbece7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x55581305a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbece7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x55581305a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40312/0 (socket says 10.20.193.28:40312) 2026-02-20T03:36:09.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbece7fc640 1 -- 10.20.193.28:0/400698627 learned_addr learned my addr 10.20.193.28:0/400698627 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbece7fc640 1 -- 10.20.193.28:0/400698627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5558130365e0 msgr2=0x555813059ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbece7fc640 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5558130365e0 0x555813059ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbece7fc640 1 -- 10.20.193.28:0/400698627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 msgr2=0x555813058270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbece7fc640 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 0x555813058270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbece7fc640 1 -- 10.20.193.28:0/400698627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555813051580 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbece7fc640 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x55581305a000 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8006da0 tx=0x7fbeb8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1310234a44b9a83e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbe917fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbe917fa640 1 -- 10.20.193.28:0/400698627 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8016040 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 -- 10.20.193.28:0/400698627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555812d5ab40 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbe917fa640 1 -- 10.20.193.28:0/400698627 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbeb8020070 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbe917fa640 1 -- 10.20.193.28:0/400698627 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb801b990 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 10 client.21300 _ll_register_callbacks cb 0x555812fc2eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 -- 10.20.193.28:0/400698627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555812f97150 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbe917fa640 1 -- 10.20.193.28:0/400698627 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbeb801bb30 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbe917fa640 1 -- 10.20.193.28:0/400698627 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbeb801bdf0 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 10 client.21300 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 -- 10.20.193.28:0/400698627 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x555812f441e0 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbe917fa640 1 -- 10.20.193.28:0/400698627 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fbeb800bad0 con 0x555813036f60 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 10 client.21300 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:09.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 10 client.21300 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:36:09.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 20 client.21300 populate_metadata read hostname 'trial028' 2026-02-20T03:36:09.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x555813068680 0x55581306ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 4 client.21300 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:09.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.257+0000 7fbed7f53e00 1 -- 10.20.193.28:0/400698627 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555812f91560 con 0x555813068680 2026-02-20T03:36:09.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.285+0000 7fbeceffd640 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x555813068680 0x55581306ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:09.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.325+0000 7fbeceffd640 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x555813068680 0x55581306ab40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9663be73034c4c0c server_cookie=e9b1c9be07a44cc5 in_seq=0 out_seq=0 2026-02-20T03:36:09.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.325+0000 7fbe917fa640 10 client.21300 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:36:09.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbe917fa640 1 -- 10.20.193.28:0/400698627 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555812f91560 con 0x555813068680 2026-02-20T03:36:09.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbe917fa640 10 client.21300 handle_command_reply: tid=0 2026-02-20T03:36:09.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 client.21300 shutdown 2026-02-20T03:36:09.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 -- 10.20.193.28:0/400698627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 msgr2=0x55581305a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:09.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x55581305a000 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8006da0 tx=0x7fbeb8003ce0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 -- 10.20.193.28:0/400698627 shutdown_connections 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x555813068680 0x55581306ab40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 0x555813058270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x55581305a000 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/400698627 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5558130365e0 0x555813059ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 -- 10.20.193.28:0/400698627 >> 10.20.193.28:0/400698627 conn(0x555812ff9240 msgr2=0x5558130353f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbe917fa640 0 client.21300 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 -- 10.20.193.28:0/400698627 shutdown_connections 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 1 -- 10.20.193.28:0/400698627 wait complete. 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.339+0000 7fbed7f53e00 20 client.21300 trim_cache size 0 max 16384 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 Processor -- start 2026-02-20T03:36:09.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- start start 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5558130365e0 0x555813059f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x5558130354d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 0x555813035a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740127b0 con 0x555813036f60 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400ffc0 con 0x55581303bfb0 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400de10 con 0x5558130365e0 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbece7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x5558130354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbece7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x5558130354d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40316/0 (socket says 10.20.193.28:40316) 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbece7fc640 1 -- 10.20.193.28:0/2962272951 learned_addr learned my addr 10.20.193.28:0/2962272951 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbece7fc640 1 -- 10.20.193.28:0/2962272951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5558130365e0 msgr2=0x555813059f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:09.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbece7fc640 1 --2- 10.20.193.28:0/2962272951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5558130365e0 0x555813059f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbece7fc640 1 -- 10.20.193.28:0/2962272951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 msgr2=0x555813035a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbece7fc640 1 --2- 10.20.193.28:0/2962272951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 0x555813035a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbece7fc640 1 -- 10.20.193.28:0/2962272951 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558130513b0 con 0x555813036f60 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbece7fc640 1 --2- 10.20.193.28:0/2962272951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x5558130354d0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80026b0 tx=0x7fbeb800b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee97fda03ebbf71f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbe937fe640 1 -- 10.20.193.28:0/2962272951 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8016040 con 0x555813036f60 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbe937fe640 1 -- 10.20.193.28:0/2962272951 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbeb8020030 con 0x555813036f60 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbe937fe640 1 -- 10.20.193.28:0/2962272951 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb801b3f0 con 0x555813036f60 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- 10.20.193.28:0/2962272951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 msgr2=0x5558130354d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/2962272951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x5558130354d0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fbeb80026b0 tx=0x7fbeb800b020 comp rx=0 tx=0).stop 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- 10.20.193.28:0/2962272951 shutdown_connections 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/2962272951 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 0x555813035a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/2962272951 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555813036f60 0x5558130354d0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/2962272951 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5558130365e0 0x555813059f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- 10.20.193.28:0/2962272951 >> 10.20.193.28:0/2962272951 conn(0x555812ff9240 msgr2=0x555813059800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- 10.20.193.28:0/2962272951 shutdown_connections 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- 10.20.193.28:0/2962272951 wait complete. 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- start start 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 Processor -- start 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558130365e0 0x555813070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555813036f60 0x55581305f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 0x55581305ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400e480 con 0x5558130365e0 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400f8f0 con 0x55581303bfb0 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbe7400eb50 con 0x555813036f60 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbeceffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558130365e0 0x555813070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbeceffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558130365e0 0x555813070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40324/0 (socket says 10.20.193.28:40324) 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbeceffd640 1 -- 10.20.193.28:0/506606525 learned_addr learned my addr 10.20.193.28:0/506606525 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbeceffd640 1 -- 10.20.193.28:0/506606525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555813036f60 msgr2=0x55581305f9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbeceffd640 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555813036f60 0x55581305f9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbeceffd640 1 -- 10.20.193.28:0/506606525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 msgr2=0x55581305ff20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbeceffd640 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 0x55581305ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbeceffd640 1 -- 10.20.193.28:0/506606525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555812c68870 con 0x5558130365e0 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbeceffd640 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558130365e0 0x555813070d00 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x55581306b3f0 tx=0x7fbec4004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd294f08d19f376 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbe917fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:09.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbe917fa640 1 -- 10.20.193.28:0/506606525 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4002dd0 con 0x5558130365e0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbe917fa640 1 -- 10.20.193.28:0/506606525 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbec400bc00 con 0x5558130365e0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbe917fa640 1 -- 10.20.193.28:0/506606525 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4013d80 con 0x5558130365e0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.345+0000 7fbed7f53e00 1 -- 10.20.193.28:0/506606525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555812f293f0 con 0x5558130365e0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbe917fa640 1 -- 10.20.193.28:0/506606525 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbec40113f0 con 0x5558130365e0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbe917fa640 10 client.21306 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 10 client.21306 _ll_register_callbacks cb 0x7fbeb8014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 1 -- 10.20.193.28:0/506606525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555812f3bab0 con 0x5558130365e0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbe917fa640 1 -- 10.20.193.28:0/506606525 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbec402d060 con 0x5558130365e0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 10 client.21306 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 1 -- 10.20.193.28:0/506606525 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5558130520a0 con 0x5558130365e0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbe917fa640 1 -- 10.20.193.28:0/506606525 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fbec4013410 con 0x5558130365e0 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 10 client.21306 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 10 client.21306 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 20 client.21306 populate_metadata read hostname 'trial028' 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5558130d3a10 0x5558130d5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 4 client.21306 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:36:09.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.350+0000 7fbed7f53e00 1 -- 10.20.193.28:0/506606525 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbeb8002870 con 0x5558130d3a10 2026-02-20T03:36:09.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.366+0000 7fbece7fc640 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5558130d3a10 0x5558130d5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:09.421 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.419+0000 7fbece7fc640 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5558130d3a10 0x5558130d5ed0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32d81102c32a2b52 server_cookie=6988fcc79af7f08 in_seq=0 out_seq=0 2026-02-20T03:36:09.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.419+0000 7fbe917fa640 10 client.21306 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:36:09.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbe917fa640 1 -- 10.20.193.28:0/506606525 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbeb8002870 con 0x5558130d3a10 2026-02-20T03:36:09.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbe917fa640 10 client.21306 handle_command_reply: tid=0 2026-02-20T03:36:09.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 client.21306 shutdown 2026-02-20T03:36:09.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 -- 10.20.193.28:0/506606525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558130365e0 msgr2=0x555813070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:09.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558130365e0 0x555813070d00 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x55581306b3f0 tx=0x7fbec4004850 comp rx=0 tx=0).stop 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 -- 10.20.193.28:0/506606525 shutdown_connections 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5558130d3a10 0x5558130d5ed0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55581303bfb0 0x55581305ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555813036f60 0x55581305f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 --2- 10.20.193.28:0/506606525 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5558130365e0 0x555813070d00 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 -- 10.20.193.28:0/506606525 >> 10.20.193.28:0/506606525 conn(0x555812ff9240 msgr2=0x555813057160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbe917fa640 0 client.21306 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 -- 10.20.193.28:0/506606525 shutdown_connections 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 1 -- 10.20.193.28:0/506606525 wait complete. 2026-02-20T03:36:09.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbed7f53e00 20 client.21306 trim_cache size 0 max 16384 2026-02-20T03:36:09.449 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 -- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbea40b0ef0 msgr2=0x7fbea40b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbea40b0ef0 0x7fbea40b33b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fbec40096f0 tx=0x7fbec4006cd0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 -- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed0108700 msgr2=0x7fbed01a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed0108700 0x7fbed01a1af0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fbec00077f0 tx=0x7fbec0009300 comp rx=0 tx=0).stop 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 -- 10.20.193.28:0/1439361991 shutdown_connections 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbea40b0ef0 0x7fbea40b33b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbed0108700 0x7fbed01a1af0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbed01030a0 0x7fbed019d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 --2- 10.20.193.28:0/1439361991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbed0102700 0x7fbed019d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:09.450 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 -- 10.20.193.28:0/1439361991 >> 10.20.193.28:0/1439361991 conn(0x7fbed00fe440 msgr2=0x7fbed00feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:09.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 -- 10.20.193.28:0/1439361991 shutdown_connections 2026-02-20T03:36:09.451 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:09.433+0000 7fbecffff640 1 -- 10.20.193.28:0/1439361991 wait complete. 2026-02-20T03:36:09.593 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:36:09.595 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:09 trial028 ceph-mon[38552]: pgmap v830: 129 pgs: 129 active+clean; 758 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 387 KiB/s rd, 629 KiB/s wr, 135 op/s 2026-02-20T03:36:09.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:09 trial177 ceph-mon[43181]: pgmap v830: 129 pgs: 129 active+clean; 758 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 387 KiB/s rd, 629 KiB/s wr, 135 op/s 2026-02-20T03:36:09.720 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.67 MB/sec execute 340 sec latency 34720.585 ms 2026-02-20T03:36:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:09 trial126 ceph-mon[38476]: pgmap v830: 129 pgs: 129 active+clean; 758 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 387 KiB/s rd, 629 KiB/s wr, 135 op/s 2026-02-20T03:36:09.902 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:10.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.152+0000 7f9dbf026640 1 -- 10.20.193.28:0/1344333550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8104da0 msgr2=0x7f9db8105180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:10.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.152+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1344333550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8104da0 0x7f9db8105180 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009a30 tx=0x7f9da802f260 comp rx=0 tx=0).stop 2026-02-20T03:36:10.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.152+0000 7f9dbf026640 1 -- 10.20.193.28:0/1344333550 shutdown_connections 2026-02-20T03:36:10.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.152+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1344333550 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9db8109ed0 0x7f9db8111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.152+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1344333550 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9db8105750 0x7f9db81097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.152+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1344333550 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8104da0 0x7f9db8105180 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.152+0000 7f9dbf026640 1 -- 10.20.193.28:0/1344333550 >> 10.20.193.28:0/1344333550 conn(0x7f9db8100840 msgr2=0x7f9db8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:10.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.152+0000 7f9dbf026640 1 -- 10.20.193.28:0/1344333550 shutdown_connections 2026-02-20T03:36:10.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.152+0000 7f9dbf026640 1 -- 10.20.193.28:0/1344333550 wait complete. 2026-02-20T03:36:10.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9dbf026640 1 Processor -- start 2026-02-20T03:36:10.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9dbf026640 1 -- start start 2026-02-20T03:36:10.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9dbf026640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9db8104da0 0x7f9db819d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9dbf026640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8105750 0x7f9db819d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9dbf026640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9db8109ed0 0x7f9db81a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9dbf026640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8114e30 con 0x7f9db8105750 2026-02-20T03:36:10.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9dbf026640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8114cb0 con 0x7f9db8104da0 2026-02-20T03:36:10.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9dbf026640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8114fb0 con 0x7f9db8109ed0 2026-02-20T03:36:10.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9daffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8105750 0x7f9db819d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:10.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9daffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8105750 0x7f9db819d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40328/0 (socket says 10.20.193.28:40328) 2026-02-20T03:36:10.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9daffff640 1 -- 10.20.193.28:0/1876222685 learned_addr learned my addr 10.20.193.28:0/1876222685 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:10.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9daffff640 1 -- 10.20.193.28:0/1876222685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9db8109ed0 msgr2=0x7f9db81a1b80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:10.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9daffff640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9db8109ed0 0x7f9db81a1b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9daffff640 1 -- 10.20.193.28:0/1876222685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9db8104da0 msgr2=0x7f9db819d2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9daffff640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9db8104da0 0x7f9db819d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9daffff640 1 -- 10.20.193.28:0/1876222685 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db81a2300 con 0x7f9db8105750 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.158+0000 7f9daffff640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8105750 0x7f9db819d7f0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f9da000b570 tx=0x7f9da000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.160+0000 7f9dadffb640 1 -- 10.20.193.28:0/1876222685 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0013020 con 0x7f9db8105750 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.160+0000 7f9dadffb640 1 -- 10.20.193.28:0/1876222685 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9da0004480 con 0x7f9db8105750 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.160+0000 7f9dbf026640 1 -- 10.20.193.28:0/1876222685 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db81a25f0 con 0x7f9db8105750 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.160+0000 7f9dadffb640 1 -- 10.20.193.28:0/1876222685 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da000fb50 con 0x7f9db8105750 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.160+0000 7f9dbf026640 1 -- 10.20.193.28:0/1876222685 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db81a9e30 con 0x7f9db8105750 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.162+0000 7f9dc152be00 1 Processor -- start 2026-02-20T03:36:10.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.162+0000 7f9dadffb640 1 -- 10.20.193.28:0/1876222685 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9da0018400 con 0x7f9db8105750 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.162+0000 7f9dc152be00 1 -- start start 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df93ff0 0x55ad0df943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0df983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df98ae0 0x55ad0dfa0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dc152be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad0df0be00 con 0x55ad0df949a0 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dc152be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ad0dede970 con 0x55ad0df98ae0 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dc152be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad0de8c1f0 con 0x55ad0df93ff0 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dbcd9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0df983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dbcd9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0df983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40332/0 (socket says 10.20.193.28:40332) 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/1193107221 learned_addr learned my addr 10.20.193.28:0/1193107221 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/1193107221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df93ff0 msgr2=0x55ad0df943d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:10.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dbcd9b640 1 --2- 10.20.193.28:0/1193107221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df93ff0 0x55ad0df943d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/1193107221 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df98ae0 msgr2=0x55ad0dfa0660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dbcd9b640 1 --2- 10.20.193.28:0/1193107221 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df98ae0 0x55ad0dfa0660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/1193107221 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0de9f3d0 con 0x55ad0df949a0 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.163+0000 7f9dbcd9b640 1 --2- 10.20.193.28:0/1193107221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0df983b0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005d10 tx=0x7f9da8038470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a748379fcf596b62 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9d854e4640 1 -- 10.20.193.28:0/1193107221 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8002c30 con 0x55ad0df949a0 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9d854e4640 1 -- 10.20.193.28:0/1193107221 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9da8033040 con 0x55ad0df949a0 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9d854e4640 1 -- 10.20.193.28:0/1193107221 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8004340 con 0x55ad0df949a0 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dc152be00 1 -- 10.20.193.28:0/1193107221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 msgr2=0x55ad0df983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1193107221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0df983b0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005d10 tx=0x7f9da8038470 comp rx=0 tx=0).stop 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dadffb640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d940b0e20 0x7f9d940b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dadffb640 1 -- 10.20.193.28:0/1876222685 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9da00e05d0 con 0x7f9db8105750 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dc152be00 1 -- 10.20.193.28:0/1193107221 shutdown_connections 2026-02-20T03:36:10.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1193107221 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df98ae0 0x55ad0dfa0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1193107221 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0df983b0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1193107221 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df93ff0 0x55ad0df943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dc152be00 1 -- 10.20.193.28:0/1193107221 >> 10.20.193.28:0/1193107221 conn(0x55ad0df4e240 msgr2=0x55ad0df89ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dc152be00 1 -- 10.20.193.28:0/1193107221 shutdown_connections 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dbd59c640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d940b0e20 0x7f9d940b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.164+0000 7f9dc152be00 1 -- 10.20.193.28:0/1193107221 wait complete. 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbd59c640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d940b0e20 0x7f9d940b32e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9db400aab0 tx=0x7f9db4009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 -- start start 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 Processor -- start 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfb6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df949a0 0x55ad0dfb74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df98ae0 0x55ad0dfb56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ad0deda8a0 con 0x55ad0df93ff0 2026-02-20T03:36:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ad0dcccf50 con 0x55ad0df949a0 2026-02-20T03:36:10.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ad0dfb5c80 con 0x55ad0df98ae0 2026-02-20T03:36:10.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbcd9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfb6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:10.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbcd9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfb6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40344/0 (socket says 10.20.193.28:40344) 2026-02-20T03:36:10.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/1343712882 learned_addr learned my addr 10.20.193.28:0/1343712882 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:10.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/1343712882 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df98ae0 msgr2=0x55ad0dfb56f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:10.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbcd9b640 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df98ae0 0x55ad0dfb56f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/1343712882 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df949a0 msgr2=0x55ad0dfb74f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbcd9b640 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df949a0 0x55ad0dfb74f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/1343712882 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0df90bf0 con 0x55ad0df93ff0 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dbcd9b640 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfb6fb0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f9da8002410 tx=0x7f9da8002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76d4d57542f9fab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9d767fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9d767fc640 1 -- 10.20.193.28:0/1343712882 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8002a00 con 0x55ad0df93ff0 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9d767fc640 1 -- 10.20.193.28:0/1343712882 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9da804b070 con 0x55ad0df93ff0 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9d767fc640 1 -- 10.20.193.28:0/1343712882 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8042680 con 0x55ad0df93ff0 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 -- 10.20.193.28:0/1343712882 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0dcafb40 con 0x55ad0df93ff0 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9d767fc640 1 -- 10.20.193.28:0/1343712882 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9da8042820 con 0x55ad0df93ff0 2026-02-20T03:36:10.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 10 client.21318 _ll_register_callbacks cb 0x55ad0df17eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:10.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 -- 10.20.193.28:0/1343712882 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ad0deec150 con 0x55ad0df93ff0 2026-02-20T03:36:10.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9d767fc640 1 -- 10.20.193.28:0/1343712882 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f9da80042d0 con 0x55ad0df93ff0 2026-02-20T03:36:10.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 10 client.21318 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:10.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 -- 10.20.193.28:0/1343712882 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55ad0de991e0 con 0x55ad0df93ff0 2026-02-20T03:36:10.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9d767fc640 1 -- 10.20.193.28:0/1343712882 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f9da8038790 con 0x55ad0df93ff0 2026-02-20T03:36:10.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 10 client.21318 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:10.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 10 client.21318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:10.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 20 client.21318 populate_metadata read hostname 'trial028' 2026-02-20T03:36:10.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ad0dfc5200 0x55ad0dfc75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 4 client.21318 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:10.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.166+0000 7f9dc152be00 1 -- 10.20.193.28:0/1343712882 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad0dee6560 con 0x55ad0dfc5200 2026-02-20T03:36:10.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.193+0000 7f9daffff640 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ad0dfc5200 0x55ad0dfc75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.259+0000 7f9daffff640 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ad0dfc5200 0x55ad0dfc75f0 crc :-1 s=READY pgs=543 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a17e5a02575167 server_cookie=862a44c9e96d958e in_seq=0 out_seq=0 2026-02-20T03:36:10.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.259+0000 7f9d767fc640 10 client.21318 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:10.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9d767fc640 1 -- 10.20.193.28:0/1343712882 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ad0dee6560 con 0x55ad0dfc5200 2026-02-20T03:36:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9d767fc640 10 client.21318 handle_command_reply: tid=0 2026-02-20T03:36:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 client.21318 shutdown 2026-02-20T03:36:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 -- 10.20.193.28:0/1343712882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 msgr2=0x55ad0dfb6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:10.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfb6fb0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f9da8002410 tx=0x7f9da8002910 comp rx=0 tx=0).stop 2026-02-20T03:36:10.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 -- 10.20.193.28:0/1343712882 shutdown_connections 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ad0dfc5200 0x55ad0dfc75f0 crc :-1 s=READY pgs=543 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df98ae0 0x55ad0dfb56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df949a0 0x55ad0dfb74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 --2- 10.20.193.28:0/1343712882 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfb6fb0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9d767fc640 0 client.21318 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 -- 10.20.193.28:0/1343712882 >> 10.20.193.28:0/1343712882 conn(0x55ad0df4e240 msgr2=0x55ad0df97300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 -- 10.20.193.28:0/1343712882 shutdown_connections 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 1 -- 10.20.193.28:0/1343712882 wait complete. 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.286+0000 7f9dc152be00 20 client.21318 trim_cache size 0 max 16384 2026-02-20T03:36:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.289+0000 7f9dc152be00 1 Processor -- start 2026-02-20T03:36:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.294+0000 7f9dc152be00 1 -- start start 2026-02-20T03:36:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.294+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df93ff0 0x55ad0dfccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.294+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0dfcd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.294+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df98ae0 0x55ad0dfc10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.294+0000 7f9dc152be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c0127b0 con 0x55ad0df949a0 2026-02-20T03:36:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.294+0000 7f9dc152be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c00ffc0 con 0x55ad0df98ae0 2026-02-20T03:36:10.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.294+0000 7f9dc152be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c00de10 con 0x55ad0df93ff0 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9daffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0dfcd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9daffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0dfcd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40358/0 (socket says 10.20.193.28:40358) 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9daffff640 1 -- 10.20.193.28:0/4025266323 learned_addr learned my addr 10.20.193.28:0/4025266323 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9daffff640 1 -- 10.20.193.28:0/4025266323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df93ff0 msgr2=0x55ad0dfccf00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9daffff640 1 --2- 10.20.193.28:0/4025266323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df93ff0 0x55ad0dfccf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9daffff640 1 -- 10.20.193.28:0/4025266323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df98ae0 msgr2=0x55ad0dfc10a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9daffff640 1 --2- 10.20.193.28:0/4025266323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df98ae0 0x55ad0dfc10a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9daffff640 1 -- 10.20.193.28:0/4025266323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0df90a20 con 0x55ad0df949a0 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9daffff640 1 --2- 10.20.193.28:0/4025266323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0dfcd440 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f9da00a8240 tx=0x7f9da00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c721a4b3c938bd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d84ce3640 1 -- 10.20.193.28:0/4025266323 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da00e0040 con 0x55ad0df949a0 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d84ce3640 1 -- 10.20.193.28:0/4025266323 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9da00ddd50 con 0x55ad0df949a0 2026-02-20T03:36:10.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d84ce3640 1 -- 10.20.193.28:0/4025266323 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da00a72c0 con 0x55ad0df949a0 2026-02-20T03:36:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- 10.20.193.28:0/4025266323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 msgr2=0x55ad0dfcd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 --2- 10.20.193.28:0/4025266323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0dfcd440 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f9da00a8240 tx=0x7f9da00047e0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- 10.20.193.28:0/4025266323 shutdown_connections 2026-02-20T03:36:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 --2- 10.20.193.28:0/4025266323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df98ae0 0x55ad0dfc10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 --2- 10.20.193.28:0/4025266323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df949a0 0x55ad0dfcd440 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 --2- 10.20.193.28:0/4025266323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df93ff0 0x55ad0dfccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- 10.20.193.28:0/4025266323 >> 10.20.193.28:0/4025266323 conn(0x55ad0df4e240 msgr2=0x55ad0dfb4620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:10.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- 10.20.193.28:0/4025266323 shutdown_connections 2026-02-20T03:36:10.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- 10.20.193.28:0/4025266323 wait complete. 2026-02-20T03:36:10.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- start start 2026-02-20T03:36:10.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 Processor -- start 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfc0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df949a0 0x55ad0dfc1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df98ae0 0x55ad0e02a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c00e480 con 0x55ad0df93ff0 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c00f8f0 con 0x55ad0df949a0 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c00eb50 con 0x55ad0df98ae0 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dbcd9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfc0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dbcd9b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfc0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40372/0 (socket says 10.20.193.28:40372) 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/3531355880 learned_addr learned my addr 10.20.193.28:0/3531355880 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/3531355880 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df98ae0 msgr2=0x55ad0e02a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:10.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dbcd9b640 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df98ae0 0x55ad0e02a0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/3531355880 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df949a0 msgr2=0x55ad0dfc1420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dbcd9b640 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df949a0 0x55ad0dfc1420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dbcd9b640 1 -- 10.20.193.28:0/3531355880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad0df32010 con 0x55ad0df93ff0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dbcd9b640 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfc0ee0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f9da802f2a0 tx=0x7f9da802f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c82dfb33676ec server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d767fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d767fc640 1 -- 10.20.193.28:0/3531355880 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8005d90 con 0x55ad0df93ff0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d767fc640 1 -- 10.20.193.28:0/3531355880 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9da8033040 con 0x55ad0df93ff0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d767fc640 1 -- 10.20.193.28:0/3531355880 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8004a00 con 0x55ad0df93ff0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- 10.20.193.28:0/3531355880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad0dbbd870 con 0x55ad0df93ff0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d767fc640 1 -- 10.20.193.28:0/3531355880 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9da8059020 con 0x55ad0df93ff0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 10 client.21324 _ll_register_callbacks cb 0x7f9da8005840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- 10.20.193.28:0/3531355880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ad0de90ab0 con 0x55ad0df93ff0 2026-02-20T03:36:10.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d767fc640 1 -- 10.20.193.28:0/3531355880 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f9da8002690 con 0x55ad0df93ff0 2026-02-20T03:36:10.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 10 client.21324 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:10.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- 10.20.193.28:0/3531355880 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55ad0de7e3f0 con 0x55ad0df93ff0 2026-02-20T03:36:10.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9d767fc640 1 -- 10.20.193.28:0/3531355880 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f9da8004c60 con 0x55ad0df93ff0 2026-02-20T03:36:10.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 10 client.21324 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:10.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 10 client.21324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:10.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 20 client.21324 populate_metadata read hostname 'trial028' 2026-02-20T03:36:10.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ad0e031a30 0x55ad0e033ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:10.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 4 client.21324 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:36:10.306 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.295+0000 7f9dc152be00 1 -- 10.20.193.28:0/3531355880 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9da00ddd50 con 0x55ad0e031a30 2026-02-20T03:36:10.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.313+0000 7f9daffff640 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ad0e031a30 0x55ad0e033ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:10.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.380+0000 7f9daffff640 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ad0e031a30 0x55ad0e033ef0 crc :-1 s=READY pgs=544 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d75169eb66bf8ded server_cookie=44551d64cea6393d in_seq=0 out_seq=0 2026-02-20T03:36:10.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.380+0000 7f9d767fc640 10 client.21324 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:10.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9d767fc640 1 -- 10.20.193.28:0/3531355880 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9da00ddd50 con 0x55ad0e031a30 2026-02-20T03:36:10.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9d767fc640 10 client.21324 handle_command_reply: tid=0 2026-02-20T03:36:10.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 client.21324 shutdown 2026-02-20T03:36:10.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 -- 10.20.193.28:0/3531355880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 msgr2=0x55ad0dfc0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:10.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfc0ee0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f9da802f2a0 tx=0x7f9da802f900 comp rx=0 tx=0).stop 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 -- 10.20.193.28:0/3531355880 shutdown_connections 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ad0e031a30 0x55ad0e033ef0 crc :-1 s=READY pgs=544 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ad0df98ae0 0x55ad0e02a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ad0df949a0 0x55ad0dfc1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 --2- 10.20.193.28:0/3531355880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ad0df93ff0 0x55ad0dfc0ee0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 -- 10.20.193.28:0/3531355880 >> 10.20.193.28:0/3531355880 conn(0x55ad0df4e240 msgr2=0x55ad0df97170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9d767fc640 0 client.21324 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 -- 10.20.193.28:0/3531355880 shutdown_connections 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 1 -- 10.20.193.28:0/3531355880 wait complete. 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dc152be00 20 client.21324 trim_cache size 0 max 16384 2026-02-20T03:36:10.396 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:36:10.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 -- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d940b0e20 msgr2=0x7f9d940b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:10.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d940b0e20 0x7f9d940b32e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9db400aab0 tx=0x7f9db4009250 comp rx=0 tx=0).stop 2026-02-20T03:36:10.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 -- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8105750 msgr2=0x7f9db819d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:10.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8105750 0x7f9db819d7f0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f9da000b570 tx=0x7f9da000ba40 comp rx=0 tx=0).stop 2026-02-20T03:36:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 -- 10.20.193.28:0/1876222685 shutdown_connections 2026-02-20T03:36:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9d940b0e20 0x7f9d940b32e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9db8109ed0 0x7f9db81a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.409 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9db8105750 0x7f9db819d7f0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 --2- 10.20.193.28:0/1876222685 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9db8104da0 0x7f9db819d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 -- 10.20.193.28:0/1876222685 >> 10.20.193.28:0/1876222685 conn(0x7f9db8100840 msgr2=0x7f9db8101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 -- 10.20.193.28:0/1876222685 shutdown_connections 2026-02-20T03:36:10.410 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:10.393+0000 7f9dbf026640 1 -- 10.20.193.28:0/1876222685 wait complete. 2026-02-20T03:36:10.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.61 MB/sec execute 341 sec latency 35720.621 ms 2026-02-20T03:36:11.553 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:36:11.553 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:36:11.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:11 trial028 ceph-mon[38552]: pgmap v831: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 390 KiB/s rd, 494 KiB/s wr, 148 op/s 2026-02-20T03:36:11.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:11 trial177 ceph-mon[43181]: pgmap v831: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 390 KiB/s rd, 494 KiB/s wr, 148 op/s 2026-02-20T03:36:11.728 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.55 MB/sec execute 342 sec latency 36720.660 ms 2026-02-20T03:36:11.837 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:11 trial126 ceph-mon[38476]: pgmap v831: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 390 KiB/s rd, 494 KiB/s wr, 148 op/s 2026-02-20T03:36:12.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.077+0000 7f71eb577640 1 -- 10.20.193.28:0/1595349374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec07d550 msgr2=0x7f71ec10db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:12.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.077+0000 7f71eb577640 1 --2- 10.20.193.28:0/1595349374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec07d550 0x7f71ec10db10 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009a60 tx=0x7f71d402f290 comp rx=0 tx=0).stop 2026-02-20T03:36:12.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.078+0000 7f71eb577640 1 -- 10.20.193.28:0/1595349374 shutdown_connections 2026-02-20T03:36:12.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.078+0000 7f71eb577640 1 --2- 10.20.193.28:0/1595349374 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71ec10e220 0x7f71ec115dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.078+0000 7f71eb577640 1 --2- 10.20.193.28:0/1595349374 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec07d550 0x7f71ec10db10 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.078+0000 7f71eb577640 1 --2- 10.20.193.28:0/1595349374 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71ec07cba0 0x7f71ec07cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.081 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.078+0000 7f71eb577640 1 -- 10.20.193.28:0/1595349374 >> 10.20.193.28:0/1595349374 conn(0x7f71ec078790 msgr2=0x7f71ec07abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.078+0000 7f71eb577640 1 -- 10.20.193.28:0/1595349374 shutdown_connections 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.078+0000 7f71eb577640 1 -- 10.20.193.28:0/1595349374 wait complete. 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.078+0000 7f71eb577640 1 Processor -- start 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71eb577640 1 -- start start 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71eb577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71ec07cba0 0x7f71ec1a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71eb577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71ec07d550 0x7f71ec1a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71eb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10e220 0x7f71ec1a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71eb577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec1191e0 con 0x7f71ec10e220 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71eb577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec119060 con 0x7f71ec07d550 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71eb577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f71ec119360 con 0x7f71ec07cba0 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71ead76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10e220 0x7f71ec1a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71ead76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10e220 0x7f71ec1a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40394/0 (socket says 10.20.193.28:40394) 2026-02-20T03:36:12.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71ead76640 1 -- 10.20.193.28:0/1506899986 learned_addr learned my addr 10.20.193.28:0/1506899986 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71ead76640 1 -- 10.20.193.28:0/1506899986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71ec07cba0 msgr2=0x7f71ec1a73d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71ead76640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71ec07cba0 0x7f71ec1a73d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71ead76640 1 -- 10.20.193.28:0/1506899986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71ec07d550 msgr2=0x7f71ec1a7910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.079+0000 7f71ead76640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71ec07d550 0x7f71ec1a7910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.080+0000 7f71ead76640 1 -- 10.20.193.28:0/1506899986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ec1a1d60 con 0x7f71ec10e220 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.080+0000 7f71ead76640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10e220 0x7f71ec1a1590 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00b9e0 tx=0x7f71dc00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.080+0000 7f71d37fe640 1 -- 10.20.193.28:0/1506899986 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc006e60 con 0x7f71ec10e220 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.080+0000 7f71d37fe640 1 -- 10.20.193.28:0/1506899986 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71dc010070 con 0x7f71ec10e220 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.080+0000 7f71d37fe640 1 -- 10.20.193.28:0/1506899986 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0047f0 con 0x7f71ec10e220 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.080+0000 7f71eb577640 1 -- 10.20.193.28:0/1506899986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ec1a2050 con 0x7f71ec10e220 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.080+0000 7f71eb577640 1 -- 10.20.193.28:0/1506899986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ec1ae320 con 0x7f71ec10e220 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.081+0000 7f71f3178e00 1 Processor -- start 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.081+0000 7f71d37fe640 1 -- 10.20.193.28:0/1506899986 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f71dc01d030 con 0x7f71ec10e220 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71f3178e00 1 -- start start 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d2a70 0x558de31d6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d6b60 0x558de31d6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71f3178e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558de3124c00 con 0x558de31d20c0 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71f3178e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558de30d23c0 con 0x558de31d6b60 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71f3178e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558de3120b30 con 0x558de31d2a70 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31d24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40402/0 (socket says 10.20.193.28:40402) 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71e9d74640 1 -- 10.20.193.28:0/3610894420 learned_addr learned my addr 10.20.193.28:0/3610894420 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71e9d74640 1 -- 10.20.193.28:0/3610894420 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d2a70 msgr2=0x558de31d6540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71e9d74640 1 --2- 10.20.193.28:0/3610894420 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d2a70 0x558de31d6540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71e9d74640 1 -- 10.20.193.28:0/3610894420 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d6b60 msgr2=0x558de31d6fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71e9d74640 1 --2- 10.20.193.28:0/3610894420 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d6b60 0x558de31d6fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71e9d74640 1 -- 10.20.193.28:0/3610894420 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de30cb840 con 0x558de31d20c0 2026-02-20T03:36:12.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71e9d74640 1 --2- 10.20.193.28:0/3610894420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31d24a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f71ec06c740 tx=0x7f71d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f733ecc90757d5c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71d0ff9640 1 -- 10.20.193.28:0/3610894420 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d40026e0 con 0x558de31d20c0 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71d0ff9640 1 -- 10.20.193.28:0/3610894420 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71d4033040 con 0x558de31d20c0 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71d37fe640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71c40b0e20 0x7f71c40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71f3178e00 1 -- 10.20.193.28:0/3610894420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 msgr2=0x558de31d24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.084+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3610894420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31d24a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f71ec06c740 tx=0x7f71d4005880 comp rx=0 tx=0).stop 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71d37fe640 1 -- 10.20.193.28:0/1506899986 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f71dc0dff00 con 0x7f71ec10e220 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71f3178e00 1 -- 10.20.193.28:0/3610894420 shutdown_connections 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3610894420 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d6b60 0x558de31d6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3610894420 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d2a70 0x558de31d6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3610894420 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31d24a0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71f3178e00 1 -- 10.20.193.28:0/3610894420 >> 10.20.193.28:0/3610894420 conn(0x558de31cab60 msgr2=0x558de31d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71ea575640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71c40b0e20 0x7f71c40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71f3178e00 1 -- 10.20.193.28:0/3610894420 shutdown_connections 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71f3178e00 1 -- 10.20.193.28:0/3610894420 wait complete. 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71ea575640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71c40b0e20 0x7f71c40b32e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x558de31d3090 tx=0x7f71e0006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.086+0000 7f71f3178e00 1 -- start start 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 Processor -- start 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d2a70 0x558de31eb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d6b60 0x558de31f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558de30cc1a0 con 0x558de31d20c0 2026-02-20T03:36:12.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558de31ded60 con 0x558de31d6b60 2026-02-20T03:36:12.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558de31f6f80 con 0x558de31d2a70 2026-02-20T03:36:12.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71ea575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:12.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71ea575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31eadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40416/0 (socket says 10.20.193.28:40416) 2026-02-20T03:36:12.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71ea575640 1 -- 10.20.193.28:0/745413864 learned_addr learned my addr 10.20.193.28:0/745413864 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:12.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71ea575640 1 -- 10.20.193.28:0/745413864 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d2a70 msgr2=0x558de31eb310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:12.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71ea575640 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d2a70 0x558de31eb310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71ea575640 1 -- 10.20.193.28:0/745413864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d6b60 msgr2=0x558de31f6a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:12.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71ea575640 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d6b60 0x558de31f6a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71ea575640 1 -- 10.20.193.28:0/745413864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de31e4540 con 0x558de31d20c0 2026-02-20T03:36:12.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71ea575640 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31eadd0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f71e00046c0 tx=0x7f71e00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e33a9848ab5cf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:12.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f719bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:12.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f719bfff640 1 -- 10.20.193.28:0/745413864 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0002e20 con 0x558de31d20c0 2026-02-20T03:36:12.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f719bfff640 1 -- 10.20.193.28:0/745413864 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71e000be10 con 0x558de31d20c0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f719bfff640 1 -- 10.20.193.28:0/745413864 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011420 con 0x558de31d20c0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 -- 10.20.193.28:0/745413864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558de2ef3b60 con 0x558de31d20c0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 10 client.21336 _ll_register_callbacks cb 0x558de30d00d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 -- 10.20.193.28:0/745413864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558de312c7f0 con 0x558de31d20c0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f719bfff640 1 -- 10.20.193.28:0/745413864 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f71e000b970 con 0x558de31d20c0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f719bfff640 1 -- 10.20.193.28:0/745413864 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f71e000bbb0 con 0x558de31d20c0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 10 client.21336 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 -- 10.20.193.28:0/745413864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x558de30f1430 con 0x558de31d20c0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f719bfff640 1 -- 10.20.193.28:0/745413864 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f71e0020430 con 0x558de31d20c0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 10 client.21336 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 10 client.21336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 20 client.21336 populate_metadata read hostname 'trial028' 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558de31fb5b0 0x558de31fda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 4 client.21336 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.088+0000 7f71f3178e00 1 -- 10.20.193.28:0/745413864 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558de30a6c00 con 0x558de31fb5b0 2026-02-20T03:36:12.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.101+0000 7f71e9d74640 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558de31fb5b0 0x558de31fda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:12.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.168+0000 7f71e9d74640 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558de31fb5b0 0x558de31fda70 crc :-1 s=READY pgs=545 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=666b11ebe52061df server_cookie=83ce2de19b15fa6d in_seq=0 out_seq=0 2026-02-20T03:36:12.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.168+0000 7f719bfff640 10 client.21336 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:12.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f719bfff640 1 -- 10.20.193.28:0/745413864 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x558de30a6c00 con 0x558de31fb5b0 2026-02-20T03:36:12.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f719bfff640 10 client.21336 handle_command_reply: tid=0 2026-02-20T03:36:12.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 client.21336 shutdown 2026-02-20T03:36:12.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 -- 10.20.193.28:0/745413864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 msgr2=0x558de31eadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:12.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31eadd0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f71e00046c0 tx=0x7f71e00047e0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 -- 10.20.193.28:0/745413864 shutdown_connections 2026-02-20T03:36:12.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558de31fb5b0 0x558de31fda70 crc :-1 s=READY pgs=545 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d6b60 0x558de31f6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d2a70 0x558de31eb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 --2- 10.20.193.28:0/745413864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d20c0 0x558de31eadd0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 -- 10.20.193.28:0/745413864 >> 10.20.193.28:0/745413864 conn(0x558de31cab60 msgr2=0x558de31d5520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:12.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f719bfff640 0 client.21336 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:12.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 -- 10.20.193.28:0/745413864 shutdown_connections 2026-02-20T03:36:12.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 1 -- 10.20.193.28:0/745413864 wait complete. 2026-02-20T03:36:12.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.195+0000 7f71f3178e00 20 client.21336 trim_cache size 0 max 16384 2026-02-20T03:36:12.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71f3178e00 1 Processor -- start 2026-02-20T03:36:12.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71f3178e00 1 -- start start 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d20c0 0x558de3202370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d2a70 0x558de32028b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d6b60 0x558de3202df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71f3178e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71900127a0 con 0x558de31d2a70 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71f3178e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f719000ffb0 con 0x558de31d20c0 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71f3178e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f719000de00 con 0x558de31d6b60 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d2a70 0x558de32028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d2a70 0x558de32028b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40420/0 (socket says 10.20.193.28:40420) 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71e9d74640 1 -- 10.20.193.28:0/3408330199 learned_addr learned my addr 10.20.193.28:0/3408330199 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71e9d74640 1 -- 10.20.193.28:0/3408330199 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d6b60 msgr2=0x558de3202df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71e9d74640 1 --2- 10.20.193.28:0/3408330199 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d6b60 0x558de3202df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71e9d74640 1 -- 10.20.193.28:0/3408330199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d20c0 msgr2=0x558de3202370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71e9d74640 1 --2- 10.20.193.28:0/3408330199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d20c0 0x558de3202370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71e9d74640 1 -- 10.20.193.28:0/3408330199 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de31e4370 con 0x558de31d2a70 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71e9d74640 1 --2- 10.20.193.28:0/3408330199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d2a70 0x558de32028b0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x558de31ea500 tx=0x7f71d40023d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faeb95e795d2e095 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71b64e6640 1 -- 10.20.193.28:0/3408330199 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d40043a0 con 0x558de31d2a70 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71b64e6640 1 -- 10.20.193.28:0/3408330199 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71d402fab0 con 0x558de31d2a70 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.201+0000 7f71b64e6640 1 -- 10.20.193.28:0/3408330199 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4038bd0 con 0x558de31d2a70 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 -- 10.20.193.28:0/3408330199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d2a70 msgr2=0x558de32028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3408330199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d2a70 0x558de32028b0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x558de31ea500 tx=0x7f71d40023d0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 -- 10.20.193.28:0/3408330199 shutdown_connections 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3408330199 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d6b60 0x558de3202df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3408330199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d2a70 0x558de32028b0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3408330199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d20c0 0x558de3202370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 -- 10.20.193.28:0/3408330199 >> 10.20.193.28:0/3408330199 conn(0x558de31cab60 msgr2=0x558de31e9580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:12.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 -- 10.20.193.28:0/3408330199 shutdown_connections 2026-02-20T03:36:12.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 -- 10.20.193.28:0/3408330199 wait complete. 2026-02-20T03:36:12.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 -- start start 2026-02-20T03:36:12.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 Processor -- start 2026-02-20T03:36:12.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d20c0 0x558de31f2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d2a70 0x558de31f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d6b60 0x558de31f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f719000e470 con 0x558de31d6b60 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f719000f8e0 con 0x558de31d2a70 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71f3178e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f719000eb40 con 0x558de31d20c0 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71ead76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d6b60 0x558de31f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71ead76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d6b60 0x558de31f0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40422/0 (socket says 10.20.193.28:40422) 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71ead76640 1 -- 10.20.193.28:0/3449725240 learned_addr learned my addr 10.20.193.28:0/3449725240 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71ead76640 1 -- 10.20.193.28:0/3449725240 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d20c0 msgr2=0x558de31f2210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.206+0000 7f71ead76640 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d20c0 0x558de31f2210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71ead76640 1 -- 10.20.193.28:0/3449725240 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d2a70 msgr2=0x558de31f05a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71ead76640 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d2a70 0x558de31f05a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71ead76640 1 -- 10.20.193.28:0/3449725240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de2e03900 con 0x558de31d6b60 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71ead76640 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d6b60 0x558de31f0ae0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0a78e0 tx=0x7f71dc0a72e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e221b9789fac006c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:12.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f719bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f719bfff640 1 -- 10.20.193.28:0/3449725240 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc012320 con 0x558de31d6b60 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f719bfff640 1 -- 10.20.193.28:0/3449725240 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71dc0a82e0 con 0x558de31d6b60 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f719bfff640 1 -- 10.20.193.28:0/3449725240 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71dc0a3300 con 0x558de31d6b60 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 1 -- 10.20.193.28:0/3449725240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558de30df4d0 con 0x558de31d6b60 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 10 client.21342 _ll_register_callbacks cb 0x7f71e0004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 1 -- 10.20.193.28:0/3449725240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71d4033040 con 0x558de31d6b60 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f719bfff640 1 -- 10.20.193.28:0/3449725240 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f71dc0ce1b0 con 0x558de31d6b60 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f719bfff640 1 -- 10.20.193.28:0/3449725240 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f71dc0abf90 con 0x558de31d6b60 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 10 client.21342 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 1 -- 10.20.193.28:0/3449725240 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x558de31e5060 con 0x558de31d6b60 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f719bfff640 1 -- 10.20.193.28:0/3449725240 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f71dc0a34c0 con 0x558de31d6b60 2026-02-20T03:36:12.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 10 client.21342 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:12.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 10 client.21342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:12.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 20 client.21342 populate_metadata read hostname 'trial028' 2026-02-20T03:36:12.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558de3267890 0x558de3269d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:12.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 4 client.21342 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:36:12.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.209+0000 7f71f3178e00 1 -- 10.20.193.28:0/3449725240 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558de2ea52b0 con 0x558de3267890 2026-02-20T03:36:12.238 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.235+0000 7f71ea575640 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558de3267890 0x558de3269d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:12.304 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.301+0000 7f71ea575640 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558de3267890 0x558de3269d50 crc :-1 s=READY pgs=546 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=283414e9c5c23488 server_cookie=12e5884aeb181bb7 in_seq=0 out_seq=0 2026-02-20T03:36:12.305 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.301+0000 7f719bfff640 10 client.21342 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:12.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.315+0000 7f719bfff640 1 -- 10.20.193.28:0/3449725240 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f71e002c080 con 0x558de3267890 2026-02-20T03:36:12.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.315+0000 7f719bfff640 10 client.21342 handle_command_reply: tid=0 2026-02-20T03:36:12.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.315+0000 7f71f3178e00 1 client.21342 shutdown 2026-02-20T03:36:12.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 -- 10.20.193.28:0/3449725240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d6b60 msgr2=0x558de31f0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:12.319 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d6b60 0x558de31f0ae0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f71dc0a78e0 tx=0x7f71dc0a72e0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 -- 10.20.193.28:0/3449725240 shutdown_connections 2026-02-20T03:36:12.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558de3267890 0x558de3269d50 crc :-1 s=READY pgs=546 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558de31d6b60 0x558de31f0ae0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558de31d2a70 0x558de31f05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 --2- 10.20.193.28:0/3449725240 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558de31d20c0 0x558de31f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 -- 10.20.193.28:0/3449725240 >> 10.20.193.28:0/3449725240 conn(0x558de31cab60 msgr2=0x558de31d7510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:12.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f719bfff640 0 client.21342 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:12.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 -- 10.20.193.28:0/3449725240 shutdown_connections 2026-02-20T03:36:12.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 1 -- 10.20.193.28:0/3449725240 wait complete. 2026-02-20T03:36:12.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71f3178e00 20 client.21342 trim_cache size 0 max 16384 2026-02-20T03:36:12.321 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:36:12.321 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:36:12.321 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "2c7d8857-5909-4ada-b3ac-7a384a465877", 2026-02-20T03:36:12.321 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:36:12.321 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:36:12.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 -- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71c40b0e20 msgr2=0x7f71c40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:12.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71c40b0e20 0x7f71c40b32e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x558de31d3090 tx=0x7f71e0006cd0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 -- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10e220 msgr2=0x7f71ec1a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:12.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10e220 0x7f71ec1a1590 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00b9e0 tx=0x7f71dc00beb0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 -- 10.20.193.28:0/1506899986 shutdown_connections 2026-02-20T03:36:12.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71c40b0e20 0x7f71c40b32e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71ec10e220 0x7f71ec1a1590 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71ec07d550 0x7f71ec1a7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 --2- 10.20.193.28:0/1506899986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71ec07cba0 0x7f71ec1a73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:12.331 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 -- 10.20.193.28:0/1506899986 >> 10.20.193.28:0/1506899986 conn(0x7f71ec078790 msgr2=0x7f71ec10c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:12.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 -- 10.20.193.28:0/1506899986 shutdown_connections 2026-02-20T03:36:12.332 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:12.316+0000 7f71eb577640 1 -- 10.20.193.28:0/1506899986 wait complete. 2026-02-20T03:36:12.478 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:36:12.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.50 MB/sec execute 343 sec latency 37720.775 ms 2026-02-20T03:36:12.776 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:12 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:36:12.776 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:12 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:12.776 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:12 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:36:12.790 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:12.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:12 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:36:12.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:12 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:12.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:12 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:36:12.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:12 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:36:12.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:12 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:12.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:12 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:36:13.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.026+0000 7ff7bbfff640 1 -- 10.20.193.28:0/3534821500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc104980 msgr2=0x7ff7bc104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:13.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.026+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/3534821500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc104980 0x7ff7bc104de0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009a60 tx=0x7ff7a402f290 comp rx=0 tx=0).stop 2026-02-20T03:36:13.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.026+0000 7ff7bbfff640 1 -- 10.20.193.28:0/3534821500 shutdown_connections 2026-02-20T03:36:13.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.026+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/3534821500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7bc105320 0x7ff7bc111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.026+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/3534821500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc104980 0x7ff7bc104de0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.026+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/3534821500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7bc10a980 0x7ff7bc10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.026+0000 7ff7bbfff640 1 -- 10.20.193.28:0/3534821500 >> 10.20.193.28:0/3534821500 conn(0x7ff7bc100680 msgr2=0x7ff7bc102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.026+0000 7ff7bbfff640 1 -- 10.20.193.28:0/3534821500 shutdown_connections 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.026+0000 7ff7bbfff640 1 -- 10.20.193.28:0/3534821500 wait complete. 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bbfff640 1 Processor -- start 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bbfff640 1 -- start start 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bbfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7bc104980 0x7ff7bc074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bbfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7bc105320 0x7ff7bc06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc10a980 0x7ff7bc06de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc114cd0 con 0x7ff7bc10a980 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bbfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc114b50 con 0x7ff7bc104980 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bbfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc114e50 con 0x7ff7bc105320 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc10a980 0x7ff7bc06de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc10a980 0x7ff7bc06de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40438/0 (socket says 10.20.193.28:40438) 2026-02-20T03:36:13.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bb7fe640 1 -- 10.20.193.28:0/161814641 learned_addr learned my addr 10.20.193.28:0/161814641 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:13.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bb7fe640 1 -- 10.20.193.28:0/161814641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7bc105320 msgr2=0x7ff7bc06d8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:13.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bb7fe640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7bc105320 0x7ff7bc06d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bb7fe640 1 -- 10.20.193.28:0/161814641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7bc104980 msgr2=0x7ff7bc074840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:13.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bb7fe640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7bc104980 0x7ff7bc074840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bb7fe640 1 -- 10.20.193.28:0/161814641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7bc06e420 con 0x7ff7bc10a980 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bb7fe640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc10a980 0x7ff7bc06de10 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00b990 tx=0x7ff7ac00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff79bfff640 1 -- 10.20.193.28:0/161814641 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac006e60 con 0x7ff7bc10a980 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff79bfff640 1 -- 10.20.193.28:0/161814641 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff7ac010070 con 0x7ff7bc10a980 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff7bbfff640 1 -- 10.20.193.28:0/161814641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7bc06e710 con 0x7ff7bc10a980 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.032+0000 7ff79bfff640 1 -- 10.20.193.28:0/161814641 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac004800 con 0x7ff7bc10a980 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.034+0000 7ff7bbfff640 1 -- 10.20.193.28:0/161814641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7bc0726e0 con 0x7ff7bc10a980 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.037+0000 7ff79bfff640 1 -- 10.20.193.28:0/161814641 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff7ac01e3f0 con 0x7ff7bc10a980 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.037+0000 7ff7c387fe00 1 Processor -- start 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.037+0000 7ff7c387fe00 1 -- start start 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4c00000 0x5591a4c003e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4bfa630 0x5591a4bfaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4c06e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5591a4b7ae50 con 0x5591a4bfafb0 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5591a4b4d9c0 con 0x5591a4c00000 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5591a4afb240 con 0x5591a4bfa630 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7ba7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4c06e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7ba7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4c06e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40448/0 (socket says 10.20.193.28:40448) 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7ba7fc640 1 -- 10.20.193.28:0/1637418864 learned_addr learned my addr 10.20.193.28:0/1637418864 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7ba7fc640 1 -- 10.20.193.28:0/1637418864 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4bfa630 msgr2=0x5591a4bfaa70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7ba7fc640 1 --2- 10.20.193.28:0/1637418864 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4bfa630 0x5591a4bfaa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7ba7fc640 1 -- 10.20.193.28:0/1637418864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4c00000 msgr2=0x5591a4c003e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7ba7fc640 1 --2- 10.20.193.28:0/1637418864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4c00000 0x5591a4c003e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7ba7fc640 1 -- 10.20.193.28:0/1637418864 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a4b0e420 con 0x5591a4bfafb0 2026-02-20T03:36:13.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7ba7fc640 1 --2- 10.20.193.28:0/1637418864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4c06e30 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7ff7a402f7a0 tx=0x7ff7a4002cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564c651b89d3ab91 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:13.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7837fe640 1 -- 10.20.193.28:0/1637418864 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4038470 con 0x5591a4bfafb0 2026-02-20T03:36:13.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7837fe640 1 -- 10.20.193.28:0/1637418864 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff7a4033040 con 0x5591a4bfafb0 2026-02-20T03:36:13.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7837fe640 1 -- 10.20.193.28:0/1637418864 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40047c0 con 0x5591a4bfafb0 2026-02-20T03:36:13.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff79bfff640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff78c0b0e20 0x7ff78c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff79bfff640 1 -- 10.20.193.28:0/161814641 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff7ac0e0420 con 0x7ff7bc10a980 2026-02-20T03:36:13.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7c387fe00 1 -- 10.20.193.28:0/1637418864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 msgr2=0x5591a4c06e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:13.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/1637418864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4c06e30 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7ff7a402f7a0 tx=0x7ff7a4002cb0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7baffd640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff78c0b0e20 0x7ff78c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:13.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.038+0000 7ff7c387fe00 1 -- 10.20.193.28:0/1637418864 shutdown_connections 2026-02-20T03:36:13.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/1637418864 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4c06e30 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/1637418864 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4bfa630 0x5591a4bfaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/1637418864 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4c00000 0x5591a4c003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- 10.20.193.28:0/1637418864 >> 10.20.193.28:0/1637418864 conn(0x5591a4bbd290 msgr2=0x5591a4bf8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:13.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- 10.20.193.28:0/1637418864 shutdown_connections 2026-02-20T03:36:13.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- 10.20.193.28:0/1637418864 wait complete. 2026-02-20T03:36:13.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7baffd640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff78c0b0e20 0x7ff78c0b32e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00096f0 tx=0x7ff7b0006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:13.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- start start 2026-02-20T03:36:13.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 Processor -- start 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4bfa630 0x5591a4c1d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfafb0 0x5591a4c1daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4c00000 0x5591a4c1bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5591a4b498f0 con 0x5591a4c00000 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5591a493bf50 con 0x5591a4bfafb0 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5591a4c1c470 con 0x5591a4bfa630 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7bb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4c00000 0x5591a4c1bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7bb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4c00000 0x5591a4c1bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40452/0 (socket says 10.20.193.28:40452) 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7bb7fe640 1 -- 10.20.193.28:0/994819667 learned_addr learned my addr 10.20.193.28:0/994819667 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7bb7fe640 1 -- 10.20.193.28:0/994819667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4bfa630 msgr2=0x5591a4c1d5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7bb7fe640 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4bfa630 0x5591a4c1d5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7bb7fe640 1 -- 10.20.193.28:0/994819667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfafb0 msgr2=0x5591a4c1daf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7bb7fe640 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfafb0 0x5591a4c1daf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7bb7fe640 1 -- 10.20.193.28:0/994819667 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a4c15440 con 0x5591a4c00000 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7bb7fe640 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4c00000 0x5591a4c1bcf0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00ccc0 tx=0x7ff7ac0a7770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aea1f74b5c76b16 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff780ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff780ff9640 1 -- 10.20.193.28:0/994819667 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0ac4b0 con 0x5591a4c00000 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff780ff9640 1 -- 10.20.193.28:0/994819667 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff7ac0b1360 con 0x5591a4c00000 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff780ff9640 1 -- 10.20.193.28:0/994819667 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0a4970 con 0x5591a4c00000 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- 10.20.193.28:0/994819667 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a491eb40 con 0x5591a4c00000 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff780ff9640 1 -- 10.20.193.28:0/994819667 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff7ac0b08a0 con 0x5591a4c00000 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff780ff9640 10 client.21354 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 10 client.21354 _ll_register_callbacks cb 0x5591a4b86f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:13.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- 10.20.193.28:0/994819667 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5591a4b5b1a0 con 0x5591a4c00000 2026-02-20T03:36:13.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff780ff9640 1 -- 10.20.193.28:0/994819667 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff7ac091390 con 0x5591a4c00000 2026-02-20T03:36:13.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 10 client.21354 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:13.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- 10.20.193.28:0/994819667 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5591a4b08230 con 0x5591a4c00000 2026-02-20T03:36:13.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff780ff9640 1 -- 10.20.193.28:0/994819667 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7ff7ac0b0aa0 con 0x5591a4c00000 2026-02-20T03:36:13.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 10 client.21354 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:13.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 10 client.21354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:13.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 20 client.21354 populate_metadata read hostname 'trial028' 2026-02-20T03:36:13.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5591a4c2be70 0x5591a4c2e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 4 client.21354 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:13.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.040+0000 7ff7c387fe00 1 -- 10.20.193.28:0/994819667 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591a4b555b0 con 0x5591a4c2be70 2026-02-20T03:36:13.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.067+0000 7ff7baffd640 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5591a4c2be70 0x5591a4c2e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:13.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.134+0000 7ff7baffd640 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5591a4c2be70 0x5591a4c2e2c0 crc :-1 s=READY pgs=547 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b00a50722df6d1 server_cookie=9b81f62ff48e24ee in_seq=0 out_seq=0 2026-02-20T03:36:13.136 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.134+0000 7ff780ff9640 10 client.21354 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:13.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff780ff9640 1 -- 10.20.193.28:0/994819667 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5591a4b555b0 con 0x5591a4c2be70 2026-02-20T03:36:13.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff780ff9640 10 client.21354 handle_command_reply: tid=0 2026-02-20T03:36:13.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 client.21354 shutdown 2026-02-20T03:36:13.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 -- 10.20.193.28:0/994819667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4c00000 msgr2=0x5591a4c1bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:13.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4c00000 0x5591a4c1bcf0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00ccc0 tx=0x7ff7ac0a7770 comp rx=0 tx=0).stop 2026-02-20T03:36:13.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 -- 10.20.193.28:0/994819667 shutdown_connections 2026-02-20T03:36:13.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5591a4c2be70 0x5591a4c2e2c0 crc :-1 s=READY pgs=547 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4c00000 0x5591a4c1bcf0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfafb0 0x5591a4c1daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/994819667 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4bfa630 0x5591a4c1d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff780ff9640 0 client.21354 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:13.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 -- 10.20.193.28:0/994819667 >> 10.20.193.28:0/994819667 conn(0x5591a4bbd290 msgr2=0x5591a4bf9440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:13.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 -- 10.20.193.28:0/994819667 shutdown_connections 2026-02-20T03:36:13.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 1 -- 10.20.193.28:0/994819667 wait complete. 2026-02-20T03:36:13.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.160+0000 7ff7c387fe00 20 client.21354 trim_cache size 0 max 16384 2026-02-20T03:36:13.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7c387fe00 1 Processor -- start 2026-02-20T03:36:13.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7c387fe00 1 -- start start 2026-02-20T03:36:13.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfa630 0x5591a4bf2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4bf9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4c00000 0x5591a4bf9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff760012710 con 0x5591a4bfafb0 2026-02-20T03:36:13.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000ff20 con 0x5591a4bfa630 2026-02-20T03:36:13.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000dd70 con 0x5591a4c00000 2026-02-20T03:36:13.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7ba7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4bf9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7ba7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4bf9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40456/0 (socket says 10.20.193.28:40456) 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7ba7fc640 1 -- 10.20.193.28:0/925600147 learned_addr learned my addr 10.20.193.28:0/925600147 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7ba7fc640 1 -- 10.20.193.28:0/925600147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4c00000 msgr2=0x5591a4bf9a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7ba7fc640 1 --2- 10.20.193.28:0/925600147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4c00000 0x5591a4bf9a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7ba7fc640 1 -- 10.20.193.28:0/925600147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfa630 msgr2=0x5591a4bf2b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7ba7fc640 1 --2- 10.20.193.28:0/925600147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfa630 0x5591a4bf2b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7ba7fc640 1 -- 10.20.193.28:0/925600147 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a4c15270 con 0x5591a4bfafb0 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff7ba7fc640 1 --2- 10.20.193.28:0/925600147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4bf9520 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4041000 tx=0x7ff7a4038470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6539c19dd0ee3ab server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff782ffd640 1 -- 10.20.193.28:0/925600147 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4048070 con 0x5591a4bfafb0 2026-02-20T03:36:13.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff782ffd640 1 -- 10.20.193.28:0/925600147 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff7a402fab0 con 0x5591a4bfafb0 2026-02-20T03:36:13.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.166+0000 7ff782ffd640 1 -- 10.20.193.28:0/925600147 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40047c0 con 0x5591a4bfafb0 2026-02-20T03:36:13.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 -- 10.20.193.28:0/925600147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 msgr2=0x5591a4bf9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:13.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/925600147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4bf9520 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4041000 tx=0x7ff7a4038470 comp rx=0 tx=0).stop 2026-02-20T03:36:13.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 -- 10.20.193.28:0/925600147 shutdown_connections 2026-02-20T03:36:13.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/925600147 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4c00000 0x5591a4bf9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/925600147 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfafb0 0x5591a4bf9520 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/925600147 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfa630 0x5591a4bf2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 -- 10.20.193.28:0/925600147 >> 10.20.193.28:0/925600147 conn(0x5591a4bbd290 msgr2=0x5591a4c1ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:13.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 -- 10.20.193.28:0/925600147 shutdown_connections 2026-02-20T03:36:13.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 -- 10.20.193.28:0/925600147 wait complete. 2026-02-20T03:36:13.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 -- start start 2026-02-20T03:36:13.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 Processor -- start 2026-02-20T03:36:13.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfa630 0x5591a4c911d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfafb0 0x5591a4c91710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4c00000 0x5591a4c20b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000e3e0 con 0x5591a4bfa630 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000f850 con 0x5591a4bfafb0 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7c387fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff76000eab0 con 0x5591a4c00000 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfa630 0x5591a4c911d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfa630 0x5591a4c911d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40460/0 (socket says 10.20.193.28:40460) 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.171+0000 7ff7baffd640 1 -- 10.20.193.28:0/3788318327 learned_addr learned my addr 10.20.193.28:0/3788318327 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7baffd640 1 -- 10.20.193.28:0/3788318327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4c00000 msgr2=0x5591a4c20b60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7baffd640 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4c00000 0x5591a4c20b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7baffd640 1 -- 10.20.193.28:0/3788318327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfafb0 msgr2=0x5591a4c91710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:13.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7baffd640 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfafb0 0x5591a4c91710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7baffd640 1 -- 10.20.193.28:0/3788318327 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591a482c870 con 0x5591a4bfa630 2026-02-20T03:36:13.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7baffd640 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfa630 0x5591a4c911d0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x5591a4c2eb70 tx=0x7ff7b0004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9544c2c8558f4c1d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:13.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff780ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:13.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff780ff9640 1 -- 10.20.193.28:0/3788318327 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0002e60 con 0x5591a4bfa630 2026-02-20T03:36:13.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff780ff9640 1 -- 10.20.193.28:0/3788318327 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff7b00045b0 con 0x5591a4bfa630 2026-02-20T03:36:13.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff780ff9640 1 -- 10.20.193.28:0/3788318327 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0013e00 con 0x5591a4bfa630 2026-02-20T03:36:13.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 1 -- 10.20.193.28:0/3788318327 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591a4aed440 con 0x5591a4bfa630 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff780ff9640 1 -- 10.20.193.28:0/3788318327 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff7b00113f0 con 0x5591a4bfa630 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 10 client.21360 _ll_register_callbacks cb 0x7ff7ac0098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 1 -- 10.20.193.28:0/3788318327 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5591a4affb00 con 0x5591a4bfa630 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff780ff9640 1 -- 10.20.193.28:0/3788318327 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff7b002d060 con 0x5591a4bfa630 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 10 client.21360 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 1 -- 10.20.193.28:0/3788318327 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5591a4c15f60 con 0x5591a4bfa630 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff780ff9640 1 -- 10.20.193.28:0/3788318327 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7ff7b0013410 con 0x5591a4bfa630 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 10 client.21360 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 10 client.21360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:13.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 20 client.21360 populate_metadata read hostname 'trial028' 2026-02-20T03:36:13.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5591a4c98c60 0x5591a4c9b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:13.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 4 client.21360 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:36:13.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.174+0000 7ff7c387fe00 1 -- 10.20.193.28:0/3788318327 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ff7a4033040 con 0x5591a4c98c60 2026-02-20T03:36:13.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.201+0000 7ff7ba7fc640 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5591a4c98c60 0x5591a4c9b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:13.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.266+0000 7ff7ba7fc640 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5591a4c98c60 0x5591a4c9b120 crc :-1 s=READY pgs=548 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b50e2df297b0550 server_cookie=e6e56a14239ca4c2 in_seq=0 out_seq=0 2026-02-20T03:36:13.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.266+0000 7ff780ff9640 10 client.21360 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:13.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff780ff9640 1 -- 10.20.193.28:0/3788318327 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7ff7a4033040 con 0x5591a4c98c60 2026-02-20T03:36:13.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff780ff9640 10 client.21360 handle_command_reply: tid=0 2026-02-20T03:36:13.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 client.21360 shutdown 2026-02-20T03:36:13.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 -- 10.20.193.28:0/3788318327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfa630 msgr2=0x5591a4c911d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:13.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfa630 0x5591a4c911d0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x5591a4c2eb70 tx=0x7ff7b0004850 comp rx=0 tx=0).stop 2026-02-20T03:36:13.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 -- 10.20.193.28:0/3788318327 shutdown_connections 2026-02-20T03:36:13.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5591a4c98c60 0x5591a4c9b120 crc :-1 s=READY pgs=548 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5591a4c00000 0x5591a4c20b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5591a4bfafb0 0x5591a4c91710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 --2- 10.20.193.28:0/3788318327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5591a4bfa630 0x5591a4c911d0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff780ff9640 0 client.21360 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:13.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 -- 10.20.193.28:0/3788318327 >> 10.20.193.28:0/3788318327 conn(0x5591a4bbd290 msgr2=0x5591a4c2c250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:13.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 -- 10.20.193.28:0/3788318327 shutdown_connections 2026-02-20T03:36:13.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 1 -- 10.20.193.28:0/3788318327 wait complete. 2026-02-20T03:36:13.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.281+0000 7ff7c387fe00 20 client.21360 trim_cache size 0 max 16384 2026-02-20T03:36:13.296 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:36:13.296 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:36:13.296 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:36:13.296 INFO:teuthology.orchestra.run.trial028.stdout: "2c7d8857-5909-4ada-b3ac-7a384a465877": { 2026-02-20T03:36:13.296 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:36:13.297 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "2c7d8857-5909-4ada-b3ac-7a384a465877", 2026-02-20T03:36:13.297 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:36:13.297 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:36:13.297 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:36:13.297 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:36:13.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 -- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff78c0b0e20 msgr2=0x7ff78c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:13.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff78c0b0e20 0x7ff78c0b32e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00096f0 tx=0x7ff7b0006cd0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 -- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc10a980 msgr2=0x7ff7bc06de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:13.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc10a980 0x7ff7bc06de10 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00b990 tx=0x7ff7ac00be60 comp rx=0 tx=0).stop 2026-02-20T03:36:13.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 -- 10.20.193.28:0/161814641 shutdown_connections 2026-02-20T03:36:13.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff78c0b0e20 0x7ff78c0b32e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff7bc10a980 0x7ff7bc06de10 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff7bc105320 0x7ff7bc06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 --2- 10.20.193.28:0/161814641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff7bc104980 0x7ff7bc074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:13.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 -- 10.20.193.28:0/161814641 >> 10.20.193.28:0/161814641 conn(0x7ff7bc100680 msgr2=0x7ff7bc101170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:13.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 -- 10.20.193.28:0/161814641 shutdown_connections 2026-02-20T03:36:13.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:13.282+0000 7ff7bbfff640 1 -- 10.20.193.28:0/161814641 wait complete. 2026-02-20T03:36:13.428 INFO:tasks.cephfs.filesystem:scrub status for tag:2c7d8857-5909-4ada-b3ac-7a384a465877 - {'path': '/', 'tag': '2c7d8857-5909-4ada-b3ac-7a384a465877', 'options': 'recursive,force'} 2026-02-20T03:36:13.550 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:13 trial028 ceph-mon[38552]: pgmap v832: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 387 KiB/s rd, 471 KiB/s wr, 146 op/s 2026-02-20T03:36:13.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:13 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:36:13.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:13 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:36:13.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:13 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:13.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:13 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:36:13.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:13 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:13.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:13 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:13.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.44 MB/sec execute 344 sec latency 38720.828 ms 2026-02-20T03:36:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:13 trial126 ceph-mon[38476]: pgmap v832: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 387 KiB/s rd, 471 KiB/s wr, 146 op/s 2026-02-20T03:36:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:13 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:36:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:13 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:36:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:13 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:13 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:36:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:13 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:13.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:13 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:13.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:13 trial177 ceph-mon[43181]: pgmap v832: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 387 KiB/s rd, 471 KiB/s wr, 146 op/s 2026-02-20T03:36:13.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:13 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:36:13.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:13 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:36:13.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:13 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:13.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:13 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:36:13.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:13 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:13.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:13 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:14.618 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:14 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:14.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.38 MB/sec execute 345 sec latency 39720.875 ms 2026-02-20T03:36:14.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:14 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:14.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:14 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:15.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 -- 10.20.193.28:0/2645776576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc105b30 msgr2=0x7f93fc105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:15.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 --2- 10.20.193.28:0/2645776576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc105b30 0x7f93fc105fb0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009a30 tx=0x7f93ec02f260 comp rx=0 tx=0).stop 2026-02-20T03:36:15.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 -- 10.20.193.28:0/2645776576 shutdown_connections 2026-02-20T03:36:15.647 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 --2- 10.20.193.28:0/2645776576 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f93fc1064f0 0x7f93fc10cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.648 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 --2- 10.20.193.28:0/2645776576 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc105b30 0x7f93fc105fb0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 --2- 10.20.193.28:0/2645776576 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc104940 0x7f93fc104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 -- 10.20.193.28:0/2645776576 >> 10.20.193.28:0/2645776576 conn(0x7f93fc1000c0 msgr2=0x7f93fc1024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:15.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 -- 10.20.193.28:0/2645776576 shutdown_connections 2026-02-20T03:36:15.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 -- 10.20.193.28:0/2645776576 wait complete. 2026-02-20T03:36:15.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.644+0000 7f940132a640 1 Processor -- start 2026-02-20T03:36:15.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f940132a640 1 -- start start 2026-02-20T03:36:15.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f940132a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc104940 0x7f93fc19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f940132a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc105b30 0x7f93fc19d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f940132a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f93fc1064f0 0x7f93fc1a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f940132a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc110550 con 0x7f93fc104940 2026-02-20T03:36:15.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f940132a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc1103d0 con 0x7f93fc1064f0 2026-02-20T03:36:15.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f940132a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc1106d0 con 0x7f93fc105b30 2026-02-20T03:36:15.654 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f93fbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc104940 0x7f93fc19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f93fbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc104940 0x7f93fc19cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40476/0 (socket says 10.20.193.28:40476) 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f93fbfff640 1 -- 10.20.193.28:0/3930908665 learned_addr learned my addr 10.20.193.28:0/3930908665 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f93fbfff640 1 -- 10.20.193.28:0/3930908665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc105b30 msgr2=0x7f93fc19d100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f93fbfff640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc105b30 0x7f93fc19d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f93fbfff640 1 -- 10.20.193.28:0/3930908665 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f93fc1064f0 msgr2=0x7f93fc1a4170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f93fbfff640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f93fc1064f0 0x7f93fc1a4170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.646+0000 7f93fbfff640 1 -- 10.20.193.28:0/3930908665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc1a4870 con 0x7f93fc104940 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.647+0000 7f93fbfff640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc104940 0x7f93fc19cbc0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f93e800b750 tx=0x7f93e800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.647+0000 7f93f97fa640 1 -- 10.20.193.28:0/3930908665 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8004480 con 0x7f93fc104940 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.647+0000 7f93f97fa640 1 -- 10.20.193.28:0/3930908665 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f93e8010070 con 0x7f93fc104940 2026-02-20T03:36:15.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.647+0000 7f940132a640 1 -- 10.20.193.28:0/3930908665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93fc1a4b60 con 0x7f93fc104940 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.647+0000 7f93f97fa640 1 -- 10.20.193.28:0/3930908665 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e800ca90 con 0x7f93fc104940 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.647+0000 7f940132a640 1 -- 10.20.193.28:0/3930908665 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93fc1a5100 con 0x7f93fc104940 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f93f97fa640 1 -- 10.20.193.28:0/3930908665 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f93e801d030 con 0x7f93fc104940 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 Processor -- start 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 -- start start 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582867280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 0x55d58286bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d58286c560 0x55d58286e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d5827b78f0 con 0x55d582866e80 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d5827652e0 con 0x55d5828677c0 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d5827b3820 con 0x55d58286c560 2026-02-20T03:36:15.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9400b29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582867280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:15.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9400b29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582867280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40488/0 (socket says 10.20.193.28:40488) 2026-02-20T03:36:15.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9400b29640 1 -- 10.20.193.28:0/3506617 learned_addr learned my addr 10.20.193.28:0/3506617 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:15.660 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9400b29640 1 -- 10.20.193.28:0/3506617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d58286c560 msgr2=0x55d58286e9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9400b29640 1 --2- 10.20.193.28:0/3506617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d58286c560 0x55d58286e9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9400b29640 1 -- 10.20.193.28:0/3506617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 msgr2=0x55d58286bf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9400b29640 1 --2- 10.20.193.28:0/3506617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 0x55d58286bf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9400b29640 1 -- 10.20.193.28:0/3506617 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5827575a0 con 0x55d582866e80 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9400b29640 1 --2- 10.20.193.28:0/3506617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582867280 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009d20 tx=0x7f93f000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e4b1d29b1bdf85 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f93bffff640 1 -- 10.20.193.28:0/3506617 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0017070 con 0x55d582866e80 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f93bffff640 1 -- 10.20.193.28:0/3506617 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f93f000bd50 con 0x55d582866e80 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f93bffff640 1 -- 10.20.193.28:0/3506617 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0006e60 con 0x55d582866e80 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f93f97fa640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93d00b0e20 0x7f93d00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 -- 10.20.193.28:0/3506617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 msgr2=0x55d582867280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 --2- 10.20.193.28:0/3506617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582867280 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009d20 tx=0x7f93f000b420 comp rx=0 tx=0).stop 2026-02-20T03:36:15.661 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f93f97fa640 1 -- 10.20.193.28:0/3930908665 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f93e80df880 con 0x7f93fc104940 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 -- 10.20.193.28:0/3506617 shutdown_connections 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 --2- 10.20.193.28:0/3506617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d58286c560 0x55d58286e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 --2- 10.20.193.28:0/3506617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 0x55d58286bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 --2- 10.20.193.28:0/3506617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582867280 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 -- 10.20.193.28:0/3506617 >> 10.20.193.28:0/3506617 conn(0x55d58285e6f0 msgr2=0x55d582865570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f93fbfff640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93d00b0e20 0x7f93d00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 -- 10.20.193.28:0/3506617 shutdown_connections 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f9405417e00 1 -- 10.20.193.28:0/3506617 wait complete. 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.650+0000 7f93fbfff640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93d00b0e20 0x7f93d00b32e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f93e80a45e0 tx=0x7f93e80047e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 -- start start 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 Processor -- start 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d582866e80 0x55d58287f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 0x55d58287ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d58286c560 0x55d582886eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d58275f0c0 con 0x55d58286c560 2026-02-20T03:36:15.662 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d58286f660 con 0x55d5828677c0 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d582887440 con 0x55d582866e80 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9400b29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d58286c560 0x55d582886eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9400b29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d58286c560 0x55d582886eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40504/0 (socket says 10.20.193.28:40504) 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9400b29640 1 -- 10.20.193.28:0/2610809940 learned_addr learned my addr 10.20.193.28:0/2610809940 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9400b29640 1 -- 10.20.193.28:0/2610809940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d582866e80 msgr2=0x55d58287f9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9400b29640 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d582866e80 0x55d58287f9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9400b29640 1 -- 10.20.193.28:0/2610809940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 msgr2=0x55d58287ff30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9400b29640 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 0x55d58287ff30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9400b29640 1 -- 10.20.193.28:0/2610809940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d582879130 con 0x55d58286c560 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9400b29640 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d58286c560 0x55d582886eb0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f93f000bfd0 tx=0x7f93f0012640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ba8a2832a06930 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f93bd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2610809940 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0017040 con 0x55d58286c560 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2610809940 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f93f0004950 con 0x55d58286c560 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2610809940 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f001d470 con 0x55d58286c560 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 -- 10.20.193.28:0/2610809940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d582773820 con 0x55d58286c560 2026-02-20T03:36:15.663 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2610809940 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f93f001d610 con 0x55d58286c560 2026-02-20T03:36:15.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f93bd7fa640 10 client.21372 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:36:15.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 10 client.21372 _ll_register_callbacks cb 0x55d582762ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:15.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 -- 10.20.193.28:0/2610809940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d5827bf4e0 con 0x55d58286c560 2026-02-20T03:36:15.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2610809940 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f93f0006e60 con 0x55d58286c560 2026-02-20T03:36:15.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 10 client.21372 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:15.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 -- 10.20.193.28:0/2610809940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55d582778380 con 0x55d58286c560 2026-02-20T03:36:15.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2610809940 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f93f00126b0 con 0x55d58286c560 2026-02-20T03:36:15.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 10 client.21372 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:15.664 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 10 client.21372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:15.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 20 client.21372 populate_metadata read hostname 'trial028' 2026-02-20T03:36:15.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d58288b570 0x55d58288da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 4 client.21372 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:15.669 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.653+0000 7f9405417e00 1 -- 10.20.193.28:0/2610809940 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d582739bd0 con 0x55d58288b570 2026-02-20T03:36:15.682 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.680+0000 7f93fb7fe640 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d58288b570 0x55d58288da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:15.709 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:15 trial028 ceph-mon[38552]: pgmap v833: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 116 KiB/s rd, 81 KiB/s wr, 156 op/s 2026-02-20T03:36:15.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.33 MB/sec execute 346 sec latency 40720.913 ms 2026-02-20T03:36:15.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.747+0000 7f93fb7fe640 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d58288b570 0x55d58288da00 crc :-1 s=READY pgs=549 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14c437a86933a729 server_cookie=4f3d2aa83483a470 in_seq=0 out_seq=0 2026-02-20T03:36:15.749 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.747+0000 7f93bd7fa640 10 client.21372 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:15.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.759+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2610809940 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d582739bd0 con 0x55d58288b570 2026-02-20T03:36:15.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.759+0000 7f93bd7fa640 10 client.21372 handle_command_reply: tid=0 2026-02-20T03:36:15.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.759+0000 7f9405417e00 1 client.21372 shutdown 2026-02-20T03:36:15.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 -- 10.20.193.28:0/2610809940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d58286c560 msgr2=0x55d582886eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:15.763 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d58286c560 0x55d582886eb0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f93f000bfd0 tx=0x7f93f0012640 comp rx=0 tx=0).stop 2026-02-20T03:36:15.770 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 -- 10.20.193.28:0/2610809940 shutdown_connections 2026-02-20T03:36:15.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d58288b570 0x55d58288da00 crc :-1 s=READY pgs=549 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d58286c560 0x55d582886eb0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 0x55d58287ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.771 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 --2- 10.20.193.28:0/2610809940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d582866e80 0x55d58287f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f93bd7fa640 0 client.21372 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:15.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 -- 10.20.193.28:0/2610809940 >> 10.20.193.28:0/2610809940 conn(0x55d58285e6f0 msgr2=0x55d58286d910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:15.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 -- 10.20.193.28:0/2610809940 shutdown_connections 2026-02-20T03:36:15.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 1 -- 10.20.193.28:0/2610809940 wait complete. 2026-02-20T03:36:15.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.760+0000 7f9405417e00 20 client.21372 trim_cache size 0 max 16384 2026-02-20T03:36:15.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 Processor -- start 2026-02-20T03:36:15.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- start start 2026-02-20T03:36:15.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d582866e80 0x55d582888130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5828677c0 0x55d5828922e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d58286c560 0x55d582886e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f93a0012710 con 0x55d5828677c0 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000ff20 con 0x55d58286c560 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000dd70 con 0x55d582866e80 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93fb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5828677c0 0x55d5828922e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93fb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5828677c0 0x55d5828922e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40508/0 (socket says 10.20.193.28:40508) 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93fb7fe640 1 -- 10.20.193.28:0/698406484 learned_addr learned my addr 10.20.193.28:0/698406484 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93fb7fe640 1 -- 10.20.193.28:0/698406484 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d582866e80 msgr2=0x55d582888130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93fb7fe640 1 --2- 10.20.193.28:0/698406484 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d582866e80 0x55d582888130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93fb7fe640 1 -- 10.20.193.28:0/698406484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d58286c560 msgr2=0x55d582886e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93fb7fe640 1 --2- 10.20.193.28:0/698406484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d58286c560 0x55d582886e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.775 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93fb7fe640 1 -- 10.20.193.28:0/698406484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d582878f60 con 0x55d5828677c0 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93fb7fe640 1 --2- 10.20.193.28:0/698406484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5828677c0 0x55d5828922e0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009a30 tx=0x7f93ec02f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f336ee1569de087 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93bf7fe640 1 -- 10.20.193.28:0/698406484 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec0026e0 con 0x55d5828677c0 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93bf7fe640 1 -- 10.20.193.28:0/698406484 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f93ec033040 con 0x55d5828677c0 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93bf7fe640 1 -- 10.20.193.28:0/698406484 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec038790 con 0x55d5828677c0 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- 10.20.193.28:0/698406484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5828677c0 msgr2=0x55d5828922e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- 10.20.193.28:0/698406484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5828677c0 0x55d5828922e0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009a30 tx=0x7f93ec02f900 comp rx=0 tx=0).stop 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- 10.20.193.28:0/698406484 shutdown_connections 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- 10.20.193.28:0/698406484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d58286c560 0x55d582886e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- 10.20.193.28:0/698406484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d5828677c0 0x55d5828922e0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.776 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- 10.20.193.28:0/698406484 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d582866e80 0x55d582888130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- 10.20.193.28:0/698406484 >> 10.20.193.28:0/698406484 conn(0x55d58285e6f0 msgr2=0x55d582867ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:15.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- 10.20.193.28:0/698406484 shutdown_connections 2026-02-20T03:36:15.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- 10.20.193.28:0/698406484 wait complete. 2026-02-20T03:36:15.779 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- start start 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 Processor -- start 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582884a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 0x55d582884fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d58286c560 0x55d582885ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000e3e0 con 0x55d582866e80 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000f850 con 0x55d5828677c0 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f93a000eab0 con 0x55d58286c560 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9400b29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582884a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9400b29640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582884a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40524/0 (socket says 10.20.193.28:40524) 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9400b29640 1 -- 10.20.193.28:0/2264009922 learned_addr learned my addr 10.20.193.28:0/2264009922 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:15.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9400b29640 1 -- 10.20.193.28:0/2264009922 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d58286c560 msgr2=0x55d582885ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9400b29640 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d58286c560 0x55d582885ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9400b29640 1 -- 10.20.193.28:0/2264009922 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 msgr2=0x55d582884fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9400b29640 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 0x55d582884fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9400b29640 1 -- 10.20.193.28:0/2264009922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58287dd20 con 0x55d582866e80 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9400b29640 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582884a80 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f93f0015040 tx=0x7f93f0002c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a5cd5002011b56 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93bd7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2264009922 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0035020 con 0x55d582866e80 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2264009922 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f93f0002e50 con 0x55d582866e80 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2264009922 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f0017040 con 0x55d582866e80 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.766+0000 7f9405417e00 1 -- 10.20.193.28:0/2264009922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d582517690 con 0x55d582866e80 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2264009922 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f93f001db90 con 0x55d582866e80 2026-02-20T03:36:15.781 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 10 client.21378 _ll_register_callbacks cb 0x7f93f00099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 1 -- 10.20.193.28:0/2264009922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93f000bd50 con 0x55d582866e80 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2264009922 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f93f001d470 con 0x55d582866e80 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 10 client.21378 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 1 -- 10.20.193.28:0/2264009922 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55d58277cb70 con 0x55d582866e80 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2264009922 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f93f0042060 con 0x55d582866e80 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 10 client.21378 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 10 client.21378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 20 client.21378 populate_metadata read hostname 'trial028' 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5828f6c10 0x55d5828f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 4 client.21378 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:36:15.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.771+0000 7f9405417e00 1 -- 10.20.193.28:0/2264009922 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d582590520 con 0x55d5828f6c10 2026-02-20T03:36:15.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.787+0000 7f93fb7fe640 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5828f6c10 0x55d5828f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:15.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:15 trial126 ceph-mon[38476]: pgmap v833: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 116 KiB/s rd, 81 KiB/s wr, 156 op/s 2026-02-20T03:36:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.854+0000 7f93fb7fe640 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5828f6c10 0x55d5828f90d0 crc :-1 s=READY pgs=550 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f18e1c838bd4c32 server_cookie=3ee8f68be581ac4c in_seq=0 out_seq=0 2026-02-20T03:36:15.856 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:15.854+0000 7f93bd7fa640 10 client.21378 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:15.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:15 trial177 ceph-mon[43181]: pgmap v833: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 116 KiB/s rd, 81 KiB/s wr, 156 op/s 2026-02-20T03:36:16.050 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f93bd7fa640 1 -- 10.20.193.28:0/2264009922 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d582590520 con 0x55d5828f6c10 2026-02-20T03:36:16.050 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f93bd7fa640 10 client.21378 handle_command_reply: tid=0 2026-02-20T03:36:16.050 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 client.21378 shutdown 2026-02-20T03:36:16.050 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 -- 10.20.193.28:0/2264009922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 msgr2=0x55d582884a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:16.050 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582884a80 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f93f0015040 tx=0x7f93f0002c10 comp rx=0 tx=0).stop 2026-02-20T03:36:16.051 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 -- 10.20.193.28:0/2264009922 shutdown_connections 2026-02-20T03:36:16.051 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d5828f6c10 0x55d5828f90d0 crc :-1 s=READY pgs=550 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:16.051 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d58286c560 0x55d582885ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:16.051 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d5828677c0 0x55d582884fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:16.052 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 --2- 10.20.193.28:0/2264009922 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d582866e80 0x55d582884a80 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:16.052 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f93bd7fa640 0 client.21378 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:16.052 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 -- 10.20.193.28:0/2264009922 >> 10.20.193.28:0/2264009922 conn(0x55d58285e6f0 msgr2=0x55d582868700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:16.052 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 -- 10.20.193.28:0/2264009922 shutdown_connections 2026-02-20T03:36:16.052 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 1 -- 10.20.193.28:0/2264009922 wait complete. 2026-02-20T03:36:16.052 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.047+0000 7f9405417e00 20 client.21378 trim_cache size 0 max 16384 2026-02-20T03:36:16.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:36:16.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:36:16.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:36:16.063 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:36:16.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 -- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93d00b0e20 msgr2=0x7f93d00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:16.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93d00b0e20 0x7f93d00b32e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f93e80a45e0 tx=0x7f93e80047e0 comp rx=0 tx=0).stop 2026-02-20T03:36:16.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 -- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc104940 msgr2=0x7f93fc19cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:16.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc104940 0x7f93fc19cbc0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f93e800b750 tx=0x7f93e800bc20 comp rx=0 tx=0).stop 2026-02-20T03:36:16.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 -- 10.20.193.28:0/3930908665 shutdown_connections 2026-02-20T03:36:16.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f93d00b0e20 0x7f93d00b32e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:16.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f93fc1064f0 0x7f93fc1a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:16.064 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f93fc105b30 0x7f93fc19d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:16.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 --2- 10.20.193.28:0/3930908665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f93fc104940 0x7f93fc19cbc0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:16.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 -- 10.20.193.28:0/3930908665 >> 10.20.193.28:0/3930908665 conn(0x7f93fc1000c0 msgr2=0x7f93fc108fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:16.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 -- 10.20.193.28:0/3930908665 shutdown_connections 2026-02-20T03:36:16.065 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:16.049+0000 7f940132a640 1 -- 10.20.193.28:0/3930908665 wait complete. 2026-02-20T03:36:16.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.27 MB/sec execute 347 sec latency 41720.964 ms 2026-02-20T03:36:17.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.22 MB/sec execute 348 sec latency 42721.008 ms 2026-02-20T03:36:17.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:17 trial126 ceph-mon[38476]: pgmap v834: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 130 KiB/s rd, 65 KiB/s wr, 164 op/s 2026-02-20T03:36:17.846 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:17 trial028 ceph-mon[38552]: pgmap v834: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 130 KiB/s rd, 65 KiB/s wr, 164 op/s 2026-02-20T03:36:17.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:17 trial177 ceph-mon[43181]: pgmap v834: 129 pgs: 129 active+clean; 749 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 130 KiB/s rd, 65 KiB/s wr, 164 op/s 2026-02-20T03:36:18.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.16 MB/sec execute 349 sec latency 43721.058 ms 2026-02-20T03:36:19.714 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:19 trial028 ceph-mon[38552]: pgmap v835: 129 pgs: 129 active+clean; 747 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 115 KiB/s rd, 73 KiB/s wr, 129 op/s 2026-02-20T03:36:19.727 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.11 MB/sec execute 350 sec latency 44721.111 ms 2026-02-20T03:36:19.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:19 trial177 ceph-mon[43181]: pgmap v835: 129 pgs: 129 active+clean; 747 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 115 KiB/s rd, 73 KiB/s wr, 129 op/s 2026-02-20T03:36:20.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:19 trial126 ceph-mon[38476]: pgmap v835: 129 pgs: 129 active+clean; 747 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 115 KiB/s rd, 73 KiB/s wr, 129 op/s 2026-02-20T03:36:20.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.05 MB/sec execute 351 sec latency 45721.165 ms 2026-02-20T03:36:20.793 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:20 trial028 ceph-mon[38552]: pgmap v836: 129 pgs: 129 active+clean; 740 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 140 KiB/s rd, 109 KiB/s wr, 126 op/s 2026-02-20T03:36:20.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:20 trial177 ceph-mon[43181]: pgmap v836: 129 pgs: 129 active+clean; 740 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 140 KiB/s rd, 109 KiB/s wr, 126 op/s 2026-02-20T03:36:21.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:20 trial126 ceph-mon[38476]: pgmap v836: 129 pgs: 129 active+clean; 740 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 140 KiB/s rd, 109 KiB/s wr, 126 op/s 2026-02-20T03:36:21.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 19.00 MB/sec execute 352 sec latency 46721.197 ms 2026-02-20T03:36:22.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 18.94 MB/sec execute 353 sec latency 47721.230 ms 2026-02-20T03:36:23.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:23 trial028 ceph-mon[38552]: pgmap v837: 129 pgs: 129 active+clean; 737 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 138 KiB/s rd, 109 KiB/s wr, 122 op/s 2026-02-20T03:36:23.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:23 trial177 ceph-mon[43181]: pgmap v837: 129 pgs: 129 active+clean; 737 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 138 KiB/s rd, 109 KiB/s wr, 122 op/s 2026-02-20T03:36:23.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 18.89 MB/sec execute 354 sec latency 48721.255 ms 2026-02-20T03:36:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:23 trial126 ceph-mon[38476]: pgmap v837: 129 pgs: 129 active+clean; 737 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 138 KiB/s rd, 109 KiB/s wr, 122 op/s 2026-02-20T03:36:24.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184816 18.84 MB/sec execute 355 sec latency 49721.305 ms 2026-02-20T03:36:25.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:25 trial028 ceph-mon[38552]: pgmap v838: 129 pgs: 129 active+clean; 737 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 140 KiB/s rd, 110 KiB/s wr, 123 op/s 2026-02-20T03:36:25.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:25 trial177 ceph-mon[43181]: pgmap v838: 129 pgs: 129 active+clean; 737 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 140 KiB/s rd, 110 KiB/s wr, 123 op/s 2026-02-20T03:36:25.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184817 18.79 MB/sec execute 356 sec latency 50721.345 ms 2026-02-20T03:36:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:25 trial126 ceph-mon[38476]: pgmap v838: 129 pgs: 129 active+clean; 737 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 140 KiB/s rd, 110 KiB/s wr, 123 op/s 2026-02-20T03:36:26.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.73 MB/sec execute 357 sec latency 51721.383 ms 2026-02-20T03:36:27.477 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:27 trial028 ceph-mon[38552]: pgmap v839: 129 pgs: 129 active+clean; 737 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 123 KiB/s rd, 97 KiB/s wr, 107 op/s 2026-02-20T03:36:27.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:27 trial177 ceph-mon[43181]: pgmap v839: 129 pgs: 129 active+clean; 737 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 123 KiB/s rd, 97 KiB/s wr, 107 op/s 2026-02-20T03:36:27.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.68 MB/sec execute 358 sec latency 52721.425 ms 2026-02-20T03:36:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:27 trial126 ceph-mon[38476]: pgmap v839: 129 pgs: 129 active+clean; 737 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 123 KiB/s rd, 97 KiB/s wr, 107 op/s 2026-02-20T03:36:28.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:28 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:36:28.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:28 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:36:28.546 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:28 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:36:28.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:28 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:36:28.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:28 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:36:28.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:28 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:36:28.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.63 MB/sec execute 359 sec latency 53721.476 ms 2026-02-20T03:36:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:28 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:36:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:28 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:36:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:28 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:36:29.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- 10.20.193.28:0/701312083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a4410a900 msgr2=0x7f4a44111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:29.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 --2- 10.20.193.28:0/701312083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a4410a900 0x7f4a44111480 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000b0a0 tx=0x7f4a4002f450 comp rx=0 tx=0).stop 2026-02-20T03:36:29.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- 10.20.193.28:0/701312083 shutdown_connections 2026-02-20T03:36:29.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 --2- 10.20.193.28:0/701312083 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a4410a900 0x7f4a44111480 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 --2- 10.20.193.28:0/701312083 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a44109e60 0x7f4a4410a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 --2- 10.20.193.28:0/701312083 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a44109490 0x7f4a44109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- 10.20.193.28:0/701312083 >> 10.20.193.28:0/701312083 conn(0x7f4a44077fe0 msgr2=0x7f4a4407a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- 10.20.193.28:0/701312083 shutdown_connections 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- 10.20.193.28:0/701312083 wait complete. 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 Processor -- start 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- start start 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a44109490 0x7f4a441a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a44109e60 0x7f4a441a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a4410a900 0x7f4a441a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4a44114a50 con 0x7f4a44109e60 2026-02-20T03:36:29.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4a441148d0 con 0x7f4a44109490 2026-02-20T03:36:29.130 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4a44114bd0 con 0x7f4a4410a900 2026-02-20T03:36:29.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a48c4e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a44109e60 0x7f4a441a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:29.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a48c4e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a44109e60 0x7f4a441a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40954/0 (socket says 10.20.193.28:40954) 2026-02-20T03:36:29.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a48c4e640 1 -- 10.20.193.28:0/3360688653 learned_addr learned my addr 10.20.193.28:0/3360688653 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:29.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a48c4e640 1 -- 10.20.193.28:0/3360688653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a4410a900 msgr2=0x7f4a441a85c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:29.135 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a4410a900 0x7f4a441a85c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a48c4e640 1 -- 10.20.193.28:0/3360688653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a44109490 msgr2=0x7f4a441a1010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a44109490 0x7f4a441a1010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a48c4e640 1 -- 10.20.193.28:0/3360688653 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a441a8cc0 con 0x7f4a44109e60 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a44109e60 0x7f4a441a1550 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800b570 tx=0x7f4a3800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a327fc640 1 -- 10.20.193.28:0/3360688653 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38013020 con 0x7f4a44109e60 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a327fc640 1 -- 10.20.193.28:0/3360688653 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4a38004480 con 0x7f4a44109e60 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a327fc640 1 -- 10.20.193.28:0/3360688653 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3800fb50 con 0x7f4a44109e60 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- 10.20.193.28:0/3360688653 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a441a8fb0 con 0x7f4a44109e60 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.124+0000 7f4a4a451640 1 -- 10.20.193.28:0/3360688653 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a441a9490 con 0x7f4a44109e60 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.130+0000 7f4a327fc640 1 -- 10.20.193.28:0/3360688653 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4a38002780 con 0x7f4a44109e60 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.130+0000 7f4a327fc640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a200b0da0 0x7f4a200b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.130+0000 7f4a327fc640 1 -- 10.20.193.28:0/3360688653 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4a380e05c0 con 0x7f4a44109e60 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.130+0000 7f4a4944f640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a200b0da0 0x7f4a200b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 Processor -- start 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4944f640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a200b0da0 0x7f4a200b3260 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4a4407b6a0 tx=0x7f4a34006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- start start 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654c9e80 0x55a3654ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.136 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654cf560 0x55a3654d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a36541a8f0 con 0x55a3654ca7c0 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a3653c82e0 con 0x55a3654cf560 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a365416820 con 0x55a3654c9e80 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40970/0 (socket says 10.20.193.28:40970) 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1256077676 learned_addr learned my addr 10.20.193.28:0/1256077676 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1256077676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654c9e80 msgr2=0x55a3654ca280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/1256077676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654c9e80 0x55a3654ca280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1256077676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654cf560 msgr2=0x55a3654d19f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/1256077676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654cf560 0x55a3654d19f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1256077676 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3653ba5a0 con 0x55a3654ca7c0 2026-02-20T03:36:29.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/1256077676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654cef40 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f4a380a40d0 tx=0x7f4a3801f300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9289df54eb93d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:29.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a117fe640 1 -- 10.20.193.28:0/1256077676 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380ac650 con 0x55a3654ca7c0 2026-02-20T03:36:29.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a117fe640 1 -- 10.20.193.28:0/1256077676 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4a380b1500 con 0x55a3654ca7c0 2026-02-20T03:36:29.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a117fe640 1 -- 10.20.193.28:0/1256077676 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380a72b0 con 0x55a3654ca7c0 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1256077676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 msgr2=0x55a3654cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1256077676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654cef40 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f4a380a40d0 tx=0x7f4a3801f300 comp rx=0 tx=0).stop 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1256077676 shutdown_connections 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1256077676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654cf560 0x55a3654d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1256077676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654cef40 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1256077676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654c9e80 0x55a3654ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1256077676 >> 10.20.193.28:0/1256077676 conn(0x55a3654c16f0 msgr2=0x55a3654c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1256077676 shutdown_connections 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1256077676 wait complete. 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- start start 2026-02-20T03:36:29.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 Processor -- start 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654c9e80 0x55a3654e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654cf560 0x55a3654e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a3653c20c0 con 0x55a3654ca7c0 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a3654d2610 con 0x55a3654c9e80 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a3654ea4a0 con 0x55a3654cf560 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40974/0 (socket says 10.20.193.28:40974) 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1641343263 learned_addr learned my addr 10.20.193.28:0/1641343263 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1641343263 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654cf560 msgr2=0x55a3654e9f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654cf560 0x55a3654e9f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1641343263 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654c9e80 msgr2=0x55a3654e2a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:29.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654c9e80 0x55a3654e2a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1641343263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3654dc1a0 con 0x55a3654ca7c0 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e2f90 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800b540 tx=0x7f4a380a4640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c88eeba51e233e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f49fe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1641343263 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380ce070 con 0x55a3654ca7c0 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1641343263 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4a380a4350 con 0x55a3654ca7c0 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1641343263 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38005a70 con 0x55a3654ca7c0 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1641343263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3653d6820 con 0x55a3654ca7c0 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1641343263 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4a38005c10 con 0x55a3654ca7c0 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f49fe7fc640 10 client.21390 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 10 client.21390 _ll_register_callbacks cb 0x55a3653c5ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:29.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1641343263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3654224e0 con 0x55a3654ca7c0 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1641343263 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f4a38005e10 con 0x55a3654ca7c0 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 10 client.21390 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1641343263 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55a3653db380 con 0x55a3654ca7c0 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1641343263 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f4a380a39c0 con 0x55a3654ca7c0 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 10 client.21390 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 10 client.21390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 20 client.21390 populate_metadata read hostname 'trial028' 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a3654ee1a0 0x55a3654f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 4 client.21390 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:29.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.132+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1641343263 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a36539cbd0 con 0x55a3654ee1a0 2026-02-20T03:36:29.162 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.159+0000 7f4a4944f640 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a3654ee1a0 0x55a3654f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:29.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.226+0000 7f49fe7fc640 10 client.21390 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:29.229 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.226+0000 7f4a4944f640 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a3654ee1a0 0x55a3654f05b0 crc :-1 s=READY pgs=551 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f7742803f827394 server_cookie=810d30f00ddd454b in_seq=0 out_seq=0 2026-02-20T03:36:29.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.239+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1641343263 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a36539cbd0 con 0x55a3654ee1a0 2026-02-20T03:36:29.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.239+0000 7f49fe7fc640 10 client.21390 handle_command_reply: tid=0 2026-02-20T03:36:29.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 client.21390 shutdown 2026-02-20T03:36:29.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1641343263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 msgr2=0x55a3654e2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:29.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e2f90 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800b540 tx=0x7f4a380a4640 comp rx=0 tx=0).stop 2026-02-20T03:36:29.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1641343263 shutdown_connections 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a3654ee1a0 0x55a3654f05b0 crc :-1 s=READY pgs=551 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654cf560 0x55a3654e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e2f90 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1641343263 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654c9e80 0x55a3654e2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1641343263 >> 10.20.193.28:0/1641343263 conn(0x55a3654c16f0 msgr2=0x55a3654d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f49fe7fc640 0 client.21390 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1641343263 shutdown_connections 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1641343263 wait complete. 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.240+0000 7f4a4e617e00 20 client.21390 trim_cache size 0 max 16384 2026-02-20T03:36:29.251 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 Processor -- start 2026-02-20T03:36:29.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- start start 2026-02-20T03:36:29.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654c9e80 0x55a3654e3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654ca7c0 0x55a3654e9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654cf560 0x55a3654cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.253 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49e80126c0 con 0x55a3654c9e80 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f49e800fed0 con 0x55a3654ca7c0 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f49e800dd20 con 0x55a3654cf560 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4944f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654c9e80 0x55a3654e3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4944f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654c9e80 0x55a3654e3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40990/0 (socket says 10.20.193.28:40990) 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4944f640 1 -- 10.20.193.28:0/2631618244 learned_addr learned my addr 10.20.193.28:0/2631618244 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4944f640 1 -- 10.20.193.28:0/2631618244 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654cf560 msgr2=0x55a3654cbbb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4944f640 1 --2- 10.20.193.28:0/2631618244 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654cf560 0x55a3654cbbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4944f640 1 -- 10.20.193.28:0/2631618244 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654ca7c0 msgr2=0x55a3654e9ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4944f640 1 --2- 10.20.193.28:0/2631618244 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654ca7c0 0x55a3654e9ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4944f640 1 -- 10.20.193.28:0/2631618244 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3654dbfd0 con 0x55a3654c9e80 2026-02-20T03:36:29.254 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4944f640 1 --2- 10.20.193.28:0/2631618244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654c9e80 0x55a3654e3060 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x55a3654e2100 tx=0x7f4a3400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b12a8b87fbce4e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a10ffd640 1 -- 10.20.193.28:0/2631618244 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a34002a80 con 0x55a3654c9e80 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a10ffd640 1 -- 10.20.193.28:0/2631618244 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4a34002c20 con 0x55a3654c9e80 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a10ffd640 1 -- 10.20.193.28:0/2631618244 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a340138a0 con 0x55a3654c9e80 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- 10.20.193.28:0/2631618244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654c9e80 msgr2=0x55a3654e3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/2631618244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654c9e80 0x55a3654e3060 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x55a3654e2100 tx=0x7f4a3400f000 comp rx=0 tx=0).stop 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- 10.20.193.28:0/2631618244 shutdown_connections 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/2631618244 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654cf560 0x55a3654cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/2631618244 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654ca7c0 0x55a3654e9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/2631618244 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654c9e80 0x55a3654e3060 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.255 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- 10.20.193.28:0/2631618244 >> 10.20.193.28:0/2631618244 conn(0x55a3654c16f0 msgr2=0x55a3654e2950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:29.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- 10.20.193.28:0/2631618244 shutdown_connections 2026-02-20T03:36:29.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- 10.20.193.28:0/2631618244 wait complete. 2026-02-20T03:36:29.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- start start 2026-02-20T03:36:29.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 Processor -- start 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654c9e80 0x55a3654e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654cf560 0x55a3654e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f49e800e390 con 0x55a3654ca7c0 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f49e800f800 con 0x55a3654cf560 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f49e800ea60 con 0x55a3654c9e80 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a48c4e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a48c4e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40992/0 (socket says 10.20.193.28:40992) 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1532894003 learned_addr learned my addr 10.20.193.28:0/1532894003 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1532894003 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654c9e80 msgr2=0x55a3654e7b60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654c9e80 0x55a3654e7b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1532894003 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654cf560 msgr2=0x55a3654e90d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654cf560 0x55a3654e90d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a48c4e640 1 -- 10.20.193.28:0/1532894003 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36517a690 con 0x55a3654ca7c0 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a48c4e640 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e80a0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f4a380a4080 tx=0x7f4a380a77c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886c033334de5d38 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f49fe7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1532894003 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380ce040 con 0x55a3654ca7c0 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1532894003 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55a3654224e0 con 0x55a3654ca7c0 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1532894003 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a380a7080 con 0x55a3654ca7c0 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.246+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1532894003 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3653dfb70 con 0x55a3654ca7c0 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1532894003 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4a3806e1f0 con 0x55a3654ca7c0 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 10 client.21396 _ll_register_callbacks cb 0x7f4a380ac670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:29.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1532894003 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a380b1500 con 0x55a3654ca7c0 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1532894003 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f4a380a7590 con 0x55a3654ca7c0 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 10 client.21396 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1532894003 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55a3654dccc0 con 0x55a3654ca7c0 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1532894003 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f4a38005a70 con 0x55a3654ca7c0 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 10 client.21396 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 10 client.21396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 20 client.21396 populate_metadata read hostname 'trial028' 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a365559590 0x55a36555ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 4 client.21396 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:36:29.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.251+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1532894003 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3653eb6b0 con 0x55a365559590 2026-02-20T03:36:29.269 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.266+0000 7f4a4944f640 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a365559590 0x55a36555ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:29.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.333+0000 7f4a4944f640 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a365559590 0x55a36555ba20 crc :-1 s=READY pgs=552 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ac34e50ad897a1d server_cookie=f0a5ac37d708392b in_seq=0 out_seq=0 2026-02-20T03:36:29.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.333+0000 7f49fe7fc640 10 client.21396 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:29.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.442+0000 7f49fe7fc640 1 -- 10.20.193.28:0/1532894003 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3653eb6b0 con 0x55a365559590 2026-02-20T03:36:29.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f49fe7fc640 10 client.21396 handle_command_reply: tid=0 2026-02-20T03:36:29.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 client.21396 shutdown 2026-02-20T03:36:29.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1532894003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 msgr2=0x55a3654e80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:29.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e80a0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f4a380a4080 tx=0x7f4a380a77c0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.447 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1532894003 shutdown_connections 2026-02-20T03:36:29.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a365559590 0x55a36555ba20 crc :-1 s=READY pgs=552 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a3654cf560 0x55a3654e90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a3654ca7c0 0x55a3654e80a0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 --2- 10.20.193.28:0/1532894003 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a3654c9e80 0x55a3654e7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f49fe7fc640 0 client.21396 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:29.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1532894003 >> 10.20.193.28:0/1532894003 conn(0x55a3654c16f0 msgr2=0x55a3654caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:29.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1532894003 shutdown_connections 2026-02-20T03:36:29.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 1 -- 10.20.193.28:0/1532894003 wait complete. 2026-02-20T03:36:29.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4e617e00 20 client.21396 trim_cache size 0 max 16384 2026-02-20T03:36:29.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:36:29.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:36:29.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:36:29.459 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:36:29.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 -- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a200b0da0 msgr2=0x7f4a200b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:29.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a200b0da0 0x7f4a200b3260 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f4a4407b6a0 tx=0x7f4a34006cd0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 -- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a44109e60 msgr2=0x7f4a441a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:29.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a44109e60 0x7f4a441a1550 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800b570 tx=0x7f4a3800ba40 comp rx=0 tx=0).stop 2026-02-20T03:36:29.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 -- 10.20.193.28:0/3360688653 shutdown_connections 2026-02-20T03:36:29.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4a200b0da0 0x7f4a200b3260 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4a4410a900 0x7f4a441a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.460 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4a44109e60 0x7f4a441a1550 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 --2- 10.20.193.28:0/3360688653 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4a44109490 0x7f4a441a1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:29.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 -- 10.20.193.28:0/3360688653 >> 10.20.193.28:0/3360688653 conn(0x7f4a44077fe0 msgr2=0x7f4a4410d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:29.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 -- 10.20.193.28:0/3360688653 shutdown_connections 2026-02-20T03:36:29.461 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:29.443+0000 7f4a4a451640 1 -- 10.20.193.28:0/3360688653 wait complete. 2026-02-20T03:36:29.629 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:29 trial028 ceph-mon[38552]: pgmap v840: 129 pgs: 129 active+clean; 736 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 91 KiB/s rd, 97 KiB/s wr, 76 op/s 2026-02-20T03:36:29.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:29 trial177 ceph-mon[43181]: pgmap v840: 129 pgs: 129 active+clean; 736 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 91 KiB/s rd, 97 KiB/s wr, 76 op/s 2026-02-20T03:36:29.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.58 MB/sec execute 360 sec latency 54721.557 ms 2026-02-20T03:36:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:29 trial126 ceph-mon[38476]: pgmap v840: 129 pgs: 129 active+clean; 736 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 91 KiB/s rd, 97 KiB/s wr, 76 op/s 2026-02-20T03:36:30.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.52 MB/sec execute 361 sec latency 55721.600 ms 2026-02-20T03:36:31.597 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:31 trial028 ceph-mon[38552]: pgmap v841: 129 pgs: 129 active+clean; 734 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 101 KiB/s rd, 114 KiB/s wr, 57 op/s 2026-02-20T03:36:31.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:31 trial177 ceph-mon[43181]: pgmap v841: 129 pgs: 129 active+clean; 734 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 101 KiB/s rd, 114 KiB/s wr, 57 op/s 2026-02-20T03:36:31.721 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.47 MB/sec execute 362 sec latency 56721.675 ms 2026-02-20T03:36:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:31 trial126 ceph-mon[38476]: pgmap v841: 129 pgs: 129 active+clean; 734 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 101 KiB/s rd, 114 KiB/s wr, 57 op/s 2026-02-20T03:36:32.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.42 MB/sec execute 363 sec latency 57721.716 ms 2026-02-20T03:36:33.563 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:33 trial028 ceph-mon[38552]: pgmap v842: 129 pgs: 129 active+clean; 723 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 31 KiB/s wr, 47 op/s 2026-02-20T03:36:33.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.37 MB/sec execute 364 sec latency 58721.760 ms 2026-02-20T03:36:33.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:33 trial126 ceph-mon[38476]: pgmap v842: 129 pgs: 129 active+clean; 723 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 31 KiB/s wr, 47 op/s 2026-02-20T03:36:33.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:33 trial177 ceph-mon[43181]: pgmap v842: 129 pgs: 129 active+clean; 723 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 28 KiB/s rd, 31 KiB/s wr, 47 op/s 2026-02-20T03:36:34.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.32 MB/sec execute 365 sec latency 59721.814 ms 2026-02-20T03:36:35.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:35 trial028 ceph-mon[38552]: pgmap v843: 129 pgs: 129 active+clean; 708 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 259 KiB/s rd, 320 KiB/s wr, 67 op/s 2026-02-20T03:36:35.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.27 MB/sec execute 366 sec latency 60721.860 ms 2026-02-20T03:36:35.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:35 trial126 ceph-mon[38476]: pgmap v843: 129 pgs: 129 active+clean; 708 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 259 KiB/s rd, 320 KiB/s wr, 67 op/s 2026-02-20T03:36:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:35 trial177 ceph-mon[43181]: pgmap v843: 129 pgs: 129 active+clean; 708 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 259 KiB/s rd, 320 KiB/s wr, 67 op/s 2026-02-20T03:36:36.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.22 MB/sec execute 367 sec latency 61721.894 ms 2026-02-20T03:36:37.567 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:37 trial028 ceph-mon[38552]: pgmap v844: 129 pgs: 129 active+clean; 671 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 258 KiB/s rd, 319 KiB/s wr, 106 op/s 2026-02-20T03:36:37.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.17 MB/sec execute 368 sec latency 62721.928 ms 2026-02-20T03:36:37.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:37 trial126 ceph-mon[38476]: pgmap v844: 129 pgs: 129 active+clean; 671 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 258 KiB/s rd, 319 KiB/s wr, 106 op/s 2026-02-20T03:36:37.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:37 trial177 ceph-mon[43181]: pgmap v844: 129 pgs: 129 active+clean; 671 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 258 KiB/s rd, 319 KiB/s wr, 106 op/s 2026-02-20T03:36:38.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.12 MB/sec execute 369 sec latency 63721.966 ms 2026-02-20T03:36:39.690 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:39 trial028 ceph-mon[38552]: pgmap v845: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 257 KiB/s rd, 319 KiB/s wr, 119 op/s 2026-02-20T03:36:39.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.07 MB/sec execute 370 sec latency 64722.000 ms 2026-02-20T03:36:39.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:39 trial126 ceph-mon[38476]: pgmap v845: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 257 KiB/s rd, 319 KiB/s wr, 119 op/s 2026-02-20T03:36:39.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:39 trial177 ceph-mon[43181]: pgmap v845: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 257 KiB/s rd, 319 KiB/s wr, 119 op/s 2026-02-20T03:36:40.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 18.03 MB/sec execute 371 sec latency 65722.052 ms 2026-02-20T03:36:41.572 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:41 trial028 ceph-mon[38552]: pgmap v846: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 318 KiB/s rd, 321 KiB/s wr, 122 op/s 2026-02-20T03:36:41.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 17.98 MB/sec execute 372 sec latency 66722.092 ms 2026-02-20T03:36:41.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:41 trial126 ceph-mon[38476]: pgmap v846: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 318 KiB/s rd, 321 KiB/s wr, 122 op/s 2026-02-20T03:36:41.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:41 trial177 ceph-mon[43181]: pgmap v846: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 318 KiB/s rd, 321 KiB/s wr, 122 op/s 2026-02-20T03:36:42.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- 10.20.193.28:0/3988994224 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c104f10 msgr2=0x7f828c10cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:42.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 --2- 10.20.193.28:0/3988994224 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c104f10 0x7f828c10cd80 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f828800b0a0 tx=0x7f828802f450 comp rx=0 tx=0).stop 2026-02-20T03:36:42.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- 10.20.193.28:0/3988994224 shutdown_connections 2026-02-20T03:36:42.525 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 --2- 10.20.193.28:0/3988994224 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c104f10 0x7f828c10cd80 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 --2- 10.20.193.28:0/3988994224 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f828c104550 0x7f828c1049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 --2- 10.20.193.28:0/3988994224 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f828c106020 0x7f828c106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.526 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- 10.20.193.28:0/3988994224 >> 10.20.193.28:0/3988994224 conn(0x7f828c1000e0 msgr2=0x7f828c102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- 10.20.193.28:0/3988994224 shutdown_connections 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- 10.20.193.28:0/3988994224 wait complete. 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 Processor -- start 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- start start 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f828c104550 0x7f828c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f828c104f10 0x7f828c19d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c106020 0x7f828c1a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f828c110650 con 0x7f828c106020 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f828c1104d0 con 0x7f828c104550 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f828c1107d0 con 0x7f828c104f10 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f82923ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c106020 0x7f828c1a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f82923ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c106020 0x7f828c1a41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59988/0 (socket says 10.20.193.28:59988) 2026-02-20T03:36:42.527 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f82923ce640 1 -- 10.20.193.28:0/376406679 learned_addr learned my addr 10.20.193.28:0/376406679 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:42.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f82923ce640 1 -- 10.20.193.28:0/376406679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f828c104f10 msgr2=0x7f828c19d170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:42.533 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f82923ce640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f828c104f10 0x7f828c19d170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f82923ce640 1 -- 10.20.193.28:0/376406679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f828c104550 msgr2=0x7f828c19cc30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f82923ce640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f828c104550 0x7f828c19cc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f82923ce640 1 -- 10.20.193.28:0/376406679 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828c1a48d0 con 0x7f828c106020 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f82923ce640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c106020 0x7f828c1a41a0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f828800b1d0 tx=0x7f8288004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f827affd640 1 -- 10.20.193.28:0/376406679 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288004d40 con 0x7f828c106020 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f827affd640 1 -- 10.20.193.28:0/376406679 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f82880078c0 con 0x7f828c106020 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f827affd640 1 -- 10.20.193.28:0/376406679 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288005380 con 0x7f828c106020 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.522+0000 7f8292bcf640 1 -- 10.20.193.28:0/376406679 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828c1a4b60 con 0x7f828c106020 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f8292bcf640 1 -- 10.20.193.28:0/376406679 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f828c1a5000 con 0x7f828c106020 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f827affd640 1 -- 10.20.193.28:0/376406679 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8288007a70 con 0x7f828c106020 2026-02-20T03:36:42.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f8296cc1e00 1 Processor -- start 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f8296cc1e00 1 -- start start 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3944280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b39447c0 0x5592b3948f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 0x5592b394b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592b38948f0 con 0x5592b3943e80 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5592b38422e0 con 0x5592b3949560 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5592b3890820 con 0x5592b39447c0 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f82913cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3944280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f82913cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3944280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59996/0 (socket says 10.20.193.28:59996) 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f82913cc640 1 -- 10.20.193.28:0/2853779089 learned_addr learned my addr 10.20.193.28:0/2853779089 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:42.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f82913cc640 1 -- 10.20.193.28:0/2853779089 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b39447c0 msgr2=0x5592b3948f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f82913cc640 1 --2- 10.20.193.28:0/2853779089 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b39447c0 0x5592b3948f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f82913cc640 1 -- 10.20.193.28:0/2853779089 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 msgr2=0x5592b394b9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f82913cc640 1 --2- 10.20.193.28:0/2853779089 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 0x5592b394b9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f82913cc640 1 -- 10.20.193.28:0/2853779089 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b38345a0 con 0x5592b3943e80 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f827affd640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82680b0e20 0x7f82680b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.525+0000 7f82913cc640 1 --2- 10.20.193.28:0/2853779089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3944280 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f82800098c0 tx=0x7f8280009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6179e3018ca0807 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f827affd640 1 -- 10.20.193.28:0/376406679 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f82881059e0 con 0x7f828c106020 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8259bfe640 1 -- 10.20.193.28:0/2853779089 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280016070 con 0x5592b3943e80 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8259bfe640 1 -- 10.20.193.28:0/2853779089 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f828000bd70 con 0x5592b3943e80 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8259bfe640 1 -- 10.20.193.28:0/2853779089 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280011400 con 0x5592b3943e80 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8291bcd640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82680b0e20 0x7f82680b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:42.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- 10.20.193.28:0/2853779089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 msgr2=0x5592b3944280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:42.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/2853779089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3944280 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f82800098c0 tx=0x7f8280009d90 comp rx=0 tx=0).stop 2026-02-20T03:36:42.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- 10.20.193.28:0/2853779089 shutdown_connections 2026-02-20T03:36:42.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/2853779089 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 0x5592b394b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/2853779089 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b39447c0 0x5592b3948f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/2853779089 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3944280 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- 10.20.193.28:0/2853779089 >> 10.20.193.28:0/2853779089 conn(0x5592b393b6f0 msgr2=0x5592b3942570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:42.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- 10.20.193.28:0/2853779089 shutdown_connections 2026-02-20T03:36:42.540 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8291bcd640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82680b0e20 0x7f82680b32e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x5592b3944eb0 tx=0x7f827c006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- 10.20.193.28:0/2853779089 wait complete. 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- start start 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 Processor -- start 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3943e80 0x5592b395cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b395d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 0x5592b3963f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592b383c0c0 con 0x5592b39447c0 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5592b394c660 con 0x5592b3949560 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5592b3964520 con 0x5592b3943e80 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f82913cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b395d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f82913cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b395d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:59998/0 (socket says 10.20.193.28:59998) 2026-02-20T03:36:42.541 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f82913cc640 1 -- 10.20.193.28:0/3759121680 learned_addr learned my addr 10.20.193.28:0/3759121680 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f82913cc640 1 -- 10.20.193.28:0/3759121680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3943e80 msgr2=0x5592b395cad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f82913cc640 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3943e80 0x5592b395cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f82913cc640 1 -- 10.20.193.28:0/3759121680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 msgr2=0x5592b3963f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f82913cc640 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 0x5592b3963f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f82913cc640 1 -- 10.20.193.28:0/3759121680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b3956220 con 0x5592b39447c0 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f82913cc640 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b395d010 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f8280006be0 tx=0x7f82800029b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cfa5c43ddcef64 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8246ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8246ffd640 1 -- 10.20.193.28:0/3759121680 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280020020 con 0x5592b39447c0 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8246ffd640 1 -- 10.20.193.28:0/3759121680 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8280004390 con 0x5592b39447c0 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8246ffd640 1 -- 10.20.193.28:0/3759121680 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280016040 con 0x5592b39447c0 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- 10.20.193.28:0/3759121680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b3850820 con 0x5592b39447c0 2026-02-20T03:36:42.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8246ffd640 1 -- 10.20.193.28:0/3759121680 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8280011660 con 0x5592b39447c0 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 10 client.21408 _ll_register_callbacks cb 0x5592b383fff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- 10.20.193.28:0/3759121680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5592b389c4e0 con 0x5592b39447c0 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8246ffd640 1 -- 10.20.193.28:0/3759121680 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f828001c9e0 con 0x5592b39447c0 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 10 client.21408 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- 10.20.193.28:0/3759121680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5592b3855380 con 0x5592b39447c0 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8246ffd640 1 -- 10.20.193.28:0/3759121680 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f8280019030 con 0x5592b39447c0 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 10 client.21408 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 10 client.21408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 20 client.21408 populate_metadata read hostname 'trial028' 2026-02-20T03:36:42.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592b3968600 0x5592b396aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 4 client.21408 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:42.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.529+0000 7f8296cc1e00 1 -- 10.20.193.28:0/3759121680 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592b3816bd0 con 0x5592b3968600 2026-02-20T03:36:42.559 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.556+0000 7f8291bcd640 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592b3968600 0x5592b396aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:42.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.623+0000 7f8291bcd640 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592b3968600 0x5592b396aa70 crc :-1 s=READY pgs=553 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51f4183798f816b server_cookie=31f4652280669a03 in_seq=0 out_seq=0 2026-02-20T03:36:42.626 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.623+0000 7f8246ffd640 10 client.21408 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:42.639 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8246ffd640 1 -- 10.20.193.28:0/3759121680 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5592b3816bd0 con 0x5592b3968600 2026-02-20T03:36:42.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8246ffd640 10 client.21408 handle_command_reply: tid=0 2026-02-20T03:36:42.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 client.21408 shutdown 2026-02-20T03:36:42.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 -- 10.20.193.28:0/3759121680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 msgr2=0x5592b395d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:42.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b395d010 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f8280006be0 tx=0x7f82800029b0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 -- 10.20.193.28:0/3759121680 shutdown_connections 2026-02-20T03:36:42.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592b3968600 0x5592b396aa70 crc :-1 s=READY pgs=553 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 0x5592b3963f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b395d010 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.640 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/3759121680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3943e80 0x5592b395cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 -- 10.20.193.28:0/3759121680 >> 10.20.193.28:0/3759121680 conn(0x5592b393b6f0 msgr2=0x5592b394a910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:42.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8246ffd640 0 client.21408 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:42.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 -- 10.20.193.28:0/3759121680 shutdown_connections 2026-02-20T03:36:42.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 1 -- 10.20.193.28:0/3759121680 wait complete. 2026-02-20T03:36:42.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.636+0000 7f8296cc1e00 20 client.21408 trim_cache size 0 max 16384 2026-02-20T03:36:42.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 Processor -- start 2026-02-20T03:36:42.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- start start 2026-02-20T03:36:42.649 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3943e80 0x5592b395cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b3963f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 0x5592b395c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8238012760 con 0x5592b39447c0 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f823800ff70 con 0x5592b3949560 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f823800ddc0 con 0x5592b3943e80 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82913cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b3963f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82913cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b3963f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60006/0 (socket says 10.20.193.28:60006) 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82913cc640 1 -- 10.20.193.28:0/476999164 learned_addr learned my addr 10.20.193.28:0/476999164 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82913cc640 1 -- 10.20.193.28:0/476999164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3943e80 msgr2=0x5592b395cb50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82913cc640 1 --2- 10.20.193.28:0/476999164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3943e80 0x5592b395cb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.650 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82913cc640 1 -- 10.20.193.28:0/476999164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 msgr2=0x5592b395c210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82913cc640 1 --2- 10.20.193.28:0/476999164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 0x5592b395c210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82913cc640 1 -- 10.20.193.28:0/476999164 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b3956050 con 0x5592b39447c0 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82913cc640 1 --2- 10.20.193.28:0/476999164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b3963f50 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f828000bd40 tx=0x7f8280027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b7dbd774a79647 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82593fd640 1 -- 10.20.193.28:0/476999164 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280016040 con 0x5592b39447c0 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82593fd640 1 -- 10.20.193.28:0/476999164 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5592b389c4e0 con 0x5592b39447c0 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f82593fd640 1 -- 10.20.193.28:0/476999164 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280020040 con 0x5592b39447c0 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- 10.20.193.28:0/476999164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 msgr2=0x5592b3963f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/476999164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b3963f50 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f828000bd40 tx=0x7f8280027000 comp rx=0 tx=0).stop 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- 10.20.193.28:0/476999164 shutdown_connections 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/476999164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b3949560 0x5592b395c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.651 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/476999164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b39447c0 0x5592b3963f50 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.652 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/476999164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3943e80 0x5592b395cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- 10.20.193.28:0/476999164 >> 10.20.193.28:0/476999164 conn(0x5592b393b6f0 msgr2=0x5592b3942570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- 10.20.193.28:0/476999164 shutdown_connections 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- 10.20.193.28:0/476999164 wait complete. 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- start start 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 Processor -- start 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3961d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b39447c0 0x5592b39622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3949560 0x5592b39632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f823800e430 con 0x5592b3943e80 2026-02-20T03:36:42.655 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f823800f8a0 con 0x5592b39447c0 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8296cc1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f823800eb00 con 0x5592b3949560 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8291bcd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3961d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8291bcd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3961d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60014/0 (socket says 10.20.193.28:60014) 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8291bcd640 1 -- 10.20.193.28:0/382493270 learned_addr learned my addr 10.20.193.28:0/382493270 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8291bcd640 1 -- 10.20.193.28:0/382493270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3949560 msgr2=0x5592b39632e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8291bcd640 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3949560 0x5592b39632e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8291bcd640 1 -- 10.20.193.28:0/382493270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b39447c0 msgr2=0x5592b39622b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8291bcd640 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b39447c0 0x5592b39622b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.642+0000 7f8291bcd640 1 -- 10.20.193.28:0/382493270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b35f4690 con 0x5592b3943e80 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8291bcd640 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3961d70 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f828c105990 tx=0x7f827c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586cb3aa2f5d9016 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:42.656 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8246ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8246ffd640 1 -- 10.20.193.28:0/382493270 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c00b730 con 0x5592b3943e80 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8246ffd640 1 -- 10.20.193.28:0/382493270 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f827c00bd70 con 0x5592b3943e80 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8246ffd640 1 -- 10.20.193.28:0/382493270 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c013dd0 con 0x5592b3943e80 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 1 -- 10.20.193.28:0/382493270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b3859b70 con 0x5592b3943e80 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8246ffd640 1 -- 10.20.193.28:0/382493270 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f827c028420 con 0x5592b3943e80 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 10 client.21414 _ll_register_callbacks cb 0x7f828000bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 1 -- 10.20.193.28:0/382493270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f828000bd70 con 0x5592b3943e80 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8246ffd640 1 -- 10.20.193.28:0/382493270 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f827c0134a0 con 0x5592b3943e80 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 10 client.21414 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 1 -- 10.20.193.28:0/382493270 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5592b3956d40 con 0x5592b3943e80 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8246ffd640 1 -- 10.20.193.28:0/382493270 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f827c00b8d0 con 0x5592b3943e80 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 10 client.21414 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:42.657 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 10 client.21414 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:42.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 20 client.21414 populate_metadata read hostname 'trial028' 2026-02-20T03:36:42.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592b39d4320 0x5592b39d67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:42.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 4 client.21414 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:36:42.658 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.647+0000 7f8296cc1e00 1 -- 10.20.193.28:0/382493270 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5592b38656b0 con 0x5592b39d4320 2026-02-20T03:36:42.665 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.663+0000 7f82913cc640 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592b39d4320 0x5592b39d67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:42.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 17.93 MB/sec execute 373 sec latency 67722.128 ms 2026-02-20T03:36:42.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.730+0000 7f82913cc640 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592b39d4320 0x5592b39d67e0 crc :-1 s=READY pgs=554 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc240ca575011d7 server_cookie=ce3d0fc95cbe10c9 in_seq=0 out_seq=0 2026-02-20T03:36:42.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.730+0000 7f8246ffd640 10 client.21414 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:42.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8246ffd640 1 -- 10.20.193.28:0/382493270 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5592b38656b0 con 0x5592b39d4320 2026-02-20T03:36:42.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8246ffd640 10 client.21414 handle_command_reply: tid=0 2026-02-20T03:36:42.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 client.21414 shutdown 2026-02-20T03:36:42.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 -- 10.20.193.28:0/382493270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 msgr2=0x5592b3961d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:42.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3961d70 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f828c105990 tx=0x7f827c0047e0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 -- 10.20.193.28:0/382493270 shutdown_connections 2026-02-20T03:36:42.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592b39d4320 0x5592b39d67e0 crc :-1 s=READY pgs=554 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592b3949560 0x5592b39632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592b39447c0 0x5592b39622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 --2- 10.20.193.28:0/382493270 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592b3943e80 0x5592b3961d70 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 -- 10.20.193.28:0/382493270 >> 10.20.193.28:0/382493270 conn(0x5592b393b6f0 msgr2=0x5592b395b200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:42.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8246ffd640 0 client.21414 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:42.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 -- 10.20.193.28:0/382493270 shutdown_connections 2026-02-20T03:36:42.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 1 -- 10.20.193.28:0/382493270 wait complete. 2026-02-20T03:36:42.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8296cc1e00 20 client.21414 trim_cache size 0 max 16384 2026-02-20T03:36:42.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:36:42.840 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:36:42.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:36:42.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:36:42.841 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 -- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82680b0e20 msgr2=0x7f82680b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:42.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82680b0e20 0x7f82680b32e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x5592b3944eb0 tx=0x7f827c006cd0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 -- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c106020 msgr2=0x7f828c1a41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:42.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c106020 0x7f828c1a41a0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f828800b1d0 tx=0x7f8288004360 comp rx=0 tx=0).stop 2026-02-20T03:36:42.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 -- 10.20.193.28:0/376406679 shutdown_connections 2026-02-20T03:36:42.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f82680b0e20 0x7f82680b32e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f828c106020 0x7f828c1a41a0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f828c104f10 0x7f828c19d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 --2- 10.20.193.28:0/376406679 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f828c104550 0x7f828c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:42.842 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 -- 10.20.193.28:0/376406679 >> 10.20.193.28:0/376406679 conn(0x7f828c1000e0 msgr2=0x7f828c108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:42.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 -- 10.20.193.28:0/376406679 shutdown_connections 2026-02-20T03:36:42.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:42.824+0000 7f8292bcf640 1 -- 10.20.193.28:0/376406679 wait complete. 2026-02-20T03:36:43.429 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:36:43.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 17.88 MB/sec execute 374 sec latency 68722.161 ms 2026-02-20T03:36:43.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:43 trial028 ceph-mon[38552]: pgmap v847: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 293 KiB/s rd, 294 KiB/s wr, 113 op/s 2026-02-20T03:36:43.737 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:43 trial126 ceph-mon[38476]: pgmap v847: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 293 KiB/s rd, 294 KiB/s wr, 113 op/s 2026-02-20T03:36:43.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:43 trial177 ceph-mon[43181]: pgmap v847: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 293 KiB/s rd, 294 KiB/s wr, 113 op/s 2026-02-20T03:36:43.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 -- 10.20.193.28:0/2480479668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 msgr2=0x7fa6cc109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:43.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/2480479668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 0x7fa6cc109660 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009a30 tx=0x7fa6c002f260 comp rx=0 tx=0).stop 2026-02-20T03:36:43.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 -- 10.20.193.28:0/2480479668 shutdown_connections 2026-02-20T03:36:43.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/2480479668 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6cc109ba0 0x7fa6cc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/2480479668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 0x7fa6cc109660 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/2480479668 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6cc10eef0 0x7fa6cc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 -- 10.20.193.28:0/2480479668 >> 10.20.193.28:0/2480479668 conn(0x7fa6cc078600 msgr2=0x7fa6cc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:43.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 -- 10.20.193.28:0/2480479668 shutdown_connections 2026-02-20T03:36:43.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 -- 10.20.193.28:0/2480479668 wait complete. 2026-02-20T03:36:43.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.975+0000 7fa6d2b33640 1 Processor -- start 2026-02-20T03:36:43.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d2b33640 1 -- start start 2026-02-20T03:36:43.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d2b33640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 0x7fa6cc1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d2b33640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6cc109ba0 0x7fa6cc1a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d2b33640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6cc10eef0 0x7fa6cc1a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d2b33640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1191b0 con 0x7fa6cc109220 2026-02-20T03:36:43.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d2b33640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc119030 con 0x7fa6cc10eef0 2026-02-20T03:36:43.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d2b33640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc119330 con 0x7fa6cc109ba0 2026-02-20T03:36:43.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d1b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 0x7fa6cc1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:43.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d1b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 0x7fa6cc1a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60028/0 (socket says 10.20.193.28:60028) 2026-02-20T03:36:43.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d1b31640 1 -- 10.20.193.28:0/1243635647 learned_addr learned my addr 10.20.193.28:0/1243635647 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:43.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d1b31640 1 -- 10.20.193.28:0/1243635647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6cc109ba0 msgr2=0x7fa6cc1a1bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:43.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6cc109ba0 0x7fa6cc1a1bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d1b31640 1 -- 10.20.193.28:0/1243635647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6cc10eef0 msgr2=0x7fa6cc1a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:43.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6cc10eef0 0x7fa6cc1a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d1b31640 1 -- 10.20.193.28:0/1243635647 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc1a66c0 con 0x7fa6cc109220 2026-02-20T03:36:43.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 0x7fa6cc1a1670 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00b570 tx=0x7fa6bc00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:43.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6baffd640 1 -- 10.20.193.28:0/1243635647 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc013020 con 0x7fa6cc109220 2026-02-20T03:36:43.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6baffd640 1 -- 10.20.193.28:0/1243635647 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa6bc004480 con 0x7fa6cc109220 2026-02-20T03:36:43.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6baffd640 1 -- 10.20.193.28:0/1243635647 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00fb50 con 0x7fa6cc109220 2026-02-20T03:36:43.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.979+0000 7fa6d2b33640 1 -- 10.20.193.28:0/1243635647 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6cc1a69b0 con 0x7fa6cc109220 2026-02-20T03:36:43.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.980+0000 7fa6d2b33640 1 -- 10.20.193.28:0/1243635647 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6cc1ae1f0 con 0x7fa6cc109220 2026-02-20T03:36:43.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.980+0000 7fa6baffd640 1 -- 10.20.193.28:0/1243635647 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa6bc002780 con 0x7fa6cc109220 2026-02-20T03:36:43.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.980+0000 7fa6d62c1e00 1 Processor -- start 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 -- start start 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015fdf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9630 0x561015fd9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015fe5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561015f59e50 con 0x561015fd9fb0 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561015f2c9c0 con 0x561015fd9630 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561015eda240 con 0x561015fdf000 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d1330640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015fe5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d1330640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015fe5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60042/0 (socket says 10.20.193.28:60042) 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d1330640 1 -- 10.20.193.28:0/1413932329 learned_addr learned my addr 10.20.193.28:0/1413932329 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6baffd640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a80b0da0 0x7fa6a80b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6baffd640 1 -- 10.20.193.28:0/1243635647 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa6bc0e0410 con 0x7fa6cc109220 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d1330640 1 -- 10.20.193.28:0/1413932329 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 msgr2=0x561015fdf3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d1330640 1 --2- 10.20.193.28:0/1413932329 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015fdf3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d1330640 1 -- 10.20.193.28:0/1413932329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9630 msgr2=0x561015fd9a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d1330640 1 --2- 10.20.193.28:0/1413932329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9630 0x561015fd9a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d2332640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a80b0da0 0x7fa6a80b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d1330640 1 -- 10.20.193.28:0/1413932329 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561015eed420 con 0x561015fd9fb0 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d1330640 1 --2- 10.20.193.28:0/1413932329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015fe5e30 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fa6c002f770 tx=0x7fa6c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b24891c2af293a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d2332640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a80b0da0 0x7fa6a80b3260 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800aae0 tx=0x7fa6c8009230 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa69a4e6640 1 -- 10.20.193.28:0/1413932329 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00384f0 con 0x561015fd9fb0 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa69a4e6640 1 -- 10.20.193.28:0/1413932329 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa6c0033040 con 0x561015fd9fb0 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa69a4e6640 1 -- 10.20.193.28:0/1413932329 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0004320 con 0x561015fd9fb0 2026-02-20T03:36:43.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1413932329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 msgr2=0x561015fe5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1413932329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015fe5e30 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fa6c002f770 tx=0x7fa6c0005880 comp rx=0 tx=0).stop 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1413932329 shutdown_connections 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1413932329 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015fe5e30 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1413932329 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9630 0x561015fd9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1413932329 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015fdf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1413932329 >> 10.20.193.28:0/1413932329 conn(0x561015f9c290 msgr2=0x561015fd7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1413932329 shutdown_connections 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.984+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1413932329 wait complete. 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 -- start start 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 Processor -- start 2026-02-20T03:36:43.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9fb0 0x561015ff4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015ff23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x561015f288f0 con 0x561015fd9630 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x561015d1af50 con 0x561015fd9fb0 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561015ff29f0 con 0x561015fdf000 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d1b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d1b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60054/0 (socket says 10.20.193.28:60054) 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d1b31640 1 -- 10.20.193.28:0/3231550743 learned_addr learned my addr 10.20.193.28:0/3231550743 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d1b31640 1 -- 10.20.193.28:0/3231550743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 msgr2=0x561015ff23b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015ff23b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d1b31640 1 -- 10.20.193.28:0/3231550743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9fb0 msgr2=0x561015ff4140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:43.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9fb0 0x561015ff4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:43.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d1b31640 1 -- 10.20.193.28:0/3231550743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561015febb20 con 0x561015fd9630 2026-02-20T03:36:43.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff3c00 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00b540 tx=0x7fa6bc0a7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d61283eb5ae3f00 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:44.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6877fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:44.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6877fe640 1 -- 10.20.193.28:0/3231550743 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0e0170 con 0x561015fd9630 2026-02-20T03:36:44.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6877fe640 1 -- 10.20.193.28:0/3231550743 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa6bc0ac120 con 0x561015fd9630 2026-02-20T03:36:44.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6877fe640 1 -- 10.20.193.28:0/3231550743 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0a3c90 con 0x561015fd9630 2026-02-20T03:36:44.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3231550743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561015cfdb40 con 0x561015fd9630 2026-02-20T03:36:44.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6877fe640 1 -- 10.20.193.28:0/3231550743 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa6bc0a6ef0 con 0x561015fd9630 2026-02-20T03:36:44.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6877fe640 10 client.21426 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:36:44.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 10 client.21426 _ll_register_callbacks cb 0x561015f65f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:44.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3231550743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561015f3a1a0 con 0x561015fd9630 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6877fe640 1 -- 10.20.193.28:0/3231550743 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa6bc0ac2d0 con 0x561015fd9630 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 10 client.21426 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3231550743 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x561015ee7230 con 0x561015fd9630 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6877fe640 1 -- 10.20.193.28:0/3231550743 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fa6bc0a7200 con 0x561015fd9630 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 10 client.21426 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 10 client.21426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 20 client.21426 populate_metadata read hostname 'trial028' 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5610160025a0 0x561016004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 4 client.21426 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:44.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:43.987+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3231550743 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561015f345b0 con 0x5610160025a0 2026-02-20T03:36:44.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.014+0000 7fa6d1330640 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5610160025a0 0x561016004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:44.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.067+0000 7fa6d1330640 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5610160025a0 0x561016004990 crc :-1 s=READY pgs=555 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2120ff747642d8cf server_cookie=2fb5afcec37c7313 in_seq=0 out_seq=0 2026-02-20T03:36:44.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.067+0000 7fa6877fe640 10 client.21426 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:44.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6877fe640 1 -- 10.20.193.28:0/3231550743 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x561015f345b0 con 0x5610160025a0 2026-02-20T03:36:44.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6877fe640 10 client.21426 handle_command_reply: tid=0 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 client.21426 shutdown 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3231550743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 msgr2=0x561015ff3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff3c00 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00b540 tx=0x7fa6bc0a7800 comp rx=0 tx=0).stop 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3231550743 shutdown_connections 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5610160025a0 0x561016004990 crc :-1 s=READY pgs=555 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015ff23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9fb0 0x561015ff4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3231550743 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff3c00 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6877fe640 0 client.21426 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3231550743 >> 10.20.193.28:0/3231550743 conn(0x561015f9c290 msgr2=0x561015fd8440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3231550743 shutdown_connections 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3231550743 wait complete. 2026-02-20T03:36:44.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.094+0000 7fa6d62c1e00 20 client.21426 trim_cache size 0 max 16384 2026-02-20T03:36:44.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d62c1e00 1 Processor -- start 2026-02-20T03:36:44.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d62c1e00 1 -- start start 2026-02-20T03:36:44.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9fb0 0x561015ff1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015fef900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa6780127b0 con 0x561015fd9630 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa67800ffc0 con 0x561015fd9fb0 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa67800de10 con 0x561015fdf000 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d1b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d1b31640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60058/0 (socket says 10.20.193.28:60058) 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d1b31640 1 -- 10.20.193.28:0/3957604866 learned_addr learned my addr 10.20.193.28:0/3957604866 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d1b31640 1 -- 10.20.193.28:0/3957604866 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 msgr2=0x561015fef900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/3957604866 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015fef900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d1b31640 1 -- 10.20.193.28:0/3957604866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9fb0 msgr2=0x561015ff1150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/3957604866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9fb0 0x561015ff1150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.100+0000 7fa6d1b31640 1 -- 10.20.193.28:0/3957604866 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561015feb950 con 0x561015fd9630 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/3957604866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff0c10 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0a7ea0 tx=0x7fa6bc090030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a19582e8373a55d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa699ce5640 1 -- 10.20.193.28:0/3957604866 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0a78f0 con 0x561015fd9630 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa699ce5640 1 -- 10.20.193.28:0/3957604866 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x561015f3a1a0 con 0x561015fd9630 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa699ce5640 1 -- 10.20.193.28:0/3957604866 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0a6c70 con 0x561015fd9630 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3957604866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 msgr2=0x561015ff0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3957604866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff0c10 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0a7ea0 tx=0x7fa6bc090030 comp rx=0 tx=0).stop 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3957604866 shutdown_connections 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3957604866 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015fef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3957604866 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9fb0 0x561015ff1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/3957604866 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9630 0x561015ff0c10 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3957604866 >> 10.20.193.28:0/3957604866 conn(0x561015f9c290 msgr2=0x561015ff3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3957604866 shutdown_connections 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/3957604866 wait complete. 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 -- start start 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 Processor -- start 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9630 0x561015ff6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015ff7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015ff7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa67800e480 con 0x561015fd9fb0 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa67800f8f0 con 0x561015fd9630 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d62c1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa67800eb50 con 0x561015fdf000 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d1330640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015ff7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d1330640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015ff7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60060/0 (socket says 10.20.193.28:60060) 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.105+0000 7fa6d1330640 1 -- 10.20.193.28:0/1792228247 learned_addr learned my addr 10.20.193.28:0/1792228247 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d1330640 1 -- 10.20.193.28:0/1792228247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 msgr2=0x561015ff7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d1330640 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015ff7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d1330640 1 -- 10.20.193.28:0/1792228247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9630 msgr2=0x561015ff6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d1330640 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9630 0x561015ff6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d1330640 1 -- 10.20.193.28:0/1792228247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561015c0b870 con 0x561015fd9fb0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d1330640 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015ff7010 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0005d20 tx=0x7fa6c0005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d5cb0f42b81494 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6877fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6877fe640 1 -- 10.20.193.28:0/1792228247 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c002fac0 con 0x561015fd9fb0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6877fe640 1 -- 10.20.193.28:0/1792228247 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa6c002fc60 con 0x561015fd9fb0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6877fe640 1 -- 10.20.193.28:0/1792228247 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0038790 con 0x561015fd9fb0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1792228247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561015ecc440 con 0x561015fd9fb0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6877fe640 1 -- 10.20.193.28:0/1792228247 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa6c0038930 con 0x561015fd9fb0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 10 client.21432 _ll_register_callbacks cb 0x7fa6bc00f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1792228247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561015edeb00 con 0x561015fd9fb0 2026-02-20T03:36:44.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6877fe640 1 -- 10.20.193.28:0/1792228247 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa6c00040d0 con 0x561015fd9fb0 2026-02-20T03:36:44.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 10 client.21432 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:44.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1792228247 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x561015fec640 con 0x561015fd9fb0 2026-02-20T03:36:44.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6877fe640 1 -- 10.20.193.28:0/1792228247 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fa6c00026e0 con 0x561015fd9fb0 2026-02-20T03:36:44.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 10 client.21432 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:44.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 10 client.21432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:44.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 20 client.21432 populate_metadata read hostname 'trial028' 2026-02-20T03:36:44.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56101606e600 0x561016070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 4 client.21432 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:36:44.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.107+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1792228247 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fa6c0033040 con 0x56101606e600 2026-02-20T03:36:44.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.135+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56101606e600 0x561016070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:44.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.201+0000 7fa6d1b31640 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56101606e600 0x561016070ac0 crc :-1 s=READY pgs=556 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cefad5402fcc48 server_cookie=54de8157e482c917 in_seq=0 out_seq=0 2026-02-20T03:36:44.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.201+0000 7fa6877fe640 10 client.21432 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:44.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6877fe640 1 -- 10.20.193.28:0/1792228247 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fa6c0033040 con 0x56101606e600 2026-02-20T03:36:44.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6877fe640 10 client.21432 handle_command_reply: tid=0 2026-02-20T03:36:44.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 client.21432 shutdown 2026-02-20T03:36:44.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1792228247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 msgr2=0x561015ff7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:44.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015ff7010 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0005d20 tx=0x7fa6c0005950 comp rx=0 tx=0).stop 2026-02-20T03:36:44.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1792228247 shutdown_connections 2026-02-20T03:36:44.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56101606e600 0x561016070ac0 crc :-1 s=READY pgs=556 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561015fdf000 0x561015ff7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.219 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561015fd9fb0 0x561015ff7010 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 --2- 10.20.193.28:0/1792228247 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561015fd9630 0x561015ff6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1792228247 >> 10.20.193.28:0/1792228247 conn(0x561015f9c290 msgr2=0x561015ff0810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:44.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6877fe640 0 client.21432 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:44.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1792228247 shutdown_connections 2026-02-20T03:36:44.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 1 -- 10.20.193.28:0/1792228247 wait complete. 2026-02-20T03:36:44.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d62c1e00 20 client.21432 trim_cache size 0 max 16384 2026-02-20T03:36:44.220 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:36:44.220 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:36:44.221 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:36:44.221 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:36:44.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 -- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a80b0da0 msgr2=0x7fa6a80b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:44.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a80b0da0 0x7fa6a80b3260 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800aae0 tx=0x7fa6c8009230 comp rx=0 tx=0).stop 2026-02-20T03:36:44.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 -- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 msgr2=0x7fa6cc1a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:44.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 0x7fa6cc1a1670 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00b570 tx=0x7fa6bc00ba40 comp rx=0 tx=0).stop 2026-02-20T03:36:44.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 -- 10.20.193.28:0/1243635647 shutdown_connections 2026-02-20T03:36:44.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa6a80b0da0 0x7fa6a80b3260 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa6cc10eef0 0x7fa6cc1a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa6cc109ba0 0x7fa6cc1a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 --2- 10.20.193.28:0/1243635647 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa6cc109220 0x7fa6cc1a1670 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 -- 10.20.193.28:0/1243635647 >> 10.20.193.28:0/1243635647 conn(0x7fa6cc078600 msgr2=0x7fa6cc079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:44.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 -- 10.20.193.28:0/1243635647 shutdown_connections 2026-02-20T03:36:44.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.215+0000 7fa6d2b33640 1 -- 10.20.193.28:0/1243635647 wait complete. 2026-02-20T03:36:44.428 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:36:44.428 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:36:44.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 17.83 MB/sec execute 375 sec latency 69722.198 ms 2026-02-20T03:36:44.752 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:44.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.991+0000 7f62d1530640 1 -- 10.20.193.28:0/303118262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc107830 msgr2=0x7f62cc107c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:44.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.991+0000 7f62d1530640 1 --2- 10.20.193.28:0/303118262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc107830 0x7f62cc107c10 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f62b8009a30 tx=0x7f62b802f2f0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.991+0000 7f62d1530640 1 -- 10.20.193.28:0/303118262 shutdown_connections 2026-02-20T03:36:44.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.991+0000 7f62d1530640 1 --2- 10.20.193.28:0/303118262 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f62cc101100 0x7f62cc10f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.991+0000 7f62d1530640 1 --2- 10.20.193.28:0/303118262 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f62cc100780 0x7f62cc100bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.991+0000 7f62d1530640 1 --2- 10.20.193.28:0/303118262 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc107830 0x7f62cc107c10 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.991+0000 7f62d1530640 1 -- 10.20.193.28:0/303118262 >> 10.20.193.28:0/303118262 conn(0x7f62cc0fc5f0 msgr2=0x7f62cc0fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:44.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.991+0000 7f62d1530640 1 -- 10.20.193.28:0/303118262 shutdown_connections 2026-02-20T03:36:44.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.991+0000 7f62d1530640 1 -- 10.20.193.28:0/303118262 wait complete. 2026-02-20T03:36:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.992+0000 7f62d1530640 1 Processor -- start 2026-02-20T03:36:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.992+0000 7f62d1530640 1 -- start start 2026-02-20T03:36:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.992+0000 7f62d1530640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc100780 0x7f62cc19d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.992+0000 7f62d1530640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f62cc101100 0x7f62cc19d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.992+0000 7f62d1530640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f62cc107830 0x7f62cc1a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.992+0000 7f62d1530640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc112a40 con 0x7f62cc100780 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.992+0000 7f62d1530640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc1128c0 con 0x7f62cc101100 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.992+0000 7f62d1530640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f62cc112bc0 con 0x7f62cc107830 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.993+0000 7f62cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc100780 0x7f62cc19d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.993+0000 7f62cbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc100780 0x7f62cc19d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60084/0 (socket says 10.20.193.28:60084) 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.993+0000 7f62cbfff640 1 -- 10.20.193.28:0/2705857273 learned_addr learned my addr 10.20.193.28:0/2705857273 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.993+0000 7f62cbfff640 1 -- 10.20.193.28:0/2705857273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f62cc107830 msgr2=0x7f62cc1a1af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.993+0000 7f62cbfff640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f62cc107830 0x7f62cc1a1af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:44.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.993+0000 7f62cbfff640 1 -- 10.20.193.28:0/2705857273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f62cc101100 msgr2=0x7f62cc19d760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:44.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.993+0000 7f62cbfff640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f62cc101100 0x7f62cc19d760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.993+0000 7f62cbfff640 1 -- 10.20.193.28:0/2705857273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62cc1a2270 con 0x7f62cc100780 2026-02-20T03:36:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.993+0000 7f62cbfff640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc100780 0x7f62cc19d220 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f62b8002910 tx=0x7f62b8002940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.994+0000 7f62c97fa640 1 -- 10.20.193.28:0/2705857273 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8002c70 con 0x7f62cc100780 2026-02-20T03:36:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.994+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62cc1a2500 con 0x7f62cc100780 2026-02-20T03:36:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.994+0000 7f62c97fa640 1 -- 10.20.193.28:0/2705857273 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f62b80054d0 con 0x7f62cc100780 2026-02-20T03:36:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.994+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62cc1a9da0 con 0x7f62cc100780 2026-02-20T03:36:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.994+0000 7f62c97fa640 1 -- 10.20.193.28:0/2705857273 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b80386d0 con 0x7f62cc100780 2026-02-20T03:36:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.994+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62cc100c40 con 0x7f62cc100780 2026-02-20T03:36:45.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.995+0000 7f62c97fa640 1 -- 10.20.193.28:0/2705857273 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f62b80048e0 con 0x7f62cc100780 2026-02-20T03:36:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.998+0000 7f62c97fa640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f629c0b0e20 0x7f629c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.998+0000 7f62c97fa640 1 -- 10.20.193.28:0/2705857273 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f62b81054b0 con 0x7f62cc100780 2026-02-20T03:36:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.998+0000 7f62cb7fe640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f629c0b0e20 0x7f629c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.998+0000 7f62c97fa640 1 -- 10.20.193.28:0/2705857273 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f62b81059d0 con 0x7f62cc100780 2026-02-20T03:36:45.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:44.998+0000 7f62cb7fe640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f629c0b0e20 0x7f629c0b32e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f62cc1041e0 tx=0x7f62bc006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:45.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.106+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62cc19e580 con 0x7f62cc100780 2026-02-20T03:36:45.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.106+0000 7f62c97fa640 1 -- 10.20.193.28:0/2705857273 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11927 (secure 0 0 0) 0x7f62cc19e580 con 0x7f62cc100780 2026-02-20T03:36:45.110 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:36:45.111 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":48,"btime":"2026-02-20T03:35:09:352789+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:35:09.177379+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:36:45.112 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 48 2026-02-20T03:36:45.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f629c0b0e20 msgr2=0x7f629c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:45.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f629c0b0e20 0x7f629c0b32e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f62cc1041e0 tx=0x7f62bc006cd0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc100780 msgr2=0x7f62cc19d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:45.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc100780 0x7f62cc19d220 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f62b8002910 tx=0x7f62b8002940 comp rx=0 tx=0).stop 2026-02-20T03:36:45.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 shutdown_connections 2026-02-20T03:36:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f629c0b0e20 0x7f629c0b32e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f62cc107830 0x7f62cc1a1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f62cc101100 0x7f62cc19d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 --2- 10.20.193.28:0/2705857273 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f62cc100780 0x7f62cc19d220 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 >> 10.20.193.28:0/2705857273 conn(0x7f62cc0fc5f0 msgr2=0x7f62cc0fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 shutdown_connections 2026-02-20T03:36:45.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.107+0000 7f62d1530640 1 -- 10.20.193.28:0/2705857273 wait complete. 2026-02-20T03:36:45.269 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:36:45.580 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:45.593 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:45 trial028 ceph-mon[38552]: pgmap v848: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 295 KiB/s rd, 297 KiB/s wr, 98 op/s 2026-02-20T03:36:45.593 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:45 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2705857273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:36:45.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 17.79 MB/sec execute 376 sec latency 70722.232 ms 2026-02-20T03:36:45.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.833+0000 7ff93abbb640 1 -- 10.20.193.28:0/3174807456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109220 msgr2=0x7ff934109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:45.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.833+0000 7ff93abbb640 1 --2- 10.20.193.28:0/3174807456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109220 0x7ff934109660 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7ff928009a30 tx=0x7ff92802f260 comp rx=0 tx=0).stop 2026-02-20T03:36:45.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.834+0000 7ff93abbb640 1 -- 10.20.193.28:0/3174807456 shutdown_connections 2026-02-20T03:36:45.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.834+0000 7ff93abbb640 1 --2- 10.20.193.28:0/3174807456 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff934109ba0 0x7ff934115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.834+0000 7ff93abbb640 1 --2- 10.20.193.28:0/3174807456 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109220 0x7ff934109660 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.834+0000 7ff93abbb640 1 --2- 10.20.193.28:0/3174807456 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff93410eef0 0x7ff93410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.834+0000 7ff93abbb640 1 -- 10.20.193.28:0/3174807456 >> 10.20.193.28:0/3174807456 conn(0x7ff934078600 msgr2=0x7ff93407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:45.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.834+0000 7ff93abbb640 1 -- 10.20.193.28:0/3174807456 shutdown_connections 2026-02-20T03:36:45.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.834+0000 7ff93abbb640 1 -- 10.20.193.28:0/3174807456 wait complete. 2026-02-20T03:36:45.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.834+0000 7ff93abbb640 1 Processor -- start 2026-02-20T03:36:45.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.834+0000 7ff93abbb640 1 -- start start 2026-02-20T03:36:45.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff93abbb640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff934109220 0x7ff9341a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff93abbb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109ba0 0x7ff9341a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff93abbb640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff93410eef0 0x7ff9341a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff93abbb640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff9341191b0 con 0x7ff934109ba0 2026-02-20T03:36:45.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff93abbb640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff934119030 con 0x7ff934109220 2026-02-20T03:36:45.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff93abbb640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff934119330 con 0x7ff93410eef0 2026-02-20T03:36:45.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff9393b8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109ba0 0x7ff9341a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:45.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff9393b8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109ba0 0x7ff9341a1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60108/0 (socket says 10.20.193.28:60108) 2026-02-20T03:36:45.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff9393b8640 1 -- 10.20.193.28:0/256837481 learned_addr learned my addr 10.20.193.28:0/256837481 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:45.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff9393b8640 1 -- 10.20.193.28:0/256837481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff93410eef0 msgr2=0x7ff9341a5f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:45.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff9393b8640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff93410eef0 0x7ff9341a5f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff9393b8640 1 -- 10.20.193.28:0/256837481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff934109220 msgr2=0x7ff9341a1670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:45.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff9393b8640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff934109220 0x7ff9341a1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff9393b8640 1 -- 10.20.193.28:0/256837481 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9341a66c0 con 0x7ff934109ba0 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.835+0000 7ff9393b8640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109ba0 0x7ff9341a1bb0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7ff928002fa0 tx=0x7ff928002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.836+0000 7ff922ffd640 1 -- 10.20.193.28:0/256837481 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928004280 con 0x7ff934109ba0 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.836+0000 7ff922ffd640 1 -- 10.20.193.28:0/256837481 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff928004420 con 0x7ff934109ba0 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.836+0000 7ff93abbb640 1 -- 10.20.193.28:0/256837481 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9341a6950 con 0x7ff934109ba0 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.836+0000 7ff922ffd640 1 -- 10.20.193.28:0/256837481 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928038d20 con 0x7ff934109ba0 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.836+0000 7ff93abbb640 1 -- 10.20.193.28:0/256837481 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9341ae1f0 con 0x7ff934109ba0 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.838+0000 7ff93e349e00 1 Processor -- start 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.838+0000 7ff93e349e00 1 -- start start 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.838+0000 7ff922ffd640 1 -- 10.20.193.28:0/256837481 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff928005030 con 0x7ff934109ba0 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e411fb0 0x56369e412390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e40c5e0 0x56369e40ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40cf60 0x56369e418de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56369e38ce00 con 0x56369e40cf60 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56369e35f970 con 0x56369e40c5e0 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56369e30d1f0 con 0x56369e411fb0 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9393b8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40cf60 0x56369e418de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9393b8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40cf60 0x56369e418de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60124/0 (socket says 10.20.193.28:60124) 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9393b8640 1 -- 10.20.193.28:0/327159872 learned_addr learned my addr 10.20.193.28:0/327159872 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9393b8640 1 -- 10.20.193.28:0/327159872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e411fb0 msgr2=0x56369e412390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9393b8640 1 --2- 10.20.193.28:0/327159872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e411fb0 0x56369e412390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9393b8640 1 -- 10.20.193.28:0/327159872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e40c5e0 msgr2=0x56369e40ca20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:45.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9393b8640 1 --2- 10.20.193.28:0/327159872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e40c5e0 0x56369e40ca20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9393b8640 1 -- 10.20.193.28:0/327159872 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369e3203d0 con 0x56369e40cf60 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9393b8640 1 --2- 10.20.193.28:0/327159872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40cf60 0x56369e418de0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7ff92810d5b0 tx=0x7ff92810da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c8164fa543e81b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9024e6640 1 -- 10.20.193.28:0/327159872 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9281074e0 con 0x56369e40cf60 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9024e6640 1 -- 10.20.193.28:0/327159872 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff928112030 con 0x56369e40cf60 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff9024e6640 1 -- 10.20.193.28:0/327159872 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff928117ab0 con 0x56369e40cf60 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- 10.20.193.28:0/327159872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40cf60 msgr2=0x56369e418de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- 10.20.193.28:0/327159872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40cf60 0x56369e418de0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7ff92810d5b0 tx=0x7ff92810da80 comp rx=0 tx=0).stop 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- 10.20.193.28:0/327159872 shutdown_connections 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- 10.20.193.28:0/327159872 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40cf60 0x56369e418de0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- 10.20.193.28:0/327159872 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e40c5e0 0x56369e40ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- 10.20.193.28:0/327159872 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e411fb0 0x56369e412390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- 10.20.193.28:0/327159872 >> 10.20.193.28:0/327159872 conn(0x56369e3cf240 msgr2=0x56369e40ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- 10.20.193.28:0/327159872 shutdown_connections 2026-02-20T03:36:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- 10.20.193.28:0/327159872 wait complete. 2026-02-20T03:36:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff922ffd640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9100b0d80 0x7ff9100b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93a3ba640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9100b0d80 0x7ff9100b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff922ffd640 1 -- 10.20.193.28:0/256837481 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff9281053b0 con 0x7ff934109ba0 2026-02-20T03:36:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93a3ba640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9100b0d80 0x7ff9100b3240 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff93000aab0 tx=0x7ff930009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:45.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- start start 2026-02-20T03:36:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 Processor -- start 2026-02-20T03:36:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e426a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e40cf60 0x56369e426f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e411fb0 0x56369e425150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56369e35b8a0 con 0x56369e40c5e0 2026-02-20T03:36:45.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56369e14df50 con 0x56369e411fb0 2026-02-20T03:36:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff93e349e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56369e4256e0 con 0x56369e40cf60 2026-02-20T03:36:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.839+0000 7ff939bb9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e426a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff939bb9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e426a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60126/0 (socket says 10.20.193.28:60126) 2026-02-20T03:36:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff939bb9640 1 -- 10.20.193.28:0/2009599333 learned_addr learned my addr 10.20.193.28:0/2009599333 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff939bb9640 1 -- 10.20.193.28:0/2009599333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e40cf60 msgr2=0x56369e426f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff939bb9640 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e40cf60 0x56369e426f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff939bb9640 1 -- 10.20.193.28:0/2009599333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e411fb0 msgr2=0x56369e425150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff939bb9640 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e411fb0 0x56369e425150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff939bb9640 1 -- 10.20.193.28:0/2009599333 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369e41e840 con 0x56369e40c5e0 2026-02-20T03:36:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff939bb9640 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e426a10 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7ff924009f00 tx=0x7ff92400b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab5841cfb145a9d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff8ef7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2009599333 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924016070 con 0x56369e40c5e0 2026-02-20T03:36:45.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2009599333 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff924002780 con 0x56369e40c5e0 2026-02-20T03:36:45.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2009599333 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924011860 con 0x56369e40c5e0 2026-02-20T03:36:45.855 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:45 trial126 ceph-mon[38476]: pgmap v848: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 295 KiB/s rd, 297 KiB/s wr, 98 op/s 2026-02-20T03:36:45.856 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:45 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2705857273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:36:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 1 -- 10.20.193.28:0/2009599333 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56369e130b40 con 0x56369e40c5e0 2026-02-20T03:36:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2009599333 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff92401a3b0 con 0x56369e40c5e0 2026-02-20T03:36:45.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff8ef7fe640 10 client.21450 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:36:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 10 client.21450 _ll_register_callbacks cb 0x56369e398eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 1 -- 10.20.193.28:0/2009599333 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56369e36d150 con 0x56369e40c5e0 2026-02-20T03:36:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2009599333 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff924004270 con 0x56369e40c5e0 2026-02-20T03:36:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 10 client.21450 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:45.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 1 -- 10.20.193.28:0/2009599333 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x56369e31a1e0 con 0x56369e40c5e0 2026-02-20T03:36:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2009599333 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7ff924023020 con 0x56369e40c5e0 2026-02-20T03:36:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 10 client.21450 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 10 client.21450 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:36:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 20 client.21450 populate_metadata read hostname 'trial028' 2026-02-20T03:36:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56369e4352c0 0x56369e4376b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 4 client.21450 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:45.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.843+0000 7ff93e349e00 1 -- 10.20.193.28:0/2009599333 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56369e367560 con 0x56369e4352c0 2026-02-20T03:36:45.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.870+0000 7ff9393b8640 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56369e4352c0 0x56369e4376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:45.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.937+0000 7ff9393b8640 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56369e4352c0 0x56369e4376b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69dd0a873649d4db server_cookie=bd0dc7ae332cd30e in_seq=0 out_seq=0 2026-02-20T03:36:45.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.937+0000 7ff8ef7fe640 10 client.21450 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:36:45.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2009599333 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56369e367560 con 0x56369e4352c0 2026-02-20T03:36:45.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff8ef7fe640 10 client.21450 handle_command_reply: tid=0 2026-02-20T03:36:45.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 client.21450 shutdown 2026-02-20T03:36:45.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 -- 10.20.193.28:0/2009599333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 msgr2=0x56369e426a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:45.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e426a10 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7ff924009f00 tx=0x7ff92400b4b0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 -- 10.20.193.28:0/2009599333 shutdown_connections 2026-02-20T03:36:45.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e411fb0 0x56369e425150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e40cf60 0x56369e426f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56369e4352c0 0x56369e4376b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff8ef7fe640 0 client.21450 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:36:45.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2009599333 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e426a10 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 -- 10.20.193.28:0/2009599333 >> 10.20.193.28:0/2009599333 conn(0x56369e3cf240 msgr2=0x56369e40b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:45.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 -- 10.20.193.28:0/2009599333 shutdown_connections 2026-02-20T03:36:45.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 1 -- 10.20.193.28:0/2009599333 wait complete. 2026-02-20T03:36:45.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.963+0000 7ff93e349e00 20 client.21450 trim_cache size 0 max 16384 2026-02-20T03:36:45.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:45 trial177 ceph-mon[43181]: pgmap v848: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 295 KiB/s rd, 297 KiB/s wr, 98 op/s 2026-02-20T03:36:45.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:45 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2705857273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:36:45.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff93e349e00 1 Processor -- start 2026-02-20T03:36:45.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff93e349e00 1 -- start start 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e435db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e40cf60 0x56369e4362f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e411fb0 0x56369e40b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff93e349e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e00127b0 con 0x56369e40c5e0 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff93e349e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e000ffc0 con 0x56369e40cf60 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff93e349e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e000de10 con 0x56369e411fb0 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff939bb9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e435db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff939bb9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e435db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60128/0 (socket says 10.20.193.28:60128) 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff939bb9640 1 -- 10.20.193.28:0/392410395 learned_addr learned my addr 10.20.193.28:0/392410395 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff939bb9640 1 -- 10.20.193.28:0/392410395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e411fb0 msgr2=0x56369e40b4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff939bb9640 1 --2- 10.20.193.28:0/392410395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e411fb0 0x56369e40b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff939bb9640 1 -- 10.20.193.28:0/392410395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e40cf60 msgr2=0x56369e4362f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff939bb9640 1 --2- 10.20.193.28:0/392410395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e40cf60 0x56369e4362f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.969+0000 7ff939bb9640 1 -- 10.20.193.28:0/392410395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369e41e670 con 0x56369e40c5e0 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.972+0000 7ff939bb9640 1 --2- 10.20.193.28:0/392410395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e435db0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7ff92400ba40 tx=0x7ff924019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd67534d1f818c60 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.972+0000 7ff901ce5640 1 -- 10.20.193.28:0/392410395 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924016070 con 0x56369e40c5e0 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.972+0000 7ff901ce5640 1 -- 10.20.193.28:0/392410395 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56369e36d150 con 0x56369e40c5e0 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.972+0000 7ff901ce5640 1 -- 10.20.193.28:0/392410395 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924011890 con 0x56369e40c5e0 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.972+0000 7ff93e349e00 1 -- 10.20.193.28:0/392410395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 msgr2=0x56369e435db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.972+0000 7ff93e349e00 1 --2- 10.20.193.28:0/392410395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e435db0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7ff92400ba40 tx=0x7ff924019000 comp rx=0 tx=0).stop 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- 10.20.193.28:0/392410395 shutdown_connections 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 --2- 10.20.193.28:0/392410395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e411fb0 0x56369e40b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 --2- 10.20.193.28:0/392410395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e40cf60 0x56369e4362f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 --2- 10.20.193.28:0/392410395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e435db0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- 10.20.193.28:0/392410395 >> 10.20.193.28:0/392410395 conn(0x56369e3cf240 msgr2=0x56369e4356a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- 10.20.193.28:0/392410395 shutdown_connections 2026-02-20T03:36:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- 10.20.193.28:0/392410395 wait complete. 2026-02-20T03:36:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- start start 2026-02-20T03:36:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 Processor -- start 2026-02-20T03:36:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e42e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e40cf60 0x56369e42ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e411fb0 0x56369e49a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e000e480 con 0x56369e40c5e0 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e000f8f0 con 0x56369e411fb0 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e000eb50 con 0x56369e40cf60 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff939bb9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e42e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff939bb9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e42e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:60144/0 (socket says 10.20.193.28:60144) 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff939bb9640 1 -- 10.20.193.28:0/2986295137 learned_addr learned my addr 10.20.193.28:0/2986295137 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff939bb9640 1 -- 10.20.193.28:0/2986295137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e40cf60 msgr2=0x56369e42ec90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff939bb9640 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e40cf60 0x56369e42ec90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff939bb9640 1 -- 10.20.193.28:0/2986295137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e411fb0 msgr2=0x56369e49a1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff939bb9640 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e411fb0 0x56369e49a1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff939bb9640 1 -- 10.20.193.28:0/2986295137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56369e03e870 con 0x56369e40c5e0 2026-02-20T03:36:45.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff939bb9640 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e42e750 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7ff924003dd0 tx=0x7ff92400b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0e3d786f933042 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff8ef7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2986295137 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff924016040 con 0x56369e40c5e0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2986295137 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff924032070 con 0x56369e40c5e0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2986295137 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92401b840 con 0x56369e40c5e0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- 10.20.193.28:0/2986295137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56369e2ff3f0 con 0x56369e40c5e0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 10 client.21456 _ll_register_callbacks cb 0x7ff924009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- 10.20.193.28:0/2986295137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56369e36d150 con 0x56369e40c5e0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2986295137 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff92401b9e0 con 0x56369e40c5e0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2986295137 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff92401bcc0 con 0x56369e40c5e0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 10 client.21456 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- 10.20.193.28:0/2986295137 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x56369e41f360 con 0x56369e40c5e0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2986295137 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7ff924023070 con 0x56369e40c5e0 2026-02-20T03:36:45.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 10 client.21456 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:45.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 10 client.21456 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:36:45.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 20 client.21456 populate_metadata read hostname 'trial028' 2026-02-20T03:36:45.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56369e4a1a80 0x56369e4a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:45.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 4 client.21456 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:36:45.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.973+0000 7ff93e349e00 1 -- 10.20.193.28:0/2986295137 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56369e367560 con 0x56369e4a1a80 2026-02-20T03:36:45.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:45.990+0000 7ff9393b8640 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56369e4a1a80 0x56369e4a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:46.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.044+0000 7ff9393b8640 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56369e4a1a80 0x56369e4a3f40 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e7ba81676c251e40 server_cookie=24d5313bbdd4226 in_seq=0 out_seq=0 2026-02-20T03:36:46.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.044+0000 7ff8ef7fe640 10 client.21456 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:36:46.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff8ef7fe640 1 -- 10.20.193.28:0/2986295137 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff928112020 con 0x56369e4a1a80 2026-02-20T03:36:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff8ef7fe640 10 client.21456 handle_command_reply: tid=0 2026-02-20T03:36:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 client.21456 shutdown 2026-02-20T03:36:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 -- 10.20.193.28:0/2986295137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 msgr2=0x56369e42e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:46.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e42e750 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7ff924003dd0 tx=0x7ff92400b4b0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 -- 10.20.193.28:0/2986295137 shutdown_connections 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56369e411fb0 0x56369e49a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56369e40cf60 0x56369e42ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56369e4a1a80 0x56369e4a3f40 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 --2- 10.20.193.28:0/2986295137 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56369e40c5e0 0x56369e42e750 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 -- 10.20.193.28:0/2986295137 >> 10.20.193.28:0/2986295137 conn(0x56369e3cf240 msgr2=0x56369e435ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff8ef7fe640 0 client.21456 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 -- 10.20.193.28:0/2986295137 shutdown_connections 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 1 -- 10.20.193.28:0/2986295137 wait complete. 2026-02-20T03:36:46.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93e349e00 20 client.21456 trim_cache size 0 max 16384 2026-02-20T03:36:46.073 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:36:46.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93abbb640 1 -- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9100b0d80 msgr2=0x7ff9100b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:46.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93abbb640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9100b0d80 0x7ff9100b3240 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff93000aab0 tx=0x7ff930009250 comp rx=0 tx=0).stop 2026-02-20T03:36:46.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93abbb640 1 -- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109ba0 msgr2=0x7ff9341a1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:46.073 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.057+0000 7ff93abbb640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109ba0 0x7ff9341a1bb0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7ff928002fa0 tx=0x7ff928002910 comp rx=0 tx=0).stop 2026-02-20T03:36:46.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.058+0000 7ff93abbb640 1 -- 10.20.193.28:0/256837481 shutdown_connections 2026-02-20T03:36:46.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.058+0000 7ff93abbb640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff9100b0d80 0x7ff9100b3240 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.058+0000 7ff93abbb640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff93410eef0 0x7ff9341a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.058+0000 7ff93abbb640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff934109ba0 0x7ff9341a1bb0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.058+0000 7ff93abbb640 1 --2- 10.20.193.28:0/256837481 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff934109220 0x7ff9341a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.058+0000 7ff93abbb640 1 -- 10.20.193.28:0/256837481 >> 10.20.193.28:0/256837481 conn(0x7ff934078600 msgr2=0x7ff934079ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:46.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.058+0000 7ff93abbb640 1 -- 10.20.193.28:0/256837481 shutdown_connections 2026-02-20T03:36:46.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.058+0000 7ff93abbb640 1 -- 10.20.193.28:0/256837481 wait complete. 2026-02-20T03:36:46.245 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:36:46.540 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:46.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 17.74 MB/sec execute 377 sec latency 71722.269 ms 2026-02-20T03:36:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.793+0000 7fdb559e3640 1 -- 10.20.193.28:0/1195239683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501009c0 msgr2=0x7fdb50100da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.793+0000 7fdb559e3640 1 --2- 10.20.193.28:0/1195239683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501009c0 0x7fdb50100da0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009a30 tx=0x7fdb4002f2f0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.793+0000 7fdb559e3640 1 -- 10.20.193.28:0/1195239683 shutdown_connections 2026-02-20T03:36:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.793+0000 7fdb559e3640 1 --2- 10.20.193.28:0/1195239683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5010efb0 0x7fdb50111430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.793+0000 7fdb559e3640 1 --2- 10.20.193.28:0/1195239683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb501012e0 0x7fdb5010e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.793+0000 7fdb559e3640 1 --2- 10.20.193.28:0/1195239683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501009c0 0x7fdb50100da0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.793+0000 7fdb559e3640 1 -- 10.20.193.28:0/1195239683 >> 10.20.193.28:0/1195239683 conn(0x7fdb500fc5f0 msgr2=0x7fdb500fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.793+0000 7fdb559e3640 1 -- 10.20.193.28:0/1195239683 shutdown_connections 2026-02-20T03:36:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.794+0000 7fdb559e3640 1 -- 10.20.193.28:0/1195239683 wait complete. 2026-02-20T03:36:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.794+0000 7fdb559e3640 1 Processor -- start 2026-02-20T03:36:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.794+0000 7fdb559e3640 1 -- start start 2026-02-20T03:36:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.794+0000 7fdb559e3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb501009c0 0x7fdb5019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.794+0000 7fdb559e3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501012e0 0x7fdb5019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.794+0000 7fdb559e3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5010efb0 0x7fdb501a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.794+0000 7fdb559e3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50114d00 con 0x7fdb501012e0 2026-02-20T03:36:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.794+0000 7fdb559e3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50114b80 con 0x7fdb5010efb0 2026-02-20T03:36:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.794+0000 7fdb559e3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdb50114e80 con 0x7fdb501009c0 2026-02-20T03:36:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.795+0000 7fdb47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501012e0 0x7fdb5019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.795+0000 7fdb47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501012e0 0x7fdb5019d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42704/0 (socket says 10.20.193.28:42704) 2026-02-20T03:36:46.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.795+0000 7fdb47fff640 1 -- 10.20.193.28:0/3139290031 learned_addr learned my addr 10.20.193.28:0/3139290031 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb47fff640 1 -- 10.20.193.28:0/3139290031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb501009c0 msgr2=0x7fdb5019d1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb47fff640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb501009c0 0x7fdb5019d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb47fff640 1 -- 10.20.193.28:0/3139290031 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5010efb0 msgr2=0x7fdb501a1a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:46.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb47fff640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5010efb0 0x7fdb501a1a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb47fff640 1 -- 10.20.193.28:0/3139290031 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb501a2200 con 0x7fdb501012e0 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb47fff640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501012e0 0x7fdb5019d6f0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800b550 tx=0x7fdb3800ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb45ffb640 1 -- 10.20.193.28:0/3139290031 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38013020 con 0x7fdb501012e0 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb45ffb640 1 -- 10.20.193.28:0/3139290031 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdb38004480 con 0x7fdb501012e0 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb559e3640 1 -- 10.20.193.28:0/3139290031 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb501a24f0 con 0x7fdb501012e0 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb45ffb640 1 -- 10.20.193.28:0/3139290031 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800fb10 con 0x7fdb501012e0 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb559e3640 1 -- 10.20.193.28:0/3139290031 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb501a9db0 con 0x7fdb501012e0 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb45ffb640 1 -- 10.20.193.28:0/3139290031 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fdb38002780 con 0x7fdb501012e0 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 Processor -- start 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 -- start start 2026-02-20T03:36:46.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463115fb0 0x558463116390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584631105e0 0x558463110a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463110f60 0x55846311cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558463090e00 con 0x558463115fb0 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558463063970 con 0x5584631105e0 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5584630111f0 con 0x558463110f60 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb551e2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463115fb0 0x558463116390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb551e2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463115fb0 0x558463116390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42718/0 (socket says 10.20.193.28:42718) 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb551e2640 1 -- 10.20.193.28:0/2511383248 learned_addr learned my addr 10.20.193.28:0/2511383248 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb551e2640 1 -- 10.20.193.28:0/2511383248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463110f60 msgr2=0x55846311cde0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb551e2640 1 --2- 10.20.193.28:0/2511383248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463110f60 0x55846311cde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb551e2640 1 -- 10.20.193.28:0/2511383248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584631105e0 msgr2=0x558463110a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb551e2640 1 --2- 10.20.193.28:0/2511383248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584631105e0 0x558463110a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb551e2640 1 -- 10.20.193.28:0/2511383248 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584630243d0 con 0x558463115fb0 2026-02-20T03:36:46.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb551e2640 1 --2- 10.20.193.28:0/2511383248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463115fb0 0x558463116390 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009d20 tx=0x7fdb4c00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de51b42c12f45d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:46.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb45ffb640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb2c0b0e20 0x7fdb2c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb1d4e4640 1 -- 10.20.193.28:0/2511383248 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c017070 con 0x558463115fb0 2026-02-20T03:36:46.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb45ffb640 1 -- 10.20.193.28:0/3139290031 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fdb380e0560 con 0x7fdb501012e0 2026-02-20T03:36:46.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb549e1640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb2c0b0e20 0x7fdb2c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:46.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb1d4e4640 1 -- 10.20.193.28:0/2511383248 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdb4c00bd50 con 0x558463115fb0 2026-02-20T03:36:46.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb1d4e4640 1 -- 10.20.193.28:0/2511383248 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c006e60 con 0x558463115fb0 2026-02-20T03:36:46.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 -- 10.20.193.28:0/2511383248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463115fb0 msgr2=0x558463116390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:46.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 --2- 10.20.193.28:0/2511383248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463115fb0 0x558463116390 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009d20 tx=0x7fdb4c00b420 comp rx=0 tx=0).stop 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 -- 10.20.193.28:0/2511383248 shutdown_connections 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 --2- 10.20.193.28:0/2511383248 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463110f60 0x55846311cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 --2- 10.20.193.28:0/2511383248 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584631105e0 0x558463110a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 --2- 10.20.193.28:0/2511383248 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463115fb0 0x558463116390 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 -- 10.20.193.28:0/2511383248 >> 10.20.193.28:0/2511383248 conn(0x5584630d3240 msgr2=0x55846310ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 -- 10.20.193.28:0/2511383248 shutdown_connections 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb59171e00 1 -- 10.20.193.28:0/2511383248 wait complete. 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.796+0000 7fdb549e1640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb2c0b0e20 0x7fdb2c0b32e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009950 tx=0x7fdb400023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 -- start start 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 Processor -- start 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584631105e0 0x55846312aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846312b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463115fb0 0x558463129670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55846305f8a0 con 0x558463110f60 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558462e51f50 con 0x5584631105e0 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558463129cb0 con 0x558463115fb0 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846312b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846312b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42720/0 (socket says 10.20.193.28:42720) 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb47fff640 1 -- 10.20.193.28:0/3268167197 learned_addr learned my addr 10.20.193.28:0/3268167197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb47fff640 1 -- 10.20.193.28:0/3268167197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463115fb0 msgr2=0x558463129670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb47fff640 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463115fb0 0x558463129670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb47fff640 1 -- 10.20.193.28:0/3268167197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584631105e0 msgr2=0x55846312aec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb47fff640 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584631105e0 0x55846312aec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb47fff640 1 -- 10.20.193.28:0/3268167197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558463122ad0 con 0x558463110f60 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb47fff640 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846312b400 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fdb38006e80 tx=0x7fdb3801f300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c95bae0c1eb4224 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb0e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/3268167197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380ac5f0 con 0x558463110f60 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/3268167197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdb380b14a0 con 0x558463110f60 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/3268167197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380a3bc0 con 0x558463110f60 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 -- 10.20.193.28:0/3268167197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558462e34b40 con 0x558463110f60 2026-02-20T03:36:46.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/3268167197 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fdb380a6cc0 con 0x558463110f60 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 10 client.21468 _ll_register_callbacks cb 0x55846309ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 -- 10.20.193.28:0/3268167197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558463071150 con 0x558463110f60 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/3268167197 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fdb380ac120 con 0x558463110f60 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 10 client.21468 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 -- 10.20.193.28:0/3268167197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55846301e1e0 con 0x558463110f60 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/3268167197 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fdb380cace0 con 0x558463110f60 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 10 client.21468 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 10 client.21468 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 20 client.21468 populate_metadata read hostname 'trial028' 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5584631396c0 0x55846313bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 4 client.21468 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.803+0000 7fdb59171e00 1 -- 10.20.193.28:0/3268167197 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55846306b560 con 0x5584631396c0 2026-02-20T03:36:46.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.830+0000 7fdb549e1640 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5584631396c0 0x55846313bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:46.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.883+0000 7fdb549e1640 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5584631396c0 0x55846313bb60 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53908ab69ec4d891 server_cookie=87683a4179f43bd in_seq=0 out_seq=0 2026-02-20T03:36:46.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.883+0000 7fdb0e7fc640 10 client.21468 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:36:46.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/3268167197 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55846306b560 con 0x5584631396c0 2026-02-20T03:36:46.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb0e7fc640 10 client.21468 handle_command_reply: tid=0 2026-02-20T03:36:46.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 client.21468 shutdown 2026-02-20T03:36:46.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 -- 10.20.193.28:0/3268167197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 msgr2=0x55846312b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:46.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846312b400 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fdb38006e80 tx=0x7fdb3801f300 comp rx=0 tx=0).stop 2026-02-20T03:36:46.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 -- 10.20.193.28:0/3268167197 shutdown_connections 2026-02-20T03:36:46.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5584631396c0 0x55846313bb60 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463115fb0 0x558463129670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846312b400 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 --2- 10.20.193.28:0/3268167197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584631105e0 0x55846312aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 -- 10.20.193.28:0/3268167197 >> 10.20.193.28:0/3268167197 conn(0x5584630d3240 msgr2=0x55846310f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:46.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb0e7fc640 0 client.21468 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:36:46.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 -- 10.20.193.28:0/3268167197 shutdown_connections 2026-02-20T03:36:46.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 1 -- 10.20.193.28:0/3268167197 wait complete. 2026-02-20T03:36:46.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.910+0000 7fdb59171e00 20 client.21468 trim_cache size 0 max 16384 2026-02-20T03:36:46.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.915+0000 7fdb59171e00 1 Processor -- start 2026-02-20T03:36:46.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb59171e00 1 -- start start 2026-02-20T03:36:46.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584631105e0 0x558463136460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846310f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558463115fb0 0x55846310fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb59171e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf40127b0 con 0x558463110f60 2026-02-20T03:36:46.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb59171e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf400ffc0 con 0x558463115fb0 2026-02-20T03:36:46.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb59171e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf400de10 con 0x5584631105e0 2026-02-20T03:36:46.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846310f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:46.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846310f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42732/0 (socket says 10.20.193.28:42732) 2026-02-20T03:36:46.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb47fff640 1 -- 10.20.193.28:0/1212823799 learned_addr learned my addr 10.20.193.28:0/1212823799 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:46.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb47fff640 1 -- 10.20.193.28:0/1212823799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584631105e0 msgr2=0x558463136460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:46.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb47fff640 1 --2- 10.20.193.28:0/1212823799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584631105e0 0x558463136460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb47fff640 1 -- 10.20.193.28:0/1212823799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558463115fb0 msgr2=0x55846310fa10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:46.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb47fff640 1 --2- 10.20.193.28:0/1212823799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558463115fb0 0x55846310fa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.917+0000 7fdb47fff640 1 -- 10.20.193.28:0/1212823799 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558463122900 con 0x558463110f60 2026-02-20T03:36:46.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb47fff640 1 --2- 10.20.193.28:0/1212823799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846310f4d0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fdb380a4590 tx=0x7fdb38090020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4640724f4920c67e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:46.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb1cce3640 1 -- 10.20.193.28:0/1212823799 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380ac360 con 0x558463110f60 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb1cce3640 1 -- 10.20.193.28:0/1212823799 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x558463071150 con 0x558463110f60 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb1cce3640 1 -- 10.20.193.28:0/1212823799 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380a3c50 con 0x558463110f60 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb59171e00 1 -- 10.20.193.28:0/1212823799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 msgr2=0x55846310f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1212823799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846310f4d0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fdb380a4590 tx=0x7fdb38090020 comp rx=0 tx=0).stop 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb59171e00 1 -- 10.20.193.28:0/1212823799 shutdown_connections 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1212823799 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558463115fb0 0x55846310fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1212823799 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558463110f60 0x55846310f4d0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1212823799 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584631105e0 0x558463136460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.918+0000 7fdb59171e00 1 -- 10.20.193.28:0/1212823799 >> 10.20.193.28:0/1212823799 conn(0x5584630d3240 msgr2=0x558463135d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:46.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.919+0000 7fdb59171e00 1 -- 10.20.193.28:0/1212823799 shutdown_connections 2026-02-20T03:36:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.919+0000 7fdb59171e00 1 -- 10.20.193.28:0/1212823799 wait complete. 2026-02-20T03:36:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.919+0000 7fdb59171e00 1 -- start start 2026-02-20T03:36:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.919+0000 7fdb59171e00 1 Processor -- start 2026-02-20T03:36:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584631105e0 0x558463131060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463110f60 0x5584631315a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb59171e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558463115fb0 0x55846312f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb59171e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf400e480 con 0x5584631105e0 2026-02-20T03:36:46.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb59171e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf400f8f0 con 0x558463115fb0 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb59171e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf400eb50 con 0x558463110f60 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb549e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584631105e0 0x558463131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb549e1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584631105e0 0x558463131060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42736/0 (socket says 10.20.193.28:42736) 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb549e1640 1 -- 10.20.193.28:0/1783967730 learned_addr learned my addr 10.20.193.28:0/1783967730 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb549e1640 1 -- 10.20.193.28:0/1783967730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463110f60 msgr2=0x5584631315a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb549e1640 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463110f60 0x5584631315a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb549e1640 1 -- 10.20.193.28:0/1783967730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558463115fb0 msgr2=0x55846312f400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb549e1640 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558463115fb0 0x55846312f400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.920+0000 7fdb549e1640 1 -- 10.20.193.28:0/1783967730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558462d42870 con 0x5584631105e0 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.921+0000 7fdb549e1640 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584631105e0 0x558463131060 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fdb40032040 tx=0x7fdb4002f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147210764765bc61 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.921+0000 7fdb0e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:46.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.921+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/1783967730 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40004520 con 0x5584631105e0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.921+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/1783967730 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdb40033040 con 0x5584631105e0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.921+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/1783967730 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40038850 con 0x5584631105e0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.921+0000 7fdb59171e00 1 -- 10.20.193.28:0/1783967730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584630033f0 con 0x5584631105e0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.921+0000 7fdb59171e00 10 client.21474 _ll_register_callbacks cb 0x7fdb38004630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.921+0000 7fdb59171e00 1 -- 10.20.193.28:0/1783967730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558463015ab0 con 0x5584631105e0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/1783967730 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fdb40002ca0 con 0x5584631105e0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/1783967730 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fdb4005c060 con 0x5584631105e0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb59171e00 10 client.21474 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb59171e00 1 -- 10.20.193.28:0/1783967730 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5584631235f0 con 0x5584631105e0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/1783967730 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fdb400026e0 con 0x5584631105e0 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb59171e00 10 client.21474 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb59171e00 10 client.21474 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:36:46.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb59171e00 20 client.21474 populate_metadata read hostname 'trial028' 2026-02-20T03:36:46.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5584631adec0 0x5584631b0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:46.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb59171e00 4 client.21474 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:36:46.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.922+0000 7fdb59171e00 1 -- 10.20.193.28:0/1783967730 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558463071150 con 0x5584631adec0 2026-02-20T03:36:46.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:46.937+0000 7fdb47fff640 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5584631adec0 0x5584631b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:47.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.004+0000 7fdb47fff640 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5584631adec0 0x5584631b0380 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a66b7762192a6039 server_cookie=9de4a404a40865f3 in_seq=0 out_seq=0 2026-02-20T03:36:47.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.004+0000 7fdb0e7fc640 10 client.21474 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:36:47.020 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb0e7fc640 1 -- 10.20.193.28:0/1783967730 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558463071150 con 0x5584631adec0 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb0e7fc640 10 client.21474 handle_command_reply: tid=0 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 client.21474 shutdown 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 -- 10.20.193.28:0/1783967730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584631105e0 msgr2=0x558463131060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584631105e0 0x558463131060 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fdb40032040 tx=0x7fdb4002f2f0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 -- 10.20.193.28:0/1783967730 shutdown_connections 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5584631adec0 0x5584631b0380 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558463115fb0 0x55846312f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558463110f60 0x5584631315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 --2- 10.20.193.28:0/1783967730 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584631105e0 0x558463131060 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 -- 10.20.193.28:0/1783967730 >> 10.20.193.28:0/1783967730 conn(0x5584630d3240 msgr2=0x558463127ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb0e7fc640 0 client.21474 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:36:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 -- 10.20.193.28:0/1783967730 shutdown_connections 2026-02-20T03:36:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 1 -- 10.20.193.28:0/1783967730 wait complete. 2026-02-20T03:36:47.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb59171e00 20 client.21474 trim_cache size 0 max 16384 2026-02-20T03:36:47.033 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:36:47.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 -- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb2c0b0e20 msgr2=0x7fdb2c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb2c0b0e20 0x7fdb2c0b32e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009950 tx=0x7fdb400023d0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 -- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501012e0 msgr2=0x7fdb5019d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501012e0 0x7fdb5019d6f0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800b550 tx=0x7fdb3800ba20 comp rx=0 tx=0).stop 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 -- 10.20.193.28:0/3139290031 shutdown_connections 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdb2c0b0e20 0x7fdb2c0b32e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdb5010efb0 0x7fdb501a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdb501012e0 0x7fdb5019d6f0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 --2- 10.20.193.28:0/3139290031 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdb501009c0 0x7fdb5019d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 -- 10.20.193.28:0/3139290031 >> 10.20.193.28:0/3139290031 conn(0x7fdb500fc5f0 msgr2=0x7fdb50110e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 -- 10.20.193.28:0/3139290031 shutdown_connections 2026-02-20T03:36:47.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.017+0000 7fdb559e3640 1 -- 10.20.193.28:0/3139290031 wait complete. 2026-02-20T03:36:47.204 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:36:47.500 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:47.699 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:47 trial028 ceph-mon[38552]: pgmap v849: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 8.1 KiB/s wr, 67 op/s 2026-02-20T03:36:47.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184818 17.69 MB/sec execute 378 sec latency 72722.306 ms 2026-02-20T03:36:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 -- 10.20.193.28:0/1763393643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f70104980 msgr2=0x7f8f70104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1763393643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f70104980 0x7f8f70104de0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009a60 tx=0x7f8f5802f290 comp rx=0 tx=0).stop 2026-02-20T03:36:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 -- 10.20.193.28:0/1763393643 shutdown_connections 2026-02-20T03:36:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1763393643 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f70105320 0x7f8f70111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1763393643 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f70104980 0x7f8f70104de0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1763393643 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f7010a980 0x7f8f7010ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 -- 10.20.193.28:0/1763393643 >> 10.20.193.28:0/1763393643 conn(0x7f8f70100680 msgr2=0x7f8f70102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:47.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 -- 10.20.193.28:0/1763393643 shutdown_connections 2026-02-20T03:36:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 -- 10.20.193.28:0/1763393643 wait complete. 2026-02-20T03:36:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 Processor -- start 2026-02-20T03:36:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 -- start start 2026-02-20T03:36:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f70104980 0x7f8f7019d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f70105320 0x7f8f7019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f7010a980 0x7f8f701a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70114cd0 con 0x7f8f7010a980 2026-02-20T03:36:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70114b50 con 0x7f8f70104980 2026-02-20T03:36:47.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6f577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f70114e50 con 0x7f8f70105320 2026-02-20T03:36:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f7010a980 0x7f8f701a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f7010a980 0x7f8f701a1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42762/0 (socket says 10.20.193.28:42762) 2026-02-20T03:36:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6ed76640 1 -- 10.20.193.28:0/1092795241 learned_addr learned my addr 10.20.193.28:0/1092795241 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6ed76640 1 -- 10.20.193.28:0/1092795241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f70105320 msgr2=0x7f8f7019d7b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:47.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6ed76640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f70105320 0x7f8f7019d7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6ed76640 1 -- 10.20.193.28:0/1092795241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f70104980 msgr2=0x7f8f7019d270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6ed76640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f70104980 0x7f8f7019d270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.754+0000 7f8f6ed76640 1 -- 10.20.193.28:0/1092795241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f701a22c0 con 0x7f8f7010a980 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.758+0000 7f8f6ed76640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f7010a980 0x7f8f701a1b40 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000b990 tx=0x7f8f6000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.758+0000 7f8f577fe640 1 -- 10.20.193.28:0/1092795241 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60006e60 con 0x7f8f7010a980 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.758+0000 7f8f577fe640 1 -- 10.20.193.28:0/1092795241 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f60010070 con 0x7f8f7010a980 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.758+0000 7f8f577fe640 1 -- 10.20.193.28:0/1092795241 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f60004800 con 0x7f8f7010a980 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.758+0000 7f8f6f577640 1 -- 10.20.193.28:0/1092795241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f701a25b0 con 0x7f8f7010a980 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.758+0000 7f8f6f577640 1 -- 10.20.193.28:0/1092795241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f701a9df0 con 0x7f8f7010a980 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.759+0000 7f8f577fe640 1 -- 10.20.193.28:0/1092795241 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8f6001d030 con 0x7f8f7010a980 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.759+0000 7f8f77209e00 1 Processor -- start 2026-02-20T03:36:47.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f77209e00 1 -- start start 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b919c0 0x555d72b91da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8bff0 0x555d72b8c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72b987f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f77209e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555d72b03e00 con 0x555d72b8c970 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f77209e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555d72ad6970 con 0x555d72b8bff0 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f77209e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555d72a841f0 con 0x555d72b919c0 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f6dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72b987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f6dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72b987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42766/0 (socket says 10.20.193.28:42766) 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.761+0000 7f8f6dd74640 1 -- 10.20.193.28:0/2467427907 learned_addr learned my addr 10.20.193.28:0/2467427907 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f6dd74640 1 -- 10.20.193.28:0/2467427907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b919c0 msgr2=0x555d72b91da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f6dd74640 1 --2- 10.20.193.28:0/2467427907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b919c0 0x555d72b91da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f6dd74640 1 -- 10.20.193.28:0/2467427907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8bff0 msgr2=0x555d72b8c430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:47.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f6dd74640 1 --2- 10.20.193.28:0/2467427907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8bff0 0x555d72b8c430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f6dd74640 1 -- 10.20.193.28:0/2467427907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d72a973d0 con 0x555d72b8c970 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f6dd74640 1 --2- 10.20.193.28:0/2467427907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72b987f0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009950 tx=0x7f8f58002cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448a0f45f5ba8923 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f54ff9640 1 -- 10.20.193.28:0/2467427907 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58038470 con 0x555d72b8c970 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f54ff9640 1 -- 10.20.193.28:0/2467427907 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f58033040 con 0x555d72b8c970 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f54ff9640 1 -- 10.20.193.28:0/2467427907 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58004340 con 0x555d72b8c970 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.762+0000 7f8f577fe640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f480b0e20 0x7f8f480b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f577fe640 1 -- 10.20.193.28:0/1092795241 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8f600dffe0 con 0x7f8f7010a980 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6e575640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f480b0e20 0x7f8f480b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- 10.20.193.28:0/2467427907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 msgr2=0x555d72b987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2467427907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72b987f0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009950 tx=0x7f8f58002cb0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- 10.20.193.28:0/2467427907 shutdown_connections 2026-02-20T03:36:47.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2467427907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72b987f0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2467427907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8bff0 0x555d72b8c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2467427907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b919c0 0x555d72b91da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- 10.20.193.28:0/2467427907 >> 10.20.193.28:0/2467427907 conn(0x555d72b46240 msgr2=0x555d72b81ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:47.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- 10.20.193.28:0/2467427907 shutdown_connections 2026-02-20T03:36:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- 10.20.193.28:0/2467427907 wait complete. 2026-02-20T03:36:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6e575640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f480b0e20 0x7f8f480b32e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8f640096f0 tx=0x7f8f64006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- start start 2026-02-20T03:36:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 Processor -- start 2026-02-20T03:36:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 0x555d72ba62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72ba67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b919c0 0x555d72ba49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555d72ad28a0 con 0x555d72b8c970 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555d728c4f50 con 0x555d72b919c0 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555d72ba5160 con 0x555d72b8bff0 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72ba67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6dd74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72ba67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42776/0 (socket says 10.20.193.28:42776) 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6dd74640 1 -- 10.20.193.28:0/2470767648 learned_addr learned my addr 10.20.193.28:0/2470767648 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6dd74640 1 -- 10.20.193.28:0/2470767648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 msgr2=0x555d72ba62a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6dd74640 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 0x555d72ba62a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6dd74640 1 -- 10.20.193.28:0/2470767648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b919c0 msgr2=0x555d72ba49e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6dd74640 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b919c0 0x555d72ba49e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6dd74640 1 -- 10.20.193.28:0/2470767648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d72b9e490 con 0x555d72b8c970 2026-02-20T03:36:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f6dd74640 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72ba67e0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f8f5802ffd0 tx=0x7f8f58002f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7911f2fb2ec11e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f1ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f1ffff640 1 -- 10.20.193.28:0/2470767648 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f580028f0 con 0x555d72b8c970 2026-02-20T03:36:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f1ffff640 1 -- 10.20.193.28:0/2470767648 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f580044d0 con 0x555d72b8c970 2026-02-20T03:36:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f1ffff640 1 -- 10.20.193.28:0/2470767648 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58038d90 con 0x555d72b8c970 2026-02-20T03:36:47.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- 10.20.193.28:0/2470767648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d728a7b40 con 0x555d72b8c970 2026-02-20T03:36:47.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f1ffff640 1 -- 10.20.193.28:0/2470767648 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8f5804b430 con 0x555d72b8c970 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 10 client.21486 _ll_register_callbacks cb 0x555d72b0feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- 10.20.193.28:0/2470767648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d72ae4150 con 0x555d72b8c970 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f1ffff640 1 -- 10.20.193.28:0/2470767648 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f8f58038730 con 0x555d72b8c970 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 10 client.21486 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- 10.20.193.28:0/2470767648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x555d72a911e0 con 0x555d72b8c970 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f1ffff640 1 -- 10.20.193.28:0/2470767648 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f8f58004030 con 0x555d72b8c970 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 10 client.21486 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 10 client.21486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 20 client.21486 populate_metadata read hostname 'trial028' 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555d72bb4700 0x555d72bb6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 4 client.21486 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:47.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.763+0000 7f8f77209e00 1 -- 10.20.193.28:0/2470767648 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d72ade560 con 0x555d72bb4700 2026-02-20T03:36:47.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.790+0000 7f8f6e575640 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555d72bb4700 0x555d72bb6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:47 trial126 ceph-mon[38476]: pgmap v849: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 8.1 KiB/s wr, 67 op/s 2026-02-20T03:36:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.856+0000 7f8f6e575640 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555d72bb4700 0x555d72bb6af0 crc :-1 s=READY pgs=557 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931303f4be87e63a server_cookie=a6fac7009855801d in_seq=0 out_seq=0 2026-02-20T03:36:47.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.856+0000 7f8f1ffff640 10 client.21486 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:47.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f1ffff640 1 -- 10.20.193.28:0/2470767648 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555d72ade560 con 0x555d72bb4700 2026-02-20T03:36:47.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f1ffff640 10 client.21486 handle_command_reply: tid=0 2026-02-20T03:36:47.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 client.21486 shutdown 2026-02-20T03:36:47.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 -- 10.20.193.28:0/2470767648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 msgr2=0x555d72ba67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:47.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72ba67e0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f8f5802ffd0 tx=0x7f8f58002f50 comp rx=0 tx=0).stop 2026-02-20T03:36:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 -- 10.20.193.28:0/2470767648 shutdown_connections 2026-02-20T03:36:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555d72bb4700 0x555d72bb6af0 crc :-1 s=READY pgs=557 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b919c0 0x555d72ba49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b8c970 0x555d72ba67e0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 --2- 10.20.193.28:0/2470767648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 0x555d72ba62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f1ffff640 0 client.21486 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 -- 10.20.193.28:0/2470767648 >> 10.20.193.28:0/2470767648 conn(0x555d72b46240 msgr2=0x555d72b823f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 -- 10.20.193.28:0/2470767648 shutdown_connections 2026-02-20T03:36:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 1 -- 10.20.193.28:0/2470767648 wait complete. 2026-02-20T03:36:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.883+0000 7f8f77209e00 20 client.21486 trim_cache size 0 max 16384 2026-02-20T03:36:47.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 Processor -- start 2026-02-20T03:36:47.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- start start 2026-02-20T03:36:47.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 0x555d72ba22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8c970 0x555d72ba27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72bbc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f140127b0 con 0x555d72b919c0 2026-02-20T03:36:47.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1400ffc0 con 0x555d72b8c970 2026-02-20T03:36:47.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1400de10 con 0x555d72b8bff0 2026-02-20T03:36:47.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f6ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72bbc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:47.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f6ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72bbc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42792/0 (socket says 10.20.193.28:42792) 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f6ed76640 1 -- 10.20.193.28:0/3010824936 learned_addr learned my addr 10.20.193.28:0/3010824936 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f6ed76640 1 -- 10.20.193.28:0/3010824936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 msgr2=0x555d72ba22b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f6ed76640 1 --2- 10.20.193.28:0/3010824936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 0x555d72ba22b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f6ed76640 1 -- 10.20.193.28:0/3010824936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8c970 msgr2=0x555d72ba27f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f6ed76640 1 --2- 10.20.193.28:0/3010824936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8c970 0x555d72ba27f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f6ed76640 1 -- 10.20.193.28:0/3010824936 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d72b9e2c0 con 0x555d72b919c0 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f6ed76640 1 --2- 10.20.193.28:0/3010824936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72bbc3b0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f8f600a7c50 tx=0x7f8f600a7490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc97dc6379e62de server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f3a4e6640 1 -- 10.20.193.28:0/3010824936 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600a83c0 con 0x555d72b919c0 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f3a4e6640 1 -- 10.20.193.28:0/3010824936 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f600ac070 con 0x555d72b919c0 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f3a4e6640 1 -- 10.20.193.28:0/3010824936 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600dddb0 con 0x555d72b919c0 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- 10.20.193.28:0/3010824936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 msgr2=0x555d72bbc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:47.898 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- 10.20.193.28:0/3010824936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72bbc3b0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f8f600a7c50 tx=0x7f8f600a7490 comp rx=0 tx=0).stop 2026-02-20T03:36:47.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- 10.20.193.28:0/3010824936 shutdown_connections 2026-02-20T03:36:47.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- 10.20.193.28:0/3010824936 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72bbc3b0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- 10.20.193.28:0/3010824936 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8c970 0x555d72ba27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- 10.20.193.28:0/3010824936 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 0x555d72ba22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.901 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- 10.20.193.28:0/3010824936 >> 10.20.193.28:0/3010824936 conn(0x555d72b46240 msgr2=0x555d72ba3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- 10.20.193.28:0/3010824936 shutdown_connections 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- 10.20.193.28:0/3010824936 wait complete. 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- start start 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 Processor -- start 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 0x555d72ba9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8c970 0x555d72ba9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72c18550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1400e480 con 0x555d72b919c0 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1400f8f0 con 0x555d72b8c970 2026-02-20T03:36:47.902 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.889+0000 7f8f77209e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1400eb50 con 0x555d72b8bff0 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f6ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72c18550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f6ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72c18550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42794/0 (socket says 10.20.193.28:42794) 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f6ed76640 1 -- 10.20.193.28:0/1132715492 learned_addr learned my addr 10.20.193.28:0/1132715492 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f6ed76640 1 -- 10.20.193.28:0/1132715492 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 msgr2=0x555d72ba9a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f6ed76640 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 0x555d72ba9a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f6ed76640 1 -- 10.20.193.28:0/1132715492 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8c970 msgr2=0x555d72ba9f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f6ed76640 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8c970 0x555d72ba9f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f6ed76640 1 -- 10.20.193.28:0/1132715492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d727b5870 con 0x555d72b919c0 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f6ed76640 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72c18550 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000f040 tx=0x7f8f600a8520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fde8606d4e917d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f1ffff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f1ffff640 1 -- 10.20.193.28:0/1132715492 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600a3d00 con 0x555d72b919c0 2026-02-20T03:36:47.903 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f1ffff640 1 -- 10.20.193.28:0/1132715492 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8f600ae260 con 0x555d72b919c0 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f1ffff640 1 -- 10.20.193.28:0/1132715492 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600ce270 con 0x555d72b919c0 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 1 -- 10.20.193.28:0/1132715492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d72a763f0 con 0x555d72b919c0 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f1ffff640 1 -- 10.20.193.28:0/1132715492 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8f600a33e0 con 0x555d72b919c0 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f1ffff640 10 client.21492 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 10 client.21492 _ll_register_callbacks cb 0x7f8f58002c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 1 -- 10.20.193.28:0/1132715492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d72aa77c0 con 0x555d72b919c0 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f1ffff640 1 -- 10.20.193.28:0/1132715492 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f8f600ae410 con 0x555d72b919c0 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 10 client.21492 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 1 -- 10.20.193.28:0/1132715492 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x555d72b9efb0 con 0x555d72b919c0 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f1ffff640 1 -- 10.20.193.28:0/1132715492 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f8f600a35e0 con 0x555d72b919c0 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 10 client.21492 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:47.904 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 10 client.21492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:47.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 20 client.21492 populate_metadata read hostname 'trial028' 2026-02-20T03:36:47.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555d72c212b0 0x555d72c23770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:47.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 4 client.21492 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:36:47.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.894+0000 7f8f77209e00 1 -- 10.20.193.28:0/1132715492 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d72a88ab0 con 0x555d72c212b0 2026-02-20T03:36:47.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.910+0000 7f8f6e575640 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555d72c212b0 0x555d72c23770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:47.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:47 trial177 ceph-mon[43181]: pgmap v849: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 8.1 KiB/s wr, 67 op/s 2026-02-20T03:36:47.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.977+0000 7f8f6e575640 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555d72c212b0 0x555d72c23770 crc :-1 s=READY pgs=558 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e78e22632ab25945 server_cookie=f26fdce0d260c6db in_seq=0 out_seq=0 2026-02-20T03:36:47.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.977+0000 7f8f1ffff640 10 client.21492 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:47.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f1ffff640 1 -- 10.20.193.28:0/1132715492 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d72a88ab0 con 0x555d72c212b0 2026-02-20T03:36:47.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f1ffff640 10 client.21492 handle_command_reply: tid=0 2026-02-20T03:36:47.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 client.21492 shutdown 2026-02-20T03:36:47.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 -- 10.20.193.28:0/1132715492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 msgr2=0x555d72c18550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:47.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72c18550 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000f040 tx=0x7f8f600a8520 comp rx=0 tx=0).stop 2026-02-20T03:36:47.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 -- 10.20.193.28:0/1132715492 shutdown_connections 2026-02-20T03:36:47.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555d72c212b0 0x555d72c23770 crc :-1 s=READY pgs=558 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555d72b919c0 0x555d72c18550 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555d72b8c970 0x555d72ba9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 --2- 10.20.193.28:0/1132715492 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555d72b8bff0 0x555d72ba9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:47.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f1ffff640 0 client.21492 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:47.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 -- 10.20.193.28:0/1132715492 >> 10.20.193.28:0/1132715492 conn(0x555d72b46240 msgr2=0x555d72bb4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:47.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 -- 10.20.193.28:0/1132715492 shutdown_connections 2026-02-20T03:36:47.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 1 -- 10.20.193.28:0/1132715492 wait complete. 2026-02-20T03:36:47.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f77209e00 20 client.21492 trim_cache size 0 max 16384 2026-02-20T03:36:47.995 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 -- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f480b0e20 msgr2=0x7f8f480b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f480b0e20 0x7f8f480b32e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8f640096f0 tx=0x7f8f64006cd0 comp rx=0 tx=0).stop 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 -- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f7010a980 msgr2=0x7f8f701a1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f7010a980 0x7f8f701a1b40 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000b990 tx=0x7f8f6000be60 comp rx=0 tx=0).stop 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 -- 10.20.193.28:0/1092795241 shutdown_connections 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8f480b0e20 0x7f8f480b32e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8f7010a980 0x7f8f701a1b40 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8f70105320 0x7f8f7019d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 --2- 10.20.193.28:0/1092795241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8f70104980 0x7f8f7019d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 -- 10.20.193.28:0/1092795241 >> 10.20.193.28:0/1092795241 conn(0x7f8f70100680 msgr2=0x7f8f70101090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 -- 10.20.193.28:0/1092795241 shutdown_connections 2026-02-20T03:36:48.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:47.990+0000 7f8f6f577640 1 -- 10.20.193.28:0/1092795241 wait complete. 2026-02-20T03:36:48.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184851 17.65 MB/sec execute 379 sec latency 73366.609 ms 2026-02-20T03:36:48.796 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:48 trial028 ceph-mon[38552]: pgmap v850: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 64 KiB/s rd, 8.4 KiB/s wr, 27 op/s 2026-02-20T03:36:48.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:48 trial177 ceph-mon[43181]: pgmap v850: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 64 KiB/s rd, 8.4 KiB/s wr, 27 op/s 2026-02-20T03:36:49.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:48 trial126 ceph-mon[38476]: pgmap v850: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 64 KiB/s rd, 8.4 KiB/s wr, 27 op/s 2026-02-20T03:36:49.155 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:36:49.155 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:36:49.443 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:49.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184856 17.60 MB/sec execute 380 sec latency 71630.499 ms 2026-02-20T03:36:49.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- 10.20.193.28:0/902164502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d741028d0 msgr2=0x7f2d74102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:49.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 --2- 10.20.193.28:0/902164502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d741028d0 0x7f2d74102d30 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009a60 tx=0x7f2d6402f290 comp rx=0 tx=0).stop 2026-02-20T03:36:49.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- 10.20.193.28:0/902164502 shutdown_connections 2026-02-20T03:36:49.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 --2- 10.20.193.28:0/902164502 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d74103270 0x7f2d7410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 --2- 10.20.193.28:0/902164502 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d741028d0 0x7f2d74102d30 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 --2- 10.20.193.28:0/902164502 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d741088d0 0x7f2d74108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- 10.20.193.28:0/902164502 >> 10.20.193.28:0/902164502 conn(0x7f2d740fe610 msgr2=0x7f2d74100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:49.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- 10.20.193.28:0/902164502 shutdown_connections 2026-02-20T03:36:49.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- 10.20.193.28:0/902164502 wait complete. 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 Processor -- start 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- start start 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d741028d0 0x7f2d7419d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d74103270 0x7f2d7419d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d741088d0 0x7f2d741a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74112bd0 con 0x7f2d74103270 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74112a50 con 0x7f2d741028d0 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74112d50 con 0x7f2d741088d0 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d72ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d74103270 0x7f2d7419d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d72ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d74103270 0x7f2d7419d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42798/0 (socket says 10.20.193.28:42798) 2026-02-20T03:36:49.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d72ffd640 1 -- 10.20.193.28:0/1348957302 learned_addr learned my addr 10.20.193.28:0/1348957302 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:49.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d72ffd640 1 -- 10.20.193.28:0/1348957302 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d741088d0 msgr2=0x7f2d741a1c60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:49.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d741088d0 0x7f2d741a1c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d72ffd640 1 -- 10.20.193.28:0/1348957302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d741028d0 msgr2=0x7f2d7419d390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:49.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d741028d0 0x7f2d7419d390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d72ffd640 1 -- 10.20.193.28:0/1348957302 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d741a23e0 con 0x7f2d74103270 2026-02-20T03:36:49.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d74103270 0x7f2d7419d8d0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009a30 tx=0x7f2d6402fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:49.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d70ff9640 1 -- 10.20.193.28:0/1348957302 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640044e0 con 0x7f2d74103270 2026-02-20T03:36:49.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d70ff9640 1 -- 10.20.193.28:0/1348957302 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d64004c60 con 0x7f2d74103270 2026-02-20T03:36:49.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d70ff9640 1 -- 10.20.193.28:0/1348957302 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64038490 con 0x7f2d74103270 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- 10.20.193.28:0/1348957302 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d741a2670 con 0x7f2d74103270 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.753+0000 7f2d79d11640 1 -- 10.20.193.28:0/1348957302 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d741a9f10 con 0x7f2d74103270 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d70ff9640 1 -- 10.20.193.28:0/1348957302 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2d64005050 con 0x7f2d74103270 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d7c216e00 1 Processor -- start 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d7c216e00 1 -- start start 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62e0630 0x55b0d62e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62dbee0 0x55b0d62dc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d62e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b0d622ec00 con 0x55b0d62dc8a0 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b0d61dc3c0 con 0x55b0d62dbee0 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b0d622ab30 con 0x55b0d62e0630 2026-02-20T03:36:49.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d72ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d62e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d72ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d62e85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42810/0 (socket says 10.20.193.28:42810) 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d72ffd640 1 -- 10.20.193.28:0/2268784323 learned_addr learned my addr 10.20.193.28:0/2268784323 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d72ffd640 1 -- 10.20.193.28:0/2268784323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62e0630 msgr2=0x55b0d62e0a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/2268784323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62e0630 0x55b0d62e0a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d72ffd640 1 -- 10.20.193.28:0/2268784323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62dbee0 msgr2=0x55b0d62dc360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/2268784323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62dbee0 0x55b0d62dc360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d72ffd640 1 -- 10.20.193.28:0/2268784323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d61d5840 con 0x55b0d62dc8a0 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d70ff9640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d480b0e20 0x7f2d480b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/2268784323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d62e85c0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f2d6410ba90 tx=0x7f2d6410bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6608649249e5791b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.758+0000 7f2d70ff9640 1 -- 10.20.193.28:0/1348957302 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2d64105840 con 0x7f2d74103270 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d73fff640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d480b0e20 0x7f2d480b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:49.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d37fff640 1 -- 10.20.193.28:0/2268784323 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640c9190 con 0x55b0d62dc8a0 2026-02-20T03:36:49.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d37fff640 1 -- 10.20.193.28:0/2268784323 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d64033030 con 0x55b0d62dc8a0 2026-02-20T03:36:49.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d37fff640 1 -- 10.20.193.28:0/2268784323 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640c9190 con 0x55b0d62dc8a0 2026-02-20T03:36:49.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2268784323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 msgr2=0x55b0d62e85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:49.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/2268784323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d62e85c0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f2d6410ba90 tx=0x7f2d6410bf60 comp rx=0 tx=0).stop 2026-02-20T03:36:49.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d73fff640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d480b0e20 0x7f2d480b32e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x55b0d62841e0 tx=0x7f2d68009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:49.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2268784323 shutdown_connections 2026-02-20T03:36:49.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/2268784323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d62e85c0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/2268784323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62dbee0 0x55b0d62dc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/2268784323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62e0630 0x55b0d62e0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2268784323 >> 10.20.193.28:0/2268784323 conn(0x55b0d62d4aa0 msgr2=0x55b0d62da5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2268784323 shutdown_connections 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2268784323 wait complete. 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- start start 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 Processor -- start 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d62fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62dc8a0 0x55b0d62fef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62e0630 0x55b0d62fd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b0d61d61a0 con 0x55b0d62dbee0 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b0d62e8b00 con 0x55b0d62e0630 2026-02-20T03:36:49.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b0d62fd900 con 0x55b0d62dc8a0 2026-02-20T03:36:49.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d62fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:49.778 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d62fea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42822/0 (socket says 10.20.193.28:42822) 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d737fe640 1 -- 10.20.193.28:0/93004276 learned_addr learned my addr 10.20.193.28:0/93004276 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d737fe640 1 -- 10.20.193.28:0/93004276 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62dc8a0 msgr2=0x55b0d62fef80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d737fe640 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62dc8a0 0x55b0d62fef80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d737fe640 1 -- 10.20.193.28:0/93004276 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62e0630 msgr2=0x55b0d62fd180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d737fe640 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62e0630 0x55b0d62fd180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d737fe640 1 -- 10.20.193.28:0/93004276 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d62ee180 con 0x55b0d62dbee0 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d737fe640 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d62fea40 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009f00 tx=0x7f2d6000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4def3bc972c0bb49 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d357fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d357fa640 1 -- 10.20.193.28:0/93004276 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60016070 con 0x55b0d62dbee0 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d357fa640 1 -- 10.20.193.28:0/93004276 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d60002780 con 0x55b0d62dbee0 2026-02-20T03:36:49.779 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d357fa640 1 -- 10.20.193.28:0/93004276 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d600117f0 con 0x55b0d62dbee0 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- 10.20.193.28:0/93004276 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0d5ffdb60 con 0x55b0d62dbee0 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d357fa640 1 -- 10.20.193.28:0/93004276 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2d60004270 con 0x55b0d62dbee0 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 10 client.21504 _ll_register_callbacks cb 0x55b0d61da0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- 10.20.193.28:0/93004276 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b0d62367f0 con 0x55b0d62dbee0 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d357fa640 1 -- 10.20.193.28:0/93004276 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f2d60002930 con 0x55b0d62dbee0 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 10 client.21504 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- 10.20.193.28:0/93004276 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55b0d61fb430 con 0x55b0d62dbee0 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d357fa640 1 -- 10.20.193.28:0/93004276 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f2d60002b60 con 0x55b0d62dbee0 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 10 client.21504 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 10 client.21504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 20 client.21504 populate_metadata read hostname 'trial028' 2026-02-20T03:36:49.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b0d630d300 0x55b0d630f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 4 client.21504 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:49.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.761+0000 7f2d7c216e00 1 -- 10.20.193.28:0/93004276 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0d61b0c00 con 0x55b0d630d300 2026-02-20T03:36:49.790 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.787+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b0d630d300 0x55b0d630f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:49.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.814+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b0d630d300 0x55b0d630f7a0 crc :-1 s=READY pgs=559 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83f13d1415ff36aa server_cookie=3932665e52f4b0c9 in_seq=0 out_seq=0 2026-02-20T03:36:49.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.814+0000 7f2d357fa640 10 client.21504 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:49.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d357fa640 1 -- 10.20.193.28:0/93004276 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b0d61b0c00 con 0x55b0d630d300 2026-02-20T03:36:49.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d357fa640 10 client.21504 handle_command_reply: tid=0 2026-02-20T03:36:49.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 client.21504 shutdown 2026-02-20T03:36:49.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 -- 10.20.193.28:0/93004276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 msgr2=0x55b0d62fea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:49.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d62fea40 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f2d60009f00 tx=0x7f2d6000b4b0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 -- 10.20.193.28:0/93004276 shutdown_connections 2026-02-20T03:36:49.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b0d630d300 0x55b0d630f7a0 crc :-1 s=READY pgs=559 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62e0630 0x55b0d62fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62dc8a0 0x55b0d62fef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/93004276 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d62fea40 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 -- 10.20.193.28:0/93004276 >> 10.20.193.28:0/93004276 conn(0x55b0d62d4aa0 msgr2=0x55b0d62df310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:49.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d357fa640 0 client.21504 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:49.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 -- 10.20.193.28:0/93004276 shutdown_connections 2026-02-20T03:36:49.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 1 -- 10.20.193.28:0/93004276 wait complete. 2026-02-20T03:36:49.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.828+0000 7f2d7c216e00 20 client.21504 trim_cache size 0 max 16384 2026-02-20T03:36:49.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d7c216e00 1 Processor -- start 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d7c216e00 1 -- start start 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62dbee0 0x55b0d63150b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d63155f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62e0630 0x55b0d63048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2d18012760 con 0x55b0d62dc8a0 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1800ff70 con 0x55b0d62e0630 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1800ddc0 con 0x55b0d62dbee0 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d72ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d63155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d72ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d63155f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42832/0 (socket says 10.20.193.28:42832) 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d72ffd640 1 -- 10.20.193.28:0/2382904996 learned_addr learned my addr 10.20.193.28:0/2382904996 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:49.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d72ffd640 1 -- 10.20.193.28:0/2382904996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62dbee0 msgr2=0x55b0d63150b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/2382904996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62dbee0 0x55b0d63150b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d72ffd640 1 -- 10.20.193.28:0/2382904996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62e0630 msgr2=0x55b0d63048d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/2382904996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62e0630 0x55b0d63048d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.834+0000 7f2d72ffd640 1 -- 10.20.193.28:0/2382904996 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d62edfb0 con 0x55b0d62dc8a0 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/2382904996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d63155f0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f2d6410b9b0 tx=0x7f2d64005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f65165f8dad62ac server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d377fe640 1 -- 10.20.193.28:0/2382904996 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640cca40 con 0x55b0d62dc8a0 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d377fe640 1 -- 10.20.193.28:0/2382904996 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2d640cdc20 con 0x55b0d62dc8a0 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d377fe640 1 -- 10.20.193.28:0/2382904996 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640ccc20 con 0x55b0d62dc8a0 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2382904996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 msgr2=0x55b0d63155f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/2382904996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d63155f0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f2d6410b9b0 tx=0x7f2d64005d90 comp rx=0 tx=0).stop 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2382904996 shutdown_connections 2026-02-20T03:36:49.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/2382904996 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62e0630 0x55b0d63048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/2382904996 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dc8a0 0x55b0d63155f0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/2382904996 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62dbee0 0x55b0d63150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2382904996 >> 10.20.193.28:0/2382904996 conn(0x55b0d62d4aa0 msgr2=0x55b0d62f3720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2382904996 shutdown_connections 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 -- 10.20.193.28:0/2382904996 wait complete. 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 -- start start 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 Processor -- start 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d6305080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62dc8a0 0x55b0d6302400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62e0630 0x55b0d6302940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1800e430 con 0x55b0d62dbee0 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1800f8a0 con 0x55b0d62dc8a0 2026-02-20T03:36:49.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d7c216e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1800eb00 con 0x55b0d62e0630 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d6305080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d6305080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42842/0 (socket says 10.20.193.28:42842) 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.839+0000 7f2d737fe640 1 -- 10.20.193.28:0/3761368555 learned_addr learned my addr 10.20.193.28:0/3761368555 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d737fe640 1 -- 10.20.193.28:0/3761368555 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62e0630 msgr2=0x55b0d6302940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d737fe640 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62e0630 0x55b0d6302940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d737fe640 1 -- 10.20.193.28:0/3761368555 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62dc8a0 msgr2=0x55b0d6302400 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d737fe640 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62dc8a0 0x55b0d6302400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d737fe640 1 -- 10.20.193.28:0/3761368555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d5f0d900 con 0x55b0d62dbee0 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d737fe640 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d6305080 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f2d60002e50 tx=0x7f2d60009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a7837bfab4cdb5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d357fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d357fa640 1 -- 10.20.193.28:0/3761368555 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60016040 con 0x55b0d62dbee0 2026-02-20T03:36:49.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d357fa640 1 -- 10.20.193.28:0/3761368555 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55b0d62367f0 con 0x55b0d62dbee0 2026-02-20T03:36:49.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d357fa640 1 -- 10.20.193.28:0/3761368555 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6001b640 con 0x55b0d62dbee0 2026-02-20T03:36:49.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 1 -- 10.20.193.28:0/3761368555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0d61e94d0 con 0x55b0d62dbee0 2026-02-20T03:36:49.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d357fa640 1 -- 10.20.193.28:0/3761368555 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2d6001b7e0 con 0x55b0d62dbee0 2026-02-20T03:36:49.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 10 client.21510 _ll_register_callbacks cb 0x7f2d60009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:49.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 1 -- 10.20.193.28:0/3761368555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d64033030 con 0x55b0d62dbee0 2026-02-20T03:36:49.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d357fa640 1 -- 10.20.193.28:0/3761368555 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f2d6002b060 con 0x55b0d62dbee0 2026-02-20T03:36:49.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 10 client.21510 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:49.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 1 -- 10.20.193.28:0/3761368555 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55b0d62eeca0 con 0x55b0d62dbee0 2026-02-20T03:36:49.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d357fa640 1 -- 10.20.193.28:0/3761368555 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f2d600117d0 con 0x55b0d62dbee0 2026-02-20T03:36:49.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 10 client.21510 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:49.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 10 client.21510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:49.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 20 client.21510 populate_metadata read hostname 'trial028' 2026-02-20T03:36:49.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b0d637a3c0 0x55b0d637c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:49.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 4 client.21510 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:36:49.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.842+0000 7f2d7c216e00 1 -- 10.20.193.28:0/3761368555 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b0d5f9ea20 con 0x55b0d637a3c0 2026-02-20T03:36:49.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.868+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b0d637a3c0 0x55b0d637c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:49.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.935+0000 7f2d72ffd640 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b0d637a3c0 0x55b0d637c880 crc :-1 s=READY pgs=560 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=386646d523d0775e server_cookie=41fd510433afc171 in_seq=0 out_seq=0 2026-02-20T03:36:49.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.935+0000 7f2d357fa640 10 client.21510 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:49.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d357fa640 1 -- 10.20.193.28:0/3761368555 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b0d5f9ea20 con 0x55b0d637a3c0 2026-02-20T03:36:49.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d357fa640 10 client.21510 handle_command_reply: tid=0 2026-02-20T03:36:49.951 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 client.21510 shutdown 2026-02-20T03:36:49.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 -- 10.20.193.28:0/3761368555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 msgr2=0x55b0d6305080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:49.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d6305080 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f2d60002e50 tx=0x7f2d60009d70 comp rx=0 tx=0).stop 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 -- 10.20.193.28:0/3761368555 shutdown_connections 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b0d637a3c0 0x55b0d637c880 crc :-1 s=READY pgs=560 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b0d62e0630 0x55b0d6302940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b0d62dc8a0 0x55b0d6302400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 --2- 10.20.193.28:0/3761368555 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b0d62dbee0 0x55b0d6305080 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d357fa640 0 client.21510 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 -- 10.20.193.28:0/3761368555 >> 10.20.193.28:0/3761368555 conn(0x55b0d62d4aa0 msgr2=0x55b0d62e1370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 -- 10.20.193.28:0/3761368555 shutdown_connections 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 1 -- 10.20.193.28:0/3761368555 wait complete. 2026-02-20T03:36:49.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d7c216e00 20 client.21510 trim_cache size 0 max 16384 2026-02-20T03:36:49.964 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:36:49.964 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:36:49.964 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "0c6aaafe-76f0-455a-81e4-62ad37589f23", 2026-02-20T03:36:49.965 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:36:49.965 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:36:49.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 -- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d480b0e20 msgr2=0x7f2d480b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d480b0e20 0x7f2d480b32e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x55b0d62841e0 tx=0x7f2d68009250 comp rx=0 tx=0).stop 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 -- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d74103270 msgr2=0x7f2d7419d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d74103270 0x7f2d7419d8d0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009a30 tx=0x7f2d6402fe20 comp rx=0 tx=0).stop 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 -- 10.20.193.28:0/1348957302 shutdown_connections 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2d480b0e20 0x7f2d480b32e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2d741088d0 0x7f2d741a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2d74103270 0x7f2d7419d8d0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 --2- 10.20.193.28:0/1348957302 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2d741028d0 0x7f2d7419d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 -- 10.20.193.28:0/1348957302 >> 10.20.193.28:0/1348957302 conn(0x7f2d740fe610 msgr2=0x7f2d7410e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:49.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 -- 10.20.193.28:0/1348957302 shutdown_connections 2026-02-20T03:36:49.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:49.948+0000 7f2d79d11640 1 -- 10.20.193.28:0/1348957302 wait complete. 2026-02-20T03:36:50.032 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:36:50.374 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:36:50.387 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:50 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:36:50.595 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:50 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:36:50.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:50 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:36:50.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 184856 17.56 MB/sec execute 381 sec latency 72630.538 ms 2026-02-20T03:36:50.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- 10.20.193.28:0/3399808896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01136a0 msgr2=0x7fbfc0115ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:50.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/3399808896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01136a0 0x7fbfc0115ad0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400b0a0 tx=0x7fbfb402f4e0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- 10.20.193.28:0/3399808896 shutdown_connections 2026-02-20T03:36:50.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/3399808896 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01136a0 0x7fbfc0115ad0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/3399808896 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbfc0075950 0x7fbfc0075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/3399808896 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbfc01067a0 0x7fbfc0075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- 10.20.193.28:0/3399808896 >> 10.20.193.28:0/3399808896 conn(0x7fbfc00fe610 msgr2=0x7fbfc0100a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:50.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- 10.20.193.28:0/3399808896 shutdown_connections 2026-02-20T03:36:50.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- 10.20.193.28:0/3399808896 wait complete. 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 Processor -- start 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- start start 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbfc0075950 0x7fbfc01a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01067a0 0x7fbfc01a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbfc01136a0 0x7fbfc01a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc0119350 con 0x7fbfc01067a0 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01191d0 con 0x7fbfc01136a0 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc01194d0 con 0x7fbfc0075950 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01067a0 0x7fbfc01a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01067a0 0x7fbfc01a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42856/0 (socket says 10.20.193.28:42856) 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbeffd640 1 -- 10.20.193.28:0/2264808220 learned_addr learned my addr 10.20.193.28:0/2264808220 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbeffd640 1 -- 10.20.193.28:0/2264808220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbfc0075950 msgr2=0x7fbfc01a1750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbeffd640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbfc0075950 0x7fbfc01a1750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbeffd640 1 -- 10.20.193.28:0/2264808220 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbfc01136a0 msgr2=0x7fbfc01a6020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:36:50.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbeffd640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbfc01136a0 0x7fbfc01a6020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbeffd640 1 -- 10.20.193.28:0/2264808220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc01a67a0 con 0x7fbfc01067a0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbeffd640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01067a0 0x7fbfc01a1c90 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000b570 tx=0x7fbfb000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbcff9640 1 -- 10.20.193.28:0/2264808220 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0013020 con 0x7fbfc01067a0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbcff9640 1 -- 10.20.193.28:0/2264808220 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbfb0004480 con 0x7fbfc01067a0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- 10.20.193.28:0/2264808220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc01a6a90 con 0x7fbfc01067a0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfbcff9640 1 -- 10.20.193.28:0/2264808220 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb000fb50 con 0x7fbfc01067a0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.736+0000 7fbfc5db4640 1 -- 10.20.193.28:0/2264808220 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc01ae2d0 con 0x7fbfc01067a0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfc82b9e00 1 Processor -- start 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbcff9640 1 -- 10.20.193.28:0/2264808220 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbfb0002780 con 0x7fbfc01067a0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfc82b9e00 1 -- start start 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 0x5632a2b73a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2b779f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b7fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5632a2af3e50 con 0x5632a2b78120 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5632a2ac69c0 con 0x5632a2b73fe0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5632a2a74240 con 0x5632a2b73630 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b7fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b7fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42866/0 (socket says 10.20.193.28:42866) 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbeffd640 1 -- 10.20.193.28:0/3618291422 learned_addr learned my addr 10.20.193.28:0/3618291422 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbeffd640 1 -- 10.20.193.28:0/3618291422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 msgr2=0x5632a2b73a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbeffd640 1 --2- 10.20.193.28:0/3618291422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 0x5632a2b73a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbeffd640 1 -- 10.20.193.28:0/3618291422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 msgr2=0x5632a2b779f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbeffd640 1 --2- 10.20.193.28:0/3618291422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2b779f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbeffd640 1 -- 10.20.193.28:0/3618291422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632a2a87420 con 0x5632a2b78120 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbfbeffd640 1 --2- 10.20.193.28:0/3618291422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b7fca0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00e6790 tx=0x7fbfb00e6c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710cc382b5be076d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbf83fff640 1 -- 10.20.193.28:0/3618291422 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00f3070 con 0x5632a2b78120 2026-02-20T03:36:50.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.741+0000 7fbf83fff640 1 -- 10.20.193.28:0/3618291422 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbfb00e0d80 con 0x5632a2b78120 2026-02-20T03:36:50.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbf83fff640 1 -- 10.20.193.28:0/3618291422 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00e8c00 con 0x5632a2b78120 2026-02-20T03:36:50.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbcff9640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbf940b0e20 0x7fbf940b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3618291422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 msgr2=0x5632a2b7fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:50.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3618291422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b7fca0 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fbfb00e6790 tx=0x7fbfb00e6c60 comp rx=0 tx=0).stop 2026-02-20T03:36:50.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbcff9640 1 -- 10.20.193.28:0/2264808220 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbfb00e0580 con 0x7fbfc01067a0 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbf940b0e20 0x7fbf940b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3618291422 shutdown_connections 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3618291422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b7fca0 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3618291422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2b779f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3618291422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 0x5632a2b73a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3618291422 >> 10.20.193.28:0/3618291422 conn(0x5632a2b36290 msgr2=0x5632a2b71d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3618291422 shutdown_connections 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3618291422 wait complete. 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbf940b0e20 0x7fbf940b32e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40095b0 tx=0x7fbfb4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- start start 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 Processor -- start 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 0x5632a2b90e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2b8c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b8c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5632a2ac28f0 con 0x5632a2b78120 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5632a28b4f50 con 0x5632a2b73fe0 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5632a2b8cd20 con 0x5632a2b73630 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b8c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b8c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42874/0 (socket says 10.20.193.28:42874) 2026-02-20T03:36:50.750 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 -- 10.20.193.28:0/3111744553 learned_addr learned my addr 10.20.193.28:0/3111744553 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:50.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 -- 10.20.193.28:0/3111744553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 msgr2=0x5632a2b90e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 0x5632a2b90e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 -- 10.20.193.28:0/3111744553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 msgr2=0x5632a2b8c1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2b8c1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 -- 10.20.193.28:0/3111744553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632a2b858e0 con 0x5632a2b78120 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfbffff640 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b8c700 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4002eb0 tx=0x7fbfb402f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863cfa4c01b79335 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbf817fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbf817fa640 1 -- 10.20.193.28:0/3111744553 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4002a60 con 0x5632a2b78120 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbf817fa640 1 -- 10.20.193.28:0/3111744553 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbfb40079d0 con 0x5632a2b78120 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbf817fa640 1 -- 10.20.193.28:0/3111744553 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4002a60 con 0x5632a2b78120 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3111744553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632a2897b40 con 0x5632a2b78120 2026-02-20T03:36:50.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 10 client.21522 _ll_register_callbacks cb 0x5632a2afff00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3111744553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5632a2ad41a0 con 0x5632a2b78120 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbf817fa640 1 -- 10.20.193.28:0/3111744553 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbfb4045860 con 0x5632a2b78120 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbf817fa640 1 -- 10.20.193.28:0/3111744553 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbfb4045b60 con 0x5632a2b78120 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 10 client.21522 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3111744553 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5632a2a81230 con 0x5632a2b78120 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbf817fa640 1 -- 10.20.193.28:0/3111744553 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fbfb4056070 con 0x5632a2b78120 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 10 client.21522 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 10 client.21522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 20 client.21522 populate_metadata read hostname 'trial028' 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5632a2bbea70 0x5632a2bc0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 4 client.21522 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:50.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.744+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3111744553 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632a2ace5b0 con 0x5632a2bbea70 2026-02-20T03:36:50.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.772+0000 7fbfbf7fe640 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5632a2bbea70 0x5632a2bc0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:50.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.839+0000 7fbfbf7fe640 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5632a2bbea70 0x5632a2bc0ec0 crc :-1 s=READY pgs=561 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e67dcd16005348ec server_cookie=ff5064197079d3e5 in_seq=0 out_seq=0 2026-02-20T03:36:50.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.839+0000 7fbf817fa640 10 client.21522 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:50.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbf817fa640 1 -- 10.20.193.28:0/3111744553 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5632a2ace5b0 con 0x5632a2bbea70 2026-02-20T03:36:50.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbf817fa640 10 client.21522 handle_command_reply: tid=0 2026-02-20T03:36:50.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 client.21522 shutdown 2026-02-20T03:36:50.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3111744553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 msgr2=0x5632a2b8c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:50.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b8c700 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4002eb0 tx=0x7fbfb402f4e0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3111744553 shutdown_connections 2026-02-20T03:36:50.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5632a2bbea70 0x5632a2bc0ec0 crc :-1 s=READY pgs=561 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2b8c700 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2b8c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/3111744553 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 0x5632a2b90e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3111744553 >> 10.20.193.28:0/3111744553 conn(0x5632a2b36290 msgr2=0x5632a2b76940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:50.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbf817fa640 0 client.21522 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:50.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3111744553 shutdown_connections 2026-02-20T03:36:50.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.852+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/3111744553 wait complete. 2026-02-20T03:36:50.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.865+0000 7fbfc82b9e00 20 client.21522 trim_cache size 0 max 16384 2026-02-20T03:36:50.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfc82b9e00 1 Processor -- start 2026-02-20T03:36:50.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfc82b9e00 1 -- start start 2026-02-20T03:36:50.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b73630 0x5632a2b6bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2b8b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b78120 0x5632a2b896e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64012890 con 0x5632a2b73630 2026-02-20T03:36:50.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbf640100a0 con 0x5632a2b73fe0 2026-02-20T03:36:50.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6400def0 con 0x5632a2b78120 2026-02-20T03:36:50.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfbf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b73630 0x5632a2b6bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfbf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b73630 0x5632a2b6bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42882/0 (socket says 10.20.193.28:42882) 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfbf7fe640 1 -- 10.20.193.28:0/2152103803 learned_addr learned my addr 10.20.193.28:0/2152103803 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfbf7fe640 1 -- 10.20.193.28:0/2152103803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b78120 msgr2=0x5632a2b896e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfbf7fe640 1 --2- 10.20.193.28:0/2152103803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b78120 0x5632a2b896e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfbf7fe640 1 -- 10.20.193.28:0/2152103803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 msgr2=0x5632a2b8b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfbf7fe640 1 --2- 10.20.193.28:0/2152103803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2b8b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfbf7fe640 1 -- 10.20.193.28:0/2152103803 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632a2b85710 con 0x5632a2b73630 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbfbf7fe640 1 --2- 10.20.193.28:0/2152103803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b73630 0x5632a2b6bb20 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009590 tx=0x7fbfac0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360e85350e5d5b11 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbf837fe640 1 -- 10.20.193.28:0/2152103803 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac015040 con 0x5632a2b73630 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbf837fe640 1 -- 10.20.193.28:0/2152103803 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbfac009dc0 con 0x5632a2b73630 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.871+0000 7fbf837fe640 1 -- 10.20.193.28:0/2152103803 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0183c0 con 0x5632a2b73630 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2152103803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b73630 msgr2=0x5632a2b6bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2152103803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b73630 0x5632a2b6bb20 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009590 tx=0x7fbfac0047e0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2152103803 shutdown_connections 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2152103803 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b78120 0x5632a2b896e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2152103803 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2b8b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2152103803 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b73630 0x5632a2b6bb20 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2152103803 >> 10.20.193.28:0/2152103803 conn(0x5632a2b36290 msgr2=0x5632a2b8a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2152103803 shutdown_connections 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2152103803 wait complete. 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- start start 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 Processor -- start 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 0x5632a2bba810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2bb4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2bb50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6400e560 con 0x5632a2b78120 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6400f9d0 con 0x5632a2b73fe0 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6400ec30 con 0x5632a2b73630 2026-02-20T03:36:50.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2bb50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2bb50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42894/0 (socket says 10.20.193.28:42894) 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfbffff640 1 -- 10.20.193.28:0/2568724054 learned_addr learned my addr 10.20.193.28:0/2568724054 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfbffff640 1 -- 10.20.193.28:0/2568724054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 msgr2=0x5632a2bba810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfbffff640 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 0x5632a2bba810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfbffff640 1 -- 10.20.193.28:0/2568724054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 msgr2=0x5632a2bb4ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfbffff640 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2bb4ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfbffff640 1 -- 10.20.193.28:0/2568724054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632a27a5870 con 0x5632a2b78120 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfbffff640 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2bb50d0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400b0a0 tx=0x7fbfb4045570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8bd21d40f1f124 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbf817fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbf817fa640 1 -- 10.20.193.28:0/2568724054 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4002c60 con 0x5632a2b78120 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2568724054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632a2a66440 con 0x5632a2b78120 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbf817fa640 1 -- 10.20.193.28:0/2568724054 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5632a2ad41a0 con 0x5632a2b78120 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 10 client.21528 _ll_register_callbacks cb 0x7fbfb4009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.876+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2568724054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5632a2b6c200 con 0x5632a2b78120 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbf817fa640 1 -- 10.20.193.28:0/2568724054 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb40586c0 con 0x5632a2b78120 2026-02-20T03:36:50.882 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbf817fa640 1 -- 10.20.193.28:0/2568724054 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbfb40079f0 con 0x5632a2b78120 2026-02-20T03:36:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbf817fa640 1 -- 10.20.193.28:0/2568724054 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fbfb40074c0 con 0x5632a2b78120 2026-02-20T03:36:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbfc82b9e00 10 client.21528 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:50.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2568724054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5632a2b86400 con 0x5632a2b78120 2026-02-20T03:36:50.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbf817fa640 1 -- 10.20.193.28:0/2568724054 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7fbfb405f070 con 0x5632a2b78120 2026-02-20T03:36:50.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbfc82b9e00 10 client.21528 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:50.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbfc82b9e00 10 client.21528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:50.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbfc82b9e00 20 client.21528 populate_metadata read hostname 'trial028' 2026-02-20T03:36:50.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5632a2c2acf0 0x5632a2c2d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:50.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbfc82b9e00 4 client.21528 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:36:50.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.879+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2568724054 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5632a2a78b00 con 0x5632a2c2acf0 2026-02-20T03:36:50.908 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.906+0000 7fbfbf7fe640 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5632a2c2acf0 0x5632a2c2d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:50.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.960+0000 7fbf817fa640 10 client.21528 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:50.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.960+0000 7fbfbf7fe640 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5632a2c2acf0 0x5632a2c2d1b0 crc :-1 s=READY pgs=562 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f641a868c82c3816 server_cookie=617d5b10d3d77083 in_seq=0 out_seq=0 2026-02-20T03:36:50.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbf817fa640 1 -- 10.20.193.28:0/2568724054 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5632a2a78b00 con 0x5632a2c2acf0 2026-02-20T03:36:50.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbf817fa640 10 client.21528 handle_command_reply: tid=0 2026-02-20T03:36:50.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbfc82b9e00 1 client.21528 shutdown 2026-02-20T03:36:50.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2568724054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 msgr2=0x5632a2bb50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:50.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2bb50d0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400b0a0 tx=0x7fbfb4045570 comp rx=0 tx=0).stop 2026-02-20T03:36:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2568724054 shutdown_connections 2026-02-20T03:36:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5632a2c2acf0 0x5632a2c2d1b0 crc :-1 s=READY pgs=562 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5632a2b78120 0x5632a2bb50d0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5632a2b73fe0 0x5632a2bb4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbfc82b9e00 1 --2- 10.20.193.28:0/2568724054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5632a2b73630 0x5632a2bba810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2568724054 >> 10.20.193.28:0/2568724054 conn(0x5632a2b36290 msgr2=0x5632a2b8b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.973+0000 7fbf817fa640 0 client.21528 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2568724054 shutdown_connections 2026-02-20T03:36:50.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc82b9e00 1 -- 10.20.193.28:0/2568724054 wait complete. 2026-02-20T03:36:50.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc82b9e00 20 client.21528 trim_cache size 0 max 16384 2026-02-20T03:36:50.990 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:36:50.990 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:36:50.991 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:36:50.991 INFO:teuthology.orchestra.run.trial028.stdout: "0c6aaafe-76f0-455a-81e4-62ad37589f23": { 2026-02-20T03:36:50.991 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:36:50.991 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "0c6aaafe-76f0-455a-81e4-62ad37589f23", 2026-02-20T03:36:50.991 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:36:50.991 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:36:50.991 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:36:50.991 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:36:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 -- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbf940b0e20 msgr2=0x7fbf940b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbf940b0e20 0x7fbf940b32e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40095b0 tx=0x7fbfb4009500 comp rx=0 tx=0).stop 2026-02-20T03:36:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 -- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01067a0 msgr2=0x7fbfc01a1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01067a0 0x7fbfc01a1c90 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000b570 tx=0x7fbfb000ba40 comp rx=0 tx=0).stop 2026-02-20T03:36:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 -- 10.20.193.28:0/2264808220 shutdown_connections 2026-02-20T03:36:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbf940b0e20 0x7fbf940b32e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbfc01136a0 0x7fbfc01a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbfc01067a0 0x7fbfc01a1c90 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 --2- 10.20.193.28:0/2264808220 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbfc0075950 0x7fbfc01a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:50.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 -- 10.20.193.28:0/2264808220 >> 10.20.193.28:0/2264808220 conn(0x7fbfc00fe610 msgr2=0x7fbfc0114d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:51.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 -- 10.20.193.28:0/2264808220 shutdown_connections 2026-02-20T03:36:51.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:36:50.986+0000 7fbfc5db4640 1 -- 10.20.193.28:0/2264808220 wait complete. 2026-02-20T03:36:51.213 INFO:tasks.cephfs.filesystem:scrub status for tag:0c6aaafe-76f0-455a-81e4-62ad37589f23 - {'path': '/', 'tag': '0c6aaafe-76f0-455a-81e4-62ad37589f23', 'options': 'recursive,force'} 2026-02-20T03:36:51.431 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:36:51.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:36:51.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:36:51.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: pgmap v851: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 119 KiB/s rd, 12 KiB/s wr, 24 op/s 2026-02-20T03:36:51.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:36:51.432 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.433 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.433 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.433 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:51 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:36:51.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:36:51.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:36:51.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: pgmap v851: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 119 KiB/s rd, 12 KiB/s wr, 24 op/s 2026-02-20T03:36:51.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:36:51.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.719 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:51 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 184856 17.51 MB/sec execute 382 sec latency 73630.575 ms 2026-02-20T03:36:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:36:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: pgmap v851: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 119 KiB/s rd, 12 KiB/s wr, 24 op/s 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:51.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:51 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:52.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 184856 17.47 MB/sec execute 383 sec latency 74630.617 ms 2026-02-20T03:36:53.051 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:53.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:53.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:52 trial028 ceph-mon[38552]: pgmap v852: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 122 KiB/s rd, 10 KiB/s wr, 42 op/s 2026-02-20T03:36:53.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:36:53.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:36:53.052 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:52 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:53.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:53.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:53.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:52 trial126 ceph-mon[38476]: pgmap v852: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 122 KiB/s rd, 10 KiB/s wr, 42 op/s 2026-02-20T03:36:53.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:36:53.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:36:53.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:52 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:53.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:53.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:53.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:52 trial177 ceph-mon[43181]: pgmap v852: 129 pgs: 129 active+clean; 661 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 122 KiB/s rd, 10 KiB/s wr, 42 op/s 2026-02-20T03:36:53.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:36:53.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:36:53.219 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:52 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:36:53.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 185339 17.47 MB/sec execute 384 sec latency 75009.060 ms 2026-02-20T03:36:54.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 186722 17.57 MB/sec execute 385 sec latency 74.340 ms 2026-02-20T03:36:55.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:55 trial177 ceph-mon[43181]: pgmap v853: 129 pgs: 129 active+clean; 663 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 333 KiB/s rd, 212 KiB/s wr, 81 op/s 2026-02-20T03:36:55.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 188394 17.82 MB/sec execute 386 sec latency 47.349 ms 2026-02-20T03:36:55.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:55 trial126 ceph-mon[38476]: pgmap v853: 129 pgs: 129 active+clean; 663 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 333 KiB/s rd, 212 KiB/s wr, 81 op/s 2026-02-20T03:36:55.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:55 trial028 ceph-mon[38552]: pgmap v853: 129 pgs: 129 active+clean; 663 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 333 KiB/s rd, 212 KiB/s wr, 81 op/s 2026-02-20T03:36:55.906 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.902+0000 7f0d499cf640 1 -- 10.20.193.28:0/2639820814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d441060d0 msgr2=0x7f0d44110f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:55.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.902+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2639820814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d441060d0 0x7f0d44110f90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000b0a0 tx=0x7f0d4002f4a0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.902+0000 7f0d499cf640 1 -- 10.20.193.28:0/2639820814 shutdown_connections 2026-02-20T03:36:55.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.902+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2639820814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d441060d0 0x7f0d44110f90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.902+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2639820814 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d44075ad0 0x7f0d44075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.903+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2639820814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d440770b0 0x7f0d44075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.903+0000 7f0d499cf640 1 -- 10.20.193.28:0/2639820814 >> 10.20.193.28:0/2639820814 conn(0x7f0d440fde10 msgr2=0x7f0d44100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:55.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.903+0000 7f0d499cf640 1 -- 10.20.193.28:0/2639820814 shutdown_connections 2026-02-20T03:36:55.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.903+0000 7f0d499cf640 1 -- 10.20.193.28:0/2639820814 wait complete. 2026-02-20T03:36:55.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.903+0000 7f0d499cf640 1 Processor -- start 2026-02-20T03:36:55.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.903+0000 7f0d499cf640 1 -- start start 2026-02-20T03:36:55.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d499cf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d44075ad0 0x7f0d441a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d499cf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d440770b0 0x7f0d441a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d499cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d441060d0 0x7f0d441a8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d499cf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44114900 con 0x7f0d441060d0 2026-02-20T03:36:55.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d499cf640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44114780 con 0x7f0d44075ad0 2026-02-20T03:36:55.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d499cf640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0d44114a80 con 0x7f0d440770b0 2026-02-20T03:36:55.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d491ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d441060d0 0x7f0d441a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d489cd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d44075ad0 0x7f0d441a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d489cd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d44075ad0 0x7f0d441a0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:57414/0 (socket says 10.20.193.28:57414) 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d489cd640 1 -- 10.20.193.28:0/2929109973 learned_addr learned my addr 10.20.193.28:0/2929109973 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d3bfff640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d440770b0 0x7f0d441a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d489cd640 1 -- 10.20.193.28:0/2929109973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d440770b0 msgr2=0x7f0d441a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d489cd640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d440770b0 0x7f0d441a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d489cd640 1 -- 10.20.193.28:0/2929109973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d441060d0 msgr2=0x7f0d441a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d489cd640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d441060d0 0x7f0d441a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.904+0000 7f0d489cd640 1 -- 10.20.193.28:0/2929109973 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d441a8ad0 con 0x7f0d44075ad0 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.905+0000 7f0d489cd640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d44075ad0 0x7f0d441a0eb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400ea10 tx=0x7f0d3400eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:55.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.905+0000 7f0d39ffb640 1 -- 10.20.193.28:0/2929109973 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400ce50 con 0x7f0d44075ad0 2026-02-20T03:36:55.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.905+0000 7f0d499cf640 1 -- 10.20.193.28:0/2929109973 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d441a8dc0 con 0x7f0d44075ad0 2026-02-20T03:36:55.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.905+0000 7f0d39ffb640 1 -- 10.20.193.28:0/2929109973 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d34004570 con 0x7f0d44075ad0 2026-02-20T03:36:55.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.905+0000 7f0d39ffb640 1 -- 10.20.193.28:0/2929109973 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34010690 con 0x7f0d44075ad0 2026-02-20T03:36:55.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.905+0000 7f0d499cf640 1 -- 10.20.193.28:0/2929109973 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d441a9280 con 0x7f0d44075ad0 2026-02-20T03:36:55.911 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.908+0000 7f0d39ffb640 1 -- 10.20.193.28:0/2929109973 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0d34020030 con 0x7f0d44075ad0 2026-02-20T03:36:55.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d4dabee00 1 Processor -- start 2026-02-20T03:36:55.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d4dabee00 1 -- start start 2026-02-20T03:36:55.912 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 0x55c2877cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c28770b8f0 con 0x55c2877d1970 2026-02-20T03:36:55.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c2876b92e0 con 0x55c2877cc290 2026-02-20T03:36:55.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c287707820 con 0x55c2877ccbd0 2026-02-20T03:36:55.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d489cd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d489cd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45304/0 (socket says 10.20.193.28:45304) 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d489cd640 1 -- 10.20.193.28:0/298706285 learned_addr learned my addr 10.20.193.28:0/298706285 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d3bfff640 1 --2- 10.20.193.28:0/298706285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d491ce640 1 --2- 10.20.193.28:0/298706285 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 0x55c2877cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.909+0000 7f0d489cd640 1 -- 10.20.193.28:0/298706285 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 msgr2=0x55c2877cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d489cd640 1 --2- 10.20.193.28:0/298706285 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 0x55c2877cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d489cd640 1 -- 10.20.193.28:0/298706285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 msgr2=0x55c2877d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d489cd640 1 --2- 10.20.193.28:0/298706285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877d3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d489cd640 1 -- 10.20.193.28:0/298706285 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2876ab5a0 con 0x55c2877ccbd0 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d489cd640 1 --2- 10.20.193.28:0/298706285 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877d1350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0d340e4d10 tx=0x7f0d340e9630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de00be298d89ea5a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d10ffe640 1 -- 10.20.193.28:0/298706285 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340ed480 con 0x55c2877ccbd0 2026-02-20T03:36:55.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d10ffe640 1 -- 10.20.193.28:0/298706285 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d340f2070 con 0x55c2877ccbd0 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d10ffe640 1 -- 10.20.193.28:0/298706285 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340ec850 con 0x55c2877ccbd0 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d4dabee00 1 -- 10.20.193.28:0/298706285 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 msgr2=0x55c2877d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/298706285 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877d1350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0d340e4d10 tx=0x7f0d340e9630 comp rx=0 tx=0).stop 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d4dabee00 1 -- 10.20.193.28:0/298706285 shutdown_connections 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/298706285 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877d3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/298706285 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877d1350 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/298706285 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 0x55c2877cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.910+0000 7f0d4dabee00 1 -- 10.20.193.28:0/298706285 >> 10.20.193.28:0/298706285 conn(0x55c2877b26f0 msgr2=0x55c2877b9570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.911+0000 7f0d4dabee00 1 -- 10.20.193.28:0/298706285 shutdown_connections 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.911+0000 7f0d4dabee00 1 -- 10.20.193.28:0/298706285 wait complete. 2026-02-20T03:36:55.916 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.911+0000 7f0d39ffb640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d200b0f20 0x7f0d200b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.917 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.911+0000 7f0d39ffb640 1 -- 10.20.193.28:0/2929109973 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0d340e0be0 con 0x7f0d44075ad0 2026-02-20T03:36:55.919 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.911+0000 7f0d491ce640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d200b0f20 0x7f0d200b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.912+0000 7f0d4dabee00 1 -- start start 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.912+0000 7f0d4dabee00 1 Processor -- start 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.912+0000 7f0d491ce640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d200b0f20 0x7f0d200b33e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000b070 tx=0x7f0d40009d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.913+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 0x55c2877e4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.913+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877e5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.913+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877ec0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.913+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c2876b30c0 con 0x55c2877d1970 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.913+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c2877d49c0 con 0x55c2877cc290 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.913+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c2877ec650 con 0x55c2877ccbd0 2026-02-20T03:36:55.920 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d491ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877ec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d3bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877e5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d491ce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877ec0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42932/0 (socket says 10.20.193.28:42932) 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d491ce640 1 -- 10.20.193.28:0/2497637728 learned_addr learned my addr 10.20.193.28:0/2497637728 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d489cd640 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 0x55c2877e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d491ce640 1 -- 10.20.193.28:0/2497637728 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 msgr2=0x55c2877e5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d491ce640 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877e5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d491ce640 1 -- 10.20.193.28:0/2497637728 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 msgr2=0x55c2877e4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d491ce640 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 0x55c2877e4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d491ce640 1 -- 10.20.193.28:0/2497637728 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2877de440 con 0x55c2877d1970 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d09ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:55.921 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d491ce640 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877ec0c0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f0d40004880 tx=0x7f0d4002f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fbff0ada5ccdee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.914+0000 7f0d09ffb640 1 -- 10.20.193.28:0/2497637728 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40002a60 con 0x55c2877d1970 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.915+0000 7f0d09ffb640 1 -- 10.20.193.28:0/2497637728 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d40033040 con 0x55c2877d1970 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.915+0000 7f0d09ffb640 1 -- 10.20.193.28:0/2497637728 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40045680 con 0x55c2877d1970 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.915+0000 7f0d4dabee00 1 -- 10.20.193.28:0/2497637728 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2876c7820 con 0x55c2877d1970 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.915+0000 7f0d4dabee00 10 client.21540 _ll_register_callbacks cb 0x55c2876b6ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.915+0000 7f0d4dabee00 1 -- 10.20.193.28:0/2497637728 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c2877134e0 con 0x55c2877d1970 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.915+0000 7f0d09ffb640 1 -- 10.20.193.28:0/2497637728 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0d40002c00 con 0x55c2877d1970 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.915+0000 7f0d09ffb640 1 -- 10.20.193.28:0/2497637728 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0d40002e40 con 0x55c2877d1970 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.915+0000 7f0d4dabee00 10 client.21540 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.915+0000 7f0d4dabee00 1 -- 10.20.193.28:0/2497637728 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55c2876cc380 con 0x55c2877d1970 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.916+0000 7f0d09ffb640 1 -- 10.20.193.28:0/2497637728 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f0d4004d070 con 0x55c2877d1970 2026-02-20T03:36:55.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.916+0000 7f0d4dabee00 10 client.21540 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:55.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.916+0000 7f0d4dabee00 10 client.21540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:55.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.916+0000 7f0d4dabee00 20 client.21540 populate_metadata read hostname 'trial028' 2026-02-20T03:36:55.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.916+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c2877f0a30 0x55c2877f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.916+0000 7f0d4dabee00 4 client.21540 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:36:55.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.916+0000 7f0d4dabee00 1 -- 10.20.193.28:0/2497637728 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c28768dbd0 con 0x55c2877f0a30 2026-02-20T03:36:55.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.916+0000 7f0d489cd640 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c2877f0a30 0x55c2877f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.917+0000 7f0d489cd640 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c2877f0a30 0x55c2877f2ef0 crc :-1 s=READY pgs=563 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c3ea7cab9fbcd7e server_cookie=20b1e046f92f8cb6 in_seq=0 out_seq=0 2026-02-20T03:36:55.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.917+0000 7f0d09ffb640 10 client.21540 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:55.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.917+0000 7f0d09ffb640 1 -- 10.20.193.28:0/2497637728 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c28768dbd0 con 0x55c2877f0a30 2026-02-20T03:36:55.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.917+0000 7f0d09ffb640 10 client.21540 handle_command_reply: tid=0 2026-02-20T03:36:55.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.917+0000 7f0d4dabee00 1 client.21540 shutdown 2026-02-20T03:36:55.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 -- 10.20.193.28:0/2497637728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 msgr2=0x55c2877ec0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:55.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877ec0c0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f0d40004880 tx=0x7f0d4002f4a0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 -- 10.20.193.28:0/2497637728 shutdown_connections 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c2877f0a30 0x55c2877f2ef0 crc :-1 s=READY pgs=563 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877d1970 0x55c2877ec0c0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877ccbd0 0x55c2877e5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/2497637728 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877cc290 0x55c2877e4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 -- 10.20.193.28:0/2497637728 >> 10.20.193.28:0/2497637728 conn(0x55c2877b26f0 msgr2=0x55c2877d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d09ffb640 0 client.21540 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 -- 10.20.193.28:0/2497637728 shutdown_connections 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 1 -- 10.20.193.28:0/2497637728 wait complete. 2026-02-20T03:36:55.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.918+0000 7f0d4dabee00 20 client.21540 trim_cache size 0 max 16384 2026-02-20T03:36:55.928 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.925+0000 7f0d4dabee00 1 Processor -- start 2026-02-20T03:36:55.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.925+0000 7f0d4dabee00 1 -- start start 2026-02-20T03:36:55.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877cc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 0x55c2877e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 0x55c2877ec080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8012830 con 0x55c2877cc290 2026-02-20T03:36:55.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce8010040 con 0x55c2877ccbd0 2026-02-20T03:36:55.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce800de90 con 0x55c2877d1970 2026-02-20T03:36:55.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d3bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 0x55c2877e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d3bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 0x55c2877e3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:57444/0 (socket says 10.20.193.28:57444) 2026-02-20T03:36:55.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d3bfff640 1 -- 10.20.193.28:0/3875489058 learned_addr learned my addr 10.20.193.28:0/3875489058 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:55.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d489cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d491ce640 1 --2- 10.20.193.28:0/3875489058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 0x55c2877ec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d489cd640 1 -- 10.20.193.28:0/3875489058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 msgr2=0x55c2877ec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:55.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d489cd640 1 --2- 10.20.193.28:0/3875489058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 0x55c2877ec080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d489cd640 1 -- 10.20.193.28:0/3875489058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 msgr2=0x55c2877e3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:55.931 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d489cd640 1 --2- 10.20.193.28:0/3875489058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 0x55c2877e3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d489cd640 1 -- 10.20.193.28:0/3875489058 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2877de270 con 0x55c2877cc290 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.926+0000 7f0d491ce640 1 --2- 10.20.193.28:0/3875489058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 0x55c2877ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.927+0000 7f0d489cd640 1 --2- 10.20.193.28:0/3875489058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877cc670 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c770 tx=0x7f0d340e4620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e60501ab109fc0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.927+0000 7f0d0bfff640 1 -- 10.20.193.28:0/3875489058 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340a8690 con 0x55c2877cc290 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.927+0000 7f0d0bfff640 1 -- 10.20.193.28:0/3875489058 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d340a8fc0 con 0x55c2877cc290 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.927+0000 7f0d0bfff640 1 -- 10.20.193.28:0/3875489058 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340a7de0 con 0x55c2877cc290 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.927+0000 7f0d4dabee00 1 -- 10.20.193.28:0/3875489058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 msgr2=0x55c2877cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.927+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/3875489058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877cc670 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c770 tx=0x7f0d340e4620 comp rx=0 tx=0).stop 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.928+0000 7f0d4dabee00 1 -- 10.20.193.28:0/3875489058 shutdown_connections 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.928+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/3875489058 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 0x55c2877ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.928+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/3875489058 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 0x55c2877e3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.932 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.928+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/3875489058 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877cc670 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.928+0000 7f0d4dabee00 1 -- 10.20.193.28:0/3875489058 >> 10.20.193.28:0/3875489058 conn(0x55c2877b26f0 msgr2=0x55c2877b9570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:55.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.928+0000 7f0d4dabee00 1 -- 10.20.193.28:0/3875489058 shutdown_connections 2026-02-20T03:36:55.933 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.928+0000 7f0d4dabee00 1 -- 10.20.193.28:0/3875489058 wait complete. 2026-02-20T03:36:55.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.928+0000 7f0d4dabee00 1 -- start start 2026-02-20T03:36:55.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.928+0000 7f0d4dabee00 1 Processor -- start 2026-02-20T03:36:55.935 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 0x55c2877ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d4dabee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 0x55c2877eb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce800e500 con 0x55c2877cc290 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce800f970 con 0x55c2877ccbd0 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d4dabee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce800ebd0 con 0x55c2877d1970 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d489cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d489cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877e9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42944/0 (socket says 10.20.193.28:42944) 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d489cd640 1 -- 10.20.193.28:0/46723387 learned_addr learned my addr 10.20.193.28:0/46723387 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d491ce640 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 0x55c2877eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d3bfff640 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 0x55c2877ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d489cd640 1 -- 10.20.193.28:0/46723387 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 msgr2=0x55c2877eb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d489cd640 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 0x55c2877eb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d489cd640 1 -- 10.20.193.28:0/46723387 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 msgr2=0x55c2877ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d489cd640 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 0x55c2877ea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d489cd640 1 -- 10.20.193.28:0/46723387 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2877b9c80 con 0x55c2877cc290 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d489cd640 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877e9da0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0d340a85c0 tx=0x7f0d340e9630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65012680c944871 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.929+0000 7f0d09ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d09ffb640 1 -- 10.20.193.28:0/46723387 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340a7fc0 con 0x55c2877cc290 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d09ffb640 1 -- 10.20.193.28:0/46723387 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0d340acc70 con 0x55c2877cc290 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d09ffb640 1 -- 10.20.193.28:0/46723387 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d340de2d0 con 0x55c2877cc290 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d4dabee00 1 -- 10.20.193.28:0/46723387 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c28746b690 con 0x55c2877cc290 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d09ffb640 1 -- 10.20.193.28:0/46723387 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0d340a4900 con 0x55c2877cc290 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d4dabee00 10 client.21546 _ll_register_callbacks cb 0x7f0d40004740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:36:55.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d4dabee00 1 -- 10.20.193.28:0/46723387 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d340f2070 con 0x55c2877cc290 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d09ffb640 1 -- 10.20.193.28:0/46723387 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0d340a8690 con 0x55c2877cc290 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d4dabee00 10 client.21546 fetch_fsmap learned FSMap version 48 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.930+0000 7f0d4dabee00 1 -- 10.20.193.28:0/46723387 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=48}) -- 0x55c2876d0b70 con 0x55c2877cc290 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d09ffb640 1 -- 10.20.193.28:0/46723387 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 48) ==== 8378+0+0 (secure 0 0 0) 0x7f0d34002900 con 0x55c2877cc290 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d4dabee00 10 client.21546 fetch_fsmap finished waiting for FSMap version 48 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d4dabee00 10 client.21546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d4dabee00 20 client.21546 populate_metadata read hostname 'trial028' 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c28785bd50 0x55c28785e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d4dabee00 4 client.21546 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d4dabee00 1 -- 10.20.193.28:0/46723387 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2874e4520 con 0x55c28785bd50 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d3bfff640 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c28785bd50 0x55c28785e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:36:55.938 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d3bfff640 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c28785bd50 0x55c28785e1c0 crc :-1 s=READY pgs=564 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=342c102e2104f01c server_cookie=3547f944bb5d16e6 in_seq=0 out_seq=0 2026-02-20T03:36:55.939 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:55.931+0000 7f0d09ffb640 10 client.21546 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:56.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.136+0000 7f0d09ffb640 1 -- 10.20.193.28:0/46723387 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2874e4520 con 0x55c28785bd50 2026-02-20T03:36:56.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.136+0000 7f0d09ffb640 10 client.21546 handle_command_reply: tid=0 2026-02-20T03:36:56.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 client.21546 shutdown 2026-02-20T03:36:56.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 -- 10.20.193.28:0/46723387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 msgr2=0x55c2877e9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:56.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877e9da0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0d340a85c0 tx=0x7f0d340e9630 comp rx=0 tx=0).stop 2026-02-20T03:36:56.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 -- 10.20.193.28:0/46723387 shutdown_connections 2026-02-20T03:36:56.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c28785bd50 0x55c28785e1c0 crc :-1 s=READY pgs=564 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:56.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c2877d1970 0x55c2877eb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:56.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c2877ccbd0 0x55c2877ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:56.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 --2- 10.20.193.28:0/46723387 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c2877cc290 0x55c2877e9da0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:56.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 -- 10.20.193.28:0/46723387 >> 10.20.193.28:0/46723387 conn(0x55c2877b26f0 msgr2=0x55c2877e19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:56.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d09ffb640 0 client.21546 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:36:56.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 -- 10.20.193.28:0/46723387 shutdown_connections 2026-02-20T03:36:56.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 1 -- 10.20.193.28:0/46723387 wait complete. 2026-02-20T03:36:56.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.137+0000 7f0d4dabee00 20 client.21546 trim_cache size 0 max 16384 2026-02-20T03:36:56.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:36:56.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:36:56.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:36:56.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:36:56.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 -- 10.20.193.28:0/2929109973 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d200b0f20 msgr2=0x7f0d200b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d200b0f20 0x7f0d200b33e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000b070 tx=0x7f0d40009d00 comp rx=0 tx=0).stop 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 -- 10.20.193.28:0/2929109973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d44075ad0 msgr2=0x7f0d441a0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d44075ad0 0x7f0d441a0eb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400ea10 tx=0x7f0d3400eee0 comp rx=0 tx=0).stop 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 -- 10.20.193.28:0/2929109973 shutdown_connections 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0d200b0f20 0x7f0d200b33e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0d441060d0 0x7f0d441a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0d440770b0 0x7f0d441a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 --2- 10.20.193.28:0/2929109973 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0d44075ad0 0x7f0d441a0eb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 -- 10.20.193.28:0/2929109973 >> 10.20.193.28:0/2929109973 conn(0x7f0d440fde10 msgr2=0x7f0d44102020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:36:56.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.139+0000 7f0d499cf640 1 -- 10.20.193.28:0/2929109973 shutdown_connections 2026-02-20T03:36:56.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:36:56.140+0000 7f0d499cf640 1 -- 10.20.193.28:0/2929109973 wait complete. 2026-02-20T03:36:56.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 189287 17.87 MB/sec execute 387 sec latency 120.666 ms 2026-02-20T03:36:57.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:57 trial028 ceph-mon[38552]: pgmap v854: 129 pgs: 129 active+clean; 656 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.6 MiB/s rd, 531 KiB/s wr, 138 op/s 2026-02-20T03:36:57.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:57 trial177 ceph-mon[43181]: pgmap v854: 129 pgs: 129 active+clean; 656 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.6 MiB/s rd, 531 KiB/s wr, 138 op/s 2026-02-20T03:36:57.722 INFO:tasks.workunit.client.0.trial028.stdout: 10 191178 18.09 MB/sec execute 388 sec latency 27.787 ms 2026-02-20T03:36:57.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:57 trial126 ceph-mon[38476]: pgmap v854: 129 pgs: 129 active+clean; 656 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 2.6 MiB/s rd, 531 KiB/s wr, 138 op/s 2026-02-20T03:36:58.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 192409 18.21 MB/sec execute 389 sec latency 45.327 ms 2026-02-20T03:36:59.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:36:59 trial028 ceph-mon[38552]: pgmap v855: 129 pgs: 129 active+clean; 662 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 MiB/s rd, 1.6 MiB/s wr, 302 op/s 2026-02-20T03:36:59.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:36:59 trial177 ceph-mon[43181]: pgmap v855: 129 pgs: 129 active+clean; 662 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 MiB/s rd, 1.6 MiB/s wr, 302 op/s 2026-02-20T03:36:59.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 194028 18.37 MB/sec execute 390 sec latency 41.047 ms 2026-02-20T03:36:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:36:59 trial126 ceph-mon[38476]: pgmap v855: 129 pgs: 129 active+clean; 662 MiB data, 9.3 GiB used, 8.2 TiB / 8.2 TiB avail; 5.8 MiB/s rd, 1.6 MiB/s wr, 302 op/s 2026-02-20T03:37:00.605 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:00 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:00.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:00 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:00.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 195609 18.59 MB/sec execute 391 sec latency 27.562 ms 2026-02-20T03:37:00.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:00 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:01 trial177 ceph-mon[43181]: pgmap v856: 129 pgs: 129 active+clean; 668 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 3.7 MiB/s wr, 625 op/s 2026-02-20T03:37:01.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 196970 18.70 MB/sec execute 392 sec latency 71.341 ms 2026-02-20T03:37:01.746 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:01 trial126 ceph-mon[38476]: pgmap v856: 129 pgs: 129 active+clean; 668 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 3.7 MiB/s wr, 625 op/s 2026-02-20T03:37:01.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:01 trial028 ceph-mon[38552]: pgmap v856: 129 pgs: 129 active+clean; 668 MiB data, 9.4 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 3.7 MiB/s wr, 625 op/s 2026-02-20T03:37:02.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 198777 18.91 MB/sec execute 393 sec latency 71.719 ms 2026-02-20T03:37:03.487 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:03 trial028 ceph-mon[38552]: pgmap v857: 129 pgs: 129 active+clean; 675 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 5.0 MiB/s wr, 754 op/s 2026-02-20T03:37:03.487 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:03 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:37:03.488 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:03 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:37:03.488 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:03 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:37:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:03 trial177 ceph-mon[43181]: pgmap v857: 129 pgs: 129 active+clean; 675 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 5.0 MiB/s wr, 754 op/s 2026-02-20T03:37:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:03 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:37:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:03 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:37:03.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:03 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:37:03.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 200017 19.01 MB/sec execute 394 sec latency 41.517 ms 2026-02-20T03:37:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:03 trial126 ceph-mon[38476]: pgmap v857: 129 pgs: 129 active+clean; 675 MiB data, 9.5 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 5.0 MiB/s wr, 754 op/s 2026-02-20T03:37:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:03 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:37:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:03 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:37:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:03 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:37:04.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 201584 19.19 MB/sec execute 395 sec latency 40.826 ms 2026-02-20T03:37:05.552 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:05 trial028 ceph-mon[38552]: pgmap v858: 129 pgs: 129 active+clean; 683 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 6.2 MiB/s wr, 872 op/s 2026-02-20T03:37:05.552 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:05 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:05.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:05 trial177 ceph-mon[43181]: pgmap v858: 129 pgs: 129 active+clean; 683 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 6.2 MiB/s wr, 872 op/s 2026-02-20T03:37:05.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:05 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:05.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 202826 19.31 MB/sec execute 396 sec latency 61.279 ms 2026-02-20T03:37:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:05 trial126 ceph-mon[38476]: pgmap v858: 129 pgs: 129 active+clean; 683 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 6.2 MiB/s wr, 872 op/s 2026-02-20T03:37:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:05 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:06.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 204301 19.45 MB/sec execute 397 sec latency 40.540 ms 2026-02-20T03:37:07.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:07 trial028 ceph-mon[38552]: pgmap v859: 129 pgs: 129 active+clean; 691 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 7.7 MiB/s wr, 1.03k op/s 2026-02-20T03:37:07.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:07 trial177 ceph-mon[43181]: pgmap v859: 129 pgs: 129 active+clean; 691 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 7.7 MiB/s wr, 1.03k op/s 2026-02-20T03:37:07.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 205869 19.63 MB/sec execute 398 sec latency 38.157 ms 2026-02-20T03:37:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:07 trial126 ceph-mon[38476]: pgmap v859: 129 pgs: 129 active+clean; 691 MiB data, 9.6 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 7.7 MiB/s wr, 1.03k op/s 2026-02-20T03:37:08.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 207132 19.75 MB/sec execute 399 sec latency 59.287 ms 2026-02-20T03:37:09.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.221+0000 7fd48212a640 1 -- 10.20.193.28:0/3941885611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd47c078cf0 msgr2=0x7fd47c079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:09.223 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.221+0000 7fd48212a640 1 --2- 10.20.193.28:0/3941885611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd47c078cf0 0x7fd47c079150 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fd478009f90 tx=0x7fd47802f390 comp rx=0 tx=0).stop 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.222+0000 7fd48212a640 1 -- 10.20.193.28:0/3941885611 shutdown_connections 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.222+0000 7fd48212a640 1 --2- 10.20.193.28:0/3941885611 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd47c079690 0x7fd47c079f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.222+0000 7fd48212a640 1 --2- 10.20.193.28:0/3941885611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd47c078cf0 0x7fd47c079150 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.222+0000 7fd48212a640 1 --2- 10.20.193.28:0/3941885611 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd47c077ab0 0x7fd47c077eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.222+0000 7fd48212a640 1 -- 10.20.193.28:0/3941885611 >> 10.20.193.28:0/3941885611 conn(0x7fd47c1000c0 msgr2=0x7fd47c1024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.222+0000 7fd48212a640 1 -- 10.20.193.28:0/3941885611 shutdown_connections 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.222+0000 7fd48212a640 1 -- 10.20.193.28:0/3941885611 wait complete. 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd48212a640 1 Processor -- start 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd48212a640 1 -- start start 2026-02-20T03:37:09.224 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd48212a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd47c077ab0 0x7fd47c10f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd48212a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd47c078cf0 0x7fd47c10f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd48212a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd47c079690 0x7fd47c1b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd48212a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c114920 con 0x7fd47c078cf0 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd48212a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c1147a0 con 0x7fd47c077ab0 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd48212a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd47c114aa0 con 0x7fd47c079690 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd481929640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd47c079690 0x7fd47c1b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd481929640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd47c079690 0x7fd47c1b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45456/0 (socket says 10.20.193.28:45456) 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd481929640 1 -- 10.20.193.28:0/1860543675 learned_addr learned my addr 10.20.193.28:0/1860543675 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd480927640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd47c078cf0 0x7fd47c10f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd481128640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd47c077ab0 0x7fd47c10f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd480927640 1 -- 10.20.193.28:0/1860543675 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd47c079690 msgr2=0x7fd47c1b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd480927640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd47c079690 0x7fd47c1b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd480927640 1 -- 10.20.193.28:0/1860543675 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd47c077ab0 msgr2=0x7fd47c10f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd480927640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd47c077ab0 0x7fd47c10f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.223+0000 7fd480927640 1 -- 10.20.193.28:0/1860543675 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47c112ae0 con 0x7fd47c078cf0 2026-02-20T03:37:09.225 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.224+0000 7fd480927640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd47c078cf0 0x7fd47c10f8d0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fd478036000 tx=0x7fd478030e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:09.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.224+0000 7fd46a7fc640 1 -- 10.20.193.28:0/1860543675 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478002c60 con 0x7fd47c078cf0 2026-02-20T03:37:09.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.224+0000 7fd46a7fc640 1 -- 10.20.193.28:0/1860543675 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd4780048f0 con 0x7fd47c078cf0 2026-02-20T03:37:09.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.224+0000 7fd46a7fc640 1 -- 10.20.193.28:0/1860543675 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4780387a0 con 0x7fd47c078cf0 2026-02-20T03:37:09.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.224+0000 7fd48212a640 1 -- 10.20.193.28:0/1860543675 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd47c1b18b0 con 0x7fd47c078cf0 2026-02-20T03:37:09.226 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.225+0000 7fd48212a640 1 -- 10.20.193.28:0/1860543675 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd47c1b1d20 con 0x7fd47c078cf0 2026-02-20T03:37:09.230 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.229+0000 7fd486215e00 1 Processor -- start 2026-02-20T03:37:09.231 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.230+0000 7fd486215e00 1 -- start start 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.230+0000 7fd486215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.230+0000 7fd486215e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40ca7c0 0x55dbd40cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.230+0000 7fd486215e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40cf560 0x55dbd40d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.230+0000 7fd486215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dbd401a8f0 con 0x55dbd40c9e80 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.230+0000 7fd486215e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dbd3fc82e0 con 0x55dbd40ca7c0 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.230+0000 7fd486215e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dbd4016820 con 0x55dbd40cf560 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481128640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40ca7c0 0x55dbd40cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481128640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40ca7c0 0x55dbd40cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36706/0 (socket says 10.20.193.28:36706) 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481128640 1 -- 10.20.193.28:0/816128106 learned_addr learned my addr 10.20.193.28:0/816128106 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481929640 1 --2- 10.20.193.28:0/816128106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481128640 1 -- 10.20.193.28:0/816128106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40cf560 msgr2=0x55dbd40d19f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:37:09.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481128640 1 --2- 10.20.193.28:0/816128106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40cf560 0x55dbd40d19f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481128640 1 -- 10.20.193.28:0/816128106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 msgr2=0x55dbd40ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:09.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481128640 1 --2- 10.20.193.28:0/816128106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481128640 1 -- 10.20.193.28:0/816128106 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd3fba5a0 con 0x55dbd40ca7c0 2026-02-20T03:37:09.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.231+0000 7fd481128640 1 --2- 10.20.193.28:0/816128106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40ca7c0 0x55dbd40cef40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd46c004750 tx=0x7fd46c009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f160e45cdae1639d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:09.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.232+0000 7fd4497fe640 1 -- 10.20.193.28:0/816128106 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c011440 con 0x55dbd40ca7c0 2026-02-20T03:37:09.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.232+0000 7fd4497fe640 1 -- 10.20.193.28:0/816128106 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd46c015070 con 0x55dbd40ca7c0 2026-02-20T03:37:09.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.232+0000 7fd4497fe640 1 -- 10.20.193.28:0/816128106 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c010b20 con 0x55dbd40ca7c0 2026-02-20T03:37:09.233 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.232+0000 7fd486215e00 1 -- 10.20.193.28:0/816128106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40ca7c0 msgr2=0x55dbd40cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:09.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.232+0000 7fd486215e00 1 --2- 10.20.193.28:0/816128106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40ca7c0 0x55dbd40cef40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd46c004750 tx=0x7fd46c009ba0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.233+0000 7fd486215e00 1 -- 10.20.193.28:0/816128106 shutdown_connections 2026-02-20T03:37:09.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.233+0000 7fd46a7fc640 1 -- 10.20.193.28:0/1860543675 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd478038940 con 0x7fd47c078cf0 2026-02-20T03:37:09.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.233+0000 7fd486215e00 1 --2- 10.20.193.28:0/816128106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40cf560 0x55dbd40d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.233+0000 7fd486215e00 1 --2- 10.20.193.28:0/816128106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40ca7c0 0x55dbd40cef40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.233+0000 7fd486215e00 1 --2- 10.20.193.28:0/816128106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.234 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.233+0000 7fd486215e00 1 -- 10.20.193.28:0/816128106 >> 10.20.193.28:0/816128106 conn(0x55dbd40c16f0 msgr2=0x55dbd40c8570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:09.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.234+0000 7fd486215e00 1 -- 10.20.193.28:0/816128106 shutdown_connections 2026-02-20T03:37:09.236 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.234+0000 7fd486215e00 1 -- 10.20.193.28:0/816128106 wait complete. 2026-02-20T03:37:09.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.235+0000 7fd46a7fc640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4580b0e00 0x7fd4580b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.237 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.235+0000 7fd46a7fc640 1 -- 10.20.193.28:0/1860543675 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd478105450 con 0x7fd47c078cf0 2026-02-20T03:37:09.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.236+0000 7fd486215e00 1 -- start start 2026-02-20T03:37:09.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.236+0000 7fd481929640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4580b0e00 0x7fd4580b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.238 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.236+0000 7fd486215e00 1 Processor -- start 2026-02-20T03:37:09.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.237+0000 7fd481929640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4580b0e00 0x7fd4580b32c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd470005fd0 tx=0x7fd4700074e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:09.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd486215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40e2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd486215e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.239 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd481128640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd481128640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40e2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42034/0 (socket says 10.20.193.28:42034) 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd481128640 1 -- 10.20.193.28:0/2094530109 learned_addr learned my addr 10.20.193.28:0/2094530109 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd486215e00 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 0x55dbd40e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dbd3fc20c0 con 0x55dbd40c9e80 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dbd40d2610 con 0x55dbd40cf560 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dbd40ea290 con 0x55dbd40ca7c0 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.238+0000 7fd480927640 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.239+0000 7fd481929640 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 0x55dbd40e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.239+0000 7fd481128640 1 -- 10.20.193.28:0/2094530109 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 msgr2=0x55dbd40e2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.239+0000 7fd481128640 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.239+0000 7fd481128640 1 -- 10.20.193.28:0/2094530109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 msgr2=0x55dbd40e9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.239+0000 7fd481128640 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 0x55dbd40e9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.240 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.239+0000 7fd481128640 1 -- 10.20.193.28:0/2094530109 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd40dc180 con 0x55dbd40c9e80 2026-02-20T03:37:09.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.239+0000 7fd481128640 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40e2840 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fd46c010a80 tx=0x7fd46c010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc9281441ab8663 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:09.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.239+0000 7fd43e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:09.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.240+0000 7fd43e7fc640 1 -- 10.20.193.28:0/2094530109 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c010de0 con 0x55dbd40c9e80 2026-02-20T03:37:09.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.240+0000 7fd43e7fc640 1 -- 10.20.193.28:0/2094530109 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd46c0118e0 con 0x55dbd40c9e80 2026-02-20T03:37:09.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.240+0000 7fd43e7fc640 1 -- 10.20.193.28:0/2094530109 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c01b910 con 0x55dbd40c9e80 2026-02-20T03:37:09.241 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.240+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd3fd6820 con 0x55dbd40c9e80 2026-02-20T03:37:09.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.240+0000 7fd486215e00 10 client.21558 _ll_register_callbacks cb 0x55dbd3fc5ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:09.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.240+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dbd40224e0 con 0x55dbd40c9e80 2026-02-20T03:37:09.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.240+0000 7fd43e7fc640 1 -- 10.20.193.28:0/2094530109 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd46c011a90 con 0x55dbd40c9e80 2026-02-20T03:37:09.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.240+0000 7fd43e7fc640 1 -- 10.20.193.28:0/2094530109 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fd46c02c060 con 0x55dbd40c9e80 2026-02-20T03:37:09.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.241+0000 7fd486215e00 10 client.21558 fetch_fsmap learned FSMap version 50 2026-02-20T03:37:09.242 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.241+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=50}) -- 0x55dbd3fdb380 con 0x55dbd40c9e80 2026-02-20T03:37:09.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.242+0000 7fd43e7fc640 1 -- 10.20.193.28:0/2094530109 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7fd46c011440 con 0x55dbd40c9e80 2026-02-20T03:37:09.243 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.242+0000 7fd486215e00 10 client.21558 fetch_fsmap finished waiting for FSMap version 50 2026-02-20T03:37:09.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.242+0000 7fd486215e00 10 client.21558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:09.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.242+0000 7fd486215e00 20 client.21558 populate_metadata read hostname 'trial028' 2026-02-20T03:37:09.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.242+0000 7fd486215e00 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dbd40ee1e0 0x55dbd40f0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.242+0000 7fd486215e00 4 client.21558 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:09.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.242+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbd3f9cbd0 con 0x55dbd40ee1e0 2026-02-20T03:37:09.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.242+0000 7fd480927640 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dbd40ee1e0 0x55dbd40f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.243+0000 7fd480927640 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dbd40ee1e0 0x55dbd40f0610 crc :-1 s=READY pgs=565 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa005b8e52f6dc9d server_cookie=6c868de6b983afb1 in_seq=0 out_seq=0 2026-02-20T03:37:09.244 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.243+0000 7fd43e7fc640 10 client.21558 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:09.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd43e7fc640 1 -- 10.20.193.28:0/2094530109 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55dbd3f9cbd0 con 0x55dbd40ee1e0 2026-02-20T03:37:09.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd43e7fc640 10 client.21558 handle_command_reply: tid=0 2026-02-20T03:37:09.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 client.21558 shutdown 2026-02-20T03:37:09.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 msgr2=0x55dbd40e2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:09.245 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40e2840 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fd46c010a80 tx=0x7fd46c010ab0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 shutdown_connections 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dbd40ee1e0 0x55dbd40f0610 crc :-1 s=READY pgs=565 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 0x55dbd40e9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 --2- 10.20.193.28:0/2094530109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40c9e80 0x55dbd40e2840 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd43e7fc640 0 client.21558 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 >> 10.20.193.28:0/2094530109 conn(0x55dbd40c16f0 msgr2=0x55dbd40d08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 shutdown_connections 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 1 -- 10.20.193.28:0/2094530109 wait complete. 2026-02-20T03:37:09.246 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.244+0000 7fd486215e00 20 client.21558 trim_cache size 0 max 16384 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.252+0000 7fd486215e00 1 Processor -- start 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.252+0000 7fd486215e00 1 -- start start 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.252+0000 7fd486215e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40c9e80 0x55dbd40cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.252+0000 7fd486215e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.252+0000 7fd486215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40cf560 0x55dbd40e00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.252+0000 7fd486215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c012730 con 0x55dbd40cf560 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.252+0000 7fd486215e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00ff70 con 0x55dbd40c9e80 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.252+0000 7fd486215e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00ddc0 con 0x55dbd40ca7c0 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd481128640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40c9e80 0x55dbd40cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd481128640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40c9e80 0x55dbd40cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:36710/0 (socket says 10.20.193.28:36710) 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd480927640 1 --2- 10.20.193.28:0/3417348923 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd481128640 1 -- 10.20.193.28:0/3417348923 learned_addr learned my addr 10.20.193.28:0/3417348923 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd480927640 1 -- 10.20.193.28:0/3417348923 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40c9e80 msgr2=0x55dbd40cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd480927640 1 --2- 10.20.193.28:0/3417348923 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40c9e80 0x55dbd40cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd480927640 1 -- 10.20.193.28:0/3417348923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40cf560 msgr2=0x55dbd40e00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd480927640 1 --2- 10.20.193.28:0/3417348923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40cf560 0x55dbd40e00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd480927640 1 -- 10.20.193.28:0/3417348923 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd40dbfb0 con 0x55dbd40ca7c0 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd480927640 1 --2- 10.20.193.28:0/3417348923 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e9c70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd478009f90 tx=0x7fd478102990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98956c47919c4b39 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd448ffd640 1 -- 10.20.193.28:0/3417348923 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4780d6390 con 0x55dbd40ca7c0 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd448ffd640 1 -- 10.20.193.28:0/3417348923 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd478033070 con 0x55dbd40ca7c0 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.253+0000 7fd448ffd640 1 -- 10.20.193.28:0/3417348923 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4780cc9f0 con 0x55dbd40ca7c0 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.254+0000 7fd486215e00 1 -- 10.20.193.28:0/3417348923 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 msgr2=0x55dbd40e9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.254+0000 7fd486215e00 1 --2- 10.20.193.28:0/3417348923 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e9c70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd478009f90 tx=0x7fd478102990 comp rx=0 tx=0).stop 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.254+0000 7fd486215e00 1 -- 10.20.193.28:0/3417348923 shutdown_connections 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.254+0000 7fd486215e00 1 --2- 10.20.193.28:0/3417348923 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40cf560 0x55dbd40e00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.254+0000 7fd486215e00 1 --2- 10.20.193.28:0/3417348923 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e9c70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.254+0000 7fd486215e00 1 --2- 10.20.193.28:0/3417348923 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40c9e80 0x55dbd40cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.254+0000 7fd486215e00 1 -- 10.20.193.28:0/3417348923 >> 10.20.193.28:0/3417348923 conn(0x55dbd40c16f0 msgr2=0x55dbd40cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.254+0000 7fd486215e00 1 -- 10.20.193.28:0/3417348923 shutdown_connections 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.254+0000 7fd486215e00 1 -- 10.20.193.28:0/3417348923 wait complete. 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.255+0000 7fd486215e00 1 -- start start 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.255+0000 7fd486215e00 1 Processor -- start 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.255+0000 7fd486215e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40c9e80 0x55dbd40e5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.255+0000 7fd486215e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.255+0000 7fd486215e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 0x55dbd40e9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.255+0000 7fd486215e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00e430 con 0x55dbd40ca7c0 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.255+0000 7fd486215e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00f8a0 con 0x55dbd40cf560 2026-02-20T03:37:09.258 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.255+0000 7fd486215e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c00eb00 con 0x55dbd40c9e80 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.256+0000 7fd481929640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 0x55dbd40e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.256+0000 7fd481128640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40c9e80 0x55dbd40e5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.256+0000 7fd481128640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40c9e80 0x55dbd40e5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45488/0 (socket says 10.20.193.28:45488) 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.256+0000 7fd481128640 1 -- 10.20.193.28:0/3756912761 learned_addr learned my addr 10.20.193.28:0/3756912761 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.256+0000 7fd481128640 1 -- 10.20.193.28:0/3756912761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 msgr2=0x55dbd40e9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.256+0000 7fd481128640 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 0x55dbd40e9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.256+0000 7fd481128640 1 -- 10.20.193.28:0/3756912761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40ca7c0 msgr2=0x55dbd40e63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.256+0000 7fd481128640 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.256+0000 7fd481128640 1 -- 10.20.193.28:0/3756912761 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbd40ea330 con 0x55dbd40c9e80 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd481128640 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40c9e80 0x55dbd40e5e60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009380 tx=0x7fd46c005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee314b7f13e5962c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd43e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd43e7fc640 1 -- 10.20.193.28:0/3756912761 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c03d070 con 0x55dbd40c9e80 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd43e7fc640 1 -- 10.20.193.28:0/3756912761 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55dbd40224e0 con 0x55dbd40c9e80 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd43e7fc640 1 -- 10.20.193.28:0/3756912761 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c038910 con 0x55dbd40c9e80 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd486215e00 1 -- 10.20.193.28:0/3756912761 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbd3d7a690 con 0x55dbd40c9e80 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd486215e00 10 client.28708 _ll_register_callbacks cb 0x7fd46c004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd486215e00 1 -- 10.20.193.28:0/3756912761 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd46c015070 con 0x55dbd40c9e80 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd43e7fc640 1 -- 10.20.193.28:0/3756912761 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd46c01b470 con 0x55dbd40c9e80 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd43e7fc640 1 -- 10.20.193.28:0/3756912761 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fd46c01b770 con 0x55dbd40c9e80 2026-02-20T03:37:09.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.257+0000 7fd486215e00 10 client.28708 fetch_fsmap learned FSMap version 50 2026-02-20T03:37:09.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.258+0000 7fd486215e00 1 -- 10.20.193.28:0/3756912761 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=50}) -- 0x55dbd3fdfb70 con 0x55dbd40c9e80 2026-02-20T03:37:09.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.258+0000 7fd43e7fc640 1 -- 10.20.193.28:0/3756912761 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7fd46c04a060 con 0x55dbd40c9e80 2026-02-20T03:37:09.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.258+0000 7fd486215e00 10 client.28708 fetch_fsmap finished waiting for FSMap version 50 2026-02-20T03:37:09.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.258+0000 7fd486215e00 10 client.28708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:09.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.258+0000 7fd486215e00 20 client.28708 populate_metadata read hostname 'trial028' 2026-02-20T03:37:09.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.258+0000 7fd486215e00 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dbd419ea40 0x55dbd41a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:09.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.258+0000 7fd486215e00 4 client.28708 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:37:09.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.258+0000 7fd486215e00 1 -- 10.20.193.28:0/3756912761 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dbd3feb6b0 con 0x55dbd419ea40 2026-02-20T03:37:09.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.258+0000 7fd480927640 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dbd419ea40 0x55dbd41a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:09.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.259+0000 7fd43e7fc640 10 client.28708 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:09.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.259+0000 7fd480927640 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dbd419ea40 0x55dbd41a0f00 crc :-1 s=READY pgs=566 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38533476dbe6cc79 server_cookie=88f67bd7b8a16ad3 in_seq=0 out_seq=0 2026-02-20T03:37:09.469 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:09 trial028 ceph-mon[38552]: pgmap v860: 129 pgs: 129 active+clean; 697 MiB data, 9.7 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.1 MiB/s wr, 1.05k op/s 2026-02-20T03:37:09.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 208089 19.82 MB/sec execute 400 sec latency 409.870 ms 2026-02-20T03:37:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:09 trial126 ceph-mon[38476]: pgmap v860: 129 pgs: 129 active+clean; 697 MiB data, 9.7 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.1 MiB/s wr, 1.05k op/s 2026-02-20T03:37:09.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.867+0000 7fd43e7fc640 1 -- 10.20.193.28:0/3756912761 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dbd3feb6b0 con 0x55dbd419ea40 2026-02-20T03:37:09.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.867+0000 7fd43e7fc640 10 client.28708 handle_command_reply: tid=0 2026-02-20T03:37:09.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.867+0000 7fd486215e00 1 client.28708 shutdown 2026-02-20T03:37:09.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.867+0000 7fd486215e00 1 -- 10.20.193.28:0/3756912761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40c9e80 msgr2=0x55dbd40e5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:09.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.867+0000 7fd486215e00 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40c9e80 0x55dbd40e5e60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009380 tx=0x7fd46c005760 comp rx=0 tx=0).stop 2026-02-20T03:37:09.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd486215e00 1 -- 10.20.193.28:0/3756912761 shutdown_connections 2026-02-20T03:37:09.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd486215e00 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55dbd419ea40 0x55dbd41a0f00 crc :-1 s=READY pgs=566 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd486215e00 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dbd40cf560 0x55dbd40e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd486215e00 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dbd40ca7c0 0x55dbd40e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd486215e00 1 --2- 10.20.193.28:0/3756912761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dbd40c9e80 0x55dbd40e5e60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd486215e00 1 -- 10.20.193.28:0/3756912761 >> 10.20.193.28:0/3756912761 conn(0x55dbd40c16f0 msgr2=0x55dbd40df0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:09.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd43e7fc640 0 client.28708 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:09.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd486215e00 1 -- 10.20.193.28:0/3756912761 shutdown_connections 2026-02-20T03:37:09.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd486215e00 1 -- 10.20.193.28:0/3756912761 wait complete. 2026-02-20T03:37:09.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd486215e00 20 client.28708 trim_cache size 0 max 16384 2026-02-20T03:37:09.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:37:09.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:37:09.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:37:09.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:37:09.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 -- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4580b0e00 msgr2=0x7fd4580b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:09.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4580b0e00 0x7fd4580b32c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd470005fd0 tx=0x7fd4700074e0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 -- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd47c078cf0 msgr2=0x7fd47c10f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:09.873 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd47c078cf0 0x7fd47c10f8d0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fd478036000 tx=0x7fd478030e70 comp rx=0 tx=0).stop 2026-02-20T03:37:09.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 -- 10.20.193.28:0/1860543675 shutdown_connections 2026-02-20T03:37:09.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd4580b0e00 0x7fd4580b32c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd47c079690 0x7fd47c1b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd47c078cf0 0x7fd47c10f8d0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 --2- 10.20.193.28:0/1860543675 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd47c077ab0 0x7fd47c10f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:09.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 -- 10.20.193.28:0/1860543675 >> 10.20.193.28:0/1860543675 conn(0x7fd47c1000c0 msgr2=0x7fd47c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:09.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 -- 10.20.193.28:0/1860543675 shutdown_connections 2026-02-20T03:37:09.874 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:09.868+0000 7fd48212a640 1 -- 10.20.193.28:0/1860543675 wait complete. 2026-02-20T03:37:09.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:09 trial177 ceph-mon[43181]: pgmap v860: 129 pgs: 129 active+clean; 697 MiB data, 9.7 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.1 MiB/s wr, 1.05k op/s 2026-02-20T03:37:10.723 INFO:tasks.workunit.client.0.trial028.stdout: 10 209354 19.95 MB/sec execute 401 sec latency 462.461 ms 2026-02-20T03:37:11.724 INFO:tasks.workunit.client.0.trial028.stdout: 10 210425 20.03 MB/sec execute 402 sec latency 62.042 ms 2026-02-20T03:37:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:11 trial126 ceph-mon[38476]: pgmap v861: 129 pgs: 129 active+clean; 696 MiB data, 9.7 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 9.0 MiB/s wr, 1.18k op/s 2026-02-20T03:37:11.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:11 trial028 ceph-mon[38552]: pgmap v861: 129 pgs: 129 active+clean; 696 MiB data, 9.7 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 9.0 MiB/s wr, 1.18k op/s 2026-02-20T03:37:11.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:11 trial177 ceph-mon[43181]: pgmap v861: 129 pgs: 129 active+clean; 696 MiB data, 9.7 GiB used, 8.2 TiB / 8.2 TiB avail; 26 MiB/s rd, 9.0 MiB/s wr, 1.18k op/s 2026-02-20T03:37:12.724 INFO:tasks.workunit.client.0.trial028.stdout: 10 211989 20.21 MB/sec execute 403 sec latency 47.328 ms 2026-02-20T03:37:13.724 INFO:tasks.workunit.client.0.trial028.stdout: 10 213133 20.30 MB/sec execute 404 sec latency 68.072 ms 2026-02-20T03:37:13.736 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:13 trial028 ceph-mon[38552]: pgmap v862: 129 pgs: 129 active+clean; 700 MiB data, 9.8 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 7.8 MiB/s wr, 1.04k op/s 2026-02-20T03:37:13.736 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:13 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:13 trial126 ceph-mon[38476]: pgmap v862: 129 pgs: 129 active+clean; 700 MiB data, 9.8 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 7.8 MiB/s wr, 1.04k op/s 2026-02-20T03:37:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:13 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:13.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:13 trial177 ceph-mon[43181]: pgmap v862: 129 pgs: 129 active+clean; 700 MiB data, 9.8 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 7.8 MiB/s wr, 1.04k op/s 2026-02-20T03:37:13.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:13 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:14.725 INFO:tasks.workunit.client.0.trial028.stdout: 10 214615 20.43 MB/sec execute 405 sec latency 35.297 ms 2026-02-20T03:37:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:15 trial028 ceph-mon[38552]: pgmap v863: 129 pgs: 129 active+clean; 711 MiB data, 9.8 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.0 MiB/s wr, 1.17k op/s 2026-02-20T03:37:15.725 INFO:tasks.workunit.client.0.trial028.stdout: 10 216156 20.62 MB/sec execute 406 sec latency 43.862 ms 2026-02-20T03:37:15.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:15 trial126 ceph-mon[38476]: pgmap v863: 129 pgs: 129 active+clean; 711 MiB data, 9.8 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.0 MiB/s wr, 1.17k op/s 2026-02-20T03:37:15.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:15 trial177 ceph-mon[43181]: pgmap v863: 129 pgs: 129 active+clean; 711 MiB data, 9.8 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.0 MiB/s wr, 1.17k op/s 2026-02-20T03:37:16.725 INFO:tasks.workunit.client.0.trial028.stdout: 10 217177 20.68 MB/sec execute 407 sec latency 46.143 ms 2026-02-20T03:37:17.724 INFO:tasks.workunit.client.0.trial028.stdout: 10 218812 20.84 MB/sec execute 408 sec latency 51.810 ms 2026-02-20T03:37:17.778 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:17 trial028 ceph-mon[38552]: pgmap v864: 129 pgs: 129 active+clean; 719 MiB data, 9.9 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.5 MiB/s wr, 1.26k op/s 2026-02-20T03:37:17.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:17 trial126 ceph-mon[38476]: pgmap v864: 129 pgs: 129 active+clean; 719 MiB data, 9.9 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.5 MiB/s wr, 1.26k op/s 2026-02-20T03:37:17.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:17 trial177 ceph-mon[43181]: pgmap v864: 129 pgs: 129 active+clean; 719 MiB data, 9.9 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.5 MiB/s wr, 1.26k op/s 2026-02-20T03:37:18.730 INFO:tasks.workunit.client.0.trial028.stdout: 10 220081 20.98 MB/sec execute 409 sec latency 35.308 ms 2026-02-20T03:37:19.730 INFO:tasks.workunit.client.0.trial028.stdout: 10 221170 21.05 MB/sec execute 410 sec latency 56.151 ms 2026-02-20T03:37:19.749 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:19 trial028 ceph-mon[38552]: pgmap v865: 129 pgs: 129 active+clean; 723 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 7.2 MiB/s wr, 1.12k op/s 2026-02-20T03:37:19.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:19 trial126 ceph-mon[38476]: pgmap v865: 129 pgs: 129 active+clean; 723 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 7.2 MiB/s wr, 1.12k op/s 2026-02-20T03:37:19.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:19 trial177 ceph-mon[43181]: pgmap v865: 129 pgs: 129 active+clean; 723 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 22 MiB/s rd, 7.2 MiB/s wr, 1.12k op/s 2026-02-20T03:37:20.730 INFO:tasks.workunit.client.0.trial028.stdout: 10 222744 21.22 MB/sec execute 411 sec latency 55.962 ms 2026-02-20T03:37:21.215 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:37:21.581 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:37:21.602 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:21 trial028 ceph-mon[38552]: pgmap v866: 129 pgs: 129 active+clean; 745 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.8 MiB/s wr, 1.31k op/s 2026-02-20T03:37:21.730 INFO:tasks.workunit.client.0.trial028.stdout: 10 223789 21.29 MB/sec execute 412 sec latency 64.428 ms 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.809+0000 7fbde3841640 1 -- 10.20.193.28:0/1129439660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc10a470 msgr2=0x7fbddc10a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.809+0000 7fbde3841640 1 --2- 10.20.193.28:0/1129439660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc10a470 0x7fbddc10a850 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00dec0 tx=0x7fbdcc033370 comp rx=0 tx=0).stop 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.811+0000 7fbde3841640 1 -- 10.20.193.28:0/1129439660 shutdown_connections 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.811+0000 7fbde3841640 1 --2- 10.20.193.28:0/1129439660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbddc115df0 0x7fbddc1181e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.811+0000 7fbde3841640 1 --2- 10.20.193.28:0/1129439660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbddc10ad90 0x7fbddc1158b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.811+0000 7fbde3841640 1 --2- 10.20.193.28:0/1129439660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc10a470 0x7fbddc10a850 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.811+0000 7fbde3841640 1 -- 10.20.193.28:0/1129439660 >> 10.20.193.28:0/1129439660 conn(0x7fbddc06ed80 msgr2=0x7fbddc06f190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.811+0000 7fbde3841640 1 -- 10.20.193.28:0/1129439660 shutdown_connections 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.811+0000 7fbde3841640 1 -- 10.20.193.28:0/1129439660 wait complete. 2026-02-20T03:37:21.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.812+0000 7fbde3841640 1 Processor -- start 2026-02-20T03:37:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.812+0000 7fbde3841640 1 -- start start 2026-02-20T03:37:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde3841640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbddc10a470 0x7fbddc1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde3841640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbddc10ad90 0x7fbddc1a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde3841640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc115df0 0x7fbddc1a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde3841640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc1192e0 con 0x7fbddc10a470 2026-02-20T03:37:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde3841640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc119160 con 0x7fbddc10ad90 2026-02-20T03:37:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde3841640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc119460 con 0x7fbddc115df0 2026-02-20T03:37:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde1db7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc115df0 0x7fbddc1a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde1db7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc115df0 0x7fbddc1a5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43136/0 (socket says 10.20.193.28:43136) 2026-02-20T03:37:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde1db7640 1 -- 10.20.193.28:0/2992949868 learned_addr learned my addr 10.20.193.28:0/2992949868 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.813+0000 7fbde0db5640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbddc10ad90 0x7fbddc1a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.814+0000 7fbde1db7640 1 -- 10.20.193.28:0/2992949868 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbddc10ad90 msgr2=0x7fbddc1a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.814+0000 7fbde1db7640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbddc10ad90 0x7fbddc1a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.814+0000 7fbde1db7640 1 -- 10.20.193.28:0/2992949868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbddc10a470 msgr2=0x7fbddc1a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.814+0000 7fbde1db7640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbddc10a470 0x7fbddc1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.814+0000 7fbde1db7640 1 -- 10.20.193.28:0/2992949868 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc1a6770 con 0x7fbddc115df0 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.814+0000 7fbde1db7640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc115df0 0x7fbddc1a5ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80047e0 tx=0x7fbdd800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.814+0000 7fbdca7fc640 1 -- 10.20.193.28:0/2992949868 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80090d0 con 0x7fbddc115df0 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.815+0000 7fbde3841640 1 -- 10.20.193.28:0/2992949868 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc1a6a00 con 0x7fbddc115df0 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.815+0000 7fbdca7fc640 1 -- 10.20.193.28:0/2992949868 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbdd8009270 con 0x7fbddc115df0 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.815+0000 7fbdca7fc640 1 -- 10.20.193.28:0/2992949868 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80090d0 con 0x7fbddc115df0 2026-02-20T03:37:21.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.815+0000 7fbde3841640 1 -- 10.20.193.28:0/2992949868 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbddc1ae2a0 con 0x7fbddc115df0 2026-02-20T03:37:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.818+0000 7fbdca7fc640 1 -- 10.20.193.28:0/2992949868 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbdd8012070 con 0x7fbddc115df0 2026-02-20T03:37:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.819+0000 7fbdca7fc640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdac0b1020 0x7fbdac0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.820+0000 7fbdca7fc640 1 -- 10.20.193.28:0/2992949868 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbdd80e0ed0 con 0x7fbddc115df0 2026-02-20T03:37:21.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.820+0000 7fbde15b6640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdac0b1020 0x7fbdac0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.835+0000 7fbde15b6640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdac0b1020 0x7fbdac0b34e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00dec0 tx=0x7fbdcc00f010 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:21.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.835+0000 7fbde5d46e00 1 Processor -- start 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde5d46e00 1 -- start start 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6965040 0x5570b6965420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b6969400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6969b30 0x5570b69716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5570b68dce50 con 0x5570b6965040 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5570b68af9c0 con 0x5570b6969b30 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5570b685d240 con 0x5570b69659f0 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde0db5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b6969400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde0db5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b6969400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43148/0 (socket says 10.20.193.28:43148) 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde0db5640 1 -- 10.20.193.28:0/853213517 learned_addr learned my addr 10.20.193.28:0/853213517 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.836+0000 7fbde1db7640 1 --2- 10.20.193.28:0/853213517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6969b30 0x5570b69716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.837+0000 7fbde0db5640 1 -- 10.20.193.28:0/853213517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6969b30 msgr2=0x5570b69716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.837+0000 7fbde0db5640 1 --2- 10.20.193.28:0/853213517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6969b30 0x5570b69716b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.837+0000 7fbde0db5640 1 -- 10.20.193.28:0/853213517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6965040 msgr2=0x5570b6965420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.837+0000 7fbde0db5640 1 --2- 10.20.193.28:0/853213517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6965040 0x5570b6965420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.837+0000 7fbde0db5640 1 -- 10.20.193.28:0/853213517 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b6870420 con 0x5570b69659f0 2026-02-20T03:37:21.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.837+0000 7fbde1db7640 1 --2- 10.20.193.28:0/853213517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6969b30 0x5570b69716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:37:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.837+0000 7fbde0db5640 1 --2- 10.20.193.28:0/853213517 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b6969400 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0002710 tx=0x7fbdd0002be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2a893a9884dc3a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.837+0000 7fbdc1ce5640 1 -- 10.20.193.28:0/853213517 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0002e40 con 0x5570b69659f0 2026-02-20T03:37:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.838+0000 7fbdc1ce5640 1 -- 10.20.193.28:0/853213517 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbdd0017070 con 0x5570b69659f0 2026-02-20T03:37:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.838+0000 7fbdc1ce5640 1 -- 10.20.193.28:0/853213517 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0002e40 con 0x5570b69659f0 2026-02-20T03:37:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.838+0000 7fbde5d46e00 1 -- 10.20.193.28:0/853213517 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 msgr2=0x5570b6969400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.838+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/853213517 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b6969400 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0002710 tx=0x7fbdd0002be0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.838+0000 7fbde5d46e00 1 -- 10.20.193.28:0/853213517 shutdown_connections 2026-02-20T03:37:21.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.838+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/853213517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6969b30 0x5570b69716b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.838+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/853213517 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b6969400 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.838+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/853213517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6965040 0x5570b6965420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.838+0000 7fbde5d46e00 1 -- 10.20.193.28:0/853213517 >> 10.20.193.28:0/853213517 conn(0x5570b691f290 msgr2=0x5570b695ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.839+0000 7fbde5d46e00 1 -- 10.20.193.28:0/853213517 shutdown_connections 2026-02-20T03:37:21.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.839+0000 7fbde5d46e00 1 -- 10.20.193.28:0/853213517 wait complete. 2026-02-20T03:37:21.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:21 trial126 ceph-mon[38476]: pgmap v866: 129 pgs: 129 active+clean; 745 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.8 MiB/s wr, 1.31k op/s 2026-02-20T03:37:21.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.841+0000 7fbde5d46e00 1 -- start start 2026-02-20T03:37:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.845+0000 7fbde5d46e00 1 Processor -- start 2026-02-20T03:37:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.846+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6965040 0x5570b6988160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.846+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b69659f0 0x5570b69886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.846+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 0x5570b69868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.846+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5570b68ab8f0 con 0x5570b6965040 2026-02-20T03:37:21.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.846+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5570b669df50 con 0x5570b69659f0 2026-02-20T03:37:21.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.846+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5570b6987020 con 0x5570b6969b30 2026-02-20T03:37:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.847+0000 7fbde0db5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b69659f0 0x5570b69886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.847+0000 7fbde1db7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 0x5570b69868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.847+0000 7fbde1db7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 0x5570b69868a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43156/0 (socket says 10.20.193.28:43156) 2026-02-20T03:37:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.847+0000 7fbde1db7640 1 -- 10.20.193.28:0/1794153764 learned_addr learned my addr 10.20.193.28:0/1794153764 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.847+0000 7fbde1db7640 1 -- 10.20.193.28:0/1794153764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b69659f0 msgr2=0x5570b69886a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.847+0000 7fbde1db7640 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b69659f0 0x5570b69886a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.847+0000 7fbde1db7640 1 -- 10.20.193.28:0/1794153764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6965040 msgr2=0x5570b6988160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.847+0000 7fbde1db7640 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6965040 0x5570b6988160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.847+0000 7fbde1db7640 1 -- 10.20.193.28:0/1794153764 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b6961b60 con 0x5570b6969b30 2026-02-20T03:37:21.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.848+0000 7fbde1db7640 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 0x5570b69868a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80de5a0 tx=0x7fbdd80a4990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e4aa8a195f9793 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:21.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.848+0000 7fbd92ffd640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:37:21.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.848+0000 7fbd92ffd640 1 -- 10.20.193.28:0/1794153764 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80a9310 con 0x5570b6969b30 2026-02-20T03:37:21.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.848+0000 7fbde5d46e00 1 -- 10.20.193.28:0/1794153764 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b6680b40 con 0x5570b6969b30 2026-02-20T03:37:21.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.848+0000 7fbd92ffd640 1 -- 10.20.193.28:0/1794153764 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbdd80acfc0 con 0x5570b6969b30 2026-02-20T03:37:21.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.848+0000 7fbde5d46e00 10 client.28720 _ll_register_callbacks cb 0x5570b68e8f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:21.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.848+0000 7fbde5d46e00 1 -- 10.20.193.28:0/1794153764 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570b68bd1a0 con 0x5570b6969b30 2026-02-20T03:37:21.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.848+0000 7fbd92ffd640 1 -- 10.20.193.28:0/1794153764 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd80a78f0 con 0x5570b6969b30 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.849+0000 7fbd92ffd640 1 -- 10.20.193.28:0/1794153764 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbdd80dea60 con 0x5570b6969b30 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.849+0000 7fbd92ffd640 1 -- 10.20.193.28:0/1794153764 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fbdd80dec80 con 0x5570b6969b30 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.849+0000 7fbde5d46e00 10 client.28720 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.849+0000 7fbde5d46e00 1 -- 10.20.193.28:0/1794153764 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=51}) -- 0x5570b686a230 con 0x5570b6969b30 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.849+0000 7fbd92ffd640 1 -- 10.20.193.28:0/1794153764 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7fbdd80cb0f0 con 0x5570b6969b30 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.849+0000 7fbde5d46e00 10 client.28720 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.849+0000 7fbde5d46e00 10 client.28720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.850+0000 7fbde5d46e00 20 client.28720 populate_metadata read hostname 'trial028' 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.850+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570b6996940 0x5570b6998e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.850+0000 7fbde5d46e00 4 client.28720 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.850+0000 7fbde5d46e00 1 -- 10.20.193.28:0/1794153764 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570b68b75b0 con 0x5570b6996940 2026-02-20T03:37:21.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.850+0000 7fbde15b6640 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570b6996940 0x5570b6998e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.851+0000 7fbde15b6640 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570b6996940 0x5570b6998e00 crc :-1 s=READY pgs=567 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a6a1f5470b7b5dc server_cookie=453086de550be3bd in_seq=0 out_seq=0 2026-02-20T03:37:21.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.851+0000 7fbd92ffd640 10 client.28720 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:21.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.851+0000 7fbd92ffd640 1 -- 10.20.193.28:0/1794153764 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5570b68b75b0 con 0x5570b6996940 2026-02-20T03:37:21.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.851+0000 7fbd92ffd640 10 client.28720 handle_command_reply: tid=0 2026-02-20T03:37:21.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbde5d46e00 1 client.28720 shutdown 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbde5d46e00 1 -- 10.20.193.28:0/1794153764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 msgr2=0x5570b69868a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 0x5570b69868a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80de5a0 tx=0x7fbdd80a4990 comp rx=0 tx=0).stop 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbde5d46e00 1 -- 10.20.193.28:0/1794153764 shutdown_connections 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570b6996940 0x5570b6998e00 crc :-1 s=READY pgs=567 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 0x5570b69868a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b69659f0 0x5570b69886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/1794153764 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6965040 0x5570b6988160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbd92ffd640 0 client.28720 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.852+0000 7fbde5d46e00 1 -- 10.20.193.28:0/1794153764 >> 10.20.193.28:0/1794153764 conn(0x5570b691f290 msgr2=0x5570b6968350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.853+0000 7fbde5d46e00 1 -- 10.20.193.28:0/1794153764 shutdown_connections 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.853+0000 7fbde5d46e00 1 -- 10.20.193.28:0/1794153764 wait complete. 2026-02-20T03:37:21.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.853+0000 7fbde5d46e00 20 client.28720 trim_cache size 0 max 16384 2026-02-20T03:37:21.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.867+0000 7fbde5d46e00 1 Processor -- start 2026-02-20T03:37:21.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.867+0000 7fbde5d46e00 1 -- start start 2026-02-20T03:37:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.868+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 0x5570b695b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.868+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b699e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.868+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6969b30 0x5570b699ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.868+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbd800127d0 con 0x5570b6969b30 2026-02-20T03:37:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.868+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbd80010040 con 0x5570b6965040 2026-02-20T03:37:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.868+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8000de90 con 0x5570b69659f0 2026-02-20T03:37:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.869+0000 7fbde15b6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 0x5570b695b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.869+0000 7fbde15b6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 0x5570b695b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:57254/0 (socket says 10.20.193.28:57254) 2026-02-20T03:37:21.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.869+0000 7fbde15b6640 1 -- 10.20.193.28:0/2965717179 learned_addr learned my addr 10.20.193.28:0/2965717179 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.869+0000 7fbde1db7640 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6969b30 0x5570b699ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.869+0000 7fbde0db5640 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b699e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.870+0000 7fbde15b6640 1 -- 10.20.193.28:0/2965717179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 msgr2=0x5570b699e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.870+0000 7fbde15b6640 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b699e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.870+0000 7fbde15b6640 1 -- 10.20.193.28:0/2965717179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6969b30 msgr2=0x5570b699ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:21.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.870+0000 7fbde15b6640 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6969b30 0x5570b699ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.870+0000 7fbde15b6640 1 -- 10.20.193.28:0/2965717179 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b6986c10 con 0x5570b6965040 2026-02-20T03:37:21.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.870+0000 7fbde1db7640 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6969b30 0x5570b699ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:37:21.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.870+0000 7fbde0db5640 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b699e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:37:21.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.870+0000 7fbde15b6640 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 0x5570b695b630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc033880 tx=0x7fbdcc03e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2f0cc447224de0a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:21.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.871+0000 7fbdc14e4640 1 -- 10.20.193.28:0/2965717179 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc0044f0 con 0x5570b6965040 2026-02-20T03:37:21.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.871+0000 7fbdc14e4640 1 -- 10.20.193.28:0/2965717179 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbdcc037070 con 0x5570b6965040 2026-02-20T03:37:21.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.871+0000 7fbdc14e4640 1 -- 10.20.193.28:0/2965717179 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc045d00 con 0x5570b6965040 2026-02-20T03:37:21.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.873+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2965717179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 msgr2=0x5570b695b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:21.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.873+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 0x5570b695b630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc033880 tx=0x7fbdcc03e040 comp rx=0 tx=0).stop 2026-02-20T03:37:21.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.874+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2965717179 shutdown_connections 2026-02-20T03:37:21.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.874+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b6969b30 0x5570b699ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.874+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b69659f0 0x5570b699e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.874+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2965717179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 0x5570b695b630 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.874+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2965717179 >> 10.20.193.28:0/2965717179 conn(0x5570b691f290 msgr2=0x5570b6968a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:21.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.874+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2965717179 shutdown_connections 2026-02-20T03:37:21.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.874+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2965717179 wait complete. 2026-02-20T03:37:21.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.875+0000 7fbde5d46e00 1 -- start start 2026-02-20T03:37:21.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.876+0000 7fbde5d46e00 1 Processor -- start 2026-02-20T03:37:21.880 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.876+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 0x5570b698cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.876+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b69659f0 0x5570b698d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.877+0000 7fbde5d46e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 0x5570b698da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.877+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8000e500 con 0x5570b69659f0 2026-02-20T03:37:21.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.877+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8000f970 con 0x5570b6965040 2026-02-20T03:37:21.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.877+0000 7fbde5d46e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8000ebd0 con 0x5570b6969b30 2026-02-20T03:37:21.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.877+0000 7fbde0db5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b69659f0 0x5570b698d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.877+0000 7fbde0db5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b69659f0 0x5570b698d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40676/0 (socket says 10.20.193.28:40676) 2026-02-20T03:37:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.877+0000 7fbde0db5640 1 -- 10.20.193.28:0/2145691624 learned_addr learned my addr 10.20.193.28:0/2145691624 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.878+0000 7fbde0db5640 1 -- 10.20.193.28:0/2145691624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 msgr2=0x5570b698da10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.878+0000 7fbde0db5640 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 0x5570b698da10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.878+0000 7fbde0db5640 1 -- 10.20.193.28:0/2145691624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 msgr2=0x5570b698cf90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.878+0000 7fbde0db5640 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 0x5570b698cf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.878+0000 7fbde0db5640 1 -- 10.20.193.28:0/2145691624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570b6961990 con 0x5570b69659f0 2026-02-20T03:37:21.885 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.879+0000 7fbde0db5640 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b69659f0 0x5570b698d4d0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0004910 tx=0x7fbdd0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982c463ba4bf68fb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.879+0000 7fbd92ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.879+0000 7fbd92ffd640 1 -- 10.20.193.28:0/2145691624 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd002a070 con 0x5570b69659f0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.879+0000 7fbd92ffd640 1 -- 10.20.193.28:0/2145691624 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbdd001cbf0 con 0x5570b69659f0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.879+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2145691624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570b658e870 con 0x5570b69659f0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.880+0000 7fbd92ffd640 1 -- 10.20.193.28:0/2145691624 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0025c50 con 0x5570b69659f0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.880+0000 7fbde5d46e00 10 client.21561 _ll_register_callbacks cb 0x7fbdd8004a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.880+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2145691624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570b6861b00 con 0x5570b69659f0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.880+0000 7fbd92ffd640 1 -- 10.20.193.28:0/2145691624 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbdd002f460 con 0x5570b69659f0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.880+0000 7fbd92ffd640 1 -- 10.20.193.28:0/2145691624 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fbdd002f740 con 0x5570b69659f0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.880+0000 7fbde5d46e00 10 client.21561 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.880+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2145691624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=51}) -- 0x5570b684f440 con 0x5570b69659f0 2026-02-20T03:37:21.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.880+0000 7fbd92ffd640 1 -- 10.20.193.28:0/2145691624 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7fbdd0037020 con 0x5570b69659f0 2026-02-20T03:37:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.881+0000 7fbde5d46e00 10 client.21561 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.881+0000 7fbde5d46e00 10 client.21561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.881+0000 7fbde5d46e00 20 client.21561 populate_metadata read hostname 'trial028' 2026-02-20T03:37:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.881+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570b6a02b80 0x5570b6a05010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.881+0000 7fbde5d46e00 4 client.21561 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:37:21.887 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.881+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2145691624 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fbdd0017070 con 0x5570b6a02b80 2026-02-20T03:37:21.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.889+0000 7fbde15b6640 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570b6a02b80 0x5570b6a05010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:21.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.889+0000 7fbde15b6640 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570b6a02b80 0x5570b6a05010 crc :-1 s=READY pgs=568 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f666be8b4d3845b5 server_cookie=df2881d0bc26eecf in_seq=0 out_seq=0 2026-02-20T03:37:21.892 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.889+0000 7fbd92ffd640 10 client.21561 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:21.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.890+0000 7fbd92ffd640 1 -- 10.20.193.28:0/2145691624 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fbdd0017070 con 0x5570b6a02b80 2026-02-20T03:37:21.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.890+0000 7fbd92ffd640 10 client.21561 handle_command_reply: tid=0 2026-02-20T03:37:21.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.890+0000 7fbde5d46e00 1 client.21561 shutdown 2026-02-20T03:37:21.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2145691624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b69659f0 msgr2=0x5570b698d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:21.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b69659f0 0x5570b698d4d0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0004910 tx=0x7fbdd0003f90 comp rx=0 tx=0).stop 2026-02-20T03:37:21.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2145691624 shutdown_connections 2026-02-20T03:37:21.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5570b6a02b80 0x5570b6a05010 crc :-1 s=READY pgs=568 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5570b6969b30 0x5570b698da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5570b69659f0 0x5570b698d4d0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 --2- 10.20.193.28:0/2145691624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5570b6965040 0x5570b698cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.906 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2145691624 >> 10.20.193.28:0/2145691624 conn(0x5570b691f290 msgr2=0x5570b6984fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:21.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbd92ffd640 0 client.21561 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:21.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2145691624 shutdown_connections 2026-02-20T03:37:21.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.891+0000 7fbde5d46e00 1 -- 10.20.193.28:0/2145691624 wait complete. 2026-02-20T03:37:21.907 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.903+0000 7fbde5d46e00 20 client.21561 trim_cache size 0 max 16384 2026-02-20T03:37:21.908 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:37:21.908 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:37:21.908 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:37:21.908 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:37:21.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 -- 10.20.193.28:0/2992949868 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdac0b1020 msgr2=0x7fbdac0b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:21.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdac0b1020 0x7fbdac0b34e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00dec0 tx=0x7fbdcc00f010 comp rx=0 tx=0).stop 2026-02-20T03:37:21.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 -- 10.20.193.28:0/2992949868 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc115df0 msgr2=0x7fbddc1a5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:21.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc115df0 0x7fbddc1a5ff0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80047e0 tx=0x7fbdd800d4a0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 -- 10.20.193.28:0/2992949868 shutdown_connections 2026-02-20T03:37:21.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbdac0b1020 0x7fbdac0b34e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbddc115df0 0x7fbddc1a5ff0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbddc10ad90 0x7fbddc1a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 --2- 10.20.193.28:0/2992949868 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbddc10a470 0x7fbddc1a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:21.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.904+0000 7fbde3841640 1 -- 10.20.193.28:0/2992949868 >> 10.20.193.28:0/2992949868 conn(0x7fbddc06ed80 msgr2=0x7fbddc071450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:21.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.905+0000 7fbde3841640 1 -- 10.20.193.28:0/2992949868 shutdown_connections 2026-02-20T03:37:21.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:21.905+0000 7fbde3841640 1 -- 10.20.193.28:0/2992949868 wait complete. 2026-02-20T03:37:21.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:21 trial177 ceph-mon[43181]: pgmap v866: 129 pgs: 129 active+clean; 745 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.8 MiB/s wr, 1.31k op/s 2026-02-20T03:37:22.022 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:37:22.023 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:37:22.355 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:37:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.568+0000 7f4bf7fff640 1 -- 10.20.193.28:0/2697105859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4bf810e1e0 msgr2=0x7f4bf807b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.568+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/2697105859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4bf810e1e0 0x7f4bf807b2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000b0a0 tx=0x7f4bf002f470 comp rx=0 tx=0).stop 2026-02-20T03:37:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.570+0000 7f4bf7fff640 1 -- 10.20.193.28:0/2697105859 shutdown_connections 2026-02-20T03:37:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.570+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/2697105859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4bf810e1e0 0x7f4bf807b2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.570+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/2697105859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bf8074d30 0x7f4bf810dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.570+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/2697105859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bf8074380 0x7f4bf8074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.570+0000 7f4bf7fff640 1 -- 10.20.193.28:0/2697105859 >> 10.20.193.28:0/2697105859 conn(0x7f4bf806ead0 msgr2=0x7f4bf806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:22.574 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.570+0000 7f4bf7fff640 1 -- 10.20.193.28:0/2697105859 shutdown_connections 2026-02-20T03:37:22.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.570+0000 7f4bf7fff640 1 -- 10.20.193.28:0/2697105859 wait complete. 2026-02-20T03:37:22.575 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.571+0000 7f4bf7fff640 1 Processor -- start 2026-02-20T03:37:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.571+0000 7f4bf7fff640 1 -- start start 2026-02-20T03:37:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf7fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bf8074380 0x7f4bf8085ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4bf8074d30 0x7f4bf8084100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bf810e1e0 0x7f4bf80847c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf7fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf807e620 con 0x7f4bf810e1e0 2026-02-20T03:37:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf7fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf807e4a0 con 0x7f4bf8074d30 2026-02-20T03:37:22.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf7fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf807e7a0 con 0x7f4bf8074380 2026-02-20T03:37:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bf810e1e0 0x7f4bf80847c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bf8074380 0x7f4bf8085ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf6ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bf8074380 0x7f4bf8085ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43180/0 (socket says 10.20.193.28:43180) 2026-02-20T03:37:22.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.572+0000 7f4bf6ffd640 1 -- 10.20.193.28:0/3255793607 learned_addr learned my addr 10.20.193.28:0/3255793607 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.573+0000 7f4bf67fc640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4bf8074d30 0x7f4bf8084100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.573+0000 7f4bf67fc640 1 -- 10.20.193.28:0/3255793607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bf8074380 msgr2=0x7f4bf8085ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.573+0000 7f4bf67fc640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bf8074380 0x7f4bf8085ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.573+0000 7f4bf67fc640 1 -- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bf810e1e0 msgr2=0x7f4bf80847c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.573+0000 7f4bf67fc640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bf810e1e0 0x7f4bf80847c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.573+0000 7f4bf67fc640 1 -- 10.20.193.28:0/3255793607 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf81c31e0 con 0x7f4bf8074d30 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.573+0000 7f4bf77fe640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bf810e1e0 0x7f4bf80847c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.573+0000 7f4bf67fc640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4bf8074d30 0x7f4bf8084100 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00e9f0 tx=0x7f4bec00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.573+0000 7f4bfca57640 1 -- 10.20.193.28:0/3255793607 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec00cd80 con 0x7f4bf8074d30 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.574+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf81c3410 con 0x7f4bf8074d30 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.574+0000 7f4bfca57640 1 -- 10.20.193.28:0/3255793607 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4bec004570 con 0x7f4bf8074d30 2026-02-20T03:37:22.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.574+0000 7f4bfca57640 1 -- 10.20.193.28:0/3255793607 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bec010690 con 0x7f4bf8074d30 2026-02-20T03:37:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.574+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf81c3920 con 0x7f4bf8074d30 2026-02-20T03:37:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.574+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf810a680 con 0x7f4bf8074d30 2026-02-20T03:37:22.579 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.576+0000 7f4bfca57640 1 -- 10.20.193.28:0/3255793607 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4bec002890 con 0x7f4bf8074d30 2026-02-20T03:37:22.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.578+0000 7f4bfca57640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4bcc0b0ea0 0x7f4bcc0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.578+0000 7f4bfca57640 1 -- 10.20.193.28:0/3255793607 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4bec0e0f40 con 0x7f4bf8074d30 2026-02-20T03:37:22.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.578+0000 7f4bfca57640 1 -- 10.20.193.28:0/3255793607 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f4bec0a9320 con 0x7f4bf8074d30 2026-02-20T03:37:22.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.578+0000 7f4bf6ffd640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4bcc0b0ea0 0x7f4bcc0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.579+0000 7f4bf6ffd640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4bcc0b0ea0 0x7f4bcc0b3360 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4be8005fd0 tx=0x7f4be80074e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:22.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.697+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bf81c3c40 con 0x7f4bf8074d30 2026-02-20T03:37:22.704 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:37:22.704 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":51,"btime":"2026-02-20T03:37:12:473601+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:37:12.404966+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:37:22.704 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 51 2026-02-20T03:37:22.704 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.698+0000 7f4bfca57640 1 -- 10.20.193.28:0/3255793607 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11921 (secure 0 0 0) 0x7f4bec0acfd0 con 0x7f4bf8074d30 2026-02-20T03:37:22.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4bcc0b0ea0 msgr2=0x7f4bcc0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4bcc0b0ea0 0x7f4bcc0b3360 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4be8005fd0 tx=0x7f4be80074e0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4bf8074d30 msgr2=0x7f4bf8084100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4bf8074d30 0x7f4bf8084100 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4bec00e9f0 tx=0x7f4bec00eec0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 shutdown_connections 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4bcc0b0ea0 0x7f4bcc0b3360 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4bf810e1e0 0x7f4bf80847c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4bf8074d30 0x7f4bf8084100 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 --2- 10.20.193.28:0/3255793607 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4bf8074380 0x7f4bf8085ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.703+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 >> 10.20.193.28:0/3255793607 conn(0x7f4bf806ead0 msgr2=0x7f4bf8072200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.704+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 shutdown_connections 2026-02-20T03:37:22.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:22.704+0000 7f4bf7fff640 1 -- 10.20.193.28:0/3255793607 wait complete. 2026-02-20T03:37:22.730 INFO:tasks.workunit.client.0.trial028.stdout: 10 224691 21.36 MB/sec execute 413 sec latency 97.139 ms 2026-02-20T03:37:22.834 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:37:22.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.952+0000 7f839350d640 1 -- 10.20.193.28:0/3544310365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c075ad0 msgr2=0x7f838c075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.952+0000 7f839350d640 1 --2- 10.20.193.28:0/3544310365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c075ad0 0x7f838c075f30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8380009960 tx=0x7f838002f1f0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.952+0000 7f839350d640 1 -- 10.20.193.28:0/3544310365 shutdown_connections 2026-02-20T03:37:22.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.952+0000 7f839350d640 1 --2- 10.20.193.28:0/3544310365 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838c1060b0 0x7f838c110f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.953+0000 7f839350d640 1 --2- 10.20.193.28:0/3544310365 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c075ad0 0x7f838c075f30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.953+0000 7f839350d640 1 --2- 10.20.193.28:0/3544310365 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c0770b0 0x7f838c075500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.953+0000 7f839350d640 1 -- 10.20.193.28:0/3544310365 >> 10.20.193.28:0/3544310365 conn(0x7f838c0fddf0 msgr2=0x7f838c100230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:22.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.953+0000 7f839350d640 1 -- 10.20.193.28:0/3544310365 shutdown_connections 2026-02-20T03:37:22.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.954+0000 7f839350d640 1 -- 10.20.193.28:0/3544310365 wait complete. 2026-02-20T03:37:22.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.954+0000 7f839350d640 1 Processor -- start 2026-02-20T03:37:22.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.955+0000 7f839350d640 1 -- start start 2026-02-20T03:37:22.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.955+0000 7f839350d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c075ad0 0x7f838c0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.955+0000 7f839350d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838c0770b0 0x7f838c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f839350d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c1060b0 0x7f838c1b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f839350d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f838c114960 con 0x7f838c0770b0 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f839350d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f838c1147e0 con 0x7f838c075ad0 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f839350d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f838c114ae0 con 0x7f838c1060b0 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8392d0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c1060b0 0x7f838c1b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8392d0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c1060b0 0x7f838c1b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43194/0 (socket says 10.20.193.28:43194) 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8392d0c640 1 -- 10.20.193.28:0/3804028676 learned_addr learned my addr 10.20.193.28:0/3804028676 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f839250b640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c075ad0 0x7f838c0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8391d0a640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838c0770b0 0x7f838c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8392d0c640 1 -- 10.20.193.28:0/3804028676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c075ad0 msgr2=0x7f838c0718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8392d0c640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c075ad0 0x7f838c0718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8392d0c640 1 -- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838c0770b0 msgr2=0x7f838c071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.961 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8392d0c640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838c0770b0 0x7f838c071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8392d0c640 1 -- 10.20.193.28:0/3804028676 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838c074ff0 con 0x7f838c1060b0 2026-02-20T03:37:22.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.956+0000 7f8391d0a640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838c0770b0 0x7f838c071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:37:22.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.957+0000 7f8392d0c640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c1060b0 0x7f838c1b13d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f838800b970 tx=0x7f838800be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:22.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.957+0000 7f837b7fe640 1 -- 10.20.193.28:0/3804028676 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838800c790 con 0x7f838c1060b0 2026-02-20T03:37:22.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.957+0000 7f837b7fe640 1 -- 10.20.193.28:0/3804028676 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8388010070 con 0x7f838c1060b0 2026-02-20T03:37:22.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.957+0000 7f837b7fe640 1 -- 10.20.193.28:0/3804028676 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388015470 con 0x7f838c1060b0 2026-02-20T03:37:22.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.957+0000 7f839350d640 1 -- 10.20.193.28:0/3804028676 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838c1b1970 con 0x7f838c1060b0 2026-02-20T03:37:22.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.957+0000 7f839350d640 1 -- 10.20.193.28:0/3804028676 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838c1b1ef0 con 0x7f838c1060b0 2026-02-20T03:37:22.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.960+0000 7f837b7fe640 1 -- 10.20.193.28:0/3804028676 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f838801d030 con 0x7f838c1060b0 2026-02-20T03:37:22.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.962+0000 7f837b7fe640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83600b0ef0 0x7f83600b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.962+0000 7f83975f6e00 1 Processor -- start 2026-02-20T03:37:22.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.962+0000 7f837b7fe640 1 -- 10.20.193.28:0/3804028676 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f83880dffe0 con 0x7f838c1060b0 2026-02-20T03:37:22.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.962+0000 7f83975f6e00 1 -- start start 2026-02-20T03:37:22.965 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.962+0000 7f839250b640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83600b0ef0 0x7f83600b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d0e80 0x55fbe89d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89d5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89d89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f83975f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fbe89218f0 con 0x55fbe89d17c0 2026-02-20T03:37:22.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f83975f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fbe88cf2e0 con 0x55fbe89d0e80 2026-02-20T03:37:22.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f83975f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fbe891d820 con 0x55fbe89d6560 2026-02-20T03:37:22.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f839250b640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83600b0ef0 0x7f83600b33b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f837c0097c0 tx=0x7f837c009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:22.967 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f8392d0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89d89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f8392d0c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89d89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43196/0 (socket says 10.20.193.28:43196) 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f8392d0c640 1 -- 10.20.193.28:0/2923858870 learned_addr learned my addr 10.20.193.28:0/2923858870 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f839250b640 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d0e80 0x55fbe89d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f8391d0a640 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89d5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f8392d0c640 1 -- 10.20.193.28:0/2923858870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d0e80 msgr2=0x55fbe89d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f8392d0c640 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d0e80 0x55fbe89d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f8392d0c640 1 -- 10.20.193.28:0/2923858870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 msgr2=0x55fbe89d5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f8392d0c640 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89d5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f8392d0c640 1 -- 10.20.193.28:0/2923858870 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe88c15a0 con 0x55fbe89d6560 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.963+0000 7f839250b640 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d0e80 0x55fbe89d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.964+0000 7f8391d0a640 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89d5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:37:22.968 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.964+0000 7f8392d0c640 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89d89f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8388004310 tx=0x7f8388004c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa0396969b1c9f3d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:22.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.966+0000 7f8378bfe640 1 -- 10.20.193.28:0/2923858870 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388004070 con 0x55fbe89d6560 2026-02-20T03:37:22.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.966+0000 7f8378bfe640 1 -- 10.20.193.28:0/2923858870 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f83880a83c0 con 0x55fbe89d6560 2026-02-20T03:37:22.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.966+0000 7f8378bfe640 1 -- 10.20.193.28:0/2923858870 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880ddd70 con 0x55fbe89d6560 2026-02-20T03:37:22.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.966+0000 7f83975f6e00 1 -- 10.20.193.28:0/2923858870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 msgr2=0x55fbe89d89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.969 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.966+0000 7f83975f6e00 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89d89f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8388004310 tx=0x7f8388004c50 comp rx=0 tx=0).stop 2026-02-20T03:37:22.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.967+0000 7f83975f6e00 1 -- 10.20.193.28:0/2923858870 shutdown_connections 2026-02-20T03:37:22.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.967+0000 7f83975f6e00 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89d89f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.967+0000 7f83975f6e00 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89d5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.967+0000 7f83975f6e00 1 --2- 10.20.193.28:0/2923858870 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d0e80 0x55fbe89d1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.967+0000 7f83975f6e00 1 -- 10.20.193.28:0/2923858870 >> 10.20.193.28:0/2923858870 conn(0x55fbe89c86f0 msgr2=0x55fbe89cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:22.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.967+0000 7f83975f6e00 1 -- 10.20.193.28:0/2923858870 shutdown_connections 2026-02-20T03:37:22.971 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.967+0000 7f83975f6e00 1 -- 10.20.193.28:0/2923858870 wait complete. 2026-02-20T03:37:22.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.970+0000 7f83975f6e00 1 -- start start 2026-02-20T03:37:22.973 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.970+0000 7f83975f6e00 1 Processor -- start 2026-02-20T03:37:22.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d0e80 0x55fbe89e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89e9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f83975f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fbe88c90c0 con 0x55fbe89d0e80 2026-02-20T03:37:22.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f83975f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fbe89d9610 con 0x55fbe89d17c0 2026-02-20T03:37:22.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f83975f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fbe89f14a0 con 0x55fbe89d6560 2026-02-20T03:37:22.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f8391d0a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89e9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.975 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f839250b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d0e80 0x55fbe89e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f8391d0a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89e9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:57306/0 (socket says 10.20.193.28:57306) 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f8391d0a640 1 -- 10.20.193.28:0/970430490 learned_addr learned my addr 10.20.193.28:0/970430490 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f8392d0c640 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f8391d0a640 1 -- 10.20.193.28:0/970430490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 msgr2=0x55fbe89f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f8391d0a640 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89f0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f8391d0a640 1 -- 10.20.193.28:0/970430490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d0e80 msgr2=0x55fbe89e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.971+0000 7f8391d0a640 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d0e80 0x55fbe89e9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.972+0000 7f8391d0a640 1 -- 10.20.193.28:0/970430490 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe89e3180 con 0x55fbe89d17c0 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.972+0000 7f839250b640 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d0e80 0x55fbe89e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:37:22.976 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.972+0000 7f8391d0a640 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89e9f90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8380009930 tx=0x7f83800026e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3128fe7a304ca79 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:22.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.973+0000 7f8343fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.973+0000 7f8343fff640 1 -- 10.20.193.28:0/970430490 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838002fe60 con 0x55fbe89d17c0 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.973+0000 7f8343fff640 1 -- 10.20.193.28:0/970430490 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8380033040 con 0x55fbe89d17c0 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.973+0000 7f8343fff640 1 -- 10.20.193.28:0/970430490 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380038e20 con 0x55fbe89d17c0 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.973+0000 7f83975f6e00 1 -- 10.20.193.28:0/970430490 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe88dd820 con 0x55fbe89d17c0 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.973+0000 7f83975f6e00 10 client.28751 _ll_register_callbacks cb 0x55fbe88ccff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.973+0000 7f83975f6e00 1 -- 10.20.193.28:0/970430490 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fbe89294e0 con 0x55fbe89d17c0 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.974+0000 7f8343fff640 1 -- 10.20.193.28:0/970430490 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8380038500 con 0x55fbe89d17c0 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.974+0000 7f8343fff640 1 -- 10.20.193.28:0/970430490 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8380004030 con 0x55fbe89d17c0 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.974+0000 7f83975f6e00 10 client.28751 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:22.978 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.975+0000 7f83975f6e00 1 -- 10.20.193.28:0/970430490 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=51}) -- 0x55fbe88e2380 con 0x55fbe89d17c0 2026-02-20T03:37:22.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.975+0000 7f8343fff640 1 -- 10.20.193.28:0/970430490 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7f838004c020 con 0x55fbe89d17c0 2026-02-20T03:37:22.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.975+0000 7f83975f6e00 10 client.28751 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:22.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.975+0000 7f83975f6e00 10 client.28751 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:22.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.975+0000 7f83975f6e00 20 client.28751 populate_metadata read hostname 'trial028' 2026-02-20T03:37:22.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.975+0000 7f83975f6e00 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fbe89f5650 0x55fbe89f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.975+0000 7f83975f6e00 4 client.28751 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:22.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.975+0000 7f83975f6e00 1 -- 10.20.193.28:0/970430490 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbe88a3bd0 con 0x55fbe89f5650 2026-02-20T03:37:22.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.975+0000 7f839250b640 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fbe89f5650 0x55fbe89f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.980 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.976+0000 7f839250b640 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fbe89f5650 0x55fbe89f7b10 crc :-1 s=READY pgs=569 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20a6a9d8b91786df server_cookie=192a71097e1ce4b6 in_seq=0 out_seq=0 2026-02-20T03:37:22.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.976+0000 7f8343fff640 10 client.28751 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:22.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f8343fff640 1 -- 10.20.193.28:0/970430490 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fbe88a3bd0 con 0x55fbe89f5650 2026-02-20T03:37:22.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f8343fff640 10 client.28751 handle_command_reply: tid=0 2026-02-20T03:37:22.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 client.28751 shutdown 2026-02-20T03:37:22.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 -- 10.20.193.28:0/970430490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 msgr2=0x55fbe89e9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89e9f90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8380009930 tx=0x7f83800026e0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 -- 10.20.193.28:0/970430490 shutdown_connections 2026-02-20T03:37:22.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fbe89f5650 0x55fbe89f7b10 crc :-1 s=READY pgs=569 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d6560 0x55fbe89f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89e9f90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 --2- 10.20.193.28:0/970430490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d0e80 0x55fbe89e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 -- 10.20.193.28:0/970430490 >> 10.20.193.28:0/970430490 conn(0x55fbe89c86f0 msgr2=0x55fbe89d78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:22.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f8343fff640 0 client.28751 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:22.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 -- 10.20.193.28:0/970430490 shutdown_connections 2026-02-20T03:37:22.982 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.977+0000 7f83975f6e00 1 -- 10.20.193.28:0/970430490 wait complete. 2026-02-20T03:37:22.983 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.978+0000 7f83975f6e00 20 client.28751 trim_cache size 0 max 16384 2026-02-20T03:37:22.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f83975f6e00 1 Processor -- start 2026-02-20T03:37:22.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f83975f6e00 1 -- start start 2026-02-20T03:37:22.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 0x55fbe89e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d6560 0x55fbe89d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f83975f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f83300128d0 con 0x55fbe89d6560 2026-02-20T03:37:22.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f83975f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8330010140 con 0x55fbe89d17c0 2026-02-20T03:37:22.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f83975f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f833000df30 con 0x55fbe89d0e80 2026-02-20T03:37:22.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f8392d0c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d6560 0x55fbe89d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f8391d0a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f8391d0a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89f0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:57322/0 (socket says 10.20.193.28:57322) 2026-02-20T03:37:22.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f8391d0a640 1 -- 10.20.193.28:0/1043375249 learned_addr learned my addr 10.20.193.28:0/1043375249 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:22.990 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.986+0000 7f839250b640 1 --2- 10.20.193.28:0/1043375249 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 0x55fbe89e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.987+0000 7f8391d0a640 1 -- 10.20.193.28:0/1043375249 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 msgr2=0x55fbe89e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.987+0000 7f8391d0a640 1 --2- 10.20.193.28:0/1043375249 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 0x55fbe89e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.987+0000 7f8391d0a640 1 -- 10.20.193.28:0/1043375249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d6560 msgr2=0x55fbe89d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.987+0000 7f8391d0a640 1 --2- 10.20.193.28:0/1043375249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d6560 0x55fbe89d24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.987+0000 7f8391d0a640 1 -- 10.20.193.28:0/1043375249 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe89e2fb0 con 0x55fbe89d17c0 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.987+0000 7f8391d0a640 1 --2- 10.20.193.28:0/1043375249 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89f0ed0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8380038720 tx=0x7f838003a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9e7377c2e3ddd6f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.987+0000 7f835e3ff640 1 -- 10.20.193.28:0/1043375249 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83800041d0 con 0x55fbe89d17c0 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.988+0000 7f835e3ff640 1 -- 10.20.193.28:0/1043375249 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f838003c070 con 0x55fbe89d17c0 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.988+0000 7f835e3ff640 1 -- 10.20.193.28:0/1043375249 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380037950 con 0x55fbe89d17c0 2026-02-20T03:37:22.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.988+0000 7f83975f6e00 1 -- 10.20.193.28:0/1043375249 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 msgr2=0x55fbe89f0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:22.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.988+0000 7f83975f6e00 1 --2- 10.20.193.28:0/1043375249 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89f0ed0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8380038720 tx=0x7f838003a000 comp rx=0 tx=0).stop 2026-02-20T03:37:22.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.988+0000 7f83975f6e00 1 -- 10.20.193.28:0/1043375249 shutdown_connections 2026-02-20T03:37:22.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.988+0000 7f83975f6e00 1 --2- 10.20.193.28:0/1043375249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d6560 0x55fbe89d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.988+0000 7f83975f6e00 1 --2- 10.20.193.28:0/1043375249 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d17c0 0x55fbe89f0ed0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.988+0000 7f83975f6e00 1 --2- 10.20.193.28:0/1043375249 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 0x55fbe89e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.988+0000 7f83975f6e00 1 -- 10.20.193.28:0/1043375249 >> 10.20.193.28:0/1043375249 conn(0x55fbe89c86f0 msgr2=0x55fbe89d1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:22.996 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.989+0000 7f83975f6e00 1 -- 10.20.193.28:0/1043375249 shutdown_connections 2026-02-20T03:37:22.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.990+0000 7f83975f6e00 1 -- 10.20.193.28:0/1043375249 wait complete. 2026-02-20T03:37:22.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.990+0000 7f83975f6e00 1 -- start start 2026-02-20T03:37:22.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.990+0000 7f83975f6e00 1 Processor -- start 2026-02-20T03:37:22.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.991+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 0x55fbe89ed040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.991+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89ed580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.991+0000 7f83975f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d6560 0x55fbe89f0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:22.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.991+0000 7f8391d0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.991+0000 7f83975f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f833000e600 con 0x55fbe89d17c0 2026-02-20T03:37:22.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.991+0000 7f83975f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f833000fa70 con 0x55fbe89d6560 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.991+0000 7f83975f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f833000ecd0 con 0x55fbe89d0e80 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.991+0000 7f839250b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 0x55fbe89ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f839250b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 0x55fbe89ed040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43224/0 (socket says 10.20.193.28:43224) 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f839250b640 1 -- 10.20.193.28:0/886784929 learned_addr learned my addr 10.20.193.28:0/886784929 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8392d0c640 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d6560 0x55fbe89f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8392d0c640 1 -- 10.20.193.28:0/886784929 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 msgr2=0x55fbe89ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8392d0c640 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 0x55fbe89ed040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8392d0c640 1 -- 10.20.193.28:0/886784929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 msgr2=0x55fbe89ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8392d0c640 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89ed580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8392d0c640 1 -- 10.20.193.28:0/886784929 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbe89d9370 con 0x55fbe89d6560 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8391d0a640 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8392d0c640 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d6560 0x55fbe89f0030 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f838800cfd0 tx=0x7f8388009940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dad94de475bf872 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:22.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8343fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8343fff640 1 -- 10.20.193.28:0/886784929 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880ac070 con 0x55fbe89d6560 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f83975f6e00 1 -- 10.20.193.28:0/886784929 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbe8681690 con 0x55fbe89d6560 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8343fff640 1 -- 10.20.193.28:0/886784929 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f83880b0f20 con 0x55fbe89d6560 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f83975f6e00 10 client.28757 _ll_register_callbacks cb 0x7f8380005b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f83975f6e00 1 -- 10.20.193.28:0/886784929 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83880a83c0 con 0x55fbe89d6560 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.992+0000 7f8343fff640 1 -- 10.20.193.28:0/886784929 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880ae4c0 con 0x55fbe89d6560 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f8343fff640 1 -- 10.20.193.28:0/886784929 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f83880ce1a0 con 0x55fbe89d6560 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f8343fff640 1 -- 10.20.193.28:0/886784929 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f83880ce3a0 con 0x55fbe89d6560 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f83975f6e00 10 client.28757 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f83975f6e00 1 -- 10.20.193.28:0/886784929 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=51}) -- 0x55fbe88e6b70 con 0x55fbe89d6560 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f8343fff640 1 -- 10.20.193.28:0/886784929 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7f83880a6cd0 con 0x55fbe89d6560 2026-02-20T03:37:22.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f83975f6e00 10 client.28757 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:23.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f83975f6e00 10 client.28757 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:23.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f83975f6e00 20 client.28757 populate_metadata read hostname 'trial028' 2026-02-20T03:37:23.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f83975f6e00 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fbe8a60f50 0x55fbe8a63410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f83975f6e00 4 client.28757 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:37:23.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f83975f6e00 1 -- 10.20.193.28:0/886784929 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fbe88f26b0 con 0x55fbe8a60f50 2026-02-20T03:37:23.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.993+0000 7f839250b640 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fbe8a60f50 0x55fbe8a63410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.994+0000 7f8343fff640 10 client.28757 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:23.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:22.994+0000 7f839250b640 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fbe8a60f50 0x55fbe8a63410 crc :-1 s=READY pgs=570 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=456fe4fd5486f5f4 server_cookie=fa167ae34b65c2ed in_seq=0 out_seq=0 2026-02-20T03:37:23.191 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:37:23.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.483+0000 7f5da187a640 1 -- 10.20.193.28:0/1096357162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5d9c101b70 msgr2=0x7f5d9c107560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.483+0000 7f5da187a640 1 --2- 10.20.193.28:0/1096357162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5d9c101b70 0x7f5d9c107560 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5d84009a30 tx=0x7f5d8402f220 comp rx=0 tx=0).stop 2026-02-20T03:37:23.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.483+0000 7f5da187a640 1 -- 10.20.193.28:0/1096357162 shutdown_connections 2026-02-20T03:37:23.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.483+0000 7f5da187a640 1 --2- 10.20.193.28:0/1096357162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d9c107c70 0x7f5d9c10f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.483+0000 7f5da187a640 1 --2- 10.20.193.28:0/1096357162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5d9c101b70 0x7f5d9c107560 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.483+0000 7f5da187a640 1 --2- 10.20.193.28:0/1096357162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d9c1011c0 0x7f5d9c1015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.483+0000 7f5da187a640 1 -- 10.20.193.28:0/1096357162 >> 10.20.193.28:0/1096357162 conn(0x7f5d9c0fd280 msgr2=0x7f5d9c0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:23.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.483+0000 7f5da187a640 1 -- 10.20.193.28:0/1096357162 shutdown_connections 2026-02-20T03:37:23.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.483+0000 7f5da187a640 1 -- 10.20.193.28:0/1096357162 wait complete. 2026-02-20T03:37:23.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.484+0000 7f5da187a640 1 Processor -- start 2026-02-20T03:37:23.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.484+0000 7f5da187a640 1 -- start start 2026-02-20T03:37:23.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5da187a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d9c1011c0 0x7f5d9c10f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5da187a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d9c101b70 0x7f5d9c10c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5da187a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5d9c107c70 0x7f5d9c10cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5da187a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c114dc0 con 0x7f5d9c101b70 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5da187a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c114c40 con 0x7f5d9c1011c0 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5da187a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9c114f40 con 0x7f5d9c107c70 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5d9a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d9c101b70 0x7f5d9c10c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5d9a7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d9c101b70 0x7f5d9c10c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40760/0 (socket says 10.20.193.28:40760) 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/2887517230 learned_addr learned my addr 10.20.193.28:0/2887517230 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.485+0000 7f5d9affd640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d9c1011c0 0x7f5d9c10f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.486+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/2887517230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5d9c107c70 msgr2=0x7f5d9c10cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.486+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5d9c107c70 0x7f5d9c10cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.486+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/2887517230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d9c1011c0 msgr2=0x7f5d9c10f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.486+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d9c1011c0 0x7f5d9c10f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.486+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/2887517230 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9c10d520 con 0x7f5d9c101b70 2026-02-20T03:37:23.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.486+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d9c101b70 0x7f5d9c10c700 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f5d8402ffa0 tx=0x7f5d840043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:23.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.487+0000 7f5da0878640 1 -- 10.20.193.28:0/2887517230 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84004540 con 0x7f5d9c101b70 2026-02-20T03:37:23.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.487+0000 7f5da0878640 1 -- 10.20.193.28:0/2887517230 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5d84038e20 con 0x7f5d9c101b70 2026-02-20T03:37:23.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.487+0000 7f5da0878640 1 -- 10.20.193.28:0/2887517230 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d84041620 con 0x7f5d9c101b70 2026-02-20T03:37:23.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.487+0000 7f5da187a640 1 -- 10.20.193.28:0/2887517230 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c1a32a0 con 0x7f5d9c101b70 2026-02-20T03:37:23.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.487+0000 7f5da187a640 1 -- 10.20.193.28:0/2887517230 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9c1a3730 con 0x7f5d9c101b70 2026-02-20T03:37:23.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.490+0000 7f5da0878640 1 -- 10.20.193.28:0/2887517230 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5d840029e0 con 0x7f5d9c101b70 2026-02-20T03:37:23.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.491+0000 7f5da0878640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d700b0e20 0x7f5d700b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.491+0000 7f5da0878640 1 -- 10.20.193.28:0/2887517230 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5d84104c10 con 0x7f5d9c101b70 2026-02-20T03:37:23.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.492+0000 7f5da3d7fe00 1 Processor -- start 2026-02-20T03:37:23.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.492+0000 7f5da3d7fe00 1 -- start start 2026-02-20T03:37:23.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.492+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bd09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.492+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029bd49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.492+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029bdcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.492+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557029b50e00 con 0x557029bd50d0 2026-02-20T03:37:23.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.492+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557029b23970 con 0x557029bd05e0 2026-02-20T03:37:23.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.492+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557029ad11f0 con 0x557029bd0f90 2026-02-20T03:37:23.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.492+0000 7f5d9a7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029bd49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.493+0000 7f5d9a7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029bd49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43250/0 (socket says 10.20.193.28:43250) 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.493+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/1745312216 learned_addr learned my addr 10.20.193.28:0/1745312216 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.493+0000 7f5d9b7fe640 1 --2- 10.20.193.28:0/1745312216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029bdcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.493+0000 7f5d9affd640 1 --2- 10.20.193.28:0/1745312216 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bd09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.493+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/1745312216 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 msgr2=0x557029bd09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.493+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/1745312216 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bd09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.493+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/1745312216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 msgr2=0x557029bdcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.493+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/1745312216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029bdcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.493+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/1745312216 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557029ae43d0 con 0x557029bd0f90 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.494+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/1745312216 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029bd49a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5d840c8720 tx=0x7f5d84005e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=350741dc8acd98ee server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.494+0000 7f5d5ffff640 1 -- 10.20.193.28:0/1745312216 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d840ef0c0 con 0x557029bd0f90 2026-02-20T03:37:23.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.494+0000 7f5d5ffff640 1 -- 10.20.193.28:0/1745312216 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5d840ef0c0 con 0x557029bd0f90 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.494+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1745312216 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 msgr2=0x557029bd49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.494+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/1745312216 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029bd49a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5d840c8720 tx=0x7f5d84005e50 comp rx=0 tx=0).stop 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.495+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1745312216 shutdown_connections 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.495+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/1745312216 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029bdcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.495+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/1745312216 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029bd49a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.495+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/1745312216 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bd09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.495+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1745312216 >> 10.20.193.28:0/1745312216 conn(0x557029b93240 msgr2=0x557029bcece0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.495+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1745312216 shutdown_connections 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.496+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1745312216 wait complete. 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.501+0000 7f5da3d7fe00 1 -- start start 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.501+0000 7f5da3d7fe00 1 Processor -- start 2026-02-20T03:37:23.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd05e0 0x557029bfba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029bfbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd50d0 0x557029bfa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x557029b1f8a0 con 0x557029bd05e0 2026-02-20T03:37:23.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x557029911f50 con 0x557029bd0f90 2026-02-20T03:37:23.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x557029bfa950 con 0x557029bd50d0 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5d9b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd50d0 0x557029bfa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5d9a7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029bfbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5d9b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd50d0 0x557029bfa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:43254/0 (socket says 10.20.193.28:43254) 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.502+0000 7f5d9a7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029bfbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:57354/0 (socket says 10.20.193.28:57354) 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.503+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/3271864892 learned_addr learned my addr 10.20.193.28:0/3271864892 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.503+0000 7f5d9affd640 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd05e0 0x557029bfba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.503+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/3271864892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd50d0 msgr2=0x557029bfa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.503+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd50d0 0x557029bfa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.503+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/3271864892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd05e0 msgr2=0x557029bfba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:23.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.503+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd05e0 0x557029bfba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.503+0000 7f5d9a7fc640 1 -- 10.20.193.28:0/3271864892 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557029bf3940 con 0x557029bd0f90 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.504+0000 7f5d9affd640 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd05e0 0x557029bfba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.504+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029bfbfd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5d8403a040 tx=0x7f5d8402f220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a766a4b5ea7396 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.504+0000 7f5d5d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.504+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/3271864892 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d840d0ca0 con 0x557029bd0f90 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.504+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/3271864892 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5d84033030 con 0x557029bd0f90 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.504+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/3271864892 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d840cb370 con 0x557029bd0f90 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.504+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/3271864892 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570298f4b40 con 0x557029bd0f90 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/3271864892 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5d840cb510 con 0x557029bd0f90 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 10 client.28769 _ll_register_callbacks cb 0x557029b5ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/3271864892 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557029b31150 con 0x557029bd0f90 2026-02-20T03:37:23.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/3271864892 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5d840cb710 con 0x557029bd0f90 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 10 client.28769 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/3271864892 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=51}) -- 0x557029ade1e0 con 0x557029bd0f90 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/3271864892 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7f5d840e1bc0 con 0x557029bd0f90 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 10 client.28769 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 10 client.28769 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 20 client.28769 populate_metadata read hostname 'trial028' 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557029c09950 0x557029c0bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 4 client.28769 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.505+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/3271864892 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557029b2b560 con 0x557029c09950 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.506+0000 7f5d9affd640 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557029c09950 0x557029c0bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.506+0000 7f5d9affd640 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557029c09950 0x557029c0bdf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=537ffe61222c8749 server_cookie=8c6627e6dbf51955 in_seq=0 out_seq=0 2026-02-20T03:37:23.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.506+0000 7f5d5d7fa640 10 client.28769 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:37:23.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.508+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/3271864892 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x557029b2b560 con 0x557029c09950 2026-02-20T03:37:23.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.508+0000 7f5d5d7fa640 10 client.28769 handle_command_reply: tid=0 2026-02-20T03:37:23.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.508+0000 7f5da3d7fe00 1 client.28769 shutdown 2026-02-20T03:37:23.515 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/3271864892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 msgr2=0x557029bfbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029bfbfd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5d8403a040 tx=0x7f5d8402f220 comp rx=0 tx=0).stop 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/3271864892 shutdown_connections 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd50d0 0x557029bfa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029bfbfd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557029c09950 0x557029c0bdf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/3271864892 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd05e0 0x557029bfba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5d5d7fa640 0 client.28769 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/3271864892 >> 10.20.193.28:0/3271864892 conn(0x557029b93240 msgr2=0x557029bcc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/3271864892 shutdown_connections 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/3271864892 wait complete. 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.509+0000 7f5da3d7fe00 20 client.28769 trim_cache size 0 max 16384 2026-02-20T03:37:23.516 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.510+0000 7f5d9affd640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d700b0e20 0x7f5d700b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.517 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.512+0000 7f5d9affd640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d700b0e20 0x7f5d700b32e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009890 tx=0x7f5d90009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:23.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.516+0000 7f5da3d7fe00 1 Processor -- start 2026-02-20T03:37:23.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.516+0000 7f5da3d7fe00 1 -- start start 2026-02-20T03:37:23.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bf7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029c11700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c11c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5d40012750 con 0x557029bd50d0 2026-02-20T03:37:23.520 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4000ffc0 con 0x557029bd05e0 2026-02-20T03:37:23.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4000de10 con 0x557029bd0f90 2026-02-20T03:37:23.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5d9affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bf7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5d9affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bf7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:57364/0 (socket says 10.20.193.28:57364) 2026-02-20T03:37:23.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5d9affd640 1 -- 10.20.193.28:0/1307904179 learned_addr learned my addr 10.20.193.28:0/1307904179 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:23.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029c11700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.517+0000 7f5d9b7fe640 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c11c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d9affd640 1 -- 10.20.193.28:0/1307904179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 msgr2=0x557029c11700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:23.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d9affd640 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029c11700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d9affd640 1 -- 10.20.193.28:0/1307904179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 msgr2=0x557029c11c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:23.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d9affd640 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c11c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d9affd640 1 -- 10.20.193.28:0/1307904179 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557029bf3770 con 0x557029bd05e0 2026-02-20T03:37:23.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d9b7fe640 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c11c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:37:23.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d9affd640 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bf7960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x557029c0c6a0 tx=0x7f5d9001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222e49a59111a0b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:23.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d5f7fe640 1 -- 10.20.193.28:0/1307904179 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9002f070 con 0x557029bd05e0 2026-02-20T03:37:23.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d5f7fe640 1 -- 10.20.193.28:0/1307904179 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5d90022040 con 0x557029bd05e0 2026-02-20T03:37:23.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.518+0000 7f5d5f7fe640 1 -- 10.20.193.28:0/1307904179 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000f880 con 0x557029bd05e0 2026-02-20T03:37:23.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.519+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1307904179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 msgr2=0x557029bf7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.523 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.519+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bf7960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x557029c0c6a0 tx=0x7f5d9001b000 comp rx=0 tx=0).stop 2026-02-20T03:37:23.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.519+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1307904179 shutdown_connections 2026-02-20T03:37:23.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.519+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c11c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.519+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd0f90 0x557029c11700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.519+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/1307904179 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd05e0 0x557029bf7960 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.519+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1307904179 >> 10.20.193.28:0/1307904179 conn(0x557029b93240 msgr2=0x557029bff110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.519+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1307904179 shutdown_connections 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.519+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/1307904179 wait complete. 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5da3d7fe00 1 -- start start 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5da3d7fe00 1 Processor -- start 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd05e0 0x557029c04f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029c02230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5da3d7fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c02770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4000e480 con 0x557029bd50d0 2026-02-20T03:37:23.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4000f8f0 con 0x557029bd0f90 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5da3d7fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4000eb50 con 0x557029bd05e0 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5d9a7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029c02230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5d9b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c02770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.520+0000 7f5d9a7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029c02230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:57378/0 (socket says 10.20.193.28:57378) 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c02770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40796/0 (socket says 10.20.193.28:40796) 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9b7fe640 1 -- 10.20.193.28:0/2136855538 learned_addr learned my addr 10.20.193.28:0/2136855538 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9affd640 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd05e0 0x557029c04f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9b7fe640 1 -- 10.20.193.28:0/2136855538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd05e0 msgr2=0x557029c04f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9b7fe640 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd05e0 0x557029c04f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9b7fe640 1 -- 10.20.193.28:0/2136855538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 msgr2=0x557029c02230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9b7fe640 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029c02230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9b7fe640 1 -- 10.20.193.28:0/2136855538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557029ade1e0 con 0x557029bd50d0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9a7fc640 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029c02230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d5d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d9b7fe640 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c02770 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c004300 tx=0x7f5d8c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adefaf796e16a53a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.521+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/2136855538 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c017610 con 0x557029bd50d0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/2136855538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557029802870 con 0x557029bd50d0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5da3d7fe00 10 client.21597 _ll_register_callbacks cb 0x7f5d8c002b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/2136855538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d90022040 con 0x557029bd50d0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/2136855538 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5d90022040 con 0x557029bd50d0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/2136855538 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c024060 con 0x557029bd50d0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/2136855538 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5d8c016770 con 0x557029bd50d0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/2136855538 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5d8c017610 con 0x557029bd50d0 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5da3d7fe00 10 client.21597 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:23.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/2136855538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=51}) -- 0x557029ac33f0 con 0x557029bd50d0 2026-02-20T03:37:23.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/2136855538 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7f5d8c016970 con 0x557029bd50d0 2026-02-20T03:37:23.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5da3d7fe00 10 client.21597 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:23.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5da3d7fe00 10 client.21597 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:37:23.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.522+0000 7f5da3d7fe00 20 client.21597 populate_metadata read hostname 'trial028' 2026-02-20T03:37:23.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.523+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557029c76880 0x557029c78d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:23.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.523+0000 7f5da3d7fe00 4 client.21597 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:37:23.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.523+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/2136855538 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557029b2b560 con 0x557029c76880 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.523+0000 7f5d9affd640 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557029c76880 0x557029c78d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.524+0000 7f5d5d7fa640 10 client.21597 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.524+0000 7f5d9affd640 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557029c76880 0x557029c78d40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c2918faeba9d2c02 server_cookie=c820f9553921ef57 in_seq=0 out_seq=0 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.524+0000 7f5d5d7fa640 1 -- 10.20.193.28:0/2136855538 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557029b2b560 con 0x557029c76880 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.524+0000 7f5d5d7fa640 10 client.21597 handle_command_reply: tid=0 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.524+0000 7f5da3d7fe00 1 client.21597 shutdown 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.524+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/2136855538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 msgr2=0x557029c02770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.524+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c02770 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c004300 tx=0x7f5d8c0047d0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/2136855538 shutdown_connections 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x557029c76880 0x557029c78d40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x557029bd50d0 0x557029c02770 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x557029bd0f90 0x557029c02230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da3d7fe00 1 --2- 10.20.193.28:0/2136855538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x557029bd05e0 0x557029c04f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/2136855538 >> 10.20.193.28:0/2136855538 conn(0x557029b93240 msgr2=0x557029bce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:23.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5d5d7fa640 0 client.21597 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:37:23.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/2136855538 shutdown_connections 2026-02-20T03:37:23.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da3d7fe00 1 -- 10.20.193.28:0/2136855538 wait complete. 2026-02-20T03:37:23.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da3d7fe00 20 client.21597 trim_cache size 0 max 16384 2026-02-20T03:37:23.532 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:37:23.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da187a640 1 -- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d700b0e20 msgr2=0x7f5d700b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da187a640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d700b0e20 0x7f5d700b32e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009890 tx=0x7f5d90009290 comp rx=0 tx=0).stop 2026-02-20T03:37:23.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da187a640 1 -- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d9c101b70 msgr2=0x7f5d9c10c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.525+0000 7f5da187a640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d9c101b70 0x7f5d9c10c700 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f5d8402ffa0 tx=0x7f5d840043d0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.526+0000 7f5da187a640 1 -- 10.20.193.28:0/2887517230 shutdown_connections 2026-02-20T03:37:23.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.526+0000 7f5da187a640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5d700b0e20 0x7f5d700b32e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.526+0000 7f5da187a640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5d9c107c70 0x7f5d9c10cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.526+0000 7f5da187a640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5d9c101b70 0x7f5d9c10c700 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.526+0000 7f5da187a640 1 --2- 10.20.193.28:0/2887517230 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5d9c1011c0 0x7f5d9c10f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.526+0000 7f5da187a640 1 -- 10.20.193.28:0/2887517230 >> 10.20.193.28:0/2887517230 conn(0x7f5d9c0fd280 msgr2=0x7f5d9c0ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:23.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.526+0000 7f5da187a640 1 -- 10.20.193.28:0/2887517230 shutdown_connections 2026-02-20T03:37:23.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:23.526+0000 7f5da187a640 1 -- 10.20.193.28:0/2887517230 wait complete. 2026-02-20T03:37:23.608 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:23 trial028 ceph-mon[38552]: pgmap v867: 129 pgs: 129 active+clean; 751 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 7.6 MiB/s wr, 1.10k op/s 2026-02-20T03:37:23.608 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:23 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3255793607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:37:23.680 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:37:23.730 INFO:tasks.workunit.client.0.trial028.stdout: 10 225325 21.39 MB/sec execute 414 sec latency 523.123 ms 2026-02-20T03:37:23.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.777+0000 7f8343fff640 1 -- 10.20.193.28:0/886784929 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fbe88f26b0 con 0x55fbe8a60f50 2026-02-20T03:37:23.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.777+0000 7f8343fff640 10 client.28757 handle_command_reply: tid=0 2026-02-20T03:37:23.780 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.777+0000 7f83975f6e00 1 client.28757 shutdown 2026-02-20T03:37:23.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 -- 10.20.193.28:0/886784929 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d6560 msgr2=0x55fbe89f0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d6560 0x55fbe89f0030 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f838800cfd0 tx=0x7f8388009940 comp rx=0 tx=0).stop 2026-02-20T03:37:23.782 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 -- 10.20.193.28:0/886784929 shutdown_connections 2026-02-20T03:37:23.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fbe8a60f50 0x55fbe8a63410 crc :-1 s=READY pgs=570 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fbe89d6560 0x55fbe89f0030 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fbe89d17c0 0x55fbe89ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 --2- 10.20.193.28:0/886784929 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fbe89d0e80 0x55fbe89ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 -- 10.20.193.28:0/886784929 >> 10.20.193.28:0/886784929 conn(0x55fbe89c86f0 msgr2=0x55fbe89d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:23.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f8343fff640 0 client.28757 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:23.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 -- 10.20.193.28:0/886784929 shutdown_connections 2026-02-20T03:37:23.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 1 -- 10.20.193.28:0/886784929 wait complete. 2026-02-20T03:37:23.783 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.779+0000 7f83975f6e00 20 client.28757 trim_cache size 0 max 16384 2026-02-20T03:37:23.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:37:23.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:37:23.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:37:23.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:37:23.784 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 -- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83600b0ef0 msgr2=0x7f83600b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83600b0ef0 0x7f83600b33b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f837c0097c0 tx=0x7f837c009340 comp rx=0 tx=0).stop 2026-02-20T03:37:23.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 -- 10.20.193.28:0/3804028676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c1060b0 msgr2=0x7f838c1b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:23.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c1060b0 0x7f838c1b13d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f838800b970 tx=0x7f838800be40 comp rx=0 tx=0).stop 2026-02-20T03:37:23.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 -- 10.20.193.28:0/3804028676 shutdown_connections 2026-02-20T03:37:23.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f83600b0ef0 0x7f83600b33b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f838c1060b0 0x7f838c1b13d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f838c0770b0 0x7f838c071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 --2- 10.20.193.28:0/3804028676 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f838c075ad0 0x7f838c0718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:23.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.780+0000 7f839350d640 1 -- 10.20.193.28:0/3804028676 >> 10.20.193.28:0/3804028676 conn(0x7f838c0fddf0 msgr2=0x7f838c102000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:23.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.783+0000 7f839350d640 1 -- 10.20.193.28:0/3804028676 shutdown_connections 2026-02-20T03:37:23.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:23.783+0000 7f839350d640 1 -- 10.20.193.28:0/3804028676 wait complete. 2026-02-20T03:37:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:23 trial126 ceph-mon[38476]: pgmap v867: 129 pgs: 129 active+clean; 751 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 7.6 MiB/s wr, 1.10k op/s 2026-02-20T03:37:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:23 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3255793607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:37:23.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:23 trial177 ceph-mon[43181]: pgmap v867: 129 pgs: 129 active+clean; 751 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 7.6 MiB/s wr, 1.10k op/s 2026-02-20T03:37:23.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:23 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3255793607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:37:23.979 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:37:24.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.184+0000 7ff8ed465640 1 -- 10.20.193.28:0/3397394003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 msgr2=0x7ff8e810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:24.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.184+0000 7ff8ed465640 1 --2- 10.20.193.28:0/3397394003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 0x7ff8e810df40 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00bc40 tx=0x7ff8cc031010 comp rx=0 tx=0).stop 2026-02-20T03:37:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.187+0000 7ff8ed465640 1 -- 10.20.193.28:0/3397394003 shutdown_connections 2026-02-20T03:37:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.187+0000 7ff8ed465640 1 --2- 10.20.193.28:0/3397394003 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8e810e480 0x7ff8e810e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.187+0000 7ff8ed465640 1 --2- 10.20.193.28:0/3397394003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 0x7ff8e810df40 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.187+0000 7ff8ed465640 1 --2- 10.20.193.28:0/3397394003 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e8074380 0x7ff8e8074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.187+0000 7ff8ed465640 1 -- 10.20.193.28:0/3397394003 >> 10.20.193.28:0/3397394003 conn(0x7ff8e806efb0 msgr2=0x7ff8e806f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:24.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.187+0000 7ff8ed465640 1 -- 10.20.193.28:0/3397394003 shutdown_connections 2026-02-20T03:37:24.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.187+0000 7ff8ed465640 1 -- 10.20.193.28:0/3397394003 wait complete. 2026-02-20T03:37:24.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.188+0000 7ff8ed465640 1 Processor -- start 2026-02-20T03:37:24.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.188+0000 7ff8ed465640 1 -- start start 2026-02-20T03:37:24.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8ed465640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8e8074380 0x7ff8e81ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8ed465640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 0x7ff8e81abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8ed465640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e810e480 0x7ff8e81a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8ed465640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8119180 con 0x7ff8e8074ca0 2026-02-20T03:37:24.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8ed465640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8119000 con 0x7ff8e810e480 2026-02-20T03:37:24.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8ed465640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8119300 con 0x7ff8e8074380 2026-02-20T03:37:24.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 0x7ff8e81abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 0x7ff8e81abc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40808/0 (socket says 10.20.193.28:40808) 2026-02-20T03:37:24.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8e77fe640 1 -- 10.20.193.28:0/2037167719 learned_addr learned my addr 10.20.193.28:0/2037167719 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:24.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8e7fff640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8e8074380 0x7ff8e81ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e810e480 0x7ff8e81a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.189+0000 7ff8ecc64640 1 -- 10.20.193.28:0/2037167719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8e8074380 msgr2=0x7ff8e81ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:24.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.190+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8e8074380 0x7ff8e81ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.190+0000 7ff8ecc64640 1 -- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 msgr2=0x7ff8e81abc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:24.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.190+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 0x7ff8e81abc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.190+0000 7ff8ecc64640 1 -- 10.20.193.28:0/2037167719 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e81a6070 con 0x7ff8e810e480 2026-02-20T03:37:24.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.190+0000 7ff8e77fe640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 0x7ff8e81abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:37:24.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.190+0000 7ff8e7fff640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8e8074380 0x7ff8e81ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:37:24.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.191+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e810e480 0x7ff8e81a58a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400d650 tx=0x7ff8d400db20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.191+0000 7ff8e57fa640 1 -- 10.20.193.28:0/2037167719 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4014070 con 0x7ff8e810e480 2026-02-20T03:37:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.191+0000 7ff8ed465640 1 -- 10.20.193.28:0/2037167719 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e81a6360 con 0x7ff8e810e480 2026-02-20T03:37:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.191+0000 7ff8ed465640 1 -- 10.20.193.28:0/2037167719 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81b25b0 con 0x7ff8e810e480 2026-02-20T03:37:24.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.191+0000 7ff8e57fa640 1 -- 10.20.193.28:0/2037167719 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff8d4004d40 con 0x7ff8e810e480 2026-02-20T03:37:24.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.191+0000 7ff8e57fa640 1 -- 10.20.193.28:0/2037167719 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4005020 con 0x7ff8e810e480 2026-02-20T03:37:24.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.195+0000 7ff8e57fa640 1 -- 10.20.193.28:0/2037167719 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff8d40047c0 con 0x7ff8e810e480 2026-02-20T03:37:24.199 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.196+0000 7ff8f0bf3e00 1 Processor -- start 2026-02-20T03:37:24.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8e57fa640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff8c00b0e20 0x7ff8c00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 -- start start 2026-02-20T03:37:24.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8e57fa640 1 -- 10.20.193.28:0/2037167719 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff8d40e0690 con 0x7ff8e810e480 2026-02-20T03:37:24.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff40fb0 0x55dddff41390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3b5e0 0x55dddff3ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff47de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dddfebbe00 con 0x55dddff3bf60 2026-02-20T03:37:24.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dddfe8e970 con 0x55dddff40fb0 2026-02-20T03:37:24.200 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dddfe3c1f0 con 0x55dddff3b5e0 2026-02-20T03:37:24.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8ecc64640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff47de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8ecc64640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff47de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40812/0 (socket says 10.20.193.28:40812) 2026-02-20T03:37:24.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8ecc64640 1 -- 10.20.193.28:0/1215593624 learned_addr learned my addr 10.20.193.28:0/1215593624 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:24.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8ecc64640 1 -- 10.20.193.28:0/1215593624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3b5e0 msgr2=0x55dddff3ba20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:24.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/1215593624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3b5e0 0x55dddff3ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8ecc64640 1 -- 10.20.193.28:0/1215593624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff40fb0 msgr2=0x55dddff41390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:24.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/1215593624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff40fb0 0x55dddff41390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8ecc64640 1 -- 10.20.193.28:0/1215593624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddfe4f3d0 con 0x55dddff3bf60 2026-02-20T03:37:24.201 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8e77fe640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff8c00b0e20 0x7ff8c00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/1215593624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff47de0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40a8300 tx=0x7ff8d40a7a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50561233c4333809 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:24.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8d8ce3640 1 -- 10.20.193.28:0/1215593624 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d401d040 con 0x55dddff3bf60 2026-02-20T03:37:24.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8d8ce3640 1 -- 10.20.193.28:0/1215593624 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff8d40ac720 con 0x55dddff3bf60 2026-02-20T03:37:24.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8d8ce3640 1 -- 10.20.193.28:0/1215593624 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40e03d0 con 0x55dddff3bf60 2026-02-20T03:37:24.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1215593624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 msgr2=0x55dddff47de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:24.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8e77fe640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff8c00b0e20 0x7ff8c00b32e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff8e806f760 tx=0x7ff8cc03c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:24.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1215593624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff47de0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40a8300 tx=0x7ff8d40a7a70 comp rx=0 tx=0).stop 2026-02-20T03:37:24.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1215593624 shutdown_connections 2026-02-20T03:37:24.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1215593624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff47de0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1215593624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3b5e0 0x55dddff3ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1215593624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff40fb0 0x55dddff41390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.197+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1215593624 >> 10.20.193.28:0/1215593624 conn(0x55dddfefe240 msgr2=0x55dddff39ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:24.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.211+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1215593624 shutdown_connections 2026-02-20T03:37:24.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.211+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1215593624 wait complete. 2026-02-20T03:37:24.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.212+0000 7ff8f0bf3e00 1 -- start start 2026-02-20T03:37:24.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.212+0000 7ff8f0bf3e00 1 Processor -- start 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.212+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff3b5e0 0x55dddff54290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.212+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.212+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff40fb0 0x55dddff62790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.212+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55dddfe8a8a0 con 0x55dddff3bf60 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.212+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55dddfc7cf50 con 0x55dddff3b5e0 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.212+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55dddff62cd0 con 0x55dddff40fb0 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40816/0 (socket says 10.20.193.28:40816) 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e77fe640 1 -- 10.20.193.28:0/2405826322 learned_addr learned my addr 10.20.193.28:0/2405826322 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e7fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff3b5e0 0x55dddff54290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff40fb0 0x55dddff62790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e77fe640 1 -- 10.20.193.28:0/2405826322 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff40fb0 msgr2=0x55dddff62790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:24.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e77fe640 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff40fb0 0x55dddff62790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e77fe640 1 -- 10.20.193.28:0/2405826322 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff3b5e0 msgr2=0x55dddff54290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:24.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e77fe640 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff3b5e0 0x55dddff54290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e77fe640 1 -- 10.20.193.28:0/2405826322 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddff4da30 con 0x55dddff3bf60 2026-02-20T03:37:24.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8e77fe640 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff547d0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00bd70 tx=0x7ff8cc00b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebee7c4fbc90619f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:24.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8a9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/2405826322 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc052070 con 0x55dddff3bf60 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/2405826322 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff8cc004570 con 0x55dddff3bf60 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/2405826322 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc043990 con 0x55dddff3bf60 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.213+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/2405826322 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddfc5fb40 con 0x55dddff3bf60 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.214+0000 7ff8f0bf3e00 10 client.21609 _ll_register_callbacks cb 0x55dddfec7eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.214+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/2405826322 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dddfe9c150 con 0x55dddff3bf60 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.214+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/2405826322 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff8cc03a920 con 0x55dddff3bf60 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.214+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/2405826322 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff8cc032d20 con 0x55dddff3bf60 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.214+0000 7ff8f0bf3e00 10 client.21609 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:24.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.214+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/2405826322 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=51}) -- 0x55dddfe491e0 con 0x55dddff3bf60 2026-02-20T03:37:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.217+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/2405826322 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7ff8cc03ab20 con 0x55dddff3bf60 2026-02-20T03:37:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.217+0000 7ff8f0bf3e00 10 client.21609 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.217+0000 7ff8f0bf3e00 10 client.21609 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:37:24.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.217+0000 7ff8f0bf3e00 20 client.21609 populate_metadata read hostname 'trial028' 2026-02-20T03:37:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.217+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dddff6cca0 0x55dddff6f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.217+0000 7ff8f0bf3e00 4 client.21609 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.217+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/2405826322 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dddfe96560 con 0x55dddff6cca0 2026-02-20T03:37:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.217+0000 7ff8e7fff640 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dddff6cca0 0x55dddff6f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.218+0000 7ff8e7fff640 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dddff6cca0 0x55dddff6f130 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9eac6ee59a9a2eca server_cookie=de664e4e23a842cf in_seq=0 out_seq=0 2026-02-20T03:37:24.221 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.218+0000 7ff8a9ffb640 10 client.21609 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.218+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/2405826322 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55dddfe96560 con 0x55dddff6cca0 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.218+0000 7ff8a9ffb640 10 client.21609 handle_command_reply: tid=0 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.218+0000 7ff8f0bf3e00 1 client.21609 shutdown 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.218+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/2405826322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 msgr2=0x55dddff547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.218+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff547d0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00bd70 tx=0x7ff8cc00b5d0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/2405826322 shutdown_connections 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dddff6cca0 0x55dddff6f130 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff40fb0 0x55dddff62790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3bf60 0x55dddff547d0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/2405826322 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff3b5e0 0x55dddff54290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/2405826322 >> 10.20.193.28:0/2405826322 conn(0x55dddfefe240 msgr2=0x55dddff3a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:24.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8a9ffb640 0 client.21609 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:37:24.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/2405826322 shutdown_connections 2026-02-20T03:37:24.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/2405826322 wait complete. 2026-02-20T03:37:24.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.219+0000 7ff8f0bf3e00 20 client.21609 trim_cache size 0 max 16384 2026-02-20T03:37:24.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8f0bf3e00 1 Processor -- start 2026-02-20T03:37:24.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8f0bf3e00 1 -- start start 2026-02-20T03:37:24.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3b5e0 0x55dddff3acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff3bf60 0x55dddff73a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff40fb0 0x55dddff73f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff8900126c0 con 0x55dddff40fb0 2026-02-20T03:37:24.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff89000ff30 con 0x55dddff3bf60 2026-02-20T03:37:24.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff89000dd80 con 0x55dddff3b5e0 2026-02-20T03:37:24.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8ecc64640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff40fb0 0x55dddff73f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8ecc64640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff40fb0 0x55dddff73f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40830/0 (socket says 10.20.193.28:40830) 2026-02-20T03:37:24.232 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8ecc64640 1 -- 10.20.193.28:0/3964301902 learned_addr learned my addr 10.20.193.28:0/3964301902 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:24.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8ecc64640 1 -- 10.20.193.28:0/3964301902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3b5e0 msgr2=0x55dddff3acf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:24.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/3964301902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3b5e0 0x55dddff3acf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8ecc64640 1 -- 10.20.193.28:0/3964301902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff3bf60 msgr2=0x55dddff73a30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:24.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/3964301902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff3bf60 0x55dddff73a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.223+0000 7ff8ecc64640 1 -- 10.20.193.28:0/3964301902 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddff4d860 con 0x55dddff40fb0 2026-02-20T03:37:24.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8ecc64640 1 --2- 10.20.193.28:0/3964301902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff40fb0 0x55dddff73f70 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40a41a0 tx=0x7ff8d40044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759b57817cb050d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:24.242 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8abfff640 1 -- 10.20.193.28:0/3964301902 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d401d070 con 0x55dddff40fb0 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8abfff640 1 -- 10.20.193.28:0/3964301902 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff8d4004ae0 con 0x55dddff40fb0 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8abfff640 1 -- 10.20.193.28:0/3964301902 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40a3cd0 con 0x55dddff40fb0 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/3964301902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff40fb0 msgr2=0x55dddff73f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/3964301902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff40fb0 0x55dddff73f70 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40a41a0 tx=0x7ff8d40044f0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/3964301902 shutdown_connections 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/3964301902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff40fb0 0x55dddff73f70 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/3964301902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff3bf60 0x55dddff73a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/3964301902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3b5e0 0x55dddff3acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/3964301902 >> 10.20.193.28:0/3964301902 conn(0x55dddfefe240 msgr2=0x55dddff6ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/3964301902 shutdown_connections 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/3964301902 wait complete. 2026-02-20T03:37:24.243 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 -- start start 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 Processor -- start 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3b5e0 0x55dddff69420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3bf60 0x55dddff67800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff40fb0 0x55dddff67d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff89000e3f0 con 0x55dddff3b5e0 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff89000f860 con 0x55dddff40fb0 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8f0bf3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff89000eac0 con 0x55dddff3bf60 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8e7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3b5e0 0x55dddff69420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8e7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3b5e0 0x55dddff69420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40832/0 (socket says 10.20.193.28:40832) 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8e7fff640 1 -- 10.20.193.28:0/1580351238 learned_addr learned my addr 10.20.193.28:0/1580351238 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8e7fff640 1 -- 10.20.193.28:0/1580351238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3bf60 msgr2=0x55dddff67800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:24.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8e7fff640 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3bf60 0x55dddff67800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8e7fff640 1 -- 10.20.193.28:0/1580351238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff40fb0 msgr2=0x55dddff67d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8e7fff640 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff40fb0 0x55dddff67d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.229+0000 7ff8e7fff640 1 -- 10.20.193.28:0/1580351238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dddfb6d870 con 0x55dddff3b5e0 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8e7fff640 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3b5e0 0x55dddff69420 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc002dc0 tx=0x7ff8dc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d360b4f396905232 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8a9ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/1580351238 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc007500 con 0x55dddff3b5e0 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/1580351238 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff8dc007b40 con 0x55dddff3b5e0 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1580351238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dddfe2e3f0 con 0x55dddff3b5e0 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8f0bf3e00 10 client.21615 _ll_register_callbacks cb 0x7ff8cc00bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1580351238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dddfe40ab0 con 0x55dddff3b5e0 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/1580351238 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc01ec90 con 0x55dddff3b5e0 2026-02-20T03:37:24.245 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/1580351238 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff8dc017410 con 0x55dddff3b5e0 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.234+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/1580351238 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff8dc02c050 con 0x55dddff3b5e0 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.236+0000 7ff8f0bf3e00 10 client.21615 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.236+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1580351238 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=51}) -- 0x55dddff4e550 con 0x55dddff3b5e0 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.237+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/1580351238 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7ff8dc0076a0 con 0x55dddff3b5e0 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.237+0000 7ff8f0bf3e00 10 client.21615 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.237+0000 7ff8f0bf3e00 10 client.21615 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.237+0000 7ff8f0bf3e00 20 client.21615 populate_metadata read hostname 'trial028' 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.237+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dddffd8f60 0x55dddffdb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.237+0000 7ff8f0bf3e00 4 client.21615 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.237+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1580351238 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff8d4004ae0 con 0x55dddffd8f60 2026-02-20T03:37:24.246 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.238+0000 7ff8e77fe640 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dddffd8f60 0x55dddffdb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:24.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.245+0000 7ff8e77fe640 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dddffd8f60 0x55dddffdb420 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2bb8eadb43a2a473 server_cookie=b714dc1898aaf191 in_seq=0 out_seq=0 2026-02-20T03:37:24.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.245+0000 7ff8a9ffb640 10 client.21615 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:37:24.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.245+0000 7ff8a9ffb640 1 -- 10.20.193.28:0/1580351238 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff8d4004ae0 con 0x55dddffd8f60 2026-02-20T03:37:24.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.245+0000 7ff8a9ffb640 10 client.21615 handle_command_reply: tid=0 2026-02-20T03:37:24.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.245+0000 7ff8f0bf3e00 1 client.21615 shutdown 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.250+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1580351238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3b5e0 msgr2=0x55dddff69420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.250+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3b5e0 0x55dddff69420 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc002dc0 tx=0x7ff8dc009920 comp rx=0 tx=0).stop 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.250+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1580351238 shutdown_connections 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.250+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55dddffd8f60 0x55dddffdb420 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.250+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55dddff40fb0 0x55dddff67d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.250+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55dddff3bf60 0x55dddff67800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.250+0000 7ff8f0bf3e00 1 --2- 10.20.193.28:0/1580351238 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55dddff3b5e0 0x55dddff69420 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.250+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1580351238 >> 10.20.193.28:0/1580351238 conn(0x55dddfefe240 msgr2=0x55dddff6ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.250+0000 7ff8a9ffb640 0 client.21615 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:37:24.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.251+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1580351238 shutdown_connections 2026-02-20T03:37:24.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.251+0000 7ff8f0bf3e00 1 -- 10.20.193.28:0/1580351238 wait complete. 2026-02-20T03:37:24.255 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.252+0000 7ff8f0bf3e00 20 client.21615 trim_cache size 0 max 16384 2026-02-20T03:37:24.255 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:37:24.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.253+0000 7ff8ed465640 1 -- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff8c00b0e20 msgr2=0x7ff8c00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:24.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.253+0000 7ff8ed465640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff8c00b0e20 0x7ff8c00b32e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff8e806f760 tx=0x7ff8cc03c040 comp rx=0 tx=0).stop 2026-02-20T03:37:24.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.253+0000 7ff8ed465640 1 -- 10.20.193.28:0/2037167719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e810e480 msgr2=0x7ff8e81a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:24.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.253+0000 7ff8ed465640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e810e480 0x7ff8e81a58a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400d650 tx=0x7ff8d400db20 comp rx=0 tx=0).stop 2026-02-20T03:37:24.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.254+0000 7ff8ed465640 1 -- 10.20.193.28:0/2037167719 shutdown_connections 2026-02-20T03:37:24.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.254+0000 7ff8ed465640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff8c00b0e20 0x7ff8c00b32e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.254+0000 7ff8ed465640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff8e810e480 0x7ff8e81a58a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.254+0000 7ff8ed465640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff8e8074ca0 0x7ff8e81abc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.254+0000 7ff8ed465640 1 --2- 10.20.193.28:0/2037167719 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff8e8074380 0x7ff8e81ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:24.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.254+0000 7ff8ed465640 1 -- 10.20.193.28:0/2037167719 >> 10.20.193.28:0/2037167719 conn(0x7ff8e806efb0 msgr2=0x7ff8e80710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:24.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.255+0000 7ff8ed465640 1 -- 10.20.193.28:0/2037167719 shutdown_connections 2026-02-20T03:37:24.259 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:24.255+0000 7ff8ed465640 1 -- 10.20.193.28:0/2037167719 wait complete. 2026-02-20T03:37:24.455 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:37:24.730 INFO:tasks.workunit.client.0.trial028.stdout: 10 226081 21.45 MB/sec execute 415 sec latency 505.427 ms 2026-02-20T03:37:24.797 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:37:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.073+0000 7fa7bbfff640 1 -- 10.20.193.28:0/2754705887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc105350 msgr2=0x7fa7bc111990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.073+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/2754705887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc105350 0x7fa7bc111990 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00b0d0 tx=0x7fa7ac02f490 comp rx=0 tx=0).stop 2026-02-20T03:37:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.074+0000 7fa7bbfff640 1 -- 10.20.193.28:0/2754705887 shutdown_connections 2026-02-20T03:37:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.074+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/2754705887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc105350 0x7fa7bc111990 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.074+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/2754705887 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc1049b0 0x7fa7bc104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.074+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/2754705887 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10aac0 0x7fa7bc10aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.074+0000 7fa7bbfff640 1 -- 10.20.193.28:0/2754705887 >> 10.20.193.28:0/2754705887 conn(0x7fa7bc100690 msgr2=0x7fa7bc102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.074+0000 7fa7bbfff640 1 -- 10.20.193.28:0/2754705887 shutdown_connections 2026-02-20T03:37:25.078 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.074+0000 7fa7bbfff640 1 -- 10.20.193.28:0/2754705887 wait complete. 2026-02-20T03:37:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.074+0000 7fa7bbfff640 1 Processor -- start 2026-02-20T03:37:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7bbfff640 1 -- start start 2026-02-20T03:37:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc1049b0 0x7fa7bc19d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7bbfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc105350 0x7fa7bc19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7bbfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10aac0 0x7fa7bc1a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7bbfff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc114e10 con 0x7fa7bc1049b0 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7bbfff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc114c90 con 0x7fa7bc105350 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7bbfff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc114f90 con 0x7fa7bc10aac0 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc1049b0 0x7fa7bc19d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc1049b0 0x7fa7bc19d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40840/0 (socket says 10.20.193.28:40840) 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7baffd640 1 -- 10.20.193.28:0/3091495100 learned_addr learned my addr 10.20.193.28:0/3091495100 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7baffd640 1 -- 10.20.193.28:0/3091495100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10aac0 msgr2=0x7fa7bc1a1b60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7baffd640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10aac0 0x7fa7bc1a1b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.080 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7baffd640 1 -- 10.20.193.28:0/3091495100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc105350 msgr2=0x7fa7bc19d7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7baffd640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc105350 0x7fa7bc19d7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7baffd640 1 -- 10.20.193.28:0/3091495100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc1a22e0 con 0x7fa7bc1049b0 2026-02-20T03:37:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.075+0000 7fa7baffd640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc1049b0 0x7fa7bc19d290 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b570 tx=0x7fa7b000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.076+0000 7fa79bfff640 1 -- 10.20.193.28:0/3091495100 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0013020 con 0x7fa7bc1049b0 2026-02-20T03:37:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.076+0000 7fa79bfff640 1 -- 10.20.193.28:0/3091495100 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7b0004480 con 0x7fa7bc1049b0 2026-02-20T03:37:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.076+0000 7fa79bfff640 1 -- 10.20.193.28:0/3091495100 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000fb50 con 0x7fa7bc1049b0 2026-02-20T03:37:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.076+0000 7fa7bbfff640 1 -- 10.20.193.28:0/3091495100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc1a25d0 con 0x7fa7bc1049b0 2026-02-20T03:37:25.088 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.076+0000 7fa7bbfff640 1 -- 10.20.193.28:0/3091495100 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc1a9e10 con 0x7fa7bc1049b0 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.078+0000 7fa79bfff640 1 -- 10.20.193.28:0/3091495100 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa7b0002780 con 0x7fa7bc1049b0 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.079+0000 7fa7c3a21e00 1 Processor -- start 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.079+0000 7fa7c3a21e00 1 -- start start 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d05dfb0 0x55ae3d05e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d0585e0 0x55ae3d058a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d058f60 0x55ae3d064de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ae3cfd8e00 con 0x55ae3d058f60 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ae3cfab970 con 0x55ae3d05dfb0 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ae3cf591f0 con 0x55ae3d0585e0 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7ba7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d058f60 0x55ae3d064de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:25.089 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7ba7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d058f60 0x55ae3d064de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40852/0 (socket says 10.20.193.28:40852) 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7ba7fc640 1 -- 10.20.193.28:0/359840562 learned_addr learned my addr 10.20.193.28:0/359840562 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7ba7fc640 1 -- 10.20.193.28:0/359840562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d0585e0 msgr2=0x55ae3d058a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7ba7fc640 1 --2- 10.20.193.28:0/359840562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d0585e0 0x55ae3d058a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7ba7fc640 1 -- 10.20.193.28:0/359840562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d05dfb0 msgr2=0x55ae3d05e390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7ba7fc640 1 --2- 10.20.193.28:0/359840562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d05dfb0 0x55ae3d05e390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7ba7fc640 1 -- 10.20.193.28:0/359840562 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3cf6c3d0 con 0x55ae3d058f60 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7ba7fc640 1 --2- 10.20.193.28:0/359840562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d058f60 0x55ae3d064de0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009840 tx=0x7fa7a4009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abab2e7f38492afd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa79bfff640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa78c0b0e20 0x7fa78c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7bb7fe640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa78c0b0e20 0x7fa78c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa79bfff640 1 -- 10.20.193.28:0/3091495100 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa7b00e0550 con 0x7fa7bc1049b0 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7837fe640 1 -- 10.20.193.28:0/359840562 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4016070 con 0x55ae3d058f60 2026-02-20T03:37:25.090 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7837fe640 1 -- 10.20.193.28:0/359840562 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7a4004480 con 0x55ae3d058f60 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7837fe640 1 -- 10.20.193.28:0/359840562 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a400bc80 con 0x55ae3d058f60 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/359840562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d058f60 msgr2=0x55ae3d064de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/359840562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d058f60 0x55ae3d064de0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009840 tx=0x7fa7a4009d10 comp rx=0 tx=0).stop 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7bb7fe640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa78c0b0e20 0x7fa78c0b32e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00b0a0 tx=0x7fa7ac005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/359840562 shutdown_connections 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/359840562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d058f60 0x55ae3d064de0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/359840562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d0585e0 0x55ae3d058a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/359840562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d05dfb0 0x55ae3d05e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/359840562 >> 10.20.193.28:0/359840562 conn(0x55ae3d01b240 msgr2=0x55ae3d056ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:25.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/359840562 shutdown_connections 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.080+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/359840562 wait complete. 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 -- start start 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 Processor -- start 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d07b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d058f60 0x55ae3d07bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d05dfb0 0x55ae3d07a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55ae3cfa78a0 con 0x55ae3d0585e0 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55ae3cd99f50 con 0x55ae3d05dfb0 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55ae3d07a860 con 0x55ae3d058f60 2026-02-20T03:37:25.092 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d07b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d07b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40864/0 (socket says 10.20.193.28:40864) 2026-02-20T03:37:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7baffd640 1 -- 10.20.193.28:0/451781863 learned_addr learned my addr 10.20.193.28:0/451781863 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:25.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7baffd640 1 -- 10.20.193.28:0/451781863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d058f60 msgr2=0x55ae3d07bee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7baffd640 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d058f60 0x55ae3d07bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7baffd640 1 -- 10.20.193.28:0/451781863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d05dfb0 msgr2=0x55ae3d07a0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7baffd640 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d05dfb0 0x55ae3d07a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7baffd640 1 -- 10.20.193.28:0/451781863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3d073530 con 0x55ae3d0585e0 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7baffd640 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d07b9a0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00a4060 tx=0x7fa7b00a7820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b912e9782cfbeb1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa780ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa780ff9640 1 -- 10.20.193.28:0/451781863 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00b1490 con 0x55ae3d0585e0 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa780ff9640 1 -- 10.20.193.28:0/451781863 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7b00e01c0 con 0x55ae3d0585e0 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa780ff9640 1 -- 10.20.193.28:0/451781863 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00a6cb0 con 0x55ae3d0585e0 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/451781863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae3cd7cb40 con 0x55ae3d0585e0 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa780ff9640 1 -- 10.20.193.28:0/451781863 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa7b00a6e50 con 0x55ae3d0585e0 2026-02-20T03:37:25.095 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa780ff9640 10 client.21627 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:37:25.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 10 client.21627 _ll_register_callbacks cb 0x55ae3cfe4eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:25.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/451781863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ae3cfb9150 con 0x55ae3d0585e0 2026-02-20T03:37:25.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa780ff9640 1 -- 10.20.193.28:0/451781863 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fa7b00a7050 con 0x55ae3d0585e0 2026-02-20T03:37:25.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 10 client.21627 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:25.096 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/451781863 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=51}) -- 0x55ae3cf661e0 con 0x55ae3d0585e0 2026-02-20T03:37:25.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa780ff9640 1 -- 10.20.193.28:0/451781863 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7fa7b00ac120 con 0x55ae3d0585e0 2026-02-20T03:37:25.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 10 client.21627 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:25.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 10 client.21627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:25.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 20 client.21627 populate_metadata read hostname 'trial028' 2026-02-20T03:37:25.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ae3d08a6b0 0x55ae3d08cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 4 client.21627 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:25.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.083+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/451781863 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae3cfb3560 con 0x55ae3d08a6b0 2026-02-20T03:37:25.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.110+0000 7fa7ba7fc640 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ae3d08a6b0 0x55ae3d08cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.164+0000 7fa7ba7fc640 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ae3d08a6b0 0x55ae3d08cb70 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28b62a7a7c65a3f8 server_cookie=a375dc4d8fd00bc3 in_seq=0 out_seq=0 2026-02-20T03:37:25.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.164+0000 7fa780ff9640 10 client.21627 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:25.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa780ff9640 1 -- 10.20.193.28:0/451781863 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55ae3cfb3560 con 0x55ae3d08a6b0 2026-02-20T03:37:25.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa780ff9640 10 client.21627 handle_command_reply: tid=0 2026-02-20T03:37:25.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 client.21627 shutdown 2026-02-20T03:37:25.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/451781863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 msgr2=0x55ae3d07b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:25.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d07b9a0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00a4060 tx=0x7fa7b00a7820 comp rx=0 tx=0).stop 2026-02-20T03:37:25.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/451781863 shutdown_connections 2026-02-20T03:37:25.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ae3d08a6b0 0x55ae3d08cb70 crc :-1 s=READY pgs=571 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.202 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d05dfb0 0x55ae3d07a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d058f60 0x55ae3d07bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/451781863 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d07b9a0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa780ff9640 0 client.21627 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:25.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/451781863 >> 10.20.193.28:0/451781863 conn(0x55ae3d01b240 msgr2=0x55ae3d0573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:25.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/451781863 shutdown_connections 2026-02-20T03:37:25.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.191+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/451781863 wait complete. 2026-02-20T03:37:25.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.192+0000 7fa7c3a21e00 20 client.21627 trim_cache size 0 max 16384 2026-02-20T03:37:25.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7c3a21e00 1 Processor -- start 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7c3a21e00 1 -- start start 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d050ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d058f60 0x55ae3d079050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d05dfb0 0x55ae3d077350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa760012700 con 0x55ae3d0585e0 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa76000ff70 con 0x55ae3d058f60 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa76000ddc0 con 0x55ae3d05dfb0 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d050ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d050ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40872/0 (socket says 10.20.193.28:40872) 2026-02-20T03:37:25.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.199+0000 7fa7baffd640 1 -- 10.20.193.28:0/1284053800 learned_addr learned my addr 10.20.193.28:0/1284053800 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 -- 10.20.193.28:0/1284053800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d05dfb0 msgr2=0x55ae3d077350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 --2- 10.20.193.28:0/1284053800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d05dfb0 0x55ae3d077350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 -- 10.20.193.28:0/1284053800 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d058f60 msgr2=0x55ae3d079050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 --2- 10.20.193.28:0/1284053800 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d058f60 0x55ae3d079050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 -- 10.20.193.28:0/1284053800 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3d073360 con 0x55ae3d0585e0 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 --2- 10.20.193.28:0/1284053800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d050ad0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b540 tx=0x7fa7b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a39811f61eaa6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa782ffd640 1 -- 10.20.193.28:0/1284053800 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00b1490 con 0x55ae3d0585e0 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa782ffd640 1 -- 10.20.193.28:0/1284053800 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55ae3cfb9150 con 0x55ae3d0585e0 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa782ffd640 1 -- 10.20.193.28:0/1284053800 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00a7540 con 0x55ae3d0585e0 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1284053800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 msgr2=0x55ae3d050ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1284053800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d050ad0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b540 tx=0x7fa7b0019000 comp rx=0 tx=0).stop 2026-02-20T03:37:25.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1284053800 shutdown_connections 2026-02-20T03:37:25.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1284053800 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d05dfb0 0x55ae3d077350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1284053800 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d058f60 0x55ae3d079050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1284053800 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d050ad0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.207 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1284053800 >> 10.20.193.28:0/1284053800 conn(0x55ae3d01b240 msgr2=0x55ae3d078940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:25.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1284053800 shutdown_connections 2026-02-20T03:37:25.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1284053800 wait complete. 2026-02-20T03:37:25.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- start start 2026-02-20T03:37:25.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 Processor -- start 2026-02-20T03:37:25.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d081ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.209 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d058f60 0x55ae3d082000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d05dfb0 0x55ae3d07e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa76000e430 con 0x55ae3d0585e0 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa76000f8a0 con 0x55ae3d058f60 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa76000eb00 con 0x55ae3d05dfb0 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d081ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d081ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:40888/0 (socket says 10.20.193.28:40888) 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 -- 10.20.193.28:0/1998613480 learned_addr learned my addr 10.20.193.28:0/1998613480 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 -- 10.20.193.28:0/1998613480 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d05dfb0 msgr2=0x55ae3d07e800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d05dfb0 0x55ae3d07e800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 -- 10.20.193.28:0/1998613480 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d058f60 msgr2=0x55ae3d082000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d058f60 0x55ae3d082000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 -- 10.20.193.28:0/1998613480 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3d073360 con 0x55ae3d0585e0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7baffd640 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d081ac0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00a7260 tx=0x7fa7b00a79e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156cca67dd0611b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa780ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa780ff9640 1 -- 10.20.193.28:0/1998613480 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00a6e50 con 0x55ae3d0585e0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa780ff9640 1 -- 10.20.193.28:0/1998613480 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa7b00b1490 con 0x55ae3d0585e0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa780ff9640 1 -- 10.20.193.28:0/1998613480 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0005d00 con 0x55ae3d0585e0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1998613480 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae3cc8a870 con 0x55ae3d0585e0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 10 client.21633 _ll_register_callbacks cb 0x7fa7b000f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1998613480 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ae3cf5dab0 con 0x55ae3d0585e0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa780ff9640 1 -- 10.20.193.28:0/1998613480 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa7b00c7070 con 0x55ae3d0585e0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa780ff9640 1 -- 10.20.193.28:0/1998613480 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7fa7b00c6030 con 0x55ae3d0585e0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 10 client.21633 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1998613480 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=51}) -- 0x55ae3cf4b3f0 con 0x55ae3d0585e0 2026-02-20T03:37:25.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa780ff9640 1 -- 10.20.193.28:0/1998613480 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7fa7b00941f0 con 0x55ae3d0585e0 2026-02-20T03:37:25.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 10 client.21633 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:25.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 10 client.21633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:25.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 20 client.21633 populate_metadata read hostname 'trial028' 2026-02-20T03:37:25.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ae3d0f5b10 0x55ae3d0f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:25.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 4 client.21633 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:37:25.212 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.200+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1998613480 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa7a4004480 con 0x55ae3d0f5b10 2026-02-20T03:37:25.220 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.218+0000 7fa7ba7fc640 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ae3d0f5b10 0x55ae3d0f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:25.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.258+0000 7fa7ba7fc640 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ae3d0f5b10 0x55ae3d0f7fd0 crc :-1 s=READY pgs=572 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b40087f14dbaa623 server_cookie=c8b3f7899bb4489b in_seq=0 out_seq=0 2026-02-20T03:37:25.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.258+0000 7fa780ff9640 10 client.21633 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:25.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa780ff9640 1 -- 10.20.193.28:0/1998613480 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa7a4004480 con 0x55ae3d0f5b10 2026-02-20T03:37:25.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa780ff9640 10 client.21633 handle_command_reply: tid=0 2026-02-20T03:37:25.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 client.21633 shutdown 2026-02-20T03:37:25.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1998613480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 msgr2=0x55ae3d081ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:25.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d081ac0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00a7260 tx=0x7fa7b00a79e0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1998613480 shutdown_connections 2026-02-20T03:37:25.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55ae3d0f5b10 0x55ae3d0f7fd0 crc :-1 s=READY pgs=572 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55ae3d05dfb0 0x55ae3d07e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55ae3d058f60 0x55ae3d082000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 --2- 10.20.193.28:0/1998613480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55ae3d0585e0 0x55ae3d081ac0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1998613480 >> 10.20.193.28:0/1998613480 conn(0x55ae3d01b240 msgr2=0x55ae3d079160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:25.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa780ff9640 0 client.21633 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:25.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1998613480 shutdown_connections 2026-02-20T03:37:25.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 1 -- 10.20.193.28:0/1998613480 wait complete. 2026-02-20T03:37:25.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7c3a21e00 20 client.21633 trim_cache size 0 max 16384 2026-02-20T03:37:25.276 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:37:25.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7bbfff640 1 -- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa78c0b0e20 msgr2=0x7fa78c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:25.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa78c0b0e20 0x7fa78c0b32e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac00b0a0 tx=0x7fa7ac005b50 comp rx=0 tx=0).stop 2026-02-20T03:37:25.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7bbfff640 1 -- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc1049b0 msgr2=0x7fa7bc19d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:25.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.271+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc1049b0 0x7fa7bc19d290 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b570 tx=0x7fa7b000ba40 comp rx=0 tx=0).stop 2026-02-20T03:37:25.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.273+0000 7fa7bbfff640 1 -- 10.20.193.28:0/3091495100 shutdown_connections 2026-02-20T03:37:25.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.273+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa78c0b0e20 0x7fa78c0b32e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.273+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa7bc10aac0 0x7fa7bc1a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.273+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa7bc105350 0x7fa7bc19d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.273+0000 7fa7bbfff640 1 --2- 10.20.193.28:0/3091495100 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa7bc1049b0 0x7fa7bc19d290 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.273+0000 7fa7bbfff640 1 -- 10.20.193.28:0/3091495100 >> 10.20.193.28:0/3091495100 conn(0x7fa7bc100690 msgr2=0x7fa7bc100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.273+0000 7fa7bbfff640 1 -- 10.20.193.28:0/3091495100 shutdown_connections 2026-02-20T03:37:25.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:25.273+0000 7fa7bbfff640 1 -- 10.20.193.28:0/3091495100 wait complete. 2026-02-20T03:37:25.730 INFO:tasks.workunit.client.0.trial028.stdout: 10 226083 21.40 MB/sec execute 416 sec latency 1483.527 ms 2026-02-20T03:37:25.777 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:25 trial028 ceph-mon[38552]: pgmap v868: 129 pgs: 129 active+clean; 749 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 7.3 MiB/s wr, 1.01k op/s 2026-02-20T03:37:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:25 trial126 ceph-mon[38476]: pgmap v868: 129 pgs: 129 active+clean; 749 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 7.3 MiB/s wr, 1.01k op/s 2026-02-20T03:37:25.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:25 trial177 ceph-mon[43181]: pgmap v868: 129 pgs: 129 active+clean; 749 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 7.3 MiB/s wr, 1.01k op/s 2026-02-20T03:37:26.447 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:37:26.447 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:37:26.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 226242 21.37 MB/sec execute 417 sec latency 2340.275 ms 2026-02-20T03:37:26.792 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:37:26.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.990+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2968987464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 msgr2=0x7f4b70100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:26.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.990+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2968987464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 0x7f4b70100e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009a30 tx=0x7f4b5802f220 comp rx=0 tx=0).stop 2026-02-20T03:37:26.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.990+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2968987464 shutdown_connections 2026-02-20T03:37:26.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.990+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2968987464 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b7010b790 0x7f4b7010db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.990+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2968987464 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 0x7f4b70100e10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.990+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2968987464 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b70069d50 0x7f4b701008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.990+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2968987464 >> 10.20.193.28:0/2968987464 conn(0x7f4b700fc5f0 msgr2=0x7f4b700fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.990+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2968987464 shutdown_connections 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.990+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2968987464 wait complete. 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.991+0000 7f4b75ab6640 1 Processor -- start 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.991+0000 7f4b75ab6640 1 -- start start 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.991+0000 7f4b75ab6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b70069d50 0x7f4b70116b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.991+0000 7f4b75ab6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 0x7f4b70117090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.991+0000 7f4b75ab6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b7010b790 0x7f4b70111cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.991+0000 7f4b75ab6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4b701106d0 con 0x7f4b7010b790 2026-02-20T03:37:26.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.991+0000 7f4b75ab6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4b70110550 con 0x7f4b70107210 2026-02-20T03:37:26.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.991+0000 7f4b75ab6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4b70110850 con 0x7f4b70069d50 2026-02-20T03:37:26.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.991+0000 7f4b67fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 0x7f4b70117090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:26.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b67fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 0x7f4b70117090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:45572/0 (socket says 10.20.193.28:45572) 2026-02-20T03:37:26.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b67fff640 1 -- 10.20.193.28:0/2136004885 learned_addr learned my addr 10.20.193.28:0/2136004885 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:26.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b70069d50 0x7f4b70116b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:26.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b7010b790 0x7f4b70111cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:26.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b67fff640 1 -- 10.20.193.28:0/2136004885 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b70069d50 msgr2=0x7f4b70116b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b67fff640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b70069d50 0x7f4b70116b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b67fff640 1 -- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b7010b790 msgr2=0x7f4b70111cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b67fff640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b7010b790 0x7f4b70111cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b67fff640 1 -- 10.20.193.28:0/2136004885 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b701125b0 con 0x7f4b70107210 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b7010b790 0x7f4b70111cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b67fff640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 0x7f4b70117090 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4b580386a0 tx=0x7f4b58004300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.992+0000 7f4b65ffb640 1 -- 10.20.193.28:0/2136004885 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58038770 con 0x7f4b70107210 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.993+0000 7f4b65ffb640 1 -- 10.20.193.28:0/2136004885 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4b58038db0 con 0x7f4b70107210 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.993+0000 7f4b65ffb640 1 -- 10.20.193.28:0/2136004885 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58041620 con 0x7f4b70107210 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.993+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2136004885 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b70112840 con 0x7f4b70107210 2026-02-20T03:37:26.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.993+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2136004885 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7011ca40 con 0x7f4b70107210 2026-02-20T03:37:27.001 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b79244e00 1 Processor -- start 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b79244e00 1 -- start start 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b65ffb640 1 -- 10.20.193.28:0/2136004885 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4b58049020 con 0x7f4b70107210 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 0x555f02b0d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b11540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b11b60 0x555f02b11fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b79244e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555f02a5fc00 con 0x555f02b11b60 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b79244e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555f02a0d3c0 con 0x555f02b0d0c0 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b79244e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555f02a5bb30 con 0x555f02b0da70 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b74ab4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b11540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b74ab4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b11540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33936/0 (socket says 10.20.193.28:33936) 2026-02-20T03:37:27.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b74ab4640 1 -- 10.20.193.28:0/3182693392 learned_addr learned my addr 10.20.193.28:0/3182693392 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:27.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.997+0000 7f4b67fff640 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b11b60 0x555f02b11fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.998+0000 7f4b752b5640 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 0x555f02b0d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.998+0000 7f4b74ab4640 1 -- 10.20.193.28:0/3182693392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 msgr2=0x555f02b0d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.998+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 0x555f02b0d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.998+0000 7f4b74ab4640 1 -- 10.20.193.28:0/3182693392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b11b60 msgr2=0x555f02b11fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.998+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b11b60 0x555f02b11fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.998+0000 7f4b74ab4640 1 -- 10.20.193.28:0/3182693392 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02a06840 con 0x555f02b0da70 2026-02-20T03:37:27.003 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.998+0000 7f4b67fff640 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b11b60 0x555f02b11fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:37:27.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.999+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b11540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4b600045a0 tx=0x7f4b60009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=966315882cab78c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.004 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.999+0000 7f4b65ffb640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b440b0f70 0x7f4b440b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.999+0000 7f4b65ffb640 1 -- 10.20.193.28:0/2136004885 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4b58104aa0 con 0x7f4b70107210 2026-02-20T03:37:27.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:26.999+0000 7f4b414e4640 1 -- 10.20.193.28:0/3182693392 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60010630 con 0x555f02b0da70 2026-02-20T03:37:27.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.000+0000 7f4b414e4640 1 -- 10.20.193.28:0/3182693392 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4b60010c70 con 0x555f02b0da70 2026-02-20T03:37:27.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.000+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b440b0f70 0x7f4b440b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.000+0000 7f4b79244e00 1 -- 10.20.193.28:0/3182693392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 msgr2=0x555f02b11540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.000+0000 7f4b79244e00 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b11540 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4b600045a0 tx=0x7f4b60009c70 comp rx=0 tx=0).stop 2026-02-20T03:37:27.005 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.001+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b440b0f70 0x7f4b440b3430 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0094e0 tx=0x7f4b6c00b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.001+0000 7f4b79244e00 1 -- 10.20.193.28:0/3182693392 shutdown_connections 2026-02-20T03:37:27.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.001+0000 7f4b79244e00 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b11b60 0x555f02b11fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.001+0000 7f4b79244e00 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b11540 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.001+0000 7f4b79244e00 1 --2- 10.20.193.28:0/3182693392 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 0x555f02b0d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.001+0000 7f4b79244e00 1 -- 10.20.193.28:0/3182693392 >> 10.20.193.28:0/3182693392 conn(0x555f02b05b60 msgr2=0x555f02b0b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.002+0000 7f4b79244e00 1 -- 10.20.193.28:0/3182693392 shutdown_connections 2026-02-20T03:37:27.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.002+0000 7f4b79244e00 1 -- 10.20.193.28:0/3182693392 wait complete. 2026-02-20T03:37:27.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.003+0000 7f4b79244e00 1 -- start start 2026-02-20T03:37:27.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.003+0000 7f4b79244e00 1 Processor -- start 2026-02-20T03:37:27.007 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.004+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b261a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.004+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b266e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.004+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b27560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.004+0000 7f4b79244e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555f02a071a0 con 0x555f02b0d0c0 2026-02-20T03:37:27.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.004+0000 7f4b79244e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555f02b19e10 con 0x555f02b11b60 2026-02-20T03:37:27.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.004+0000 7f4b79244e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555f02b27b20 con 0x555f02b0da70 2026-02-20T03:37:27.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.004+0000 7f4b74ab4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b261a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b74ab4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b261a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33828/0 (socket says 10.20.193.28:33828) 2026-02-20T03:37:27.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b74ab4640 1 -- 10.20.193.28:0/2135237841 learned_addr learned my addr 10.20.193.28:0/2135237841 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:27.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b27560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b67fff640 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b266e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b752b5640 1 -- 10.20.193.28:0/2135237841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 msgr2=0x555f02b266e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.010 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b266e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b752b5640 1 -- 10.20.193.28:0/2135237841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 msgr2=0x555f02b261a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b261a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b752b5640 1 -- 10.20.193.28:0/2135237841 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02b1f590 con 0x555f02b11b60 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.005+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b261a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.006+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b27560 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c008a40 tx=0x7f4b6c004bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7909862fdc6d1e46 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.006+0000 7f4b2e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.006+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/2135237841 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c028070 con 0x555f02b11b60 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.006+0000 7f4b79244e00 1 -- 10.20.193.28:0/2135237841 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0282eb60 con 0x555f02b11b60 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.006+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/2135237841 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4b6c009e50 con 0x555f02b11b60 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.007+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/2135237841 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0166b0 con 0x555f02b11b60 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.007+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/2135237841 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4b6c0164b0 con 0x555f02b11b60 2026-02-20T03:37:27.011 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.007+0000 7f4b79244e00 10 client.28793 _ll_register_callbacks cb 0x555f02a0b0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:27.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.007+0000 7f4b79244e00 1 -- 10.20.193.28:0/2135237841 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555f02a677f0 con 0x555f02b11b60 2026-02-20T03:37:27.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/2135237841 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f4b6c034050 con 0x555f02b11b60 2026-02-20T03:37:27.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b79244e00 10 client.28793 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:27.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b79244e00 1 -- 10.20.193.28:0/2135237841 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=51}) -- 0x555f02a2c430 con 0x555f02b11b60 2026-02-20T03:37:27.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/2135237841 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7f4b6c023540 con 0x555f02b11b60 2026-02-20T03:37:27.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b79244e00 10 client.28793 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:27.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b79244e00 10 client.28793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:27.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b79244e00 20 client.28793 populate_metadata read hostname 'trial028' 2026-02-20T03:37:27.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555f02b36520 0x555f02b389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b79244e00 4 client.28793 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b79244e00 1 -- 10.20.193.28:0/2135237841 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f029e1c00 con 0x555f02b36520 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.008+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555f02b36520 0x555f02b389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.009+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555f02b36520 0x555f02b389e0 crc :-1 s=READY pgs=573 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ff7c7c4e8dae692 server_cookie=c9650fc1ee4a3326 in_seq=0 out_seq=0 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.009+0000 7f4b2e7fc640 10 client.28793 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/2135237841 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555f029e1c00 con 0x555f02b36520 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b2e7fc640 10 client.28793 handle_command_reply: tid=0 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b79244e00 1 client.28793 shutdown 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b79244e00 1 -- 10.20.193.28:0/2135237841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 msgr2=0x555f02b27560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b27560 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c008a40 tx=0x7f4b6c004bb0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b79244e00 1 -- 10.20.193.28:0/2135237841 shutdown_connections 2026-02-20T03:37:27.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555f02b36520 0x555f02b389e0 crc :-1 s=READY pgs=573 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b27560 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b266e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2135237841 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b261a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.010+0000 7f4b79244e00 1 -- 10.20.193.28:0/2135237841 >> 10.20.193.28:0/2135237841 conn(0x555f02b05b60 msgr2=0x555f02b10520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.011+0000 7f4b2e7fc640 0 client.28793 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:27.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.011+0000 7f4b79244e00 1 -- 10.20.193.28:0/2135237841 shutdown_connections 2026-02-20T03:37:27.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.011+0000 7f4b79244e00 1 -- 10.20.193.28:0/2135237841 wait complete. 2026-02-20T03:37:27.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.011+0000 7f4b79244e00 20 client.28793 trim_cache size 0 max 16384 2026-02-20T03:37:27.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.022+0000 7f4b79244e00 1 Processor -- start 2026-02-20T03:37:27.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.022+0000 7f4b79244e00 1 -- start start 2026-02-20T03:37:27.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.022+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.022+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b2ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.023+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.023+0000 7f4b79244e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c012720 con 0x555f02b0d0c0 2026-02-20T03:37:27.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.023+0000 7f4b79244e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c00ff90 con 0x555f02b11b60 2026-02-20T03:37:27.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.023+0000 7f4b79244e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c00dde0 con 0x555f02b0da70 2026-02-20T03:37:27.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.023+0000 7f4b752b5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.023+0000 7f4b74ab4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.023+0000 7f4b752b5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b317d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:45606/0 (socket says 10.20.193.28:45606) 2026-02-20T03:37:27.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.023+0000 7f4b752b5640 1 -- 10.20.193.28:0/2696764678 learned_addr learned my addr 10.20.193.28:0/2696764678 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:27.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.024+0000 7f4b752b5640 1 -- 10.20.193.28:0/2696764678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 msgr2=0x555f02b2ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.023+0000 7f4b67fff640 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b2ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.024+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b2ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.024+0000 7f4b752b5640 1 -- 10.20.193.28:0/2696764678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 msgr2=0x555f02b114c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.024+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b114c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.024+0000 7f4b752b5640 1 -- 10.20.193.28:0/2696764678 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02b24fc0 con 0x555f02b11b60 2026-02-20T03:37:27.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.024+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:37:27.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.024+0000 7f4b67fff640 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b2ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:37:27.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.025+0000 7f4b752b5640 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b317d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009020 tx=0x7f4b6c02b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b167691db2b13e30 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.025+0000 7f4b40ce3640 1 -- 10.20.193.28:0/2696764678 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c028050 con 0x555f02b11b60 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.025+0000 7f4b40ce3640 1 -- 10.20.193.28:0/2696764678 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4b6c009e50 con 0x555f02b11b60 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.025+0000 7f4b40ce3640 1 -- 10.20.193.28:0/2696764678 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c0166b0 con 0x555f02b11b60 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.026+0000 7f4b79244e00 1 -- 10.20.193.28:0/2696764678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 msgr2=0x555f02b317d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.026+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b317d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009020 tx=0x7f4b6c02b000 comp rx=0 tx=0).stop 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.026+0000 7f4b79244e00 1 -- 10.20.193.28:0/2696764678 shutdown_connections 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.026+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b11b60 0x555f02b317d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.026+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b0da70 0x555f02b2ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.026+0000 7f4b79244e00 1 --2- 10.20.193.28:0/2696764678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0d0c0 0x555f02b114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.026+0000 7f4b79244e00 1 -- 10.20.193.28:0/2696764678 >> 10.20.193.28:0/2696764678 conn(0x555f02b05b60 msgr2=0x555f02b2a680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.027+0000 7f4b79244e00 1 -- 10.20.193.28:0/2696764678 shutdown_connections 2026-02-20T03:37:27.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.027+0000 7f4b79244e00 1 -- 10.20.193.28:0/2696764678 wait complete. 2026-02-20T03:37:27.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.027+0000 7f4b79244e00 1 -- start start 2026-02-20T03:37:27.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.027+0000 7f4b79244e00 1 Processor -- start 2026-02-20T03:37:27.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 0x555f02b314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0da70 0x555f02b31a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b79244e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b11b60 0x555f02ba14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b79244e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c00e450 con 0x555f02b0da70 2026-02-20T03:37:27.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b79244e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c00f8c0 con 0x555f02b0d0c0 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b79244e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4b1c00eb20 con 0x555f02b11b60 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b67fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0da70 0x555f02b31a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b752b5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b11b60 0x555f02ba14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b752b5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b11b60 0x555f02ba14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33966/0 (socket says 10.20.193.28:33966) 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b752b5640 1 -- 10.20.193.28:0/199107148 learned_addr learned my addr 10.20.193.28:0/199107148 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.028+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 0x555f02b314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b752b5640 1 -- 10.20.193.28:0/199107148 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 msgr2=0x555f02b314f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b752b5640 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 0x555f02b314f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b752b5640 1 -- 10.20.193.28:0/199107148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0da70 msgr2=0x555f02b31a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b752b5640 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0da70 0x555f02b31a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b752b5640 1 -- 10.20.193.28:0/199107148 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f02b0d810 con 0x555f02b11b60 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 0x555f02b314f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:37:27.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b752b5640 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b11b60 0x555f02ba14e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0239c0 tx=0x7f4b6c004de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eff1c836955b8b83 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b2e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/199107148 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c028040 con 0x555f02b11b60 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b79244e00 1 -- 10.20.193.28:0/199107148 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f02b1f3c0 con 0x555f02b11b60 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b79244e00 10 client.28783 _ll_register_callbacks cb 0x7f4b6c008740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.029+0000 7f4b79244e00 1 -- 10.20.193.28:0/199107148 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b60010c70 con 0x555f02b11b60 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/199107148 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x555f02a677f0 con 0x555f02b11b60 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/199107148 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c047060 con 0x555f02b11b60 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/199107148 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4b6c02d700 con 0x555f02b11b60 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/199107148 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f4b6c047060 con 0x555f02b11b60 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b79244e00 10 client.28783 fetch_fsmap learned FSMap version 51 2026-02-20T03:37:27.035 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b79244e00 1 -- 10.20.193.28:0/199107148 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=51}) -- 0x555f0273e900 con 0x555f02b11b60 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/199107148 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 51) ==== 8366+0+0 (secure 0 0 0) 0x7f4b6c02d980 con 0x555f02b11b60 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b79244e00 10 client.28783 fetch_fsmap finished waiting for FSMap version 51 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b79244e00 10 client.28783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b79244e00 20 client.28783 populate_metadata read hostname 'trial028' 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b79244e00 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555f02ba2e20 0x555f02ba52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b79244e00 4 client.28783 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.030+0000 7f4b79244e00 1 -- 10.20.193.28:0/199107148 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555f02b18c90 con 0x555f02ba2e20 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.031+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555f02ba2e20 0x555f02ba52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.031+0000 7f4b74ab4640 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555f02ba2e20 0x555f02ba52e0 crc :-1 s=READY pgs=574 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3e106b9257f622d server_cookie=8ffc2dd72a5ca462 in_seq=0 out_seq=0 2026-02-20T03:37:27.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.031+0000 7f4b2e7fc640 10 client.28783 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:27.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.032+0000 7f4b2e7fc640 1 -- 10.20.193.28:0/199107148 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555f02b18c90 con 0x555f02ba2e20 2026-02-20T03:37:27.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.032+0000 7f4b2e7fc640 10 client.28783 handle_command_reply: tid=0 2026-02-20T03:37:27.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.032+0000 7f4b79244e00 1 client.28783 shutdown 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 -- 10.20.193.28:0/199107148 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b11b60 msgr2=0x555f02ba14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b11b60 0x555f02ba14e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0239c0 tx=0x7f4b6c004de0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 -- 10.20.193.28:0/199107148 shutdown_connections 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555f02ba2e20 0x555f02ba52e0 crc :-1 s=READY pgs=574 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555f02b11b60 0x555f02ba14e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555f02b0da70 0x555f02b31a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 --2- 10.20.193.28:0/199107148 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555f02b0d0c0 0x555f02b314f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 -- 10.20.193.28:0/199107148 >> 10.20.193.28:0/199107148 conn(0x555f02b05b60 msgr2=0x555f02b10cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b2e7fc640 0 client.28783 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 -- 10.20.193.28:0/199107148 shutdown_connections 2026-02-20T03:37:27.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 1 -- 10.20.193.28:0/199107148 wait complete. 2026-02-20T03:37:27.039 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.033+0000 7f4b79244e00 20 client.28783 trim_cache size 0 max 16384 2026-02-20T03:37:27.039 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:37:27.039 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:37:27.039 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "bbf590c1-d132-44d9-841b-b2c1787c6d04", 2026-02-20T03:37:27.039 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:37:27.039 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:37:27.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b440b0f70 msgr2=0x7f4b440b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b440b0f70 0x7f4b440b3430 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0094e0 tx=0x7f4b6c00b040 comp rx=0 tx=0).stop 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2136004885 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 msgr2=0x7f4b70117090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 0x7f4b70117090 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4b580386a0 tx=0x7f4b58004300 comp rx=0 tx=0).stop 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2136004885 shutdown_connections 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4b440b0f70 0x7f4b440b3430 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4b7010b790 0x7f4b70111cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4b70107210 0x7f4b70117090 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 --2- 10.20.193.28:0/2136004885 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4b70069d50 0x7f4b70116b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2136004885 >> 10.20.193.28:0/2136004885 conn(0x7f4b700fc5f0 msgr2=0x7f4b7010be40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.034+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2136004885 shutdown_connections 2026-02-20T03:37:27.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.035+0000 7f4b75ab6640 1 -- 10.20.193.28:0/2136004885 wait complete. 2026-02-20T03:37:27.151 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:37:27.494 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.714+0000 7f03da210640 1 -- 10.20.193.28:0/1172571234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d410a470 msgr2=0x7f03d41114d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.715+0000 7f03da210640 1 --2- 10.20.193.28:0/1172571234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d410a470 0x7f03d41114d0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f03c800b0d0 tx=0x7f03c802f490 comp rx=0 tx=0).stop 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.715+0000 7f03da210640 1 -- 10.20.193.28:0/1172571234 shutdown_connections 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.715+0000 7f03da210640 1 --2- 10.20.193.28:0/1172571234 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03d411c780 0x7f03d411eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.715+0000 7f03da210640 1 --2- 10.20.193.28:0/1172571234 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d410a850 0x7f03d410acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.715+0000 7f03da210640 1 --2- 10.20.193.28:0/1172571234 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d410a470 0x7f03d41114d0 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.715+0000 7f03da210640 1 -- 10.20.193.28:0/1172571234 >> 10.20.193.28:0/1172571234 conn(0x7f03d406ec00 msgr2=0x7f03d406f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.715+0000 7f03da210640 1 -- 10.20.193.28:0/1172571234 shutdown_connections 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.715+0000 7f03da210640 1 -- 10.20.193.28:0/1172571234 wait complete. 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03da210640 1 Processor -- start 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03da210640 1 -- start start 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03da210640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d410a470 0x7f03d41aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.722 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03da210640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03d410a850 0x7f03d41aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03da210640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d411c780 0x7f03d41aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03da210640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4121dd0 con 0x7f03d411c780 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03da210640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4121c50 con 0x7f03d410a470 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03da210640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4121f50 con 0x7f03d410a850 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03d3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d411c780 0x7f03d41aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03d3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d411c780 0x7f03d41aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33864/0 (socket says 10.20.193.28:33864) 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.716+0000 7f03d3fff640 1 -- 10.20.193.28:0/2663585197 learned_addr learned my addr 10.20.193.28:0/2663585197 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03d3fff640 1 -- 10.20.193.28:0/2663585197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03d410a850 msgr2=0x7f03d41aa810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03d3fff640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03d410a850 0x7f03d41aa810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03d3fff640 1 -- 10.20.193.28:0/2663585197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d410a470 msgr2=0x7f03d41aa2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03d3fff640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d410a470 0x7f03d41aa2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03d3fff640 1 -- 10.20.193.28:0/2663585197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d41af320 con 0x7f03d411c780 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03d3fff640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d411c780 0x7f03d41aeba0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f03c400b550 tx=0x7f03c400ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03d0ff9640 1 -- 10.20.193.28:0/2663585197 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4004500 con 0x7f03d411c780 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03da210640 1 -- 10.20.193.28:0/2663585197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d41af610 con 0x7f03d411c780 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03d0ff9640 1 -- 10.20.193.28:0/2663585197 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03c4015070 con 0x7f03d411c780 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.717+0000 7f03da210640 1 -- 10.20.193.28:0/2663585197 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d41b6e50 con 0x7f03d411c780 2026-02-20T03:37:27.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.718+0000 7f03d0ff9640 1 -- 10.20.193.28:0/2663585197 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4004500 con 0x7f03d411c780 2026-02-20T03:37:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.721+0000 7f03d0ff9640 1 -- 10.20.193.28:0/2663585197 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f03c4002cb0 con 0x7f03d411c780 2026-02-20T03:37:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.722+0000 7f03d0ff9640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03a80b1020 0x7f03a80b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.723+0000 7f03d0ff9640 1 -- 10.20.193.28:0/2663585197 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f03c40df1e0 con 0x7f03d411c780 2026-02-20T03:37:27.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.724+0000 7f03d37fe640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03a80b1020 0x7f03a80b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.725+0000 7f03d37fe640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03a80b1020 0x7f03a80b34e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f03c800b0a0 tx=0x7f03c8002750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.726+0000 7f03dc715e00 1 Processor -- start 2026-02-20T03:37:27.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.726+0000 7f03dc715e00 1 -- start start 2026-02-20T03:37:27.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.726+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d785715a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.726+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715fe0 0x55d7857199f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.726+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d785721ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.726+0000 7f03dc715e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d785695e50 con 0x55d785715630 2026-02-20T03:37:27.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.726+0000 7f03dc715e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d7856689c0 con 0x55d78571a120 2026-02-20T03:37:27.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.726+0000 7f03dc715e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d785616240 con 0x55d785715fe0 2026-02-20T03:37:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715fe0 0x55d7857199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d785721ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d785715a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d785715a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33870/0 (socket says 10.20.193.28:33870) 2026-02-20T03:37:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d2ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715fe0 0x55d7857199f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:33994/0 (socket says 10.20.193.28:33994) 2026-02-20T03:37:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d37fe640 1 -- 10.20.193.28:0/3843894678 learned_addr learned my addr 10.20.193.28:0/3843894678 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:27.730 INFO:tasks.workunit.client.0.trial028.stdout: 10 227539 21.47 MB/sec execute 418 sec latency 72.347 ms 2026-02-20T03:37:27.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d37fe640 1 -- 10.20.193.28:0/3843894678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715fe0 msgr2=0x55d7857199f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d37fe640 1 --2- 10.20.193.28:0/3843894678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715fe0 0x55d7857199f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d37fe640 1 -- 10.20.193.28:0/3843894678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 msgr2=0x55d785721ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d37fe640 1 --2- 10.20.193.28:0/3843894678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d785721ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.727+0000 7f03d37fe640 1 -- 10.20.193.28:0/3843894678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d785629420 con 0x55d785715630 2026-02-20T03:37:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.728+0000 7f03d37fe640 1 --2- 10.20.193.28:0/3843894678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d785715a10 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f03c80040f0 tx=0x7f03c803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4eea2f50a8ce94 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.728+0000 7f0397fff640 1 -- 10.20.193.28:0/3843894678 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8002a60 con 0x55d785715630 2026-02-20T03:37:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.728+0000 7f0397fff640 1 -- 10.20.193.28:0/3843894678 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03c8033030 con 0x55d785715630 2026-02-20T03:37:27.731 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.728+0000 7f0397fff640 1 -- 10.20.193.28:0/3843894678 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8038850 con 0x55d785715630 2026-02-20T03:37:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.729+0000 7f03dc715e00 1 -- 10.20.193.28:0/3843894678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 msgr2=0x55d785715a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.729+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3843894678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d785715a10 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f03c80040f0 tx=0x7f03c803b000 comp rx=0 tx=0).stop 2026-02-20T03:37:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.729+0000 7f03dc715e00 1 -- 10.20.193.28:0/3843894678 shutdown_connections 2026-02-20T03:37:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.729+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3843894678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d785721ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.729+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3843894678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715fe0 0x55d7857199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.729+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3843894678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d785715a10 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.729+0000 7f03dc715e00 1 -- 10.20.193.28:0/3843894678 >> 10.20.193.28:0/3843894678 conn(0x55d7856d8290 msgr2=0x55d785713d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.729+0000 7f03dc715e00 1 -- 10.20.193.28:0/3843894678 shutdown_connections 2026-02-20T03:37:27.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.729+0000 7f03dc715e00 1 -- 10.20.193.28:0/3843894678 wait complete. 2026-02-20T03:37:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.730+0000 7f03dc715e00 1 -- start start 2026-02-20T03:37:27.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.731+0000 7f03dc715e00 1 Processor -- start 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d78572fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 0x55d78572ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d78572e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03dc715e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d7856648f0 con 0x55d785715fe0 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03dc715e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d785456f50 con 0x55d78571a120 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03dc715e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d78572e810 con 0x55d785715630 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03d37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d78572fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03d37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d78572fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34002/0 (socket says 10.20.193.28:34002) 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03d37fe640 1 -- 10.20.193.28:0/1376451451 learned_addr learned my addr 10.20.193.28:0/1376451451 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03d2ffd640 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 0x55d78572ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.733+0000 7f03d3fff640 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d78572e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.734+0000 7f03d37fe640 1 -- 10.20.193.28:0/1376451451 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 msgr2=0x55d78572e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.734+0000 7f03d37fe640 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d78572e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.734+0000 7f03d37fe640 1 -- 10.20.193.28:0/1376451451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 msgr2=0x55d78572ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.734+0000 7f03d37fe640 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 0x55d78572ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.734+0000 7f03d37fe640 1 -- 10.20.193.28:0/1376451451 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d785727940 con 0x55d785715630 2026-02-20T03:37:27.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.735+0000 7f03d37fe640 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d78572fa20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f03c802f9a0 tx=0x7f03c8002a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e5e8a6388489f3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.735+0000 7f03957fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:37:27.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.735+0000 7f03957fa640 1 -- 10.20.193.28:0/1376451451 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8053070 con 0x55d785715630 2026-02-20T03:37:27.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.735+0000 7f03dc715e00 1 -- 10.20.193.28:0/1376451451 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d785439b40 con 0x55d785715630 2026-02-20T03:37:27.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.735+0000 7f03dc715e00 10 client.28789 _ll_register_callbacks cb 0x55d7856a1f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:27.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.735+0000 7f03dc715e00 1 -- 10.20.193.28:0/1376451451 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d7856761a0 con 0x55d785715630 2026-02-20T03:37:27.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.735+0000 7f03957fa640 1 -- 10.20.193.28:0/1376451451 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03c8038420 con 0x55d785715630 2026-02-20T03:37:27.738 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.735+0000 7f03957fa640 1 -- 10.20.193.28:0/1376451451 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8043670 con 0x55d785715630 2026-02-20T03:37:27.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03957fa640 1 -- 10.20.193.28:0/1376451451 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f03c8007ac0 con 0x55d785715630 2026-02-20T03:37:27.739 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03957fa640 1 -- 10.20.193.28:0/1376451451 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f03c805c060 con 0x55d785715630 2026-02-20T03:37:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03dc715e00 10 client.28789 fetch_fsmap learned FSMap version 52 2026-02-20T03:37:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03dc715e00 1 -- 10.20.193.28:0/1376451451 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=52}) -- 0x55d785623230 con 0x55d785715630 2026-02-20T03:37:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03957fa640 1 -- 10.20.193.28:0/1376451451 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f03c803f070 con 0x55d785715630 2026-02-20T03:37:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03dc715e00 10 client.28789 fetch_fsmap finished waiting for FSMap version 52 2026-02-20T03:37:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03dc715e00 10 client.28789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03dc715e00 20 client.28789 populate_metadata read hostname 'trial028' 2026-02-20T03:37:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03dc715e00 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d78573dda0 0x55d785740240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03dc715e00 4 client.28789 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.737+0000 7f03dc715e00 1 -- 10.20.193.28:0/1376451451 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7856705b0 con 0x55d78573dda0 2026-02-20T03:37:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.738+0000 7f03d2ffd640 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d78573dda0 0x55d785740240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.739+0000 7f03d2ffd640 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d78573dda0 0x55d785740240 crc :-1 s=READY pgs=575 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1495c04894e4df7 server_cookie=805edfc3a7f0083b in_seq=0 out_seq=0 2026-02-20T03:37:27.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.739+0000 7f03957fa640 10 client.28789 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.739+0000 7f03957fa640 1 -- 10.20.193.28:0/1376451451 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d7856705b0 con 0x55d78573dda0 2026-02-20T03:37:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.739+0000 7f03957fa640 10 client.28789 handle_command_reply: tid=0 2026-02-20T03:37:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.739+0000 7f03dc715e00 1 client.28789 shutdown 2026-02-20T03:37:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.739+0000 7f03dc715e00 1 -- 10.20.193.28:0/1376451451 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 msgr2=0x55d78572fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.739+0000 7f03dc715e00 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d78572fa20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f03c802f9a0 tx=0x7f03c8002a60 comp rx=0 tx=0).stop 2026-02-20T03:37:27.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.740+0000 7f03dc715e00 1 -- 10.20.193.28:0/1376451451 shutdown_connections 2026-02-20T03:37:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.740+0000 7f03dc715e00 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d78573dda0 0x55d785740240 crc :-1 s=READY pgs=575 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.740+0000 7f03dc715e00 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d78572e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.740+0000 7f03dc715e00 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 0x55d78572ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.740+0000 7f03dc715e00 1 --2- 10.20.193.28:0/1376451451 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d78572fa20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.740+0000 7f03dc715e00 1 -- 10.20.193.28:0/1376451451 >> 10.20.193.28:0/1376451451 conn(0x55d7856d8290 msgr2=0x55d785718940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.740+0000 7f03957fa640 0 client.28789 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.740+0000 7f03dc715e00 1 -- 10.20.193.28:0/1376451451 shutdown_connections 2026-02-20T03:37:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.740+0000 7f03dc715e00 1 -- 10.20.193.28:0/1376451451 wait complete. 2026-02-20T03:37:27.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.741+0000 7f03dc715e00 20 client.28789 trim_cache size 0 max 16384 2026-02-20T03:37:27.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.752+0000 7f03dc715e00 1 Processor -- start 2026-02-20T03:37:27.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.752+0000 7f03dc715e00 1 -- start start 2026-02-20T03:37:27.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d78571b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d785715fe0 0x55d78572b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d78571a120 0x55d78572bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03dc715e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0378012720 con 0x55d785715630 2026-02-20T03:37:27.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03dc715e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f037800ffc0 con 0x55d785715fe0 2026-02-20T03:37:27.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03dc715e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f037800de10 con 0x55d78571a120 2026-02-20T03:37:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03d3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d78571a120 0x55d78572bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03d37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d78571b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03d37fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d78571b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33876/0 (socket says 10.20.193.28:33876) 2026-02-20T03:37:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03d37fe640 1 -- 10.20.193.28:0/3832391081 learned_addr learned my addr 10.20.193.28:0/3832391081 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.753+0000 7f03d3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d78571a120 0x55d78572bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34018/0 (socket says 10.20.193.28:34018) 2026-02-20T03:37:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.754+0000 7f03d2ffd640 1 --2- 10.20.193.28:0/3832391081 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d785715fe0 0x55d78572b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.754+0000 7f03d3fff640 1 -- 10.20.193.28:0/3832391081 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d785715fe0 msgr2=0x55d78572b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.754+0000 7f03d3fff640 1 --2- 10.20.193.28:0/3832391081 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d785715fe0 0x55d78572b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.754+0000 7f03d3fff640 1 -- 10.20.193.28:0/3832391081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 msgr2=0x55d78571b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.754+0000 7f03d3fff640 1 --2- 10.20.193.28:0/3832391081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d78571b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.754+0000 7f03d3fff640 1 -- 10.20.193.28:0/3832391081 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d785715d80 con 0x55d78571a120 2026-02-20T03:37:27.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.754+0000 7f03d3fff640 1 --2- 10.20.193.28:0/3832391081 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d78571a120 0x55d78572bca0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f03c4002fd0 tx=0x7f03c40a2cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4675530ce76af7a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.755+0000 7f03977fe640 1 -- 10.20.193.28:0/3832391081 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c400c1d0 con 0x55d78571a120 2026-02-20T03:37:27.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.755+0000 7f03977fe640 1 -- 10.20.193.28:0/3832391081 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f03c4015070 con 0x55d78571a120 2026-02-20T03:37:27.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.755+0000 7f03977fe640 1 -- 10.20.193.28:0/3832391081 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4002780 con 0x55d78571a120 2026-02-20T03:37:27.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.755+0000 7f03dc715e00 1 -- 10.20.193.28:0/3832391081 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d78571a120 msgr2=0x55d78572bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.755+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3832391081 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d78571a120 0x55d78572bca0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f03c4002fd0 tx=0x7f03c40a2cf0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.758+0000 7f03dc715e00 1 -- 10.20.193.28:0/3832391081 shutdown_connections 2026-02-20T03:37:27.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.758+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3832391081 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d78571a120 0x55d78572bca0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.758+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3832391081 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d785715fe0 0x55d78572b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.761 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.758+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3832391081 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715630 0x55d78571b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.758+0000 7f03dc715e00 1 -- 10.20.193.28:0/3832391081 >> 10.20.193.28:0/3832391081 conn(0x55d7856d8290 msgr2=0x55d78571a980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.758+0000 7f03dc715e00 1 -- 10.20.193.28:0/3832391081 shutdown_connections 2026-02-20T03:37:27.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.758+0000 7f03dc715e00 1 -- 10.20.193.28:0/3832391081 wait complete. 2026-02-20T03:37:27.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.759+0000 7f03dc715e00 1 -- start start 2026-02-20T03:37:27.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.759+0000 7f03dc715e00 1 Processor -- start 2026-02-20T03:37:27.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.760+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d7857a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.760+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 0x55d7857a2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.760+0000 7f03dc715e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d785732ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.760+0000 7f03dc715e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f037800e480 con 0x55d785715fe0 2026-02-20T03:37:27.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.761+0000 7f03dc715e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f037800f8f0 con 0x55d78571a120 2026-02-20T03:37:27.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.761+0000 7f03d37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d7857a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.761+0000 7f03d37fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d7857a20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:34034/0 (socket says 10.20.193.28:34034) 2026-02-20T03:37:27.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.761+0000 7f03d37fe640 1 -- 10.20.193.28:0/3106746407 learned_addr learned my addr 10.20.193.28:0/3106746407 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:27.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.761+0000 7f03dc715e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f037800eb50 con 0x55d785715630 2026-02-20T03:37:27.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.761+0000 7f03d3fff640 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d785732ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.761+0000 7f03d2ffd640 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 0x55d7857a2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03d37fe640 1 -- 10.20.193.28:0/3106746407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 msgr2=0x55d785732ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03d37fe640 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d785732ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03d37fe640 1 -- 10.20.193.28:0/3106746407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 msgr2=0x55d7857a2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:37:27.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03d37fe640 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 0x55d7857a2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03d37fe640 1 -- 10.20.193.28:0/3106746407 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d785727770 con 0x55d785715630 2026-02-20T03:37:27.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03d2ffd640 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 0x55d7857a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:37:27.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03d37fe640 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d7857a20f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009850 tx=0x7f03c802fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56d9bbff06253465 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:27.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03957fa640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:37:27.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03957fa640 1 -- 10.20.193.28:0/3106746407 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8053070 con 0x55d785715630 2026-02-20T03:37:27.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03dc715e00 1 -- 10.20.193.28:0/3106746407 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d785347870 con 0x55d785715630 2026-02-20T03:37:27.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03dc715e00 10 client.28795 _ll_register_callbacks cb 0x7f03c40a2bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:27.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.762+0000 7f03dc715e00 1 -- 10.20.193.28:0/3106746407 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d785639810 con 0x55d785715630 2026-02-20T03:37:27.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.763+0000 7f03957fa640 1 -- 10.20.193.28:0/3106746407 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d7856761a0 con 0x55d785715630 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.763+0000 7f03957fa640 1 -- 10.20.193.28:0/3106746407 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8061d70 con 0x55d785715630 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.763+0000 7f03957fa640 1 -- 10.20.193.28:0/3106746407 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f03c8043410 con 0x55d785715630 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.763+0000 7f03957fa640 1 -- 10.20.193.28:0/3106746407 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f03c8061470 con 0x55d785715630 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.763+0000 7f03dc715e00 10 client.28795 fetch_fsmap learned FSMap version 52 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.763+0000 7f03dc715e00 1 -- 10.20.193.28:0/3106746407 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=52}) -- 0x55d785608440 con 0x55d785715630 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.764+0000 7f03957fa640 1 -- 10.20.193.28:0/3106746407 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 52) ==== 8362+0+0 (secure 0 0 0) 0x7f03c8069030 con 0x55d785715630 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.764+0000 7f03dc715e00 10 client.28795 fetch_fsmap finished waiting for FSMap version 52 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.764+0000 7f03dc715e00 10 client.28795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.764+0000 7f03dc715e00 20 client.28795 populate_metadata read hostname 'trial028' 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.764+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7857aa6c0 0x55d7857acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.764+0000 7f03dc715e00 4 client.28795 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.764+0000 7f03dc715e00 1 -- 10.20.193.28:0/3106746407 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d78561ab00 con 0x55d7857aa6c0 2026-02-20T03:37:27.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.764+0000 7f03d2ffd640 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7857aa6c0 0x55d7857acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:27.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.765+0000 7f03d2ffd640 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7857aa6c0 0x55d7857acb80 crc :-1 s=READY pgs=576 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19bc3fb5c504e8a9 server_cookie=c705c07b792c32d6 in_seq=0 out_seq=0 2026-02-20T03:37:27.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.765+0000 7f03957fa640 10 client.28795 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.766+0000 7f03957fa640 1 -- 10.20.193.28:0/3106746407 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d78561ab00 con 0x55d7857aa6c0 2026-02-20T03:37:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.766+0000 7f03957fa640 10 client.28795 handle_command_reply: tid=0 2026-02-20T03:37:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.766+0000 7f03dc715e00 1 client.28795 shutdown 2026-02-20T03:37:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.766+0000 7f03dc715e00 1 -- 10.20.193.28:0/3106746407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 msgr2=0x55d7857a20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.766+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d7857a20f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009850 tx=0x7f03c802fa70 comp rx=0 tx=0).stop 2026-02-20T03:37:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.766+0000 7f03dc715e00 1 -- 10.20.193.28:0/3106746407 shutdown_connections 2026-02-20T03:37:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.766+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d7857aa6c0 0x55d7857acb80 crc :-1 s=READY pgs=576 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.767+0000 7f03957fa640 0 client.28795 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.767+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d78571a120 0x55d785732ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.767+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d785715fe0 0x55d7857a2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.767+0000 7f03dc715e00 1 --2- 10.20.193.28:0/3106746407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d785715630 0x55d7857a20f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.767+0000 7f03dc715e00 1 -- 10.20.193.28:0/3106746407 >> 10.20.193.28:0/3106746407 conn(0x55d7856d8290 msgr2=0x55d785711d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.767+0000 7f03dc715e00 1 -- 10.20.193.28:0/3106746407 shutdown_connections 2026-02-20T03:37:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.767+0000 7f03dc715e00 1 -- 10.20.193.28:0/3106746407 wait complete. 2026-02-20T03:37:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.767+0000 7f03dc715e00 20 client.28795 trim_cache size 0 max 16384 2026-02-20T03:37:27.772 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:37:27.773 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:37:27.773 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:37:27.773 INFO:teuthology.orchestra.run.trial028.stdout: "bbf590c1-d132-44d9-841b-b2c1787c6d04": { 2026-02-20T03:37:27.773 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:37:27.773 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "bbf590c1-d132-44d9-841b-b2c1787c6d04", 2026-02-20T03:37:27.773 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:37:27.773 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:37:27.773 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:37:27.773 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:37:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 -- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03a80b1020 msgr2=0x7f03a80b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03a80b1020 0x7f03a80b34e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f03c800b0a0 tx=0x7f03c8002750 comp rx=0 tx=0).stop 2026-02-20T03:37:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 -- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d411c780 msgr2=0x7f03d41aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d411c780 0x7f03d41aeba0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f03c400b550 tx=0x7f03c400ba20 comp rx=0 tx=0).stop 2026-02-20T03:37:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 -- 10.20.193.28:0/2663585197 shutdown_connections 2026-02-20T03:37:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f03a80b1020 0x7f03a80b34e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f03d411c780 0x7f03d41aeba0 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f03d410a850 0x7f03d41aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 --2- 10.20.193.28:0/2663585197 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f03d410a470 0x7f03d41aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 -- 10.20.193.28:0/2663585197 >> 10.20.193.28:0/2663585197 conn(0x7f03d406ec00 msgr2=0x7f03d411cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 -- 10.20.193.28:0/2663585197 shutdown_connections 2026-02-20T03:37:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:27.769+0000 7f03da210640 1 -- 10.20.193.28:0/2663585197 wait complete. 2026-02-20T03:37:27.785 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:27 trial028 ceph-mon[38552]: pgmap v869: 129 pgs: 129 active+clean; 744 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 7.4 MiB/s wr, 991 op/s 2026-02-20T03:37:27.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:27 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:37:27.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:27 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:37:27.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:27 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:27.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:27 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:37:27.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:27 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:27.786 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:27 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:27 trial126 ceph-mon[38476]: pgmap v869: 129 pgs: 129 active+clean; 744 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 7.4 MiB/s wr, 991 op/s 2026-02-20T03:37:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:27 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:37:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:27 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:37:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:27 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:27 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:37:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:27 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:27 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:27.951 INFO:tasks.cephfs.filesystem:scrub status for tag:bbf590c1-d132-44d9-841b-b2c1787c6d04 - {'path': '/', 'tag': 'bbf590c1-d132-44d9-841b-b2c1787c6d04', 'options': 'recursive,force'} 2026-02-20T03:37:27.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:27 trial177 ceph-mon[43181]: pgmap v869: 129 pgs: 129 active+clean; 744 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 7.4 MiB/s wr, 991 op/s 2026-02-20T03:37:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:27 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:37:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:27 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:37:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:27 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:27 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:37:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:27 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:27 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:28.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 228925 21.61 MB/sec execute 419 sec latency 57.698 ms 2026-02-20T03:37:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:28 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:37:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:28 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:28.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:28 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:28 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:37:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:28 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:28.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:28 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:28.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:28 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:37:28.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:28 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:37:28.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:28 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:29.634 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:29 trial028 ceph-mon[38552]: pgmap v870: 129 pgs: 129 active+clean; 739 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 16 MiB/s rd, 6.8 MiB/s wr, 967 op/s 2026-02-20T03:37:29.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229961 21.69 MB/sec execute 420 sec latency 387.088 ms 2026-02-20T03:37:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:29 trial126 ceph-mon[38476]: pgmap v870: 129 pgs: 129 active+clean; 739 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 16 MiB/s rd, 6.8 MiB/s wr, 967 op/s 2026-02-20T03:37:29.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:29 trial177 ceph-mon[43181]: pgmap v870: 129 pgs: 129 active+clean; 739 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 16 MiB/s rd, 6.8 MiB/s wr, 967 op/s 2026-02-20T03:37:30.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229963 21.64 MB/sec execute 421 sec latency 1369.852 ms 2026-02-20T03:37:30.770 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:30 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:30.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:30 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:30.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:30 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:31.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229963 21.59 MB/sec execute 422 sec latency 2369.896 ms 2026-02-20T03:37:31.869 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:31 trial177 ceph-mon[43181]: pgmap v871: 129 pgs: 129 active+clean; 758 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 16 MiB/s rd, 8.9 MiB/s wr, 1.09k op/s 2026-02-20T03:37:31.874 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:31 trial028 ceph-mon[38552]: pgmap v871: 129 pgs: 129 active+clean; 758 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 16 MiB/s rd, 8.9 MiB/s wr, 1.09k op/s 2026-02-20T03:37:32.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:31 trial126 ceph-mon[38476]: pgmap v871: 129 pgs: 129 active+clean; 758 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 16 MiB/s rd, 8.9 MiB/s wr, 1.09k op/s 2026-02-20T03:37:32.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229963 21.54 MB/sec execute 423 sec latency 3369.937 ms 2026-02-20T03:37:33.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229963 21.49 MB/sec execute 424 sec latency 4369.999 ms 2026-02-20T03:37:33.762 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:33 trial028 ceph-mon[38552]: pgmap v872: 129 pgs: 129 active+clean; 779 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 9.1 MiB/s wr, 950 op/s 2026-02-20T03:37:33.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:33 trial177 ceph-mon[43181]: pgmap v872: 129 pgs: 129 active+clean; 779 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 9.1 MiB/s wr, 950 op/s 2026-02-20T03:37:34.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:33 trial126 ceph-mon[38476]: pgmap v872: 129 pgs: 129 active+clean; 779 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 9.1 MiB/s wr, 950 op/s 2026-02-20T03:37:34.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229963 21.44 MB/sec execute 425 sec latency 5370.041 ms 2026-02-20T03:37:34.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:34 trial028 ceph-mon[38552]: pgmap v873: 129 pgs: 129 active+clean; 798 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 965 op/s 2026-02-20T03:37:34.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:34 trial177 ceph-mon[43181]: pgmap v873: 129 pgs: 129 active+clean; 798 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 965 op/s 2026-02-20T03:37:35.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:34 trial126 ceph-mon[38476]: pgmap v873: 129 pgs: 129 active+clean; 798 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 11 MiB/s rd, 11 MiB/s wr, 965 op/s 2026-02-20T03:37:35.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229963 21.39 MB/sec execute 426 sec latency 6370.101 ms 2026-02-20T03:37:36.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229964 21.34 MB/sec execute 427 sec latency 7370.148 ms 2026-02-20T03:37:36.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 -- 10.20.193.28:0/2727097159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109e60 msgr2=0x7f60bc10a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:36.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 --2- 10.20.193.28:0/2727097159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109e60 0x7f60bc10a2e0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f60b0009a30 tx=0x7f60b002f260 comp rx=0 tx=0).stop 2026-02-20T03:37:36.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 -- 10.20.193.28:0/2727097159 shutdown_connections 2026-02-20T03:37:36.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 --2- 10.20.193.28:0/2727097159 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f60bc10a900 0x7f60bc111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.863 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 --2- 10.20.193.28:0/2727097159 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109e60 0x7f60bc10a2e0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 --2- 10.20.193.28:0/2727097159 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f60bc109490 0x7f60bc109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 -- 10.20.193.28:0/2727097159 >> 10.20.193.28:0/2727097159 conn(0x7f60bc077fe0 msgr2=0x7f60bc07a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:36.864 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 -- 10.20.193.28:0/2727097159 shutdown_connections 2026-02-20T03:37:36.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 -- 10.20.193.28:0/2727097159 wait complete. 2026-02-20T03:37:36.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 Processor -- start 2026-02-20T03:37:36.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 -- start start 2026-02-20T03:37:36.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109490 0x7f60bc1a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f60bc109e60 0x7f60bc1a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f60bc10a900 0x7f60bc1a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc114a50 con 0x7f60bc109490 2026-02-20T03:37:36.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc1148d0 con 0x7f60bc109e60 2026-02-20T03:37:36.865 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c31cf640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc114bd0 con 0x7f60bc10a900 2026-02-20T03:37:36.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c21cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109490 0x7f60bc1a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:36.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c21cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109490 0x7f60bc1a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52626/0 (socket says 10.20.193.28:52626) 2026-02-20T03:37:36.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c21cd640 1 -- 10.20.193.28:0/3920520316 learned_addr learned my addr 10.20.193.28:0/3920520316 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:36.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c21cd640 1 -- 10.20.193.28:0/3920520316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f60bc10a900 msgr2=0x7f60bc1a8640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:36.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c21cd640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f60bc10a900 0x7f60bc1a8640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c21cd640 1 -- 10.20.193.28:0/3920520316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f60bc109e60 msgr2=0x7f60bc1a15d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c21cd640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f60bc109e60 0x7f60bc1a15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.859+0000 7f60c21cd640 1 -- 10.20.193.28:0/3920520316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc1a8d40 con 0x7f60bc109490 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.861+0000 7f60c21cd640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109490 0x7f60bc1a1090 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00b750 tx=0x7f60ac00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.861+0000 7f60a37fe640 1 -- 10.20.193.28:0/3920520316 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac004480 con 0x7f60bc109490 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.861+0000 7f60a37fe640 1 -- 10.20.193.28:0/3920520316 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f60ac010070 con 0x7f60bc109490 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.861+0000 7f60a37fe640 1 -- 10.20.193.28:0/3920520316 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00ca90 con 0x7f60bc109490 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.861+0000 7f60c31cf640 1 -- 10.20.193.28:0/3920520316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc1a8fd0 con 0x7f60bc109490 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.861+0000 7f60c31cf640 1 -- 10.20.193.28:0/3920520316 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60bc1a9590 con 0x7f60bc109490 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60a37fe640 1 -- 10.20.193.28:0/3920520316 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f60ac01d030 con 0x7f60bc109490 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60c72bae00 1 Processor -- start 2026-02-20T03:37:36.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60c72bae00 1 -- start start 2026-02-20T03:37:36.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0c6e80 0x563e0d0c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0cc560 0x563e0d0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60c72bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563e0d0178f0 con 0x563e0d0c77c0 2026-02-20T03:37:36.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60c72bae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563e0cfc52e0 con 0x563e0d0cc560 2026-02-20T03:37:36.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60c72bae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563e0d013820 con 0x563e0d0c6e80 2026-02-20T03:37:36.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.864+0000 7f60c21cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:36.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c21cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52630/0 (socket says 10.20.193.28:52630) 2026-02-20T03:37:36.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c21cd640 1 -- 10.20.193.28:0/1683170328 learned_addr learned my addr 10.20.193.28:0/1683170328 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:36.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c21cd640 1 -- 10.20.193.28:0/1683170328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0c6e80 msgr2=0x563e0d0c7280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:36.876 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c21cd640 1 --2- 10.20.193.28:0/1683170328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0c6e80 0x563e0d0c7280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c21cd640 1 -- 10.20.193.28:0/1683170328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0cc560 msgr2=0x563e0d0ce9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c21cd640 1 --2- 10.20.193.28:0/1683170328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0cc560 0x563e0d0ce9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c21cd640 1 -- 10.20.193.28:0/1683170328 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0cfb75a0 con 0x563e0d0c77c0 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c21cd640 1 --2- 10.20.193.28:0/1683170328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0cbf40 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0e5b70 tx=0x7f60ac0e7750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4d446ae45c5ad0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f608a3ff640 1 -- 10.20.193.28:0/1683170328 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0f1670 con 0x563e0d0c77c0 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f608a3ff640 1 -- 10.20.193.28:0/1683170328 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f60ac0ec070 con 0x563e0d0c77c0 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f608a3ff640 1 -- 10.20.193.28:0/1683170328 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0e8ad0 con 0x563e0d0c77c0 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c72bae00 1 -- 10.20.193.28:0/1683170328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 msgr2=0x563e0d0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.865+0000 7f60c72bae00 1 --2- 10.20.193.28:0/1683170328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0cbf40 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0e5b70 tx=0x7f60ac0e7750 comp rx=0 tx=0).stop 2026-02-20T03:37:36.877 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.866+0000 7f60c72bae00 1 -- 10.20.193.28:0/1683170328 shutdown_connections 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.866+0000 7f60c72bae00 1 --2- 10.20.193.28:0/1683170328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0cc560 0x563e0d0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.866+0000 7f60c72bae00 1 --2- 10.20.193.28:0/1683170328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0cbf40 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.866+0000 7f60c72bae00 1 --2- 10.20.193.28:0/1683170328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0c6e80 0x563e0d0c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.866+0000 7f60c72bae00 1 -- 10.20.193.28:0/1683170328 >> 10.20.193.28:0/1683170328 conn(0x563e0d0be6f0 msgr2=0x563e0d0c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.866+0000 7f60c72bae00 1 -- 10.20.193.28:0/1683170328 shutdown_connections 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.866+0000 7f60c72bae00 1 -- 10.20.193.28:0/1683170328 wait complete. 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.866+0000 7f60a37fe640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f60980b0d80 0x7f60980b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.866+0000 7f60a37fe640 1 -- 10.20.193.28:0/3920520316 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f60ac0df900 con 0x7f60bc109490 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c29ce640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f60980b0d80 0x7f60980b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c72bae00 1 -- start start 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c72bae00 1 Processor -- start 2026-02-20T03:37:36.878 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c29ce640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f60980b0d80 0x7f60980b3240 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f60b800aab0 tx=0x7f60b8009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c6e80 0x563e0d0dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 0x563e0d0e6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c72bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563e0cfbf0c0 con 0x563e0d0c77c0 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c72bae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563e0d0cf610 con 0x563e0d0c6e80 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.867+0000 7f60c72bae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563e0d0e74d0 con 0x563e0d0cc560 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c19cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c19cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0dffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52632/0 (socket says 10.20.193.28:52632) 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c19cc640 1 -- 10.20.193.28:0/2316831110 learned_addr learned my addr 10.20.193.28:0/2316831110 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c19cc640 1 -- 10.20.193.28:0/2316831110 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 msgr2=0x563e0d0e6f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c19cc640 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 0x563e0d0e6f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.879 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c19cc640 1 -- 10.20.193.28:0/2316831110 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c6e80 msgr2=0x563e0d0dfa80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c19cc640 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c6e80 0x563e0d0dfa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c19cc640 1 -- 10.20.193.28:0/2316831110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0d0d91d0 con 0x563e0d0c77c0 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c19cc640 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0dffc0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f60b0002b60 tx=0x7f60b0009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fad2257c09f5795 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60777fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60777fe640 1 -- 10.20.193.28:0/2316831110 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b002fac0 con 0x563e0d0c77c0 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60777fe640 1 -- 10.20.193.28:0/2316831110 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f60b0033040 con 0x563e0d0c77c0 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60777fe640 1 -- 10.20.193.28:0/2316831110 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0038d30 con 0x563e0d0c77c0 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c72bae00 1 -- 10.20.193.28:0/2316831110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e0cfd3820 con 0x563e0d0c77c0 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60777fe640 1 -- 10.20.193.28:0/2316831110 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f60b0042420 con 0x563e0d0c77c0 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c72bae00 10 client.21675 _ll_register_callbacks cb 0x563e0cfc2ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:36.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.868+0000 7f60c72bae00 1 -- 10.20.193.28:0/2316831110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e0d01f4e0 con 0x563e0d0c77c0 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60777fe640 1 -- 10.20.193.28:0/2316831110 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f60b002fc60 con 0x563e0d0c77c0 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60c72bae00 10 client.21675 fetch_fsmap learned FSMap version 53 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60c72bae00 1 -- 10.20.193.28:0/2316831110 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=53}) -- 0x563e0cfd8380 con 0x563e0d0c77c0 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60777fe640 1 -- 10.20.193.28:0/2316831110 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 53) ==== 8358+0+0 (secure 0 0 0) 0x7f60b0004030 con 0x563e0d0c77c0 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60c72bae00 10 client.21675 fetch_fsmap finished waiting for FSMap version 53 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60c72bae00 10 client.21675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60c72bae00 20 client.21675 populate_metadata read hostname 'trial028' 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e0d0eb830 0x563e0d0edc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60c72bae00 4 client.21675 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:36.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.869+0000 7f60c72bae00 1 -- 10.20.193.28:0/2316831110 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e0cf99bd0 con 0x563e0d0eb830 2026-02-20T03:37:36.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.884+0000 7f60c21cd640 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e0d0eb830 0x563e0d0edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:36.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.951+0000 7f60c21cd640 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e0d0eb830 0x563e0d0edc40 crc :-1 s=READY pgs=577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f073928ca573464 server_cookie=ac811cc06f0b8f48 in_seq=0 out_seq=0 2026-02-20T03:37:36.954 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.951+0000 7f60777fe640 10 client.21675 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:36.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60777fe640 1 -- 10.20.193.28:0/2316831110 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563e0cf99bd0 con 0x563e0d0eb830 2026-02-20T03:37:36.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60777fe640 10 client.21675 handle_command_reply: tid=0 2026-02-20T03:37:36.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 client.21675 shutdown 2026-02-20T03:37:36.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 -- 10.20.193.28:0/2316831110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 msgr2=0x563e0d0dffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:36.981 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0dffc0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f60b0002b60 tx=0x7f60b0009690 comp rx=0 tx=0).stop 2026-02-20T03:37:36.988 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 -- 10.20.193.28:0/2316831110 shutdown_connections 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e0d0eb830 0x563e0d0edc40 crc :-1 s=READY pgs=577 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 0x563e0d0e6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0dffc0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2316831110 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c6e80 0x563e0d0dfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60777fe640 0 client.21675 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 -- 10.20.193.28:0/2316831110 >> 10.20.193.28:0/2316831110 conn(0x563e0d0be6f0 msgr2=0x563e0d0cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 -- 10.20.193.28:0/2316831110 shutdown_connections 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 1 -- 10.20.193.28:0/2316831110 wait complete. 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.978+0000 7f60c72bae00 20 client.21675 trim_cache size 0 max 16384 2026-02-20T03:37:36.989 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c72bae00 1 Processor -- start 2026-02-20T03:37:36.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c72bae00 1 -- start start 2026-02-20T03:37:36.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c6e80 0x563e0d0de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.991 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c77c0 0x563e0d0e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 0x563e0d0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c72bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6068012650 con 0x563e0d0c6e80 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c72bae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f606800ff20 con 0x563e0d0c77c0 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c72bae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f606800dd70 con 0x563e0d0cc560 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c21cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c6e80 0x563e0d0de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c21cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c6e80 0x563e0d0de8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52646/0 (socket says 10.20.193.28:52646) 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c21cd640 1 -- 10.20.193.28:0/1641862832 learned_addr learned my addr 10.20.193.28:0/1641862832 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c21cd640 1 -- 10.20.193.28:0/1641862832 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 msgr2=0x563e0d0c7ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c21cd640 1 --2- 10.20.193.28:0/1641862832 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 0x563e0d0c7ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c21cd640 1 -- 10.20.193.28:0/1641862832 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c77c0 msgr2=0x563e0d0e6f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:36.992 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c21cd640 1 --2- 10.20.193.28:0/1641862832 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c77c0 0x563e0d0e6f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c21cd640 1 -- 10.20.193.28:0/1641862832 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0d0d9000 con 0x563e0d0c6e80 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f60c21cd640 1 --2- 10.20.193.28:0/1641862832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c6e80 0x563e0d0de8c0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f60ac006fd0 tx=0x7f60ac0f1f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac32ac1fb4f444 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f6089bfe640 1 -- 10.20.193.28:0/1641862832 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0a73b0 con 0x563e0d0c6e80 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f6089bfe640 1 -- 10.20.193.28:0/1641862832 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f60ac0e53e0 con 0x563e0d0c6e80 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.986+0000 7f6089bfe640 1 -- 10.20.193.28:0/1641862832 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0e83f0 con 0x563e0d0c6e80 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 -- 10.20.193.28:0/1641862832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c6e80 msgr2=0x563e0d0de8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 --2- 10.20.193.28:0/1641862832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c6e80 0x563e0d0de8c0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f60ac006fd0 tx=0x7f60ac0f1f60 comp rx=0 tx=0).stop 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 -- 10.20.193.28:0/1641862832 shutdown_connections 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 --2- 10.20.193.28:0/1641862832 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 0x563e0d0c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 --2- 10.20.193.28:0/1641862832 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c77c0 0x563e0d0e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.993 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 --2- 10.20.193.28:0/1641862832 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c6e80 0x563e0d0de8c0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.994 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 -- 10.20.193.28:0/1641862832 >> 10.20.193.28:0/1641862832 conn(0x563e0d0be6f0 msgr2=0x563e0d0de1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:36.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 -- 10.20.193.28:0/1641862832 shutdown_connections 2026-02-20T03:37:36.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 -- 10.20.193.28:0/1641862832 wait complete. 2026-02-20T03:37:36.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 -- start start 2026-02-20T03:37:36.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.987+0000 7f60c72bae00 1 Processor -- start 2026-02-20T03:37:36.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c6e80 0x563e0d0e51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0e5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 0x563e0d0e6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:36.997 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f606800e3e0 con 0x563e0d0c77c0 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f606800f850 con 0x563e0d0c6e80 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f606800eab0 con 0x563e0d0cc560 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c19cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c19cc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0e5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52648/0 (socket says 10.20.193.28:52648) 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c19cc640 1 -- 10.20.193.28:0/2185616696 learned_addr learned my addr 10.20.193.28:0/2185616696 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c19cc640 1 -- 10.20.193.28:0/2185616696 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 msgr2=0x563e0d0e6590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c19cc640 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 0x563e0d0e6590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c19cc640 1 -- 10.20.193.28:0/2185616696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c6e80 msgr2=0x563e0d0e51e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c19cc640 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c6e80 0x563e0d0e51e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c19cc640 1 -- 10.20.193.28:0/2185616696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0d0e75a0 con 0x563e0d0c77c0 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c19cc640 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0e5720 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f60b0031040 tx=0x7f60b0002a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8b19ac5a5b5d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60777fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:36.998 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60777fe640 1 -- 10.20.193.28:0/2185616696 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b002fac0 con 0x563e0d0c77c0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60777fe640 1 -- 10.20.193.28:0/2185616696 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f60b0033070 con 0x563e0d0c77c0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60777fe640 1 -- 10.20.193.28:0/2185616696 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b00428f0 con 0x563e0d0c77c0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 -- 10.20.193.28:0/2185616696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e0cd77690 con 0x563e0d0c77c0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 10 client.21681 _ll_register_callbacks cb 0x7f60b00057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 -- 10.20.193.28:0/2185616696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60ac0ec070 con 0x563e0d0c77c0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60777fe640 1 -- 10.20.193.28:0/2185616696 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f60b00389a0 con 0x563e0d0c77c0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60777fe640 1 -- 10.20.193.28:0/2185616696 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f60b0038ba0 con 0x563e0d0c77c0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 10 client.21681 fetch_fsmap learned FSMap version 53 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 -- 10.20.193.28:0/2185616696 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=53}) -- 0x563e0cfdcb70 con 0x563e0d0c77c0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60777fe640 1 -- 10.20.193.28:0/2185616696 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 53) ==== 8358+0+0 (secure 0 0 0) 0x7f60b0054460 con 0x563e0d0c77c0 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 10 client.21681 fetch_fsmap finished waiting for FSMap version 53 2026-02-20T03:37:36.999 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 10 client.21681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:37.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 20 client.21681 populate_metadata read hostname 'trial028' 2026-02-20T03:37:37.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e0d157550 0x563e0d159a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:37.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 4 client.21681 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:37:37.000 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:36.988+0000 7f60c72bae00 1 -- 10.20.193.28:0/2185616696 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e0cfe86b0 con 0x563e0d157550 2026-02-20T03:37:37.007 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.005+0000 7f60c21cd640 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e0d157550 0x563e0d159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:37.060 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.058+0000 7f60c21cd640 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e0d157550 0x563e0d159a10 crc :-1 s=READY pgs=578 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bdff21ce7a29ab1 server_cookie=7b9547aa1cd4bdcc in_seq=0 out_seq=0 2026-02-20T03:37:37.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.058+0000 7f60777fe640 10 client.21681 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:37.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60777fe640 1 -- 10.20.193.28:0/2185616696 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e0cfe86b0 con 0x563e0d157550 2026-02-20T03:37:37.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60777fe640 10 client.21681 handle_command_reply: tid=0 2026-02-20T03:37:37.333 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 client.21681 shutdown 2026-02-20T03:37:37.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 -- 10.20.193.28:0/2185616696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 msgr2=0x563e0d0e5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:37.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0e5720 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f60b0031040 tx=0x7f60b0002a60 comp rx=0 tx=0).stop 2026-02-20T03:37:37.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 -- 10.20.193.28:0/2185616696 shutdown_connections 2026-02-20T03:37:37.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563e0d157550 0x563e0d159a10 crc :-1 s=READY pgs=578 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:37.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563e0d0cc560 0x563e0d0e6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:37.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563e0d0c77c0 0x563e0d0e5720 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:37.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 --2- 10.20.193.28:0/2185616696 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563e0d0c6e80 0x563e0d0e51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:37.334 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 -- 10.20.193.28:0/2185616696 >> 10.20.193.28:0/2185616696 conn(0x563e0d0be6f0 msgr2=0x563e0d0de9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:37.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60777fe640 0 client.21681 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:37.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 -- 10.20.193.28:0/2185616696 shutdown_connections 2026-02-20T03:37:37.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 1 -- 10.20.193.28:0/2185616696 wait complete. 2026-02-20T03:37:37.335 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.330+0000 7f60c72bae00 20 client.21681 trim_cache size 0 max 16384 2026-02-20T03:37:37.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:37:37.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:37:37.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:37:37.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:37:37.336 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 -- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f60980b0d80 msgr2=0x7f60980b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:37.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f60980b0d80 0x7f60980b3240 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f60b800aab0 tx=0x7f60b8009250 comp rx=0 tx=0).stop 2026-02-20T03:37:37.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 -- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109490 msgr2=0x7f60bc1a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:37.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109490 0x7f60bc1a1090 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00b750 tx=0x7f60ac00bc20 comp rx=0 tx=0).stop 2026-02-20T03:37:37.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 -- 10.20.193.28:0/3920520316 shutdown_connections 2026-02-20T03:37:37.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f60980b0d80 0x7f60980b3240 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:37.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f60bc10a900 0x7f60bc1a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:37.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f60bc109e60 0x7f60bc1a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:37.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 --2- 10.20.193.28:0/3920520316 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f60bc109490 0x7f60bc1a1090 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:37.337 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 -- 10.20.193.28:0/3920520316 >> 10.20.193.28:0/3920520316 conn(0x7f60bc077fe0 msgr2=0x7f60bc10d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:37.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 -- 10.20.193.28:0/3920520316 shutdown_connections 2026-02-20T03:37:37.346 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:37.332+0000 7f60c31cf640 1 -- 10.20.193.28:0/3920520316 wait complete. 2026-02-20T03:37:37.587 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:37 trial028 ceph-mon[38552]: pgmap v874: 129 pgs: 129 active+clean; 789 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 MiB/s rd, 11 MiB/s wr, 925 op/s 2026-02-20T03:37:37.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:37 trial177 ceph-mon[43181]: pgmap v874: 129 pgs: 129 active+clean; 789 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 MiB/s rd, 11 MiB/s wr, 925 op/s 2026-02-20T03:37:37.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229964 21.29 MB/sec execute 428 sec latency 8370.202 ms 2026-02-20T03:37:37.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:37 trial126 ceph-mon[38476]: pgmap v874: 129 pgs: 129 active+clean; 789 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 MiB/s rd, 11 MiB/s wr, 925 op/s 2026-02-20T03:37:38.643 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:38 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:37:38.643 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:38 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:37:38.643 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:38 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:37:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:38 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:37:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:38 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:37:38.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:38 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:37:38.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229964 21.24 MB/sec execute 429 sec latency 9370.243 ms 2026-02-20T03:37:38.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:38 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:37:38.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:38 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:37:38.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:38 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:37:39.723 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:39 trial028 ceph-mon[38552]: pgmap v875: 129 pgs: 129 active+clean; 792 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 6.8 MiB/s rd, 11 MiB/s wr, 754 op/s 2026-02-20T03:37:39.736 INFO:tasks.workunit.client.0.trial028.stdout: 10 229964 21.19 MB/sec execute 430 sec latency 10370.279 ms 2026-02-20T03:37:39.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:39 trial126 ceph-mon[38476]: pgmap v875: 129 pgs: 129 active+clean; 792 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 6.8 MiB/s rd, 11 MiB/s wr, 754 op/s 2026-02-20T03:37:39.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:39 trial177 ceph-mon[43181]: pgmap v875: 129 pgs: 129 active+clean; 792 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 6.8 MiB/s rd, 11 MiB/s wr, 754 op/s 2026-02-20T03:37:40.551 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:40 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:40.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229964 21.14 MB/sec execute 431 sec latency 11370.328 ms 2026-02-20T03:37:40.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:40 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:40.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:40 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:41.659 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:41 trial028 ceph-mon[38552]: pgmap v876: 129 pgs: 129 active+clean; 802 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 MiB/s rd, 13 MiB/s wr, 682 op/s 2026-02-20T03:37:41.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229965 21.09 MB/sec execute 432 sec latency 12370.559 ms 2026-02-20T03:37:41.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:41 trial126 ceph-mon[38476]: pgmap v876: 129 pgs: 129 active+clean; 802 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 MiB/s rd, 13 MiB/s wr, 682 op/s 2026-02-20T03:37:41.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:41 trial177 ceph-mon[43181]: pgmap v876: 129 pgs: 129 active+clean; 802 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 5.5 MiB/s rd, 13 MiB/s wr, 682 op/s 2026-02-20T03:37:42.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229965 21.04 MB/sec execute 433 sec latency 13370.605 ms 2026-02-20T03:37:43.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:43 trial028 ceph-mon[38552]: pgmap v877: 129 pgs: 129 active+clean; 807 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 545 op/s 2026-02-20T03:37:43.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229965 20.99 MB/sec execute 434 sec latency 14370.655 ms 2026-02-20T03:37:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:43 trial126 ceph-mon[38476]: pgmap v877: 129 pgs: 129 active+clean; 807 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 545 op/s 2026-02-20T03:37:43.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:43 trial177 ceph-mon[43181]: pgmap v877: 129 pgs: 129 active+clean; 807 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 2.7 MiB/s rd, 11 MiB/s wr, 545 op/s 2026-02-20T03:37:44.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229965 20.95 MB/sec execute 435 sec latency 15370.699 ms 2026-02-20T03:37:45.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229965 20.90 MB/sec execute 436 sec latency 16327.092 ms 2026-02-20T03:37:45.751 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:45 trial028 ceph-mon[38552]: pgmap v878: 129 pgs: 129 active+clean; 825 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 10 MiB/s wr, 450 op/s 2026-02-20T03:37:45.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:45 trial126 ceph-mon[38476]: pgmap v878: 129 pgs: 129 active+clean; 825 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 10 MiB/s wr, 450 op/s 2026-02-20T03:37:45.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:45 trial177 ceph-mon[43181]: pgmap v878: 129 pgs: 129 active+clean; 825 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 1.2 MiB/s rd, 10 MiB/s wr, 450 op/s 2026-02-20T03:37:46.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.85 MB/sec execute 437 sec latency 17327.126 ms 2026-02-20T03:37:47.649 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:47 trial028 ceph-mon[38552]: pgmap v879: 129 pgs: 129 active+clean; 851 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 267 KiB/s rd, 10 MiB/s wr, 397 op/s 2026-02-20T03:37:47.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.80 MB/sec execute 438 sec latency 18327.169 ms 2026-02-20T03:37:47.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:47 trial177 ceph-mon[43181]: pgmap v879: 129 pgs: 129 active+clean; 851 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 267 KiB/s rd, 10 MiB/s wr, 397 op/s 2026-02-20T03:37:48.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:47 trial126 ceph-mon[38476]: pgmap v879: 129 pgs: 129 active+clean; 851 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 267 KiB/s rd, 10 MiB/s wr, 397 op/s 2026-02-20T03:37:48.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.76 MB/sec execute 439 sec latency 19327.208 ms 2026-02-20T03:37:49.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.71 MB/sec execute 440 sec latency 20327.257 ms 2026-02-20T03:37:49.875 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:49 trial028 ceph-mon[38552]: pgmap v880: 129 pgs: 129 active+clean; 861 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 146 KiB/s rd, 10 MiB/s wr, 359 op/s 2026-02-20T03:37:49.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:49 trial177 ceph-mon[43181]: pgmap v880: 129 pgs: 129 active+clean; 861 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 146 KiB/s rd, 10 MiB/s wr, 359 op/s 2026-02-20T03:37:50.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:49 trial126 ceph-mon[38476]: pgmap v880: 129 pgs: 129 active+clean; 861 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 146 KiB/s rd, 10 MiB/s wr, 359 op/s 2026-02-20T03:37:50.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.408+0000 7f27e3fff640 1 -- 10.20.193.28:0/947685098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e41064f0 msgr2=0x7f27e410cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:50.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.408+0000 7f27e3fff640 1 --2- 10.20.193.28:0/947685098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e41064f0 0x7f27e410cd80 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f27d400b0a0 tx=0x7f27d402f450 comp rx=0 tx=0).stop 2026-02-20T03:37:50.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.408+0000 7f27e3fff640 1 -- 10.20.193.28:0/947685098 shutdown_connections 2026-02-20T03:37:50.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.408+0000 7f27e3fff640 1 --2- 10.20.193.28:0/947685098 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e41064f0 0x7f27e410cd80 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.408+0000 7f27e3fff640 1 --2- 10.20.193.28:0/947685098 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27e4105b30 0x7f27e4105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.408+0000 7f27e3fff640 1 --2- 10.20.193.28:0/947685098 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27e4104940 0x7f27e4104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.408+0000 7f27e3fff640 1 -- 10.20.193.28:0/947685098 >> 10.20.193.28:0/947685098 conn(0x7f27e41000c0 msgr2=0x7f27e41024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:50.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.408+0000 7f27e3fff640 1 -- 10.20.193.28:0/947685098 shutdown_connections 2026-02-20T03:37:50.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.408+0000 7f27e3fff640 1 -- 10.20.193.28:0/947685098 wait complete. 2026-02-20T03:37:50.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e3fff640 1 Processor -- start 2026-02-20T03:37:50.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e3fff640 1 -- start start 2026-02-20T03:37:50.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e3fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27e4104940 0x7f27e419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e3fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e4105b30 0x7f27e419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e3fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27e41064f0 0x7f27e41a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e3fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4110550 con 0x7f27e4105b30 2026-02-20T03:37:50.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e3fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41103d0 con 0x7f27e41064f0 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e3fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41106d0 con 0x7f27e4104940 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e4105b30 0x7f27e419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e4105b30 0x7f27e419d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56124/0 (socket says 10.20.193.28:56124) 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e27fc640 1 -- 10.20.193.28:0/2175988791 learned_addr learned my addr 10.20.193.28:0/2175988791 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e27fc640 1 -- 10.20.193.28:0/2175988791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27e4104940 msgr2=0x7f27e419cb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e27fc640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27e4104940 0x7f27e419cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e27fc640 1 -- 10.20.193.28:0/2175988791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27e41064f0 msgr2=0x7f27e41a4140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e27fc640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27e41064f0 0x7f27e41a4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e27fc640 1 -- 10.20.193.28:0/2175988791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e41a4840 con 0x7f27e4105b30 2026-02-20T03:37:50.418 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e27fc640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e4105b30 0x7f27e419d0d0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00b570 tx=0x7f27cc00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27c3fff640 1 -- 10.20.193.28:0/2175988791 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc013020 con 0x7f27e4105b30 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27c3fff640 1 -- 10.20.193.28:0/2175988791 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f27cc004480 con 0x7f27e4105b30 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27c3fff640 1 -- 10.20.193.28:0/2175988791 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00fb50 con 0x7f27e4105b30 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.409+0000 7f27e3fff640 1 -- 10.20.193.28:0/2175988791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e41a4b30 con 0x7f27e4105b30 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.411+0000 7f27e3fff640 1 -- 10.20.193.28:0/2175988791 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e41a5030 con 0x7f27e4105b30 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.411+0000 7f27c3fff640 1 -- 10.20.193.28:0/2175988791 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f27cc002780 con 0x7f27e4105b30 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.411+0000 7f27ec3f6e00 1 Processor -- start 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27ec3f6e00 1 -- start start 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a2e80 0x5597b80a3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 0x5597b80aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.419 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5597b7ff38f0 con 0x5597b80a37c0 2026-02-20T03:37:50.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5597b7fa12e0 con 0x5597b80a2e80 2026-02-20T03:37:50.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5597b7fef820 con 0x5597b80a8560 2026-02-20T03:37:50.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80a7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:50.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80a7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56126/0 (socket says 10.20.193.28:56126) 2026-02-20T03:37:50.420 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27e2ffd640 1 -- 10.20.193.28:0/2843319616 learned_addr learned my addr 10.20.193.28:0/2843319616 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:50.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27e2ffd640 1 -- 10.20.193.28:0/2843319616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 msgr2=0x5597b80aa9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:50.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/2843319616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 0x5597b80aa9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27e2ffd640 1 -- 10.20.193.28:0/2843319616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a2e80 msgr2=0x5597b80a3280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:50.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/2843319616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a2e80 0x5597b80a3280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27e2ffd640 1 -- 10.20.193.28:0/2843319616 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b7f935a0 con 0x5597b80a37c0 2026-02-20T03:37:50.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/2843319616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80a7f40 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009840 tx=0x7f27d8009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6412bb58834a1ffa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27af7fe640 1 -- 10.20.193.28:0/2843319616 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8016070 con 0x5597b80a37c0 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27af7fe640 1 -- 10.20.193.28:0/2843319616 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f27d8004480 con 0x5597b80a37c0 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27af7fe640 1 -- 10.20.193.28:0/2843319616 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d800bca0 con 0x5597b80a37c0 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27c3fff640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27b80b0e20 0x7f27b80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/2843319616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 msgr2=0x5597b80a7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/2843319616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80a7f40 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009840 tx=0x7f27d8009d10 comp rx=0 tx=0).stop 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.414+0000 7f27c3fff640 1 -- 10.20.193.28:0/2175988791 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f27cc0e04c0 con 0x7f27e4105b30 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/2843319616 shutdown_connections 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/2843319616 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 0x5597b80aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/2843319616 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80a7f40 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/2843319616 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a2e80 0x5597b80a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/2843319616 >> 10.20.193.28:0/2843319616 conn(0x5597b809a6f0 msgr2=0x5597b80a1570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e37fe640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27b80b0e20 0x7f27b80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/2843319616 shutdown_connections 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/2843319616 wait complete. 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e37fe640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27b80b0e20 0x7f27b80b32e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f27d40045f0 tx=0x7f27d4009da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- start start 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 Processor -- start 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a2e80 0x5597b80bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80bbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 0x5597b80c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5597b7f9b0c0 con 0x5597b80a37c0 2026-02-20T03:37:50.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5597b80ab610 con 0x5597b80a2e80 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5597b80c34d0 con 0x5597b80a8560 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80bbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80bbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56134/0 (socket says 10.20.193.28:56134) 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e27fc640 1 -- 10.20.193.28:0/3368279678 learned_addr learned my addr 10.20.193.28:0/3368279678 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e27fc640 1 -- 10.20.193.28:0/3368279678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 msgr2=0x5597b80c2f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e27fc640 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 0x5597b80c2f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e27fc640 1 -- 10.20.193.28:0/3368279678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a2e80 msgr2=0x5597b80bba80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e27fc640 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a2e80 0x5597b80bba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e27fc640 1 -- 10.20.193.28:0/3368279678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b80b51d0 con 0x5597b80a37c0 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27e27fc640 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80bbfc0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0a7f00 tx=0x7f27cc0a79f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712abf28962eb788 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27acff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:50.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27acff9640 1 -- 10.20.193.28:0/3368279678 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0b1460 con 0x5597b80a37c0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27acff9640 1 -- 10.20.193.28:0/3368279678 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f27cc002aa0 con 0x5597b80a37c0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27acff9640 1 -- 10.20.193.28:0/3368279678 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0a3b80 con 0x5597b80a37c0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/3368279678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597b7faf820 con 0x5597b80a37c0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27acff9640 1 -- 10.20.193.28:0/3368279678 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f27cc0a6c80 con 0x5597b80a37c0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 10 client.21693 _ll_register_callbacks cb 0x5597b7f9eff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/3368279678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597b7ffb4e0 con 0x5597b80a37c0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27acff9640 1 -- 10.20.193.28:0/3368279678 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f27cc0ac120 con 0x5597b80a37c0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 10 client.21693 fetch_fsmap learned FSMap version 54 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/3368279678 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=54}) -- 0x5597b7fb4380 con 0x5597b80a37c0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27acff9640 1 -- 10.20.193.28:0/3368279678 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 54) ==== 8354+0+0 (secure 0 0 0) 0x7f27cc0a6e80 con 0x5597b80a37c0 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 10 client.21693 fetch_fsmap finished waiting for FSMap version 54 2026-02-20T03:37:50.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 10 client.21693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:50.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 20 client.21693 populate_metadata read hostname 'trial028' 2026-02-20T03:37:50.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597b80c7730 0x5597b80c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 4 client.21693 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:50.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.415+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/3368279678 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597b7f75bd0 con 0x5597b80c7730 2026-02-20T03:37:50.437 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.435+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597b80c7730 0x5597b80c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:50.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.502+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597b80c7730 0x5597b80c9bf0 crc :-1 s=READY pgs=579 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=436c9a90107da962 server_cookie=a5ff5f3ba98fb129 in_seq=0 out_seq=0 2026-02-20T03:37:50.504 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.502+0000 7f27acff9640 10 client.21693 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:50.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27acff9640 1 -- 10.20.193.28:0/3368279678 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5597b7f75bd0 con 0x5597b80c7730 2026-02-20T03:37:50.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27acff9640 10 client.21693 handle_command_reply: tid=0 2026-02-20T03:37:50.519 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 client.21693 shutdown 2026-02-20T03:37:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/3368279678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 msgr2=0x5597b80bbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80bbfc0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0a7f00 tx=0x7f27cc0a79f0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/3368279678 shutdown_connections 2026-02-20T03:37:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597b80c7730 0x5597b80c9bf0 crc :-1 s=READY pgs=579 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 0x5597b80c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.520 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80bbfc0 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/3368279678 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a2e80 0x5597b80bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/3368279678 >> 10.20.193.28:0/3368279678 conn(0x5597b809a6f0 msgr2=0x5597b80a9910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:50.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27acff9640 0 client.21693 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:50.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/3368279678 shutdown_connections 2026-02-20T03:37:50.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/3368279678 wait complete. 2026-02-20T03:37:50.521 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.515+0000 7f27ec3f6e00 20 client.21693 trim_cache size 0 max 16384 2026-02-20T03:37:50.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 Processor -- start 2026-02-20T03:37:50.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- start start 2026-02-20T03:37:50.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a2e80 0x5597b80a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a37c0 0x5597b80c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 0x5597b80a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2788012650 con 0x5597b80a2e80 2026-02-20T03:37:50.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f278800ff20 con 0x5597b80a37c0 2026-02-20T03:37:50.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f278800dd70 con 0x5597b80a8560 2026-02-20T03:37:50.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a2e80 0x5597b80a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:50.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e2ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a2e80 0x5597b80a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56136/0 (socket says 10.20.193.28:56136) 2026-02-20T03:37:50.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e2ffd640 1 -- 10.20.193.28:0/629921808 learned_addr learned my addr 10.20.193.28:0/629921808 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:50.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e2ffd640 1 -- 10.20.193.28:0/629921808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 msgr2=0x5597b80a4b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:50.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/629921808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 0x5597b80a4b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e2ffd640 1 -- 10.20.193.28:0/629921808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a37c0 msgr2=0x5597b80c2f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/629921808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a37c0 0x5597b80c2f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e2ffd640 1 -- 10.20.193.28:0/629921808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b80b5000 con 0x5597b80a2e80 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/629921808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a2e80 0x5597b80a45f0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f27d8014040 tx=0x7f27d800b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea87430f029070a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27aeffd640 1 -- 10.20.193.28:0/629921808 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8016040 con 0x5597b80a2e80 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27aeffd640 1 -- 10.20.193.28:0/629921808 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f27d800bc70 con 0x5597b80a2e80 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27aeffd640 1 -- 10.20.193.28:0/629921808 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8002e60 con 0x5597b80a2e80 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/629921808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a2e80 msgr2=0x5597b80a45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/629921808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a2e80 0x5597b80a45f0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f27d8014040 tx=0x7f27d800b760 comp rx=0 tx=0).stop 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/629921808 shutdown_connections 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/629921808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a8560 0x5597b80a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/629921808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a37c0 0x5597b80c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/629921808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a2e80 0x5597b80a45f0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/629921808 >> 10.20.193.28:0/629921808 conn(0x5597b809a6f0 msgr2=0x5597b80a3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:50.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/629921808 shutdown_connections 2026-02-20T03:37:50.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/629921808 wait complete. 2026-02-20T03:37:50.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- start start 2026-02-20T03:37:50.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 Processor -- start 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a2e80 0x5597b80c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a8560 0x5597b80c0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f278800e3e0 con 0x5597b80a37c0 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f278800f850 con 0x5597b80a8560 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f278800eab0 con 0x5597b80a2e80 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e27fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80c2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56150/0 (socket says 10.20.193.28:56150) 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e27fc640 1 -- 10.20.193.28:0/1090631341 learned_addr learned my addr 10.20.193.28:0/1090631341 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e27fc640 1 -- 10.20.193.28:0/1090631341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a2e80 msgr2=0x5597b80c2820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:50.536 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e27fc640 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a2e80 0x5597b80c2820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e27fc640 1 -- 10.20.193.28:0/1090631341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a8560 msgr2=0x5597b80c0e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e27fc640 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a8560 0x5597b80c0e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e27fc640 1 -- 10.20.193.28:0/1090631341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597b80c6130 con 0x5597b80a37c0 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27e27fc640 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80c2d60 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00bf50 tx=0x7f27cc0e0150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f960d78aa49f09 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27acff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27acff9640 1 -- 10.20.193.28:0/1090631341 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0ac2c0 con 0x5597b80a37c0 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27acff9640 1 -- 10.20.193.28:0/1090631341 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f27cc094020 con 0x5597b80a37c0 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27acff9640 1 -- 10.20.193.28:0/1090631341 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0a7000 con 0x5597b80a37c0 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/1090631341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597b7d53690 con 0x5597b80a37c0 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 10 client.21699 _ll_register_callbacks cb 0x7f27cc0a8080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.521+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/1090631341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27d8004480 con 0x5597b80a37c0 2026-02-20T03:37:50.537 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27acff9640 1 -- 10.20.193.28:0/1090631341 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f27cc0941d0 con 0x5597b80a37c0 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27acff9640 1 -- 10.20.193.28:0/1090631341 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f27cc0a7210 con 0x5597b80a37c0 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27ec3f6e00 10 client.21699 fetch_fsmap learned FSMap version 54 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/1090631341 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=54}) -- 0x5597b7fb8b70 con 0x5597b80a37c0 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27acff9640 1 -- 10.20.193.28:0/1090631341 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 54) ==== 8354+0+0 (secure 0 0 0) 0x7f27cc005a70 con 0x5597b80a37c0 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27ec3f6e00 10 client.21699 fetch_fsmap finished waiting for FSMap version 54 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27ec3f6e00 10 client.21699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27ec3f6e00 20 client.21699 populate_metadata read hostname 'trial028' 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597b813bc90 0x5597b813e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27ec3f6e00 4 client.21699 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:37:50.538 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.526+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/1090631341 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5597b7fc46b0 con 0x5597b813bc90 2026-02-20T03:37:50.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.541+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597b813bc90 0x5597b813e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:50.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.596+0000 7f27e2ffd640 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597b813bc90 0x5597b813e150 crc :-1 s=READY pgs=580 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a9f0e3176632c1 server_cookie=6d48a183c1a6b2da in_seq=0 out_seq=0 2026-02-20T03:37:50.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:50.596+0000 7f27acff9640 10 client.21699 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:50.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.66 MB/sec execute 441 sec latency 21327.300 ms 2026-02-20T03:37:51.731 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.61 MB/sec execute 442 sec latency 22327.343 ms 2026-02-20T03:37:51.774 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:51 trial028 ceph-mon[38552]: pgmap v881: 129 pgs: 129 active+clean; 878 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 282 KiB/s rd, 12 MiB/s wr, 372 op/s 2026-02-20T03:37:51.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:51 trial177 ceph-mon[43181]: pgmap v881: 129 pgs: 129 active+clean; 878 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 282 KiB/s rd, 12 MiB/s wr, 372 op/s 2026-02-20T03:37:52.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:51 trial126 ceph-mon[38476]: pgmap v881: 129 pgs: 129 active+clean; 878 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 282 KiB/s rd, 12 MiB/s wr, 372 op/s 2026-02-20T03:37:52.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27acff9640 1 -- 10.20.193.28:0/1090631341 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5597b7fc46b0 con 0x5597b813bc90 2026-02-20T03:37:52.515 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27acff9640 10 client.21699 handle_command_reply: tid=0 2026-02-20T03:37:52.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27ec3f6e00 1 client.21699 shutdown 2026-02-20T03:37:52.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/1090631341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 msgr2=0x5597b80c2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:52.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80c2d60 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00bf50 tx=0x7f27cc0e0150 comp rx=0 tx=0).stop 2026-02-20T03:37:52.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/1090631341 shutdown_connections 2026-02-20T03:37:52.516 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5597b813bc90 0x5597b813e150 crc :-1 s=READY pgs=580 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:52.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5597b80a8560 0x5597b80c0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:52.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5597b80a37c0 0x5597b80c2d60 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:52.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27ec3f6e00 1 --2- 10.20.193.28:0/1090631341 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5597b80a2e80 0x5597b80c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:52.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/1090631341 >> 10.20.193.28:0/1090631341 conn(0x5597b809a6f0 msgr2=0x5597b80a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:52.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.511+0000 7f27acff9640 0 client.21699 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:52.517 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.513+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/1090631341 shutdown_connections 2026-02-20T03:37:52.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.513+0000 7f27ec3f6e00 1 -- 10.20.193.28:0/1090631341 wait complete. 2026-02-20T03:37:52.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.513+0000 7f27ec3f6e00 20 client.21699 trim_cache size 0 max 16384 2026-02-20T03:37:52.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:37:52.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:37:52.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:37:52.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:37:52.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 -- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27b80b0e20 msgr2=0x7f27b80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:52.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27b80b0e20 0x7f27b80b32e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f27d40045f0 tx=0x7f27d4009da0 comp rx=0 tx=0).stop 2026-02-20T03:37:52.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 -- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e4105b30 msgr2=0x7f27e419d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:52.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e4105b30 0x7f27e419d0d0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00b570 tx=0x7f27cc00ba40 comp rx=0 tx=0).stop 2026-02-20T03:37:52.531 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 -- 10.20.193.28:0/2175988791 shutdown_connections 2026-02-20T03:37:52.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f27b80b0e20 0x7f27b80b32e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:52.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f27e41064f0 0x7f27e41a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:52.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f27e4105b30 0x7f27e419d0d0 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:52.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 --2- 10.20.193.28:0/2175988791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f27e4104940 0x7f27e419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:52.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 -- 10.20.193.28:0/2175988791 >> 10.20.193.28:0/2175988791 conn(0x7f27e41000c0 msgr2=0x7f27e4108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:52.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 -- 10.20.193.28:0/2175988791 shutdown_connections 2026-02-20T03:37:52.532 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:37:52.514+0000 7f27e3fff640 1 -- 10.20.193.28:0/2175988791 wait complete. 2026-02-20T03:37:52.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.57 MB/sec execute 443 sec latency 23327.383 ms 2026-02-20T03:37:53.656 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:53 trial028 ceph-mon[38552]: pgmap v882: 129 pgs: 129 active+clean; 866 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 203 KiB/s rd, 11 MiB/s wr, 317 op/s 2026-02-20T03:37:53.656 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:37:53.656 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:37:53.656 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:37:53.656 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:53 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:37:53.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.52 MB/sec execute 444 sec latency 24327.421 ms 2026-02-20T03:37:53.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:53 trial177 ceph-mon[43181]: pgmap v882: 129 pgs: 129 active+clean; 866 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 203 KiB/s rd, 11 MiB/s wr, 317 op/s 2026-02-20T03:37:53.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:37:53.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:37:53.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:37:53.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:53 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:37:54.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:53 trial126 ceph-mon[38476]: pgmap v882: 129 pgs: 129 active+clean; 866 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 203 KiB/s rd, 11 MiB/s wr, 317 op/s 2026-02-20T03:37:54.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:37:54.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:37:54.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:37:54.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:53 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:37:54.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.48 MB/sec execute 445 sec latency 25327.462 ms 2026-02-20T03:37:54.755 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:54 trial028 ceph-mon[38552]: pgmap v883: 129 pgs: 129 active+clean; 839 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 649 KiB/s rd, 11 MiB/s wr, 375 op/s 2026-02-20T03:37:54.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:54 trial177 ceph-mon[43181]: pgmap v883: 129 pgs: 129 active+clean; 839 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 649 KiB/s rd, 11 MiB/s wr, 375 op/s 2026-02-20T03:37:55.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:54 trial126 ceph-mon[38476]: pgmap v883: 129 pgs: 129 active+clean; 839 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 649 KiB/s rd, 11 MiB/s wr, 375 op/s 2026-02-20T03:37:55.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.43 MB/sec execute 446 sec latency 26327.511 ms 2026-02-20T03:37:56.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.38 MB/sec execute 447 sec latency 27327.549 ms 2026-02-20T03:37:57.484 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:57 trial028 ceph-mon[38552]: pgmap v884: 129 pgs: 129 active+clean; 791 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 772 KiB/s rd, 12 MiB/s wr, 514 op/s 2026-02-20T03:37:57.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:57 trial177 ceph-mon[43181]: pgmap v884: 129 pgs: 129 active+clean; 791 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 772 KiB/s rd, 12 MiB/s wr, 514 op/s 2026-02-20T03:37:57.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.34 MB/sec execute 448 sec latency 28327.585 ms 2026-02-20T03:37:57.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:57 trial126 ceph-mon[38476]: pgmap v884: 129 pgs: 129 active+clean; 791 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 772 KiB/s rd, 12 MiB/s wr, 514 op/s 2026-02-20T03:37:57.952 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:37:58.273 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:37:58.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- 10.20.193.28:0/3731665571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 msgr2=0x7fe2ec111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:58.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 --2- 10.20.193.28:0/3731665571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 0x7fe2ec111850 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00b0d0 tx=0x7fe2dc02f490 comp rx=0 tx=0).stop 2026-02-20T03:37:58.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- 10.20.193.28:0/3731665571 shutdown_connections 2026-02-20T03:37:58.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 --2- 10.20.193.28:0/3731665571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 0x7fe2ec111850 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 --2- 10.20.193.28:0/3731665571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe2ec104980 0x7fe2ec104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 --2- 10.20.193.28:0/3731665571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe2ec10a980 0x7fe2ec10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- 10.20.193.28:0/3731665571 >> 10.20.193.28:0/3731665571 conn(0x7fe2ec100680 msgr2=0x7fe2ec102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:58.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- 10.20.193.28:0/3731665571 shutdown_connections 2026-02-20T03:37:58.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- 10.20.193.28:0/3731665571 wait complete. 2026-02-20T03:37:58.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 Processor -- start 2026-02-20T03:37:58.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- start start 2026-02-20T03:37:58.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe2ec104980 0x7fe2ec111670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 0x7fe2ec10e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe2ec10a980 0x7fe2ec10ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec114cd0 con 0x7fe2ec105320 2026-02-20T03:37:58.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec114b50 con 0x7fe2ec104980 2026-02-20T03:37:58.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec114e50 con 0x7fe2ec10a980 2026-02-20T03:37:58.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 0x7fe2ec10e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:58.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 0x7fe2ec10e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47896/0 (socket says 10.20.193.28:47896) 2026-02-20T03:37:58.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2e9d74640 1 -- 10.20.193.28:0/1308833956 learned_addr learned my addr 10.20.193.28:0/1308833956 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:58.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2e9d74640 1 -- 10.20.193.28:0/1308833956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe2ec10a980 msgr2=0x7fe2ec10ec80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:58.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2e9d74640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe2ec10a980 0x7fe2ec10ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2e9d74640 1 -- 10.20.193.28:0/1308833956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe2ec104980 msgr2=0x7fe2ec111670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:58.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2e9d74640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe2ec104980 0x7fe2ec111670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.535 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2e9d74640 1 -- 10.20.193.28:0/1308833956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec10f540 con 0x7fe2ec105320 2026-02-20T03:37:58.543 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2e9d74640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 0x7fe2ec10e720 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400b570 tx=0x7fe2d400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2d37fe640 1 -- 10.20.193.28:0/1308833956 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4013020 con 0x7fe2ec105320 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2d37fe640 1 -- 10.20.193.28:0/1308833956 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe2d4004480 con 0x7fe2ec105320 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2d37fe640 1 -- 10.20.193.28:0/1308833956 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400fb50 con 0x7fe2ec105320 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.528+0000 7fe2eb577640 1 -- 10.20.193.28:0/1308833956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ec1adc90 con 0x7fe2ec105320 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.531+0000 7fe2eb577640 1 -- 10.20.193.28:0/1308833956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ec1ae180 con 0x7fe2ec105320 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.531+0000 7fe2d37fe640 1 -- 10.20.193.28:0/1308833956 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe2d4002780 con 0x7fe2ec105320 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 Processor -- start 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 -- start start 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561193761000 0x5611937613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375b630 0x56119375ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375bfb0 0x561193767e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5611936dbe50 con 0x56119375b630 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5611936ae9c0 con 0x561193761000 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56119365c240 con 0x56119375bfb0 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ea575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375b630 0x56119375ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ea575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375b630 0x56119375ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47908/0 (socket says 10.20.193.28:47908) 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ea575640 1 -- 10.20.193.28:0/562545954 learned_addr learned my addr 10.20.193.28:0/562545954 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ea575640 1 -- 10.20.193.28:0/562545954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375bfb0 msgr2=0x561193767e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ea575640 1 --2- 10.20.193.28:0/562545954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375bfb0 0x561193767e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ea575640 1 -- 10.20.193.28:0/562545954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561193761000 msgr2=0x5611937613e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:58.545 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ea575640 1 --2- 10.20.193.28:0/562545954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561193761000 0x5611937613e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ea575640 1 -- 10.20.193.28:0/562545954 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56119366f420 con 0x56119375b630 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ea575640 1 --2- 10.20.193.28:0/562545954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375b630 0x56119375ba70 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009870 tx=0x7fe2e0009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2626f223752ad332 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2d37fe640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2c40b0e20 0x7fe2c40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2d0ff9640 1 -- 10.20.193.28:0/562545954 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0016070 con 0x56119375b630 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2d0ff9640 1 -- 10.20.193.28:0/562545954 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe2e0004480 con 0x56119375b630 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2d0ff9640 1 -- 10.20.193.28:0/562545954 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e000bd30 con 0x56119375b630 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2d37fe640 1 -- 10.20.193.28:0/1308833956 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe2d40e0480 con 0x7fe2ec105320 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 -- 10.20.193.28:0/562545954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375b630 msgr2=0x56119375ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 --2- 10.20.193.28:0/562545954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375b630 0x56119375ba70 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009870 tx=0x7fe2e0009d40 comp rx=0 tx=0).stop 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2ead76640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2c40b0e20 0x7fe2c40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 -- 10.20.193.28:0/562545954 shutdown_connections 2026-02-20T03:37:58.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 --2- 10.20.193.28:0/562545954 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375bfb0 0x561193767e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 --2- 10.20.193.28:0/562545954 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375b630 0x56119375ba70 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 --2- 10.20.193.28:0/562545954 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561193761000 0x5611937613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 -- 10.20.193.28:0/562545954 >> 10.20.193.28:0/562545954 conn(0x56119371e290 msgr2=0x561193759d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 -- 10.20.193.28:0/562545954 shutdown_connections 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.533+0000 7fe2f317de00 1 -- 10.20.193.28:0/562545954 wait complete. 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 -- start start 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2c40b0e20 0x7fe2c40b32e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00b0a0 tx=0x7fe2dc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 Processor -- start 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375b630 0x561193775f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56119375bfb0 0x5611937764c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561193761000 0x5611937746c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5611936aa8f0 con 0x561193761000 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56119349cf50 con 0x56119375bfb0 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x561193774e40 con 0x56119375b630 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561193761000 0x5611937746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561193761000 0x5611937746c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47922/0 (socket says 10.20.193.28:47922) 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 -- 10.20.193.28:0/666732897 learned_addr learned my addr 10.20.193.28:0/666732897 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 -- 10.20.193.28:0/666732897 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375b630 msgr2=0x561193775f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375b630 0x561193775f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 -- 10.20.193.28:0/666732897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56119375bfb0 msgr2=0x5611937764c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56119375bfb0 0x5611937764c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 -- 10.20.193.28:0/666732897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56119376db20 con 0x561193761000 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2ead76640 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561193761000 0x5611937746c0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc036000 tx=0x7fe2dc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcec1a47edd9684 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:58.548 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe29bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe29bfff640 1 -- 10.20.193.28:0/666732897 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0078c0 con 0x561193761000 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe29bfff640 1 -- 10.20.193.28:0/666732897 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe2dc033030 con 0x561193761000 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe29bfff640 1 -- 10.20.193.28:0/666732897 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc038c50 con 0x561193761000 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 -- 10.20.193.28:0/666732897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56119347fb40 con 0x561193761000 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe29bfff640 1 -- 10.20.193.28:0/666732897 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe2dc038df0 con 0x561193761000 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 10 client.21711 _ll_register_callbacks cb 0x5611936e7f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 -- 10.20.193.28:0/666732897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5611936bc1a0 con 0x561193761000 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe29bfff640 1 -- 10.20.193.28:0/666732897 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe2dc050060 con 0x561193761000 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 10 client.21711 fetch_fsmap learned FSMap version 55 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 -- 10.20.193.28:0/666732897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x561193669230 con 0x561193761000 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe29bfff640 1 -- 10.20.193.28:0/666732897 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fe2dc03f070 con 0x561193761000 2026-02-20T03:37:58.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 10 client.21711 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:37:58.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 10 client.21711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:58.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 20 client.21711 populate_metadata read hostname 'trial028' 2026-02-20T03:37:58.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561193784840 0x561193786ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 4 client.21711 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:37:58.550 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.537+0000 7fe2f317de00 1 -- 10.20.193.28:0/666732897 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611936b65b0 con 0x561193784840 2026-02-20T03:37:58.552 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:58 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:58.566 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.564+0000 7fe2ea575640 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561193784840 0x561193786ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:58.632 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.631+0000 7fe2ea575640 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561193784840 0x561193786ce0 crc :-1 s=READY pgs=581 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962f1042feef61f6 server_cookie=38743d234ce393f8 in_seq=0 out_seq=0 2026-02-20T03:37:58.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.631+0000 7fe29bfff640 10 client.21711 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:58.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe29bfff640 1 -- 10.20.193.28:0/666732897 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5611936b65b0 con 0x561193784840 2026-02-20T03:37:58.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe29bfff640 10 client.21711 handle_command_reply: tid=0 2026-02-20T03:37:58.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 client.21711 shutdown 2026-02-20T03:37:58.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 -- 10.20.193.28:0/666732897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561193761000 msgr2=0x5611937746c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:58.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561193761000 0x5611937746c0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc036000 tx=0x7fe2dc0099e0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.660 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 -- 10.20.193.28:0/666732897 shutdown_connections 2026-02-20T03:37:58.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x561193784840 0x561193786ce0 crc :-1 s=READY pgs=581 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x561193761000 0x5611937746c0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56119375bfb0 0x5611937764c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 --2- 10.20.193.28:0/666732897 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375b630 0x561193775f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe29bfff640 0 client.21711 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:58.661 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 -- 10.20.193.28:0/666732897 >> 10.20.193.28:0/666732897 conn(0x56119371e290 msgr2=0x56119375a440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:58.671 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 -- 10.20.193.28:0/666732897 shutdown_connections 2026-02-20T03:37:58.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 1 -- 10.20.193.28:0/666732897 wait complete. 2026-02-20T03:37:58.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.657+0000 7fe2f317de00 20 client.21711 trim_cache size 0 max 16384 2026-02-20T03:37:58.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2f317de00 1 Processor -- start 2026-02-20T03:37:58.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2f317de00 1 -- start start 2026-02-20T03:37:58.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375b630 0x56119375fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x561193781020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561193761000 0x561193781560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2f317de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe290012720 con 0x56119375bfb0 2026-02-20T03:37:58.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2f317de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe29000ffc0 con 0x561193761000 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2f317de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe29000de10 con 0x56119375b630 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x561193781020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x561193781020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47928/0 (socket says 10.20.193.28:47928) 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2e9d74640 1 -- 10.20.193.28:0/1980153814 learned_addr learned my addr 10.20.193.28:0/1980153814 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2e9d74640 1 -- 10.20.193.28:0/1980153814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375b630 msgr2=0x56119375fe20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2e9d74640 1 --2- 10.20.193.28:0/1980153814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375b630 0x56119375fe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2e9d74640 1 -- 10.20.193.28:0/1980153814 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561193761000 msgr2=0x561193781560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2e9d74640 1 --2- 10.20.193.28:0/1980153814 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561193761000 0x561193781560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2e9d74640 1 -- 10.20.193.28:0/1980153814 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56119376d950 con 0x56119375bfb0 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2e9d74640 1 --2- 10.20.193.28:0/1980153814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x561193781020 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40ddec0 tx=0x7fe2d40a76e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da12ca63a7031d16 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:58.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2b64e6640 1 -- 10.20.193.28:0/1980153814 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40a88c0 con 0x56119375bfb0 2026-02-20T03:37:58.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2b64e6640 1 -- 10.20.193.28:0/1980153814 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe2d40ac570 con 0x56119375bfb0 2026-02-20T03:37:58.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.663+0000 7fe2b64e6640 1 -- 10.20.193.28:0/1980153814 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40ac170 con 0x56119375bfb0 2026-02-20T03:37:58.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- 10.20.193.28:0/1980153814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 msgr2=0x561193781020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:58.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 --2- 10.20.193.28:0/1980153814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x561193781020 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40ddec0 tx=0x7fe2d40a76e0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- 10.20.193.28:0/1980153814 shutdown_connections 2026-02-20T03:37:58.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 --2- 10.20.193.28:0/1980153814 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x561193761000 0x561193781560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 --2- 10.20.193.28:0/1980153814 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x561193781020 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 --2- 10.20.193.28:0/1980153814 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56119375b630 0x56119375fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- 10.20.193.28:0/1980153814 >> 10.20.193.28:0/1980153814 conn(0x56119371e290 msgr2=0x5611937735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:58.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- 10.20.193.28:0/1980153814 shutdown_connections 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- 10.20.193.28:0/1980153814 wait complete. 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- start start 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 Processor -- start 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56119375b630 0x5611937e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x5611937e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561193761000 0x56119377d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe29000e480 con 0x56119375bfb0 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe29000f8f0 con 0x56119375b630 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe29000eb50 con 0x561193761000 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x5611937e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2e9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x5611937e8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47940/0 (socket says 10.20.193.28:47940) 2026-02-20T03:37:58.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2e9d74640 1 -- 10.20.193.28:0/2816500737 learned_addr learned my addr 10.20.193.28:0/2816500737 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2e9d74640 1 -- 10.20.193.28:0/2816500737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561193761000 msgr2=0x56119377d360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2e9d74640 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561193761000 0x56119377d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2e9d74640 1 -- 10.20.193.28:0/2816500737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56119375b630 msgr2=0x5611937e8a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2e9d74640 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56119375b630 0x5611937e8a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2e9d74640 1 -- 10.20.193.28:0/2816500737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56119338d870 con 0x56119375bfb0 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2e9d74640 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x5611937e8f90 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40ddb20 tx=0x7fe2d40b1510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94155ed1bdb68a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe29bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe29bfff640 1 -- 10.20.193.28:0/2816500737 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40e0180 con 0x56119375bfb0 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe29bfff640 1 -- 10.20.193.28:0/2816500737 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe2d40a4200 con 0x56119375bfb0 2026-02-20T03:37:58.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe29bfff640 1 -- 10.20.193.28:0/2816500737 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40a6c40 con 0x56119375bfb0 2026-02-20T03:37:58.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.668+0000 7fe2f317de00 1 -- 10.20.193.28:0/2816500737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56119364e440 con 0x56119375bfb0 2026-02-20T03:37:58.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe29bfff640 1 -- 10.20.193.28:0/2816500737 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe2d40a6de0 con 0x56119375bfb0 2026-02-20T03:37:58.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe29bfff640 10 client.21717 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:37:58.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 10 client.21717 _ll_register_callbacks cb 0x7fe2dc009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:37:58.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 1 -- 10.20.193.28:0/2816500737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561193660b00 con 0x56119375bfb0 2026-02-20T03:37:58.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe29bfff640 1 -- 10.20.193.28:0/2816500737 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe2d40a6fe0 con 0x56119375bfb0 2026-02-20T03:37:58.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 10 client.21717 fetch_fsmap learned FSMap version 55 2026-02-20T03:37:58.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 1 -- 10.20.193.28:0/2816500737 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x56119376e640 con 0x56119375bfb0 2026-02-20T03:37:58.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe29bfff640 1 -- 10.20.193.28:0/2816500737 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fe2d40ca040 con 0x56119375bfb0 2026-02-20T03:37:58.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 10 client.21717 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:37:58.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 10 client.21717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:37:58.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 20 client.21717 populate_metadata read hostname 'trial028' 2026-02-20T03:37:58.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5611937f04d0 0x5611937f2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:58.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 4 client.21717 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:37:58.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.671+0000 7fe2f317de00 1 -- 10.20.193.28:0/2816500737 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fe2e0004480 con 0x5611937f04d0 2026-02-20T03:37:58.700 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.698+0000 7fe2ea575640 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5611937f04d0 0x5611937f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:58.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.29 MB/sec execute 449 sec latency 29327.617 ms 2026-02-20T03:37:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.738+0000 7fe2ea575640 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5611937f04d0 0x5611937f2990 crc :-1 s=READY pgs=582 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0b47809ed9a9356 server_cookie=c35c0a3111d55e0b in_seq=0 out_seq=0 2026-02-20T03:37:58.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.738+0000 7fe29bfff640 10 client.21717 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:58.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe29bfff640 1 -- 10.20.193.28:0/2816500737 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fe2e0004480 con 0x5611937f04d0 2026-02-20T03:37:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe29bfff640 10 client.21717 handle_command_reply: tid=0 2026-02-20T03:37:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 client.21717 shutdown 2026-02-20T03:37:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 -- 10.20.193.28:0/2816500737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 msgr2=0x5611937e8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:58.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x5611937e8f90 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40ddb20 tx=0x7fe2d40b1510 comp rx=0 tx=0).stop 2026-02-20T03:37:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 -- 10.20.193.28:0/2816500737 shutdown_connections 2026-02-20T03:37:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5611937f04d0 0x5611937f2990 crc :-1 s=READY pgs=582 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x561193761000 0x56119377d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.755 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56119375bfb0 0x5611937e8f90 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 --2- 10.20.193.28:0/2816500737 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56119375b630 0x5611937e8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 -- 10.20.193.28:0/2816500737 >> 10.20.193.28:0/2816500737 conn(0x56119371e290 msgr2=0x561193784c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe29bfff640 0 client.21717 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:37:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 -- 10.20.193.28:0/2816500737 shutdown_connections 2026-02-20T03:37:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 1 -- 10.20.193.28:0/2816500737 wait complete. 2026-02-20T03:37:58.756 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.751+0000 7fe2f317de00 20 client.21717 trim_cache size 0 max 16384 2026-02-20T03:37:58.756 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:37:58.757 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:37:58.757 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:37:58.757 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:37:58.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 -- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2c40b0e20 msgr2=0x7fe2c40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:58.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2c40b0e20 0x7fe2c40b32e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00b0a0 tx=0x7fe2dc005b50 comp rx=0 tx=0).stop 2026-02-20T03:37:58.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 -- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 msgr2=0x7fe2ec10e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:58.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 0x7fe2ec10e720 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400b570 tx=0x7fe2d400ba40 comp rx=0 tx=0).stop 2026-02-20T03:37:58.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 -- 10.20.193.28:0/1308833956 shutdown_connections 2026-02-20T03:37:58.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe2c40b0e20 0x7fe2c40b32e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe2ec10a980 0x7fe2ec10ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe2ec105320 0x7fe2ec10e720 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 --2- 10.20.193.28:0/1308833956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe2ec104980 0x7fe2ec111670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:58.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 -- 10.20.193.28:0/1308833956 >> 10.20.193.28:0/1308833956 conn(0x7fe2ec100680 msgr2=0x7fe2ec100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:58.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 -- 10.20.193.28:0/1308833956 shutdown_connections 2026-02-20T03:37:58.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:58.753+0000 7fe2eb577640 1 -- 10.20.193.28:0/1308833956 wait complete. 2026-02-20T03:37:58.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:58 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:58.949 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:37:58.949 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:37:58.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:58 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:37:59.248 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:37:59.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- 10.20.193.28:0/2271278257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 msgr2=0x7fba48101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:59.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 --2- 10.20.193.28:0/2271278257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 0x7fba48101470 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fba38009a30 tx=0x7fba3802f260 comp rx=0 tx=0).stop 2026-02-20T03:37:59.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- 10.20.193.28:0/2271278257 shutdown_connections 2026-02-20T03:37:59.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 --2- 10.20.193.28:0/2271278257 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba481019b0 0x7fba4810dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 --2- 10.20.193.28:0/2271278257 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 0x7fba48101470 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 --2- 10.20.193.28:0/2271278257 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba48106e10 0x7fba481071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- 10.20.193.28:0/2271278257 >> 10.20.193.28:0/2271278257 conn(0x7fba480fc5f0 msgr2=0x7fba480fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:59.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- 10.20.193.28:0/2271278257 shutdown_connections 2026-02-20T03:37:59.518 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- 10.20.193.28:0/2271278257 wait complete. 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 Processor -- start 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- start start 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 0x7fba4810f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba481019b0 0x7fba4810f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba48106e10 0x7fba4810ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fba48112a40 con 0x7fba48101030 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fba481128c0 con 0x7fba48106e10 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fba48112bc0 con 0x7fba481019b0 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 0x7fba4810f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba47fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 0x7fba4810f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47968/0 (socket says 10.20.193.28:47968) 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba47fff640 1 -- 10.20.193.28:0/1377453030 learned_addr learned my addr 10.20.193.28:0/1377453030 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba47fff640 1 -- 10.20.193.28:0/1377453030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba481019b0 msgr2=0x7fba4810f9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba47fff640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba481019b0 0x7fba4810f9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba47fff640 1 -- 10.20.193.28:0/1377453030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba48106e10 msgr2=0x7fba4810ff20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba47fff640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba48106e10 0x7fba4810ff20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.519 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba47fff640 1 -- 10.20.193.28:0/1377453030 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba481a9450 con 0x7fba48101030 2026-02-20T03:37:59.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba47fff640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 0x7fba4810f4a0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fba3400b570 tx=0x7fba3400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:59.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba457fa640 1 -- 10.20.193.28:0/1377453030 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba34013020 con 0x7fba48101030 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba457fa640 1 -- 10.20.193.28:0/1377453030 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fba34004480 con 0x7fba48101030 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba457fa640 1 -- 10.20.193.28:0/1377453030 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3400fb50 con 0x7fba48101030 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.516+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba481a9740 con 0x7fba48101030 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.518+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba481a9c30 con 0x7fba48101030 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.518+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba48101470 con 0x7fba48101030 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.518+0000 7fba457fa640 1 -- 10.20.193.28:0/1377453030 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fba34002780 con 0x7fba48101030 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.518+0000 7fba457fa640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba1c0b0e20 0x7fba1c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.518+0000 7fba457fa640 1 -- 10.20.193.28:0/1377453030 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fba340e0c30 con 0x7fba48101030 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.518+0000 7fba477fe640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba1c0b0e20 0x7fba1c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.518+0000 7fba457fa640 1 -- 10.20.193.28:0/1377453030 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fba3401d020 con 0x7fba48101030 2026-02-20T03:37:59.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.518+0000 7fba477fe640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba1c0b0e20 0x7fba1c0b32e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fba38009950 tx=0x7fba380023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:37:59.620 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:37:59 trial028 ceph-mon[38552]: pgmap v885: 129 pgs: 129 active+clean; 768 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 754 KiB/s rd, 11 MiB/s wr, 570 op/s 2026-02-20T03:37:59.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.632+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba481109d0 con 0x7fba48101030 2026-02-20T03:37:59.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.632+0000 7fba457fa640 1 -- 10.20.193.28:0/1377453030 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11919 (secure 0 0 0) 0x7fba481109d0 con 0x7fba48101030 2026-02-20T03:37:59.639 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:37:59.640 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":55,"btime":"2026-02-20T03:37:57:428043+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:37:57.415897+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:37:59.640 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 55 2026-02-20T03:37:59.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba1c0b0e20 msgr2=0x7fba1c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:59.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba1c0b0e20 0x7fba1c0b32e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fba38009950 tx=0x7fba380023d0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 msgr2=0x7fba4810f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 0x7fba4810f4a0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fba3400b570 tx=0x7fba3400ba40 comp rx=0 tx=0).stop 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 shutdown_connections 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fba1c0b0e20 0x7fba1c0b32e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fba48106e10 0x7fba4810ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fba481019b0 0x7fba4810f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 --2- 10.20.193.28:0/1377453030 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fba48101030 0x7fba4810f4a0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 >> 10.20.193.28:0/1377453030 conn(0x7fba480fc5f0 msgr2=0x7fba480fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 shutdown_connections 2026-02-20T03:37:59.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:37:59.638+0000 7fba4d573640 1 -- 10.20.193.28:0/1377453030 wait complete. 2026-02-20T03:37:59.739 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.25 MB/sec execute 450 sec latency 30327.654 ms 2026-02-20T03:37:59.810 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:37:59.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:37:59 trial126 ceph-mon[38476]: pgmap v885: 129 pgs: 129 active+clean; 768 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 754 KiB/s rd, 11 MiB/s wr, 570 op/s 2026-02-20T03:37:59.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:37:59 trial177 ceph-mon[43181]: pgmap v885: 129 pgs: 129 active+clean; 768 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 754 KiB/s rd, 11 MiB/s wr, 570 op/s 2026-02-20T03:38:00.143 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:00.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.360+0000 7fd8bd90c640 1 -- 10.20.193.28:0/1621602231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b810a980 msgr2=0x7fd8b810ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:00.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.360+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/1621602231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b810a980 0x7fd8b810ad60 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009a60 tx=0x7fd8a802f290 comp rx=0 tx=0).stop 2026-02-20T03:38:00.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.360+0000 7fd8bd90c640 1 -- 10.20.193.28:0/1621602231 shutdown_connections 2026-02-20T03:38:00.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.360+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/1621602231 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd8b8105320 0x7fd8b8111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.360+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/1621602231 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd8b8104980 0x7fd8b8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.360+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/1621602231 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b810a980 0x7fd8b810ad60 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.360+0000 7fd8bd90c640 1 -- 10.20.193.28:0/1621602231 >> 10.20.193.28:0/1621602231 conn(0x7fd8b8100680 msgr2=0x7fd8b8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:00.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.360+0000 7fd8bd90c640 1 -- 10.20.193.28:0/1621602231 shutdown_connections 2026-02-20T03:38:00.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8bd90c640 1 -- 10.20.193.28:0/1621602231 wait complete. 2026-02-20T03:38:00.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8bd90c640 1 Processor -- start 2026-02-20T03:38:00.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8bd90c640 1 -- start start 2026-02-20T03:38:00.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8bd90c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd8b8104980 0x7fd8b819d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8bd90c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b8105320 0x7fd8b819d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8bd90c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd8b810a980 0x7fd8b81a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8bd90c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b8114cd0 con 0x7fd8b8105320 2026-02-20T03:38:00.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8bd90c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b8114b50 con 0x7fd8b8104980 2026-02-20T03:38:00.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8bd90c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b8114e50 con 0x7fd8b810a980 2026-02-20T03:38:00.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8affff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b8105320 0x7fd8b819d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:00.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8affff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b8105320 0x7fd8b819d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:47986/0 (socket says 10.20.193.28:47986) 2026-02-20T03:38:00.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8affff640 1 -- 10.20.193.28:0/4113034961 learned_addr learned my addr 10.20.193.28:0/4113034961 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:00.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8affff640 1 -- 10.20.193.28:0/4113034961 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd8b810a980 msgr2=0x7fd8b81a1b80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:00.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8affff640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd8b810a980 0x7fd8b81a1b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8affff640 1 -- 10.20.193.28:0/4113034961 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd8b8104980 msgr2=0x7fd8b819d2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:00.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8affff640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd8b8104980 0x7fd8b819d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.363+0000 7fd8affff640 1 -- 10.20.193.28:0/4113034961 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b81a2300 con 0x7fd8b8105320 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.364+0000 7fd8affff640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b8105320 0x7fd8b819d7f0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000b570 tx=0x7fd8a000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.364+0000 7fd8adffb640 1 -- 10.20.193.28:0/4113034961 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0013020 con 0x7fd8b8105320 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.364+0000 7fd8adffb640 1 -- 10.20.193.28:0/4113034961 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd8a0004480 con 0x7fd8b8105320 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.364+0000 7fd8adffb640 1 -- 10.20.193.28:0/4113034961 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000fb50 con 0x7fd8b8105320 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.364+0000 7fd8bd90c640 1 -- 10.20.193.28:0/4113034961 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b81a25f0 con 0x7fd8b8105320 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.364+0000 7fd8bd90c640 1 -- 10.20.193.28:0/4113034961 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b81a9e30 con 0x7fd8b8105320 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.365+0000 7fd8adffb640 1 -- 10.20.193.28:0/4113034961 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd8a0002780 con 0x7fd8b8105320 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8c109ae00 1 Processor -- start 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8c109ae00 1 -- start start 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b4030 0x56343c8afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b02a0 0x56343c8b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56343c82ae00 con 0x56343c8aa860 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56343c7fd970 con 0x56343c8b4030 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56343c7ab1f0 con 0x56343c8b02a0 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8affff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8affff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48000/0 (socket says 10.20.193.28:48000) 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8affff640 1 -- 10.20.193.28:0/1717309624 learned_addr learned my addr 10.20.193.28:0/1717309624 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8affff640 1 -- 10.20.193.28:0/1717309624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b02a0 msgr2=0x56343c8b06e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8affff640 1 --2- 10.20.193.28:0/1717309624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b02a0 0x56343c8b06e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8affff640 1 -- 10.20.193.28:0/1717309624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b4030 msgr2=0x56343c8afd60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8affff640 1 --2- 10.20.193.28:0/1717309624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b4030 0x56343c8afd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8affff640 1 -- 10.20.193.28:0/1717309624 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56343c7be3d0 con 0x56343c8aa860 2026-02-20T03:38:00.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8affff640 1 --2- 10.20.193.28:0/1717309624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8aace0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00e67a0 tx=0x7fd8a00e6c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c802448779bc8351 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:00.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8854e4640 1 -- 10.20.193.28:0/1717309624 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00f3070 con 0x56343c8aa860 2026-02-20T03:38:00.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8854e4640 1 -- 10.20.193.28:0/1717309624 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd8a00e0de0 con 0x56343c8aa860 2026-02-20T03:38:00.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8854e4640 1 -- 10.20.193.28:0/1717309624 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00e26a0 con 0x56343c8aa860 2026-02-20T03:38:00.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8adffb640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8940b0e20 0x7fd8940b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.368+0000 7fd8adffb640 1 -- 10.20.193.28:0/4113034961 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd8a00e05e0 con 0x7fd8b8105320 2026-02-20T03:38:00.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1717309624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 msgr2=0x56343c8aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:00.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1717309624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8aace0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00e67a0 tx=0x7fd8a00e6c70 comp rx=0 tx=0).stop 2026-02-20T03:38:00.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8bd10b640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8940b0e20 0x7fd8940b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1717309624 shutdown_connections 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1717309624 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8aace0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1717309624 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b02a0 0x56343c8b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1717309624 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b4030 0x56343c8afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1717309624 >> 10.20.193.28:0/1717309624 conn(0x56343c86d240 msgr2=0x56343c8a8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1717309624 shutdown_connections 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1717309624 wait complete. 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8bd10b640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8940b0e20 0x7fd8940b32e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400aab0 tx=0x7fd8b4009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.369+0000 7fd8c109ae00 1 -- start start 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.371+0000 7fd8c109ae00 1 Processor -- start 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.371+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8aa860 0x56343c8d6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.371+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b02a0 0x56343c8d6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.371+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b4030 0x56343c8d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.371+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56343c7f98a0 con 0x56343c8b02a0 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.371+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56343c5ebf50 con 0x56343c8aa860 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.371+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56343c8d5010 con 0x56343c8b4030 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8affff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b02a0 0x56343c8d6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8affff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b02a0 0x56343c8d6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48002/0 (socket says 10.20.193.28:48002) 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8affff640 1 -- 10.20.193.28:0/2089769500 learned_addr learned my addr 10.20.193.28:0/2089769500 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8affff640 1 -- 10.20.193.28:0/2089769500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b4030 msgr2=0x56343c8d4a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8affff640 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b4030 0x56343c8d4a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8affff640 1 -- 10.20.193.28:0/2089769500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8aa860 msgr2=0x56343c8d6340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8affff640 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8aa860 0x56343c8d6340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8affff640 1 -- 10.20.193.28:0/2089769500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56343c8cdf00 con 0x56343c8b02a0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8affff640 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b02a0 0x56343c8d6880 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00a8250 tx=0x7fd8a00e20e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31edd9b52560a7f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8767fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8767fc640 1 -- 10.20.193.28:0/2089769500 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00a3f30 con 0x56343c8b02a0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8767fc640 1 -- 10.20.193.28:0/2089769500 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd8a00a89c0 con 0x56343c8b02a0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8767fc640 1 -- 10.20.193.28:0/2089769500 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a001f300 con 0x56343c8b02a0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8c109ae00 1 -- 10.20.193.28:0/2089769500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56343c5ceb40 con 0x56343c8b02a0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8c109ae00 10 client.21735 _ll_register_callbacks cb 0x56343c836eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8c109ae00 1 -- 10.20.193.28:0/2089769500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56343c80b150 con 0x56343c8b02a0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8767fc640 1 -- 10.20.193.28:0/2089769500 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd8a00dddc0 con 0x56343c8b02a0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8767fc640 1 -- 10.20.193.28:0/2089769500 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fd8a00a77e0 con 0x56343c8b02a0 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8c109ae00 10 client.21735 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:00.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.372+0000 7fd8c109ae00 1 -- 10.20.193.28:0/2089769500 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x56343c7b81e0 con 0x56343c8b02a0 2026-02-20T03:38:00.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.373+0000 7fd8767fc640 1 -- 10.20.193.28:0/2089769500 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fd8a00e0200 con 0x56343c8b02a0 2026-02-20T03:38:00.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.373+0000 7fd8c109ae00 10 client.21735 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:00.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.373+0000 7fd8c109ae00 10 client.21735 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:38:00.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.373+0000 7fd8c109ae00 20 client.21735 populate_metadata read hostname 'trial028' 2026-02-20T03:38:00.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.373+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56343c8e4a30 0x56343c8e6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.373+0000 7fd8c109ae00 4 client.21735 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:00.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.373+0000 7fd8c109ae00 1 -- 10.20.193.28:0/2089769500 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56343c805560 con 0x56343c8e4a30 2026-02-20T03:38:00.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.399+0000 7fd8bc90a640 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56343c8e4a30 0x56343c8e6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.466+0000 7fd8bc90a640 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56343c8e4a30 0x56343c8e6ef0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8025d64f679caed3 server_cookie=2209bdb1d2e35005 in_seq=0 out_seq=0 2026-02-20T03:38:00.468 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.466+0000 7fd8767fc640 10 client.21735 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:38:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8767fc640 1 -- 10.20.193.28:0/2089769500 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56343c805560 con 0x56343c8e4a30 2026-02-20T03:38:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8767fc640 10 client.21735 handle_command_reply: tid=0 2026-02-20T03:38:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 client.21735 shutdown 2026-02-20T03:38:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 -- 10.20.193.28:0/2089769500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b02a0 msgr2=0x56343c8d6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b02a0 0x56343c8d6880 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00a8250 tx=0x7fd8a00e20e0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 -- 10.20.193.28:0/2089769500 shutdown_connections 2026-02-20T03:38:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b4030 0x56343c8d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56343c8e4a30 0x56343c8e6ef0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b02a0 0x56343c8d6880 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/2089769500 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8aa860 0x56343c8d6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 -- 10.20.193.28:0/2089769500 >> 10.20.193.28:0/2089769500 conn(0x56343c86d240 msgr2=0x56343c8ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8767fc640 0 client.21735 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:38:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 -- 10.20.193.28:0/2089769500 shutdown_connections 2026-02-20T03:38:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 1 -- 10.20.193.28:0/2089769500 wait complete. 2026-02-20T03:38:00.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.492+0000 7fd8c109ae00 20 client.21735 trim_cache size 0 max 16384 2026-02-20T03:38:00.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 Processor -- start 2026-02-20T03:38:00.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- start start 2026-02-20T03:38:00.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8aa860 0x56343c8ec800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b02a0 0x56343c8ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b4030 0x56343c8d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c012790 con 0x56343c8b4030 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c010030 con 0x56343c8b02a0 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c00de80 con 0x56343c8aa860 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8bd10b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b4030 0x56343c8d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8bd10b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b4030 0x56343c8d3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48014/0 (socket says 10.20.193.28:48014) 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8bd10b640 1 -- 10.20.193.28:0/3972077766 learned_addr learned my addr 10.20.193.28:0/3972077766 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8bd10b640 1 -- 10.20.193.28:0/3972077766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8aa860 msgr2=0x56343c8ec800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8bd10b640 1 --2- 10.20.193.28:0/3972077766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8aa860 0x56343c8ec800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8bd10b640 1 -- 10.20.193.28:0/3972077766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b02a0 msgr2=0x56343c8ecd40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8bd10b640 1 --2- 10.20.193.28:0/3972077766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b02a0 0x56343c8ecd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8bd10b640 1 -- 10.20.193.28:0/3972077766 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56343c8cdd30 con 0x56343c8b4030 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8bd10b640 1 --2- 10.20.193.28:0/3972077766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b4030 0x56343c8d3300 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400cc10 tx=0x7fd8b400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326d99542925054e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd884ce3640 1 -- 10.20.193.28:0/3972077766 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4006e60 con 0x56343c8b4030 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd884ce3640 1 -- 10.20.193.28:0/3972077766 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd8b401f020 con 0x56343c8b4030 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd884ce3640 1 -- 10.20.193.28:0/3972077766 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400d680 con 0x56343c8b4030 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- 10.20.193.28:0/3972077766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b4030 msgr2=0x56343c8d3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/3972077766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b4030 0x56343c8d3300 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400cc10 tx=0x7fd8b400f000 comp rx=0 tx=0).stop 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- 10.20.193.28:0/3972077766 shutdown_connections 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/3972077766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8b4030 0x56343c8d3300 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/3972077766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b02a0 0x56343c8ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/3972077766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8aa860 0x56343c8ec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- 10.20.193.28:0/3972077766 >> 10.20.193.28:0/3972077766 conn(0x56343c86d240 msgr2=0x56343c8d6340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:00.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- 10.20.193.28:0/3972077766 shutdown_connections 2026-02-20T03:38:00.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- 10.20.193.28:0/3972077766 wait complete. 2026-02-20T03:38:00.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 -- start start 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.497+0000 7fd8c109ae00 1 Processor -- start 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8e1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b02a0 0x56343c8dd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b4030 0x56343c8dd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c00e4f0 con 0x56343c8aa860 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c00f960 con 0x56343c8b02a0 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c00ebc0 con 0x56343c8b4030 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8bc90a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8e1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8bc90a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8e1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48016/0 (socket says 10.20.193.28:48016) 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8bc90a640 1 -- 10.20.193.28:0/1922731955 learned_addr learned my addr 10.20.193.28:0/1922731955 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8bc90a640 1 -- 10.20.193.28:0/1922731955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b4030 msgr2=0x56343c8dd9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:00.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8bc90a640 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b4030 0x56343c8dd9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8bc90a640 1 -- 10.20.193.28:0/1922731955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b02a0 msgr2=0x56343c8dd470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8bc90a640 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b02a0 0x56343c8dd470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8bc90a640 1 -- 10.20.193.28:0/1922731955 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56343c4dc870 con 0x56343c8aa860 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8bc90a640 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8e1150 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009a60 tx=0x7fd8a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0fd5210aa589bd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8767fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8767fc640 1 -- 10.20.193.28:0/1922731955 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8002e10 con 0x56343c8aa860 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8767fc640 1 -- 10.20.193.28:0/1922731955 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd8a8045020 con 0x56343c8aa860 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8767fc640 1 -- 10.20.193.28:0/1922731955 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8038730 con 0x56343c8aa860 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1922731955 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56343c79d3f0 con 0x56343c8aa860 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 10 client.21741 _ll_register_callbacks cb 0x7fd8a00f1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1922731955 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56343c7afab0 con 0x56343c8aa860 2026-02-20T03:38:00.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8767fc640 1 -- 10.20.193.28:0/1922731955 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd8a80026e0 con 0x56343c8aa860 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8767fc640 1 -- 10.20.193.28:0/1922731955 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fd8a80028e0 con 0x56343c8aa860 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 10 client.21741 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1922731955 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x56343c8cea20 con 0x56343c8aa860 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8767fc640 1 -- 10.20.193.28:0/1922731955 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fd8a802fab0 con 0x56343c8aa860 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 10 client.21741 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 10 client.21741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 20 client.21741 populate_metadata read hostname 'trial028' 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56343c950b70 0x56343c953030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 4 client.21741 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:38:00.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.502+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1922731955 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fd8b401f020 con 0x56343c950b70 2026-02-20T03:38:00.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.519+0000 7fd8affff640 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56343c950b70 0x56343c953030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:00.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.586+0000 7fd8affff640 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56343c950b70 0x56343c953030 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af534c78ce38c702 server_cookie=cad9d36c9a2b036d in_seq=0 out_seq=0 2026-02-20T03:38:00.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.586+0000 7fd8767fc640 10 client.21741 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:38:00.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8767fc640 1 -- 10.20.193.28:0/1922731955 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fd8b401f020 con 0x56343c950b70 2026-02-20T03:38:00.601 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8767fc640 10 client.21741 handle_command_reply: tid=0 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 client.21741 shutdown 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1922731955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 msgr2=0x56343c8e1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8e1150 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8009a60 tx=0x7fd8a8009780 comp rx=0 tx=0).stop 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1922731955 shutdown_connections 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56343c8b4030 0x56343c8dd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56343c8b02a0 0x56343c8dd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x56343c950b70 0x56343c953030 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 --2- 10.20.193.28:0/1922731955 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56343c8aa860 0x56343c8e1150 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1922731955 >> 10.20.193.28:0/1922731955 conn(0x56343c86d240 msgr2=0x56343c8d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:00.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8767fc640 0 client.21741 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:38:00.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1922731955 shutdown_connections 2026-02-20T03:38:00.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 1 -- 10.20.193.28:0/1922731955 wait complete. 2026-02-20T03:38:00.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.599+0000 7fd8c109ae00 20 client.21741 trim_cache size 0 max 16384 2026-02-20T03:38:00.615 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:38:00.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 -- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8940b0e20 msgr2=0x7fd8940b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8940b0e20 0x7fd8940b32e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400aab0 tx=0x7fd8b4009250 comp rx=0 tx=0).stop 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 -- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b8105320 msgr2=0x7fd8b819d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b8105320 0x7fd8b819d7f0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000b570 tx=0x7fd8a000ba40 comp rx=0 tx=0).stop 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 -- 10.20.193.28:0/4113034961 shutdown_connections 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd8940b0e20 0x7fd8940b32e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd8b810a980 0x7fd8b81a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd8b8105320 0x7fd8b819d7f0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 --2- 10.20.193.28:0/4113034961 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd8b8104980 0x7fd8b819d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 -- 10.20.193.28:0/4113034961 >> 10.20.193.28:0/4113034961 conn(0x7fd8b8100680 msgr2=0x7fd8b8101160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 -- 10.20.193.28:0/4113034961 shutdown_connections 2026-02-20T03:38:00.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:00.600+0000 7fd8bd90c640 1 -- 10.20.193.28:0/4113034961 wait complete. 2026-02-20T03:38:00.727 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:00 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1377453030' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:38:00.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.20 MB/sec execute 451 sec latency 31327.692 ms 2026-02-20T03:38:00.758 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:38:00.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:00 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1377453030' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:38:00.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:00 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1377453030' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:38:01.055 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- 10.20.193.28:0/3150676466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 msgr2=0x7fb528118000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:01.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/3150676466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 0x7fb528118000 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fb52400b0a0 tx=0x7fb52402f450 comp rx=0 tx=0).stop 2026-02-20T03:38:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- 10.20.193.28:0/3150676466 shutdown_connections 2026-02-20T03:38:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/3150676466 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 0x7fb528118000 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/3150676466 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb52810c090 0x7fb52810fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/3150676466 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb52810b6e0 0x7fb52810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- 10.20.193.28:0/3150676466 >> 10.20.193.28:0/3150676466 conn(0x7fb528071f80 msgr2=0x7fb5280743a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- 10.20.193.28:0/3150676466 shutdown_connections 2026-02-20T03:38:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- 10.20.193.28:0/3150676466 wait complete. 2026-02-20T03:38:01.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 Processor -- start 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- start start 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb52810b6e0 0x7fb5281ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb52810c090 0x7fb5281abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 0x7fb5281a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb52811b430 con 0x7fb5281104c0 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb52811b2b0 con 0x7fb52810c090 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb52811b5b0 con 0x7fb52810b6e0 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52eca7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 0x7fb5281a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52eca7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 0x7fb5281a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48026/0 (socket says 10.20.193.28:48026) 2026-02-20T03:38:01.302 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52eca7640 1 -- 10.20.193.28:0/88016009 learned_addr learned my addr 10.20.193.28:0/88016009 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52eca7640 1 -- 10.20.193.28:0/88016009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb52810b6e0 msgr2=0x7fb5281ab7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52eca7640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb52810b6e0 0x7fb5281ab7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52eca7640 1 -- 10.20.193.28:0/88016009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb52810c090 msgr2=0x7fb5281abd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52eca7640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb52810c090 0x7fb5281abd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52eca7640 1 -- 10.20.193.28:0/88016009 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5281a6150 con 0x7fb5281104c0 2026-02-20T03:38:01.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52eca7640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 0x7fb5281a5980 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fb52400b1d0 tx=0x7fb524009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb50f7fe640 1 -- 10.20.193.28:0/88016009 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524004590 con 0x7fb5281104c0 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb50f7fe640 1 -- 10.20.193.28:0/88016009 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb524004730 con 0x7fb5281104c0 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb50f7fe640 1 -- 10.20.193.28:0/88016009 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524007e60 con 0x7fb5281104c0 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- 10.20.193.28:0/88016009 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5281a63e0 con 0x7fb5281104c0 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.294+0000 7fb52f4a8640 1 -- 10.20.193.28:0/88016009 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5281b2690 con 0x7fb5281104c0 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.300+0000 7fb50f7fe640 1 -- 10.20.193.28:0/88016009 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb524002a60 con 0x7fb5281104c0 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.300+0000 7fb532c36e00 1 Processor -- start 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- start start 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abaf090 0x55807abaf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abafa40 0x55807abb3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abb3c80 0x55807abbb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.308 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55807ab26e00 con 0x55807abaf090 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55807aaf9970 con 0x55807abb3c80 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55807aaa71f0 con 0x55807abafa40 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abaf090 0x55807abaf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abaf090 0x55807abaf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48030/0 (socket says 10.20.193.28:48030) 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 -- 10.20.193.28:0/2604475871 learned_addr learned my addr 10.20.193.28:0/2604475871 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 -- 10.20.193.28:0/2604475871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abafa40 msgr2=0x55807abb3570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 --2- 10.20.193.28:0/2604475871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abafa40 0x55807abb3570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 -- 10.20.193.28:0/2604475871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abb3c80 msgr2=0x55807abbb820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 --2- 10.20.193.28:0/2604475871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abb3c80 0x55807abbb820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 -- 10.20.193.28:0/2604475871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807aaba3d0 con 0x55807abaf090 2026-02-20T03:38:01.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 --2- 10.20.193.28:0/2604475871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abaf090 0x55807abaf470 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009840 tx=0x7fb51c009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe52a9b5d0c1079e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:01.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb50ccf3640 1 -- 10.20.193.28:0/2604475871 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c016070 con 0x55807abaf090 2026-02-20T03:38:01.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb50ccf3640 1 -- 10.20.193.28:0/2604475871 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb51c004500 con 0x55807abaf090 2026-02-20T03:38:01.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb50ccf3640 1 -- 10.20.193.28:0/2604475871 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00bd20 con 0x55807abaf090 2026-02-20T03:38:01.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- 10.20.193.28:0/2604475871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abaf090 msgr2=0x55807abaf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:01.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2604475871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abaf090 0x55807abaf470 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009840 tx=0x7fb51c009d10 comp rx=0 tx=0).stop 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- 10.20.193.28:0/2604475871 shutdown_connections 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2604475871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abb3c80 0x55807abbb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2604475871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abafa40 0x55807abb3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2604475871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abaf090 0x55807abaf470 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- 10.20.193.28:0/2604475871 >> 10.20.193.28:0/2604475871 conn(0x55807ab69240 msgr2=0x55807abad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb50f7fe640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb5040b0da0 0x7fb5040b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- 10.20.193.28:0/2604475871 shutdown_connections 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb50f7fe640 1 -- 10.20.193.28:0/88016009 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fb5241058c0 con 0x7fb5281104c0 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- 10.20.193.28:0/2604475871 wait complete. 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb5040b0da0 0x7fb5040b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:01.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb52dca5640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb5040b0da0 0x7fb5040b3260 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00b800 tx=0x7fb51c00b900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 -- start start 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.303+0000 7fb532c36e00 1 Processor -- start 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 0x55807abd1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abd2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abb3c80 0x55807abd0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55807aaf58a0 con 0x55807abafa40 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55807a8e7f50 con 0x55807abaf090 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55807abd0e80 con 0x55807abb3c80 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb52dca5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abd2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb52dca5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abd2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48044/0 (socket says 10.20.193.28:48044) 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb52dca5640 1 -- 10.20.193.28:0/2410578020 learned_addr learned my addr 10.20.193.28:0/2410578020 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:01.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb52dca5640 1 -- 10.20.193.28:0/2410578020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abb3c80 msgr2=0x55807abd0700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb52dca5640 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abb3c80 0x55807abd0700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb52dca5640 1 -- 10.20.193.28:0/2410578020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 msgr2=0x55807abd1fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb52dca5640 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 0x55807abd1fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb52dca5640 1 -- 10.20.193.28:0/2410578020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807ababb30 con 0x55807abafa40 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb52dca5640 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abd2500 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fb51c013000 tx=0x7fb51c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4932f92d3e3f5fb0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb4dbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb4dbfff640 1 -- 10.20.193.28:0/2410578020 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c01b470 con 0x55807abafa40 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb4dbfff640 1 -- 10.20.193.28:0/2410578020 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb51c017040 con 0x55807abafa40 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb4dbfff640 1 -- 10.20.193.28:0/2410578020 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c01c8f0 con 0x55807abafa40 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 -- 10.20.193.28:0/2410578020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807a8cab40 con 0x55807abafa40 2026-02-20T03:38:01.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb4dbfff640 1 -- 10.20.193.28:0/2410578020 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fb51c01b610 con 0x55807abafa40 2026-02-20T03:38:01.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 10 client.21753 _ll_register_callbacks cb 0x55807ab32eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:01.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 -- 10.20.193.28:0/2410578020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55807ab07150 con 0x55807abafa40 2026-02-20T03:38:01.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb4dbfff640 1 -- 10.20.193.28:0/2410578020 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fb51c02d060 con 0x55807abafa40 2026-02-20T03:38:01.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 10 client.21753 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:01.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 -- 10.20.193.28:0/2410578020 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55807aab41e0 con 0x55807abafa40 2026-02-20T03:38:01.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb4dbfff640 1 -- 10.20.193.28:0/2410578020 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fb51c01ca90 con 0x55807abafa40 2026-02-20T03:38:01.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 10 client.21753 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:01.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 10 client.21753 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:38:01.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 20 client.21753 populate_metadata read hostname 'trial028' 2026-02-20T03:38:01.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55807abe0760 0x55807abe2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 4 client.21753 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:01.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.306+0000 7fb532c36e00 1 -- 10.20.193.28:0/2410578020 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55807ab01560 con 0x55807abe0760 2026-02-20T03:38:01.323 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.319+0000 7fb52e4a6640 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55807abe0760 0x55807abe2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:01.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.361+0000 7fb52e4a6640 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55807abe0760 0x55807abe2b50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c06f09b0f2117465 server_cookie=f6eed757993fd538 in_seq=0 out_seq=0 2026-02-20T03:38:01.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.361+0000 7fb4dbfff640 10 client.21753 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:38:01.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb4dbfff640 1 -- 10.20.193.28:0/2410578020 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55807ab01560 con 0x55807abe0760 2026-02-20T03:38:01.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb4dbfff640 10 client.21753 handle_command_reply: tid=0 2026-02-20T03:38:01.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 client.21753 shutdown 2026-02-20T03:38:01.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 -- 10.20.193.28:0/2410578020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 msgr2=0x55807abd2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:01.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abd2500 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7fb51c013000 tx=0x7fb51c009240 comp rx=0 tx=0).stop 2026-02-20T03:38:01.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 -- 10.20.193.28:0/2410578020 shutdown_connections 2026-02-20T03:38:01.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55807abe0760 0x55807abe2b50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abb3c80 0x55807abd0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abd2500 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 --2- 10.20.193.28:0/2410578020 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 0x55807abd1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.391 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb4dbfff640 0 client.21753 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:38:01.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 -- 10.20.193.28:0/2410578020 >> 10.20.193.28:0/2410578020 conn(0x55807ab69240 msgr2=0x55807abb4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:01.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 -- 10.20.193.28:0/2410578020 shutdown_connections 2026-02-20T03:38:01.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 1 -- 10.20.193.28:0/2410578020 wait complete. 2026-02-20T03:38:01.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.387+0000 7fb532c36e00 20 client.21753 trim_cache size 0 max 16384 2026-02-20T03:38:01.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.390+0000 7fb532c36e00 1 Processor -- start 2026-02-20T03:38:01.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb532c36e00 1 -- start start 2026-02-20T03:38:01.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 0x55807ab9ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abb3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abb3c80 0x55807abe8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb532c36e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d00126d0 con 0x55807abafa40 2026-02-20T03:38:01.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb532c36e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d000ff70 con 0x55807abaf090 2026-02-20T03:38:01.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb532c36e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d000ddc0 con 0x55807abb3c80 2026-02-20T03:38:01.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb52dca5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abb3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb52dca5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abb3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48054/0 (socket says 10.20.193.28:48054) 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb52dca5640 1 -- 10.20.193.28:0/454298641 learned_addr learned my addr 10.20.193.28:0/454298641 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb52dca5640 1 -- 10.20.193.28:0/454298641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abb3c80 msgr2=0x55807abe8380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb52dca5640 1 --2- 10.20.193.28:0/454298641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abb3c80 0x55807abe8380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb52dca5640 1 -- 10.20.193.28:0/454298641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 msgr2=0x55807ab9ed00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb52dca5640 1 --2- 10.20.193.28:0/454298641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 0x55807ab9ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb52dca5640 1 -- 10.20.193.28:0/454298641 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807abab960 con 0x55807abafa40 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb52dca5640 1 --2- 10.20.193.28:0/454298641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abb3200 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fb51c006fd0 tx=0x7fb51c02b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e121df5d691db32 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb4f64e6640 1 -- 10.20.193.28:0/454298641 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00bd70 con 0x55807abafa40 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb4f64e6640 1 -- 10.20.193.28:0/454298641 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb51c017070 con 0x55807abafa40 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb4f64e6640 1 -- 10.20.193.28:0/454298641 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51c01b940 con 0x55807abafa40 2026-02-20T03:38:01.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb532c36e00 1 -- 10.20.193.28:0/454298641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 msgr2=0x55807abb3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:01.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.395+0000 7fb532c36e00 1 --2- 10.20.193.28:0/454298641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abb3200 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7fb51c006fd0 tx=0x7fb51c02b000 comp rx=0 tx=0).stop 2026-02-20T03:38:01.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- 10.20.193.28:0/454298641 shutdown_connections 2026-02-20T03:38:01.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 --2- 10.20.193.28:0/454298641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abb3c80 0x55807abe8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.402 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 --2- 10.20.193.28:0/454298641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abafa40 0x55807abb3200 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 --2- 10.20.193.28:0/454298641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 0x55807ab9ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- 10.20.193.28:0/454298641 >> 10.20.193.28:0/454298641 conn(0x55807ab69240 msgr2=0x55807abb6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- 10.20.193.28:0/454298641 shutdown_connections 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- 10.20.193.28:0/454298641 wait complete. 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- start start 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 Processor -- start 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 0x55807abd51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abafa40 0x55807abd5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abb3c80 0x55807ac4b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d000e430 con 0x55807abb3c80 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d000f8a0 con 0x55807abaf090 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d000eb00 con 0x55807abafa40 2026-02-20T03:38:01.405 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb52eca7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abb3c80 0x55807ac4b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb52eca7640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abb3c80 0x55807ac4b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48058/0 (socket says 10.20.193.28:48058) 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb52eca7640 1 -- 10.20.193.28:0/4294320371 learned_addr learned my addr 10.20.193.28:0/4294320371 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb52eca7640 1 -- 10.20.193.28:0/4294320371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abafa40 msgr2=0x55807abd5720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb52eca7640 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abafa40 0x55807abd5720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb52eca7640 1 -- 10.20.193.28:0/4294320371 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 msgr2=0x55807abd51e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb52eca7640 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 0x55807abd51e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb52eca7640 1 -- 10.20.193.28:0/4294320371 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807a7d8870 con 0x55807abb3c80 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb52eca7640 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abb3c80 0x55807ac4b560 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fb52402f960 tx=0x7fb5240ccb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993aff397baa9bd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb4dbfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb4dbfff640 1 -- 10.20.193.28:0/4294320371 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5240048e0 con 0x55807abb3c80 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb4dbfff640 1 -- 10.20.193.28:0/4294320371 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb524033020 con 0x55807abb3c80 2026-02-20T03:38:01.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb4dbfff640 1 -- 10.20.193.28:0/4294320371 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5240d6630 con 0x55807abb3c80 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- 10.20.193.28:0/4294320371 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807aa993f0 con 0x55807abb3c80 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb4dbfff640 1 -- 10.20.193.28:0/4294320371 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fb5240c7b40 con 0x55807abb3c80 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 10 client.21759 _ll_register_callbacks cb 0x7fb51c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- 10.20.193.28:0/4294320371 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb51c004500 con 0x55807abb3c80 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb4dbfff640 1 -- 10.20.193.28:0/4294320371 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fb5240d6860 con 0x55807abb3c80 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 10 client.21759 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- 10.20.193.28:0/4294320371 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55807abac650 con 0x55807abb3c80 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb4dbfff640 1 -- 10.20.193.28:0/4294320371 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fb5240d2b40 con 0x55807abb3c80 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 10 client.21759 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 10 client.21759 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 20 client.21759 populate_metadata read hostname 'trial028' 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55807ac4cee0 0x55807ac4f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:01.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 4 client.21759 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:38:01.408 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.397+0000 7fb532c36e00 1 -- 10.20.193.28:0/4294320371 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55807aaca7c0 con 0x55807ac4cee0 2026-02-20T03:38:01.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.414+0000 7fb52e4a6640 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55807ac4cee0 0x55807ac4f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:01.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.455+0000 7fb52e4a6640 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55807ac4cee0 0x55807ac4f3a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8acb16b98b57d808 server_cookie=173782471db656fd in_seq=0 out_seq=0 2026-02-20T03:38:01.457 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.455+0000 7fb4dbfff640 10 client.21759 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:38:01.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb4dbfff640 1 -- 10.20.193.28:0/4294320371 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55807aaca7c0 con 0x55807ac4cee0 2026-02-20T03:38:01.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb4dbfff640 10 client.21759 handle_command_reply: tid=0 2026-02-20T03:38:01.470 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 client.21759 shutdown 2026-02-20T03:38:01.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 -- 10.20.193.28:0/4294320371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abb3c80 msgr2=0x55807ac4b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:01.471 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abb3c80 0x55807ac4b560 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fb52402f960 tx=0x7fb5240ccb20 comp rx=0 tx=0).stop 2026-02-20T03:38:01.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 -- 10.20.193.28:0/4294320371 shutdown_connections 2026-02-20T03:38:01.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55807ac4cee0 0x55807ac4f3a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55807abb3c80 0x55807ac4b560 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55807abafa40 0x55807abd5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 --2- 10.20.193.28:0/4294320371 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55807abaf090 0x55807abd51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 -- 10.20.193.28:0/4294320371 >> 10.20.193.28:0/4294320371 conn(0x55807ab69240 msgr2=0x55807abcef80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:01.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb4dbfff640 0 client.21759 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:38:01.472 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 -- 10.20.193.28:0/4294320371 shutdown_connections 2026-02-20T03:38:01.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 1 -- 10.20.193.28:0/4294320371 wait complete. 2026-02-20T03:38:01.473 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb532c36e00 20 client.21759 trim_cache size 0 max 16384 2026-02-20T03:38:01.483 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:38:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 -- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb5040b0da0 msgr2=0x7fb5040b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb5040b0da0 0x7fb5040b3260 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00b800 tx=0x7fb51c00b900 comp rx=0 tx=0).stop 2026-02-20T03:38:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 -- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 msgr2=0x7fb5281a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 0x7fb5281a5980 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fb52400b1d0 tx=0x7fb524009300 comp rx=0 tx=0).stop 2026-02-20T03:38:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 -- 10.20.193.28:0/88016009 shutdown_connections 2026-02-20T03:38:01.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb5040b0da0 0x7fb5040b3260 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb5281104c0 0x7fb5281a5980 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb52810c090 0x7fb5281abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 --2- 10.20.193.28:0/88016009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb52810b6e0 0x7fb5281ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 -- 10.20.193.28:0/88016009 >> 10.20.193.28:0/88016009 conn(0x7fb528071f80 msgr2=0x7fb528074390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 -- 10.20.193.28:0/88016009 shutdown_connections 2026-02-20T03:38:01.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:01.468+0000 7fb52f4a8640 1 -- 10.20.193.28:0/88016009 wait complete. 2026-02-20T03:38:01.614 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:38:01.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.16 MB/sec execute 452 sec latency 32327.727 ms 2026-02-20T03:38:01.817 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:01 trial028 ceph-mon[38552]: pgmap v886: 129 pgs: 129 active+clean; 770 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 767 KiB/s rd, 11 MiB/s wr, 593 op/s 2026-02-20T03:38:01.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:01 trial126 ceph-mon[38476]: pgmap v886: 129 pgs: 129 active+clean; 770 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 767 KiB/s rd, 11 MiB/s wr, 593 op/s 2026-02-20T03:38:01.868 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:01 trial177 ceph-mon[43181]: pgmap v886: 129 pgs: 129 active+clean; 770 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 767 KiB/s rd, 11 MiB/s wr, 593 op/s 2026-02-20T03:38:01.938 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:02.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.179+0000 7f6e959b4640 1 -- 10.20.193.28:0/2086258673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e901049b0 msgr2=0x7f6e90104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:02.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.179+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2086258673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e901049b0 0x7f6e90104e10 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009a60 tx=0x7f6e7802f290 comp rx=0 tx=0).stop 2026-02-20T03:38:02.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.180+0000 7f6e959b4640 1 -- 10.20.193.28:0/2086258673 shutdown_connections 2026-02-20T03:38:02.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.180+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2086258673 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e90105350 0x7f6e90111990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.180+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2086258673 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e901049b0 0x7f6e90104e10 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.180+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2086258673 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e9010aac0 0x7f6e9010aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.180+0000 7f6e959b4640 1 -- 10.20.193.28:0/2086258673 >> 10.20.193.28:0/2086258673 conn(0x7f6e90100690 msgr2=0x7f6e90102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:02.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.180+0000 7f6e959b4640 1 -- 10.20.193.28:0/2086258673 shutdown_connections 2026-02-20T03:38:02.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.180+0000 7f6e959b4640 1 -- 10.20.193.28:0/2086258673 wait complete. 2026-02-20T03:38:02.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.180+0000 7f6e959b4640 1 Processor -- start 2026-02-20T03:38:02.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e959b4640 1 -- start start 2026-02-20T03:38:02.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e959b4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e901049b0 0x7f6e9019d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e959b4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105350 0x7f6e9019d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e959b4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e9010aac0 0x7f6e901a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e959b4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90114e10 con 0x7f6e90105350 2026-02-20T03:38:02.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e959b4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90114c90 con 0x7f6e901049b0 2026-02-20T03:38:02.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e959b4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e90114f90 con 0x7f6e9010aac0 2026-02-20T03:38:02.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105350 0x7f6e9019d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:02.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105350 0x7f6e9019d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48070/0 (socket says 10.20.193.28:48070) 2026-02-20T03:38:02.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e87fff640 1 -- 10.20.193.28:0/2707366000 learned_addr learned my addr 10.20.193.28:0/2707366000 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:02.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e87fff640 1 -- 10.20.193.28:0/2707366000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e9010aac0 msgr2=0x7f6e901a1c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:02.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e87fff640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e9010aac0 0x7f6e901a1c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e87fff640 1 -- 10.20.193.28:0/2707366000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e901049b0 msgr2=0x7f6e9019d370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:02.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e87fff640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e901049b0 0x7f6e9019d370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.181+0000 7f6e87fff640 1 -- 10.20.193.28:0/2707366000 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e901a23c0 con 0x7f6e90105350 2026-02-20T03:38:02.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.182+0000 7f6e87fff640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105350 0x7f6e9019d8b0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f6e7802f7a0 tx=0x7f6e7802fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:02.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.182+0000 7f6e85ffb640 1 -- 10.20.193.28:0/2707366000 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7802fe50 con 0x7f6e90105350 2026-02-20T03:38:02.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.182+0000 7f6e85ffb640 1 -- 10.20.193.28:0/2707366000 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e78005030 con 0x7f6e90105350 2026-02-20T03:38:02.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.182+0000 7f6e85ffb640 1 -- 10.20.193.28:0/2707366000 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78004cf0 con 0x7f6e90105350 2026-02-20T03:38:02.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.182+0000 7f6e959b4640 1 -- 10.20.193.28:0/2707366000 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e901a2650 con 0x7f6e90105350 2026-02-20T03:38:02.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.182+0000 7f6e959b4640 1 -- 10.20.193.28:0/2707366000 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e901a9ef0 con 0x7f6e90105350 2026-02-20T03:38:02.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e85ffb640 1 -- 10.20.193.28:0/2707366000 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6e780051e0 con 0x7f6e90105350 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 Processor -- start 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 -- start start 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc11fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc119ff0 0x55f5cc11a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc11a970 0x55f5cc1267f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f5cc091e00 con 0x55f5cc11f9c0 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f5cc064970 con 0x55f5cc119ff0 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f5cc0121f0 con 0x55f5cc11a970 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e951b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc11fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e951b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc11fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48072/0 (socket says 10.20.193.28:48072) 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e951b3640 1 -- 10.20.193.28:0/1708490891 learned_addr learned my addr 10.20.193.28:0/1708490891 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:02.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e951b3640 1 -- 10.20.193.28:0/1708490891 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc11a970 msgr2=0x55f5cc1267f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e951b3640 1 --2- 10.20.193.28:0/1708490891 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc11a970 0x55f5cc1267f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e951b3640 1 -- 10.20.193.28:0/1708490891 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc119ff0 msgr2=0x55f5cc11a430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e951b3640 1 --2- 10.20.193.28:0/1708490891 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc119ff0 0x55f5cc11a430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e951b3640 1 -- 10.20.193.28:0/1708490891 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5cc0253d0 con 0x55f5cc11f9c0 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e85ffb640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e6c0b0fc0 0x7f6e6c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e85ffb640 1 -- 10.20.193.28:0/2707366000 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6e781052a0 con 0x7f6e90105350 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e951b3640 1 --2- 10.20.193.28:0/1708490891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc11fda0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009d20 tx=0x7f6e8c00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b12f9d3a95b4f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e949b2640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e6c0b0fc0 0x7f6e6c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e5d4e4640 1 -- 10.20.193.28:0/1708490891 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c017070 con 0x55f5cc11f9c0 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e5d4e4640 1 -- 10.20.193.28:0/1708490891 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e8c00bd50 con 0x55f5cc11f9c0 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e5d4e4640 1 -- 10.20.193.28:0/1708490891 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c006e60 con 0x55f5cc11f9c0 2026-02-20T03:38:02.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 -- 10.20.193.28:0/1708490891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 msgr2=0x55f5cc11fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 --2- 10.20.193.28:0/1708490891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc11fda0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009d20 tx=0x7f6e8c00b420 comp rx=0 tx=0).stop 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e949b2640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e6c0b0fc0 0x7f6e6c0b3480 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6e800096f0 tx=0x7f6e80006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 -- 10.20.193.28:0/1708490891 shutdown_connections 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 --2- 10.20.193.28:0/1708490891 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc11a970 0x55f5cc1267f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 --2- 10.20.193.28:0/1708490891 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc119ff0 0x55f5cc11a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 --2- 10.20.193.28:0/1708490891 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc11fda0 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 -- 10.20.193.28:0/1708490891 >> 10.20.193.28:0/1708490891 conn(0x55f5cc0d4240 msgr2=0x55f5cc10fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 -- 10.20.193.28:0/1708490891 shutdown_connections 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.183+0000 7f6e99142e00 1 -- 10.20.193.28:0/1708490891 wait complete. 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 -- start start 2026-02-20T03:38:02.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 Processor -- start 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 0x55f5cc134af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc135030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11f9c0 0x55f5cc1332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f5cc0608a0 con 0x55f5cc11a970 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f5cbe52f50 con 0x55f5cc11f9c0 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f5cc133830 con 0x55f5cc119ff0 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc135030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc135030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48088/0 (socket says 10.20.193.28:48088) 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e87fff640 1 -- 10.20.193.28:0/3972148656 learned_addr learned my addr 10.20.193.28:0/3972148656 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e87fff640 1 -- 10.20.193.28:0/3972148656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 msgr2=0x55f5cc134af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e87fff640 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 0x55f5cc134af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e87fff640 1 -- 10.20.193.28:0/3972148656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11f9c0 msgr2=0x55f5cc1332a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:02.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e87fff640 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11f9c0 0x55f5cc1332a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e87fff640 1 -- 10.20.193.28:0/3972148656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5cc12c5d0 con 0x55f5cc11a970 2026-02-20T03:38:02.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e87fff640 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc135030 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f6e780c8db0 tx=0x7f6e780cc680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16450939c3d8849 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e4e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/3972148656 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780cd680 con 0x55f5cc11a970 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/3972148656 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e78033020 con 0x55f5cc11a970 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 -- 10.20.193.28:0/3972148656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5cbe35b40 con 0x55f5cc11a970 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/3972148656 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780c86a0 con 0x55f5cc11a970 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/3972148656 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6e780c8840 con 0x55f5cc11a970 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e4e7fc640 10 client.21771 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 10 client.21771 _ll_register_callbacks cb 0x55f5cc09deb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 -- 10.20.193.28:0/3972148656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f5cc072150 con 0x55f5cc11a970 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/3972148656 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6e780b52d0 con 0x55f5cc11a970 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 10 client.21771 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:02.204 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 -- 10.20.193.28:0/3972148656 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55f5cc01f1e0 con 0x55f5cc11a970 2026-02-20T03:38:02.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/3972148656 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7f6e780b3ce0 con 0x55f5cc11a970 2026-02-20T03:38:02.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 10 client.21771 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:02.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 10 client.21771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:02.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 20 client.21771 populate_metadata read hostname 'trial028' 2026-02-20T03:38:02.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f5cc1431e0 0x55f5cc1456a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 4 client.21771 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:02.205 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.188+0000 7f6e99142e00 1 -- 10.20.193.28:0/3972148656 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5cc06c560 con 0x55f5cc1431e0 2026-02-20T03:38:02.217 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.215+0000 7f6e949b2640 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f5cc1431e0 0x55f5cc1456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:02.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.282+0000 7f6e949b2640 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f5cc1431e0 0x55f5cc1456a0 crc :-1 s=READY pgs=583 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7023cda13c948ecf server_cookie=10184cd496574516 in_seq=0 out_seq=0 2026-02-20T03:38:02.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.282+0000 7f6e4e7fc640 10 client.21771 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:02.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/3972148656 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f5cc06c560 con 0x55f5cc1431e0 2026-02-20T03:38:02.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e4e7fc640 10 client.21771 handle_command_reply: tid=0 2026-02-20T03:38:02.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 client.21771 shutdown 2026-02-20T03:38:02.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 -- 10.20.193.28:0/3972148656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 msgr2=0x55f5cc135030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:02.311 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc135030 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f6e780c8db0 tx=0x7f6e780cc680 comp rx=0 tx=0).stop 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 -- 10.20.193.28:0/3972148656 shutdown_connections 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f5cc1431e0 0x55f5cc1456a0 crc :-1 s=READY pgs=583 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11f9c0 0x55f5cc1332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc135030 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 --2- 10.20.193.28:0/3972148656 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 0x55f5cc134af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e4e7fc640 0 client.21771 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 -- 10.20.193.28:0/3972148656 >> 10.20.193.28:0/3972148656 conn(0x55f5cc0d4240 msgr2=0x55f5cc1103f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 -- 10.20.193.28:0/3972148656 shutdown_connections 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 1 -- 10.20.193.28:0/3972148656 wait complete. 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.309+0000 7f6e99142e00 20 client.21771 trim_cache size 0 max 16384 2026-02-20T03:38:02.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 Processor -- start 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- start start 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 0x55f5cc109d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11a970 0x55f5cc134f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc14afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c0126d0 con 0x55f5cc11f9c0 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c00ff70 con 0x55f5cc11a970 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c00ddc0 con 0x55f5cc119ff0 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e951b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc14afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e951b3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc14afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48100/0 (socket says 10.20.193.28:48100) 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e951b3640 1 -- 10.20.193.28:0/2005240878 learned_addr learned my addr 10.20.193.28:0/2005240878 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e951b3640 1 -- 10.20.193.28:0/2005240878 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 msgr2=0x55f5cc109d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e951b3640 1 --2- 10.20.193.28:0/2005240878 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 0x55f5cc109d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e951b3640 1 -- 10.20.193.28:0/2005240878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11a970 msgr2=0x55f5cc134f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e951b3640 1 --2- 10.20.193.28:0/2005240878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11a970 0x55f5cc134f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e951b3640 1 -- 10.20.193.28:0/2005240878 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5cc12c400 con 0x55f5cc11f9c0 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e951b3640 1 --2- 10.20.193.28:0/2005240878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc14afb0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009a70 tx=0x7f6e8c009aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a5b8ef838b53d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:02.320 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e5cce3640 1 -- 10.20.193.28:0/2005240878 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c017070 con 0x55f5cc11f9c0 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e5cce3640 1 -- 10.20.193.28:0/2005240878 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e8c018040 con 0x55f5cc11f9c0 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e5cce3640 1 -- 10.20.193.28:0/2005240878 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c012410 con 0x55f5cc11f9c0 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- 10.20.193.28:0/2005240878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 msgr2=0x55f5cc14afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2005240878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc14afb0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c009a70 tx=0x7f6e8c009aa0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- 10.20.193.28:0/2005240878 shutdown_connections 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2005240878 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11f9c0 0x55f5cc14afb0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2005240878 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11a970 0x55f5cc134f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2005240878 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 0x55f5cc109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- 10.20.193.28:0/2005240878 >> 10.20.193.28:0/2005240878 conn(0x55f5cc0d4240 msgr2=0x55f5cc134830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- 10.20.193.28:0/2005240878 shutdown_connections 2026-02-20T03:38:02.321 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- 10.20.193.28:0/2005240878 wait complete. 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- start start 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 Processor -- start 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 0x55f5cc13b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc1396f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11f9c0 0x55f5cc139d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c00e430 con 0x55f5cc11a970 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c00f8a0 con 0x55f5cc11f9c0 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c00eb00 con 0x55f5cc119ff0 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc1396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e87fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc1396f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48106/0 (socket says 10.20.193.28:48106) 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e87fff640 1 -- 10.20.193.28:0/2552564932 learned_addr learned my addr 10.20.193.28:0/2552564932 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e87fff640 1 -- 10.20.193.28:0/2552564932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 msgr2=0x55f5cc13b360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e87fff640 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 0x55f5cc13b360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e87fff640 1 -- 10.20.193.28:0/2552564932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11f9c0 msgr2=0x55f5cc139d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e87fff640 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11f9c0 0x55f5cc139d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e87fff640 1 -- 10.20.193.28:0/2552564932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5cbd43870 con 0x55f5cc11a970 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e87fff640 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc1396f0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f6e780cc610 tx=0x7f6e781051b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f646ae275ba356b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e4e7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/2552564932 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780cd680 con 0x55f5cc11a970 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/2552564932 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e78033070 con 0x55f5cc11a970 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/2552564932 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780cba00 con 0x55f5cc11a970 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- 10.20.193.28:0/2552564932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5cc0043f0 con 0x55f5cc11a970 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/2552564932 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6e780cbba0 con 0x55f5cc11a970 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 10 client.21777 _ll_register_callbacks cb 0x7f6e78005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- 10.20.193.28:0/2552564932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f5cc0357c0 con 0x55f5cc11a970 2026-02-20T03:38:02.325 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/2552564932 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6e780cbda0 con 0x55f5cc11a970 2026-02-20T03:38:02.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 10 client.21777 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:02.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.315+0000 7f6e99142e00 1 -- 10.20.193.28:0/2552564932 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55f5cc12d0f0 con 0x55f5cc11a970 2026-02-20T03:38:02.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.320+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/2552564932 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7f6e780b3ce0 con 0x55f5cc11a970 2026-02-20T03:38:02.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.320+0000 7f6e99142e00 10 client.21777 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:02.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.320+0000 7f6e99142e00 10 client.21777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:02.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.320+0000 7f6e99142e00 20 client.21777 populate_metadata read hostname 'trial028' 2026-02-20T03:38:02.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.320+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f5cc1af000 0x55f5cc1b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:02.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.320+0000 7f6e99142e00 4 client.21777 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:38:02.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.320+0000 7f6e99142e00 1 -- 10.20.193.28:0/2552564932 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f5cc016ab0 con 0x55f5cc1af000 2026-02-20T03:38:02.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.336+0000 7f6e949b2640 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f5cc1af000 0x55f5cc1b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:02.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.402+0000 7f6e949b2640 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f5cc1af000 0x55f5cc1b14c0 crc :-1 s=READY pgs=584 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=811f6e6ce899c0da server_cookie=9c9b7056cf6d6a55 in_seq=0 out_seq=0 2026-02-20T03:38:02.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.402+0000 7f6e4e7fc640 10 client.21777 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:02.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e4e7fc640 1 -- 10.20.193.28:0/2552564932 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f5cc016ab0 con 0x55f5cc1af000 2026-02-20T03:38:02.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e4e7fc640 10 client.21777 handle_command_reply: tid=0 2026-02-20T03:38:02.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e99142e00 1 client.21777 shutdown 2026-02-20T03:38:02.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e99142e00 1 -- 10.20.193.28:0/2552564932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 msgr2=0x55f5cc1396f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:02.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc1396f0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f6e780cc610 tx=0x7f6e781051b0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e99142e00 1 -- 10.20.193.28:0/2552564932 shutdown_connections 2026-02-20T03:38:02.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f5cc1af000 0x55f5cc1b14c0 crc :-1 s=READY pgs=584 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f5cc11f9c0 0x55f5cc139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f5cc11a970 0x55f5cc1396f0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e99142e00 1 --2- 10.20.193.28:0/2552564932 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f5cc119ff0 0x55f5cc13b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e99142e00 1 -- 10.20.193.28:0/2552564932 >> 10.20.193.28:0/2552564932 conn(0x55f5cc0d4240 msgr2=0x55f5cc134e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:02.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.416+0000 7f6e4e7fc640 0 client.21777 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:02.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e99142e00 1 -- 10.20.193.28:0/2552564932 shutdown_connections 2026-02-20T03:38:02.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e99142e00 1 -- 10.20.193.28:0/2552564932 wait complete. 2026-02-20T03:38:02.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e99142e00 20 client.21777 trim_cache size 0 max 16384 2026-02-20T03:38:02.431 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:38:02.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 -- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e6c0b0fc0 msgr2=0x7f6e6c0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:02.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e6c0b0fc0 0x7f6e6c0b3480 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6e800096f0 tx=0x7f6e80006cd0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 -- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105350 msgr2=0x7f6e9019d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:02.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105350 0x7f6e9019d8b0 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f6e7802f7a0 tx=0x7f6e7802fce0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 -- 10.20.193.28:0/2707366000 shutdown_connections 2026-02-20T03:38:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e6c0b0fc0 0x7f6e6c0b3480 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e9010aac0 0x7f6e901a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e90105350 0x7f6e9019d8b0 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 --2- 10.20.193.28:0/2707366000 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e901049b0 0x7f6e9019d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 -- 10.20.193.28:0/2707366000 >> 10.20.193.28:0/2707366000 conn(0x7f6e90100690 msgr2=0x7f6e90100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 -- 10.20.193.28:0/2707366000 shutdown_connections 2026-02-20T03:38:02.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:02.417+0000 7f6e959b4640 1 -- 10.20.193.28:0/2707366000 wait complete. 2026-02-20T03:38:02.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.11 MB/sec execute 453 sec latency 33327.774 ms 2026-02-20T03:38:03.615 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:38:03.616 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:38:03.659 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:03 trial028 ceph-mon[38552]: pgmap v887: 129 pgs: 129 active+clean; 781 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 588 KiB/s rd, 8.9 MiB/s wr, 518 op/s 2026-02-20T03:38:03.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.07 MB/sec execute 454 sec latency 34327.808 ms 2026-02-20T03:38:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:03 trial126 ceph-mon[38476]: pgmap v887: 129 pgs: 129 active+clean; 781 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 588 KiB/s rd, 8.9 MiB/s wr, 518 op/s 2026-02-20T03:38:03.914 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:03.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:03 trial177 ceph-mon[43181]: pgmap v887: 129 pgs: 129 active+clean; 781 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 588 KiB/s rd, 8.9 MiB/s wr, 518 op/s 2026-02-20T03:38:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.168+0000 7efccedd0640 1 -- 10.20.193.28:0/2163254203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8102420 msgr2=0x7efcc8102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.168+0000 7efccedd0640 1 --2- 10.20.193.28:0/2163254203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8102420 0x7efcc8102800 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009a60 tx=0x7efcb802f290 comp rx=0 tx=0).stop 2026-02-20T03:38:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.168+0000 7efccedd0640 1 -- 10.20.193.28:0/2163254203 shutdown_connections 2026-02-20T03:38:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.168+0000 7efccedd0640 1 --2- 10.20.193.28:0/2163254203 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efcc8106a00 0x7efcc810e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.168+0000 7efccedd0640 1 --2- 10.20.193.28:0/2163254203 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efcc8102dd0 0x7efcc81062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.168+0000 7efccedd0640 1 --2- 10.20.193.28:0/2163254203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8102420 0x7efcc8102800 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.168+0000 7efccedd0640 1 -- 10.20.193.28:0/2163254203 >> 10.20.193.28:0/2163254203 conn(0x7efcc80fc5f0 msgr2=0x7efcc80fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 -- 10.20.193.28:0/2163254203 shutdown_connections 2026-02-20T03:38:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 -- 10.20.193.28:0/2163254203 wait complete. 2026-02-20T03:38:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 Processor -- start 2026-02-20T03:38:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 -- start start 2026-02-20T03:38:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efcc8102420 0x7efcc819d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efcc8102dd0 0x7efcc819d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8106a00 0x7efcc81a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efcc8111910 con 0x7efcc8106a00 2026-02-20T03:38:04.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efcc8111790 con 0x7efcc8102dd0 2026-02-20T03:38:04.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efcc8111a90 con 0x7efcc8102420 2026-02-20T03:38:04.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcce5cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8106a00 0x7efcc81a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:04.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcce5cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8106a00 0x7efcc81a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48136/0 (socket says 10.20.193.28:48136) 2026-02-20T03:38:04.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcce5cf640 1 -- 10.20.193.28:0/3154868893 learned_addr learned my addr 10.20.193.28:0/3154868893 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcce5cf640 1 -- 10.20.193.28:0/3154868893 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efcc8102420 msgr2=0x7efcc819d210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcce5cf640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efcc8102420 0x7efcc819d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcce5cf640 1 -- 10.20.193.28:0/3154868893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efcc8102dd0 msgr2=0x7efcc819d750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcce5cf640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efcc8102dd0 0x7efcc819d750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcce5cf640 1 -- 10.20.193.28:0/3154868893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc81a2260 con 0x7efcc8106a00 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcce5cf640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8106a00 0x7efcc81a1ae0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7efcc400b990 tx=0x7efcc400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcb6ffd640 1 -- 10.20.193.28:0/3154868893 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc4006e60 con 0x7efcc8106a00 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcb6ffd640 1 -- 10.20.193.28:0/3154868893 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efcc4010070 con 0x7efcc8106a00 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efcb6ffd640 1 -- 10.20.193.28:0/3154868893 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc4004800 con 0x7efcc8106a00 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 -- 10.20.193.28:0/3154868893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc81a2550 con 0x7efcc8106a00 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.171+0000 7efccedd0640 1 -- 10.20.193.28:0/3154868893 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc81a9d90 con 0x7efcc8106a00 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 Processor -- start 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcb6ffd640 1 -- 10.20.193.28:0/3154868893 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7efcc401d030 con 0x7efcc8106a00 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 -- start start 2026-02-20T03:38:04.182 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762bad0 0x555bd762beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd762c480 0x555bd762ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76309e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555bd7575c00 con 0x555bd7630570 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555bd75233c0 con 0x555bd762c480 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555bd7571b30 con 0x555bd762bad0 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccd5cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccd5cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48144/0 (socket says 10.20.193.28:48144) 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccd5cd640 1 -- 10.20.193.28:0/549385983 learned_addr learned my addr 10.20.193.28:0/549385983 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccd5cd640 1 -- 10.20.193.28:0/549385983 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762bad0 msgr2=0x555bd762beb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccd5cd640 1 --2- 10.20.193.28:0/549385983 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762bad0 0x555bd762beb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccd5cd640 1 -- 10.20.193.28:0/549385983 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd762c480 msgr2=0x555bd762ff50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:04.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccd5cd640 1 --2- 10.20.193.28:0/549385983 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd762c480 0x555bd762ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccd5cd640 1 -- 10.20.193.28:0/549385983 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd751c840 con 0x555bd7630570 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcb6ffd640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efca40b0e20 0x7efca40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccd5cd640 1 --2- 10.20.193.28:0/549385983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76309e0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009860 tx=0x7efcbc009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bf9025dc23834e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcb6ffd640 1 -- 10.20.193.28:0/3154868893 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7efcc40dffd0 con 0x7efcc8106a00 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efc964e6640 1 -- 10.20.193.28:0/549385983 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc016070 con 0x555bd7630570 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efc964e6640 1 -- 10.20.193.28:0/549385983 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efcbc002870 con 0x555bd7630570 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efc964e6640 1 -- 10.20.193.28:0/549385983 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc004600 con 0x555bd7630570 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efccddce640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efca40b0e20 0x7efca40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 -- 10.20.193.28:0/549385983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 msgr2=0x555bd76309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.175+0000 7efcd255ee00 1 --2- 10.20.193.28:0/549385983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76309e0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009860 tx=0x7efcbc009d30 comp rx=0 tx=0).stop 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- 10.20.193.28:0/549385983 shutdown_connections 2026-02-20T03:38:04.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 --2- 10.20.193.28:0/549385983 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76309e0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 --2- 10.20.193.28:0/549385983 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd762c480 0x555bd762ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 --2- 10.20.193.28:0/549385983 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762bad0 0x555bd762beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- 10.20.193.28:0/549385983 >> 10.20.193.28:0/549385983 conn(0x555bd761bb60 msgr2=0x555bd76215e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- 10.20.193.28:0/549385983 shutdown_connections 2026-02-20T03:38:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efca40b0e20 0x7efca40b32e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x555bd762caa0 tx=0x7efcb80023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- 10.20.193.28:0/549385983 wait complete. 2026-02-20T03:38:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- start start 2026-02-20T03:38:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 Processor -- start 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762bad0 0x555bd7645f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762c480 0x555bd7646450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd7630570 0x555bd7644650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x555bd751d1a0 con 0x555bd762bad0 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x555bd7638780 con 0x555bd7630570 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x555bd7644dd0 con 0x555bd762c480 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762bad0 0x555bd7645f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762bad0 0x555bd7645f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48160/0 (socket says 10.20.193.28:48160) 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 -- 10.20.193.28:0/2015509463 learned_addr learned my addr 10.20.193.28:0/2015509463 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 -- 10.20.193.28:0/2015509463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762c480 msgr2=0x555bd7646450 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762c480 0x555bd7646450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 -- 10.20.193.28:0/2015509463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd7630570 msgr2=0x555bd7644650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:04.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd7630570 0x555bd7644650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 -- 10.20.193.28:0/2015509463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd763e050 con 0x555bd762bad0 2026-02-20T03:38:04.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efccddce640 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762bad0 0x555bd7645f10 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7efcb8002960 tx=0x7efcb802f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43a4440c9c771ca server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:04.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efc837fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:04.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efc837fe640 1 -- 10.20.193.28:0/2015509463 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8051070 con 0x555bd762bad0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efc837fe640 1 -- 10.20.193.28:0/2015509463 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efcb8033040 con 0x555bd762bad0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efc837fe640 1 -- 10.20.193.28:0/2015509463 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb80426d0 con 0x555bd762bad0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- 10.20.193.28:0/2015509463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd7344b60 con 0x555bd762bad0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 10 client.21789 _ll_register_callbacks cb 0x555bd75210d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- 10.20.193.28:0/2015509463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555bd757d7f0 con 0x555bd762bad0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efc837fe640 1 -- 10.20.193.28:0/2015509463 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7efcb8038940 con 0x555bd762bad0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efc837fe640 1 -- 10.20.193.28:0/2015509463 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7efcb8038b80 con 0x555bd762bad0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 10 client.21789 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- 10.20.193.28:0/2015509463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x555bd7542430 con 0x555bd762bad0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efc837fe640 1 -- 10.20.193.28:0/2015509463 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7efcb8056440 con 0x555bd762bad0 2026-02-20T03:38:04.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 10 client.21789 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:04.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 10 client.21789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:04.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 20 client.21789 populate_metadata read hostname 'trial028' 2026-02-20T03:38:04.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555bd7654790 0x555bd7656c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 4 client.21789 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:04.196 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.178+0000 7efcd255ee00 1 -- 10.20.193.28:0/2015509463 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bd74f7c00 con 0x555bd7654790 2026-02-20T03:38:04.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.205+0000 7efccd5cd640 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555bd7654790 0x555bd7656c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:04.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.272+0000 7efccd5cd640 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555bd7654790 0x555bd7656c50 crc :-1 s=READY pgs=585 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bbce0336b54f08e server_cookie=6645d8ad4e12da28 in_seq=0 out_seq=0 2026-02-20T03:38:04.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.272+0000 7efc837fe640 10 client.21789 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:04.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efc837fe640 1 -- 10.20.193.28:0/2015509463 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x555bd74f7c00 con 0x555bd7654790 2026-02-20T03:38:04.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efc837fe640 10 client.21789 handle_command_reply: tid=0 2026-02-20T03:38:04.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 client.21789 shutdown 2026-02-20T03:38:04.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 -- 10.20.193.28:0/2015509463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762bad0 msgr2=0x555bd7645f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:04.300 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762bad0 0x555bd7645f10 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7efcb8002960 tx=0x7efcb802f290 comp rx=0 tx=0).stop 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 -- 10.20.193.28:0/2015509463 shutdown_connections 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555bd7654790 0x555bd7656c50 crc :-1 s=READY pgs=585 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd7630570 0x555bd7644650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762c480 0x555bd7646450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2015509463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762bad0 0x555bd7645f10 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efc837fe640 0 client.21789 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 -- 10.20.193.28:0/2015509463 >> 10.20.193.28:0/2015509463 conn(0x555bd761bb60 msgr2=0x555bd762ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 -- 10.20.193.28:0/2015509463 shutdown_connections 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 1 -- 10.20.193.28:0/2015509463 wait complete. 2026-02-20T03:38:04.309 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.298+0000 7efcd255ee00 20 client.21789 trim_cache size 0 max 16384 2026-02-20T03:38:04.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 Processor -- start 2026-02-20T03:38:04.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 -- start start 2026-02-20T03:38:04.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762bad0 0x555bd7631960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762c480 0x555bd765c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd7630570 0x555bd765ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc74012790 con 0x555bd762c480 2026-02-20T03:38:04.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efc74010030 con 0x555bd7630570 2026-02-20T03:38:04.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efc7400de80 con 0x555bd762bad0 2026-02-20T03:38:04.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efccd5cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762c480 0x555bd765c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efccd5cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762c480 0x555bd765c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48168/0 (socket says 10.20.193.28:48168) 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efccd5cd640 1 -- 10.20.193.28:0/1285867884 learned_addr learned my addr 10.20.193.28:0/1285867884 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efccd5cd640 1 -- 10.20.193.28:0/1285867884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762bad0 msgr2=0x555bd7631960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efccd5cd640 1 --2- 10.20.193.28:0/1285867884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762bad0 0x555bd7631960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efccd5cd640 1 -- 10.20.193.28:0/1285867884 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd7630570 msgr2=0x555bd765ca50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efccd5cd640 1 --2- 10.20.193.28:0/1285867884 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd7630570 0x555bd765ca50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efccd5cd640 1 -- 10.20.193.28:0/1285867884 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd76517d0 con 0x555bd762c480 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efccd5cd640 1 --2- 10.20.193.28:0/1285867884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762c480 0x555bd765c510 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0041d0 tx=0x7efcbc009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d9179111d258c7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efc95ce5640 1 -- 10.20.193.28:0/1285867884 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc016070 con 0x555bd762c480 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efc95ce5640 1 -- 10.20.193.28:0/1285867884 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efcbc017040 con 0x555bd762c480 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efc95ce5640 1 -- 10.20.193.28:0/1285867884 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc004560 con 0x555bd762c480 2026-02-20T03:38:04.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 -- 10.20.193.28:0/1285867884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762c480 msgr2=0x555bd765c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:04.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 --2- 10.20.193.28:0/1285867884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762c480 0x555bd765c510 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0041d0 tx=0x7efcbc009d30 comp rx=0 tx=0).stop 2026-02-20T03:38:04.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 -- 10.20.193.28:0/1285867884 shutdown_connections 2026-02-20T03:38:04.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 --2- 10.20.193.28:0/1285867884 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd7630570 0x555bd765ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 --2- 10.20.193.28:0/1285867884 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd762c480 0x555bd765c510 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 --2- 10.20.193.28:0/1285867884 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762bad0 0x555bd7631960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 -- 10.20.193.28:0/1285867884 >> 10.20.193.28:0/1285867884 conn(0x555bd761bb60 msgr2=0x555bd76436d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:04.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 -- 10.20.193.28:0/1285867884 shutdown_connections 2026-02-20T03:38:04.314 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.304+0000 7efcd255ee00 1 -- 10.20.193.28:0/1285867884 wait complete. 2026-02-20T03:38:04.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcd255ee00 1 -- start start 2026-02-20T03:38:04.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcd255ee00 1 Processor -- start 2026-02-20T03:38:04.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd762bad0 0x555bd764b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762c480 0x555bd764be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcd255ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcd255ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7efc7400e4f0 con 0x555bd7630570 2026-02-20T03:38:04.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcd255ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7efc7400f960 con 0x555bd762bad0 2026-02-20T03:38:04.316 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcd255ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7efc7400ebc0 con 0x555bd762c480 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcce5cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcce5cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76b88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48182/0 (socket says 10.20.193.28:48182) 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcce5cf640 1 -- 10.20.193.28:0/2125187859 learned_addr learned my addr 10.20.193.28:0/2125187859 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcce5cf640 1 -- 10.20.193.28:0/2125187859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762c480 msgr2=0x555bd764be80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcce5cf640 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762c480 0x555bd764be80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcce5cf640 1 -- 10.20.193.28:0/2125187859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd762bad0 msgr2=0x555bd764b940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcce5cf640 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd762bad0 0x555bd764b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcce5cf640 1 -- 10.20.193.28:0/2125187859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd76449c0 con 0x555bd7630570 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcce5cf640 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76b88f0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7efcc400b960 tx=0x7efcc40a7950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9672967621878c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efc837fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efc837fe640 1 -- 10.20.193.28:0/2125187859 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc40a7230 con 0x555bd7630570 2026-02-20T03:38:04.317 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efc837fe640 1 -- 10.20.193.28:0/2125187859 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7efcc400cdc0 con 0x555bd7630570 2026-02-20T03:38:04.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efc837fe640 1 -- 10.20.193.28:0/2125187859 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc40a36b0 con 0x555bd7630570 2026-02-20T03:38:04.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.309+0000 7efcd255ee00 1 -- 10.20.193.28:0/2125187859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd763de80 con 0x555bd7630570 2026-02-20T03:38:04.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efc837fe640 1 -- 10.20.193.28:0/2125187859 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7efcc40ce1b0 con 0x555bd7630570 2026-02-20T03:38:04.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 10 client.21795 _ll_register_callbacks cb 0x7efcb8002f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:04.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 1 -- 10.20.193.28:0/2125187859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcbc002870 con 0x555bd7630570 2026-02-20T03:38:04.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efc837fe640 1 -- 10.20.193.28:0/2125187859 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7efcc40b0f70 con 0x555bd7630570 2026-02-20T03:38:04.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 10 client.21795 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:04.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 1 -- 10.20.193.28:0/2125187859 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x555bd7254900 con 0x555bd7630570 2026-02-20T03:38:04.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efc837fe640 1 -- 10.20.193.28:0/2125187859 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7efcc40a6790 con 0x555bd7630570 2026-02-20T03:38:04.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 10 client.21795 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:04.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 10 client.21795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:04.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 20 client.21795 populate_metadata read hostname 'trial028' 2026-02-20T03:38:04.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555bd76c1790 0x555bd76c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:04.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 4 client.21795 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:38:04.327 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.312+0000 7efcd255ee00 1 -- 10.20.193.28:0/2125187859 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555bd72e5a20 con 0x555bd76c1790 2026-02-20T03:38:04.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.338+0000 7efccddce640 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555bd76c1790 0x555bd76c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:04.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.405+0000 7efccddce640 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555bd76c1790 0x555bd76c3c50 crc :-1 s=READY pgs=586 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26fee04d3274e88e server_cookie=21863b3de11e3df6 in_seq=0 out_seq=0 2026-02-20T03:38:04.407 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.405+0000 7efc837fe640 10 client.21795 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efc837fe640 1 -- 10.20.193.28:0/2125187859 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555bd72e5a20 con 0x555bd76c1790 2026-02-20T03:38:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efc837fe640 10 client.21795 handle_command_reply: tid=0 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 client.21795 shutdown 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 -- 10.20.193.28:0/2125187859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 msgr2=0x555bd76b88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76b88f0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7efcc400b960 tx=0x7efcc40a7950 comp rx=0 tx=0).stop 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 -- 10.20.193.28:0/2125187859 shutdown_connections 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x555bd76c1790 0x555bd76c3c50 crc :-1 s=READY pgs=586 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x555bd7630570 0x555bd76b88f0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x555bd762c480 0x555bd764be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 --2- 10.20.193.28:0/2125187859 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x555bd762bad0 0x555bd764b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 -- 10.20.193.28:0/2125187859 >> 10.20.193.28:0/2125187859 conn(0x555bd761bb60 msgr2=0x555bd7630950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efc837fe640 0 client.21795 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:04.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 -- 10.20.193.28:0/2125187859 shutdown_connections 2026-02-20T03:38:04.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 1 -- 10.20.193.28:0/2125187859 wait complete. 2026-02-20T03:38:04.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.418+0000 7efcd255ee00 20 client.21795 trim_cache size 0 max 16384 2026-02-20T03:38:04.423 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:38:04.423 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:38:04.423 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "2378821c-3004-49c3-bdc0-6173c4a67570", 2026-02-20T03:38:04.423 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:38:04.423 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:38:04.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 -- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efca40b0e20 msgr2=0x7efca40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:04.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efca40b0e20 0x7efca40b32e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x555bd762caa0 tx=0x7efcb80023d0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 -- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8106a00 msgr2=0x7efcc81a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:04.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8106a00 0x7efcc81a1ae0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7efcc400b990 tx=0x7efcc400be60 comp rx=0 tx=0).stop 2026-02-20T03:38:04.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 -- 10.20.193.28:0/3154868893 shutdown_connections 2026-02-20T03:38:04.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7efca40b0e20 0x7efca40b32e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7efcc8106a00 0x7efcc81a1ae0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7efcc8102dd0 0x7efcc819d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 --2- 10.20.193.28:0/3154868893 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7efcc8102420 0x7efcc819d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:04.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 -- 10.20.193.28:0/3154868893 >> 10.20.193.28:0/3154868893 conn(0x7efcc80fc5f0 msgr2=0x7efcc8101030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:04.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 -- 10.20.193.28:0/3154868893 shutdown_connections 2026-02-20T03:38:04.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:04.420+0000 7efccedd0640 1 -- 10.20.193.28:0/3154868893 wait complete. 2026-02-20T03:38:04.566 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:38:04.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:04 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:38:04.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:04 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:04.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:04 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:38:04.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:04 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:38:04.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 20.03 MB/sec execute 455 sec latency 35327.843 ms 2026-02-20T03:38:04.905 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:04 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:38:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:04 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:04 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:38:04.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:04 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:38:05.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:04 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:38:05.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:04 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:05.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:04 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:38:05.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:04 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:38:05.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.155+0000 7fe1c9dff640 1 -- 10.20.193.28:0/65127605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 msgr2=0x7fe1c410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.155+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/65127605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 0x7fe1c410f2d0 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009a30 tx=0x7fe1b402f260 comp rx=0 tx=0).stop 2026-02-20T03:38:05.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.155+0000 7fe1c9dff640 1 -- 10.20.193.28:0/65127605 shutdown_connections 2026-02-20T03:38:05.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.155+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/65127605 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1c4109ba0 0x7fe1c4115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.155+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/65127605 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1c4109220 0x7fe1c4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.155+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/65127605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 0x7fe1c410f2d0 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.155+0000 7fe1c9dff640 1 -- 10.20.193.28:0/65127605 >> 10.20.193.28:0/65127605 conn(0x7fe1c4078600 msgr2=0x7fe1c407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.155+0000 7fe1c9dff640 1 -- 10.20.193.28:0/65127605 shutdown_connections 2026-02-20T03:38:05.162 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.155+0000 7fe1c9dff640 1 -- 10.20.193.28:0/65127605 wait complete. 2026-02-20T03:38:05.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 Processor -- start 2026-02-20T03:38:05.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 -- start start 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1c4109220 0x7fe1c41a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1c4109ba0 0x7fe1c41a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 0x7fe1c41a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c41191b0 con 0x7fe1c410eef0 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c4119030 con 0x7fe1c4109220 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c4119330 con 0x7fe1c4109ba0 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c95fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 0x7fe1c41a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c95fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 0x7fe1c41a5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48214/0 (socket says 10.20.193.28:48214) 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c95fe640 1 -- 10.20.193.28:0/963372364 learned_addr learned my addr 10.20.193.28:0/963372364 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c95fe640 1 -- 10.20.193.28:0/963372364 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1c4109ba0 msgr2=0x7fe1c41a1b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:05.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c95fe640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1c4109ba0 0x7fe1c41a1b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c95fe640 1 -- 10.20.193.28:0/963372364 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1c4109220 msgr2=0x7fe1c41a1650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:05.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c95fe640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1c4109220 0x7fe1c41a1650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c95fe640 1 -- 10.20.193.28:0/963372364 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c41a66a0 con 0x7fe1c410eef0 2026-02-20T03:38:05.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c95fe640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 0x7fe1c41a5f20 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000b990 tx=0x7fe1c000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1b9ffb640 1 -- 10.20.193.28:0/963372364 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0006e60 con 0x7fe1c410eef0 2026-02-20T03:38:05.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1b9ffb640 1 -- 10.20.193.28:0/963372364 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1c0010070 con 0x7fe1c410eef0 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 -- 10.20.193.28:0/963372364 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c41a6990 con 0x7fe1c410eef0 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1b9ffb640 1 -- 10.20.193.28:0/963372364 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0004800 con 0x7fe1c410eef0 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1c9dff640 1 -- 10.20.193.28:0/963372364 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c41ae1d0 con 0x7fe1c410eef0 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1b9ffb640 1 -- 10.20.193.28:0/963372364 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe1c000c790 con 0x7fe1c410eef0 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.160+0000 7fe1cd58de00 1 Processor -- start 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- start start 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d7e000 0x55b6c5d7e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d78630 0x55b6c5d78a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d84e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5cf8e50 con 0x55b6c5d7e000 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5ccb9c0 con 0x55b6c5d78fb0 2026-02-20T03:38:05.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5c79240 con 0x55b6c5d78630 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d7e000 0x55b6c5d7e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d7e000 0x55b6c5d7e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48218/0 (socket says 10.20.193.28:48218) 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1bbfff640 1 -- 10.20.193.28:0/2228351135 learned_addr learned my addr 10.20.193.28:0/2228351135 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1bbfff640 1 -- 10.20.193.28:0/2228351135 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d78630 msgr2=0x55b6c5d78a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/2228351135 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d78630 0x55b6c5d78a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1bbfff640 1 -- 10.20.193.28:0/2228351135 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78fb0 msgr2=0x55b6c5d84e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/2228351135 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d84e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1bbfff640 1 -- 10.20.193.28:0/2228351135 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c5c8c420 con 0x55b6c5d7e000 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/2228351135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d7e000 0x55b6c5d7e3e0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0098a0 tx=0x7fe1ac009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55b27e691c74358 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1914e4640 1 -- 10.20.193.28:0/2228351135 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac016070 con 0x55b6c5d7e000 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1914e4640 1 -- 10.20.193.28:0/2228351135 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1ac004480 con 0x55b6c5d7e000 2026-02-20T03:38:05.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1914e4640 1 -- 10.20.193.28:0/2228351135 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00bd90 con 0x55b6c5d7e000 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1b9ffb640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1a00b0da0 0x7fe1a00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1b9ffb640 1 -- 10.20.193.28:0/963372364 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe1c00e04a0 con 0x7fe1c410eef0 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- 10.20.193.28:0/2228351135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d7e000 msgr2=0x55b6c5d7e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/2228351135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d7e000 0x55b6c5d7e3e0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0098a0 tx=0x7fe1ac009d70 comp rx=0 tx=0).stop 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1c8dfd640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1a00b0da0 0x7fe1a00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- 10.20.193.28:0/2228351135 shutdown_connections 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/2228351135 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d84e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/2228351135 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d78630 0x55b6c5d78a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/2228351135 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d7e000 0x55b6c5d7e3e0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- 10.20.193.28:0/2228351135 >> 10.20.193.28:0/2228351135 conn(0x55b6c5d3b290 msgr2=0x55b6c5d76d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- 10.20.193.28:0/2228351135 shutdown_connections 2026-02-20T03:38:05.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- 10.20.193.28:0/2228351135 wait complete. 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 -- start start 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 Processor -- start 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1c8dfd640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1a00b0da0 0x7fe1a00b3260 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009950 tx=0x7fe1b40023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.164+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78630 0x55b6c5d92f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d934c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d7e000 0x55b6c5d916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5cc78f0 con 0x55b6c5d78fb0 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5ab9f50 con 0x55b6c5d78630 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5d91e40 con 0x55b6c5d7e000 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d934c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d934c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48234/0 (socket says 10.20.193.28:48234) 2026-02-20T03:38:05.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1bbfff640 1 -- 10.20.193.28:0/125685812 learned_addr learned my addr 10.20.193.28:0/125685812 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1bbfff640 1 -- 10.20.193.28:0/125685812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d7e000 msgr2=0x55b6c5d916c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d7e000 0x55b6c5d916c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1bbfff640 1 -- 10.20.193.28:0/125685812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78630 msgr2=0x55b6c5d92f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:38:05.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78630 0x55b6c5d92f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1bbfff640 1 -- 10.20.193.28:0/125685812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c5d8ab20 con 0x55b6c5d78fb0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d934c0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00b9b0 tx=0x7fe1ac00b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7647cd856eee7aa9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1827fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1827fc640 1 -- 10.20.193.28:0/125685812 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac016040 con 0x55b6c5d78fb0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1827fc640 1 -- 10.20.193.28:0/125685812 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1ac01f070 con 0x55b6c5d78fb0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1827fc640 1 -- 10.20.193.28:0/125685812 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac01aab0 con 0x55b6c5d78fb0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 -- 10.20.193.28:0/125685812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c5a9cb40 con 0x55b6c5d78fb0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1827fc640 1 -- 10.20.193.28:0/125685812 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe1ac01ac50 con 0x55b6c5d78fb0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 10 client.21807 _ll_register_callbacks cb 0x55b6c5d04f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 -- 10.20.193.28:0/125685812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6c5cd91a0 con 0x55b6c5d78fb0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1827fc640 1 -- 10.20.193.28:0/125685812 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe1ac01a430 con 0x55b6c5d78fb0 2026-02-20T03:38:05.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 10 client.21807 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:05.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 -- 10.20.193.28:0/125685812 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55b6c5c86230 con 0x55b6c5d78fb0 2026-02-20T03:38:05.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1827fc640 1 -- 10.20.193.28:0/125685812 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fe1ac019070 con 0x55b6c5d78fb0 2026-02-20T03:38:05.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 10 client.21807 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:05.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 10 client.21807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:05.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 20 client.21807 populate_metadata read hostname 'trial028' 2026-02-20T03:38:05.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6c5da1700 0x55b6c5da3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 4 client.21807 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:05.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.168+0000 7fe1cd58de00 1 -- 10.20.193.28:0/125685812 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6c5cd35b0 con 0x55b6c5da1700 2026-02-20T03:38:05.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.195+0000 7fe1c8dfd640 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6c5da1700 0x55b6c5da3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.249+0000 7fe1c8dfd640 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6c5da1700 0x55b6c5da3af0 crc :-1 s=READY pgs=587 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35f4a9a44b88f1b2 server_cookie=fd987d8fd658d1e3 in_seq=0 out_seq=0 2026-02-20T03:38:05.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.249+0000 7fe1827fc640 10 client.21807 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:05.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1827fc640 1 -- 10.20.193.28:0/125685812 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b6c5cd35b0 con 0x55b6c5da1700 2026-02-20T03:38:05.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1827fc640 10 client.21807 handle_command_reply: tid=0 2026-02-20T03:38:05.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 client.21807 shutdown 2026-02-20T03:38:05.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 -- 10.20.193.28:0/125685812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 msgr2=0x55b6c5d934c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d934c0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00b9b0 tx=0x7fe1ac00b740 comp rx=0 tx=0).stop 2026-02-20T03:38:05.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 -- 10.20.193.28:0/125685812 shutdown_connections 2026-02-20T03:38:05.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6c5da1700 0x55b6c5da3af0 crc :-1 s=READY pgs=587 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d7e000 0x55b6c5d916c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d934c0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/125685812 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78630 0x55b6c5d92f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1827fc640 0 client.21807 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:05.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 -- 10.20.193.28:0/125685812 >> 10.20.193.28:0/125685812 conn(0x55b6c5d3b290 msgr2=0x55b6c5d77440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 -- 10.20.193.28:0/125685812 shutdown_connections 2026-02-20T03:38:05.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.276+0000 7fe1cd58de00 1 -- 10.20.193.28:0/125685812 wait complete. 2026-02-20T03:38:05.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.277+0000 7fe1cd58de00 20 client.21807 trim_cache size 0 max 16384 2026-02-20T03:38:05.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.283+0000 7fe1cd58de00 1 Processor -- start 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1cd58de00 1 -- start start 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d78630 0x55b6c5d70d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d90650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d7e000 0x55b6c5da9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe168012630 con 0x55b6c5d78fb0 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe16800fed0 con 0x55b6c5d7e000 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe16800dd20 con 0x55b6c5d78630 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d90650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1bbfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d90650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48238/0 (socket says 10.20.193.28:48238) 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1bbfff640 1 -- 10.20.193.28:0/3685079908 learned_addr learned my addr 10.20.193.28:0/3685079908 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1bbfff640 1 -- 10.20.193.28:0/3685079908 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d78630 msgr2=0x55b6c5d70d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/3685079908 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d78630 0x55b6c5d70d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1bbfff640 1 -- 10.20.193.28:0/3685079908 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d7e000 msgr2=0x55b6c5da9360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/3685079908 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d7e000 0x55b6c5da9360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1bbfff640 1 -- 10.20.193.28:0/3685079908 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c5d8a950 con 0x55b6c5d78fb0 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/3685079908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d90650 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac002410 tx=0x7fe1ac003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6b98b406410e7e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe190ce3640 1 -- 10.20.193.28:0/3685079908 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac016040 con 0x55b6c5d78fb0 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe190ce3640 1 -- 10.20.193.28:0/3685079908 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1ac01f070 con 0x55b6c5d78fb0 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe190ce3640 1 -- 10.20.193.28:0/3685079908 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac011400 con 0x55b6c5d78fb0 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1cd58de00 1 -- 10.20.193.28:0/3685079908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 msgr2=0x55b6c5d90650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.285+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/3685079908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d90650 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac002410 tx=0x7fe1ac003000 comp rx=0 tx=0).stop 2026-02-20T03:38:05.291 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.287+0000 7fe1cd58de00 1 -- 10.20.193.28:0/3685079908 shutdown_connections 2026-02-20T03:38:05.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.287+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/3685079908 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d7e000 0x55b6c5da9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.287+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/3685079908 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d90650 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.287+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/3685079908 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d78630 0x55b6c5d70d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.287+0000 7fe1cd58de00 1 -- 10.20.193.28:0/3685079908 >> 10.20.193.28:0/3685079908 conn(0x55b6c5d3b290 msgr2=0x55b6c5d8ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.287+0000 7fe1cd58de00 1 -- 10.20.193.28:0/3685079908 shutdown_connections 2026-02-20T03:38:05.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.287+0000 7fe1cd58de00 1 -- 10.20.193.28:0/3685079908 wait complete. 2026-02-20T03:38:05.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.287+0000 7fe1cd58de00 1 -- start start 2026-02-20T03:38:05.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1cd58de00 1 Processor -- start 2026-02-20T03:38:05.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78630 0x55b6c5d97e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1cd58de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d7e000 0x55b6c5d988f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe16800e390 con 0x55b6c5d78630 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe16800f800 con 0x55b6c5d78fb0 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1cd58de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe16800ea60 con 0x55b6c5d7e000 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1c8dfd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78630 0x55b6c5d97e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1c8dfd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78630 0x55b6c5d97e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48254/0 (socket says 10.20.193.28:48254) 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1c8dfd640 1 -- 10.20.193.28:0/1953235480 learned_addr learned my addr 10.20.193.28:0/1953235480 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1c8dfd640 1 -- 10.20.193.28:0/1953235480 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d7e000 msgr2=0x55b6c5d988f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1c8dfd640 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d7e000 0x55b6c5d988f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1c8dfd640 1 -- 10.20.193.28:0/1953235480 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78fb0 msgr2=0x55b6c5d983b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1c8dfd640 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d983b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.288+0000 7fe1c8dfd640 1 -- 10.20.193.28:0/1953235480 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c59aa870 con 0x55b6c5d78630 2026-02-20T03:38:05.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1c8dfd640 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78630 0x55b6c5d97e70 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40097c0 tx=0x7fe1b402f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4ce1166368fc5b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1827fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1827fc640 1 -- 10.20.193.28:0/1953235480 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4053020 con 0x55b6c5d78630 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1827fc640 1 -- 10.20.193.28:0/1953235480 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe1b4033040 con 0x55b6c5d78630 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 1 -- 10.20.193.28:0/1953235480 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c5c6b440 con 0x55b6c5d78630 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1827fc640 1 -- 10.20.193.28:0/1953235480 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4038b00 con 0x55b6c5d78630 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1827fc640 1 -- 10.20.193.28:0/1953235480 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe1b4038ca0 con 0x55b6c5d78630 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1827fc640 10 client.21813 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 10 client.21813 _ll_register_callbacks cb 0x7fe1ac014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 1 -- 10.20.193.28:0/1953235480 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6c5c9c810 con 0x55b6c5d78630 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1827fc640 1 -- 10.20.193.28:0/1953235480 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe1b4038ea0 con 0x55b6c5d78630 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 10 client.21813 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:05.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 1 -- 10.20.193.28:0/1953235480 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55b6c5d8b640 con 0x55b6c5d78630 2026-02-20T03:38:05.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1827fc640 1 -- 10.20.193.28:0/1953235480 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fe1b40026e0 con 0x55b6c5d78630 2026-02-20T03:38:05.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 10 client.21813 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:05.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 10 client.21813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:05.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 20 client.21813 populate_metadata read hostname 'trial028' 2026-02-20T03:38:05.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6c5e0dbd0 0x55b6c5e10090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 4 client.21813 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:38:05.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.289+0000 7fe1cd58de00 1 -- 10.20.193.28:0/1953235480 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b6c5c7db00 con 0x55b6c5e0dbd0 2026-02-20T03:38:05.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.316+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6c5e0dbd0 0x55b6c5e10090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.356+0000 7fe1bbfff640 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6c5e0dbd0 0x55b6c5e10090 crc :-1 s=READY pgs=588 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bb726c5fbc947c9 server_cookie=8feea710ba7c1b73 in_seq=0 out_seq=0 2026-02-20T03:38:05.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.356+0000 7fe1827fc640 10 client.21813 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:05.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1827fc640 1 -- 10.20.193.28:0/1953235480 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b6c5c7db00 con 0x55b6c5e0dbd0 2026-02-20T03:38:05.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1827fc640 10 client.21813 handle_command_reply: tid=0 2026-02-20T03:38:05.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 client.21813 shutdown 2026-02-20T03:38:05.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 -- 10.20.193.28:0/1953235480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78630 msgr2=0x55b6c5d97e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78630 0x55b6c5d97e70 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fe1b40097c0 tx=0x7fe1b402f260 comp rx=0 tx=0).stop 2026-02-20T03:38:05.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 -- 10.20.193.28:0/1953235480 shutdown_connections 2026-02-20T03:38:05.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6c5e0dbd0 0x55b6c5e10090 crc :-1 s=READY pgs=588 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6c5d7e000 0x55b6c5d988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6c5d78fb0 0x55b6c5d983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 --2- 10.20.193.28:0/1953235480 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6c5d78630 0x55b6c5d97e70 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 -- 10.20.193.28:0/1953235480 >> 10.20.193.28:0/1953235480 conn(0x55b6c5d3b290 msgr2=0x55b6c5d90760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1827fc640 0 client.21813 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:05.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 -- 10.20.193.28:0/1953235480 shutdown_connections 2026-02-20T03:38:05.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 1 -- 10.20.193.28:0/1953235480 wait complete. 2026-02-20T03:38:05.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.370+0000 7fe1cd58de00 20 client.21813 trim_cache size 0 max 16384 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout: "2378821c-3004-49c3-bdc0-6173c4a67570": { 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "2378821c-3004-49c3-bdc0-6173c4a67570", 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:38:05.375 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:38:05.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 -- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1a00b0da0 msgr2=0x7fe1a00b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1a00b0da0 0x7fe1a00b3260 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009950 tx=0x7fe1b40023d0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 -- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 msgr2=0x7fe1c41a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 0x7fe1c41a5f20 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000b990 tx=0x7fe1c000be60 comp rx=0 tx=0).stop 2026-02-20T03:38:05.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 -- 10.20.193.28:0/963372364 shutdown_connections 2026-02-20T03:38:05.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe1a00b0da0 0x7fe1a00b3260 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe1c410eef0 0x7fe1c41a5f20 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe1c4109ba0 0x7fe1c41a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 --2- 10.20.193.28:0/963372364 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe1c4109220 0x7fe1c41a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 -- 10.20.193.28:0/963372364 >> 10.20.193.28:0/963372364 conn(0x7fe1c4078600 msgr2=0x7fe1c407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 -- 10.20.193.28:0/963372364 shutdown_connections 2026-02-20T03:38:05.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:05.371+0000 7fe1c9dff640 1 -- 10.20.193.28:0/963372364 wait complete. 2026-02-20T03:38:05.529 INFO:tasks.cephfs.filesystem:scrub status for tag:2378821c-3004-49c3-bdc0-6173c4a67570 - {'path': '/', 'tag': '2378821c-3004-49c3-bdc0-6173c4a67570', 'options': 'recursive,force'} 2026-02-20T03:38:05.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- 10.20.193.28:0/1489634881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e44109e60 msgr2=0x7f6e4410a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1489634881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e44109e60 0x7f6e4410a2e0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009a30 tx=0x7f6e3802f260 comp rx=0 tx=0).stop 2026-02-20T03:38:05.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- 10.20.193.28:0/1489634881 shutdown_connections 2026-02-20T03:38:05.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1489634881 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e4410a900 0x7f6e44111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.593 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1489634881 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e44109e60 0x7f6e4410a2e0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1489634881 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e44109490 0x7f6e44109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- 10.20.193.28:0/1489634881 >> 10.20.193.28:0/1489634881 conn(0x7f6e44077fe0 msgr2=0x7f6e4407a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- 10.20.193.28:0/1489634881 shutdown_connections 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- 10.20.193.28:0/1489634881 wait complete. 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 Processor -- start 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- start start 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e44109490 0x7f6e441a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e44109e60 0x7f6e441a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e4410a900 0x7f6e441a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6e44114a50 con 0x7f6e4410a900 2026-02-20T03:38:05.595 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6e441148d0 con 0x7f6e44109490 2026-02-20T03:38:05.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6e44114bd0 con 0x7f6e44109e60 2026-02-20T03:38:05.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e49d81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e4410a900 0x7f6e441a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.600 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e49d81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e4410a900 0x7f6e441a8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48286/0 (socket says 10.20.193.28:48286) 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e49d81640 1 -- 10.20.193.28:0/1979395227 learned_addr learned my addr 10.20.193.28:0/1979395227 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e49d81640 1 -- 10.20.193.28:0/1979395227 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e44109e60 msgr2=0x7f6e441a1600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e49d81640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e44109e60 0x7f6e441a1600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e49d81640 1 -- 10.20.193.28:0/1979395227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e44109490 msgr2=0x7f6e441a10c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e49d81640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e44109490 0x7f6e441a10c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e49d81640 1 -- 10.20.193.28:0/1979395227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e441a8d70 con 0x7f6e4410a900 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e49d81640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e4410a900 0x7f6e441a8670 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000b990 tx=0x7f6e4000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e327fc640 1 -- 10.20.193.28:0/1979395227 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40006e60 con 0x7f6e4410a900 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e327fc640 1 -- 10.20.193.28:0/1979395227 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e40010070 con 0x7f6e4410a900 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e327fc640 1 -- 10.20.193.28:0/1979395227 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40004800 con 0x7f6e4410a900 2026-02-20T03:38:05.601 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- 10.20.193.28:0/1979395227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e441a9060 con 0x7f6e4410a900 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.588+0000 7f6e4a582640 1 -- 10.20.193.28:0/1979395227 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e441a95e0 con 0x7f6e4410a900 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.593+0000 7f6e4e66ae00 1 Processor -- start 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e327fc640 1 -- 10.20.193.28:0/1979395227 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6e4001d030 con 0x7f6e4410a900 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- start start 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd0e80 0x5600b0bd1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bd5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 0x5600b0bd89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5600b0b218f0 con 0x5600b0bd17c0 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5600b0acf2e0 con 0x5600b0bd0e80 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5600b0b1d820 con 0x5600b0bd6560 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e49580640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bd5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.602 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e49580640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bd5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48288/0 (socket says 10.20.193.28:48288) 2026-02-20T03:38:05.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e49580640 1 -- 10.20.193.28:0/3486432391 learned_addr learned my addr 10.20.193.28:0/3486432391 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e49580640 1 -- 10.20.193.28:0/3486432391 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 msgr2=0x5600b0bd89f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e49580640 1 --2- 10.20.193.28:0/3486432391 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 0x5600b0bd89f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e49580640 1 -- 10.20.193.28:0/3486432391 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd0e80 msgr2=0x5600b0bd1280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.603 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e49580640 1 --2- 10.20.193.28:0/3486432391 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd0e80 0x5600b0bd1280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e49580640 1 -- 10.20.193.28:0/3486432391 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b0ac15a0 con 0x5600b0bd17c0 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e49580640 1 --2- 10.20.193.28:0/3486432391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bd5f40 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009840 tx=0x7f6e34009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3a2b78d912ec50 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e11bfe640 1 -- 10.20.193.28:0/3486432391 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34016070 con 0x5600b0bd17c0 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e11bfe640 1 -- 10.20.193.28:0/3486432391 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e34004480 con 0x5600b0bd17c0 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e11bfe640 1 -- 10.20.193.28:0/3486432391 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3400bca0 con 0x5600b0bd17c0 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/3486432391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 msgr2=0x5600b0bd5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/3486432391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bd5f40 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009840 tx=0x7f6e34009d10 comp rx=0 tx=0).stop 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/3486432391 shutdown_connections 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/3486432391 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 0x5600b0bd89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.606 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/3486432391 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bd5f40 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/3486432391 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd0e80 0x5600b0bd1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/3486432391 >> 10.20.193.28:0/3486432391 conn(0x5600b0bc86f0 msgr2=0x5600b0bcf570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/3486432391 shutdown_connections 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/3486432391 wait complete. 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e327fc640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e200b0d80 0x7f6e200b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e327fc640 1 -- 10.20.193.28:0/1979395227 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6e400dfff0 con 0x7f6e4410a900 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e200b0d80 0x7f6e200b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e200b0d80 0x7f6e200b3240 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6e38002b60 tx=0x7f6e380023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- start start 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 Processor -- start 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd0e80 0x5600b0bfadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bfb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 0x5600b0c022b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5600b0ac90c0 con 0x5600b0bd17c0 2026-02-20T03:38:05.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5600b0beaa20 con 0x5600b0bd0e80 2026-02-20T03:38:05.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5600b0c02840 con 0x5600b0bd6560 2026-02-20T03:38:05.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bfb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bfb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48302/0 (socket says 10.20.193.28:48302) 2026-02-20T03:38:05.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 -- 10.20.193.28:0/2113482413 learned_addr learned my addr 10.20.193.28:0/2113482413 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 -- 10.20.193.28:0/2113482413 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 msgr2=0x5600b0c022b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 0x5600b0c022b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 -- 10.20.193.28:0/2113482413 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd0e80 msgr2=0x5600b0bfadf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd0e80 0x5600b0bfadf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 -- 10.20.193.28:0/2113482413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b0bf4540 con 0x5600b0bd17c0 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e48d7f640 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bfb330 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f6e38037000 tx=0x7f6e3802f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7961cd7c22955e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6dfeffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6dfeffd640 1 -- 10.20.193.28:0/2113482413 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e380045a0 con 0x5600b0bd17c0 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6dfeffd640 1 -- 10.20.193.28:0/2113482413 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e38033040 con 0x5600b0bd17c0 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6dfeffd640 1 -- 10.20.193.28:0/2113482413 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e380458f0 con 0x5600b0bd17c0 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/2113482413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b0add820 con 0x5600b0bd17c0 2026-02-20T03:38:05.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6dfeffd640 1 -- 10.20.193.28:0/2113482413 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6e38045ab0 con 0x5600b0bd17c0 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 10 client.21825 _ll_register_callbacks cb 0x5600b0accff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.596+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/2113482413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5600b0b294e0 con 0x5600b0bd17c0 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6dfeffd640 1 -- 10.20.193.28:0/2113482413 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6e38002e60 con 0x5600b0bd17c0 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6e4e66ae00 10 client.21825 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/2113482413 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x5600b0ae2380 con 0x5600b0bd17c0 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6dfeffd640 1 -- 10.20.193.28:0/2113482413 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7f6e3804d070 con 0x5600b0bd17c0 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6e4e66ae00 10 client.21825 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6e4e66ae00 10 client.21825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6e4e66ae00 20 client.21825 populate_metadata read hostname 'trial028' 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5600b0c06c70 0x5600b0c09130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6e4e66ae00 4 client.21825 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:05.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.601+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/2113482413 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600b0aa3bd0 con 0x5600b0c06c70 2026-02-20T03:38:05.625 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.623+0000 7f6e49580640 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5600b0c06c70 0x5600b0c09130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.689+0000 7f6dfeffd640 10 client.21825 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:05.692 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.689+0000 7f6e49580640 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5600b0c06c70 0x5600b0c09130 crc :-1 s=READY pgs=589 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ceeca26ce792613 server_cookie=759a96d019ddc900 in_seq=0 out_seq=0 2026-02-20T03:38:05.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6dfeffd640 1 -- 10.20.193.28:0/2113482413 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5600b0aa3bd0 con 0x5600b0c06c70 2026-02-20T03:38:05.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6dfeffd640 10 client.21825 handle_command_reply: tid=0 2026-02-20T03:38:05.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 client.21825 shutdown 2026-02-20T03:38:05.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/2113482413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 msgr2=0x5600b0bfb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.719 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bfb330 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f6e38037000 tx=0x7f6e3802f260 comp rx=0 tx=0).stop 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/2113482413 shutdown_connections 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5600b0c06c70 0x5600b0c09130 crc :-1 s=READY pgs=589 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 0x5600b0c022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd17c0 0x5600b0bfb330 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/2113482413 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd0e80 0x5600b0bfadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/2113482413 >> 10.20.193.28:0/2113482413 conn(0x5600b0bc86f0 msgr2=0x5600b0bd7910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6dfeffd640 0 client.21825 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/2113482413 shutdown_connections 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/2113482413 wait complete. 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.717+0000 7f6e4e66ae00 20 client.21825 trim_cache size 0 max 16384 2026-02-20T03:38:05.727 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 Processor -- start 2026-02-20T03:38:05.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- start start 2026-02-20T03:38:05.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd0e80 0x5600b0bcf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd17c0 0x5600b0c02270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 0x5600b0bcf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6df0012720 con 0x5600b0bd0e80 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6df000ffc0 con 0x5600b0bd17c0 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6df000de10 con 0x5600b0bd6560 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e49580640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd0e80 0x5600b0bcf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e49580640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd0e80 0x5600b0bcf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48304/0 (socket says 10.20.193.28:48304) 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e49580640 1 -- 10.20.193.28:0/1633006671 learned_addr learned my addr 10.20.193.28:0/1633006671 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e49580640 1 -- 10.20.193.28:0/1633006671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 msgr2=0x5600b0bcf9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e49580640 1 --2- 10.20.193.28:0/1633006671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 0x5600b0bcf9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e49580640 1 -- 10.20.193.28:0/1633006671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd17c0 msgr2=0x5600b0c02270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e49580640 1 --2- 10.20.193.28:0/1633006671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd17c0 0x5600b0c02270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.730 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e49580640 1 -- 10.20.193.28:0/1633006671 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b0bf4370 con 0x5600b0bd0e80 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e49580640 1 --2- 10.20.193.28:0/1633006671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd0e80 0x5600b0bcf460 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009d50 tx=0x7f6e3400b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d7379e93b1a55 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e113fd640 1 -- 10.20.193.28:0/1633006671 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34016040 con 0x5600b0bd0e80 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e113fd640 1 -- 10.20.193.28:0/1633006671 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e34009350 con 0x5600b0bd0e80 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e113fd640 1 -- 10.20.193.28:0/1633006671 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34002d50 con 0x5600b0bd0e80 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/1633006671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd0e80 msgr2=0x5600b0bcf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/1633006671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd0e80 0x5600b0bcf460 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009d50 tx=0x7f6e3400b760 comp rx=0 tx=0).stop 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/1633006671 shutdown_connections 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/1633006671 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd6560 0x5600b0bcf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/1633006671 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd17c0 0x5600b0c02270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/1633006671 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd0e80 0x5600b0bcf460 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/1633006671 >> 10.20.193.28:0/1633006671 conn(0x5600b0bc86f0 msgr2=0x5600b0bced50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/1633006671 shutdown_connections 2026-02-20T03:38:05.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/1633006671 wait complete. 2026-02-20T03:38:05.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 -- start start 2026-02-20T03:38:05.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.722+0000 7f6e4e66ae00 1 Processor -- start 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd0e80 0x5600b0c01fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd17c0 0x5600b0c005f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd6560 0x5600b0c00b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6df000e480 con 0x5600b0bd6560 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6df000f8f0 con 0x5600b0bd17c0 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6df000eb50 con 0x5600b0bd0e80 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e49d81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd6560 0x5600b0c00b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e49d81640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd6560 0x5600b0c00b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:48306/0 (socket says 10.20.193.28:48306) 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e49d81640 1 -- 10.20.193.28:0/973913454 learned_addr learned my addr 10.20.193.28:0/973913454 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e49d81640 1 -- 10.20.193.28:0/973913454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd0e80 msgr2=0x5600b0c01fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e49d81640 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd0e80 0x5600b0c01fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.735 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e49d81640 1 -- 10.20.193.28:0/973913454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd17c0 msgr2=0x5600b0c005f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e49d81640 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd17c0 0x5600b0c005f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e49d81640 1 -- 10.20.193.28:0/973913454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b0881690 con 0x5600b0bd6560 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e49d81640 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd6560 0x5600b0c00b30 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f6e400a4d50 tx=0x7f6e400a7970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a7cda6a2bef099 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6dfeffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6dfeffd640 1 -- 10.20.193.28:0/973913454 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e400c8e60 con 0x5600b0bd6560 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6dfeffd640 1 -- 10.20.193.28:0/973913454 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6e4000cdc0 con 0x5600b0bd6560 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6dfeffd640 1 -- 10.20.193.28:0/973913454 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e400ddde0 con 0x5600b0bd6560 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/973913454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b0ae6b70 con 0x5600b0bd6560 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6dfeffd640 1 -- 10.20.193.28:0/973913454 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6e400ce1b0 con 0x5600b0bd6560 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6dfeffd640 10 client.21831 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 10 client.21831 _ll_register_callbacks cb 0x7f6e38009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:05.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/973913454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e34004480 con 0x5600b0bd6560 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6dfeffd640 1 -- 10.20.193.28:0/973913454 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6e4001c2f0 con 0x5600b0bd6560 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 10 client.21831 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/973913454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x5600b0bf5060 con 0x5600b0bd6560 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6dfeffd640 1 -- 10.20.193.28:0/973913454 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7f6e400ae2f0 con 0x5600b0bd6560 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 10 client.21831 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 10 client.21831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 20 client.21831 populate_metadata read hostname 'trial028' 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5600b0c72fb0 0x5600b0c75470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 4 client.21831 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:38:05.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.727+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/973913454 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5600b08fa520 con 0x5600b0c72fb0 2026-02-20T03:38:05.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 19.98 MB/sec execute 456 sec latency 36327.879 ms 2026-02-20T03:38:05.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.730+0000 7f6e49580640 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5600b0c72fb0 0x5600b0c75470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:05.759 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:05 trial028 ceph-mon[38552]: pgmap v888: 129 pgs: 129 active+clean; 789 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 588 KiB/s rd, 7.9 MiB/s wr, 453 op/s 2026-02-20T03:38:05.759 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:05 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:38:05.760 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:05 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:05.760 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:05 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:05.760 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:05 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:05.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.784+0000 7f6e49580640 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5600b0c72fb0 0x5600b0c75470 crc :-1 s=READY pgs=590 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=949df2cd48e9bbe4 server_cookie=26b5795e8d911bd2 in_seq=0 out_seq=0 2026-02-20T03:38:05.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.784+0000 7f6dfeffd640 10 client.21831 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6dfeffd640 1 -- 10.20.193.28:0/973913454 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5600b08fa520 con 0x5600b0c72fb0 2026-02-20T03:38:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6dfeffd640 10 client.21831 handle_command_reply: tid=0 2026-02-20T03:38:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 client.21831 shutdown 2026-02-20T03:38:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/973913454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd6560 msgr2=0x5600b0c00b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd6560 0x5600b0c00b30 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f6e400a4d50 tx=0x7f6e400a7970 comp rx=0 tx=0).stop 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/973913454 shutdown_connections 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5600b0c72fb0 0x5600b0c75470 crc :-1 s=READY pgs=590 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5600b0bd6560 0x5600b0c00b30 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5600b0bd17c0 0x5600b0c005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 --2- 10.20.193.28:0/973913454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5600b0bd0e80 0x5600b0c01fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/973913454 >> 10.20.193.28:0/973913454 conn(0x5600b0bc86f0 msgr2=0x5600b0bcf570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6dfeffd640 0 client.21831 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/973913454 shutdown_connections 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 1 -- 10.20.193.28:0/973913454 wait complete. 2026-02-20T03:38:05.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.865+0000 7f6e4e66ae00 20 client.21831 trim_cache size 0 max 16384 2026-02-20T03:38:05.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:38:05.880 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:38:05.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:38:05.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:38:05.881 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 -- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e200b0d80 msgr2=0x7f6e200b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e200b0d80 0x7f6e200b3240 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6e38002b60 tx=0x7f6e380023d0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 -- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e4410a900 msgr2=0x7f6e441a8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e4410a900 0x7f6e441a8670 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000b990 tx=0x7f6e4000be60 comp rx=0 tx=0).stop 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 -- 10.20.193.28:0/1979395227 shutdown_connections 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6e200b0d80 0x7f6e200b3240 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6e4410a900 0x7f6e441a8670 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6e44109e60 0x7f6e441a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 --2- 10.20.193.28:0/1979395227 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6e44109490 0x7f6e441a10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 -- 10.20.193.28:0/1979395227 >> 10.20.193.28:0/1979395227 conn(0x7f6e44077fe0 msgr2=0x7f6e4410d670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 -- 10.20.193.28:0/1979395227 shutdown_connections 2026-02-20T03:38:05.882 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:05.867+0000 7f6e4a582640 1 -- 10.20.193.28:0/1979395227 wait complete. 2026-02-20T03:38:05.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:05 trial177 ceph-mon[43181]: pgmap v888: 129 pgs: 129 active+clean; 789 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 588 KiB/s rd, 7.9 MiB/s wr, 453 op/s 2026-02-20T03:38:05.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:05 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:38:05.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:05 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:05.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:05 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:05.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:05 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:06.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:05 trial126 ceph-mon[38476]: pgmap v888: 129 pgs: 129 active+clean; 789 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 588 KiB/s rd, 7.9 MiB/s wr, 453 op/s 2026-02-20T03:38:06.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:05 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:38:06.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:05 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:06.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:05 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:06.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:05 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:06.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229966 19.94 MB/sec execute 457 sec latency 37327.912 ms 2026-02-20T03:38:07.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.89 MB/sec execute 458 sec latency 38327.969 ms 2026-02-20T03:38:07.869 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:07 trial028 ceph-mon[38552]: pgmap v889: 129 pgs: 129 active+clean; 792 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 171 KiB/s rd, 7.0 MiB/s wr, 384 op/s 2026-02-20T03:38:07.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:07 trial177 ceph-mon[43181]: pgmap v889: 129 pgs: 129 active+clean; 792 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 171 KiB/s rd, 7.0 MiB/s wr, 384 op/s 2026-02-20T03:38:08.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:07 trial126 ceph-mon[38476]: pgmap v889: 129 pgs: 129 active+clean; 792 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 171 KiB/s rd, 7.0 MiB/s wr, 384 op/s 2026-02-20T03:38:08.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.85 MB/sec execute 459 sec latency 39328.009 ms 2026-02-20T03:38:09.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.81 MB/sec execute 460 sec latency 40328.050 ms 2026-02-20T03:38:09.750 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:09 trial028 ceph-mon[38552]: pgmap v890: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 63 KiB/s rd, 5.2 MiB/s wr, 236 op/s 2026-02-20T03:38:09.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:09 trial177 ceph-mon[43181]: pgmap v890: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 63 KiB/s rd, 5.2 MiB/s wr, 236 op/s 2026-02-20T03:38:10.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:09 trial126 ceph-mon[38476]: pgmap v890: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 63 KiB/s rd, 5.2 MiB/s wr, 236 op/s 2026-02-20T03:38:10.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.77 MB/sec execute 461 sec latency 41328.097 ms 2026-02-20T03:38:10.804 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:10 trial028 ceph-mon[38552]: pgmap v891: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 82 KiB/s rd, 3.7 MiB/s wr, 157 op/s 2026-02-20T03:38:10.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:10 trial177 ceph-mon[43181]: pgmap v891: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 82 KiB/s rd, 3.7 MiB/s wr, 157 op/s 2026-02-20T03:38:11.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:10 trial126 ceph-mon[38476]: pgmap v891: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 82 KiB/s rd, 3.7 MiB/s wr, 157 op/s 2026-02-20T03:38:11.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.72 MB/sec execute 462 sec latency 42328.132 ms 2026-02-20T03:38:12.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.68 MB/sec execute 463 sec latency 43328.175 ms 2026-02-20T03:38:13.457 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:13 trial028 ceph-mon[38552]: pgmap v892: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 2.2 MiB/s wr, 110 op/s 2026-02-20T03:38:13.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:13 trial177 ceph-mon[43181]: pgmap v892: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 2.2 MiB/s wr, 110 op/s 2026-02-20T03:38:13.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.64 MB/sec execute 464 sec latency 44328.236 ms 2026-02-20T03:38:13.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:13 trial126 ceph-mon[38476]: pgmap v892: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 2.2 MiB/s wr, 110 op/s 2026-02-20T03:38:14.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.60 MB/sec execute 465 sec latency 45328.287 ms 2026-02-20T03:38:15.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:15 trial028 ceph-mon[38552]: pgmap v893: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 1.1 MiB/s wr, 94 op/s 2026-02-20T03:38:15.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.55 MB/sec execute 466 sec latency 46328.328 ms 2026-02-20T03:38:15.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:15 trial126 ceph-mon[38476]: pgmap v893: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 1.1 MiB/s wr, 94 op/s 2026-02-20T03:38:15.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:15 trial177 ceph-mon[43181]: pgmap v893: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 66 KiB/s rd, 1.1 MiB/s wr, 94 op/s 2026-02-20T03:38:16.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.51 MB/sec execute 467 sec latency 47328.382 ms 2026-02-20T03:38:17.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:17 trial028 ceph-mon[38552]: pgmap v894: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 68 KiB/s rd, 273 KiB/s wr, 82 op/s 2026-02-20T03:38:17.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.47 MB/sec execute 468 sec latency 48328.415 ms 2026-02-20T03:38:17.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:17 trial126 ceph-mon[38476]: pgmap v894: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 68 KiB/s rd, 273 KiB/s wr, 82 op/s 2026-02-20T03:38:17.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:17 trial177 ceph-mon[43181]: pgmap v894: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 68 KiB/s rd, 273 KiB/s wr, 82 op/s 2026-02-20T03:38:18.526 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:38:18.526 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:38:18.526 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:18 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:38:18.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.43 MB/sec execute 469 sec latency 49328.452 ms 2026-02-20T03:38:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:38:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:38:18.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:18 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:38:18.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.943+0000 7f67fc8f4640 1 -- 10.20.193.28:0/70311499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109e60 msgr2=0x7f67f810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:18.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.943+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/70311499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109e60 0x7f67f810a2e0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009a30 tx=0x7f67e002f260 comp rx=0 tx=0).stop 2026-02-20T03:38:18.946 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.943+0000 7f67fc8f4640 1 -- 10.20.193.28:0/70311499 shutdown_connections 2026-02-20T03:38:18.947 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.943+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/70311499 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f67f810a900 0x7f67f8111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.947 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.943+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/70311499 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109e60 0x7f67f810a2e0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.943+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/70311499 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f67f8109490 0x7f67f8109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.943+0000 7f67fc8f4640 1 -- 10.20.193.28:0/70311499 >> 10.20.193.28:0/70311499 conn(0x7f67f8077fe0 msgr2=0x7f67f807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:18.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.943+0000 7f67fc8f4640 1 -- 10.20.193.28:0/70311499 shutdown_connections 2026-02-20T03:38:18.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.943+0000 7f67fc8f4640 1 -- 10.20.193.28:0/70311499 wait complete. 2026-02-20T03:38:18.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67fc8f4640 1 Processor -- start 2026-02-20T03:38:18.948 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67fc8f4640 1 -- start start 2026-02-20T03:38:18.949 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67fc8f4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109490 0x7f67f81a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.949 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67fc8f4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f67f8109e60 0x7f67f81a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.949 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67fc8f4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f67f810a900 0x7f67f81a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.949 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67fc8f4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f67f8114a50 con 0x7f67f8109490 2026-02-20T03:38:18.949 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67fc8f4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f67f81148d0 con 0x7f67f810a900 2026-02-20T03:38:18.949 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67fc8f4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f67f8114bd0 con 0x7f67f8109e60 2026-02-20T03:38:18.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109490 0x7f67f81a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:18.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109490 0x7f67f81a10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33302/0 (socket says 10.20.193.28:33302) 2026-02-20T03:38:18.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67f6d76640 1 -- 10.20.193.28:0/2362887941 learned_addr learned my addr 10.20.193.28:0/2362887941 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:18.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67f6d76640 1 -- 10.20.193.28:0/2362887941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f67f8109e60 msgr2=0x7f67f81a1600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:18.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67f6d76640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f67f8109e60 0x7f67f81a1600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67f6d76640 1 -- 10.20.193.28:0/2362887941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f67f810a900 msgr2=0x7f67f81a8670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:18.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.944+0000 7f67f6d76640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f67f810a900 0x7f67f81a8670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.945+0000 7f67f6d76640 1 -- 10.20.193.28:0/2362887941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f81a8d70 con 0x7f67f8109490 2026-02-20T03:38:18.955 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.945+0000 7f67f6d76640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109490 0x7f67f81a10c0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00b750 tx=0x7f67ec00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.945+0000 7f67d7fff640 1 -- 10.20.193.28:0/2362887941 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec004480 con 0x7f67f8109490 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.945+0000 7f67d7fff640 1 -- 10.20.193.28:0/2362887941 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f67ec010070 con 0x7f67f8109490 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.945+0000 7f67d7fff640 1 -- 10.20.193.28:0/2362887941 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec00ca90 con 0x7f67f8109490 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.945+0000 7f67fc8f4640 1 -- 10.20.193.28:0/2362887941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f81a9060 con 0x7f67f8109490 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.945+0000 7f67fc8f4640 1 -- 10.20.193.28:0/2362887941 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f81a95e0 con 0x7f67f8109490 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.945+0000 7f67d7fff640 1 -- 10.20.193.28:0/2362887941 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f67ec01d030 con 0x7f67f8109490 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.945+0000 7f680002ce00 1 Processor -- start 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 -- start start 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666be80 0x56015666c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015666c7c0 0x560156670f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560156671560 0x5601566739f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.956 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5601565bc8f0 con 0x560156671560 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56015656a2e0 con 0x56015666be80 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5601565b8820 con 0x56015666c7c0 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67f6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560156671560 0x5601566739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67f6575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560156671560 0x5601566739f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33314/0 (socket says 10.20.193.28:33314) 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67f6575640 1 -- 10.20.193.28:0/4120740561 learned_addr learned my addr 10.20.193.28:0/4120740561 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67f6575640 1 -- 10.20.193.28:0/4120740561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015666c7c0 msgr2=0x560156670f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67f6575640 1 --2- 10.20.193.28:0/4120740561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015666c7c0 0x560156670f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67f6575640 1 -- 10.20.193.28:0/4120740561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666be80 msgr2=0x56015666c280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67f6575640 1 --2- 10.20.193.28:0/4120740561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666be80 0x56015666c280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67f6575640 1 -- 10.20.193.28:0/4120740561 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015655c5a0 con 0x560156671560 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67f6575640 1 --2- 10.20.193.28:0/4120740561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560156671560 0x5601566739f0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f67e002f770 tx=0x7f67e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd293d89c86c371d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:18.957 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67d53fe640 1 -- 10.20.193.28:0/4120740561 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0038530 con 0x560156671560 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67d53fe640 1 -- 10.20.193.28:0/4120740561 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f67e0033040 con 0x560156671560 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67d53fe640 1 -- 10.20.193.28:0/4120740561 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0004500 con 0x560156671560 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67d7fff640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f67cc0b0e20 0x7f67cc0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 -- 10.20.193.28:0/4120740561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560156671560 msgr2=0x5601566739f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 --2- 10.20.193.28:0/4120740561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560156671560 0x5601566739f0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f67e002f770 tx=0x7f67e0005880 comp rx=0 tx=0).stop 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f67d7fff640 1 -- 10.20.193.28:0/2362887941 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f67ec0df8e0 con 0x7f67f8109490 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 -- 10.20.193.28:0/4120740561 shutdown_connections 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 --2- 10.20.193.28:0/4120740561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x560156671560 0x5601566739f0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 --2- 10.20.193.28:0/4120740561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015666c7c0 0x560156670f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 --2- 10.20.193.28:0/4120740561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666be80 0x56015666c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.958 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.948+0000 7f680002ce00 1 -- 10.20.193.28:0/4120740561 >> 10.20.193.28:0/4120740561 conn(0x5601566636f0 msgr2=0x56015666a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.950+0000 7f67f7577640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f67cc0b0e20 0x7f67cc0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.950+0000 7f680002ce00 1 -- 10.20.193.28:0/4120740561 shutdown_connections 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.950+0000 7f680002ce00 1 -- 10.20.193.28:0/4120740561 wait complete. 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.950+0000 7f67f7577640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f67cc0b0e20 0x7f67cc0b32e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f67e800aab0 tx=0x7f67e8009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.950+0000 7f680002ce00 1 -- start start 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f680002ce00 1 Processor -- start 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f680002ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666be80 0x5601566849b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f680002ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666c7c0 0x560156684ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f680002ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560156671560 0x56015668be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f680002ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5601565640c0 con 0x56015666be80 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f680002ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5601566745b0 con 0x56015666c7c0 2026-02-20T03:38:18.959 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f680002ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56015668c400 con 0x560156671560 2026-02-20T03:38:18.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666be80 0x5601566849b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:18.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666be80 0x5601566849b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33320/0 (socket says 10.20.193.28:33320) 2026-02-20T03:38:18.960 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67f6d76640 1 -- 10.20.193.28:0/20897177 learned_addr learned my addr 10.20.193.28:0/20897177 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:18.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67f6d76640 1 -- 10.20.193.28:0/20897177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560156671560 msgr2=0x56015668be70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:18.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67f6d76640 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560156671560 0x56015668be70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67f6d76640 1 -- 10.20.193.28:0/20897177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666c7c0 msgr2=0x560156684ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:18.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67f6d76640 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666c7c0 0x560156684ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:18.962 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67f6d76640 1 -- 10.20.193.28:0/20897177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015667e0d0 con 0x56015666be80 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67f6d76640 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666be80 0x5601566849b0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0a72c0 tx=0x7f67ec0a7cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3891d3b2f9afd1d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67c0bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67c0bfc640 1 -- 10.20.193.28:0/20897177 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec012d90 con 0x56015666be80 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67c0bfc640 1 -- 10.20.193.28:0/20897177 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f67ec0acb00 con 0x56015666be80 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.951+0000 7f67c0bfc640 1 -- 10.20.193.28:0/20897177 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0a2f40 con 0x56015666be80 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 1 -- 10.20.193.28:0/20897177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560156578820 con 0x56015666be80 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f67c0bfc640 1 -- 10.20.193.28:0/20897177 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f67ec0a6040 con 0x56015666be80 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 10 client.21843 _ll_register_callbacks cb 0x560156567ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 1 -- 10.20.193.28:0/20897177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5601565c44e0 con 0x56015666be80 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f67c0bfc640 1 -- 10.20.193.28:0/20897177 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f67ec0a1b00 con 0x56015666be80 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 10 client.21843 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:18.963 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 1 -- 10.20.193.28:0/20897177 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x56015657d380 con 0x56015666be80 2026-02-20T03:38:18.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f67c0bfc640 1 -- 10.20.193.28:0/20897177 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7f67ec0a6260 con 0x56015666be80 2026-02-20T03:38:18.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 10 client.21843 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:18.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 10 client.21843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:18.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 20 client.21843 populate_metadata read hostname 'trial028' 2026-02-20T03:38:18.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560156690780 0x560156692c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:18.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 4 client.21843 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:18.964 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.952+0000 7f680002ce00 1 -- 10.20.193.28:0/20897177 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56015653ebd0 con 0x560156690780 2026-02-20T03:38:18.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:38:18.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:38:18.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:18 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:38:18.979 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:18.977+0000 7f67f6575640 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560156690780 0x560156692c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:19.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.030+0000 7f67f6575640 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560156690780 0x560156692c20 crc :-1 s=READY pgs=591 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cc0f3ed0c9a2f3f server_cookie=2de432b309e8f31d in_seq=0 out_seq=0 2026-02-20T03:38:19.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.030+0000 7f67c0bfc640 10 client.21843 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:19.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.057+0000 7f67c0bfc640 1 -- 10.20.193.28:0/20897177 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56015653ebd0 con 0x560156690780 2026-02-20T03:38:19.059 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.057+0000 7f67c0bfc640 10 client.21843 handle_command_reply: tid=0 2026-02-20T03:38:19.060 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.057+0000 7f680002ce00 1 client.21843 shutdown 2026-02-20T03:38:19.060 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.057+0000 7f680002ce00 1 -- 10.20.193.28:0/20897177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666be80 msgr2=0x5601566849b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:19.060 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.057+0000 7f680002ce00 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666be80 0x5601566849b0 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0a72c0 tx=0x7f67ec0a7cc0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f680002ce00 1 -- 10.20.193.28:0/20897177 shutdown_connections 2026-02-20T03:38:19.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f680002ce00 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560156690780 0x560156692c20 crc :-1 s=READY pgs=591 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f680002ce00 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x560156671560 0x56015668be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f680002ce00 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666c7c0 0x560156684ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.061 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f680002ce00 1 --2- 10.20.193.28:0/20897177 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666be80 0x5601566849b0 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f680002ce00 1 -- 10.20.193.28:0/20897177 >> 10.20.193.28:0/20897177 conn(0x5601566636f0 msgr2=0x560156672870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:19.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f67c0bfc640 0 client.21843 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:19.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f680002ce00 1 -- 10.20.193.28:0/20897177 shutdown_connections 2026-02-20T03:38:19.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f680002ce00 1 -- 10.20.193.28:0/20897177 wait complete. 2026-02-20T03:38:19.062 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.058+0000 7f680002ce00 20 client.21843 trim_cache size 0 max 16384 2026-02-20T03:38:19.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 Processor -- start 2026-02-20T03:38:19.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- start start 2026-02-20T03:38:19.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601566636f0 0x560156672950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:19.070 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666be80 0x56015668be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666c7c0 0x560156669d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0126d0 con 0x56015666c7c0 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f679c00ff70 con 0x56015666be80 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f679c00ddc0 con 0x5601566636f0 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f7577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666c7c0 0x560156669d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f7577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666c7c0 0x560156669d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33328/0 (socket says 10.20.193.28:33328) 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f7577640 1 -- 10.20.193.28:0/4015018554 learned_addr learned my addr 10.20.193.28:0/4015018554 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f7577640 1 -- 10.20.193.28:0/4015018554 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601566636f0 msgr2=0x560156672950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f7577640 1 --2- 10.20.193.28:0/4015018554 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601566636f0 0x560156672950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f7577640 1 -- 10.20.193.28:0/4015018554 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666be80 msgr2=0x56015668be30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f7577640 1 --2- 10.20.193.28:0/4015018554 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666be80 0x56015668be30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.071 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f7577640 1 -- 10.20.193.28:0/4015018554 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015667df00 con 0x56015666c7c0 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f7577640 1 --2- 10.20.193.28:0/4015018554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666c7c0 0x560156669d50 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f67e800cc40 tx=0x7f67e800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5b44a3d28326b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67d4bfd640 1 -- 10.20.193.28:0/4015018554 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8006e60 con 0x56015666c7c0 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67d4bfd640 1 -- 10.20.193.28:0/4015018554 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f67e801f020 con 0x56015666c7c0 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67d4bfd640 1 -- 10.20.193.28:0/4015018554 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e800d680 con 0x56015666c7c0 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- 10.20.193.28:0/4015018554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666c7c0 msgr2=0x560156669d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- 10.20.193.28:0/4015018554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666c7c0 0x560156669d50 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f67e800cc40 tx=0x7f67e800f000 comp rx=0 tx=0).stop 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- 10.20.193.28:0/4015018554 shutdown_connections 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- 10.20.193.28:0/4015018554 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56015666c7c0 0x560156669d50 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- 10.20.193.28:0/4015018554 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666be80 0x56015668be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- 10.20.193.28:0/4015018554 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5601566636f0 0x560156672950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.072 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- 10.20.193.28:0/4015018554 >> 10.20.193.28:0/4015018554 conn(0x5601566850f0 msgr2=0x560156683770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:19.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- 10.20.193.28:0/4015018554 shutdown_connections 2026-02-20T03:38:19.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- 10.20.193.28:0/4015018554 wait complete. 2026-02-20T03:38:19.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- start start 2026-02-20T03:38:19.075 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 Processor -- start 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601566636f0 0x56015668bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015666be80 0x5601566887f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666c7c0 0x560156688d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f679c00e430 con 0x5601566636f0 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f679c00f8a0 con 0x56015666c7c0 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f679c00eb00 con 0x56015666be80 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601566636f0 0x56015668bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f6d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601566636f0 0x56015668bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:33332/0 (socket says 10.20.193.28:33332) 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f6d76640 1 -- 10.20.193.28:0/3919091436 learned_addr learned my addr 10.20.193.28:0/3919091436 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f6d76640 1 -- 10.20.193.28:0/3919091436 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015666be80 msgr2=0x5601566887f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f6d76640 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015666be80 0x5601566887f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.076 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f6d76640 1 -- 10.20.193.28:0/3919091436 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666c7c0 msgr2=0x560156688d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f6d76640 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666c7c0 0x560156688d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f6d76640 1 -- 10.20.193.28:0/3919091436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56015631c690 con 0x5601566636f0 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67f6d76640 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601566636f0 0x56015668bd20 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0a7400 tx=0x7f67ec0b08e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6057d107c95aedbc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67c0bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67c0bfc640 1 -- 10.20.193.28:0/3919091436 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0c83b0 con 0x5601566636f0 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67c0bfc640 1 -- 10.20.193.28:0/3919091436 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5601565c44e0 con 0x5601566636f0 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67c0bfc640 1 -- 10.20.193.28:0/3919091436 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0affa0 con 0x5601566636f0 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- 10.20.193.28:0/3919091436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560156581b70 con 0x5601566636f0 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67c0bfc640 1 -- 10.20.193.28:0/3919091436 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f67ec0b0a70 con 0x5601566636f0 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f67c0bfc640 10 client.21849 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 10 client.21849 _ll_register_callbacks cb 0x7f67ec0a6ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:19.077 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.064+0000 7f680002ce00 1 -- 10.20.193.28:0/3919091436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67e0033040 con 0x5601566636f0 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f67c0bfc640 1 -- 10.20.193.28:0/3919091436 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f67ec0b0140 con 0x5601566636f0 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f680002ce00 10 client.21849 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f680002ce00 1 -- 10.20.193.28:0/3919091436 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x56015667ebf0 con 0x5601566636f0 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f67c0bfc640 1 -- 10.20.193.28:0/3919091436 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7f67ec0a6040 con 0x5601566636f0 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f680002ce00 10 client.21849 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f680002ce00 10 client.21849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f680002ce00 20 client.21849 populate_metadata read hostname 'trial028' 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f680002ce00 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560156671560 0x5601566feae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f680002ce00 4 client.21849 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:38:19.078 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.069+0000 7f680002ce00 1 -- 10.20.193.28:0/3919091436 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560156395520 con 0x560156671560 2026-02-20T03:38:19.086 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.084+0000 7f67f6575640 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560156671560 0x5601566feae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:19.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.151+0000 7f67f6575640 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560156671560 0x5601566feae0 crc :-1 s=READY pgs=592 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c96229a171b10c3e server_cookie=59d8ead178de77d1 in_seq=0 out_seq=0 2026-02-20T03:38:19.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.151+0000 7f67c0bfc640 10 client.21849 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:19.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67c0bfc640 1 -- 10.20.193.28:0/3919091436 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560156395520 con 0x560156671560 2026-02-20T03:38:19.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67c0bfc640 10 client.21849 handle_command_reply: tid=0 2026-02-20T03:38:19.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 client.21849 shutdown 2026-02-20T03:38:19.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 -- 10.20.193.28:0/3919091436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601566636f0 msgr2=0x56015668bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:19.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601566636f0 0x56015668bd20 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0a7400 tx=0x7f67ec0b08e0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 -- 10.20.193.28:0/3919091436 shutdown_connections 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x560156671560 0x5601566feae0 crc :-1 s=READY pgs=592 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56015666c7c0 0x560156688d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56015666be80 0x5601566887f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 --2- 10.20.193.28:0/3919091436 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5601566636f0 0x56015668bd20 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67c0bfc640 0 client.21849 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 -- 10.20.193.28:0/3919091436 >> 10.20.193.28:0/3919091436 conn(0x5601566850f0 msgr2=0x560156671940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 -- 10.20.193.28:0/3919091436 shutdown_connections 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 1 -- 10.20.193.28:0/3919091436 wait complete. 2026-02-20T03:38:19.194 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f680002ce00 20 client.21849 trim_cache size 0 max 16384 2026-02-20T03:38:19.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:38:19.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:38:19.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:38:19.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:38:19.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 -- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f67cc0b0e20 msgr2=0x7f67cc0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:19.206 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f67cc0b0e20 0x7f67cc0b32e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f67e800aab0 tx=0x7f67e8009250 comp rx=0 tx=0).stop 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 -- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109490 msgr2=0x7f67f81a10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109490 0x7f67f81a10c0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f67ec00b750 tx=0x7f67ec00bc20 comp rx=0 tx=0).stop 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 -- 10.20.193.28:0/2362887941 shutdown_connections 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f67cc0b0e20 0x7f67cc0b32e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f67f810a900 0x7f67f81a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f67f8109e60 0x7f67f81a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 --2- 10.20.193.28:0/2362887941 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f67f8109490 0x7f67f81a10c0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 -- 10.20.193.28:0/2362887941 >> 10.20.193.28:0/2362887941 conn(0x7f67f8077fe0 msgr2=0x7f67f810d670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 -- 10.20.193.28:0/2362887941 shutdown_connections 2026-02-20T03:38:19.207 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:19.191+0000 7f67fc8f4640 1 -- 10.20.193.28:0/2362887941 wait complete. 2026-02-20T03:38:19.595 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:19 trial028 ceph-mon[38552]: pgmap v895: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 12 KiB/s wr, 48 op/s 2026-02-20T03:38:19.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.39 MB/sec execute 470 sec latency 50328.492 ms 2026-02-20T03:38:19.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:19 trial126 ceph-mon[38476]: pgmap v895: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 12 KiB/s wr, 48 op/s 2026-02-20T03:38:19.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:19 trial177 ceph-mon[43181]: pgmap v895: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 40 KiB/s rd, 12 KiB/s wr, 48 op/s 2026-02-20T03:38:20.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.35 MB/sec execute 471 sec latency 51328.527 ms 2026-02-20T03:38:21.732 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.30 MB/sec execute 472 sec latency 52328.568 ms 2026-02-20T03:38:21.769 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:21 trial028 ceph-mon[38552]: pgmap v896: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 30 op/s 2026-02-20T03:38:21.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:21 trial126 ceph-mon[38476]: pgmap v896: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 30 op/s 2026-02-20T03:38:21.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:21 trial177 ceph-mon[43181]: pgmap v896: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 24 KiB/s rd, 11 KiB/s wr, 30 op/s 2026-02-20T03:38:22.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.26 MB/sec execute 473 sec latency 52745.416 ms 2026-02-20T03:38:23.674 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:23 trial028 ceph-mon[38552]: pgmap v897: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2026-02-20T03:38:23.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.22 MB/sec execute 474 sec latency 53745.456 ms 2026-02-20T03:38:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:23 trial126 ceph-mon[38476]: pgmap v897: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2026-02-20T03:38:23.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:23 trial177 ceph-mon[43181]: pgmap v897: 129 pgs: 129 active+clean; 788 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2026-02-20T03:38:24.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.18 MB/sec execute 475 sec latency 54745.497 ms 2026-02-20T03:38:25.588 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:25 trial028 ceph-mon[38552]: pgmap v898: 129 pgs: 129 active+clean; 783 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 7.2 KiB/s wr, 15 op/s 2026-02-20T03:38:25.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.14 MB/sec execute 476 sec latency 55745.537 ms 2026-02-20T03:38:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:25 trial126 ceph-mon[38476]: pgmap v898: 129 pgs: 129 active+clean; 783 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 7.2 KiB/s wr, 15 op/s 2026-02-20T03:38:25.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:25 trial177 ceph-mon[43181]: pgmap v898: 129 pgs: 129 active+clean; 783 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 7.2 KiB/s wr, 15 op/s 2026-02-20T03:38:26.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.10 MB/sec execute 477 sec latency 56745.578 ms 2026-02-20T03:38:27.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.06 MB/sec execute 478 sec latency 57745.628 ms 2026-02-20T03:38:27.741 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:27 trial028 ceph-mon[38552]: pgmap v899: 129 pgs: 129 active+clean; 768 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 39 op/s 2026-02-20T03:38:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:27 trial126 ceph-mon[38476]: pgmap v899: 129 pgs: 129 active+clean; 768 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 39 op/s 2026-02-20T03:38:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:27 trial177 ceph-mon[43181]: pgmap v899: 129 pgs: 129 active+clean; 768 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 39 op/s 2026-02-20T03:38:28.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 19.02 MB/sec execute 479 sec latency 58745.662 ms 2026-02-20T03:38:29.610 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:29 trial028 ceph-mon[38552]: pgmap v900: 129 pgs: 129 active+clean; 756 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 56 op/s 2026-02-20T03:38:29.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.98 MB/sec execute 480 sec latency 59745.695 ms 2026-02-20T03:38:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:29 trial126 ceph-mon[38476]: pgmap v900: 129 pgs: 129 active+clean; 756 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 56 op/s 2026-02-20T03:38:29.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:29 trial177 ceph-mon[43181]: pgmap v900: 129 pgs: 129 active+clean; 756 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 56 op/s 2026-02-20T03:38:30.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.94 MB/sec execute 481 sec latency 60745.738 ms 2026-02-20T03:38:31.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.90 MB/sec execute 482 sec latency 61745.771 ms 2026-02-20T03:38:31.758 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:31 trial028 ceph-mon[38552]: pgmap v901: 129 pgs: 129 active+clean; 748 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 76 op/s 2026-02-20T03:38:31.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:31 trial177 ceph-mon[43181]: pgmap v901: 129 pgs: 129 active+clean; 748 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 76 op/s 2026-02-20T03:38:32.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:31 trial126 ceph-mon[38476]: pgmap v901: 129 pgs: 129 active+clean; 748 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 76 op/s 2026-02-20T03:38:32.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- 10.20.193.28:0/2200409047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 msgr2=0x7f1dc0104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:32.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 --2- 10.20.193.28:0/2200409047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 0x7f1dc0104d40 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009a30 tx=0x7f1dac02f260 comp rx=0 tx=0).stop 2026-02-20T03:38:32.271 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- 10.20.193.28:0/2200409047 shutdown_connections 2026-02-20T03:38:32.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 --2- 10.20.193.28:0/2200409047 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1dc01064f0 0x7f1dc010cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 --2- 10.20.193.28:0/2200409047 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1dc0105b30 0x7f1dc0105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 --2- 10.20.193.28:0/2200409047 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 0x7f1dc0104d40 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.272 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- 10.20.193.28:0/2200409047 >> 10.20.193.28:0/2200409047 conn(0x7f1dc01000c0 msgr2=0x7f1dc01024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:32.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- 10.20.193.28:0/2200409047 shutdown_connections 2026-02-20T03:38:32.273 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- 10.20.193.28:0/2200409047 wait complete. 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 Processor -- start 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- start start 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 0x7f1dc019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1dc0105b30 0x7f1dc019d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1dc01064f0 0x7f1dc01a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc0110550 con 0x7f1dc0104940 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc01103d0 con 0x7f1dc0105b30 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc01106d0 con 0x7f1dc01064f0 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 0x7f1dc019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 0x7f1dc019cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56948/0 (socket says 10.20.193.28:56948) 2026-02-20T03:38:32.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbffff640 1 -- 10.20.193.28:0/3452385925 learned_addr learned my addr 10.20.193.28:0/3452385925 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:32.281 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbffff640 1 -- 10.20.193.28:0/3452385925 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1dc01064f0 msgr2=0x7f1dc01a4170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbffff640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1dc01064f0 0x7f1dc01a4170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbffff640 1 -- 10.20.193.28:0/3452385925 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1dc0105b30 msgr2=0x7f1dc019d100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbffff640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1dc0105b30 0x7f1dc019d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbffff640 1 -- 10.20.193.28:0/3452385925 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc01a4870 con 0x7f1dc0104940 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbffff640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 0x7f1dc019cbc0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009950 tx=0x7f1dac02fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbd7fa640 1 -- 10.20.193.28:0/3452385925 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac004240 con 0x7f1dc0104940 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbd7fa640 1 -- 10.20.193.28:0/3452385925 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1dac0043e0 con 0x7f1dc0104940 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dbd7fa640 1 -- 10.20.193.28:0/3452385925 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac042b30 con 0x7f1dc0104940 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.268+0000 7f1dc5061640 1 -- 10.20.193.28:0/3452385925 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc01a4b00 con 0x7f1dc0104940 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.271+0000 7f1dc5061640 1 -- 10.20.193.28:0/3452385925 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc01a5020 con 0x7f1dc0104940 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.271+0000 7f1dc9223e00 1 Processor -- start 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.271+0000 7f1dbd7fa640 1 -- 10.20.193.28:0/3452385925 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1dac042cd0 con 0x7f1dc0104940 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 -- start start 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a8fc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a900f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a901560 0x55fd6a9039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd6a84c8f0 con 0x55fd6a8fbe80 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fd6a7fa2e0 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd6a848820 con 0x55fd6a901560 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a8fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a8fc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56964/0 (socket says 10.20.193.28:56964) 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 -- 10.20.193.28:0/2448334622 learned_addr learned my addr 10.20.193.28:0/2448334622 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 -- 10.20.193.28:0/2448334622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a901560 msgr2=0x55fd6a9039f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 --2- 10.20.193.28:0/2448334622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a901560 0x55fd6a9039f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 -- 10.20.193.28:0/2448334622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fc7c0 msgr2=0x55fd6a900f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 --2- 10.20.193.28:0/2448334622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a900f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 -- 10.20.193.28:0/2448334622 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd6a7ec5a0 con 0x55fd6a8fbe80 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 --2- 10.20.193.28:0/2448334622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a8fc280 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009d20 tx=0x7f1db400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b06bd8a22f2c20a server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1d83fff640 1 -- 10.20.193.28:0/2448334622 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4017070 con 0x55fd6a8fbe80 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1d83fff640 1 -- 10.20.193.28:0/2448334622 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1db400bd50 con 0x55fd6a8fbe80 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1d83fff640 1 -- 10.20.193.28:0/2448334622 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4006e60 con 0x55fd6a8fbe80 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 -- 10.20.193.28:0/2448334622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 msgr2=0x55fd6a8fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/2448334622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a8fc280 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009d20 tx=0x7f1db400b420 comp rx=0 tx=0).stop 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 -- 10.20.193.28:0/2448334622 shutdown_connections 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/2448334622 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a901560 0x55fd6a9039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/2448334622 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a900f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/2448334622 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a8fc280 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.282 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 -- 10.20.193.28:0/2448334622 >> 10.20.193.28:0/2448334622 conn(0x55fd6a8f36f0 msgr2=0x55fd6a8fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 -- 10.20.193.28:0/2448334622 shutdown_connections 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc9223e00 1 -- 10.20.193.28:0/2448334622 wait complete. 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dbd7fa640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1d940b0d80 0x7f1d940b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dbd7fa640 1 -- 10.20.193.28:0/3452385925 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f1dac1053b0 con 0x7f1dc0104940 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1d940b0d80 0x7f1d940b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.274+0000 7f1dc4860640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1d940b0d80 0x7f1d940b3240 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009b30 tx=0x7f1db40098b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 -- start start 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 Processor -- start 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a914cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a9151f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a901560 0x55fd6a91c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55fd6a7f40c0 con 0x55fd6a8fbe80 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55fd6a904610 con 0x55fd6a901560 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55fd6a91c700 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a914cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dbffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a914cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56972/0 (socket says 10.20.193.28:56972) 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dbffff640 1 -- 10.20.193.28:0/1258224291 learned_addr learned my addr 10.20.193.28:0/1258224291 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dbffff640 1 -- 10.20.193.28:0/1258224291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a8fc7c0 msgr2=0x55fd6a9151f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dbffff640 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a9151f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dbffff640 1 -- 10.20.193.28:0/1258224291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a901560 msgr2=0x55fd6a91c170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dbffff640 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a901560 0x55fd6a91c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dbffff640 1 -- 10.20.193.28:0/1258224291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd6a90e210 con 0x55fd6a8fbe80 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dbffff640 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a914cb0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f1dac105650 tx=0x7f1dac0ccf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10df563d29b07797 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1d817fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1d817fa640 1 -- 10.20.193.28:0/1258224291 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac1051b0 con 0x55fd6a8fbe80 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1d817fa640 1 -- 10.20.193.28:0/1258224291 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1dac033030 con 0x55fd6a8fbe80 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1d817fa640 1 -- 10.20.193.28:0/1258224291 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0cc300 con 0x55fd6a8fbe80 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 -- 10.20.193.28:0/1258224291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd6a808820 con 0x55fd6a8fbe80 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 10 client.21861 _ll_register_callbacks cb 0x55fd6a7f7ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 -- 10.20.193.28:0/1258224291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd6a8544e0 con 0x55fd6a8fbe80 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1d817fa640 1 -- 10.20.193.28:0/1258224291 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f1dac0b91e0 con 0x55fd6a8fbe80 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1d817fa640 1 -- 10.20.193.28:0/1258224291 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1dac0c87b0 con 0x55fd6a8fbe80 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 10 client.21861 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:32.283 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 -- 10.20.193.28:0/1258224291 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55fd6a80d380 con 0x55fd6a8fbe80 2026-02-20T03:38:32.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1d817fa640 1 -- 10.20.193.28:0/1258224291 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7f1dac0c8950 con 0x55fd6a8fbe80 2026-02-20T03:38:32.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 10 client.21861 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:32.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 10 client.21861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:32.291 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 20 client.21861 populate_metadata read hostname 'trial028' 2026-02-20T03:38:32.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd6a9209e0 0x55fd6a922ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 4 client.21861 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:32.292 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.276+0000 7f1dc9223e00 1 -- 10.20.193.28:0/1258224291 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd6a7cebd0 con 0x55fd6a9209e0 2026-02-20T03:38:32.305 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.303+0000 7f1dbf7fe640 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd6a9209e0 0x55fd6a922ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:32.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.370+0000 7f1dbf7fe640 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd6a9209e0 0x55fd6a922ea0 crc :-1 s=READY pgs=593 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c5820d24a47a043 server_cookie=17b944d929c98d5c in_seq=0 out_seq=0 2026-02-20T03:38:32.372 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.370+0000 7f1d817fa640 10 client.21861 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:32.398 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1d817fa640 1 -- 10.20.193.28:0/1258224291 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55fd6a7cebd0 con 0x55fd6a9209e0 2026-02-20T03:38:32.399 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1d817fa640 10 client.21861 handle_command_reply: tid=0 2026-02-20T03:38:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 client.21861 shutdown 2026-02-20T03:38:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 -- 10.20.193.28:0/1258224291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 msgr2=0x55fd6a914cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a914cb0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f1dac105650 tx=0x7f1dac0ccf60 comp rx=0 tx=0).stop 2026-02-20T03:38:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 -- 10.20.193.28:0/1258224291 shutdown_connections 2026-02-20T03:38:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd6a9209e0 0x55fd6a922ea0 crc :-1 s=READY pgs=593 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a901560 0x55fd6a91c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a9151f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/1258224291 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fbe80 0x55fd6a914cb0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.400 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 -- 10.20.193.28:0/1258224291 >> 10.20.193.28:0/1258224291 conn(0x55fd6a8f36f0 msgr2=0x55fd6a902910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1d817fa640 0 client.21861 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 -- 10.20.193.28:0/1258224291 shutdown_connections 2026-02-20T03:38:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.396+0000 7f1dc9223e00 1 -- 10.20.193.28:0/1258224291 wait complete. 2026-02-20T03:38:32.401 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.397+0000 7f1dc9223e00 20 client.21861 trim_cache size 0 max 16384 2026-02-20T03:38:32.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 Processor -- start 2026-02-20T03:38:32.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- start start 2026-02-20T03:38:32.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fbe80 0x55fd6a913380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a91c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a901560 0x55fd6a9138c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1d64012720 con 0x55fd6a901560 2026-02-20T03:38:32.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6400ffc0 con 0x55fd6a8fbe80 2026-02-20T03:38:32.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6400de10 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc4860640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a901560 0x55fd6a9138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc4860640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a901560 0x55fd6a9138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56986/0 (socket says 10.20.193.28:56986) 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc4860640 1 -- 10.20.193.28:0/608729168 learned_addr learned my addr 10.20.193.28:0/608729168 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc4860640 1 -- 10.20.193.28:0/608729168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a8fc7c0 msgr2=0x55fd6a91c130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc4860640 1 --2- 10.20.193.28:0/608729168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a91c130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc4860640 1 -- 10.20.193.28:0/608729168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fbe80 msgr2=0x55fd6a913380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc4860640 1 --2- 10.20.193.28:0/608729168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fbe80 0x55fd6a913380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc4860640 1 -- 10.20.193.28:0/608729168 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd6a90e040 con 0x55fd6a901560 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc4860640 1 --2- 10.20.193.28:0/608729168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a901560 0x55fd6a9138c0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009cc0 tx=0x7f1db4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647080f19a828994 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d837fe640 1 -- 10.20.193.28:0/608729168 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db401e450 con 0x55fd6a901560 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d837fe640 1 -- 10.20.193.28:0/608729168 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1db4018040 con 0x55fd6a901560 2026-02-20T03:38:32.410 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d837fe640 1 -- 10.20.193.28:0/608729168 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4012590 con 0x55fd6a901560 2026-02-20T03:38:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- 10.20.193.28:0/608729168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a901560 msgr2=0x55fd6a9138c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/608729168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a901560 0x55fd6a9138c0 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009cc0 tx=0x7f1db4019000 comp rx=0 tx=0).stop 2026-02-20T03:38:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- 10.20.193.28:0/608729168 shutdown_connections 2026-02-20T03:38:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/608729168 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a901560 0x55fd6a9138c0 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/608729168 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a91c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/608729168 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fbe80 0x55fd6a913380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.411 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- 10.20.193.28:0/608729168 >> 10.20.193.28:0/608729168 conn(0x55fd6a8f36f0 msgr2=0x55fd6a914d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:32.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- 10.20.193.28:0/608729168 shutdown_connections 2026-02-20T03:38:32.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- 10.20.193.28:0/608729168 wait complete. 2026-02-20T03:38:32.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- start start 2026-02-20T03:38:32.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 Processor -- start 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fbe80 0x55fd6a91bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a91a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a901560 0x55fd6a91a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6400e480 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6400f8f0 con 0x55fd6a8fbe80 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6400eb50 con 0x55fd6a901560 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dbf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a91a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dbf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a91a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:56996/0 (socket says 10.20.193.28:56996) 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dbf7fe640 1 -- 10.20.193.28:0/3302142660 learned_addr learned my addr 10.20.193.28:0/3302142660 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dbf7fe640 1 -- 10.20.193.28:0/3302142660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a901560 msgr2=0x55fd6a91a850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:32.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dbf7fe640 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a901560 0x55fd6a91a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dbf7fe640 1 -- 10.20.193.28:0/3302142660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fbe80 msgr2=0x55fd6a91bce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dbf7fe640 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fbe80 0x55fd6a91bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dbf7fe640 1 -- 10.20.193.28:0/3302142660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd6a912a80 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dbf7fe640 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a91a310 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x55fd6a9160d0 tx=0x7f1db0002b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400f89b8f7f88123 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d817fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d817fa640 1 -- 10.20.193.28:0/3302142660 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0015040 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d817fa640 1 -- 10.20.193.28:0/3302142660 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1db0004530 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d817fa640 1 -- 10.20.193.28:0/3302142660 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0019670 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- 10.20.193.28:0/3302142660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd6a5ac690 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d817fa640 1 -- 10.20.193.28:0/3302142660 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f1db0019810 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d817fa640 10 client.21867 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:38:32.416 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 10 client.21867 _ll_register_callbacks cb 0x7f1dac0c8d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- 10.20.193.28:0/3302142660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1db400bd50 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d817fa640 1 -- 10.20.193.28:0/3302142660 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f1db0009c50 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 10 client.21867 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- 10.20.193.28:0/3302142660 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55fd6a811b70 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1d817fa640 1 -- 10.20.193.28:0/3302142660 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7f1db0019a10 con 0x55fd6a8fc7c0 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 10 client.21867 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 10 client.21867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 20 client.21867 populate_metadata read hostname 'trial028' 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd6a98cc30 0x55fd6a98f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 4 client.21867 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:38:32.417 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.404+0000 7f1dc9223e00 1 -- 10.20.193.28:0/3302142660 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fd6a914b00 con 0x55fd6a98cc30 2026-02-20T03:38:32.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.423+0000 7f1dbffff640 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd6a98cc30 0x55fd6a98f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:32.479 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.477+0000 7f1dbffff640 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd6a98cc30 0x55fd6a98f0f0 crc :-1 s=READY pgs=594 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddf7a2dee1f0a5a2 server_cookie=2010d3566102bd0c in_seq=0 out_seq=0 2026-02-20T03:38:32.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.477+0000 7f1d817fa640 10 client.21867 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:32.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1d817fa640 1 -- 10.20.193.28:0/3302142660 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fd6a914b00 con 0x55fd6a98cc30 2026-02-20T03:38:32.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1d817fa640 10 client.21867 handle_command_reply: tid=0 2026-02-20T03:38:32.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 client.21867 shutdown 2026-02-20T03:38:32.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 -- 10.20.193.28:0/3302142660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fc7c0 msgr2=0x55fd6a91a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:32.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a91a310 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x55fd6a9160d0 tx=0x7f1db0002b50 comp rx=0 tx=0).stop 2026-02-20T03:38:32.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 -- 10.20.193.28:0/3302142660 shutdown_connections 2026-02-20T03:38:32.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55fd6a98cc30 0x55fd6a98f0f0 crc :-1 s=READY pgs=594 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.534 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55fd6a901560 0x55fd6a91a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55fd6a8fc7c0 0x55fd6a91a310 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 --2- 10.20.193.28:0/3302142660 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55fd6a8fbe80 0x55fd6a91bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 -- 10.20.193.28:0/3302142660 >> 10.20.193.28:0/3302142660 conn(0x55fd6a8f36f0 msgr2=0x55fd6a913380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:32.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1d817fa640 0 client.21867 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:32.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 -- 10.20.193.28:0/3302142660 shutdown_connections 2026-02-20T03:38:32.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 1 -- 10.20.193.28:0/3302142660 wait complete. 2026-02-20T03:38:32.535 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.531+0000 7f1dc9223e00 20 client.21867 trim_cache size 0 max 16384 2026-02-20T03:38:32.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:38:32.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:38:32.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:38:32.546 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:38:32.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 -- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1d940b0d80 msgr2=0x7f1d940b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:32.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1d940b0d80 0x7f1d940b3240 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009b30 tx=0x7f1db40098b0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 -- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 msgr2=0x7f1dc019cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:32.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 0x7f1dc019cbc0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009950 tx=0x7f1dac02fdc0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.547 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 -- 10.20.193.28:0/3452385925 shutdown_connections 2026-02-20T03:38:32.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1d940b0d80 0x7f1d940b3240 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1dc01064f0 0x7f1dc01a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1dc0105b30 0x7f1dc019d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 --2- 10.20.193.28:0/3452385925 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1dc0104940 0x7f1dc019cbc0 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:32.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 -- 10.20.193.28:0/3452385925 >> 10.20.193.28:0/3452385925 conn(0x7f1dc01000c0 msgr2=0x7f1dc0108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:32.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 -- 10.20.193.28:0/3452385925 shutdown_connections 2026-02-20T03:38:32.548 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:32.532+0000 7f1dc5061640 1 -- 10.20.193.28:0/3452385925 wait complete. 2026-02-20T03:38:32.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.86 MB/sec execute 483 sec latency 62745.800 ms 2026-02-20T03:38:33.627 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:33 trial028 ceph-mon[38552]: pgmap v902: 129 pgs: 129 active+clean; 748 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 73 op/s 2026-02-20T03:38:33.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.83 MB/sec execute 484 sec latency 63745.833 ms 2026-02-20T03:38:33.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:33 trial177 ceph-mon[43181]: pgmap v902: 129 pgs: 129 active+clean; 748 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 73 op/s 2026-02-20T03:38:34.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:33 trial126 ceph-mon[38476]: pgmap v902: 129 pgs: 129 active+clean; 748 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 73 op/s 2026-02-20T03:38:34.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.79 MB/sec execute 485 sec latency 64745.866 ms 2026-02-20T03:38:35.530 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:38:35.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.75 MB/sec execute 486 sec latency 65745.898 ms 2026-02-20T03:38:35.768 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:35 trial028 ceph-mon[38552]: pgmap v903: 129 pgs: 129 active+clean; 748 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 74 op/s 2026-02-20T03:38:35.852 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:35.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:35 trial177 ceph-mon[43181]: pgmap v903: 129 pgs: 129 active+clean; 748 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 74 op/s 2026-02-20T03:38:36.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:35 trial126 ceph-mon[38476]: pgmap v903: 129 pgs: 129 active+clean; 748 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 207 KiB/s rd, 205 KiB/s wr, 74 op/s 2026-02-20T03:38:36.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- 10.20.193.28:0/2428079268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810eef0 msgr2=0x7fe08810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:36.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 --2- 10.20.193.28:0/2428079268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810eef0 0x7fe08810f2d0 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7fe078009a30 tx=0x7fe07802f260 comp rx=0 tx=0).stop 2026-02-20T03:38:36.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- 10.20.193.28:0/2428079268 shutdown_connections 2026-02-20T03:38:36.108 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 --2- 10.20.193.28:0/2428079268 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe088109ba0 0x7fe088115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 --2- 10.20.193.28:0/2428079268 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe088109220 0x7fe088109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 --2- 10.20.193.28:0/2428079268 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe08810eef0 0x7fe08810f2d0 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- 10.20.193.28:0/2428079268 >> 10.20.193.28:0/2428079268 conn(0x7fe088078600 msgr2=0x7fe08807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:36.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- 10.20.193.28:0/2428079268 shutdown_connections 2026-02-20T03:38:36.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- 10.20.193.28:0/2428079268 wait complete. 2026-02-20T03:38:36.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 Processor -- start 2026-02-20T03:38:36.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- start start 2026-02-20T03:38:36.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe088109220 0x7fe088083850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe088109ba0 0x7fe088083d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe08810eef0 0x7fe08807c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0881191b0 con 0x7fe088109220 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe088119030 con 0x7fe088109ba0 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe088119330 con 0x7fe08810eef0 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08d13f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe088109220 0x7fe088083850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08d13f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe088109220 0x7fe088083850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44652/0 (socket says 10.20.193.28:44652) 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08d13f640 1 -- 10.20.193.28:0/693601091 learned_addr learned my addr 10.20.193.28:0/693601091 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08d13f640 1 -- 10.20.193.28:0/693601091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe08810eef0 msgr2=0x7fe08807c9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08d13f640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe08810eef0 0x7fe08807c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08d13f640 1 -- 10.20.193.28:0/693601091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe088109ba0 msgr2=0x7fe088083d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:36.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08d13f640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe088109ba0 0x7fe088083d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08d13f640 1 -- 10.20.193.28:0/693601091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08807d290 con 0x7fe088109220 2026-02-20T03:38:36.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08d13f640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe088109220 0x7fe088083850 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fe078009950 tx=0x7fe078002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:36.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe0767fc640 1 -- 10.20.193.28:0/693601091 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078002a00 con 0x7fe088109220 2026-02-20T03:38:36.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe0767fc640 1 -- 10.20.193.28:0/693601091 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe078005030 con 0x7fe088109220 2026-02-20T03:38:36.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe0767fc640 1 -- 10.20.193.28:0/693601091 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078004d80 con 0x7fe088109220 2026-02-20T03:38:36.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- 10.20.193.28:0/693601091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08807d520 con 0x7fe088109220 2026-02-20T03:38:36.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.103+0000 7fe08e141640 1 -- 10.20.193.28:0/693601091 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe088081550 con 0x7fe088109220 2026-02-20T03:38:36.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0918cfe00 1 Processor -- start 2026-02-20T03:38:36.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0918cfe00 1 -- start start 2026-02-20T03:38:36.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89d83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d2630 0x55c8e89d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 0x55c8e89dee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c8e8952e50 con 0x55c8e89d8000 2026-02-20T03:38:36.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c8e89259c0 con 0x55c8e89d2630 2026-02-20T03:38:36.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c8e88d3240 con 0x55c8e89d2fb0 2026-02-20T03:38:36.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe08d940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89d83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:36.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe08d940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89d83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44656/0 (socket says 10.20.193.28:44656) 2026-02-20T03:38:36.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe08d940640 1 -- 10.20.193.28:0/1667813200 learned_addr learned my addr 10.20.193.28:0/1667813200 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:36.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe08d940640 1 -- 10.20.193.28:0/1667813200 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 msgr2=0x55c8e89dee30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:36.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe08d940640 1 --2- 10.20.193.28:0/1667813200 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 0x55c8e89dee30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe08d940640 1 -- 10.20.193.28:0/1667813200 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d2630 msgr2=0x55c8e89d2a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:38:36.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe08d940640 1 --2- 10.20.193.28:0/1667813200 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d2630 0x55c8e89d2a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe08d940640 1 -- 10.20.193.28:0/1667813200 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e88e6420 con 0x55c8e89d8000 2026-02-20T03:38:36.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe08d940640 1 --2- 10.20.193.28:0/1667813200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89d83e0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fe084009d20 tx=0x7fe08400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc5cf110a23ed14 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:36.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0767fc640 1 -- 10.20.193.28:0/693601091 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe07804b060 con 0x7fe088109220 2026-02-20T03:38:36.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.109+0000 7fe0767fc640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0640b0ea0 0x7fe0640b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe055ce5640 1 -- 10.20.193.28:0/1667813200 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084017070 con 0x55c8e89d8000 2026-02-20T03:38:36.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0767fc640 1 -- 10.20.193.28:0/693601091 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe078104cb0 con 0x7fe088109220 2026-02-20T03:38:36.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d13f640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0640b0ea0 0x7fe0640b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:36.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe055ce5640 1 -- 10.20.193.28:0/1667813200 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe08400bd50 con 0x55c8e89d8000 2026-02-20T03:38:36.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe055ce5640 1 -- 10.20.193.28:0/1667813200 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084006e60 con 0x55c8e89d8000 2026-02-20T03:38:36.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1667813200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 msgr2=0x55c8e89d83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:36.123 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1667813200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89d83e0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fe084009d20 tx=0x7fe08400b420 comp rx=0 tx=0).stop 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1667813200 shutdown_connections 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1667813200 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 0x55c8e89dee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1667813200 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d2630 0x55c8e89d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1667813200 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89d83e0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1667813200 >> 10.20.193.28:0/1667813200 conn(0x55c8e8995290 msgr2=0x55c8e89d0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1667813200 shutdown_connections 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1667813200 wait complete. 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d13f640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0640b0ea0 0x7fe0640b3360 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe0780c87c0 tx=0x7fe0780047c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- start start 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 Processor -- start 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2630 0x55c8e89ed020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 0x55c8e89ed560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d8000 0x55c8e89eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c8e89218f0 con 0x55c8e89d2630 2026-02-20T03:38:36.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c8e8713f50 con 0x55c8e89d8000 2026-02-20T03:38:36.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c8e89ebee0 con 0x55c8e89d2fb0 2026-02-20T03:38:36.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2630 0x55c8e89ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2630 0x55c8e89ed020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44666/0 (socket says 10.20.193.28:44666) 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d940640 1 -- 10.20.193.28:0/1746972501 learned_addr learned my addr 10.20.193.28:0/1746972501 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d940640 1 -- 10.20.193.28:0/1746972501 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 msgr2=0x55c8e89ed560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d940640 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 0x55c8e89ed560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d940640 1 -- 10.20.193.28:0/1746972501 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d8000 msgr2=0x55c8e89eb760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d940640 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d8000 0x55c8e89eb760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d940640 1 -- 10.20.193.28:0/1746972501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e89e4c10 con 0x55c8e89d2630 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe08d940640 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2630 0x55c8e89ed020 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fe0840094d0 tx=0x7fe084004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7947c660c96f0fb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe042ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:36.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe042ffd640 1 -- 10.20.193.28:0/1746972501 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084017040 con 0x55c8e89d2630 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe042ffd640 1 -- 10.20.193.28:0/1746972501 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe084020070 con 0x55c8e89d2630 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe042ffd640 1 -- 10.20.193.28:0/1746972501 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084012410 con 0x55c8e89d2630 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1746972501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e86f6b40 con 0x55c8e89d2630 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe042ffd640 1 -- 10.20.193.28:0/1746972501 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe08401b430 con 0x55c8e89d2630 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.115+0000 7fe0918cfe00 10 client.21879 _ll_register_callbacks cb 0x55c8e895ef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1746972501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c8e89331a0 con 0x55c8e89d2630 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe042ffd640 1 -- 10.20.193.28:0/1746972501 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe084006e60 con 0x55c8e89d2630 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe0918cfe00 10 client.21879 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1746972501 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55c8e88e0230 con 0x55c8e89d2630 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe042ffd640 1 -- 10.20.193.28:0/1746972501 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fe08401a070 con 0x55c8e89d2630 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe0918cfe00 10 client.21879 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:36.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe0918cfe00 10 client.21879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:36.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe0918cfe00 20 client.21879 populate_metadata read hostname 'trial028' 2026-02-20T03:38:36.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e89fb6d0 0x55c8e89fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe0918cfe00 4 client.21879 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:36.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.120+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1746972501 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8e892d5b0 con 0x55c8e89fb6d0 2026-02-20T03:38:36.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.136+0000 7fe08c93e640 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e89fb6d0 0x55c8e89fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:36.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.177+0000 7fe08c93e640 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e89fb6d0 0x55c8e89fdac0 crc :-1 s=READY pgs=595 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e58fd0a5735abdf3 server_cookie=87ad3a975d108b5c in_seq=0 out_seq=0 2026-02-20T03:38:36.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.177+0000 7fe042ffd640 10 client.21879 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:36.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.191+0000 7fe042ffd640 1 -- 10.20.193.28:0/1746972501 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c8e892d5b0 con 0x55c8e89fb6d0 2026-02-20T03:38:36.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.191+0000 7fe042ffd640 10 client.21879 handle_command_reply: tid=0 2026-02-20T03:38:36.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.191+0000 7fe0918cfe00 1 client.21879 shutdown 2026-02-20T03:38:36.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.191+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1746972501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2630 msgr2=0x55c8e89ed020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:36.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.191+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2630 0x55c8e89ed020 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fe0840094d0 tx=0x7fe084004290 comp rx=0 tx=0).stop 2026-02-20T03:38:36.197 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1746972501 shutdown_connections 2026-02-20T03:38:36.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e89fb6d0 0x55c8e89fdac0 crc :-1 s=READY pgs=595 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d8000 0x55c8e89eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 0x55c8e89ed560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/1746972501 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2630 0x55c8e89ed020 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1746972501 >> 10.20.193.28:0/1746972501 conn(0x55c8e8995290 msgr2=0x55c8e89d1440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:36.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe042ffd640 0 client.21879 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:36.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1746972501 shutdown_connections 2026-02-20T03:38:36.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe0918cfe00 1 -- 10.20.193.28:0/1746972501 wait complete. 2026-02-20T03:38:36.198 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.193+0000 7fe0918cfe00 20 client.21879 trim_cache size 0 max 16384 2026-02-20T03:38:36.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 Processor -- start 2026-02-20T03:38:36.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- start start 2026-02-20T03:38:36.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2630 0x55c8e89ed020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2fb0 0x55c8e89ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d8000 0x55c8e89d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe0340126d0 con 0x55c8e89d2fb0 2026-02-20T03:38:36.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe03400ff70 con 0x55c8e89d8000 2026-02-20T03:38:36.208 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe03400ddc0 con 0x55c8e89d2630 2026-02-20T03:38:36.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe08c93e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2fb0 0x55c8e89ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:36.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe08c93e640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2fb0 0x55c8e89ea5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44678/0 (socket says 10.20.193.28:44678) 2026-02-20T03:38:36.210 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe08c93e640 1 -- 10.20.193.28:0/4092016134 learned_addr learned my addr 10.20.193.28:0/4092016134 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:36.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe08c93e640 1 -- 10.20.193.28:0/4092016134 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2630 msgr2=0x55c8e89ed020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:36.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe08c93e640 1 --2- 10.20.193.28:0/4092016134 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2630 0x55c8e89ed020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe08c93e640 1 -- 10.20.193.28:0/4092016134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d8000 msgr2=0x55c8e89d1520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:36.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe08c93e640 1 --2- 10.20.193.28:0/4092016134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d8000 0x55c8e89d1520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe08c93e640 1 -- 10.20.193.28:0/4092016134 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e89f8520 con 0x55c8e89d2fb0 2026-02-20T03:38:36.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe08c93e640 1 --2- 10.20.193.28:0/4092016134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2fb0 0x55c8e89ea5a0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fe08807e0a0 tx=0x7fe07c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d572129113c32e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:36.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0554e4640 1 -- 10.20.193.28:0/4092016134 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c01e070 con 0x55c8e89d2fb0 2026-02-20T03:38:36.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0554e4640 1 -- 10.20.193.28:0/4092016134 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe07c002dd0 con 0x55c8e89d2fb0 2026-02-20T03:38:36.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- 10.20.193.28:0/4092016134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2fb0 msgr2=0x55c8e89ea5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:36.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/4092016134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2fb0 0x55c8e89ea5a0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7fe08807e0a0 tx=0x7fe07c0047e0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- 10.20.193.28:0/4092016134 shutdown_connections 2026-02-20T03:38:36.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/4092016134 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d8000 0x55c8e89d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.213 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/4092016134 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d2fb0 0x55c8e89ea5a0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/4092016134 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2630 0x55c8e89ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- 10.20.193.28:0/4092016134 >> 10.20.193.28:0/4092016134 conn(0x55c8e8995290 msgr2=0x55c8e89e9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- 10.20.193.28:0/4092016134 shutdown_connections 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- 10.20.193.28:0/4092016134 wait complete. 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- start start 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 Processor -- start 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d2630 0x55c8e89f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 0x55c8e89efe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89f0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe03400e430 con 0x55c8e89d8000 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe03400f8a0 con 0x55c8e89d2630 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.205+0000 7fe0918cfe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe03400eb00 con 0x55c8e89d2fb0 2026-02-20T03:38:36.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe08d940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:36.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe08d940640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89f0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44680/0 (socket says 10.20.193.28:44680) 2026-02-20T03:38:36.215 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe08d940640 1 -- 10.20.193.28:0/625090396 learned_addr learned my addr 10.20.193.28:0/625090396 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:36.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe08d940640 1 -- 10.20.193.28:0/625090396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 msgr2=0x55c8e89efe80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:36.222 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe08d940640 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 0x55c8e89efe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe08d940640 1 -- 10.20.193.28:0/625090396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d2630 msgr2=0x55c8e89f38d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe08d940640 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d2630 0x55c8e89f38d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe08d940640 1 -- 10.20.193.28:0/625090396 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8e89e4a40 con 0x55c8e89d8000 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe08d940640 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89f0470 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fe084007140 tx=0x7fe08401bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1a5bf71aaeae03 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe042ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe042ffd640 1 -- 10.20.193.28:0/625090396 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084029020 con 0x55c8e89d8000 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe0918cfe00 1 -- 10.20.193.28:0/625090396 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8e8604870 con 0x55c8e89d8000 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe0918cfe00 10 client.21885 _ll_register_callbacks cb 0x7fe084015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe0918cfe00 1 -- 10.20.193.28:0/625090396 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe07c002dd0 con 0x55c8e89d8000 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe042ffd640 1 -- 10.20.193.28:0/625090396 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe07c002dd0 con 0x55c8e89d8000 2026-02-20T03:38:36.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe042ffd640 1 -- 10.20.193.28:0/625090396 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08401b430 con 0x55c8e89d8000 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.210+0000 7fe042ffd640 1 -- 10.20.193.28:0/625090396 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe084024d70 con 0x55c8e89d8000 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe042ffd640 1 -- 10.20.193.28:0/625090396 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fe08401b890 con 0x55c8e89d8000 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe0918cfe00 10 client.21885 fetch_fsmap learned FSMap version 55 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe0918cfe00 1 -- 10.20.193.28:0/625090396 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=55}) -- 0x55c8e88c5440 con 0x55c8e89d8000 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe042ffd640 1 -- 10.20.193.28:0/625090396 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 55) ==== 8358+0+0 (secure 0 0 0) 0x7fe08401a070 con 0x55c8e89d8000 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe0918cfe00 10 client.21885 fetch_fsmap finished waiting for FSMap version 55 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe0918cfe00 10 client.21885 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe0918cfe00 20 client.21885 populate_metadata read hostname 'trial028' 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e8a789f0 0x55c8e8a7aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe0918cfe00 4 client.21885 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.212+0000 7fe0918cfe00 1 -- 10.20.193.28:0/625090396 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c8e892d5b0 con 0x55c8e8a789f0 2026-02-20T03:38:36.224 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.219+0000 7fe08c93e640 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e8a789f0 0x55c8e8a7aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:36.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.260+0000 7fe08c93e640 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e8a789f0 0x55c8e8a7aeb0 crc :-1 s=READY pgs=596 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=330501cbcf5ea09a server_cookie=e02c97c49e912462 in_seq=0 out_seq=0 2026-02-20T03:38:36.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.260+0000 7fe042ffd640 10 client.21885 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:36.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe042ffd640 1 -- 10.20.193.28:0/625090396 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c8e892d5b0 con 0x55c8e8a789f0 2026-02-20T03:38:36.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe042ffd640 10 client.21885 handle_command_reply: tid=0 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe0918cfe00 1 client.21885 shutdown 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe0918cfe00 1 -- 10.20.193.28:0/625090396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 msgr2=0x55c8e89f0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89f0470 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7fe084007140 tx=0x7fe08401bf90 comp rx=0 tx=0).stop 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe0918cfe00 1 -- 10.20.193.28:0/625090396 shutdown_connections 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55c8e8a789f0 0x55c8e8a7aeb0 crc :-1 s=READY pgs=596 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c8e89d8000 0x55c8e89f0470 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c8e89d2fb0 0x55c8e89efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe0918cfe00 1 --2- 10.20.193.28:0/625090396 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c8e89d2630 0x55c8e89f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe042ffd640 0 client.21885 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:36.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.274+0000 7fe0918cfe00 1 -- 10.20.193.28:0/625090396 >> 10.20.193.28:0/625090396 conn(0x55c8e8995290 msgr2=0x55c8e89ea6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe0918cfe00 1 -- 10.20.193.28:0/625090396 shutdown_connections 2026-02-20T03:38:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe0918cfe00 1 -- 10.20.193.28:0/625090396 wait complete. 2026-02-20T03:38:36.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe0918cfe00 20 client.21885 trim_cache size 0 max 16384 2026-02-20T03:38:36.280 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:38:36.280 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:38:36.280 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:38:36.280 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:38:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 -- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0640b0ea0 msgr2=0x7fe0640b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0640b0ea0 0x7fe0640b3360 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe0780c87c0 tx=0x7fe0780047c0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 -- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe088109220 msgr2=0x7fe088083850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe088109220 0x7fe088083850 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fe078009950 tx=0x7fe078002910 comp rx=0 tx=0).stop 2026-02-20T03:38:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 -- 10.20.193.28:0/693601091 shutdown_connections 2026-02-20T03:38:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe0640b0ea0 0x7fe0640b3360 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe08810eef0 0x7fe08807c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe088109ba0 0x7fe088083d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 --2- 10.20.193.28:0/693601091 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe088109220 0x7fe088083850 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 -- 10.20.193.28:0/693601091 >> 10.20.193.28:0/693601091 conn(0x7fe088078600 msgr2=0x7fe08807a040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 -- 10.20.193.28:0/693601091 shutdown_connections 2026-02-20T03:38:36.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:36.275+0000 7fe08e141640 1 -- 10.20.193.28:0/693601091 wait complete. 2026-02-20T03:38:36.472 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:38:36.473 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:38:36.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.71 MB/sec execute 487 sec latency 66746.020 ms 2026-02-20T03:38:36.784 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:37.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.038+0000 7f151e5e2640 1 -- 10.20.193.28:0/1974454479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 msgr2=0x7f151810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:37.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.038+0000 7f151e5e2640 1 --2- 10.20.193.28:0/1974454479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 0x7f151810f2d0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f1508009a30 tx=0x7f150802f260 comp rx=0 tx=0).stop 2026-02-20T03:38:37.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.038+0000 7f151e5e2640 1 -- 10.20.193.28:0/1974454479 shutdown_connections 2026-02-20T03:38:37.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.038+0000 7f151e5e2640 1 --2- 10.20.193.28:0/1974454479 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1518109ba0 0x7f1518115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.038+0000 7f151e5e2640 1 --2- 10.20.193.28:0/1974454479 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1518109220 0x7f1518109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.038+0000 7f151e5e2640 1 --2- 10.20.193.28:0/1974454479 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 0x7f151810f2d0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.038+0000 7f151e5e2640 1 -- 10.20.193.28:0/1974454479 >> 10.20.193.28:0/1974454479 conn(0x7f1518078600 msgr2=0x7f151807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:37.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.038+0000 7f151e5e2640 1 -- 10.20.193.28:0/1974454479 shutdown_connections 2026-02-20T03:38:37.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.038+0000 7f151e5e2640 1 -- 10.20.193.28:0/1974454479 wait complete. 2026-02-20T03:38:37.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151e5e2640 1 Processor -- start 2026-02-20T03:38:37.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151e5e2640 1 -- start start 2026-02-20T03:38:37.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151e5e2640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1518109220 0x7f15181a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151e5e2640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1518109ba0 0x7f15181a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151e5e2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 0x7f15181a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151e5e2640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f15181191b0 con 0x7f151810eef0 2026-02-20T03:38:37.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151e5e2640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1518119030 con 0x7f1518109ba0 2026-02-20T03:38:37.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151e5e2640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1518119330 con 0x7f1518109220 2026-02-20T03:38:37.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151dde1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 0x7f15181a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:37.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151dde1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 0x7f15181a5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44704/0 (socket says 10.20.193.28:44704) 2026-02-20T03:38:37.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151dde1640 1 -- 10.20.193.28:0/447037907 learned_addr learned my addr 10.20.193.28:0/447037907 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:37.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151dde1640 1 -- 10.20.193.28:0/447037907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1518109220 msgr2=0x7f15181a1650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:37.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151dde1640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1518109220 0x7f15181a1650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151dde1640 1 -- 10.20.193.28:0/447037907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1518109ba0 msgr2=0x7f15181a1b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151dde1640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1518109ba0 0x7f15181a1b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151dde1640 1 -- 10.20.193.28:0/447037907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15181a66a0 con 0x7f151810eef0 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151dde1640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 0x7f15181a5f20 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f151400b990 tx=0x7f151400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f15067fc640 1 -- 10.20.193.28:0/447037907 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514006e60 con 0x7f151810eef0 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f15067fc640 1 -- 10.20.193.28:0/447037907 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1514010070 con 0x7f151810eef0 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f15067fc640 1 -- 10.20.193.28:0/447037907 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514004800 con 0x7f151810eef0 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.040+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15181a6990 con 0x7f151810eef0 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.041+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15181ae1d0 con 0x7f151810eef0 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.041+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1518109660 con 0x7f151810eef0 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.044+0000 7f15067fc640 1 -- 10.20.193.28:0/447037907 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f151400c790 con 0x7f151810eef0 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.044+0000 7f15067fc640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14f40b0ea0 0x7f14f40b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.044+0000 7f15067fc640 1 -- 10.20.193.28:0/447037907 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f15140e0540 con 0x7f151810eef0 2026-02-20T03:38:37.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.044+0000 7f151d5e0640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14f40b0ea0 0x7f14f40b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:37.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.044+0000 7f15067fc640 1 -- 10.20.193.28:0/447037907 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f15140e0960 con 0x7f151810eef0 2026-02-20T03:38:37.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.044+0000 7f151d5e0640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14f40b0ea0 0x7f14f40b3360 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1508009950 tx=0x7f15080023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:37.155 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.152+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15181a29b0 con 0x7f151810eef0 2026-02-20T03:38:37.156 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.152+0000 7f15067fc640 1 -- 10.20.193.28:0/447037907 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11919 (secure 0 0 0) 0x7f15181a29b0 con 0x7f151810eef0 2026-02-20T03:38:37.156 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:38:37.157 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":55,"btime":"2026-02-20T03:37:57:428043+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:37:57.415897+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 55 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14f40b0ea0 msgr2=0x7f14f40b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14f40b0ea0 0x7f14f40b3360 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1508009950 tx=0x7f15080023d0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 msgr2=0x7f15181a5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 0x7f15181a5f20 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f151400b990 tx=0x7f151400be60 comp rx=0 tx=0).stop 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 shutdown_connections 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14f40b0ea0 0x7f14f40b3360 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f151810eef0 0x7f15181a5f20 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1518109ba0 0x7f15181a1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 --2- 10.20.193.28:0/447037907 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1518109220 0x7f15181a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 >> 10.20.193.28:0/447037907 conn(0x7f1518078600 msgr2=0x7f1518079fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:37.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 shutdown_connections 2026-02-20T03:38:37.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.155+0000 7f151e5e2640 1 -- 10.20.193.28:0/447037907 wait complete. 2026-02-20T03:38:37.265 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:38:37.587 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:37.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.67 MB/sec execute 488 sec latency 67746.054 ms 2026-02-20T03:38:37.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.827+0000 7f56e57f3640 1 -- 10.20.193.28:0/1519568571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0105750 msgr2=0x7f56e01097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:37.831 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.827+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1519568571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0105750 0x7f56e01097a0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009a30 tx=0x7f56c802f260 comp rx=0 tx=0).stop 2026-02-20T03:38:37.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 -- 10.20.193.28:0/1519568571 shutdown_connections 2026-02-20T03:38:37.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1519568571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56e0109ed0 0x7f56e0111a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1519568571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0105750 0x7f56e01097a0 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1519568571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56e0104da0 0x7f56e0105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 -- 10.20.193.28:0/1519568571 >> 10.20.193.28:0/1519568571 conn(0x7f56e0100840 msgr2=0x7f56e0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:37.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 -- 10.20.193.28:0/1519568571 shutdown_connections 2026-02-20T03:38:37.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 -- 10.20.193.28:0/1519568571 wait complete. 2026-02-20T03:38:37.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 Processor -- start 2026-02-20T03:38:37.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 -- start start 2026-02-20T03:38:37.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56e0104da0 0x7f56e019d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56e0105750 0x7f56e019d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0109ed0 0x7f56e01a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0114e80 con 0x7f56e0109ed0 2026-02-20T03:38:37.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0114d00 con 0x7f56e0104da0 2026-02-20T03:38:37.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.829+0000 7f56e57f3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0115000 con 0x7f56e0105750 2026-02-20T03:38:37.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56df7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0109ed0 0x7f56e01a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:37.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56df7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0109ed0 0x7f56e01a1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44724/0 (socket says 10.20.193.28:44724) 2026-02-20T03:38:37.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56df7fe640 1 -- 10.20.193.28:0/1905791505 learned_addr learned my addr 10.20.193.28:0/1905791505 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:37.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56df7fe640 1 -- 10.20.193.28:0/1905791505 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56e0105750 msgr2=0x7f56e019d860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56df7fe640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56e0105750 0x7f56e019d860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56df7fe640 1 -- 10.20.193.28:0/1905791505 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56e0104da0 msgr2=0x7f56e019d320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56df7fe640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56e0104da0 0x7f56e019d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56df7fe640 1 -- 10.20.193.28:0/1905791505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e01a2370 con 0x7f56e0109ed0 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56df7fe640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0109ed0 0x7f56e01a1bf0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b990 tx=0x7f56d000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56bffff640 1 -- 10.20.193.28:0/1905791505 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0006e60 con 0x7f56e0109ed0 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56bffff640 1 -- 10.20.193.28:0/1905791505 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56d0010070 con 0x7f56e0109ed0 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56bffff640 1 -- 10.20.193.28:0/1905791505 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0004800 con 0x7f56e0109ed0 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56e57f3640 1 -- 10.20.193.28:0/1905791505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e01a2660 con 0x7f56e0109ed0 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.830+0000 7f56e57f3640 1 -- 10.20.193.28:0/1905791505 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e01a9ea0 con 0x7f56e0109ed0 2026-02-20T03:38:37.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56e7cf8e00 1 Processor -- start 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56bffff640 1 -- 10.20.193.28:0/1905791505 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f56d001d030 con 0x7f56e0109ed0 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56e7cf8e00 1 -- start start 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a01ec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01ecf90 0x55c3a01f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01f10d0 0x55c3a01f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c3a016ce00 con 0x55c3a01ec5e0 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c3a013f970 con 0x55c3a01ecf90 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c3a00ed1f0 con 0x55c3a01f10d0 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.834+0000 7f56de7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a01ec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56de7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a01ec9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44740/0 (socket says 10.20.193.28:44740) 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56de7fc640 1 -- 10.20.193.28:0/1621718545 learned_addr learned my addr 10.20.193.28:0/1621718545 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:37.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56de7fc640 1 -- 10.20.193.28:0/1621718545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01f10d0 msgr2=0x55c3a01f8c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56de7fc640 1 --2- 10.20.193.28:0/1621718545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01f10d0 0x55c3a01f8c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56de7fc640 1 -- 10.20.193.28:0/1621718545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01ecf90 msgr2=0x55c3a01f09a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56de7fc640 1 --2- 10.20.193.28:0/1621718545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01ecf90 0x55c3a01f09a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56de7fc640 1 -- 10.20.193.28:0/1621718545 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a01003d0 con 0x55c3a01ec5e0 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56de7fc640 1 --2- 10.20.193.28:0/1621718545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a01ec9c0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009950 tx=0x7f56c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10737ed65b4ac008 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56a77fe640 1 -- 10.20.193.28:0/1621718545 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8038530 con 0x55c3a01ec5e0 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56a77fe640 1 -- 10.20.193.28:0/1621718545 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56c8033040 con 0x55c3a01ec5e0 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56a77fe640 1 -- 10.20.193.28:0/1621718545 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80042b0 con 0x55c3a01ec5e0 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56bffff640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56b00b0e20 0x7f56b00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/1621718545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 msgr2=0x55c3a01ec9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/1621718545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a01ec9c0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009950 tx=0x7f56c8005880 comp rx=0 tx=0).stop 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56bffff640 1 -- 10.20.193.28:0/1905791505 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f56d00dfff0 con 0x7f56e0109ed0 2026-02-20T03:38:37.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56deffd640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56b00b0e20 0x7f56b00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:37.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/1621718545 shutdown_connections 2026-02-20T03:38:37.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/1621718545 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01f10d0 0x55c3a01f8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/1621718545 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01ecf90 0x55c3a01f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/1621718545 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a01ec9c0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/1621718545 >> 10.20.193.28:0/1621718545 conn(0x55c3a01af240 msgr2=0x55c3a01eace0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:37.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/1621718545 shutdown_connections 2026-02-20T03:38:37.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/1621718545 wait complete. 2026-02-20T03:38:37.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.835+0000 7f56deffd640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56b00b0e20 0x7f56b00b32e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x55c3a01947b0 tx=0x7f56d4006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:37.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 -- start start 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 Processor -- start 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01ec5e0 0x55c3a02180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a0218630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01f10d0 0x55c3a0216830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55c3a013b8a0 con 0x55c3a01ecf90 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55c39ff2df50 con 0x55c3a01f10d0 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55c3a0216dc0 con 0x55c3a01ec5e0 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56de7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a0218630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56de7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a0218630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44742/0 (socket says 10.20.193.28:44742) 2026-02-20T03:38:37.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56de7fc640 1 -- 10.20.193.28:0/843374711 learned_addr learned my addr 10.20.193.28:0/843374711 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:37.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56de7fc640 1 -- 10.20.193.28:0/843374711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01ec5e0 msgr2=0x55c3a02180f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:37.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56de7fc640 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01ec5e0 0x55c3a02180f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56de7fc640 1 -- 10.20.193.28:0/843374711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01f10d0 msgr2=0x55c3a0216830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:37.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56de7fc640 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01f10d0 0x55c3a0216830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56de7fc640 1 -- 10.20.193.28:0/843374711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a020fc00 con 0x55c3a01ecf90 2026-02-20T03:38:37.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56de7fc640 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a0218630 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f56c8002410 tx=0x7f56c8002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e2533c1a05837b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:37.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56a4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:37.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56a4ff9640 1 -- 10.20.193.28:0/843374711 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c802fd50 con 0x55c3a01ecf90 2026-02-20T03:38:37.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56a4ff9640 1 -- 10.20.193.28:0/843374711 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56c80044d0 con 0x55c3a01ecf90 2026-02-20T03:38:37.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56a4ff9640 1 -- 10.20.193.28:0/843374711 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8038e60 con 0x55c3a01ecf90 2026-02-20T03:38:37.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/843374711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39ff10b40 con 0x55c3a01ecf90 2026-02-20T03:38:37.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56a4ff9640 1 -- 10.20.193.28:0/843374711 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f56c8042420 con 0x55c3a01ecf90 2026-02-20T03:38:37.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 10 client.21903 _ll_register_callbacks cb 0x55c3a0178eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:37.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/843374711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c3a014d150 con 0x55c3a01ecf90 2026-02-20T03:38:37.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56a4ff9640 1 -- 10.20.193.28:0/843374711 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f56c8004030 con 0x55c3a01ecf90 2026-02-20T03:38:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 10 client.21903 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/843374711 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55c3a00fa1e0 con 0x55c3a01ecf90 2026-02-20T03:38:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56a4ff9640 1 -- 10.20.193.28:0/843374711 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f56c8038790 con 0x55c3a01ecf90 2026-02-20T03:38:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 10 client.21903 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 10 client.21903 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:38:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 20 client.21903 populate_metadata read hostname 'trial028' 2026-02-20T03:38:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55c3a0226490 0x55c3a0228880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 4 client.21903 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:37.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.837+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/843374711 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3a0147560 con 0x55c3a0226490 2026-02-20T03:38:37.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.864+0000 7f56deffd640 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55c3a0226490 0x55c3a0228880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:37.893 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:37 trial028 ceph-mon[38552]: pgmap v904: 129 pgs: 129 active+clean; 744 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 299 KiB/s rd, 298 KiB/s wr, 79 op/s 2026-02-20T03:38:37.893 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:37 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/447037907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:38:37.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.930+0000 7f56deffd640 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55c3a0226490 0x55c3a0228880 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=46649bcb54cf387b server_cookie=1c1d7123b1687ee6 in_seq=0 out_seq=0 2026-02-20T03:38:37.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.930+0000 7f56a4ff9640 10 client.21903 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:38:37.959 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56a4ff9640 1 -- 10.20.193.28:0/843374711 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55c3a0147560 con 0x55c3a0226490 2026-02-20T03:38:37.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56a4ff9640 10 client.21903 handle_command_reply: tid=0 2026-02-20T03:38:37.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 client.21903 shutdown 2026-02-20T03:38:37.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/843374711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 msgr2=0x55c3a0218630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:37.960 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a0218630 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f56c8002410 tx=0x7f56c8002910 comp rx=0 tx=0).stop 2026-02-20T03:38:37.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/843374711 shutdown_connections 2026-02-20T03:38:37.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01f10d0 0x55c3a0216830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55c3a0226490 0x55c3a0228880 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a0218630 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/843374711 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01ec5e0 0x55c3a02180f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/843374711 >> 10.20.193.28:0/843374711 conn(0x55c3a01af240 msgr2=0x55c3a01ef8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:37.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56a4ff9640 0 client.21903 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:38:37.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/843374711 shutdown_connections 2026-02-20T03:38:37.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/843374711 wait complete. 2026-02-20T03:38:37.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.957+0000 7f56e7cf8e00 20 client.21903 trim_cache size 0 max 16384 2026-02-20T03:38:37.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 Processor -- start 2026-02-20T03:38:37.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:37 trial177 ceph-mon[43181]: pgmap v904: 129 pgs: 129 active+clean; 744 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 299 KiB/s rd, 298 KiB/s wr, 79 op/s 2026-02-20T03:38:37.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:37 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/447037907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:38:37.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- start start 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01ec5e0 0x55c3a022e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a022e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01f10d0 0x55c3a021d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5684012750 con 0x55c3a01ecf90 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f568400ffc0 con 0x55c3a01f10d0 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f568400de10 con 0x55c3a01ec5e0 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56de7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a022e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56de7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a022e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44758/0 (socket says 10.20.193.28:44758) 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56de7fc640 1 -- 10.20.193.28:0/3560148915 learned_addr learned my addr 10.20.193.28:0/3560148915 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56de7fc640 1 -- 10.20.193.28:0/3560148915 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01ec5e0 msgr2=0x55c3a022e150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:37.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56de7fc640 1 --2- 10.20.193.28:0/3560148915 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01ec5e0 0x55c3a022e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56de7fc640 1 -- 10.20.193.28:0/3560148915 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01f10d0 msgr2=0x55c3a021d1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56de7fc640 1 --2- 10.20.193.28:0/3560148915 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01f10d0 0x55c3a021d1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56de7fc640 1 -- 10.20.193.28:0/3560148915 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a020fa30 con 0x55c3a01ecf90 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56de7fc640 1 --2- 10.20.193.28:0/3560148915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a022e690 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x55c3a021d170 tx=0x7f56c8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec3066650aa142d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56a6ffd640 1 -- 10.20.193.28:0/3560148915 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8059060 con 0x55c3a01ecf90 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56a6ffd640 1 -- 10.20.193.28:0/3560148915 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55c3a014d150 con 0x55c3a01ecf90 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56a6ffd640 1 -- 10.20.193.28:0/3560148915 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8038910 con 0x55c3a01ecf90 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3560148915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 msgr2=0x55c3a022e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3560148915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a022e690 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x55c3a021d170 tx=0x7f56c8050000 comp rx=0 tx=0).stop 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3560148915 shutdown_connections 2026-02-20T03:38:37.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3560148915 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01f10d0 0x55c3a021d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3560148915 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ecf90 0x55c3a022e690 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3560148915 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01ec5e0 0x55c3a022e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3560148915 >> 10.20.193.28:0/3560148915 conn(0x55c3a01af240 msgr2=0x55c3a01eff20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:37.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3560148915 shutdown_connections 2026-02-20T03:38:37.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3560148915 wait complete. 2026-02-20T03:38:37.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- start start 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 Processor -- start 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a0221450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01ecf90 0x55c3a0221990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01f10d0 0x55c3a0291340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f568400e480 con 0x55c3a01ec5e0 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f568400f8f0 con 0x55c3a01ecf90 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56e7cf8e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f568400eb50 con 0x55c3a01f10d0 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a0221450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56deffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a0221450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44768/0 (socket says 10.20.193.28:44768) 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56deffd640 1 -- 10.20.193.28:0/3059777108 learned_addr learned my addr 10.20.193.28:0/3059777108 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56deffd640 1 -- 10.20.193.28:0/3059777108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01f10d0 msgr2=0x55c3a0291340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:37.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56deffd640 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01f10d0 0x55c3a0291340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56deffd640 1 -- 10.20.193.28:0/3059777108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01ecf90 msgr2=0x55c3a0221990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.963+0000 7f56deffd640 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01ecf90 0x55c3a0221990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56deffd640 1 -- 10.20.193.28:0/3059777108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39fe1e870 con 0x55c3a01ec5e0 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56deffd640 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a0221450 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x55c3a02290c0 tx=0x7f56d40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7e1142e9479c74 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56a4ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56a4ff9640 1 -- 10.20.193.28:0/3059777108 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4002c50 con 0x55c3a01ec5e0 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56a4ff9640 1 -- 10.20.193.28:0/3059777108 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56d4022030 con 0x55c3a01ec5e0 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56a4ff9640 1 -- 10.20.193.28:0/3059777108 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d40136b0 con 0x55c3a01ec5e0 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3059777108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a00df3f0 con 0x55c3a01ec5e0 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56a4ff9640 1 -- 10.20.193.28:0/3059777108 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f56d4013870 con 0x55c3a01ec5e0 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 10 client.21909 _ll_register_callbacks cb 0x7f56c80057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:37.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3059777108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c8033040 con 0x55c3a01ec5e0 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56a4ff9640 1 -- 10.20.193.28:0/3059777108 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f56d402d060 con 0x55c3a01ec5e0 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 10 client.21909 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3059777108 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55c3a0210720 con 0x55c3a01ec5e0 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56a4ff9640 1 -- 10.20.193.28:0/3059777108 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f56d4013a70 con 0x55c3a01ec5e0 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 10 client.21909 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 10 client.21909 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 20 client.21909 populate_metadata read hostname 'trial028' 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55c3a0292c20 0x55c3a02950e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 4 client.21909 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:38:37.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.968+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3059777108 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3a01107c0 con 0x55c3a0292c20 2026-02-20T03:38:37.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:37.984+0000 7f56de7fc640 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55c3a0292c20 0x55c3a02950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:38.026 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.024+0000 7f56de7fc640 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55c3a0292c20 0x55c3a02950e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f73de394a35cd7d1 server_cookie=34f5ada906e57b5 in_seq=0 out_seq=0 2026-02-20T03:38:38.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.024+0000 7f56a4ff9640 10 client.21909 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:38:38.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56a4ff9640 1 -- 10.20.193.28:0/3059777108 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3a01107c0 con 0x55c3a0292c20 2026-02-20T03:38:38.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56a4ff9640 10 client.21909 handle_command_reply: tid=0 2026-02-20T03:38:38.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 client.21909 shutdown 2026-02-20T03:38:38.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3059777108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 msgr2=0x55c3a0221450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:38.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a0221450 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x55c3a02290c0 tx=0x7f56d40047e0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3059777108 shutdown_connections 2026-02-20T03:38:38.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55c3a01f10d0 0x55c3a0291340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55c3a01ecf90 0x55c3a0221990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55c3a0292c20 0x55c3a02950e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 --2- 10.20.193.28:0/3059777108 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55c3a01ec5e0 0x55c3a0221450 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3059777108 >> 10.20.193.28:0/3059777108 conn(0x55c3a01af240 msgr2=0x55c3a022d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:38.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56a4ff9640 0 client.21909 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:38:38.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3059777108 shutdown_connections 2026-02-20T03:38:38.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 1 -- 10.20.193.28:0/3059777108 wait complete. 2026-02-20T03:38:38.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e7cf8e00 20 client.21909 trim_cache size 0 max 16384 2026-02-20T03:38:38.042 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:38:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 -- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56b00b0e20 msgr2=0x7f56b00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56b00b0e20 0x7f56b00b32e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x55c3a01947b0 tx=0x7f56d4006cd0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 -- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0109ed0 msgr2=0x7f56e01a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:38.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0109ed0 0x7f56e01a1bf0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b990 tx=0x7f56d000be60 comp rx=0 tx=0).stop 2026-02-20T03:38:38.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 -- 10.20.193.28:0/1905791505 shutdown_connections 2026-02-20T03:38:38.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56b00b0e20 0x7f56b00b32e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56e0109ed0 0x7f56e01a1bf0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56e0105750 0x7f56e019d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 --2- 10.20.193.28:0/1905791505 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56e0104da0 0x7f56e019d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 -- 10.20.193.28:0/1905791505 >> 10.20.193.28:0/1905791505 conn(0x7f56e0100840 msgr2=0x7f56e0101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:38.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 -- 10.20.193.28:0/1905791505 shutdown_connections 2026-02-20T03:38:38.054 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.038+0000 7f56e57f3640 1 -- 10.20.193.28:0/1905791505 wait complete. 2026-02-20T03:38:38.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:37 trial126 ceph-mon[38476]: pgmap v904: 129 pgs: 129 active+clean; 744 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 299 KiB/s rd, 298 KiB/s wr, 79 op/s 2026-02-20T03:38:38.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:37 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/447037907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:38:38.211 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:38:38.534 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:38.733 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.63 MB/sec execute 489 sec latency 68746.087 ms 2026-02-20T03:38:38.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.788+0000 7fc546f6c640 1 -- 10.20.193.28:0/2232646185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077620 msgr2=0x7fc540077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:38.791 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.788+0000 7fc546f6c640 1 --2- 10.20.193.28:0/2232646185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077620 0x7fc540077a00 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fc530009a30 tx=0x7fc53002f260 comp rx=0 tx=0).stop 2026-02-20T03:38:38.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.788+0000 7fc546f6c640 1 -- 10.20.193.28:0/2232646185 shutdown_connections 2026-02-20T03:38:38.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.788+0000 7fc546f6c640 1 --2- 10.20.193.28:0/2232646185 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc540113820 0x7fc540115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.788+0000 7fc546f6c640 1 --2- 10.20.193.28:0/2232646185 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc540077f40 0x7fc5401132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.788+0000 7fc546f6c640 1 --2- 10.20.193.28:0/2232646185 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077620 0x7fc540077a00 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.788+0000 7fc546f6c640 1 -- 10.20.193.28:0/2232646185 >> 10.20.193.28:0/2232646185 conn(0x7fc540100680 msgr2=0x7fc540102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:38.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.788+0000 7fc546f6c640 1 -- 10.20.193.28:0/2232646185 shutdown_connections 2026-02-20T03:38:38.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.788+0000 7fc546f6c640 1 -- 10.20.193.28:0/2232646185 wait complete. 2026-02-20T03:38:38.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc546f6c640 1 Processor -- start 2026-02-20T03:38:38.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc546f6c640 1 -- start start 2026-02-20T03:38:38.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc546f6c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc540077620 0x7fc5401a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc546f6c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077f40 0x7fc5401a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc546f6c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc540113820 0x7fc5401a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc546f6c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc5401191c0 con 0x7fc540077f40 2026-02-20T03:38:38.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc546f6c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc540119040 con 0x7fc540113820 2026-02-20T03:38:38.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc546f6c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc540119340 con 0x7fc540077620 2026-02-20T03:38:38.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc545769640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077f40 0x7fc5401a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:38.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc545769640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077f40 0x7fc5401a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44784/0 (socket says 10.20.193.28:44784) 2026-02-20T03:38:38.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc545769640 1 -- 10.20.193.28:0/876996986 learned_addr learned my addr 10.20.193.28:0/876996986 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:38.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc545769640 1 -- 10.20.193.28:0/876996986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc540077620 msgr2=0x7fc5401a16a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:38.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc545769640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc540077620 0x7fc5401a16a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc545769640 1 -- 10.20.193.28:0/876996986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc540113820 msgr2=0x7fc5401a5f70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:38.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc545769640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc540113820 0x7fc5401a5f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.789+0000 7fc545769640 1 -- 10.20.193.28:0/876996986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5401a66f0 con 0x7fc540077f40 2026-02-20T03:38:38.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.791+0000 7fc545769640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077f40 0x7fc5401a1be0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7fc53400b570 tx=0x7fc53400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.791+0000 7fc52effd640 1 -- 10.20.193.28:0/876996986 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc534013020 con 0x7fc540077f40 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.791+0000 7fc52effd640 1 -- 10.20.193.28:0/876996986 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc534004480 con 0x7fc540077f40 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.791+0000 7fc546f6c640 1 -- 10.20.193.28:0/876996986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5401a69e0 con 0x7fc540077f40 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.791+0000 7fc52effd640 1 -- 10.20.193.28:0/876996986 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53400fb50 con 0x7fc540077f40 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.791+0000 7fc546f6c640 1 -- 10.20.193.28:0/876996986 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5401ae220 con 0x7fc540077f40 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.793+0000 7fc52effd640 1 -- 10.20.193.28:0/876996986 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc534002780 con 0x7fc540077f40 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 Processor -- start 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- start start 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94ffb0 0x55a32f950390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94a5e0 0x55a32f94aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.803 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94af60 0x55a32f956de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a32f8cae00 con 0x55a32f94af60 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a32f89d970 con 0x55a32f94a5e0 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a32f84b1f0 con 0x55a32f94ffb0 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc545769640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94af60 0x55a32f956de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc545769640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94af60 0x55a32f956de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44790/0 (socket says 10.20.193.28:44790) 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc545769640 1 -- 10.20.193.28:0/1313238532 learned_addr learned my addr 10.20.193.28:0/1313238532 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc545769640 1 -- 10.20.193.28:0/1313238532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94ffb0 msgr2=0x55a32f950390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc545769640 1 --2- 10.20.193.28:0/1313238532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94ffb0 0x55a32f950390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc545769640 1 -- 10.20.193.28:0/1313238532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94a5e0 msgr2=0x55a32f94aa20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc545769640 1 --2- 10.20.193.28:0/1313238532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94a5e0 0x55a32f94aa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc545769640 1 -- 10.20.193.28:0/1313238532 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a32f85e3d0 con 0x55a32f94af60 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc545769640 1 --2- 10.20.193.28:0/1313238532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94af60 0x55a32f956de0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fc5340e66d0 tx=0x7fc5340e6ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdfb766b385cc94 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:38.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc52effd640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc51c0b0e20 0x7fc51c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc52effd640 1 -- 10.20.193.28:0/876996986 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc5340e0480 con 0x7fc540077f40 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc50e4e6640 1 -- 10.20.193.28:0/1313238532 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5340f3070 con 0x55a32f94af60 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc50e4e6640 1 -- 10.20.193.28:0/1313238532 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc53401e2b0 con 0x55a32f94af60 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc50e4e6640 1 -- 10.20.193.28:0/1313238532 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5340a78c0 con 0x55a32f94af60 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54676b640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc51c0b0e20 0x7fc51c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1313238532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94af60 msgr2=0x55a32f956de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1313238532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94af60 0x55a32f956de0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fc5340e66d0 tx=0x7fc5340e6ba0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1313238532 shutdown_connections 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1313238532 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94af60 0x55a32f956de0 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1313238532 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94a5e0 0x55a32f94aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1313238532 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94ffb0 0x55a32f950390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1313238532 >> 10.20.193.28:0/1313238532 conn(0x55a32f90d240 msgr2=0x55a32f948ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1313238532 shutdown_connections 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1313238532 wait complete. 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54676b640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc51c0b0e20 0x7fc51c0b32e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00aab0 tx=0x7fc53c009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 -- start start 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.794+0000 7fc54a6fae00 1 Processor -- start 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f964f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94af60 0x55a32f965470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94ffb0 0x55a32f963670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a32f8998a0 con 0x55a32f94a5e0 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a32f68bf50 con 0x55a32f94ffb0 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a32f963df0 con 0x55a32f94af60 2026-02-20T03:38:38.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc545f6a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f964f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc545f6a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f964f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44800/0 (socket says 10.20.193.28:44800) 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc545f6a640 1 -- 10.20.193.28:0/1625027991 learned_addr learned my addr 10.20.193.28:0/1625027991 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc545f6a640 1 -- 10.20.193.28:0/1625027991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94af60 msgr2=0x55a32f965470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc545f6a640 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94af60 0x55a32f965470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc545f6a640 1 -- 10.20.193.28:0/1625027991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94ffb0 msgr2=0x55a32f963670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc545f6a640 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94ffb0 0x55a32f963670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc545f6a640 1 -- 10.20.193.28:0/1625027991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a32f95cad0 con 0x55a32f94a5e0 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc545f6a640 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f964f30 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fc530032040 tx=0x7fc530009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baea068749000696 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc4f77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc4f77fe640 1 -- 10.20.193.28:0/1625027991 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53002fcd0 con 0x55a32f94a5e0 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc4f77fe640 1 -- 10.20.193.28:0/1625027991 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc530033040 con 0x55a32f94a5e0 2026-02-20T03:38:38.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc4f77fe640 1 -- 10.20.193.28:0/1625027991 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530038a80 con 0x55a32f94a5e0 2026-02-20T03:38:38.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1625027991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a32f66eb40 con 0x55a32f94a5e0 2026-02-20T03:38:38.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 10 client.21921 _ll_register_callbacks cb 0x55a32f8d6eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:38.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1625027991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a32f8ab150 con 0x55a32f94a5e0 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc4f77fe640 1 -- 10.20.193.28:0/1625027991 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc530038c20 con 0x55a32f94a5e0 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc4f77fe640 1 -- 10.20.193.28:0/1625027991 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fc530038e20 con 0x55a32f94a5e0 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 10 client.21921 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1625027991 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55a32f8581e0 con 0x55a32f94a5e0 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc4f77fe640 1 -- 10.20.193.28:0/1625027991 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7fc53004a030 con 0x55a32f94a5e0 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 10 client.21921 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 10 client.21921 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 20 client.21921 populate_metadata read hostname 'trial028' 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55a32f973660 0x55a32f975af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 4 client.21921 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:38.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.797+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1625027991 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a32f8a5560 con 0x55a32f973660 2026-02-20T03:38:38.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.824+0000 7fc545769640 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55a32f973660 0x55a32f975af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:38.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.891+0000 7fc545769640 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55a32f973660 0x55a32f975af0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fea646c2b24a14b6 server_cookie=7c3ceb0395e0c2d7 in_seq=0 out_seq=0 2026-02-20T03:38:38.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.891+0000 7fc4f77fe640 10 client.21921 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:38:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc4f77fe640 1 -- 10.20.193.28:0/1625027991 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a32f8a5560 con 0x55a32f973660 2026-02-20T03:38:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc4f77fe640 10 client.21921 handle_command_reply: tid=0 2026-02-20T03:38:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 client.21921 shutdown 2026-02-20T03:38:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1625027991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 msgr2=0x55a32f964f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:38.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f964f30 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fc530032040 tx=0x7fc530009760 comp rx=0 tx=0).stop 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1625027991 shutdown_connections 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55a32f973660 0x55a32f975af0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94ffb0 0x55a32f963670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94af60 0x55a32f965470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/1625027991 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f964f30 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1625027991 >> 10.20.193.28:0/1625027991 conn(0x55a32f90d240 msgr2=0x55a32f9493f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc4f77fe640 0 client.21921 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1625027991 shutdown_connections 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 1 -- 10.20.193.28:0/1625027991 wait complete. 2026-02-20T03:38:38.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.918+0000 7fc54a6fae00 20 client.21921 trim_cache size 0 max 16384 2026-02-20T03:38:38.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 Processor -- start 2026-02-20T03:38:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- start start 2026-02-20T03:38:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94a5e0 0x55a32f964600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94af60 0x55a32f942d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94ffb0 0x55a32f962490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec012820 con 0x55a32f94ffb0 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec010090 con 0x55a32f94af60 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec00dee0 con 0x55a32f94a5e0 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54676b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94ffb0 0x55a32f962490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54676b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94ffb0 0x55a32f962490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44804/0 (socket says 10.20.193.28:44804) 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54676b640 1 -- 10.20.193.28:0/294265490 learned_addr learned my addr 10.20.193.28:0/294265490 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54676b640 1 -- 10.20.193.28:0/294265490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94a5e0 msgr2=0x55a32f964600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54676b640 1 --2- 10.20.193.28:0/294265490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94a5e0 0x55a32f964600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.931 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54676b640 1 -- 10.20.193.28:0/294265490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94af60 msgr2=0x55a32f942d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54676b640 1 --2- 10.20.193.28:0/294265490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94af60 0x55a32f942d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54676b640 1 -- 10.20.193.28:0/294265490 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a32f95c900 con 0x55a32f94ffb0 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54676b640 1 --2- 10.20.193.28:0/294265490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94ffb0 0x55a32f962490 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00cc40 tx=0x7fc53c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1a916a0219b355 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc50dce5640 1 -- 10.20.193.28:0/294265490 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c006e60 con 0x55a32f94ffb0 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc50dce5640 1 -- 10.20.193.28:0/294265490 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc53c01f020 con 0x55a32f94ffb0 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc50dce5640 1 -- 10.20.193.28:0/294265490 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53c00d680 con 0x55a32f94ffb0 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- 10.20.193.28:0/294265490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94ffb0 msgr2=0x55a32f962490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/294265490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94ffb0 0x55a32f962490 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00cc40 tx=0x7fc53c00f000 comp rx=0 tx=0).stop 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- 10.20.193.28:0/294265490 shutdown_connections 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/294265490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94ffb0 0x55a32f962490 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/294265490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94af60 0x55a32f942d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/294265490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94a5e0 0x55a32f964600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- 10.20.193.28:0/294265490 >> 10.20.193.28:0/294265490 conn(0x55a32f90d240 msgr2=0x55a32f961d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- 10.20.193.28:0/294265490 shutdown_connections 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- 10.20.193.28:0/294265490 wait complete. 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 -- start start 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.923+0000 7fc54a6fae00 1 Processor -- start 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f96b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94af60 0x55a32f967d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94ffb0 0x55a32f968520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec00e550 con 0x55a32f94a5e0 2026-02-20T03:38:38.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec00f9c0 con 0x55a32f94ffb0 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec00ec20 con 0x55a32f94af60 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc545f6a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f96b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc545f6a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f96b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44816/0 (socket says 10.20.193.28:44816) 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc545f6a640 1 -- 10.20.193.28:0/3445213852 learned_addr learned my addr 10.20.193.28:0/3445213852 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc545f6a640 1 -- 10.20.193.28:0/3445213852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94af60 msgr2=0x55a32f967d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc545f6a640 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94af60 0x55a32f967d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc545f6a640 1 -- 10.20.193.28:0/3445213852 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94ffb0 msgr2=0x55a32f968520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc545f6a640 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94ffb0 0x55a32f968520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc545f6a640 1 -- 10.20.193.28:0/3445213852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a32f57c870 con 0x55a32f94a5e0 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc545f6a640 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f96b7f0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7fc530002410 tx=0x7fc53002f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29a1bd6dcce8a13 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc4f77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:38.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc4f77fe640 1 -- 10.20.193.28:0/3445213852 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53002fcd0 con 0x55a32f94a5e0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc4f77fe640 1 -- 10.20.193.28:0/3445213852 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc530033030 con 0x55a32f94a5e0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc4f77fe640 1 -- 10.20.193.28:0/3445213852 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5300051a0 con 0x55a32f94a5e0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 -- 10.20.193.28:0/3445213852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a32f83d3f0 con 0x55a32f94a5e0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc4f77fe640 1 -- 10.20.193.28:0/3445213852 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc530005340 con 0x55a32f94a5e0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 10 client.21927 _ll_register_callbacks cb 0x7fc530009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 -- 10.20.193.28:0/3445213852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a32f84fab0 con 0x55a32f94a5e0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc4f77fe640 1 -- 10.20.193.28:0/3445213852 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fc530057060 con 0x55a32f94a5e0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 10 client.21927 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 -- 10.20.193.28:0/3445213852 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55a32f95d5f0 con 0x55a32f94a5e0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc4f77fe640 1 -- 10.20.193.28:0/3445213852 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7fc53005a050 con 0x55a32f94a5e0 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 10 client.21927 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:38.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 10 client.21927 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:38:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 20 client.21927 populate_metadata read hostname 'trial028' 2026-02-20T03:38:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55a32f9dfaf0 0x55a32f9e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 4 client.21927 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:38:38.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.928+0000 7fc54a6fae00 1 -- 10.20.193.28:0/3445213852 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc53c01f020 con 0x55a32f9dfaf0 2026-02-20T03:38:38.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:38.945+0000 7fc545769640 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55a32f9dfaf0 0x55a32f9e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:38.960 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:38 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:38:38.961 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:38 trial028 ceph-mon[38552]: pgmap v905: 129 pgs: 129 active+clean; 733 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 243 KiB/s rd, 242 KiB/s wr, 86 op/s 2026-02-20T03:38:38.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:38 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:38:38.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:38 trial177 ceph-mon[43181]: pgmap v905: 129 pgs: 129 active+clean; 733 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 243 KiB/s rd, 242 KiB/s wr, 86 op/s 2026-02-20T03:38:39.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.011+0000 7fc545769640 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55a32f9dfaf0 0x55a32f9e1f80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31503a7a4f209bb server_cookie=cd110d9e00e92c82 in_seq=0 out_seq=0 2026-02-20T03:38:39.014 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.011+0000 7fc4f77fe640 10 client.21927 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:38:39.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc4f77fe640 1 -- 10.20.193.28:0/3445213852 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc53c01f020 con 0x55a32f9dfaf0 2026-02-20T03:38:39.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc4f77fe640 10 client.21927 handle_command_reply: tid=0 2026-02-20T03:38:39.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 client.21927 shutdown 2026-02-20T03:38:39.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 -- 10.20.193.28:0/3445213852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 msgr2=0x55a32f96b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.027 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f96b7f0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7fc530002410 tx=0x7fc53002f8d0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 -- 10.20.193.28:0/3445213852 shutdown_connections 2026-02-20T03:38:39.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55a32f9dfaf0 0x55a32f9e1f80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a32f94ffb0 0x55a32f968520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a32f94af60 0x55a32f967d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 --2- 10.20.193.28:0/3445213852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a32f94a5e0 0x55a32f96b7f0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 -- 10.20.193.28:0/3445213852 >> 10.20.193.28:0/3445213852 conn(0x55a32f90d240 msgr2=0x55a32f9625a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc4f77fe640 0 client.21927 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:38:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 -- 10.20.193.28:0/3445213852 shutdown_connections 2026-02-20T03:38:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 1 -- 10.20.193.28:0/3445213852 wait complete. 2026-02-20T03:38:39.029 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc54a6fae00 20 client.21927 trim_cache size 0 max 16384 2026-02-20T03:38:39.040 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:38:39.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 -- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc51c0b0e20 msgr2=0x7fc51c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc51c0b0e20 0x7fc51c0b32e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc53c00aab0 tx=0x7fc53c009250 comp rx=0 tx=0).stop 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 -- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077f40 msgr2=0x7fc5401a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077f40 0x7fc5401a1be0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7fc53400b570 tx=0x7fc53400ba40 comp rx=0 tx=0).stop 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 -- 10.20.193.28:0/876996986 shutdown_connections 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc51c0b0e20 0x7fc51c0b32e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc540113820 0x7fc5401a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc540077f40 0x7fc5401a1be0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 --2- 10.20.193.28:0/876996986 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc540077620 0x7fc5401a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.025+0000 7fc546f6c640 1 -- 10.20.193.28:0/876996986 >> 10.20.193.28:0/876996986 conn(0x7fc540100680 msgr2=0x7fc540113e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:39.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.026+0000 7fc546f6c640 1 -- 10.20.193.28:0/876996986 shutdown_connections 2026-02-20T03:38:39.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.026+0000 7fc546f6c640 1 -- 10.20.193.28:0/876996986 wait complete. 2026-02-20T03:38:39.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:38 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:38:39.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:38 trial126 ceph-mon[38476]: pgmap v905: 129 pgs: 129 active+clean; 733 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 243 KiB/s rd, 242 KiB/s wr, 86 op/s 2026-02-20T03:38:39.169 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:38:39.481 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:39.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 -- 10.20.193.28:0/3726119765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc109ba0 msgr2=0x7f58fc115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3726119765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc109ba0 0x7f58fc115d10 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f58f800b0a0 tx=0x7f58f802f450 comp rx=0 tx=0).stop 2026-02-20T03:38:39.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 -- 10.20.193.28:0/3726119765 shutdown_connections 2026-02-20T03:38:39.723 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3726119765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc109ba0 0x7f58fc115d10 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3726119765 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58fc109220 0x7f58fc109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3726119765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58fc10eef0 0x7f58fc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 -- 10.20.193.28:0/3726119765 >> 10.20.193.28:0/3726119765 conn(0x7f58fc078600 msgr2=0x7f58fc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:39.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 -- 10.20.193.28:0/3726119765 shutdown_connections 2026-02-20T03:38:39.724 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 -- 10.20.193.28:0/3726119765 wait complete. 2026-02-20T03:38:39.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 Processor -- start 2026-02-20T03:38:39.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 -- start start 2026-02-20T03:38:39.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58fc109220 0x7f58fc1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58fc109ba0 0x7f58fc1a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc10eef0 0x7f58fc1a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc1191b0 con 0x7f58fc10eef0 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc119030 con 0x7f58fc109ba0 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f5901d1c640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc119330 con 0x7f58fc109220 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f590151b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc10eef0 0x7f58fc1a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f590151b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc10eef0 0x7f58fc1a5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44842/0 (socket says 10.20.193.28:44842) 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f590151b640 1 -- 10.20.193.28:0/3227329970 learned_addr learned my addr 10.20.193.28:0/3227329970 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f590151b640 1 -- 10.20.193.28:0/3227329970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58fc109220 msgr2=0x7f58fc1a1610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f590151b640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58fc109220 0x7f58fc1a1610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f590151b640 1 -- 10.20.193.28:0/3227329970 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58fc109ba0 msgr2=0x7f58fc1a1b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:39.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f590151b640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58fc109ba0 0x7f58fc1a1b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.720+0000 7f590151b640 1 -- 10.20.193.28:0/3227329970 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc1a6660 con 0x7f58fc10eef0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.722+0000 7f590151b640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc10eef0 0x7f58fc1a5ee0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f58f800b1d0 tx=0x7f58f8009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.722+0000 7f58f1ffb640 1 -- 10.20.193.28:0/3227329970 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8004590 con 0x7f58fc10eef0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.722+0000 7f58f1ffb640 1 -- 10.20.193.28:0/3227329970 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58f8004730 con 0x7f58fc10eef0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.722+0000 7f5901d1c640 1 -- 10.20.193.28:0/3227329970 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58fc1a68f0 con 0x7f58fc10eef0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.722+0000 7f58f1ffb640 1 -- 10.20.193.28:0/3227329970 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8038680 con 0x7f58fc10eef0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.722+0000 7f5901d1c640 1 -- 10.20.193.28:0/3227329970 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58fc1ae190 con 0x7f58fc10eef0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.723+0000 7f59054aae00 1 Processor -- start 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.723+0000 7f58f1ffb640 1 -- 10.20.193.28:0/3227329970 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f58f8002a60 con 0x7f58fc10eef0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f59054aae00 1 -- start start 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f59054aae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a14110fb0 0x563a14111390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f59054aae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a1410ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f59054aae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410bf60 0x563a14117de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f59054aae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563a1408be00 con 0x563a1410b5e0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f59054aae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563a1405e970 con 0x563a14110fb0 2026-02-20T03:38:39.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f59054aae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563a1400c1f0 con 0x563a1410bf60 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f5900d1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a1410ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f5900d1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a1410ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44848/0 (socket says 10.20.193.28:44848) 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f5900d1a640 1 -- 10.20.193.28:0/2536092745 learned_addr learned my addr 10.20.193.28:0/2536092745 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f5900d1a640 1 -- 10.20.193.28:0/2536092745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410bf60 msgr2=0x563a14117de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f5900d1a640 1 --2- 10.20.193.28:0/2536092745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410bf60 0x563a14117de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f5900d1a640 1 -- 10.20.193.28:0/2536092745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a14110fb0 msgr2=0x563a14111390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f5900d1a640 1 --2- 10.20.193.28:0/2536092745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a14110fb0 0x563a14111390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f5900d1a640 1 -- 10.20.193.28:0/2536092745 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1401f3d0 con 0x563a1410b5e0 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.726+0000 7f5900d1a640 1 --2- 10.20.193.28:0/2536092745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a1410ba20 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009870 tx=0x7f58ec009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a47934dd91333cf server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f58c94e4640 1 -- 10.20.193.28:0/2536092745 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec016070 con 0x563a1410b5e0 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f58c94e4640 1 -- 10.20.193.28:0/2536092745 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58ec004480 con 0x563a1410b5e0 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f58c94e4640 1 -- 10.20.193.28:0/2536092745 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec00bda0 con 0x563a1410b5e0 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f58f1ffb640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58d80b0e20 0x7f58d80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f58f1ffb640 1 -- 10.20.193.28:0/3227329970 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f58f8105920 con 0x7f58fc10eef0 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 -- 10.20.193.28:0/2536092745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 msgr2=0x563a1410ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 --2- 10.20.193.28:0/2536092745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a1410ba20 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009870 tx=0x7f58ec009d40 comp rx=0 tx=0).stop 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f58f3fff640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58d80b0e20 0x7f58d80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 -- 10.20.193.28:0/2536092745 shutdown_connections 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 --2- 10.20.193.28:0/2536092745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410bf60 0x563a14117de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 --2- 10.20.193.28:0/2536092745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a1410ba20 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 --2- 10.20.193.28:0/2536092745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a14110fb0 0x563a14111390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 -- 10.20.193.28:0/2536092745 >> 10.20.193.28:0/2536092745 conn(0x563a140ce240 msgr2=0x563a14109ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 -- 10.20.193.28:0/2536092745 shutdown_connections 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 -- 10.20.193.28:0/2536092745 wait complete. 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 -- start start 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f58f3fff640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58d80b0e20 0x7f58d80b32e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f58e4006fd0 tx=0x7f58e4006d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 Processor -- start 2026-02-20T03:38:39.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a141260b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 0x563a141265f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a14110fb0 0x563a14124860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563a1405a8a0 con 0x563a1410b5e0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563a13e4cf50 con 0x563a1410bf60 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.727+0000 7f59054aae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563a14124df0 con 0x563a14110fb0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f5900d1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a141260b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f5900d1a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a141260b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44860/0 (socket says 10.20.193.28:44860) 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f5900d1a640 1 -- 10.20.193.28:0/2986189191 learned_addr learned my addr 10.20.193.28:0/2986189191 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f5900d1a640 1 -- 10.20.193.28:0/2986189191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a14110fb0 msgr2=0x563a14124860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f5900d1a640 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a14110fb0 0x563a14124860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f5900d1a640 1 -- 10.20.193.28:0/2986189191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 msgr2=0x563a141265f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f5900d1a640 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 0x563a141265f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f5900d1a640 1 -- 10.20.193.28:0/2986189191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1411db70 con 0x563a1410b5e0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f5900d1a640 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a141260b0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f58ec002410 tx=0x7f58ec0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d485fd19ff42e200 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f58ba7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2986189191 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec020070 con 0x563a1410b5e0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2986189191 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58ec017040 con 0x563a1410b5e0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2986189191 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec016070 con 0x563a1410b5e0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 1 -- 10.20.193.28:0/2986189191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a13e2fb40 con 0x563a1410b5e0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2986189191 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f58ec011400 con 0x563a1410b5e0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 10 client.21939 _ll_register_callbacks cb 0x563a14097eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 1 -- 10.20.193.28:0/2986189191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563a1406c150 con 0x563a1410b5e0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2986189191 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f58ec01b400 con 0x563a1410b5e0 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 10 client.21939 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:39.736 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 1 -- 10.20.193.28:0/2986189191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x563a140191e0 con 0x563a1410b5e0 2026-02-20T03:38:39.745 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.60 MB/sec execute 490 sec latency 69746.123 ms 2026-02-20T03:38:39.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2986189191 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f58ec01bb60 con 0x563a1410b5e0 2026-02-20T03:38:39.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 10 client.21939 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:39.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 10 client.21939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:39.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 20 client.21939 populate_metadata read hostname 'trial028' 2026-02-20T03:38:39.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a141349d0 0x563a14136dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 4 client.21939 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:39.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.730+0000 7f59054aae00 1 -- 10.20.193.28:0/2986189191 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a14066560 con 0x563a141349d0 2026-02-20T03:38:39.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.743+0000 7f58f3fff640 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a141349d0 0x563a14136dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:39.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.797+0000 7f58f3fff640 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a141349d0 0x563a14136dc0 crc :-1 s=READY pgs=597 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=237a1f0ebf320d61 server_cookie=2691828a9bdd4665 in_seq=0 out_seq=0 2026-02-20T03:38:39.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.797+0000 7f58ba7fc640 10 client.21939 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:39.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2986189191 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563a14066560 con 0x563a141349d0 2026-02-20T03:38:39.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f58ba7fc640 10 client.21939 handle_command_reply: tid=0 2026-02-20T03:38:39.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 client.21939 shutdown 2026-02-20T03:38:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 -- 10.20.193.28:0/2986189191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 msgr2=0x563a141260b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a141260b0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f58ec002410 tx=0x7f58ec0094a0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 -- 10.20.193.28:0/2986189191 shutdown_connections 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a141349d0 0x563a14136dc0 crc :-1 s=READY pgs=597 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a14110fb0 0x563a14124860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 0x563a141265f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 --2- 10.20.193.28:0/2986189191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a1410b5e0 0x563a141260b0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 -- 10.20.193.28:0/2986189191 >> 10.20.193.28:0/2986189191 conn(0x563a140ce240 msgr2=0x563a1410a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f58ba7fc640 0 client.21939 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 -- 10.20.193.28:0/2986189191 shutdown_connections 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 1 -- 10.20.193.28:0/2986189191 wait complete. 2026-02-20T03:38:39.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.824+0000 7f59054aae00 20 client.21939 trim_cache size 0 max 16384 2026-02-20T03:38:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 Processor -- start 2026-02-20T03:38:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- start start 2026-02-20T03:38:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410b5e0 0x563a14126500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 0x563a14121bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14122130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0012750 con 0x563a14110fb0 2026-02-20T03:38:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f58a000ffc0 con 0x563a1410bf60 2026-02-20T03:38:39.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f58a000de10 con 0x563a1410b5e0 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14122130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14122130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44874/0 (socket says 10.20.193.28:44874) 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 -- 10.20.193.28:0/3198080054 learned_addr learned my addr 10.20.193.28:0/3198080054 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 -- 10.20.193.28:0/3198080054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410b5e0 msgr2=0x563a14126500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- 10.20.193.28:0/3198080054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410b5e0 0x563a14126500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 -- 10.20.193.28:0/3198080054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 msgr2=0x563a14121bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- 10.20.193.28:0/3198080054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 0x563a14121bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 -- 10.20.193.28:0/3198080054 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a1411d9a0 con 0x563a14110fb0 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- 10.20.193.28:0/3198080054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14122130 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f58f80cd590 tx=0x7f58f80cd500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7581e1236df442b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f58c8ce3640 1 -- 10.20.193.28:0/3198080054 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80cdd00 con 0x563a14110fb0 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f58c8ce3640 1 -- 10.20.193.28:0/3198080054 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58f8033020 con 0x563a14110fb0 2026-02-20T03:38:39.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f58c8ce3640 1 -- 10.20.193.28:0/3198080054 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8041c30 con 0x563a14110fb0 2026-02-20T03:38:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- 10.20.193.28:0/3198080054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 msgr2=0x563a14122130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- 10.20.193.28:0/3198080054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14122130 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f58f80cd590 tx=0x7f58f80cd500 comp rx=0 tx=0).stop 2026-02-20T03:38:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- 10.20.193.28:0/3198080054 shutdown_connections 2026-02-20T03:38:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- 10.20.193.28:0/3198080054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14122130 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- 10.20.193.28:0/3198080054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 0x563a14121bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- 10.20.193.28:0/3198080054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410b5e0 0x563a14126500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- 10.20.193.28:0/3198080054 >> 10.20.193.28:0/3198080054 conn(0x563a140ce240 msgr2=0x563a14125df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- 10.20.193.28:0/3198080054 shutdown_connections 2026-02-20T03:38:39.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- 10.20.193.28:0/3198080054 wait complete. 2026-02-20T03:38:39.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- start start 2026-02-20T03:38:39.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 Processor -- start 2026-02-20T03:38:39.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410b5e0 0x563a1412bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 0x563a1412c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14128f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f58a000e480 con 0x563a14110fb0 2026-02-20T03:38:39.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f58a000f8f0 con 0x563a1410bf60 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f58a000eb50 con 0x563a1410b5e0 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14128f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14128f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44882/0 (socket says 10.20.193.28:44882) 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 -- 10.20.193.28:0/2307572822 learned_addr learned my addr 10.20.193.28:0/2307572822 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 -- 10.20.193.28:0/2307572822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410b5e0 msgr2=0x563a1412bfb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410b5e0 0x563a1412bfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 -- 10.20.193.28:0/2307572822 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 msgr2=0x563a1412c4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 0x563a1412c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 -- 10.20.193.28:0/2307572822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a13d3d870 con 0x563a14110fb0 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f590151b640 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14128f80 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f58f8044040 tx=0x7f58f80cdd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa70b674f1fafd2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:39.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f58ba7fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2307572822 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8002d80 con 0x563a14110fb0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2307572822 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f58f8041e40 con 0x563a14110fb0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2307572822 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80c7b40 con 0x563a14110fb0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- 10.20.193.28:0/2307572822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a13ffe3f0 con 0x563a14110fb0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2307572822 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f58f80c7ce0 con 0x563a14110fb0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 10 client.21945 _ll_register_callbacks cb 0x7f58ec014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- 10.20.193.28:0/2307572822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563a14010ab0 con 0x563a14110fb0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2307572822 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f58f80ccec0 con 0x563a14110fb0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 10 client.21945 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.830+0000 7f59054aae00 1 -- 10.20.193.28:0/2307572822 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x563a1411e690 con 0x563a14110fb0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.835+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2307572822 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f58f80d2b40 con 0x563a14110fb0 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.835+0000 7f59054aae00 10 client.21945 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:39.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.835+0000 7f59054aae00 10 client.21945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.835+0000 7f59054aae00 20 client.21945 populate_metadata read hostname 'trial028' 2026-02-20T03:38:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.835+0000 7f59054aae00 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a1419fe40 0x563a141a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.835+0000 7f59054aae00 4 client.21945 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:38:39.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.835+0000 7f59054aae00 1 -- 10.20.193.28:0/2307572822 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f58ec004480 con 0x563a1419fe40 2026-02-20T03:38:39.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.851+0000 7f5900d1a640 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a1419fe40 0x563a141a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:39.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.917+0000 7f5900d1a640 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a1419fe40 0x563a141a22d0 crc :-1 s=READY pgs=598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d62d7a892ef383e server_cookie=b3ea5c406ef671e2 in_seq=0 out_seq=0 2026-02-20T03:38:39.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.917+0000 7f58ba7fc640 10 client.21945 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f58ba7fc640 1 -- 10.20.193.28:0/2307572822 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f58ec004480 con 0x563a1419fe40 2026-02-20T03:38:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f58ba7fc640 10 client.21945 handle_command_reply: tid=0 2026-02-20T03:38:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 client.21945 shutdown 2026-02-20T03:38:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 -- 10.20.193.28:0/2307572822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 msgr2=0x563a14128f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14128f80 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f58f8044040 tx=0x7f58f80cdd80 comp rx=0 tx=0).stop 2026-02-20T03:38:39.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 -- 10.20.193.28:0/2307572822 shutdown_connections 2026-02-20T03:38:39.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x563a1419fe40 0x563a141a22d0 crc :-1 s=READY pgs=598 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563a14110fb0 0x563a14128f80 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563a1410bf60 0x563a1412c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 --2- 10.20.193.28:0/2307572822 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563a1410b5e0 0x563a1412bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 -- 10.20.193.28:0/2307572822 >> 10.20.193.28:0/2307572822 conn(0x563a140ce240 msgr2=0x563a14123880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:39.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f58ba7fc640 0 client.21945 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:39.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 -- 10.20.193.28:0/2307572822 shutdown_connections 2026-02-20T03:38:39.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 1 -- 10.20.193.28:0/2307572822 wait complete. 2026-02-20T03:38:39.935 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f59054aae00 20 client.21945 trim_cache size 0 max 16384 2026-02-20T03:38:39.946 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:38:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 -- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58d80b0e20 msgr2=0x7f58d80b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58d80b0e20 0x7f58d80b32e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f58e4006fd0 tx=0x7f58e4006d60 comp rx=0 tx=0).stop 2026-02-20T03:38:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 -- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc10eef0 msgr2=0x7f58fc1a5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc10eef0 0x7f58fc1a5ee0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f58f800b1d0 tx=0x7f58f8009300 comp rx=0 tx=0).stop 2026-02-20T03:38:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 -- 10.20.193.28:0/3227329970 shutdown_connections 2026-02-20T03:38:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f58d80b0e20 0x7f58d80b32e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f58fc10eef0 0x7f58fc1a5ee0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f58fc109ba0 0x7f58fc1a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 --2- 10.20.193.28:0/3227329970 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f58fc109220 0x7f58fc1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:39.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 -- 10.20.193.28:0/3227329970 >> 10.20.193.28:0/3227329970 conn(0x7f58fc078600 msgr2=0x7f58fc079f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:39.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 -- 10.20.193.28:0/3227329970 shutdown_connections 2026-02-20T03:38:39.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:39.931+0000 7f5901d1c640 1 -- 10.20.193.28:0/3227329970 wait complete. 2026-02-20T03:38:40.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.56 MB/sec execute 491 sec latency 70746.164 ms 2026-02-20T03:38:41.143 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:38:41.143 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:38:41.428 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:41.655 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:41 trial028 ceph-mon[38552]: pgmap v906: 129 pgs: 129 active+clean; 721 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 277 KiB/s rd, 275 KiB/s wr, 108 op/s 2026-02-20T03:38:41.674 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.670+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3639634946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109ba0 msgr2=0x7fb2ac115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:41.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.670+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3639634946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109ba0 0x7fb2ac115d10 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800b0a0 tx=0x7fb2a802f450 comp rx=0 tx=0).stop 2026-02-20T03:38:41.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.670+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3639634946 shutdown_connections 2026-02-20T03:38:41.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.670+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3639634946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109ba0 0x7fb2ac115d10 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.670+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3639634946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb2ac109220 0x7fb2ac109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.670+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3639634946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb2ac10eef0 0x7fb2ac10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.670+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3639634946 >> 10.20.193.28:0/3639634946 conn(0x7fb2ac078600 msgr2=0x7fb2ac07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:41.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.670+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3639634946 shutdown_connections 2026-02-20T03:38:41.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.670+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3639634946 wait complete. 2026-02-20T03:38:41.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.672+0000 7fb2b2bff640 1 Processor -- start 2026-02-20T03:38:41.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.672+0000 7fb2b2bff640 1 -- start start 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.672+0000 7fb2b2bff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109220 0x7fb2ac1a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b2bff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb2ac109ba0 0x7fb2ac1a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b2bff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb2ac10eef0 0x7fb2ac1a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b2bff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac1191b0 con 0x7fb2ac109220 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b2bff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac119030 con 0x7fb2ac109ba0 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b2bff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac119330 con 0x7fb2ac10eef0 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b1bfd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109220 0x7fb2ac1a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b1bfd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109220 0x7fb2ac1a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44906/0 (socket says 10.20.193.28:44906) 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b1bfd640 1 -- 10.20.193.28:0/3521527527 learned_addr learned my addr 10.20.193.28:0/3521527527 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b1bfd640 1 -- 10.20.193.28:0/3521527527 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb2ac10eef0 msgr2=0x7fb2ac1a5ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:41.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b1bfd640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb2ac10eef0 0x7fb2ac1a5ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.683 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b1bfd640 1 -- 10.20.193.28:0/3521527527 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb2ac109ba0 msgr2=0x7fb2ac1a1b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b1bfd640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb2ac109ba0 0x7fb2ac1a1b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b1bfd640 1 -- 10.20.193.28:0/3521527527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac1a6620 con 0x7fb2ac109220 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb2b1bfd640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109220 0x7fb2ac1a15d0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00b570 tx=0x7fb29c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.673+0000 7fb29affd640 1 -- 10.20.193.28:0/3521527527 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c013020 con 0x7fb2ac109220 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb29affd640 1 -- 10.20.193.28:0/3521527527 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb29c004480 con 0x7fb2ac109220 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb29affd640 1 -- 10.20.193.28:0/3521527527 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c00fb50 con 0x7fb2ac109220 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3521527527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac1a6910 con 0x7fb2ac109220 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3521527527 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac1ae150 con 0x7fb2ac109220 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb29affd640 1 -- 10.20.193.28:0/3521527527 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fb29c002780 con 0x7fb2ac109220 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 Processor -- start 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 -- start start 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a1a70 0x55a4431a5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a5b60 0x55a4431a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a4430f3c00 con 0x55a4431a10c0 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a4430a13c0 con 0x55a4431a5b60 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a4430efb30 con 0x55a4431a1a70 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b23fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b23fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44910/0 (socket says 10.20.193.28:44910) 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b23fe640 1 -- 10.20.193.28:0/582492410 learned_addr learned my addr 10.20.193.28:0/582492410 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b23fe640 1 -- 10.20.193.28:0/582492410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a1a70 msgr2=0x55a4431a5540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/582492410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a1a70 0x55a4431a5540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b23fe640 1 -- 10.20.193.28:0/582492410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a5b60 msgr2=0x55a4431a5fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/582492410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a5b60 0x55a4431a5fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b23fe640 1 -- 10.20.193.28:0/582492410 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a44309a840 con 0x55a4431a10c0 2026-02-20T03:38:41.684 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/582492410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a14a0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009850 tx=0x7fb2a8009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b631b80a1ddffd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb27a4e6640 1 -- 10.20.193.28:0/582492410 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8004d40 con 0x55a4431a10c0 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb27a4e6640 1 -- 10.20.193.28:0/582492410 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb2a8033030 con 0x55a4431a10c0 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb27a4e6640 1 -- 10.20.193.28:0/582492410 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8002cc0 con 0x55a4431a10c0 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb29affd640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2880b0da0 0x7fb2880b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb29affd640 1 -- 10.20.193.28:0/3521527527 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fb29c0e0660 con 0x7fb2ac109220 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 -- 10.20.193.28:0/582492410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 msgr2=0x55a4431a14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.674+0000 7fb2b638de00 1 --2- 10.20.193.28:0/582492410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a14a0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009850 tx=0x7fb2a8009e00 comp rx=0 tx=0).stop 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- 10.20.193.28:0/582492410 shutdown_connections 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 --2- 10.20.193.28:0/582492410 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a5b60 0x55a4431a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 --2- 10.20.193.28:0/582492410 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a1a70 0x55a4431a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 --2- 10.20.193.28:0/582492410 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a14a0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- 10.20.193.28:0/582492410 >> 10.20.193.28:0/582492410 conn(0x55a443199b60 msgr2=0x55a44319f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- 10.20.193.28:0/582492410 shutdown_connections 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b1bfd640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2880b0da0 0x7fb2880b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- 10.20.193.28:0/582492410 wait complete. 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b1bfd640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2880b0da0 0x7fb2880b3260 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0a8040 tx=0x7fb29c004850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- start start 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 Processor -- start 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a10c0 0x55a4431bb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a1a70 0x55a4431bb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a5b60 0x55a4431b9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a44309b1a0 con 0x55a4431a1a70 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a4431add10 con 0x55a4431a10c0 2026-02-20T03:38:41.685 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a4431b9ec0 con 0x55a4431a5b60 2026-02-20T03:38:41.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b13fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a1a70 0x55a4431bb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:41.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b13fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a1a70 0x55a4431bb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44918/0 (socket says 10.20.193.28:44918) 2026-02-20T03:38:41.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b13fc640 1 -- 10.20.193.28:0/813050358 learned_addr learned my addr 10.20.193.28:0/813050358 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:41.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b13fc640 1 -- 10.20.193.28:0/813050358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a5b60 msgr2=0x55a4431b9880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:41.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b13fc640 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a5b60 0x55a4431b9880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b13fc640 1 -- 10.20.193.28:0/813050358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a10c0 msgr2=0x55a4431bb0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:41.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b13fc640 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a10c0 0x55a4431bb0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b13fc640 1 -- 10.20.193.28:0/813050358 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4431b3590 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b13fc640 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a1a70 0x55a4431bb610 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009ed0 tx=0x7fb2a000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889bba4a2d5a0f0f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2637fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2637fe640 1 -- 10.20.193.28:0/813050358 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0016070 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2637fe640 1 -- 10.20.193.28:0/813050358 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb2a0002780 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2637fe640 1 -- 10.20.193.28:0/813050358 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00117e0 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- 10.20.193.28:0/813050358 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a442ec2b60 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2637fe640 1 -- 10.20.193.28:0/813050358 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fb2a001a3b0 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 10 client.21957 _ll_register_callbacks cb 0x55a44309f0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- 10.20.193.28:0/813050358 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4430fb7f0 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2637fe640 1 -- 10.20.193.28:0/813050358 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fb2a0002cc0 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 10 client.21957 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- 10.20.193.28:0/813050358 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55a4430c0430 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2637fe640 1 -- 10.20.193.28:0/813050358 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7fb2a0023020 con 0x55a4431a1a70 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 10 client.21957 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 10 client.21957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 20 client.21957 populate_metadata read hostname 'trial028' 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a4431c9980 0x55a4431cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 4 client.21957 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:41.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.680+0000 7fb2b638de00 1 -- 10.20.193.28:0/813050358 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a443075c00 con 0x55a4431c9980 2026-02-20T03:38:41.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.706+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a4431c9980 0x55a4431cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:41.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:41 trial177 ceph-mon[43181]: pgmap v906: 129 pgs: 129 active+clean; 721 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 277 KiB/s rd, 275 KiB/s wr, 108 op/s 2026-02-20T03:38:41.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.52 MB/sec execute 492 sec latency 71746.204 ms 2026-02-20T03:38:41.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.773+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a4431c9980 0x55a4431cbe40 crc :-1 s=READY pgs=599 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29f0e3ace4240554 server_cookie=5feeb4f26199ce99 in_seq=0 out_seq=0 2026-02-20T03:38:41.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.773+0000 7fb2637fe640 10 client.21957 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.799+0000 7fb2637fe640 1 -- 10.20.193.28:0/813050358 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a443075c00 con 0x55a4431c9980 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.799+0000 7fb2637fe640 10 client.21957 handle_command_reply: tid=0 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.799+0000 7fb2b638de00 1 client.21957 shutdown 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 -- 10.20.193.28:0/813050358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a1a70 msgr2=0x55a4431bb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a1a70 0x55a4431bb610 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009ed0 tx=0x7fb2a000b4b0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 -- 10.20.193.28:0/813050358 shutdown_connections 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a4431c9980 0x55a4431cbe40 crc :-1 s=READY pgs=599 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a5b60 0x55a4431b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a1a70 0x55a4431bb610 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 --2- 10.20.193.28:0/813050358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a10c0 0x55a4431bb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 -- 10.20.193.28:0/813050358 >> 10.20.193.28:0/813050358 conn(0x55a443199b60 msgr2=0x55a4431a4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2637fe640 0 client.21957 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:41.802 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 -- 10.20.193.28:0/813050358 shutdown_connections 2026-02-20T03:38:41.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 1 -- 10.20.193.28:0/813050358 wait complete. 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.800+0000 7fb2b638de00 20 client.21957 trim_cache size 0 max 16384 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b638de00 1 Processor -- start 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b638de00 1 -- start start 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a1a70 0x55a4431c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a5b60 0x55a4431c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b638de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb258012740 con 0x55a4431a10c0 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b638de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb25800ffb0 con 0x55a4431a1a70 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b638de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb25800de00 con 0x55a4431a5b60 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b23fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b23fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44920/0 (socket says 10.20.193.28:44920) 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b23fe640 1 -- 10.20.193.28:0/1969090490 learned_addr learned my addr 10.20.193.28:0/1969090490 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b23fe640 1 -- 10.20.193.28:0/1969090490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a5b60 msgr2=0x55a4431c1510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/1969090490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a5b60 0x55a4431c1510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b23fe640 1 -- 10.20.193.28:0/1969090490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a1a70 msgr2=0x55a4431c0fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/1969090490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a1a70 0x55a4431c0fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b23fe640 1 -- 10.20.193.28:0/1969090490 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4431b33c0 con 0x55a4431a10c0 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.805+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/1969090490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a6f50 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8004600 tx=0x7fb2a80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d56fcb3de77848e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb279ce5640 1 -- 10.20.193.28:0/1969090490 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80040e0 con 0x55a4431a10c0 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb279ce5640 1 -- 10.20.193.28:0/1969090490 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb2a8004280 con 0x55a4431a10c0 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb279ce5640 1 -- 10.20.193.28:0/1969090490 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80387c0 con 0x55a4431a10c0 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- 10.20.193.28:0/1969090490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 msgr2=0x55a4431a6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:41.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1969090490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a6f50 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8004600 tx=0x7fb2a80046d0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- 10.20.193.28:0/1969090490 shutdown_connections 2026-02-20T03:38:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1969090490 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a5b60 0x55a4431c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1969090490 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a1a70 0x55a4431c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1969090490 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a4431a6f50 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- 10.20.193.28:0/1969090490 >> 10.20.193.28:0/1969090490 conn(0x55a443199b60 msgr2=0x55a4431a41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- 10.20.193.28:0/1969090490 shutdown_connections 2026-02-20T03:38:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- 10.20.193.28:0/1969090490 wait complete. 2026-02-20T03:38:41.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- start start 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 Processor -- start 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a44322fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a1a70 0x55a443230090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a5b60 0x55a44322e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fb25800e470 con 0x55a4431a10c0 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fb25800f8e0 con 0x55a4431a5b60 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fb25800eb40 con 0x55a4431a1a70 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b23fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a44322fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b23fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a44322fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44932/0 (socket says 10.20.193.28:44932) 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b23fe640 1 -- 10.20.193.28:0/1848575156 learned_addr learned my addr 10.20.193.28:0/1848575156 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:41.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b23fe640 1 -- 10.20.193.28:0/1848575156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a1a70 msgr2=0x55a443230090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a1a70 0x55a443230090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b23fe640 1 -- 10.20.193.28:0/1848575156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a5b60 msgr2=0x55a44322e8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a5b60 0x55a44322e8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b23fe640 1 -- 10.20.193.28:0/1848575156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a442dd2900 con 0x55a4431a10c0 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b23fe640 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a44322fb50 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80060b0 tx=0x7fb2a80096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c694b4817f84871 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2637fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2637fe640 1 -- 10.20.193.28:0/1848575156 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8045070 con 0x55a4431a10c0 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2637fe640 1 -- 10.20.193.28:0/1848575156 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fb2a8033070 con 0x55a4431a10c0 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2637fe640 1 -- 10.20.193.28:0/1848575156 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8007df0 con 0x55a4431a10c0 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- 10.20.193.28:0/1848575156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4430ae4d0 con 0x55a4431a10c0 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 10 client.21963 _ll_register_callbacks cb 0x7fb2a0009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- 10.20.193.28:0/1848575156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a4431015a0 con 0x55a4431a10c0 2026-02-20T03:38:41.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2637fe640 1 -- 10.20.193.28:0/1848575156 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fb2a8002af0 con 0x55a4431a10c0 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2637fe640 1 -- 10.20.193.28:0/1848575156 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fb2a8004940 con 0x55a4431a10c0 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 10 client.21963 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.810+0000 7fb2b638de00 1 -- 10.20.193.28:0/1848575156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55a4431b40b0 con 0x55a4431a10c0 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.813+0000 7fb2637fe640 1 -- 10.20.193.28:0/1848575156 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7fb2a8051070 con 0x55a4431a10c0 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.813+0000 7fb2b638de00 10 client.21963 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.813+0000 7fb2b638de00 10 client.21963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.813+0000 7fb2b638de00 20 client.21963 populate_metadata read hostname 'trial028' 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.813+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a443237150 0x55a443239540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.813+0000 7fb2b638de00 4 client.21963 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:38:41.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.813+0000 7fb2b638de00 1 -- 10.20.193.28:0/1848575156 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fb2a8004280 con 0x55a443237150 2026-02-20T03:38:41.829 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.827+0000 7fb2b13fc640 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a443237150 0x55a443239540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:41.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:41 trial126 ceph-mon[38476]: pgmap v906: 129 pgs: 129 active+clean; 721 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 277 KiB/s rd, 275 KiB/s wr, 108 op/s 2026-02-20T03:38:41.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.894+0000 7fb2b13fc640 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a443237150 0x55a443239540 crc :-1 s=READY pgs=600 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11cc50893245b682 server_cookie=e27b3eae08b6e2bf in_seq=0 out_seq=0 2026-02-20T03:38:41.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.894+0000 7fb2637fe640 10 client.21963 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:41.909 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2637fe640 1 -- 10.20.193.28:0/1848575156 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fb2a8004280 con 0x55a443237150 2026-02-20T03:38:41.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2637fe640 10 client.21963 handle_command_reply: tid=0 2026-02-20T03:38:41.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 client.21963 shutdown 2026-02-20T03:38:41.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 -- 10.20.193.28:0/1848575156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 msgr2=0x55a44322fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:41.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a44322fb50 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80060b0 tx=0x7fb2a80096a0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 -- 10.20.193.28:0/1848575156 shutdown_connections 2026-02-20T03:38:41.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a443237150 0x55a443239540 crc :-1 s=READY pgs=600 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a4431a5b60 0x55a44322e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a4431a1a70 0x55a443230090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 --2- 10.20.193.28:0/1848575156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a4431a10c0 0x55a44322fb50 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 -- 10.20.193.28:0/1848575156 >> 10.20.193.28:0/1848575156 conn(0x55a443199b60 msgr2=0x55a4431a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:41.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2637fe640 0 client.21963 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:41.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 -- 10.20.193.28:0/1848575156 shutdown_connections 2026-02-20T03:38:41.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.907+0000 7fb2b638de00 1 -- 10.20.193.28:0/1848575156 wait complete. 2026-02-20T03:38:41.912 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b638de00 20 client.21963 trim_cache size 0 max 16384 2026-02-20T03:38:41.923 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:38:41.923 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:38:41.923 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "5b751d16-bf4c-4dab-838f-de09b7b2559a", 2026-02-20T03:38:41.923 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:38:41.923 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:38:41.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2880b0da0 msgr2=0x7fb2880b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:41.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2880b0da0 0x7fb2880b3260 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0a8040 tx=0x7fb29c004850 comp rx=0 tx=0).stop 2026-02-20T03:38:41.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109220 msgr2=0x7fb2ac1a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:41.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109220 0x7fb2ac1a15d0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00b570 tx=0x7fb29c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:38:41.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3521527527 shutdown_connections 2026-02-20T03:38:41.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fb2880b0da0 0x7fb2880b3260 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fb2ac10eef0 0x7fb2ac1a5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fb2ac109ba0 0x7fb2ac1a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 --2- 10.20.193.28:0/3521527527 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fb2ac109220 0x7fb2ac1a15d0 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:41.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3521527527 >> 10.20.193.28:0/3521527527 conn(0x7fb2ac078600 msgr2=0x7fb2ac079e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:41.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3521527527 shutdown_connections 2026-02-20T03:38:41.925 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:41.908+0000 7fb2b2bff640 1 -- 10.20.193.28:0/3521527527 wait complete. 2026-02-20T03:38:42.056 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:38:42.354 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:38:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.607+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/229290754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb81065d0 msgr2=0x7f0bb8075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.607+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/229290754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb81065d0 0x7f0bb8075410 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009a30 tx=0x7f0ba402f2f0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.607+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/229290754 shutdown_connections 2026-02-20T03:38:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.607+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/229290754 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bb81134d0 0x7f0bb8115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.607+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/229290754 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bb8075950 0x7f0bb8075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.607+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/229290754 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb81065d0 0x7f0bb8075410 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.612 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.607+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/229290754 >> 10.20.193.28:0/229290754 conn(0x7f0bb80fe440 msgr2=0x7f0bb8100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:42.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.607+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/229290754 shutdown_connections 2026-02-20T03:38:42.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.607+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/229290754 wait complete. 2026-02-20T03:38:42.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.610+0000 7f0bbcfe4640 1 Processor -- start 2026-02-20T03:38:42.614 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.610+0000 7f0bbcfe4640 1 -- start start 2026-02-20T03:38:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bbcfe4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb8075950 0x7f0bb81a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bbcfe4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bb81065d0 0x7f0bb81a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bbcfe4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bb81134d0 0x7f0bb81a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bbcfe4640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb81191d0 con 0x7f0bb8075950 2026-02-20T03:38:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bbcfe4640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb8119050 con 0x7f0bb81134d0 2026-02-20T03:38:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bbcfe4640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb8119350 con 0x7f0bb81065d0 2026-02-20T03:38:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bb77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb8075950 0x7f0bb81a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:42.615 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bb77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb8075950 0x7f0bb81a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44956/0 (socket says 10.20.193.28:44956) 2026-02-20T03:38:42.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bb77fe640 1 -- 10.20.193.28:0/1114286687 learned_addr learned my addr 10.20.193.28:0/1114286687 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:42.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bb77fe640 1 -- 10.20.193.28:0/1114286687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bb81065d0 msgr2=0x7f0bb81a1c70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:42.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bb77fe640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bb81065d0 0x7f0bb81a1c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.621 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bb77fe640 1 -- 10.20.193.28:0/1114286687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bb81134d0 msgr2=0x7f0bb81a6000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bb77fe640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bb81134d0 0x7f0bb81a6000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bb77fe640 1 -- 10.20.193.28:0/1114286687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb81a6780 con 0x7f0bb8075950 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.611+0000 7f0bb77fe640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb8075950 0x7f0bb81a1730 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4002910 tx=0x7f0ba4002940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.612+0000 7f0bb4ff9640 1 -- 10.20.193.28:0/1114286687 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4002c70 con 0x7f0bb8075950 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.612+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/1114286687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb81a6a10 con 0x7f0bb8075950 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.612+0000 7f0bb4ff9640 1 -- 10.20.193.28:0/1114286687 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0ba40054d0 con 0x7f0bb8075950 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.612+0000 7f0bb4ff9640 1 -- 10.20.193.28:0/1114286687 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40386d0 con 0x7f0bb8075950 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.612+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/1114286687 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb81ae2b0 con 0x7f0bb8075950 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb4ff9640 1 -- 10.20.193.28:0/1114286687 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0ba4038870 con 0x7f0bb8075950 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 Processor -- start 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 -- start start 2026-02-20T03:38:42.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b1a000 0x55a1f4b1a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14630 0x55a1f4b14a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b20e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4a94e50 con 0x55a1f4b1a000 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4a679c0 con 0x55a1f4b14fb0 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4a15240 con 0x55a1f4b14630 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b1a000 0x55a1f4b1a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b1a000 0x55a1f4b1a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44964/0 (socket says 10.20.193.28:44964) 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb7fff640 1 -- 10.20.193.28:0/1140519993 learned_addr learned my addr 10.20.193.28:0/1140519993 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb7fff640 1 -- 10.20.193.28:0/1140519993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14630 msgr2=0x55a1f4b14a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/1140519993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14630 0x55a1f4b14a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb7fff640 1 -- 10.20.193.28:0/1140519993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14fb0 msgr2=0x55a1f4b20e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:42.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/1140519993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b20e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb7fff640 1 -- 10.20.193.28:0/1140519993 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4a28420 con 0x55a1f4b1a000 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/1140519993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b1a000 0x55a1f4b1a3e0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009d20 tx=0x7f0bac00b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328cdd5631fbb402 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb4ff9640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b8c0b0e20 0x7f0b8c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0b7bfff640 1 -- 10.20.193.28:0/1140519993 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac017070 con 0x55a1f4b1a000 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0b7bfff640 1 -- 10.20.193.28:0/1140519993 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0bac00bd50 con 0x55a1f4b1a000 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0b7bfff640 1 -- 10.20.193.28:0/1140519993 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac006e60 con 0x55a1f4b1a000 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb4ff9640 1 -- 10.20.193.28:0/1114286687 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0ba4105590 con 0x7f0bb8075950 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1140519993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b1a000 msgr2=0x55a1f4b1a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1140519993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b1a000 0x55a1f4b1a3e0 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009d20 tx=0x7f0bac00b420 comp rx=0 tx=0).stop 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bb77fe640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b8c0b0e20 0x7f0b8c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1140519993 shutdown_connections 2026-02-20T03:38:42.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1140519993 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b20e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1140519993 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14630 0x55a1f4b14a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1140519993 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b1a000 0x55a1f4b1a3e0 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.615+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1140519993 >> 10.20.193.28:0/1140519993 conn(0x55a1f4ad7290 msgr2=0x55a1f4b12d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:42.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.617+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1140519993 shutdown_connections 2026-02-20T03:38:42.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.617+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1140519993 wait complete. 2026-02-20T03:38:42.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.617+0000 7f0bb77fe640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b8c0b0e20 0x7f0b8c0b32e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40cdf20 tx=0x7f0ba4004c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:42.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bc0772e00 1 -- start start 2026-02-20T03:38:42.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bc0772e00 1 Processor -- start 2026-02-20T03:38:42.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b14630 0x55a1f4b2ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b2f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b1a000 0x55a1f4b2d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4a638f0 con 0x55a1f4b14630 2026-02-20T03:38:42.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4855f50 con 0x55a1f4b1a000 2026-02-20T03:38:42.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55a1f4b2de40 con 0x55a1f4b14fb0 2026-02-20T03:38:42.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bb7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b14630 0x55a1f4b2ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:42.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bb7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b14630 0x55a1f4b2ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44980/0 (socket says 10.20.193.28:44980) 2026-02-20T03:38:42.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bb7fff640 1 -- 10.20.193.28:0/3901354130 learned_addr learned my addr 10.20.193.28:0/3901354130 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:42.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bb7fff640 1 -- 10.20.193.28:0/3901354130 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 msgr2=0x55a1f4b2f4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:42.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b2f4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bb7fff640 1 -- 10.20.193.28:0/3901354130 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b1a000 msgr2=0x55a1f4b2d6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:42.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b1a000 0x55a1f4b2d6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bb7fff640 1 -- 10.20.193.28:0/3901354130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4b26b20 con 0x55a1f4b14630 2026-02-20T03:38:42.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b14630 0x55a1f4b2ef80 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f0bac004470 tx=0x7f0bac0049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6afc3f7401a1b38 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:42.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0b797fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0b797fa640 1 -- 10.20.193.28:0/3901354130 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac017050 con 0x55a1f4b14630 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0b797fa640 1 -- 10.20.193.28:0/3901354130 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0bac023070 con 0x55a1f4b14630 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.618+0000 7f0b797fa640 1 -- 10.20.193.28:0/3901354130 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac012410 con 0x55a1f4b14630 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.620+0000 7f0bc0772e00 1 -- 10.20.193.28:0/3901354130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f4838b40 con 0x55a1f4b14630 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.620+0000 7f0b797fa640 1 -- 10.20.193.28:0/3901354130 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0bac0125b0 con 0x55a1f4b14630 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.620+0000 7f0b797fa640 10 client.21975 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.620+0000 7f0bc0772e00 10 client.21975 _ll_register_callbacks cb 0x55a1f4aa0f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.620+0000 7f0bc0772e00 1 -- 10.20.193.28:0/3901354130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1f4a751a0 con 0x55a1f4b14630 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.620+0000 7f0b797fa640 1 -- 10.20.193.28:0/3901354130 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f0bac006e60 con 0x55a1f4b14630 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.620+0000 7f0bc0772e00 10 client.21975 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.620+0000 7f0bc0772e00 1 -- 10.20.193.28:0/3901354130 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55a1f4a22230 con 0x55a1f4b14630 2026-02-20T03:38:42.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.621+0000 7f0b797fa640 1 -- 10.20.193.28:0/3901354130 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f0bac01e450 con 0x55a1f4b14630 2026-02-20T03:38:42.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.621+0000 7f0bc0772e00 10 client.21975 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:42.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.621+0000 7f0bc0772e00 10 client.21975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:42.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.621+0000 7f0bc0772e00 20 client.21975 populate_metadata read hostname 'trial028' 2026-02-20T03:38:42.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.621+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a1f4b3d650 0x55a1f4b3fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.621+0000 7f0bc0772e00 4 client.21975 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:42.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.621+0000 7f0bc0772e00 1 -- 10.20.193.28:0/3901354130 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1f4a6f5b0 con 0x55a1f4b3d650 2026-02-20T03:38:42.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.645+0000 7f0bb6ffd640 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a1f4b3d650 0x55a1f4b3fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:42.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.711+0000 7f0bb6ffd640 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a1f4b3d650 0x55a1f4b3fa40 crc :-1 s=READY pgs=601 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22f5e3a06e8f5368 server_cookie=960aad33d5ba127b in_seq=0 out_seq=0 2026-02-20T03:38:42.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.711+0000 7f0b797fa640 10 client.21975 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:42.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:42 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:38:42.726 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:42 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:38:42.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0b797fa640 1 -- 10.20.193.28:0/3901354130 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55a1f4a6f5b0 con 0x55a1f4b3d650 2026-02-20T03:38:42.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0b797fa640 10 client.21975 handle_command_reply: tid=0 2026-02-20T03:38:42.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0bc0772e00 1 client.21975 shutdown 2026-02-20T03:38:42.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0bc0772e00 1 -- 10.20.193.28:0/3901354130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b14630 msgr2=0x55a1f4b2ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:42.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b14630 0x55a1f4b2ef80 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f0bac004470 tx=0x7f0bac0049e0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0bc0772e00 1 -- 10.20.193.28:0/3901354130 shutdown_connections 2026-02-20T03:38:42.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a1f4b3d650 0x55a1f4b3fa40 crc :-1 s=READY pgs=601 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b1a000 0x55a1f4b2d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b2f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/3901354130 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4b14630 0x55a1f4b2ef80 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0b797fa640 0 client.21975 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:42.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.724+0000 7f0bc0772e00 1 -- 10.20.193.28:0/3901354130 >> 10.20.193.28:0/3901354130 conn(0x55a1f4ad7290 msgr2=0x55a1f4b13440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:42.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.725+0000 7f0bc0772e00 1 -- 10.20.193.28:0/3901354130 shutdown_connections 2026-02-20T03:38:42.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.725+0000 7f0bc0772e00 1 -- 10.20.193.28:0/3901354130 wait complete. 2026-02-20T03:38:42.729 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.725+0000 7f0bc0772e00 20 client.21975 trim_cache size 0 max 16384 2026-02-20T03:38:42.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.48 MB/sec execute 493 sec latency 72746.243 ms 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 Processor -- start 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 -- start start 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b2ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14630 0x55a1f4b3e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b3e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c012740 con 0x55a1f4ad7290 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c00ffb0 con 0x55a1f4b14630 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c00de00 con 0x55a1f4b14fb0 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bb7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b2ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:42.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bb7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b2ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:44996/0 (socket says 10.20.193.28:44996) 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bb7fff640 1 -- 10.20.193.28:0/2327689753 learned_addr learned my addr 10.20.193.28:0/2327689753 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bb7fff640 1 -- 10.20.193.28:0/2327689753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 msgr2=0x55a1f4b3e680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/2327689753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b3e680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bb7fff640 1 -- 10.20.193.28:0/2327689753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14630 msgr2=0x55a1f4b3e140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/2327689753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14630 0x55a1f4b3e140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bb7fff640 1 -- 10.20.193.28:0/2327689753 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4b26950 con 0x55a1f4ad7290 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/2327689753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b2ef80 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f0bac01e5e0 tx=0x7f0bac028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0283864e07e6c05 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0b7b7fe640 1 -- 10.20.193.28:0/2327689753 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac017040 con 0x55a1f4ad7290 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0b7b7fe640 1 -- 10.20.193.28:0/2327689753 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0bac023070 con 0x55a1f4ad7290 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0b7b7fe640 1 -- 10.20.193.28:0/2327689753 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac028a30 con 0x55a1f4ad7290 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 -- 10.20.193.28:0/2327689753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 msgr2=0x55a1f4b2ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:42.741 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.731+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/2327689753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b2ef80 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f0bac01e5e0 tx=0x7f0bac028000 comp rx=0 tx=0).stop 2026-02-20T03:38:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 -- 10.20.193.28:0/2327689753 shutdown_connections 2026-02-20T03:38:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/2327689753 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b3e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/2327689753 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14630 0x55a1f4b3e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/2327689753 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b2ef80 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 -- 10.20.193.28:0/2327689753 >> 10.20.193.28:0/2327689753 conn(0x55a1f4b18080 msgr2=0x55a1f4b3da30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:42.742 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 -- 10.20.193.28:0/2327689753 shutdown_connections 2026-02-20T03:38:42.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 -- 10.20.193.28:0/2327689753 wait complete. 2026-02-20T03:38:42.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 -- start start 2026-02-20T03:38:42.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 Processor -- start 2026-02-20T03:38:42.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b33e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.744 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14630 0x55a1f4b34340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b34880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c00e470 con 0x55a1f4ad7290 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c00f8e0 con 0x55a1f4b14630 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bc0772e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c00eb40 con 0x55a1f4b14fb0 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bb7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b33e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bb7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b33e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45010/0 (socket says 10.20.193.28:45010) 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bb7fff640 1 -- 10.20.193.28:0/1017872389 learned_addr learned my addr 10.20.193.28:0/1017872389 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bb7fff640 1 -- 10.20.193.28:0/1017872389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 msgr2=0x55a1f4b34880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b34880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bb7fff640 1 -- 10.20.193.28:0/1017872389 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14630 msgr2=0x55a1f4b34340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:42.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14630 0x55a1f4b34340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.736+0000 7f0bb7fff640 1 -- 10.20.193.28:0/1017872389 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f4746870 con 0x55a1f4ad7290 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bb7fff640 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b33e00 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f0bac01e970 tx=0x7f0bac028690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17be8b035e8650 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0b797fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0b797fa640 1 -- 10.20.193.28:0/1017872389 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac017040 con 0x55a1f4ad7290 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0b797fa640 1 -- 10.20.193.28:0/1017872389 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0bac042070 con 0x55a1f4ad7290 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0b797fa640 1 -- 10.20.193.28:0/1017872389 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bac03d7b0 con 0x55a1f4ad7290 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1017872389 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f4a07440 con 0x55a1f4ad7290 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0b797fa640 1 -- 10.20.193.28:0/1017872389 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0bac03d950 con 0x55a1f4ad7290 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0b797fa640 10 client.21981 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 10 client.21981 _ll_register_callbacks cb 0x7f0bac015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1017872389 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1f4a19b00 con 0x55a1f4ad7290 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0b797fa640 1 -- 10.20.193.28:0/1017872389 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f0bac03db50 con 0x55a1f4ad7290 2026-02-20T03:38:42.746 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 10 client.21981 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:42.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1017872389 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55a1f4b27640 con 0x55a1f4ad7290 2026-02-20T03:38:42.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0b797fa640 1 -- 10.20.193.28:0/1017872389 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f0bac03c070 con 0x55a1f4ad7290 2026-02-20T03:38:42.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 10 client.21981 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:42.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 10 client.21981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:42.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 20 client.21981 populate_metadata read hostname 'trial028' 2026-02-20T03:38:42.747 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a1f4b1a000 0x55a1f4bab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:42.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 4 client.21981 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:38:42.754 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.738+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1017872389 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f0bac00bd50 con 0x55a1f4b1a000 2026-02-20T03:38:42.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.765+0000 7f0bb6ffd640 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a1f4b1a000 0x55a1f4bab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:42.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.832+0000 7f0bb6ffd640 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a1f4b1a000 0x55a1f4bab550 crc :-1 s=READY pgs=602 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd85691b4d5ce82a server_cookie=2f79edd51df37291 in_seq=0 out_seq=0 2026-02-20T03:38:42.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.832+0000 7f0b797fa640 10 client.21981 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:42.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:42 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:38:42.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0b797fa640 1 -- 10.20.193.28:0/1017872389 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x7f0bac00bd50 con 0x55a1f4b1a000 2026-02-20T03:38:42.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0b797fa640 10 client.21981 handle_command_reply: tid=0 2026-02-20T03:38:42.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 client.21981 shutdown 2026-02-20T03:38:42.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1017872389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 msgr2=0x55a1f4b33e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:42.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b33e00 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f0bac01e970 tx=0x7f0bac028690 comp rx=0 tx=0).stop 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1017872389 shutdown_connections 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55a1f4b1a000 0x55a1f4bab550 crc :-1 s=READY pgs=602 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55a1f4b14fb0 0x55a1f4b34880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55a1f4b14630 0x55a1f4b34340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 --2- 10.20.193.28:0/1017872389 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55a1f4ad7290 0x55a1f4b33e00 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1017872389 >> 10.20.193.28:0/1017872389 conn(0x55a1f4b18080 msgr2=0x55a1f4b3e250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0b797fa640 0 client.21981 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1017872389 shutdown_connections 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 1 -- 10.20.193.28:0/1017872389 wait complete. 2026-02-20T03:38:42.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.845+0000 7f0bc0772e00 20 client.21981 trim_cache size 0 max 16384 2026-02-20T03:38:42.860 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:38:42.860 INFO:teuthology.orchestra.run.trial028.stdout: "status": "scrub active (2 inodes in the stack)", 2026-02-20T03:38:42.861 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:38:42.861 INFO:teuthology.orchestra.run.trial028.stdout: "5b751d16-bf4c-4dab-838f-de09b7b2559a": { 2026-02-20T03:38:42.861 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:38:42.861 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "5b751d16-bf4c-4dab-838f-de09b7b2559a", 2026-02-20T03:38:42.861 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:38:42.861 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:38:42.861 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:38:42.861 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:38:42.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b8c0b0e20 msgr2=0x7f0b8c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:42.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b8c0b0e20 0x7f0b8c0b32e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40cdf20 tx=0x7f0ba4004c80 comp rx=0 tx=0).stop 2026-02-20T03:38:42.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb8075950 msgr2=0x7f0bb81a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:42.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb8075950 0x7f0bb81a1730 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4002910 tx=0x7f0ba4002940 comp rx=0 tx=0).stop 2026-02-20T03:38:42.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/1114286687 shutdown_connections 2026-02-20T03:38:42.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b8c0b0e20 0x7f0b8c0b32e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0bb81134d0 0x7f0bb81a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0bb81065d0 0x7f0bb81a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 --2- 10.20.193.28:0/1114286687 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0bb8075950 0x7f0bb81a1730 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:42.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/1114286687 >> 10.20.193.28:0/1114286687 conn(0x7f0bb80fe440 msgr2=0x7f0bb8114cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:42.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/1114286687 shutdown_connections 2026-02-20T03:38:42.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:38:42.846+0000 7f0bbcfe4640 1 -- 10.20.193.28:0/1114286687 wait complete. 2026-02-20T03:38:43.023 INFO:tasks.cephfs.filesystem:scrub status for tag:5b751d16-bf4c-4dab-838f-de09b7b2559a - {'path': '/', 'tag': '5b751d16-bf4c-4dab-838f-de09b7b2559a', 'options': 'recursive,force'} 2026-02-20T03:38:43.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:43 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:38:43.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:43 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:43.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:43 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:38:43.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:43 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:38:43.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:43 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:43.544 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:43 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:43.545 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:43 trial028 ceph-mon[38552]: pgmap v907: 129 pgs: 129 active+clean; 720 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 91 op/s 2026-02-20T03:38:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:43 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:38:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:43 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:43 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:38:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:43 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:38:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:43 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:43 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:43.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:43 trial177 ceph-mon[43181]: pgmap v907: 129 pgs: 129 active+clean; 720 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 91 op/s 2026-02-20T03:38:43.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.44 MB/sec execute 494 sec latency 73746.288 ms 2026-02-20T03:38:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:43 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:38:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:43 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:43 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:38:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:43 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:38:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:43 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:43 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:43.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:43 trial126 ceph-mon[38476]: pgmap v907: 129 pgs: 129 active+clean; 720 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 153 KiB/s rd, 152 KiB/s wr, 91 op/s 2026-02-20T03:38:44.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.41 MB/sec execute 495 sec latency 74746.729 ms 2026-02-20T03:38:45.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.607+0000 7ff33f3ff640 1 -- 10.20.193.28:0/2124336443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109490 msgr2=0x7ff338109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:45.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.607+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/2124336443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109490 0x7ff338109890 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7ff328009a30 tx=0x7ff32802f260 comp rx=0 tx=0).stop 2026-02-20T03:38:45.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.607+0000 7ff33f3ff640 1 -- 10.20.193.28:0/2124336443 shutdown_connections 2026-02-20T03:38:45.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.607+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/2124336443 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff33810a900 0x7ff338111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.610 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.607+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/2124336443 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff338109e60 0x7ff33810a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.607+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/2124336443 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109490 0x7ff338109890 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.607+0000 7ff33f3ff640 1 -- 10.20.193.28:0/2124336443 >> 10.20.193.28:0/2124336443 conn(0x7ff338077fe0 msgr2=0x7ff33807a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.607+0000 7ff33f3ff640 1 -- 10.20.193.28:0/2124336443 shutdown_connections 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.607+0000 7ff33f3ff640 1 -- 10.20.193.28:0/2124336443 wait complete. 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33f3ff640 1 Processor -- start 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33f3ff640 1 -- start start 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33f3ff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338109490 0x7ff3381a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33f3ff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109e60 0x7ff3381a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33f3ff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff33810a900 0x7ff3381a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33f3ff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff338114a50 con 0x7ff338109e60 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33f3ff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff3381148d0 con 0x7ff33810a900 2026-02-20T03:38:45.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33f3ff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff338114bd0 con 0x7ff338109490 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33dbfc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109e60 0x7ff3381a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33dbfc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109e60 0x7ff3381a15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45018/0 (socket says 10.20.193.28:45018) 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33dbfc640 1 -- 10.20.193.28:0/3703698668 learned_addr learned my addr 10.20.193.28:0/3703698668 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33dbfc640 1 -- 10.20.193.28:0/3703698668 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338109490 msgr2=0x7ff3381a1090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33dbfc640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338109490 0x7ff3381a1090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33dbfc640 1 -- 10.20.193.28:0/3703698668 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff33810a900 msgr2=0x7ff3381a8640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33dbfc640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff33810a900 0x7ff3381a8640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33dbfc640 1 -- 10.20.193.28:0/3703698668 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3381a8d40 con 0x7ff338109e60 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.609+0000 7ff33dbfc640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109e60 0x7ff3381a15d0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00b570 tx=0x7ff32c00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.610+0000 7ff31f7fe640 1 -- 10.20.193.28:0/3703698668 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c013020 con 0x7ff338109e60 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.610+0000 7ff33f3ff640 1 -- 10.20.193.28:0/3703698668 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3381a8fd0 con 0x7ff338109e60 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.610+0000 7ff31f7fe640 1 -- 10.20.193.28:0/3703698668 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff32c004480 con 0x7ff338109e60 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.610+0000 7ff31f7fe640 1 -- 10.20.193.28:0/3703698668 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00fb00 con 0x7ff338109e60 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.610+0000 7ff33f3ff640 1 -- 10.20.193.28:0/3703698668 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3381a9560 con 0x7ff338109e60 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 Processor -- start 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 -- start start 2026-02-20T03:38:45.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f880258e80 0x55f880259280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8802597c0 0x55f88025df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f88025e560 0x55f8802609f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8801a98f0 con 0x55f880258e80 2026-02-20T03:38:45.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f8801572e0 con 0x55f8802597c0 2026-02-20T03:38:45.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f8801a5820 con 0x55f88025e560 2026-02-20T03:38:45.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff31f7fe640 1 -- 10.20.193.28:0/3703698668 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff32c018400 con 0x7ff338109e60 2026-02-20T03:38:45.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff33ebfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f880258e80 0x55f880259280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:45.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff33ebfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f880258e80 0x55f880259280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45026/0 (socket says 10.20.193.28:45026) 2026-02-20T03:38:45.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff33ebfe640 1 -- 10.20.193.28:0/305375526 learned_addr learned my addr 10.20.193.28:0/305375526 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff33ebfe640 1 -- 10.20.193.28:0/305375526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f88025e560 msgr2=0x55f8802609f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff33ebfe640 1 --2- 10.20.193.28:0/305375526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f88025e560 0x55f8802609f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff33ebfe640 1 -- 10.20.193.28:0/305375526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8802597c0 msgr2=0x55f88025df40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff33ebfe640 1 --2- 10.20.193.28:0/305375526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8802597c0 0x55f88025df40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff33ebfe640 1 -- 10.20.193.28:0/305375526 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8801495a0 con 0x55f880258e80 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff33ebfe640 1 --2- 10.20.193.28:0/305375526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f880258e80 0x55f880259280 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7ff334009d20 tx=0x7ff33400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcca7e97716bede server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3063ff640 1 -- 10.20.193.28:0/305375526 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334017070 con 0x55f880258e80 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3063ff640 1 -- 10.20.193.28:0/305375526 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff33400bd50 con 0x55f880258e80 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3063ff640 1 -- 10.20.193.28:0/305375526 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334006e60 con 0x55f880258e80 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 -- 10.20.193.28:0/305375526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f880258e80 msgr2=0x55f880259280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/305375526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f880258e80 0x55f880259280 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7ff334009d20 tx=0x7ff33400b420 comp rx=0 tx=0).stop 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 -- 10.20.193.28:0/305375526 shutdown_connections 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/305375526 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f88025e560 0x55f8802609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/305375526 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8802597c0 0x55f88025df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/305375526 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f880258e80 0x55f880259280 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.612+0000 7ff3435c4e00 1 -- 10.20.193.28:0/305375526 >> 10.20.193.28:0/305375526 conn(0x55f8802506f0 msgr2=0x55f880257570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.615+0000 7ff3435c4e00 1 -- 10.20.193.28:0/305375526 shutdown_connections 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.615+0000 7ff3435c4e00 1 -- 10.20.193.28:0/305375526 wait complete. 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.615+0000 7ff31f7fe640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3140b0d00 0x7ff3140b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.615+0000 7ff31f7fe640 1 -- 10.20.193.28:0/3703698668 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff32c0e0ac0 con 0x7ff338109e60 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.615+0000 7ff33ebfe640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3140b0d00 0x7ff3140b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.615+0000 7ff33ebfe640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3140b0d00 0x7ff3140b31c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff334009b30 tx=0x7ff3340098b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.615+0000 7ff3435c4e00 1 -- start start 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 Processor -- start 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f880258e80 0x55f880271a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8802597c0 0x55f880271f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f88025e560 0x55f880278ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55f8801510c0 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55f880261610 con 0x55f8802597c0 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55f880279460 con 0x55f880258e80 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff33ebfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f88025e560 0x55f880278ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff33ebfe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f88025e560 0x55f880278ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45034/0 (socket says 10.20.193.28:45034) 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff33ebfe640 1 -- 10.20.193.28:0/3643145603 learned_addr learned my addr 10.20.193.28:0/3643145603 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff33ebfe640 1 -- 10.20.193.28:0/3643145603 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f880258e80 msgr2=0x55f880271a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff33ebfe640 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f880258e80 0x55f880271a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff33ebfe640 1 -- 10.20.193.28:0/3643145603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8802597c0 msgr2=0x55f880271f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff33ebfe640 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8802597c0 0x55f880271f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff33ebfe640 1 -- 10.20.193.28:0/3643145603 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f88026b180 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff33ebfe640 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f88025e560 0x55f880278ed0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7ff334014000 tx=0x7ff33400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a674ce5ae35ead97 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff2f37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff2f37fe640 1 -- 10.20.193.28:0/3643145603 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33402e070 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff2f37fe640 1 -- 10.20.193.28:0/3643145603 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff334018040 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff2f37fe640 1 -- 10.20.193.28:0/3643145603 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33401eb10 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3643145603 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f880165820 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 10 client.21993 _ll_register_callbacks cb 0x55f880154ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3643145603 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f8801b14e0 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff2f37fe640 1 -- 10.20.193.28:0/3643145603 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff33401ecb0 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff2f37fe640 1 -- 10.20.193.28:0/3643145603 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff334006e60 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 10 client.21993 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3643145603 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55f88016a380 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff2f37fe640 1 -- 10.20.193.28:0/3643145603 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7ff33403a060 con 0x55f88025e560 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 10 client.21993 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 10 client.21993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 20 client.21993 populate_metadata read hostname 'trial028' 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f88027d4b0 0x55f88027f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 4 client.21993 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:38:45.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.617+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3643145603 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f88012bbd0 con 0x55f88027d4b0 2026-02-20T03:38:45.635 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.633+0000 7ff33e3fd640 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f88027d4b0 0x55f88027f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:45.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.700+0000 7ff33e3fd640 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f88027d4b0 0x55f88027f8c0 crc :-1 s=READY pgs=603 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac3664689d1d3d8b server_cookie=11fff534ae7712ca in_seq=0 out_seq=0 2026-02-20T03:38:45.702 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.700+0000 7ff2f37fe640 10 client.21993 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:45.715 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:45 trial028 ceph-mon[38552]: pgmap v908: 129 pgs: 129 active+clean; 721 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 272 KiB/s rd, 254 KiB/s wr, 110 op/s 2026-02-20T03:38:45.728 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff2f37fe640 1 -- 10.20.193.28:0/3643145603 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55f88012bbd0 con 0x55f88027d4b0 2026-02-20T03:38:45.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff2f37fe640 10 client.21993 handle_command_reply: tid=0 2026-02-20T03:38:45.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 client.21993 shutdown 2026-02-20T03:38:45.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3643145603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f88025e560 msgr2=0x55f880278ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:45.729 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f88025e560 0x55f880278ed0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7ff334014000 tx=0x7ff33400b420 comp rx=0 tx=0).stop 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3643145603 shutdown_connections 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f88027d4b0 0x55f88027f8c0 crc :-1 s=READY pgs=603 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f88025e560 0x55f880278ed0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f8802597c0 0x55f880271f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3643145603 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f880258e80 0x55f880271a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3643145603 >> 10.20.193.28:0/3643145603 conn(0x55f8802506f0 msgr2=0x55f88025f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff2f37fe640 0 client.21993 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3643145603 shutdown_connections 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3643145603 wait complete. 2026-02-20T03:38:45.734 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.727+0000 7ff3435c4e00 20 client.21993 trim_cache size 0 max 16384 2026-02-20T03:38:45.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.37 MB/sec execute 496 sec latency 75746.772 ms 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.734+0000 7ff3435c4e00 1 Processor -- start 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.734+0000 7ff3435c4e00 1 -- start start 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.734+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f880258e80 0x55f880257820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.734+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880278e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.734+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f88025e560 0x55f88026f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.734+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e4012730 con 0x55f8802597c0 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.734+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e400ffa0 con 0x55f88025e560 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.734+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e400ddf0 con 0x55f880258e80 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880278e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880278e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45040/0 (socket says 10.20.193.28:45040) 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 -- 10.20.193.28:0/3440656191 learned_addr learned my addr 10.20.193.28:0/3440656191 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 -- 10.20.193.28:0/3440656191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f880258e80 msgr2=0x55f880257820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- 10.20.193.28:0/3440656191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f880258e80 0x55f880257820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 -- 10.20.193.28:0/3440656191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f88025e560 msgr2=0x55f88026f1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- 10.20.193.28:0/3440656191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f88025e560 0x55f88026f1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 -- 10.20.193.28:0/3440656191 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f88026afb0 con 0x55f8802597c0 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- 10.20.193.28:0/3440656191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880278e90 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0a8730 tx=0x7ff32c0a7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3b133d57ee65b7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff305bfe640 1 -- 10.20.193.28:0/3440656191 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0acb50 con 0x55f8802597c0 2026-02-20T03:38:45.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff305bfe640 1 -- 10.20.193.28:0/3440656191 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff32c0b1a00 con 0x55f8802597c0 2026-02-20T03:38:45.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff305bfe640 1 -- 10.20.193.28:0/3440656191 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0a41b0 con 0x55f8802597c0 2026-02-20T03:38:45.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3440656191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 msgr2=0x55f880278e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:45.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3440656191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880278e90 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0a8730 tx=0x7ff32c0a7f90 comp rx=0 tx=0).stop 2026-02-20T03:38:45.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3440656191 shutdown_connections 2026-02-20T03:38:45.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3440656191 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f88025e560 0x55f88026f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3440656191 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880278e90 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/3440656191 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f880258e80 0x55f880257820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3440656191 >> 10.20.193.28:0/3440656191 conn(0x55f8802506f0 msgr2=0x55f88026eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3440656191 shutdown_connections 2026-02-20T03:38:45.742 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- 10.20.193.28:0/3440656191 wait complete. 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- start start 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 Processor -- start 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f880258e80 0x55f880276c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880277180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f88025e560 0x55f880278110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e400e460 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e400f8d0 con 0x55f880258e80 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e400eb30 con 0x55f88025e560 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880277180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880277180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:45056/0 (socket says 10.20.193.28:45056) 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 -- 10.20.193.28:0/1078056009 learned_addr learned my addr 10.20.193.28:0/1078056009 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 -- 10.20.193.28:0/1078056009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f88025e560 msgr2=0x55f880278110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f88025e560 0x55f880278110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 -- 10.20.193.28:0/1078056009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f880258e80 msgr2=0x55f880276c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f880258e80 0x55f880276c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 -- 10.20.193.28:0/1078056009 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f87ff09690 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff33dbfc640 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880277180 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0a84a0 tx=0x7ff32c009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a6faea14ab93af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff2f37fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff2f37fe640 1 -- 10.20.193.28:0/1078056009 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0a3f30 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff2f37fe640 1 -- 10.20.193.28:0/1078056009 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff32c0a40d0 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff2f37fe640 1 -- 10.20.193.28:0/1078056009 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c005cb0 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- 10.20.193.28:0/1078056009 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f88016eb70 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff2f37fe640 1 -- 10.20.193.28:0/1078056009 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff32c0bda70 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 10 client.21999 _ll_register_callbacks cb 0x7ff334004380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- 10.20.193.28:0/1078056009 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff33400bd50 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff2f37fe640 1 -- 10.20.193.28:0/1078056009 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7ff32c005e50 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 10 client.21999 fetch_fsmap learned FSMap version 56 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- 10.20.193.28:0/1078056009 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55f88026bca0 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff2f37fe640 1 -- 10.20.193.28:0/1078056009 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7ff32c0adce0 con 0x55f8802597c0 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 10 client.21999 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 10 client.21999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 20 client.21999 populate_metadata read hostname 'trial028' 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8802e9110 0x55f8802eb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 4 client.21999 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:38:45.743 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.735+0000 7ff3435c4e00 1 -- 10.20.193.28:0/1078056009 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f88017a6b0 con 0x55f8802e9110 2026-02-20T03:38:45.755 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.754+0000 7ff33e3fd640 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8802e9110 0x55f8802eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:38:45.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.821+0000 7ff33e3fd640 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8802e9110 0x55f8802eb5a0 crc :-1 s=READY pgs=604 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1436f9b5f9ad6c0 server_cookie=a8ff5ff307edcfc8 in_seq=0 out_seq=0 2026-02-20T03:38:45.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:45.821+0000 7ff2f37fe640 10 client.21999 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:45.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:45 trial126 ceph-mon[38476]: pgmap v908: 129 pgs: 129 active+clean; 721 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 272 KiB/s rd, 254 KiB/s wr, 110 op/s 2026-02-20T03:38:45.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:45 trial177 ceph-mon[43181]: pgmap v908: 129 pgs: 129 active+clean; 721 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 272 KiB/s rd, 254 KiB/s wr, 110 op/s 2026-02-20T03:38:46.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.33 MB/sec execute 497 sec latency 76746.810 ms 2026-02-20T03:38:47.586 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:47 trial028 ceph-mon[38552]: pgmap v909: 129 pgs: 129 active+clean; 709 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 279 KiB/s rd, 234 KiB/s wr, 157 op/s 2026-02-20T03:38:47.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.30 MB/sec execute 498 sec latency 77746.844 ms 2026-02-20T03:38:47.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:47 trial126 ceph-mon[38476]: pgmap v909: 129 pgs: 129 active+clean; 709 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 279 KiB/s rd, 234 KiB/s wr, 157 op/s 2026-02-20T03:38:47.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:47 trial177 ceph-mon[43181]: pgmap v909: 129 pgs: 129 active+clean; 709 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 279 KiB/s rd, 234 KiB/s wr, 157 op/s 2026-02-20T03:38:48.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.26 MB/sec execute 499 sec latency 78746.884 ms 2026-02-20T03:38:49.708 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:49 trial028 ceph-mon[38552]: pgmap v910: 129 pgs: 129 active+clean; 699 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 193 KiB/s rd, 141 KiB/s wr, 171 op/s 2026-02-20T03:38:49.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.22 MB/sec execute 500 sec latency 79746.937 ms 2026-02-20T03:38:49.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:49 trial126 ceph-mon[38476]: pgmap v910: 129 pgs: 129 active+clean; 699 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 193 KiB/s rd, 141 KiB/s wr, 171 op/s 2026-02-20T03:38:49.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:49 trial177 ceph-mon[43181]: pgmap v910: 129 pgs: 129 active+clean; 699 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 193 KiB/s rd, 141 KiB/s wr, 171 op/s 2026-02-20T03:38:50.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.19 MB/sec execute 501 sec latency 80746.974 ms 2026-02-20T03:38:51.574 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:51 trial028 ceph-mon[38552]: pgmap v911: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 216 KiB/s rd, 166 KiB/s wr, 162 op/s 2026-02-20T03:38:51.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.15 MB/sec execute 502 sec latency 81747.014 ms 2026-02-20T03:38:51.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:51 trial126 ceph-mon[38476]: pgmap v911: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 216 KiB/s rd, 166 KiB/s wr, 162 op/s 2026-02-20T03:38:51.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:51 trial177 ceph-mon[43181]: pgmap v911: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 216 KiB/s rd, 166 KiB/s wr, 162 op/s 2026-02-20T03:38:52.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229967 18.11 MB/sec execute 503 sec latency 82747.042 ms 2026-02-20T03:38:53.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff2f37fe640 1 -- 10.20.193.28:0/1078056009 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f88017a6b0 con 0x55f8802e9110 2026-02-20T03:38:53.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff2f37fe640 10 client.21999 handle_command_reply: tid=0 2026-02-20T03:38:53.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 client.21999 shutdown 2026-02-20T03:38:53.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 -- 10.20.193.28:0/1078056009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 msgr2=0x55f880277180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:53.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880277180 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0a84a0 tx=0x7ff32c009300 comp rx=0 tx=0).stop 2026-02-20T03:38:53.308 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 -- 10.20.193.28:0/1078056009 shutdown_connections 2026-02-20T03:38:53.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55f8802e9110 0x55f8802eb5a0 crc :-1 s=READY pgs=604 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:53.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55f88025e560 0x55f880278110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:53.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55f8802597c0 0x55f880277180 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:53.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 --2- 10.20.193.28:0/1078056009 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55f880258e80 0x55f880276c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:53.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff2f37fe640 0 client.21999 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:38:53.309 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 -- 10.20.193.28:0/1078056009 >> 10.20.193.28:0/1078056009 conn(0x55f8802506f0 msgr2=0x55f88026f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:53.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 -- 10.20.193.28:0/1078056009 shutdown_connections 2026-02-20T03:38:53.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.305+0000 7ff3435c4e00 1 -- 10.20.193.28:0/1078056009 wait complete. 2026-02-20T03:38:53.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff3435c4e00 20 client.21999 trim_cache size 0 max 16384 2026-02-20T03:38:53.310 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:38:53.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:38:53.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:38:53.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:38:53.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 -- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3140b0d00 msgr2=0x7ff3140b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:53.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3140b0d00 0x7ff3140b31c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff334009b30 tx=0x7ff3340098b0 comp rx=0 tx=0).stop 2026-02-20T03:38:53.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 -- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109e60 msgr2=0x7ff3381a15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:38:53.311 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109e60 0x7ff3381a15d0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00b570 tx=0x7ff32c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:38:53.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 -- 10.20.193.28:0/3703698668 shutdown_connections 2026-02-20T03:38:53.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff3140b0d00 0x7ff3140b31c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:53.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff33810a900 0x7ff3381a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:53.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff338109e60 0x7ff3381a15d0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:53.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 --2- 10.20.193.28:0/3703698668 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff338109490 0x7ff3381a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:38:53.312 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 -- 10.20.193.28:0/3703698668 >> 10.20.193.28:0/3703698668 conn(0x7ff338077fe0 msgr2=0x7ff33810d600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:38:53.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 -- 10.20.193.28:0/3703698668 shutdown_connections 2026-02-20T03:38:53.321 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:38:53.306+0000 7ff33f3ff640 1 -- 10.20.193.28:0/3703698668 wait complete. 2026-02-20T03:38:53.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 229976 18.08 MB/sec execute 504 sec latency 83747.068 ms 2026-02-20T03:38:53.747 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:53 trial028 ceph-mon[38552]: pgmap v912: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 182 KiB/s rd, 133 KiB/s wr, 119 op/s 2026-02-20T03:38:53.747 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:53 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:53.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:53 trial126 ceph-mon[38476]: pgmap v912: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 182 KiB/s rd, 133 KiB/s wr, 119 op/s 2026-02-20T03:38:53.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:53 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:53.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:53 trial177 ceph-mon[43181]: pgmap v912: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 182 KiB/s rd, 133 KiB/s wr, 119 op/s 2026-02-20T03:38:53.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:53 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:54.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 229979 18.04 MB/sec execute 505 sec latency 84747.108 ms 2026-02-20T03:38:54.819 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:54 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:38:54.820 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:54 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:54.820 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:38:54.820 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:38:54.820 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:38:54.820 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:38:54.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:54 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:38:54.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:54 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:54.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:38:54.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:38:54.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:38:54.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:38:54.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:54 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:38:54.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:54 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:38:54.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:38:54.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:38:54.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:38:54.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:38:55.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 230557 18.07 MB/sec execute 506 sec latency 85312.084 ms 2026-02-20T03:38:55.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:55 trial028 ceph-mon[38552]: pgmap v913: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 182 KiB/s rd, 142 KiB/s wr, 120 op/s 2026-02-20T03:38:55.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:55 trial177 ceph-mon[43181]: pgmap v913: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 182 KiB/s rd, 142 KiB/s wr, 120 op/s 2026-02-20T03:38:56.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:55 trial126 ceph-mon[38476]: pgmap v913: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 182 KiB/s rd, 142 KiB/s wr, 120 op/s 2026-02-20T03:38:56.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 231895 18.16 MB/sec execute 507 sec latency 37.169 ms 2026-02-20T03:38:57.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 233192 18.28 MB/sec execute 508 sec latency 48.375 ms 2026-02-20T03:38:57.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:57 trial028 ceph-mon[38552]: pgmap v914: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 348 KiB/s rd, 105 KiB/s wr, 111 op/s 2026-02-20T03:38:57.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:57 trial177 ceph-mon[43181]: pgmap v914: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 348 KiB/s rd, 105 KiB/s wr, 111 op/s 2026-02-20T03:38:58.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:57 trial126 ceph-mon[38476]: pgmap v914: 129 pgs: 129 active+clean; 695 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 348 KiB/s rd, 105 KiB/s wr, 111 op/s 2026-02-20T03:38:58.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 234334 18.37 MB/sec execute 509 sec latency 60.906 ms 2026-02-20T03:38:59.734 INFO:tasks.workunit.client.0.trial028.stdout: 10 235414 18.42 MB/sec execute 510 sec latency 75.466 ms 2026-02-20T03:38:59.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:38:59 trial028 ceph-mon[38552]: pgmap v915: 129 pgs: 129 active+clean; 690 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 400 KiB/s wr, 105 op/s 2026-02-20T03:38:59.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:38:59 trial177 ceph-mon[43181]: pgmap v915: 129 pgs: 129 active+clean; 690 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 400 KiB/s wr, 105 op/s 2026-02-20T03:39:00.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:38:59 trial126 ceph-mon[38476]: pgmap v915: 129 pgs: 129 active+clean; 690 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 2.1 MiB/s rd, 400 KiB/s wr, 105 op/s 2026-02-20T03:39:00.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 236932 18.56 MB/sec execute 511 sec latency 72.916 ms 2026-02-20T03:39:01.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 238195 18.66 MB/sec execute 512 sec latency 52.347 ms 2026-02-20T03:39:01.897 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:01 trial126 ceph-mon[38476]: pgmap v916: 129 pgs: 129 active+clean; 691 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 8.1 MiB/s rd, 1.9 MiB/s wr, 275 op/s 2026-02-20T03:39:01.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:01 trial177 ceph-mon[43181]: pgmap v916: 129 pgs: 129 active+clean; 691 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 8.1 MiB/s rd, 1.9 MiB/s wr, 275 op/s 2026-02-20T03:39:02.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:01 trial028 ceph-mon[38552]: pgmap v916: 129 pgs: 129 active+clean; 691 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 8.1 MiB/s rd, 1.9 MiB/s wr, 275 op/s 2026-02-20T03:39:02.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 239884 18.79 MB/sec execute 513 sec latency 84.039 ms 2026-02-20T03:39:02.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:02 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:39:02.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:02 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:39:03.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:02 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:39:03.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:02 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:39:03.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:02 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:39:03.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:02 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:39:03.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 241384 18.94 MB/sec execute 514 sec latency 33.457 ms 2026-02-20T03:39:03.792 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:03 trial028 ceph-mon[38552]: pgmap v917: 129 pgs: 129 active+clean; 685 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 2.8 MiB/s wr, 377 op/s 2026-02-20T03:39:03.792 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:03 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:39:03.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:03 trial177 ceph-mon[43181]: pgmap v917: 129 pgs: 129 active+clean; 685 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 2.8 MiB/s wr, 377 op/s 2026-02-20T03:39:03.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:03 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:39:04.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:03 trial126 ceph-mon[38476]: pgmap v917: 129 pgs: 129 active+clean; 685 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 2.8 MiB/s wr, 377 op/s 2026-02-20T03:39:04.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:03 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:39:04.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 242593 18.99 MB/sec execute 515 sec latency 59.439 ms 2026-02-20T03:39:05.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 244349 19.16 MB/sec execute 516 sec latency 50.426 ms 2026-02-20T03:39:05.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:05 trial177 ceph-mon[43181]: pgmap v918: 129 pgs: 129 active+clean; 699 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 4.1 MiB/s wr, 542 op/s 2026-02-20T03:39:06.012 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:05 trial028 ceph-mon[38552]: pgmap v918: 129 pgs: 129 active+clean; 699 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 4.1 MiB/s wr, 542 op/s 2026-02-20T03:39:06.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:05 trial126 ceph-mon[38476]: pgmap v918: 129 pgs: 129 active+clean; 699 MiB data, 10 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 4.1 MiB/s wr, 542 op/s 2026-02-20T03:39:06.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.399+0000 7f5b70140640 1 -- 10.20.193.28:0/1627624571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b68109be0 msgr2=0x7f5b68111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:06.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.399+0000 7f5b70140640 1 --2- 10.20.193.28:0/1627624571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b68109be0 0x7f5b68111480 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400b0a0 tx=0x7f5b6402f450 comp rx=0 tx=0).stop 2026-02-20T03:39:06.403 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.399+0000 7f5b70140640 1 -- 10.20.193.28:0/1627624571 shutdown_connections 2026-02-20T03:39:06.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.399+0000 7f5b70140640 1 --2- 10.20.193.28:0/1627624571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b68109be0 0x7f5b68111480 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.399+0000 7f5b70140640 1 --2- 10.20.193.28:0/1627624571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b68109220 0x7f5b681096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.399+0000 7f5b70140640 1 --2- 10.20.193.28:0/1627624571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b6810a620 0x7f5b6810aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.399+0000 7f5b70140640 1 -- 10.20.193.28:0/1627624571 >> 10.20.193.28:0/1627624571 conn(0x7f5b68078080 msgr2=0x7f5b6807a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:06.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.400+0000 7f5b70140640 1 -- 10.20.193.28:0/1627624571 shutdown_connections 2026-02-20T03:39:06.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.400+0000 7f5b70140640 1 -- 10.20.193.28:0/1627624571 wait complete. 2026-02-20T03:39:06.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.400+0000 7f5b70140640 1 Processor -- start 2026-02-20T03:39:06.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.400+0000 7f5b70140640 1 -- start start 2026-02-20T03:39:06.404 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.400+0000 7f5b70140640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b68109220 0x7f5b68074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b70140640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b68109be0 0x7f5b68071720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b70140640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b6810a620 0x7f5b68071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b70140640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68114c50 con 0x7f5b68109be0 2026-02-20T03:39:06.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6deb5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b68109220 0x7f5b68074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b70140640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68114ad0 con 0x7f5b6810a620 2026-02-20T03:39:06.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b70140640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68114dd0 con 0x7f5b68109220 2026-02-20T03:39:06.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6deb5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b68109220 0x7f5b68074cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40316/0 (socket says 10.20.193.28:40316) 2026-02-20T03:39:06.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6deb5640 1 -- 10.20.193.28:0/3235112003 learned_addr learned my addr 10.20.193.28:0/3235112003 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:06.407 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6d6b4640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b68109be0 0x7f5b68071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6e6b6640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b6810a620 0x7f5b68071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6deb5640 1 -- 10.20.193.28:0/3235112003 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b6810a620 msgr2=0x7f5b68071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b6810a620 0x7f5b68071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6deb5640 1 -- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b68109be0 msgr2=0x7f5b68071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b68109be0 0x7f5b68071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6deb5640 1 -- 10.20.193.28:0/3235112003 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b681b1770 con 0x7f5b68109220 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.401+0000 7f5b6d6b4640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b68109be0 0x7f5b68071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.402+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b68109220 0x7f5b68074cb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00b570 tx=0x7f5b5c00ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.403+0000 7f5b56ffd640 1 -- 10.20.193.28:0/3235112003 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c013020 con 0x7f5b68109220 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.403+0000 7f5b70140640 1 -- 10.20.193.28:0/3235112003 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b681b1a60 con 0x7f5b68109220 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.403+0000 7f5b56ffd640 1 -- 10.20.193.28:0/3235112003 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5b5c004480 con 0x7f5b68109220 2026-02-20T03:39:06.408 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.403+0000 7f5b70140640 1 -- 10.20.193.28:0/3235112003 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b681b2000 con 0x7f5b68109220 2026-02-20T03:39:06.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.403+0000 7f5b56ffd640 1 -- 10.20.193.28:0/3235112003 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c013020 con 0x7f5b68109220 2026-02-20T03:39:06.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b56ffd640 1 -- 10.20.193.28:0/3235112003 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5b5c0026e0 con 0x7f5b68109220 2026-02-20T03:39:06.409 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b56ffd640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5b440b0fa0 0x7f5b440b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.412 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b56ffd640 1 -- 10.20.193.28:0/3235112003 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5b5c0a4140 con 0x7f5b68109220 2026-02-20T03:39:06.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b73081e00 1 Processor -- start 2026-02-20T03:39:06.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b73081e00 1 -- start start 2026-02-20T03:39:06.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 0x558c0e069e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 0x558c0e071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b73081e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558c0dfba8f0 con 0x558c0e06f340 2026-02-20T03:39:06.413 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b73081e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558c0df682e0 con 0x558c0e069a60 2026-02-20T03:39:06.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b73081e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558c0dfb6820 con 0x558c0e06a3a0 2026-02-20T03:39:06.414 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b6e6b6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 0x558c0e071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b6e6b6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 0x558c0e071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54692/0 (socket says 10.20.193.28:54692) 2026-02-20T03:39:06.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b6e6b6640 1 -- 10.20.193.28:0/4279652862 learned_addr learned my addr 10.20.193.28:0/4279652862 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:06.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b6e6b6640 1 -- 10.20.193.28:0/4279652862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 msgr2=0x558c0e06ed70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:39:06.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b6e6b6640 1 --2- 10.20.193.28:0/4279652862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e06ed70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b6e6b6640 1 -- 10.20.193.28:0/4279652862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 msgr2=0x558c0e069e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:06.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b6e6b6640 1 --2- 10.20.193.28:0/4279652862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 0x558c0e069e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.415 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.405+0000 7f5b6e6b6640 1 -- 10.20.193.28:0/4279652862 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0df5a5a0 con 0x558c0e06f340 2026-02-20T03:39:06.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b6e6b6640 1 --2- 10.20.193.28:0/4279652862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 0x558c0e071800 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f5b64036000 tx=0x7f5b640044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be3326f127d6a0e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:06.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b3e3ff640 1 -- 10.20.193.28:0/4279652862 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b640045b0 con 0x558c0e06f340 2026-02-20T03:39:06.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b3e3ff640 1 -- 10.20.193.28:0/4279652862 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5b64033050 con 0x558c0e06f340 2026-02-20T03:39:06.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b3e3ff640 1 -- 10.20.193.28:0/4279652862 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64041440 con 0x558c0e06f340 2026-02-20T03:39:06.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b6d6b4640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5b440b0fa0 0x7f5b440b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.422 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b73081e00 1 -- 10.20.193.28:0/4279652862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 msgr2=0x558c0e071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b73081e00 1 --2- 10.20.193.28:0/4279652862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 0x558c0e071800 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f5b64036000 tx=0x7f5b640044b0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b6d6b4640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5b440b0fa0 0x7f5b440b3460 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x558c0e06ace0 tx=0x7f5b5800a400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b73081e00 1 -- 10.20.193.28:0/4279652862 shutdown_connections 2026-02-20T03:39:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b73081e00 1 --2- 10.20.193.28:0/4279652862 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 0x558c0e071800 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b73081e00 1 --2- 10.20.193.28:0/4279652862 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e06ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b73081e00 1 --2- 10.20.193.28:0/4279652862 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 0x558c0e069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.411+0000 7f5b73081e00 1 -- 10.20.193.28:0/4279652862 >> 10.20.193.28:0/4279652862 conn(0x558c0e0612d0 msgr2=0x558c0e068150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.419+0000 7f5b73081e00 1 -- 10.20.193.28:0/4279652862 shutdown_connections 2026-02-20T03:39:06.423 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.419+0000 7f5b73081e00 1 -- 10.20.193.28:0/4279652862 wait complete. 2026-02-20T03:39:06.425 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.423+0000 7f5b73081e00 1 -- start start 2026-02-20T03:39:06.426 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.423+0000 7f5b73081e00 1 Processor -- start 2026-02-20T03:39:06.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.423+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e069a60 0x558c0e082760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e082ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 0x558c0e089c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b73081e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x558c0df620c0 con 0x558c0e069a60 2026-02-20T03:39:06.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b73081e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x558c0e0723b0 con 0x558c0e06f340 2026-02-20T03:39:06.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b73081e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x558c0e08a1b0 con 0x558c0e06a3a0 2026-02-20T03:39:06.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6d6b4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e082ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.427 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6d6b4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e082ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40320/0 (socket says 10.20.193.28:40320) 2026-02-20T03:39:06.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6d6b4640 1 -- 10.20.193.28:0/1400126663 learned_addr learned my addr 10.20.193.28:0/1400126663 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:06.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6e6b6640 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 0x558c0e089c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e069a60 0x558c0e082760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6d6b4640 1 -- 10.20.193.28:0/1400126663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 msgr2=0x558c0e089c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:06.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6d6b4640 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 0x558c0e089c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6d6b4640 1 -- 10.20.193.28:0/1400126663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e069a60 msgr2=0x558c0e082760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:06.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6d6b4640 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e069a60 0x558c0e082760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.428 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.424+0000 7f5b6d6b4640 1 -- 10.20.193.28:0/1400126663 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0e07be80 con 0x558c0e06a3a0 2026-02-20T03:39:06.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b6d6b4640 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e082ca0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5b58010e30 tx=0x7f5b58004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcbb6fb3b85a55b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:06.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b1f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:39:06.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/1400126663 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5801d420 con 0x558c0e06a3a0 2026-02-20T03:39:06.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b73081e00 1 -- 10.20.193.28:0/1400126663 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c0df76820 con 0x558c0e06a3a0 2026-02-20T03:39:06.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b73081e00 10 client.28801 _ll_register_callbacks cb 0x558c0df65ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:06.429 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b73081e00 1 -- 10.20.193.28:0/1400126663 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558c0dfc24e0 con 0x558c0e06a3a0 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/1400126663 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5b5801da60 con 0x558c0e06a3a0 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/1400126663 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5801d420 con 0x558c0e06a3a0 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/1400126663 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5b5801b7f0 con 0x558c0e06a3a0 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/1400126663 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f5b5801d5c0 con 0x558c0e06a3a0 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b73081e00 10 client.28801 fetch_fsmap learned FSMap version 56 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.425+0000 7f5b73081e00 1 -- 10.20.193.28:0/1400126663 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=56}) -- 0x558c0df7b380 con 0x558c0e06a3a0 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.426+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/1400126663 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f5b5801dc10 con 0x558c0e06a3a0 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.426+0000 7f5b73081e00 10 client.28801 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.426+0000 7f5b73081e00 10 client.28801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.426+0000 7f5b73081e00 20 client.28801 populate_metadata read hostname 'trial028' 2026-02-20T03:39:06.430 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.426+0000 7f5b73081e00 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558c0e08e4d0 0x558c0e090960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.426+0000 7f5b73081e00 4 client.28801 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.426+0000 7f5b73081e00 1 -- 10.20.193.28:0/1400126663 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c0df3cbd0 con 0x558c0e08e4d0 2026-02-20T03:39:06.431 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.426+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558c0e08e4d0 0x558c0e090960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.428+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558c0e08e4d0 0x558c0e090960 crc :-1 s=READY pgs=605 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452169a314b83fa0 server_cookie=ce3555a36640cfc5 in_seq=0 out_seq=0 2026-02-20T03:39:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.428+0000 7f5b1f7fe640 10 client.28801 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.428+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/1400126663 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x558c0df3cbd0 con 0x558c0e08e4d0 2026-02-20T03:39:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.428+0000 7f5b1f7fe640 10 client.28801 handle_command_reply: tid=0 2026-02-20T03:39:06.432 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.428+0000 7f5b73081e00 1 client.28801 shutdown 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.428+0000 7f5b73081e00 1 -- 10.20.193.28:0/1400126663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 msgr2=0x558c0e082ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.428+0000 7f5b73081e00 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e082ca0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5b58010e30 tx=0x7f5b58004830 comp rx=0 tx=0).stop 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b73081e00 1 -- 10.20.193.28:0/1400126663 shutdown_connections 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b73081e00 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558c0e08e4d0 0x558c0e090960 crc :-1 s=READY pgs=605 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b73081e00 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 0x558c0e089c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b73081e00 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e082ca0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b73081e00 1 --2- 10.20.193.28:0/1400126663 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e069a60 0x558c0e082760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b73081e00 1 -- 10.20.193.28:0/1400126663 >> 10.20.193.28:0/1400126663 conn(0x558c0e0612d0 msgr2=0x558c0e070650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b1f7fe640 0 client.28801 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b73081e00 1 -- 10.20.193.28:0/1400126663 shutdown_connections 2026-02-20T03:39:06.433 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b73081e00 1 -- 10.20.193.28:0/1400126663 wait complete. 2026-02-20T03:39:06.434 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.429+0000 7f5b73081e00 20 client.28801 trim_cache size 0 max 16384 2026-02-20T03:39:06.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.436+0000 7f5b73081e00 1 Processor -- start 2026-02-20T03:39:06.439 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b73081e00 1 -- start start 2026-02-20T03:39:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 0x558c0e06ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e089be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 0x558c0e06b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b73081e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5b14012860 con 0x558c0e06f340 2026-02-20T03:39:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b73081e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5b140100d0 con 0x558c0e069a60 2026-02-20T03:39:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b73081e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1400dec0 con 0x558c0e06a3a0 2026-02-20T03:39:06.440 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b6deb5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 0x558c0e06ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b6deb5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 0x558c0e06ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:34636/0 (socket says 10.20.193.28:34636) 2026-02-20T03:39:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b6deb5640 1 -- 10.20.193.28:0/3738472704 learned_addr learned my addr 10.20.193.28:0/3738472704 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:06.441 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.437+0000 7f5b6d6b4640 1 --2- 10.20.193.28:0/3738472704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e089be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.438+0000 7f5b6deb5640 1 -- 10.20.193.28:0/3738472704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 msgr2=0x558c0e089be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.438+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/3738472704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e089be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.438+0000 7f5b6deb5640 1 -- 10.20.193.28:0/3738472704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 msgr2=0x558c0e06b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.438+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/3738472704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 0x558c0e06b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.438+0000 7f5b6deb5640 1 -- 10.20.193.28:0/3738472704 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0e07bcb0 con 0x558c0e069a60 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.438+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/3738472704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 0x558c0e06ad10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00b540 tx=0x7f5b5c0af3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb120db770403e55 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.438+0000 7f5b3dbfe640 1 -- 10.20.193.28:0/3738472704 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c0a4340 con 0x558c0e069a60 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.439+0000 7f5b3dbfe640 1 -- 10.20.193.28:0/3738472704 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x558c0df3cbd0 con 0x558c0e069a60 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.439+0000 7f5b3dbfe640 1 -- 10.20.193.28:0/3738472704 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c0a44e0 con 0x558c0e069a60 2026-02-20T03:39:06.442 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.439+0000 7f5b73081e00 1 -- 10.20.193.28:0/3738472704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 msgr2=0x558c0e06ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:06.443 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.439+0000 7f5b73081e00 1 --2- 10.20.193.28:0/3738472704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 0x558c0e06ad10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00b540 tx=0x7f5b5c0af3d0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.444 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.440+0000 7f5b73081e00 1 -- 10.20.193.28:0/3738472704 shutdown_connections 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.440+0000 7f5b73081e00 1 --2- 10.20.193.28:0/3738472704 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06f340 0x558c0e06b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.440+0000 7f5b73081e00 1 --2- 10.20.193.28:0/3738472704 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e06a3a0 0x558c0e089be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.440+0000 7f5b73081e00 1 --2- 10.20.193.28:0/3738472704 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e069a60 0x558c0e06ad10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.440+0000 7f5b73081e00 1 -- 10.20.193.28:0/3738472704 >> 10.20.193.28:0/3738472704 conn(0x558c0e0612d0 msgr2=0x558c0e06f720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.440+0000 7f5b73081e00 1 -- 10.20.193.28:0/3738472704 shutdown_connections 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.440+0000 7f5b73081e00 1 -- 10.20.193.28:0/3738472704 wait complete. 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.441+0000 7f5b73081e00 1 -- start start 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.441+0000 7f5b73081e00 1 Processor -- start 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.441+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e069a60 0x558c0e089c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06a3a0 0x558c0e0867e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.445 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b73081e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 0x558c0e086d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b6deb5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e069a60 0x558c0e089c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b6deb5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e069a60 0x558c0e089c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40332/0 (socket says 10.20.193.28:40332) 2026-02-20T03:39:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b6deb5640 1 -- 10.20.193.28:0/2101129156 learned_addr learned my addr 10.20.193.28:0/2101129156 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1400e590 con 0x558c0e06a3a0 2026-02-20T03:39:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1400fa00 con 0x558c0e06f340 2026-02-20T03:39:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1400ec60 con 0x558c0e069a60 2026-02-20T03:39:06.446 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b6e6b6640 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 0x558c0e086d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b6e6b6640 1 -- 10.20.193.28:0/2101129156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e069a60 msgr2=0x558c0e089c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:06.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b6e6b6640 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e069a60 0x558c0e089c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b6e6b6640 1 -- 10.20.193.28:0/2101129156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06a3a0 msgr2=0x558c0e0867e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:06.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.442+0000 7f5b6e6b6640 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06a3a0 0x558c0e0867e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:06.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.443+0000 7f5b6e6b6640 1 -- 10.20.193.28:0/2101129156 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0e08a4f0 con 0x558c0e06f340 2026-02-20T03:39:06.448 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.443+0000 7f5b6e6b6640 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 0x558c0e086d20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5b64032040 tx=0x7f5b64009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5600398cf9852892 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.443+0000 7f5b1f7fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.443+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/2101129156 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64004200 con 0x558c0e06f340 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.443+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/2101129156 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5b6404f070 con 0x558c0e06f340 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.443+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/2101129156 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6404a460 con 0x558c0e06f340 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.443+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c0dd1a690 con 0x558c0e06f340 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.443+0000 7f5b73081e00 10 client.28826 _ll_register_callbacks cb 0x7f5b58010ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.443+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b64033050 con 0x558c0e06f340 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/2101129156 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f5b6404a600 con 0x558c0e06f340 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/2101129156 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f5b6404a8a0 con 0x558c0e06f340 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b73081e00 10 client.28826 fetch_fsmap learned FSMap version 56 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=56}) -- 0x558c0df7fb70 con 0x558c0e06f340 2026-02-20T03:39:06.449 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/2101129156 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f5b6404aa40 con 0x558c0e06f340 2026-02-20T03:39:06.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b73081e00 10 client.28826 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:39:06.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b73081e00 10 client.28826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:06.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b73081e00 20 client.28826 populate_metadata read hostname 'trial028' 2026-02-20T03:39:06.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b73081e00 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558c0e10ba70 0x558c0e10df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:06.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b73081e00 4 client.28826 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:39:06.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558c0dd93520 con 0x558c0e10ba70 2026-02-20T03:39:06.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.444+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558c0e10ba70 0x558c0e10df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:06.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.445+0000 7f5b6deb5640 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558c0e10ba70 0x558c0e10df30 crc :-1 s=READY pgs=606 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2af13311d70533a server_cookie=ec6de09891b4ba3c in_seq=0 out_seq=0 2026-02-20T03:39:06.450 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:06.445+0000 7f5b1f7fe640 10 client.28826 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:06.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 245467 19.24 MB/sec execute 517 sec latency 203.153 ms 2026-02-20T03:39:07.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b1f7fe640 1 -- 10.20.193.28:0/2101129156 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558c0dd93520 con 0x558c0e10ba70 2026-02-20T03:39:07.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b1f7fe640 10 client.28826 handle_command_reply: tid=0 2026-02-20T03:39:07.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 client.28826 shutdown 2026-02-20T03:39:07.032 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 msgr2=0x558c0e086d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 0x558c0e086d20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5b64032040 tx=0x7f5b64009da0 comp rx=0 tx=0).stop 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 shutdown_connections 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x558c0e10ba70 0x558c0e10df30 crc :-1 s=READY pgs=606 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x558c0e06f340 0x558c0e086d20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x558c0e06a3a0 0x558c0e0867e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 --2- 10.20.193.28:0/2101129156 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x558c0e069a60 0x558c0e089c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 >> 10.20.193.28:0/2101129156 conn(0x558c0e0612d0 msgr2=0x558c0e06ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b1f7fe640 0 client.28826 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 shutdown_connections 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.030+0000 7f5b73081e00 1 -- 10.20.193.28:0/2101129156 wait complete. 2026-02-20T03:39:07.033 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.031+0000 7f5b73081e00 20 client.28826 trim_cache size 0 max 16384 2026-02-20T03:39:07.034 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:39:07.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:39:07.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:39:07.035 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:39:07.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 -- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5b440b0fa0 msgr2=0x7f5b440b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:07.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5b440b0fa0 0x7f5b440b3460 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x558c0e06ace0 tx=0x7f5b5800a400 comp rx=0 tx=0).stop 2026-02-20T03:39:07.036 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 -- 10.20.193.28:0/3235112003 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b68109220 msgr2=0x7f5b68074cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:07.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b68109220 0x7f5b68074cb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00b570 tx=0x7f5b5c00ba40 comp rx=0 tx=0).stop 2026-02-20T03:39:07.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 -- 10.20.193.28:0/3235112003 shutdown_connections 2026-02-20T03:39:07.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5b440b0fa0 0x7f5b440b3460 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:07.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5b6810a620 0x7f5b68071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:07.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5b68109be0 0x7f5b68071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:07.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 --2- 10.20.193.28:0/3235112003 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5b68109220 0x7f5b68074cb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:07.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 -- 10.20.193.28:0/3235112003 >> 10.20.193.28:0/3235112003 conn(0x7f5b68078080 msgr2=0x7f5b6810d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:07.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 -- 10.20.193.28:0/3235112003 shutdown_connections 2026-02-20T03:39:07.037 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:07.032+0000 7f5b70140640 1 -- 10.20.193.28:0/3235112003 wait complete. 2026-02-20T03:39:07.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 246618 19.31 MB/sec execute 518 sec latency 374.804 ms 2026-02-20T03:39:07.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:07 trial028 ceph-mon[38552]: pgmap v919: 129 pgs: 129 active+clean; 708 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 5.5 MiB/s wr, 699 op/s 2026-02-20T03:39:07.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:07 trial177 ceph-mon[43181]: pgmap v919: 129 pgs: 129 active+clean; 708 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 5.5 MiB/s wr, 699 op/s 2026-02-20T03:39:08.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:07 trial126 ceph-mon[38476]: pgmap v919: 129 pgs: 129 active+clean; 708 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 5.5 MiB/s wr, 699 op/s 2026-02-20T03:39:08.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 248324 19.47 MB/sec execute 519 sec latency 52.366 ms 2026-02-20T03:39:09.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 249503 19.54 MB/sec execute 520 sec latency 55.975 ms 2026-02-20T03:39:09.817 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:09 trial028 ceph-mon[38552]: pgmap v920: 129 pgs: 129 active+clean; 714 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 7.3 MiB/s wr, 987 op/s 2026-02-20T03:39:09.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:09 trial177 ceph-mon[43181]: pgmap v920: 129 pgs: 129 active+clean; 714 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 7.3 MiB/s wr, 987 op/s 2026-02-20T03:39:10.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:09 trial126 ceph-mon[38476]: pgmap v920: 129 pgs: 129 active+clean; 714 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 7.3 MiB/s wr, 987 op/s 2026-02-20T03:39:10.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 250974 19.64 MB/sec execute 521 sec latency 57.695 ms 2026-02-20T03:39:11.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 252409 19.78 MB/sec execute 522 sec latency 95.830 ms 2026-02-20T03:39:11.989 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:11 trial028 ceph-mon[38552]: pgmap v921: 129 pgs: 129 active+clean; 705 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 27 MiB/s rd, 8.6 MiB/s wr, 1.22k op/s 2026-02-20T03:39:12.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:11 trial126 ceph-mon[38476]: pgmap v921: 129 pgs: 129 active+clean; 705 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 27 MiB/s rd, 8.6 MiB/s wr, 1.22k op/s 2026-02-20T03:39:12.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:11 trial177 ceph-mon[43181]: pgmap v921: 129 pgs: 129 active+clean; 705 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 27 MiB/s rd, 8.6 MiB/s wr, 1.22k op/s 2026-02-20T03:39:12.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 253715 19.85 MB/sec execute 523 sec latency 35.691 ms 2026-02-20T03:39:13.024 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:39:13.390 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:13.735 INFO:tasks.workunit.client.0.trial028.stdout: 10 255044 19.96 MB/sec execute 524 sec latency 106.139 ms 2026-02-20T03:39:13.804 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:13 trial028 ceph-mon[38552]: pgmap v922: 129 pgs: 129 active+clean; 705 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 7.8 MiB/s wr, 1.14k op/s 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.813+0000 7f8c86323640 1 -- 10.20.193.28:0/3337726414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 msgr2=0x7f8c8010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.813+0000 7f8c86323640 1 --2- 10.20.193.28:0/3337726414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 0x7f8c8010a470 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009a30 tx=0x7f8c6c02f2b0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.814+0000 7f8c86323640 1 -- 10.20.193.28:0/3337726414 shutdown_connections 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.814+0000 7f8c86323640 1 --2- 10.20.193.28:0/3337726414 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c80115940 0x7f8c80117d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.814+0000 7f8c86323640 1 --2- 10.20.193.28:0/3337726414 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c8010a9b0 0x7f8c8010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.814+0000 7f8c86323640 1 --2- 10.20.193.28:0/3337726414 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 0x7f8c8010a470 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.814+0000 7f8c86323640 1 -- 10.20.193.28:0/3337726414 >> 10.20.193.28:0/3337726414 conn(0x7f8c8006ec00 msgr2=0x7f8c8006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.814+0000 7f8c86323640 1 -- 10.20.193.28:0/3337726414 shutdown_connections 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.814+0000 7f8c86323640 1 -- 10.20.193.28:0/3337726414 wait complete. 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.814+0000 7f8c86323640 1 Processor -- start 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c86323640 1 -- start start 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c86323640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 0x7f8c801a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c86323640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8010a9b0 0x7f8c801a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c86323640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c80115940 0x7f8c801a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c86323640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c801192b0 con 0x7f8c80115940 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c86323640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80119130 con 0x7f8c8010a9b0 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c86323640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80119430 con 0x7f8c80074e40 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c7ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 0x7f8c801a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c7f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8010a9b0 0x7f8c801a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c7ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 0x7f8c801a1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40338/0 (socket says 10.20.193.28:40338) 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.815+0000 7f8c7ffff640 1 -- 10.20.193.28:0/2395009124 learned_addr learned my addr 10.20.193.28:0/2395009124 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.816+0000 7f8c84899640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c80115940 0x7f8c801a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.816+0000 7f8c7ffff640 1 -- 10.20.193.28:0/2395009124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8010a9b0 msgr2=0x7f8c801a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.816+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8010a9b0 0x7f8c801a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.816+0000 7f8c7ffff640 1 -- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c80115940 msgr2=0x7f8c801a6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.816+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c80115940 0x7f8c801a6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.816+0000 7f8c7ffff640 1 -- 10.20.193.28:0/2395009124 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c801a6780 con 0x7f8c80074e40 2026-02-20T03:39:13.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.816+0000 7f8c84899640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c80115940 0x7f8c801a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:39:13.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.816+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 0x7f8c801a1730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c002910 tx=0x7f8c6c002940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:13.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.817+0000 7f8c7d7fa640 1 -- 10.20.193.28:0/2395009124 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c004240 con 0x7f8c80074e40 2026-02-20T03:39:13.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.817+0000 7f8c7d7fa640 1 -- 10.20.193.28:0/2395009124 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8c6c0043e0 con 0x7f8c80074e40 2026-02-20T03:39:13.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.817+0000 7f8c7d7fa640 1 -- 10.20.193.28:0/2395009124 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c042680 con 0x7f8c80074e40 2026-02-20T03:39:13.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.817+0000 7f8c86323640 1 -- 10.20.193.28:0/2395009124 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c801a6a10 con 0x7f8c80074e40 2026-02-20T03:39:13.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.817+0000 7f8c86323640 1 -- 10.20.193.28:0/2395009124 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c801b6cc0 con 0x7f8c80074e40 2026-02-20T03:39:13.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.820+0000 7f8c7d7fa640 1 -- 10.20.193.28:0/2395009124 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8c6c04a070 con 0x7f8c80074e40 2026-02-20T03:39:13.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.821+0000 7f8c88828e00 1 Processor -- start 2026-02-20T03:39:13.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c88828e00 1 -- start start 2026-02-20T03:39:13.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7d7fa640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c580b0e20 0x7f8c580b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7d7fa640 1 -- 10.20.193.28:0/2395009124 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8c6c105200 con 0x7f8c80074e40 2026-02-20T03:39:13.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7630 0x55b946ec7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ecb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 0x55b946ed3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c88828e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b946e47e50 con 0x55b946ec7630 2026-02-20T03:39:13.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c88828e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b946e1a9c0 con 0x55b946ecc120 2026-02-20T03:39:13.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c88828e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b946dc8240 con 0x55b946ec7fe0 2026-02-20T03:39:13.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ecb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7f7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ecb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40340/0 (socket says 10.20.193.28:40340) 2026-02-20T03:39:13.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7f7fe640 1 -- 10.20.193.28:0/469405750 learned_addr learned my addr 10.20.193.28:0/469405750 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:13.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c84899640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c580b0e20 0x7f8c580b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/469405750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7630 0x55b946ec7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c84899640 1 --2- 10.20.193.28:0/469405750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 0x55b946ed3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7f7fe640 1 -- 10.20.193.28:0/469405750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 msgr2=0x55b946ed3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:13.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/469405750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 0x55b946ed3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7f7fe640 1 -- 10.20.193.28:0/469405750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7630 msgr2=0x55b946ec7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:13.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/469405750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7630 0x55b946ec7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.822+0000 7f8c7f7fe640 1 -- 10.20.193.28:0/469405750 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b946ddb420 con 0x55b946ec7fe0 2026-02-20T03:39:13.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.823+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/469405750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ecb9f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400d600 tx=0x7f8c6400d7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c6afc0155ecb09 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:13.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.823+0000 7f8c84899640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c580b0e20 0x7f8c580b32e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8c80075270 tx=0x7f8c74009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:13.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.823+0000 7f8c68ce3640 1 -- 10.20.193.28:0/469405750 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64002c40 con 0x55b946ec7fe0 2026-02-20T03:39:13.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.823+0000 7f8c68ce3640 1 -- 10.20.193.28:0/469405750 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8c64002de0 con 0x55b946ec7fe0 2026-02-20T03:39:13.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.823+0000 7f8c88828e00 1 -- 10.20.193.28:0/469405750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 msgr2=0x55b946ecb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:13.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.823+0000 7f8c88828e00 1 --2- 10.20.193.28:0/469405750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ecb9f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8c6400d600 tx=0x7f8c6400d7a0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.824+0000 7f8c88828e00 1 -- 10.20.193.28:0/469405750 shutdown_connections 2026-02-20T03:39:13.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.824+0000 7f8c88828e00 1 --2- 10.20.193.28:0/469405750 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 0x55b946ed3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.824+0000 7f8c88828e00 1 --2- 10.20.193.28:0/469405750 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ecb9f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.824+0000 7f8c88828e00 1 --2- 10.20.193.28:0/469405750 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7630 0x55b946ec7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.828 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.824+0000 7f8c88828e00 1 -- 10.20.193.28:0/469405750 >> 10.20.193.28:0/469405750 conn(0x55b946e8a290 msgr2=0x55b946ec5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.836+0000 7f8c88828e00 1 -- 10.20.193.28:0/469405750 shutdown_connections 2026-02-20T03:39:13.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.836+0000 7f8c88828e00 1 -- 10.20.193.28:0/469405750 wait complete. 2026-02-20T03:39:13.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.837+0000 7f8c88828e00 1 -- start start 2026-02-20T03:39:13.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.838+0000 7f8c88828e00 1 Processor -- start 2026-02-20T03:39:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7630 0x55b946ee19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ee1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c88828e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b946e168f0 con 0x55b946ecc120 2026-02-20T03:39:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c88828e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b946c08f50 con 0x55b946ec7630 2026-02-20T03:39:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c88828e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b946ee0880 con 0x55b946ec7fe0 2026-02-20T03:39:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c7ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7630 0x55b946ee19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c7ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7630 0x55b946ee19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:34682/0 (socket says 10.20.193.28:34682) 2026-02-20T03:39:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c7ffff640 1 -- 10.20.193.28:0/2461192423 learned_addr learned my addr 10.20.193.28:0/2461192423 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ee1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c84899640 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.839+0000 7f8c7ffff640 1 -- 10.20.193.28:0/2461192423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 msgr2=0x55b946ee1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ee1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c7ffff640 1 -- 10.20.193.28:0/2461192423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 msgr2=0x55b946ee0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c7ffff640 1 -- 10.20.193.28:0/2461192423 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b946ed98a0 con 0x55b946ec7630 2026-02-20T03:39:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c84899640 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:39:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7630 0x55b946ee19c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c02f7c0 tx=0x7f8c6c0ccb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95790e67275f43a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c41ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:39:13.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c41ffb640 1 -- 10.20.193.28:0/2461192423 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0f3070 con 0x55b946ec7630 2026-02-20T03:39:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c88828e00 1 -- 10.20.193.28:0/2461192423 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b946bebb40 con 0x55b946ec7630 2026-02-20T03:39:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c88828e00 10 client.28838 _ll_register_callbacks cb 0x55b946e53f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c88828e00 1 -- 10.20.193.28:0/2461192423 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b946e281a0 con 0x55b946ec7630 2026-02-20T03:39:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c41ffb640 1 -- 10.20.193.28:0/2461192423 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8c6c033030 con 0x55b946ec7630 2026-02-20T03:39:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c41ffb640 1 -- 10.20.193.28:0/2461192423 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0cb960 con 0x55b946ec7630 2026-02-20T03:39:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c41ffb640 1 -- 10.20.193.28:0/2461192423 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8c6c0e73f0 con 0x55b946ec7630 2026-02-20T03:39:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.840+0000 7f8c41ffb640 1 -- 10.20.193.28:0/2461192423 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f8c6c0cbb00 con 0x55b946ec7630 2026-02-20T03:39:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.841+0000 7f8c88828e00 10 client.28838 fetch_fsmap learned FSMap version 56 2026-02-20T03:39:13.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.841+0000 7f8c88828e00 1 -- 10.20.193.28:0/2461192423 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55b946dd5230 con 0x55b946ec7630 2026-02-20T03:39:13.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.842+0000 7f8c41ffb640 1 -- 10.20.193.28:0/2461192423 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f8c6c0f3210 con 0x55b946ec7630 2026-02-20T03:39:13.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.842+0000 7f8c88828e00 10 client.28838 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:39:13.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.842+0000 7f8c88828e00 10 client.28838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.842+0000 7f8c88828e00 20 client.28838 populate_metadata read hostname 'trial028' 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.842+0000 7f8c88828e00 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b946ef0250 0x55b946ef2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.842+0000 7f8c88828e00 4 client.28838 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.842+0000 7f8c88828e00 1 -- 10.20.193.28:0/2461192423 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b946e225b0 con 0x55b946ef0250 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.842+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b946ef0250 0x55b946ef2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.843+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b946ef0250 0x55b946ef2710 crc :-1 s=READY pgs=607 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5492203138b80028 server_cookie=118293fa61784986 in_seq=0 out_seq=0 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.843+0000 7f8c41ffb640 10 client.28838 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.843+0000 7f8c41ffb640 1 -- 10.20.193.28:0/2461192423 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b946e225b0 con 0x55b946ef0250 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.843+0000 7f8c41ffb640 10 client.28838 handle_command_reply: tid=0 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.843+0000 7f8c88828e00 1 client.28838 shutdown 2026-02-20T03:39:13.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.843+0000 7f8c88828e00 1 -- 10.20.193.28:0/2461192423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7630 msgr2=0x55b946ee19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.843+0000 7f8c88828e00 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7630 0x55b946ee19c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c02f7c0 tx=0x7f8c6c0ccb50 comp rx=0 tx=0).stop 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c88828e00 1 -- 10.20.193.28:0/2461192423 shutdown_connections 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c88828e00 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b946ef0250 0x55b946ef2710 crc :-1 s=READY pgs=607 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c88828e00 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c88828e00 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7fe0 0x55b946ee1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c88828e00 1 --2- 10.20.193.28:0/2461192423 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7630 0x55b946ee19c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c88828e00 1 -- 10.20.193.28:0/2461192423 >> 10.20.193.28:0/2461192423 conn(0x55b946e8a290 msgr2=0x55b946ec3500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c41ffb640 0 client.28838 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c88828e00 1 -- 10.20.193.28:0/2461192423 shutdown_connections 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c88828e00 1 -- 10.20.193.28:0/2461192423 wait complete. 2026-02-20T03:39:13.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.844+0000 7f8c88828e00 20 client.28838 trim_cache size 0 max 16384 2026-02-20T03:39:13.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c88828e00 1 Processor -- start 2026-02-20T03:39:13.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c88828e00 1 -- start start 2026-02-20T03:39:13.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946edd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7fe0 0x55b946ef8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 0x55b946ef8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c88828e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30012750 con 0x55b946ec7fe0 2026-02-20T03:39:13.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c88828e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3000ffc0 con 0x55b946ecc120 2026-02-20T03:39:13.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c88828e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3000de10 con 0x55b946ec7630 2026-02-20T03:39:13.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c84899640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 0x55b946ef8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c7ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946edd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.853+0000 7f8c7f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7fe0 0x55b946ef8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.854+0000 7f8c7f7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7fe0 0x55b946ef8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54782/0 (socket says 10.20.193.28:54782) 2026-02-20T03:39:13.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.854+0000 7f8c7f7fe640 1 -- 10.20.193.28:0/1476971605 learned_addr learned my addr 10.20.193.28:0/1476971605 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:13.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.854+0000 7f8c7f7fe640 1 -- 10.20.193.28:0/1476971605 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 msgr2=0x55b946edd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:13.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.854+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/1476971605 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946edd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.854+0000 7f8c7f7fe640 1 -- 10.20.193.28:0/1476971605 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 msgr2=0x55b946ef8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:13.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.854+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/1476971605 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 0x55b946ef8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.854+0000 7f8c7f7fe640 1 -- 10.20.193.28:0/1476971605 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b946ed96d0 con 0x55b946ec7fe0 2026-02-20T03:39:13.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.854+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/1476971605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7fe0 0x55b946ef8020 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x55b946ec84d0 tx=0x7f8c64002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74e81a6290d7d71 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:13.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.854+0000 7f8c43fff640 1 -- 10.20.193.28:0/1476971605 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64004980 con 0x55b946ec7fe0 2026-02-20T03:39:13.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c43fff640 1 -- 10.20.193.28:0/1476971605 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8c64005040 con 0x55b946ec7fe0 2026-02-20T03:39:13.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c43fff640 1 -- 10.20.193.28:0/1476971605 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c64017650 con 0x55b946ec7fe0 2026-02-20T03:39:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c88828e00 1 -- 10.20.193.28:0/1476971605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7fe0 msgr2=0x55b946ef8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1476971605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7fe0 0x55b946ef8020 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x55b946ec84d0 tx=0x7f8c64002f90 comp rx=0 tx=0).stop 2026-02-20T03:39:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c88828e00 1 -- 10.20.193.28:0/1476971605 shutdown_connections 2026-02-20T03:39:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1476971605 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ecc120 0x55b946ef8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1476971605 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ec7fe0 0x55b946ef8020 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1476971605 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946edd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c88828e00 1 -- 10.20.193.28:0/1476971605 >> 10.20.193.28:0/1476971605 conn(0x55b946e8a290 msgr2=0x55b946ef0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c88828e00 1 -- 10.20.193.28:0/1476971605 shutdown_connections 2026-02-20T03:39:13.860 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.856+0000 7f8c88828e00 1 -- 10.20.193.28:0/1476971605 wait complete. 2026-02-20T03:39:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.857+0000 7f8c88828e00 1 -- start start 2026-02-20T03:39:13.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.857+0000 7f8c88828e00 1 Processor -- start 2026-02-20T03:39:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946ee4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7fe0 0x55b946ee5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c88828e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c88828e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3000e480 con 0x55b946ecc120 2026-02-20T03:39:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c88828e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3000f8f0 con 0x55b946ec7fe0 2026-02-20T03:39:13.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c88828e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3000eb50 con 0x55b946ec7630 2026-02-20T03:39:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c7ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946ee4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c7f7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7fe0 0x55b946ee5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c7ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946ee4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:40362/0 (socket says 10.20.193.28:40362) 2026-02-20T03:39:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c7ffff640 1 -- 10.20.193.28:0/1531875306 learned_addr learned my addr 10.20.193.28:0/1531875306 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c84899640 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c7ffff640 1 -- 10.20.193.28:0/1531875306 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7fe0 msgr2=0x55b946ee5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.859+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7fe0 0x55b946ee5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c7ffff640 1 -- 10.20.193.28:0/1531875306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 msgr2=0x55b946ee55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:13.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c7ffff640 1 -- 10.20.193.28:0/1531875306 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b946af9870 con 0x55b946ec7630 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c84899640 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c7ffff640 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946ee4b40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0c8d10 tx=0x7f8c6c0023d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f5240c765196e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c41ffb640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c41ffb640 1 -- 10.20.193.28:0/1531875306 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0f3040 con 0x55b946ec7630 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c88828e00 1 -- 10.20.193.28:0/1531875306 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b946dba440 con 0x55b946ec7630 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c88828e00 10 client.28825 _ll_register_callbacks cb 0x7f8c6c0c8b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.860+0000 7f8c88828e00 1 -- 10.20.193.28:0/1531875306 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c64005040 con 0x55b946ec7630 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c41ffb640 1 -- 10.20.193.28:0/1531875306 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8c6c033070 con 0x55b946ec7630 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c41ffb640 1 -- 10.20.193.28:0/1531875306 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0d6140 con 0x55b946ec7630 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c41ffb640 1 -- 10.20.193.28:0/1531875306 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8c6c0c8040 con 0x55b946ec7630 2026-02-20T03:39:13.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c41ffb640 1 -- 10.20.193.28:0/1531875306 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f8c6c0d1290 con 0x55b946ec7630 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c88828e00 10 client.28825 fetch_fsmap learned FSMap version 56 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c88828e00 1 -- 10.20.193.28:0/1531875306 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=56}) -- 0x55b946eda3c0 con 0x55b946ec7630 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c41ffb640 1 -- 10.20.193.28:0/1531875306 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 56) ==== 8362+0+0 (secure 0 0 0) 0x7f8c6c0c8240 con 0x55b946ec7630 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c88828e00 10 client.28825 fetch_fsmap finished waiting for FSMap version 56 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c88828e00 10 client.28825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c88828e00 20 client.28825 populate_metadata read hostname 'trial028' 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b946f5c430 0x55b946f5e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c88828e00 4 client.28825 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.861+0000 7f8c88828e00 1 -- 10.20.193.28:0/1531875306 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b946e225b0 con 0x55b946f5c430 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.862+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b946f5c430 0x55b946f5e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c7f7fe640 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b946f5c430 0x55b946f5e8f0 crc :-1 s=READY pgs=608 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5132f9888e6e54d8 server_cookie=476be2a0da2bc5f in_seq=0 out_seq=0 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c41ffb640 10 client.28825 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c41ffb640 1 -- 10.20.193.28:0/1531875306 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b946e225b0 con 0x55b946f5c430 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c41ffb640 10 client.28825 handle_command_reply: tid=0 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 client.28825 shutdown 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 -- 10.20.193.28:0/1531875306 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 msgr2=0x55b946ee4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946ee4b40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0c8d10 tx=0x7f8c6c0023d0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 -- 10.20.193.28:0/1531875306 shutdown_connections 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b946f5c430 0x55b946f5e8f0 crc :-1 s=READY pgs=608 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b946ecc120 0x55b946ee55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b946ec7fe0 0x55b946ee5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 --2- 10.20.193.28:0/1531875306 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b946ec7630 0x55b946ee4b40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 -- 10.20.193.28:0/1531875306 >> 10.20.193.28:0/1531875306 conn(0x55b946e8a290 msgr2=0x55b946ec5510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:13.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c41ffb640 0 client.28825 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:13.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.863+0000 7f8c88828e00 1 -- 10.20.193.28:0/1531875306 shutdown_connections 2026-02-20T03:39:13.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.864+0000 7f8c88828e00 1 -- 10.20.193.28:0/1531875306 wait complete. 2026-02-20T03:39:13.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.864+0000 7f8c88828e00 20 client.28825 trim_cache size 0 max 16384 2026-02-20T03:39:13.868 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:39:13.869 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:39:13.869 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:39:13.869 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:39:13.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.865+0000 7f8c86323640 1 -- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c580b0e20 msgr2=0x7f8c580b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:13.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.865+0000 7f8c86323640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c580b0e20 0x7f8c580b32e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8c80075270 tx=0x7f8c74009920 comp rx=0 tx=0).stop 2026-02-20T03:39:13.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.865+0000 7f8c86323640 1 -- 10.20.193.28:0/2395009124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 msgr2=0x7f8c801a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:13.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.865+0000 7f8c86323640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 0x7f8c801a1730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c002910 tx=0x7f8c6c002940 comp rx=0 tx=0).stop 2026-02-20T03:39:13.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.866+0000 7f8c86323640 1 -- 10.20.193.28:0/2395009124 shutdown_connections 2026-02-20T03:39:13.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.866+0000 7f8c86323640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c580b0e20 0x7f8c580b32e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.866+0000 7f8c86323640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8c80115940 0x7f8c801a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.866+0000 7f8c86323640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8c8010a9b0 0x7f8c801a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.866+0000 7f8c86323640 1 --2- 10.20.193.28:0/2395009124 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8c80074e40 0x7f8c801a1730 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:13.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.866+0000 7f8c86323640 1 -- 10.20.193.28:0/2395009124 >> 10.20.193.28:0/2395009124 conn(0x7f8c8006ec00 msgr2=0x7f8c8010d850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:13.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.866+0000 7f8c86323640 1 -- 10.20.193.28:0/2395009124 shutdown_connections 2026-02-20T03:39:13.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:13.866+0000 7f8c86323640 1 -- 10.20.193.28:0/2395009124 wait complete. 2026-02-20T03:39:14.023 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:39:14.024 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:39:14.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:13 trial126 ceph-mon[38476]: pgmap v922: 129 pgs: 129 active+clean; 705 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 7.8 MiB/s wr, 1.14k op/s 2026-02-20T03:39:14.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:13 trial177 ceph-mon[43181]: pgmap v922: 129 pgs: 129 active+clean; 705 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 7.8 MiB/s wr, 1.14k op/s 2026-02-20T03:39:14.309 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:14.555 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.552+0000 7fa9d2823640 1 -- 10.20.193.28:0/1933706063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077620 msgr2=0x7fa9cc077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:14.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.553+0000 7fa9d2823640 1 --2- 10.20.193.28:0/1933706063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077620 0x7fa9cc077a00 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009a30 tx=0x7fa9b802f220 comp rx=0 tx=0).stop 2026-02-20T03:39:14.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.553+0000 7fa9d2823640 1 -- 10.20.193.28:0/1933706063 shutdown_connections 2026-02-20T03:39:14.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.553+0000 7fa9d2823640 1 --2- 10.20.193.28:0/1933706063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9cc1139e0 0x7fa9cc115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.553+0000 7fa9d2823640 1 --2- 10.20.193.28:0/1933706063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9cc077f40 0x7fa9cc1134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.553+0000 7fa9d2823640 1 --2- 10.20.193.28:0/1933706063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077620 0x7fa9cc077a00 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.553+0000 7fa9d2823640 1 -- 10.20.193.28:0/1933706063 >> 10.20.193.28:0/1933706063 conn(0x7fa9cc100840 msgr2=0x7fa9cc102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:14.556 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.553+0000 7fa9d2823640 1 -- 10.20.193.28:0/1933706063 shutdown_connections 2026-02-20T03:39:14.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.553+0000 7fa9d2823640 1 -- 10.20.193.28:0/1933706063 wait complete. 2026-02-20T03:39:14.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.554+0000 7fa9d2823640 1 Processor -- start 2026-02-20T03:39:14.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.554+0000 7fa9d2823640 1 -- start start 2026-02-20T03:39:14.557 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.554+0000 7fa9d2823640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9cc077620 0x7fa9cc0746c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:14.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.554+0000 7fa9d2823640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077f40 0x7fa9cc074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:14.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.554+0000 7fa9d2823640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9cc1139e0 0x7fa9cc06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:14.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.554+0000 7fa9d2823640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc119290 con 0x7fa9cc077f40 2026-02-20T03:39:14.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.554+0000 7fa9d2823640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc119110 con 0x7fa9cc1139e0 2026-02-20T03:39:14.558 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.554+0000 7fa9d2823640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc119410 con 0x7fa9cc077620 2026-02-20T03:39:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.555+0000 7fa9cb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077f40 0x7fa9cc074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.555+0000 7fa9cb7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077f40 0x7fa9cc074c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54812/0 (socket says 10.20.193.28:54812) 2026-02-20T03:39:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.555+0000 7fa9cb7fe640 1 -- 10.20.193.28:0/542011090 learned_addr learned my addr 10.20.193.28:0/542011090 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.555+0000 7fa9cbfff640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9cc077620 0x7fa9cc0746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.555+0000 7fa9d0d99640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9cc1139e0 0x7fa9cc06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:14.559 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.556+0000 7fa9d0d99640 1 -- 10.20.193.28:0/542011090 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9cc077620 msgr2=0x7fa9cc0746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:14.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.556+0000 7fa9d0d99640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9cc077620 0x7fa9cc0746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.556+0000 7fa9d0d99640 1 -- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077f40 msgr2=0x7fa9cc074c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:14.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.556+0000 7fa9d0d99640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077f40 0x7fa9cc074c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.556+0000 7fa9d0d99640 1 -- 10.20.193.28:0/542011090 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9cc06e090 con 0x7fa9cc1139e0 2026-02-20T03:39:14.560 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.557+0000 7fa9cbfff640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9cc077620 0x7fa9cc0746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:39:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.557+0000 7fa9cb7fe640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077f40 0x7fa9cc074c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:39:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.557+0000 7fa9d0d99640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9cc1139e0 0x7fa9cc06d7d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0007ee0 tx=0x7fa9c000d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.558+0000 7fa9c97fa640 1 -- 10.20.193.28:0/542011090 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0002a60 con 0x7fa9cc1139e0 2026-02-20T03:39:14.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.558+0000 7fa9c97fa640 1 -- 10.20.193.28:0/542011090 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa9c0002c00 con 0x7fa9cc1139e0 2026-02-20T03:39:14.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.558+0000 7fa9c97fa640 1 -- 10.20.193.28:0/542011090 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0013720 con 0x7fa9cc1139e0 2026-02-20T03:39:14.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.558+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9cc06e320 con 0x7fa9cc1139e0 2026-02-20T03:39:14.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.558+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9cc0723c0 con 0x7fa9cc1139e0 2026-02-20T03:39:14.562 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.559+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa990005390 con 0x7fa9cc1139e0 2026-02-20T03:39:14.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.566+0000 7fa9c97fa640 1 -- 10.20.193.28:0/542011090 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa9c0012070 con 0x7fa9cc1139e0 2026-02-20T03:39:14.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.574+0000 7fa9c97fa640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9a40b0e20 0x7fa9a40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:14.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.574+0000 7fa9c97fa640 1 -- 10.20.193.28:0/542011090 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa9c00e05a0 con 0x7fa9cc1139e0 2026-02-20T03:39:14.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.574+0000 7fa9c97fa640 1 -- 10.20.193.28:0/542011090 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa9c0010070 con 0x7fa9cc1139e0 2026-02-20T03:39:14.577 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.575+0000 7fa9cbfff640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9a40b0e20 0x7fa9a40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:14.578 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.576+0000 7fa9cbfff640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9a40b0e20 0x7fa9a40b32e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80097c0 tx=0x7fa9b8005830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:14.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.700+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa990005680 con 0x7fa9cc1139e0 2026-02-20T03:39:14.703 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.701+0000 7fa9c97fa640 1 -- 10.20.193.28:0/542011090 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11921 (secure 0 0 0) 0x7fa9c00a8980 con 0x7fa9cc1139e0 2026-02-20T03:39:14.704 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:39:14.705 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":56,"btime":"2026-02-20T03:38:37:635326+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:38:37.423192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:39:14.705 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 56 2026-02-20T03:39:14.707 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9a40b0e20 msgr2=0x7fa9a40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9a40b0e20 0x7fa9a40b32e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80097c0 tx=0x7fa9b8005830 comp rx=0 tx=0).stop 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9cc1139e0 msgr2=0x7fa9cc06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9cc1139e0 0x7fa9cc06d7d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0007ee0 tx=0x7fa9c000d4a0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 shutdown_connections 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa9a40b0e20 0x7fa9a40b32e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa9cc1139e0 0x7fa9cc06d7d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa9cc077f40 0x7fa9cc074c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 --2- 10.20.193.28:0/542011090 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa9cc077620 0x7fa9cc0746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.704+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 >> 10.20.193.28:0/542011090 conn(0x7fa9cc100840 msgr2=0x7fa9cc102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:14.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.705+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 shutdown_connections 2026-02-20T03:39:14.709 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:14.705+0000 7fa9d2823640 1 -- 10.20.193.28:0/542011090 wait complete. 2026-02-20T03:39:14.736 INFO:tasks.workunit.client.0.trial028.stdout: 10 256564 20.08 MB/sec execute 525 sec latency 33.857 ms 2026-02-20T03:39:14.825 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:39:14.967 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:14 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/542011090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:39:15.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:14 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/542011090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:39:15.129 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:15.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:14 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/542011090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:39:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.330+0000 7fbc99681640 1 -- 10.20.193.28:0/4243260766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbc941065d0 msgr2=0x7fbc94075410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.330+0000 7fbc99681640 1 --2- 10.20.193.28:0/4243260766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbc941065d0 0x7fbc94075410 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009a30 tx=0x7fbc8002f2f0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.332+0000 7fbc99681640 1 -- 10.20.193.28:0/4243260766 shutdown_connections 2026-02-20T03:39:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.332+0000 7fbc99681640 1 --2- 10.20.193.28:0/4243260766 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc941134d0 0x7fbc94115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.332+0000 7fbc99681640 1 --2- 10.20.193.28:0/4243260766 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc94075950 0x7fbc94075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.332+0000 7fbc99681640 1 --2- 10.20.193.28:0/4243260766 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbc941065d0 0x7fbc94075410 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.332+0000 7fbc99681640 1 -- 10.20.193.28:0/4243260766 >> 10.20.193.28:0/4243260766 conn(0x7fbc940fe440 msgr2=0x7fbc94100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.332+0000 7fbc99681640 1 -- 10.20.193.28:0/4243260766 shutdown_connections 2026-02-20T03:39:15.335 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.332+0000 7fbc99681640 1 -- 10.20.193.28:0/4243260766 wait complete. 2026-02-20T03:39:15.337 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc99681640 1 Processor -- start 2026-02-20T03:39:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc99681640 1 -- start start 2026-02-20T03:39:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc99681640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc94075950 0x7fbc940747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc99681640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbc941065d0 0x7fbc94074ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc99681640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc941134d0 0x7fbc9406d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc99681640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94119120 con 0x7fbc941134d0 2026-02-20T03:39:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc99681640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94118fa0 con 0x7fbc94075950 2026-02-20T03:39:15.338 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc99681640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941192a0 con 0x7fbc941065d0 2026-02-20T03:39:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc98e80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc941134d0 0x7fbc9406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc98e80640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc941134d0 0x7fbc9406d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54830/0 (socket says 10.20.193.28:54830) 2026-02-20T03:39:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc98e80640 1 -- 10.20.193.28:0/2590146428 learned_addr learned my addr 10.20.193.28:0/2590146428 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc98e80640 1 -- 10.20.193.28:0/2590146428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbc941065d0 msgr2=0x7fbc94074ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc98e80640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbc941065d0 0x7fbc94074ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.339 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc98e80640 1 -- 10.20.193.28:0/2590146428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc94075950 msgr2=0x7fbc940747a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:15.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc98e80640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc94075950 0x7fbc940747a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.340 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc98e80640 1 -- 10.20.193.28:0/2590146428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9406e260 con 0x7fbc941134d0 2026-02-20T03:39:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc98e80640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc941134d0 0x7fbc9406d950 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b970 tx=0x7fbc8800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:15.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc917fa640 1 -- 10.20.193.28:0/2590146428 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800c790 con 0x7fbc941134d0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc917fa640 1 -- 10.20.193.28:0/2590146428 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbc88010070 con 0x7fbc941134d0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc917fa640 1 -- 10.20.193.28:0/2590146428 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88015470 con 0x7fbc941134d0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.335+0000 7fbc99681640 1 -- 10.20.193.28:0/2590146428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9406e4f0 con 0x7fbc941134d0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.338+0000 7fbc99681640 1 -- 10.20.193.28:0/2590146428 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc940724a0 con 0x7fbc941134d0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc917fa640 1 -- 10.20.193.28:0/2590146428 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbc8801d030 con 0x7fbc941134d0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc917fa640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbc600b0ef0 0x7fbc600b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc917fa640 1 -- 10.20.193.28:0/2590146428 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbc880dffe0 con 0x7fbc941134d0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbc600b0ef0 0x7fbc600b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 Processor -- start 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 -- start start 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbc600b0ef0 0x7fbc600b33b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009950 tx=0x7fbc800023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c1965e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c196585e0 0x564c19658a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c19658f60 0x564c19664de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c195d8e00 con 0x564c1965dfb0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564c195ab970 con 0x564c19658f60 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564c195591f0 con 0x564c196585e0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c1965e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c1965e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54832/0 (socket says 10.20.193.28:54832) 2026-02-20T03:39:15.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 -- 10.20.193.28:0/787440450 learned_addr learned my addr 10.20.193.28:0/787440450 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:15.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 -- 10.20.193.28:0/787440450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c196585e0 msgr2=0x564c19658a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:15.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 --2- 10.20.193.28:0/787440450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c196585e0 0x564c19658a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 -- 10.20.193.28:0/787440450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c19658f60 msgr2=0x564c19664de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:15.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 --2- 10.20.193.28:0/787440450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c19658f60 0x564c19664de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 -- 10.20.193.28:0/787440450 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1956c3d0 con 0x564c1965dfb0 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc93fff640 1 --2- 10.20.193.28:0/787440450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c1965e390 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fbc80002eb0 tx=0x7fbc8003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2f8864988a91c4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc6cce3640 1 -- 10.20.193.28:0/787440450 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80004070 con 0x564c1965dfb0 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc6cce3640 1 -- 10.20.193.28:0/787440450 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbc80033040 con 0x564c1965dfb0 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc6cce3640 1 -- 10.20.193.28:0/787440450 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80042bd0 con 0x564c1965dfb0 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/787440450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 msgr2=0x564c1965e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/787440450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c1965e390 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7fbc80002eb0 tx=0x7fbc8003d000 comp rx=0 tx=0).stop 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/787440450 shutdown_connections 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/787440450 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c19658f60 0x564c19664de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/787440450 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c196585e0 0x564c19658a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.350 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/787440450 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c1965e390 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.340+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/787440450 >> 10.20.193.28:0/787440450 conn(0x564c1961b240 msgr2=0x564c19656ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:15.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.347+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/787440450 shutdown_connections 2026-02-20T03:39:15.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.347+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/787440450 wait complete. 2026-02-20T03:39:15.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.348+0000 7fbc9ce0fe00 1 -- start start 2026-02-20T03:39:15.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc9ce0fe00 1 Processor -- start 2026-02-20T03:39:15.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c19671280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c19658f60 0x564c196717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c19676d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x564c195a78a0 con 0x564c1965dfb0 2026-02-20T03:39:15.352 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x564c19399f50 con 0x564c196585e0 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x564c19677290 con 0x564c19658f60 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc93fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c19671280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc93fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c19671280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:34750/0 (socket says 10.20.193.28:34750) 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc93fff640 1 -- 10.20.193.28:0/1427724417 learned_addr learned my addr 10.20.193.28:0/1427724417 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc937fe640 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c19658f60 0x564c196717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.349+0000 7fbc98e80640 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c19676d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc93fff640 1 -- 10.20.193.28:0/1427724417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c19658f60 msgr2=0x564c196717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc93fff640 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c19658f60 0x564c196717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc93fff640 1 -- 10.20.193.28:0/1427724417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 msgr2=0x564c19676d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc93fff640 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c19676d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc93fff640 1 -- 10.20.193.28:0/1427724417 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1966aa20 con 0x564c196585e0 2026-02-20T03:39:15.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc98e80640 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c19676d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc93fff640 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c19671280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbc80002fd0 tx=0x7fbc80042670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d64776ec82a6e04 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc55ffb640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc55ffb640 1 -- 10.20.193.28:0/1427724417 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80004280 con 0x564c196585e0 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc55ffb640 1 -- 10.20.193.28:0/1427724417 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbc80059070 con 0x564c196585e0 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc55ffb640 1 -- 10.20.193.28:0/1427724417 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80038df0 con 0x564c196585e0 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.350+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1427724417 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1937cb40 con 0x564c196585e0 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.351+0000 7fbc9ce0fe00 10 client.28856 _ll_register_callbacks cb 0x564c195e4eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.351+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1427724417 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564c195b9150 con 0x564c196585e0 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.351+0000 7fbc55ffb640 1 -- 10.20.193.28:0/1427724417 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbc8005d410 con 0x564c196585e0 2026-02-20T03:39:15.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.351+0000 7fbc55ffb640 1 -- 10.20.193.28:0/1427724417 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fbc80066050 con 0x564c196585e0 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.351+0000 7fbc9ce0fe00 10 client.28856 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.351+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1427724417 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=57}) -- 0x564c195661e0 con 0x564c196585e0 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.352+0000 7fbc55ffb640 1 -- 10.20.193.28:0/1427724417 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7fbc80038470 con 0x564c196585e0 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.352+0000 7fbc9ce0fe00 10 client.28856 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.352+0000 7fbc9ce0fe00 10 client.28856 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.352+0000 7fbc9ce0fe00 20 client.28856 populate_metadata read hostname 'trial028' 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.352+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564c19680f60 0x564c19683350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.352+0000 7fbc9ce0fe00 4 client.28856 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.352+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1427724417 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c195b3560 con 0x564c19680f60 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.352+0000 7fbc937fe640 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564c19680f60 0x564c19683350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.355 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.353+0000 7fbc937fe640 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564c19680f60 0x564c19683350 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce53b75f7b0c443c server_cookie=b9ed219496bd7e54 in_seq=0 out_seq=0 2026-02-20T03:39:15.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.353+0000 7fbc55ffb640 10 client.28856 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:39:15.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc55ffb640 1 -- 10.20.193.28:0/1427724417 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x564c195b3560 con 0x564c19680f60 2026-02-20T03:39:15.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc55ffb640 10 client.28856 handle_command_reply: tid=0 2026-02-20T03:39:15.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 client.28856 shutdown 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1427724417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 msgr2=0x564c19671280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c19671280 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbc80002fd0 tx=0x7fbc80042670 comp rx=0 tx=0).stop 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1427724417 shutdown_connections 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564c19680f60 0x564c19683350 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c1965dfb0 0x564c19676d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c19658f60 0x564c196717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1427724417 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c19671280 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc55ffb640 0 client.28856 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1427724417 >> 10.20.193.28:0/1427724417 conn(0x564c1961b240 msgr2=0x564c196573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1427724417 shutdown_connections 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.354+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1427724417 wait complete. 2026-02-20T03:39:15.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.355+0000 7fbc9ce0fe00 20 client.28856 trim_cache size 0 max 16384 2026-02-20T03:39:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.362+0000 7fbc9ce0fe00 1 Processor -- start 2026-02-20T03:39:15.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.362+0000 7fbc9ce0fe00 1 -- start start 2026-02-20T03:39:15.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.362+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c19681a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.362+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c19681f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.365 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.362+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c1965dfb0 0x564c196574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc380126f0 con 0x564c19658f60 2026-02-20T03:39:15.366 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3800ff30 con 0x564c196585e0 2026-02-20T03:39:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3800dd80 con 0x564c1965dfb0 2026-02-20T03:39:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c19681f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c19681f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54846/0 (socket says 10.20.193.28:54846) 2026-02-20T03:39:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc937fe640 1 -- 10.20.193.28:0/1196036201 learned_addr learned my addr 10.20.193.28:0/1196036201 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc937fe640 1 -- 10.20.193.28:0/1196036201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c1965dfb0 msgr2=0x564c196574d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:15.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc937fe640 1 --2- 10.20.193.28:0/1196036201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c1965dfb0 0x564c196574d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc937fe640 1 -- 10.20.193.28:0/1196036201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 msgr2=0x564c19681a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc937fe640 1 --2- 10.20.193.28:0/1196036201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c19681a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.363+0000 7fbc937fe640 1 -- 10.20.193.28:0/1196036201 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1966a850 con 0x564c19658f60 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.364+0000 7fbc937fe640 1 --2- 10.20.193.28:0/1196036201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c19681f90 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fbc9406f080 tx=0x7fbc840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731b383433a2dafe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.365+0000 7fbc57fff640 1 -- 10.20.193.28:0/1196036201 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84003e20 con 0x564c19658f60 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.365+0000 7fbc57fff640 1 -- 10.20.193.28:0/1196036201 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbc840108d0 con 0x564c19658f60 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.365+0000 7fbc57fff640 1 -- 10.20.193.28:0/1196036201 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc840196d0 con 0x564c19658f60 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.365+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1196036201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 msgr2=0x564c19681f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.365+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1196036201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c19681f90 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7fbc9406f080 tx=0x7fbc840047c0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.367+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1196036201 shutdown_connections 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.367+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1196036201 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c1965dfb0 0x564c196574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.367+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1196036201 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c19681f90 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.367+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/1196036201 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c19681a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.367+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1196036201 >> 10.20.193.28:0/1196036201 conn(0x564c1961b240 msgr2=0x564c19681340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.367+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1196036201 shutdown_connections 2026-02-20T03:39:15.372 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.367+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/1196036201 wait complete. 2026-02-20T03:39:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.367+0000 7fbc9ce0fe00 1 -- start start 2026-02-20T03:39:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.368+0000 7fbc9ce0fe00 1 Processor -- start 2026-02-20T03:39:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.368+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c1967a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.368+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c1967ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.368+0000 7fbc9ce0fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c1965dfb0 0x564c196ebdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.368+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3800e3f0 con 0x564c19658f60 2026-02-20T03:39:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.368+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3800f860 con 0x564c196585e0 2026-02-20T03:39:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.368+0000 7fbc9ce0fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3800eac0 con 0x564c1965dfb0 2026-02-20T03:39:15.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c1967ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc937fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c1967ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54856/0 (socket says 10.20.193.28:54856) 2026-02-20T03:39:15.378 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc937fe640 1 -- 10.20.193.28:0/3129904385 learned_addr learned my addr 10.20.193.28:0/3129904385 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc937fe640 1 -- 10.20.193.28:0/3129904385 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c1965dfb0 msgr2=0x564c196ebdc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc937fe640 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c1965dfb0 0x564c196ebdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc937fe640 1 -- 10.20.193.28:0/3129904385 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 msgr2=0x564c1967a5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc937fe640 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c1967a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc937fe640 1 -- 10.20.193.28:0/3129904385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1928a870 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc937fe640 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c1967ab30 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7fbc84005fa0 tx=0x7fbc84010620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0df489ac2effc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.369+0000 7fbc55ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc55ffb640 1 -- 10.20.193.28:0/3129904385 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84010710 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc55ffb640 1 -- 10.20.193.28:0/3129904385 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbc84019450 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc55ffb640 1 -- 10.20.193.28:0/3129904385 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84022640 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/3129904385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1954b3f0 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc55ffb640 1 -- 10.20.193.28:0/3129904385 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbc840227e0 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc9ce0fe00 10 client.22041 _ll_register_callbacks cb 0x7fbc80009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/3129904385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564c1955dab0 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc55ffb640 1 -- 10.20.193.28:0/3129904385 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fbc84032060 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc9ce0fe00 10 client.22041 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.370+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/3129904385 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=57}) -- 0x564c1966b540 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.371+0000 7fbc55ffb640 1 -- 10.20.193.28:0/3129904385 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7fbc84010a80 con 0x564c19658f60 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.371+0000 7fbc9ce0fe00 10 client.22041 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.371+0000 7fbc9ce0fe00 10 client.22041 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.371+0000 7fbc9ce0fe00 20 client.22041 populate_metadata read hostname 'trial028' 2026-02-20T03:39:15.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.371+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564c196ed610 0x564c196efad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.371+0000 7fbc9ce0fe00 4 client.22041 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:39:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.371+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/3129904385 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbc840108d0 con 0x564c196ed610 2026-02-20T03:39:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.377+0000 7fbc93fff640 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564c196ed610 0x564c196efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.377+0000 7fbc93fff640 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564c196ed610 0x564c196efad0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e7be15c2c2189191 server_cookie=adc41f1d96d04f in_seq=0 out_seq=0 2026-02-20T03:39:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.378+0000 7fbc55ffb640 10 client.22041 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:39:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.378+0000 7fbc55ffb640 1 -- 10.20.193.28:0/3129904385 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbc840108d0 con 0x564c196ed610 2026-02-20T03:39:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.378+0000 7fbc55ffb640 10 client.22041 handle_command_reply: tid=0 2026-02-20T03:39:15.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.378+0000 7fbc9ce0fe00 1 client.22041 shutdown 2026-02-20T03:39:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.378+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/3129904385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 msgr2=0x564c1967ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.378+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c1967ab30 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7fbc84005fa0 tx=0x7fbc84010620 comp rx=0 tx=0).stop 2026-02-20T03:39:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/3129904385 shutdown_connections 2026-02-20T03:39:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x564c1965dfb0 0x564c196ebdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x564c196ed610 0x564c196efad0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x564c19658f60 0x564c1967ab30 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc9ce0fe00 1 --2- 10.20.193.28:0/3129904385 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x564c196585e0 0x564c1967a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc55ffb640 0 client.22041 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:39:15.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/3129904385 >> 10.20.193.28:0/3129904385 conn(0x564c1961b240 msgr2=0x564c19681b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/3129904385 shutdown_connections 2026-02-20T03:39:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc9ce0fe00 1 -- 10.20.193.28:0/3129904385 wait complete. 2026-02-20T03:39:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.379+0000 7fbc9ce0fe00 20 client.22041 trim_cache size 0 max 16384 2026-02-20T03:39:15.382 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:39:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 -- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbc600b0ef0 msgr2=0x7fbc600b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbc600b0ef0 0x7fbc600b33b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009950 tx=0x7fbc800023d0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 -- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc941134d0 msgr2=0x7fbc9406d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc941134d0 0x7fbc9406d950 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b970 tx=0x7fbc8800be40 comp rx=0 tx=0).stop 2026-02-20T03:39:15.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 -- 10.20.193.28:0/2590146428 shutdown_connections 2026-02-20T03:39:15.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbc600b0ef0 0x7fbc600b33b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbc941134d0 0x7fbc9406d950 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbc941065d0 0x7fbc94074ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 --2- 10.20.193.28:0/2590146428 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbc94075950 0x7fbc940747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:15.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 -- 10.20.193.28:0/2590146428 >> 10.20.193.28:0/2590146428 conn(0x7fbc940fe440 msgr2=0x7fbc940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:15.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 -- 10.20.193.28:0/2590146428 shutdown_connections 2026-02-20T03:39:15.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:15.380+0000 7fbc99681640 1 -- 10.20.193.28:0/2590146428 wait complete. 2026-02-20T03:39:15.499 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:39:15.736 INFO:tasks.workunit.client.0.trial028.stdout: 10 257415 20.15 MB/sec execute 526 sec latency 209.702 ms 2026-02-20T03:39:15.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:15 trial028 ceph-mon[38552]: pgmap v923: 129 pgs: 129 active+clean; 723 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.5 MiB/s wr, 1.24k op/s 2026-02-20T03:39:15.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:15 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:39:15.871 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:16.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:15 trial126 ceph-mon[38476]: pgmap v923: 129 pgs: 129 active+clean; 723 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.5 MiB/s wr, 1.24k op/s 2026-02-20T03:39:16.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:15 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:39:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.098+0000 7f4fa1862640 1 -- 10.20.193.28:0/1362089852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f9c106a90 msgr2=0x7f4f9c106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.100 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.098+0000 7f4fa1862640 1 --2- 10.20.193.28:0/1362089852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f9c106a90 0x7f4f9c106e70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009a30 tx=0x7f4f9002f220 comp rx=0 tx=0).stop 2026-02-20T03:39:16.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.098+0000 7f4fa1862640 1 -- 10.20.193.28:0/1362089852 shutdown_connections 2026-02-20T03:39:16.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.098+0000 7f4fa1862640 1 --2- 10.20.193.28:0/1362089852 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f9c101430 0x7f4f9c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.098+0000 7f4fa1862640 1 --2- 10.20.193.28:0/1362089852 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f9c100a90 0x7f4f9c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.098+0000 7f4fa1862640 1 --2- 10.20.193.28:0/1362089852 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f9c106a90 0x7f4f9c106e70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.098+0000 7f4fa1862640 1 -- 10.20.193.28:0/1362089852 >> 10.20.193.28:0/1362089852 conn(0x7f4f9c0fc7b0 msgr2=0x7f4f9c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.102 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.098+0000 7f4fa1862640 1 -- 10.20.193.28:0/1362089852 shutdown_connections 2026-02-20T03:39:16.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.098+0000 7f4fa1862640 1 -- 10.20.193.28:0/1362089852 wait complete. 2026-02-20T03:39:16.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.099+0000 7f4fa1862640 1 Processor -- start 2026-02-20T03:39:16.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.099+0000 7f4fa1862640 1 -- start start 2026-02-20T03:39:16.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.100+0000 7f4fa1862640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f9c100a90 0x7f4f9c19d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.100+0000 7f4fa1862640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f9c101430 0x7f4f9c19df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.100+0000 7f4fa1862640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f9c106a90 0x7f4f9c10cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f9c106a90 0x7f4f9c10cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f9c100a90 0x7f4f9c19d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f9c106a90 0x7f4f9c10cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38204/0 (socket says 10.20.193.28:38204) 2026-02-20T03:39:16.105 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/311310598 learned_addr learned my addr 10.20.193.28:0/311310598 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c112b40 con 0x7f4f9c101430 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c1129c0 con 0x7f4f9c106a90 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f9c101430 0x7f4f9c19df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c112cc0 con 0x7f4f9c100a90 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9a7fc640 1 -- 10.20.193.28:0/311310598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f9c100a90 msgr2=0x7f4f9c19d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f9c100a90 0x7f4f9c19d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9a7fc640 1 -- 10.20.193.28:0/311310598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f9c106a90 msgr2=0x7f4f9c10cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f9c106a90 0x7f4f9c10cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.101+0000 7f4f9a7fc640 1 -- 10.20.193.28:0/311310598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c10d3d0 con 0x7f4f9c101430 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.102+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f9c101430 0x7f4f9c19df00 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400e9f0 tx=0x7f4f8400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.102+0000 7f4fa0860640 1 -- 10.20.193.28:0/311310598 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400cd80 con 0x7f4f9c101430 2026-02-20T03:39:16.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.102+0000 7f4fa0860640 1 -- 10.20.193.28:0/311310598 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4f84004570 con 0x7f4f9c101430 2026-02-20T03:39:16.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.102+0000 7f4fa0860640 1 -- 10.20.193.28:0/311310598 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f84010690 con 0x7f4f9c101430 2026-02-20T03:39:16.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.102+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c10d6c0 con 0x7f4f9c101430 2026-02-20T03:39:16.107 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.103+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c1a18a0 con 0x7f4f9c101430 2026-02-20T03:39:16.109 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4fa3d67e00 1 Processor -- start 2026-02-20T03:39:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4fa3d67e00 1 -- start start 2026-02-20T03:39:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4fa0860640 1 -- 10.20.193.28:0/311310598 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f4f84020060 con 0x7f4f9c101430 2026-02-20T03:39:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c27c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9b2b9be00 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e9b2b6e970 con 0x55e9b2c200d0 2026-02-20T03:39:16.110 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e9b2b1c1f0 con 0x55e9b2c1bf90 2026-02-20T03:39:16.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4f9affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4f9affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45064/0 (socket says 10.20.193.28:45064) 2026-02-20T03:39:16.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4f9affd640 1 -- 10.20.193.28:0/337333574 learned_addr learned my addr 10.20.193.28:0/337333574 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/337333574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c27c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.107+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/337333574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.108+0000 7f4fa0860640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4f700b0e20 0x7f4f700b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.109+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/337333574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 msgr2=0x55e9b2c1f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.109+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/337333574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.109+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/337333574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 msgr2=0x55e9b2c27c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.109+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/337333574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c27c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.109+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/337333574 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b2b2f3d0 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.109+0000 7f4fa0860640 1 -- 10.20.193.28:0/311310598 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4f840e0780 con 0x7f4f9c101430 2026-02-20T03:39:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.109+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/337333574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1b9c0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009450 tx=0x7f4f8c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a724cb1c249aea5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.109+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4f700b0e20 0x7f4f700b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.109+0000 7f4f5ffff640 1 -- 10.20.193.28:0/337333574 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c002d80 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.110+0000 7f4f5ffff640 1 -- 10.20.193.28:0/337333574 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4f8c01c070 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.110+0000 7f4f5ffff640 1 -- 10.20.193.28:0/337333574 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c013cf0 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.110+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/337333574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 msgr2=0x55e9b2c1b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.110+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/337333574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1b9c0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009450 tx=0x7f4f8c009920 comp rx=0 tx=0).stop 2026-02-20T03:39:16.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.110+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4f700b0e20 0x7f4f700b32e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c01b000 tx=0x7f4f8c013f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.111+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/337333574 shutdown_connections 2026-02-20T03:39:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.111+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/337333574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c27c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.111+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/337333574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.111+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/337333574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1b9c0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.111+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/337333574 >> 10.20.193.28:0/337333574 conn(0x55e9b2bde240 msgr2=0x55e9b2c19ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.111+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/337333574 shutdown_connections 2026-02-20T03:39:16.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.111+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/337333574 wait complete. 2026-02-20T03:39:16.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.112+0000 7f4fa3d67e00 1 -- start start 2026-02-20T03:39:16.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.112+0000 7f4fa3d67e00 1 Processor -- start 2026-02-20T03:39:16.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.112+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c46b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.112+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c47050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.112+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c200d0 0x55e9b2c452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55e9b2b6a8a0 con 0x55e9b2c200d0 2026-02-20T03:39:16.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55e9b295cf50 con 0x55e9b2c1bf90 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55e9b2c45900 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4f9b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c200d0 0x55e9b2c452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4f9b7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c200d0 0x55e9b2c452c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54126/0 (socket says 10.20.193.28:54126) 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/624912538 learned_addr learned my addr 10.20.193.28:0/624912538 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4f9affd640 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c46b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/624912538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1b5e0 msgr2=0x55e9b2c46b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c46b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/624912538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1bf90 msgr2=0x55e9b2c47050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.113+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c47050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c47050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/624912538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b2c3ec50 con 0x55e9b2c200d0 2026-02-20T03:39:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c47050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:39:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c200d0 0x55e9b2c452c0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c013830 tx=0x7f4f8c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da16331ce6960d93 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4f5d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/624912538 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c02f070 con 0x55e9b2c200d0 2026-02-20T03:39:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/624912538 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4f8c0135e0 con 0x55e9b2c200d0 2026-02-20T03:39:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/624912538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b293fb40 con 0x55e9b2c200d0 2026-02-20T03:39:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4fa3d67e00 10 client.22053 _ll_register_callbacks cb 0x55e9b2ba7eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/624912538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9b2b7c150 con 0x55e9b2c200d0 2026-02-20T03:39:16.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.114+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/624912538 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0043a0 con 0x55e9b2c200d0 2026-02-20T03:39:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.116+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/624912538 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4f8c004540 con 0x55e9b2c200d0 2026-02-20T03:39:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.116+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/624912538 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f4f8c039060 con 0x55e9b2c200d0 2026-02-20T03:39:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.116+0000 7f4fa3d67e00 10 client.22053 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.116+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/624912538 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=57}) -- 0x55e9b2b291e0 con 0x55e9b2c200d0 2026-02-20T03:39:16.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.117+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/624912538 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7f4f8c022a30 con 0x55e9b2c200d0 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.117+0000 7f4fa3d67e00 10 client.22053 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.117+0000 7f4fa3d67e00 10 client.22053 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.117+0000 7f4fa3d67e00 20 client.22053 populate_metadata read hostname 'trial028' 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.117+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9b2c55240 0x55e9b2c57630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.117+0000 7f4fa3d67e00 4 client.22053 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.117+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/624912538 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9b2b76560 con 0x55e9b2c55240 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.117+0000 7f4f9affd640 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9b2c55240 0x55e9b2c57630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.118+0000 7f4f9affd640 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9b2c55240 0x55e9b2c57630 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=594da8a48dc04f40 server_cookie=831620ae3720ce4d in_seq=0 out_seq=0 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.118+0000 7f4f5d7fa640 10 client.22053 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.118+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/624912538 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55e9b2b76560 con 0x55e9b2c55240 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.118+0000 7f4f5d7fa640 10 client.22053 handle_command_reply: tid=0 2026-02-20T03:39:16.122 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 client.22053 shutdown 2026-02-20T03:39:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/624912538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c200d0 msgr2=0x55e9b2c452c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c200d0 0x55e9b2c452c0 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c013830 tx=0x7f4f8c01c000 comp rx=0 tx=0).stop 2026-02-20T03:39:16.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/624912538 shutdown_connections 2026-02-20T03:39:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9b2c55240 0x55e9b2c57630 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c200d0 0x55e9b2c452c0 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c47050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/624912538 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c46b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/624912538 >> 10.20.193.28:0/624912538 conn(0x55e9b2bde240 msgr2=0x55e9b2c174b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4f5d7fa640 0 client.22053 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:39:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/624912538 shutdown_connections 2026-02-20T03:39:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/624912538 wait complete. 2026-02-20T03:39:16.125 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.119+0000 7f4fa3d67e00 20 client.22053 trim_cache size 0 max 16384 2026-02-20T03:39:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.127+0000 7f4fa3d67e00 1 Processor -- start 2026-02-20T03:39:16.130 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.127+0000 7f4fa3d67e00 1 -- start start 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.127+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c57250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c012780 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00ffc0 con 0x55e9b2c200d0 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00de10 con 0x55e9b2c1bf90 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4f9a7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4f9b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c57250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4f9b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c57250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38244/0 (socket says 10.20.193.28:38244) 2026-02-20T03:39:16.131 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/3905753164 learned_addr learned my addr 10.20.193.28:0/3905753164 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4f9a7fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45074/0 (socket says 10.20.193.28:45074) 2026-02-20T03:39:16.132 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.128+0000 7f4f9affd640 1 --2- 10.20.193.28:0/3905753164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.129+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/3905753164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 msgr2=0x55e9b2c1f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.133 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.129+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/3905753164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.129+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/3905753164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 msgr2=0x55e9b2c1ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.129+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/3905753164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.129+0000 7f4f9b7fe640 1 -- 10.20.193.28:0/3905753164 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b2c3ea80 con 0x55e9b2c200d0 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.129+0000 7f4f9affd640 1 --2- 10.20.193.28:0/3905753164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.129+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/3905753164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c57250 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0093a0 tx=0x7f4f8c037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a36f6f87c44b4880 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4f5f7fe640 1 -- 10.20.193.28:0/3905753164 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c043070 con 0x55e9b2c200d0 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4f5f7fe640 1 -- 10.20.193.28:0/3905753164 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55e9b2b7c150 con 0x55e9b2c200d0 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4f5f7fe640 1 -- 10.20.193.28:0/3905753164 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c02f040 con 0x55e9b2c200d0 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/3905753164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 msgr2=0x55e9b2c57250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/3905753164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c57250 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0093a0 tx=0x7f4f8c037000 comp rx=0 tx=0).stop 2026-02-20T03:39:16.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/3905753164 shutdown_connections 2026-02-20T03:39:16.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/3905753164 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c200d0 0x55e9b2c57250 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/3905753164 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c1f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/3905753164 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c1ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.130+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/3905753164 >> 10.20.193.28:0/3905753164 conn(0x55e9b2bde240 msgr2=0x55e9b2c44360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.131+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/3905753164 shutdown_connections 2026-02-20T03:39:16.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.131+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/3905753164 wait complete. 2026-02-20T03:39:16.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.131+0000 7f4fa3d67e00 1 -- start start 2026-02-20T03:39:16.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.131+0000 7f4fa3d67e00 1 Processor -- start 2026-02-20T03:39:16.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c4cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c491f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4fa3d67e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c200d0 0x55e9b2c49730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.137 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00e480 con 0x55e9b2c1bf90 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00f8f0 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4fa3d67e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c00eb50 con 0x55e9b2c200d0 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4f9affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c4cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4f9affd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c4cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38250/0 (socket says 10.20.193.28:38250) 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4f9affd640 1 -- 10.20.193.28:0/4028827861 learned_addr learned my addr 10.20.193.28:0/4028827861 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.132+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c200d0 0x55e9b2c49730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f9affd640 1 -- 10.20.193.28:0/4028827861 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c200d0 msgr2=0x55e9b2c49730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f9affd640 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c200d0 0x55e9b2c49730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f9affd640 1 -- 10.20.193.28:0/4028827861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1bf90 msgr2=0x55e9b2c491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f9affd640 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f9affd640 1 -- 10.20.193.28:0/4028827861 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9b284d870 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f9b7fe640 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c200d0 0x55e9b2c49730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:39:16.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:39:16.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f9affd640 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c4cf20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4f90002410 tx=0x7f4f9002f840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63be503d38141730 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f5d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:39:16.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/4028827861 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f900045c0 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/4028827861 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f4f90033040 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.133+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/4028827861 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f90005050 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.134+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/4028827861 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9b2b0e3f0 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.134+0000 7f4fa3d67e00 10 client.28871 _ll_register_callbacks cb 0x7f4f8c0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:16.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.134+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/4028827861 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f8c01c070 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.135+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/4028827861 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f4f90038770 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.135+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/4028827861 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f4f900047c0 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.135+0000 7f4fa3d67e00 10 client.28871 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.135+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/4028827861 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=57}) -- 0x55e9b2c3f770 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.136+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/4028827861 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7f4f8c018d50 con 0x55e9b2c1b5e0 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.136+0000 7f4fa3d67e00 10 client.28871 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.136+0000 7f4fa3d67e00 10 client.28871 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.136+0000 7f4fa3d67e00 20 client.28871 populate_metadata read hostname 'trial028' 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.136+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9b2cc1090 0x55e9b2cc3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.136+0000 7f4fa3d67e00 4 client.28871 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.136+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/4028827861 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9b2b3f7c0 con 0x55e9b2cc1090 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.136+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9b2cc1090 0x55e9b2cc3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.137+0000 7f4f9a7fc640 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9b2cc1090 0x55e9b2cc3550 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e1e6de6870a81bd server_cookie=cda82b9b80f090e4 in_seq=0 out_seq=0 2026-02-20T03:39:16.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.137+0000 7f4f5d7fa640 10 client.28871 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:39:16.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.138+0000 7f4f5d7fa640 1 -- 10.20.193.28:0/4028827861 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9b2b3f7c0 con 0x55e9b2cc1090 2026-02-20T03:39:16.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.138+0000 7f4f5d7fa640 10 client.28871 handle_command_reply: tid=0 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.138+0000 7f4fa3d67e00 1 client.28871 shutdown 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.138+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/4028827861 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1b5e0 msgr2=0x55e9b2c4cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.138+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c4cf20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4f90002410 tx=0x7f4f9002f840 comp rx=0 tx=0).stop 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/4028827861 shutdown_connections 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x55e9b2cc1090 0x55e9b2cc3550 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55e9b2c200d0 0x55e9b2c49730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55e9b2c1bf90 0x55e9b2c491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4fa3d67e00 1 --2- 10.20.193.28:0/4028827861 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55e9b2c1b5e0 0x55e9b2c4cf20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/4028827861 >> 10.20.193.28:0/4028827861 conn(0x55e9b2bde240 msgr2=0x55e9b2c57250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4f5d7fa640 0 client.28871 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:39:16.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/4028827861 shutdown_connections 2026-02-20T03:39:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4fa3d67e00 1 -- 10.20.193.28:0/4028827861 wait complete. 2026-02-20T03:39:16.144 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:39:16.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.139+0000 7f4fa3d67e00 20 client.28871 trim_cache size 0 max 16384 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4f700b0e20 msgr2=0x7f4f700b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4f700b0e20 0x7f4f700b32e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c01b000 tx=0x7f4f8c013f70 comp rx=0 tx=0).stop 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f9c101430 msgr2=0x7f4f9c19df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f9c101430 0x7f4f9c19df00 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400e9f0 tx=0x7f4f8400eec0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 shutdown_connections 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f4f700b0e20 0x7f4f700b32e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f4f9c106a90 0x7f4f9c10cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f4f9c101430 0x7f4f9c19df00 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 --2- 10.20.193.28:0/311310598 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f4f9c100a90 0x7f4f9c19d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 >> 10.20.193.28:0/311310598 conn(0x7f4f9c0fc7b0 msgr2=0x7f4f9c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 shutdown_connections 2026-02-20T03:39:16.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.140+0000 7f4fa1862640 1 -- 10.20.193.28:0/311310598 wait complete. 2026-02-20T03:39:16.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:15 trial177 ceph-mon[43181]: pgmap v923: 129 pgs: 129 active+clean; 723 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 24 MiB/s rd, 8.5 MiB/s wr, 1.24k op/s 2026-02-20T03:39:16.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:15 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:39:16.251 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:39:16.560 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:16.736 INFO:tasks.workunit.client.0.trial028.stdout: 10 258289 20.17 MB/sec execute 527 sec latency 85.141 ms 2026-02-20T03:39:16.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.789+0000 7f2b4d573640 1 -- 10.20.193.28:0/3822343830 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3802fba0 con 0x7f2b50077f40 2026-02-20T03:39:16.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.790+0000 7f2b4f577640 1 -- 10.20.193.28:0/3822343830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50077f40 msgr2=0x7f2b501132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.790+0000 7f2b4f577640 1 --2- 10.20.193.28:0/3822343830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50077f40 0x7f2b501132e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009960 tx=0x7f2b3802f160 comp rx=0 tx=0).stop 2026-02-20T03:39:16.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.790+0000 7f2b4f577640 1 -- 10.20.193.28:0/3822343830 shutdown_connections 2026-02-20T03:39:16.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.790+0000 7f2b4f577640 1 --2- 10.20.193.28:0/3822343830 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b50113820 0x7f2b50115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.790+0000 7f2b4f577640 1 --2- 10.20.193.28:0/3822343830 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50077f40 0x7f2b501132e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.790+0000 7f2b4f577640 1 --2- 10.20.193.28:0/3822343830 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b50077620 0x7f2b50077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.790+0000 7f2b4f577640 1 -- 10.20.193.28:0/3822343830 >> 10.20.193.28:0/3822343830 conn(0x7f2b50100680 msgr2=0x7f2b50102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.793 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.790+0000 7f2b4f577640 1 -- 10.20.193.28:0/3822343830 shutdown_connections 2026-02-20T03:39:16.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.790+0000 7f2b4f577640 1 -- 10.20.193.28:0/3822343830 wait complete. 2026-02-20T03:39:16.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.791+0000 7f2b4f577640 1 Processor -- start 2026-02-20T03:39:16.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.791+0000 7f2b4f577640 1 -- start start 2026-02-20T03:39:16.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.792+0000 7f2b4f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50077620 0x7f2b50112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.792+0000 7f2b4f577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b50077f40 0x7f2b50113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.793+0000 7f2b4f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b50113820 0x7f2b5010bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.793+0000 7f2b4ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b50113820 0x7f2b5010bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.793+0000 7f2b4ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b50113820 0x7f2b5010bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54160/0 (socket says 10.20.193.28:54160) 2026-02-20T03:39:16.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.794+0000 7f2b4ed76640 1 -- 10.20.193.28:0/2400161217 learned_addr learned my addr 10.20.193.28:0/2400161217 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.794+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50119040 con 0x7f2b50113820 2026-02-20T03:39:16.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.794+0000 7f2b4e575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50077620 0x7f2b50112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.794+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50118ec0 con 0x7f2b50077f40 2026-02-20T03:39:16.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.794+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b501191c0 con 0x7f2b50077620 2026-02-20T03:39:16.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.794+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b50077f40 0x7f2b50113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.795+0000 7f2b4ed76640 1 -- 10.20.193.28:0/2400161217 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50077620 msgr2=0x7f2b50112c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.795+0000 7f2b4ed76640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50077620 0x7f2b50112c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.795+0000 7f2b4ed76640 1 -- 10.20.193.28:0/2400161217 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b50077f40 msgr2=0x7f2b50113180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.795+0000 7f2b4ed76640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b50077f40 0x7f2b50113180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.795+0000 7f2b4ed76640 1 -- 10.20.193.28:0/2400161217 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5010c6b0 con 0x7f2b50113820 2026-02-20T03:39:16.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.795+0000 7f2b4ed76640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b50113820 0x7f2b5010bdf0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000ef30 tx=0x7f2b4000c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.795+0000 7f2b377fe640 1 -- 10.20.193.28:0/2400161217 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40019070 con 0x7f2b50113820 2026-02-20T03:39:16.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.796+0000 7f2b377fe640 1 -- 10.20.193.28:0/2400161217 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2b400092d0 con 0x7f2b50113820 2026-02-20T03:39:16.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.796+0000 7f2b377fe640 1 -- 10.20.193.28:0/2400161217 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40007500 con 0x7f2b50113820 2026-02-20T03:39:16.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.796+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5010c940 con 0x7f2b50113820 2026-02-20T03:39:16.799 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.796+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b50110940 con 0x7f2b50113820 2026-02-20T03:39:16.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.802+0000 7f2b5708ce00 1 Processor -- start 2026-02-20T03:39:16.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.807+0000 7f2b5708ce00 1 -- start start 2026-02-20T03:39:16.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f50390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f4aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f56de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d8b9ecae00 con 0x55d8b9f4a5e0 2026-02-20T03:39:16.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d8b9e9d970 con 0x55d8b9f4ffb0 2026-02-20T03:39:16.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d8b9e4b1f0 con 0x55d8b9f4af60 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b4dd74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f50390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b4dd74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f50390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38264/0 (socket says 10.20.193.28:38264) 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b4dd74640 1 -- 10.20.193.28:0/3904348289 learned_addr learned my addr 10.20.193.28:0/3904348289 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/3904348289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f56de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b4e575640 1 --2- 10.20.193.28:0/3904348289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f4aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.808+0000 7f2b4dd74640 1 -- 10.20.193.28:0/3904348289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 msgr2=0x55d8b9f56de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.809+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/3904348289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f56de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.809+0000 7f2b4dd74640 1 -- 10.20.193.28:0/3904348289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4a5e0 msgr2=0x55d8b9f4aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.809+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/3904348289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f4aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.809+0000 7f2b4dd74640 1 -- 10.20.193.28:0/3904348289 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b9e5e3d0 con 0x55d8b9f4ffb0 2026-02-20T03:39:16.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.810+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/3904348289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f50390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2b38005a40 tx=0x7f2b38005950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bd88b44dbdcef29 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.810+0000 7f2b34ff9640 1 -- 10.20.193.28:0/3904348289 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38002ab0 con 0x55d8b9f4ffb0 2026-02-20T03:39:16.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.810+0000 7f2b34ff9640 1 -- 10.20.193.28:0/3904348289 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2b38033040 con 0x55d8b9f4ffb0 2026-02-20T03:39:16.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.810+0000 7f2b34ff9640 1 -- 10.20.193.28:0/3904348289 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38002ab0 con 0x55d8b9f4ffb0 2026-02-20T03:39:16.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.811+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3904348289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 msgr2=0x55d8b9f50390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.811+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3904348289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f50390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2b38005a40 tx=0x7f2b38005950 comp rx=0 tx=0).stop 2026-02-20T03:39:16.814 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.811+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3904348289 shutdown_connections 2026-02-20T03:39:16.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.811+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3904348289 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f56de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.811+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3904348289 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f4aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.811+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3904348289 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f50390 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.811+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3904348289 >> 10.20.193.28:0/3904348289 conn(0x55d8b9f0d240 msgr2=0x55d8b9f48ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.812+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3904348289 shutdown_connections 2026-02-20T03:39:16.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.812+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3904348289 wait complete. 2026-02-20T03:39:16.815 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.813+0000 7f2b5708ce00 1 -- start start 2026-02-20T03:39:16.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.813+0000 7f2b5708ce00 1 Processor -- start 2026-02-20T03:39:16.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.813+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f64ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.813+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f650e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.813+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.813+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55d8b9e998a0 con 0x55d8b9f4ffb0 2026-02-20T03:39:16.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.813+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55d8b9c8bf50 con 0x55d8b9f4a5e0 2026-02-20T03:39:16.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.813+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55d8b9f63a60 con 0x55d8b9f4af60 2026-02-20T03:39:16.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.813+0000 7f2b377fe640 1 -- 10.20.193.28:0/2400161217 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2b40002a60 con 0x7f2b50113820 2026-02-20T03:39:16.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.814+0000 7f2b4e575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.814+0000 7f2b4e575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45110/0 (socket says 10.20.193.28:45110) 2026-02-20T03:39:16.817 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.814+0000 7f2b4e575640 1 -- 10.20.193.28:0/3445971969 learned_addr learned my addr 10.20.193.28:0/3445971969 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.814+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f64ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.814+0000 7f2b4e575640 1 -- 10.20.193.28:0/3445971969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4a5e0 msgr2=0x55d8b9f64ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.814+0000 7f2b4e575640 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f64ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.814+0000 7f2b4e575640 1 -- 10.20.193.28:0/3445971969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4ffb0 msgr2=0x55d8b9f632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.814+0000 7f2b4e575640 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.814+0000 7f2b4e575640 1 -- 10.20.193.28:0/3445971969 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b9f5ca30 con 0x55d8b9f4af60 2026-02-20T03:39:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.815+0000 7f2b4e575640 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f650e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2b44004750 tx=0x7f2b44002ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36ab1a56dbf0dd86 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.815+0000 7f2b07fff640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:39:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.815+0000 7f2b07fff640 1 -- 10.20.193.28:0/3445971969 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b44013960 con 0x55d8b9f4af60 2026-02-20T03:39:16.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.815+0000 7f2b07fff640 1 -- 10.20.193.28:0/3445971969 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2b44010420 con 0x55d8b9f4af60 2026-02-20T03:39:16.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.815+0000 7f2b07fff640 1 -- 10.20.193.28:0/3445971969 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4401b650 con 0x55d8b9f4af60 2026-02-20T03:39:16.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.815+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3445971969 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b9c6eb40 con 0x55d8b9f4af60 2026-02-20T03:39:16.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.815+0000 7f2b377fe640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b240b0e00 0x7f2b240b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.815+0000 7f2b377fe640 1 -- 10.20.193.28:0/2400161217 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2b400e0500 con 0x7f2b50113820 2026-02-20T03:39:16.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.815+0000 7f2b5708ce00 10 client.28861 _ll_register_callbacks cb 0x55d8b9ed6eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:16.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.816+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3445971969 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d8b9eab150 con 0x55d8b9f4af60 2026-02-20T03:39:16.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.816+0000 7f2b07fff640 1 -- 10.20.193.28:0/3445971969 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2b44013b00 con 0x55d8b9f4af60 2026-02-20T03:39:16.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.816+0000 7f2b07fff640 1 -- 10.20.193.28:0/3445971969 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f2b44013d00 con 0x55d8b9f4af60 2026-02-20T03:39:16.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.816+0000 7f2b5708ce00 10 client.28861 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:16.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.816+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3445971969 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=57}) -- 0x55d8b9e581e0 con 0x55d8b9f4af60 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.816+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b240b0e00 0x7f2b240b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.817+0000 7f2b07fff640 1 -- 10.20.193.28:0/3445971969 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7f2b44023030 con 0x55d8b9f4af60 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.817+0000 7f2b5708ce00 10 client.28861 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.817+0000 7f2b5708ce00 10 client.28861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.817+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b240b0e00 0x7f2b240b32c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009350 tx=0x7f2b3802f160 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.817+0000 7f2b5708ce00 20 client.28861 populate_metadata read hostname 'trial028' 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.817+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8b9f733f0 0x55d8b9f75890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.817+0000 7f2b5708ce00 4 client.28861 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.817+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3445971969 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8b9ea5560 con 0x55d8b9f733f0 2026-02-20T03:39:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.817+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8b9f733f0 0x55d8b9f75890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.818+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8b9f733f0 0x55d8b9f75890 crc :-1 s=READY pgs=609 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bd99d8cc887c483 server_cookie=98c043f20a5ae22e in_seq=0 out_seq=0 2026-02-20T03:39:16.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.818+0000 7f2b07fff640 10 client.28861 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:16.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.819+0000 7f2b07fff640 1 -- 10.20.193.28:0/3445971969 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55d8b9ea5560 con 0x55d8b9f733f0 2026-02-20T03:39:16.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.819+0000 7f2b07fff640 10 client.28861 handle_command_reply: tid=0 2026-02-20T03:39:16.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.819+0000 7f2b5708ce00 1 client.28861 shutdown 2026-02-20T03:39:16.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.819+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3445971969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 msgr2=0x55d8b9f650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.819+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f650e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2b44004750 tx=0x7f2b44002ab0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.820+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3445971969 shutdown_connections 2026-02-20T03:39:16.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.820+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8b9f733f0 0x55d8b9f75890 crc :-1 s=READY pgs=609 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.820+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.820+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4af60 0x55d8b9f650e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.820+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/3445971969 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f64ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.820+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3445971969 >> 10.20.193.28:0/3445971969 conn(0x55d8b9f0d240 msgr2=0x55d8b9f493f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.820+0000 7f2b07fff640 0 client.28861 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:16.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.820+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3445971969 shutdown_connections 2026-02-20T03:39:16.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.820+0000 7f2b5708ce00 1 -- 10.20.193.28:0/3445971969 wait complete. 2026-02-20T03:39:16.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.821+0000 7f2b5708ce00 20 client.28861 trim_cache size 0 max 16384 2026-02-20T03:39:16.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.829+0000 7f2b5708ce00 1 Processor -- start 2026-02-20T03:39:16.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.829+0000 7f2b5708ce00 1 -- start start 2026-02-20T03:39:16.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.829+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f4ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.829+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4af60 0x55d8b9f62160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.829+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f494d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.829+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2af4012770 con 0x55d8b9f4af60 2026-02-20T03:39:16.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.829+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2af400ffb0 con 0x55d8b9f4ffb0 2026-02-20T03:39:16.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.829+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2af400de00 con 0x55d8b9f4a5e0 2026-02-20T03:39:16.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4ed76640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4e575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f4ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4e575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f4ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45122/0 (socket says 10.20.193.28:45122) 2026-02-20T03:39:16.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4e575640 1 -- 10.20.193.28:0/1569158548 learned_addr learned my addr 10.20.193.28:0/1569158548 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/1569158548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4af60 0x55d8b9f62160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4dd74640 1 -- 10.20.193.28:0/1569158548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 msgr2=0x55d8b9f4ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/1569158548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f4ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4dd74640 1 -- 10.20.193.28:0/1569158548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 msgr2=0x55d8b9f494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/1569158548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.830+0000 7f2b4dd74640 1 -- 10.20.193.28:0/1569158548 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b9f5c860 con 0x55d8b9f4af60 2026-02-20T03:39:16.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.832+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/1569158548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4af60 0x55d8b9f62160 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x55d8b9f62b00 tx=0x7f2b3804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6ac4f9afab59a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.832+0000 7f2b164e6640 1 -- 10.20.193.28:0/1569158548 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38060070 con 0x55d8b9f4af60 2026-02-20T03:39:16.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.832+0000 7f2b164e6640 1 -- 10.20.193.28:0/1569158548 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55d8b9ea5560 con 0x55d8b9f4af60 2026-02-20T03:39:16.835 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.832+0000 7f2b164e6640 1 -- 10.20.193.28:0/1569158548 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38038900 con 0x55d8b9f4af60 2026-02-20T03:39:16.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.833+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1569158548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4af60 msgr2=0x55d8b9f62160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.833+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1569158548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4af60 0x55d8b9f62160 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x55d8b9f62b00 tx=0x7f2b3804f000 comp rx=0 tx=0).stop 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.833+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1569158548 shutdown_connections 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.833+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1569158548 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.833+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1569158548 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4af60 0x55d8b9f62160 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.833+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1569158548 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f4ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.833+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1569158548 >> 10.20.193.28:0/1569158548 conn(0x55d8b9f0d240 msgr2=0x55d8b9f61a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.833+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1569158548 shutdown_connections 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.833+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1569158548 wait complete. 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.834+0000 7f2b5708ce00 1 -- start start 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.834+0000 7f2b5708ce00 1 Processor -- start 2026-02-20T03:39:16.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.834+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f67a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.834+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4af60 0x55d8b9f67f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.834+0000 7f2b5708ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f68480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.834+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2af400e470 con 0x55d8b9f4ffb0 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.834+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2af400f8e0 con 0x55d8b9f4af60 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.834+0000 7f2b5708ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2af400eb40 con 0x55d8b9f4a5e0 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.834+0000 7f2b4e575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f67a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.835+0000 7f2b4e575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f67a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45136/0 (socket says 10.20.193.28:45136) 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.835+0000 7f2b4e575640 1 -- 10.20.193.28:0/1986362176 learned_addr learned my addr 10.20.193.28:0/1986362176 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.835+0000 7f2b4dd74640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4af60 0x55d8b9f67f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.835+0000 7f2b4dd74640 1 -- 10.20.193.28:0/1986362176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 msgr2=0x55d8b9f67a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.835+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f67a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.835+0000 7f2b4dd74640 1 -- 10.20.193.28:0/1986362176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4ffb0 msgr2=0x55d8b9f68480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.835+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f68480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.836+0000 7f2b4dd74640 1 -- 10.20.193.28:0/1986362176 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b9b7c870 con 0x55d8b9f4af60 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.836+0000 7f2b4dd74640 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4af60 0x55d8b9f67f40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55d8b9f4b820 tx=0x7f2b38038470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a34e22083052a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.836+0000 7f2b07fff640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.836+0000 7f2b4e575640 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f67a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.836+0000 7f2b07fff640 1 -- 10.20.193.28:0/1986362176 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38069070 con 0x55d8b9f4af60 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.836+0000 7f2b07fff640 1 -- 10.20.193.28:0/1986362176 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2b38033040 con 0x55d8b9f4af60 2026-02-20T03:39:16.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.836+0000 7f2b07fff640 1 -- 10.20.193.28:0/1986362176 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b38060050 con 0x55d8b9f4af60 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.836+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1986362176 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b9e3d3f0 con 0x55d8b9f4af60 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.837+0000 7f2b5708ce00 10 client.28886 _ll_register_callbacks cb 0x7f2b44004210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.837+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1986362176 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d8b9e4fab0 con 0x55d8b9f4af60 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.837+0000 7f2b07fff640 1 -- 10.20.193.28:0/1986362176 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2b38065460 con 0x55d8b9f4af60 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.837+0000 7f2b07fff640 1 -- 10.20.193.28:0/1986362176 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f2b38073060 con 0x55d8b9f4af60 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.837+0000 7f2b5708ce00 10 client.28886 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.837+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1986362176 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=57}) -- 0x55d8b9f5d550 con 0x55d8b9f4af60 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.837+0000 7f2b07fff640 1 -- 10.20.193.28:0/1986362176 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7f2b3802f9a0 con 0x55d8b9f4af60 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.837+0000 7f2b5708ce00 10 client.28886 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.837+0000 7f2b5708ce00 10 client.28886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.838+0000 7f2b5708ce00 20 client.28886 populate_metadata read hostname 'trial028' 2026-02-20T03:39:16.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.838+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8b9fdefe0 0x55d8b9fe13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.838+0000 7f2b5708ce00 4 client.28886 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.838+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1986362176 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8b9ea5560 con 0x55d8b9fdefe0 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.838+0000 7f2b4e575640 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8b9fdefe0 0x55d8b9fe13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b4e575640 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8b9fdefe0 0x55d8b9fe13d0 crc :-1 s=READY pgs=610 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f48dfbd758f5914 server_cookie=408c71368688e610 in_seq=0 out_seq=0 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b07fff640 10 client.28886 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b07fff640 1 -- 10.20.193.28:0/1986362176 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d8b9ea5560 con 0x55d8b9fdefe0 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b07fff640 10 client.28886 handle_command_reply: tid=0 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b5708ce00 1 client.28886 shutdown 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1986362176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4af60 msgr2=0x55d8b9f67f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4af60 0x55d8b9f67f40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55d8b9f4b820 tx=0x7f2b38038470 comp rx=0 tx=0).stop 2026-02-20T03:39:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1986362176 shutdown_connections 2026-02-20T03:39:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55d8b9fdefe0 0x55d8b9fe13d0 crc :-1 s=READY pgs=610 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55d8b9f4ffb0 0x55d8b9f68480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55d8b9f4af60 0x55d8b9f67f40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b5708ce00 1 --2- 10.20.193.28:0/1986362176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55d8b9f4a5e0 0x55d8b9f67a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b07fff640 0 client.28886 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:16.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.839+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1986362176 >> 10.20.193.28:0/1986362176 conn(0x55d8b9f0d240 msgr2=0x55d8b9f62270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.840+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1986362176 shutdown_connections 2026-02-20T03:39:16.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.840+0000 7f2b5708ce00 1 -- 10.20.193.28:0/1986362176 wait complete. 2026-02-20T03:39:16.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.840+0000 7f2b5708ce00 20 client.28886 trim_cache size 0 max 16384 2026-02-20T03:39:16.846 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:39:16.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.840+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b240b0e00 msgr2=0x7f2b240b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.840+0000 7f2b4f577640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b240b0e00 0x7f2b240b32c0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009350 tx=0x7f2b3802f160 comp rx=0 tx=0).stop 2026-02-20T03:39:16.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.840+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b50113820 msgr2=0x7f2b5010bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:16.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.840+0000 7f2b4f577640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b50113820 0x7f2b5010bdf0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000ef30 tx=0x7f2b4000c560 comp rx=0 tx=0).stop 2026-02-20T03:39:16.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.841+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 shutdown_connections 2026-02-20T03:39:16.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.841+0000 7f2b4f577640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b240b0e00 0x7f2b240b32c0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.841+0000 7f2b4f577640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2b50113820 0x7f2b5010bdf0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.841+0000 7f2b4f577640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2b50077f40 0x7f2b50113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.841+0000 7f2b4f577640 1 --2- 10.20.193.28:0/2400161217 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2b50077620 0x7f2b50112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:16.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.841+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 >> 10.20.193.28:0/2400161217 conn(0x7f2b50100680 msgr2=0x7f2b50113e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:16.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.841+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 shutdown_connections 2026-02-20T03:39:16.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:16.841+0000 7f2b4f577640 1 -- 10.20.193.28:0/2400161217 wait complete. 2026-02-20T03:39:17.736 INFO:tasks.workunit.client.0.trial028.stdout: 10 259863 20.29 MB/sec execute 528 sec latency 115.421 ms 2026-02-20T03:39:17.953 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:39:17.954 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:39:18.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:17 trial126 ceph-mon[38476]: pgmap v924: 129 pgs: 129 active+clean; 736 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 8.6 MiB/s wr, 1.25k op/s 2026-02-20T03:39:18.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:17 trial028 ceph-mon[38552]: pgmap v924: 129 pgs: 129 active+clean; 736 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 8.6 MiB/s wr, 1.25k op/s 2026-02-20T03:39:18.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:17 trial177 ceph-mon[43181]: pgmap v924: 129 pgs: 129 active+clean; 736 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 25 MiB/s rd, 8.6 MiB/s wr, 1.25k op/s 2026-02-20T03:39:18.263 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:18.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.469+0000 7f0b72239640 1 -- 10.20.193.28:0/555362014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 msgr2=0x7f0b6c075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:18.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.469+0000 7f0b72239640 1 --2- 10.20.193.28:0/555362014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 0x7f0b6c075d90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009a30 tx=0x7f0b5c02f2f0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.470+0000 7f0b72239640 1 -- 10.20.193.28:0/555362014 shutdown_connections 2026-02-20T03:39:18.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.470+0000 7f0b72239640 1 --2- 10.20.193.28:0/555362014 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b6c1136a0 0x7f0b6c115ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.470+0000 7f0b72239640 1 --2- 10.20.193.28:0/555362014 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 0x7f0b6c075d90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.470+0000 7f0b72239640 1 --2- 10.20.193.28:0/555362014 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b6c1067a0 0x7f0b6c075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.470+0000 7f0b72239640 1 -- 10.20.193.28:0/555362014 >> 10.20.193.28:0/555362014 conn(0x7f0b6c0fe630 msgr2=0x7f0b6c100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:18.474 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.470+0000 7f0b72239640 1 -- 10.20.193.28:0/555362014 shutdown_connections 2026-02-20T03:39:18.476 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.471+0000 7f0b72239640 1 -- 10.20.193.28:0/555362014 wait complete. 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.472+0000 7f0b72239640 1 Processor -- start 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.472+0000 7f0b72239640 1 -- start start 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b72239640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 0x7f0b6c1a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b72239640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b6c1067a0 0x7f0b6c1a7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b6b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 0x7f0b6c1a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b6b7fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 0x7f0b6c1a73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45160/0 (socket says 10.20.193.28:45160) 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b6affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b6c1067a0 0x7f0b6c1a7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b6affd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b6c1067a0 0x7f0b6c1a7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54230/0 (socket says 10.20.193.28:54230) 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b6b7fe640 1 -- 10.20.193.28:0/2125408850 learned_addr learned my addr 10.20.193.28:0/2125408850 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b72239640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b6c1136a0 0x7f0b6c1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c119270 con 0x7f0b6c1067a0 2026-02-20T03:39:18.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c1190f0 con 0x7f0b6c1136a0 2026-02-20T03:39:18.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.473+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c1193f0 con 0x7f0b6c075950 2026-02-20T03:39:18.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.474+0000 7f0b6b7fe640 1 -- 10.20.193.28:0/2125408850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b6c1136a0 msgr2=0x7f0b6c1a15a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:18.478 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.474+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b6c1136a0 0x7f0b6c1a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.474+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b6c1136a0 0x7f0b6c1a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.474+0000 7f0b6b7fe640 1 -- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b6c1067a0 msgr2=0x7f0b6c1a7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:18.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.474+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b6c1067a0 0x7f0b6c1a7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.474+0000 7f0b6b7fe640 1 -- 10.20.193.28:0/2125408850 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6c1a1d70 con 0x7f0b6c075950 2026-02-20T03:39:18.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.474+0000 7f0b6affd640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b6c1067a0 0x7f0b6c1a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:39:18.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.475+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 0x7f0b6c1a73e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800d950 tx=0x7f0b5800de20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:18.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.475+0000 7f0b68ff9640 1 -- 10.20.193.28:0/2125408850 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58014070 con 0x7f0b6c075950 2026-02-20T03:39:18.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.475+0000 7f0b68ff9640 1 -- 10.20.193.28:0/2125408850 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0b580044e0 con 0x7f0b6c075950 2026-02-20T03:39:18.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.475+0000 7f0b68ff9640 1 -- 10.20.193.28:0/2125408850 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58014070 con 0x7f0b6c075950 2026-02-20T03:39:18.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.475+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6c1a2060 con 0x7f0b6c075950 2026-02-20T03:39:18.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.475+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6c1ae2b0 con 0x7f0b6c075950 2026-02-20T03:39:18.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.478+0000 7f0b68ff9640 1 -- 10.20.193.28:0/2125408850 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f0b58020060 con 0x7f0b6c075950 2026-02-20T03:39:18.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.479+0000 7f0b68ff9640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b400b1020 0x7f0b400b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.479+0000 7f0b68ff9640 1 -- 10.20.193.28:0/2125408850 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0b580dff60 con 0x7f0b6c075950 2026-02-20T03:39:18.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.481+0000 7f0b6affd640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b400b1020 0x7f0b400b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.484+0000 7f0b7473ee00 1 Processor -- start 2026-02-20T03:39:18.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b7473ee00 1 -- start start 2026-02-20T03:39:18.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b6affd640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b400b1020 0x7f0b400b34e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c002410 tx=0x7f0b5c031040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:18.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff18ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 0x55aff18fb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aff184dc00 con 0x55aff18faee0 2026-02-20T03:39:18.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55aff17fb3c0 con 0x55aff18ff630 2026-02-20T03:39:18.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55aff1849b30 con 0x55aff18fb8a0 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b6bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.485+0000 7f0b6bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45166/0 (socket says 10.20.193.28:45166) 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.486+0000 7f0b6bfff640 1 -- 10.20.193.28:0/312234176 learned_addr learned my addr 10.20.193.28:0/312234176 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.486+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff18ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.486+0000 7f0b6affd640 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 0x55aff18fb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.486+0000 7f0b6bfff640 1 -- 10.20.193.28:0/312234176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 msgr2=0x55aff18ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.486+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff18ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.486+0000 7f0b6bfff640 1 -- 10.20.193.28:0/312234176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 msgr2=0x55aff18fb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.486+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 0x55aff18fb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.486+0000 7f0b6bfff640 1 -- 10.20.193.28:0/312234176 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff17f4840 con 0x55aff18fb8a0 2026-02-20T03:39:18.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.486+0000 7f0b6affd640 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 0x55aff18fb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:39:18.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.487+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19075c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009c30 tx=0x7f0b600078d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d06600b46ff1c41 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:18.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.487+0000 7f0b2ffff640 1 -- 10.20.193.28:0/312234176 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60019070 con 0x55aff18fb8a0 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.491+0000 7f0b2ffff640 1 -- 10.20.193.28:0/312234176 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0b60009e50 con 0x55aff18fb8a0 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.491+0000 7f0b2ffff640 1 -- 10.20.193.28:0/312234176 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b600149e0 con 0x55aff18fb8a0 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.491+0000 7f0b7473ee00 1 -- 10.20.193.28:0/312234176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 msgr2=0x55aff19075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.491+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19075c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009c30 tx=0x7f0b600078d0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.492+0000 7f0b7473ee00 1 -- 10.20.193.28:0/312234176 shutdown_connections 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.492+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19075c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.492+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 0x55aff18fb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.492+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/312234176 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff18ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.492+0000 7f0b7473ee00 1 -- 10.20.193.28:0/312234176 >> 10.20.193.28:0/312234176 conn(0x55aff18f3aa0 msgr2=0x55aff18f95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:18.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.492+0000 7f0b7473ee00 1 -- 10.20.193.28:0/312234176 shutdown_connections 2026-02-20T03:39:18.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.492+0000 7f0b7473ee00 1 -- 10.20.193.28:0/312234176 wait complete. 2026-02-20T03:39:18.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.494+0000 7f0b7473ee00 1 -- start start 2026-02-20T03:39:18.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.494+0000 7f0b7473ee00 1 Processor -- start 2026-02-20T03:39:18.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.495+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1913c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.495+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19141b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.495+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 0x55aff191f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.495+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55aff17f51a0 con 0x55aff18ff630 2026-02-20T03:39:18.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.495+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55aff1907cc0 con 0x55aff18faee0 2026-02-20T03:39:18.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.495+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55aff1914930 con 0x55aff18fb8a0 2026-02-20T03:39:18.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.495+0000 7f0b6b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1913c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.495+0000 7f0b6bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 0x55aff191f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.496+0000 7f0b6bfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 0x55aff191f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54238/0 (socket says 10.20.193.28:54238) 2026-02-20T03:39:18.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.496+0000 7f0b6bfff640 1 -- 10.20.193.28:0/1386351162 learned_addr learned my addr 10.20.193.28:0/1386351162 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:18.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.496+0000 7f0b6affd640 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b6bfff640 1 -- 10.20.193.28:0/1386351162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 msgr2=0x55aff19141b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:18.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19141b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b6bfff640 1 -- 10.20.193.28:0/1386351162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 msgr2=0x55aff1913c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:18.501 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1913c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b6bfff640 1 -- 10.20.193.28:0/1386351162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff190d3e0 con 0x55aff18ff630 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1913c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 0x55aff191f8e0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f0b600145e0 tx=0x7f0b60004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf6c52fc63f0cd6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b2d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/1386351162 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60019040 con 0x55aff18ff630 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.497+0000 7f0b7473ee00 1 -- 10.20.193.28:0/1386351162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aff161cb60 con 0x55aff18ff630 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.498+0000 7f0b7473ee00 10 client.22080 _ll_register_callbacks cb 0x55aff17f90d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.498+0000 7f0b7473ee00 1 -- 10.20.193.28:0/1386351162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55aff18557f0 con 0x55aff18ff630 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.498+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/1386351162 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0b60023020 con 0x55aff18ff630 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.498+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/1386351162 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60014cd0 con 0x55aff18ff630 2026-02-20T03:39:18.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.498+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/1386351162 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0b60014640 con 0x55aff18ff630 2026-02-20T03:39:18.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.498+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/1386351162 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f0b60006060 con 0x55aff18ff630 2026-02-20T03:39:18.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.499+0000 7f0b7473ee00 10 client.22080 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:18.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.499+0000 7f0b7473ee00 1 -- 10.20.193.28:0/1386351162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=57}) -- 0x55aff181a430 con 0x55aff18ff630 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.499+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/1386351162 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7f0b6002f060 con 0x55aff18ff630 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.499+0000 7f0b7473ee00 10 client.22080 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.499+0000 7f0b7473ee00 10 client.22080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.499+0000 7f0b7473ee00 20 client.22080 populate_metadata read hostname 'trial028' 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.499+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aff1923ba0 0x55aff1925f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.499+0000 7f0b7473ee00 4 client.22080 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.499+0000 7f0b7473ee00 1 -- 10.20.193.28:0/1386351162 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aff17cfc00 con 0x55aff1923ba0 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.500+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aff1923ba0 0x55aff1925f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.500+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aff1923ba0 0x55aff1925f90 crc :-1 s=READY pgs=611 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c78f8a04a3218ffd server_cookie=234763c23aafc390 in_seq=0 out_seq=0 2026-02-20T03:39:18.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.500+0000 7f0b2d7fa640 10 client.22080 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:18.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.502+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/1386351162 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55aff17cfc00 con 0x55aff1923ba0 2026-02-20T03:39:18.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.502+0000 7f0b2d7fa640 10 client.22080 handle_command_reply: tid=0 2026-02-20T03:39:18.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.502+0000 7f0b7473ee00 1 client.22080 shutdown 2026-02-20T03:39:18.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.502+0000 7f0b7473ee00 1 -- 10.20.193.28:0/1386351162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 msgr2=0x55aff191f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:18.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.502+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 0x55aff191f8e0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f0b600145e0 tx=0x7f0b60004870 comp rx=0 tx=0).stop 2026-02-20T03:39:18.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.502+0000 7f0b7473ee00 1 -- 10.20.193.28:0/1386351162 shutdown_connections 2026-02-20T03:39:18.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.503+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aff1923ba0 0x55aff1925f90 crc :-1 s=READY pgs=611 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.503+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 0x55aff191f8e0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.503+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff19141b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.503+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/1386351162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1913c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.503+0000 7f0b2d7fa640 0 client.22080 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:18.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.503+0000 7f0b7473ee00 1 -- 10.20.193.28:0/1386351162 >> 10.20.193.28:0/1386351162 conn(0x55aff18f3aa0 msgr2=0x55aff18fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:18.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.504+0000 7f0b7473ee00 1 -- 10.20.193.28:0/1386351162 shutdown_connections 2026-02-20T03:39:18.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.504+0000 7f0b7473ee00 1 -- 10.20.193.28:0/1386351162 wait complete. 2026-02-20T03:39:18.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.504+0000 7f0b7473ee00 20 client.22080 trim_cache size 0 max 16384 2026-02-20T03:39:18.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.518+0000 7f0b7473ee00 1 Processor -- start 2026-02-20T03:39:18.521 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.518+0000 7f0b7473ee00 1 -- start start 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.518+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1900a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.518+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff1900fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.518+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 0x55aff192b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.518+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b10012760 con 0x55aff18ff630 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.518+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1000ffa0 con 0x55aff18faee0 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.518+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1000ddf0 con 0x55aff18fb8a0 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.518+0000 7f0b6b7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1900a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.519+0000 7f0b6affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff1900fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.519+0000 7f0b6affd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff1900fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45192/0 (socket says 10.20.193.28:45192) 2026-02-20T03:39:18.522 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.519+0000 7f0b6affd640 1 -- 10.20.193.28:0/3613921606 learned_addr learned my addr 10.20.193.28:0/3613921606 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:18.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.519+0000 7f0b6b7fe640 1 -- 10.20.193.28:0/3613921606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 msgr2=0x55aff1900fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:18.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.519+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/3613921606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff1900fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.519+0000 7f0b6b7fe640 1 -- 10.20.193.28:0/3613921606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 msgr2=0x55aff192b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:18.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.519+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/3613921606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 0x55aff192b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.519+0000 7f0b6b7fe640 1 -- 10.20.193.28:0/3613921606 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff190d210 con 0x55aff18faee0 2026-02-20T03:39:18.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.520+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/3613921606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1900a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0b580a7940 tx=0x7f0b580dd4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5771d3cc864a3ee8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:18.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.520+0000 7f0b2f7fe640 1 -- 10.20.193.28:0/3613921606 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5801d070 con 0x55aff18faee0 2026-02-20T03:39:18.524 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.520+0000 7f0b2f7fe640 1 -- 10.20.193.28:0/3613921606 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0b580ae040 con 0x55aff18faee0 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.520+0000 7f0b2f7fe640 1 -- 10.20.193.28:0/3613921606 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b580ae1f0 con 0x55aff18faee0 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 -- 10.20.193.28:0/3613921606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 msgr2=0x55aff1900a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/3613921606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1900a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0b580a7940 tx=0x7f0b580dd4a0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 -- 10.20.193.28:0/3613921606 shutdown_connections 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/3613921606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18ff630 0x55aff192b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/3613921606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff1900fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/3613921606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18faee0 0x55aff1900a80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 -- 10.20.193.28:0/3613921606 >> 10.20.193.28:0/3613921606 conn(0x55aff18f3aa0 msgr2=0x55aff1900370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 -- 10.20.193.28:0/3613921606 shutdown_connections 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 -- 10.20.193.28:0/3613921606 wait complete. 2026-02-20T03:39:18.525 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.521+0000 7f0b7473ee00 1 -- start start 2026-02-20T03:39:18.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.522+0000 7f0b7473ee00 1 Processor -- start 2026-02-20T03:39:18.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.522+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 0x55aff191ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.522+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff1919220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.522+0000 7f0b7473ee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff1919760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.522+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1000e460 con 0x55aff18faee0 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.522+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1000f8d0 con 0x55aff18ff630 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.522+0000 7f0b7473ee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f0b1000eb30 con 0x55aff18fb8a0 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.523+0000 7f0b6bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff1919760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.523+0000 7f0b6bfff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff1919760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38340/0 (socket says 10.20.193.28:38340) 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.523+0000 7f0b6bfff640 1 -- 10.20.193.28:0/381314467 learned_addr learned my addr 10.20.193.28:0/381314467 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.523+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 0x55aff191ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.523+0000 7f0b6affd640 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff1919220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.523+0000 7f0b6bfff640 1 -- 10.20.193.28:0/381314467 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 msgr2=0x55aff1919220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.523+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff1919220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.523+0000 7f0b6bfff640 1 -- 10.20.193.28:0/381314467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 msgr2=0x55aff191ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:18.528 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.523+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 0x55aff191ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.524+0000 7f0b6bfff640 1 -- 10.20.193.28:0/381314467 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff152c900 con 0x55aff18ff630 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.524+0000 7f0b6bfff640 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff1919760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0b60017040 tx=0x7f0b600148c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bcc2992224a6a6d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.524+0000 7f0b2d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.524+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/381314467 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60033070 con 0x55aff18ff630 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.524+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/381314467 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f0b60023040 con 0x55aff18ff630 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.524+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/381314467 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60019070 con 0x55aff18ff630 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.524+0000 7f0b7473ee00 1 -- 10.20.193.28:0/381314467 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aff18084d0 con 0x55aff18ff630 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.524+0000 7f0b7473ee00 10 client.28901 _ll_register_callbacks cb 0x7f0b60004500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.524+0000 7f0b7473ee00 1 -- 10.20.193.28:0/381314467 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b60009e50 con 0x55aff18ff630 2026-02-20T03:39:18.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/381314467 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f0b6001e410 con 0x55aff18ff630 2026-02-20T03:39:18.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/381314467 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f0b6001e690 con 0x55aff18ff630 2026-02-20T03:39:18.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b7473ee00 10 client.28901 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:18.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b7473ee00 1 -- 10.20.193.28:0/381314467 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=57}) -- 0x55aff190df00 con 0x55aff18ff630 2026-02-20T03:39:18.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/381314467 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7f0b6002f030 con 0x55aff18ff630 2026-02-20T03:39:18.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b7473ee00 10 client.28901 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:18.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b7473ee00 10 client.28901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:18.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b7473ee00 20 client.28901 populate_metadata read hostname 'trial028' 2026-02-20T03:39:18.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aff198f640 0x55aff1991b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:18.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b7473ee00 4 client.28901 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:39:18.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.525+0000 7f0b7473ee00 1 -- 10.20.193.28:0/381314467 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55aff190ba10 con 0x55aff198f640 2026-02-20T03:39:18.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.526+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aff198f640 0x55aff1991b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:18.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.527+0000 7f0b6b7fe640 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aff198f640 0x55aff1991b00 crc :-1 s=READY pgs=612 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f47e772d63a2893 server_cookie=e9afaee6734c43f8 in_seq=0 out_seq=0 2026-02-20T03:39:18.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.527+0000 7f0b2d7fa640 10 client.28901 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.528+0000 7f0b2d7fa640 1 -- 10.20.193.28:0/381314467 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55aff190ba10 con 0x55aff198f640 2026-02-20T03:39:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.528+0000 7f0b2d7fa640 10 client.28901 handle_command_reply: tid=0 2026-02-20T03:39:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.528+0000 7f0b7473ee00 1 client.28901 shutdown 2026-02-20T03:39:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.528+0000 7f0b7473ee00 1 -- 10.20.193.28:0/381314467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 msgr2=0x55aff1919760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.528+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff1919760 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0b60017040 tx=0x7f0b600148c0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b7473ee00 1 -- 10.20.193.28:0/381314467 shutdown_connections 2026-02-20T03:39:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55aff198f640 0x55aff1991b00 crc :-1 s=READY pgs=612 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55aff18ff630 0x55aff1919760 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55aff18fb8a0 0x55aff1919220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b7473ee00 1 --2- 10.20.193.28:0/381314467 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55aff18faee0 0x55aff191ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b7473ee00 1 -- 10.20.193.28:0/381314467 >> 10.20.193.28:0/381314467 conn(0x55aff18f3aa0 msgr2=0x55aff1912b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:18.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b2d7fa640 0 client.28901 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:18.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b7473ee00 1 -- 10.20.193.28:0/381314467 shutdown_connections 2026-02-20T03:39:18.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b7473ee00 1 -- 10.20.193.28:0/381314467 wait complete. 2026-02-20T03:39:18.534 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b7473ee00 20 client.28901 trim_cache size 0 max 16384 2026-02-20T03:39:18.534 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:39:18.534 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:39:18.535 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "3b4923cd-e294-4b7e-a461-a92b7824e1bf", 2026-02-20T03:39:18.535 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:39:18.535 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b400b1020 msgr2=0x7f0b400b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.529+0000 7f0b72239640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b400b1020 0x7f0b400b34e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c002410 tx=0x7f0b5c031040 comp rx=0 tx=0).stop 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 msgr2=0x7f0b6c1a73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 0x7f0b6c1a73e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800d950 tx=0x7f0b5800de20 comp rx=0 tx=0).stop 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 shutdown_connections 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f0b400b1020 0x7f0b400b34e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f0b6c1136a0 0x7f0b6c1a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f0b6c1067a0 0x7f0b6c1a7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 --2- 10.20.193.28:0/2125408850 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f0b6c075950 0x7f0b6c1a73e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:18.536 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 >> 10.20.193.28:0/2125408850 conn(0x7f0b6c0fe630 msgr2=0x7f0b6c111730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 shutdown_connections 2026-02-20T03:39:18.537 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:18.530+0000 7f0b72239640 1 -- 10.20.193.28:0/2125408850 wait complete. 2026-02-20T03:39:18.640 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:39:18.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 261199 20.42 MB/sec execute 529 sec latency 33.780 ms 2026-02-20T03:39:19.011 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:19.070 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:18 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:39:19.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:18 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:39:19.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:18 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:39:19.248 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.245+0000 7fe3fa891640 1 -- 10.20.193.28:0/3014903840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe3f4077f40 msgr2=0x7fe3f4113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:19.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.245+0000 7fe3fa891640 1 --2- 10.20.193.28:0/3014903840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe3f4077f40 0x7fe3f4113310 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009a30 tx=0x7fe3e802f220 comp rx=0 tx=0).stop 2026-02-20T03:39:19.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.245+0000 7fe3fa891640 1 -- 10.20.193.28:0/3014903840 shutdown_connections 2026-02-20T03:39:19.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.245+0000 7fe3fa891640 1 --2- 10.20.193.28:0/3014903840 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe3f4113850 0x7fe3f4115c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.245+0000 7fe3fa891640 1 --2- 10.20.193.28:0/3014903840 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe3f4077f40 0x7fe3f4113310 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.246+0000 7fe3fa891640 1 --2- 10.20.193.28:0/3014903840 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3f4077620 0x7fe3f4077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.246+0000 7fe3fa891640 1 -- 10.20.193.28:0/3014903840 >> 10.20.193.28:0/3014903840 conn(0x7fe3f4100690 msgr2=0x7fe3f4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:19.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.246+0000 7fe3fa891640 1 -- 10.20.193.28:0/3014903840 shutdown_connections 2026-02-20T03:39:19.249 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.246+0000 7fe3fa891640 1 -- 10.20.193.28:0/3014903840 wait complete. 2026-02-20T03:39:19.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.247+0000 7fe3fa891640 1 Processor -- start 2026-02-20T03:39:19.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.247+0000 7fe3fa891640 1 -- start start 2026-02-20T03:39:19.250 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.247+0000 7fe3fa891640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3f4077620 0x7fe3f41a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.248+0000 7fe3fa891640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe3f4077f40 0x7fe3f41a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.248+0000 7fe3fa891640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe3f4113850 0x7fe3f41a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.252 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.248+0000 7fe3f988f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3f4077620 0x7fe3f41a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.248+0000 7fe3f988f640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3f4077620 0x7fe3f41a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54280/0 (socket says 10.20.193.28:54280) 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.248+0000 7fe3f908e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe3f4077f40 0x7fe3f41a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.248+0000 7fe3f908e640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe3f4077f40 0x7fe3f41a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45218/0 (socket says 10.20.193.28:45218) 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.248+0000 7fe3f988f640 1 -- 10.20.193.28:0/2311042606 learned_addr learned my addr 10.20.193.28:0/2311042606 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f4119260 con 0x7fe3f4077620 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41190e0 con 0x7fe3f4113850 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f41193e0 con 0x7fe3f4077f40 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3fa090640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe3f4113850 0x7fe3f41a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3f988f640 1 -- 10.20.193.28:0/2311042606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe3f4077f40 msgr2=0x7fe3f41a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:19.253 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3f988f640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe3f4077f40 0x7fe3f41a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3f988f640 1 -- 10.20.193.28:0/2311042606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe3f4113850 msgr2=0x7fe3f41a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:19.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3f988f640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe3f4113850 0x7fe3f41a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3f988f640 1 -- 10.20.193.28:0/2311042606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f41a5720 con 0x7fe3f4077620 2026-02-20T03:39:19.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.249+0000 7fe3f988f640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3f4077620 0x7fe3f41a1780 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40027e0 tx=0x7fe3e4002cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:19.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.250+0000 7fe3e2ffd640 1 -- 10.20.193.28:0/2311042606 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e400ed40 con 0x7fe3f4077620 2026-02-20T03:39:19.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.250+0000 7fe3e2ffd640 1 -- 10.20.193.28:0/2311042606 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe3e40108d0 con 0x7fe3f4077620 2026-02-20T03:39:19.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.250+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f41a5a10 con 0x7fe3f4077620 2026-02-20T03:39:19.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.250+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f41ae330 con 0x7fe3f4077620 2026-02-20T03:39:19.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.250+0000 7fe3e2ffd640 1 -- 10.20.193.28:0/2311042606 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e400ed40 con 0x7fe3f4077620 2026-02-20T03:39:19.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.253+0000 7fe3fe01fe00 1 Processor -- start 2026-02-20T03:39:19.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fe01fe00 1 -- start start 2026-02-20T03:39:19.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.257 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fa090640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fa090640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:38368/0 (socket says 10.20.193.28:38368) 2026-02-20T03:39:19.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502abfb0 0x5622502b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56225022be50 con 0x5622502abfb0 2026-02-20T03:39:19.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5622501fe9c0 con 0x5622502b1000 2026-02-20T03:39:19.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5622501ac240 con 0x5622502ab630 2026-02-20T03:39:19.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3e2ffd640 1 -- 10.20.193.28:0/2311042606 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe3e4010430 con 0x7fe3f4077620 2026-02-20T03:39:19.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.254+0000 7fe3fa090640 1 -- 10.20.193.28:0/3104607706 learned_addr learned my addr 10.20.193.28:0/3104607706 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:19.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.255+0000 7fe3fa090640 1 -- 10.20.193.28:0/3104607706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 msgr2=0x5622502aba70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:39:19.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.255+0000 7fe3f908e640 1 --2- 10.20.193.28:0/3104607706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502abfb0 0x5622502b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.255+0000 7fe3f988f640 1 --2- 10.20.193.28:0/3104607706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.255+0000 7fe3fa090640 1 --2- 10.20.193.28:0/3104607706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.255+0000 7fe3fa090640 1 -- 10.20.193.28:0/3104607706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502abfb0 msgr2=0x5622502b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:19.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.255+0000 7fe3fa090640 1 --2- 10.20.193.28:0/3104607706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502abfb0 0x5622502b7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.255+0000 7fe3fa090640 1 -- 10.20.193.28:0/3104607706 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622501bf420 con 0x5622502b1000 2026-02-20T03:39:19.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.256+0000 7fe3fa090640 1 --2- 10.20.193.28:0/3104607706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502b13e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009480 tx=0x7fe3f0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87c1e9a1f89dc5a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:19.260 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.256+0000 7fe3e2ffd640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3d00b0fa0 0x7fe3d00b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.256+0000 7fe3c24e6640 1 -- 10.20.193.28:0/3104607706 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f001b070 con 0x5622502b1000 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.256+0000 7fe3c24e6640 1 -- 10.20.193.28:0/3104607706 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe3f00045b0 con 0x5622502b1000 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.256+0000 7fe3c24e6640 1 -- 10.20.193.28:0/3104607706 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0013af0 con 0x5622502b1000 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.256+0000 7fe3e2ffd640 1 -- 10.20.193.28:0/2311042606 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe3e40e0370 con 0x7fe3f4077620 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.256+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/3104607706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 msgr2=0x5622502b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.256+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/3104607706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502b13e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009480 tx=0x7fe3f0009920 comp rx=0 tx=0).stop 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.257+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/3104607706 shutdown_connections 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.257+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/3104607706 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502abfb0 0x5622502b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.257+0000 7fe3f988f640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3d00b0fa0 0x7fe3d00b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.257+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/3104607706 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.261 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.257+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/3104607706 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502b13e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.257+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/3104607706 >> 10.20.193.28:0/3104607706 conn(0x56225026e290 msgr2=0x5622502a9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:19.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.257+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/3104607706 shutdown_connections 2026-02-20T03:39:19.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.257+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/3104607706 wait complete. 2026-02-20T03:39:19.262 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.257+0000 7fe3f988f640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3d00b0fa0 0x7fe3d00b3460 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40dda40 tx=0x7fe3e40023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:19.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.258+0000 7fe3fe01fe00 1 -- start start 2026-02-20T03:39:19.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.259+0000 7fe3fe01fe00 1 Processor -- start 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.259+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.259+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502abfb0 0x5622502c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.259+0000 7fe3fa090640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.259+0000 7fe3fa090640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54286/0 (socket says 10.20.193.28:54286) 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.259+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.259+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5622501fa8f0 con 0x5622502ab630 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.259+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56224ffecf50 con 0x5622502b1000 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.259+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5622502c4b30 con 0x5622502abfb0 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3fa090640 1 -- 10.20.193.28:0/96167323 learned_addr learned my addr 10.20.193.28:0/96167323 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3fa090640 1 -- 10.20.193.28:0/96167323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502abfb0 msgr2=0x5622502c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3f908e640 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502abfb0 0x5622502c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.264 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3fa090640 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502abfb0 0x5622502c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3fa090640 1 -- 10.20.193.28:0/96167323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 msgr2=0x5622502c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:19.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3fa090640 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3fa090640 1 -- 10.20.193.28:0/96167323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622502bdb20 con 0x5622502ab630 2026-02-20T03:39:19.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3f908e640 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502abfb0 0x5622502c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:39:19.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3fa090640 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c5c70 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0004340 tx=0x7fe3f0004370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d1583256a71b4c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:19.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3a77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:19.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3a77fe640 1 -- 10.20.193.28:0/96167323 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0023020 con 0x5622502ab630 2026-02-20T03:39:19.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.260+0000 7fe3a77fe640 1 -- 10.20.193.28:0/96167323 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe3f0013d90 con 0x5622502ab630 2026-02-20T03:39:19.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.261+0000 7fe3a77fe640 1 -- 10.20.193.28:0/96167323 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f001b040 con 0x5622502ab630 2026-02-20T03:39:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.261+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/96167323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56224ffcfb40 con 0x5622502ab630 2026-02-20T03:39:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.261+0000 7fe3fe01fe00 10 client.22092 _ll_register_callbacks cb 0x562250237f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.261+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/96167323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56225020c1a0 con 0x5622502ab630 2026-02-20T03:39:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3a77fe640 1 -- 10.20.193.28:0/96167323 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe3f0015410 con 0x5622502ab630 2026-02-20T03:39:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3a77fe640 1 -- 10.20.193.28:0/96167323 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fe3f0015bb0 con 0x5622502ab630 2026-02-20T03:39:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3fe01fe00 10 client.22092 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/96167323 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=57}) -- 0x5622501b9230 con 0x5622502ab630 2026-02-20T03:39:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3a77fe640 1 -- 10.20.193.28:0/96167323 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7fe3f001e030 con 0x5622502ab630 2026-02-20T03:39:19.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3fe01fe00 10 client.22092 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3fe01fe00 10 client.22092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3fe01fe00 20 client.22092 populate_metadata read hostname 'trial028' 2026-02-20T03:39:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5622502d4350 0x5622502d6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3fe01fe00 4 client.22092 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.262+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/96167323 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622502065b0 con 0x5622502d4350 2026-02-20T03:39:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.263+0000 7fe3f908e640 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5622502d4350 0x5622502d6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.264+0000 7fe3f908e640 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5622502d4350 0x5622502d6740 crc :-1 s=READY pgs=613 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=490286c5e5b398b9 server_cookie=9ab8edf5db3c155c in_seq=0 out_seq=0 2026-02-20T03:39:19.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.264+0000 7fe3a77fe640 10 client.22092 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3a77fe640 1 -- 10.20.193.28:0/96167323 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5622502065b0 con 0x5622502d4350 2026-02-20T03:39:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3a77fe640 10 client.22092 handle_command_reply: tid=0 2026-02-20T03:39:19.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 client.22092 shutdown 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/96167323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 msgr2=0x5622502c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c5c70 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0004340 tx=0x7fe3f0004370 comp rx=0 tx=0).stop 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/96167323 shutdown_connections 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5622502d4350 0x5622502d6740 crc :-1 s=READY pgs=613 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502abfb0 0x5622502c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/96167323 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c5c70 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/96167323 >> 10.20.193.28:0/96167323 conn(0x56225026e290 msgr2=0x5622502aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3a77fe640 0 client.22092 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.265+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/96167323 shutdown_connections 2026-02-20T03:39:19.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.266+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/96167323 wait complete. 2026-02-20T03:39:19.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.266+0000 7fe3fe01fe00 20 client.22092 trim_cache size 0 max 16384 2026-02-20T03:39:19.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.274+0000 7fe3fe01fe00 1 Processor -- start 2026-02-20T03:39:19.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.274+0000 7fe3fe01fe00 1 -- start start 2026-02-20T03:39:19.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502c1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502abfb0 0x5622502c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fa090640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502dbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe398012850 con 0x5622502abfb0 2026-02-20T03:39:19.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe398010090 con 0x5622502b1000 2026-02-20T03:39:19.278 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe39800dee0 con 0x5622502ab630 2026-02-20T03:39:19.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fa090640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502c1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:45232/0 (socket says 10.20.193.28:45232) 2026-02-20T03:39:19.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fa090640 1 -- 10.20.193.28:0/1221570710 learned_addr learned my addr 10.20.193.28:0/1221570710 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:19.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.275+0000 7fe3fa090640 1 --2- 10.20.193.28:0/1221570710 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502dbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.276+0000 7fe3fa090640 1 -- 10.20.193.28:0/1221570710 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 msgr2=0x5622502dbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:19.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.276+0000 7fe3fa090640 1 --2- 10.20.193.28:0/1221570710 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502dbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.276+0000 7fe3fa090640 1 -- 10.20.193.28:0/1221570710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502abfb0 msgr2=0x5622502c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:19.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.276+0000 7fe3fa090640 1 --2- 10.20.193.28:0/1221570710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502abfb0 0x5622502c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.276+0000 7fe3fa090640 1 -- 10.20.193.28:0/1221570710 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622502c4720 con 0x5622502ab630 2026-02-20T03:39:19.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.276+0000 7fe3fa090640 1 --2- 10.20.193.28:0/1221570710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502c1940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009a20 tx=0x7fe3f0028000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81eb02e05069c58e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:19.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.276+0000 7fe3c1ce5640 1 -- 10.20.193.28:0/1221570710 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f001b070 con 0x5622502ab630 2026-02-20T03:39:19.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3c1ce5640 1 -- 10.20.193.28:0/1221570710 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56225020c1a0 con 0x5622502ab630 2026-02-20T03:39:19.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3c1ce5640 1 -- 10.20.193.28:0/1221570710 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0023040 con 0x5622502ab630 2026-02-20T03:39:19.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/1221570710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 msgr2=0x5622502c1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:19.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/1221570710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502c1940 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009a20 tx=0x7fe3f0028000 comp rx=0 tx=0).stop 2026-02-20T03:39:19.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/1221570710 shutdown_connections 2026-02-20T03:39:19.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/1221570710 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502b1000 0x5622502dbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/1221570710 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502abfb0 0x5622502c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/1221570710 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502ab630 0x5622502c1940 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/1221570710 >> 10.20.193.28:0/1221570710 conn(0x56225026e290 msgr2=0x5622502c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/1221570710 shutdown_connections 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.277+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/1221570710 wait complete. 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.278+0000 7fe3fe01fe00 1 -- start start 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.278+0000 7fe3fe01fe00 1 Processor -- start 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502abfb0 0x5622502c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fe01fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502b1000 0x56225033ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe39800e550 con 0x5622502ab630 2026-02-20T03:39:19.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe39800f9c0 con 0x5622502abfb0 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fe01fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe39800ec20 con 0x5622502b1000 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fa090640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fa090640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54300/0 (socket says 10.20.193.28:54300) 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fa090640 1 -- 10.20.193.28:0/767751776 learned_addr learned my addr 10.20.193.28:0/767751776 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3f908e640 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502abfb0 0x5622502c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fa090640 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502b1000 0x56225033ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fa090640 1 -- 10.20.193.28:0/767751776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502b1000 msgr2=0x56225033ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fa090640 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502b1000 0x56225033ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fa090640 1 -- 10.20.193.28:0/767751776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502abfb0 msgr2=0x5622502c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fa090640 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502abfb0 0x5622502c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3fa090640 1 -- 10.20.193.28:0/767751776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622502bd950 con 0x5622502ab630 2026-02-20T03:39:19.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.279+0000 7fe3f908e640 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502abfb0 0x5622502c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:39:19.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.280+0000 7fe3fa090640 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c9270 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009b30 tx=0x7fe3f0004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fabbbdbe8e9139 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:19.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.280+0000 7fe3a77fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:19.287 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.280+0000 7fe3a77fe640 1 -- 10.20.193.28:0/767751776 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f001b070 con 0x5622502ab630 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.280+0000 7fe3a77fe640 1 -- 10.20.193.28:0/767751776 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe3f0013800 con 0x5622502ab630 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.280+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/767751776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56224fedd870 con 0x5622502ab630 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.280+0000 7fe3fe01fe00 10 client.22095 _ll_register_callbacks cb 0x7fe3f0019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.280+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/767751776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5622501b0b00 con 0x5622502ab630 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.280+0000 7fe3a77fe640 1 -- 10.20.193.28:0/767751776 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0023040 con 0x5622502ab630 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.281+0000 7fe3a77fe640 1 -- 10.20.193.28:0/767751776 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe3f0028450 con 0x5622502ab630 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.281+0000 7fe3a77fe640 1 -- 10.20.193.28:0/767751776 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7fe3f0028650 con 0x5622502ab630 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.281+0000 7fe3fe01fe00 10 client.22095 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.281+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/767751776 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=57}) -- 0x56225019e440 con 0x5622502ab630 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.281+0000 7fe3a77fe640 1 -- 10.20.193.28:0/767751776 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7fe3f003c020 con 0x5622502ab630 2026-02-20T03:39:19.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.281+0000 7fe3fe01fe00 10 client.22095 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.281+0000 7fe3fe01fe00 10 client.22095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.281+0000 7fe3fe01fe00 20 client.22095 populate_metadata read hostname 'trial028' 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.282+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5622503407c0 0x562250342c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.282+0000 7fe3fe01fe00 4 client.22095 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.282+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/767751776 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56225020c1a0 con 0x5622503407c0 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.282+0000 7fe3f908e640 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5622503407c0 0x562250342c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.283+0000 7fe3f908e640 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5622503407c0 0x562250342c80 crc :-1 s=READY pgs=614 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25d548d113eaa985 server_cookie=c8e89246161778ce in_seq=0 out_seq=0 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.283+0000 7fe3a77fe640 10 client.22095 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3a77fe640 1 -- 10.20.193.28:0/767751776 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56225020c1a0 con 0x5622503407c0 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3a77fe640 10 client.22095 handle_command_reply: tid=0 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 client.22095 shutdown 2026-02-20T03:39:19.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/767751776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 msgr2=0x5622502c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c9270 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009b30 tx=0x7fe3f0004460 comp rx=0 tx=0).stop 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/767751776 shutdown_connections 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5622503407c0 0x562250342c80 crc :-1 s=READY pgs=614 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3a77fe640 0 client.22095 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5622502b1000 0x56225033ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5622502abfb0 0x5622502c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 --2- 10.20.193.28:0/767751776 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5622502ab630 0x5622502c9270 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/767751776 >> 10.20.193.28:0/767751776 conn(0x56225026e290 msgr2=0x5622502d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/767751776 shutdown_connections 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.284+0000 7fe3fe01fe00 1 -- 10.20.193.28:0/767751776 wait complete. 2026-02-20T03:39:19.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.285+0000 7fe3fe01fe00 20 client.22095 trim_cache size 0 max 16384 2026-02-20T03:39:19.291 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:39:19.291 INFO:teuthology.orchestra.run.trial028.stdout: "status": "IDLE (waiting for more scrubs)", 2026-02-20T03:39:19.291 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:39:19.291 INFO:teuthology.orchestra.run.trial028.stdout: "3b4923cd-e294-4b7e-a461-a92b7824e1bf": { 2026-02-20T03:39:19.291 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:39:19.291 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "3b4923cd-e294-4b7e-a461-a92b7824e1bf", 2026-02-20T03:39:19.291 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:39:19.291 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:39:19.292 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:39:19.292 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:39:19.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.285+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3d00b0fa0 msgr2=0x7fe3d00b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.285+0000 7fe3fa891640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3d00b0fa0 0x7fe3d00b3460 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40dda40 tx=0x7fe3e40023d0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.285+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3f4077620 msgr2=0x7fe3f41a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.285+0000 7fe3fa891640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3f4077620 0x7fe3f41a1780 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40027e0 tx=0x7fe3e4002cb0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.286+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 shutdown_connections 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.286+0000 7fe3fa891640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe3d00b0fa0 0x7fe3d00b3460 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.286+0000 7fe3fa891640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe3f4113850 0x7fe3f41a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.286+0000 7fe3fa891640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe3f4077f40 0x7fe3f41a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.286+0000 7fe3fa891640 1 --2- 10.20.193.28:0/2311042606 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe3f4077620 0x7fe3f41a1780 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.286+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 >> 10.20.193.28:0/2311042606 conn(0x7fe3f4100690 msgr2=0x7fe3f4102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.286+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 shutdown_connections 2026-02-20T03:39:19.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:19.286+0000 7fe3fa891640 1 -- 10.20.193.28:0/2311042606 wait complete. 2026-02-20T03:39:19.403 INFO:tasks.cephfs.filesystem:scrub status for tag:3b4923cd-e294-4b7e-a461-a92b7824e1bf - {'path': '/', 'tag': '3b4923cd-e294-4b7e-a461-a92b7824e1bf', 'options': 'recursive,force'} 2026-02-20T03:39:19.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 262191 20.46 MB/sec execute 530 sec latency 72.838 ms 2026-02-20T03:39:20.074 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:19 trial028 ceph-mon[38552]: pgmap v925: 129 pgs: 129 active+clean; 744 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.0 MiB/s wr, 1.20k op/s 2026-02-20T03:39:20.075 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:19 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:39:20.075 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:19 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:39:20.075 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:19 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.075 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:19 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:39:20.075 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:19 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.075 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:19 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.075 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:19 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:19 trial126 ceph-mon[38476]: pgmap v925: 129 pgs: 129 active+clean; 744 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.0 MiB/s wr, 1.20k op/s 2026-02-20T03:39:20.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:19 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:39:20.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:19 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:39:20.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:19 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:19 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:39:20.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:19 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:19 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:19 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 -- 10.20.193.28:0/4220179079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104260 msgr2=0x7f232810aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:20.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 --2- 10.20.193.28:0/4220179079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104260 0x7f232810aaf0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f232400b0a0 tx=0x7f232402f450 comp rx=0 tx=0).stop 2026-02-20T03:39:20.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 -- 10.20.193.28:0/4220179079 shutdown_connections 2026-02-20T03:39:20.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 --2- 10.20.193.28:0/4220179079 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2328104260 0x7f232810aaf0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 --2- 10.20.193.28:0/4220179079 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23281038a0 0x7f2328103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 --2- 10.20.193.28:0/4220179079 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f23281026b0 0x7f2328102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.126 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 -- 10.20.193.28:0/4220179079 >> 10.20.193.28:0/4220179079 conn(0x7f23280fde10 msgr2=0x7f2328100250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:20.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 -- 10.20.193.28:0/4220179079 shutdown_connections 2026-02-20T03:39:20.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 -- 10.20.193.28:0/4220179079 wait complete. 2026-02-20T03:39:20.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.123+0000 7f232dd7d640 1 Processor -- start 2026-02-20T03:39:20.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232dd7d640 1 -- start start 2026-02-20T03:39:20.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232dd7d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23281026b0 0x7f23281a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232dd7d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23281038a0 0x7f23281a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.128 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232dd7d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2328104260 0x7f23281a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232dd7d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f232810e2c0 con 0x7f23281026b0 2026-02-20T03:39:20.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232dd7d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f232810e140 con 0x7f23281038a0 2026-02-20T03:39:20.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232dd7d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f232810e440 con 0x7f2328104260 2026-02-20T03:39:20.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232cd7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23281026b0 0x7f23281a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232cd7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23281026b0 0x7f23281a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54324/0 (socket says 10.20.193.28:54324) 2026-02-20T03:39:20.129 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232cd7b640 1 -- 10.20.193.28:0/804133311 learned_addr learned my addr 10.20.193.28:0/804133311 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:20.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232cd7b640 1 -- 10.20.193.28:0/804133311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2328104260 msgr2=0x7f23281a8640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:20.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232cd7b640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2328104260 0x7f23281a8640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232cd7b640 1 -- 10.20.193.28:0/804133311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23281038a0 msgr2=0x7f23281a15d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:20.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232cd7b640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23281038a0 0x7f23281a15d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.124+0000 7f232cd7b640 1 -- 10.20.193.28:0/804133311 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23281a8d40 con 0x7f23281026b0 2026-02-20T03:39:20.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.125+0000 7f232cd7b640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23281026b0 0x7f23281a1090 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f231800b750 tx=0x7f231800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:20.137 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.125+0000 7f231dffb640 1 -- 10.20.193.28:0/804133311 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318004480 con 0x7f23281026b0 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.125+0000 7f231dffb640 1 -- 10.20.193.28:0/804133311 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2318010070 con 0x7f23281026b0 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.125+0000 7f231dffb640 1 -- 10.20.193.28:0/804133311 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231800ca90 con 0x7f23281026b0 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.125+0000 7f232dd7d640 1 -- 10.20.193.28:0/804133311 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23281a8fd0 con 0x7f23281026b0 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.125+0000 7f232dd7d640 1 -- 10.20.193.28:0/804133311 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23281a94f0 con 0x7f23281026b0 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.127+0000 7f231dffb640 1 -- 10.20.193.28:0/804133311 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f231801d030 con 0x7f23281026b0 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.127+0000 7f2331e63e00 1 Processor -- start 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.127+0000 7f2331e63e00 1 -- start start 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.127+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632de280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.127+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.127+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.127+0000 7f2331e63e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56496322e8f0 con 0x5649632de7c0 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.127+0000 7f2331e63e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5649631dc2e0 con 0x5649632e3560 2026-02-20T03:39:20.138 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.127+0000 7f2331e63e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56496322a820 con 0x5649632dde80 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f232cd7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f232cd7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632e2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54336/0 (socket says 10.20.193.28:54336) 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f232cd7b640 1 -- 10.20.193.28:0/1972844460 learned_addr learned my addr 10.20.193.28:0/1972844460 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f232cd7b640 1 -- 10.20.193.28:0/1972844460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 msgr2=0x5649632de280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f232cd7b640 1 --2- 10.20.193.28:0/1972844460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632de280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f232cd7b640 1 -- 10.20.193.28:0/1972844460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 msgr2=0x5649632e59f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f232cd7b640 1 --2- 10.20.193.28:0/1972844460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632e59f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f232cd7b640 1 -- 10.20.193.28:0/1972844460 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649631ce5a0 con 0x5649632de7c0 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f231dffb640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23040b0ea0 0x7f23040b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f232cd7b640 1 --2- 10.20.193.28:0/1972844460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632e2f40 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f23180e5d00 tx=0x7f23180e7750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a52135f3ba4ebc3 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:20.139 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f231dffb640 1 -- 10.20.193.28:0/804133311 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f23180df900 con 0x7f23281026b0 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.129+0000 7f22f53fe640 1 -- 10.20.193.28:0/1972844460 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180a3250 con 0x5649632de7c0 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f22f53fe640 1 -- 10.20.193.28:0/1972844460 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23180ec070 con 0x5649632de7c0 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f22f53fe640 1 -- 10.20.193.28:0/1972844460 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180a6b00 con 0x5649632de7c0 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f232d57c640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23040b0ea0 0x7f23040b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f2331e63e00 1 -- 10.20.193.28:0/1972844460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 msgr2=0x5649632e2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1972844460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632e2f40 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f23180e5d00 tx=0x7f23180e7750 comp rx=0 tx=0).stop 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f232d57c640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23040b0ea0 0x7f23040b3360 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f232400b0a0 tx=0x7f2324004590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f2331e63e00 1 -- 10.20.193.28:0/1972844460 shutdown_connections 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1972844460 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632e59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1972844460 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632e2f40 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.140 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1972844460 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632de280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f2331e63e00 1 -- 10.20.193.28:0/1972844460 >> 10.20.193.28:0/1972844460 conn(0x5649632d56f0 msgr2=0x5649632dc570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f2331e63e00 1 -- 10.20.193.28:0/1972844460 shutdown_connections 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.130+0000 7f2331e63e00 1 -- 10.20.193.28:0/1972844460 wait complete. 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.131+0000 7f2331e63e00 1 -- start start 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f2331e63e00 1 Processor -- start 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632dde80 0x5649632f6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632de7c0 0x5649632f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f2331e63e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5649631d60c0 con 0x5649632dde80 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f2331e63e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5649632e6610 con 0x5649632e3560 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f2331e63e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5649632fe1c0 con 0x5649632de7c0 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f232cd7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632dde80 0x5649632f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.141 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f232cd7b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632dde80 0x5649632f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54338/0 (socket says 10.20.193.28:54338) 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f232cd7b640 1 -- 10.20.193.28:0/1228726534 learned_addr learned my addr 10.20.193.28:0/1228726534 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f231ffff640 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632de7c0 0x5649632f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f232d57c640 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f232cd7b640 1 -- 10.20.193.28:0/1228726534 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632de7c0 msgr2=0x5649632f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f232cd7b640 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632de7c0 0x5649632f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f232cd7b640 1 -- 10.20.193.28:0/1228726534 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 msgr2=0x5649632fdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f232cd7b640 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632fdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.132+0000 7f232cd7b640 1 -- 10.20.193.28:0/1228726534 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649632f0300 con 0x5649632dde80 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f232cd7b640 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632dde80 0x5649632f6850 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f23180e7c60 tx=0x7f23180a7d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff828c5ea99508b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f22e67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f22e67fc640 1 -- 10.20.193.28:0/1228726534 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180a6ce0 con 0x5649632dde80 2026-02-20T03:39:20.142 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f22e67fc640 1 -- 10.20.193.28:0/1228726534 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f23180ab990 con 0x5649632dde80 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f22e67fc640 1 -- 10.20.193.28:0/1228726534 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23180a73b0 con 0x5649632dde80 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f2331e63e00 1 -- 10.20.193.28:0/1228726534 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649631ea820 con 0x5649632dde80 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f2331e63e00 10 client.22107 _ll_register_callbacks cb 0x5649631d9ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f2331e63e00 1 -- 10.20.193.28:0/1228726534 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5649632364e0 con 0x5649632dde80 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f22e67fc640 1 -- 10.20.193.28:0/1228726534 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f23180b03b0 con 0x5649632dde80 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f22e67fc640 1 -- 10.20.193.28:0/1228726534 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f23180a7100 con 0x5649632dde80 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f2331e63e00 10 client.22107 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.133+0000 7f2331e63e00 1 -- 10.20.193.28:0/1228726534 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=57}) -- 0x5649631ef380 con 0x5649632dde80 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.134+0000 7f22e67fc640 1 -- 10.20.193.28:0/1228726534 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7f23180a65f0 con 0x5649632dde80 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.134+0000 7f2331e63e00 10 client.22107 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.134+0000 7f2331e63e00 10 client.22107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:20.143 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.134+0000 7f2331e63e00 20 client.22107 populate_metadata read hostname 'trial028' 2026-02-20T03:39:20.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.134+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564963301fc0 0x564963304460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.134+0000 7f2331e63e00 4 client.22107 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:20.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.134+0000 7f2331e63e00 1 -- 10.20.193.28:0/1228726534 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649631b0bd0 con 0x564963301fc0 2026-02-20T03:39:20.144 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.134+0000 7f231ffff640 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564963301fc0 0x564963304460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.135+0000 7f231ffff640 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564963301fc0 0x564963304460 crc :-1 s=READY pgs=615 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4607a2bd267d1010 server_cookie=dada1f13e0f7a8c2 in_seq=0 out_seq=0 2026-02-20T03:39:20.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.135+0000 7f22e67fc640 10 client.22107 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:20.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.135+0000 7f22e67fc640 1 -- 10.20.193.28:0/1228726534 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5649631b0bd0 con 0x564963301fc0 2026-02-20T03:39:20.145 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.135+0000 7f22e67fc640 10 client.22107 handle_command_reply: tid=0 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.135+0000 7f2331e63e00 1 client.22107 shutdown 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.135+0000 7f2331e63e00 1 -- 10.20.193.28:0/1228726534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632dde80 msgr2=0x5649632f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.135+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632dde80 0x5649632f6850 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f23180e7c60 tx=0x7f23180a7d50 comp rx=0 tx=0).stop 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f2331e63e00 1 -- 10.20.193.28:0/1228726534 shutdown_connections 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x564963301fc0 0x564963304460 crc :-1 s=READY pgs=615 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632fdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632de7c0 0x5649632f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1228726534 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632dde80 0x5649632f6850 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f22e67fc640 0 client.22107 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f2331e63e00 1 -- 10.20.193.28:0/1228726534 >> 10.20.193.28:0/1228726534 conn(0x5649632d56f0 msgr2=0x5649632e4910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:20.146 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f2331e63e00 1 -- 10.20.193.28:0/1228726534 shutdown_connections 2026-02-20T03:39:20.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f2331e63e00 1 -- 10.20.193.28:0/1228726534 wait complete. 2026-02-20T03:39:20.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.136+0000 7f2331e63e00 20 client.22107 trim_cache size 0 max 16384 2026-02-20T03:39:20.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.144+0000 7f2331e63e00 1 Processor -- start 2026-02-20T03:39:20.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.144+0000 7f2331e63e00 1 -- start start 2026-02-20T03:39:20.147 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632de7c0 0x5649632fdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632e3560 0x5649632f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f2331e63e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc012760 con 0x5649632e3560 2026-02-20T03:39:20.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f2331e63e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00ffa0 con 0x5649632de7c0 2026-02-20T03:39:20.148 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f2331e63e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00ddf0 con 0x5649632dde80 2026-02-20T03:39:20.149 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232d57c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632e3560 0x5649632f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232d57c640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632e3560 0x5649632f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54354/0 (socket says 10.20.193.28:54354) 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232cd7b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232d57c640 1 -- 10.20.193.28:0/3707710933 learned_addr learned my addr 10.20.193.28:0/3707710933 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f231ffff640 1 --2- 10.20.193.28:0/3707710933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632de7c0 0x5649632fdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232d57c640 1 -- 10.20.193.28:0/3707710933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 msgr2=0x5649632f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232d57c640 1 --2- 10.20.193.28:0/3707710933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232d57c640 1 -- 10.20.193.28:0/3707710933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632de7c0 msgr2=0x5649632fdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232d57c640 1 --2- 10.20.193.28:0/3707710933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632de7c0 0x5649632fdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232d57c640 1 -- 10.20.193.28:0/3707710933 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649632f0130 con 0x5649632e3560 2026-02-20T03:39:20.150 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.145+0000 7f232d57c640 1 --2- 10.20.193.28:0/3707710933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632e3560 0x5649632f38e0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f23240041a0 tx=0x7f232403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4518ff13c6728e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.146+0000 7f22f4bfd640 1 -- 10.20.193.28:0/3707710933 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324002c60 con 0x5649632e3560 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.146+0000 7f22f4bfd640 1 -- 10.20.193.28:0/3707710933 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2324048070 con 0x5649632e3560 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.146+0000 7f22f4bfd640 1 -- 10.20.193.28:0/3707710933 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324044a80 con 0x5649632e3560 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.146+0000 7f2331e63e00 1 -- 10.20.193.28:0/3707710933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632e3560 msgr2=0x5649632f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.146+0000 7f2331e63e00 1 --2- 10.20.193.28:0/3707710933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632e3560 0x5649632f38e0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f23240041a0 tx=0x7f232403b000 comp rx=0 tx=0).stop 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.146+0000 7f2331e63e00 1 -- 10.20.193.28:0/3707710933 shutdown_connections 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.146+0000 7f2331e63e00 1 --2- 10.20.193.28:0/3707710933 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632e3560 0x5649632f38e0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.147+0000 7f2331e63e00 1 --2- 10.20.193.28:0/3707710933 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632de7c0 0x5649632fdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.147+0000 7f2331e63e00 1 --2- 10.20.193.28:0/3707710933 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.147+0000 7f2331e63e00 1 -- 10.20.193.28:0/3707710933 >> 10.20.193.28:0/3707710933 conn(0x5649632d56f0 msgr2=0x5649632df6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.147+0000 7f2331e63e00 1 -- 10.20.193.28:0/3707710933 shutdown_connections 2026-02-20T03:39:20.151 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.147+0000 7f2331e63e00 1 -- 10.20.193.28:0/3707710933 wait complete. 2026-02-20T03:39:20.153 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f2331e63e00 1 -- start start 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f2331e63e00 1 Processor -- start 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632fbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632fc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f2331e63e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632fd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f2331e63e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00e460 con 0x5649632de7c0 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f2331e63e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00f8d0 con 0x5649632e3560 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f2331e63e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc00eb30 con 0x5649632dde80 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f231ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632fc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f231ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632fc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54358/0 (socket says 10.20.193.28:54358) 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.148+0000 7f231ffff640 1 -- 10.20.193.28:0/1769212377 learned_addr learned my addr 10.20.193.28:0/1769212377 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:20.154 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.149+0000 7f232d57c640 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.149+0000 7f232cd7b640 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632fbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.149+0000 7f231ffff640 1 -- 10.20.193.28:0/1769212377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 msgr2=0x5649632fbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.149+0000 7f231ffff640 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632fbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.149+0000 7f231ffff640 1 -- 10.20.193.28:0/1769212377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 msgr2=0x5649632fd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.149+0000 7f231ffff640 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632fd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.149+0000 7f231ffff640 1 -- 10.20.193.28:0/1769212377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564962f8e690 con 0x5649632de7c0 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.149+0000 7f22e67fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.149+0000 7f231ffff640 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632fc140 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f23100097d0 tx=0x7f2310004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5d36dc920676ff server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.150+0000 7f22e67fc640 1 -- 10.20.193.28:0/1769212377 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231001e020 con 0x5649632de7c0 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.150+0000 7f22e67fc640 1 -- 10.20.193.28:0/1769212377 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2310003cc0 con 0x5649632de7c0 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.150+0000 7f22e67fc640 1 -- 10.20.193.28:0/1769212377 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231001a670 con 0x5649632de7c0 2026-02-20T03:39:20.155 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.150+0000 7f2331e63e00 1 -- 10.20.193.28:0/1769212377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649631f3b70 con 0x5649632de7c0 2026-02-20T03:39:20.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.150+0000 7f22e67fc640 1 -- 10.20.193.28:0/1769212377 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f231001a810 con 0x5649632de7c0 2026-02-20T03:39:20.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.150+0000 7f22e67fc640 10 client.22113 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:39:20.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 10 client.22113 _ll_register_callbacks cb 0x7f23180e5f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:20.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 1 -- 10.20.193.28:0/1769212377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23180ec070 con 0x5649632de7c0 2026-02-20T03:39:20.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f22e67fc640 1 -- 10.20.193.28:0/1769212377 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f231001aa10 con 0x5649632de7c0 2026-02-20T03:39:20.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 10 client.22113 fetch_fsmap learned FSMap version 57 2026-02-20T03:39:20.156 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 1 -- 10.20.193.28:0/1769212377 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=57}) -- 0x5649632f0e20 con 0x5649632de7c0 2026-02-20T03:39:20.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f22e67fc640 1 -- 10.20.193.28:0/1769212377 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 57) ==== 8366+0+0 (secure 0 0 0) 0x7f231001abb0 con 0x5649632de7c0 2026-02-20T03:39:20.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 10 client.22113 fetch_fsmap finished waiting for FSMap version 57 2026-02-20T03:39:20.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 10 client.22113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:20.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 20 client.22113 populate_metadata read hostname 'trial028' 2026-02-20T03:39:20.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56496337f090 0x564963381550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:20.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 4 client.22113 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:39:20.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.151+0000 7f2331e63e00 1 -- 10.20.193.28:0/1769212377 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5649631ff6b0 con 0x56496337f090 2026-02-20T03:39:20.157 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.153+0000 7f232cd7b640 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56496337f090 0x564963381550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:20.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.155+0000 7f232cd7b640 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56496337f090 0x564963381550 crc :-1 s=READY pgs=616 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9d8810c22a1d100 server_cookie=9005cae118802750 in_seq=0 out_seq=0 2026-02-20T03:39:20.158 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.155+0000 7f22e67fc640 10 client.22113 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:20.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:19 trial177 ceph-mon[43181]: pgmap v925: 129 pgs: 129 active+clean; 744 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.0 MiB/s wr, 1.20k op/s 2026-02-20T03:39:20.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:19 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:39:20.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:19 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:39:20.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:19 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:19 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:39:20.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:19 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:19 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:19 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:20.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.733+0000 7f22e67fc640 1 -- 10.20.193.28:0/1769212377 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5649631ff6b0 con 0x56496337f090 2026-02-20T03:39:20.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.733+0000 7f22e67fc640 10 client.22113 handle_command_reply: tid=0 2026-02-20T03:39:20.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.733+0000 7f2331e63e00 1 client.22113 shutdown 2026-02-20T03:39:20.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.733+0000 7f2331e63e00 1 -- 10.20.193.28:0/1769212377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 msgr2=0x5649632fc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:20.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.733+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632fc140 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f23100097d0 tx=0x7f2310004480 comp rx=0 tx=0).stop 2026-02-20T03:39:20.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 263251 20.51 MB/sec execute 531 sec latency 340.144 ms 2026-02-20T03:39:20.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f2331e63e00 1 -- 10.20.193.28:0/1769212377 shutdown_connections 2026-02-20T03:39:20.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56496337f090 0x564963381550 crc :-1 s=READY pgs=616 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5649632e3560 0x5649632fd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5649632de7c0 0x5649632fc140 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f2331e63e00 1 --2- 10.20.193.28:0/1769212377 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5649632dde80 0x5649632fbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f2331e63e00 1 -- 10.20.193.28:0/1769212377 >> 10.20.193.28:0/1769212377 conn(0x5649632d56f0 msgr2=0x5649632f5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:20.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f22e67fc640 0 client.22113 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:20.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f2331e63e00 1 -- 10.20.193.28:0/1769212377 shutdown_connections 2026-02-20T03:39:20.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f2331e63e00 1 -- 10.20.193.28:0/1769212377 wait complete. 2026-02-20T03:39:20.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f2331e63e00 20 client.22113 trim_cache size 0 max 16384 2026-02-20T03:39:20.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:39:20.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:39:20.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:39:20.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:39:20.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f232dd7d640 1 -- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23040b0ea0 msgr2=0x7f23040b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:20.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f232dd7d640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23040b0ea0 0x7f23040b3360 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f232400b0a0 tx=0x7f2324004590 comp rx=0 tx=0).stop 2026-02-20T03:39:20.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f232dd7d640 1 -- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23281026b0 msgr2=0x7f23281a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:20.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.735+0000 7f232dd7d640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23281026b0 0x7f23281a1090 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f231800b750 tx=0x7f231800bc20 comp rx=0 tx=0).stop 2026-02-20T03:39:20.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.736+0000 7f232dd7d640 1 -- 10.20.193.28:0/804133311 shutdown_connections 2026-02-20T03:39:20.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.736+0000 7f232dd7d640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f23040b0ea0 0x7f23040b3360 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.736+0000 7f232dd7d640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2328104260 0x7f23281a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.736+0000 7f232dd7d640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f23281038a0 0x7f23281a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.736+0000 7f232dd7d640 1 --2- 10.20.193.28:0/804133311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f23281026b0 0x7f23281a1090 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:20.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.736+0000 7f232dd7d640 1 -- 10.20.193.28:0/804133311 >> 10.20.193.28:0/804133311 conn(0x7f23280fde10 msgr2=0x7f2328104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:20.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.736+0000 7f232dd7d640 1 -- 10.20.193.28:0/804133311 shutdown_connections 2026-02-20T03:39:20.741 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:20.736+0000 7f232dd7d640 1 -- 10.20.193.28:0/804133311 wait complete. 2026-02-20T03:39:21.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:20 trial126 ceph-mon[38476]: pgmap v926: 129 pgs: 129 active+clean; 763 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.1 MiB/s wr, 1.14k op/s 2026-02-20T03:39:21.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:20 trial028 ceph-mon[38552]: pgmap v926: 129 pgs: 129 active+clean; 763 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.1 MiB/s wr, 1.14k op/s 2026-02-20T03:39:21.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:20 trial177 ceph-mon[43181]: pgmap v926: 129 pgs: 129 active+clean; 763 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 23 MiB/s rd, 8.1 MiB/s wr, 1.14k op/s 2026-02-20T03:39:21.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 264797 20.66 MB/sec execute 532 sec latency 55.542 ms 2026-02-20T03:39:22.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 265877 20.73 MB/sec execute 533 sec latency 42.037 ms 2026-02-20T03:39:23.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 267407 20.81 MB/sec execute 534 sec latency 70.562 ms 2026-02-20T03:39:23.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:23 trial126 ceph-mon[38476]: pgmap v927: 129 pgs: 129 active+clean; 762 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.3 MiB/s wr, 1.05k op/s 2026-02-20T03:39:23.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:23 trial028 ceph-mon[38552]: pgmap v927: 129 pgs: 129 active+clean; 762 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.3 MiB/s wr, 1.05k op/s 2026-02-20T03:39:23.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:23 trial177 ceph-mon[43181]: pgmap v927: 129 pgs: 129 active+clean; 762 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.3 MiB/s wr, 1.05k op/s 2026-02-20T03:39:24.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 268838 20.96 MB/sec execute 535 sec latency 68.339 ms 2026-02-20T03:39:25.592 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:25 trial028 ceph-mon[38552]: pgmap v928: 129 pgs: 129 active+clean; 737 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.9 MiB/s wr, 1.18k op/s 2026-02-20T03:39:25.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 269590 20.98 MB/sec execute 536 sec latency 56.730 ms 2026-02-20T03:39:25.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:25 trial126 ceph-mon[38476]: pgmap v928: 129 pgs: 129 active+clean; 737 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.9 MiB/s wr, 1.18k op/s 2026-02-20T03:39:25.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:25 trial177 ceph-mon[43181]: pgmap v928: 129 pgs: 129 active+clean; 737 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 7.9 MiB/s wr, 1.18k op/s 2026-02-20T03:39:26.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 271059 21.06 MB/sec execute 537 sec latency 82.200 ms 2026-02-20T03:39:27.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 272393 21.20 MB/sec execute 538 sec latency 37.960 ms 2026-02-20T03:39:27.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:27 trial126 ceph-mon[38476]: pgmap v929: 129 pgs: 129 active+clean; 736 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 7.1 MiB/s wr, 1.11k op/s 2026-02-20T03:39:27.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:27 trial028 ceph-mon[38552]: pgmap v929: 129 pgs: 129 active+clean; 736 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 7.1 MiB/s wr, 1.11k op/s 2026-02-20T03:39:27.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:27 trial177 ceph-mon[43181]: pgmap v929: 129 pgs: 129 active+clean; 736 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 20 MiB/s rd, 7.1 MiB/s wr, 1.11k op/s 2026-02-20T03:39:28.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 273445 21.24 MB/sec execute 539 sec latency 42.821 ms 2026-02-20T03:39:29.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 274123 21.26 MB/sec execute 540 sec latency 579.766 ms 2026-02-20T03:39:29.764 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:29 trial028 ceph-mon[38552]: pgmap v930: 129 pgs: 129 active+clean; 749 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 6.9 MiB/s wr, 1.08k op/s 2026-02-20T03:39:29.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:29 trial126 ceph-mon[38476]: pgmap v930: 129 pgs: 129 active+clean; 749 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 6.9 MiB/s wr, 1.08k op/s 2026-02-20T03:39:29.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:29 trial177 ceph-mon[43181]: pgmap v930: 129 pgs: 129 active+clean; 749 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 19 MiB/s rd, 6.9 MiB/s wr, 1.08k op/s 2026-02-20T03:39:30.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274126 21.22 MB/sec execute 541 sec latency 1578.672 ms 2026-02-20T03:39:31.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274127 21.18 MB/sec execute 542 sec latency 2578.734 ms 2026-02-20T03:39:31.783 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:31 trial028 ceph-mon[38552]: pgmap v931: 129 pgs: 129 active+clean; 773 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 9.6 MiB/s wr, 1.23k op/s 2026-02-20T03:39:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:31 trial126 ceph-mon[38476]: pgmap v931: 129 pgs: 129 active+clean; 773 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 9.6 MiB/s wr, 1.23k op/s 2026-02-20T03:39:31.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:31 trial177 ceph-mon[43181]: pgmap v931: 129 pgs: 129 active+clean; 773 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 21 MiB/s rd, 9.6 MiB/s wr, 1.23k op/s 2026-02-20T03:39:32.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274127 21.15 MB/sec execute 543 sec latency 3578.773 ms 2026-02-20T03:39:32.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:32 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:39:32.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:32 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:39:33.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:32 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:39:33.646 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:39:33.647 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:33 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:39:33.647 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:33 trial028 ceph-mon[38552]: pgmap v932: 129 pgs: 129 active+clean; 780 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 9.3 MiB/s wr, 1.08k op/s 2026-02-20T03:39:33.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 274128 21.11 MB/sec execute 544 sec latency 4578.811 ms 2026-02-20T03:39:33.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.817+0000 7f6173fff640 1 -- 10.20.193.28:0/1784250116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6174109490 msgr2=0x7f6174109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:33.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.817+0000 7f6173fff640 1 --2- 10.20.193.28:0/1784250116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6174109490 0x7f6174109890 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f6168009a30 tx=0x7f616802f260 comp rx=0 tx=0).stop 2026-02-20T03:39:33.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.817+0000 7f6173fff640 1 -- 10.20.193.28:0/1784250116 shutdown_connections 2026-02-20T03:39:33.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.817+0000 7f6173fff640 1 --2- 10.20.193.28:0/1784250116 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f617410ecf0 0x7f61741110e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.821 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.817+0000 7f6173fff640 1 --2- 10.20.193.28:0/1784250116 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f617410c3c0 0x7f617410e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.817+0000 7f6173fff640 1 --2- 10.20.193.28:0/1784250116 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6174109490 0x7f6174109890 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.817+0000 7f6173fff640 1 -- 10.20.193.28:0/1784250116 >> 10.20.193.28:0/1784250116 conn(0x7f617406c010 msgr2=0x7f617407a650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 -- 10.20.193.28:0/1784250116 shutdown_connections 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 -- 10.20.193.28:0/1784250116 wait complete. 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 Processor -- start 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 -- start start 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6174109490 0x7f61741a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f617410c3c0 0x7f61741a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f617410ecf0 0x7f61741a86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6174114a60 con 0x7f617410c3c0 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f61741148e0 con 0x7f6174109490 2026-02-20T03:39:33.822 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6174114be0 con 0x7f617410ecf0 2026-02-20T03:39:33.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f61727fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f617410c3c0 0x7f61741a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:33.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f61727fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f617410c3c0 0x7f61741a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52472/0 (socket says 10.20.193.28:52472) 2026-02-20T03:39:33.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f61727fc640 1 -- 10.20.193.28:0/521996318 learned_addr learned my addr 10.20.193.28:0/521996318 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:33.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f61727fc640 1 -- 10.20.193.28:0/521996318 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f617410ecf0 msgr2=0x7f61741a86a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:33.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f61727fc640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f617410ecf0 0x7f61741a86a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f61727fc640 1 -- 10.20.193.28:0/521996318 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6174109490 msgr2=0x7f61741a10f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:33.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f61727fc640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6174109490 0x7f61741a10f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.827 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f61727fc640 1 -- 10.20.193.28:0/521996318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61741a8da0 con 0x7f617410c3c0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f61727fc640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f617410c3c0 0x7f61741a1630 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f615c00b750 tx=0x7f615c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6153fff640 1 -- 10.20.193.28:0/521996318 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c004480 con 0x7f617410c3c0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6153fff640 1 -- 10.20.193.28:0/521996318 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f615c010070 con 0x7f617410c3c0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6153fff640 1 -- 10.20.193.28:0/521996318 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615c00ca90 con 0x7f617410c3c0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 -- 10.20.193.28:0/521996318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61741a9090 con 0x7f617410c3c0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6173fff640 1 -- 10.20.193.28:0/521996318 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61741a9610 con 0x7f617410c3c0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.819+0000 7f6153fff640 1 -- 10.20.193.28:0/521996318 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f615c01d030 con 0x7f617410c3c0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f617c267e00 1 Processor -- start 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f617c267e00 1 -- start start 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f617c267e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556255386c50 0x556255387070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f617c267e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5562553875b0 0x55625538bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f617c267e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55625538c600 0x55625538ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f617c267e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5562552d78f0 con 0x5562553875b0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f617c267e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5562552852e0 con 0x556255386c50 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f617c267e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5562552d3820 con 0x55625538c600 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6172ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5562553875b0 0x55625538bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:33.828 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6172ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5562553875b0 0x55625538bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52474/0 (socket says 10.20.193.28:52474) 2026-02-20T03:39:33.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6172ffd640 1 -- 10.20.193.28:0/3904046250 learned_addr learned my addr 10.20.193.28:0/3904046250 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:33.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6172ffd640 1 -- 10.20.193.28:0/3904046250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55625538c600 msgr2=0x55625538ea30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:33.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6172ffd640 1 --2- 10.20.193.28:0/3904046250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55625538c600 0x55625538ea30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6153fff640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61480b0e20 0x7f61480b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6172ffd640 1 -- 10.20.193.28:0/3904046250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556255386c50 msgr2=0x556255387070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:33.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6172ffd640 1 --2- 10.20.193.28:0/3904046250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556255386c50 0x556255387070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.829 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6172ffd640 1 -- 10.20.193.28:0/3904046250 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562552775a0 con 0x5562553875b0 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6153fff640 1 -- 10.20.193.28:0/521996318 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f615c0df900 con 0x7f617410c3c0 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.824+0000 7f6172ffd640 1 --2- 10.20.193.28:0/3904046250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5562553875b0 0x55625538bfe0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f6168032040 tx=0x7f6168005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230b5ff17362b5e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f61737fe640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61480b0e20 0x7f61480b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f61513fe640 1 -- 10.20.193.28:0/3904046250 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6168038530 con 0x5562553875b0 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f61513fe640 1 -- 10.20.193.28:0/3904046250 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6168033040 con 0x5562553875b0 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f61513fe640 1 -- 10.20.193.28:0/3904046250 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61680045a0 con 0x5562553875b0 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f617c267e00 1 -- 10.20.193.28:0/3904046250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5562553875b0 msgr2=0x55625538bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f617c267e00 1 --2- 10.20.193.28:0/3904046250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5562553875b0 0x55625538bfe0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f6168032040 tx=0x7f6168005880 comp rx=0 tx=0).stop 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f61737fe640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61480b0e20 0x7f61480b32e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x556255387f50 tx=0x7f61640091d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f617c267e00 1 -- 10.20.193.28:0/3904046250 shutdown_connections 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f617c267e00 1 --2- 10.20.193.28:0/3904046250 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55625538c600 0x55625538ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f617c267e00 1 --2- 10.20.193.28:0/3904046250 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5562553875b0 0x55625538bfe0 unknown :-1 s=CLOSED pgs=2161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f617c267e00 1 --2- 10.20.193.28:0/3904046250 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556255386c50 0x556255387070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f617c267e00 1 -- 10.20.193.28:0/3904046250 >> 10.20.193.28:0/3904046250 conn(0x55625537e2d0 msgr2=0x556255385150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f617c267e00 1 -- 10.20.193.28:0/3904046250 shutdown_connections 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.825+0000 7f617c267e00 1 -- 10.20.193.28:0/3904046250 wait complete. 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f617c267e00 1 -- start start 2026-02-20T03:39:33.830 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f617c267e00 1 Processor -- start 2026-02-20T03:39:33.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f617c267e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556255386c50 0x55625539f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f617c267e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5562553875b0 0x55625539fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f617c267e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625538c600 0x5562553a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f617c267e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55625527f0c0 con 0x55625538c600 2026-02-20T03:39:33.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f617c267e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55625538f590 con 0x5562553875b0 2026-02-20T03:39:33.832 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f617c267e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5562553a73e0 con 0x556255386c50 2026-02-20T03:39:33.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f61737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625538c600 0x5562553a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:33.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f61737fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625538c600 0x5562553a6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52486/0 (socket says 10.20.193.28:52486) 2026-02-20T03:39:33.833 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f61737fe640 1 -- 10.20.193.28:0/3903187153 learned_addr learned my addr 10.20.193.28:0/3903187153 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:33.835 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f61737fe640 1 -- 10.20.193.28:0/3903187153 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556255386c50 msgr2=0x55625539f990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f61737fe640 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556255386c50 0x55625539f990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f61737fe640 1 -- 10.20.193.28:0/3903187153 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5562553875b0 msgr2=0x55625539fed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f61737fe640 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5562553875b0 0x55625539fed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.827+0000 7f61737fe640 1 -- 10.20.193.28:0/3903187153 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562553990b0 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f61737fe640 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625538c600 0x5562553a6e50 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f6164004350 tx=0x7f6164004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69169a9771a5ea55 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f613cbfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f613cbfc640 1 -- 10.20.193.28:0/3903187153 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616401b460 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f613cbfc640 1 -- 10.20.193.28:0/3903187153 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f616401baa0 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 1 -- 10.20.193.28:0/3903187153 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556255293820 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 10 client.22125 _ll_register_callbacks cb 0x556255282ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 1 -- 10.20.193.28:0/3903187153 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5562552df4e0 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f613cbfc640 1 -- 10.20.193.28:0/3903187153 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616400eba0 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f613cbfc640 1 -- 10.20.193.28:0/3903187153 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f616401bc50 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f613cbfc640 1 -- 10.20.193.28:0/3903187153 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f616401b600 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 10 client.22125 fetch_fsmap learned FSMap version 58 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 1 -- 10.20.193.28:0/3903187153 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=58}) -- 0x556255298380 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f613cbfc640 1 -- 10.20.193.28:0/3903187153 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 58) ==== 8370+0+0 (secure 0 0 0) 0x7f6164026470 con 0x55625538c600 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 10 client.22125 fetch_fsmap finished waiting for FSMap version 58 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 10 client.22125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 20 client.22125 populate_metadata read hostname 'trial028' 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5562553ab7d0 0x5562553adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 4 client.22125 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:33.836 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.831+0000 7f617c267e00 1 -- 10.20.193.28:0/3903187153 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556255259bd0 con 0x5562553ab7d0 2026-02-20T03:39:33.843 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.841+0000 7f6172ffd640 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5562553ab7d0 0x5562553adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:33.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.855+0000 7f6172ffd640 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5562553ab7d0 0x5562553adc60 crc :-1 s=READY pgs=617 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c993bda6dec4a688 server_cookie=9f65049bc4919823 in_seq=0 out_seq=0 2026-02-20T03:39:33.857 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.855+0000 7f613cbfc640 10 client.22125 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:33.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.883+0000 7f613cbfc640 1 -- 10.20.193.28:0/3903187153 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x556255259bd0 con 0x5562553ab7d0 2026-02-20T03:39:33.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.883+0000 7f613cbfc640 10 client.22125 handle_command_reply: tid=0 2026-02-20T03:39:33.885 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.883+0000 7f617c267e00 1 client.22125 shutdown 2026-02-20T03:39:33.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.883+0000 7f617c267e00 1 -- 10.20.193.28:0/3903187153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625538c600 msgr2=0x5562553a6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:33.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.883+0000 7f617c267e00 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625538c600 0x5562553a6e50 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f6164004350 tx=0x7f6164004c50 comp rx=0 tx=0).stop 2026-02-20T03:39:33.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.884+0000 7f617c267e00 1 -- 10.20.193.28:0/3903187153 shutdown_connections 2026-02-20T03:39:33.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.884+0000 7f617c267e00 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5562553ab7d0 0x5562553adc60 crc :-1 s=READY pgs=617 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.884+0000 7f617c267e00 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625538c600 0x5562553a6e50 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.884+0000 7f617c267e00 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5562553875b0 0x55625539fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.886 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.884+0000 7f617c267e00 1 --2- 10.20.193.28:0/3903187153 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556255386c50 0x55625539f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.884+0000 7f617c267e00 1 -- 10.20.193.28:0/3903187153 >> 10.20.193.28:0/3903187153 conn(0x55625537e2d0 msgr2=0x55625538d950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:33.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.889+0000 7f613cbfc640 0 client.22125 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:33.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.889+0000 7f617c267e00 1 -- 10.20.193.28:0/3903187153 shutdown_connections 2026-02-20T03:39:33.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.889+0000 7f617c267e00 1 -- 10.20.193.28:0/3903187153 wait complete. 2026-02-20T03:39:33.900 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.889+0000 7f617c267e00 20 client.22125 trim_cache size 0 max 16384 2026-02-20T03:39:33.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 Processor -- start 2026-02-20T03:39:33.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 -- start start 2026-02-20T03:39:33.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x55625539e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556255386c50 0x5562553a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5562553875b0 0x556255387f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6114012800 con 0x55625537e2d0 2026-02-20T03:39:33.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6114010040 con 0x556255386c50 2026-02-20T03:39:33.903 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f611400de90 con 0x5562553875b0 2026-02-20T03:39:33.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6172ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x55625539e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:33.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6172ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x55625539e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52500/0 (socket says 10.20.193.28:52500) 2026-02-20T03:39:33.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6172ffd640 1 -- 10.20.193.28:0/612541530 learned_addr learned my addr 10.20.193.28:0/612541530 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:33.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6172ffd640 1 -- 10.20.193.28:0/612541530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5562553875b0 msgr2=0x556255387f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:33.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6172ffd640 1 --2- 10.20.193.28:0/612541530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5562553875b0 0x556255387f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6172ffd640 1 -- 10.20.193.28:0/612541530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556255386c50 msgr2=0x5562553a6e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:33.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6172ffd640 1 --2- 10.20.193.28:0/612541530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556255386c50 0x5562553a6e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6172ffd640 1 -- 10.20.193.28:0/612541530 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556255398ee0 con 0x55625537e2d0 2026-02-20T03:39:33.904 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6172ffd640 1 --2- 10.20.193.28:0/612541530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x55625539e640 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f6168002410 tx=0x7f6168009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91bc34fb6fb3031 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:33.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6150bfd640 1 -- 10.20.193.28:0/612541530 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616802fac0 con 0x55625537e2d0 2026-02-20T03:39:33.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6150bfd640 1 -- 10.20.193.28:0/612541530 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6168004510 con 0x55625537e2d0 2026-02-20T03:39:33.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f6150bfd640 1 -- 10.20.193.28:0/612541530 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6168038aa0 con 0x55625537e2d0 2026-02-20T03:39:33.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 -- 10.20.193.28:0/612541530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 msgr2=0x55625539e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 --2- 10.20.193.28:0/612541530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x55625539e640 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f6168002410 tx=0x7f6168009340 comp rx=0 tx=0).stop 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 -- 10.20.193.28:0/612541530 shutdown_connections 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 --2- 10.20.193.28:0/612541530 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5562553875b0 0x556255387f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 --2- 10.20.193.28:0/612541530 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x556255386c50 0x5562553a6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 --2- 10.20.193.28:0/612541530 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x55625539e640 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 -- 10.20.193.28:0/612541530 >> 10.20.193.28:0/612541530 conn(0x55625539f5b0 msgr2=0x55625539df30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 -- 10.20.193.28:0/612541530 shutdown_connections 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.898+0000 7f617c267e00 1 -- 10.20.193.28:0/612541530 wait complete. 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 -- start start 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 Processor -- start 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x5562553a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f6172ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x5562553a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f6172ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x5562553a6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52508/0 (socket says 10.20.193.28:52508) 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556255386c50 0x5562553a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5562553875b0 0x5562553a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f611400e500 con 0x55625537e2d0 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f611400f970 con 0x5562553875b0 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f611400ebd0 con 0x556255386c50 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f6172ffd640 1 -- 10.20.193.28:0/763348848 learned_addr learned my addr 10.20.193.28:0/763348848 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f6172ffd640 1 -- 10.20.193.28:0/763348848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556255386c50 msgr2=0x5562553a51b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f6172ffd640 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556255386c50 0x5562553a51b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f6172ffd640 1 -- 10.20.193.28:0/763348848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5562553875b0 msgr2=0x5562553a56f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f6172ffd640 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5562553875b0 0x5562553a56f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f6172ffd640 1 -- 10.20.193.28:0/763348848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55625539dca0 con 0x55625537e2d0 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f6172ffd640 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x5562553a6b30 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f616802f2a0 tx=0x7f6168005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee861e051425033f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:33.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f613cbfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:33.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f613cbfc640 1 -- 10.20.193.28:0/763348848 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6168051070 con 0x55625537e2d0 2026-02-20T03:39:33.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f613cbfc640 1 -- 10.20.193.28:0/763348848 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6168033030 con 0x55625537e2d0 2026-02-20T03:39:33.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f613cbfc640 1 -- 10.20.193.28:0/763348848 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616804c7b0 con 0x55625537e2d0 2026-02-20T03:39:33.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 -- 10.20.193.28:0/763348848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556255037690 con 0x55625537e2d0 2026-02-20T03:39:33.914 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f613cbfc640 1 -- 10.20.193.28:0/763348848 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6168042420 con 0x55625537e2d0 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f613cbfc640 10 client.22131 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 10 client.22131 _ll_register_callbacks cb 0x7f616400ce40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 -- 10.20.193.28:0/763348848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5562550b0520 con 0x55625537e2d0 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f613cbfc640 1 -- 10.20.193.28:0/763348848 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f6168004090 con 0x55625537e2d0 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 10 client.22131 fetch_fsmap learned FSMap version 58 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 -- 10.20.193.28:0/763348848 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=58}) -- 0x55625529cb70 con 0x55625537e2d0 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f613cbfc640 1 -- 10.20.193.28:0/763348848 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 58) ==== 8370+0+0 (secure 0 0 0) 0x7f616804c950 con 0x55625537e2d0 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 10 client.22131 fetch_fsmap finished waiting for FSMap version 58 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 10 client.22131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 20 client.22131 populate_metadata read hostname 'trial028' 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55625538c600 0x55625542a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 4 client.22131 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.903+0000 7f617c267e00 1 -- 10.20.193.28:0/763348848 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5562552e5290 con 0x55625538c600 2026-02-20T03:39:33.915 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.912+0000 7f61727fc640 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55625538c600 0x55625542a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.927+0000 7f61727fc640 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55625538c600 0x55625542a960 crc :-1 s=READY pgs=618 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=314d23fe39b8174a server_cookie=92311251de91a334 in_seq=0 out_seq=0 2026-02-20T03:39:33.929 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:33.927+0000 7f613cbfc640 10 client.22131 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:33.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:39:33.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:33 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:39:33.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:33 trial177 ceph-mon[43181]: pgmap v932: 129 pgs: 129 active+clean; 780 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 9.3 MiB/s wr, 1.08k op/s 2026-02-20T03:39:34.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:39:34.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:33 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:39:34.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:33 trial126 ceph-mon[38476]: pgmap v932: 129 pgs: 129 active+clean; 780 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 18 MiB/s rd, 9.3 MiB/s wr, 1.08k op/s 2026-02-20T03:39:34.392 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f613cbfc640 1 -- 10.20.193.28:0/763348848 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5562552e5290 con 0x55625538c600 2026-02-20T03:39:34.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f613cbfc640 10 client.22131 handle_command_reply: tid=0 2026-02-20T03:39:34.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 client.22131 shutdown 2026-02-20T03:39:34.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 -- 10.20.193.28:0/763348848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 msgr2=0x5562553a6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:34.393 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x5562553a6b30 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f616802f2a0 tx=0x7f6168005950 comp rx=0 tx=0).stop 2026-02-20T03:39:34.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 -- 10.20.193.28:0/763348848 shutdown_connections 2026-02-20T03:39:34.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55625538c600 0x55625542a960 crc :-1 s=READY pgs=618 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:34.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5562553875b0 0x5562553a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:34.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x556255386c50 0x5562553a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:34.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 --2- 10.20.193.28:0/763348848 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55625537e2d0 0x5562553a6b30 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:34.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 -- 10.20.193.28:0/763348848 >> 10.20.193.28:0/763348848 conn(0x55625539f5b0 msgr2=0x55625539e750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:34.394 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f613cbfc640 0 client.22131 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:34.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 -- 10.20.193.28:0/763348848 shutdown_connections 2026-02-20T03:39:34.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 1 -- 10.20.193.28:0/763348848 wait complete. 2026-02-20T03:39:34.405 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f617c267e00 20 client.22131 trim_cache size 0 max 16384 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 -- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61480b0e20 msgr2=0x7f61480b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61480b0e20 0x7f61480b32e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x556255387f50 tx=0x7f61640091d0 comp rx=0 tx=0).stop 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 -- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f617410c3c0 msgr2=0x7f61741a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f617410c3c0 0x7f61741a1630 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f615c00b750 tx=0x7f615c00bc20 comp rx=0 tx=0).stop 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 -- 10.20.193.28:0/521996318 shutdown_connections 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f61480b0e20 0x7f61480b32e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f617410ecf0 0x7f61741a86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f617410c3c0 0x7f61741a1630 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 --2- 10.20.193.28:0/521996318 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6174109490 0x7f61741a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 -- 10.20.193.28:0/521996318 >> 10.20.193.28:0/521996318 conn(0x7f617406c010 msgr2=0x7f617410cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 -- 10.20.193.28:0/521996318 shutdown_connections 2026-02-20T03:39:34.406 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:34.390+0000 7f6173fff640 1 -- 10.20.193.28:0/521996318 wait complete. 2026-02-20T03:39:34.737 INFO:tasks.workunit.client.0.trial028.stdout: 10 274132 21.07 MB/sec execute 545 sec latency 5400.874 ms 2026-02-20T03:39:34.757 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:34 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:39:34.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:34 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:39:35.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:34 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:39:35.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274132 21.03 MB/sec execute 546 sec latency 6400.915 ms 2026-02-20T03:39:35.878 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:35 trial028 ceph-mon[38552]: pgmap v933: 129 pgs: 129 active+clean; 772 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 9.8 MiB/s wr, 958 op/s 2026-02-20T03:39:35.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:35 trial177 ceph-mon[43181]: pgmap v933: 129 pgs: 129 active+clean; 772 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 9.8 MiB/s wr, 958 op/s 2026-02-20T03:39:36.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:35 trial126 ceph-mon[38476]: pgmap v933: 129 pgs: 129 active+clean; 772 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 15 MiB/s rd, 9.8 MiB/s wr, 958 op/s 2026-02-20T03:39:36.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274132 20.99 MB/sec execute 547 sec latency 7400.958 ms 2026-02-20T03:39:37.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274132 20.95 MB/sec execute 548 sec latency 8400.996 ms 2026-02-20T03:39:37.761 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:37 trial028 ceph-mon[38552]: pgmap v934: 129 pgs: 129 active+clean; 761 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 9.9 MiB/s wr, 823 op/s 2026-02-20T03:39:37.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:37 trial177 ceph-mon[43181]: pgmap v934: 129 pgs: 129 active+clean; 761 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 9.9 MiB/s wr, 823 op/s 2026-02-20T03:39:38.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:37 trial126 ceph-mon[38476]: pgmap v934: 129 pgs: 129 active+clean; 761 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 12 MiB/s rd, 9.9 MiB/s wr, 823 op/s 2026-02-20T03:39:38.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.91 MB/sec execute 549 sec latency 9242.426 ms 2026-02-20T03:39:39.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.88 MB/sec execute 550 sec latency 10242.471 ms 2026-02-20T03:39:39.921 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:39 trial028 ceph-mon[38552]: pgmap v935: 129 pgs: 129 active+clean; 772 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 9.7 MiB/s rd, 11 MiB/s wr, 761 op/s 2026-02-20T03:39:39.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:39 trial177 ceph-mon[43181]: pgmap v935: 129 pgs: 129 active+clean; 772 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 9.7 MiB/s rd, 11 MiB/s wr, 761 op/s 2026-02-20T03:39:40.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:39 trial126 ceph-mon[38476]: pgmap v935: 129 pgs: 129 active+clean; 772 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 9.7 MiB/s rd, 11 MiB/s wr, 761 op/s 2026-02-20T03:39:40.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.84 MB/sec execute 551 sec latency 11242.513 ms 2026-02-20T03:39:41.048 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:40 trial028 ceph-mon[38552]: pgmap v936: 129 pgs: 129 active+clean; 774 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 12 MiB/s wr, 713 op/s 2026-02-20T03:39:41.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:40 trial177 ceph-mon[43181]: pgmap v936: 129 pgs: 129 active+clean; 774 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 12 MiB/s wr, 713 op/s 2026-02-20T03:39:41.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:40 trial126 ceph-mon[38476]: pgmap v936: 129 pgs: 129 active+clean; 774 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 6.5 MiB/s rd, 12 MiB/s wr, 713 op/s 2026-02-20T03:39:41.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.80 MB/sec execute 552 sec latency 12242.558 ms 2026-02-20T03:39:42.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.76 MB/sec execute 553 sec latency 13242.607 ms 2026-02-20T03:39:43.734 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:43 trial028 ceph-mon[38552]: pgmap v937: 129 pgs: 129 active+clean; 770 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 523 op/s 2026-02-20T03:39:43.747 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.73 MB/sec execute 554 sec latency 14242.647 ms 2026-02-20T03:39:43.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:43 trial126 ceph-mon[38476]: pgmap v937: 129 pgs: 129 active+clean; 770 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 523 op/s 2026-02-20T03:39:43.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:43 trial177 ceph-mon[43181]: pgmap v937: 129 pgs: 129 active+clean; 770 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 523 op/s 2026-02-20T03:39:44.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.69 MB/sec execute 555 sec latency 15242.689 ms 2026-02-20T03:39:44.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:44 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:39:44.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:44 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:39:45.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:44 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:39:45.673 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:45 trial028 ceph-mon[38552]: pgmap v938: 129 pgs: 129 active+clean; 776 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 829 KiB/s rd, 10 MiB/s wr, 487 op/s 2026-02-20T03:39:45.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.65 MB/sec execute 556 sec latency 16242.731 ms 2026-02-20T03:39:45.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:45 trial177 ceph-mon[43181]: pgmap v938: 129 pgs: 129 active+clean; 776 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 829 KiB/s rd, 10 MiB/s wr, 487 op/s 2026-02-20T03:39:46.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:45 trial126 ceph-mon[38476]: pgmap v938: 129 pgs: 129 active+clean; 776 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 829 KiB/s rd, 10 MiB/s wr, 487 op/s 2026-02-20T03:39:46.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.61 MB/sec execute 557 sec latency 17242.774 ms 2026-02-20T03:39:47.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- 10.20.193.28:0/39334949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c073ca0 msgr2=0x7f2e0c0740a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:47.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 --2- 10.20.193.28:0/39334949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c073ca0 0x7f2e0c0740a0 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009a30 tx=0x7f2e0002f260 comp rx=0 tx=0).stop 2026-02-20T03:39:47.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- 10.20.193.28:0/39334949 shutdown_connections 2026-02-20T03:39:47.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 --2- 10.20.193.28:0/39334949 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e0c10c9c0 0x7f2e0c10ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 --2- 10.20.193.28:0/39334949 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0c0745e0 0x7f2e0c10c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 --2- 10.20.193.28:0/39334949 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c073ca0 0x7f2e0c0740a0 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.472 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- 10.20.193.28:0/39334949 >> 10.20.193.28:0/39334949 conn(0x7f2e0c06f7e0 msgr2=0x7f2e0c071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:47.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- 10.20.193.28:0/39334949 shutdown_connections 2026-02-20T03:39:47.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- 10.20.193.28:0/39334949 wait complete. 2026-02-20T03:39:47.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 Processor -- start 2026-02-20T03:39:47.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- start start 2026-02-20T03:39:47.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e0c073ca0 0x7f2e0c1a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0c0745e0 0x7f2e0c1a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.474 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c10c9c0 0x7f2e0c1acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c118f10 con 0x7f2e0c10c9c0 2026-02-20T03:39:47.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c118d90 con 0x7f2e0c073ca0 2026-02-20T03:39:47.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c119090 con 0x7f2e0c0745e0 2026-02-20T03:39:47.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e0b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c10c9c0 0x7f2e0c1acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:47.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e0b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c10c9c0 0x7f2e0c1acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37436/0 (socket says 10.20.193.28:37436) 2026-02-20T03:39:47.475 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e0b577640 1 -- 10.20.193.28:0/963452184 learned_addr learned my addr 10.20.193.28:0/963452184 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e0b577640 1 -- 10.20.193.28:0/963452184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0c0745e0 msgr2=0x7f2e0c1a5a90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e0b577640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0c0745e0 0x7f2e0c1a5a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e0b577640 1 -- 10.20.193.28:0/963452184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e0c073ca0 msgr2=0x7f2e0c1a5550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e0b577640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e0c073ca0 0x7f2e0c1a5550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e0b577640 1 -- 10.20.193.28:0/963452184 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c1ad200 con 0x7f2e0c10c9c0 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e0b577640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c10c9c0 0x7f2e0c1acb00 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00b990 tx=0x7f2dfc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2debfff640 1 -- 10.20.193.28:0/963452184 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc006e60 con 0x7f2e0c10c9c0 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2debfff640 1 -- 10.20.193.28:0/963452184 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2dfc010070 con 0x7f2e0c10c9c0 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2debfff640 1 -- 10.20.193.28:0/963452184 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc004800 con 0x7f2e0c10c9c0 2026-02-20T03:39:47.477 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.469+0000 7f2e109a8640 1 -- 10.20.193.28:0/963452184 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0c1ad4f0 con 0x7f2e0c10c9c0 2026-02-20T03:39:47.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.471+0000 7f2e109a8640 1 -- 10.20.193.28:0/963452184 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0c1ada70 con 0x7f2e0c10c9c0 2026-02-20T03:39:47.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.473+0000 7f2debfff640 1 -- 10.20.193.28:0/963452184 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2dfc01d030 con 0x7f2e0c10c9c0 2026-02-20T03:39:47.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.473+0000 7f2e14012e00 1 Processor -- start 2026-02-20T03:39:47.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e14012e00 1 -- start start 2026-02-20T03:39:47.478 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd55689280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd556897c0 0x55cd5568df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd5568e560 0x55cd556909f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e14012e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd555d98f0 con 0x55cd55688e80 2026-02-20T03:39:47.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e14012e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cd555872e0 con 0x55cd5568e560 2026-02-20T03:39:47.480 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e14012e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cd555d5820 con 0x55cd556897c0 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e0a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd55689280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e0a575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd55689280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37444/0 (socket says 10.20.193.28:37444) 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.474+0000 7f2e0a575640 1 -- 10.20.193.28:0/235347199 learned_addr learned my addr 10.20.193.28:0/235347199 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2e0a575640 1 -- 10.20.193.28:0/235347199 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd556897c0 msgr2=0x55cd5568df40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2e0a575640 1 --2- 10.20.193.28:0/235347199 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd556897c0 0x55cd5568df40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2e0a575640 1 -- 10.20.193.28:0/235347199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd5568e560 msgr2=0x55cd556909f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2e0a575640 1 --2- 10.20.193.28:0/235347199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd5568e560 0x55cd556909f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2e0a575640 1 -- 10.20.193.28:0/235347199 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd555795a0 con 0x55cd55688e80 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2e0a575640 1 --2- 10.20.193.28:0/235347199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd55689280 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009860 tx=0x7f2df4009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901374471a2250da server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2de93fe640 1 -- 10.20.193.28:0/235347199 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4016070 con 0x55cd55688e80 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2de93fe640 1 -- 10.20.193.28:0/235347199 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2df400b8d0 con 0x55cd55688e80 2026-02-20T03:39:47.481 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2de93fe640 1 -- 10.20.193.28:0/235347199 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4002db0 con 0x55cd55688e80 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2debfff640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2de00b0e20 0x7f2de00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2debfff640 1 -- 10.20.193.28:0/963452184 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2dfc0dfff0 con 0x7f2e0c10c9c0 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2e14012e00 1 -- 10.20.193.28:0/235347199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 msgr2=0x55cd55689280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.475+0000 7f2e14012e00 1 --2- 10.20.193.28:0/235347199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd55689280 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009860 tx=0x7f2df4009d30 comp rx=0 tx=0).stop 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2de00b0e20 0x7f2de00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- 10.20.193.28:0/235347199 shutdown_connections 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 --2- 10.20.193.28:0/235347199 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd5568e560 0x55cd556909f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 --2- 10.20.193.28:0/235347199 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd556897c0 0x55cd5568df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 --2- 10.20.193.28:0/235347199 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd55689280 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- 10.20.193.28:0/235347199 >> 10.20.193.28:0/235347199 conn(0x55cd556806f0 msgr2=0x55cd55687570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- 10.20.193.28:0/235347199 shutdown_connections 2026-02-20T03:39:47.482 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- 10.20.193.28:0/235347199 wait complete. 2026-02-20T03:39:47.491 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2de00b0e20 0x7f2de00b32e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009950 tx=0x7f2e000023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- start start 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 Processor -- start 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd556a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd556897c0 0x55cd556a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd5568e560 0x55cd556a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55cd555810c0 con 0x55cd55688e80 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55cd55691610 con 0x55cd556897c0 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55cd556a94a0 con 0x55cd5568e560 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd556a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd556a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37446/0 (socket says 10.20.193.28:37446) 2026-02-20T03:39:47.492 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 -- 10.20.193.28:0/3472229714 learned_addr learned my addr 10.20.193.28:0/3472229714 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 -- 10.20.193.28:0/3472229714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd5568e560 msgr2=0x55cd556a8f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd5568e560 0x55cd556a8f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 -- 10.20.193.28:0/3472229714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd556897c0 msgr2=0x55cd556a1f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd556897c0 0x55cd556a1f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 -- 10.20.193.28:0/3472229714 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd5569b180 con 0x55cd55688e80 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e0ad76640 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd556a1a50 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f2e00037000 tx=0x7f2e0002f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281867eb143bf75b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2dd4bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/3472229714 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00038680 con 0x55cd55688e80 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/3472229714 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2e00033040 con 0x55cd55688e80 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/3472229714 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00045a60 con 0x55cd55688e80 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- 10.20.193.28:0/3472229714 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd55595820 con 0x55cd55688e80 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/3472229714 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2e00045c00 con 0x55cd55688e80 2026-02-20T03:39:47.493 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 10 client.22143 _ll_register_callbacks cb 0x55cd55584ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- 10.20.193.28:0/3472229714 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd555e14e0 con 0x55cd55688e80 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/3472229714 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f2e00045420 con 0x55cd55688e80 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 10 client.22143 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- 10.20.193.28:0/3472229714 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x55cd5559a380 con 0x55cd55688e80 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/3472229714 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f2e0004d070 con 0x55cd55688e80 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 10 client.22143 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 10 client.22143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 20 client.22143 populate_metadata read hostname 'trial028' 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cd556ad920 0x55cd556afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 4 client.22143 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:47.494 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.476+0000 7f2e14012e00 1 -- 10.20.193.28:0/3472229714 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd5555bbd0 con 0x55cd556ad920 2026-02-20T03:39:47.503 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.500+0000 7f2e0a575640 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cd556ad920 0x55cd556afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:47.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.567+0000 7f2e0a575640 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cd556ad920 0x55cd556afde0 crc :-1 s=READY pgs=619 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb071b1692ee1b38 server_cookie=9746c803f2d243df in_seq=0 out_seq=0 2026-02-20T03:39:47.569 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.567+0000 7f2dd4bfc640 10 client.22143 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:47.596 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/3472229714 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55cd5555bbd0 con 0x55cd556ad920 2026-02-20T03:39:47.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2dd4bfc640 10 client.22143 handle_command_reply: tid=0 2026-02-20T03:39:47.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 client.22143 shutdown 2026-02-20T03:39:47.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 -- 10.20.193.28:0/3472229714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 msgr2=0x55cd556a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:47.597 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd556a1a50 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f2e00037000 tx=0x7f2e0002f260 comp rx=0 tx=0).stop 2026-02-20T03:39:47.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 -- 10.20.193.28:0/3472229714 shutdown_connections 2026-02-20T03:39:47.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cd556ad920 0x55cd556afde0 crc :-1 s=READY pgs=619 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd5568e560 0x55cd556a8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd556897c0 0x55cd556a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 --2- 10.20.193.28:0/3472229714 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd55688e80 0x55cd556a1a50 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 -- 10.20.193.28:0/3472229714 >> 10.20.193.28:0/3472229714 conn(0x55cd556806f0 msgr2=0x55cd5568f910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:47.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2dd4bfc640 0 client.22143 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:47.598 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 -- 10.20.193.28:0/3472229714 shutdown_connections 2026-02-20T03:39:47.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 1 -- 10.20.193.28:0/3472229714 wait complete. 2026-02-20T03:39:47.599 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.594+0000 7f2e14012e00 20 client.22143 trim_cache size 0 max 16384 2026-02-20T03:39:47.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e14012e00 1 Processor -- start 2026-02-20T03:39:47.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e14012e00 1 -- start start 2026-02-20T03:39:47.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd55688e80 0x55cd5568abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd556897c0 0x55cd556a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e14012e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2db0012780 con 0x55cd5568e560 2026-02-20T03:39:47.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e14012e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2db000ffc0 con 0x55cd556897c0 2026-02-20T03:39:47.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e14012e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2db000de10 con 0x55cd55688e80 2026-02-20T03:39:47.607 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e0b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e0b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37454/0 (socket says 10.20.193.28:37454) 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e0b577640 1 -- 10.20.193.28:0/248005288 learned_addr learned my addr 10.20.193.28:0/248005288 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e0b577640 1 -- 10.20.193.28:0/248005288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd55688e80 msgr2=0x55cd5568abb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e0b577640 1 --2- 10.20.193.28:0/248005288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd55688e80 0x55cd5568abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e0b577640 1 -- 10.20.193.28:0/248005288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd556897c0 msgr2=0x55cd556a8ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e0b577640 1 --2- 10.20.193.28:0/248005288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd556897c0 0x55cd556a8ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e0b577640 1 -- 10.20.193.28:0/248005288 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd5569afb0 con 0x55cd5568e560 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.602+0000 7f2e0b577640 1 --2- 10.20.193.28:0/248005288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556af930 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0a7a30 tx=0x7f2dfc0a7430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cede5aa094a9b894 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2de8bfd640 1 -- 10.20.193.28:0/248005288 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0c8e60 con 0x55cd5568e560 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2de8bfd640 1 -- 10.20.193.28:0/248005288 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2dfc01c2f0 con 0x55cd5568e560 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2de8bfd640 1 -- 10.20.193.28:0/248005288 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0a3d70 con 0x55cd5568e560 2026-02-20T03:39:47.608 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 -- 10.20.193.28:0/248005288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 msgr2=0x55cd556af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:47.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 --2- 10.20.193.28:0/248005288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556af930 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0a7a30 tx=0x7f2dfc0a7430 comp rx=0 tx=0).stop 2026-02-20T03:39:47.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 -- 10.20.193.28:0/248005288 shutdown_connections 2026-02-20T03:39:47.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 --2- 10.20.193.28:0/248005288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556af930 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 --2- 10.20.193.28:0/248005288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd556897c0 0x55cd556a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 --2- 10.20.193.28:0/248005288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd55688e80 0x55cd5568abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 -- 10.20.193.28:0/248005288 >> 10.20.193.28:0/248005288 conn(0x55cd556806f0 msgr2=0x55cd556a0160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:47.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 -- 10.20.193.28:0/248005288 shutdown_connections 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 -- 10.20.193.28:0/248005288 wait complete. 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 -- start start 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.603+0000 7f2e14012e00 1 Processor -- start 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.604+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd55688e80 0x55cd556a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.604+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd556897c0 0x55cd556a7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.604+0000 7f2e14012e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.604+0000 7f2e14012e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2db000e480 con 0x55cd5568e560 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.604+0000 7f2e14012e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2db000f8f0 con 0x55cd55688e80 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.604+0000 7f2e14012e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2db000eb50 con 0x55cd556897c0 2026-02-20T03:39:47.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.604+0000 7f2e0b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.604+0000 7f2e0b577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556a80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37466/0 (socket says 10.20.193.28:37466) 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.604+0000 7f2e0b577640 1 -- 10.20.193.28:0/2172566418 learned_addr learned my addr 10.20.193.28:0/2172566418 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e0b577640 1 -- 10.20.193.28:0/2172566418 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd556897c0 msgr2=0x55cd556a7070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e0b577640 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd556897c0 0x55cd556a7070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e0b577640 1 -- 10.20.193.28:0/2172566418 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd55688e80 msgr2=0x55cd556a6b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e0b577640 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd55688e80 0x55cd556a6b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e0b577640 1 -- 10.20.193.28:0/2172566418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd55690ea0 con 0x55cd5568e560 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e0b577640 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556a80a0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00bfd0 tx=0x7f2dfc0ce420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d48d08f19c6cc35 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2dd4bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/2172566418 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0c8e60 con 0x55cd5568e560 2026-02-20T03:39:47.613 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/2172566418 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2dfc0ac0e0 con 0x55cd5568e560 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 1 -- 10.20.193.28:0/2172566418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd55339690 con 0x55cd5568e560 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/2172566418 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0ae550 con 0x55cd5568e560 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 10 client.22149 _ll_register_callbacks cb 0x7f2e00009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/2172566418 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2dfc0a3450 con 0x55cd5568e560 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 1 -- 10.20.193.28:0/2172566418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2df400b8d0 con 0x55cd5568e560 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/2172566418 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f2dfc0b0f90 con 0x55cd5568e560 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 10 client.22149 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 1 -- 10.20.193.28:0/2172566418 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x55cd5559eb70 con 0x55cd5568e560 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/2172566418 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f2dfc0a3650 con 0x55cd5568e560 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 10 client.22149 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 10 client.22149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:47.614 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 20 client.22149 populate_metadata read hostname 'trial028' 2026-02-20T03:39:47.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cd55721d90 0x55cd55724250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:47.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 4 client.22149 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:39:47.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.605+0000 7f2e14012e00 1 -- 10.20.193.28:0/2172566418 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd555aa6b0 con 0x55cd55721d90 2026-02-20T03:39:47.623 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.621+0000 7f2e0ad76640 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cd55721d90 0x55cd55724250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:47.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.687+0000 7f2e0ad76640 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cd55721d90 0x55cd55724250 crc :-1 s=READY pgs=620 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca827e005035cc36 server_cookie=2f6cc8ca6034ace in_seq=0 out_seq=0 2026-02-20T03:39:47.690 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.687+0000 7f2dd4bfc640 10 client.22149 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:47.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.58 MB/sec execute 558 sec latency 18242.823 ms 2026-02-20T03:39:47.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2dd4bfc640 1 -- 10.20.193.28:0/2172566418 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd555aa6b0 con 0x55cd55721d90 2026-02-20T03:39:47.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2dd4bfc640 10 client.22149 handle_command_reply: tid=0 2026-02-20T03:39:47.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 client.22149 shutdown 2026-02-20T03:39:47.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 -- 10.20.193.28:0/2172566418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 msgr2=0x55cd556a80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:47.772 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556a80a0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00bfd0 tx=0x7f2dfc0ce420 comp rx=0 tx=0).stop 2026-02-20T03:39:47.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 -- 10.20.193.28:0/2172566418 shutdown_connections 2026-02-20T03:39:47.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55cd55721d90 0x55cd55724250 crc :-1 s=READY pgs=620 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55cd5568e560 0x55cd556a80a0 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55cd556897c0 0x55cd556a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 --2- 10.20.193.28:0/2172566418 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55cd55688e80 0x55cd556a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.773 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 -- 10.20.193.28:0/2172566418 >> 10.20.193.28:0/2172566418 conn(0x55cd556806f0 msgr2=0x55cd556a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:47.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2dd4bfc640 0 client.22149 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:47.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 -- 10.20.193.28:0/2172566418 shutdown_connections 2026-02-20T03:39:47.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 1 -- 10.20.193.28:0/2172566418 wait complete. 2026-02-20T03:39:47.774 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.769+0000 7f2e14012e00 20 client.22149 trim_cache size 0 max 16384 2026-02-20T03:39:47.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:39:47.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:39:47.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:39:47.785 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:39:47.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 -- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2de00b0e20 msgr2=0x7f2de00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:47.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2de00b0e20 0x7f2de00b32e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009950 tx=0x7f2e000023d0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 -- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c10c9c0 msgr2=0x7f2e0c1acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:47.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c10c9c0 0x7f2e0c1acb00 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00b990 tx=0x7f2dfc00be60 comp rx=0 tx=0).stop 2026-02-20T03:39:47.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 -- 10.20.193.28:0/963452184 shutdown_connections 2026-02-20T03:39:47.786 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2de00b0e20 0x7f2de00b32e0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2e0c10c9c0 0x7f2e0c1acb00 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2e0c0745e0 0x7f2e0c1a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 --2- 10.20.193.28:0/963452184 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2e0c073ca0 0x7f2e0c1a5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:47.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 -- 10.20.193.28:0/963452184 >> 10.20.193.28:0/963452184 conn(0x7f2e0c06f7e0 msgr2=0x7f2e0c111d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:47.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 -- 10.20.193.28:0/963452184 shutdown_connections 2026-02-20T03:39:47.787 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:39:47.770+0000 7f2e109a8640 1 -- 10.20.193.28:0/963452184 wait complete. 2026-02-20T03:39:47.892 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:47 trial028 ceph-mon[38552]: pgmap v939: 129 pgs: 129 active+clean; 791 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 534 KiB/s rd, 10 MiB/s wr, 456 op/s 2026-02-20T03:39:47.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:47 trial177 ceph-mon[43181]: pgmap v939: 129 pgs: 129 active+clean; 791 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 534 KiB/s rd, 10 MiB/s wr, 456 op/s 2026-02-20T03:39:48.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:47 trial126 ceph-mon[38476]: pgmap v939: 129 pgs: 129 active+clean; 791 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 534 KiB/s rd, 10 MiB/s wr, 456 op/s 2026-02-20T03:39:48.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.54 MB/sec execute 559 sec latency 19242.876 ms 2026-02-20T03:39:49.404 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:39:49.723 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:49.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.50 MB/sec execute 560 sec latency 20242.913 ms 2026-02-20T03:39:49.789 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:49 trial028 ceph-mon[38552]: pgmap v940: 129 pgs: 129 active+clean; 800 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 369 KiB/s rd, 11 MiB/s wr, 388 op/s 2026-02-20T03:39:49.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:49 trial177 ceph-mon[43181]: pgmap v940: 129 pgs: 129 active+clean; 800 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 369 KiB/s rd, 11 MiB/s wr, 388 op/s 2026-02-20T03:39:50.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.044+0000 7fafbb577640 1 -- 10.20.193.28:0/3009057328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109ba0 msgr2=0x7fafbc115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:50.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.044+0000 7fafbb577640 1 --2- 10.20.193.28:0/3009057328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109ba0 0x7fafbc115d10 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7fafac00b0a0 tx=0x7fafac02f450 comp rx=0 tx=0).stop 2026-02-20T03:39:50.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.044+0000 7fafbb577640 1 -- 10.20.193.28:0/3009057328 shutdown_connections 2026-02-20T03:39:50.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.044+0000 7fafbb577640 1 --2- 10.20.193.28:0/3009057328 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109ba0 0x7fafbc115d10 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.044+0000 7fafbb577640 1 --2- 10.20.193.28:0/3009057328 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafbc109220 0x7fafbc109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.044+0000 7fafbb577640 1 --2- 10.20.193.28:0/3009057328 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafbc10eef0 0x7fafbc10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.044+0000 7fafbb577640 1 -- 10.20.193.28:0/3009057328 >> 10.20.193.28:0/3009057328 conn(0x7fafbc078600 msgr2=0x7fafbc07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:50.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.044+0000 7fafbb577640 1 -- 10.20.193.28:0/3009057328 shutdown_connections 2026-02-20T03:39:50.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.044+0000 7fafbb577640 1 -- 10.20.193.28:0/3009057328 wait complete. 2026-02-20T03:39:50.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.045+0000 7fafbb577640 1 Processor -- start 2026-02-20T03:39:50.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.045+0000 7fafbb577640 1 -- start start 2026-02-20T03:39:50.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafbb577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109220 0x7fafbc1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafbb577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafbc109ba0 0x7fafbc1a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafbb577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafbc10eef0 0x7fafbc1a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafbb577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc1191b0 con 0x7fafbc109220 2026-02-20T03:39:50.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafbb577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc119030 con 0x7fafbc109ba0 2026-02-20T03:39:50.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafbb577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fafbc119330 con 0x7fafbc10eef0 2026-02-20T03:39:50.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafba575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109220 0x7fafbc1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafba575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109220 0x7fafbc1a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37484/0 (socket says 10.20.193.28:37484) 2026-02-20T03:39:50.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafba575640 1 -- 10.20.193.28:0/3826650940 learned_addr learned my addr 10.20.193.28:0/3826650940 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:50.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafba575640 1 -- 10.20.193.28:0/3826650940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafbc10eef0 msgr2=0x7fafbc1a5f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:50.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafba575640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafbc10eef0 0x7fafbc1a5f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafba575640 1 -- 10.20.193.28:0/3826650940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafbc109ba0 msgr2=0x7fafbc1a1b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafba575640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafbc109ba0 0x7fafbc1a1b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafba575640 1 -- 10.20.193.28:0/3826650940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafbc1a6680 con 0x7fafbc109220 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.046+0000 7fafba575640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109220 0x7fafbc1a1630 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b570 tx=0x7fafb000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafa37fe640 1 -- 10.20.193.28:0/3826650940 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0013020 con 0x7fafbc109220 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafa37fe640 1 -- 10.20.193.28:0/3826650940 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafb0004480 con 0x7fafbc109220 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafa37fe640 1 -- 10.20.193.28:0/3826650940 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb000fb50 con 0x7fafbc109220 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbb577640 1 -- 10.20.193.28:0/3826650940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafbc1a6970 con 0x7fafbc109220 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbb577640 1 -- 10.20.193.28:0/3826650940 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafbc1ae1b0 con 0x7fafbc109220 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafa37fe640 1 -- 10.20.193.28:0/3826650940 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fafb0002780 con 0x7fafbc109220 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 Processor -- start 2026-02-20T03:39:50.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 -- start start 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d7123e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70c630 0x56297d70ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70cfb0 0x56297d718e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56297d68ce50 con 0x56297d712000 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56297d65f9c0 con 0x56297d70c630 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56297d60d240 con 0x56297d70cfb0 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d7123e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d7123e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37488/0 (socket says 10.20.193.28:37488) 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbad76640 1 -- 10.20.193.28:0/3314485571 learned_addr learned my addr 10.20.193.28:0/3314485571 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbad76640 1 -- 10.20.193.28:0/3314485571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70cfb0 msgr2=0x56297d718e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbad76640 1 --2- 10.20.193.28:0/3314485571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70cfb0 0x56297d718e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbad76640 1 -- 10.20.193.28:0/3314485571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70c630 msgr2=0x56297d70ca70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbad76640 1 --2- 10.20.193.28:0/3314485571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70c630 0x56297d70ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbad76640 1 -- 10.20.193.28:0/3314485571 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56297d620420 con 0x56297d712000 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafbad76640 1 --2- 10.20.193.28:0/3314485571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d7123e0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fafac009850 tx=0x7fafac009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd3a6ea4398aeeb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafa37fe640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf940b0e20 0x7faf940b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafa37fe640 1 -- 10.20.193.28:0/3826650940 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fafb00e0480 con 0x7fafbc109220 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafa0ff9640 1 -- 10.20.193.28:0/3314485571 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac004d40 con 0x56297d712000 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafba575640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf940b0e20 0x7faf940b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafa0ff9640 1 -- 10.20.193.28:0/3314485571 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafac033030 con 0x56297d712000 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafa0ff9640 1 -- 10.20.193.28:0/3314485571 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac002cc0 con 0x56297d712000 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 -- 10.20.193.28:0/3314485571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 msgr2=0x56297d7123e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:50.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 --2- 10.20.193.28:0/3314485571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d7123e0 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7fafac009850 tx=0x7fafac009e00 comp rx=0 tx=0).stop 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafba575640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf940b0e20 0x7faf940b32e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fafb00a51e0 tx=0x7fafb00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 -- 10.20.193.28:0/3314485571 shutdown_connections 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 --2- 10.20.193.28:0/3314485571 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70cfb0 0x56297d718e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 --2- 10.20.193.28:0/3314485571 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70c630 0x56297d70ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 --2- 10.20.193.28:0/3314485571 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d7123e0 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 -- 10.20.193.28:0/3314485571 >> 10.20.193.28:0/3314485571 conn(0x56297d6cf290 msgr2=0x56297d70ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 -- 10.20.193.28:0/3314485571 shutdown_connections 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.047+0000 7fafc3284e00 1 -- 10.20.193.28:0/3314485571 wait complete. 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafc3284e00 1 -- start start 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafc3284e00 1 Processor -- start 2026-02-20T03:39:50.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70c630 0x56297d727090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70cfb0 0x56297d7275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d725590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafc3284e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56297d65b8f0 con 0x56297d712000 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafc3284e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56297d44df50 con 0x56297d70c630 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafc3284e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56297d725b20 con 0x56297d70cfb0 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafbad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d725590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafbad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d725590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37502/0 (socket says 10.20.193.28:37502) 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafbad76640 1 -- 10.20.193.28:0/446180905 learned_addr learned my addr 10.20.193.28:0/446180905 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafbad76640 1 -- 10.20.193.28:0/446180905 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70cfb0 msgr2=0x56297d7275d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafbad76640 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70cfb0 0x56297d7275d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafbad76640 1 -- 10.20.193.28:0/446180905 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70c630 msgr2=0x56297d727090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafbad76640 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70c630 0x56297d727090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.053+0000 7fafbad76640 1 -- 10.20.193.28:0/446180905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56297d71ebc0 con 0x56297d712000 2026-02-20T03:39:50.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7fafbad76640 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d725590 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fafac004710 tx=0x7fafac004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d138a4dc773a37 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:50.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7faf6bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:50.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7faf6bfff640 1 -- 10.20.193.28:0/446180905 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac004910 con 0x56297d712000 2026-02-20T03:39:50.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7faf6bfff640 1 -- 10.20.193.28:0/446180905 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafac004b40 con 0x56297d712000 2026-02-20T03:39:50.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7faf6bfff640 1 -- 10.20.193.28:0/446180905 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac041440 con 0x56297d712000 2026-02-20T03:39:50.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7fafc3284e00 1 -- 10.20.193.28:0/446180905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56297d430b40 con 0x56297d712000 2026-02-20T03:39:50.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7fafc3284e00 10 client.22161 _ll_register_callbacks cb 0x56297d698f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:50.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7fafc3284e00 1 -- 10.20.193.28:0/446180905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56297d66d1a0 con 0x56297d712000 2026-02-20T03:39:50.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7faf6bfff640 1 -- 10.20.193.28:0/446180905 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fafac004cf0 con 0x56297d712000 2026-02-20T03:39:50.070 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.054+0000 7faf6bfff640 1 -- 10.20.193.28:0/446180905 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fafac0090d0 con 0x56297d712000 2026-02-20T03:39:50.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.055+0000 7fafc3284e00 10 client.22161 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:50.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.055+0000 7fafc3284e00 1 -- 10.20.193.28:0/446180905 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x56297d61a230 con 0x56297d712000 2026-02-20T03:39:50.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.055+0000 7faf6bfff640 1 -- 10.20.193.28:0/446180905 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fafac03f020 con 0x56297d712000 2026-02-20T03:39:50.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.055+0000 7fafc3284e00 10 client.22161 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:50.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.055+0000 7fafc3284e00 10 client.22161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:50.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.055+0000 7fafc3284e00 20 client.22161 populate_metadata read hostname 'trial028' 2026-02-20T03:39:50.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.055+0000 7fafc3284e00 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56297d735380 0x56297d737810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.055+0000 7fafc3284e00 4 client.22161 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:50.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.055+0000 7fafc3284e00 1 -- 10.20.193.28:0/446180905 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56297d6675b0 con 0x56297d735380 2026-02-20T03:39:50.082 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.080+0000 7fafb9d74640 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56297d735380 0x56297d737810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:49 trial126 ceph-mon[38476]: pgmap v940: 129 pgs: 129 active+clean; 800 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 369 KiB/s rd, 11 MiB/s wr, 388 op/s 2026-02-20T03:39:50.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.146+0000 7fafb9d74640 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56297d735380 0x56297d737810 crc :-1 s=READY pgs=621 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2969e9ccab41e864 server_cookie=2faa79c683987b12 in_seq=0 out_seq=0 2026-02-20T03:39:50.149 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.146+0000 7faf6bfff640 10 client.22161 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7faf6bfff640 1 -- 10.20.193.28:0/446180905 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56297d6675b0 con 0x56297d735380 2026-02-20T03:39:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7faf6bfff640 10 client.22161 handle_command_reply: tid=0 2026-02-20T03:39:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 client.22161 shutdown 2026-02-20T03:39:50.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 -- 10.20.193.28:0/446180905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 msgr2=0x56297d725590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:50.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d725590 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fafac004710 tx=0x7fafac004800 comp rx=0 tx=0).stop 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 -- 10.20.193.28:0/446180905 shutdown_connections 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56297d735380 0x56297d737810 crc :-1 s=READY pgs=621 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d725590 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70cfb0 0x56297d7275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 --2- 10.20.193.28:0/446180905 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70c630 0x56297d727090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 -- 10.20.193.28:0/446180905 >> 10.20.193.28:0/446180905 conn(0x56297d6cf290 msgr2=0x56297d70b440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7faf6bfff640 0 client.22161 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 -- 10.20.193.28:0/446180905 shutdown_connections 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 1 -- 10.20.193.28:0/446180905 wait complete. 2026-02-20T03:39:50.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.173+0000 7fafc3284e00 20 client.22161 trim_cache size 0 max 16384 2026-02-20T03:39:50.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafc3284e00 1 Processor -- start 2026-02-20T03:39:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafc3284e00 1 -- start start 2026-02-20T03:39:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70c630 0x56297d73d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70cfb0 0x56297d73d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d722a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafc3284e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf60012780 con 0x56297d712000 2026-02-20T03:39:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafc3284e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faf6000ffc0 con 0x56297d70cfb0 2026-02-20T03:39:50.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafc3284e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf6000de10 con 0x56297d70c630 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafbad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d722a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafbad76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d722a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37504/0 (socket says 10.20.193.28:37504) 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.179+0000 7fafbad76640 1 -- 10.20.193.28:0/2613353251 learned_addr learned my addr 10.20.193.28:0/2613353251 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafbad76640 1 -- 10.20.193.28:0/2613353251 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70c630 msgr2=0x56297d73d120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafbad76640 1 --2- 10.20.193.28:0/2613353251 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70c630 0x56297d73d120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafbad76640 1 -- 10.20.193.28:0/2613353251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70cfb0 msgr2=0x56297d73d660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafbad76640 1 --2- 10.20.193.28:0/2613353251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70cfb0 0x56297d73d660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafbad76640 1 -- 10.20.193.28:0/2613353251 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56297d71e9f0 con 0x56297d712000 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafbad76640 1 --2- 10.20.193.28:0/2613353251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d722a60 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fafac0075c0 tx=0x7fafac031050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c482243ce62cc90b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7faf864e6640 1 -- 10.20.193.28:0/2613353251 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac0099e0 con 0x56297d712000 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7faf864e6640 1 -- 10.20.193.28:0/2613353251 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56297d66d1a0 con 0x56297d712000 2026-02-20T03:39:50.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7faf864e6640 1 -- 10.20.193.28:0/2613353251 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac004da0 con 0x56297d712000 2026-02-20T03:39:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 -- 10.20.193.28:0/2613353251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 msgr2=0x56297d722a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 --2- 10.20.193.28:0/2613353251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d722a60 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7fafac0075c0 tx=0x7fafac031050 comp rx=0 tx=0).stop 2026-02-20T03:39:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 -- 10.20.193.28:0/2613353251 shutdown_connections 2026-02-20T03:39:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 --2- 10.20.193.28:0/2613353251 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d712000 0x56297d722a60 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 --2- 10.20.193.28:0/2613353251 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d70cfb0 0x56297d73d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 --2- 10.20.193.28:0/2613353251 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70c630 0x56297d73d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 -- 10.20.193.28:0/2613353251 >> 10.20.193.28:0/2613353251 conn(0x56297d6cf290 msgr2=0x56297d723d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 -- 10.20.193.28:0/2613353251 shutdown_connections 2026-02-20T03:39:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 -- 10.20.193.28:0/2613353251 wait complete. 2026-02-20T03:39:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 -- start start 2026-02-20T03:39:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 Processor -- start 2026-02-20T03:39:50.192 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70c630 0x56297d732110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d70cfb0 0x56297d72e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d712000 0x56297d72eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7faf6000e480 con 0x56297d70cfb0 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7faf6000f8f0 con 0x56297d712000 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafc3284e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7faf6000eb50 con 0x56297d70c630 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafb9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d70cfb0 0x56297d72e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafb9d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d70cfb0 0x56297d72e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37512/0 (socket says 10.20.193.28:37512) 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafb9d74640 1 -- 10.20.193.28:0/1974898982 learned_addr learned my addr 10.20.193.28:0/1974898982 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafb9d74640 1 -- 10.20.193.28:0/1974898982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70c630 msgr2=0x56297d732110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafb9d74640 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70c630 0x56297d732110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafb9d74640 1 -- 10.20.193.28:0/1974898982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d712000 msgr2=0x56297d72eb20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:50.193 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafb9d74640 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d712000 0x56297d72eb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafb9d74640 1 -- 10.20.193.28:0/1974898982 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56297d33e870 con 0x56297d70cfb0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7fafb9d74640 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d70cfb0 0x56297d72e3e0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x56297d724d10 tx=0x7fafa40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ba0a6a831ee1b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7faf6bfff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.184+0000 7faf6bfff640 1 -- 10.20.193.28:0/1974898982 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa401e070 con 0x56297d70cfb0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7faf6bfff640 1 -- 10.20.193.28:0/1974898982 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fafa4002e20 con 0x56297d70cfb0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7faf6bfff640 1 -- 10.20.193.28:0/1974898982 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4015040 con 0x56297d70cfb0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 1 -- 10.20.193.28:0/1974898982 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56297d5ff440 con 0x56297d70cfb0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7faf6bfff640 1 -- 10.20.193.28:0/1974898982 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fafa4013340 con 0x56297d70cfb0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 10 client.22167 _ll_register_callbacks cb 0x7fafac009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 1 -- 10.20.193.28:0/1974898982 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56297d611b00 con 0x56297d70cfb0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7faf6bfff640 1 -- 10.20.193.28:0/1974898982 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fafa4019420 con 0x56297d70cfb0 2026-02-20T03:39:50.194 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 10 client.22167 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:50.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 1 -- 10.20.193.28:0/1974898982 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x56297d71f6e0 con 0x56297d70cfb0 2026-02-20T03:39:50.195 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7faf6bfff640 1 -- 10.20.193.28:0/1974898982 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fafa4009920 con 0x56297d70cfb0 2026-02-20T03:39:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 10 client.22167 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 10 client.22167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 20 client.22167 populate_metadata read hostname 'trial028' 2026-02-20T03:39:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56297d7a1730 0x56297d7a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 4 client.22167 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:39:50.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.187+0000 7fafc3284e00 1 -- 10.20.193.28:0/1974898982 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56297d66d1a0 con 0x56297d7a1730 2026-02-20T03:39:50.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.214+0000 7fafbad76640 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56297d7a1730 0x56297d7a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.267+0000 7fafbad76640 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56297d7a1730 0x56297d7a3bf0 crc :-1 s=READY pgs=622 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d13c328b494765f0 server_cookie=32f40588195ee8e0 in_seq=0 out_seq=0 2026-02-20T03:39:50.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.267+0000 7faf6bfff640 10 client.22167 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:50.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7faf6bfff640 1 -- 10.20.193.28:0/1974898982 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56297d66d1a0 con 0x56297d7a1730 2026-02-20T03:39:50.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7faf6bfff640 10 client.22167 handle_command_reply: tid=0 2026-02-20T03:39:50.283 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 client.22167 shutdown 2026-02-20T03:39:50.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 -- 10.20.193.28:0/1974898982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d70cfb0 msgr2=0x56297d72e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:50.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d70cfb0 0x56297d72e3e0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x56297d724d10 tx=0x7fafa40046b0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 -- 10.20.193.28:0/1974898982 shutdown_connections 2026-02-20T03:39:50.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56297d7a1730 0x56297d7a3bf0 crc :-1 s=READY pgs=622 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56297d712000 0x56297d72eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56297d70cfb0 0x56297d72e3e0 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 --2- 10.20.193.28:0/1974898982 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56297d70c630 0x56297d732110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 -- 10.20.193.28:0/1974898982 >> 10.20.193.28:0/1974898982 conn(0x56297d6cf290 msgr2=0x56297d735760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:50.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7faf6bfff640 0 client.22167 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:50.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 -- 10.20.193.28:0/1974898982 shutdown_connections 2026-02-20T03:39:50.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 1 -- 10.20.193.28:0/1974898982 wait complete. 2026-02-20T03:39:50.285 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafc3284e00 20 client.22167 trim_cache size 0 max 16384 2026-02-20T03:39:50.296 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:39:50.297 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:39:50.297 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:39:50.297 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 -- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf940b0e20 msgr2=0x7faf940b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf940b0e20 0x7faf940b32e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fafb00a51e0 tx=0x7fafb00046c0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 -- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109220 msgr2=0x7fafbc1a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109220 0x7fafbc1a1630 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b570 tx=0x7fafb000ba40 comp rx=0 tx=0).stop 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 -- 10.20.193.28:0/3826650940 shutdown_connections 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7faf940b0e20 0x7faf940b32e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fafbc10eef0 0x7fafbc1a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fafbc109ba0 0x7fafbc1a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 --2- 10.20.193.28:0/3826650940 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fafbc109220 0x7fafbc1a1630 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 -- 10.20.193.28:0/3826650940 >> 10.20.193.28:0/3826650940 conn(0x7fafbc078600 msgr2=0x7fafbc079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:50.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 -- 10.20.193.28:0/3826650940 shutdown_connections 2026-02-20T03:39:50.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.281+0000 7fafbb577640 1 -- 10.20.193.28:0/3826650940 wait complete. 2026-02-20T03:39:50.440 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:39:50.441 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:39:50.737 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:50.749 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.47 MB/sec execute 561 sec latency 21132.703 ms 2026-02-20T03:39:50.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.974+0000 7fe046f26640 1 -- 10.20.193.28:0/2236636636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0401134d0 msgr2=0x7fe040115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:50.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.974+0000 7fe046f26640 1 --2- 10.20.193.28:0/2236636636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0401134d0 0x7fe040115900 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00b0a0 tx=0x7fe03c02f4e0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.974+0000 7fe046f26640 1 -- 10.20.193.28:0/2236636636 shutdown_connections 2026-02-20T03:39:50.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.974+0000 7fe046f26640 1 --2- 10.20.193.28:0/2236636636 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe0401134d0 0x7fe040115900 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.974+0000 7fe046f26640 1 --2- 10.20.193.28:0/2236636636 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe040075950 0x7fe040075d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.974+0000 7fe046f26640 1 --2- 10.20.193.28:0/2236636636 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0401065d0 0x7fe040075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.974+0000 7fe046f26640 1 -- 10.20.193.28:0/2236636636 >> 10.20.193.28:0/2236636636 conn(0x7fe0400fe440 msgr2=0x7fe040100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.974+0000 7fe046f26640 1 -- 10.20.193.28:0/2236636636 shutdown_connections 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.974+0000 7fe046f26640 1 -- 10.20.193.28:0/2236636636 wait complete. 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe046f26640 1 Processor -- start 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe046f26640 1 -- start start 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe046f26640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe040075950 0x7fe0401a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe046f26640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0401065d0 0x7fe0401a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe046f26640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0401134d0 0x7fe0401a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe046f26640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe040119180 con 0x7fe040075950 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe046f26640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe040119000 con 0x7fe0401065d0 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe046f26640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe040119300 con 0x7fe0401134d0 2026-02-20T03:39:50.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe045f24640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe040075950 0x7fe0401a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe045f24640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe040075950 0x7fe0401a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37538/0 (socket says 10.20.193.28:37538) 2026-02-20T03:39:50.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe045f24640 1 -- 10.20.193.28:0/3149895967 learned_addr learned my addr 10.20.193.28:0/3149895967 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:50.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe045f24640 1 -- 10.20.193.28:0/3149895967 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0401134d0 msgr2=0x7fe0401a5ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:50.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe045f24640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0401134d0 0x7fe0401a5ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe045f24640 1 -- 10.20.193.28:0/3149895967 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0401065d0 msgr2=0x7fe0401a1b60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:50.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe045f24640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0401065d0 0x7fe0401a1b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:50.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe045f24640 1 -- 10.20.193.28:0/3149895967 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0401a6670 con 0x7fe040075950 2026-02-20T03:39:50.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe045f24640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe040075950 0x7fe0401a1620 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7fe03000b570 tx=0x7fe03000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:50.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe02effd640 1 -- 10.20.193.28:0/3149895967 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030013020 con 0x7fe040075950 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.980+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0401a6960 con 0x7fe040075950 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.981+0000 7fe02effd640 1 -- 10.20.193.28:0/3149895967 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe030004480 con 0x7fe040075950 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.981+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0401ae1a0 con 0x7fe040075950 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.982+0000 7fe02effd640 1 -- 10.20.193.28:0/3149895967 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030002980 con 0x7fe040075950 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.982+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe040075e10 con 0x7fe040075950 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.983+0000 7fe02effd640 1 -- 10.20.193.28:0/3149895967 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe03000f820 con 0x7fe040075950 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.983+0000 7fe02effd640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe01c0b0da0 0x7fe01c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.986+0000 7fe02effd640 1 -- 10.20.193.28:0/3149895967 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe0300e0a10 con 0x7fe040075950 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.986+0000 7fe02effd640 1 -- 10.20.193.28:0/3149895967 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe03001d020 con 0x7fe040075950 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.986+0000 7fe045723640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe01c0b0da0 0x7fe01c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:50.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:50.986+0000 7fe045723640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe01c0b0da0 0x7fe01c0b3260 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe040113340 tx=0x7fe034006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:51.098 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.096+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0401ae4c0 con 0x7fe040075950 2026-02-20T03:39:51.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.096+0000 7fe02effd640 1 -- 10.20.193.28:0/3149895967 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+11925 (secure 0 0 0) 0x7fe030020350 con 0x7fe040075950 2026-02-20T03:39:51.099 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:39:51.109 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 59 2026-02-20T03:39:51.110 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":59,"btime":"2026-02-20T03:39:43:533677+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":59,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:39:43.492349+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:39:51.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe01c0b0da0 msgr2=0x7fe01c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:51.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe01c0b0da0 0x7fe01c0b3260 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe040113340 tx=0x7fe034006cd0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe040075950 msgr2=0x7fe0401a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:51.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe040075950 0x7fe0401a1620 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7fe03000b570 tx=0x7fe03000ba40 comp rx=0 tx=0).stop 2026-02-20T03:39:51.111 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 shutdown_connections 2026-02-20T03:39:51.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe01c0b0da0 0x7fe01c0b3260 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe0401134d0 0x7fe0401a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe0401065d0 0x7fe0401a1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 --2- 10.20.193.28:0/3149895967 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe040075950 0x7fe0401a1620 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 >> 10.20.193.28:0/3149895967 conn(0x7fe0400fe440 msgr2=0x7fe040114cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:51.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 shutdown_connections 2026-02-20T03:39:51.112 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.098+0000 7fe046f26640 1 -- 10.20.193.28:0/3149895967 wait complete. 2026-02-20T03:39:51.239 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:39:51.538 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:51.710 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:51 trial028 ceph-mon[38552]: pgmap v941: 129 pgs: 129 active+clean; 813 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 325 KiB/s rd, 11 MiB/s wr, 375 op/s 2026-02-20T03:39:51.710 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:51 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3149895967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:39:51.738 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.43 MB/sec execute 562 sec latency 22000.208 ms 2026-02-20T03:39:51.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.806+0000 7f2baa643640 1 -- 10.20.193.28:0/461542286 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109ba0 msgr2=0x7f2ba4115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:51.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.806+0000 7f2baa643640 1 --2- 10.20.193.28:0/461542286 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109ba0 0x7f2ba4115d10 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b0a0 tx=0x7f2ba002f450 comp rx=0 tx=0).stop 2026-02-20T03:39:51.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.806+0000 7f2baa643640 1 -- 10.20.193.28:0/461542286 shutdown_connections 2026-02-20T03:39:51.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.806+0000 7f2baa643640 1 --2- 10.20.193.28:0/461542286 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109ba0 0x7f2ba4115d10 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.806+0000 7f2baa643640 1 --2- 10.20.193.28:0/461542286 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ba4109220 0x7f2ba4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.806+0000 7f2baa643640 1 --2- 10.20.193.28:0/461542286 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ba410eef0 0x7f2ba410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.806+0000 7f2baa643640 1 -- 10.20.193.28:0/461542286 >> 10.20.193.28:0/461542286 conn(0x7f2ba4078600 msgr2=0x7f2ba407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:51.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.806+0000 7f2baa643640 1 -- 10.20.193.28:0/461542286 shutdown_connections 2026-02-20T03:39:51.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.806+0000 7f2baa643640 1 -- 10.20.193.28:0/461542286 wait complete. 2026-02-20T03:39:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2baa643640 1 Processor -- start 2026-02-20T03:39:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2baa643640 1 -- start start 2026-02-20T03:39:51.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2baa643640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109220 0x7f2ba41a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2baa643640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ba4109ba0 0x7f2ba41a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2baa643640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ba410eef0 0x7f2ba41a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2baa643640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba41191b0 con 0x7f2ba4109220 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2baa643640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba4119030 con 0x7f2ba410eef0 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2baa643640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba4119330 con 0x7f2ba4109ba0 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2ba9641640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109220 0x7f2ba41a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2ba9641640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109220 0x7f2ba41a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37550/0 (socket says 10.20.193.28:37550) 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2ba9641640 1 -- 10.20.193.28:0/2975515429 learned_addr learned my addr 10.20.193.28:0/2975515429 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2ba9641640 1 -- 10.20.193.28:0/2975515429 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ba4109ba0 msgr2=0x7f2ba41a1b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2ba9641640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ba4109ba0 0x7f2ba41a1b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2ba9641640 1 -- 10.20.193.28:0/2975515429 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ba410eef0 msgr2=0x7f2ba41a5ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:51.812 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2ba9641640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ba410eef0 0x7f2ba41a5ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.807+0000 7f2ba9641640 1 -- 10.20.193.28:0/2975515429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba41a6660 con 0x7f2ba4109220 2026-02-20T03:39:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109220 0x7f2ba41a1610 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400b570 tx=0x7f2b9400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2b927fc640 1 -- 10.20.193.28:0/2975515429 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94013020 con 0x7f2ba4109220 2026-02-20T03:39:51.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2b927fc640 1 -- 10.20.193.28:0/2975515429 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2b94004480 con 0x7f2ba4109220 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2b927fc640 1 -- 10.20.193.28:0/2975515429 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400fb50 con 0x7f2ba4109220 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baa643640 1 -- 10.20.193.28:0/2975515429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba41a6950 con 0x7f2ba4109220 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baa643640 1 -- 10.20.193.28:0/2975515429 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba41ae190 con 0x7f2ba4109220 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2b927fc640 1 -- 10.20.193.28:0/2975515429 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2b94002780 con 0x7f2ba4109220 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 Processor -- start 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 -- start start 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c3113c0 0x55950c3117a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c30b9f0 0x55950c30be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 0x55950c3181f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55950c27ae00 con 0x55950c30b9f0 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55950c24d970 con 0x55950c30c370 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55950c1fb1f0 con 0x55950c3113c0 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c30b9f0 0x55950c30be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c30b9f0 0x55950c30be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37566/0 (socket says 10.20.193.28:37566) 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 -- 10.20.193.28:0/1068093720 learned_addr learned my addr 10.20.193.28:0/1068093720 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 -- 10.20.193.28:0/1068093720 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c3113c0 msgr2=0x55950c3117a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 --2- 10.20.193.28:0/1068093720 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c3113c0 0x55950c3117a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 -- 10.20.193.28:0/1068093720 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 msgr2=0x55950c3181f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 --2- 10.20.193.28:0/1068093720 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 0x55950c3181f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 -- 10.20.193.28:0/1068093720 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950c20e3d0 con 0x55950c30b9f0 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2ba9641640 1 --2- 10.20.193.28:0/1068093720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c30b9f0 0x55950c30be30 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f2b940e67a0 tx=0x7f2b940e6c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bf419a05de3355 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:51.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2b71ce5640 1 -- 10.20.193.28:0/1068093720 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b940f3070 con 0x55950c30b9f0 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2b71ce5640 1 -- 10.20.193.28:0/1068093720 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2b940e0de0 con 0x55950c30b9f0 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2b71ce5640 1 -- 10.20.193.28:0/1068093720 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b940e25f0 con 0x55950c30b9f0 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2b927fc640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1068093720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c30b9f0 msgr2=0x55950c30be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/1068093720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c30b9f0 0x55950c30be30 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f2b940e67a0 tx=0x7f2b940e6c70 comp rx=0 tx=0).stop 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.808+0000 7f2b927fc640 1 -- 10.20.193.28:0/2975515429 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2b940e05e0 con 0x7f2ba4109220 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1068093720 shutdown_connections 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/1068093720 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 0x55950c3181f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/1068093720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c30b9f0 0x55950c30be30 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/1068093720 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c3113c0 0x55950c3117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1068093720 >> 10.20.193.28:0/1068093720 conn(0x55950c2bd240 msgr2=0x55950c2f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1068093720 shutdown_connections 2026-02-20T03:39:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1068093720 wait complete. 2026-02-20T03:39:51.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b0a0 tx=0x7f2ba0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- start start 2026-02-20T03:39:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 Processor -- start 2026-02-20T03:39:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30b9f0 0x55950c326060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30c370 0x55950c3265a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c3247a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55950c2498a0 con 0x55950c3113c0 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55950c03bf50 con 0x55950c30b9f0 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55950c324f20 con 0x55950c30c370 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c3247a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c3247a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37572/0 (socket says 10.20.193.28:37572) 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 -- 10.20.193.28:0/216921144 learned_addr learned my addr 10.20.193.28:0/216921144 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 -- 10.20.193.28:0/216921144 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30c370 msgr2=0x55950c3265a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30c370 0x55950c3265a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 -- 10.20.193.28:0/216921144 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30b9f0 msgr2=0x55950c326060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30b9f0 0x55950c326060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 -- 10.20.193.28:0/216921144 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950c31dee0 con 0x55950c3113c0 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c3247a0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00077f0 tx=0x7f2ba00099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852cd4b2efcf68e4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:51.825 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2b5effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2b5effd640 1 -- 10.20.193.28:0/216921144 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00078c0 con 0x55950c3113c0 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2b5effd640 1 -- 10.20.193.28:0/216921144 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2ba0047030 con 0x55950c3113c0 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2b5effd640 1 -- 10.20.193.28:0/216921144 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0042c60 con 0x55950c3113c0 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- 10.20.193.28:0/216921144 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950c01eb40 con 0x55950c3113c0 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2b5effd640 1 -- 10.20.193.28:0/216921144 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2ba0038420 con 0x55950c3113c0 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 10 client.22185 _ll_register_callbacks cb 0x55950c286eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- 10.20.193.28:0/216921144 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55950c25b150 con 0x55950c3113c0 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2b5effd640 1 -- 10.20.193.28:0/216921144 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f2ba0051060 con 0x55950c3113c0 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 10 client.22185 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:51.826 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- 10.20.193.28:0/216921144 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x55950c2081e0 con 0x55950c3113c0 2026-02-20T03:39:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2b5effd640 1 -- 10.20.193.28:0/216921144 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f2ba003f030 con 0x55950c3113c0 2026-02-20T03:39:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 10 client.22185 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 10 client.22185 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:39:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 20 client.22185 populate_metadata read hostname 'trial028' 2026-02-20T03:39:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55950c334910 0x55950c336da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 4 client.22185 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:51.827 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.814+0000 7f2baddd1e00 1 -- 10.20.193.28:0/216921144 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55950c255560 con 0x55950c334910 2026-02-20T03:39:51.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.841+0000 7f2ba9641640 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55950c334910 0x55950c336da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:51.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.908+0000 7f2ba9641640 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55950c334910 0x55950c336da0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=26a4eb1e8ffd3d41 server_cookie=d618351d4630df20 in_seq=0 out_seq=0 2026-02-20T03:39:51.910 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.908+0000 7f2b5effd640 10 client.22185 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:39:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2b5effd640 1 -- 10.20.193.28:0/216921144 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55950c255560 con 0x55950c334910 2026-02-20T03:39:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2b5effd640 10 client.22185 handle_command_reply: tid=0 2026-02-20T03:39:51.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2baddd1e00 1 client.22185 shutdown 2026-02-20T03:39:51.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2baddd1e00 1 -- 10.20.193.28:0/216921144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 msgr2=0x55950c3247a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:51.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c3247a0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00077f0 tx=0x7f2ba00099e0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2baddd1e00 1 -- 10.20.193.28:0/216921144 shutdown_connections 2026-02-20T03:39:51.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55950c334910 0x55950c336da0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c3247a0 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30c370 0x55950c3265a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2b5effd640 0 client.22185 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:39:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/216921144 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30b9f0 0x55950c326060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.934+0000 7f2baddd1e00 1 -- 10.20.193.28:0/216921144 >> 10.20.193.28:0/216921144 conn(0x55950c2bd240 msgr2=0x55950c2f93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.935+0000 7f2baddd1e00 1 -- 10.20.193.28:0/216921144 shutdown_connections 2026-02-20T03:39:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.935+0000 7f2baddd1e00 1 -- 10.20.193.28:0/216921144 wait complete. 2026-02-20T03:39:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.935+0000 7f2baddd1e00 20 client.22185 trim_cache size 0 max 16384 2026-02-20T03:39:51.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 Processor -- start 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- start start 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30b9f0 0x55950c310180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 0x55950c3236f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c321d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b50012780 con 0x55950c3113c0 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5000ffc0 con 0x55950c30c370 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5000de10 con 0x55950c30b9f0 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c321d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c321d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37588/0 (socket says 10.20.193.28:37588) 2026-02-20T03:39:51.947 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 -- 10.20.193.28:0/1221822359 learned_addr learned my addr 10.20.193.28:0/1221822359 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 -- 10.20.193.28:0/1221822359 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30b9f0 msgr2=0x55950c310180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/1221822359 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30b9f0 0x55950c310180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 -- 10.20.193.28:0/1221822359 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 msgr2=0x55950c3236f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/1221822359 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 0x55950c3236f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 -- 10.20.193.28:0/1221822359 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950c31dd10 con 0x55950c3113c0 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/1221822359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c321d00 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b070 tx=0x7f2ba0045030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879987d242e40f56 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2b714e4640 1 -- 10.20.193.28:0/1221822359 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0061070 con 0x55950c3113c0 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2b714e4640 1 -- 10.20.193.28:0/1221822359 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2ba0047070 con 0x55950c3113c0 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2b714e4640 1 -- 10.20.193.28:0/1221822359 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba004cd10 con 0x55950c3113c0 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1221822359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 msgr2=0x55950c321d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/1221822359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c321d00 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b070 tx=0x7f2ba0045030 comp rx=0 tx=0).stop 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1221822359 shutdown_connections 2026-02-20T03:39:51.948 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/1221822359 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c321d00 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/1221822359 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 0x55950c3236f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.949 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/1221822359 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30b9f0 0x55950c310180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1221822359 >> 10.20.193.28:0/1221822359 conn(0x55950c2bd240 msgr2=0x55950c322fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1221822359 shutdown_connections 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- 10.20.193.28:0/1221822359 wait complete. 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- start start 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 Processor -- start 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30b9f0 0x55950c32c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 0x55950c328ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c329600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5000e480 con 0x55950c3113c0 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5000f8f0 con 0x55950c30c370 2026-02-20T03:39:51.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5000eb50 con 0x55950c30b9f0 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c329600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c329600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37594/0 (socket says 10.20.193.28:37594) 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 -- 10.20.193.28:0/4087113911 learned_addr learned my addr 10.20.193.28:0/4087113911 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 -- 10.20.193.28:0/4087113911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30b9f0 msgr2=0x55950c32c8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30b9f0 0x55950c32c8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 -- 10.20.193.28:0/4087113911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 msgr2=0x55950c328ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 0x55950c328ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 -- 10.20.193.28:0/4087113911 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950bf2c870 con 0x55950c3113c0 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2ba9e42640 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c329600 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f2ba003d040 tx=0x7f2ba004c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944fc675b1a023c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2b5effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2b5effd640 1 -- 10.20.193.28:0/4087113911 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0061070 con 0x55950c3113c0 2026-02-20T03:39:51.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- 10.20.193.28:0/4087113911 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950c1ed3f0 con 0x55950c3113c0 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2b5effd640 1 -- 10.20.193.28:0/4087113911 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2ba0063070 con 0x55950c3113c0 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2b5effd640 1 -- 10.20.193.28:0/4087113911 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba005c860 con 0x55950c3113c0 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 10 client.22191 _ll_register_callbacks cb 0x7f2ba0009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- 10.20.193.28:0/4087113911 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55950c310860 con 0x55950c3113c0 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2b5effd640 1 -- 10.20.193.28:0/4087113911 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2ba005ca00 con 0x55950c3113c0 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2b5effd640 1 -- 10.20.193.28:0/4087113911 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f2ba005cca0 con 0x55950c3113c0 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 10 client.22191 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.941+0000 7f2baddd1e00 1 -- 10.20.193.28:0/4087113911 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x55950c31ea00 con 0x55950c3113c0 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.946+0000 7f2b5effd640 1 -- 10.20.193.28:0/4087113911 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f2ba006f030 con 0x55950c3113c0 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.946+0000 7f2baddd1e00 10 client.22191 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.946+0000 7f2baddd1e00 10 client.22191 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.946+0000 7f2baddd1e00 20 client.22191 populate_metadata read hostname 'trial028' 2026-02-20T03:39:51.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.946+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55950c3a0890 0x55950c3a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:51.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.946+0000 7f2baddd1e00 4 client.22191 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:39:51.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.946+0000 7f2baddd1e00 1 -- 10.20.193.28:0/4087113911 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55950c1ffab0 con 0x55950c3a0890 2026-02-20T03:39:51.963 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:51.961+0000 7f2ba9641640 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55950c3a0890 0x55950c3a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:51.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:51 trial177 ceph-mon[43181]: pgmap v941: 129 pgs: 129 active+clean; 813 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 325 KiB/s rd, 11 MiB/s wr, 375 op/s 2026-02-20T03:39:51.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:51 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3149895967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:39:52.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.015+0000 7f2ba9641640 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55950c3a0890 0x55950c3a2d50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=107c1c01c6357124 server_cookie=df12973efeca77c in_seq=0 out_seq=0 2026-02-20T03:39:52.017 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.015+0000 7f2b5effd640 10 client.22191 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:39:52.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2b5effd640 1 -- 10.20.193.28:0/4087113911 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55950c1ffab0 con 0x55950c3a0890 2026-02-20T03:39:52.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2b5effd640 10 client.22191 handle_command_reply: tid=0 2026-02-20T03:39:52.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 client.22191 shutdown 2026-02-20T03:39:52.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 -- 10.20.193.28:0/4087113911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 msgr2=0x55950c329600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c329600 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f2ba003d040 tx=0x7f2ba004c620 comp rx=0 tx=0).stop 2026-02-20T03:39:52.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 -- 10.20.193.28:0/4087113911 shutdown_connections 2026-02-20T03:39:52.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x55950c3a0890 0x55950c3a2d50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55950c3113c0 0x55950c329600 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55950c30c370 0x55950c328ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 --2- 10.20.193.28:0/4087113911 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55950c30b9f0 0x55950c32c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 -- 10.20.193.28:0/4087113911 >> 10.20.193.28:0/4087113911 conn(0x55950c2bd240 msgr2=0x55950c323800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:52.032 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2b5effd640 0 client.22191 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:39:52.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 -- 10.20.193.28:0/4087113911 shutdown_connections 2026-02-20T03:39:52.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 1 -- 10.20.193.28:0/4087113911 wait complete. 2026-02-20T03:39:52.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baddd1e00 20 client.22191 trim_cache size 0 max 16384 2026-02-20T03:39:52.044 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:39:52.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 -- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 msgr2=0x7f2b800b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b0a0 tx=0x7f2ba0005b50 comp rx=0 tx=0).stop 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 -- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109220 msgr2=0x7f2ba41a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109220 0x7f2ba41a1610 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f2b9400b570 tx=0x7f2b9400ba40 comp rx=0 tx=0).stop 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 -- 10.20.193.28:0/2975515429 shutdown_connections 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2ba410eef0 0x7f2ba41a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2ba4109ba0 0x7f2ba41a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 --2- 10.20.193.28:0/2975515429 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2ba4109220 0x7f2ba41a1610 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 -- 10.20.193.28:0/2975515429 >> 10.20.193.28:0/2975515429 conn(0x7f2ba4078600 msgr2=0x7f2ba4079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 -- 10.20.193.28:0/2975515429 shutdown_connections 2026-02-20T03:39:52.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.028+0000 7f2baa643640 1 -- 10.20.193.28:0/2975515429 wait complete. 2026-02-20T03:39:52.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:51 trial126 ceph-mon[38476]: pgmap v941: 129 pgs: 129 active+clean; 813 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 325 KiB/s rd, 11 MiB/s wr, 375 op/s 2026-02-20T03:39:52.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:51 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3149895967' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:39:52.265 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:39:52.602 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:52.739 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.39 MB/sec execute 563 sec latency 23000.950 ms 2026-02-20T03:39:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.854+0000 7fbd2af5d640 1 -- 10.20.193.28:0/2189504054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077f40 msgr2=0x7fbd241132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.854+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/2189504054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077f40 0x7fbd241132e0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009a30 tx=0x7fbd1802f240 comp rx=0 tx=0).stop 2026-02-20T03:39:52.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.854+0000 7fbd2af5d640 1 -- 10.20.193.28:0/2189504054 shutdown_connections 2026-02-20T03:39:52.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.854+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/2189504054 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbd24113820 0x7fbd24115c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.854+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/2189504054 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077f40 0x7fbd241132e0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.854+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/2189504054 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24077620 0x7fbd24077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.854+0000 7fbd2af5d640 1 -- 10.20.193.28:0/2189504054 >> 10.20.193.28:0/2189504054 conn(0x7fbd24100680 msgr2=0x7fbd24102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:52.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.855+0000 7fbd2af5d640 1 -- 10.20.193.28:0/2189504054 shutdown_connections 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.855+0000 7fbd2af5d640 1 -- 10.20.193.28:0/2189504054 wait complete. 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.855+0000 7fbd2af5d640 1 Processor -- start 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.855+0000 7fbd2af5d640 1 -- start start 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.860+0000 7fbd2af5d640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077620 0x7fbd241a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.860+0000 7fbd2af5d640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbd24077f40 0x7fbd241a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.860+0000 7fbd2af5d640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24113820 0x7fbd241a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.860+0000 7fbd2af5d640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbd24119180 con 0x7fbd24077620 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.860+0000 7fbd2af5d640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbd24119000 con 0x7fbd24113820 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.860+0000 7fbd2af5d640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbd24119300 con 0x7fbd24077f40 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd29f5b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077620 0x7fbd241a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.875 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd29f5b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077620 0x7fbd241a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37624/0 (socket says 10.20.193.28:37624) 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd29f5b640 1 -- 10.20.193.28:0/4038910315 learned_addr learned my addr 10.20.193.28:0/4038910315 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd29f5b640 1 -- 10.20.193.28:0/4038910315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbd24077f40 msgr2=0x7fbd241a1c20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbd24077f40 0x7fbd241a1c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd29f5b640 1 -- 10.20.193.28:0/4038910315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24113820 msgr2=0x7fbd241a5fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24113820 0x7fbd241a5fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd29f5b640 1 -- 10.20.193.28:0/4038910315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd241a6730 con 0x7fbd24077620 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077620 0x7fbd241a16e0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400b780 tx=0x7fbd1400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd12ffd640 1 -- 10.20.193.28:0/4038910315 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14004480 con 0x7fbd24077620 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd12ffd640 1 -- 10.20.193.28:0/4038910315 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbd14010070 con 0x7fbd24077620 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd12ffd640 1 -- 10.20.193.28:0/4038910315 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400cae0 con 0x7fbd24077620 2026-02-20T03:39:52.876 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd2af5d640 1 -- 10.20.193.28:0/4038910315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd241a6a20 con 0x7fbd24077620 2026-02-20T03:39:52.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.862+0000 7fbd2af5d640 1 -- 10.20.193.28:0/4038910315 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd241ae260 con 0x7fbd24077620 2026-02-20T03:39:52.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.871+0000 7fbd12ffd640 1 -- 10.20.193.28:0/4038910315 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbd1401d070 con 0x7fbd24077620 2026-02-20T03:39:52.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.875+0000 7fbd12ffd640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbd000b0f70 0x7fbd000b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.875+0000 7fbd12ffd640 1 -- 10.20.193.28:0/4038910315 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbd140dfd60 con 0x7fbd24077620 2026-02-20T03:39:52.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.876+0000 7fbd2e6ebe00 1 Processor -- start 2026-02-20T03:39:52.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.877+0000 7fbd2975a640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbd000b0f70 0x7fbd000b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.877+0000 7fbd2e6ebe00 1 -- start start 2026-02-20T03:39:52.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.877+0000 7fbd2975a640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbd000b0f70 0x7fbd000b3430 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009950 tx=0x7fbd180023d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:52.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.877+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 0x56520948f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.877+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 0x565209489a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.877+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x565209495de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.877+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x565209409e00 con 0x5652094895e0 2026-02-20T03:39:52.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.877+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5652093dc970 con 0x565209489f60 2026-02-20T03:39:52.895 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.877+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56520938a1f0 con 0x56520948efb0 2026-02-20T03:39:52.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.893+0000 7fbd2a75c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x565209495de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.896 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.893+0000 7fbd2a75c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x565209495de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:58384/0 (socket says 10.20.193.28:58384) 2026-02-20T03:39:52.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.893+0000 7fbd29f5b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 0x56520948f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.893+0000 7fbd29f5b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 0x56520948f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36434/0 (socket says 10.20.193.28:36434) 2026-02-20T03:39:52.897 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.893+0000 7fbd29f5b640 1 -- 10.20.193.28:0/3511566760 learned_addr learned my addr 10.20.193.28:0/3511566760 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:52.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.895+0000 7fbd29f5b640 1 -- 10.20.193.28:0/3511566760 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 msgr2=0x565209495de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:52.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.895+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/3511566760 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x565209495de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.895+0000 7fbd29f5b640 1 -- 10.20.193.28:0/3511566760 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 msgr2=0x565209489a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:52.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.895+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/3511566760 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 0x565209489a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.895+0000 7fbd29f5b640 1 -- 10.20.193.28:0/3511566760 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520939d3d0 con 0x56520948efb0 2026-02-20T03:39:52.911 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.895+0000 7fbd2a75c640 1 --2- 10.20.193.28:0/3511566760 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x565209495de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:39:52.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.912+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/3511566760 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 0x56520948f390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009e20 tx=0x7fbd1400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ced457ec72779a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:52.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.913+0000 7fbcf24e6640 1 -- 10.20.193.28:0/3511566760 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd140b0ca0 con 0x56520948efb0 2026-02-20T03:39:52.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.914+0000 7fbcf24e6640 1 -- 10.20.193.28:0/3511566760 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbd140dd4e0 con 0x56520948efb0 2026-02-20T03:39:52.917 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.914+0000 7fbcf24e6640 1 -- 10.20.193.28:0/3511566760 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd140ae0b0 con 0x56520948efb0 2026-02-20T03:39:52.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.915+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3511566760 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 msgr2=0x56520948f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.915+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3511566760 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 0x56520948f390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009e20 tx=0x7fbd1400bf10 comp rx=0 tx=0).stop 2026-02-20T03:39:52.918 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.915+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3511566760 shutdown_connections 2026-02-20T03:39:52.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.915+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3511566760 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x565209495de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.915+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3511566760 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 0x565209489a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.915+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3511566760 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 0x56520948f390 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.915+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3511566760 >> 10.20.193.28:0/3511566760 conn(0x56520944c240 msgr2=0x565209487ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:52.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.916+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3511566760 shutdown_connections 2026-02-20T03:39:52.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.916+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3511566760 wait complete. 2026-02-20T03:39:52.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.917+0000 7fbd2e6ebe00 1 -- start start 2026-02-20T03:39:52.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.917+0000 7fbd2e6ebe00 1 Processor -- start 2026-02-20T03:39:52.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.918+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 0x5652094a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.918+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x5652094a4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.918+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 0x5652094a2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.918+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5652093d88a0 con 0x5652094895e0 2026-02-20T03:39:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.918+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5652091caf50 con 0x565209489f60 2026-02-20T03:39:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.918+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5652094a29c0 con 0x56520948efb0 2026-02-20T03:39:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.919+0000 7fbd29f5b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 0x5652094a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.919+0000 7fbd29f5b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 0x5652094a3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37634/0 (socket says 10.20.193.28:37634) 2026-02-20T03:39:52.922 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.919+0000 7fbd29f5b640 1 -- 10.20.193.28:0/3790499957 learned_addr learned my addr 10.20.193.28:0/3790499957 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:52.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.920+0000 7fbd29f5b640 1 -- 10.20.193.28:0/3790499957 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 msgr2=0x5652094a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:52.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.920+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 0x5652094a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.920+0000 7fbd29f5b640 1 -- 10.20.193.28:0/3790499957 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 msgr2=0x5652094a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:52.923 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.920+0000 7fbd2975a640 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x5652094a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.920+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x5652094a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.920+0000 7fbd29f5b640 1 -- 10.20.193.28:0/3790499957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520949bb40 con 0x5652094895e0 2026-02-20T03:39:52.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.924+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 0x5652094a3cf0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fbd140a3870 tx=0x7fbd140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ed07ed75949669 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:52.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.924+0000 7fbcdf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/3790499957 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd140ce030 con 0x5652094895e0 2026-02-20T03:39:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3790499957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652091adb40 con 0x5652094895e0 2026-02-20T03:39:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbd2e6ebe00 10 client.22200 _ll_register_callbacks cb 0x565209415eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3790499957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5652093ea150 con 0x5652094895e0 2026-02-20T03:39:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/3790499957 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbd140ae0f0 con 0x5652094895e0 2026-02-20T03:39:52.928 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/3790499957 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd14002940 con 0x5652094895e0 2026-02-20T03:39:52.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/3790499957 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbd140a3160 con 0x5652094895e0 2026-02-20T03:39:52.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/3790499957 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fbd140a3420 con 0x5652094895e0 2026-02-20T03:39:52.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbd2e6ebe00 10 client.22200 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:52.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.925+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3790499957 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5652093971e0 con 0x5652094895e0 2026-02-20T03:39:52.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.926+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/3790499957 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fbd140a6a50 con 0x5652094895e0 2026-02-20T03:39:52.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.926+0000 7fbd2e6ebe00 10 client.22200 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:52.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.926+0000 7fbd2e6ebe00 10 client.22200 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:39:52.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.926+0000 7fbd2e6ebe00 20 client.22200 populate_metadata read hostname 'trial028' 2026-02-20T03:39:52.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.926+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5652094b20c0 0x5652094b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.926+0000 7fbd2e6ebe00 4 client.22200 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:52.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.926+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3790499957 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652093e4560 con 0x5652094b20c0 2026-02-20T03:39:52.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.939+0000 7fbd2975a640 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5652094b20c0 0x5652094b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.940+0000 7fbd2975a640 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5652094b20c0 0x5652094b44b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c1f66c52aaacdecb server_cookie=4bfd8de8b6ea5340 in_seq=0 out_seq=0 2026-02-20T03:39:52.943 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.940+0000 7fbcdf7fe640 10 client.22200 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:39:52.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/3790499957 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5652093e4560 con 0x5652094b20c0 2026-02-20T03:39:52.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbcdf7fe640 10 client.22200 handle_command_reply: tid=0 2026-02-20T03:39:52.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbd2e6ebe00 1 client.22200 shutdown 2026-02-20T03:39:52.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3790499957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 msgr2=0x5652094a3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 0x5652094a3cf0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fbd140a3870 tx=0x7fbd140047c0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3790499957 shutdown_connections 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5652094b20c0 0x5652094b44b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56520948efb0 0x5652094a2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x565209489f60 0x5652094a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/3790499957 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5652094895e0 0x5652094a3cf0 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbcdf7fe640 0 client.22200 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.941+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3790499957 >> 10.20.193.28:0/3790499957 conn(0x56520944c240 msgr2=0x5652094883f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.942+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3790499957 shutdown_connections 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.942+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/3790499957 wait complete. 2026-02-20T03:39:52.945 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.942+0000 7fbd2e6ebe00 20 client.22200 trim_cache size 0 max 16384 2026-02-20T03:39:52.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2e6ebe00 1 Processor -- start 2026-02-20T03:39:52.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2e6ebe00 1 -- start start 2026-02-20T03:39:52.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 0x5652094884d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x565209488a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.952 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 0x56520949f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc012780 con 0x565209489f60 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc00ffc0 con 0x56520948efb0 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc00de10 con 0x5652094895e0 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd29f5b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 0x5652094884d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2975a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x565209488a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2a75c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 0x56520949f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2a75c640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 0x56520949f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:58402/0 (socket says 10.20.193.28:58402) 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2a75c640 1 -- 10.20.193.28:0/233279808 learned_addr learned my addr 10.20.193.28:0/233279808 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd29f5b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 0x5652094884d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36448/0 (socket says 10.20.193.28:36448) 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2975a640 1 -- 10.20.193.28:0/233279808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 msgr2=0x5652094884d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2975a640 1 --2- 10.20.193.28:0/233279808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 0x5652094884d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.953 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2975a640 1 -- 10.20.193.28:0/233279808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 msgr2=0x56520949f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:52.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2975a640 1 --2- 10.20.193.28:0/233279808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 0x56520949f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.949+0000 7fbd2975a640 1 -- 10.20.193.28:0/233279808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520949b970 con 0x565209489f60 2026-02-20T03:39:52.954 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 --2- 10.20.193.28:0/233279808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x565209488a10 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fbd1802f750 tx=0x7fbd18009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274c7221fa810f70 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:52.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcf1ce5640 1 -- 10.20.193.28:0/233279808 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18002db0 con 0x565209489f60 2026-02-20T03:39:52.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcf1ce5640 1 -- 10.20.193.28:0/233279808 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbd18033040 con 0x565209489f60 2026-02-20T03:39:52.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/233279808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 msgr2=0x565209488a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcf1ce5640 1 -- 10.20.193.28:0/233279808 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18002db0 con 0x565209489f60 2026-02-20T03:39:52.955 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/233279808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x565209488a10 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fbd1802f750 tx=0x7fbd18009340 comp rx=0 tx=0).stop 2026-02-20T03:39:52.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/233279808 shutdown_connections 2026-02-20T03:39:52.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/233279808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 0x56520949f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/233279808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x565209488a10 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.956 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/233279808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 0x5652094884d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/233279808 >> 10.20.193.28:0/233279808 conn(0x56520944c240 msgr2=0x5652094a3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/233279808 shutdown_connections 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/233279808 wait complete. 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- start start 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 Processor -- start 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 0x5652094ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x5652094ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 0x5652094aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc00e480 con 0x565209489f60 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc00f8f0 con 0x56520948efb0 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbccc00eb50 con 0x5652094895e0 2026-02-20T03:39:52.957 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x5652094ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x5652094ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37652/0 (socket says 10.20.193.28:37652) 2026-02-20T03:39:52.958 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 -- 10.20.193.28:0/2043982580 learned_addr learned my addr 10.20.193.28:0/2043982580 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:52.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 -- 10.20.193.28:0/2043982580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 msgr2=0x5652094ae3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:52.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 0x5652094ae3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 -- 10.20.193.28:0/2043982580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 msgr2=0x5652094aadd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:52.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 0x5652094aadd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 -- 10.20.193.28:0/2043982580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652090bb870 con 0x565209489f60 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2975a640 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x5652094ae8f0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fbd18002fc0 tx=0x7fbd18038660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5657cd0de350cf36 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcdf7fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/2043982580 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18038b80 con 0x565209489f60 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/2043982580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520937c3f0 con 0x565209489f60 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 10 client.22206 _ll_register_callbacks cb 0x7fbd20009470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/2043982580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56520938eab0 con 0x565209489f60 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/2043982580 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56520938eab0 con 0x565209489f60 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/2043982580 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1804e7d0 con 0x565209489f60 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/2043982580 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbd1804e970 con 0x565209489f60 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/2043982580 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fbd1804ec30 con 0x565209489f60 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 10 client.22206 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/2043982580 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x56520949c660 con 0x565209489f60 2026-02-20T03:39:52.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/2043982580 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fbd18004040 con 0x565209489f60 2026-02-20T03:39:52.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 10 client.22206 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:52.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 10 client.22206 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:39:52.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 20 client.22206 populate_metadata read hostname 'trial028' 2026-02-20T03:39:52.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56520951dd10 0x5652095201d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:52.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 4 client.22206 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:39:52.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.950+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/2043982580 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fbd140dd4e0 con 0x56520951dd10 2026-02-20T03:39:52.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.965+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56520951dd10 0x5652095201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:52.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.967+0000 7fbd29f5b640 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56520951dd10 0x5652095201d0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93d2d94fa028e2a7 server_cookie=61538f5264800fc7 in_seq=0 out_seq=0 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.967+0000 7fbcdf7fe640 10 client.22206 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbcdf7fe640 1 -- 10.20.193.28:0/2043982580 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fbd140dd4e0 con 0x56520951dd10 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbcdf7fe640 10 client.22206 handle_command_reply: tid=0 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 client.22206 shutdown 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/2043982580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 msgr2=0x5652094ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x5652094ae8f0 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7fbd18002fc0 tx=0x7fbd18038660 comp rx=0 tx=0).stop 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/2043982580 shutdown_connections 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x56520951dd10 0x5652095201d0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56520948efb0 0x5652094aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x565209489f60 0x5652094ae8f0 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbcdf7fe640 0 client.22206 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:39:52.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 --2- 10.20.193.28:0/2043982580 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5652094895e0 0x5652094ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/2043982580 >> 10.20.193.28:0/2043982580 conn(0x56520944c240 msgr2=0x5652094a0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:52.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/2043982580 shutdown_connections 2026-02-20T03:39:52.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 1 -- 10.20.193.28:0/2043982580 wait complete. 2026-02-20T03:39:52.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.968+0000 7fbd2e6ebe00 20 client.22206 trim_cache size 0 max 16384 2026-02-20T03:39:52.973 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:39:52.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 -- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbd000b0f70 msgr2=0x7fbd000b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbd000b0f70 0x7fbd000b3430 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009950 tx=0x7fbd180023d0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 -- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077620 msgr2=0x7fbd241a16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:52.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077620 0x7fbd241a16e0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400b780 tx=0x7fbd1400bc50 comp rx=0 tx=0).stop 2026-02-20T03:39:52.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 -- 10.20.193.28:0/4038910315 shutdown_connections 2026-02-20T03:39:52.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbd000b0f70 0x7fbd000b3430 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbd24113820 0x7fbd241a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbd24077f40 0x7fbd241a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 --2- 10.20.193.28:0/4038910315 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbd24077620 0x7fbd241a16e0 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:52.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 -- 10.20.193.28:0/4038910315 >> 10.20.193.28:0/4038910315 conn(0x7fbd24100680 msgr2=0x7fbd24113e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:52.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 -- 10.20.193.28:0/4038910315 shutdown_connections 2026-02-20T03:39:52.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:52.970+0000 7fbd2af5d640 1 -- 10.20.193.28:0/4038910315 wait complete. 2026-02-20T03:39:53.176 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:39:53.490 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:53.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.36 MB/sec execute 564 sec latency 24000.994 ms 2026-02-20T03:39:53.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 -- 10.20.193.28:0/1517494288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc078105340 msgr2=0x7fc078111870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:53.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 --2- 10.20.193.28:0/1517494288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc078105340 0x7fc078111870 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7fc06800b0d0 tx=0x7fc06802f490 comp rx=0 tx=0).stop 2026-02-20T03:39:53.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 -- 10.20.193.28:0/1517494288 shutdown_connections 2026-02-20T03:39:53.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 --2- 10.20.193.28:0/1517494288 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc078105340 0x7fc078111870 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 --2- 10.20.193.28:0/1517494288 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc0781049a0 0x7fc078104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 --2- 10.20.193.28:0/1517494288 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc07810a9a0 0x7fc07810ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 -- 10.20.193.28:0/1517494288 >> 10.20.193.28:0/1517494288 conn(0x7fc0781006c0 msgr2=0x7fc078102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:53.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 -- 10.20.193.28:0/1517494288 shutdown_connections 2026-02-20T03:39:53.765 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 -- 10.20.193.28:0/1517494288 wait complete. 2026-02-20T03:39:53.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 Processor -- start 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 -- start start 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0781049a0 0x7fc07819d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc078105340 0x7fc07819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc07810a9a0 0x7fc0781a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc078114cf0 con 0x7fc07810a9a0 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc078114b70 con 0x7fc078105340 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.761+0000 7fc077fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc078114e70 con 0x7fc0781049a0 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.763+0000 7fc0777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc07810a9a0 0x7fc0781a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.763+0000 7fc0777fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc07810a9a0 0x7fc0781a1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37672/0 (socket says 10.20.193.28:37672) 2026-02-20T03:39:53.767 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.763+0000 7fc0777fe640 1 -- 10.20.193.28:0/3988541404 learned_addr learned my addr 10.20.193.28:0/3988541404 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:53.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc076ffd640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0781049a0 0x7fc07819d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc0767fc640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc078105340 0x7fc07819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc0777fe640 1 -- 10.20.193.28:0/3988541404 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0781049a0 msgr2=0x7fc07819d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:53.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc0777fe640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0781049a0 0x7fc07819d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc0777fe640 1 -- 10.20.193.28:0/3988541404 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc078105340 msgr2=0x7fc07819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:53.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc0777fe640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc078105340 0x7fc07819d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc0777fe640 1 -- 10.20.193.28:0/3988541404 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0781a2220 con 0x7fc07810a9a0 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc0777fe640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc07810a9a0 0x7fc0781a1aa0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fc0680077f0 tx=0x7fc068009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc057fff640 1 -- 10.20.193.28:0/3988541404 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc068004590 con 0x7fc07810a9a0 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc057fff640 1 -- 10.20.193.28:0/3988541404 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc068004730 con 0x7fc07810a9a0 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc077fff640 1 -- 10.20.193.28:0/3988541404 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0781a24b0 con 0x7fc07810a9a0 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc057fff640 1 -- 10.20.193.28:0/3988541404 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0680052b0 con 0x7fc07810a9a0 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc077fff640 1 -- 10.20.193.28:0/3988541404 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0781a9d50 con 0x7fc07810a9a0 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.764+0000 7fc057fff640 1 -- 10.20.193.28:0/3988541404 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fc068005450 con 0x7fc07810a9a0 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 Processor -- start 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 -- start start 2026-02-20T03:39:53.781 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea3f50 0x562c0aea4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea4900 0x562c0aea6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea6b40 0x562c0aea74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562c0ae27e00 con 0x562c0aea4900 2026-02-20T03:39:53.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562c0adfa970 con 0x562c0aea3f50 2026-02-20T03:39:53.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562c0ada81f0 con 0x562c0aea6b40 2026-02-20T03:39:53.782 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc076ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea4900 0x562c0aea6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc076ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea4900 0x562c0aea6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37676/0 (socket says 10.20.193.28:37676) 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc076ffd640 1 -- 10.20.193.28:0/14163241 learned_addr learned my addr 10.20.193.28:0/14163241 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc076ffd640 1 -- 10.20.193.28:0/14163241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea6b40 msgr2=0x562c0aea74d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc076ffd640 1 --2- 10.20.193.28:0/14163241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea6b40 0x562c0aea74d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc076ffd640 1 -- 10.20.193.28:0/14163241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea3f50 msgr2=0x562c0aea4330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc076ffd640 1 --2- 10.20.193.28:0/14163241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea3f50 0x562c0aea4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc076ffd640 1 -- 10.20.193.28:0/14163241 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0adbb3d0 con 0x562c0aea4900 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc076ffd640 1 --2- 10.20.193.28:0/14163241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea4900 0x562c0aea6410 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fc06c006b50 tx=0x7fc06c007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed81977577faae39 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc0477fe640 1 -- 10.20.193.28:0/14163241 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0042e0 con 0x562c0aea4900 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc0477fe640 1 -- 10.20.193.28:0/14163241 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc06c004480 con 0x562c0aea4900 2026-02-20T03:39:53.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc0477fe640 1 -- 10.20.193.28:0/14163241 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c036a20 con 0x562c0aea4900 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 -- 10.20.193.28:0/14163241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea4900 msgr2=0x562c0aea6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/14163241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea4900 0x562c0aea6410 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fc06c006b50 tx=0x7fc06c007790 comp rx=0 tx=0).stop 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 -- 10.20.193.28:0/14163241 shutdown_connections 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/14163241 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea6b40 0x562c0aea74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/14163241 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea4900 0x562c0aea6410 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/14163241 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea3f50 0x562c0aea4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 -- 10.20.193.28:0/14163241 >> 10.20.193.28:0/14163241 conn(0x562c0ae6a240 msgr2=0x562c0aeae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 -- 10.20.193.28:0/14163241 shutdown_connections 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.770+0000 7fc07f86ce00 1 -- 10.20.193.28:0/14163241 wait complete. 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.775+0000 7fc07f86ce00 1 -- start start 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.775+0000 7fc07f86ce00 1 Processor -- start 2026-02-20T03:39:53.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.775+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.775+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af07120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.777+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea6b40 0x562c0af05390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.777+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562c0adf68a0 con 0x562c0aea3f50 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.777+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562c0abe8f50 con 0x562c0aea6b40 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.777+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562c0af059d0 con 0x562c0aea4900 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.777+0000 7fc057fff640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0480b0e50 0x7fc0480b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc076ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af07120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc076ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af07120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:36510/0 (socket says 10.20.193.28:36510) 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc076ffd640 1 -- 10.20.193.28:0/1552797513 learned_addr learned my addr 10.20.193.28:0/1552797513 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc057fff640 1 -- 10.20.193.28:0/3988541404 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc068106620 con 0x7fc07810a9a0 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc0777fe640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0480b0e50 0x7fc0480b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.785 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc0777fe640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0480b0e50 0x7fc0480b3310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc0681068c0 tx=0x7fc06800c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:53.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc0767fc640 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc0767fc640 1 -- 10.20.193.28:0/1552797513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 msgr2=0x562c0af07120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc0767fc640 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af07120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc0767fc640 1 -- 10.20.193.28:0/1552797513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea6b40 msgr2=0x562c0af05390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc0767fc640 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea6b40 0x562c0af05390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc0767fc640 1 -- 10.20.193.28:0/1552797513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0aeb9aa0 con 0x562c0aea3f50 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc0767fc640 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fc078102d50 tx=0x7fc06000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4b9b520a569acc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc044ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc044ff9640 1 -- 10.20.193.28:0/1552797513 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060004270 con 0x562c0aea3f50 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc044ff9640 1 -- 10.20.193.28:0/1552797513 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc060016070 con 0x562c0aea3f50 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc044ff9640 1 -- 10.20.193.28:0/1552797513 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0600118a0 con 0x562c0aea3f50 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc07f86ce00 1 -- 10.20.193.28:0/1552797513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0abcbb40 con 0x562c0aea3f50 2026-02-20T03:39:53.796 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc044ff9640 1 -- 10.20.193.28:0/1552797513 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc060002780 con 0x562c0aea3f50 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc044ff9640 10 client.22218 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc07f86ce00 10 client.22218 _ll_register_callbacks cb 0x562c0ae33eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.778+0000 7fc07f86ce00 1 -- 10.20.193.28:0/1552797513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562c0ae08150 con 0x562c0aea3f50 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc044ff9640 1 -- 10.20.193.28:0/1552797513 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fc060004410 con 0x562c0aea3f50 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc07f86ce00 10 client.22218 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc07f86ce00 1 -- 10.20.193.28:0/1552797513 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x562c0adb51e0 con 0x562c0aea3f50 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc044ff9640 1 -- 10.20.193.28:0/1552797513 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fc060011a80 con 0x562c0aea3f50 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc07f86ce00 10 client.22218 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc07f86ce00 10 client.22218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc07f86ce00 20 client.22218 populate_metadata read hostname 'trial028' 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562c0af15480 0x562c0af178d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc07f86ce00 4 client.22218 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:53.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.783+0000 7fc07f86ce00 1 -- 10.20.193.28:0/1552797513 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c0ae02560 con 0x562c0af15480 2026-02-20T03:39:53.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.792+0000 7fc076ffd640 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562c0af15480 0x562c0af178d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.835 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:53 trial028 ceph-mon[38552]: pgmap v942: 129 pgs: 129 active+clean; 825 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 222 KiB/s rd, 9.7 MiB/s wr, 292 op/s 2026-02-20T03:39:53.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.833+0000 7fc076ffd640 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562c0af15480 0x562c0af178d0 crc :-1 s=READY pgs=623 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81030cdbda7859d3 server_cookie=5e3e2bf68e7981ab in_seq=0 out_seq=0 2026-02-20T03:39:53.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.833+0000 7fc044ff9640 10 client.22218 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:53.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.847+0000 7fc044ff9640 1 -- 10.20.193.28:0/1552797513 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562c0ae02560 con 0x562c0af15480 2026-02-20T03:39:53.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.847+0000 7fc044ff9640 10 client.22218 handle_command_reply: tid=0 2026-02-20T03:39:53.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.847+0000 7fc07f86ce00 1 client.22218 shutdown 2026-02-20T03:39:53.850 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 -- 10.20.193.28:0/1552797513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 msgr2=0x562c0af06be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:53.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fc078102d50 tx=0x7fc06000c870 comp rx=0 tx=0).stop 2026-02-20T03:39:53.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 -- 10.20.193.28:0/1552797513 shutdown_connections 2026-02-20T03:39:53.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562c0af15480 0x562c0af178d0 crc :-1 s=READY pgs=623 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea6b40 0x562c0af05390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af07120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/1552797513 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 -- 10.20.193.28:0/1552797513 >> 10.20.193.28:0/1552797513 conn(0x562c0ae6a240 msgr2=0x562c0aea5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:53.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc044ff9640 0 client.22218 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:53.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 -- 10.20.193.28:0/1552797513 shutdown_connections 2026-02-20T03:39:53.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 1 -- 10.20.193.28:0/1552797513 wait complete. 2026-02-20T03:39:53.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.848+0000 7fc07f86ce00 20 client.22218 trim_cache size 0 max 16384 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.854+0000 7fc07f86ce00 1 Processor -- start 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.854+0000 7fc07f86ce00 1 -- start start 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.854+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af07120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea6b40 0x562c0aebd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc024012850 con 0x562c0aea3f50 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc024010090 con 0x562c0aea6b40 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc02400dee0 con 0x562c0aea4900 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc0767fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc0767fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37698/0 (socket says 10.20.193.28:37698) 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc0767fc640 1 -- 10.20.193.28:0/3297540152 learned_addr learned my addr 10.20.193.28:0/3297540152 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:53.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc0767fc640 1 -- 10.20.193.28:0/3297540152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 msgr2=0x562c0af07120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc0767fc640 1 --2- 10.20.193.28:0/3297540152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af07120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc0767fc640 1 -- 10.20.193.28:0/3297540152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea6b40 msgr2=0x562c0aebd8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc0767fc640 1 --2- 10.20.193.28:0/3297540152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea6b40 0x562c0aebd8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc0767fc640 1 -- 10.20.193.28:0/3297540152 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0aeb98d0 con 0x562c0aea3f50 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc0767fc640 1 --2- 10.20.193.28:0/3297540152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fc060004770 tx=0x7fc06001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320baffff27196a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc046ffd640 1 -- 10.20.193.28:0/3297540152 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060029020 con 0x562c0aea3f50 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc046ffd640 1 -- 10.20.193.28:0/3297540152 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc060016040 con 0x562c0aea3f50 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc046ffd640 1 -- 10.20.193.28:0/3297540152 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060011650 con 0x562c0aea3f50 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 -- 10.20.193.28:0/3297540152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 msgr2=0x562c0af06be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/3297540152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fc060004770 tx=0x7fc06001b000 comp rx=0 tx=0).stop 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 -- 10.20.193.28:0/3297540152 shutdown_connections 2026-02-20T03:39:53.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/3297540152 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea6b40 0x562c0aebd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/3297540152 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af07120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/3297540152 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea3f50 0x562c0af06be0 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 -- 10.20.193.28:0/3297540152 >> 10.20.193.28:0/3297540152 conn(0x562c0ae6a240 msgr2=0x562c0af17490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:53.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 -- 10.20.193.28:0/3297540152 shutdown_connections 2026-02-20T03:39:53.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.857+0000 7fc07f86ce00 1 -- 10.20.193.28:0/3297540152 wait complete. 2026-02-20T03:39:53.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.860+0000 7fc07f86ce00 1 -- start start 2026-02-20T03:39:53.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.860+0000 7fc07f86ce00 1 Processor -- start 2026-02-20T03:39:53.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea3f50 0x562c0af0d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af0b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc07f86ce00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea6b40 0x562c0af0bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fc02400e550 con 0x562c0aea6b40 2026-02-20T03:39:53.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fc02400f9c0 con 0x562c0aea3f50 2026-02-20T03:39:53.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc07f86ce00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fc02400ec20 con 0x562c0aea4900 2026-02-20T03:39:53.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc0767fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea6b40 0x562c0af0bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc0767fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea6b40 0x562c0af0bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37714/0 (socket says 10.20.193.28:37714) 2026-02-20T03:39:53.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc0767fc640 1 -- 10.20.193.28:0/4108852815 learned_addr learned my addr 10.20.193.28:0/4108852815 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:53.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc0767fc640 1 -- 10.20.193.28:0/4108852815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 msgr2=0x562c0af0b670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc0767fc640 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af0b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc0767fc640 1 -- 10.20.193.28:0/4108852815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea3f50 msgr2=0x562c0af0d2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc0767fc640 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea3f50 0x562c0af0d2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc0767fc640 1 -- 10.20.193.28:0/4108852815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c0aad9870 con 0x562c0aea6b40 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc0767fc640 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea6b40 0x562c0af0bbb0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fc060006e10 tx=0x7fc0600029b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a711082806182d server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.861+0000 7fc044ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc044ff9640 1 -- 10.20.193.28:0/4108852815 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060033070 con 0x562c0aea6b40 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 1 -- 10.20.193.28:0/4108852815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c0ad9a3f0 con 0x562c0aea6b40 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 10 client.22224 _ll_register_callbacks cb 0x7fc06000a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 1 -- 10.20.193.28:0/4108852815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc060016040 con 0x562c0aea6b40 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc044ff9640 1 -- 10.20.193.28:0/4108852815 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fc060016040 con 0x562c0aea6b40 2026-02-20T03:39:53.872 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc044ff9640 1 -- 10.20.193.28:0/4108852815 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060029020 con 0x562c0aea6b40 2026-02-20T03:39:53.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc044ff9640 1 -- 10.20.193.28:0/4108852815 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fc06001b750 con 0x562c0aea6b40 2026-02-20T03:39:53.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc044ff9640 1 -- 10.20.193.28:0/4108852815 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fc06001ba50 con 0x562c0aea6b40 2026-02-20T03:39:53.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 10 client.22224 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:53.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 1 -- 10.20.193.28:0/4108852815 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x562c0aeba5c0 con 0x562c0aea6b40 2026-02-20T03:39:53.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc044ff9640 1 -- 10.20.193.28:0/4108852815 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fc06001bbf0 con 0x562c0aea6b40 2026-02-20T03:39:53.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 10 client.22224 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:53.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 10 client.22224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:53.873 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 20 client.22224 populate_metadata read hostname 'trial028' 2026-02-20T03:39:53.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562c0af81250 0x562c0af83710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:53.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 4 client.22224 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:39:53.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.866+0000 7fc07f86ce00 1 -- 10.20.193.28:0/4108852815 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562c0ae02560 con 0x562c0af81250 2026-02-20T03:39:53.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.875+0000 7fc076ffd640 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562c0af81250 0x562c0af83710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:53.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.902+0000 7fc076ffd640 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562c0af81250 0x562c0af83710 crc :-1 s=READY pgs=624 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd20273b5f623d02 server_cookie=fe736f2a9f44fa92 in_seq=0 out_seq=0 2026-02-20T03:39:53.905 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.902+0000 7fc044ff9640 10 client.22224 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:53.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc044ff9640 1 -- 10.20.193.28:0/4108852815 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562c0ae02560 con 0x562c0af81250 2026-02-20T03:39:53.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc044ff9640 10 client.22224 handle_command_reply: tid=0 2026-02-20T03:39:53.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 client.22224 shutdown 2026-02-20T03:39:53.919 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 -- 10.20.193.28:0/4108852815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea6b40 msgr2=0x562c0af0bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:53.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea6b40 0x562c0af0bbb0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fc060006e10 tx=0x7fc0600029b0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 -- 10.20.193.28:0/4108852815 shutdown_connections 2026-02-20T03:39:53.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x562c0af81250 0x562c0af83710 crc :-1 s=READY pgs=624 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562c0aea6b40 0x562c0af0bbb0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562c0aea4900 0x562c0af0b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 --2- 10.20.193.28:0/4108852815 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562c0aea3f50 0x562c0af0d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 -- 10.20.193.28:0/4108852815 >> 10.20.193.28:0/4108852815 conn(0x562c0ae6a240 msgr2=0x562c0af06be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:53.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc044ff9640 0 client.22224 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:53.920 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 -- 10.20.193.28:0/4108852815 shutdown_connections 2026-02-20T03:39:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 1 -- 10.20.193.28:0/4108852815 wait complete. 2026-02-20T03:39:53.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc07f86ce00 20 client.22224 trim_cache size 0 max 16384 2026-02-20T03:39:53.932 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:39:53.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 -- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0480b0e50 msgr2=0x7fc0480b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:53.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0480b0e50 0x7fc0480b3310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fc0681068c0 tx=0x7fc06800c000 comp rx=0 tx=0).stop 2026-02-20T03:39:53.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 -- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc07810a9a0 msgr2=0x7fc0781a1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:53.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc07810a9a0 0x7fc0781a1aa0 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7fc0680077f0 tx=0x7fc068009300 comp rx=0 tx=0).stop 2026-02-20T03:39:53.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 -- 10.20.193.28:0/3988541404 shutdown_connections 2026-02-20T03:39:53.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fc0480b0e50 0x7fc0480b3310 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fc07810a9a0 0x7fc0781a1aa0 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fc078105340 0x7fc07819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 --2- 10.20.193.28:0/3988541404 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fc0781049a0 0x7fc07819d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:53.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 -- 10.20.193.28:0/3988541404 >> 10.20.193.28:0/3988541404 conn(0x7fc0781006c0 msgr2=0x7fc078100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:53.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 -- 10.20.193.28:0/3988541404 shutdown_connections 2026-02-20T03:39:53.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:53.916+0000 7fc077fff640 1 -- 10.20.193.28:0/3988541404 wait complete. 2026-02-20T03:39:53.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:53 trial177 ceph-mon[43181]: pgmap v942: 129 pgs: 129 active+clean; 825 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 222 KiB/s rd, 9.7 MiB/s wr, 292 op/s 2026-02-20T03:39:54.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:53 trial126 ceph-mon[38476]: pgmap v942: 129 pgs: 129 active+clean; 825 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 222 KiB/s rd, 9.7 MiB/s wr, 292 op/s 2026-02-20T03:39:54.739 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.32 MB/sec execute 565 sec latency 25001.296 ms 2026-02-20T03:39:54.911 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:54 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:39:54.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:54 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:39:55.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:54 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:39:55.107 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2026-02-20T03:39:55.108 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub start / force,recursive 2026-02-20T03:39:55.407 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:55.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 -- 10.20.193.28:0/968514028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d410eef0 msgr2=0x7f18d410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:55.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 --2- 10.20.193.28:0/968514028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d410eef0 0x7f18d410f2d0 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f18c8009a30 tx=0x7f18c802f260 comp rx=0 tx=0).stop 2026-02-20T03:39:55.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 -- 10.20.193.28:0/968514028 shutdown_connections 2026-02-20T03:39:55.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 --2- 10.20.193.28:0/968514028 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f18d4109ba0 0x7f18d4115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 --2- 10.20.193.28:0/968514028 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18d4109220 0x7f18d4109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 --2- 10.20.193.28:0/968514028 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d410eef0 0x7f18d410f2d0 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 -- 10.20.193.28:0/968514028 >> 10.20.193.28:0/968514028 conn(0x7f18d4078600 msgr2=0x7f18d407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:55.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 -- 10.20.193.28:0/968514028 shutdown_connections 2026-02-20T03:39:55.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 -- 10.20.193.28:0/968514028 wait complete. 2026-02-20T03:39:55.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.659+0000 7f18d3577640 1 Processor -- start 2026-02-20T03:39:55.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d3577640 1 -- start start 2026-02-20T03:39:55.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d3577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d4109220 0x7f18d41a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d3577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18d4109ba0 0x7f18d41a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d3577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f18d410eef0 0x7f18d41a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d3577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f18d4119160 con 0x7f18d4109220 2026-02-20T03:39:55.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d3577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f18d4118fe0 con 0x7f18d410eef0 2026-02-20T03:39:55.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d3577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f18d41192e0 con 0x7f18d4109ba0 2026-02-20T03:39:55.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d4109220 0x7f18d41a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:55.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d4109220 0x7f18d41a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37724/0 (socket says 10.20.193.28:37724) 2026-02-20T03:39:55.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d2575640 1 -- 10.20.193.28:0/4006540680 learned_addr learned my addr 10.20.193.28:0/4006540680 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:55.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d2575640 1 -- 10.20.193.28:0/4006540680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18d4109ba0 msgr2=0x7f18d41a1b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:55.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d2575640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18d4109ba0 0x7f18d41a1b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d2575640 1 -- 10.20.193.28:0/4006540680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f18d410eef0 msgr2=0x7f18d41a5f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:55.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d2575640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f18d410eef0 0x7f18d41a5f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.664+0000 7f18d2575640 1 -- 10.20.193.28:0/4006540680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d41a6680 con 0x7f18d4109220 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.665+0000 7f18d2575640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d4109220 0x7f18d41a1630 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f18c802f770 tx=0x7f18c8002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.665+0000 7f18bb7fe640 1 -- 10.20.193.28:0/4006540680 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8004260 con 0x7f18d4109220 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.665+0000 7f18bb7fe640 1 -- 10.20.193.28:0/4006540680 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f18c8004400 con 0x7f18d4109220 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.665+0000 7f18bb7fe640 1 -- 10.20.193.28:0/4006540680 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8041920 con 0x7f18d4109220 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.665+0000 7f18d3577640 1 -- 10.20.193.28:0/4006540680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d41a6910 con 0x7f18d4109220 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.665+0000 7f18d3577640 1 -- 10.20.193.28:0/4006540680 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d41ae1b0 con 0x7f18d4109220 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.665+0000 7f18db134e00 1 Processor -- start 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18bb7fe640 1 -- 10.20.193.28:0/4006540680 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f18c8038790 con 0x7f18d4109220 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18db134e00 1 -- start start 2026-02-20T03:39:55.676 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18db134e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508ca0c0 0x5621508ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18db134e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508caa70 0x5621508ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18db134e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ceb60 0x5621508cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18db134e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56215081cc00 con 0x5621508caa70 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18db134e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5621507ca3c0 con 0x5621508ceb60 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18db134e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562150818b30 con 0x5621508ca0c0 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18d2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508caa70 0x5621508ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18d2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508caa70 0x5621508ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37736/0 (socket says 10.20.193.28:37736) 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18d2575640 1 -- 10.20.193.28:0/738304642 learned_addr learned my addr 10.20.193.28:0/738304642 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18d2575640 1 -- 10.20.193.28:0/738304642 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508ca0c0 msgr2=0x5621508ca4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18d2575640 1 --2- 10.20.193.28:0/738304642 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508ca0c0 0x5621508ca4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18d2575640 1 -- 10.20.193.28:0/738304642 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ceb60 msgr2=0x5621508cefd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:55.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18d2575640 1 --2- 10.20.193.28:0/738304642 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ceb60 0x5621508cefd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18d2575640 1 -- 10.20.193.28:0/738304642 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621507c3840 con 0x5621508caa70 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18d2575640 1 --2- 10.20.193.28:0/738304642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508caa70 0x5621508ce540 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f18c810b4f0 tx=0x7f18c810b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab8b5891e4cf508 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18b8ff9640 1 -- 10.20.193.28:0/738304642 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8105d80 con 0x5621508caa70 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18b8ff9640 1 -- 10.20.193.28:0/738304642 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f18c8112030 con 0x5621508caa70 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.668+0000 7f18b8ff9640 1 -- 10.20.193.28:0/738304642 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8117900 con 0x5621508caa70 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18bb7fe640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18ac0b0e20 0x7f18ac0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- 10.20.193.28:0/738304642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508caa70 msgr2=0x5621508ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 --2- 10.20.193.28:0/738304642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508caa70 0x5621508ce540 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f18c810b4f0 tx=0x7f18c810b5f0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18bb7fe640 1 -- 10.20.193.28:0/4006540680 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f18c8105580 con 0x7f18d4109220 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- 10.20.193.28:0/738304642 shutdown_connections 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 --2- 10.20.193.28:0/738304642 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ceb60 0x5621508cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 --2- 10.20.193.28:0/738304642 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508caa70 0x5621508ce540 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 --2- 10.20.193.28:0/738304642 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508ca0c0 0x5621508ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- 10.20.193.28:0/738304642 >> 10.20.193.28:0/738304642 conn(0x5621508c2b60 msgr2=0x5621508c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2d76640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18ac0b0e20 0x7f18ac0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- 10.20.193.28:0/738304642 shutdown_connections 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- 10.20.193.28:0/738304642 wait complete. 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2d76640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18ac0b0e20 0x7f18ac0b32e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f18c400aab0 tx=0x7f18c4009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- start start 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 Processor -- start 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ca0c0 0x5621508e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508caa70 0x5621508e41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508ceb60 0x5621508e2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.679 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5621507c41a0 con 0x5621508ca0c0 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5621508d6bb0 con 0x5621508caa70 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5621508e2a60 con 0x5621508ceb60 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ca0c0 0x5621508e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ca0c0 0x5621508e3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37738/0 (socket says 10.20.193.28:37738) 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2575640 1 -- 10.20.193.28:0/206267440 learned_addr learned my addr 10.20.193.28:0/206267440 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2575640 1 -- 10.20.193.28:0/206267440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508ceb60 msgr2=0x5621508e2420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2575640 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508ceb60 0x5621508e2420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2575640 1 -- 10.20.193.28:0/206267440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508caa70 msgr2=0x5621508e41b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2575640 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508caa70 0x5621508e41b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2575640 1 -- 10.20.193.28:0/206267440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621508dc320 con 0x5621508ca0c0 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18d2575640 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ca0c0 0x5621508e3c70 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f18c80ccf60 tx=0x7f18c80413c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a005ca513abc57 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:55.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f1883fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:55.686 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f1883fff640 1 -- 10.20.193.28:0/206267440 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80c8ed0 con 0x5621508ca0c0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f1883fff640 1 -- 10.20.193.28:0/206267440 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f18c8033070 con 0x5621508ca0c0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f1883fff640 1 -- 10.20.193.28:0/206267440 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80cc780 con 0x5621508ca0c0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- 10.20.193.28:0/206267440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621505ebb60 con 0x5621508ca0c0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f1883fff640 1 -- 10.20.193.28:0/206267440 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f18c80ccb20 con 0x5621508ca0c0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 10 client.22236 _ll_register_callbacks cb 0x5621507c80d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- 10.20.193.28:0/206267440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5621508247f0 con 0x5621508ca0c0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f1883fff640 1 -- 10.20.193.28:0/206267440 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f18c80cc960 con 0x5621508ca0c0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 10 client.22236 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- 10.20.193.28:0/206267440 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5621507e9430 con 0x5621508ca0c0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f1883fff640 1 -- 10.20.193.28:0/206267440 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f18c80d6030 con 0x5621508ca0c0 2026-02-20T03:39:55.687 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 10 client.22236 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 10 client.22236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 20 client.22236 populate_metadata read hostname 'trial028' 2026-02-20T03:39:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5621508f2350 0x5621508f4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 4 client.22236 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:55.688 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.670+0000 7f18db134e00 1 -- 10.20.193.28:0/206267440 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56215079ec00 con 0x5621508f2350 2026-02-20T03:39:55.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.696+0000 7f18d1d74640 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5621508f2350 0x5621508f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:55.739 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.29 MB/sec execute 566 sec latency 26001.332 ms 2026-02-20T03:39:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.763+0000 7f18d1d74640 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5621508f2350 0x5621508f4810 crc :-1 s=READY pgs=625 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dd756d591af5e98 server_cookie=6a7d0a22c4564af2 in_seq=0 out_seq=0 2026-02-20T03:39:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.763+0000 7f1883fff640 10 client.22236 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:55.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f1883fff640 1 -- 10.20.193.28:0/206267440 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56215079ec00 con 0x5621508f2350 2026-02-20T03:39:55.792 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f1883fff640 10 client.22236 handle_command_reply: tid=0 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 client.22236 shutdown 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 -- 10.20.193.28:0/206267440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ca0c0 msgr2=0x5621508e3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ca0c0 0x5621508e3c70 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f18c80ccf60 tx=0x7f18c80413c0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 -- 10.20.193.28:0/206267440 shutdown_connections 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5621508f2350 0x5621508f4810 crc :-1 s=READY pgs=625 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508ceb60 0x5621508e2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508caa70 0x5621508e41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 --2- 10.20.193.28:0/206267440 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ca0c0 0x5621508e3c70 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 -- 10.20.193.28:0/206267440 >> 10.20.193.28:0/206267440 conn(0x5621508c2b60 msgr2=0x5621508cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f1883fff640 0 client.22236 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:55.794 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 -- 10.20.193.28:0/206267440 shutdown_connections 2026-02-20T03:39:55.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 1 -- 10.20.193.28:0/206267440 wait complete. 2026-02-20T03:39:55.795 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.790+0000 7f18db134e00 20 client.22236 trim_cache size 0 max 16384 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18db134e00 1 Processor -- start 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18db134e00 1 -- start start 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18db134e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ca0c0 0x5621508ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18db134e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508caa70 0x5621508fa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18db134e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621508fa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18db134e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1878012730 con 0x5621508ceb60 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18db134e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f187800ff70 con 0x5621508ca0c0 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18db134e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f187800ddc0 con 0x5621508caa70 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18d2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621508fa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18d2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621508fa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37742/0 (socket says 10.20.193.28:37742) 2026-02-20T03:39:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18d2d76640 1 -- 10.20.193.28:0/1511698272 learned_addr learned my addr 10.20.193.28:0/1511698272 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18d2d76640 1 -- 10.20.193.28:0/1511698272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508caa70 msgr2=0x5621508fa0e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18d2d76640 1 --2- 10.20.193.28:0/1511698272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508caa70 0x5621508fa0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18d2d76640 1 -- 10.20.193.28:0/1511698272 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ca0c0 msgr2=0x5621508ce1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18d2d76640 1 --2- 10.20.193.28:0/1511698272 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ca0c0 0x5621508ce1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18d2d76640 1 -- 10.20.193.28:0/1511698272 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621508ca810 con 0x5621508ceb60 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f18d2d76640 1 --2- 10.20.193.28:0/1511698272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621508fa620 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f18c400cc10 tx=0x7f18c400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9fc40bd1812f82 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.796+0000 7f189e4e6640 1 -- 10.20.193.28:0/1511698272 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4006e60 con 0x5621508ceb60 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f189e4e6640 1 -- 10.20.193.28:0/1511698272 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f18c401f020 con 0x5621508ceb60 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f189e4e6640 1 -- 10.20.193.28:0/1511698272 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c400d660 con 0x5621508ceb60 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- 10.20.193.28:0/1511698272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 msgr2=0x5621508fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 --2- 10.20.193.28:0/1511698272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621508fa620 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7f18c400cc10 tx=0x7f18c400f000 comp rx=0 tx=0).stop 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- 10.20.193.28:0/1511698272 shutdown_connections 2026-02-20T03:39:55.806 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 --2- 10.20.193.28:0/1511698272 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621508fa620 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 --2- 10.20.193.28:0/1511698272 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508caa70 0x5621508fa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 --2- 10.20.193.28:0/1511698272 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ca0c0 0x5621508ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- 10.20.193.28:0/1511698272 >> 10.20.193.28:0/1511698272 conn(0x5621508c2b60 msgr2=0x5621508e13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:55.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- 10.20.193.28:0/1511698272 shutdown_connections 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- 10.20.193.28:0/1511698272 wait complete. 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- start start 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 Processor -- start 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ca0c0 0x5621508e9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508caa70 0x5621508ea080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621509568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f187800e430 con 0x5621508ceb60 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f187800f8a0 con 0x5621508ca0c0 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f187800eb00 con 0x5621508caa70 2026-02-20T03:39:55.809 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18d2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621509568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18d2d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621509568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37746/0 (socket says 10.20.193.28:37746) 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18d2d76640 1 -- 10.20.193.28:0/1308717368 learned_addr learned my addr 10.20.193.28:0/1308717368 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18d2d76640 1 -- 10.20.193.28:0/1308717368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508caa70 msgr2=0x5621508ea080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18d2d76640 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508caa70 0x5621508ea080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18d2d76640 1 -- 10.20.193.28:0/1308717368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ca0c0 msgr2=0x5621508e9b40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18d2d76640 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ca0c0 0x5621508e9b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18d2d76640 1 -- 10.20.193.28:0/1308717368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621508dc150 con 0x5621508ceb60 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18d2d76640 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621509568f0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f18c4002d00 tx=0x7f18c401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8b57bf4231e108 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f1883fff640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f1883fff640 1 -- 10.20.193.28:0/1308717368 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c401e070 con 0x5621508ceb60 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f1883fff640 1 -- 10.20.193.28:0/1308717368 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f18c4011070 con 0x5621508ceb60 2026-02-20T03:39:55.810 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f1883fff640 1 -- 10.20.193.28:0/1308717368 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c4024930 con 0x5621508ceb60 2026-02-20T03:39:55.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.801+0000 7f18db134e00 1 -- 10.20.193.28:0/1308717368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621504fb900 con 0x5621508ceb60 2026-02-20T03:39:55.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f1883fff640 1 -- 10.20.193.28:0/1308717368 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f18c4024ad0 con 0x5621508ceb60 2026-02-20T03:39:55.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 10 client.22242 _ll_register_callbacks cb 0x7f18c80045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:55.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 1 -- 10.20.193.28:0/1308717368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18c8112030 con 0x5621508ceb60 2026-02-20T03:39:55.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f1883fff640 1 -- 10.20.193.28:0/1308717368 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f18c4024cd0 con 0x5621508ceb60 2026-02-20T03:39:55.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 10 client.22242 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:55.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 1 -- 10.20.193.28:0/1308717368 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5621507d74d0 con 0x5621508ceb60 2026-02-20T03:39:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f1883fff640 1 -- 10.20.193.28:0/1308717368 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f18c402c020 con 0x5621508ceb60 2026-02-20T03:39:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 10 client.22242 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 10 client.22242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 20 client.22242 populate_metadata read hostname 'trial028' 2026-02-20T03:39:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56215095f7f0 0x562150961cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 4 client.22242 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2026-02-20T03:39:55.820 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.803+0000 7f18db134e00 1 -- 10.20.193.28:0/1308717368 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56215058ca20 con 0x56215095f7f0 2026-02-20T03:39:55.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.830+0000 7f18d2575640 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56215095f7f0 0x562150961cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:55.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.897+0000 7f18d2575640 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56215095f7f0 0x562150961cb0 crc :-1 s=READY pgs=626 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2bd5a8a9014951 server_cookie=f7b80b82c91b2d1a in_seq=0 out_seq=0 2026-02-20T03:39:55.899 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.897+0000 7f1883fff640 10 client.22242 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:55.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f1883fff640 1 -- 10.20.193.28:0/1308717368 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56215058ca20 con 0x56215095f7f0 2026-02-20T03:39:55.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f1883fff640 10 client.22242 handle_command_reply: tid=0 2026-02-20T03:39:55.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 client.22242 shutdown 2026-02-20T03:39:55.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 -- 10.20.193.28:0/1308717368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 msgr2=0x5621509568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:55.913 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621509568f0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f18c4002d00 tx=0x7f18c401ac40 comp rx=0 tx=0).stop 2026-02-20T03:39:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 -- 10.20.193.28:0/1308717368 shutdown_connections 2026-02-20T03:39:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56215095f7f0 0x562150961cb0 crc :-1 s=READY pgs=626 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5621508ceb60 0x5621509568f0 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5621508caa70 0x5621508ea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 --2- 10.20.193.28:0/1308717368 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5621508ca0c0 0x5621508e9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 -- 10.20.193.28:0/1308717368 >> 10.20.193.28:0/1308717368 conn(0x5621508c2b60 msgr2=0x5621508cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:55.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f1883fff640 0 client.22242 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:55.915 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:39:55.915 INFO:teuthology.orchestra.run.trial028.stdout: "return_code": 0, 2026-02-20T03:39:55.915 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_tag": "3590b345-cd20-45f5-8dac-0c62d0d24d0c", 2026-02-20T03:39:55.915 INFO:teuthology.orchestra.run.trial028.stdout: "mode": "asynchronous" 2026-02-20T03:39:55.915 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:39:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 -- 10.20.193.28:0/1308717368 shutdown_connections 2026-02-20T03:39:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.910+0000 7f18db134e00 1 -- 10.20.193.28:0/1308717368 wait complete. 2026-02-20T03:39:55.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18db134e00 20 client.22242 trim_cache size 0 max 16384 2026-02-20T03:39:55.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 -- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18ac0b0e20 msgr2=0x7f18ac0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:55.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18ac0b0e20 0x7f18ac0b32e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f18c400aab0 tx=0x7f18c4009250 comp rx=0 tx=0).stop 2026-02-20T03:39:55.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 -- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d4109220 msgr2=0x7f18d41a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:55.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d4109220 0x7f18d41a1630 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f18c802f770 tx=0x7f18c8002910 comp rx=0 tx=0).stop 2026-02-20T03:39:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 -- 10.20.193.28:0/4006540680 shutdown_connections 2026-02-20T03:39:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f18ac0b0e20 0x7f18ac0b32e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f18d410eef0 0x7f18d41a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f18d4109ba0 0x7f18d41a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 --2- 10.20.193.28:0/4006540680 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f18d4109220 0x7f18d41a1630 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 -- 10.20.193.28:0/4006540680 >> 10.20.193.28:0/4006540680 conn(0x7f18d4078600 msgr2=0x7f18d407a050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 -- 10.20.193.28:0/4006540680 shutdown_connections 2026-02-20T03:39:55.927 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:55.911+0000 7f18d3577640 1 -- 10.20.193.28:0/4006540680 wait complete. 2026-02-20T03:39:55.954 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:55 trial028 ceph-mon[38552]: pgmap v943: 129 pgs: 129 active+clean; 839 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 140 KiB/s rd, 9.7 MiB/s wr, 284 op/s 2026-02-20T03:39:55.954 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:39:55.954 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:39:55.955 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:39:55.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:55 trial177 ceph-mon[43181]: pgmap v943: 129 pgs: 129 active+clean; 839 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 140 KiB/s rd, 9.7 MiB/s wr, 284 op/s 2026-02-20T03:39:55.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:39:55.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:39:55.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:39:56.072 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:39:56.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:55 trial126 ceph-mon[38476]: pgmap v943: 129 pgs: 129 active+clean; 839 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 140 KiB/s rd, 9.7 MiB/s wr, 284 op/s 2026-02-20T03:39:56.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:39:56.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:39:56.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:39:56.397 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:39:56.595 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:39:56 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:39:56.152+0000 7ff740af4640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004a21 [...2,head] /volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client5/~dmtmp/PARADOX/ auth{1=1,2=1} v63086 ap=2 f(v325 m2026-02-20T03:39:29.152355+0000 25=25+0) n(v5 rc2026-02-20T03:39:29.152355+0000 b5201920 26=25+1) (inest sync->mix g=1,2) caps={25141=pAsLsXsFs/pAsLsXsFsx@4604} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5575525ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000004a21:[<0x100000048b1/PARADOX v1582>,<0x100000048af/~dmtmp v45>,<0x100000005e4/client5 v1463>,<0x100000005e3/clients v1153>,<0x100000005e2/tmp v1114>,<0x100000001fb/client.0 v1118>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v1129>,<0x10000000001/sv_1 v1131>,<0x10000000000/qa v1107>,<0x1/volumes v1055>]//[]","memoryvalue":"(2)0x10000004a21:[<0x100000048b1/PARADOX v63086>,<0x100000048af/~dmtmp v1233>,<0x100000005e4/client5 v4239>,<0x100000005e3/clients v2324>,<0x100000005e2/tmp v1820>,<0x100000001fb/client.0 v1830>,<0x100000001fa/19cdb0c0-6ca5-4b99-964e-2013b2854021 v1841>,<0x10000000001/sv_1 v1840>,<0x10000000000/qa v1821>,<0x1/volumes v1691>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2026-02-20T03:39:29.142355+0000 24=24+0)","ondisk_value.rstat":"n(v0 rc2026-02-20T03:39:29.152355+0000 b5201920 26=25+1)","memory_value.dirstat":"f(v325 m2026-02-20T03:39:29.152355+0000 25=25+0)","memory_value.rstat":"n(v5 rc2026-02-20T03:39:29.152355+0000 b5201920 26=25+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2026-02-20T03:39:56.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.652+0000 7f6c66555640 1 -- 10.20.193.28:0/328610337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 msgr2=0x7f6c6010e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:56.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.652+0000 7f6c66555640 1 --2- 10.20.193.28:0/328610337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 0x7f6c6010e940 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009a30 tx=0x7f6c5402f2f0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.652+0000 7f6c66555640 1 -- 10.20.193.28:0/328610337 shutdown_connections 2026-02-20T03:39:56.655 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.652+0000 7f6c66555640 1 --2- 10.20.193.28:0/328610337 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c6010efb0 0x7f6c60111430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.652+0000 7f6c66555640 1 --2- 10.20.193.28:0/328610337 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 0x7f6c6010e940 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.652+0000 7f6c66555640 1 --2- 10.20.193.28:0/328610337 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c601009c0 0x7f6c60100da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.652+0000 7f6c66555640 1 -- 10.20.193.28:0/328610337 >> 10.20.193.28:0/328610337 conn(0x7f6c600fc5f0 msgr2=0x7f6c600fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:56.656 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.652+0000 7f6c66555640 1 -- 10.20.193.28:0/328610337 shutdown_connections 2026-02-20T03:39:56.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.652+0000 7f6c66555640 1 -- 10.20.193.28:0/328610337 wait complete. 2026-02-20T03:39:56.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 Processor -- start 2026-02-20T03:39:56.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 -- start start 2026-02-20T03:39:56.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c601009c0 0x7f6c601044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 0x7f6c60104a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.657 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c6010efb0 0x7f6c60104f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60114d00 con 0x7f6c601012e0 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60114b80 con 0x7f6c601009c0 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60114e80 con 0x7f6c6010efb0 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 0x7f6c60104a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 0x7f6c60104a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55912/0 (socket says 10.20.193.28:55912) 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 -- 10.20.193.28:0/4267112161 learned_addr learned my addr 10.20.193.28:0/4267112161 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 -- 10.20.193.28:0/4267112161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c6010efb0 msgr2=0x7f6c60104f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c6010efb0 0x7f6c60104f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 -- 10.20.193.28:0/4267112161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c601009c0 msgr2=0x7f6c601044c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c601009c0 0x7f6c601044c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.658 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 -- 10.20.193.28:0/4267112161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c601ad9e0 con 0x7f6c601012e0 2026-02-20T03:39:56.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 0x7f6c60104a00 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f6c54002910 tx=0x7f6c54002940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:56.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c4e7fc640 1 -- 10.20.193.28:0/4267112161 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54002cf0 con 0x7f6c601012e0 2026-02-20T03:39:56.665 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c4e7fc640 1 -- 10.20.193.28:0/4267112161 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6c54004c60 con 0x7f6c601012e0 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 -- 10.20.193.28:0/4267112161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c601adc70 con 0x7f6c601012e0 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c4e7fc640 1 -- 10.20.193.28:0/4267112161 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54038470 con 0x7f6c601012e0 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c66555640 1 -- 10.20.193.28:0/4267112161 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c601ae1a0 con 0x7f6c601012e0 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c4e7fc640 1 -- 10.20.193.28:0/4267112161 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f6c5404a060 con 0x7f6c601012e0 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c69ce3e00 1 Processor -- start 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c69ce3e00 1 -- start start 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 0x56367e4633e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45d630 0x56367e45da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e469e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56367e3dde50 con 0x56367e45dfb0 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56367e3b09c0 con 0x56367e463000 2026-02-20T03:39:56.666 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56367e35e240 con 0x56367e45d630 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e469e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e469e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55924/0 (socket says 10.20.193.28:55924) 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 -- 10.20.193.28:0/3284641327 learned_addr learned my addr 10.20.193.28:0/3284641327 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 -- 10.20.193.28:0/3284641327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45d630 msgr2=0x56367e45da70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 --2- 10.20.193.28:0/3284641327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45d630 0x56367e45da70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 -- 10.20.193.28:0/3284641327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 msgr2=0x56367e4633e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 --2- 10.20.193.28:0/3284641327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 0x56367e4633e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c64d52640 1 -- 10.20.193.28:0/3284641327 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367e371420 con 0x56367e45dfb0 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.653+0000 7f6c4e7fc640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c3c0b0e20 0x7f6c3c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c64d52640 1 --2- 10.20.193.28:0/3284641327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e469e30 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f6c5410aeb0 tx=0x7f6c5410c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7d84832b1b1da2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c4e7fc640 1 -- 10.20.193.28:0/4267112161 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6c54004860 con 0x7f6c601012e0 2026-02-20T03:39:56.667 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c65d54640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c3c0b0e20 0x7f6c3c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c2dce5640 1 -- 10.20.193.28:0/3284641327 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c540c92e0 con 0x56367e45dfb0 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c2dce5640 1 -- 10.20.193.28:0/3284641327 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6c54033030 con 0x56367e45dfb0 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3284641327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 msgr2=0x56367e469e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c65d54640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c3c0b0e20 0x7f6c3c0b32e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00aab0 tx=0x7f6c5c009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c2dce5640 1 -- 10.20.193.28:0/3284641327 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c540c92e0 con 0x56367e45dfb0 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/3284641327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e469e30 secure :-1 s=READY pgs=2204 cs=0 l=1 rev1=1 crypto rx=0x7f6c5410aeb0 tx=0x7f6c5410c670 comp rx=0 tx=0).stop 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3284641327 shutdown_connections 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/3284641327 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e469e30 unknown :-1 s=CLOSED pgs=2204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/3284641327 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45d630 0x56367e45da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/3284641327 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 0x56367e4633e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.668 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3284641327 >> 10.20.193.28:0/3284641327 conn(0x56367e420290 msgr2=0x56367e45bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3284641327 shutdown_connections 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.659+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3284641327 wait complete. 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 -- start start 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 Processor -- start 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e488d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45dfb0 0x56367e4892a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 0x56367e487510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x56367e3ac8f0 con 0x56367e45d630 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56367e19ef50 con 0x56367e463000 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x56367e487b50 con 0x56367e45dfb0 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c65553640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e488d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:56.669 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c65553640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e488d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55928/0 (socket says 10.20.193.28:55928) 2026-02-20T03:39:56.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c65553640 1 -- 10.20.193.28:0/243663484 learned_addr learned my addr 10.20.193.28:0/243663484 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:56.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c65553640 1 -- 10.20.193.28:0/243663484 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45dfb0 msgr2=0x56367e4892a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:56.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c65553640 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45dfb0 0x56367e4892a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c65553640 1 -- 10.20.193.28:0/243663484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 msgr2=0x56367e487510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:56.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c65553640 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 0x56367e487510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c65553640 1 -- 10.20.193.28:0/243663484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367e480cf0 con 0x56367e45d630 2026-02-20T03:39:56.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c65553640 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e488d60 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009f00 tx=0x7f6c5000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a8a90c134559a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:56.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c1affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c1affd640 1 -- 10.20.193.28:0/243663484 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50016070 con 0x56367e45d630 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c1affd640 1 -- 10.20.193.28:0/243663484 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6c50002780 con 0x56367e45d630 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c1affd640 1 -- 10.20.193.28:0/243663484 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c500117f0 con 0x56367e45d630 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/243663484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56367e181b40 con 0x56367e45d630 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c1affd640 1 -- 10.20.193.28:0/243663484 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6c5001a3b0 con 0x56367e45d630 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 10 client.22254 _ll_register_callbacks cb 0x56367e3e9f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/243663484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56367e3be1a0 con 0x56367e45d630 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c1affd640 1 -- 10.20.193.28:0/243663484 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f6c50004270 con 0x56367e45d630 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 10 client.22254 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:56.677 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/243663484 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x56367e36b230 con 0x56367e45d630 2026-02-20T03:39:56.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c1affd640 1 -- 10.20.193.28:0/243663484 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f6c50023020 con 0x56367e45d630 2026-02-20T03:39:56.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 10 client.22254 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:56.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 10 client.22254 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:56.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 20 client.22254 populate_metadata read hostname 'trial028' 2026-02-20T03:39:56.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56367e497650 0x56367e499af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 4 client.22254 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:39:56.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.660+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/243663484 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56367e3b85b0 con 0x56367e497650 2026-02-20T03:39:56.689 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.687+0000 7f6c64d52640 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56367e497650 0x56367e499af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:56.739 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.25 MB/sec execute 567 sec latency 27001.367 ms 2026-02-20T03:39:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.741+0000 7f6c64d52640 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56367e497650 0x56367e499af0 crc :-1 s=READY pgs=627 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f38ea97a68206ce server_cookie=16ceec8afadbda3a in_seq=0 out_seq=0 2026-02-20T03:39:56.743 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.741+0000 7f6c1affd640 10 client.22254 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:56.757 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:56 trial028 ceph-mon[38552]: scrub queued for path: / 2026-02-20T03:39:56.757 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:56 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:56.757 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:56 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:39:56.757 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:56 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:39:56.757 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:56 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:39:56.757 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:56 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:56.757 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:56 trial028 ceph-mon[38552]: Scrub error on inode 0x10000004a21 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client5/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:39:56.757 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:56 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:56.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.754+0000 7f6c1affd640 1 -- 10.20.193.28:0/243663484 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x56367e3b85b0 con 0x56367e497650 2026-02-20T03:39:56.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.754+0000 7f6c1affd640 10 client.22254 handle_command_reply: tid=0 2026-02-20T03:39:56.758 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.754+0000 7f6c69ce3e00 1 client.22254 shutdown 2026-02-20T03:39:56.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.754+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/243663484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 msgr2=0x56367e488d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:56.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.754+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e488d60 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009f00 tx=0x7f6c5000b4b0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/243663484 shutdown_connections 2026-02-20T03:39:56.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56367e497650 0x56367e499af0 crc :-1 s=READY pgs=627 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 0x56367e487510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.759 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45dfb0 0x56367e4892a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/243663484 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e488d60 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/243663484 >> 10.20.193.28:0/243663484 conn(0x56367e420290 msgr2=0x56367e45c440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:56.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c1affd640 0 client.22254 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:56.768 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/243663484 shutdown_connections 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/243663484 wait complete. 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.755+0000 7f6c69ce3e00 20 client.22254 trim_cache size 0 max 16384 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c69ce3e00 1 Processor -- start 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c69ce3e00 1 -- start start 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e45c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45dfb0 0x56367e45ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 0x56367e484aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c012730 con 0x56367e45d630 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c00ff70 con 0x56367e463000 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c00ddc0 con 0x56367e45dfb0 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c65553640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e45c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:56.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c65553640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e45c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55930/0 (socket says 10.20.193.28:55930) 2026-02-20T03:39:56.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c65553640 1 -- 10.20.193.28:0/3820225454 learned_addr learned my addr 10.20.193.28:0/3820225454 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:56.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c65553640 1 -- 10.20.193.28:0/3820225454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45dfb0 msgr2=0x56367e45ca60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:56.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c65553640 1 --2- 10.20.193.28:0/3820225454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45dfb0 0x56367e45ca60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c65553640 1 -- 10.20.193.28:0/3820225454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 msgr2=0x56367e484aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:56.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c65553640 1 --2- 10.20.193.28:0/3820225454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 0x56367e484aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.770 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c65553640 1 -- 10.20.193.28:0/3820225454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367e480b20 con 0x56367e45d630 2026-02-20T03:39:56.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c65553640 1 --2- 10.20.193.28:0/3820225454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e45c520 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f6c500097c0 tx=0x7f6c50019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3fa669e891e9e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:56.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.761+0000 7f6c2d4e4640 1 -- 10.20.193.28:0/3820225454 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5002a070 con 0x56367e45d630 2026-02-20T03:39:56.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c2d4e4640 1 -- 10.20.193.28:0/3820225454 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x56367e3be1a0 con 0x56367e45d630 2026-02-20T03:39:56.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c2d4e4640 1 -- 10.20.193.28:0/3820225454 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50016030 con 0x56367e45d630 2026-02-20T03:39:56.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3820225454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 msgr2=0x56367e45c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:56.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/3820225454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e45c520 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f6c500097c0 tx=0x7f6c50019000 comp rx=0 tx=0).stop 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3820225454 shutdown_connections 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/3820225454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e463000 0x56367e484aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/3820225454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e45dfb0 0x56367e45ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/3820225454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45d630 0x56367e45c520 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3820225454 >> 10.20.193.28:0/3820225454 conn(0x56367e420290 msgr2=0x56367e488d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3820225454 shutdown_connections 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.765+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/3820225454 wait complete. 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c69ce3e00 1 -- start start 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c69ce3e00 1 Processor -- start 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e45d630 0x56367e48f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e48bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c69ce3e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e463000 0x56367e48c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c00e430 con 0x56367e45dfb0 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c00f8a0 con 0x56367e45d630 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c69ce3e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c00eb00 con 0x56367e463000 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c64d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e48bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c64d52640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e48bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55936/0 (socket says 10.20.193.28:55936) 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c64d52640 1 -- 10.20.193.28:0/2158040249 learned_addr learned my addr 10.20.193.28:0/2158040249 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c64d52640 1 -- 10.20.193.28:0/2158040249 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e463000 msgr2=0x56367e48c170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c64d52640 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e463000 0x56367e48c170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c64d52640 1 -- 10.20.193.28:0/2158040249 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e45d630 msgr2=0x56367e48f310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c64d52640 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e45d630 0x56367e48f310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c64d52640 1 -- 10.20.193.28:0/2158040249 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56367e08f870 con 0x56367e45dfb0 2026-02-20T03:39:56.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c64d52640 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e48bc30 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f6c54002410 tx=0x7f6c540053d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e8e3a5efd2d4b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.766+0000 7f6c1affd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c1affd640 1 -- 10.20.193.28:0/2158040249 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54047070 con 0x56367e45dfb0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c1affd640 1 -- 10.20.193.28:0/2158040249 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f6c5410a300 con 0x56367e45dfb0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c1affd640 1 -- 10.20.193.28:0/2158040249 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c540ccb90 con 0x56367e45dfb0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/2158040249 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56367e350440 con 0x56367e45dfb0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c1affd640 1 -- 10.20.193.28:0/2158040249 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f6c54005030 con 0x56367e45dfb0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 10 client.22260 _ll_register_callbacks cb 0x7f6c50009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/2158040249 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56367e362b00 con 0x56367e45dfb0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c1affd640 1 -- 10.20.193.28:0/2158040249 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f6c540ccd70 con 0x56367e45dfb0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 10 client.22260 fetch_fsmap learned FSMap version 59 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/2158040249 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x56367e481810 con 0x56367e45dfb0 2026-02-20T03:39:56.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c1affd640 1 -- 10.20.193.28:0/2158040249 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f6c540f3030 con 0x56367e45dfb0 2026-02-20T03:39:56.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 10 client.22260 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:39:56.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 10 client.22260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:39:56.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 20 client.22260 populate_metadata read hostname 'trial028' 2026-02-20T03:39:56.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56367e503210 0x56367e5056d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:39:56.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 4 client.22260 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:39:56.784 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.768+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/2158040249 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f6c54033030 con 0x56367e503210 2026-02-20T03:39:56.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.795+0000 7f6c65553640 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56367e503210 0x56367e5056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:39:56.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.862+0000 7f6c65553640 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56367e503210 0x56367e5056d0 crc :-1 s=READY pgs=628 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ba367d8fb626a81 server_cookie=5548a848551f1c89 in_seq=0 out_seq=0 2026-02-20T03:39:56.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.862+0000 7f6c1affd640 10 client.22260 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:56.877 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c1affd640 1 -- 10.20.193.28:0/2158040249 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x7f6c54033030 con 0x56367e503210 2026-02-20T03:39:56.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c1affd640 10 client.22260 handle_command_reply: tid=0 2026-02-20T03:39:56.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 client.22260 shutdown 2026-02-20T03:39:56.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/2158040249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 msgr2=0x56367e48bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:56.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e48bc30 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f6c54002410 tx=0x7f6c540053d0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/2158040249 shutdown_connections 2026-02-20T03:39:56.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x56367e503210 0x56367e5056d0 crc :-1 s=READY pgs=628 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x56367e463000 0x56367e48c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x56367e45dfb0 0x56367e48bc30 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 --2- 10.20.193.28:0/2158040249 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x56367e45d630 0x56367e48f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/2158040249 >> 10.20.193.28:0/2158040249 conn(0x56367e420290 msgr2=0x56367e485c80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:56.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c1affd640 0 client.22260 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:39:56.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/2158040249 shutdown_connections 2026-02-20T03:39:56.879 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 1 -- 10.20.193.28:0/2158040249 wait complete. 2026-02-20T03:39:56.891 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.875+0000 7f6c69ce3e00 20 client.22260 trim_cache size 0 max 16384 2026-02-20T03:39:56.891 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:39:56.891 INFO:teuthology.orchestra.run.trial028.stdout: "status": "scrub active (1 inodes in the stack)", 2026-02-20T03:39:56.891 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:39:56.891 INFO:teuthology.orchestra.run.trial028.stdout: "3590b345-cd20-45f5-8dac-0c62d0d24d0c": { 2026-02-20T03:39:56.891 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:39:56.892 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "3590b345-cd20-45f5-8dac-0c62d0d24d0c", 2026-02-20T03:39:56.892 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:39:56.892 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:39:56.892 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:39:56.892 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 -- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c3c0b0e20 msgr2=0x7f6c3c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c3c0b0e20 0x7f6c3c0b32e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00aab0 tx=0x7f6c5c009250 comp rx=0 tx=0).stop 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 -- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 msgr2=0x7f6c60104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 0x7f6c60104a00 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f6c54002910 tx=0x7f6c54002940 comp rx=0 tx=0).stop 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 -- 10.20.193.28:0/4267112161 shutdown_connections 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f6c3c0b0e20 0x7f6c3c0b32e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f6c6010efb0 0x7f6c60104f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f6c601012e0 0x7f6c60104a00 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 --2- 10.20.193.28:0/4267112161 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f6c601009c0 0x7f6c601044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:39:56.893 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 -- 10.20.193.28:0/4267112161 >> 10.20.193.28:0/4267112161 conn(0x7f6c600fc5f0 msgr2=0x7f6c6010f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:39:56.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 -- 10.20.193.28:0/4267112161 shutdown_connections 2026-02-20T03:39:56.894 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:39:56.876+0000 7f6c66555640 1 -- 10.20.193.28:0/4267112161 wait complete. 2026-02-20T03:39:57.047 INFO:tasks.cephfs.filesystem:scrub status for tag:3590b345-cd20-45f5-8dac-0c62d0d24d0c - {'path': '/', 'tag': '3590b345-cd20-45f5-8dac-0c62d0d24d0c', 'options': 'recursive,force'} 2026-02-20T03:39:57.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:56 trial126 ceph-mon[38476]: scrub queued for path: / 2026-02-20T03:39:57.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:56 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:57.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:56 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:39:57.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:56 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:39:57.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:56 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:39:57.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:56 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:57.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:56 trial126 ceph-mon[38476]: Scrub error on inode 0x10000004a21 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client5/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:39:57.096 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:56 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:56 trial177 ceph-mon[43181]: scrub queued for path: / 2026-02-20T03:39:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:56 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:56 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:39:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:56 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:39:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:56 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:39:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:56 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:56 trial177 ceph-mon[43181]: Scrub error on inode 0x10000004a21 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client5/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:39:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:56 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:39:57.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274134 20.22 MB/sec execute 568 sec latency 28001.417 ms 2026-02-20T03:39:57.812 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:57 trial028 ceph-mon[38552]: pgmap v944: 129 pgs: 129 active+clean; 849 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 234 KiB/s rd, 10 MiB/s wr, 293 op/s 2026-02-20T03:39:58.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:57 trial126 ceph-mon[38476]: pgmap v944: 129 pgs: 129 active+clean; 849 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 234 KiB/s rd, 10 MiB/s wr, 293 op/s 2026-02-20T03:39:58.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:57 trial177 ceph-mon[43181]: pgmap v944: 129 pgs: 129 active+clean; 849 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 234 KiB/s rd, 10 MiB/s wr, 293 op/s 2026-02-20T03:39:58.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274135 20.18 MB/sec execute 569 sec latency 29001.458 ms 2026-02-20T03:39:59.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274135 20.14 MB/sec execute 570 sec latency 30001.515 ms 2026-02-20T03:39:59.850 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:39:59 trial028 ceph-mon[38552]: pgmap v945: 129 pgs: 129 active+clean; 851 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 250 KiB/s rd, 10 MiB/s wr, 330 op/s 2026-02-20T03:40:00.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:39:59 trial126 ceph-mon[38476]: pgmap v945: 129 pgs: 129 active+clean; 851 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 250 KiB/s rd, 10 MiB/s wr, 330 op/s 2026-02-20T03:40:00.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:39:59 trial177 ceph-mon[43181]: pgmap v945: 129 pgs: 129 active+clean; 851 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 250 KiB/s rd, 10 MiB/s wr, 330 op/s 2026-02-20T03:40:00.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274135 20.11 MB/sec execute 571 sec latency 31001.572 ms 2026-02-20T03:40:00.850 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 -- 10.20.193.28:0/406444269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0105b10 msgr2=0x7f56c0105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:00.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 --2- 10.20.193.28:0/406444269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0105b10 0x7f56c0105f90 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009a30 tx=0x7f56b002f260 comp rx=0 tx=0).stop 2026-02-20T03:40:00.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 -- 10.20.193.28:0/406444269 shutdown_connections 2026-02-20T03:40:00.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 --2- 10.20.193.28:0/406444269 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56c01064d0 0x7f56c010cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 --2- 10.20.193.28:0/406444269 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0105b10 0x7f56c0105f90 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 --2- 10.20.193.28:0/406444269 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56c0104920 0x7f56c0104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.851 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 -- 10.20.193.28:0/406444269 >> 10.20.193.28:0/406444269 conn(0x7f56c0100080 msgr2=0x7f56c01024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:00.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 -- 10.20.193.28:0/406444269 shutdown_connections 2026-02-20T03:40:00.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 -- 10.20.193.28:0/406444269 wait complete. 2026-02-20T03:40:00.853 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 Processor -- start 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 -- start start 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0104920 0x7f56c019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56c0105b10 0x7f56c019d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56c01064d0 0x7f56c01a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f56c0110530 con 0x7f56c0104920 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f56c01103b0 con 0x7f56c0105b10 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.848+0000 7f56c4892640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f56c01106b0 con 0x7f56c01064d0 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0104920 0x7f56c019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0104920 0x7f56c019cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55950/0 (socket says 10.20.193.28:55950) 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bf7fe640 1 -- 10.20.193.28:0/592741005 learned_addr learned my addr 10.20.193.28:0/592741005 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bf7fe640 1 -- 10.20.193.28:0/592741005 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56c01064d0 msgr2=0x7f56c01a40f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:40:00.854 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56c01064d0 0x7f56c01a40f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bf7fe640 1 -- 10.20.193.28:0/592741005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56c0105b10 msgr2=0x7f56c019d080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:40:00.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56c0105b10 0x7f56c019d080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bf7fe640 1 -- 10.20.193.28:0/592741005 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c01a47f0 con 0x7f56c0104920 2026-02-20T03:40:00.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0104920 0x7f56c019cb40 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00b750 tx=0x7f56ac00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:00.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bcff9640 1 -- 10.20.193.28:0/592741005 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac004480 con 0x7f56c0104920 2026-02-20T03:40:00.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bcff9640 1 -- 10.20.193.28:0/592741005 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56ac010070 con 0x7f56c0104920 2026-02-20T03:40:00.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bcff9640 1 -- 10.20.193.28:0/592741005 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac00ca90 con 0x7f56c0104920 2026-02-20T03:40:00.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56c4892640 1 -- 10.20.193.28:0/592741005 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c01a4ae0 con 0x7f56c0104920 2026-02-20T03:40:00.855 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56c4892640 1 -- 10.20.193.28:0/592741005 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c01a4fe0 con 0x7f56c0104920 2026-02-20T03:40:00.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.849+0000 7f56bcff9640 1 -- 10.20.193.28:0/592741005 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f56ac01d030 con 0x7f56c0104920 2026-02-20T03:40:00.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.855+0000 7f56c8a59e00 1 Processor -- start 2026-02-20T03:40:00.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56bcff9640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56940b0e20 0x7f56940b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56bcff9640 1 -- 10.20.193.28:0/592741005 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f56ac0df900 con 0x7f56c0104920 2026-02-20T03:40:00.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56c8a59e00 1 -- start start 2026-02-20T03:40:00.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56bffff640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56940b0e20 0x7f56940b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:00.861 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a5e80 0x5592c28a6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 0x5592c28aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592c27f68f0 con 0x5592c28ab560 2026-02-20T03:40:00.862 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5592c27a42e0 con 0x5592c28a5e80 2026-02-20T03:40:00.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5592c27f2820 con 0x5592c28a67c0 2026-02-20T03:40:00.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.857+0000 7f56bffff640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56940b0e20 0x7f56940b32e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f56b400ab30 tx=0x7f56b4009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:00.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f56bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:00.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f56bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28ad9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55958/0 (socket says 10.20.193.28:55958) 2026-02-20T03:40:00.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f56bffff640 1 -- 10.20.193.28:0/2875270981 learned_addr learned my addr 10.20.193.28:0/2875270981 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:00.867 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f56bffff640 1 -- 10.20.193.28:0/2875270981 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 msgr2=0x5592c28aaf40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f56bffff640 1 --2- 10.20.193.28:0/2875270981 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 0x5592c28aaf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f56bffff640 1 -- 10.20.193.28:0/2875270981 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a5e80 msgr2=0x5592c28a6280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f56bffff640 1 --2- 10.20.193.28:0/2875270981 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a5e80 0x5592c28a6280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f56bffff640 1 -- 10.20.193.28:0/2875270981 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c27965a0 con 0x5592c28ab560 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f56bffff640 1 --2- 10.20.193.28:0/2875270981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28ad9f0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f56b4002b30 tx=0x7f56b400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26200ffd6d74022f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f5683fff640 1 -- 10.20.193.28:0/2875270981 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4006e60 con 0x5592c28ab560 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f5683fff640 1 -- 10.20.193.28:0/2875270981 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56b401f020 con 0x5592c28ab560 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.858+0000 7f5683fff640 1 -- 10.20.193.28:0/2875270981 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b400d750 con 0x5592c28ab560 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2875270981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 msgr2=0x5592c28ad9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2875270981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28ad9f0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f56b4002b30 tx=0x7f56b400f000 comp rx=0 tx=0).stop 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2875270981 shutdown_connections 2026-02-20T03:40:00.868 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2875270981 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28ad9f0 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2875270981 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 0x5592c28aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2875270981 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a5e80 0x5592c28a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2875270981 >> 10.20.193.28:0/2875270981 conn(0x5592c289d6f0 msgr2=0x5592c28a4570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2875270981 shutdown_connections 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2875270981 wait complete. 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.859+0000 7f56c8a59e00 1 -- start start 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 Processor -- start 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a67c0 0x5592c28c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28ab560 0x5592c28ce900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5592c279e0c0 con 0x5592c28a5e80 2026-02-20T03:40:00.869 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5592c28b7020 con 0x5592c28a67c0 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5592c28cee90 con 0x5592c28ab560 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55964/0 (socket says 10.20.193.28:55964) 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56bf7fe640 1 -- 10.20.193.28:0/2091891683 learned_addr learned my addr 10.20.193.28:0/2091891683 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56bf7fe640 1 -- 10.20.193.28:0/2091891683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28ab560 msgr2=0x5592c28ce900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28ab560 0x5592c28ce900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56bf7fe640 1 -- 10.20.193.28:0/2091891683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a67c0 msgr2=0x5592c28c7980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a67c0 0x5592c28c7980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56bf7fe640 1 -- 10.20.193.28:0/2091891683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c28c0b90 con 0x5592c28a5e80 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28c7440 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0a4600 tx=0x7f56ac0a7e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1a5214f79fdaeb server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:00.870 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f5689ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f5689ffb640 1 -- 10.20.193.28:0/2091891683 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac012b80 con 0x5592c28a5e80 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2091891683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592c27b2820 con 0x5592c28a5e80 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f5689ffb640 1 -- 10.20.193.28:0/2091891683 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56ac0cd070 con 0x5592c28a5e80 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f5689ffb640 1 -- 10.20.193.28:0/2091891683 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0a2f40 con 0x5592c28a5e80 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 10 client.22272 _ll_register_callbacks cb 0x5592c27a1ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2091891683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5592c27fe4e0 con 0x5592c28a5e80 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f5689ffb640 1 -- 10.20.193.28:0/2091891683 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f56ac0a6060 con 0x5592c28a5e80 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f5689ffb640 1 -- 10.20.193.28:0/2091891683 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f56ac0a6340 con 0x5592c28a5e80 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 10 client.22272 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2091891683 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5592c27b7380 con 0x5592c28a5e80 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f5689ffb640 1 -- 10.20.193.28:0/2091891683 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f56ac0c8300 con 0x5592c28a5e80 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 10 client.22272 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:00.871 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 10 client.22272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:00.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 20 client.22272 populate_metadata read hostname 'trial028' 2026-02-20T03:40:00.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592c28d3270 0x5592c28d5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 4 client.22272 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:40:00.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.861+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2091891683 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592c2778bd0 con 0x5592c28d3270 2026-02-20T03:40:00.872 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.864+0000 7f56beffd640 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592c28d3270 0x5592c28d5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:00.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.891+0000 7f56beffd640 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592c28d3270 0x5592c28d5710 crc :-1 s=READY pgs=629 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c425c098049d2a9 server_cookie=995b1464efc5fd0b in_seq=0 out_seq=0 2026-02-20T03:40:00.894 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.891+0000 7f5689ffb640 10 client.22272 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:00.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f5689ffb640 1 -- 10.20.193.28:0/2091891683 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5592c2778bd0 con 0x5592c28d3270 2026-02-20T03:40:00.907 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f5689ffb640 10 client.22272 handle_command_reply: tid=0 2026-02-20T03:40:00.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 client.22272 shutdown 2026-02-20T03:40:00.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2091891683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 msgr2=0x5592c28c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:00.908 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28c7440 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0a4600 tx=0x7f56ac0a7e30 comp rx=0 tx=0).stop 2026-02-20T03:40:00.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2091891683 shutdown_connections 2026-02-20T03:40:00.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592c28d3270 0x5592c28d5710 crc :-1 s=READY pgs=629 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28ab560 0x5592c28ce900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a67c0 0x5592c28c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.909 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/2091891683 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28c7440 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f5689ffb640 0 client.22272 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:00.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2091891683 >> 10.20.193.28:0/2091891683 conn(0x5592c289d6f0 msgr2=0x5592c28ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:00.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2091891683 shutdown_connections 2026-02-20T03:40:00.910 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 1 -- 10.20.193.28:0/2091891683 wait complete. 2026-02-20T03:40:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.905+0000 7f56c8a59e00 20 client.22272 trim_cache size 0 max 16384 2026-02-20T03:40:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 Processor -- start 2026-02-20T03:40:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 -- start start 2026-02-20T03:40:00.922 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a5e80 0x5592c28a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 0x5592c28ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28a7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5660012700 con 0x5592c28ab560 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f566000ff40 con 0x5592c28a5e80 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f566000dd90 con 0x5592c28a67c0 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56bffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28a7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55978/0 (socket says 10.20.193.28:55978) 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56bffff640 1 -- 10.20.193.28:0/1281389287 learned_addr learned my addr 10.20.193.28:0/1281389287 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56bffff640 1 -- 10.20.193.28:0/1281389287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 msgr2=0x5592c28ce8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56bffff640 1 --2- 10.20.193.28:0/1281389287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 0x5592c28ce8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.923 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56bffff640 1 -- 10.20.193.28:0/1281389287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a5e80 msgr2=0x5592c28a6ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56bffff640 1 --2- 10.20.193.28:0/1281389287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a5e80 0x5592c28a6ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56bffff640 1 -- 10.20.193.28:0/1281389287 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c28c09c0 con 0x5592c28ab560 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56bffff640 1 --2- 10.20.193.28:0/1281389287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28a7420 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f56b4004bd0 tx=0x7f56b4006f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81172c282c76d4f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56837fe640 1 -- 10.20.193.28:0/1281389287 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b401e070 con 0x5592c28ab560 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56837fe640 1 -- 10.20.193.28:0/1281389287 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56b4011070 con 0x5592c28ab560 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56837fe640 1 -- 10.20.193.28:0/1281389287 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4024760 con 0x5592c28ab560 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1281389287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 msgr2=0x5592c28a7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1281389287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28a7420 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f56b4004bd0 tx=0x7f56b4006f60 comp rx=0 tx=0).stop 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1281389287 shutdown_connections 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1281389287 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28ab560 0x5592c28a7420 unknown :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1281389287 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 0x5592c28ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.924 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1281389287 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28a5e80 0x5592c28a6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1281389287 >> 10.20.193.28:0/1281389287 conn(0x5592c289d6f0 msgr2=0x5592c28c3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1281389287 shutdown_connections 2026-02-20T03:40:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.916+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1281389287 wait complete. 2026-02-20T03:40:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 -- start start 2026-02-20T03:40:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 Processor -- start 2026-02-20T03:40:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.925 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 0x5592c28cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.926 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28ab560 0x5592c28cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f566000e400 con 0x5592c28a5e80 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f566000f870 con 0x5592c28ab560 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f566000ead0 con 0x5592c28a67c0 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56bf7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:55980/0 (socket says 10.20.193.28:55980) 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56bf7fe640 1 -- 10.20.193.28:0/1035998497 learned_addr learned my addr 10.20.193.28:0/1035998497 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56bf7fe640 1 -- 10.20.193.28:0/1035998497 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 msgr2=0x5592c28cb010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 0x5592c28cb010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56bf7fe640 1 -- 10.20.193.28:0/1035998497 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28ab560 msgr2=0x5592c28cdbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28ab560 0x5592c28cdbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56bf7fe640 1 -- 10.20.193.28:0/1035998497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c2556690 con 0x5592c28a5e80 2026-02-20T03:40:00.927 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56bf7fe640 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28caad0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0a3410 tx=0x7f56ac0ae020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d145f94f4e56af server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f5689ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f5689ffb640 1 -- 10.20.193.28:0/1035998497 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0a6900 con 0x5592c28a5e80 2026-02-20T03:40:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f5689ffb640 1 -- 10.20.193.28:0/1035998497 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f56ac0cd070 con 0x5592c28a5e80 2026-02-20T03:40:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1035998497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592c27bbb70 con 0x5592c28a5e80 2026-02-20T03:40:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f5689ffb640 1 -- 10.20.193.28:0/1035998497 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac005be0 con 0x5592c28a5e80 2026-02-20T03:40:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f5689ffb640 1 -- 10.20.193.28:0/1035998497 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f56ac005d80 con 0x5592c28a5e80 2026-02-20T03:40:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f5689ffb640 10 client.22278 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:40:00.936 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 10 client.22278 _ll_register_callbacks cb 0x7f56ac0a6b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1035998497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56b401f020 con 0x5592c28a5e80 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.919+0000 7f5689ffb640 1 -- 10.20.193.28:0/1035998497 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f56ac0acb20 con 0x5592c28a5e80 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.924+0000 7f56c8a59e00 10 client.22278 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.924+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1035998497 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5592c28c16b0 con 0x5592c28a5e80 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.924+0000 7f5689ffb640 1 -- 10.20.193.28:0/1035998497 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f56ac0a2d00 con 0x5592c28a5e80 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.924+0000 7f56c8a59e00 10 client.22278 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.924+0000 7f56c8a59e00 10 client.22278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.924+0000 7f56c8a59e00 20 client.22278 populate_metadata read hostname 'trial028' 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.924+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592c293e6d0 0x5592c2940b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.924+0000 7f56c8a59e00 4 client.22278 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.924+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1035998497 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5592c27c76b0 con 0x5592c293e6d0 2026-02-20T03:40:00.937 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.933+0000 7f56beffd640 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592c293e6d0 0x5592c2940b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:00.963 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:00 trial028 ceph-mon[38552]: overall HEALTH_OK 2026-02-20T03:40:00.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.974+0000 7f5689ffb640 10 client.22278 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:00.977 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:00.974+0000 7f56beffd640 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592c293e6d0 0x5592c2940b90 crc :-1 s=READY pgs=630 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d15ecc4f87f724bb server_cookie=ea7e6129f44456cf in_seq=0 out_seq=0 2026-02-20T03:40:01.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.085+0000 7f5689ffb640 1 -- 10.20.193.28:0/1035998497 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5592c27c76b0 con 0x5592c293e6d0 2026-02-20T03:40:01.088 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.085+0000 7f5689ffb640 10 client.22278 handle_command_reply: tid=0 2026-02-20T03:40:01.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.085+0000 7f56c8a59e00 1 client.22278 shutdown 2026-02-20T03:40:01.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1035998497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 msgr2=0x5592c28caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:01.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28caad0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7f56ac0a3410 tx=0x7f56ac0ae020 comp rx=0 tx=0).stop 2026-02-20T03:40:01.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1035998497 shutdown_connections 2026-02-20T03:40:01.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5592c293e6d0 0x5592c2940b90 crc :-1 s=READY pgs=630 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:01.090 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5592c28ab560 0x5592c28cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:01.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5592c28a67c0 0x5592c28cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:01.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 --2- 10.20.193.28:0/1035998497 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5592c28a5e80 0x5592c28caad0 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:01.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1035998497 >> 10.20.193.28:0/1035998497 conn(0x5592c289d6f0 msgr2=0x5592c28c44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:01.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f5689ffb640 0 client.22278 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:01.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1035998497 shutdown_connections 2026-02-20T03:40:01.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 1 -- 10.20.193.28:0/1035998497 wait complete. 2026-02-20T03:40:01.091 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c8a59e00 20 client.22278 trim_cache size 0 max 16384 2026-02-20T03:40:01.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:00 trial126 ceph-mon[38476]: overall HEALTH_OK 2026-02-20T03:40:01.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:40:01.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:40:01.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:40:01.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:40:01.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 -- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56940b0e20 msgr2=0x7f56940b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:01.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56940b0e20 0x7f56940b32e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f56b400ab30 tx=0x7f56b4009250 comp rx=0 tx=0).stop 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 -- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0104920 msgr2=0x7f56c019cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0104920 0x7f56c019cb40 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00b750 tx=0x7f56ac00bc20 comp rx=0 tx=0).stop 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 -- 10.20.193.28:0/592741005 shutdown_connections 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f56940b0e20 0x7f56940b32e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f56c01064d0 0x7f56c01a40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f56c0105b10 0x7f56c019d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 --2- 10.20.193.28:0/592741005 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f56c0104920 0x7f56c019cb40 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 -- 10.20.193.28:0/592741005 >> 10.20.193.28:0/592741005 conn(0x7f56c0100080 msgr2=0x7f56c0108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 -- 10.20.193.28:0/592741005 shutdown_connections 2026-02-20T03:40:01.103 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:01.086+0000 7f56c4892640 1 -- 10.20.193.28:0/592741005 wait complete. 2026-02-20T03:40:01.118 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:00 trial177 ceph-mon[43181]: overall HEALTH_OK 2026-02-20T03:40:01.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274135 20.07 MB/sec execute 572 sec latency 32001.614 ms 2026-02-20T03:40:01.829 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:01 trial028 ceph-mon[38552]: pgmap v946: 129 pgs: 129 active+clean; 861 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 319 KiB/s rd, 11 MiB/s wr, 401 op/s 2026-02-20T03:40:01.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:01 trial177 ceph-mon[43181]: pgmap v946: 129 pgs: 129 active+clean; 861 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 319 KiB/s rd, 11 MiB/s wr, 401 op/s 2026-02-20T03:40:02.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:01 trial126 ceph-mon[38476]: pgmap v946: 129 pgs: 129 active+clean; 861 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 319 KiB/s rd, 11 MiB/s wr, 401 op/s 2026-02-20T03:40:02.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274135 20.04 MB/sec execute 573 sec latency 33001.668 ms 2026-02-20T03:40:03.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274136 20.00 MB/sec execute 574 sec latency 33514.546 ms 2026-02-20T03:40:03.998 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:03 trial028 ceph-mon[38552]: pgmap v947: 129 pgs: 129 active+clean; 860 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 477 KiB/s rd, 11 MiB/s wr, 393 op/s 2026-02-20T03:40:04.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:03 trial126 ceph-mon[38476]: pgmap v947: 129 pgs: 129 active+clean; 860 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 477 KiB/s rd, 11 MiB/s wr, 393 op/s 2026-02-20T03:40:04.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:03 trial177 ceph-mon[43181]: pgmap v947: 129 pgs: 129 active+clean; 860 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 477 KiB/s rd, 11 MiB/s wr, 393 op/s 2026-02-20T03:40:04.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274136 19.97 MB/sec execute 575 sec latency 26544.782 ms 2026-02-20T03:40:05.133 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:04 trial028 ceph-mon[38552]: pgmap v948: 129 pgs: 129 active+clean; 848 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 656 KiB/s rd, 10 MiB/s wr, 418 op/s 2026-02-20T03:40:05.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:04 trial177 ceph-mon[43181]: pgmap v948: 129 pgs: 129 active+clean; 848 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 656 KiB/s rd, 10 MiB/s wr, 418 op/s 2026-02-20T03:40:05.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:04 trial126 ceph-mon[38476]: pgmap v948: 129 pgs: 129 active+clean; 848 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 656 KiB/s rd, 10 MiB/s wr, 418 op/s 2026-02-20T03:40:05.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274136 19.93 MB/sec execute 576 sec latency 27544.821 ms 2026-02-20T03:40:06.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274136 19.90 MB/sec execute 577 sec latency 28544.872 ms 2026-02-20T03:40:07.647 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:07 trial028 ceph-mon[38552]: pgmap v949: 129 pgs: 129 active+clean; 823 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 635 KiB/s rd, 9.0 MiB/s wr, 412 op/s 2026-02-20T03:40:07.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274136 19.87 MB/sec execute 578 sec latency 29544.918 ms 2026-02-20T03:40:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:07 trial126 ceph-mon[38476]: pgmap v949: 129 pgs: 129 active+clean; 823 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 635 KiB/s rd, 9.0 MiB/s wr, 412 op/s 2026-02-20T03:40:07.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:07 trial177 ceph-mon[43181]: pgmap v949: 129 pgs: 129 active+clean; 823 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 635 KiB/s rd, 9.0 MiB/s wr, 412 op/s 2026-02-20T03:40:08.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274136 19.83 MB/sec execute 579 sec latency 30544.974 ms 2026-02-20T03:40:09.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274136 19.80 MB/sec execute 580 sec latency 31545.054 ms 2026-02-20T03:40:09.865 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:09 trial028 ceph-mon[38552]: pgmap v950: 129 pgs: 129 active+clean; 809 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 667 KiB/s rd, 7.1 MiB/s wr, 366 op/s 2026-02-20T03:40:09.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:09 trial177 ceph-mon[43181]: pgmap v950: 129 pgs: 129 active+clean; 809 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 667 KiB/s rd, 7.1 MiB/s wr, 366 op/s 2026-02-20T03:40:10.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:09 trial126 ceph-mon[38476]: pgmap v950: 129 pgs: 129 active+clean; 809 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 667 KiB/s rd, 7.1 MiB/s wr, 366 op/s 2026-02-20T03:40:10.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274136 19.76 MB/sec execute 581 sec latency 32545.099 ms 2026-02-20T03:40:11.738 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:11 trial028 ceph-mon[38552]: pgmap v951: 129 pgs: 129 active+clean; 770 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 667 KiB/s rd, 5.7 MiB/s wr, 361 op/s 2026-02-20T03:40:11.750 INFO:tasks.workunit.client.0.trial028.stdout: 10 274136 19.73 MB/sec execute 582 sec latency 33545.136 ms 2026-02-20T03:40:11.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:11 trial177 ceph-mon[43181]: pgmap v951: 129 pgs: 129 active+clean; 770 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 667 KiB/s rd, 5.7 MiB/s wr, 361 op/s 2026-02-20T03:40:12.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:11 trial126 ceph-mon[38476]: pgmap v951: 129 pgs: 129 active+clean; 770 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 667 KiB/s rd, 5.7 MiB/s wr, 361 op/s 2026-02-20T03:40:12.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.70 MB/sec execute 583 sec latency 34545.175 ms 2026-02-20T03:40:13.740 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.66 MB/sec execute 584 sec latency 35545.213 ms 2026-02-20T03:40:13.903 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:13 trial028 ceph-mon[38552]: pgmap v952: 129 pgs: 129 active+clean; 749 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 598 KiB/s rd, 3.1 MiB/s wr, 286 op/s 2026-02-20T03:40:13.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:13 trial177 ceph-mon[43181]: pgmap v952: 129 pgs: 129 active+clean; 749 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 598 KiB/s rd, 3.1 MiB/s wr, 286 op/s 2026-02-20T03:40:14.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:13 trial126 ceph-mon[38476]: pgmap v952: 129 pgs: 129 active+clean; 749 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 598 KiB/s rd, 3.1 MiB/s wr, 286 op/s 2026-02-20T03:40:14.170 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 -- 10.20.193.28:0/899133935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 msgr2=0x7fd588079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:14.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 --2- 10.20.193.28:0/899133935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 0x7fd588079150 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009a30 tx=0x7fd57c02f260 comp rx=0 tx=0).stop 2026-02-20T03:40:14.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 -- 10.20.193.28:0/899133935 shutdown_connections 2026-02-20T03:40:14.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 --2- 10.20.193.28:0/899133935 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd588079690 0x7fd588079f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 --2- 10.20.193.28:0/899133935 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 0x7fd588079150 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 --2- 10.20.193.28:0/899133935 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd588077ab0 0x7fd588077eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.171 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 -- 10.20.193.28:0/899133935 >> 10.20.193.28:0/899133935 conn(0x7fd5881000c0 msgr2=0x7fd588102500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:14.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 -- 10.20.193.28:0/899133935 shutdown_connections 2026-02-20T03:40:14.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 -- 10.20.193.28:0/899133935 wait complete. 2026-02-20T03:40:14.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.168+0000 7fd58ff87640 1 Processor -- start 2026-02-20T03:40:14.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58ff87640 1 -- start start 2026-02-20T03:40:14.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58ff87640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd588077ab0 0x7fd5881a1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58ff87640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 0x7fd5881a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58ff87640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd588079690 0x7fd5881a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58ff87640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd588114a70 con 0x7fd588078cf0 2026-02-20T03:40:14.173 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58ff87640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd5881148f0 con 0x7fd588077ab0 2026-02-20T03:40:14.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58ff87640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd588114bf0 con 0x7fd588079690 2026-02-20T03:40:14.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58d4fb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 0x7fd5881a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:14.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58d4fb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 0x7fd5881a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42378/0 (socket says 10.20.193.28:42378) 2026-02-20T03:40:14.174 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58d4fb640 1 -- 10.20.193.28:0/3324193997 learned_addr learned my addr 10.20.193.28:0/3324193997 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:14.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58d4fb640 1 -- 10.20.193.28:0/3324193997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd588079690 msgr2=0x7fd5881a86c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:40:14.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd588079690 0x7fd5881a86c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.179 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58d4fb640 1 -- 10.20.193.28:0/3324193997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd588077ab0 msgr2=0x7fd5881a1110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd588077ab0 0x7fd5881a1110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58d4fb640 1 -- 10.20.193.28:0/3324193997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5881a8dc0 con 0x7fd588078cf0 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 0x7fd5881a1650 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009950 tx=0x7fd57c02fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd576ffd640 1 -- 10.20.193.28:0/3324193997 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c004240 con 0x7fd588078cf0 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd576ffd640 1 -- 10.20.193.28:0/3324193997 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd57c0043e0 con 0x7fd588078cf0 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd58ff87640 1 -- 10.20.193.28:0/3324193997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5881a9050 con 0x7fd588078cf0 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.169+0000 7fd576ffd640 1 -- 10.20.193.28:0/3324193997 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c042b30 con 0x7fd588078cf0 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.171+0000 7fd58ff87640 1 -- 10.20.193.28:0/3324193997 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5881a9610 con 0x7fd588078cf0 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.171+0000 7fd576ffd640 1 -- 10.20.193.28:0/3324193997 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fd57c042cd0 con 0x7fd588078cf0 2026-02-20T03:40:14.180 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd592deae00 1 Processor -- start 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd592deae00 1 -- start start 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd592deae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9bb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd592deae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9bbbd0 0x5569ca9c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd592deae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9c0970 0x5569ca9c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd592deae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5569ca8fa8f0 con 0x5569ca9bb290 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd592deae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5569ca8a82e0 con 0x5569ca9bbbd0 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd592deae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5569ca8f6820 con 0x5569ca9c0970 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd58e4fd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd58e4fd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9bb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42382/0 (socket says 10.20.193.28:42382) 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd58e4fd640 1 -- 10.20.193.28:0/402729584 learned_addr learned my addr 10.20.193.28:0/402729584 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd58e4fd640 1 -- 10.20.193.28:0/402729584 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9c0970 msgr2=0x5569ca9c2e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:14.181 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd58e4fd640 1 --2- 10.20.193.28:0/402729584 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9c0970 0x5569ca9c2e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd58e4fd640 1 -- 10.20.193.28:0/402729584 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9bbbd0 msgr2=0x5569ca9c0350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:14.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd58e4fd640 1 --2- 10.20.193.28:0/402729584 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9bbbd0 0x5569ca9c0350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.174+0000 7fd58e4fd640 1 -- 10.20.193.28:0/402729584 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ca89a5a0 con 0x5569ca9bb290 2026-02-20T03:40:14.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd576ffd640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd576ffd640 1 -- 10.20.193.28:0/3324193997 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd57c1050a0 con 0x7fd588078cf0 2026-02-20T03:40:14.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd58e4fd640 1 --2- 10.20.193.28:0/402729584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9bb690 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fd584009d20 tx=0x7fd58400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d74d11baac8647 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:14.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd58dcfc640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:14.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd5563ff640 1 -- 10.20.193.28:0/402729584 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584017070 con 0x5569ca9bb290 2026-02-20T03:40:14.182 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd5563ff640 1 -- 10.20.193.28:0/402729584 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd58400bd50 con 0x5569ca9bb290 2026-02-20T03:40:14.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd5563ff640 1 -- 10.20.193.28:0/402729584 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584006e60 con 0x5569ca9bb290 2026-02-20T03:40:14.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd58dcfc640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5569ca9bc2c0 tx=0x7fd578006cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:14.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd592deae00 1 -- 10.20.193.28:0/402729584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 msgr2=0x5569ca9bb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:14.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.175+0000 7fd592deae00 1 --2- 10.20.193.28:0/402729584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9bb690 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7fd584009d20 tx=0x7fd58400b420 comp rx=0 tx=0).stop 2026-02-20T03:40:14.183 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- 10.20.193.28:0/402729584 shutdown_connections 2026-02-20T03:40:14.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 --2- 10.20.193.28:0/402729584 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9c0970 0x5569ca9c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 --2- 10.20.193.28:0/402729584 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9bbbd0 0x5569ca9c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.184 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 --2- 10.20.193.28:0/402729584 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9bb690 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- 10.20.193.28:0/402729584 >> 10.20.193.28:0/402729584 conn(0x5569ca9a16f0 msgr2=0x5569ca9a8570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:14.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- 10.20.193.28:0/402729584 shutdown_connections 2026-02-20T03:40:14.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- 10.20.193.28:0/402729584 wait complete. 2026-02-20T03:40:14.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- start start 2026-02-20T03:40:14.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 Processor -- start 2026-02-20T03:40:14.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9d3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.186 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9bbbd0 0x5569ca9d4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9c0970 0x5569ca9db3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5569ca8a20c0 con 0x5569ca9bb290 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5569ca9c3a20 con 0x5569ca9c0970 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5569ca9db950 con 0x5569ca9bbbd0 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd58dcfc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9d3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd58dcfc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9d3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42388/0 (socket says 10.20.193.28:42388) 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd58dcfc640 1 -- 10.20.193.28:0/3836596455 learned_addr learned my addr 10.20.193.28:0/3836596455 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd58dcfc640 1 -- 10.20.193.28:0/3836596455 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9bbbd0 msgr2=0x5569ca9d4440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd58dcfc640 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9bbbd0 0x5569ca9d4440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd58dcfc640 1 -- 10.20.193.28:0/3836596455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9c0970 msgr2=0x5569ca9db3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd58dcfc640 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9c0970 0x5569ca9db3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.187 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd58dcfc640 1 -- 10.20.193.28:0/3836596455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ca9cd620 con 0x5569ca9bb290 2026-02-20T03:40:14.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd58dcfc640 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9d3f00 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fd578004690 tx=0x7fd5780047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb23035ae2da4ca2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:14.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd5437fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:14.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd5437fe640 1 -- 10.20.193.28:0/3836596455 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57800b760 con 0x5569ca9bb290 2026-02-20T03:40:14.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd5437fe640 1 -- 10.20.193.28:0/3836596455 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd57800bda0 con 0x5569ca9bb290 2026-02-20T03:40:14.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd5437fe640 1 -- 10.20.193.28:0/3836596455 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578011e00 con 0x5569ca9bb290 2026-02-20T03:40:14.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- 10.20.193.28:0/3836596455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ca8b6820 con 0x5569ca9bb290 2026-02-20T03:40:14.188 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd5437fe640 1 -- 10.20.193.28:0/3836596455 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd578013410 con 0x5569ca9bb290 2026-02-20T03:40:14.191 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd5437fe640 10 client.22290 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 10 client.22290 _ll_register_callbacks cb 0x5569ca8a5ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- 10.20.193.28:0/3836596455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5569ca9024e0 con 0x5569ca9bb290 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd5437fe640 1 -- 10.20.193.28:0/3836596455 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fd57800b900 con 0x5569ca9bb290 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 10 client.22290 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- 10.20.193.28:0/3836596455 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5569ca8bb380 con 0x5569ca9bb290 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd5437fe640 1 -- 10.20.193.28:0/3836596455 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fd578011420 con 0x5569ca9bb290 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 10 client.22290 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 10 client.22290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 20 client.22290 populate_metadata read hostname 'trial028' 2026-02-20T03:40:14.192 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5569ca9dfd70 0x5569ca9e2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 4 client.22290 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:40:14.193 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.179+0000 7fd592deae00 1 -- 10.20.193.28:0/3836596455 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569ca87cbd0 con 0x5569ca9dfd70 2026-02-20T03:40:14.204 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.203+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5569ca9dfd70 0x5569ca9e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:14.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.230+0000 7fd5437fe640 10 client.22290 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:14.232 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.230+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5569ca9dfd70 0x5569ca9e2210 crc :-1 s=READY pgs=631 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43d83340beba1e55 server_cookie=20ac06d079370cef in_seq=0 out_seq=0 2026-02-20T03:40:14.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd5437fe640 1 -- 10.20.193.28:0/3836596455 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5569ca87cbd0 con 0x5569ca9dfd70 2026-02-20T03:40:14.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd5437fe640 10 client.22290 handle_command_reply: tid=0 2026-02-20T03:40:14.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 client.22290 shutdown 2026-02-20T03:40:14.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 -- 10.20.193.28:0/3836596455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 msgr2=0x5569ca9d3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:14.248 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9d3f00 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7fd578004690 tx=0x7fd5780047e0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 -- 10.20.193.28:0/3836596455 shutdown_connections 2026-02-20T03:40:14.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5569ca9dfd70 0x5569ca9e2210 crc :-1 s=READY pgs=631 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9c0970 0x5569ca9db3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9bbbd0 0x5569ca9d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.249 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 --2- 10.20.193.28:0/3836596455 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bb290 0x5569ca9d3f00 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd5437fe640 0 client.22290 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:14.250 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 -- 10.20.193.28:0/3836596455 >> 10.20.193.28:0/3836596455 conn(0x5569ca9a16f0 msgr2=0x5569ca9c1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:14.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 -- 10.20.193.28:0/3836596455 shutdown_connections 2026-02-20T03:40:14.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 1 -- 10.20.193.28:0/3836596455 wait complete. 2026-02-20T03:40:14.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.244+0000 7fd592deae00 20 client.22290 trim_cache size 0 max 16384 2026-02-20T03:40:14.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd592deae00 1 Processor -- start 2026-02-20T03:40:14.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd592deae00 1 -- start start 2026-02-20T03:40:14.259 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd592deae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9bb290 0x5569ca9d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd592deae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9db380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd592deae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9c0970 0x5569ca9d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd592deae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd534012730 con 0x5569ca9bbbd0 2026-02-20T03:40:14.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd592deae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400ff70 con 0x5569ca9bb290 2026-02-20T03:40:14.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd592deae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400ddc0 con 0x5569ca9c0970 2026-02-20T03:40:14.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd58d4fb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9db380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:14.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd58d4fb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9db380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42398/0 (socket says 10.20.193.28:42398) 2026-02-20T03:40:14.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd58d4fb640 1 -- 10.20.193.28:0/1052644966 learned_addr learned my addr 10.20.193.28:0/1052644966 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:14.260 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd58d4fb640 1 -- 10.20.193.28:0/1052644966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9c0970 msgr2=0x5569ca9d4040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:14.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/1052644966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9c0970 0x5569ca9d4040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd58d4fb640 1 -- 10.20.193.28:0/1052644966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9bb290 msgr2=0x5569ca9d3b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:14.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/1052644966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9bb290 0x5569ca9d3b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd58d4fb640 1 -- 10.20.193.28:0/1052644966 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ca9cd450 con 0x5569ca9bbbd0 2026-02-20T03:40:14.261 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/1052644966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9db380 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0c9da0 tx=0x7fd57c0b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f89a3e66cd0654 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:14.264 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.255+0000 7fd555bfe640 1 -- 10.20.193.28:0/1052644966 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0d1130 con 0x5569ca9bbbd0 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd555bfe640 1 -- 10.20.193.28:0/1052644966 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd57c033030 con 0x5569ca9bbbd0 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd555bfe640 1 -- 10.20.193.28:0/1052644966 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0f3210 con 0x5569ca9bbbd0 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 -- 10.20.193.28:0/1052644966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 msgr2=0x5569ca9db380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 --2- 10.20.193.28:0/1052644966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9db380 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0c9da0 tx=0x7fd57c0b5040 comp rx=0 tx=0).stop 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 -- 10.20.193.28:0/1052644966 shutdown_connections 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 --2- 10.20.193.28:0/1052644966 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9c0970 0x5569ca9d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 --2- 10.20.193.28:0/1052644966 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9db380 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 --2- 10.20.193.28:0/1052644966 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9bb290 0x5569ca9d3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 -- 10.20.193.28:0/1052644966 >> 10.20.193.28:0/1052644966 conn(0x5569ca9a16f0 msgr2=0x5569ca9d25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:14.265 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 -- 10.20.193.28:0/1052644966 shutdown_connections 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 -- 10.20.193.28:0/1052644966 wait complete. 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 -- start start 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.256+0000 7fd592deae00 1 Processor -- start 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9bb290 0x5569ca9d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9da2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9c0970 0x5569ca9da830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400e430 con 0x5569ca9bbbd0 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400f8a0 con 0x5569ca9c0970 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fd53400eb00 con 0x5569ca9bb290 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd58d4fb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9da2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd58d4fb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9da2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:42412/0 (socket says 10.20.193.28:42412) 2026-02-20T03:40:14.266 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd58d4fb640 1 -- 10.20.193.28:0/2534458395 learned_addr learned my addr 10.20.193.28:0/2534458395 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd58d4fb640 1 -- 10.20.193.28:0/2534458395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9bb290 msgr2=0x5569ca9d9db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9bb290 0x5569ca9d9db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd58d4fb640 1 -- 10.20.193.28:0/2534458395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9c0970 msgr2=0x5569ca9da830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9c0970 0x5569ca9da830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd58d4fb640 1 -- 10.20.193.28:0/2534458395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ca9d4ea0 con 0x5569ca9bbbd0 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd58d4fb640 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9da2f0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0ccd10 tx=0x7fd57c1053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3feeea9fbf6dc4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd5437fe640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd5437fe640 1 -- 10.20.193.28:0/2534458395 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0d1130 con 0x5569ca9bbbd0 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 -- 10.20.193.28:0/2534458395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ca9db8e0 con 0x5569ca9bbbd0 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd5437fe640 1 -- 10.20.193.28:0/2534458395 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fd57c0d5fe0 con 0x5569ca9bbbd0 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 10 client.22296 _ll_register_callbacks cb 0x7fd578004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:14.267 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 -- 10.20.193.28:0/2534458395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5569ca8cb6b0 con 0x5569ca9bbbd0 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd5437fe640 1 -- 10.20.193.28:0/2534458395 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0d1130 con 0x5569ca9bbbd0 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd5437fe640 1 -- 10.20.193.28:0/2534458395 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fd57c0c8dc0 con 0x5569ca9bbbd0 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd5437fe640 1 -- 10.20.193.28:0/2534458395 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fd57c0e72d0 con 0x5569ca9bbbd0 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 10 client.22296 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 -- 10.20.193.28:0/2534458395 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5569ca65a690 con 0x5569ca9bbbd0 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd5437fe640 1 -- 10.20.193.28:0/2534458395 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fd57c0d5bd0 con 0x5569ca9bbbd0 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 10 client.22296 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 10 client.22296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 20 client.22296 populate_metadata read hostname 'trial028' 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5569ca9dfd70 0x5569caa4e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 4 client.22296 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:40:14.268 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.258+0000 7fd592deae00 1 -- 10.20.193.28:0/2534458395 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5569ca908290 con 0x5569ca9dfd70 2026-02-20T03:40:14.274 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.272+0000 7fd58dcfc640 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5569ca9dfd70 0x5569caa4e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:14.302 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.300+0000 7fd58dcfc640 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5569ca9dfd70 0x5569caa4e560 crc :-1 s=READY pgs=632 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2299dee9bd8c92c9 server_cookie=1e7d1a5554a3be24 in_seq=0 out_seq=0 2026-02-20T03:40:14.315 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:14.300+0000 7fd5437fe640 10 client.22296 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:14.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.63 MB/sec execute 585 sec latency 36545.485 ms 2026-02-20T03:40:15.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.59 MB/sec execute 586 sec latency 37545.526 ms 2026-02-20T03:40:15.863 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:15 trial028 ceph-mon[38552]: pgmap v953: 129 pgs: 129 active+clean; 737 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 394 KiB/s rd, 1.1 MiB/s wr, 246 op/s 2026-02-20T03:40:15.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:15 trial177 ceph-mon[43181]: pgmap v953: 129 pgs: 129 active+clean; 737 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 394 KiB/s rd, 1.1 MiB/s wr, 246 op/s 2026-02-20T03:40:16.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:15 trial126 ceph-mon[38476]: pgmap v953: 129 pgs: 129 active+clean; 737 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 394 KiB/s rd, 1.1 MiB/s wr, 246 op/s 2026-02-20T03:40:16.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.56 MB/sec execute 587 sec latency 38545.566 ms 2026-02-20T03:40:17.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.53 MB/sec execute 588 sec latency 39545.602 ms 2026-02-20T03:40:17.746 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:17 trial028 ceph-mon[38552]: pgmap v954: 129 pgs: 129 active+clean; 722 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 273 KiB/s rd, 478 KiB/s wr, 241 op/s 2026-02-20T03:40:17.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:17 trial177 ceph-mon[43181]: pgmap v954: 129 pgs: 129 active+clean; 722 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 273 KiB/s rd, 478 KiB/s wr, 241 op/s 2026-02-20T03:40:18.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:17 trial126 ceph-mon[38476]: pgmap v954: 129 pgs: 129 active+clean; 722 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 273 KiB/s rd, 478 KiB/s wr, 241 op/s 2026-02-20T03:40:18.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.49 MB/sec execute 589 sec latency 40545.634 ms 2026-02-20T03:40:19.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.46 MB/sec execute 590 sec latency 41545.664 ms 2026-02-20T03:40:19.879 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:19 trial028 ceph-mon[38552]: pgmap v955: 129 pgs: 129 active+clean; 711 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 361 KiB/s rd, 426 KiB/s wr, 244 op/s 2026-02-20T03:40:20.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:19 trial126 ceph-mon[38476]: pgmap v955: 129 pgs: 129 active+clean; 711 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 361 KiB/s rd, 426 KiB/s wr, 244 op/s 2026-02-20T03:40:20.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:19 trial177 ceph-mon[43181]: pgmap v955: 129 pgs: 129 active+clean; 711 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 361 KiB/s rd, 426 KiB/s wr, 244 op/s 2026-02-20T03:40:20.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.43 MB/sec execute 591 sec latency 42545.702 ms 2026-02-20T03:40:21.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.40 MB/sec execute 592 sec latency 43545.736 ms 2026-02-20T03:40:21.772 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:21 trial028 ceph-mon[38552]: pgmap v956: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 230 KiB/s rd, 238 KiB/s wr, 232 op/s 2026-02-20T03:40:22.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:21 trial126 ceph-mon[38476]: pgmap v956: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 230 KiB/s rd, 238 KiB/s wr, 232 op/s 2026-02-20T03:40:22.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:21 trial177 ceph-mon[43181]: pgmap v956: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 230 KiB/s rd, 238 KiB/s wr, 232 op/s 2026-02-20T03:40:22.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.36 MB/sec execute 593 sec latency 44545.771 ms 2026-02-20T03:40:23.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.33 MB/sec execute 594 sec latency 45545.802 ms 2026-02-20T03:40:23.909 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:23 trial028 ceph-mon[38552]: pgmap v957: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 213 KiB/s rd, 219 KiB/s wr, 163 op/s 2026-02-20T03:40:24.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:23 trial126 ceph-mon[38476]: pgmap v957: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 213 KiB/s rd, 219 KiB/s wr, 163 op/s 2026-02-20T03:40:24.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:23 trial177 ceph-mon[43181]: pgmap v957: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 213 KiB/s rd, 219 KiB/s wr, 163 op/s 2026-02-20T03:40:24.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.30 MB/sec execute 595 sec latency 46545.832 ms 2026-02-20T03:40:25.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.27 MB/sec execute 596 sec latency 47545.860 ms 2026-02-20T03:40:26.044 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:25 trial028 ceph-mon[38552]: pgmap v958: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 214 KiB/s rd, 221 KiB/s wr, 134 op/s 2026-02-20T03:40:26.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:25 trial126 ceph-mon[38476]: pgmap v958: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 214 KiB/s rd, 221 KiB/s wr, 134 op/s 2026-02-20T03:40:26.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:25 trial177 ceph-mon[43181]: pgmap v958: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 214 KiB/s rd, 221 KiB/s wr, 134 op/s 2026-02-20T03:40:26.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.23 MB/sec execute 597 sec latency 48545.890 ms 2026-02-20T03:40:27.048 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:40:27.366 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:40:27.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 -- 10.20.193.28:0/2879511069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 msgr2=0x7f9ab8115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:27.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 --2- 10.20.193.28:0/2879511069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 0x7f9ab8115d10 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f9aac00b0a0 tx=0x7f9aac02f450 comp rx=0 tx=0).stop 2026-02-20T03:40:27.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 -- 10.20.193.28:0/2879511069 shutdown_connections 2026-02-20T03:40:27.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 --2- 10.20.193.28:0/2879511069 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 0x7f9ab8115d10 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 --2- 10.20.193.28:0/2879511069 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ab8109220 0x7f9ab8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 --2- 10.20.193.28:0/2879511069 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ab810eef0 0x7f9ab810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 -- 10.20.193.28:0/2879511069 >> 10.20.193.28:0/2879511069 conn(0x7f9ab8078600 msgr2=0x7f9ab807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:27.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 -- 10.20.193.28:0/2879511069 shutdown_connections 2026-02-20T03:40:27.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 -- 10.20.193.28:0/2879511069 wait complete. 2026-02-20T03:40:27.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.622+0000 7f9abd350640 1 Processor -- start 2026-02-20T03:40:27.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9abd350640 1 -- start start 2026-02-20T03:40:27.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9abd350640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ab8109220 0x7f9ab81a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9abd350640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 0x7f9ab81a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9abd350640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ab810eef0 0x7f9ab81a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9abd350640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8119160 con 0x7f9ab8109ba0 2026-02-20T03:40:27.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9abd350640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8118fe0 con 0x7f9ab810eef0 2026-02-20T03:40:27.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9abd350640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab81192e0 con 0x7f9ab8109220 2026-02-20T03:40:27.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 0x7f9ab81a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:27.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 0x7f9ab81a1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38310/0 (socket says 10.20.193.28:38310) 2026-02-20T03:40:27.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab77fe640 1 -- 10.20.193.28:0/2150103180 learned_addr learned my addr 10.20.193.28:0/2150103180 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:27.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab77fe640 1 -- 10.20.193.28:0/2150103180 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ab8109220 msgr2=0x7f9ab81a15a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:40:27.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ab8109220 0x7f9ab81a15a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab77fe640 1 -- 10.20.193.28:0/2150103180 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ab810eef0 msgr2=0x7f9ab81a5e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:40:27.633 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ab810eef0 0x7f9ab81a5e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab77fe640 1 -- 10.20.193.28:0/2150103180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab81a65f0 con 0x7f9ab8109ba0 2026-02-20T03:40:27.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 0x7f9ab81a1ae0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b570 tx=0x7f9aa800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:27.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab57fa640 1 -- 10.20.193.28:0/2150103180 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8013020 con 0x7f9ab8109ba0 2026-02-20T03:40:27.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9ab57fa640 1 -- 10.20.193.28:0/2150103180 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9aa8004480 con 0x7f9ab8109ba0 2026-02-20T03:40:27.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.624+0000 7f9abd350640 1 -- 10.20.193.28:0/2150103180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab81a68e0 con 0x7f9ab8109ba0 2026-02-20T03:40:27.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.625+0000 7f9ab57fa640 1 -- 10.20.193.28:0/2150103180 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800fb50 con 0x7f9ab8109ba0 2026-02-20T03:40:27.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.625+0000 7f9abd350640 1 -- 10.20.193.28:0/2150103180 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab81ae120 con 0x7f9ab8109ba0 2026-02-20T03:40:27.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.625+0000 7f9ab57fa640 1 -- 10.20.193.28:0/2150103180 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9aa8002780 con 0x7f9ab8109ba0 2026-02-20T03:40:27.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.625+0000 7f9ac0adee00 1 Processor -- start 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.625+0000 7f9ac0adee00 1 -- start start 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d7cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 0x55b04d7d4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b04d736e50 con 0x55b04d7c7a40 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b04d7099c0 con 0x55b04d7cd410 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b04d6b7240 con 0x55b04d7c83c0 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38312/0 (socket says 10.20.193.28:38312) 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab7fff640 1 -- 10.20.193.28:0/1889776093 learned_addr learned my addr 10.20.193.28:0/1889776093 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab7fff640 1 -- 10.20.193.28:0/1889776093 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 msgr2=0x55b04d7d4240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:27.635 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab7fff640 1 --2- 10.20.193.28:0/1889776093 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 0x55b04d7d4240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab7fff640 1 -- 10.20.193.28:0/1889776093 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 msgr2=0x55b04d7cd7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab7fff640 1 --2- 10.20.193.28:0/1889776093 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d7cd7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab57fa640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a8c0b0da0 0x7f9a8c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab7fff640 1 -- 10.20.193.28:0/1889776093 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b04d6ca420 con 0x55b04d7c7a40 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab57fa640 1 -- 10.20.193.28:0/2150103180 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9aa80e04c0 con 0x7f9ab8109ba0 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9ab7fff640 1 --2- 10.20.193.28:0/1889776093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7c7e80 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009870 tx=0x7f9aa4009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969897629d958ffd server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9abcb4f640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a8c0b0da0 0x7f9a8c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9a88ce3640 1 -- 10.20.193.28:0/1889776093 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4016070 con 0x55b04d7c7a40 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9a88ce3640 1 -- 10.20.193.28:0/1889776093 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9aa4004480 con 0x55b04d7c7a40 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.629+0000 7f9a88ce3640 1 -- 10.20.193.28:0/1889776093 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa400bda0 con 0x55b04d7c7a40 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.630+0000 7f9ac0adee00 1 -- 10.20.193.28:0/1889776093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 msgr2=0x55b04d7c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:27.636 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.630+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/1889776093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7c7e80 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009870 tx=0x7f9aa4009d40 comp rx=0 tx=0).stop 2026-02-20T03:40:27.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.630+0000 7f9ac0adee00 1 -- 10.20.193.28:0/1889776093 shutdown_connections 2026-02-20T03:40:27.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.630+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/1889776093 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 0x55b04d7d4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.630+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/1889776093 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7c7e80 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.630+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/1889776093 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d7cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.630+0000 7f9ac0adee00 1 -- 10.20.193.28:0/1889776093 >> 10.20.193.28:0/1889776093 conn(0x55b04d779290 msgr2=0x55b04d7b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:27.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- 10.20.193.28:0/1889776093 shutdown_connections 2026-02-20T03:40:27.637 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9abcb4f640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a8c0b0da0 0x7f9a8c0b3260 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9aac006130 tx=0x7f9aac0060c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:27.638 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- 10.20.193.28:0/1889776093 wait complete. 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- start start 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 Processor -- start 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 0x55b04d7e1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d7e5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b04d7058f0 con 0x55b04d7c7a40 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b04d4f7f50 con 0x55b04d7cd410 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b04d7e5880 con 0x55b04d7c83c0 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38318/0 (socket says 10.20.193.28:38318) 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ab7fff640 1 -- 10.20.193.28:0/2778105630 learned_addr learned my addr 10.20.193.28:0/2778105630 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:27.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ab7fff640 1 -- 10.20.193.28:0/2778105630 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 msgr2=0x55b04d7e1050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:27.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ab7fff640 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 0x55b04d7e1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ab7fff640 1 -- 10.20.193.28:0/2778105630 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 msgr2=0x55b04d7e5340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:27.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ab7fff640 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d7e5340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ab7fff640 1 -- 10.20.193.28:0/2778105630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b04d7d9fd0 con 0x55b04d7c7a40 2026-02-20T03:40:27.640 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ab7fff640 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e0b10 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4014040 tx=0x7f9aa40094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8095557399b0f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:27.646 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9a79ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:27.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9a79ffb640 1 -- 10.20.193.28:0/2778105630 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4020070 con 0x55b04d7c7a40 2026-02-20T03:40:27.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2778105630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b04d4dab40 con 0x55b04d7c7a40 2026-02-20T03:40:27.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 10 client.22308 _ll_register_callbacks cb 0x55b04d742f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:27.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2778105630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b04d7171a0 con 0x55b04d7c7a40 2026-02-20T03:40:27.647 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9a79ffb640 1 -- 10.20.193.28:0/2778105630 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x55b04d7171a0 con 0x55b04d7c7a40 2026-02-20T03:40:27.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9a79ffb640 1 -- 10.20.193.28:0/2778105630 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4016070 con 0x55b04d7c7a40 2026-02-20T03:40:27.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9a79ffb640 1 -- 10.20.193.28:0/2778105630 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9aa4011b60 con 0x55b04d7c7a40 2026-02-20T03:40:27.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9a79ffb640 1 -- 10.20.193.28:0/2778105630 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f9aa40278b0 con 0x55b04d7c7a40 2026-02-20T03:40:27.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 10 client.22308 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:27.648 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2778105630 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x55b04d6c4230 con 0x55b04d7c7a40 2026-02-20T03:40:27.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9a79ffb640 1 -- 10.20.193.28:0/2778105630 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f9aa4027a50 con 0x55b04d7c7a40 2026-02-20T03:40:27.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 10 client.22308 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:27.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 10 client.22308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:27.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 20 client.22308 populate_metadata read hostname 'trial028' 2026-02-20T03:40:27.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b04d7f0bd0 0x55b04d7f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.649 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 4 client.22308 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:40:27.650 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.631+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2778105630 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b04d7115b0 con 0x55b04d7f0bd0 2026-02-20T03:40:27.659 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.657+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b04d7f0bd0 0x55b04d7f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.724+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b04d7f0bd0 0x55b04d7f2fc0 crc :-1 s=READY pgs=633 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8a0897444c1c7df server_cookie=1c0f2742dd7900cd in_seq=0 out_seq=0 2026-02-20T03:40:27.726 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.724+0000 7f9a79ffb640 10 client.22308 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:27.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.20 MB/sec execute 598 sec latency 49545.924 ms 2026-02-20T03:40:27.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9a79ffb640 1 -- 10.20.193.28:0/2778105630 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b04d7115b0 con 0x55b04d7f0bd0 2026-02-20T03:40:27.752 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9a79ffb640 10 client.22308 handle_command_reply: tid=0 2026-02-20T03:40:27.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 client.22308 shutdown 2026-02-20T03:40:27.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2778105630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 msgr2=0x55b04d7e0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:27.753 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e0b10 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4014040 tx=0x7f9aa40094a0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2778105630 shutdown_connections 2026-02-20T03:40:27.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b04d7f0bd0 0x55b04d7f2fc0 crc :-1 s=READY pgs=633 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.762 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d7e5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 0x55b04d7e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2778105630 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e0b10 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2778105630 >> 10.20.193.28:0/2778105630 conn(0x55b04d779290 msgr2=0x55b04d7b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:27.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9a79ffb640 0 client.22308 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:27.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2778105630 shutdown_connections 2026-02-20T03:40:27.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2778105630 wait complete. 2026-02-20T03:40:27.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.751+0000 7f9ac0adee00 20 client.22308 trim_cache size 0 max 16384 2026-02-20T03:40:27.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.757+0000 7f9ac0adee00 1 Processor -- start 2026-02-20T03:40:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- start start 2026-02-20T03:40:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c7a40 0x55b04d7b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c83c0 0x55b04d7b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.771 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d7f8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c0127b0 con 0x55b04d7c83c0 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c00fff0 con 0x55b04d7cd410 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c00de40 con 0x55b04d7c7a40 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c83c0 0x55b04d7b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab77fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c83c0 0x55b04d7b5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38330/0 (socket says 10.20.193.28:38330) 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab77fe640 1 -- 10.20.193.28:0/2966039574 learned_addr learned my addr 10.20.193.28:0/2966039574 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab77fe640 1 -- 10.20.193.28:0/2966039574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c7a40 msgr2=0x55b04d7b5520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/2966039574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c7a40 0x55b04d7b5520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab77fe640 1 -- 10.20.193.28:0/2966039574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 msgr2=0x55b04d7f8840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/2966039574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d7f8840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.772 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab77fe640 1 -- 10.20.193.28:0/2966039574 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b04d7cdb60 con 0x55b04d7c83c0 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/2966039574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c83c0 0x55b04d7b5a60 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80a7ea0 tx=0x7f9aa80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c495c639794cd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a7bfff640 1 -- 10.20.193.28:0/2966039574 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80ac550 con 0x55b04d7c83c0 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a7bfff640 1 -- 10.20.193.28:0/2966039574 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9aa80b1400 con 0x55b04d7c83c0 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a7bfff640 1 -- 10.20.193.28:0/2966039574 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80ac170 con 0x55b04d7c83c0 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2966039574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c83c0 msgr2=0x55b04d7b5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2966039574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c83c0 0x55b04d7b5a60 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80a7ea0 tx=0x7f9aa80047e0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2966039574 shutdown_connections 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2966039574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d7f8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2966039574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c83c0 0x55b04d7b5a60 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/2966039574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c7a40 0x55b04d7b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.773 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2966039574 >> 10.20.193.28:0/2966039574 conn(0x55b04d779290 msgr2=0x55b04d7e0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2966039574 shutdown_connections 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- 10.20.193.28:0/2966039574 wait complete. 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- start start 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 Processor -- start 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 0x55b04d7e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d85aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c00e4b0 con 0x55b04d7c7a40 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c00f920 con 0x55b04d7cd410 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c00eb80 con 0x55b04d7c83c0 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:27.774 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab7fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:38336/0 (socket says 10.20.193.28:38336) 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab7fff640 1 -- 10.20.193.28:0/3481949897 learned_addr learned my addr 10.20.193.28:0/3481949897 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab7fff640 1 -- 10.20.193.28:0/3481949897 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 msgr2=0x55b04d7e7c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab7fff640 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 0x55b04d7e7c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab7fff640 1 -- 10.20.193.28:0/3481949897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 msgr2=0x55b04d85aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab7fff640 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d85aa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab7fff640 1 -- 10.20.193.28:0/3481949897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b04d7d9e00 con 0x55b04d7c7a40 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ab7fff640 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e76f0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400b530 tx=0x7f9aa4006b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c705bbcf7794c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a79ffb640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a79ffb640 1 -- 10.20.193.28:0/3481949897 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4020070 con 0x55b04d7c7a40 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a79ffb640 1 -- 10.20.193.28:0/3481949897 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9aa4017040 con 0x55b04d7c7a40 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a79ffb640 1 -- 10.20.193.28:0/3481949897 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4016040 con 0x55b04d7c7a40 2026-02-20T03:40:27.775 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- 10.20.193.28:0/3481949897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b04d3e8870 con 0x55b04d7c7a40 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a79ffb640 1 -- 10.20.193.28:0/3481949897 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9aa4011400 con 0x55b04d7c7a40 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 10 client.22314 _ll_register_callbacks cb 0x7f9aa4014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- 10.20.193.28:0/3481949897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aa80b1400 con 0x55b04d7c7a40 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a79ffb640 1 -- 10.20.193.28:0/3481949897 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f9aa4004280 con 0x55b04d7c7a40 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 10 client.22314 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- 10.20.193.28:0/3481949897 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x55b04d6a9440 con 0x55b04d7c7a40 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9a79ffb640 1 -- 10.20.193.28:0/3481949897 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f9aa40272c0 con 0x55b04d7c7a40 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 10 client.22314 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 10 client.22314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 20 client.22314 populate_metadata read hostname 'trial028' 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b04d85c110 0x55b04d85e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:27.776 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 4 client.22314 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:40:27.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.760+0000 7f9ac0adee00 1 -- 10.20.193.28:0/3481949897 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b04d7115b0 con 0x55b04d85c110 2026-02-20T03:40:27.777 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.764+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b04d85c110 0x55b04d85e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:27.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.831+0000 7f9ab77fe640 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b04d85c110 0x55b04d85e5d0 crc :-1 s=READY pgs=634 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdbd3665cb8b4f03 server_cookie=edadc3311f204519 in_seq=0 out_seq=0 2026-02-20T03:40:27.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.831+0000 7f9a79ffb640 10 client.22314 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:27.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9a79ffb640 1 -- 10.20.193.28:0/3481949897 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55b04d7115b0 con 0x55b04d85c110 2026-02-20T03:40:27.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9a79ffb640 10 client.22314 handle_command_reply: tid=0 2026-02-20T03:40:27.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 client.22314 shutdown 2026-02-20T03:40:27.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 -- 10.20.193.28:0/3481949897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 msgr2=0x55b04d7e76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:27.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e76f0 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400b530 tx=0x7f9aa4006b60 comp rx=0 tx=0).stop 2026-02-20T03:40:27.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 -- 10.20.193.28:0/3481949897 shutdown_connections 2026-02-20T03:40:27.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b04d85c110 0x55b04d85e5d0 crc :-1 s=READY pgs=634 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b04d7cd410 0x55b04d85aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b04d7c83c0 0x55b04d7e7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 --2- 10.20.193.28:0/3481949897 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b04d7c7a40 0x55b04d7e76f0 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 -- 10.20.193.28:0/3481949897 >> 10.20.193.28:0/3481949897 conn(0x55b04d779290 msgr2=0x55b04d7df000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:27.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9a79ffb640 0 client.22314 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:27.848 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 -- 10.20.193.28:0/3481949897 shutdown_connections 2026-02-20T03:40:27.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 1 -- 10.20.193.28:0/3481949897 wait complete. 2026-02-20T03:40:27.849 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.845+0000 7f9ac0adee00 20 client.22314 trim_cache size 0 max 16384 2026-02-20T03:40:27.860 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:40:27.860 INFO:teuthology.orchestra.run.trial028.stdout: "status": "scrub active (1 inodes in the stack)", 2026-02-20T03:40:27.860 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": { 2026-02-20T03:40:27.860 INFO:teuthology.orchestra.run.trial028.stdout: "3590b345-cd20-45f5-8dac-0c62d0d24d0c": { 2026-02-20T03:40:27.860 INFO:teuthology.orchestra.run.trial028.stdout: "path": "/", 2026-02-20T03:40:27.860 INFO:teuthology.orchestra.run.trial028.stdout: "tag": "3590b345-cd20-45f5-8dac-0c62d0d24d0c", 2026-02-20T03:40:27.860 INFO:teuthology.orchestra.run.trial028.stdout: "options": "recursive,force" 2026-02-20T03:40:27.860 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:40:27.861 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:40:27.861 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:40:27.861 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 -- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a8c0b0da0 msgr2=0x7f9a8c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a8c0b0da0 0x7f9a8c0b3260 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9aac006130 tx=0x7f9aac0060c0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 -- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 msgr2=0x7f9ab81a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 0x7f9ab81a1ae0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b570 tx=0x7f9aa800ba40 comp rx=0 tx=0).stop 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 -- 10.20.193.28:0/2150103180 shutdown_connections 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9a8c0b0da0 0x7f9a8c0b3260 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9ab810eef0 0x7f9ab81a5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9ab8109ba0 0x7f9ab81a1ae0 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 --2- 10.20.193.28:0/2150103180 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9ab8109220 0x7f9ab81a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 -- 10.20.193.28:0/2150103180 >> 10.20.193.28:0/2150103180 conn(0x7f9ab8078600 msgr2=0x7f9ab8079f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 -- 10.20.193.28:0/2150103180 shutdown_connections 2026-02-20T03:40:27.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:27.846+0000 7f9abd350640 1 -- 10.20.193.28:0/2150103180 wait complete. 2026-02-20T03:40:27.921 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:27 trial028 ceph-mon[38552]: pgmap v959: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 154 KiB/s rd, 100 KiB/s wr, 104 op/s 2026-02-20T03:40:28.016 INFO:tasks.cephfs.filesystem:scrub status for tag:3590b345-cd20-45f5-8dac-0c62d0d24d0c - {'path': '/', 'tag': '3590b345-cd20-45f5-8dac-0c62d0d24d0c', 'options': 'recursive,force'} 2026-02-20T03:40:28.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:27 trial126 ceph-mon[38476]: pgmap v959: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 154 KiB/s rd, 100 KiB/s wr, 104 op/s 2026-02-20T03:40:28.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:27 trial177 ceph-mon[43181]: pgmap v959: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 154 KiB/s rd, 100 KiB/s wr, 104 op/s 2026-02-20T03:40:28.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 274137 19.17 MB/sec execute 599 sec latency 50545.969 ms 2026-02-20T03:40:28.993 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:28 trial028 ceph-mon[38552]: pgmap v960: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 98 KiB/s rd, 41 KiB/s wr, 64 op/s 2026-02-20T03:40:29.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:28 trial177 ceph-mon[43181]: pgmap v960: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 98 KiB/s rd, 41 KiB/s wr, 64 op/s 2026-02-20T03:40:29.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:28 trial126 ceph-mon[38476]: pgmap v960: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 98 KiB/s rd, 41 KiB/s wr, 64 op/s 2026-02-20T03:40:29.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 600 sec 2026-02-20T03:40:30.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 601 sec 2026-02-20T03:40:31.661 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:31 trial028 ceph-mon[38552]: pgmap v961: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 5.7 KiB/s wr, 21 op/s 2026-02-20T03:40:31.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 602 sec 2026-02-20T03:40:31.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:31 trial126 ceph-mon[38476]: pgmap v961: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 5.7 KiB/s wr, 21 op/s 2026-02-20T03:40:31.920 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:31 trial177 ceph-mon[43181]: pgmap v961: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 6.7 KiB/s rd, 5.7 KiB/s wr, 21 op/s 2026-02-20T03:40:32.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 603 sec 2026-02-20T03:40:33.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 604 sec 2026-02-20T03:40:33.809 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:33 trial028 ceph-mon[38552]: pgmap v962: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2026-02-20T03:40:33.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:33 trial177 ceph-mon[43181]: pgmap v962: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2026-02-20T03:40:34.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:33 trial126 ceph-mon[38476]: pgmap v962: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2026-02-20T03:40:34.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 605 sec 2026-02-20T03:40:35.687 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:35 trial028 ceph-mon[38552]: pgmap v963: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2026-02-20T03:40:35.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 606 sec 2026-02-20T03:40:35.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:35 trial177 ceph-mon[43181]: pgmap v963: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2026-02-20T03:40:36.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:35 trial126 ceph-mon[38476]: pgmap v963: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 4.4 KiB/s wr, 8 op/s 2026-02-20T03:40:36.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 607 sec 2026-02-20T03:40:37.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 608 sec 2026-02-20T03:40:37.822 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:37 trial028 ceph-mon[38552]: pgmap v964: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2026-02-20T03:40:37.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:37 trial177 ceph-mon[43181]: pgmap v964: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2026-02-20T03:40:38.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:37 trial126 ceph-mon[38476]: pgmap v964: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2026-02-20T03:40:38.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 609 sec 2026-02-20T03:40:39.706 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:39 trial028 ceph-mon[38552]: pgmap v965: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 7 op/s 2026-02-20T03:40:39.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 610 sec 2026-02-20T03:40:39.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:39 trial177 ceph-mon[43181]: pgmap v965: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 7 op/s 2026-02-20T03:40:40.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:39 trial126 ceph-mon[38476]: pgmap v965: 129 pgs: 129 active+clean; 707 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 13 KiB/s rd, 17 KiB/s wr, 7 op/s 2026-02-20T03:40:40.741 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 611 sec 2026-02-20T03:40:41.528 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd5437fe640 1 -- 10.20.193.28:0/2534458395 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5569ca908290 con 0x5569ca9dfd70 2026-02-20T03:40:41.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd5437fe640 10 client.22296 handle_command_reply: tid=0 2026-02-20T03:40:41.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd592deae00 1 client.22296 shutdown 2026-02-20T03:40:41.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd592deae00 1 -- 10.20.193.28:0/2534458395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 msgr2=0x5569ca9da2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:41.529 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd592deae00 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9da2f0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0ccd10 tx=0x7fd57c1053a0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd592deae00 1 -- 10.20.193.28:0/2534458395 shutdown_connections 2026-02-20T03:40:41.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd592deae00 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5569ca9dfd70 0x5569caa4e560 crc :-1 s=READY pgs=632 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd592deae00 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5569ca9c0970 0x5569ca9da830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd592deae00 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5569ca9bbbd0 0x5569ca9da2f0 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd5437fe640 0 client.22296 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:41.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd592deae00 1 --2- 10.20.193.28:0/2534458395 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5569ca9bb290 0x5569ca9d9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.530 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.526+0000 7fd592deae00 1 -- 10.20.193.28:0/2534458395 >> 10.20.193.28:0/2534458395 conn(0x5569ca9a16f0 msgr2=0x5569ca9d3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:41.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.527+0000 7fd592deae00 1 -- 10.20.193.28:0/2534458395 shutdown_connections 2026-02-20T03:40:41.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.527+0000 7fd592deae00 1 -- 10.20.193.28:0/2534458395 wait complete. 2026-02-20T03:40:41.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.527+0000 7fd592deae00 20 client.22296 trim_cache size 0 max 16384 2026-02-20T03:40:41.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:40:41.542 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:40:41.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:40:41.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:40:41.543 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 -- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 msgr2=0x7fd5640b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x5569ca9bc2c0 tx=0x7fd578006cd0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 -- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 msgr2=0x7fd5881a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 0x7fd5881a1650 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009950 tx=0x7fd57c02fdc0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 -- 10.20.193.28:0/3324193997 shutdown_connections 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fd5640b0e20 0x7fd5640b32e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fd588079690 0x7fd5881a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fd588078cf0 0x7fd5881a1650 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 --2- 10.20.193.28:0/3324193997 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fd588077ab0 0x7fd5881a1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 -- 10.20.193.28:0/3324193997 >> 10.20.193.28:0/3324193997 conn(0x7fd5881000c0 msgr2=0x7fd588101820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:41.544 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 -- 10.20.193.28:0/3324193997 shutdown_connections 2026-02-20T03:40:41.545 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:41.528+0000 7fd58ff87640 1 -- 10.20.193.28:0/3324193997 wait complete. 2026-02-20T03:40:41.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 612 sec 2026-02-20T03:40:41.867 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:41 trial028 ceph-mon[38552]: pgmap v966: 129 pgs: 129 active+clean; 704 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 10 op/s 2026-02-20T03:40:41.867 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:41 trial028 ceph-mon[38552]: scrub summary: active paths [/] 2026-02-20T03:40:41.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:41 trial177 ceph-mon[43181]: pgmap v966: 129 pgs: 129 active+clean; 704 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 10 op/s 2026-02-20T03:40:41.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:41 trial177 ceph-mon[43181]: scrub summary: active paths [/] 2026-02-20T03:40:42.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:41 trial126 ceph-mon[38476]: pgmap v966: 129 pgs: 129 active+clean; 704 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 14 KiB/s rd, 18 KiB/s wr, 10 op/s 2026-02-20T03:40:42.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:41 trial126 ceph-mon[38476]: scrub summary: active paths [/] 2026-02-20T03:40:42.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:42 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:40:42.729 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:42 trial028 ceph-mon[38552]: scrub summary: idle+waiting paths [/] 2026-02-20T03:40:42.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 613 sec 2026-02-20T03:40:42.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:42 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:40:42.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:42 trial177 ceph-mon[43181]: scrub summary: idle+waiting paths [/] 2026-02-20T03:40:43.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:42 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:40:43.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:42 trial126 ceph-mon[38476]: scrub summary: idle+waiting paths [/] 2026-02-20T03:40:43.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 614 sec 2026-02-20T03:40:43.816 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:43 trial028 ceph-mon[38552]: pgmap v967: 129 pgs: 129 active+clean; 700 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 20 KiB/s wr, 15 op/s 2026-02-20T03:40:43.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:43 trial177 ceph-mon[43181]: pgmap v967: 129 pgs: 129 active+clean; 700 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 20 KiB/s wr, 15 op/s 2026-02-20T03:40:44.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:43 trial126 ceph-mon[38476]: pgmap v967: 129 pgs: 129 active+clean; 700 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 16 KiB/s rd, 20 KiB/s wr, 15 op/s 2026-02-20T03:40:44.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 615 sec 2026-02-20T03:40:45.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 616 sec 2026-02-20T03:40:45.979 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:45 trial028 ceph-mon[38552]: pgmap v968: 129 pgs: 129 active+clean; 695 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 105 KiB/s rd, 105 KiB/s wr, 30 op/s 2026-02-20T03:40:46.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:45 trial126 ceph-mon[38476]: pgmap v968: 129 pgs: 129 active+clean; 695 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 105 KiB/s rd, 105 KiB/s wr, 30 op/s 2026-02-20T03:40:46.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:45 trial177 ceph-mon[43181]: pgmap v968: 129 pgs: 129 active+clean; 695 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 105 KiB/s rd, 105 KiB/s wr, 30 op/s 2026-02-20T03:40:46.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 617 sec 2026-02-20T03:40:47.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 618 sec 2026-02-20T03:40:47.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:47 trial028 ceph-mon[38552]: pgmap v969: 129 pgs: 129 active+clean; 680 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 47 op/s 2026-02-20T03:40:47.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:47 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:40:47.859 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:47 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:40:48.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:47 trial126 ceph-mon[38476]: pgmap v969: 129 pgs: 129 active+clean; 680 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 47 op/s 2026-02-20T03:40:48.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:47 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:40:48.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:47 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:40:48.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:47 trial177 ceph-mon[43181]: pgmap v969: 129 pgs: 129 active+clean; 680 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 114 KiB/s rd, 112 KiB/s wr, 47 op/s 2026-02-20T03:40:48.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:47 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:40:48.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:47 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:40:48.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 619 sec 2026-02-20T03:40:48.928 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:48 trial028 ceph-mon[38552]: scrub summary: idle 2026-02-20T03:40:49.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:48 trial126 ceph-mon[38476]: scrub summary: idle 2026-02-20T03:40:49.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:48 trial177 ceph-mon[43181]: scrub summary: idle 2026-02-20T03:40:49.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 620 sec 2026-02-20T03:40:50.010 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:49 trial028 ceph-mon[38552]: pgmap v970: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 138 KiB/s rd, 133 KiB/s wr, 56 op/s 2026-02-20T03:40:50.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:49 trial126 ceph-mon[38476]: pgmap v970: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 138 KiB/s rd, 133 KiB/s wr, 56 op/s 2026-02-20T03:40:50.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:49 trial177 ceph-mon[43181]: pgmap v970: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 138 KiB/s rd, 133 KiB/s wr, 56 op/s 2026-02-20T03:40:50.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 621 sec 2026-02-20T03:40:51.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 622 sec 2026-02-20T03:40:51.890 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:51 trial028 ceph-mon[38552]: pgmap v971: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 56 op/s 2026-02-20T03:40:52.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:51 trial126 ceph-mon[38476]: pgmap v971: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 56 op/s 2026-02-20T03:40:52.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:51 trial177 ceph-mon[43181]: pgmap v971: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 56 op/s 2026-02-20T03:40:52.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 623 sec 2026-02-20T03:40:53.742 INFO:tasks.workunit.client.0.trial028.stdout: 10 cleanup 624 sec 2026-02-20T03:40:54.064 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:53 trial028 ceph-mon[38552]: pgmap v972: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 128 KiB/s rd, 116 KiB/s wr, 52 op/s 2026-02-20T03:40:54.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:53 trial126 ceph-mon[38476]: pgmap v972: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 128 KiB/s rd, 116 KiB/s wr, 52 op/s 2026-02-20T03:40:54.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:53 trial177 ceph-mon[43181]: pgmap v972: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 128 KiB/s rd, 116 KiB/s wr, 52 op/s 2026-02-20T03:40:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- 10.20.193.28:0/291452212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 msgr2=0x7fbf04105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/291452212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 0x7fbf04105fb0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009a30 tx=0x7fbeec02f260 comp rx=0 tx=0).stop 2026-02-20T03:40:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- 10.20.193.28:0/291452212 shutdown_connections 2026-02-20T03:40:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/291452212 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf041064f0 0x7fbf0410cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/291452212 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 0x7fbf04105fb0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/291452212 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf04104940 0x7fbf04104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.609 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- 10.20.193.28:0/291452212 >> 10.20.193.28:0/291452212 conn(0x7fbf041000c0 msgr2=0x7fbf041024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:54.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- 10.20.193.28:0/291452212 shutdown_connections 2026-02-20T03:40:54.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- 10.20.193.28:0/291452212 wait complete. 2026-02-20T03:40:54.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 Processor -- start 2026-02-20T03:40:54.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- start start 2026-02-20T03:40:54.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf04104940 0x7fbf0419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 0x7fbf0419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.611 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf041064f0 0x7fbf041a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04110550 con 0x7fbf04105b30 2026-02-20T03:40:54.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041103d0 con 0x7fbf04104940 2026-02-20T03:40:54.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbf041106d0 con 0x7fbf041064f0 2026-02-20T03:40:54.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf02575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 0x7fbf0419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:54.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf02575640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 0x7fbf0419d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54450/0 (socket says 10.20.193.28:54450) 2026-02-20T03:40:54.612 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf02575640 1 -- 10.20.193.28:0/2140315150 learned_addr learned my addr 10.20.193.28:0/2140315150 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf02575640 1 -- 10.20.193.28:0/2140315150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf041064f0 msgr2=0x7fbf041a4140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:40:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf02575640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf041064f0 0x7fbf041a4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf02575640 1 -- 10.20.193.28:0/2140315150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf04104940 msgr2=0x7fbf0419cb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-20T03:40:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf02575640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf04104940 0x7fbf0419cb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.615 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf02575640 1 -- 10.20.193.28:0/2140315150 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf041a4840 con 0x7fbf04105b30 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf02575640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 0x7fbf0419d0d0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009950 tx=0x7fbeec02fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbee3fff640 1 -- 10.20.193.28:0/2140315150 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec004240 con 0x7fbf04105b30 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbee3fff640 1 -- 10.20.193.28:0/2140315150 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbeec0043e0 con 0x7fbf04105b30 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbf08a0a640 1 -- 10.20.193.28:0/2140315150 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf041a4ad0 con 0x7fbf04105b30 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.605+0000 7fbee3fff640 1 -- 10.20.193.28:0/2140315150 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec042b00 con 0x7fbf04105b30 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.608+0000 7fbf08a0a640 1 -- 10.20.193.28:0/2140315150 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf041a5010 con 0x7fbf04105b30 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.609+0000 7fbee3fff640 1 -- 10.20.193.28:0/2140315150 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fbeec04a030 con 0x7fbf04105b30 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.609+0000 7fbf0c06fe00 1 Processor -- start 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 -- start start 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e8064c50 0x5584e8065070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.616 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e80655b0 0x5584e8069fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e806a600 0x5584e806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5584e7fb58f0 con 0x5584e80655b0 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5584e7f632e0 con 0x5584e806a600 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5584e7fb1820 con 0x5584e8064c50 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf02d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e80655b0 0x5584e8069fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf02d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e80655b0 0x5584e8069fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54458/0 (socket says 10.20.193.28:54458) 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf02d76640 1 -- 10.20.193.28:0/4135113583 learned_addr learned my addr 10.20.193.28:0/4135113583 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf02d76640 1 -- 10.20.193.28:0/4135113583 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e8064c50 msgr2=0x5584e8065070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf02d76640 1 --2- 10.20.193.28:0/4135113583 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e8064c50 0x5584e8065070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf02d76640 1 -- 10.20.193.28:0/4135113583 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e806a600 msgr2=0x5584e806ca30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf02d76640 1 --2- 10.20.193.28:0/4135113583 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e806a600 0x5584e806ca30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.617 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf02d76640 1 -- 10.20.193.28:0/4135113583 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e7f555a0 con 0x5584e80655b0 2026-02-20T03:40:54.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf02d76640 1 --2- 10.20.193.28:0/4135113583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e80655b0 0x5584e8069fe0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009840 tx=0x7fbef8009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4eb8ca635373dc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:54.619 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbee13fe640 1 -- 10.20.193.28:0/4135113583 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8016070 con 0x5584e80655b0 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbee13fe640 1 -- 10.20.193.28:0/4135113583 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbef8004480 con 0x5584e80655b0 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbee13fe640 1 -- 10.20.193.28:0/4135113583 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef800bd00 con 0x5584e80655b0 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbee3fff640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbed40b0e20 0x7fbed40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbee3fff640 1 -- 10.20.193.28:0/2140315150 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbeec1051a0 con 0x7fbf04105b30 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4135113583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e80655b0 msgr2=0x5584e8069fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4135113583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e80655b0 0x5584e8069fe0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009840 tx=0x7fbef8009d10 comp rx=0 tx=0).stop 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4135113583 shutdown_connections 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4135113583 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e806a600 0x5584e806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4135113583 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e80655b0 0x5584e8069fe0 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4135113583 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e8064c50 0x5584e8065070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.620 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4135113583 >> 10.20.193.28:0/4135113583 conn(0x5584e805c2d0 msgr2=0x5584e8063150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.612+0000 7fbf03577640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbed40b0e20 0x7fbed40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.613+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4135113583 shutdown_connections 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.613+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4135113583 wait complete. 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 -- start start 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbed40b0e20 0x7fbed40b32e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5584e8065f50 tx=0x7fbef4009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 Processor -- start 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e8064c50 0x5584e807da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 0x5584e807dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e8084f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5584e7f5d0c0 con 0x5584e806a600 2026-02-20T03:40:54.621 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5584e806d5f0 con 0x5584e8064c50 2026-02-20T03:40:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5584e80854b0 con 0x5584e80655b0 2026-02-20T03:40:54.622 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e8084f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e8084f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54460/0 (socket says 10.20.193.28:54460) 2026-02-20T03:40:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 -- 10.20.193.28:0/4142404279 learned_addr learned my addr 10.20.193.28:0/4142404279 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:54.629 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 -- 10.20.193.28:0/4142404279 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 msgr2=0x5584e807dfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 0x5584e807dfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 -- 10.20.193.28:0/4142404279 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e8064c50 msgr2=0x5584e807da60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e8064c50 0x5584e807da60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 -- 10.20.193.28:0/4142404279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e80771b0 con 0x5584e806a600 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf03577640 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e8084f20 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fbef4004380 tx=0x7fbef4004bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba763226620a08 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbec8bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbec8bfc640 1 -- 10.20.193.28:0/4142404279 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef4006e60 con 0x5584e806a600 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4142404279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584e7f71820 con 0x5584e806a600 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 10 client.22326 _ll_register_callbacks cb 0x5584e7f60ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4142404279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584e7fbd4e0 con 0x5584e806a600 2026-02-20T03:40:54.630 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbec8bfc640 1 -- 10.20.193.28:0/4142404279 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x5584e7fbd4e0 con 0x5584e806a600 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbec8bfc640 1 -- 10.20.193.28:0/4142404279 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef401e020 con 0x5584e806a600 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbec8bfc640 1 -- 10.20.193.28:0/4142404279 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbef401ad50 con 0x5584e806a600 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbec8bfc640 1 -- 10.20.193.28:0/4142404279 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fbef4024410 con 0x5584e806a600 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 10 client.22326 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4142404279 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5584e7f76380 con 0x5584e806a600 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbec8bfc640 1 -- 10.20.193.28:0/4142404279 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fbef400d9a0 con 0x5584e806a600 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 10 client.22326 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 10 client.22326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 20 client.22326 populate_metadata read hostname 'trial028' 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584e80899c0 0x5584e808be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 4 client.22326 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:40:54.631 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.614+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4142404279 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584e7f37bd0 con 0x5584e80899c0 2026-02-20T03:40:54.641 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.639+0000 7fbf02d76640 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584e80899c0 0x5584e808be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:54.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.705+0000 7fbf02d76640 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584e80899c0 0x5584e808be50 crc :-1 s=READY pgs=635 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf8624b901b678 server_cookie=66fff8fb42681b73 in_seq=0 out_seq=0 2026-02-20T03:40:54.707 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.705+0000 7fbec8bfc640 10 client.22326 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:54.721 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbec8bfc640 1 -- 10.20.193.28:0/4142404279 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5584e7f37bd0 con 0x5584e80899c0 2026-02-20T03:40:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbec8bfc640 10 client.22326 handle_command_reply: tid=0 2026-02-20T03:40:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 client.22326 shutdown 2026-02-20T03:40:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4142404279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 msgr2=0x5584e8084f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e8084f20 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fbef4004380 tx=0x7fbef4004bd0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4142404279 shutdown_connections 2026-02-20T03:40:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584e80899c0 0x5584e808be50 crc :-1 s=READY pgs=635 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e8084f20 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 0x5584e807dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.722 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/4142404279 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e8064c50 0x5584e807da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4142404279 >> 10.20.193.28:0/4142404279 conn(0x5584e805c2d0 msgr2=0x5584e806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:54.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbec8bfc640 0 client.22326 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:54.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4142404279 shutdown_connections 2026-02-20T03:40:54.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/4142404279 wait complete. 2026-02-20T03:40:54.723 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.719+0000 7fbf0c06fe00 20 client.22326 trim_cache size 0 max 16384 2026-02-20T03:40:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 Processor -- start 2026-02-20T03:40:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- start start 2026-02-20T03:40:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e8064c50 0x5584e807a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 0x5584e8084ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e807a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.731 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbea8012730 con 0x5584e806a600 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbea800ff70 con 0x5584e8064c50 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbea800ddc0 con 0x5584e80655b0 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf03577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e807a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf03577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e807a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54466/0 (socket says 10.20.193.28:54466) 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf03577640 1 -- 10.20.193.28:0/1827587474 learned_addr learned my addr 10.20.193.28:0/1827587474 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf03577640 1 -- 10.20.193.28:0/1827587474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 msgr2=0x5584e8084ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf03577640 1 --2- 10.20.193.28:0/1827587474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 0x5584e8084ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf03577640 1 -- 10.20.193.28:0/1827587474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e8064c50 msgr2=0x5584e807a2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf03577640 1 --2- 10.20.193.28:0/1827587474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e8064c50 0x5584e807a2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf03577640 1 -- 10.20.193.28:0/1827587474 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e8076fe0 con 0x5584e806a600 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf03577640 1 --2- 10.20.193.28:0/1827587474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e807a800 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fbef4004b80 tx=0x7fbef4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f094a82f9d0cb524 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:54.732 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbee0bfd640 1 -- 10.20.193.28:0/1827587474 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef403c070 con 0x5584e806a600 2026-02-20T03:40:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbee0bfd640 1 -- 10.20.193.28:0/1827587474 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbef401f020 con 0x5584e806a600 2026-02-20T03:40:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbee0bfd640 1 -- 10.20.193.28:0/1827587474 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef401e070 con 0x5584e806a600 2026-02-20T03:40:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/1827587474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 msgr2=0x5584e807a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/1827587474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e807a800 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fbef4004b80 tx=0x7fbef4004040 comp rx=0 tx=0).stop 2026-02-20T03:40:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/1827587474 shutdown_connections 2026-02-20T03:40:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/1827587474 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e806a600 0x5584e807a800 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/1827587474 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 0x5584e8084ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.733 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/1827587474 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e8064c50 0x5584e807a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.736 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/1827587474 >> 10.20.193.28:0/1827587474 conn(0x5584e805c2d0 msgr2=0x5584e80667a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/1827587474 shutdown_connections 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/1827587474 wait complete. 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- start start 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 Processor -- start 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e8064c50 0x5584e8082e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 0x5584e80833b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e806a600 0x5584e80843e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fbea800e430 con 0x5584e8064c50 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fbea800f8a0 con 0x5584e806a600 2026-02-20T03:40:54.737 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf0c06fe00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fbea800eb00 con 0x5584e80655b0 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf02d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e8064c50 0x5584e8082e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf02d76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e8064c50 0x5584e8082e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:54476/0 (socket says 10.20.193.28:54476) 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf02d76640 1 -- 10.20.193.28:0/2617015720 learned_addr learned my addr 10.20.193.28:0/2617015720 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf02d76640 1 -- 10.20.193.28:0/2617015720 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 msgr2=0x5584e80833b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf02d76640 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 0x5584e80833b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf02d76640 1 -- 10.20.193.28:0/2617015720 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e806a600 msgr2=0x5584e80843e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf02d76640 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e806a600 0x5584e80843e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf02d76640 1 -- 10.20.193.28:0/2617015720 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584e7d15690 con 0x5584e8064c50 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbf02d76640 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e8064c50 0x5584e8082e70 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fbef8002fd0 tx=0x7fbef800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee43e80b9f675a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbec8bfc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbec8bfc640 1 -- 10.20.193.28:0/2617015720 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8016040 con 0x5584e8064c50 2026-02-20T03:40:54.738 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.726+0000 7fbec8bfc640 1 -- 10.20.193.28:0/2617015720 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fbef8029070 con 0x5584e8064c50 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbec8bfc640 1 -- 10.20.193.28:0/2617015720 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef801e430 con 0x5584e8064c50 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/2617015720 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584e7f7ab70 con 0x5584e8064c50 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbec8bfc640 1 -- 10.20.193.28:0/2617015720 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fbef801e5d0 con 0x5584e8064c50 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 10 client.22332 _ll_register_callbacks cb 0x7fbef400cde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/2617015720 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5584e7f866b0 con 0x5584e8064c50 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbec8bfc640 1 -- 10.20.193.28:0/2617015720 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fbef800b970 con 0x5584e8064c50 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 10 client.22332 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/2617015720 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5584e8077cd0 con 0x5584e8064c50 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbec8bfc640 1 -- 10.20.193.28:0/2617015720 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7fbef800bb10 con 0x5584e8064c50 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 10 client.22332 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 10 client.22332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:54.739 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 20 client.22332 populate_metadata read hostname 'trial028' 2026-02-20T03:40:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584e80f5360 0x5584e80f7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 4 client.22332 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2026-02-20T03:40:54.740 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.730+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/2617015720 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584e7fc3290 con 0x5584e80f5360 2026-02-20T03:40:54.742 INFO:tasks.workunit.client.0.trial028.stdout: 7 cleanup 625 sec 2026-02-20T03:40:54.748 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.746+0000 7fbf02575640 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584e80f5360 0x5584e80f7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:54.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.787+0000 7fbf02575640 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584e80f5360 0x5584e80f7820 crc :-1 s=READY pgs=636 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a60a2fd2b56d41da server_cookie=7e5f252637853a80 in_seq=0 out_seq=0 2026-02-20T03:40:54.789 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:54.787+0000 7fbec8bfc640 10 client.22332 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:55.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbec8bfc640 1 -- 10.20.193.28:0/2617015720 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584e7fc3290 con 0x5584e80f5360 2026-02-20T03:40:55.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbec8bfc640 10 client.22332 handle_command_reply: tid=0 2026-02-20T03:40:55.098 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 client.22332 shutdown 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/2617015720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e8064c50 msgr2=0x5584e8082e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e8064c50 0x5584e8082e70 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fbef8002fd0 tx=0x7fbef800b730 comp rx=0 tx=0).stop 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/2617015720 shutdown_connections 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5584e80f5360 0x5584e80f7820 crc :-1 s=READY pgs=636 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5584e806a600 0x5584e80843e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5584e80655b0 0x5584e80833b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 --2- 10.20.193.28:0/2617015720 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5584e8064c50 0x5584e8082e70 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/2617015720 >> 10.20.193.28:0/2617015720 conn(0x5584e805c2d0 msgr2=0x5584e807d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbec8bfc640 0 client.22332 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/2617015720 shutdown_connections 2026-02-20T03:40:55.099 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 1 -- 10.20.193.28:0/2617015720 wait complete. 2026-02-20T03:40:55.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.095+0000 7fbf0c06fe00 20 client.22332 trim_cache size 0 max 16384 2026-02-20T03:40:55.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:{ 2026-02-20T03:40:55.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "message": "", 2026-02-20T03:40:55.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout: "return_code": 0 2026-02-20T03:40:55.100 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stdout:} 2026-02-20T03:40:55.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 -- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbed40b0e20 msgr2=0x7fbed40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:55.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbed40b0e20 0x7fbed40b32e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5584e8065f50 tx=0x7fbef4009250 comp rx=0 tx=0).stop 2026-02-20T03:40:55.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 -- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 msgr2=0x7fbf0419d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:55.101 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 0x7fbf0419d0d0 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009950 tx=0x7fbeec02fd60 comp rx=0 tx=0).stop 2026-02-20T03:40:55.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 -- 10.20.193.28:0/2140315150 shutdown_connections 2026-02-20T03:40:55.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fbed40b0e20 0x7fbed40b32e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:55.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fbf041064f0 0x7fbf041a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:55.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fbf04105b30 0x7fbf0419d0d0 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:55.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 --2- 10.20.193.28:0/2140315150 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fbf04104940 0x7fbf0419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:55.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 -- 10.20.193.28:0/2140315150 >> 10.20.193.28:0/2140315150 conn(0x7fbf041000c0 msgr2=0x7fbf04108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:55.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 -- 10.20.193.28:0/2140315150 shutdown_connections 2026-02-20T03:40:55.102 INFO:teuthology.task.background_exec.ubuntu@trial028.front.sepia.ceph.com.trial028.stderr:2026-02-20T03:40:55.096+0000 7fbf08a0a640 1 -- 10.20.193.28:0/2140315150 wait complete. 2026-02-20T03:40:55.318 INFO:tasks.workunit.client.0.trial028.stdout: 0 cleanup 626 sec 2026-02-20T03:40:55.318 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-20T03:40:55.318 INFO:tasks.workunit.client.0.trial028.stdout: Operation Count AvgLat MaxLat 2026-02-20T03:40:55.318 INFO:tasks.workunit.client.0.trial028.stdout: ---------------------------------------- 2026-02-20T03:40:55.318 INFO:tasks.workunit.client.0.trial028.stdout: NTCreateX 368876 7.683 101821.304 2026-02-20T03:40:55.318 INFO:tasks.workunit.client.0.trial028.stdout: Close 270770 0.006 5.510 2026-02-20T03:40:55.318 INFO:tasks.workunit.client.0.trial028.stdout: Rename 15624 20.991 85359.612 2026-02-20T03:40:55.318 INFO:tasks.workunit.client.0.trial028.stdout: Unlink 74608 9.861 75009.050 2026-02-20T03:40:55.318 INFO:tasks.workunit.client.0.trial028.stdout: Qpathinfo 334454 5.412 102403.190 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: Qfileinfo 58264 0.003 3.095 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: Qfsinfo 61283 0.454 219.404 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: Sfileinfo 30086 0.091 1005.630 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: Find 129161 0.710 63598.774 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: WriteX 182111 0.187 22838.222 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: ReadX 578012 0.087 1359.034 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: LockX 1200 1.226 20.268 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: UnlockX 1200 1.006 17.287 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: Flush 25876 10.847 15419.111 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout: 2026-02-20T03:40:55.319 INFO:tasks.workunit.client.0.trial028.stdout:Throughput 19.1691 MB/sec 10 clients 10 procs max_latency=102403.198 ms 2026-02-20T03:40:55.321 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-20T03:40:55.321 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-20T03:40:56.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:55 trial028 ceph-mon[38552]: pgmap v973: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 128 KiB/s rd, 116 KiB/s wr, 49 op/s 2026-02-20T03:40:56.097 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:55 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:40:56.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:55 trial177 ceph-mon[43181]: pgmap v973: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 128 KiB/s rd, 116 KiB/s wr, 49 op/s 2026-02-20T03:40:56.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:55 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:40:56.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:55 trial126 ceph-mon[38476]: pgmap v973: 129 pgs: 129 active+clean; 673 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 128 KiB/s rd, 116 KiB/s wr, 49 op/s 2026-02-20T03:40:56.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:55 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-20T03:40:56.680 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2026-02-20T03:40:56.681 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-20T03:40:57.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:40:57.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:40:57.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:56 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:40:57.101 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:56 trial028 ceph-mon[38552]: pgmap v974: 129 pgs: 129 active+clean; 638 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 55 op/s 2026-02-20T03:40:57.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:40:57.217 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:40:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:56 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:40:57.218 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:56 trial177 ceph-mon[43181]: pgmap v974: 129 pgs: 129 active+clean; 638 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 55 op/s 2026-02-20T03:40:57.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-20T03:40:57.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-20T03:40:57.345 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:56 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' 2026-02-20T03:40:57.346 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:56 trial126 ceph-mon[38476]: pgmap v974: 129 pgs: 129 active+clean; 638 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 55 op/s 2026-02-20T03:40:57.729 DEBUG:teuthology.parallel:result is None 2026-02-20T03:40:57.730 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T03:40:57.790 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-20T03:40:57.790 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2026-02-20T03:40:57.809 INFO:tasks.quiescer:joining Quiescers 2026-02-20T03:40:57.809 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2026-02-20T03:40:57.810 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:40:58.017 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 scrub status 2026-02-20T03:40:58.076 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:40:58.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.263+0000 7f1215da5640 1 -- 10.20.193.28:0/3440333311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f121010eef0 msgr2=0x7f121010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.263+0000 7f1215da5640 1 --2- 10.20.193.28:0/3440333311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f121010eef0 0x7f121010f2d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1200009a30 tx=0x7f120002f260 comp rx=0 tx=0).stop 2026-02-20T03:40:58.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.263+0000 7f1215da5640 1 -- 10.20.193.28:0/3440333311 shutdown_connections 2026-02-20T03:40:58.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.263+0000 7f1215da5640 1 --2- 10.20.193.28:0/3440333311 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1210109ba0 0x7f1210115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.263+0000 7f1215da5640 1 --2- 10.20.193.28:0/3440333311 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1210109220 0x7f1210109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.263+0000 7f1215da5640 1 --2- 10.20.193.28:0/3440333311 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f121010eef0 0x7f121010f2d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.267 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.263+0000 7f1215da5640 1 -- 10.20.193.28:0/3440333311 >> 10.20.193.28:0/3440333311 conn(0x7f1210078600 msgr2=0x7f121007aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.263+0000 7f1215da5640 1 -- 10.20.193.28:0/3440333311 shutdown_connections 2026-02-20T03:40:58.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.263+0000 7f1215da5640 1 -- 10.20.193.28:0/3440333311 wait complete. 2026-02-20T03:40:58.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.264+0000 7f1215da5640 1 Processor -- start 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.264+0000 7f1215da5640 1 -- start start 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.264+0000 7f1215da5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1210109220 0x7f1210074670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.264+0000 7f1215da5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1210109ba0 0x7f1210074bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.264+0000 7f1215da5640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121010eef0 0x7f121006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.264+0000 7f1215da5640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1210119030 con 0x7f1210109ba0 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.264+0000 7f1215da5640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1210118eb0 con 0x7f1210109220 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.264+0000 7f1215da5640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f12101191b0 con 0x7f121010eef0 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f1214da3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1210109220 0x7f1210074670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f12155a4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121010eef0 0x7f121006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f1207fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1210109ba0 0x7f1210074bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.269 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f12155a4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121010eef0 0x7f121006d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51516/0 (socket says 10.20.193.28:51516) 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f1214da3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1210109220 0x7f1210074670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47278/0 (socket says 10.20.193.28:47278) 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f12155a4640 1 -- 10.20.193.28:0/1346951561 learned_addr learned my addr 10.20.193.28:0/1346951561 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f12155a4640 1 -- 10.20.193.28:0/1346951561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1210109220 msgr2=0x7f1210074670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f12155a4640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1210109220 0x7f1210074670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f12155a4640 1 -- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1210109ba0 msgr2=0x7f1210074bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f12155a4640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1210109ba0 0x7f1210074bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f12155a4640 1 -- 10.20.193.28:0/1346951561 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121006e0e0 con 0x7f121010eef0 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f1214da3640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1210109220 0x7f1210074670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.265+0000 7f1207fff640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1210109ba0 0x7f1210074bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:40:58.270 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.266+0000 7f12155a4640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121010eef0 0x7f121006d7d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f120c00ef30 tx=0x7f120c00c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.266+0000 7f1205ffb640 1 -- 10.20.193.28:0/1346951561 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c019070 con 0x7f121010eef0 2026-02-20T03:40:58.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.266+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121006e310 con 0x7f121010eef0 2026-02-20T03:40:58.271 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.266+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1210072370 con 0x7f121010eef0 2026-02-20T03:40:58.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.266+0000 7f1205ffb640 1 -- 10.20.193.28:0/1346951561 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f120c0092d0 con 0x7f121010eef0 2026-02-20T03:40:58.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.266+0000 7f1205ffb640 1 -- 10.20.193.28:0/1346951561 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c007500 con 0x7f121010eef0 2026-02-20T03:40:58.272 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.267+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121010a580 con 0x7f121010eef0 2026-02-20T03:40:58.273 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.270+0000 7f1205ffb640 1 -- 10.20.193.28:0/1346951561 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f120c002a60 con 0x7f121010eef0 2026-02-20T03:40:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.272+0000 7f1205ffb640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11ec0b0e20 0x7f11ec0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.272+0000 7f1205ffb640 1 -- 10.20.193.28:0/1346951561 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f120c0e09e0 con 0x7f121010eef0 2026-02-20T03:40:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.272+0000 7f1214da3640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11ec0b0e20 0x7f11ec0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.275 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.272+0000 7f1205ffb640 1 -- 10.20.193.28:0/1346951561 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f120c010040 con 0x7f121010eef0 2026-02-20T03:40:58.276 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.273+0000 7f1214da3640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11ec0b0e20 0x7f11ec0b32e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1200002410 tx=0x7f120003a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.288 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:40:58.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.381+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1210072e80 con 0x7f121010eef0 2026-02-20T03:40:58.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.382+0000 7f1205ffb640 1 -- 10.20.193.28:0/1346951561 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+11925 (secure 0 0 0) 0x7f120c0aca70 con 0x7f121010eef0 2026-02-20T03:40:58.385 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:40:58.385 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":59,"btime":"2026-02-20T03:39:43:533677+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":59,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:39:43.492349+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:40:58.386 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 59 2026-02-20T03:40:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.383+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11ec0b0e20 msgr2=0x7f11ec0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.383+0000 7f1215da5640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11ec0b0e20 0x7f11ec0b32e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1200002410 tx=0x7f120003a040 comp rx=0 tx=0).stop 2026-02-20T03:40:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.383+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121010eef0 msgr2=0x7f121006d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.383+0000 7f1215da5640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121010eef0 0x7f121006d7d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f120c00ef30 tx=0x7f120c00c560 comp rx=0 tx=0).stop 2026-02-20T03:40:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.384+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 shutdown_connections 2026-02-20T03:40:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.384+0000 7f1215da5640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f11ec0b0e20 0x7f11ec0b32e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.384+0000 7f1215da5640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f121010eef0 0x7f121006d7d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.384+0000 7f1215da5640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1210109ba0 0x7f1210074bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.384+0000 7f1215da5640 1 --2- 10.20.193.28:0/1346951561 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1210109220 0x7f1210074670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.384+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 >> 10.20.193.28:0/1346951561 conn(0x7f1210078600 msgr2=0x7f1210079fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.384+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 shutdown_connections 2026-02-20T03:40:58.388 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.384+0000 7f1215da5640 1 -- 10.20.193.28:0/1346951561 wait complete. 2026-02-20T03:40:58.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1250472358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac109220 msgr2=0x7ff2ac109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1250472358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac109220 0x7ff2ac109660 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009a30 tx=0x7ff29c02f220 comp rx=0 tx=0).stop 2026-02-20T03:40:58.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1250472358 shutdown_connections 2026-02-20T03:40:58.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1250472358 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2ac109ba0 0x7ff2ac115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1250472358 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac109220 0x7ff2ac109660 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1250472358 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2ac10eef0 0x7ff2ac10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1250472358 >> 10.20.193.28:0/1250472358 conn(0x7ff2ac078600 msgr2=0x7ff2ac07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1250472358 shutdown_connections 2026-02-20T03:40:58.477 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1250472358 wait complete. 2026-02-20T03:40:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 Processor -- start 2026-02-20T03:40:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.474+0000 7ff2b0b88640 1 -- start start 2026-02-20T03:40:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2b0b88640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2ac109220 0x7ff2ac1a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2b0b88640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2ac109ba0 0x7ff2ac1a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2b0b88640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac10eef0 0x7ff2ac1a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2b0b88640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac1190a0 con 0x7ff2ac10eef0 2026-02-20T03:40:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2b0b88640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac118f20 con 0x7ff2ac109220 2026-02-20T03:40:58.479 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2b0b88640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ac119220 con 0x7ff2ac109ba0 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2abfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac10eef0 0x7ff2ac1a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2abfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac10eef0 0x7ff2ac1a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51794/0 (socket says 10.20.193.28:51794) 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2abfff640 1 -- 10.20.193.28:0/1349678670 learned_addr learned my addr 10.20.193.28:0/1349678670 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2ac109220 0x7ff2ac1a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2abfff640 1 -- 10.20.193.28:0/1349678670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2ac109ba0 msgr2=0x7ff2ac1a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2ac109ba0 0x7ff2ac1a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2abfff640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2ac109ba0 0x7ff2ac1a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2abfff640 1 -- 10.20.193.28:0/1349678670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2ac109220 msgr2=0x7ff2ac1a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2abfff640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2ac109220 0x7ff2ac1a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2abfff640 1 -- 10.20.193.28:0/1349678670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ac1a65b0 con 0x7ff2ac10eef0 2026-02-20T03:40:58.480 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2ac109220 0x7ff2ac1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:40:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.475+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2ac109ba0 0x7ff2ac1a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:40:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.476+0000 7ff2abfff640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac10eef0 0x7ff2ac1a5e30 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0004820 tx=0x7ff2a000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.476+0000 7ff2a8ff9640 1 -- 10.20.193.28:0/1349678670 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a00090d0 con 0x7ff2ac10eef0 2026-02-20T03:40:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.476+0000 7ff2a8ff9640 1 -- 10.20.193.28:0/1349678670 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff2a0009270 con 0x7ff2ac10eef0 2026-02-20T03:40:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.476+0000 7ff2a8ff9640 1 -- 10.20.193.28:0/1349678670 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0013810 con 0x7ff2ac10eef0 2026-02-20T03:40:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.476+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1349678670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ac1a6840 con 0x7ff2ac10eef0 2026-02-20T03:40:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.476+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1349678670 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ac1ae0e0 con 0x7ff2ac10eef0 2026-02-20T03:40:58.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.478+0000 7ff2a8ff9640 1 -- 10.20.193.28:0/1349678670 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff2a0012070 con 0x7ff2ac10eef0 2026-02-20T03:40:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.479+0000 7ff2b4316e00 1 Processor -- start 2026-02-20T03:40:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.479+0000 7ff2b4316e00 1 -- start start 2026-02-20T03:40:58.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b92363e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b9230a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b923ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6b91b0e50 con 0x55b6b9230fb0 2026-02-20T03:40:58.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b6b91839c0 con 0x55b6b9230630 2026-02-20T03:40:58.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6b9131240 con 0x55b6b9236000 2026-02-20T03:40:58.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2ab7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b9230a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.485 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2ab7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b9230a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47314/0 (socket says 10.20.193.28:47314) 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2ab7fe640 1 -- 10.20.193.28:0/2862954531 learned_addr learned my addr 10.20.193.28:0/2862954531 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/2862954531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b923ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/2862954531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b92363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2ab7fe640 1 -- 10.20.193.28:0/2862954531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 msgr2=0x55b6b92363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/2862954531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b92363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2ab7fe640 1 -- 10.20.193.28:0/2862954531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 msgr2=0x55b6b923ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/2862954531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b923ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2ab7fe640 1 -- 10.20.193.28:0/2862954531 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b9144420 con 0x55b6b9230630 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2a8ff9640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2800b0da0 0x7ff2800b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.480+0000 7ff2a8ff9640 1 -- 10.20.193.28:0/1349678670 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff2a00e0470 con 0x7ff2ac10eef0 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2abfff640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2800b0da0 0x7ff2800b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/2862954531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b9230a70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff298002b90 tx=0x7ff29800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c9f3eafc31e9b13 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff26ffff640 1 -- 10.20.193.28:0/2862954531 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298015070 con 0x55b6b9230630 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff26ffff640 1 -- 10.20.193.28:0/2862954531 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff2980118e0 con 0x55b6b9230630 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff26ffff640 1 -- 10.20.193.28:0/2862954531 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298010890 con 0x55b6b9230630 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2b4316e00 1 -- 10.20.193.28:0/2862954531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 msgr2=0x55b6b9230a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2abfff640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2800b0da0 0x7ff2800b3260 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00a7eb0 tx=0x7ff2a000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/2862954531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b9230a70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff298002b90 tx=0x7ff29800f730 comp rx=0 tx=0).stop 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2b4316e00 1 -- 10.20.193.28:0/2862954531 shutdown_connections 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/2862954531 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b923ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/2862954531 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b9230a70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/2862954531 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b92363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.481+0000 7ff2b4316e00 1 -- 10.20.193.28:0/2862954531 >> 10.20.193.28:0/2862954531 conn(0x55b6b91f3290 msgr2=0x55b6b922ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.487 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.482+0000 7ff2b4316e00 1 -- 10.20.193.28:0/2862954531 shutdown_connections 2026-02-20T03:40:58.488 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.482+0000 7ff2b4316e00 1 -- 10.20.193.28:0/2862954531 wait complete. 2026-02-20T03:40:58.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.483+0000 7ff2b4316e00 1 -- start start 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.483+0000 7ff2b4316e00 1 Processor -- start 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.483+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b924ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.483+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b924b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.483+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b9249270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.483+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x55b6b917f8f0 con 0x55b6b9230fb0 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.483+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x55b6b8f71f50 con 0x55b6b9230630 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.483+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x55b6b92499f0 con 0x55b6b9236000 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.483+0000 7ff2ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b924b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2ab7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b924b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51810/0 (socket says 10.20.193.28:51810) 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2ab7fe640 1 -- 10.20.193.28:0/1056358827 learned_addr learned my addr 10.20.193.28:0/1056358827 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.490 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b924ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b9249270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2ab7fe640 1 -- 10.20.193.28:0/1056358827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 msgr2=0x55b6b9249270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b9249270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2ab7fe640 1 -- 10.20.193.28:0/1056358827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 msgr2=0x55b6b924ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b924ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2ab7fe640 1 -- 10.20.193.28:0/1056358827 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b92429e0 con 0x55b6b9230fb0 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b924b070 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7ff298003fd0 tx=0x7ff298002ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1944d43789c426 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff26d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1056358827 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298015070 con 0x55b6b9230fb0 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1056358827 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff298005050 con 0x55b6b9230fb0 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1056358827 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298004a20 con 0x55b6b9230fb0 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.484+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1056358827 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b8f54b40 con 0x55b6b9230fb0 2026-02-20T03:40:58.491 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1056358827 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff298004bc0 con 0x55b6b9230fb0 2026-02-20T03:40:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 10 client.22350 _ll_register_callbacks cb 0x55b6b91bcf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:58.492 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1056358827 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6b91911a0 con 0x55b6b9230fb0 2026-02-20T03:40:58.493 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24560 quiesce db --cancel --all' 2026-02-20T03:40:58.494 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- timeout 105 ceph tell mds.24560 quiesce db --cancel --all 2026-02-20T03:40:58.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1056358827 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7ff298032050 con 0x55b6b9230fb0 2026-02-20T03:40:58.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 10 client.22350 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:58.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1056358827 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x55b6b913e230 con 0x55b6b9230fb0 2026-02-20T03:40:58.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1056358827 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7ff298011a90 con 0x55b6b9230fb0 2026-02-20T03:40:58.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 10 client.22350 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:58.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 10 client.22350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:58.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 20 client.22350 populate_metadata read hostname 'trial028' 2026-02-20T03:40:58.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6b92591d0 0x55b6b925b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 4 client.22350 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.485+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1056358827 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6b918b5b0 con 0x55b6b92591d0 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.486+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6b92591d0 0x55b6b925b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.486+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6b92591d0 0x55b6b925b5c0 crc :-1 s=READY pgs=637 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41c0fa6041e8c9cb server_cookie=6c7c44f973395425 in_seq=0 out_seq=0 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.486+0000 7ff26d7fa640 10 client.22350 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1056358827 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b6b918b5b0 con 0x55b6b92591d0 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff26d7fa640 10 client.22350 handle_command_reply: tid=0 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 client.22350 shutdown 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1056358827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 msgr2=0x55b6b924b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b924b070 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7ff298003fd0 tx=0x7ff298002ec0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1056358827 shutdown_connections 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6b92591d0 0x55b6b925b5c0 crc :-1 s=READY pgs=637 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.497 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b9249270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230fb0 0x55b6b924b070 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1056358827 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b924ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff26d7fa640 0 client.22350 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1056358827 >> 10.20.193.28:0/1056358827 conn(0x55b6b91f3290 msgr2=0x55b6b922f440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1056358827 shutdown_connections 2026-02-20T03:40:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1056358827 wait complete. 2026-02-20T03:40:58.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.487+0000 7ff2b4316e00 20 client.22350 trim_cache size 0 max 16384 2026-02-20T03:40:58.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.495+0000 7ff2b4316e00 1 Processor -- start 2026-02-20T03:40:58.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.495+0000 7ff2b4316e00 1 -- start start 2026-02-20T03:40:58.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230630 0x55b6b9232170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230fb0 0x55b6b92326b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b922f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff250012690 con 0x55b6b9230630 2026-02-20T03:40:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff25000fed0 con 0x55b6b9230fb0 2026-02-20T03:40:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff25000dd20 con 0x55b6b9236000 2026-02-20T03:40:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2aaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230630 0x55b6b9232170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2ab7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230fb0 0x55b6b92326b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2aaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230630 0x55b6b9232170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51824/0 (socket says 10.20.193.28:51824) 2026-02-20T03:40:58.500 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2aaffd640 1 -- 10.20.193.28:0/682237777 learned_addr learned my addr 10.20.193.28:0/682237777 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2aaffd640 1 -- 10.20.193.28:0/682237777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 msgr2=0x55b6b922f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.503 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/682237777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b922f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2aaffd640 1 -- 10.20.193.28:0/682237777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230fb0 msgr2=0x55b6b92326b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/682237777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230fb0 0x55b6b92326b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.496+0000 7ff2aaffd640 1 -- 10.20.193.28:0/682237777 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b9242810 con 0x55b6b9230630 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/682237777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230630 0x55b6b9232170 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009a00 tx=0x7ff29c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8acccbe0ebbd7aa server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff26f7fe640 1 -- 10.20.193.28:0/682237777 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004050 con 0x55b6b9230630 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff26f7fe640 1 -- 10.20.193.28:0/682237777 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff29c04d070 con 0x55b6b9230630 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff26f7fe640 1 -- 10.20.193.28:0/682237777 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0028b0 con 0x55b6b9230630 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2b4316e00 1 -- 10.20.193.28:0/682237777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230630 msgr2=0x55b6b9232170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/682237777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230630 0x55b6b9232170 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009a00 tx=0x7ff29c009340 comp rx=0 tx=0).stop 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2b4316e00 1 -- 10.20.193.28:0/682237777 shutdown_connections 2026-02-20T03:40:58.504 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/682237777 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9236000 0x55b6b922f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/682237777 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230fb0 0x55b6b92326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/682237777 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9230630 0x55b6b9232170 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2b4316e00 1 -- 10.20.193.28:0/682237777 >> 10.20.193.28:0/682237777 conn(0x55b6b91f3290 msgr2=0x55b6b9231a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2b4316e00 1 -- 10.20.193.28:0/682237777 shutdown_connections 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.497+0000 7ff2b4316e00 1 -- 10.20.193.28:0/682237777 wait complete. 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2b4316e00 1 -- start start 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2b4316e00 1 Processor -- start 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b924e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9230fb0 0x55b6b924e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2b4316e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9236000 0x55b6b92c4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff25000e390 con 0x55b6b9236000 2026-02-20T03:40:58.505 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff25000f800 con 0x55b6b9230630 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2b4316e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff25000ea60 con 0x55b6b9230fb0 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2aaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9236000 0x55b6b92c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2aaffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9236000 0x55b6b92c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51840/0 (socket says 10.20.193.28:51840) 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2aaffd640 1 -- 10.20.193.28:0/1701875618 learned_addr learned my addr 10.20.193.28:0/1701875618 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b924e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.498+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9230fb0 0x55b6b924e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff2aaffd640 1 -- 10.20.193.28:0/1701875618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9230fb0 msgr2=0x55b6b924e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9230fb0 0x55b6b924e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff2aaffd640 1 -- 10.20.193.28:0/1701875618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9236000 msgr2=0x55b6b92c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9236000 0x55b6b92c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff2aaffd640 1 -- 10.20.193.28:0/1701875618 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b8e62870 con 0x55b6b9230630 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff2aaffd640 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b924e0b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff29c038db0 tx=0x7ff29c0023d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c957253bcd2682 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.506 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff26d7fa640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1701875618 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c038970 con 0x55b6b9230630 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1701875618 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b9123440 con 0x55b6b9230630 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff2b4316e00 10 client.28952 _ll_register_callbacks cb 0x7ff29c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1701875618 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6b9135b00 con 0x55b6b9230630 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1701875618 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff29c033040 con 0x55b6b9230630 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.499+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1701875618 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c051480 con 0x55b6b9230630 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1701875618 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff29c051620 con 0x55b6b9230630 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1701875618 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7ff29c065050 con 0x55b6b9230630 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff2b4316e00 10 client.28952 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1701875618 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=59}) -- 0x55b6b9243500 con 0x55b6b9230630 2026-02-20T03:40:58.507 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1701875618 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7ff29c004030 con 0x55b6b9230630 2026-02-20T03:40:58.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff2b4316e00 10 client.28952 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:58.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff2b4316e00 10 client.28952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:40:58.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff2b4316e00 20 client.28952 populate_metadata read hostname 'trial028' 2026-02-20T03:40:58.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6b92c5780 0x55b6b92c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff2b4316e00 4 client.28952 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2026-02-20T03:40:58.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1701875618 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7ff29c04d070 con 0x55b6b92c5780 2026-02-20T03:40:58.508 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.500+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6b92c5780 0x55b6b92c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.501+0000 7ff2ab7fe640 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6b92c5780 0x55b6b92c7c40 crc :-1 s=READY pgs=638 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a2f9a0acd97393a server_cookie=15cca98287e71f3c in_seq=0 out_seq=0 2026-02-20T03:40:58.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.501+0000 7ff26d7fa640 10 client.28952 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:58.509 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.501+0000 7ff26d7fa640 1 -- 10.20.193.28:0/1701875618 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7ff29c04d070 con 0x55b6b92c5780 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.501+0000 7ff26d7fa640 10 client.28952 handle_command_reply: tid=0 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.501+0000 7ff2b4316e00 1 client.28952 shutdown 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1701875618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 msgr2=0x55b6b924e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b924e0b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff29c038db0 tx=0x7ff29c0023d0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1701875618 shutdown_connections 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x55b6b92c5780 0x55b6b92c7c40 crc :-1 s=READY pgs=638 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x55b6b9236000 0x55b6b92c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x55b6b9230fb0 0x55b6b924e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 --2- 10.20.193.28:0/1701875618 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x55b6b9230630 0x55b6b924e0b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1701875618 >> 10.20.193.28:0/1701875618 conn(0x55b6b91f3290 msgr2=0x55b6b9232280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff26d7fa640 0 client.28952 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1701875618 shutdown_connections 2026-02-20T03:40:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 1 -- 10.20.193.28:0/1701875618 wait complete. 2026-02-20T03:40:58.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.502+0000 7ff2b4316e00 20 client.28952 trim_cache size 0 max 16384 2026-02-20T03:40:58.511 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:40:58.511 INFO:teuthology.orchestra.run.trial028.stdout: "status": "no active scrubs running", 2026-02-20T03:40:58.511 INFO:teuthology.orchestra.run.trial028.stdout: "scrubs": {} 2026-02-20T03:40:58.511 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:40:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.503+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2800b0da0 msgr2=0x7ff2800b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.512 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.503+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2800b0da0 0x7ff2800b3260 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00a7eb0 tx=0x7ff2a000b040 comp rx=0 tx=0).stop 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.503+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac10eef0 msgr2=0x7ff2ac1a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.503+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac10eef0 0x7ff2ac1a5e30 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0004820 tx=0x7ff2a000d4a0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.503+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1349678670 shutdown_connections 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.503+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2800b0da0 0x7ff2800b3260 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.504+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2ac10eef0 0x7ff2ac1a5e30 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.504+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2ac109ba0 0x7ff2ac1a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.504+0000 7ff2b0b88640 1 --2- 10.20.193.28:0/1349678670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2ac109220 0x7ff2ac1a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.504+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1349678670 >> 10.20.193.28:0/1349678670 conn(0x7ff2ac078600 msgr2=0x7ff2ac079ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.504+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1349678670 shutdown_connections 2026-02-20T03:40:58.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.504+0000 7ff2b0b88640 1 -- 10.20.193.28:0/1349678670 wait complete. 2026-02-20T03:40:58.601 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:58 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1346951561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:40:58.604 INFO:tasks.cephfs.filesystem:all active scrubs completed 2026-02-20T03:40:58.604 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:40:58.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:58 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1346951561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:40:58.763 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:40:58.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:58 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1346951561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:40:58.939 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.958+0000 7f201a0a6640 1 -- 10.20.193.28:0/1376616195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 msgr2=0x7f2014108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.958+0000 7f201a0a6640 1 --2- 10.20.193.28:0/1376616195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 0x7f2014108ae0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f2004009a60 tx=0x7f200402f260 comp rx=0 tx=0).stop 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.958+0000 7f201a0a6640 1 -- 10.20.193.28:0/1376616195 shutdown_connections 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.958+0000 7f201a0a6640 1 --2- 10.20.193.28:0/1376616195 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f20141030a0 0x7f201410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.958+0000 7f201a0a6640 1 --2- 10.20.193.28:0/1376616195 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2014102700 0x7f2014102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.958+0000 7f201a0a6640 1 --2- 10.20.193.28:0/1376616195 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 0x7f2014108ae0 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.958+0000 7f201a0a6640 1 -- 10.20.193.28:0/1376616195 >> 10.20.193.28:0/1376616195 conn(0x7f20140fe440 msgr2=0x7f2014100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.958+0000 7f201a0a6640 1 -- 10.20.193.28:0/1376616195 shutdown_connections 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.958+0000 7f201a0a6640 1 -- 10.20.193.28:0/1376616195 wait complete. 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.959+0000 7f201a0a6640 1 Processor -- start 2026-02-20T03:40:58.962 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.959+0000 7f201a0a6640 1 -- start start 2026-02-20T03:40:58.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.959+0000 7f201a0a6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2014102700 0x7f201419d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.959+0000 7f201a0a6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f20141030a0 0x7f201419d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.959+0000 7f201a0a6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 0x7f20141a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.959+0000 7f201a0a6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2014114c00 con 0x7f2014108700 2026-02-20T03:40:58.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.959+0000 7f201a0a6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2014114a80 con 0x7f2014102700 2026-02-20T03:40:58.964 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.959+0000 7f201a0a6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2014114d80 con 0x7f20141030a0 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20198a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 0x7f20141a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20190a4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2014102700 0x7f201419d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20198a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 0x7f20141a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51862/0 (socket says 10.20.193.28:51862) 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20198a5640 1 -- 10.20.193.28:0/633635943 learned_addr learned my addr 10.20.193.28:0/633635943 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20188a3640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f20141030a0 0x7f201419d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20198a5640 1 -- 10.20.193.28:0/633635943 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f20141030a0 msgr2=0x7f201419d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20198a5640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f20141030a0 0x7f201419d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20198a5640 1 -- 10.20.193.28:0/633635943 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2014102700 msgr2=0x7f201419d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20198a5640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2014102700 0x7f201419d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20198a5640 1 -- 10.20.193.28:0/633635943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20141a20b0 con 0x7f2014108700 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20188a3640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f20141030a0 0x7f201419d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:40:58.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20198a5640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 0x7f20141a1930 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f2010004820 tx=0x7f201000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.960+0000 7f20027fc640 1 -- 10.20.193.28:0/633635943 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20100090d0 con 0x7f2014108700 2026-02-20T03:40:58.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.961+0000 7f20027fc640 1 -- 10.20.193.28:0/633635943 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2010009270 con 0x7f2014108700 2026-02-20T03:40:58.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.961+0000 7f20027fc640 1 -- 10.20.193.28:0/633635943 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2010013810 con 0x7f2014108700 2026-02-20T03:40:58.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.961+0000 7f201a0a6640 1 -- 10.20.193.28:0/633635943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20141a2340 con 0x7f2014108700 2026-02-20T03:40:58.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.961+0000 7f201a0a6640 1 -- 10.20.193.28:0/633635943 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20141a9be0 con 0x7f2014108700 2026-02-20T03:40:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.964+0000 7f20027fc640 1 -- 10.20.193.28:0/633635943 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2010012070 con 0x7f2014108700 2026-02-20T03:40:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.964+0000 7f201d834e00 1 Processor -- start 2026-02-20T03:40:58.967 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.964+0000 7f201d834e00 1 -- start start 2026-02-20T03:40:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.964+0000 7f201d834e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03942d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.964+0000 7f201d834e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f0398370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.964+0000 7f201d834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03a0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.964+0000 7f201d834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5603f02e6d90 con 0x5603f0398aa0 2026-02-20T03:40:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.964+0000 7f201d834e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5603f02945d0 con 0x5603f0393ef0 2026-02-20T03:40:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.964+0000 7f201d834e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5603f02e2cc0 con 0x5603f03948a0 2026-02-20T03:40:58.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20188a3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03942d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20188a3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03942d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47380/0 (socket says 10.20.193.28:47380) 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20188a3640 1 -- 10.20.193.28:0/346485151 learned_addr learned my addr 10.20.193.28:0/346485151 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20190a4640 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f0398370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20188a3640 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20188a3640 1 -- 10.20.193.28:0/346485151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 msgr2=0x5603f0398370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20188a3640 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f0398370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20188a3640 1 -- 10.20.193.28:0/346485151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 msgr2=0x5603f03a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20188a3640 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20188a3640 1 -- 10.20.193.28:0/346485151 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f028da50 con 0x5603f0393ef0 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.965+0000 7f20190a4640 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f0398370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.966+0000 7f20188a3640 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03942d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2008014a40 tx=0x7f2008007560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2cff9a45ce0bfc8 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.966+0000 7f20027fc640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fe40b0e20 0x7f1fe40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.966+0000 7f1fe1ce5640 1 -- 10.20.193.28:0/346485151 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20080142d0 con 0x5603f0393ef0 2026-02-20T03:40:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.966+0000 7f1fe1ce5640 1 -- 10.20.193.28:0/346485151 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2008004520 con 0x5603f0393ef0 2026-02-20T03:40:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.966+0000 7f1fe1ce5640 1 -- 10.20.193.28:0/346485151 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20080026e0 con 0x5603f0393ef0 2026-02-20T03:40:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.966+0000 7f20190a4640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fe40b0e20 0x7f1fe40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.966+0000 7f20027fc640 1 -- 10.20.193.28:0/633635943 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f20100e02f0 con 0x7f2014108700 2026-02-20T03:40:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.966+0000 7f201d834e00 1 -- 10.20.193.28:0/346485151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 msgr2=0x5603f03942d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.971 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.966+0000 7f201d834e00 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03942d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2008014a40 tx=0x7f2008007560 comp rx=0 tx=0).stop 2026-02-20T03:40:58.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.967+0000 7f20190a4640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fe40b0e20 0x7f1fe40b32e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2004005d20 tx=0x7f2004005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.967+0000 7f201d834e00 1 -- 10.20.193.28:0/346485151 shutdown_connections 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.967+0000 7f201d834e00 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.967+0000 7f201d834e00 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f0398370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.967+0000 7f201d834e00 1 --2- 10.20.193.28:0/346485151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03942d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.967+0000 7f201d834e00 1 -- 10.20.193.28:0/346485151 >> 10.20.193.28:0/346485151 conn(0x5603f038c990 msgr2=0x5603f0392410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.967+0000 7f201d834e00 1 -- 10.20.193.28:0/346485151 shutdown_connections 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.967+0000 7f201d834e00 1 -- 10.20.193.28:0/346485151 wait complete. 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.968+0000 7f201d834e00 1 -- start start 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f201d834e00 1 Processor -- start 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f201d834e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03ba720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f201d834e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f201d834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f201d834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5603f028e3b0 con 0x5603f0398aa0 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f201d834e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5603f03a0d20 con 0x5603f0393ef0 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f201d834e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5603f03b5e90 con 0x5603f03948a0 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f20190a4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03ba720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f20190a4640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03ba720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47384/0 (socket says 10.20.193.28:47384) 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f20190a4640 1 -- 10.20.193.28:0/862310071 learned_addr learned my addr 10.20.193.28:0/862310071 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f20188a3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.969+0000 7f20198a5640 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f20188a3640 1 -- 10.20.193.28:0/862310071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 msgr2=0x5603f03ba720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f20188a3640 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03ba720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f20188a3640 1 -- 10.20.193.28:0/862310071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 msgr2=0x5603f03b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f20188a3640 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f20188a3640 1 -- 10.20.193.28:0/862310071 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f03aed90 con 0x5603f03948a0 2026-02-20T03:40:58.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f20188a3640 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bac60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2008004000 tx=0x7f2008014400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8edd1ff0f345ecc0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f1fceffd640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:40:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f1fceffd640 1 -- 10.20.193.28:0/862310071 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008007c60 con 0x5603f03948a0 2026-02-20T03:40:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f201d834e00 1 -- 10.20.193.28:0/862310071 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603f00b5ad0 con 0x5603f03948a0 2026-02-20T03:40:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f1fceffd640 1 -- 10.20.193.28:0/862310071 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f20080026e0 con 0x5603f03948a0 2026-02-20T03:40:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f201d834e00 10 client.28948 _ll_register_callbacks cb 0x5603f02922e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f201d834e00 1 -- 10.20.193.28:0/862310071 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5603f02ee980 con 0x5603f03948a0 2026-02-20T03:40:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.970+0000 7f1fceffd640 1 -- 10.20.193.28:0/862310071 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008007c60 con 0x5603f03948a0 2026-02-20T03:40:58.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f1fceffd640 1 -- 10.20.193.28:0/862310071 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2008012450 con 0x5603f03948a0 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f1fceffd640 1 -- 10.20.193.28:0/862310071 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f2008004030 con 0x5603f03948a0 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f201d834e00 10 client.28948 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f201d834e00 1 -- 10.20.193.28:0/862310071 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5603f02b3640 con 0x5603f03948a0 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f1fceffd640 1 -- 10.20.193.28:0/862310071 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f2008031050 con 0x5603f03948a0 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f201d834e00 10 client.28948 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f201d834e00 10 client.28948 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f201d834e00 20 client.28948 populate_metadata read hostname 'trial028' 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f201d834e00 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5603f03c57a0 0x5603f03c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f201d834e00 4 client.28948 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.971+0000 7f201d834e00 1 -- 10.20.193.28:0/862310071 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603f0268d70 con 0x5603f03c57a0 2026-02-20T03:40:58.978 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.972+0000 7f20190a4640 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5603f03c57a0 0x5603f03c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.972+0000 7f20190a4640 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5603f03c57a0 0x5603f03c7b90 crc :-1 s=READY pgs=639 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=798c6de5fed5f9d server_cookie=197d7b3714531eb2 in_seq=0 out_seq=0 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.972+0000 7f1fceffd640 10 client.28948 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f1fceffd640 1 -- 10.20.193.28:0/862310071 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5603f0268d70 con 0x5603f03c57a0 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f1fceffd640 10 client.28948 handle_command_reply: tid=0 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 client.28948 shutdown 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 -- 10.20.193.28:0/862310071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 msgr2=0x5603f03bac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bac60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2008004000 tx=0x7f2008014400 comp rx=0 tx=0).stop 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 -- 10.20.193.28:0/862310071 shutdown_connections 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5603f03c57a0 0x5603f03c7b90 crc :-1 s=READY pgs=639 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.979 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bac60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 --2- 10.20.193.28:0/862310071 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03ba720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 -- 10.20.193.28:0/862310071 >> 10.20.193.28:0/862310071 conn(0x5603f038c990 msgr2=0x5603f0397350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f1fceffd640 0 client.28948 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 -- 10.20.193.28:0/862310071 shutdown_connections 2026-02-20T03:40:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 1 -- 10.20.193.28:0/862310071 wait complete. 2026-02-20T03:40:58.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.973+0000 7f201d834e00 20 client.28948 trim_cache size 0 max 16384 2026-02-20T03:40:58.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.982+0000 7f201d834e00 1 Processor -- start 2026-02-20T03:40:58.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.982+0000 7f201d834e00 1 -- start start 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.982+0000 7f201d834e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f0393ef0 0x5603f03b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.982+0000 7f201d834e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f03948a0 0x5603f03cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.982+0000 7f201d834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.982+0000 7f201d834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc0012800 con 0x5603f0398aa0 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.982+0000 7f201d834e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc0010040 con 0x5603f03948a0 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.982+0000 7f201d834e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc000de30 con 0x5603f0393ef0 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20188a3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f03948a0 0x5603f03cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20190a4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f0393ef0 0x5603f03b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20190a4640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f0393ef0 0x5603f03b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51614/0 (socket says 10.20.193.28:51614) 2026-02-20T03:40:58.986 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20188a3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f03948a0 0x5603f03cd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47392/0 (socket says 10.20.193.28:47392) 2026-02-20T03:40:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20188a3640 1 -- 10.20.193.28:0/3261525880 learned_addr learned my addr 10.20.193.28:0/3261525880 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20198a5640 1 --2- 10.20.193.28:0/3261525880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20190a4640 1 -- 10.20.193.28:0/3261525880 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f03948a0 msgr2=0x5603f03cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20190a4640 1 --2- 10.20.193.28:0/3261525880 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f03948a0 0x5603f03cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20190a4640 1 -- 10.20.193.28:0/3261525880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 msgr2=0x5603f03cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20190a4640 1 --2- 10.20.193.28:0/3261525880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20190a4640 1 -- 10.20.193.28:0/3261525880 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f0391f60 con 0x5603f0393ef0 2026-02-20T03:40:58.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20198a5640 1 --2- 10.20.193.28:0/3261525880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:40:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.983+0000 7f20190a4640 1 --2- 10.20.193.28:0/3261525880 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f0393ef0 0x5603f03b4770 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5603f03c8310 tx=0x7f2004009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=995aa795b7fbf1b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f1fe14e4640 1 -- 10.20.193.28:0/3261525880 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004004c10 con 0x5603f0393ef0 2026-02-20T03:40:58.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f1fe14e4640 1 -- 10.20.193.28:0/3261525880 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2004033040 con 0x5603f0393ef0 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f1fe14e4640 1 -- 10.20.193.28:0/3261525880 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004038cd0 con 0x5603f0393ef0 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f201d834e00 1 -- 10.20.193.28:0/3261525880 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f0393ef0 msgr2=0x5603f03b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f201d834e00 1 --2- 10.20.193.28:0/3261525880 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f0393ef0 0x5603f03b4770 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x5603f03c8310 tx=0x7f2004009340 comp rx=0 tx=0).stop 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f201d834e00 1 -- 10.20.193.28:0/3261525880 shutdown_connections 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f201d834e00 1 --2- 10.20.193.28:0/3261525880 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f201d834e00 1 --2- 10.20.193.28:0/3261525880 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f03948a0 0x5603f03cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f201d834e00 1 --2- 10.20.193.28:0/3261525880 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f0393ef0 0x5603f03b4770 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f201d834e00 1 -- 10.20.193.28:0/3261525880 >> 10.20.193.28:0/3261525880 conn(0x5603f038c990 msgr2=0x5603f03b9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f201d834e00 1 -- 10.20.193.28:0/3261525880 shutdown_connections 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.984+0000 7f201d834e00 1 -- 10.20.193.28:0/3261525880 wait complete. 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.985+0000 7f201d834e00 1 -- start start 2026-02-20T03:40:58.990 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.985+0000 7f201d834e00 1 Processor -- start 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.985+0000 7f201d834e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03bf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.985+0000 7f201d834e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.985+0000 7f201d834e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.985+0000 7f201d834e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc000e500 con 0x5603f0398aa0 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.985+0000 7f201d834e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc000f970 con 0x5603f0393ef0 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.985+0000 7f201d834e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc000ebd0 con 0x5603f03948a0 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20188a3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20198a5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20188a3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51630/0 (socket says 10.20.193.28:51630) 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20188a3640 1 -- 10.20.193.28:0/151954765 learned_addr learned my addr 10.20.193.28:0/151954765 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20190a4640 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.991 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20198a5640 1 -- 10.20.193.28:0/151954765 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 msgr2=0x5603f03bf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20198a5640 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20198a5640 1 -- 10.20.193.28:0/151954765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 msgr2=0x5603f03bf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20198a5640 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03bf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20198a5640 1 -- 10.20.193.28:0/151954765 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603f03aebc0 con 0x5603f0398aa0 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20188a3640 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f20198a5640 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03bfe00 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f20100dd960 tx=0x7f2010007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aade9d494eda188 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f1fceffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f1fceffd640 1 -- 10.20.193.28:0/151954765 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20100ac380 con 0x5603f0398aa0 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f1fceffd640 1 -- 10.20.193.28:0/151954765 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f20100b1230 con 0x5603f0398aa0 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f1fceffd640 1 -- 10.20.193.28:0/151954765 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20100a6cb0 con 0x5603f0398aa0 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.986+0000 7f201d834e00 1 -- 10.20.193.28:0/151954765 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603effc5870 con 0x5603f0398aa0 2026-02-20T03:40:58.992 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f1fceffd640 1 -- 10.20.193.28:0/151954765 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f2010007500 con 0x5603f0398aa0 2026-02-20T03:40:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f1fceffd640 10 client.22374 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:40:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f201d834e00 10 client.22374 _ll_register_callbacks cb 0x7f2008014910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:58.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f201d834e00 1 -- 10.20.193.28:0/151954765 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2008004520 con 0x5603f0398aa0 2026-02-20T03:40:58.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f1fceffd640 1 -- 10.20.193.28:0/151954765 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f20100902d0 con 0x5603f0398aa0 2026-02-20T03:40:58.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f201d834e00 10 client.22374 fetch_fsmap learned FSMap version 59 2026-02-20T03:40:58.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f201d834e00 1 -- 10.20.193.28:0/151954765 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=59}) -- 0x5603f02a16e0 con 0x5603f0398aa0 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f1fceffd640 1 -- 10.20.193.28:0/151954765 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 59) ==== 8374+0+0 (secure 0 0 0) 0x7f20100a36f0 con 0x5603f0398aa0 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f201d834e00 10 client.22374 fetch_fsmap finished waiting for FSMap version 59 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f201d834e00 10 client.22374 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f201d834e00 20 client.22374 populate_metadata read hostname 'trial028' 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.987+0000 7f201d834e00 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5603f0431b40 0x5603f0434000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.988+0000 7f201d834e00 4 client.22374 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.988+0000 7f201d834e00 1 -- 10.20.193.28:0/151954765 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5603f0067220 con 0x5603f0431b40 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.988+0000 7f20190a4640 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5603f0431b40 0x5603f0434000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.988+0000 7f20190a4640 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5603f0431b40 0x5603f0434000 crc :-1 s=READY pgs=640 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c90e53f9f32092fd server_cookie=e215ec40123ec48b in_seq=0 out_seq=0 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.988+0000 7f1fceffd640 10 client.22374 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.988+0000 7f1fceffd640 1 -- 10.20.193.28:0/151954765 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5603f0067220 con 0x5603f0431b40 2026-02-20T03:40:58.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.988+0000 7f1fceffd640 10 client.22374 handle_command_reply: tid=0 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.988+0000 7f201d834e00 1 client.22374 shutdown 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 -- 10.20.193.28:0/151954765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 msgr2=0x5603f03bfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03bfe00 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f20100dd960 tx=0x7f2010007da0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 -- 10.20.193.28:0/151954765 shutdown_connections 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5603f0431b40 0x5603f0434000 crc :-1 s=READY pgs=640 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5603f0398aa0 0x5603f03bfe00 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5603f03948a0 0x5603f03bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 --2- 10.20.193.28:0/151954765 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5603f0393ef0 0x5603f03bf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 -- 10.20.193.28:0/151954765 >> 10.20.193.28:0/151954765 conn(0x5603f038c990 msgr2=0x5603f03992a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f1fceffd640 0 client.22374 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 -- 10.20.193.28:0/151954765 shutdown_connections 2026-02-20T03:40:58.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 1 -- 10.20.193.28:0/151954765 wait complete. 2026-02-20T03:40:58.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201d834e00 20 client.22374 trim_cache size 0 max 16384 2026-02-20T03:40:58.997 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:40:58.997 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 59, 2026-02-20T03:40:58.997 INFO:teuthology.orchestra.run.trial028.stdout: "leader": 24560, 2026-02-20T03:40:58.997 INFO:teuthology.orchestra.run.trial028.stdout: "set_version": 50, 2026-02-20T03:40:58.997 INFO:teuthology.orchestra.run.trial028.stdout: "sets": {} 2026-02-20T03:40:58.997 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:40:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201a0a6640 1 -- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fe40b0e20 msgr2=0x7f1fe40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201a0a6640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fe40b0e20 0x7f1fe40b32e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2004005d20 tx=0x7f2004005e50 comp rx=0 tx=0).stop 2026-02-20T03:40:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201a0a6640 1 -- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 msgr2=0x7f20141a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.989+0000 7f201a0a6640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 0x7f20141a1930 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f2010004820 tx=0x7f201000d4a0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.998 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.990+0000 7f201a0a6640 1 -- 10.20.193.28:0/633635943 shutdown_connections 2026-02-20T03:40:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.990+0000 7f201a0a6640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f1fe40b0e20 0x7f1fe40b32e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.990+0000 7f201a0a6640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2014108700 0x7f20141a1930 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.990+0000 7f201a0a6640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f20141030a0 0x7f201419d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.990+0000 7f201a0a6640 1 --2- 10.20.193.28:0/633635943 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2014102700 0x7f201419d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.990+0000 7f201a0a6640 1 -- 10.20.193.28:0/633635943 >> 10.20.193.28:0/633635943 conn(0x7f20140fe440 msgr2=0x7f20140fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.990+0000 7f201a0a6640 1 -- 10.20.193.28:0/633635943 shutdown_connections 2026-02-20T03:40:58.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:58.990+0000 7f201a0a6640 1 -- 10.20.193.28:0/633635943 wait complete. 2026-02-20T03:40:59.098 ERROR:teuthology.run_tasks:Manager failed: quiescer Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa/tasks/quiescer.py", line 422, in task stop_all_quiescers(ctx.ceph[cluster_name].thrashers) File "/home/teuthworker/src/github.com_ceph_ceph-c_f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03/qa/tasks/quiescer.py", line 381, in stop_all_quiescers raise RuntimeError(f"error during quiesce thrashing: {thrasher.exception}") RuntimeError: error during quiesce thrashing: Error quiescing set 'f621fbc0': 110 (ETIMEDOUT) 2026-02-20T03:40:59.100 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2026-02-20T03:40:59.117 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@trial028.front.sepia.ceph.com 2026-02-20T03:40:59.128 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2026-02-20T03:40:59.145 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2026-02-20T03:40:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.169+0000 7f25fb1a3640 1 -- 10.20.193.28:0/844432565 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f25f4102700 msgr2=0x7f25f4102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.169+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/844432565 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f25f4102700 0x7f25f4102b60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009a30 tx=0x7f25e802f220 comp rx=0 tx=0).stop 2026-02-20T03:40:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.169+0000 7f25fb1a3640 1 -- 10.20.193.28:0/844432565 shutdown_connections 2026-02-20T03:40:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.169+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/844432565 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f25f41030a0 0x7f25f410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.169+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/844432565 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f25f4102700 0x7f25f4102b60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.169+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/844432565 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25f4108700 0x7f25f4108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.169+0000 7f25fb1a3640 1 -- 10.20.193.28:0/844432565 >> 10.20.193.28:0/844432565 conn(0x7f25f40fe440 msgr2=0x7f25f4100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:59.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.169+0000 7f25fb1a3640 1 -- 10.20.193.28:0/844432565 shutdown_connections 2026-02-20T03:40:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.170+0000 7f25fb1a3640 1 -- 10.20.193.28:0/844432565 wait complete. 2026-02-20T03:40:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.170+0000 7f25fb1a3640 1 Processor -- start 2026-02-20T03:40:59.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.170+0000 7f25fb1a3640 1 -- start start 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.170+0000 7f25fb1a3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f25f4102700 0x7f25f419d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.170+0000 7f25fb1a3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f25f41030a0 0x7f25f419d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.170+0000 7f25fb1a3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25f4108700 0x7f25f41a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fb1a3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f25f4112970 con 0x7f25f4108700 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fb1a3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f25f41127f0 con 0x7f25f41030a0 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fb1a3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f25f4112af0 con 0x7f25f4102700 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa9a2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25f4108700 0x7f25f41a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa9a2640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25f4108700 0x7f25f41a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51918/0 (socket says 10.20.193.28:51918) 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa9a2640 1 -- 10.20.193.28:0/1654268574 learned_addr learned my addr 10.20.193.28:0/1654268574 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25f99a0640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f25f41030a0 0x7f25f419d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa1a1640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f25f4102700 0x7f25f419d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa9a2640 1 -- 10.20.193.28:0/1654268574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f25f4102700 msgr2=0x7f25f419d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa9a2640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f25f4102700 0x7f25f419d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa9a2640 1 -- 10.20.193.28:0/1654268574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f25f41030a0 msgr2=0x7f25f419d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa9a2640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f25f41030a0 0x7f25f419d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa9a2640 1 -- 10.20.193.28:0/1654268574 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f41a2080 con 0x7f25f4108700 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fa9a2640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25f4108700 0x7f25f41a1900 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f25f000ef30 tx=0x7f25f000c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25db7fe640 1 -- 10.20.193.28:0/1654268574 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0019070 con 0x7f25f4108700 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f41a2310 con 0x7f25f4108700 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25db7fe640 1 -- 10.20.193.28:0/1654268574 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f25f00092d0 con 0x7f25f4108700 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.171+0000 7f25db7fe640 1 -- 10.20.193.28:0/1654268574 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0007500 con 0x7f25f4108700 2026-02-20T03:40:59.176 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.172+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f41a9bb0 con 0x7f25f4108700 2026-02-20T03:40:59.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.172+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f4102b60 con 0x7f25f4108700 2026-02-20T03:40:59.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.174+0000 7f25db7fe640 1 -- 10.20.193.28:0/1654268574 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f25f0002a60 con 0x7f25f4108700 2026-02-20T03:40:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.176+0000 7f25db7fe640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f25d00b0e20 0x7f25d00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.176+0000 7f25db7fe640 1 -- 10.20.193.28:0/1654268574 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f25f00e0a90 con 0x7f25f4108700 2026-02-20T03:40:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.176+0000 7f25fa1a1640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f25d00b0e20 0x7f25d00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.176+0000 7f25db7fe640 1 -- 10.20.193.28:0/1654268574 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f25f0023080 con 0x7f25f4108700 2026-02-20T03:40:59.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.177+0000 7f25fa1a1640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f25d00b0e20 0x7f25d00b32e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f25e40096f0 tx=0x7f25e4009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:59.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.283+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25f41a9e50 con 0x7f25f4108700 2026-02-20T03:40:59.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.284+0000 7f25db7fe640 1 -- 10.20.193.28:0/1654268574 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+11925 (secure 0 0 0) 0x7f25f0010040 con 0x7f25f4108700 2026-02-20T03:40:59.287 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:40:59.287 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":59,"btime":"2026-02-20T03:39:43:533677+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":59,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:39:43.492349+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24538,24533]},"id":1}]} 2026-02-20T03:40:59.288 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 59 2026-02-20T03:40:59.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f25d00b0e20 msgr2=0x7f25d00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f25d00b0e20 0x7f25d00b32e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f25e40096f0 tx=0x7f25e4009290 comp rx=0 tx=0).stop 2026-02-20T03:40:59.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25f4108700 msgr2=0x7f25f41a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.288 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25f4108700 0x7f25f41a1900 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f25f000ef30 tx=0x7f25f000c560 comp rx=0 tx=0).stop 2026-02-20T03:40:59.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 shutdown_connections 2026-02-20T03:40:59.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f25d00b0e20 0x7f25d00b32e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f25f4108700 0x7f25f41a1900 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f25f41030a0 0x7f25f419d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 --2- 10.20.193.28:0/1654268574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f25f4102700 0x7f25f419d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 >> 10.20.193.28:0/1654268574 conn(0x7f25f40fe440 msgr2=0x7f25f40fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:59.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 shutdown_connections 2026-02-20T03:40:59.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.285+0000 7f25fb1a3640 1 -- 10.20.193.28:0/1654268574 wait complete. 2026-02-20T03:40:59.390 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:2 damage ls 2026-02-20T03:40:59.652 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:40:59.699 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:59 trial028 ceph-mon[38552]: pgmap v975: 129 pgs: 129 active+clean; 585 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 299 KiB/s rd, 309 KiB/s wr, 98 op/s 2026-02-20T03:40:59.699 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:40:59 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1654268574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:40:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:59 trial177 ceph-mon[43181]: pgmap v975: 129 pgs: 129 active+clean; 585 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 299 KiB/s rd, 309 KiB/s wr, 98 op/s 2026-02-20T03:40:59.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:40:59 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1654268574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:40:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.834+0000 7ff69ebc6640 1 -- 10.20.193.28:0/4200928902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff698109220 msgr2=0x7ff698109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.834+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/4200928902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff698109220 0x7ff698109660 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009a30 tx=0x7ff68c02f220 comp rx=0 tx=0).stop 2026-02-20T03:40:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.834+0000 7ff69ebc6640 1 -- 10.20.193.28:0/4200928902 shutdown_connections 2026-02-20T03:40:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.834+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/4200928902 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff698109ba0 0x7ff698115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.834+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/4200928902 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff698109220 0x7ff698109660 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.834+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/4200928902 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff69810eef0 0x7ff69810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.834+0000 7ff69ebc6640 1 -- 10.20.193.28:0/4200928902 >> 10.20.193.28:0/4200928902 conn(0x7ff698078600 msgr2=0x7ff69807aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.834+0000 7ff69ebc6640 1 -- 10.20.193.28:0/4200928902 shutdown_connections 2026-02-20T03:40:59.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.834+0000 7ff69ebc6640 1 -- 10.20.193.28:0/4200928902 wait complete. 2026-02-20T03:40:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69ebc6640 1 Processor -- start 2026-02-20T03:40:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69ebc6640 1 -- start start 2026-02-20T03:40:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69ebc6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff698109220 0x7ff6981a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69ebc6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff698109ba0 0x7ff6981a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69ebc6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff69810eef0 0x7ff6981a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69ebc6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff698119090 con 0x7ff698109ba0 2026-02-20T03:40:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69ebc6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff698118f10 con 0x7ff698109220 2026-02-20T03:40:59.839 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69ebc6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff698119210 con 0x7ff69810eef0 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69d3c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff698109ba0 0x7ff6981a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69d3c3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff698109ba0 0x7ff6981a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51938/0 (socket says 10.20.193.28:51938) 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69d3c3640 1 -- 10.20.193.28:0/959653106 learned_addr learned my addr 10.20.193.28:0/959653106 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.835+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff698109220 0x7ff6981a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff69e3c5640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff69810eef0 0x7ff6981a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff69d3c3640 1 -- 10.20.193.28:0/959653106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff69810eef0 msgr2=0x7ff6981a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff69810eef0 0x7ff6981a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff69d3c3640 1 -- 10.20.193.28:0/959653106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff698109220 msgr2=0x7ff6981a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff698109220 0x7ff6981a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff69d3c3640 1 -- 10.20.193.28:0/959653106 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6981a65c0 con 0x7ff698109ba0 2026-02-20T03:40:59.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff698109ba0 0x7ff6981a1ab0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7ff68c005ec0 tx=0x7ff68c004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:59.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff686ffd640 1 -- 10.20.193.28:0/959653106 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c005020 con 0x7ff698109ba0 2026-02-20T03:40:59.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff69ebc6640 1 -- 10.20.193.28:0/959653106 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6981a6850 con 0x7ff698109ba0 2026-02-20T03:40:59.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff686ffd640 1 -- 10.20.193.28:0/959653106 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff68c005660 con 0x7ff698109ba0 2026-02-20T03:40:59.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff686ffd640 1 -- 10.20.193.28:0/959653106 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c038aa0 con 0x7ff698109ba0 2026-02-20T03:40:59.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.836+0000 7ff69ebc6640 1 -- 10.20.193.28:0/959653106 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6981ae0f0 con 0x7ff698109ba0 2026-02-20T03:40:59.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.839+0000 7ff686ffd640 1 -- 10.20.193.28:0/959653106 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff68c004a70 con 0x7ff698109ba0 2026-02-20T03:40:59.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff6a2354e00 1 Processor -- start 2026-02-20T03:40:59.842 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff6a2354e00 1 -- start start 2026-02-20T03:40:59.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc7fb0 0x5642eecc8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc25e0 0x5642eecc2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eeccede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5642eec42e00 con 0x5642eecc7fb0 2026-02-20T03:40:59.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5642eec15970 con 0x5642eecc2f60 2026-02-20T03:40:59.843 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5642eebc31f0 con 0x5642eecc25e0 2026-02-20T03:40:59.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69e3c5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc7fb0 0x5642eecc8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69d3c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eeccede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69e3c5640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc7fb0 0x5642eecc8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51946/0 (socket says 10.20.193.28:51946) 2026-02-20T03:40:59.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69e3c5640 1 -- 10.20.193.28:0/4184845748 learned_addr learned my addr 10.20.193.28:0/4184845748 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:59.844 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/4184845748 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc25e0 0x5642eecc2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69e3c5640 1 -- 10.20.193.28:0/4184845748 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc25e0 msgr2=0x5642eecc2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69e3c5640 1 --2- 10.20.193.28:0/4184845748 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc25e0 0x5642eecc2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69e3c5640 1 -- 10.20.193.28:0/4184845748 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 msgr2=0x5642eeccede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69e3c5640 1 --2- 10.20.193.28:0/4184845748 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eeccede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.840+0000 7ff69e3c5640 1 -- 10.20.193.28:0/4184845748 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642eebd63d0 con 0x5642eecc7fb0 2026-02-20T03:40:59.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff686ffd640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6740b0e20 0x7ff6740b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff69e3c5640 1 --2- 10.20.193.28:0/4184845748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc7fb0 0x5642eecc8390 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7ff694009500 tx=0x7ff694009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bd2a7e636db95c server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff686ffd640 1 -- 10.20.193.28:0/959653106 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff68c104e40 con 0x7ff698109ba0 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6740b0e20 0x7ff6740b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6664e6640 1 -- 10.20.193.28:0/4184845748 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69401b070 con 0x5642eecc7fb0 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6664e6640 1 -- 10.20.193.28:0/4184845748 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff694004570 con 0x5642eecc7fb0 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6664e6640 1 -- 10.20.193.28:0/4184845748 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694013a40 con 0x5642eecc7fb0 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4184845748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc7fb0 msgr2=0x5642eecc8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4184845748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc7fb0 0x5642eecc8390 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7ff694009500 tx=0x7ff694009920 comp rx=0 tx=0).stop 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4184845748 shutdown_connections 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4184845748 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eeccede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.846 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4184845748 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc25e0 0x5642eecc2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4184845748 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc7fb0 0x5642eecc8390 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4184845748 >> 10.20.193.28:0/4184845748 conn(0x5642eec85240 msgr2=0x5642eecc0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4184845748 shutdown_connections 2026-02-20T03:40:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4184845748 wait complete. 2026-02-20T03:40:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.841+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6740b0e20 0x7ff6740b32e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff688004670 tx=0x7ff688009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.842+0000 7ff6a2354e00 1 -- start start 2026-02-20T03:40:59.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff6a2354e00 1 Processor -- start 2026-02-20T03:40:59.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:59 trial126 ceph-mon[38476]: pgmap v975: 129 pgs: 129 active+clean; 585 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 299 KiB/s rd, 309 KiB/s wr, 98 op/s 2026-02-20T03:40:59.848 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:40:59 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1654268574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eecdc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecdcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 0x5642eecdafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5642eec118a0 con 0x5642eecc25e0 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5642eea03f50 con 0x5642eecc2f60 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5642eecdb720 con 0x5642eecc7fb0 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69dbc4640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eecdc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69d3c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecdcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69d3c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecdcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47452/0 (socket says 10.20.193.28:47452) 2026-02-20T03:40:59.851 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69d3c3640 1 -- 10.20.193.28:0/4173217119 learned_addr learned my addr 10.20.193.28:0/4173217119 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69e3c5640 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 0x5642eecdafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69d3c3640 1 -- 10.20.193.28:0/4173217119 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 msgr2=0x5642eecdafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 0x5642eecdafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69d3c3640 1 -- 10.20.193.28:0/4173217119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 msgr2=0x5642eecdc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eecdc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.843+0000 7ff69d3c3640 1 -- 10.20.193.28:0/4173217119 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642eecd4a30 con 0x5642eecc2f60 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecdcda0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0c9b40 tx=0x7ff68c004e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e95edd7d00d0bef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6537fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6537fe640 1 -- 10.20.193.28:0/4173217119 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0c8790 con 0x5642eecc2f60 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4173217119 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642ee9e6b40 con 0x5642eecc2f60 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6a2354e00 10 client.28988 _ll_register_callbacks cb 0x5642eec4eeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:59.852 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4173217119 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642eec23150 con 0x5642eecc2f60 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6537fe640 1 -- 10.20.193.28:0/4173217119 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff68c033070 con 0x5642eecc2f60 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6537fe640 1 -- 10.20.193.28:0/4173217119 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0cc040 con 0x5642eecc2f60 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6537fe640 1 -- 10.20.193.28:0/4173217119 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff68c0d5a70 con 0x5642eecc2f60 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6537fe640 1 -- 10.20.193.28:0/4173217119 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7ff68c0cc220 con 0x5642eecc2f60 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6a2354e00 10 client.28988 fetch_fsmap learned FSMap version 60 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.844+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4173217119 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=60}) -- 0x5642eebd01e0 con 0x5642eecc2f60 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff6537fe640 1 -- 10.20.193.28:0/4173217119 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7ff68c0051c0 con 0x5642eecc2f60 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff6a2354e00 10 client.28988 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff6a2354e00 10 client.28988 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff6a2354e00 20 client.28988 populate_metadata read hostname 'trial028' 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5642eeceaf90 0x5642eeced450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff6a2354e00 4 client.28988 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4173217119 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642eec1d560 con 0x5642eeceaf90 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5642eeceaf90 0x5642eeced450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5642eeceaf90 0x5642eeced450 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ecf19dc42195e6f server_cookie=61d35cfaefaebc7f in_seq=0 out_seq=0 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.845+0000 7ff6537fe640 10 client.28988 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6537fe640 1 -- 10.20.193.28:0/4173217119 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5642eec1d560 con 0x5642eeceaf90 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6537fe640 10 client.28988 handle_command_reply: tid=0 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 client.28988 shutdown 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4173217119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 msgr2=0x5642eecdcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecdcda0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0c9b40 tx=0x7ff68c004e10 comp rx=0 tx=0).stop 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4173217119 shutdown_connections 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 0x5642eecdafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.854 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecdcda0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5642eeceaf90 0x5642eeced450 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/4173217119 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eecdc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4173217119 >> 10.20.193.28:0/4173217119 conn(0x5642eec85240 msgr2=0x5642eecc13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:59.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6537fe640 0 client.28988 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:40:59.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4173217119 shutdown_connections 2026-02-20T03:40:59.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 1 -- 10.20.193.28:0/4173217119 wait complete. 2026-02-20T03:40:59.855 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.846+0000 7ff6a2354e00 20 client.28988 trim_cache size 0 max 16384 2026-02-20T03:40:59.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff6a2354e00 1 Processor -- start 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff6a2354e00 1 -- start start 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eecbad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecc14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 0x5642eecc1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff644012810 con 0x5642eecc25e0 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff644010020 con 0x5642eecc2f60 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff64400de10 con 0x5642eecc7fb0 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff69d3c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecc14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff69d3c3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecc14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47464/0 (socket says 10.20.193.28:47464) 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff69d3c3640 1 -- 10.20.193.28:0/3274928357 learned_addr learned my addr 10.20.193.28:0/3274928357 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:59.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.853+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eecbad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff69e3c5640 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 0x5642eecc1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff69d3c3640 1 -- 10.20.193.28:0/3274928357 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 msgr2=0x5642eecc1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:59.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 0x5642eecc1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff69d3c3640 1 -- 10.20.193.28:0/3274928357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 msgr2=0x5642eecbad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:59.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eecbad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff69d3c3640 1 -- 10.20.193.28:0/3274928357 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642eecd4860 con 0x5642eecc2f60 2026-02-20T03:40:59.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eecbad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:40:59.858 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecc14d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff68c002410 tx=0x7ff68c0cf000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e76c18eb36091a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:59.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff665ce5640 1 -- 10.20.193.28:0/3274928357 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0cc8f0 con 0x5642eecc2f60 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff665ce5640 1 -- 10.20.193.28:0/3274928357 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff68c033020 con 0x5642eecc2f60 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff6a2354e00 1 -- 10.20.193.28:0/3274928357 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 msgr2=0x5642eecc14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.854+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecc14d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff68c002410 tx=0x7ff68c0cf000 comp rx=0 tx=0).stop 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 -- 10.20.193.28:0/3274928357 shutdown_connections 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc7fb0 0x5642eecc1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc2f60 0x5642eecc14d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/3274928357 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eecbad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 -- 10.20.193.28:0/3274928357 >> 10.20.193.28:0/3274928357 conn(0x5642eec85240 msgr2=0x5642eecda040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 -- 10.20.193.28:0/3274928357 shutdown_connections 2026-02-20T03:40:59.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 -- 10.20.193.28:0/3274928357 wait complete. 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 -- start start 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 Processor -- start 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.855+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eece2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc2f60 0x5642eece3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff6a2354e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc7fb0 0x5642eece0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff64400e4e0 con 0x5642eecc25e0 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff64400f950 con 0x5642eecc7fb0 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff6a2354e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff64400ebb0 con 0x5642eecc2f60 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69e3c5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc7fb0 0x5642eece0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69e3c5640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc7fb0 0x5642eece0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47478/0 (socket says 10.20.193.28:47478) 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69e3c5640 1 -- 10.20.193.28:0/1167949280 learned_addr learned my addr 10.20.193.28:0/1167949280 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:40:59.864 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69d3c3640 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc2f60 0x5642eece3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69e3c5640 1 -- 10.20.193.28:0/1167949280 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc2f60 msgr2=0x5642eece3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69e3c5640 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc2f60 0x5642eece3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69e3c5640 1 -- 10.20.193.28:0/1167949280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 msgr2=0x5642eece2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eece2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69e3c5640 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eece2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69e3c5640 1 -- 10.20.193.28:0/1167949280 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642ee8f4870 con 0x5642eecc7fb0 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eece2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff69e3c5640 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc7fb0 0x5642eece0110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff694007e40 tx=0x7ff6940042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22b2f4959ae3da9b server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff6537fe640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.856+0000 7ff6537fe640 1 -- 10.20.193.28:0/1167949280 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69401b070 con 0x5642eecc7fb0 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6537fe640 1 -- 10.20.193.28:0/1167949280 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff694026070 con 0x5642eecc7fb0 2026-02-20T03:40:59.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 1 -- 10.20.193.28:0/1167949280 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642eebb53f0 con 0x5642eecc7fb0 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6537fe640 1 -- 10.20.193.28:0/1167949280 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694021420 con 0x5642eecc7fb0 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 10 client.28994 _ll_register_callbacks cb 0x7ff68c009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 1 -- 10.20.193.28:0/1167949280 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642eebc7ab0 con 0x5642eecc7fb0 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6537fe640 1 -- 10.20.193.28:0/1167949280 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff6940215c0 con 0x5642eecc7fb0 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6537fe640 1 -- 10.20.193.28:0/1167949280 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7ff6940218a0 con 0x5642eecc7fb0 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 10 client.28994 fetch_fsmap learned FSMap version 60 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 1 -- 10.20.193.28:0/1167949280 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=60}) -- 0x5642eecd5550 con 0x5642eecc7fb0 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6537fe640 1 -- 10.20.193.28:0/1167949280 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7ff694015450 con 0x5642eecc7fb0 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 10 client.28994 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 10 client.28994 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2026-02-20T03:40:59.866 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 20 client.28994 populate_metadata read hostname 'trial028' 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5642eed57ae0 0x5642eed59fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 4 client.28994 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff6a2354e00 1 -- 10.20.193.28:0/1167949280 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff68c033020 con 0x5642eed57ae0 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.857+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5642eed57ae0 0x5642eed59fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff69dbc4640 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5642eed57ae0 0x5642eed59fa0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2abd256324cf26c1 server_cookie=5169b4799fe9b1ba in_seq=0 out_seq=0 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6537fe640 10 client.28994 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6537fe640 1 -- 10.20.193.28:0/1167949280 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff68c033020 con 0x5642eed57ae0 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6537fe640 10 client.28994 handle_command_reply: tid=0 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 client.28994 shutdown 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 -- 10.20.193.28:0/1167949280 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc7fb0 msgr2=0x5642eece0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc7fb0 0x5642eece0110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff694007e40 tx=0x7ff6940042e0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 -- 10.20.193.28:0/1167949280 shutdown_connections 2026-02-20T03:40:59.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5642eecc7fb0 0x5642eece0110 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5642eecc2f60 0x5642eece3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x5642eed57ae0 0x5642eed59fa0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 --2- 10.20.193.28:0/1167949280 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5642eecc25e0 0x5642eece2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6537fe640 0 client.28994 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:40:59.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 -- 10.20.193.28:0/1167949280 >> 10.20.193.28:0/1167949280 conn(0x5642eec85240 msgr2=0x5642eeceb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:59.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.858+0000 7ff6a2354e00 1 -- 10.20.193.28:0/1167949280 shutdown_connections 2026-02-20T03:40:59.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff6a2354e00 1 -- 10.20.193.28:0/1167949280 wait complete. 2026-02-20T03:40:59.868 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff6a2354e00 20 client.28994 trim_cache size 0 max 16384 2026-02-20T03:40:59.869 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:40:59.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 -- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6740b0e20 msgr2=0x7ff6740b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.869 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6740b0e20 0x7ff6740b32e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff688004670 tx=0x7ff688009290 comp rx=0 tx=0).stop 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 -- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff698109ba0 msgr2=0x7ff6981a1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff698109ba0 0x7ff6981a1ab0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7ff68c005ec0 tx=0x7ff68c004290 comp rx=0 tx=0).stop 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 -- 10.20.193.28:0/959653106 shutdown_connections 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff6740b0e20 0x7ff6740b32e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff69810eef0 0x7ff6981a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff698109ba0 0x7ff6981a1ab0 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 --2- 10.20.193.28:0/959653106 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff698109220 0x7ff6981a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 -- 10.20.193.28:0/959653106 >> 10.20.193.28:0/959653106 conn(0x7ff698078600 msgr2=0x7ff698079f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 -- 10.20.193.28:0/959653106 shutdown_connections 2026-02-20T03:40:59.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:40:59.859+0000 7ff69ebc6640 1 -- 10.20.193.28:0/959653106 wait complete. 2026-02-20T03:40:59.962 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:1 damage ls 2026-02-20T03:41:00.229 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:00.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f867bfff640 1 -- 10.20.193.28:0/2786333992 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86880048a0 con 0x7f868c105320 2026-02-20T03:41:00.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f86927cf640 1 -- 10.20.193.28:0/2786333992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f868c105320 msgr2=0x7f868c111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:00.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f86927cf640 1 --2- 10.20.193.28:0/2786333992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f868c105320 0x7f868c111850 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f868800b0a0 tx=0x7f868802f410 comp rx=0 tx=0).stop 2026-02-20T03:41:00.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f86927cf640 1 -- 10.20.193.28:0/2786333992 shutdown_connections 2026-02-20T03:41:00.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f86927cf640 1 --2- 10.20.193.28:0/2786333992 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f868c105320 0x7f868c111850 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f86927cf640 1 --2- 10.20.193.28:0/2786333992 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f868c104980 0x7f868c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f86927cf640 1 --2- 10.20.193.28:0/2786333992 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f868c10a980 0x7f868c10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f86927cf640 1 -- 10.20.193.28:0/2786333992 >> 10.20.193.28:0/2786333992 conn(0x7f868c100680 msgr2=0x7f868c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:00.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f86927cf640 1 -- 10.20.193.28:0/2786333992 shutdown_connections 2026-02-20T03:41:00.412 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.408+0000 7f86927cf640 1 -- 10.20.193.28:0/2786333992 wait complete. 2026-02-20T03:41:00.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.409+0000 7f86927cf640 1 Processor -- start 2026-02-20T03:41:00.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.409+0000 7f86927cf640 1 -- start start 2026-02-20T03:41:00.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86927cf640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f868c104980 0x7f868c19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86927cf640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f868c105320 0x7f868c19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86927cf640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f868c10a980 0x7f868c1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86927cf640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f868c114ba0 con 0x7f868c104980 2026-02-20T03:41:00.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86927cf640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f868c114a20 con 0x7f868c105320 2026-02-20T03:41:00.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86927cf640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f868c114d20 con 0x7f868c10a980 2026-02-20T03:41:00.414 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86917cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f868c104980 0x7f868c19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f8691fce640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f868c10a980 0x7f868c1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86917cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f868c104980 0x7f868c19cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:51990/0 (socket says 10.20.193.28:51990) 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86917cd640 1 -- 10.20.193.28:0/407288808 learned_addr learned my addr 10.20.193.28:0/407288808 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f8690fcc640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f868c105320 0x7f868c19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86917cd640 1 -- 10.20.193.28:0/407288808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f868c10a980 msgr2=0x7f868c1a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86917cd640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f868c10a980 0x7f868c1a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86917cd640 1 -- 10.20.193.28:0/407288808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f868c105320 msgr2=0x7f868c19d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86917cd640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f868c105320 0x7f868c19d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86917cd640 1 -- 10.20.193.28:0/407288808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f868c1a1ff0 con 0x7f868c104980 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.410+0000 7f86917cd640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f868c104980 0x7f868c19cfa0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ea10 tx=0x7f867c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:00.415 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.411+0000 7f867a7fc640 1 -- 10.20.193.28:0/407288808 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c00ce50 con 0x7f868c104980 2026-02-20T03:41:00.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.411+0000 7f867a7fc640 1 -- 10.20.193.28:0/407288808 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f867c004570 con 0x7f868c104980 2026-02-20T03:41:00.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.411+0000 7f867a7fc640 1 -- 10.20.193.28:0/407288808 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c010690 con 0x7f868c104980 2026-02-20T03:41:00.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.411+0000 7f86927cf640 1 -- 10.20.193.28:0/407288808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868c1a22e0 con 0x7f868c104980 2026-02-20T03:41:00.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.411+0000 7f86927cf640 1 -- 10.20.193.28:0/407288808 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868c1a9b20 con 0x7f868c104980 2026-02-20T03:41:00.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f867a7fc640 1 -- 10.20.193.28:0/407288808 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f867c0040d0 con 0x7f868c104980 2026-02-20T03:41:00.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8695f5de00 1 Processor -- start 2026-02-20T03:41:00.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8695f5de00 1 -- start start 2026-02-20T03:41:00.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b33fb0 0x562769b34390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b2ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.418 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b3ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8695f5de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562769aaee00 con 0x562769b33fb0 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8695f5de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x562769a81970 con 0x562769b2e5e0 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8695f5de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562769a2f1f0 con 0x562769b2ef60 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f86917cd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b2ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f86917cd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b2ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47508/0 (socket says 10.20.193.28:47508) 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f86917cd640 1 -- 10.20.193.28:0/3658737373 learned_addr learned my addr 10.20.193.28:0/3658737373 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8691fce640 1 --2- 10.20.193.28:0/3658737373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b33fb0 0x562769b34390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.414+0000 7f8690fcc640 1 --2- 10.20.193.28:0/3658737373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b3ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f86917cd640 1 -- 10.20.193.28:0/3658737373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 msgr2=0x562769b3ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f86917cd640 1 --2- 10.20.193.28:0/3658737373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b3ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f86917cd640 1 -- 10.20.193.28:0/3658737373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b33fb0 msgr2=0x562769b34390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:00.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f86917cd640 1 --2- 10.20.193.28:0/3658737373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b33fb0 0x562769b34390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f86917cd640 1 -- 10.20.193.28:0/3658737373 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562769a423d0 con 0x562769b2e5e0 2026-02-20T03:41:00.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f86917cd640 1 --2- 10.20.193.28:0/3658737373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b2ea20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f867c0e4cd0 tx=0x7f867c0e95f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a19396233d247f server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:00.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f867a7fc640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86680b0fc0 0x7f86680b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f8659ce5640 1 -- 10.20.193.28:0/3658737373 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a4c80 con 0x562769b2e5e0 2026-02-20T03:41:00.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f8659ce5640 1 -- 10.20.193.28:0/3658737373 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f867c0f2070 con 0x562769b2e5e0 2026-02-20T03:41:00.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f8659ce5640 1 -- 10.20.193.28:0/3658737373 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a7f80 con 0x562769b2e5e0 2026-02-20T03:41:00.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f867a7fc640 1 -- 10.20.193.28:0/407288808 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f867c0e0ba0 con 0x7f868c104980 2026-02-20T03:41:00.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.415+0000 7f8691fce640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86680b0fc0 0x7f86680b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8691fce640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86680b0fc0 0x7f86680b3480 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8688009e60 tx=0x7f868803a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:00.422 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8695f5de00 1 -- 10.20.193.28:0/3658737373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 msgr2=0x562769b2ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8695f5de00 1 --2- 10.20.193.28:0/3658737373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b2ea20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f867c0e4cd0 tx=0x7f867c0e95f0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8695f5de00 1 -- 10.20.193.28:0/3658737373 shutdown_connections 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8695f5de00 1 --2- 10.20.193.28:0/3658737373 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b3ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8695f5de00 1 --2- 10.20.193.28:0/3658737373 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b2ea20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8695f5de00 1 --2- 10.20.193.28:0/3658737373 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b33fb0 0x562769b34390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8695f5de00 1 -- 10.20.193.28:0/3658737373 >> 10.20.193.28:0/3658737373 conn(0x562769af1240 msgr2=0x562769b2cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8695f5de00 1 -- 10.20.193.28:0/3658737373 shutdown_connections 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.416+0000 7f8695f5de00 1 -- 10.20.193.28:0/3658737373 wait complete. 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8695f5de00 1 -- start start 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8695f5de00 1 Processor -- start 2026-02-20T03:41:00.423 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b48b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b49050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 0x562769b47250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8695f5de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x562769a7d8a0 con 0x562769b2e5e0 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8695f5de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x56276986ff50 con 0x562769b33fb0 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8695f5de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x562769b479d0 con 0x562769b2ef60 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8690fcc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b49050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8691fce640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 0x562769b47250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8690fcc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b49050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51724/0 (socket says 10.20.193.28:51724) 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f8690fcc640 1 -- 10.20.193.28:0/2665061407 learned_addr learned my addr 10.20.193.28:0/2665061407 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.418+0000 7f86917cd640 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b48b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8690fcc640 1 -- 10.20.193.28:0/2665061407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 msgr2=0x562769b47250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:00.424 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8690fcc640 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 0x562769b47250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8690fcc640 1 -- 10.20.193.28:0/2665061407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 msgr2=0x562769b48b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8690fcc640 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b48b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8690fcc640 1 -- 10.20.193.28:0/2665061407 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562769b409e0 con 0x562769b2ef60 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8690fcc640 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b49050 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d60 tx=0x7f8680002ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4098df41667014a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8646ffd640 10 client.0 ms_handle_connect on v2:10.20.193.177:3300/0 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8646ffd640 1 -- 10.20.193.28:0/2665061407 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86800125a0 con 0x562769b2ef60 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8646ffd640 1 -- 10.20.193.28:0/2665061407 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8680012be0 con 0x562769b2ef60 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8695f5de00 1 -- 10.20.193.28:0/2665061407 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562769852b40 con 0x562769b2ef60 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8646ffd640 1 -- 10.20.193.28:0/2665061407 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680010c60 con 0x562769b2ef60 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.419+0000 7f8695f5de00 10 client.28990 _ll_register_callbacks cb 0x562769abaeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8695f5de00 1 -- 10.20.193.28:0/2665061407 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562769a8f150 con 0x562769b2ef60 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8646ffd640 1 -- 10.20.193.28:0/2665061407 <== mon.1 v2:10.20.193.177:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8680010e00 con 0x562769b2ef60 2026-02-20T03:41:00.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8646ffd640 1 -- 10.20.193.28:0/2665061407 <== mon.1 v2:10.20.193.177:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f8680012d90 con 0x562769b2ef60 2026-02-20T03:41:00.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8695f5de00 10 client.28990 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:00.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8695f5de00 1 -- 10.20.193.28:0/2665061407 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({fsmap=60}) -- 0x562769a3c1e0 con 0x562769b2ef60 2026-02-20T03:41:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8646ffd640 1 -- 10.20.193.28:0/2665061407 <== mon.1 v2:10.20.193.177:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7f8680024030 con 0x562769b2ef60 2026-02-20T03:41:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8695f5de00 10 client.28990 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8695f5de00 10 client.28990 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:41:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8695f5de00 20 client.28990 populate_metadata read hostname 'trial028' 2026-02-20T03:41:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8695f5de00 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562769b57360 0x562769b59800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8695f5de00 4 client.28990 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:41:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f8695f5de00 1 -- 10.20.193.28:0/2665061407 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562769a89560 con 0x562769b57360 2026-02-20T03:41:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.420+0000 7f86917cd640 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562769b57360 0x562769b59800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.421+0000 7f86917cd640 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562769b57360 0x562769b59800 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=803cc6adab3e85bc server_cookie=3ceae211cd9550fd in_seq=0 out_seq=0 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.421+0000 7f8646ffd640 10 client.28990 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.421+0000 7f8646ffd640 1 -- 10.20.193.28:0/2665061407 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x562769a89560 con 0x562769b57360 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.421+0000 7f8646ffd640 10 client.28990 handle_command_reply: tid=0 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.421+0000 7f8695f5de00 1 client.28990 shutdown 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 -- 10.20.193.28:0/2665061407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 msgr2=0x562769b49050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b49050 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d60 tx=0x7f8680002ab0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 -- 10.20.193.28:0/2665061407 shutdown_connections 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562769b57360 0x562769b59800 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 0x562769b47250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b49050 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 --2- 10.20.193.28:0/2665061407 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b48b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.429 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8646ffd640 0 client.28990 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:41:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 -- 10.20.193.28:0/2665061407 >> 10.20.193.28:0/2665061407 conn(0x562769af1240 msgr2=0x562769b2d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 -- 10.20.193.28:0/2665061407 shutdown_connections 2026-02-20T03:41:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 1 -- 10.20.193.28:0/2665061407 wait complete. 2026-02-20T03:41:00.430 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.422+0000 7f8695f5de00 20 client.28990 trim_cache size 0 max 16384 2026-02-20T03:41:00.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8695f5de00 1 Processor -- start 2026-02-20T03:41:00.432 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8695f5de00 1 -- start start 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b32cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2ef60 0x562769b460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b33fb0 0x562769b2d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8695f5de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8638012730 con 0x562769b2ef60 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8695f5de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f863800ff40 con 0x562769b2e5e0 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8695f5de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f863800dd90 con 0x562769b33fb0 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f86917cd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b32cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8691fce640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b33fb0 0x562769b2d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8691fce640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b33fb0 0x562769b2d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51736/0 (socket says 10.20.193.28:51736) 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f8691fce640 1 -- 10.20.193.28:0/3804704833 learned_addr learned my addr 10.20.193.28:0/3804704833 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:00.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.429+0000 7f86917cd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b32cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47520/0 (socket says 10.20.193.28:47520) 2026-02-20T03:41:00.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f8690fcc640 1 --2- 10.20.193.28:0/3804704833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2ef60 0x562769b460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f8691fce640 1 -- 10.20.193.28:0/3804704833 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 msgr2=0x562769b32cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:00.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f8691fce640 1 --2- 10.20.193.28:0/3804704833 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b32cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f8691fce640 1 -- 10.20.193.28:0/3804704833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2ef60 msgr2=0x562769b460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:00.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f8691fce640 1 --2- 10.20.193.28:0/3804704833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2ef60 0x562769b460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f8691fce640 1 -- 10.20.193.28:0/3804704833 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562769b40810 con 0x562769b33fb0 2026-02-20T03:41:00.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f8691fce640 1 --2- 10.20.193.28:0/3804704833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b33fb0 0x562769b2d4d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8688004c40 tx=0x7f8688044000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fabbc96a9263b33 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:00.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f86594e4640 1 -- 10.20.193.28:0/3804704833 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688056070 con 0x562769b33fb0 2026-02-20T03:41:00.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f86594e4640 1 -- 10.20.193.28:0/3804704833 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f86880076a0 con 0x562769b33fb0 2026-02-20T03:41:00.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.430+0000 7f86594e4640 1 -- 10.20.193.28:0/3804704833 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86880456e0 con 0x562769b33fb0 2026-02-20T03:41:00.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 -- 10.20.193.28:0/3804704833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b33fb0 msgr2=0x562769b2d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:00.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 --2- 10.20.193.28:0/3804704833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b33fb0 0x562769b2d4d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8688004c40 tx=0x7f8688044000 comp rx=0 tx=0).stop 2026-02-20T03:41:00.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 -- 10.20.193.28:0/3804704833 shutdown_connections 2026-02-20T03:41:00.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 --2- 10.20.193.28:0/3804704833 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b33fb0 0x562769b2d4d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 --2- 10.20.193.28:0/3804704833 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2ef60 0x562769b460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 --2- 10.20.193.28:0/3804704833 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b2e5e0 0x562769b32cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 -- 10.20.193.28:0/3804704833 >> 10.20.193.28:0/3804704833 conn(0x562769af1240 msgr2=0x562769b459e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:00.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 -- 10.20.193.28:0/3804704833 shutdown_connections 2026-02-20T03:41:00.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 -- 10.20.193.28:0/3804704833 wait complete. 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 -- start start 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.431+0000 7f8695f5de00 1 Processor -- start 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.432+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b4b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.432+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b4beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.432+0000 7f8695f5de00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 0x562769b4c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.432+0000 7f8695f5de00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f863800e400 con 0x562769b2e5e0 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.432+0000 7f8695f5de00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f863800f870 con 0x562769b33fb0 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f8695f5de00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f863800ead0 con 0x562769b2ef60 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f86917cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b4b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f86917cd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b4b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52026/0 (socket says 10.20.193.28:52026) 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f86917cd640 1 -- 10.20.193.28:0/1947183203 learned_addr learned my addr 10.20.193.28:0/1947183203 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:00.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f8690fcc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b4beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f8691fce640 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 0x562769b4c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f86917cd640 1 -- 10.20.193.28:0/1947183203 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 msgr2=0x562769b4beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f86917cd640 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b4beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f86917cd640 1 -- 10.20.193.28:0/1947183203 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 msgr2=0x562769b4c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f86917cd640 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 0x562769b4c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f86917cd640 1 -- 10.20.193.28:0/1947183203 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562769760870 con 0x562769b2e5e0 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f8690fcc640 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b4beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f8691fce640 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 0x562769b4c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f86917cd640 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b4b970 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f867c00c770 tx=0x7f867c00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8b963e7a3cbca1 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f8646ffd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:41:00.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.433+0000 7f8646ffd640 1 -- 10.20.193.28:0/1947183203 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a8170 con 0x562769b2e5e0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 1 -- 10.20.193.28:0/1947183203 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562769a213f0 con 0x562769b2e5e0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 10 client.22413 _ll_register_callbacks cb 0x7f86800041e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 1 -- 10.20.193.28:0/1947183203 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562769b333d0 con 0x562769b2e5e0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8646ffd640 1 -- 10.20.193.28:0/1947183203 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f867c0e6050 con 0x562769b2e5e0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8646ffd640 1 -- 10.20.193.28:0/1947183203 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a83c0 con 0x562769b2e5e0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8646ffd640 1 -- 10.20.193.28:0/1947183203 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f867c0de290 con 0x562769b2e5e0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8646ffd640 1 -- 10.20.193.28:0/1947183203 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f867c0a8650 con 0x562769b2e5e0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 10 client.22413 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 1 -- 10.20.193.28:0/1947183203 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=60}) -- 0x562769b41500 con 0x562769b2e5e0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8646ffd640 1 -- 10.20.193.28:0/1947183203 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7f867c0a48c0 con 0x562769b2e5e0 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 10 client.22413 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:00.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 10 client.22413 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2026-02-20T03:41:00.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 20 client.22413 populate_metadata read hostname 'trial028' 2026-02-20T03:41:00.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562769bcbbc0 0x562769bcdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:00.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 4 client.22413 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:41:00.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.434+0000 7f8695f5de00 1 -- 10.20.193.28:0/1947183203 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562769a33ab0 con 0x562769bcbbc0 2026-02-20T03:41:00.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.435+0000 7f8690fcc640 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562769bcbbc0 0x562769bcdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.435+0000 7f8690fcc640 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562769bcbbc0 0x562769bcdfb0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=62515ff30fa0c256 server_cookie=1c9af9ba9297400d in_seq=0 out_seq=0 2026-02-20T03:41:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.435+0000 7f8646ffd640 10 client.22413 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:41:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.435+0000 7f8646ffd640 1 -- 10.20.193.28:0/1947183203 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562769a33ab0 con 0x562769bcbbc0 2026-02-20T03:41:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.435+0000 7f8646ffd640 10 client.22413 handle_command_reply: tid=0 2026-02-20T03:41:00.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.435+0000 7f8695f5de00 1 client.22413 shutdown 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.435+0000 7f8695f5de00 1 -- 10.20.193.28:0/1947183203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 msgr2=0x562769b4b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.435+0000 7f8695f5de00 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b4b970 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f867c00c770 tx=0x7f867c00ef50 comp rx=0 tx=0).stop 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8695f5de00 1 -- 10.20.193.28:0/1947183203 shutdown_connections 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8695f5de00 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x562769bcbbc0 0x562769bcdfb0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8695f5de00 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x562769b33fb0 0x562769b4c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8695f5de00 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x562769b2ef60 0x562769b4beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8695f5de00 1 --2- 10.20.193.28:0/1947183203 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x562769b2e5e0 0x562769b4b970 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8646ffd640 0 client.22413 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8695f5de00 1 -- 10.20.193.28:0/1947183203 >> 10.20.193.28:0/1947183203 conn(0x562769af1240 msgr2=0x562769b46200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8695f5de00 1 -- 10.20.193.28:0/1947183203 shutdown_connections 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8695f5de00 1 -- 10.20.193.28:0/1947183203 wait complete. 2026-02-20T03:41:00.444 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f8695f5de00 20 client.22413 trim_cache size 0 max 16384 2026-02-20T03:41:00.445 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f86927cf640 1 -- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86680b0fc0 msgr2=0x7f86680b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f86927cf640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86680b0fc0 0x7f86680b3480 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8688009e60 tx=0x7f868803a040 comp rx=0 tx=0).stop 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f86927cf640 1 -- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f868c104980 msgr2=0x7f868c19cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.436+0000 7f86927cf640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f868c104980 0x7f868c19cfa0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ea10 tx=0x7f867c00eee0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.437+0000 7f86927cf640 1 -- 10.20.193.28:0/407288808 shutdown_connections 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.437+0000 7f86927cf640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f86680b0fc0 0x7f86680b3480 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.437+0000 7f86927cf640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f868c10a980 0x7f868c1a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.437+0000 7f86927cf640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f868c105320 0x7f868c19d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.437+0000 7f86927cf640 1 --2- 10.20.193.28:0/407288808 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f868c104980 0x7f868c19cfa0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.437+0000 7f86927cf640 1 -- 10.20.193.28:0/407288808 >> 10.20.193.28:0/407288808 conn(0x7f868c100680 msgr2=0x7f868c100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:00.446 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.437+0000 7f86927cf640 1 -- 10.20.193.28:0/407288808 shutdown_connections 2026-02-20T03:41:00.447 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:00.437+0000 7f86927cf640 1 -- 10.20.193.28:0/407288808 wait complete. 2026-02-20T03:41:00.528 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:00 trial028 ceph-mon[38552]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:41:00.578 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph tell mds.1:0 damage ls 2026-02-20T03:41:00.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:00 trial177 ceph-mon[43181]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:41:00.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:00 trial126 ceph-mon[38476]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2026-02-20T03:41:00.845 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:01.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.030+0000 7f8e8a207640 1 -- 10.20.193.28:0/3784258887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e84109ba0 msgr2=0x7f8e84115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.030+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3784258887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e84109ba0 0x7f8e84115d10 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009f90 tx=0x7f8e8002f390 comp rx=0 tx=0).stop 2026-02-20T03:41:01.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.030+0000 7f8e8a207640 1 -- 10.20.193.28:0/3784258887 shutdown_connections 2026-02-20T03:41:01.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.030+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3784258887 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e84109ba0 0x7f8e84115d10 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.030+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3784258887 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e84109220 0x7f8e84109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.030+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3784258887 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8e8410eef0 0x7f8e8410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.030+0000 7f8e8a207640 1 -- 10.20.193.28:0/3784258887 >> 10.20.193.28:0/3784258887 conn(0x7f8e84078600 msgr2=0x7f8e8407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.030+0000 7f8e8a207640 1 -- 10.20.193.28:0/3784258887 shutdown_connections 2026-02-20T03:41:01.034 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.030+0000 7f8e8a207640 1 -- 10.20.193.28:0/3784258887 wait complete. 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e8a207640 1 Processor -- start 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e8a207640 1 -- start start 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e8a207640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e84109220 0x7f8e841a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e8a207640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e84109ba0 0x7f8e841a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e8a207640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8e8410eef0 0x7f8e841a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e8a207640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84119090 con 0x7f8e84109220 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e8a207640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84118f10 con 0x7f8e8410eef0 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e8a207640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84119210 con 0x7f8e84109ba0 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e89205640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e84109220 0x7f8e841a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.031+0000 7f8e88a04640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e84109ba0 0x7f8e841a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e89205640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e84109220 0x7f8e841a1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52050/0 (socket says 10.20.193.28:52050) 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e89205640 1 -- 10.20.193.28:0/3202687723 learned_addr learned my addr 10.20.193.28:0/3202687723 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e89a06640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8e8410eef0 0x7f8e841a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e89a06640 1 -- 10.20.193.28:0/3202687723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e84109ba0 msgr2=0x7f8e841a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e89a06640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e84109ba0 0x7f8e841a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e89a06640 1 -- 10.20.193.28:0/3202687723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e84109220 msgr2=0x7f8e841a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e89a06640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e84109220 0x7f8e841a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e89a06640 1 -- 10.20.193.28:0/3202687723 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e841a6480 con 0x7f8e8410eef0 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e88a04640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e84109ba0 0x7f8e841a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e89a06640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8e8410eef0 0x7f8e841a5d00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009f90 tx=0x7f8e80004290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e727fc640 1 -- 10.20.193.28:0/3202687723 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e80045070 con 0x7f8e8410eef0 2026-02-20T03:41:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e727fc640 1 -- 10.20.193.28:0/3202687723 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8e80002a60 con 0x7f8e8410eef0 2026-02-20T03:41:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.032+0000 7f8e8a207640 1 -- 10.20.193.28:0/3202687723 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e841a6710 con 0x7f8e8410eef0 2026-02-20T03:41:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.033+0000 7f8e8a207640 1 -- 10.20.193.28:0/3202687723 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e841adfb0 con 0x7f8e8410eef0 2026-02-20T03:41:01.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.033+0000 7f8e727fc640 1 -- 10.20.193.28:0/3202687723 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e80007b30 con 0x7f8e8410eef0 2026-02-20T03:41:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.035+0000 7f8e727fc640 1 -- 10.20.193.28:0/3202687723 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8e8003f030 con 0x7f8e8410eef0 2026-02-20T03:41:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.035+0000 7f8e8d995e00 1 Processor -- start 2026-02-20T03:41:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.035+0000 7f8e8d995e00 1 -- start start 2026-02-20T03:41:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba81390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba7ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba87de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5595fb9fbe00 con 0x5595fba80fb0 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5595fb9ce970 con 0x5595fba7bf60 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5595fb97c1f0 con 0x5595fba7b5e0 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e89205640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba7ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e88a04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba81390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e89205640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba7ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:51774/0 (socket says 10.20.193.28:51774) 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e89205640 1 -- 10.20.193.28:0/2490150304 learned_addr learned my addr 10.20.193.28:0/2490150304 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e88a04640 1 --2- 10.20.193.28:0/2490150304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba87de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e88a04640 1 -- 10.20.193.28:0/2490150304 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 msgr2=0x5595fba7ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e88a04640 1 --2- 10.20.193.28:0/2490150304 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba7ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e88a04640 1 -- 10.20.193.28:0/2490150304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 msgr2=0x5595fba87de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:01.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e88a04640 1 --2- 10.20.193.28:0/2490150304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba87de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.036+0000 7f8e88a04640 1 -- 10.20.193.28:0/2490150304 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595fb98f3d0 con 0x5595fba80fb0 2026-02-20T03:41:01.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e727fc640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e600b0da0 0x7f8e600b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e88a04640 1 --2- 10.20.193.28:0/2490150304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba81390 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f8e8410e500 tx=0x7f8e78004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59294cd5e84319ea server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e727fc640 1 -- 10.20.193.28:0/3202687723 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8e80104ab0 con 0x7f8e8410eef0 2026-02-20T03:41:01.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e51ce5640 1 -- 10.20.193.28:0/2490150304 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e780048a0 con 0x5595fba80fb0 2026-02-20T03:41:01.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e89205640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e600b0da0 0x7f8e600b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e51ce5640 1 -- 10.20.193.28:0/2490150304 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8e78002e50 con 0x5595fba80fb0 2026-02-20T03:41:01.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e51ce5640 1 -- 10.20.193.28:0/2490150304 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e780048a0 con 0x5595fba80fb0 2026-02-20T03:41:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2490150304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 msgr2=0x5595fba81390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2490150304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba81390 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f8e8410e500 tx=0x7f8e78004650 comp rx=0 tx=0).stop 2026-02-20T03:41:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2490150304 shutdown_connections 2026-02-20T03:41:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2490150304 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba87de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2490150304 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba7ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2490150304 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba81390 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2490150304 >> 10.20.193.28:0/2490150304 conn(0x5595fba3e240 msgr2=0x5595fba79ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2490150304 shutdown_connections 2026-02-20T03:41:01.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e89205640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e600b0da0 0x7f8e600b3260 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8e74004160 tx=0x7f8e74009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.037+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2490150304 wait complete. 2026-02-20T03:41:01.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.038+0000 7f8e8d995e00 1 -- start start 2026-02-20T03:41:01.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e8d995e00 1 Processor -- start 2026-02-20T03:41:01.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba7bf60 0x5595fba95d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba80fb0 0x5595fba93fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5595fb9ca8a0 con 0x5595fba7bf60 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5595fb7bcf50 con 0x5595fba80fb0 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5595fba945e0 con 0x5595fba7b5e0 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e88a04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba7bf60 0x5595fba95d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e88a04640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba7bf60 0x5595fba95d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52062/0 (socket says 10.20.193.28:52062) 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e88a04640 1 -- 10.20.193.28:0/2554443463 learned_addr learned my addr 10.20.193.28:0/2554443463 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e89a06640 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba80fb0 0x5595fba93fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e89205640 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e88a04640 1 -- 10.20.193.28:0/2554443463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 msgr2=0x5595fba957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e88a04640 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e88a04640 1 -- 10.20.193.28:0/2554443463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba80fb0 msgr2=0x5595fba93fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:01.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e88a04640 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba80fb0 0x5595fba93fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e88a04640 1 -- 10.20.193.28:0/2554443463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595fba8da30 con 0x5595fba7bf60 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.039+0000 7f8e88a04640 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba7bf60 0x5595fba95d30 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f8e78004750 tx=0x7f8e78009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5449c7e21e9dca62 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e3effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e3effd640 1 -- 10.20.193.28:0/2554443463 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7801f480 con 0x5595fba7bf60 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e3effd640 1 -- 10.20.193.28:0/2554443463 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8e7801fac0 con 0x5595fba7bf60 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e3effd640 1 -- 10.20.193.28:0/2554443463 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7801e9c0 con 0x5595fba7bf60 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2554443463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595fb79fb40 con 0x5595fba7bf60 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e3effd640 1 -- 10.20.193.28:0/2554443463 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8e7801eb60 con 0x5595fba7bf60 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e8d995e00 10 client.22425 _ll_register_callbacks cb 0x5595fba07eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2554443463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5595fb9dc150 con 0x5595fba7bf60 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e3effd640 1 -- 10.20.193.28:0/2554443463 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f8e7801e3e0 con 0x5595fba7bf60 2026-02-20T03:41:01.050 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e8d995e00 10 client.22425 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.040+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2554443463 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=60}) -- 0x5595fb9891e0 con 0x5595fba7bf60 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e3effd640 1 -- 10.20.193.28:0/2554443463 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7f8e7801d020 con 0x5595fba7bf60 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e8d995e00 10 client.22425 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e8d995e00 10 client.22425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e8d995e00 20 client.22425 populate_metadata read hostname 'trial028' 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595fbaa3e30 0x5595fbaa6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e8d995e00 4 client.22425 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2554443463 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595fb9d6560 con 0x5595fbaa3e30 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e89205640 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595fbaa3e30 0x5595fbaa6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e3effd640 10 client.22425 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.041+0000 7f8e89205640 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595fbaa3e30 0x5595fbaa6220 crc :-1 s=READY pgs=641 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=772cc49a5b8da6a6 server_cookie=3fd756c1a5a51edd in_seq=0 out_seq=0 2026-02-20T03:41:01.051 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e3effd640 1 -- 10.20.193.28:0/2554443463 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5595fb9d6560 con 0x5595fbaa3e30 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e3effd640 10 client.22425 handle_command_reply: tid=0 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 client.22425 shutdown 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2554443463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba7bf60 msgr2=0x5595fba95d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba7bf60 0x5595fba95d30 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f8e78004750 tx=0x7f8e78009b30 comp rx=0 tx=0).stop 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2554443463 shutdown_connections 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595fbaa3e30 0x5595fbaa6220 crc :-1 s=READY pgs=641 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba80fb0 0x5595fba93fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba7bf60 0x5595fba95d30 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/2554443463 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e3effd640 0 client.22425 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:41:01.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2554443463 >> 10.20.193.28:0/2554443463 conn(0x5595fba3e240 msgr2=0x5595fba7a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.042+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2554443463 shutdown_connections 2026-02-20T03:41:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.043+0000 7f8e8d995e00 1 -- 10.20.193.28:0/2554443463 wait complete. 2026-02-20T03:41:01.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.043+0000 7f8e8d995e00 20 client.22425 trim_cache size 0 max 16384 2026-02-20T03:41:01.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.049+0000 7f8e8d995e00 1 Processor -- start 2026-02-20T03:41:01.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.049+0000 7f8e8d995e00 1 -- start start 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba7a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba7aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fbaaba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30012760 con 0x5595fba80fb0 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3000ff70 con 0x5595fba7bf60 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3000ddc0 con 0x5595fba7b5e0 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e88a04640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba7aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e88a04640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba7aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47590/0 (socket says 10.20.193.28:47590) 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e88a04640 1 -- 10.20.193.28:0/3393909641 learned_addr learned my addr 10.20.193.28:0/3393909641 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e89205640 1 --2- 10.20.193.28:0/3393909641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba7a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e89a06640 1 --2- 10.20.193.28:0/3393909641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fbaaba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e88a04640 1 -- 10.20.193.28:0/3393909641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 msgr2=0x5595fba7a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e88a04640 1 --2- 10.20.193.28:0/3393909641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba7a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e88a04640 1 -- 10.20.193.28:0/3393909641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 msgr2=0x5595fbaaba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e88a04640 1 --2- 10.20.193.28:0/3393909641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fbaaba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e88a04640 1 -- 10.20.193.28:0/3393909641 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595fba8d860 con 0x5595fba7bf60 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.050+0000 7f8e88a04640 1 --2- 10.20.193.28:0/3393909641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba7aa10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8e78011d90 tx=0x7f8e7802d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5967bd16edc0cff4 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e514e4640 1 -- 10.20.193.28:0/3393909641 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78011b50 con 0x5595fba7bf60 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e514e4640 1 -- 10.20.193.28:0/3393909641 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8e78035070 con 0x5595fba7bf60 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e514e4640 1 -- 10.20.193.28:0/3393909641 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7801fa90 con 0x5595fba7bf60 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3393909641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 msgr2=0x5595fba7aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3393909641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba7aa10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8e78011d90 tx=0x7f8e7802d000 comp rx=0 tx=0).stop 2026-02-20T03:41:01.060 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3393909641 shutdown_connections 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3393909641 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fbaaba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3393909641 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7bf60 0x5595fba7aa10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3393909641 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7b5e0 0x5595fba7a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3393909641 >> 10.20.193.28:0/3393909641 conn(0x5595fba3e240 msgr2=0x5595fba93040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3393909641 shutdown_connections 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3393909641 wait complete. 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.051+0000 7f8e8d995e00 1 -- start start 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e8d995e00 1 Processor -- start 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7b5e0 0x5595fba9bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7bf60 0x5595fba9c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e8d995e00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba98fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3000e430 con 0x5595fba80fb0 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3000f8a0 con 0x5595fba7b5e0 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e8d995e00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3000eb00 con 0x5595fba7bf60 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89a06640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba98fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89205640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7b5e0 0x5595fba9bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89a06640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba98fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52074/0 (socket says 10.20.193.28:52074) 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89a06640 1 -- 10.20.193.28:0/3171781839 learned_addr learned my addr 10.20.193.28:0/3171781839 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e88a04640 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7bf60 0x5595fba9c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89a06640 1 -- 10.20.193.28:0/3171781839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7bf60 msgr2=0x5595fba9c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89a06640 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7bf60 0x5595fba9c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89a06640 1 -- 10.20.193.28:0/3171781839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7b5e0 msgr2=0x5595fba9bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89a06640 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7b5e0 0x5595fba9bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89a06640 1 -- 10.20.193.28:0/3171781839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595fb6ad870 con 0x5595fba80fb0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.052+0000 7f8e89205640 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7b5e0 0x5595fba9bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e89a06640 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba98fb0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f8e8002f8a0 tx=0x7f8e8002f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a24b9a9d9a212cc server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e3effd640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e3effd640 1 -- 10.20.193.28:0/3171781839 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e800d59f0 con 0x5595fba80fb0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3171781839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595fb96e3f0 con 0x5595fba80fb0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 10 client.22431 _ll_register_callbacks cb 0x7f8e78009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3171781839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5595fb980ab0 con 0x5595fba80fb0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e3effd640 1 -- 10.20.193.28:0/3171781839 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8e80033040 con 0x5595fba80fb0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e3effd640 1 -- 10.20.193.28:0/3171781839 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e800cb530 con 0x5595fba80fb0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e3effd640 1 -- 10.20.193.28:0/3171781839 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8e800cdac0 con 0x5595fba80fb0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e3effd640 1 -- 10.20.193.28:0/3171781839 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f8e800cdd20 con 0x5595fba80fb0 2026-02-20T03:41:01.063 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 10 client.22431 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3171781839 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=60}) -- 0x5595fba8e550 con 0x5595fba80fb0 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e3effd640 1 -- 10.20.193.28:0/3171781839 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7f8e800c7f60 con 0x5595fba80fb0 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 10 client.22431 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 10 client.22431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 20 client.22431 populate_metadata read hostname 'trial028' 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595fbb10a30 0x5595fbb12ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 4 client.22431 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.053+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3171781839 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8e78035070 con 0x5595fbb10a30 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.054+0000 7f8e89205640 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595fbb10a30 0x5595fbb12ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.054+0000 7f8e89205640 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595fbb10a30 0x5595fbb12ef0 crc :-1 s=READY pgs=642 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18cbc72e71d4ba07 server_cookie=a175ac6c6341ce06 in_seq=0 out_seq=0 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.054+0000 7f8e3effd640 10 client.22431 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:41:01.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.054+0000 7f8e3effd640 1 -- 10.20.193.28:0/3171781839 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8e78035070 con 0x5595fbb10a30 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.054+0000 7f8e3effd640 10 client.22431 handle_command_reply: tid=0 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.054+0000 7f8e8d995e00 1 client.22431 shutdown 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3171781839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 msgr2=0x5595fba98fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba98fb0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f8e8002f8a0 tx=0x7f8e8002f390 comp rx=0 tx=0).stop 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3171781839 shutdown_connections 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5595fbb10a30 0x5595fbb12ef0 crc :-1 s=READY pgs=642 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5595fba80fb0 0x5595fba98fb0 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5595fba7bf60 0x5595fba9c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 --2- 10.20.193.28:0/3171781839 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5595fba7b5e0 0x5595fba9bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e3effd640 0 client.22431 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:41:01.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3171781839 >> 10.20.193.28:0/3171781839 conn(0x5595fba3e240 msgr2=0x5595fbaa4210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3171781839 shutdown_connections 2026-02-20T03:41:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 1 -- 10.20.193.28:0/3171781839 wait complete. 2026-02-20T03:41:01.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8d995e00 20 client.22431 trim_cache size 0 max 16384 2026-02-20T03:41:01.066 INFO:teuthology.orchestra.run.trial028.stdout:[] 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8a207640 1 -- 10.20.193.28:0/3202687723 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e600b0da0 msgr2=0x7f8e600b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e600b0da0 0x7f8e600b3260 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8e74004160 tx=0x7f8e74009290 comp rx=0 tx=0).stop 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8a207640 1 -- 10.20.193.28:0/3202687723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8e8410eef0 msgr2=0x7f8e841a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.055+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8e8410eef0 0x7f8e841a5d00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009f90 tx=0x7f8e80004290 comp rx=0 tx=0).stop 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.056+0000 7f8e8a207640 1 -- 10.20.193.28:0/3202687723 shutdown_connections 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.056+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8e600b0da0 0x7f8e600b3260 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.056+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8e8410eef0 0x7f8e841a5d00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.056+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8e84109ba0 0x7f8e841a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.056+0000 7f8e8a207640 1 --2- 10.20.193.28:0/3202687723 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8e84109220 0x7f8e841a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.056+0000 7f8e8a207640 1 -- 10.20.193.28:0/3202687723 >> 10.20.193.28:0/3202687723 conn(0x7f8e84078600 msgr2=0x7f8e84079d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.056+0000 7f8e8a207640 1 -- 10.20.193.28:0/3202687723 shutdown_connections 2026-02-20T03:41:01.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.056+0000 7f8e8a207640 1 -- 10.20.193.28:0/3202687723 wait complete. 2026-02-20T03:41:01.198 INFO:tasks.fwd_scrub:done joining 2026-02-20T03:41:01.199 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2026-02-20T03:41:01.217 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T03:41:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.339+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2118306761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cac104920 msgr2=0x7f8cac104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.339+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2118306761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cac104920 0x7f8cac104d20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009960 tx=0x7f8c9c02f140 comp rx=0 tx=0).stop 2026-02-20T03:41:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.339+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2118306761 shutdown_connections 2026-02-20T03:41:01.342 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.339+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2118306761 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cac1064d0 0x7f8cac10cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.339+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2118306761 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cac105b10 0x7f8cac105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.339+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2118306761 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cac104920 0x7f8cac104d20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.339+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2118306761 >> 10.20.193.28:0/2118306761 conn(0x7f8cac100080 msgr2=0x7f8cac1024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.339+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2118306761 shutdown_connections 2026-02-20T03:41:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.339+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2118306761 wait complete. 2026-02-20T03:41:01.343 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb2cfd640 1 Processor -- start 2026-02-20T03:41:01.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb2cfd640 1 -- start start 2026-02-20T03:41:01.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb2cfd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cac104920 0x7f8cac19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.345 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb2cfd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cac105b10 0x7f8cac19cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb2cfd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cac1064d0 0x7f8cac1a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb2cfd640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac110410 con 0x7f8cac104920 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb2cfd640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac110290 con 0x7f8cac105b10 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb2cfd640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac110590 con 0x7f8cac1064d0 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb1cfb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cac104920 0x7f8cac19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb1cfb640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cac104920 0x7f8cac19ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52106/0 (socket says 10.20.193.28:52106) 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb1cfb640 1 -- 10.20.193.28:0/2977499567 learned_addr learned my addr 10.20.193.28:0/2977499567 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb24fc640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cac1064d0 0x7f8cac1a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb14fa640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cac105b10 0x7f8cac19cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb1cfb640 1 -- 10.20.193.28:0/2977499567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cac1064d0 msgr2=0x7f8cac1a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb1cfb640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cac1064d0 0x7f8cac1a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.346 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb1cfb640 1 -- 10.20.193.28:0/2977499567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cac105b10 msgr2=0x7f8cac19cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb1cfb640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cac105b10 0x7f8cac19cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb1cfb640 1 -- 10.20.193.28:0/2977499567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac1a46d0 con 0x7f8cac104920 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb14fa640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cac105b10 0x7f8cac19cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.340+0000 7f8cb1cfb640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cac104920 0x7f8cac19ca20 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c002410 tx=0x7f8c9c02fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.341+0000 7f8c9affd640 1 -- 10.20.193.28:0/2977499567 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c004070 con 0x7f8cac104920 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.341+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cac1a4960 con 0x7f8cac104920 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.341+0000 7f8c9affd640 1 -- 10.20.193.28:0/2977499567 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8c9c0047c0 con 0x7f8cac104920 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.341+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cac1a4ea0 con 0x7f8cac104920 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.341+0000 7f8c9affd640 1 -- 10.20.193.28:0/2977499567 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c038b90 con 0x7f8cac104920 2026-02-20T03:41:01.347 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.341+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cac10b7d0 con 0x7f8cac104920 2026-02-20T03:41:01.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.344+0000 7f8c9affd640 1 -- 10.20.193.28:0/2977499567 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8c9c004210 con 0x7f8cac104920 2026-02-20T03:41:01.348 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.345+0000 7f8c9affd640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c880b0e20 0x7f8c880b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.345+0000 7f8cb14fa640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c880b0e20 0x7f8c880b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.345+0000 7f8c9affd640 1 -- 10.20.193.28:0/2977499567 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8c9c0c9360 con 0x7f8cac104920 2026-02-20T03:41:01.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.346+0000 7f8c9affd640 1 -- 10.20.193.28:0/2977499567 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8c9c0d1370 con 0x7f8cac104920 2026-02-20T03:41:01.349 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.346+0000 7f8cb14fa640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c880b0e20 0x7f8c880b32e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8cac19df30 tx=0x7f8ca0009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.436+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cac10bbe0 con 0x7f8cac104920 2026-02-20T03:41:01.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.437+0000 7f8c9affd640 1 -- 10.20.193.28:0/2977499567 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+25081 (secure 0 0 0) 0x7f8c9c0d6220 con 0x7f8cac104920 2026-02-20T03:41:01.440 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:41:01.441 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":99,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:32:40.803568+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7},{"from":3,"to":6}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.16","mappings":[{"from":1,"to":8}]},{"pgid":"3.17","mappings":[{"from":0,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:41:01.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c880b0e20 msgr2=0x7f8c880b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c880b0e20 0x7f8c880b32e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8cac19df30 tx=0x7f8ca0009290 comp rx=0 tx=0).stop 2026-02-20T03:41:01.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cac104920 msgr2=0x7f8cac19ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cac104920 0x7f8cac19ca20 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c002410 tx=0x7f8c9c02fbd0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 shutdown_connections 2026-02-20T03:41:01.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8c880b0e20 0x7f8c880b32e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8cac1064d0 0x7f8cac1a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8cac105b10 0x7f8cac19cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.442 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 --2- 10.20.193.28:0/2977499567 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8cac104920 0x7f8cac19ca20 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 >> 10.20.193.28:0/2977499567 conn(0x7f8cac100080 msgr2=0x7f8cac108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 shutdown_connections 2026-02-20T03:41:01.443 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.438+0000 7f8cb2cfd640 1 -- 10.20.193.28:0/2977499567 wait complete. 2026-02-20T03:41:01.446 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:01 trial028 ceph-mon[38552]: pgmap v976: 129 pgs: 129 active+clean; 480 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 285 KiB/s rd, 301 KiB/s wr, 156 op/s 2026-02-20T03:41:01.447 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:01 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2977499567' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:41:01.454 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-20T03:12:36.019995+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2026-02-20T03:14:30.208166+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2026-02-20T03:14:31.725985+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2026-02-20T03:14:35.302631+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2026-02-20T03:41:01.455 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-20T03:41:01.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.578+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/3670508570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 msgr2=0x7fa2b010dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.578+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/3670508570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 0x7fa2b010dbe0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009a30 tx=0x7fa2a002f2b0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.581 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.578+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/3670508570 shutdown_connections 2026-02-20T03:41:01.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.578+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/3670508570 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2b010efa0 0x7fa2b0115830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.578+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/3670508570 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2b010e5e0 0x7fa2b010ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.578+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/3670508570 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 0x7fa2b010dbe0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.578+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/3670508570 >> 10.20.193.28:0/3670508570 conn(0x7fa2b006c7a0 msgr2=0x7fa2b006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.578+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/3670508570 shutdown_connections 2026-02-20T03:41:01.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.578+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/3670508570 wait complete. 2026-02-20T03:41:01.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b5fd8640 1 Processor -- start 2026-02-20T03:41:01.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b5fd8640 1 -- start start 2026-02-20T03:41:01.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b5fd8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 0x7fa2b01a5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b5fd8640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2b010e5e0 0x7fa2b01a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b5fd8640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2b010efa0 0x7fa2b01aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b5fd8640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b0118e80 con 0x7fa2b010d7e0 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b5fd8640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b0118d00 con 0x7fa2b010efa0 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b5fd8640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b0119000 con 0x7fa2b010e5e0 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b4fd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 0x7fa2b01a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b4fd6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 0x7fa2b01a5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52122/0 (socket says 10.20.193.28:52122) 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b4fd6640 1 -- 10.20.193.28:0/15507162 learned_addr learned my addr 10.20.193.28:0/15507162 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2a7fff640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2b010e5e0 0x7fa2b01a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.579+0000 7fa2b57d7640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2b010efa0 0x7fa2b01aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2b4fd6640 1 -- 10.20.193.28:0/15507162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2b010e5e0 msgr2=0x7fa2b01a59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2b4fd6640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2b010e5e0 0x7fa2b01a59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2b4fd6640 1 -- 10.20.193.28:0/15507162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2b010efa0 msgr2=0x7fa2b01aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2b4fd6640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2b010efa0 0x7fa2b01aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2b4fd6640 1 -- 10.20.193.28:0/15507162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b01ad130 con 0x7fa2b010d7e0 2026-02-20T03:41:01.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2b4fd6640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 0x7fa2b01a5480 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009950 tx=0x7fa2a0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2a5ffb640 1 -- 10.20.193.28:0/15507162 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0046070 con 0x7fa2b010d7e0 2026-02-20T03:41:01.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2a5ffb640 1 -- 10.20.193.28:0/15507162 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fa2a0038910 con 0x7fa2b010d7e0 2026-02-20T03:41:01.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2a5ffb640 1 -- 10.20.193.28:0/15507162 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0041670 con 0x7fa2b010d7e0 2026-02-20T03:41:01.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b01ad3c0 con 0x7fa2b010d7e0 2026-02-20T03:41:01.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.580+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b01ad860 con 0x7fa2b010d7e0 2026-02-20T03:41:01.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.581+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b0114310 con 0x7fa2b010d7e0 2026-02-20T03:41:01.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.583+0000 7fa2a5ffb640 1 -- 10.20.193.28:0/15507162 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fa2a0038ac0 con 0x7fa2b010d7e0 2026-02-20T03:41:01.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.585+0000 7fa2a5ffb640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa28c0b0e20 0x7fa28c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.585+0000 7fa2a5ffb640 1 -- 10.20.193.28:0/15507162 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fa2a0104fe0 con 0x7fa2b010d7e0 2026-02-20T03:41:01.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.585+0000 7fa2a7fff640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa28c0b0e20 0x7fa28c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.585+0000 7fa2a5ffb640 1 -- 10.20.193.28:0/15507162 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fa2a0105480 con 0x7fa2b010d7e0 2026-02-20T03:41:01.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.585+0000 7fa2a7fff640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa28c0b0e20 0x7fa28c0b32e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa298005fd0 tx=0x7fa298004380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.675+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2b0063880 con 0x7fa2b010d7e0 2026-02-20T03:41:01.678 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.675+0000 7fa2a5ffb640 1 -- 10.20.193.28:0/15507162 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) ==== 93+0+10 (secure 0 0 0) 0x7fa2a00cd460 con 0x7fa2b010d7e0 2026-02-20T03:41:01.679 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 1 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa28c0b0e20 msgr2=0x7fa28c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa28c0b0e20 0x7fa28c0b32e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa298005fd0 tx=0x7fa298004380 comp rx=0 tx=0).stop 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 msgr2=0x7fa2b01a5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 0x7fa2b01a5480 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009950 tx=0x7fa2a0004290 comp rx=0 tx=0).stop 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 shutdown_connections 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fa28c0b0e20 0x7fa28c0b32e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fa2b010efa0 0x7fa2b01aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fa2b010e5e0 0x7fa2b01a59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 --2- 10.20.193.28:0/15507162 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fa2b010d7e0 0x7fa2b01a5480 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.680 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 >> 10.20.193.28:0/15507162 conn(0x7fa2b006c7a0 msgr2=0x7fa2b0111a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 shutdown_connections 2026-02-20T03:41:01.681 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.676+0000 7fa2b5fd8640 1 -- 10.20.193.28:0/15507162 wait complete. 2026-02-20T03:41:01.691 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2026-02-20T03:41:01.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:01 trial177 ceph-mon[43181]: pgmap v976: 129 pgs: 129 active+clean; 480 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 285 KiB/s rd, 301 KiB/s wr, 156 op/s 2026-02-20T03:41:01.718 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:01 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2977499567' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:41:01.746 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:01 trial126 ceph-mon[38476]: pgmap v976: 129 pgs: 129 active+clean; 480 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 285 KiB/s rd, 301 KiB/s wr, 156 op/s 2026-02-20T03:41:01.746 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:01 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2977499567' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:41:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.814+0000 7f1506145640 1 -- 10.20.193.28:0/1757871745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15001038b0 msgr2=0x7f1500105d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.814+0000 7f1506145640 1 --2- 10.20.193.28:0/1757871745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15001038b0 0x7f1500105d20 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009a30 tx=0x7f14f402f220 comp rx=0 tx=0).stop 2026-02-20T03:41:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.815+0000 7f1506145640 1 -- 10.20.193.28:0/1757871745 shutdown_connections 2026-02-20T03:41:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.815+0000 7f1506145640 1 --2- 10.20.193.28:0/1757871745 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1500106260 0x7f1500106710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.815+0000 7f1506145640 1 --2- 10.20.193.28:0/1757871745 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f15001038b0 0x7f1500105d20 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.815+0000 7f1506145640 1 --2- 10.20.193.28:0/1757871745 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1500100f60 0x7f1500103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.815+0000 7f1506145640 1 -- 10.20.193.28:0/1757871745 >> 10.20.193.28:0/1757871745 conn(0x7f15000fcd50 msgr2=0x7f15000ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.815+0000 7f1506145640 1 -- 10.20.193.28:0/1757871745 shutdown_connections 2026-02-20T03:41:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.815+0000 7f1506145640 1 -- 10.20.193.28:0/1757871745 wait complete. 2026-02-20T03:41:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.815+0000 7f1506145640 1 Processor -- start 2026-02-20T03:41:01.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.815+0000 7f1506145640 1 -- start start 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1506145640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1500100f60 0x7f15001a0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1506145640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15001038b0 0x7f15001a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1506145640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1500106260 0x7f15001a8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1506145640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f15001149b0 con 0x7f1500106260 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1506145640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1500114830 con 0x7f1500100f60 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1506145640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1500114b30 con 0x7f15001038b0 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505944640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1500106260 0x7f15001a8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505143640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1500100f60 0x7f15001a0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505944640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1500106260 0x7f15001a8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52130/0 (socket says 10.20.193.28:52130) 2026-02-20T03:41:01.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505944640 1 -- 10.20.193.28:0/2129131956 learned_addr learned my addr 10.20.193.28:0/2129131956 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1504942640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15001038b0 0x7f15001a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505944640 1 -- 10.20.193.28:0/2129131956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15001038b0 msgr2=0x7f15001a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505944640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15001038b0 0x7f15001a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505944640 1 -- 10.20.193.28:0/2129131956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1500100f60 msgr2=0x7f15001a0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505944640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1500100f60 0x7f15001a0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505944640 1 -- 10.20.193.28:0/2129131956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15001a8c50 con 0x7f1500106260 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f1505944640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1500106260 0x7f15001a8550 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f14fc004820 tx=0x7f14fc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f14ee7fc640 1 -- 10.20.193.28:0/2129131956 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0090d0 con 0x7f1500106260 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.816+0000 7f14ee7fc640 1 -- 10.20.193.28:0/2129131956 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f14fc009270 con 0x7f1500106260 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.817+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15001a8ee0 con 0x7f1500106260 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.817+0000 7f14ee7fc640 1 -- 10.20.193.28:0/2129131956 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc013810 con 0x7f1500106260 2026-02-20T03:41:01.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.817+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15001a93a0 con 0x7f1500106260 2026-02-20T03:41:01.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.817+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15000fe2b0 con 0x7f1500106260 2026-02-20T03:41:01.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.820+0000 7f14ee7fc640 1 -- 10.20.193.28:0/2129131956 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f14fc012070 con 0x7f1500106260 2026-02-20T03:41:01.823 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.821+0000 7f14ee7fc640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14dc0b0ea0 0x7f14dc0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.821+0000 7f14ee7fc640 1 -- 10.20.193.28:0/2129131956 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f14fc0e07d0 con 0x7f1500106260 2026-02-20T03:41:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.821+0000 7f1505143640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14dc0b0ea0 0x7f14dc0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.821+0000 7f1505143640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14dc0b0ea0 0x7f14dc0b3360 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f14f0007c40 tx=0x7f14f00073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:01.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.822+0000 7f14ee7fc640 1 -- 10.20.193.28:0/2129131956 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f14fc010070 con 0x7f1500106260 2026-02-20T03:41:01.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.911+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f15000fe480 con 0x7f1500106260 2026-02-20T03:41:01.914 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.911+0000 7f14ee7fc640 1 -- 10.20.193.28:0/2129131956 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) ==== 104+0+11 (secure 0 0 0) 0x7f14fc0a8bb0 con 0x7f1500106260 2026-02-20T03:41:01.914 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 32 2026-02-20T03:41:01.915 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14dc0b0ea0 msgr2=0x7f14dc0b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14dc0b0ea0 0x7f14dc0b3360 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f14f0007c40 tx=0x7f14f00073d0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1500106260 msgr2=0x7f15001a8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1500106260 0x7f15001a8550 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f14fc004820 tx=0x7f14fc00d4a0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 shutdown_connections 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f14dc0b0ea0 0x7f14dc0b3360 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1500106260 0x7f15001a8550 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f15001038b0 0x7f15001a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 --2- 10.20.193.28:0/2129131956 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1500100f60 0x7f15001a0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.912+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 >> 10.20.193.28:0/2129131956 conn(0x7f15000fcd50 msgr2=0x7f1500101980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.913+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 shutdown_connections 2026-02-20T03:41:01.916 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:01.913+0000 7f1506145640 1 -- 10.20.193.28:0/2129131956 wait complete. 2026-02-20T03:41:01.927 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2026-02-20T03:41:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.049+0000 7fe9edba9640 1 -- 10.20.193.28:0/2384988693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e8109220 msgr2=0x7fe9e81096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.052 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.049+0000 7fe9edba9640 1 --2- 10.20.193.28:0/2384988693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e8109220 0x7fe9e81096a0 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009960 tx=0x7fe9d002f140 comp rx=0 tx=0).stop 2026-02-20T03:41:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.049+0000 7fe9edba9640 1 -- 10.20.193.28:0/2384988693 shutdown_connections 2026-02-20T03:41:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.049+0000 7fe9edba9640 1 --2- 10.20.193.28:0/2384988693 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe9e8109be0 0x7fe9e8111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.049+0000 7fe9edba9640 1 --2- 10.20.193.28:0/2384988693 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e8109220 0x7fe9e81096a0 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.049+0000 7fe9edba9640 1 --2- 10.20.193.28:0/2384988693 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe9e810a540 0x7fe9e810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.049+0000 7fe9edba9640 1 -- 10.20.193.28:0/2384988693 >> 10.20.193.28:0/2384988693 conn(0x7fe9e8078080 msgr2=0x7fe9e807a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.049+0000 7fe9edba9640 1 -- 10.20.193.28:0/2384988693 shutdown_connections 2026-02-20T03:41:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.049+0000 7fe9edba9640 1 -- 10.20.193.28:0/2384988693 wait complete. 2026-02-20T03:41:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9edba9640 1 Processor -- start 2026-02-20T03:41:02.053 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9edba9640 1 -- start start 2026-02-20T03:41:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9edba9640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe9e8109220 0x7fe9e81a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9edba9640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe9e8109be0 0x7fe9e81a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.055 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9edba9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e810a540 0x7fe9e81a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9edba9640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e81149a0 con 0x7fe9e810a540 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9edba9640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e8114820 con 0x7fe9e8109be0 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9edba9640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e8114b20 con 0x7fe9e8109220 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9ed3a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e810a540 0x7fe9e81a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9ecba7640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe9e8109220 0x7fe9e81a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9ed3a8640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e810a540 0x7fe9e81a85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52146/0 (socket says 10.20.193.28:52146) 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9ed3a8640 1 -- 10.20.193.28:0/3160443871 learned_addr learned my addr 10.20.193.28:0/3160443871 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9dffff640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe9e8109be0 0x7fe9e81a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9ed3a8640 1 -- 10.20.193.28:0/3160443871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe9e8109220 msgr2=0x7fe9e81a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.050+0000 7fe9ed3a8640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe9e8109220 0x7fe9e81a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9ed3a8640 1 -- 10.20.193.28:0/3160443871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe9e8109be0 msgr2=0x7fe9e81a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9ed3a8640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe9e8109be0 0x7fe9e81a1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9ed3a8640 1 -- 10.20.193.28:0/3160443871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e81a8ca0 con 0x7fe9e810a540 2026-02-20T03:41:02.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9ecba7640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe9e8109220 0x7fe9e81a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:41:02.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9ed3a8640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e810a540 0x7fe9e81a85a0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400ef90 tx=0x7fe9e400c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:02.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9ddffb640 1 -- 10.20.193.28:0/3160443871 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4019070 con 0x7fe9e810a540 2026-02-20T03:41:02.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9ddffb640 1 -- 10.20.193.28:0/3160443871 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fe9e40092d0 con 0x7fe9e810a540 2026-02-20T03:41:02.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9ddffb640 1 -- 10.20.193.28:0/3160443871 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4007500 con 0x7fe9e810a540 2026-02-20T03:41:02.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e81a8f30 con 0x7fe9e810a540 2026-02-20T03:41:02.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.051+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e81a93a0 con 0x7fe9e810a540 2026-02-20T03:41:02.057 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.052+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e810fef0 con 0x7fe9e810a540 2026-02-20T03:41:02.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.053+0000 7fe9ddffb640 1 -- 10.20.193.28:0/3160443871 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fe9e40076a0 con 0x7fe9e810a540 2026-02-20T03:41:02.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.055+0000 7fe9ddffb640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe9c40b0e20 0x7fe9c40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.055+0000 7fe9ddffb640 1 -- 10.20.193.28:0/3160443871 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fe9e40e0930 con 0x7fe9e810a540 2026-02-20T03:41:02.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.055+0000 7fe9ecba7640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe9c40b0e20 0x7fe9c40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.056+0000 7fe9ecba7640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe9c40b0e20 0x7fe9c40b32e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe9e807b740 tx=0x7fe9d8009340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:02.059 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.056+0000 7fe9ddffb640 1 -- 10.20.193.28:0/3160443871 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fe9e4052b20 con 0x7fe9e810a540 2026-02-20T03:41:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.148+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe9e80638b0 con 0x7fe9e810a540 2026-02-20T03:41:02.151 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.148+0000 7fe9ddffb640 1 -- 10.20.193.28:0/3160443871 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) ==== 100+0+11 (secure 0 0 0) 0x7fe9e4010040 con 0x7fe9e810a540 2026-02-20T03:41:02.152 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 64 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe9c40b0e20 msgr2=0x7fe9c40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe9c40b0e20 0x7fe9c40b32e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe9e807b740 tx=0x7fe9d8009340 comp rx=0 tx=0).stop 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e810a540 msgr2=0x7fe9e81a85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e810a540 0x7fe9e81a85a0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400ef90 tx=0x7fe9e400c560 comp rx=0 tx=0).stop 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 shutdown_connections 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fe9c40b0e20 0x7fe9c40b32e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fe9e810a540 0x7fe9e81a85a0 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fe9e8109be0 0x7fe9e81a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 --2- 10.20.193.28:0/3160443871 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fe9e8109220 0x7fe9e81a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 >> 10.20.193.28:0/3160443871 conn(0x7fe9e8078080 msgr2=0x7fe9e810d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:02.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 shutdown_connections 2026-02-20T03:41:02.154 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.149+0000 7fe9edba9640 1 -- 10.20.193.28:0/3160443871 wait complete. 2026-02-20T03:41:02.165 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2026-02-20T03:41:02.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.286+0000 7f3762db3640 1 -- 10.20.193.28:0/3249740721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f375c109be0 msgr2=0x7f375c111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.286+0000 7f3762db3640 1 --2- 10.20.193.28:0/3249740721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f375c109be0 0x7f375c111480 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f375800b0a0 tx=0x7f375802f410 comp rx=0 tx=0).stop 2026-02-20T03:41:02.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.286+0000 7f3762db3640 1 -- 10.20.193.28:0/3249740721 shutdown_connections 2026-02-20T03:41:02.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.286+0000 7f3762db3640 1 --2- 10.20.193.28:0/3249740721 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f375c109be0 0x7f375c111480 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.286+0000 7f3762db3640 1 --2- 10.20.193.28:0/3249740721 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f375c109220 0x7f375c1096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.289 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.286+0000 7f3762db3640 1 --2- 10.20.193.28:0/3249740721 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f375c10a540 0x7f375c10a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.286+0000 7f3762db3640 1 -- 10.20.193.28:0/3249740721 >> 10.20.193.28:0/3249740721 conn(0x7f375c078080 msgr2=0x7f375c07a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:02.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.286+0000 7f3762db3640 1 -- 10.20.193.28:0/3249740721 shutdown_connections 2026-02-20T03:41:02.290 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.286+0000 7f3762db3640 1 -- 10.20.193.28:0/3249740721 wait complete. 2026-02-20T03:41:02.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3762db3640 1 Processor -- start 2026-02-20T03:41:02.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3762db3640 1 -- start start 2026-02-20T03:41:02.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3762db3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f375c109220 0x7f375c1a0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3762db3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f375c109be0 0x7f375c1a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.292 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3762db3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f375c10a540 0x7f375c1a8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3762db3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f375c1149c0 con 0x7f375c109220 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3762db3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f375c114840 con 0x7f375c109be0 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3762db3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f375c114b40 con 0x7f375c10a540 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3761db1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f375c109220 0x7f375c1a0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3761db1640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f375c109220 0x7f375c1a0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52156/0 (socket says 10.20.193.28:52156) 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f3761db1640 1 -- 10.20.193.28:0/970317791 learned_addr learned my addr 10.20.193.28:0/970317791 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f37615b0640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f375c109be0 0x7f375c1a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f37625b2640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f375c10a540 0x7f375c1a8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f37615b0640 1 -- 10.20.193.28:0/970317791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f375c10a540 msgr2=0x7f375c1a8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f37615b0640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f375c10a540 0x7f375c1a8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.293 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f37615b0640 1 -- 10.20.193.28:0/970317791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f375c109220 msgr2=0x7f375c1a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.287+0000 7f37615b0640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f375c109220 0x7f375c1a0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.288+0000 7f37615b0640 1 -- 10.20.193.28:0/970317791 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375c1a8c00 con 0x7f375c109be0 2026-02-20T03:41:02.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.288+0000 7f37615b0640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f375c109be0 0x7f375c1a1490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f375000e9f0 tx=0x7f375000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:02.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.288+0000 7f374affd640 1 -- 10.20.193.28:0/970317791 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375000cd80 con 0x7f375c109be0 2026-02-20T03:41:02.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.288+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375c1a8ef0 con 0x7f375c109be0 2026-02-20T03:41:02.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.288+0000 7f374affd640 1 -- 10.20.193.28:0/970317791 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3750004570 con 0x7f375c109be0 2026-02-20T03:41:02.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.288+0000 7f374affd640 1 -- 10.20.193.28:0/970317791 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750010690 con 0x7f375c109be0 2026-02-20T03:41:02.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.288+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375c1a93b0 con 0x7f375c109be0 2026-02-20T03:41:02.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.289+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f375c10fef0 con 0x7f375c109be0 2026-02-20T03:41:02.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.291+0000 7f374affd640 1 -- 10.20.193.28:0/970317791 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3750002890 con 0x7f375c109be0 2026-02-20T03:41:02.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.292+0000 7f374affd640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f37380b0e20 0x7f37380b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.292+0000 7f374affd640 1 -- 10.20.193.28:0/970317791 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f37500e0f70 con 0x7f375c109be0 2026-02-20T03:41:02.295 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.292+0000 7f374affd640 1 -- 10.20.193.28:0/970317791 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f37500e13f0 con 0x7f375c109be0 2026-02-20T03:41:02.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.293+0000 7f3761db1640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f37380b0e20 0x7f37380b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.296 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.293+0000 7f3761db1640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f37380b0e20 0x7f37380b32e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f374c004690 tx=0x7f374c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.382+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f375c110310 con 0x7f375c109be0 2026-02-20T03:41:02.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.382+0000 7f374affd640 1 -- 10.20.193.28:0/970317791 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v99) ==== 103+0+11 (secure 0 0 0) 0x7f37500a9350 con 0x7f375c109be0 2026-02-20T03:41:02.385 INFO:teuthology.orchestra.run.trial028.stdout:pg_num: 32 2026-02-20T03:41:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f37380b0e20 msgr2=0x7f37380b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f37380b0e20 0x7f37380b32e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f374c004690 tx=0x7f374c009290 comp rx=0 tx=0).stop 2026-02-20T03:41:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f375c109be0 msgr2=0x7f375c1a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f375c109be0 0x7f375c1a1490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f375000e9f0 tx=0x7f375000eec0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 shutdown_connections 2026-02-20T03:41:02.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f37380b0e20 0x7f37380b32e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f375c10a540 0x7f375c1a8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f375c109be0 0x7f375c1a1490 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 --2- 10.20.193.28:0/970317791 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f375c109220 0x7f375c1a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 >> 10.20.193.28:0/970317791 conn(0x7f375c078080 msgr2=0x7f375c10d650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:02.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 shutdown_connections 2026-02-20T03:41:02.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.383+0000 7f3762db3640 1 -- 10.20.193.28:0/970317791 wait complete. 2026-02-20T03:41:02.399 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2026-02-20T03:41:02.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 -- 10.20.193.28:0/1736454151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109e60 msgr2=0x7ff2b810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1736454151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109e60 0x7ff2b810a2e0 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009a30 tx=0x7ff2ac02f220 comp rx=0 tx=0).stop 2026-02-20T03:41:02.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 -- 10.20.193.28:0/1736454151 shutdown_connections 2026-02-20T03:41:02.526 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1736454151 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2b810a930 0x7ff2b8111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1736454151 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109e60 0x7ff2b810a2e0 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1736454151 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2b8109490 0x7ff2b8109890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 -- 10.20.193.28:0/1736454151 >> 10.20.193.28:0/1736454151 conn(0x7ff2b8078080 msgr2=0x7ff2b807a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:02.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 -- 10.20.193.28:0/1736454151 shutdown_connections 2026-02-20T03:41:02.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 -- 10.20.193.28:0/1736454151 wait complete. 2026-02-20T03:41:02.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.523+0000 7ff2c051b640 1 Processor -- start 2026-02-20T03:41:02.527 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2c051b640 1 -- start start 2026-02-20T03:41:02.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2c051b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109490 0x7ff2b81a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2c051b640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2b8109e60 0x7ff2b81a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2c051b640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2b810a930 0x7ff2b81a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2c051b640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8114990 con 0x7ff2b8109490 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2c051b640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8114810 con 0x7ff2b810a930 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2c051b640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b8114b10 con 0x7ff2b8109e60 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2be290640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109490 0x7ff2b81a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2be290640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109490 0x7ff2b81a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52162/0 (socket says 10.20.193.28:52162) 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2be290640 1 -- 10.20.193.28:0/1427611422 learned_addr learned my addr 10.20.193.28:0/1427611422 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2bda8f640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2b8109e60 0x7ff2b81a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2bea91640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2b810a930 0x7ff2b81a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2be290640 1 -- 10.20.193.28:0/1427611422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2b8109e60 msgr2=0x7ff2b81a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2be290640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2b8109e60 0x7ff2b81a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2be290640 1 -- 10.20.193.28:0/1427611422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2b810a930 msgr2=0x7ff2b81a8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2be290640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2b810a930 0x7ff2b81a8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:02.530 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.524+0000 7ff2be290640 1 -- 10.20.193.28:0/1427611422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b81a8c90 con 0x7ff2b8109490 2026-02-20T03:41:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.525+0000 7ff2be290640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109490 0x7ff2b81a0fe0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800d980 tx=0x7ff2a800de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.525+0000 7ff29f7fe640 1 -- 10.20.193.28:0/1427611422 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8014070 con 0x7ff2b8109490 2026-02-20T03:41:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.525+0000 7ff29f7fe640 1 -- 10.20.193.28:0/1427611422 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7ff2a80044e0 con 0x7ff2b8109490 2026-02-20T03:41:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.525+0000 7ff29f7fe640 1 -- 10.20.193.28:0/1427611422 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8010460 con 0x7ff2b8109490 2026-02-20T03:41:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.525+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b81a8f80 con 0x7ff2b8109490 2026-02-20T03:41:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.525+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b81a9390 con 0x7ff2b8109490 2026-02-20T03:41:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.525+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b810fea0 con 0x7ff2b8109490 2026-02-20T03:41:02.531 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.527+0000 7ff29f7fe640 1 -- 10.20.193.28:0/1427611422 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7ff2a800b840 con 0x7ff2b8109490 2026-02-20T03:41:02.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.529+0000 7ff29f7fe640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2940b0e20 0x7ff2940b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:02.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.529+0000 7ff29f7fe640 1 -- 10.20.193.28:0/1427611422 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7ff2a80e1000 con 0x7ff2b8109490 2026-02-20T03:41:02.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.530+0000 7ff2bda8f640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2940b0e20 0x7ff2940b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:02.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.530+0000 7ff29f7fe640 1 -- 10.20.193.28:0/1427611422 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7ff2a80e1520 con 0x7ff2b8109490 2026-02-20T03:41:02.533 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.530+0000 7ff2bda8f640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2940b0e20 0x7ff2940b32e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff2b81a24f0 tx=0x7ff2ac03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:02.643 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.641+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff2b81100c0 con 0x7ff2b8109490 2026-02-20T03:41:02.652 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.649+0000 7ff29f7fe640 1 -- 10.20.193.28:0/1427611422 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v17) ==== 81+0+808238 (secure 0 0 0) 0x7ff2a80a9440 con 0x7ff2b8109490 2026-02-20T03:41:02.663 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:41:02.663 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:41:02.663 INFO:teuthology.orchestra.run.trial028.stdout: "epoch": 17, 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: "active_gid": 14150, 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: "active_name": "x", 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: "active_addrs": { 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:6800", 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 3562582510 2026-02-20T03:41:02.664 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v1", 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:6801", 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 3562582510 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: "active_addr": "10.20.193.28:6801/3562582510", 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: "active_change": "2026-02-20T03:11:25.971250+0000", 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: "active_mgr_features": 4540701547738038271, 2026-02-20T03:41:02.665 INFO:teuthology.orchestra.run.trial028.stdout: "available": true, 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "standbys": [ 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "gid": 24112, 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "name": "z", 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_features": 4540701547738038271, 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "available_modules": [ 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "name": "alerts", 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.666 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to reexamine health status", 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.667 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.668 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.669 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.670 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.671 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.672 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_destination": { 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_destination", 2026-02-20T03:41:02.673 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email address to send alerts to", 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_from_name": { 2026-02-20T03:41:02.674 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_from_name", 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "Ceph", 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email From: name", 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.675 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_host": { 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_host", 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP server", 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.676 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_password": { 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_password", 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Password to authenticate with", 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.677 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_port": { 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_port", 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "465", 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP port", 2026-02-20T03:41:02.678 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_sender": { 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_sender", 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.679 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP envelope sender", 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_ssl": { 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_ssl", 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.680 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_user": { 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_user", 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.681 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "User to authenticate as", 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.682 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.683 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "name": "balancer", 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "active": { 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "name": "active", 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.684 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically balance PGs across cluster", 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "begin_time": { 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_time", 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.685 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0000", 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "beginning time of day to automatically balance", 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "begin_weekday": { 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_weekday", 2026-02-20T03:41:02.686 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_max_iterations": { 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_max_iterations", 2026-02-20T03:41:02.687 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "25", 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "max": "250", 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_metrics": { 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_metrics", 2026-02-20T03:41:02.688 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "pgs,objects,bytes", 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_step": { 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_step", 2026-02-20T03:41:02.689 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.5", 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0.001", 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "max": "0.999", 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "aggressiveness of optimization", 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "end_time": { 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_time", 2026-02-20T03:41:02.690 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2359", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ending time of day to automatically balance", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "end_weekday": { 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_weekday", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.691 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.692 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.693 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.694 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.695 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "min_score": { 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_score", 2026-02-20T03:41:02.696 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "upmap", 2026-02-20T03:41:02.697 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "crush-compat", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "none", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "read", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "upmap", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "upmap-read" 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Balancer mode", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "pool_ids": { 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_ids", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.698 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.699 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.700 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "update_pg_upmap_activity": { 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_pg_upmap_activity", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_deviation": { 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_deviation", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.701 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_optimizations": { 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_optimizations", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.702 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm", 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "agent_down_multiplier": { 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_down_multiplier", 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T03:41:02.703 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "agent_refresh_rate": { 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_refresh_rate", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "20", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.704 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "agent_starting_port": { 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_starting_port", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4721", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "allow_ptrace": { 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_ptrace", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.705 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_interval": { 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_interval", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to autotune daemon memory", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.706 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_memory_target_ratio": { 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_memory_target_ratio", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.7", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_log_destination": { 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm_log_destination", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.707 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "file", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "file,syslog", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "syslog" 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Destination for cephadm command's persistent logging", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "cgroups_split": { 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cgroups_split", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.708 INFO:teuthology.orchestra.run.trial028.stdout: "config_checks_enabled": { 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_checks_enabled", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "config_dashboard": { 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_dashboard", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.709 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alertmanager": { 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alertmanager", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_base": { 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_base", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.710 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Container image name, without the tag", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_elasticsearch": { 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_elasticsearch", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "elasticsearch container image", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.711 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_grafana": { 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_grafana", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_haproxy": { 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_haproxy", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.712 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "HAproxy container image", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_agent": { 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_agent", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger agent container image", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_collector": { 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_collector", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-20T03:41:02.713 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger collector container image", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_query": { 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_query", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger query container image", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_keepalived": { 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_keepalived", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.714 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Keepalived container image", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_loki": { 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_loki", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/loki:3.0.0", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Loki container image", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_node_exporter": { 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_node_exporter", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.715 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nvmeof": { 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nvmeof", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nvme-of container image", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_prometheus": { 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_prometheus", 2026-02-20T03:41:02.716 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_promtail": { 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_promtail", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/promtail:3.0.0", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Promtail container image", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.717 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba": { 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba/SMB container image", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_snmp_gateway": { 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_snmp_gateway", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/snmp-notifier:v1.2.1", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SNMP Gateway container image", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.718 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "container_init": { 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_init", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Run podman/docker with `--init`", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "daemon_cache_timeout": { 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "name": "daemon_cache_timeout", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "seconds to cache service (daemon) inventory", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.719 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_cephadm_command_timeout": { 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_cephadm_command_timeout", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "900", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_registry": { 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_registry", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.720 INFO:teuthology.orchestra.run.trial028.stdout: "device_cache_timeout": { 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_cache_timeout", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "seconds to cache device inventory", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "device_enhanced_scan": { 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_enhanced_scan", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "facts_cache_timeout": { 2026-02-20T03:41:02.721 INFO:teuthology.orchestra.run.trial028.stdout: "name": "facts_cache_timeout", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "seconds to cache host facts data", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "grafana_dashboards_path": { 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "grafana_dashboards_path", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "location of dashboards to include in grafana deployments", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "host_check_interval": { 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "name": "host_check_interval", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.722 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to perform a host check", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "hw_monitoring": { 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hw_monitoring", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "inventory_list_all": { 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "name": "inventory_list_all", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.723 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "log_refresh_metadata": { 2026-02-20T03:41:02.724 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_refresh_metadata", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.725 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.726 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "*", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "max_count_per_host": { 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_count_per_host", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "max number of daemons per service per host", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "max_osd_draining_count": { 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_osd_draining_count", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.727 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "migration_current": { 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "name": "migration_current", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "internal - do not modify", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "root", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm-package", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "root" 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "mode for remote execution of cephadm", 2026-02-20T03:41:02.728 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "oob_default_addr": { 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "name": "oob_default_addr", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "169.254.1.1", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default address for RedFish API (oob management).", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_alerts_path": { 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_alerts_path", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "location of alerts to include in prometheus deployments", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "registry_insecure": { 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_insecure", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.729 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "registry_password": { 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_password", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "registry_url": { 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_url", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "registry_username": { 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_username", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.730 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "service_discovery_port": { 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "service_discovery_port", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8765", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "cephadm service discovery port", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.731 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_config_file": { 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_config_file", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "customized SSH config file to connect to managed hosts", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_count_max": { 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_count_max", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.732 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_interval": { 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_interval", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often ssh connections are checked for liveness", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "use_agent": { 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_agent", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "use_repo_digest": { 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_repo_digest", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2026-02-20T03:41:02.733 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_failed_host_check": { 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_failed_host_check", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise a health warning if the host check fails", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_daemons": { 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_daemons", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_hosts": { 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_hosts", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.734 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crash", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.735 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "retain_interval": { 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retain_interval", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.736 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "31536000", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "warn_recent_interval": { 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_recent_interval", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1209600", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.737 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dashboard", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_HOST": { 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.738 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_ENABLED": { 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_ENABLED", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "ENABLE_BROWSABLE_API": { 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-20T03:41:02.739 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.740 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.741 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_PASSWORD": { 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_URL": { 2026-02-20T03:41:02.742 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_URL", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_USERNAME": { 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.743 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_HOST": { 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.744 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.745 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-20T03:41:02.746 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_ENABLED": { 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.747 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "45", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.748 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ACCESS_KEY": { 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SECRET_KEY": { 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.749 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SSL_VERIFY": { 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-20T03:41:02.750 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "cross_origin_url": { 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cross_origin_url", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "crt_file": { 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crt_file", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "debug": { 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "name": "debug", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.751 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable/disable debug options", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "jwt_token_ttl": { 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "name": "jwt_token_ttl", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "28800", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.752 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.753 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "motd": { 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "motd", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The message of the day", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "redirect_resolve_ip_addr": { 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "redirect_resolve_ip_addr", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.754 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8080", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.755 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "ssl_server_port": { 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl_server_port", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8443", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "redirect", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "redirect" 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.756 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "url_prefix": { 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url_prefix", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "enable_monitoring": { 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_monitoring", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "monitor device health metrics", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.757 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.758 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "mark_out_threshold": { 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mark_out_threshold", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2419200", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "pool_name": { 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_name", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "device_health_metrics", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "retention_period": { 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retention_period", 2026-02-20T03:41:02.759 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15552000", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain device health metrics", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_frequency": { 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_frequency", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "self_heal": { 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "self_heal", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.760 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and check device health", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "warn_threshold": { 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_threshold", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7257600", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "diskprediction_local", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.761 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.762 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "predict_interval": { 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predict_interval", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "predictor_model": { 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predictor_model", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "prophetstor", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.763 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "influx", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": false, 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "influxdb python module not found", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "batch_size": { 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "name": "batch_size", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5000", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.764 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "database": { 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "database", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "ceph", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": { 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hostname", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server hostname", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "min": "5", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-20T03:41:02.765 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.766 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "password": { 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "password", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "password of InfluxDB server user", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "port": { 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "name": "port", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.767 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8086", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server port", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "false", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "threads": { 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threads", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "max": "32", 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.768 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "username": { 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "username", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "username of InfluxDB server user", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "verify_ssl": { 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "verify_ssl", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "true", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "insights", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.769 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.770 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "iostat", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.771 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.772 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "k8sevents", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_event_retention_days": { 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ceph_event_retention_days", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T03:41:02.773 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "config_check_secs": { 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_check_secs", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.774 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.775 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "localpool", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "failure_domain": { 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "failure_domain", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "host", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "failure domain for any created local pool", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.776 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.777 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "min_size": { 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_size", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default min_size for any created local pool", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "num_rep": { 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "num_rep", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default replica count for any created local pool", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "pg_num": { 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_num", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.778 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "128", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default pg_num for any created local pool", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "prefix": { 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prefix", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name prefix for any created local pool", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "subtree": { 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "name": "subtree", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rack", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.779 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mds_autoscaler", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.780 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.781 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirroring", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.782 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.783 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "name": "nfs", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.784 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.785 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "fail_fs": { 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "fail_fs", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.786 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.787 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator": { 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "rook", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "test_orchestrator" 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Orchestrator backend", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_perf_query", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.788 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.789 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_support", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.790 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.791 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_autoscaler", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.792 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.793 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.794 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "threshold": { 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threshold", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1.0", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "scaling threshold", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "name": "progress", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "allow_pg_recovery_event": { 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_pg_recovery_event", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.795 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.796 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "max_completed_events": { 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_completed_events", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "50", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "number of past completed events to remember", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.797 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long the module is going to sleep", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "cache": { 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cache", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.798 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "exclude_perf_counters": { 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "name": "exclude_perf_counters", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.799 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.800 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools": { 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "300", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_interval": { 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_interval", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15.0", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.801 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "9283", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "stale_cache_strategy": { 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stale_cache_strategy", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "log", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.802 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "default", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "default", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "error" 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.803 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.804 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_snap_create": { 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_snap_create", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "mirror_snapshot_schedule": { 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirror_snapshot_schedule", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.805 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "trash_purge_schedule": { 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "name": "trash_purge_schedule", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "name": "restful", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "enable_auth": { 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_auth", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.806 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.807 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.808 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "max_requests": { 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_requests", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.809 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rgw", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.810 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.811 INFO:teuthology.orchestra.run.trial028.stdout: "secondary_zone_period_retry_limit": { 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rook", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.812 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.813 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "storage_class": { 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "name": "storage_class", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "local", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.814 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "name": "selftest", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.815 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "roption1": { 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption1", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.816 INFO:teuthology.orchestra.run.trial028.stdout: "roption2": { 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption2", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "xyz", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption1": { 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption1", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption2": { 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption2", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption3": { 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption3", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.817 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption4": { 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption4", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption5": { 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption5", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption6": { 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption6", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.818 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption7": { 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption7", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "max": "42", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "testkey": { 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testkey", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.819 INFO:teuthology.orchestra.run.trial028.stdout: "testlkey": { 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testlkey", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "testnewline": { 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testnewline", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "allow_m_granularity": { 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_m_granularity", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow minute scheduled snapshots", 2026-02-20T03:41:02.820 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "dump_on_update": { 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dump_on_update", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "dump database to debug log on update", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.821 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.822 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stats", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.823 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.824 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "name": "status", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.825 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.826 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telegraf", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "address": { 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "name": "address", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.827 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.828 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telemetry", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "channel_basic": { 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_basic", 2026-02-20T03:41:02.829 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "channel_crash": { 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_crash", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "channel_device": { 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_device", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "channel_ident": { 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_ident", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.830 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "channel_perf": { 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_perf", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "contact": { 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "name": "contact", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "description": { 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "name": "description", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.831 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "device_url": { 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_url", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "24", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "min": "8", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "last_opt_revision": { 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "name": "last_opt_revision", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.832 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard": { 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard_description": { 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard_description", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.833 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.834 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "organization": { 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "name": "organization", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "proxy": { 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "name": "proxy", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.835 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "url": { 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "name": "test_orchestrator", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.836 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.837 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.838 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.839 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_clones": { 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_clones", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "periodic_async_work": { 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "name": "periodic_async_work", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Periodically check for async work", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_delay": { 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_delay", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.840 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_no_wait": { 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_no_wait", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "discovery_interval": { 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "name": "discovery_interval", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.841 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "100", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "identifier": { 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "name": "identifier", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.842 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.843 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "zabbix_host": { 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix_host", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "zabbix_port": { 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix_port", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.844 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10051", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "zabbix_sender": { 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix_sender", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/usr/bin/zabbix_sender", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "gid": 24119, 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "name": "y", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_features": 4540701547738038271, 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "available_modules": [ 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "name": "alerts", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.845 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to reexamine health status", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.846 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_destination": { 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_destination", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email address to send alerts to", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_from_name": { 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_from_name", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.847 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "Ceph", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email From: name", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_host": { 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_host", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP server", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_password": { 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_password", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Password to authenticate with", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_port": { 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_port", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "465", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.848 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP port", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_sender": { 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_sender", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP envelope sender", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_ssl": { 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_ssl", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_user": { 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_user", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "User to authenticate as", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.849 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "name": "balancer", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "active": { 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "name": "active", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically balance PGs across cluster", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "begin_time": { 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_time", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0000", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.850 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "beginning time of day to automatically balance", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "begin_weekday": { 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_weekday", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_max_iterations": { 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_max_iterations", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "25", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "max": "250", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_metrics": { 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_metrics", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "pgs,objects,bytes", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.851 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_step": { 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_step", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.5", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0.001", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "max": "0.999", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "aggressiveness of optimization", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "end_time": { 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_time", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2359", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ending time of day to automatically balance", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "end_weekday": { 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_weekday", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.852 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.853 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "min_score": { 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_score", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "upmap", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.854 INFO:teuthology.orchestra.run.trial028.stdout: "crush-compat", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "none", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "read", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "upmap", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "upmap-read" 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Balancer mode", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "pool_ids": { 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_ids", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.855 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "update_pg_upmap_activity": { 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_pg_upmap_activity", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_deviation": { 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_deviation", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_optimizations": { 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_optimizations", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.856 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "agent_down_multiplier": { 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_down_multiplier", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "agent_refresh_rate": { 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_refresh_rate", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "20", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "agent_starting_port": { 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_starting_port", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4721", 2026-02-20T03:41:02.857 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "allow_ptrace": { 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_ptrace", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_interval": { 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_interval", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to autotune daemon memory", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_memory_target_ratio": { 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_memory_target_ratio", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.7", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2026-02-20T03:41:02.858 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_log_destination": { 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm_log_destination", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "file", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "file,syslog", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "syslog" 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Destination for cephadm command's persistent logging", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "cgroups_split": { 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cgroups_split", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "config_checks_enabled": { 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_checks_enabled", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2026-02-20T03:41:02.859 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "config_dashboard": { 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_dashboard", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alertmanager": { 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alertmanager", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_base": { 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_base", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Container image name, without the tag", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.860 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_elasticsearch": { 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_elasticsearch", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "elasticsearch container image", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_grafana": { 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_grafana", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_haproxy": { 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_haproxy", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "HAproxy container image", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_agent": { 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_agent", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.861 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger agent container image", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_collector": { 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_collector", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger collector container image", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_query": { 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_query", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger query container image", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_keepalived": { 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_keepalived", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.862 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Keepalived container image", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_loki": { 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_loki", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/loki:3.0.0", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Loki container image", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_node_exporter": { 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_node_exporter", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nvmeof": { 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nvmeof", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nvme-of container image", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.863 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_prometheus": { 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_prometheus", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_promtail": { 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_promtail", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/promtail:3.0.0", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Promtail container image", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba": { 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba/SMB container image", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_snmp_gateway": { 2026-02-20T03:41:02.864 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_snmp_gateway", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/snmp-notifier:v1.2.1", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SNMP Gateway container image", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "container_init": { 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_init", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Run podman/docker with `--init`", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "daemon_cache_timeout": { 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "name": "daemon_cache_timeout", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "seconds to cache service (daemon) inventory", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "default_cephadm_command_timeout": { 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_cephadm_command_timeout", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.865 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "900", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "default_registry": { 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_registry", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "device_cache_timeout": { 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_cache_timeout", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "seconds to cache device inventory", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "device_enhanced_scan": { 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_enhanced_scan", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.866 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "facts_cache_timeout": { 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "name": "facts_cache_timeout", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "seconds to cache host facts data", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "grafana_dashboards_path": { 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "name": "grafana_dashboards_path", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "location of dashboards to include in grafana deployments", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "host_check_interval": { 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "name": "host_check_interval", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to perform a host check", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.867 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "hw_monitoring": { 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hw_monitoring", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "inventory_list_all": { 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "name": "inventory_list_all", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.868 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "log_refresh_metadata": { 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_refresh_metadata", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.869 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "*", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-20T03:41:02.870 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "max_count_per_host": { 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_count_per_host", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "max number of daemons per service per host", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "max_osd_draining_count": { 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_osd_draining_count", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "migration_current": { 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "name": "migration_current", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "internal - do not modify", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.871 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "root", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm-package", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "root" 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "mode for remote execution of cephadm", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "oob_default_addr": { 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "name": "oob_default_addr", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "169.254.1.1", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default address for RedFish API (oob management).", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_alerts_path": { 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_alerts_path", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "location of alerts to include in prometheus deployments", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.872 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "registry_insecure": { 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_insecure", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "registry_password": { 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_password", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "registry_url": { 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_url", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "registry_username": { 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_username", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.873 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "service_discovery_port": { 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "name": "service_discovery_port", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8765", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "cephadm service discovery port", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.874 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_config_file": { 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_config_file", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "customized SSH config file to connect to managed hosts", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_count_max": { 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_count_max", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_interval": { 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_interval", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often ssh connections are checked for liveness", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.875 INFO:teuthology.orchestra.run.trial028.stdout: "use_agent": { 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_agent", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "use_repo_digest": { 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_repo_digest", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_failed_host_check": { 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_failed_host_check", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise a health warning if the host check fails", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_daemons": { 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_daemons", 2026-02-20T03:41:02.876 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_hosts": { 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_hosts", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crash", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.877 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.878 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "retain_interval": { 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retain_interval", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "31536000", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "warn_recent_interval": { 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_recent_interval", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1209600", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.879 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dashboard", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_HOST": { 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-20T03:41:02.880 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_ENABLED": { 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_ENABLED", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "ENABLE_BROWSABLE_API": { 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.881 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.882 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-20T03:41:02.883 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_PASSWORD": { 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.884 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_URL": { 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_URL", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_USERNAME": { 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.885 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.886 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_HOST": { 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.887 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.888 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_ENABLED": { 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.889 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.890 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "45", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ACCESS_KEY": { 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SECRET_KEY": { 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.891 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SSL_VERIFY": { 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.892 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "cross_origin_url": { 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cross_origin_url", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "crt_file": { 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crt_file", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.893 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "debug": { 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "name": "debug", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable/disable debug options", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "jwt_token_ttl": { 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "name": "jwt_token_ttl", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "28800", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.894 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.895 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "motd": { 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "name": "motd", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The message of the day", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "redirect_resolve_ip_addr": { 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "name": "redirect_resolve_ip_addr", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.896 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8080", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.897 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "ssl_server_port": { 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl_server_port", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8443", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "redirect", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "redirect" 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T03:41:02.898 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "url_prefix": { 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url_prefix", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "enable_monitoring": { 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_monitoring", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "monitor device health metrics", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.899 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.900 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "mark_out_threshold": { 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mark_out_threshold", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2419200", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "pool_name": { 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_name", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "device_health_metrics", 2026-02-20T03:41:02.901 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "retention_period": { 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retention_period", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15552000", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain device health metrics", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_frequency": { 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_frequency", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "self_heal": { 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "name": "self_heal", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-20T03:41:02.902 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and check device health", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "warn_threshold": { 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_threshold", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7257600", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.903 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "name": "diskprediction_local", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.904 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "predict_interval": { 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predict_interval", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.905 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "predictor_model": { 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predictor_model", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "prophetstor", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.906 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "name": "influx", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": false, 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "influxdb python module not found", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "batch_size": { 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "name": "batch_size", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5000", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "database": { 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "name": "database", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "ceph", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": { 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hostname", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server hostname", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.907 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "min": "5", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.908 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "password": { 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "name": "password", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.909 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "password of InfluxDB server user", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "port": { 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "name": "port", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8086", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server port", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "false", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.910 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "threads": { 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threads", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "max": "32", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "username": { 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "name": "username", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "username of InfluxDB server user", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "verify_ssl": { 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "name": "verify_ssl", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "true", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.911 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "name": "insights", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.912 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.913 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "name": "iostat", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.914 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.915 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "name": "k8sevents", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_event_retention_days": { 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ceph_event_retention_days", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "config_check_secs": { 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_check_secs", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.916 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.917 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "name": "localpool", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "failure_domain": { 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "name": "failure_domain", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "host", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "failure domain for any created local pool", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.918 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.919 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "min_size": { 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_size", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default min_size for any created local pool", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "num_rep": { 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "name": "num_rep", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.920 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default replica count for any created local pool", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "pg_num": { 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_num", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "128", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default pg_num for any created local pool", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "prefix": { 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prefix", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name prefix for any created local pool", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.921 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "subtree": { 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "name": "subtree", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rack", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mds_autoscaler", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.922 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.923 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirroring", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.924 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.925 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "name": "nfs", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.926 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.927 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "fail_fs": { 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "name": "fail_fs", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.928 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.929 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator": { 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "rook", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "test_orchestrator" 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Orchestrator backend", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.930 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_perf_query", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.931 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.932 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_support", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.933 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.934 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_autoscaler", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.935 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.936 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "threshold": { 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threshold", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1.0", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "scaling threshold", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "name": "progress", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "allow_pg_recovery_event": { 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_pg_recovery_event", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.937 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.938 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "max_completed_events": { 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_completed_events", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "50", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.939 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "number of past completed events to remember", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long the module is going to sleep", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "cache": { 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cache", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.940 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "exclude_perf_counters": { 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "name": "exclude_perf_counters", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.941 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.942 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools": { 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "300", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_interval": { 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_interval", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15.0", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.943 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "9283", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "stale_cache_strategy": { 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stale_cache_strategy", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "log", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.944 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "default", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "default", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "error" 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.945 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.946 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_snap_create": { 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_snap_create", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "mirror_snapshot_schedule": { 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirror_snapshot_schedule", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.947 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "trash_purge_schedule": { 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "name": "trash_purge_schedule", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "name": "restful", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "enable_auth": { 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_auth", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.948 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.949 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "max_requests": { 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_requests", 2026-02-20T03:41:02.950 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.951 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rgw", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.952 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "secondary_zone_period_retry_limit": { 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.953 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rook", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.954 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.955 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "storage_class": { 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "name": "storage_class", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "local", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "name": "selftest", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.956 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.957 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "roption1": { 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption1", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "roption2": { 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption2", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "xyz", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.958 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption1": { 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption1", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption2": { 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption2", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption3": { 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption3", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption4": { 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption4", 2026-02-20T03:41:02.959 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption5": { 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption5", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption6": { 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption6", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption7": { 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption7", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.960 INFO:teuthology.orchestra.run.trial028.stdout: "max": "42", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "testkey": { 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testkey", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "testlkey": { 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testlkey", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.961 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "testnewline": { 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testnewline", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "allow_m_granularity": { 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_m_granularity", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow minute scheduled snapshots", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "dump_on_update": { 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dump_on_update", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.962 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "dump database to debug log on update", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.963 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.964 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stats", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.965 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "name": "status", 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.966 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.967 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telegraf", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.968 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "address": { 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "name": "address", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.969 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.970 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telemetry", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "channel_basic": { 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_basic", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "channel_crash": { 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_crash", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.971 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "channel_device": { 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_device", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "channel_ident": { 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_ident", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "channel_perf": { 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_perf", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.972 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "contact": { 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "name": "contact", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "description": { 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "name": "description", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "device_url": { 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_url", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.973 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "24", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "min": "8", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "last_opt_revision": { 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "name": "last_opt_revision", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard": { 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.974 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard_description": { 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard_description", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.975 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.976 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "organization": { 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "name": "organization", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "proxy": { 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "name": "proxy", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.977 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "url": { 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "name": "test_orchestrator", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.978 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.979 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.980 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_clones": { 2026-02-20T03:41:02.981 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_clones", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "periodic_async_work": { 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "name": "periodic_async_work", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Periodically check for async work", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_delay": { 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_delay", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_no_wait": { 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_no_wait", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.982 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "discovery_interval": { 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "name": "discovery_interval", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "100", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "identifier": { 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "name": "identifier", 2026-02-20T03:41:02.983 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.984 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.985 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "zabbix_host": { 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix_host", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "zabbix_port": { 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix_port", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10051", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "zabbix_sender": { 2026-02-20T03:41:02.986 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix_sender", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/usr/bin/zabbix_sender", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "modules": [ 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "dashboard", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "iostat", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "nfs", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "restful" 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "available_modules": [ 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "name": "alerts", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How frequently to reexamine health status", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.987 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.988 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_destination": { 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_destination", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email address to send alerts to", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_from_name": { 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_from_name", 2026-02-20T03:41:02.989 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "Ceph", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Email From: name", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_host": { 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_host", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP server", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_password": { 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_password", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Password to authenticate with", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_port": { 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_port", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.990 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "465", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP port", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_sender": { 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_sender", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SMTP envelope sender", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_ssl": { 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_ssl", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use SSL to connect to SMTP server", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "smtp_user": { 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "name": "smtp_user", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.991 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "User to authenticate as", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "name": "balancer", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "active": { 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "name": "active", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically balance PGs across cluster", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "begin_time": { 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_time", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.992 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0000", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "beginning time of day to automatically balance", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "begin_weekday": { 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "name": "begin_weekday", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_max_iterations": { 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_max_iterations", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "25", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "max": "250", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum number of iterations to attempt optimization", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_metrics": { 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_metrics", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "pgs,objects,bytes", 2026-02-20T03:41:02.993 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "metrics with which to calculate OSD utilization", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "crush_compat_step": { 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crush_compat_step", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.5", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0.001", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "max": "0.999", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "aggressiveness of optimization", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "end_time": { 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_time", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2359", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ending time of day to automatically balance", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "This is a time of day in the format HHMM.", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "end_weekday": { 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "name": "end_weekday", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "min": "0", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "max": "6", 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.994 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.995 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "min_score": { 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_score", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "minimum score, below which no optimization is attempted", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T03:41:02.996 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "upmap", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "crush-compat", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "none", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "read", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "upmap", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "upmap-read" 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Balancer mode", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "pool_ids": { 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_ids", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "pools which the automatic balancing will be limited to", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and attempt optimization", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.997 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "update_pg_upmap_activity": { 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "name": "update_pg_upmap_activity", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Updates pg_upmap activity stats to be used in `balancer status detail`", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_deviation": { 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_deviation", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "deviation below which no optimization is attempted", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.998 INFO:teuthology.orchestra.run.trial028.stdout: "upmap_max_optimizations": { 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "name": "upmap_max_optimizations", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "maximum upmap optimizations to make per attempt", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "agent_down_multiplier": { 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_down_multiplier", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "agent_refresh_rate": { 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_refresh_rate", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "20", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2026-02-20T03:41:02.999 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "agent_starting_port": { 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "name": "agent_starting_port", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4721", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "allow_ptrace": { 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_ptrace", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_interval": { 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_interval", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to autotune daemon memory", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.000 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "autotune_memory_target_ratio": { 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "name": "autotune_memory_target_ratio", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0.7", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_log_destination": { 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cephadm_log_destination", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "file", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "file,syslog", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "syslog" 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Destination for cephadm command's persistent logging", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "cgroups_split": { 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cgroups_split", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.001 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "config_checks_enabled": { 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_checks_enabled", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "config_dashboard": { 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_dashboard", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_alertmanager": { 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_alertmanager", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.002 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_base": { 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_base", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/ceph", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Container image name, without the tag", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_elasticsearch": { 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_elasticsearch", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "elasticsearch container image", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_grafana": { 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_grafana", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_haproxy": { 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_haproxy", 2026-02-20T03:41:03.003 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "HAproxy container image", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_agent": { 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_agent", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger agent container image", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_collector": { 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_collector", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger collector container image", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_jaeger_query": { 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_jaeger_query", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.004 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Jaeger query container image", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_keepalived": { 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_keepalived", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Keepalived container image", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_loki": { 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_loki", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/loki:3.0.0", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Loki container image", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_node_exporter": { 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_node_exporter", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.005 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_nvmeof": { 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_nvmeof", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Nvme-of container image", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_prometheus": { 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_prometheus", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Prometheus container image", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_promtail": { 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_promtail", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/promtail:3.0.0", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Promtail container image", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.006 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_samba": { 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_samba", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Samba/SMB container image", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "container_image_snmp_gateway": { 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_image_snmp_gateway", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io/ceph/snmp-notifier:v1.2.1", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "SNMP Gateway container image", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "container_init": { 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "name": "container_init", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Run podman/docker with `--init`", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.007 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "daemon_cache_timeout": { 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "name": "daemon_cache_timeout", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "seconds to cache service (daemon) inventory", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "default_cephadm_command_timeout": { 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_cephadm_command_timeout", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "900", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "default_registry": { 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "name": "default_registry", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "quay.io", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "device_cache_timeout": { 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_cache_timeout", 2026-02-20T03:41:03.008 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1800", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "seconds to cache device inventory", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "device_enhanced_scan": { 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_enhanced_scan", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use libstoragemgmt during device scans", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "facts_cache_timeout": { 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "name": "facts_cache_timeout", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "seconds to cache host facts data", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "grafana_dashboards_path": { 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "name": "grafana_dashboards_path", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2026-02-20T03:41:03.009 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "location of dashboards to include in grafana deployments", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "host_check_interval": { 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "name": "host_check_interval", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to perform a host check", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "hw_monitoring": { 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hw_monitoring", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "inventory_list_all": { 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "name": "inventory_list_all", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.010 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "log_refresh_metadata": { 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_refresh_metadata", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.011 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.012 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf": { 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "*", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "max_count_per_host": { 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_count_per_host", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "max number of daemons per service per host", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "max_osd_draining_count": { 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_osd_draining_count", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.013 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "migration_current": { 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "name": "migration_current", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "internal - do not modify", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "mode": { 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mode", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "root", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm-package", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "root" 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "mode for remote execution of cephadm", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "oob_default_addr": { 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "name": "oob_default_addr", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.014 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "169.254.1.1", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Default address for RedFish API (oob management).", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "prometheus_alerts_path": { 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus_alerts_path", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "location of alerts to include in prometheus deployments", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "registry_insecure": { 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_insecure", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "registry_password": { 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_password", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.015 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "registry_url": { 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_url", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "registry_username": { 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "name": "registry_username", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "secure_monitoring_stack": { 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secure_monitoring_stack", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.016 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "service_discovery_port": { 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "name": "service_discovery_port", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8765", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "cephadm service discovery port", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_config_file": { 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_config_file", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "customized SSH config file to connect to managed hosts", 2026-02-20T03:41:03.017 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_count_max": { 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_count_max", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "ssh_keepalive_interval": { 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssh_keepalive_interval", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How often ssh connections are checked for liveness", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "use_agent": { 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_agent", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.018 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "use_repo_digest": { 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "name": "use_repo_digest", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_failed_host_check": { 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_failed_host_check", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise a health warning if the host check fails", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_daemons": { 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_daemons", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "warn_on_stray_hosts": { 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_on_stray_hosts", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.019 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crash", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.020 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "retain_interval": { 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retain_interval", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.021 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "31536000", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain crashes before pruning them", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "warn_recent_interval": { 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_recent_interval", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1209600", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "time interval in which to warn about recent crashes", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dashboard", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.022 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_HOST": { 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_HOST", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_ENABLED": { 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_ENABLED", 2026-02-20T03:41:03.023 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "AUDIT_API_LOG_PAYLOAD": { 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "ENABLE_BROWSABLE_API": { 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ENABLE_BROWSABLE_API", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_CEPHFS": { 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.024 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_ISCSI": { 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_MIRRORING": { 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.025 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_NFS": { 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_NFS", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RBD": { 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RBD", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "FEATURE_TOGGLE_RGW": { 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "name": "FEATURE_TOGGLE_RGW", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.026 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_PASSWORD": { 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_PASSWORD", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_SSL_VERIFY": { 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_URL": { 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_URL", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.027 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_API_USERNAME": { 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_API_USERNAME", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_FRONTEND_API_URL": { 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.028 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "ISCSI_API_SSL_VERIFICATION": { 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "ISSUE_TRACKER_API_KEY": { 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ISSUE_TRACKER_API_KEY", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_HOST": { 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_HOST", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.029 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2026-02-20T03:41:03.030 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.031 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_ENABLED": { 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_ENABLED", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.032 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "PWD_POLICY_MIN_LENGTH": { 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "REST_REQUESTS_TIMEOUT": { 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "name": "REST_REQUESTS_TIMEOUT", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "45", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.033 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ACCESS_KEY": { 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ACCESS_KEY", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_ADMIN_RESOURCE": { 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "admin", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SECRET_KEY": { 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SECRET_KEY", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "RGW_API_SSL_VERIFY": { 2026-02-20T03:41:03.034 INFO:teuthology.orchestra.run.trial028.stdout: "name": "RGW_API_SSL_VERIFY", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_SPAN": { 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.035 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "cross_origin_url": { 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cross_origin_url", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "crt_file": { 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "name": "crt_file", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "debug": { 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "name": "debug", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.036 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Enable/disable debug options", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "jwt_token_ttl": { 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "name": "jwt_token_ttl", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "28800", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.037 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.038 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "motd": { 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "name": "motd", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "The message of the day", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "redirect_resolve_ip_addr": { 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "name": "redirect_resolve_ip_addr", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T03:41:03.039 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8080", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.040 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "ssl_server_port": { 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl_server_port", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8443", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "redirect", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "redirect" 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.041 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "url_prefix": { 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url_prefix", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "enable_monitoring": { 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_monitoring", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "monitor device health metrics", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.042 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.043 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "mark_out_threshold": { 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mark_out_threshold", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "2419200", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "automatically mark OSD if it may fail before this long", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "pool_name": { 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pool_name", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "device_health_metrics", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name of pool in which to store device health metrics", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "retention_period": { 2026-02-20T03:41:03.044 INFO:teuthology.orchestra.run.trial028.stdout: "name": "retention_period", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15552000", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long to retain device health metrics", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_frequency": { 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_frequency", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to scrape device health metrics", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "self_heal": { 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "name": "self_heal", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "preemptively heal cluster around devices that may fail", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.045 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how frequently to wake up and check device health", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "warn_threshold": { 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "name": "warn_threshold", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7257600", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "raise health warning if OSD may fail before this long", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "name": "diskprediction_local", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.046 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.047 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "predict_interval": { 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predict_interval", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "86400", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "predictor_model": { 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "name": "predictor_model", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "prophetstor", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.048 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "600", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "name": "influx", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": false, 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "influxdb python module not found", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "batch_size": { 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "name": "batch_size", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.049 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5000", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "database": { 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "name": "database", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "ceph", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "hostname": { 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "name": "hostname", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server hostname", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "30", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "min": "5", 2026-02-20T03:41:03.050 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.051 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "password": { 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "name": "password", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "password of InfluxDB server user", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.052 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "port": { 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "name": "port", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "8086", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "InfluxDB server port", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "ssl": { 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ssl", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "false", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "threads": { 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threads", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.053 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "max": "32", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "username": { 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "name": "username", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "username of InfluxDB server user", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "verify_ssl": { 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "name": "verify_ssl", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "true", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "name": "insights", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.054 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.055 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "name": "iostat", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.056 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.057 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "name": "k8sevents", 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.058 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_event_retention_days": { 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "name": "ceph_event_retention_days", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "7", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Days to hold ceph event information within local cache", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "config_check_secs": { 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "name": "config_check_secs", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "min": "10", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.059 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.060 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "name": "localpool", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "failure_domain": { 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "name": "failure_domain", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "host", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "failure domain for any created local pool", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.061 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.062 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "min_size": { 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "name": "min_size", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default min_size for any created local pool", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "num_rep": { 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "name": "num_rep", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.063 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default replica count for any created local pool", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "pg_num": { 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_num", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "128", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "default pg_num for any created local pool", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "prefix": { 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prefix", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "name prefix for any created local pool", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.064 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "subtree": { 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "name": "subtree", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "rack", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "CRUSH level for which to create a local pool", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mds_autoscaler", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.065 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.066 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirroring", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.067 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.068 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "name": "nfs", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.069 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.070 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "fail_fs": { 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "name": "fail_fs", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.071 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.072 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator": { 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "name": "orchestrator", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "rook", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "test_orchestrator" 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Orchestrator backend", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.073 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_perf_query", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.074 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.075 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "name": "osd_support", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.076 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.077 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "name": "pg_autoscaler", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.078 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.079 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "threshold": { 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "name": "threshold", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "3.0", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1.0", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "scaling threshold", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "name": "progress", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "allow_pg_recovery_event": { 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_pg_recovery_event", 2026-02-20T03:41:03.080 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow the module to show pg recovery progress", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.081 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.082 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "max_completed_events": { 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_completed_events", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "50", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "number of past completed events to remember", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "sleep_interval": { 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sleep_interval", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "how long the module is going to sleep", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.083 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "name": "prometheus", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "cache": { 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "name": "cache", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "exclude_perf_counters": { 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "name": "exclude_perf_counters", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Do not include perf-counters in the metrics output", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.084 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.085 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools": { 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_stats_pools_refresh_interval": { 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_stats_pools_refresh_interval", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "300", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "scrape_interval": { 2026-02-20T03:41:03.086 INFO:teuthology.orchestra.run.trial028.stdout: "name": "scrape_interval", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15.0", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "::", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "9283", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "the port on which the module listens for HTTP requests", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.087 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "stale_cache_strategy": { 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stale_cache_strategy", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "log", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "standby_behaviour": { 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_behaviour", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "default", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "default", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "error" 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "standby_error_status_code": { 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "name": "standby_error_status_code", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.088 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "min": "400", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "max": "599", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.089 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_snap_create": { 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_snap_create", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.090 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "mirror_snapshot_schedule": { 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mirror_snapshot_schedule", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "trash_purge_schedule": { 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "name": "trash_purge_schedule", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.091 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "name": "restful", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "enable_auth": { 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enable_auth", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "key_file": { 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "name": "key_file", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.092 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.093 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "max_requests": { 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_requests", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "500", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "server_addr": { 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_addr", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.094 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "server_port": { 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "name": "server_port", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rgw", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.095 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.096 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "secondary_zone_period_retry_limit": { 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "name": "secondary_zone_period_retry_limit", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "5", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "RGW module period update retry limit for secondary site", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.097 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rook", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.098 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.099 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "storage_class": { 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "name": "storage_class", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "local", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "storage class name for LSO-discovered PVs", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "name": "selftest", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.100 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.101 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "roption1": { 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption1", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "roption2": { 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "name": "roption2", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "xyz", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption1": { 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption1", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.102 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption2": { 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption2", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption3": { 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption3", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "type": "float", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption4": { 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption4", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption5": { 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption5", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.103 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption6": { 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption6", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "rwoption7": { 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rwoption7", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "min": "1", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "max": "42", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.104 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "testkey": { 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testkey", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "testlkey": { 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testlkey", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "testnewline": { 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "name": "testnewline", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.105 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snap_schedule", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "allow_m_granularity": { 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "name": "allow_m_granularity", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "allow minute scheduled snapshots", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "dump_on_update": { 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "name": "dump_on_update", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "dump database to debug log on update", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.106 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.107 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "name": "stats", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.108 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.109 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "name": "status", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.110 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.111 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telegraf", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "address": { 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "name": "address", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.112 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "15", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.113 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.114 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "name": "telemetry", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "channel_basic": { 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_basic", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share basic cluster information (size, version)", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "channel_crash": { 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_crash", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "channel_device": { 2026-02-20T03:41:03.115 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_device", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "channel_ident": { 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_ident", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "channel_perf": { 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "name": "channel_perf", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Share various performance metrics of a cluster", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "contact": { 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "name": "contact", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.116 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "description": { 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "name": "description", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "device_url": { 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "name": "device_url", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/device", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "enabled": { 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "name": "enabled", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.117 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "24", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "min": "8", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "last_opt_revision": { 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "name": "last_opt_revision", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "1", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard": { 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "leaderboard_description": { 2026-02-20T03:41:03.118 INFO:teuthology.orchestra.run.trial028.stdout: "name": "leaderboard_description", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.119 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "organization": { 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "name": "organization", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.120 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "proxy": { 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "name": "proxy", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "url": { 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "name": "url", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "https://telemetry.ceph.com/report", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.121 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "name": "test_orchestrator", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.122 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.123 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.124 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "max_concurrent_clones": { 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "name": "max_concurrent_clones", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "4", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Number of asynchronous cloner threads", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.125 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "periodic_async_work": { 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "name": "periodic_async_work", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Periodically check for async work", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_delay": { 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_delay", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "snapshot_clone_no_wait": { 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "name": "snapshot_clone_no_wait", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "True", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.126 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "can_run": true, 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "error_string": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "module_options": { 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "discovery_interval": { 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "name": "discovery_interval", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "type": "uint", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "100", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "identifier": { 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "name": "identifier", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.127 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "interval": { 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "name": "interval", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "type": "secs", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "60", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "log_level": { 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_level", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster": { 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.128 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_cluster_level": { 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_cluster_level", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "info", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [ 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "critical", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "debug", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "error", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "info", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "warning" 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": { 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "name": "log_to_file", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "type": "bool", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "False", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "sqlite3_killpoint": { 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "name": "sqlite3_killpoint", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "level": "dev", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 1, 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "0", 2026-02-20T03:41:03.129 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "zabbix_host": { 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix_host", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "zabbix_port": { 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix_port", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "type": "int", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "10051", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "zabbix_sender": { 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "name": "zabbix_sender", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "type": "str", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "level": "advanced", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "flags": 0, 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "default_value": "/usr/bin/zabbix_sender", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "min": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "max": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "enum_allowed": [], 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "desc": "", 2026-02-20T03:41:03.130 INFO:teuthology.orchestra.run.trial028.stdout: "long_desc": "", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "tags": [], 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "see_also": [] 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "services": { 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "dashboard": "https://10.20.193.28:8443/" 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "always_on_modules": { 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "octopus": [ 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "pacific": [ 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "quincy": [ 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T03:41:03.131 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "reef": [ 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: ], 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "squid": [ 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "balancer", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "crash", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "devicehealth", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "orchestrator", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "pg_autoscaler", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "progress", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_support", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "status", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "telemetry", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "volumes" 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "force_disabled_modules": {}, 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "last_failure_osd_epoch": 3, 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "active_clients": [ 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "name": "devicehealth", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 3634579217 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "name": "libcephsqlite", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T03:41:03.132 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 4207797157 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "name": "rbd_support", 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 4249222346 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "name": "volumes", 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "addrvec": [ 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: { 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "type": "v2", 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "addr": "10.20.193.28:0", 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: "nonce": 3288790577 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout: ] 2026-02-20T03:41:03.133 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:41:03.133 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:02 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/15507162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.134 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:02 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2129131956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.134 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:02 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3160443871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.134 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:02 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/970317791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.134 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:02 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/15507162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.134 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:02 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2129131956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.134 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:02 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3160443871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.134 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:02 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/970317791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.654+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2940b0e20 msgr2=0x7ff2940b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.654+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2940b0e20 0x7ff2940b32e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff2b81a24f0 tx=0x7ff2ac03a040 comp rx=0 tx=0).stop 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.654+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109490 msgr2=0x7ff2b81a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.654+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109490 0x7ff2b81a0fe0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800d980 tx=0x7ff2a800de50 comp rx=0 tx=0).stop 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.655+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 shutdown_connections 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.655+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7ff2940b0e20 0x7ff2940b32e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.655+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7ff2b810a930 0x7ff2b81a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.655+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7ff2b8109e60 0x7ff2b81a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.655+0000 7ff2c051b640 1 --2- 10.20.193.28:0/1427611422 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7ff2b8109490 0x7ff2b81a0fe0 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.655+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 >> 10.20.193.28:0/1427611422 conn(0x7ff2b8078080 msgr2=0x7ff2b810d600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.655+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 shutdown_connections 2026-02-20T03:41:03.134 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:02.655+0000 7ff2c051b640 1 -- 10.20.193.28:0/1427611422 wait complete. 2026-02-20T03:41:03.138 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:41:03.139 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:02 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/15507162' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.139 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:02 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2129131956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.139 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:02 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3160443871' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.139 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:02 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/970317791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2026-02-20T03:41:03.403 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:03.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.581+0000 7f948f6b6640 1 -- 10.20.193.28:0/3339729063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488109ed0 msgr2=0x7f9488111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.581+0000 7f948f6b6640 1 --2- 10.20.193.28:0/3339729063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488109ed0 0x7f9488111a50 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f948400b0a0 tx=0x7f948402f410 comp rx=0 tx=0).stop 2026-02-20T03:41:03.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.581+0000 7f948f6b6640 1 -- 10.20.193.28:0/3339729063 shutdown_connections 2026-02-20T03:41:03.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.581+0000 7f948f6b6640 1 --2- 10.20.193.28:0/3339729063 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488109ed0 0x7f9488111a50 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.581+0000 7f948f6b6640 1 --2- 10.20.193.28:0/3339729063 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9488105750 0x7f94881097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.581+0000 7f948f6b6640 1 --2- 10.20.193.28:0/3339729063 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9488104da0 0x7f9488105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.581+0000 7f948f6b6640 1 -- 10.20.193.28:0/3339729063 >> 10.20.193.28:0/3339729063 conn(0x7f9488100840 msgr2=0x7f9488102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:03.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.581+0000 7f948f6b6640 1 -- 10.20.193.28:0/3339729063 shutdown_connections 2026-02-20T03:41:03.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.581+0000 7f948f6b6640 1 -- 10.20.193.28:0/3339729063 wait complete. 2026-02-20T03:41:03.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.582+0000 7f948f6b6640 1 Processor -- start 2026-02-20T03:41:03.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.582+0000 7f948f6b6640 1 -- start start 2026-02-20T03:41:03.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.582+0000 7f948f6b6640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488104da0 0x7f948819d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.582+0000 7f948f6b6640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9488105750 0x7f948819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.582+0000 7f948f6b6640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9488109ed0 0x7f94881a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.582+0000 7f948f6b6640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9488114da0 con 0x7f9488104da0 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.582+0000 7f948f6b6640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9488114c20 con 0x7f9488109ed0 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.582+0000 7f948f6b6640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9488114f20 con 0x7f9488105750 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948d42b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488104da0 0x7f948819d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948cc2a640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9488105750 0x7f948819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948d42b640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488104da0 0x7f948819d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52190/0 (socket says 10.20.193.28:52190) 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948d42b640 1 -- 10.20.193.28:0/2842261426 learned_addr learned my addr 10.20.193.28:0/2842261426 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948dc2c640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9488109ed0 0x7f94881a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948d42b640 1 -- 10.20.193.28:0/2842261426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9488105750 msgr2=0x7f948819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948d42b640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9488105750 0x7f948819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948d42b640 1 -- 10.20.193.28:0/2842261426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9488109ed0 msgr2=0x7f94881a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948d42b640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9488109ed0 0x7f94881a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948d42b640 1 -- 10.20.193.28:0/2842261426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94881a21b0 con 0x7f9488104da0 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948cc2a640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9488105750 0x7f948819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948d42b640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488104da0 0x7f948819d160 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f947800ea30 tx=0x7f947800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f94767fc640 1 -- 10.20.193.28:0/2842261426 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947800ce50 con 0x7f9488104da0 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f94767fc640 1 -- 10.20.193.28:0/2842261426 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9478004570 con 0x7f9488104da0 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f94767fc640 1 -- 10.20.193.28:0/2842261426 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478010690 con 0x7f9488104da0 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94881a24a0 con 0x7f9488104da0 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.583+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94881a9ce0 con 0x7f9488104da0 2026-02-20T03:41:03.589 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.584+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9488105180 con 0x7f9488104da0 2026-02-20T03:41:03.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.586+0000 7f94767fc640 1 -- 10.20.193.28:0/2842261426 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9478020060 con 0x7f9488104da0 2026-02-20T03:41:03.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.587+0000 7f94767fc640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94640b0e20 0x7f94640b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.588+0000 7f94767fc640 1 -- 10.20.193.28:0/2842261426 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f94780e1180 con 0x7f9488104da0 2026-02-20T03:41:03.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.588+0000 7f948cc2a640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94640b0e20 0x7f94640b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.588+0000 7f94767fc640 1 -- 10.20.193.28:0/2842261426 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f94780e1600 con 0x7f9488104da0 2026-02-20T03:41:03.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.588+0000 7f948cc2a640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94640b0e20 0x7f94640b32e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f948810b8a0 tx=0x7f947c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:03.698 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.695+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f948810cb20 con 0x7f9488104da0 2026-02-20T03:41:03.699 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.696+0000 7f94767fc640 1 -- 10.20.193.28:0/2842261426 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+11927 (secure 0 0 0) 0x7f9478016320 con 0x7f9488104da0 2026-02-20T03:41:03.699 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:41:03.699 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":60,"btime":"2026-02-20T03:40:59:436190+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":60,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:40:59.183075+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:41:03.700 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 60 2026-02-20T03:41:03.700 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:03 trial028 ceph-mon[38552]: pgmap v977: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 286 KiB/s rd, 304 KiB/s wr, 162 op/s 2026-02-20T03:41:03.700 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:03 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/1427611422' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2026-02-20T03:41:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94640b0e20 msgr2=0x7f94640b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94640b0e20 0x7f94640b32e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f948810b8a0 tx=0x7f947c009290 comp rx=0 tx=0).stop 2026-02-20T03:41:03.701 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488104da0 msgr2=0x7f948819d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488104da0 0x7f948819d160 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7f947800ea30 tx=0x7f947800ef00 comp rx=0 tx=0).stop 2026-02-20T03:41:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 shutdown_connections 2026-02-20T03:41:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f94640b0e20 0x7f94640b32e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9488109ed0 0x7f94881a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9488105750 0x7f948819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 --2- 10.20.193.28:0/2842261426 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9488104da0 0x7f948819d160 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.697+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 >> 10.20.193.28:0/2842261426 conn(0x7f9488100840 msgr2=0x7f9488101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.698+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 shutdown_connections 2026-02-20T03:41:03.702 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.698+0000 7f948f6b6640 1 -- 10.20.193.28:0/2842261426 wait complete. 2026-02-20T03:41:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:03 trial177 ceph-mon[43181]: pgmap v977: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 286 KiB/s rd, 304 KiB/s wr, 162 op/s 2026-02-20T03:41:03.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:03 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/1427611422' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2026-02-20T03:41:03.839 DEBUG:tasks.check_counter:Getting stats from a 2026-02-20T03:41:03.839 DEBUG:tasks.check_counter:skipping mds.14511 2026-02-20T03:41:03.839 DEBUG:tasks.check_counter:Getting stats from d 2026-02-20T03:41:03.840 DEBUG:tasks.check_counter:skipping mds.14472 2026-02-20T03:41:03.840 DEBUG:tasks.check_counter:Getting stats from g 2026-02-20T03:41:03.840 DEBUG:tasks.check_counter:skipping mds.14499 2026-02-20T03:41:03.840 DEBUG:tasks.check_counter:Getting stats from j 2026-02-20T03:41:03.840 DEBUG:tasks.check_counter:skipping mds.24496 2026-02-20T03:41:03.840 DEBUG:tasks.check_counter:Getting stats from b 2026-02-20T03:41:03.840 DEBUG:tasks.check_counter:Getting stats from mds.24560 2026-02-20T03:41:03.840 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24560 perf dump --format=json-pretty 2026-02-20T03:41:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:03 trial126 ceph-mon[38476]: pgmap v977: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 286 KiB/s rd, 304 KiB/s wr, 162 op/s 2026-02-20T03:41:03.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:03 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/1427611422' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2026-02-20T03:41:03.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.962+0000 7f3e97fff640 1 -- 10.20.193.28:0/2681088670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e9810a540 msgr2=0x7f3e9810a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.962+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2681088670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e9810a540 0x7f3e9810a940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009a30 tx=0x7f3e8c02f220 comp rx=0 tx=0).stop 2026-02-20T03:41:03.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.962+0000 7f3e97fff640 1 -- 10.20.193.28:0/2681088670 shutdown_connections 2026-02-20T03:41:03.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.962+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2681088670 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e98109be0 0x7f3e98111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.965 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.962+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2681088670 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e98109220 0x7f3e981096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.962+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2681088670 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e9810a540 0x7f3e9810a940 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.962+0000 7f3e97fff640 1 -- 10.20.193.28:0/2681088670 >> 10.20.193.28:0/2681088670 conn(0x7f3e98078080 msgr2=0x7f3e9807a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:03.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.962+0000 7f3e97fff640 1 -- 10.20.193.28:0/2681088670 shutdown_connections 2026-02-20T03:41:03.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.962+0000 7f3e97fff640 1 -- 10.20.193.28:0/2681088670 wait complete. 2026-02-20T03:41:03.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e97fff640 1 Processor -- start 2026-02-20T03:41:03.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e97fff640 1 -- start start 2026-02-20T03:41:03.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98109220 0x7f3e981a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e98109be0 0x7f3e981a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.968 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e97fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9810a540 0x7f3e981a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e97fff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e981149a0 con 0x7f3e98109be0 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e97fff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e98114820 con 0x7f3e9810a540 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e97fff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e98114b20 con 0x7f3e98109220 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e967fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e98109be0 0x7f3e981a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e96ffd640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98109220 0x7f3e981a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e967fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e98109be0 0x7f3e981a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52204/0 (socket says 10.20.193.28:52204) 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e967fc640 1 -- 10.20.193.28:0/2757284274 learned_addr learned my addr 10.20.193.28:0/2757284274 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.963+0000 7f3e977fe640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9810a540 0x7f3e981a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e967fc640 1 -- 10.20.193.28:0/2757284274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98109220 msgr2=0x7f3e981a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e967fc640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98109220 0x7f3e981a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e967fc640 1 -- 10.20.193.28:0/2757284274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9810a540 msgr2=0x7f3e981a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e967fc640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9810a540 0x7f3e981a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e967fc640 1 -- 10.20.193.28:0/2757284274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e981a8ca0 con 0x7f3e98109be0 2026-02-20T03:41:03.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e967fc640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e98109be0 0x7f3e981a1530 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000d950 tx=0x7f3e8000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:03.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e9c88d640 1 -- 10.20.193.28:0/2757284274 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80014070 con 0x7f3e98109be0 2026-02-20T03:41:03.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e9c88d640 1 -- 10.20.193.28:0/2757284274 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e800044e0 con 0x7f3e98109be0 2026-02-20T03:41:03.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e9c88d640 1 -- 10.20.193.28:0/2757284274 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e80010460 con 0x7f3e98109be0 2026-02-20T03:41:03.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e97fff640 1 -- 10.20.193.28:0/2757284274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e981a8f90 con 0x7f3e98109be0 2026-02-20T03:41:03.970 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.964+0000 7f3e97fff640 1 -- 10.20.193.28:0/2757284274 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e981a9400 con 0x7f3e98109be0 2026-02-20T03:41:03.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3ea07cde00 1 Processor -- start 2026-02-20T03:41:03.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3e9c88d640 1 -- 10.20.193.28:0/2757284274 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3e8000b840 con 0x7f3e98109be0 2026-02-20T03:41:03.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3ea07cde00 1 -- start start 2026-02-20T03:41:03.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42d81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f42dac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5568f4224bc0 con 0x5568f42d2c60 2026-02-20T03:41:03.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5568f41d1fc0 con 0x5568f42d35a0 2026-02-20T03:41:03.973 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5568f4220af0 con 0x5568f42d8780 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3e977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3e96ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42d81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3e977fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52206/0 (socket says 10.20.193.28:52206) 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.967+0000 7f3e96ffd640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42d81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47766/0 (socket says 10.20.193.28:47766) 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e977fe640 1 -- 10.20.193.28:0/4224885611 learned_addr learned my addr 10.20.193.28:0/4224885611 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e967fc640 1 --2- 10.20.193.28:0/4224885611 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f42dac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e96ffd640 1 -- 10.20.193.28:0/4224885611 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 msgr2=0x5568f42dac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/4224885611 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f42dac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e96ffd640 1 -- 10.20.193.28:0/4224885611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 msgr2=0x5568f42d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/4224885611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42d3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e96ffd640 1 -- 10.20.193.28:0/4224885611 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f41a83e0 con 0x5568f42d35a0 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e977fe640 1 --2- 10.20.193.28:0/4224885611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42d3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/4224885611 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42d81b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c02f730 tx=0x7f3e8c0057d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=494a4356afee0c47 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e637fe640 1 -- 10.20.193.28:0/4224885611 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c047070 con 0x5568f42d35a0 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e637fe640 1 -- 10.20.193.28:0/4224885611 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e8c033040 con 0x5568f42d35a0 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.968+0000 7f3e637fe640 1 -- 10.20.193.28:0/4224885611 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c004420 con 0x5568f42d35a0 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3ea07cde00 1 -- 10.20.193.28:0/4224885611 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 msgr2=0x5568f42d81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/4224885611 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42d81b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c02f730 tx=0x7f3e8c0057d0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3ea07cde00 1 -- 10.20.193.28:0/4224885611 shutdown_connections 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/4224885611 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f42dac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/4224885611 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42d81b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/4224885611 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42d3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.975 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3ea07cde00 1 -- 10.20.193.28:0/4224885611 >> 10.20.193.28:0/4224885611 conn(0x5568f42ca0d0 msgr2=0x5568f42d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:03.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3e9c88d640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0da0 0x7f3e6c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3e9c88d640 1 -- 10.20.193.28:0/2757284274 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3e800e0c70 con 0x7f3e98109be0 2026-02-20T03:41:03.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3ea07cde00 1 -- 10.20.193.28:0/4224885611 shutdown_connections 2026-02-20T03:41:03.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0da0 0x7f3e6c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0da0 0x7f3e6c0b3260 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c02f260 tx=0x7f3e8c03a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:03.976 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.969+0000 7f3ea07cde00 1 -- 10.20.193.28:0/4224885611 wait complete. 2026-02-20T03:41:03.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3ea07cde00 1 -- start start 2026-02-20T03:41:03.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3ea07cde00 1 Processor -- start 2026-02-20T03:41:03.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.980 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f4304c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5568f41cbbb0 con 0x5568f42d2c60 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5568f42ecb90 con 0x5568f42d35a0 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5568f4305210 con 0x5568f42d8780 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3e967fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3e977fe640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f4304c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3e967fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42fdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47782/0 (socket says 10.20.193.28:47782) 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3e967fc640 1 -- 10.20.193.28:0/2297805036 learned_addr learned my addr 10.20.193.28:0/2297805036 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.971+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e967fc640 1 -- 10.20.193.28:0/2297805036 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 msgr2=0x5568f4304c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e967fc640 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f4304c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.981 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e967fc640 1 -- 10.20.193.28:0/2297805036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 msgr2=0x5568f42fd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e967fc640 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e967fc640 1 -- 10.20.193.28:0/2297805036 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f42f66b0 con 0x5568f42d35a0 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e967fc640 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42fdd00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3e800a8700 tx=0x7f3e8000bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7afecf9671e3cb69 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e60ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e60ff9640 1 -- 10.20.193.28:0/2297805036 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8001e070 con 0x5568f42d35a0 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e60ff9640 1 -- 10.20.193.28:0/2297805036 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e800cb0f0 con 0x5568f42d35a0 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e60ff9640 1 -- 10.20.193.28:0/2297805036 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e800af0b0 con 0x5568f42d35a0 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2297805036 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f41c4040 con 0x5568f42d35a0 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e60ff9640 1 -- 10.20.193.28:0/2297805036 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3e800b1720 con 0x5568f42d35a0 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3e60ff9640 10 client.29081 inactive, discarding osd_map(99..99 src has 1..99) 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3ea07cde00 10 client.29081 _ll_register_callbacks cb 0x5568f41cfae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:03.982 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.972+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2297805036 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5568f422c7b0 con 0x5568f42d35a0 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3e60ff9640 1 -- 10.20.193.28:0/2297805036 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f3e800a7f20 con 0x5568f42d35a0 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3ea07cde00 10 client.29081 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2297805036 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=60}) -- 0x5568f41ca660 con 0x5568f42d35a0 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3e60ff9640 1 -- 10.20.193.28:0/2297805036 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7f3e800ea040 con 0x5568f42d35a0 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3ea07cde00 10 client.29081 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3ea07cde00 10 client.29081 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3ea07cde00 20 client.29081 populate_metadata read hostname 'trial028' 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5568f43091a0 0x5568f430b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3ea07cde00 4 client.29081 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2297805036 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568f41a6520 con 0x5568f43091a0 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.973+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5568f43091a0 0x5568f430b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.983 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.974+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5568f43091a0 0x5568f430b640 crc :-1 s=READY pgs=643 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917d259b186d9095 server_cookie=aaaa5c8402990668 in_seq=0 out_seq=0 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.974+0000 7f3e60ff9640 10 client.29081 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.974+0000 7f3e60ff9640 1 -- 10.20.193.28:0/2297805036 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5568f41a6520 con 0x5568f43091a0 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.974+0000 7f3e60ff9640 10 client.29081 handle_command_reply: tid=0 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.974+0000 7f3ea07cde00 1 client.29081 shutdown 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.974+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2297805036 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 msgr2=0x5568f42fdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.974+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42fdd00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3e800a8700 tx=0x7f3e8000bf50 comp rx=0 tx=0).stop 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2297805036 shutdown_connections 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5568f43091a0 0x5568f430b640 crc :-1 s=READY pgs=643 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f4304c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f42fdd00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2297805036 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.984 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2297805036 >> 10.20.193.28:0/2297805036 conn(0x5568f42ca0d0 msgr2=0x5568f42d9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:03.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3e60ff9640 0 client.29081 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:41:03.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2297805036 shutdown_connections 2026-02-20T03:41:03.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2297805036 wait complete. 2026-02-20T03:41:03.985 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.975+0000 7f3ea07cde00 20 client.29081 trim_cache size 0 max 16384 2026-02-20T03:41:03.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3ea07cde00 1 Processor -- start 2026-02-20T03:41:03.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3ea07cde00 1 -- start start 2026-02-20T03:41:03.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d35a0 0x5568f4304c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d8780 0x5568f42d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c012730 con 0x5568f42d2c60 2026-02-20T03:41:03.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00ff40 con 0x5568f42d8780 2026-02-20T03:41:03.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00dd90 con 0x5568f42d35a0 2026-02-20T03:41:03.987 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e96ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e967fc640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d35a0 0x5568f4304c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e96ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52224/0 (socket says 10.20.193.28:52224) 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e96ffd640 1 -- 10.20.193.28:0/2269759821 learned_addr learned my addr 10.20.193.28:0/2269759821 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e977fe640 1 --2- 10.20.193.28:0/2269759821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d8780 0x5568f42d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e96ffd640 1 -- 10.20.193.28:0/2269759821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d35a0 msgr2=0x5568f4304c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/2269759821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d35a0 0x5568f4304c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e96ffd640 1 -- 10.20.193.28:0/2269759821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d8780 msgr2=0x5568f42d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/2269759821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d8780 0x5568f42d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e96ffd640 1 -- 10.20.193.28:0/2269759821 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f42f64e0 con 0x5568f42d2c60 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e967fc640 1 --2- 10.20.193.28:0/2269759821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d35a0 0x5568f4304c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.983+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/2269759821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fae40 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0058c0 tx=0x7f3e8c04a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890ad046a5b69ffe server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:03.988 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3e62ffd640 1 -- 10.20.193.28:0/2269759821 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c047040 con 0x5568f42d2c60 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3e62ffd640 1 -- 10.20.193.28:0/2269759821 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e8c066070 con 0x5568f42d2c60 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3e62ffd640 1 -- 10.20.193.28:0/2269759821 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c038c40 con 0x5568f42d2c60 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2269759821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 msgr2=0x5568f42fae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2269759821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fae40 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c0058c0 tx=0x7f3e8c04a000 comp rx=0 tx=0).stop 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2269759821 shutdown_connections 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2269759821 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d8780 0x5568f42d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2269759821 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d35a0 0x5568f4304c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/2269759821 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f42fae40 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2269759821 >> 10.20.193.28:0/2269759821 conn(0x5568f42ca0d0 msgr2=0x5568f42d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2269759821 shutdown_connections 2026-02-20T03:41:03.989 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.984+0000 7f3ea07cde00 1 -- 10.20.193.28:0/2269759821 wait complete. 2026-02-20T03:41:03.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3ea07cde00 1 -- start start 2026-02-20T03:41:03.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3ea07cde00 1 Processor -- start 2026-02-20T03:41:03.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f4302240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f4302780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3ea07cde00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f43037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.993 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00e400 con 0x5568f42d2c60 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00f870 con 0x5568f42d35a0 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3ea07cde00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c00ead0 con 0x5568f42d8780 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3e96ffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f4302240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3e967fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f4302780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3e967fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f4302780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47800/0 (socket says 10.20.193.28:47800) 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.985+0000 7f3e967fc640 1 -- 10.20.193.28:0/1256771817 learned_addr learned my addr 10.20.193.28:0/1256771817 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e977fe640 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f43037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e96ffd640 1 -- 10.20.193.28:0/1256771817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 msgr2=0x5568f43037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f43037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e96ffd640 1 -- 10.20.193.28:0/1256771817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 msgr2=0x5568f4302780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f4302780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.994 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e96ffd640 1 -- 10.20.193.28:0/1256771817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568f3f83e90 con 0x5568f42d2c60 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e967fc640 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f4302780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e96ffd640 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f4302240 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c02f730 tx=0x7f3e8c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8f7219f2dcb6ad server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e60ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e60ff9640 1 -- 10.20.193.28:0/1256771817 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c02fe20 con 0x5568f42d2c60 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3ea07cde00 1 -- 10.20.193.28:0/1256771817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568f41df540 con 0x5568f42d2c60 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e60ff9640 1 -- 10.20.193.28:0/1256771817 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3e8c02fe20 con 0x5568f42d2c60 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3ea07cde00 10 client.22491 _ll_register_callbacks cb 0x7f3e800a3f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3ea07cde00 1 -- 10.20.193.28:0/1256771817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5568f4232560 con 0x5568f42d2c60 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e60ff9640 1 -- 10.20.193.28:0/1256771817 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c06a450 con 0x5568f42d2c60 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e60ff9640 1 -- 10.20.193.28:0/1256771817 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f3e8c04c460 con 0x5568f42d2c60 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3e60ff9640 1 -- 10.20.193.28:0/1256771817 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f3e8c04c720 con 0x5568f42d2c60 2026-02-20T03:41:03.995 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3ea07cde00 10 client.22491 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.986+0000 7f3ea07cde00 1 -- 10.20.193.28:0/1256771817 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=60}) -- 0x5568f42f71d0 con 0x5568f42d2c60 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3e60ff9640 1 -- 10.20.193.28:0/1256771817 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7f3e8c060070 con 0x5568f42d2c60 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3ea07cde00 10 client.22491 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3ea07cde00 10 client.22491 resolve_mds: validated gid 24560 aka daemon mds.b 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3ea07cde00 20 client.22491 populate_metadata read hostname 'trial028' 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5568f4374120 0x5568f4376510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3ea07cde00 4 client.22491 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3ea07cde00 1 -- 10.20.193.28:0/1256771817 --> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x7f3e8c033040 con 0x5568f4374120 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3e967fc640 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5568f4374120 0x5568f4376510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3e967fc640 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5568f4374120 0x5568f4376510 crc :-1 s=READY pgs=644 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21df5cbc1705a863 server_cookie=239d001c227103ec in_seq=0 out_seq=0 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.987+0000 7f3e60ff9640 10 client.22491 ms_handle_connect on v2:10.20.193.126:6838/2074063114 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3e60ff9640 1 -- 10.20.193.28:0/1256771817 <== mds.0 v2:10.20.193.126:6838/2074063114 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18403 (crc 0 0 0) 0x7f3e8c033040 con 0x5568f4374120 2026-02-20T03:41:03.996 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3e60ff9640 10 client.22491 handle_command_reply: tid=0 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 client.22491 shutdown 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 -- 10.20.193.28:0/1256771817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 msgr2=0x5568f4302240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f4302240 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c02f730 tx=0x7f3e8c005ef0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 -- 10.20.193.28:0/1256771817 shutdown_connections 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.126:6838/2074063114,v1:10.20.193.126:6839/2074063114] conn(0x5568f4374120 0x5568f4376510 crc :-1 s=READY pgs=644 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5568f42d8780 0x5568f43037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5568f42d35a0 0x5568f4302780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 --2- 10.20.193.28:0/1256771817 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5568f42d2c60 0x5568f4302240 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3e60ff9640 0 client.22491 ms_handle_reset on v2:10.20.193.126:6838/2074063114 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 -- 10.20.193.28:0/1256771817 >> 10.20.193.28:0/1256771817 conn(0x5568f42ca0d0 msgr2=0x5568f42d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 -- 10.20.193.28:0/1256771817 shutdown_connections 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 1 -- 10.20.193.28:0/1256771817 wait complete. 2026-02-20T03:41:03.997 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.988+0000 7f3ea07cde00 20 client.22491 trim_cache size 0 max 16384 2026-02-20T03:41:03.998 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:41:03.998 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:41:03.998 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-20T03:41:03.998 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 452795, 2026-02-20T03:41:03.998 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 511350, 2026-02-20T03:41:03.998 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 109584408, 2026-02-20T03:41:03.998 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 424770348, 2026-02-20T03:41:03.998 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 19, 2026-02-20T03:41:03.998 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 5, 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 13.616200313, 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 6.139347182, 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 6.909014368, 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 1.306765939, 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 511348, 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 19.346462738, 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000037834 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 736580, 2026-02-20T03:41:03.999 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.038063033, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000051 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 0 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 100132, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 100139, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 31774854, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 318103278, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 616, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 8, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 3.497661614, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 1.341058350, 2026-02-20T03:41:04.000 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 0.788484435, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 1.122581664, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 100139, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 11.446726547, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000114308 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 797, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000035860, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000044 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 833696, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 358768 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.001 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 907672, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 1270645, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 292266756, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 859796580, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 16, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 24.645208995, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 11.579288358, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 18.585900264, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.712394631, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1270643, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 21.084895461, 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000016593 2026-02-20T03:41:04.002 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1719746, 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.122180570, 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000071 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 213643712, 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 661269584 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T03:41:04.003 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 191151, 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 79.951882685, 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000418265 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 101293, 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 4.930804244, 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000048678 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "request": 406276, 2026-02-20T03:41:04.004 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 355479, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 355479, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 743.179303114, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002090641 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 50797, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 10, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 2, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 5304, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 38, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 40, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 300, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 114, 2026-02-20T03:41:04.005 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 175, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 11, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 137, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 2800, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 4, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 4, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 4, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 599401, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 348377, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 50766, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 183, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 3335, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 8782, 2026-02-20T03:41:04.006 INFO:teuthology.orchestra.run.trial028.stdout: "q": 3, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 19, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 1791, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 18, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 875, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 6821, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 4, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 234, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 6821, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 1519, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 41, 2026-02-20T03:41:04.007 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 1478, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 5302, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 88, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 54061, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 214610, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 0, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 133589, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 41184, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 19424, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 208331 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 270, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 327, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 207, 2026-02-20T03:41:04.008 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 328, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 1095, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 15, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 53147, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 53132, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 13, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 1203, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 41, 2026-02-20T03:41:04.009 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 21, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 78, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 279465, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 278958, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 278958, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 507, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 195, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 397, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 396, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 396, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 1, 2026-02-20T03:41:04.010 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 1, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 1, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 601459920, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 602415895, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 97389, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 296.832648640, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003047907 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 49, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 54222, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 54173, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 87, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 690, 2026-02-20T03:41:04.011 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 603, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 298, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 113497, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 113199, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 4, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 56805, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 56801, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 105984, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 231712 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 534822, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 31542, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 406276, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 6460, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 63366, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 53559, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 146.085928444, 2026-02-20T03:41:04.012 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002727570 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 34995, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 125.189002198, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003577339 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 115075, 2026-02-20T03:41:04.013 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 93.817982230, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000815276 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000135803, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000067901 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.014 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 119, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 16.772024908, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.140941385 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.015 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 10, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.003014571, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000301457 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 82654, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 243.235523585, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002942816 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 13304, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 21.567945306, 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001621162 2026-02-20T03:41:04.016 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 64, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.875704280, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.013682879 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-20T03:41:04.017 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 97, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 2.601053699, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.026814986 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2496, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 1.364962006, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000546859 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.018 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 10, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.011357255, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001135725 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 53094, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 91.654668829, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.001726271 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.019 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 1, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 3, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 2, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 1, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 11363, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 11363, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 1538, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-20T03:41:04.020 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-20T03:41:04.021 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 376052, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 152, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 88, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 1, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 9344, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 177, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 486569, 2026-02-20T03:41:04.022 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 6076, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 274720, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 648941148, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 22, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 274720, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 274720, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 9693.599572829, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.035285379 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 274720, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 368690 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op": 274720, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 7869, 2026-02-20T03:41:04.023 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 266851, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 4829, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 53932, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 995, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 98343, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 977, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 38, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 107302, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 6874, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 81392, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-20T03:41:04.024 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 99, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 15, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 12, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 12, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 10885, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 24, 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 3099 2026-02-20T03:41:04.025 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "osd-slow-ops": { 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 610 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 16, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 16, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 106226, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 53132, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "get": 1460595, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 275660749, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.026 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 1460595, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "put": 1460595, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 275660749, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "take": 274720, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 654732064, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "put": 274720, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 654732064, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.027 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "take": 274720, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 274720, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "put": 274720, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 274720, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "get": 53132, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 5791084, 2026-02-20T03:41:04.028 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 53132, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "put": 954, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 5791084, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x557551752a00": { 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "get": 279465, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 598221591, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 279465, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "put": 97389, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 598221591, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.029 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.030 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.030 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.030 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:41:04.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 -- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0da0 msgr2=0x7f3e6c0b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0da0 0x7f3e6c0b3260 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c02f260 tx=0x7f3e8c03a040 comp rx=0 tx=0).stop 2026-02-20T03:41:04.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 -- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e98109be0 msgr2=0x7f3e981a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e98109be0 0x7f3e981a1530 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f3e8000d950 tx=0x7f3e8000de20 comp rx=0 tx=0).stop 2026-02-20T03:41:04.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 -- 10.20.193.28:0/2757284274 shutdown_connections 2026-02-20T03:41:04.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3e6c0b0da0 0x7f3e6c0b3260 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3e9810a540 0x7f3e981a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3e98109be0 0x7f3e981a1530 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 --2- 10.20.193.28:0/2757284274 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3e98109220 0x7f3e981a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 -- 10.20.193.28:0/2757284274 >> 10.20.193.28:0/2757284274 conn(0x7f3e98078080 msgr2=0x7f3e9810d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 -- 10.20.193.28:0/2757284274 shutdown_connections 2026-02-20T03:41:04.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:03.989+0000 7f3e97fff640 1 -- 10.20.193.28:0/2757284274 wait complete. 2026-02-20T03:41:04.031 INFO:tasks.check_counter:Daemon mds.b mds.exported=19 2026-02-20T03:41:04.031 INFO:tasks.check_counter:Daemon mds.b mds.imported=18 2026-02-20T03:41:04.031 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=270 2026-02-20T03:41:04.031 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=327 2026-02-20T03:41:04.031 DEBUG:tasks.check_counter:Getting stats from e 2026-02-20T03:41:04.031 DEBUG:tasks.check_counter:skipping mds.24515 2026-02-20T03:41:04.031 DEBUG:tasks.check_counter:Getting stats from h 2026-02-20T03:41:04.032 DEBUG:tasks.check_counter:Getting stats from mds.24533 2026-02-20T03:41:04.032 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24533 perf dump --format=json-pretty 2026-02-20T03:41:04.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.154+0000 7f9b9dd64640 1 -- 10.20.193.28:0/3548939004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109be0 msgr2=0x7f9b98111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.154+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/3548939004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109be0 0x7f9b98111480 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009f90 tx=0x7f9b9402f390 comp rx=0 tx=0).stop 2026-02-20T03:41:04.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.154+0000 7f9b9dd64640 1 -- 10.20.193.28:0/3548939004 shutdown_connections 2026-02-20T03:41:04.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.154+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/3548939004 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109be0 0x7f9b98111480 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.154+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/3548939004 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b98109220 0x7f9b981096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.154+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/3548939004 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b9810a540 0x7f9b9810a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.154+0000 7f9b9dd64640 1 -- 10.20.193.28:0/3548939004 >> 10.20.193.28:0/3548939004 conn(0x7f9b98078080 msgr2=0x7f9b9807a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.157 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.154+0000 7f9b9dd64640 1 -- 10.20.193.28:0/3548939004 shutdown_connections 2026-02-20T03:41:04.158 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.154+0000 7f9b9dd64640 1 -- 10.20.193.28:0/3548939004 wait complete. 2026-02-20T03:41:04.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9dd64640 1 Processor -- start 2026-02-20T03:41:04.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9dd64640 1 -- start start 2026-02-20T03:41:04.159 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9dd64640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109220 0x7f9b981a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9dd64640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b98109be0 0x7f9b981a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9dd64640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b9810a540 0x7f9b981a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9dd64640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98114950 con 0x7f9b98109220 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9dd64640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9b981147d0 con 0x7f9b9810a540 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9dd64640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b98114ad0 con 0x7f9b98109be0 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9cd62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109220 0x7f9b981a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b8ffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b98109be0 0x7f9b981a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9cd62640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109220 0x7f9b981a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52264/0 (socket says 10.20.193.28:52264) 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9cd62640 1 -- 10.20.193.28:0/598510277 learned_addr learned my addr 10.20.193.28:0/598510277 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9d563640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b9810a540 0x7f9b981a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.160 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9cd62640 1 -- 10.20.193.28:0/598510277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b98109be0 msgr2=0x7f9b981a1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9cd62640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b98109be0 0x7f9b981a1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9cd62640 1 -- 10.20.193.28:0/598510277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b9810a540 msgr2=0x7f9b981a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9cd62640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b9810a540 0x7f9b981a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9cd62640 1 -- 10.20.193.28:0/598510277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b981a8bb0 con 0x7f9b98109220 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.155+0000 7f9b9cd62640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109220 0x7f9b981a0f00 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f9b880027e0 tx=0x7f9b88002cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.156+0000 7f9b8dffb640 1 -- 10.20.193.28:0/598510277 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8800ed40 con 0x7f9b98109220 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.156+0000 7f9b8dffb640 1 -- 10.20.193.28:0/598510277 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9b880108d0 con 0x7f9b98109220 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.156+0000 7f9b8dffb640 1 -- 10.20.193.28:0/598510277 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b88018780 con 0x7f9b98109220 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.156+0000 7f9b9dd64640 1 -- 10.20.193.28:0/598510277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b981a8ea0 con 0x7f9b98109220 2026-02-20T03:41:04.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.156+0000 7f9b9dd64640 1 -- 10.20.193.28:0/598510277 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b981a92b0 con 0x7f9b98109220 2026-02-20T03:41:04.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.158+0000 7f9b8dffb640 1 -- 10.20.193.28:0/598510277 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f9b88020030 con 0x7f9b98109220 2026-02-20T03:41:04.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9ba1e4be00 1 Processor -- start 2026-02-20T03:41:04.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9ba1e4be00 1 -- start start 2026-02-20T03:41:04.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef40060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef451b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.163 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef45780 0x563f9ef47c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f9ee91bc0 con 0x563f9ef405a0 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563f9ee3efc0 con 0x563f9ef45780 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563f9ee8daf0 con 0x563f9ef3fc60 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9b9d563640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef40060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9b9d563640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef40060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52064/0 (socket says 10.20.193.28:52064) 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9b9d563640 1 -- 10.20.193.28:0/3418016517 learned_addr learned my addr 10.20.193.28:0/3418016517 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.159+0000 7f9b9cd62640 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef45780 0x563f9ef47c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b9d563640 1 -- 10.20.193.28:0/3418016517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef45780 msgr2=0x563f9ef47c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b9d563640 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef45780 0x563f9ef47c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b9d563640 1 -- 10.20.193.28:0/3418016517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 msgr2=0x563f9ef451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b9d563640 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b9d563640 1 -- 10.20.193.28:0/3418016517 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9ee153e0 con 0x563f9ef3fc60 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef45780 0x563f9ef47c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b9cd62640 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b9d563640 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef40060 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9b940074c0 tx=0x7f9b940060e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db346240ab6f1b21 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b8dffb640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9b740b0ef0 0x7f9b740b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b653fe640 1 -- 10.20.193.28:0/3418016517 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94004050 con 0x563f9ef3fc60 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b653fe640 1 -- 10.20.193.28:0/3418016517 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9b94033040 con 0x563f9ef3fc60 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b653fe640 1 -- 10.20.193.28:0/3418016517 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94002a60 con 0x563f9ef3fc60 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b8dffb640 1 -- 10.20.193.28:0/598510277 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9b880e0b50 con 0x7f9b98109220 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/3418016517 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 msgr2=0x563f9ef40060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef40060 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f9b940074c0 tx=0x7f9b940060e0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.160+0000 7f9b9cd62640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9b740b0ef0 0x7f9b740b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.161+0000 7f9b9cd62640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9b740b0ef0 0x7f9b740b33b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800e720 tx=0x7f9b880e4590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.161+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/3418016517 shutdown_connections 2026-02-20T03:41:04.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.161+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef45780 0x563f9ef47c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.161+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.161+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/3418016517 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef40060 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.161+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/3418016517 >> 10.20.193.28:0/3418016517 conn(0x563f9ef370d0 msgr2=0x563f9ef3df50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.161+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/3418016517 shutdown_connections 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.161+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/3418016517 wait complete. 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.162+0000 7f9ba1e4be00 1 -- start start 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.162+0000 7f9ba1e4be00 1 Processor -- start 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef3fc60 0x563f9ef593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef45780 0x563f9ef607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x563f9ee38bb0 con 0x563f9ef405a0 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x563f9ef48770 con 0x563f9ef3fc60 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x563f9ef60d50 con 0x563f9ef45780 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b9d563640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef3fc60 0x563f9ef593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b8ffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52278/0 (socket says 10.20.193.28:52278) 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b8ffff640 1 -- 10.20.193.28:0/706338092 learned_addr learned my addr 10.20.193.28:0/706338092 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b9d563640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef45780 0x563f9ef607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b8ffff640 1 -- 10.20.193.28:0/706338092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef45780 msgr2=0x563f9ef607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef45780 0x563f9ef607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b8ffff640 1 -- 10.20.193.28:0/706338092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef3fc60 msgr2=0x563f9ef593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef3fc60 0x563f9ef593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b8ffff640 1 -- 10.20.193.28:0/706338092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9ef52220 con 0x563f9ef405a0 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.163+0000 7f9b9d563640 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef45780 0x563f9ef607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef598e0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f9b80004390 tx=0x7f9b80002ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d375f0627a8423 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9b567fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9b567fc640 1 -- 10.20.193.28:0/706338092 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80004aa0 con 0x563f9ef405a0 2026-02-20T03:41:04.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9b567fc640 1 -- 10.20.193.28:0/706338092 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9b80004c40 con 0x563f9ef405a0 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9b567fc640 1 -- 10.20.193.28:0/706338092 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80005600 con 0x563f9ef405a0 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/706338092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f9ee31040 con 0x563f9ef405a0 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9ba1e4be00 10 client.22503 _ll_register_callbacks cb 0x563f9ee3cae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/706338092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563f9ee997b0 con 0x563f9ef405a0 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9b567fc640 1 -- 10.20.193.28:0/706338092 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9b80013760 con 0x563f9ef405a0 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9b567fc640 1 -- 10.20.193.28:0/706338092 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f9b80004df0 con 0x563f9ef405a0 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9ba1e4be00 10 client.22503 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/706338092 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=60}) -- 0x563f9ee37660 con 0x563f9ef405a0 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.164+0000 7f9b567fc640 1 -- 10.20.193.28:0/706338092 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7f9b80023030 con 0x563f9ef405a0 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.165+0000 7f9ba1e4be00 10 client.22503 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.165+0000 7f9ba1e4be00 10 client.22503 resolve_mds: validated gid 24533 aka daemon mds.h 2026-02-20T03:41:04.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.165+0000 7f9ba1e4be00 20 client.22503 populate_metadata read hostname 'trial028' 2026-02-20T03:41:04.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.165+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x563f9ef64d40 0x563f9ef67200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.165+0000 7f9ba1e4be00 4 client.22503 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:41:04.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.165+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/706338092 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f9ee13520 con 0x563f9ef64d40 2026-02-20T03:41:04.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.165+0000 7f9b9d563640 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x563f9ef64d40 0x563f9ef67200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.165+0000 7f9b567fc640 10 client.22503 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:41:04.172 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.165+0000 7f9b9d563640 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x563f9ef64d40 0x563f9ef67200 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=823f954bafc91b78 server_cookie=2cb53646a7287509 in_seq=0 out_seq=0 2026-02-20T03:41:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9b567fc640 1 -- 10.20.193.28:0/706338092 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x563f9ee13520 con 0x563f9ef64d40 2026-02-20T03:41:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9b567fc640 10 client.22503 handle_command_reply: tid=0 2026-02-20T03:41:04.173 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 client.22503 shutdown 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/706338092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 msgr2=0x563f9ef598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef598e0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f9b80004390 tx=0x7f9b80002ab0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/706338092 shutdown_connections 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef45780 0x563f9ef607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x563f9ef64d40 0x563f9ef67200 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef405a0 0x563f9ef598e0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/706338092 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef3fc60 0x563f9ef593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/706338092 >> 10.20.193.28:0/706338092 conn(0x563f9ef370d0 msgr2=0x563f9ef46b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9b567fc640 0 client.22503 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/706338092 shutdown_connections 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/706338092 wait complete. 2026-02-20T03:41:04.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.166+0000 7f9ba1e4be00 20 client.22503 trim_cache size 0 max 16384 2026-02-20T03:41:04.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.174+0000 7f9ba1e4be00 1 Processor -- start 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.174+0000 7f9ba1e4be00 1 -- start start 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.174+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef42370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.174+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef56740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.174+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef60780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.174+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c0127b0 con 0x563f9ef45780 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.174+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c00ffc0 con 0x563f9ef405a0 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.174+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c00de10 con 0x563f9ef3fc60 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b8ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef56740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b8ffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef56740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47850/0 (socket says 10.20.193.28:47850) 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b8ffff640 1 -- 10.20.193.28:0/59804295 learned_addr learned my addr 10.20.193.28:0/59804295 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b9d563640 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef42370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b9d563640 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef60780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b8ffff640 1 -- 10.20.193.28:0/59804295 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 msgr2=0x563f9ef42370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef42370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b8ffff640 1 -- 10.20.193.28:0/59804295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 msgr2=0x563f9ef60780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef60780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b8ffff640 1 -- 10.20.193.28:0/59804295 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9ef52050 con 0x563f9ef405a0 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b9d563640 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef60780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef56740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9b800058a0 tx=0x7f9b8001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb8f466728a8c06 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b64bfd640 1 -- 10.20.193.28:0/59804295 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8002f020 con 0x563f9ef405a0 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b64bfd640 1 -- 10.20.193.28:0/59804295 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x563f9ee997b0 con 0x563f9ef405a0 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.175+0000 7f9b64bfd640 1 -- 10.20.193.28:0/59804295 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80010680 con 0x563f9ef405a0 2026-02-20T03:41:04.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/59804295 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 msgr2=0x563f9ef56740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef56740 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9b800058a0 tx=0x7f9b8001f000 comp rx=0 tx=0).stop 2026-02-20T03:41:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/59804295 shutdown_connections 2026-02-20T03:41:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef60780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef56740 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/59804295 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef42370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/59804295 >> 10.20.193.28:0/59804295 conn(0x563f9ef370d0 msgr2=0x563f9ef3df50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/59804295 shutdown_connections 2026-02-20T03:41:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/59804295 wait complete. 2026-02-20T03:41:04.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 -- start start 2026-02-20T03:41:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.176+0000 7f9ba1e4be00 1 Processor -- start 2026-02-20T03:41:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef5e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef5e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9ba1e4be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef5f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c00e480 con 0x563f9ef45780 2026-02-20T03:41:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c00f8f0 con 0x563f9ef405a0 2026-02-20T03:41:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9ba1e4be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c00eb50 con 0x563f9ef3fc60 2026-02-20T03:41:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef5e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef5f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef5f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52306/0 (socket says 10.20.193.28:52306) 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 -- 10.20.193.28:0/29307372 learned_addr learned my addr 10.20.193.28:0/29307372 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef5e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 -- 10.20.193.28:0/29307372 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 msgr2=0x563f9ef5e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef5e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 -- 10.20.193.28:0/29307372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 msgr2=0x563f9ef5e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef5e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 -- 10.20.193.28:0/29307372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f9ebf0e90 con 0x563f9ef45780 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b9d563640 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef5f8a0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009620 tx=0x7f9b94009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df7879493ef32ef server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b567fc640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b567fc640 1 -- 10.20.193.28:0/29307372 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94004840 con 0x563f9ef45780 2026-02-20T03:41:04.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/29307372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f9ee4c540 con 0x563f9ef45780 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9ba1e4be00 10 client.22509 _ll_register_callbacks cb 0x7f9b80009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/29307372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b94033040 con 0x563f9ef45780 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b567fc640 1 -- 10.20.193.28:0/29307372 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f9b94007a80 con 0x563f9ef45780 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.177+0000 7f9b567fc640 1 -- 10.20.193.28:0/29307372 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b94057780 con 0x563f9ef45780 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9b567fc640 1 -- 10.20.193.28:0/29307372 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f9b94057920 con 0x563f9ef45780 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9b567fc640 1 -- 10.20.193.28:0/29307372 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f9b94057b60 con 0x563f9ef45780 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9ba1e4be00 10 client.22509 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/29307372 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=60}) -- 0x563f9ef52d40 con 0x563f9ef45780 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9b567fc640 1 -- 10.20.193.28:0/29307372 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7f9b9404d040 con 0x563f9ef45780 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9ba1e4be00 10 client.22509 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9ba1e4be00 10 client.22509 resolve_mds: validated gid 24533 aka daemon mds.h 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9ba1e4be00 20 client.22509 populate_metadata read hostname 'trial028' 2026-02-20T03:41:04.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x563f9efd0170 0x563f9efd2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9ba1e4be00 4 client.22509 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/29307372 --> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x563f9ef38420 con 0x563f9efd0170 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.178+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x563f9efd0170 0x563f9efd2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.179+0000 7f9b8ffff640 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x563f9efd0170 0x563f9efd2630 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4c9f5aeb3197de1f server_cookie=24f79cc364cbc295 in_seq=0 out_seq=0 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.179+0000 7f9b567fc640 10 client.22509 ms_handle_connect on v2:10.20.193.126:6836/1802675915 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.179+0000 7f9b567fc640 1 -- 10.20.193.28:0/29307372 <== mds.2 v2:10.20.193.126:6836/1802675915 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18386 (crc 0 0 0) 0x563f9ef38420 con 0x563f9efd0170 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.179+0000 7f9b567fc640 10 client.22509 handle_command_reply: tid=0 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.179+0000 7f9ba1e4be00 1 client.22509 shutdown 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/29307372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 msgr2=0x563f9ef5f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef5f8a0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f9b94009620 tx=0x7f9b94009920 comp rx=0 tx=0).stop 2026-02-20T03:41:04.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/29307372 shutdown_connections 2026-02-20T03:41:04.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.126:6836/1802675915,v1:10.20.193.126:6837/1802675915] conn(0x563f9efd0170 0x563f9efd2630 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x563f9ef45780 0x563f9ef5f8a0 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x563f9ef405a0 0x563f9ef5e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b567fc640 0 client.22509 ms_handle_reset on v2:10.20.193.126:6836/1802675915 2026-02-20T03:41:04.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 --2- 10.20.193.28:0/29307372 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x563f9ef3fc60 0x563f9ef5e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/29307372 >> 10.20.193.28:0/29307372 conn(0x563f9ef370d0 msgr2=0x563f9ef55730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/29307372 shutdown_connections 2026-02-20T03:41:04.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 1 -- 10.20.193.28:0/29307372 wait complete. 2026-02-20T03:41:04.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9ba1e4be00 20 client.22509 trim_cache size 0 max 16384 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 468455, 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 409901, 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 124320091, 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 252813655, 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 93, 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 7, 2026-02-20T03:41:04.190 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 12.192209872, 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 5.458567388, 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 7.149154534, 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.784522824, 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 409901, 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 3.499326262, 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000008537 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 736741, 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.034073750, 2026-02-20T03:41:04.191 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000046 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 0, 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 0 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 515659, 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 754918, 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 190511052, 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 722195647, 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 16, 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 7, 2026-02-20T03:41:04.192 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 15.086902160, 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 7.073974561, 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 10.734997562, 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.680940845, 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 754916, 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 9.292328267, 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000012309 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 875518, 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.074732173, 2026-02-20T03:41:04.193 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000085 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 176067344, 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 579839512 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 195757, 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 204029, 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 50643293, 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 212386183, 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 13, 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-20T03:41:04.194 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 5.584808388, 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 2.382594154, 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 2.671174042, 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.668655009, 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 204027, 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 2.179405311, 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000010681 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 294465, 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.015990515, 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000054 2026-02-20T03:41:04.195 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 1904, 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 754576 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 124585, 2026-02-20T03:41:04.196 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 55.018087021, 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000441610 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 95478, 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 3.897010229, 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000040815 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.197 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "request": 341431, 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 291006, 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 291006, 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 819.445667744, 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002815906 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 50425, 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-20T03:41:04.198 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 209, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 21, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 17, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 2681, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 1263, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 920, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 498, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 875, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 1292, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 0, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 0, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 4, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 565114, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 272007, 2026-02-20T03:41:04.199 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 50407, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 224, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 5447, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 4083, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 11, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 605, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 12, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 1036, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 5716, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 663, 2026-02-20T03:41:04.200 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 211565411, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 5716, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 640, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 0, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 640, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 5076, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 42, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 16683, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 183565, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 0, 2026-02-20T03:41:04.201 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 90110, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 35583, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 11596, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 221077 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 360, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 691, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 421, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 615, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 542, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 3, 2026-02-20T03:41:04.202 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 49902, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 49899, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 13, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 1115, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 11, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-20T03:41:04.203 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 38, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 245215, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 137078, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 130352, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 114863, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 6726, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 298, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 170, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 163, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 135, 2026-02-20T03:41:04.204 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 8, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 7, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 197139064, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 438301744, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 65258, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 223.077484204, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003418392 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 34, 2026-02-20T03:41:04.205 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 50411, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 50377, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 107, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 667, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 560, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 2719, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 89119, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 86400, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 0, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 54294, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 54294, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 97164, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 223520 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 488585, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 1109, 2026-02-20T03:41:04.206 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 341431, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 4368, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 24841, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 49674, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 316.484225795, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.006371224 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 4658, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 31.628700022, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.006790188 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.207 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 92102, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 57.464253696, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000623919 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-20T03:41:04.208 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.209 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.210 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 2, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.001615956, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000807978 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 84456, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 188.662251844, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002233852 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 9188, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 41.790892862, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.004548421 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-20T03:41:04.211 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 30, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.129351484, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.004311716 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.212 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 16, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.083432131, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.005214508 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 1008, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.721720920, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000715992 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.213 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 49872, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 182.479223034, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003658951 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.214 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 1, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 2, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 1, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 1, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 15016, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 15016, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 1475, 2026-02-20T03:41:04.215 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-20T03:41:04.216 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 302053, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 127, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 0, 2026-02-20T03:41:04.217 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 9344, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 177, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 2298433, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 31137, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 174998, 2026-02-20T03:41:04.218 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 446356598, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 27, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 174998, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 174998, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 1426.343119283, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.008150625 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 174998, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 176552 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "op": 174998, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 6854, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 168144, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 13, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 53, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 1138, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 66396, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 675, 2026-02-20T03:41:04.219 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 21, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 100052, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 5716, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 90, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-20T03:41:04.220 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 99, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 10, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 12, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 12, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 1754, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 644 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-20T03:41:04.221 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "osd-slow-ops": { 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 930 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 17, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 10, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 99771, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 49899, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "get": 1179867, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 237376956, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.222 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 1179867, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "put": 1179867, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 237376956, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "take": 174998, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 451795373, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "put": 174998, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 451795373, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.223 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "take": 174998, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 174998, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "put": 174998, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 174998, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.224 INFO:teuthology.orchestra.run.trial028.stdout: "get": 49899, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 5438775, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 49899, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "put": 1138, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 5438775, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x55e21ba3aa00": { 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "val": 189, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "get": 245215, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 434107440, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 245215, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "put": 65258, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 434107251, 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.225 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.226 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.226 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.226 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.226 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.226 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:41:04.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 -- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9b740b0ef0 msgr2=0x7f9b740b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9b740b0ef0 0x7f9b740b33b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9b8800e720 tx=0x7f9b880e4590 comp rx=0 tx=0).stop 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 -- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109220 msgr2=0x7f9b981a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109220 0x7f9b981a0f00 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f9b880027e0 tx=0x7f9b88002cb0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 -- 10.20.193.28:0/598510277 shutdown_connections 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f9b740b0ef0 0x7f9b740b33b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f9b9810a540 0x7f9b981a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f9b98109be0 0x7f9b981a1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 --2- 10.20.193.28:0/598510277 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f9b98109220 0x7f9b981a0f00 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.180+0000 7f9b9dd64640 1 -- 10.20.193.28:0/598510277 >> 10.20.193.28:0/598510277 conn(0x7f9b98078080 msgr2=0x7f9b9810d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.181+0000 7f9b9dd64640 1 -- 10.20.193.28:0/598510277 shutdown_connections 2026-02-20T03:41:04.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.181+0000 7f9b9dd64640 1 -- 10.20.193.28:0/598510277 wait complete. 2026-02-20T03:41:04.227 INFO:tasks.check_counter:Daemon mds.h mds.exported=11 2026-02-20T03:41:04.227 INFO:tasks.check_counter:Daemon mds.h mds.imported=12 2026-02-20T03:41:04.228 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=360 2026-02-20T03:41:04.228 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=691 2026-02-20T03:41:04.228 DEBUG:tasks.check_counter:Getting stats from k 2026-02-20T03:41:04.228 DEBUG:tasks.check_counter:skipping mds.24494 2026-02-20T03:41:04.228 DEBUG:tasks.check_counter:Getting stats from c 2026-02-20T03:41:04.228 DEBUG:tasks.check_counter:skipping mds.28330 2026-02-20T03:41:04.228 DEBUG:tasks.check_counter:Getting stats from f 2026-02-20T03:41:04.228 DEBUG:tasks.check_counter:skipping mds.24517 2026-02-20T03:41:04.228 DEBUG:tasks.check_counter:Getting stats from i 2026-02-20T03:41:04.228 DEBUG:tasks.check_counter:Getting stats from mds.24538 2026-02-20T03:41:04.228 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.24538 perf dump --format=json-pretty 2026-02-20T03:41:04.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.350+0000 7fedeffff640 1 -- 10.20.193.28:0/3321005266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf010a540 msgr2=0x7fedf010a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.350+0000 7fedeffff640 1 --2- 10.20.193.28:0/3321005266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf010a540 0x7fedf010a940 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7fede4009960 tx=0x7fede402f140 comp rx=0 tx=0).stop 2026-02-20T03:41:04.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.350+0000 7fedeffff640 1 -- 10.20.193.28:0/3321005266 shutdown_connections 2026-02-20T03:41:04.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.350+0000 7fedeffff640 1 --2- 10.20.193.28:0/3321005266 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fedf0109be0 0x7fedf0111480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.350+0000 7fedeffff640 1 --2- 10.20.193.28:0/3321005266 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fedf0109220 0x7fedf01096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.350+0000 7fedeffff640 1 --2- 10.20.193.28:0/3321005266 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf010a540 0x7fedf010a940 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.350+0000 7fedeffff640 1 -- 10.20.193.28:0/3321005266 >> 10.20.193.28:0/3321005266 conn(0x7fedf0078080 msgr2=0x7fedf007a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.350+0000 7fedeffff640 1 -- 10.20.193.28:0/3321005266 shutdown_connections 2026-02-20T03:41:04.354 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.350+0000 7fedeffff640 1 -- 10.20.193.28:0/3321005266 wait complete. 2026-02-20T03:41:04.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedeffff640 1 Processor -- start 2026-02-20T03:41:04.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedeffff640 1 -- start start 2026-02-20T03:41:04.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedeffff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fedf0109220 0x7fedf01a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedeffff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf0109be0 0x7fedf01a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedeffff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fedf010a540 0x7fedf01a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedeffff640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fedf01149a0 con 0x7fedf0109be0 2026-02-20T03:41:04.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedeffff640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fedf0114820 con 0x7fedf010a540 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedeffff640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fedf0114b20 con 0x7fedf0109220 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedee7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf0109be0 0x7fedf01a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedee7fc640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf0109be0 0x7fedf01a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52316/0 (socket says 10.20.193.28:52316) 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedee7fc640 1 -- 10.20.193.28:0/1488747751 learned_addr learned my addr 10.20.193.28:0/1488747751 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fedf0109220 0x7fedf01a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedef7fe640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fedf010a540 0x7fedf01a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedee7fc640 1 -- 10.20.193.28:0/1488747751 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fedf0109220 msgr2=0x7fedf01a0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedee7fc640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fedf0109220 0x7fedf01a0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedee7fc640 1 -- 10.20.193.28:0/1488747751 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fedf010a540 msgr2=0x7fedf01a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedee7fc640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fedf010a540 0x7fedf01a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.351+0000 7fedee7fc640 1 -- 10.20.193.28:0/1488747751 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf01a8ca0 con 0x7fedf0109be0 2026-02-20T03:41:04.357 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.352+0000 7fedee7fc640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf0109be0 0x7fedf01a1530 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7fedd800ea10 tx=0x7fedd800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.352+0000 7fedcffff640 1 -- 10.20.193.28:0/1488747751 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd800ce50 con 0x7fedf0109be0 2026-02-20T03:41:04.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.352+0000 7fedcffff640 1 -- 10.20.193.28:0/1488747751 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fedd8004570 con 0x7fedf0109be0 2026-02-20T03:41:04.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.352+0000 7fedcffff640 1 -- 10.20.193.28:0/1488747751 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8010670 con 0x7fedf0109be0 2026-02-20T03:41:04.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.352+0000 7fedeffff640 1 -- 10.20.193.28:0/1488747751 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf01a8f90 con 0x7fedf0109be0 2026-02-20T03:41:04.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.352+0000 7fedeffff640 1 -- 10.20.193.28:0/1488747751 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf01a9400 con 0x7fedf0109be0 2026-02-20T03:41:04.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.355+0000 7fedcffff640 1 -- 10.20.193.28:0/1488747751 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fedd80040d0 con 0x7fedf0109be0 2026-02-20T03:41:04.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.355+0000 7fedf865be00 1 Processor -- start 2026-02-20T03:41:04.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.355+0000 7fedf865be00 1 -- start start 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.355+0000 7fedf865be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 0x5572b44a9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.355+0000 7fedf865be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a95a0 0x5572b44ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedf865be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44ae780 0x5572b44b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedf865be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572b43fabc0 con 0x5572b44a95a0 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedf865be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5572b43a7fc0 con 0x5572b44a8c60 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedf865be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5572b43f6af0 con 0x5572b44ae780 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedeeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a95a0 0x5572b44ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedeeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a95a0 0x5572b44ae1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52320/0 (socket says 10.20.193.28:52320) 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedeeffd640 1 -- 10.20.193.28:0/1955366608 learned_addr learned my addr 10.20.193.28:0/1955366608 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedee7fc640 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44ae780 0x5572b44b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedef7fe640 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 0x5572b44a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedeeffd640 1 -- 10.20.193.28:0/1955366608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44ae780 msgr2=0x5572b44b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44ae780 0x5572b44b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedeeffd640 1 -- 10.20.193.28:0/1955366608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 msgr2=0x5572b44a9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 0x5572b44a9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedeeffd640 1 -- 10.20.193.28:0/1955366608 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b437e3e0 con 0x5572b44a95a0 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedee7fc640 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44ae780 0x5572b44b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a95a0 0x5572b44ae1b0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7fede4009930 tx=0x7fede4005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d133cf7bfc3edc2 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.356+0000 7fedcffff640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedc40b0fc0 0x7fedc40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedcffff640 1 -- 10.20.193.28:0/1488747751 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fedd80e0fe0 con 0x7fedf0109be0 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedbb7fe640 1 -- 10.20.193.28:0/1955366608 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4046070 con 0x5572b44a95a0 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedef7fe640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedc40b0fc0 0x7fedc40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.362 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedbb7fe640 1 -- 10.20.193.28:0/1955366608 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fede4033040 con 0x5572b44a95a0 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedbb7fe640 1 -- 10.20.193.28:0/1955366608 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede40043b0 con 0x5572b44a95a0 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedf865be00 1 -- 10.20.193.28:0/1955366608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a95a0 msgr2=0x5572b44ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedf865be00 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a95a0 0x5572b44ae1b0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7fede4009930 tx=0x7fede4005e20 comp rx=0 tx=0).stop 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedef7fe640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedc40b0fc0 0x7fedc40b3480 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fedf006c860 tx=0x7fede000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedf865be00 1 -- 10.20.193.28:0/1955366608 shutdown_connections 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedf865be00 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44ae780 0x5572b44b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedf865be00 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a95a0 0x5572b44ae1b0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedf865be00 1 --2- 10.20.193.28:0/1955366608 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 0x5572b44a9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedf865be00 1 -- 10.20.193.28:0/1955366608 >> 10.20.193.28:0/1955366608 conn(0x5572b44a00d0 msgr2=0x5572b44a6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedf865be00 1 -- 10.20.193.28:0/1955366608 shutdown_connections 2026-02-20T03:41:04.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.357+0000 7fedf865be00 1 -- 10.20.193.28:0/1955366608 wait complete. 2026-02-20T03:41:04.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedf865be00 1 -- start start 2026-02-20T03:41:04.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedf865be00 1 Processor -- start 2026-02-20T03:41:04.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedf865be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a8c60 0x5572b44c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedf865be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a95a0 0x5572b44c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedf865be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedf865be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x5572b43a1bb0 con 0x5572b44ae780 2026-02-20T03:41:04.367 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedf865be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x5572b44b1780 con 0x5572b44a95a0 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedf865be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x5572b44c9f20 con 0x5572b44a8c60 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedee7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a95a0 0x5572b44c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedee7fc640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a95a0 0x5572b44c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:47914/0 (socket says 10.20.193.28:47914) 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedee7fc640 1 -- 10.20.193.28:0/1198321617 learned_addr learned my addr 10.20.193.28:0/1198321617 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a8c60 0x5572b44c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.359+0000 7fedef7fe640 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedee7fc640 1 -- 10.20.193.28:0/1198321617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a8c60 msgr2=0x5572b44c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedee7fc640 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a8c60 0x5572b44c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedee7fc640 1 -- 10.20.193.28:0/1198321617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 msgr2=0x5572b44c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedee7fc640 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedee7fc640 1 -- 10.20.193.28:0/1198321617 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b44bb370 con 0x5572b44a95a0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedee7fc640 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a95a0 0x5572b44c2ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fedd80a8a20 tx=0x7fedd80044c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e2b61486b54a63e server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedb8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.126:3300/0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedb8ff9640 1 -- 10.20.193.28:0/1198321617 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80a8420 con 0x5572b44a95a0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedb8ff9640 1 -- 10.20.193.28:0/1198321617 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fedd80c9e50 con 0x5572b44a95a0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedb8ff9640 1 -- 10.20.193.28:0/1198321617 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd80a8240 con 0x5572b44a95a0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedf865be00 1 -- 10.20.193.28:0/1198321617 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b439a040 con 0x5572b44a95a0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedb8ff9640 1 -- 10.20.193.28:0/1198321617 <== mon.2 v2:10.20.193.126:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fedd80e30d0 con 0x5572b44a95a0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedf865be00 10 client.29114 _ll_register_callbacks cb 0x5572b43a5ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedf865be00 1 -- 10.20.193.28:0/1198321617 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5572b44027b0 con 0x5572b44a95a0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.360+0000 7fedb8ff9640 1 -- 10.20.193.28:0/1198321617 <== mon.2 v2:10.20.193.126:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fedd80ad0d0 con 0x5572b44a95a0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedf865be00 10 client.29114 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedf865be00 1 -- 10.20.193.28:0/1198321617 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({fsmap=60}) -- 0x5572b43a0660 con 0x5572b44a95a0 2026-02-20T03:41:04.369 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedb8ff9640 1 -- 10.20.193.28:0/1198321617 <== mon.2 v2:10.20.193.126:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7fedd80cf1b0 con 0x5572b44a95a0 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedf865be00 10 client.29114 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedf865be00 10 client.29114 resolve_mds: validated gid 24538 aka daemon mds.i 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedf865be00 20 client.29114 populate_metadata read hostname 'trial028' 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedf865be00 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5572b44cdef0 0x5572b44d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedf865be00 4 client.29114 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedf865be00 1 -- 10.20.193.28:0/1198321617 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b437c520 con 0x5572b44cdef0 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.361+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5572b44cdef0 0x5572b44d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedb8ff9640 10 client.29114 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5572b44cdef0 0x5572b44d03b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af50a4d171a99a14 server_cookie=9cd716d766e1ddc in_seq=0 out_seq=0 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedb8ff9640 1 -- 10.20.193.28:0/1198321617 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x5572b437c520 con 0x5572b44cdef0 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedb8ff9640 10 client.29114 handle_command_reply: tid=0 2026-02-20T03:41:04.370 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedf865be00 1 client.29114 shutdown 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedf865be00 1 -- 10.20.193.28:0/1198321617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a95a0 msgr2=0x5572b44c2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedf865be00 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a95a0 0x5572b44c2ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fedd80a8a20 tx=0x7fedd80044c0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedf865be00 1 -- 10.20.193.28:0/1198321617 shutdown_connections 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedf865be00 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5572b44cdef0 0x5572b44d03b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedf865be00 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedf865be00 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a95a0 0x5572b44c2ab0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedf865be00 1 --2- 10.20.193.28:0/1198321617 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a8c60 0x5572b44c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedf865be00 1 -- 10.20.193.28:0/1198321617 >> 10.20.193.28:0/1198321617 conn(0x5572b44a00d0 msgr2=0x5572b44afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.362+0000 7fedb8ff9640 0 client.29114 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.363+0000 7fedf865be00 1 -- 10.20.193.28:0/1198321617 shutdown_connections 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.363+0000 7fedf865be00 1 -- 10.20.193.28:0/1198321617 wait complete. 2026-02-20T03:41:04.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.363+0000 7fedf865be00 20 client.29114 trim_cache size 0 max 16384 2026-02-20T03:41:04.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedf865be00 1 Processor -- start 2026-02-20T03:41:04.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedf865be00 1 -- start start 2026-02-20T03:41:04.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedf865be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a8c60 0x5572b44bfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedf865be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a95a0 0x5572b44c0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedf865be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44ae780 0x5572b44c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedf865be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fed94012830 con 0x5572b44a8c60 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedf865be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fed94010040 con 0x5572b44ae780 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedf865be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fed9400de90 con 0x5572b44a95a0 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedeeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a8c60 0x5572b44bfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedeeffd640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a8c60 0x5572b44bfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52348/0 (socket says 10.20.193.28:52348) 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedeeffd640 1 -- 10.20.193.28:0/1993044574 learned_addr learned my addr 10.20.193.28:0/1993044574 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedeeffd640 1 -- 10.20.193.28:0/1993044574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a95a0 msgr2=0x5572b44c0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1993044574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a95a0 0x5572b44c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedef7fe640 1 --2- 10.20.193.28:0/1993044574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44ae780 0x5572b44c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.375 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedeeffd640 1 -- 10.20.193.28:0/1993044574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44ae780 msgr2=0x5572b44c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1993044574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44ae780 0x5572b44c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.371+0000 7fedeeffd640 1 -- 10.20.193.28:0/1993044574 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b44bb1a0 con 0x5572b44a8c60 2026-02-20T03:41:04.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedeeffd640 1 --2- 10.20.193.28:0/1993044574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a8c60 0x5572b44bfb20 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7fede4044040 tx=0x7fede40023d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c29d47cebe5631 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedbaffd640 1 -- 10.20.193.28:0/1993044574 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4046040 con 0x5572b44a8c60 2026-02-20T03:41:04.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedbaffd640 1 -- 10.20.193.28:0/1993044574 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fede4047040 con 0x5572b44a8c60 2026-02-20T03:41:04.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedbaffd640 1 -- 10.20.193.28:0/1993044574 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4005070 con 0x5572b44a8c60 2026-02-20T03:41:04.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedf865be00 1 -- 10.20.193.28:0/1993044574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a8c60 msgr2=0x5572b44bfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedf865be00 1 --2- 10.20.193.28:0/1993044574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a8c60 0x5572b44bfb20 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7fede4044040 tx=0x7fede40023d0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedf865be00 1 -- 10.20.193.28:0/1993044574 shutdown_connections 2026-02-20T03:41:04.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedf865be00 1 --2- 10.20.193.28:0/1993044574 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44ae780 0x5572b44c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedf865be00 1 --2- 10.20.193.28:0/1993044574 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a95a0 0x5572b44c0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedf865be00 1 --2- 10.20.193.28:0/1993044574 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44a8c60 0x5572b44bfb20 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.380 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedf865be00 1 -- 10.20.193.28:0/1993044574 >> 10.20.193.28:0/1993044574 conn(0x5572b44a00d0 msgr2=0x5572b44a6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedf865be00 1 -- 10.20.193.28:0/1993044574 shutdown_connections 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.372+0000 7fedf865be00 1 -- 10.20.193.28:0/1993044574 wait complete. 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedf865be00 1 -- start start 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedf865be00 1 Processor -- start 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedf865be00 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 0x5572b44c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedf865be00 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a95a0 0x5572b44c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedf865be00 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedf865be00 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fed9400e500 con 0x5572b44ae780 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedf865be00 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fed9400f970 con 0x5572b44a8c60 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedf865be00 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fed9400ebd0 con 0x5572b44a95a0 2026-02-20T03:41:04.381 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedef7fe640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52352/0 (socket says 10.20.193.28:52352) 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedef7fe640 1 -- 10.20.193.28:0/326960648 learned_addr learned my addr 10.20.193.28:0/326960648 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedeeffd640 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 0x5572b44c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedee7fc640 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a95a0 0x5572b44c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedef7fe640 1 -- 10.20.193.28:0/326960648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a95a0 msgr2=0x5572b44c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedef7fe640 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a95a0 0x5572b44c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedef7fe640 1 -- 10.20.193.28:0/326960648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 msgr2=0x5572b44c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedef7fe640 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 0x5572b44c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.373+0000 7fedef7fe640 1 -- 10.20.193.28:0/326960648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b4159e90 con 0x5572b44ae780 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedef7fe640 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c8a40 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7fede0007ab0 tx=0x7fede0004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c7e606d67fd415 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedb8ff9640 10 client.0 ms_handle_connect on v2:10.20.193.28:3300/0 2026-02-20T03:41:04.382 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedb8ff9640 1 -- 10.20.193.28:0/326960648 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0028020 con 0x5572b44ae780 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedb8ff9640 1 -- 10.20.193.28:0/326960648 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fede0009e10 con 0x5572b44ae780 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedb8ff9640 1 -- 10.20.193.28:0/326960648 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00156f0 con 0x5572b44ae780 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedf865be00 1 -- 10.20.193.28:0/326960648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b43b5540 con 0x5572b44ae780 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedf865be00 10 client.22527 _ll_register_callbacks cb 0x7fedd800ef50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedf865be00 1 -- 10.20.193.28:0/326960648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fede4033040 con 0x5572b44ae780 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedb8ff9640 1 -- 10.20.193.28:0/326960648 <== mon.0 v2:10.20.193.28:3300/0 4 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fede0024a00 con 0x5572b44ae780 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedb8ff9640 1 -- 10.20.193.28:0/326960648 <== mon.0 v2:10.20.193.28:3300/0 5 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7fede0024440 con 0x5572b44ae780 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedf865be00 10 client.22527 fetch_fsmap learned FSMap version 60 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.374+0000 7fedf865be00 1 -- 10.20.193.28:0/326960648 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({fsmap=60}) -- 0x5572b44bbe90 con 0x5572b44ae780 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.375+0000 7fedb8ff9640 1 -- 10.20.193.28:0/326960648 <== mon.0 v2:10.20.193.28:3300/0 6 ==== fsmap(e 60) ==== 8378+0+0 (secure 0 0 0) 0x7fede00245e0 con 0x5572b44ae780 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.375+0000 7fedf865be00 10 client.22527 fetch_fsmap finished waiting for FSMap version 60 2026-02-20T03:41:04.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.375+0000 7fedf865be00 10 client.22527 resolve_mds: validated gid 24538 aka daemon mds.i 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.375+0000 7fedf865be00 20 client.22527 populate_metadata read hostname 'trial028' 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.375+0000 7fedf865be00 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5572b4539880 0x5572b453bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.375+0000 7fedf865be00 4 client.22527 mds_command: new command op to 24538 tid=0 multi_id=0 [{"prefix": "perf dump", "format": "json-pretty"}] 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.375+0000 7fedf865be00 1 -- 10.20.193.28:0/326960648 --> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] -- command(tid 0: {"prefix": "perf dump", "format": "json-pretty"}) -- 0x5572b41396b0 con 0x5572b4539880 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.375+0000 7fedeeffd640 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5572b4539880 0x5572b453bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedeeffd640 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5572b4539880 0x5572b453bd40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d71e18ee9578ad96 server_cookie=89b02eccf4e2c709 in_seq=0 out_seq=0 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedb8ff9640 10 client.22527 ms_handle_connect on v2:10.20.193.177:6838/1288808268 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedb8ff9640 1 -- 10.20.193.28:0/326960648 <== mds.1 v2:10.20.193.177:6838/1288808268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+18377 (crc 0 0 0) 0x5572b41396b0 con 0x5572b4539880 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedb8ff9640 10 client.22527 handle_command_reply: tid=0 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 client.22527 shutdown 2026-02-20T03:41:04.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 -- 10.20.193.28:0/326960648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 msgr2=0x5572b44c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c8a40 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7fede0007ab0 tx=0x7fede0004bb0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 -- 10.20.193.28:0/326960648 shutdown_connections 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.177:6838/1288808268,v1:10.20.193.177:6839/1288808268] conn(0x5572b4539880 0x5572b453bd40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x5572b44ae780 0x5572b44c8a40 unknown :-1 s=CLOSED pgs=2271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x5572b44a95a0 0x5572b44c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 --2- 10.20.193.28:0/326960648 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x5572b44a8c60 0x5572b44c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 -- 10.20.193.28:0/326960648 >> 10.20.193.28:0/326960648 conn(0x5572b44a00d0 msgr2=0x5572b44beb10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedb8ff9640 0 client.22527 ms_handle_reset on v2:10.20.193.177:6838/1288808268 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 -- 10.20.193.28:0/326960648 shutdown_connections 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 1 -- 10.20.193.28:0/326960648 wait complete. 2026-02-20T03:41:04.385 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.376+0000 7fedf865be00 20 client.22527 trim_cache size 0 max 16384 2026-02-20T03:41:04.386 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:41:04.386 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T03:41:04.386 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-0": { 2026-02-20T03:41:04.386 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 412019, 2026-02-20T03:41:04.386 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 555150, 2026-02-20T03:41:04.386 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 152142796, 2026-02-20T03:41:04.386 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 601461824, 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 103, 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 9, 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 11.254240913, 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 5.323287124, 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 9.729964834, 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.372762776, 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 555147, 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 4.937865375, 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000008894 2026-02-20T03:41:04.387 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 663768, 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.058220932, 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000087 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 144150352, 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 512817280 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-1": { 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 400857, 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 308738, 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 103870146, 2026-02-20T03:41:04.388 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 161773082, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 10, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 5, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 8.335737379, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 3.567364229, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 5.133852241, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.404477001, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 308738, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 2.408435783, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000007800 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T03:41:04.389 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 637391, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.028485927, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000044 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 160, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 661840 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "AsyncMessenger::Worker-2": { 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_messages": 212240, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages": 204293, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_bytes": 56257209, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_bytes": 234837805, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_created_connections": 8, 2026-02-20T03:41:04.390 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_active_connections": 6, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_total_time": 5.465122893, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_send_time": 2.303205346, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_recv_time": 2.608931606, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_running_fast_dispatch_time": 0.697522872, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_messages_queue_lat": { 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 204292, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 2.053334264, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000010050 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_handle_ack_lat": { 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 294506, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.016152884, 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000054 2026-02-20T03:41:04.391 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_recv_encrypted_bytes": 2960, 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "msgr_send_encrypted_bytes": 448 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "cct": { 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "total_workers": 1, 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "unhealthy_workers": 0 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-MDSRank": { 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 89336, 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 41.870796211, 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000468688 2026-02-20T03:41:04.392 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "finisher-PurgeQueue": { 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "queue_len": 0, 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "complete_latency": { 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 65607, 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 2.567880793, 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000039140 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "mds": { 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "request": 263765, 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "reply": 209539, 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "reply_latency": { 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 209539, 2026-02-20T03:41:04.393 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 592.141925366, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002825927 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "slow_reply": 0, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "forward": 54226, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_complete": 0, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "dir_fetch_keys": 0, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "dir_commit": 197, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "dir_split": 19, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "dir_merge": 12, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "inodes": 2842, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_top": 1082, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_bottom": 491, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pin_tail": 1269, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_pinned": 1295, 2026-02-20T03:41:04.394 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_expired": 637, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "inodes_with_caps": 0, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "caps": 0, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "subtrees": 4, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "traverse": 421572, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_hit": 190807, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_forward": 54221, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_discover": 177, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_dir_fetch": 0, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_remote_ino": 0, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "traverse_lock": 3915, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "load_cent": 5560, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "q": 0, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "exported": 8, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "exported_inodes": 270, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "imported": 8, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "imported_inodes": 755, 2026-02-20T03:41:04.395 INFO:teuthology.orchestra.run.trial028.stdout: "openino_dir_fetch": 0, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "openino_backtrace_fetch": 5601, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "openino_peer_discover": 0, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "root_rfiles": 663, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "root_rbytes": 211565411, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "root_rsnaps": 0, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_fetch": 5601, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_set_tag": 0, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_backtrace_repaired": 0, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_inotable_repaired": 0, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_inodes": 556, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dir_base_inodes": 0, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_dirfrag_rstats": 556, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "scrub_file_inodes": 5045, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "handle_inode_file_caps": 71, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_revoke": 11763, 2026-02-20T03:41:04.396 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_grant": 134069, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_trunc": 0, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flushsnap_ack": 0, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_cap_op_flush_ack": 0, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps": 91719, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_caps_dirty": 30574, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_cap_release": 13839, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "process_request_cap_release": 147515 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache": { 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update": 183, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "dir_update_receipt": 952, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "dir_try_discover": 529, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "dir_send_discover": 974, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "dir_handle_discover": 280, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays": 2, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_delayed": 0, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "num_strays_enqueuing": 0, 2026-02-20T03:41:04.397 INFO:teuthology.orchestra.run.trial028.stdout: "strays_created": 34216, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "strays_enqueued": 34214, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "strays_reintegrated": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "strays_migrated": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_processing": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_enqueued": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "num_recovering_prioritized": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_started": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "recovery_completed": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_path": 13, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_quiesce_inode": 1151, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_enqueue_scrub": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_exportdir": 8, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_flush": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragmentdir": 31, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_fragstats": 0, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "ireq_inodestats": 0 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.398 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log": { 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "evlrg": 0, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "evadd": 183473, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "evex": 71372, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "evtrm": 61950, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "ev": 121523, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "evexg": 0, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "evexd": 9422, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "segadd": 211, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "segex": 83, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "segtrm": 73, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "seg": 138, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "segmjr": 8, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "segexg": 0, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "segexd": 10, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "expos": 109060254, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "wrpos": 355956759, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "rdpos": 0, 2026-02-20T03:41:04.399 INFO:teuthology.orchestra.run.trial028.stdout: "jlat": { 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 47114, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 203.630409439, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.004322078 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "replayed": 0 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mem": { 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "ino": 28, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "ino+": 34471, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "ino-": 34443, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "dir": 105, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "dir+": 730, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "dir-": 625, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "dn": 2869, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "dn+": 70566, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "dn-": 67697, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "cap": 0, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "cap+": 40724, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "cap-": 40724, 2026-02-20T03:41:04.400 INFO:teuthology.orchestra.run.trial028.stdout: "rss": 108988, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "heap": 223520 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server": { 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_client_request": 362599, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "dispatch_server_request": 129, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_request": 263765, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "handle_client_session": 2696, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "handle_peer_request": 10081, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "req_create_latency": { 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 33923, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 153.244808446, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.004517430 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "req_getattr_latency": { 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 7978, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 44.630087657, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.005594144 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "req_getfilelock_latency": { 2026-02-20T03:41:04.401 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "req_link_latency": { 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookup_latency": { 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 71131, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 43.600515669, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000612960 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookuphash_latency": { 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.402 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupino_latency": { 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupname_latency": { 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupparent_latency": { 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "req_lookupsnap_latency": { 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.403 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "req_lssnap_latency": { 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "req_mkdir_latency": { 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "req_mknod_latency": { 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "req_mksnap_latency": { 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.404 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "req_open_latency": { 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 3, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000886257, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000295419 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "req_readdir_latency": { 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 55240, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 139.452796075, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.002524489 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "req_rename_latency": { 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 6156, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 22.593711475, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003670193 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "req_renamesnap_latency": { 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.405 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "req_snapdiff_latency": { 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmdir_latency": { 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 30, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.100902001, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.003363400 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmsnap_latency": { 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "req_rmxattr_latency": { 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.406 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "req_setattr_latency": { 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "req_setdirlayout_latency": { 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "req_setfilelock_latency": { 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 892, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.391514899, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000438918 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "req_setlayout_latency": { 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.407 INFO:teuthology.orchestra.run.trial028.stdout: "req_setxattr_latency": { 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "req_symlink_latency": { 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "req_unlink_latency": { 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 34186, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 188.126702887, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.005503033 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "cap_revoke_eviction": 0, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "cap_acquisition_throttle": 0, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "req_getvxattr_latency": { 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.408 INFO:teuthology.orchestra.run.trial028.stdout: "req_blockdiff_latency": { 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessions": { 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "session_count": 1, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "session_add": 2, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "session_remove": 1, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_open": 1, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "sessions_stale": 0, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "total_load": 13187, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "average_load": 13187, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "avg_session_uptime": 1549, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "mdthresh_evicted": 0 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "mempool": { 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_bytes": 0, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "bloom_filter_items": 0, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_bytes": 0, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_items": 0, 2026-02-20T03:41:04.409 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_data_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_onode_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_other_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_buffer_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blob_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_shared_blob_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_inline_bl_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_txc_items": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_bytes": 0, 2026-02-20T03:41:04.410 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_deferred_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_bytes": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_writing_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_bytes": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_bytes": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_reader_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_bytes": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_file_writer_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_bytes": 302694, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_anon_items": 129, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_bytes": 88, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "buffer_meta_items": 1, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bytes": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osd_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_bytes": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mapbl_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_bytes": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pglog_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_bytes": 9344, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_items": 177, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_bytes": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "osdmap_mapping_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_bytes": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "pgmap_items": 0, 2026-02-20T03:41:04.411 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_bytes": 2385258, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "mds_co_items": 31546, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_bytes": 0, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_1_items": 0, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_bytes": 0, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "unittest_2_items": 0 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "objecter": { 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op_active": 0, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op_laggy": 0, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op_send": 124049, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op_send_bytes": 361438254, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op_resend": 27, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op_reply": 124049, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op_latency": { 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 124049, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 1166.317954834, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.009402074 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op_inflight": 0, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "oplen_avg": { 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 124049, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 125343 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op": 124049, 2026-02-20T03:41:04.412 INFO:teuthology.orchestra.run.trial028.stdout: "op_r": 6257, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "op_w": 117792, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "op_rmw": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "op_pg": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_stat": 22, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_create": 61, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_read": 656, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_write": 47770, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writefull": 450, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_writesame": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_append": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_zero": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_truncate": 19, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_delete": 68606, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_mapext": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_sparse_read": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_clonerange": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_getxattr": 5601, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_setxattr": 102, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_cmpxattr": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_rmxattr": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_resetxattrs": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_call": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_watch": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_notify": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_src_cmpxattr": 0, 2026-02-20T03:41:04.413 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_pgls_filter": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "osdop_other": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "linger_active": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "linger_send": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "linger_resend": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "linger_ping": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_active": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_send": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "poolop_resend": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_active": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_send": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "poolstat_resend": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_active": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_send": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "statfs_resend": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "command_active": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "command_send": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "command_resend": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "map_epoch": 99, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "map_full": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "map_inc": 10, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "osd_sessions": 12, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_open": 12, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "osd_session_close": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "osd_laggy": 0, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "omap_wr": 1618, 2026-02-20T03:41:04.414 INFO:teuthology.orchestra.run.trial028.stdout: "omap_rd": 0, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "omap_del": 438 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "oft": { 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_objs": 1, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_kv_pairs": 0, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_updates": 0, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "omap_total_removes": 0 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "osd-slow-ops": { 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "slow_ops_count": 1173 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "purge_queue": { 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops": 0, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_ops_high_water": 16, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing": 0, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executing_high_water": 16, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed_ops": 68400, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "pq_executed": 34214, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "pq_item_in_journal": 0 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-msgr_dispatch_throttler-mds": { 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "get": 1025112, 2026-02-20T03:41:04.415 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 202139288, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 1025112, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "put": 1025112, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 202139288, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_bytes": { 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "max": 104857600, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "take": 124049, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 365167356, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "put": 124049, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 365167356, 2026-02-20T03:41:04.416 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-objecter_ops": { 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "max": 1024, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "get": 0, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 0, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 0, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "take": 124049, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 124049, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "put": 124049, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 124049, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle": { 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.417 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get": 34214, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 3729102, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 34214, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "put": 656, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 3729102, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: }, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "throttle-write_buf_throttle-0x55d0455e8a00": { 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "val": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "max": 3758096384, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get_started": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get": 183473, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get_sum": 351762455, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_fail": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "get_or_fail_success": 183473, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "take": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "take_sum": 0, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "put": 47114, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "put_sum": 351762455, 2026-02-20T03:41:04.418 INFO:teuthology.orchestra.run.trial028.stdout: "wait": { 2026-02-20T03:41:04.419 INFO:teuthology.orchestra.run.trial028.stdout: "avgcount": 0, 2026-02-20T03:41:04.419 INFO:teuthology.orchestra.run.trial028.stdout: "sum": 0.000000000, 2026-02-20T03:41:04.419 INFO:teuthology.orchestra.run.trial028.stdout: "avgtime": 0.000000000 2026-02-20T03:41:04.419 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.419 INFO:teuthology.orchestra.run.trial028.stdout: } 2026-02-20T03:41:04.419 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T03:41:04.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 -- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedc40b0fc0 msgr2=0x7fedc40b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedc40b0fc0 0x7fedc40b3480 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fedf006c860 tx=0x7fede000b040 comp rx=0 tx=0).stop 2026-02-20T03:41:04.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 -- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf0109be0 msgr2=0x7fedf01a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf0109be0 0x7fedf01a1530 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7fedd800ea10 tx=0x7fedd800eee0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 -- 10.20.193.28:0/1488747751 shutdown_connections 2026-02-20T03:41:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fedc40b0fc0 0x7fedc40b3480 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fedf010a540 0x7fedf01a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fedf0109be0 0x7fedf01a1530 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 --2- 10.20.193.28:0/1488747751 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fedf0109220 0x7fedf01a0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 -- 10.20.193.28:0/1488747751 >> 10.20.193.28:0/1488747751 conn(0x7fedf0078080 msgr2=0x7fedf010d670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 -- 10.20.193.28:0/1488747751 shutdown_connections 2026-02-20T03:41:04.420 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:04.377+0000 7fedeffff640 1 -- 10.20.193.28:0/1488747751 wait complete. 2026-02-20T03:41:04.420 INFO:tasks.check_counter:Daemon mds.i mds.exported=8 2026-02-20T03:41:04.420 INFO:tasks.check_counter:Daemon mds.i mds.imported=8 2026-02-20T03:41:04.420 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=183 2026-02-20T03:41:04.420 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=952 2026-02-20T03:41:04.420 DEBUG:tasks.check_counter:Getting stats from l 2026-02-20T03:41:04.421 DEBUG:tasks.check_counter:skipping mds.24478 2026-02-20T03:41:04.421 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2026-02-20T03:41:04.433 INFO:tasks.kclient:Unmounting kernel clients... 2026-02-20T03:41:04.433 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:41:04.433 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T03:41:04.475 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:41:04.475 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T03:41:04.555 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd blocklist ls 2026-02-20T03:41:04.600 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:04 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2842261426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:41:04.717 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:04 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2842261426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:41:04.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:04 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2842261426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:41:04.853 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:05.042 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.039+0000 7f218f385640 1 -- 10.20.193.28:0/1175069016 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2188100680 msgr2=0x7f2188100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:05.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.039+0000 7f218f385640 1 --2- 10.20.193.28:0/1175069016 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2188100680 0x7f2188100a60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2178009a30 tx=0x7f217802f2b0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.039+0000 7f218f385640 1 -- 10.20.193.28:0/1175069016 shutdown_connections 2026-02-20T03:41:05.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.039+0000 7f218f385640 1 --2- 10.20.193.28:0/1175069016 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2188113780 0x7f2188115b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.039+0000 7f218f385640 1 --2- 10.20.193.28:0/1175069016 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2188100fa0 0x7f2188113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.039+0000 7f218f385640 1 --2- 10.20.193.28:0/1175069016 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2188100680 0x7f2188100a60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.039+0000 7f218f385640 1 -- 10.20.193.28:0/1175069016 >> 10.20.193.28:0/1175069016 conn(0x7f21880fc5f0 msgr2=0x7f21880fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:05.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.039+0000 7f218f385640 1 -- 10.20.193.28:0/1175069016 shutdown_connections 2026-02-20T03:41:05.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.039+0000 7f218f385640 1 -- 10.20.193.28:0/1175069016 wait complete. 2026-02-20T03:41:05.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218f385640 1 Processor -- start 2026-02-20T03:41:05.044 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218f385640 1 -- start start 2026-02-20T03:41:05.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218f385640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2188100680 0x7f21881a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:05.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218f385640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2188100fa0 0x7f21881a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:05.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218f385640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2188113780 0x7f21881a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:05.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218f385640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f21881190b0 con 0x7f2188100fa0 2026-02-20T03:41:05.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218f385640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2188118f30 con 0x7f2188113780 2026-02-20T03:41:05.045 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218f385640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2188119230 con 0x7f2188100680 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218db82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2188100fa0 0x7f21881a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218e383640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2188100680 0x7f21881a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218db82640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2188100fa0 0x7f21881a1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:52362/0 (socket says 10.20.193.28:52362) 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218db82640 1 -- 10.20.193.28:0/3512494609 learned_addr learned my addr 10.20.193.28:0/3512494609 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.040+0000 7f218e383640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2188100680 0x7f21881a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:52156/0 (socket says 10.20.193.28:52156) 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f218db82640 1 -- 10.20.193.28:0/3512494609 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2188100680 msgr2=0x7f21881a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f218db82640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2188100680 0x7f21881a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f218db82640 1 -- 10.20.193.28:0/3512494609 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2188113780 msgr2=0x7f21881a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f218db82640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2188113780 0x7f21881a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f218db82640 1 -- 10.20.193.28:0/3512494609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21881a6680 con 0x7f2188100fa0 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f218db82640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2188100fa0 0x7f21881a1b70 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f217c00ea10 tx=0x7f217c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:05.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f216f7fe640 1 -- 10.20.193.28:0/3512494609 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c00ce50 con 0x7f2188100fa0 2026-02-20T03:41:05.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21881a6970 con 0x7f2188100fa0 2026-02-20T03:41:05.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f216f7fe640 1 -- 10.20.193.28:0/3512494609 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f217c004570 con 0x7f2188100fa0 2026-02-20T03:41:05.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f216f7fe640 1 -- 10.20.193.28:0/3512494609 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c010690 con 0x7f2188100fa0 2026-02-20T03:41:05.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.041+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21881ae1b0 con 0x7f2188100fa0 2026-02-20T03:41:05.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.042+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2188100a60 con 0x7f2188100fa0 2026-02-20T03:41:05.047 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.044+0000 7f216f7fe640 1 -- 10.20.193.28:0/3512494609 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f217c020030 con 0x7f2188100fa0 2026-02-20T03:41:05.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.045+0000 7f216f7fe640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21640b0fc0 0x7f21640b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:05.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.045+0000 7f216f7fe640 1 -- 10.20.193.28:0/3512494609 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f217c0e0c70 con 0x7f2188100fa0 2026-02-20T03:41:05.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.046+0000 7f218e383640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21640b0fc0 0x7f21640b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:05.048 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.046+0000 7f216f7fe640 1 -- 10.20.193.28:0/3512494609 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f217c0a9050 con 0x7f2188100fa0 2026-02-20T03:41:05.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.046+0000 7f218e383640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21640b0fc0 0x7f21640b3480 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2178002410 tx=0x7f2178005950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:05.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.141+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f21880fdc20 con 0x7f2188100fa0 2026-02-20T03:41:05.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.141+0000 7f216f7fe640 1 -- 10.20.193.28:0/3512494609 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v99) ==== 81+0+589 (secure 0 0 0) 0x7f217c0acd00 con 0x7f2188100fa0 2026-02-20T03:41:05.144 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/732750991 2026-02-21T03:11:25.971161+0000 2026-02-20T03:41:05.144 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/732750991 2026-02-21T03:11:25.971161+0000 2026-02-20T03:41:05.144 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2248669804 2026-02-21T03:11:25.971161+0000 2026-02-20T03:41:05.145 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/3377311556 2026-02-21T03:11:25.971161+0000 2026-02-20T03:41:05.145 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1349207449 2026-02-21T03:11:14.750053+0000 2026-02-20T03:41:05.145 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/613688684 2026-02-21T03:11:14.750053+0000 2026-02-20T03:41:05.145 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6801/1032320093 2026-02-21T03:11:14.750053+0000 2026-02-20T03:41:05.145 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:6800/1032320093 2026-02-21T03:11:14.750053+0000 2026-02-20T03:41:05.145 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/1867592854 2026-02-21T03:11:25.971161+0000 2026-02-20T03:41:05.145 INFO:teuthology.orchestra.run.trial028.stdout:10.20.193.28:0/2481417757 2026-02-21T03:11:14.750053+0000 2026-02-20T03:41:05.146 INFO:teuthology.orchestra.run.trial028.stderr:listed 10 entries 2026-02-20T03:41:05.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21640b0fc0 msgr2=0x7f21640b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:05.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21640b0fc0 0x7f21640b3480 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2178002410 tx=0x7f2178005950 comp rx=0 tx=0).stop 2026-02-20T03:41:05.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2188100fa0 msgr2=0x7f21881a1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:05.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2188100fa0 0x7f21881a1b70 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f217c00ea10 tx=0x7f217c00eee0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 shutdown_connections 2026-02-20T03:41:05.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f21640b0fc0 0x7f21640b3480 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2188113780 0x7f21881a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2188100fa0 0x7f21881a1b70 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 --2- 10.20.193.28:0/3512494609 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2188100680 0x7f21881a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:05.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 >> 10.20.193.28:0/3512494609 conn(0x7f21880fc5f0 msgr2=0x7f2188114fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:05.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 shutdown_connections 2026-02-20T03:41:05.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:05.142+0000 7f218f385640 1 -- 10.20.193.28:0/3512494609 wait complete. 2026-02-20T03:41:05.243 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2026-02-20T03:41:05.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:41:05.244 DEBUG:teuthology.orchestra.run.trial028:> sudo umount /home/ubuntu/cephtest/mnt.0 2026-02-20T03:41:05.381 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial028.front.sepia.ceph.com 2026-02-20T03:41:05.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:41:05.382 DEBUG:teuthology.orchestra.run.trial028:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2026-02-20T03:41:05.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:41:05.431 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-20T03:41:05.477 INFO:teuthology.orchestra.run.trial028.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2026-02-20T03:41:05.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:41:05.478 DEBUG:teuthology.orchestra.run.trial028:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-20T03:41:05.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:41:05.578 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link delete ceph-brx 2026-02-20T03:41:05.677 INFO:tasks.kclient:Unmounting kernel clients... 2026-02-20T03:41:05.677 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T03:41:05.677 DEBUG:teuthology.orchestra.run.trial028:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-20T03:41:05.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=65179128k,nr_inodes=16294782,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=26089668k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 none /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 efivarfs /sys/firmware/efi/efivars efivarfs rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 /dev/nvme2n1p2 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/nvme2n1p1 /boot/efi vfat rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=ascii,shortname=mixed,errors=remount-ro 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=13044832k,nr_inodes=3261208,mode=700,uid=1000,gid=1002 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/nvme2n1p2 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/4faec576b1b01c6cf62144769ab600e012561d914788fe8ae5ec18f4209d4b0e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/4faec576b1b01c6cf62144769ab600e012561d914788fe8ae5ec18f4209d4b0e/diff,workdir=/var/lib/containers/storage/overlay/4faec576b1b01c6cf62144769ab600e012561d914788fe8ae5ec18f4209d4b0e/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0339323f652315e561ee280d9023689e6844882abdebe9fb0bd53862450c2e32/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/0339323f652315e561ee280d9023689e6844882abdebe9fb0bd53862450c2e32/diff,workdir=/var/lib/containers/storage/overlay/0339323f652315e561ee280d9023689e6844882abdebe9fb0bd53862450c2e32/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=13044832k,nr_inodes=3261208,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/03b45f7d81395a93268fd1487f41f903f0266b70021d2803740d395d94ee8a1a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/03b45f7d81395a93268fd1487f41f903f0266b70021d2803740d395d94ee8a1a/diff,workdir=/var/lib/containers/storage/overlay/03b45f7d81395a93268fd1487f41f903f0266b70021d2803740d395d94ee8a1a/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3c2456bfc84eaca098ff1708354414b11baadf261421ed1d2608f58bda09ec0b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/3c2456bfc84eaca098ff1708354414b11baadf261421ed1d2608f58bda09ec0b/diff,workdir=/var/lib/containers/storage/overlay/3c2456bfc84eaca098ff1708354414b11baadf261421ed1d2608f58bda09ec0b/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c471d97931fdfe7e30628c1a66d14ba1520740ccf5ecafeaa89d097abb523cb5/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/c471d97931fdfe7e30628c1a66d14ba1520740ccf5ecafeaa89d097abb523cb5/diff,workdir=/var/lib/containers/storage/overlay/c471d97931fdfe7e30628c1a66d14ba1520740ccf5ecafeaa89d097abb523cb5/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/54200644b06edd5027864ae6471599d8265278fec638f5de33871eab5c69b25f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/54200644b06edd5027864ae6471599d8265278fec638f5de33871eab5c69b25f/diff,workdir=/var/lib/containers/storage/overlay/54200644b06edd5027864ae6471599d8265278fec638f5de33871eab5c69b25f/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/dbbd8fe4415bc52da1a114c4983b28ba52b9c89824f14a6f906f75674d094a31/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/dbbd8fe4415bc52da1a114c4983b28ba52b9c89824f14a6f906f75674d094a31/diff,workdir=/var/lib/containers/storage/overlay/dbbd8fe4415bc52da1a114c4983b28ba52b9c89824f14a6f906f75674d094a31/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/20f8691a6d1a23cbe006d26e3d7f2e8aef27f13a6caa105c429ca855d52732ff/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/20f8691a6d1a23cbe006d26e3d7f2e8aef27f13a6caa105c429ca855d52732ff/diff,workdir=/var/lib/containers/storage/overlay/20f8691a6d1a23cbe006d26e3d7f2e8aef27f13a6caa105c429ca855d52732ff/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b1da5466f201aa08b06cde1b89e88ca5a6a822d151705c322320e27affb97ee6/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/b1da5466f201aa08b06cde1b89e88ca5a6a822d151705c322320e27affb97ee6/diff,workdir=/var/lib/containers/storage/overlay/b1da5466f201aa08b06cde1b89e88ca5a6a822d151705c322320e27affb97ee6/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a34cdc453ac3749eae04a1cabfaa08a321bface1e2eb723570191cde8ebea90c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/RCA3J4OEGGSIQTJOSQSDAJQTVG:/var/lib/containers/storage/overlay/l/RE7QHM6RV2MDZKW4BTO47QK4CV,upperdir=/var/lib/containers/storage/overlay/a34cdc453ac3749eae04a1cabfaa08a321bface1e2eb723570191cde8ebea90c/diff,workdir=/var/lib/containers/storage/overlay/a34cdc453ac3749eae04a1cabfaa08a321bface1e2eb723570191cde8ebea90c/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=26089668k,nr_inodes=819200,mode=755 0 0 2026-02-20T03:41:05.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:41:05.720 DEBUG:teuthology.orchestra.run.trial028:> ip netns list 2026-02-20T03:41:05.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:05 trial177 ceph-mon[43181]: pgmap v978: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 287 KiB/s rd, 304 KiB/s wr, 162 op/s 2026-02-20T03:41:05.721 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:05 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3512494609' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T03:41:05.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-20T03:41:05.799 DEBUG:teuthology.orchestra.run.trial028:> sudo ip link delete ceph-brx 2026-02-20T03:41:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:05 trial126 ceph-mon[38476]: pgmap v978: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 287 KiB/s rd, 304 KiB/s wr, 162 op/s 2026-02-20T03:41:05.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:05 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3512494609' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T03:41:05.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:05 trial028 ceph-mon[38552]: pgmap v978: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 287 KiB/s rd, 304 KiB/s wr, 162 op/s 2026-02-20T03:41:05.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:05 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3512494609' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-20T03:41:05.900 INFO:teuthology.orchestra.run.trial028.stderr:Cannot find device "ceph-brx" 2026-02-20T03:41:05.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:41:05.903 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-20T03:41:05.920 INFO:tasks.cephadm:Teardown begin 2026-02-20T03:41:05.921 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2026-02-20T03:41:05.921 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:41:06.209 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:06.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.391+0000 7f8a4f577640 1 -- 10.20.193.28:0/988463109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a50074ac0 msgr2=0x7f8a50116ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.391+0000 7f8a4f577640 1 --2- 10.20.193.28:0/988463109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a50074ac0 0x7f8a50116ea0 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000b0d0 tx=0x7f8a4002f450 comp rx=0 tx=0).stop 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.391+0000 7f8a4f577640 1 -- 10.20.193.28:0/988463109 shutdown_connections 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.391+0000 7f8a4f577640 1 --2- 10.20.193.28:0/988463109 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a50074ac0 0x7f8a50116ea0 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.391+0000 7f8a4f577640 1 --2- 10.20.193.28:0/988463109 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a50074120 0x7f8a50074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.391+0000 7f8a4f577640 1 --2- 10.20.193.28:0/988463109 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a5010f000 0x7f8a5010f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.391+0000 7f8a4f577640 1 -- 10.20.193.28:0/988463109 >> 10.20.193.28:0/988463109 conn(0x7f8a5006efb0 msgr2=0x7f8a5006f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.391+0000 7f8a4f577640 1 -- 10.20.193.28:0/988463109 shutdown_connections 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.391+0000 7f8a4f577640 1 -- 10.20.193.28:0/988463109 wait complete. 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4f577640 1 Processor -- start 2026-02-20T03:41:06.395 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4f577640 1 -- start start 2026-02-20T03:41:06.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4f577640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a50074120 0x7f8a501ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:06.397 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4f577640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a50074ac0 0x7f8a501abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4f577640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a5010f000 0x7f8a501a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4f577640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5011a210 con 0x7f8a5010f000 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4f577640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5011a090 con 0x7f8a50074ac0 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4f577640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5011a390 con 0x7f8a50074120 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4e575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a50074120 0x7f8a501ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a5010f000 0x7f8a501a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4ed76640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a5010f000 0x7f8a501a57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37340/0 (socket says 10.20.193.28:37340) 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4ed76640 1 -- 10.20.193.28:0/2953594772 learned_addr learned my addr 10.20.193.28:0/2953594772 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.392+0000 7f8a4dd74640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a50074ac0 0x7f8a501abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a4ed76640 1 -- 10.20.193.28:0/2953594772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a50074120 msgr2=0x7f8a501ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:06.398 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a4ed76640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a50074120 0x7f8a501ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a4ed76640 1 -- 10.20.193.28:0/2953594772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a50074ac0 msgr2=0x7f8a501abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a4ed76640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a50074ac0 0x7f8a501abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a4ed76640 1 -- 10.20.193.28:0/2953594772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a501a5fe0 con 0x7f8a5010f000 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a4ed76640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a5010f000 0x7f8a501a57b0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006030 tx=0x7f8a40009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a377fe640 1 -- 10.20.193.28:0/2953594772 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400044e0 con 0x7f8a5010f000 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a377fe640 1 -- 10.20.193.28:0/2953594772 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f8a40004680 con 0x7f8a5010f000 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a501a6270 con 0x7f8a5010f000 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.393+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a501b2490 con 0x7f8a5010f000 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.394+0000 7f8a377fe640 1 -- 10.20.193.28:0/2953594772 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400387a0 con 0x7f8a5010f000 2026-02-20T03:41:06.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.394+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5010b7d0 con 0x7f8a5010f000 2026-02-20T03:41:06.400 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.396+0000 7f8a377fe640 1 -- 10.20.193.28:0/2953594772 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f8a40047030 con 0x7f8a5010f000 2026-02-20T03:41:06.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.398+0000 7f8a377fe640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a280b0da0 0x7f8a280b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:06.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.398+0000 7f8a377fe640 1 -- 10.20.193.28:0/2953594772 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f8a40104db0 con 0x7f8a5010f000 2026-02-20T03:41:06.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.398+0000 7f8a377fe640 1 -- 10.20.193.28:0/2953594772 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f8a401052d0 con 0x7f8a5010f000 2026-02-20T03:41:06.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.398+0000 7f8a4e575640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a280b0da0 0x7f8a280b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:06.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.399+0000 7f8a4e575640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a280b0da0 0x7f8a280b3260 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007bc0 tx=0x7f8a440073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:06.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.507+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a501b2660 con 0x7f8a5010f000 2026-02-20T03:41:06.511 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.508+0000 7f8a377fe640 1 -- 10.20.193.28:0/2953594772 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+11927 (secure 0 0 0) 0x7f8a400cd1f0 con 0x7f8a5010f000 2026-02-20T03:41:06.511 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:41:06.511 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":60,"btime":"2026-02-20T03:40:59:436190+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":60,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:40:59.183075+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:41:06.512 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 60 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a280b0da0 msgr2=0x7f8a280b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a280b0da0 0x7f8a280b3260 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8a44007bc0 tx=0x7f8a440073d0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a5010f000 msgr2=0x7f8a501a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a5010f000 0x7f8a501a57b0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f8a40006030 tx=0x7f8a40009370 comp rx=0 tx=0).stop 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 shutdown_connections 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f8a280b0da0 0x7f8a280b3260 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f8a5010f000 0x7f8a501a57b0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f8a50074ac0 0x7f8a501abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 --2- 10.20.193.28:0/2953594772 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f8a50074120 0x7f8a501ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 >> 10.20.193.28:0/2953594772 conn(0x7f8a5006efb0 msgr2=0x7f8a50071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:06.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 shutdown_connections 2026-02-20T03:41:06.514 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:06.509+0000 7f8a4f577640 1 -- 10.20.193.28:0/2953594772 wait complete. 2026-02-20T03:41:06.616 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs dump --format=json 2026-02-20T03:41:06.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:06 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2953594772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:41:06.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:06 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2953594772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:41:06.882 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:06.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:06 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2953594772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:41:07.061 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.058+0000 7f3072912640 1 -- 10.20.193.28:0/1059216593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306c1030a0 msgr2=0x7f306c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.058+0000 7f3072912640 1 --2- 10.20.193.28:0/1059216593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306c1030a0 0x7f306c10f5d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3068009f90 tx=0x7f306802f390 comp rx=0 tx=0).stop 2026-02-20T03:41:07.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.059+0000 7f3072912640 1 -- 10.20.193.28:0/1059216593 shutdown_connections 2026-02-20T03:41:07.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.059+0000 7f3072912640 1 --2- 10.20.193.28:0/1059216593 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306c1030a0 0x7f306c10f5d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.059+0000 7f3072912640 1 --2- 10.20.193.28:0/1059216593 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f306c102700 0x7f306c102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.059+0000 7f3072912640 1 --2- 10.20.193.28:0/1059216593 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f306c108700 0x7f306c108ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.059+0000 7f3072912640 1 -- 10.20.193.28:0/1059216593 >> 10.20.193.28:0/1059216593 conn(0x7f306c0fe440 msgr2=0x7f306c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:07.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.059+0000 7f3072912640 1 -- 10.20.193.28:0/1059216593 shutdown_connections 2026-02-20T03:41:07.062 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.059+0000 7f3072912640 1 -- 10.20.193.28:0/1059216593 wait complete. 2026-02-20T03:41:07.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.059+0000 7f3072912640 1 Processor -- start 2026-02-20T03:41:07.064 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.059+0000 7f3072912640 1 -- start start 2026-02-20T03:41:07.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3072912640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f306c102700 0x7f306c19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:07.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3072912640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306c1030a0 0x7f306c19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:07.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3072912640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f306c108700 0x7f306c19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:07.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3072912640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f306c112970 con 0x7f306c108700 2026-02-20T03:41:07.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3072912640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f306c1127f0 con 0x7f306c1030a0 2026-02-20T03:41:07.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3072912640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f306c112af0 con 0x7f306c102700 2026-02-20T03:41:07.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3071910640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f306c102700 0x7f306c19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:07.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3071910640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f306c102700 0x7f306c19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.177:3300/0 says I am v2:10.20.193.28:57138/0 (socket says 10.20.193.28:57138) 2026-02-20T03:41:07.065 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3071910640 1 -- 10.20.193.28:0/3257474433 learned_addr learned my addr 10.20.193.28:0/3257474433 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f307110f640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306c1030a0 0x7f306c19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3072111640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f306c108700 0x7f306c19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3071910640 1 -- 10.20.193.28:0/3257474433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306c1030a0 msgr2=0x7f306c19b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3071910640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306c1030a0 0x7f306c19b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3071910640 1 -- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f306c108700 msgr2=0x7f306c19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3071910640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f306c108700 0x7f306c19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.060+0000 7f3071910640 1 -- 10.20.193.28:0/3257474433 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c19fd70 con 0x7f306c102700 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.061+0000 7f3071910640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f306c102700 0x7f306c19ad20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f305c00ea30 tx=0x7f305c00ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.061+0000 7f305affd640 1 -- 10.20.193.28:0/3257474433 <== mon.1 v2:10.20.193.177:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c00ce50 con 0x7f306c102700 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.061+0000 7f305affd640 1 -- 10.20.193.28:0/3257474433 <== mon.1 v2:10.20.193.177:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f305c004570 con 0x7f306c102700 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.061+0000 7f305affd640 1 -- 10.20.193.28:0/3257474433 <== mon.1 v2:10.20.193.177:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c010690 con 0x7f306c102700 2026-02-20T03:41:07.066 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.061+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c1a0060 con 0x7f306c102700 2026-02-20T03:41:07.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.061+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c1a78a0 con 0x7f306c102700 2026-02-20T03:41:07.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.061+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306c102b60 con 0x7f306c102700 2026-02-20T03:41:07.067 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.064+0000 7f305affd640 1 -- 10.20.193.28:0/3257474433 <== mon.1 v2:10.20.193.177:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f305c002920 con 0x7f306c102700 2026-02-20T03:41:07.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.065+0000 7f305affd640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30480b0da0 0x7f30480b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:07.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.065+0000 7f305affd640 1 -- 10.20.193.28:0/3257474433 <== mon.1 v2:10.20.193.177:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f305c0e0f80 con 0x7f306c102700 2026-02-20T03:41:07.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.066+0000 7f307110f640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30480b0da0 0x7f30480b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:07.068 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.066+0000 7f305affd640 1 -- 10.20.193.28:0/3257474433 <== mon.1 v2:10.20.193.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f305c0e1400 con 0x7f306c102700 2026-02-20T03:41:07.069 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.066+0000 7f307110f640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30480b0da0 0x7f30480b3260 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f306c100a10 tx=0x7f3060009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:07.174 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.172+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f306c10a720 con 0x7f306c102700 2026-02-20T03:41:07.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.172+0000 7f305affd640 1 -- 10.20.193.28:0/3257474433 <== mon.1 v2:10.20.193.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+11927 (secure 0 0 0) 0x7f305c0a9360 con 0x7f306c102700 2026-02-20T03:41:07.176 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:41:07.176 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":60,"btime":"2026-02-20T03:40:59:436190+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14472,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6837/3766105703","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6836","nonce":3766105703},{"type":"v1","addr":"10.20.193.28:6837","nonce":3766105703}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14499,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6839/4204022790","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6838","nonce":4204022790},{"type":"v1","addr":"10.20.193.28:6839","nonce":4204022790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14511,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6841/3872820740","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6840","nonce":3872820740},{"type":"v1","addr":"10.20.193.28:6841","nonce":3872820740}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24478,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.177:6833/3775040244","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6832","nonce":3775040244},{"type":"v1","addr":"10.20.193.177:6833","nonce":3775040244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24494,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.126:6833/304296049","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6832","nonce":304296049},{"type":"v1","addr":"10.20.193.126:6833","nonce":304296049}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24496,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.28:6835/612573094","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6834","nonce":612573094},{"type":"v1","addr":"10.20.193.28:6835","nonce":612573094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":60,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-20T03:14:32.740764+0000","modified":"2026-02-20T03:40:59.183075+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24560,"mds_1":24538,"mds_2":24533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24515":{"gid":24515,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.126:6835/2797409986","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6834","nonce":2797409986},{"type":"v1","addr":"10.20.193.126:6835","nonce":2797409986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6835/2041071245","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6834","nonce":2041071245},{"type":"v1","addr":"10.20.193.177:6835","nonce":2041071245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":8,"addr":"10.20.193.126:6837/1802675915","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6836","nonce":1802675915},{"type":"v1","addr":"10.20.193.126:6837","nonce":1802675915}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":8,"addr":"10.20.193.177:6839/1288808268","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6838","nonce":1288808268},{"type":"v1","addr":"10.20.193.177:6839","nonce":1288808268}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.126:6839/2074063114","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6838","nonce":2074063114},{"type":"v1","addr":"10.20.193.126:6839","nonce":2074063114}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_28330":{"gid":28330,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.177:6837/201170198","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6836","nonce":201170198},{"type":"v1","addr":"10.20.193.177:6837","nonce":201170198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24533,24538,24560]},"id":1}]} 2026-02-20T03:41:07.177 INFO:teuthology.orchestra.run.trial028.stderr:dumped fsmap epoch 60 2026-02-20T03:41:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30480b0da0 msgr2=0x7f30480b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30480b0da0 0x7f30480b3260 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f306c100a10 tx=0x7f3060009290 comp rx=0 tx=0).stop 2026-02-20T03:41:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f306c102700 msgr2=0x7f306c19ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f306c102700 0x7f306c19ad20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f305c00ea30 tx=0x7f305c00ef00 comp rx=0 tx=0).stop 2026-02-20T03:41:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 shutdown_connections 2026-02-20T03:41:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f30480b0da0 0x7f30480b3260 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f306c108700 0x7f306c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f306c1030a0 0x7f306c19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 --2- 10.20.193.28:0/3257474433 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f306c102700 0x7f306c19ad20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 >> 10.20.193.28:0/3257474433 conn(0x7f306c0fe440 msgr2=0x7f306c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 shutdown_connections 2026-02-20T03:41:07.178 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.173+0000 7f3072912640 1 -- 10.20.193.28:0/3257474433 wait complete. 2026-02-20T03:41:07.274 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd dump --format=json 2026-02-20T03:41:07.541 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:07.574 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:07 trial028 ceph-mon[38552]: pgmap v979: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 285 KiB/s rd, 302 KiB/s wr, 161 op/s 2026-02-20T03:41:07.574 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:07 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3257474433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:41:07.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.727+0000 7fdf48ec3640 1 -- 10.20.193.28:0/2328513074 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf44109ed0 msgr2=0x7fdf44111a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.727+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/2328513074 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf44109ed0 0x7fdf44111a50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400b0a0 tx=0x7fdf3402f450 comp rx=0 tx=0).stop 2026-02-20T03:41:07.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.727+0000 7fdf48ec3640 1 -- 10.20.193.28:0/2328513074 shutdown_connections 2026-02-20T03:41:07.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.727+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/2328513074 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf44109ed0 0x7fdf44111a50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.727+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/2328513074 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdf44105750 0x7fdf441097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.727+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/2328513074 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf44104da0 0x7fdf44105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.727+0000 7fdf48ec3640 1 -- 10.20.193.28:0/2328513074 >> 10.20.193.28:0/2328513074 conn(0x7fdf44100840 msgr2=0x7fdf44102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:07.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.727+0000 7fdf48ec3640 1 -- 10.20.193.28:0/2328513074 shutdown_connections 2026-02-20T03:41:07.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.727+0000 7fdf48ec3640 1 -- 10.20.193.28:0/2328513074 wait complete. 2026-02-20T03:41:07.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf48ec3640 1 Processor -- start 2026-02-20T03:41:07.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf48ec3640 1 -- start start 2026-02-20T03:41:07.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf48ec3640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf44104da0 0x7fdf4419d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:07.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf48ec3640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf44105750 0x7fdf4419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:07.733 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf48ec3640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdf44109ed0 0x7fdf441a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:07.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf48ec3640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7fdf44114da0 con 0x7fdf44105750 2026-02-20T03:41:07.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf48ec3640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7fdf44114c20 con 0x7fdf44109ed0 2026-02-20T03:41:07.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf48ec3640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7fdf44114f20 con 0x7fdf44104da0 2026-02-20T03:41:07.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf41d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf44105750 0x7fdf4419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:07.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf42575640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf44104da0 0x7fdf4419d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:07.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf41d74640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf44105750 0x7fdf4419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37386/0 (socket says 10.20.193.28:37386) 2026-02-20T03:41:07.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf41d74640 1 -- 10.20.193.28:0/533222946 learned_addr learned my addr 10.20.193.28:0/533222946 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:07.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.728+0000 7fdf42d76640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdf44109ed0 0x7fdf441a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:07.734 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf41d74640 1 -- 10.20.193.28:0/533222946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf44104da0 msgr2=0x7fdf4419d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf41d74640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf44104da0 0x7fdf4419d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf41d74640 1 -- 10.20.193.28:0/533222946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdf44109ed0 msgr2=0x7fdf441a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf41d74640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdf44109ed0 0x7fdf441a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf41d74640 1 -- 10.20.193.28:0/533222946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf441a2170 con 0x7fdf44105750 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf41d74640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf44105750 0x7fdf4419d660 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00d980 tx=0x7fdf2c00de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf2b7fe640 1 -- 10.20.193.28:0/533222946 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c014070 con 0x7fdf44105750 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf441a2460 con 0x7fdf44105750 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf2b7fe640 1 -- 10.20.193.28:0/533222946 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7fdf2c0044e0 con 0x7fdf44105750 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf2b7fe640 1 -- 10.20.193.28:0/533222946 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c005080 con 0x7fdf44105750 2026-02-20T03:41:07.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.729+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf441a9ca0 con 0x7fdf44105750 2026-02-20T03:41:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.730+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf44105180 con 0x7fdf44105750 2026-02-20T03:41:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.732+0000 7fdf2b7fe640 1 -- 10.20.193.28:0/533222946 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7fdf2c0047c0 con 0x7fdf44105750 2026-02-20T03:41:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.733+0000 7fdf2b7fe640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdf1c0b0e20 0x7fdf1c0b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.733+0000 7fdf2b7fe640 1 -- 10.20.193.28:0/533222946 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7fdf2c0e0c80 con 0x7fdf44105750 2026-02-20T03:41:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.734+0000 7fdf42575640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdf1c0b0e20 0x7fdf1c0b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.734+0000 7fdf2b7fe640 1 -- 10.20.193.28:0/533222946 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7fdf2c0e1100 con 0x7fdf44105750 2026-02-20T03:41:07.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.734+0000 7fdf42575640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdf1c0b0e20 0x7fdf1c0b32e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdf380096f0 tx=0x7fdf38009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:07.832 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.830+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf4410cba0 con 0x7fdf44105750 2026-02-20T03:41:07.833 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.830+0000 7fdf2b7fe640 1 -- 10.20.193.28:0/533222946 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) ==== 74+0+25081 (secure 0 0 0) 0x7fdf2c0a9060 con 0x7fdf44105750 2026-02-20T03:41:07.834 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T03:41:07.835 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":99,"fsid":"bfaff8d7-0e09-11f1-8045-d404e6e7d460","created":"2026-02-20T03:11:02.801601+0000","modified":"2026-02-20T03:32:40.803568+0000","last_up_change":"2026-02-20T03:14:13.484298+0000","last_in_change":"2026-02-20T03:13:58.804226+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T03:12:36.019995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-20T03:14:30.208166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-20T03:14:31.725985+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2026-02-20T03:14:35.302631+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5757792c-caf3-4397-a245-e9ff471749a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6803","nonce":1632554659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6805","nonce":1632554659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6808","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6809","nonce":1632554659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":1632554659},{"type":"v1","addr":"10.20.193.28:6807","nonce":1632554659}]},"public_addr":"10.20.193.28:6803/1632554659","cluster_addr":"10.20.193.28:6805/1632554659","heartbeat_back_addr":"10.20.193.28:6809/1632554659","heartbeat_front_addr":"10.20.193.28:6807/1632554659","state":["exists","up"]},{"osd":1,"uuid":"452bcc43-d4da-471e-8823-6ba9c2de8105","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6800","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6801","nonce":2836649908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6802","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6803","nonce":2836649908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6806","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6807","nonce":2836649908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6804","nonce":2836649908},{"type":"v1","addr":"10.20.193.126:6805","nonce":2836649908}]},"public_addr":"10.20.193.126:6801/2836649908","cluster_addr":"10.20.193.126:6803/2836649908","heartbeat_back_addr":"10.20.193.126:6807/2836649908","heartbeat_front_addr":"10.20.193.126:6805/2836649908","state":["exists","up"]},{"osd":2,"uuid":"636c4c98-006a-4471-98ba-d570c4b7963a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6800","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6801","nonce":674314820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6802","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6803","nonce":674314820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6806","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6807","nonce":674314820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6804","nonce":674314820},{"type":"v1","addr":"10.20.193.177:6805","nonce":674314820}]},"public_addr":"10.20.193.177:6801/674314820","cluster_addr":"10.20.193.177:6803/674314820","heartbeat_back_addr":"10.20.193.177:6807/674314820","heartbeat_front_addr":"10.20.193.177:6805/674314820","state":["exists","up"]},{"osd":3,"uuid":"c1cd8b22-5eaf-41e1-80be-dd3d856859b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6810","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6811","nonce":770811326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6812","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6813","nonce":770811326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6816","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6817","nonce":770811326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6814","nonce":770811326},{"type":"v1","addr":"10.20.193.28:6815","nonce":770811326}]},"public_addr":"10.20.193.28:6811/770811326","cluster_addr":"10.20.193.28:6813/770811326","heartbeat_back_addr":"10.20.193.28:6817/770811326","heartbeat_front_addr":"10.20.193.28:6815/770811326","state":["exists","up"]},{"osd":4,"uuid":"4e6bd944-356d-40ba-8586-50792c78360e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6808","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6809","nonce":1455790264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6810","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6811","nonce":1455790264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6814","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6815","nonce":1455790264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6812","nonce":1455790264},{"type":"v1","addr":"10.20.193.126:6813","nonce":1455790264}]},"public_addr":"10.20.193.126:6809/1455790264","cluster_addr":"10.20.193.126:6811/1455790264","heartbeat_back_addr":"10.20.193.126:6815/1455790264","heartbeat_front_addr":"10.20.193.126:6813/1455790264","state":["exists","up"]},{"osd":5,"uuid":"c9a1fa82-3f5c-4507-b5a5-2b7533b9d7f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6808","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6809","nonce":2872553788}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6810","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6811","nonce":2872553788}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6814","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6815","nonce":2872553788}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6812","nonce":2872553788},{"type":"v1","addr":"10.20.193.177:6813","nonce":2872553788}]},"public_addr":"10.20.193.177:6809/2872553788","cluster_addr":"10.20.193.177:6811/2872553788","heartbeat_back_addr":"10.20.193.177:6815/2872553788","heartbeat_front_addr":"10.20.193.177:6813/2872553788","state":["exists","up"]},{"osd":6,"uuid":"f08a6b86-b475-42cd-9e1b-9a0af277f218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6818","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6819","nonce":1649444587}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6820","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6821","nonce":1649444587}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6824","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6825","nonce":1649444587}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6822","nonce":1649444587},{"type":"v1","addr":"10.20.193.28:6823","nonce":1649444587}]},"public_addr":"10.20.193.28:6819/1649444587","cluster_addr":"10.20.193.28:6821/1649444587","heartbeat_back_addr":"10.20.193.28:6825/1649444587","heartbeat_front_addr":"10.20.193.28:6823/1649444587","state":["exists","up"]},{"osd":7,"uuid":"4a8b78d5-ef89-4bd1-94e7-74316c304a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6816","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6817","nonce":2141691482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6818","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6819","nonce":2141691482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6822","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6823","nonce":2141691482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6820","nonce":2141691482},{"type":"v1","addr":"10.20.193.126:6821","nonce":2141691482}]},"public_addr":"10.20.193.126:6817/2141691482","cluster_addr":"10.20.193.126:6819/2141691482","heartbeat_back_addr":"10.20.193.126:6823/2141691482","heartbeat_front_addr":"10.20.193.126:6821/2141691482","state":["exists","up"]},{"osd":8,"uuid":"cfc544c3-19d5-4f29-b18f-e846213b9f10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6816","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6817","nonce":830253287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6818","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6819","nonce":830253287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6822","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6823","nonce":830253287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6820","nonce":830253287},{"type":"v1","addr":"10.20.193.177:6821","nonce":830253287}]},"public_addr":"10.20.193.177:6817/830253287","cluster_addr":"10.20.193.177:6819/830253287","heartbeat_back_addr":"10.20.193.177:6823/830253287","heartbeat_front_addr":"10.20.193.177:6821/830253287","state":["exists","up"]},{"osd":9,"uuid":"f0bb903a-f9c1-445d-a9b2-5b9eed0489d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6826","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6827","nonce":698517696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6828","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6829","nonce":698517696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6832","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6833","nonce":698517696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6830","nonce":698517696},{"type":"v1","addr":"10.20.193.28:6831","nonce":698517696}]},"public_addr":"10.20.193.28:6827/698517696","cluster_addr":"10.20.193.28:6829/698517696","heartbeat_back_addr":"10.20.193.28:6833/698517696","heartbeat_front_addr":"10.20.193.28:6831/698517696","state":["exists","up"]},{"osd":10,"uuid":"2b911c8a-899c-45c2-8851-56fe9de089e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6824","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6825","nonce":4061106799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6826","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6827","nonce":4061106799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6830","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6831","nonce":4061106799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.126:6828","nonce":4061106799},{"type":"v1","addr":"10.20.193.126:6829","nonce":4061106799}]},"public_addr":"10.20.193.126:6825/4061106799","cluster_addr":"10.20.193.126:6827/4061106799","heartbeat_back_addr":"10.20.193.126:6831/4061106799","heartbeat_front_addr":"10.20.193.126:6829/4061106799","state":["exists","up"]},{"osd":11,"uuid":"10be6c12-30e6-42bf-bf2c-b4b219cb18bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6824","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6825","nonce":3589825667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6826","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6827","nonce":3589825667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6830","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6831","nonce":3589825667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.177:6828","nonce":3589825667},{"type":"v1","addr":"10.20.193.177:6829","nonce":3589825667}]},"public_addr":"10.20.193.177:6825/3589825667","cluster_addr":"10.20.193.177:6827/3589825667","heartbeat_back_addr":"10.20.193.177:6831/3589825667","heartbeat_front_addr":"10.20.193.177:6829/3589825667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:14.201885+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:23.963294+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:33.755778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:48.030374+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:12:57.713308+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:06.340219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:20.585056+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:30.005667+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:39.500648+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:13:52.560627+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:02.406343+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-20T03:14:11.818234+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.6","mappings":[{"from":4,"to":7},{"from":3,"to":6}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.16","mappings":[{"from":1,"to":8}]},{"pgid":"3.17","mappings":[{"from":0,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.37","mappings":[{"from":5,"to":6}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.28:6801/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:6800/732750991":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2248669804":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/3377311556":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/1349207449":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/613688684":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6801/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:6800/1032320093":"2026-02-21T03:11:14.750053+0000","10.20.193.28:0/1867592854":"2026-02-21T03:11:25.971161+0000","10.20.193.28:0/2481417757":"2026-02-21T03:11:14.750053+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.831+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdf1c0b0e20 msgr2=0x7fdf1c0b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.831+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdf1c0b0e20 0x7fdf1c0b32e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdf380096f0 tx=0x7fdf38009290 comp rx=0 tx=0).stop 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.831+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf44105750 msgr2=0x7fdf4419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.831+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf44105750 0x7fdf4419d660 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00d980 tx=0x7fdf2c00de50 comp rx=0 tx=0).stop 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.832+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 shutdown_connections 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.832+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7fdf1c0b0e20 0x7fdf1c0b32e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.832+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7fdf44109ed0 0x7fdf441a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.832+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7fdf44105750 0x7fdf4419d660 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.832+0000 7fdf48ec3640 1 --2- 10.20.193.28:0/533222946 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7fdf44104da0 0x7fdf4419d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:07.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.832+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 >> 10.20.193.28:0/533222946 conn(0x7fdf44100840 msgr2=0x7fdf44101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:07.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.832+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 shutdown_connections 2026-02-20T03:41:07.837 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:07.832+0000 7fdf48ec3640 1 -- 10.20.193.28:0/533222946 wait complete. 2026-02-20T03:41:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:07 trial126 ceph-mon[38476]: pgmap v979: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 285 KiB/s rd, 302 KiB/s wr, 161 op/s 2026-02-20T03:41:07.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:07 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3257474433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:41:07.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:07 trial177 ceph-mon[43181]: pgmap v979: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 285 KiB/s rd, 302 KiB/s wr, 161 op/s 2026-02-20T03:41:07.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:07 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3257474433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-20T03:41:07.971 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs fail cephfs 2026-02-20T03:41:08.246 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 -- 10.20.193.28:0/4147624665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 msgr2=0x7f71c4108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 --2- 10.20.193.28:0/4147624665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 0x7f71c4108ae0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009a60 tx=0x7f71b002f250 comp rx=0 tx=0).stop 2026-02-20T03:41:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 -- 10.20.193.28:0/4147624665 shutdown_connections 2026-02-20T03:41:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 --2- 10.20.193.28:0/4147624665 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71c41030a0 0x7f71c410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 --2- 10.20.193.28:0/4147624665 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71c4102700 0x7f71c4102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 --2- 10.20.193.28:0/4147624665 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 0x7f71c4108ae0 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.433 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 -- 10.20.193.28:0/4147624665 >> 10.20.193.28:0/4147624665 conn(0x7f71c40fe440 msgr2=0x7f71c4100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:08.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 -- 10.20.193.28:0/4147624665 shutdown_connections 2026-02-20T03:41:08.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 -- 10.20.193.28:0/4147624665 wait complete. 2026-02-20T03:41:08.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.430+0000 7f71c94aa640 1 Processor -- start 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c94aa640 1 -- start start 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c94aa640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71c4102700 0x7f71c419d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c94aa640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71c41030a0 0x7f71c419d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c94aa640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 0x7f71c41a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c94aa640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f71c4112920 con 0x7f71c4108700 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c94aa640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f71c41127a0 con 0x7f71c41030a0 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c94aa640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f71c4112aa0 con 0x7f71c4102700 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c8ca9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 0x7f71c41a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c8ca9640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 0x7f71c41a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37404/0 (socket says 10.20.193.28:37404) 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c8ca9640 1 -- 10.20.193.28:0/2688019457 learned_addr learned my addr 10.20.193.28:0/2688019457 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:08.436 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c3fff640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71c4102700 0x7f71c419d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c37fe640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71c41030a0 0x7f71c419d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c8ca9640 1 -- 10.20.193.28:0/2688019457 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71c4102700 msgr2=0x7f71c419d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c8ca9640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71c4102700 0x7f71c419d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c8ca9640 1 -- 10.20.193.28:0/2688019457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71c41030a0 msgr2=0x7f71c419d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c8ca9640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71c41030a0 0x7f71c419d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.431+0000 7f71c8ca9640 1 -- 10.20.193.28:0/2688019457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c41a20d0 con 0x7f71c4108700 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.432+0000 7f71c8ca9640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 0x7f71c41a1950 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f71b8004820 tx=0x7f71b800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.432+0000 7f71c17fa640 1 -- 10.20.193.28:0/2688019457 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b80090d0 con 0x7f71c4108700 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.432+0000 7f71c17fa640 1 -- 10.20.193.28:0/2688019457 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f71b8009270 con 0x7f71c4108700 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.432+0000 7f71c17fa640 1 -- 10.20.193.28:0/2688019457 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b8013810 con 0x7f71c4108700 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.432+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c41a2360 con 0x7f71c4108700 2026-02-20T03:41:08.437 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.432+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c41a9c00 con 0x7f71c4108700 2026-02-20T03:41:08.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.432+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71c4102b60 con 0x7f71c4108700 2026-02-20T03:41:08.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.435+0000 7f71c17fa640 1 -- 10.20.193.28:0/2688019457 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f71b8012070 con 0x7f71c4108700 2026-02-20T03:41:08.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.436+0000 7f71c17fa640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71980b0e20 0x7f71980b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:08.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.437+0000 7f71c17fa640 1 -- 10.20.193.28:0/2688019457 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9297+0+0 (secure 0 0 0) 0x7f71b80e06f0 con 0x7f71c4108700 2026-02-20T03:41:08.439 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.437+0000 7f71c3fff640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71980b0e20 0x7f71980b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:08.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.437+0000 7f71c17fa640 1 -- 10.20.193.28:0/2688019457 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f71b8010070 con 0x7f71c4108700 2026-02-20T03:41:08.440 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.437+0000 7f71c3fff640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71980b0e20 0x7f71980b32e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71b00097c0 tx=0x7f71b00057d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:08.547 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.544+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f71c41a9e90 con 0x7f71c4108700 2026-02-20T03:41:08.549 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.546+0000 7f71c17fa640 1 -- 10.20.193.28:0/2688019457 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) ==== 161+0+0 (secure 0 0 0) 0x7f71b80ac780 con 0x7f71c4108700 2026-02-20T03:41:08.550 INFO:teuthology.orchestra.run.trial028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2026-02-20T03:41:08.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.547+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71980b0e20 msgr2=0x7f71980b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:08.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.547+0000 7f71c94aa640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71980b0e20 0x7f71980b32e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f71b00097c0 tx=0x7f71b00057d0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.547+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 msgr2=0x7f71c41a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:08.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.547+0000 7f71c94aa640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 0x7f71c41a1950 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f71b8004820 tx=0x7f71b800d4a0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.548+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 shutdown_connections 2026-02-20T03:41:08.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.548+0000 7f71c94aa640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f71980b0e20 0x7f71980b32e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.548+0000 7f71c94aa640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f71c4108700 0x7f71c41a1950 unknown :-1 s=CLOSED pgs=2277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.551 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.548+0000 7f71c94aa640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f71c41030a0 0x7f71c419d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.548+0000 7f71c94aa640 1 --2- 10.20.193.28:0/2688019457 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f71c4102700 0x7f71c419d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:08.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.548+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 >> 10.20.193.28:0/2688019457 conn(0x7f71c40fe440 msgr2=0x7f71c40feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:08.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.548+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 shutdown_connections 2026-02-20T03:41:08.552 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:08.548+0000 7f71c94aa640 1 -- 10.20.193.28:0/2688019457 wait complete. 2026-02-20T03:41:08.655 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph fs rm cephfs --yes-i-really-mean-it 2026-02-20T03:41:08.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/533222946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:41:08.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2688019457' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2026-02-20T03:41:08.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-mon[38476]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-20T03:41:08.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-mon[38476]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T03:41:08.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2688019457' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-20T03:41:08.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-mon[38476]: osdmap e100: 12 total, 12 up, 12 in 2026-02-20T03:41:08.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-mon[38476]: fsmap cephfs:0/3 6 up:standby, 3 failed 2026-02-20T03:41:08.846 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: ignoring --setuser ceph since I am not root 2026-02-20T03:41:08.846 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: ignoring --setgroup ceph since I am not root 2026-02-20T03:41:08.847 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-mds[66222]: -- 10.20.193.126:0/142091675 <== mon.2 v2:10.20.193.126:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561b6d682b40 con 0x561b6c8a9000 2026-02-20T03:41:08.847 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:41:08 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: starting mds.b at 2026-02-20T03:41:08.847 INFO:journalctl@ceph.mds.e.trial126.stdout:Feb 20 03:41:08 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-e[65557]: starting mds.e at 2026-02-20T03:41:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:08 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a[38548]: 2026-02-20T03:41:08.545+0000 7feccad16640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T03:41:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:08 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/533222946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:41:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:08 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2688019457' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2026-02-20T03:41:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:08 trial028 ceph-mon[38552]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-20T03:41:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:08 trial028 ceph-mon[38552]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T03:41:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:08 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2688019457' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-20T03:41:08.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:08 trial028 ceph-mon[38552]: osdmap e100: 12 total, 12 up, 12 in 2026-02-20T03:41:08.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:08 trial028 ceph-mon[38552]: fsmap cephfs:0/3 6 up:standby, 3 failed 2026-02-20T03:41:08.925 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:08.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/533222946' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-20T03:41:08.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2688019457' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2026-02-20T03:41:08.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mon[43181]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-20T03:41:08.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mon[43181]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-20T03:41:08.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2688019457' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2026-02-20T03:41:08.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mon[43181]: osdmap e100: 12 total, 12 up, 12 in 2026-02-20T03:41:08.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mon[43181]: fsmap cephfs:0/3 6 up:standby, 3 failed 2026-02-20T03:41:08.969 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setuser ceph since I am not root 2026-02-20T03:41:08.969 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: ignoring --setgroup ceph since I am not root 2026-02-20T03:41:08.969 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mds[71178]: -- 10.20.193.177:0/399481786 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5619c67b0b40 con 0x5619c59d6800 2026-02-20T03:41:08.969 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:41:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: starting mds.c at 2026-02-20T03:41:08.969 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:41:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-f[70833]: ignoring --setuser ceph since I am not root 2026-02-20T03:41:08.969 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:41:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-f[70833]: ignoring --setgroup ceph since I am not root 2026-02-20T03:41:08.970 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mds[70837]: -- 10.20.193.177:0/3538482405 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c48a3eb40 con 0x560c47c65000 2026-02-20T03:41:08.970 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:41:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-f[70833]: starting mds.f at 2026-02-20T03:41:08.970 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 20 03:41:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-i[71504]: ignoring --setuser ceph since I am not root 2026-02-20T03:41:08.970 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 20 03:41:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-i[71504]: ignoring --setgroup ceph since I am not root 2026-02-20T03:41:08.970 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 20 03:41:08 trial177 ceph-mds[71508]: -- 10.20.193.177:0/2465045109 <== mon.1 v2:10.20.193.177:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d8fc460b40 con 0x55d8fb687400 2026-02-20T03:41:08.970 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 20 03:41:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-i[71504]: starting mds.i at 2026-02-20T03:41:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 -- 10.20.193.28:0/3100977562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8c113840 msgr2=0x7f3c8c115c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3100977562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8c113840 0x7f3c8c115c30 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f3c88009f90 tx=0x7f3c8802f390 comp rx=0 tx=0).stop 2026-02-20T03:41:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 -- 10.20.193.28:0/3100977562 shutdown_connections 2026-02-20T03:41:09.113 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3100977562 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8c113840 0x7f3c8c115c30 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3100977562 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c8c077f40 0x7f3c8c113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3100977562 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c8c077620 0x7f3c8c077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 -- 10.20.193.28:0/3100977562 >> 10.20.193.28:0/3100977562 conn(0x7f3c8c1006c0 msgr2=0x7f3c8c102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 -- 10.20.193.28:0/3100977562 shutdown_connections 2026-02-20T03:41:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 -- 10.20.193.28:0/3100977562 wait complete. 2026-02-20T03:41:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.110+0000 7f3c91b65640 1 Processor -- start 2026-02-20T03:41:09.114 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c91b65640 1 -- start start 2026-02-20T03:41:09.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c91b65640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8c077620 0x7f3c8c1a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:09.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c91b65640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c8c077f40 0x7f3c8c1a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:09.115 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c91b65640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c8c113840 0x7f3c8c1a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c91b65640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c119100 con 0x7f3c8c077620 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c91b65640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c118f80 con 0x7f3c8c077f40 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c91b65640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f3c8c119280 con 0x7f3c8c113840 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c83fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c8c077f40 0x7f3c8c1a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c90b63640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8c077620 0x7f3c8c1a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c91364640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c8c113840 0x7f3c8c1a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c83fff640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c8c077f40 0x7f3c8c1a1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.126:3300/0 says I am v2:10.20.193.28:48958/0 (socket says 10.20.193.28:48958) 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c83fff640 1 -- 10.20.193.28:0/3697378010 learned_addr learned my addr 10.20.193.28:0/3697378010 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c83fff640 1 -- 10.20.193.28:0/3697378010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c8c113840 msgr2=0x7f3c8c1a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:09.116 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c83fff640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c8c113840 0x7f3c8c1a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c83fff640 1 -- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8c077620 msgr2=0x7f3c8c1a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c83fff640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8c077620 0x7f3c8c1a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c83fff640 1 -- 10.20.193.28:0/3697378010 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c8c1a6510 con 0x7f3c8c077f40 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.111+0000 7f3c90b63640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8c077620 0x7f3c8c1a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.112+0000 7f3c83fff640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c8c077f40 0x7f3c8c1a1a00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400ea30 tx=0x7f3c7400ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.112+0000 7f3c81ffb640 1 -- 10.20.193.28:0/3697378010 <== mon.2 v2:10.20.193.126:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400ce50 con 0x7f3c8c077f40 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.112+0000 7f3c81ffb640 1 -- 10.20.193.28:0/3697378010 <== mon.2 v2:10.20.193.126:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f3c74004570 con 0x7f3c8c077f40 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.112+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c8c1a6800 con 0x7f3c8c077f40 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.112+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c8c1ae040 con 0x7f3c8c077f40 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.112+0000 7f3c81ffb640 1 -- 10.20.193.28:0/3697378010 <== mon.2 v2:10.20.193.126:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c74010690 con 0x7f3c8c077f40 2026-02-20T03:41:09.117 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.112+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c8c077a00 con 0x7f3c8c077f40 2026-02-20T03:41:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.114+0000 7f3c81ffb640 1 -- 10.20.193.28:0/3697378010 <== mon.2 v2:10.20.193.126:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f3c74002920 con 0x7f3c8c077f40 2026-02-20T03:41:09.118 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.116+0000 7f3c81ffb640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c680b0da0 0x7f3c680b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.116+0000 7f3c81ffb640 1 -- 10.20.193.28:0/3697378010 <== mon.2 v2:10.20.193.126:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9555+0+0 (secure 0 0 0) 0x7f3c740e1020 con 0x7f3c8c077f40 2026-02-20T03:41:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.116+0000 7f3c81ffb640 1 -- 10.20.193.28:0/3697378010 <== mon.2 v2:10.20.193.126:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f3c740e1540 con 0x7f3c8c077f40 2026-02-20T03:41:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.116+0000 7f3c90b63640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c680b0da0 0x7f3c680b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:09.119 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.116+0000 7f3c90b63640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c680b0da0 0x7f3c680b3260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009fd0 tx=0x7f3c7c009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:09.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.223+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3c8c1ae340 con 0x7f3c8c077f40 2026-02-20T03:41:09.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.581+0000 7f3c81ffb640 1 -- 10.20.193.28:0/3697378010 <== mon.2 v2:10.20.193.126:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) ==== 104+0+0 (secure 0 0 0) 0x7f3c740a93f0 con 0x7f3c8c077f40 2026-02-20T03:41:09.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.582+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c680b0da0 msgr2=0x7f3c680b3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:09.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.582+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c680b0da0 0x7f3c680b3260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c009fd0 tx=0x7f3c7c009290 comp rx=0 tx=0).stop 2026-02-20T03:41:09.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.582+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c8c077f40 msgr2=0x7f3c8c1a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:09.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.582+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c8c077f40 0x7f3c8c1a1a00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400ea30 tx=0x7f3c7400ef00 comp rx=0 tx=0).stop 2026-02-20T03:41:09.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.583+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 shutdown_connections 2026-02-20T03:41:09.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.583+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f3c680b0da0 0x7f3c680b3260 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:09.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.583+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f3c8c113840 0x7f3c8c1a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:09.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.583+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f3c8c077f40 0x7f3c8c1a1a00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:09.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.583+0000 7f3c91b65640 1 --2- 10.20.193.28:0/3697378010 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f3c8c077620 0x7f3c8c1a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:09.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.583+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 >> 10.20.193.28:0/3697378010 conn(0x7f3c8c1006c0 msgr2=0x7f3c8c102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:09.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.583+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 shutdown_connections 2026-02-20T03:41:09.587 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:09.583+0000 7f3c91b65640 1 -- 10.20.193.28:0/3697378010 wait complete. 2026-02-20T03:41:09.687 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2026-02-20T03:41:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:09 trial126 ceph-mon[38476]: pgmap v980: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 286 KiB/s rd, 299 KiB/s wr, 142 op/s 2026-02-20T03:41:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:09 trial126 ceph-mon[38476]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:41:09.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:09 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3697378010' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:41:09.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:09 trial028 ceph-mon[38552]: pgmap v980: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 286 KiB/s rd, 299 KiB/s wr, 142 op/s 2026-02-20T03:41:09.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:09 trial028 ceph-mon[38552]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:41:09.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:09 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3697378010' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:41:09.954 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:09.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:09 trial177 ceph-mon[43181]: pgmap v980: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 286 KiB/s rd, 299 KiB/s wr, 142 op/s 2026-02-20T03:41:09.967 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:09 trial177 ceph-mon[43181]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:41:09.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:09 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3697378010' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2026-02-20T03:41:10.140 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.137+0000 7f1a11694640 1 -- 10.20.193.28:0/1204589196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c109ba0 msgr2=0x7f1a0c115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:10.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.137+0000 7f1a11694640 1 --2- 10.20.193.28:0/1204589196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c109ba0 0x7f1a0c115d10 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000b0a0 tx=0x7f1a0002f410 comp rx=0 tx=0).stop 2026-02-20T03:41:10.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.137+0000 7f1a11694640 1 -- 10.20.193.28:0/1204589196 shutdown_connections 2026-02-20T03:41:10.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.137+0000 7f1a11694640 1 --2- 10.20.193.28:0/1204589196 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c109ba0 0x7f1a0c115d10 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:10.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.137+0000 7f1a11694640 1 --2- 10.20.193.28:0/1204589196 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a0c109220 0x7f1a0c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:10.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.137+0000 7f1a11694640 1 --2- 10.20.193.28:0/1204589196 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a0c10eef0 0x7f1a0c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:10.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.137+0000 7f1a11694640 1 -- 10.20.193.28:0/1204589196 >> 10.20.193.28:0/1204589196 conn(0x7f1a0c078600 msgr2=0x7f1a0c07aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:10.141 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.137+0000 7f1a11694640 1 -- 10.20.193.28:0/1204589196 shutdown_connections 2026-02-20T03:41:10.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.137+0000 7f1a11694640 1 -- 10.20.193.28:0/1204589196 wait complete. 2026-02-20T03:41:10.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a11694640 1 Processor -- start 2026-02-20T03:41:10.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a11694640 1 -- start start 2026-02-20T03:41:10.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a11694640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a0c109220 0x7f1a0c1a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:10.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a11694640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a0c109ba0 0x7f1a0c1a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:10.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a11694640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c10eef0 0x7f1a0c1a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:10.143 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a11694640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c1190a0 con 0x7f1a0c10eef0 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a11694640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c118f20 con 0x7f1a0c109ba0 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a11694640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c119220 con 0x7f1a0c109220 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a10e93640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c10eef0 0x7f1a0c1a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a0bfff640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a0c109220 0x7f1a0c1a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a10e93640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c10eef0 0x7f1a0c1a5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37446/0 (socket says 10.20.193.28:37446) 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a10e93640 1 -- 10.20.193.28:0/2624560454 learned_addr learned my addr 10.20.193.28:0/2624560454 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.138+0000 7f1a0b7fe640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a0c109ba0 0x7f1a0c1a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a10e93640 1 -- 10.20.193.28:0/2624560454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a0c109220 msgr2=0x7f1a0c1a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a10e93640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a0c109220 0x7f1a0c1a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a10e93640 1 -- 10.20.193.28:0/2624560454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a0c109ba0 msgr2=0x7f1a0c1a19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:10.144 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a10e93640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a0c109ba0 0x7f1a0c1a19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:10.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a10e93640 1 -- 10.20.193.28:0/2624560454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c1a64b0 con 0x7f1a0c10eef0 2026-02-20T03:41:10.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a0bfff640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a0c109220 0x7f1a0c1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:41:10.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a10e93640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c10eef0 0x7f1a0c1a5d30 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f1a00006030 tx=0x7f1a00009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:10.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a097fa640 1 -- 10.20.193.28:0/2624560454 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00046070 con 0x7f1a0c10eef0 2026-02-20T03:41:10.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a097fa640 1 -- 10.20.193.28:0/2624560454 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f1a000076a0 con 0x7f1a0c10eef0 2026-02-20T03:41:10.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a097fa640 1 -- 10.20.193.28:0/2624560454 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a000416e0 con 0x7f1a0c10eef0 2026-02-20T03:41:10.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0c1a6740 con 0x7f1a0c10eef0 2026-02-20T03:41:10.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.139+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0c1adfe0 con 0x7f1a0c10eef0 2026-02-20T03:41:10.145 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.140+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0c109660 con 0x7f1a0c10eef0 2026-02-20T03:41:10.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.142+0000 7f1a097fa640 1 -- 10.20.193.28:0/2624560454 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f1a00007bc0 con 0x7f1a0c10eef0 2026-02-20T03:41:10.146 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.144+0000 7f1a097fa640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f19e00b0e20 0x7f19e00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:10.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.144+0000 7f1a097fa640 1 -- 10.20.193.28:0/2624560454 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9555+0+0 (secure 0 0 0) 0x7f1a00105680 con 0x7f1a0c10eef0 2026-02-20T03:41:10.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.144+0000 7f1a0bfff640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f19e00b0e20 0x7f19e00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:10.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.144+0000 7f1a097fa640 1 -- 10.20.193.28:0/2624560454 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f1a0004f020 con 0x7f1a0c10eef0 2026-02-20T03:41:10.147 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.144+0000 7f1a0bfff640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f19e00b0e20 0x7f19e00b32e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f19f80046e0 tx=0x7f19f8009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:10.236 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.234+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1a0c110e30 con 0x7f1a0c10eef0 2026-02-20T03:41:10.591 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.589+0000 7f1a097fa640 1 -- 10.20.193.28:0/2624560454 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) ==== 181+0+0 (secure 0 0 0) 0x7f1a000cda20 con 0x7f1a0c10eef0 2026-02-20T03:41:10.591 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_metadata' removed 2026-02-20T03:41:10.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f19e00b0e20 msgr2=0x7f19e00b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:10.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f19e00b0e20 0x7f19e00b32e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f19f80046e0 tx=0x7f19f8009290 comp rx=0 tx=0).stop 2026-02-20T03:41:10.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c10eef0 msgr2=0x7f1a0c1a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:10.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c10eef0 0x7f1a0c1a5d30 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f1a00006030 tx=0x7f1a00009300 comp rx=0 tx=0).stop 2026-02-20T03:41:10.592 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 shutdown_connections 2026-02-20T03:41:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f19e00b0e20 0x7f19e00b32e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f1a0c10eef0 0x7f1a0c1a5d30 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f1a0c109ba0 0x7f1a0c1a19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 --2- 10.20.193.28:0/2624560454 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f1a0c109220 0x7f1a0c1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 >> 10.20.193.28:0/2624560454 conn(0x7f1a0c078600 msgr2=0x7f1a0c079d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.590+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 shutdown_connections 2026-02-20T03:41:10.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:10.591+0000 7f1a11694640 1 -- 10.20.193.28:0/2624560454 wait complete. 2026-02-20T03:41:10.733 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2026-02-20T03:41:10.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-20T03:41:10.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: Cluster is now healthy 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6834/3910845640,v1:10.20.193.177:6836/3910845640] up:boot 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6835/1383445878,v1:10.20.193.177:6837/1383445878] up:boot 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.177:6838/1120983345,v1:10.20.193.177:6839/1120983345] up:boot 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.126:6834/760451139,v1:10.20.193.126:6837/760451139] up:boot 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.126:6836/1120759813,v1:10.20.193.126:6839/1120759813] up:boot 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: mds.? [v2:10.20.193.126:6835/3324349408,v1:10.20.193.126:6838/3324349408] up:boot 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: fsmap 12 up:standby 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:41:10.846 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2026-02-20T03:41:10.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2026-02-20T03:41:10.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2026-02-20T03:41:10.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2026-02-20T03:41:10.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2026-02-20T03:41:10.847 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:10 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2624560454' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2026-02-20T03:41:10.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-20T03:41:10.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-20T03:41:10.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: Cluster is now healthy 2026-02-20T03:41:10.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-20T03:41:10.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6834/3910845640,v1:10.20.193.177:6836/3910845640] up:boot 2026-02-20T03:41:10.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6835/1383445878,v1:10.20.193.177:6837/1383445878] up:boot 2026-02-20T03:41:10.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.177:6838/1120983345,v1:10.20.193.177:6839/1120983345] up:boot 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.126:6834/760451139,v1:10.20.193.126:6837/760451139] up:boot 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.126:6836/1120759813,v1:10.20.193.126:6839/1120759813] up:boot 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: mds.? [v2:10.20.193.126:6835/3324349408,v1:10.20.193.126:6838/3324349408] up:boot 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: fsmap 12 up:standby 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2026-02-20T03:41:10.852 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:10 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2624560454' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2026-02-20T03:41:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-20T03:41:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-20T03:41:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: Cluster is now healthy 2026-02-20T03:41:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2026-02-20T03:41:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6834/3910845640,v1:10.20.193.177:6836/3910845640] up:boot 2026-02-20T03:41:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6835/1383445878,v1:10.20.193.177:6837/1383445878] up:boot 2026-02-20T03:41:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.177:6838/1120983345,v1:10.20.193.177:6839/1120983345] up:boot 2026-02-20T03:41:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.126:6834/760451139,v1:10.20.193.126:6837/760451139] up:boot 2026-02-20T03:41:10.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.126:6836/1120759813,v1:10.20.193.126:6839/1120759813] up:boot 2026-02-20T03:41:10.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: mds.? [v2:10.20.193.126:6835/3324349408,v1:10.20.193.126:6838/3324349408] up:boot 2026-02-20T03:41:10.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: fsmap 12 up:standby 2026-02-20T03:41:10.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2026-02-20T03:41:10.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2026-02-20T03:41:10.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2026-02-20T03:41:10.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2026-02-20T03:41:10.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2026-02-20T03:41:10.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: from='mgr.14150 10.20.193.28:0/2904857377' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2026-02-20T03:41:10.969 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:10 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2624560454' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2026-02-20T03:41:10.998 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:11.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 -- 10.20.193.28:0/1942292425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e18075950 msgr2=0x7f5e18075d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:11.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 --2- 10.20.193.28:0/1942292425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e18075950 0x7f5e18075d90 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009a30 tx=0x7f5e0c02f2b0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 -- 10.20.193.28:0/1942292425 shutdown_connections 2026-02-20T03:41:11.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 --2- 10.20.193.28:0/1942292425 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e181134d0 0x7f5e18115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 --2- 10.20.193.28:0/1942292425 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e18075950 0x7f5e18075d90 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 --2- 10.20.193.28:0/1942292425 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e181065d0 0x7f5e18075410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 -- 10.20.193.28:0/1942292425 >> 10.20.193.28:0/1942292425 conn(0x7f5e180fe440 msgr2=0x7f5e18100860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 -- 10.20.193.28:0/1942292425 shutdown_connections 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 -- 10.20.193.28:0/1942292425 wait complete. 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.182+0000 7f5e1e914640 1 Processor -- start 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1e914640 1 -- start start 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1e914640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e18075950 0x7f5e181a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1e914640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e181065d0 0x7f5e181a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1e914640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e181134d0 0x7f5e181a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1e914640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f5e18119050 con 0x7f5e181065d0 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1e914640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f5e18118ed0 con 0x7f5e18075950 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1e914640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f5e181191d0 con 0x7f5e181134d0 2026-02-20T03:41:11.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1d111640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e181065d0 0x7f5e181a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:11.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1d111640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e181065d0 0x7f5e181a1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37476/0 (socket says 10.20.193.28:37476) 2026-02-20T03:41:11.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1d111640 1 -- 10.20.193.28:0/3937394278 learned_addr learned my addr 10.20.193.28:0/3937394278 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:11.187 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1d912640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e18075950 0x7f5e181a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1d111640 1 -- 10.20.193.28:0/3937394278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e181134d0 msgr2=0x7f5e181a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1d111640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e181134d0 0x7f5e181a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1d111640 1 -- 10.20.193.28:0/3937394278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e18075950 msgr2=0x7f5e181a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1d111640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e18075950 0x7f5e181a1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.183+0000 7f5e1d111640 1 -- 10.20.193.28:0/3937394278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e181a63e0 con 0x7f5e181065d0 2026-02-20T03:41:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.184+0000 7f5e1d111640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e181065d0 0x7f5e181a1970 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009b60 tx=0x7f5e0c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.184+0000 7f5e06ffd640 1 -- 10.20.193.28:0/3937394278 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c046070 con 0x7f5e181065d0 2026-02-20T03:41:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.184+0000 7f5e06ffd640 1 -- 10.20.193.28:0/3937394278 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f5e0c03e070 con 0x7f5e181065d0 2026-02-20T03:41:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.184+0000 7f5e06ffd640 1 -- 10.20.193.28:0/3937394278 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c02fd10 con 0x7f5e181065d0 2026-02-20T03:41:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.184+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e181a6670 con 0x7f5e181065d0 2026-02-20T03:41:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.184+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e181a6b00 con 0x7f5e181065d0 2026-02-20T03:41:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.185+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e18075d90 con 0x7f5e181065d0 2026-02-20T03:41:11.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.187+0000 7f5e06ffd640 1 -- 10.20.193.28:0/3937394278 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f5e0c038bb0 con 0x7f5e181065d0 2026-02-20T03:41:11.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.188+0000 7f5e06ffd640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5df40b0e20 0x7f5df40b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:11.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.188+0000 7f5e06ffd640 1 -- 10.20.193.28:0/3937394278 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9001+0+0 (secure 0 0 0) 0x7f5e0c105250 con 0x7f5e181065d0 2026-02-20T03:41:11.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.189+0000 7f5e06ffd640 1 -- 10.20.193.28:0/3937394278 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f5e0c1056d0 con 0x7f5e181065d0 2026-02-20T03:41:11.190 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.189+0000 7f5e1d912640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5df40b0e20 0x7f5df40b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:11.191 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.189+0000 7f5e1d912640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5df40b0e20 0x7f5df40b32e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5e08005fd0 tx=0x7f5e08005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:11.281 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.279+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5e181ae1d0 con 0x7f5e181065d0 2026-02-20T03:41:11.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.594+0000 7f5e06ffd640 1 -- 10.20.193.28:0/3937394278 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) ==== 169+0+0 (secure 0 0 0) 0x7f5e0c0cd7f0 con 0x7f5e181065d0 2026-02-20T03:41:11.596 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_data' removed 2026-02-20T03:41:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5df40b0e20 msgr2=0x7f5df40b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5df40b0e20 0x7f5df40b32e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5e08005fd0 tx=0x7f5e08005dc0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e181065d0 msgr2=0x7f5e181a1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e181065d0 0x7f5e181a1970 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009b60 tx=0x7f5e0c004600 comp rx=0 tx=0).stop 2026-02-20T03:41:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 shutdown_connections 2026-02-20T03:41:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f5df40b0e20 0x7f5df40b32e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f5e181134d0 0x7f5e181a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f5e181065d0 0x7f5e181a1970 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.599 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 --2- 10.20.193.28:0/3937394278 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f5e18075950 0x7f5e181a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 >> 10.20.193.28:0/3937394278 conn(0x7f5e180fe440 msgr2=0x7f5e18114b60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 shutdown_connections 2026-02-20T03:41:11.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:11.597+0000 7f5e1e914640 1 -- 10.20.193.28:0/3937394278 wait complete. 2026-02-20T03:41:11.711 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2026-02-20T03:41:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:11 trial126 ceph-mon[38476]: pgmap v982: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2026-02-20T03:41:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:11 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2624560454' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-20T03:41:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:11 trial126 ceph-mon[38476]: osdmap e101: 12 total, 12 up, 12 in 2026-02-20T03:41:11.845 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:11 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3937394278' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2026-02-20T03:41:11.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:11 trial028 ceph-mon[38552]: pgmap v982: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2026-02-20T03:41:11.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:11 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2624560454' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-20T03:41:11.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:11 trial028 ceph-mon[38552]: osdmap e101: 12 total, 12 up, 12 in 2026-02-20T03:41:11.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:11 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3937394278' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2026-02-20T03:41:11.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:11 trial177 ceph-mon[43181]: pgmap v982: 129 pgs: 129 active+clean; 475 MiB data, 11 GiB used, 8.2 TiB / 8.2 TiB avail; 9.0 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2026-02-20T03:41:11.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:11 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2624560454' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2026-02-20T03:41:11.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:11 trial177 ceph-mon[43181]: osdmap e101: 12 total, 12 up, 12 in 2026-02-20T03:41:11.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:11 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3937394278' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2026-02-20T03:41:11.983 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.162+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2340259857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 msgr2=0x7f2bac106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.162+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2340259857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 0x7f2bac106f40 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f2ba000b0a0 tx=0x7f2ba002f4a0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.162+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2340259857 shutdown_connections 2026-02-20T03:41:12.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.162+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2340259857 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 0x7f2bac106f40 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.162+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2340259857 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bac101fa0 0x7f2bac106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.162+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2340259857 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bac101680 0x7f2bac101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.162+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2340259857 >> 10.20.193.28:0/2340259857 conn(0x7f2bac0fd330 msgr2=0x7f2bac0ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.162+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2340259857 shutdown_connections 2026-02-20T03:41:12.165 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.162+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2340259857 wait complete. 2026-02-20T03:41:12.166 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.163+0000 7f2bb0d78640 1 Processor -- start 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.163+0000 7f2bb0d78640 1 -- start start 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.163+0000 7f2bb0d78640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bac101680 0x7f2bac1a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.163+0000 7f2bb0d78640 1 --2- >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bac101fa0 0x7f2bac1a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.163+0000 7f2bb0d78640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 0x7f2bac1a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.163+0000 7f2bb0d78640 1 -- --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac1190e0 con 0x7f2bac106a90 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.163+0000 7f2bb0d78640 1 -- --> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac118f60 con 0x7f2bac101680 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.163+0000 7f2bb0d78640 1 -- --> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] -- mon_getmap magic: 0 -- 0x7f2bac119260 con 0x7f2bac101fa0 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2babfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 0x7f2bac1a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2bab7fe640 1 --2- >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bac101680 0x7f2bac1a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:12.167 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2babfff640 1 --2- >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 0x7f2bac1a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.28:3300/0 says I am v2:10.20.193.28:37498/0 (socket says 10.20.193.28:37498) 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2babfff640 1 -- 10.20.193.28:0/2103138406 learned_addr learned my addr 10.20.193.28:0/2103138406 (peer_addr_for_me v2:10.20.193.28:0/0) 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2baaffd640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bac101fa0 0x7f2bac1a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2babfff640 1 -- 10.20.193.28:0/2103138406 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bac101fa0 msgr2=0x7f2bac1a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2babfff640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bac101fa0 0x7f2bac1a1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2babfff640 1 -- 10.20.193.28:0/2103138406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bac101680 msgr2=0x7f2bac1a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2babfff640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bac101680 0x7f2bac1a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2babfff640 1 -- 10.20.193.28:0/2103138406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bac1a6590 con 0x7f2bac106a90 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2bab7fe640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bac101680 0x7f2bac1a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2babfff640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 0x7f2bac1a5e10 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0032040 tx=0x7f2ba0009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.164+0000 7f2ba8ff9640 1 -- 10.20.193.28:0/2103138406 <== mon.0 v2:10.20.193.28:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0046070 con 0x7f2bac106a90 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.165+0000 7f2ba8ff9640 1 -- 10.20.193.28:0/2103138406 <== mon.0 v2:10.20.193.28:3300/0 2 ==== config(26 keys) ==== 1076+0+0 (secure 0 0 0) 0x7f2ba00075c0 con 0x7f2bac106a90 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.165+0000 7f2ba8ff9640 1 -- 10.20.193.28:0/2103138406 <== mon.0 v2:10.20.193.28:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00416e0 con 0x7f2bac106a90 2026-02-20T03:41:12.168 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.165+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bac1a6820 con 0x7f2bac106a90 2026-02-20T03:41:12.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.165+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bac1ae0c0 con 0x7f2bac106a90 2026-02-20T03:41:12.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.165+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bac106470 con 0x7f2bac106a90 2026-02-20T03:41:12.169 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.167+0000 7f2ba8ff9640 1 -- 10.20.193.28:0/2103138406 <== mon.0 v2:10.20.193.28:3300/0 4 ==== mgrmap(e 17) ==== 149705+0+0 (secure 0 0 0) 0x7f2ba0007ae0 con 0x7f2bac106a90 2026-02-20T03:41:12.170 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.169+0000 7f2ba8ff9640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-20T03:41:12.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.169+0000 7f2ba8ff9640 1 -- 10.20.193.28:0/2103138406 <== mon.0 v2:10.20.193.28:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8318+0+0 (secure 0 0 0) 0x7f2ba01052c0 con 0x7f2bac106a90 2026-02-20T03:41:12.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.169+0000 7f2bab7fe640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-20T03:41:12.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.169+0000 7f2ba8ff9640 1 -- 10.20.193.28:0/2103138406 <== mon.0 v2:10.20.193.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195341 (secure 0 0 0) 0x7f2ba01057e0 con 0x7f2bac106a90 2026-02-20T03:41:12.171 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.170+0000 7f2bab7fe640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2b98002730 tx=0x7f2b98009290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-20T03:41:12.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.261+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 --> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2bac1ae290 con 0x7f2bac106a90 2026-02-20T03:41:12.600 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.598+0000 7f2ba8ff9640 1 -- 10.20.193.28:0/2103138406 <== mon.0 v2:10.20.193.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v103) ==== 178+0+0 (secure 0 0 0) 0x7f2ba00cdae0 con 0x7f2bac106a90 2026-02-20T03:41:12.600 INFO:teuthology.orchestra.run.trial028.stderr:pool 'cephfs_data_ec' removed 2026-02-20T03:41:12.602 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 msgr2=0x7f2b800b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:12.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2b98002730 tx=0x7f2b98009290 comp rx=0 tx=0).stop 2026-02-20T03:41:12.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 msgr2=0x7f2bac1a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-20T03:41:12.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 0x7f2bac1a5e10 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0032040 tx=0x7f2ba0009300 comp rx=0 tx=0).stop 2026-02-20T03:41:12.603 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 shutdown_connections 2026-02-20T03:41:12.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:6800/3562582510,v1:10.20.193.28:6801/3562582510] conn(0x7f2b800b0e20 0x7f2b800b32e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] conn(0x7f2bac106a90 0x7f2bac1a5e10 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.177:3300/0,v1:10.20.193.177:6789/0] conn(0x7f2bac101fa0 0x7f2bac1a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 --2- 10.20.193.28:0/2103138406 >> [v2:10.20.193.126:3300/0,v1:10.20.193.126:6789/0] conn(0x7f2bac101680 0x7f2bac1a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-20T03:41:12.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.601+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 >> 10.20.193.28:0/2103138406 conn(0x7f2bac0fd330 msgr2=0x7f2bac1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-20T03:41:12.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.602+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 shutdown_connections 2026-02-20T03:41:12.604 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T03:41:12.602+0000 7f2bb0d78640 1 -- 10.20.193.28:0/2103138406 wait complete. 2026-02-20T03:41:12.710 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T03:41:12.768 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T03:41:12.796 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T03:41:12.825 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-20T03:41:12.825 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-20T03:41:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:12 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/3937394278' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2026-02-20T03:41:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:12 trial028 ceph-mon[38552]: osdmap e102: 12 total, 12 up, 12 in 2026-02-20T03:41:12.851 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:12 trial028 ceph-mon[38552]: from='client.? 10.20.193.28:0/2103138406' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2026-02-20T03:41:12.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:12 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/3937394278' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2026-02-20T03:41:12.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:12 trial177 ceph-mon[43181]: osdmap e102: 12 total, 12 up, 12 in 2026-02-20T03:41:12.968 INFO:journalctl@ceph.mon.c.trial177.stdout:Feb 20 03:41:12 trial177 ceph-mon[43181]: from='client.? 10.20.193.28:0/2103138406' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2026-02-20T03:41:13.087 INFO:teuthology.orchestra.run.trial028.stderr:Inferring config /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/mon.a/config 2026-02-20T03:41:13.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:12 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/3937394278' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2026-02-20T03:41:13.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:12 trial126 ceph-mon[38476]: osdmap e102: 12 total, 12 up, 12 in 2026-02-20T03:41:13.095 INFO:journalctl@ceph.mon.b.trial126.stdout:Feb 20 03:41:12 trial126 ceph-mon[38476]: from='client.? 10.20.193.28:0/2103138406' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2026-02-20T03:41:13.126 INFO:teuthology.orchestra.run.trial028.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-20T03:41:13.154 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-20T03:41:13.155 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-20T03:41:13.155 DEBUG:teuthology.orchestra.run.trial028:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-20T03:41:13.236 DEBUG:teuthology.orchestra.run.trial126:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-20T03:41:13.254 DEBUG:teuthology.orchestra.run.trial177:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-20T03:41:13.273 INFO:tasks.cephadm:Stopping all daemons... 2026-02-20T03:41:13.273 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-20T03:41:13.274 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.a 2026-02-20T03:41:13.471 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:13 trial028 systemd[1]: Stopping Ceph mon.a for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:41:13.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a[38548]: 2026-02-20T03:41:13.468+0000 7fecd0521640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:41:13.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a[38548]: 2026-02-20T03:41:13.468+0000 7fecd0521640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-20T03:41:13.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:13 trial028 podman[147857]: 2026-02-20 03:41:13.569952255 +0000 UTC m=+0.127103431 container died 656b013ac329f06d5a566e4f5a7fb75df7d4ff61bba65d70c48e1ea011a8a447 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T03:41:13.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:13 trial028 podman[147857]: 2026-02-20 03:41:13.641045285 +0000 UTC m=+0.198196461 container remove 656b013ac329f06d5a566e4f5a7fb75df7d4ff61bba65d70c48e1ea011a8a447 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default) 2026-02-20T03:41:13.742 INFO:journalctl@ceph.mon.a.trial028.stdout:Feb 20 03:41:13 trial028 bash[147857]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mon-a 2026-02-20T03:41:13.759 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.a.service' 2026-02-20T03:41:13.834 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:13.835 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-20T03:41:13.835 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-20T03:41:13.835 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.b 2026-02-20T03:41:14.078 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.b.service' 2026-02-20T03:41:14.116 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:14.117 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-20T03:41:14.117 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-20T03:41:14.117 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.c 2026-02-20T03:41:14.317 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mon.c.service' 2026-02-20T03:41:14.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:14.354 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-20T03:41:14.354 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-20T03:41:14.354 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.x 2026-02-20T03:41:14.663 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:41:14 trial028 systemd[1]: Stopping Ceph mgr.x for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:41:14.663 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:41:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:41:14.542+0000 7ff85e6b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:41:14.663 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:41:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x[38788]: 2026-02-20T03:41:14.542+0000 7ff85e6b6640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-20T03:41:14.663 INFO:journalctl@ceph.mgr.x.trial028.stdout:Feb 20 03:41:14 trial028 podman[147988]: 2026-02-20 03:41:14.634153015 +0000 UTC m=+0.116212717 container died 58c5d3975ef7b8724aaa27958bb2e21983a18d45a0c2d6e7e5e9ef6e390f5220 (image=quay.ceph.io/ceph-ci/ceph:f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mgr-x, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T03:41:14.845 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.x.service' 2026-02-20T03:41:14.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:14.915 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-20T03:41:14.915 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-20T03:41:14.915 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.y 2026-02-20T03:41:15.135 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.y.service' 2026-02-20T03:41:15.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:15.169 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-20T03:41:15.169 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-20T03:41:15.169 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.z 2026-02-20T03:41:15.407 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mgr.z.service' 2026-02-20T03:41:15.443 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:15.443 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-20T03:41:15.443 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-20T03:41:15.443 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.0 2026-02-20T03:41:15.851 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:15 trial028 systemd[1]: Stopping Ceph osd.0 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:41:15.851 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:15 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0[49934]: 2026-02-20T03:41:15.633+0000 7f8ee22e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:41:15.851 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:15 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0[49934]: 2026-02-20T03:41:15.633+0000 7f8ee22e0640 -1 osd.0 103 *** Got signal Terminated *** 2026-02-20T03:41:15.851 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:15 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0[49934]: 2026-02-20T03:41:15.633+0000 7f8ee22e0640 -1 osd.0 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:41:21.786 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:21 trial028 podman[148117]: 2026-02-20 03:41:21.46970854 +0000 UTC m=+5.859899955 container died c0a662372942454fe47be7c64abd61a7d74317bc20539eaf9b9cf8b21881cc6d (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-20T03:41:21.787 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:21 trial028 podman[148117]: 2026-02-20 03:41:21.530315517 +0000 UTC m=+5.920506932 container remove c0a662372942454fe47be7c64abd61a7d74317bc20539eaf9b9cf8b21881cc6d (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216) 2026-02-20T03:41:21.787 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:21 trial028 bash[148117]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0 2026-02-20T03:41:22.037 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:21 trial028 podman[148219]: 2026-02-20 03:41:21.784425108 +0000 UTC m=+0.029898984 container create 70f714224d45f5d4eb885b112770a5059342671a431e05e228680e78347ba71a (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T03:41:22.037 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:21 trial028 podman[148219]: 2026-02-20 03:41:21.837197016 +0000 UTC m=+0.082670841 container init 70f714224d45f5d4eb885b112770a5059342671a431e05e228680e78347ba71a (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0-deactivate, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T03:41:22.037 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:21 trial028 podman[148219]: 2026-02-20 03:41:21.842645403 +0000 UTC m=+0.088119228 container start 70f714224d45f5d4eb885b112770a5059342671a431e05e228680e78347ba71a (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T03:41:22.037 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:21 trial028 podman[148219]: 2026-02-20 03:41:21.843532912 +0000 UTC m=+0.089006737 container attach 70f714224d45f5d4eb885b112770a5059342671a431e05e228680e78347ba71a (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-0-deactivate, ceph=True, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T03:41:22.037 INFO:journalctl@ceph.osd.0.trial028.stdout:Feb 20 03:41:21 trial028 podman[148219]: 2026-02-20 03:41:21.774432843 +0000 UTC m=+0.019906678 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:41:22.122 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.0.service' 2026-02-20T03:41:22.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:22.194 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-20T03:41:22.194 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-20T03:41:22.194 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.1 2026-02-20T03:41:22.595 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:22 trial126 systemd[1]: Stopping Ceph osd.1 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:41:22.596 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1[43143]: 2026-02-20T03:41:22.300+0000 7f60ab6c1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:41:22.596 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1[43143]: 2026-02-20T03:41:22.300+0000 7f60ab6c1640 -1 osd.1 103 *** Got signal Terminated *** 2026-02-20T03:41:22.596 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1[43143]: 2026-02-20T03:41:22.300+0000 7f60ab6c1640 -1 osd.1 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:41:28.166 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:27 trial126 podman[73503]: 2026-02-20 03:41:27.866820876 +0000 UTC m=+5.578375060 container died 36c286a5e682740b41c9d3c01d181705fbeaba8362fec1f2442d5f3649ddd0fe (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T03:41:28.166 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:27 trial126 podman[73503]: 2026-02-20 03:41:27.877244343 +0000 UTC m=+5.588798537 container remove 36c286a5e682740b41c9d3c01d181705fbeaba8362fec1f2442d5f3649ddd0fe (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS) 2026-02-20T03:41:28.167 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:27 trial126 bash[73503]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1 2026-02-20T03:41:28.167 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:28 trial126 podman[73635]: 2026-02-20 03:41:28.010402958 +0000 UTC m=+0.016292150 container create c36e7fe568062765d8d748a0cf746acd581c646f4beac9e00cf0f875ba76d7c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1-deactivate, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, ceph=True, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T03:41:28.167 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:28 trial126 podman[73635]: 2026-02-20 03:41:28.048975399 +0000 UTC m=+0.054864601 container init c36e7fe568062765d8d748a0cf746acd581c646f4beac9e00cf0f875ba76d7c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS) 2026-02-20T03:41:28.167 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:28 trial126 podman[73635]: 2026-02-20 03:41:28.051342388 +0000 UTC m=+0.057231570 container start c36e7fe568062765d8d748a0cf746acd581c646f4beac9e00cf0f875ba76d7c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, io.buildah.version=1.33.7) 2026-02-20T03:41:28.167 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:28 trial126 podman[73635]: 2026-02-20 03:41:28.051822548 +0000 UTC m=+0.057711741 container attach c36e7fe568062765d8d748a0cf746acd581c646f4beac9e00cf0f875ba76d7c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0) 2026-02-20T03:41:28.167 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:28 trial126 podman[73635]: 2026-02-20 03:41:28.00355519 +0000 UTC m=+0.009444392 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:41:28.167 INFO:journalctl@ceph.osd.1.trial126.stdout:Feb 20 03:41:28 trial126 podman[73635]: 2026-02-20 03:41:28.17463001 +0000 UTC m=+0.180519212 container died c36e7fe568062765d8d748a0cf746acd581c646f4beac9e00cf0f875ba76d7c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=default, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7) 2026-02-20T03:41:28.208 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.1.service' 2026-02-20T03:41:28.246 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:28.246 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-20T03:41:28.246 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-20T03:41:28.246 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.2 2026-02-20T03:41:28.718 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:28 trial177 systemd[1]: Stopping Ceph osd.2 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:41:28.718 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2[48328]: 2026-02-20T03:41:28.348+0000 7f7e748c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:41:28.718 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2[48328]: 2026-02-20T03:41:28.348+0000 7f7e748c5640 -1 osd.2 103 *** Got signal Terminated *** 2026-02-20T03:41:28.718 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2[48328]: 2026-02-20T03:41:28.348+0000 7f7e748c5640 -1 osd.2 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:41:34.206 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:33 trial177 podman[79519]: 2026-02-20 03:41:33.90361651 +0000 UTC m=+5.568459492 container died 13492f6c7e7ffe469ef9051d974bf99e03c53765647a9d6c8bc704da9d41ada3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T03:41:34.206 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:33 trial177 podman[79519]: 2026-02-20 03:41:33.912690439 +0000 UTC m=+5.577533411 container remove 13492f6c7e7ffe469ef9051d974bf99e03c53765647a9d6c8bc704da9d41ada3 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True) 2026-02-20T03:41:34.207 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:33 trial177 bash[79519]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2 2026-02-20T03:41:34.207 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:34 trial177 podman[79648]: 2026-02-20 03:41:34.045290607 +0000 UTC m=+0.016692065 container create 3c186cdbd5ca70e11f7f6259a266b62ebded8fb98d26c8a823aa2c783f6efd6b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T03:41:34.207 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:34 trial177 podman[79648]: 2026-02-20 03:41:34.081531562 +0000 UTC m=+0.052933030 container init 3c186cdbd5ca70e11f7f6259a266b62ebded8fb98d26c8a823aa2c783f6efd6b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, OSD_FLAVOR=default, ceph=True, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T03:41:34.207 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:34 trial177 podman[79648]: 2026-02-20 03:41:34.084052285 +0000 UTC m=+0.055453743 container start 3c186cdbd5ca70e11f7f6259a266b62ebded8fb98d26c8a823aa2c783f6efd6b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=default, ceph=True, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7) 2026-02-20T03:41:34.207 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:34 trial177 podman[79648]: 2026-02-20 03:41:34.084633705 +0000 UTC m=+0.056035163 container attach 3c186cdbd5ca70e11f7f6259a266b62ebded8fb98d26c8a823aa2c783f6efd6b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T03:41:34.207 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:34 trial177 podman[79648]: 2026-02-20 03:41:34.038566794 +0000 UTC m=+0.009968252 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:41:34.207 INFO:journalctl@ceph.osd.2.trial177.stdout:Feb 20 03:41:34 trial177 podman[79648]: 2026-02-20 03:41:34.206063189 +0000 UTC m=+0.177464667 container died 3c186cdbd5ca70e11f7f6259a266b62ebded8fb98d26c8a823aa2c783f6efd6b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-2-deactivate, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.license=GPLv2) 2026-02-20T03:41:34.240 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.2.service' 2026-02-20T03:41:34.277 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:34.278 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-20T03:41:34.278 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-20T03:41:34.278 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.3 2026-02-20T03:41:34.601 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:34 trial028 systemd[1]: Stopping Ceph osd.3 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:41:34.602 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:34 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3[55857]: 2026-02-20T03:41:34.469+0000 7f02b1b54640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:41:34.602 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:34 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3[55857]: 2026-02-20T03:41:34.469+0000 7f02b1b54640 -1 osd.3 103 *** Got signal Terminated *** 2026-02-20T03:41:34.602 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:34 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3[55857]: 2026-02-20T03:41:34.469+0000 7f02b1b54640 -1 osd.3 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:41:40.601 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:40 trial028 podman[148333]: 2026-02-20 03:41:40.345956674 +0000 UTC m=+5.901707455 container died 7921a6bdf300bb168af530aee92d9a684c9d34d56ec37eb36d512692d2f16d44 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, ceph=True) 2026-02-20T03:41:40.601 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:40 trial028 podman[148333]: 2026-02-20 03:41:40.405063234 +0000 UTC m=+5.960814045 container remove 7921a6bdf300bb168af530aee92d9a684c9d34d56ec37eb36d512692d2f16d44 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T03:41:40.601 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:40 trial028 bash[148333]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3 2026-02-20T03:41:40.931 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:40 trial028 podman[148439]: 2026-02-20 03:41:40.667230037 +0000 UTC m=+0.029514609 container create 9a133b02ef4fbd5a0b3f832043c227245628fdcfa9c2d3923ef96002125b17ad (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3-deactivate, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:41:40.931 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:40 trial028 podman[148439]: 2026-02-20 03:41:40.716036742 +0000 UTC m=+0.078321324 container init 9a133b02ef4fbd5a0b3f832043c227245628fdcfa9c2d3923ef96002125b17ad (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216) 2026-02-20T03:41:40.931 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:40 trial028 podman[148439]: 2026-02-20 03:41:40.72166875 +0000 UTC m=+0.083953332 container start 9a133b02ef4fbd5a0b3f832043c227245628fdcfa9c2d3923ef96002125b17ad (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, io.buildah.version=1.33.7, ceph=True) 2026-02-20T03:41:40.931 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:40 trial028 podman[148439]: 2026-02-20 03:41:40.722509121 +0000 UTC m=+0.084793693 container attach 9a133b02ef4fbd5a0b3f832043c227245628fdcfa9c2d3923ef96002125b17ad (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3-deactivate, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, ceph=True) 2026-02-20T03:41:40.931 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:40 trial028 podman[148439]: 2026-02-20 03:41:40.656660179 +0000 UTC m=+0.018944761 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:41:40.932 INFO:journalctl@ceph.osd.3.trial028.stdout:Feb 20 03:41:40 trial028 podman[148439]: 2026-02-20 03:41:40.916499801 +0000 UTC m=+0.278784383 container died 9a133b02ef4fbd5a0b3f832043c227245628fdcfa9c2d3923ef96002125b17ad (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-20T03:41:41.007 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.3.service' 2026-02-20T03:41:41.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:41.079 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-20T03:41:41.079 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-20T03:41:41.079 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.4 2026-02-20T03:41:41.595 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:41 trial126 systemd[1]: Stopping Ceph osd.4 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:41:41.596 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:41 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4[49259]: 2026-02-20T03:41:41.189+0000 7f8a581a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:41:41.596 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:41 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4[49259]: 2026-02-20T03:41:41.189+0000 7f8a581a9640 -1 osd.4 103 *** Got signal Terminated *** 2026-02-20T03:41:41.596 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:41 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4[49259]: 2026-02-20T03:41:41.189+0000 7f8a581a9640 -1 osd.4 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:41:42.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:41 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:41.766+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:42.347 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:42 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:42.027+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:42.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:41 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:41.993+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:43.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:42 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:42.812+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:43.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:42 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:42.998+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:43.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:42 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:42.990+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:44.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:43 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:43.822+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:44.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:44 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:44.024+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:44.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:43 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:43.974+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:45.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:44 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:44.814+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:45.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:44 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:44.983+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:45.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:44 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:44.946+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:20.360714+0000 front 2026-02-20T03:41:20.360753+0000 (oldest deadline 2026-02-20T03:41:44.460791+0000) 2026-02-20T03:41:45.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:45 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:45.072+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:46.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:45 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:45.948+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:46.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:45 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:45.952+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:20.360714+0000 front 2026-02-20T03:41:20.360753+0000 (oldest deadline 2026-02-20T03:41:44.460791+0000) 2026-02-20T03:41:46.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:46 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:46.054+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:46.350 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:45 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:45.857+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:47.058 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:46 trial126 podman[73774]: 2026-02-20 03:41:46.806036377 +0000 UTC m=+5.627898703 container died 36233f3afce9e4f560c2123745b9b4df7137cde308233d69a8fc78184761319c (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2026-02-20T03:41:47.059 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:46 trial126 podman[73774]: 2026-02-20 03:41:46.814380759 +0000 UTC m=+5.636243075 container remove 36233f3afce9e4f560c2123745b9b4df7137cde308233d69a8fc78184761319c (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0) 2026-02-20T03:41:47.059 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:46 trial126 bash[73774]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4 2026-02-20T03:41:47.059 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:46 trial126 podman[73900]: 2026-02-20 03:41:46.948862237 +0000 UTC m=+0.016610441 container create 77e4ac48e4a5b80dcc3355e1baa2509c0b406c42c8e804e65dea495dc2984916 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True) 2026-02-20T03:41:47.059 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:46 trial126 podman[73900]: 2026-02-20 03:41:46.977959489 +0000 UTC m=+0.045707633 container init 77e4ac48e4a5b80dcc3355e1baa2509c0b406c42c8e804e65dea495dc2984916 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4-deactivate, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T03:41:47.059 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:46 trial126 podman[73900]: 2026-02-20 03:41:46.98051632 +0000 UTC m=+0.048264454 container start 77e4ac48e4a5b80dcc3355e1baa2509c0b406c42c8e804e65dea495dc2984916 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4-deactivate, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-20T03:41:47.059 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:46 trial126 podman[73900]: 2026-02-20 03:41:46.980944815 +0000 UTC m=+0.048692959 container attach 77e4ac48e4a5b80dcc3355e1baa2509c0b406c42c8e804e65dea495dc2984916 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-4-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T03:41:47.059 INFO:journalctl@ceph.osd.4.trial126.stdout:Feb 20 03:41:47 trial126 podman[73900]: 2026-02-20 03:41:46.942641302 +0000 UTC m=+0.010389446 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:41:47.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:46 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:46.844+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:47.138 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.4.service' 2026-02-20T03:41:47.175 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:47.176 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-20T03:41:47.176 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-20T03:41:47.176 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.5 2026-02-20T03:41:47.277 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:46 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:46.984+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:47.278 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:46 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:46.986+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:20.360714+0000 front 2026-02-20T03:41:20.360753+0000 (oldest deadline 2026-02-20T03:41:44.460791+0000) 2026-02-20T03:41:47.278 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:47 trial177 systemd[1]: Stopping Ceph osd.5 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:41:47.278 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:47 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:47.276+0000 7f2bea80a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:41:47.278 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:47 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:47.276+0000 7f2bea80a640 -1 osd.5 103 *** Got signal Terminated *** 2026-02-20T03:41:47.279 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:47 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:47.276+0000 7f2bea80a640 -1 osd.5 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:41:47.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:47 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:47.065+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:48.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:47 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:47.835+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:48.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:47 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:47.962+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:48.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:47 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:47.944+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:20.360714+0000 front 2026-02-20T03:41:20.360753+0000 (oldest deadline 2026-02-20T03:41:44.460791+0000) 2026-02-20T03:41:48.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:48 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:48.066+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:49.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:48 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:48.805+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:49.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:48 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:48.919+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:49.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:48 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:48.972+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:20.360714+0000 front 2026-02-20T03:41:20.360753+0000 (oldest deadline 2026-02-20T03:41:44.460791+0000) 2026-02-20T03:41:49.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:48 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:48.972+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.461199+0000 front 2026-02-20T03:41:24.461206+0000 (oldest deadline 2026-02-20T03:41:48.561216+0000) 2026-02-20T03:41:49.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:49 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:49.047+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:49.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:49 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:49.047+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:49.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:49 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:49.311+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:50.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:49 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:49.794+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:50.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:49 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:49.942+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:50.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:50 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:50.005+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:20.360714+0000 front 2026-02-20T03:41:20.360753+0000 (oldest deadline 2026-02-20T03:41:44.460791+0000) 2026-02-20T03:41:50.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:50 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:50.005+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.461199+0000 front 2026-02-20T03:41:24.461206+0000 (oldest deadline 2026-02-20T03:41:48.561216+0000) 2026-02-20T03:41:50.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:50 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:50.088+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:50.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:50 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:50.088+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:50.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:50 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:50.302+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:51.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:50 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:50.757+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:51.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:50 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:50.757+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:51.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:50 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:50.905+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:51.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:51 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:51.015+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:20.360714+0000 front 2026-02-20T03:41:20.360753+0000 (oldest deadline 2026-02-20T03:41:44.460791+0000) 2026-02-20T03:41:51.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:51 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:51.015+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.461199+0000 front 2026-02-20T03:41:24.461206+0000 (oldest deadline 2026-02-20T03:41:48.561216+0000) 2026-02-20T03:41:51.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:50 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:50.828+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:41:51.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:51 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:51.101+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:51.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:51 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:51.101+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:51.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:51 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:51.344+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:52.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:51 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:51.707+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:52.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:51 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:51.707+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:52.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:51 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:51.933+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:52.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:52 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:52.041+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:20.360714+0000 front 2026-02-20T03:41:20.360753+0000 (oldest deadline 2026-02-20T03:41:44.460791+0000) 2026-02-20T03:41:52.218 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:52 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5[54435]: 2026-02-20T03:41:52.041+0000 7f2be6e23640 -1 osd.5 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.461199+0000 front 2026-02-20T03:41:24.461206+0000 (oldest deadline 2026-02-20T03:41:48.561216+0000) 2026-02-20T03:41:52.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:51 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:51.831+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:41:52.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:52 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:52.060+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:52.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:52 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:52.060+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:52.717 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:52 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:52.359+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:53.080 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:52 trial177 podman[79787]: 2026-02-20 03:41:52.933690618 +0000 UTC m=+5.669838235 container died 25a2493cd137b5dbd1a80e3c92ec4c513f0b5f7f3da68c19ce9265414deb5177 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, org.label-schema.build-date=20260216, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T03:41:53.080 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:52 trial177 podman[79787]: 2026-02-20 03:41:52.942688736 +0000 UTC m=+5.678836353 container remove 25a2493cd137b5dbd1a80e3c92ec4c513f0b5f7f3da68c19ce9265414deb5177 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:41:53.080 INFO:journalctl@ceph.osd.5.trial177.stdout:Feb 20 03:41:52 trial177 bash[79787]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-5 2026-02-20T03:41:53.080 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:52 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:52.785+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:41:53.081 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:52 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:52.909+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:53.100 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:52 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:52.716+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:53.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:52 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:52.716+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:53.269 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.5.service' 2026-02-20T03:41:53.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:41:53.306 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-20T03:41:53.306 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-20T03:41:53.307 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.6 2026-02-20T03:41:53.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:53 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:53.041+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:53.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:53 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:53.041+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:53.346 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:41:52 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:41:52.951+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:41:53.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:53 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:53.311+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:53.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:53 trial028 systemd[1]: Stopping Ceph osd.6 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:41:53.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:53 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:53.492+0000 7ff975ffe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:41:53.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:53 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:53.492+0000 7ff975ffe640 -1 osd.6 103 *** Got signal Terminated *** 2026-02-20T03:41:53.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:53 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:53.492+0000 7ff975ffe640 -1 osd.6 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:41:54.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:53 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:53.745+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:54.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:53 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:53.745+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:54.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:53.800+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:41:54.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:53.907+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:54.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:53 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:53.907+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:41:54.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:41:53 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:41:53.925+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:41:54.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:54.019+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:54.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:54.019+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:54.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:54 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:54.327+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:55.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:54 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:54.733+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:55.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:54 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:54.733+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:55.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:54.843+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:41:55.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:54.889+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:55.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:54 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:54.889+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:41:55.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:41:54 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:41:54.973+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:41:55.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:55.068+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:55.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:55.068+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:55.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:55 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:55.346+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:56.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:55 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:55.720+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:56.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:55 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:55.720+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:56.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:55 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:55.853+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:41:56.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:55 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:55.853+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:41:56.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:55 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:55.918+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:56.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:55 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:55.918+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:41:56.219 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:55 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:55.918+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:41:56.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:41:55 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:41:55.994+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:41:56.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:56 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:56.094+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:56.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:56 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:56.094+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:56.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:56 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:56.094+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:41:56.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:56 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:56.296+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:56.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:56 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:56.296+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.343907+0000 front 2026-02-20T03:41:33.343945+0000 (oldest deadline 2026-02-20T03:41:55.544529+0000) 2026-02-20T03:41:57.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:56 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:56.675+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:57.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:56 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:56.675+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:57.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:56 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:56.847+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:41:57.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:56 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:56.847+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:41:57.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:56 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:56.914+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:57.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:56 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:56.914+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:41:57.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:56 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:56.914+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:41:57.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:41:57 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:41:57.015+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:41:57.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:57 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:57.098+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:57.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:57 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:57.098+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:57.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:57 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:57.098+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:41:57.600 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:57 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:57.308+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:57.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:57 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:57.308+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.343907+0000 front 2026-02-20T03:41:33.343945+0000 (oldest deadline 2026-02-20T03:41:55.544529+0000) 2026-02-20T03:41:58.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:57 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:57.641+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:58.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:57 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:57.641+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:58.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:57 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:57.641+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:41:58.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:57 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:57.802+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:41:58.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:57 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:57.802+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:41:58.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:57 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:57.933+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:58.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:57 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:57.933+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:41:58.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:57 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:57.933+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:41:58.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:41:58 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:41:58.063+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:41:58.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:41:58 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:41:58.063+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.489600+0000 front 2026-02-20T03:41:32.489622+0000 (oldest deadline 2026-02-20T03:41:57.789695+0000) 2026-02-20T03:41:58.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:58 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:58.062+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:58.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:58 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:58.062+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:58.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:58 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:58.062+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:41:58.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:58 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:58.346+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.543069+0000 front 2026-02-20T03:41:24.543174+0000 (oldest deadline 2026-02-20T03:41:49.243087+0000) 2026-02-20T03:41:58.601 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:58 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6[61710]: 2026-02-20T03:41:58.346+0000 7ff972617640 -1 osd.6 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.343907+0000 front 2026-02-20T03:41:33.343945+0000 (oldest deadline 2026-02-20T03:41:55.544529+0000) 2026-02-20T03:41:59.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:58 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:58.673+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:59.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:58 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:58.673+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:59.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:58 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:58.673+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:41:59.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:58 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:58.838+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:41:59.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:58 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:58.838+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:41:59.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:58 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:58.908+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:41:59.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:58 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:58.908+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:41:59.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:58 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:58.908+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:41:59.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:41:59 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:41:59.080+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:41:59.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:41:59 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:41:59.080+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.489600+0000 front 2026-02-20T03:41:32.489622+0000 (oldest deadline 2026-02-20T03:41:57.789695+0000) 2026-02-20T03:41:59.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:59 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:59.053+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:41:59.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:59 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:59.053+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:41:59.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:41:59 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:41:59.053+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:41:59.662 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:59 trial028 podman[148555]: 2026-02-20 03:41:59.369567564 +0000 UTC m=+5.901999729 container died fd2350b223eb82657bd63fbf64d67183d3d452debf870143205684dd36498f03 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.build-date=20260216) 2026-02-20T03:41:59.662 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:59 trial028 podman[148555]: 2026-02-20 03:41:59.427903793 +0000 UTC m=+5.960335968 container remove fd2350b223eb82657bd63fbf64d67183d3d452debf870143205684dd36498f03 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216) 2026-02-20T03:41:59.662 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:59 trial028 bash[148555]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6 2026-02-20T03:41:59.933 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:59 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:59.660+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:41:59.933 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:59 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:59.660+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:41:59.933 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:41:59 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:41:59.660+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:41:59.934 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:59 trial028 podman[148656]: 2026-02-20 03:41:59.696952329 +0000 UTC m=+0.029135385 container create 77284f2281b395520d09349e1ff9c55bdc300469e155212892124bc165b4d499 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6-deactivate, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS) 2026-02-20T03:41:59.934 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:59 trial028 podman[148656]: 2026-02-20 03:41:59.743047158 +0000 UTC m=+0.075230214 container init 77284f2281b395520d09349e1ff9c55bdc300469e155212892124bc165b4d499 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6-deactivate, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T03:41:59.934 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:59 trial028 podman[148656]: 2026-02-20 03:41:59.748633696 +0000 UTC m=+0.080816752 container start 77284f2281b395520d09349e1ff9c55bdc300469e155212892124bc165b4d499 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6-deactivate, OSD_FLAVOR=default, org.label-schema.build-date=20260216, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS) 2026-02-20T03:41:59.934 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:59 trial028 podman[148656]: 2026-02-20 03:41:59.749467044 +0000 UTC m=+0.081650100 container attach 77284f2281b395520d09349e1ff9c55bdc300469e155212892124bc165b4d499 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, ceph=True) 2026-02-20T03:41:59.934 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:59 trial028 podman[148656]: 2026-02-20 03:41:59.686464676 +0000 UTC m=+0.018647732 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:41:59.935 INFO:journalctl@ceph.osd.6.trial028.stdout:Feb 20 03:41:59 trial028 podman[148656]: 2026-02-20 03:41:59.931072137 +0000 UTC m=+0.263255184 container died 77284f2281b395520d09349e1ff9c55bdc300469e155212892124bc165b4d499 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-6-deactivate, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-20T03:42:00.015 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.6.service' 2026-02-20T03:42:00.087 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:00.087 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-20T03:42:00.088 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-20T03:42:00.088 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.7 2026-02-20T03:42:00.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:59 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:59.823+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:00.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:41:59 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:41:59.823+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:00.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:59 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:59.920+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:00.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:59 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:59.920+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:00.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:41:59 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:41:59.920+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:00.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:00 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:00.034+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:00.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:00 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:00.034+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:00.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:00 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:00.034+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:00.346 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:00 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:00.066+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:42:00.346 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:00 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:00.066+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.489600+0000 front 2026-02-20T03:41:32.489622+0000 (oldest deadline 2026-02-20T03:41:57.789695+0000) 2026-02-20T03:42:00.346 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:00 trial126 systemd[1]: Stopping Ceph osd.7 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:00.346 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:00 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:00.194+0000 7f6080698640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:00.346 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:00 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:00.194+0000 7f6080698640 -1 osd.7 103 *** Got signal Terminated *** 2026-02-20T03:42:00.346 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:00 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:00.194+0000 7f6080698640 -1 osd.7 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:42:01.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:00 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:00.687+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:01.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:00 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:00.687+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:01.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:00 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:00.687+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:01.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:00 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:00.687+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:01.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:00 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:00.868+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:01.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:00 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:00.868+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:01.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:00 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:00.952+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:01.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:00 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:00.952+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:01.219 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:00 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:00.952+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:01.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:01 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:01.091+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:42:01.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:01 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:01.091+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.489600+0000 front 2026-02-20T03:41:32.489622+0000 (oldest deadline 2026-02-20T03:41:57.789695+0000) 2026-02-20T03:42:01.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:01 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:01.091+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:37.790038+0000 front 2026-02-20T03:41:37.790063+0000 (oldest deadline 2026-02-20T03:42:00.690052+0000) 2026-02-20T03:42:01.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:01 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:01.023+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:01.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:01 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:01.023+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:01.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:01 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:01.023+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:01.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:01 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:01.023+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:02.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:01 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:01.708+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:02.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:01 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:01.708+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:02.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:01 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:01.708+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:02.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:01 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:01.708+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:02.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:01 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:01.877+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:02.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:01 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:01.877+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:02.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:01 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:01.940+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:02.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:01 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:01.940+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:02.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:01 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:01.940+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:02.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:02.084+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:42:02.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:02.084+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.489600+0000 front 2026-02-20T03:41:32.489622+0000 (oldest deadline 2026-02-20T03:41:57.789695+0000) 2026-02-20T03:42:02.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:02.084+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:37.790038+0000 front 2026-02-20T03:41:37.790063+0000 (oldest deadline 2026-02-20T03:42:00.690052+0000) 2026-02-20T03:42:02.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:02.014+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:02.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:02.014+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:02.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:02.014+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:02.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:02 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:02.014+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:03.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:02 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:02.687+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:03.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:02 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:02.687+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:03.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:02 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:02.687+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:03.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:02 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:02.687+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:03.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:02 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:02.915+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:03.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:02 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:02.915+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:03.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:02 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:02.937+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:03.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:02 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:02.937+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:03.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:02 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:02.937+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:03.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:03 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:03.057+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:42:03.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:03 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:03.057+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.489600+0000 front 2026-02-20T03:41:32.489622+0000 (oldest deadline 2026-02-20T03:41:57.789695+0000) 2026-02-20T03:42:03.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:03 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:03.057+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:37.790038+0000 front 2026-02-20T03:41:37.790063+0000 (oldest deadline 2026-02-20T03:42:00.690052+0000) 2026-02-20T03:42:03.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:03 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:03.062+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:03.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:03 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:03.062+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:03.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:03 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:03.062+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:03.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:03 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:03.062+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:04.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:03 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:03.689+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:04.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:03 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:03.689+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:04.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:03 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:03.689+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:04.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:03 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:03.689+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:04.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:03 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:03.896+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:04.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:03 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:03.896+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:04.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:03 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:03.896+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:04.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:03 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:03.961+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:04.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:03 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:03.961+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:04.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:03 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:03.961+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:39.368420+0000 front 2026-02-20T03:41:39.368741+0000 (oldest deadline 2026-02-20T03:42:03.468444+0000) 2026-02-20T03:42:04.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:04 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:04.088+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:42:04.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:04 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:04.088+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.489600+0000 front 2026-02-20T03:41:32.489622+0000 (oldest deadline 2026-02-20T03:41:57.789695+0000) 2026-02-20T03:42:04.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:04 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:04.088+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:37.790038+0000 front 2026-02-20T03:41:37.790063+0000 (oldest deadline 2026-02-20T03:42:00.690052+0000) 2026-02-20T03:42:04.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:04 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:04.018+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:04.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:04 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:04.018+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:04.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:04 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:04.018+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:04.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:04 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:04.018+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:05.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:04 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:04.729+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:05.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:04 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:04.729+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:05.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:04 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:04.729+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:05.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:04 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:04.729+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:05.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:04 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:04.912+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:05.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:04 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:04.912+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:05.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:04 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:04.912+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:39.368420+0000 front 2026-02-20T03:41:39.368741+0000 (oldest deadline 2026-02-20T03:42:03.468444+0000) 2026-02-20T03:42:05.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:04 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:04.943+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:05.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:04 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:04.943+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:05.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:04 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:04.943+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:05.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:05.084+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:27.189172+0000 front 2026-02-20T03:41:27.189183+0000 (oldest deadline 2026-02-20T03:41:52.489269+0000) 2026-02-20T03:42:05.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:05.084+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.489600+0000 front 2026-02-20T03:41:32.489622+0000 (oldest deadline 2026-02-20T03:41:57.789695+0000) 2026-02-20T03:42:05.345 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7[55456]: 2026-02-20T03:42:05.084+0000 7f6078ca9640 -1 osd.7 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:37.790038+0000 front 2026-02-20T03:41:37.790063+0000 (oldest deadline 2026-02-20T03:42:00.690052+0000) 2026-02-20T03:42:05.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:05 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:05.056+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:05.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:05 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:05.056+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:05.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:05 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:05.056+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:05.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:05 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:05.056+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:05.989 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 podman[74040]: 2026-02-20 03:42:05.69846532 +0000 UTC m=+5.516678570 container died 2954902dceabe5e01538e5d3311382ac076928b2b2e0f8857b046374195abd20 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS) 2026-02-20T03:42:05.989 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 podman[74040]: 2026-02-20 03:42:05.706592159 +0000 UTC m=+5.524805399 container remove 2954902dceabe5e01538e5d3311382ac076928b2b2e0f8857b046374195abd20 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, ceph=True) 2026-02-20T03:42:05.989 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 bash[74040]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7 2026-02-20T03:42:05.989 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 podman[74171]: 2026-02-20 03:42:05.839179635 +0000 UTC m=+0.017052029 container create a54801692217976dc738c84f73cf06d0edc3ba1c4d7b278566c89b03530c907b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7-deactivate, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid) 2026-02-20T03:42:05.989 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 podman[74171]: 2026-02-20 03:42:05.867466084 +0000 UTC m=+0.045338408 container init a54801692217976dc738c84f73cf06d0edc3ba1c4d7b278566c89b03530c907b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, org.label-schema.build-date=20260216) 2026-02-20T03:42:05.990 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 podman[74171]: 2026-02-20 03:42:05.87010134 +0000 UTC m=+0.047973664 container start a54801692217976dc738c84f73cf06d0edc3ba1c4d7b278566c89b03530c907b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, ceph=True, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T03:42:05.990 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 podman[74171]: 2026-02-20 03:42:05.870659816 +0000 UTC m=+0.048532140 container attach a54801692217976dc738c84f73cf06d0edc3ba1c4d7b278566c89b03530c907b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2026-02-20T03:42:05.990 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 podman[74171]: 2026-02-20 03:42:05.832086843 +0000 UTC m=+0.009959167 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:42:05.990 INFO:journalctl@ceph.osd.7.trial126.stdout:Feb 20 03:42:05 trial126 podman[74171]: 2026-02-20 03:42:05.997423463 +0000 UTC m=+0.175295787 container died a54801692217976dc738c84f73cf06d0edc3ba1c4d7b278566c89b03530c907b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-7-deactivate, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T03:42:06.024 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.7.service' 2026-02-20T03:42:06.061 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:06.061 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-20T03:42:06.061 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-20T03:42:06.061 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.8 2026-02-20T03:42:06.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:05 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:05.722+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:06.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:05 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:05.722+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:06.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:05 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:05.722+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:06.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:05 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:05.722+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:06.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:05 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:05.982+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:06.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:05 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:05.982+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:06.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:05 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:05.982+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:06.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:05 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:05.946+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:06.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:05 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:05.946+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:06.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:05 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:05.946+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:39.368420+0000 front 2026-02-20T03:41:39.368741+0000 (oldest deadline 2026-02-20T03:42:03.468444+0000) 2026-02-20T03:42:06.219 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:06 trial177 systemd[1]: Stopping Ceph osd.8 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:06.219 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:06.160+0000 7f652c849640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:06.219 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:06.160+0000 7f652c849640 -1 osd.8 103 *** Got signal Terminated *** 2026-02-20T03:42:06.219 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:06.160+0000 7f652c849640 -1 osd.8 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:42:06.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:06 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:06.043+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:06.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:06 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:06.043+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:06.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:06 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:06.043+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:06.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:06 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:06.043+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:07.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:06.703+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:07.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:06.703+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:07.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:06.703+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:07.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:06 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:06.703+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:07.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:06.956+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:07.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:06.956+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:07.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:06.956+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:39.368420+0000 front 2026-02-20T03:41:39.368741+0000 (oldest deadline 2026-02-20T03:42:03.468444+0000) 2026-02-20T03:42:07.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:06.955+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:07.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:06.955+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:07.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:06 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:06.955+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:07.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:07 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:07.070+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:07.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:07 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:07.070+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:07.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:07 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:07.070+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:07.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:07 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:07.070+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:08.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:07.718+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:08.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:07.718+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:08.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:07.718+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:08.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:07 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:07.718+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:08.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:07 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:07.964+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:08.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:07 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:07.964+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:08.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:07 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:07.964+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:08.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:07 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:07.934+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:08.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:07 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:07.934+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:08.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:07 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:07.934+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:39.368420+0000 front 2026-02-20T03:41:39.368741+0000 (oldest deadline 2026-02-20T03:42:03.468444+0000) 2026-02-20T03:42:08.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:07 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:07.934+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:43.468707+0000 front 2026-02-20T03:41:43.468659+0000 (oldest deadline 2026-02-20T03:42:06.968672+0000) 2026-02-20T03:42:08.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:08 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:08.108+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:08.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:08 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:08.108+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:08.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:08 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:08.108+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:08.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:08 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:08.108+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:09.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:08 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:08.692+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:09.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:08 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:08.692+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:09.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:08 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:08.692+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:09.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:08 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:08.692+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:09.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:08 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:08.692+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:41.959499+0000 front 2026-02-20T03:41:41.959514+0000 (oldest deadline 2026-02-20T03:42:07.859607+0000) 2026-02-20T03:42:09.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:08.942+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:09.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:08.942+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:09.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:08.942+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:39.368420+0000 front 2026-02-20T03:41:39.368741+0000 (oldest deadline 2026-02-20T03:42:03.468444+0000) 2026-02-20T03:42:09.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:08 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:08.942+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:43.468707+0000 front 2026-02-20T03:41:43.468659+0000 (oldest deadline 2026-02-20T03:42:06.968672+0000) 2026-02-20T03:42:09.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:09.000+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:09.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:09.000+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:09.219 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:09.000+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:09.219 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:09.000+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:09.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:09 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:09.080+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:09.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:09 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:09.080+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:09.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:09 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:09.080+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:09.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:09 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:09.080+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:09.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:09 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:09.080+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:10.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:09 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:09.686+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:10.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:09 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:09.686+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:10.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:09 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:09.686+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:10.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:09 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:09.686+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:10.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:09 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:09.686+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:41.959499+0000 front 2026-02-20T03:41:41.959514+0000 (oldest deadline 2026-02-20T03:42:07.859607+0000) 2026-02-20T03:42:10.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:10 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:10.096+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:10.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:10 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:10.096+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:10.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:10 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:10.096+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:10.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:10 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:10.096+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:10.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:10 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:10.096+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:10.468 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:09.971+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:10.468 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:09.971+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:10.468 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:09.971+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:39.368420+0000 front 2026-02-20T03:41:39.368741+0000 (oldest deadline 2026-02-20T03:42:03.468444+0000) 2026-02-20T03:42:10.468 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:09.971+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:43.468707+0000 front 2026-02-20T03:41:43.468659+0000 (oldest deadline 2026-02-20T03:42:06.968672+0000) 2026-02-20T03:42:10.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:09.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:10.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:09.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:10.469 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:09.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:10.469 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:09 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:09.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:11.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:10 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:10.654+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:11.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:10 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:10.654+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:11.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:10 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:10.654+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:11.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:10 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:10.654+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:11.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:10 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:10.654+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:41.959499+0000 front 2026-02-20T03:41:41.959514+0000 (oldest deadline 2026-02-20T03:42:07.859607+0000) 2026-02-20T03:42:11.217 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:10 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:10.934+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:25.267638+0000 front 2026-02-20T03:41:25.267663+0000 (oldest deadline 2026-02-20T03:41:50.567469+0000) 2026-02-20T03:42:11.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:10 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:10.934+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.567686+0000 front 2026-02-20T03:41:30.567697+0000 (oldest deadline 2026-02-20T03:41:55.267781+0000) 2026-02-20T03:42:11.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:10 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:10.934+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:39.368420+0000 front 2026-02-20T03:41:39.368741+0000 (oldest deadline 2026-02-20T03:42:03.468444+0000) 2026-02-20T03:42:11.218 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:10 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8[60634]: 2026-02-20T03:42:10.934+0000 7f6524e5a640 -1 osd.8 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:43.468707+0000 front 2026-02-20T03:41:43.468659+0000 (oldest deadline 2026-02-20T03:42:06.968672+0000) 2026-02-20T03:42:11.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:11 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:11.024+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:11.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:11 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:11.024+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:11.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:11 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:11.024+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:11.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:11 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:11.024+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:11.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:11 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:11.117+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:11.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:11 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:11.117+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:11.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:11 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:11.117+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:11.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:11 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:11.117+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:11.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:11 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:11.117+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:12.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:11.615+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:12.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:11.615+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:12.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:11.615+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:12.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:11.615+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:12.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:11 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:11.615+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:41.959499+0000 front 2026-02-20T03:41:41.959514+0000 (oldest deadline 2026-02-20T03:42:07.859607+0000) 2026-02-20T03:42:12.125 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:11 trial177 podman[80057]: 2026-02-20 03:42:11.816007293 +0000 UTC m=+5.668168782 container died 16c1d09876b0fbfc532481334980d9cef8e7be917e1f545452219893e179ec4b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8, org.label-schema.build-date=20260216, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True) 2026-02-20T03:42:12.126 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:11 trial177 podman[80057]: 2026-02-20 03:42:11.824825708 +0000 UTC m=+5.676987197 container remove 16c1d09876b0fbfc532481334980d9cef8e7be917e1f545452219893e179ec4b (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:42:12.126 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:11 trial177 bash[80057]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8 2026-02-20T03:42:12.126 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:11 trial177 podman[80187]: 2026-02-20 03:42:11.956313417 +0000 UTC m=+0.015835903 container create c76c466bae7bb9cc869e39521ae2e5ece0953e4706f2cba16b5188c671a10657 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, ceph=True, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T03:42:12.127 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:12 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:12.047+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:12.127 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:12 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:12.047+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:12.127 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:12 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:12.047+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:12.127 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:12 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:12.047+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:12.127 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:11 trial177 podman[80187]: 2026-02-20 03:42:11.99116489 +0000 UTC m=+0.050687376 container init c76c466bae7bb9cc869e39521ae2e5ece0953e4706f2cba16b5188c671a10657 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8-deactivate, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, ceph=True, OSD_FLAVOR=default) 2026-02-20T03:42:12.127 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:11 trial177 podman[80187]: 2026-02-20 03:42:11.993970563 +0000 UTC m=+0.053493049 container start c76c466bae7bb9cc869e39521ae2e5ece0953e4706f2cba16b5188c671a10657 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, ceph=True) 2026-02-20T03:42:12.127 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:11 trial177 podman[80187]: 2026-02-20 03:42:11.994469189 +0000 UTC m=+0.053991675 container attach c76c466bae7bb9cc869e39521ae2e5ece0953e4706f2cba16b5188c671a10657 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2026-02-20T03:42:12.128 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:12 trial177 podman[80187]: 2026-02-20 03:42:11.949591869 +0000 UTC m=+0.009114365 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:42:12.128 INFO:journalctl@ceph.osd.8.trial177.stdout:Feb 20 03:42:12 trial177 podman[80187]: 2026-02-20 03:42:12.125697127 +0000 UTC m=+0.185219613 container died c76c466bae7bb9cc869e39521ae2e5ece0953e4706f2cba16b5188c671a10657 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-8-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, OSD_FLAVOR=default) 2026-02-20T03:42:12.161 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.8.service' 2026-02-20T03:42:12.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:12.198 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-20T03:42:12.198 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-20T03:42:12.198 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.9 2026-02-20T03:42:12.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:12 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:12.152+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:12.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:12 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:12.152+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:12.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:12 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:12.152+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:12.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:12 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:12.152+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:12.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:12 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:12.152+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:12.601 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:12 trial028 systemd[1]: Stopping Ceph osd.9 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:12.601 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:12.380+0000 7f6b7d764640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:12.601 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:12.380+0000 7f6b7d764640 -1 osd.9 103 *** Got signal Terminated *** 2026-02-20T03:42:12.601 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:12.380+0000 7f6b7d764640 -1 osd.9 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:42:13.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:12.610+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:13.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:12.610+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:13.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:12.610+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:13.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:12.610+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:13.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:12 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:12.610+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:41.959499+0000 front 2026-02-20T03:41:41.959514+0000 (oldest deadline 2026-02-20T03:42:07.859607+0000) 2026-02-20T03:42:13.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:13 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:13.056+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:13.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:13 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:13.056+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:13.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:13 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:13.056+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:13.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:13 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:13.056+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:13.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:13 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:13.174+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:13.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:13 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:13.174+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:13.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:13 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:13.174+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:13.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:13 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:13.174+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:13.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:13 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:13.174+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:14.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:13.625+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:14.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:13.625+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:14.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:13.625+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:14.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:13.625+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:14.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:13 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:13.625+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:41.959499+0000 front 2026-02-20T03:41:41.959514+0000 (oldest deadline 2026-02-20T03:42:07.859607+0000) 2026-02-20T03:42:14.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:14 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:14.027+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:14.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:14 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:14.027+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:14.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:14 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:14.027+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:14.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:14 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:14.027+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:14.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:14 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:14.027+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:14.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:14 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:14.148+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:14.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:14 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:14.148+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:14.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:14 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:14.148+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:14.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:14 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:14.148+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:14.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:14 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:14.148+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:15.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:14.631+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:15.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:14.631+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:15.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:14.631+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:15.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:14.631+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:15.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:14 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:14.631+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:41.959499+0000 front 2026-02-20T03:41:41.959514+0000 (oldest deadline 2026-02-20T03:42:07.859607+0000) 2026-02-20T03:42:15.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:15 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:15.023+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:15.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:15 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:15.023+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:15.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:15 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:15.023+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:15.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:15 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:15.023+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:15.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:15 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:15.023+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:15.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:15 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:15.136+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:15.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:15 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:15.136+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:15.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:15 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:15.136+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:15.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:15 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:15.136+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:15.595 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:15 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:15.136+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:16.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:15 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:15.651+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:16.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:15 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:15.651+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:16.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:15 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:15.651+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:16.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:15 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:15.651+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:16.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:15 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:15.651+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:41.959499+0000 front 2026-02-20T03:41:41.959514+0000 (oldest deadline 2026-02-20T03:42:07.859607+0000) 2026-02-20T03:42:16.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:15 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:15.651+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:49.560505+0000 front 2026-02-20T03:41:49.560481+0000 (oldest deadline 2026-02-20T03:42:15.460593+0000) 2026-02-20T03:42:16.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:16 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:16.100+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:16.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:16 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:16.100+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:16.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:16 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:16.100+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:16.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:16 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:16.100+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:16.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:16 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:16.100+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:16.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:16 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:16.058+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:16.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:16 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:16.058+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:16.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:16 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:16.058+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:16.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:16 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:16.058+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:16.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:16 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:16.058+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:17.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:16.693+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.956981+0000 front 2026-02-20T03:41:19.957130+0000 (oldest deadline 2026-02-20T03:41:41.657025+0000) 2026-02-20T03:42:17.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:16.693+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:21.657538+0000 front 2026-02-20T03:41:21.657301+0000 (oldest deadline 2026-02-20T03:41:50.457568+0000) 2026-02-20T03:42:17.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:16.693+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:32.757996+0000 front 2026-02-20T03:41:32.758040+0000 (oldest deadline 2026-02-20T03:41:56.858036+0000) 2026-02-20T03:42:17.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:16.693+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:36.858213+0000 front 2026-02-20T03:41:36.858301+0000 (oldest deadline 2026-02-20T03:42:00.358305+0000) 2026-02-20T03:42:17.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:16.693+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:41.959499+0000 front 2026-02-20T03:41:41.959514+0000 (oldest deadline 2026-02-20T03:42:07.859607+0000) 2026-02-20T03:42:17.101 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:16 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9[67425]: 2026-02-20T03:42:16.693+0000 7f6b79d7d640 -1 osd.9 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:49.560505+0000 front 2026-02-20T03:41:49.560481+0000 (oldest deadline 2026-02-20T03:42:15.460593+0000) 2026-02-20T03:42:17.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:17 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:17.084+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:17.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:17 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:17.084+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:17.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:17 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:17.084+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:17.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:17 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:17.084+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:17.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:17 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:17.084+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:17.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:17 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:17.084+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:48.812803+0000 front 2026-02-20T03:41:48.812883+0000 (oldest deadline 2026-02-20T03:42:17.013147+0000) 2026-02-20T03:42:17.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:17 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:17.012+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:17.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:17 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:17.012+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:17.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:17 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:17.012+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:17.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:17 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:17.012+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:17.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:17 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:17.012+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:18.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:18 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:18.050+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:18.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:18 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:18.050+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:18.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:18 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:18.050+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:18.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:18 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:18.050+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:18.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:18 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:18.050+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:18.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:18 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:18.050+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:48.812803+0000 front 2026-02-20T03:41:48.812883+0000 (oldest deadline 2026-02-20T03:42:17.013147+0000) 2026-02-20T03:42:18.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:18 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:18.054+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:18.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:18 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:18.054+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:18.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:18 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:18.054+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:18.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:18 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:18.054+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:18.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:18 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:18.054+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:18.524 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:18 trial028 podman[148772]: 2026-02-20 03:42:18.215954421 +0000 UTC m=+5.860524841 container died d7fdd1c73bc1b5da98faab58f880d6d6eb6d1105950ce8ca6b815bc41594d650 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T03:42:18.524 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:18 trial028 podman[148772]: 2026-02-20 03:42:18.273582926 +0000 UTC m=+5.918153346 container remove d7fdd1c73bc1b5da98faab58f880d6d6eb6d1105950ce8ca6b815bc41594d650 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, ceph=True, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS) 2026-02-20T03:42:18.525 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:18 trial028 bash[148772]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9 2026-02-20T03:42:18.784 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:18 trial028 podman[148879]: 2026-02-20 03:42:18.523153859 +0000 UTC m=+0.027372901 container create abfce7afc5187c77dc86b080309e0b09d5c0675e5d753e08fd6b92db1441d4ad (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9-deactivate, io.buildah.version=1.33.7, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.vendor=CentOS) 2026-02-20T03:42:18.784 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:18 trial028 podman[148879]: 2026-02-20 03:42:18.574744497 +0000 UTC m=+0.078963539 container init abfce7afc5187c77dc86b080309e0b09d5c0675e5d753e08fd6b92db1441d4ad (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image) 2026-02-20T03:42:18.784 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:18 trial028 podman[148879]: 2026-02-20 03:42:18.580191726 +0000 UTC m=+0.084410768 container start abfce7afc5187c77dc86b080309e0b09d5c0675e5d753e08fd6b92db1441d4ad (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9-deactivate, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:42:18.784 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:18 trial028 podman[148879]: 2026-02-20 03:42:18.581445335 +0000 UTC m=+0.085664377 container attach abfce7afc5187c77dc86b080309e0b09d5c0675e5d753e08fd6b92db1441d4ad (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.label-schema.build-date=20260216) 2026-02-20T03:42:18.784 INFO:journalctl@ceph.osd.9.trial028.stdout:Feb 20 03:42:18 trial028 podman[148879]: 2026-02-20 03:42:18.514317403 +0000 UTC m=+0.018536445 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:42:18.869 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.9.service' 2026-02-20T03:42:18.940 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:18.941 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-20T03:42:18.941 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-20T03:42:18.941 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.10 2026-02-20T03:42:19.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:18 trial126 systemd[1]: Stopping Ceph osd.10 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:19.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:19.002+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:19.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:19.002+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:19.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:19.002+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:19.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:19.002+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:19.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:19.002+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:19.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:19.002+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:48.812803+0000 front 2026-02-20T03:41:48.812883+0000 (oldest deadline 2026-02-20T03:42:17.013147+0000) 2026-02-20T03:42:19.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:19.050+0000 7fb0cca84640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:19.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:19.050+0000 7fb0cca84640 -1 osd.10 103 *** Got signal Terminated *** 2026-02-20T03:42:19.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:19 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:19.050+0000 7fb0cca84640 -1 osd.10 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:42:19.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.018+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:19.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.018+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:19.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.018+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:19.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.018+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:19.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.018+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:20.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.005+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:20.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.005+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:20.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.005+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:20.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.005+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:20.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.005+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:20.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.005+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:48.812803+0000 front 2026-02-20T03:41:48.812883+0000 (oldest deadline 2026-02-20T03:42:17.013147+0000) 2026-02-20T03:42:20.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.987+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:20.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.987+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:20.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.987+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:20.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.987+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:20.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:19 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:19.987+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:21.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.978+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:21.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.978+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:21.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.978+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:21.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.978+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:21.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.978+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:21.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:20 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:20.978+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:48.812803+0000 front 2026-02-20T03:41:48.812883+0000 (oldest deadline 2026-02-20T03:42:17.013147+0000) 2026-02-20T03:42:21.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:21 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:21.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:21.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:21 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:21.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:21.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:21 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:21.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:21.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:21 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:21.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:21.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:21 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:21.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:21.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:21 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:21.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:22.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.024+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:22.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.024+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:22.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.024+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:22.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.024+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:22.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.024+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:22.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.024+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:48.812803+0000 front 2026-02-20T03:41:48.812883+0000 (oldest deadline 2026-02-20T03:42:17.013147+0000) 2026-02-20T03:42:22.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.024+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:57.513620+0000 front 2026-02-20T03:41:57.513672+0000 (oldest deadline 2026-02-20T03:42:21.613634+0000) 2026-02-20T03:42:22.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.010+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:22.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.010+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:22.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.010+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:22.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.010+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:22.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.010+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:22.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.010+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:23.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.989+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:23.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.989+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:23.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.989+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:23.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.989+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:23.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.989+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:23.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.989+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:48.812803+0000 front 2026-02-20T03:41:48.812883+0000 (oldest deadline 2026-02-20T03:42:17.013147+0000) 2026-02-20T03:42:23.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:22 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:22.989+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:57.513620+0000 front 2026-02-20T03:41:57.513672+0000 (oldest deadline 2026-02-20T03:42:21.613634+0000) 2026-02-20T03:42:23.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.988+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:23.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.988+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:23.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.988+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:23.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.988+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:23.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.988+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:23.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:22 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:22.988+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:24.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:24.016+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:16.809719+0000 front 2026-02-20T03:41:16.809763+0000 (oldest deadline 2026-02-20T03:41:42.009878+0000) 2026-02-20T03:42:24.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:24.016+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:24.310428+0000 front 2026-02-20T03:41:24.310440+0000 (oldest deadline 2026-02-20T03:41:49.010561+0000) 2026-02-20T03:42:24.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:24.016+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:30.611605+0000 front 2026-02-20T03:41:30.611573+0000 (oldest deadline 2026-02-20T03:41:55.311637+0000) 2026-02-20T03:42:24.345 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:24.016+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6814 osd.3 since back 2026-02-20T03:41:35.311881+0000 front 2026-02-20T03:41:35.311903+0000 (oldest deadline 2026-02-20T03:42:00.611909+0000) 2026-02-20T03:42:24.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:24.016+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:40.612105+0000 front 2026-02-20T03:41:40.612126+0000 (oldest deadline 2026-02-20T03:42:08.812580+0000) 2026-02-20T03:42:24.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:24.016+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:48.812803+0000 front 2026-02-20T03:41:48.812883+0000 (oldest deadline 2026-02-20T03:42:17.013147+0000) 2026-02-20T03:42:24.346 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10[61747]: 2026-02-20T03:42:24.016+0000 7fb0c5095640 -1 osd.10 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:57.513620+0000 front 2026-02-20T03:41:57.513672+0000 (oldest deadline 2026-02-20T03:42:21.613634+0000) 2026-02-20T03:42:24.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:23 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:23.995+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:24.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:23 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:23.995+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:24.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:23 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:23.995+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:24.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:23 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:23.995+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:24.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:23 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:23.995+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:24.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:23 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:23.995+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:24.947 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 podman[74306]: 2026-02-20 03:42:24.667170325 +0000 UTC m=+5.629086408 container died 8462e598297efe82c889dd1ddf6190a4d4db0f477d0f1781cd43d5e92fc53209 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.license=GPLv2) 2026-02-20T03:42:24.947 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 podman[74306]: 2026-02-20 03:42:24.675415403 +0000 UTC m=+5.637331466 container remove 8462e598297efe82c889dd1ddf6190a4d4db0f477d0f1781cd43d5e92fc53209 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7) 2026-02-20T03:42:24.947 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 bash[74306]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10 2026-02-20T03:42:24.947 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 podman[74433]: 2026-02-20 03:42:24.805897996 +0000 UTC m=+0.016224364 container create 9294344738a626ed3f5f11702a0249aea843bd3f4abbb66532cff36d97611e3d (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10-deactivate, ceph=True, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T03:42:24.948 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 podman[74433]: 2026-02-20 03:42:24.8383828 +0000 UTC m=+0.048709088 container init 9294344738a626ed3f5f11702a0249aea843bd3f4abbb66532cff36d97611e3d (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10-deactivate, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, ceph=True, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-20T03:42:24.948 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 podman[74433]: 2026-02-20 03:42:24.840796265 +0000 UTC m=+0.051122563 container start 9294344738a626ed3f5f11702a0249aea843bd3f4abbb66532cff36d97611e3d (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, ceph=True, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-20T03:42:24.948 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 podman[74433]: 2026-02-20 03:42:24.841292365 +0000 UTC m=+0.051618663 container attach 9294344738a626ed3f5f11702a0249aea843bd3f4abbb66532cff36d97611e3d (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10-deactivate, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, ceph=True, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-20T03:42:24.948 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 podman[74433]: 2026-02-20 03:42:24.799430995 +0000 UTC m=+0.009757293 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:42:24.948 INFO:journalctl@ceph.osd.10.trial126.stdout:Feb 20 03:42:24 trial126 podman[74433]: 2026-02-20 03:42:24.955693028 +0000 UTC m=+0.166019326 container died 9294344738a626ed3f5f11702a0249aea843bd3f4abbb66532cff36d97611e3d (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260218.004834-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, ceph=True) 2026-02-20T03:42:24.985 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.10.service' 2026-02-20T03:42:25.022 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:25.022 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-20T03:42:25.022 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-20T03:42:25.023 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.11 2026-02-20T03:42:25.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:24 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:24.955+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:25.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:24 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:24.955+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:25.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:24 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:24.955+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:25.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:24 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:24.955+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:25.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:24 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:24.955+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:25.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:24 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:24.955+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:25.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 systemd[1]: Stopping Ceph osd.11 for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:25.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:25.120+0000 7f4ca852c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:25.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:25.120+0000 7f4ca852c640 -1 osd.11 103 *** Got signal Terminated *** 2026-02-20T03:42:25.219 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:25.120+0000 7f4ca852c640 -1 osd.11 103 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-20T03:42:26.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:25.956+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:26.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:25.956+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:26.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:25.956+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:26.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:25.956+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:26.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:25.956+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:26.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:25 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:25.956+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:27.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:26 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:26.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:27.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:26 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:26.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:27.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:26 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:26.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:27.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:26 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:26.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:27.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:26 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:26.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:27.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:26 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:26.992+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:28.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:28.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:28.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:28.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:28.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:28.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:28.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.022+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6820 osd.7 since back 2026-02-20T03:42:05.052670+0000 front 2026-02-20T03:42:05.052702+0000 (oldest deadline 2026-02-20T03:42:27.952649+0000) 2026-02-20T03:42:29.467 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.974+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:29.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.974+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:29.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.974+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:29.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.974+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:29.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.974+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:29.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.974+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:29.468 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:28 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:28.974+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6820 osd.7 since back 2026-02-20T03:42:05.052670+0000 front 2026-02-20T03:42:05.052702+0000 (oldest deadline 2026-02-20T03:42:27.952649+0000) 2026-02-20T03:42:30.217 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:29 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:29.949+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6806 osd.0 since back 2026-02-20T03:41:19.547122+0000 front 2026-02-20T03:41:19.547266+0000 (oldest deadline 2026-02-20T03:41:41.747300+0000) 2026-02-20T03:42:30.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:29 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:29.949+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6804 osd.1 since back 2026-02-20T03:41:23.348108+0000 front 2026-02-20T03:41:23.348116+0000 (oldest deadline 2026-02-20T03:41:53.348489+0000) 2026-02-20T03:42:30.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:29 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:29.949+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6804 osd.2 since back 2026-02-20T03:41:33.348698+0000 front 2026-02-20T03:41:33.348708+0000 (oldest deadline 2026-02-20T03:41:55.048787+0000) 2026-02-20T03:42:30.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:29 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:29.949+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6812 osd.4 since back 2026-02-20T03:41:44.350347+0000 front 2026-02-20T03:41:44.350308+0000 (oldest deadline 2026-02-20T03:42:08.450359+0000) 2026-02-20T03:42:30.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:29 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:29.949+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.177:6812 osd.5 since back 2026-02-20T03:41:51.851015+0000 front 2026-02-20T03:41:51.851027+0000 (oldest deadline 2026-02-20T03:42:13.451391+0000) 2026-02-20T03:42:30.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:29 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:29.949+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.28:6822 osd.6 since back 2026-02-20T03:41:54.452242+0000 front 2026-02-20T03:41:54.452213+0000 (oldest deadline 2026-02-20T03:42:20.352177+0000) 2026-02-20T03:42:30.218 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:29 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11[66908]: 2026-02-20T03:42:29.949+0000 7f4ca0b3d640 -1 osd.11 103 heartbeat_check: no reply from 10.20.193.126:6820 osd.7 since back 2026-02-20T03:42:05.052670+0000 front 2026-02-20T03:42:05.052702+0000 (oldest deadline 2026-02-20T03:42:27.952649+0000) 2026-02-20T03:42:30.847 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:30 trial177 podman[80317]: 2026-02-20 03:42:30.544630388 +0000 UTC m=+5.436409102 container died 9d958a352ae4bf12b04b5b9ef6597d82107809ff897cd05235be988f8960af0e (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, ceph=True, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.schema-version=1.0, io.buildah.version=1.33.7, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2) 2026-02-20T03:42:30.847 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:30 trial177 podman[80317]: 2026-02-20 03:42:30.554576317 +0000 UTC m=+5.446355031 container remove 9d958a352ae4bf12b04b5b9ef6597d82107809ff897cd05235be988f8960af0e (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7) 2026-02-20T03:42:30.848 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:30 trial177 bash[80317]: ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11 2026-02-20T03:42:30.848 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:30 trial177 podman[80445]: 2026-02-20 03:42:30.681715347 +0000 UTC m=+0.014562909 container create 719f1a9341e7f0a7426752175c68d086456f20540a59df45863ce3134a696849 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11-deactivate, OSD_FLAVOR=default, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-20T03:42:30.848 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:30 trial177 podman[80445]: 2026-02-20 03:42:30.717560165 +0000 UTC m=+0.050407727 container init 719f1a9341e7f0a7426752175c68d086456f20540a59df45863ce3134a696849 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:42:30.848 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:30 trial177 podman[80445]: 2026-02-20 03:42:30.720080187 +0000 UTC m=+0.052927749 container start 719f1a9341e7f0a7426752175c68d086456f20540a59df45863ce3134a696849 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:42:30.848 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:30 trial177 podman[80445]: 2026-02-20 03:42:30.720718493 +0000 UTC m=+0.053566065 container attach 719f1a9341e7f0a7426752175c68d086456f20540a59df45863ce3134a696849 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11-deactivate, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03, io.buildah.version=1.33.7, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-20T03:42:30.848 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:30 trial177 podman[80445]: 2026-02-20 03:42:30.675664675 +0000 UTC m=+0.008512247 image pull de93007c0a7294fe21ee720a59af82756a09d70248e05dfaafd75692021039f7 quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285 2026-02-20T03:42:30.848 INFO:journalctl@ceph.osd.11.trial177.stdout:Feb 20 03:42:30 trial177 podman[80445]: 2026-02-20 03:42:30.847374175 +0000 UTC m=+0.180221737 container died 719f1a9341e7f0a7426752175c68d086456f20540a59df45863ce3134a696849 (image=quay.ceph.io/ceph-ci/ceph@sha256:a12073417505e16c1f8ea034ce0886f2a6277167fd1ac6925819a154c57ec285, name=ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-osd-11-deactivate, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260218.004834-squid, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_SHA1=f4ef35d9be574462cb661d0e0cbb2e9fbfb23f03) 2026-02-20T03:42:30.881 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@osd.11.service' 2026-02-20T03:42:30.918 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:30.918 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-20T03:42:30.919 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-20T03:42:30.919 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.a 2026-02-20T03:42:31.351 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 03:42:30 trial028 systemd[1]: Stopping Ceph mds.a for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:31.351 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 03:42:31 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-a[73045]: 2026-02-20T03:42:31.102+0000 7f9137871640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:31.351 INFO:journalctl@ceph.mds.a.trial028.stdout:Feb 20 03:42:31 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-a[73045]: 2026-02-20T03:42:31.102+0000 7f9137871640 -1 mds.a *** got signal Terminated *** 2026-02-20T03:42:32.229 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.a.service' 2026-02-20T03:42:32.299 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:32.299 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-20T03:42:32.300 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-20T03:42:32.300 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.d 2026-02-20T03:42:32.851 INFO:journalctl@ceph.mds.d.trial028.stdout:Feb 20 03:42:32 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-d[72210]: 2026-02-20T03:42:32.523+0000 7fc3358ee640 -1 mds.d *** got signal Terminated *** 2026-02-20T03:42:33.654 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.d.service' 2026-02-20T03:42:33.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:33.722 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-20T03:42:33.722 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-20T03:42:33.723 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.g 2026-02-20T03:42:34.101 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:42:33 trial028 systemd[1]: Stopping Ceph mds.g for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:34.101 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:42:33 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-g[72638]: 2026-02-20T03:42:33.900+0000 7f787bb69640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:34.101 INFO:journalctl@ceph.mds.g.trial028.stdout:Feb 20 03:42:33 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-g[72638]: 2026-02-20T03:42:33.900+0000 7f787bb69640 -1 mds.g *** got signal Terminated *** 2026-02-20T03:42:35.029 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.g.service' 2026-02-20T03:42:35.096 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:35.096 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-20T03:42:35.096 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-20T03:42:35.096 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.j 2026-02-20T03:42:35.601 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:42:35 trial028 systemd[1]: Stopping Ceph mds.j for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:35.601 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:42:35 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-j[71819]: 2026-02-20T03:42:35.281+0000 7f8d3fd75640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:35.602 INFO:journalctl@ceph.mds.j.trial028.stdout:Feb 20 03:42:35 trial028 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-j[71819]: 2026-02-20T03:42:35.281+0000 7f8d3fd75640 -1 mds.j *** got signal Terminated *** 2026-02-20T03:42:36.405 DEBUG:teuthology.orchestra.run.trial028:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.j.service' 2026-02-20T03:42:36.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:36.472 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-20T03:42:36.472 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-20T03:42:36.473 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.b 2026-02-20T03:42:36.845 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:42:36 trial126 systemd[1]: Stopping Ceph mds.b for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:36.845 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:42:36 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:42:36.587+0000 7fae05647640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:36.845 INFO:journalctl@ceph.mds.b.trial126.stdout:Feb 20 03:42:36 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-b[66218]: 2026-02-20T03:42:36.587+0000 7fae05647640 -1 mds.b *** got signal Terminated *** 2026-02-20T03:42:37.617 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.b.service' 2026-02-20T03:42:37.652 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:37.652 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-20T03:42:37.653 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-20T03:42:37.653 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.e 2026-02-20T03:42:37.845 INFO:journalctl@ceph.mds.e.trial126.stdout:Feb 20 03:42:37 trial126 systemd[1]: Stopping Ceph mds.e for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:37.845 INFO:journalctl@ceph.mds.e.trial126.stdout:Feb 20 03:42:37 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-e[65557]: 2026-02-20T03:42:37.794+0000 7effd417d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:37.845 INFO:journalctl@ceph.mds.e.trial126.stdout:Feb 20 03:42:37 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-e[65557]: 2026-02-20T03:42:37.794+0000 7effd417d640 -1 mds.e *** got signal Terminated *** 2026-02-20T03:42:38.817 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.e.service' 2026-02-20T03:42:38.850 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:38.850 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-20T03:42:38.850 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-20T03:42:38.851 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.h 2026-02-20T03:42:39.095 INFO:journalctl@ceph.mds.h.trial126.stdout:Feb 20 03:42:38 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-h[65883]: 2026-02-20T03:42:38.991+0000 7f86a25c5640 -1 mds.h *** got signal Terminated *** 2026-02-20T03:42:40.018 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.h.service' 2026-02-20T03:42:40.052 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:40.052 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-20T03:42:40.052 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-20T03:42:40.052 DEBUG:teuthology.orchestra.run.trial126:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.k 2026-02-20T03:42:40.345 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:42:40 trial126 systemd[1]: Stopping Ceph mds.k for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:40.345 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:42:40 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-k[65221]: 2026-02-20T03:42:40.199+0000 7fc9e8658640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:40.345 INFO:journalctl@ceph.mds.k.trial126.stdout:Feb 20 03:42:40 trial126 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-k[65221]: 2026-02-20T03:42:40.199+0000 7fc9e8658640 -1 mds.k *** got signal Terminated *** 2026-02-20T03:42:41.227 DEBUG:teuthology.orchestra.run.trial126:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.k.service' 2026-02-20T03:42:41.260 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:41.261 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-20T03:42:41.261 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-20T03:42:41.261 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.c 2026-02-20T03:42:41.718 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:42:41 trial177 systemd[1]: Stopping Ceph mds.c for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:41.718 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:42:41 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: 2026-02-20T03:42:41.364+0000 7f57e6e87640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:41.718 INFO:journalctl@ceph.mds.c.trial177.stdout:Feb 20 03:42:41 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-c[71171]: 2026-02-20T03:42:41.364+0000 7f57e6e87640 -1 mds.c *** got signal Terminated *** 2026-02-20T03:42:42.414 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.c.service' 2026-02-20T03:42:42.448 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:42.449 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-20T03:42:42.449 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-20T03:42:42.449 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.f 2026-02-20T03:42:42.584 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:42:42 trial177 systemd[1]: Stopping Ceph mds.f for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:42.967 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:42:42 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-f[70833]: 2026-02-20T03:42:42.583+0000 7f3bff4ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:42.968 INFO:journalctl@ceph.mds.f.trial177.stdout:Feb 20 03:42:42 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-f[70833]: 2026-02-20T03:42:42.583+0000 7f3bff4ba640 -1 mds.f *** got signal Terminated *** 2026-02-20T03:42:43.624 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.f.service' 2026-02-20T03:42:43.658 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:43.658 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-20T03:42:43.659 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-20T03:42:43.659 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.i 2026-02-20T03:42:43.967 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 20 03:42:43 trial177 systemd[1]: Stopping Ceph mds.i for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:43.968 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 20 03:42:43 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-i[71504]: 2026-02-20T03:42:43.790+0000 7f21a502d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:43.968 INFO:journalctl@ceph.mds.i.trial177.stdout:Feb 20 03:42:43 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-i[71504]: 2026-02-20T03:42:43.790+0000 7f21a502d640 -1 mds.i *** got signal Terminated *** 2026-02-20T03:42:44.837 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.i.service' 2026-02-20T03:42:44.870 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:44.871 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-20T03:42:44.871 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-20T03:42:44.871 DEBUG:teuthology.orchestra.run.trial177:> sudo systemctl stop ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.l 2026-02-20T03:42:45.004 INFO:journalctl@ceph.mds.l.trial177.stdout:Feb 20 03:42:44 trial177 systemd[1]: Stopping Ceph mds.l for bfaff8d7-0e09-11f1-8045-d404e6e7d460... 2026-02-20T03:42:45.467 INFO:journalctl@ceph.mds.l.trial177.stdout:Feb 20 03:42:45 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-l[70499]: 2026-02-20T03:42:45.003+0000 7fa89b282640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-20T03:42:45.467 INFO:journalctl@ceph.mds.l.trial177.stdout:Feb 20 03:42:45 trial177 ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460-mds-l[70499]: 2026-02-20T03:42:45.003+0000 7fa89b282640 -1 mds.l *** got signal Terminated *** 2026-02-20T03:42:46.038 DEBUG:teuthology.orchestra.run.trial177:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bfaff8d7-0e09-11f1-8045-d404e6e7d460@mds.l.service' 2026-02-20T03:42:46.072 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-20T03:42:46.072 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-20T03:42:46.073 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 --force --keep-logs 2026-02-20T03:42:46.254 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:42:49.547 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 --force --keep-logs 2026-02-20T03:42:49.661 INFO:teuthology.orchestra.run.trial126.stdout:Deleting cluster with fsid: bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:42:51.508 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 --force --keep-logs 2026-02-20T03:42:51.624 INFO:teuthology.orchestra.run.trial177.stdout:Deleting cluster with fsid: bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:42:53.462 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T03:42:53.521 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T03:42:53.550 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-20T03:42:53.579 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-20T03:42:53.582 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/remote/trial028/crash 2026-02-20T03:42:53.583 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/crash -- . 2026-02-20T03:42:53.640 INFO:teuthology.orchestra.run.trial028.stderr:tar: /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-20T03:42:53.641 INFO:teuthology.orchestra.run.trial028.stderr:tar: Error is not recoverable: exiting now 2026-02-20T03:42:53.644 DEBUG:teuthology.misc:Transferring archived files from trial126:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/remote/trial126/crash 2026-02-20T03:42:53.645 DEBUG:teuthology.orchestra.run.trial126:> sudo tar c -f - -C /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/crash -- . 2026-02-20T03:42:53.671 INFO:teuthology.orchestra.run.trial126.stderr:tar: /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-20T03:42:53.671 INFO:teuthology.orchestra.run.trial126.stderr:tar: Error is not recoverable: exiting now 2026-02-20T03:42:53.674 DEBUG:teuthology.misc:Transferring archived files from trial177:/var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/remote/trial177/crash 2026-02-20T03:42:53.675 DEBUG:teuthology.orchestra.run.trial177:> sudo tar c -f - -C /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/crash -- . 2026-02-20T03:42:53.701 INFO:teuthology.orchestra.run.trial177.stderr:tar: /var/lib/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-20T03:42:53.701 INFO:teuthology.orchestra.run.trial177.stderr:tar: Error is not recoverable: exiting now 2026-02-20T03:42:53.702 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-20T03:42:53.703 DEBUG:teuthology.orchestra.run.trial028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2026-02-20T03:42:53.776 INFO:teuthology.orchestra.run.trial028.stdout:2026-02-20T03:24:00.506651+0000 mds.b (mds.0) 74 : cluster [WRN] Scrub error on inode 0x10000000029 (/volumes/qa/sv_1/19cdb0c0-6ca5-4b99-964e-2013b2854021/client.0/tmp/clients/client0/~dmtmp/PARADOX) see mds.b log and `damage ls` output for details 2026-02-20T03:42:53.777 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-20T03:42:53.777 INFO:tasks.cephadm:Compressing logs... 2026-02-20T03:42:53.777 DEBUG:teuthology.orchestra.run.trial028:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T03:42:53.781 DEBUG:teuthology.orchestra.run.trial126:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T03:42:53.784 DEBUG:teuthology.orchestra.run.trial177:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T03:42:53.806 INFO:teuthology.orchestra.run.trial126.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-20T03:42:53.807 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-20T03:42:53.807 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mgr.y.log 2026-02-20T03:42:53.808 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.b.log 2026-02-20T03:42:53.808 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.h.log 2026-02-20T03:42:53.811 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mgr.y.log: /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.7.log 2026-02-20T03:42:53.811 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.h.log: 91.3% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-20T03:42:53.811 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.cephadm.log 2026-02-20T03:42:53.811 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.10.log 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.4.log 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr: 83.0% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.cephadm.log.gz 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.audit.log 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mon.b.log 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-volume.log 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.1.log 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.k.log 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.e.log 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr: 90.7% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.audit.log.gz 2026-02-20T03:42:53.812 INFO:teuthology.orchestra.run.trial126.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.k.log: /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.e.log: 93.4% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-20T03:42:53.813 INFO:teuthology.orchestra.run.trial126.stderr: 86.5% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log.gz 2026-02-20T03:42:53.817 INFO:teuthology.orchestra.run.trial177.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-20T03:42:53.817 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-20T03:42:53.817 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.2.log 2026-02-20T03:42:53.817 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.i.log 2026-02-20T03:42:53.817 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mon.c.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.f.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.5.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.cephadm.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.11.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.audit.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr: 83.0% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.cephadm.log.gz 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-volume.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mgr.z.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.audit.log: /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.l.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.c.log 2026-02-20T03:42:53.818 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log 2026-02-20T03:42:53.819 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.8.log 2026-02-20T03:42:53.819 INFO:teuthology.orchestra.run.trial177.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log: /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.8.log: 90.7% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.audit.log.gz 2026-02-20T03:42:53.819 INFO:teuthology.orchestra.run.trial177.stderr: 86.5% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log.gz 2026-02-20T03:42:53.819 INFO:teuthology.orchestra.run.trial177.stderr: 94.4% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.l.log.gz 2026-02-20T03:42:53.819 INFO:teuthology.orchestra.run.trial177.stderr: 93.5% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-20T03:42:53.820 INFO:teuthology.orchestra.run.trial177.stderr: 94.9% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-volume.log.gz 2026-02-20T03:42:53.820 INFO:teuthology.orchestra.run.trial126.stderr: 94.3% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.k.log.gz 2026-02-20T03:42:53.820 INFO:teuthology.orchestra.run.trial126.stderr: 94.9% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-volume.log.gz 2026-02-20T03:42:53.833 INFO:teuthology.orchestra.run.trial028.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2026-02-20T03:42:53.833 INFO:teuthology.orchestra.run.trial028.stderr: --verbose -- /var/log/ceph/cephadm.log 2026-02-20T03:42:53.834 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2026-02-20T03:42:53.834 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mon.a.log 2026-02-20T03:42:53.835 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.d.log 2026-02-20T03:42:53.836 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.j.log 2026-02-20T03:42:53.836 INFO:teuthology.orchestra.run.trial028.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2026-02-20T03:42:53.836 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.0.log 2026-02-20T03:42:53.839 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.j.log: /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.0.log: 94.7% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.d.log.gz 2026-02-20T03:42:53.840 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.3.log 2026-02-20T03:42:53.840 INFO:teuthology.orchestra.run.trial028.stderr: 94.2% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.j.log.gz 2026-02-20T03:42:53.841 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.cephadm.log 2026-02-20T03:42:53.842 INFO:teuthology.orchestra.run.trial028.stderr: 95.0% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-20T03:42:53.842 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.a.log 2026-02-20T03:42:53.842 INFO:teuthology.orchestra.run.trial028.stderr:gzip/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.cephadm.log: -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.g.log 2026-02-20T03:42:53.843 INFO:teuthology.orchestra.run.trial028.stderr: 82.8% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.cephadm.log.gz 2026-02-20T03:42:53.843 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.audit.log 2026-02-20T03:42:53.844 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.a.log: /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-volume.log 2026-02-20T03:42:53.844 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.6.log 2026-02-20T03:42:53.847 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-volume.log: /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose 90.5% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.audit.log.gz 2026-02-20T03:42:53.848 INFO:teuthology.orchestra.run.trial028.stderr: -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mgr.x.log 2026-02-20T03:42:53.848 INFO:teuthology.orchestra.run.trial028.stderr: 94.6% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.a.log.gz 2026-02-20T03:42:53.848 INFO:teuthology.orchestra.run.trial028.stderr: 94.7% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.g.log.gz 2026-02-20T03:42:53.848 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log 2026-02-20T03:42:53.848 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.9.log 2026-02-20T03:42:53.851 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log: /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.9.log: 86.6% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph.log.gz 2026-02-20T03:42:53.853 INFO:teuthology.orchestra.run.trial028.stderr: 94.6% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-volume.log.gz 2026-02-20T03:42:54.009 INFO:teuthology.orchestra.run.trial028.stderr: 90.5% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-20T03:42:54.100 INFO:teuthology.orchestra.run.trial126.stderr: 91.8% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mon.b.log.gz 2026-02-20T03:42:54.686 INFO:teuthology.orchestra.run.trial028.stderr: 90.4% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mon.a.log.gz 2026-02-20T03:42:54.926 INFO:teuthology.orchestra.run.trial177.stderr: 93.7% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mon.c.log.gz 2026-02-20T03:42:58.863 INFO:teuthology.orchestra.run.trial177.stderr: 95.2% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.f.log.gz 2026-02-20T03:43:00.515 INFO:teuthology.orchestra.run.trial126.stderr: 95.2% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.e.log.gz 2026-02-20T03:43:01.951 INFO:teuthology.orchestra.run.trial177.stderr: 95.2% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.c.log.gz 2026-02-20T03:43:21.591 INFO:teuthology.orchestra.run.trial126.stderr: 91.6% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.10.log.gz 2026-02-20T03:43:22.149 INFO:teuthology.orchestra.run.trial177.stderr: 91.6% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.11.log.gz 2026-02-20T03:43:22.529 INFO:teuthology.orchestra.run.trial126.stderr: 91.7% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.1.log.gz 2026-02-20T03:43:25.751 INFO:teuthology.orchestra.run.trial028.stderr: 91.7% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.0.log.gz 2026-02-20T03:43:29.575 INFO:teuthology.orchestra.run.trial177.stderr: 91.3% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.8.log.gz 2026-02-20T03:43:32.749 INFO:teuthology.orchestra.run.trial028.stderr: 91.3% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.6.log.gz 2026-02-20T03:43:33.481 INFO:teuthology.orchestra.run.trial126.stderr: 91.4% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.7.log.gz 2026-02-20T03:43:33.740 INFO:teuthology.orchestra.run.trial177.stderr: 91.5% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.2.log.gz 2026-02-20T03:43:33.881 INFO:teuthology.orchestra.run.trial028.stderr: 91.4% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.3.log.gz 2026-02-20T03:43:37.518 INFO:teuthology.orchestra.run.trial126.stderr: 91.5% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.4.log.gz 2026-02-20T03:43:39.094 INFO:teuthology.orchestra.run.trial028.stderr: 91.3% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.9.log.gz 2026-02-20T03:43:39.097 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-20T03:43:39.097 INFO:teuthology.orchestra.run.trial028.stderr:real 0m45.283s 2026-02-20T03:43:39.097 INFO:teuthology.orchestra.run.trial028.stderr:user 2m22.271s 2026-02-20T03:43:39.097 INFO:teuthology.orchestra.run.trial028.stderr:sys 0m14.895s 2026-02-20T03:43:42.694 INFO:teuthology.orchestra.run.trial177.stderr: 91.2% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-osd.5.log.gz 2026-02-20T03:44:48.607 INFO:teuthology.orchestra.run.trial177.stderr: 93.4% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.i.log.gz 2026-02-20T03:44:48.608 INFO:teuthology.orchestra.run.trial177.stderr: 2026-02-20T03:44:48.609 INFO:teuthology.orchestra.run.trial177.stderr:real 1m54.808s 2026-02-20T03:44:48.609 INFO:teuthology.orchestra.run.trial177.stderr:user 4m30.692s 2026-02-20T03:44:48.609 INFO:teuthology.orchestra.run.trial177.stderr:sys 0m10.779s 2026-02-20T03:45:20.575 INFO:teuthology.orchestra.run.trial126.stderr: 93.5% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.h.log.gz 2026-02-20T03:46:02.698 INFO:teuthology.orchestra.run.trial126.stderr: 93.5% -- replaced with /var/log/ceph/bfaff8d7-0e09-11f1-8045-d404e6e7d460/ceph-mds.b.log.gz 2026-02-20T03:46:02.700 INFO:teuthology.orchestra.run.trial126.stderr: 2026-02-20T03:46:02.700 INFO:teuthology.orchestra.run.trial126.stderr:real 3m8.902s 2026-02-20T03:46:02.700 INFO:teuthology.orchestra.run.trial126.stderr:user 7m43.184s 2026-02-20T03:46:02.700 INFO:teuthology.orchestra.run.trial126.stderr:sys 0m18.315s 2026-02-20T03:46:02.701 INFO:tasks.cephadm:Archiving logs... 2026-02-20T03:46:02.702 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/log/ceph to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/remote/trial028/log 2026-02-20T03:46:02.703 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T03:46:15.207 DEBUG:teuthology.misc:Transferring archived files from trial126:/var/log/ceph to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/remote/trial126/log 2026-02-20T03:46:15.208 DEBUG:teuthology.orchestra.run.trial126:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T03:46:50.705 DEBUG:teuthology.misc:Transferring archived files from trial177:/var/log/ceph to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/remote/trial177/log 2026-02-20T03:46:50.706 DEBUG:teuthology.orchestra.run.trial177:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T03:47:12.552 INFO:tasks.cephadm:Removing cluster... 2026-02-20T03:47:12.552 DEBUG:teuthology.orchestra.run.trial028:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 --force 2026-02-20T03:47:12.741 INFO:teuthology.orchestra.run.trial028.stdout:Deleting cluster with fsid: bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:47:13.448 DEBUG:teuthology.orchestra.run.trial126:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 --force 2026-02-20T03:47:13.563 INFO:teuthology.orchestra.run.trial126.stdout:Deleting cluster with fsid: bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:47:14.746 DEBUG:teuthology.orchestra.run.trial177:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bfaff8d7-0e09-11f1-8045-d404e6e7d460 --force 2026-02-20T03:47:14.864 INFO:teuthology.orchestra.run.trial177.stdout:Deleting cluster with fsid: bfaff8d7-0e09-11f1-8045-d404e6e7d460 2026-02-20T03:47:15.655 INFO:tasks.cephadm:Removing cephadm ... 2026-02-20T03:47:15.655 DEBUG:teuthology.orchestra.run.trial028:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-20T03:47:15.694 DEBUG:teuthology.orchestra.run.trial126:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-20T03:47:15.711 DEBUG:teuthology.orchestra.run.trial177:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-20T03:47:15.730 INFO:tasks.cephadm:Teardown complete 2026-02-20T03:47:15.731 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T03:47:15.744 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T03:47:15.744 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T03:47:15.748 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T03:47:15.754 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T03:47:16.021 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T03:47:16.032 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T03:47:16.032 DEBUG:teuthology.orchestra.run.trial028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T03:47:16.035 DEBUG:teuthology.orchestra.run.trial126:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T03:47:16.037 DEBUG:teuthology.orchestra.run.trial177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T03:47:16.051 INFO:teuthology.orchestra.run.trial126.stderr:bash: line 1: ntpq: command not found 2026-02-20T03:47:16.053 INFO:teuthology.orchestra.run.trial177.stderr:bash: line 1: ntpq: command not found 2026-02-20T03:47:16.069 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-20T03:47:16.083 INFO:teuthology.orchestra.run.trial126.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T03:47:16.083 INFO:teuthology.orchestra.run.trial126.stdout:=============================================================================== 2026-02-20T03:47:16.083 INFO:teuthology.orchestra.run.trial126.stdout:^- 172-233-157-223.ip.linod> 2 8 377 132 +3514us[+3528us] +/- 128ms 2026-02-20T03:47:16.083 INFO:teuthology.orchestra.run.trial126.stdout:^* connected.by.freedominte> 2 8 377 9 +11ms[ +11ms] +/- 41ms 2026-02-20T03:47:16.083 INFO:teuthology.orchestra.run.trial126.stdout:^+ t2.time.gq1.yahoo.com 2 8 377 334 -25ms[ -25ms] +/- 68ms 2026-02-20T03:47:16.083 INFO:teuthology.orchestra.run.trial126.stdout:^+ time4.lshiy.com 2 7 377 269 +11ms[ +11ms] +/- 131ms 2026-02-20T03:47:16.083 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T03:47:16.083 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial028.stdout:^- 172-233-157-223.ip.linod> 2 6 377 6 -5337us[-5337us] +/- 131ms 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial028.stdout:^- connected.by.freedominte> 2 6 377 9 -501us[ -501us] +/- 41ms 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial028.stdout:^* ntp.swyn.net 2 7 377 74 +141us[ +163us] +/- 8263us 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial028.stdout:^- time4.lshiy.com 2 6 377 9 +225us[ +225us] +/- 135ms 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial177.stdout:=============================================================================== 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial177.stdout:^- 172-233-157-223.ip.linod> 2 8 377 200 -4566us[-4570us] +/- 127ms 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial177.stdout:^+ connected.by.freedominte> 2 7 377 134 +1364us[+1358us] +/- 41ms 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial177.stdout:^* time2.hflnetworks.net 2 7 377 75 -616us[ -623us] +/- 29ms 2026-02-20T03:47:16.084 INFO:teuthology.orchestra.run.trial177.stdout:^- time4.lshiy.com 2 8 377 134 +1730us[+1723us] +/- 134ms 2026-02-20T03:47:16.085 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T03:47:16.096 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T03:47:16.096 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T03:47:16.111 DEBUG:teuthology.orchestra.run.trial028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T03:47:16.251 DEBUG:teuthology.orchestra.run.trial126:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T03:47:16.309 DEBUG:teuthology.orchestra.run.trial177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T03:47:16.368 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T03:47:16.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:47:16.430 DEBUG:teuthology.orchestra.run.trial126:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T03:47:16.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:47:16.457 DEBUG:teuthology.orchestra.run.trial177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-20T03:47:16.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:47:16.485 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T03:47:16.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T03:47:16.519 INFO:teuthology.task.internal:Duration was 2515.614537 seconds 2026-02-20T03:47:16.520 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T03:47:16.539 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T03:47:16.539 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T03:47:16.543 DEBUG:teuthology.orchestra.run.trial126:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T03:47:16.546 DEBUG:teuthology.orchestra.run.trial177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T03:47:16.581 INFO:teuthology.orchestra.run.trial126.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T03:47:16.582 INFO:teuthology.orchestra.run.trial177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T03:47:16.622 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T03:47:16.897 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T03:47:16.897 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial028.front.sepia.ceph.com 2026-02-20T03:47:16.898 DEBUG:teuthology.orchestra.run.trial028:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T03:47:16.943 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial126.front.sepia.ceph.com 2026-02-20T03:47:16.944 DEBUG:teuthology.orchestra.run.trial126:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T03:47:16.964 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial177.front.sepia.ceph.com 2026-02-20T03:47:16.965 DEBUG:teuthology.orchestra.run.trial177:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T03:47:16.984 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T03:47:16.985 DEBUG:teuthology.orchestra.run.trial028:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:47:16.989 DEBUG:teuthology.orchestra.run.trial126:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:47:17.007 DEBUG:teuthology.orchestra.run.trial177:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:47:18.231 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T03:47:18.231 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T03:47:18.235 DEBUG:teuthology.orchestra.run.trial126:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T03:47:18.238 DEBUG:teuthology.orchestra.run.trial177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T03:47:18.260 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:47:18.262 INFO:teuthology.orchestra.run.trial126.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:47:18.262 INFO:teuthology.orchestra.run.trial126.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:47:18.262 INFO:teuthology.orchestra.run.trial126.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T03:47:18.262 INFO:teuthology.orchestra.run.trial126.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T03:47:18.265 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:47:18.265 INFO:teuthology.orchestra.run.trial177.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:47:18.265 INFO:teuthology.orchestra.run.trial177.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:47:18.265 INFO:teuthology.orchestra.run.trial177.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T03:47:18.265 INFO:teuthology.orchestra.run.trial177.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T03:47:18.280 INFO:teuthology.orchestra.run.trial126.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T03:47:18.284 INFO:teuthology.orchestra.run.trial177.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.6% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T03:47:18.286 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T03:47:18.287 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T03:47:18.288 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T03:47:18.288 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T03:47:18.288 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T03:47:18.515 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 91.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T03:47:18.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T03:47:18.539 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T03:47:18.539 DEBUG:teuthology.orchestra.run.trial028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T03:47:18.596 DEBUG:teuthology.orchestra.run.trial126:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T03:47:18.621 DEBUG:teuthology.orchestra.run.trial177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T03:47:18.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T03:47:18.666 DEBUG:teuthology.orchestra.run.trial028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:47:18.669 DEBUG:teuthology.orchestra.run.trial126:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:47:18.673 DEBUG:teuthology.orchestra.run.trial177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:47:18.695 INFO:teuthology.orchestra.run.trial126.stdout:kernel.core_pattern = core 2026-02-20T03:47:18.708 INFO:teuthology.orchestra.run.trial177.stdout:kernel.core_pattern = core 2026-02-20T03:47:18.739 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = core 2026-02-20T03:47:18.766 DEBUG:teuthology.orchestra.run.trial028:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:47:18.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:47:18.803 DEBUG:teuthology.orchestra.run.trial126:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:47:18.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:47:18.820 DEBUG:teuthology.orchestra.run.trial177:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T03:47:18.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T03:47:18.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T03:47:18.857 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T03:47:18.858 DEBUG:teuthology.misc:Transferring archived files from trial028:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/remote/trial028 2026-02-20T03:47:18.858 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T03:47:18.981 DEBUG:teuthology.misc:Transferring archived files from trial126:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/remote/trial126 2026-02-20T03:47:18.981 DEBUG:teuthology.orchestra.run.trial126:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T03:47:19.018 DEBUG:teuthology.misc:Transferring archived files from trial177:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jcollin-2026-02-18_03:11:55-fs-wip-jcollin-testing-20260218.004834-squid-distro-default-trial/55462/remote/trial177 2026-02-20T03:47:19.018 DEBUG:teuthology.orchestra.run.trial177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T03:47:19.057 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T03:47:19.058 DEBUG:teuthology.orchestra.run.trial028:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T03:47:19.062 DEBUG:teuthology.orchestra.run.trial126:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T03:47:19.064 DEBUG:teuthology.orchestra.run.trial177:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T03:47:19.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T03:47:19.124 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T03:47:19.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T03:47:19.143 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T03:47:19.144 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T03:47:19.148 DEBUG:teuthology.orchestra.run.trial126:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T03:47:19.151 DEBUG:teuthology.orchestra.run.trial177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T03:47:19.166 INFO:teuthology.orchestra.run.trial126.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 03:47 /home/ubuntu/cephtest 2026-02-20T03:47:19.167 INFO:teuthology.orchestra.run.trial177.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 03:47 /home/ubuntu/cephtest 2026-02-20T03:47:19.182 INFO:teuthology.orchestra.run.trial028.stdout: 1048605 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 03:47 /home/ubuntu/cephtest 2026-02-20T03:47:19.185 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T03:47:19.205 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T03:47:19.251 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-kernel 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} duration: 2515.6145367622375 failure_reason: 'error during quiesce thrashing: Error quiescing set ''f621fbc0'': 110 (ETIMEDOUT)' flavor: default owner: scheduled_jcollin@soko04.front.sepia.ceph.com status: fail success: false 2026-02-20T03:47:19.251 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T03:47:19.370 INFO:teuthology.run:FAIL